> Training Environment: | > Backend: Accelerate | > Mixed precision: False | > Precision: float32 | > Current device: 0 | > Num. of GPUs: 8 | > Num. of CPUs: 32 | > Num. of Torch Threads: 1 | > Torch seed: 54321 | > Torch CUDNN: True | > Torch CUDNN deterministic: False | > Torch CUDNN benchmark: False | > Torch TF32 MatMul: False > Start Tensorboard: tensorboard --logdir=runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000 > Restoring from checkpoint_53000.pth ... > Restoring Model... > Restoring Optimizer... > Restoring from checkpoint_53000.pth ... > Restoring Model... > Restoring from checkpoint_53000.pth ... > Restoring Model... > Restoring Optimizer... > Restoring from checkpoint_53000.pth ... > Restoring from checkpoint_53000.pth ... > Restoring from checkpoint_53000.pth ... > Restoring Optimizer... > Restoring from checkpoint_53000.pth ... > Restoring from checkpoint_53000.pth ... > Model restored from step 53000 > Restoring Model... > Restoring Model... > Restoring Model... > Restoring Model... > Restoring Model... > Restoring Optimizer... > Restoring Optimizer... > Restoring Optimizer... > Restoring Optimizer... > Restoring Optimizer... > Model restored from step 53000 > Model restored from step 53000 > Model restored from step 53000 > Model restored from step 53000 > Model restored from step 53000 > Model restored from step 53000 > Model restored from step 53000 > Model has 83074156 parameters  > EPOCH: 0/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:41:18)   --> TIME: 2023-10-19 23:41:35 -- STEP: 9/50 -- GLOBAL_STEP: 53010 | > loss_disc: 3.41275954246521 (5.4153762393527565) | > loss_disc_real_0: 0.1597934365272522 (1.1276010208659701) | > loss_disc_real_1: 0.2670835256576538 (0.35046319829093087) | > loss_disc_real_2: 0.3282585144042969 (0.39491676663359004) | > loss_disc_real_3: 0.19565331935882568 (0.27089477909935844) | > loss_disc_real_4: 0.3353975713253021 (0.2696611475613382) | > loss_disc_real_5: 0.5806218981742859 (0.25186553866499) | > loss_0: 3.41275954246521 (5.4153762393527565) | > grad_norm_0: tensor(5167.3335, device='cuda:0') (tensor(475402.4062, device='cuda:0')) | > loss_gen: 3.125758647918701 (3.7561258474985757) | > loss_kl: 3.127525806427002 (3.9372116724650064) | > loss_feat: 6.786253929138184 (9.745250198576185) | > loss_mel: 21.712026596069336 (21.456592559814453) | > loss_duration: 2.4740805625915527 (2.4694792297151356) | > loss_1: 37.225643157958984 (41.36465962727865) | > grad_norm_1: tensor(99971.0078, device='cuda:0') (tensor(26389.2090, device='cuda:0')) | > current_lr_0: 0.0002 | > current_lr_1: 0.0002 | > step_time: 0.5945 (0.5584206581115723) | > loader_time: 0.0242 (0.02566748195224338)  --> TIME: 2023-10-19 23:41:53 -- STEP: 39/50 -- GLOBAL_STEP: 53040 | > loss_disc: 2.849456787109375 (5.170341711777908) | > loss_disc_real_0: 0.02670641429722309 (0.8842799611485157) | > loss_disc_real_1: 0.20483344793319702 (0.34350624374854266) | > loss_disc_real_2: 0.23831231892108917 (0.39098165346643865) | > loss_disc_real_3: 0.2424740046262741 (0.29792357923892826) | > loss_disc_real_4: 0.08207374066114426 (0.3185181458217976) | > loss_disc_real_5: 0.2653448283672333 (0.3239083921489043) | > loss_0: 2.849456787109375 (5.170341711777908) | > grad_norm_0: tensor(2960.2908, device='cuda:0') (tensor(117164.8984, device='cuda:0')) | > loss_gen: 1.8150804042816162 (3.566448926925659) | > loss_kl: 2.965264320373535 (5.231447342114571) | > loss_feat: 4.286157608032227 (7.914351809101224) | > loss_mel: 39.931739807128906 (34.53156856390147) | > loss_duration: 1.9064830541610718 (2.090785371951567) | > loss_1: 50.90472412109375 (53.334602013612404) | > grad_norm_1: tensor(60424.2656, device='cuda:0') (tensor(81690.8828, device='cuda:0')) | > current_lr_0: 0.0002 | > current_lr_1: 0.0002 | > step_time: 0.6018 (0.5847359865139692) | > loader_time: 0.0272 (0.022692503073276617)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.3519749641418457 (3.3519749641418457) | > loss_disc_real_0: 0.6653248071670532 (0.6653248071670532) | > loss_disc_real_1: 0.4339384436607361 (0.4339384436607361) | > loss_disc_real_2: 0.3902605175971985 (0.3902605175971985) | > loss_disc_real_3: 0.3045373260974884 (0.3045373260974884) | > loss_disc_real_4: 0.4323318898677826 (0.4323318898677826) | > loss_disc_real_5: 0.23089267313480377 (0.23089267313480377) | > loss_0: 3.3519749641418457 (3.3519749641418457) | > loss_gen: 2.492807388305664 (2.492807388305664) | > loss_kl: 2.5124399662017822 (2.5124399662017822) | > loss_feat: 0.3251303434371948 (0.3251303434371948) | > loss_mel: 23.9743709564209 (23.9743709564209) | > loss_duration: 2.0844316482543945 (2.0844316482543945) | > loss_1: 31.389179229736328 (31.389179229736328)  --> STEP: 1 | > loss_disc: 4.56552267074585 (4.56552267074585) | > loss_disc_real_0: 2.403567314147949 (2.403567314147949) | > loss_disc_real_1: 0.3158210515975952 (0.3158210515975952) | > loss_disc_real_2: 0.19250303506851196 (0.19250303506851196) | > loss_disc_real_3: 0.16642478108406067 (0.16642478108406067) | > loss_disc_real_4: 0.4145509898662567 (0.4145509898662567) | > loss_disc_real_5: 0.10695217549800873 (0.10695217549800873) | > loss_0: 4.56552267074585 (4.56552267074585) | > loss_gen: 3.1474061012268066 (3.1474061012268066) | > loss_kl: 2.6702682971954346 (2.6702682971954346) | > loss_feat: 5.87401008605957 (5.87401008605957) | > loss_mel: 34.08002471923828 (34.08002471923828) | > loss_duration: 2.23026180267334 (2.23026180267334) | > loss_1: 48.00197219848633 (48.00197219848633)  --> STEP: 2 | > loss_disc: 13.34227466583252 (8.953898668289185) | > loss_disc_real_0: 10.169878005981445 (6.286722660064697) | > loss_disc_real_1: 0.2081991583108902 (0.2620101049542427) | > loss_disc_real_2: 0.09192673116922379 (0.14221488311886787) | > loss_disc_real_3: 0.0858975201845169 (0.1261611506342888) | > loss_disc_real_4: 1.0506465435028076 (0.7325987666845322) | > loss_disc_real_5: 0.45668500661849976 (0.28181859105825424) | > loss_0: 13.34227466583252 (8.953898668289185) | > loss_gen: 2.77761173248291 (2.9625089168548584) | > loss_kl: 2.683722734451294 (2.6769955158233643) | > loss_feat: 12.73723030090332 (9.305620193481445) | > loss_mel: 48.50876998901367 (41.29439735412598) | > loss_duration: 2.0860636234283447 (2.1581627130508423) | > loss_1: 68.79340362548828 (58.397687911987305)  --> STEP: 3 | > loss_disc: 3.7703051567077637 (7.226034164428711) | > loss_disc_real_0: 1.0958850383758545 (4.556443452835083) | > loss_disc_real_1: 0.43731364607810974 (0.32044461866219837) | > loss_disc_real_2: 0.2769874632358551 (0.18713907649119696) | > loss_disc_real_3: 0.2507530748844147 (0.1676917920509974) | > loss_disc_real_4: 0.6710675358772278 (0.7120883564154307) | > loss_disc_real_5: 0.06190114840865135 (0.20851277684171995) | > loss_0: 3.7703051567077637 (7.226034164428711) | > loss_gen: 2.869696855545044 (2.9315715630849204) | > loss_kl: 2.5925159454345703 (2.6488356590270996) | > loss_feat: 3.55167818069458 (7.38763952255249) | > loss_mel: 39.64864730834961 (40.74581400553385) | > loss_duration: 2.1945114135742188 (2.1702789465586343) | > loss_1: 50.857051849365234 (55.884142557779946) --> EVAL PERFORMANCE | > avg_loader_time: 0.01001739501953125 (+0) | > avg_loss_disc: 7.226034164428711 (+0) | > avg_loss_disc_real_0: 4.556443452835083 (+0) | > avg_loss_disc_real_1: 0.32044461866219837 (+0) | > avg_loss_disc_real_2: 0.18713907649119696 (+0) | > avg_loss_disc_real_3: 0.1676917920509974 (+0) | > avg_loss_disc_real_4: 0.7120883564154307 (+0) | > avg_loss_disc_real_5: 0.20851277684171995 (+0) | > avg_loss_0: 7.226034164428711 (+0) | > avg_loss_gen: 2.9315715630849204 (+0) | > avg_loss_kl: 2.6488356590270996 (+0) | > avg_loss_feat: 7.38763952255249 (+0) | > avg_loss_mel: 40.74581400553385 (+0) | > avg_loss_duration: 2.1702789465586343 (+0) | > avg_loss_1: 55.884142557779946 (+0) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_53051.pth  > EPOCH: 1/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:42:12)   --> TIME: 2023-10-19 23:42:25 -- STEP: 19/50 -- GLOBAL_STEP: 53070 | > loss_disc: 3.083796739578247 (4.08755340074238) | > loss_disc_real_0: 0.23077048361301422 (0.6160921156406403) | > loss_disc_real_1: 0.28318023681640625 (0.3400238481791396) | > loss_disc_real_2: 0.3023638129234314 (0.5318903550505638) | > loss_disc_real_3: 0.2501983642578125 (0.3675033630509126) | > loss_disc_real_4: 0.6067788600921631 (0.37159963795229006) | > loss_disc_real_5: 0.12353448569774628 (0.2859123364875191) | > loss_0: 3.083796739578247 (4.08755340074238) | > grad_norm_0: tensor(771.5519, device='cuda:0') (tensor(1971.9679, device='cuda:0')) | > loss_gen: 1.7417734861373901 (2.504806713054055) | > loss_kl: 1.8968440294265747 (2.4435222776312577) | > loss_feat: 5.067708969116211 (5.047163298255519) | > loss_mel: 36.793426513671875 (35.98317537809673) | > loss_duration: 2.2233328819274902 (2.1982637894781014) | > loss_1: 47.72308349609375 (48.17693188315943) | > grad_norm_1: tensor(38184.2656, device='cuda:0') (tensor(46834.6992, device='cuda:0')) | > current_lr_0: 0.00019980008747812837 | > current_lr_1: 0.00019980008747812837 | > step_time: 0.6499 (0.5268838531092593) | > loader_time: 0.0043 (0.01371974694101434)  --> TIME: 2023-10-19 23:42:43 -- STEP: 49/50 -- GLOBAL_STEP: 53100 | > loss_disc: 2.562654495239258 (3.3146422590528215) | > loss_disc_real_0: 0.33188527822494507 (0.35818276793829035) | > loss_disc_real_1: 0.2829611003398895 (0.2715130284884755) | > loss_disc_real_2: 0.2466539889574051 (0.3348237349062549) | > loss_disc_real_3: 0.2737991511821747 (0.2894159566078867) | > loss_disc_real_4: 0.4148522615432739 (0.2899957508304898) | > loss_disc_real_5: 0.21653775870800018 (0.2634928455690341) | > loss_0: 2.562654495239258 (3.3146422590528215) | > grad_norm_0: tensor(520.0343, device='cuda:0') (tensor(1342.0991, device='cuda:0')) | > loss_gen: 2.6571528911590576 (2.1731959970629946) | > loss_kl: 1.486864686012268 (2.2496199534863845) | > loss_feat: 4.111755847930908 (4.751565278792868) | > loss_mel: 36.72529983520508 (33.48463268669285) | > loss_duration: 2.208014965057373 (2.112705405877561) | > loss_1: 47.189090728759766 (44.771719445987635) | > grad_norm_1: tensor(24886.5410, device='cuda:0') (tensor(36382.5156, device='cuda:0')) | > current_lr_0: 0.00019980008747812837 | > current_lr_1: 0.00019980008747812837 | > step_time: 0.7832 (0.5519589599297973) | > loader_time: 0.1984 (0.020123559601452887)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.02810001373291 (2.02810001373291) | > loss_disc_real_0: 0.19319218397140503 (0.19319218397140503) | > loss_disc_real_1: 0.17623166739940643 (0.17623166739940643) | > loss_disc_real_2: 0.14269930124282837 (0.14269930124282837) | > loss_disc_real_3: 0.34623682498931885 (0.34623682498931885) | > loss_disc_real_4: 0.2656033933162689 (0.2656033933162689) | > loss_disc_real_5: 0.06827355176210403 (0.06827355176210403) | > loss_0: 2.02810001373291 (2.02810001373291) | > loss_gen: 2.617753505706787 (2.617753505706787) | > loss_kl: 2.102673053741455 (2.102673053741455) | > loss_feat: 10.016183853149414 (10.016183853149414) | > loss_mel: 32.71315002441406 (32.71315002441406) | > loss_duration: 2.0578231811523438 (2.0578231811523438) | > loss_1: 49.50758361816406 (49.50758361816406)  --> STEP: 1 | > loss_disc: 2.215458869934082 (2.215458869934082) | > loss_disc_real_0: 0.21967639029026031 (0.21967639029026031) | > loss_disc_real_1: 0.31014880537986755 (0.31014880537986755) | > loss_disc_real_2: 0.21074539422988892 (0.21074539422988892) | > loss_disc_real_3: 0.23424755036830902 (0.23424755036830902) | > loss_disc_real_4: 0.08513021469116211 (0.08513021469116211) | > loss_disc_real_5: 0.18287403881549835 (0.18287403881549835) | > loss_0: 2.215458869934082 (2.215458869934082) | > loss_gen: 2.235520601272583 (2.235520601272583) | > loss_kl: 2.380002021789551 (2.380002021789551) | > loss_feat: 5.432464599609375 (5.432464599609375) | > loss_mel: 32.81386184692383 (32.81386184692383) | > loss_duration: 2.132997751235962 (2.132997751235962) | > loss_1: 44.99484634399414 (44.99484634399414)  --> STEP: 2 | > loss_disc: 2.2721755504608154 (2.2438172101974487) | > loss_disc_real_0: 0.19776636362075806 (0.20872137695550919) | > loss_disc_real_1: 0.31304165720939636 (0.31159523129463196) | > loss_disc_real_2: 0.3511107265949249 (0.2809280604124069) | > loss_disc_real_3: 0.21630190312862396 (0.2252747267484665) | > loss_disc_real_4: 0.19198457896709442 (0.13855739682912827) | > loss_disc_real_5: 0.08847033232450485 (0.1356721855700016) | > loss_0: 2.2721755504608154 (2.2438172101974487) | > loss_gen: 2.489332914352417 (2.3624267578125) | > loss_kl: 2.327037811279297 (2.353519916534424) | > loss_feat: 5.712646484375 (5.5725555419921875) | > loss_mel: 34.845176696777344 (33.829519271850586) | > loss_duration: 2.06801176071167 (2.100504755973816) | > loss_1: 47.44220733642578 (46.21852684020996)  --> STEP: 3 | > loss_disc: 2.5179972648620605 (2.3352105617523193) | > loss_disc_real_0: 0.47281399369239807 (0.2967522492011388) | > loss_disc_real_1: 0.4920518100261688 (0.37174742420514423) | > loss_disc_real_2: 0.30963411927223206 (0.2904967466990153) | > loss_disc_real_3: 0.2860388457775116 (0.24552943309148154) | > loss_disc_real_4: 0.26973816752433777 (0.1822843203941981) | > loss_disc_real_5: 0.0777171403169632 (0.11635383715232213) | > loss_0: 2.5179972648620605 (2.3352105617523193) | > loss_gen: 3.027385711669922 (2.5840797424316406) | > loss_kl: 2.0623908042907715 (2.256476879119873) | > loss_feat: 8.277031898498535 (6.474047660827637) | > loss_mel: 48.504913330078125 (38.721317291259766) | > loss_duration: 2.238248825073242 (2.1464194456736245) | > loss_1: 64.10997009277344 (52.18234125773112) --> EVAL PERFORMANCE | > avg_loader_time: 0.015147765477498373 (+0.005130370457967123) | > avg_loss_disc: 2.3352105617523193 (-4.890823602676392) | > avg_loss_disc_real_0: 0.2967522492011388 (-4.2596912036339445) | > avg_loss_disc_real_1: 0.37174742420514423 (+0.05130280554294586) | > avg_loss_disc_real_2: 0.2904967466990153 (+0.10335767020781836) | > avg_loss_disc_real_3: 0.24552943309148154 (+0.07783764104048413) | > avg_loss_disc_real_4: 0.1822843203941981 (-0.5298040360212326) | > avg_loss_disc_real_5: 0.11635383715232213 (-0.09215893968939783) | > avg_loss_0: 2.3352105617523193 (-4.890823602676392) | > avg_loss_gen: 2.5840797424316406 (-0.34749182065327977) | > avg_loss_kl: 2.256476879119873 (-0.39235877990722656) | > avg_loss_feat: 6.474047660827637 (-0.9135918617248535) | > avg_loss_mel: 38.721317291259766 (-2.024496714274086) | > avg_loss_duration: 2.1464194456736245 (-0.023859500885009766) | > avg_loss_1: 52.18234125773112 (-3.701801300048828) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_53101.pth  > EPOCH: 2/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:42:51)   --> TIME: 2023-10-19 23:43:06 -- STEP: 29/50 -- GLOBAL_STEP: 53130 | > loss_disc: 3.032580614089966 (2.632964479512182) | > loss_disc_real_0: 0.12674809992313385 (0.2256600041070889) | > loss_disc_real_1: 0.26511168479919434 (0.2609463596138461) | > loss_disc_real_2: 0.273297518491745 (0.25086420896495204) | > loss_disc_real_3: 0.2631198763847351 (0.23592223175640764) | > loss_disc_real_4: 0.19299091398715973 (0.2575666399608398) | > loss_disc_real_5: 0.2786494195461273 (0.2722124746390458) | > loss_0: 3.032580614089966 (2.632964479512182) | > grad_norm_0: tensor(1379.1073, device='cuda:0') (tensor(956.0488, device='cuda:0')) | > loss_gen: 1.4508646726608276 (2.349598000789511) | > loss_kl: 1.771257758140564 (1.9746861868891223) | > loss_feat: 0.2225218415260315 (5.3309221357620995) | > loss_mel: 23.881301879882812 (30.796863227054992) | > loss_duration: 2.1334481239318848 (2.113472132847227) | > loss_1: 29.459394454956055 (42.56554116873905) | > grad_norm_1: tensor(25594.9258, device='cuda:0') (tensor(35289.2812, device='cuda:0')) | > current_lr_0: 0.00019960037478133875 | > current_lr_1: 0.00019960037478133875 | > step_time: 0.2728 (0.4342999622739594) | > loader_time: 0.002 (0.011511375164163524)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6887600421905518 (2.6887600421905518) | > loss_disc_real_0: 0.28759777545928955 (0.28759777545928955) | > loss_disc_real_1: 0.27310171723365784 (0.27310171723365784) | > loss_disc_real_2: 0.2193281203508377 (0.2193281203508377) | > loss_disc_real_3: 0.2746592164039612 (0.2746592164039612) | > loss_disc_real_4: 0.11791519075632095 (0.11791519075632095) | > loss_disc_real_5: 0.14861935377120972 (0.14861935377120972) | > loss_0: 2.6887600421905518 (2.6887600421905518) | > loss_gen: 1.9286171197891235 (1.9286171197891235) | > loss_kl: 1.6496038436889648 (1.6496038436889648) | > loss_feat: 4.886722087860107 (4.886722087860107) | > loss_mel: 27.541168212890625 (27.541168212890625) | > loss_duration: 1.9747912883758545 (1.9747912883758545) | > loss_1: 37.98090362548828 (37.98090362548828)  --> STEP: 1 | > loss_disc: 2.1156091690063477 (2.1156091690063477) | > loss_disc_real_0: 0.038508251309394836 (0.038508251309394836) | > loss_disc_real_1: 0.11935629695653915 (0.11935629695653915) | > loss_disc_real_2: 0.13961002230644226 (0.13961002230644226) | > loss_disc_real_3: 0.1821799874305725 (0.1821799874305725) | > loss_disc_real_4: 0.024869486689567566 (0.024869486689567566) | > loss_disc_real_5: 0.17798066139221191 (0.17798066139221191) | > loss_0: 2.1156091690063477 (2.1156091690063477) | > loss_gen: 2.168307304382324 (2.168307304382324) | > loss_kl: 1.8231967687606812 (1.8231967687606812) | > loss_feat: 15.838866233825684 (15.838866233825684) | > loss_mel: 35.033905029296875 (35.033905029296875) | > loss_duration: 2.1102638244628906 (2.1102638244628906) | > loss_1: 56.97454071044922 (56.97454071044922)  --> STEP: 2 | > loss_disc: 3.0353667736053467 (2.575487971305847) | > loss_disc_real_0: 0.2857639193534851 (0.16213608533143997) | > loss_disc_real_1: 0.3439192473888397 (0.23163777217268944) | > loss_disc_real_2: 0.23951131105422974 (0.189560666680336) | > loss_disc_real_3: 0.21977536380290985 (0.20097767561674118) | > loss_disc_real_4: 0.3751334547996521 (0.20000147074460983) | > loss_disc_real_5: 0.3293103873729706 (0.25364552438259125) | > loss_0: 3.0353667736053467 (2.575487971305847) | > loss_gen: 1.8260693550109863 (1.9971883296966553) | > loss_kl: 2.300619125366211 (2.061907947063446) | > loss_feat: 0.07302669435739517 (7.955946464091539) | > loss_mel: 6.576940059661865 (20.80542254447937) | > loss_duration: 2.057551145553589 (2.0839074850082397) | > loss_1: 12.834206581115723 (34.90437364578247)  --> STEP: 3 | > loss_disc: 3.0353264808654785 (2.728767474492391) | > loss_disc_real_0: 0.2856501340866089 (0.20330743491649628) | > loss_disc_real_1: 0.343908429145813 (0.26906132449706394) | > loss_disc_real_2: 0.23952002823352814 (0.2062137871980667) | > loss_disc_real_3: 0.2197631448507309 (0.20723949869473776) | > loss_disc_real_4: 0.3752986192703247 (0.2584338535865148) | > loss_disc_real_5: 0.3293394446372986 (0.27887683113416034) | > loss_0: 3.0353264808654785 (2.728767474492391) | > loss_gen: 1.8262248039245605 (1.9402004877726238) | > loss_kl: 1.4830797910690308 (1.8689652283986409) | > loss_feat: 0.07323592901229858 (5.3283762857317924) | > loss_mel: 6.385114669799805 (15.998653252919516) | > loss_duration: 2.204643487930298 (2.1241528193155923) | > loss_1: 11.972297668457031 (27.260348320007324) --> EVAL PERFORMANCE | > avg_loader_time: 0.002551396687825521 (-0.012596368789672852) | > avg_loss_disc: 2.728767474492391 (+0.39355691274007176) | > avg_loss_disc_real_0: 0.20330743491649628 (-0.09344481428464252) | > avg_loss_disc_real_1: 0.26906132449706394 (-0.10268609970808029) | > avg_loss_disc_real_2: 0.2062137871980667 (-0.0842829595009486) | > avg_loss_disc_real_3: 0.20723949869473776 (-0.038289934396743774) | > avg_loss_disc_real_4: 0.2584338535865148 (+0.07614953319231668) | > avg_loss_disc_real_5: 0.27887683113416034 (+0.16252299398183823) | > avg_loss_0: 2.728767474492391 (+0.39355691274007176) | > avg_loss_gen: 1.9402004877726238 (-0.6438792546590169) | > avg_loss_kl: 1.8689652283986409 (-0.38751165072123217) | > avg_loss_feat: 5.3283762857317924 (-1.1456713750958443) | > avg_loss_mel: 15.998653252919516 (-22.72266403834025) | > avg_loss_duration: 2.1241528193155923 (-0.022266626358032227) | > avg_loss_1: 27.260348320007324 (-24.921992937723793) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_53151.pth  > EPOCH: 3/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:43:29)   --> TIME: 2023-10-19 23:43:38 -- STEP: 9/50 -- GLOBAL_STEP: 53160 | > loss_disc: 3.0086631774902344 (2.960946559906006) | > loss_disc_real_0: 0.17435133457183838 (0.22792967491679722) | > loss_disc_real_1: 0.3245629370212555 (0.32607729070716435) | > loss_disc_real_2: 0.3376537561416626 (0.27251562227805454) | > loss_disc_real_3: 0.2828022241592407 (0.26437193486425614) | > loss_disc_real_4: 0.3313193917274475 (0.23385447180933422) | > loss_disc_real_5: 0.4517676532268524 (0.2648097922404607) | > loss_0: 3.0086631774902344 (2.960946559906006) | > grad_norm_0: tensor(1046.2880, device='cuda:0') (tensor(1008.6489, device='cuda:0')) | > loss_gen: 1.9557000398635864 (2.01416454050276) | > loss_kl: 2.0816731452941895 (1.789051440027025) | > loss_feat: 0.5385793447494507 (3.2841019100613065) | > loss_mel: 34.644142150878906 (31.31096543206109) | > loss_duration: 1.9255056381225586 (2.038096931245592) | > loss_1: 41.14560317993164 (40.43638017442491) | > grad_norm_1: tensor(27920.4043, device='cuda:0') (tensor(25038.6426, device='cuda:0')) | > current_lr_0: 0.00019940086170989343 | > current_lr_1: 0.00019940086170989343 | > step_time: 0.6929 (0.5541652308570014) | > loader_time: 0.0247 (0.01715837584601508)  --> TIME: 2023-10-19 23:43:54 -- STEP: 39/50 -- GLOBAL_STEP: 53190 | > loss_disc: 2.0931670665740967 (2.703044261687841) | > loss_disc_real_0: 0.043310314416885376 (0.18356159773583594) | > loss_disc_real_1: 0.17777425050735474 (0.2548795171464101) | > loss_disc_real_2: 0.3070782423019409 (0.23668523901739183) | > loss_disc_real_3: 0.15421351790428162 (0.24040619016457826) | > loss_disc_real_4: 0.1265501230955124 (0.2571029912871428) | > loss_disc_real_5: 0.09575458616018295 (0.2517955544858407) | > loss_0: 2.0931670665740967 (2.703044261687841) | > grad_norm_0: tensor(909.8612, device='cuda:0') (tensor(1129.8088, device='cuda:0')) | > loss_gen: 2.5087313652038574 (2.148186805920723) | > loss_kl: 1.5258985757827759 (1.6943052456929133) | > loss_feat: 7.650634765625 (4.360709686309864) | > loss_mel: 34.45020294189453 (29.927443467653713) | > loss_duration: 2.0279037952423096 (2.06337292989095) | > loss_1: 48.16337203979492 (40.19401792379526) | > grad_norm_1: tensor(82428.1953, device='cuda:0') (tensor(31996.6543, device='cuda:0')) | > current_lr_0: 0.00019940086170989343 | > current_lr_1: 0.00019940086170989343 | > step_time: 0.5963 (0.5372953109252148) | > loader_time: 0.0107 (0.01658146809308957)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7579140663146973 (2.7579140663146973) | > loss_disc_real_0: 0.309323251247406 (0.309323251247406) | > loss_disc_real_1: 0.4061840772628784 (0.4061840772628784) | > loss_disc_real_2: 0.26891863346099854 (0.26891863346099854) | > loss_disc_real_3: 0.48642662167549133 (0.48642662167549133) | > loss_disc_real_4: 0.24572154879570007 (0.24572154879570007) | > loss_disc_real_5: 0.27724891901016235 (0.27724891901016235) | > loss_0: 2.7579140663146973 (2.7579140663146973) | > loss_gen: 3.1025869846343994 (3.1025869846343994) | > loss_kl: 1.5750179290771484 (1.5750179290771484) | > loss_feat: 5.470276355743408 (5.470276355743408) | > loss_mel: 26.98087501525879 (26.98087501525879) | > loss_duration: 1.9572924375534058 (1.9572924375534058) | > loss_1: 39.0860481262207 (39.0860481262207)  --> STEP: 1 | > loss_disc: 2.1769986152648926 (2.1769986152648926) | > loss_disc_real_0: 0.3563983142375946 (0.3563983142375946) | > loss_disc_real_1: 0.43078354001045227 (0.43078354001045227) | > loss_disc_real_2: 0.09763218462467194 (0.09763218462467194) | > loss_disc_real_3: 0.3828069269657135 (0.3828069269657135) | > loss_disc_real_4: 0.19237108528614044 (0.19237108528614044) | > loss_disc_real_5: 0.17742806673049927 (0.17742806673049927) | > loss_0: 2.1769986152648926 (2.1769986152648926) | > loss_gen: 3.793733596801758 (3.793733596801758) | > loss_kl: 1.4328885078430176 (1.4328885078430176) | > loss_feat: 9.86788558959961 (9.86788558959961) | > loss_mel: 24.642427444458008 (24.642427444458008) | > loss_duration: 2.1010420322418213 (2.1010420322418213) | > loss_1: 41.837974548339844 (41.837974548339844)  --> STEP: 2 | > loss_disc: 2.9588441848754883 (2.5679214000701904) | > loss_disc_real_0: 0.5098843574523926 (0.4331413358449936) | > loss_disc_real_1: 0.3903452754020691 (0.4105644077062607) | > loss_disc_real_2: 0.26079002022743225 (0.1792111024260521) | > loss_disc_real_3: 0.4125891625881195 (0.3976980447769165) | > loss_disc_real_4: 0.14990301430225372 (0.17113704979419708) | > loss_disc_real_5: 0.20379772782325745 (0.19061289727687836) | > loss_0: 2.9588441848754883 (2.5679214000701904) | > loss_gen: 2.1185708045959473 (2.9561522006988525) | > loss_kl: 2.344151020050049 (1.8885197639465332) | > loss_feat: 0.7065250873565674 (5.287205338478088) | > loss_mel: 7.333498954772949 (15.987963199615479) | > loss_duration: 2.0550498962402344 (2.078045964241028) | > loss_1: 14.557796478271484 (28.197885513305664)  --> STEP: 3 | > loss_disc: 2.651071071624756 (2.5956379572550454) | > loss_disc_real_0: 0.2556169331073761 (0.3739665349324544) | > loss_disc_real_1: 0.37913835048675537 (0.4000890552997589) | > loss_disc_real_2: 0.17443594336509705 (0.17761938273906708) | > loss_disc_real_3: 0.4619189202785492 (0.41910500327746075) | > loss_disc_real_4: 0.14169861376285553 (0.1613242377837499) | > loss_disc_real_5: 0.2814554274082184 (0.2208937406539917) | > loss_0: 2.651071071624756 (2.5956379572550454) | > loss_gen: 2.635845184326172 (2.8493831952412925) | > loss_kl: 1.7071011066436768 (1.8280468781789143) | > loss_feat: 4.457647323608398 (5.010686000188191) | > loss_mel: 26.5023250579834 (19.492750485738117) | > loss_duration: 2.217519521713257 (2.124537150065104) | > loss_1: 37.52043533325195 (31.305402119954426) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031556288401285806 (+0.0006042321523030596) | > avg_loss_disc: 2.5956379572550454 (-0.13312951723734567) | > avg_loss_disc_real_0: 0.3739665349324544 (+0.17065910001595813) | > avg_loss_disc_real_1: 0.4000890552997589 (+0.13102773080269497) | > avg_loss_disc_real_2: 0.17761938273906708 (-0.028594404458999634) | > avg_loss_disc_real_3: 0.41910500327746075 (+0.211865504582723) | > avg_loss_disc_real_4: 0.1613242377837499 (-0.09710961580276486) | > avg_loss_disc_real_5: 0.2208937406539917 (-0.05798309048016864) | > avg_loss_0: 2.5956379572550454 (-0.13312951723734567) | > avg_loss_gen: 2.8493831952412925 (+0.9091827074686687) | > avg_loss_kl: 1.8280468781789143 (-0.04091835021972656) | > avg_loss_feat: 5.010686000188191 (-0.317690285543601) | > avg_loss_mel: 19.492750485738117 (+3.4940972328186017) | > avg_loss_duration: 2.124537150065104 (+0.00038433074951171875) | > avg_loss_1: 31.305402119954426 (+4.045053799947102)  > EPOCH: 4/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:44:08)   --> TIME: 2023-10-19 23:44:21 -- STEP: 19/50 -- GLOBAL_STEP: 53220 | > loss_disc: 2.1796624660491943 (2.7267845555355676) | > loss_disc_real_0: 0.08351065218448639 (0.21217842253023073) | > loss_disc_real_1: 0.2610865533351898 (0.27216590666457224) | > loss_disc_real_2: 0.19713997840881348 (0.22035425685738264) | > loss_disc_real_3: 0.23329409956932068 (0.26329049644501584) | > loss_disc_real_4: 0.13152188062667847 (0.21573323011398315) | > loss_disc_real_5: 0.057664114981889725 (0.2229350189629354) | > loss_0: 2.1796624660491943 (2.7267845555355676) | > grad_norm_0: tensor(747.9388, device='cuda:0') (tensor(1009.8999, device='cuda:0')) | > loss_gen: 2.323970079421997 (2.2576665815554167) | > loss_kl: 1.4758044481277466 (1.7332317264456498) | > loss_feat: 5.400162696838379 (5.881861220064916) | > loss_mel: 32.87186050415039 (29.289613046144183) | > loss_duration: 2.1959543228149414 (2.118409909700093) | > loss_1: 44.26774978637695 (41.28078290035851) | > grad_norm_1: tensor(21095.2363, device='cuda:0') (tensor(32676.9238, device='cuda:0')) | > current_lr_0: 0.00019920154806425444 | > current_lr_1: 0.00019920154806425444 | > step_time: 0.4978 (0.5176441920431036) | > loader_time: 0.002 (0.019170033304314864)  --> TIME: 2023-10-19 23:44:37 -- STEP: 49/50 -- GLOBAL_STEP: 53250 | > loss_disc: 2.8530006408691406 (2.697431902496182) | > loss_disc_real_0: 0.1745925396680832 (0.19684036574041358) | > loss_disc_real_1: 0.3462669253349304 (0.2606255049456137) | > loss_disc_real_2: 0.23923435807228088 (0.2316361477180403) | > loss_disc_real_3: 0.31069061160087585 (0.283168300302053) | > loss_disc_real_4: 0.27304601669311523 (0.27831261148866343) | > loss_disc_real_5: 0.3348582983016968 (0.25428785132814435) | > loss_0: 2.8530006408691406 (2.697431902496182) | > grad_norm_0: tensor(627.7804, device='cuda:0') (tensor(911.1313, device='cuda:0')) | > loss_gen: 1.927240252494812 (2.3373016702885527) | > loss_kl: 1.5901188850402832 (1.6804444181675813) | > loss_feat: 0.831912636756897 (5.460527757296757) | > loss_mel: 25.18391227722168 (28.10837474161265) | > loss_duration: 2.138385772705078 (2.050321304068274) | > loss_1: 31.67156982421875 (39.63696964419618) | > grad_norm_1: tensor(18399.3477, device='cuda:0') (tensor(28808.5078, device='cuda:0')) | > current_lr_0: 0.00019920154806425444 | > current_lr_1: 0.00019920154806425444 | > step_time: 0.8802 (0.5102761862229328) | > loader_time: 0.1815 (0.0184139718814772)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8337392807006836 (2.8337392807006836) | > loss_disc_real_0: 0.17577460408210754 (0.17577460408210754) | > loss_disc_real_1: 0.27150559425354004 (0.27150559425354004) | > loss_disc_real_2: 0.18462231755256653 (0.18462231755256653) | > loss_disc_real_3: 0.22201550006866455 (0.22201550006866455) | > loss_disc_real_4: 0.26752322912216187 (0.26752322912216187) | > loss_disc_real_5: 0.49367716908454895 (0.49367716908454895) | > loss_0: 2.8337392807006836 (2.8337392807006836) | > loss_gen: 2.107804298400879 (2.107804298400879) | > loss_kl: 1.6353691816329956 (1.6353691816329956) | > loss_feat: 4.494213581085205 (4.494213581085205) | > loss_mel: 25.396575927734375 (25.396575927734375) | > loss_duration: 1.9709019660949707 (1.9709019660949707) | > loss_1: 35.60486602783203 (35.60486602783203)  --> STEP: 1 | > loss_disc: 3.0634524822235107 (3.0634524822235107) | > loss_disc_real_0: 0.1268509477376938 (0.1268509477376938) | > loss_disc_real_1: 0.04609507694840431 (0.04609507694840431) | > loss_disc_real_2: 0.502433180809021 (0.502433180809021) | > loss_disc_real_3: 0.28092822432518005 (0.28092822432518005) | > loss_disc_real_4: 0.08825905621051788 (0.08825905621051788) | > loss_disc_real_5: 0.4502566158771515 (0.4502566158771515) | > loss_0: 3.0634524822235107 (3.0634524822235107) | > loss_gen: 2.471172571182251 (2.471172571182251) | > loss_kl: 1.848919153213501 (1.848919153213501) | > loss_feat: 16.149703979492188 (16.149703979492188) | > loss_mel: 33.44934844970703 (33.44934844970703) | > loss_duration: 2.0961380004882812 (2.0961380004882812) | > loss_1: 56.015281677246094 (56.015281677246094)  --> STEP: 2 | > loss_disc: 1.9536182880401611 (2.508535385131836) | > loss_disc_real_0: 0.05590001493692398 (0.09137548133730888) | > loss_disc_real_1: 0.2132277488708496 (0.12966141290962696) | > loss_disc_real_2: 0.10427039861679077 (0.3033517897129059) | > loss_disc_real_3: 0.2582455277442932 (0.26958687603473663) | > loss_disc_real_4: 0.06325088441371918 (0.07575497031211853) | > loss_disc_real_5: 0.0878760889172554 (0.26906635239720345) | > loss_0: 1.9536182880401611 (2.508535385131836) | > loss_gen: 2.501742124557495 (2.486457347869873) | > loss_kl: 2.2384579181671143 (2.0436885356903076) | > loss_feat: 8.772594451904297 (12.461149215698242) | > loss_mel: 30.257404327392578 (31.853376388549805) | > loss_duration: 1.9777443408966064 (2.036941170692444) | > loss_1: 45.74794387817383 (50.88161277770996)  --> STEP: 3 | > loss_disc: 3.0189342498779297 (2.6786683400472007) | > loss_disc_real_0: 0.12683139741420746 (0.10319412002960841) | > loss_disc_real_1: 0.3251054286956787 (0.1948094181716442) | > loss_disc_real_2: 0.24721704423427582 (0.28464020788669586) | > loss_disc_real_3: 0.3010796904563904 (0.28008448084195453) | > loss_disc_real_4: 0.2726481854915619 (0.14138604203859964) | > loss_disc_real_5: 0.32769912481307983 (0.28861060986916226) | > loss_0: 3.0189342498779297 (2.6786683400472007) | > loss_gen: 1.6363359689712524 (2.203083554903666) | > loss_kl: 1.670002818107605 (1.9191266298294067) | > loss_feat: 0.10273750871419907 (8.341678646703562) | > loss_mel: 4.556451797485352 (22.754401524861652) | > loss_duration: 2.2042484283447266 (2.092710256576538) | > loss_1: 10.169776916503906 (37.31100082397461) --> EVAL PERFORMANCE | > avg_loader_time: 0.010993401209513346 (+0.007837772369384766) | > avg_loss_disc: 2.6786683400472007 (+0.08303038279215524) | > avg_loss_disc_real_0: 0.10319412002960841 (-0.270772414902846) | > avg_loss_disc_real_1: 0.1948094181716442 (-0.2052796371281147) | > avg_loss_disc_real_2: 0.28464020788669586 (+0.10702082514762878) | > avg_loss_disc_real_3: 0.28008448084195453 (-0.13902052243550622) | > avg_loss_disc_real_4: 0.14138604203859964 (-0.019938195745150267) | > avg_loss_disc_real_5: 0.28861060986916226 (+0.06771686921517056) | > avg_loss_0: 2.6786683400472007 (+0.08303038279215524) | > avg_loss_gen: 2.203083554903666 (-0.6462996403376264) | > avg_loss_kl: 1.9191266298294067 (+0.09107975165049242) | > avg_loss_feat: 8.341678646703562 (+3.3309926465153703) | > avg_loss_mel: 22.754401524861652 (+3.261651039123535) | > avg_loss_duration: 2.092710256576538 (-0.03182689348856593) | > avg_loss_1: 37.31100082397461 (+6.0055987040201835)  > EPOCH: 5/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:44:43)   --> TIME: 2023-10-19 23:44:59 -- STEP: 29/50 -- GLOBAL_STEP: 53280 | > loss_disc: 3.5656306743621826 (2.78867637700048) | > loss_disc_real_0: 0.08748158812522888 (0.23696417759718566) | > loss_disc_real_1: 0.4191926419734955 (0.2474104212275867) | > loss_disc_real_2: 0.7770535349845886 (0.2537033252803416) | > loss_disc_real_3: 0.3221950829029083 (0.25041174801901495) | > loss_disc_real_4: 0.3477719724178314 (0.29209268234413244) | > loss_disc_real_5: 0.2734593451023102 (0.23326673214163246) | > loss_0: 3.5656306743621826 (2.78867637700048) | > grad_norm_0: tensor(1310.1825, device='cuda:0') (tensor(1237.8541, device='cuda:0')) | > loss_gen: 1.976386547088623 (2.431960582733155) | > loss_kl: 1.6713210344314575 (1.7176746890462677) | > loss_feat: 6.987666130065918 (6.0916999198239425) | > loss_mel: 25.683408737182617 (27.769044382818812) | > loss_duration: 2.0667386054992676 (2.0791232996973497) | > loss_1: 38.385520935058594 (40.089502597677296) | > grad_norm_1: tensor(29877.1387, device='cuda:0') (tensor(38049.0781, device='cuda:0')) | > current_lr_0: 0.00019900243364508313 | > current_lr_1: 0.00019900243364508313 | > step_time: 0.3501 (0.4114496296849744) | > loader_time: 0.0021 (0.009821998661962046)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0778002738952637 (3.0778002738952637) | > loss_disc_real_0: 0.22332978248596191 (0.22332978248596191) | > loss_disc_real_1: 0.3427181839942932 (0.3427181839942932) | > loss_disc_real_2: 0.23419976234436035 (0.23419976234436035) | > loss_disc_real_3: 0.2126258909702301 (0.2126258909702301) | > loss_disc_real_4: 0.3958699107170105 (0.3958699107170105) | > loss_disc_real_5: 0.17367881536483765 (0.17367881536483765) | > loss_0: 3.0778002738952637 (3.0778002738952637) | > loss_gen: 1.595211148262024 (1.595211148262024) | > loss_kl: 1.598711609840393 (1.598711609840393) | > loss_feat: 0.10531076043844223 (0.10531076043844223) | > loss_mel: 6.523423194885254 (6.523423194885254) | > loss_duration: 1.9388169050216675 (1.9388169050216675) | > loss_1: 11.761473655700684 (11.761473655700684)  --> STEP: 1 | > loss_disc: 2.4796791076660156 (2.4796791076660156) | > loss_disc_real_0: 0.2874765992164612 (0.2874765992164612) | > loss_disc_real_1: 0.32634037733078003 (0.32634037733078003) | > loss_disc_real_2: 0.0798400491476059 (0.0798400491476059) | > loss_disc_real_3: 0.1353769153356552 (0.1353769153356552) | > loss_disc_real_4: 0.08656985312700272 (0.08656985312700272) | > loss_disc_real_5: 0.04662008211016655 (0.04662008211016655) | > loss_0: 2.4796791076660156 (2.4796791076660156) | > loss_gen: 2.102210521697998 (2.102210521697998) | > loss_kl: 2.102215528488159 (2.102215528488159) | > loss_feat: 8.365300178527832 (8.365300178527832) | > loss_mel: 29.954679489135742 (29.954679489135742) | > loss_duration: 2.0720999240875244 (2.0720999240875244) | > loss_1: 44.59650802612305 (44.59650802612305)  --> STEP: 2 | > loss_disc: 2.192621946334839 (2.3361505270004272) | > loss_disc_real_0: 0.293732225894928 (0.2906044125556946) | > loss_disc_real_1: 0.2890414893627167 (0.30769093334674835) | > loss_disc_real_2: 0.05007379502058029 (0.0649569220840931) | > loss_disc_real_3: 0.11551220715045929 (0.12544456124305725) | > loss_disc_real_4: 0.1060953289270401 (0.09633259102702141) | > loss_disc_real_5: 0.12104372680187225 (0.0838319044560194) | > loss_0: 2.192621946334839 (2.3361505270004272) | > loss_gen: 2.3942482471466064 (2.2482293844223022) | > loss_kl: 2.4092531204223633 (2.2557343244552612) | > loss_feat: 8.226787567138672 (8.296043872833252) | > loss_mel: 32.49147033691406 (31.223074913024902) | > loss_duration: 1.9754480123519897 (2.023773968219757) | > loss_1: 47.49720764160156 (46.046857833862305)  --> STEP: 3 | > loss_disc: 2.982100009918213 (2.551467021306356) | > loss_disc_real_0: 0.2329355776309967 (0.2713814675807953) | > loss_disc_real_1: 0.3657493591308594 (0.327043741941452) | > loss_disc_real_2: 0.1854824274778366 (0.10513209054867427) | > loss_disc_real_3: 0.20258989930152893 (0.15115967392921448) | > loss_disc_real_4: 0.32759836316108704 (0.17342118173837662) | > loss_disc_real_5: 0.19295208156108856 (0.12020529682437579) | > loss_0: 2.982100009918213 (2.551467021306356) | > loss_gen: 1.6316704750061035 (2.042709747950236) | > loss_kl: 1.2068673372268677 (1.9061119953791301) | > loss_feat: 0.7654466032981873 (5.785844782988231) | > loss_mel: 21.42143440246582 (27.955861409505207) | > loss_duration: 2.136475086212158 (2.0613410075505576) | > loss_1: 27.161893844604492 (39.75186983744303) --> EVAL PERFORMANCE | > avg_loader_time: 0.0060151418050130205 (-0.004978259404500325) | > avg_loss_disc: 2.551467021306356 (-0.12720131874084473) | > avg_loss_disc_real_0: 0.2713814675807953 (+0.16818734755118686) | > avg_loss_disc_real_1: 0.327043741941452 (+0.13223432376980782) | > avg_loss_disc_real_2: 0.10513209054867427 (-0.17950811733802158) | > avg_loss_disc_real_3: 0.15115967392921448 (-0.12892480691274005) | > avg_loss_disc_real_4: 0.17342118173837662 (+0.03203513969977698) | > avg_loss_disc_real_5: 0.12020529682437579 (-0.16840531304478645) | > avg_loss_0: 2.551467021306356 (-0.12720131874084473) | > avg_loss_gen: 2.042709747950236 (-0.16037380695343018) | > avg_loss_kl: 1.9061119953791301 (-0.013014634450276619) | > avg_loss_feat: 5.785844782988231 (-2.555833863715331) | > avg_loss_mel: 27.955861409505207 (+5.201459884643555) | > avg_loss_duration: 2.0613410075505576 (-0.031369249025980483) | > avg_loss_1: 39.75186983744303 (+2.440869013468422)  > EPOCH: 6/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:45:19)   --> TIME: 2023-10-19 23:45:27 -- STEP: 9/50 -- GLOBAL_STEP: 53310 | > loss_disc: 3.4009320735931396 (2.832873132493761) | > loss_disc_real_0: 0.42972230911254883 (0.19292407813999388) | > loss_disc_real_1: 0.24203729629516602 (0.3475564685132768) | > loss_disc_real_2: 0.771516740322113 (0.3097197173370255) | > loss_disc_real_3: 0.3444429934024811 (0.28588434639904237) | > loss_disc_real_4: 0.5610666871070862 (0.2775813245938884) | > loss_disc_real_5: 0.4153868556022644 (0.19231915722290674) | > loss_0: 3.4009320735931396 (2.832873132493761) | > grad_norm_0: tensor(1101.0830, device='cuda:0') (tensor(923.5842, device='cuda:0')) | > loss_gen: 2.9408926963806152 (2.554398496945699) | > loss_kl: 1.7687979936599731 (1.9141679604848225) | > loss_feat: 3.201040744781494 (7.353198750151528) | > loss_mel: 29.224578857421875 (27.91277419196235) | > loss_duration: 1.8969001770019531 (2.005289872487386) | > loss_1: 39.03220748901367 (41.73982810974121) | > grad_norm_1: tensor(12032.5205, device='cuda:0') (tensor(36262.8477, device='cuda:0')) | > current_lr_0: 0.00019880351825324018 | > current_lr_1: 0.00019880351825324018 | > step_time: 0.7043 (0.5063723723093668) | > loader_time: 0.0244 (0.01420532332526313)  --> TIME: 2023-10-19 23:45:45 -- STEP: 39/50 -- GLOBAL_STEP: 53340 | > loss_disc: 2.2402424812316895 (2.7592349082995677) | > loss_disc_real_0: 0.22243714332580566 (0.18232972748004472) | > loss_disc_real_1: 0.2507452964782715 (0.29291995458352643) | > loss_disc_real_2: 0.2884720265865326 (0.2544096270337319) | > loss_disc_real_3: 0.1523333340883255 (0.2964509191612403) | > loss_disc_real_4: 0.16545234620571136 (0.2582270343525288) | > loss_disc_real_5: 0.0657087117433548 (0.25555062628327274) | > loss_0: 2.2402424812316895 (2.7592349082995677) | > grad_norm_0: tensor(771.0856, device='cuda:0') (tensor(942.7672, device='cuda:0')) | > loss_gen: 2.344271659851074 (2.474911426886534) | > loss_kl: 1.34242844581604 (1.8478384766823206) | > loss_feat: 4.210615158081055 (6.3475539592596215) | > loss_mel: 32.3132209777832 (28.87742052322779) | > loss_duration: 2.021294355392456 (2.0360721624814553) | > loss_1: 42.23183059692383 (41.58379652561286) | > grad_norm_1: tensor(27926.2305, device='cuda:0') (tensor(34808.9414, device='cuda:0')) | > current_lr_0: 0.00019880351825324018 | > current_lr_1: 0.00019880351825324018 | > step_time: 0.565 (0.5732109974592161) | > loader_time: 0.0246 (0.016297548245161008)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7183845043182373 (2.7183845043182373) | > loss_disc_real_0: 0.2582075595855713 (0.2582075595855713) | > loss_disc_real_1: 0.2985441982746124 (0.2985441982746124) | > loss_disc_real_2: 0.1676553189754486 (0.1676553189754486) | > loss_disc_real_3: 0.3246604800224304 (0.3246604800224304) | > loss_disc_real_4: 0.13586965203285217 (0.13586965203285217) | > loss_disc_real_5: 0.14440475404262543 (0.14440475404262543) | > loss_0: 2.7183845043182373 (2.7183845043182373) | > loss_gen: 1.789215326309204 (1.789215326309204) | > loss_kl: 1.9694336652755737 (1.9694336652755737) | > loss_feat: 2.5010886192321777 (2.5010886192321777) | > loss_mel: 24.076608657836914 (24.076608657836914) | > loss_duration: 1.9417176246643066 (1.9417176246643066) | > loss_1: 32.2780647277832 (32.2780647277832)  --> STEP: 1 | > loss_disc: 2.732499599456787 (2.732499599456787) | > loss_disc_real_0: 0.1703956127166748 (0.1703956127166748) | > loss_disc_real_1: 0.17608310282230377 (0.17608310282230377) | > loss_disc_real_2: 0.2601069211959839 (0.2601069211959839) | > loss_disc_real_3: 0.2052549123764038 (0.2052549123764038) | > loss_disc_real_4: 0.23577049374580383 (0.23577049374580383) | > loss_disc_real_5: 0.3238399028778076 (0.3238399028778076) | > loss_0: 2.732499599456787 (2.732499599456787) | > loss_gen: 2.334648609161377 (2.334648609161377) | > loss_kl: 2.0862951278686523 (2.0862951278686523) | > loss_feat: 6.690396785736084 (6.690396785736084) | > loss_mel: 30.000011444091797 (30.000011444091797) | > loss_duration: 2.0831751823425293 (2.0831751823425293) | > loss_1: 43.19452667236328 (43.19452667236328)  --> STEP: 2 | > loss_disc: 3.3597681522369385 (3.046133875846863) | > loss_disc_real_0: 0.11106174439191818 (0.1407286785542965) | > loss_disc_real_1: 0.12899252772331238 (0.15253781527280807) | > loss_disc_real_2: 0.11213364452123642 (0.18612028285861015) | > loss_disc_real_3: 0.044066980481147766 (0.12466094642877579) | > loss_disc_real_4: 0.09999603778123856 (0.1678832657635212) | > loss_disc_real_5: 0.22352533042430878 (0.2736826166510582) | > loss_0: 3.3597681522369385 (3.046133875846863) | > loss_gen: 2.3357911109924316 (2.3352198600769043) | > loss_kl: 2.373549461364746 (2.229922294616699) | > loss_feat: 13.908474922180176 (10.29943585395813) | > loss_mel: 31.638723373413086 (30.81936740875244) | > loss_duration: 1.9898228645324707 (2.0364990234375) | > loss_1: 52.246360778808594 (47.72044372558594)  --> STEP: 3 | > loss_disc: 2.6805617809295654 (2.92427651087443) | > loss_disc_real_0: 0.28621822595596313 (0.18922519435485205) | > loss_disc_real_1: 0.298092246055603 (0.20105595886707306) | > loss_disc_real_2: 0.28722116351127625 (0.21982057640949884) | > loss_disc_real_3: 0.3007228672504425 (0.18334825336933136) | > loss_disc_real_4: 0.2467784732580185 (0.19418166826168695) | > loss_disc_real_5: 0.43180787563323975 (0.3263910363117854) | > loss_0: 2.6805617809295654 (2.92427651087443) | > loss_gen: 2.7948851585388184 (2.4884416262308755) | > loss_kl: 1.8854261636734009 (2.115090250968933) | > loss_feat: 3.447984218597412 (8.015618642171225) | > loss_mel: 22.209327697753906 (27.94935417175293) | > loss_duration: 2.126829147338867 (2.0666090647379556) | > loss_1: 32.464454650878906 (42.63511403401693) --> EVAL PERFORMANCE | > avg_loader_time: 0.00863337516784668 (+0.002618233362833659) | > avg_loss_disc: 2.92427651087443 (+0.37280948956807425) | > avg_loss_disc_real_0: 0.18922519435485205 (-0.08215627322594324) | > avg_loss_disc_real_1: 0.20105595886707306 (-0.12598778307437897) | > avg_loss_disc_real_2: 0.21982057640949884 (+0.11468848586082457) | > avg_loss_disc_real_3: 0.18334825336933136 (+0.03218857944011688) | > avg_loss_disc_real_4: 0.19418166826168695 (+0.020760486523310334) | > avg_loss_disc_real_5: 0.3263910363117854 (+0.2061857394874096) | > avg_loss_0: 2.92427651087443 (+0.37280948956807425) | > avg_loss_gen: 2.4884416262308755 (+0.44573187828063965) | > avg_loss_kl: 2.115090250968933 (+0.20897825558980299) | > avg_loss_feat: 8.015618642171225 (+2.229773859182994) | > avg_loss_mel: 27.94935417175293 (-0.006507237752277462) | > avg_loss_duration: 2.0666090647379556 (+0.005268057187397979) | > avg_loss_1: 42.63511403401693 (+2.883244196573898)  > EPOCH: 7/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:45:57)   --> TIME: 2023-10-19 23:46:10 -- STEP: 19/50 -- GLOBAL_STEP: 53370 | > loss_disc: 2.8146567344665527 (2.7030008466620195) | > loss_disc_real_0: 0.328299343585968 (0.15056347998937494) | > loss_disc_real_1: 0.32057902216911316 (0.22738317517857803) | > loss_disc_real_2: 0.22265006601810455 (0.23729971168856873) | > loss_disc_real_3: 0.3054956793785095 (0.22835805365129522) | > loss_disc_real_4: 0.3292734920978546 (0.30668752091495616) | > loss_disc_real_5: 0.21754206717014313 (0.27327954729920934) | > loss_0: 2.8146567344665527 (2.7030008466620195) | > grad_norm_0: tensor(619.6707, device='cuda:0') (tensor(1027.4619, device='cuda:0')) | > loss_gen: 2.095547676086426 (2.192432491402877) | > loss_kl: 1.3722493648529053 (1.749170698617634) | > loss_feat: 1.3122695684432983 (5.534704923629761) | > loss_mel: 26.612306594848633 (27.816796152215254) | > loss_duration: 2.1709585189819336 (2.1012394490994906) | > loss_1: 33.563331604003906 (39.394343526739824) | > grad_norm_1: tensor(14423.1123, device='cuda:0') (tensor(32334.4277, device='cuda:0')) | > current_lr_0: 0.00019860480168978534 | > current_lr_1: 0.00019860480168978534 | > step_time: 0.5368 (0.5520590731972141) | > loader_time: 0.0023 (0.019322922355250308)  --> TIME: 2023-10-19 23:46:21 -- STEP: 49/50 -- GLOBAL_STEP: 53400 | > loss_disc: 2.598334312438965 (2.586229064026657) | > loss_disc_real_0: 0.0960816815495491 (0.15962153146689648) | > loss_disc_real_1: 0.23644714057445526 (0.23748817340451844) | > loss_disc_real_2: 0.254304975271225 (0.2226878081505396) | > loss_disc_real_3: 0.3191888928413391 (0.23497006730461606) | > loss_disc_real_4: 0.2686222493648529 (0.2620776046295556) | > loss_disc_real_5: 0.30692920088768005 (0.24345762145762537) | > loss_0: 2.598334312438965 (2.586229064026657) | > grad_norm_0: tensor(970.7141, device='cuda:0') (tensor(841.4758, device='cuda:0')) | > loss_gen: 2.053408145904541 (2.233662760987574) | > loss_kl: 1.561936378479004 (1.6332317724519847) | > loss_feat: 2.7652456760406494 (5.202769691998861) | > loss_mel: 24.46057891845703 (26.527641101759308) | > loss_duration: 2.0562617778778076 (2.031895360168146) | > loss_1: 32.897430419921875 (37.62920103267747) | > grad_norm_1: tensor(21722.1504, device='cuda:0') (tensor(31522.9961, device='cuda:0')) | > current_lr_0: 0.00019860480168978534 | > current_lr_1: 0.00019860480168978534 | > step_time: 0.2644 (0.4253734033934924) | > loader_time: 0.1885 (0.015100464528920695)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.483147621154785 (2.483147621154785) | > loss_disc_real_0: 0.16441255807876587 (0.16441255807876587) | > loss_disc_real_1: 0.2601213753223419 (0.2601213753223419) | > loss_disc_real_2: 0.2529212236404419 (0.2529212236404419) | > loss_disc_real_3: 0.3406250774860382 (0.3406250774860382) | > loss_disc_real_4: 0.14919185638427734 (0.14919185638427734) | > loss_disc_real_5: 0.28490644693374634 (0.28490644693374634) | > loss_0: 2.483147621154785 (2.483147621154785) | > loss_gen: 2.202906608581543 (2.202906608581543) | > loss_kl: 1.5649278163909912 (1.5649278163909912) | > loss_feat: 4.368984222412109 (4.368984222412109) | > loss_mel: 28.112648010253906 (28.112648010253906) | > loss_duration: 1.9394216537475586 (1.9394216537475586) | > loss_1: 38.18889236450195 (38.18889236450195)  --> STEP: 1 | > loss_disc: 2.1449098587036133 (2.1449098587036133) | > loss_disc_real_0: 0.09525875002145767 (0.09525875002145767) | > loss_disc_real_1: 0.15628094971179962 (0.15628094971179962) | > loss_disc_real_2: 0.1904992312192917 (0.1904992312192917) | > loss_disc_real_3: 0.28430214524269104 (0.28430214524269104) | > loss_disc_real_4: 0.14507853984832764 (0.14507853984832764) | > loss_disc_real_5: 0.21948087215423584 (0.21948087215423584) | > loss_0: 2.1449098587036133 (2.1449098587036133) | > loss_gen: 2.3373522758483887 (2.3373522758483887) | > loss_kl: 1.565311312675476 (1.565311312675476) | > loss_feat: 7.872045993804932 (7.872045993804932) | > loss_mel: 28.643564224243164 (28.643564224243164) | > loss_duration: 2.0588576793670654 (2.0588576793670654) | > loss_1: 42.47713088989258 (42.47713088989258)  --> STEP: 2 | > loss_disc: 2.943098545074463 (2.544004201889038) | > loss_disc_real_0: 0.1662304699420929 (0.13074460998177528) | > loss_disc_real_1: 0.18732307851314545 (0.17180201411247253) | > loss_disc_real_2: 0.20799383521080017 (0.19924653321504593) | > loss_disc_real_3: 0.2014581710100174 (0.24288015812635422) | > loss_disc_real_4: 0.19944164156913757 (0.1722600907087326) | > loss_disc_real_5: 0.14470233023166656 (0.1820916011929512) | > loss_0: 2.943098545074463 (2.544004201889038) | > loss_gen: 1.3520678281784058 (1.8447100520133972) | > loss_kl: 2.2820067405700684 (1.9236590266227722) | > loss_feat: 3.397756814956665 (5.634901404380798) | > loss_mel: 23.01243782043457 (25.828001022338867) | > loss_duration: 2.0042240619659424 (2.031540870666504) | > loss_1: 32.048492431640625 (37.2628116607666)  --> STEP: 3 | > loss_disc: 2.7769863605499268 (2.6216649214426675) | > loss_disc_real_0: 0.39801448583602905 (0.21983456859985986) | > loss_disc_real_1: 0.21841847896575928 (0.18734083573023477) | > loss_disc_real_2: 0.20061756670475006 (0.19970354437828064) | > loss_disc_real_3: 0.397582083940506 (0.29444746673107147) | > loss_disc_real_4: 0.37995263934135437 (0.24149094025293985) | > loss_disc_real_5: 0.33409637212753296 (0.2327598581711451) | > loss_0: 2.7769863605499268 (2.6216649214426675) | > loss_gen: 3.120656967163086 (2.270025690396627) | > loss_kl: 1.7982314825057983 (1.8818498452504475) | > loss_feat: 4.193777561187744 (5.154526789983113) | > loss_mel: 27.51378631591797 (26.389929453531902) | > loss_duration: 2.1505346298217773 (2.071205457051595) | > loss_1: 38.77698516845703 (37.76753616333008) --> EVAL PERFORMANCE | > avg_loader_time: 0.016170660654703777 (+0.0075372854868570975) | > avg_loss_disc: 2.6216649214426675 (-0.3026115894317627) | > avg_loss_disc_real_0: 0.21983456859985986 (+0.030609374245007814) | > avg_loss_disc_real_1: 0.18734083573023477 (-0.013715123136838286) | > avg_loss_disc_real_2: 0.19970354437828064 (-0.0201170320312182) | > avg_loss_disc_real_3: 0.29444746673107147 (+0.11109921336174011) | > avg_loss_disc_real_4: 0.24149094025293985 (+0.0473092719912529) | > avg_loss_disc_real_5: 0.2327598581711451 (-0.09363117814064029) | > avg_loss_0: 2.6216649214426675 (-0.3026115894317627) | > avg_loss_gen: 2.270025690396627 (-0.21841593583424856) | > avg_loss_kl: 1.8818498452504475 (-0.2332404057184856) | > avg_loss_feat: 5.154526789983113 (-2.8610918521881112) | > avg_loss_mel: 26.389929453531902 (-1.5594247182210275) | > avg_loss_duration: 2.071205457051595 (+0.004596392313639619) | > avg_loss_1: 37.76753616333008 (-4.867577870686851)  > EPOCH: 8/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:46:34)   --> TIME: 2023-10-19 23:46:53 -- STEP: 29/50 -- GLOBAL_STEP: 53430 | > loss_disc: 2.295595169067383 (2.9330221291246086) | > loss_disc_real_0: 0.05186634883284569 (0.34946849267801333) | > loss_disc_real_1: 0.11840049177408218 (0.2521233178418258) | > loss_disc_real_2: 0.05558016896247864 (0.23492317004450436) | > loss_disc_real_3: 0.3087150752544403 (0.23173958666879554) | > loss_disc_real_4: 0.22957457602024078 (0.23483285590492445) | > loss_disc_real_5: 0.07698516547679901 (0.2680556729179005) | > loss_0: 2.295595169067383 (2.9330221291246086) | > grad_norm_0: tensor(1477.5081, device='cuda:0') (tensor(2414.3518, device='cuda:0')) | > loss_gen: 2.5799341201782227 (2.2876109912477682) | > loss_kl: 1.6651504039764404 (1.903654279380009) | > loss_feat: 8.507311820983887 (4.621014484814529) | > loss_mel: 27.932371139526367 (24.757397454360436) | > loss_duration: 2.084940195083618 (2.068933750021047) | > loss_1: 42.769710540771484 (35.63861110292632) | > grad_norm_1: tensor(17624.9844, device='cuda:0') (tensor(29823.7441, device='cuda:0')) | > current_lr_0: 0.0001984062837559772 | > current_lr_1: 0.0001984062837559772 | > step_time: 0.5894 (0.5217294364139952) | > loader_time: 0.0038 (0.01678346765452418)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.7326784133911133 (3.7326784133911133) | > loss_disc_real_0: 0.5232747793197632 (0.5232747793197632) | > loss_disc_real_1: 0.3884647786617279 (0.3884647786617279) | > loss_disc_real_2: 0.47594302892684937 (0.47594302892684937) | > loss_disc_real_3: 0.40409186482429504 (0.40409186482429504) | > loss_disc_real_4: 0.6544827818870544 (0.6544827818870544) | > loss_disc_real_5: 0.3867577612400055 (0.3867577612400055) | > loss_0: 3.7326784133911133 (3.7326784133911133) | > loss_gen: 2.4560599327087402 (2.4560599327087402) | > loss_kl: 1.916024088859558 (1.916024088859558) | > loss_feat: 4.052309513092041 (4.052309513092041) | > loss_mel: 29.569766998291016 (29.569766998291016) | > loss_duration: 1.967159628868103 (1.967159628868103) | > loss_1: 39.96131896972656 (39.96131896972656)  --> STEP: 1 | > loss_disc: 3.1390929222106934 (3.1390929222106934) | > loss_disc_real_0: 0.5327684879302979 (0.5327684879302979) | > loss_disc_real_1: 0.32567787170410156 (0.32567787170410156) | > loss_disc_real_2: 0.26644167304039 (0.26644167304039) | > loss_disc_real_3: 0.3646453619003296 (0.3646453619003296) | > loss_disc_real_4: 0.6078404188156128 (0.6078404188156128) | > loss_disc_real_5: 0.20734231173992157 (0.20734231173992157) | > loss_0: 3.1390929222106934 (3.1390929222106934) | > loss_gen: 3.1429882049560547 (3.1429882049560547) | > loss_kl: 1.849631428718567 (1.849631428718567) | > loss_feat: 6.99372673034668 (6.99372673034668) | > loss_mel: 30.787885665893555 (30.787885665893555) | > loss_duration: 2.084354877471924 (2.084354877471924) | > loss_1: 44.858585357666016 (44.858585357666016)  --> STEP: 2 | > loss_disc: 3.0453946590423584 (3.092243790626526) | > loss_disc_real_0: 0.30662640929222107 (0.41969744861125946) | > loss_disc_real_1: 0.24460509419441223 (0.2851414829492569) | > loss_disc_real_2: 0.3592105805873871 (0.31282612681388855) | > loss_disc_real_3: 0.2683168053627014 (0.3164810836315155) | > loss_disc_real_4: 0.3088444471359253 (0.45834243297576904) | > loss_disc_real_5: 0.34188607335090637 (0.27461419254541397) | > loss_0: 3.0453946590423584 (3.092243790626526) | > loss_gen: 1.8347423076629639 (2.4888652563095093) | > loss_kl: 2.1793088912963867 (2.014470160007477) | > loss_feat: 0.036337584257125854 (3.5150321573019028) | > loss_mel: 3.0009658336639404 (16.894425749778748) | > loss_duration: 1.9958068132400513 (2.0400808453559875) | > loss_1: 9.047161102294922 (26.95287322998047)  --> STEP: 3 | > loss_disc: 2.2467026710510254 (2.810396750768026) | > loss_disc_real_0: 0.5615717768669128 (0.4669888913631439) | > loss_disc_real_1: 0.1455785185098648 (0.23862049480279288) | > loss_disc_real_2: 0.09848435968160629 (0.2413788711031278) | > loss_disc_real_3: 0.1402580738067627 (0.2577400803565979) | > loss_disc_real_4: 0.23498080670833588 (0.3838885575532913) | > loss_disc_real_5: 0.12691815197467804 (0.22538217902183533) | > loss_0: 2.2467026710510254 (2.810396750768026) | > loss_gen: 2.391834020614624 (2.456521511077881) | > loss_kl: 1.5107438564300537 (1.8465613921483357) | > loss_feat: 6.1050615310668945 (4.378375281890233) | > loss_mel: 29.730289459228516 (21.173046986262005) | > loss_duration: 2.1627471446990967 (2.0809696118036904) | > loss_1: 41.90067672729492 (31.935474395751953) --> EVAL PERFORMANCE | > avg_loader_time: 0.007412115732828776 (-0.008758544921875) | > avg_loss_disc: 2.810396750768026 (+0.18873182932535837) | > avg_loss_disc_real_0: 0.4669888913631439 (+0.24715432276328406) | > avg_loss_disc_real_1: 0.23862049480279288 (+0.051279659072558104) | > avg_loss_disc_real_2: 0.2413788711031278 (+0.04167532672484717) | > avg_loss_disc_real_3: 0.2577400803565979 (-0.03670738637447357) | > avg_loss_disc_real_4: 0.3838885575532913 (+0.14239761730035147) | > avg_loss_disc_real_5: 0.22538217902183533 (-0.007377679149309785) | > avg_loss_0: 2.810396750768026 (+0.18873182932535837) | > avg_loss_gen: 2.456521511077881 (+0.18649582068125392) | > avg_loss_kl: 1.8465613921483357 (-0.035288453102111816) | > avg_loss_feat: 4.378375281890233 (-0.7761515080928802) | > avg_loss_mel: 21.173046986262005 (-5.2168824672698975) | > avg_loss_duration: 2.0809696118036904 (+0.009764154752095244) | > avg_loss_1: 31.935474395751953 (-5.832061767578125)  > EPOCH: 9/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:47:13)   --> TIME: 2023-10-19 23:47:19 -- STEP: 9/50 -- GLOBAL_STEP: 53460 | > loss_disc: 3.046719789505005 (2.72112242380778) | > loss_disc_real_0: 0.12987899780273438 (0.17670294476879966) | > loss_disc_real_1: 0.29545265436172485 (0.2893687453534868) | > loss_disc_real_2: 0.28803369402885437 (0.31501826726728016) | > loss_disc_real_3: 0.25796765089035034 (0.2997323539521959) | > loss_disc_real_4: 0.23701703548431396 (0.2330835668577088) | > loss_disc_real_5: 0.24623169004917145 (0.245002590947681) | > loss_0: 3.046719789505005 (2.72112242380778) | > grad_norm_0: tensor(2232.6511, device='cuda:0') (tensor(1016.8624, device='cuda:0')) | > loss_gen: 1.4887235164642334 (2.5221902794308133) | > loss_kl: 2.2027552127838135 (1.552166713608636) | > loss_feat: 0.17506615817546844 (8.065830434362093) | > loss_mel: 4.340814113616943 (26.386320696936714) | > loss_duration: 1.891358733177185 (2.0219857825173273) | > loss_1: 10.09871768951416 (40.54849338531494) | > grad_norm_1: tensor(20757.1797, device='cuda:0') (tensor(42250.5000, device='cuda:0')) | > current_lr_0: 0.00019820796425327303 | > current_lr_1: 0.00019820796425327303 | > step_time: 0.3779 (0.39752981397840714) | > loader_time: 0.0072 (0.007990413241916232)  --> TIME: 2023-10-19 23:47:33 -- STEP: 39/50 -- GLOBAL_STEP: 53490 | > loss_disc: 2.8978843688964844 (2.59173221160204) | > loss_disc_real_0: 0.16509181261062622 (0.19378775444168309) | > loss_disc_real_1: 0.25941064953804016 (0.2494245377870707) | > loss_disc_real_2: 0.10434526950120926 (0.23800560645759097) | > loss_disc_real_3: 0.24375025928020477 (0.2515869626823145) | > loss_disc_real_4: 0.24846860766410828 (0.25964029744649547) | > loss_disc_real_5: 0.19073015451431274 (0.2298698408099321) | > loss_0: 2.8978843688964844 (2.59173221160204) | > grad_norm_0: tensor(1183.3613, device='cuda:0') (tensor(1097.9806, device='cuda:0')) | > loss_gen: 1.603568434715271 (2.491665641466776) | > loss_kl: 0.7801631093025208 (1.5773229996363323) | > loss_feat: 0.5032179951667786 (6.414086415790594) | > loss_mel: 20.2564697265625 (24.900561296022854) | > loss_duration: 1.9731556177139282 (2.025487765287742) | > loss_1: 25.116575241088867 (37.40912437438965) | > grad_norm_1: tensor(29359.7754, device='cuda:0') (tensor(35477.0625, device='cuda:0')) | > current_lr_0: 0.00019820796425327303 | > current_lr_1: 0.00019820796425327303 | > step_time: 0.4756 (0.4400053696754651) | > loader_time: 0.011 (0.009532861220530974)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6153202056884766 (2.6153202056884766) | > loss_disc_real_0: 0.3504847586154938 (0.3504847586154938) | > loss_disc_real_1: 0.2567802369594574 (0.2567802369594574) | > loss_disc_real_2: 0.17388853430747986 (0.17388853430747986) | > loss_disc_real_3: 0.3480933606624603 (0.3480933606624603) | > loss_disc_real_4: 0.17549356818199158 (0.17549356818199158) | > loss_disc_real_5: 0.41460612416267395 (0.41460612416267395) | > loss_0: 2.6153202056884766 (2.6153202056884766) | > loss_gen: 2.485069751739502 (2.485069751739502) | > loss_kl: 1.6137287616729736 (1.6137287616729736) | > loss_feat: 3.2809224128723145 (3.2809224128723145) | > loss_mel: 27.440433502197266 (27.440433502197266) | > loss_duration: 1.924633502960205 (1.924633502960205) | > loss_1: 36.74478530883789 (36.74478530883789)  --> STEP: 1 | > loss_disc: 2.8734991550445557 (2.8734991550445557) | > loss_disc_real_0: 0.658133864402771 (0.658133864402771) | > loss_disc_real_1: 0.20370085537433624 (0.20370085537433624) | > loss_disc_real_2: 0.19191180169582367 (0.19191180169582367) | > loss_disc_real_3: 0.3848714828491211 (0.3848714828491211) | > loss_disc_real_4: 0.3034283220767975 (0.3034283220767975) | > loss_disc_real_5: 0.4993722438812256 (0.4993722438812256) | > loss_0: 2.8734991550445557 (2.8734991550445557) | > loss_gen: 3.1593592166900635 (3.1593592166900635) | > loss_kl: 2.1817803382873535 (2.1817803382873535) | > loss_feat: 5.233057498931885 (5.233057498931885) | > loss_mel: 28.435409545898438 (28.435409545898438) | > loss_duration: 2.063385486602783 (2.063385486602783) | > loss_1: 41.07299041748047 (41.07299041748047)  --> STEP: 2 | > loss_disc: 2.9103243350982666 (2.891911745071411) | > loss_disc_real_0: 0.9406777620315552 (0.7994058132171631) | > loss_disc_real_1: 0.16871720552444458 (0.1862090304493904) | > loss_disc_real_2: 0.08295057713985443 (0.13743118941783905) | > loss_disc_real_3: 0.31036922335624695 (0.347620353102684) | > loss_disc_real_4: 0.11424784362316132 (0.2088380828499794) | > loss_disc_real_5: 0.12956249713897705 (0.3144673705101013) | > loss_0: 2.9103243350982666 (2.891911745071411) | > loss_gen: 4.022427082061768 (3.5908931493759155) | > loss_kl: 1.9231821298599243 (2.052481234073639) | > loss_feat: 11.766444206237793 (8.499750852584839) | > loss_mel: 27.215473175048828 (27.825441360473633) | > loss_duration: 1.9921178817749023 (2.0277516841888428) | > loss_1: 46.91964340209961 (43.99631690979004)  --> STEP: 3 | > loss_disc: 2.991736888885498 (2.92518679300944) | > loss_disc_real_0: 0.7375601530075073 (0.7787905931472778) | > loss_disc_real_1: 0.31776687502861023 (0.23006164530913034) | > loss_disc_real_2: 0.10925570130348206 (0.12803936004638672) | > loss_disc_real_3: 0.304439514875412 (0.33322674036026) | > loss_disc_real_4: 0.18195311725139618 (0.19987642765045166) | > loss_disc_real_5: 0.35944655537605286 (0.32946043213208515) | > loss_0: 2.991736888885498 (2.92518679300944) | > loss_gen: 2.4131529331207275 (3.198313077290853) | > loss_kl: 0.8679505586624146 (1.6576376756032307) | > loss_feat: 2.0507400035858154 (6.350080569585164) | > loss_mel: 21.493885040283203 (25.714922587076824) | > loss_duration: 2.05881929397583 (2.0381075541178384) | > loss_1: 28.884546279907227 (38.95906003316244) --> EVAL PERFORMANCE | > avg_loader_time: 0.016113122304280598 (+0.00870100657145182) | > avg_loss_disc: 2.92518679300944 (+0.11479004224141409) | > avg_loss_disc_real_0: 0.7787905931472778 (+0.3118017017841339) | > avg_loss_disc_real_1: 0.23006164530913034 (-0.008558849493662535) | > avg_loss_disc_real_2: 0.12803936004638672 (-0.11333951105674109) | > avg_loss_disc_real_3: 0.33322674036026 (+0.07548666000366211) | > avg_loss_disc_real_4: 0.19987642765045166 (-0.18401212990283966) | > avg_loss_disc_real_5: 0.32946043213208515 (+0.10407825311024982) | > avg_loss_0: 2.92518679300944 (+0.11479004224141409) | > avg_loss_gen: 3.198313077290853 (+0.7417915662129722) | > avg_loss_kl: 1.6576376756032307 (-0.18892371654510498) | > avg_loss_feat: 6.350080569585164 (+1.971705287694931) | > avg_loss_mel: 25.714922587076824 (+4.541875600814819) | > avg_loss_duration: 2.0381075541178384 (-0.04286205768585205) | > avg_loss_1: 38.95906003316244 (+7.023585637410484)  > EPOCH: 10/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:47:47)   --> TIME: 2023-10-19 23:48:00 -- STEP: 19/50 -- GLOBAL_STEP: 53520 | > loss_disc: 3.277589797973633 (2.8898105433112695) | > loss_disc_real_0: 0.24284666776657104 (0.4252116397807473) | > loss_disc_real_1: 0.4897021949291229 (0.2557144800299092) | > loss_disc_real_2: 0.47883397340774536 (0.25423657286324) | > loss_disc_real_3: 0.3114217221736908 (0.3045574181566113) | > loss_disc_real_4: 0.31479188799858093 (0.22812339859573463) | > loss_disc_real_5: 0.7404602766036987 (0.23709014803171158) | > loss_0: 3.277589797973633 (2.8898105433112695) | > grad_norm_0: tensor(1470.9135, device='cuda:0') (tensor(1392.0466, device='cuda:0')) | > loss_gen: 2.5678157806396484 (2.6731333858088444) | > loss_kl: 1.4194145202636719 (1.6834471790414107) | > loss_feat: 4.258294582366943 (6.41135148704052) | > loss_mel: 31.54206657409668 (29.910078475349827) | > loss_duration: 2.1920931339263916 (2.0779589289113094) | > loss_1: 41.97968292236328 (42.75596970006039) | > grad_norm_1: tensor(28937.8691, device='cuda:0') (tensor(43274.6172, device='cuda:0')) | > current_lr_0: 0.00019800984298332845 | > current_lr_1: 0.00019800984298332845 | > step_time: 0.6393 (0.5004293291192305) | > loader_time: 0.0248 (0.021583670064022665)  --> TIME: 2023-10-19 23:48:15 -- STEP: 49/50 -- GLOBAL_STEP: 53550 | > loss_disc: 2.9816534519195557 (2.863555927665866) | > loss_disc_real_0: 0.28583669662475586 (0.28538050783836105) | > loss_disc_real_1: 0.1957351565361023 (0.26744037015097477) | > loss_disc_real_2: 0.16984307765960693 (0.2429263385734996) | > loss_disc_real_3: 0.17831456661224365 (0.29991684146985714) | > loss_disc_real_4: 0.31120896339416504 (0.22969837730028192) | > loss_disc_real_5: 0.2410842478275299 (0.23120204336485084) | > loss_0: 2.9816534519195557 (2.863555927665866) | > grad_norm_0: tensor(574.7057, device='cuda:0') (tensor(1231.0117, device='cuda:0')) | > loss_gen: 1.7365838289260864 (2.4222806205554885) | > loss_kl: 1.2986215353012085 (1.5234253807943694) | > loss_feat: 2.184558391571045 (5.83073354223553) | > loss_mel: 14.424771308898926 (27.817067934542287) | > loss_duration: 2.0902059078216553 (2.007652124580072) | > loss_1: 21.7347412109375 (39.601159718571886) | > grad_norm_1: tensor(23168.6230, device='cuda:0') (tensor(34564.5898, device='cuda:0')) | > current_lr_0: 0.00019800984298332845 | > current_lr_1: 0.00019800984298332845 | > step_time: 0.298 (0.48044917534808723) | > loader_time: 0.1469 (0.021504796281152844)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8313145637512207 (2.8313145637512207) | > loss_disc_real_0: 0.13925305008888245 (0.13925305008888245) | > loss_disc_real_1: 0.1123206689953804 (0.1123206689953804) | > loss_disc_real_2: 0.16894389688968658 (0.16894389688968658) | > loss_disc_real_3: 0.22200892865657806 (0.22200892865657806) | > loss_disc_real_4: 0.17510591447353363 (0.17510591447353363) | > loss_disc_real_5: 0.2978128492832184 (0.2978128492832184) | > loss_0: 2.8313145637512207 (2.8313145637512207) | > loss_gen: 1.8951916694641113 (1.8951916694641113) | > loss_kl: 1.7148698568344116 (1.7148698568344116) | > loss_feat: 5.92784309387207 (5.92784309387207) | > loss_mel: 26.571914672851562 (26.571914672851562) | > loss_duration: 1.948893666267395 (1.948893666267395) | > loss_1: 38.058712005615234 (38.058712005615234)  --> STEP: 1 | > loss_disc: 2.842198133468628 (2.842198133468628) | > loss_disc_real_0: 0.07646170258522034 (0.07646170258522034) | > loss_disc_real_1: 0.20788034796714783 (0.20788034796714783) | > loss_disc_real_2: 0.08872184157371521 (0.08872184157371521) | > loss_disc_real_3: 0.12861470878124237 (0.12861470878124237) | > loss_disc_real_4: 0.07494533807039261 (0.07494533807039261) | > loss_disc_real_5: 0.07634793221950531 (0.07634793221950531) | > loss_0: 2.842198133468628 (2.842198133468628) | > loss_gen: 1.131368637084961 (1.131368637084961) | > loss_kl: 1.9355801343917847 (1.9355801343917847) | > loss_feat: 7.496827125549316 (7.496827125549316) | > loss_mel: 30.77573585510254 (30.77573585510254) | > loss_duration: 2.056459426879883 (2.056459426879883) | > loss_1: 43.395973205566406 (43.395973205566406)  --> STEP: 2 | > loss_disc: 3.0661046504974365 (2.9541513919830322) | > loss_disc_real_0: 0.4360961318016052 (0.2562789171934128) | > loss_disc_real_1: 0.33248817920684814 (0.270184263586998) | > loss_disc_real_2: 0.24986372888088226 (0.16929278522729874) | > loss_disc_real_3: 0.290490984916687 (0.2095528468489647) | > loss_disc_real_4: 0.322453111410141 (0.1986992247402668) | > loss_disc_real_5: 0.24619662761688232 (0.16127227991819382) | > loss_0: 3.0661046504974365 (2.9541513919830322) | > loss_gen: 1.8932979106903076 (1.5123332738876343) | > loss_kl: 1.576849341392517 (1.7562147378921509) | > loss_feat: 0.05746683105826378 (3.77714697830379) | > loss_mel: 6.57686185836792 (18.67629885673523) | > loss_duration: 2.044264554977417 (2.05036199092865) | > loss_1: 12.148740768432617 (27.77235698699951)  --> STEP: 3 | > loss_disc: 2.9046623706817627 (2.937655051549276) | > loss_disc_real_0: 0.19572538137435913 (0.23609440525372824) | > loss_disc_real_1: 0.2558506429195404 (0.2654063900311788) | > loss_disc_real_2: 0.2899836301803589 (0.2095230668783188) | > loss_disc_real_3: 0.2065785676240921 (0.20856142044067383) | > loss_disc_real_4: 0.26590025424957275 (0.22109956791003546) | > loss_disc_real_5: 0.15907028317451477 (0.16053828100363413) | > loss_0: 2.9046623706817627 (2.937655051549276) | > loss_gen: 1.6271417140960693 (1.5506027539571126) | > loss_kl: 1.5218256711959839 (1.6780850489934285) | > loss_feat: 3.6106154918670654 (3.721636482824882) | > loss_mel: 24.011676788330078 (20.454758167266846) | > loss_duration: 2.113091468811035 (2.071271816889445) | > loss_1: 32.88434982299805 (29.476354598999023) --> EVAL PERFORMANCE | > avg_loader_time: 0.008728265762329102 (-0.007384856541951496) | > avg_loss_disc: 2.937655051549276 (+0.012468258539835908) | > avg_loss_disc_real_0: 0.23609440525372824 (-0.5426961878935496) | > avg_loss_disc_real_1: 0.2654063900311788 (+0.03534474472204843) | > avg_loss_disc_real_2: 0.2095230668783188 (+0.08148370683193207) | > avg_loss_disc_real_3: 0.20856142044067383 (-0.12466531991958618) | > avg_loss_disc_real_4: 0.22109956791003546 (+0.0212231402595838) | > avg_loss_disc_real_5: 0.16053828100363413 (-0.16892215112845102) | > avg_loss_0: 2.937655051549276 (+0.012468258539835908) | > avg_loss_gen: 1.5506027539571126 (-1.6477103233337405) | > avg_loss_kl: 1.6780850489934285 (+0.020447373390197754) | > avg_loss_feat: 3.721636482824882 (-2.628444086760282) | > avg_loss_mel: 20.454758167266846 (-5.260164419809978) | > avg_loss_duration: 2.071271816889445 (+0.033164262771606445) | > avg_loss_1: 29.476354598999023 (-9.482705434163414)  > EPOCH: 11/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:48:24)   --> TIME: 2023-10-19 23:48:41 -- STEP: 29/50 -- GLOBAL_STEP: 53580 | > loss_disc: 2.725182294845581 (2.6131085116287753) | > loss_disc_real_0: 0.14885690808296204 (0.20500390938129917) | > loss_disc_real_1: 0.2582727372646332 (0.228674794836291) | > loss_disc_real_2: 0.171590194106102 (0.22066769569084563) | > loss_disc_real_3: 0.22500404715538025 (0.23985222213227173) | > loss_disc_real_4: 0.28658270835876465 (0.24316721563709193) | > loss_disc_real_5: 0.23335976898670197 (0.22038864575583358) | > loss_0: 2.725182294845581 (2.6131085116287753) | > grad_norm_0: tensor(731.5656, device='cuda:0') (tensor(726.6904, device='cuda:0')) | > loss_gen: 2.682224750518799 (2.213230046732672) | > loss_kl: 1.4262775182724 (1.5013214637493264) | > loss_feat: 6.427048206329346 (5.053966902453323) | > loss_mel: 27.425994873046875 (24.672661304473877) | > loss_duration: 2.0142340660095215 (2.0361668529181647) | > loss_1: 39.97577667236328 (35.47734599277892) | > grad_norm_1: tensor(42448.4453, device='cuda:0') (tensor(36663.7539, device='cuda:0')) | > current_lr_0: 0.0001978119197479974 | > current_lr_1: 0.0001978119197479974 | > step_time: 0.6903 (0.450436493446087) | > loader_time: 0.0218 (0.013478706622945851)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9793429374694824 (2.9793429374694824) | > loss_disc_real_0: 0.303192675113678 (0.303192675113678) | > loss_disc_real_1: 0.32363495230674744 (0.32363495230674744) | > loss_disc_real_2: 0.24940891563892365 (0.24940891563892365) | > loss_disc_real_3: 0.2583223581314087 (0.2583223581314087) | > loss_disc_real_4: 0.2118881791830063 (0.2118881791830063) | > loss_disc_real_5: 0.30840542912483215 (0.30840542912483215) | > loss_0: 2.9793429374694824 (2.9793429374694824) | > loss_gen: 1.739800214767456 (1.739800214767456) | > loss_kl: 1.2709721326828003 (1.2709721326828003) | > loss_feat: 0.6688039302825928 (0.6688039302825928) | > loss_mel: 26.52791404724121 (26.52791404724121) | > loss_duration: 1.866124153137207 (1.866124153137207) | > loss_1: 32.073612213134766 (32.073612213134766)  --> STEP: 1 | > loss_disc: 1.6049163341522217 (1.6049163341522217) | > loss_disc_real_0: 0.019046179950237274 (0.019046179950237274) | > loss_disc_real_1: 0.2519679069519043 (0.2519679069519043) | > loss_disc_real_2: 0.027370724827051163 (0.027370724827051163) | > loss_disc_real_3: 0.15383751690387726 (0.15383751690387726) | > loss_disc_real_4: 0.08400054275989532 (0.08400054275989532) | > loss_disc_real_5: 0.1005985215306282 (0.1005985215306282) | > loss_0: 1.6049163341522217 (1.6049163341522217) | > loss_gen: 3.416024684906006 (3.416024684906006) | > loss_kl: 1.7827616930007935 (1.7827616930007935) | > loss_feat: 10.674310684204102 (10.674310684204102) | > loss_mel: 26.325572967529297 (26.325572967529297) | > loss_duration: 2.0531160831451416 (2.0531160831451416) | > loss_1: 44.25178527832031 (44.25178527832031)  --> STEP: 2 | > loss_disc: 2.084968090057373 (1.8449422121047974) | > loss_disc_real_0: 0.1262764185667038 (0.07266129925847054) | > loss_disc_real_1: 0.2101641148328781 (0.2310660108923912) | > loss_disc_real_2: 0.16328555345535278 (0.09532813914120197) | > loss_disc_real_3: 0.1317039579153061 (0.14277073740959167) | > loss_disc_real_4: 0.16919422149658203 (0.12659738212823868) | > loss_disc_real_5: 0.36502891778945923 (0.23281371966004372) | > loss_0: 2.084968090057373 (1.8449422121047974) | > loss_gen: 2.9588234424591064 (3.187424063682556) | > loss_kl: 2.5115554332733154 (2.1471585631370544) | > loss_feat: 8.476444244384766 (9.575377464294434) | > loss_mel: 27.24188232421875 (26.783727645874023) | > loss_duration: 2.0130252838134766 (2.033070683479309) | > loss_1: 43.20172882080078 (43.72675704956055)  --> STEP: 3 | > loss_disc: 2.498816728591919 (2.0629003842671714) | > loss_disc_real_0: 0.2159706950187683 (0.12043109784523646) | > loss_disc_real_1: 0.2495935559272766 (0.237241859237353) | > loss_disc_real_2: 0.33866333961486816 (0.17643987263242403) | > loss_disc_real_3: 0.1903390884399414 (0.15862685441970825) | > loss_disc_real_4: 0.25749191641807556 (0.1702288935581843) | > loss_disc_real_5: 0.29650115966796875 (0.2540428663293521) | > loss_0: 2.498816728591919 (2.0629003842671714) | > loss_gen: 2.3250069618225098 (2.899951696395874) | > loss_kl: 1.007366418838501 (1.7672278483708699) | > loss_feat: 3.470175266265869 (7.540310064951579) | > loss_mel: 21.91439437866211 (25.160616556803387) | > loss_duration: 2.137819528579712 (2.0679869651794434) | > loss_1: 30.85476303100586 (39.436092376708984) --> EVAL PERFORMANCE | > avg_loader_time: 0.01047364870707194 (+0.001745382944742838) | > avg_loss_disc: 2.0629003842671714 (-0.8747546672821045) | > avg_loss_disc_real_0: 0.12043109784523646 (-0.11566330740849178) | > avg_loss_disc_real_1: 0.237241859237353 (-0.028164530793825776) | > avg_loss_disc_real_2: 0.17643987263242403 (-0.03308319424589476) | > avg_loss_disc_real_3: 0.15862685441970825 (-0.049934566020965576) | > avg_loss_disc_real_4: 0.1702288935581843 (-0.050870674351851164) | > avg_loss_disc_real_5: 0.2540428663293521 (+0.09350458532571795) | > avg_loss_0: 2.0629003842671714 (-0.8747546672821045) | > avg_loss_gen: 2.899951696395874 (+1.3493489424387615) | > avg_loss_kl: 1.7672278483708699 (+0.0891427993774414) | > avg_loss_feat: 7.540310064951579 (+3.818673582126697) | > avg_loss_mel: 25.160616556803387 (+4.705858389536541) | > avg_loss_duration: 2.0679869651794434 (-0.0032848517100014796) | > avg_loss_1: 39.436092376708984 (+9.959737777709961)  > EPOCH: 12/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:49:00)   --> TIME: 2023-10-19 23:49:08 -- STEP: 9/50 -- GLOBAL_STEP: 53610 | > loss_disc: 2.65315580368042 (2.463223854700724) | > loss_disc_real_0: 0.17550796270370483 (0.15967926962508094) | > loss_disc_real_1: 0.3497171700000763 (0.2501671529478497) | > loss_disc_real_2: 0.4442566931247711 (0.19308632612228394) | > loss_disc_real_3: 0.38615912199020386 (0.22838306840923098) | > loss_disc_real_4: 0.3185402452945709 (0.20429148276646933) | > loss_disc_real_5: 0.23853087425231934 (0.20096890214416716) | > loss_0: 2.65315580368042 (2.463223854700724) | > grad_norm_0: tensor(806.8642, device='cuda:0') (tensor(973.5587, device='cuda:0')) | > loss_gen: 2.6165008544921875 (2.4943944613138833) | > loss_kl: 1.4040640592575073 (1.5286022027333577) | > loss_feat: 3.9554104804992676 (7.208786540561253) | > loss_mel: 26.60796356201172 (25.863864050971138) | > loss_duration: 1.84394371509552 (1.9529444376627605) | > loss_1: 36.42788314819336 (39.04859161376953) | > grad_norm_1: tensor(7064.7544, device='cuda:0') (tensor(37777.9297, device='cuda:0')) | > current_lr_0: 0.00019761419434933197 | > current_lr_1: 0.00019761419434933197 | > step_time: 0.3997 (0.5190623866187202) | > loader_time: 0.0019 (0.017607821358574763)  --> TIME: 2023-10-19 23:49:21 -- STEP: 39/50 -- GLOBAL_STEP: 53640 | > loss_disc: 1.9607586860656738 (2.600761300478226) | > loss_disc_real_0: 0.04180135577917099 (0.20082512526557997) | > loss_disc_real_1: 0.17258566617965698 (0.25401001366285175) | > loss_disc_real_2: 0.10337809473276138 (0.22072804862490067) | > loss_disc_real_3: 0.21768955886363983 (0.2415840414663156) | > loss_disc_real_4: 0.4836432933807373 (0.252126641667042) | > loss_disc_real_5: 0.09091993421316147 (0.20094778474706873) | > loss_0: 1.9607586860656738 (2.600761300478226) | > grad_norm_0: tensor(1326.5918, device='cuda:0') (tensor(1098.8682, device='cuda:0')) | > loss_gen: 2.657156467437744 (2.406087792836703) | > loss_kl: 1.0220774412155151 (1.4729508283810737) | > loss_feat: 7.761335372924805 (5.233548401257931) | > loss_mel: 33.69453048706055 (24.27927190218216) | > loss_duration: 1.9507499933242798 (1.9933516276188386) | > loss_1: 47.08584976196289 (35.38521028176334) | > grad_norm_1: tensor(39913.8672, device='cuda:0') (tensor(37950.6758, device='cuda:0')) | > current_lr_0: 0.00019761419434933197 | > current_lr_1: 0.00019761419434933197 | > step_time: 0.2907 (0.42957448348020894) | > loader_time: 0.0045 (0.012324596062684668)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9748239517211914 (2.9748239517211914) | > loss_disc_real_0: 0.13258522748947144 (0.13258522748947144) | > loss_disc_real_1: 0.36797410249710083 (0.36797410249710083) | > loss_disc_real_2: 0.31367409229278564 (0.31367409229278564) | > loss_disc_real_3: 0.34761810302734375 (0.34761810302734375) | > loss_disc_real_4: 0.1422492116689682 (0.1422492116689682) | > loss_disc_real_5: 0.2753962576389313 (0.2753962576389313) | > loss_0: 2.9748239517211914 (2.9748239517211914) | > loss_gen: 1.8124632835388184 (1.8124632835388184) | > loss_kl: 2.040200710296631 (2.040200710296631) | > loss_feat: 2.425503730773926 (2.425503730773926) | > loss_mel: 27.37469482421875 (27.37469482421875) | > loss_duration: 1.932916283607483 (1.932916283607483) | > loss_1: 35.585777282714844 (35.585777282714844)  --> STEP: 1 | > loss_disc: 2.9010329246520996 (2.9010329246520996) | > loss_disc_real_0: 0.1052226722240448 (0.1052226722240448) | > loss_disc_real_1: 0.29395732283592224 (0.29395732283592224) | > loss_disc_real_2: 0.23038238286972046 (0.23038238286972046) | > loss_disc_real_3: 0.13142137229442596 (0.13142137229442596) | > loss_disc_real_4: 0.1621997356414795 (0.1621997356414795) | > loss_disc_real_5: 0.4475221037864685 (0.4475221037864685) | > loss_0: 2.9010329246520996 (2.9010329246520996) | > loss_gen: 1.9290956258773804 (1.9290956258773804) | > loss_kl: 1.8980499505996704 (1.8980499505996704) | > loss_feat: 7.868410110473633 (7.868410110473633) | > loss_mel: 28.32864761352539 (28.32864761352539) | > loss_duration: 2.0259408950805664 (2.0259408950805664) | > loss_1: 42.05014419555664 (42.05014419555664)  --> STEP: 2 | > loss_disc: 2.9554638862609863 (2.928248405456543) | > loss_disc_real_0: 0.17068642377853394 (0.13795454800128937) | > loss_disc_real_1: 0.24977783858776093 (0.2718675807118416) | > loss_disc_real_2: 0.24044787883758545 (0.23541513085365295) | > loss_disc_real_3: 0.3498072922229767 (0.24061433225870132) | > loss_disc_real_4: 0.24224171042442322 (0.20222072303295135) | > loss_disc_real_5: 0.4485451281070709 (0.4480336159467697) | > loss_0: 2.9554638862609863 (2.928248405456543) | > loss_gen: 2.1188859939575195 (2.02399080991745) | > loss_kl: 2.0190412998199463 (1.9585456252098083) | > loss_feat: 7.477965831756592 (7.673187971115112) | > loss_mel: 26.080564498901367 (27.20460605621338) | > loss_duration: 2.02839994430542 (2.027170419692993) | > loss_1: 39.724857330322266 (40.88750076293945)  --> STEP: 3 | > loss_disc: 3.0208377838134766 (2.959111531575521) | > loss_disc_real_0: 0.27577435970306396 (0.18389448523521423) | > loss_disc_real_1: 0.3680346608161926 (0.3039232740799586) | > loss_disc_real_2: 0.3104555606842041 (0.26042860746383667) | > loss_disc_real_3: 0.360201895236969 (0.2804768532514572) | > loss_disc_real_4: 0.26867735385894775 (0.22437293330828348) | > loss_disc_real_5: 0.33450621366500854 (0.410191148519516) | > loss_0: 3.0208377838134766 (2.959111531575521) | > loss_gen: 1.9751743078231812 (2.007718642552694) | > loss_kl: 1.1200380325317383 (1.6790430943171184) | > loss_feat: 0.1281208097934723 (5.158165584007899) | > loss_mel: 4.7427897453308105 (19.717333952585857) | > loss_duration: 2.081806182861328 (2.045382340749105) | > loss_1: 10.047929763793945 (30.607643763224285) --> EVAL PERFORMANCE | > avg_loader_time: 0.013079484303792318 (+0.0026058355967203788) | > avg_loss_disc: 2.959111531575521 (+0.8962111473083496) | > avg_loss_disc_real_0: 0.18389448523521423 (+0.06346338738997777) | > avg_loss_disc_real_1: 0.3039232740799586 (+0.06668141484260562) | > avg_loss_disc_real_2: 0.26042860746383667 (+0.08398873483141264) | > avg_loss_disc_real_3: 0.2804768532514572 (+0.12184999883174896) | > avg_loss_disc_real_4: 0.22437293330828348 (+0.05414403975009918) | > avg_loss_disc_real_5: 0.410191148519516 (+0.1561482821901639) | > avg_loss_0: 2.959111531575521 (+0.8962111473083496) | > avg_loss_gen: 2.007718642552694 (-0.8922330538431802) | > avg_loss_kl: 1.6790430943171184 (-0.08818475405375148) | > avg_loss_feat: 5.158165584007899 (-2.38214448094368) | > avg_loss_mel: 19.717333952585857 (-5.443282604217529) | > avg_loss_duration: 2.045382340749105 (-0.022604624430338394) | > avg_loss_1: 30.607643763224285 (-8.8284486134847)  > EPOCH: 13/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:49:36)   --> TIME: 2023-10-19 23:49:49 -- STEP: 19/50 -- GLOBAL_STEP: 53670 | > loss_disc: 3.740551710128784 (2.995755521874679) | > loss_disc_real_0: 0.7282677888870239 (0.35260720943149765) | > loss_disc_real_1: 0.4554169774055481 (0.27087035539903137) | > loss_disc_real_2: 0.48259055614471436 (0.23519269337779597) | > loss_disc_real_3: 0.3901798129081726 (0.26483275074707835) | > loss_disc_real_4: 0.47965022921562195 (0.342373924133809) | > loss_disc_real_5: 0.5078353881835938 (0.29417590934195015) | > loss_0: 3.740551710128784 (2.995755521874679) | > grad_norm_0: tensor(3444.1870, device='cuda:0') (tensor(1623.3793, device='cuda:0')) | > loss_gen: 3.299102306365967 (2.7235185598072253) | > loss_kl: 1.437500238418579 (1.472004002646396) | > loss_feat: 4.506458759307861 (6.226910753861854) | > loss_mel: 27.686574935913086 (24.878365667242754) | > loss_duration: 2.154789686203003 (2.0519264434513294) | > loss_1: 39.08442687988281 (37.352725781892474) | > grad_norm_1: tensor(24419.3418, device='cuda:0') (tensor(45765.2070, device='cuda:0')) | > current_lr_0: 0.0001974166665895819 | > current_lr_1: 0.0001974166665895819 | > step_time: 0.6054 (0.5046891162269994) | > loader_time: 0.0038 (0.017848115218313115)  --> TIME: 2023-10-19 23:50:05 -- STEP: 49/50 -- GLOBAL_STEP: 53700 | > loss_disc: 1.58284330368042 (2.759746938335652) | > loss_disc_real_0: 0.1006178930401802 (0.2471651960620466) | > loss_disc_real_1: 0.2343524992465973 (0.2478115190656817) | > loss_disc_real_2: 0.13907644152641296 (0.2492949025971549) | > loss_disc_real_3: 0.27743467688560486 (0.24941244162619114) | > loss_disc_real_4: 0.25230786204338074 (0.2883949791062243) | > loss_disc_real_5: 0.017125505954027176 (0.25089811782675725) | > loss_0: 1.58284330368042 (2.759746938335652) | > grad_norm_0: tensor(506.3194, device='cuda:0') (tensor(1157.8715, device='cuda:0')) | > loss_gen: 3.3260498046875 (2.4435024918342134) | > loss_kl: 0.9469481110572815 (1.4534995932968295) | > loss_feat: 8.079793930053711 (5.87719834755574) | > loss_mel: 36.84217834472656 (26.03618581440984) | > loss_duration: 2.0584049224853516 (1.991140180704545) | > loss_1: 51.25337219238281 (37.80152651728416) | > grad_norm_1: tensor(43629.6641, device='cuda:0') (tensor(34105.3672, device='cuda:0')) | > current_lr_0: 0.0001974166665895819 | > current_lr_1: 0.0001974166665895819 | > step_time: 0.6147 (0.5007182286710153) | > loader_time: 0.2023 (0.02233184600362972)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.01863431930542 (3.01863431930542) | > loss_disc_real_0: 0.19332893192768097 (0.19332893192768097) | > loss_disc_real_1: 0.2492668330669403 (0.2492668330669403) | > loss_disc_real_2: 0.2627337574958801 (0.2627337574958801) | > loss_disc_real_3: 0.2592461407184601 (0.2592461407184601) | > loss_disc_real_4: 0.3103531002998352 (0.3103531002998352) | > loss_disc_real_5: 0.22465462982654572 (0.22465462982654572) | > loss_0: 3.01863431930542 (3.01863431930542) | > loss_gen: 1.5056071281433105 (1.5056071281433105) | > loss_kl: 1.7838771343231201 (1.7838771343231201) | > loss_feat: 0.07188713550567627 (0.07188713550567627) | > loss_mel: 4.594717502593994 (4.594717502593994) | > loss_duration: 2.000386953353882 (2.000386953353882) | > loss_1: 9.956476211547852 (9.956476211547852)  --> STEP: 1 | > loss_disc: 2.6273000240325928 (2.6273000240325928) | > loss_disc_real_0: 0.22311431169509888 (0.22311431169509888) | > loss_disc_real_1: 0.24408909678459167 (0.24408909678459167) | > loss_disc_real_2: 0.24584846198558807 (0.24584846198558807) | > loss_disc_real_3: 0.26148006319999695 (0.26148006319999695) | > loss_disc_real_4: 0.3076533377170563 (0.3076533377170563) | > loss_disc_real_5: 0.2130134552717209 (0.2130134552717209) | > loss_0: 2.6273000240325928 (2.6273000240325928) | > loss_gen: 1.9939312934875488 (1.9939312934875488) | > loss_kl: 1.692857265472412 (1.692857265472412) | > loss_feat: 1.3638554811477661 (1.3638554811477661) | > loss_mel: 23.832754135131836 (23.832754135131836) | > loss_duration: 2.0646450519561768 (2.0646450519561768) | > loss_1: 30.948043823242188 (30.948043823242188)  --> STEP: 2 | > loss_disc: 3.0184309482574463 (2.8228654861450195) | > loss_disc_real_0: 0.19326263666152954 (0.2081884741783142) | > loss_disc_real_1: 0.2492872178554535 (0.24668815732002258) | > loss_disc_real_2: 0.26273301243782043 (0.25429073721170425) | > loss_disc_real_3: 0.25924697518348694 (0.26036351919174194) | > loss_disc_real_4: 0.3103492558002472 (0.30900129675865173) | > loss_disc_real_5: 0.2246648520231247 (0.2188391536474228) | > loss_0: 3.0184309482574463 (2.8228654861450195) | > loss_gen: 1.5057525634765625 (1.7498419284820557) | > loss_kl: 2.053931951522827 (1.8733946084976196) | > loss_feat: 0.07239465415477753 (0.7181250676512718) | > loss_mel: 4.795510768890381 (14.314132452011108) | > loss_duration: 2.0339159965515137 (2.049280524253845) | > loss_1: 10.461505889892578 (20.704774856567383)  --> STEP: 3 | > loss_disc: 1.8960869312286377 (2.513939301172892) | > loss_disc_real_0: 0.08968513458967209 (0.16868736098210016) | > loss_disc_real_1: 0.2234346866607666 (0.2389370004336039) | > loss_disc_real_2: 0.19150611758232117 (0.23336253066857657) | > loss_disc_real_3: 0.2323630154132843 (0.25103001793225604) | > loss_disc_real_4: 0.16444101929664612 (0.26081453760464984) | > loss_disc_real_5: 0.06766267120838165 (0.1684469928344091) | > loss_0: 1.8960869312286377 (2.513939301172892) | > loss_gen: 2.36442232131958 (1.9547020594278972) | > loss_kl: 1.2304432392120361 (1.659077485402425) | > loss_feat: 6.328704357147217 (2.58831816414992) | > loss_mel: 26.208484649658203 (18.278916517893474) | > loss_duration: 2.127363681793213 (2.0753082434336343) | > loss_1: 38.25941848754883 (26.5563227335612) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027054150899251304 (-0.010374069213867188) | > avg_loss_disc: 2.513939301172892 (-0.4451722304026289) | > avg_loss_disc_real_0: 0.16868736098210016 (-0.015207124253114074) | > avg_loss_disc_real_1: 0.2389370004336039 (-0.0649862736463547) | > avg_loss_disc_real_2: 0.23336253066857657 (-0.027066076795260102) | > avg_loss_disc_real_3: 0.25103001793225604 (-0.02944683531920117) | > avg_loss_disc_real_4: 0.26081453760464984 (+0.036441604296366364) | > avg_loss_disc_real_5: 0.1684469928344091 (-0.2417441556851069) | > avg_loss_0: 2.513939301172892 (-0.4451722304026289) | > avg_loss_gen: 1.9547020594278972 (-0.053016583124796623) | > avg_loss_kl: 1.659077485402425 (-0.019965608914693345) | > avg_loss_feat: 2.58831816414992 (-2.5698474198579793) | > avg_loss_mel: 18.278916517893474 (-1.4384174346923828) | > avg_loss_duration: 2.0753082434336343 (+0.029925902684529326) | > avg_loss_1: 26.5563227335612 (-4.051321029663086) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_53701.pth  > EPOCH: 14/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:50:14)   --> TIME: 2023-10-19 23:50:30 -- STEP: 29/50 -- GLOBAL_STEP: 53730 | > loss_disc: 2.877223491668701 (2.430147590308354) | > loss_disc_real_0: 0.19385653734207153 (0.16940162035411802) | > loss_disc_real_1: 0.39239466190338135 (0.21099423938270273) | > loss_disc_real_2: 0.24574516713619232 (0.20087745772867366) | > loss_disc_real_3: 0.3499264717102051 (0.24484573407419796) | > loss_disc_real_4: 0.3438720703125 (0.2242675259195525) | > loss_disc_real_5: 0.23643822968006134 (0.2354354328508007) | > loss_0: 2.877223491668701 (2.430147590308354) | > grad_norm_0: tensor(717.5504, device='cuda:0') (tensor(776.0138, device='cuda:0')) | > loss_gen: 1.8759642839431763 (2.479654221699155) | > loss_kl: 1.133300542831421 (1.71301603522794) | > loss_feat: 0.6841804385185242 (6.423329020882475) | > loss_mel: 23.975008010864258 (29.50556337422338) | > loss_duration: 2.0140209197998047 (2.027039704651668) | > loss_1: 29.68247413635254 (42.14860205814756) | > grad_norm_1: tensor(23257.7910, device='cuda:0') (tensor(44957.9961, device='cuda:0')) | > current_lr_0: 0.0001972193362711948 | > current_lr_1: 0.0001972193362711948 | > step_time: 0.376 (0.3869978066148429) | > loader_time: 0.0094 (0.006865024566650391)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5306854248046875 (1.5306854248046875) | > loss_disc_real_0: 0.0537976399064064 (0.0537976399064064) | > loss_disc_real_1: 0.24701209366321564 (0.24701209366321564) | > loss_disc_real_2: 0.08313609659671783 (0.08313609659671783) | > loss_disc_real_3: 0.16411307454109192 (0.16411307454109192) | > loss_disc_real_4: 0.03504883870482445 (0.03504883870482445) | > loss_disc_real_5: 0.06595262885093689 (0.06595262885093689) | > loss_0: 1.5306854248046875 (1.5306854248046875) | > loss_gen: 2.76985502243042 (2.76985502243042) | > loss_kl: 1.572922706604004 (1.572922706604004) | > loss_feat: 12.401735305786133 (12.401735305786133) | > loss_mel: 27.739437103271484 (27.739437103271484) | > loss_duration: 1.9202983379364014 (1.9202983379364014) | > loss_1: 46.40425109863281 (46.40425109863281)  --> STEP: 1 | > loss_disc: 2.2997055053710938 (2.2997055053710938) | > loss_disc_real_0: 0.023644007742404938 (0.023644007742404938) | > loss_disc_real_1: 0.37269264459609985 (0.37269264459609985) | > loss_disc_real_2: 0.1268598437309265 (0.1268598437309265) | > loss_disc_real_3: 0.24223122000694275 (0.24223122000694275) | > loss_disc_real_4: 0.277378648519516 (0.277378648519516) | > loss_disc_real_5: 0.12546147406101227 (0.12546147406101227) | > loss_0: 2.2997055053710938 (2.2997055053710938) | > loss_gen: 2.330594778060913 (2.330594778060913) | > loss_kl: 1.4640673398971558 (1.4640673398971558) | > loss_feat: 8.540480613708496 (8.540480613708496) | > loss_mel: 25.7612361907959 (25.7612361907959) | > loss_duration: 2.075667142868042 (2.075667142868042) | > loss_1: 40.17204666137695 (40.17204666137695)  --> STEP: 2 | > loss_disc: 2.437870979309082 (2.368788242340088) | > loss_disc_real_0: 0.09898722171783447 (0.061315614730119705) | > loss_disc_real_1: 0.3083656430244446 (0.3405291438102722) | > loss_disc_real_2: 0.11030550301074982 (0.11858267337083817) | > loss_disc_real_3: 0.13087964057922363 (0.1865554302930832) | > loss_disc_real_4: 0.15205033123493195 (0.21471448987722397) | > loss_disc_real_5: 0.36195871233940125 (0.24371009320020676) | > loss_0: 2.437870979309082 (2.368788242340088) | > loss_gen: 2.0834078788757324 (2.2070013284683228) | > loss_kl: 2.22182559967041 (1.842946469783783) | > loss_feat: 6.754744529724121 (7.647612571716309) | > loss_mel: 29.56909942626953 (27.665167808532715) | > loss_duration: 1.999307632446289 (2.0374873876571655) | > loss_1: 42.628387451171875 (41.400217056274414)  --> STEP: 3 | > loss_disc: 2.797468662261963 (2.5116817156473794) | > loss_disc_real_0: 0.1363629698753357 (0.08633139977852504) | > loss_disc_real_1: 0.21125034987926483 (0.2974362124999364) | > loss_disc_real_2: 0.22476588189601898 (0.1539770762125651) | > loss_disc_real_3: 0.25101029872894287 (0.20804038643836975) | > loss_disc_real_4: 0.33556893467903137 (0.2549993048111598) | > loss_disc_real_5: 0.34110188484191895 (0.27617402374744415) | > loss_0: 2.797468662261963 (2.5116817156473794) | > loss_gen: 1.7745440006256104 (2.0628488858540854) | > loss_kl: 1.0489578247070312 (1.5782835880915325) | > loss_feat: 0.957306981086731 (5.417510708173116) | > loss_mel: 22.14539909362793 (25.825244903564453) | > loss_duration: 2.143503189086914 (2.0728259881337485) | > loss_1: 28.069711685180664 (36.95671526590983) --> EVAL PERFORMANCE | > avg_loader_time: 0.006209452946980794 (+0.0035040378570556636) | > avg_loss_disc: 2.5116817156473794 (-0.0022575855255126953) | > avg_loss_disc_real_0: 0.08633139977852504 (-0.08235596120357512) | > avg_loss_disc_real_1: 0.2974362124999364 (+0.05849921206633249) | > avg_loss_disc_real_2: 0.1539770762125651 (-0.07938545445601147) | > avg_loss_disc_real_3: 0.20804038643836975 (-0.04298963149388629) | > avg_loss_disc_real_4: 0.2549993048111598 (-0.005815232793490055) | > avg_loss_disc_real_5: 0.27617402374744415 (+0.10772703091303507) | > avg_loss_0: 2.5116817156473794 (-0.0022575855255126953) | > avg_loss_gen: 2.0628488858540854 (+0.10814682642618823) | > avg_loss_kl: 1.5782835880915325 (-0.08079389731089259) | > avg_loss_feat: 5.417510708173116 (+2.8291925440231958) | > avg_loss_mel: 25.825244903564453 (+7.546328385670979) | > avg_loss_duration: 2.0728259881337485 (-0.0024822552998857716) | > avg_loss_1: 36.95671526590983 (+10.40039253234863)  > EPOCH: 15/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:50:50)   --> TIME: 2023-10-19 23:50:59 -- STEP: 9/50 -- GLOBAL_STEP: 53760 | > loss_disc: 3.0505945682525635 (2.6964895725250244) | > loss_disc_real_0: 0.3125375509262085 (0.17339083552360535) | > loss_disc_real_1: 0.5172915458679199 (0.27079715993669295) | > loss_disc_real_2: 0.5910423994064331 (0.2552727609872818) | > loss_disc_real_3: 0.4368504285812378 (0.3275328791803784) | > loss_disc_real_4: 0.30846166610717773 (0.21431384773717987) | > loss_disc_real_5: 0.3021274507045746 (0.260648965007729) | > loss_0: 3.0505945682525635 (2.6964895725250244) | > grad_norm_0: tensor(759.9655, device='cuda:0') (tensor(722.0176, device='cuda:0')) | > loss_gen: 3.2821669578552246 (2.503215644094679) | > loss_kl: 1.4927589893341064 (1.5055248737335205) | > loss_feat: 6.166738986968994 (5.735158469941881) | > loss_mel: 30.02159309387207 (26.79867829216851) | > loss_duration: 1.8433034420013428 (1.9476420614454482) | > loss_1: 42.80656051635742 (38.490218268500435) | > grad_norm_1: tensor(30284.2578, device='cuda:0') (tensor(30853.6211, device='cuda:0')) | > current_lr_0: 0.00019702220319681561 | > current_lr_1: 0.00019702220319681561 | > step_time: 0.6423 (0.5161326196458604) | > loader_time: 0.0291 (0.01954054832458496)  --> TIME: 2023-10-19 23:51:14 -- STEP: 39/50 -- GLOBAL_STEP: 53790 | > loss_disc: 2.7030718326568604 (2.6398009948241405) | > loss_disc_real_0: 0.19585515558719635 (0.17169652845806035) | > loss_disc_real_1: 0.2797654867172241 (0.26461115651405775) | > loss_disc_real_2: 0.19531841576099396 (0.24128202769236692) | > loss_disc_real_3: 0.2861582636833191 (0.2656237847912005) | > loss_disc_real_4: 0.19002042710781097 (0.22435888418784508) | > loss_disc_real_5: 0.20770907402038574 (0.23517177253961563) | > loss_0: 2.7030718326568604 (2.6398009948241405) | > grad_norm_0: tensor(603.6662, device='cuda:0') (tensor(808.2306, device='cuda:0')) | > loss_gen: 1.6483110189437866 (2.308048135195023) | > loss_kl: 1.27590012550354 (1.5202794548792715) | > loss_feat: 1.1895909309387207 (4.980069804650086) | > loss_mel: 27.134296417236328 (27.391992764595226) | > loss_duration: 1.9131028652191162 (1.9927054185133721) | > loss_1: 33.16120147705078 (38.19309537838668) | > grad_norm_1: tensor(18740.5195, device='cuda:0') (tensor(30398.3594, device='cuda:0')) | > current_lr_0: 0.00019702220319681561 | > current_lr_1: 0.00019702220319681561 | > step_time: 0.3439 (0.4863914893223689) | > loader_time: 0.0137 (0.016352298932197768)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.477137565612793 (2.477137565612793) | > loss_disc_real_0: 0.21885831654071808 (0.21885831654071808) | > loss_disc_real_1: 0.1933055967092514 (0.1933055967092514) | > loss_disc_real_2: 0.1929430216550827 (0.1929430216550827) | > loss_disc_real_3: 0.21797144412994385 (0.21797144412994385) | > loss_disc_real_4: 0.41812577843666077 (0.41812577843666077) | > loss_disc_real_5: 0.2592218816280365 (0.2592218816280365) | > loss_0: 2.477137565612793 (2.477137565612793) | > loss_gen: 3.541184425354004 (3.541184425354004) | > loss_kl: 1.480372667312622 (1.480372667312622) | > loss_feat: 7.860568046569824 (7.860568046569824) | > loss_mel: 25.650964736938477 (25.650964736938477) | > loss_duration: 1.908839225769043 (1.908839225769043) | > loss_1: 40.44192886352539 (40.44192886352539)  --> STEP: 1 | > loss_disc: 2.259237289428711 (2.259237289428711) | > loss_disc_real_0: 0.2172500640153885 (0.2172500640153885) | > loss_disc_real_1: 0.12105963379144669 (0.12105963379144669) | > loss_disc_real_2: 0.1441347301006317 (0.1441347301006317) | > loss_disc_real_3: 0.1909865289926529 (0.1909865289926529) | > loss_disc_real_4: 0.25311577320098877 (0.25311577320098877) | > loss_disc_real_5: 0.26058581471443176 (0.26058581471443176) | > loss_0: 2.259237289428711 (2.259237289428711) | > loss_gen: 2.6658623218536377 (2.6658623218536377) | > loss_kl: 1.5312665700912476 (1.5312665700912476) | > loss_feat: 7.198241710662842 (7.198241710662842) | > loss_mel: 25.33395004272461 (25.33395004272461) | > loss_duration: 2.0654995441436768 (2.0654995441436768) | > loss_1: 38.79481887817383 (38.79481887817383)  --> STEP: 2 | > loss_disc: 1.9922196865081787 (2.125728487968445) | > loss_disc_real_0: 0.1645234376192093 (0.1908867508172989) | > loss_disc_real_1: 0.26039838790893555 (0.19072901085019112) | > loss_disc_real_2: 0.04969308152794838 (0.09691390581429005) | > loss_disc_real_3: 0.29535335302352905 (0.24316994100809097) | > loss_disc_real_4: 0.14446048438549042 (0.1987881287932396) | > loss_disc_real_5: 0.06079068034887314 (0.16068824753165245) | > loss_0: 1.9922196865081787 (2.125728487968445) | > loss_gen: 2.5583295822143555 (2.6120959520339966) | > loss_kl: 2.1703295707702637 (1.8507980704307556) | > loss_feat: 6.567015647888184 (6.882628679275513) | > loss_mel: 30.61090850830078 (27.972429275512695) | > loss_duration: 1.989975094795227 (2.027737319469452) | > loss_1: 43.89655685424805 (41.34568786621094)  --> STEP: 3 | > loss_disc: 3.1804494857788086 (2.477302153905233) | > loss_disc_real_0: 0.4316125214099884 (0.2711286743481954) | > loss_disc_real_1: 0.32062509655952454 (0.2340277060866356) | > loss_disc_real_2: 0.20132826268672943 (0.1317186914384365) | > loss_disc_real_3: 0.4716682732105255 (0.31933605174223584) | > loss_disc_real_4: 0.2988044321537018 (0.23212689658006033) | > loss_disc_real_5: 0.43941229581832886 (0.25359626362721127) | > loss_0: 3.1804494857788086 (2.477302153905233) | > loss_gen: 2.5802247524261475 (2.6014722188313804) | > loss_kl: 1.0857385396957397 (1.595778226852417) | > loss_feat: 2.71089506149292 (5.492050806681315) | > loss_mel: 21.20468521118164 (25.716514587402344) | > loss_duration: 2.091301918029785 (2.048925518989563) | > loss_1: 29.672847747802734 (37.45474116007487) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022452672322591147 (-0.00396418571472168) | > avg_loss_disc: 2.477302153905233 (-0.034379561742146514) | > avg_loss_disc_real_0: 0.2711286743481954 (+0.18479727456967032) | > avg_loss_disc_real_1: 0.2340277060866356 (-0.06340850641330081) | > avg_loss_disc_real_2: 0.1317186914384365 (-0.022258384774128587) | > avg_loss_disc_real_3: 0.31933605174223584 (+0.11129566530386609) | > avg_loss_disc_real_4: 0.23212689658006033 (-0.022872408231099456) | > avg_loss_disc_real_5: 0.25359626362721127 (-0.02257776012023288) | > avg_loss_0: 2.477302153905233 (-0.034379561742146514) | > avg_loss_gen: 2.6014722188313804 (+0.5386233329772949) | > avg_loss_kl: 1.595778226852417 (+0.01749463876088453) | > avg_loss_feat: 5.492050806681315 (+0.07454009850819965) | > avg_loss_mel: 25.716514587402344 (-0.10873031616210938) | > avg_loss_duration: 2.048925518989563 (-0.023900469144185532) | > avg_loss_1: 37.45474116007487 (+0.49802589416503906)  > EPOCH: 16/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:51:27)   --> TIME: 2023-10-19 23:51:43 -- STEP: 19/50 -- GLOBAL_STEP: 53820 | > loss_disc: 2.730964183807373 (2.717757745792991) | > loss_disc_real_0: 0.18536123633384705 (0.18205391948944644) | > loss_disc_real_1: 0.5551440715789795 (0.2622184198545782) | > loss_disc_real_2: 0.3169519901275635 (0.22703760136899195) | > loss_disc_real_3: 0.35830068588256836 (0.29235458119135155) | > loss_disc_real_4: 0.4301231801509857 (0.3116123037118661) | > loss_disc_real_5: 0.35004478693008423 (0.25105633018048185) | > loss_0: 2.730964183807373 (2.717757745792991) | > grad_norm_0: tensor(813.6198, device='cuda:0') (tensor(1157.1436, device='cuda:0')) | > loss_gen: 3.06506085395813 (2.485553866938541) | > loss_kl: 1.3828119039535522 (1.5403244495391846) | > loss_feat: 4.3362040519714355 (5.88052407063936) | > loss_mel: 28.182798385620117 (27.45202350616455) | > loss_duration: 2.1695969104766846 (2.043073660448978) | > loss_1: 39.136470794677734 (39.40150009958368) | > grad_norm_1: tensor(38496.2266, device='cuda:0') (tensor(41982.3242, device='cuda:0')) | > current_lr_0: 0.00019682526716928672 | > current_lr_1: 0.00019682526716928672 | > step_time: 0.282 (0.49228301801179586) | > loader_time: 0.0249 (0.018881697403757197)  --> TIME: 2023-10-19 23:51:59 -- STEP: 49/50 -- GLOBAL_STEP: 53850 | > loss_disc: 2.8008761405944824 (2.6705988888837853) | > loss_disc_real_0: 0.1279786378145218 (0.2118818797171116) | > loss_disc_real_1: 0.3261784613132477 (0.2524057064889645) | > loss_disc_real_2: 0.1588880866765976 (0.22216722171525566) | > loss_disc_real_3: 0.31385448575019836 (0.2619752215639669) | > loss_disc_real_4: 0.4467518627643585 (0.2849661935196847) | > loss_disc_real_5: 0.42756468057632446 (0.2259610292254662) | > loss_0: 2.8008761405944824 (2.6705988888837853) | > grad_norm_0: tensor(823.0981, device='cuda:0') (tensor(1315.8840, device='cuda:0')) | > loss_gen: 2.265133857727051 (2.389091428445311) | > loss_kl: 1.0300378799438477 (1.4651526486387059) | > loss_feat: 1.4468272924423218 (5.540018234934125) | > loss_mel: 26.722572326660156 (26.303951029874842) | > loss_duration: 2.0715341567993164 (1.9828404504425672) | > loss_1: 33.53610610961914 (37.68105370657785) | > grad_norm_1: tensor(9742.8076, device='cuda:0') (tensor(34838.7305, device='cuda:0')) | > current_lr_0: 0.00019682526716928672 | > current_lr_1: 0.00019682526716928672 | > step_time: 0.5974 (0.5151978560856411) | > loader_time: 0.1804 (0.021634111599046362)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.715529441833496 (2.715529441833496) | > loss_disc_real_0: 0.37782734632492065 (0.37782734632492065) | > loss_disc_real_1: 0.12860442698001862 (0.12860442698001862) | > loss_disc_real_2: 0.21636615693569183 (0.21636615693569183) | > loss_disc_real_3: 0.2099185287952423 (0.2099185287952423) | > loss_disc_real_4: 0.33511093258857727 (0.33511093258857727) | > loss_disc_real_5: 0.31528598070144653 (0.31528598070144653) | > loss_0: 2.715529441833496 (2.715529441833496) | > loss_gen: 2.542691707611084 (2.542691707611084) | > loss_kl: 1.4685344696044922 (1.4685344696044922) | > loss_feat: 8.192294120788574 (8.192294120788574) | > loss_mel: 28.080121994018555 (28.080121994018555) | > loss_duration: 1.9924603700637817 (1.9924603700637817) | > loss_1: 42.27610397338867 (42.27610397338867)  --> STEP: 1 | > loss_disc: 3.4390861988067627 (3.4390861988067627) | > loss_disc_real_0: 0.2736714482307434 (0.2736714482307434) | > loss_disc_real_1: 0.29200494289398193 (0.29200494289398193) | > loss_disc_real_2: 0.47890421748161316 (0.47890421748161316) | > loss_disc_real_3: 0.2046654224395752 (0.2046654224395752) | > loss_disc_real_4: 0.18675260245800018 (0.18675260245800018) | > loss_disc_real_5: 0.4245356619358063 (0.4245356619358063) | > loss_0: 3.4390861988067627 (3.4390861988067627) | > loss_gen: 1.8941740989685059 (1.8941740989685059) | > loss_kl: 2.574472188949585 (2.574472188949585) | > loss_feat: 5.749043941497803 (5.749043941497803) | > loss_mel: 28.588321685791016 (28.588321685791016) | > loss_duration: 2.0837953090667725 (2.0837953090667725) | > loss_1: 40.88980484008789 (40.88980484008789)  --> STEP: 2 | > loss_disc: 3.112149477005005 (3.275617837905884) | > loss_disc_real_0: 0.10263209044933319 (0.1881517693400383) | > loss_disc_real_1: 0.29841211438179016 (0.29520852863788605) | > loss_disc_real_2: 0.2656083106994629 (0.372256264090538) | > loss_disc_real_3: 0.30664724111557007 (0.25565633177757263) | > loss_disc_real_4: 0.41980352997779846 (0.3032780662178993) | > loss_disc_real_5: 0.34667882323265076 (0.3856072425842285) | > loss_0: 3.112149477005005 (3.275617837905884) | > loss_gen: 1.7448512315750122 (1.819512665271759) | > loss_kl: 2.129873752593994 (2.3521729707717896) | > loss_feat: 0.1452292501926422 (2.9471365958452225) | > loss_mel: 5.644114017486572 (17.116217851638794) | > loss_duration: 2.0401387214660645 (2.0619670152664185) | > loss_1: 11.704206466674805 (26.297005653381348)  --> STEP: 3 | > loss_disc: 2.887092113494873 (3.1461092631022134) | > loss_disc_real_0: 0.2742161750793457 (0.2168399045864741) | > loss_disc_real_1: 0.17310358583927155 (0.2545068810383479) | > loss_disc_real_2: 0.30543485283851624 (0.3499824603398641) | > loss_disc_real_3: 0.25204187631607056 (0.2544515132904053) | > loss_disc_real_4: 0.5478677153587341 (0.38480794926484424) | > loss_disc_real_5: 0.26412007212638855 (0.34511151909828186) | > loss_0: 2.887092113494873 (3.1461092631022134) | > loss_gen: 2.186035394668579 (1.9416869084040325) | > loss_kl: 0.5956650376319885 (1.766670326391856) | > loss_feat: 3.202016830444336 (3.032096674044927) | > loss_mel: 23.719972610473633 (19.317469437917072) | > loss_duration: 2.0646560192108154 (2.062863349914551) | > loss_1: 31.76834487915039 (28.120785395304363) --> EVAL PERFORMANCE | > avg_loader_time: 0.01814413070678711 (+0.015898863474527996) | > avg_loss_disc: 3.1461092631022134 (+0.6688071091969805) | > avg_loss_disc_real_0: 0.2168399045864741 (-0.054288769761721284) | > avg_loss_disc_real_1: 0.2545068810383479 (+0.02047917495171231) | > avg_loss_disc_real_2: 0.3499824603398641 (+0.21826376890142757) | > avg_loss_disc_real_3: 0.2544515132904053 (-0.06488453845183056) | > avg_loss_disc_real_4: 0.38480794926484424 (+0.1526810526847839) | > avg_loss_disc_real_5: 0.34511151909828186 (+0.09151525547107059) | > avg_loss_0: 3.1461092631022134 (+0.6688071091969805) | > avg_loss_gen: 1.9416869084040325 (-0.6597853104273479) | > avg_loss_kl: 1.766670326391856 (+0.17089209953943896) | > avg_loss_feat: 3.032096674044927 (-2.4599541326363883) | > avg_loss_mel: 19.317469437917072 (-6.399045149485271) | > avg_loss_duration: 2.062863349914551 (+0.013937830924987793) | > avg_loss_1: 28.120785395304363 (-9.333955764770504)  > EPOCH: 17/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:52:08)   --> TIME: 2023-10-19 23:52:24 -- STEP: 29/50 -- GLOBAL_STEP: 53880 | > loss_disc: 2.5236034393310547 (2.576636898106542) | > loss_disc_real_0: 0.1911085993051529 (0.19735840194184204) | > loss_disc_real_1: 0.3844693601131439 (0.2615782323068586) | > loss_disc_real_2: 0.2469688206911087 (0.19883902948992005) | > loss_disc_real_3: 0.4937756061553955 (0.23346256843671717) | > loss_disc_real_4: 0.25484326481819153 (0.24250221933270327) | > loss_disc_real_5: 0.11702661961317062 (0.2256472364774552) | > loss_0: 2.5236034393310547 (2.576636898106542) | > grad_norm_0: tensor(1164.8350, device='cuda:0') (tensor(834.3067, device='cuda:0')) | > loss_gen: 3.0851244926452637 (2.4609363777884123) | > loss_kl: 1.421980381011963 (1.5162013193656658) | > loss_feat: 5.920636177062988 (6.457617243559196) | > loss_mel: 27.231674194335938 (27.591027407810607) | > loss_duration: 1.9882726669311523 (1.998982223971137) | > loss_1: 39.64768981933594 (40.02476462002457) | > grad_norm_1: tensor(32550.3145, device='cuda:0') (tensor(39679.4609, device='cuda:0')) | > current_lr_0: 0.00019662852799164733 | > current_lr_1: 0.00019662852799164733 | > step_time: 0.6754 (0.3981100197496086) | > loader_time: 0.0243 (0.008368294814537311)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.981832265853882 (2.981832265853882) | > loss_disc_real_0: 0.38214415311813354 (0.38214415311813354) | > loss_disc_real_1: 0.2890666425228119 (0.2890666425228119) | > loss_disc_real_2: 0.24564264714717865 (0.24564264714717865) | > loss_disc_real_3: 0.36771613359451294 (0.36771613359451294) | > loss_disc_real_4: 0.4125710725784302 (0.4125710725784302) | > loss_disc_real_5: 0.33311471343040466 (0.33311471343040466) | > loss_0: 2.981832265853882 (2.981832265853882) | > loss_gen: 2.213153600692749 (2.213153600692749) | > loss_kl: 2.0397918224334717 (2.0397918224334717) | > loss_feat: 0.40828055143356323 (0.40828055143356323) | > loss_mel: 20.34786605834961 (20.34786605834961) | > loss_duration: 1.9273111820220947 (1.9273111820220947) | > loss_1: 26.936403274536133 (26.936403274536133)  --> STEP: 1 | > loss_disc: 2.7828187942504883 (2.7828187942504883) | > loss_disc_real_0: 0.33881744742393494 (0.33881744742393494) | > loss_disc_real_1: 0.2470017671585083 (0.2470017671585083) | > loss_disc_real_2: 0.371027410030365 (0.371027410030365) | > loss_disc_real_3: 0.5777003765106201 (0.5777003765106201) | > loss_disc_real_4: 0.14384479820728302 (0.14384479820728302) | > loss_disc_real_5: 0.3250102400779724 (0.3250102400779724) | > loss_0: 2.7828187942504883 (2.7828187942504883) | > loss_gen: 4.204530239105225 (4.204530239105225) | > loss_kl: 1.6171678304672241 (1.6171678304672241) | > loss_feat: 8.355072975158691 (8.355072975158691) | > loss_mel: 28.326400756835938 (28.326400756835938) | > loss_duration: 2.016427993774414 (2.016427993774414) | > loss_1: 44.51959991455078 (44.51959991455078)  --> STEP: 2 | > loss_disc: 3.0509274005889893 (2.9168730974197388) | > loss_disc_real_0: 0.3795682191848755 (0.3591928333044052) | > loss_disc_real_1: 0.2901798486709595 (0.2685908079147339) | > loss_disc_real_2: 0.25562721490859985 (0.3133273124694824) | > loss_disc_real_3: 0.37528038024902344 (0.4764903783798218) | > loss_disc_real_4: 0.4262412190437317 (0.28504300862550735) | > loss_disc_real_5: 0.33838340640068054 (0.3316968232393265) | > loss_0: 3.0509274005889893 (2.9168730974197388) | > loss_gen: 2.1556015014648438 (3.180065870285034) | > loss_kl: 1.7731117010116577 (1.695139765739441) | > loss_feat: 0.21512463688850403 (4.285098806023598) | > loss_mel: 5.363760471343994 (16.845080614089966) | > loss_duration: 2.0264179706573486 (2.0214229822158813) | > loss_1: 11.534016609191895 (28.026808261871338)  --> STEP: 3 | > loss_disc: 3.135759115219116 (2.9898351033528647) | > loss_disc_real_0: 0.41988813877105713 (0.3794246017932892) | > loss_disc_real_1: 0.3273765742778778 (0.2881860633691152) | > loss_disc_real_2: 0.3945353329181671 (0.340396652619044) | > loss_disc_real_3: 0.3923000693321228 (0.4484269420305888) | > loss_disc_real_4: 0.4839800298213959 (0.35135534902413684) | > loss_disc_real_5: 0.1361703872680664 (0.2665213445822398) | > loss_0: 3.135759115219116 (2.9898351033528647) | > loss_gen: 2.406350612640381 (2.922160784403483) | > loss_kl: 0.860307514667511 (1.4168623487154643) | > loss_feat: 3.268742561340332 (3.9463133911291757) | > loss_mel: 29.611906051635742 (21.100689093271892) | > loss_duration: 2.0693740844726562 (2.0374066829681396) | > loss_1: 38.216678619384766 (31.423431714375813) --> EVAL PERFORMANCE | > avg_loader_time: 0.006624062856038411 (-0.011520067850748699) | > avg_loss_disc: 2.9898351033528647 (-0.15627415974934866) | > avg_loss_disc_real_0: 0.3794246017932892 (+0.1625846972068151) | > avg_loss_disc_real_1: 0.2881860633691152 (+0.03367918233076728) | > avg_loss_disc_real_2: 0.340396652619044 (-0.009585807720820072) | > avg_loss_disc_real_3: 0.4484269420305888 (+0.19397542874018353) | > avg_loss_disc_real_4: 0.35135534902413684 (-0.0334526002407074) | > avg_loss_disc_real_5: 0.2665213445822398 (-0.07859017451604206) | > avg_loss_0: 2.9898351033528647 (-0.15627415974934866) | > avg_loss_gen: 2.922160784403483 (+0.9804738759994505) | > avg_loss_kl: 1.4168623487154643 (-0.3498079776763916) | > avg_loss_feat: 3.9463133911291757 (+0.9142167170842486) | > avg_loss_mel: 21.100689093271892 (+1.78321965535482) | > avg_loss_duration: 2.0374066829681396 (-0.025456666946411133) | > avg_loss_1: 31.423431714375813 (+3.3026463190714495)  > EPOCH: 18/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:52:44)   --> TIME: 2023-10-19 23:52:52 -- STEP: 9/50 -- GLOBAL_STEP: 53910 | > loss_disc: 2.5234644412994385 (2.5741245481703015) | > loss_disc_real_0: 0.231661856174469 (0.25127413786119884) | > loss_disc_real_1: 0.21217533946037292 (0.26757235990630257) | > loss_disc_real_2: 0.3037448525428772 (0.2945319347911411) | > loss_disc_real_3: 0.3969859778881073 (0.3091215358840095) | > loss_disc_real_4: 0.18298611044883728 (0.16433858333362472) | > loss_disc_real_5: 0.18547004461288452 (0.2350356930659877) | > loss_0: 2.5234644412994385 (2.5741245481703015) | > grad_norm_0: tensor(1645.8447, device='cuda:0') (tensor(1592.0094, device='cuda:0')) | > loss_gen: 2.426891803741455 (2.750293148888482) | > loss_kl: 1.1140179634094238 (1.2606702711847093) | > loss_feat: 5.149148464202881 (6.556520798140102) | > loss_mel: 28.618188858032227 (24.52165921529134) | > loss_duration: 1.8506779670715332 (1.9353440867529974) | > loss_1: 39.1589241027832 (37.024486753675674) | > grad_norm_1: tensor(26948.3770, device='cuda:0') (tensor(45640.4805, device='cuda:0')) | > current_lr_0: 0.0001964319854671337 | > current_lr_1: 0.0001964319854671337 | > step_time: 0.6077 (0.49750534693400067) | > loader_time: 0.0062 (0.020658625496758357)  --> TIME: 2023-10-19 23:53:08 -- STEP: 39/50 -- GLOBAL_STEP: 53940 | > loss_disc: 1.9605118036270142 (2.6154304345448813) | > loss_disc_real_0: 0.3248116075992584 (0.22073002627644783) | > loss_disc_real_1: 0.13910730183124542 (0.23495841102722365) | > loss_disc_real_2: 0.14346294105052948 (0.25438076009353006) | > loss_disc_real_3: 0.07493261247873306 (0.2573588477113307) | > loss_disc_real_4: 0.2930254638195038 (0.19950596601344076) | > loss_disc_real_5: 0.13558679819107056 (0.21272130406055695) | > loss_0: 1.9605118036270142 (2.6154304345448813) | > grad_norm_0: tensor(1209.5060, device='cuda:0') (tensor(1367.4933, device='cuda:0')) | > loss_gen: 3.122408628463745 (2.4207538091219387) | > loss_kl: 0.6995427012443542 (1.3165602118541035) | > loss_feat: 10.054402351379395 (5.4592369220768795) | > loss_mel: 29.297691345214844 (24.468142650066277) | > loss_duration: 1.933573603630066 (1.956696054874322) | > loss_1: 45.10762023925781 (35.621390000367775) | > grad_norm_1: tensor(66037.2109, device='cuda:0') (tensor(36083.5508, device='cuda:0')) | > current_lr_0: 0.0001964319854671337 | > current_lr_1: 0.0001964319854671337 | > step_time: 0.5901 (0.49103844471466845) | > loader_time: 0.0155 (0.019447791270720653)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.850931406021118 (2.850931406021118) | > loss_disc_real_0: 0.26420003175735474 (0.26420003175735474) | > loss_disc_real_1: 0.38899269700050354 (0.38899269700050354) | > loss_disc_real_2: 0.33125239610671997 (0.33125239610671997) | > loss_disc_real_3: 0.3126760721206665 (0.3126760721206665) | > loss_disc_real_4: 0.2889353334903717 (0.2889353334903717) | > loss_disc_real_5: 0.3512222468852997 (0.3512222468852997) | > loss_0: 2.850931406021118 (2.850931406021118) | > loss_gen: 2.362942695617676 (2.362942695617676) | > loss_kl: 1.7521154880523682 (1.7521154880523682) | > loss_feat: 2.0127129554748535 (2.0127129554748535) | > loss_mel: 26.85380744934082 (26.85380744934082) | > loss_duration: 1.90101158618927 (1.90101158618927) | > loss_1: 34.882591247558594 (34.882591247558594)  --> STEP: 1 | > loss_disc: 2.694591999053955 (2.694591999053955) | > loss_disc_real_0: 0.1429562270641327 (0.1429562270641327) | > loss_disc_real_1: 0.2952737808227539 (0.2952737808227539) | > loss_disc_real_2: 0.19004526734352112 (0.19004526734352112) | > loss_disc_real_3: 0.32121074199676514 (0.32121074199676514) | > loss_disc_real_4: 0.24870043992996216 (0.24870043992996216) | > loss_disc_real_5: 0.2572530210018158 (0.2572530210018158) | > loss_0: 2.694591999053955 (2.694591999053955) | > loss_gen: 1.929929256439209 (1.929929256439209) | > loss_kl: 2.3445775508880615 (2.3445775508880615) | > loss_feat: 3.0075180530548096 (3.0075180530548096) | > loss_mel: 23.64497947692871 (23.64497947692871) | > loss_duration: 2.0027968883514404 (2.0027968883514404) | > loss_1: 32.92980194091797 (32.92980194091797)  --> STEP: 2 | > loss_disc: 1.9878346920013428 (2.341213345527649) | > loss_disc_real_0: 0.35363128781318665 (0.24829375743865967) | > loss_disc_real_1: 0.23325170576572418 (0.26426274329423904) | > loss_disc_real_2: 0.21389232575893402 (0.20196879655122757) | > loss_disc_real_3: 0.13005414605140686 (0.225632444024086) | > loss_disc_real_4: 0.1461409628391266 (0.19742070138454437) | > loss_disc_real_5: 0.10799062252044678 (0.1826218217611313) | > loss_0: 1.9878346920013428 (2.341213345527649) | > loss_gen: 2.746490001678467 (2.338209629058838) | > loss_kl: 2.1169607639312744 (2.230769157409668) | > loss_feat: 8.786351203918457 (5.896934628486633) | > loss_mel: 29.66053009033203 (26.65275478363037) | > loss_duration: 1.981598138809204 (1.9921975135803223) | > loss_1: 45.29193115234375 (39.11086654663086)  --> STEP: 3 | > loss_disc: 2.627406120300293 (2.4366109371185303) | > loss_disc_real_0: 0.17263761162757874 (0.22307504216829935) | > loss_disc_real_1: 0.3192732036113739 (0.2825995633999507) | > loss_disc_real_2: 0.4286583960056305 (0.2775319963693619) | > loss_disc_real_3: 0.2496398240327835 (0.23363490402698517) | > loss_disc_real_4: 0.2869049608707428 (0.22724878787994385) | > loss_disc_real_5: 0.3502987027168274 (0.23851411541303) | > loss_0: 2.627406120300293 (2.4366109371185303) | > loss_gen: 2.546621561050415 (2.4076802730560303) | > loss_kl: 0.9083711504936218 (1.7899698217709858) | > loss_feat: 2.695570230484009 (4.829813162485759) | > loss_mel: 21.832916259765625 (25.04614194234212) | > loss_duration: 2.0764167308807373 (2.020270586013794) | > loss_1: 30.059894561767578 (36.093875885009766) --> EVAL PERFORMANCE | > avg_loader_time: 0.005414168039957683 (-0.0012098948160807286) | > avg_loss_disc: 2.4366109371185303 (-0.5532241662343345) | > avg_loss_disc_real_0: 0.22307504216829935 (-0.15634955962498984) | > avg_loss_disc_real_1: 0.2825995633999507 (-0.005586499969164493) | > avg_loss_disc_real_2: 0.2775319963693619 (-0.06286465624968213) | > avg_loss_disc_real_3: 0.23363490402698517 (-0.21479203800360364) | > avg_loss_disc_real_4: 0.22724878787994385 (-0.124106561144193) | > avg_loss_disc_real_5: 0.23851411541303 (-0.028007229169209807) | > avg_loss_0: 2.4366109371185303 (-0.5532241662343345) | > avg_loss_gen: 2.4076802730560303 (-0.5144805113474527) | > avg_loss_kl: 1.7899698217709858 (+0.3731074730555215) | > avg_loss_feat: 4.829813162485759 (+0.8834997713565831) | > avg_loss_mel: 25.04614194234212 (+3.9454528490702288) | > avg_loss_duration: 2.020270586013794 (-0.017136096954345703) | > avg_loss_1: 36.093875885009766 (+4.670444170633953)  > EPOCH: 19/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:53:22)   --> TIME: 2023-10-19 23:53:36 -- STEP: 19/50 -- GLOBAL_STEP: 53970 | > loss_disc: 3.0641326904296875 (2.6089155799464177) | > loss_disc_real_0: 0.21955862641334534 (0.1615130415088252) | > loss_disc_real_1: 0.3224300742149353 (0.23906106737099195) | > loss_disc_real_2: 0.39201819896698 (0.2397366726869031) | > loss_disc_real_3: 0.20296020805835724 (0.32336133169500453) | > loss_disc_real_4: 0.4508861303329468 (0.2129670387428058) | > loss_disc_real_5: 0.2853419780731201 (0.22870433408963056) | > loss_0: 3.0641326904296875 (2.6089155799464177) | > grad_norm_0: tensor(856.4799, device='cuda:0') (tensor(843.7082, device='cuda:0')) | > loss_gen: 1.9698244333267212 (2.2772121805893746) | > loss_kl: 1.8481078147888184 (1.649451029928107) | > loss_feat: 0.5490842461585999 (4.9218011561192965) | > loss_mel: 18.131786346435547 (25.260531927409925) | > loss_duration: 2.1393818855285645 (2.020860276724163) | > loss_1: 24.63818359375 (36.12985641077945) | > grad_norm_1: tensor(18760.0664, device='cuda:0') (tensor(29748.3594, device='cuda:0')) | > current_lr_0: 0.00019623563939917877 | > current_lr_1: 0.00019623563939917877 | > step_time: 0.5619 (0.5084922313690186) | > loader_time: 0.0243 (0.01481091348748458)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.724822998046875 (2.724822998046875) | > loss_disc_real_0: 0.05590697377920151 (0.05590697377920151) | > loss_disc_real_1: 0.16662557423114777 (0.16662557423114777) | > loss_disc_real_2: 0.3928729295730591 (0.3928729295730591) | > loss_disc_real_3: 0.21549077332019806 (0.21549077332019806) | > loss_disc_real_4: 0.3001907765865326 (0.3001907765865326) | > loss_disc_real_5: 0.41641297936439514 (0.41641297936439514) | > loss_0: 2.724822998046875 (2.724822998046875) | > loss_gen: 2.309985399246216 (2.309985399246216) | > loss_kl: 1.7481200695037842 (1.7481200695037842) | > loss_feat: 6.705606460571289 (6.705606460571289) | > loss_mel: 25.052579879760742 (25.052579879760742) | > loss_duration: 1.9633100032806396 (1.9633100032806396) | > loss_1: 37.77960205078125 (37.77960205078125)  --> STEP: 1 | > loss_disc: 2.5631024837493896 (2.5631024837493896) | > loss_disc_real_0: 0.11977250874042511 (0.11977250874042511) | > loss_disc_real_1: 0.19723542034626007 (0.19723542034626007) | > loss_disc_real_2: 0.28858697414398193 (0.28858697414398193) | > loss_disc_real_3: 0.25236666202545166 (0.25236666202545166) | > loss_disc_real_4: 0.20161965489387512 (0.20161965489387512) | > loss_disc_real_5: 0.21319329738616943 (0.21319329738616943) | > loss_0: 2.5631024837493896 (2.5631024837493896) | > loss_gen: 1.8469642400741577 (1.8469642400741577) | > loss_kl: 1.9302167892456055 (1.9302167892456055) | > loss_feat: 3.768584728240967 (3.768584728240967) | > loss_mel: 21.913679122924805 (21.913679122924805) | > loss_duration: 2.038308620452881 (2.038308620452881) | > loss_1: 31.497753143310547 (31.497753143310547)  --> STEP: 2 | > loss_disc: 2.5292859077453613 (2.5461941957473755) | > loss_disc_real_0: 0.07314036041498184 (0.09645643457770348) | > loss_disc_real_1: 0.22467905282974243 (0.21095723658800125) | > loss_disc_real_2: 0.22870483994483948 (0.2586459070444107) | > loss_disc_real_3: 0.3091113865375519 (0.28073902428150177) | > loss_disc_real_4: 0.10848210752010345 (0.1550508812069893) | > loss_disc_real_5: 0.24437189102172852 (0.22878259420394897) | > loss_0: 2.5292859077453613 (2.5461941957473755) | > loss_gen: 1.759535312652588 (1.8032497763633728) | > loss_kl: 1.7562693357467651 (1.8432430624961853) | > loss_feat: 3.023378372192383 (3.395981550216675) | > loss_mel: 27.95772933959961 (24.935704231262207) | > loss_duration: 2.0178961753845215 (2.028102397918701) | > loss_1: 36.514808654785156 (34.00628089904785)  --> STEP: 3 | > loss_disc: 1.411420464515686 (2.1679362853368125) | > loss_disc_real_0: 0.021205918863415718 (0.07137292933960755) | > loss_disc_real_1: 0.08103068172931671 (0.16764838496843973) | > loss_disc_real_2: 0.03298533335328102 (0.18342571581403413) | > loss_disc_real_3: 0.07074524462223053 (0.21074109772841135) | > loss_disc_real_4: 0.1174025684595108 (0.14250144362449646) | > loss_disc_real_5: 0.09710673242807388 (0.1848906402786573) | > loss_0: 1.411420464515686 (2.1679362853368125) | > loss_gen: 2.819373846054077 (2.1419577995936074) | > loss_kl: 1.23300039768219 (1.6398288408915203) | > loss_feat: 10.020211219787598 (5.6040581067403155) | > loss_mel: 28.39361572265625 (26.088341395060223) | > loss_duration: 2.0831820964813232 (2.046462297439575) | > loss_1: 44.54938507080078 (37.52064895629883)  --> TIME: 2023-10-19 23:53:57 -- STEP: 49/50 -- GLOBAL_STEP: 54000 | > loss_disc: 3.0310354232788086 (2.6689724970837028) | > loss_disc_real_0: 0.10761718451976776 (0.17464765872122073) | > loss_disc_real_1: 0.21970900893211365 (0.2344084281702431) | > loss_disc_real_2: 0.2731042802333832 (0.24515188044431258) | > loss_disc_real_3: 0.2633572518825531 (0.28262999380121423) | > loss_disc_real_4: 0.1404489278793335 (0.24611121666978814) | > loss_disc_real_5: 0.3232978284358978 (0.25480134785175323) | > loss_0: 3.0310354232788086 (2.6689724970837028) | > grad_norm_0: tensor(2420.1616, device='cuda:0') (tensor(1350.8052, device='cuda:0')) | > loss_gen: 1.664014220237732 (2.249224088629898) | > loss_kl: 1.519361972808838 (1.5144766374510161) | > loss_feat: 0.7787178754806519 (4.413798483050599) | > loss_mel: 30.233524322509766 (24.828662424671407) | > loss_duration: 2.0092177391052246 (1.9639804046981195) | > loss_1: 36.204833984375 (34.97014199470988) | > grad_norm_1: tensor(71158.4219, device='cuda:0') (tensor(31379.4961, device='cuda:0')) | > current_lr_0: 0.00019623563939917877 | > current_lr_1: 0.00019623563939917877 | > step_time: 1.4584 (0.5445158140999933) | > loader_time: 3.4519 (0.08742821946436045) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_54000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.759101390838623 (2.315727561712265) | > loss_disc_real_0: 0.1536749303340912 (0.09194842958822846) | > loss_disc_real_1: 0.2239285111427307 (0.18171841651201248) | > loss_disc_real_2: 0.2340523600578308 (0.1960823768749833) | > loss_disc_real_3: 0.23049019277095795 (0.215678371489048) | > loss_disc_real_4: 0.13690483570098877 (0.14110229164361954) | > loss_disc_real_5: 0.2596670389175415 (0.20358473993837833) | > loss_0: 2.759101390838623 (2.315727561712265) | > loss_gen: 1.5266742706298828 (1.9881369173526764) | > loss_kl: 1.6180310249328613 (1.6343793869018555) | > loss_feat: 1.5848596096038818 (4.599258482456207) | > loss_mel: 13.256457328796387 (22.880370378494263) | > loss_duration: 1.9791054725646973 (2.0296230912208557) | > loss_1: 19.96512794494629 (33.13176870346069)  --> STEP: 1 | > loss_disc: 2.815208673477173 (2.4156237840652466) | > loss_disc_real_0: 0.14635735750198364 (0.1028302151709795) | > loss_disc_real_1: 0.18514439463615417 (0.1824036121368408) | > loss_disc_real_2: 0.2434854954481125 (0.20556300058960914) | > loss_disc_real_3: 0.20789270102977753 (0.2141212373971939) | > loss_disc_real_4: 0.16421599686145782 (0.1457250326871872) | > loss_disc_real_5: 0.29481643438339233 (0.22183107882738112) | > loss_0: 2.815208673477173 (2.4156237840652466) | > loss_gen: 1.5064994096755981 (1.8918094158172607) | > loss_kl: 1.8969299793243408 (1.6868895053863526) | > loss_feat: 1.9837441444396973 (4.0761556148529055) | > loss_mel: 17.786195755004883 (21.861535453796385) | > loss_duration: 2.0431485176086426 (2.032328176498413) | > loss_1: 25.21651840209961 (31.548718643188476)  --> STEP: 2 | > loss_disc: 2.5733835697174072 (2.44191708167394) | > loss_disc_real_0: 0.05943989008665085 (0.0955984943235914) | > loss_disc_real_1: 0.15828685462474823 (0.17838415255149206) | > loss_disc_real_2: 0.11237769573926926 (0.19003211644788584) | > loss_disc_real_3: 0.16739043593406677 (0.20633277048667273) | > loss_disc_real_4: 0.16022814810276031 (0.14814221858978271) | > loss_disc_real_5: 0.13805298507213593 (0.20786806320150694) | > loss_0: 2.5733835697174072 (2.44191708167394) | > loss_gen: 1.5464184284210205 (1.8342442512512207) | > loss_kl: 2.0825488567352295 (1.7528327306111653) | > loss_feat: 8.955501556396484 (4.8893799384435015) | > loss_mel: 29.678436279296875 (23.164352258046467) | > loss_duration: 2.059293508529663 (2.0368223985036216) | > loss_1: 44.32219696044922 (33.67763169606527)  --> STEP: 3 | > loss_disc: 3.0171737670898438 (2.5240966081619263) | > loss_disc_real_0: 0.17688219249248505 (0.10721045120486192) | > loss_disc_real_1: 0.3709550201892853 (0.20589427649974823) | > loss_disc_real_2: 0.5852718353271484 (0.24649493343063764) | > loss_disc_real_3: 0.32932132482528687 (0.2239025639636176) | > loss_disc_real_4: 0.36388081312179565 (0.1789620178086417) | > loss_disc_real_5: 0.3122943341732025 (0.22278610191174916) | > loss_0: 3.0171737670898438 (2.5240966081619263) | > loss_gen: 2.6351451873779297 (1.9486586706978934) | > loss_kl: 1.2764147520065308 (1.684773019381932) | > loss_feat: 3.7285289764404297 (4.7235440867287775) | > loss_mel: 24.420555114746094 (23.343809809003556) | > loss_duration: 2.1158628463745117 (2.0481138910566057) | > loss_1: 34.176509857177734 (33.74890000479562) --> EVAL PERFORMANCE | > avg_loader_time: 0.15436318942478724 (+0.14894902138482957) | > avg_loss_disc: 2.5240966081619263 (+0.087485671043396) | > avg_loss_disc_real_0: 0.10721045120486192 (-0.11586459096343743) | > avg_loss_disc_real_1: 0.20589427649974823 (-0.07670528690020245) | > avg_loss_disc_real_2: 0.24649493343063764 (-0.03103706293872424) | > avg_loss_disc_real_3: 0.2239025639636176 (-0.009732340063367567) | > avg_loss_disc_real_4: 0.1789620178086417 (-0.04828677007130214) | > avg_loss_disc_real_5: 0.22278610191174916 (-0.015728013501280835) | > avg_loss_0: 2.5240966081619263 (+0.087485671043396) | > avg_loss_gen: 1.9486586706978934 (-0.4590216023581368) | > avg_loss_kl: 1.684773019381932 (-0.10519680238905393) | > avg_loss_feat: 4.7235440867287775 (-0.1062690757569813) | > avg_loss_mel: 23.343809809003556 (-1.7023321333385653) | > avg_loss_duration: 2.0481138910566057 (+0.02784330504281174) | > avg_loss_1: 33.74890000479562 (-2.344975880214143)  > EPOCH: 20/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:54:05)   --> TIME: 2023-10-19 23:54:19 -- STEP: 29/50 -- GLOBAL_STEP: 54030 | > loss_disc: 2.380445718765259 (2.7698945300332443) | > loss_disc_real_0: 0.1754218190908432 (0.18412807114936156) | > loss_disc_real_1: 0.16516898572444916 (0.23036483713778957) | > loss_disc_real_2: 0.47544148564338684 (0.25848989548354306) | > loss_disc_real_3: 0.2562251091003418 (0.2578157145401527) | > loss_disc_real_4: 0.3351096510887146 (0.23981078155338764) | > loss_disc_real_5: 0.3251091539859772 (0.24972305607436032) | > loss_0: 2.380445718765259 (2.7698945300332443) | > grad_norm_0: tensor(909.4659, device='cuda:0') (tensor(1178.2750, device='cuda:0')) | > loss_gen: 3.3984179496765137 (2.1680578363352807) | > loss_kl: 1.3407964706420898 (1.4203531793479263) | > loss_feat: 5.625312805175781 (4.735589212384717) | > loss_mel: 28.046953201293945 (24.92590828599601) | > loss_duration: 1.9935083389282227 (1.9872307284124966) | > loss_1: 40.40498733520508 (35.23713937299004) | > grad_norm_1: tensor(36066.3633, device='cuda:0') (tensor(33402.4297, device='cuda:0')) | > current_lr_0: 0.00019603948959141186 | > current_lr_1: 0.00019603948959141186 | > step_time: 0.6894 (0.36961268556529087) | > loader_time: 0.0431 (0.009522150302755423)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8935110569000244 (1.8935110569000244) | > loss_disc_real_0: 0.012978889979422092 (0.012978889979422092) | > loss_disc_real_1: 0.09552463889122009 (0.09552463889122009) | > loss_disc_real_2: 0.10639070719480515 (0.10639070719480515) | > loss_disc_real_3: 0.10407043248414993 (0.10407043248414993) | > loss_disc_real_4: 0.08731923997402191 (0.08731923997402191) | > loss_disc_real_5: 0.0723312720656395 (0.0723312720656395) | > loss_0: 1.8935110569000244 (1.8935110569000244) | > loss_gen: 1.8815734386444092 (1.8815734386444092) | > loss_kl: 1.5645540952682495 (1.5645540952682495) | > loss_feat: 11.396369934082031 (11.396369934082031) | > loss_mel: 29.38444709777832 (29.38444709777832) | > loss_duration: 1.9337964057922363 (1.9337964057922363) | > loss_1: 46.16073989868164 (46.16073989868164)  --> STEP: 1 | > loss_disc: 2.4876372814178467 (2.4876372814178467) | > loss_disc_real_0: 0.04184884950518608 (0.04184884950518608) | > loss_disc_real_1: 0.05363469198346138 (0.05363469198346138) | > loss_disc_real_2: 0.035660989582538605 (0.035660989582538605) | > loss_disc_real_3: 0.1510162204504013 (0.1510162204504013) | > loss_disc_real_4: 0.14465223252773285 (0.14465223252773285) | > loss_disc_real_5: 0.03928346931934357 (0.03928346931934357) | > loss_0: 2.4876372814178467 (2.4876372814178467) | > loss_gen: 1.391371488571167 (1.391371488571167) | > loss_kl: 1.6380751132965088 (1.6380751132965088) | > loss_feat: 10.746845245361328 (10.746845245361328) | > loss_mel: 34.84273910522461 (34.84273910522461) | > loss_duration: 2.0704798698425293 (2.0704798698425293) | > loss_1: 50.68951416015625 (50.68951416015625)  --> STEP: 2 | > loss_disc: 2.2712182998657227 (2.3794277906417847) | > loss_disc_real_0: 0.02561948634684086 (0.03373416792601347) | > loss_disc_real_1: 0.0956926941871643 (0.07466369308531284) | > loss_disc_real_2: 0.0655122846364975 (0.05058663710951805) | > loss_disc_real_3: 0.20070718228816986 (0.17586170136928558) | > loss_disc_real_4: 0.10055924206972122 (0.12260573729872704) | > loss_disc_real_5: 0.12509678304195404 (0.0821901261806488) | > loss_0: 2.2712182998657227 (2.3794277906417847) | > loss_gen: 1.5692617893218994 (1.4803166389465332) | > loss_kl: 2.4045844078063965 (2.0213297605514526) | > loss_feat: 8.867733001708984 (9.807289123535156) | > loss_mel: 40.1230583190918 (37.4828987121582) | > loss_duration: 1.9688304662704468 (2.019655168056488) | > loss_1: 54.9334716796875 (52.811492919921875)  --> STEP: 3 | > loss_disc: 2.421128988265991 (2.3933281898498535) | > loss_disc_real_0: 0.16279523074626923 (0.07675452219943206) | > loss_disc_real_1: 0.1504860520362854 (0.09993781273563702) | > loss_disc_real_2: 0.20863032341003418 (0.10326786587635677) | > loss_disc_real_3: 0.23846016824245453 (0.19672785699367523) | > loss_disc_real_4: 0.18324494361877441 (0.14281880607207617) | > loss_disc_real_5: 0.19357801973819733 (0.11931942403316498) | > loss_0: 2.421128988265991 (2.3933281898498535) | > loss_gen: 1.9935147762298584 (1.6513826847076416) | > loss_kl: 1.0565659999847412 (1.6997418403625488) | > loss_feat: 5.416415214538574 (8.343664487202963) | > loss_mel: 24.75992202758789 (33.2419064839681) | > loss_duration: 2.115198850631714 (2.05150306224823) | > loss_1: 35.341617584228516 (46.98820114135742) --> EVAL PERFORMANCE | > avg_loader_time: 0.010773738225301107 (-0.14358945119948613) | > avg_loss_disc: 2.3933281898498535 (-0.13076841831207275) | > avg_loss_disc_real_0: 0.07675452219943206 (-0.030455929005429858) | > avg_loss_disc_real_1: 0.09993781273563702 (-0.1059564637641112) | > avg_loss_disc_real_2: 0.10326786587635677 (-0.14322706755428088) | > avg_loss_disc_real_3: 0.19672785699367523 (-0.02717470696994237) | > avg_loss_disc_real_4: 0.14281880607207617 (-0.03614321173656554) | > avg_loss_disc_real_5: 0.11931942403316498 (-0.10346667787858418) | > avg_loss_0: 2.3933281898498535 (-0.13076841831207275) | > avg_loss_gen: 1.6513826847076416 (-0.29727598599025185) | > avg_loss_kl: 1.6997418403625488 (+0.014968820980616915) | > avg_loss_feat: 8.343664487202963 (+3.6201204004741854) | > avg_loss_mel: 33.2419064839681 (+9.898096674964545) | > avg_loss_duration: 2.05150306224823 (+0.003389171191624296) | > avg_loss_1: 46.98820114135742 (+13.2393011365618)  > EPOCH: 21/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:54:40)   --> TIME: 2023-10-19 23:54:49 -- STEP: 9/50 -- GLOBAL_STEP: 54060 | > loss_disc: 2.4516146183013916 (2.8068500094943576) | > loss_disc_real_0: 0.31716158986091614 (0.31809559133317733) | > loss_disc_real_1: 0.16439777612686157 (0.22220612317323685) | > loss_disc_real_2: 0.4576060175895691 (0.2750408264497916) | > loss_disc_real_3: 0.24285314977169037 (0.26372434281640583) | > loss_disc_real_4: 0.37906956672668457 (0.2603318894075023) | > loss_disc_real_5: 0.2017071396112442 (0.2120206363292204) | > loss_0: 2.4516146183013916 (2.8068500094943576) | > grad_norm_0: tensor(1146.7040, device='cuda:0') (tensor(1464.5709, device='cuda:0')) | > loss_gen: 2.7391440868377686 (2.2980119254853992) | > loss_kl: 1.4218292236328125 (1.4702617592281766) | > loss_feat: 4.79420280456543 (5.38885545068317) | > loss_mel: 33.9640007019043 (28.113464143541123) | > loss_duration: 1.841434359550476 (1.928879181543986) | > loss_1: 44.7606086730957 (39.19947263929579) | > grad_norm_1: tensor(35039.0977, device='cuda:0') (tensor(52131.6602, device='cuda:0')) | > current_lr_0: 0.00019584353584765863 | > current_lr_1: 0.00019584353584765863 | > step_time: 0.5627 (0.5698782073126899) | > loader_time: 0.0134 (0.015513102213541666)  --> TIME: 2023-10-19 23:55:04 -- STEP: 39/50 -- GLOBAL_STEP: 54090 | > loss_disc: 2.4331002235412598 (2.6725065860992827) | > loss_disc_real_0: 0.2657117247581482 (0.241454955859062) | > loss_disc_real_1: 0.4005714952945709 (0.23501077867471254) | > loss_disc_real_2: 0.24204736948013306 (0.24906742486816186) | > loss_disc_real_3: 0.21972276270389557 (0.24720176204274866) | > loss_disc_real_4: 0.16407889127731323 (0.23448076992271802) | > loss_disc_real_5: 0.3014531135559082 (0.22883685293774575) | > loss_0: 2.4331002235412598 (2.6725065860992827) | > grad_norm_0: tensor(603.1407, device='cuda:0') (tensor(676.4583, device='cuda:0')) | > loss_gen: 2.7331786155700684 (2.1901432673136387) | > loss_kl: 1.1197140216827393 (1.3912055049187098) | > loss_feat: 4.073876857757568 (4.545671923086047) | > loss_mel: 24.872295379638672 (25.62699343607976) | > loss_duration: 1.97232186794281 (1.9585063365789561) | > loss_1: 34.771385192871094 (35.712520428192924) | > grad_norm_1: tensor(8387.9053, device='cuda:0') (tensor(25627.2871, device='cuda:0')) | > current_lr_0: 0.00019584353584765863 | > current_lr_1: 0.00019584353584765863 | > step_time: 0.5736 (0.5094407460628412) | > loader_time: 0.0044 (0.019022104067680165)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.784703254699707 (2.784703254699707) | > loss_disc_real_0: 0.10147380083799362 (0.10147380083799362) | > loss_disc_real_1: 0.20576085150241852 (0.20576085150241852) | > loss_disc_real_2: 0.1957542449235916 (0.1957542449235916) | > loss_disc_real_3: 0.3088471293449402 (0.3088471293449402) | > loss_disc_real_4: 0.3305177092552185 (0.3305177092552185) | > loss_disc_real_5: 0.35731175541877747 (0.35731175541877747) | > loss_0: 2.784703254699707 (2.784703254699707) | > loss_gen: 4.175627708435059 (4.175627708435059) | > loss_kl: 2.1455531120300293 (2.1455531120300293) | > loss_feat: 8.960591316223145 (8.960591316223145) | > loss_mel: 24.086896896362305 (24.086896896362305) | > loss_duration: 1.9175926446914673 (1.9175926446914673) | > loss_1: 41.286258697509766 (41.286258697509766)  --> STEP: 1 | > loss_disc: 2.318572759628296 (2.318572759628296) | > loss_disc_real_0: 0.08424168080091476 (0.08424168080091476) | > loss_disc_real_1: 0.2342638522386551 (0.2342638522386551) | > loss_disc_real_2: 0.12173790484666824 (0.12173790484666824) | > loss_disc_real_3: 0.20791955292224884 (0.20791955292224884) | > loss_disc_real_4: 0.1713051199913025 (0.1713051199913025) | > loss_disc_real_5: 0.030474483966827393 (0.030474483966827393) | > loss_0: 2.318572759628296 (2.318572759628296) | > loss_gen: 5.455811977386475 (5.455811977386475) | > loss_kl: 1.9789841175079346 (1.9789841175079346) | > loss_feat: 13.784148216247559 (13.784148216247559) | > loss_mel: 29.0986385345459 (29.0986385345459) | > loss_duration: 2.0541582107543945 (2.0541582107543945) | > loss_1: 52.37173843383789 (52.37173843383789)  --> STEP: 2 | > loss_disc: 2.4934964179992676 (2.4060345888137817) | > loss_disc_real_0: 0.17647582292556763 (0.1303587518632412) | > loss_disc_real_1: 0.2460666000843048 (0.24016522616147995) | > loss_disc_real_2: 0.216095432639122 (0.16891666874289513) | > loss_disc_real_3: 0.2682238221168518 (0.23807168751955032) | > loss_disc_real_4: 0.25293609499931335 (0.21212060749530792) | > loss_disc_real_5: 0.3502194583415985 (0.19034697115421295) | > loss_0: 2.4934964179992676 (2.4060345888137817) | > loss_gen: 2.6131129264831543 (4.0344624519348145) | > loss_kl: 1.9918936491012573 (1.985438883304596) | > loss_feat: 8.330147743225098 (11.057147979736328) | > loss_mel: 25.807613372802734 (27.453125953674316) | > loss_duration: 1.996777892112732 (2.0254680514335632) | > loss_1: 40.73954391479492 (46.555641174316406)  --> STEP: 3 | > loss_disc: 2.7056314945220947 (2.505900224049886) | > loss_disc_real_0: 0.14916010200977325 (0.1366258685787519) | > loss_disc_real_1: 0.3420359492301941 (0.27412213385105133) | > loss_disc_real_2: 0.31825146079063416 (0.21869493275880814) | > loss_disc_real_3: 0.3957522213459015 (0.29063186546166736) | > loss_disc_real_4: 0.3066035211086273 (0.24361491203308105) | > loss_disc_real_5: 0.5467420220375061 (0.309145321448644) | > loss_0: 2.7056314945220947 (2.505900224049886) | > loss_gen: 3.381657361984253 (3.8168607552846274) | > loss_kl: 0.9013032913208008 (1.6240603526433308) | > loss_feat: 5.0132856369018555 (9.042527198791504) | > loss_mel: 22.78635025024414 (25.897534052530926) | > loss_duration: 2.0664098262786865 (2.039115309715271) | > loss_1: 34.14900588989258 (42.42009607950846) --> EVAL PERFORMANCE | > avg_loader_time: 0.011164585749308268 (+0.0003908475240071603) | > avg_loss_disc: 2.505900224049886 (+0.1125720342000327) | > avg_loss_disc_real_0: 0.1366258685787519 (+0.05987134637931983) | > avg_loss_disc_real_1: 0.27412213385105133 (+0.17418432111541432) | > avg_loss_disc_real_2: 0.21869493275880814 (+0.11542706688245137) | > avg_loss_disc_real_3: 0.29063186546166736 (+0.09390400846799213) | > avg_loss_disc_real_4: 0.24361491203308105 (+0.10079610596100488) | > avg_loss_disc_real_5: 0.309145321448644 (+0.189825897415479) | > avg_loss_0: 2.505900224049886 (+0.1125720342000327) | > avg_loss_gen: 3.8168607552846274 (+2.165478070576986) | > avg_loss_kl: 1.6240603526433308 (-0.07568148771921801) | > avg_loss_feat: 9.042527198791504 (+0.6988627115885411) | > avg_loss_mel: 25.897534052530926 (-7.344372431437176) | > avg_loss_duration: 2.039115309715271 (-0.012387752532958984) | > avg_loss_1: 42.42009607950846 (-4.568105061848961)  > EPOCH: 22/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:55:18)   --> TIME: 2023-10-19 23:55:32 -- STEP: 19/50 -- GLOBAL_STEP: 54120 | > loss_disc: 2.7407264709472656 (2.552319438833939) | > loss_disc_real_0: 0.15754079818725586 (0.1920803210845119) | > loss_disc_real_1: 0.2553441822528839 (0.26721490488240596) | > loss_disc_real_2: 0.2611886262893677 (0.25902748068696574) | > loss_disc_real_3: 0.33543309569358826 (0.24752291919369446) | > loss_disc_real_4: 0.3017781376838684 (0.23733621463179583) | > loss_disc_real_5: 0.31376513838768005 (0.2373059769406131) | > loss_0: 2.7407264709472656 (2.552319438833939) | > grad_norm_0: tensor(285.7634, device='cuda:0') (tensor(457.4954, device='cuda:0')) | > loss_gen: 2.0297086238861084 (2.7425319144600318) | > loss_kl: 1.3630867004394531 (1.4134104157748975) | > loss_feat: 1.1510398387908936 (5.994657934104142) | > loss_mel: 21.42694854736328 (26.014349134344805) | > loss_duration: 2.125384569168091 (2.0096871350940906) | > loss_1: 28.096168518066406 (38.174637141980625) | > grad_norm_1: tensor(6596.4878, device='cuda:0') (tensor(23526.3828, device='cuda:0')) | > current_lr_0: 0.00019564777797194082 | > current_lr_1: 0.00019564777797194082 | > step_time: 0.348 (0.5507768957238448) | > loader_time: 0.0157 (0.01610181206151059)  --> TIME: 2023-10-19 23:55:48 -- STEP: 49/50 -- GLOBAL_STEP: 54150 | > loss_disc: 1.8556634187698364 (2.6511137850430546) | > loss_disc_real_0: 0.09213215112686157 (0.19021554333062807) | > loss_disc_real_1: 0.2594100534915924 (0.2533331460186415) | > loss_disc_real_2: 0.2424120157957077 (0.2402928474606301) | > loss_disc_real_3: 0.1585213840007782 (0.2344687418365965) | > loss_disc_real_4: 0.17740072309970856 (0.23413998800881056) | > loss_disc_real_5: 0.23399610817432404 (0.23735129821817486) | > loss_0: 1.8556634187698364 (2.6511137850430546) | > grad_norm_0: tensor(193.5239, device='cuda:0') (tensor(386.7195, device='cuda:0')) | > loss_gen: 3.0217337608337402 (2.333031622730956) | > loss_kl: 0.9297405481338501 (1.4890059974728798) | > loss_feat: 6.880379676818848 (4.944062265662515) | > loss_mel: 27.22818374633789 (24.973012967985504) | > loss_duration: 2.087409496307373 (1.9579158388838476) | > loss_1: 40.14744567871094 (35.697028627201014) | > grad_norm_1: tensor(16656.6211, device='cuda:0') (tensor(17885.6191, device='cuda:0')) | > current_lr_0: 0.00019564777797194082 | > current_lr_1: 0.00019564777797194082 | > step_time: 0.5992 (0.5333964046166868) | > loader_time: 0.1869 (0.02037648765408263)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.448364019393921 (3.448364019393921) | > loss_disc_real_0: 0.4652385413646698 (0.4652385413646698) | > loss_disc_real_1: 0.23985376954078674 (0.23985376954078674) | > loss_disc_real_2: 0.3518204987049103 (0.3518204987049103) | > loss_disc_real_3: 0.2571850121021271 (0.2571850121021271) | > loss_disc_real_4: 0.2623768448829651 (0.2623768448829651) | > loss_disc_real_5: 0.23985449969768524 (0.23985449969768524) | > loss_0: 3.448364019393921 (3.448364019393921) | > loss_gen: 1.643362283706665 (1.643362283706665) | > loss_kl: 1.560472846031189 (1.560472846031189) | > loss_feat: 6.461621284484863 (6.461621284484863) | > loss_mel: 25.419008255004883 (25.419008255004883) | > loss_duration: 1.934183955192566 (1.934183955192566) | > loss_1: 37.01865005493164 (37.01865005493164)  --> STEP: 1 | > loss_disc: 2.282306432723999 (2.282306432723999) | > loss_disc_real_0: 0.16974779963493347 (0.16974779963493347) | > loss_disc_real_1: 0.20156630873680115 (0.20156630873680115) | > loss_disc_real_2: 0.20381365716457367 (0.20381365716457367) | > loss_disc_real_3: 0.09577014297246933 (0.09577014297246933) | > loss_disc_real_4: 0.15646083652973175 (0.15646083652973175) | > loss_disc_real_5: 0.08422676473855972 (0.08422676473855972) | > loss_0: 2.282306432723999 (2.282306432723999) | > loss_gen: 1.8888647556304932 (1.8888647556304932) | > loss_kl: 1.901289939880371 (1.901289939880371) | > loss_feat: 6.210817337036133 (6.210817337036133) | > loss_mel: 26.35767936706543 (26.35767936706543) | > loss_duration: 2.0574231147766113 (2.0574231147766113) | > loss_1: 38.41607666015625 (38.41607666015625)  --> STEP: 2 | > loss_disc: 2.840282917022705 (2.561294674873352) | > loss_disc_real_0: 0.2337995022535324 (0.20177365094423294) | > loss_disc_real_1: 0.12698505818843842 (0.16427568346261978) | > loss_disc_real_2: 0.21233320236206055 (0.2080734297633171) | > loss_disc_real_3: 0.3746521770954132 (0.23521116003394127) | > loss_disc_real_4: 0.0814516469836235 (0.11895624175667763) | > loss_disc_real_5: 0.24806222319602966 (0.1661444939672947) | > loss_0: 2.840282917022705 (2.561294674873352) | > loss_gen: 1.7559914588928223 (1.8224281072616577) | > loss_kl: 2.204345226287842 (2.0528175830841064) | > loss_feat: 8.114803314208984 (7.162810325622559) | > loss_mel: 25.00438690185547 (25.68103313446045) | > loss_duration: 1.9684756994247437 (2.0129494071006775) | > loss_1: 39.048004150390625 (38.73204040527344)  --> STEP: 3 | > loss_disc: 1.769505500793457 (2.2973649501800537) | > loss_disc_real_0: 0.2000323235988617 (0.20119320849577585) | > loss_disc_real_1: 0.15545925498008728 (0.1613368739684423) | > loss_disc_real_2: 0.198759987950325 (0.20496894915898642) | > loss_disc_real_3: 0.1636914610862732 (0.21137126038471857) | > loss_disc_real_4: 0.04777618870139122 (0.0952295574049155) | > loss_disc_real_5: 0.07201515138149261 (0.134768046438694) | > loss_0: 1.769505500793457 (2.2973649501800537) | > loss_gen: 2.4997172355651855 (2.0481911500295005) | > loss_kl: 1.0687892436981201 (1.724808136622111) | > loss_feat: 6.6293463706970215 (6.984989007314046) | > loss_mel: 23.498868942260742 (24.95364507039388) | > loss_duration: 2.114640712738037 (2.0468465089797974) | > loss_1: 35.81135940551758 (37.758480072021484) --> EVAL PERFORMANCE | > avg_loader_time: 0.014921744664510092 (+0.003757158915201824) | > avg_loss_disc: 2.2973649501800537 (-0.2085352738698325) | > avg_loss_disc_real_0: 0.20119320849577585 (+0.06456733991702396) | > avg_loss_disc_real_1: 0.1613368739684423 (-0.11278525988260904) | > avg_loss_disc_real_2: 0.20496894915898642 (-0.013725983599821717) | > avg_loss_disc_real_3: 0.21137126038471857 (-0.07926060507694879) | > avg_loss_disc_real_4: 0.0952295574049155 (-0.14838535462816554) | > avg_loss_disc_real_5: 0.134768046438694 (-0.17437727500994998) | > avg_loss_0: 2.2973649501800537 (-0.2085352738698325) | > avg_loss_gen: 2.0481911500295005 (-1.768669605255127) | > avg_loss_kl: 1.724808136622111 (+0.10074778397878026) | > avg_loss_feat: 6.984989007314046 (-2.057538191477458) | > avg_loss_mel: 24.95364507039388 (-0.9438889821370466) | > avg_loss_duration: 2.0468465089797974 (+0.007731199264526367) | > avg_loss_1: 37.758480072021484 (-4.661616007486977)  > EPOCH: 23/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:55:55)   --> TIME: 2023-10-19 23:56:12 -- STEP: 29/50 -- GLOBAL_STEP: 54180 | > loss_disc: 2.85152006149292 (2.7009623543969514) | > loss_disc_real_0: 0.5707422494888306 (0.20018880072467285) | > loss_disc_real_1: 0.36758682131767273 (0.25475471595238) | > loss_disc_real_2: 0.22351369261741638 (0.2586364135916891) | > loss_disc_real_3: 0.2342168688774109 (0.2538903387713021) | > loss_disc_real_4: 0.14451706409454346 (0.2631747433594588) | > loss_disc_real_5: 0.2948683798313141 (0.24980820664044084) | > loss_0: 2.85152006149292 (2.7009623543969514) | > grad_norm_0: tensor(841.0088, device='cuda:0') (tensor(411.4583, device='cuda:0')) | > loss_gen: 2.7200770378112793 (2.315243885434907) | > loss_kl: 1.2518882751464844 (1.4550706949727288) | > loss_feat: 7.209865093231201 (5.214349676228674) | > loss_mel: 22.563255310058594 (23.73121693216521) | > loss_duration: 2.0343868732452393 (1.9830602654095353) | > loss_1: 35.77947235107422 (34.69894185559503) | > grad_norm_1: tensor(16554.0469, device='cuda:0') (tensor(20759.9102, device='cuda:0')) | > current_lr_0: 0.00019545221576847604 | > current_lr_1: 0.00019545221576847604 | > step_time: 0.4425 (0.47824691904002237) | > loader_time: 0.0079 (0.016264307087865366)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3606302738189697 (2.3606302738189697) | > loss_disc_real_0: 0.027271289378404617 (0.027271289378404617) | > loss_disc_real_1: 0.2656331956386566 (0.2656331956386566) | > loss_disc_real_2: 0.3748745024204254 (0.3748745024204254) | > loss_disc_real_3: 0.30960986018180847 (0.30960986018180847) | > loss_disc_real_4: 0.2615109384059906 (0.2615109384059906) | > loss_disc_real_5: 0.23454250395298004 (0.23454250395298004) | > loss_0: 2.3606302738189697 (2.3606302738189697) | > loss_gen: 4.079570770263672 (4.079570770263672) | > loss_kl: 1.891081690788269 (1.891081690788269) | > loss_feat: 6.186751365661621 (6.186751365661621) | > loss_mel: 33.05045700073242 (33.05045700073242) | > loss_duration: 1.890109896659851 (1.890109896659851) | > loss_1: 47.09796905517578 (47.09796905517578)  --> STEP: 1 | > loss_disc: 2.3324055671691895 (2.3324055671691895) | > loss_disc_real_0: 0.08693157136440277 (0.08693157136440277) | > loss_disc_real_1: 0.15808768570423126 (0.15808768570423126) | > loss_disc_real_2: 0.14330995082855225 (0.14330995082855225) | > loss_disc_real_3: 0.2827439606189728 (0.2827439606189728) | > loss_disc_real_4: 0.2321372777223587 (0.2321372777223587) | > loss_disc_real_5: 0.17359444499015808 (0.17359444499015808) | > loss_0: 2.3324055671691895 (2.3324055671691895) | > loss_gen: 2.1690173149108887 (2.1690173149108887) | > loss_kl: 1.9164546728134155 (1.9164546728134155) | > loss_feat: 7.16384744644165 (7.16384744644165) | > loss_mel: 25.767879486083984 (25.767879486083984) | > loss_duration: 2.021963596343994 (2.021963596343994) | > loss_1: 39.03916549682617 (39.03916549682617)  --> STEP: 2 | > loss_disc: 2.8641533851623535 (2.5982794761657715) | > loss_disc_real_0: 0.12068907171487808 (0.10381032153964043) | > loss_disc_real_1: 0.3394564688205719 (0.24877207726240158) | > loss_disc_real_2: 0.3600585162639618 (0.251684233546257) | > loss_disc_real_3: 0.4066879451274872 (0.34471595287323) | > loss_disc_real_4: 0.21499069035053253 (0.22356398403644562) | > loss_disc_real_5: 0.3576483726501465 (0.2656214088201523) | > loss_0: 2.8641533851623535 (2.5982794761657715) | > loss_gen: 2.2326464653015137 (2.200831890106201) | > loss_kl: 1.978353500366211 (1.9474040865898132) | > loss_feat: 3.107081413269043 (5.135464429855347) | > loss_mel: 31.65762710571289 (28.712753295898438) | > loss_duration: 1.9648548364639282 (1.9934092164039612) | > loss_1: 40.9405632019043 (39.989864349365234)  --> STEP: 3 | > loss_disc: 3.0092544555664062 (2.735271135965983) | > loss_disc_real_0: 0.20435209572315216 (0.13732424626747766) | > loss_disc_real_1: 0.25470098853111267 (0.2507483810186386) | > loss_disc_real_2: 0.2505110204219818 (0.25129316250483197) | > loss_disc_real_3: 0.2507639527320862 (0.3133986194928487) | > loss_disc_real_4: 0.2618902027606964 (0.23633939027786255) | > loss_disc_real_5: 0.2714998126029968 (0.26758087674776715) | > loss_0: 3.0092544555664062 (2.735271135965983) | > loss_gen: 1.4935415983200073 (1.9650684595108032) | > loss_kl: 2.686546564102173 (2.1937849124272666) | > loss_feat: 0.004044011235237122 (3.424990956981977) | > loss_mel: 2.049610137939453 (19.82503890991211) | > loss_duration: 2.2396023273468018 (2.0754735867182412) | > loss_1: 8.473344802856445 (29.484357833862305) --> EVAL PERFORMANCE | > avg_loader_time: 0.01598072052001953 (+0.0010589758555094395) | > avg_loss_disc: 2.735271135965983 (+0.4379061857859292) | > avg_loss_disc_real_0: 0.13732424626747766 (-0.06386896222829819) | > avg_loss_disc_real_1: 0.2507483810186386 (+0.08941150705019632) | > avg_loss_disc_real_2: 0.25129316250483197 (+0.04632421334584555) | > avg_loss_disc_real_3: 0.3133986194928487 (+0.10202735910813013) | > avg_loss_disc_real_4: 0.23633939027786255 (+0.14110983287294704) | > avg_loss_disc_real_5: 0.26758087674776715 (+0.13281283030907315) | > avg_loss_0: 2.735271135965983 (+0.4379061857859292) | > avg_loss_gen: 1.9650684595108032 (-0.08312269051869725) | > avg_loss_kl: 2.1937849124272666 (+0.4689767758051555) | > avg_loss_feat: 3.424990956981977 (-3.559998050332069) | > avg_loss_mel: 19.82503890991211 (-5.12860616048177) | > avg_loss_duration: 2.0754735867182412 (+0.028627077738443862) | > avg_loss_1: 29.484357833862305 (-8.27412223815918)  > EPOCH: 24/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:56:31)   --> TIME: 2023-10-19 23:56:40 -- STEP: 9/50 -- GLOBAL_STEP: 54210 | > loss_disc: 2.664304494857788 (2.517635703086853) | > loss_disc_real_0: 0.1165211945772171 (0.17410575722654661) | > loss_disc_real_1: 0.3226781189441681 (0.2670712818702062) | > loss_disc_real_2: 0.39053457975387573 (0.22704514861106873) | > loss_disc_real_3: 0.26512107253074646 (0.2548815715644095) | > loss_disc_real_4: 0.19492104649543762 (0.23826436864005196) | > loss_disc_real_5: 0.1502157747745514 (0.166504274846779) | > loss_0: 2.664304494857788 (2.517635703086853) | > grad_norm_0: tensor(415.4974, device='cuda:0') (tensor(522.9318, device='cuda:0')) | > loss_gen: 2.1547067165374756 (2.845741722318861) | > loss_kl: 1.3882936239242554 (1.5497436655892267) | > loss_feat: 7.814291954040527 (8.981588734520805) | > loss_mel: 27.596446990966797 (28.553483539157444) | > loss_duration: 1.7888988256454468 (1.927083240614997) | > loss_1: 40.742637634277344 (43.857641008165146) | > grad_norm_1: tensor(5859.8599, device='cuda:0') (tensor(22139.8301, device='cuda:0')) | > current_lr_0: 0.00019525684904167766 | > current_lr_1: 0.00019525684904167766 | > step_time: 0.6123 (0.5269596841600206) | > loader_time: 0.024 (0.019698805279201932)  --> TIME: 2023-10-19 23:56:55 -- STEP: 39/50 -- GLOBAL_STEP: 54240 | > loss_disc: 1.2705622911453247 (2.6699073284100265) | > loss_disc_real_0: 0.011708829551935196 (0.22919259019769156) | > loss_disc_real_1: 0.14636997878551483 (0.23984331714037133) | > loss_disc_real_2: 0.015980271622538567 (0.23256890872159067) | > loss_disc_real_3: 0.16319969296455383 (0.24259474166692832) | > loss_disc_real_4: 0.08297325670719147 (0.23322281518425692) | > loss_disc_real_5: 0.015079198405146599 (0.23515340853004885) | > loss_0: 1.2705622911453247 (2.6699073284100265) | > grad_norm_0: tensor(423.5231, device='cuda:0') (tensor(493.0702, device='cuda:0')) | > loss_gen: 3.1498537063598633 (2.361626872649559) | > loss_kl: 0.9349226355552673 (1.4534047062580404) | > loss_feat: 9.943170547485352 (5.542876456028375) | > loss_mel: 28.411008834838867 (25.421251125824764) | > loss_duration: 1.9294580221176147 (1.9503223345829894) | > loss_1: 44.368412017822266 (36.729481159112396) | > grad_norm_1: tensor(20879.9922, device='cuda:0') (tensor(18628.5508, device='cuda:0')) | > current_lr_0: 0.00019525684904167766 | > current_lr_1: 0.00019525684904167766 | > step_time: 0.279 (0.5075886494074113) | > loader_time: 0.0024 (0.018128236134847004)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8241777420043945 (1.8241777420043945) | > loss_disc_real_0: 0.10663917660713196 (0.10663917660713196) | > loss_disc_real_1: 0.4275289475917816 (0.4275289475917816) | > loss_disc_real_2: 0.18849323689937592 (0.18849323689937592) | > loss_disc_real_3: 0.30741584300994873 (0.30741584300994873) | > loss_disc_real_4: 0.12731432914733887 (0.12731432914733887) | > loss_disc_real_5: 0.17339660227298737 (0.17339660227298737) | > loss_0: 1.8241777420043945 (1.8241777420043945) | > loss_gen: 3.4852333068847656 (3.4852333068847656) | > loss_kl: 2.166078567504883 (2.166078567504883) | > loss_feat: 7.770367622375488 (7.770367622375488) | > loss_mel: 25.314868927001953 (25.314868927001953) | > loss_duration: 1.9299840927124023 (1.9299840927124023) | > loss_1: 40.666534423828125 (40.666534423828125)  --> STEP: 1 | > loss_disc: 1.772845983505249 (1.772845983505249) | > loss_disc_real_0: 0.12181607633829117 (0.12181607633829117) | > loss_disc_real_1: 0.31591033935546875 (0.31591033935546875) | > loss_disc_real_2: 0.2615586519241333 (0.2615586519241333) | > loss_disc_real_3: 0.16551627218723297 (0.16551627218723297) | > loss_disc_real_4: 0.10348553210496902 (0.10348553210496902) | > loss_disc_real_5: 0.14517560601234436 (0.14517560601234436) | > loss_0: 1.772845983505249 (1.772845983505249) | > loss_gen: 3.7338979244232178 (3.7338979244232178) | > loss_kl: 1.928923487663269 (1.928923487663269) | > loss_feat: 10.195979118347168 (10.195979118347168) | > loss_mel: 25.910158157348633 (25.910158157348633) | > loss_duration: 2.020859718322754 (2.020859718322754) | > loss_1: 43.789817810058594 (43.789817810058594)  --> STEP: 2 | > loss_disc: 2.151123046875 (1.9619845151901245) | > loss_disc_real_0: 0.15524333715438843 (0.1385297067463398) | > loss_disc_real_1: 0.49889305233955383 (0.4074016958475113) | > loss_disc_real_2: 0.21006910502910614 (0.23581387847661972) | > loss_disc_real_3: 0.3814610242843628 (0.2734886482357979) | > loss_disc_real_4: 0.13020093739032745 (0.11684323474764824) | > loss_disc_real_5: 0.17099112272262573 (0.15808336436748505) | > loss_0: 2.151123046875 (1.9619845151901245) | > loss_gen: 3.2802655696868896 (3.5070817470550537) | > loss_kl: 2.056561231613159 (1.9927423596382141) | > loss_feat: 7.740717887878418 (8.968348503112793) | > loss_mel: 28.400121688842773 (27.155139923095703) | > loss_duration: 1.9833521842956543 (2.002105951309204) | > loss_1: 43.461021423339844 (43.62541961669922)  --> STEP: 3 | > loss_disc: 3.0409462451934814 (2.3216384251912436) | > loss_disc_real_0: 0.3153378367424011 (0.19746575007836023) | > loss_disc_real_1: 0.330974280834198 (0.38192589084307355) | > loss_disc_real_2: 0.4888536334037781 (0.3201604634523392) | > loss_disc_real_3: 0.25126662850379944 (0.2660813083251317) | > loss_disc_real_4: 0.3651341199874878 (0.1996068631609281) | > loss_disc_real_5: 0.47702229022979736 (0.2643963396549225) | > loss_0: 3.0409462451934814 (2.3216384251912436) | > loss_gen: 2.6236767768859863 (3.2126134236653647) | > loss_kl: 2.6626241207122803 (2.2160362799962363) | > loss_feat: 2.6698482036590576 (6.868848403294881) | > loss_mel: 26.691761016845703 (27.000680287679035) | > loss_duration: 2.283674716949463 (2.0959622065226235) | > loss_1: 36.93158721923828 (41.394142150878906) --> EVAL PERFORMANCE | > avg_loader_time: 0.011433760325113932 (-0.0045469601949055995) | > avg_loss_disc: 2.3216384251912436 (-0.4136327107747393) | > avg_loss_disc_real_0: 0.19746575007836023 (+0.06014150381088257) | > avg_loss_disc_real_1: 0.38192589084307355 (+0.13117750982443493) | > avg_loss_disc_real_2: 0.3201604634523392 (+0.0688673009475072) | > avg_loss_disc_real_3: 0.2660813083251317 (-0.04731731116771698) | > avg_loss_disc_real_4: 0.1996068631609281 (-0.03673252711693445) | > avg_loss_disc_real_5: 0.2643963396549225 (-0.0031845370928446637) | > avg_loss_0: 2.3216384251912436 (-0.4136327107747393) | > avg_loss_gen: 3.2126134236653647 (+1.2475449641545615) | > avg_loss_kl: 2.2160362799962363 (+0.022251367568969727) | > avg_loss_feat: 6.868848403294881 (+3.443857446312904) | > avg_loss_mel: 27.000680287679035 (+7.175641377766926) | > avg_loss_duration: 2.0959622065226235 (+0.020488619804382324) | > avg_loss_1: 41.394142150878906 (+11.909784317016602)  > EPOCH: 25/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:57:11)   --> TIME: 2023-10-19 23:57:22 -- STEP: 19/50 -- GLOBAL_STEP: 54270 | > loss_disc: 2.2493233680725098 (2.6116385083449516) | > loss_disc_real_0: 0.1304004043340683 (0.155850836909131) | > loss_disc_real_1: 0.1281239241361618 (0.22844991656510452) | > loss_disc_real_2: 0.2692655622959137 (0.237592639499589) | > loss_disc_real_3: 0.2491040676832199 (0.25529514802129644) | > loss_disc_real_4: 0.2944006621837616 (0.24393562815691294) | > loss_disc_real_5: 0.3265645503997803 (0.23965638640679812) | > loss_0: 2.2493233680725098 (2.6116385083449516) | > grad_norm_0: tensor(510.6931, device='cuda:0') (tensor(311.6245, device='cuda:0')) | > loss_gen: 2.566175937652588 (2.128866484290675) | > loss_kl: 1.2377238273620605 (1.4343041369789524) | > loss_feat: 6.571667671203613 (4.405426423800619) | > loss_mel: 27.14345932006836 (24.564279004147178) | > loss_duration: 2.1369571685791016 (1.9842287051050287) | > loss_1: 39.655982971191406 (34.51710505234568) | > grad_norm_1: tensor(12961.5713, device='cuda:0') (tensor(16060.9639, device='cuda:0')) | > current_lr_0: 0.00019506167759615451 | > current_lr_1: 0.00019506167759615451 | > step_time: 0.5978 (0.40964870703847783) | > loader_time: 0.022 (0.009987768373991313)  --> TIME: 2023-10-19 23:57:38 -- STEP: 49/50 -- GLOBAL_STEP: 54300 | > loss_disc: 2.681955337524414 (2.5653325319290166) | > loss_disc_real_0: 0.15768148005008698 (0.17684040338333168) | > loss_disc_real_1: 0.20033234357833862 (0.24473559620733165) | > loss_disc_real_2: 0.13329052925109863 (0.21588000906061153) | > loss_disc_real_3: 0.22744111716747284 (0.24760682713620516) | > loss_disc_real_4: 0.33019810914993286 (0.22332839196433826) | > loss_disc_real_5: 0.4198104441165924 (0.21194760965145365) | > loss_0: 2.681955337524414 (2.5653325319290166) | > grad_norm_0: tensor(359.4605, device='cuda:0') (tensor(345.7588, device='cuda:0')) | > loss_gen: 1.8755860328674316 (2.229683754395465) | > loss_kl: 1.047176718711853 (1.3681922786089842) | > loss_feat: 1.5823158025741577 (4.614484811847914) | > loss_mel: 22.22747039794922 (23.917371647698538) | > loss_duration: 2.0251269340515137 (1.9342959121781953) | > loss_1: 28.757675170898438 (34.064028506376296) | > grad_norm_1: tensor(10861.3789, device='cuda:0') (tensor(17144.9473, device='cuda:0')) | > current_lr_0: 0.00019506167759615451 | > current_lr_1: 0.00019506167759615451 | > step_time: 0.4127 (0.4638229632864193) | > loader_time: 0.215 (0.015418602495777364)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2300758361816406 (2.2300758361816406) | > loss_disc_real_0: 0.013130632229149342 (0.013130632229149342) | > loss_disc_real_1: 0.1642274558544159 (0.1642274558544159) | > loss_disc_real_2: 0.1803794652223587 (0.1803794652223587) | > loss_disc_real_3: 0.1938231736421585 (0.1938231736421585) | > loss_disc_real_4: 0.2498011589050293 (0.2498011589050293) | > loss_disc_real_5: 0.050727371126413345 (0.050727371126413345) | > loss_0: 2.2300758361816406 (2.2300758361816406) | > loss_gen: 1.8437379598617554 (1.8437379598617554) | > loss_kl: 1.8371083736419678 (1.8371083736419678) | > loss_feat: 10.667451858520508 (10.667451858520508) | > loss_mel: 27.56016731262207 (27.56016731262207) | > loss_duration: 1.936867594718933 (1.936867594718933) | > loss_1: 43.845333099365234 (43.845333099365234)  --> STEP: 1 | > loss_disc: 2.9369657039642334 (2.9369657039642334) | > loss_disc_real_0: 0.25862613320350647 (0.25862613320350647) | > loss_disc_real_1: 0.2394041270017624 (0.2394041270017624) | > loss_disc_real_2: 0.23020225763320923 (0.23020225763320923) | > loss_disc_real_3: 0.22641834616661072 (0.22641834616661072) | > loss_disc_real_4: 0.3786807358264923 (0.3786807358264923) | > loss_disc_real_5: 0.3267745077610016 (0.3267745077610016) | > loss_0: 2.9369657039642334 (2.9369657039642334) | > loss_gen: 1.8015286922454834 (1.8015286922454834) | > loss_kl: 1.8592240810394287 (1.8592240810394287) | > loss_feat: 0.3025350570678711 (0.3025350570678711) | > loss_mel: 13.78026294708252 (13.78026294708252) | > loss_duration: 2.0328757762908936 (2.0328757762908936) | > loss_1: 19.776426315307617 (19.776426315307617)  --> STEP: 2 | > loss_disc: 2.8746697902679443 (2.905817747116089) | > loss_disc_real_0: 0.0968361645936966 (0.17773114889860153) | > loss_disc_real_1: 0.2837389409542084 (0.2615715339779854) | > loss_disc_real_2: 0.38067200779914856 (0.3054371327161789) | > loss_disc_real_3: 0.4073652923107147 (0.3168918192386627) | > loss_disc_real_4: 0.4526020884513855 (0.4156414121389389) | > loss_disc_real_5: 0.21385248005390167 (0.27031349390745163) | > loss_0: 2.8746697902679443 (2.905817747116089) | > loss_gen: 2.3261661529541016 (2.0638474225997925) | > loss_kl: 1.8657268285751343 (1.8624754548072815) | > loss_feat: 5.427566051483154 (2.8650505542755127) | > loss_mel: 28.809656143188477 (21.294959545135498) | > loss_duration: 1.97454035282135 (2.003708064556122) | > loss_1: 40.403656005859375 (30.090041160583496)  --> STEP: 3 | > loss_disc: 2.482203483581543 (2.7646129926045737) | > loss_disc_real_0: 0.050568804144859314 (0.13534370064735413) | > loss_disc_real_1: 0.213094100356102 (0.24541238943735758) | > loss_disc_real_2: 0.3985120356082916 (0.3364621003468831) | > loss_disc_real_3: 0.1384744644165039 (0.25741936763127643) | > loss_disc_real_4: 0.40352174639701843 (0.41160152355829877) | > loss_disc_real_5: 0.3777812123298645 (0.3061360667149226) | > loss_0: 2.482203483581543 (2.7646129926045737) | > loss_gen: 2.8422718048095703 (2.3233222166697183) | > loss_kl: 1.8425601720809937 (1.8558370272318523) | > loss_feat: 7.1335577964782715 (4.287886301676433) | > loss_mel: 27.99211311340332 (23.527344067891438) | > loss_duration: 2.1752445697784424 (2.0608868996302285) | > loss_1: 41.98574447631836 (34.05527559916178) --> EVAL PERFORMANCE | > avg_loader_time: 0.01367346445719401 (+0.002239704132080078) | > avg_loss_disc: 2.7646129926045737 (+0.4429745674133301) | > avg_loss_disc_real_0: 0.13534370064735413 (-0.062122049431006104) | > avg_loss_disc_real_1: 0.24541238943735758 (-0.13651350140571597) | > avg_loss_disc_real_2: 0.3364621003468831 (+0.016301636894543947) | > avg_loss_disc_real_3: 0.25741936763127643 (-0.008661940693855286) | > avg_loss_disc_real_4: 0.41160152355829877 (+0.21199466039737067) | > avg_loss_disc_real_5: 0.3061360667149226 (+0.04173972706000012) | > avg_loss_0: 2.7646129926045737 (+0.4429745674133301) | > avg_loss_gen: 2.3233222166697183 (-0.8892912069956465) | > avg_loss_kl: 1.8558370272318523 (-0.360199252764384) | > avg_loss_feat: 4.287886301676433 (-2.5809621016184483) | > avg_loss_mel: 23.527344067891438 (-3.4733362197875977) | > avg_loss_duration: 2.0608868996302285 (-0.03507530689239502) | > avg_loss_1: 34.05527559916178 (-7.338866551717125)  > EPOCH: 26/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:57:45)   --> TIME: 2023-10-19 23:58:04 -- STEP: 29/50 -- GLOBAL_STEP: 54330 | > loss_disc: 2.8866171836853027 (2.5792390971348205) | > loss_disc_real_0: 0.4000338315963745 (0.1661168908507659) | > loss_disc_real_1: 0.3121189475059509 (0.25303998602361516) | > loss_disc_real_2: 0.19481612741947174 (0.23650302590224254) | > loss_disc_real_3: 0.3670009672641754 (0.2602012691826655) | > loss_disc_real_4: 0.22224216163158417 (0.23039908848445984) | > loss_disc_real_5: 0.2404816597700119 (0.23908472958759505) | > loss_0: 2.8866171836853027 (2.5792390971348205) | > grad_norm_0: tensor(643.5806, device='cuda:0') (tensor(486.7386, device='cuda:0')) | > loss_gen: 2.0838797092437744 (2.4764651676704137) | > loss_kl: 1.0753499269485474 (1.3524634992254192) | > loss_feat: 1.9154692888259888 (5.55063664206657) | > loss_mel: 28.69928741455078 (26.293533078555402) | > loss_duration: 1.919416069984436 (1.9581518419857682) | > loss_1: 35.69340133666992 (37.63125006905918) | > grad_norm_1: tensor(8436.6973, device='cuda:0') (tensor(25313.5156, device='cuda:0')) | > current_lr_0: 0.0001948667012367107 | > current_lr_1: 0.0001948667012367107 | > step_time: 0.6915 (0.5020378540302146) | > loader_time: 0.0214 (0.020860655554409684)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4809670448303223 (2.4809670448303223) | > loss_disc_real_0: 0.05783409625291824 (0.05783409625291824) | > loss_disc_real_1: 0.15260979533195496 (0.15260979533195496) | > loss_disc_real_2: 0.2750788629055023 (0.2750788629055023) | > loss_disc_real_3: 0.22071196138858795 (0.22071196138858795) | > loss_disc_real_4: 0.3193449378013611 (0.3193449378013611) | > loss_disc_real_5: 0.29270780086517334 (0.29270780086517334) | > loss_0: 2.4809670448303223 (2.4809670448303223) | > loss_gen: 2.1122865676879883 (2.1122865676879883) | > loss_kl: 2.2429850101470947 (2.2429850101470947) | > loss_feat: 4.384555339813232 (4.384555339813232) | > loss_mel: 28.18271255493164 (28.18271255493164) | > loss_duration: 1.9213078022003174 (1.9213078022003174) | > loss_1: 38.84384536743164 (38.84384536743164)  --> STEP: 1 | > loss_disc: 2.696428060531616 (2.696428060531616) | > loss_disc_real_0: 0.07832683622837067 (0.07832683622837067) | > loss_disc_real_1: 0.18189561367034912 (0.18189561367034912) | > loss_disc_real_2: 0.17482145130634308 (0.17482145130634308) | > loss_disc_real_3: 0.2753271460533142 (0.2753271460533142) | > loss_disc_real_4: 0.2894347906112671 (0.2894347906112671) | > loss_disc_real_5: 0.23673810064792633 (0.23673810064792633) | > loss_0: 2.696428060531616 (2.696428060531616) | > loss_gen: 1.8915235996246338 (1.8915235996246338) | > loss_kl: 2.132307291030884 (2.132307291030884) | > loss_feat: 5.8419671058654785 (5.8419671058654785) | > loss_mel: 26.479360580444336 (26.479360580444336) | > loss_duration: 2.075085163116455 (2.075085163116455) | > loss_1: 38.42024612426758 (38.42024612426758)  --> STEP: 2 | > loss_disc: 2.0542399883270264 (2.3753340244293213) | > loss_disc_real_0: 0.07336835563182831 (0.07584759593009949) | > loss_disc_real_1: 0.25014638900756836 (0.21602100133895874) | > loss_disc_real_2: 0.04582090303301811 (0.1103211771696806) | > loss_disc_real_3: 0.22651894390583038 (0.2509230449795723) | > loss_disc_real_4: 0.12936905026435852 (0.2094019204378128) | > loss_disc_real_5: 0.17489252984523773 (0.20581531524658203) | > loss_0: 2.0542399883270264 (2.3753340244293213) | > loss_gen: 2.245913505554199 (2.0687185525894165) | > loss_kl: 1.8606535196304321 (1.996480405330658) | > loss_feat: 11.173091888427734 (8.507529497146606) | > loss_mel: 28.827701568603516 (27.653531074523926) | > loss_duration: 2.0113205909729004 (2.0432028770446777) | > loss_1: 46.118682861328125 (42.26946449279785)  --> STEP: 3 | > loss_disc: 3.109145402908325 (2.6199378172556558) | > loss_disc_real_0: 0.22029128670692444 (0.12399549285570781) | > loss_disc_real_1: 0.18171371519565582 (0.2045852392911911) | > loss_disc_real_2: 0.2506742477416992 (0.15710553402702013) | > loss_disc_real_3: 0.18528605997562408 (0.22904404997825623) | > loss_disc_real_4: 0.38118255138397217 (0.2666621307531993) | > loss_disc_real_5: 0.3264002501964569 (0.246010293563207) | > loss_0: 3.109145402908325 (2.6199378172556558) | > loss_gen: 2.0300469398498535 (2.055828015009562) | > loss_kl: 2.2668633460998535 (2.086608052253723) | > loss_feat: 4.442104339599609 (7.152387777964274) | > loss_mel: 26.034786224365234 (27.113949457804363) | > loss_duration: 2.3064770698547363 (2.1309609413146973) | > loss_1: 37.08028030395508 (40.53973642985026) --> EVAL PERFORMANCE | > avg_loader_time: 0.005878527959187825 (-0.007794936498006185) | > avg_loss_disc: 2.6199378172556558 (-0.14467517534891794) | > avg_loss_disc_real_0: 0.12399549285570781 (-0.011348207791646317) | > avg_loss_disc_real_1: 0.2045852392911911 (-0.040827150146166474) | > avg_loss_disc_real_2: 0.15710553402702013 (-0.179356566319863) | > avg_loss_disc_real_3: 0.22904404997825623 (-0.028375317653020204) | > avg_loss_disc_real_4: 0.2666621307531993 (-0.1449393928050995) | > avg_loss_disc_real_5: 0.246010293563207 (-0.060125773151715606) | > avg_loss_0: 2.6199378172556558 (-0.14467517534891794) | > avg_loss_gen: 2.055828015009562 (-0.26749420166015625) | > avg_loss_kl: 2.086608052253723 (+0.23077102502187086) | > avg_loss_feat: 7.152387777964274 (+2.864501476287842) | > avg_loss_mel: 27.113949457804363 (+3.5866053899129255) | > avg_loss_duration: 2.1309609413146973 (+0.07007404168446874) | > avg_loss_1: 40.53973642985026 (+6.484460830688477)  > EPOCH: 27/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:58:23)   --> TIME: 2023-10-19 23:58:32 -- STEP: 9/50 -- GLOBAL_STEP: 54360 | > loss_disc: 2.2846672534942627 (2.429822709825304) | > loss_disc_real_0: 0.15598148107528687 (0.1656450496779548) | > loss_disc_real_1: 0.2987253665924072 (0.29734961026244694) | > loss_disc_real_2: 0.2992737889289856 (0.2144159691201316) | > loss_disc_real_3: 0.3246905207633972 (0.22729247477319506) | > loss_disc_real_4: 0.27110520005226135 (0.25347498266233337) | > loss_disc_real_5: 0.135590061545372 (0.1937100723799732) | > loss_0: 2.2846672534942627 (2.429822709825304) | > grad_norm_0: tensor(485.4749, device='cuda:0') (tensor(402.0312, device='cuda:0')) | > loss_gen: 3.087317943572998 (2.4977790779537625) | > loss_kl: 1.116748332977295 (1.2183408273590937) | > loss_feat: 6.830731391906738 (5.521987279256185) | > loss_mel: 26.458457946777344 (24.56627294752333) | > loss_duration: 1.7440705299377441 (1.8765025271309748) | > loss_1: 39.237327575683594 (35.68088234795464) | > grad_norm_1: tensor(24730.3184, device='cuda:0') (tensor(14984.0625, device='cuda:0')) | > current_lr_0: 0.0001946719197683455 | > current_lr_1: 0.0001946719197683455 | > step_time: 0.5912 (0.37007321251763237) | > loader_time: 0.0152 (0.008869383070203993)  --> TIME: 2023-10-19 23:58:48 -- STEP: 39/50 -- GLOBAL_STEP: 54390 | > loss_disc: 2.430480480194092 (2.559726528632335) | > loss_disc_real_0: 0.49226564168930054 (0.18562106071756437) | > loss_disc_real_1: 0.24990564584732056 (0.25624484072128934) | > loss_disc_real_2: 0.2865133285522461 (0.22288703307127342) | > loss_disc_real_3: 0.18140442669391632 (0.25260286931044024) | > loss_disc_real_4: 0.14798739552497864 (0.23754239435761404) | > loss_disc_real_5: 0.10268466919660568 (0.20863216356016123) | > loss_0: 2.430480480194092 (2.559726528632335) | > grad_norm_0: tensor(593.4355, device='cuda:0') (tensor(538.1277, device='cuda:0')) | > loss_gen: 2.33912992477417 (2.4188364988718276) | > loss_kl: 1.4595907926559448 (1.3588949548892486) | > loss_feat: 3.7439427375793457 (5.3563130986996175) | > loss_mel: 14.99426555633545 (25.817973760458138) | > loss_duration: 1.9015982151031494 (1.928336968788734) | > loss_1: 24.438528060913086 (36.88035519917806) | > grad_norm_1: tensor(6669.6631, device='cuda:0') (tensor(18670.2070, device='cuda:0')) | > current_lr_0: 0.0001946719197683455 | > current_lr_1: 0.0001946719197683455 | > step_time: 0.578 (0.47380824578114045) | > loader_time: 0.0251 (0.01529392217978453)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.4414680004119873 (1.4414680004119873) | > loss_disc_real_0: 0.10677462071180344 (0.10677462071180344) | > loss_disc_real_1: 0.21752899885177612 (0.21752899885177612) | > loss_disc_real_2: 0.07504133135080338 (0.07504133135080338) | > loss_disc_real_3: 0.04578307643532753 (0.04578307643532753) | > loss_disc_real_4: 0.08391614258289337 (0.08391614258289337) | > loss_disc_real_5: 0.02095390111207962 (0.02095390111207962) | > loss_0: 1.4414680004119873 (1.4414680004119873) | > loss_gen: 3.177358388900757 (3.177358388900757) | > loss_kl: 1.983066439628601 (1.983066439628601) | > loss_feat: 13.223736763000488 (13.223736763000488) | > loss_mel: 30.848464965820312 (30.848464965820312) | > loss_duration: 1.899760365486145 (1.899760365486145) | > loss_1: 51.13238525390625 (51.13238525390625)  --> STEP: 1 | > loss_disc: 2.0232417583465576 (2.0232417583465576) | > loss_disc_real_0: 0.06587175279855728 (0.06587175279855728) | > loss_disc_real_1: 0.12140423059463501 (0.12140423059463501) | > loss_disc_real_2: 0.05467798560857773 (0.05467798560857773) | > loss_disc_real_3: 0.07813379168510437 (0.07813379168510437) | > loss_disc_real_4: 0.2308695912361145 (0.2308695912361145) | > loss_disc_real_5: 0.4186164438724518 (0.4186164438724518) | > loss_0: 2.0232417583465576 (2.0232417583465576) | > loss_gen: 4.20682954788208 (4.20682954788208) | > loss_kl: 2.5971081256866455 (2.5971081256866455) | > loss_feat: 12.315834999084473 (12.315834999084473) | > loss_mel: 29.017072677612305 (29.017072677612305) | > loss_duration: 2.0936238765716553 (2.0936238765716553) | > loss_1: 50.23046875 (50.23046875)  --> STEP: 2 | > loss_disc: 2.3070731163024902 (2.165157437324524) | > loss_disc_real_0: 0.1933000236749649 (0.1295858882367611) | > loss_disc_real_1: 0.3985343873500824 (0.2599693089723587) | > loss_disc_real_2: 0.2404726892709732 (0.14757533743977547) | > loss_disc_real_3: 0.18779784440994263 (0.1329658180475235) | > loss_disc_real_4: 0.12559838593006134 (0.17823398858308792) | > loss_disc_real_5: 0.11035434901714325 (0.2644853964447975) | > loss_0: 2.3070731163024902 (2.165157437324524) | > loss_gen: 2.3226611614227295 (3.264745354652405) | > loss_kl: 2.1964187622070312 (2.3967634439468384) | > loss_feat: 7.255239486694336 (9.785537242889404) | > loss_mel: 30.24483871459961 (29.630955696105957) | > loss_duration: 2.010471820831299 (2.052047848701477) | > loss_1: 44.02962875366211 (47.130048751831055)  --> STEP: 3 | > loss_disc: 3.1062285900115967 (2.4788478215535483) | > loss_disc_real_0: 0.27713829278945923 (0.17877002308766046) | > loss_disc_real_1: 0.28043466806411743 (0.26679109533627826) | > loss_disc_real_2: 0.25830960273742676 (0.18448675920565924) | > loss_disc_real_3: 0.334310919046402 (0.20008085171381632) | > loss_disc_real_4: 0.40606048703193665 (0.25417615473270416) | > loss_disc_real_5: 0.38434579968452454 (0.30443886419137317) | > loss_0: 3.1062285900115967 (2.4788478215535483) | > loss_gen: 1.919042706489563 (2.816177805264791) | > loss_kl: 2.3553807735443115 (2.3829692204793296) | > loss_feat: 0.39299964904785156 (6.654691378275554) | > loss_mel: 24.73790168762207 (27.999937693277996) | > loss_duration: 2.216503381729126 (2.1068663597106934) | > loss_1: 31.621828079223633 (41.960641860961914) --> EVAL PERFORMANCE | > avg_loader_time: 0.005572954813639323 (-0.000305573145548502) | > avg_loss_disc: 2.4788478215535483 (-0.14108999570210745) | > avg_loss_disc_real_0: 0.17877002308766046 (+0.05477453023195265) | > avg_loss_disc_real_1: 0.26679109533627826 (+0.06220585604508716) | > avg_loss_disc_real_2: 0.18448675920565924 (+0.027381225178639113) | > avg_loss_disc_real_3: 0.20008085171381632 (-0.02896319826443991) | > avg_loss_disc_real_4: 0.25417615473270416 (-0.012485976020495115) | > avg_loss_disc_real_5: 0.30443886419137317 (+0.05842857062816617) | > avg_loss_0: 2.4788478215535483 (-0.14108999570210745) | > avg_loss_gen: 2.816177805264791 (+0.760349790255229) | > avg_loss_kl: 2.3829692204793296 (+0.29636116822560643) | > avg_loss_feat: 6.654691378275554 (-0.4976963996887207) | > avg_loss_mel: 27.999937693277996 (+0.8859882354736328) | > avg_loss_duration: 2.1068663597106934 (-0.024094581604003906) | > avg_loss_1: 41.960641860961914 (+1.420905431111656)  > EPOCH: 28/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:59:03)   --> TIME: 2023-10-19 23:59:15 -- STEP: 19/50 -- GLOBAL_STEP: 54420 | > loss_disc: 1.5741469860076904 (2.606283056108575) | > loss_disc_real_0: 0.08320878446102142 (0.19569345798931623) | > loss_disc_real_1: 0.19874583184719086 (0.24594713590647044) | > loss_disc_real_2: 0.18446040153503418 (0.2393050268292427) | > loss_disc_real_3: 0.03546192869544029 (0.22131964740784546) | > loss_disc_real_4: 0.06703902781009674 (0.2482508593483975) | > loss_disc_real_5: 0.06922299414873123 (0.3231729337651479) | > loss_0: 1.5741469860076904 (2.606283056108575) | > grad_norm_0: tensor(552.2461, device='cuda:0') (tensor(482.8745, device='cuda:0')) | > loss_gen: 2.772440195083618 (2.4605092061193368) | > loss_kl: 1.2822604179382324 (1.4547394984646846) | > loss_feat: 10.878894805908203 (5.324422000858345) | > loss_mel: 32.736690521240234 (24.781952468972456) | > loss_duration: 2.131246566772461 (1.9874921660674245) | > loss_1: 49.801536560058594 (36.00911511872944) | > grad_norm_1: tensor(32205.0527, device='cuda:0') (tensor(21308.4336, device='cuda:0')) | > current_lr_0: 0.0001944773329962531 | > current_lr_1: 0.0001944773329962531 | > step_time: 0.3214 (0.4082221859379819) | > loader_time: 0.0058 (0.013495984830354387)  --> TIME: 2023-10-19 23:59:27 -- STEP: 49/50 -- GLOBAL_STEP: 54450 | > loss_disc: 2.847339630126953 (2.639244252321672) | > loss_disc_real_0: 0.2611297070980072 (0.2529888879127649) | > loss_disc_real_1: 0.3454888164997101 (0.2374345879925757) | > loss_disc_real_2: 0.21362902224063873 (0.2425975382936244) | > loss_disc_real_3: 0.4481106102466583 (0.23846504008587527) | > loss_disc_real_4: 0.25075051188468933 (0.27302636814360715) | > loss_disc_real_5: 0.24382776021957397 (0.2798326671009465) | > loss_0: 2.847339630126953 (2.639244252321672) | > grad_norm_0: tensor(335.3586, device='cuda:0') (tensor(524.7198, device='cuda:0')) | > loss_gen: 1.9811474084854126 (2.4950176745044947) | > loss_kl: 0.9737913608551025 (1.3688621143905482) | > loss_feat: 1.1709632873535156 (5.366033370359514) | > loss_mel: 30.38886833190918 (26.643613635277262) | > loss_duration: 1.9891917705535889 (1.9268776470301103) | > loss_1: 36.503963470458984 (37.80040454864502) | > grad_norm_1: tensor(5190.8555, device='cuda:0') (tensor(18159.1289, device='cuda:0')) | > current_lr_0: 0.0001944773329962531 | > current_lr_1: 0.0001944773329962531 | > step_time: 0.2719 (0.39721251020626147) | > loader_time: 0.1581 (0.014166578954579874)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6603646278381348 (2.6603646278381348) | > loss_disc_real_0: 0.1657731831073761 (0.1657731831073761) | > loss_disc_real_1: 0.19739465415477753 (0.19739465415477753) | > loss_disc_real_2: 0.2518535256385803 (0.2518535256385803) | > loss_disc_real_3: 0.4630035161972046 (0.4630035161972046) | > loss_disc_real_4: 0.32679927349090576 (0.32679927349090576) | > loss_disc_real_5: 0.35891011357307434 (0.35891011357307434) | > loss_0: 2.6603646278381348 (2.6603646278381348) | > loss_gen: 2.3923819065093994 (2.3923819065093994) | > loss_kl: 1.378670334815979 (1.378670334815979) | > loss_feat: 3.5833849906921387 (3.5833849906921387) | > loss_mel: 26.697101593017578 (26.697101593017578) | > loss_duration: 1.9063397645950317 (1.9063397645950317) | > loss_1: 35.957881927490234 (35.957881927490234)  --> STEP: 1 | > loss_disc: 2.5211310386657715 (2.5211310386657715) | > loss_disc_real_0: 0.12858042120933533 (0.12858042120933533) | > loss_disc_real_1: 0.3584470748901367 (0.3584470748901367) | > loss_disc_real_2: 0.2783946096897125 (0.2783946096897125) | > loss_disc_real_3: 0.33194732666015625 (0.33194732666015625) | > loss_disc_real_4: 0.20229850709438324 (0.20229850709438324) | > loss_disc_real_5: 0.1843070685863495 (0.1843070685863495) | > loss_0: 2.5211310386657715 (2.5211310386657715) | > loss_gen: 2.3823912143707275 (2.3823912143707275) | > loss_kl: 2.5296695232391357 (2.5296695232391357) | > loss_feat: 6.426797389984131 (6.426797389984131) | > loss_mel: 28.4371280670166 (28.4371280670166) | > loss_duration: 2.07208514213562 (2.07208514213562) | > loss_1: 41.84807205200195 (41.84807205200195)  --> STEP: 2 | > loss_disc: 2.4541549682617188 (2.487643003463745) | > loss_disc_real_0: 0.05588719993829727 (0.0922338105738163) | > loss_disc_real_1: 0.2803036570549011 (0.3193753659725189) | > loss_disc_real_2: 0.12035217136144638 (0.19937339052557945) | > loss_disc_real_3: 0.3203306794166565 (0.32613900303840637) | > loss_disc_real_4: 0.12765254080295563 (0.16497552394866943) | > loss_disc_real_5: 0.05904122069478035 (0.12167414464056492) | > loss_0: 2.4541549682617188 (2.487643003463745) | > loss_gen: 1.851935863494873 (2.1171635389328003) | > loss_kl: 1.6982331275939941 (2.113951325416565) | > loss_feat: 6.95504093170166 (6.6909191608428955) | > loss_mel: 23.8216552734375 (26.12939167022705) | > loss_duration: 1.9659818410873413 (2.0190334916114807) | > loss_1: 36.2928466796875 (39.07045936584473)  --> STEP: 3 | > loss_disc: 3.112011671066284 (2.6957658926645913) | > loss_disc_real_0: 0.17781151831150055 (0.12075971315304439) | > loss_disc_real_1: 0.22446906566619873 (0.28773993253707886) | > loss_disc_real_2: 0.2751885950565338 (0.2246451253692309) | > loss_disc_real_3: 0.4565087556838989 (0.36959558725357056) | > loss_disc_real_4: 0.160784512758255 (0.16357852021853128) | > loss_disc_real_5: 0.13727526366710663 (0.12687451764941216) | > loss_0: 3.112011671066284 (2.6957658926645913) | > loss_gen: 1.6242088079452515 (1.952845295270284) | > loss_kl: 1.2004320621490479 (1.8094449043273926) | > loss_feat: 3.2690703868865967 (5.550302902857463) | > loss_mel: 25.106233596801758 (25.788338979085285) | > loss_duration: 2.121485948562622 (2.0531843105951944) | > loss_1: 33.32143020629883 (37.15411631266276) --> EVAL PERFORMANCE | > avg_loader_time: 0.002406040827433268 (-0.003166913986206055) | > avg_loss_disc: 2.6957658926645913 (+0.216918071111043) | > avg_loss_disc_real_0: 0.12075971315304439 (-0.058010309934616075) | > avg_loss_disc_real_1: 0.28773993253707886 (+0.020948837200800596) | > avg_loss_disc_real_2: 0.2246451253692309 (+0.04015836616357166) | > avg_loss_disc_real_3: 0.36959558725357056 (+0.16951473553975424) | > avg_loss_disc_real_4: 0.16357852021853128 (-0.09059763451417288) | > avg_loss_disc_real_5: 0.12687451764941216 (-0.17756434654196102) | > avg_loss_0: 2.6957658926645913 (+0.216918071111043) | > avg_loss_gen: 1.952845295270284 (-0.8633325099945071) | > avg_loss_kl: 1.8094449043273926 (-0.573524316151937) | > avg_loss_feat: 5.550302902857463 (-1.1043884754180908) | > avg_loss_mel: 25.788338979085285 (-2.2115987141927107) | > avg_loss_duration: 2.0531843105951944 (-0.05368204911549901) | > avg_loss_1: 37.15411631266276 (-4.806525548299156)  > EPOCH: 29/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-19 23:59:37)   --> TIME: 2023-10-19 23:59:55 -- STEP: 29/50 -- GLOBAL_STEP: 54480 | > loss_disc: 2.813581705093384 (2.7603006897301507) | > loss_disc_real_0: 0.2041378915309906 (0.19837746743498177) | > loss_disc_real_1: 0.3150133490562439 (0.24203205712396522) | > loss_disc_real_2: 0.28334835171699524 (0.24271713505531178) | > loss_disc_real_3: 0.3414294719696045 (0.28883363383597344) | > loss_disc_real_4: 0.29385554790496826 (0.2507012091448595) | > loss_disc_real_5: 0.25381362438201904 (0.24439020345694026) | > loss_0: 2.813581705093384 (2.7603006897301507) | > grad_norm_0: tensor(183.0532, device='cuda:0') (tensor(443.0365, device='cuda:0')) | > loss_gen: 1.846868872642517 (2.253211050197996) | > loss_kl: 1.3673871755599976 (1.312941390892555) | > loss_feat: 0.6807793378829956 (4.400768024140392) | > loss_mel: 21.782024383544922 (25.03105017234539) | > loss_duration: 2.0247061252593994 (1.957972025049144) | > loss_1: 27.701765060424805 (34.95594238412794) | > grad_norm_1: tensor(8862.0918, device='cuda:0') (tensor(18048.1602, device='cuda:0')) | > current_lr_0: 0.00019428294072582235 | > current_lr_1: 0.00019428294072582235 | > step_time: 0.6037 (0.504943716114965) | > loader_time: 0.0138 (0.01930144737506735)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.463318109512329 (2.463318109512329) | > loss_disc_real_0: 0.1236647292971611 (0.1236647292971611) | > loss_disc_real_1: 0.288964182138443 (0.288964182138443) | > loss_disc_real_2: 0.2024165242910385 (0.2024165242910385) | > loss_disc_real_3: 0.2521635890007019 (0.2521635890007019) | > loss_disc_real_4: 0.20720259845256805 (0.20720259845256805) | > loss_disc_real_5: 0.13682612776756287 (0.13682612776756287) | > loss_0: 2.463318109512329 (2.463318109512329) | > loss_gen: 1.996096134185791 (1.996096134185791) | > loss_kl: 2.2619969844818115 (2.2619969844818115) | > loss_feat: 3.58817195892334 (3.58817195892334) | > loss_mel: 26.53127098083496 (26.53127098083496) | > loss_duration: 1.9603444337844849 (1.9603444337844849) | > loss_1: 36.33788299560547 (36.33788299560547)  --> STEP: 1 | > loss_disc: 2.3926212787628174 (2.3926212787628174) | > loss_disc_real_0: 0.04013391584157944 (0.04013391584157944) | > loss_disc_real_1: 0.23079349100589752 (0.23079349100589752) | > loss_disc_real_2: 0.23650911450386047 (0.23650911450386047) | > loss_disc_real_3: 0.29003456234931946 (0.29003456234931946) | > loss_disc_real_4: 0.21588248014450073 (0.21588248014450073) | > loss_disc_real_5: 0.23776750266551971 (0.23776750266551971) | > loss_0: 2.3926212787628174 (2.3926212787628174) | > loss_gen: 2.2673838138580322 (2.2673838138580322) | > loss_kl: 2.519357204437256 (2.519357204437256) | > loss_feat: 5.317623615264893 (5.317623615264893) | > loss_mel: 27.138872146606445 (27.138872146606445) | > loss_duration: 2.046800136566162 (2.046800136566162) | > loss_1: 39.290035247802734 (39.290035247802734)  --> STEP: 2 | > loss_disc: 2.522365093231201 (2.4574931859970093) | > loss_disc_real_0: 0.05895918980240822 (0.04954655282199383) | > loss_disc_real_1: 0.1161956861615181 (0.1734945885837078) | > loss_disc_real_2: 0.11175885051488876 (0.17413398250937462) | > loss_disc_real_3: 0.27222660183906555 (0.2811305820941925) | > loss_disc_real_4: 0.2008117139339447 (0.20834709703922272) | > loss_disc_real_5: 0.37452274560928345 (0.3061451241374016) | > loss_0: 2.522365093231201 (2.4574931859970093) | > loss_gen: 2.245572090148926 (2.256477952003479) | > loss_kl: 1.7454442977905273 (2.1324007511138916) | > loss_feat: 6.867173671722412 (6.092398643493652) | > loss_mel: 26.979768753051758 (27.0593204498291) | > loss_duration: 2.0808770656585693 (2.0638386011123657) | > loss_1: 39.91883087158203 (39.60443305969238)  --> STEP: 3 | > loss_disc: 2.4266953468322754 (2.4472272396087646) | > loss_disc_real_0: 0.27957940101623535 (0.126224168886741) | > loss_disc_real_1: 0.2064875066280365 (0.18449222793181738) | > loss_disc_real_2: 0.15778984129428864 (0.1686859354376793) | > loss_disc_real_3: 0.2591143250465393 (0.2737918297449748) | > loss_disc_real_4: 0.24536865949630737 (0.22068761785825095) | > loss_disc_real_5: 0.08789221942424774 (0.23339415589968363) | > loss_0: 2.4266953468322754 (2.4472272396087646) | > loss_gen: 2.337887763977051 (2.2836145559946694) | > loss_kl: 2.6301984786987305 (2.2983333269755044) | > loss_feat: 4.098938465118408 (5.427911917368571) | > loss_mel: 25.39958953857422 (26.50607681274414) | > loss_duration: 2.2186169624328613 (2.1154313882191977) | > loss_1: 36.68523025512695 (38.63136545817057) --> EVAL PERFORMANCE | > avg_loader_time: 0.011503458023071289 (+0.009097417195638021) | > avg_loss_disc: 2.4472272396087646 (-0.24853865305582667) | > avg_loss_disc_real_0: 0.126224168886741 (+0.005464455733696624) | > avg_loss_disc_real_1: 0.18449222793181738 (-0.10324770460526148) | > avg_loss_disc_real_2: 0.1686859354376793 (-0.055959189931551606) | > avg_loss_disc_real_3: 0.2737918297449748 (-0.09580375750859577) | > avg_loss_disc_real_4: 0.22068761785825095 (+0.057109097639719664) | > avg_loss_disc_real_5: 0.23339415589968363 (+0.10651963825027147) | > avg_loss_0: 2.4472272396087646 (-0.24853865305582667) | > avg_loss_gen: 2.2836145559946694 (+0.3307692607243855) | > avg_loss_kl: 2.2983333269755044 (+0.48888842264811183) | > avg_loss_feat: 5.427911917368571 (-0.1223909854888916) | > avg_loss_mel: 26.50607681274414 (+0.7177378336588554) | > avg_loss_duration: 2.1154313882191977 (+0.06224707762400339) | > avg_loss_1: 38.63136545817057 (+1.4772491455078125)  > EPOCH: 30/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:00:16)   --> TIME: 2023-10-20 00:00:22 -- STEP: 9/50 -- GLOBAL_STEP: 54510 | > loss_disc: 2.1319782733917236 (2.464971833758884) | > loss_disc_real_0: 0.17420753836631775 (0.12954093826313814) | > loss_disc_real_1: 0.22967033088207245 (0.20079596216479936) | > loss_disc_real_2: 0.27689796686172485 (0.23952322453260422) | > loss_disc_real_3: 0.2948525547981262 (0.26777725252840257) | > loss_disc_real_4: 0.24287797510623932 (0.24729363661673334) | > loss_disc_real_5: 0.1497197300195694 (0.15854219305846426) | > loss_0: 2.1319782733917236 (2.464971833758884) | > grad_norm_0: tensor(274.7632, device='cuda:0') (tensor(388.1791, device='cuda:0')) | > loss_gen: 2.722766399383545 (2.3509839640723333) | > loss_kl: 1.027758002281189 (1.4636061390240986) | > loss_feat: 7.016195297241211 (6.822714295652178) | > loss_mel: 30.38772201538086 (25.410000642140705) | > loss_duration: 1.7821638584136963 (1.8954155047734578) | > loss_1: 42.936607360839844 (37.94272083706326) | > grad_norm_1: tensor(13728.3105, device='cuda:0') (tensor(19888.9414, device='cuda:0')) | > current_lr_0: 0.00019408874276263664 | > current_lr_1: 0.00019408874276263664 | > step_time: 0.426 (0.3316234217749702) | > loader_time: 0.0078 (0.005699104732937283)  --> TIME: 2023-10-20 00:00:39 -- STEP: 39/50 -- GLOBAL_STEP: 54540 | > loss_disc: 2.8930439949035645 (2.6623840515430155) | > loss_disc_real_0: 0.1772499531507492 (0.18897094544118795) | > loss_disc_real_1: 0.2829638123512268 (0.2355813982968147) | > loss_disc_real_2: 0.2941521108150482 (0.2348714665724681) | > loss_disc_real_3: 0.28115329146385193 (0.2592661930964543) | > loss_disc_real_4: 0.2353750616312027 (0.2670400560093231) | > loss_disc_real_5: 0.2651621699333191 (0.24054460542706343) | > loss_0: 2.8930439949035645 (2.6623840515430155) | > grad_norm_0: tensor(474.9539, device='cuda:0') (tensor(503.6580, device='cuda:0')) | > loss_gen: 1.7882901430130005 (2.181315146959745) | > loss_kl: 1.272877812385559 (1.3276354173819225) | > loss_feat: 1.9707374572753906 (4.4773395258264665) | > loss_mel: 28.70218276977539 (23.40629898584806) | > loss_duration: 1.8795896768569946 (1.9338973546639466) | > loss_1: 35.613677978515625 (33.32648656307122) | > grad_norm_1: tensor(7550.4385, device='cuda:0') (tensor(15434.5098, device='cuda:0')) | > current_lr_0: 0.00019408874276263664 | > current_lr_1: 0.00019408874276263664 | > step_time: 0.5799 (0.4826777287018605) | > loader_time: 0.025 (0.01423036746489696)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2921345233917236 (3.2921345233917236) | > loss_disc_real_0: 0.2136097103357315 (0.2136097103357315) | > loss_disc_real_1: 0.23321881890296936 (0.23321881890296936) | > loss_disc_real_2: 0.2649431824684143 (0.2649431824684143) | > loss_disc_real_3: 0.349671334028244 (0.349671334028244) | > loss_disc_real_4: 0.34189632534980774 (0.34189632534980774) | > loss_disc_real_5: 0.6434687972068787 (0.6434687972068787) | > loss_0: 3.2921345233917236 (3.2921345233917236) | > loss_gen: 2.015130043029785 (2.015130043029785) | > loss_kl: 1.9334309101104736 (1.9334309101104736) | > loss_feat: 4.7687201499938965 (4.7687201499938965) | > loss_mel: 27.872962951660156 (27.872962951660156) | > loss_duration: 1.9616713523864746 (1.9616713523864746) | > loss_1: 38.55191421508789 (38.55191421508789)  --> STEP: 1 | > loss_disc: 1.7855173349380493 (1.7855173349380493) | > loss_disc_real_0: 0.12183904647827148 (0.12183904647827148) | > loss_disc_real_1: 0.22313806414604187 (0.22313806414604187) | > loss_disc_real_2: 0.19948793947696686 (0.19948793947696686) | > loss_disc_real_3: 0.19179292023181915 (0.19179292023181915) | > loss_disc_real_4: 0.07661019265651703 (0.07661019265651703) | > loss_disc_real_5: 0.06884633749723434 (0.06884633749723434) | > loss_0: 1.7855173349380493 (1.7855173349380493) | > loss_gen: 2.765160083770752 (2.765160083770752) | > loss_kl: 2.365807294845581 (2.365807294845581) | > loss_feat: 7.887118339538574 (7.887118339538574) | > loss_mel: 30.556011199951172 (30.556011199951172) | > loss_duration: 2.093679189682007 (2.093679189682007) | > loss_1: 45.66777420043945 (45.66777420043945)  --> STEP: 2 | > loss_disc: 2.8510563373565674 (2.3182868361473083) | > loss_disc_real_0: 0.2616256773471832 (0.19173236191272736) | > loss_disc_real_1: 0.16110947728157043 (0.19212377071380615) | > loss_disc_real_2: 0.3861139118671417 (0.2928009256720543) | > loss_disc_real_3: 0.2698170244693756 (0.23080497235059738) | > loss_disc_real_4: 0.30010148882865906 (0.18835584074258804) | > loss_disc_real_5: 0.3201597332954407 (0.1945030353963375) | > loss_0: 2.8510563373565674 (2.3182868361473083) | > loss_gen: 2.0842342376708984 (2.424697160720825) | > loss_kl: 1.844168782234192 (2.1049880385398865) | > loss_feat: 1.3866735696792603 (4.636895954608917) | > loss_mel: 23.903072357177734 (27.229541778564453) | > loss_duration: 2.008988380432129 (2.051333785057068) | > loss_1: 31.22713851928711 (38.44745635986328)  --> STEP: 3 | > loss_disc: 3.2525293827056885 (2.629701018333435) | > loss_disc_real_0: 0.4314804673194885 (0.2716483970483144) | > loss_disc_real_1: 0.24028678238391876 (0.20817810793717703) | > loss_disc_real_2: 0.27135568857192993 (0.2856525133053462) | > loss_disc_real_3: 0.13870306313037872 (0.20010433594385782) | > loss_disc_real_4: 0.27907031774520874 (0.2185939997434616) | > loss_disc_real_5: 0.16263307631015778 (0.18387971570094427) | > loss_0: 3.2525293827056885 (2.629701018333435) | > loss_gen: 2.00187611579895 (2.2837568124135337) | > loss_kl: 2.3149142265319824 (2.174963434537252) | > loss_feat: 4.5063629150390625 (4.593384941418965) | > loss_mel: 28.3465576171875 (27.6018803914388) | > loss_duration: 2.128364086151123 (2.0770105520884194) | > loss_1: 39.29807662963867 (38.730996449788414) --> EVAL PERFORMANCE | > avg_loader_time: 0.00854333241780599 (-0.002960125605265299) | > avg_loss_disc: 2.629701018333435 (+0.1824737787246704) | > avg_loss_disc_real_0: 0.2716483970483144 (+0.14542422816157338) | > avg_loss_disc_real_1: 0.20817810793717703 (+0.02368588000535965) | > avg_loss_disc_real_2: 0.2856525133053462 (+0.1169665778676669) | > avg_loss_disc_real_3: 0.20010433594385782 (-0.07368749380111697) | > avg_loss_disc_real_4: 0.2185939997434616 (-0.0020936181147893362) | > avg_loss_disc_real_5: 0.18387971570094427 (-0.04951444019873935) | > avg_loss_0: 2.629701018333435 (+0.1824737787246704) | > avg_loss_gen: 2.2837568124135337 (+0.00014225641886422835) | > avg_loss_kl: 2.174963434537252 (-0.12336989243825247) | > avg_loss_feat: 4.593384941418965 (-0.8345269759496059) | > avg_loss_mel: 27.6018803914388 (+1.0958035786946603) | > avg_loss_duration: 2.0770105520884194 (-0.03842083613077829) | > avg_loss_1: 38.730996449788414 (+0.09963099161784328)  > EPOCH: 31/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:00:54)   --> TIME: 2023-10-20 00:01:07 -- STEP: 19/50 -- GLOBAL_STEP: 54570 | > loss_disc: 2.7299246788024902 (2.5065840294486597) | > loss_disc_real_0: 0.1747244894504547 (0.17569445553970964) | > loss_disc_real_1: 0.2308986783027649 (0.256401427090168) | > loss_disc_real_2: 0.22558045387268066 (0.22021490806027463) | > loss_disc_real_3: 0.3426186740398407 (0.2542620524764061) | > loss_disc_real_4: 0.17031818628311157 (0.22409705180478723) | > loss_disc_real_5: 0.2823389172554016 (0.24212134727521947) | > loss_0: 2.7299246788024902 (2.5065840294486597) | > grad_norm_0: tensor(408.2295, device='cuda:0') (tensor(711.9979, device='cuda:0')) | > loss_gen: 2.029743194580078 (2.5107250150881315) | > loss_kl: 1.7989670038223267 (1.3684627601974888) | > loss_feat: 4.9438605308532715 (5.84478514680737) | > loss_mel: 26.514686584472656 (25.84765951257003) | > loss_duration: 2.076138496398926 (1.9718192690297176) | > loss_1: 37.36339569091797 (37.543451158623945) | > grad_norm_1: tensor(8742.5371, device='cuda:0') (tensor(18942.2812, device='cuda:0')) | > current_lr_0: 0.00019389473891247375 | > current_lr_1: 0.00019389473891247375 | > step_time: 0.3161 (0.4922446953622918) | > loader_time: 0.0248 (0.02127879544308311)  --> TIME: 2023-10-20 00:01:20 -- STEP: 49/50 -- GLOBAL_STEP: 54600 | > loss_disc: 2.8189210891723633 (2.5721672335449535) | > loss_disc_real_0: 0.41707342863082886 (0.18319982541154842) | > loss_disc_real_1: 0.30397558212280273 (0.25225884315310687) | > loss_disc_real_2: 0.19551874697208405 (0.22597380605887393) | > loss_disc_real_3: 0.17029275000095367 (0.24853496823687943) | > loss_disc_real_4: 0.3408369719982147 (0.22163637381579196) | > loss_disc_real_5: 0.2141953557729721 (0.2316722904465028) | > loss_0: 2.8189210891723633 (2.5721672335449535) | > grad_norm_0: tensor(882.1177, device='cuda:0') (tensor(664.7030, device='cuda:0')) | > loss_gen: 2.1458353996276855 (2.3217527525765553) | > loss_kl: 1.1053051948547363 (1.3352157947968464) | > loss_feat: 3.550511121749878 (5.011663738381574) | > loss_mel: 24.579181671142578 (25.183596148782847) | > loss_duration: 1.9978251457214355 (1.9133486115202611) | > loss_1: 33.378658294677734 (35.76557666428238) | > grad_norm_1: tensor(4699.9351, device='cuda:0') (tensor(19039.0996, device='cuda:0')) | > current_lr_0: 0.00019389473891247375 | > current_lr_1: 0.00019389473891247375 | > step_time: 0.4123 (0.4464792280781026) | > loader_time: 0.2212 (0.018282608110077533)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4726638793945312 (2.4726638793945312) | > loss_disc_real_0: 0.09963291138410568 (0.09963291138410568) | > loss_disc_real_1: 0.27447399497032166 (0.27447399497032166) | > loss_disc_real_2: 0.24363702535629272 (0.24363702535629272) | > loss_disc_real_3: 0.33326128125190735 (0.33326128125190735) | > loss_disc_real_4: 0.07660430669784546 (0.07660430669784546) | > loss_disc_real_5: 0.11436257511377335 (0.11436257511377335) | > loss_0: 2.4726638793945312 (2.4726638793945312) | > loss_gen: 2.050321340560913 (2.050321340560913) | > loss_kl: 2.0868985652923584 (2.0868985652923584) | > loss_feat: 9.123537063598633 (9.123537063598633) | > loss_mel: 29.224132537841797 (29.224132537841797) | > loss_duration: 1.9110256433486938 (1.9110256433486938) | > loss_1: 44.39591598510742 (44.39591598510742)  --> STEP: 1 | > loss_disc: 2.2640600204467773 (2.2640600204467773) | > loss_disc_real_0: 0.11730416864156723 (0.11730416864156723) | > loss_disc_real_1: 0.19384725391864777 (0.19384725391864777) | > loss_disc_real_2: 0.22455495595932007 (0.22455495595932007) | > loss_disc_real_3: 0.1771155297756195 (0.1771155297756195) | > loss_disc_real_4: 0.07598614692687988 (0.07598614692687988) | > loss_disc_real_5: 0.047756392508745193 (0.047756392508745193) | > loss_0: 2.2640600204467773 (2.2640600204467773) | > loss_gen: 2.1185457706451416 (2.1185457706451416) | > loss_kl: 1.958925485610962 (1.958925485610962) | > loss_feat: 6.370814800262451 (6.370814800262451) | > loss_mel: 28.13825798034668 (28.13825798034668) | > loss_duration: 1.978236436843872 (1.978236436843872) | > loss_1: 40.564781188964844 (40.564781188964844)  --> STEP: 2 | > loss_disc: 2.2948060035705566 (2.279433012008667) | > loss_disc_real_0: 0.04598341882228851 (0.08164379373192787) | > loss_disc_real_1: 0.06569384038448334 (0.12977054715156555) | > loss_disc_real_2: 0.07091250270605087 (0.14773372933268547) | > loss_disc_real_3: 0.1672738790512085 (0.172194704413414) | > loss_disc_real_4: 0.08549907058477402 (0.08074260875582695) | > loss_disc_real_5: 0.07398953288793564 (0.060872962698340416) | > loss_0: 2.2948060035705566 (2.279433012008667) | > loss_gen: 2.1702189445495605 (2.144382357597351) | > loss_kl: 2.235816478729248 (2.097370982170105) | > loss_feat: 12.40079402923584 (9.385804414749146) | > loss_mel: 27.874671936035156 (28.006464958190918) | > loss_duration: 1.9799541234970093 (1.9790952801704407) | > loss_1: 46.66145706176758 (43.61311912536621)  --> STEP: 3 | > loss_disc: 3.014322280883789 (2.5243961016337075) | > loss_disc_real_0: 0.15967504680156708 (0.1076542114218076) | > loss_disc_real_1: 0.28664278984069824 (0.18206129471460977) | > loss_disc_real_2: 0.32022854685783386 (0.20523200184106827) | > loss_disc_real_3: 0.3276255428791046 (0.22400498390197754) | > loss_disc_real_4: 0.34727028012275696 (0.16958516587813696) | > loss_disc_real_5: 0.31607282161712646 (0.14593958233793577) | > loss_0: 3.014322280883789 (2.5243961016337075) | > loss_gen: 1.8482862710952759 (2.045683662096659) | > loss_kl: 2.568697452545166 (2.2544798056284585) | > loss_feat: 0.3561936318874359 (6.375934153795242) | > loss_mel: 18.715360641479492 (24.909430185953777) | > loss_duration: 2.191781759262085 (2.0499907732009888) | > loss_1: 25.68031883239746 (37.63551902770996) --> EVAL PERFORMANCE | > avg_loader_time: 0.006123940149943034 (-0.002419392267862956) | > avg_loss_disc: 2.5243961016337075 (-0.10530491669972752) | > avg_loss_disc_real_0: 0.1076542114218076 (-0.1639941856265068) | > avg_loss_disc_real_1: 0.18206129471460977 (-0.02611681322256726) | > avg_loss_disc_real_2: 0.20523200184106827 (-0.08042051146427792) | > avg_loss_disc_real_3: 0.22400498390197754 (+0.02390064795811972) | > avg_loss_disc_real_4: 0.16958516587813696 (-0.04900883386532465) | > avg_loss_disc_real_5: 0.14593958233793577 (-0.0379401333630085) | > avg_loss_0: 2.5243961016337075 (-0.10530491669972752) | > avg_loss_gen: 2.045683662096659 (-0.23807315031687448) | > avg_loss_kl: 2.2544798056284585 (+0.07951637109120657) | > avg_loss_feat: 6.375934153795242 (+1.782549212376277) | > avg_loss_mel: 24.909430185953777 (-2.6924502054850237) | > avg_loss_duration: 2.0499907732009888 (-0.02701977888743068) | > avg_loss_1: 37.63551902770996 (-1.095477422078453)  > EPOCH: 32/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:01:30)   --> TIME: 2023-10-20 00:01:48 -- STEP: 29/50 -- GLOBAL_STEP: 54630 | > loss_disc: 3.0813710689544678 (2.6801104874446473) | > loss_disc_real_0: 0.32311147451400757 (0.23218212315234646) | > loss_disc_real_1: 0.2407236397266388 (0.23461362899377428) | > loss_disc_real_2: 0.31712672114372253 (0.23001385261786395) | > loss_disc_real_3: 0.3847157955169678 (0.23602265299394218) | > loss_disc_real_4: 0.3894725739955902 (0.24203958914711557) | > loss_disc_real_5: 0.3329761028289795 (0.25581093601368626) | > loss_0: 3.0813710689544678 (2.6801104874446473) | > grad_norm_0: tensor(192.0790, device='cuda:0') (tensor(477.8108, device='cuda:0')) | > loss_gen: 1.9142866134643555 (2.3320118065538074) | > loss_kl: 0.9017487168312073 (1.497760065670671) | > loss_feat: 0.06903471797704697 (4.846803924261496) | > loss_mel: 11.734421730041504 (25.30654972997205) | > loss_duration: 1.9636750221252441 (1.960797774380651) | > loss_1: 16.583166122436523 (35.94392345691549) | > grad_norm_1: tensor(18933.6602, device='cuda:0') (tensor(15958.3574, device='cuda:0')) | > current_lr_0: 0.00019370092898130556 | > current_lr_1: 0.00019370092898130556 | > step_time: 0.2916 (0.4889870183221225) | > loader_time: 0.0246 (0.021054687171146783)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.743680953979492 (2.743680953979492) | > loss_disc_real_0: 0.12904608249664307 (0.12904608249664307) | > loss_disc_real_1: 0.39021193981170654 (0.39021193981170654) | > loss_disc_real_2: 0.3634394705295563 (0.3634394705295563) | > loss_disc_real_3: 0.4144079387187958 (0.4144079387187958) | > loss_disc_real_4: 0.2904122471809387 (0.2904122471809387) | > loss_disc_real_5: 0.41161054372787476 (0.41161054372787476) | > loss_0: 2.743680953979492 (2.743680953979492) | > loss_gen: 2.6680262088775635 (2.6680262088775635) | > loss_kl: 1.4973957538604736 (1.4973957538604736) | > loss_feat: 3.217252731323242 (3.217252731323242) | > loss_mel: 28.641986846923828 (28.641986846923828) | > loss_duration: 1.9169143438339233 (1.9169143438339233) | > loss_1: 37.94157791137695 (37.94157791137695)  --> STEP: 1 | > loss_disc: 2.8928158283233643 (2.8928158283233643) | > loss_disc_real_0: 0.1908247321844101 (0.1908247321844101) | > loss_disc_real_1: 0.22655779123306274 (0.22655779123306274) | > loss_disc_real_2: 0.2969169020652771 (0.2969169020652771) | > loss_disc_real_3: 0.28247296810150146 (0.28247296810150146) | > loss_disc_real_4: 0.24978169798851013 (0.24978169798851013) | > loss_disc_real_5: 0.2454288750886917 (0.2454288750886917) | > loss_0: 2.8928158283233643 (2.8928158283233643) | > loss_gen: 1.6564515829086304 (1.6564515829086304) | > loss_kl: 2.249436616897583 (2.249436616897583) | > loss_feat: 1.4131989479064941 (1.4131989479064941) | > loss_mel: 10.13947582244873 (10.13947582244873) | > loss_duration: 2.047567367553711 (2.047567367553711) | > loss_1: 17.50613021850586 (17.50613021850586)  --> STEP: 2 | > loss_disc: 2.9241247177124023 (2.9084702730178833) | > loss_disc_real_0: 0.12027021497488022 (0.15554747357964516) | > loss_disc_real_1: 0.09504445642232895 (0.16080112382769585) | > loss_disc_real_2: 0.18875564634799957 (0.24283627420663834) | > loss_disc_real_3: 0.3628275692462921 (0.3226502686738968) | > loss_disc_real_4: 0.22365102171897888 (0.2367163598537445) | > loss_disc_real_5: 0.7141804099082947 (0.4798046424984932) | > loss_0: 2.9241247177124023 (2.9084702730178833) | > loss_gen: 2.2824974060058594 (1.9694744944572449) | > loss_kl: 1.6708927154541016 (1.9601646661758423) | > loss_feat: 7.148122310638428 (4.280660629272461) | > loss_mel: 27.90929412841797 (19.02438497543335) | > loss_duration: 1.9938923120498657 (2.0207298398017883) | > loss_1: 41.00469970703125 (29.255414962768555)  --> STEP: 3 | > loss_disc: 2.11719012260437 (2.6447102228800454) | > loss_disc_real_0: 0.14174610376358032 (0.15094701697429022) | > loss_disc_real_1: 0.18800079822540283 (0.16986768196026483) | > loss_disc_real_2: 0.3508031666278839 (0.27882523834705353) | > loss_disc_real_3: 0.3674577474594116 (0.33758609493573505) | > loss_disc_real_4: 0.2364175021648407 (0.2366167406241099) | > loss_disc_real_5: 0.11782572418451309 (0.35914500306049985) | > loss_0: 2.11719012260437 (2.6447102228800454) | > loss_gen: 3.096311569213867 (2.345086852709452) | > loss_kl: 1.8415436744689941 (1.9206243356068928) | > loss_feat: 5.096151351928711 (4.552490870157878) | > loss_mel: 24.2365665435791 (20.761778831481934) | > loss_duration: 2.130861282348633 (2.0574403206507363) | > loss_1: 36.40143585205078 (31.63742192586263) --> EVAL PERFORMANCE | > avg_loader_time: 0.008989651997884115 (+0.002865711847941081) | > avg_loss_disc: 2.6447102228800454 (+0.12031412124633789) | > avg_loss_disc_real_0: 0.15094701697429022 (+0.04329280555248262) | > avg_loss_disc_real_1: 0.16986768196026483 (-0.01219361275434494) | > avg_loss_disc_real_2: 0.27882523834705353 (+0.07359323650598526) | > avg_loss_disc_real_3: 0.33758609493573505 (+0.11358111103375751) | > avg_loss_disc_real_4: 0.2366167406241099 (+0.06703157474597293) | > avg_loss_disc_real_5: 0.35914500306049985 (+0.21320542072256407) | > avg_loss_0: 2.6447102228800454 (+0.12031412124633789) | > avg_loss_gen: 2.345086852709452 (+0.29940319061279297) | > avg_loss_kl: 1.9206243356068928 (-0.3338554700215657) | > avg_loss_feat: 4.552490870157878 (-1.8234432836373644) | > avg_loss_mel: 20.761778831481934 (-4.147651354471844) | > avg_loss_duration: 2.0574403206507363 (+0.007449547449747573) | > avg_loss_1: 31.63742192586263 (-5.998097101847332)  > EPOCH: 33/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:02:09)   --> TIME: 2023-10-20 00:02:17 -- STEP: 9/50 -- GLOBAL_STEP: 54660 | > loss_disc: 3.098679780960083 (2.099127623769972) | > loss_disc_real_0: 0.38565587997436523 (0.1479316506948736) | > loss_disc_real_1: 0.30140361189842224 (0.2283974008427726) | > loss_disc_real_2: 0.45141732692718506 (0.23288442525598738) | > loss_disc_real_3: 0.2691216766834259 (0.19601952615711424) | > loss_disc_real_4: 0.26837801933288574 (0.13113835743731922) | > loss_disc_real_5: 0.35413655638694763 (0.14446323654717869) | > loss_0: 3.098679780960083 (2.099127623769972) | > grad_norm_0: tensor(1524.2313, device='cuda:0') (tensor(546.8010, device='cuda:0')) | > loss_gen: 1.9731841087341309 (2.631403300497267) | > loss_kl: 1.3204954862594604 (1.3575591908560858) | > loss_feat: 0.29819416999816895 (7.471563405460781) | > loss_mel: 19.686084747314453 (27.0469364590115) | > loss_duration: 1.8090076446533203 (1.8893497652477689) | > loss_1: 25.08696746826172 (40.39681180318197) | > grad_norm_1: tensor(13671.1914, device='cuda:0') (tensor(25597.4785, device='cuda:0')) | > current_lr_0: 0.00019350731277529787 | > current_lr_1: 0.00019350731277529787 | > step_time: 0.676 (0.39472484588623047) | > loader_time: 0.022 (0.008204195234510634)  --> TIME: 2023-10-20 00:02:33 -- STEP: 39/50 -- GLOBAL_STEP: 54690 | > loss_disc: 2.816213369369507 (2.3082252740859985) | > loss_disc_real_0: 0.12903833389282227 (0.15546267326825702) | > loss_disc_real_1: 0.28725507855415344 (0.24798902028646225) | > loss_disc_real_2: 0.2369866520166397 (0.2183383776782415) | > loss_disc_real_3: 0.23289687931537628 (0.2288449614858016) | > loss_disc_real_4: 0.21509376168251038 (0.20338952166434282) | > loss_disc_real_5: 0.33194634318351746 (0.19927366660573545) | > loss_0: 2.816213369369507 (2.3082252740859985) | > grad_norm_0: tensor(351.3541, device='cuda:0') (tensor(535.1997, device='cuda:0')) | > loss_gen: 1.6610921621322632 (2.716532144791041) | > loss_kl: 1.0620834827423096 (1.3347319165865583) | > loss_feat: 0.6637231111526489 (6.675715684890747) | > loss_mel: 21.164522171020508 (27.761944599640675) | > loss_duration: 1.8980661630630493 (1.9181605577468872) | > loss_1: 26.449487686157227 (40.40708453838642) | > grad_norm_1: tensor(14458.6475, device='cuda:0') (tensor(22473.6016, device='cuda:0')) | > current_lr_0: 0.00019350731277529787 | > current_lr_1: 0.00019350731277529787 | > step_time: 0.5786 (0.4854743236150497) | > loader_time: 0.0248 (0.01378770363636506)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.924144744873047 (2.924144744873047) | > loss_disc_real_0: 0.1292591094970703 (0.1292591094970703) | > loss_disc_real_1: 0.4526960849761963 (0.4526960849761963) | > loss_disc_real_2: 0.3063073456287384 (0.3063073456287384) | > loss_disc_real_3: 0.48615434765815735 (0.48615434765815735) | > loss_disc_real_4: 0.3157104551792145 (0.3157104551792145) | > loss_disc_real_5: 0.44049930572509766 (0.44049930572509766) | > loss_0: 2.924144744873047 (2.924144744873047) | > loss_gen: 3.3015265464782715 (3.3015265464782715) | > loss_kl: 1.299351692199707 (1.299351692199707) | > loss_feat: 5.043545246124268 (5.043545246124268) | > loss_mel: 27.25327491760254 (27.25327491760254) | > loss_duration: 1.9893611669540405 (1.9893611669540405) | > loss_1: 38.88705825805664 (38.88705825805664)  --> STEP: 1 | > loss_disc: 2.084887742996216 (2.084887742996216) | > loss_disc_real_0: 0.041674260050058365 (0.041674260050058365) | > loss_disc_real_1: 0.1689944863319397 (0.1689944863319397) | > loss_disc_real_2: 0.2386704534292221 (0.2386704534292221) | > loss_disc_real_3: 0.1443510204553604 (0.1443510204553604) | > loss_disc_real_4: 0.09068530052900314 (0.09068530052900314) | > loss_disc_real_5: 0.09831473231315613 (0.09831473231315613) | > loss_0: 2.084887742996216 (2.084887742996216) | > loss_gen: 2.0517308712005615 (2.0517308712005615) | > loss_kl: 2.2819411754608154 (2.2819411754608154) | > loss_feat: 9.15731143951416 (9.15731143951416) | > loss_mel: 29.813138961791992 (29.813138961791992) | > loss_duration: 2.009902238845825 (2.009902238845825) | > loss_1: 45.31402587890625 (45.31402587890625)  --> STEP: 2 | > loss_disc: 2.069826126098633 (2.0773569345474243) | > loss_disc_real_0: 0.08732003718614578 (0.06449714861810207) | > loss_disc_real_1: 0.36159712076187134 (0.2652958035469055) | > loss_disc_real_2: 0.12806913256645203 (0.18336979299783707) | > loss_disc_real_3: 0.07985100895166397 (0.11210101470351219) | > loss_disc_real_4: 0.058714233338832855 (0.074699766933918) | > loss_disc_real_5: 0.3351355791091919 (0.216725155711174) | > loss_0: 2.069826126098633 (2.0773569345474243) | > loss_gen: 2.376901865005493 (2.2143163681030273) | > loss_kl: 2.2790687084198 (2.2805049419403076) | > loss_feat: 12.969015121459961 (11.06316328048706) | > loss_mel: 31.477136611938477 (30.645137786865234) | > loss_duration: 2.0568559169769287 (2.033379077911377) | > loss_1: 51.15897750854492 (48.236501693725586)  --> STEP: 3 | > loss_disc: 2.60402512550354 (2.252912998199463) | > loss_disc_real_0: 0.07268643379211426 (0.0672269103427728) | > loss_disc_real_1: 0.25600552558898926 (0.2621990442276001) | > loss_disc_real_2: 0.16423822939395905 (0.17699260512987772) | > loss_disc_real_3: 0.36662065982818604 (0.19694089641173682) | > loss_disc_real_4: 0.2736286222934723 (0.14100938538710275) | > loss_disc_real_5: 0.2260492444038391 (0.21983318527539572) | > loss_0: 2.60402512550354 (2.252912998199463) | > loss_gen: 1.8902239799499512 (2.106285572052002) | > loss_kl: 1.100550889968872 (1.8871869246164958) | > loss_feat: 1.8542989492416382 (7.993541836738586) | > loss_mel: 21.909509658813477 (27.733261744181316) | > loss_duration: 2.094373941421509 (2.053710699081421) | > loss_1: 28.848957061767578 (41.77398681640625) --> EVAL PERFORMANCE | > avg_loader_time: 0.003941535949707031 (-0.005048116048177084) | > avg_loss_disc: 2.252912998199463 (-0.39179722468058253) | > avg_loss_disc_real_0: 0.0672269103427728 (-0.08372010663151742) | > avg_loss_disc_real_1: 0.2621990442276001 (+0.09233136226733527) | > avg_loss_disc_real_2: 0.17699260512987772 (-0.10183263321717581) | > avg_loss_disc_real_3: 0.19694089641173682 (-0.14064519852399823) | > avg_loss_disc_real_4: 0.14100938538710275 (-0.09560735523700714) | > avg_loss_disc_real_5: 0.21983318527539572 (-0.13931181778510413) | > avg_loss_0: 2.252912998199463 (-0.39179722468058253) | > avg_loss_gen: 2.106285572052002 (-0.2388012806574502) | > avg_loss_kl: 1.8871869246164958 (-0.03343741099039699) | > avg_loss_feat: 7.993541836738586 (+3.4410509665807085) | > avg_loss_mel: 27.733261744181316 (+6.971482912699383) | > avg_loss_duration: 2.053710699081421 (-0.0037296215693154444) | > avg_loss_1: 41.77398681640625 (+10.136564890543621)  > EPOCH: 34/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:02:46)   --> TIME: 2023-10-20 00:03:00 -- STEP: 19/50 -- GLOBAL_STEP: 54720 | > loss_disc: 2.1298093795776367 (2.5731793516560604) | > loss_disc_real_0: 0.09666495025157928 (0.16976423041993066) | > loss_disc_real_1: 0.23072762787342072 (0.2596253780157943) | > loss_disc_real_2: 0.2510066330432892 (0.20944732937373614) | > loss_disc_real_3: 0.1754208654165268 (0.26191739816414694) | > loss_disc_real_4: 0.08271891623735428 (0.24482909237083636) | > loss_disc_real_5: 0.0656542256474495 (0.21262336767425663) | > loss_0: 2.1298093795776367 (2.5731793516560604) | > grad_norm_0: tensor(437.0363, device='cuda:0') (tensor(874.3890, device='cuda:0')) | > loss_gen: 2.737211227416992 (2.3435012666802657) | > loss_kl: 1.1906644105911255 (1.3209104945785122) | > loss_feat: 6.220804214477539 (4.501654617684452) | > loss_mel: 27.145105361938477 (24.947877105913665) | > loss_duration: 2.0763041973114014 (1.9666202883971364) | > loss_1: 39.37009048461914 (35.08056389658075) | > grad_norm_1: tensor(26180.1211, device='cuda:0') (tensor(20147.0938, device='cuda:0')) | > current_lr_0: 0.0001933138901008103 | > current_lr_1: 0.0001933138901008103 | > step_time: 0.2853 (0.48799984078658254) | > loader_time: 0.0249 (0.01928727250350149)  --> TIME: 2023-10-20 00:03:12 -- STEP: 49/50 -- GLOBAL_STEP: 54750 | > loss_disc: 2.53194522857666 (2.539902390265952) | > loss_disc_real_0: 0.1935708224773407 (0.1918579833391978) | > loss_disc_real_1: 0.30602389574050903 (0.24642333099428493) | > loss_disc_real_2: 0.23373574018478394 (0.21935778863880098) | > loss_disc_real_3: 0.3443374037742615 (0.24482285512649282) | > loss_disc_real_4: 0.22350086271762848 (0.223701058715886) | > loss_disc_real_5: 0.22079850733280182 (0.20361377002329242) | > loss_0: 2.53194522857666 (2.539902390265952) | > grad_norm_0: tensor(689.9705, device='cuda:0') (tensor(714.3138, device='cuda:0')) | > loss_gen: 2.3425488471984863 (2.335299370240192) | > loss_kl: 1.203033447265625 (1.2893613272783708) | > loss_feat: 1.991204023361206 (4.516795179521552) | > loss_mel: 25.358802795410156 (23.911364482373607) | > loss_duration: 2.021672248840332 (1.9201717644321674) | > loss_1: 32.917259216308594 (33.97299230342009) | > grad_norm_1: tensor(8350.3164, device='cuda:0') (tensor(16952.6289, device='cuda:0')) | > current_lr_0: 0.0001933138901008103 | > current_lr_1: 0.0001933138901008103 | > step_time: 0.4741 (0.4395416902036083) | > loader_time: 0.2068 (0.016222642392528304)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1938979625701904 (3.1938979625701904) | > loss_disc_real_0: 0.43777740001678467 (0.43777740001678467) | > loss_disc_real_1: 0.33320629596710205 (0.33320629596710205) | > loss_disc_real_2: 0.3367650806903839 (0.3367650806903839) | > loss_disc_real_3: 0.32383260130882263 (0.32383260130882263) | > loss_disc_real_4: 0.2903827130794525 (0.2903827130794525) | > loss_disc_real_5: 0.24144376814365387 (0.24144376814365387) | > loss_0: 3.1938979625701904 (3.1938979625701904) | > loss_gen: 2.0646185874938965 (2.0646185874938965) | > loss_kl: 2.040675163269043 (2.040675163269043) | > loss_feat: 1.044237732887268 (1.044237732887268) | > loss_mel: 20.05773162841797 (20.05773162841797) | > loss_duration: 1.9049535989761353 (1.9049535989761353) | > loss_1: 27.11221694946289 (27.11221694946289)  --> STEP: 1 | > loss_disc: 2.2265148162841797 (2.2265148162841797) | > loss_disc_real_0: 0.2766627073287964 (0.2766627073287964) | > loss_disc_real_1: 0.16896793246269226 (0.16896793246269226) | > loss_disc_real_2: 0.1553996503353119 (0.1553996503353119) | > loss_disc_real_3: 0.35281509160995483 (0.35281509160995483) | > loss_disc_real_4: 0.3119358718395233 (0.3119358718395233) | > loss_disc_real_5: 0.2962104082107544 (0.2962104082107544) | > loss_0: 2.2265148162841797 (2.2265148162841797) | > loss_gen: 3.270703077316284 (3.270703077316284) | > loss_kl: 2.3495981693267822 (2.3495981693267822) | > loss_feat: 7.2634758949279785 (7.2634758949279785) | > loss_mel: 27.126646041870117 (27.126646041870117) | > loss_duration: 2.0302865505218506 (2.0302865505218506) | > loss_1: 42.040706634521484 (42.040706634521484)  --> STEP: 2 | > loss_disc: 3.5373549461364746 (2.881934881210327) | > loss_disc_real_0: 0.36554500460624695 (0.32110385596752167) | > loss_disc_real_1: 0.1405409872531891 (0.15475445985794067) | > loss_disc_real_2: 0.32103782892227173 (0.2382187396287918) | > loss_disc_real_3: 0.14864268898963928 (0.25072889029979706) | > loss_disc_real_4: 0.5664781928062439 (0.4392070323228836) | > loss_disc_real_5: 0.9791216254234314 (0.6376660168170929) | > loss_0: 3.5373549461364746 (2.881934881210327) | > loss_gen: 2.8644323348999023 (3.0675677061080933) | > loss_kl: 1.8371472358703613 (2.0933727025985718) | > loss_feat: 9.858447074890137 (8.560961484909058) | > loss_mel: 31.224994659423828 (29.175820350646973) | > loss_duration: 2.0281097888946533 (2.029198169708252) | > loss_1: 47.813133239746094 (44.92691993713379)  --> STEP: 3 | > loss_disc: 2.9361462593078613 (2.900005340576172) | > loss_disc_real_0: 0.24258296191692352 (0.29493022461732227) | > loss_disc_real_1: 0.3187411427497864 (0.2094166874885559) | > loss_disc_real_2: 0.31862714886665344 (0.26502154270807904) | > loss_disc_real_3: 0.3039695620536804 (0.26847578088442486) | > loss_disc_real_4: 0.025627827271819115 (0.3013472973058621) | > loss_disc_real_5: 0.35941052436828613 (0.544914186000824) | > loss_0: 2.9361462593078613 (2.900005340576172) | > loss_gen: 2.9709959030151367 (3.035377105077108) | > loss_kl: 0.7366135716438293 (1.641119658946991) | > loss_feat: 7.7656145095825195 (8.295845826466879) | > loss_mel: 30.483152389526367 (29.611597696940105) | > loss_duration: 2.056558132171631 (2.038318157196045) | > loss_1: 44.012935638427734 (44.62225850423177) --> EVAL PERFORMANCE | > avg_loader_time: 0.013881365458170572 (+0.009939829508463541) | > avg_loss_disc: 2.900005340576172 (+0.647092342376709) | > avg_loss_disc_real_0: 0.29493022461732227 (+0.22770331427454948) | > avg_loss_disc_real_1: 0.2094166874885559 (-0.05278235673904419) | > avg_loss_disc_real_2: 0.26502154270807904 (+0.08802893757820132) | > avg_loss_disc_real_3: 0.26847578088442486 (+0.07153488447268805) | > avg_loss_disc_real_4: 0.3013472973058621 (+0.16033791191875937) | > avg_loss_disc_real_5: 0.544914186000824 (+0.3250810007254282) | > avg_loss_0: 2.900005340576172 (+0.647092342376709) | > avg_loss_gen: 3.035377105077108 (+0.9290915330251059) | > avg_loss_kl: 1.641119658946991 (-0.24606726566950488) | > avg_loss_feat: 8.295845826466879 (+0.3023039897282924) | > avg_loss_mel: 29.611597696940105 (+1.878335952758789) | > avg_loss_duration: 2.038318157196045 (-0.015392541885375977) | > avg_loss_1: 44.62225850423177 (+2.848271687825523)  > EPOCH: 35/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:03:24)   --> TIME: 2023-10-20 00:03:43 -- STEP: 29/50 -- GLOBAL_STEP: 54780 | > loss_disc: 3.295119285583496 (2.713923170648772) | > loss_disc_real_0: 0.09973669052124023 (0.1983132073334579) | > loss_disc_real_1: 0.2805020213127136 (0.22231219593307067) | > loss_disc_real_2: 0.26150593161582947 (0.2504219859838487) | > loss_disc_real_3: 0.1320551484823227 (0.23161651618007956) | > loss_disc_real_4: 0.15933769941329956 (0.2491715238269033) | > loss_disc_real_5: 0.5329699516296387 (0.2629345001588607) | > loss_0: 3.295119285583496 (2.713923170648772) | > grad_norm_0: tensor(505.5379, device='cuda:0') (tensor(574.4219, device='cuda:0')) | > loss_gen: 2.013664722442627 (2.368819919125787) | > loss_kl: 1.1338783502578735 (1.3173658005122482) | > loss_feat: 6.052416801452637 (6.190644658331213) | > loss_mel: 27.92140769958496 (25.315651392114574) | > loss_duration: 1.9504828453063965 (1.961360820408525) | > loss_1: 39.07184982299805 (37.153842514958875) | > grad_norm_1: tensor(9491.7432, device='cuda:0') (tensor(19188.5508, device='cuda:0')) | > current_lr_0: 0.00019312066076439597 | > current_lr_1: 0.00019312066076439597 | > step_time: 0.6203 (0.5219360137807911) | > loader_time: 0.0114 (0.017008107284019733)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0299108028411865 (3.0299108028411865) | > loss_disc_real_0: 0.3129730820655823 (0.3129730820655823) | > loss_disc_real_1: 0.21318578720092773 (0.21318578720092773) | > loss_disc_real_2: 0.3163216710090637 (0.3163216710090637) | > loss_disc_real_3: 0.4636843204498291 (0.4636843204498291) | > loss_disc_real_4: 0.3587901294231415 (0.3587901294231415) | > loss_disc_real_5: 0.3614985942840576 (0.3614985942840576) | > loss_0: 3.0299108028411865 (3.0299108028411865) | > loss_gen: 2.250640392303467 (2.250640392303467) | > loss_kl: 1.5462359189987183 (1.5462359189987183) | > loss_feat: 5.588762283325195 (5.588762283325195) | > loss_mel: 23.853796005249023 (23.853796005249023) | > loss_duration: 1.9506205320358276 (1.9506205320358276) | > loss_1: 35.1900520324707 (35.1900520324707)  --> STEP: 1 | > loss_disc: 1.9095373153686523 (1.9095373153686523) | > loss_disc_real_0: 0.18719089031219482 (0.18719089031219482) | > loss_disc_real_1: 0.20198364555835724 (0.20198364555835724) | > loss_disc_real_2: 0.18166090548038483 (0.18166090548038483) | > loss_disc_real_3: 0.16174694895744324 (0.16174694895744324) | > loss_disc_real_4: 0.20350445806980133 (0.20350445806980133) | > loss_disc_real_5: 0.06649670749902725 (0.06649670749902725) | > loss_0: 1.9095373153686523 (1.9095373153686523) | > loss_gen: 2.5178680419921875 (2.5178680419921875) | > loss_kl: 2.6287667751312256 (2.6287667751312256) | > loss_feat: 6.4087066650390625 (6.4087066650390625) | > loss_mel: 25.87432861328125 (25.87432861328125) | > loss_duration: 2.047548770904541 (2.047548770904541) | > loss_1: 39.47722244262695 (39.47722244262695)  --> STEP: 2 | > loss_disc: 3.0393753051757812 (2.474456310272217) | > loss_disc_real_0: 0.3293575644493103 (0.25827422738075256) | > loss_disc_real_1: 0.24175919592380524 (0.22187142074108124) | > loss_disc_real_2: 0.239818274974823 (0.2107395902276039) | > loss_disc_real_3: 0.36960700154304504 (0.26567697525024414) | > loss_disc_real_4: 0.2194334864616394 (0.21146897226572037) | > loss_disc_real_5: 0.23614050447940826 (0.15131860598921776) | > loss_0: 3.0393753051757812 (2.474456310272217) | > loss_gen: 1.6552830934524536 (2.0865755677223206) | > loss_kl: 1.485984444618225 (2.0573756098747253) | > loss_feat: 1.138136625289917 (3.7734216451644897) | > loss_mel: 26.627267837524414 (26.250798225402832) | > loss_duration: 2.0312442779541016 (2.0393965244293213) | > loss_1: 32.93791580200195 (36.20756912231445)  --> STEP: 3 | > loss_disc: 2.3827719688415527 (2.443894863128662) | > loss_disc_real_0: 0.25735899806022644 (0.2579691509405772) | > loss_disc_real_1: 0.21855078637599945 (0.2207645426193873) | > loss_disc_real_2: 0.18004630506038666 (0.20050849517186484) | > loss_disc_real_3: 0.31322064995765686 (0.2815248668193817) | > loss_disc_real_4: 0.12348862737417221 (0.18214219063520432) | > loss_disc_real_5: 0.08105701953172684 (0.1278980771700541) | > loss_0: 2.3827719688415527 (2.443894863128662) | > loss_gen: 1.9480299949645996 (2.0403937101364136) | > loss_kl: 1.3087693452835083 (1.8078401883443196) | > loss_feat: 3.02138614654541 (3.5227431456247964) | > loss_mel: 25.769325256347656 (26.090307235717773) | > loss_duration: 2.068077325820923 (2.048956791559855) | > loss_1: 34.11558532714844 (35.510241190592446) --> EVAL PERFORMANCE | > avg_loader_time: 0.017214536666870117 (+0.003333171208699545) | > avg_loss_disc: 2.443894863128662 (-0.45611047744750977) | > avg_loss_disc_real_0: 0.2579691509405772 (-0.03696107367674506) | > avg_loss_disc_real_1: 0.2207645426193873 (+0.011347855130831391) | > avg_loss_disc_real_2: 0.20050849517186484 (-0.0645130475362142) | > avg_loss_disc_real_3: 0.2815248668193817 (+0.01304908593495685) | > avg_loss_disc_real_4: 0.18214219063520432 (-0.11920510667065781) | > avg_loss_disc_real_5: 0.1278980771700541 (-0.4170161088307699) | > avg_loss_0: 2.443894863128662 (-0.45611047744750977) | > avg_loss_gen: 2.0403937101364136 (-0.9949833949406943) | > avg_loss_kl: 1.8078401883443196 (+0.16672052939732862) | > avg_loss_feat: 3.5227431456247964 (-4.773102680842083) | > avg_loss_mel: 26.090307235717773 (-3.521290461222332) | > avg_loss_duration: 2.048956791559855 (+0.010638634363810073) | > avg_loss_1: 35.510241190592446 (-9.112017313639328)  > EPOCH: 36/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:04:03)   --> TIME: 2023-10-20 00:04:10 -- STEP: 9/50 -- GLOBAL_STEP: 54810 | > loss_disc: 2.738818645477295 (2.8330908351474338) | > loss_disc_real_0: 0.2191736400127411 (0.27275753973258865) | > loss_disc_real_1: 0.3384206295013428 (0.26498088737328845) | > loss_disc_real_2: 0.33278948068618774 (0.2518261588282055) | > loss_disc_real_3: 0.23612689971923828 (0.23983088963561588) | > loss_disc_real_4: 0.31315892934799194 (0.3809867832395766) | > loss_disc_real_5: 0.26706409454345703 (0.266857896414068) | > loss_0: 2.738818645477295 (2.8330908351474338) | > grad_norm_0: tensor(557.8779, device='cuda:0') (tensor(761.0182, device='cuda:0')) | > loss_gen: 2.3867039680480957 (2.45716216829088) | > loss_kl: 1.4244771003723145 (1.2464984920289781) | > loss_feat: 5.605727195739746 (5.090465241008335) | > loss_mel: 25.806913375854492 (23.767010158962673) | > loss_duration: 1.7826473712921143 (1.8554208411110773) | > loss_1: 37.006465911865234 (34.41655667622884) | > grad_norm_1: tensor(8793.1367, device='cuda:0') (tensor(20605.8203, device='cuda:0')) | > current_lr_0: 0.00019292762457280132 | > current_lr_1: 0.00019292762457280132 | > step_time: 0.2767 (0.3615350193447537) | > loader_time: 0.0216 (0.008689191606309678)  --> TIME: 2023-10-20 00:04:23 -- STEP: 39/50 -- GLOBAL_STEP: 54840 | > loss_disc: 2.5215675830841064 (2.731169819831848) | > loss_disc_real_0: 0.1618691384792328 (0.21791870041917533) | > loss_disc_real_1: 0.1723925769329071 (0.23648342662132704) | > loss_disc_real_2: 0.1423288732767105 (0.22026272089435503) | > loss_disc_real_3: 0.2613338828086853 (0.24186609928997663) | > loss_disc_real_4: 0.26838186383247375 (0.2883297852598705) | > loss_disc_real_5: 0.17380917072296143 (0.2766651220810719) | > loss_0: 2.5215675830841064 (2.731169819831848) | > grad_norm_0: tensor(333.6982, device='cuda:0') (tensor(601.6031, device='cuda:0')) | > loss_gen: 1.934544324874878 (2.39715489363059) | > loss_kl: 0.8418362140655518 (1.2959610926799285) | > loss_feat: 2.467664957046509 (4.83570685218542) | > loss_mel: 27.408361434936523 (25.386746369875393) | > loss_duration: 1.9096261262893677 (1.8986952671637902) | > loss_1: 34.562034606933594 (35.81426493326823) | > grad_norm_1: tensor(7449.3735, device='cuda:0') (tensor(19430.5059, device='cuda:0')) | > current_lr_0: 0.00019292762457280132 | > current_lr_1: 0.00019292762457280132 | > step_time: 0.2672 (0.4099114307990441) | > loader_time: 0.0024 (0.009047453220073994)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8523831367492676 (2.8523831367492676) | > loss_disc_real_0: 0.1964617669582367 (0.1964617669582367) | > loss_disc_real_1: 0.1449851095676422 (0.1449851095676422) | > loss_disc_real_2: 0.1397761106491089 (0.1397761106491089) | > loss_disc_real_3: 0.33622482419013977 (0.33622482419013977) | > loss_disc_real_4: 0.11873728036880493 (0.11873728036880493) | > loss_disc_real_5: 0.3383972644805908 (0.3383972644805908) | > loss_0: 2.8523831367492676 (2.8523831367492676) | > loss_gen: 1.8184716701507568 (1.8184716701507568) | > loss_kl: 2.319672107696533 (2.319672107696533) | > loss_feat: 4.706357002258301 (4.706357002258301) | > loss_mel: 32.134986877441406 (32.134986877441406) | > loss_duration: 1.905472755432129 (1.905472755432129) | > loss_1: 42.88495635986328 (42.88495635986328)  --> STEP: 1 | > loss_disc: 2.9203853607177734 (2.9203853607177734) | > loss_disc_real_0: 0.17122092843055725 (0.17122092843055725) | > loss_disc_real_1: 0.26977989077568054 (0.26977989077568054) | > loss_disc_real_2: 0.2550852596759796 (0.2550852596759796) | > loss_disc_real_3: 0.295619398355484 (0.295619398355484) | > loss_disc_real_4: 0.2654516398906708 (0.2654516398906708) | > loss_disc_real_5: 0.2927505373954773 (0.2927505373954773) | > loss_0: 2.9203853607177734 (2.9203853607177734) | > loss_gen: 1.7851922512054443 (1.7851922512054443) | > loss_kl: 2.237537384033203 (2.237537384033203) | > loss_feat: 2.1244349479675293 (2.1244349479675293) | > loss_mel: 26.052452087402344 (26.052452087402344) | > loss_duration: 2.0188403129577637 (2.0188403129577637) | > loss_1: 34.21845626831055 (34.21845626831055)  --> STEP: 2 | > loss_disc: 3.0448455810546875 (2.9826154708862305) | > loss_disc_real_0: 0.21729296445846558 (0.1942569464445114) | > loss_disc_real_1: 0.31046125292778015 (0.29012057185173035) | > loss_disc_real_2: 0.33133676648139954 (0.2932110130786896) | > loss_disc_real_3: 0.2464921921491623 (0.27105579525232315) | > loss_disc_real_4: 0.19961236417293549 (0.23253200203180313) | > loss_disc_real_5: 0.24312566220760345 (0.2679380998015404) | > loss_0: 3.0448455810546875 (2.9826154708862305) | > loss_gen: 1.5378012657165527 (1.6614967584609985) | > loss_kl: 1.9390804767608643 (2.0883089303970337) | > loss_feat: 0.06932497769594193 (1.0968799628317356) | > loss_mel: 4.900216102600098 (15.47633409500122) | > loss_duration: 2.0745418071746826 (2.046691060066223) | > loss_1: 10.520964622497559 (22.369710445404053)  --> STEP: 3 | > loss_disc: 2.0177690982818604 (2.6610000133514404) | > loss_disc_real_0: 0.11687790602445602 (0.1684639329711596) | > loss_disc_real_1: 0.20440039038658142 (0.26154717803001404) | > loss_disc_real_2: 0.09190553426742554 (0.22610918680826822) | > loss_disc_real_3: 0.214277982711792 (0.25212985773881275) | > loss_disc_real_4: 0.2956443428993225 (0.25356944898764294) | > loss_disc_real_5: 0.24801777303218842 (0.26129799087842304) | > loss_0: 2.0177690982818604 (2.6610000133514404) | > loss_gen: 2.585785150527954 (1.9695928891499836) | > loss_kl: 1.077380895614624 (1.7513329188028972) | > loss_feat: 5.568666458129883 (2.5874754612644515) | > loss_mel: 25.597257614135742 (18.849975268046062) | > loss_duration: 2.0576388835906982 (2.0503403345743814) | > loss_1: 36.8867301940918 (27.20871702829997) --> EVAL PERFORMANCE | > avg_loader_time: 0.011249383290608725 (-0.005965153376261393) | > avg_loss_disc: 2.6610000133514404 (+0.21710515022277832) | > avg_loss_disc_real_0: 0.1684639329711596 (-0.0895052179694176) | > avg_loss_disc_real_1: 0.26154717803001404 (+0.04078263541062674) | > avg_loss_disc_real_2: 0.22610918680826822 (+0.025600691636403383) | > avg_loss_disc_real_3: 0.25212985773881275 (-0.029395009080568968) | > avg_loss_disc_real_4: 0.25356944898764294 (+0.07142725835243863) | > avg_loss_disc_real_5: 0.26129799087842304 (+0.13339991370836893) | > avg_loss_0: 2.6610000133514404 (+0.21710515022277832) | > avg_loss_gen: 1.9695928891499836 (-0.07080082098642992) | > avg_loss_kl: 1.7513329188028972 (-0.05650726954142238) | > avg_loss_feat: 2.5874754612644515 (-0.9352676843603449) | > avg_loss_mel: 18.849975268046062 (-7.240331967671711) | > avg_loss_duration: 2.0503403345743814 (+0.0013835430145263672) | > avg_loss_1: 27.20871702829997 (-8.301524162292477)  > EPOCH: 37/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:04:37)   --> TIME: 2023-10-20 00:04:51 -- STEP: 19/50 -- GLOBAL_STEP: 54870 | > loss_disc: 3.189467430114746 (2.643746859148929) | > loss_disc_real_0: 0.2914922535419464 (0.19275089627818057) | > loss_disc_real_1: 0.3457300364971161 (0.25264747519242137) | > loss_disc_real_2: 0.39179813861846924 (0.2381632645663462) | > loss_disc_real_3: 0.2854457199573517 (0.2591553295129223) | > loss_disc_real_4: 0.3287268877029419 (0.23500401007109567) | > loss_disc_real_5: 0.3903781473636627 (0.260083698324467) | > loss_0: 3.189467430114746 (2.643746859148929) | > grad_norm_0: tensor(414.2896, device='cuda:0') (tensor(365.1960, device='cuda:0')) | > loss_gen: 2.0438742637634277 (2.193633612833525) | > loss_kl: 1.4678443670272827 (1.341900022406327) | > loss_feat: 1.897810459136963 (4.263949583823743) | > loss_mel: 26.65167236328125 (26.62521834122507) | > loss_duration: 2.1157827377319336 (1.9495656804034585) | > loss_1: 34.17698287963867 (36.37426687541761) | > grad_norm_1: tensor(3993.2854, device='cuda:0') (tensor(14106.0859, device='cuda:0')) | > current_lr_0: 0.00019273478133296606 | > current_lr_1: 0.00019273478133296606 | > step_time: 0.3048 (0.5155387928611355) | > loader_time: 0.0257 (0.017148670397306744)  --> TIME: 2023-10-20 00:05:06 -- STEP: 49/50 -- GLOBAL_STEP: 54900 | > loss_disc: 2.13608980178833 (2.5912287843470665) | > loss_disc_real_0: 0.07433866709470749 (0.17410131513464208) | > loss_disc_real_1: 0.06790532916784286 (0.23372640627987532) | > loss_disc_real_2: 0.08366817981004715 (0.22780346786793398) | > loss_disc_real_3: 0.2629345953464508 (0.26299264034902564) | > loss_disc_real_4: 0.035401202738285065 (0.23155146362069917) | > loss_disc_real_5: 0.007935067638754845 (0.22813474253884383) | > loss_0: 2.13608980178833 (2.5912287843470665) | > grad_norm_0: tensor(1131.1010, device='cuda:0') (tensor(400.1208, device='cuda:0')) | > loss_gen: 2.573645830154419 (2.1874071310977548) | > loss_kl: 0.8450186848640442 (1.223462491619344) | > loss_feat: 7.393909931182861 (4.32216911968224) | > loss_mel: 33.23102951049805 (23.852712986420613) | > loss_duration: 1.9594600200653076 (1.9056012168222545) | > loss_1: 46.00306701660156 (33.49135248028501) | > grad_norm_1: tensor(12300.2021, device='cuda:0') (tensor(13682.8252, device='cuda:0')) | > current_lr_0: 0.00019273478133296606 | > current_lr_1: 0.00019273478133296606 | > step_time: 0.3707 (0.491789905392394) | > loader_time: 0.2027 (0.02026695621256926)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8009021282196045 (2.8009021282196045) | > loss_disc_real_0: 0.26889851689338684 (0.26889851689338684) | > loss_disc_real_1: 0.325309693813324 (0.325309693813324) | > loss_disc_real_2: 0.33383962512016296 (0.33383962512016296) | > loss_disc_real_3: 0.25220030546188354 (0.25220030546188354) | > loss_disc_real_4: 0.191160187125206 (0.191160187125206) | > loss_disc_real_5: 0.20271217823028564 (0.20271217823028564) | > loss_0: 2.8009021282196045 (2.8009021282196045) | > loss_gen: 1.9041006565093994 (1.9041006565093994) | > loss_kl: 1.4475706815719604 (1.4475706815719604) | > loss_feat: 0.9706786274909973 (0.9706786274909973) | > loss_mel: 21.472074508666992 (21.472074508666992) | > loss_duration: 1.9097036123275757 (1.9097036123275757) | > loss_1: 27.70412826538086 (27.70412826538086)  --> STEP: 1 | > loss_disc: 2.099917411804199 (2.099917411804199) | > loss_disc_real_0: 0.0667666643857956 (0.0667666643857956) | > loss_disc_real_1: 0.2580229938030243 (0.2580229938030243) | > loss_disc_real_2: 0.14739173650741577 (0.14739173650741577) | > loss_disc_real_3: 0.20403064787387848 (0.20403064787387848) | > loss_disc_real_4: 0.19355547428131104 (0.19355547428131104) | > loss_disc_real_5: 0.11902152746915817 (0.11902152746915817) | > loss_0: 2.099917411804199 (2.099917411804199) | > loss_gen: 2.1926229000091553 (2.1926229000091553) | > loss_kl: 2.6892101764678955 (2.6892101764678955) | > loss_feat: 5.092979907989502 (5.092979907989502) | > loss_mel: 27.14052963256836 (27.14052963256836) | > loss_duration: 2.1193299293518066 (2.1193299293518066) | > loss_1: 39.234676361083984 (39.234676361083984)  --> STEP: 2 | > loss_disc: 2.6128971576690674 (2.3564072847366333) | > loss_disc_real_0: 0.5722557306289673 (0.31951119750738144) | > loss_disc_real_1: 0.20121842622756958 (0.22962071001529694) | > loss_disc_real_2: 0.422158420085907 (0.2847750782966614) | > loss_disc_real_3: 0.18063725531101227 (0.19233395159244537) | > loss_disc_real_4: 0.25131845474243164 (0.22243696451187134) | > loss_disc_real_5: 0.19561472535133362 (0.1573181264102459) | > loss_0: 2.6128971576690674 (2.3564072847366333) | > loss_gen: 3.572554349899292 (2.8825886249542236) | > loss_kl: 1.7793376445770264 (2.234273910522461) | > loss_feat: 9.162978172302246 (7.127979040145874) | > loss_mel: 29.125417709350586 (28.132973670959473) | > loss_duration: 1.9844614267349243 (2.0518956780433655) | > loss_1: 45.624752044677734 (42.42971420288086)  --> STEP: 3 | > loss_disc: 2.989244222640991 (2.5673529307047525) | > loss_disc_real_0: 0.3438110649585724 (0.32761115332444507) | > loss_disc_real_1: 0.38006794452667236 (0.27976978818575543) | > loss_disc_real_2: 0.3441636860370636 (0.30457128087679547) | > loss_disc_real_3: 0.2494603544473648 (0.21137608587741852) | > loss_disc_real_4: 0.20225082337856293 (0.21570825080076853) | > loss_disc_real_5: 0.2186974585056305 (0.17777790377537409) | > loss_0: 2.989244222640991 (2.5673529307047525) | > loss_gen: 1.8372845649719238 (2.534153938293457) | > loss_kl: 1.0833780765533447 (1.8506419658660889) | > loss_feat: 0.22919036448001862 (4.8283828149239225) | > loss_mel: 4.2020416259765625 (20.155996322631836) | > loss_duration: 2.0793964862823486 (2.0610626141230264) | > loss_1: 9.431291580200195 (31.430239995320637) --> EVAL PERFORMANCE | > avg_loader_time: 0.005907217661539714 (-0.005342165629069011) | > avg_loss_disc: 2.5673529307047525 (-0.09364708264668797) | > avg_loss_disc_real_0: 0.32761115332444507 (+0.15914722035328546) | > avg_loss_disc_real_1: 0.27976978818575543 (+0.018222610155741392) | > avg_loss_disc_real_2: 0.30457128087679547 (+0.07846209406852725) | > avg_loss_disc_real_3: 0.21137608587741852 (-0.04075377186139423) | > avg_loss_disc_real_4: 0.21570825080076853 (-0.03786119818687442) | > avg_loss_disc_real_5: 0.17777790377537409 (-0.08352008710304895) | > avg_loss_0: 2.5673529307047525 (-0.09364708264668797) | > avg_loss_gen: 2.534153938293457 (+0.5645610491434734) | > avg_loss_kl: 1.8506419658660889 (+0.09930904706319166) | > avg_loss_feat: 4.8283828149239225 (+2.240907353659471) | > avg_loss_mel: 20.155996322631836 (+1.3060210545857736) | > avg_loss_duration: 2.0610626141230264 (+0.01072227954864502) | > avg_loss_1: 31.430239995320637 (+4.221522967020668)  > EPOCH: 38/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:05:15)   --> TIME: 2023-10-20 00:05:33 -- STEP: 29/50 -- GLOBAL_STEP: 54930 | > loss_disc: 2.054781198501587 (2.5460926171006832) | > loss_disc_real_0: 0.2484922707080841 (0.2006353309442257) | > loss_disc_real_1: 0.18439972400665283 (0.2425137953511599) | > loss_disc_real_2: 0.2123556286096573 (0.23119709024141574) | > loss_disc_real_3: 0.14727866649627686 (0.2026929398035181) | > loss_disc_real_4: 0.1719924658536911 (0.20245665710034041) | > loss_disc_real_5: 0.2611945569515228 (0.23003175283043545) | > loss_0: 2.054781198501587 (2.5460926171006832) | > grad_norm_0: tensor(245.3087, device='cuda:0') (tensor(583.2431, device='cuda:0')) | > loss_gen: 2.854921579360962 (2.307565619205606) | > loss_kl: 1.1201817989349365 (1.1962441473171632) | > loss_feat: 7.953754425048828 (5.362817778669555) | > loss_mel: 23.54972267150879 (25.007318348720155) | > loss_duration: 1.9648483991622925 (1.9261466346938034) | > loss_1: 37.44342803955078 (35.800092269634376) | > grad_norm_1: tensor(6365.9448, device='cuda:0') (tensor(18398.5059, device='cuda:0')) | > current_lr_0: 0.00019254213085202282 | > current_lr_1: 0.00019254213085202282 | > step_time: 0.3001 (0.4949179435598439) | > loader_time: 0.0017 (0.013926760903720197)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5864458084106445 (2.5864458084106445) | > loss_disc_real_0: 0.21520614624023438 (0.21520614624023438) | > loss_disc_real_1: 0.1255292147397995 (0.1255292147397995) | > loss_disc_real_2: 0.23216597735881805 (0.23216597735881805) | > loss_disc_real_3: 0.4086081087589264 (0.4086081087589264) | > loss_disc_real_4: 0.3058869540691376 (0.3058869540691376) | > loss_disc_real_5: 0.24403096735477448 (0.24403096735477448) | > loss_0: 2.5864458084106445 (2.5864458084106445) | > loss_gen: 2.261988878250122 (2.261988878250122) | > loss_kl: 1.7484755516052246 (1.7484755516052246) | > loss_feat: 5.313567161560059 (5.313567161560059) | > loss_mel: 23.05571937561035 (23.05571937561035) | > loss_duration: 1.94775390625 (1.94775390625) | > loss_1: 34.3275032043457 (34.3275032043457)  --> STEP: 1 | > loss_disc: 2.3473055362701416 (2.3473055362701416) | > loss_disc_real_0: 0.09983741492033005 (0.09983741492033005) | > loss_disc_real_1: 0.35290464758872986 (0.35290464758872986) | > loss_disc_real_2: 0.16788636147975922 (0.16788636147975922) | > loss_disc_real_3: 0.24378061294555664 (0.24378061294555664) | > loss_disc_real_4: 0.2059699296951294 (0.2059699296951294) | > loss_disc_real_5: 0.3133155405521393 (0.3133155405521393) | > loss_0: 2.3473055362701416 (2.3473055362701416) | > loss_gen: 2.397808313369751 (2.397808313369751) | > loss_kl: 3.201934337615967 (3.201934337615967) | > loss_feat: 7.3153228759765625 (7.3153228759765625) | > loss_mel: 24.863656997680664 (24.863656997680664) | > loss_duration: 2.0448803901672363 (2.0448803901672363) | > loss_1: 39.82360076904297 (39.82360076904297)  --> STEP: 2 | > loss_disc: 2.9845733642578125 (2.665939450263977) | > loss_disc_real_0: 0.35333847999572754 (0.2265879474580288) | > loss_disc_real_1: 0.20868505537509918 (0.2807948514819145) | > loss_disc_real_2: 0.2738931179046631 (0.22088973969221115) | > loss_disc_real_3: 0.39674291014671326 (0.32026176154613495) | > loss_disc_real_4: 0.4697032570838928 (0.3378365933895111) | > loss_disc_real_5: 0.41131436824798584 (0.36231495440006256) | > loss_0: 2.9845733642578125 (2.665939450263977) | > loss_gen: 2.5072712898254395 (2.452539801597595) | > loss_kl: 1.9061963558197021 (2.5540653467178345) | > loss_feat: 2.8202836513519287 (5.067803263664246) | > loss_mel: 26.690555572509766 (25.777106285095215) | > loss_duration: 2.073647975921631 (2.0592641830444336) | > loss_1: 35.997955322265625 (37.9107780456543)  --> STEP: 3 | > loss_disc: 1.8411662578582764 (2.39101505279541) | > loss_disc_real_0: 0.1399957239627838 (0.1977238729596138) | > loss_disc_real_1: 0.12290957570075989 (0.22816642622152963) | > loss_disc_real_2: 0.12205809354782104 (0.18794585764408112) | > loss_disc_real_3: 0.36566102504730225 (0.33539484937985736) | > loss_disc_real_4: 0.3482644259929657 (0.34131253759066266) | > loss_disc_real_5: 0.16093891859054565 (0.2951896091302236) | > loss_0: 1.8411662578582764 (2.39101505279541) | > loss_gen: 3.2310914993286133 (2.712057034174601) | > loss_kl: 1.21390962600708 (2.107346773147583) | > loss_feat: 5.545646667480469 (5.227084398269653) | > loss_mel: 29.604087829589844 (27.052766799926758) | > loss_duration: 2.0736730098724365 (2.0640671253204346) | > loss_1: 41.66840744018555 (39.16332117716471) --> EVAL PERFORMANCE | > avg_loader_time: 0.0062541961669921875 (+0.00034697850545247367) | > avg_loss_disc: 2.39101505279541 (-0.1763378779093423) | > avg_loss_disc_real_0: 0.1977238729596138 (-0.12988728036483127) | > avg_loss_disc_real_1: 0.22816642622152963 (-0.0516033619642258) | > avg_loss_disc_real_2: 0.18794585764408112 (-0.11662542323271435) | > avg_loss_disc_real_3: 0.33539484937985736 (+0.12401876350243884) | > avg_loss_disc_real_4: 0.34131253759066266 (+0.12560428678989413) | > avg_loss_disc_real_5: 0.2951896091302236 (+0.11741170535484949) | > avg_loss_0: 2.39101505279541 (-0.1763378779093423) | > avg_loss_gen: 2.712057034174601 (+0.17790309588114406) | > avg_loss_kl: 2.107346773147583 (+0.25670480728149414) | > avg_loss_feat: 5.227084398269653 (+0.3987015833457308) | > avg_loss_mel: 27.052766799926758 (+6.896770477294922) | > avg_loss_duration: 2.0640671253204346 (+0.0030045111974081884) | > avg_loss_1: 39.16332117716471 (+7.733081181844074)  > EPOCH: 39/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:05:53)   --> TIME: 2023-10-20 00:06:00 -- STEP: 9/50 -- GLOBAL_STEP: 54960 | > loss_disc: 2.323190927505493 (2.5119470755259194) | > loss_disc_real_0: 0.08220222592353821 (0.16465784257484806) | > loss_disc_real_1: 0.2654932141304016 (0.22147813273800743) | > loss_disc_real_2: 0.08453965932130814 (0.179880500667625) | > loss_disc_real_3: 0.3487604856491089 (0.27984584040111965) | > loss_disc_real_4: 0.1665123552083969 (0.2460248718659083) | > loss_disc_real_5: 0.3273489475250244 (0.22748574117819467) | > loss_0: 2.323190927505493 (2.5119470755259194) | > grad_norm_0: tensor(419.4063, device='cuda:0') (tensor(492.3217, device='cuda:0')) | > loss_gen: 2.408618927001953 (2.334268821610345) | > loss_kl: 0.8303155899047852 (1.1505686773194208) | > loss_feat: 4.606081485748291 (4.845634420298868) | > loss_mel: 25.51042366027832 (24.76969310972426) | > loss_duration: 1.7763986587524414 (1.881224897172716) | > loss_1: 35.1318359375 (34.98138946957059) | > grad_norm_1: tensor(14954.5361, device='cuda:0') (tensor(16013.3193, device='cuda:0')) | > current_lr_0: 0.00019234967293729698 | > current_lr_1: 0.00019234967293729698 | > step_time: 0.3625 (0.47971969180636936) | > loader_time: 0.0065 (0.018741130828857422)  --> TIME: 2023-10-20 00:06:11 -- STEP: 39/50 -- GLOBAL_STEP: 54990 | > loss_disc: 3.238638401031494 (2.4715733986634474) | > loss_disc_real_0: 0.6942267417907715 (0.16948833560141233) | > loss_disc_real_1: 0.22609487175941467 (0.2276966229845316) | > loss_disc_real_2: 0.2600044906139374 (0.21823703860625243) | > loss_disc_real_3: 0.19720083475112915 (0.24623240062441581) | > loss_disc_real_4: 0.24426895380020142 (0.23435025308758783) | > loss_disc_real_5: 0.1582670658826828 (0.22851524807703802) | > loss_0: 3.238638401031494 (2.4715733986634474) | > grad_norm_0: tensor(1140.6632, device='cuda:0') (tensor(519.6210, device='cuda:0')) | > loss_gen: 1.553573489189148 (2.4965670811824308) | > loss_kl: 1.3520770072937012 (1.2352725129861097) | > loss_feat: 0.21965330839157104 (5.755339833310782) | > loss_mel: 3.54167103767395 (24.873167044077164) | > loss_duration: 1.8625108003616333 (1.897268350307758) | > loss_1: 8.529485702514648 (36.25761452699319) | > grad_norm_1: tensor(9832.2637, device='cuda:0') (tensor(19800.5332, device='cuda:0')) | > current_lr_0: 0.00019234967293729698 | > current_lr_1: 0.00019234967293729698 | > step_time: 0.5065 (0.39226582722786146) | > loader_time: 0.0139 (0.010639563584939027)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.074492931365967 (2.074492931365967) | > loss_disc_real_0: 0.13053515553474426 (0.13053515553474426) | > loss_disc_real_1: 0.21559645235538483 (0.21559645235538483) | > loss_disc_real_2: 0.17193080484867096 (0.17193080484867096) | > loss_disc_real_3: 0.20328639447689056 (0.20328639447689056) | > loss_disc_real_4: 0.09688491374254227 (0.09688491374254227) | > loss_disc_real_5: 0.19931302964687347 (0.19931302964687347) | > loss_0: 2.074492931365967 (2.074492931365967) | > loss_gen: 2.569300889968872 (2.569300889968872) | > loss_kl: 1.8703964948654175 (1.8703964948654175) | > loss_feat: 6.25267219543457 (6.25267219543457) | > loss_mel: 26.57240104675293 (26.57240104675293) | > loss_duration: 1.9866182804107666 (1.9866182804107666) | > loss_1: 39.25138854980469 (39.25138854980469)  --> STEP: 1 | > loss_disc: 1.8548706769943237 (1.8548706769943237) | > loss_disc_real_0: 0.19064989686012268 (0.19064989686012268) | > loss_disc_real_1: 0.02812837064266205 (0.02812837064266205) | > loss_disc_real_2: 0.34467869997024536 (0.34467869997024536) | > loss_disc_real_3: 0.12476218491792679 (0.12476218491792679) | > loss_disc_real_4: 0.04926944151520729 (0.04926944151520729) | > loss_disc_real_5: 0.14968302845954895 (0.14968302845954895) | > loss_0: 1.8548706769943237 (1.8548706769943237) | > loss_gen: 2.8313937187194824 (2.8313937187194824) | > loss_kl: 2.9959607124328613 (2.9959607124328613) | > loss_feat: 10.434065818786621 (10.434065818786621) | > loss_mel: 27.08403778076172 (27.08403778076172) | > loss_duration: 2.0754776000976562 (2.0754776000976562) | > loss_1: 45.420936584472656 (45.420936584472656)  --> STEP: 2 | > loss_disc: 2.543280839920044 (2.199075758457184) | > loss_disc_real_0: 0.33336472511291504 (0.26200731098651886) | > loss_disc_real_1: 0.09363521635532379 (0.06088179349899292) | > loss_disc_real_2: 0.07059568911790848 (0.20763719454407692) | > loss_disc_real_3: 0.18182910978794098 (0.15329564735293388) | > loss_disc_real_4: 0.09108984470367432 (0.0701796431094408) | > loss_disc_real_5: 0.20001712441444397 (0.17485007643699646) | > loss_0: 2.543280839920044 (2.199075758457184) | > loss_gen: 2.1094248294830322 (2.4704092741012573) | > loss_kl: 1.9637386798858643 (2.479849696159363) | > loss_feat: 8.887079238891602 (9.660572528839111) | > loss_mel: 30.52994728088379 (28.806992530822754) | > loss_duration: 2.1091580390930176 (2.092317819595337) | > loss_1: 45.59934616088867 (45.510141372680664)  --> STEP: 3 | > loss_disc: 2.9602513313293457 (2.4528009494145713) | > loss_disc_real_0: 0.33522477746009827 (0.28641313314437866) | > loss_disc_real_1: 0.3154206871986389 (0.1457280913988749) | > loss_disc_real_2: 0.3138531446456909 (0.24304251124461493) | > loss_disc_real_3: 0.2516676187515259 (0.18608630448579788) | > loss_disc_real_4: 0.29862046241760254 (0.14632658287882805) | > loss_disc_real_5: 0.40142822265625 (0.2503761251767476) | > loss_0: 2.9602513313293457 (2.4528009494145713) | > loss_gen: 2.1467933654785156 (2.3625373045603433) | > loss_kl: 1.619038701057434 (2.1929126977920532) | > loss_feat: 0.49267882108688354 (6.604607959588368) | > loss_mel: 21.333642959594727 (26.315876007080078) | > loss_duration: 2.194728374481201 (2.1264546712239585) | > loss_1: 27.786882400512695 (39.60238838195801) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_55000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7894874811172485 (2.2869725823402405) | > loss_disc_real_0: 0.21613718569278717 (0.2688441462814808) | > loss_disc_real_1: 0.06255485117435455 (0.12493478134274483) | > loss_disc_real_2: 0.10815924406051636 (0.20932169444859028) | > loss_disc_real_3: 0.18289844691753387 (0.18528934009373188) | > loss_disc_real_4: 0.06833205372095108 (0.1268279505893588) | > loss_disc_real_5: 0.16967949271202087 (0.23020196706056595) | > loss_0: 1.7894874811172485 (2.2869725823402405) | > loss_gen: 2.447697162628174 (2.383827269077301) | > loss_kl: 1.6862651109695435 (2.066250801086426) | > loss_feat: 8.726604461669922 (7.135107085108757) | > loss_mel: 25.03932762145996 (25.99673891067505) | > loss_duration: 1.9659194946289062 (2.0863208770751953) | > loss_1: 39.865814208984375 (39.6682448387146)  --> STEP: 1 | > loss_disc: 1.7567322254180908 (2.1809245109558106) | > loss_disc_real_0: 0.12779253721237183 (0.240633824467659) | > loss_disc_real_1: 0.08847569674253464 (0.11764296442270279) | > loss_disc_real_2: 0.09225927293300629 (0.18590921014547349) | > loss_disc_real_3: 0.19795027375221252 (0.18782152682542802) | > loss_disc_real_4: 0.15831317007541656 (0.13312499448657036) | > loss_disc_real_5: 0.20781713724136353 (0.22572500109672547) | > loss_0: 1.7567322254180908 (2.1809245109558106) | > loss_gen: 2.509378433227539 (2.4089375019073485) | > loss_kl: 2.8216094970703125 (2.2173225402832033) | > loss_feat: 8.387112617492676 (7.385508191585541) | > loss_mel: 24.270305633544922 (25.651452255249023) | > loss_duration: 2.1064987182617188 (2.0903564453125) | > loss_1: 40.09490203857422 (39.75357627868652)  --> STEP: 2 | > loss_disc: 1.8563716411590576 (2.126832365989685) | > loss_disc_real_0: 0.04574311524629593 (0.2081520395974318) | > loss_disc_real_1: 0.12247884273529053 (0.11844894414146741) | > loss_disc_real_2: 0.10780636221170425 (0.17289206882317862) | > loss_disc_real_3: 0.06986404955387115 (0.16816194728016853) | > loss_disc_real_4: 0.16057835519313812 (0.13770055460433164) | > loss_disc_real_5: 0.13657307624816895 (0.21086634695529938) | > loss_0: 1.8563716411590576 (2.126832365989685) | > loss_gen: 2.1909472942352295 (2.372605800628662) | > loss_kl: 1.7884384393692017 (2.1458418567975364) | > loss_feat: 10.57153606414795 (7.9165128370126085) | > loss_mel: 33.06858825683594 (26.887641588846844) | > loss_duration: 2.0584094524383545 (2.0850319465001426) | > loss_1: 49.677921295166016 (41.407633781433105)  --> STEP: 3 | > loss_disc: 2.642380714416504 (2.200482130050659) | > loss_disc_real_0: 0.3254810869693756 (0.22491333207913808) | > loss_disc_real_1: 0.13903973996639252 (0.121390486402171) | > loss_disc_real_2: 0.18211008608341217 (0.1742089284317834) | > loss_disc_real_3: 0.20721517503261566 (0.1737409798162324) | > loss_disc_real_4: 0.4117708206176758 (0.1768534497490951) | > loss_disc_real_5: 0.3872310221195221 (0.23606130055018834) | > loss_0: 2.642380714416504 (2.200482130050659) | > loss_gen: 2.6805102825164795 (2.416592155184065) | > loss_kl: 1.6897526979446411 (2.080686262675694) | > loss_feat: 5.542253494262695 (7.577332930905478) | > loss_mel: 25.53538703918457 (26.694462367466517) | > loss_duration: 2.1829867362976074 (2.0990254878997803) | > loss_1: 37.63089370727539 (40.86809948512486) --> EVAL PERFORMANCE | > avg_loader_time: 0.19628364699227469 (+0.1900294508252825) | > avg_loss_disc: 2.200482130050659 (-0.19053292274475098) | > avg_loss_disc_real_0: 0.22491333207913808 (+0.02718945911952428) | > avg_loss_disc_real_1: 0.121390486402171 (-0.10677593981935864) | > avg_loss_disc_real_2: 0.1742089284317834 (-0.013736929212297716) | > avg_loss_disc_real_3: 0.1737409798162324 (-0.16165386956362496) | > avg_loss_disc_real_4: 0.1768534497490951 (-0.16445908784156757) | > avg_loss_disc_real_5: 0.23606130055018834 (-0.05912830858003523) | > avg_loss_0: 2.200482130050659 (-0.19053292274475098) | > avg_loss_gen: 2.416592155184065 (-0.2954648789905363) | > avg_loss_kl: 2.080686262675694 (-0.026660510471888887) | > avg_loss_feat: 7.577332930905478 (+2.350248532635825) | > avg_loss_mel: 26.694462367466517 (-0.35830443246024046) | > avg_loss_duration: 2.0990254878997803 (+0.0349583625793457) | > avg_loss_1: 40.86809948512486 (+1.7047783079601473)  > EPOCH: 40/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:06:34)   --> TIME: 2023-10-20 00:06:48 -- STEP: 19/50 -- GLOBAL_STEP: 55020 | > loss_disc: 2.4715750217437744 (2.3753950407630517) | > loss_disc_real_0: 0.21399879455566406 (0.15588405434238284) | > loss_disc_real_1: 0.32803577184677124 (0.22742954367085508) | > loss_disc_real_2: 0.2775004208087921 (0.20520089056931043) | > loss_disc_real_3: 0.43886691331863403 (0.22581992416005386) | > loss_disc_real_4: 0.15989567339420319 (0.19891313247774778) | > loss_disc_real_5: 0.34616926312446594 (0.19458416790554398) | > loss_0: 2.4715750217437744 (2.3753950407630517) | > grad_norm_0: tensor(1080.4934, device='cuda:0') (tensor(583.2874, device='cuda:0')) | > loss_gen: 2.7518491744995117 (2.565077825596458) | > loss_kl: 1.6296979188919067 (1.2731200833069651) | > loss_feat: 5.48847770690918 (6.433809965848923) | > loss_mel: 30.344200134277344 (24.68765559949373) | > loss_duration: 2.0533676147460938 (1.9480499405609935) | > loss_1: 42.26759338378906 (36.907713137174916) | > grad_norm_1: tensor(16727.2793, device='cuda:0') (tensor(20890.4746, device='cuda:0')) | > current_lr_0: 0.0001921574073963066 | > current_lr_1: 0.0001921574073963066 | > step_time: 0.5856 (0.5165137993661981) | > loader_time: 0.0108 (0.017429527483488385)  --> TIME: 2023-10-20 00:07:02 -- STEP: 49/50 -- GLOBAL_STEP: 55050 | > loss_disc: 2.906306743621826 (2.3982900283774544) | > loss_disc_real_0: 0.2839166522026062 (0.1590099366457791) | > loss_disc_real_1: 0.35738128423690796 (0.22654218150644886) | > loss_disc_real_2: 0.27889999747276306 (0.22316411167991404) | > loss_disc_real_3: 0.31291663646698 (0.23427468129642764) | > loss_disc_real_4: 0.3303193747997284 (0.20757610761389442) | > loss_disc_real_5: 0.4010857343673706 (0.21277353559069487) | > loss_0: 2.906306743621826 (2.3982900283774544) | > grad_norm_0: tensor(891.2231, device='cuda:0') (tensor(596.1642, device='cuda:0')) | > loss_gen: 2.3088436126708984 (2.5143745797021047) | > loss_kl: 0.8389148712158203 (1.200770825147629) | > loss_feat: 1.6632877588272095 (5.927905728014148) | > loss_mel: 25.053884506225586 (24.936018749159206) | > loss_duration: 1.9809489250183105 (1.8940742624049285) | > loss_1: 31.84588050842285 (36.4731442003834) | > grad_norm_1: tensor(4926.7974, device='cuda:0') (tensor(19391.7246, device='cuda:0')) | > current_lr_0: 0.0001921574073963066 | > current_lr_1: 0.0001921574073963066 | > step_time: 0.3688 (0.47418096114178093) | > loader_time: 0.2105 (0.021237173858953982)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3118131160736084 (2.3118131160736084) | > loss_disc_real_0: 0.2303357571363449 (0.2303357571363449) | > loss_disc_real_1: 0.058109160512685776 (0.058109160512685776) | > loss_disc_real_2: 0.12127324193716049 (0.12127324193716049) | > loss_disc_real_3: 0.33613768219947815 (0.33613768219947815) | > loss_disc_real_4: 0.03570955619215965 (0.03570955619215965) | > loss_disc_real_5: 0.060952916741371155 (0.060952916741371155) | > loss_0: 2.3118131160736084 (2.3118131160736084) | > loss_gen: 2.245335817337036 (2.245335817337036) | > loss_kl: 1.984631061553955 (1.984631061553955) | > loss_feat: 6.619936943054199 (6.619936943054199) | > loss_mel: 25.98996925354004 (25.98996925354004) | > loss_duration: 1.9669359922409058 (1.9669359922409058) | > loss_1: 38.80680465698242 (38.80680465698242)  --> STEP: 1 | > loss_disc: 2.1745777130126953 (2.1745777130126953) | > loss_disc_real_0: 0.111015185713768 (0.111015185713768) | > loss_disc_real_1: 0.08535300195217133 (0.08535300195217133) | > loss_disc_real_2: 0.28958359360694885 (0.28958359360694885) | > loss_disc_real_3: 0.3672943711280823 (0.3672943711280823) | > loss_disc_real_4: 0.05720873922109604 (0.05720873922109604) | > loss_disc_real_5: 0.07535944879055023 (0.07535944879055023) | > loss_0: 2.1745777130126953 (2.1745777130126953) | > loss_gen: 2.7131810188293457 (2.7131810188293457) | > loss_kl: 1.9415055513381958 (1.9415055513381958) | > loss_feat: 9.425405502319336 (9.425405502319336) | > loss_mel: 28.877721786499023 (28.877721786499023) | > loss_duration: 2.056053638458252 (2.056053638458252) | > loss_1: 45.01386642456055 (45.01386642456055)  --> STEP: 2 | > loss_disc: 2.025691509246826 (2.1001346111297607) | > loss_disc_real_0: 0.25186729431152344 (0.18144124001264572) | > loss_disc_real_1: 0.08918371051549911 (0.08726835623383522) | > loss_disc_real_2: 0.19105876982212067 (0.24032118171453476) | > loss_disc_real_3: 0.3428103029727936 (0.3550523370504379) | > loss_disc_real_4: 0.05301663652062416 (0.0551126878708601) | > loss_disc_real_5: 0.20796476304531097 (0.1416621059179306) | > loss_0: 2.025691509246826 (2.1001346111297607) | > loss_gen: 3.352320432662964 (3.032750725746155) | > loss_kl: 1.8102120161056519 (1.8758587837219238) | > loss_feat: 10.168344497680664 (9.796875) | > loss_mel: 28.314685821533203 (28.596203804016113) | > loss_duration: 2.02459979057312 (2.040326714515686) | > loss_1: 45.670166015625 (45.34201622009277)  --> STEP: 3 | > loss_disc: 2.5002384185791016 (2.2335025469462075) | > loss_disc_real_0: 0.1158212423324585 (0.1595679074525833) | > loss_disc_real_1: 0.2589706778526306 (0.14450246344010034) | > loss_disc_real_2: 0.3142150640487671 (0.26495247582594555) | > loss_disc_real_3: 0.3733190894126892 (0.36114125450452167) | > loss_disc_real_4: 0.3068793714046478 (0.139034915715456) | > loss_disc_real_5: 0.37254416942596436 (0.21862279375394186) | > loss_0: 2.5002384185791016 (2.2335025469462075) | > loss_gen: 2.5770158767700195 (2.8808391094207764) | > loss_kl: 0.8776299357414246 (1.5431158343950908) | > loss_feat: 3.1097824573516846 (7.5678441524505615) | > loss_mel: 26.03166961669922 (27.74135907491048) | > loss_duration: 2.077773332595825 (2.052808920542399) | > loss_1: 34.67387008666992 (41.78596750895182) --> EVAL PERFORMANCE | > avg_loader_time: 0.002771457036336263 (-0.1935121899559384) | > avg_loss_disc: 2.2335025469462075 (+0.033020416895548355) | > avg_loss_disc_real_0: 0.1595679074525833 (-0.06534542462655477) | > avg_loss_disc_real_1: 0.14450246344010034 (+0.023111977037929346) | > avg_loss_disc_real_2: 0.26495247582594555 (+0.09074354739416216) | > avg_loss_disc_real_3: 0.36114125450452167 (+0.18740027468828926) | > avg_loss_disc_real_4: 0.139034915715456 (-0.03781853403363908) | > avg_loss_disc_real_5: 0.21862279375394186 (-0.017438506796246478) | > avg_loss_0: 2.2335025469462075 (+0.033020416895548355) | > avg_loss_gen: 2.8808391094207764 (+0.4642469542367116) | > avg_loss_kl: 1.5431158343950908 (-0.5375704282806033) | > avg_loss_feat: 7.5678441524505615 (-0.009488778454916691) | > avg_loss_mel: 27.74135907491048 (+1.0468967074439632) | > avg_loss_duration: 2.052808920542399 (-0.04621656735738133) | > avg_loss_1: 41.78596750895182 (+0.9178680238269621)  > EPOCH: 41/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:07:12)   --> TIME: 2023-10-20 00:07:32 -- STEP: 29/50 -- GLOBAL_STEP: 55080 | > loss_disc: 2.846055030822754 (2.586732186120132) | > loss_disc_real_0: 0.20194366574287415 (0.2307831264775375) | > loss_disc_real_1: 0.23443223536014557 (0.22048158744542762) | > loss_disc_real_2: 0.26693037152290344 (0.23918789882084418) | > loss_disc_real_3: 0.3257027566432953 (0.25847768205507043) | > loss_disc_real_4: 0.40288981795310974 (0.24133017228852058) | > loss_disc_real_5: 0.29588937759399414 (0.2183965470898768) | > loss_0: 2.846055030822754 (2.586732186120132) | > grad_norm_0: tensor(749.5848, device='cuda:0') (tensor(1234.4448, device='cuda:0')) | > loss_gen: 2.0300486087799072 (2.5220852761433044) | > loss_kl: 1.1759382486343384 (1.3121426783759016) | > loss_feat: 1.8346832990646362 (6.01604531962296) | > loss_mel: 21.024364471435547 (25.712914581956536) | > loss_duration: 1.9767229557037354 (1.9311441141983559) | > loss_1: 28.041757583618164 (37.494331688716485) | > grad_norm_1: tensor(7547.1396, device='cuda:0') (tensor(29041.3086, device='cuda:0')) | > current_lr_0: 0.000191965334036762 | > current_lr_1: 0.000191965334036762 | > step_time: 0.6357 (0.5102386639035982) | > loader_time: 0.0243 (0.017773332266971982)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5883255004882812 (2.5883255004882812) | > loss_disc_real_0: 0.29390373826026917 (0.29390373826026917) | > loss_disc_real_1: 0.13590730726718903 (0.13590730726718903) | > loss_disc_real_2: 0.2505514323711395 (0.2505514323711395) | > loss_disc_real_3: 0.18830974400043488 (0.18830974400043488) | > loss_disc_real_4: 0.5710892081260681 (0.5710892081260681) | > loss_disc_real_5: 0.33512017130851746 (0.33512017130851746) | > loss_0: 2.5883255004882812 (2.5883255004882812) | > loss_gen: 3.640378952026367 (3.640378952026367) | > loss_kl: 1.5851582288742065 (1.5851582288742065) | > loss_feat: 8.192341804504395 (8.192341804504395) | > loss_mel: 32.875099182128906 (32.875099182128906) | > loss_duration: 1.9484035968780518 (1.9484035968780518) | > loss_1: 48.24137878417969 (48.24137878417969)  --> STEP: 1 | > loss_disc: 2.8051888942718506 (2.8051888942718506) | > loss_disc_real_0: 0.24031829833984375 (0.24031829833984375) | > loss_disc_real_1: 0.3431078791618347 (0.3431078791618347) | > loss_disc_real_2: 0.5366660952568054 (0.5366660952568054) | > loss_disc_real_3: 0.28110966086387634 (0.28110966086387634) | > loss_disc_real_4: 0.29564160108566284 (0.29564160108566284) | > loss_disc_real_5: 0.2641589045524597 (0.2641589045524597) | > loss_0: 2.8051888942718506 (2.8051888942718506) | > loss_gen: 2.572341203689575 (2.572341203689575) | > loss_kl: 2.4959840774536133 (2.4959840774536133) | > loss_feat: 1.8534961938858032 (1.8534961938858032) | > loss_mel: 20.813570022583008 (20.813570022583008) | > loss_duration: 2.092980146408081 (2.092980146408081) | > loss_1: 29.828371047973633 (29.828371047973633)  --> STEP: 2 | > loss_disc: 2.6719863414764404 (2.7385876178741455) | > loss_disc_real_0: 0.32207128405570984 (0.2811947911977768) | > loss_disc_real_1: 0.12401425093412399 (0.23356106504797935) | > loss_disc_real_2: 0.21216954290866852 (0.37441781908273697) | > loss_disc_real_3: 0.25709953904151917 (0.26910459995269775) | > loss_disc_real_4: 0.3706662952899933 (0.33315394818782806) | > loss_disc_real_5: 0.15302886068820953 (0.20859388262033463) | > loss_0: 2.6719863414764404 (2.7385876178741455) | > loss_gen: 2.46824312210083 (2.5202921628952026) | > loss_kl: 2.0937557220458984 (2.294869899749756) | > loss_feat: 7.069102764129639 (4.461299479007721) | > loss_mel: 32.986976623535156 (26.900273323059082) | > loss_duration: 2.004279613494873 (2.048629879951477) | > loss_1: 46.62235641479492 (38.22536373138428)  --> STEP: 3 | > loss_disc: 3.0804028511047363 (2.8525260289510093) | > loss_disc_real_0: 0.19914652407169342 (0.25384536882241565) | > loss_disc_real_1: 0.34441477060317993 (0.27051230023304623) | > loss_disc_real_2: 0.4605028033256531 (0.40311281383037567) | > loss_disc_real_3: 0.2736934721469879 (0.2706342240174611) | > loss_disc_real_4: 0.25140103697776794 (0.3059029777844747) | > loss_disc_real_5: 0.2832419276237488 (0.23347656428813934) | > loss_0: 3.0804028511047363 (2.8525260289510093) | > loss_gen: 1.8148702383041382 (2.2851515213648477) | > loss_kl: 1.30495285987854 (1.9648975531260173) | > loss_feat: 0.10192155838012695 (3.0081735054651895) | > loss_mel: 7.2493438720703125 (20.349963506062824) | > loss_duration: 2.049978494644165 (2.049079418182373) | > loss_1: 12.521066665649414 (29.657264709472656) --> EVAL PERFORMANCE | > avg_loader_time: 0.015444596608479818 (+0.012673139572143555) | > avg_loss_disc: 2.8525260289510093 (+0.6190234820048017) | > avg_loss_disc_real_0: 0.25384536882241565 (+0.09427746136983234) | > avg_loss_disc_real_1: 0.27051230023304623 (+0.1260098367929459) | > avg_loss_disc_real_2: 0.40311281383037567 (+0.13816033800443012) | > avg_loss_disc_real_3: 0.2706342240174611 (-0.09050703048706055) | > avg_loss_disc_real_4: 0.3059029777844747 (+0.16686806206901866) | > avg_loss_disc_real_5: 0.23347656428813934 (+0.01485377053419748) | > avg_loss_0: 2.8525260289510093 (+0.6190234820048017) | > avg_loss_gen: 2.2851515213648477 (-0.5956875880559287) | > avg_loss_kl: 1.9648975531260173 (+0.4217817187309265) | > avg_loss_feat: 3.0081735054651895 (-4.5596706469853725) | > avg_loss_mel: 20.349963506062824 (-7.391395568847656) | > avg_loss_duration: 2.049079418182373 (-0.0037295023600258936) | > avg_loss_1: 29.657264709472656 (-12.128702799479164)  > EPOCH: 42/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:07:52)   --> TIME: 2023-10-20 00:08:00 -- STEP: 9/50 -- GLOBAL_STEP: 55110 | > loss_disc: 3.003605842590332 (2.5478195349375405) | > loss_disc_real_0: 0.09363679587841034 (0.17848463273710674) | > loss_disc_real_1: 0.27808529138565063 (0.21523980134063297) | > loss_disc_real_2: 0.2378721833229065 (0.2072673940824138) | > loss_disc_real_3: 0.34628334641456604 (0.2114837101350228) | > loss_disc_real_4: 0.2515333592891693 (0.2731662442286809) | > loss_disc_real_5: 0.2893788516521454 (0.2401997567050987) | > loss_0: 3.003605842590332 (2.5478195349375405) | > grad_norm_0: tensor(1072.5765, device='cuda:0') (tensor(1193.0284, device='cuda:0')) | > loss_gen: 1.7265995740890503 (2.3644241624408298) | > loss_kl: 1.7557127475738525 (1.7944083081351385) | > loss_feat: 0.5011041760444641 (5.252979008687867) | > loss_mel: 25.192243576049805 (25.337079260084366) | > loss_duration: 1.8516520261764526 (1.8790069421132405) | > loss_1: 31.027311325073242 (36.62789726257324) | > grad_norm_1: tensor(15538.6279, device='cuda:0') (tensor(44113.0508, device='cuda:0')) | > current_lr_0: 0.00019177345266656591 | > current_lr_1: 0.00019177345266656591 | > step_time: 0.6842 (0.5138506359524198) | > loader_time: 0.0283 (0.01630038685268826)  --> TIME: 2023-10-20 00:08:12 -- STEP: 39/50 -- GLOBAL_STEP: 55140 | > loss_disc: 3.211484432220459 (2.5155376562705407) | > loss_disc_real_0: 0.37900033593177795 (0.1785418132845408) | > loss_disc_real_1: 0.22453118860721588 (0.22700731150614908) | > loss_disc_real_2: 0.31496426463127136 (0.23681608697351736) | > loss_disc_real_3: 0.16643305122852325 (0.25749672552905023) | > loss_disc_real_4: 0.30214065313339233 (0.21674572167774805) | > loss_disc_real_5: 0.2902498245239258 (0.23527675461119565) | > loss_0: 3.211484432220459 (2.5155376562705407) | > grad_norm_0: tensor(3116.9858, device='cuda:0') (tensor(1054.0822, device='cuda:0')) | > loss_gen: 1.5081243515014648 (2.4067882054891343) | > loss_kl: 0.8732082843780518 (1.4180722420032204) | > loss_feat: 0.5927324891090393 (4.930821931132903) | > loss_mel: 21.356395721435547 (25.396739323933918) | > loss_duration: 1.8827029466629028 (1.9005388296567476) | > loss_1: 26.213163375854492 (36.052960542532105) | > grad_norm_1: tensor(9111.8096, device='cuda:0') (tensor(40234.9609, device='cuda:0')) | > current_lr_0: 0.00019177345266656591 | > current_lr_1: 0.00019177345266656591 | > step_time: 0.6725 (0.41347545843857986) | > loader_time: 0.022 (0.00995632929679675)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0519375801086426 (3.0519375801086426) | > loss_disc_real_0: 0.0788029283285141 (0.0788029283285141) | > loss_disc_real_1: 0.2513355016708374 (0.2513355016708374) | > loss_disc_real_2: 0.24646124243736267 (0.24646124243736267) | > loss_disc_real_3: 0.3318895697593689 (0.3318895697593689) | > loss_disc_real_4: 0.24266256392002106 (0.24266256392002106) | > loss_disc_real_5: 0.44286060333251953 (0.44286060333251953) | > loss_0: 3.0519375801086426 (3.0519375801086426) | > loss_gen: 1.6731678247451782 (1.6731678247451782) | > loss_kl: 1.74282705783844 (1.74282705783844) | > loss_feat: 2.6486620903015137 (2.6486620903015137) | > loss_mel: 22.61613655090332 (22.61613655090332) | > loss_duration: 1.9599666595458984 (1.9599666595458984) | > loss_1: 30.64076042175293 (30.64076042175293)  --> STEP: 1 | > loss_disc: 3.1855576038360596 (3.1855576038360596) | > loss_disc_real_0: 0.1940331757068634 (0.1940331757068634) | > loss_disc_real_1: 0.3454402983188629 (0.3454402983188629) | > loss_disc_real_2: 0.29614514112472534 (0.29614514112472534) | > loss_disc_real_3: 0.2376062572002411 (0.2376062572002411) | > loss_disc_real_4: 0.26696255803108215 (0.26696255803108215) | > loss_disc_real_5: 0.5968834161758423 (0.5968834161758423) | > loss_0: 3.1855576038360596 (3.1855576038360596) | > loss_gen: 2.0050766468048096 (2.0050766468048096) | > loss_kl: 2.1504359245300293 (2.1504359245300293) | > loss_feat: 3.466951608657837 (3.466951608657837) | > loss_mel: 23.49390411376953 (23.49390411376953) | > loss_duration: 2.0835535526275635 (2.0835535526275635) | > loss_1: 33.19992446899414 (33.19992446899414)  --> STEP: 2 | > loss_disc: 1.9657063484191895 (2.5756319761276245) | > loss_disc_real_0: 0.16420304775238037 (0.1791181117296219) | > loss_disc_real_1: 0.24549290537834167 (0.2954666018486023) | > loss_disc_real_2: 0.33023595809936523 (0.3131905496120453) | > loss_disc_real_3: 0.16357813775539398 (0.20059219747781754) | > loss_disc_real_4: 0.2841426432132721 (0.2755526006221771) | > loss_disc_real_5: 0.04456176608800888 (0.3207225911319256) | > loss_0: 1.9657063484191895 (2.5756319761276245) | > loss_gen: 3.100949287414551 (2.55301296710968) | > loss_kl: 1.951002836227417 (2.050719380378723) | > loss_feat: 10.220791816711426 (6.843871712684631) | > loss_mel: 28.63753890991211 (26.06572151184082) | > loss_duration: 2.015657901763916 (2.0496057271957397) | > loss_1: 45.925941467285156 (39.56293296813965)  --> STEP: 3 | > loss_disc: 3.081819534301758 (2.744361162185669) | > loss_disc_real_0: 0.19454823434352875 (0.1842614859342575) | > loss_disc_real_1: 0.25957050919532776 (0.2835012376308441) | > loss_disc_real_2: 0.23393253982067108 (0.28677121301492053) | > loss_disc_real_3: 0.266169935464859 (0.22245144347349802) | > loss_disc_real_4: 0.31477659940719604 (0.2886272668838501) | > loss_disc_real_5: 0.48474493622779846 (0.3753967061638832) | > loss_0: 3.081819534301758 (2.744361162185669) | > loss_gen: 1.7119449377059937 (2.272656957308451) | > loss_kl: 2.903106927871704 (2.3348485628763833) | > loss_feat: 0.5454713106155396 (4.744404911994934) | > loss_mel: 6.3938117027282715 (19.50841824213664) | > loss_duration: 2.141854763031006 (2.080355405807495) | > loss_1: 13.696189880371094 (30.940685272216797) --> EVAL PERFORMANCE | > avg_loader_time: 0.006916522979736328 (-0.00852807362874349) | > avg_loss_disc: 2.744361162185669 (-0.10816486676534032) | > avg_loss_disc_real_0: 0.1842614859342575 (-0.06958388288815814) | > avg_loss_disc_real_1: 0.2835012376308441 (+0.012988937397797884) | > avg_loss_disc_real_2: 0.28677121301492053 (-0.11634160081545514) | > avg_loss_disc_real_3: 0.22245144347349802 (-0.048182780543963105) | > avg_loss_disc_real_4: 0.2886272668838501 (-0.017275710900624575) | > avg_loss_disc_real_5: 0.3753967061638832 (+0.14192014187574387) | > avg_loss_0: 2.744361162185669 (-0.10816486676534032) | > avg_loss_gen: 2.272656957308451 (-0.012494564056396484) | > avg_loss_kl: 2.3348485628763833 (+0.369951009750366) | > avg_loss_feat: 4.744404911994934 (+1.7362314065297446) | > avg_loss_mel: 19.50841824213664 (-0.8415452639261858) | > avg_loss_duration: 2.080355405807495 (+0.03127598762512207) | > avg_loss_1: 30.940685272216797 (+1.2834205627441406)  > EPOCH: 43/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:08:26)   --> TIME: 2023-10-20 00:08:40 -- STEP: 19/50 -- GLOBAL_STEP: 55170 | > loss_disc: 2.7311887741088867 (2.387849437563043) | > loss_disc_real_0: 0.03770726919174194 (0.13441160478089986) | > loss_disc_real_1: 0.127280592918396 (0.25155171791189596) | > loss_disc_real_2: 0.1504402905702591 (0.23078917202196622) | > loss_disc_real_3: 0.2617676258087158 (0.22433235300214668) | > loss_disc_real_4: 0.10550179332494736 (0.1885258433850188) | > loss_disc_real_5: 0.3248894214630127 (0.21316422306393323) | > loss_0: 2.7311887741088867 (2.387849437563043) | > grad_norm_0: tensor(1399.2339, device='cuda:0') (tensor(1182.5880, device='cuda:0')) | > loss_gen: 2.9460620880126953 (2.76747853504984) | > loss_kl: 1.4577308893203735 (1.3555975085810612) | > loss_feat: 11.375895500183105 (7.245271289819165) | > loss_mel: 31.996715545654297 (28.9025522533216) | > loss_duration: 2.07536244392395 (1.970334153426321) | > loss_1: 49.851768493652344 (42.24123367510344) | > grad_norm_1: tensor(102642.9141, device='cuda:0') (tensor(80755.7734, device='cuda:0')) | > current_lr_0: 0.0001915817630938129 | > current_lr_1: 0.0001915817630938129 | > step_time: 0.6937 (0.5217628353520444) | > loader_time: 0.0237 (0.020403711419356495)  --> TIME: 2023-10-20 00:08:56 -- STEP: 49/50 -- GLOBAL_STEP: 55200 | > loss_disc: 1.9495421648025513 (2.508994270344169) | > loss_disc_real_0: 0.022282954305410385 (0.17388779586371111) | > loss_disc_real_1: 0.15786007046699524 (0.24892062724244832) | > loss_disc_real_2: 0.05771838128566742 (0.23931339398330573) | > loss_disc_real_3: 0.34629371762275696 (0.23473475827854506) | > loss_disc_real_4: 0.4018089771270752 (0.22200157767047687) | > loss_disc_real_5: 0.19489607214927673 (0.22315117579941846) | > loss_0: 1.9495421648025513 (2.508994270344169) | > grad_norm_0: tensor(1745.5559, device='cuda:0') (tensor(1332.4187, device='cuda:0')) | > loss_gen: 3.383840322494507 (2.466728813794195) | > loss_kl: 0.6609972715377808 (1.2278100617077885) | > loss_feat: 8.401470184326172 (5.555621050754372) | > loss_mel: 34.430259704589844 (27.04571534176262) | > loss_duration: 2.0114712715148926 (1.9056091746505426) | > loss_1: 48.888038635253906 (38.20148434930919) | > grad_norm_1: tensor(113409.1797, device='cuda:0') (tensor(56056.5039, device='cuda:0')) | > current_lr_0: 0.0001915817630938129 | > current_lr_1: 0.0001915817630938129 | > step_time: 0.5171 (0.49923146014310876) | > loader_time: 0.2282 (0.024860318826169375)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5667855739593506 (2.5667855739593506) | > loss_disc_real_0: 0.056935276836156845 (0.056935276836156845) | > loss_disc_real_1: 0.3240800201892853 (0.3240800201892853) | > loss_disc_real_2: 0.24284176528453827 (0.24284176528453827) | > loss_disc_real_3: 0.2686901390552521 (0.2686901390552521) | > loss_disc_real_4: 0.44906073808670044 (0.44906073808670044) | > loss_disc_real_5: 0.3776536285877228 (0.3776536285877228) | > loss_0: 2.5667855739593506 (2.5667855739593506) | > loss_gen: 3.1168506145477295 (3.1168506145477295) | > loss_kl: 1.6508089303970337 (1.6508089303970337) | > loss_feat: 4.961189270019531 (4.961189270019531) | > loss_mel: 23.425724029541016 (23.425724029541016) | > loss_duration: 1.9123152494430542 (1.9123152494430542) | > loss_1: 35.06688690185547 (35.06688690185547)  --> STEP: 1 | > loss_disc: 2.1467013359069824 (2.1467013359069824) | > loss_disc_real_0: 0.07870239019393921 (0.07870239019393921) | > loss_disc_real_1: 0.2343040406703949 (0.2343040406703949) | > loss_disc_real_2: 0.24625463783740997 (0.24625463783740997) | > loss_disc_real_3: 0.3364608883857727 (0.3364608883857727) | > loss_disc_real_4: 0.4510389268398285 (0.4510389268398285) | > loss_disc_real_5: 0.3275611996650696 (0.3275611996650696) | > loss_0: 2.1467013359069824 (2.1467013359069824) | > loss_gen: 3.9834461212158203 (3.9834461212158203) | > loss_kl: 3.2137913703918457 (3.2137913703918457) | > loss_feat: 9.014809608459473 (9.014809608459473) | > loss_mel: 25.391700744628906 (25.391700744628906) | > loss_duration: 2.072402000427246 (2.072402000427246) | > loss_1: 43.6761474609375 (43.6761474609375)  --> STEP: 2 | > loss_disc: 2.782529592514038 (2.4646154642105103) | > loss_disc_real_0: 0.17293807864189148 (0.12582023441791534) | > loss_disc_real_1: 0.21066595613956451 (0.2224849984049797) | > loss_disc_real_2: 0.22610339522361755 (0.23617901653051376) | > loss_disc_real_3: 0.2763245403766632 (0.30639271438121796) | > loss_disc_real_4: 0.3732869625091553 (0.4121629446744919) | > loss_disc_real_5: 0.30819079279899597 (0.3178759962320328) | > loss_0: 2.782529592514038 (2.4646154642105103) | > loss_gen: 1.8997074365615845 (2.9415767788887024) | > loss_kl: 2.0962769985198975 (2.6550341844558716) | > loss_feat: 1.4217491149902344 (5.2182793617248535) | > loss_mel: 11.819218635559082 (18.605459690093994) | > loss_duration: 1.9785325527191162 (2.025467276573181) | > loss_1: 19.215484619140625 (31.445816040039062)  --> STEP: 3 | > loss_disc: 3.0987966060638428 (2.676009178161621) | > loss_disc_real_0: 0.048584599047899246 (0.10007502262790997) | > loss_disc_real_1: 0.2719741761684418 (0.23898139099280039) | > loss_disc_real_2: 0.23776645958423615 (0.2367081642150879) | > loss_disc_real_3: 0.3450394570827484 (0.3192749619483948) | > loss_disc_real_4: 0.40647098422050476 (0.41026562452316284) | > loss_disc_real_5: 0.393894225358963 (0.3432154059410095) | > loss_0: 3.0987966060638428 (2.676009178161621) | > loss_gen: 1.7264295816421509 (2.536527713139852) | > loss_kl: 2.7073090076446533 (2.672459125518799) | > loss_feat: 2.2421605587005615 (4.226239760716756) | > loss_mel: 22.465715408325195 (19.892211596171062) | > loss_duration: 2.136561155319214 (2.0624985694885254) | > loss_1: 31.278173446655273 (31.3899351755778) --> EVAL PERFORMANCE | > avg_loader_time: 0.01953721046447754 (+0.012620687484741211) | > avg_loss_disc: 2.676009178161621 (-0.06835198402404785) | > avg_loss_disc_real_0: 0.10007502262790997 (-0.08418646330634753) | > avg_loss_disc_real_1: 0.23898139099280039 (-0.04451984663804373) | > avg_loss_disc_real_2: 0.2367081642150879 (-0.05006304879983264) | > avg_loss_disc_real_3: 0.3192749619483948 (+0.09682351847489676) | > avg_loss_disc_real_4: 0.41026562452316284 (+0.12163835763931274) | > avg_loss_disc_real_5: 0.3432154059410095 (-0.03218130022287369) | > avg_loss_0: 2.676009178161621 (-0.06835198402404785) | > avg_loss_gen: 2.536527713139852 (+0.26387075583140085) | > avg_loss_kl: 2.672459125518799 (+0.3376105626424155) | > avg_loss_feat: 4.226239760716756 (-0.5181651512781782) | > avg_loss_mel: 19.892211596171062 (+0.38379335403442383) | > avg_loss_duration: 2.0624985694885254 (-0.017856836318969727) | > avg_loss_1: 31.3899351755778 (+0.4492499033610038)  > EPOCH: 44/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:09:05)   --> TIME: 2023-10-20 00:09:24 -- STEP: 29/50 -- GLOBAL_STEP: 55230 | > loss_disc: 2.598381757736206 (2.315983168010054) | > loss_disc_real_0: 0.146521657705307 (0.1361815495223835) | > loss_disc_real_1: 0.26002055406570435 (0.2246031989825183) | > loss_disc_real_2: 0.2311040610074997 (0.22933587431907654) | > loss_disc_real_3: 0.2560510039329529 (0.2320393804974597) | > loss_disc_real_4: 0.2542116940021515 (0.22252274111940942) | > loss_disc_real_5: 0.2855406105518341 (0.1658952990867968) | > loss_0: 2.598381757736206 (2.315983168010054) | > grad_norm_0: tensor(890.1119, device='cuda:0') (tensor(1441.6852, device='cuda:0')) | > loss_gen: 2.22249174118042 (2.6474968647134713) | > loss_kl: 0.9086014032363892 (1.2684362263515079) | > loss_feat: 2.932116746902466 (6.656977632950092) | > loss_mel: 30.098115921020508 (26.81663330670061) | > loss_duration: 1.9579230546951294 (1.9129009123506218) | > loss_1: 38.1192512512207 (39.30244468820507) | > grad_norm_1: tensor(22520.8164, device='cuda:0') (tensor(56749.8594, device='cuda:0')) | > current_lr_0: 0.00019139026512678941 | > current_lr_1: 0.00019139026512678941 | > step_time: 0.6855 (0.5125346265990158) | > loader_time: 0.0251 (0.015655081847618366)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.318004608154297 (3.318004608154297) | > loss_disc_real_0: 0.750531792640686 (0.750531792640686) | > loss_disc_real_1: 0.34735849499702454 (0.34735849499702454) | > loss_disc_real_2: 0.24696052074432373 (0.24696052074432373) | > loss_disc_real_3: 0.22601436078548431 (0.22601436078548431) | > loss_disc_real_4: 0.24019841849803925 (0.24019841849803925) | > loss_disc_real_5: 0.1639246940612793 (0.1639246940612793) | > loss_0: 3.318004608154297 (3.318004608154297) | > loss_gen: 1.9749062061309814 (1.9749062061309814) | > loss_kl: 2.110677719116211 (2.110677719116211) | > loss_feat: 0.07512263208627701 (0.07512263208627701) | > loss_mel: 15.239457130432129 (15.239457130432129) | > loss_duration: 1.9760335683822632 (1.9760335683822632) | > loss_1: 21.376197814941406 (21.376197814941406)  --> STEP: 1 | > loss_disc: 3.3334834575653076 (3.3334834575653076) | > loss_disc_real_0: 0.7588655948638916 (0.7588655948638916) | > loss_disc_real_1: 0.34745165705680847 (0.34745165705680847) | > loss_disc_real_2: 0.24880832433700562 (0.24880832433700562) | > loss_disc_real_3: 0.226448193192482 (0.226448193192482) | > loss_disc_real_4: 0.24097059667110443 (0.24097059667110443) | > loss_disc_real_5: 0.16373075544834137 (0.16373075544834137) | > loss_0: 3.3334834575653076 (3.3334834575653076) | > loss_gen: 1.9848958253860474 (1.9848958253860474) | > loss_kl: 1.8844493627548218 (1.8844493627548218) | > loss_feat: 0.06156661733984947 (0.06156661733984947) | > loss_mel: 24.082857131958008 (24.082857131958008) | > loss_duration: 2.111297607421875 (2.111297607421875) | > loss_1: 30.12506675720215 (30.12506675720215)  --> STEP: 2 | > loss_disc: 2.9850051403045654 (3.1592442989349365) | > loss_disc_real_0: 0.0950256735086441 (0.42694563418626785) | > loss_disc_real_1: 0.35471150279045105 (0.35108157992362976) | > loss_disc_real_2: 0.19737577438354492 (0.22309204936027527) | > loss_disc_real_3: 0.2096557766199112 (0.2180519849061966) | > loss_disc_real_4: 0.2393314689397812 (0.2401510328054428) | > loss_disc_real_5: 0.14249147474765778 (0.15311111509799957) | > loss_0: 2.9850051403045654 (3.1592442989349365) | > loss_gen: 1.514507532119751 (1.7497016787528992) | > loss_kl: 1.8689342737197876 (1.8766918182373047) | > loss_feat: 3.1275157928466797 (1.5945412050932646) | > loss_mel: 31.268329620361328 (27.675593376159668) | > loss_duration: 2.002298593521118 (2.0567981004714966) | > loss_1: 39.781585693359375 (34.95332622528076)  --> STEP: 3 | > loss_disc: 2.6853599548339844 (3.0012828509012857) | > loss_disc_real_0: 0.14383018016815186 (0.3325738161802292) | > loss_disc_real_1: 0.21940568089485168 (0.30718961358070374) | > loss_disc_real_2: 0.27407410740852356 (0.24008606870969137) | > loss_disc_real_3: 0.18682855367660522 (0.2076441744963328) | > loss_disc_real_4: 0.23752202093601227 (0.23927469551563263) | > loss_disc_real_5: 0.1331547051668167 (0.14645897845427194) | > loss_0: 2.6853599548339844 (3.0012828509012857) | > loss_gen: 1.6171914339065552 (1.7055315971374512) | > loss_kl: 3.3583621978759766 (2.370581944783529) | > loss_feat: 3.003903388977051 (2.0643285997211933) | > loss_mel: 27.80918312072754 (27.720123291015625) | > loss_duration: 2.150499105453491 (2.088031768798828) | > loss_1: 37.93913650512695 (35.94859631856283) --> EVAL PERFORMANCE | > avg_loader_time: 0.012145121892293295 (-0.007392088572184244) | > avg_loss_disc: 3.0012828509012857 (+0.32527367273966457) | > avg_loss_disc_real_0: 0.3325738161802292 (+0.23249879355231923) | > avg_loss_disc_real_1: 0.30718961358070374 (+0.06820822258790335) | > avg_loss_disc_real_2: 0.24008606870969137 (+0.003377904494603484) | > avg_loss_disc_real_3: 0.2076441744963328 (-0.11163078745206198) | > avg_loss_disc_real_4: 0.23927469551563263 (-0.1709909290075302) | > avg_loss_disc_real_5: 0.14645897845427194 (-0.19675642748673758) | > avg_loss_0: 3.0012828509012857 (+0.32527367273966457) | > avg_loss_gen: 1.7055315971374512 (-0.8309961160024009) | > avg_loss_kl: 2.370581944783529 (-0.30187718073527003) | > avg_loss_feat: 2.0643285997211933 (-2.1619111609955626) | > avg_loss_mel: 27.720123291015625 (+7.827911694844563) | > avg_loss_duration: 2.088031768798828 (+0.025533199310302734) | > avg_loss_1: 35.94859631856283 (+4.558661142985027)  > EPOCH: 45/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:09:42)   --> TIME: 2023-10-20 00:09:50 -- STEP: 9/50 -- GLOBAL_STEP: 55260 | > loss_disc: 2.8782079219818115 (2.5253966914282904) | > loss_disc_real_0: 0.0273287370800972 (0.1800328933944305) | > loss_disc_real_1: 0.32842928171157837 (0.22196959373023775) | > loss_disc_real_2: 0.19403241574764252 (0.16783674019906256) | > loss_disc_real_3: 0.2916228175163269 (0.24678605794906616) | > loss_disc_real_4: 0.3060077130794525 (0.17694295342597696) | > loss_disc_real_5: 0.2753201425075531 (0.18159214593470097) | > loss_0: 2.8782079219818115 (2.5253966914282904) | > grad_norm_0: tensor(2086.3787, device='cuda:0') (tensor(2175.1438, device='cuda:0')) | > loss_gen: 1.994006872177124 (2.418876197603014) | > loss_kl: 1.2692136764526367 (1.1324265864160326) | > loss_feat: 1.3596570491790771 (5.986665498051378) | > loss_mel: 25.819700241088867 (25.71778498755561) | > loss_duration: 1.7581735849380493 (1.8968049552705553) | > loss_1: 32.20075225830078 (37.15255906846788) | > grad_norm_1: tensor(9466.2803, device='cuda:0') (tensor(63421.6602, device='cuda:0')) | > current_lr_0: 0.0001911989585739735 | > current_lr_1: 0.0001911989585739735 | > step_time: 0.283 (0.48753197987874347) | > loader_time: 0.0058 (0.015911261240641277)  --> TIME: 2023-10-20 00:10:04 -- STEP: 39/50 -- GLOBAL_STEP: 55290 | > loss_disc: 2.6406335830688477 (2.524367039020245) | > loss_disc_real_0: 0.27014467120170593 (0.1815543798968578) | > loss_disc_real_1: 0.3274630904197693 (0.24025768672044462) | > loss_disc_real_2: 0.3018481135368347 (0.22690685981741318) | > loss_disc_real_3: 0.23611363768577576 (0.2684409656585791) | > loss_disc_real_4: 0.21056881546974182 (0.22295612999452993) | > loss_disc_real_5: 0.43223854899406433 (0.23605500682233235) | > loss_0: 2.6406335830688477 (2.524367039020245) | > grad_norm_0: tensor(1610.8531, device='cuda:0') (tensor(1675.4426, device='cuda:0')) | > loss_gen: 2.3411648273468018 (2.4276075515991606) | > loss_kl: 0.8913457989692688 (1.1808321063335125) | > loss_feat: 2.609785318374634 (5.181806423152104) | > loss_mel: 27.011301040649414 (25.917709546211434) | > loss_duration: 1.8484519720077515 (1.8844331013850677) | > loss_1: 34.702049255371094 (36.59238930237599) | > grad_norm_1: tensor(25703.2695, device='cuda:0') (tensor(46552.8398, device='cuda:0')) | > current_lr_0: 0.0001911989585739735 | > current_lr_1: 0.0001911989585739735 | > step_time: 0.2999 (0.4442453323266445) | > loader_time: 0.0023 (0.014750981942201275)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1375436782836914 (2.1375436782836914) | > loss_disc_real_0: 0.0811011791229248 (0.0811011791229248) | > loss_disc_real_1: 0.1465032994747162 (0.1465032994747162) | > loss_disc_real_2: 0.16630472242832184 (0.16630472242832184) | > loss_disc_real_3: 0.3180241882801056 (0.3180241882801056) | > loss_disc_real_4: 0.37607401609420776 (0.37607401609420776) | > loss_disc_real_5: 0.3577253818511963 (0.3577253818511963) | > loss_0: 2.1375436782836914 (2.1375436782836914) | > loss_gen: 3.04276967048645 (3.04276967048645) | > loss_kl: 1.9168418645858765 (1.9168418645858765) | > loss_feat: 6.9081807136535645 (6.9081807136535645) | > loss_mel: 26.894100189208984 (26.894100189208984) | > loss_duration: 1.973338007926941 (1.973338007926941) | > loss_1: 40.735233306884766 (40.735233306884766)  --> STEP: 1 | > loss_disc: 2.716878652572632 (2.716878652572632) | > loss_disc_real_0: 0.1532350480556488 (0.1532350480556488) | > loss_disc_real_1: 0.2092590034008026 (0.2092590034008026) | > loss_disc_real_2: 0.24530231952667236 (0.24530231952667236) | > loss_disc_real_3: 0.2855963408946991 (0.2855963408946991) | > loss_disc_real_4: 0.2690375745296478 (0.2690375745296478) | > loss_disc_real_5: 0.13216233253479004 (0.13216233253479004) | > loss_0: 2.716878652572632 (2.716878652572632) | > loss_gen: 1.8433364629745483 (1.8433364629745483) | > loss_kl: 2.5608863830566406 (2.5608863830566406) | > loss_feat: 4.6969380378723145 (4.6969380378723145) | > loss_mel: 26.638153076171875 (26.638153076171875) | > loss_duration: 2.0529091358184814 (2.0529091358184814) | > loss_1: 37.7922248840332 (37.7922248840332)  --> STEP: 2 | > loss_disc: 2.4796061515808105 (2.598242402076721) | > loss_disc_real_0: 0.02851482480764389 (0.09087493643164635) | > loss_disc_real_1: 0.1824760138988495 (0.19586750864982605) | > loss_disc_real_2: 0.15259160101413727 (0.19894696027040482) | > loss_disc_real_3: 0.36216193437576294 (0.323879137635231) | > loss_disc_real_4: 0.23852010071277618 (0.253778837621212) | > loss_disc_real_5: 0.19752484560012817 (0.1648435890674591) | > loss_0: 2.4796061515808105 (2.598242402076721) | > loss_gen: 2.049022912979126 (1.9461796879768372) | > loss_kl: 1.9143744707107544 (2.2376304268836975) | > loss_feat: 7.143740177154541 (5.920339107513428) | > loss_mel: 29.121671676635742 (27.87991237640381) | > loss_duration: 2.0616114139556885 (2.057260274887085) | > loss_1: 42.29042053222656 (40.04132270812988)  --> STEP: 3 | > loss_disc: 2.103950262069702 (2.433478355407715) | > loss_disc_real_0: 0.1689462512731552 (0.11689870804548264) | > loss_disc_real_1: 0.3140442669391632 (0.23525976141293845) | > loss_disc_real_2: 0.1655869334936142 (0.18782695134480795) | > loss_disc_real_3: 0.4299471378326416 (0.35923513770103455) | > loss_disc_real_4: 0.18558688461780548 (0.2310481866200765) | > loss_disc_real_5: 0.13839255273342133 (0.1560265769561132) | > loss_0: 2.103950262069702 (2.433478355407715) | > loss_gen: 2.857762575149536 (2.250040650367737) | > loss_kl: 2.25134015083313 (2.242200334866842) | > loss_feat: 5.202991962432861 (5.681223392486572) | > loss_mel: 25.37701988220215 (27.04561487833659) | > loss_duration: 2.213404655456543 (2.109308401743571) | > loss_1: 37.90251922607422 (39.32838821411133) --> EVAL PERFORMANCE | > avg_loader_time: 0.01618472735087077 (+0.0040396054585774745) | > avg_loss_disc: 2.433478355407715 (-0.5678044954935708) | > avg_loss_disc_real_0: 0.11689870804548264 (-0.21567510813474655) | > avg_loss_disc_real_1: 0.23525976141293845 (-0.07192985216776529) | > avg_loss_disc_real_2: 0.18782695134480795 (-0.05225911736488342) | > avg_loss_disc_real_3: 0.35923513770103455 (+0.15159096320470175) | > avg_loss_disc_real_4: 0.2310481866200765 (-0.008226508895556123) | > avg_loss_disc_real_5: 0.1560265769561132 (+0.009567598501841246) | > avg_loss_0: 2.433478355407715 (-0.5678044954935708) | > avg_loss_gen: 2.250040650367737 (+0.5445090532302856) | > avg_loss_kl: 2.242200334866842 (-0.128381609916687) | > avg_loss_feat: 5.681223392486572 (+3.616894792765379) | > avg_loss_mel: 27.04561487833659 (-0.6745084126790353) | > avg_loss_duration: 2.109308401743571 (+0.02127663294474269) | > avg_loss_1: 39.32838821411133 (+3.3797918955485002)  > EPOCH: 46/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:10:20)   --> TIME: 2023-10-20 00:10:33 -- STEP: 19/50 -- GLOBAL_STEP: 55320 | > loss_disc: 2.553492546081543 (2.4782979802081457) | > loss_disc_real_0: 0.07878773659467697 (0.15494300944632605) | > loss_disc_real_1: 0.14677421748638153 (0.2592146357423381) | > loss_disc_real_2: 0.17153945565223694 (0.23035144570626712) | > loss_disc_real_3: 0.18059533834457397 (0.22726588264891975) | > loss_disc_real_4: 0.13568760454654694 (0.24294097819610647) | > loss_disc_real_5: 0.03851982206106186 (0.20016197095576085) | > loss_0: 2.553492546081543 (2.4782979802081457) | > grad_norm_0: tensor(1408.0503, device='cuda:0') (tensor(999.8129, device='cuda:0')) | > loss_gen: 2.5287294387817383 (2.3886699739255404) | > loss_kl: 1.2407176494598389 (1.2554061946115995) | > loss_feat: 6.2663373947143555 (4.802241484585561) | > loss_mel: 28.107818603515625 (23.767925613804866) | > loss_duration: 2.1122028827667236 (1.9570113483228182) | > loss_1: 40.25580596923828 (34.17125496111419) | > grad_norm_1: tensor(55996.4297, device='cuda:0') (tensor(60104.3359, device='cuda:0')) | > current_lr_0: 0.00019100784324403472 | > current_lr_1: 0.00019100784324403472 | > step_time: 0.3387 (0.5133118378488641) | > loader_time: 0.0097 (0.01701607202228747)  --> TIME: 2023-10-20 00:10:49 -- STEP: 49/50 -- GLOBAL_STEP: 55350 | > loss_disc: 2.3860678672790527 (2.5227015553688514) | > loss_disc_real_0: 0.1486893892288208 (0.17985265188831456) | > loss_disc_real_1: 0.25207892060279846 (0.24883059655525258) | > loss_disc_real_2: 0.2680855095386505 (0.2243351922655592) | > loss_disc_real_3: 0.27615800499916077 (0.24152709779386616) | > loss_disc_real_4: 0.2957567274570465 (0.21939370294614713) | > loss_disc_real_5: 0.3425646722316742 (0.22121244935052736) | > loss_0: 2.3860678672790527 (2.5227015553688514) | > grad_norm_0: tensor(983.5720, device='cuda:0') (tensor(1359.1907, device='cuda:0')) | > loss_gen: 2.8567914962768555 (2.455917025098995) | > loss_kl: 0.9180718660354614 (1.2144085923019714) | > loss_feat: 4.1991071701049805 (4.855230530913996) | > loss_mel: 23.40435791015625 (23.49985329472289) | > loss_duration: 1.9475001096725464 (1.9002228318428507) | > loss_1: 33.325828552246094 (33.92563258385171) | > grad_norm_1: tensor(46399.8516, device='cuda:0') (tensor(51989.7070, device='cuda:0')) | > current_lr_0: 0.00019100784324403472 | > current_lr_1: 0.00019100784324403472 | > step_time: 0.5359 (0.5030044292917055) | > loader_time: 0.2035 (0.022499921370525745)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1654415130615234 (3.1654415130615234) | > loss_disc_real_0: 0.04357108846306801 (0.04357108846306801) | > loss_disc_real_1: 0.25687313079833984 (0.25687313079833984) | > loss_disc_real_2: 0.21818864345550537 (0.21818864345550537) | > loss_disc_real_3: 0.31574851274490356 (0.31574851274490356) | > loss_disc_real_4: 0.32757747173309326 (0.32757747173309326) | > loss_disc_real_5: 0.2843850255012512 (0.2843850255012512) | > loss_0: 3.1654415130615234 (3.1654415130615234) | > loss_gen: 1.4470624923706055 (1.4470624923706055) | > loss_kl: 1.474461555480957 (1.474461555480957) | > loss_feat: 0.12774920463562012 (0.12774920463562012) | > loss_mel: 12.573419570922852 (12.573419570922852) | > loss_duration: 1.9826816320419312 (1.9826816320419312) | > loss_1: 17.605375289916992 (17.605375289916992)  --> STEP: 1 | > loss_disc: 2.5648748874664307 (2.5648748874664307) | > loss_disc_real_0: 0.10773120820522308 (0.10773120820522308) | > loss_disc_real_1: 0.24791289865970612 (0.24791289865970612) | > loss_disc_real_2: 0.15629591047763824 (0.15629591047763824) | > loss_disc_real_3: 0.3770684599876404 (0.3770684599876404) | > loss_disc_real_4: 0.42863529920578003 (0.42863529920578003) | > loss_disc_real_5: 0.4097401797771454 (0.4097401797771454) | > loss_0: 2.5648748874664307 (2.5648748874664307) | > loss_gen: 2.7542378902435303 (2.7542378902435303) | > loss_kl: 2.10498309135437 (2.10498309135437) | > loss_feat: 5.9496588706970215 (5.9496588706970215) | > loss_mel: 28.164594650268555 (28.164594650268555) | > loss_duration: 2.0949699878692627 (2.0949699878692627) | > loss_1: 41.06844711303711 (41.06844711303711)  --> STEP: 2 | > loss_disc: 1.9266383647918701 (2.2457566261291504) | > loss_disc_real_0: 0.1578250229358673 (0.1327781155705452) | > loss_disc_real_1: 0.0560595877468586 (0.15198624320328236) | > loss_disc_real_2: 0.12867586314678192 (0.14248588681221008) | > loss_disc_real_3: 0.3135124444961548 (0.3452904522418976) | > loss_disc_real_4: 0.10361889004707336 (0.2661270946264267) | > loss_disc_real_5: 0.10370481014251709 (0.25672249495983124) | > loss_0: 1.9266383647918701 (2.2457566261291504) | > loss_gen: 2.451674699783325 (2.6029562950134277) | > loss_kl: 2.0765864849090576 (2.090784788131714) | > loss_feat: 10.435028076171875 (8.192343473434448) | > loss_mel: 24.103906631469727 (26.13425064086914) | > loss_duration: 2.029810667037964 (2.0623903274536133) | > loss_1: 41.097007751464844 (41.08272743225098)  --> STEP: 3 | > loss_disc: 2.153956174850464 (2.2151564757029214) | > loss_disc_real_0: 0.07274593412876129 (0.11276738842328389) | > loss_disc_real_1: 0.22855418920516968 (0.17750889187057814) | > loss_disc_real_2: 0.12418566644191742 (0.13638581335544586) | > loss_disc_real_3: 0.2876148819923401 (0.32606526215871173) | > loss_disc_real_4: 0.3543357849121094 (0.2955299913883209) | > loss_disc_real_5: 0.12042155861854553 (0.211288849512736) | > loss_0: 2.153956174850464 (2.2151564757029214) | > loss_gen: 2.338927984237671 (2.5149468580881753) | > loss_kl: 3.0638415813446045 (2.4151370525360107) | > loss_feat: 4.605922698974609 (6.996869881947835) | > loss_mel: 22.875402450561523 (25.0479679107666) | > loss_duration: 2.1435816287994385 (2.089454094568888) | > loss_1: 35.02767562866211 (39.06437683105469) --> EVAL PERFORMANCE | > avg_loader_time: 0.011263608932495117 (-0.004921118418375652) | > avg_loss_disc: 2.2151564757029214 (-0.21832187970479344) | > avg_loss_disc_real_0: 0.11276738842328389 (-0.004131319622198745) | > avg_loss_disc_real_1: 0.17750889187057814 (-0.057750869542360306) | > avg_loss_disc_real_2: 0.13638581335544586 (-0.05144113798936209) | > avg_loss_disc_real_3: 0.32606526215871173 (-0.03316987554232281) | > avg_loss_disc_real_4: 0.2955299913883209 (+0.06448180476824442) | > avg_loss_disc_real_5: 0.211288849512736 (+0.055262272556622805) | > avg_loss_0: 2.2151564757029214 (-0.21832187970479344) | > avg_loss_gen: 2.5149468580881753 (+0.2649062077204385) | > avg_loss_kl: 2.4151370525360107 (+0.17293671766916896) | > avg_loss_feat: 6.996869881947835 (+1.3156464894612627) | > avg_loss_mel: 25.0479679107666 (-1.9976469675699882) | > avg_loss_duration: 2.089454094568888 (-0.019854307174682617) | > avg_loss_1: 39.06437683105469 (-0.2640113830566406)  > EPOCH: 47/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:10:59)   --> TIME: 2023-10-20 00:11:17 -- STEP: 29/50 -- GLOBAL_STEP: 55380 | > loss_disc: 3.05115008354187 (2.484972361860604) | > loss_disc_real_0: 0.3208005428314209 (0.15455616393993643) | > loss_disc_real_1: 0.2677137851715088 (0.24660195718551503) | > loss_disc_real_2: 0.22424732148647308 (0.224210720637749) | > loss_disc_real_3: 0.3766409754753113 (0.2408000318140819) | > loss_disc_real_4: 0.28842487931251526 (0.2649941164357909) | > loss_disc_real_5: 0.30466917157173157 (0.23617262329007016) | > loss_0: 3.05115008354187 (2.484972361860604) | > grad_norm_0: tensor(2699.7163, device='cuda:0') (tensor(1535.3427, device='cuda:0')) | > loss_gen: 1.8385626077651978 (2.553982845668135) | > loss_kl: 1.7098805904388428 (1.308014456568093) | > loss_feat: 0.18455347418785095 (6.014775562902977) | > loss_mel: 18.456289291381836 (27.764245962274487) | > loss_duration: 1.9269535541534424 (1.9166823091178105) | > loss_1: 24.116239547729492 (39.557701702775645) | > grad_norm_1: tensor(17805.8887, device='cuda:0') (tensor(42867.9648, device='cuda:0')) | > current_lr_0: 0.00019081691894583383 | > current_lr_1: 0.00019081691894583383 | > step_time: 1.4916 (0.46199212403133) | > loader_time: 0.017 (0.012163655511264143)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6681984663009644 (1.6681984663009644) | > loss_disc_real_0: 0.13653400540351868 (0.13653400540351868) | > loss_disc_real_1: 0.10468341410160065 (0.10468341410160065) | > loss_disc_real_2: 0.10288994014263153 (0.10288994014263153) | > loss_disc_real_3: 0.16269774734973907 (0.16269774734973907) | > loss_disc_real_4: 0.18691253662109375 (0.18691253662109375) | > loss_disc_real_5: 0.12650178372859955 (0.12650178372859955) | > loss_0: 1.6681984663009644 (1.6681984663009644) | > loss_gen: 4.91157341003418 (4.91157341003418) | > loss_kl: 1.7370821237564087 (1.7370821237564087) | > loss_feat: 12.365755081176758 (12.365755081176758) | > loss_mel: 28.511850357055664 (28.511850357055664) | > loss_duration: 1.9626331329345703 (1.9626331329345703) | > loss_1: 49.4888916015625 (49.4888916015625)  --> STEP: 1 | > loss_disc: 2.370664358139038 (2.370664358139038) | > loss_disc_real_0: 0.15741410851478577 (0.15741410851478577) | > loss_disc_real_1: 0.15856730937957764 (0.15856730937957764) | > loss_disc_real_2: 0.17106427252292633 (0.17106427252292633) | > loss_disc_real_3: 0.2578694820404053 (0.2578694820404053) | > loss_disc_real_4: 0.14500941336154938 (0.14500941336154938) | > loss_disc_real_5: 0.34301576018333435 (0.34301576018333435) | > loss_0: 2.370664358139038 (2.370664358139038) | > loss_gen: 2.9930572509765625 (2.9930572509765625) | > loss_kl: 1.9940521717071533 (1.9940521717071533) | > loss_feat: 6.390324592590332 (6.390324592590332) | > loss_mel: 26.586868286132812 (26.586868286132812) | > loss_duration: 2.132547616958618 (2.132547616958618) | > loss_1: 40.09685134887695 (40.09685134887695)  --> STEP: 2 | > loss_disc: 2.7613205909729004 (2.5659924745559692) | > loss_disc_real_0: 0.1405715048313141 (0.14899280667304993) | > loss_disc_real_1: 0.30810874700546265 (0.23333802819252014) | > loss_disc_real_2: 0.3146195113658905 (0.24284189194440842) | > loss_disc_real_3: 0.29176440834999084 (0.27481694519519806) | > loss_disc_real_4: 0.16101884841918945 (0.15301413089036942) | > loss_disc_real_5: 0.3405645489692688 (0.3417901545763016) | > loss_0: 2.7613205909729004 (2.5659924745559692) | > loss_gen: 2.433995485305786 (2.7135263681411743) | > loss_kl: 1.8114925622940063 (1.9027723670005798) | > loss_feat: 4.595821380615234 (5.493072986602783) | > loss_mel: 26.27435302734375 (26.43061065673828) | > loss_duration: 2.0208897590637207 (2.0767186880111694) | > loss_1: 37.13655090332031 (38.61670112609863)  --> STEP: 3 | > loss_disc: 2.0505318641662598 (2.394172271092733) | > loss_disc_real_0: 0.2422858327627182 (0.18009048203627268) | > loss_disc_real_1: 0.2461128830909729 (0.23759631315867105) | > loss_disc_real_2: 0.13637834787368774 (0.20735404392083487) | > loss_disc_real_3: 0.30468207597732544 (0.28477198878924054) | > loss_disc_real_4: 0.10935410857200623 (0.1384607901175817) | > loss_disc_real_5: 0.05744275450706482 (0.247007687886556) | > loss_0: 2.0505318641662598 (2.394172271092733) | > loss_gen: 2.340367078781128 (2.589139938354492) | > loss_kl: 1.7740763425827026 (1.8598736921946208) | > loss_feat: 5.00102424621582 (5.329056739807129) | > loss_mel: 25.555307388305664 (26.138842900594074) | > loss_duration: 2.1383562088012695 (2.097264528274536) | > loss_1: 36.80912780761719 (38.01417668660482) --> EVAL PERFORMANCE | > avg_loader_time: 0.012882312138875326 (+0.001618703206380209) | > avg_loss_disc: 2.394172271092733 (+0.1790157953898115) | > avg_loss_disc_real_0: 0.18009048203627268 (+0.06732309361298879) | > avg_loss_disc_real_1: 0.23759631315867105 (+0.06008742128809291) | > avg_loss_disc_real_2: 0.20735404392083487 (+0.070968230565389) | > avg_loss_disc_real_3: 0.28477198878924054 (-0.041293273369471195) | > avg_loss_disc_real_4: 0.1384607901175817 (-0.15706920127073923) | > avg_loss_disc_real_5: 0.247007687886556 (+0.035718838373820005) | > avg_loss_0: 2.394172271092733 (+0.1790157953898115) | > avg_loss_gen: 2.589139938354492 (+0.07419308026631688) | > avg_loss_kl: 1.8598736921946208 (-0.5552633603413899) | > avg_loss_feat: 5.329056739807129 (-1.667813142140706) | > avg_loss_mel: 26.138842900594074 (+1.0908749898274728) | > avg_loss_duration: 2.097264528274536 (+0.0078104337056479345) | > avg_loss_1: 38.01417668660482 (-1.0502001444498674)  > EPOCH: 48/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:11:34)   --> TIME: 2023-10-20 00:11:44 -- STEP: 9/50 -- GLOBAL_STEP: 55410 | > loss_disc: 2.6736059188842773 (2.464079644944933) | > loss_disc_real_0: 0.13584940135478973 (0.1908727834622065) | > loss_disc_real_1: 0.3137362003326416 (0.28279779603083927) | > loss_disc_real_2: 0.3041033148765564 (0.2486333470377657) | > loss_disc_real_3: 0.3262973725795746 (0.2410174103246795) | > loss_disc_real_4: 0.3060680031776428 (0.22207430005073547) | > loss_disc_real_5: 0.3521536886692047 (0.23740327523814309) | > loss_0: 2.6736059188842773 (2.464079644944933) | > grad_norm_0: tensor(566.7356, device='cuda:0') (tensor(811.9364, device='cuda:0')) | > loss_gen: 2.4418938159942627 (2.512174235449897) | > loss_kl: 1.1479583978652954 (1.1269123587343428) | > loss_feat: 3.975111484527588 (4.307897796233495) | > loss_mel: 26.307662963867188 (25.195951461791992) | > loss_duration: 1.768767237663269 (1.8807314369413588) | > loss_1: 35.641395568847656 (35.02366744147407) | > grad_norm_1: tensor(7918.9927, device='cuda:0') (tensor(33708.0469, device='cuda:0')) | > current_lr_0: 0.0001906261854884226 | > current_lr_1: 0.0001906261854884226 | > step_time: 0.3077 (0.5155558586120605) | > loader_time: 0.0252 (0.019646935992770724)  --> TIME: 2023-10-20 00:11:59 -- STEP: 39/50 -- GLOBAL_STEP: 55440 | > loss_disc: 2.6089394092559814 (2.5285185758884143) | > loss_disc_real_0: 0.3272310197353363 (0.1763905200581902) | > loss_disc_real_1: 0.15265201032161713 (0.24482468362802115) | > loss_disc_real_2: 0.30125758051872253 (0.2571356948942709) | > loss_disc_real_3: 0.19095638394355774 (0.25875058636451376) | > loss_disc_real_4: 0.205600768327713 (0.23349255600418806) | > loss_disc_real_5: 0.22753773629665375 (0.2381886264357047) | > loss_0: 2.6089394092559814 (2.5285185758884143) | > grad_norm_0: tensor(2474.4849, device='cuda:0') (tensor(1091.7002, device='cuda:0')) | > loss_gen: 2.374300718307495 (2.4627415247452564) | > loss_kl: 0.7082163691520691 (1.2412879321819692) | > loss_feat: 4.303820610046387 (4.833393116983085) | > loss_mel: 23.121841430664062 (25.157276300283577) | > loss_duration: 1.9285122156143188 (1.8888670939665575) | > loss_1: 32.43669128417969 (35.58356598096017) | > grad_norm_1: tensor(54024.4062, device='cuda:0') (tensor(38247.1211, device='cuda:0')) | > current_lr_0: 0.0001906261854884226 | > current_lr_1: 0.0001906261854884226 | > step_time: 0.4797 (0.4919627018463919) | > loader_time: 0.0249 (0.020306911223973982)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.310772657394409 (2.310772657394409) | > loss_disc_real_0: 0.26147401332855225 (0.26147401332855225) | > loss_disc_real_1: 0.07120735943317413 (0.07120735943317413) | > loss_disc_real_2: 0.13862326741218567 (0.13862326741218567) | > loss_disc_real_3: 0.2070138156414032 (0.2070138156414032) | > loss_disc_real_4: 0.3232637941837311 (0.3232637941837311) | > loss_disc_real_5: 0.2726171910762787 (0.2726171910762787) | > loss_0: 2.310772657394409 (2.310772657394409) | > loss_gen: 2.614136219024658 (2.614136219024658) | > loss_kl: 2.0236854553222656 (2.0236854553222656) | > loss_feat: 7.672551155090332 (7.672551155090332) | > loss_mel: 28.09571647644043 (28.09571647644043) | > loss_duration: 1.9435452222824097 (1.9435452222824097) | > loss_1: 42.34963607788086 (42.34963607788086)  --> STEP: 1 | > loss_disc: 2.5470688343048096 (2.5470688343048096) | > loss_disc_real_0: 0.4242522716522217 (0.4242522716522217) | > loss_disc_real_1: 0.1958155632019043 (0.1958155632019043) | > loss_disc_real_2: 0.23612642288208008 (0.23612642288208008) | > loss_disc_real_3: 0.10288410633802414 (0.10288410633802414) | > loss_disc_real_4: 0.4196510910987854 (0.4196510910987854) | > loss_disc_real_5: 0.36151009798049927 (0.36151009798049927) | > loss_0: 2.5470688343048096 (2.5470688343048096) | > loss_gen: 2.876338005065918 (2.876338005065918) | > loss_kl: 2.480541467666626 (2.480541467666626) | > loss_feat: 5.331654071807861 (5.331654071807861) | > loss_mel: 26.418533325195312 (26.418533325195312) | > loss_duration: 2.141446113586426 (2.141446113586426) | > loss_1: 39.248512268066406 (39.248512268066406)  --> STEP: 2 | > loss_disc: 2.1363577842712402 (2.341713309288025) | > loss_disc_real_0: 0.32921117544174194 (0.3767317235469818) | > loss_disc_real_1: 0.20278576016426086 (0.19930066168308258) | > loss_disc_real_2: 0.29848697781562805 (0.26730670034885406) | > loss_disc_real_3: 0.2550908923149109 (0.17898749932646751) | > loss_disc_real_4: 0.07706500589847565 (0.24835804849863052) | > loss_disc_real_5: 0.05592340975999832 (0.2087167538702488) | > loss_0: 2.1363577842712402 (2.341713309288025) | > loss_gen: 2.48024582862854 (2.678291916847229) | > loss_kl: 2.489241123199463 (2.4848912954330444) | > loss_feat: 4.453232765197754 (4.892443418502808) | > loss_mel: 32.787498474121094 (29.603015899658203) | > loss_duration: 2.088474750518799 (2.1149604320526123) | > loss_1: 44.2986946105957 (41.773603439331055)  --> STEP: 3 | > loss_disc: 2.6620116233825684 (2.448479413986206) | > loss_disc_real_0: 0.3471302092075348 (0.36686455210049945) | > loss_disc_real_1: 0.24194970726966858 (0.21351701021194458) | > loss_disc_real_2: 0.195562481880188 (0.2433919608592987) | > loss_disc_real_3: 0.2469300478696823 (0.20163501550753912) | > loss_disc_real_4: 0.29078060388565063 (0.2624989002943039) | > loss_disc_real_5: 0.4348258376121521 (0.2840864484508832) | > loss_0: 2.6620116233825684 (2.448479413986206) | > loss_gen: 2.4061145782470703 (2.5875661373138428) | > loss_kl: 1.161336064338684 (2.043706218401591) | > loss_feat: 2.620170831680298 (4.135019222895305) | > loss_mel: 17.075929641723633 (25.42732048034668) | > loss_duration: 2.081451654434204 (2.103790839513143) | > loss_1: 25.345003128051758 (36.29740333557129) --> EVAL PERFORMANCE | > avg_loader_time: 0.0017881393432617188 (-0.011094172795613607) | > avg_loss_disc: 2.448479413986206 (+0.05430714289347316) | > avg_loss_disc_real_0: 0.36686455210049945 (+0.18677407006422678) | > avg_loss_disc_real_1: 0.21351701021194458 (-0.024079302946726472) | > avg_loss_disc_real_2: 0.2433919608592987 (+0.03603791693846384) | > avg_loss_disc_real_3: 0.20163501550753912 (-0.08313697328170142) | > avg_loss_disc_real_4: 0.2624989002943039 (+0.1240381101767222) | > avg_loss_disc_real_5: 0.2840864484508832 (+0.03707876056432721) | > avg_loss_0: 2.448479413986206 (+0.05430714289347316) | > avg_loss_gen: 2.5875661373138428 (-0.001573801040649414) | > avg_loss_kl: 2.043706218401591 (+0.18383252620697) | > avg_loss_feat: 4.135019222895305 (-1.1940375169118242) | > avg_loss_mel: 25.42732048034668 (-0.7115224202473946) | > avg_loss_duration: 2.103790839513143 (+0.006526311238606919) | > avg_loss_1: 36.29740333557129 (-1.716773351033531)  > EPOCH: 49/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:12:13)   --> TIME: 2023-10-20 00:12:29 -- STEP: 19/50 -- GLOBAL_STEP: 55470 | > loss_disc: 3.094820499420166 (2.4398065930918644) | > loss_disc_real_0: 0.1770765483379364 (0.20437043434695193) | > loss_disc_real_1: 0.24500232934951782 (0.23186683576357991) | > loss_disc_real_2: 0.27346470952033997 (0.23487646446416252) | > loss_disc_real_3: 0.28611552715301514 (0.20590735383723913) | > loss_disc_real_4: 0.2654649615287781 (0.20547671919982685) | > loss_disc_real_5: 0.2392418384552002 (0.24165717659420088) | > loss_0: 3.094820499420166 (2.4398065930918644) | > grad_norm_0: tensor(493.3383, device='cuda:0') (tensor(1717.4794, device='cuda:0')) | > loss_gen: 1.528950810432434 (2.540622874310142) | > loss_kl: 1.2347068786621094 (1.4084315080391734) | > loss_feat: 0.36086419224739075 (5.769308710421779) | > loss_mel: 12.646513938903809 (22.47320911131407) | > loss_duration: 2.0397439002990723 (1.9272741518522565) | > loss_1: 17.810779571533203 (34.11884674273039) | > grad_norm_1: tensor(4813.0171, device='cuda:0') (tensor(58144.3555, device='cuda:0')) | > current_lr_0: 0.0001904356426810438 | > current_lr_1: 0.0001904356426810438 | > step_time: 0.5936 (0.5096473568364194) | > loader_time: 0.0119 (0.01477990652385511)  --> TIME: 2023-10-20 00:12:46 -- STEP: 49/50 -- GLOBAL_STEP: 55500 | > loss_disc: 2.698068618774414 (2.4832325516914846) | > loss_disc_real_0: 0.33482879400253296 (0.18388566867049252) | > loss_disc_real_1: 0.3090687394142151 (0.23048731433797856) | > loss_disc_real_2: 0.2151993066072464 (0.22100243975921552) | > loss_disc_real_3: 0.32770636677742004 (0.24087526960944644) | > loss_disc_real_4: 0.34851449728012085 (0.21874068000791025) | > loss_disc_real_5: 0.21892879903316498 (0.22442214848587708) | > loss_0: 2.698068618774414 (2.4832325516914846) | > grad_norm_0: tensor(1149.2897, device='cuda:0') (tensor(1037.4642, device='cuda:0')) | > loss_gen: 2.513394832611084 (2.4761947004162534) | > loss_kl: 0.9205551743507385 (1.1885864162931634) | > loss_feat: 2.9936110973358154 (5.560354215549115) | > loss_mel: 26.217979431152344 (24.404166593843577) | > loss_duration: 1.9488525390625 (1.8823202751120742) | > loss_1: 34.594390869140625 (35.51162235104308) | > grad_norm_1: tensor(10050.2246, device='cuda:0') (tensor(33184.9258, device='cuda:0')) | > current_lr_0: 0.0001904356426810438 | > current_lr_1: 0.0001904356426810438 | > step_time: 0.6125 (0.5202289065536186) | > loader_time: 0.3036 (0.022092021241479985)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7273705005645752 (1.7273705005645752) | > loss_disc_real_0: 0.06268404424190521 (0.06268404424190521) | > loss_disc_real_1: 0.11779973655939102 (0.11779973655939102) | > loss_disc_real_2: 0.1173265129327774 (0.1173265129327774) | > loss_disc_real_3: 0.29583871364593506 (0.29583871364593506) | > loss_disc_real_4: 0.2484869509935379 (0.2484869509935379) | > loss_disc_real_5: 0.2097541093826294 (0.2097541093826294) | > loss_0: 1.7273705005645752 (1.7273705005645752) | > loss_gen: 3.0020947456359863 (3.0020947456359863) | > loss_kl: 1.3572624921798706 (1.3572624921798706) | > loss_feat: 10.448213577270508 (10.448213577270508) | > loss_mel: 25.581348419189453 (25.581348419189453) | > loss_duration: 1.9455174207687378 (1.9455174207687378) | > loss_1: 42.33443832397461 (42.33443832397461)  --> STEP: 1 | > loss_disc: 3.0804789066314697 (3.0804789066314697) | > loss_disc_real_0: 0.3143541216850281 (0.3143541216850281) | > loss_disc_real_1: 0.31415271759033203 (0.31415271759033203) | > loss_disc_real_2: 0.2944079339504242 (0.2944079339504242) | > loss_disc_real_3: 0.3264022171497345 (0.3264022171497345) | > loss_disc_real_4: 0.43012043833732605 (0.43012043833732605) | > loss_disc_real_5: 0.2775581479072571 (0.2775581479072571) | > loss_0: 3.0804789066314697 (3.0804789066314697) | > loss_gen: 1.9605813026428223 (1.9605813026428223) | > loss_kl: 2.6210849285125732 (2.6210849285125732) | > loss_feat: 0.07206127047538757 (0.07206127047538757) | > loss_mel: 15.788736343383789 (15.788736343383789) | > loss_duration: 2.166194438934326 (2.166194438934326) | > loss_1: 22.608657836914062 (22.608657836914062)  --> STEP: 2 | > loss_disc: 3.0882985591888428 (3.0843887329101562) | > loss_disc_real_0: 0.31890517473220825 (0.31662964820861816) | > loss_disc_real_1: 0.3139163553714752 (0.3140345364809036) | > loss_disc_real_2: 0.29414990544319153 (0.29427891969680786) | > loss_disc_real_3: 0.326453298330307 (0.32642775774002075) | > loss_disc_real_4: 0.43009820580482483 (0.43010932207107544) | > loss_disc_real_5: 0.27715110778808594 (0.2773546278476715) | > loss_0: 3.0882985591888428 (3.0843887329101562) | > loss_gen: 1.9551430940628052 (1.9578621983528137) | > loss_kl: 2.3195865154266357 (2.4703357219696045) | > loss_feat: 0.020350385457277298 (0.046205827966332436) | > loss_mel: 2.881061315536499 (9.334898829460144) | > loss_duration: 2.0826947689056396 (2.124444603919983) | > loss_1: 9.258835792541504 (15.933746814727783)  --> STEP: 3 | > loss_disc: 2.7221899032592773 (2.9636557896931968) | > loss_disc_real_0: 0.19883596897125244 (0.2773650884628296) | > loss_disc_real_1: 0.2879522740840912 (0.3053404490152995) | > loss_disc_real_2: 0.32602736353874207 (0.30486173431078595) | > loss_disc_real_3: 0.30618956685066223 (0.31968169411023456) | > loss_disc_real_4: 0.4609487056732178 (0.44038911660512287) | > loss_disc_real_5: 0.28977853059768677 (0.28149592876434326) | > loss_0: 2.7221899032592773 (2.9636557896931968) | > loss_gen: 2.612905979156494 (2.176210125287374) | > loss_kl: 1.0437886714935303 (1.9948200384775798) | > loss_feat: 2.344609498977661 (0.8123403849701086) | > loss_mel: 21.61894416809082 (13.429580609003702) | > loss_duration: 1.999546766281128 (2.0828119913736978) | > loss_1: 29.619794845581055 (20.495762825012207) --> EVAL PERFORMANCE | > avg_loader_time: 0.02417763074239095 (+0.02238949139912923) | > avg_loss_disc: 2.9636557896931968 (+0.5151763757069907) | > avg_loss_disc_real_0: 0.2773650884628296 (-0.08949946363766986) | > avg_loss_disc_real_1: 0.3053404490152995 (+0.09182343880335492) | > avg_loss_disc_real_2: 0.30486173431078595 (+0.06146977345148724) | > avg_loss_disc_real_3: 0.31968169411023456 (+0.11804667860269544) | > avg_loss_disc_real_4: 0.44038911660512287 (+0.17789021631081897) | > avg_loss_disc_real_5: 0.28149592876434326 (-0.0025905196865399494) | > avg_loss_0: 2.9636557896931968 (+0.5151763757069907) | > avg_loss_gen: 2.176210125287374 (-0.41135601202646876) | > avg_loss_kl: 1.9948200384775798 (-0.04888617992401101) | > avg_loss_feat: 0.8123403849701086 (-3.322678837925196) | > avg_loss_mel: 13.429580609003702 (-11.997739871342977) | > avg_loss_duration: 2.0828119913736978 (-0.020978848139445283) | > avg_loss_1: 20.495762825012207 (-15.801640510559082) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_55501.pth  > EPOCH: 50/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:12:55)   --> TIME: 2023-10-20 00:13:12 -- STEP: 29/50 -- GLOBAL_STEP: 55530 | > loss_disc: 2.175532341003418 (2.4437755305191566) | > loss_disc_real_0: 0.03292005509138107 (0.19736062497671308) | > loss_disc_real_1: 0.399894118309021 (0.2242131595467699) | > loss_disc_real_2: 0.2296333611011505 (0.21595140572251945) | > loss_disc_real_3: 0.33770713210105896 (0.27343668377604974) | > loss_disc_real_4: 0.07987868040800095 (0.23996554539892176) | > loss_disc_real_5: 0.18370866775512695 (0.21179802034949435) | > loss_0: 2.175532341003418 (2.4437755305191566) | > grad_norm_0: tensor(321.6256, device='cuda:0') (tensor(638.1607, device='cuda:0')) | > loss_gen: 2.911473274230957 (2.57380919209842) | > loss_kl: 1.0964285135269165 (1.2235289647661407) | > loss_feat: 8.037516593933105 (6.20613160074271) | > loss_mel: 26.605220794677734 (26.897090681667986) | > loss_duration: 1.8797670602798462 (1.896855851699566) | > loss_1: 40.5304069519043 (38.79741648969979) | > grad_norm_1: tensor(13989.9727, device='cuda:0') (tensor(25346.2246, device='cuda:0')) | > current_lr_0: 0.00019024529033313074 | > current_lr_1: 0.00019024529033313074 | > step_time: 0.6629 (0.4514599421928669) | > loader_time: 0.0222 (0.011836808303306842)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8045406341552734 (1.8045406341552734) | > loss_disc_real_0: 0.07042339444160461 (0.07042339444160461) | > loss_disc_real_1: 0.11887471377849579 (0.11887471377849579) | > loss_disc_real_2: 0.1180490180850029 (0.1180490180850029) | > loss_disc_real_3: 0.3163630962371826 (0.3163630962371826) | > loss_disc_real_4: 0.040967896580696106 (0.040967896580696106) | > loss_disc_real_5: 0.12017577141523361 (0.12017577141523361) | > loss_0: 1.8045406341552734 (1.8045406341552734) | > loss_gen: 2.4991307258605957 (2.4991307258605957) | > loss_kl: 1.4983677864074707 (1.4983677864074707) | > loss_feat: 8.23930835723877 (8.23930835723877) | > loss_mel: 26.508729934692383 (26.508729934692383) | > loss_duration: 1.930599570274353 (1.930599570274353) | > loss_1: 40.6761360168457 (40.6761360168457)  --> STEP: 1 | > loss_disc: 3.204094171524048 (3.204094171524048) | > loss_disc_real_0: 0.1582789123058319 (0.1582789123058319) | > loss_disc_real_1: 0.3526453673839569 (0.3526453673839569) | > loss_disc_real_2: 0.18613871932029724 (0.18613871932029724) | > loss_disc_real_3: 0.26473864912986755 (0.26473864912986755) | > loss_disc_real_4: 0.24520675837993622 (0.24520675837993622) | > loss_disc_real_5: 0.28352534770965576 (0.28352534770965576) | > loss_0: 3.204094171524048 (3.204094171524048) | > loss_gen: 1.5717724561691284 (1.5717724561691284) | > loss_kl: 3.0463647842407227 (3.0463647842407227) | > loss_feat: 3.4264755249023438 (3.4264755249023438) | > loss_mel: 23.3550968170166 (23.3550968170166) | > loss_duration: 2.076063632965088 (2.076063632965088) | > loss_1: 33.475772857666016 (33.475772857666016)  --> STEP: 2 | > loss_disc: 3.0548229217529297 (3.1294585466384888) | > loss_disc_real_0: 0.1134757250547409 (0.1358773186802864) | > loss_disc_real_1: 0.3319801986217499 (0.3423127830028534) | > loss_disc_real_2: 0.24552951753139496 (0.2158341184258461) | > loss_disc_real_3: 0.3109075725078583 (0.2878231108188629) | > loss_disc_real_4: 0.3058931231498718 (0.275549940764904) | > loss_disc_real_5: 0.29252389073371887 (0.2880246192216873) | > loss_0: 3.0548229217529297 (3.1294585466384888) | > loss_gen: 1.6557061672210693 (1.6137393116950989) | > loss_kl: 2.057281494140625 (2.551823139190674) | > loss_feat: 0.20437827706336975 (1.8154269009828568) | > loss_mel: 4.344955921173096 (13.850026369094849) | > loss_duration: 2.106562376022339 (2.0913130044937134) | > loss_1: 10.368885040283203 (21.92232894897461)  --> STEP: 3 | > loss_disc: 2.931882381439209 (3.0635998249053955) | > loss_disc_real_0: 0.15211346745491028 (0.1412893682718277) | > loss_disc_real_1: 0.364106684923172 (0.3495774169762929) | > loss_disc_real_2: 0.24424807727336884 (0.225305438041687) | > loss_disc_real_3: 0.31666669249534607 (0.2974376380443573) | > loss_disc_real_4: 0.30372729897499084 (0.2849423935015996) | > loss_disc_real_5: 0.2843286693096161 (0.2867926359176636) | > loss_0: 2.931882381439209 (3.0635998249053955) | > loss_gen: 1.8273446559906006 (1.6849410931269329) | > loss_kl: 1.0348293781280518 (2.0461585521698) | > loss_feat: 0.5043932199478149 (1.3784156739711761) | > loss_mel: 14.4566650390625 (14.052239259084066) | > loss_duration: 2.0341176986694336 (2.0722479025522866) | > loss_1: 19.857349395751953 (21.234002431233723) --> EVAL PERFORMANCE | > avg_loader_time: 0.01641090710957845 (-0.0077667236328125) | > avg_loss_disc: 3.0635998249053955 (+0.09994403521219875) | > avg_loss_disc_real_0: 0.1412893682718277 (-0.1360757201910019) | > avg_loss_disc_real_1: 0.3495774169762929 (+0.04423696796099341) | > avg_loss_disc_real_2: 0.225305438041687 (-0.07955629626909894) | > avg_loss_disc_real_3: 0.2974376380443573 (-0.02224405606587726) | > avg_loss_disc_real_4: 0.2849423935015996 (-0.15544672310352325) | > avg_loss_disc_real_5: 0.2867926359176636 (+0.0052967071533203125) | > avg_loss_0: 3.0635998249053955 (+0.09994403521219875) | > avg_loss_gen: 1.6849410931269329 (-0.49126903216044115) | > avg_loss_kl: 2.0461585521698 (+0.05133851369221998) | > avg_loss_feat: 1.3784156739711761 (+0.5660752890010675) | > avg_loss_mel: 14.052239259084066 (+0.6226586500803641) | > avg_loss_duration: 2.0722479025522866 (-0.010564088821411133) | > avg_loss_1: 21.234002431233723 (+0.7382396062215157)  > EPOCH: 51/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:13:30)   --> TIME: 2023-10-20 00:13:38 -- STEP: 9/50 -- GLOBAL_STEP: 55560 | > loss_disc: 2.8362369537353516 (2.885292556550768) | > loss_disc_real_0: 0.10618627071380615 (0.19842981381548774) | > loss_disc_real_1: 0.254893958568573 (0.24742848094966677) | > loss_disc_real_2: 0.22878015041351318 (0.24580710464053684) | > loss_disc_real_3: 0.31138044595718384 (0.25232890496651333) | > loss_disc_real_4: 0.27179819345474243 (0.27634596162372166) | > loss_disc_real_5: 0.2294265627861023 (0.23527525199784172) | > loss_0: 2.8362369537353516 (2.885292556550768) | > grad_norm_0: tensor(349.7221, device='cuda:0') (tensor(557.3505, device='cuda:0')) | > loss_gen: 1.6557459831237793 (2.090762562221951) | > loss_kl: 0.9509133100509644 (1.159112983279758) | > loss_feat: 1.4226317405700684 (4.307166753543748) | > loss_mel: 22.01607894897461 (26.17866759830051) | > loss_duration: 1.7363392114639282 (1.8306037717395358) | > loss_1: 27.781709671020508 (35.56631321377225) | > grad_norm_1: tensor(5926.7427, device='cuda:0') (tensor(21040.7891, device='cuda:0')) | > current_lr_0: 0.00019005512825430728 | > current_lr_1: 0.00019005512825430728 | > step_time: 0.5914 (0.5386063522762723) | > loader_time: 0.0265 (0.01608329349093967)  --> TIME: 2023-10-20 00:13:54 -- STEP: 39/50 -- GLOBAL_STEP: 55590 | > loss_disc: 1.9004786014556885 (2.534473186884171) | > loss_disc_real_0: 0.5033631324768066 (0.16993263533386666) | > loss_disc_real_1: 0.20538142323493958 (0.2380214314430188) | > loss_disc_real_2: 0.07738903164863586 (0.23708408707991624) | > loss_disc_real_3: 0.2178618311882019 (0.23639049495642) | > loss_disc_real_4: 0.19598467648029327 (0.2295942712479677) | > loss_disc_real_5: 0.0759773999452591 (0.20677765621206698) | > loss_0: 1.9004786014556885 (2.534473186884171) | > grad_norm_0: tensor(1075.1560, device='cuda:0') (tensor(713.0317, device='cuda:0')) | > loss_gen: 4.5838165283203125 (2.3860429219710517) | > loss_kl: 0.9226440787315369 (1.1478301836894111) | > loss_feat: 14.389543533325195 (5.195744873239444) | > loss_mel: 30.88838005065918 (25.231791753035324) | > loss_duration: 1.8404220342636108 (1.8700634974699755) | > loss_1: 52.62480926513672 (35.83147305708665) | > grad_norm_1: tensor(63491.4609, device='cuda:0') (tensor(24157.3242, device='cuda:0')) | > current_lr_0: 0.00019005512825430728 | > current_lr_1: 0.00019005512825430728 | > step_time: 0.5855 (0.5021412678253957) | > loader_time: 0.0241 (0.018516375468327448)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.042008399963379 (3.042008399963379) | > loss_disc_real_0: 0.3909003734588623 (0.3909003734588623) | > loss_disc_real_1: 0.26656225323677063 (0.26656225323677063) | > loss_disc_real_2: 0.26028117537498474 (0.26028117537498474) | > loss_disc_real_3: 0.2624468505382538 (0.2624468505382538) | > loss_disc_real_4: 0.2879519760608673 (0.2879519760608673) | > loss_disc_real_5: 0.22620224952697754 (0.22620224952697754) | > loss_0: 3.042008399963379 (3.042008399963379) | > loss_gen: 1.6903337240219116 (1.6903337240219116) | > loss_kl: 1.7232238054275513 (1.7232238054275513) | > loss_feat: 0.009442037902772427 (0.009442037902772427) | > loss_mel: 2.216729164123535 (2.216729164123535) | > loss_duration: 1.9857319593429565 (1.9857319593429565) | > loss_1: 7.625461101531982 (7.625461101531982)  --> STEP: 1 | > loss_disc: 2.6424312591552734 (2.6424312591552734) | > loss_disc_real_0: 0.1662575751543045 (0.1662575751543045) | > loss_disc_real_1: 0.29369696974754333 (0.29369696974754333) | > loss_disc_real_2: 0.21231397986412048 (0.21231397986412048) | > loss_disc_real_3: 0.40377116203308105 (0.40377116203308105) | > loss_disc_real_4: 0.19192153215408325 (0.19192153215408325) | > loss_disc_real_5: 0.24721765518188477 (0.24721765518188477) | > loss_0: 2.6424312591552734 (2.6424312591552734) | > loss_gen: 2.233786106109619 (2.233786106109619) | > loss_kl: 3.1117987632751465 (3.1117987632751465) | > loss_feat: 6.303624629974365 (6.303624629974365) | > loss_mel: 24.614274978637695 (24.614274978637695) | > loss_duration: 2.089125871658325 (2.089125871658325) | > loss_1: 38.35261154174805 (38.35261154174805)  --> STEP: 2 | > loss_disc: 2.1481847763061523 (2.395308017730713) | > loss_disc_real_0: 0.13261796534061432 (0.1494377702474594) | > loss_disc_real_1: 0.23810088634490967 (0.2658989280462265) | > loss_disc_real_2: 0.30021315813064575 (0.2562635689973831) | > loss_disc_real_3: 0.35323214530944824 (0.37850165367126465) | > loss_disc_real_4: 0.12164819240570068 (0.15678486227989197) | > loss_disc_real_5: 0.11071854829788208 (0.17896810173988342) | > loss_0: 2.1481847763061523 (2.395308017730713) | > loss_gen: 2.5232110023498535 (2.3784985542297363) | > loss_kl: 2.039928913116455 (2.575863838195801) | > loss_feat: 5.7748894691467285 (6.039257049560547) | > loss_mel: 30.19605255126953 (27.405163764953613) | > loss_duration: 2.035517692565918 (2.0623217821121216) | > loss_1: 42.569602966308594 (40.46110725402832)  --> STEP: 3 | > loss_disc: 2.7252981662750244 (2.50530473391215) | > loss_disc_real_0: 0.33870750665664673 (0.2125276823838552) | > loss_disc_real_1: 0.18682453036308289 (0.23954079548517862) | > loss_disc_real_2: 0.3070743680000305 (0.27320050199826557) | > loss_disc_real_3: 0.1642398238182068 (0.30708104372024536) | > loss_disc_real_4: 0.34081944823265076 (0.2181297242641449) | > loss_disc_real_5: 0.3099099099636078 (0.22261537114779154) | > loss_0: 2.7252981662750244 (2.50530473391215) | > loss_gen: 2.198943614959717 (2.3186469078063965) | > loss_kl: 1.1480131149291992 (2.0999135971069336) | > loss_feat: 2.949918270111084 (5.009477456410726) | > loss_mel: 17.718875885009766 (24.176401138305664) | > loss_duration: 2.0372791290283203 (2.053974231084188) | > loss_1: 26.053030014038086 (35.65841484069824) --> EVAL PERFORMANCE | > avg_loader_time: 0.002174933751424154 (-0.014235973358154295) | > avg_loss_disc: 2.50530473391215 (-0.5582950909932456) | > avg_loss_disc_real_0: 0.2125276823838552 (+0.0712383141120275) | > avg_loss_disc_real_1: 0.23954079548517862 (-0.11003662149111429) | > avg_loss_disc_real_2: 0.27320050199826557 (+0.047895063956578554) | > avg_loss_disc_real_3: 0.30708104372024536 (+0.009643405675888062) | > avg_loss_disc_real_4: 0.2181297242641449 (-0.06681266923745471) | > avg_loss_disc_real_5: 0.22261537114779154 (-0.06417726476987204) | > avg_loss_0: 2.50530473391215 (-0.5582950909932456) | > avg_loss_gen: 2.3186469078063965 (+0.6337058146794636) | > avg_loss_kl: 2.0999135971069336 (+0.05375504493713379) | > avg_loss_feat: 5.009477456410726 (+3.6310617824395495) | > avg_loss_mel: 24.176401138305664 (+10.124161879221598) | > avg_loss_duration: 2.053974231084188 (-0.018273671468098662) | > avg_loss_1: 35.65841484069824 (+14.42441240946452)  > EPOCH: 52/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:14:09)   --> TIME: 2023-10-20 00:14:23 -- STEP: 19/50 -- GLOBAL_STEP: 55620 | > loss_disc: 3.008389711380005 (2.6497814718045687) | > loss_disc_real_0: 0.09708596765995026 (0.19955735977150893) | > loss_disc_real_1: 0.27638906240463257 (0.24605032095783635) | > loss_disc_real_2: 0.3482847213745117 (0.26258120940704094) | > loss_disc_real_3: 0.3216107487678528 (0.2528713610219328) | > loss_disc_real_4: 0.25445154309272766 (0.2943537766604047) | > loss_disc_real_5: 0.30033209919929504 (0.23343317994945928) | > loss_0: 3.008389711380005 (2.6497814718045687) | > grad_norm_0: tensor(459.9642, device='cuda:0') (tensor(569.0266, device='cuda:0')) | > loss_gen: 1.838553547859192 (2.483143499023036) | > loss_kl: 1.2141422033309937 (1.2394423108351857) | > loss_feat: 2.9160566329956055 (5.4856201284810115) | > loss_mel: 24.989151000976562 (25.457447742160998) | > loss_duration: 2.0246362686157227 (1.9275050226010775) | > loss_1: 32.982540130615234 (36.59315927405106) | > grad_norm_1: tensor(5603.8276, device='cuda:0') (tensor(18263.8906, device='cuda:0')) | > current_lr_0: 0.00018986515625438747 | > current_lr_1: 0.00018986515625438747 | > step_time: 0.5823 (0.5364465337050589) | > loader_time: 0.0244 (0.015937403628700657)  --> TIME: 2023-10-20 00:14:39 -- STEP: 49/50 -- GLOBAL_STEP: 55650 | > loss_disc: 2.600682497024536 (2.4703160256755594) | > loss_disc_real_0: 0.2472025454044342 (0.1522912245471867) | > loss_disc_real_1: 0.20513950288295746 (0.23596937695936288) | > loss_disc_real_2: 0.18472661077976227 (0.2309016481193961) | > loss_disc_real_3: 0.33533814549446106 (0.23815885847624468) | > loss_disc_real_4: 0.31193265318870544 (0.23353070377999421) | > loss_disc_real_5: 0.23776130378246307 (0.22570396237531487) | > loss_0: 2.600682497024536 (2.4703160256755594) | > grad_norm_0: tensor(445.1425, device='cuda:0') (tensor(497.0550, device='cuda:0')) | > loss_gen: 2.6393203735351562 (2.505306703703744) | > loss_kl: 0.871784508228302 (1.2349304289233924) | > loss_feat: 5.6489105224609375 (5.738927344734571) | > loss_mel: 30.14553451538086 (25.566095872801178) | > loss_duration: 1.9615963697433472 (1.8740444742903417) | > loss_1: 41.267147064208984 (36.91930508127018) | > grad_norm_1: tensor(22462.5195, device='cuda:0') (tensor(20335.1895, device='cuda:0')) | > current_lr_0: 0.00018986515625438747 | > current_lr_1: 0.00018986515625438747 | > step_time: 0.5238 (0.5135473523821149) | > loader_time: 0.2408 (0.022329092025756836)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0849788188934326 (3.0849788188934326) | > loss_disc_real_0: 0.08476535975933075 (0.08476535975933075) | > loss_disc_real_1: 0.08858063817024231 (0.08858063817024231) | > loss_disc_real_2: 0.41351890563964844 (0.41351890563964844) | > loss_disc_real_3: 0.4356350302696228 (0.4356350302696228) | > loss_disc_real_4: 0.6518985629081726 (0.6518985629081726) | > loss_disc_real_5: 0.6307564973831177 (0.6307564973831177) | > loss_0: 3.0849788188934326 (3.0849788188934326) | > loss_gen: 3.7838470935821533 (3.7838470935821533) | > loss_kl: 1.782145380973816 (1.782145380973816) | > loss_feat: 6.9474663734436035 (6.9474663734436035) | > loss_mel: 25.748796463012695 (25.748796463012695) | > loss_duration: 1.9634828567504883 (1.9634828567504883) | > loss_1: 40.225738525390625 (40.225738525390625)  --> STEP: 1 | > loss_disc: 1.7692811489105225 (1.7692811489105225) | > loss_disc_real_0: 0.03444870561361313 (0.03444870561361313) | > loss_disc_real_1: 0.11716616898775101 (0.11716616898775101) | > loss_disc_real_2: 0.12606008350849152 (0.12606008350849152) | > loss_disc_real_3: 0.27218443155288696 (0.27218443155288696) | > loss_disc_real_4: 0.16707304120063782 (0.16707304120063782) | > loss_disc_real_5: 0.1603001356124878 (0.1603001356124878) | > loss_0: 1.7692811489105225 (1.7692811489105225) | > loss_gen: 3.564547061920166 (3.564547061920166) | > loss_kl: 3.7039501667022705 (3.7039501667022705) | > loss_feat: 9.197364807128906 (9.197364807128906) | > loss_mel: 25.167848587036133 (25.167848587036133) | > loss_duration: 2.1345572471618652 (2.1345572471618652) | > loss_1: 43.76826858520508 (43.76826858520508)  --> STEP: 2 | > loss_disc: 2.9338314533233643 (2.3515563011169434) | > loss_disc_real_0: 0.20949527621269226 (0.1219719909131527) | > loss_disc_real_1: 0.3062639832496643 (0.21171507611870766) | > loss_disc_real_2: 0.296722412109375 (0.21139124780893326) | > loss_disc_real_3: 0.3800985515117645 (0.32614149153232574) | > loss_disc_real_4: 0.2568051517009735 (0.21193909645080566) | > loss_disc_real_5: 0.42394623160362244 (0.2921231836080551) | > loss_0: 2.9338314533233643 (2.3515563011169434) | > loss_gen: 2.4229788780212402 (2.993762969970703) | > loss_kl: 2.044414758682251 (2.8741824626922607) | > loss_feat: 5.903570175170898 (7.550467491149902) | > loss_mel: 28.293062210083008 (26.73045539855957) | > loss_duration: 2.004246234893799 (2.069401741027832) | > loss_1: 40.668270111083984 (42.21826934814453)  --> STEP: 3 | > loss_disc: 2.7760326862335205 (2.4930484294891357) | > loss_disc_real_0: 0.23094408214092255 (0.1582960213224093) | > loss_disc_real_1: 0.31433773040771484 (0.2459226275483767) | > loss_disc_real_2: 0.23549683392047882 (0.21942644317944845) | > loss_disc_real_3: 0.31533458828926086 (0.32253919045130414) | > loss_disc_real_4: 0.22422344982624054 (0.21603388090928397) | > loss_disc_real_5: 0.18447744846343994 (0.2562412718931834) | > loss_0: 2.7760326862335205 (2.4930484294891357) | > loss_gen: 1.791907787322998 (2.5931445757548013) | > loss_kl: 1.163472294807434 (2.3039457400639853) | > loss_feat: 0.9398975372314453 (5.346944173177083) | > loss_mel: 21.539260864257812 (25.000057220458984) | > loss_duration: 2.0679774284362793 (2.068926970163981) | > loss_1: 27.502517700195312 (37.313018798828125) --> EVAL PERFORMANCE | > avg_loader_time: 0.012537399927775065 (+0.01036246617635091) | > avg_loss_disc: 2.4930484294891357 (-0.012256304423014175) | > avg_loss_disc_real_0: 0.1582960213224093 (-0.05423166106144589) | > avg_loss_disc_real_1: 0.2459226275483767 (+0.00638183206319809) | > avg_loss_disc_real_2: 0.21942644317944845 (-0.05377405881881711) | > avg_loss_disc_real_3: 0.32253919045130414 (+0.015458146731058775) | > avg_loss_disc_real_4: 0.21603388090928397 (-0.0020958433548609323) | > avg_loss_disc_real_5: 0.2562412718931834 (+0.03362590074539187) | > avg_loss_0: 2.4930484294891357 (-0.012256304423014175) | > avg_loss_gen: 2.5931445757548013 (+0.2744976679484048) | > avg_loss_kl: 2.3039457400639853 (+0.20403214295705174) | > avg_loss_feat: 5.346944173177083 (+0.3374667167663574) | > avg_loss_mel: 25.000057220458984 (+0.8236560821533203) | > avg_loss_duration: 2.068926970163981 (+0.014952739079792998) | > avg_loss_1: 37.313018798828125 (+1.6546039581298828)  > EPOCH: 53/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:14:48)   --> TIME: 2023-10-20 00:15:04 -- STEP: 29/50 -- GLOBAL_STEP: 55680 | > loss_disc: 3.096569061279297 (2.5435321166597564) | > loss_disc_real_0: 0.40048539638519287 (0.16845219916310802) | > loss_disc_real_1: 0.28367480635643005 (0.23925832325014576) | > loss_disc_real_2: 0.21689988672733307 (0.23162496603768448) | > loss_disc_real_3: 0.29239413142204285 (0.24035250241386477) | > loss_disc_real_4: 0.22289788722991943 (0.22600305928238507) | > loss_disc_real_5: 0.1329003870487213 (0.19824978879428115) | > loss_0: 3.096569061279297 (2.5435321166597564) | > grad_norm_0: tensor(301.0003, device='cuda:0') (tensor(649.5351, device='cuda:0')) | > loss_gen: 1.527996301651001 (2.61399767316621) | > loss_kl: 1.401362657546997 (1.3035007756331871) | > loss_feat: 0.16046260297298431 (6.026649077647719) | > loss_mel: 16.98040771484375 (24.129645100955305) | > loss_duration: 1.8581150770187378 (1.9037303020214211) | > loss_1: 21.928342819213867 (35.977523507743044) | > grad_norm_1: tensor(6861.4146, device='cuda:0') (tensor(24132.0879, device='cuda:0')) | > current_lr_0: 0.00018967537414337564 | > current_lr_1: 0.00018967537414337564 | > step_time: 0.2553 (0.4041083105679216) | > loader_time: 0.0018 (0.011037349700927733)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.131161689758301 (2.131161689758301) | > loss_disc_real_0: 0.04100429266691208 (0.04100429266691208) | > loss_disc_real_1: 0.15579843521118164 (0.15579843521118164) | > loss_disc_real_2: 0.09985893964767456 (0.09985893964767456) | > loss_disc_real_3: 0.2352096289396286 (0.2352096289396286) | > loss_disc_real_4: 0.20465484261512756 (0.20465484261512756) | > loss_disc_real_5: 0.3578127324581146 (0.3578127324581146) | > loss_0: 2.131161689758301 (2.131161689758301) | > loss_gen: 2.4864134788513184 (2.4864134788513184) | > loss_kl: 1.9398350715637207 (1.9398350715637207) | > loss_feat: 5.7111687660217285 (5.7111687660217285) | > loss_mel: 24.818967819213867 (24.818967819213867) | > loss_duration: 1.9386910200119019 (1.9386910200119019) | > loss_1: 36.89507293701172 (36.89507293701172)  --> STEP: 1 | > loss_disc: 2.265939474105835 (2.265939474105835) | > loss_disc_real_0: 0.15095046162605286 (0.15095046162605286) | > loss_disc_real_1: 0.17133182287216187 (0.17133182287216187) | > loss_disc_real_2: 0.11717725545167923 (0.11717725545167923) | > loss_disc_real_3: 0.23597383499145508 (0.23597383499145508) | > loss_disc_real_4: 0.07774139195680618 (0.07774139195680618) | > loss_disc_real_5: 0.1329592764377594 (0.1329592764377594) | > loss_0: 2.265939474105835 (2.265939474105835) | > loss_gen: 2.12158203125 (2.12158203125) | > loss_kl: 2.3178164958953857 (2.3178164958953857) | > loss_feat: 9.203200340270996 (9.203200340270996) | > loss_mel: 28.90912437438965 (28.90912437438965) | > loss_duration: 2.035581111907959 (2.035581111907959) | > loss_1: 44.587303161621094 (44.587303161621094)  --> STEP: 2 | > loss_disc: 2.6708362102508545 (2.4683878421783447) | > loss_disc_real_0: 0.2061511129140854 (0.17855078727006912) | > loss_disc_real_1: 0.2177506685256958 (0.19454124569892883) | > loss_disc_real_2: 0.2527911961078644 (0.1849842257797718) | > loss_disc_real_3: 0.3224024474620819 (0.2791881412267685) | > loss_disc_real_4: 0.26277899742126465 (0.17026019468903542) | > loss_disc_real_5: 0.303623765707016 (0.2182915210723877) | > loss_0: 2.6708362102508545 (2.4683878421783447) | > loss_gen: 2.0050721168518066 (2.0633270740509033) | > loss_kl: 2.597724199295044 (2.457770347595215) | > loss_feat: 1.7579967975616455 (5.480598568916321) | > loss_mel: 26.42085838317871 (27.66499137878418) | > loss_duration: 2.0473127365112305 (2.0414469242095947) | > loss_1: 34.82896423339844 (39.708133697509766)  --> STEP: 3 | > loss_disc: 1.822959303855896 (2.253244996070862) | > loss_disc_real_0: 0.06360983848571777 (0.14023713767528534) | > loss_disc_real_1: 0.2019006758928299 (0.19699438909689584) | > loss_disc_real_2: 0.16166003048419952 (0.17720949401458105) | > loss_disc_real_3: 0.25365549325942993 (0.27067725857098895) | > loss_disc_real_4: 0.13798268139362335 (0.15950102359056473) | > loss_disc_real_5: 0.17182596027851105 (0.20280300080776215) | > loss_0: 1.822959303855896 (2.253244996070862) | > loss_gen: 2.720334768295288 (2.2823296387990317) | > loss_kl: 1.3503813743591309 (2.0886406898498535) | > loss_feat: 5.822527885437012 (5.594575007756551) | > loss_mel: 24.963111877441406 (26.76436487833659) | > loss_duration: 2.0551295280456543 (2.0460077921549478) | > loss_1: 36.91148376464844 (38.775917053222656) --> EVAL PERFORMANCE | > avg_loader_time: 0.008183002471923828 (-0.004354397455851236) | > avg_loss_disc: 2.253244996070862 (-0.23980343341827393) | > avg_loss_disc_real_0: 0.14023713767528534 (-0.018058883647123963) | > avg_loss_disc_real_1: 0.19699438909689584 (-0.048928238451480865) | > avg_loss_disc_real_2: 0.17720949401458105 (-0.0422169491648674) | > avg_loss_disc_real_3: 0.27067725857098895 (-0.05186193188031518) | > avg_loss_disc_real_4: 0.15950102359056473 (-0.05653285731871924) | > avg_loss_disc_real_5: 0.20280300080776215 (-0.05343827108542126) | > avg_loss_0: 2.253244996070862 (-0.23980343341827393) | > avg_loss_gen: 2.2823296387990317 (-0.31081493695576956) | > avg_loss_kl: 2.0886406898498535 (-0.21530505021413182) | > avg_loss_feat: 5.594575007756551 (+0.24763083457946777) | > avg_loss_mel: 26.76436487833659 (+1.7643076578776054) | > avg_loss_duration: 2.0460077921549478 (-0.022919178009033203) | > avg_loss_1: 38.775917053222656 (+1.4628982543945312)  > EPOCH: 54/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:15:23)   --> TIME: 2023-10-20 00:15:32 -- STEP: 9/50 -- GLOBAL_STEP: 55710 | > loss_disc: 3.0654914379119873 (2.5981891685061984) | > loss_disc_real_0: 0.2724665701389313 (0.15434298622939321) | > loss_disc_real_1: 0.3755824565887451 (0.19129098372326958) | > loss_disc_real_2: 0.433078795671463 (0.24788273415631717) | > loss_disc_real_3: 0.3326943516731262 (0.33313924570878345) | > loss_disc_real_4: 0.44167906045913696 (0.24741495814588335) | > loss_disc_real_5: 0.3695102334022522 (0.23378148881925476) | > loss_0: 3.0654914379119873 (2.5981891685061984) | > grad_norm_0: tensor(610.9171, device='cuda:0') (tensor(596.2324, device='cuda:0')) | > loss_gen: 2.3723175525665283 (2.585494147406684) | > loss_kl: 1.073832631111145 (1.2666861083772447) | > loss_feat: 2.3866817951202393 (6.152659666621023) | > loss_mel: 28.3365478515625 (23.99953892495897) | > loss_duration: 1.753747582435608 (1.8323986795213487) | > loss_1: 35.923126220703125 (35.83677705128988) | > grad_norm_1: tensor(7034.1611, device='cuda:0') (tensor(23593.1699, device='cuda:0')) | > current_lr_0: 0.00018948578173146592 | > current_lr_1: 0.00018948578173146592 | > step_time: 0.5744 (0.5071363714006212) | > loader_time: 0.0174 (0.021597570843166776)  --> TIME: 2023-10-20 00:15:47 -- STEP: 39/50 -- GLOBAL_STEP: 55740 | > loss_disc: 3.085942268371582 (2.543082313659863) | > loss_disc_real_0: 0.1643432229757309 (0.1659102132782722) | > loss_disc_real_1: 0.1441746950149536 (0.22493703338580254) | > loss_disc_real_2: 0.18566395342350006 (0.23723114339204934) | > loss_disc_real_3: 0.2781684696674347 (0.26903703292975056) | > loss_disc_real_4: 0.27809450030326843 (0.24961137083860543) | > loss_disc_real_5: 0.28952598571777344 (0.24392670698654959) | > loss_0: 3.085942268371582 (2.543082313659863) | > grad_norm_0: tensor(437.9577, device='cuda:0') (tensor(604.6284, device='cuda:0')) | > loss_gen: 1.4751298427581787 (2.5406526602231536) | > loss_kl: 0.9114435911178589 (1.3440110683441162) | > loss_feat: 0.29138150811195374 (5.360097087824192) | > loss_mel: 6.7032904624938965 (24.620947868396076) | > loss_duration: 1.8569707870483398 (1.8629964681772084) | > loss_1: 11.238216400146484 (35.728705308376206) | > grad_norm_1: tensor(8817.8691, device='cuda:0') (tensor(25019.6445, device='cuda:0')) | > current_lr_0: 0.00018948578173146592 | > current_lr_1: 0.00018948578173146592 | > step_time: 0.5408 (0.5074222882588705) | > loader_time: 0.0233 (0.019563668813460913)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.133157730102539 (3.133157730102539) | > loss_disc_real_0: 0.07653677463531494 (0.07653677463531494) | > loss_disc_real_1: 0.2917536795139313 (0.2917536795139313) | > loss_disc_real_2: 0.3342115581035614 (0.3342115581035614) | > loss_disc_real_3: 0.2807590067386627 (0.2807590067386627) | > loss_disc_real_4: 0.2716972231864929 (0.2716972231864929) | > loss_disc_real_5: 0.28538522124290466 (0.28538522124290466) | > loss_0: 3.133157730102539 (3.133157730102539) | > loss_gen: 1.5209228992462158 (1.5209228992462158) | > loss_kl: 1.8335633277893066 (1.8335633277893066) | > loss_feat: 0.09092386066913605 (0.09092386066913605) | > loss_mel: 3.934940814971924 (3.934940814971924) | > loss_duration: 1.9446992874145508 (1.9446992874145508) | > loss_1: 9.325050354003906 (9.325050354003906)  --> STEP: 1 | > loss_disc: 2.4086179733276367 (2.4086179733276367) | > loss_disc_real_0: 0.060706041753292084 (0.060706041753292084) | > loss_disc_real_1: 0.22846533358097076 (0.22846533358097076) | > loss_disc_real_2: 0.2706090211868286 (0.2706090211868286) | > loss_disc_real_3: 0.2227771282196045 (0.2227771282196045) | > loss_disc_real_4: 0.17442086338996887 (0.17442086338996887) | > loss_disc_real_5: 0.2814348340034485 (0.2814348340034485) | > loss_0: 2.4086179733276367 (2.4086179733276367) | > loss_gen: 1.9524725675582886 (1.9524725675582886) | > loss_kl: 2.2594847679138184 (2.2594847679138184) | > loss_feat: 3.097594738006592 (3.097594738006592) | > loss_mel: 26.2208309173584 (26.2208309173584) | > loss_duration: 2.0910842418670654 (2.0910842418670654) | > loss_1: 35.62146759033203 (35.62146759033203)  --> STEP: 2 | > loss_disc: 3.226151943206787 (2.817384958267212) | > loss_disc_real_0: 0.17082230746746063 (0.11576417461037636) | > loss_disc_real_1: 0.3310045003890991 (0.27973491698503494) | > loss_disc_real_2: 0.22158268094062805 (0.24609585106372833) | > loss_disc_real_3: 0.3048575818538666 (0.26381735503673553) | > loss_disc_real_4: 0.2722158133983612 (0.22331833839416504) | > loss_disc_real_5: 0.23868484795093536 (0.2600598409771919) | > loss_0: 3.226151943206787 (2.817384958267212) | > loss_gen: 1.7173216342926025 (1.8348971009254456) | > loss_kl: 1.7492095232009888 (2.0043471455574036) | > loss_feat: 8.012283325195312 (5.554939031600952) | > loss_mel: 26.16295051574707 (26.191890716552734) | > loss_duration: 2.061650037765503 (2.076367139816284) | > loss_1: 39.70341491699219 (37.66244125366211)  --> STEP: 3 | > loss_disc: 2.4535481929779053 (2.69610603650411) | > loss_disc_real_0: 0.06942323595285416 (0.10031719505786896) | > loss_disc_real_1: 0.24884286522865295 (0.2694375663995743) | > loss_disc_real_2: 0.17502890527248383 (0.2224068691333135) | > loss_disc_real_3: 0.18565133213996887 (0.23776201407114664) | > loss_disc_real_4: 0.21452102065086365 (0.22038589914639792) | > loss_disc_real_5: 0.25789904594421387 (0.2593395759661992) | > loss_0: 2.4535481929779053 (2.69610603650411) | > loss_gen: 2.150289535522461 (1.940027912457784) | > loss_kl: 1.1980922222137451 (1.7355955044428508) | > loss_feat: 4.269739627838135 (5.12653923034668) | > loss_mel: 25.533105850219727 (25.9722957611084) | > loss_duration: 2.0112152099609375 (2.054649829864502) | > loss_1: 35.162445068359375 (36.82910919189453) --> EVAL PERFORMANCE | > avg_loader_time: 0.002156813939412435 (-0.006026188532511393) | > avg_loss_disc: 2.69610603650411 (+0.44286104043324803) | > avg_loss_disc_real_0: 0.10031719505786896 (-0.03991994261741638) | > avg_loss_disc_real_1: 0.2694375663995743 (+0.07244317730267844) | > avg_loss_disc_real_2: 0.2224068691333135 (+0.04519737511873245) | > avg_loss_disc_real_3: 0.23776201407114664 (-0.03291524449984232) | > avg_loss_disc_real_4: 0.22038589914639792 (+0.06088487555583319) | > avg_loss_disc_real_5: 0.2593395759661992 (+0.056536575158437075) | > avg_loss_0: 2.69610603650411 (+0.44286104043324803) | > avg_loss_gen: 1.940027912457784 (-0.3423017263412478) | > avg_loss_kl: 1.7355955044428508 (-0.3530451854070027) | > avg_loss_feat: 5.12653923034668 (-0.4680357774098711) | > avg_loss_mel: 25.9722957611084 (-0.7920691172281913) | > avg_loss_duration: 2.054649829864502 (+0.008642037709554184) | > avg_loss_1: 36.82910919189453 (-1.946807861328125)  > EPOCH: 55/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:16:03)   --> TIME: 2023-10-20 00:16:16 -- STEP: 19/50 -- GLOBAL_STEP: 55770 | > loss_disc: 3.1034858226776123 (2.4411909141038595) | > loss_disc_real_0: 0.3851361870765686 (0.19808645771914407) | > loss_disc_real_1: 0.3362884223461151 (0.231670580804348) | > loss_disc_real_2: 0.33134326338768005 (0.2348691266226141) | > loss_disc_real_3: 0.35171565413475037 (0.2353219872242526) | > loss_disc_real_4: 0.36485928297042847 (0.23151704061188197) | > loss_disc_real_5: 0.2888677716255188 (0.22268366539164594) | > loss_0: 3.1034858226776123 (2.4411909141038595) | > grad_norm_0: tensor(901.7711, device='cuda:0') (tensor(580.5986, device='cuda:0')) | > loss_gen: 1.890912413597107 (2.4518774371398124) | > loss_kl: 1.599321961402893 (1.2925188980604474) | > loss_feat: 0.048920635133981705 (5.674922905666263) | > loss_mel: 4.113898277282715 (27.313788614775007) | > loss_duration: 2.001178741455078 (1.891060327228747) | > loss_1: 9.654232025146484 (38.62416849638287) | > grad_norm_1: tensor(18596.0684, device='cuda:0') (tensor(20779.3438, device='cuda:0')) | > current_lr_0: 0.00018929637882904215 | > current_lr_1: 0.00018929637882904215 | > step_time: 0.6243 (0.4861083658117997) | > loader_time: 0.0129 (0.012558033591822575)  --> TIME: 2023-10-20 00:16:31 -- STEP: 49/50 -- GLOBAL_STEP: 55800 | > loss_disc: 2.9273486137390137 (2.4662441672111046) | > loss_disc_real_0: 0.22679203748703003 (0.19020260133001268) | > loss_disc_real_1: 0.3452872633934021 (0.23755162992343612) | > loss_disc_real_2: 0.3383253216743469 (0.22422812324093314) | > loss_disc_real_3: 0.3714046776294708 (0.24743982077557214) | > loss_disc_real_4: 0.24845203757286072 (0.21826471768471659) | > loss_disc_real_5: 0.2727348208427429 (0.20546850698943042) | > loss_0: 2.9273486137390137 (2.4662441672111046) | > grad_norm_0: tensor(709.3104, device='cuda:0') (tensor(530.8188, device='cuda:0')) | > loss_gen: 1.9891830682754517 (2.4007665113526953) | > loss_kl: 1.1590064764022827 (1.257435713571553) | > loss_feat: 0.49375152587890625 (5.336819114581663) | > loss_mel: 4.154389381408691 (24.62385145498782) | > loss_duration: 1.939484715461731 (1.8649350599366792) | > loss_1: 9.735815048217773 (35.483808069813) | > grad_norm_1: tensor(8832.6836, device='cuda:0') (tensor(18499.1914, device='cuda:0')) | > current_lr_0: 0.00018929637882904215 | > current_lr_1: 0.00018929637882904215 | > step_time: 0.4832 (0.49044108390808105) | > loader_time: 0.2532 (0.01978952544076102)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.427542805671692 (1.427542805671692) | > loss_disc_real_0: 0.08727884292602539 (0.08727884292602539) | > loss_disc_real_1: 0.06784462928771973 (0.06784462928771973) | > loss_disc_real_2: 0.09847607463598251 (0.09847607463598251) | > loss_disc_real_3: 0.11757569760084152 (0.11757569760084152) | > loss_disc_real_4: 0.03934038430452347 (0.03934038430452347) | > loss_disc_real_5: 0.0685858428478241 (0.0685858428478241) | > loss_0: 1.427542805671692 (1.427542805671692) | > loss_gen: 2.4775166511535645 (2.4775166511535645) | > loss_kl: 2.014845132827759 (2.014845132827759) | > loss_feat: 11.857009887695312 (11.857009887695312) | > loss_mel: 25.169790267944336 (25.169790267944336) | > loss_duration: 1.9556972980499268 (1.9556972980499268) | > loss_1: 43.474857330322266 (43.474857330322266)  --> STEP: 1 | > loss_disc: 2.32950496673584 (2.32950496673584) | > loss_disc_real_0: 0.07311543077230453 (0.07311543077230453) | > loss_disc_real_1: 0.24376985430717468 (0.24376985430717468) | > loss_disc_real_2: 0.3645400404930115 (0.3645400404930115) | > loss_disc_real_3: 0.26696309447288513 (0.26696309447288513) | > loss_disc_real_4: 0.17323456704616547 (0.17323456704616547) | > loss_disc_real_5: 0.3418772518634796 (0.3418772518634796) | > loss_0: 2.32950496673584 (2.32950496673584) | > loss_gen: 2.6700077056884766 (2.6700077056884766) | > loss_kl: 1.76377272605896 (1.76377272605896) | > loss_feat: 5.199655055999756 (5.199655055999756) | > loss_mel: 29.459199905395508 (29.459199905395508) | > loss_duration: 2.1352381706237793 (2.1352381706237793) | > loss_1: 41.227874755859375 (41.227874755859375)  --> STEP: 2 | > loss_disc: 2.573354482650757 (2.4514297246932983) | > loss_disc_real_0: 0.04377849027514458 (0.058446960523724556) | > loss_disc_real_1: 0.20452523231506348 (0.22414754331111908) | > loss_disc_real_2: 0.27730926871299744 (0.32092465460300446) | > loss_disc_real_3: 0.2761581540107727 (0.2715606242418289) | > loss_disc_real_4: 0.2468690127134323 (0.2100517898797989) | > loss_disc_real_5: 0.18796120584011078 (0.2649192288517952) | > loss_0: 2.573354482650757 (2.4514297246932983) | > loss_gen: 1.9422019720077515 (2.306104838848114) | > loss_kl: 2.050675630569458 (1.907224178314209) | > loss_feat: 8.897517204284668 (7.048586130142212) | > loss_mel: 28.586423873901367 (29.022811889648438) | > loss_duration: 2.071044683456421 (2.1031414270401) | > loss_1: 43.5478630065918 (42.387868881225586)  --> STEP: 3 | > loss_disc: 2.8875339031219482 (2.596797784169515) | > loss_disc_real_0: 0.2225559651851654 (0.11314996207753818) | > loss_disc_real_1: 0.34227150678634644 (0.2635221978028615) | > loss_disc_real_2: 0.3214660584926605 (0.32110512256622314) | > loss_disc_real_3: 0.35928070545196533 (0.3008006513118744) | > loss_disc_real_4: 0.23548807203769684 (0.2185305505990982) | > loss_disc_real_5: 0.2893718183040619 (0.2730700920025508) | > loss_0: 2.8875339031219482 (2.596797784169515) | > loss_gen: 1.9542039632797241 (2.188804546991984) | > loss_kl: 1.314079761505127 (1.7095093727111816) | > loss_feat: 0.4204759895801544 (4.839216083288193) | > loss_mel: 7.5733208656311035 (21.872981548309326) | > loss_duration: 2.121162176132202 (2.1091483434041343) | > loss_1: 13.3832426071167 (32.71966012318929) --> EVAL PERFORMANCE | > avg_loader_time: 0.0065030256907145185 (+0.004346211751302084) | > avg_loss_disc: 2.596797784169515 (-0.09930825233459473) | > avg_loss_disc_real_0: 0.11314996207753818 (+0.01283276701966922) | > avg_loss_disc_real_1: 0.2635221978028615 (-0.005915368596712767) | > avg_loss_disc_real_2: 0.32110512256622314 (+0.09869825343290964) | > avg_loss_disc_real_3: 0.3008006513118744 (+0.06303863724072775) | > avg_loss_disc_real_4: 0.2185305505990982 (-0.0018553485472997122) | > avg_loss_disc_real_5: 0.2730700920025508 (+0.013730516036351559) | > avg_loss_0: 2.596797784169515 (-0.09930825233459473) | > avg_loss_gen: 2.188804546991984 (+0.24877663453419996) | > avg_loss_kl: 1.7095093727111816 (-0.026086131731669182) | > avg_loss_feat: 4.839216083288193 (-0.28732314705848694) | > avg_loss_mel: 21.872981548309326 (-4.099314212799072) | > avg_loss_duration: 2.1091483434041343 (+0.05449851353963231) | > avg_loss_1: 32.71966012318929 (-4.1094490687052385)  > EPOCH: 56/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:16:39)   --> TIME: 2023-10-20 00:16:56 -- STEP: 29/50 -- GLOBAL_STEP: 55830 | > loss_disc: 1.9055309295654297 (2.513614843631613) | > loss_disc_real_0: 0.07287037372589111 (0.1728502380308406) | > loss_disc_real_1: 0.09244928508996964 (0.21969349605256114) | > loss_disc_real_2: 0.12903377413749695 (0.22385074326704288) | > loss_disc_real_3: 0.228082537651062 (0.23938058355245098) | > loss_disc_real_4: 0.12990210950374603 (0.2309943715046192) | > loss_disc_real_5: 0.03139980882406235 (0.24512801280823246) | > loss_0: 1.9055309295654297 (2.513614843631613) | > grad_norm_0: tensor(768.1978, device='cuda:0') (tensor(567.1813, device='cuda:0')) | > loss_gen: 3.2304441928863525 (2.5219802157632234) | > loss_kl: 1.190508246421814 (1.2865696426095634) | > loss_feat: 9.461891174316406 (5.70594403558764) | > loss_mel: 25.27634048461914 (21.857278297687397) | > loss_duration: 1.8721826076507568 (1.900407836355012) | > loss_1: 41.031368255615234 (33.27218024484043) | > grad_norm_1: tensor(30837.0605, device='cuda:0') (tensor(23452.7480, device='cuda:0')) | > current_lr_0: 0.00018910716524667774 | > current_lr_1: 0.00018910716524667774 | > step_time: 0.319 (0.4665448418978987) | > loader_time: 0.0033 (0.01834006145082671)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.952885627746582 (2.952885627746582) | > loss_disc_real_0: 0.33186817169189453 (0.33186817169189453) | > loss_disc_real_1: 0.3175821304321289 (0.3175821304321289) | > loss_disc_real_2: 0.2435508519411087 (0.2435508519411087) | > loss_disc_real_3: 0.21075375378131866 (0.21075375378131866) | > loss_disc_real_4: 0.2589659094810486 (0.2589659094810486) | > loss_disc_real_5: 0.41822513937950134 (0.41822513937950134) | > loss_0: 2.952885627746582 (2.952885627746582) | > loss_gen: 2.175215244293213 (2.175215244293213) | > loss_kl: 1.757641315460205 (1.757641315460205) | > loss_feat: 4.888421058654785 (4.888421058654785) | > loss_mel: 28.99495506286621 (28.99495506286621) | > loss_duration: 2.0004618167877197 (2.0004618167877197) | > loss_1: 39.81669616699219 (39.81669616699219)  --> STEP: 1 | > loss_disc: 2.812875509262085 (2.812875509262085) | > loss_disc_real_0: 0.30432379245758057 (0.30432379245758057) | > loss_disc_real_1: 0.3076121211051941 (0.3076121211051941) | > loss_disc_real_2: 0.1451413333415985 (0.1451413333415985) | > loss_disc_real_3: 0.34238430857658386 (0.34238430857658386) | > loss_disc_real_4: 0.2063637226819992 (0.2063637226819992) | > loss_disc_real_5: 0.3971123993396759 (0.3971123993396759) | > loss_0: 2.812875509262085 (2.812875509262085) | > loss_gen: 2.095181703567505 (2.095181703567505) | > loss_kl: 2.3202877044677734 (2.3202877044677734) | > loss_feat: 2.5609304904937744 (2.5609304904937744) | > loss_mel: 24.169788360595703 (24.169788360595703) | > loss_duration: 2.085594654083252 (2.085594654083252) | > loss_1: 33.23178482055664 (33.23178482055664)  --> STEP: 2 | > loss_disc: 3.251096725463867 (3.031986117362976) | > loss_disc_real_0: 0.4563702940940857 (0.38034704327583313) | > loss_disc_real_1: 0.29053759574890137 (0.29907485842704773) | > loss_disc_real_2: 0.3013855516910553 (0.2232634425163269) | > loss_disc_real_3: 0.31071165204048157 (0.3265479803085327) | > loss_disc_real_4: 0.3413914442062378 (0.2738775834441185) | > loss_disc_real_5: 0.49298954010009766 (0.4450509697198868) | > loss_0: 3.251096725463867 (3.031986117362976) | > loss_gen: 2.1048741340637207 (2.100027918815613) | > loss_kl: 1.919013261795044 (2.1196504831314087) | > loss_feat: 0.8137333393096924 (1.6873319149017334) | > loss_mel: 23.51348876953125 (23.841638565063477) | > loss_duration: 2.021559000015259 (2.0535768270492554) | > loss_1: 30.37266731262207 (31.802226066589355)  --> STEP: 3 | > loss_disc: 2.7253904342651367 (2.929787556330363) | > loss_disc_real_0: 0.24703717231750488 (0.33591041962305707) | > loss_disc_real_1: 0.5190823078155518 (0.3724106748898824) | > loss_disc_real_2: 0.3803587555885315 (0.27562854687372845) | > loss_disc_real_3: 0.18995365500450134 (0.2810165385405223) | > loss_disc_real_4: 0.21391798555850983 (0.2538910508155823) | > loss_disc_real_5: 0.2486814558506012 (0.37959446509679157) | > loss_0: 2.7253904342651367 (2.929787556330363) | > loss_gen: 2.8233482837677 (2.341134707132975) | > loss_kl: 2.901859760284424 (2.3803869088490806) | > loss_feat: 4.587654113769531 (2.6541059811909995) | > loss_mel: 22.73201560974121 (23.471764246622723) | > loss_duration: 2.2334330081939697 (2.1135288874308267) | > loss_1: 35.2783088684082 (32.960920333862305) --> EVAL PERFORMANCE | > avg_loader_time: 0.013829946517944336 (+0.007326920827229817) | > avg_loss_disc: 2.929787556330363 (+0.3329897721608477) | > avg_loss_disc_real_0: 0.33591041962305707 (+0.22276045754551888) | > avg_loss_disc_real_1: 0.3724106748898824 (+0.10888847708702087) | > avg_loss_disc_real_2: 0.27562854687372845 (-0.04547657569249469) | > avg_loss_disc_real_3: 0.2810165385405223 (-0.019784112771352114) | > avg_loss_disc_real_4: 0.2538910508155823 (+0.03536050021648407) | > avg_loss_disc_real_5: 0.37959446509679157 (+0.10652437309424079) | > avg_loss_0: 2.929787556330363 (+0.3329897721608477) | > avg_loss_gen: 2.341134707132975 (+0.1523301601409912) | > avg_loss_kl: 2.3803869088490806 (+0.6708775361378989) | > avg_loss_feat: 2.6541059811909995 (-2.1851101020971933) | > avg_loss_mel: 23.471764246622723 (+1.5987826983133964) | > avg_loss_duration: 2.1135288874308267 (+0.004380544026692412) | > avg_loss_1: 32.960920333862305 (+0.24126021067301195)  > EPOCH: 57/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:17:18)   --> TIME: 2023-10-20 00:17:26 -- STEP: 9/50 -- GLOBAL_STEP: 55860 | > loss_disc: 3.1718831062316895 (2.498031245337592) | > loss_disc_real_0: 0.12099970132112503 (0.18055608289109337) | > loss_disc_real_1: 0.23912332952022552 (0.28258154955175185) | > loss_disc_real_2: 0.12908004224300385 (0.27214476300610435) | > loss_disc_real_3: 0.20142847299575806 (0.2541083265095949) | > loss_disc_real_4: 0.2864391505718231 (0.308893632557657) | > loss_disc_real_5: 0.2063310444355011 (0.23559698876407412) | > loss_0: 3.1718831062316895 (2.498031245337592) | > grad_norm_0: tensor(1136.9280, device='cuda:0') (tensor(614.2909, device='cuda:0')) | > loss_gen: 1.3359359502792358 (2.537933243645562) | > loss_kl: 0.8863557577133179 (1.0363693634668987) | > loss_feat: 1.481898307800293 (5.973285666563445) | > loss_mel: 16.82040786743164 (24.093807644314236) | > loss_duration: 1.7458195686340332 (1.818332725101047) | > loss_1: 22.270416259765625 (35.45972866482205) | > grad_norm_1: tensor(4817.5933, device='cuda:0') (tensor(31341.9199, device='cuda:0')) | > current_lr_0: 0.00018891814079513542 | > current_lr_1: 0.00018891814079513542 | > step_time: 0.5654 (0.5030947791205512) | > loader_time: 0.0252 (0.017926269107394747)  --> TIME: 2023-10-20 00:17:41 -- STEP: 39/50 -- GLOBAL_STEP: 55890 | > loss_disc: 3.083104133605957 (2.6973901436879077) | > loss_disc_real_0: 0.36299288272857666 (0.20491358332144907) | > loss_disc_real_1: 0.19879311323165894 (0.2614383477813158) | > loss_disc_real_2: 0.2238844335079193 (0.2727902743678827) | > loss_disc_real_3: 0.24825897812843323 (0.2565139444688192) | > loss_disc_real_4: 0.2688013017177582 (0.2728148834445537) | > loss_disc_real_5: 0.28632861375808716 (0.256723641919402) | > loss_0: 3.083104133605957 (2.6973901436879077) | > grad_norm_0: tensor(561.7894, device='cuda:0') (tensor(511.5279, device='cuda:0')) | > loss_gen: 1.5208265781402588 (2.2749431683466983) | > loss_kl: 0.9068588018417358 (1.1935176986914418) | > loss_feat: 0.16763976216316223 (4.2469753808795625) | > loss_mel: 3.5085690021514893 (22.417175494707546) | > loss_duration: 1.855492353439331 (1.8533049424489338) | > loss_1: 7.959386825561523 (31.985916651212253) | > grad_norm_1: tensor(9403.5879, device='cuda:0') (tensor(21090.5508, device='cuda:0')) | > current_lr_0: 0.00018891814079513542 | > current_lr_1: 0.00018891814079513542 | > step_time: 0.5912 (0.4945399638934013) | > loader_time: 0.0227 (0.01912973477290227)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.408818244934082 (2.408818244934082) | > loss_disc_real_0: 0.11091577261686325 (0.11091577261686325) | > loss_disc_real_1: 0.30141618847846985 (0.30141618847846985) | > loss_disc_real_2: 0.14995163679122925 (0.14995163679122925) | > loss_disc_real_3: 0.3105718493461609 (0.3105718493461609) | > loss_disc_real_4: 0.13037273287773132 (0.13037273287773132) | > loss_disc_real_5: 0.30264127254486084 (0.30264127254486084) | > loss_0: 2.408818244934082 (2.408818244934082) | > loss_gen: 2.390883684158325 (2.390883684158325) | > loss_kl: 1.892723560333252 (1.892723560333252) | > loss_feat: 5.419150352478027 (5.419150352478027) | > loss_mel: 20.579435348510742 (20.579435348510742) | > loss_duration: 2.0099480152130127 (2.0099480152130127) | > loss_1: 32.29214096069336 (32.29214096069336)  --> STEP: 1 | > loss_disc: 2.8749656677246094 (2.8749656677246094) | > loss_disc_real_0: 0.20228099822998047 (0.20228099822998047) | > loss_disc_real_1: 0.4049023687839508 (0.4049023687839508) | > loss_disc_real_2: 0.27958953380584717 (0.27958953380584717) | > loss_disc_real_3: 0.1860218644142151 (0.1860218644142151) | > loss_disc_real_4: 0.267823189496994 (0.267823189496994) | > loss_disc_real_5: 0.43560951948165894 (0.43560951948165894) | > loss_0: 2.8749656677246094 (2.8749656677246094) | > loss_gen: 2.2503883838653564 (2.2503883838653564) | > loss_kl: 2.3428432941436768 (2.3428432941436768) | > loss_feat: 2.846726894378662 (2.846726894378662) | > loss_mel: 24.62312126159668 (24.62312126159668) | > loss_duration: 2.1015896797180176 (2.1015896797180176) | > loss_1: 34.164669036865234 (34.164669036865234)  --> STEP: 2 | > loss_disc: 2.9799752235412598 (2.9274704456329346) | > loss_disc_real_0: 0.20715759694576263 (0.20471929758787155) | > loss_disc_real_1: 0.4070090651512146 (0.4059557169675827) | > loss_disc_real_2: 0.28306543827056885 (0.281327486038208) | > loss_disc_real_3: 0.21760496497154236 (0.20181341469287872) | > loss_disc_real_4: 0.3089855909347534 (0.2884043902158737) | > loss_disc_real_5: 0.28646406531333923 (0.3610367923974991) | > loss_0: 2.9799752235412598 (2.9274704456329346) | > loss_gen: 1.8470927476882935 (2.048740565776825) | > loss_kl: 2.4661056995391846 (2.4044744968414307) | > loss_feat: 0.5862850546836853 (1.7165059745311737) | > loss_mel: 8.776715278625488 (16.699918270111084) | > loss_duration: 2.0637364387512207 (2.082663059234619) | > loss_1: 15.739934921264648 (24.95230197906494)  --> STEP: 3 | > loss_disc: 2.9974284172058105 (2.95078976949056) | > loss_disc_real_0: 0.23030304908752441 (0.21324721475442251) | > loss_disc_real_1: 0.3831108510494232 (0.39834076166152954) | > loss_disc_real_2: 0.2927453815937042 (0.2851334512233734) | > loss_disc_real_3: 0.23476696014404297 (0.21279792984326681) | > loss_disc_real_4: 0.3289977014064789 (0.30193549394607544) | > loss_disc_real_5: 0.31633833050727844 (0.34613730510075885) | > loss_0: 2.9974284172058105 (2.95078976949056) | > loss_gen: 1.8555116653442383 (1.9843309322992961) | > loss_kl: 1.401211142539978 (2.0700533787409463) | > loss_feat: 0.14938975870609283 (1.1941339025894802) | > loss_mel: 4.523219108581543 (12.641018549601236) | > loss_duration: 2.1634936332702637 (2.1096065839131675) | > loss_1: 10.092824935913086 (19.99914296468099) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026129881540934243 (-0.011216958363850912) | > avg_loss_disc: 2.95078976949056 (+0.021002213160197236) | > avg_loss_disc_real_0: 0.21324721475442251 (-0.12266320486863455) | > avg_loss_disc_real_1: 0.39834076166152954 (+0.025930086771647154) | > avg_loss_disc_real_2: 0.2851334512233734 (+0.00950490434964496) | > avg_loss_disc_real_3: 0.21279792984326681 (-0.06821860869725546) | > avg_loss_disc_real_4: 0.30193549394607544 (+0.048044443130493164) | > avg_loss_disc_real_5: 0.34613730510075885 (-0.033457159996032715) | > avg_loss_0: 2.95078976949056 (+0.021002213160197236) | > avg_loss_gen: 1.9843309322992961 (-0.356803774833679) | > avg_loss_kl: 2.0700533787409463 (-0.31033353010813425) | > avg_loss_feat: 1.1941339025894802 (-1.4599720786015193) | > avg_loss_mel: 12.641018549601236 (-10.830745697021486) | > avg_loss_duration: 2.1096065839131675 (-0.003922303517659209) | > avg_loss_1: 19.99914296468099 (-12.961777369181316) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_55901.pth  > EPOCH: 58/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:17:57)   --> TIME: 2023-10-20 00:18:09 -- STEP: 19/50 -- GLOBAL_STEP: 55920 | > loss_disc: 2.012094020843506 (2.6598953134135197) | > loss_disc_real_0: 0.248742938041687 (0.22517699571816543) | > loss_disc_real_1: 0.3134068548679352 (0.26936328018966477) | > loss_disc_real_2: 0.09405982494354248 (0.2548319438570424) | > loss_disc_real_3: 0.11811622232198715 (0.23073971840111832) | > loss_disc_real_4: 0.2506181299686432 (0.20037228672912247) | > loss_disc_real_5: 0.14308781921863556 (0.21762644440719955) | > loss_0: 2.012094020843506 (2.6598953134135197) | > grad_norm_0: tensor(384.8299, device='cuda:0') (tensor(615.2514, device='cuda:0')) | > loss_gen: 2.6360719203948975 (2.293677248452839) | > loss_kl: 1.2758249044418335 (1.2145184623567682) | > loss_feat: 7.397693634033203 (4.92614524929147) | > loss_mel: 27.861164093017578 (21.517342228638498) | > loss_duration: 1.9449400901794434 (1.904765009880066) | > loss_1: 41.115692138671875 (31.856447947652715) | > grad_norm_1: tensor(26083.0078, device='cuda:0') (tensor(22317.4434, device='cuda:0')) | > current_lr_0: 0.0001887293052853671 | > current_lr_1: 0.0001887293052853671 | > step_time: 0.5478 (0.4536893744217722) | > loader_time: 0.0243 (0.012175447062442177)  --> TIME: 2023-10-20 00:18:25 -- STEP: 49/50 -- GLOBAL_STEP: 55950 | > loss_disc: 2.343841075897217 (2.5538939042967193) | > loss_disc_real_0: 0.1070990189909935 (0.1925447577306507) | > loss_disc_real_1: 0.26293012499809265 (0.24028656373218615) | > loss_disc_real_2: 0.286264568567276 (0.24183041647988923) | > loss_disc_real_3: 0.24891598522663116 (0.25011499933138187) | > loss_disc_real_4: 0.23530332744121552 (0.20888840946920065) | > loss_disc_real_5: 0.326643705368042 (0.22032231282518835) | > loss_0: 2.343841075897217 (2.5538939042967193) | > grad_norm_0: tensor(838.1473, device='cuda:0') (tensor(516.9603, device='cuda:0')) | > loss_gen: 2.4940221309661865 (2.280466678191205) | > loss_kl: 1.074226975440979 (1.1808501317793005) | > loss_feat: 3.127584457397461 (4.859386785906189) | > loss_mel: 27.212177276611328 (22.462603744195427) | > loss_duration: 1.9356333017349243 (1.8547708550278021) | > loss_1: 35.84364318847656 (32.6380781932753) | > grad_norm_1: tensor(8569.4189, device='cuda:0') (tensor(18430.7930, device='cuda:0')) | > current_lr_0: 0.0001887293052853671 | > current_lr_1: 0.0001887293052853671 | > step_time: 0.8216 (0.48454471510283803) | > loader_time: 0.2641 (0.01859700923063317)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6985136270523071 (1.6985136270523071) | > loss_disc_real_0: 0.09634468704462051 (0.09634468704462051) | > loss_disc_real_1: 0.11091838777065277 (0.11091838777065277) | > loss_disc_real_2: 0.1474088877439499 (0.1474088877439499) | > loss_disc_real_3: 0.30131685733795166 (0.30131685733795166) | > loss_disc_real_4: 0.07329811900854111 (0.07329811900854111) | > loss_disc_real_5: 0.03614295646548271 (0.03614295646548271) | > loss_0: 1.6985136270523071 (1.6985136270523071) | > loss_gen: 2.669999599456787 (2.669999599456787) | > loss_kl: 2.168081283569336 (2.168081283569336) | > loss_feat: 8.890111923217773 (8.890111923217773) | > loss_mel: 24.937910079956055 (24.937910079956055) | > loss_duration: 2.016350030899048 (2.016350030899048) | > loss_1: 40.68244934082031 (40.68244934082031)  --> STEP: 1 | > loss_disc: 2.9292426109313965 (2.9292426109313965) | > loss_disc_real_0: 0.2350112497806549 (0.2350112497806549) | > loss_disc_real_1: 0.23041430115699768 (0.23041430115699768) | > loss_disc_real_2: 0.2889895439147949 (0.2889895439147949) | > loss_disc_real_3: 0.19624997675418854 (0.19624997675418854) | > loss_disc_real_4: 0.34009218215942383 (0.34009218215942383) | > loss_disc_real_5: 0.32462650537490845 (0.32462650537490845) | > loss_0: 2.9292426109313965 (2.9292426109313965) | > loss_gen: 1.7485696077346802 (1.7485696077346802) | > loss_kl: 2.258840322494507 (2.258840322494507) | > loss_feat: 0.680253803730011 (0.680253803730011) | > loss_mel: 24.505634307861328 (24.505634307861328) | > loss_duration: 2.1150131225585938 (2.1150131225585938) | > loss_1: 31.308311462402344 (31.308311462402344)  --> STEP: 2 | > loss_disc: 2.30015230178833 (2.6146974563598633) | > loss_disc_real_0: 0.14676351845264435 (0.19088738411664963) | > loss_disc_real_1: 0.21071311831474304 (0.22056370973587036) | > loss_disc_real_2: 0.2566210925579071 (0.272805318236351) | > loss_disc_real_3: 0.2626977860927582 (0.22947388142347336) | > loss_disc_real_4: 0.13354484736919403 (0.23681851476430893) | > loss_disc_real_5: 0.14594940841197968 (0.23528795689344406) | > loss_0: 2.30015230178833 (2.6146974563598633) | > loss_gen: 2.319202423095703 (2.0338860154151917) | > loss_kl: 1.9053645133972168 (2.082102417945862) | > loss_feat: 5.544301509857178 (3.1122776567935944) | > loss_mel: 29.40596580505371 (26.95580005645752) | > loss_duration: 2.180530071258545 (2.1477715969085693) | > loss_1: 41.35536575317383 (36.331838607788086)  --> STEP: 3 | > loss_disc: 3.082056760787964 (2.77048389116923) | > loss_disc_real_0: 0.16346678137779236 (0.1817471832036972) | > loss_disc_real_1: 0.30674806237220764 (0.24929182728131613) | > loss_disc_real_2: 0.36476263403892517 (0.30345775683720905) | > loss_disc_real_3: 0.28723862767219543 (0.24872879683971405) | > loss_disc_real_4: 0.3438584506511688 (0.2724984933932622) | > loss_disc_real_5: 0.32327497005462646 (0.2646169612805049) | > loss_0: 3.082056760787964 (2.77048389116923) | > loss_gen: 2.024209499359131 (2.0306605100631714) | > loss_kl: 1.7117669582366943 (1.9586572647094727) | > loss_feat: 3.5082271099090576 (3.2442608078320823) | > loss_mel: 24.49077033996582 (26.13412348429362) | > loss_duration: 2.118619441986084 (2.1380542119344077) | > loss_1: 33.85359191894531 (35.50575637817383) --> EVAL PERFORMANCE | > avg_loader_time: 0.027536948521931965 (+0.02492396036783854) | > avg_loss_disc: 2.77048389116923 (-0.18030587832133005) | > avg_loss_disc_real_0: 0.1817471832036972 (-0.03150003155072531) | > avg_loss_disc_real_1: 0.24929182728131613 (-0.1490489343802134) | > avg_loss_disc_real_2: 0.30345775683720905 (+0.018324305613835634) | > avg_loss_disc_real_3: 0.24872879683971405 (+0.035930866996447236) | > avg_loss_disc_real_4: 0.2724984933932622 (-0.02943700055281323) | > avg_loss_disc_real_5: 0.2646169612805049 (-0.08152034382025397) | > avg_loss_0: 2.77048389116923 (-0.18030587832133005) | > avg_loss_gen: 2.0306605100631714 (+0.04632957776387525) | > avg_loss_kl: 1.9586572647094727 (-0.11139611403147365) | > avg_loss_feat: 3.2442608078320823 (+2.0501269052426023) | > avg_loss_mel: 26.13412348429362 (+13.493104934692385) | > avg_loss_duration: 2.1380542119344077 (+0.028447628021240234) | > avg_loss_1: 35.50575637817383 (+15.50661341349284)  > EPOCH: 59/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:18:31)   --> TIME: 2023-10-20 00:18:50 -- STEP: 29/50 -- GLOBAL_STEP: 55980 | > loss_disc: 2.4580888748168945 (2.3792019794727195) | > loss_disc_real_0: 0.2667180299758911 (0.1401719395071268) | > loss_disc_real_1: 0.226567804813385 (0.218039784965844) | > loss_disc_real_2: 0.3211286962032318 (0.22459665852887878) | > loss_disc_real_3: 0.36118489503860474 (0.22975637770161547) | > loss_disc_real_4: 0.22481559216976166 (0.2222611040904604) | > loss_disc_real_5: 0.25254321098327637 (0.2240480566718455) | > loss_0: 2.4580888748168945 (2.3792019794727195) | > grad_norm_0: tensor(820.5792, device='cuda:0') (tensor(511.9701, device='cuda:0')) | > loss_gen: 2.9812350273132324 (2.443549263066259) | > loss_kl: 1.170330286026001 (1.2695545389734466) | > loss_feat: 5.129957675933838 (5.304330214151535) | > loss_mel: 25.679641723632812 (24.46435259128439) | > loss_duration: 1.865049958229065 (1.8863742515958588) | > loss_1: 36.82621765136719 (35.36816069175456) | > grad_norm_1: tensor(20692.5273, device='cuda:0') (tensor(21402.6328, device='cuda:0')) | > current_lr_0: 0.00018854065852851368 | > current_lr_1: 0.00018854065852851368 | > step_time: 0.5847 (0.5030935303918247) | > loader_time: 0.0163 (0.020440348263444576)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.973219871520996 (2.973219871520996) | > loss_disc_real_0: 0.8309805393218994 (0.8309805393218994) | > loss_disc_real_1: 0.3893708884716034 (0.3893708884716034) | > loss_disc_real_2: 0.30883947014808655 (0.30883947014808655) | > loss_disc_real_3: 0.2831794023513794 (0.2831794023513794) | > loss_disc_real_4: 0.18650393187999725 (0.18650393187999725) | > loss_disc_real_5: 0.32490962743759155 (0.32490962743759155) | > loss_0: 2.973219871520996 (2.973219871520996) | > loss_gen: 3.371141195297241 (3.371141195297241) | > loss_kl: 2.304534912109375 (2.304534912109375) | > loss_feat: 8.188838005065918 (8.188838005065918) | > loss_mel: 23.300840377807617 (23.300840377807617) | > loss_duration: 1.9437414407730103 (1.9437414407730103) | > loss_1: 39.109092712402344 (39.109092712402344)  --> STEP: 1 | > loss_disc: 0.8199333548545837 (0.8199333548545837) | > loss_disc_real_0: 0.09139871597290039 (0.09139871597290039) | > loss_disc_real_1: 0.09564999490976334 (0.09564999490976334) | > loss_disc_real_2: 0.06270293146371841 (0.06270293146371841) | > loss_disc_real_3: 0.07907432317733765 (0.07907432317733765) | > loss_disc_real_4: 0.020932378247380257 (0.020932378247380257) | > loss_disc_real_5: 0.1552489548921585 (0.1552489548921585) | > loss_0: 0.8199333548545837 (0.8199333548545837) | > loss_gen: 4.78397274017334 (4.78397274017334) | > loss_kl: 2.5730948448181152 (2.5730948448181152) | > loss_feat: 15.622908592224121 (15.622908592224121) | > loss_mel: 29.714675903320312 (29.714675903320312) | > loss_duration: 2.0697362422943115 (2.0697362422943115) | > loss_1: 54.76438903808594 (54.76438903808594)  --> STEP: 2 | > loss_disc: 1.8926136493682861 (1.356273502111435) | > loss_disc_real_0: 0.2696312665939331 (0.18051499128341675) | > loss_disc_real_1: 0.128657266497612 (0.11215363070368767) | > loss_disc_real_2: 0.13307400047779083 (0.09788846597075462) | > loss_disc_real_3: 0.17957466840744019 (0.12932449579238892) | > loss_disc_real_4: 0.16836239397525787 (0.09464738611131907) | > loss_disc_real_5: 0.07319886982440948 (0.114223912358284) | > loss_0: 1.8926136493682861 (1.356273502111435) | > loss_gen: 2.699906349182129 (3.7419395446777344) | > loss_kl: 1.9589836597442627 (2.266039252281189) | > loss_feat: 9.146797180175781 (12.384852886199951) | > loss_mel: 26.098623275756836 (27.906649589538574) | > loss_duration: 2.0549888610839844 (2.062362551689148) | > loss_1: 41.95929718017578 (48.36184310913086)  --> STEP: 3 | > loss_disc: 2.151517868041992 (1.6213549574216206) | > loss_disc_real_0: 0.7277063131332397 (0.3629120985666911) | > loss_disc_real_1: 0.2058442085981369 (0.14338382333517075) | > loss_disc_real_2: 0.21758390963077545 (0.13778694719076157) | > loss_disc_real_3: 0.2845030426979065 (0.18105067809422812) | > loss_disc_real_4: 0.021790437400341034 (0.07036173654099305) | > loss_disc_real_5: 0.015341481193900108 (0.08126310197015603) | > loss_0: 2.151517868041992 (1.6213549574216206) | > loss_gen: 3.7645444869995117 (3.74947452545166) | > loss_kl: 1.1873998641967773 (1.906492789586385) | > loss_feat: 7.647871017456055 (10.805858929951986) | > loss_mel: 27.02332305908203 (27.612207412719727) | > loss_duration: 2.0798146724700928 (2.0681799252827964) | > loss_1: 41.70295333862305 (46.14221318562826) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_56000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.074918746948242 (1.984745904803276) | > loss_disc_real_0: 0.3449493646621704 (0.3584214150905609) | > loss_disc_real_1: 0.21687637269496918 (0.16175696067512035) | > loss_disc_real_2: 0.25780487060546875 (0.16779142804443836) | > loss_disc_real_3: 0.30606791377067566 (0.21230498701334) | > loss_disc_real_4: 0.36470264196395874 (0.14394696289673448) | > loss_disc_real_5: 0.24584269523620605 (0.12240800028666854) | > loss_0: 3.074918746948242 (1.984745904803276) | > loss_gen: 1.8682821989059448 (3.2791764438152313) | > loss_kl: 2.1383721828460693 (1.9644626379013062) | > loss_feat: 1.842907428741455 (8.565121054649353) | > loss_mel: 26.648290634155273 (27.371228218078613) | > loss_duration: 1.947822093963623 (2.038090467453003) | > loss_1: 34.445674896240234 (43.21807861328125)  --> STEP: 1 | > loss_disc: 3.0399816036224365 (2.1957930445671083) | > loss_disc_real_0: 0.39714354276657104 (0.36616584062576296) | > loss_disc_real_1: 0.3975468873977661 (0.2089149460196495) | > loss_disc_real_2: 0.33090922236442566 (0.20041498690843582) | > loss_disc_real_3: 0.33520713448524475 (0.23688541650772094) | > loss_disc_real_4: 0.2415848970413208 (0.16347454972565173) | > loss_disc_real_5: 0.1293654590845108 (0.123799492046237) | > loss_0: 3.0399816036224365 (2.1957930445671083) | > loss_gen: 2.1636719703674316 (3.0560755491256715) | > loss_kl: 2.4437813758850098 (2.0603263854980467) | > loss_feat: 3.5150418281555176 (7.555105209350586) | > loss_mel: 26.541933059692383 (27.205369186401366) | > loss_duration: 2.0714290142059326 (2.044758176803589) | > loss_1: 36.73585891723633 (41.921634674072266)  --> STEP: 2 | > loss_disc: 3.759451389312744 (2.456402768691381) | > loss_disc_real_0: 0.6757084727287292 (0.41775627930959064) | > loss_disc_real_1: 0.3711286187171936 (0.23595055813590685) | > loss_disc_real_2: 0.3151227533817291 (0.21953294798731804) | > loss_disc_real_3: 0.33213481307029724 (0.252760315934817) | > loss_disc_real_4: 0.38084137439727783 (0.1997023538375894) | > loss_disc_real_5: 0.4029208719730377 (0.1703197220340371) | > loss_0: 3.759451389312744 (2.456402768691381) | > loss_gen: 2.0683462619781494 (2.891454001267751) | > loss_kl: 2.3382785320281982 (2.1066517432530723) | > loss_feat: 6.626858234405518 (7.400397380193074) | > loss_mel: 26.395246505737305 (27.070348739624023) | > loss_duration: 2.050515651702881 (2.0457177559534707) | > loss_1: 39.479244232177734 (41.51456960042318)  --> STEP: 3 | > loss_disc: 3.05253267288208 (2.5415641835757663) | > loss_disc_real_0: 0.5462775230407715 (0.43611645698547363) | > loss_disc_real_1: 0.2894073724746704 (0.24358724589858735) | > loss_disc_real_2: 0.29323458671569824 (0.2300617535199438) | > loss_disc_real_3: 0.3108956515789032 (0.26106536388397217) | > loss_disc_real_4: 0.301787406206131 (0.21428593274738109) | > loss_disc_real_5: 0.26017820835113525 (0.18315664865076542) | > loss_0: 3.05253267288208 (2.5415641835757663) | > loss_gen: 2.177065849304199 (2.7893985509872437) | > loss_kl: 1.2796202898025513 (1.9885043927601405) | > loss_feat: 0.9977660775184631 (6.4857357655252725) | > loss_mel: 24.050609588623047 (26.63895743233817) | > loss_duration: 2.063477039337158 (2.0482547964368547) | > loss_1: 30.568538665771484 (39.95085089547293) --> EVAL PERFORMANCE | > avg_loader_time: 0.23293454306466238 (+0.2053975945427304) | > avg_loss_disc: 2.5415641835757663 (-0.2289197075934637) | > avg_loss_disc_real_0: 0.43611645698547363 (+0.25436927378177643) | > avg_loss_disc_real_1: 0.24358724589858735 (-0.0057045813827287795) | > avg_loss_disc_real_2: 0.2300617535199438 (-0.07339600331726526) | > avg_loss_disc_real_3: 0.26106536388397217 (+0.012336567044258118) | > avg_loss_disc_real_4: 0.21428593274738109 (-0.05821256064588112) | > avg_loss_disc_real_5: 0.18315664865076542 (-0.08146031262973946) | > avg_loss_0: 2.5415641835757663 (-0.2289197075934637) | > avg_loss_gen: 2.7893985509872437 (+0.7587380409240723) | > avg_loss_kl: 1.9885043927601405 (+0.029847128050667804) | > avg_loss_feat: 6.4857357655252725 (+3.2414749576931903) | > avg_loss_mel: 26.63895743233817 (+0.5048339480445492) | > avg_loss_duration: 2.0482547964368547 (-0.08979941549755299) | > avg_loss_1: 39.95085089547293 (+4.445094517299104)  > EPOCH: 60/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:19:16)   --> TIME: 2023-10-20 00:19:24 -- STEP: 9/50 -- GLOBAL_STEP: 56010 | > loss_disc: 2.326265811920166 (2.296839197476705) | > loss_disc_real_0: 0.04867975041270256 (0.13835510652926233) | > loss_disc_real_1: 0.1616383194923401 (0.20589667186141014) | > loss_disc_real_2: 0.12041857093572617 (0.21716638799342844) | > loss_disc_real_3: 0.2412576973438263 (0.23532779845926496) | > loss_disc_real_4: 0.11353424936532974 (0.25347742603884804) | > loss_disc_real_5: 0.06909308582544327 (0.19709167505304018) | > loss_0: 2.326265811920166 (2.296839197476705) | > grad_norm_0: tensor(817.7922, device='cuda:0') (tensor(442.6139, device='cuda:0')) | > loss_gen: 1.7814438343048096 (2.4137105147043862) | > loss_kl: 1.2676918506622314 (1.1310180028279622) | > loss_feat: 3.092149257659912 (6.350124279658) | > loss_mel: 19.359275817871094 (26.116365644666885) | > loss_duration: 1.791378140449524 (1.8122310373518202) | > loss_1: 27.29193878173828 (37.8234494527181) | > grad_norm_1: tensor(5544.7627, device='cuda:0') (tensor(22223.9082, device='cuda:0')) | > current_lr_0: 0.00018835220033590485 | > current_lr_1: 0.00018835220033590485 | > step_time: 0.5217 (0.5358286168840196) | > loader_time: 0.0033 (0.01756551530626085)  --> TIME: 2023-10-20 00:19:40 -- STEP: 39/50 -- GLOBAL_STEP: 56040 | > loss_disc: 1.7819368839263916 (2.417348501009819) | > loss_disc_real_0: 0.029605181887745857 (0.15756196547777226) | > loss_disc_real_1: 0.14414174854755402 (0.22577615569417292) | > loss_disc_real_2: 0.19345030188560486 (0.22255946098802945) | > loss_disc_real_3: 0.10544059425592422 (0.23800961998028633) | > loss_disc_real_4: 0.13202795386314392 (0.23575067644317946) | > loss_disc_real_5: 0.06829716265201569 (0.22064450822579554) | > loss_0: 1.7819368839263916 (2.417348501009819) | > grad_norm_0: tensor(780.9813, device='cuda:0') (tensor(535.1572, device='cuda:0')) | > loss_gen: 2.8374111652374268 (2.4307624865800905) | > loss_kl: 0.6679322123527527 (1.1348278323809307) | > loss_feat: 7.745584011077881 (5.404168703617194) | > loss_mel: 25.958354949951172 (25.533269197512897) | > loss_duration: 1.8601182699203491 (1.8505753156466362) | > loss_1: 39.069400787353516 (36.35360382764769) | > grad_norm_1: tensor(33358.6602, device='cuda:0') (tensor(19893.9883, device='cuda:0')) | > current_lr_0: 0.00018835220033590485 | > current_lr_1: 0.00018835220033590485 | > step_time: 0.5961 (0.5036329611753808) | > loader_time: 0.0117 (0.019563907232040014)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.025353193283081 (3.025353193283081) | > loss_disc_real_0: 0.340215802192688 (0.340215802192688) | > loss_disc_real_1: 0.2715676426887512 (0.2715676426887512) | > loss_disc_real_2: 0.27521735429763794 (0.27521735429763794) | > loss_disc_real_3: 0.2863432765007019 (0.2863432765007019) | > loss_disc_real_4: 0.2548483908176422 (0.2548483908176422) | > loss_disc_real_5: 0.23837490379810333 (0.23837490379810333) | > loss_0: 3.025353193283081 (3.025353193283081) | > loss_gen: 1.6645036935806274 (1.6645036935806274) | > loss_kl: 2.3815536499023438 (2.3815536499023438) | > loss_feat: 0.0654553771018982 (0.0654553771018982) | > loss_mel: 11.88071060180664 (11.88071060180664) | > loss_duration: 1.899204969406128 (1.899204969406128) | > loss_1: 17.891427993774414 (17.891427993774414)  --> STEP: 1 | > loss_disc: 2.296712636947632 (2.296712636947632) | > loss_disc_real_0: 0.30070802569389343 (0.30070802569389343) | > loss_disc_real_1: 0.15534059703350067 (0.15534059703350067) | > loss_disc_real_2: 0.38310810923576355 (0.38310810923576355) | > loss_disc_real_3: 0.21344134211540222 (0.21344134211540222) | > loss_disc_real_4: 0.2850703299045563 (0.2850703299045563) | > loss_disc_real_5: 0.1769769787788391 (0.1769769787788391) | > loss_0: 2.296712636947632 (2.296712636947632) | > loss_gen: 3.2664759159088135 (3.2664759159088135) | > loss_kl: 2.8867616653442383 (2.8867616653442383) | > loss_feat: 6.0612101554870605 (6.0612101554870605) | > loss_mel: 30.567726135253906 (30.567726135253906) | > loss_duration: 2.0797464847564697 (2.0797464847564697) | > loss_1: 44.86191940307617 (44.86191940307617)  --> STEP: 2 | > loss_disc: 2.877242088317871 (2.5869773626327515) | > loss_disc_real_0: 0.31865912675857544 (0.30968357622623444) | > loss_disc_real_1: 0.1341213583946228 (0.14473097771406174) | > loss_disc_real_2: 0.3320308029651642 (0.35756945610046387) | > loss_disc_real_3: 0.2933575212955475 (0.25339943170547485) | > loss_disc_real_4: 0.271823525428772 (0.2784469276666641) | > loss_disc_real_5: 0.37460383772850037 (0.27579040825366974) | > loss_0: 2.877242088317871 (2.5869773626327515) | > loss_gen: 2.2693071365356445 (2.767891526222229) | > loss_kl: 1.974331021308899 (2.4305463433265686) | > loss_feat: 5.539665222167969 (5.800437688827515) | > loss_mel: 29.777015686035156 (30.17237091064453) | > loss_duration: 2.098525047302246 (2.089135766029358) | > loss_1: 41.658843994140625 (43.2603816986084)  --> STEP: 3 | > loss_disc: 2.854647159576416 (2.6762006282806396) | > loss_disc_real_0: 0.6839402914047241 (0.43443581461906433) | > loss_disc_real_1: 0.2570996582508087 (0.18218720455964407) | > loss_disc_real_2: 0.3864060342311859 (0.36718164881070453) | > loss_disc_real_3: 0.17486262321472168 (0.22722049554189047) | > loss_disc_real_4: 0.16500592231750488 (0.24063325921694437) | > loss_disc_real_5: 0.014390292577445507 (0.188657036361595) | > loss_0: 2.854647159576416 (2.6762006282806396) | > loss_gen: 2.4051802158355713 (2.6469877560933432) | > loss_kl: 1.2171555757522583 (2.026082754135132) | > loss_feat: 5.781535625457764 (5.794137001037598) | > loss_mel: 28.118762969970703 (29.487834930419922) | > loss_duration: 2.1267998218536377 (2.1016904513041177) | > loss_1: 39.649436950683594 (42.05673344930013) --> EVAL PERFORMANCE | > avg_loader_time: 0.01068552335103353 (-0.22224901971362884) | > avg_loss_disc: 2.6762006282806396 (+0.13463644470487335) | > avg_loss_disc_real_0: 0.43443581461906433 (-0.0016806423664093018) | > avg_loss_disc_real_1: 0.18218720455964407 (-0.06140004133894328) | > avg_loss_disc_real_2: 0.36718164881070453 (+0.13711989529076074) | > avg_loss_disc_real_3: 0.22722049554189047 (-0.033844868342081696) | > avg_loss_disc_real_4: 0.24063325921694437 (+0.02634732646956328) | > avg_loss_disc_real_5: 0.188657036361595 (+0.005500387710829585) | > avg_loss_0: 2.6762006282806396 (+0.13463644470487335) | > avg_loss_gen: 2.6469877560933432 (-0.1424107948939004) | > avg_loss_kl: 2.026082754135132 (+0.037578361374991376) | > avg_loss_feat: 5.794137001037598 (-0.6915987644876749) | > avg_loss_mel: 29.487834930419922 (+2.8488774980817517) | > avg_loss_duration: 2.1016904513041177 (+0.05343565486726298) | > avg_loss_1: 42.05673344930013 (+2.1058825538272004)  > EPOCH: 61/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:19:54)   --> TIME: 2023-10-20 00:20:05 -- STEP: 19/50 -- GLOBAL_STEP: 56070 | > loss_disc: 3.1358046531677246 (2.588399127910012) | > loss_disc_real_0: 0.39262959361076355 (0.17289824911246174) | > loss_disc_real_1: 0.2800957262516022 (0.2671640934912782) | > loss_disc_real_2: 0.2628580927848816 (0.2312844645624098) | > loss_disc_real_3: 0.31691837310791016 (0.2559223498560881) | > loss_disc_real_4: 0.3414956033229828 (0.2531105726957321) | > loss_disc_real_5: 0.324219286441803 (0.2505706852596057) | > loss_0: 3.1358046531677246 (2.588399127910012) | > grad_norm_0: tensor(870.9447, device='cuda:0') (tensor(589.5624, device='cuda:0')) | > loss_gen: 2.089667558670044 (2.6615479368912545) | > loss_kl: 0.9079020023345947 (1.1274438374920894) | > loss_feat: 1.4622297286987305 (5.301560598474584) | > loss_mel: 21.80951690673828 (23.473804423683568) | > loss_duration: 2.022012948989868 (1.895684135587592) | > loss_1: 28.291330337524414 (34.46004087046573) | > grad_norm_1: tensor(5749.9097, device='cuda:0') (tensor(22433.9570, device='cuda:0')) | > current_lr_0: 0.00018816393051905876 | > current_lr_1: 0.00018816393051905876 | > step_time: 0.246 (0.3259195779499255) | > loader_time: 0.0016 (0.0063914374301308075)  --> TIME: 2023-10-20 00:20:20 -- STEP: 49/50 -- GLOBAL_STEP: 56100 | > loss_disc: 2.7554333209991455 (2.5805192455953474) | > loss_disc_real_0: 0.12317569553852081 (0.17881976740852906) | > loss_disc_real_1: 0.5554739236831665 (0.237959729393526) | > loss_disc_real_2: 0.33932170271873474 (0.21190588392925505) | > loss_disc_real_3: 0.5038759112358093 (0.2426551483875635) | > loss_disc_real_4: 0.3443751931190491 (0.25498218659539607) | > loss_disc_real_5: 0.08321009576320648 (0.21936409049952516) | > loss_0: 2.7554333209991455 (2.5805192455953474) | > grad_norm_0: tensor(720.3651, device='cuda:0') (tensor(539.6976, device='cuda:0')) | > loss_gen: 3.184532403945923 (2.516579679080418) | > loss_kl: 0.7027626633644104 (1.094770324473478) | > loss_feat: 5.3940911293029785 (5.447546961622274) | > loss_mel: 28.407800674438477 (24.16946448598589) | > loss_duration: 1.91628098487854 (1.8504902756943995) | > loss_1: 39.60546875 (35.07885173875459) | > grad_norm_1: tensor(19091.8301, device='cuda:0') (tensor(19097.6133, device='cuda:0')) | > current_lr_0: 0.00018816393051905876 | > current_lr_1: 0.00018816393051905876 | > step_time: 0.3921 (0.42086337050613093) | > loader_time: 0.2635 (0.015522470279615752)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2837512493133545 (2.2837512493133545) | > loss_disc_real_0: 0.0965590626001358 (0.0965590626001358) | > loss_disc_real_1: 0.29798486828804016 (0.29798486828804016) | > loss_disc_real_2: 0.2776268422603607 (0.2776268422603607) | > loss_disc_real_3: 0.3467269241809845 (0.3467269241809845) | > loss_disc_real_4: 0.35085129737854004 (0.35085129737854004) | > loss_disc_real_5: 0.37096044421195984 (0.37096044421195984) | > loss_0: 2.2837512493133545 (2.2837512493133545) | > loss_gen: 3.326282262802124 (3.326282262802124) | > loss_kl: 2.109616756439209 (2.109616756439209) | > loss_feat: 7.202960968017578 (7.202960968017578) | > loss_mel: 28.351757049560547 (28.351757049560547) | > loss_duration: 1.9482014179229736 (1.9482014179229736) | > loss_1: 42.938819885253906 (42.938819885253906)  --> STEP: 1 | > loss_disc: 2.6095192432403564 (2.6095192432403564) | > loss_disc_real_0: 0.1018785908818245 (0.1018785908818245) | > loss_disc_real_1: 0.3841792345046997 (0.3841792345046997) | > loss_disc_real_2: 0.32800766825675964 (0.32800766825675964) | > loss_disc_real_3: 0.33799970149993896 (0.33799970149993896) | > loss_disc_real_4: 0.26185837388038635 (0.26185837388038635) | > loss_disc_real_5: 0.11387873440980911 (0.11387873440980911) | > loss_0: 2.6095192432403564 (2.6095192432403564) | > loss_gen: 2.330958604812622 (2.330958604812622) | > loss_kl: 2.8471550941467285 (2.8471550941467285) | > loss_feat: 6.304864406585693 (6.304864406585693) | > loss_mel: 25.001785278320312 (25.001785278320312) | > loss_duration: 2.1734750270843506 (2.1734750270843506) | > loss_1: 38.65823745727539 (38.65823745727539)  --> STEP: 2 | > loss_disc: 2.2306571006774902 (2.4200881719589233) | > loss_disc_real_0: 0.058267995715141296 (0.0800732932984829) | > loss_disc_real_1: 0.27637261152267456 (0.33027592301368713) | > loss_disc_real_2: 0.15460552275180817 (0.2413065955042839) | > loss_disc_real_3: 0.34159982204437256 (0.33979976177215576) | > loss_disc_real_4: 0.3418571949005127 (0.3018577843904495) | > loss_disc_real_5: 0.0492677241563797 (0.0815732292830944) | > loss_0: 2.2306571006774902 (2.4200881719589233) | > loss_gen: 2.2922723293304443 (2.311615467071533) | > loss_kl: 2.1897125244140625 (2.5184338092803955) | > loss_feat: 7.275237560272217 (6.790050983428955) | > loss_mel: 31.243785858154297 (28.122785568237305) | > loss_duration: 2.102839231491089 (2.1381571292877197) | > loss_1: 45.10384750366211 (41.88104248046875)  --> STEP: 3 | > loss_disc: 2.4970405101776123 (2.445738951365153) | > loss_disc_real_0: 0.0684373676776886 (0.0761946514248848) | > loss_disc_real_1: 0.5898856520652771 (0.4168124993642171) | > loss_disc_real_2: 0.399345725774765 (0.2939863055944443) | > loss_disc_real_3: 0.3474474251270294 (0.34234898289044696) | > loss_disc_real_4: 0.26455944776535034 (0.28942500551541644) | > loss_disc_real_5: 0.10369548201560974 (0.08894731352726619) | > loss_0: 2.4970405101776123 (2.445738951365153) | > loss_gen: 3.075719118118286 (2.5663166840871177) | > loss_kl: 1.201399326324463 (2.0794223149617515) | > loss_feat: 4.569477558135986 (6.049859841664632) | > loss_mel: 25.645200729370117 (27.296923955281574) | > loss_duration: 2.0808193683624268 (2.119044542312622) | > loss_1: 36.57261276245117 (40.111565907796226) --> EVAL PERFORMANCE | > avg_loader_time: 0.002386887868245443 (-0.008298635482788086) | > avg_loss_disc: 2.445738951365153 (-0.2304616769154868) | > avg_loss_disc_real_0: 0.0761946514248848 (-0.35824116319417953) | > avg_loss_disc_real_1: 0.4168124993642171 (+0.23462529480457303) | > avg_loss_disc_real_2: 0.2939863055944443 (-0.07319534321626026) | > avg_loss_disc_real_3: 0.34234898289044696 (+0.11512848734855649) | > avg_loss_disc_real_4: 0.28942500551541644 (+0.04879174629847208) | > avg_loss_disc_real_5: 0.08894731352726619 (-0.09970972283432881) | > avg_loss_0: 2.445738951365153 (-0.2304616769154868) | > avg_loss_gen: 2.5663166840871177 (-0.08067107200622559) | > avg_loss_kl: 2.0794223149617515 (+0.053339560826619614) | > avg_loss_feat: 6.049859841664632 (+0.2557228406270342) | > avg_loss_mel: 27.296923955281574 (-2.1909109751383475) | > avg_loss_duration: 2.119044542312622 (+0.01735409100850438) | > avg_loss_1: 40.111565907796226 (-1.9451675415039062)  > EPOCH: 62/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:20:29)   --> TIME: 2023-10-20 00:20:49 -- STEP: 29/50 -- GLOBAL_STEP: 56130 | > loss_disc: 3.091979503631592 (2.3997512192561707) | > loss_disc_real_0: 0.3781035542488098 (0.1550225715056575) | > loss_disc_real_1: 0.3127979636192322 (0.23449692232855435) | > loss_disc_real_2: 0.2933467626571655 (0.23057138174772263) | > loss_disc_real_3: 0.33852723240852356 (0.2351387456573289) | > loss_disc_real_4: 0.2479631006717682 (0.2250395613433472) | > loss_disc_real_5: 0.16951148211956024 (0.19879115180208765) | > loss_0: 3.091979503631592 (2.3997512192561707) | > grad_norm_0: tensor(332.4436, device='cuda:0') (tensor(468.2354, device='cuda:0')) | > loss_gen: 1.6407325267791748 (2.4306353042865627) | > loss_kl: 1.1864686012268066 (0.9986618305074757) | > loss_feat: 0.07562687247991562 (6.02897685021162) | > loss_mel: 6.118960857391357 (26.064522406150555) | > loss_duration: 1.858124017715454 (1.8759873899920234) | > loss_1: 10.879912376403809 (37.39878361800621) | > grad_norm_1: tensor(25264.1641, device='cuda:0') (tensor(20137.2949, device='cuda:0')) | > current_lr_0: 0.00018797584888968205 | > current_lr_1: 0.00018797584888968205 | > step_time: 0.5703 (0.49805054171331997) | > loader_time: 0.0095 (0.017936673657647496)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6817128658294678 (2.6817128658294678) | > loss_disc_real_0: 0.23694385588169098 (0.23694385588169098) | > loss_disc_real_1: 0.5170876979827881 (0.5170876979827881) | > loss_disc_real_2: 0.35323768854141235 (0.35323768854141235) | > loss_disc_real_3: 0.28389257192611694 (0.28389257192611694) | > loss_disc_real_4: 0.342700719833374 (0.342700719833374) | > loss_disc_real_5: 0.28729408979415894 (0.28729408979415894) | > loss_0: 2.6817128658294678 (2.6817128658294678) | > loss_gen: 4.622570991516113 (4.622570991516113) | > loss_kl: 2.284680128097534 (2.284680128097534) | > loss_feat: 7.698955535888672 (7.698955535888672) | > loss_mel: 27.653057098388672 (27.653057098388672) | > loss_duration: 1.9295392036437988 (1.9295392036437988) | > loss_1: 44.18880081176758 (44.18880081176758)  --> STEP: 1 | > loss_disc: 2.327213764190674 (2.327213764190674) | > loss_disc_real_0: 0.18967780470848083 (0.18967780470848083) | > loss_disc_real_1: 0.23819127678871155 (0.23819127678871155) | > loss_disc_real_2: 0.33598604798316956 (0.33598604798316956) | > loss_disc_real_3: 0.21172180771827698 (0.21172180771827698) | > loss_disc_real_4: 0.4208117425441742 (0.4208117425441742) | > loss_disc_real_5: 0.46908411383628845 (0.46908411383628845) | > loss_0: 2.327213764190674 (2.327213764190674) | > loss_gen: 5.012124061584473 (5.012124061584473) | > loss_kl: 2.449289321899414 (2.449289321899414) | > loss_feat: 8.270486831665039 (8.270486831665039) | > loss_mel: 33.01368713378906 (33.01368713378906) | > loss_duration: 2.114959955215454 (2.114959955215454) | > loss_1: 50.86054611206055 (50.86054611206055)  --> STEP: 2 | > loss_disc: 3.0699691772460938 (2.698591470718384) | > loss_disc_real_0: 0.3916657567024231 (0.29067178070545197) | > loss_disc_real_1: 0.3691205680370331 (0.3036559224128723) | > loss_disc_real_2: 0.4707419276237488 (0.40336398780345917) | > loss_disc_real_3: 0.4212223291397095 (0.3164720684289932) | > loss_disc_real_4: 0.32485780119895935 (0.3728347718715668) | > loss_disc_real_5: 0.42247435450553894 (0.4457792341709137) | > loss_0: 3.0699691772460938 (2.698591470718384) | > loss_gen: 3.0540366172790527 (4.033080339431763) | > loss_kl: 2.501491069793701 (2.4753901958465576) | > loss_feat: 3.606719732284546 (5.9386032819747925) | > loss_mel: 26.89168357849121 (29.952685356140137) | > loss_duration: 2.0245635509490967 (2.0697617530822754) | > loss_1: 38.0784912109375 (44.46951866149902)  --> STEP: 3 | > loss_disc: 2.970158338546753 (2.789113759994507) | > loss_disc_real_0: 0.3646811246871948 (0.3153415620326996) | > loss_disc_real_1: 0.21904206275939941 (0.27545130252838135) | > loss_disc_real_2: 0.3407897651195526 (0.3825059135754903) | > loss_disc_real_3: 0.25919559597969055 (0.29737991094589233) | > loss_disc_real_4: 0.336134135723114 (0.3606012264887492) | > loss_disc_real_5: 0.3490923047065735 (0.4135502576828003) | > loss_0: 2.970158338546753 (2.789113759994507) | > loss_gen: 2.0640368461608887 (3.376732508341471) | > loss_kl: 0.924496054649353 (1.958425482114156) | > loss_feat: 0.814316987991333 (4.230507850646973) | > loss_mel: 22.110912322998047 (27.33876101175944) | > loss_duration: 2.0531511306762695 (2.06422487894694) | > loss_1: 27.966915130615234 (38.968650817871094) --> EVAL PERFORMANCE | > avg_loader_time: 0.003400405248006185 (+0.0010135173797607422) | > avg_loss_disc: 2.789113759994507 (+0.343374808629354) | > avg_loss_disc_real_0: 0.3153415620326996 (+0.2391469106078148) | > avg_loss_disc_real_1: 0.27545130252838135 (-0.14136119683583576) | > avg_loss_disc_real_2: 0.3825059135754903 (+0.08851960798104602) | > avg_loss_disc_real_3: 0.29737991094589233 (-0.04496907194455463) | > avg_loss_disc_real_4: 0.3606012264887492 (+0.07117622097333276) | > avg_loss_disc_real_5: 0.4135502576828003 (+0.3246029441555341) | > avg_loss_0: 2.789113759994507 (+0.343374808629354) | > avg_loss_gen: 3.376732508341471 (+0.8104158242543535) | > avg_loss_kl: 1.958425482114156 (-0.12099683284759544) | > avg_loss_feat: 4.230507850646973 (-1.8193519910176592) | > avg_loss_mel: 27.33876101175944 (+0.04183705647786695) | > avg_loss_duration: 2.06422487894694 (-0.054819663365682114) | > avg_loss_1: 38.968650817871094 (-1.1429150899251326)  > EPOCH: 63/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:21:09)   --> TIME: 2023-10-20 00:21:19 -- STEP: 9/50 -- GLOBAL_STEP: 56160 | > loss_disc: 2.0366039276123047 (2.290870640012953) | > loss_disc_real_0: 0.24268922209739685 (0.1371361772633261) | > loss_disc_real_1: 0.18254441022872925 (0.2278125998046663) | > loss_disc_real_2: 0.11348818242549896 (0.21794534722963968) | > loss_disc_real_3: 0.23542310297489166 (0.1991753155986468) | > loss_disc_real_4: 0.080429807305336 (0.2262380603286955) | > loss_disc_real_5: 0.045682642608881 (0.15151945832702848) | > loss_0: 2.0366039276123047 (2.290870640012953) | > grad_norm_0: tensor(457.8930, device='cuda:0') (tensor(612.8546, device='cuda:0')) | > loss_gen: 1.9500051736831665 (2.63936013645596) | > loss_kl: 1.0492403507232666 (1.2849100298351712) | > loss_feat: 4.057950019836426 (6.578973518477546) | > loss_mel: 23.14345932006836 (24.80282465616862) | > loss_duration: 1.812504768371582 (1.8541100422541301) | > loss_1: 32.01315689086914 (37.160177654690216) | > grad_norm_1: tensor(5872.2705, device='cuda:0') (tensor(25681.2754, device='cuda:0')) | > current_lr_0: 0.0001877879552596695 | > current_lr_1: 0.0001877879552596695 | > step_time: 0.4262 (0.6125085883670383) | > loader_time: 0.0143 (0.01525976922776964)  --> TIME: 2023-10-20 00:21:34 -- STEP: 39/50 -- GLOBAL_STEP: 56190 | > loss_disc: 2.9211466312408447 (2.428723014318026) | > loss_disc_real_0: 0.31451451778411865 (0.15678644906251857) | > loss_disc_real_1: 0.2550971210002899 (0.24487708203303507) | > loss_disc_real_2: 0.2900354862213135 (0.2165935448346994) | > loss_disc_real_3: 0.19795463979244232 (0.23483542075906044) | > loss_disc_real_4: 0.25003546476364136 (0.22482687865312284) | > loss_disc_real_5: 0.41093435883522034 (0.20877151554211593) | > loss_0: 2.9211466312408447 (2.428723014318026) | > grad_norm_0: tensor(436.5887, device='cuda:0') (tensor(521.8576, device='cuda:0')) | > loss_gen: 1.8840916156768799 (2.533636389634548) | > loss_kl: 0.9579591751098633 (1.2593707740306854) | > loss_feat: 0.7230375409126282 (5.7505203286806745) | > loss_mel: 20.356897354125977 (24.666367946526943) | > loss_duration: 1.8303643465042114 (1.8501808979572394) | > loss_1: 25.752349853515625 (36.060076200045074) | > grad_norm_1: tensor(3459.8679, device='cuda:0') (tensor(20105.5352, device='cuda:0')) | > current_lr_0: 0.0001877879552596695 | > current_lr_1: 0.0001877879552596695 | > step_time: 0.4665 (0.5310717912820668) | > loader_time: 0.0247 (0.016801369495880902)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.032407760620117 (3.032407760620117) | > loss_disc_real_0: 0.24237115681171417 (0.24237115681171417) | > loss_disc_real_1: 0.3025587797164917 (0.3025587797164917) | > loss_disc_real_2: 0.31985166668891907 (0.31985166668891907) | > loss_disc_real_3: 0.324069619178772 (0.324069619178772) | > loss_disc_real_4: 0.3006040155887604 (0.3006040155887604) | > loss_disc_real_5: 0.277051717042923 (0.277051717042923) | > loss_0: 3.032407760620117 (3.032407760620117) | > loss_gen: 1.7648144960403442 (1.7648144960403442) | > loss_kl: 1.7479411363601685 (1.7479411363601685) | > loss_feat: 0.10600178688764572 (0.10600178688764572) | > loss_mel: 15.748990058898926 (15.748990058898926) | > loss_duration: 1.9462130069732666 (1.9462130069732666) | > loss_1: 21.3139591217041 (21.3139591217041)  --> STEP: 1 | > loss_disc: 2.991353988647461 (2.991353988647461) | > loss_disc_real_0: 0.17425547540187836 (0.17425547540187836) | > loss_disc_real_1: 0.4132757782936096 (0.4132757782936096) | > loss_disc_real_2: 0.40504348278045654 (0.40504348278045654) | > loss_disc_real_3: 0.4164430797100067 (0.4164430797100067) | > loss_disc_real_4: 0.3480117619037628 (0.3480117619037628) | > loss_disc_real_5: 0.3030332624912262 (0.3030332624912262) | > loss_0: 2.991353988647461 (2.991353988647461) | > loss_gen: 2.740309476852417 (2.740309476852417) | > loss_kl: 2.383971691131592 (2.383971691131592) | > loss_feat: 3.5434913635253906 (3.5434913635253906) | > loss_mel: 25.55087661743164 (25.55087661743164) | > loss_duration: 2.1229231357574463 (2.1229231357574463) | > loss_1: 36.341575622558594 (36.341575622558594)  --> STEP: 2 | > loss_disc: 1.5950379371643066 (2.293195962905884) | > loss_disc_real_0: 0.12148664146661758 (0.14787105843424797) | > loss_disc_real_1: 0.3019368052482605 (0.35760629177093506) | > loss_disc_real_2: 0.22264930605888367 (0.3138463944196701) | > loss_disc_real_3: 0.11633560061454773 (0.2663893401622772) | > loss_disc_real_4: 0.14760041236877441 (0.24780608713626862) | > loss_disc_real_5: 0.033664118498563766 (0.16834869049489498) | > loss_0: 1.5950379371643066 (2.293195962905884) | > loss_gen: 3.0406222343444824 (2.8904658555984497) | > loss_kl: 2.1339526176452637 (2.2589621543884277) | > loss_feat: 9.32568359375 (6.434587478637695) | > loss_mel: 31.326953887939453 (28.438915252685547) | > loss_duration: 2.111497163772583 (2.1172101497650146) | > loss_1: 47.9387092590332 (42.1401424407959)  --> STEP: 3 | > loss_disc: 2.9741969108581543 (2.520196278889974) | > loss_disc_real_0: 0.3322921395301819 (0.2093447521328926) | > loss_disc_real_1: 0.33752763271331787 (0.350913405418396) | > loss_disc_real_2: 0.3260660767555237 (0.31791962186495465) | > loss_disc_real_3: 0.30867934226989746 (0.28048600753148395) | > loss_disc_real_4: 0.30025893449783325 (0.2652903695901235) | > loss_disc_real_5: 0.27840495109558105 (0.20503411069512367) | > loss_0: 2.9741969108581543 (2.520196278889974) | > loss_gen: 2.0245323181152344 (2.6018213431040444) | > loss_kl: 0.8612188696861267 (1.7930477261543274) | > loss_feat: 0.8003580570220947 (4.556511004765828) | > loss_mel: 21.44479751586914 (26.107542673746746) | > loss_duration: 2.0718674659729004 (2.10209592183431) | > loss_1: 27.202774047851562 (37.16101964314779) --> EVAL PERFORMANCE | > avg_loader_time: 0.013462305068969727 (+0.010061899820963541) | > avg_loss_disc: 2.520196278889974 (-0.26891748110453273) | > avg_loss_disc_real_0: 0.2093447521328926 (-0.10599680989980698) | > avg_loss_disc_real_1: 0.350913405418396 (+0.07546210289001465) | > avg_loss_disc_real_2: 0.31791962186495465 (-0.06458629171053565) | > avg_loss_disc_real_3: 0.28048600753148395 (-0.016893903414408384) | > avg_loss_disc_real_4: 0.2652903695901235 (-0.09531085689862573) | > avg_loss_disc_real_5: 0.20503411069512367 (-0.20851614698767662) | > avg_loss_0: 2.520196278889974 (-0.26891748110453273) | > avg_loss_gen: 2.6018213431040444 (-0.7749111652374268) | > avg_loss_kl: 1.7930477261543274 (-0.16537775595982862) | > avg_loss_feat: 4.556511004765828 (+0.3260031541188555) | > avg_loss_mel: 26.107542673746746 (-1.2312183380126953) | > avg_loss_duration: 2.10209592183431 (+0.03787104288737009) | > avg_loss_1: 37.16101964314779 (-1.807631174723305)  > EPOCH: 64/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:21:49)   --> TIME: 2023-10-20 00:22:01 -- STEP: 19/50 -- GLOBAL_STEP: 56220 | > loss_disc: 2.711562395095825 (2.596802655019258) | > loss_disc_real_0: 0.06646493077278137 (0.16016328295594767) | > loss_disc_real_1: 0.31951969861984253 (0.23436419077609716) | > loss_disc_real_2: 0.33136168122291565 (0.26662587688157435) | > loss_disc_real_3: 0.4047376215457916 (0.2204710033379103) | > loss_disc_real_4: 0.30261778831481934 (0.2712241383759599) | > loss_disc_real_5: 0.3379204273223877 (0.22522349714448578) | > loss_0: 2.711562395095825 (2.596802655019258) | > grad_norm_0: tensor(336.8806, device='cuda:0') (tensor(443.8866, device='cuda:0')) | > loss_gen: 2.424527168273926 (2.1926796436309814) | > loss_kl: 0.8882801532745361 (1.1850336758713973) | > loss_feat: 3.025299072265625 (4.386495934897347) | > loss_mel: 26.906217575073242 (22.360718965530396) | > loss_duration: 2.0114009380340576 (1.879204932012056) | > loss_1: 35.2557258605957 (32.00413259706999) | > grad_norm_1: tensor(9058.2764, device='cuda:0') (tensor(16358.2256, device='cuda:0')) | > current_lr_0: 0.00018760024944110414 | > current_lr_1: 0.00018760024944110414 | > step_time: 0.402 (0.4510224869376735) | > loader_time: 0.0076 (0.014527722408896998)  --> TIME: 2023-10-20 00:22:17 -- STEP: 49/50 -- GLOBAL_STEP: 56250 | > loss_disc: 2.663240671157837 (2.5488242567801964) | > loss_disc_real_0: 0.4930173456668854 (0.16865683274761747) | > loss_disc_real_1: 0.35090354084968567 (0.25051471575790524) | > loss_disc_real_2: 0.21220526099205017 (0.24747622894997504) | > loss_disc_real_3: 0.20606277883052826 (0.23343908239384087) | > loss_disc_real_4: 0.30342021584510803 (0.23189863811570163) | > loss_disc_real_5: 0.22519221901893616 (0.2242387820947535) | > loss_0: 2.663240671157837 (2.5488242567801964) | > grad_norm_0: tensor(917.3196, device='cuda:0') (tensor(554.4247, device='cuda:0')) | > loss_gen: 3.427180767059326 (2.3712492208091573) | > loss_kl: 0.6261006593704224 (1.1162620928822735) | > loss_feat: 6.282369613647461 (4.737330174871853) | > loss_mel: 25.970754623413086 (23.174725118948487) | > loss_duration: 1.9245351552963257 (1.8340408023522825) | > loss_1: 38.23094177246094 (33.23360724351844) | > grad_norm_1: tensor(47209.7188, device='cuda:0') (tensor(17674.1445, device='cuda:0')) | > current_lr_0: 0.00018760024944110414 | > current_lr_1: 0.00018760024944110414 | > step_time: 0.3288 (0.4561347280229841) | > loader_time: 0.9014 (0.029870845833603218)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6446175575256348 (2.6446175575256348) | > loss_disc_real_0: 0.10220219194889069 (0.10220219194889069) | > loss_disc_real_1: 0.14855843782424927 (0.14855843782424927) | > loss_disc_real_2: 0.23818320035934448 (0.23818320035934448) | > loss_disc_real_3: 0.3558894693851471 (0.3558894693851471) | > loss_disc_real_4: 0.2986525297164917 (0.2986525297164917) | > loss_disc_real_5: 0.29285672307014465 (0.29285672307014465) | > loss_0: 2.6446175575256348 (2.6446175575256348) | > loss_gen: 2.0821666717529297 (2.0821666717529297) | > loss_kl: 2.0105504989624023 (2.0105504989624023) | > loss_feat: 5.64156436920166 (5.64156436920166) | > loss_mel: 23.430252075195312 (23.430252075195312) | > loss_duration: 1.9877548217773438 (1.9877548217773438) | > loss_1: 35.15229034423828 (35.15229034423828)  --> STEP: 1 | > loss_disc: 2.146672487258911 (2.146672487258911) | > loss_disc_real_0: 0.10234533250331879 (0.10234533250331879) | > loss_disc_real_1: 0.28917479515075684 (0.28917479515075684) | > loss_disc_real_2: 0.2656753957271576 (0.2656753957271576) | > loss_disc_real_3: 0.2358657568693161 (0.2358657568693161) | > loss_disc_real_4: 0.032855596393346786 (0.032855596393346786) | > loss_disc_real_5: 0.15212038159370422 (0.15212038159370422) | > loss_0: 2.146672487258911 (2.146672487258911) | > loss_gen: 2.2622885704040527 (2.2622885704040527) | > loss_kl: 2.3720734119415283 (2.3720734119415283) | > loss_feat: 7.457333564758301 (7.457333564758301) | > loss_mel: 25.753795623779297 (25.753795623779297) | > loss_duration: 2.077561855316162 (2.077561855316162) | > loss_1: 39.92304992675781 (39.92304992675781)  --> STEP: 2 | > loss_disc: 1.92132568359375 (2.0339990854263306) | > loss_disc_real_0: 0.06812835484743118 (0.08523684367537498) | > loss_disc_real_1: 0.13584387302398682 (0.21250933408737183) | > loss_disc_real_2: 0.14313240349292755 (0.20440389961004257) | > loss_disc_real_3: 0.36005696654319763 (0.29796136170625687) | > loss_disc_real_4: 0.11526372283697128 (0.07405965961515903) | > loss_disc_real_5: 0.051029447466135025 (0.10157491452991962) | > loss_0: 1.92132568359375 (2.0339990854263306) | > loss_gen: 2.7888717651367188 (2.5255801677703857) | > loss_kl: 1.8428655862808228 (2.1074694991111755) | > loss_feat: 8.211462020874023 (7.834397792816162) | > loss_mel: 29.03071403503418 (27.39225482940674) | > loss_duration: 2.1061973571777344 (2.0918796062469482) | > loss_1: 43.98011016845703 (41.95158004760742)  --> STEP: 3 | > loss_disc: 2.5809576511383057 (2.2163186073303223) | > loss_disc_real_0: 0.03163617104291916 (0.06736995279788971) | > loss_disc_real_1: 0.2538708448410034 (0.22629650433858237) | > loss_disc_real_2: 0.30512258410453796 (0.23797679444154105) | > loss_disc_real_3: 0.3208672106266022 (0.3055966446797053) | > loss_disc_real_4: 0.29946982860565186 (0.14919638261198997) | > loss_disc_real_5: 0.38766226172447205 (0.19693736359477043) | > loss_0: 2.5809576511383057 (2.2163186073303223) | > loss_gen: 2.317500114440918 (2.4562201499938965) | > loss_kl: 1.0634270906448364 (1.7594553629557292) | > loss_feat: 2.7394587993621826 (6.136084794998169) | > loss_mel: 21.64444351196289 (25.47631772359212) | > loss_duration: 2.133096218109131 (2.105618476867676) | > loss_1: 29.89792823791504 (37.9336961110433) --> EVAL PERFORMANCE | > avg_loader_time: 0.006244262059529622 (-0.0072180430094401045) | > avg_loss_disc: 2.2163186073303223 (-0.30387767155965184) | > avg_loss_disc_real_0: 0.06736995279788971 (-0.1419747993350029) | > avg_loss_disc_real_1: 0.22629650433858237 (-0.12461690107981363) | > avg_loss_disc_real_2: 0.23797679444154105 (-0.0799428274234136) | > avg_loss_disc_real_3: 0.3055966446797053 (+0.02511063714822137) | > avg_loss_disc_real_4: 0.14919638261198997 (-0.1160939869781335) | > avg_loss_disc_real_5: 0.19693736359477043 (-0.008096747100353241) | > avg_loss_0: 2.2163186073303223 (-0.30387767155965184) | > avg_loss_gen: 2.4562201499938965 (-0.14560119311014796) | > avg_loss_kl: 1.7594553629557292 (-0.03359236319859815) | > avg_loss_feat: 6.136084794998169 (+1.5795737902323408) | > avg_loss_mel: 25.47631772359212 (-0.6312249501546248) | > avg_loss_duration: 2.105618476867676 (+0.0035225550333657374) | > avg_loss_1: 37.9336961110433 (+0.7726764678955078)  > EPOCH: 65/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:22:24)   --> TIME: 2023-10-20 00:22:42 -- STEP: 29/50 -- GLOBAL_STEP: 56280 | > loss_disc: 2.003105640411377 (2.5741971114586137) | > loss_disc_real_0: 0.07951438426971436 (0.16453341060671314) | > loss_disc_real_1: 0.20532070100307465 (0.24703988278734268) | > loss_disc_real_2: 0.1744157075881958 (0.21963281030284948) | > loss_disc_real_3: 0.14635872840881348 (0.2591589322506353) | > loss_disc_real_4: 0.4256037771701813 (0.2559301208319335) | > loss_disc_real_5: 0.2899596095085144 (0.2343054749071598) | > loss_0: 2.003105640411377 (2.5741971114586137) | > grad_norm_0: tensor(323.6595, device='cuda:0') (tensor(578.4551, device='cuda:0')) | > loss_gen: 3.2371346950531006 (2.48500352481316) | > loss_kl: 1.0495237112045288 (1.22768903189692) | > loss_feat: 9.093502044677734 (5.615511348535275) | > loss_mel: 26.958436965942383 (25.236462091577465) | > loss_duration: 1.892083764076233 (1.8684114587718044) | > loss_1: 42.23067855834961 (36.433077318915004) | > grad_norm_1: tensor(16328.8975, device='cuda:0') (tensor(18481.4160, device='cuda:0')) | > current_lr_0: 0.00018741273124625658 | > current_lr_1: 0.00018741273124625658 | > step_time: 0.5668 (0.48729624419376766) | > loader_time: 0.0109 (0.019788857164054083)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6270945072174072 (2.6270945072174072) | > loss_disc_real_0: 0.1256246566772461 (0.1256246566772461) | > loss_disc_real_1: 0.14959898591041565 (0.14959898591041565) | > loss_disc_real_2: 0.513778030872345 (0.513778030872345) | > loss_disc_real_3: 0.3505871891975403 (0.3505871891975403) | > loss_disc_real_4: 0.23237822949886322 (0.23237822949886322) | > loss_disc_real_5: 0.3084932267665863 (0.3084932267665863) | > loss_0: 2.6270945072174072 (2.6270945072174072) | > loss_gen: 2.4284560680389404 (2.4284560680389404) | > loss_kl: 1.993630290031433 (1.993630290031433) | > loss_feat: 4.624986171722412 (4.624986171722412) | > loss_mel: 26.26075553894043 (26.26075553894043) | > loss_duration: 1.9784632921218872 (1.9784632921218872) | > loss_1: 37.28628921508789 (37.28628921508789)  --> STEP: 1 | > loss_disc: 2.70951509475708 (2.70951509475708) | > loss_disc_real_0: 0.21767275035381317 (0.21767275035381317) | > loss_disc_real_1: 0.24623261392116547 (0.24623261392116547) | > loss_disc_real_2: 0.4194231331348419 (0.4194231331348419) | > loss_disc_real_3: 0.41965246200561523 (0.41965246200561523) | > loss_disc_real_4: 0.25848087668418884 (0.25848087668418884) | > loss_disc_real_5: 0.30218639969825745 (0.30218639969825745) | > loss_0: 2.70951509475708 (2.70951509475708) | > loss_gen: 2.629599094390869 (2.629599094390869) | > loss_kl: 2.9863333702087402 (2.9863333702087402) | > loss_feat: 5.133092403411865 (5.133092403411865) | > loss_mel: 26.735416412353516 (26.735416412353516) | > loss_duration: 2.0381596088409424 (2.0381596088409424) | > loss_1: 39.52260208129883 (39.52260208129883)  --> STEP: 2 | > loss_disc: 2.487795114517212 (2.598655104637146) | > loss_disc_real_0: 0.09278260171413422 (0.1552276760339737) | > loss_disc_real_1: 0.34243330359458923 (0.29433295875787735) | > loss_disc_real_2: 0.30048152804374695 (0.35995233058929443) | > loss_disc_real_3: 0.2836136221885681 (0.3516330420970917) | > loss_disc_real_4: 0.03744015097618103 (0.14796051383018494) | > loss_disc_real_5: 0.17202474176883698 (0.2371055707335472) | > loss_0: 2.487795114517212 (2.598655104637146) | > loss_gen: 2.659498691558838 (2.6445488929748535) | > loss_kl: 1.9634451866149902 (2.4748892784118652) | > loss_feat: 9.355877876281738 (7.244485139846802) | > loss_mel: 26.627599716186523 (26.68150806427002) | > loss_duration: 2.0551464557647705 (2.0466530323028564) | > loss_1: 42.66156768798828 (41.092084884643555)  --> STEP: 3 | > loss_disc: 2.5870590209960938 (2.594789743423462) | > loss_disc_real_0: 0.24401727318763733 (0.18482420841852823) | > loss_disc_real_1: 0.3051091134548187 (0.2979250103235245) | > loss_disc_real_2: 0.5065160989761353 (0.4088069200515747) | > loss_disc_real_3: 0.37170618772506714 (0.3583240906397502) | > loss_disc_real_4: 0.23067885637283325 (0.17553329467773438) | > loss_disc_real_5: 0.31881803274154663 (0.264343058069547) | > loss_0: 2.5870590209960938 (2.594789743423462) | > loss_gen: 3.3793694972991943 (2.8894890944163003) | > loss_kl: 1.40524160861969 (2.1183400551478067) | > loss_feat: 4.110063552856445 (6.19967794418335) | > loss_mel: 21.99151039123535 (25.118175506591797) | > loss_duration: 2.1881625652313232 (2.0938228766123452) | > loss_1: 33.07434844970703 (38.41950607299805) --> EVAL PERFORMANCE | > avg_loader_time: 0.0066985289255778 (+0.00045426686604817766) | > avg_loss_disc: 2.594789743423462 (+0.37847113609313965) | > avg_loss_disc_real_0: 0.18482420841852823 (+0.11745425562063852) | > avg_loss_disc_real_1: 0.2979250103235245 (+0.07162850598494211) | > avg_loss_disc_real_2: 0.4088069200515747 (+0.17083012561003366) | > avg_loss_disc_real_3: 0.3583240906397502 (+0.05272744596004486) | > avg_loss_disc_real_4: 0.17553329467773438 (+0.0263369120657444) | > avg_loss_disc_real_5: 0.264343058069547 (+0.06740569447477657) | > avg_loss_0: 2.594789743423462 (+0.37847113609313965) | > avg_loss_gen: 2.8894890944163003 (+0.4332689444224038) | > avg_loss_kl: 2.1183400551478067 (+0.3588846921920774) | > avg_loss_feat: 6.19967794418335 (+0.06359314918518066) | > avg_loss_mel: 25.118175506591797 (-0.35814221700032434) | > avg_loss_duration: 2.0938228766123452 (-0.011795600255330552) | > avg_loss_1: 38.41950607299805 (+0.48580996195475024)  > EPOCH: 66/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:23:03)   --> TIME: 2023-10-20 00:23:10 -- STEP: 9/50 -- GLOBAL_STEP: 56310 | > loss_disc: 2.59437894821167 (2.4571065107981362) | > loss_disc_real_0: 0.16970530152320862 (0.1898983692129453) | > loss_disc_real_1: 0.23857775330543518 (0.23090311719311607) | > loss_disc_real_2: 0.2161930799484253 (0.23515449464321136) | > loss_disc_real_3: 0.422398179769516 (0.24807577083508173) | > loss_disc_real_4: 0.22215266525745392 (0.22817300880948702) | > loss_disc_real_5: 0.28656014800071716 (0.28275540636645424) | > loss_0: 2.59437894821167 (2.4571065107981362) | > grad_norm_0: tensor(309.9504, device='cuda:0') (tensor(470.4233, device='cuda:0')) | > loss_gen: 2.158726930618286 (2.5721494091881647) | > loss_kl: 1.4497959613800049 (1.123174410727289) | > loss_feat: 2.874074935913086 (5.740062011612786) | > loss_mel: 31.309192657470703 (25.729570176866318) | > loss_duration: 1.7247453927993774 (1.8243715630637274) | > loss_1: 39.516536712646484 (36.98932753668891) | > grad_norm_1: tensor(10027.2627, device='cuda:0') (tensor(18030.6621, device='cuda:0')) | > current_lr_0: 0.0001872254004875851 | > current_lr_1: 0.0001872254004875851 | > step_time: 0.4603 (0.3547142876519097) | > loader_time: 0.0021 (0.006452322006225586)  --> TIME: 2023-10-20 00:23:26 -- STEP: 39/50 -- GLOBAL_STEP: 56340 | > loss_disc: 2.6698811054229736 (2.6023297737806272) | > loss_disc_real_0: 0.2839650809764862 (0.1849953913822388) | > loss_disc_real_1: 0.327563613653183 (0.2394364166718263) | > loss_disc_real_2: 0.27717354893684387 (0.24852017122201436) | > loss_disc_real_3: 0.2073531448841095 (0.26414001073974824) | > loss_disc_real_4: 0.22415457665920258 (0.2262223524829516) | > loss_disc_real_5: 0.2724126875400543 (0.2612756075671851) | > loss_0: 2.6698811054229736 (2.6023297737806272) | > grad_norm_0: tensor(1138.0060, device='cuda:0') (tensor(662.1185, device='cuda:0')) | > loss_gen: 2.47438383102417 (2.334519523840685) | > loss_kl: 0.8491466641426086 (1.1284019308976643) | > loss_feat: 3.1963117122650146 (4.722932590888097) | > loss_mel: 23.67578125 (24.59113393074427) | > loss_duration: 1.8173834085464478 (1.8428221482496996) | > loss_1: 32.01300811767578 (34.619810251089234) | > grad_norm_1: tensor(18805.1074, device='cuda:0') (tensor(14249.2275, device='cuda:0')) | > current_lr_0: 0.0001872254004875851 | > current_lr_1: 0.0001872254004875851 | > step_time: 0.5772 (0.45943169104747283) | > loader_time: 0.0243 (0.014097391030727288)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5413520336151123 (2.5413520336151123) | > loss_disc_real_0: 0.09575626254081726 (0.09575626254081726) | > loss_disc_real_1: 0.2530635893344879 (0.2530635893344879) | > loss_disc_real_2: 0.3157745897769928 (0.3157745897769928) | > loss_disc_real_3: 0.3554201126098633 (0.3554201126098633) | > loss_disc_real_4: 0.2793027460575104 (0.2793027460575104) | > loss_disc_real_5: 0.2209734469652176 (0.2209734469652176) | > loss_0: 2.5413520336151123 (2.5413520336151123) | > loss_gen: 2.225330114364624 (2.225330114364624) | > loss_kl: 1.7686182260513306 (1.7686182260513306) | > loss_feat: 2.0982680320739746 (2.0982680320739746) | > loss_mel: 21.93787384033203 (21.93787384033203) | > loss_duration: 1.9938876628875732 (1.9938876628875732) | > loss_1: 30.023977279663086 (30.023977279663086)  --> STEP: 1 | > loss_disc: 2.0828824043273926 (2.0828824043273926) | > loss_disc_real_0: 0.062156058847904205 (0.062156058847904205) | > loss_disc_real_1: 0.11899124085903168 (0.11899124085903168) | > loss_disc_real_2: 0.11078346520662308 (0.11078346520662308) | > loss_disc_real_3: 0.3233550488948822 (0.3233550488948822) | > loss_disc_real_4: 0.2294415831565857 (0.2294415831565857) | > loss_disc_real_5: 0.22187408804893494 (0.22187408804893494) | > loss_0: 2.0828824043273926 (2.0828824043273926) | > loss_gen: 2.4430198669433594 (2.4430198669433594) | > loss_kl: 2.4444386959075928 (2.4444386959075928) | > loss_feat: 8.053098678588867 (8.053098678588867) | > loss_mel: 25.65226936340332 (25.65226936340332) | > loss_duration: 2.150963544845581 (2.150963544845581) | > loss_1: 40.74378967285156 (40.74378967285156)  --> STEP: 2 | > loss_disc: 2.0515315532684326 (2.0672069787979126) | > loss_disc_real_0: 0.1396850049495697 (0.10092053189873695) | > loss_disc_real_1: 0.15593388676643372 (0.1374625638127327) | > loss_disc_real_2: 0.10467996448278427 (0.10773171484470367) | > loss_disc_real_3: 0.25229090452194214 (0.28782297670841217) | > loss_disc_real_4: 0.26680922508239746 (0.24812540411949158) | > loss_disc_real_5: 0.04472703859210014 (0.13330056332051754) | > loss_0: 2.0515315532684326 (2.0672069787979126) | > loss_gen: 2.4517159461975098 (2.4473679065704346) | > loss_kl: 2.3068466186523438 (2.3756426572799683) | > loss_feat: 8.968158721923828 (8.510628700256348) | > loss_mel: 27.257537841796875 (26.454903602600098) | > loss_duration: 2.113879919052124 (2.1324217319488525) | > loss_1: 43.098140716552734 (41.92096519470215)  --> STEP: 3 | > loss_disc: 2.320711612701416 (2.1517085234324136) | > loss_disc_real_0: 0.11323149502277374 (0.10502418627341588) | > loss_disc_real_1: 0.23950918018817902 (0.17147810260454813) | > loss_disc_real_2: 0.26227685809135437 (0.15924676259358725) | > loss_disc_real_3: 0.29034385085105896 (0.28866326808929443) | > loss_disc_real_4: 0.3325316309928894 (0.27626081307729083) | > loss_disc_real_5: 0.28351151943206787 (0.18337088202436766) | > loss_0: 2.320711612701416 (2.1517085234324136) | > loss_gen: 2.6021673679351807 (2.49896772702535) | > loss_kl: 0.9018115997314453 (1.8843656380971272) | > loss_feat: 3.3105995655059814 (6.777285655339559) | > loss_mel: 29.63018798828125 (27.51333173116048) | > loss_duration: 2.0859670639038086 (2.1169368426005044) | > loss_1: 38.53073501586914 (40.79088846842448) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024791558583577475 (-0.004219373067220053) | > avg_loss_disc: 2.1517085234324136 (-0.4430812199910483) | > avg_loss_disc_real_0: 0.10502418627341588 (-0.07980002214511235) | > avg_loss_disc_real_1: 0.17147810260454813 (-0.12644690771897635) | > avg_loss_disc_real_2: 0.15924676259358725 (-0.24956015745798746) | > avg_loss_disc_real_3: 0.28866326808929443 (-0.06966082255045575) | > avg_loss_disc_real_4: 0.27626081307729083 (+0.10072751839955646) | > avg_loss_disc_real_5: 0.18337088202436766 (-0.08097217604517934) | > avg_loss_0: 2.1517085234324136 (-0.4430812199910483) | > avg_loss_gen: 2.49896772702535 (-0.3905213673909502) | > avg_loss_kl: 1.8843656380971272 (-0.23397441705067945) | > avg_loss_feat: 6.777285655339559 (+0.577607711156209) | > avg_loss_mel: 27.51333173116048 (+2.3951562245686837) | > avg_loss_duration: 2.1169368426005044 (+0.02311396598815918) | > avg_loss_1: 40.79088846842448 (+2.37138239542643)  > EPOCH: 67/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:23:41)   --> TIME: 2023-10-20 00:23:54 -- STEP: 19/50 -- GLOBAL_STEP: 56370 | > loss_disc: 2.668769598007202 (2.4107555966628227) | > loss_disc_real_0: 0.2198718637228012 (0.18923094839249788) | > loss_disc_real_1: 0.2581075131893158 (0.20965274266506495) | > loss_disc_real_2: 0.18678905069828033 (0.2330219118218673) | > loss_disc_real_3: 0.2489795833826065 (0.27331927928485367) | > loss_disc_real_4: 0.1961439996957779 (0.18026903193247945) | > loss_disc_real_5: 0.21000751852989197 (0.2102236321293994) | > loss_0: 2.668769598007202 (2.4107555966628227) | > grad_norm_0: tensor(301.6864, device='cuda:0') (tensor(520.7186, device='cuda:0')) | > loss_gen: 2.2373404502868652 (2.723954050164474) | > loss_kl: 1.5044680833816528 (1.3173057813393443) | > loss_feat: 6.711753845214844 (7.178470865676277) | > loss_mel: 26.860252380371094 (24.250401791773346) | > loss_duration: 1.9744789600372314 (1.8820737286617881) | > loss_1: 39.288291931152344 (37.352205753326416) | > grad_norm_1: tensor(14372.2178, device='cuda:0') (tensor(29510.4766, device='cuda:0')) | > current_lr_0: 0.00018703825697773558 | > current_lr_1: 0.00018703825697773558 | > step_time: 0.2778 (0.47646049449318334) | > loader_time: 0.025 (0.020953793274728877)  --> TIME: 2023-10-20 00:24:05 -- STEP: 49/50 -- GLOBAL_STEP: 56400 | > loss_disc: 2.9463658332824707 (2.48721072868425) | > loss_disc_real_0: 0.30280038714408875 (0.18110236339271069) | > loss_disc_real_1: 0.3094402253627777 (0.23071229016902495) | > loss_disc_real_2: 0.24121569097042084 (0.21458322486403036) | > loss_disc_real_3: 0.28000256419181824 (0.2657020190844731) | > loss_disc_real_4: 0.23808231949806213 (0.22664745342062445) | > loss_disc_real_5: 0.2567499577999115 (0.22716465090610544) | > loss_0: 2.9463658332824707 (2.48721072868425) | > grad_norm_0: tensor(352.7639, device='cuda:0') (tensor(505.6079, device='cuda:0')) | > loss_gen: 1.7064831256866455 (2.4872893776212424) | > loss_kl: 0.7107675075531006 (1.2370219534757183) | > loss_feat: 0.3767017126083374 (5.873775277210742) | > loss_mel: 20.258747100830078 (24.521183400737996) | > loss_duration: 1.8799992799758911 (1.8340428362087327) | > loss_1: 24.93269920349121 (35.9533126889443) | > grad_norm_1: tensor(10047.4473, device='cuda:0') (tensor(20064.0234, device='cuda:0')) | > current_lr_0: 0.00018703825697773558 | > current_lr_1: 0.00018703825697773558 | > step_time: 0.2738 (0.39576694430137166) | > loader_time: 0.2581 (0.016814460559767118)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.708200454711914 (2.708200454711914) | > loss_disc_real_0: 0.1127961128950119 (0.1127961128950119) | > loss_disc_real_1: 0.28206199407577515 (0.28206199407577515) | > loss_disc_real_2: 0.27387019991874695 (0.27387019991874695) | > loss_disc_real_3: 0.2922356128692627 (0.2922356128692627) | > loss_disc_real_4: 0.33943116664886475 (0.33943116664886475) | > loss_disc_real_5: 0.2521442770957947 (0.2521442770957947) | > loss_0: 2.708200454711914 (2.708200454711914) | > loss_gen: 1.9322720766067505 (1.9322720766067505) | > loss_kl: 1.7351479530334473 (1.7351479530334473) | > loss_feat: 1.7891899347305298 (1.7891899347305298) | > loss_mel: 20.822765350341797 (20.822765350341797) | > loss_duration: 2.0080175399780273 (2.0080175399780273) | > loss_1: 28.287391662597656 (28.287391662597656)  --> STEP: 1 | > loss_disc: 1.782196283340454 (1.782196283340454) | > loss_disc_real_0: 0.05450545623898506 (0.05450545623898506) | > loss_disc_real_1: 0.21142297983169556 (0.21142297983169556) | > loss_disc_real_2: 0.20011034607887268 (0.20011034607887268) | > loss_disc_real_3: 0.13195696473121643 (0.13195696473121643) | > loss_disc_real_4: 0.04853900521993637 (0.04853900521993637) | > loss_disc_real_5: 0.13063104450702667 (0.13063104450702667) | > loss_0: 1.782196283340454 (1.782196283340454) | > loss_gen: 2.4500789642333984 (2.4500789642333984) | > loss_kl: 2.4116804599761963 (2.4116804599761963) | > loss_feat: 8.499347686767578 (8.499347686767578) | > loss_mel: 25.235597610473633 (25.235597610473633) | > loss_duration: 2.0626487731933594 (2.0626487731933594) | > loss_1: 40.65935134887695 (40.65935134887695)  --> STEP: 2 | > loss_disc: 1.6169238090515137 (1.6995600461959839) | > loss_disc_real_0: 0.07836727052927017 (0.06643636338412762) | > loss_disc_real_1: 0.2479996532201767 (0.22971131652593613) | > loss_disc_real_2: 0.06359011679887772 (0.1318502314388752) | > loss_disc_real_3: 0.2904853820800781 (0.21122117340564728) | > loss_disc_real_4: 0.0374126173555851 (0.042975811287760735) | > loss_disc_real_5: 0.014883172698318958 (0.07275710860267282) | > loss_0: 1.6169238090515137 (1.6995600461959839) | > loss_gen: 2.7061665058135986 (2.5781227350234985) | > loss_kl: 2.6072206497192383 (2.5094505548477173) | > loss_feat: 8.990257263183594 (8.744802474975586) | > loss_mel: 26.930347442626953 (26.082972526550293) | > loss_duration: 2.0574095249176025 (2.060029149055481) | > loss_1: 43.29140090942383 (41.97537612915039)  --> STEP: 3 | > loss_disc: 2.5208802223205566 (1.973333438237508) | > loss_disc_real_0: 0.14781177043914795 (0.0935614990691344) | > loss_disc_real_1: 0.22451993823051453 (0.22798085709412894) | > loss_disc_real_2: 0.217178076505661 (0.16029284646113715) | > loss_disc_real_3: 0.20639239251613617 (0.20961157977581024) | > loss_disc_real_4: 0.16070370376110077 (0.08221844211220741) | > loss_disc_real_5: 0.24576498568058014 (0.13042640096197525) | > loss_0: 2.5208802223205566 (1.973333438237508) | > loss_gen: 1.971285104751587 (2.3758435249328613) | > loss_kl: 1.4037718772888184 (2.1408909956614175) | > loss_feat: 4.380903244018555 (7.290169397989909) | > loss_mel: 28.71631622314453 (26.96075375874837) | > loss_duration: 2.1510860919952393 (2.090381463368734) | > loss_1: 38.62336349487305 (40.858038584391274) --> EVAL PERFORMANCE | > avg_loader_time: 0.013808965682983398 (+0.01132980982462565) | > avg_loss_disc: 1.973333438237508 (-0.17837508519490552) | > avg_loss_disc_real_0: 0.0935614990691344 (-0.01146268720428148) | > avg_loss_disc_real_1: 0.22798085709412894 (+0.05650275448958081) | > avg_loss_disc_real_2: 0.16029284646113715 (+0.0010460838675498962) | > avg_loss_disc_real_3: 0.20961157977581024 (-0.07905168831348419) | > avg_loss_disc_real_4: 0.08221844211220741 (-0.19404237096508342) | > avg_loss_disc_real_5: 0.13042640096197525 (-0.05294448106239241) | > avg_loss_0: 1.973333438237508 (-0.17837508519490552) | > avg_loss_gen: 2.3758435249328613 (-0.12312420209248875) | > avg_loss_kl: 2.1408909956614175 (+0.2565253575642903) | > avg_loss_feat: 7.290169397989909 (+0.5128837426503505) | > avg_loss_mel: 26.96075375874837 (-0.5525779724121094) | > avg_loss_duration: 2.090381463368734 (-0.026555379231770537) | > avg_loss_1: 40.858038584391274 (+0.06715011596679688)  > EPOCH: 68/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:24:18)   --> TIME: 2023-10-20 00:24:38 -- STEP: 29/50 -- GLOBAL_STEP: 56430 | > loss_disc: 1.722646951675415 (2.4562722115681086) | > loss_disc_real_0: 0.04156197980046272 (0.1598381375701263) | > loss_disc_real_1: 0.07793096452951431 (0.22995379913983674) | > loss_disc_real_2: 0.08466638624668121 (0.20708897851150612) | > loss_disc_real_3: 0.18035735189914703 (0.22799080603852354) | > loss_disc_real_4: 0.5703745484352112 (0.23685520514845848) | > loss_disc_real_5: 0.10152603685855865 (0.19723306069600172) | > loss_0: 1.722646951675415 (2.4562722115681086) | > grad_norm_0: tensor(531.8663, device='cuda:0') (tensor(454.3745, device='cuda:0')) | > loss_gen: 3.806448221206665 (2.3386566351199973) | > loss_kl: 1.3546160459518433 (1.3275827950444714) | > loss_feat: 12.961557388305664 (5.49463404201228) | > loss_mel: 26.454669952392578 (25.32593876740028) | > loss_duration: 1.8687971830368042 (1.8584828171236762) | > loss_1: 46.44609069824219 (36.345295675869636) | > grad_norm_1: tensor(30309.1328, device='cuda:0') (tensor(18618.1504, device='cuda:0')) | > current_lr_0: 0.00018685130052954112 | > current_lr_1: 0.00018685130052954112 | > step_time: 0.305 (0.4862619926189554) | > loader_time: 0.0246 (0.021157905973237138)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9934611320495605 (2.9934611320495605) | > loss_disc_real_0: 0.2901400923728943 (0.2901400923728943) | > loss_disc_real_1: 0.3252449631690979 (0.3252449631690979) | > loss_disc_real_2: 0.25992685556411743 (0.25992685556411743) | > loss_disc_real_3: 0.28035107254981995 (0.28035107254981995) | > loss_disc_real_4: 0.2492476850748062 (0.2492476850748062) | > loss_disc_real_5: 0.16027820110321045 (0.16027820110321045) | > loss_0: 2.9934611320495605 (2.9934611320495605) | > loss_gen: 2.3370935916900635 (2.3370935916900635) | > loss_kl: 2.4826254844665527 (2.4826254844665527) | > loss_feat: 6.141499996185303 (6.141499996185303) | > loss_mel: 25.023578643798828 (25.023578643798828) | > loss_duration: 1.9804773330688477 (1.9804773330688477) | > loss_1: 37.965274810791016 (37.965274810791016)  --> STEP: 1 | > loss_disc: 3.1141178607940674 (3.1141178607940674) | > loss_disc_real_0: 0.618637204170227 (0.618637204170227) | > loss_disc_real_1: 0.27440428733825684 (0.27440428733825684) | > loss_disc_real_2: 0.30579447746276855 (0.30579447746276855) | > loss_disc_real_3: 0.4224155843257904 (0.4224155843257904) | > loss_disc_real_4: 0.3634926378726959 (0.3634926378726959) | > loss_disc_real_5: 0.2856818437576294 (0.2856818437576294) | > loss_0: 3.1141178607940674 (3.1141178607940674) | > loss_gen: 3.0303878784179688 (3.0303878784179688) | > loss_kl: 2.3830766677856445 (2.3830766677856445) | > loss_feat: 7.402048587799072 (7.402048587799072) | > loss_mel: 26.916101455688477 (26.916101455688477) | > loss_duration: 2.109489679336548 (2.109489679336548) | > loss_1: 41.841102600097656 (41.841102600097656)  --> STEP: 2 | > loss_disc: 2.971168279647827 (3.0426430702209473) | > loss_disc_real_0: 0.18485313653945923 (0.40174517035484314) | > loss_disc_real_1: 0.37231016159057617 (0.3233572244644165) | > loss_disc_real_2: 0.21520927548408508 (0.2605018764734268) | > loss_disc_real_3: 0.33068913221359253 (0.37655235826969147) | > loss_disc_real_4: 0.29902955889701843 (0.3312610983848572) | > loss_disc_real_5: 0.3128300905227661 (0.29925596714019775) | > loss_0: 2.971168279647827 (3.0426430702209473) | > loss_gen: 1.9018306732177734 (2.466109275817871) | > loss_kl: 1.773220419883728 (2.0781485438346863) | > loss_feat: 2.011505126953125 (4.706776857376099) | > loss_mel: 25.758621215820312 (26.337361335754395) | > loss_duration: 2.034789562225342 (2.072139620780945) | > loss_1: 33.47996520996094 (37.6605339050293)  --> STEP: 3 | > loss_disc: 1.597058653831482 (2.5607815980911255) | > loss_disc_real_0: 0.07690732926130295 (0.29346588999032974) | > loss_disc_real_1: 0.15012817084789276 (0.26561420659224194) | > loss_disc_real_2: 0.14657218754291534 (0.22252531349658966) | > loss_disc_real_3: 0.12729987502098083 (0.2934681971867879) | > loss_disc_real_4: 0.14039193093776703 (0.26763804256916046) | > loss_disc_real_5: 0.012054309248924255 (0.2035220811764399) | > loss_0: 1.597058653831482 (2.5607815980911255) | > loss_gen: 2.424473762512207 (2.45223077138265) | > loss_kl: 1.7796803712844849 (1.9786591529846191) | > loss_feat: 7.627140998840332 (5.68023157119751) | > loss_mel: 26.596513748168945 (26.42374547322591) | > loss_duration: 2.147890329360962 (2.0973898569742837) | > loss_1: 40.57569885253906 (38.63225555419922) --> EVAL PERFORMANCE | > avg_loader_time: 0.008092403411865234 (-0.005716562271118164) | > avg_loss_disc: 2.5607815980911255 (+0.5874481598536174) | > avg_loss_disc_real_0: 0.29346588999032974 (+0.19990439092119533) | > avg_loss_disc_real_1: 0.26561420659224194 (+0.037633349498113006) | > avg_loss_disc_real_2: 0.22252531349658966 (+0.062232467035452516) | > avg_loss_disc_real_3: 0.2934681971867879 (+0.08385661741097766) | > avg_loss_disc_real_4: 0.26763804256916046 (+0.18541960045695305) | > avg_loss_disc_real_5: 0.2035220811764399 (+0.07309568021446466) | > avg_loss_0: 2.5607815980911255 (+0.5874481598536174) | > avg_loss_gen: 2.45223077138265 (+0.07638724644978856) | > avg_loss_kl: 1.9786591529846191 (-0.16223184267679835) | > avg_loss_feat: 5.68023157119751 (-1.6099378267923994) | > avg_loss_mel: 26.42374547322591 (-0.5370082855224609) | > avg_loss_duration: 2.0973898569742837 (+0.007008393605549834) | > avg_loss_1: 38.63225555419922 (-2.225783030192055)  > EPOCH: 69/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:24:59)   --> TIME: 2023-10-20 00:25:05 -- STEP: 9/50 -- GLOBAL_STEP: 56460 | > loss_disc: 2.019441604614258 (2.688403738869561) | > loss_disc_real_0: 0.2596091330051422 (0.12206537276506424) | > loss_disc_real_1: 0.07266464829444885 (0.1925604355831941) | > loss_disc_real_2: 0.12442253530025482 (0.252353322174814) | > loss_disc_real_3: 0.17997024953365326 (0.22989375558164385) | > loss_disc_real_4: 0.13190965354442596 (0.2649982563323445) | > loss_disc_real_5: 0.04922879487276077 (0.36927561379141277) | > loss_0: 2.019441604614258 (2.688403738869561) | > grad_norm_0: tensor(643.7153, device='cuda:0') (tensor(574.5676, device='cuda:0')) | > loss_gen: 2.9015250205993652 (2.431962940427992) | > loss_kl: 1.2979031801223755 (1.2248105340533786) | > loss_feat: 7.894987106323242 (6.26395230823093) | > loss_mel: 27.54319953918457 (26.697292539808487) | > loss_duration: 1.7058525085449219 (1.7940302027596369) | > loss_1: 41.343467712402344 (38.41204833984375) | > grad_norm_1: tensor(5557.3164, device='cuda:0') (tensor(23009.3047, device='cuda:0')) | > current_lr_0: 0.0001866645309560218 | > current_lr_1: 0.0001866645309560218 | > step_time: 0.2556 (0.3028450806935628) | > loader_time: 0.0035 (0.0027104483710394967)  --> TIME: 2023-10-20 00:25:21 -- STEP: 39/50 -- GLOBAL_STEP: 56490 | > loss_disc: 1.5829882621765137 (2.625045806933672) | > loss_disc_real_0: 0.031207725405693054 (0.17777248507795426) | > loss_disc_real_1: 0.06363680213689804 (0.23283562818780923) | > loss_disc_real_2: 0.13383691012859344 (0.2513367568071072) | > loss_disc_real_3: 0.17321434617042542 (0.24736786824770463) | > loss_disc_real_4: 0.08569421619176865 (0.23147571879701737) | > loss_disc_real_5: 0.34405219554901123 (0.2682985759889469) | > loss_0: 1.5829882621765137 (2.625045806933672) | > grad_norm_0: tensor(754.4566, device='cuda:0') (tensor(1432.6520, device='cuda:0')) | > loss_gen: 2.7184972763061523 (2.3562080707305517) | > loss_kl: 0.8242273330688477 (1.1489724341111307) | > loss_feat: 6.93974494934082 (5.123361921558778) | > loss_mel: 24.432470321655273 (23.69017961697701) | > loss_duration: 1.8550524711608887 (1.8254988804841652) | > loss_1: 36.76999282836914 (34.14422079233023) | > grad_norm_1: tensor(41968.7148, device='cuda:0') (tensor(33314.9453, device='cuda:0')) | > current_lr_0: 0.0001866645309560218 | > current_lr_1: 0.0001866645309560218 | > step_time: 0.304 (0.443957982919155) | > loader_time: 0.0244 (0.011681202130439954)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8990490436553955 (2.8990490436553955) | > loss_disc_real_0: 0.6971060037612915 (0.6971060037612915) | > loss_disc_real_1: 0.18716971576213837 (0.18716971576213837) | > loss_disc_real_2: 0.2308008074760437 (0.2308008074760437) | > loss_disc_real_3: 0.29836320877075195 (0.29836320877075195) | > loss_disc_real_4: 0.20989365875720978 (0.20989365875720978) | > loss_disc_real_5: 0.1901342123746872 (0.1901342123746872) | > loss_0: 2.8990490436553955 (2.8990490436553955) | > loss_gen: 2.7623291015625 (2.7623291015625) | > loss_kl: 1.8376922607421875 (1.8376922607421875) | > loss_feat: 4.513533115386963 (4.513533115386963) | > loss_mel: 26.62287712097168 (26.62287712097168) | > loss_duration: 1.9958282709121704 (1.9958282709121704) | > loss_1: 37.73225784301758 (37.73225784301758)  --> STEP: 1 | > loss_disc: 1.6223323345184326 (1.6223323345184326) | > loss_disc_real_0: 0.20116442441940308 (0.20116442441940308) | > loss_disc_real_1: 0.07228581607341766 (0.07228581607341766) | > loss_disc_real_2: 0.0784681886434555 (0.0784681886434555) | > loss_disc_real_3: 0.17157214879989624 (0.17157214879989624) | > loss_disc_real_4: 0.10597044229507446 (0.10597044229507446) | > loss_disc_real_5: 0.10241828858852386 (0.10241828858852386) | > loss_0: 1.6223323345184326 (1.6223323345184326) | > loss_gen: 2.6626808643341064 (2.6626808643341064) | > loss_kl: 3.0242974758148193 (3.0242974758148193) | > loss_feat: 8.493145942687988 (8.493145942687988) | > loss_mel: 25.10663604736328 (25.10663604736328) | > loss_duration: 2.079132318496704 (2.079132318496704) | > loss_1: 41.36589431762695 (41.36589431762695)  --> STEP: 2 | > loss_disc: 2.279324531555176 (1.9508284330368042) | > loss_disc_real_0: 0.20136581361293793 (0.2012651190161705) | > loss_disc_real_1: 0.2308460921049118 (0.15156595408916473) | > loss_disc_real_2: 0.2599303722381592 (0.16919928044080734) | > loss_disc_real_3: 0.19781073927879333 (0.1846914440393448) | > loss_disc_real_4: 0.09023828059434891 (0.09810436144471169) | > loss_disc_real_5: 0.240520641207695 (0.17146946489810944) | > loss_0: 2.279324531555176 (1.9508284330368042) | > loss_gen: 2.452376365661621 (2.5575286149978638) | > loss_kl: 2.254403829574585 (2.639350652694702) | > loss_feat: 5.075535774230957 (6.784340858459473) | > loss_mel: 28.50882339477539 (26.807729721069336) | > loss_duration: 2.1263365745544434 (2.1027344465255737) | > loss_1: 40.417476654052734 (40.891685485839844)  --> STEP: 3 | > loss_disc: 2.1966490745544434 (2.032768646876017) | > loss_disc_real_0: 0.21248875558376312 (0.20500633120536804) | > loss_disc_real_1: 0.21613647043704987 (0.17308945953845978) | > loss_disc_real_2: 0.22037312388420105 (0.1862572282552719) | > loss_disc_real_3: 0.1390267163515091 (0.16946986814339957) | > loss_disc_real_4: 0.14454302191734314 (0.11358391493558884) | > loss_disc_real_5: 0.20742401480674744 (0.18345431486765543) | > loss_0: 2.1966490745544434 (2.032768646876017) | > loss_gen: 2.4435606002807617 (2.5195392767588296) | > loss_kl: 1.299270749092102 (2.1926573514938354) | > loss_feat: 5.163046360015869 (6.2439093589782715) | > loss_mel: 23.93452262878418 (25.84999402364095) | > loss_duration: 2.0489978790283203 (2.0848222573598227) | > loss_1: 34.88939666748047 (38.89092254638672) --> EVAL PERFORMANCE | > avg_loader_time: 0.006179014841715495 (-0.0019133885701497393) | > avg_loss_disc: 2.032768646876017 (-0.5280129512151084) | > avg_loss_disc_real_0: 0.20500633120536804 (-0.0884595587849617) | > avg_loss_disc_real_1: 0.17308945953845978 (-0.09252474705378216) | > avg_loss_disc_real_2: 0.1862572282552719 (-0.03626808524131775) | > avg_loss_disc_real_3: 0.16946986814339957 (-0.12399832904338834) | > avg_loss_disc_real_4: 0.11358391493558884 (-0.15405412763357162) | > avg_loss_disc_real_5: 0.18345431486765543 (-0.020067766308784485) | > avg_loss_0: 2.032768646876017 (-0.5280129512151084) | > avg_loss_gen: 2.5195392767588296 (+0.06730850537617972) | > avg_loss_kl: 2.1926573514938354 (+0.2139981985092163) | > avg_loss_feat: 6.2439093589782715 (+0.5636777877807617) | > avg_loss_mel: 25.84999402364095 (-0.5737514495849609) | > avg_loss_duration: 2.0848222573598227 (-0.012567599614460967) | > avg_loss_1: 38.89092254638672 (+0.2586669921875)  > EPOCH: 70/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:25:35)   --> TIME: 2023-10-20 00:25:48 -- STEP: 19/50 -- GLOBAL_STEP: 56520 | > loss_disc: 3.387990713119507 (2.588839148220263) | > loss_disc_real_0: 0.08726899325847626 (0.13696742596987047) | > loss_disc_real_1: 0.4012278914451599 (0.26707479396933004) | > loss_disc_real_2: 0.30377310514450073 (0.2595855434866328) | > loss_disc_real_3: 0.3013995289802551 (0.2511898741910332) | > loss_disc_real_4: 0.3559543490409851 (0.24312159914131226) | > loss_disc_real_5: 0.22080358862876892 (0.21420830233316673) | > loss_0: 3.387990713119507 (2.588839148220263) | > grad_norm_0: tensor(1358.5818, device='cuda:0') (tensor(1383.1749, device='cuda:0')) | > loss_gen: 2.1075594425201416 (2.4668386296222082) | > loss_kl: 1.3553540706634521 (1.1710216152040582) | > loss_feat: 5.7164626121521 (5.333618287585284) | > loss_mel: 24.63938331604004 (25.79869506233617) | > loss_duration: 1.9717854261398315 (1.9005311853007267) | > loss_1: 35.79054641723633 (36.67070524316085) | > grad_norm_1: tensor(28075.3301, device='cuda:0') (tensor(51364.0586, device='cuda:0')) | > current_lr_0: 0.00018647794807038476 | > current_lr_1: 0.00018647794807038476 | > step_time: 0.5963 (0.5011170663331684) | > loader_time: 0.0242 (0.0217997902318051)  --> TIME: 2023-10-20 00:26:00 -- STEP: 49/50 -- GLOBAL_STEP: 56550 | > loss_disc: 2.6352293491363525 (2.576265940860826) | > loss_disc_real_0: 0.6939325928688049 (0.16900906057990328) | > loss_disc_real_1: 0.21612092852592468 (0.2414690476595139) | > loss_disc_real_2: 0.2392425239086151 (0.2420881732690091) | > loss_disc_real_3: 0.21760942041873932 (0.24191927849030012) | > loss_disc_real_4: 0.26364463567733765 (0.2518724645773063) | > loss_disc_real_5: 0.2762138247489929 (0.22234637662768364) | > loss_0: 2.6352293491363525 (2.576265940860826) | > grad_norm_0: tensor(1987.3507, device='cuda:0') (tensor(1144.2394, device='cuda:0')) | > loss_gen: 3.7166941165924072 (2.439199289497064) | > loss_kl: 0.9305687546730042 (1.1266289438520158) | > loss_feat: 4.879820346832275 (4.893615582919851) | > loss_mel: 27.16266632080078 (25.12084687485987) | > loss_duration: 1.913997769355774 (1.8426055032379773) | > loss_1: 38.6037483215332 (35.422896346267386) | > grad_norm_1: tensor(44803.6172, device='cuda:0') (tensor(39928.9609, device='cuda:0')) | > current_lr_0: 0.00018647794807038476 | > current_lr_1: 0.00018647794807038476 | > step_time: 0.2594 (0.4235343981762322) | > loader_time: 0.2117 (0.019607845617800337)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0853774547576904 (3.0853774547576904) | > loss_disc_real_0: 0.6126569509506226 (0.6126569509506226) | > loss_disc_real_1: 0.25182604789733887 (0.25182604789733887) | > loss_disc_real_2: 0.31729134917259216 (0.31729134917259216) | > loss_disc_real_3: 0.3063170909881592 (0.3063170909881592) | > loss_disc_real_4: 0.2913280129432678 (0.2913280129432678) | > loss_disc_real_5: 0.27825161814689636 (0.27825161814689636) | > loss_0: 3.0853774547576904 (3.0853774547576904) | > loss_gen: 2.204385280609131 (2.204385280609131) | > loss_kl: 2.370192766189575 (2.370192766189575) | > loss_feat: 0.30849123001098633 (0.30849123001098633) | > loss_mel: 10.40261173248291 (10.40261173248291) | > loss_duration: 1.9895156621932983 (1.9895156621932983) | > loss_1: 17.275196075439453 (17.275196075439453)  --> STEP: 1 | > loss_disc: 2.702375888824463 (2.702375888824463) | > loss_disc_real_0: 0.22670766711235046 (0.22670766711235046) | > loss_disc_real_1: 0.11808118224143982 (0.11808118224143982) | > loss_disc_real_2: 0.3015648424625397 (0.3015648424625397) | > loss_disc_real_3: 0.3262588381767273 (0.3262588381767273) | > loss_disc_real_4: 0.2069321870803833 (0.2069321870803833) | > loss_disc_real_5: 0.23085585236549377 (0.23085585236549377) | > loss_0: 2.702375888824463 (2.702375888824463) | > loss_gen: 1.986721396446228 (1.986721396446228) | > loss_kl: 2.6301050186157227 (2.6301050186157227) | > loss_feat: 4.658257007598877 (4.658257007598877) | > loss_mel: 25.51288604736328 (25.51288604736328) | > loss_duration: 2.087252616882324 (2.087252616882324) | > loss_1: 36.875221252441406 (36.875221252441406)  --> STEP: 2 | > loss_disc: 2.347835063934326 (2.5251054763793945) | > loss_disc_real_0: 0.257941335439682 (0.24232450127601624) | > loss_disc_real_1: 0.18424560129642487 (0.15116339176893234) | > loss_disc_real_2: 0.2479097843170166 (0.27473731338977814) | > loss_disc_real_3: 0.34979429841041565 (0.33802656829357147) | > loss_disc_real_4: 0.131517693400383 (0.16922494024038315) | > loss_disc_real_5: 0.0717625692486763 (0.15130921080708504) | > loss_0: 2.347835063934326 (2.5251054763793945) | > loss_gen: 2.0648791790008545 (2.0258002877235413) | > loss_kl: 2.314579963684082 (2.4723424911499023) | > loss_feat: 4.75439453125 (4.7063257694244385) | > loss_mel: 29.150413513183594 (27.331649780273438) | > loss_duration: 2.074711322784424 (2.080981969833374) | > loss_1: 40.358978271484375 (38.61709976196289)  --> STEP: 3 | > loss_disc: 2.960338592529297 (2.6701831817626953) | > loss_disc_real_0: 0.5807709693908691 (0.35513999064763385) | > loss_disc_real_1: 0.3443569242954254 (0.21556123594443002) | > loss_disc_real_2: 0.5035856366157532 (0.35102008779843646) | > loss_disc_real_3: 0.3182786703109741 (0.3314439356327057) | > loss_disc_real_4: 0.23779921233654022 (0.19208303093910217) | > loss_disc_real_5: 0.1562262773513794 (0.15294823298851648) | > loss_0: 2.960338592529297 (2.6701831817626953) | > loss_gen: 2.773493766784668 (2.2750314474105835) | > loss_kl: 1.3989145755767822 (2.1145331859588623) | > loss_feat: 3.7888174057006836 (4.4004896481831866) | > loss_mel: 27.69292640686035 (27.452075322469074) | > loss_duration: 2.111642599105835 (2.091202179590861) | > loss_1: 37.76579284667969 (38.33333079020182) --> EVAL PERFORMANCE | > avg_loader_time: 0.013856331507364908 (+0.007677316665649413) | > avg_loss_disc: 2.6701831817626953 (+0.6374145348866782) | > avg_loss_disc_real_0: 0.35513999064763385 (+0.1501336594422658) | > avg_loss_disc_real_1: 0.21556123594443002 (+0.042471776405970246) | > avg_loss_disc_real_2: 0.35102008779843646 (+0.16476285954316455) | > avg_loss_disc_real_3: 0.3314439356327057 (+0.16197406748930612) | > avg_loss_disc_real_4: 0.19208303093910217 (+0.07849911600351334) | > avg_loss_disc_real_5: 0.15294823298851648 (-0.030506081879138947) | > avg_loss_0: 2.6701831817626953 (+0.6374145348866782) | > avg_loss_gen: 2.2750314474105835 (-0.2445078293482461) | > avg_loss_kl: 2.1145331859588623 (-0.07812416553497314) | > avg_loss_feat: 4.4004896481831866 (-1.843419710795085) | > avg_loss_mel: 27.452075322469074 (+1.602081298828125) | > avg_loss_duration: 2.091202179590861 (+0.006379922231038115) | > avg_loss_1: 38.33333079020182 (-0.5575917561848982)  > EPOCH: 71/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:26:14)   --> TIME: 2023-10-20 00:26:32 -- STEP: 29/50 -- GLOBAL_STEP: 56580 | > loss_disc: 2.1323845386505127 (2.4779040196846265) | > loss_disc_real_0: 0.054029159247875214 (0.19881525044811182) | > loss_disc_real_1: 0.0764957144856453 (0.2247856837408296) | > loss_disc_real_2: 0.0551844984292984 (0.21036032381756553) | > loss_disc_real_3: 0.19655241072177887 (0.23134750359017273) | > loss_disc_real_4: 0.20958198606967926 (0.19249086685735603) | > loss_disc_real_5: 0.09048160165548325 (0.19700073325556927) | > loss_0: 2.1323845386505127 (2.4779040196846265) | > grad_norm_0: tensor(880.0229, device='cuda:0') (tensor(1116.9160, device='cuda:0')) | > loss_gen: 1.913096308708191 (2.3178284168243413) | > loss_kl: 0.9843135476112366 (1.18779960377463) | > loss_feat: 9.044516563415527 (5.052358761943619) | > loss_mel: 30.99321746826172 (26.004269978095746) | > loss_duration: 1.8563218116760254 (1.8481399930756668) | > loss_1: 44.79146957397461 (36.4103966745837) | > grad_norm_1: tensor(30223., device='cuda:0') (tensor(34371.5117, device='cuda:0')) | > current_lr_0: 0.00018629155168602374 | > current_lr_1: 0.00018629155168602374 | > step_time: 0.2974 (0.496179276499255) | > loader_time: 0.0253 (0.02049551338985048)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8880820274353027 (2.8880820274353027) | > loss_disc_real_0: 0.2087617963552475 (0.2087617963552475) | > loss_disc_real_1: 0.2781544029712677 (0.2781544029712677) | > loss_disc_real_2: 0.28155046701431274 (0.28155046701431274) | > loss_disc_real_3: 0.297621488571167 (0.297621488571167) | > loss_disc_real_4: 0.2854487895965576 (0.2854487895965576) | > loss_disc_real_5: 0.26075780391693115 (0.26075780391693115) | > loss_0: 2.8880820274353027 (2.8880820274353027) | > loss_gen: 1.7692136764526367 (1.7692136764526367) | > loss_kl: 2.355952024459839 (2.355952024459839) | > loss_feat: 0.5435128211975098 (0.5435128211975098) | > loss_mel: 4.206103801727295 (4.206103801727295) | > loss_duration: 1.9523156881332397 (1.9523156881332397) | > loss_1: 10.82709789276123 (10.82709789276123)  --> STEP: 1 | > loss_disc: 3.0767157077789307 (3.0767157077789307) | > loss_disc_real_0: 0.29082760214805603 (0.29082760214805603) | > loss_disc_real_1: 0.36469826102256775 (0.36469826102256775) | > loss_disc_real_2: 0.3656695485115051 (0.3656695485115051) | > loss_disc_real_3: 0.38470226526260376 (0.38470226526260376) | > loss_disc_real_4: 0.5328799486160278 (0.5328799486160278) | > loss_disc_real_5: 0.6378269195556641 (0.6378269195556641) | > loss_0: 3.0767157077789307 (3.0767157077789307) | > loss_gen: 3.5280673503875732 (3.5280673503875732) | > loss_kl: 2.7154510021209717 (2.7154510021209717) | > loss_feat: 5.626698970794678 (5.626698970794678) | > loss_mel: 26.126258850097656 (26.126258850097656) | > loss_duration: 2.06011700630188 (2.06011700630188) | > loss_1: 40.05659103393555 (40.05659103393555)  --> STEP: 2 | > loss_disc: 2.86929988861084 (2.9730077981948853) | > loss_disc_real_0: 0.16576071083545685 (0.22829415649175644) | > loss_disc_real_1: 0.27027836441993713 (0.31748831272125244) | > loss_disc_real_2: 0.3156181275844574 (0.34064383804798126) | > loss_disc_real_3: 0.2786225974559784 (0.3316624313592911) | > loss_disc_real_4: 0.269479900598526 (0.4011799246072769) | > loss_disc_real_5: 0.2885116934776306 (0.46316930651664734) | > loss_0: 2.86929988861084 (2.9730077981948853) | > loss_gen: 2.0035340785980225 (2.765800714492798) | > loss_kl: 2.16916561126709 (2.4423083066940308) | > loss_feat: 3.023582935333252 (4.325140953063965) | > loss_mel: 25.90550422668457 (26.015881538391113) | > loss_duration: 2.0838232040405273 (2.0719701051712036) | > loss_1: 35.185611724853516 (37.62110137939453)  --> STEP: 3 | > loss_disc: 2.408541440963745 (2.7848523457845054) | > loss_disc_real_0: 0.059400662779808044 (0.1719963252544403) | > loss_disc_real_1: 0.3633745610713959 (0.3327837288379669) | > loss_disc_real_2: 0.31928539276123047 (0.333524356285731) | > loss_disc_real_3: 0.4060908257961273 (0.3564718961715698) | > loss_disc_real_4: 0.17322979867458344 (0.3251965492963791) | > loss_disc_real_5: 0.18165668845176697 (0.3693317671616872) | > loss_0: 2.408541440963745 (2.7848523457845054) | > loss_gen: 2.5992259979248047 (2.7102758089701333) | > loss_kl: 1.5142744779586792 (2.13296369711558) | > loss_feat: 5.044899940490723 (4.565060615539551) | > loss_mel: 25.38619613647461 (25.805986404418945) | > loss_duration: 2.1103439331054688 (2.084761381149292) | > loss_1: 36.654937744140625 (37.2990468343099) --> EVAL PERFORMANCE | > avg_loader_time: 0.010608911514282227 (-0.0032474199930826817) | > avg_loss_disc: 2.7848523457845054 (+0.11466916402181004) | > avg_loss_disc_real_0: 0.1719963252544403 (-0.18314366539319354) | > avg_loss_disc_real_1: 0.3327837288379669 (+0.1172224928935369) | > avg_loss_disc_real_2: 0.333524356285731 (-0.017495731512705448) | > avg_loss_disc_real_3: 0.3564718961715698 (+0.025027960538864136) | > avg_loss_disc_real_4: 0.3251965492963791 (+0.13311351835727692) | > avg_loss_disc_real_5: 0.3693317671616872 (+0.21638353417317072) | > avg_loss_0: 2.7848523457845054 (+0.11466916402181004) | > avg_loss_gen: 2.7102758089701333 (+0.4352443615595498) | > avg_loss_kl: 2.13296369711558 (+0.018430511156717788) | > avg_loss_feat: 4.565060615539551 (+0.16457096735636423) | > avg_loss_mel: 25.805986404418945 (-1.646088918050129) | > avg_loss_duration: 2.084761381149292 (-0.006440798441568862) | > avg_loss_1: 37.2990468343099 (-1.0342839558919223)  > EPOCH: 72/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:26:53)   --> TIME: 2023-10-20 00:27:01 -- STEP: 9/50 -- GLOBAL_STEP: 56610 | > loss_disc: 3.189263343811035 (2.152337577607897) | > loss_disc_real_0: 0.06345751881599426 (0.0958894310105178) | > loss_disc_real_1: 0.1524837762117386 (0.16234707832336426) | > loss_disc_real_2: 0.329446405172348 (0.1902625494533115) | > loss_disc_real_3: 0.3093966543674469 (0.17927067892418969) | > loss_disc_real_4: 0.07502894103527069 (0.13961603658066857) | > loss_disc_real_5: 0.09383007884025574 (0.08341545694404179) | > loss_0: 3.189263343811035 (2.152337577607897) | > grad_norm_0: tensor(2447.4207, device='cuda:0') (tensor(1085.4834, device='cuda:0')) | > loss_gen: 2.421743869781494 (3.3245174487431846) | > loss_kl: 1.1889700889587402 (1.32188790374332) | > loss_feat: 7.2329912185668945 (11.35898823208279) | > loss_mel: 27.114748001098633 (29.277115292019314) | > loss_duration: 1.6854026317596436 (1.8080753750271268) | > loss_1: 39.643856048583984 (47.090584648980034) | > grad_norm_1: tensor(15375.7393, device='cuda:0') (tensor(69830.7734, device='cuda:0')) | > current_lr_0: 0.00018610534161651906 | > current_lr_1: 0.00018610534161651906 | > step_time: 0.4113 (0.4006033208635118) | > loader_time: 0.0059 (0.009047693676418729)  --> TIME: 2023-10-20 00:27:13 -- STEP: 39/50 -- GLOBAL_STEP: 56640 | > loss_disc: 2.1510658264160156 (2.729552550193591) | > loss_disc_real_0: 0.17322658002376556 (0.2202026737280763) | > loss_disc_real_1: 0.12446240335702896 (0.23868242765848452) | > loss_disc_real_2: 0.20913730561733246 (0.24105833623653802) | > loss_disc_real_3: 0.22592225670814514 (0.2377281618806032) | > loss_disc_real_4: 0.12950961291790009 (0.27824052690695494) | > loss_disc_real_5: 0.09404794126749039 (0.26815960881037587) | > loss_0: 2.1510658264160156 (2.729552550193591) | > grad_norm_0: tensor(928.9980, device='cuda:0') (tensor(1582.8057, device='cuda:0')) | > loss_gen: 2.026362180709839 (2.55600800881019) | > loss_kl: 0.7533968091011047 (1.245552802315125) | > loss_feat: 4.635272979736328 (5.472635676845526) | > loss_mel: 25.08837127685547 (23.69481500601157) | > loss_duration: 1.808017611503601 (1.8309991329144208) | > loss_1: 34.31142044067383 (34.80001043662048) | > grad_norm_1: tensor(15395.2568, device='cuda:0') (tensor(37494.2617, device='cuda:0')) | > current_lr_0: 0.00018610534161651906 | > current_lr_1: 0.00018610534161651906 | > step_time: 0.6322 (0.3947788201845609) | > loader_time: 0.0028 (0.007480645791078222)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.775689125061035 (2.775689125061035) | > loss_disc_real_0: 0.2433740347623825 (0.2433740347623825) | > loss_disc_real_1: 0.30062830448150635 (0.30062830448150635) | > loss_disc_real_2: 0.16889306902885437 (0.16889306902885437) | > loss_disc_real_3: 0.37127310037612915 (0.37127310037612915) | > loss_disc_real_4: 0.3266042172908783 (0.3266042172908783) | > loss_disc_real_5: 0.4564723074436188 (0.4564723074436188) | > loss_0: 2.775689125061035 (2.775689125061035) | > loss_gen: 2.531656265258789 (2.531656265258789) | > loss_kl: 2.3758544921875 (2.3758544921875) | > loss_feat: 4.746331214904785 (4.746331214904785) | > loss_mel: 23.589462280273438 (23.589462280273438) | > loss_duration: 1.996579885482788 (1.996579885482788) | > loss_1: 35.2398796081543 (35.2398796081543)  --> STEP: 1 | > loss_disc: 2.012270927429199 (2.012270927429199) | > loss_disc_real_0: 0.20158204436302185 (0.20158204436302185) | > loss_disc_real_1: 0.1296340674161911 (0.1296340674161911) | > loss_disc_real_2: 0.08309800177812576 (0.08309800177812576) | > loss_disc_real_3: 0.14146845042705536 (0.14146845042705536) | > loss_disc_real_4: 0.07844852656126022 (0.07844852656126022) | > loss_disc_real_5: 0.10239401459693909 (0.10239401459693909) | > loss_0: 2.012270927429199 (2.012270927429199) | > loss_gen: 2.14984393119812 (2.14984393119812) | > loss_kl: 2.480377197265625 (2.480377197265625) | > loss_feat: 8.515130043029785 (8.515130043029785) | > loss_mel: 27.379287719726562 (27.379287719726562) | > loss_duration: 2.139514446258545 (2.139514446258545) | > loss_1: 42.664154052734375 (42.664154052734375)  --> STEP: 2 | > loss_disc: 2.320443630218506 (2.1663572788238525) | > loss_disc_real_0: 0.3069753646850586 (0.2542787045240402) | > loss_disc_real_1: 0.22086836397647858 (0.17525121569633484) | > loss_disc_real_2: 0.13273055851459503 (0.1079142801463604) | > loss_disc_real_3: 0.19952963292598724 (0.1704990416765213) | > loss_disc_real_4: 0.1365189254283905 (0.10748372599482536) | > loss_disc_real_5: 0.11477185785770416 (0.10858293622732162) | > loss_0: 2.320443630218506 (2.1663572788238525) | > loss_gen: 2.055962085723877 (2.1029030084609985) | > loss_kl: 2.024810552597046 (2.2525938749313354) | > loss_feat: 5.624524116516113 (7.069827079772949) | > loss_mel: 25.53195571899414 (26.45562171936035) | > loss_duration: 2.122049331665039 (2.130781888961792) | > loss_1: 37.35929870605469 (40.01172637939453)  --> STEP: 3 | > loss_disc: 2.967379093170166 (2.4333645502726235) | > loss_disc_real_0: 0.463672012090683 (0.32407647371292114) | > loss_disc_real_1: 0.46480420231819153 (0.2717688779036204) | > loss_disc_real_2: 0.31675875186920166 (0.17752910405397415) | > loss_disc_real_3: 0.36013221740722656 (0.23371010025342306) | > loss_disc_real_4: 0.36126476526260376 (0.1920774057507515) | > loss_disc_real_5: 0.22478896379470825 (0.14731827874978384) | > loss_0: 2.967379093170166 (2.4333645502726235) | > loss_gen: 2.6566762924194336 (2.28749410311381) | > loss_kl: 1.2160742282867432 (1.9070873260498047) | > loss_feat: 2.4694807529449463 (5.536378304163615) | > loss_mel: 25.683889389038086 (26.19837760925293) | > loss_duration: 2.078125 (2.113229592641195) | > loss_1: 34.104244232177734 (38.0425656636556) --> EVAL PERFORMANCE | > avg_loader_time: 0.010480483373006185 (-0.0001284281412760411) | > avg_loss_disc: 2.4333645502726235 (-0.3514877955118818) | > avg_loss_disc_real_0: 0.32407647371292114 (+0.15208014845848083) | > avg_loss_disc_real_1: 0.2717688779036204 (-0.0610148509343465) | > avg_loss_disc_real_2: 0.17752910405397415 (-0.15599525223175686) | > avg_loss_disc_real_3: 0.23371010025342306 (-0.12276179591814676) | > avg_loss_disc_real_4: 0.1920774057507515 (-0.1331191435456276) | > avg_loss_disc_real_5: 0.14731827874978384 (-0.22201348841190335) | > avg_loss_0: 2.4333645502726235 (-0.3514877955118818) | > avg_loss_gen: 2.28749410311381 (-0.42278170585632324) | > avg_loss_kl: 1.9070873260498047 (-0.2258763710657754) | > avg_loss_feat: 5.536378304163615 (+0.9713176886240644) | > avg_loss_mel: 26.19837760925293 (+0.3923912048339844) | > avg_loss_duration: 2.113229592641195 (+0.028468211491902817) | > avg_loss_1: 38.0425656636556 (+0.7435188293457031)  > EPOCH: 73/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:27:27)   --> TIME: 2023-10-20 00:27:40 -- STEP: 19/50 -- GLOBAL_STEP: 56670 | > loss_disc: 2.911853313446045 (2.7729523181915283) | > loss_disc_real_0: 0.17346712946891785 (0.18465724077663923) | > loss_disc_real_1: 0.23912674188613892 (0.2508733115698162) | > loss_disc_real_2: 0.21747462451457977 (0.2568437268859462) | > loss_disc_real_3: 0.23685961961746216 (0.24964121111521595) | > loss_disc_real_4: 0.2615566849708557 (0.2455904648492211) | > loss_disc_real_5: 0.24240198731422424 (0.2822074774456651) | > loss_0: 2.911853313446045 (2.7729523181915283) | > grad_norm_0: tensor(1399.7388, device='cuda:0') (tensor(960.4188, device='cuda:0')) | > loss_gen: 1.6024410724639893 (2.088085745510302) | > loss_kl: 1.2325692176818848 (1.201160148570412) | > loss_feat: 0.3793678879737854 (3.964103425632378) | > loss_mel: 8.524629592895508 (23.527787321492244) | > loss_duration: 2.013212203979492 (1.86370008870175) | > loss_1: 13.752219200134277 (32.64483753003572) | > grad_norm_1: tensor(69495.1328, device='cuda:0') (tensor(34543.9688, device='cuda:0')) | > current_lr_0: 0.00018591931767563734 | > current_lr_1: 0.00018591931767563734 | > step_time: 0.2949 (0.5068558391771817) | > loader_time: 0.0251 (0.01959697823775442)  --> TIME: 2023-10-20 00:27:56 -- STEP: 49/50 -- GLOBAL_STEP: 56700 | > loss_disc: 2.4731075763702393 (2.634602680498239) | > loss_disc_real_0: 0.16599687933921814 (0.16241031877544462) | > loss_disc_real_1: 0.2651243209838867 (0.24628249856130202) | > loss_disc_real_2: 0.15762802958488464 (0.2509372040477334) | > loss_disc_real_3: 0.25847986340522766 (0.24795869232288423) | > loss_disc_real_4: 0.2275392860174179 (0.22591304148034175) | > loss_disc_real_5: 0.24301153421401978 (0.24245640069094232) | > loss_0: 2.4731075763702393 (2.634602680498239) | > grad_norm_0: tensor(855.3773, device='cuda:0') (tensor(1100.7555, device='cuda:0')) | > loss_gen: 2.2735984325408936 (2.172875319208418) | > loss_kl: 1.1081812381744385 (1.1354997650701177) | > loss_feat: 3.8994529247283936 (4.417669433045524) | > loss_mel: 28.164962768554688 (24.119120451868802) | > loss_duration: 1.8612819910049438 (1.8230227256307796) | > loss_1: 37.30747604370117 (33.6681877544948) | > grad_norm_1: tensor(17393.8145, device='cuda:0') (tensor(36516.6094, device='cuda:0')) | > current_lr_0: 0.00018591931767563734 | > current_lr_1: 0.00018591931767563734 | > step_time: 0.2643 (0.4878819961937107) | > loader_time: 0.2476 (0.02153390767622967)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2746167182922363 (2.2746167182922363) | > loss_disc_real_0: 0.18900567293167114 (0.18900567293167114) | > loss_disc_real_1: 0.21108955144882202 (0.21108955144882202) | > loss_disc_real_2: 0.30572590231895447 (0.30572590231895447) | > loss_disc_real_3: 0.2492801696062088 (0.2492801696062088) | > loss_disc_real_4: 0.2090684473514557 (0.2090684473514557) | > loss_disc_real_5: 0.30905988812446594 (0.30905988812446594) | > loss_0: 2.2746167182922363 (2.2746167182922363) | > loss_gen: 2.842113733291626 (2.842113733291626) | > loss_kl: 1.7585419416427612 (1.7585419416427612) | > loss_feat: 5.141268253326416 (5.141268253326416) | > loss_mel: 26.202425003051758 (26.202425003051758) | > loss_duration: 1.9985531568527222 (1.9985531568527222) | > loss_1: 37.942901611328125 (37.942901611328125)  --> STEP: 1 | > loss_disc: 2.8578343391418457 (2.8578343391418457) | > loss_disc_real_0: 0.5434268116950989 (0.5434268116950989) | > loss_disc_real_1: 0.31840434670448303 (0.31840434670448303) | > loss_disc_real_2: 0.26874658465385437 (0.26874658465385437) | > loss_disc_real_3: 0.2678707540035248 (0.2678707540035248) | > loss_disc_real_4: 0.29459500312805176 (0.29459500312805176) | > loss_disc_real_5: 0.2558605670928955 (0.2558605670928955) | > loss_0: 2.8578343391418457 (2.8578343391418457) | > loss_gen: 2.5301673412323 (2.5301673412323) | > loss_kl: 2.2265472412109375 (2.2265472412109375) | > loss_feat: 5.826788425445557 (5.826788425445557) | > loss_mel: 27.281469345092773 (27.281469345092773) | > loss_duration: 2.1026523113250732 (2.1026523113250732) | > loss_1: 39.96762466430664 (39.96762466430664)  --> STEP: 2 | > loss_disc: 3.1840646266937256 (3.0209494829177856) | > loss_disc_real_0: 0.22795644402503967 (0.3856916278600693) | > loss_disc_real_1: 0.293708860874176 (0.30605660378932953) | > loss_disc_real_2: 0.3398013412952423 (0.30427396297454834) | > loss_disc_real_3: 0.22814325988292694 (0.24800700694322586) | > loss_disc_real_4: 0.5070873498916626 (0.4008411765098572) | > loss_disc_real_5: 0.592311441898346 (0.4240860044956207) | > loss_0: 3.1840646266937256 (3.0209494829177856) | > loss_gen: 2.2632336616516113 (2.3967005014419556) | > loss_kl: 2.178352117538452 (2.202449679374695) | > loss_feat: 5.163818836212158 (5.495303630828857) | > loss_mel: 26.527935028076172 (26.904702186584473) | > loss_duration: 2.118579626083374 (2.1106159687042236) | > loss_1: 38.25191879272461 (39.109771728515625)  --> STEP: 3 | > loss_disc: 2.769059658050537 (2.936986207962036) | > loss_disc_real_0: 0.2112756073474884 (0.32755295435587567) | > loss_disc_real_1: 0.3086974322795868 (0.3069368799527486) | > loss_disc_real_2: 0.32303375005722046 (0.310527225335439) | > loss_disc_real_3: 0.291137158870697 (0.26238372425238293) | > loss_disc_real_4: 0.25165438652038574 (0.3511122465133667) | > loss_disc_real_5: 0.3117257058620453 (0.38663257161776227) | > loss_0: 2.769059658050537 (2.936986207962036) | > loss_gen: 2.3456954956054688 (2.3796988328297934) | > loss_kl: 3.5509872436523438 (2.6519622008005777) | > loss_feat: 2.171886920928955 (4.387498060862224) | > loss_mel: 22.515424728393555 (25.441609700520832) | > loss_duration: 2.3202078342437744 (2.1804799238840737) | > loss_1: 32.90420150756836 (37.0412483215332) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028301080067952475 (-0.0076503753662109375) | > avg_loss_disc: 2.936986207962036 (+0.5036216576894126) | > avg_loss_disc_real_0: 0.32755295435587567 (+0.003476480642954527) | > avg_loss_disc_real_1: 0.3069368799527486 (+0.03516800204912818) | > avg_loss_disc_real_2: 0.310527225335439 (+0.13299812128146488) | > avg_loss_disc_real_3: 0.26238372425238293 (+0.02867362399895987) | > avg_loss_disc_real_4: 0.3511122465133667 (+0.1590348407626152) | > avg_loss_disc_real_5: 0.38663257161776227 (+0.23931429286797842) | > avg_loss_0: 2.936986207962036 (+0.5036216576894126) | > avg_loss_gen: 2.3796988328297934 (+0.09220472971598337) | > avg_loss_kl: 2.6519622008005777 (+0.744874874750773) | > avg_loss_feat: 4.387498060862224 (-1.1488802433013916) | > avg_loss_mel: 25.441609700520832 (-0.7567679087320975) | > avg_loss_duration: 2.1804799238840737 (+0.06725033124287894) | > avg_loss_1: 37.0412483215332 (-1.0013173421223982)  > EPOCH: 74/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:28:05)   --> TIME: 2023-10-20 00:28:25 -- STEP: 29/50 -- GLOBAL_STEP: 56730 | > loss_disc: 1.591451644897461 (2.31284187579977) | > loss_disc_real_0: 0.1699749380350113 (0.16421474760462498) | > loss_disc_real_1: 0.26854291558265686 (0.23404143044147) | > loss_disc_real_2: 0.15945535898208618 (0.20677252550577296) | > loss_disc_real_3: 0.08968574553728104 (0.23503854466152602) | > loss_disc_real_4: 0.10623839497566223 (0.19553426357692685) | > loss_disc_real_5: 0.0734482854604721 (0.1979335756522828) | > loss_0: 1.591451644897461 (2.31284187579977) | > grad_norm_0: tensor(515.0922, device='cuda:0') (tensor(1337.1162, device='cuda:0')) | > loss_gen: 2.9003028869628906 (2.6775345185707353) | > loss_kl: 0.875552237033844 (1.2625253611597524) | > loss_feat: 9.145034790039062 (6.923291950390257) | > loss_mel: 29.34856414794922 (28.229086514176995) | > loss_duration: 1.8044439554214478 (1.8459652292317357) | > loss_1: 44.07389831542969 (40.93840375439874) | > grad_norm_1: tensor(15382.2236, device='cuda:0') (tensor(53320.1641, device='cuda:0')) | > current_lr_0: 0.00018573347967733138 | > current_lr_1: 0.00018573347967733138 | > step_time: 0.2937 (0.49185100095025425) | > loader_time: 0.0249 (0.01817904669663002)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9228515625 (1.9228515625) | > loss_disc_real_0: 0.06501564383506775 (0.06501564383506775) | > loss_disc_real_1: 0.21295267343521118 (0.21295267343521118) | > loss_disc_real_2: 0.24425148963928223 (0.24425148963928223) | > loss_disc_real_3: 0.22092387080192566 (0.22092387080192566) | > loss_disc_real_4: 0.28393393754959106 (0.28393393754959106) | > loss_disc_real_5: 0.15636807680130005 (0.15636807680130005) | > loss_0: 1.9228515625 (1.9228515625) | > loss_gen: 2.8412723541259766 (2.8412723541259766) | > loss_kl: 1.5248422622680664 (1.5248422622680664) | > loss_feat: 5.823154449462891 (5.823154449462891) | > loss_mel: 23.13524055480957 (23.13524055480957) | > loss_duration: 2.062823534011841 (2.062823534011841) | > loss_1: 35.387332916259766 (35.387332916259766)  --> STEP: 1 | > loss_disc: 2.2134695053100586 (2.2134695053100586) | > loss_disc_real_0: 0.13555648922920227 (0.13555648922920227) | > loss_disc_real_1: 0.2779604196548462 (0.2779604196548462) | > loss_disc_real_2: 0.14125095307826996 (0.14125095307826996) | > loss_disc_real_3: 0.4139181077480316 (0.4139181077480316) | > loss_disc_real_4: 0.1207999661564827 (0.1207999661564827) | > loss_disc_real_5: 0.0979703888297081 (0.0979703888297081) | > loss_0: 2.2134695053100586 (2.2134695053100586) | > loss_gen: 2.2518815994262695 (2.2518815994262695) | > loss_kl: 2.2457547187805176 (2.2457547187805176) | > loss_feat: 5.121275424957275 (5.121275424957275) | > loss_mel: 25.355815887451172 (25.355815887451172) | > loss_duration: 2.190662384033203 (2.190662384033203) | > loss_1: 37.16539001464844 (37.16539001464844)  --> STEP: 2 | > loss_disc: 1.8188084363937378 (2.016138970851898) | > loss_disc_real_0: 0.0834343358874321 (0.10949541255831718) | > loss_disc_real_1: 0.13026344776153564 (0.20411193370819092) | > loss_disc_real_2: 0.15044090151786804 (0.145845927298069) | > loss_disc_real_3: 0.1097482442855835 (0.26183317601680756) | > loss_disc_real_4: 0.20257078111171722 (0.16168537363409996) | > loss_disc_real_5: 0.1129450798034668 (0.10545773431658745) | > loss_0: 1.8188084363937378 (2.016138970851898) | > loss_gen: 2.8495068550109863 (2.550694227218628) | > loss_kl: 2.3199336528778076 (2.2828441858291626) | > loss_feat: 9.155369758605957 (7.138322591781616) | > loss_mel: 28.66187858581543 (27.0088472366333) | > loss_duration: 2.116218090057373 (2.153440237045288) | > loss_1: 45.102909088134766 (41.1341495513916)  --> STEP: 3 | > loss_disc: 3.099224805831909 (2.377167582511902) | > loss_disc_real_0: 0.25608885288238525 (0.15835989266633987) | > loss_disc_real_1: 0.269816130399704 (0.22601333260536194) | > loss_disc_real_2: 0.3529368042945862 (0.2148762196302414) | > loss_disc_real_3: 0.2839847505092621 (0.26921703418095905) | > loss_disc_real_4: 0.23925869166851044 (0.18754314631223679) | > loss_disc_real_5: 0.24584342539310455 (0.15225296467542648) | > loss_0: 3.099224805831909 (2.377167582511902) | > loss_gen: 1.573821783065796 (2.225070079167684) | > loss_kl: 3.7789602279663086 (2.7815495332082114) | > loss_feat: 0.1964307725429535 (4.824358652035396) | > loss_mel: 3.7703185081481934 (19.26267099380493) | > loss_duration: 2.188856840133667 (2.165245771408081) | > loss_1: 11.50838851928711 (31.258895874023438) --> EVAL PERFORMANCE | > avg_loader_time: 0.023368358612060547 (+0.0205382506052653) | > avg_loss_disc: 2.377167582511902 (-0.5598186254501343) | > avg_loss_disc_real_0: 0.15835989266633987 (-0.1691930616895358) | > avg_loss_disc_real_1: 0.22601333260536194 (-0.08092354734738666) | > avg_loss_disc_real_2: 0.2148762196302414 (-0.09565100570519763) | > avg_loss_disc_real_3: 0.26921703418095905 (+0.0068333099285761145) | > avg_loss_disc_real_4: 0.18754314631223679 (-0.1635691002011299) | > avg_loss_disc_real_5: 0.15225296467542648 (-0.23437960694233578) | > avg_loss_0: 2.377167582511902 (-0.5598186254501343) | > avg_loss_gen: 2.225070079167684 (-0.15462875366210938) | > avg_loss_kl: 2.7815495332082114 (+0.12958733240763376) | > avg_loss_feat: 4.824358652035396 (+0.436860591173172) | > avg_loss_mel: 19.26267099380493 (-6.1789387067159005) | > avg_loss_duration: 2.165245771408081 (-0.01523415247599269) | > avg_loss_1: 31.258895874023438 (-5.782352447509766)  > EPOCH: 75/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:28:46)   --> TIME: 2023-10-20 00:28:53 -- STEP: 9/50 -- GLOBAL_STEP: 56760 | > loss_disc: 3.094311237335205 (2.408269074228075) | > loss_disc_real_0: 0.4402349591255188 (0.2338528260588646) | > loss_disc_real_1: 0.14682726562023163 (0.19735604110691282) | > loss_disc_real_2: 0.40783026814460754 (0.22953260358836916) | > loss_disc_real_3: 0.3343232274055481 (0.23868775098688072) | > loss_disc_real_4: 0.35863637924194336 (0.20208739613493285) | > loss_disc_real_5: 0.2808676064014435 (0.24156947444296545) | > loss_0: 3.094311237335205 (2.408269074228075) | > grad_norm_0: tensor(1213.7885, device='cuda:0') (tensor(889.9940, device='cuda:0')) | > loss_gen: 2.6125917434692383 (2.529752665095859) | > loss_kl: 1.0499329566955566 (1.180155336856842) | > loss_feat: 5.330732345581055 (5.670732266373104) | > loss_mel: 22.688426971435547 (24.187825520833332) | > loss_duration: 1.7507293224334717 (1.828373908996582) | > loss_1: 33.432411193847656 (35.39683935377333) | > grad_norm_1: tensor(44235.5000, device='cuda:0') (tensor(48039.9570, device='cuda:0')) | > current_lr_0: 0.0001855478274357399 | > current_lr_1: 0.0001855478274357399 | > step_time: 0.5959 (0.44944726096259224) | > loader_time: 0.0194 (0.016954819361368816)  --> TIME: 2023-10-20 00:29:05 -- STEP: 39/50 -- GLOBAL_STEP: 56790 | > loss_disc: 2.243225574493408 (2.4369233204768257) | > loss_disc_real_0: 0.12769418954849243 (0.16277421475985113) | > loss_disc_real_1: 0.208103209733963 (0.23529939162425506) | > loss_disc_real_2: 0.3282921612262726 (0.2215379272133876) | > loss_disc_real_3: 0.18347211182117462 (0.23915195995225355) | > loss_disc_real_4: 0.11185793578624725 (0.19988513164795363) | > loss_disc_real_5: 0.3078175187110901 (0.23385359373134681) | > loss_0: 2.243225574493408 (2.4369233204768257) | > grad_norm_0: tensor(1450.6711, device='cuda:0') (tensor(1076.0109, device='cuda:0')) | > loss_gen: 2.7007243633270264 (2.440153843317277) | > loss_kl: 0.9747964143753052 (1.1505378362460015) | > loss_feat: 6.199440956115723 (5.428377051384021) | > loss_mel: 28.987768173217773 (24.500480358417217) | > loss_duration: 1.8229882717132568 (1.8308450350394616) | > loss_1: 40.68571853637695 (35.35039393107096) | > grad_norm_1: tensor(88414.4141, device='cuda:0') (tensor(41170.5508, device='cuda:0')) | > current_lr_0: 0.0001855478274357399 | > current_lr_1: 0.0001855478274357399 | > step_time: 0.3354 (0.39999747887635845) | > loader_time: 0.0026 (0.009924576832697938)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8384034633636475 (2.8384034633636475) | > loss_disc_real_0: 0.1939322054386139 (0.1939322054386139) | > loss_disc_real_1: 0.26558974385261536 (0.26558974385261536) | > loss_disc_real_2: 0.22543583810329437 (0.22543583810329437) | > loss_disc_real_3: 0.2541191875934601 (0.2541191875934601) | > loss_disc_real_4: 0.2907974421977997 (0.2907974421977997) | > loss_disc_real_5: 0.24736493825912476 (0.24736493825912476) | > loss_0: 2.8384034633636475 (2.8384034633636475) | > loss_gen: 1.6663182973861694 (1.6663182973861694) | > loss_kl: 2.850590944290161 (2.850590944290161) | > loss_feat: 0.4591429531574249 (0.4591429531574249) | > loss_mel: 5.4539289474487305 (5.4539289474487305) | > loss_duration: 2.085796356201172 (2.085796356201172) | > loss_1: 12.515776634216309 (12.515776634216309)  --> STEP: 1 | > loss_disc: 2.3657212257385254 (2.3657212257385254) | > loss_disc_real_0: 0.173004150390625 (0.173004150390625) | > loss_disc_real_1: 0.19451044499874115 (0.19451044499874115) | > loss_disc_real_2: 0.13777101039886475 (0.13777101039886475) | > loss_disc_real_3: 0.2372259795665741 (0.2372259795665741) | > loss_disc_real_4: 0.41046595573425293 (0.41046595573425293) | > loss_disc_real_5: 0.24795149266719818 (0.24795149266719818) | > loss_0: 2.3657212257385254 (2.3657212257385254) | > loss_gen: 2.676337480545044 (2.676337480545044) | > loss_kl: 2.9922006130218506 (2.9922006130218506) | > loss_feat: 6.860172271728516 (6.860172271728516) | > loss_mel: 23.186494827270508 (23.186494827270508) | > loss_duration: 2.1940882205963135 (2.1940882205963135) | > loss_1: 37.90929412841797 (37.90929412841797)  --> STEP: 2 | > loss_disc: 1.3149640560150146 (1.84034264087677) | > loss_disc_real_0: 0.07016685605049133 (0.12158550322055817) | > loss_disc_real_1: 0.09705149382352829 (0.14578096941113472) | > loss_disc_real_2: 0.04870377480983734 (0.09323739260435104) | > loss_disc_real_3: 0.2337469607591629 (0.2354864701628685) | > loss_disc_real_4: 0.01366513129323721 (0.21206554351374507) | > loss_disc_real_5: 0.03887558728456497 (0.14341353997588158) | > loss_0: 1.3149640560150146 (1.84034264087677) | > loss_gen: 3.133373498916626 (2.904855489730835) | > loss_kl: 2.1994469165802 (2.5958237648010254) | > loss_feat: 13.785364151000977 (10.322768211364746) | > loss_mel: 26.861366271972656 (25.023930549621582) | > loss_duration: 2.1982388496398926 (2.196163535118103) | > loss_1: 48.17778778076172 (43.043540954589844)  --> STEP: 3 | > loss_disc: 2.408735990524292 (2.0298070907592773) | > loss_disc_real_0: 0.1468062400817871 (0.1299924155076345) | > loss_disc_real_1: 0.22890038788318634 (0.17348744223515192) | > loss_disc_real_2: 0.21493613719940186 (0.13380364080270132) | > loss_disc_real_3: 0.22935135662555695 (0.233441432317098) | > loss_disc_real_4: 0.29155081510543823 (0.23856063404430947) | > loss_disc_real_5: 0.23409487307071686 (0.17364065100749335) | > loss_0: 2.408735990524292 (2.0298070907592773) | > loss_gen: 2.202460765838623 (2.6707239151000977) | > loss_kl: 1.0451300144195557 (2.078925848007202) | > loss_feat: 2.600912570953369 (7.74881633122762) | > loss_mel: 22.619733810424805 (24.22253163655599) | > loss_duration: 2.048999309539795 (2.147108793258667) | > loss_1: 30.517236709594727 (38.86810620625814) --> EVAL PERFORMANCE | > avg_loader_time: 0.010141770044962565 (-0.013226588567097982) | > avg_loss_disc: 2.0298070907592773 (-0.3473604917526245) | > avg_loss_disc_real_0: 0.1299924155076345 (-0.028367477158705384) | > avg_loss_disc_real_1: 0.17348744223515192 (-0.05252589037021002) | > avg_loss_disc_real_2: 0.13380364080270132 (-0.08107257882754007) | > avg_loss_disc_real_3: 0.233441432317098 (-0.035775601863861056) | > avg_loss_disc_real_4: 0.23856063404430947 (+0.05101748773207268) | > avg_loss_disc_real_5: 0.17364065100749335 (+0.021387686332066863) | > avg_loss_0: 2.0298070907592773 (-0.3473604917526245) | > avg_loss_gen: 2.6707239151000977 (+0.4456538359324136) | > avg_loss_kl: 2.078925848007202 (-0.7026236852010093) | > avg_loss_feat: 7.74881633122762 (+2.9244576791922245) | > avg_loss_mel: 24.22253163655599 (+4.959860642751057) | > avg_loss_duration: 2.147108793258667 (-0.018136978149414062) | > avg_loss_1: 38.86810620625814 (+7.609210332234703)  > EPOCH: 76/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:29:21)   --> TIME: 2023-10-20 00:29:34 -- STEP: 19/50 -- GLOBAL_STEP: 56820 | > loss_disc: 1.0261893272399902 (2.317673683166504) | > loss_disc_real_0: 0.022547326982021332 (0.16588960107611983) | > loss_disc_real_1: 0.13080927729606628 (0.21926480296411013) | > loss_disc_real_2: 0.10876958072185516 (0.21278204415973864) | > loss_disc_real_3: 0.07783423364162445 (0.22938018409829392) | > loss_disc_real_4: 0.06275424361228943 (0.2041735900075812) | > loss_disc_real_5: 0.020695919170975685 (0.16014333966335184) | > loss_0: 1.0261893272399902 (2.317673683166504) | > grad_norm_0: tensor(417.4036, device='cuda:0') (tensor(1225.4224, device='cuda:0')) | > loss_gen: 4.8860297203063965 (2.7323527587087533) | > loss_kl: 1.4424573183059692 (1.2211564496943825) | > loss_feat: 14.526922225952148 (6.408812221727874) | > loss_mel: 31.182897567749023 (26.38837212010434) | > loss_duration: 1.9350979328155518 (1.8528477769148977) | > loss_1: 53.9734001159668 (38.603541022852845) | > grad_norm_1: tensor(118740.6250, device='cuda:0') (tensor(44986.0352, device='cuda:0')) | > current_lr_0: 0.00018536236076518748 | > current_lr_1: 0.00018536236076518748 | > step_time: 0.5062 (0.49526568462974135) | > loader_time: 0.0192 (0.01896466706928454)  --> TIME: 2023-10-20 00:29:50 -- STEP: 49/50 -- GLOBAL_STEP: 56850 | > loss_disc: 2.352931499481201 (2.4446260004627467) | > loss_disc_real_0: 0.08707787096500397 (0.17234443696405816) | > loss_disc_real_1: 0.2914643883705139 (0.22871776738641214) | > loss_disc_real_2: 0.4115070402622223 (0.22152601258487117) | > loss_disc_real_3: 0.2753216326236725 (0.2599766207288723) | > loss_disc_real_4: 0.03593058884143829 (0.1962883628296609) | > loss_disc_real_5: 0.05563813075423241 (0.18585905362376753) | > loss_0: 2.352931499481201 (2.4446260004627467) | > grad_norm_0: tensor(2047.5901, device='cuda:0') (tensor(1388.7797, device='cuda:0')) | > loss_gen: 2.259657144546509 (2.5926022237660944) | > loss_kl: 0.8613600134849548 (1.1726838885521402) | > loss_feat: 6.3487067222595215 (5.81138083597227) | > loss_mel: 25.476913452148438 (24.851672542338473) | > loss_duration: 1.9314428567886353 (1.8095910111252143) | > loss_1: 36.878082275390625 (36.23793012268689) | > grad_norm_1: tensor(48523.7695, device='cuda:0') (tensor(40784.7070, device='cuda:0')) | > current_lr_0: 0.00018536236076518748 | > current_lr_1: 0.00018536236076518748 | > step_time: 0.6147 (0.49249456366714167) | > loader_time: 0.2534 (0.024571413896521736)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8294191360473633 (2.8294191360473633) | > loss_disc_real_0: 0.23740416765213013 (0.23740416765213013) | > loss_disc_real_1: 0.2393186390399933 (0.2393186390399933) | > loss_disc_real_2: 0.23712611198425293 (0.23712611198425293) | > loss_disc_real_3: 0.24388828873634338 (0.24388828873634338) | > loss_disc_real_4: 0.34880369901657104 (0.34880369901657104) | > loss_disc_real_5: 0.35456550121307373 (0.35456550121307373) | > loss_0: 2.8294191360473633 (2.8294191360473633) | > loss_gen: 1.9932034015655518 (1.9932034015655518) | > loss_kl: 2.0186421871185303 (2.0186421871185303) | > loss_feat: 1.945999026298523 (1.945999026298523) | > loss_mel: 25.14253044128418 (25.14253044128418) | > loss_duration: 1.9712097644805908 (1.9712097644805908) | > loss_1: 33.07158660888672 (33.07158660888672)  --> STEP: 1 | > loss_disc: 2.413750171661377 (2.413750171661377) | > loss_disc_real_0: 0.10172334313392639 (0.10172334313392639) | > loss_disc_real_1: 0.3074738383293152 (0.3074738383293152) | > loss_disc_real_2: 0.32435286045074463 (0.32435286045074463) | > loss_disc_real_3: 0.2885916829109192 (0.2885916829109192) | > loss_disc_real_4: 0.36198917031288147 (0.36198917031288147) | > loss_disc_real_5: 0.2410028576850891 (0.2410028576850891) | > loss_0: 2.413750171661377 (2.413750171661377) | > loss_gen: 2.870359182357788 (2.870359182357788) | > loss_kl: 2.444545269012451 (2.444545269012451) | > loss_feat: 5.8401055335998535 (5.8401055335998535) | > loss_mel: 28.304168701171875 (28.304168701171875) | > loss_duration: 2.164558172225952 (2.164558172225952) | > loss_1: 41.62373733520508 (41.62373733520508)  --> STEP: 2 | > loss_disc: 2.4880032539367676 (2.4508767127990723) | > loss_disc_real_0: 0.09562836587429047 (0.09867585450410843) | > loss_disc_real_1: 0.39417147636413574 (0.35082265734672546) | > loss_disc_real_2: 0.19769081473350525 (0.26102183759212494) | > loss_disc_real_3: 0.21232399344444275 (0.25045783817768097) | > loss_disc_real_4: 0.15783515572547913 (0.2599121630191803) | > loss_disc_real_5: 0.23380860686302185 (0.23740573227405548) | > loss_0: 2.4880032539367676 (2.4508767127990723) | > loss_gen: 2.0297019481658936 (2.450030565261841) | > loss_kl: 1.9345976114273071 (2.189571440219879) | > loss_feat: 4.983841896057129 (5.411973714828491) | > loss_mel: 30.588090896606445 (29.44612979888916) | > loss_duration: 2.124143600463867 (2.1443508863449097) | > loss_1: 41.660377502441406 (41.64205741882324)  --> STEP: 3 | > loss_disc: 2.9316020011901855 (2.61111847559611) | > loss_disc_real_0: 0.318150132894516 (0.17183394730091095) | > loss_disc_real_1: 0.22104184329509735 (0.30756238599618274) | > loss_disc_real_2: 0.3017148971557617 (0.27458619078000385) | > loss_disc_real_3: 0.24005770683288574 (0.2469911277294159) | > loss_disc_real_4: 0.2884458601474762 (0.26942339539527893) | > loss_disc_real_5: 0.29614055156707764 (0.25698400537172955) | > loss_0: 2.9316020011901855 (2.61111847559611) | > loss_gen: 1.7866848707199097 (2.2289153337478638) | > loss_kl: 1.5666759014129639 (1.9819395939509075) | > loss_feat: 0.439926415681839 (3.7546246151129403) | > loss_mel: 18.052522659301758 (25.648260752360027) | > loss_duration: 2.1284852027893066 (2.1390623251597085) | > loss_1: 23.974292755126953 (35.75280253092448) --> EVAL PERFORMANCE | > avg_loader_time: 0.010661999384562174 (+0.0005202293395996094) | > avg_loss_disc: 2.61111847559611 (+0.5813113848368325) | > avg_loss_disc_real_0: 0.17183394730091095 (+0.04184153179327646) | > avg_loss_disc_real_1: 0.30756238599618274 (+0.13407494376103082) | > avg_loss_disc_real_2: 0.27458619078000385 (+0.14078254997730252) | > avg_loss_disc_real_3: 0.2469911277294159 (+0.013549695412317903) | > avg_loss_disc_real_4: 0.26942339539527893 (+0.030862761350969464) | > avg_loss_disc_real_5: 0.25698400537172955 (+0.0833433543642362) | > avg_loss_0: 2.61111847559611 (+0.5813113848368325) | > avg_loss_gen: 2.2289153337478638 (-0.4418085813522339) | > avg_loss_kl: 1.9819395939509075 (-0.09698625405629469) | > avg_loss_feat: 3.7546246151129403 (-3.99419171611468) | > avg_loss_mel: 25.648260752360027 (+1.4257291158040388) | > avg_loss_duration: 2.1390623251597085 (-0.008046468098958481) | > avg_loss_1: 35.75280253092448 (-3.1153036753336636)  > EPOCH: 77/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:30:00)   --> TIME: 2023-10-20 00:30:18 -- STEP: 29/50 -- GLOBAL_STEP: 56880 | > loss_disc: 3.048844337463379 (2.397380384905585) | > loss_disc_real_0: 0.21544700860977173 (0.14933641537510123) | > loss_disc_real_1: 0.24704499542713165 (0.23672673183268514) | > loss_disc_real_2: 0.3046633005142212 (0.21383399978793902) | > loss_disc_real_3: 0.23882411420345306 (0.24285143177057134) | > loss_disc_real_4: 0.2514476776123047 (0.22390241150198312) | > loss_disc_real_5: 0.33094534277915955 (0.22868430344709034) | > loss_0: 3.048844337463379 (2.397380384905585) | > grad_norm_0: tensor(189.6894, device='cuda:0') (tensor(612.7062, device='cuda:0')) | > loss_gen: 1.590171217918396 (2.516076556567488) | > loss_kl: 0.9770252704620361 (1.2818813755594454) | > loss_feat: 0.07631619274616241 (5.00766049261237) | > loss_mel: 10.939632415771484 (21.10231916246743) | > loss_duration: 1.8368693590164185 (1.8364705875002105) | > loss_1: 15.420014381408691 (31.744407982661805) | > grad_norm_1: tensor(14179.2441, device='cuda:0') (tensor(32091.5098, device='cuda:0')) | > current_lr_0: 0.0001851770794801842 | > current_lr_1: 0.0001851770794801842 | > step_time: 0.5375 (0.4785334324014598) | > loader_time: 0.0241 (0.01203572339025037)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1923134326934814 (3.1923134326934814) | > loss_disc_real_0: 0.05265025049448013 (0.05265025049448013) | > loss_disc_real_1: 0.3167193531990051 (0.3167193531990051) | > loss_disc_real_2: 0.4616781771183014 (0.4616781771183014) | > loss_disc_real_3: 0.34564346075057983 (0.34564346075057983) | > loss_disc_real_4: 0.7113481163978577 (0.7113481163978577) | > loss_disc_real_5: 0.3591790795326233 (0.3591790795326233) | > loss_0: 3.1923134326934814 (3.1923134326934814) | > loss_gen: 2.856022596359253 (2.856022596359253) | > loss_kl: 1.9462522268295288 (1.9462522268295288) | > loss_feat: 8.189288139343262 (8.189288139343262) | > loss_mel: 26.933671951293945 (26.933671951293945) | > loss_duration: 2.006948947906494 (2.006948947906494) | > loss_1: 41.932186126708984 (41.932186126708984)  --> STEP: 1 | > loss_disc: 3.400942802429199 (3.400942802429199) | > loss_disc_real_0: 0.24388667941093445 (0.24388667941093445) | > loss_disc_real_1: 0.4142495095729828 (0.4142495095729828) | > loss_disc_real_2: 0.42148542404174805 (0.42148542404174805) | > loss_disc_real_3: 0.39622563123703003 (0.39622563123703003) | > loss_disc_real_4: 0.5666861534118652 (0.5666861534118652) | > loss_disc_real_5: 0.379844069480896 (0.379844069480896) | > loss_0: 3.400942802429199 (3.400942802429199) | > loss_gen: 2.332219123840332 (2.332219123840332) | > loss_kl: 2.9615461826324463 (2.9615461826324463) | > loss_feat: 3.1759655475616455 (3.1759655475616455) | > loss_mel: 24.879390716552734 (24.879390716552734) | > loss_duration: 2.155348300933838 (2.155348300933838) | > loss_1: 35.50447082519531 (35.50447082519531)  --> STEP: 2 | > loss_disc: 3.253223419189453 (3.327083110809326) | > loss_disc_real_0: 0.6373931765556335 (0.440639927983284) | > loss_disc_real_1: 0.35079726576805115 (0.38252338767051697) | > loss_disc_real_2: 0.3433811068534851 (0.3824332654476166) | > loss_disc_real_3: 0.3596983551979065 (0.37796199321746826) | > loss_disc_real_4: 0.46909958124160767 (0.5178928673267365) | > loss_disc_real_5: 0.33123359084129333 (0.35553883016109467) | > loss_0: 3.253223419189453 (3.327083110809326) | > loss_gen: 2.617659330368042 (2.474939227104187) | > loss_kl: 2.4650654792785645 (2.7133058309555054) | > loss_feat: 0.3705464005470276 (1.7732559740543365) | > loss_mel: 9.193941116333008 (17.03666591644287) | > loss_duration: 2.129025459289551 (2.1421868801116943) | > loss_1: 16.77623748779297 (26.14035415649414)  --> STEP: 3 | > loss_disc: 3.1866207122802734 (3.280262311299642) | > loss_disc_real_0: 0.18780198693275452 (0.35636061429977417) | > loss_disc_real_1: 0.4141133725643158 (0.3930533826351166) | > loss_disc_real_2: 0.5006181001663208 (0.4218282103538513) | > loss_disc_real_3: 0.41521722078323364 (0.3903804024060567) | > loss_disc_real_4: 0.5327258110046387 (0.5228371818860372) | > loss_disc_real_5: 0.40257614850997925 (0.3712179362773895) | > loss_0: 3.1866207122802734 (3.280262311299642) | > loss_gen: 2.8139543533325195 (2.587944269180298) | > loss_kl: 1.7853306531906128 (2.403980771700541) | > loss_feat: 3.07653546333313 (2.207682470480601) | > loss_mel: 21.97994041442871 (18.684424082438152) | > loss_duration: 2.24096941947937 (2.175114393234253) | > loss_1: 31.896730422973633 (28.059146245320637) --> EVAL PERFORMANCE | > avg_loader_time: 0.00680851936340332 (-0.0038534800211588536) | > avg_loss_disc: 3.280262311299642 (+0.6691438357035322) | > avg_loss_disc_real_0: 0.35636061429977417 (+0.18452666699886322) | > avg_loss_disc_real_1: 0.3930533826351166 (+0.08549099663893384) | > avg_loss_disc_real_2: 0.4218282103538513 (+0.14724201957384747) | > avg_loss_disc_real_3: 0.3903804024060567 (+0.1433892746766408) | > avg_loss_disc_real_4: 0.5228371818860372 (+0.2534137864907583) | > avg_loss_disc_real_5: 0.3712179362773895 (+0.11423393090565997) | > avg_loss_0: 3.280262311299642 (+0.6691438357035322) | > avg_loss_gen: 2.587944269180298 (+0.3590289354324341) | > avg_loss_kl: 2.403980771700541 (+0.42204117774963357) | > avg_loss_feat: 2.207682470480601 (-1.5469421446323395) | > avg_loss_mel: 18.684424082438152 (-6.963836669921875) | > avg_loss_duration: 2.175114393234253 (+0.03605206807454442) | > avg_loss_1: 28.059146245320637 (-7.69365628560384)  > EPOCH: 78/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:30:38)   --> TIME: 2023-10-20 00:30:46 -- STEP: 9/50 -- GLOBAL_STEP: 56910 | > loss_disc: 2.670060396194458 (2.8861516316731772) | > loss_disc_real_0: 0.1523922234773636 (0.22201961868753037) | > loss_disc_real_1: 0.29722365736961365 (0.2749185355173217) | > loss_disc_real_2: 0.5565327405929565 (0.34099138114187455) | > loss_disc_real_3: 0.3747672140598297 (0.2954866819911533) | > loss_disc_real_4: 0.2766043245792389 (0.2989911569489373) | > loss_disc_real_5: 0.27387839555740356 (0.2808751281764772) | > loss_0: 2.670060396194458 (2.8861516316731772) | > grad_norm_0: tensor(272.2625, device='cuda:0') (tensor(611.5855, device='cuda:0')) | > loss_gen: 3.0415306091308594 (2.1862508985731335) | > loss_kl: 0.8787149786949158 (1.2398259573512607) | > loss_feat: 4.131219863891602 (3.6436820667650966) | > loss_mel: 25.547962188720703 (20.471498754289414) | > loss_duration: 1.7528327703475952 (1.8046314716339111) | > loss_1: 35.35226058959961 (29.345889303419327) | > grad_norm_1: tensor(5859.0093, device='cuda:0') (tensor(19122.7031, device='cuda:0')) | > current_lr_0: 0.00018499198339542563 | > current_lr_1: 0.00018499198339542563 | > step_time: 0.2903 (0.5009488264719645) | > loader_time: 0.0251 (0.021246910095214844)  --> TIME: 2023-10-20 00:30:57 -- STEP: 39/50 -- GLOBAL_STEP: 56940 | > loss_disc: 2.9088046550750732 (2.6605900648312693) | > loss_disc_real_0: 0.29609912633895874 (0.20622880787899098) | > loss_disc_real_1: 0.2801034450531006 (0.2444883739719024) | > loss_disc_real_2: 0.26116764545440674 (0.26036621859440434) | > loss_disc_real_3: 0.23251496255397797 (0.2572913746803235) | > loss_disc_real_4: 0.33161455392837524 (0.2499198117890419) | > loss_disc_real_5: 0.2215953767299652 (0.2484772767011936) | > loss_0: 2.9088046550750732 (2.6605900648312693) | > grad_norm_0: tensor(327.9850, device='cuda:0') (tensor(483.1555, device='cuda:0')) | > loss_gen: 1.7062153816223145 (2.2659426255103874) | > loss_kl: 1.174332618713379 (1.2170157157457795) | > loss_feat: 0.5185350775718689 (4.484401987340206) | > loss_mel: 19.891693115234375 (23.796990461838547) | > loss_duration: 1.8129169940948486 (1.8209165273568568) | > loss_1: 25.10369300842285 (33.58526765383207) | > grad_norm_1: tensor(8050.4985, device='cuda:0') (tensor(15974.0566, device='cuda:0')) | > current_lr_0: 0.00018499198339542563 | > current_lr_1: 0.00018499198339542563 | > step_time: 0.4759 (0.3954971203437218) | > loader_time: 0.0023 (0.010289534544333434)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.306730270385742 (2.306730270385742) | > loss_disc_real_0: 0.10384712368249893 (0.10384712368249893) | > loss_disc_real_1: 0.15085424482822418 (0.15085424482822418) | > loss_disc_real_2: 0.2556709945201874 (0.2556709945201874) | > loss_disc_real_3: 0.34077098965644836 (0.34077098965644836) | > loss_disc_real_4: 0.11187756061553955 (0.11187756061553955) | > loss_disc_real_5: 0.15499193966388702 (0.15499193966388702) | > loss_0: 2.306730270385742 (2.306730270385742) | > loss_gen: 2.4454472064971924 (2.4454472064971924) | > loss_kl: 1.7641340494155884 (1.7641340494155884) | > loss_feat: 6.519730567932129 (6.519730567932129) | > loss_mel: 24.470115661621094 (24.470115661621094) | > loss_duration: 2.010169506072998 (2.010169506072998) | > loss_1: 37.209598541259766 (37.209598541259766)  --> STEP: 1 | > loss_disc: 2.420607566833496 (2.420607566833496) | > loss_disc_real_0: 0.06179971247911453 (0.06179971247911453) | > loss_disc_real_1: 0.10126621276140213 (0.10126621276140213) | > loss_disc_real_2: 0.2905164957046509 (0.2905164957046509) | > loss_disc_real_3: 0.3375968635082245 (0.3375968635082245) | > loss_disc_real_4: 0.21281510591506958 (0.21281510591506958) | > loss_disc_real_5: 0.2739429771900177 (0.2739429771900177) | > loss_0: 2.420607566833496 (2.420607566833496) | > loss_gen: 2.125364065170288 (2.125364065170288) | > loss_kl: 2.9879937171936035 (2.9879937171936035) | > loss_feat: 6.324811935424805 (6.324811935424805) | > loss_mel: 27.23683738708496 (27.23683738708496) | > loss_duration: 2.2205095291137695 (2.2205095291137695) | > loss_1: 40.89551544189453 (40.89551544189453)  --> STEP: 2 | > loss_disc: 3.0395703315734863 (2.730088949203491) | > loss_disc_real_0: 0.3477262854576111 (0.2047629989683628) | > loss_disc_real_1: 0.2629920542240143 (0.1821291334927082) | > loss_disc_real_2: 0.25712284445762634 (0.2738196700811386) | > loss_disc_real_3: 0.30657505989074707 (0.3220859616994858) | > loss_disc_real_4: 0.26999959349632263 (0.2414073497056961) | > loss_disc_real_5: 0.3251221776008606 (0.29953257739543915) | > loss_0: 3.0395703315734863 (2.730088949203491) | > loss_gen: 1.7609517574310303 (1.9431579113006592) | > loss_kl: 2.5808773040771484 (2.784435510635376) | > loss_feat: 0.12203989177942276 (3.2234259136021137) | > loss_mel: 3.2891762256622314 (15.263006806373596) | > loss_duration: 2.2404680252075195 (2.2304887771606445) | > loss_1: 9.993513107299805 (25.444514274597168)  --> STEP: 3 | > loss_disc: 2.432864189147949 (2.631014029184977) | > loss_disc_real_0: 0.28793635964393616 (0.23248745252688727) | > loss_disc_real_1: 0.25603654980659485 (0.2067649389306704) | > loss_disc_real_2: 0.44345778226852417 (0.3303657074769338) | > loss_disc_real_3: 0.17541539669036865 (0.2731957733631134) | > loss_disc_real_4: 0.26348069310188293 (0.2487651308377584) | > loss_disc_real_5: 0.27300962805747986 (0.29069159428278607) | > loss_0: 2.432864189147949 (2.631014029184977) | > loss_gen: 2.811178684234619 (2.2324981689453125) | > loss_kl: 1.3987535238265991 (2.32254151503245) | > loss_feat: 3.7988266944885254 (3.4152261738975844) | > loss_mel: 23.076412200927734 (17.867475271224976) | > loss_duration: 2.114841938018799 (2.1919398307800293) | > loss_1: 33.20001220703125 (28.029680252075195) --> EVAL PERFORMANCE | > avg_loader_time: 0.003668626149495443 (-0.0031398932139078775) | > avg_loss_disc: 2.631014029184977 (-0.649248282114665) | > avg_loss_disc_real_0: 0.23248745252688727 (-0.1238731617728869) | > avg_loss_disc_real_1: 0.2067649389306704 (-0.18628844370444617) | > avg_loss_disc_real_2: 0.3303657074769338 (-0.09146250287691754) | > avg_loss_disc_real_3: 0.2731957733631134 (-0.1171846290429433) | > avg_loss_disc_real_4: 0.2487651308377584 (-0.2740720510482788) | > avg_loss_disc_real_5: 0.29069159428278607 (-0.08052634199460346) | > avg_loss_0: 2.631014029184977 (-0.649248282114665) | > avg_loss_gen: 2.2324981689453125 (-0.35544610023498535) | > avg_loss_kl: 2.32254151503245 (-0.08143925666809082) | > avg_loss_feat: 3.4152261738975844 (+1.2075437034169836) | > avg_loss_mel: 17.867475271224976 (-0.8169488112131766) | > avg_loss_duration: 2.1919398307800293 (+0.016825437545776367) | > avg_loss_1: 28.029680252075195 (-0.029465993245441524)  > EPOCH: 79/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:31:15)   --> TIME: 2023-10-20 00:31:29 -- STEP: 19/50 -- GLOBAL_STEP: 56970 | > loss_disc: 2.9889369010925293 (2.4222701474239954) | > loss_disc_real_0: 0.2744045853614807 (0.16274127775901243) | > loss_disc_real_1: 0.2511681020259857 (0.21899065963531794) | > loss_disc_real_2: 0.28314048051834106 (0.20825336148080073) | > loss_disc_real_3: 0.28029921650886536 (0.24981007960281873) | > loss_disc_real_4: 0.24864241480827332 (0.22866081642477135) | > loss_disc_real_5: 0.2902090549468994 (0.24563068641643776) | > loss_0: 2.9889369010925293 (2.4222701474239954) | > grad_norm_0: tensor(257.9953, device='cuda:0') (tensor(446.5152, device='cuda:0')) | > loss_gen: 1.7315170764923096 (2.382132831372713) | > loss_kl: 1.1569042205810547 (1.074428478353902) | > loss_feat: 0.6513180732727051 (5.069056723855044) | > loss_mel: 19.614749908447266 (23.5171539030577) | > loss_duration: 2.001272201538086 (1.8733526593760441) | > loss_1: 25.15576171875 (33.916125197159616) | > grad_norm_1: tensor(4346.1963, device='cuda:0') (tensor(21494.4141, device='cuda:0')) | > current_lr_0: 0.00018480707232579257 | > current_lr_1: 0.00018480707232579257 | > step_time: 0.3018 (0.4884982109069824) | > loader_time: 0.0264 (0.02098988231859709)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.394155502319336 (3.394155502319336) | > loss_disc_real_0: 0.22117166221141815 (0.22117166221141815) | > loss_disc_real_1: 0.23521019518375397 (0.23521019518375397) | > loss_disc_real_2: 0.47177937626838684 (0.47177937626838684) | > loss_disc_real_3: 0.20603656768798828 (0.20603656768798828) | > loss_disc_real_4: 0.5396373271942139 (0.5396373271942139) | > loss_disc_real_5: 0.5869181156158447 (0.5869181156158447) | > loss_0: 3.394155502319336 (3.394155502319336) | > loss_gen: 2.3358559608459473 (2.3358559608459473) | > loss_kl: 1.5473639965057373 (1.5473639965057373) | > loss_feat: 5.384458541870117 (5.384458541870117) | > loss_mel: 22.924022674560547 (22.924022674560547) | > loss_duration: 1.9889241456985474 (1.9889241456985474) | > loss_1: 34.18062973022461 (34.18062973022461)  --> STEP: 1 | > loss_disc: 2.0171470642089844 (2.0171470642089844) | > loss_disc_real_0: 0.2444143146276474 (0.2444143146276474) | > loss_disc_real_1: 0.07107990980148315 (0.07107990980148315) | > loss_disc_real_2: 0.12437909841537476 (0.12437909841537476) | > loss_disc_real_3: 0.1189020574092865 (0.1189020574092865) | > loss_disc_real_4: 0.05108567327260971 (0.05108567327260971) | > loss_disc_real_5: 0.021623758599162102 (0.021623758599162102) | > loss_0: 2.0171470642089844 (2.0171470642089844) | > loss_gen: 2.815244674682617 (2.815244674682617) | > loss_kl: 2.1417229175567627 (2.1417229175567627) | > loss_feat: 11.071980476379395 (11.071980476379395) | > loss_mel: 31.26530647277832 (31.26530647277832) | > loss_duration: 2.1125545501708984 (2.1125545501708984) | > loss_1: 49.40681457519531 (49.40681457519531)  --> STEP: 2 | > loss_disc: 2.9421589374542236 (2.479653000831604) | > loss_disc_real_0: 0.26547905802726746 (0.25494668632745743) | > loss_disc_real_1: 0.2584453225135803 (0.16476261615753174) | > loss_disc_real_2: 0.2947617471218109 (0.20957042276859283) | > loss_disc_real_3: 0.2713262438774109 (0.1951141506433487) | > loss_disc_real_4: 0.36557331681251526 (0.20832949504256248) | > loss_disc_real_5: 0.37807878851890564 (0.19985127355903387) | > loss_0: 2.9421589374542236 (2.479653000831604) | > loss_gen: 1.9914730787277222 (2.4033588767051697) | > loss_kl: 2.475912570953369 (2.308817744255066) | > loss_feat: 0.8077782988548279 (5.939879387617111) | > loss_mel: 18.977474212646484 (25.121390342712402) | > loss_duration: 2.133248805999756 (2.122901678085327) | > loss_1: 26.385887145996094 (37.8963508605957)  --> STEP: 3 | > loss_disc: 2.9734277725219727 (2.64424459139506) | > loss_disc_real_0: 0.29590821266174316 (0.268600528438886) | > loss_disc_real_1: 0.26574015617370605 (0.1984217961629232) | > loss_disc_real_2: 0.33575963973999023 (0.25163349509239197) | > loss_disc_real_3: 0.27100878953933716 (0.2204123636086782) | > loss_disc_real_4: 0.36094099283218384 (0.2591999943057696) | > loss_disc_real_5: 0.3797762989997864 (0.2598262820392847) | > loss_0: 2.9734277725219727 (2.64424459139506) | > loss_gen: 2.0696544647216797 (2.292124072710673) | > loss_kl: 0.9145627021789551 (1.844066063563029) | > loss_feat: 0.7623517513275146 (4.214036842187245) | > loss_mel: 21.077957153320312 (23.773579279581707) | > loss_duration: 2.0451295375823975 (2.096977631251017) | > loss_1: 26.86965560913086 (34.220785776774086)  --> TIME: 2023-10-20 00:31:50 -- STEP: 49/50 -- GLOBAL_STEP: 57000 | > loss_disc: 2.803624153137207 (2.41688563142504) | > loss_disc_real_0: 0.2710320055484772 (0.15532788391015973) | > loss_disc_real_1: 0.23487915098667145 (0.2250082553649435) | > loss_disc_real_2: 0.24594393372535706 (0.212005223014525) | > loss_disc_real_3: 0.3052533268928528 (0.23304773927951344) | > loss_disc_real_4: 0.4292198717594147 (0.22968184210512102) | > loss_disc_real_5: 0.40047505497932434 (0.22973716205784253) | > loss_0: 2.803624153137207 (2.41688563142504) | > grad_norm_0: tensor(1632.9550, device='cuda:0') (tensor(521.6094, device='cuda:0')) | > loss_gen: 2.3842804431915283 (2.468520130429949) | > loss_kl: 0.6332485675811768 (1.038602843576548) | > loss_feat: 2.0170464515686035 (5.484595375249581) | > loss_mel: 23.967018127441406 (24.322135930158655) | > loss_duration: 1.8885513544082642 (1.813921804330787) | > loss_1: 30.890146255493164 (35.12777637948796) | > grad_norm_1: tensor(8374.3232, device='cuda:0') (tensor(22068.4824, device='cuda:0')) | > current_lr_0: 0.00018480707232579257 | > current_lr_1: 0.00018480707232579257 | > step_time: 1.5033 (0.5187015874045235) | > loader_time: 4.0234 (0.10130890534848583) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_57000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.392982006072998 (2.5814289450645447) | > loss_disc_real_0: 0.06690318882465363 (0.2181761935353279) | > loss_disc_real_1: 0.19917427003383636 (0.19860991463065147) | > loss_disc_real_2: 0.3221478760242462 (0.26926209032535553) | > loss_disc_real_3: 0.05928954854607582 (0.1801316598430276) | > loss_disc_real_4: 0.21000345051288605 (0.2469008583575487) | > loss_disc_real_5: 0.29939115047454834 (0.2697174991481006) | > loss_0: 2.392982006072998 (2.5814289450645447) | > loss_gen: 2.6684482097625732 (2.386205106973648) | > loss_kl: 1.3824183940887451 (1.728654146194458) | > loss_feat: 10.255789756774902 (5.72447507083416) | > loss_mel: 30.02265167236328 (25.3358473777771) | > loss_duration: 2.014495372772217 (2.076357066631317) | > loss_1: 46.34380340576172 (37.251540184020996)  --> STEP: 1 | > loss_disc: 3.084474802017212 (2.682038116455078) | > loss_disc_real_0: 0.3083762526512146 (0.23621620535850524) | > loss_disc_real_1: 0.17326374351978302 (0.19354068040847777) | > loss_disc_real_2: 0.35866060853004456 (0.28714179396629336) | > loss_disc_real_3: 0.15815241634845734 (0.17573581114411355) | > loss_disc_real_4: 0.3309549391269684 (0.2637116745114326) | > loss_disc_real_5: 0.3878364562988281 (0.2933412905782461) | > loss_0: 3.084474802017212 (2.682038116455078) | > loss_gen: 2.0229687690734863 (2.313557839393616) | > loss_kl: 2.2306201457977295 (1.8290473461151122) | > loss_feat: 4.13506555557251 (5.40659316778183) | > loss_mel: 26.238283157348633 (25.516334533691406) | > loss_duration: 2.1814699172973633 (2.0973796367645265) | > loss_1: 36.808406829833984 (37.1629135131836)  --> STEP: 2 | > loss_disc: 3.0281715393066406 (2.739727020263672) | > loss_disc_real_0: 0.2685430943965912 (0.24160402019818625) | > loss_disc_real_1: 0.29083117842674255 (0.2097557634115219) | > loss_disc_real_2: 0.3226369321346283 (0.2930576503276825) | > loss_disc_real_3: 0.2659451365470886 (0.19077069871127605) | > loss_disc_real_4: 0.3667846918106079 (0.28089051072796184) | > loss_disc_real_5: 0.39534392952919006 (0.31034173040340346) | > loss_0: 3.0281715393066406 (2.739727020263672) | > loss_gen: 1.9562937021255493 (2.2540138165156045) | > loss_kl: 2.137814521789551 (1.880508542060852) | > loss_feat: 0.4467248320579529 (4.579948445161183) | > loss_mel: 5.095955848693848 (22.112938086191814) | > loss_duration: 2.1169466972351074 (2.100640813509623) | > loss_1: 11.75373649597168 (32.928050676981606)  --> STEP: 3 | > loss_disc: 2.7868919372558594 (2.74646486554827) | > loss_disc_real_0: 0.22969302535057068 (0.23990244950566972) | > loss_disc_real_1: 0.25156182050704956 (0.21572805728231156) | > loss_disc_real_2: 0.2774046063423157 (0.2908215011869158) | > loss_disc_real_3: 0.2508805990219116 (0.19935782732708113) | > loss_disc_real_4: 0.35349753499031067 (0.29126294276544024) | > loss_disc_real_5: 0.3844936490058899 (0.3209348616323301) | > loss_0: 2.7868919372558594 (2.74646486554827) | > loss_gen: 2.0937273502349854 (2.2311157499040877) | > loss_kl: 1.417057752609253 (1.8143012864249093) | > loss_feat: 1.0814354419708252 (4.080160873276847) | > loss_mel: 17.86231231689453 (21.50570583343506) | > loss_duration: 2.07897686958313 (2.097545964377267) | > loss_1: 24.533510208129883 (31.72883061000279) --> EVAL PERFORMANCE | > avg_loader_time: 0.2606899397713797 (+0.2570213136218843) | > avg_loss_disc: 2.74646486554827 (+0.1154508363632929) | > avg_loss_disc_real_0: 0.23990244950566972 (+0.007414996978782451) | > avg_loss_disc_real_1: 0.21572805728231156 (+0.008963118351641153) | > avg_loss_disc_real_2: 0.2908215011869158 (-0.03954420629001798) | > avg_loss_disc_real_3: 0.19935782732708113 (-0.07383794603603228) | > avg_loss_disc_real_4: 0.29126294276544024 (+0.042497811927681844) | > avg_loss_disc_real_5: 0.3209348616323301 (+0.030243267349544023) | > avg_loss_0: 2.74646486554827 (+0.1154508363632929) | > avg_loss_gen: 2.2311157499040877 (-0.001382419041224825) | > avg_loss_kl: 1.8143012864249093 (-0.5082402286075409) | > avg_loss_feat: 4.080160873276847 (+0.6649346993792622) | > avg_loss_mel: 21.50570583343506 (+3.638230562210083) | > avg_loss_duration: 2.097545964377267 (-0.09439386640276215) | > avg_loss_1: 31.72883061000279 (+3.6991503579275964)  > EPOCH: 80/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:32:03)   --> TIME: 2023-10-20 00:32:24 -- STEP: 29/50 -- GLOBAL_STEP: 57030 | > loss_disc: 2.931283712387085 (2.6130667431601164) | > loss_disc_real_0: 0.3026137351989746 (0.18157353428802614) | > loss_disc_real_1: 0.26744383573532104 (0.23959315491133723) | > loss_disc_real_2: 0.31195130944252014 (0.23838958812171016) | > loss_disc_real_3: 0.27290651202201843 (0.23771456115204712) | > loss_disc_real_4: 0.28019505739212036 (0.23662606960740581) | > loss_disc_real_5: 0.28600504994392395 (0.26340431989780794) | > loss_0: 2.931283712387085 (2.6130667431601164) | > grad_norm_0: tensor(1255.7930, device='cuda:0') (tensor(727.4091, device='cuda:0')) | > loss_gen: 1.6873420476913452 (2.321294607787298) | > loss_kl: 0.8774887919425964 (1.127228660830136) | > loss_feat: 0.19800688326358795 (4.981586212035397) | > loss_mel: 14.465409278869629 (22.643128617056483) | > loss_duration: 1.8094379901885986 (1.840963573291384) | > loss_1: 19.03768539428711 (32.9142018186635) | > grad_norm_1: tensor(19869.4727, device='cuda:0') (tensor(22058.2715, device='cuda:0')) | > current_lr_0: 0.0001846223460863507 | > current_lr_1: 0.0001846223460863507 | > step_time: 0.2519 (0.5006562019216605) | > loader_time: 0.0231 (0.015730455003935717)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.808765411376953 (2.808765411376953) | > loss_disc_real_0: 0.12597714364528656 (0.12597714364528656) | > loss_disc_real_1: 0.27444013953208923 (0.27444013953208923) | > loss_disc_real_2: 0.36374589800834656 (0.36374589800834656) | > loss_disc_real_3: 0.2328425496816635 (0.2328425496816635) | > loss_disc_real_4: 0.27422916889190674 (0.27422916889190674) | > loss_disc_real_5: 0.2871268391609192 (0.2871268391609192) | > loss_0: 2.808765411376953 (2.808765411376953) | > loss_gen: 1.836017370223999 (1.836017370223999) | > loss_kl: 1.8865300416946411 (1.8865300416946411) | > loss_feat: 1.6052900552749634 (1.6052900552749634) | > loss_mel: 23.911724090576172 (23.911724090576172) | > loss_duration: 2.046504259109497 (2.046504259109497) | > loss_1: 31.28606605529785 (31.28606605529785)  --> STEP: 1 | > loss_disc: 2.9610698223114014 (2.9610698223114014) | > loss_disc_real_0: 0.05293133109807968 (0.05293133109807968) | > loss_disc_real_1: 0.23430711030960083 (0.23430711030960083) | > loss_disc_real_2: 0.214666485786438 (0.214666485786438) | > loss_disc_real_3: 0.22469556331634521 (0.22469556331634521) | > loss_disc_real_4: 0.1287083476781845 (0.1287083476781845) | > loss_disc_real_5: 0.19165264070034027 (0.19165264070034027) | > loss_0: 2.9610698223114014 (2.9610698223114014) | > loss_gen: 1.4261424541473389 (1.4261424541473389) | > loss_kl: 2.8226096630096436 (2.8226096630096436) | > loss_feat: 3.244415283203125 (3.244415283203125) | > loss_mel: 26.16840362548828 (26.16840362548828) | > loss_duration: 2.2134549617767334 (2.2134549617767334) | > loss_1: 35.87502670288086 (35.87502670288086)  --> STEP: 2 | > loss_disc: 2.7094147205352783 (2.83524227142334) | > loss_disc_real_0: 0.2345554083585739 (0.1437433697283268) | > loss_disc_real_1: 0.21031610667705536 (0.2223116084933281) | > loss_disc_real_2: 0.2923834025859833 (0.25352494418621063) | > loss_disc_real_3: 0.2802073359489441 (0.25245144963264465) | > loss_disc_real_4: 0.2726375460624695 (0.200672946870327) | > loss_disc_real_5: 0.3633313775062561 (0.2774920091032982) | > loss_0: 2.7094147205352783 (2.83524227142334) | > loss_gen: 2.12170672416687 (1.7739245891571045) | > loss_kl: 2.109266757965088 (2.4659382104873657) | > loss_feat: 2.0545167922973633 (2.649466037750244) | > loss_mel: 27.759851455688477 (26.96412754058838) | > loss_duration: 2.114461898803711 (2.163958430290222) | > loss_1: 36.15980529785156 (36.01741600036621)  --> STEP: 3 | > loss_disc: 2.183347702026367 (2.617944081624349) | > loss_disc_real_0: 0.10991171002388 (0.13246614982684454) | > loss_disc_real_1: 0.25458258390426636 (0.23306860029697418) | > loss_disc_real_2: 0.23277975618839264 (0.2466098815202713) | > loss_disc_real_3: 0.2063191831111908 (0.2370740274588267) | > loss_disc_real_4: 0.23161302506923676 (0.2109863062699636) | > loss_disc_real_5: 0.36746108531951904 (0.3074817011753718) | > loss_0: 2.183347702026367 (2.617944081624349) | > loss_gen: 2.6789164543151855 (2.0755885442097983) | > loss_kl: 1.134337306022644 (2.0220712423324585) | > loss_feat: 4.266355991363525 (3.188429355621338) | > loss_mel: 28.601945877075195 (27.510066986083984) | > loss_duration: 2.086655855178833 (2.1381909052530923) | > loss_1: 38.768211364746094 (36.934347788492836) --> EVAL PERFORMANCE | > avg_loader_time: 0.01362148920694987 (-0.24706845056442986) | > avg_loss_disc: 2.617944081624349 (-0.12852078392392086) | > avg_loss_disc_real_0: 0.13246614982684454 (-0.10743629967882518) | > avg_loss_disc_real_1: 0.23306860029697418 (+0.01734054301466262) | > avg_loss_disc_real_2: 0.2466098815202713 (-0.0442116196666445) | > avg_loss_disc_real_3: 0.2370740274588267 (+0.037716200131745564) | > avg_loss_disc_real_4: 0.2109863062699636 (-0.08027663649547664) | > avg_loss_disc_real_5: 0.3074817011753718 (-0.013453160456958269) | > avg_loss_0: 2.617944081624349 (-0.12852078392392086) | > avg_loss_gen: 2.0755885442097983 (-0.15552720569428935) | > avg_loss_kl: 2.0220712423324585 (+0.2077699559075492) | > avg_loss_feat: 3.188429355621338 (-0.8917315176555087) | > avg_loss_mel: 27.510066986083984 (+6.004361152648926) | > avg_loss_duration: 2.1381909052530923 (+0.04064494087582515) | > avg_loss_1: 36.934347788492836 (+5.2055171784900445)  > EPOCH: 81/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:32:45)   --> TIME: 2023-10-20 00:32:52 -- STEP: 9/50 -- GLOBAL_STEP: 57060 | > loss_disc: 3.0323262214660645 (2.9504087236192493) | > loss_disc_real_0: 0.05088701844215393 (0.17211503638989395) | > loss_disc_real_1: 0.29263922572135925 (0.2364935436182552) | > loss_disc_real_2: 0.29420289397239685 (0.29171524362431633) | > loss_disc_real_3: 0.25500622391700745 (0.26203057832188076) | > loss_disc_real_4: 0.37209343910217285 (0.2580535142785973) | > loss_disc_real_5: 0.2992628216743469 (0.29194777541690403) | > loss_0: 3.0323262214660645 (2.9504087236192493) | > grad_norm_0: tensor(1062.2180, device='cuda:0') (tensor(662.9756, device='cuda:0')) | > loss_gen: 1.55332350730896 (2.2170996401045056) | > loss_kl: 0.9676910638809204 (1.0574709441926744) | > loss_feat: 0.33725613355636597 (4.289513991938697) | > loss_mel: 32.21980667114258 (23.19112491607666) | > loss_duration: 1.7312276363372803 (1.7940894232855902) | > loss_1: 36.809303283691406 (32.54929934607612) | > grad_norm_1: tensor(14353.0049, device='cuda:0') (tensor(17361.6191, device='cuda:0')) | > current_lr_0: 0.00018443780449235083 | > current_lr_1: 0.00018443780449235083 | > step_time: 0.3234 (0.3442750771840413) | > loader_time: 0.0019 (0.01064655515882704)  --> TIME: 2023-10-20 00:33:06 -- STEP: 39/50 -- GLOBAL_STEP: 57090 | > loss_disc: 1.7232575416564941 (2.6562678813934326) | > loss_disc_real_0: 0.04435820132493973 (0.16892074120159334) | > loss_disc_real_1: 0.3300081193447113 (0.23887536732050088) | > loss_disc_real_2: 0.13445523381233215 (0.23930912407544938) | > loss_disc_real_3: 0.18332965672016144 (0.2629007525168931) | > loss_disc_real_4: 0.11368760466575623 (0.2320360591969429) | > loss_disc_real_5: 0.11256419867277145 (0.217527892249517) | > loss_0: 1.7232575416564941 (2.6562678813934326) | > grad_norm_0: tensor(655.9592, device='cuda:0') (tensor(724.9902, device='cuda:0')) | > loss_gen: 3.2847707271575928 (2.361324976652096) | > loss_kl: 0.5401278138160706 (1.0847797378515587) | > loss_feat: 8.870229721069336 (5.3351503620162966) | > loss_mel: 35.50825119018555 (25.225620648799797) | > loss_duration: 1.8031775951385498 (1.8081434017572648) | > loss_1: 50.00655746459961 (35.815019191839745) | > grad_norm_1: tensor(6157.1353, device='cuda:0') (tensor(18258.9004, device='cuda:0')) | > current_lr_0: 0.00018443780449235083 | > current_lr_1: 0.00018443780449235083 | > step_time: 0.2844 (0.42650518661890274) | > loader_time: 0.003 (0.010272068855090018)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.505302906036377 (2.505302906036377) | > loss_disc_real_0: 0.16801899671554565 (0.16801899671554565) | > loss_disc_real_1: 0.20544582605361938 (0.20544582605361938) | > loss_disc_real_2: 0.23938226699829102 (0.23938226699829102) | > loss_disc_real_3: 0.236524298787117 (0.236524298787117) | > loss_disc_real_4: 0.17209386825561523 (0.17209386825561523) | > loss_disc_real_5: 0.22738797962665558 (0.22738797962665558) | > loss_0: 2.505302906036377 (2.505302906036377) | > loss_gen: 2.2397468090057373 (2.2397468090057373) | > loss_kl: 1.985412359237671 (1.985412359237671) | > loss_feat: 4.636712551116943 (4.636712551116943) | > loss_mel: 20.066499710083008 (20.066499710083008) | > loss_duration: 2.0892527103424072 (2.0892527103424072) | > loss_1: 31.017623901367188 (31.017623901367188)  --> STEP: 1 | > loss_disc: 2.8405566215515137 (2.8405566215515137) | > loss_disc_real_0: 0.36810722947120667 (0.36810722947120667) | > loss_disc_real_1: 0.1549004316329956 (0.1549004316329956) | > loss_disc_real_2: 0.13699381053447723 (0.13699381053447723) | > loss_disc_real_3: 0.231286883354187 (0.231286883354187) | > loss_disc_real_4: 0.3044764995574951 (0.3044764995574951) | > loss_disc_real_5: 0.4489704966545105 (0.4489704966545105) | > loss_0: 2.8405566215515137 (2.8405566215515137) | > loss_gen: 2.329371929168701 (2.329371929168701) | > loss_kl: 2.715303897857666 (2.715303897857666) | > loss_feat: 8.440983772277832 (8.440983772277832) | > loss_mel: 26.63262367248535 (26.63262367248535) | > loss_duration: 2.268069267272949 (2.268069267272949) | > loss_1: 42.3863525390625 (42.3863525390625)  --> STEP: 2 | > loss_disc: 3.098295211791992 (2.969425916671753) | > loss_disc_real_0: 0.20882569253444672 (0.2884664610028267) | > loss_disc_real_1: 0.34384483098983765 (0.24937263131141663) | > loss_disc_real_2: 0.322295218706131 (0.2296445146203041) | > loss_disc_real_3: 0.2911691665649414 (0.2612280249595642) | > loss_disc_real_4: 0.3226863443851471 (0.3135814219713211) | > loss_disc_real_5: 0.3030487895011902 (0.37600964307785034) | > loss_0: 3.098295211791992 (2.969425916671753) | > loss_gen: 1.8471914529800415 (2.0882816910743713) | > loss_kl: 2.211513042449951 (2.4634084701538086) | > loss_feat: 1.2787317037582397 (4.859857738018036) | > loss_mel: 25.084426879882812 (25.858525276184082) | > loss_duration: 2.1703438758850098 (2.2192065715789795) | > loss_1: 32.59220886230469 (37.489280700683594)  --> STEP: 3 | > loss_disc: 2.747279644012451 (2.8953771591186523) | > loss_disc_real_0: 0.4692721366882324 (0.3487350195646286) | > loss_disc_real_1: 0.3509337306022644 (0.28322633107503253) | > loss_disc_real_2: 0.2619747817516327 (0.24042127033074698) | > loss_disc_real_3: 0.2858629524707794 (0.2694396674633026) | > loss_disc_real_4: 0.2867822051048279 (0.30464834968249005) | > loss_disc_real_5: 0.2808055877685547 (0.34427495797475177) | > loss_0: 2.747279644012451 (2.8953771591186523) | > loss_gen: 2.5772905349731445 (2.251284639040629) | > loss_kl: 1.3863412141799927 (2.10438605149587) | > loss_feat: 2.7067551612854004 (4.142156879107158) | > loss_mel: 25.89382553100586 (25.87029202779134) | > loss_duration: 2.1496317386627197 (2.196014960606893) | > loss_1: 34.713844299316406 (36.564135233561196) --> EVAL PERFORMANCE | > avg_loader_time: 0.016033411026000977 (+0.0024119218190511073) | > avg_loss_disc: 2.8953771591186523 (+0.27743307749430324) | > avg_loss_disc_real_0: 0.3487350195646286 (+0.21626886973778406) | > avg_loss_disc_real_1: 0.28322633107503253 (+0.05015773077805835) | > avg_loss_disc_real_2: 0.24042127033074698 (-0.006188611189524323) | > avg_loss_disc_real_3: 0.2694396674633026 (+0.03236564000447592) | > avg_loss_disc_real_4: 0.30464834968249005 (+0.09366204341252646) | > avg_loss_disc_real_5: 0.34427495797475177 (+0.03679325679937995) | > avg_loss_0: 2.8953771591186523 (+0.27743307749430324) | > avg_loss_gen: 2.251284639040629 (+0.1756960948308306) | > avg_loss_kl: 2.10438605149587 (+0.0823148091634116) | > avg_loss_feat: 4.142156879107158 (+0.9537275234858198) | > avg_loss_mel: 25.87029202779134 (-1.6397749582926444) | > avg_loss_duration: 2.196014960606893 (+0.05782405535380075) | > avg_loss_1: 36.564135233561196 (-0.3702125549316406)  > EPOCH: 82/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:33:19)   --> TIME: 2023-10-20 00:33:33 -- STEP: 19/50 -- GLOBAL_STEP: 57120 | > loss_disc: 2.802811861038208 (2.480559982751545) | > loss_disc_real_0: 0.28376203775405884 (0.18064783523349384) | > loss_disc_real_1: 0.29663747549057007 (0.2148515708548458) | > loss_disc_real_2: 0.34443941712379456 (0.21012034973031596) | > loss_disc_real_3: 0.337005615234375 (0.2180837396728365) | > loss_disc_real_4: 0.37073633074760437 (0.23315883467071935) | > loss_disc_real_5: 0.23238830268383026 (0.20375332726459755) | > loss_0: 2.802811861038208 (2.480559982751545) | > grad_norm_0: tensor(405.6825, device='cuda:0') (tensor(367.0147, device='cuda:0')) | > loss_gen: 2.252248525619507 (2.316424714891534) | > loss_kl: 1.0471315383911133 (1.0705006185330843) | > loss_feat: 1.1621121168136597 (5.514350835626063) | > loss_mel: 20.710712432861328 (25.76178429001256) | > loss_duration: 1.9267771244049072 (1.8668133083142733) | > loss_1: 27.098981857299805 (36.52987447537874) | > grad_norm_1: tensor(4980.3765, device='cuda:0') (tensor(18771.0039, device='cuda:0')) | > current_lr_0: 0.00018425344735922817 | > current_lr_1: 0.00018425344735922817 | > step_time: 0.626 (0.5018823272303531) | > loader_time: 0.0242 (0.018902439820139033)  --> TIME: 2023-10-20 00:33:48 -- STEP: 49/50 -- GLOBAL_STEP: 57150 | > loss_disc: 2.647216320037842 (2.359099641138193) | > loss_disc_real_0: 0.2819015383720398 (0.16439790001177057) | > loss_disc_real_1: 0.3769139349460602 (0.22321549381072425) | > loss_disc_real_2: 0.3747759163379669 (0.2128340966087215) | > loss_disc_real_3: 0.291902631521225 (0.22738281090040596) | > loss_disc_real_4: 0.41754311323165894 (0.23604566303594987) | > loss_disc_real_5: 0.18228238821029663 (0.20421421396717124) | > loss_0: 2.647216320037842 (2.359099641138193) | > grad_norm_0: tensor(504.9904, device='cuda:0') (tensor(423.5716, device='cuda:0')) | > loss_gen: 2.658505439758301 (2.472595883875477) | > loss_kl: 0.5193079113960266 (1.1193211373625973) | > loss_feat: 2.8509321212768555 (5.80151514747009) | > loss_mel: 22.63648223876953 (25.900911394430665) | > loss_duration: 1.9030169248580933 (1.8182403433079621) | > loss_1: 30.5682430267334 (37.11258438655309) | > grad_norm_1: tensor(13484.9004, device='cuda:0') (tensor(17443.0762, device='cuda:0')) | > current_lr_0: 0.00018425344735922817 | > current_lr_1: 0.00018425344735922817 | > step_time: 0.6658 (0.4887875391512501) | > loader_time: 0.3 (0.025184738392732574)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.162562847137451 (2.162562847137451) | > loss_disc_real_0: 0.12042367458343506 (0.12042367458343506) | > loss_disc_real_1: 0.216232568025589 (0.216232568025589) | > loss_disc_real_2: 0.3097473382949829 (0.3097473382949829) | > loss_disc_real_3: 0.3637658357620239 (0.3637658357620239) | > loss_disc_real_4: 0.10650771111249924 (0.10650771111249924) | > loss_disc_real_5: 0.05602202191948891 (0.05602202191948891) | > loss_0: 2.162562847137451 (2.162562847137451) | > loss_gen: 2.796137809753418 (2.796137809753418) | > loss_kl: 1.9810819625854492 (1.9810819625854492) | > loss_feat: 7.161077976226807 (7.161077976226807) | > loss_mel: 25.782838821411133 (25.782838821411133) | > loss_duration: 1.9801992177963257 (1.9801992177963257) | > loss_1: 39.70133590698242 (39.70133590698242)  --> STEP: 1 | > loss_disc: 2.6157591342926025 (2.6157591342926025) | > loss_disc_real_0: 0.10468907654285431 (0.10468907654285431) | > loss_disc_real_1: 0.2499595731496811 (0.2499595731496811) | > loss_disc_real_2: 0.3172513246536255 (0.3172513246536255) | > loss_disc_real_3: 0.23192070424556732 (0.23192070424556732) | > loss_disc_real_4: 0.30277323722839355 (0.30277323722839355) | > loss_disc_real_5: 0.1844290792942047 (0.1844290792942047) | > loss_0: 2.6157591342926025 (2.6157591342926025) | > loss_gen: 2.425138473510742 (2.425138473510742) | > loss_kl: 2.8316657543182373 (2.8316657543182373) | > loss_feat: 5.661410808563232 (5.661410808563232) | > loss_mel: 24.198389053344727 (24.198389053344727) | > loss_duration: 2.1808924674987793 (2.1808924674987793) | > loss_1: 37.29750061035156 (37.29750061035156)  --> STEP: 2 | > loss_disc: 2.7977466583251953 (2.706752896308899) | > loss_disc_real_0: 0.2204444706439972 (0.16256677359342575) | > loss_disc_real_1: 0.4346460998058319 (0.3423028364777565) | > loss_disc_real_2: 0.3307321071624756 (0.32399171590805054) | > loss_disc_real_3: 0.27048009634017944 (0.2512004002928734) | > loss_disc_real_4: 0.2942764163017273 (0.2985248267650604) | > loss_disc_real_5: 0.3618888854980469 (0.2731589823961258) | > loss_0: 2.7977466583251953 (2.706752896308899) | > loss_gen: 2.512822151184082 (2.468980312347412) | > loss_kl: 2.3550736904144287 (2.593369722366333) | > loss_feat: 2.367459297180176 (4.014435052871704) | > loss_mel: 26.897218704223633 (25.54780387878418) | > loss_duration: 2.1320266723632812 (2.1564595699310303) | > loss_1: 36.26459884643555 (36.781049728393555)  --> STEP: 3 | > loss_disc: 2.1673004627227783 (2.526935418446859) | > loss_disc_real_0: 0.11690705269575119 (0.14734686662753424) | > loss_disc_real_1: 0.30909326672554016 (0.3312329798936844) | > loss_disc_real_2: 0.33731362223625183 (0.3284323513507843) | > loss_disc_real_3: 0.30706730484962463 (0.26982270181179047) | > loss_disc_real_4: 0.19876141846179962 (0.26527035733064014) | > loss_disc_real_5: 0.3225378692150116 (0.2896186113357544) | > loss_0: 2.1673004627227783 (2.526935418446859) | > loss_gen: 3.2651870250701904 (2.7343825499216714) | > loss_kl: 1.318259596824646 (2.1683330138524375) | > loss_feat: 4.5784502029418945 (4.202440102895101) | > loss_mel: 25.294387817382812 (25.46333185831706) | > loss_duration: 2.080629825592041 (2.1311829884847007) | > loss_1: 36.53691482543945 (36.69967142740885) --> EVAL PERFORMANCE | > avg_loader_time: 0.006869316101074219 (-0.009164094924926758) | > avg_loss_disc: 2.526935418446859 (-0.36844174067179347) | > avg_loss_disc_real_0: 0.14734686662753424 (-0.20138815293709436) | > avg_loss_disc_real_1: 0.3312329798936844 (+0.048006648818651854) | > avg_loss_disc_real_2: 0.3284323513507843 (+0.08801108102003732) | > avg_loss_disc_real_3: 0.26982270181179047 (+0.000383034348487854) | > avg_loss_disc_real_4: 0.26527035733064014 (-0.03937799235184991) | > avg_loss_disc_real_5: 0.2896186113357544 (-0.05465634663899738) | > avg_loss_0: 2.526935418446859 (-0.36844174067179347) | > avg_loss_gen: 2.7343825499216714 (+0.4830979108810425) | > avg_loss_kl: 2.1683330138524375 (+0.06394696235656738) | > avg_loss_feat: 4.202440102895101 (+0.06028322378794293) | > avg_loss_mel: 25.46333185831706 (-0.4069601694742815) | > avg_loss_duration: 2.1311829884847007 (-0.06483197212219238) | > avg_loss_1: 36.69967142740885 (+0.13553619384765625)  > EPOCH: 83/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:33:59)   --> TIME: 2023-10-20 00:34:18 -- STEP: 29/50 -- GLOBAL_STEP: 57180 | > loss_disc: 2.468566656112671 (2.4379004733315837) | > loss_disc_real_0: 0.13696013391017914 (0.16894146183441422) | > loss_disc_real_1: 0.2038855403661728 (0.22663339741271118) | > loss_disc_real_2: 0.18472076952457428 (0.22752067202637935) | > loss_disc_real_3: 0.07523366808891296 (0.22982619060524578) | > loss_disc_real_4: 0.1808817982673645 (0.20048452807783051) | > loss_disc_real_5: 0.2057531177997589 (0.2206685048495901) | > loss_0: 2.468566656112671 (2.4379004733315837) | > grad_norm_0: tensor(918.1354, device='cuda:0') (tensor(725.6835, device='cuda:0')) | > loss_gen: 2.2558045387268066 (2.494266045504603) | > loss_kl: 0.716558039188385 (1.1236068339183414) | > loss_feat: 10.151717185974121 (5.615020460609732) | > loss_mel: 25.476402282714844 (24.12150510837292) | > loss_duration: 1.7654123306274414 (1.8194447221427128) | > loss_1: 40.36589431762695 (35.17384341667438) | > grad_norm_1: tensor(3731.7854, device='cuda:0') (tensor(21290.1133, device='cuda:0')) | > current_lr_0: 0.00018406927450260254 | > current_lr_1: 0.00018406927450260254 | > step_time: 0.6243 (0.5208513572298248) | > loader_time: 0.016 (0.01792687383191339)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.799358367919922 (2.799358367919922) | > loss_disc_real_0: 0.08159587532281876 (0.08159587532281876) | > loss_disc_real_1: 0.10224171727895737 (0.10224171727895737) | > loss_disc_real_2: 0.1695609986782074 (0.1695609986782074) | > loss_disc_real_3: 0.24385324120521545 (0.24385324120521545) | > loss_disc_real_4: 0.3703840970993042 (0.3703840970993042) | > loss_disc_real_5: 0.24101899564266205 (0.24101899564266205) | > loss_0: 2.799358367919922 (2.799358367919922) | > loss_gen: 1.6029659509658813 (1.6029659509658813) | > loss_kl: 1.7605159282684326 (1.7605159282684326) | > loss_feat: 6.473087310791016 (6.473087310791016) | > loss_mel: 25.588788986206055 (25.588788986206055) | > loss_duration: 1.9832571744918823 (1.9832571744918823) | > loss_1: 37.40861511230469 (37.40861511230469)  --> STEP: 1 | > loss_disc: 2.6947109699249268 (2.6947109699249268) | > loss_disc_real_0: 0.03649741783738136 (0.03649741783738136) | > loss_disc_real_1: 0.21094240248203278 (0.21094240248203278) | > loss_disc_real_2: 0.13554935157299042 (0.13554935157299042) | > loss_disc_real_3: 0.16458411514759064 (0.16458411514759064) | > loss_disc_real_4: 0.2423054426908493 (0.2423054426908493) | > loss_disc_real_5: 0.2519281506538391 (0.2519281506538391) | > loss_0: 2.6947109699249268 (2.6947109699249268) | > loss_gen: 1.6351206302642822 (1.6351206302642822) | > loss_kl: 2.597562551498413 (2.597562551498413) | > loss_feat: 5.021002292633057 (5.021002292633057) | > loss_mel: 27.20264434814453 (27.20264434814453) | > loss_duration: 2.174283981323242 (2.174283981323242) | > loss_1: 38.630615234375 (38.630615234375)  --> STEP: 2 | > loss_disc: 2.855113983154297 (2.774912476539612) | > loss_disc_real_0: 0.0841922014951706 (0.06034480966627598) | > loss_disc_real_1: 0.11427706480026245 (0.1626097336411476) | > loss_disc_real_2: 0.13594810664653778 (0.1357487291097641) | > loss_disc_real_3: 0.12537217140197754 (0.1449781432747841) | > loss_disc_real_4: 0.22047443687915802 (0.23138993978500366) | > loss_disc_real_5: 0.176761195063591 (0.21434467285871506) | > loss_0: 2.855113983154297 (2.774912476539612) | > loss_gen: 1.279447078704834 (1.457283854484558) | > loss_kl: 2.3338284492492676 (2.4656955003738403) | > loss_feat: 5.777713298797607 (5.399357795715332) | > loss_mel: 30.574787139892578 (28.888715744018555) | > loss_duration: 2.137876510620117 (2.1560802459716797) | > loss_1: 42.10365295410156 (40.36713409423828)  --> STEP: 3 | > loss_disc: 2.951209545135498 (2.8336781660715737) | > loss_disc_real_0: 0.1696646511554718 (0.09678475682934125) | > loss_disc_real_1: 0.31170856952667236 (0.2123093456029892) | > loss_disc_real_2: 0.37052738666534424 (0.2140082816282908) | > loss_disc_real_3: 0.21997703611850739 (0.16997777422269186) | > loss_disc_real_4: 0.2550453245639801 (0.23927506804466248) | > loss_disc_real_5: 0.1855047643184662 (0.20473137001196542) | > loss_0: 2.951209545135498 (2.8336781660715737) | > loss_gen: 1.6113699674606323 (1.5086458921432495) | > loss_kl: 0.9793080687522888 (1.9702330231666565) | > loss_feat: 0.5699343085289001 (3.789549966653188) | > loss_mel: 16.084447860717773 (24.62062644958496) | > loss_duration: 2.1254453659057617 (2.1458686192830405) | > loss_1: 21.370506286621094 (34.034924825032554) --> EVAL PERFORMANCE | > avg_loader_time: 0.010017077128092447 (+0.0031477610270182286) | > avg_loss_disc: 2.8336781660715737 (+0.3067427476247149) | > avg_loss_disc_real_0: 0.09678475682934125 (-0.05056210979819299) | > avg_loss_disc_real_1: 0.2123093456029892 (-0.11892363429069519) | > avg_loss_disc_real_2: 0.2140082816282908 (-0.1144240697224935) | > avg_loss_disc_real_3: 0.16997777422269186 (-0.0998449275890986) | > avg_loss_disc_real_4: 0.23927506804466248 (-0.025995289285977663) | > avg_loss_disc_real_5: 0.20473137001196542 (-0.08488724132378897) | > avg_loss_0: 2.8336781660715737 (+0.3067427476247149) | > avg_loss_gen: 1.5086458921432495 (-1.225736657778422) | > avg_loss_kl: 1.9702330231666565 (-0.198099990685781) | > avg_loss_feat: 3.789549966653188 (-0.4128901362419124) | > avg_loss_mel: 24.62062644958496 (-0.8427054087320975) | > avg_loss_duration: 2.1458686192830405 (+0.014685630798339844) | > avg_loss_1: 34.034924825032554 (-2.6647466023762973)  > EPOCH: 84/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:34:38)   --> TIME: 2023-10-20 00:34:46 -- STEP: 9/50 -- GLOBAL_STEP: 57210 | > loss_disc: 1.7578773498535156 (2.297831005520291) | > loss_disc_real_0: 0.030087849125266075 (0.10093151115708882) | > loss_disc_real_1: 0.18108154833316803 (0.23365785678227743) | > loss_disc_real_2: 0.09296374768018723 (0.1983772193392118) | > loss_disc_real_3: 0.20701684057712555 (0.2398572928375668) | > loss_disc_real_4: 0.11193350702524185 (0.1930989676879512) | > loss_disc_real_5: 0.07761486619710922 (0.18359830354650816) | > loss_0: 1.7578773498535156 (2.297831005520291) | > grad_norm_0: tensor(368.9998, device='cuda:0') (tensor(495.2970, device='cuda:0')) | > loss_gen: 2.6719489097595215 (2.5519495407740274) | > loss_kl: 0.9088213443756104 (1.1875135037634108) | > loss_feat: 8.51225757598877 (6.648080342345768) | > loss_mel: 26.880203247070312 (26.49581633673774) | > loss_duration: 1.7492493391036987 (1.8081272972954645) | > loss_1: 40.722476959228516 (38.691485510932075) | > grad_norm_1: tensor(12032.2900, device='cuda:0') (tensor(22940.9473, device='cuda:0')) | > current_lr_0: 0.00018388528573827801 | > current_lr_1: 0.00018388528573827801 | > step_time: 0.516 (0.48999706904093426) | > loader_time: 0.0248 (0.021826161278618708)  --> TIME: 2023-10-20 00:34:58 -- STEP: 39/50 -- GLOBAL_STEP: 57240 | > loss_disc: 2.50349497795105 (2.460259422277793) | > loss_disc_real_0: 0.11506910622119904 (0.1390484186510245) | > loss_disc_real_1: 0.2024259865283966 (0.2387014199525882) | > loss_disc_real_2: 0.17283114790916443 (0.2304784030868457) | > loss_disc_real_3: 0.1332523375749588 (0.23157076614025313) | > loss_disc_real_4: 0.14560703933238983 (0.21429705533843774) | > loss_disc_real_5: 0.01584109477698803 (0.23417361926000851) | > loss_0: 2.50349497795105 (2.460259422277793) | > grad_norm_0: tensor(584.0449, device='cuda:0') (tensor(494.5538, device='cuda:0')) | > loss_gen: 2.091860771179199 (2.5253450931646886) | > loss_kl: 0.4915216267108917 (1.056978053771532) | > loss_feat: 6.284376621246338 (5.665279512604077) | > loss_mel: 31.807273864746094 (24.277228740545418) | > loss_duration: 1.8426978588104248 (1.8154631516872308) | > loss_1: 42.517730712890625 (35.34029454451341) | > grad_norm_1: tensor(18026.8145, device='cuda:0') (tensor(20760.4668, device='cuda:0')) | > current_lr_0: 0.00018388528573827801 | > current_lr_1: 0.00018388528573827801 | > step_time: 0.6748 (0.41789944966634107) | > loader_time: 0.022 (0.011855602264404297)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4679598808288574 (2.4679598808288574) | > loss_disc_real_0: 0.1960100531578064 (0.1960100531578064) | > loss_disc_real_1: 0.2612323760986328 (0.2612323760986328) | > loss_disc_real_2: 0.3180907368659973 (0.3180907368659973) | > loss_disc_real_3: 0.25975120067596436 (0.25975120067596436) | > loss_disc_real_4: 0.2513393759727478 (0.2513393759727478) | > loss_disc_real_5: 0.18063589930534363 (0.18063589930534363) | > loss_0: 2.4679598808288574 (2.4679598808288574) | > loss_gen: 2.31693959236145 (2.31693959236145) | > loss_kl: 2.020193338394165 (2.020193338394165) | > loss_feat: 5.930412769317627 (5.930412769317627) | > loss_mel: 19.916080474853516 (19.916080474853516) | > loss_duration: 1.971655249595642 (1.971655249595642) | > loss_1: 32.1552848815918 (32.1552848815918)  --> STEP: 1 | > loss_disc: 1.5390743017196655 (1.5390743017196655) | > loss_disc_real_0: 0.06802074611186981 (0.06802074611186981) | > loss_disc_real_1: 0.021898534148931503 (0.021898534148931503) | > loss_disc_real_2: 0.06564676016569138 (0.06564676016569138) | > loss_disc_real_3: 0.10287715494632721 (0.10287715494632721) | > loss_disc_real_4: 0.09208524227142334 (0.09208524227142334) | > loss_disc_real_5: 0.028544507920742035 (0.028544507920742035) | > loss_0: 1.5390743017196655 (1.5390743017196655) | > loss_gen: 2.617311716079712 (2.617311716079712) | > loss_kl: 2.541470766067505 (2.541470766067505) | > loss_feat: 11.871542930603027 (11.871542930603027) | > loss_mel: 27.01511573791504 (27.01511573791504) | > loss_duration: 2.068439245223999 (2.068439245223999) | > loss_1: 46.11388397216797 (46.11388397216797)  --> STEP: 2 | > loss_disc: 1.62385094165802 (1.5814626216888428) | > loss_disc_real_0: 0.1174774169921875 (0.09274908155202866) | > loss_disc_real_1: 0.17864131927490234 (0.10026992671191692) | > loss_disc_real_2: 0.15252584218978882 (0.1090863011777401) | > loss_disc_real_3: 0.08844976872205734 (0.09566346183419228) | > loss_disc_real_4: 0.14557647705078125 (0.1188308596611023) | > loss_disc_real_5: 0.1382167488336563 (0.08338062837719917) | > loss_0: 1.62385094165802 (1.5814626216888428) | > loss_gen: 3.5971853733062744 (3.107248544692993) | > loss_kl: 2.666146993637085 (2.603808879852295) | > loss_feat: 9.153714179992676 (10.512628555297852) | > loss_mel: 29.943981170654297 (28.479548454284668) | > loss_duration: 2.108386993408203 (2.088413119316101) | > loss_1: 47.469417572021484 (46.79165077209473)  --> STEP: 3 | > loss_disc: 3.1170759201049805 (2.0933337211608887) | > loss_disc_real_0: 0.5375760793685913 (0.24102474749088287) | > loss_disc_real_1: 0.30273595452308655 (0.16775860264897346) | > loss_disc_real_2: 0.31305715441703796 (0.17707658559083939) | > loss_disc_real_3: 0.28810182213783264 (0.15980958193540573) | > loss_disc_real_4: 0.3213218152523041 (0.18632784485816956) | > loss_disc_real_5: 0.33329787850379944 (0.16668637841939926) | > loss_0: 3.1170759201049805 (2.0933337211608887) | > loss_gen: 2.1685826778411865 (2.7943599224090576) | > loss_kl: 1.3352410793304443 (2.1809529463450112) | > loss_feat: 0.18565979599952698 (7.070305635531743) | > loss_mel: 18.307523727416992 (25.088873545328777) | > loss_duration: 2.0557589530944824 (2.077528397242228) | > loss_1: 24.052766799926758 (39.21202278137207) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018432140350341797 (-0.008173863093058268) | > avg_loss_disc: 2.0933337211608887 (-0.7403444449106851) | > avg_loss_disc_real_0: 0.24102474749088287 (+0.14423999066154164) | > avg_loss_disc_real_1: 0.16775860264897346 (-0.04455074295401573) | > avg_loss_disc_real_2: 0.17707658559083939 (-0.03693169603745142) | > avg_loss_disc_real_3: 0.15980958193540573 (-0.010168192287286132) | > avg_loss_disc_real_4: 0.18632784485816956 (-0.05294722318649292) | > avg_loss_disc_real_5: 0.16668637841939926 (-0.03804499159256616) | > avg_loss_0: 2.0933337211608887 (-0.7403444449106851) | > avg_loss_gen: 2.7943599224090576 (+1.285714030265808) | > avg_loss_kl: 2.1809529463450112 (+0.21071992317835475) | > avg_loss_feat: 7.070305635531743 (+3.280755668878555) | > avg_loss_mel: 25.088873545328777 (+0.4682470957438163) | > avg_loss_duration: 2.077528397242228 (-0.06834022204081247) | > avg_loss_1: 39.21202278137207 (+5.177097956339516)  > EPOCH: 85/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:35:13)   --> TIME: 2023-10-20 00:35:27 -- STEP: 19/50 -- GLOBAL_STEP: 57270 | > loss_disc: 2.943660259246826 (2.6087140535053455) | > loss_disc_real_0: 0.43159955739974976 (0.21084478115172764) | > loss_disc_real_1: 0.31457751989364624 (0.2664553750502436) | > loss_disc_real_2: 0.34281980991363525 (0.244184462647689) | > loss_disc_real_3: 0.3338852524757385 (0.25349334431321996) | > loss_disc_real_4: 0.38304567337036133 (0.20231232948993383) | > loss_disc_real_5: 0.35015618801116943 (0.24918650482830249) | > loss_0: 2.943660259246826 (2.6087140535053455) | > grad_norm_0: tensor(489.8464, device='cuda:0') (tensor(927.4641, device='cuda:0')) | > loss_gen: 2.6872165203094482 (2.4434578105023035) | > loss_kl: 1.0082802772521973 (1.223227256222775) | > loss_feat: 2.3528566360473633 (5.112046653723442) | > loss_mel: 24.928499221801758 (21.886265447265224) | > loss_duration: 1.9185720682144165 (1.869211667462399) | > loss_1: 32.895423889160156 (32.534208699276576) | > grad_norm_1: tensor(6629.2886, device='cuda:0') (tensor(28680.8066, device='cuda:0')) | > current_lr_0: 0.00018370148088224286 | > current_lr_1: 0.00018370148088224286 | > step_time: 0.2953 (0.5074347571322793) | > loader_time: 0.025 (0.019405352441888107)  --> TIME: 2023-10-20 00:35:42 -- STEP: 49/50 -- GLOBAL_STEP: 57300 | > loss_disc: 2.7533118724823 (2.591718629914887) | > loss_disc_real_0: 0.2096746265888214 (0.19366191760921964) | > loss_disc_real_1: 0.3203374147415161 (0.2503330646728983) | > loss_disc_real_2: 0.3229043483734131 (0.2340232272993545) | > loss_disc_real_3: 0.29777809977531433 (0.2458895466157369) | > loss_disc_real_4: 0.3833951950073242 (0.2181868173029958) | > loss_disc_real_5: 0.19187571108341217 (0.22715765655953057) | > loss_0: 2.7533118724823 (2.591718629914887) | > grad_norm_0: tensor(679.1276, device='cuda:0') (tensor(626.1645, device='cuda:0')) | > loss_gen: 2.3520400524139404 (2.2906052774312546) | > loss_kl: 0.46083685755729675 (1.130971393414906) | > loss_feat: 3.346320152282715 (4.706452142304684) | > loss_mel: 22.956472396850586 (22.43432940998856) | > loss_duration: 1.9008692502975464 (1.8065691699787063) | > loss_1: 31.016538619995117 (32.36892743986481) | > grad_norm_1: tensor(6637.7476, device='cuda:0') (tensor(19171.8691, device='cuda:0')) | > current_lr_0: 0.00018370148088224286 | > current_lr_1: 0.00018370148088224286 | > step_time: 0.5233 (0.5000443653184541) | > loader_time: 0.226 (0.025061524644189953)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.125786781311035 (3.125786781311035) | > loss_disc_real_0: 0.17236751317977905 (0.17236751317977905) | > loss_disc_real_1: 0.2400369942188263 (0.2400369942188263) | > loss_disc_real_2: 0.45506924390792847 (0.45506924390792847) | > loss_disc_real_3: 0.22579273581504822 (0.22579273581504822) | > loss_disc_real_4: 0.45641374588012695 (0.45641374588012695) | > loss_disc_real_5: 0.2580418586730957 (0.2580418586730957) | > loss_0: 3.125786781311035 (3.125786781311035) | > loss_gen: 1.850512146949768 (1.850512146949768) | > loss_kl: 2.128262519836426 (2.128262519836426) | > loss_feat: 1.1412945985794067 (1.1412945985794067) | > loss_mel: 24.629735946655273 (24.629735946655273) | > loss_duration: 2.0221405029296875 (2.0221405029296875) | > loss_1: 31.771944046020508 (31.771944046020508)  --> STEP: 1 | > loss_disc: 2.252575397491455 (2.252575397491455) | > loss_disc_real_0: 0.05622319504618645 (0.05622319504618645) | > loss_disc_real_1: 0.19941604137420654 (0.19941604137420654) | > loss_disc_real_2: 0.20118966698646545 (0.20118966698646545) | > loss_disc_real_3: 0.12340551614761353 (0.12340551614761353) | > loss_disc_real_4: 0.5312791466712952 (0.5312791466712952) | > loss_disc_real_5: 0.09651152789592743 (0.09651152789592743) | > loss_0: 2.252575397491455 (2.252575397491455) | > loss_gen: 2.622535228729248 (2.622535228729248) | > loss_kl: 3.3669424057006836 (3.3669424057006836) | > loss_feat: 7.322343826293945 (7.322343826293945) | > loss_mel: 23.739749908447266 (23.739749908447266) | > loss_duration: 2.2327544689178467 (2.2327544689178467) | > loss_1: 39.284324645996094 (39.284324645996094)  --> STEP: 2 | > loss_disc: 3.1255507469177246 (2.68906307220459) | > loss_disc_real_0: 0.21967937052249908 (0.13795128278434277) | > loss_disc_real_1: 0.2617683410644531 (0.23059219121932983) | > loss_disc_real_2: 0.501221776008606 (0.3512057214975357) | > loss_disc_real_3: 0.2167794555425644 (0.17009248584508896) | > loss_disc_real_4: 0.41716739535331726 (0.4742232710123062) | > loss_disc_real_5: 0.23824094235897064 (0.16737623512744904) | > loss_0: 3.1255507469177246 (2.68906307220459) | > loss_gen: 1.882543921470642 (2.252539575099945) | > loss_kl: 2.568164110183716 (2.9675532579421997) | > loss_feat: 0.0838591530919075 (3.7031014896929264) | > loss_mel: 10.536373138427734 (17.1380615234375) | > loss_duration: 2.2271387577056885 (2.2299466133117676) | > loss_1: 17.298078536987305 (28.2912015914917)  --> STEP: 3 | > loss_disc: 1.754916787147522 (2.3776809771855674) | > loss_disc_real_0: 0.04014447331428528 (0.10534901296099027) | > loss_disc_real_1: 0.2191941738128662 (0.22679285208384195) | > loss_disc_real_2: 0.22855953872203827 (0.3103236605723699) | > loss_disc_real_3: 0.12703335285186768 (0.1557394415140152) | > loss_disc_real_4: 0.2041793167591095 (0.384208619594574) | > loss_disc_real_5: 0.207173153758049 (0.18064187467098236) | > loss_0: 1.754916787147522 (2.3776809771855674) | > loss_gen: 4.034320831298828 (2.8464666604995728) | > loss_kl: 1.1705175638198853 (2.3685413599014282) | > loss_feat: 8.479926109313965 (5.2953763628999395) | > loss_mel: 28.072694778442383 (20.782939275105793) | > loss_duration: 2.0728204250335693 (2.1775712172190347) | > loss_1: 43.83027648925781 (33.470893224080406) --> EVAL PERFORMANCE | > avg_loader_time: 0.0038849512736002603 (+0.0020417372385660806) | > avg_loss_disc: 2.3776809771855674 (+0.2843472560246787) | > avg_loss_disc_real_0: 0.10534901296099027 (-0.13567573452989262) | > avg_loss_disc_real_1: 0.22679285208384195 (+0.059034249434868485) | > avg_loss_disc_real_2: 0.3103236605723699 (+0.1332470749815305) | > avg_loss_disc_real_3: 0.1557394415140152 (-0.0040701404213905334) | > avg_loss_disc_real_4: 0.384208619594574 (+0.19788077473640442) | > avg_loss_disc_real_5: 0.18064187467098236 (+0.0139554962515831) | > avg_loss_0: 2.3776809771855674 (+0.2843472560246787) | > avg_loss_gen: 2.8464666604995728 (+0.05210673809051514) | > avg_loss_kl: 2.3685413599014282 (+0.18758841355641698) | > avg_loss_feat: 5.2953763628999395 (-1.7749292726318036) | > avg_loss_mel: 20.782939275105793 (-4.305934270222984) | > avg_loss_duration: 2.1775712172190347 (+0.10004281997680664) | > avg_loss_1: 33.470893224080406 (-5.741129557291664)  > EPOCH: 86/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:35:53)   --> TIME: 2023-10-20 00:36:12 -- STEP: 29/50 -- GLOBAL_STEP: 57330 | > loss_disc: 3.0049328804016113 (2.5525148613699553) | > loss_disc_real_0: 0.23917683959007263 (0.16757317369097266) | > loss_disc_real_1: 0.2822025418281555 (0.20701386047334508) | > loss_disc_real_2: 0.20031039416790009 (0.2409221794584702) | > loss_disc_real_3: 0.40450340509414673 (0.23624944095981532) | > loss_disc_real_4: 0.17856468260288239 (0.23481942841718936) | > loss_disc_real_5: 0.24987521767616272 (0.1947314226999879) | > loss_0: 3.0049328804016113 (2.5525148613699553) | > grad_norm_0: tensor(400.0772, device='cuda:0') (tensor(470.6475, device='cuda:0')) | > loss_gen: 1.744096040725708 (2.346534042522825) | > loss_kl: 0.7905413508415222 (1.1398787662900727) | > loss_feat: 0.23105750977993011 (5.282689059313772) | > loss_mel: 20.897083282470703 (22.69402397089991) | > loss_duration: 1.8041077852249146 (1.8276212544276798) | > loss_1: 25.466886520385742 (33.290747083466634) | > grad_norm_1: tensor(9862.1211, device='cuda:0') (tensor(25218.2930, device='cuda:0')) | > current_lr_0: 0.00018351785975066927 | > current_lr_1: 0.00018351785975066927 | > step_time: 0.5961 (0.5121279009457291) | > loader_time: 0.0039 (0.016976471604972055)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0169167518615723 (3.0169167518615723) | > loss_disc_real_0: 0.2807633876800537 (0.2807633876800537) | > loss_disc_real_1: 0.32920411229133606 (0.32920411229133606) | > loss_disc_real_2: 0.3985525965690613 (0.3985525965690613) | > loss_disc_real_3: 0.2788425087928772 (0.2788425087928772) | > loss_disc_real_4: 0.33823439478874207 (0.33823439478874207) | > loss_disc_real_5: 0.29098501801490784 (0.29098501801490784) | > loss_0: 3.0169167518615723 (3.0169167518615723) | > loss_gen: 1.9762482643127441 (1.9762482643127441) | > loss_kl: 2.0082621574401855 (2.0082621574401855) | > loss_feat: 0.19243597984313965 (0.19243597984313965) | > loss_mel: 17.050765991210938 (17.050765991210938) | > loss_duration: 2.0332536697387695 (2.0332536697387695) | > loss_1: 23.260967254638672 (23.260967254638672)  --> STEP: 1 | > loss_disc: 2.516144275665283 (2.516144275665283) | > loss_disc_real_0: 0.05094796419143677 (0.05094796419143677) | > loss_disc_real_1: 0.21421530842781067 (0.21421530842781067) | > loss_disc_real_2: 0.16728462278842926 (0.16728462278842926) | > loss_disc_real_3: 0.36254316568374634 (0.36254316568374634) | > loss_disc_real_4: 0.2358749508857727 (0.2358749508857727) | > loss_disc_real_5: 0.17989759147167206 (0.17989759147167206) | > loss_0: 2.516144275665283 (2.516144275665283) | > loss_gen: 1.9864771366119385 (1.9864771366119385) | > loss_kl: 2.759465217590332 (2.759465217590332) | > loss_feat: 5.062646865844727 (5.062646865844727) | > loss_mel: 25.93515396118164 (25.93515396118164) | > loss_duration: 2.2510364055633545 (2.2510364055633545) | > loss_1: 37.994781494140625 (37.994781494140625)  --> STEP: 2 | > loss_disc: 2.2259700298309326 (2.371057152748108) | > loss_disc_real_0: 0.09416330605745316 (0.07255563512444496) | > loss_disc_real_1: 0.22802260518074036 (0.2211189568042755) | > loss_disc_real_2: 0.231576606631279 (0.19943061470985413) | > loss_disc_real_3: 0.23166632652282715 (0.29710474610328674) | > loss_disc_real_4: 0.1602490097284317 (0.1980619803071022) | > loss_disc_real_5: 0.2442508488893509 (0.21207422018051147) | > loss_0: 2.2259700298309326 (2.371057152748108) | > loss_gen: 2.3780252933502197 (2.182251214981079) | > loss_kl: 2.418677568435669 (2.5890713930130005) | > loss_feat: 4.766720771789551 (4.914683818817139) | > loss_mel: 33.3599853515625 (29.64756965637207) | > loss_duration: 2.2141189575195312 (2.232577681541443) | > loss_1: 45.13752746582031 (41.56615447998047)  --> STEP: 3 | > loss_disc: 2.0335519313812256 (2.2585554122924805) | > loss_disc_real_0: 0.07482533901929855 (0.07331220308939616) | > loss_disc_real_1: 0.2221786379814148 (0.22147218386332193) | > loss_disc_real_2: 0.31707584857940674 (0.23864569266637167) | > loss_disc_real_3: 0.28712859749794006 (0.29377936323483783) | > loss_disc_real_4: 0.12898167967796326 (0.17503521343072256) | > loss_disc_real_5: 0.08196902275085449 (0.16870582103729248) | > loss_0: 2.0335519313812256 (2.2585554122924805) | > loss_gen: 2.654226064682007 (2.339576164881388) | > loss_kl: 1.215506672859192 (2.1312164862950644) | > loss_feat: 5.810499668121338 (5.213289101918538) | > loss_mel: 23.317047119140625 (27.537395477294922) | > loss_duration: 2.118436098098755 (2.194530487060547) | > loss_1: 35.11571502685547 (39.41600799560547) --> EVAL PERFORMANCE | > avg_loader_time: 0.006180365880330403 (+0.002295414606730143) | > avg_loss_disc: 2.2585554122924805 (-0.1191255648930869) | > avg_loss_disc_real_0: 0.07331220308939616 (-0.0320368098715941) | > avg_loss_disc_real_1: 0.22147218386332193 (-0.0053206682205200195) | > avg_loss_disc_real_2: 0.23864569266637167 (-0.0716779679059982) | > avg_loss_disc_real_3: 0.29377936323483783 (+0.13803992172082263) | > avg_loss_disc_real_4: 0.17503521343072256 (-0.2091734061638514) | > avg_loss_disc_real_5: 0.16870582103729248 (-0.01193605363368988) | > avg_loss_0: 2.2585554122924805 (-0.1191255648930869) | > avg_loss_gen: 2.339576164881388 (-0.5068904956181846) | > avg_loss_kl: 2.1312164862950644 (-0.23732487360636378) | > avg_loss_feat: 5.213289101918538 (-0.0820872609814014) | > avg_loss_mel: 27.537395477294922 (+6.754456202189129) | > avg_loss_duration: 2.194530487060547 (+0.016959269841512192) | > avg_loss_1: 39.41600799560547 (+5.945114771525063)  > EPOCH: 87/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:36:30)   --> TIME: 2023-10-20 00:36:39 -- STEP: 9/50 -- GLOBAL_STEP: 57360 | > loss_disc: 3.0341639518737793 (2.5942488776312933) | > loss_disc_real_0: 0.15452605485916138 (0.21215940142671266) | > loss_disc_real_1: 0.2937953472137451 (0.25851694080564713) | > loss_disc_real_2: 0.3136586546897888 (0.21368149254057142) | > loss_disc_real_3: 0.2792556583881378 (0.2682958357036114) | > loss_disc_real_4: 0.3464210331439972 (0.26995163783431053) | > loss_disc_real_5: 0.24470938742160797 (0.19686982780694962) | > loss_0: 3.0341639518737793 (2.5942488776312933) | > grad_norm_0: tensor(503.4896, device='cuda:0') (tensor(668.4948, device='cuda:0')) | > loss_gen: 1.5323054790496826 (2.3986956808302136) | > loss_kl: 1.326979637145996 (1.2062917086813185) | > loss_feat: 0.02948528528213501 (5.083446201350954) | > loss_mel: 2.735921859741211 (20.451014015409683) | > loss_duration: 1.6805837154388428 (1.7932627730899386) | > loss_1: 7.305275917053223 (30.93271043565538) | > grad_norm_1: tensor(16431.5781, device='cuda:0') (tensor(21869.0645, device='cuda:0')) | > current_lr_0: 0.00018333442215991301 | > current_lr_1: 0.00018333442215991301 | > step_time: 0.6897 (0.5268079969618056) | > loader_time: 0.0243 (0.017311149173312716)  --> TIME: 2023-10-20 00:36:50 -- STEP: 39/50 -- GLOBAL_STEP: 57390 | > loss_disc: 2.428159236907959 (2.5776526897381515) | > loss_disc_real_0: 0.25644606351852417 (0.1919513777232705) | > loss_disc_real_1: 0.2521677315235138 (0.2372708216500588) | > loss_disc_real_2: 0.3172297775745392 (0.2337849143988047) | > loss_disc_real_3: 0.24196338653564453 (0.24343522399281844) | > loss_disc_real_4: 0.2274751365184784 (0.24014692579228908) | > loss_disc_real_5: 0.44676467776298523 (0.24378599510647547) | > loss_0: 2.428159236907959 (2.5776526897381515) | > grad_norm_0: tensor(1424.7610, device='cuda:0') (tensor(599.5231, device='cuda:0')) | > loss_gen: 3.2918381690979004 (2.3648511935503054) | > loss_kl: 0.8349688053131104 (1.1700549370203264) | > loss_feat: 4.271358489990234 (5.0183888257313995) | > loss_mel: 27.399309158325195 (23.178194687916683) | > loss_duration: 1.8564985990524292 (1.7976557933367217) | > loss_1: 37.65397644042969 (33.52914550976875) | > grad_norm_1: tensor(24021.2949, device='cuda:0') (tensor(16310.2676, device='cuda:0')) | > current_lr_0: 0.00018333442215991301 | > current_lr_1: 0.00018333442215991301 | > step_time: 0.3032 (0.39725058506696653) | > loader_time: 0.0033 (0.011265705793331832)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7810919284820557 (2.7810919284820557) | > loss_disc_real_0: 0.04612964391708374 (0.04612964391708374) | > loss_disc_real_1: 0.25456178188323975 (0.25456178188323975) | > loss_disc_real_2: 0.2948698103427887 (0.2948698103427887) | > loss_disc_real_3: 0.3376050889492035 (0.3376050889492035) | > loss_disc_real_4: 0.407002717256546 (0.407002717256546) | > loss_disc_real_5: 0.30432406067848206 (0.30432406067848206) | > loss_0: 2.7810919284820557 (2.7810919284820557) | > loss_gen: 2.113135814666748 (2.113135814666748) | > loss_kl: 1.6229795217514038 (1.6229795217514038) | > loss_feat: 3.48034405708313 (3.48034405708313) | > loss_mel: 23.93488883972168 (23.93488883972168) | > loss_duration: 2.020641326904297 (2.020641326904297) | > loss_1: 33.17198944091797 (33.17198944091797)  --> STEP: 1 | > loss_disc: 2.2114152908325195 (2.2114152908325195) | > loss_disc_real_0: 0.10613305866718292 (0.10613305866718292) | > loss_disc_real_1: 0.04659189656376839 (0.04659189656376839) | > loss_disc_real_2: 0.09958918392658234 (0.09958918392658234) | > loss_disc_real_3: 0.0817880854010582 (0.0817880854010582) | > loss_disc_real_4: 0.11506827920675278 (0.11506827920675278) | > loss_disc_real_5: 0.0659685879945755 (0.0659685879945755) | > loss_0: 2.2114152908325195 (2.2114152908325195) | > loss_gen: 1.9997584819793701 (1.9997584819793701) | > loss_kl: 2.4791107177734375 (2.4791107177734375) | > loss_feat: 10.61925983428955 (10.61925983428955) | > loss_mel: 29.326351165771484 (29.326351165771484) | > loss_duration: 2.124498128890991 (2.124498128890991) | > loss_1: 46.54897689819336 (46.54897689819336)  --> STEP: 2 | > loss_disc: 2.8996992111206055 (2.5555572509765625) | > loss_disc_real_0: 0.13596193492412567 (0.1210474967956543) | > loss_disc_real_1: 0.27145886421203613 (0.15902538038790226) | > loss_disc_real_2: 0.3163762390613556 (0.20798271149396896) | > loss_disc_real_3: 0.2811523973941803 (0.18147024139761925) | > loss_disc_real_4: 0.26491525769233704 (0.1899917684495449) | > loss_disc_real_5: 0.29244264960289 (0.17920561879873276) | > loss_0: 2.8996992111206055 (2.5555572509765625) | > loss_gen: 1.6966519355773926 (1.8482052087783813) | > loss_kl: 2.1344828605651855 (2.3067967891693115) | > loss_feat: 0.3847281038761139 (5.501993969082832) | > loss_mel: 14.432074546813965 (21.879212856292725) | > loss_duration: 2.0714762210845947 (2.097987174987793) | > loss_1: 20.71941375732422 (33.63419532775879)  --> STEP: 3 | > loss_disc: 2.8356828689575195 (2.648932456970215) | > loss_disc_real_0: 0.17805540561676025 (0.1400501330693563) | > loss_disc_real_1: 0.28187841176986694 (0.19997639084855715) | > loss_disc_real_2: 0.29849720001220703 (0.238154207666715) | > loss_disc_real_3: 0.30381906032562256 (0.22225318104028702) | > loss_disc_real_4: 0.33056387305259705 (0.2368491366505623) | > loss_disc_real_5: 0.32186025381088257 (0.22675716380278269) | > loss_0: 2.8356828689575195 (2.648932456970215) | > loss_gen: 2.379133701324463 (2.0251813729604087) | > loss_kl: 0.8378682136535645 (1.8171539306640625) | > loss_feat: 2.2405893802642822 (4.414859106143315) | > loss_mel: 21.016544342041016 (21.59165668487549) | > loss_duration: 2.0794506072998047 (2.091808319091797) | > loss_1: 28.553585052490234 (31.940658569335938) --> EVAL PERFORMANCE | > avg_loader_time: 0.0017840862274169922 (-0.004396279652913411) | > avg_loss_disc: 2.648932456970215 (+0.3903770446777344) | > avg_loss_disc_real_0: 0.1400501330693563 (+0.06673792997996013) | > avg_loss_disc_real_1: 0.19997639084855715 (-0.021495793014764786) | > avg_loss_disc_real_2: 0.238154207666715 (-0.0004914849996566772) | > avg_loss_disc_real_3: 0.22225318104028702 (-0.07152618219455081) | > avg_loss_disc_real_4: 0.2368491366505623 (+0.06181392321983972) | > avg_loss_disc_real_5: 0.22675716380278269 (+0.058051342765490205) | > avg_loss_0: 2.648932456970215 (+0.3903770446777344) | > avg_loss_gen: 2.0251813729604087 (-0.3143947919209795) | > avg_loss_kl: 1.8171539306640625 (-0.31406255563100194) | > avg_loss_feat: 4.414859106143315 (-0.7984299957752228) | > avg_loss_mel: 21.59165668487549 (-5.945738792419434) | > avg_loss_duration: 2.091808319091797 (-0.10272216796875) | > avg_loss_1: 31.940658569335938 (-7.475349426269531)  > EPOCH: 88/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:37:08)   --> TIME: 2023-10-20 00:37:22 -- STEP: 19/50 -- GLOBAL_STEP: 57420 | > loss_disc: 2.7723982334136963 (2.7254997178127893) | > loss_disc_real_0: 0.22614172101020813 (0.1855423213227799) | > loss_disc_real_1: 0.3907526135444641 (0.2253598751206147) | > loss_disc_real_2: 0.40245941281318665 (0.22152476032313548) | > loss_disc_real_3: 0.31762295961380005 (0.2517977635327138) | > loss_disc_real_4: 0.29567858576774597 (0.24498461814303146) | > loss_disc_real_5: 0.5592235326766968 (0.29471007303187724) | > loss_0: 2.7723982334136963 (2.7254997178127893) | > grad_norm_0: tensor(996.2314, device='cuda:0') (tensor(653.6450, device='cuda:0')) | > loss_gen: 3.355835437774658 (2.2180546333915307) | > loss_kl: 1.2427611351013184 (1.0684013460811816) | > loss_feat: 4.064844131469727 (4.472826571448853) | > loss_mel: 27.185626983642578 (25.516458260385615) | > loss_duration: 1.877441644668579 (1.8322750957388627) | > loss_1: 37.72650909423828 (35.10801546197189) | > grad_norm_1: tensor(18733.6387, device='cuda:0') (tensor(19102.8613, device='cuda:0')) | > current_lr_0: 0.00018315116792651365 | > current_lr_1: 0.00018315116792651365 | > step_time: 0.6247 (0.5242632815712378) | > loader_time: 0.0247 (0.018956397709093596)  --> TIME: 2023-10-20 00:37:38 -- STEP: 49/50 -- GLOBAL_STEP: 57450 | > loss_disc: 2.256880044937134 (2.564739991207513) | > loss_disc_real_0: 0.04736348241567612 (0.16144106071442363) | > loss_disc_real_1: 0.17679446935653687 (0.24079361633986843) | > loss_disc_real_2: 0.18527308106422424 (0.23560627207768206) | > loss_disc_real_3: 0.20675355195999146 (0.2502469675881522) | > loss_disc_real_4: 0.30784207582473755 (0.23769040428558175) | > loss_disc_real_5: 0.22985845804214478 (0.24749515982990974) | > loss_0: 2.256880044937134 (2.564739991207513) | > grad_norm_0: tensor(902.3069, device='cuda:0') (tensor(635.2264, device='cuda:0')) | > loss_gen: 2.7756783962249756 (2.3555762232566373) | > loss_kl: 0.9090149402618408 (1.0676005142075673) | > loss_feat: 6.797410011291504 (4.747462234554851) | > loss_mel: 26.07636833190918 (25.03673561251893) | > loss_duration: 1.9225903749465942 (1.78526741631177) | > loss_1: 38.48106002807617 (34.99264176037845) | > grad_norm_1: tensor(33727.5195, device='cuda:0') (tensor(18260.9688, device='cuda:0')) | > current_lr_0: 0.00018315116792651365 | > current_lr_1: 0.00018315116792651365 | > step_time: 0.4531 (0.5021731172289168) | > loader_time: 0.2471 (0.023804630552019392)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.615487813949585 (2.615487813949585) | > loss_disc_real_0: 0.1181337758898735 (0.1181337758898735) | > loss_disc_real_1: 0.29473793506622314 (0.29473793506622314) | > loss_disc_real_2: 0.3575676679611206 (0.3575676679611206) | > loss_disc_real_3: 0.3044176399707794 (0.3044176399707794) | > loss_disc_real_4: 0.17620491981506348 (0.17620491981506348) | > loss_disc_real_5: 0.1765020191669464 (0.1765020191669464) | > loss_0: 2.615487813949585 (2.615487813949585) | > loss_gen: 2.887277603149414 (2.887277603149414) | > loss_kl: 1.8293402194976807 (1.8293402194976807) | > loss_feat: 4.222142219543457 (4.222142219543457) | > loss_mel: 27.67804527282715 (27.67804527282715) | > loss_duration: 2.0490915775299072 (2.0490915775299072) | > loss_1: 38.665897369384766 (38.665897369384766)  --> STEP: 1 | > loss_disc: 2.032986640930176 (2.032986640930176) | > loss_disc_real_0: 0.07577061653137207 (0.07577061653137207) | > loss_disc_real_1: 0.05155564099550247 (0.05155564099550247) | > loss_disc_real_2: 0.1494373083114624 (0.1494373083114624) | > loss_disc_real_3: 0.18377332389354706 (0.18377332389354706) | > loss_disc_real_4: 0.07301604002714157 (0.07301604002714157) | > loss_disc_real_5: 0.08360370248556137 (0.08360370248556137) | > loss_0: 2.032986640930176 (2.032986640930176) | > loss_gen: 2.064631462097168 (2.064631462097168) | > loss_kl: 3.200101375579834 (3.200101375579834) | > loss_feat: 8.460907936096191 (8.460907936096191) | > loss_mel: 26.484546661376953 (26.484546661376953) | > loss_duration: 2.218071460723877 (2.218071460723877) | > loss_1: 42.42825698852539 (42.42825698852539)  --> STEP: 2 | > loss_disc: 3.223618984222412 (2.628302812576294) | > loss_disc_real_0: 0.4469676613807678 (0.26136913895606995) | > loss_disc_real_1: 0.25960874557495117 (0.15558219328522682) | > loss_disc_real_2: 0.3338504731655121 (0.24164389073848724) | > loss_disc_real_3: 0.2623845934867859 (0.22307895869016647) | > loss_disc_real_4: 0.31015604734420776 (0.19158604368567467) | > loss_disc_real_5: 0.3375931680202484 (0.2105984352529049) | > loss_0: 3.223618984222412 (2.628302812576294) | > loss_gen: 2.3127009868621826 (2.1886662244796753) | > loss_kl: 2.509104013442993 (2.8546026945114136) | > loss_feat: 3.897223949432373 (6.179065942764282) | > loss_mel: 30.70004653930664 (28.592296600341797) | > loss_duration: 2.145659923553467 (2.181865692138672) | > loss_1: 41.56473922729492 (41.996498107910156)  --> STEP: 3 | > loss_disc: 3.2651922702789307 (2.840599298477173) | > loss_disc_real_0: 0.22524325549602509 (0.24932717780272165) | > loss_disc_real_1: 0.2294379323720932 (0.18020077298084894) | > loss_disc_real_2: 0.3061119616031647 (0.2631332476933797) | > loss_disc_real_3: 0.16367869079113007 (0.20327886939048767) | > loss_disc_real_4: 0.2940388023853302 (0.2257369632522265) | > loss_disc_real_5: 0.3670852482318878 (0.2627607062458992) | > loss_0: 3.2651922702789307 (2.840599298477173) | > loss_gen: 1.7877211570739746 (2.055017868677775) | > loss_kl: 0.9901208281517029 (2.2331087390581765) | > loss_feat: 3.787287712097168 (5.381806532541911) | > loss_mel: 25.8188533782959 (27.667815526326496) | > loss_duration: 2.1057136058807373 (2.156481663386027) | > loss_1: 34.48969650268555 (39.49423090616862) --> EVAL PERFORMANCE | > avg_loader_time: 0.0061168670654296875 (+0.004332780838012695) | > avg_loss_disc: 2.840599298477173 (+0.191666841506958) | > avg_loss_disc_real_0: 0.24932717780272165 (+0.10927704473336536) | > avg_loss_disc_real_1: 0.18020077298084894 (-0.019775617867708206) | > avg_loss_disc_real_2: 0.2631332476933797 (+0.024979040026664706) | > avg_loss_disc_real_3: 0.20327886939048767 (-0.018974311649799347) | > avg_loss_disc_real_4: 0.2257369632522265 (-0.011112173398335784) | > avg_loss_disc_real_5: 0.2627607062458992 (+0.036003542443116515) | > avg_loss_0: 2.840599298477173 (+0.191666841506958) | > avg_loss_gen: 2.055017868677775 (+0.02983649571736624) | > avg_loss_kl: 2.2331087390581765 (+0.41595480839411403) | > avg_loss_feat: 5.381806532541911 (+0.9669474263985958) | > avg_loss_mel: 27.667815526326496 (+6.076158841451008) | > avg_loss_duration: 2.156481663386027 (+0.06467334429423) | > avg_loss_1: 39.49423090616862 (+7.55357233683268)  > EPOCH: 89/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:37:48)   --> TIME: 2023-10-20 00:38:06 -- STEP: 29/50 -- GLOBAL_STEP: 57480 | > loss_disc: 2.494925022125244 (2.347399649948909) | > loss_disc_real_0: 0.0895688384771347 (0.1678417570054017) | > loss_disc_real_1: 0.20025841891765594 (0.2410314483889218) | > loss_disc_real_2: 0.30118873715400696 (0.23204278894539543) | > loss_disc_real_3: 0.2622644007205963 (0.2308269600416052) | > loss_disc_real_4: 0.1703392118215561 (0.1969914048396308) | > loss_disc_real_5: 0.2419210523366928 (0.1908897190386879) | > loss_0: 2.494925022125244 (2.347399649948909) | > grad_norm_0: tensor(725.6514, device='cuda:0') (tensor(637.4238, device='cuda:0')) | > loss_gen: 2.1622767448425293 (2.6551008594447167) | > loss_kl: 1.115015983581543 (1.2096587337296585) | > loss_feat: 4.291434288024902 (6.176462775802817) | > loss_mel: 25.595848083496094 (25.250686694835796) | > loss_duration: 1.8208463191986084 (1.8287703292123203) | > loss_1: 34.98542022705078 (37.120679559378786) | > grad_norm_1: tensor(10341.9521, device='cuda:0') (tensor(27178.6699, device='cuda:0')) | > current_lr_0: 0.000182968096867194 | > current_lr_1: 0.000182968096867194 | > step_time: 0.5913 (0.4838748635916874) | > loader_time: 0.0236 (0.011250060180137897)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6339142322540283 (2.6339142322540283) | > loss_disc_real_0: 0.25849348306655884 (0.25849348306655884) | > loss_disc_real_1: 0.22998249530792236 (0.22998249530792236) | > loss_disc_real_2: 0.1886129230260849 (0.1886129230260849) | > loss_disc_real_3: 0.29335910081863403 (0.29335910081863403) | > loss_disc_real_4: 0.21016184985637665 (0.21016184985637665) | > loss_disc_real_5: 0.09091803431510925 (0.09091803431510925) | > loss_0: 2.6339142322540283 (2.6339142322540283) | > loss_gen: 2.0211145877838135 (2.0211145877838135) | > loss_kl: 2.157782554626465 (2.157782554626465) | > loss_feat: 4.893488883972168 (4.893488883972168) | > loss_mel: 23.526798248291016 (23.526798248291016) | > loss_duration: 2.007416009902954 (2.007416009902954) | > loss_1: 34.60660171508789 (34.60660171508789)  --> STEP: 1 | > loss_disc: 2.507956027984619 (2.507956027984619) | > loss_disc_real_0: 0.3836522698402405 (0.3836522698402405) | > loss_disc_real_1: 0.2981415390968323 (0.2981415390968323) | > loss_disc_real_2: 0.23535898327827454 (0.23535898327827454) | > loss_disc_real_3: 0.26339051127433777 (0.26339051127433777) | > loss_disc_real_4: 0.2350372076034546 (0.2350372076034546) | > loss_disc_real_5: 0.19493307173252106 (0.19493307173252106) | > loss_0: 2.507956027984619 (2.507956027984619) | > loss_gen: 2.670166492462158 (2.670166492462158) | > loss_kl: 2.9078400135040283 (2.9078400135040283) | > loss_feat: 4.171021461486816 (4.171021461486816) | > loss_mel: 24.02338981628418 (24.02338981628418) | > loss_duration: 2.1551971435546875 (2.1551971435546875) | > loss_1: 35.927616119384766 (35.927616119384766)  --> STEP: 2 | > loss_disc: 2.7502357959747314 (2.6290959119796753) | > loss_disc_real_0: 0.17636452615261078 (0.28000839799642563) | > loss_disc_real_1: 0.24966692924499512 (0.2739042341709137) | > loss_disc_real_2: 0.17815543711185455 (0.20675721019506454) | > loss_disc_real_3: 0.2693141996860504 (0.2663523554801941) | > loss_disc_real_4: 0.15822255611419678 (0.19662988185882568) | > loss_disc_real_5: 0.1547377109527588 (0.17483539134263992) | > loss_0: 2.7502357959747314 (2.6290959119796753) | > loss_gen: 1.8037919998168945 (2.2369792461395264) | > loss_kl: 2.584686279296875 (2.7462631464004517) | > loss_feat: 5.2479987144470215 (4.709510087966919) | > loss_mel: 24.187517166137695 (24.105453491210938) | > loss_duration: 2.151033639907837 (2.153115391731262) | > loss_1: 35.97502899169922 (35.95132255554199)  --> STEP: 3 | > loss_disc: 2.203648328781128 (2.4872800509134927) | > loss_disc_real_0: 0.45874232053756714 (0.33958637217680615) | > loss_disc_real_1: 0.20991632342338562 (0.25257493058840436) | > loss_disc_real_2: 0.3141413927078247 (0.24255193769931793) | > loss_disc_real_3: 0.17200729250907898 (0.23490400115648905) | > loss_disc_real_4: 0.2752927541732788 (0.22285083929697672) | > loss_disc_real_5: 0.18263721466064453 (0.17743599911530814) | > loss_0: 2.203648328781128 (2.4872800509134927) | > loss_gen: 3.154080867767334 (2.542679786682129) | > loss_kl: 1.3062833547592163 (2.26626988252004) | > loss_feat: 4.683578968048096 (4.7008663813273115) | > loss_mel: 22.99470329284668 (23.73520342508952) | > loss_duration: 2.060544967651367 (2.1222585837046304) | > loss_1: 34.199188232421875 (35.36727778116862) --> EVAL PERFORMANCE | > avg_loader_time: 0.011555353800455729 (+0.005438486735026041) | > avg_loss_disc: 2.4872800509134927 (-0.35331924756368016) | > avg_loss_disc_real_0: 0.33958637217680615 (+0.0902591943740845) | > avg_loss_disc_real_1: 0.25257493058840436 (+0.07237415760755542) | > avg_loss_disc_real_2: 0.24255193769931793 (-0.02058130999406177) | > avg_loss_disc_real_3: 0.23490400115648905 (+0.031625131766001374) | > avg_loss_disc_real_4: 0.22285083929697672 (-0.0028861239552497864) | > avg_loss_disc_real_5: 0.17743599911530814 (-0.08532470713059107) | > avg_loss_0: 2.4872800509134927 (-0.35331924756368016) | > avg_loss_gen: 2.542679786682129 (+0.487661918004354) | > avg_loss_kl: 2.26626988252004 (+0.033161143461863496) | > avg_loss_feat: 4.7008663813273115 (-0.6809401512145996) | > avg_loss_mel: 23.73520342508952 (-3.932612101236977) | > avg_loss_duration: 2.1222585837046304 (-0.034223079681396484) | > avg_loss_1: 35.36727778116862 (-4.126953125)  > EPOCH: 90/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:38:27)   --> TIME: 2023-10-20 00:38:35 -- STEP: 9/50 -- GLOBAL_STEP: 57510 | > loss_disc: 3.0126450061798096 (2.746326128641764) | > loss_disc_real_0: 0.21286341547966003 (0.19779879475633302) | > loss_disc_real_1: 0.25276675820350647 (0.23926487896177503) | > loss_disc_real_2: 0.1914745271205902 (0.2425275362200207) | > loss_disc_real_3: 0.30809640884399414 (0.25265197041961884) | > loss_disc_real_4: 0.30616188049316406 (0.2571510134471787) | > loss_disc_real_5: 0.2937391698360443 (0.28338875331812435) | > loss_0: 3.0126450061798096 (2.746326128641764) | > grad_norm_0: tensor(370.5182, device='cuda:0') (tensor(374.8991, device='cuda:0')) | > loss_gen: 1.5251072645187378 (2.0365117258495755) | > loss_kl: 1.0052471160888672 (1.0949224564764235) | > loss_feat: 0.10779671370983124 (3.637129647864236) | > loss_mel: 12.117764472961426 (17.626472844017876) | > loss_duration: 1.6679999828338623 (1.759587221675449) | > loss_1: 16.42391586303711 (26.154623985290527) | > grad_norm_1: tensor(11480., device='cuda:0') (tensor(15413.4043, device='cuda:0')) | > current_lr_0: 0.0001827852087988601 | > current_lr_1: 0.0001827852087988601 | > step_time: 0.5521 (0.5051125685373942) | > loader_time: 0.0098 (0.019187582863701716)  --> TIME: 2023-10-20 00:38:48 -- STEP: 39/50 -- GLOBAL_STEP: 57540 | > loss_disc: 2.9001009464263916 (2.536367127528557) | > loss_disc_real_0: 0.18050485849380493 (0.1960418646534284) | > loss_disc_real_1: 0.25203952193260193 (0.23738609751065573) | > loss_disc_real_2: 0.32359063625335693 (0.24397719288483635) | > loss_disc_real_3: 0.2314632683992386 (0.22152584695663208) | > loss_disc_real_4: 0.2429087907075882 (0.21913805842781678) | > loss_disc_real_5: 0.21966926753520966 (0.22828999443505055) | > loss_0: 2.9001009464263916 (2.536367127528557) | > grad_norm_0: tensor(460.9432, device='cuda:0') (tensor(447.8345, device='cuda:0')) | > loss_gen: 1.5877912044525146 (2.2501868223532653) | > loss_kl: 0.804069995880127 (1.0690244054182985) | > loss_feat: 0.45605456829071045 (4.494763294473673) | > loss_mel: 4.360228061676025 (21.77302455902099) | > loss_duration: 1.827028751373291 (1.795584736726223) | > loss_1: 9.035173416137695 (31.382584009415066) | > grad_norm_1: tensor(12052.2852, device='cuda:0') (tensor(16872.2949, device='cuda:0')) | > current_lr_0: 0.0001827852087988601 | > current_lr_1: 0.0001827852087988601 | > step_time: 0.3047 (0.4484908703045967) | > loader_time: 0.0247 (0.01713241674961188)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.420929431915283 (2.420929431915283) | > loss_disc_real_0: 0.031408704817295074 (0.031408704817295074) | > loss_disc_real_1: 0.3405243158340454 (0.3405243158340454) | > loss_disc_real_2: 0.20478194952011108 (0.20478194952011108) | > loss_disc_real_3: 0.41574913263320923 (0.41574913263320923) | > loss_disc_real_4: 0.20844799280166626 (0.20844799280166626) | > loss_disc_real_5: 0.1752244085073471 (0.1752244085073471) | > loss_0: 2.420929431915283 (2.420929431915283) | > loss_gen: 2.323056221008301 (2.323056221008301) | > loss_kl: 2.325378894805908 (2.325378894805908) | > loss_feat: 5.152735710144043 (5.152735710144043) | > loss_mel: 23.184907913208008 (23.184907913208008) | > loss_duration: 2.0207574367523193 (2.0207574367523193) | > loss_1: 35.0068359375 (35.0068359375)  --> STEP: 1 | > loss_disc: 2.2037248611450195 (2.2037248611450195) | > loss_disc_real_0: 0.10504228621721268 (0.10504228621721268) | > loss_disc_real_1: 0.3996284604072571 (0.3996284604072571) | > loss_disc_real_2: 0.3583071827888489 (0.3583071827888489) | > loss_disc_real_3: 0.11169108003377914 (0.11169108003377914) | > loss_disc_real_4: 0.33310896158218384 (0.33310896158218384) | > loss_disc_real_5: 0.1794317066669464 (0.1794317066669464) | > loss_0: 2.2037248611450195 (2.2037248611450195) | > loss_gen: 2.9792966842651367 (2.9792966842651367) | > loss_kl: 2.7350199222564697 (2.7350199222564697) | > loss_feat: 9.496416091918945 (9.496416091918945) | > loss_mel: 27.541316986083984 (27.541316986083984) | > loss_duration: 2.1565263271331787 (2.1565263271331787) | > loss_1: 44.908573150634766 (44.908573150634766)  --> STEP: 2 | > loss_disc: 2.9356689453125 (2.5696969032287598) | > loss_disc_real_0: 0.21131592988967896 (0.15817910805344582) | > loss_disc_real_1: 0.24311628937721252 (0.3213723748922348) | > loss_disc_real_2: 0.23838363587856293 (0.2983454093337059) | > loss_disc_real_3: 0.24768361449241638 (0.17968734726309776) | > loss_disc_real_4: 0.24350659549236298 (0.2883077785372734) | > loss_disc_real_5: 0.21784260869026184 (0.19863715767860413) | > loss_0: 2.9356689453125 (2.5696969032287598) | > loss_gen: 1.4708493947982788 (2.2250730395317078) | > loss_kl: 2.3544559478759766 (2.544737935066223) | > loss_feat: 0.16777607798576355 (4.832096084952354) | > loss_mel: 9.191999435424805 (18.366658210754395) | > loss_duration: 2.1950862407684326 (2.1758062839508057) | > loss_1: 15.380167007446289 (30.144370079040527)  --> STEP: 3 | > loss_disc: 2.4986660480499268 (2.546019951502482) | > loss_disc_real_0: 0.02188403531908989 (0.11274741714199384) | > loss_disc_real_1: 0.5603879690170288 (0.40104423960049945) | > loss_disc_real_2: 0.1908300817012787 (0.2625069667895635) | > loss_disc_real_3: 0.38005557656288147 (0.24647675702969232) | > loss_disc_real_4: 0.12055535614490509 (0.23239030440648398) | > loss_disc_real_5: 0.30285659432411194 (0.2333769698937734) | > loss_0: 2.4986660480499268 (2.546019951502482) | > loss_gen: 3.1016271114349365 (2.517257730166117) | > loss_kl: 1.5516204833984375 (2.2136987845102944) | > loss_feat: 6.664549827575684 (5.4429139991601305) | > loss_mel: 23.04079818725586 (19.924704869588215) | > loss_duration: 2.0773799419403076 (2.1429975032806396) | > loss_1: 36.435977935791016 (32.24157269795736) --> EVAL PERFORMANCE | > avg_loader_time: 0.013803958892822266 (+0.002248605092366537) | > avg_loss_disc: 2.546019951502482 (+0.05873990058898926) | > avg_loss_disc_real_0: 0.11274741714199384 (-0.22683895503481233) | > avg_loss_disc_real_1: 0.40104423960049945 (+0.1484693090120951) | > avg_loss_disc_real_2: 0.2625069667895635 (+0.019955029090245546) | > avg_loss_disc_real_3: 0.24647675702969232 (+0.011572755873203278) | > avg_loss_disc_real_4: 0.23239030440648398 (+0.009539465109507261) | > avg_loss_disc_real_5: 0.2333769698937734 (+0.05594097077846527) | > avg_loss_0: 2.546019951502482 (+0.05873990058898926) | > avg_loss_gen: 2.517257730166117 (-0.025422056516011704) | > avg_loss_kl: 2.2136987845102944 (-0.052571098009745576) | > avg_loss_feat: 5.4429139991601305 (+0.742047617832819) | > avg_loss_mel: 19.924704869588215 (-3.8104985555013045) | > avg_loss_duration: 2.1429975032806396 (+0.020738919576009263) | > avg_loss_1: 32.24157269795736 (-3.1257050832112583)  > EPOCH: 91/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:39:04)   --> TIME: 2023-10-20 00:39:18 -- STEP: 19/50 -- GLOBAL_STEP: 57570 | > loss_disc: 2.9293365478515625 (2.658568212860509) | > loss_disc_real_0: 0.20062631368637085 (0.18429095925469147) | > loss_disc_real_1: 0.2525671422481537 (0.2444487049391395) | > loss_disc_real_2: 0.27511534094810486 (0.2334837529220079) | > loss_disc_real_3: 0.26694074273109436 (0.23429262010674728) | > loss_disc_real_4: 0.22521065175533295 (0.2072740205024418) | > loss_disc_real_5: 0.2492760419845581 (0.25074126826305143) | > loss_0: 2.9293365478515625 (2.658568212860509) | > grad_norm_0: tensor(166.5517, device='cuda:0') (tensor(384.0491, device='cuda:0')) | > loss_gen: 1.5967223644256592 (2.213400734098334) | > loss_kl: 1.066664695739746 (1.065478403317301) | > loss_feat: 0.4506533741950989 (3.536542451499324) | > loss_mel: 18.580520629882812 (18.901258092177542) | > loss_duration: 1.9260447025299072 (1.8276296791277433) | > loss_1: 23.62060546875 (27.544309716475638) | > grad_norm_1: tensor(6881.2251, device='cuda:0') (tensor(18867.5273, device='cuda:0')) | > current_lr_0: 0.00018260250353860106 | > current_lr_1: 0.00018260250353860106 | > step_time: 0.5772 (0.4934610818561755) | > loader_time: 0.0036 (0.016922210392199065)  --> TIME: 2023-10-20 00:39:34 -- STEP: 49/50 -- GLOBAL_STEP: 57600 | > loss_disc: 2.595123291015625 (2.336031704532855) | > loss_disc_real_0: 0.06816376745700836 (0.141000973250793) | > loss_disc_real_1: 0.24659064412117004 (0.22601645934034367) | > loss_disc_real_2: 0.16196195781230927 (0.20297923083512154) | > loss_disc_real_3: 0.21330048143863678 (0.22813332445767462) | > loss_disc_real_4: 0.178911954164505 (0.18305616339250486) | > loss_disc_real_5: 0.3107457160949707 (0.18799586742356122) | > loss_0: 2.595123291015625 (2.336031704532855) | > grad_norm_0: tensor(691.1440, device='cuda:0') (tensor(512.9108, device='cuda:0')) | > loss_gen: 2.4962196350097656 (2.4868936806308968) | > loss_kl: 0.8834943771362305 (1.046036355957693) | > loss_feat: 7.478518009185791 (5.558111767151526) | > loss_mel: 35.552146911621094 (23.090384488203092) | > loss_duration: 1.9389710426330566 (1.787628869621121) | > loss_1: 48.3493537902832 (33.9690555261106) | > grad_norm_1: tensor(33365.4453, device='cuda:0') (tensor(21540.3496, device='cuda:0')) | > current_lr_0: 0.00018260250353860106 | > current_lr_1: 0.00018260250353860106 | > step_time: 0.3892 (0.4963120781645483) | > loader_time: 0.2573 (0.023862605192223375)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.475905418395996 (2.475905418395996) | > loss_disc_real_0: 0.12549324333667755 (0.12549324333667755) | > loss_disc_real_1: 0.29291900992393494 (0.29291900992393494) | > loss_disc_real_2: 0.2967965602874756 (0.2967965602874756) | > loss_disc_real_3: 0.26114046573638916 (0.26114046573638916) | > loss_disc_real_4: 0.2047770917415619 (0.2047770917415619) | > loss_disc_real_5: 0.13688650727272034 (0.13688650727272034) | > loss_0: 2.475905418395996 (2.475905418395996) | > loss_gen: 2.261428117752075 (2.261428117752075) | > loss_kl: 1.9280086755752563 (1.9280086755752563) | > loss_feat: 5.459127902984619 (5.459127902984619) | > loss_mel: 25.851272583007812 (25.851272583007812) | > loss_duration: 2.0178027153015137 (2.0178027153015137) | > loss_1: 37.517642974853516 (37.517642974853516)  --> STEP: 1 | > loss_disc: 2.932781219482422 (2.932781219482422) | > loss_disc_real_0: 0.07260499894618988 (0.07260499894618988) | > loss_disc_real_1: 0.29600805044174194 (0.29600805044174194) | > loss_disc_real_2: 0.2533544600009918 (0.2533544600009918) | > loss_disc_real_3: 0.28711819648742676 (0.28711819648742676) | > loss_disc_real_4: 0.34686681628227234 (0.34686681628227234) | > loss_disc_real_5: 0.391303688287735 (0.391303688287735) | > loss_0: 2.932781219482422 (2.932781219482422) | > loss_gen: 2.0218770503997803 (2.0218770503997803) | > loss_kl: 2.79592227935791 (2.79592227935791) | > loss_feat: 6.545069217681885 (6.545069217681885) | > loss_mel: 25.33500099182129 (25.33500099182129) | > loss_duration: 2.18672513961792 (2.18672513961792) | > loss_1: 38.88459777832031 (38.88459777832031)  --> STEP: 2 | > loss_disc: 2.3134138584136963 (2.623097538948059) | > loss_disc_real_0: 0.013844095170497894 (0.04322454705834389) | > loss_disc_real_1: 0.19751787185668945 (0.2467629611492157) | > loss_disc_real_2: 0.1281445324420929 (0.19074949622154236) | > loss_disc_real_3: 0.21980760991573334 (0.25346290320158005) | > loss_disc_real_4: 0.07314172387123108 (0.2100042700767517) | > loss_disc_real_5: 0.24488180875778198 (0.3180927485227585) | > loss_0: 2.3134138584136963 (2.623097538948059) | > loss_gen: 2.2738540172576904 (2.1478655338287354) | > loss_kl: 2.2916243076324463 (2.5437732934951782) | > loss_feat: 10.220751762390137 (8.38291049003601) | > loss_mel: 26.911544799804688 (26.12327289581299) | > loss_duration: 2.185682773590088 (2.186203956604004) | > loss_1: 43.88345718383789 (41.3840274810791)  --> STEP: 3 | > loss_disc: 1.738545536994934 (2.3282468716303506) | > loss_disc_real_0: 0.09984265267848969 (0.06209724893172582) | > loss_disc_real_1: 0.1649281233549118 (0.21948468188444772) | > loss_disc_real_2: 0.12507469952106476 (0.16885789732138315) | > loss_disc_real_3: 0.06643944978713989 (0.19112175206343332) | > loss_disc_real_4: 0.038748107850551605 (0.15291888266801834) | > loss_disc_real_5: 0.05164983868598938 (0.22927844524383545) | > loss_0: 1.738545536994934 (2.3282468716303506) | > loss_gen: 2.1973390579223633 (2.1643567085266113) | > loss_kl: 1.6123875379562378 (2.2333113749821982) | > loss_feat: 9.458579063415527 (8.741466681162516) | > loss_mel: 27.966808319091797 (26.73778470357259) | > loss_duration: 2.143951177597046 (2.172119696935018) | > loss_1: 43.37906265258789 (42.04903920491537) --> EVAL PERFORMANCE | > avg_loader_time: 0.01512447992960612 (+0.0013205210367838536) | > avg_loss_disc: 2.3282468716303506 (-0.21777307987213135) | > avg_loss_disc_real_0: 0.06209724893172582 (-0.050650168210268014) | > avg_loss_disc_real_1: 0.21948468188444772 (-0.18155955771605173) | > avg_loss_disc_real_2: 0.16885789732138315 (-0.09364906946818033) | > avg_loss_disc_real_3: 0.19112175206343332 (-0.055355004966259) | > avg_loss_disc_real_4: 0.15291888266801834 (-0.07947142173846564) | > avg_loss_disc_real_5: 0.22927844524383545 (-0.004098524649937957) | > avg_loss_0: 2.3282468716303506 (-0.21777307987213135) | > avg_loss_gen: 2.1643567085266113 (-0.3529010216395059) | > avg_loss_kl: 2.2333113749821982 (+0.01961259047190378) | > avg_loss_feat: 8.741466681162516 (+3.298552682002385) | > avg_loss_mel: 26.73778470357259 (+6.813079833984375) | > avg_loss_duration: 2.172119696935018 (+0.029122193654378403) | > avg_loss_1: 42.04903920491537 (+9.807466506958008)  > EPOCH: 92/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:39:44)   --> TIME: 2023-10-20 00:40:01 -- STEP: 29/50 -- GLOBAL_STEP: 57630 | > loss_disc: 2.7447142601013184 (2.608566243073036) | > loss_disc_real_0: 0.1891476809978485 (0.17781919382255654) | > loss_disc_real_1: 0.220391184091568 (0.2584548417864174) | > loss_disc_real_2: 0.2951173782348633 (0.2642085025536603) | > loss_disc_real_3: 0.2504694163799286 (0.24997658192597585) | > loss_disc_real_4: 0.2841668725013733 (0.2372278388718079) | > loss_disc_real_5: 0.3112868070602417 (0.26190910154375535) | > loss_0: 2.7447142601013184 (2.608566243073036) | > grad_norm_0: tensor(1107.8207, device='cuda:0') (tensor(628.5906, device='cuda:0')) | > loss_gen: 2.047032356262207 (2.4193689206550855) | > loss_kl: 1.173821210861206 (1.2713928839256023) | > loss_feat: 3.727857828140259 (5.262190719102991) | > loss_mel: 18.715234756469727 (24.755318025062824) | > loss_duration: 1.8192025423049927 (1.8284140044245227) | > loss_1: 27.48314666748047 (35.53668443087874) | > grad_norm_1: tensor(4394.3564, device='cuda:0') (tensor(19084.0176, device='cuda:0')) | > current_lr_0: 0.00018241998090368867 | > current_lr_1: 0.00018241998090368867 | > step_time: 0.2692 (0.4286729220686288) | > loader_time: 0.0018 (0.010202827124760068)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4228034019470215 (2.4228034019470215) | > loss_disc_real_0: 0.11304561793804169 (0.11304561793804169) | > loss_disc_real_1: 0.15676333010196686 (0.15676333010196686) | > loss_disc_real_2: 0.14009302854537964 (0.14009302854537964) | > loss_disc_real_3: 0.1740884780883789 (0.1740884780883789) | > loss_disc_real_4: 0.2421799898147583 (0.2421799898147583) | > loss_disc_real_5: 0.166721373796463 (0.166721373796463) | > loss_0: 2.4228034019470215 (2.4228034019470215) | > loss_gen: 1.9542131423950195 (1.9542131423950195) | > loss_kl: 2.8307416439056396 (2.8307416439056396) | > loss_feat: 5.153610706329346 (5.153610706329346) | > loss_mel: 23.19841766357422 (23.19841766357422) | > loss_duration: 2.04966139793396 (2.04966139793396) | > loss_1: 35.186641693115234 (35.186641693115234)  --> STEP: 1 | > loss_disc: 2.926300525665283 (2.926300525665283) | > loss_disc_real_0: 0.2011532038450241 (0.2011532038450241) | > loss_disc_real_1: 0.29252442717552185 (0.29252442717552185) | > loss_disc_real_2: 0.279413640499115 (0.279413640499115) | > loss_disc_real_3: 0.2104787677526474 (0.2104787677526474) | > loss_disc_real_4: 0.31310418248176575 (0.31310418248176575) | > loss_disc_real_5: 0.24703823029994965 (0.24703823029994965) | > loss_0: 2.926300525665283 (2.926300525665283) | > loss_gen: 1.644445776939392 (1.644445776939392) | > loss_kl: 3.1882712841033936 (3.1882712841033936) | > loss_feat: 0.24178196489810944 (0.24178196489810944) | > loss_mel: 14.040952682495117 (14.040952682495117) | > loss_duration: 2.2569103240966797 (2.2569103240966797) | > loss_1: 21.37236213684082 (21.37236213684082)  --> STEP: 2 | > loss_disc: 2.5880208015441895 (2.7571606636047363) | > loss_disc_real_0: 0.02622094377875328 (0.1136870738118887) | > loss_disc_real_1: 0.047931309789419174 (0.1702278684824705) | > loss_disc_real_2: 0.09796348959207535 (0.18868856504559517) | > loss_disc_real_3: 0.14648476243019104 (0.17848176509141922) | > loss_disc_real_4: 0.020117102190852165 (0.16661064233630896) | > loss_disc_real_5: 0.13015858829021454 (0.1885984092950821) | > loss_0: 2.5880208015441895 (2.7571606636047363) | > loss_gen: 1.358107566833496 (1.501276671886444) | > loss_kl: 2.655970335006714 (2.9221208095550537) | > loss_feat: 11.972672462463379 (6.107227213680744) | > loss_mel: 27.949270248413086 (20.9951114654541) | > loss_duration: 2.230030059814453 (2.2434701919555664) | > loss_1: 46.16604995727539 (33.769206047058105)  --> STEP: 3 | > loss_disc: 2.6264474391937256 (2.713589588801066) | > loss_disc_real_0: 0.2646380662918091 (0.16400407130519548) | > loss_disc_real_1: 0.38378164172172546 (0.24141245956222215) | > loss_disc_real_2: 0.32049551606178284 (0.2326242153843244) | > loss_disc_real_3: 0.18325896561145782 (0.1800741652647654) | > loss_disc_real_4: 0.33171823620796204 (0.2216465069601933) | > loss_disc_real_5: 0.37885841727256775 (0.25201841195424396) | > loss_0: 2.6264474391937256 (2.713589588801066) | > loss_gen: 2.8173398971557617 (1.9399644136428833) | > loss_kl: 0.7596660256385803 (2.2013025482495627) | > loss_feat: 4.377630710601807 (5.530695045987765) | > loss_mel: 23.522865295410156 (21.837696075439453) | > loss_duration: 2.1540756225585938 (2.2136720021565757) | > loss_1: 33.63157653808594 (33.72332954406738) --> EVAL PERFORMANCE | > avg_loader_time: 0.010507901509602865 (-0.004616578420003254) | > avg_loss_disc: 2.713589588801066 (+0.38534271717071533) | > avg_loss_disc_real_0: 0.16400407130519548 (+0.10190682237346965) | > avg_loss_disc_real_1: 0.24141245956222215 (+0.02192777767777443) | > avg_loss_disc_real_2: 0.2326242153843244 (+0.06376631806294125) | > avg_loss_disc_real_3: 0.1800741652647654 (-0.011047586798667908) | > avg_loss_disc_real_4: 0.2216465069601933 (+0.06872762429217497) | > avg_loss_disc_real_5: 0.25201841195424396 (+0.02273996671040851) | > avg_loss_0: 2.713589588801066 (+0.38534271717071533) | > avg_loss_gen: 1.9399644136428833 (-0.22439229488372803) | > avg_loss_kl: 2.2013025482495627 (-0.0320088267326355) | > avg_loss_feat: 5.530695045987765 (-3.2107716351747504) | > avg_loss_mel: 21.837696075439453 (-4.900088628133137) | > avg_loss_duration: 2.2136720021565757 (+0.04155230522155762) | > avg_loss_1: 33.72332954406738 (-8.325709660847984)  > EPOCH: 93/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:40:20)   --> TIME: 2023-10-20 00:40:28 -- STEP: 9/50 -- GLOBAL_STEP: 57660 | > loss_disc: 1.5022214651107788 (2.1095843182669745) | > loss_disc_real_0: 0.10507012903690338 (0.11360972291893429) | > loss_disc_real_1: 0.1827097237110138 (0.202660428153144) | > loss_disc_real_2: 0.09787049144506454 (0.19827812165021896) | > loss_disc_real_3: 0.09761921316385269 (0.19554992765188217) | > loss_disc_real_4: 0.198886439204216 (0.20889946363038486) | > loss_disc_real_5: 0.10229898244142532 (0.20010887997017968) | > loss_0: 1.5022214651107788 (2.1095843182669745) | > grad_norm_0: tensor(654.3555, device='cuda:0') (tensor(510.5280, device='cuda:0')) | > loss_gen: 3.106250047683716 (2.702679223484463) | > loss_kl: 1.2308619022369385 (0.9289838638570573) | > loss_feat: 7.737639904022217 (6.902693377600776) | > loss_mel: 25.89733123779297 (25.344026565551758) | > loss_duration: 1.6854064464569092 (1.7881038983662922) | > loss_1: 39.65748977661133 (37.66648695203993) | > grad_norm_1: tensor(29383.5527, device='cuda:0') (tensor(22463.4609, device='cuda:0')) | > current_lr_0: 0.00018223764071157749 | > current_lr_1: 0.00018223764071157749 | > step_time: 0.5918 (0.5039018789927164) | > loader_time: 0.0252 (0.02201570404900445)  --> TIME: 2023-10-20 00:40:43 -- STEP: 39/50 -- GLOBAL_STEP: 57690 | > loss_disc: 2.0117270946502686 (2.377364024137839) | > loss_disc_real_0: 0.2765151262283325 (0.14017620845100823) | > loss_disc_real_1: 0.2836988866329193 (0.23560940732176489) | > loss_disc_real_2: 0.34697258472442627 (0.22392202149599028) | > loss_disc_real_3: 0.2864091396331787 (0.23376506409392908) | > loss_disc_real_4: 0.1541121006011963 (0.19515631658335528) | > loss_disc_real_5: 0.0511295460164547 (0.2341376122755882) | > loss_0: 2.0117270946502686 (2.377364024137839) | > grad_norm_0: tensor(379.7265, device='cuda:0') (tensor(614.8746, device='cuda:0')) | > loss_gen: 3.126176118850708 (2.6674511982844424) | > loss_kl: 1.0821915864944458 (1.1558593106575505) | > loss_feat: 8.455001831054688 (6.282660014354265) | > loss_mel: 28.40021324157715 (25.429554321827034) | > loss_duration: 1.8688733577728271 (1.7977348810587175) | > loss_1: 42.932456970214844 (37.333260267208786) | > grad_norm_1: tensor(21062.3906, device='cuda:0') (tensor(20414.7461, device='cuda:0')) | > current_lr_0: 0.00018223764071157749 | > current_lr_1: 0.00018223764071157749 | > step_time: 0.2746 (0.47525609456575835) | > loader_time: 0.0036 (0.018699670449281346)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.409165143966675 (2.409165143966675) | > loss_disc_real_0: 0.19662103056907654 (0.19662103056907654) | > loss_disc_real_1: 0.16046687960624695 (0.16046687960624695) | > loss_disc_real_2: 0.3753506541252136 (0.3753506541252136) | > loss_disc_real_3: 0.26095300912857056 (0.26095300912857056) | > loss_disc_real_4: 0.31299638748168945 (0.31299638748168945) | > loss_disc_real_5: 0.19304926693439484 (0.19304926693439484) | > loss_0: 2.409165143966675 (2.409165143966675) | > loss_gen: 2.628614664077759 (2.628614664077759) | > loss_kl: 2.329582929611206 (2.329582929611206) | > loss_feat: 5.1219682693481445 (5.1219682693481445) | > loss_mel: 27.100444793701172 (27.100444793701172) | > loss_duration: 1.9801021814346313 (1.9801021814346313) | > loss_1: 39.16071319580078 (39.16071319580078)  --> STEP: 1 | > loss_disc: 2.8586955070495605 (2.8586955070495605) | > loss_disc_real_0: 0.12676791846752167 (0.12676791846752167) | > loss_disc_real_1: 0.32808899879455566 (0.32808899879455566) | > loss_disc_real_2: 0.4045111835002899 (0.4045111835002899) | > loss_disc_real_3: 0.2591259181499481 (0.2591259181499481) | > loss_disc_real_4: 0.22425730526447296 (0.22425730526447296) | > loss_disc_real_5: 0.2552690804004669 (0.2552690804004669) | > loss_0: 2.8586955070495605 (2.8586955070495605) | > loss_gen: 2.2498040199279785 (2.2498040199279785) | > loss_kl: 2.48215389251709 (2.48215389251709) | > loss_feat: 5.090945720672607 (5.090945720672607) | > loss_mel: 30.774303436279297 (30.774303436279297) | > loss_duration: 2.2002687454223633 (2.2002687454223633) | > loss_1: 42.79747772216797 (42.79747772216797)  --> STEP: 2 | > loss_disc: 2.6146867275238037 (2.736691117286682) | > loss_disc_real_0: 0.0844707265496254 (0.10561932250857353) | > loss_disc_real_1: 0.285422682762146 (0.30675584077835083) | > loss_disc_real_2: 0.2501528263092041 (0.327332004904747) | > loss_disc_real_3: 0.263979434967041 (0.26155267655849457) | > loss_disc_real_4: 0.3698059618473053 (0.29703163355588913) | > loss_disc_real_5: 0.3908836841583252 (0.32307638227939606) | > loss_0: 2.6146867275238037 (2.736691117286682) | > loss_gen: 2.331254482269287 (2.290529251098633) | > loss_kl: 2.6101088523864746 (2.5461313724517822) | > loss_feat: 2.927896499633789 (4.009421110153198) | > loss_mel: 26.33519172668457 (28.554747581481934) | > loss_duration: 2.1590638160705566 (2.17966628074646) | > loss_1: 36.36351776123047 (39.58049774169922)  --> STEP: 3 | > loss_disc: 3.0158839225769043 (2.8297553857167563) | > loss_disc_real_0: 0.18969105184078217 (0.1336432322859764) | > loss_disc_real_1: 0.2827693819999695 (0.2987603545188904) | > loss_disc_real_2: 0.3384133279323578 (0.33102577924728394) | > loss_disc_real_3: 0.2222425788640976 (0.24844931066036224) | > loss_disc_real_4: 0.36002394556999207 (0.31802907089392346) | > loss_disc_real_5: 0.45726215839385986 (0.36780497431755066) | > loss_0: 3.0158839225769043 (2.8297553857167563) | > loss_gen: 2.0448760986328125 (2.2086448669433594) | > loss_kl: 1.3546910285949707 (2.1489845911661782) | > loss_feat: 3.208710193634033 (3.7425174713134766) | > loss_mel: 33.30360794067383 (30.1377010345459) | > loss_duration: 2.0892152786254883 (2.149515946706136) | > loss_1: 42.0010986328125 (40.38736470540365) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027290980021158853 (-0.00777880350748698) | > avg_loss_disc: 2.8297553857167563 (+0.1161657969156904) | > avg_loss_disc_real_0: 0.1336432322859764 (-0.03036083901921907) | > avg_loss_disc_real_1: 0.2987603545188904 (+0.05734789495666823) | > avg_loss_disc_real_2: 0.33102577924728394 (+0.09840156386295953) | > avg_loss_disc_real_3: 0.24844931066036224 (+0.06837514539559683) | > avg_loss_disc_real_4: 0.31802907089392346 (+0.09638256393373015) | > avg_loss_disc_real_5: 0.36780497431755066 (+0.1157865623633067) | > avg_loss_0: 2.8297553857167563 (+0.1161657969156904) | > avg_loss_gen: 2.2086448669433594 (+0.2686804533004761) | > avg_loss_kl: 2.1489845911661782 (-0.05231795708338449) | > avg_loss_feat: 3.7425174713134766 (-1.7881775746742887) | > avg_loss_mel: 30.1377010345459 (+8.300004959106445) | > avg_loss_duration: 2.149515946706136 (-0.06415605545043945) | > avg_loss_1: 40.38736470540365 (+6.664035161336265)  > EPOCH: 94/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:40:58)   --> TIME: 2023-10-20 00:41:12 -- STEP: 19/50 -- GLOBAL_STEP: 57720 | > loss_disc: 2.0265345573425293 (2.4020891628767314) | > loss_disc_real_0: 0.07827933877706528 (0.16265459505743102) | > loss_disc_real_1: 0.21008941531181335 (0.2017901179037596) | > loss_disc_real_2: 0.1370987594127655 (0.21035010014709674) | > loss_disc_real_3: 0.06227383017539978 (0.24813202219574074) | > loss_disc_real_4: 0.18795987963676453 (0.22946958910477788) | > loss_disc_real_5: 0.16769719123840332 (0.24506651247410402) | > loss_0: 2.0265345573425293 (2.4020891628767314) | > grad_norm_0: tensor(330.9068, device='cuda:0') (tensor(606.8633, device='cuda:0')) | > loss_gen: 2.4021055698394775 (2.467116274331745) | > loss_kl: 0.9442768096923828 (1.1702285659940619) | > loss_feat: 6.3339667320251465 (4.913867205381393) | > loss_mel: 21.864402770996094 (23.72346225537752) | > loss_duration: 1.9163204431533813 (1.8394186183025962) | > loss_1: 33.4610710144043 (34.11409317819696) | > grad_norm_1: tensor(15065.8281, device='cuda:0') (tensor(22112.9902, device='cuda:0')) | > current_lr_0: 0.00018205548277990452 | > current_lr_1: 0.00018205548277990452 | > step_time: 0.5885 (0.5058654233029014) | > loader_time: 0.0245 (0.018206696761281865)  --> TIME: 2023-10-20 00:41:28 -- STEP: 49/50 -- GLOBAL_STEP: 57750 | > loss_disc: 2.8113527297973633 (2.4235201684796084) | > loss_disc_real_0: 0.19418472051620483 (0.15822529817494202) | > loss_disc_real_1: 0.1760152280330658 (0.22050283225823422) | > loss_disc_real_2: 0.215143620967865 (0.20468874199658024) | > loss_disc_real_3: 0.24877910315990448 (0.24692894259885867) | > loss_disc_real_4: 0.2637418508529663 (0.22276908820685076) | > loss_disc_real_5: 0.311566025018692 (0.21915094102067606) | > loss_0: 2.8113527297973633 (2.4235201684796084) | > grad_norm_0: tensor(561.8480, device='cuda:0') (tensor(636.5584, device='cuda:0')) | > loss_gen: 2.426997661590576 (2.4757789568025235) | > loss_kl: 1.0555472373962402 (1.1034834427492959) | > loss_feat: 5.331600189208984 (5.4597315575395315) | > loss_mel: 29.90858268737793 (25.282906824228714) | > loss_duration: 1.8800628185272217 (1.794363021850586) | > loss_1: 40.60279083251953 (36.11626399293237) | > grad_norm_1: tensor(11969.6543, device='cuda:0') (tensor(18756.3613, device='cuda:0')) | > current_lr_0: 0.00018205548277990452 | > current_lr_1: 0.00018205548277990452 | > step_time: 0.4194 (0.49451707820503077) | > loader_time: 0.2704 (0.02416324615478516)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1611952781677246 (3.1611952781677246) | > loss_disc_real_0: 0.140669584274292 (0.140669584274292) | > loss_disc_real_1: 0.313318133354187 (0.313318133354187) | > loss_disc_real_2: 0.2973264157772064 (0.2973264157772064) | > loss_disc_real_3: 0.3110268712043762 (0.3110268712043762) | > loss_disc_real_4: 0.39821067452430725 (0.39821067452430725) | > loss_disc_real_5: 0.37167924642562866 (0.37167924642562866) | > loss_0: 3.1611952781677246 (3.1611952781677246) | > loss_gen: 1.8217318058013916 (1.8217318058013916) | > loss_kl: 1.9674546718597412 (1.9674546718597412) | > loss_feat: 0.23421554267406464 (0.23421554267406464) | > loss_mel: 3.630159378051758 (3.630159378051758) | > loss_duration: 2.01511549949646 (2.01511549949646) | > loss_1: 9.66867733001709 (9.66867733001709)  --> STEP: 1 | > loss_disc: 2.5315113067626953 (2.5315113067626953) | > loss_disc_real_0: 0.35624033212661743 (0.35624033212661743) | > loss_disc_real_1: 0.3037814795970917 (0.3037814795970917) | > loss_disc_real_2: 0.27496808767318726 (0.27496808767318726) | > loss_disc_real_3: 0.26642757654190063 (0.26642757654190063) | > loss_disc_real_4: 0.29723668098449707 (0.29723668098449707) | > loss_disc_real_5: 0.3156145513057709 (0.3156145513057709) | > loss_0: 2.5315113067626953 (2.5315113067626953) | > loss_gen: 2.934532403945923 (2.934532403945923) | > loss_kl: 2.7925658226013184 (2.7925658226013184) | > loss_feat: 3.228036403656006 (3.228036403656006) | > loss_mel: 22.866188049316406 (22.866188049316406) | > loss_duration: 2.1729936599731445 (2.1729936599731445) | > loss_1: 33.99431610107422 (33.99431610107422)  --> STEP: 2 | > loss_disc: 2.458265542984009 (2.494888424873352) | > loss_disc_real_0: 0.2231786549091339 (0.28970949351787567) | > loss_disc_real_1: 0.27042585611343384 (0.28710366785526276) | > loss_disc_real_2: 0.40830156207084656 (0.3416348248720169) | > loss_disc_real_3: 0.38174039125442505 (0.32408398389816284) | > loss_disc_real_4: 0.22077463567256927 (0.2590056583285332) | > loss_disc_real_5: 0.20719586312770844 (0.26140520721673965) | > loss_0: 2.458265542984009 (2.494888424873352) | > loss_gen: 2.9344136714935303 (2.9344730377197266) | > loss_kl: 2.5279810428619385 (2.6602734327316284) | > loss_feat: 5.491381645202637 (4.359709024429321) | > loss_mel: 26.36980438232422 (24.617996215820312) | > loss_duration: 2.221282958984375 (2.1971383094787598) | > loss_1: 39.544864654541016 (36.76959037780762)  --> STEP: 3 | > loss_disc: 3.1613121032714844 (2.717029651006063) | > loss_disc_real_0: 0.14066869020462036 (0.24002922574679056) | > loss_disc_real_1: 0.31331613659858704 (0.29584115743637085) | > loss_disc_real_2: 0.29718175530433655 (0.3268171350161235) | > loss_disc_real_3: 0.31102433800697327 (0.31973076860109967) | > loss_disc_real_4: 0.39823678135871887 (0.3054160326719284) | > loss_disc_real_5: 0.3717893958091736 (0.29819993674755096) | > loss_0: 3.1613121032714844 (2.717029651006063) | > loss_gen: 1.82162344455719 (2.5635231733322144) | > loss_kl: 1.2508845329284668 (2.190477132797241) | > loss_feat: 0.2336343377828598 (2.9843507955471673) | > loss_mel: 4.134250640869141 (17.790081024169922) | > loss_duration: 2.1180360317230225 (2.1707708835601807) | > loss_1: 9.558428764343262 (27.6992031733195) --> EVAL PERFORMANCE | > avg_loader_time: 0.011953989664713541 (+0.009224891662597656) | > avg_loss_disc: 2.717029651006063 (-0.11272573471069336) | > avg_loss_disc_real_0: 0.24002922574679056 (+0.10638599346081415) | > avg_loss_disc_real_1: 0.29584115743637085 (-0.0029191970825195312) | > avg_loss_disc_real_2: 0.3268171350161235 (-0.004208644231160463) | > avg_loss_disc_real_3: 0.31973076860109967 (+0.07128145794073742) | > avg_loss_disc_real_4: 0.3054160326719284 (-0.012613038221995054) | > avg_loss_disc_real_5: 0.29819993674755096 (-0.0696050375699997) | > avg_loss_0: 2.717029651006063 (-0.11272573471069336) | > avg_loss_gen: 2.5635231733322144 (+0.354878306388855) | > avg_loss_kl: 2.190477132797241 (+0.041492541631062974) | > avg_loss_feat: 2.9843507955471673 (-0.7581666757663093) | > avg_loss_mel: 17.790081024169922 (-12.347620010375977) | > avg_loss_duration: 2.1707708835601807 (+0.02125493685404445) | > avg_loss_1: 27.6992031733195 (-12.688161532084148)  > EPOCH: 95/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:41:38)   --> TIME: 2023-10-20 00:41:54 -- STEP: 29/50 -- GLOBAL_STEP: 57780 | > loss_disc: 2.8364648818969727 (2.4582561542247903) | > loss_disc_real_0: 0.12513285875320435 (0.17710702130892153) | > loss_disc_real_1: 0.28014805912971497 (0.23779879574631824) | > loss_disc_real_2: 0.39458751678466797 (0.24774269759655) | > loss_disc_real_3: 0.3758525550365448 (0.2667151394075361) | > loss_disc_real_4: 0.1471906304359436 (0.2174756191670895) | > loss_disc_real_5: 0.17891615629196167 (0.21061991932320184) | > loss_0: 2.8364648818969727 (2.4582561542247903) | > grad_norm_0: tensor(227.7594, device='cuda:0') (tensor(539.8367, device='cuda:0')) | > loss_gen: 2.013214349746704 (2.4737203696678423) | > loss_kl: 0.6486945748329163 (1.1540673806749537) | > loss_feat: 5.117905139923096 (5.44046438562459) | > loss_mel: 23.26307487487793 (25.13152921610865) | > loss_duration: 1.8010132312774658 (1.8190975682488804) | > loss_1: 32.843902587890625 (36.018879101194166) | > grad_norm_1: tensor(4332.4180, device='cuda:0') (tensor(17177.4824, device='cuda:0')) | > current_lr_0: 0.00018187350692648908 | > current_lr_1: 0.00018187350692648908 | > step_time: 0.375 (0.3970149467731344) | > loader_time: 0.0034 (0.00999211442881617)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.729339599609375 (3.729339599609375) | > loss_disc_real_0: 0.40705546736717224 (0.40705546736717224) | > loss_disc_real_1: 0.2976170778274536 (0.2976170778274536) | > loss_disc_real_2: 0.22197021543979645 (0.22197021543979645) | > loss_disc_real_3: 0.35419726371765137 (0.35419726371765137) | > loss_disc_real_4: 0.34576696157455444 (0.34576696157455444) | > loss_disc_real_5: 0.31106066703796387 (0.31106066703796387) | > loss_0: 3.729339599609375 (3.729339599609375) | > loss_gen: 2.293898344039917 (2.293898344039917) | > loss_kl: 1.468528151512146 (1.468528151512146) | > loss_feat: 4.641722679138184 (4.641722679138184) | > loss_mel: 24.938879013061523 (24.938879013061523) | > loss_duration: 2.043062210083008 (2.043062210083008) | > loss_1: 35.38609313964844 (35.38609313964844)  --> STEP: 1 | > loss_disc: 2.263045072555542 (2.263045072555542) | > loss_disc_real_0: 0.19112436473369598 (0.19112436473369598) | > loss_disc_real_1: 0.18070091307163239 (0.18070091307163239) | > loss_disc_real_2: 0.12534116208553314 (0.12534116208553314) | > loss_disc_real_3: 0.22111250460147858 (0.22111250460147858) | > loss_disc_real_4: 0.2445208728313446 (0.2445208728313446) | > loss_disc_real_5: 0.22902153432369232 (0.22902153432369232) | > loss_0: 2.263045072555542 (2.263045072555542) | > loss_gen: 3.5542337894439697 (3.5542337894439697) | > loss_kl: 2.6568000316619873 (2.6568000316619873) | > loss_feat: 6.847908973693848 (6.847908973693848) | > loss_mel: 25.40535545349121 (25.40535545349121) | > loss_duration: 2.1756062507629395 (2.1756062507629395) | > loss_1: 40.6399040222168 (40.6399040222168)  --> STEP: 2 | > loss_disc: 2.913393497467041 (2.5882192850112915) | > loss_disc_real_0: 0.21789860725402832 (0.20451148599386215) | > loss_disc_real_1: 0.3543904721736908 (0.2675456926226616) | > loss_disc_real_2: 0.1354292929172516 (0.13038522750139236) | > loss_disc_real_3: 0.32261011004447937 (0.271861307322979) | > loss_disc_real_4: 0.24294203519821167 (0.24373145401477814) | > loss_disc_real_5: 0.3112247586250305 (0.2701231464743614) | > loss_0: 2.913393497467041 (2.5882192850112915) | > loss_gen: 2.7044906616210938 (3.1293622255325317) | > loss_kl: 2.474165439605713 (2.56548273563385) | > loss_feat: 5.0158867835998535 (5.931897878646851) | > loss_mel: 33.28812789916992 (29.346741676330566) | > loss_duration: 2.2262136936187744 (2.200909972190857) | > loss_1: 45.708885192871094 (43.174394607543945)  --> STEP: 3 | > loss_disc: 2.2705137729644775 (2.4823174476623535) | > loss_disc_real_0: 0.2150593101978302 (0.20802742739518484) | > loss_disc_real_1: 0.3115532696247101 (0.28221488495667774) | > loss_disc_real_2: 0.21855312585830688 (0.1597745269536972) | > loss_disc_real_3: 0.3238048255443573 (0.28917581339677173) | > loss_disc_real_4: 0.13122612237930298 (0.2062296768029531) | > loss_disc_real_5: 0.4511735141277313 (0.33047326902548474) | > loss_0: 2.2705137729644775 (2.4823174476623535) | > loss_gen: 3.4107494354248047 (3.2231579621632895) | > loss_kl: 1.503652811050415 (2.2115394274393716) | > loss_feat: 4.987028121948242 (5.6169412930806475) | > loss_mel: 22.614585876464844 (27.102689743041992) | > loss_duration: 2.122086524963379 (2.1746354897816977) | > loss_1: 34.638099670410156 (40.32896296183268) --> EVAL PERFORMANCE | > avg_loader_time: 0.007906277974446615 (-0.004047711690266926) | > avg_loss_disc: 2.4823174476623535 (-0.23471220334370946) | > avg_loss_disc_real_0: 0.20802742739518484 (-0.032001798351605715) | > avg_loss_disc_real_1: 0.28221488495667774 (-0.013626272479693113) | > avg_loss_disc_real_2: 0.1597745269536972 (-0.16704260806242627) | > avg_loss_disc_real_3: 0.28917581339677173 (-0.030554955204327938) | > avg_loss_disc_real_4: 0.2062296768029531 (-0.09918635586897531) | > avg_loss_disc_real_5: 0.33047326902548474 (+0.032273332277933775) | > avg_loss_0: 2.4823174476623535 (-0.23471220334370946) | > avg_loss_gen: 3.2231579621632895 (+0.6596347888310752) | > avg_loss_kl: 2.2115394274393716 (+0.021062294642130386) | > avg_loss_feat: 5.6169412930806475 (+2.63259049753348) | > avg_loss_mel: 27.102689743041992 (+9.31260871887207) | > avg_loss_duration: 2.1746354897816977 (+0.003864606221517075) | > avg_loss_1: 40.32896296183268 (+12.62975978851318)  > EPOCH: 96/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:42:15)   --> TIME: 2023-10-20 00:42:24 -- STEP: 9/50 -- GLOBAL_STEP: 57810 | > loss_disc: 2.1489996910095215 (2.695009152094523) | > loss_disc_real_0: 0.06695626676082611 (0.1625588954322868) | > loss_disc_real_1: 0.24259823560714722 (0.2500802551706632) | > loss_disc_real_2: 0.25558844208717346 (0.23155261534783575) | > loss_disc_real_3: 0.2594890296459198 (0.2502830285165045) | > loss_disc_real_4: 0.10848502069711685 (0.22098029487662846) | > loss_disc_real_5: 0.04137657955288887 (0.251846222517391) | > loss_0: 2.1489996910095215 (2.695009152094523) | > grad_norm_0: tensor(639.3511, device='cuda:0') (tensor(688.9837, device='cuda:0')) | > loss_gen: 2.242985725402832 (2.2328027884165444) | > loss_kl: 0.6585855484008789 (1.0925365289052327) | > loss_feat: 3.6291821002960205 (5.077714184919993) | > loss_mel: 19.1958065032959 (23.137624104817707) | > loss_duration: 1.6925777196884155 (1.7854215568966336) | > loss_1: 27.41913604736328 (33.32609833611382) | > grad_norm_1: tensor(7063.3662, device='cuda:0') (tensor(19047.6191, device='cuda:0')) | > current_lr_0: 0.00018169171296933244 | > current_lr_1: 0.00018169171296933244 | > step_time: 0.2883 (0.5081093046400282) | > loader_time: 0.0063 (0.01802404721577962)  --> TIME: 2023-10-20 00:42:39 -- STEP: 39/50 -- GLOBAL_STEP: 57840 | > loss_disc: 1.6984437704086304 (2.509750191981976) | > loss_disc_real_0: 0.016624629497528076 (0.1886801268809881) | > loss_disc_real_1: 0.11379086971282959 (0.23592056945348397) | > loss_disc_real_2: 0.058491479605436325 (0.22172292407888633) | > loss_disc_real_3: 0.15537501871585846 (0.24744877811425767) | > loss_disc_real_4: 0.06791014224290848 (0.2070712962975869) | > loss_disc_real_5: 0.02753053978085518 (0.21429444226221397) | > loss_0: 1.6984437704086304 (2.509750191981976) | > grad_norm_0: tensor(641.3906, device='cuda:0') (tensor(729.4682, device='cuda:0')) | > loss_gen: 2.3001861572265625 (2.3749305498905673) | > loss_kl: 0.864743709564209 (1.1082640229127345) | > loss_feat: 8.35253620147705 (5.0613604715237255) | > loss_mel: 26.094768524169922 (25.069079490808342) | > loss_duration: 1.7827757596969604 (1.793523290218451) | > loss_1: 39.39501190185547 (35.40715770232371) | > grad_norm_1: tensor(23392.9023, device='cuda:0') (tensor(17378.7871, device='cuda:0')) | > current_lr_0: 0.00018169171296933244 | > current_lr_1: 0.00018169171296933244 | > step_time: 0.2642 (0.47609601265344864) | > loader_time: 0.0042 (0.017292010478484318)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0233428478240967 (3.0233428478240967) | > loss_disc_real_0: 0.3197745680809021 (0.3197745680809021) | > loss_disc_real_1: 0.24837300181388855 (0.24837300181388855) | > loss_disc_real_2: 0.28550228476524353 (0.28550228476524353) | > loss_disc_real_3: 0.19514106214046478 (0.19514106214046478) | > loss_disc_real_4: 0.29767942428588867 (0.29767942428588867) | > loss_disc_real_5: 0.27675381302833557 (0.27675381302833557) | > loss_0: 3.0233428478240967 (3.0233428478240967) | > loss_gen: 1.7604329586029053 (1.7604329586029053) | > loss_kl: 1.9354671239852905 (1.9354671239852905) | > loss_feat: 2.1099891662597656 (2.1099891662597656) | > loss_mel: 17.4787654876709 (17.4787654876709) | > loss_duration: 2.014308214187622 (2.014308214187622) | > loss_1: 25.29896354675293 (25.29896354675293)  --> STEP: 1 | > loss_disc: 2.530559778213501 (2.530559778213501) | > loss_disc_real_0: 0.3460158705711365 (0.3460158705711365) | > loss_disc_real_1: 0.327800989151001 (0.327800989151001) | > loss_disc_real_2: 0.2847089171409607 (0.2847089171409607) | > loss_disc_real_3: 0.27472057938575745 (0.27472057938575745) | > loss_disc_real_4: 0.21313536167144775 (0.21313536167144775) | > loss_disc_real_5: 0.4143825173377991 (0.4143825173377991) | > loss_0: 2.530559778213501 (2.530559778213501) | > loss_gen: 3.181881904602051 (3.181881904602051) | > loss_kl: 2.375911235809326 (2.375911235809326) | > loss_feat: 6.814947128295898 (6.814947128295898) | > loss_mel: 23.723073959350586 (23.723073959350586) | > loss_duration: 2.1642205715179443 (2.1642205715179443) | > loss_1: 38.260032653808594 (38.260032653808594)  --> STEP: 2 | > loss_disc: 1.8114795684814453 (2.171019673347473) | > loss_disc_real_0: 0.2078670859336853 (0.2769414782524109) | > loss_disc_real_1: 0.19914031028747559 (0.2634706497192383) | > loss_disc_real_2: 0.07587119191884995 (0.18029005452990532) | > loss_disc_real_3: 0.11680915206670761 (0.19576486572623253) | > loss_disc_real_4: 0.17871472239494324 (0.1959250420331955) | > loss_disc_real_5: 0.33777928352355957 (0.3760809004306793) | > loss_0: 1.8114795684814453 (2.171019673347473) | > loss_gen: 3.0101144313812256 (3.095998167991638) | > loss_kl: 2.924614191055298 (2.650262713432312) | > loss_feat: 10.064274787902832 (8.439610958099365) | > loss_mel: 30.776813507080078 (27.249943733215332) | > loss_duration: 2.152308940887451 (2.1582647562026978) | > loss_1: 48.928123474121094 (43.594078063964844)  --> STEP: 3 | > loss_disc: 3.012467861175537 (2.4515024026234946) | > loss_disc_real_0: 0.3175145983695984 (0.2904658516248067) | > loss_disc_real_1: 0.28951263427734375 (0.27215131123860675) | > loss_disc_real_2: 0.31010890007019043 (0.22356300304333368) | > loss_disc_real_3: 0.2647629380226135 (0.21876422315835953) | > loss_disc_real_4: 0.35665085911750793 (0.24950031439463297) | > loss_disc_real_5: 0.35649895668029785 (0.3695535858472188) | > loss_0: 3.012467861175537 (2.4515024026234946) | > loss_gen: 1.9609038829803467 (2.7176334063212075) | > loss_kl: 1.1971995830535889 (2.1659083366394043) | > loss_feat: 0.35305747389793396 (5.744093130032222) | > loss_mel: 18.93939971923828 (24.47976239522298) | > loss_duration: 2.084341287612915 (2.1336236000061035) | > loss_1: 24.534900665283203 (37.24101893107096) --> EVAL PERFORMANCE | > avg_loader_time: 0.00224455197652181 (-0.005661725997924805) | > avg_loss_disc: 2.4515024026234946 (-0.0308150450388589) | > avg_loss_disc_real_0: 0.2904658516248067 (+0.08243842422962186) | > avg_loss_disc_real_1: 0.27215131123860675 (-0.010063573718070984) | > avg_loss_disc_real_2: 0.22356300304333368 (+0.06378847608963648) | > avg_loss_disc_real_3: 0.21876422315835953 (-0.0704115902384122) | > avg_loss_disc_real_4: 0.24950031439463297 (+0.04327063759167987) | > avg_loss_disc_real_5: 0.3695535858472188 (+0.039080316821734074) | > avg_loss_0: 2.4515024026234946 (-0.0308150450388589) | > avg_loss_gen: 2.7176334063212075 (-0.505524555842082) | > avg_loss_kl: 2.1659083366394043 (-0.0456310907999673) | > avg_loss_feat: 5.744093130032222 (+0.12715183695157428) | > avg_loss_mel: 24.47976239522298 (-2.6229273478190116) | > avg_loss_duration: 2.1336236000061035 (-0.041011889775594224) | > avg_loss_1: 37.24101893107096 (-3.0879440307617188)  > EPOCH: 97/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:42:54)   --> TIME: 2023-10-20 00:43:10 -- STEP: 19/50 -- GLOBAL_STEP: 57870 | > loss_disc: 1.7113171815872192 (2.5564182934008146) | > loss_disc_real_0: 0.06340982019901276 (0.1633388051076939) | > loss_disc_real_1: 0.07319336384534836 (0.24246868216677717) | > loss_disc_real_2: 0.20521903038024902 (0.2557882000937274) | > loss_disc_real_3: 0.16899916529655457 (0.24358106669234603) | > loss_disc_real_4: 0.08009023219347 (0.25386031873916326) | > loss_disc_real_5: 0.04183987155556679 (0.24717080495075175) | > loss_0: 1.7113171815872192 (2.5564182934008146) | > grad_norm_0: tensor(1210.8562, device='cuda:0') (tensor(640.8520, device='cuda:0')) | > loss_gen: 2.693389415740967 (2.599571165285612) | > loss_kl: 1.3166241645812988 (1.1362463235855103) | > loss_feat: 7.966574192047119 (4.970869832917264) | > loss_mel: 21.45033836364746 (23.460178826984606) | > loss_duration: 1.9134215116500854 (1.8395134022361355) | > loss_1: 35.34034729003906 (34.006379202792516) | > grad_norm_1: tensor(68882.3594, device='cuda:0') (tensor(27634.5059, device='cuda:0')) | > current_lr_0: 0.000181510100726618 | > current_lr_1: 0.000181510100726618 | > step_time: 0.5807 (0.514876265274851) | > loader_time: 0.0243 (0.018378082074617084)  --> TIME: 2023-10-20 00:43:26 -- STEP: 49/50 -- GLOBAL_STEP: 57900 | > loss_disc: 2.7838709354400635 (2.471867245070789) | > loss_disc_real_0: 0.3620625138282776 (0.16347238018500562) | > loss_disc_real_1: 0.22634446620941162 (0.22252207325429332) | > loss_disc_real_2: 0.3306256830692291 (0.2351535691366512) | > loss_disc_real_3: 0.17316989600658417 (0.22951089693423438) | > loss_disc_real_4: 0.1879337728023529 (0.22987148198014012) | > loss_disc_real_5: 0.1836184859275818 (0.226765192056797) | > loss_0: 2.7838709354400635 (2.471867245070789) | > grad_norm_0: tensor(1235.7108, device='cuda:0') (tensor(866.4577, device='cuda:0')) | > loss_gen: 2.1234371662139893 (2.487502784145122) | > loss_kl: 0.9593636989593506 (1.1327300649516436) | > loss_feat: 3.614516258239746 (5.019802170444507) | > loss_mel: 26.77741241455078 (22.819225754056657) | > loss_duration: 1.9071929454803467 (1.7815444250496066) | > loss_1: 35.381919860839844 (33.24080483767453) | > grad_norm_1: tensor(13212.9951, device='cuda:0') (tensor(28796.3125, device='cuda:0')) | > current_lr_0: 0.000181510100726618 | > current_lr_1: 0.000181510100726618 | > step_time: 0.4831 (0.4978796559937147) | > loader_time: 0.2769 (0.023279447944796812)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.738077402114868 (2.738077402114868) | > loss_disc_real_0: 0.35478121042251587 (0.35478121042251587) | > loss_disc_real_1: 0.3155587911605835 (0.3155587911605835) | > loss_disc_real_2: 0.336792528629303 (0.336792528629303) | > loss_disc_real_3: 0.2794530391693115 (0.2794530391693115) | > loss_disc_real_4: 0.16214294731616974 (0.16214294731616974) | > loss_disc_real_5: 0.1489345133304596 (0.1489345133304596) | > loss_0: 2.738077402114868 (2.738077402114868) | > loss_gen: 2.2525529861450195 (2.2525529861450195) | > loss_kl: 1.837087631225586 (1.837087631225586) | > loss_feat: 2.646056890487671 (2.646056890487671) | > loss_mel: 21.67849349975586 (21.67849349975586) | > loss_duration: 2.056704521179199 (2.056704521179199) | > loss_1: 30.470897674560547 (30.470897674560547)  --> STEP: 1 | > loss_disc: 2.24428391456604 (2.24428391456604) | > loss_disc_real_0: 0.07994898408651352 (0.07994898408651352) | > loss_disc_real_1: 0.15445388853549957 (0.15445388853549957) | > loss_disc_real_2: 0.11639534682035446 (0.11639534682035446) | > loss_disc_real_3: 0.1169123649597168 (0.1169123649597168) | > loss_disc_real_4: 0.3268793821334839 (0.3268793821334839) | > loss_disc_real_5: 0.18902157247066498 (0.18902157247066498) | > loss_0: 2.24428391456604 (2.24428391456604) | > loss_gen: 2.565650701522827 (2.565650701522827) | > loss_kl: 2.7419216632843018 (2.7419216632843018) | > loss_feat: 9.800537109375 (9.800537109375) | > loss_mel: 26.906963348388672 (26.906963348388672) | > loss_duration: 2.232398271560669 (2.232398271560669) | > loss_1: 44.24747085571289 (44.24747085571289)  --> STEP: 2 | > loss_disc: 3.066652297973633 (2.6554681062698364) | > loss_disc_real_0: 0.5077078938484192 (0.29382843896746635) | > loss_disc_real_1: 0.30298519134521484 (0.2287195399403572) | > loss_disc_real_2: 0.4087206721305847 (0.2625580094754696) | > loss_disc_real_3: 0.2720952033996582 (0.1945037841796875) | > loss_disc_real_4: 0.24903416633605957 (0.28795677423477173) | > loss_disc_real_5: 0.27517515420913696 (0.23209836333990097) | > loss_0: 3.066652297973633 (2.6554681062698364) | > loss_gen: 2.236359119415283 (2.401004910469055) | > loss_kl: 2.6812546253204346 (2.711588144302368) | > loss_feat: 0.46119385957717896 (5.1308654844760895) | > loss_mel: 24.17621612548828 (25.541589736938477) | > loss_duration: 2.2173359394073486 (2.224867105484009) | > loss_1: 31.77235984802246 (38.009915351867676)  --> STEP: 3 | > loss_disc: 2.9510576725006104 (2.7539979616800943) | > loss_disc_real_0: 0.24781440198421478 (0.27849042663971585) | > loss_disc_real_1: 0.3187881410121918 (0.25874240696430206) | > loss_disc_real_2: 0.3801513612270355 (0.30175579339265823) | > loss_disc_real_3: 0.30327141284942627 (0.23075966040293375) | > loss_disc_real_4: 0.2424090951681137 (0.27277421454588574) | > loss_disc_real_5: 0.34846869111061096 (0.2708884725968043) | > loss_0: 2.9510576725006104 (2.7539979616800943) | > loss_gen: 2.2363805770874023 (2.346130132675171) | > loss_kl: 1.461705207824707 (2.2949604988098145) | > loss_feat: 3.730454921722412 (4.664061963558197) | > loss_mel: 24.10085678100586 (25.06134541829427) | > loss_duration: 2.13131046295166 (2.193681557973226) | > loss_1: 33.66070556640625 (36.56017875671387) --> EVAL PERFORMANCE | > avg_loader_time: 0.009524345397949219 (+0.007279793421427408) | > avg_loss_disc: 2.7539979616800943 (+0.30249555905659964) | > avg_loss_disc_real_0: 0.27849042663971585 (-0.011975424985090855) | > avg_loss_disc_real_1: 0.25874240696430206 (-0.01340890427430469) | > avg_loss_disc_real_2: 0.30175579339265823 (+0.07819279034932455) | > avg_loss_disc_real_3: 0.23075966040293375 (+0.01199543724457422) | > avg_loss_disc_real_4: 0.27277421454588574 (+0.023273900151252774) | > avg_loss_disc_real_5: 0.2708884725968043 (-0.0986651132504145) | > avg_loss_0: 2.7539979616800943 (+0.30249555905659964) | > avg_loss_gen: 2.346130132675171 (-0.37150327364603664) | > avg_loss_kl: 2.2949604988098145 (+0.12905216217041016) | > avg_loss_feat: 4.664061963558197 (-1.0800311664740248) | > avg_loss_mel: 25.06134541829427 (+0.5815830230712891) | > avg_loss_duration: 2.193681557973226 (+0.060057957967122544) | > avg_loss_1: 36.56017875671387 (-0.680840174357094)  > EPOCH: 98/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:43:36)   --> TIME: 2023-10-20 00:43:51 -- STEP: 29/50 -- GLOBAL_STEP: 57930 | > loss_disc: 2.578991651535034 (2.53459056903576) | > loss_disc_real_0: 0.03850327059626579 (0.19522989200877733) | > loss_disc_real_1: 0.3237355947494507 (0.28525264342797213) | > loss_disc_real_2: 0.20223020017147064 (0.25201100753299116) | > loss_disc_real_3: 0.2073771208524704 (0.21898969712442365) | > loss_disc_real_4: 0.1449161022901535 (0.25126188152052203) | > loss_disc_real_5: 0.32354164123535156 (0.22438340557032618) | > loss_0: 2.578991651535034 (2.53459056903576) | > grad_norm_0: tensor(694.6505, device='cuda:0') (tensor(1080.5673, device='cuda:0')) | > loss_gen: 2.132106065750122 (2.50559925210887) | > loss_kl: 1.1983721256256104 (1.18390488830106) | > loss_feat: 5.500792980194092 (5.793188581500074) | > loss_mel: 23.472604751586914 (22.663965591068926) | > loss_duration: 1.7430870532989502 (1.792959949065899) | > loss_1: 34.04696273803711 (33.93961774891821) | > grad_norm_1: tensor(10405.8936, device='cuda:0') (tensor(44860.5156, device='cuda:0')) | > current_lr_0: 0.00018132867001671084 | > current_lr_1: 0.00018132867001671084 | > step_time: 0.3686 (0.39487583883877453) | > loader_time: 0.0019 (0.008809426735187403)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4479730129241943 (2.4479730129241943) | > loss_disc_real_0: 0.1039138212800026 (0.1039138212800026) | > loss_disc_real_1: 0.32680848240852356 (0.32680848240852356) | > loss_disc_real_2: 0.3108269274234772 (0.3108269274234772) | > loss_disc_real_3: 0.4915347397327423 (0.4915347397327423) | > loss_disc_real_4: 0.23784780502319336 (0.23784780502319336) | > loss_disc_real_5: 0.3216269910335541 (0.3216269910335541) | > loss_0: 2.4479730129241943 (2.4479730129241943) | > loss_gen: 3.7666115760803223 (3.7666115760803223) | > loss_kl: 2.0931806564331055 (2.0931806564331055) | > loss_feat: 5.447723865509033 (5.447723865509033) | > loss_mel: 26.4973087310791 (26.4973087310791) | > loss_duration: 2.010493516921997 (2.010493516921997) | > loss_1: 39.8153190612793 (39.8153190612793)  --> STEP: 1 | > loss_disc: 2.5340523719787598 (2.5340523719787598) | > loss_disc_real_0: 0.18592728674411774 (0.18592728674411774) | > loss_disc_real_1: 0.27832216024398804 (0.27832216024398804) | > loss_disc_real_2: 0.23840001225471497 (0.23840001225471497) | > loss_disc_real_3: 0.28803375363349915 (0.28803375363349915) | > loss_disc_real_4: 0.14964406192302704 (0.14964406192302704) | > loss_disc_real_5: 0.20796164870262146 (0.20796164870262146) | > loss_0: 2.5340523719787598 (2.5340523719787598) | > loss_gen: 2.4560394287109375 (2.4560394287109375) | > loss_kl: 2.571152687072754 (2.571152687072754) | > loss_feat: 4.317994594573975 (4.317994594573975) | > loss_mel: 23.785215377807617 (23.785215377807617) | > loss_duration: 2.163949966430664 (2.163949966430664) | > loss_1: 35.294349670410156 (35.294349670410156)  --> STEP: 2 | > loss_disc: 3.1218152046203613 (2.8279337882995605) | > loss_disc_real_0: 0.32724255323410034 (0.25658491998910904) | > loss_disc_real_1: 0.26482897996902466 (0.27157557010650635) | > loss_disc_real_2: 0.3491213917732239 (0.2937607020139694) | > loss_disc_real_3: 0.3066362142562866 (0.2973349839448929) | > loss_disc_real_4: 0.3019654452800751 (0.22580475360155106) | > loss_disc_real_5: 0.3843233585357666 (0.29614250361919403) | > loss_0: 3.1218152046203613 (2.8279337882995605) | > loss_gen: 1.8706170320510864 (2.163328230381012) | > loss_kl: 2.1389150619506836 (2.3550338745117188) | > loss_feat: 0.18324211239814758 (2.250618353486061) | > loss_mel: 3.5825483798980713 (13.683881878852844) | > loss_duration: 2.176499128341675 (2.1702245473861694) | > loss_1: 9.951821327209473 (22.623085498809814)  --> STEP: 3 | > loss_disc: 2.5252599716186523 (2.7270425160725913) | > loss_disc_real_0: 0.3841434121131897 (0.2991044173638026) | > loss_disc_real_1: 0.2839737832546234 (0.27570830782254535) | > loss_disc_real_2: 0.32092756032943726 (0.3028163214524587) | > loss_disc_real_3: 0.3552429974079132 (0.316637655099233) | > loss_disc_real_4: 0.21773333847522736 (0.2231142818927765) | > loss_disc_real_5: 0.343779981136322 (0.31202166279157) | > loss_0: 2.5252599716186523 (2.7270425160725913) | > loss_gen: 3.3622069358825684 (2.5629544655481973) | > loss_kl: 1.4165053367614746 (2.0421910285949707) | > loss_feat: 4.114828586578369 (2.8720217645168304) | > loss_mel: 25.917049407958984 (17.76160438855489) | > loss_duration: 2.091813802719116 (2.144087632497152) | > loss_1: 36.902400970458984 (27.38285732269287) --> EVAL PERFORMANCE | > avg_loader_time: 0.00840449333190918 (-0.001119852066040039) | > avg_loss_disc: 2.7270425160725913 (-0.02695544560750296) | > avg_loss_disc_real_0: 0.2991044173638026 (+0.02061399072408676) | > avg_loss_disc_real_1: 0.27570830782254535 (+0.016965900858243288) | > avg_loss_disc_real_2: 0.3028163214524587 (+0.0010605280598004474) | > avg_loss_disc_real_3: 0.316637655099233 (+0.08587799469629923) | > avg_loss_disc_real_4: 0.2231142818927765 (-0.04965993265310925) | > avg_loss_disc_real_5: 0.31202166279157 (+0.04113319019476569) | > avg_loss_0: 2.7270425160725913 (-0.02695544560750296) | > avg_loss_gen: 2.5629544655481973 (+0.21682433287302638) | > avg_loss_kl: 2.0421910285949707 (-0.25276947021484375) | > avg_loss_feat: 2.8720217645168304 (-1.7920401990413666) | > avg_loss_mel: 17.76160438855489 (-7.29974102973938) | > avg_loss_duration: 2.144087632497152 (-0.04959392547607422) | > avg_loss_1: 27.38285732269287 (-9.177321434020996)  > EPOCH: 99/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:44:11)   --> TIME: 2023-10-20 00:44:19 -- STEP: 9/50 -- GLOBAL_STEP: 57960 | > loss_disc: 3.04731822013855 (2.44283664226532) | > loss_disc_real_0: 0.15538015961647034 (0.16954796285265022) | > loss_disc_real_1: 0.31501105427742004 (0.2534796657661597) | > loss_disc_real_2: 0.2797468602657318 (0.25357968939675224) | > loss_disc_real_3: 0.3347472548484802 (0.25647713161177105) | > loss_disc_real_4: 0.22852559387683868 (0.17799203139212397) | > loss_disc_real_5: 0.30427008867263794 (0.2136423219409254) | > loss_0: 3.04731822013855 (2.44283664226532) | > grad_norm_0: tensor(702.4115, device='cuda:0') (tensor(755.2933, device='cuda:0')) | > loss_gen: 1.5563364028930664 (2.520664612452189) | > loss_kl: 1.0406609773635864 (0.8641360567675697) | > loss_feat: 0.11812588572502136 (5.642849908934699) | > loss_mel: 2.581881046295166 (20.763227462768555) | > loss_duration: 1.688806176185608 (1.7250292433632746) | > loss_1: 6.985810279846191 (31.51590739356147) | > grad_norm_1: tensor(30983.9336, device='cuda:0') (tensor(38146.1523, device='cuda:0')) | > current_lr_0: 0.00018114742065815752 | > current_lr_1: 0.00018114742065815752 | > step_time: 0.5228 (0.5254475805494521) | > loader_time: 0.0026 (0.017257399029201932)  --> TIME: 2023-10-20 00:44:36 -- STEP: 39/50 -- GLOBAL_STEP: 57990 | > loss_disc: 3.1648919582366943 (2.444200647182954) | > loss_disc_real_0: 0.019801650196313858 (0.1589542031288147) | > loss_disc_real_1: 0.2583070397377014 (0.2504496678518943) | > loss_disc_real_2: 0.22064867615699768 (0.22752204040686289) | > loss_disc_real_3: 0.2523982524871826 (0.2610980927562102) | > loss_disc_real_4: 0.2102447748184204 (0.20152969763447076) | > loss_disc_real_5: 0.2606271505355835 (0.21407721291940945) | > loss_0: 3.1648919582366943 (2.444200647182954) | > grad_norm_0: tensor(12755.0635, device='cuda:0') (tensor(1388.3892, device='cuda:0')) | > loss_gen: 1.5101596117019653 (2.554412413866092) | > loss_kl: 0.6907823085784912 (0.9615429441134137) | > loss_feat: 0.13378173112869263 (5.450147647792711) | > loss_mel: 2.482180118560791 (22.277603461192204) | > loss_duration: 1.7898811101913452 (1.7629556350218945) | > loss_1: 6.606784820556641 (33.006661953070214) | > grad_norm_1: tensor(59126.2109, device='cuda:0') (tensor(49474.2500, device='cuda:0')) | > current_lr_0: 0.00018114742065815752 | > current_lr_1: 0.00018114742065815752 | > step_time: 0.2748 (0.5201429709410056) | > loader_time: 0.0025 (0.018500859920795146)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9882075786590576 (2.9882075786590576) | > loss_disc_real_0: 0.34321385622024536 (0.34321385622024536) | > loss_disc_real_1: 0.2596951425075531 (0.2596951425075531) | > loss_disc_real_2: 0.25903114676475525 (0.25903114676475525) | > loss_disc_real_3: 0.260159432888031 (0.260159432888031) | > loss_disc_real_4: 0.24678052961826324 (0.24678052961826324) | > loss_disc_real_5: 0.2194313108921051 (0.2194313108921051) | > loss_0: 2.9882075786590576 (2.9882075786590576) | > loss_gen: 1.6091151237487793 (1.6091151237487793) | > loss_kl: 1.6108921766281128 (1.6108921766281128) | > loss_feat: 0.5072132349014282 (0.5072132349014282) | > loss_mel: 3.6355934143066406 (3.6355934143066406) | > loss_duration: 1.9818224906921387 (1.9818224906921387) | > loss_1: 9.344636917114258 (9.344636917114258)  --> STEP: 1 | > loss_disc: 2.65010929107666 (2.65010929107666) | > loss_disc_real_0: 0.14182808995246887 (0.14182808995246887) | > loss_disc_real_1: 0.31286102533340454 (0.31286102533340454) | > loss_disc_real_2: 0.2557593584060669 (0.2557593584060669) | > loss_disc_real_3: 0.3169800639152527 (0.3169800639152527) | > loss_disc_real_4: 0.18557009100914001 (0.18557009100914001) | > loss_disc_real_5: 0.3270609974861145 (0.3270609974861145) | > loss_0: 2.65010929107666 (2.65010929107666) | > loss_gen: 2.459672451019287 (2.459672451019287) | > loss_kl: 2.7060608863830566 (2.7060608863830566) | > loss_feat: 3.232473850250244 (3.232473850250244) | > loss_mel: 25.376998901367188 (25.376998901367188) | > loss_duration: 2.1900298595428467 (2.1900298595428467) | > loss_1: 35.965232849121094 (35.965232849121094)  --> STEP: 2 | > loss_disc: 2.6548352241516113 (2.6524722576141357) | > loss_disc_real_0: 0.31979256868362427 (0.23081032931804657) | > loss_disc_real_1: 0.3278990089893341 (0.3203800171613693) | > loss_disc_real_2: 0.1982225626707077 (0.2269909605383873) | > loss_disc_real_3: 0.2843845784664154 (0.30068232119083405) | > loss_disc_real_4: 0.1709606796503067 (0.17826538532972336) | > loss_disc_real_5: 0.1809336543083191 (0.2539973258972168) | > loss_0: 2.6548352241516113 (2.6524722576141357) | > loss_gen: 1.9736697673797607 (2.216671109199524) | > loss_kl: 2.361889123916626 (2.5339750051498413) | > loss_feat: 2.462190628051758 (2.847332239151001) | > loss_mel: 13.542789459228516 (19.45989418029785) | > loss_duration: 2.201969861984253 (2.19599986076355) | > loss_1: 22.54250717163086 (29.253870010375977)  --> STEP: 3 | > loss_disc: 2.8977320194244385 (2.7342255115509033) | > loss_disc_real_0: 0.3254018723964691 (0.26234084367752075) | > loss_disc_real_1: 0.2837621867656708 (0.3081740736961365) | > loss_disc_real_2: 0.30307093262672424 (0.25235095123449963) | > loss_disc_real_3: 0.2571178674697876 (0.2861608366171519) | > loss_disc_real_4: 0.2418271154165268 (0.19945262869199118) | > loss_disc_real_5: 0.2560522258281708 (0.2546822925408681) | > loss_0: 2.8977320194244385 (2.7342255115509033) | > loss_gen: 1.879908800125122 (2.104417006174723) | > loss_kl: 1.0386861562728882 (2.0355453888575235) | > loss_feat: 0.8988785743713379 (2.1978476842244468) | > loss_mel: 24.00313949584961 (20.97430928548177) | > loss_duration: 2.1198415756225586 (2.1706137657165527) | > loss_1: 29.94045639038086 (29.48273213704427) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_58000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0512611865997314 (2.8134844303131104) | > loss_disc_real_0: 0.33446067571640015 (0.2803708016872406) | > loss_disc_real_1: 0.2520953416824341 (0.2941543906927109) | > loss_disc_real_2: 0.26842349767684937 (0.25636908784508705) | > loss_disc_real_3: 0.26617753505706787 (0.2811650112271309) | > loss_disc_real_4: 0.21633045375347137 (0.20367208495736122) | > loss_disc_real_5: 0.18239212036132812 (0.23660974949598312) | > loss_0: 3.0512611865997314 (2.8134844303131104) | > loss_gen: 1.557685375213623 (1.9677340984344482) | > loss_kl: 1.428598403930664 (1.8838086426258087) | > loss_feat: 0.784827470779419 (1.8445926308631897) | > loss_mel: 21.235671997070312 (21.039649963378906) | > loss_duration: 2.068319320678711 (2.1450401544570923) | > loss_1: 27.075103759765625 (28.88082504272461)  --> STEP: 1 | > loss_disc: 2.0662336349487305 (2.6640342712402343) | > loss_disc_real_0: 0.027498936280608177 (0.22979642860591412) | > loss_disc_real_1: 0.2928943932056427 (0.29390239119529726) | > loss_disc_real_2: 0.13774773478507996 (0.23264481723308564) | > loss_disc_real_3: 0.31124579906463623 (0.28718116879463196) | > loss_disc_real_4: 0.12036466598510742 (0.18701060116291046) | > loss_disc_real_5: 0.27825918793678284 (0.24493963718414308) | > loss_0: 2.0662336349487305 (2.6640342712402343) | > loss_gen: 2.640012502670288 (2.102189779281616) | > loss_kl: 2.5341556072235107 (2.013878035545349) | > loss_feat: 6.62136697769165 (2.799947500228882) | > loss_mel: 26.78439712524414 (22.188599395751954) | > loss_duration: 2.1516690254211426 (2.146365928649902) | > loss_1: 40.731597900390625 (31.250979614257812)  --> STEP: 2 | > loss_disc: 2.0859076976776123 (2.567679842313131) | > loss_disc_real_0: 0.05582013726234436 (0.2008003800486525) | > loss_disc_real_1: 0.2722872197628021 (0.2902998626232147) | > loss_disc_real_2: 0.12389401346445084 (0.2145196832716465) | > loss_disc_real_3: 0.13012337684631348 (0.26100487013657886) | > loss_disc_real_4: 0.08529376238584518 (0.17005779470006624) | > loss_disc_real_5: 0.14086279273033142 (0.22759349644184113) | > loss_0: 2.0859076976776123 (2.567679842313131) | > loss_gen: 1.922531247138977 (2.0722466905911765) | > loss_kl: 2.3540120124816895 (2.070567031701406) | > loss_feat: 7.743748188018799 (3.623914281527201) | > loss_mel: 24.697372436523438 (22.606728235880535) | > loss_duration: 2.2187299728393555 (2.158426602681478) | > loss_1: 38.93639373779297 (32.531881968180336)  --> STEP: 3 | > loss_disc: 2.930792808532715 (2.619553123201643) | > loss_disc_real_0: 0.31981998682022095 (0.21780318101601942) | > loss_disc_real_1: 0.26467740535736084 (0.2866395115852356) | > loss_disc_real_2: 0.2559323012828827 (0.22043577155896596) | > loss_disc_real_3: 0.2671236991882324 (0.2618789885725294) | > loss_disc_real_4: 0.2424359917640686 (0.18039753713778087) | > loss_disc_real_5: 0.2205331027507782 (0.2265848687716893) | > loss_0: 2.930792808532715 (2.619553123201643) | > loss_gen: 1.6502509117126465 (2.011961579322815) | > loss_kl: 1.0818136930465698 (1.929316554750715) | > loss_feat: 0.3920972943305969 (3.162226140499115) | > loss_mel: 18.260822296142578 (21.985884530203684) | > loss_duration: 2.110847234725952 (2.151629550116403) | > loss_1: 23.495832443237305 (31.241017750331334) --> EVAL PERFORMANCE | > avg_loader_time: 0.2746973378317697 (+0.2662928444998605) | > avg_loss_disc: 2.619553123201643 (-0.10748939287094839) | > avg_loss_disc_real_0: 0.21780318101601942 (-0.08130123634778319) | > avg_loss_disc_real_1: 0.2866395115852356 (+0.010931203762690245) | > avg_loss_disc_real_2: 0.22043577155896596 (-0.08238054989349272) | > avg_loss_disc_real_3: 0.2618789885725294 (-0.05475866652670358) | > avg_loss_disc_real_4: 0.18039753713778087 (-0.04271674475499562) | > avg_loss_disc_real_5: 0.2265848687716893 (-0.08543679401988072) | > avg_loss_0: 2.619553123201643 (-0.10748939287094839) | > avg_loss_gen: 2.011961579322815 (-0.5509928862253823) | > avg_loss_kl: 1.929316554750715 (-0.11287447384425575) | > avg_loss_feat: 3.162226140499115 (+0.29020437598228455) | > avg_loss_mel: 21.985884530203684 (+4.224280141648794) | > avg_loss_duration: 2.151629550116403 (+0.007541917619251048) | > avg_loss_1: 31.241017750331334 (+3.858160427638463)  > EPOCH: 100/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:44:57)   --> TIME: 2023-10-20 00:45:10 -- STEP: 19/50 -- GLOBAL_STEP: 58020 | > loss_disc: 2.7679762840270996 (2.366646145519457) | > loss_disc_real_0: 0.44145962595939636 (0.16605437051896987) | > loss_disc_real_1: 0.26769423484802246 (0.23008938525852404) | > loss_disc_real_2: 0.18047085404396057 (0.22400581817093648) | > loss_disc_real_3: 0.2681499719619751 (0.24254521256998965) | > loss_disc_real_4: 0.24189873039722443 (0.19279341046747409) | > loss_disc_real_5: 0.27866074442863464 (0.20925303342703142) | > loss_0: 2.7679762840270996 (2.366646145519457) | > grad_norm_0: tensor(1645.0826, device='cuda:0') (tensor(1316.0829, device='cuda:0')) | > loss_gen: 2.351339817047119 (2.4557158946990967) | > loss_kl: 0.9348560571670532 (0.981586870394255) | > loss_feat: 2.9972524642944336 (5.541857546881626) | > loss_mel: 25.876018524169922 (26.001590929533307) | > loss_duration: 1.904535174369812 (1.8243064880371094) | > loss_1: 34.06399917602539 (36.805057425247995) | > grad_norm_1: tensor(13137.9678, device='cuda:0') (tensor(35980.9961, device='cuda:0')) | > current_lr_0: 0.00018096635246968594 | > current_lr_1: 0.00018096635246968594 | > step_time: 0.5045 (0.4988128386045757) | > loader_time: 0.0221 (0.019434728120502676)  --> TIME: 2023-10-20 00:45:26 -- STEP: 49/50 -- GLOBAL_STEP: 58050 | > loss_disc: 2.4216606616973877 (2.3444830933395693) | > loss_disc_real_0: 0.24201293289661407 (0.16606066085170118) | > loss_disc_real_1: 0.3044142425060272 (0.22706582617698884) | > loss_disc_real_2: 0.08168979734182358 (0.21878684701740134) | > loss_disc_real_3: 0.34776386618614197 (0.22653602516012533) | > loss_disc_real_4: 0.3054935336112976 (0.19980149214365045) | > loss_disc_real_5: 0.1987275779247284 (0.19850759398268195) | > loss_0: 2.4216606616973877 (2.3444830933395693) | > grad_norm_0: tensor(796.3734, device='cuda:0') (tensor(1223.8159, device='cuda:0')) | > loss_gen: 2.779071092605591 (2.5624016839630746) | > loss_kl: 0.5156013369560242 (1.0594222606444847) | > loss_feat: 4.389660358428955 (6.40895542259119) | > loss_mel: 24.81361961364746 (25.36672541559959) | > loss_duration: 1.875193476676941 (1.7701647232989877) | > loss_1: 34.373146057128906 (37.16766904324902) | > grad_norm_1: tensor(15151.4141, device='cuda:0') (tensor(43694.9844, device='cuda:0')) | > current_lr_0: 0.00018096635246968594 | > current_lr_1: 0.00018096635246968594 | > step_time: 0.689 (0.500973536043751) | > loader_time: 0.2873 (0.025146095120176976)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9268760681152344 (2.9268760681152344) | > loss_disc_real_0: 0.17304319143295288 (0.17304319143295288) | > loss_disc_real_1: 0.2892059087753296 (0.2892059087753296) | > loss_disc_real_2: 0.2626868188381195 (0.2626868188381195) | > loss_disc_real_3: 0.31296736001968384 (0.31296736001968384) | > loss_disc_real_4: 0.19359466433525085 (0.19359466433525085) | > loss_disc_real_5: 0.1806071549654007 (0.1806071549654007) | > loss_0: 2.9268760681152344 (2.9268760681152344) | > loss_gen: 1.5203520059585571 (1.5203520059585571) | > loss_kl: 2.116556167602539 (2.116556167602539) | > loss_feat: 0.44210875034332275 (0.44210875034332275) | > loss_mel: 20.40677833557129 (20.40677833557129) | > loss_duration: 2.0602235794067383 (2.0602235794067383) | > loss_1: 26.546016693115234 (26.546016693115234)  --> STEP: 1 | > loss_disc: 2.487114906311035 (2.487114906311035) | > loss_disc_real_0: 0.23255430161952972 (0.23255430161952972) | > loss_disc_real_1: 0.2426186501979828 (0.2426186501979828) | > loss_disc_real_2: 0.30704963207244873 (0.30704963207244873) | > loss_disc_real_3: 0.3472965955734253 (0.3472965955734253) | > loss_disc_real_4: 0.3016471564769745 (0.3016471564769745) | > loss_disc_real_5: 0.23969528079032898 (0.23969528079032898) | > loss_0: 2.487114906311035 (2.487114906311035) | > loss_gen: 2.8358519077301025 (2.8358519077301025) | > loss_kl: 2.657626152038574 (2.657626152038574) | > loss_feat: 3.5259644985198975 (3.5259644985198975) | > loss_mel: 21.810213088989258 (21.810213088989258) | > loss_duration: 2.2095255851745605 (2.2095255851745605) | > loss_1: 33.039180755615234 (33.039180755615234)  --> STEP: 2 | > loss_disc: 2.6473658084869385 (2.567240357398987) | > loss_disc_real_0: 0.1614302694797516 (0.19699228554964066) | > loss_disc_real_1: 0.2914287745952606 (0.2670237123966217) | > loss_disc_real_2: 0.248468816280365 (0.27775922417640686) | > loss_disc_real_3: 0.34013062715530396 (0.3437136113643646) | > loss_disc_real_4: 0.22094778716564178 (0.26129747182130814) | > loss_disc_real_5: 0.22870832681655884 (0.2342018038034439) | > loss_0: 2.6473658084869385 (2.567240357398987) | > loss_gen: 2.1173903942108154 (2.476621150970459) | > loss_kl: 2.737016201019287 (2.6973211765289307) | > loss_feat: 2.335338830947876 (2.9306516647338867) | > loss_mel: 29.278162002563477 (25.544187545776367) | > loss_duration: 2.2198519706726074 (2.214688777923584) | > loss_1: 38.68775939941406 (35.86347007751465)  --> STEP: 3 | > loss_disc: 2.116743564605713 (2.417074759801229) | > loss_disc_real_0: 0.019458794966340065 (0.13781445535520712) | > loss_disc_real_1: 0.05099000781774521 (0.19501247753699621) | > loss_disc_real_2: 0.03978279232978821 (0.19843374689420065) | > loss_disc_real_3: 0.09580995887517929 (0.2610790605346362) | > loss_disc_real_4: 0.08748872578144073 (0.20336122314135233) | > loss_disc_real_5: 0.022640462964773178 (0.16368135685722032) | > loss_0: 2.116743564605713 (2.417074759801229) | > loss_gen: 1.5818161964416504 (2.1783528327941895) | > loss_kl: 1.2386571168899536 (2.2110998233159385) | > loss_feat: 8.432991027832031 (4.764764785766602) | > loss_mel: 26.012046813964844 (25.700140635172527) | > loss_duration: 2.1371757984161377 (2.1888511180877686) | > loss_1: 39.402687072753906 (37.043209075927734) --> EVAL PERFORMANCE | > avg_loader_time: 0.010655959447224935 (-0.2640413783845448) | > avg_loss_disc: 2.417074759801229 (-0.20247836340041392) | > avg_loss_disc_real_0: 0.13781445535520712 (-0.0799887256608123) | > avg_loss_disc_real_1: 0.19501247753699621 (-0.09162703404823938) | > avg_loss_disc_real_2: 0.19843374689420065 (-0.022002024664765307) | > avg_loss_disc_real_3: 0.2610790605346362 (-0.0007999280378931939) | > avg_loss_disc_real_4: 0.20336122314135233 (+0.02296368600357146) | > avg_loss_disc_real_5: 0.16368135685722032 (-0.06290351191446897) | > avg_loss_0: 2.417074759801229 (-0.20247836340041392) | > avg_loss_gen: 2.1783528327941895 (+0.1663912534713745) | > avg_loss_kl: 2.2110998233159385 (+0.2817832685652235) | > avg_loss_feat: 4.764764785766602 (+1.6025386452674866) | > avg_loss_mel: 25.700140635172527 (+3.714256104968843) | > avg_loss_duration: 2.1888511180877686 (+0.037221567971365666) | > avg_loss_1: 37.043209075927734 (+5.8021913255964)  > EPOCH: 101/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:45:36)   --> TIME: 2023-10-20 00:45:53 -- STEP: 29/50 -- GLOBAL_STEP: 58080 | > loss_disc: 2.871617078781128 (2.584713286366956) | > loss_disc_real_0: 0.5454659461975098 (0.1996797357910666) | > loss_disc_real_1: 0.2622948884963989 (0.22996456304500842) | > loss_disc_real_2: 0.3975265622138977 (0.2329306364830198) | > loss_disc_real_3: 0.2054166942834854 (0.25678325560072374) | > loss_disc_real_4: 0.28581148386001587 (0.26530843863970255) | > loss_disc_real_5: 0.24314382672309875 (0.23350142045267697) | > loss_0: 2.871617078781128 (2.584713286366956) | > grad_norm_0: tensor(1513.3381, device='cuda:0') (tensor(1169.3462, device='cuda:0')) | > loss_gen: 2.85282564163208 (2.5212550204375694) | > loss_kl: 1.05619215965271 (1.2761658060139622) | > loss_feat: 3.6589174270629883 (5.692892590088063) | > loss_mel: 28.40457534790039 (25.760508923695006) | > loss_duration: 1.7755087614059448 (1.7987290744123787) | > loss_1: 37.74802017211914 (37.04955133898505) | > grad_norm_1: tensor(8549.6396, device='cuda:0') (tensor(43749.4844, device='cuda:0')) | > current_lr_0: 0.00018078546527020527 | > current_lr_1: 0.00018078546527020527 | > step_time: 0.3963 (0.4269316525294863) | > loader_time: 0.0029 (0.00801198235873518)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.17171049118042 (3.17171049118042) | > loss_disc_real_0: 0.13545703887939453 (0.13545703887939453) | > loss_disc_real_1: 0.2895064949989319 (0.2895064949989319) | > loss_disc_real_2: 0.12635278701782227 (0.12635278701782227) | > loss_disc_real_3: 0.27425912022590637 (0.27425912022590637) | > loss_disc_real_4: 0.3317175805568695 (0.3317175805568695) | > loss_disc_real_5: 0.5402265191078186 (0.5402265191078186) | > loss_0: 3.17171049118042 (3.17171049118042) | > loss_gen: 1.7121496200561523 (1.7121496200561523) | > loss_kl: 2.5831189155578613 (2.5831189155578613) | > loss_feat: 0.3855786621570587 (0.3855786621570587) | > loss_mel: 17.732486724853516 (17.732486724853516) | > loss_duration: 2.0130081176757812 (2.0130081176757812) | > loss_1: 24.426342010498047 (24.426342010498047)  --> STEP: 1 | > loss_disc: 2.431736469268799 (2.431736469268799) | > loss_disc_real_0: 0.11991757154464722 (0.11991757154464722) | > loss_disc_real_1: 0.23076458275318146 (0.23076458275318146) | > loss_disc_real_2: 0.2788650095462799 (0.2788650095462799) | > loss_disc_real_3: 0.1632857471704483 (0.1632857471704483) | > loss_disc_real_4: 0.26180300116539 (0.26180300116539) | > loss_disc_real_5: 0.4938916862010956 (0.4938916862010956) | > loss_0: 2.431736469268799 (2.431736469268799) | > loss_gen: 2.977431535720825 (2.977431535720825) | > loss_kl: 2.7746927738189697 (2.7746927738189697) | > loss_feat: 7.536272048950195 (7.536272048950195) | > loss_mel: 25.3714599609375 (25.3714599609375) | > loss_duration: 2.2098658084869385 (2.2098658084869385) | > loss_1: 40.86972427368164 (40.86972427368164)  --> STEP: 2 | > loss_disc: 3.2032883167266846 (2.8175123929977417) | > loss_disc_real_0: 0.13383227586746216 (0.1268749237060547) | > loss_disc_real_1: 0.28960323333740234 (0.2601839080452919) | > loss_disc_real_2: 0.12534762918949127 (0.2021063193678856) | > loss_disc_real_3: 0.2747119069099426 (0.21899882704019547) | > loss_disc_real_4: 0.33111900091171265 (0.29646100103855133) | > loss_disc_real_5: 0.5384388566017151 (0.5161652714014053) | > loss_0: 3.2032883167266846 (2.8175123929977417) | > loss_gen: 1.6865187883377075 (2.3319751620292664) | > loss_kl: 2.367732524871826 (2.571212649345398) | > loss_feat: 0.3550974428653717 (3.9456847459077835) | > loss_mel: 7.22589635848999 (16.298678159713745) | > loss_duration: 2.1588504314422607 (2.1843581199645996) | > loss_1: 13.794095993041992 (27.331910133361816)  --> STEP: 3 | > loss_disc: 2.2644548416137695 (2.633159875869751) | > loss_disc_real_0: 0.2110089659690857 (0.15491960446039835) | > loss_disc_real_1: 0.1623569279909134 (0.2275749146938324) | > loss_disc_real_2: 0.16907642781734467 (0.1910963555177053) | > loss_disc_real_3: 0.31958627700805664 (0.25252797702948254) | > loss_disc_real_4: 0.4720330536365509 (0.35498501857121784) | > loss_disc_real_5: 0.2764880955219269 (0.43627287944157916) | > loss_0: 2.2644548416137695 (2.633159875869751) | > loss_gen: 3.1691408157348633 (2.611030379931132) | > loss_kl: 1.2697800397872925 (2.1374017794926963) | > loss_feat: 5.344353199005127 (4.411907563606898) | > loss_mel: 24.170787811279297 (18.922714710235596) | > loss_duration: 2.1053988933563232 (2.158038377761841) | > loss_1: 36.05946350097656 (30.2410945892334) --> EVAL PERFORMANCE | > avg_loader_time: 0.030439376831054688 (+0.01978341738382975) | > avg_loss_disc: 2.633159875869751 (+0.216085116068522) | > avg_loss_disc_real_0: 0.15491960446039835 (+0.01710514910519123) | > avg_loss_disc_real_1: 0.2275749146938324 (+0.03256243715683618) | > avg_loss_disc_real_2: 0.1910963555177053 (-0.007337391376495361) | > avg_loss_disc_real_3: 0.25252797702948254 (-0.008551083505153656) | > avg_loss_disc_real_4: 0.35498501857121784 (+0.1516237954298655) | > avg_loss_disc_real_5: 0.43627287944157916 (+0.2725915225843588) | > avg_loss_0: 2.633159875869751 (+0.216085116068522) | > avg_loss_gen: 2.611030379931132 (+0.4326775471369424) | > avg_loss_kl: 2.1374017794926963 (-0.07369804382324219) | > avg_loss_feat: 4.411907563606898 (-0.3528572221597033) | > avg_loss_mel: 18.922714710235596 (-6.7774259249369315) | > avg_loss_duration: 2.158038377761841 (-0.030812740325927734) | > avg_loss_1: 30.2410945892334 (-6.802114486694336)  > EPOCH: 102/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:46:11)   --> TIME: 2023-10-20 00:46:20 -- STEP: 9/50 -- GLOBAL_STEP: 58110 | > loss_disc: 1.9615596532821655 (2.29435125986735) | > loss_disc_real_0: 0.19459807872772217 (0.11228413797087139) | > loss_disc_real_1: 0.12782779335975647 (0.1910950711203946) | > loss_disc_real_2: 0.20288605988025665 (0.19904037730561364) | > loss_disc_real_3: 0.4058515429496765 (0.24394489659203422) | > loss_disc_real_4: 0.1493454873561859 (0.1755963597032759) | > loss_disc_real_5: 0.051694661378860474 (0.20446624441279304) | > loss_0: 1.9615596532821655 (2.29435125986735) | > grad_norm_0: tensor(1046.7524, device='cuda:0') (tensor(1104.9802, device='cuda:0')) | > loss_gen: 3.082427501678467 (2.933402313126458) | > loss_kl: 0.8391674757003784 (0.9769056075149112) | > loss_feat: 7.059776306152344 (6.739835641450352) | > loss_mel: 26.48961067199707 (22.399678866068523) | > loss_duration: 1.6996970176696777 (1.730330400996738) | > loss_1: 39.170677185058594 (34.78015285068088) | > grad_norm_1: tensor(46836.1680, device='cuda:0') (tensor(55901.3516, device='cuda:0')) | > current_lr_0: 0.00018060475887880572 | > current_lr_1: 0.00018060475887880572 | > step_time: 0.5783 (0.49321145481533474) | > loader_time: 0.0148 (0.0167845884958903)  --> TIME: 2023-10-20 00:46:35 -- STEP: 39/50 -- GLOBAL_STEP: 58140 | > loss_disc: 1.892431378364563 (2.3136294316022825) | > loss_disc_real_0: 0.09251739084720612 (0.12558133275701833) | > loss_disc_real_1: 0.1865386664867401 (0.21517975389575347) | > loss_disc_real_2: 0.1765371412038803 (0.22176028043031693) | > loss_disc_real_3: 0.26825544238090515 (0.22812056770691505) | > loss_disc_real_4: 0.16027411818504333 (0.18387019691558976) | > loss_disc_real_5: 0.09160878509283066 (0.19601879326196817) | > loss_0: 1.892431378364563 (2.3136294316022825) | > grad_norm_0: tensor(1624.5526, device='cuda:0') (tensor(1352.1584, device='cuda:0')) | > loss_gen: 2.7873454093933105 (2.6467010088455982) | > loss_kl: 0.2530736029148102 (1.0647653203744147) | > loss_feat: 7.276663303375244 (5.923917971169336) | > loss_mel: 30.253963470458984 (23.36965773655818) | > loss_duration: 1.7964720726013184 (1.7674690515567095) | > loss_1: 42.367515563964844 (34.7725112377069) | > grad_norm_1: tensor(121294.9453, device='cuda:0') (tensor(46197.4531, device='cuda:0')) | > current_lr_0: 0.00018060475887880572 | > current_lr_1: 0.00018060475887880572 | > step_time: 0.3481 (0.4730829214438415) | > loader_time: 0.0138 (0.016236293010222603)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.617146372795105 (1.617146372795105) | > loss_disc_real_0: 0.04454933479428291 (0.04454933479428291) | > loss_disc_real_1: 0.1867648959159851 (0.1867648959159851) | > loss_disc_real_2: 0.13614460825920105 (0.13614460825920105) | > loss_disc_real_3: 0.32668980956077576 (0.32668980956077576) | > loss_disc_real_4: 0.14915283024311066 (0.14915283024311066) | > loss_disc_real_5: 0.3267028033733368 (0.3267028033733368) | > loss_0: 1.617146372795105 (1.617146372795105) | > loss_gen: 3.84363055229187 (3.84363055229187) | > loss_kl: 1.848971962928772 (1.848971962928772) | > loss_feat: 9.055057525634766 (9.055057525634766) | > loss_mel: 25.779386520385742 (25.779386520385742) | > loss_duration: 2.0449512004852295 (2.0449512004852295) | > loss_1: 42.57200241088867 (42.57200241088867)  --> STEP: 1 | > loss_disc: 1.6957851648330688 (1.6957851648330688) | > loss_disc_real_0: 0.009561612270772457 (0.009561612270772457) | > loss_disc_real_1: 0.2965667247772217 (0.2965667247772217) | > loss_disc_real_2: 0.19532866775989532 (0.19532866775989532) | > loss_disc_real_3: 0.2075289636850357 (0.2075289636850357) | > loss_disc_real_4: 0.1930614858865738 (0.1930614858865738) | > loss_disc_real_5: 0.15022332966327667 (0.15022332966327667) | > loss_0: 1.6957851648330688 (1.6957851648330688) | > loss_gen: 3.5300920009613037 (3.5300920009613037) | > loss_kl: 2.776710271835327 (2.776710271835327) | > loss_feat: 8.971664428710938 (8.971664428710938) | > loss_mel: 25.421030044555664 (25.421030044555664) | > loss_duration: 2.175114870071411 (2.175114870071411) | > loss_1: 42.87460708618164 (42.87460708618164)  --> STEP: 2 | > loss_disc: 2.749640464782715 (2.222712814807892) | > loss_disc_real_0: 0.10489734262228012 (0.05722947744652629) | > loss_disc_real_1: 0.33679547905921936 (0.3166811019182205) | > loss_disc_real_2: 0.2914105951786041 (0.24336963146924973) | > loss_disc_real_3: 0.2593742609024048 (0.23345161229372025) | > loss_disc_real_4: 0.3570701479911804 (0.2750658169388771) | > loss_disc_real_5: 0.3218359053134918 (0.23602961748838425) | > loss_0: 2.749640464782715 (2.222712814807892) | > loss_gen: 2.171830415725708 (2.850961208343506) | > loss_kl: 2.5700392723083496 (2.6733747720718384) | > loss_feat: 1.7901707887649536 (5.380917608737946) | > loss_mel: 25.241474151611328 (25.331252098083496) | > loss_duration: 2.1598143577575684 (2.1674646139144897) | > loss_1: 33.93333053588867 (38.403968811035156)  --> STEP: 3 | > loss_disc: 2.0319900512695312 (2.159138560295105) | > loss_disc_real_0: 0.13345447182655334 (0.08263780890653531) | > loss_disc_real_1: 0.2779833674430847 (0.30378185709317523) | > loss_disc_real_2: 0.21678262948989868 (0.23450729747613272) | > loss_disc_real_3: 0.2193910777568817 (0.2287647674481074) | > loss_disc_real_4: 0.2030419558286667 (0.25105786323547363) | > loss_disc_real_5: 0.16574008762836456 (0.21259977420171103) | > loss_0: 2.0319900512695312 (2.159138560295105) | > loss_gen: 2.640620231628418 (2.7808475494384766) | > loss_kl: 1.2280504703521729 (2.1916000048319497) | > loss_feat: 3.808832883834839 (4.856889367103577) | > loss_mel: 22.32890510559082 (24.330469767252605) | > loss_duration: 2.1642143726348877 (2.1663812001546225) | > loss_1: 32.170623779296875 (36.32618713378906) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018401940663655598 (-0.02859918276468913) | > avg_loss_disc: 2.159138560295105 (-0.474021315574646) | > avg_loss_disc_real_0: 0.08263780890653531 (-0.07228179555386303) | > avg_loss_disc_real_1: 0.30378185709317523 (+0.07620694239934284) | > avg_loss_disc_real_2: 0.23450729747613272 (+0.04341094195842743) | > avg_loss_disc_real_3: 0.2287647674481074 (-0.02376320958137515) | > avg_loss_disc_real_4: 0.25105786323547363 (-0.1039271553357442) | > avg_loss_disc_real_5: 0.21259977420171103 (-0.22367310523986814) | > avg_loss_0: 2.159138560295105 (-0.474021315574646) | > avg_loss_gen: 2.7808475494384766 (+0.1698171695073447) | > avg_loss_kl: 2.1916000048319497 (+0.05419822533925345) | > avg_loss_feat: 4.856889367103577 (+0.4449818034966784) | > avg_loss_mel: 24.330469767252605 (+5.40775505701701) | > avg_loss_duration: 2.1663812001546225 (+0.008342822392781724) | > avg_loss_1: 36.32618713378906 (+6.085092544555664)  > EPOCH: 103/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:46:51)   --> TIME: 2023-10-20 00:47:06 -- STEP: 19/50 -- GLOBAL_STEP: 58170 | > loss_disc: 3.001497745513916 (2.43545475131587) | > loss_disc_real_0: 0.21996444463729858 (0.18458109594097263) | > loss_disc_real_1: 0.29298681020736694 (0.21874936670064926) | > loss_disc_real_2: 0.24328389763832092 (0.20057376493748866) | > loss_disc_real_3: 0.24770687520503998 (0.2338934893670835) | > loss_disc_real_4: 0.2866351306438446 (0.18772188211350063) | > loss_disc_real_5: 0.316718190908432 (0.1906051295564363) | > loss_0: 3.001497745513916 (2.43545475131587) | > grad_norm_0: tensor(354.7040, device='cuda:0') (tensor(1520.2279, device='cuda:0')) | > loss_gen: 1.5686862468719482 (2.4447443736226937) | > loss_kl: 0.8969975709915161 (1.0010768802542436) | > loss_feat: 0.1553802490234375 (5.484179626169958) | > loss_mel: 2.860511541366577 (20.396906087273045) | > loss_duration: 1.8969215154647827 (1.8031036351856433) | > loss_1: 7.37849760055542 (31.130010178214626) | > grad_norm_1: tensor(82347.0469, device='cuda:0') (tensor(66663.8672, device='cuda:0')) | > current_lr_0: 0.00018042423311475828 | > current_lr_1: 0.00018042423311475828 | > step_time: 0.3391 (0.47991948378713506) | > loader_time: 0.0247 (0.020937631004735044)  --> TIME: 2023-10-20 00:47:21 -- STEP: 49/50 -- GLOBAL_STEP: 58200 | > loss_disc: 2.227156162261963 (2.470174835652722) | > loss_disc_real_0: 0.018162943422794342 (0.17757575795510594) | > loss_disc_real_1: 0.23640990257263184 (0.22743720150723748) | > loss_disc_real_2: 0.1795620173215866 (0.21681274452759902) | > loss_disc_real_3: 0.2240968644618988 (0.2353906909726104) | > loss_disc_real_4: 0.12030155211687088 (0.21513673560503793) | > loss_disc_real_5: 0.22595535218715668 (0.23793117937688923) | > loss_0: 2.227156162261963 (2.470174835652722) | > grad_norm_0: tensor(1958.4668, device='cuda:0') (tensor(1297.2344, device='cuda:0')) | > loss_gen: 2.003756046295166 (2.470706212277315) | > loss_kl: 1.0351860523223877 (0.9312162777142865) | > loss_feat: 2.774272918701172 (5.321383542856392) | > loss_mel: 21.279102325439453 (21.735287729574708) | > loss_duration: 1.8938734531402588 (1.7722793890505422) | > loss_1: 28.986190795898438 (32.23087298140234) | > grad_norm_1: tensor(9143.9326, device='cuda:0') (tensor(50011.5391, device='cuda:0')) | > current_lr_0: 0.00018042423311475828 | > current_lr_1: 0.00018042423311475828 | > step_time: 0.4905 (0.4907651288168771) | > loader_time: 0.2607 (0.025309124771429565)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5434012413024902 (2.5434012413024902) | > loss_disc_real_0: 0.20473217964172363 (0.20473217964172363) | > loss_disc_real_1: 0.30955755710601807 (0.30955755710601807) | > loss_disc_real_2: 0.372465044260025 (0.372465044260025) | > loss_disc_real_3: 0.24349746108055115 (0.24349746108055115) | > loss_disc_real_4: 0.36080971360206604 (0.36080971360206604) | > loss_disc_real_5: 0.42433324456214905 (0.42433324456214905) | > loss_0: 2.5434012413024902 (2.5434012413024902) | > loss_gen: 3.279567003250122 (3.279567003250122) | > loss_kl: 1.8422799110412598 (1.8422799110412598) | > loss_feat: 5.630672454833984 (5.630672454833984) | > loss_mel: 24.28188705444336 (24.28188705444336) | > loss_duration: 2.0548226833343506 (2.0548226833343506) | > loss_1: 37.08922576904297 (37.08922576904297)  --> STEP: 1 | > loss_disc: 1.8810538053512573 (1.8810538053512573) | > loss_disc_real_0: 0.1083466187119484 (0.1083466187119484) | > loss_disc_real_1: 0.15899956226348877 (0.15899956226348877) | > loss_disc_real_2: 0.15421386063098907 (0.15421386063098907) | > loss_disc_real_3: 0.342303067445755 (0.342303067445755) | > loss_disc_real_4: 0.0741492211818695 (0.0741492211818695) | > loss_disc_real_5: 0.10688581317663193 (0.10688581317663193) | > loss_0: 1.8810538053512573 (1.8810538053512573) | > loss_gen: 2.5742228031158447 (2.5742228031158447) | > loss_kl: 2.3511571884155273 (2.3511571884155273) | > loss_feat: 7.085546970367432 (7.085546970367432) | > loss_mel: 26.167301177978516 (26.167301177978516) | > loss_duration: 2.188758373260498 (2.188758373260498) | > loss_1: 40.36698532104492 (40.36698532104492)  --> STEP: 2 | > loss_disc: 2.926039695739746 (2.4035467505455017) | > loss_disc_real_0: 0.24516747891902924 (0.17675704881548882) | > loss_disc_real_1: 0.25415921211242676 (0.20657938718795776) | > loss_disc_real_2: 0.3605974614620209 (0.257405661046505) | > loss_disc_real_3: 0.2455800622701645 (0.29394156485795975) | > loss_disc_real_4: 0.220738023519516 (0.14744362235069275) | > loss_disc_real_5: 0.2055329978466034 (0.15620940551161766) | > loss_0: 2.926039695739746 (2.4035467505455017) | > loss_gen: 1.6740256547927856 (2.124124228954315) | > loss_kl: 2.5252256393432617 (2.4381914138793945) | > loss_feat: 0.9515624046325684 (4.0185546875) | > loss_mel: 19.19821548461914 (22.682758331298828) | > loss_duration: 2.200401544570923 (2.1945799589157104) | > loss_1: 26.54943084716797 (33.458208084106445)  --> STEP: 3 | > loss_disc: 2.3886008262634277 (2.3985647757848105) | > loss_disc_real_0: 0.15579962730407715 (0.16977124164501825) | > loss_disc_real_1: 0.2560710906982422 (0.2230766216913859) | > loss_disc_real_2: 0.2486329972743988 (0.25448143978913623) | > loss_disc_real_3: 0.23473460972309113 (0.27420591314633685) | > loss_disc_real_4: 0.1818702518939972 (0.15891916553179422) | > loss_disc_real_5: 0.16224676370620728 (0.15822185824314752) | > loss_0: 2.3886008262634277 (2.3985647757848105) | > loss_gen: 1.9465320110321045 (2.064926822980245) | > loss_kl: 1.275947093963623 (2.050776640574137) | > loss_feat: 1.740199089050293 (3.2591028213500977) | > loss_mel: 14.512338638305664 (19.959285100301106) | > loss_duration: 2.15169620513916 (2.180285374323527) | > loss_1: 21.626712799072266 (29.514376322428387) --> EVAL PERFORMANCE | > avg_loader_time: 0.00620420773824056 (+0.004364013671875) | > avg_loss_disc: 2.3985647757848105 (+0.23942621548970555) | > avg_loss_disc_real_0: 0.16977124164501825 (+0.08713343273848294) | > avg_loss_disc_real_1: 0.2230766216913859 (-0.08070523540178934) | > avg_loss_disc_real_2: 0.25448143978913623 (+0.019974142313003512) | > avg_loss_disc_real_3: 0.27420591314633685 (+0.04544114569822946) | > avg_loss_disc_real_4: 0.15891916553179422 (-0.09213869770367941) | > avg_loss_disc_real_5: 0.15822185824314752 (-0.054377915958563505) | > avg_loss_0: 2.3985647757848105 (+0.23942621548970555) | > avg_loss_gen: 2.064926822980245 (-0.7159207264582315) | > avg_loss_kl: 2.050776640574137 (-0.1408233642578125) | > avg_loss_feat: 3.2591028213500977 (-1.597786545753479) | > avg_loss_mel: 19.959285100301106 (-4.3711846669515) | > avg_loss_duration: 2.180285374323527 (+0.013904174168904326) | > avg_loss_1: 29.514376322428387 (-6.811810811360676)  > EPOCH: 104/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:47:32)   --> TIME: 2023-10-20 00:47:50 -- STEP: 29/50 -- GLOBAL_STEP: 58230 | > loss_disc: 2.365215301513672 (2.303794943053147) | > loss_disc_real_0: 0.17102527618408203 (0.17690091747148287) | > loss_disc_real_1: 0.23688668012619019 (0.21190981232914433) | > loss_disc_real_2: 0.13523615896701813 (0.21089161521401897) | > loss_disc_real_3: 0.3292989134788513 (0.2338267662401857) | > loss_disc_real_4: 0.17320284247398376 (0.17934374132289968) | > loss_disc_real_5: 0.13292817771434784 (0.17610355225744947) | > loss_0: 2.365215301513672 (2.303794943053147) | > grad_norm_0: tensor(606.0967, device='cuda:0') (tensor(1761.1464, device='cuda:0')) | > loss_gen: 2.615628480911255 (2.6762321694143894) | > loss_kl: 1.1441161632537842 (1.0815570159205075) | > loss_feat: 6.1019744873046875 (6.269274990106451) | > loss_mel: 24.38272476196289 (25.006024738837933) | > loss_duration: 1.752097487449646 (1.7935389568065774) | > loss_1: 35.99654006958008 (36.826627369584706) | > grad_norm_1: tensor(11542.5830, device='cuda:0') (tensor(50187.8828, device='cuda:0')) | > current_lr_0: 0.0001802438877975146 | > current_lr_1: 0.0001802438877975146 | > step_time: 0.5308 (0.46143424922022325) | > loader_time: 0.024 (0.008186291004049367)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1953864097595215 (2.1953864097595215) | > loss_disc_real_0: 0.08028708398342133 (0.08028708398342133) | > loss_disc_real_1: 0.2779640853404999 (0.2779640853404999) | > loss_disc_real_2: 0.461513876914978 (0.461513876914978) | > loss_disc_real_3: 0.3316739797592163 (0.3316739797592163) | > loss_disc_real_4: 0.19041237235069275 (0.19041237235069275) | > loss_disc_real_5: 0.20980210602283478 (0.20980210602283478) | > loss_0: 2.1953864097595215 (2.1953864097595215) | > loss_gen: 3.4073290824890137 (3.4073290824890137) | > loss_kl: 1.8351898193359375 (1.8351898193359375) | > loss_feat: 9.571691513061523 (9.571691513061523) | > loss_mel: 26.45364761352539 (26.45364761352539) | > loss_duration: 1.986952304840088 (1.986952304840088) | > loss_1: 43.25481033325195 (43.25481033325195)  --> STEP: 1 | > loss_disc: 2.4150853157043457 (2.4150853157043457) | > loss_disc_real_0: 0.199282705783844 (0.199282705783844) | > loss_disc_real_1: 0.2395288348197937 (0.2395288348197937) | > loss_disc_real_2: 0.21022067964076996 (0.21022067964076996) | > loss_disc_real_3: 0.10965238511562347 (0.10965238511562347) | > loss_disc_real_4: 0.5355898141860962 (0.5355898141860962) | > loss_disc_real_5: 0.45840704441070557 (0.45840704441070557) | > loss_0: 2.4150853157043457 (2.4150853157043457) | > loss_gen: 3.846008539199829 (3.846008539199829) | > loss_kl: 2.6427931785583496 (2.6427931785583496) | > loss_feat: 8.780404090881348 (8.780404090881348) | > loss_mel: 29.16454315185547 (29.16454315185547) | > loss_duration: 2.1647534370422363 (2.1647534370422363) | > loss_1: 46.5984992980957 (46.5984992980957)  --> STEP: 2 | > loss_disc: 1.642570972442627 (2.0288281440734863) | > loss_disc_real_0: 0.03294723853468895 (0.11611497215926647) | > loss_disc_real_1: 0.28650084137916565 (0.2630148380994797) | > loss_disc_real_2: 0.2861156463623047 (0.24816816300153732) | > loss_disc_real_3: 0.18732725083827972 (0.1484898179769516) | > loss_disc_real_4: 0.15666308999061584 (0.346126452088356) | > loss_disc_real_5: 0.12808780372142792 (0.29324742406606674) | > loss_0: 1.642570972442627 (2.0288281440734863) | > loss_gen: 3.7844669818878174 (3.8152377605438232) | > loss_kl: 2.720655679702759 (2.681724429130554) | > loss_feat: 10.898279190063477 (9.839341640472412) | > loss_mel: 29.112869262695312 (29.13870620727539) | > loss_duration: 2.1595771312713623 (2.1621652841567993) | > loss_1: 48.675846099853516 (47.63717269897461)  --> STEP: 3 | > loss_disc: 2.3363091945648193 (2.131321827570597) | > loss_disc_real_0: 0.25218772888183594 (0.16147255773345628) | > loss_disc_real_1: 0.27577751874923706 (0.2672690649827321) | > loss_disc_real_2: 0.23110054433345795 (0.2424789567788442) | > loss_disc_real_3: 0.22288891673088074 (0.17328951756159464) | > loss_disc_real_4: 0.23208342492580414 (0.30811210970083874) | > loss_disc_real_5: 0.10630031675100327 (0.23093172162771225) | > loss_0: 2.3363091945648193 (2.131321827570597) | > loss_gen: 2.4634644985198975 (3.3646466732025146) | > loss_kl: 1.524808645248413 (2.296085834503174) | > loss_feat: 3.746415615081787 (7.808366298675537) | > loss_mel: 23.929378509521484 (27.402263641357422) | > loss_duration: 2.1462759971618652 (2.156868855158488) | > loss_1: 33.81034469604492 (43.02823003133138) --> EVAL PERFORMANCE | > avg_loader_time: 0.014223337173461914 (+0.008019129435221355) | > avg_loss_disc: 2.131321827570597 (-0.26724294821421335) | > avg_loss_disc_real_0: 0.16147255773345628 (-0.008298683911561966) | > avg_loss_disc_real_1: 0.2672690649827321 (+0.04419244329134622) | > avg_loss_disc_real_2: 0.2424789567788442 (-0.012002483010292025) | > avg_loss_disc_real_3: 0.17328951756159464 (-0.10091639558474222) | > avg_loss_disc_real_4: 0.30811210970083874 (+0.14919294416904452) | > avg_loss_disc_real_5: 0.23093172162771225 (+0.07270986338456473) | > avg_loss_0: 2.131321827570597 (-0.26724294821421335) | > avg_loss_gen: 3.3646466732025146 (+1.2997198502222695) | > avg_loss_kl: 2.296085834503174 (+0.2453091939290366) | > avg_loss_feat: 7.808366298675537 (+4.5492634773254395) | > avg_loss_mel: 27.402263641357422 (+7.442978541056316) | > avg_loss_duration: 2.156868855158488 (-0.023416519165039062) | > avg_loss_1: 43.02823003133138 (+13.513853708902996)  > EPOCH: 105/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:48:09)   --> TIME: 2023-10-20 00:48:19 -- STEP: 9/50 -- GLOBAL_STEP: 58260 | > loss_disc: 2.0956363677978516 (2.236261910862393) | > loss_disc_real_0: 0.13901622593402863 (0.10710739385750559) | > loss_disc_real_1: 0.22001607716083527 (0.2231915117137962) | > loss_disc_real_2: 0.1261962503194809 (0.23487944073147243) | > loss_disc_real_3: 0.20237642526626587 (0.2532035435239474) | > loss_disc_real_4: 0.06329765915870667 (0.2126120867000686) | > loss_disc_real_5: 0.1563882976770401 (0.2423266586330202) | > loss_0: 2.0956363677978516 (2.236261910862393) | > grad_norm_0: tensor(589.7755, device='cuda:0') (tensor(777.8408, device='cuda:0')) | > loss_gen: 2.7155327796936035 (2.898623996310764) | > loss_kl: 1.1303297281265259 (1.1706521113713582) | > loss_feat: 8.753104209899902 (8.049601707193586) | > loss_mel: 33.671627044677734 (24.071004072825115) | > loss_duration: 1.7150321006774902 (1.79377195570204) | > loss_1: 47.985626220703125 (37.98365471098158) | > grad_norm_1: tensor(28816.6387, device='cuda:0') (tensor(46727.8984, device='cuda:0')) | > current_lr_0: 0.00018006372274670683 | > current_lr_1: 0.00018006372274670683 | > step_time: 0.5869 (0.5564317438337538) | > loader_time: 0.0046 (0.016889651616414387)  --> TIME: 2023-10-20 00:48:33 -- STEP: 39/50 -- GLOBAL_STEP: 58290 | > loss_disc: 2.2982046604156494 (2.4596356948216758) | > loss_disc_real_0: 0.28687387704849243 (0.15605679283348414) | > loss_disc_real_1: 0.19545111060142517 (0.23008777287143928) | > loss_disc_real_2: 0.2787609100341797 (0.24528288077085447) | > loss_disc_real_3: 0.1669865846633911 (0.24823791361772096) | > loss_disc_real_4: 0.3423927128314972 (0.2083259486617186) | > loss_disc_real_5: 0.26842090487480164 (0.2331947083465564) | > loss_0: 2.2982046604156494 (2.4596356948216758) | > grad_norm_0: tensor(3201.8870, device='cuda:0') (tensor(1122.1622, device='cuda:0')) | > loss_gen: 3.169017791748047 (2.412755348743537) | > loss_kl: 0.40540361404418945 (1.0951329912894818) | > loss_feat: 5.289577007293701 (5.190665291479002) | > loss_mel: 23.005794525146484 (22.81707109854772) | > loss_duration: 1.7685343027114868 (1.7755396702350714) | > loss_1: 33.638328552246094 (33.291164606045456) | > grad_norm_1: tensor(63398.7383, device='cuda:0') (tensor(44372.2539, device='cuda:0')) | > current_lr_0: 0.00018006372274670683 | > current_lr_1: 0.00018006372274670683 | > step_time: 0.25 (0.4692129049545679) | > loader_time: 0.0023 (0.01391761730878781)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5978186130523682 (1.5978186130523682) | > loss_disc_real_0: 0.05169054493308067 (0.05169054493308067) | > loss_disc_real_1: 0.1312231570482254 (0.1312231570482254) | > loss_disc_real_2: 0.0879560187458992 (0.0879560187458992) | > loss_disc_real_3: 0.055946968495845795 (0.055946968495845795) | > loss_disc_real_4: 0.08290252089500427 (0.08290252089500427) | > loss_disc_real_5: 0.021553976461291313 (0.021553976461291313) | > loss_0: 1.5978186130523682 (1.5978186130523682) | > loss_gen: 2.3759303092956543 (2.3759303092956543) | > loss_kl: 2.086174249649048 (2.086174249649048) | > loss_feat: 12.97747802734375 (12.97747802734375) | > loss_mel: 28.71399688720703 (28.71399688720703) | > loss_duration: 2.062147378921509 (2.062147378921509) | > loss_1: 48.215728759765625 (48.215728759765625)  --> STEP: 1 | > loss_disc: 2.2156403064727783 (2.2156403064727783) | > loss_disc_real_0: 0.18060913681983948 (0.18060913681983948) | > loss_disc_real_1: 0.303066611289978 (0.303066611289978) | > loss_disc_real_2: 0.2540377080440521 (0.2540377080440521) | > loss_disc_real_3: 0.07666831463575363 (0.07666831463575363) | > loss_disc_real_4: 0.26558586955070496 (0.26558586955070496) | > loss_disc_real_5: 0.3375432789325714 (0.3375432789325714) | > loss_0: 2.2156403064727783 (2.2156403064727783) | > loss_gen: 3.626018524169922 (3.626018524169922) | > loss_kl: 3.3131978511810303 (3.3131978511810303) | > loss_feat: 9.359432220458984 (9.359432220458984) | > loss_mel: 25.666767120361328 (25.666767120361328) | > loss_duration: 2.3194637298583984 (2.3194637298583984) | > loss_1: 44.284881591796875 (44.284881591796875)  --> STEP: 2 | > loss_disc: 3.1429696083068848 (2.6793049573898315) | > loss_disc_real_0: 0.46847647428512573 (0.3245428055524826) | > loss_disc_real_1: 0.32059428095817566 (0.31183044612407684) | > loss_disc_real_2: 0.25721752643585205 (0.2556276172399521) | > loss_disc_real_3: 0.322639137506485 (0.1996537260711193) | > loss_disc_real_4: 0.3008168339729309 (0.28320135176181793) | > loss_disc_real_5: 0.2445155680179596 (0.2910294234752655) | > loss_0: 3.1429696083068848 (2.6793049573898315) | > loss_gen: 1.8746575117111206 (2.7503380179405212) | > loss_kl: 2.503648042678833 (2.9084229469299316) | > loss_feat: 1.9896659851074219 (5.674549102783203) | > loss_mel: 26.168338775634766 (25.917552947998047) | > loss_duration: 2.28269100189209 (2.301077365875244) | > loss_1: 34.819000244140625 (39.55194091796875)  --> STEP: 3 | > loss_disc: 3.012742757797241 (2.7904508908589682) | > loss_disc_real_0: 0.3516544699668884 (0.33358002702395123) | > loss_disc_real_1: 0.28239715099334717 (0.30201934774716693) | > loss_disc_real_2: 0.3592813014984131 (0.29017884532610577) | > loss_disc_real_3: 0.32266753911972046 (0.24065833042065302) | > loss_disc_real_4: 0.28638890385627747 (0.28426386912663776) | > loss_disc_real_5: 0.2209889441728592 (0.26768259704113007) | > loss_0: 3.012742757797241 (2.7904508908589682) | > loss_gen: 1.883146047592163 (2.461274027824402) | > loss_kl: 1.415371060371399 (2.410738984743754) | > loss_feat: 0.21476063132286072 (3.8546196122964225) | > loss_mel: 11.842670440673828 (21.22592544555664) | > loss_duration: 2.1802098751068115 (2.2607882022857666) | > loss_1: 17.536157608032227 (32.21334648132324) --> EVAL PERFORMANCE | > avg_loader_time: 0.01327673594156901 (-0.0009466012318929042) | > avg_loss_disc: 2.7904508908589682 (+0.6591290632883711) | > avg_loss_disc_real_0: 0.33358002702395123 (+0.17210746929049495) | > avg_loss_disc_real_1: 0.30201934774716693 (+0.034750282764434814) | > avg_loss_disc_real_2: 0.29017884532610577 (+0.047699888547261565) | > avg_loss_disc_real_3: 0.24065833042065302 (+0.06736881285905838) | > avg_loss_disc_real_4: 0.28426386912663776 (-0.023848240574200985) | > avg_loss_disc_real_5: 0.26768259704113007 (+0.036750875413417816) | > avg_loss_0: 2.7904508908589682 (+0.6591290632883711) | > avg_loss_gen: 2.461274027824402 (-0.9033726453781128) | > avg_loss_kl: 2.410738984743754 (+0.11465315024058009) | > avg_loss_feat: 3.8546196122964225 (-3.9537466863791146) | > avg_loss_mel: 21.22592544555664 (-6.176338195800781) | > avg_loss_duration: 2.2607882022857666 (+0.1039193471272788) | > avg_loss_1: 32.21334648132324 (-10.81488355000814)  > EPOCH: 106/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:48:49)   --> TIME: 2023-10-20 00:49:03 -- STEP: 19/50 -- GLOBAL_STEP: 58320 | > loss_disc: 1.7558757066726685 (2.451000671637686) | > loss_disc_real_0: 0.10031796991825104 (0.15113576830021644) | > loss_disc_real_1: 0.07717352360486984 (0.22170308781297585) | > loss_disc_real_2: 0.11701707541942596 (0.24781836412454905) | > loss_disc_real_3: 0.11011305451393127 (0.27357862732912364) | > loss_disc_real_4: 0.07735461741685867 (0.22708449346062384) | > loss_disc_real_5: 0.12659724056720734 (0.21915380656719208) | > loss_0: 1.7558757066726685 (2.451000671637686) | > grad_norm_0: tensor(977.3879, device='cuda:0') (tensor(1344.4205, device='cuda:0')) | > loss_gen: 3.1681551933288574 (2.6839446770517448) | > loss_kl: 1.160528302192688 (1.2007120283026445) | > loss_feat: 11.07710075378418 (6.150845612350263) | > loss_mel: 29.0748291015625 (25.486041570964613) | > loss_duration: 1.9019373655319214 (1.827725517122369) | > loss_1: 46.38254928588867 (37.34926936500951) | > grad_norm_1: tensor(119568.7500, device='cuda:0') (tensor(47095.1914, device='cuda:0')) | > current_lr_0: 0.0001798837377821474 | > current_lr_1: 0.0001798837377821474 | > step_time: 0.5746 (0.49344169466119064) | > loader_time: 0.0069 (0.018403053283691406)  --> TIME: 2023-10-20 00:49:19 -- STEP: 49/50 -- GLOBAL_STEP: 58350 | > loss_disc: 2.867776393890381 (2.5110058906127) | > loss_disc_real_0: 0.32079482078552246 (0.16052040786539412) | > loss_disc_real_1: 0.3782559037208557 (0.23659313667793663) | > loss_disc_real_2: 0.299102783203125 (0.23249068073168092) | > loss_disc_real_3: 0.3151458501815796 (0.2505561680513985) | > loss_disc_real_4: 0.2686808109283447 (0.22848969264602176) | > loss_disc_real_5: 0.21578794717788696 (0.2265129824910237) | > loss_0: 2.867776393890381 (2.5110058906127) | > grad_norm_0: tensor(2234.5566, device='cuda:0') (tensor(1190.8484, device='cuda:0')) | > loss_gen: 1.9968373775482178 (2.4027197069051316) | > loss_kl: 0.7573108077049255 (1.0925570288482975) | > loss_feat: 1.2420073747634888 (5.115878898878487) | > loss_mel: 31.65911865234375 (23.388632577292775) | > loss_duration: 1.8387696743011475 (1.7657581932690678) | > loss_1: 37.494041442871094 (33.7655461953611) | > grad_norm_1: tensor(26710.0371, device='cuda:0') (tensor(37247.3984, device='cuda:0')) | > current_lr_0: 0.0001798837377821474 | > current_lr_1: 0.0001798837377821474 | > step_time: 0.5449 (0.499126672744751) | > loader_time: 0.302 (0.025566684956453284)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9979662895202637 (2.9979662895202637) | > loss_disc_real_0: 0.24276678264141083 (0.24276678264141083) | > loss_disc_real_1: 0.3348979353904724 (0.3348979353904724) | > loss_disc_real_2: 0.33326101303100586 (0.33326101303100586) | > loss_disc_real_3: 0.30368664860725403 (0.30368664860725403) | > loss_disc_real_4: 0.26778146624565125 (0.26778146624565125) | > loss_disc_real_5: 0.2117338329553604 (0.2117338329553604) | > loss_0: 2.9979662895202637 (2.9979662895202637) | > loss_gen: 1.731248378753662 (1.731248378753662) | > loss_kl: 2.3034753799438477 (2.3034753799438477) | > loss_feat: 0.14468710124492645 (0.14468710124492645) | > loss_mel: 6.873775482177734 (6.873775482177734) | > loss_duration: 1.9853978157043457 (1.9853978157043457) | > loss_1: 13.038583755493164 (13.038583755493164)  --> STEP: 1 | > loss_disc: 1.9758591651916504 (1.9758591651916504) | > loss_disc_real_0: 0.014615020714700222 (0.014615020714700222) | > loss_disc_real_1: 0.33915621042251587 (0.33915621042251587) | > loss_disc_real_2: 0.22005805373191833 (0.22005805373191833) | > loss_disc_real_3: 0.40864861011505127 (0.40864861011505127) | > loss_disc_real_4: 0.16588184237480164 (0.16588184237480164) | > loss_disc_real_5: 0.12541498243808746 (0.12541498243808746) | > loss_0: 1.9758591651916504 (1.9758591651916504) | > loss_gen: 2.938077449798584 (2.938077449798584) | > loss_kl: 3.2044382095336914 (3.2044382095336914) | > loss_feat: 7.792174816131592 (7.792174816131592) | > loss_mel: 28.49772834777832 (28.49772834777832) | > loss_duration: 2.166337251663208 (2.166337251663208) | > loss_1: 44.598751068115234 (44.598751068115234)  --> STEP: 2 | > loss_disc: 2.916785955429077 (2.4463225603103638) | > loss_disc_real_0: 0.24121308326721191 (0.12791405199095607) | > loss_disc_real_1: 0.3382299840450287 (0.3386930972337723) | > loss_disc_real_2: 0.3403148651123047 (0.2801864594221115) | > loss_disc_real_3: 0.30483144521713257 (0.3567400276660919) | > loss_disc_real_4: 0.26790186762809753 (0.21689185500144958) | > loss_disc_real_5: 0.21152138710021973 (0.1684681847691536) | > loss_0: 2.916785955429077 (2.4463225603103638) | > loss_gen: 1.8407397270202637 (2.389408588409424) | > loss_kl: 2.771005868911743 (2.9877220392227173) | > loss_feat: 0.37978240847587585 (4.085978612303734) | > loss_mel: 14.733552932739258 (21.61564064025879) | > loss_duration: 2.18446683883667 (2.175402045249939) | > loss_1: 21.909549713134766 (33.254150390625)  --> STEP: 3 | > loss_disc: 2.9942288398742676 (2.628957986831665) | > loss_disc_real_0: 0.23887485265731812 (0.16490098554641008) | > loss_disc_real_1: 0.3349139094352722 (0.3374333679676056) | > loss_disc_real_2: 0.33386215567588806 (0.29807835817337036) | > loss_disc_real_3: 0.30363011360168457 (0.3390367229779561) | > loss_disc_real_4: 0.2682374119758606 (0.23400704065958658) | > loss_disc_real_5: 0.2119053155183792 (0.1829472283522288) | > loss_0: 2.9942288398742676 (2.628957986831665) | > loss_gen: 1.732287883758545 (2.1703683535257974) | > loss_kl: 1.385729432106018 (2.453724503517151) | > loss_feat: 0.13828231394290924 (2.770079846183459) | > loss_mel: 5.132080554962158 (16.12112061182658) | > loss_duration: 2.1342670917510986 (2.1616903940836587) | > loss_1: 10.5226469039917 (25.676982561747234) --> EVAL PERFORMANCE | > avg_loader_time: 0.005915085474650065 (-0.0073616504669189444) | > avg_loss_disc: 2.628957986831665 (-0.1614929040273032) | > avg_loss_disc_real_0: 0.16490098554641008 (-0.16867904147754115) | > avg_loss_disc_real_1: 0.3374333679676056 (+0.03541402022043866) | > avg_loss_disc_real_2: 0.29807835817337036 (+0.00789951284726459) | > avg_loss_disc_real_3: 0.3390367229779561 (+0.0983783925573031) | > avg_loss_disc_real_4: 0.23400704065958658 (-0.05025682846705118) | > avg_loss_disc_real_5: 0.1829472283522288 (-0.08473536868890127) | > avg_loss_0: 2.628957986831665 (-0.1614929040273032) | > avg_loss_gen: 2.1703683535257974 (-0.2909056742986045) | > avg_loss_kl: 2.453724503517151 (+0.04298551877339696) | > avg_loss_feat: 2.770079846183459 (-1.0845397661129637) | > avg_loss_mel: 16.12112061182658 (-5.104804833730061) | > avg_loss_duration: 2.1616903940836587 (-0.0990978082021079) | > avg_loss_1: 25.676982561747234 (-6.536363919576008)  > EPOCH: 107/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:49:29)   --> TIME: 2023-10-20 00:49:46 -- STEP: 29/50 -- GLOBAL_STEP: 58380 | > loss_disc: 2.704774856567383 (2.531269616094129) | > loss_disc_real_0: 0.2992660403251648 (0.1855933435004333) | > loss_disc_real_1: 0.27900466322898865 (0.22115956876298476) | > loss_disc_real_2: 0.222428560256958 (0.23905263609927277) | > loss_disc_real_3: 0.29571008682250977 (0.23454008161507803) | > loss_disc_real_4: 0.2250780463218689 (0.24212889302650403) | > loss_disc_real_5: 0.21703171730041504 (0.2245779550987585) | > loss_0: 2.704774856567383 (2.531269616094129) | > grad_norm_0: tensor(1466.7212, device='cuda:0') (tensor(1534.8018, device='cuda:0')) | > loss_gen: 1.9147772789001465 (2.4230348652806772) | > loss_kl: 1.3477100133895874 (1.2099077496035346) | > loss_feat: 1.0614625215530396 (5.530163584855097) | > loss_mel: 19.381149291992188 (24.445991072161444) | > loss_duration: 1.7657595872879028 (1.7892526305955032) | > loss_1: 25.47085952758789 (35.39834966330694) | > grad_norm_1: tensor(21457.9062, device='cuda:0') (tensor(46354.6523, device='cuda:0')) | > current_lr_0: 0.00017970393272382875 | > current_lr_1: 0.00017970393272382875 | > step_time: 1.1046 (0.44098701148197567) | > loader_time: 0.0492 (0.009446670269143989)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.903385043144226 (1.903385043144226) | > loss_disc_real_0: 0.07153701037168503 (0.07153701037168503) | > loss_disc_real_1: 0.10411394387483597 (0.10411394387483597) | > loss_disc_real_2: 0.18470580875873566 (0.18470580875873566) | > loss_disc_real_3: 0.30746614933013916 (0.30746614933013916) | > loss_disc_real_4: 0.13112668693065643 (0.13112668693065643) | > loss_disc_real_5: 0.01720246858894825 (0.01720246858894825) | > loss_0: 1.903385043144226 (1.903385043144226) | > loss_gen: 2.577871799468994 (2.577871799468994) | > loss_kl: 1.9061259031295776 (1.9061259031295776) | > loss_feat: 7.4554548263549805 (7.4554548263549805) | > loss_mel: 26.71547508239746 (26.71547508239746) | > loss_duration: 2.029114007949829 (2.029114007949829) | > loss_1: 40.684043884277344 (40.684043884277344)  --> STEP: 1 | > loss_disc: 2.2110214233398438 (2.2110214233398438) | > loss_disc_real_0: 0.06163841858506203 (0.06163841858506203) | > loss_disc_real_1: 0.12315509468317032 (0.12315509468317032) | > loss_disc_real_2: 0.15697813034057617 (0.15697813034057617) | > loss_disc_real_3: 0.24802972376346588 (0.24802972376346588) | > loss_disc_real_4: 0.16245333850383759 (0.16245333850383759) | > loss_disc_real_5: 0.14151246845722198 (0.14151246845722198) | > loss_0: 2.2110214233398438 (2.2110214233398438) | > loss_gen: 2.200747489929199 (2.200747489929199) | > loss_kl: 2.7628908157348633 (2.7628908157348633) | > loss_feat: 6.188704967498779 (6.188704967498779) | > loss_mel: 26.47707748413086 (26.47707748413086) | > loss_duration: 2.187896966934204 (2.187896966934204) | > loss_1: 39.817317962646484 (39.817317962646484)  --> STEP: 2 | > loss_disc: 2.5352697372436523 (2.373145580291748) | > loss_disc_real_0: 0.20263035595417023 (0.13213438726961613) | > loss_disc_real_1: 0.340798556804657 (0.23197682574391365) | > loss_disc_real_2: 0.23949775099754333 (0.19823794066905975) | > loss_disc_real_3: 0.19283026456832886 (0.22042999416589737) | > loss_disc_real_4: 0.16386421024799347 (0.16315877437591553) | > loss_disc_real_5: 0.09020251780748367 (0.11585749313235283) | > loss_0: 2.5352697372436523 (2.373145580291748) | > loss_gen: 3.7723276615142822 (2.9865375757217407) | > loss_kl: 2.8111560344696045 (2.787023425102234) | > loss_feat: 9.506075859069824 (7.847390413284302) | > loss_mel: 27.3557186126709 (26.91639804840088) | > loss_duration: 2.2903995513916016 (2.239148259162903) | > loss_1: 45.735679626464844 (42.776498794555664)  --> STEP: 3 | > loss_disc: 3.0980658531188965 (2.614785671234131) | > loss_disc_real_0: 0.35053935647010803 (0.2049360436697801) | > loss_disc_real_1: 0.2923256754875183 (0.2520931089917819) | > loss_disc_real_2: 0.30327263474464417 (0.23324950536092123) | > loss_disc_real_3: 0.2911047041416168 (0.24398823082447052) | > loss_disc_real_4: 0.24599534273147583 (0.19077096382776895) | > loss_disc_real_5: 0.2776758372783661 (0.16979694118102392) | > loss_0: 3.0980658531188965 (2.614785671234131) | > loss_gen: 1.7193247079849243 (2.5641332864761353) | > loss_kl: 1.2085015773773193 (2.2608494758605957) | > loss_feat: 0.40080857276916504 (5.365196466445923) | > loss_mel: 18.504398345947266 (24.112398147583008) | > loss_duration: 2.1557953357696533 (2.211363951365153) | > loss_1: 23.988828659057617 (36.513942082722984) --> EVAL PERFORMANCE | > avg_loader_time: 0.012178977330525717 (+0.006263891855875651) | > avg_loss_disc: 2.614785671234131 (-0.01417231559753418) | > avg_loss_disc_real_0: 0.2049360436697801 (+0.04003505812337002) | > avg_loss_disc_real_1: 0.2520931089917819 (-0.0853402589758237) | > avg_loss_disc_real_2: 0.23324950536092123 (-0.06482885281244913) | > avg_loss_disc_real_3: 0.24398823082447052 (-0.0950484921534856) | > avg_loss_disc_real_4: 0.19077096382776895 (-0.04323607683181763) | > avg_loss_disc_real_5: 0.16979694118102392 (-0.013150287171204866) | > avg_loss_0: 2.614785671234131 (-0.01417231559753418) | > avg_loss_gen: 2.5641332864761353 (+0.3937649329503379) | > avg_loss_kl: 2.2608494758605957 (-0.19287502765655518) | > avg_loss_feat: 5.365196466445923 (+2.595116620262464) | > avg_loss_mel: 24.112398147583008 (+7.991277535756428) | > avg_loss_duration: 2.211363951365153 (+0.04967355728149414) | > avg_loss_1: 36.513942082722984 (+10.83695952097575)  > EPOCH: 108/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:50:06)   --> TIME: 2023-10-20 00:50:14 -- STEP: 9/50 -- GLOBAL_STEP: 58410 | > loss_disc: 2.498610019683838 (2.5788682566748724) | > loss_disc_real_0: 0.0933273434638977 (0.13823056945370304) | > loss_disc_real_1: 0.24048858880996704 (0.23678062690628898) | > loss_disc_real_2: 0.11653934419155121 (0.20636996047364342) | > loss_disc_real_3: 0.18667086958885193 (0.23964266313446891) | > loss_disc_real_4: 0.14196240901947021 (0.21694298750824398) | > loss_disc_real_5: 0.20039412379264832 (0.21835641976859835) | > loss_0: 2.498610019683838 (2.5788682566748724) | > grad_norm_0: tensor(1450.6154, device='cuda:0') (tensor(1433.9884, device='cuda:0')) | > loss_gen: 1.9119083881378174 (2.201904985639784) | > loss_kl: 1.2429227828979492 (1.1204059918721516) | > loss_feat: 6.014431953430176 (5.42227624853452) | > loss_mel: 26.301921844482422 (23.78245449066162) | > loss_duration: 1.7043336629867554 (1.762750466664632) | > loss_1: 37.17551803588867 (34.28979259067111) | > grad_norm_1: tensor(7769.7275, device='cuda:0') (tensor(32180.0488, device='cuda:0')) | > current_lr_0: 0.00017952430739192338 | > current_lr_1: 0.00017952430739192338 | > step_time: 0.5553 (0.4997509585486518) | > loader_time: 0.0073 (0.020808961656358507)  --> TIME: 2023-10-20 00:50:29 -- STEP: 39/50 -- GLOBAL_STEP: 58440 | > loss_disc: 3.0855112075805664 (2.5114937531642423) | > loss_disc_real_0: 0.17853990197181702 (0.1621513143181801) | > loss_disc_real_1: 0.23734153807163239 (0.245437486240497) | > loss_disc_real_2: 0.2557424306869507 (0.2129678487395629) | > loss_disc_real_3: 0.22116369009017944 (0.2406969292041583) | > loss_disc_real_4: 0.31846922636032104 (0.23038284762356526) | > loss_disc_real_5: 0.4007824957370758 (0.24285208605802977) | > loss_0: 3.0855112075805664 (2.5114937531642423) | > grad_norm_0: tensor(1236.3153, device='cuda:0') (tensor(1329.9927, device='cuda:0')) | > loss_gen: 1.6312263011932373 (2.413266820785327) | > loss_kl: 0.9605114459991455 (1.0850773598903267) | > loss_feat: 0.10064461082220078 (5.263837122382262) | > loss_mel: 3.6695926189422607 (22.812793945654846) | > loss_duration: 1.7684366703033447 (1.7641949011729314) | > loss_1: 8.130411148071289 (33.339170419252824) | > grad_norm_1: tensor(35702.0664, device='cuda:0') (tensor(48073.5742, device='cuda:0')) | > current_lr_0: 0.00017952430739192338 | > current_lr_1: 0.00017952430739192338 | > step_time: 0.2517 (0.47949975576156223) | > loader_time: 0.0045 (0.019869443697807115)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.713291645050049 (2.713291645050049) | > loss_disc_real_0: 0.1212451308965683 (0.1212451308965683) | > loss_disc_real_1: 0.3796638250350952 (0.3796638250350952) | > loss_disc_real_2: 0.30529800057411194 (0.30529800057411194) | > loss_disc_real_3: 0.4379032254219055 (0.4379032254219055) | > loss_disc_real_4: 0.21423432230949402 (0.21423432230949402) | > loss_disc_real_5: 0.4088149070739746 (0.4088149070739746) | > loss_0: 2.713291645050049 (2.713291645050049) | > loss_gen: 2.735790491104126 (2.735790491104126) | > loss_kl: 2.108797311782837 (2.108797311782837) | > loss_feat: 5.037976264953613 (5.037976264953613) | > loss_mel: 28.906587600708008 (28.906587600708008) | > loss_duration: 2.0360028743743896 (2.0360028743743896) | > loss_1: 40.82515335083008 (40.82515335083008)  --> STEP: 1 | > loss_disc: 2.390993118286133 (2.390993118286133) | > loss_disc_real_0: 0.02475210279226303 (0.02475210279226303) | > loss_disc_real_1: 0.22357352077960968 (0.22357352077960968) | > loss_disc_real_2: 0.331830233335495 (0.331830233335495) | > loss_disc_real_3: 0.38753652572631836 (0.38753652572631836) | > loss_disc_real_4: 0.30321669578552246 (0.30321669578552246) | > loss_disc_real_5: 0.39355313777923584 (0.39355313777923584) | > loss_0: 2.390993118286133 (2.390993118286133) | > loss_gen: 3.2162442207336426 (3.2162442207336426) | > loss_kl: 2.3112893104553223 (2.3112893104553223) | > loss_feat: 6.901571750640869 (6.901571750640869) | > loss_mel: 23.622509002685547 (23.622509002685547) | > loss_duration: 2.1460797786712646 (2.1460797786712646) | > loss_1: 38.19769287109375 (38.19769287109375)  --> STEP: 2 | > loss_disc: 3.046323537826538 (2.7186583280563354) | > loss_disc_real_0: 0.047817081212997437 (0.036284592002630234) | > loss_disc_real_1: 0.3636362850666046 (0.29360490292310715) | > loss_disc_real_2: 0.2331209033727646 (0.2824755683541298) | > loss_disc_real_3: 0.17470556497573853 (0.28112104535102844) | > loss_disc_real_4: 0.13722486793994904 (0.22022078186273575) | > loss_disc_real_5: 0.24429789185523987 (0.31892551481723785) | > loss_0: 3.046323537826538 (2.7186583280563354) | > loss_gen: 1.5123755931854248 (2.3643099069595337) | > loss_kl: 2.4633235931396484 (2.3873064517974854) | > loss_feat: 6.973943710327148 (6.937757730484009) | > loss_mel: 30.876211166381836 (27.24936008453369) | > loss_duration: 2.1852123737335205 (2.1656460762023926) | > loss_1: 44.01106262207031 (41.10437774658203)  --> STEP: 3 | > loss_disc: 2.1506118774414062 (2.5293095111846924) | > loss_disc_real_0: 0.06856701523065567 (0.04704539974530538) | > loss_disc_real_1: 0.27041903138160706 (0.28587627907594043) | > loss_disc_real_2: 0.24401700496673584 (0.2696560472249985) | > loss_disc_real_3: 0.28649628162384033 (0.2829127907752991) | > loss_disc_real_4: 0.18718428909778595 (0.20920861760775247) | > loss_disc_real_5: 0.18089289963245392 (0.27291464308897656) | > loss_0: 2.1506118774414062 (2.5293095111846924) | > loss_gen: 2.3858141899108887 (2.371478001276652) | > loss_kl: 1.1283241510391235 (1.9676456848780315) | > loss_feat: 3.49357271194458 (5.789696057637532) | > loss_mel: 22.360130310058594 (25.619616826375324) | > loss_duration: 2.1418709754943848 (2.1577210426330566) | > loss_1: 31.50971221923828 (37.90615590413412) --> EVAL PERFORMANCE | > avg_loader_time: 0.00948007901509603 (-0.0026988983154296875) | > avg_loss_disc: 2.5293095111846924 (-0.08547616004943848) | > avg_loss_disc_real_0: 0.04704539974530538 (-0.15789064392447472) | > avg_loss_disc_real_1: 0.28587627907594043 (+0.03378317008415854) | > avg_loss_disc_real_2: 0.2696560472249985 (+0.03640654186407724) | > avg_loss_disc_real_3: 0.2829127907752991 (+0.03892455995082855) | > avg_loss_disc_real_4: 0.20920861760775247 (+0.01843765377998352) | > avg_loss_disc_real_5: 0.27291464308897656 (+0.10311770190795264) | > avg_loss_0: 2.5293095111846924 (-0.08547616004943848) | > avg_loss_gen: 2.371478001276652 (-0.19265528519948338) | > avg_loss_kl: 1.9676456848780315 (-0.2932037909825642) | > avg_loss_feat: 5.789696057637532 (+0.4244995911916094) | > avg_loss_mel: 25.619616826375324 (+1.5072186787923165) | > avg_loss_duration: 2.1577210426330566 (-0.053642908732096206) | > avg_loss_1: 37.90615590413412 (+1.3922138214111328)  > EPOCH: 109/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:50:43)   --> TIME: 2023-10-20 00:50:59 -- STEP: 19/50 -- GLOBAL_STEP: 58470 | > loss_disc: 2.78092622756958 (2.5725437653692147) | > loss_disc_real_0: 0.08166751265525818 (0.196747393200272) | > loss_disc_real_1: 0.22242064774036407 (0.23770237635625036) | > loss_disc_real_2: 0.24168908596038818 (0.23745023498409673) | > loss_disc_real_3: 0.22541403770446777 (0.24389738805199923) | > loss_disc_real_4: 0.303652286529541 (0.25152113445495305) | > loss_disc_real_5: 0.2885277569293976 (0.23771629717789197) | > loss_0: 2.78092622756958 (2.5725437653692147) | > grad_norm_0: tensor(2404.1946, device='cuda:0') (tensor(1601.6737, device='cuda:0')) | > loss_gen: 1.7143661975860596 (2.345223069190979) | > loss_kl: 1.2036572694778442 (0.9486952424049377) | > loss_feat: 1.5622602701187134 (5.174165416704981) | > loss_mel: 20.889995574951172 (25.96809552845202) | > loss_duration: 1.9078139066696167 (1.8165747617420398) | > loss_1: 27.278093338012695 (36.25275360910516) | > grad_norm_1: tensor(7878.1157, device='cuda:0') (tensor(39816.9648, device='cuda:0')) | > current_lr_0: 0.0001793448616067835 | > current_lr_1: 0.0001793448616067835 | > step_time: 0.5525 (0.4828133834035773) | > loader_time: 0.0231 (0.014458844536229185)  --> TIME: 2023-10-20 00:51:14 -- STEP: 49/50 -- GLOBAL_STEP: 58500 | > loss_disc: 2.7348453998565674 (2.468121966537165) | > loss_disc_real_0: 0.38851937651634216 (0.1679406889467215) | > loss_disc_real_1: 0.28520315885543823 (0.23578301421841796) | > loss_disc_real_2: 0.2557884454727173 (0.22163170743353514) | > loss_disc_real_3: 0.2728535234928131 (0.24863954367382185) | > loss_disc_real_4: 0.24098682403564453 (0.23718225028441878) | > loss_disc_real_5: 0.2600725591182709 (0.21525053732211188) | > loss_0: 2.7348453998565674 (2.468121966537165) | > grad_norm_0: tensor(3384.0430, device='cuda:0') (tensor(1384.5455, device='cuda:0')) | > loss_gen: 2.147254467010498 (2.4080878642140604) | > loss_kl: 1.0470653772354126 (1.0847037118308391) | > loss_feat: 1.9468895196914673 (4.868598515281871) | > loss_mel: 20.7760009765625 (23.577912320896072) | > loss_duration: 1.8877203464508057 (1.765535490853446) | > loss_1: 27.804931640625 (33.70483762390759) | > grad_norm_1: tensor(8746.2451, device='cuda:0') (tensor(42488.6953, device='cuda:0')) | > current_lr_0: 0.0001793448616067835 | > current_lr_1: 0.0001793448616067835 | > step_time: 0.6483 (0.4862473740869639) | > loader_time: 0.3202 (0.02222583731826471)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.485934257507324 (2.485934257507324) | > loss_disc_real_0: 0.06417767703533173 (0.06417767703533173) | > loss_disc_real_1: 0.29840603470802307 (0.29840603470802307) | > loss_disc_real_2: 0.2048960030078888 (0.2048960030078888) | > loss_disc_real_3: 0.18654905259609222 (0.18654905259609222) | > loss_disc_real_4: 0.2240251898765564 (0.2240251898765564) | > loss_disc_real_5: 0.32120415568351746 (0.32120415568351746) | > loss_0: 2.485934257507324 (2.485934257507324) | > loss_gen: 2.0606284141540527 (2.0606284141540527) | > loss_kl: 1.6662596464157104 (1.6662596464157104) | > loss_feat: 4.461211681365967 (4.461211681365967) | > loss_mel: 24.173290252685547 (24.173290252685547) | > loss_duration: 2.0973920822143555 (2.0973920822143555) | > loss_1: 34.45878219604492 (34.45878219604492)  --> STEP: 1 | > loss_disc: 2.2305502891540527 (2.2305502891540527) | > loss_disc_real_0: 0.15436530113220215 (0.15436530113220215) | > loss_disc_real_1: 0.19612948596477509 (0.19612948596477509) | > loss_disc_real_2: 0.2882114350795746 (0.2882114350795746) | > loss_disc_real_3: 0.21912918984889984 (0.21912918984889984) | > loss_disc_real_4: 0.10071852803230286 (0.10071852803230286) | > loss_disc_real_5: 0.14802110195159912 (0.14802110195159912) | > loss_0: 2.2305502891540527 (2.2305502891540527) | > loss_gen: 2.201525926589966 (2.201525926589966) | > loss_kl: 3.8490517139434814 (3.8490517139434814) | > loss_feat: 6.44810152053833 (6.44810152053833) | > loss_mel: 26.87173843383789 (26.87173843383789) | > loss_duration: 2.2373998165130615 (2.2373998165130615) | > loss_1: 41.607818603515625 (41.607818603515625)  --> STEP: 2 | > loss_disc: 2.486771583557129 (2.358660936355591) | > loss_disc_real_0: 0.07204578816890717 (0.11320554465055466) | > loss_disc_real_1: 0.1336914747953415 (0.1649104803800583) | > loss_disc_real_2: 0.14406098425388336 (0.21613620966672897) | > loss_disc_real_3: 0.19803261756896973 (0.20858090370893478) | > loss_disc_real_4: 0.16027472913265228 (0.13049662858247757) | > loss_disc_real_5: 0.20722061395645142 (0.17762085795402527) | > loss_0: 2.486771583557129 (2.358660936355591) | > loss_gen: 1.713822603225708 (1.957674264907837) | > loss_kl: 2.2536261081695557 (3.0513389110565186) | > loss_feat: 8.474575996398926 (7.461338758468628) | > loss_mel: 28.593292236328125 (27.732515335083008) | > loss_duration: 2.251636505126953 (2.2445181608200073) | > loss_1: 43.28695297241211 (42.44738578796387)  --> STEP: 3 | > loss_disc: 1.032847285270691 (1.9167230526606243) | > loss_disc_real_0: 0.06587263196706772 (0.09742790708939235) | > loss_disc_real_1: 0.08519764244556427 (0.13833953440189362) | > loss_disc_real_2: 0.017976049333810806 (0.15008282288908958) | > loss_disc_real_3: 0.11539012938737869 (0.17751731226841608) | > loss_disc_real_4: 0.04474608227610588 (0.10191311314702034) | > loss_disc_real_5: 0.029415730386972427 (0.12821914876500765) | > loss_0: 1.032847285270691 (1.9167230526606243) | > loss_gen: 3.142791748046875 (2.352713425954183) | > loss_kl: 1.1342287063598633 (2.4123021761576333) | > loss_feat: 11.951199531555176 (8.957959016164144) | > loss_mel: 29.230499267578125 (28.23184331258138) | > loss_duration: 2.121194839477539 (2.2034103870391846) | > loss_1: 47.57991027832031 (44.15822728474935) --> EVAL PERFORMANCE | > avg_loader_time: 0.009969870249430338 (+0.0004897912343343087) | > avg_loss_disc: 1.9167230526606243 (-0.6125864585240681) | > avg_loss_disc_real_0: 0.09742790708939235 (+0.05038250734408697) | > avg_loss_disc_real_1: 0.13833953440189362 (-0.14753674467404682) | > avg_loss_disc_real_2: 0.15008282288908958 (-0.11957322433590889) | > avg_loss_disc_real_3: 0.17751731226841608 (-0.105395478506883) | > avg_loss_disc_real_4: 0.10191311314702034 (-0.10729550446073213) | > avg_loss_disc_real_5: 0.12821914876500765 (-0.14469549432396892) | > avg_loss_0: 1.9167230526606243 (-0.6125864585240681) | > avg_loss_gen: 2.352713425954183 (-0.01876457532246878) | > avg_loss_kl: 2.4123021761576333 (+0.44465649127960183) | > avg_loss_feat: 8.957959016164144 (+3.168262958526612) | > avg_loss_mel: 28.23184331258138 (+2.6122264862060547) | > avg_loss_duration: 2.2034103870391846 (+0.04568934440612793) | > avg_loss_1: 44.15822728474935 (+6.252071380615234)  > EPOCH: 110/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:51:26)   --> TIME: 2023-10-20 00:51:41 -- STEP: 29/50 -- GLOBAL_STEP: 58530 | > loss_disc: 2.669729232788086 (2.580792620264251) | > loss_disc_real_0: 0.08653631806373596 (0.17753976236643465) | > loss_disc_real_1: 0.22288435697555542 (0.23980498275366322) | > loss_disc_real_2: 0.1990693062543869 (0.23400512645984517) | > loss_disc_real_3: 0.24218954145908356 (0.2414913235296463) | > loss_disc_real_4: 0.22346848249435425 (0.21702049980903493) | > loss_disc_real_5: 0.28368571400642395 (0.22794464127770786) | > loss_0: 2.669729232788086 (2.580792620264251) | > grad_norm_0: tensor(2058.3445, device='cuda:0') (tensor(1524.9580, device='cuda:0')) | > loss_gen: 1.7616134881973267 (2.2065093393983513) | > loss_kl: 0.7934948801994324 (1.0989442991799323) | > loss_feat: 1.2595007419586182 (4.3738890967235475) | > loss_mel: 17.66860580444336 (22.415617063127716) | > loss_duration: 1.7171716690063477 (1.7930986018016422) | > loss_1: 23.20038604736328 (31.88805839933198) | > grad_norm_1: tensor(18984.5273, device='cuda:0') (tensor(34662.1172, device='cuda:0')) | > current_lr_0: 0.00017916559518894084 | > current_lr_1: 0.00017916559518894084 | > step_time: 0.6703 (0.38062316795875284) | > loader_time: 0.022 (0.010244895671976024)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.980525255203247 (2.980525255203247) | > loss_disc_real_0: 0.3597119152545929 (0.3597119152545929) | > loss_disc_real_1: 0.2691335082054138 (0.2691335082054138) | > loss_disc_real_2: 0.296177476644516 (0.296177476644516) | > loss_disc_real_3: 0.25265660881996155 (0.25265660881996155) | > loss_disc_real_4: 0.2919231057167053 (0.2919231057167053) | > loss_disc_real_5: 0.3614588677883148 (0.3614588677883148) | > loss_0: 2.980525255203247 (2.980525255203247) | > loss_gen: 1.9337515830993652 (1.9337515830993652) | > loss_kl: 1.8653184175491333 (1.8653184175491333) | > loss_feat: 0.30390992760658264 (0.30390992760658264) | > loss_mel: 12.00049114227295 (12.00049114227295) | > loss_duration: 2.0521938800811768 (2.0521938800811768) | > loss_1: 18.15566635131836 (18.15566635131836)  --> STEP: 1 | > loss_disc: 2.6054000854492188 (2.6054000854492188) | > loss_disc_real_0: 0.16504459083080292 (0.16504459083080292) | > loss_disc_real_1: 0.10261847078800201 (0.10261847078800201) | > loss_disc_real_2: 0.12718363106250763 (0.12718363106250763) | > loss_disc_real_3: 0.24929268658161163 (0.24929268658161163) | > loss_disc_real_4: 0.2354312390089035 (0.2354312390089035) | > loss_disc_real_5: 0.17522332072257996 (0.17522332072257996) | > loss_0: 2.6054000854492188 (2.6054000854492188) | > loss_gen: 2.0360140800476074 (2.0360140800476074) | > loss_kl: 2.534470319747925 (2.534470319747925) | > loss_feat: 8.860652923583984 (8.860652923583984) | > loss_mel: 26.30649185180664 (26.30649185180664) | > loss_duration: 2.1913576126098633 (2.1913576126098633) | > loss_1: 41.928985595703125 (41.928985595703125)  --> STEP: 2 | > loss_disc: 3.0071945190429688 (2.8062973022460938) | > loss_disc_real_0: 0.40550002455711365 (0.2852723076939583) | > loss_disc_real_1: 0.2664286494255066 (0.1845235601067543) | > loss_disc_real_2: 0.3074074387550354 (0.21729553490877151) | > loss_disc_real_3: 0.254657506942749 (0.25197509676218033) | > loss_disc_real_4: 0.2922249734401703 (0.2638281062245369) | > loss_disc_real_5: 0.36332717537879944 (0.2692752480506897) | > loss_0: 3.0071945190429688 (2.8062973022460938) | > loss_gen: 1.9865615367889404 (2.011287808418274) | > loss_kl: 2.360445976257324 (2.4474581480026245) | > loss_feat: 0.4407585859298706 (4.6507057547569275) | > loss_mel: 26.191518783569336 (26.24900531768799) | > loss_duration: 2.2140958309173584 (2.202726721763611) | > loss_1: 33.19337844848633 (37.56118202209473)  --> STEP: 3 | > loss_disc: 2.4562318325042725 (2.6896088123321533) | > loss_disc_real_0: 0.4046552777290344 (0.32506663103898364) | > loss_disc_real_1: 0.24798539280891418 (0.2056775043408076) | > loss_disc_real_2: 0.22056542336940765 (0.21838549772898355) | > loss_disc_real_3: 0.36885276436805725 (0.29093431929747265) | > loss_disc_real_4: 0.20455192029476166 (0.24406937758127847) | > loss_disc_real_5: 0.23450618982315063 (0.2576855619748433) | > loss_0: 2.4562318325042725 (2.6896088123321533) | > loss_gen: 2.7683827877044678 (2.263652801513672) | > loss_kl: 0.9789079427719116 (1.9579414129257202) | > loss_feat: 3.8408164978027344 (4.38074266910553) | > loss_mel: 21.723567962646484 (24.74052619934082) | > loss_duration: 2.162334442138672 (2.189262628555298) | > loss_1: 31.474010467529297 (35.532124837239586) --> EVAL PERFORMANCE | > avg_loader_time: 0.0035167535146077475 (-0.00645311673482259) | > avg_loss_disc: 2.6896088123321533 (+0.7728857596715291) | > avg_loss_disc_real_0: 0.32506663103898364 (+0.22763872394959128) | > avg_loss_disc_real_1: 0.2056775043408076 (+0.06733796993891397) | > avg_loss_disc_real_2: 0.21838549772898355 (+0.06830267483989397) | > avg_loss_disc_real_3: 0.29093431929747265 (+0.11341700702905658) | > avg_loss_disc_real_4: 0.24406937758127847 (+0.14215626443425813) | > avg_loss_disc_real_5: 0.2576855619748433 (+0.12946641320983568) | > avg_loss_0: 2.6896088123321533 (+0.7728857596715291) | > avg_loss_gen: 2.263652801513672 (-0.08906062444051122) | > avg_loss_kl: 1.9579414129257202 (-0.4543607632319131) | > avg_loss_feat: 4.38074266910553 (-4.577216347058615) | > avg_loss_mel: 24.74052619934082 (-3.4913171132405587) | > avg_loss_duration: 2.189262628555298 (-0.014147758483886719) | > avg_loss_1: 35.532124837239586 (-8.626102447509766)  > EPOCH: 111/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:52:00)   --> TIME: 2023-10-20 00:52:08 -- STEP: 9/50 -- GLOBAL_STEP: 58560 | > loss_disc: 2.992833137512207 (2.764934857686361) | > loss_disc_real_0: 0.37587592005729675 (0.16550167753464645) | > loss_disc_real_1: 0.3447452783584595 (0.25151508880986106) | > loss_disc_real_2: 0.2210547924041748 (0.25575880375173354) | > loss_disc_real_3: 0.2504640519618988 (0.2302924460834927) | > loss_disc_real_4: 0.2961265444755554 (0.25842786580324173) | > loss_disc_real_5: 0.38656848669052124 (0.33772624366813236) | > loss_0: 2.992833137512207 (2.764934857686361) | > grad_norm_0: tensor(1473.5460, device='cuda:0') (tensor(2353.6714, device='cuda:0')) | > loss_gen: 1.6877341270446777 (2.307541595564948) | > loss_kl: 0.6034556031227112 (1.029907504717509) | > loss_feat: 0.26359131932258606 (4.754257172346115) | > loss_mel: 17.738616943359375 (22.175179057651096) | > loss_duration: 1.6813995838165283 (1.7389066881603665) | > loss_1: 21.97479820251465 (32.00579251183404) | > grad_norm_1: tensor(55469.2422, device='cuda:0') (tensor(52161.3242, device='cuda:0')) | > current_lr_0: 0.00017898650795910656 | > current_lr_1: 0.00017898650795910656 | > step_time: 0.3351 (0.5061003102196587) | > loader_time: 0.0019 (0.019010014004177518)  --> TIME: 2023-10-20 00:52:23 -- STEP: 39/50 -- GLOBAL_STEP: 58590 | > loss_disc: 2.075589418411255 (2.590917862378634) | > loss_disc_real_0: 0.24186478555202484 (0.17010842707867807) | > loss_disc_real_1: 0.4280394911766052 (0.23456631161463568) | > loss_disc_real_2: 0.12033949047327042 (0.23417170603687948) | > loss_disc_real_3: 0.15078161656856537 (0.2259734129676452) | > loss_disc_real_4: 0.1928781419992447 (0.23232790302389708) | > loss_disc_real_5: 0.09751931577920914 (0.246194987724989) | > loss_0: 2.075589418411255 (2.590917862378634) | > grad_norm_0: tensor(1425.6669, device='cuda:0') (tensor(1513.6599, device='cuda:0')) | > loss_gen: 2.9625473022460938 (2.2203632318056545) | > loss_kl: 1.1937607526779175 (1.0492873444006994) | > loss_feat: 6.178133010864258 (4.591885442535083) | > loss_mel: 30.35371971130371 (23.382150772290352) | > loss_duration: 1.7788270711898804 (1.7510482592460437) | > loss_1: 42.46698760986328 (32.99473564441387) | > grad_norm_1: tensor(60511.4453, device='cuda:0') (tensor(37971.1484, device='cuda:0')) | > current_lr_0: 0.00017898650795910656 | > current_lr_1: 0.00017898650795910656 | > step_time: 0.3191 (0.49134080837934446) | > loader_time: 0.0249 (0.02036289679698455)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.519606351852417 (2.519606351852417) | > loss_disc_real_0: 0.16081534326076508 (0.16081534326076508) | > loss_disc_real_1: 0.14766007661819458 (0.14766007661819458) | > loss_disc_real_2: 0.029698392376303673 (0.029698392376303673) | > loss_disc_real_3: 0.11422444134950638 (0.11422444134950638) | > loss_disc_real_4: 0.10812360048294067 (0.10812360048294067) | > loss_disc_real_5: 0.09952455013990402 (0.09952455013990402) | > loss_0: 2.519606351852417 (2.519606351852417) | > loss_gen: 1.7373836040496826 (1.7373836040496826) | > loss_kl: 1.5457161664962769 (1.5457161664962769) | > loss_feat: 8.261420249938965 (8.261420249938965) | > loss_mel: 28.742908477783203 (28.742908477783203) | > loss_duration: 2.0637519359588623 (2.0637519359588623) | > loss_1: 42.35118103027344 (42.35118103027344)  --> STEP: 1 | > loss_disc: 2.976341962814331 (2.976341962814331) | > loss_disc_real_0: 0.19685111939907074 (0.19685111939907074) | > loss_disc_real_1: 0.32366135716438293 (0.32366135716438293) | > loss_disc_real_2: 0.13704979419708252 (0.13704979419708252) | > loss_disc_real_3: 0.2763679027557373 (0.2763679027557373) | > loss_disc_real_4: 0.30693158507347107 (0.30693158507347107) | > loss_disc_real_5: 0.3201954960823059 (0.3201954960823059) | > loss_0: 2.976341962814331 (2.976341962814331) | > loss_gen: 1.6676981449127197 (1.6676981449127197) | > loss_kl: 3.0719845294952393 (3.0719845294952393) | > loss_feat: 0.9655560255050659 (0.9655560255050659) | > loss_mel: 21.92909049987793 (21.92909049987793) | > loss_duration: 2.2832088470458984 (2.2832088470458984) | > loss_1: 29.917537689208984 (29.917537689208984)  --> STEP: 2 | > loss_disc: 2.934001922607422 (2.9551719427108765) | > loss_disc_real_0: 0.18649744987487793 (0.19167428463697433) | > loss_disc_real_1: 0.267871618270874 (0.2957664877176285) | > loss_disc_real_2: 0.1432570517063141 (0.1401534229516983) | > loss_disc_real_3: 0.2674259841442108 (0.27189694344997406) | > loss_disc_real_4: 0.3130195438861847 (0.3099755644798279) | > loss_disc_real_5: 0.3035508096218109 (0.3118731528520584) | > loss_0: 2.934001922607422 (2.9551719427108765) | > loss_gen: 1.6239385604858398 (1.6458183526992798) | > loss_kl: 2.688917636871338 (2.8804510831832886) | > loss_feat: 0.9364309310913086 (0.9509934782981873) | > loss_mel: 10.240029335021973 (16.08455991744995) | > loss_duration: 2.2664055824279785 (2.2748072147369385) | > loss_1: 17.755722045898438 (23.83662986755371)  --> STEP: 3 | > loss_disc: 3.3046412467956543 (3.0716617107391357) | > loss_disc_real_0: 0.22330886125564575 (0.2022191435098648) | > loss_disc_real_1: 0.24225690960884094 (0.27792996168136597) | > loss_disc_real_2: 0.42748507857322693 (0.23593064149220785) | > loss_disc_real_3: 0.28451454639434814 (0.27610281109809875) | > loss_disc_real_4: 0.4137764871120453 (0.34457587202390033) | > loss_disc_real_5: 0.4067935347557068 (0.34351328015327454) | > loss_0: 3.3046412467956543 (3.0716617107391357) | > loss_gen: 1.9259862899780273 (1.739207665125529) | > loss_kl: 1.336717963218689 (2.365873376528422) | > loss_feat: 3.450347900390625 (1.7841116189956665) | > loss_mel: 23.141136169433594 (18.4367520014445) | > loss_duration: 2.219412326812744 (2.2563422520955405) | > loss_1: 32.07360076904297 (26.582286834716797) --> EVAL PERFORMANCE | > avg_loader_time: 0.01511240005493164 (+0.011595646540323893) | > avg_loss_disc: 3.0716617107391357 (+0.3820528984069824) | > avg_loss_disc_real_0: 0.2022191435098648 (-0.12284748752911884) | > avg_loss_disc_real_1: 0.27792996168136597 (+0.07225245734055838) | > avg_loss_disc_real_2: 0.23593064149220785 (+0.017545143763224302) | > avg_loss_disc_real_3: 0.27610281109809875 (-0.0148315081993739) | > avg_loss_disc_real_4: 0.34457587202390033 (+0.10050649444262186) | > avg_loss_disc_real_5: 0.34351328015327454 (+0.08582771817843121) | > avg_loss_0: 3.0716617107391357 (+0.3820528984069824) | > avg_loss_gen: 1.739207665125529 (-0.5244451363881428) | > avg_loss_kl: 2.365873376528422 (+0.4079319636027017) | > avg_loss_feat: 1.7841116189956665 (-2.5966310501098633) | > avg_loss_mel: 18.4367520014445 (-6.30377419789632) | > avg_loss_duration: 2.2563422520955405 (+0.06707962354024266) | > avg_loss_1: 26.582286834716797 (-8.949838002522789)  > EPOCH: 112/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:52:39)   --> TIME: 2023-10-20 00:52:53 -- STEP: 19/50 -- GLOBAL_STEP: 58620 | > loss_disc: 2.1842989921569824 (2.669730675847907) | > loss_disc_real_0: 0.10757756233215332 (0.20146091654896736) | > loss_disc_real_1: 0.16972698271274567 (0.22291940019318932) | > loss_disc_real_2: 0.2047504037618637 (0.26790721381181165) | > loss_disc_real_3: 0.3129010498523712 (0.24045640308605998) | > loss_disc_real_4: 0.07397069036960602 (0.23973937332630157) | > loss_disc_real_5: 0.07951553910970688 (0.2080545254835957) | > loss_0: 2.1842989921569824 (2.669730675847907) | > grad_norm_0: tensor(687.4892, device='cuda:0') (tensor(973.7667, device='cuda:0')) | > loss_gen: 2.1317710876464844 (2.184022087799876) | > loss_kl: 0.9989357590675354 (1.0923037215283042) | > loss_feat: 4.85429573059082 (4.562842846701019) | > loss_mel: 22.730281829833984 (22.043067932128906) | > loss_duration: 1.8931598663330078 (1.7968639762778031) | > loss_1: 32.60844421386719 (31.6791000115244) | > grad_norm_1: tensor(17116.6855, device='cuda:0') (tensor(26988.1836, device='cuda:0')) | > current_lr_0: 0.00017880759973817103 | > current_lr_1: 0.00017880759973817103 | > step_time: 0.5773 (0.4975844809883519) | > loader_time: 0.0042 (0.013358969437448602)  --> TIME: 2023-10-20 00:53:09 -- STEP: 49/50 -- GLOBAL_STEP: 58650 | > loss_disc: 2.9108684062957764 (2.5688228108445) | > loss_disc_real_0: 0.20756836235523224 (0.195405610989095) | > loss_disc_real_1: 0.25328710675239563 (0.23395703117154082) | > loss_disc_real_2: 0.23981353640556335 (0.23189799365948657) | > loss_disc_real_3: 0.22351409494876862 (0.24290077509928723) | > loss_disc_real_4: 0.22332629561424255 (0.23019672322029971) | > loss_disc_real_5: 0.295571506023407 (0.2291769291065177) | > loss_0: 2.9108684062957764 (2.5688228108445) | > grad_norm_0: tensor(2443.7253, device='cuda:0') (tensor(1011.8988, device='cuda:0')) | > loss_gen: 1.5547101497650146 (2.2638855588679427) | > loss_kl: 0.7070862054824829 (1.0147705000578138) | > loss_feat: 0.36148855090141296 (4.838199714616855) | > loss_mel: 21.47878646850586 (22.602350390687285) | > loss_duration: 1.898435115814209 (1.7601782594408308) | > loss_1: 26.000507354736328 (32.47938450988456) | > grad_norm_1: tensor(17317.4395, device='cuda:0') (tensor(29035.6270, device='cuda:0')) | > current_lr_0: 0.00017880759973817103 | > current_lr_1: 0.00017880759973817103 | > step_time: 0.5877 (0.5096637959382972) | > loader_time: 0.3525 (0.02358856006544463)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7840118408203125 (2.7840118408203125) | > loss_disc_real_0: 0.08324132114648819 (0.08324132114648819) | > loss_disc_real_1: 0.2525642216205597 (0.2525642216205597) | > loss_disc_real_2: 0.3272310495376587 (0.3272310495376587) | > loss_disc_real_3: 0.328498899936676 (0.328498899936676) | > loss_disc_real_4: 0.3680601119995117 (0.3680601119995117) | > loss_disc_real_5: 0.3394690454006195 (0.3394690454006195) | > loss_0: 2.7840118408203125 (2.7840118408203125) | > loss_gen: 2.1216368675231934 (2.1216368675231934) | > loss_kl: 2.0918025970458984 (2.0918025970458984) | > loss_feat: 3.1715986728668213 (3.1715986728668213) | > loss_mel: 23.14773941040039 (23.14773941040039) | > loss_duration: 2.04274845123291 (2.04274845123291) | > loss_1: 32.57552719116211 (32.57552719116211)  --> STEP: 1 | > loss_disc: 2.864238739013672 (2.864238739013672) | > loss_disc_real_0: 0.09219127893447876 (0.09219127893447876) | > loss_disc_real_1: 0.2562233805656433 (0.2562233805656433) | > loss_disc_real_2: 0.20244531333446503 (0.20244531333446503) | > loss_disc_real_3: 0.25593629479408264 (0.25593629479408264) | > loss_disc_real_4: 0.495807021856308 (0.495807021856308) | > loss_disc_real_5: 0.4726507067680359 (0.4726507067680359) | > loss_0: 2.864238739013672 (2.864238739013672) | > loss_gen: 2.2676126956939697 (2.2676126956939697) | > loss_kl: 3.161564826965332 (3.161564826965332) | > loss_feat: 7.000381946563721 (7.000381946563721) | > loss_mel: 25.170392990112305 (25.170392990112305) | > loss_duration: 2.1524527072906494 (2.1524527072906494) | > loss_1: 39.75240707397461 (39.75240707397461)  --> STEP: 2 | > loss_disc: 3.017150402069092 (2.940694570541382) | > loss_disc_real_0: 0.17725054919719696 (0.13472091406583786) | > loss_disc_real_1: 0.2609882354736328 (0.25860580801963806) | > loss_disc_real_2: 0.24949446320533752 (0.22596988826990128) | > loss_disc_real_3: 0.21540366113185883 (0.23566997796297073) | > loss_disc_real_4: 0.2379835993051529 (0.36689531058073044) | > loss_disc_real_5: 0.28135761618614197 (0.37700416147708893) | > loss_0: 3.017150402069092 (2.940694570541382) | > loss_gen: 1.4240992069244385 (1.845855951309204) | > loss_kl: 2.5589866638183594 (2.8602757453918457) | > loss_feat: 0.01962626911699772 (3.510004107840359) | > loss_mel: 1.8750629425048828 (13.522727966308594) | > loss_duration: 2.2070252895355225 (2.179738998413086) | > loss_1: 8.084800720214844 (23.918603897094727)  --> STEP: 3 | > loss_disc: 2.9905548095703125 (2.957314650217692) | > loss_disc_real_0: 0.3355245292186737 (0.20165545245011648) | > loss_disc_real_1: 0.3165631890296936 (0.2779249350229899) | > loss_disc_real_2: 0.33775219321250916 (0.2632306565841039) | > loss_disc_real_3: 0.17468003928661346 (0.21533999840418497) | > loss_disc_real_4: 0.402048796415329 (0.3786131391922633) | > loss_disc_real_5: 0.35278964042663574 (0.3689326544602712) | > loss_0: 2.9905548095703125 (2.957314650217692) | > loss_gen: 2.2268848419189453 (1.9728655815124512) | > loss_kl: 1.4342459440231323 (2.3849324782689414) | > loss_feat: 3.4911582469940186 (3.503722154224912) | > loss_mel: 27.23737907409668 (18.09427833557129) | > loss_duration: 2.215846061706543 (2.1917746861775718) | > loss_1: 36.60551834106445 (28.14757537841797) --> EVAL PERFORMANCE | > avg_loader_time: 0.013029336929321289 (-0.0020830631256103516) | > avg_loss_disc: 2.957314650217692 (-0.11434706052144383) | > avg_loss_disc_real_0: 0.20165545245011648 (-0.0005636910597483225) | > avg_loss_disc_real_1: 0.2779249350229899 (-5.026658376039439e-06) | > avg_loss_disc_real_2: 0.2632306565841039 (+0.02730001509189603) | > avg_loss_disc_real_3: 0.21533999840418497 (-0.06076281269391379) | > avg_loss_disc_real_4: 0.3786131391922633 (+0.03403726716836297) | > avg_loss_disc_real_5: 0.3689326544602712 (+0.025419374306996645) | > avg_loss_0: 2.957314650217692 (-0.11434706052144383) | > avg_loss_gen: 1.9728655815124512 (+0.23365791638692213) | > avg_loss_kl: 2.3849324782689414 (+0.019059101740519502) | > avg_loss_feat: 3.503722154224912 (+1.7196105352292457) | > avg_loss_mel: 18.09427833557129 (-0.3424736658732108) | > avg_loss_duration: 2.1917746861775718 (-0.06456756591796875) | > avg_loss_1: 28.14757537841797 (+1.5652885437011719)  > EPOCH: 113/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:53:18)   --> TIME: 2023-10-20 00:53:34 -- STEP: 29/50 -- GLOBAL_STEP: 58680 | > loss_disc: 2.9154505729675293 (2.3655837486530173) | > loss_disc_real_0: 0.2216150164604187 (0.13305080168206115) | > loss_disc_real_1: 0.3313264548778534 (0.2357617629499271) | > loss_disc_real_2: 0.3248650133609772 (0.19929127754836246) | > loss_disc_real_3: 0.2740793824195862 (0.2486245660432454) | > loss_disc_real_4: 0.3589938282966614 (0.20940089945135446) | > loss_disc_real_5: 0.2566138207912445 (0.22281162838997512) | > loss_0: 2.9154505729675293 (2.3655837486530173) | > grad_norm_0: tensor(901.7267, device='cuda:0') (tensor(919.4371, device='cuda:0')) | > loss_gen: 1.8682047128677368 (2.6003984993901748) | > loss_kl: 0.9042995572090149 (1.090232472995232) | > loss_feat: 0.37990128993988037 (6.47055427987) | > loss_mel: 17.520214080810547 (25.820239609685437) | > loss_duration: 1.7762062549591064 (1.7848266568677178) | > loss_1: 22.44882583618164 (37.76625139959927) | > grad_norm_1: tensor(26795.7402, device='cuda:0') (tensor(51460.9492, device='cuda:0')) | > current_lr_0: 0.00017862887034720366 | > current_lr_1: 0.00017862887034720366 | > step_time: 0.2537 (0.4211764006779111) | > loader_time: 0.0018 (0.009734910109947467)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2590856552124023 (2.2590856552124023) | > loss_disc_real_0: 0.021655656397342682 (0.021655656397342682) | > loss_disc_real_1: 0.2751079797744751 (0.2751079797744751) | > loss_disc_real_2: 0.25354188680648804 (0.25354188680648804) | > loss_disc_real_3: 0.21523413062095642 (0.21523413062095642) | > loss_disc_real_4: 0.1900864839553833 (0.1900864839553833) | > loss_disc_real_5: 0.21995487809181213 (0.21995487809181213) | > loss_0: 2.2590856552124023 (2.2590856552124023) | > loss_gen: 2.344717025756836 (2.344717025756836) | > loss_kl: 2.2148241996765137 (2.2148241996765137) | > loss_feat: 5.04693603515625 (5.04693603515625) | > loss_mel: 29.227832794189453 (29.227832794189453) | > loss_duration: 2.0729496479034424 (2.0729496479034424) | > loss_1: 40.90726089477539 (40.90726089477539)  --> STEP: 1 | > loss_disc: 2.778026580810547 (2.778026580810547) | > loss_disc_real_0: 0.1744116246700287 (0.1744116246700287) | > loss_disc_real_1: 0.2740410268306732 (0.2740410268306732) | > loss_disc_real_2: 0.24756260216236115 (0.24756260216236115) | > loss_disc_real_3: 0.28010907769203186 (0.28010907769203186) | > loss_disc_real_4: 0.39488744735717773 (0.39488744735717773) | > loss_disc_real_5: 0.2666987478733063 (0.2666987478733063) | > loss_0: 2.778026580810547 (2.778026580810547) | > loss_gen: 2.006056547164917 (2.006056547164917) | > loss_kl: 2.188032627105713 (2.188032627105713) | > loss_feat: 1.48166823387146 (1.48166823387146) | > loss_mel: 19.958782196044922 (19.958782196044922) | > loss_duration: 2.2026867866516113 (2.2026867866516113) | > loss_1: 27.83722496032715 (27.83722496032715)  --> STEP: 2 | > loss_disc: 2.1516740322113037 (2.4648503065109253) | > loss_disc_real_0: 0.024654358625411987 (0.09953299164772034) | > loss_disc_real_1: 0.04860442504286766 (0.16132272593677044) | > loss_disc_real_2: 0.16849936544895172 (0.20803098380565643) | > loss_disc_real_3: 0.06428802013397217 (0.17219854891300201) | > loss_disc_real_4: 0.14909711480140686 (0.2719922810792923) | > loss_disc_real_5: 0.03973659500479698 (0.15321767143905163) | > loss_0: 2.1516740322113037 (2.4648503065109253) | > loss_gen: 2.1480236053466797 (2.0770400762557983) | > loss_kl: 3.286137104034424 (2.7370848655700684) | > loss_feat: 12.335164070129395 (6.908416152000427) | > loss_mel: 24.421518325805664 (22.190150260925293) | > loss_duration: 2.2027363777160645 (2.202711582183838) | > loss_1: 44.393577575683594 (36.11540126800537)  --> STEP: 3 | > loss_disc: 2.2359848022460938 (2.388561805089315) | > loss_disc_real_0: 0.11812262237071991 (0.10572953522205353) | > loss_disc_real_1: 0.23135043680667877 (0.18466529622673988) | > loss_disc_real_2: 0.38283950090408325 (0.266300489505132) | > loss_disc_real_3: 0.09721769392490387 (0.14720493058363596) | > loss_disc_real_4: 0.29454055428504944 (0.279508372147878) | > loss_disc_real_5: 0.34136539697647095 (0.21593357995152473) | > loss_0: 2.2359848022460938 (2.388561805089315) | > loss_gen: 2.7133138179779053 (2.2891313234965005) | > loss_kl: 1.6132380962371826 (2.36246927579244) | > loss_feat: 4.602565765380859 (6.139799356460571) | > loss_mel: 25.61383819580078 (23.331379572550457) | > loss_duration: 2.175860643386841 (2.1937612692515054) | > loss_1: 36.71881866455078 (36.31654040018717) --> EVAL PERFORMANCE | > avg_loader_time: 0.010394811630249023 (-0.0026345252990722656) | > avg_loss_disc: 2.388561805089315 (-0.568752845128377) | > avg_loss_disc_real_0: 0.10572953522205353 (-0.09592591722806296) | > avg_loss_disc_real_1: 0.18466529622673988 (-0.09325963879625004) | > avg_loss_disc_real_2: 0.266300489505132 (+0.003069832921028137) | > avg_loss_disc_real_3: 0.14720493058363596 (-0.06813506782054901) | > avg_loss_disc_real_4: 0.279508372147878 (-0.09910476704438531) | > avg_loss_disc_real_5: 0.21593357995152473 (-0.15299907450874645) | > avg_loss_0: 2.388561805089315 (-0.568752845128377) | > avg_loss_gen: 2.2891313234965005 (+0.31626574198404933) | > avg_loss_kl: 2.36246927579244 (-0.022463202476501465) | > avg_loss_feat: 6.139799356460571 (+2.636077202235659) | > avg_loss_mel: 23.331379572550457 (+5.237101236979168) | > avg_loss_duration: 2.1937612692515054 (+0.001986583073933623) | > avg_loss_1: 36.31654040018717 (+8.168965021769203)  > EPOCH: 114/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:53:54)   --> TIME: 2023-10-20 00:54:03 -- STEP: 9/50 -- GLOBAL_STEP: 58710 | > loss_disc: 3.009765148162842 (2.6330587334103055) | > loss_disc_real_0: 0.0823974758386612 (0.23550270477102864) | > loss_disc_real_1: 0.2731318771839142 (0.23280784404940075) | > loss_disc_real_2: 0.2512715458869934 (0.2724420958095127) | > loss_disc_real_3: 0.2508934736251831 (0.2262991029355261) | > loss_disc_real_4: 0.2751505374908447 (0.19867966903580558) | > loss_disc_real_5: 0.2143433541059494 (0.20619147767623267) | > loss_0: 3.009765148162842 (2.6330587334103055) | > grad_norm_0: tensor(1134.9706, device='cuda:0') (tensor(1722.7164, device='cuda:0')) | > loss_gen: 1.5545302629470825 (2.2494035959243774) | > loss_kl: 0.7020151019096375 (0.907551560137007) | > loss_feat: 0.4042808413505554 (4.562304079532623) | > loss_mel: 5.317373275756836 (21.152578989664715) | > loss_duration: 1.6677782535552979 (1.7478493716981676) | > loss_1: 9.645977973937988 (30.619687451256645) | > grad_norm_1: tensor(81112.0859, device='cuda:0') (tensor(46405.9727, device='cuda:0')) | > current_lr_0: 0.00017845031960745267 | > current_lr_1: 0.00017845031960745267 | > step_time: 0.5503 (0.5518093638949924) | > loader_time: 0.0238 (0.01512100961473253)  --> TIME: 2023-10-20 00:54:18 -- STEP: 39/50 -- GLOBAL_STEP: 58740 | > loss_disc: 3.60911226272583 (2.495594776593722) | > loss_disc_real_0: 0.11139792203903198 (0.1883647391715875) | > loss_disc_real_1: 0.31206145882606506 (0.22676711223828486) | > loss_disc_real_2: 0.33917954564094543 (0.23377912673048484) | > loss_disc_real_3: 0.24677534401416779 (0.23117811939655206) | > loss_disc_real_4: 0.636275589466095 (0.22412460106305587) | > loss_disc_real_5: 0.6120747327804565 (0.2333336875606806) | > loss_0: 3.60911226272583 (2.495594776593722) | > grad_norm_0: tensor(1305.7571, device='cuda:0') (tensor(1050.0200, device='cuda:0')) | > loss_gen: 2.2693731784820557 (2.417618742355934) | > loss_kl: 0.612452507019043 (1.0087378773933802) | > loss_feat: 4.5909881591796875 (4.620617022666219) | > loss_mel: 26.310237884521484 (22.189412569388367) | > loss_duration: 1.7618745565414429 (1.7476164866716435) | > loss_1: 35.54492950439453 (31.984002406780537) | > grad_norm_1: tensor(9567.1787, device='cuda:0') (tensor(26808.4160, device='cuda:0')) | > current_lr_0: 0.00017845031960745267 | > current_lr_1: 0.00017845031960745267 | > step_time: 0.5804 (0.5133958535316663) | > loader_time: 0.0246 (0.02024944623311361)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.238137722015381 (2.238137722015381) | > loss_disc_real_0: 0.05668821185827255 (0.05668821185827255) | > loss_disc_real_1: 0.14410434663295746 (0.14410434663295746) | > loss_disc_real_2: 0.24853387475013733 (0.24853387475013733) | > loss_disc_real_3: 0.43492236733436584 (0.43492236733436584) | > loss_disc_real_4: 0.1987690031528473 (0.1987690031528473) | > loss_disc_real_5: 0.1691025346517563 (0.1691025346517563) | > loss_0: 2.238137722015381 (2.238137722015381) | > loss_gen: 2.4339680671691895 (2.4339680671691895) | > loss_kl: 1.7367749214172363 (1.7367749214172363) | > loss_feat: 6.304509162902832 (6.304509162902832) | > loss_mel: 23.869091033935547 (23.869091033935547) | > loss_duration: 2.064114809036255 (2.064114809036255) | > loss_1: 36.4084587097168 (36.4084587097168)  --> STEP: 1 | > loss_disc: 3.1026620864868164 (3.1026620864868164) | > loss_disc_real_0: 0.18635401129722595 (0.18635401129722595) | > loss_disc_real_1: 0.2512681186199188 (0.2512681186199188) | > loss_disc_real_2: 0.2507613003253937 (0.2507613003253937) | > loss_disc_real_3: 0.3122456669807434 (0.3122456669807434) | > loss_disc_real_4: 0.41732752323150635 (0.41732752323150635) | > loss_disc_real_5: 0.2762966454029083 (0.2762966454029083) | > loss_0: 3.1026620864868164 (3.1026620864868164) | > loss_gen: 1.646649718284607 (1.646649718284607) | > loss_kl: 3.418325901031494 (3.418325901031494) | > loss_feat: 0.1300133466720581 (0.1300133466720581) | > loss_mel: 7.833449840545654 (7.833449840545654) | > loss_duration: 2.339930772781372 (2.339930772781372) | > loss_1: 15.368369102478027 (15.368369102478027)  --> STEP: 2 | > loss_disc: 2.7740538120269775 (2.938357949256897) | > loss_disc_real_0: 0.19790294766426086 (0.1921284794807434) | > loss_disc_real_1: 0.17359618842601776 (0.2124321535229683) | > loss_disc_real_2: 0.21874985098838806 (0.23475557565689087) | > loss_disc_real_3: 0.48025763034820557 (0.3962516486644745) | > loss_disc_real_4: 0.43234747648239136 (0.42483749985694885) | > loss_disc_real_5: 0.36717259883880615 (0.32173462212085724) | > loss_0: 2.7740538120269775 (2.938357949256897) | > loss_gen: 2.776580333709717 (2.211615025997162) | > loss_kl: 3.3954386711120605 (3.4068822860717773) | > loss_feat: 5.399392127990723 (2.7647027373313904) | > loss_mel: 29.957603454589844 (18.89552664756775) | > loss_duration: 2.2794439792633057 (2.309687376022339) | > loss_1: 43.8084602355957 (29.588414669036865)  --> STEP: 3 | > loss_disc: 2.8904502391815186 (2.922388712565104) | > loss_disc_real_0: 0.15991535782814026 (0.18139077226320902) | > loss_disc_real_1: 0.2018970102071762 (0.20892043908437094) | > loss_disc_real_2: 0.24894249439239502 (0.23948454856872559) | > loss_disc_real_3: 0.3409172594547272 (0.3778068522612254) | > loss_disc_real_4: 0.4068484902381897 (0.4188411633173625) | > loss_disc_real_5: 0.25789815187454224 (0.3004557987054189) | > loss_0: 2.8904502391815186 (2.922388712565104) | > loss_gen: 1.8110893964767456 (2.07810648282369) | > loss_kl: 1.4615814685821533 (2.758448680241903) | > loss_feat: 1.2493945360183716 (2.2596000035603843) | > loss_mel: 18.463600158691406 (18.751551151275635) | > loss_duration: 2.1190946102142334 (2.2461564540863037) | > loss_1: 25.104759216308594 (28.093862851460774) --> EVAL PERFORMANCE | > avg_loader_time: 0.007978359858194986 (-0.002416451772054037) | > avg_loss_disc: 2.922388712565104 (+0.5338269074757891) | > avg_loss_disc_real_0: 0.18139077226320902 (+0.07566123704115549) | > avg_loss_disc_real_1: 0.20892043908437094 (+0.024255142857631057) | > avg_loss_disc_real_2: 0.23948454856872559 (-0.026815940936406435) | > avg_loss_disc_real_3: 0.3778068522612254 (+0.23060192167758944) | > avg_loss_disc_real_4: 0.4188411633173625 (+0.1393327911694845) | > avg_loss_disc_real_5: 0.3004557987054189 (+0.08452221875389415) | > avg_loss_0: 2.922388712565104 (+0.5338269074757891) | > avg_loss_gen: 2.07810648282369 (-0.21102484067281058) | > avg_loss_kl: 2.758448680241903 (+0.3959794044494629) | > avg_loss_feat: 2.2596000035603843 (-3.880199352900187) | > avg_loss_mel: 18.751551151275635 (-4.579828421274822) | > avg_loss_duration: 2.2461564540863037 (+0.052395184834798325) | > avg_loss_1: 28.093862851460774 (-8.222677548726399)  > EPOCH: 115/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:54:34)   --> TIME: 2023-10-20 00:54:47 -- STEP: 19/50 -- GLOBAL_STEP: 58770 | > loss_disc: 2.8840749263763428 (2.5376810588334737) | > loss_disc_real_0: 0.38215941190719604 (0.19113941216155103) | > loss_disc_real_1: 0.2392551600933075 (0.2239968200263224) | > loss_disc_real_2: 0.2339826375246048 (0.2517587497438255) | > loss_disc_real_3: 0.3895450830459595 (0.23571471693484405) | > loss_disc_real_4: 0.2950349748134613 (0.2663382943229456) | > loss_disc_real_5: 0.2729402184486389 (0.22561891602450296) | > loss_0: 2.8840749263763428 (2.5376810588334737) | > grad_norm_0: tensor(737.2820, device='cuda:0') (tensor(693.9992, device='cuda:0')) | > loss_gen: 2.382826089859009 (2.4945516335336784) | > loss_kl: 1.368727445602417 (1.1865502282192832) | > loss_feat: 3.893092155456543 (5.1891252800430125) | > loss_mel: 24.059314727783203 (24.140579386761313) | > loss_duration: 1.8613556623458862 (1.8007977134303044) | > loss_1: 33.56531524658203 (34.81160477588051) | > grad_norm_1: tensor(13848.6816, device='cuda:0') (tensor(22197.7500, device='cuda:0')) | > current_lr_0: 0.00017827194734034503 | > current_lr_1: 0.00017827194734034503 | > step_time: 0.6001 (0.43909042759945516) | > loader_time: 0.0175 (0.008239946867290297)  --> TIME: 2023-10-20 00:55:02 -- STEP: 49/50 -- GLOBAL_STEP: 58800 | > loss_disc: 2.6735727787017822 (2.5665476176203508) | > loss_disc_real_0: 0.06970810145139694 (0.16811485885053262) | > loss_disc_real_1: 0.28338050842285156 (0.24357770383358002) | > loss_disc_real_2: 0.48859497904777527 (0.2517215040113245) | > loss_disc_real_3: 0.2901511788368225 (0.24404342784261218) | > loss_disc_real_4: 0.3191464841365814 (0.24507513773456513) | > loss_disc_real_5: 0.2687340974807739 (0.21992201574754958) | > loss_0: 2.6735727787017822 (2.5665476176203508) | > grad_norm_0: tensor(467.5787, device='cuda:0') (tensor(710.0062, device='cuda:0')) | > loss_gen: 2.389613628387451 (2.3148807603485735) | > loss_kl: 0.9558618664741516 (1.080799072980881) | > loss_feat: 1.9917961359024048 (4.479140721641633) | > loss_mel: 27.17061424255371 (22.906682861094573) | > loss_duration: 1.90618097782135 (1.754724779907538) | > loss_1: 34.414066314697266 (32.5362282967081) | > grad_norm_1: tensor(5679.4302, device='cuda:0') (tensor(19895.2617, device='cuda:0')) | > current_lr_0: 0.00017827194734034503 | > current_lr_1: 0.00017827194734034503 | > step_time: 0.4849 (0.4640021470128273) | > loader_time: 0.3485 (0.021928432036419303)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.4625924825668335 (1.4625924825668335) | > loss_disc_real_0: 0.061304230242967606 (0.061304230242967606) | > loss_disc_real_1: 0.09856332093477249 (0.09856332093477249) | > loss_disc_real_2: 0.1440533846616745 (0.1440533846616745) | > loss_disc_real_3: 0.2001904994249344 (0.2001904994249344) | > loss_disc_real_4: 0.019981343299150467 (0.019981343299150467) | > loss_disc_real_5: 0.03854640573263168 (0.03854640573263168) | > loss_0: 1.4625924825668335 (1.4625924825668335) | > loss_gen: 2.8279829025268555 (2.8279829025268555) | > loss_kl: 3.3418333530426025 (3.3418333530426025) | > loss_feat: 10.117720603942871 (10.117720603942871) | > loss_mel: 25.716266632080078 (25.716266632080078) | > loss_duration: 2.1719541549682617 (2.1719541549682617) | > loss_1: 44.175758361816406 (44.175758361816406)  --> STEP: 1 | > loss_disc: 2.1618828773498535 (2.1618828773498535) | > loss_disc_real_0: 0.17536404728889465 (0.17536404728889465) | > loss_disc_real_1: 0.21392855048179626 (0.21392855048179626) | > loss_disc_real_2: 0.2152296006679535 (0.2152296006679535) | > loss_disc_real_3: 0.13401274383068085 (0.13401274383068085) | > loss_disc_real_4: 0.22692452371120453 (0.22692452371120453) | > loss_disc_real_5: 0.25817736983299255 (0.25817736983299255) | > loss_0: 2.1618828773498535 (2.1618828773498535) | > loss_gen: 2.466352701187134 (2.466352701187134) | > loss_kl: 3.6180856227874756 (3.6180856227874756) | > loss_feat: 7.082324028015137 (7.082324028015137) | > loss_mel: 25.020307540893555 (25.020307540893555) | > loss_duration: 2.291246175765991 (2.291246175765991) | > loss_1: 40.47831726074219 (40.47831726074219)  --> STEP: 2 | > loss_disc: 2.8476998805999756 (2.5047913789749146) | > loss_disc_real_0: 0.1717642843723297 (0.17356416583061218) | > loss_disc_real_1: 0.2297312468290329 (0.22182989865541458) | > loss_disc_real_2: 0.4866170883178711 (0.3509233444929123) | > loss_disc_real_3: 0.22919055819511414 (0.1816016510128975) | > loss_disc_real_4: 0.3244568705558777 (0.2756906971335411) | > loss_disc_real_5: 0.35078004002571106 (0.3044787049293518) | > loss_0: 2.8476998805999756 (2.5047913789749146) | > loss_gen: 2.385385751724243 (2.4258692264556885) | > loss_kl: 2.3485875129699707 (2.983336567878723) | > loss_feat: 2.676335334777832 (4.879329681396484) | > loss_mel: 27.88344383239746 (26.451875686645508) | > loss_duration: 2.2857296466827393 (2.2884879112243652) | > loss_1: 37.57948303222656 (39.028900146484375)  --> STEP: 3 | > loss_disc: 3.134193181991577 (2.7145919799804688) | > loss_disc_real_0: 0.2650544345378876 (0.20406092206637064) | > loss_disc_real_1: 0.2524417042732239 (0.232033833861351) | > loss_disc_real_2: 0.42900311946868896 (0.3769499361515045) | > loss_disc_real_3: 0.25642532110214233 (0.2065428743759791) | > loss_disc_real_4: 0.3035537004470825 (0.28497836490472156) | > loss_disc_real_5: 0.25127020478248596 (0.28674253821372986) | > loss_0: 3.134193181991577 (2.7145919799804688) | > loss_gen: 1.6792900562286377 (2.1770095030466714) | > loss_kl: 1.0996540784835815 (2.3554424047470093) | > loss_feat: 0.19870859384536743 (3.3191226522127786) | > loss_mel: 3.3077802658081055 (18.73717721303304) | > loss_duration: 2.1620564460754395 (2.2463440895080566) | > loss_1: 8.447488784790039 (28.83509635925293) --> EVAL PERFORMANCE | > avg_loader_time: 0.006113290786743164 (-0.0018650690714518223) | > avg_loss_disc: 2.7145919799804688 (-0.20779673258463527) | > avg_loss_disc_real_0: 0.20406092206637064 (+0.02267014980316162) | > avg_loss_disc_real_1: 0.232033833861351 (+0.023113394776980073) | > avg_loss_disc_real_2: 0.3769499361515045 (+0.13746538758277893) | > avg_loss_disc_real_3: 0.2065428743759791 (-0.1712639778852463) | > avg_loss_disc_real_4: 0.28497836490472156 (-0.13386279841264093) | > avg_loss_disc_real_5: 0.28674253821372986 (-0.013713260491689028) | > avg_loss_0: 2.7145919799804688 (-0.20779673258463527) | > avg_loss_gen: 2.1770095030466714 (+0.09890302022298147) | > avg_loss_kl: 2.3554424047470093 (-0.40300627549489354) | > avg_loss_feat: 3.3191226522127786 (+1.0595226486523943) | > avg_loss_mel: 18.73717721303304 (-0.014373938242595585) | > avg_loss_duration: 2.2463440895080566 (+0.0001876354217529297) | > avg_loss_1: 28.83509635925293 (+0.7412335077921561)  > EPOCH: 116/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:55:12)   --> TIME: 2023-10-20 00:55:27 -- STEP: 29/50 -- GLOBAL_STEP: 58830 | > loss_disc: 3.253864288330078 (2.5407196982153533) | > loss_disc_real_0: 0.2903551757335663 (0.17251232876602945) | > loss_disc_real_1: 0.31891176104545593 (0.22495267989820447) | > loss_disc_real_2: 0.28069818019866943 (0.20726225345299162) | > loss_disc_real_3: 0.2801787853240967 (0.23500351839024444) | > loss_disc_real_4: 0.2403617799282074 (0.2266596330907838) | > loss_disc_real_5: 0.14946769177913666 (0.21642191682396264) | > loss_0: 3.253864288330078 (2.5407196982153533) | > grad_norm_0: tensor(790.8227, device='cuda:0') (tensor(760.8624, device='cuda:0')) | > loss_gen: 2.1257457733154297 (2.310628792335247) | > loss_kl: 1.0991394519805908 (1.075381227608385) | > loss_feat: 5.34488582611084 (4.866015013050417) | > loss_mel: 24.63119125366211 (22.331157511678235) | > loss_duration: 1.7648603916168213 (1.7699089338039529) | > loss_1: 34.965824127197266 (32.35309166743839) | > grad_norm_1: tensor(11919.8662, device='cuda:0') (tensor(23512.6504, device='cuda:0')) | > current_lr_0: 0.0001780937533674861 | > current_lr_1: 0.0001780937533674861 | > step_time: 0.2501 (0.39270230819439067) | > loader_time: 0.0028 (0.009336249581698713)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3466408252716064 (2.3466408252716064) | > loss_disc_real_0: 0.332888126373291 (0.332888126373291) | > loss_disc_real_1: 0.32254359126091003 (0.32254359126091003) | > loss_disc_real_2: 0.2282463163137436 (0.2282463163137436) | > loss_disc_real_3: 0.2858954071998596 (0.2858954071998596) | > loss_disc_real_4: 0.12036647647619247 (0.12036647647619247) | > loss_disc_real_5: 0.1971866339445114 (0.1971866339445114) | > loss_0: 2.3466408252716064 (2.3466408252716064) | > loss_gen: 3.3012523651123047 (3.3012523651123047) | > loss_kl: 1.915919303894043 (1.915919303894043) | > loss_feat: 7.660419464111328 (7.660419464111328) | > loss_mel: 25.508920669555664 (25.508920669555664) | > loss_duration: 1.9702216386795044 (1.9702216386795044) | > loss_1: 40.35673522949219 (40.35673522949219)  --> STEP: 1 | > loss_disc: 3.2323484420776367 (3.2323484420776367) | > loss_disc_real_0: 0.4606127142906189 (0.4606127142906189) | > loss_disc_real_1: 0.3310284912586212 (0.3310284912586212) | > loss_disc_real_2: 0.41732272505760193 (0.41732272505760193) | > loss_disc_real_3: 0.3617876470088959 (0.3617876470088959) | > loss_disc_real_4: 0.39594241976737976 (0.39594241976737976) | > loss_disc_real_5: 0.3772469758987427 (0.3772469758987427) | > loss_0: 3.2323484420776367 (3.2323484420776367) | > loss_gen: 2.457803726196289 (2.457803726196289) | > loss_kl: 2.533134698867798 (2.533134698867798) | > loss_feat: 2.975328207015991 (2.975328207015991) | > loss_mel: 25.36503028869629 (25.36503028869629) | > loss_duration: 2.2446041107177734 (2.2446041107177734) | > loss_1: 35.575904846191406 (35.575904846191406)  --> STEP: 2 | > loss_disc: 1.7944345474243164 (2.5133914947509766) | > loss_disc_real_0: 0.15074825286865234 (0.3056804835796356) | > loss_disc_real_1: 0.1301136016845703 (0.23057104647159576) | > loss_disc_real_2: 0.1586243361234665 (0.2879735305905342) | > loss_disc_real_3: 0.056175366044044495 (0.20898150652647018) | > loss_disc_real_4: 0.17965491116046906 (0.2877986654639244) | > loss_disc_real_5: 0.24192306399345398 (0.3095850199460983) | > loss_0: 1.7944345474243164 (2.5133914947509766) | > loss_gen: 3.718258857727051 (3.08803129196167) | > loss_kl: 2.279923677444458 (2.406529188156128) | > loss_feat: 11.47027587890625 (7.222802042961121) | > loss_mel: 28.531631469726562 (26.948330879211426) | > loss_duration: 2.1827056407928467 (2.21365487575531) | > loss_1: 48.18279266357422 (41.87934875488281)  --> STEP: 3 | > loss_disc: 1.7725276947021484 (2.2664368947347007) | > loss_disc_real_0: 0.2148287296295166 (0.27539656559626263) | > loss_disc_real_1: 0.21252502501010895 (0.2245557059844335) | > loss_disc_real_2: 0.304149329662323 (0.2933654636144638) | > loss_disc_real_3: 0.06685160100460052 (0.16160487135251364) | > loss_disc_real_4: 0.06705081462860107 (0.21421604851881662) | > loss_disc_real_5: 0.14389482140541077 (0.25435495376586914) | > loss_0: 1.7725276947021484 (2.2664368947347007) | > loss_gen: 2.80918550491333 (2.99508269627889) | > loss_kl: 1.4515162706375122 (2.088191548983256) | > loss_feat: 7.445831298828125 (7.297145128250122) | > loss_mel: 23.136327743530273 (25.677663167317707) | > loss_duration: 2.196780204772949 (2.2080299854278564) | > loss_1: 37.039642333984375 (40.26611328125) --> EVAL PERFORMANCE | > avg_loader_time: 0.003288427988688151 (-0.002824862798055013) | > avg_loss_disc: 2.2664368947347007 (-0.4481550852457681) | > avg_loss_disc_real_0: 0.27539656559626263 (+0.071335643529892) | > avg_loss_disc_real_1: 0.2245557059844335 (-0.007478127876917512) | > avg_loss_disc_real_2: 0.2933654636144638 (-0.08358447253704071) | > avg_loss_disc_real_3: 0.16160487135251364 (-0.044938003023465456) | > avg_loss_disc_real_4: 0.21421604851881662 (-0.07076231638590494) | > avg_loss_disc_real_5: 0.25435495376586914 (-0.03238758444786072) | > avg_loss_0: 2.2664368947347007 (-0.4481550852457681) | > avg_loss_gen: 2.99508269627889 (+0.8180731932322187) | > avg_loss_kl: 2.088191548983256 (-0.2672508557637534) | > avg_loss_feat: 7.297145128250122 (+3.9780224760373435) | > avg_loss_mel: 25.677663167317707 (+6.940485954284668) | > avg_loss_duration: 2.2080299854278564 (-0.038314104080200195) | > avg_loss_1: 40.26611328125 (+11.43101692199707)  > EPOCH: 117/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:55:46)   --> TIME: 2023-10-20 00:55:58 -- STEP: 9/50 -- GLOBAL_STEP: 58860 | > loss_disc: 2.7204761505126953 (2.5911705229017468) | > loss_disc_real_0: 0.08900885283946991 (0.15025725257065561) | > loss_disc_real_1: 0.211757630109787 (0.23555507593684727) | > loss_disc_real_2: 0.19985996186733246 (0.3279609547721015) | > loss_disc_real_3: 0.27859246730804443 (0.2608352055152257) | > loss_disc_real_4: 0.25879576802253723 (0.25468145145310295) | > loss_disc_real_5: 0.3244231939315796 (0.17655335408118036) | > loss_0: 2.7204761505126953 (2.5911705229017468) | > grad_norm_0: tensor(349.4402, device='cuda:0') (tensor(489.1269, device='cuda:0')) | > loss_gen: 1.8867183923721313 (2.281362440851) | > loss_kl: 0.958845317363739 (1.1200021968947516) | > loss_feat: 1.0542672872543335 (4.796946856710646) | > loss_mel: 30.139881134033203 (25.33794042799208) | > loss_duration: 1.6761982440948486 (1.753207180235121) | > loss_1: 35.71590805053711 (35.28945880466037) | > grad_norm_1: tensor(12576.3457, device='cuda:0') (tensor(21349.3164, device='cuda:0')) | > current_lr_0: 0.0001779157375106597 | > current_lr_1: 0.0001779157375106597 | > step_time: 0.2919 (0.47449888123406303) | > loader_time: 0.0271 (0.017289665010240342)  --> TIME: 2023-10-20 00:56:13 -- STEP: 39/50 -- GLOBAL_STEP: 58890 | > loss_disc: 2.9130001068115234 (2.5373574587015004) | > loss_disc_real_0: 0.19965924322605133 (0.17373435323437056) | > loss_disc_real_1: 0.22730304300785065 (0.25280012018405484) | > loss_disc_real_2: 0.2068050354719162 (0.249433300529535) | > loss_disc_real_3: 0.3337121307849884 (0.24424237375840163) | > loss_disc_real_4: 0.2875826954841614 (0.2211624704874479) | > loss_disc_real_5: 0.2937772870063782 (0.2256804810693631) | > loss_0: 2.9130001068115234 (2.5373574587015004) | > grad_norm_0: tensor(311.9450, device='cuda:0') (tensor(570.3031, device='cuda:0')) | > loss_gen: 1.587401270866394 (2.3788132423009634) | > loss_kl: 0.7263627648353577 (1.080540114488357) | > loss_feat: 0.5736385583877563 (4.862828840812047) | > loss_mel: 21.654438018798828 (25.68991621946677) | > loss_duration: 1.7901825904846191 (1.7602705038510835) | > loss_1: 26.332021713256836 (35.772368956834846) | > grad_norm_1: tensor(17665.9863, device='cuda:0') (tensor(24528.8027, device='cuda:0')) | > current_lr_0: 0.0001779157375106597 | > current_lr_1: 0.0001779157375106597 | > step_time: 0.3212 (0.4870738127292731) | > loader_time: 0.025 (0.017017939151861727)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7615649700164795 (1.7615649700164795) | > loss_disc_real_0: 0.1136731505393982 (0.1136731505393982) | > loss_disc_real_1: 0.137918621301651 (0.137918621301651) | > loss_disc_real_2: 0.09570614248514175 (0.09570614248514175) | > loss_disc_real_3: 0.08003351092338562 (0.08003351092338562) | > loss_disc_real_4: 0.04718305543065071 (0.04718305543065071) | > loss_disc_real_5: 0.07119907438755035 (0.07119907438755035) | > loss_0: 1.7615649700164795 (1.7615649700164795) | > loss_gen: 2.2196521759033203 (2.2196521759033203) | > loss_kl: 2.2430567741394043 (2.2430567741394043) | > loss_feat: 12.455260276794434 (12.455260276794434) | > loss_mel: 28.045650482177734 (28.045650482177734) | > loss_duration: 2.0351274013519287 (2.0351274013519287) | > loss_1: 46.998741149902344 (46.998741149902344)  --> STEP: 1 | > loss_disc: 3.00561261177063 (3.00561261177063) | > loss_disc_real_0: 0.4019954204559326 (0.4019954204559326) | > loss_disc_real_1: 0.27942928671836853 (0.27942928671836853) | > loss_disc_real_2: 0.15932969748973846 (0.15932969748973846) | > loss_disc_real_3: 0.2685483992099762 (0.2685483992099762) | > loss_disc_real_4: 0.061392951756715775 (0.061392951756715775) | > loss_disc_real_5: 0.20976488292217255 (0.20976488292217255) | > loss_0: 3.00561261177063 (3.00561261177063) | > loss_gen: 1.7038404941558838 (1.7038404941558838) | > loss_kl: 2.6022696495056152 (2.6022696495056152) | > loss_feat: 4.640563488006592 (4.640563488006592) | > loss_mel: 25.371360778808594 (25.371360778808594) | > loss_duration: 2.2762086391448975 (2.2762086391448975) | > loss_1: 36.594242095947266 (36.594242095947266)  --> STEP: 2 | > loss_disc: 3.006028890609741 (3.0058207511901855) | > loss_disc_real_0: 0.4230045676231384 (0.4124999940395355) | > loss_disc_real_1: 0.29975175857543945 (0.289590522646904) | > loss_disc_real_2: 0.3232666552066803 (0.24129817634820938) | > loss_disc_real_3: 0.30999404191970825 (0.2892712205648422) | > loss_disc_real_4: 0.27999335527420044 (0.1706931535154581) | > loss_disc_real_5: 0.2601599395275116 (0.23496241122484207) | > loss_0: 3.006028890609741 (3.0058207511901855) | > loss_gen: 2.022298812866211 (1.8630696535110474) | > loss_kl: 2.8531813621520996 (2.7277255058288574) | > loss_feat: 0.3622104227542877 (2.5013869553804398) | > loss_mel: 21.758419036865234 (23.564889907836914) | > loss_duration: 2.17079758644104 (2.2235031127929688) | > loss_1: 29.166906356811523 (32.880574226379395)  --> STEP: 3 | > loss_disc: 1.7565346956253052 (2.589392066001892) | > loss_disc_real_0: 0.4290527105331421 (0.41801756620407104) | > loss_disc_real_1: 0.12494830042123795 (0.23470978190501532) | > loss_disc_real_2: 0.19099445641040802 (0.2245302697022756) | > loss_disc_real_3: 0.1319935917854309 (0.23684534430503845) | > loss_disc_real_4: 0.09050250053405762 (0.1439629358549913) | > loss_disc_real_5: 0.05620073527097702 (0.17537518590688705) | > loss_0: 1.7565346956253052 (2.589392066001892) | > loss_gen: 3.038114547729492 (2.254751284917196) | > loss_kl: 1.1009442806243896 (2.185465097427368) | > loss_feat: 7.257155895233154 (4.086643268664678) | > loss_mel: 28.566862106323242 (25.232213973999023) | > loss_duration: 2.1869468688964844 (2.211317698160807) | > loss_1: 42.150020599365234 (35.97038968404134) --> EVAL PERFORMANCE | > avg_loader_time: 0.015662352244059246 (+0.012373924255371095) | > avg_loss_disc: 2.589392066001892 (+0.3229551712671914) | > avg_loss_disc_real_0: 0.41801756620407104 (+0.1426210006078084) | > avg_loss_disc_real_1: 0.23470978190501532 (+0.010154075920581818) | > avg_loss_disc_real_2: 0.2245302697022756 (-0.0688351939121882) | > avg_loss_disc_real_3: 0.23684534430503845 (+0.07524047295252481) | > avg_loss_disc_real_4: 0.1439629358549913 (-0.07025311266382533) | > avg_loss_disc_real_5: 0.17537518590688705 (-0.07897976785898209) | > avg_loss_0: 2.589392066001892 (+0.3229551712671914) | > avg_loss_gen: 2.254751284917196 (-0.7403314113616943) | > avg_loss_kl: 2.185465097427368 (+0.09727354844411229) | > avg_loss_feat: 4.086643268664678 (-3.2105018595854444) | > avg_loss_mel: 25.232213973999023 (-0.4454491933186837) | > avg_loss_duration: 2.211317698160807 (+0.0032877127329506983) | > avg_loss_1: 35.97038968404134 (-4.2957235972086565)  > EPOCH: 118/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:56:28)   --> TIME: 2023-10-20 00:56:39 -- STEP: 19/50 -- GLOBAL_STEP: 58920 | > loss_disc: 2.046383857727051 (2.3288902797197046) | > loss_disc_real_0: 0.052349742501974106 (0.17682480125835068) | > loss_disc_real_1: 0.21403741836547852 (0.23570705479697177) | > loss_disc_real_2: 0.09785068035125732 (0.2264759999356772) | > loss_disc_real_3: 0.3138819634914398 (0.24921358249297268) | > loss_disc_real_4: 0.08370577543973923 (0.2014147784364851) | > loss_disc_real_5: 0.06065509095788002 (0.18557308908355863) | > loss_0: 2.046383857727051 (2.3288902797197046) | > grad_norm_0: tensor(290.0292, device='cuda:0') (tensor(557.7355, device='cuda:0')) | > loss_gen: 2.22451114654541 (2.637682368880824) | > loss_kl: 0.9745421409606934 (0.9716721224157434) | > loss_feat: 8.090927124023438 (6.440285941487865) | > loss_mel: 23.589191436767578 (28.360320241827715) | > loss_duration: 1.8420217037200928 (1.8102174495395862) | > loss_1: 36.721195220947266 (40.220178503739206) | > grad_norm_1: tensor(13824.9170, device='cuda:0') (tensor(24241.5723, device='cuda:0')) | > current_lr_0: 0.00017773789959182765 | > current_lr_1: 0.00017773789959182765 | > step_time: 0.2641 (0.34422561996861506) | > loader_time: 0.0051 (0.005973439467580695)  --> TIME: 2023-10-20 00:56:55 -- STEP: 49/50 -- GLOBAL_STEP: 58950 | > loss_disc: 2.6195333003997803 (2.40754483184036) | > loss_disc_real_0: 0.17165780067443848 (0.17260920925407994) | > loss_disc_real_1: 0.24103234708309174 (0.2366486535388596) | > loss_disc_real_2: 0.2841019332408905 (0.22248843882460984) | > loss_disc_real_3: 0.2930300831794739 (0.24558049482198394) | > loss_disc_real_4: 0.19334077835083008 (0.21112257348639624) | > loss_disc_real_5: 0.23813211917877197 (0.19924770162573882) | > loss_0: 2.6195333003997803 (2.40754483184036) | > grad_norm_0: tensor(453.2141, device='cuda:0') (tensor(551.7477, device='cuda:0')) | > loss_gen: 2.1324634552001953 (2.468846863629867) | > loss_kl: 0.643498420715332 (1.0114848595492694) | > loss_feat: 1.816063404083252 (5.506788097474039) | > loss_mel: 18.165891647338867 (24.972148963383265) | > loss_duration: 1.8972424268722534 (1.7631537768305565) | > loss_1: 24.65515899658203 (35.7224227263003) | > grad_norm_1: tensor(6103.5234, device='cuda:0') (tensor(20526.1191, device='cuda:0')) | > current_lr_0: 0.00017773789959182765 | > current_lr_1: 0.00017773789959182765 | > step_time: 0.6723 (0.4518840264300912) | > loader_time: 0.3528 (0.016237424344432597)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9405930042266846 (1.9405930042266846) | > loss_disc_real_0: 0.17987117171287537 (0.17987117171287537) | > loss_disc_real_1: 0.14699865877628326 (0.14699865877628326) | > loss_disc_real_2: 0.12237156927585602 (0.12237156927585602) | > loss_disc_real_3: 0.30963125824928284 (0.30963125824928284) | > loss_disc_real_4: 0.1126076877117157 (0.1126076877117157) | > loss_disc_real_5: 0.4149843752384186 (0.4149843752384186) | > loss_0: 1.9405930042266846 (1.9405930042266846) | > loss_gen: 3.0231895446777344 (3.0231895446777344) | > loss_kl: 1.9271332025527954 (1.9271332025527954) | > loss_feat: 8.568848609924316 (8.568848609924316) | > loss_mel: 25.49005889892578 (25.49005889892578) | > loss_duration: 2.0801148414611816 (2.0801148414611816) | > loss_1: 41.08934783935547 (41.08934783935547)  --> STEP: 1 | > loss_disc: 2.9986329078674316 (2.9986329078674316) | > loss_disc_real_0: 0.25076523423194885 (0.25076523423194885) | > loss_disc_real_1: 0.24654076993465424 (0.24654076993465424) | > loss_disc_real_2: 0.30040445923805237 (0.30040445923805237) | > loss_disc_real_3: 0.28140658140182495 (0.28140658140182495) | > loss_disc_real_4: 0.2616173028945923 (0.2616173028945923) | > loss_disc_real_5: 0.27370917797088623 (0.27370917797088623) | > loss_0: 2.9986329078674316 (2.9986329078674316) | > loss_gen: 1.6310076713562012 (1.6310076713562012) | > loss_kl: 2.5269057750701904 (2.5269057750701904) | > loss_feat: 0.2191229909658432 (0.2191229909658432) | > loss_mel: 17.61772918701172 (17.61772918701172) | > loss_duration: 2.202540397644043 (2.202540397644043) | > loss_1: 24.197307586669922 (24.197307586669922)  --> STEP: 2 | > loss_disc: 3.041334867477417 (3.0199838876724243) | > loss_disc_real_0: 0.2533942461013794 (0.2520797401666641) | > loss_disc_real_1: 0.24651296436786652 (0.24652686715126038) | > loss_disc_real_2: 0.3015391230583191 (0.30097179114818573) | > loss_disc_real_3: 0.2804734408855438 (0.2809400111436844) | > loss_disc_real_4: 0.261481374502182 (0.26154933869838715) | > loss_disc_real_5: 0.27347487211227417 (0.2735920250415802) | > loss_0: 3.041334867477417 (3.0199838876724243) | > loss_gen: 1.582863688468933 (1.6069356799125671) | > loss_kl: 2.4989047050476074 (2.512905240058899) | > loss_feat: 0.1169646680355072 (0.1680438295006752) | > loss_mel: 4.5703253746032715 (11.094027280807495) | > loss_duration: 2.145197629928589 (2.173869013786316) | > loss_1: 10.91425609588623 (17.555781841278076)  --> STEP: 3 | > loss_disc: 3.495015859603882 (3.1783278783162436) | > loss_disc_real_0: 0.6982406973838806 (0.40080005923906964) | > loss_disc_real_1: 0.39544644951820374 (0.2961667279402415) | > loss_disc_real_2: 0.5885216593742371 (0.3968217472235362) | > loss_disc_real_3: 0.36350688338279724 (0.30846230189005536) | > loss_disc_real_4: 0.39304831624031067 (0.30538233121236164) | > loss_disc_real_5: 0.47468945384025574 (0.34062450130780536) | > loss_0: 3.495015859603882 (3.1783278783162436) | > loss_gen: 3.7227890491485596 (2.3122201363245645) | > loss_kl: 1.3581167459487915 (2.1279757420221963) | > loss_feat: 3.476912498474121 (1.271000052491824) | > loss_mel: 27.46988868713379 (16.552647749582928) | > loss_duration: 2.162297248840332 (2.1700117588043213) | > loss_1: 38.19000244140625 (24.433855374654133) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024945735931396484 (-0.013167778650919598) | > avg_loss_disc: 3.1783278783162436 (+0.5889358123143515) | > avg_loss_disc_real_0: 0.40080005923906964 (-0.017217506965001406) | > avg_loss_disc_real_1: 0.2961667279402415 (+0.061456946035226195) | > avg_loss_disc_real_2: 0.3968217472235362 (+0.1722914775212606) | > avg_loss_disc_real_3: 0.30846230189005536 (+0.0716169575850169) | > avg_loss_disc_real_4: 0.30538233121236164 (+0.16141939535737035) | > avg_loss_disc_real_5: 0.34062450130780536 (+0.1652493154009183) | > avg_loss_0: 3.1783278783162436 (+0.5889358123143515) | > avg_loss_gen: 2.3122201363245645 (+0.05746885140736868) | > avg_loss_kl: 2.1279757420221963 (-0.05748935540517186) | > avg_loss_feat: 1.271000052491824 (-2.8156432161728535) | > avg_loss_mel: 16.552647749582928 (-8.679566224416096) | > avg_loss_duration: 2.1700117588043213 (-0.041305939356485855) | > avg_loss_1: 24.433855374654133 (-11.53653430938721)  > EPOCH: 119/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:57:03)   --> TIME: 2023-10-20 00:57:22 -- STEP: 29/50 -- GLOBAL_STEP: 58980 | > loss_disc: 3.0481247901916504 (2.347691466068399) | > loss_disc_real_0: 0.2943722605705261 (0.16382633441866473) | > loss_disc_real_1: 0.242219939827919 (0.2110399141393859) | > loss_disc_real_2: 0.32757002115249634 (0.23567637974589034) | > loss_disc_real_3: 0.30678674578666687 (0.23963760308407503) | > loss_disc_real_4: 0.2616836428642273 (0.21540652812811836) | > loss_disc_real_5: 0.3384135663509369 (0.2226656675338745) | > loss_0: 3.0481247901916504 (2.347691466068399) | > grad_norm_0: tensor(197.4516, device='cuda:0') (tensor(517.7505, device='cuda:0')) | > loss_gen: 1.6639411449432373 (2.642276698145373) | > loss_kl: 1.2948139905929565 (1.1358967875612198) | > loss_feat: 0.16928339004516602 (6.404504875684607) | > loss_mel: 10.92303466796875 (26.037188628624225) | > loss_duration: 1.7626514434814453 (1.7767130424236428) | > loss_1: 15.813724517822266 (37.996579466194945) | > grad_norm_1: tensor(8126.2241, device='cuda:0') (tensor(25822.9414, device='cuda:0')) | > current_lr_0: 0.0001775602394331298 | > current_lr_1: 0.0001775602394331298 | > step_time: 0.5287 (0.4929185571341679) | > loader_time: 0.0094 (0.01834484626506937)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.928309917449951 (2.928309917449951) | > loss_disc_real_0: 0.17791077494621277 (0.17791077494621277) | > loss_disc_real_1: 0.32531026005744934 (0.32531026005744934) | > loss_disc_real_2: 0.4059911370277405 (0.4059911370277405) | > loss_disc_real_3: 0.2794296145439148 (0.2794296145439148) | > loss_disc_real_4: 0.3832123577594757 (0.3832123577594757) | > loss_disc_real_5: 0.46571382880210876 (0.46571382880210876) | > loss_0: 2.928309917449951 (2.928309917449951) | > loss_gen: 2.605421304702759 (2.605421304702759) | > loss_kl: 2.316053628921509 (2.316053628921509) | > loss_feat: 4.329141139984131 (4.329141139984131) | > loss_mel: 23.119962692260742 (23.119962692260742) | > loss_duration: 2.0735278129577637 (2.0735278129577637) | > loss_1: 34.44410705566406 (34.44410705566406)  --> STEP: 1 | > loss_disc: 2.04403018951416 (2.04403018951416) | > loss_disc_real_0: 0.024922899901866913 (0.024922899901866913) | > loss_disc_real_1: 0.30435559153556824 (0.30435559153556824) | > loss_disc_real_2: 0.21274273097515106 (0.21274273097515106) | > loss_disc_real_3: 0.3039178252220154 (0.3039178252220154) | > loss_disc_real_4: 0.09975753724575043 (0.09975753724575043) | > loss_disc_real_5: 0.3053134083747864 (0.3053134083747864) | > loss_0: 2.04403018951416 (2.04403018951416) | > loss_gen: 2.759096384048462 (2.759096384048462) | > loss_kl: 2.8251287937164307 (2.8251287937164307) | > loss_feat: 7.059566974639893 (7.059566974639893) | > loss_mel: 25.469301223754883 (25.469301223754883) | > loss_duration: 2.2391128540039062 (2.2391128540039062) | > loss_1: 40.35220718383789 (40.35220718383789)  --> STEP: 2 | > loss_disc: 1.5894553661346436 (1.8167427778244019) | > loss_disc_real_0: 0.04538419470191002 (0.035153547301888466) | > loss_disc_real_1: 0.21310219168663025 (0.25872889161109924) | > loss_disc_real_2: 0.136300191283226 (0.17452146112918854) | > loss_disc_real_3: 0.18408915400505066 (0.24400348961353302) | > loss_disc_real_4: 0.0606982558965683 (0.08022789657115936) | > loss_disc_real_5: 0.09166980534791946 (0.19849160686135292) | > loss_0: 1.5894553661346436 (1.8167427778244019) | > loss_gen: 2.6072678565979004 (2.683182120323181) | > loss_kl: 3.1744463443756104 (2.9997875690460205) | > loss_feat: 8.595949172973633 (7.827758073806763) | > loss_mel: 25.585739135742188 (25.527520179748535) | > loss_duration: 2.167722225189209 (2.2034175395965576) | > loss_1: 42.13112258911133 (41.24166488647461)  --> STEP: 3 | > loss_disc: 3.0431289672851562 (2.22553817431132) | > loss_disc_real_0: 0.20201142132282257 (0.09077283864219983) | > loss_disc_real_1: 0.2504735291004181 (0.2559771041075389) | > loss_disc_real_2: 0.2992938160896301 (0.2161122461160024) | > loss_disc_real_3: 0.2568359076976776 (0.2482809623082479) | > loss_disc_real_4: 0.28374144434928894 (0.1480657458305359) | > loss_disc_real_5: 0.3231463134288788 (0.24004317571719488) | > loss_0: 3.0431289672851562 (2.22553817431132) | > loss_gen: 1.584275722503662 (2.316879987716675) | > loss_kl: 1.572981834411621 (2.5241856575012207) | > loss_feat: 0.2030891627073288 (5.286201770106952) | > loss_mel: 4.072403430938721 (18.37581459681193) | > loss_duration: 2.178217887878418 (2.195017655690511) | > loss_1: 9.610967636108398 (30.69809913635254) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_59000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.214834690093994 (2.4728623032569885) | > loss_disc_real_0: 0.3063833713531494 (0.14467547181993723) | > loss_disc_real_1: 0.37949132919311523 (0.28685566037893295) | > loss_disc_real_2: 0.34643837809562683 (0.2486937791109085) | > loss_disc_real_3: 0.2740020453929901 (0.25471123307943344) | > loss_disc_real_4: 0.3323405086994171 (0.1941344365477562) | > loss_disc_real_5: 0.3540084660053253 (0.2685344982892275) | > loss_0: 3.214834690093994 (2.4728623032569885) | > loss_gen: 1.9244168996810913 (2.218764215707779) | > loss_kl: 2.3376381397247314 (2.4775487780570984) | > loss_feat: 1.8723490238189697 (4.432738583534956) | > loss_mel: 23.21044158935547 (19.584471344947815) | > loss_duration: 2.0833323001861572 (2.1670963168144226) | > loss_1: 31.428178787231445 (30.880619049072266)  --> STEP: 1 | > loss_disc: 2.40273118019104 (2.458836078643799) | > loss_disc_real_0: 0.1373022496700287 (0.14320082738995552) | > loss_disc_real_1: 0.27740615606307983 (0.2849657595157623) | > loss_disc_real_2: 0.31452322006225586 (0.261859667301178) | > loss_disc_real_3: 0.25726643204689026 (0.2552222728729248) | > loss_disc_real_4: 0.17618200182914734 (0.19054394960403442) | > loss_disc_real_5: 0.23353862762451172 (0.26153532415628433) | > loss_0: 2.40273118019104 (2.458836078643799) | > loss_gen: 2.2295093536376953 (2.2209132432937624) | > loss_kl: 3.2161238193511963 (2.625263786315918) | > loss_feat: 3.1158084869384766 (4.16935256421566) | > loss_mel: 21.507213592529297 (19.96901979446411) | > loss_duration: 2.210198163986206 (2.175716686248779) | > loss_1: 32.27885437011719 (31.16026611328125)  --> STEP: 2 | > loss_disc: 2.6970415115356445 (2.498536984125773) | > loss_disc_real_0: 0.094668909907341 (0.13511217447618643) | > loss_disc_real_1: 0.22652117908000946 (0.2752249961098035) | > loss_disc_real_2: 0.3697730600833893 (0.2798452327648799) | > loss_disc_real_3: 0.2999734580516815 (0.2626808037360509) | > loss_disc_real_4: 0.32079896330833435 (0.21225311855475107) | > loss_disc_real_5: 0.4208279550075531 (0.28808409596482915) | > loss_0: 2.6970415115356445 (2.498536984125773) | > loss_gen: 2.3644297122955322 (2.2448326547940574) | > loss_kl: 2.6238231658935547 (2.625023682912191) | > loss_feat: 2.8794028759002686 (3.954360949496428) | > loss_mel: 25.9965763092041 (20.973612546920776) | > loss_duration: 2.210531711578369 (2.1815191904703775) | > loss_1: 36.074764251708984 (31.97934913635254)  --> STEP: 3 | > loss_disc: 3.044945001602173 (2.576595272336687) | > loss_disc_real_0: 0.1989983320236206 (0.14423876841153419) | > loss_disc_real_1: 0.24420686066150665 (0.27079383390290396) | > loss_disc_real_2: 0.2967008054256439 (0.28225317171641756) | > loss_disc_real_3: 0.22984053194522858 (0.25798933633736204) | > loss_disc_real_4: 0.2846047580242157 (0.2225890670503889) | > loss_disc_real_5: 0.31465163826942444 (0.2918794591511999) | > loss_0: 3.044945001602173 (2.576595272336687) | > loss_gen: 1.5373950004577637 (2.1437701327460155) | > loss_kl: 1.7087557315826416 (2.494128261293684) | > loss_feat: 0.194321870803833 (3.4172125096832002) | > loss_mel: 3.9981231689453125 (18.548542635781423) | > loss_duration: 2.1583447456359863 (2.178208555494036) | > loss_1: 9.596940994262695 (28.781862258911133) --> EVAL PERFORMANCE | > avg_loader_time: 0.32136406217302593 (+0.3188694885798863) | > avg_loss_disc: 2.576595272336687 (-0.6017326059795565) | > avg_loss_disc_real_0: 0.14423876841153419 (-0.2565612908275354) | > avg_loss_disc_real_1: 0.27079383390290396 (-0.025372894037337557) | > avg_loss_disc_real_2: 0.28225317171641756 (-0.11456857550711863) | > avg_loss_disc_real_3: 0.25798933633736204 (-0.050472965552693316) | > avg_loss_disc_real_4: 0.2225890670503889 (-0.08279326416197275) | > avg_loss_disc_real_5: 0.2918794591511999 (-0.04874504215660547) | > avg_loss_0: 2.576595272336687 (-0.6017326059795565) | > avg_loss_gen: 2.1437701327460155 (-0.168450003578549) | > avg_loss_kl: 2.494128261293684 (+0.3661525192714876) | > avg_loss_feat: 3.4172125096832002 (+2.1462124571913765) | > avg_loss_mel: 18.548542635781423 (+1.9958948861984958) | > avg_loss_duration: 2.178208555494036 (+0.008196796689714514) | > avg_loss_1: 28.781862258911133 (+4.348006884257)  > EPOCH: 120/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:57:51)   --> TIME: 2023-10-20 00:57:59 -- STEP: 9/50 -- GLOBAL_STEP: 59010 | > loss_disc: 1.9024481773376465 (2.2365830871793957) | > loss_disc_real_0: 0.01751922070980072 (0.15302996751334932) | > loss_disc_real_1: 0.2003655582666397 (0.1937945004966524) | > loss_disc_real_2: 0.24945862591266632 (0.21212845047314963) | > loss_disc_real_3: 0.24565699696540833 (0.1841739606526163) | > loss_disc_real_4: 0.16438961029052734 (0.20886887775527108) | > loss_disc_real_5: 0.07682997733354568 (0.20675302503837478) | > loss_0: 1.9024481773376465 (2.2365830871793957) | > grad_norm_0: tensor(449.8118, device='cuda:0') (tensor(579.2180, device='cuda:0')) | > loss_gen: 2.780980348587036 (2.537290414174398) | > loss_kl: 0.967212438583374 (1.0846879879633586) | > loss_feat: 7.948676109313965 (6.771370715565151) | > loss_mel: 31.630239486694336 (26.93056975470649) | > loss_duration: 1.7025768756866455 (1.748772104581197) | > loss_1: 45.02968215942383 (39.07269075181749) | > grad_norm_1: tensor(35072.1367, device='cuda:0') (tensor(29536.7754, device='cuda:0')) | > current_lr_0: 0.00017738275685688374 | > current_lr_1: 0.00017738275685688374 | > step_time: 0.5918 (0.5380827585856119) | > loader_time: 0.0162 (0.016964117685953777)  --> TIME: 2023-10-20 00:58:16 -- STEP: 39/50 -- GLOBAL_STEP: 59040 | > loss_disc: 1.9995347261428833 (2.375602003855583) | > loss_disc_real_0: 0.1549130082130432 (0.14925966082284087) | > loss_disc_real_1: 0.17874126136302948 (0.22953780262898177) | > loss_disc_real_2: 0.17058148980140686 (0.21936790224833366) | > loss_disc_real_3: 0.3494310677051544 (0.2379313830572825) | > loss_disc_real_4: 0.17267312109470367 (0.21335372109061632) | > loss_disc_real_5: 0.22517623007297516 (0.21895738786611801) | > loss_0: 1.9995347261428833 (2.375602003855583) | > grad_norm_0: tensor(968.4836, device='cuda:0') (tensor(568.2132, device='cuda:0')) | > loss_gen: 2.690152645111084 (2.5191047864082527) | > loss_kl: 0.7553838491439819 (1.1036950762455287) | > loss_feat: 4.645956516265869 (5.782371423087823) | > loss_mel: 24.969621658325195 (24.03727770463014) | > loss_duration: 1.7733458280563354 (1.7577375907164354) | > loss_1: 34.8344612121582 (35.200186570485435) | > grad_norm_1: tensor(14978.0225, device='cuda:0') (tensor(25105.7402, device='cuda:0')) | > current_lr_0: 0.00017738275685688374 | > current_lr_1: 0.00017738275685688374 | > step_time: 0.3277 (0.5209937829237717) | > loader_time: 0.0248 (0.016444242917574372)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.4669573307037354 (1.4669573307037354) | > loss_disc_real_0: 0.11566445231437683 (0.11566445231437683) | > loss_disc_real_1: 0.11241896450519562 (0.11241896450519562) | > loss_disc_real_2: 0.11673690378665924 (0.11673690378665924) | > loss_disc_real_3: 0.1603045016527176 (0.1603045016527176) | > loss_disc_real_4: 0.042125049978494644 (0.042125049978494644) | > loss_disc_real_5: 0.15341636538505554 (0.15341636538505554) | > loss_0: 1.4669573307037354 (1.4669573307037354) | > loss_gen: 3.3544840812683105 (3.3544840812683105) | > loss_kl: 1.8257976770401 (1.8257976770401) | > loss_feat: 11.596627235412598 (11.596627235412598) | > loss_mel: 30.58791732788086 (30.58791732788086) | > loss_duration: 2.042004346847534 (2.042004346847534) | > loss_1: 49.406829833984375 (49.406829833984375)  --> STEP: 1 | > loss_disc: 1.9223544597625732 (1.9223544597625732) | > loss_disc_real_0: 0.054373130202293396 (0.054373130202293396) | > loss_disc_real_1: 0.16772685945034027 (0.16772685945034027) | > loss_disc_real_2: 0.26613542437553406 (0.26613542437553406) | > loss_disc_real_3: 0.20282788574695587 (0.20282788574695587) | > loss_disc_real_4: 0.21955671906471252 (0.21955671906471252) | > loss_disc_real_5: 0.17156538367271423 (0.17156538367271423) | > loss_0: 1.9223544597625732 (1.9223544597625732) | > loss_gen: 3.1224734783172607 (3.1224734783172607) | > loss_kl: 2.7176051139831543 (2.7176051139831543) | > loss_feat: 7.963833808898926 (7.963833808898926) | > loss_mel: 26.107675552368164 (26.107675552368164) | > loss_duration: 2.163801908493042 (2.163801908493042) | > loss_1: 42.07539367675781 (42.07539367675781)  --> STEP: 2 | > loss_disc: 2.467593193054199 (2.1949738264083862) | > loss_disc_real_0: 0.050030115991830826 (0.05220162309706211) | > loss_disc_real_1: 0.33396971225738525 (0.25084828585386276) | > loss_disc_real_2: 0.19333380460739136 (0.2297346144914627) | > loss_disc_real_3: 0.2948330342769623 (0.24883046001195908) | > loss_disc_real_4: 0.21133117377758026 (0.2154439464211464) | > loss_disc_real_5: 0.08689209073781967 (0.12922873720526695) | > loss_0: 2.467593193054199 (2.1949738264083862) | > loss_gen: 2.016698122024536 (2.5695858001708984) | > loss_kl: 2.3747546672821045 (2.5461798906326294) | > loss_feat: 6.1706438064575195 (7.067238807678223) | > loss_mel: 30.01968002319336 (28.06367778778076) | > loss_duration: 2.150393486022949 (2.1570976972579956) | > loss_1: 42.73217010498047 (42.40378189086914)  --> STEP: 3 | > loss_disc: 2.906315326690674 (2.4320876598358154) | > loss_disc_real_0: 0.1538076102733612 (0.0860702854891618) | > loss_disc_real_1: 0.32606241106987 (0.2759196609258652) | > loss_disc_real_2: 0.4162212610244751 (0.29189683000246686) | > loss_disc_real_3: 0.26062068343162537 (0.25276053448518115) | > loss_disc_real_4: 0.2944803535938263 (0.24178941547870636) | > loss_disc_real_5: 0.33496910333633423 (0.19780885924895605) | > loss_0: 2.906315326690674 (2.4320876598358154) | > loss_gen: 2.0018341541290283 (2.380335251490275) | > loss_kl: 1.1077721118927002 (2.066710631052653) | > loss_feat: 0.8995370268821716 (5.011338214079539) | > loss_mel: 18.737781524658203 (24.955045700073242) | > loss_duration: 2.210031270980835 (2.1747422218322754) | > loss_1: 24.95695686340332 (36.58817354838053) --> EVAL PERFORMANCE | > avg_loader_time: 0.0020378430684407554 (-0.3193262191045852) | > avg_loss_disc: 2.4320876598358154 (-0.14450761250087174) | > avg_loss_disc_real_0: 0.0860702854891618 (-0.05816848292237238) | > avg_loss_disc_real_1: 0.2759196609258652 (+0.005125827022961216) | > avg_loss_disc_real_2: 0.29189683000246686 (+0.009643658286049295) | > avg_loss_disc_real_3: 0.25276053448518115 (-0.0052288018521808866) | > avg_loss_disc_real_4: 0.24178941547870636 (+0.01920034842831747) | > avg_loss_disc_real_5: 0.19780885924895605 (-0.09407059990224384) | > avg_loss_0: 2.4320876598358154 (-0.14450761250087174) | > avg_loss_gen: 2.380335251490275 (+0.23656511874425945) | > avg_loss_kl: 2.066710631052653 (-0.4274176302410311) | > avg_loss_feat: 5.011338214079539 (+1.594125704396339) | > avg_loss_mel: 24.955045700073242 (+6.406503064291819) | > avg_loss_duration: 2.1747422218322754 (-0.0034663336617604124) | > avg_loss_1: 36.58817354838053 (+7.806311289469399)  > EPOCH: 121/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:58:30)   --> TIME: 2023-10-20 00:58:41 -- STEP: 19/50 -- GLOBAL_STEP: 59070 | > loss_disc: 3.1290841102600098 (2.731378718426353) | > loss_disc_real_0: 0.10521423816680908 (0.1844633799046278) | > loss_disc_real_1: 0.2762176990509033 (0.24351560481284798) | > loss_disc_real_2: 0.13929526507854462 (0.24187132127975164) | > loss_disc_real_3: 0.281453400850296 (0.24845277047470987) | > loss_disc_real_4: 0.22894792258739471 (0.23876203253473105) | > loss_disc_real_5: 0.3880392611026764 (0.24920579810675822) | > loss_0: 3.1290841102600098 (2.731378718426353) | > grad_norm_0: tensor(966.3309, device='cuda:0') (tensor(600.2877, device='cuda:0')) | > loss_gen: 1.5050625801086426 (2.370543222678335) | > loss_kl: 1.4777867794036865 (1.0860162549897243) | > loss_feat: 0.14852960407733917 (4.835555847538145) | > loss_mel: 5.334351539611816 (21.48418082688984) | > loss_duration: 1.8691588640213013 (1.7809084340145713) | > loss_1: 10.33488941192627 (31.557204748454847) | > grad_norm_1: tensor(18437.3691, device='cuda:0') (tensor(26216.1289, device='cuda:0')) | > current_lr_0: 0.0001772054516855847 | > current_lr_1: 0.0001772054516855847 | > step_time: 0.6723 (0.3718968567095305) | > loader_time: 0.022 (0.0073441706205669205)  --> TIME: 2023-10-20 00:58:56 -- STEP: 49/50 -- GLOBAL_STEP: 59100 | > loss_disc: 3.3347878456115723 (2.60689538838912) | > loss_disc_real_0: 0.9407167434692383 (0.19056937809349322) | > loss_disc_real_1: 0.22839225828647614 (0.24396449373084675) | > loss_disc_real_2: 0.16748814284801483 (0.23016282581553169) | > loss_disc_real_3: 0.22328759729862213 (0.24778084365689018) | > loss_disc_real_4: 0.5257709622383118 (0.22874816700968206) | > loss_disc_real_5: 0.47999557852745056 (0.2280625939673307) | > loss_0: 3.3347878456115723 (2.60689538838912) | > grad_norm_0: tensor(1394.7760, device='cuda:0') (tensor(585.4099, device='cuda:0')) | > loss_gen: 3.2169456481933594 (2.332558405642608) | > loss_kl: 0.6314487457275391 (0.9525713537420545) | > loss_feat: 5.088042259216309 (4.816716305151278) | > loss_mel: 27.531713485717773 (22.64643688591159) | > loss_duration: 1.8719455003738403 (1.7480490377971105) | > loss_1: 38.34009552001953 (32.49633193502621) | > grad_norm_1: tensor(11201.1016, device='cuda:0') (tensor(21202.2871, device='cuda:0')) | > current_lr_0: 0.0001772054516855847 | > current_lr_1: 0.0001772054516855847 | > step_time: 0.7176 (0.42886725250555546) | > loader_time: 0.2969 (0.01569898761048609)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9805755615234375 (1.9805755615234375) | > loss_disc_real_0: 0.23096710443496704 (0.23096710443496704) | > loss_disc_real_1: 0.243120014667511 (0.243120014667511) | > loss_disc_real_2: 0.18226560950279236 (0.18226560950279236) | > loss_disc_real_3: 0.1940423995256424 (0.1940423995256424) | > loss_disc_real_4: 0.16588130593299866 (0.16588130593299866) | > loss_disc_real_5: 0.1723822057247162 (0.1723822057247162) | > loss_0: 1.9805755615234375 (1.9805755615234375) | > loss_gen: 2.7604143619537354 (2.7604143619537354) | > loss_kl: 2.1206793785095215 (2.1206793785095215) | > loss_feat: 6.764094352722168 (6.764094352722168) | > loss_mel: 26.51005744934082 (26.51005744934082) | > loss_duration: 2.084625720977783 (2.084625720977783) | > loss_1: 40.2398681640625 (40.2398681640625)  --> STEP: 1 | > loss_disc: 2.8997886180877686 (2.8997886180877686) | > loss_disc_real_0: 0.3113383650779724 (0.3113383650779724) | > loss_disc_real_1: 0.2833188772201538 (0.2833188772201538) | > loss_disc_real_2: 0.28125596046447754 (0.28125596046447754) | > loss_disc_real_3: 0.2864806652069092 (0.2864806652069092) | > loss_disc_real_4: 0.25051262974739075 (0.25051262974739075) | > loss_disc_real_5: 0.21721942722797394 (0.21721942722797394) | > loss_0: 2.8997886180877686 (2.8997886180877686) | > loss_gen: 1.762962818145752 (1.762962818145752) | > loss_kl: 2.7900426387786865 (2.7900426387786865) | > loss_feat: 0.3736436069011688 (0.3736436069011688) | > loss_mel: 15.408586502075195 (15.408586502075195) | > loss_duration: 2.227299213409424 (2.227299213409424) | > loss_1: 22.56253433227539 (22.56253433227539)  --> STEP: 2 | > loss_disc: 1.5047742128372192 (2.202281415462494) | > loss_disc_real_0: 0.021170049905776978 (0.1662542074918747) | > loss_disc_real_1: 0.18622155487537384 (0.23477021604776382) | > loss_disc_real_2: 0.13520336151123047 (0.208229660987854) | > loss_disc_real_3: 0.03773469105362892 (0.16210767813026905) | > loss_disc_real_4: 0.06478694826364517 (0.15764978900551796) | > loss_disc_real_5: 0.05298103392124176 (0.13510023057460785) | > loss_0: 1.5047742128372192 (2.202281415462494) | > loss_gen: 2.6616227626800537 (2.212292790412903) | > loss_kl: 2.3759117126464844 (2.5829771757125854) | > loss_feat: 13.138708114624023 (6.756175860762596) | > loss_mel: 32.267852783203125 (23.83821964263916) | > loss_duration: 2.2360031604766846 (2.231651186943054) | > loss_1: 52.68009567260742 (37.621315002441406)  --> STEP: 3 | > loss_disc: 2.295844316482544 (2.2334690491358438) | > loss_disc_real_0: 0.32465291023254395 (0.21905377507209778) | > loss_disc_real_1: 0.2390093058347702 (0.23618324597676596) | > loss_disc_real_2: 0.207393079996109 (0.20795080065727234) | > loss_disc_real_3: 0.22778521478176117 (0.1840001903474331) | > loss_disc_real_4: 0.24696719646453857 (0.18742225815852484) | > loss_disc_real_5: 0.15327531099319458 (0.14115859071413675) | > loss_0: 2.295844316482544 (2.2334690491358438) | > loss_gen: 2.855748176574707 (2.4267779191335044) | > loss_kl: 0.9757155179977417 (2.0472232898076377) | > loss_feat: 6.033616065979004 (6.515322595834732) | > loss_mel: 24.103113174438477 (23.926517486572266) | > loss_duration: 2.1725964546203613 (2.2119662761688232) | > loss_1: 36.14078903198242 (37.12780634562174) --> EVAL PERFORMANCE | > avg_loader_time: 0.010412375132242838 (+0.008374532063802082) | > avg_loss_disc: 2.2334690491358438 (-0.19861861069997166) | > avg_loss_disc_real_0: 0.21905377507209778 (+0.132983489582936) | > avg_loss_disc_real_1: 0.23618324597676596 (-0.039736414949099214) | > avg_loss_disc_real_2: 0.20795080065727234 (-0.08394602934519452) | > avg_loss_disc_real_3: 0.1840001903474331 (-0.06876034413774806) | > avg_loss_disc_real_4: 0.18742225815852484 (-0.05436715732018152) | > avg_loss_disc_real_5: 0.14115859071413675 (-0.056650268534819304) | > avg_loss_0: 2.2334690491358438 (-0.19861861069997166) | > avg_loss_gen: 2.4267779191335044 (+0.04644266764322946) | > avg_loss_kl: 2.0472232898076377 (-0.019487341245015166) | > avg_loss_feat: 6.515322595834732 (+1.5039843817551928) | > avg_loss_mel: 23.926517486572266 (-1.0285282135009766) | > avg_loss_duration: 2.2119662761688232 (+0.03722405433654785) | > avg_loss_1: 37.12780634562174 (+0.5396327972412109)  > EPOCH: 122/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:59:03)   --> TIME: 2023-10-20 00:59:23 -- STEP: 29/50 -- GLOBAL_STEP: 59130 | > loss_disc: 2.6967689990997314 (2.397834810717353) | > loss_disc_real_0: 0.1575585901737213 (0.17753068534336217) | > loss_disc_real_1: 0.28458288311958313 (0.2111646607518196) | > loss_disc_real_2: 0.22221694886684418 (0.19673469929217263) | > loss_disc_real_3: 0.2569262683391571 (0.2282291036741487) | > loss_disc_real_4: 0.313034325838089 (0.2143201238700542) | > loss_disc_real_5: 0.3170354664325714 (0.20981609233622922) | > loss_0: 2.6967689990997314 (2.397834810717353) | > grad_norm_0: tensor(343.0355, device='cuda:0') (tensor(593.7134, device='cuda:0')) | > loss_gen: 2.3804523944854736 (2.4868143714707474) | > loss_kl: 1.1601437330245972 (1.0769159177253989) | > loss_feat: 3.8860340118408203 (6.29203262925148) | > loss_mel: 25.638954162597656 (25.65113429365487) | > loss_duration: 1.745384931564331 (1.769238307558257) | > loss_1: 34.81096649169922 (37.27613534598514) | > grad_norm_1: tensor(5853.9028, device='cuda:0') (tensor(17971.9980, device='cuda:0')) | > current_lr_0: 0.00017702832374190535 | > current_lr_1: 0.00017702832374190535 | > step_time: 0.2853 (0.5125610746186355) | > loader_time: 0.0251 (0.019104710940657)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0892131328582764 (3.0892131328582764) | > loss_disc_real_0: 0.357174813747406 (0.357174813747406) | > loss_disc_real_1: 0.15928715467453003 (0.15928715467453003) | > loss_disc_real_2: 0.1838698536157608 (0.1838698536157608) | > loss_disc_real_3: 0.27634572982788086 (0.27634572982788086) | > loss_disc_real_4: 0.3621614873409271 (0.3621614873409271) | > loss_disc_real_5: 0.5664560794830322 (0.5664560794830322) | > loss_0: 3.0892131328582764 (3.0892131328582764) | > loss_gen: 2.1786139011383057 (2.1786139011383057) | > loss_kl: 1.8748568296432495 (1.8748568296432495) | > loss_feat: 4.810085296630859 (4.810085296630859) | > loss_mel: 22.936105728149414 (22.936105728149414) | > loss_duration: 2.086095094680786 (2.086095094680786) | > loss_1: 33.88575744628906 (33.88575744628906)  --> STEP: 1 | > loss_disc: 2.658775806427002 (2.658775806427002) | > loss_disc_real_0: 0.050401072949171066 (0.050401072949171066) | > loss_disc_real_1: 0.35077235102653503 (0.35077235102653503) | > loss_disc_real_2: 0.19875335693359375 (0.19875335693359375) | > loss_disc_real_3: 0.2826738655567169 (0.2826738655567169) | > loss_disc_real_4: 0.3043506145477295 (0.3043506145477295) | > loss_disc_real_5: 0.3391130864620209 (0.3391130864620209) | > loss_0: 2.658775806427002 (2.658775806427002) | > loss_gen: 2.215165376663208 (2.215165376663208) | > loss_kl: 2.565962553024292 (2.565962553024292) | > loss_feat: 7.137141227722168 (7.137141227722168) | > loss_mel: 28.511253356933594 (28.511253356933594) | > loss_duration: 2.251427173614502 (2.251427173614502) | > loss_1: 42.680946350097656 (42.680946350097656)  --> STEP: 2 | > loss_disc: 2.6371006965637207 (2.6479382514953613) | > loss_disc_real_0: 0.22048087418079376 (0.13544097356498241) | > loss_disc_real_1: 0.27673032879829407 (0.31375133991241455) | > loss_disc_real_2: 0.18655680119991302 (0.1926550790667534) | > loss_disc_real_3: 0.2676219344139099 (0.2751478999853134) | > loss_disc_real_4: 0.30004340410232544 (0.30219700932502747) | > loss_disc_real_5: 0.34380435943603516 (0.341458722949028) | > loss_0: 2.6371006965637207 (2.6479382514953613) | > loss_gen: 2.1858646869659424 (2.200515031814575) | > loss_kl: 2.536036968231201 (2.5509997606277466) | > loss_feat: 5.792551517486572 (6.46484637260437) | > loss_mel: 24.61264419555664 (26.561948776245117) | > loss_duration: 2.1804866790771484 (2.215956926345825) | > loss_1: 37.307579040527344 (39.9942626953125)  --> STEP: 3 | > loss_disc: 2.6696407794952393 (2.655172427495321) | > loss_disc_real_0: 0.09955679625272751 (0.12347958112756412) | > loss_disc_real_1: 0.23199769854545593 (0.28650012612342834) | > loss_disc_real_2: 0.3373243510723114 (0.24087816973527273) | > loss_disc_real_3: 0.42495688796043396 (0.3250842293103536) | > loss_disc_real_4: 0.23980744183063507 (0.28140048682689667) | > loss_disc_real_5: 0.2297034114599228 (0.3042069524526596) | > loss_0: 2.6696407794952393 (2.655172427495321) | > loss_gen: 2.282421827316284 (2.2278172969818115) | > loss_kl: 1.213535189628601 (2.1051782369613647) | > loss_feat: 4.953436851501465 (5.961043198903401) | > loss_mel: 30.52893829345703 (27.884278615315754) | > loss_duration: 2.129952907562256 (2.1872889200846353) | > loss_1: 41.10828399658203 (40.36560312906901) --> EVAL PERFORMANCE | > avg_loader_time: 0.00612942377726237 (-0.004282951354980468) | > avg_loss_disc: 2.655172427495321 (+0.421703378359477) | > avg_loss_disc_real_0: 0.12347958112756412 (-0.09557419394453366) | > avg_loss_disc_real_1: 0.28650012612342834 (+0.050316880146662385) | > avg_loss_disc_real_2: 0.24087816973527273 (+0.032927369078000396) | > avg_loss_disc_real_3: 0.3250842293103536 (+0.1410840389629205) | > avg_loss_disc_real_4: 0.28140048682689667 (+0.09397822866837183) | > avg_loss_disc_real_5: 0.3042069524526596 (+0.16304836173852286) | > avg_loss_0: 2.655172427495321 (+0.421703378359477) | > avg_loss_gen: 2.2278172969818115 (-0.19896062215169286) | > avg_loss_kl: 2.1051782369613647 (+0.057954947153727066) | > avg_loss_feat: 5.961043198903401 (-0.5542793969313307) | > avg_loss_mel: 27.884278615315754 (+3.9577611287434884) | > avg_loss_duration: 2.1872889200846353 (-0.024677356084187974) | > avg_loss_1: 40.36560312906901 (+3.2377967834472656)  > EPOCH: 123/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 00:59:42)   --> TIME: 2023-10-20 00:59:52 -- STEP: 9/50 -- GLOBAL_STEP: 59160 | > loss_disc: 2.347947597503662 (2.490367306603326) | > loss_disc_real_0: 0.12238331139087677 (0.1473565428621239) | > loss_disc_real_1: 0.2518954575061798 (0.22425053185886806) | > loss_disc_real_2: 0.2650039494037628 (0.22406207438972262) | > loss_disc_real_3: 0.2111273854970932 (0.255395813120736) | > loss_disc_real_4: 0.13767912983894348 (0.17081493594580227) | > loss_disc_real_5: 0.14840319752693176 (0.19687620529698002) | > loss_0: 2.347947597503662 (2.490367306603326) | > grad_norm_0: tensor(387.5975, device='cuda:0') (tensor(457.2001, device='cuda:0')) | > loss_gen: 2.398798704147339 (2.0901140107048883) | > loss_kl: 0.9818415641784668 (0.9998704128795199) | > loss_feat: 5.00405740737915 (3.7963684971133866) | > loss_mel: 20.801620483398438 (19.669709907637703) | > loss_duration: 1.6824376583099365 (1.7418063349193997) | > loss_1: 30.868755340576172 (28.29786941740248) | > grad_norm_1: tensor(14027.6611, device='cuda:0') (tensor(24695.7012, device='cuda:0')) | > current_lr_0: 0.00017685137284869558 | > current_lr_1: 0.00017685137284869558 | > step_time: 0.5239 (0.40444813834296334) | > loader_time: 0.0025 (0.004611942503187392)  --> TIME: 2023-10-20 01:00:09 -- STEP: 39/50 -- GLOBAL_STEP: 59190 | > loss_disc: 2.8225488662719727 (2.5106536119412155) | > loss_disc_real_0: 0.1702495515346527 (0.1668183088827974) | > loss_disc_real_1: 0.35010161995887756 (0.22913470940712172) | > loss_disc_real_2: 0.2496945708990097 (0.2260220227524256) | > loss_disc_real_3: 0.3558477759361267 (0.23706899239466742) | > loss_disc_real_4: 0.2442813366651535 (0.20859605513322046) | > loss_disc_real_5: 0.39433008432388306 (0.232531861999096) | > loss_0: 2.8225488662719727 (2.5106536119412155) | > grad_norm_0: tensor(1165.8446, device='cuda:0') (tensor(584.1095, device='cuda:0')) | > loss_gen: 2.1756558418273926 (2.200981366328704) | > loss_kl: 0.644060492515564 (1.0698404315954597) | > loss_feat: 1.901576280593872 (4.124455678348359) | > loss_mel: 24.890056610107422 (22.128964494436214) | > loss_duration: 1.8073679208755493 (1.7416846201970027) | > loss_1: 31.418716430664062 (31.26592648334993) | > grad_norm_1: tensor(11395.4072, device='cuda:0') (tensor(18034.7988, device='cuda:0')) | > current_lr_0: 0.00017685137284869558 | > current_lr_1: 0.00017685137284869558 | > step_time: 0.5599 (0.5019025802612304) | > loader_time: 0.0225 (0.015665751237135667)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4873976707458496 (2.4873976707458496) | > loss_disc_real_0: 0.24867461621761322 (0.24867461621761322) | > loss_disc_real_1: 0.1404394805431366 (0.1404394805431366) | > loss_disc_real_2: 0.16425402462482452 (0.16425402462482452) | > loss_disc_real_3: 0.21774131059646606 (0.21774131059646606) | > loss_disc_real_4: 0.1605478674173355 (0.1605478674173355) | > loss_disc_real_5: 0.24819707870483398 (0.24819707870483398) | > loss_0: 2.4873976707458496 (2.4873976707458496) | > loss_gen: 2.177082061767578 (2.177082061767578) | > loss_kl: 2.3373425006866455 (2.3373425006866455) | > loss_feat: 6.189661502838135 (6.189661502838135) | > loss_mel: 26.360942840576172 (26.360942840576172) | > loss_duration: 2.112539768218994 (2.112539768218994) | > loss_1: 39.17757034301758 (39.17757034301758)  --> STEP: 1 | > loss_disc: 2.4631285667419434 (2.4631285667419434) | > loss_disc_real_0: 0.024928363040089607 (0.024928363040089607) | > loss_disc_real_1: 0.20055866241455078 (0.20055866241455078) | > loss_disc_real_2: 0.2553400993347168 (0.2553400993347168) | > loss_disc_real_3: 0.2674444913864136 (0.2674444913864136) | > loss_disc_real_4: 0.16856399178504944 (0.16856399178504944) | > loss_disc_real_5: 0.5796224474906921 (0.5796224474906921) | > loss_0: 2.4631285667419434 (2.4631285667419434) | > loss_gen: 2.38700008392334 (2.38700008392334) | > loss_kl: 3.3145716190338135 (3.3145716190338135) | > loss_feat: 7.989201068878174 (7.989201068878174) | > loss_mel: 26.662710189819336 (26.662710189819336) | > loss_duration: 2.318807363510132 (2.318807363510132) | > loss_1: 42.67229080200195 (42.67229080200195)  --> STEP: 2 | > loss_disc: 1.6634178161621094 (2.0632731914520264) | > loss_disc_real_0: 0.07121729850769043 (0.04807283077389002) | > loss_disc_real_1: 0.046187933534383774 (0.12337329797446728) | > loss_disc_real_2: 0.03786638751626015 (0.14660324342548847) | > loss_disc_real_3: 0.08280295878648758 (0.17512372508645058) | > loss_disc_real_4: 0.02584831416606903 (0.09720615297555923) | > loss_disc_real_5: 0.05515601113438606 (0.3173892293125391) | > loss_0: 1.6634178161621094 (2.0632731914520264) | > loss_gen: 2.167477607727051 (2.2772388458251953) | > loss_kl: 2.4546847343444824 (2.884628176689148) | > loss_feat: 11.139229774475098 (9.564215421676636) | > loss_mel: 24.14897918701172 (25.405844688415527) | > loss_duration: 2.293833017349243 (2.3063201904296875) | > loss_1: 42.20420455932617 (42.43824768066406)  --> STEP: 3 | > loss_disc: 1.6436355113983154 (1.923393964767456) | > loss_disc_real_0: 0.14137960970401764 (0.07917509041726589) | > loss_disc_real_1: 0.181741401553154 (0.14282933250069618) | > loss_disc_real_2: 0.10835878551006317 (0.13385509078701338) | > loss_disc_real_3: 0.2372434139251709 (0.19583028803269067) | > loss_disc_real_4: 0.12559819221496582 (0.10667016605536143) | > loss_disc_real_5: 0.07728943228721619 (0.23735596363743147) | > loss_0: 1.6436355113983154 (1.923393964767456) | > loss_gen: 3.4033806324005127 (2.6526194413503013) | > loss_kl: 1.2182769775390625 (2.3291777769724527) | > loss_feat: 9.809233665466309 (9.645888169606527) | > loss_mel: 23.902116775512695 (24.90460205078125) | > loss_duration: 2.213078737258911 (2.2752397060394287) | > loss_1: 40.546085357666016 (41.80752690633138) --> EVAL PERFORMANCE | > avg_loader_time: 0.006407976150512695 (+0.00027855237325032523) | > avg_loss_disc: 1.923393964767456 (-0.7317784627278647) | > avg_loss_disc_real_0: 0.07917509041726589 (-0.044304490710298225) | > avg_loss_disc_real_1: 0.14282933250069618 (-0.14367079362273216) | > avg_loss_disc_real_2: 0.13385509078701338 (-0.10702307894825935) | > avg_loss_disc_real_3: 0.19583028803269067 (-0.1292539412776629) | > avg_loss_disc_real_4: 0.10667016605536143 (-0.17473032077153522) | > avg_loss_disc_real_5: 0.23735596363743147 (-0.06685098881522814) | > avg_loss_0: 1.923393964767456 (-0.7317784627278647) | > avg_loss_gen: 2.6526194413503013 (+0.42480214436848973) | > avg_loss_kl: 2.3291777769724527 (+0.2239995400110879) | > avg_loss_feat: 9.645888169606527 (+3.684844970703126) | > avg_loss_mel: 24.90460205078125 (-2.979676564534504) | > avg_loss_duration: 2.2752397060394287 (+0.08795078595479344) | > avg_loss_1: 41.80752690633138 (+1.4419237772623745)  > EPOCH: 124/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:00:24)   --> TIME: 2023-10-20 01:00:36 -- STEP: 19/50 -- GLOBAL_STEP: 59220 | > loss_disc: 1.5737624168395996 (2.0714215667624223) | > loss_disc_real_0: 0.08233724534511566 (0.11292137107566784) | > loss_disc_real_1: 0.16413304209709167 (0.1944414193889028) | > loss_disc_real_2: 0.1691301465034485 (0.20232528369677694) | > loss_disc_real_3: 0.17407166957855225 (0.22386174178437182) | > loss_disc_real_4: 0.07036270946264267 (0.17295136724255586) | > loss_disc_real_5: 0.03372498229146004 (0.17522502906228365) | > loss_0: 1.5737624168395996 (2.0714215667624223) | > grad_norm_0: tensor(264.6139, device='cuda:0') (tensor(603.7288, device='cuda:0')) | > loss_gen: 2.9870567321777344 (2.9201698742414774) | > loss_kl: 1.0320743322372437 (1.043937822705821) | > loss_feat: 8.338459014892578 (7.530654320591374) | > loss_mel: 25.64957618713379 (27.91192832746004) | > loss_duration: 1.8759404420852661 (1.804165476246884) | > loss_1: 39.88311004638672 (41.21085591065256) | > grad_norm_1: tensor(19143.4277, device='cuda:0') (tensor(29423.1484, device='cuda:0')) | > current_lr_0: 0.00017667459882898234 | > current_lr_1: 0.00017667459882898234 | > step_time: 0.2596 (0.4067764909643876) | > loader_time: 0.002 (0.010728472157528526)  --> TIME: 2023-10-20 01:00:51 -- STEP: 49/50 -- GLOBAL_STEP: 59250 | > loss_disc: 3.1871132850646973 (2.315952675683159) | > loss_disc_real_0: 0.3577442765235901 (0.14533375348059496) | > loss_disc_real_1: 0.3103119730949402 (0.2206003323425444) | > loss_disc_real_2: 0.4754525125026703 (0.22453354709610648) | > loss_disc_real_3: 0.39613887667655945 (0.2268526414219214) | > loss_disc_real_4: 0.3147791624069214 (0.20231933234145447) | > loss_disc_real_5: 0.35719650983810425 (0.20076692632722612) | > loss_0: 3.1871132850646973 (2.315952675683159) | > grad_norm_0: tensor(555.2836, device='cuda:0') (tensor(555.2252, device='cuda:0')) | > loss_gen: 2.006357431411743 (2.6338549341474256) | > loss_kl: 0.9564127326011658 (1.0223829606357886) | > loss_feat: 0.8443037867546082 (6.414416001159317) | > loss_mel: 19.344619750976562 (25.67569311540954) | > loss_duration: 1.847067952156067 (1.7434338306894108) | > loss_1: 24.998762130737305 (37.489781116952706) | > grad_norm_1: tensor(4387.0054, device='cuda:0') (tensor(21195.0820, device='cuda:0')) | > current_lr_0: 0.00017667459882898234 | > current_lr_1: 0.00017667459882898234 | > step_time: 0.6331 (0.45120456753944865) | > loader_time: 0.315 (0.017995177483072087)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.040832996368408 (3.040832996368408) | > loss_disc_real_0: 0.2693106234073639 (0.2693106234073639) | > loss_disc_real_1: 0.26252469420433044 (0.26252469420433044) | > loss_disc_real_2: 0.26725515723228455 (0.26725515723228455) | > loss_disc_real_3: 0.36184555292129517 (0.36184555292129517) | > loss_disc_real_4: 0.28973388671875 (0.28973388671875) | > loss_disc_real_5: 0.4081840515136719 (0.4081840515136719) | > loss_0: 3.040832996368408 (3.040832996368408) | > loss_gen: 1.88411545753479 (1.88411545753479) | > loss_kl: 2.1758506298065186 (2.1758506298065186) | > loss_feat: 0.4824865460395813 (0.4824865460395813) | > loss_mel: 13.99933910369873 (13.99933910369873) | > loss_duration: 2.0828323364257812 (2.0828323364257812) | > loss_1: 20.624624252319336 (20.624624252319336)  --> STEP: 1 | > loss_disc: 3.1697113513946533 (3.1697113513946533) | > loss_disc_real_0: 0.0064839571714401245 (0.0064839571714401245) | > loss_disc_real_1: 0.2397707849740982 (0.2397707849740982) | > loss_disc_real_2: 0.47761964797973633 (0.47761964797973633) | > loss_disc_real_3: 0.28795862197875977 (0.28795862197875977) | > loss_disc_real_4: 0.38844162225723267 (0.38844162225723267) | > loss_disc_real_5: 0.21723401546478271 (0.21723401546478271) | > loss_0: 3.1697113513946533 (3.1697113513946533) | > loss_gen: 1.8188303709030151 (1.8188303709030151) | > loss_kl: 2.929215431213379 (2.929215431213379) | > loss_feat: 5.165031909942627 (5.165031909942627) | > loss_mel: 24.06780242919922 (24.06780242919922) | > loss_duration: 2.281759023666382 (2.281759023666382) | > loss_1: 36.26263427734375 (36.26263427734375)  --> STEP: 2 | > loss_disc: 3.0955872535705566 (3.132649302482605) | > loss_disc_real_0: 0.2781214714050293 (0.1423027142882347) | > loss_disc_real_1: 0.26236793398857117 (0.2510693594813347) | > loss_disc_real_2: 0.2687372863292694 (0.37317846715450287) | > loss_disc_real_3: 0.36177006363868713 (0.32486434280872345) | > loss_disc_real_4: 0.2903136909008026 (0.33937765657901764) | > loss_disc_real_5: 0.40787169337272644 (0.3125528544187546) | > loss_0: 3.0955872535705566 (3.132649302482605) | > loss_gen: 1.8181320428848267 (1.818481206893921) | > loss_kl: 3.119497776031494 (3.0243566036224365) | > loss_feat: 0.3371313214302063 (2.7510816156864166) | > loss_mel: 4.916727542877197 (14.492264986038208) | > loss_duration: 2.280372142791748 (2.281065583229065) | > loss_1: 12.471860885620117 (24.367247581481934)  --> STEP: 3 | > loss_disc: 3.001098871231079 (3.088799158732096) | > loss_disc_real_0: 0.20574447512626648 (0.16344996790091196) | > loss_disc_real_1: 0.26558759808540344 (0.2559087723493576) | > loss_disc_real_2: 0.28939804434776306 (0.3452516595522563) | > loss_disc_real_3: 0.3785974085330963 (0.3427753647168477) | > loss_disc_real_4: 0.3719034194946289 (0.35021957755088806) | > loss_disc_real_5: 0.3864856958389282 (0.3371971348921458) | > loss_0: 3.001098871231079 (3.088799158732096) | > loss_gen: 2.0954134464263916 (1.9107919534047444) | > loss_kl: 1.2711427211761475 (2.4399519761403403) | > loss_feat: 1.854805588722229 (2.4523229400316873) | > loss_mel: 22.675521850585938 (17.220017274220783) | > loss_duration: 2.216831922531128 (2.2596543629964194) | > loss_1: 30.11371421813965 (26.28273646036784) --> EVAL PERFORMANCE | > avg_loader_time: 0.002675215403238932 (-0.003732760747273763) | > avg_loss_disc: 3.088799158732096 (+1.1654051939646402) | > avg_loss_disc_real_0: 0.16344996790091196 (+0.08427487748364607) | > avg_loss_disc_real_1: 0.2559087723493576 (+0.11307943984866142) | > avg_loss_disc_real_2: 0.3452516595522563 (+0.2113965687652429) | > avg_loss_disc_real_3: 0.3427753647168477 (+0.14694507668415704) | > avg_loss_disc_real_4: 0.35021957755088806 (+0.2435494114955266) | > avg_loss_disc_real_5: 0.3371971348921458 (+0.09984117125471434) | > avg_loss_0: 3.088799158732096 (+1.1654051939646402) | > avg_loss_gen: 1.9107919534047444 (-0.7418274879455569) | > avg_loss_kl: 2.4399519761403403 (+0.11077419916788767) | > avg_loss_feat: 2.4523229400316873 (-7.1935652295748405) | > avg_loss_mel: 17.220017274220783 (-7.684584776560467) | > avg_loss_duration: 2.2596543629964194 (-0.015585343043009292) | > avg_loss_1: 26.28273646036784 (-15.524790445963543)  > EPOCH: 125/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:00:59)   --> TIME: 2023-10-20 01:01:19 -- STEP: 29/50 -- GLOBAL_STEP: 59280 | > loss_disc: 3.035308361053467 (2.408140836090877) | > loss_disc_real_0: 0.26859378814697266 (0.16118640388394223) | > loss_disc_real_1: 0.3602210283279419 (0.21162671415970244) | > loss_disc_real_2: 0.30704423785209656 (0.21404078853284492) | > loss_disc_real_3: 0.25740861892700195 (0.24093393082248757) | > loss_disc_real_4: 0.5727348923683167 (0.22135017767291645) | > loss_disc_real_5: 0.5433385968208313 (0.24205519053442726) | > loss_0: 3.035308361053467 (2.408140836090877) | > grad_norm_0: tensor(656.8727, device='cuda:0') (tensor(608.3870, device='cuda:0')) | > loss_gen: 3.4414710998535156 (2.608240070014165) | > loss_kl: 0.8382343053817749 (1.1487858480420605) | > loss_feat: 5.626579284667969 (6.36212699063893) | > loss_mel: 23.82582664489746 (25.326003814565723) | > loss_duration: 1.7504018545150757 (1.7648361674670516) | > loss_1: 35.48250961303711 (37.20999293491758) | > grad_norm_1: tensor(16428.3105, device='cuda:0') (tensor(26429.2324, device='cuda:0')) | > current_lr_0: 0.0001764980015059695 | > current_lr_1: 0.0001764980015059695 | > step_time: 0.6165 (0.4985751201366556) | > loader_time: 0.0232 (0.02091152914639177)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9081273078918457 (2.9081273078918457) | > loss_disc_real_0: 0.3349422216415405 (0.3349422216415405) | > loss_disc_real_1: 0.24172286689281464 (0.24172286689281464) | > loss_disc_real_2: 0.15148499608039856 (0.15148499608039856) | > loss_disc_real_3: 0.32715949416160583 (0.32715949416160583) | > loss_disc_real_4: 0.21383893489837646 (0.21383893489837646) | > loss_disc_real_5: 0.3193666934967041 (0.3193666934967041) | > loss_0: 2.9081273078918457 (2.9081273078918457) | > loss_gen: 1.8121477365493774 (1.8121477365493774) | > loss_kl: 2.239431381225586 (2.239431381225586) | > loss_feat: 2.373753309249878 (2.373753309249878) | > loss_mel: 22.552845001220703 (22.552845001220703) | > loss_duration: 2.1077370643615723 (2.1077370643615723) | > loss_1: 31.085914611816406 (31.085914611816406)  --> STEP: 1 | > loss_disc: 2.634307384490967 (2.634307384490967) | > loss_disc_real_0: 0.20543238520622253 (0.20543238520622253) | > loss_disc_real_1: 0.2688973546028137 (0.2688973546028137) | > loss_disc_real_2: 0.2128412276506424 (0.2128412276506424) | > loss_disc_real_3: 0.2536710202693939 (0.2536710202693939) | > loss_disc_real_4: 0.40426021814346313 (0.40426021814346313) | > loss_disc_real_5: 0.22876426577568054 (0.22876426577568054) | > loss_0: 2.634307384490967 (2.634307384490967) | > loss_gen: 2.6840178966522217 (2.6840178966522217) | > loss_kl: 2.513742446899414 (2.513742446899414) | > loss_feat: 6.395105838775635 (6.395105838775635) | > loss_mel: 27.310056686401367 (27.310056686401367) | > loss_duration: 2.2558236122131348 (2.2558236122131348) | > loss_1: 41.15874481201172 (41.15874481201172)  --> STEP: 2 | > loss_disc: 1.9998830556869507 (2.3170952200889587) | > loss_disc_real_0: 0.2366914451122284 (0.22106191515922546) | > loss_disc_real_1: 0.1613040715456009 (0.2151007130742073) | > loss_disc_real_2: 0.1369108259677887 (0.17487602680921555) | > loss_disc_real_3: 0.33586230874061584 (0.2947666645050049) | > loss_disc_real_4: 0.10556641221046448 (0.2549133151769638) | > loss_disc_real_5: 0.25114771723747253 (0.23995599150657654) | > loss_0: 1.9998830556869507 (2.3170952200889587) | > loss_gen: 3.0990257263183594 (2.8915218114852905) | > loss_kl: 2.944013833999634 (2.728878140449524) | > loss_feat: 9.490410804748535 (7.942758321762085) | > loss_mel: 31.286195755004883 (29.298126220703125) | > loss_duration: 2.2440621852874756 (2.249942898750305) | > loss_1: 49.06370544433594 (45.11122512817383)  --> STEP: 3 | > loss_disc: 3.023752212524414 (2.5526475509007773) | > loss_disc_real_0: 0.3722684979438782 (0.27146410942077637) | > loss_disc_real_1: 0.2763499617576599 (0.23551712930202484) | > loss_disc_real_2: 0.2806839346885681 (0.2101453294356664) | > loss_disc_real_3: 0.2652665078639984 (0.28493327895800274) | > loss_disc_real_4: 0.27436232566833496 (0.2613963186740875) | > loss_disc_real_5: 0.25717976689338684 (0.24569724996884665) | > loss_0: 3.023752212524414 (2.5526475509007773) | > loss_gen: 1.7409815788269043 (2.5080084005991616) | > loss_kl: 1.1803264617919922 (2.21269424756368) | > loss_feat: 0.23295830190181732 (5.372824981808662) | > loss_mel: 9.511617660522461 (22.70262336730957) | > loss_duration: 2.2383415699005127 (2.2460757891337075) | > loss_1: 14.90422534942627 (35.042225201924644) --> EVAL PERFORMANCE | > avg_loader_time: 0.0021731058756510415 (-0.0005021095275878906) | > avg_loss_disc: 2.5526475509007773 (-0.5361516078313189) | > avg_loss_disc_real_0: 0.27146410942077637 (+0.10801414151986441) | > avg_loss_disc_real_1: 0.23551712930202484 (-0.020391643047332764) | > avg_loss_disc_real_2: 0.2101453294356664 (-0.13510633011658987) | > avg_loss_disc_real_3: 0.28493327895800274 (-0.057842085758844974) | > avg_loss_disc_real_4: 0.2613963186740875 (-0.08882325887680054) | > avg_loss_disc_real_5: 0.24569724996884665 (-0.09149988492329916) | > avg_loss_0: 2.5526475509007773 (-0.5361516078313189) | > avg_loss_gen: 2.5080084005991616 (+0.5972164471944172) | > avg_loss_kl: 2.21269424756368 (-0.22725772857666016) | > avg_loss_feat: 5.372824981808662 (+2.920502041776975) | > avg_loss_mel: 22.70262336730957 (+5.482606093088787) | > avg_loss_duration: 2.2460757891337075 (-0.013578573862711885) | > avg_loss_1: 35.042225201924644 (+8.759488741556805)  > EPOCH: 126/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:01:39)   --> TIME: 2023-10-20 01:01:47 -- STEP: 9/50 -- GLOBAL_STEP: 59310 | > loss_disc: 2.544524669647217 (2.574720925754971) | > loss_disc_real_0: 0.2103550285100937 (0.15295711894416147) | > loss_disc_real_1: 0.2529911696910858 (0.21733847508827844) | > loss_disc_real_2: 0.19437062740325928 (0.2609119431840049) | > loss_disc_real_3: 0.24384744465351105 (0.24793128006988102) | > loss_disc_real_4: 0.19698943197727203 (0.22850973076290554) | > loss_disc_real_5: 0.2109847366809845 (0.2343443383773168) | > loss_0: 2.544524669647217 (2.574720925754971) | > grad_norm_0: tensor(315.6035, device='cuda:0') (tensor(410.1844, device='cuda:0')) | > loss_gen: 1.7585766315460205 (2.1034582455952964) | > loss_kl: 0.8418486714363098 (0.9392965568436517) | > loss_feat: 1.5139281749725342 (4.489106946521336) | > loss_mel: 25.313201904296875 (22.432280911339653) | > loss_duration: 1.680591106414795 (1.7649301687876384) | > loss_1: 31.1081485748291 (31.729072835710312) | > grad_norm_1: tensor(8019.1685, device='cuda:0') (tensor(12521.3477, device='cuda:0')) | > current_lr_0: 0.0001763215807030377 | > current_lr_1: 0.0001763215807030377 | > step_time: 0.2663 (0.521915488772922) | > loader_time: 0.0021 (0.011028660668267144)  --> TIME: 2023-10-20 01:02:02 -- STEP: 39/50 -- GLOBAL_STEP: 59340 | > loss_disc: 3.097334861755371 (2.513295604632451) | > loss_disc_real_0: 0.14264638721942902 (0.15043259686671007) | > loss_disc_real_1: 0.3045978248119354 (0.2199986294294015) | > loss_disc_real_2: 0.2880399227142334 (0.24568612969074494) | > loss_disc_real_3: 0.2650633454322815 (0.2458990753079071) | > loss_disc_real_4: 0.3401987552642822 (0.23214506668349108) | > loss_disc_real_5: 0.3314298391342163 (0.2390525926095553) | > loss_0: 3.097334861755371 (2.513295604632451) | > grad_norm_0: tensor(464.4138, device='cuda:0') (tensor(538.3657, device='cuda:0')) | > loss_gen: 1.6561741828918457 (2.3303186434965864) | > loss_kl: 0.5915347337722778 (1.0351007733589563) | > loss_feat: 0.7923774719238281 (4.656939464692887) | > loss_mel: 13.220300674438477 (22.561473846435547) | > loss_duration: 1.772684931755066 (1.7490444061083672) | > loss_1: 18.033071517944336 (32.33287795384725) | > grad_norm_1: tensor(4172.4575, device='cuda:0') (tensor(16257.6064, device='cuda:0')) | > current_lr_0: 0.0001763215807030377 | > current_lr_1: 0.0001763215807030377 | > step_time: 0.6364 (0.4746748912028777) | > loader_time: 0.0097 (0.012692763255192684)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2652223110198975 (2.2652223110198975) | > loss_disc_real_0: 0.31052887439727783 (0.31052887439727783) | > loss_disc_real_1: 0.17866192758083344 (0.17866192758083344) | > loss_disc_real_2: 0.1713794320821762 (0.1713794320821762) | > loss_disc_real_3: 0.1138639822602272 (0.1138639822602272) | > loss_disc_real_4: 0.28779226541519165 (0.28779226541519165) | > loss_disc_real_5: 0.16896753013134003 (0.16896753013134003) | > loss_0: 2.2652223110198975 (2.2652223110198975) | > loss_gen: 4.676016807556152 (4.676016807556152) | > loss_kl: 1.8927290439605713 (1.8927290439605713) | > loss_feat: 12.810026168823242 (12.810026168823242) | > loss_mel: 24.317642211914062 (24.317642211914062) | > loss_duration: 2.0370044708251953 (2.0370044708251953) | > loss_1: 45.733421325683594 (45.733421325683594)  --> STEP: 1 | > loss_disc: 1.826938271522522 (1.826938271522522) | > loss_disc_real_0: 0.013721019960939884 (0.013721019960939884) | > loss_disc_real_1: 0.2390807718038559 (0.2390807718038559) | > loss_disc_real_2: 0.28327473998069763 (0.28327473998069763) | > loss_disc_real_3: 0.2466236799955368 (0.2466236799955368) | > loss_disc_real_4: 0.2256285399198532 (0.2256285399198532) | > loss_disc_real_5: 0.03671638295054436 (0.03671638295054436) | > loss_0: 1.826938271522522 (1.826938271522522) | > loss_gen: 2.848968744277954 (2.848968744277954) | > loss_kl: 2.64202880859375 (2.64202880859375) | > loss_feat: 7.558187007904053 (7.558187007904053) | > loss_mel: 28.978534698486328 (28.978534698486328) | > loss_duration: 2.16502046585083 (2.16502046585083) | > loss_1: 44.1927375793457 (44.1927375793457)  --> STEP: 2 | > loss_disc: 2.6050539016723633 (2.2159960865974426) | > loss_disc_real_0: 0.045226775109767914 (0.0294738975353539) | > loss_disc_real_1: 0.23078078031539917 (0.23493077605962753) | > loss_disc_real_2: 0.2954464852809906 (0.2893606126308441) | > loss_disc_real_3: 0.27154070138931274 (0.2590821906924248) | > loss_disc_real_4: 0.25432848930358887 (0.23997851461172104) | > loss_disc_real_5: 0.23983809351921082 (0.1382772382348776) | > loss_0: 2.6050539016723633 (2.2159960865974426) | > loss_gen: 2.2999634742736816 (2.574466109275818) | > loss_kl: 2.756882905960083 (2.6994558572769165) | > loss_feat: 6.929964065551758 (7.244075536727905) | > loss_mel: 25.505332946777344 (27.241933822631836) | > loss_duration: 2.160612106323242 (2.162816286087036) | > loss_1: 39.65275573730469 (41.922746658325195)  --> STEP: 3 | > loss_disc: 2.492544412612915 (2.3081788619359336) | > loss_disc_real_0: 0.14535531401634216 (0.06810103636234999) | > loss_disc_real_1: 0.4290744662284851 (0.2996453394492467) | > loss_disc_real_2: 0.4128740429878235 (0.3305317560831706) | > loss_disc_real_3: 0.20350615680217743 (0.24055684606234232) | > loss_disc_real_4: 0.2383343130350113 (0.23943044741948447) | > loss_disc_real_5: 0.354413241147995 (0.21032257253925005) | > loss_0: 2.492544412612915 (2.3081788619359336) | > loss_gen: 3.047240734100342 (2.7320576508839927) | > loss_kl: 1.2185088396072388 (2.205806851387024) | > loss_feat: 4.272470474243164 (6.253540515899658) | > loss_mel: 26.654733657836914 (27.046200434366863) | > loss_duration: 2.118494749069214 (2.1480424404144287) | > loss_1: 37.31145095825195 (40.38564809163412) --> EVAL PERFORMANCE | > avg_loader_time: 0.011070807774861654 (+0.008897701899210613) | > avg_loss_disc: 2.3081788619359336 (-0.24446868896484375) | > avg_loss_disc_real_0: 0.06810103636234999 (-0.20336307305842638) | > avg_loss_disc_real_1: 0.2996453394492467 (+0.06412821014722186) | > avg_loss_disc_real_2: 0.3305317560831706 (+0.12038642664750418) | > avg_loss_disc_real_3: 0.24055684606234232 (-0.04437643289566043) | > avg_loss_disc_real_4: 0.23943044741948447 (-0.02196587125460306) | > avg_loss_disc_real_5: 0.21032257253925005 (-0.0353746774295966) | > avg_loss_0: 2.3081788619359336 (-0.24446868896484375) | > avg_loss_gen: 2.7320576508839927 (+0.22404925028483103) | > avg_loss_kl: 2.205806851387024 (-0.006887396176656235) | > avg_loss_feat: 6.253540515899658 (+0.8807155340909958) | > avg_loss_mel: 27.046200434366863 (+4.343577067057293) | > avg_loss_duration: 2.1480424404144287 (-0.09803334871927882) | > avg_loss_1: 40.38564809163412 (+5.343422889709473)  > EPOCH: 127/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:02:15)   --> TIME: 2023-10-20 01:02:29 -- STEP: 19/50 -- GLOBAL_STEP: 59370 | > loss_disc: 1.8337478637695312 (2.503398067072818) | > loss_disc_real_0: 0.09895532578229904 (0.14328351714893392) | > loss_disc_real_1: 0.21600574254989624 (0.23173045445429652) | > loss_disc_real_2: 0.1036706492304802 (0.25430782649077865) | > loss_disc_real_3: 0.16491365432739258 (0.25257101145229843) | > loss_disc_real_4: 0.04659193009138107 (0.23459431019268537) | > loss_disc_real_5: 0.12996093928813934 (0.21610441377484485) | > loss_0: 1.8337478637695312 (2.503398067072818) | > grad_norm_0: tensor(396.1442, device='cuda:0') (tensor(517.4762, device='cuda:0')) | > loss_gen: 2.705267906188965 (2.3866625020378516) | > loss_kl: 0.8630894422531128 (1.0072787372689498) | > loss_feat: 8.534228324890137 (5.079886536849172) | > loss_mel: 26.60917854309082 (25.561551746569183) | > loss_duration: 1.9468393325805664 (1.80898360202187) | > loss_1: 40.65860366821289 (35.84436376471268) | > grad_norm_1: tensor(38036.9375, device='cuda:0') (tensor(15626.1484, device='cuda:0')) | > current_lr_0: 0.000176145336243744 | > current_lr_1: 0.000176145336243744 | > step_time: 0.6022 (0.48722658659282486) | > loader_time: 0.023 (0.02104815683866802)  --> TIME: 2023-10-20 01:02:41 -- STEP: 49/50 -- GLOBAL_STEP: 59400 | > loss_disc: 1.9388341903686523 (2.4678959968138714) | > loss_disc_real_0: 0.11871853470802307 (0.14663135929375276) | > loss_disc_real_1: 0.2368301898241043 (0.2294542473189685) | > loss_disc_real_2: 0.21803727746009827 (0.22770649985391267) | > loss_disc_real_3: 0.18435119092464447 (0.23445184148696005) | > loss_disc_real_4: 0.10853938013315201 (0.2259558497795037) | > loss_disc_real_5: 0.07670429348945618 (0.22203682235689187) | > loss_0: 1.9388341903686523 (2.4678959968138714) | > grad_norm_0: tensor(579.0570, device='cuda:0') (tensor(490.3336, device='cuda:0')) | > loss_gen: 2.8463499546051025 (2.3220773521734737) | > loss_kl: 1.1016842126846313 (1.0097968608749153) | > loss_feat: 8.485454559326172 (4.851557254487155) | > loss_mel: 28.832530975341797 (23.503688615195607) | > loss_duration: 1.8554614782333374 (1.755864800239096) | > loss_1: 43.121482849121094 (33.44298502863672) | > grad_norm_1: tensor(52939.3164, device='cuda:0') (tensor(16736.5859, device='cuda:0')) | > current_lr_0: 0.000176145336243744 | > current_lr_1: 0.000176145336243744 | > step_time: 0.3956 (0.43368604718422404) | > loader_time: 0.3664 (0.021395975229691486)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4441418647766113 (2.4441418647766113) | > loss_disc_real_0: 0.13366179168224335 (0.13366179168224335) | > loss_disc_real_1: 0.0805678516626358 (0.0805678516626358) | > loss_disc_real_2: 0.18814881145954132 (0.18814881145954132) | > loss_disc_real_3: 0.15029053390026093 (0.15029053390026093) | > loss_disc_real_4: 0.04942920058965683 (0.04942920058965683) | > loss_disc_real_5: 0.13545778393745422 (0.13545778393745422) | > loss_0: 2.4441418647766113 (2.4441418647766113) | > loss_gen: 1.6525232791900635 (1.6525232791900635) | > loss_kl: 2.187588930130005 (2.187588930130005) | > loss_feat: 8.740469932556152 (8.740469932556152) | > loss_mel: 26.09780502319336 (26.09780502319336) | > loss_duration: 2.152775287628174 (2.152775287628174) | > loss_1: 40.83116149902344 (40.83116149902344)  --> STEP: 1 | > loss_disc: 3.042665481567383 (3.042665481567383) | > loss_disc_real_0: 0.41827476024627686 (0.41827476024627686) | > loss_disc_real_1: 0.3466918468475342 (0.3466918468475342) | > loss_disc_real_2: 0.4132656157016754 (0.4132656157016754) | > loss_disc_real_3: 0.2985091209411621 (0.2985091209411621) | > loss_disc_real_4: 0.3003501892089844 (0.3003501892089844) | > loss_disc_real_5: 0.3146686851978302 (0.3146686851978302) | > loss_0: 3.042665481567383 (3.042665481567383) | > loss_gen: 2.255474090576172 (2.255474090576172) | > loss_kl: 2.5030810832977295 (2.5030810832977295) | > loss_feat: 0.315542995929718 (0.315542995929718) | > loss_mel: 14.340869903564453 (14.340869903564453) | > loss_duration: 2.334307909011841 (2.334307909011841) | > loss_1: 21.749277114868164 (21.749277114868164)  --> STEP: 2 | > loss_disc: 3.0991475582122803 (3.0709065198898315) | > loss_disc_real_0: 0.4433211088180542 (0.4307979345321655) | > loss_disc_real_1: 0.3464958071708679 (0.34659382700920105) | > loss_disc_real_2: 0.41338714957237244 (0.4133263826370239) | > loss_disc_real_3: 0.2982707917690277 (0.2983899563550949) | > loss_disc_real_4: 0.300262451171875 (0.3003063201904297) | > loss_disc_real_5: 0.3144404888153076 (0.3145545870065689) | > loss_0: 3.0991475582122803 (3.0709065198898315) | > loss_gen: 2.173129081726074 (2.214301586151123) | > loss_kl: 2.1739916801452637 (2.3385363817214966) | > loss_feat: 0.15458577871322632 (0.23506438732147217) | > loss_mel: 2.6265673637390137 (8.483718633651733) | > loss_duration: 2.36114764213562 (2.3477277755737305) | > loss_1: 9.489421844482422 (15.619349479675293)  --> STEP: 3 | > loss_disc: 3.094986915588379 (3.078933318456014) | > loss_disc_real_0: 0.17917418479919434 (0.3469233512878418) | > loss_disc_real_1: 0.32163718342781067 (0.33827494581540424) | > loss_disc_real_2: 0.4068455994129181 (0.41116612156232196) | > loss_disc_real_3: 0.280207097530365 (0.29232900341351825) | > loss_disc_real_4: 0.35998332500457764 (0.320198655128479) | > loss_disc_real_5: 0.3177889883518219 (0.3156327207883199) | > loss_0: 3.094986915588379 (3.078933318456014) | > loss_gen: 2.317455530166626 (2.2486862341562905) | > loss_kl: 1.66297447681427 (2.1133490800857544) | > loss_feat: 5.260012149810791 (1.9100469748179119) | > loss_mel: 26.38568115234375 (14.451039473215738) | > loss_duration: 2.219855308532715 (2.305103619893392) | > loss_1: 37.845977783203125 (23.028225580851238) --> EVAL PERFORMANCE | > avg_loader_time: 0.0019046465555826824 (-0.009166161219278973) | > avg_loss_disc: 3.078933318456014 (+0.7707544565200806) | > avg_loss_disc_real_0: 0.3469233512878418 (+0.2788223149254918) | > avg_loss_disc_real_1: 0.33827494581540424 (+0.03862960636615753) | > avg_loss_disc_real_2: 0.41116612156232196 (+0.08063436547915137) | > avg_loss_disc_real_3: 0.29232900341351825 (+0.051772157351175935) | > avg_loss_disc_real_4: 0.320198655128479 (+0.08076820770899454) | > avg_loss_disc_real_5: 0.3156327207883199 (+0.10531014824906984) | > avg_loss_0: 3.078933318456014 (+0.7707544565200806) | > avg_loss_gen: 2.2486862341562905 (-0.4833714167277021) | > avg_loss_kl: 2.1133490800857544 (-0.09245777130126953) | > avg_loss_feat: 1.9100469748179119 (-4.343493541081746) | > avg_loss_mel: 14.451039473215738 (-12.595160961151125) | > avg_loss_duration: 2.305103619893392 (+0.15706117947896336) | > avg_loss_1: 23.028225580851238 (-17.35742251078288)  > EPOCH: 128/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:02:52)   --> TIME: 2023-10-20 01:03:11 -- STEP: 29/50 -- GLOBAL_STEP: 59430 | > loss_disc: 2.274460792541504 (2.657107418981092) | > loss_disc_real_0: 0.3168136477470398 (0.19598260008055587) | > loss_disc_real_1: 0.3853915333747864 (0.22679679866494803) | > loss_disc_real_2: 0.2270796298980713 (0.23015212319020567) | > loss_disc_real_3: 0.25022414326667786 (0.27151267153435754) | > loss_disc_real_4: 0.19253218173980713 (0.23499455229090202) | > loss_disc_real_5: 0.21920765936374664 (0.2347645603505702) | > loss_0: 2.274460792541504 (2.657107418981092) | > grad_norm_0: tensor(636.9746, device='cuda:0') (tensor(541.4189, device='cuda:0')) | > loss_gen: 2.9948136806488037 (2.3136667835301368) | > loss_kl: 1.3717212677001953 (1.130934029303748) | > loss_feat: 4.254127502441406 (5.143945133377766) | > loss_mel: 23.99203872680664 (23.777851367818897) | > loss_duration: 1.7727307081222534 (1.773069899657677) | > loss_1: 34.385433197021484 (34.139467699774386) | > grad_norm_1: tensor(8942.2666, device='cuda:0') (tensor(15577.9092, device='cuda:0')) | > current_lr_0: 0.00017596926795182189 | > current_lr_1: 0.00017596926795182189 | > step_time: 0.3435 (0.4981881010121311) | > loader_time: 0.0021 (0.018553931137611133)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2425851821899414 (2.2425851821899414) | > loss_disc_real_0: 0.09620198607444763 (0.09620198607444763) | > loss_disc_real_1: 0.2283519059419632 (0.2283519059419632) | > loss_disc_real_2: 0.13391780853271484 (0.13391780853271484) | > loss_disc_real_3: 0.1451907604932785 (0.1451907604932785) | > loss_disc_real_4: 0.10719133168458939 (0.10719133168458939) | > loss_disc_real_5: 0.2950318455696106 (0.2950318455696106) | > loss_0: 2.2425851821899414 (2.2425851821899414) | > loss_gen: 2.230900764465332 (2.230900764465332) | > loss_kl: 2.1288294792175293 (2.1288294792175293) | > loss_feat: 7.928349018096924 (7.928349018096924) | > loss_mel: 23.90174102783203 (23.90174102783203) | > loss_duration: 2.0791940689086914 (2.0791940689086914) | > loss_1: 38.269012451171875 (38.269012451171875)  --> STEP: 1 | > loss_disc: 2.9843289852142334 (2.9843289852142334) | > loss_disc_real_0: 0.28793230652809143 (0.28793230652809143) | > loss_disc_real_1: 0.29499346017837524 (0.29499346017837524) | > loss_disc_real_2: 0.3069503903388977 (0.3069503903388977) | > loss_disc_real_3: 0.26815685629844666 (0.26815685629844666) | > loss_disc_real_4: 0.31205397844314575 (0.31205397844314575) | > loss_disc_real_5: 0.35556021332740784 (0.35556021332740784) | > loss_0: 2.9843289852142334 (2.9843289852142334) | > loss_gen: 1.946131944656372 (1.946131944656372) | > loss_kl: 2.71541428565979 (2.71541428565979) | > loss_feat: 1.1962515115737915 (1.1962515115737915) | > loss_mel: 22.497041702270508 (22.497041702270508) | > loss_duration: 2.2725002765655518 (2.2725002765655518) | > loss_1: 30.62734031677246 (30.62734031677246)  --> STEP: 2 | > loss_disc: 3.0524091720581055 (3.0183690786361694) | > loss_disc_real_0: 0.2443905770778656 (0.2661614418029785) | > loss_disc_real_1: 0.30528590083122253 (0.3001396805047989) | > loss_disc_real_2: 0.2568419277667999 (0.2818961590528488) | > loss_disc_real_3: 0.2574015259742737 (0.26277919113636017) | > loss_disc_real_4: 0.295137494802475 (0.30359573662281036) | > loss_disc_real_5: 0.3394029438495636 (0.3474815785884857) | > loss_0: 3.0524091720581055 (3.0183690786361694) | > loss_gen: 1.665764570236206 (1.805948257446289) | > loss_kl: 2.4413414001464844 (2.578377842903137) | > loss_feat: 0.07627032697200775 (0.6362609192728996) | > loss_mel: 3.6124179363250732 (13.05472981929779) | > loss_duration: 2.2446377277374268 (2.2585690021514893) | > loss_1: 10.04043197631836 (20.33388614654541)  --> STEP: 3 | > loss_disc: 2.5455713272094727 (2.860769828160604) | > loss_disc_real_0: 0.34349626302719116 (0.29193971554438275) | > loss_disc_real_1: 0.3193722367286682 (0.306550532579422) | > loss_disc_real_2: 0.3458166718482971 (0.3032029966513316) | > loss_disc_real_3: 0.15593494474887848 (0.22716444234053293) | > loss_disc_real_4: 0.2884547710418701 (0.29854874809583026) | > loss_disc_real_5: 0.3027002513408661 (0.33255446950594586) | > loss_0: 2.5455713272094727 (2.860769828160604) | > loss_gen: 2.811678886413574 (2.1411918004353843) | > loss_kl: 1.3768209218978882 (2.1778588692347207) | > loss_feat: 4.186007499694824 (1.819509779413541) | > loss_mel: 27.569581985473633 (17.89301387468974) | > loss_duration: 2.2043795585632324 (2.240505854288737) | > loss_1: 38.14847183227539 (26.27208137512207) --> EVAL PERFORMANCE | > avg_loader_time: 0.010099331537882486 (+0.008194684982299805) | > avg_loss_disc: 2.860769828160604 (-0.21816349029541016) | > avg_loss_disc_real_0: 0.29193971554438275 (-0.05498363574345905) | > avg_loss_disc_real_1: 0.306550532579422 (-0.03172441323598224) | > avg_loss_disc_real_2: 0.3032029966513316 (-0.10796312491099036) | > avg_loss_disc_real_3: 0.22716444234053293 (-0.06516456107298532) | > avg_loss_disc_real_4: 0.29854874809583026 (-0.02164990703264874) | > avg_loss_disc_real_5: 0.33255446950594586 (+0.016921748717625973) | > avg_loss_0: 2.860769828160604 (-0.21816349029541016) | > avg_loss_gen: 2.1411918004353843 (-0.10749443372090628) | > avg_loss_kl: 2.1778588692347207 (+0.06450978914896632) | > avg_loss_feat: 1.819509779413541 (-0.09053719540437077) | > avg_loss_mel: 17.89301387468974 (+3.441974401474001) | > avg_loss_duration: 2.240505854288737 (-0.06459776560465524) | > avg_loss_1: 26.27208137512207 (+3.243855794270832)  > EPOCH: 129/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:03:32)   --> TIME: 2023-10-20 01:03:40 -- STEP: 9/50 -- GLOBAL_STEP: 59460 | > loss_disc: 2.4676780700683594 (2.5104693174362183) | > loss_disc_real_0: 0.27821770310401917 (0.14865259867575434) | > loss_disc_real_1: 0.23564694821834564 (0.2410445147090488) | > loss_disc_real_2: 0.3706592619419098 (0.23476705700159073) | > loss_disc_real_3: 0.30765780806541443 (0.23035472300317553) | > loss_disc_real_4: 0.21718071401119232 (0.22832178696990013) | > loss_disc_real_5: 0.12165526300668716 (0.24391353047556347) | > loss_0: 2.4676780700683594 (2.5104693174362183) | > grad_norm_0: tensor(578.4202, device='cuda:0') (tensor(550.8258, device='cuda:0')) | > loss_gen: 2.4048593044281006 (2.3965620597203574) | > loss_kl: 1.183109164237976 (1.0517180562019348) | > loss_feat: 5.289095401763916 (5.025923205746545) | > loss_mel: 23.87982749938965 (21.281889783011543) | > loss_duration: 1.6759711503982544 (1.716768781344096) | > loss_1: 34.432861328125 (31.472861554887558) | > grad_norm_1: tensor(13103.5986, device='cuda:0') (tensor(20546.2578, device='cuda:0')) | > current_lr_0: 0.00017579337565118113 | > current_lr_1: 0.00017579337565118113 | > step_time: 0.3815 (0.4195188151465522) | > loader_time: 0.0244 (0.010723537868923612)  --> TIME: 2023-10-20 01:03:56 -- STEP: 39/50 -- GLOBAL_STEP: 59490 | > loss_disc: 3.001906394958496 (2.431904707199488) | > loss_disc_real_0: 0.13190871477127075 (0.15662098570893968) | > loss_disc_real_1: 0.2135625034570694 (0.237652469235353) | > loss_disc_real_2: 0.23661258816719055 (0.22220719491059965) | > loss_disc_real_3: 0.2138422429561615 (0.23336519109897125) | > loss_disc_real_4: 0.2040000855922699 (0.2270323271648242) | > loss_disc_real_5: 0.14386804401874542 (0.21577854850926462) | > loss_0: 3.001906394958496 (2.431904707199488) | > grad_norm_0: tensor(3153.1030, device='cuda:0') (tensor(567.1447, device='cuda:0')) | > loss_gen: 1.5114535093307495 (2.386784999798506) | > loss_kl: 1.1250278949737549 (1.0302060689681616) | > loss_feat: 1.8580716848373413 (4.8452861576508255) | > loss_mel: 13.670724868774414 (20.54968186219533) | > loss_duration: 1.7687567472457886 (1.7303253687345064) | > loss_1: 19.93403434753418 (30.542284341958855) | > grad_norm_1: tensor(11127.8613, device='cuda:0') (tensor(20599.8203, device='cuda:0')) | > current_lr_0: 0.00017579337565118113 | > current_lr_1: 0.00017579337565118113 | > step_time: 0.6378 (0.49402748621427095) | > loader_time: 0.0252 (0.013908135585295849)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.437790870666504 (2.437790870666504) | > loss_disc_real_0: 0.18313995003700256 (0.18313995003700256) | > loss_disc_real_1: 0.3720165491104126 (0.3720165491104126) | > loss_disc_real_2: 0.37020087242126465 (0.37020087242126465) | > loss_disc_real_3: 0.38622212409973145 (0.38622212409973145) | > loss_disc_real_4: 0.2522071897983551 (0.2522071897983551) | > loss_disc_real_5: 0.263885498046875 (0.263885498046875) | > loss_0: 2.437790870666504 (2.437790870666504) | > loss_gen: 3.680422067642212 (3.680422067642212) | > loss_kl: 2.3329992294311523 (2.3329992294311523) | > loss_feat: 5.9027910232543945 (5.9027910232543945) | > loss_mel: 24.60834312438965 (24.60834312438965) | > loss_duration: 2.063809633255005 (2.063809633255005) | > loss_1: 38.58836364746094 (38.58836364746094)  --> STEP: 1 | > loss_disc: 2.1576151847839355 (2.1576151847839355) | > loss_disc_real_0: 0.13883990049362183 (0.13883990049362183) | > loss_disc_real_1: 0.3825271725654602 (0.3825271725654602) | > loss_disc_real_2: 0.1845167875289917 (0.1845167875289917) | > loss_disc_real_3: 0.3993023931980133 (0.3993023931980133) | > loss_disc_real_4: 0.12641304731369019 (0.12641304731369019) | > loss_disc_real_5: 0.1685430109500885 (0.1685430109500885) | > loss_0: 2.1576151847839355 (2.1576151847839355) | > loss_gen: 2.739323854446411 (2.739323854446411) | > loss_kl: 3.050323724746704 (3.050323724746704) | > loss_feat: 6.014662742614746 (6.014662742614746) | > loss_mel: 32.07313537597656 (32.07313537597656) | > loss_duration: 2.2438251972198486 (2.2438251972198486) | > loss_1: 46.12126922607422 (46.12126922607422)  --> STEP: 2 | > loss_disc: 1.7263710498809814 (1.9419931173324585) | > loss_disc_real_0: 0.040538012981414795 (0.08968895673751831) | > loss_disc_real_1: 0.1216154620051384 (0.2520713172852993) | > loss_disc_real_2: 0.07566798478364944 (0.13009238615632057) | > loss_disc_real_3: 0.16794219613075256 (0.28362229466438293) | > loss_disc_real_4: 0.3160091042518616 (0.22121107578277588) | > loss_disc_real_5: 0.15373031795024872 (0.1611366644501686) | > loss_0: 1.7263710498809814 (1.9419931173324585) | > loss_gen: 2.929710626602173 (2.834517240524292) | > loss_kl: 2.408571243286133 (2.7294474840164185) | > loss_feat: 11.184249877929688 (8.599456310272217) | > loss_mel: 25.4226131439209 (28.74787425994873) | > loss_duration: 2.1692516803741455 (2.206538438796997) | > loss_1: 44.11439514160156 (45.11783218383789)  --> STEP: 3 | > loss_disc: 2.685516119003296 (2.1898341178894043) | > loss_disc_real_0: 0.44326770305633545 (0.20754853884379068) | > loss_disc_real_1: 0.5085194110870361 (0.3375540152192116) | > loss_disc_real_2: 0.44200050830841064 (0.23406176020701727) | > loss_disc_real_3: 0.41179388761520386 (0.32634615898132324) | > loss_disc_real_4: 0.1832718700170517 (0.20856467386086783) | > loss_disc_real_5: 0.13113294541835785 (0.15113542477289835) | > loss_0: 2.685516119003296 (2.1898341178894043) | > loss_gen: 3.4739367961883545 (3.047657092412313) | > loss_kl: 1.420241355895996 (2.293045441309611) | > loss_feat: 6.9108052253723145 (8.036572615305582) | > loss_mel: 27.14396858215332 (28.213239034016926) | > loss_duration: 2.170619487762451 (2.194565455118815) | > loss_1: 41.119571685791016 (43.78507868448893) --> EVAL PERFORMANCE | > avg_loader_time: 0.002135038375854492 (-0.007964293162027994) | > avg_loss_disc: 2.1898341178894043 (-0.6709357102711997) | > avg_loss_disc_real_0: 0.20754853884379068 (-0.08439117670059207) | > avg_loss_disc_real_1: 0.3375540152192116 (+0.03100348263978958) | > avg_loss_disc_real_2: 0.23406176020701727 (-0.06914123644431433) | > avg_loss_disc_real_3: 0.32634615898132324 (+0.09918171664079031) | > avg_loss_disc_real_4: 0.20856467386086783 (-0.08998407423496244) | > avg_loss_disc_real_5: 0.15113542477289835 (-0.1814190447330475) | > avg_loss_0: 2.1898341178894043 (-0.6709357102711997) | > avg_loss_gen: 3.047657092412313 (+0.9064652919769287) | > avg_loss_kl: 2.293045441309611 (+0.11518657207489014) | > avg_loss_feat: 8.036572615305582 (+6.217062835892041) | > avg_loss_mel: 28.213239034016926 (+10.320225159327187) | > avg_loss_duration: 2.194565455118815 (-0.045940399169921875) | > avg_loss_1: 43.78507868448893 (+17.51299730936686)  > EPOCH: 130/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:04:10)   --> TIME: 2023-10-20 01:04:24 -- STEP: 19/50 -- GLOBAL_STEP: 59520 | > loss_disc: 3.3972690105438232 (2.6618344470074304) | > loss_disc_real_0: 0.06984800845384598 (0.14542651372520546) | > loss_disc_real_1: 0.13800212740898132 (0.248258485997978) | > loss_disc_real_2: 0.2826201915740967 (0.25532101584892525) | > loss_disc_real_3: 0.3056768476963043 (0.2645552130906205) | > loss_disc_real_4: 0.39267903566360474 (0.27231779331831557) | > loss_disc_real_5: 0.3107384443283081 (0.30456626415252686) | > loss_0: 3.3972690105438232 (2.6618344470074304) | > grad_norm_0: tensor(530.3188, device='cuda:0') (tensor(481.0735, device='cuda:0')) | > loss_gen: 1.5679380893707275 (2.490323963918184) | > loss_kl: 1.1640586853027344 (1.0828288197517395) | > loss_feat: 4.390873908996582 (4.722485224079144) | > loss_mel: 25.874679565429688 (23.018012360522622) | > loss_duration: 1.8735581636428833 (1.7991509249335842) | > loss_1: 34.87110900878906 (33.11280120046515) | > grad_norm_1: tensor(11133.3564, device='cuda:0') (tensor(22853.5605, device='cuda:0')) | > current_lr_0: 0.00017561765916590733 | > current_lr_1: 0.00017561765916590733 | > step_time: 0.5493 (0.5154272757078472) | > loader_time: 0.0245 (0.0194312522285863)  --> TIME: 2023-10-20 01:04:37 -- STEP: 49/50 -- GLOBAL_STEP: 59550 | > loss_disc: 2.651578903198242 (2.553892770592048) | > loss_disc_real_0: 0.36700841784477234 (0.1761896926909685) | > loss_disc_real_1: 0.23310701549053192 (0.2390718041177915) | > loss_disc_real_2: 0.29874134063720703 (0.22852347791194913) | > loss_disc_real_3: 0.255291223526001 (0.24794366950055166) | > loss_disc_real_4: 0.16116170585155487 (0.22085035269205666) | > loss_disc_real_5: 0.2878129482269287 (0.25144232448418524) | > loss_0: 2.651578903198242 (2.553892770592048) | > grad_norm_0: tensor(654.3763, device='cuda:0') (tensor(480.7741, device='cuda:0')) | > loss_gen: 2.222526788711548 (2.354852622869063) | > loss_kl: 0.7595633864402771 (1.0119392160250218) | > loss_feat: 3.6901986598968506 (4.882512199863488) | > loss_mel: 31.13440704345703 (23.64143474247991) | > loss_duration: 1.8331187963485718 (1.7469740692450075) | > loss_1: 39.63981246948242 (33.63771289708663) | > grad_norm_1: tensor(6837.2368, device='cuda:0') (tensor(16692.7363, device='cuda:0')) | > current_lr_0: 0.00017561765916590733 | > current_lr_1: 0.00017561765916590733 | > step_time: 0.6816 (0.45223170883801517) | > loader_time: 0.385 (0.02033851098041145)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.951974868774414 (2.951974868774414) | > loss_disc_real_0: 0.15500226616859436 (0.15500226616859436) | > loss_disc_real_1: 0.32321107387542725 (0.32321107387542725) | > loss_disc_real_2: 0.2459959238767624 (0.2459959238767624) | > loss_disc_real_3: 0.30634671449661255 (0.30634671449661255) | > loss_disc_real_4: 0.2976820170879364 (0.2976820170879364) | > loss_disc_real_5: 0.2978306710720062 (0.2978306710720062) | > loss_0: 2.951974868774414 (2.951974868774414) | > loss_gen: 1.717085838317871 (1.717085838317871) | > loss_kl: 2.0085244178771973 (2.0085244178771973) | > loss_feat: 0.2400262951850891 (0.2400262951850891) | > loss_mel: 2.9348056316375732 (2.9348056316375732) | > loss_duration: 2.165585517883301 (2.165585517883301) | > loss_1: 9.066027641296387 (9.066027641296387)  --> STEP: 1 | > loss_disc: 2.0058720111846924 (2.0058720111846924) | > loss_disc_real_0: 0.06185546889901161 (0.06185546889901161) | > loss_disc_real_1: 0.11417221277952194 (0.11417221277952194) | > loss_disc_real_2: 0.09183437377214432 (0.09183437377214432) | > loss_disc_real_3: 0.18058805167675018 (0.18058805167675018) | > loss_disc_real_4: 0.0888998731970787 (0.0888998731970787) | > loss_disc_real_5: 0.1606515645980835 (0.1606515645980835) | > loss_0: 2.0058720111846924 (2.0058720111846924) | > loss_gen: 2.0062036514282227 (2.0062036514282227) | > loss_kl: 2.834622621536255 (2.834622621536255) | > loss_feat: 5.971285820007324 (5.971285820007324) | > loss_mel: 24.600831985473633 (24.600831985473633) | > loss_duration: 2.294806480407715 (2.294806480407715) | > loss_1: 37.70774841308594 (37.70774841308594)  --> STEP: 2 | > loss_disc: 2.928679943084717 (2.4672759771347046) | > loss_disc_real_0: 0.20774666965007782 (0.13480106927454472) | > loss_disc_real_1: 0.3844563364982605 (0.24931427463889122) | > loss_disc_real_2: 0.47969433665275574 (0.28576435521245) | > loss_disc_real_3: 0.3444504141807556 (0.2625192329287529) | > loss_disc_real_4: 0.32716497778892517 (0.20803242549300194) | > loss_disc_real_5: 0.32417941093444824 (0.24241548776626587) | > loss_0: 2.928679943084717 (2.4672759771347046) | > loss_gen: 2.447540044784546 (2.2268718481063843) | > loss_kl: 2.553363561630249 (2.693993091583252) | > loss_feat: 1.5222395658493042 (3.746762692928314) | > loss_mel: 22.45226287841797 (23.5265474319458) | > loss_duration: 2.263728618621826 (2.2792675495147705) | > loss_1: 31.2391357421875 (34.47344207763672)  --> STEP: 3 | > loss_disc: 2.7030837535858154 (2.5458785692850747) | > loss_disc_real_0: 0.3148077726364136 (0.194803303728501) | > loss_disc_real_1: 0.4096001088619232 (0.30274288604656857) | > loss_disc_real_2: 0.3019704222679138 (0.2911663775642713) | > loss_disc_real_3: 0.29593023657798767 (0.2736562341451645) | > loss_disc_real_4: 0.31633132696151733 (0.2441320593158404) | > loss_disc_real_5: 0.3483751118183136 (0.2777353624502818) | > loss_0: 2.7030837535858154 (2.5458785692850747) | > loss_gen: 2.8080224990844727 (2.420588731765747) | > loss_kl: 0.8960988521575928 (2.0946950117746987) | > loss_feat: 2.8524863719940186 (3.448670585950216) | > loss_mel: 25.877344131469727 (24.31014633178711) | > loss_duration: 2.207284450531006 (2.255273183186849) | > loss_1: 34.6412353515625 (34.52937316894531) --> EVAL PERFORMANCE | > avg_loader_time: 0.005024433135986328 (+0.002889394760131836) | > avg_loss_disc: 2.5458785692850747 (+0.3560444513956704) | > avg_loss_disc_real_0: 0.194803303728501 (-0.012745235115289688) | > avg_loss_disc_real_1: 0.30274288604656857 (-0.03481112917264301) | > avg_loss_disc_real_2: 0.2911663775642713 (+0.057104617357254) | > avg_loss_disc_real_3: 0.2736562341451645 (-0.05268992483615875) | > avg_loss_disc_real_4: 0.2441320593158404 (+0.03556738545497257) | > avg_loss_disc_real_5: 0.2777353624502818 (+0.12659993767738345) | > avg_loss_0: 2.5458785692850747 (+0.3560444513956704) | > avg_loss_gen: 2.420588731765747 (-0.6270683606465659) | > avg_loss_kl: 2.0946950117746987 (-0.1983504295349121) | > avg_loss_feat: 3.448670585950216 (-4.587902029355366) | > avg_loss_mel: 24.31014633178711 (-3.9030927022298165) | > avg_loss_duration: 2.255273183186849 (+0.06070772806803415) | > avg_loss_1: 34.52937316894531 (-9.255705515543617)  > EPOCH: 131/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:04:49)   --> TIME: 2023-10-20 01:05:07 -- STEP: 29/50 -- GLOBAL_STEP: 59580 | > loss_disc: 1.6066936254501343 (2.3174977384764572) | > loss_disc_real_0: 0.08157631754875183 (0.14856067209922033) | > loss_disc_real_1: 0.2958373725414276 (0.20716211225452094) | > loss_disc_real_2: 0.09837967902421951 (0.21519467722753) | > loss_disc_real_3: 0.08223462849855423 (0.22530132429353122) | > loss_disc_real_4: 0.1398627758026123 (0.2472808027061923) | > loss_disc_real_5: 0.07636389136314392 (0.23433539836571135) | > loss_0: 1.6066936254501343 (2.3174977384764572) | > grad_norm_0: tensor(407.5943, device='cuda:0') (tensor(511.8957, device='cuda:0')) | > loss_gen: 3.00620174407959 (2.688100580511422) | > loss_kl: 0.7222930192947388 (1.0847267837359988) | > loss_feat: 7.386723041534424 (7.083556951119982) | > loss_mel: 24.406234741210938 (25.627711674262738) | > loss_duration: 1.7547234296798706 (1.7513654601985011) | > loss_1: 37.27617645263672 (38.23546162967025) | > grad_norm_1: tensor(15059.4609, device='cuda:0') (tensor(22065.7832, device='cuda:0')) | > current_lr_0: 0.00017544211832026208 | > current_lr_1: 0.00017544211832026208 | > step_time: 0.6894 (0.49387240409851074) | > loader_time: 0.0245 (0.02000211847239527)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3344459533691406 (2.3344459533691406) | > loss_disc_real_0: 0.17709940671920776 (0.17709940671920776) | > loss_disc_real_1: 0.3148045837879181 (0.3148045837879181) | > loss_disc_real_2: 0.2623010575771332 (0.2623010575771332) | > loss_disc_real_3: 0.3878463804721832 (0.3878463804721832) | > loss_disc_real_4: 0.2469412088394165 (0.2469412088394165) | > loss_disc_real_5: 0.29956164956092834 (0.29956164956092834) | > loss_0: 2.3344459533691406 (2.3344459533691406) | > loss_gen: 3.240199565887451 (3.240199565887451) | > loss_kl: 2.0510690212249756 (2.0510690212249756) | > loss_feat: 4.7930073738098145 (4.7930073738098145) | > loss_mel: 23.602481842041016 (23.602481842041016) | > loss_duration: 2.043170928955078 (2.043170928955078) | > loss_1: 35.72992706298828 (35.72992706298828)  --> STEP: 1 | > loss_disc: 1.9034383296966553 (1.9034383296966553) | > loss_disc_real_0: 0.11357598006725311 (0.11357598006725311) | > loss_disc_real_1: 0.23087258636951447 (0.23087258636951447) | > loss_disc_real_2: 0.1809842735528946 (0.1809842735528946) | > loss_disc_real_3: 0.1724582314491272 (0.1724582314491272) | > loss_disc_real_4: 0.08811262249946594 (0.08811262249946594) | > loss_disc_real_5: 0.10579788684844971 (0.10579788684844971) | > loss_0: 1.9034383296966553 (1.9034383296966553) | > loss_gen: 2.5739996433258057 (2.5739996433258057) | > loss_kl: 2.675431251525879 (2.675431251525879) | > loss_feat: 8.392154693603516 (8.392154693603516) | > loss_mel: 25.50490379333496 (25.50490379333496) | > loss_duration: 2.201472520828247 (2.201472520828247) | > loss_1: 41.347965240478516 (41.347965240478516)  --> STEP: 2 | > loss_disc: 3.057584524154663 (2.480511426925659) | > loss_disc_real_0: 0.23027703166007996 (0.17192650586366653) | > loss_disc_real_1: 0.31623995304107666 (0.27355626970529556) | > loss_disc_real_2: 0.29957544803619385 (0.24027986079454422) | > loss_disc_real_3: 0.35194212198257446 (0.26220017671585083) | > loss_disc_real_4: 0.29623761773109436 (0.19217512011528015) | > loss_disc_real_5: 0.2680432200431824 (0.18692055344581604) | > loss_0: 3.057584524154663 (2.480511426925659) | > loss_gen: 1.7440496683120728 (2.159024655818939) | > loss_kl: 2.969669818878174 (2.8225505352020264) | > loss_feat: 0.4776831269264221 (4.434918910264969) | > loss_mel: 13.078553199768066 (19.291728496551514) | > loss_duration: 2.1508290767669678 (2.1761507987976074) | > loss_1: 20.42078399658203 (30.884374618530273)  --> STEP: 3 | > loss_disc: 3.001542568206787 (2.6541884740193686) | > loss_disc_real_0: 0.2092350274324417 (0.18436267971992493) | > loss_disc_real_1: 0.3240635097026825 (0.2903920163710912) | > loss_disc_real_2: 0.2783167064189911 (0.2529588093360265) | > loss_disc_real_3: 0.3455260694026947 (0.28997547427813214) | > loss_disc_real_4: 0.29133424162864685 (0.22522816061973572) | > loss_disc_real_5: 0.26393938064575195 (0.21259349584579468) | > loss_0: 3.001542568206787 (2.6541884740193686) | > loss_gen: 1.743606448173523 (2.020551919937134) | > loss_kl: 1.450713872909546 (2.3652716477711997) | > loss_feat: 0.1182841882109642 (2.996040669580301) | > loss_mel: 3.8740949630737305 (14.152517318725586) | > loss_duration: 2.164846420288086 (2.172382672627767) | > loss_1: 9.351546287536621 (23.706765174865723) --> EVAL PERFORMANCE | > avg_loader_time: 0.006175120671590169 (+0.0011506875356038409) | > avg_loss_disc: 2.6541884740193686 (+0.10830990473429392) | > avg_loss_disc_real_0: 0.18436267971992493 (-0.010440624008576066) | > avg_loss_disc_real_1: 0.2903920163710912 (-0.012350869675477383) | > avg_loss_disc_real_2: 0.2529588093360265 (-0.03820756822824478) | > avg_loss_disc_real_3: 0.28997547427813214 (+0.01631924013296765) | > avg_loss_disc_real_4: 0.22522816061973572 (-0.018903898696104676) | > avg_loss_disc_real_5: 0.21259349584579468 (-0.06514186660448712) | > avg_loss_0: 2.6541884740193686 (+0.10830990473429392) | > avg_loss_gen: 2.020551919937134 (-0.4000368118286133) | > avg_loss_kl: 2.3652716477711997 (+0.27057663599650095) | > avg_loss_feat: 2.996040669580301 (-0.452629916369915) | > avg_loss_mel: 14.152517318725586 (-10.157629013061523) | > avg_loss_duration: 2.172382672627767 (-0.08289051055908203) | > avg_loss_1: 23.706765174865723 (-10.82260799407959)  > EPOCH: 132/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:05:29)   --> TIME: 2023-10-20 01:05:37 -- STEP: 9/50 -- GLOBAL_STEP: 59610 | > loss_disc: 2.5550074577331543 (2.1358063750796847) | > loss_disc_real_0: 0.10936585068702698 (0.13777285565932593) | > loss_disc_real_1: 0.2783806622028351 (0.2288965822921859) | > loss_disc_real_2: 0.2842525541782379 (0.22992619540956286) | > loss_disc_real_3: 0.2831273078918457 (0.2699635359976027) | > loss_disc_real_4: 0.24751245975494385 (0.18915854518612227) | > loss_disc_real_5: 0.22239385545253754 (0.17974758396546045) | > loss_0: 2.5550074577331543 (2.1358063750796847) | > grad_norm_0: tensor(307.7004, device='cuda:0') (tensor(393.8553, device='cuda:0')) | > loss_gen: 2.0840296745300293 (2.7523017989264593) | > loss_kl: 1.3189201354980469 (1.1673277152909174) | > loss_feat: 2.9510364532470703 (5.767050372229682) | > loss_mel: 23.91674041748047 (23.72987323337131) | > loss_duration: 1.6966687440872192 (1.7458436489105225) | > loss_1: 31.967395782470703 (35.162397384643555) | > grad_norm_1: tensor(5509.5601, device='cuda:0') (tensor(15855.6250, device='cuda:0')) | > current_lr_0: 0.00017526675293868255 | > current_lr_1: 0.00017526675293868255 | > step_time: 0.6761 (0.4054233233133952) | > loader_time: 0.022 (0.007623354593912761)  --> TIME: 2023-10-20 01:05:52 -- STEP: 39/50 -- GLOBAL_STEP: 59640 | > loss_disc: 2.8248679637908936 (2.537978468797146) | > loss_disc_real_0: 0.3618023991584778 (0.1648236202219358) | > loss_disc_real_1: 0.24547089636325836 (0.26172108948230743) | > loss_disc_real_2: 0.2338019609451294 (0.24924686111700842) | > loss_disc_real_3: 0.22020362317562103 (0.25554409088232577) | > loss_disc_real_4: 0.2598239481449127 (0.2425445512128182) | > loss_disc_real_5: 0.28471142053604126 (0.24281340455397582) | > loss_0: 2.8248679637908936 (2.537978468797146) | > grad_norm_0: tensor(2723.2854, device='cuda:0') (tensor(695.3801, device='cuda:0')) | > loss_gen: 1.747157096862793 (2.462108621230492) | > loss_kl: 0.6384586095809937 (1.0891537857361329) | > loss_feat: 1.0074156522750854 (4.795793926295563) | > loss_mel: 18.142169952392578 (22.077741754360687) | > loss_duration: 1.7961499691009521 (1.7430054988616552) | > loss_1: 23.33135223388672 (32.1678036787571) | > grad_norm_1: tensor(11758.7344, device='cuda:0') (tensor(19260.7422, device='cuda:0')) | > current_lr_0: 0.00017526675293868255 | > current_lr_1: 0.00017526675293868255 | > step_time: 0.6947 (0.48130106925964355) | > loader_time: 0.0204 (0.012247403462727865)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.013262987136841 (3.013262987136841) | > loss_disc_real_0: 0.15482094883918762 (0.15482094883918762) | > loss_disc_real_1: 0.32959839701652527 (0.32959839701652527) | > loss_disc_real_2: 0.2854664921760559 (0.2854664921760559) | > loss_disc_real_3: 0.3148442804813385 (0.3148442804813385) | > loss_disc_real_4: 0.1774744987487793 (0.1774744987487793) | > loss_disc_real_5: 0.27059346437454224 (0.27059346437454224) | > loss_0: 3.013262987136841 (3.013262987136841) | > loss_gen: 1.570482850074768 (1.570482850074768) | > loss_kl: 3.11344838142395 (3.11344838142395) | > loss_feat: 0.09461791068315506 (0.09461791068315506) | > loss_mel: 12.244383811950684 (12.244383811950684) | > loss_duration: 2.138225793838501 (2.138225793838501) | > loss_1: 19.161157608032227 (19.161157608032227)  --> STEP: 1 | > loss_disc: 1.5689325332641602 (1.5689325332641602) | > loss_disc_real_0: 0.0983261987566948 (0.0983261987566948) | > loss_disc_real_1: 0.2187875509262085 (0.2187875509262085) | > loss_disc_real_2: 0.12039018422365189 (0.12039018422365189) | > loss_disc_real_3: 0.26500269770622253 (0.26500269770622253) | > loss_disc_real_4: 0.0821555107831955 (0.0821555107831955) | > loss_disc_real_5: 0.1897881031036377 (0.1897881031036377) | > loss_0: 1.5689325332641602 (1.5689325332641602) | > loss_gen: 3.109044075012207 (3.109044075012207) | > loss_kl: 2.574582099914551 (2.574582099914551) | > loss_feat: 6.436273574829102 (6.436273574829102) | > loss_mel: 26.45465660095215 (26.45465660095215) | > loss_duration: 2.267704486846924 (2.267704486846924) | > loss_1: 40.84225845336914 (40.84225845336914)  --> STEP: 2 | > loss_disc: 2.3132715225219727 (1.9411020278930664) | > loss_disc_real_0: 0.3230416774749756 (0.2106839381158352) | > loss_disc_real_1: 0.297819584608078 (0.25830356776714325) | > loss_disc_real_2: 0.11779274791479111 (0.1190914660692215) | > loss_disc_real_3: 0.1922188252210617 (0.22861076146364212) | > loss_disc_real_4: 0.22387227416038513 (0.1530138924717903) | > loss_disc_real_5: 0.44487810134887695 (0.3173331022262573) | > loss_0: 2.3132715225219727 (1.9411020278930664) | > loss_gen: 3.0429189205169678 (3.0759814977645874) | > loss_kl: 2.5957791805267334 (2.585180640220642) | > loss_feat: 7.7749552726745605 (7.105614423751831) | > loss_mel: 26.075679779052734 (26.26516819000244) | > loss_duration: 2.2034404277801514 (2.2355724573135376) | > loss_1: 41.69277572631836 (41.26751708984375)  --> STEP: 3 | > loss_disc: 3.040520191192627 (2.30757474899292) | > loss_disc_real_0: 0.1579160988330841 (0.19309465835491815) | > loss_disc_real_1: 0.32961198687553406 (0.2820730408032735) | > loss_disc_real_2: 0.2853773534297943 (0.17452009518941244) | > loss_disc_real_3: 0.31483325362205505 (0.2573515921831131) | > loss_disc_real_4: 0.17744949460029602 (0.1611590931812922) | > loss_disc_real_5: 0.2705318331718445 (0.3017326792081197) | > loss_0: 3.040520191192627 (2.30757474899292) | > loss_gen: 1.5515022277832031 (2.567821741104126) | > loss_kl: 1.2880054712295532 (2.1527889172236123) | > loss_feat: 0.040737248957157135 (4.7506553654869395) | > loss_mel: 2.7408220767974854 (18.423719485600788) | > loss_duration: 2.1894752979278564 (2.2202067375183105) | > loss_1: 7.810542106628418 (30.11519209543864) --> EVAL PERFORMANCE | > avg_loader_time: 0.008312384287516275 (+0.0021372636159261065) | > avg_loss_disc: 2.30757474899292 (-0.3466137250264487) | > avg_loss_disc_real_0: 0.19309465835491815 (+0.008731978634993226) | > avg_loss_disc_real_1: 0.2820730408032735 (-0.008318975567817688) | > avg_loss_disc_real_2: 0.17452009518941244 (-0.07843871414661405) | > avg_loss_disc_real_3: 0.2573515921831131 (-0.03262388209501904) | > avg_loss_disc_real_4: 0.1611590931812922 (-0.06406906743844351) | > avg_loss_disc_real_5: 0.3017326792081197 (+0.08913918336232501) | > avg_loss_0: 2.30757474899292 (-0.3466137250264487) | > avg_loss_gen: 2.567821741104126 (+0.5472698211669922) | > avg_loss_kl: 2.1527889172236123 (-0.21248273054758737) | > avg_loss_feat: 4.7506553654869395 (+1.7546146959066387) | > avg_loss_mel: 18.423719485600788 (+4.271202166875202) | > avg_loss_duration: 2.2202067375183105 (+0.04782406489054347) | > avg_loss_1: 30.11519209543864 (+6.408426920572918)  > EPOCH: 133/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:06:06)   --> TIME: 2023-10-20 01:06:19 -- STEP: 19/50 -- GLOBAL_STEP: 59670 | > loss_disc: 2.3593039512634277 (2.4621456610529044) | > loss_disc_real_0: 0.14103105664253235 (0.1620860571335805) | > loss_disc_real_1: 0.25946205854415894 (0.22288838028907776) | > loss_disc_real_2: 0.2000589668750763 (0.2119157214305903) | > loss_disc_real_3: 0.23616787791252136 (0.2455524720839764) | > loss_disc_real_4: 0.16923581063747406 (0.22600124756756582) | > loss_disc_real_5: 0.1585090309381485 (0.23827185815102175) | > loss_0: 2.3593039512634277 (2.4621456610529044) | > grad_norm_0: tensor(395.8532, device='cuda:0') (tensor(773.4136, device='cuda:0')) | > loss_gen: 2.1729896068573 (2.277949759834691) | > loss_kl: 1.4940708875656128 (1.0510749503185874) | > loss_feat: 3.802302122116089 (4.652810237321415) | > loss_mel: 15.812567710876465 (22.584979107505397) | > loss_duration: 1.873025894165039 (1.8043271616885537) | > loss_1: 25.15495491027832 (32.37114053023489) | > grad_norm_1: tensor(17695.8711, device='cuda:0') (tensor(25309.2500, device='cuda:0')) | > current_lr_0: 0.0001750915628457814 | > current_lr_1: 0.0001750915628457814 | > step_time: 0.3047 (0.4882893311349969) | > loader_time: 0.0252 (0.019989967346191406)  --> TIME: 2023-10-20 01:06:32 -- STEP: 49/50 -- GLOBAL_STEP: 59700 | > loss_disc: 2.3806240558624268 (2.492354463557808) | > loss_disc_real_0: 0.06048781797289848 (0.1645695155258385) | > loss_disc_real_1: 0.22565320134162903 (0.22611652246239233) | > loss_disc_real_2: 0.2562137544155121 (0.22565696263039597) | > loss_disc_real_3: 0.17367517948150635 (0.24327352388324786) | > loss_disc_real_4: 0.2510124742984772 (0.235366528720728) | > loss_disc_real_5: 0.2750776708126068 (0.22356949035762524) | > loss_0: 2.3806240558624268 (2.492354463557808) | > grad_norm_0: tensor(314.8369, device='cuda:0') (tensor(841.5151, device='cuda:0')) | > loss_gen: 2.211663007736206 (2.4156138702314727) | > loss_kl: 0.7178531289100647 (1.036935081287306) | > loss_feat: 3.944784641265869 (5.17491240137998) | > loss_mel: 26.873422622680664 (23.745504632288096) | > loss_duration: 1.7778842449188232 (1.7395665499628807) | > loss_1: 35.52560806274414 (34.11253244049695) | > grad_norm_1: tensor(5411.0752, device='cuda:0') (tensor(23563.7695, device='cuda:0')) | > current_lr_0: 0.0001750915628457814 | > current_lr_1: 0.0001750915628457814 | > step_time: 0.783 (0.424072620820026) | > loader_time: 0.3537 (0.01931347165788923)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0837764739990234 (2.0837764739990234) | > loss_disc_real_0: 0.15365172922611237 (0.15365172922611237) | > loss_disc_real_1: 0.27502259612083435 (0.27502259612083435) | > loss_disc_real_2: 0.23522734642028809 (0.23522734642028809) | > loss_disc_real_3: 0.23099693655967712 (0.23099693655967712) | > loss_disc_real_4: 0.06751181185245514 (0.06751181185245514) | > loss_disc_real_5: 0.15975132584571838 (0.15975132584571838) | > loss_0: 2.0837764739990234 (2.0837764739990234) | > loss_gen: 2.6743416786193848 (2.6743416786193848) | > loss_kl: 2.205150842666626 (2.205150842666626) | > loss_feat: 5.295270919799805 (5.295270919799805) | > loss_mel: 23.020174026489258 (23.020174026489258) | > loss_duration: 2.1563150882720947 (2.1563150882720947) | > loss_1: 35.351253509521484 (35.351253509521484)  --> STEP: 1 | > loss_disc: 1.8674447536468506 (1.8674447536468506) | > loss_disc_real_0: 0.05695574730634689 (0.05695574730634689) | > loss_disc_real_1: 0.4366985559463501 (0.4366985559463501) | > loss_disc_real_2: 0.2601071000099182 (0.2601071000099182) | > loss_disc_real_3: 0.2784946858882904 (0.2784946858882904) | > loss_disc_real_4: 0.09507248550653458 (0.09507248550653458) | > loss_disc_real_5: 0.13306890428066254 (0.13306890428066254) | > loss_0: 1.8674447536468506 (1.8674447536468506) | > loss_gen: 3.547189474105835 (3.547189474105835) | > loss_kl: 2.7292892932891846 (2.7292892932891846) | > loss_feat: 7.822836399078369 (7.822836399078369) | > loss_mel: 26.581777572631836 (26.581777572631836) | > loss_duration: 2.3169472217559814 (2.3169472217559814) | > loss_1: 42.99803924560547 (42.99803924560547)  --> STEP: 2 | > loss_disc: 3.015160083770752 (2.4413024187088013) | > loss_disc_real_0: 0.2939240038394928 (0.17543987557291985) | > loss_disc_real_1: 0.29395803809165955 (0.3653282970190048) | > loss_disc_real_2: 0.3322833776473999 (0.29619523882865906) | > loss_disc_real_3: 0.2685841917991638 (0.2735394388437271) | > loss_disc_real_4: 0.31662517786026 (0.2058488316833973) | > loss_disc_real_5: 0.3214438259601593 (0.22725636512041092) | > loss_0: 3.015160083770752 (2.4413024187088013) | > loss_gen: 1.855701208114624 (2.7014453411102295) | > loss_kl: 2.3935930728912354 (2.56144118309021) | > loss_feat: 0.06436606496572495 (3.943601232022047) | > loss_mel: 7.695318698883057 (17.138548135757446) | > loss_duration: 2.1957650184631348 (2.256356120109558) | > loss_1: 14.204744338989258 (28.601391792297363)  --> STEP: 3 | > loss_disc: 2.9348158836364746 (2.605806907018026) | > loss_disc_real_0: 0.2458508461713791 (0.1989101991057396) | > loss_disc_real_1: 0.2983679473400116 (0.3430081804593404) | > loss_disc_real_2: 0.33605650067329407 (0.30948232611020404) | > loss_disc_real_3: 0.2697923183441162 (0.2722903986771901) | > loss_disc_real_4: 0.3322044014930725 (0.24796735495328903) | > loss_disc_real_5: 0.32441627979278564 (0.2596430033445358) | > loss_0: 2.9348158836364746 (2.605806907018026) | > loss_gen: 1.9380531311035156 (2.4469812711079917) | > loss_kl: 1.5865058898925781 (2.2364627520243325) | > loss_feat: 0.3835013210773468 (2.756901261707147) | > loss_mel: 17.637372970581055 (17.30482308069865) | > loss_duration: 2.2178187370300293 (2.2435103257497153) | > loss_1: 23.76325225830078 (26.988678614298504) --> EVAL PERFORMANCE | > avg_loader_time: 0.013784249623616537 (+0.005471865336100262) | > avg_loss_disc: 2.605806907018026 (+0.29823215802510594) | > avg_loss_disc_real_0: 0.1989101991057396 (+0.005815540750821441) | > avg_loss_disc_real_1: 0.3430081804593404 (+0.060935139656066895) | > avg_loss_disc_real_2: 0.30948232611020404 (+0.1349622309207916) | > avg_loss_disc_real_3: 0.2722903986771901 (+0.014938806494077028) | > avg_loss_disc_real_4: 0.24796735495328903 (+0.08680826177199683) | > avg_loss_disc_real_5: 0.2596430033445358 (-0.042089675863583864) | > avg_loss_0: 2.605806907018026 (+0.29823215802510594) | > avg_loss_gen: 2.4469812711079917 (-0.12084046999613429) | > avg_loss_kl: 2.2364627520243325 (+0.08367383480072021) | > avg_loss_feat: 2.756901261707147 (-1.9937541037797923) | > avg_loss_mel: 17.30482308069865 (-1.118896404902138) | > avg_loss_duration: 2.2435103257497153 (+0.02330358823140477) | > avg_loss_1: 26.988678614298504 (-3.1265134811401367)  > EPOCH: 134/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:06:45)   --> TIME: 2023-10-20 01:07:04 -- STEP: 29/50 -- GLOBAL_STEP: 59730 | > loss_disc: 2.989556074142456 (2.389037711866971) | > loss_disc_real_0: 0.24083071947097778 (0.1590615113362156) | > loss_disc_real_1: 0.25874242186546326 (0.2215626521100258) | > loss_disc_real_2: 0.2320389747619629 (0.21313210730922633) | > loss_disc_real_3: 0.2989708185195923 (0.22991592693945456) | > loss_disc_real_4: 0.26947784423828125 (0.2092275591246013) | > loss_disc_real_5: 0.35496437549591064 (0.2149064616653426) | > loss_0: 2.989556074142456 (2.389037711866971) | > grad_norm_0: tensor(686.5812, device='cuda:0') (tensor(792.4663, device='cuda:0')) | > loss_gen: 1.6682015657424927 (2.4134631896841117) | > loss_kl: 0.9312927722930908 (1.103868309793801) | > loss_feat: 0.14039921760559082 (5.352654210452376) | > loss_mel: 13.880291938781738 (22.387368580390667) | > loss_duration: 1.7476537227630615 (1.7433435588047421) | > loss_1: 18.367839813232422 (33.00069741545053) | > grad_norm_1: tensor(33597.8242, device='cuda:0') (tensor(38818.5430, device='cuda:0')) | > current_lr_0: 0.00017491654786634667 | > current_lr_1: 0.00017491654786634667 | > step_time: 0.6154 (0.4899915251238593) | > loader_time: 0.004 (0.01816657493854391)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.206666946411133 (2.206666946411133) | > loss_disc_real_0: 0.12084081023931503 (0.12084081023931503) | > loss_disc_real_1: 0.22403602302074432 (0.22403602302074432) | > loss_disc_real_2: 0.19329120218753815 (0.19329120218753815) | > loss_disc_real_3: 0.31708216667175293 (0.31708216667175293) | > loss_disc_real_4: 0.13268226385116577 (0.13268226385116577) | > loss_disc_real_5: 0.14163893461227417 (0.14163893461227417) | > loss_0: 2.206666946411133 (2.206666946411133) | > loss_gen: 2.6993491649627686 (2.6993491649627686) | > loss_kl: 2.1689555644989014 (2.1689555644989014) | > loss_feat: 6.07494592666626 (6.07494592666626) | > loss_mel: 25.68387794494629 (25.68387794494629) | > loss_duration: 2.136502265930176 (2.136502265930176) | > loss_1: 38.76362991333008 (38.76362991333008)  --> STEP: 1 | > loss_disc: 3.2347426414489746 (3.2347426414489746) | > loss_disc_real_0: 0.5295842885971069 (0.5295842885971069) | > loss_disc_real_1: 0.3345528841018677 (0.3345528841018677) | > loss_disc_real_2: 0.2781289517879486 (0.2781289517879486) | > loss_disc_real_3: 0.30769824981689453 (0.30769824981689453) | > loss_disc_real_4: 0.29242628812789917 (0.29242628812789917) | > loss_disc_real_5: 0.4492414891719818 (0.4492414891719818) | > loss_0: 3.2347426414489746 (3.2347426414489746) | > loss_gen: 2.1135385036468506 (2.1135385036468506) | > loss_kl: 2.783127546310425 (2.783127546310425) | > loss_feat: 0.20138569176197052 (0.20138569176197052) | > loss_mel: 17.385387420654297 (17.385387420654297) | > loss_duration: 2.238917350769043 (2.238917350769043) | > loss_1: 24.722354888916016 (24.722354888916016)  --> STEP: 2 | > loss_disc: 1.3483130931854248 (2.2915278673171997) | > loss_disc_real_0: 0.059820178896188736 (0.29470223374664783) | > loss_disc_real_1: 0.04473892226815224 (0.18964590318500996) | > loss_disc_real_2: 0.05003400892019272 (0.16408148035407066) | > loss_disc_real_3: 0.035589270293712616 (0.17164376005530357) | > loss_disc_real_4: 0.041728660464286804 (0.167077474296093) | > loss_disc_real_5: 0.05285352095961571 (0.25104750506579876) | > loss_0: 1.3483130931854248 (2.2915278673171997) | > loss_gen: 2.325505256652832 (2.2195218801498413) | > loss_kl: 2.7689528465270996 (2.776040196418762) | > loss_feat: 15.063007354736328 (7.632196523249149) | > loss_mel: 29.03279685974121 (23.209092140197754) | > loss_duration: 2.1859731674194336 (2.2124452590942383) | > loss_1: 51.37623596191406 (38.04929542541504)  --> STEP: 3 | > loss_disc: 3.2880327701568604 (2.6236961682637534) | > loss_disc_real_0: 0.5456197261810303 (0.378341397891442) | > loss_disc_real_1: 0.33449891209602356 (0.23793023948868117) | > loss_disc_real_2: 0.2780037522315979 (0.20205557097991309) | > loss_disc_real_3: 0.3075004816055298 (0.21692933390537897) | > loss_disc_real_4: 0.2922867238521576 (0.2088138908147812) | > loss_disc_real_5: 0.4493933916091919 (0.31716280058026314) | > loss_0: 3.2880327701568604 (2.6236961682637534) | > loss_gen: 2.0301766395568848 (2.156406799952189) | > loss_kl: 1.3457709550857544 (2.299283782641093) | > loss_feat: 0.30998682975769043 (5.191459958751996) | > loss_mel: 3.0290918350219727 (16.482425371805828) | > loss_duration: 2.288506031036377 (2.2377988497416177) | > loss_1: 9.003532409667969 (28.367374420166016) --> EVAL PERFORMANCE | > avg_loader_time: 0.00729521115620931 (-0.006489038467407227) | > avg_loss_disc: 2.6236961682637534 (+0.01788926124572754) | > avg_loss_disc_real_0: 0.378341397891442 (+0.1794311987857024) | > avg_loss_disc_real_1: 0.23793023948868117 (-0.10507794097065923) | > avg_loss_disc_real_2: 0.20205557097991309 (-0.10742675513029096) | > avg_loss_disc_real_3: 0.21692933390537897 (-0.05536106477181116) | > avg_loss_disc_real_4: 0.2088138908147812 (-0.03915346413850784) | > avg_loss_disc_real_5: 0.31716280058026314 (+0.05751979723572731) | > avg_loss_0: 2.6236961682637534 (+0.01788926124572754) | > avg_loss_gen: 2.156406799952189 (-0.2905744711558027) | > avg_loss_kl: 2.299283782641093 (+0.06282103061676025) | > avg_loss_feat: 5.191459958751996 (+2.434558697044849) | > avg_loss_mel: 16.482425371805828 (-0.8223977088928223) | > avg_loss_duration: 2.2377988497416177 (-0.005711476008097627) | > avg_loss_1: 28.367374420166016 (+1.3786958058675118)  > EPOCH: 135/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:07:25)   --> TIME: 2023-10-20 01:07:32 -- STEP: 9/50 -- GLOBAL_STEP: 59760 | > loss_disc: 2.902125835418701 (2.1627554761038885) | > loss_disc_real_0: 0.114320307970047 (0.09339249092671606) | > loss_disc_real_1: 0.4939799904823303 (0.25442710849973893) | > loss_disc_real_2: 0.34075361490249634 (0.2059734207060602) | > loss_disc_real_3: 0.4599362909793854 (0.26064693017138374) | > loss_disc_real_4: 0.4237746596336365 (0.26515497060285675) | > loss_disc_real_5: 0.3492080569267273 (0.19322889981170496) | > loss_0: 2.902125835418701 (2.1627554761038885) | > grad_norm_0: tensor(562.5173, device='cuda:0') (tensor(1112.2668, device='cuda:0')) | > loss_gen: 2.7920079231262207 (2.883997917175293) | > loss_kl: 1.1259968280792236 (1.1055687467257183) | > loss_feat: 3.7658565044403076 (6.969633844163683) | > loss_mel: 25.51480484008789 (26.009669833713108) | > loss_duration: 1.6585925817489624 (1.746050238609314) | > loss_1: 34.85725784301758 (38.71491919623481) | > grad_norm_1: tensor(25244.2422, device='cuda:0') (tensor(47974.2930, device='cuda:0')) | > current_lr_0: 0.00017474170782534146 | > current_lr_1: 0.00017474170782534146 | > step_time: 0.2819 (0.3261704709794786) | > loader_time: 0.0024 (0.00331674681769477)  --> TIME: 2023-10-20 01:07:48 -- STEP: 39/50 -- GLOBAL_STEP: 59790 | > loss_disc: 2.838353157043457 (2.5636789217973366) | > loss_disc_real_0: 0.11062130331993103 (0.1840316321796332) | > loss_disc_real_1: 0.24524202942848206 (0.2426935877555456) | > loss_disc_real_2: 0.2288057506084442 (0.2380771971283815) | > loss_disc_real_3: 0.22083686292171478 (0.26129063581809026) | > loss_disc_real_4: 0.1713048368692398 (0.23951029227091333) | > loss_disc_real_5: 0.26828107237815857 (0.24258358127628574) | > loss_0: 2.838353157043457 (2.5636789217973366) | > grad_norm_0: tensor(906.5825, device='cuda:0') (tensor(1255.5188, device='cuda:0')) | > loss_gen: 1.4341819286346436 (2.3293940868133154) | > loss_kl: 0.974189281463623 (1.0534890049543133) | > loss_feat: 0.7038401961326599 (4.486084383649703) | > loss_mel: 17.815866470336914 (22.8276371161143) | > loss_duration: 1.7627711296081543 (1.7374104414230738) | > loss_1: 22.69084930419922 (32.43401468717135) | > grad_norm_1: tensor(19891.0449, device='cuda:0') (tensor(29816.6543, device='cuda:0')) | > current_lr_0: 0.00017474170782534146 | > current_lr_1: 0.00017474170782534146 | > step_time: 0.581 (0.46926204974834734) | > loader_time: 0.0248 (0.009945086943797575)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4731040000915527 (2.4731040000915527) | > loss_disc_real_0: 0.2313917577266693 (0.2313917577266693) | > loss_disc_real_1: 0.30453118681907654 (0.30453118681907654) | > loss_disc_real_2: 0.15117138624191284 (0.15117138624191284) | > loss_disc_real_3: 0.27641138434410095 (0.27641138434410095) | > loss_disc_real_4: 0.22587476670742035 (0.22587476670742035) | > loss_disc_real_5: 0.15297485888004303 (0.15297485888004303) | > loss_0: 2.4731040000915527 (2.4731040000915527) | > loss_gen: 2.091564655303955 (2.091564655303955) | > loss_kl: 2.497246742248535 (2.497246742248535) | > loss_feat: 2.588768482208252 (2.588768482208252) | > loss_mel: 10.482905387878418 (10.482905387878418) | > loss_duration: 2.220088243484497 (2.220088243484497) | > loss_1: 19.880573272705078 (19.880573272705078)  --> STEP: 1 | > loss_disc: 2.0850977897644043 (2.0850977897644043) | > loss_disc_real_0: 0.16976748406887054 (0.16976748406887054) | > loss_disc_real_1: 0.1927223652601242 (0.1927223652601242) | > loss_disc_real_2: 0.13406753540039062 (0.13406753540039062) | > loss_disc_real_3: 0.2047690749168396 (0.2047690749168396) | > loss_disc_real_4: 0.22922207415103912 (0.22922207415103912) | > loss_disc_real_5: 0.12565802037715912 (0.12565802037715912) | > loss_0: 2.0850977897644043 (2.0850977897644043) | > loss_gen: 2.459012508392334 (2.459012508392334) | > loss_kl: 2.98250412940979 (2.98250412940979) | > loss_feat: 8.440208435058594 (8.440208435058594) | > loss_mel: 24.24452781677246 (24.24452781677246) | > loss_duration: 2.3762176036834717 (2.3762176036834717) | > loss_1: 40.50246810913086 (40.50246810913086)  --> STEP: 2 | > loss_disc: 2.9449126720428467 (2.5150052309036255) | > loss_disc_real_0: 0.2501082122325897 (0.20993784815073013) | > loss_disc_real_1: 0.37039485573768616 (0.2815586104989052) | > loss_disc_real_2: 0.175418883562088 (0.15474320948123932) | > loss_disc_real_3: 0.30696070194244385 (0.2558648884296417) | > loss_disc_real_4: 0.30402472615242004 (0.2666234001517296) | > loss_disc_real_5: 0.2471943497657776 (0.18642618507146835) | > loss_0: 2.9449126720428467 (2.5150052309036255) | > loss_gen: 1.7538689374923706 (2.1064407229423523) | > loss_kl: 2.405008316040039 (2.6937562227249146) | > loss_feat: 0.25145429372787476 (4.345831364393234) | > loss_mel: 3.038595199584961 (13.641561508178711) | > loss_duration: 2.3394999504089355 (2.3578587770462036) | > loss_1: 9.788427352905273 (25.145447731018066)  --> STEP: 3 | > loss_disc: 3.2954702377319336 (2.775160233179728) | > loss_disc_real_0: 0.5392016172409058 (0.3196924378474553) | > loss_disc_real_1: 0.341633141040802 (0.3015834540128708) | > loss_disc_real_2: 0.2911486029624939 (0.20021167397499084) | > loss_disc_real_3: 0.3064476549625397 (0.27272581060727435) | > loss_disc_real_4: 0.3144978880882263 (0.2825815627972285) | > loss_disc_real_5: 0.4446697533130646 (0.27250737448533374) | > loss_0: 3.2954702377319336 (2.775160233179728) | > loss_gen: 2.7334210872650146 (2.3154341777165732) | > loss_kl: 1.5940293073654175 (2.327180584271749) | > loss_feat: 3.674614429473877 (4.1220923860867815) | > loss_mel: 21.401607513427734 (16.228243509928387) | > loss_duration: 2.230652093887329 (2.3154565493265786) | > loss_1: 31.63432502746582 (27.308406829833984) --> EVAL PERFORMANCE | > avg_loader_time: 0.012844006220499674 (+0.005548795064290364) | > avg_loss_disc: 2.775160233179728 (+0.15146406491597464) | > avg_loss_disc_real_0: 0.3196924378474553 (-0.058648960043986675) | > avg_loss_disc_real_1: 0.3015834540128708 (+0.06365321452418962) | > avg_loss_disc_real_2: 0.20021167397499084 (-0.0018438970049222403) | > avg_loss_disc_real_3: 0.27272581060727435 (+0.05579647670189539) | > avg_loss_disc_real_4: 0.2825815627972285 (+0.07376767198244732) | > avg_loss_disc_real_5: 0.27250737448533374 (-0.044655426094929396) | > avg_loss_0: 2.775160233179728 (+0.15146406491597464) | > avg_loss_gen: 2.3154341777165732 (+0.15902737776438425) | > avg_loss_kl: 2.327180584271749 (+0.02789680163065622) | > avg_loss_feat: 4.1220923860867815 (-1.0693675726652145) | > avg_loss_mel: 16.228243509928387 (-0.2541818618774414) | > avg_loss_duration: 2.3154565493265786 (+0.07765769958496094) | > avg_loss_1: 27.308406829833984 (-1.0589675903320312)  > EPOCH: 136/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:08:03)   --> TIME: 2023-10-20 01:08:16 -- STEP: 19/50 -- GLOBAL_STEP: 59820 | > loss_disc: 2.4462671279907227 (2.4925348507730583) | > loss_disc_real_0: 0.0426185205578804 (0.1858406975669296) | > loss_disc_real_1: 0.27427446842193604 (0.22747426205559781) | > loss_disc_real_2: 0.3063775599002838 (0.22631138778830828) | > loss_disc_real_3: 0.18726032972335815 (0.22109679054272802) | > loss_disc_real_4: 0.14520283043384552 (0.24159152021533564) | > loss_disc_real_5: 0.13770464062690735 (0.23690626780061344) | > loss_0: 2.4462671279907227 (2.4925348507730583) | > grad_norm_0: tensor(573.2430, device='cuda:0') (tensor(935.8497, device='cuda:0')) | > loss_gen: 2.145695686340332 (2.402221177753649) | > loss_kl: 1.6608179807662964 (1.2836023380881862) | > loss_feat: 7.36528205871582 (5.247362758621182) | > loss_mel: 26.181640625 (22.015067426781904) | > loss_duration: 1.8309245109558105 (1.7667893735986007) | > loss_1: 39.18436050415039 (32.715043318899056) | > grad_norm_1: tensor(53776.2070, device='cuda:0') (tensor(52117.9453, device='cuda:0')) | > current_lr_0: 0.00017456704254790382 | > current_lr_1: 0.00017456704254790382 | > step_time: 0.2982 (0.4806871916118421) | > loader_time: 0.0254 (0.02115589693972939)  --> TIME: 2023-10-20 01:08:28 -- STEP: 49/50 -- GLOBAL_STEP: 59850 | > loss_disc: 2.665771007537842 (2.443547424005003) | > loss_disc_real_0: 0.06653580069541931 (0.1573014217523896) | > loss_disc_real_1: 0.25075623393058777 (0.22914297878742218) | > loss_disc_real_2: 0.21874219179153442 (0.22331667349350695) | > loss_disc_real_3: 0.3387090563774109 (0.2436109707519716) | > loss_disc_real_4: 0.26041871309280396 (0.23018069550090905) | > loss_disc_real_5: 0.14194908738136292 (0.2293195121598487) | > loss_0: 2.665771007537842 (2.443547424005003) | > grad_norm_0: tensor(1604.3134, device='cuda:0') (tensor(988.7521, device='cuda:0')) | > loss_gen: 1.8452285528182983 (2.460815556195317) | > loss_kl: 0.9811174869537354 (1.122152178871388) | > loss_feat: 2.444866895675659 (5.523577427016381) | > loss_mel: 25.69171905517578 (22.744217843425517) | > loss_duration: 1.827606201171875 (1.7357317793126008) | > loss_1: 32.79053497314453 (33.58649483505561) | > grad_norm_1: tensor(14778.5859, device='cuda:0') (tensor(42148.9570, device='cuda:0')) | > current_lr_0: 0.00017456704254790382 | > current_lr_1: 0.00017456704254790382 | > step_time: 0.2666 (0.41761045553246323) | > loader_time: 0.2575 (0.019799354125042343)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0259459018707275 (3.0259459018707275) | > loss_disc_real_0: 0.2527370750904083 (0.2527370750904083) | > loss_disc_real_1: 0.22744490206241608 (0.22744490206241608) | > loss_disc_real_2: 0.20589904487133026 (0.20589904487133026) | > loss_disc_real_3: 0.2706204950809479 (0.2706204950809479) | > loss_disc_real_4: 0.2931568920612335 (0.2931568920612335) | > loss_disc_real_5: 0.18005311489105225 (0.18005311489105225) | > loss_0: 3.0259459018707275 (3.0259459018707275) | > loss_gen: 1.4359787702560425 (1.4359787702560425) | > loss_kl: 2.2442164421081543 (2.2442164421081543) | > loss_feat: 0.11347009241580963 (0.11347009241580963) | > loss_mel: 8.336446762084961 (8.336446762084961) | > loss_duration: 2.0660359859466553 (2.0660359859466553) | > loss_1: 14.196148872375488 (14.196148872375488)  --> STEP: 1 | > loss_disc: 2.881331443786621 (2.881331443786621) | > loss_disc_real_0: 0.19827505946159363 (0.19827505946159363) | > loss_disc_real_1: 0.22553762793540955 (0.22553762793540955) | > loss_disc_real_2: 0.21339957416057587 (0.21339957416057587) | > loss_disc_real_3: 0.27001795172691345 (0.27001795172691345) | > loss_disc_real_4: 0.2955740988254547 (0.2955740988254547) | > loss_disc_real_5: 0.18082134425640106 (0.18082134425640106) | > loss_0: 2.881331443786621 (2.881331443786621) | > loss_gen: 1.5299285650253296 (1.5299285650253296) | > loss_kl: 2.8190066814422607 (2.8190066814422607) | > loss_feat: 0.3593071699142456 (0.3593071699142456) | > loss_mel: 18.59418487548828 (18.59418487548828) | > loss_duration: 2.1509695053100586 (2.1509695053100586) | > loss_1: 25.45339584350586 (25.45339584350586)  --> STEP: 2 | > loss_disc: 3.037100076675415 (2.959215760231018) | > loss_disc_real_0: 0.252704381942749 (0.22548972070217133) | > loss_disc_real_1: 0.2274961769580841 (0.22651690244674683) | > loss_disc_real_2: 0.20598819851875305 (0.20969388633966446) | > loss_disc_real_3: 0.27081695199012756 (0.2704174518585205) | > loss_disc_real_4: 0.29283735156059265 (0.2942057251930237) | > loss_disc_real_5: 0.1801805943250656 (0.18050096929073334) | > loss_0: 3.037100076675415 (2.959215760231018) | > loss_gen: 1.422965407371521 (1.4764469861984253) | > loss_kl: 2.9343912601470947 (2.8766989707946777) | > loss_feat: 0.08507390320301056 (0.22219053655862808) | > loss_mel: 2.6033523082733154 (10.598768591880798) | > loss_duration: 2.1829493045806885 (2.1669594049453735) | > loss_1: 9.228732109069824 (17.341063976287842)  --> STEP: 3 | > loss_disc: 2.8912386894226074 (2.9365567366282144) | > loss_disc_real_0: 0.18780052661895752 (0.21292665600776672) | > loss_disc_real_1: 0.21290820837020874 (0.2219806710879008) | > loss_disc_real_2: 0.21217726171016693 (0.21052167812983194) | > loss_disc_real_3: 0.2713807225227356 (0.27073854207992554) | > loss_disc_real_4: 0.2885489761829376 (0.2923201421896617) | > loss_disc_real_5: 0.18262048065662384 (0.1812074730793635) | > loss_0: 2.8912386894226074 (2.9365567366282144) | > loss_gen: 1.4932154417037964 (1.4820364713668823) | > loss_kl: 1.194803237915039 (2.3160670598347983) | > loss_feat: 0.4055250883102417 (0.28330205380916595) | > loss_mel: 17.756589889526367 (12.984709024429321) | > loss_duration: 2.155447244644165 (2.163122018178304) | > loss_1: 23.00558090209961 (19.229236284891766) --> EVAL PERFORMANCE | > avg_loader_time: 0.013928651809692383 (+0.001084645589192709) | > avg_loss_disc: 2.9365567366282144 (+0.16139650344848633) | > avg_loss_disc_real_0: 0.21292665600776672 (-0.1067657818396886) | > avg_loss_disc_real_1: 0.2219806710879008 (-0.07960278292497) | > avg_loss_disc_real_2: 0.21052167812983194 (+0.010310004154841096) | > avg_loss_disc_real_3: 0.27073854207992554 (-0.0019872685273488178) | > avg_loss_disc_real_4: 0.2923201421896617 (+0.009738579392433167) | > avg_loss_disc_real_5: 0.1812074730793635 (-0.09129990140597025) | > avg_loss_0: 2.9365567366282144 (+0.16139650344848633) | > avg_loss_gen: 1.4820364713668823 (-0.8333977063496909) | > avg_loss_kl: 2.3160670598347983 (-0.011113524436950684) | > avg_loss_feat: 0.28330205380916595 (-3.8387903322776156) | > avg_loss_mel: 12.984709024429321 (-3.2435344854990653) | > avg_loss_duration: 2.163122018178304 (-0.15233453114827444) | > avg_loss_1: 19.229236284891766 (-8.079170544942219) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_59851.pth  > EPOCH: 137/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:08:41)   --> TIME: 2023-10-20 01:09:02 -- STEP: 29/50 -- GLOBAL_STEP: 59880 | > loss_disc: 2.5194740295410156 (2.3760805253324837) | > loss_disc_real_0: 0.04491807520389557 (0.1621754902318634) | > loss_disc_real_1: 0.295478492975235 (0.2101942511468098) | > loss_disc_real_2: 0.11961261183023453 (0.21367197817769543) | > loss_disc_real_3: 0.21937572956085205 (0.23373078696172814) | > loss_disc_real_4: 0.21203793585300446 (0.2002993891465253) | > loss_disc_real_5: 0.23624394834041595 (0.21989398568483262) | > loss_0: 2.5194740295410156 (2.3760805253324837) | > grad_norm_0: tensor(1384.7386, device='cuda:0') (tensor(1152.0210, device='cuda:0')) | > loss_gen: 1.8142564296722412 (2.440012483761228) | > loss_kl: 1.175183653831482 (1.0599723581610059) | > loss_feat: 2.5033812522888184 (5.802240121981193) | > loss_mel: 23.463891983032227 (25.459878099375757) | > loss_duration: 1.705541729927063 (1.7469575240694244) | > loss_1: 30.662254333496094 (36.5090599717765) | > grad_norm_1: tensor(5306.6611, device='cuda:0') (tensor(41075.4102, device='cuda:0')) | > current_lr_0: 0.0001743925518593467 | > current_lr_1: 0.0001743925518593467 | > step_time: 0.6801 (0.5347053182536159) | > loader_time: 0.0234 (0.01843121134001633)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8657398223876953 (2.8657398223876953) | > loss_disc_real_0: 0.31753841042518616 (0.31753841042518616) | > loss_disc_real_1: 0.29059523344039917 (0.29059523344039917) | > loss_disc_real_2: 0.3004799783229828 (0.3004799783229828) | > loss_disc_real_3: 0.29727768898010254 (0.29727768898010254) | > loss_disc_real_4: 0.22545893490314484 (0.22545893490314484) | > loss_disc_real_5: 0.20258815586566925 (0.20258815586566925) | > loss_0: 2.8657398223876953 (2.8657398223876953) | > loss_gen: 1.8299518823623657 (1.8299518823623657) | > loss_kl: 1.9500499963760376 (1.9500499963760376) | > loss_feat: 0.45332765579223633 (0.45332765579223633) | > loss_mel: 15.628640174865723 (15.628640174865723) | > loss_duration: 2.135711908340454 (2.135711908340454) | > loss_1: 21.9976806640625 (21.9976806640625)  --> STEP: 1 | > loss_disc: 1.8474228382110596 (1.8474228382110596) | > loss_disc_real_0: 0.08035653829574585 (0.08035653829574585) | > loss_disc_real_1: 0.17000575363636017 (0.17000575363636017) | > loss_disc_real_2: 0.07292447984218597 (0.07292447984218597) | > loss_disc_real_3: 0.2365444153547287 (0.2365444153547287) | > loss_disc_real_4: 0.09495886415243149 (0.09495886415243149) | > loss_disc_real_5: 0.06418129056692123 (0.06418129056692123) | > loss_0: 1.8474228382110596 (1.8474228382110596) | > loss_gen: 2.2194559574127197 (2.2194559574127197) | > loss_kl: 3.0949559211730957 (3.0949559211730957) | > loss_feat: 7.263983726501465 (7.263983726501465) | > loss_mel: 25.096406936645508 (25.096406936645508) | > loss_duration: 2.292832136154175 (2.292832136154175) | > loss_1: 39.96763229370117 (39.96763229370117)  --> STEP: 2 | > loss_disc: 2.648975133895874 (2.248198986053467) | > loss_disc_real_0: 0.19163906574249268 (0.13599780201911926) | > loss_disc_real_1: 0.2812999486923218 (0.22565285116434097) | > loss_disc_real_2: 0.33194005489349365 (0.2024322673678398) | > loss_disc_real_3: 0.23188412189483643 (0.23421426862478256) | > loss_disc_real_4: 0.13648156821727753 (0.11572021618485451) | > loss_disc_real_5: 0.20917829871177673 (0.13667979463934898) | > loss_0: 2.648975133895874 (2.248198986053467) | > loss_gen: 2.222526788711548 (2.220991373062134) | > loss_kl: 2.6855087280273438 (2.8902323246002197) | > loss_feat: 8.133091926574707 (7.698537826538086) | > loss_mel: 27.701406478881836 (26.398906707763672) | > loss_duration: 2.3151695728302 (2.3040008544921875) | > loss_1: 43.05770492553711 (41.51266860961914)  --> STEP: 3 | > loss_disc: 2.980637311935425 (2.492345094680786) | > loss_disc_real_0: 0.3534371554851532 (0.20847758650779724) | > loss_disc_real_1: 0.31459447741508484 (0.25530005991458893) | > loss_disc_real_2: 0.35288333892822266 (0.2525826245546341) | > loss_disc_real_3: 0.31434524059295654 (0.2609245926141739) | > loss_disc_real_4: 0.24546006321907043 (0.15896683186292648) | > loss_disc_real_5: 0.23593804240226746 (0.16976587722698847) | > loss_0: 2.980637311935425 (2.492345094680786) | > loss_gen: 1.9453997611999512 (2.1291275024414062) | > loss_kl: 1.4800232648849487 (2.420162638028463) | > loss_feat: 1.1588518619537354 (5.518642505009969) | > loss_mel: 19.776779174804688 (24.19153086344401) | > loss_duration: 2.1939797401428223 (2.267327149709066) | > loss_1: 26.55503273010254 (36.52678998311361) --> EVAL PERFORMANCE | > avg_loader_time: 0.01070388158162435 (-0.0032247702280680333) | > avg_loss_disc: 2.492345094680786 (-0.44421164194742824) | > avg_loss_disc_real_0: 0.20847758650779724 (-0.004449069499969482) | > avg_loss_disc_real_1: 0.25530005991458893 (+0.03331938882668814) | > avg_loss_disc_real_2: 0.2525826245546341 (+0.042060946424802154) | > avg_loss_disc_real_3: 0.2609245926141739 (-0.009813949465751648) | > avg_loss_disc_real_4: 0.15896683186292648 (-0.1333533103267352) | > avg_loss_disc_real_5: 0.16976587722698847 (-0.01144159585237503) | > avg_loss_0: 2.492345094680786 (-0.44421164194742824) | > avg_loss_gen: 2.1291275024414062 (+0.6470910310745239) | > avg_loss_kl: 2.420162638028463 (+0.10409557819366455) | > avg_loss_feat: 5.518642505009969 (+5.235340451200803) | > avg_loss_mel: 24.19153086344401 (+11.20682183901469) | > avg_loss_duration: 2.267327149709066 (+0.10420513153076172) | > avg_loss_1: 36.52678998311361 (+17.297553698221844)  > EPOCH: 138/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:09:22)   --> TIME: 2023-10-20 01:09:29 -- STEP: 9/50 -- GLOBAL_STEP: 59910 | > loss_disc: 2.0918757915496826 (2.274955670038859) | > loss_disc_real_0: 0.03783611208200455 (0.11066828005843693) | > loss_disc_real_1: 0.4612419009208679 (0.271505668759346) | > loss_disc_real_2: 0.1932198405265808 (0.22597459455331168) | > loss_disc_real_3: 0.3255156874656677 (0.25337300366825527) | > loss_disc_real_4: 0.16393044590950012 (0.1816208759943644) | > loss_disc_real_5: 0.13726399838924408 (0.18807059733404052) | > loss_0: 2.0918757915496826 (2.274955670038859) | > grad_norm_0: tensor(746.5063, device='cuda:0') (tensor(985.1738, device='cuda:0')) | > loss_gen: 2.8676469326019287 (2.505946848127577) | > loss_kl: 0.7943866848945618 (0.9670188691880968) | > loss_feat: 6.176431179046631 (6.363904820548163) | > loss_mel: 24.603012084960938 (26.747573852539062) | > loss_duration: 1.6601253747940063 (1.7106128666136) | > loss_1: 36.101600646972656 (38.295056660970054) | > grad_norm_1: tensor(17229.6270, device='cuda:0') (tensor(48714.4023, device='cuda:0')) | > current_lr_0: 0.00017421823558515755 | > current_lr_1: 0.00017421823558515755 | > step_time: 0.2484 (0.31458139419555664) | > loader_time: 0.0059 (0.005933788087632921)  --> TIME: 2023-10-20 01:09:44 -- STEP: 39/50 -- GLOBAL_STEP: 59940 | > loss_disc: 2.9666945934295654 (2.4550806069985414) | > loss_disc_real_0: 0.2961742877960205 (0.1436125907378319) | > loss_disc_real_1: 0.24377095699310303 (0.25427131030039907) | > loss_disc_real_2: 0.19680047035217285 (0.2344047161631095) | > loss_disc_real_3: 0.24938678741455078 (0.25167083148008745) | > loss_disc_real_4: 0.3099570572376251 (0.22369874020417532) | > loss_disc_real_5: 0.1894112229347229 (0.20981788979126856) | > loss_0: 2.9666945934295654 (2.4550806069985414) | > grad_norm_0: tensor(1158.2135, device='cuda:0') (tensor(1037.2279, device='cuda:0')) | > loss_gen: 1.5027198791503906 (2.428117042932755) | > loss_kl: 0.9654918313026428 (1.027602776502952) | > loss_feat: 0.26807236671447754 (5.4893669348496665) | > loss_mel: 15.82870101928711 (23.98166097738804) | > loss_duration: 1.7572981119155884 (1.722474672855475) | > loss_1: 20.322282791137695 (34.64922209275074) | > grad_norm_1: tensor(15134.2549, device='cuda:0') (tensor(37913.8711, device='cuda:0')) | > current_lr_0: 0.00017421823558515755 | > current_lr_1: 0.00017421823558515755 | > step_time: 0.5922 (0.4496953609662178) | > loader_time: 0.0049 (0.009390305250118943)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1942291259765625 (3.1942291259765625) | > loss_disc_real_0: 0.23445266485214233 (0.23445266485214233) | > loss_disc_real_1: 0.2578187584877014 (0.2578187584877014) | > loss_disc_real_2: 0.26767972111701965 (0.26767972111701965) | > loss_disc_real_3: 0.3469970226287842 (0.3469970226287842) | > loss_disc_real_4: 0.3129705786705017 (0.3129705786705017) | > loss_disc_real_5: 0.48226282000541687 (0.48226282000541687) | > loss_0: 3.1942291259765625 (3.1942291259765625) | > loss_gen: 1.7603884935379028 (1.7603884935379028) | > loss_kl: 2.4361307621002197 (2.4361307621002197) | > loss_feat: 0.4017752408981323 (0.4017752408981323) | > loss_mel: 10.527009963989258 (10.527009963989258) | > loss_duration: 2.1459362506866455 (2.1459362506866455) | > loss_1: 17.271240234375 (17.271240234375)  --> STEP: 1 | > loss_disc: 2.464587688446045 (2.464587688446045) | > loss_disc_real_0: 0.05035163462162018 (0.05035163462162018) | > loss_disc_real_1: 0.3020001947879791 (0.3020001947879791) | > loss_disc_real_2: 0.15712876617908478 (0.15712876617908478) | > loss_disc_real_3: 0.15635213255882263 (0.15635213255882263) | > loss_disc_real_4: 0.2145240157842636 (0.2145240157842636) | > loss_disc_real_5: 0.1787203997373581 (0.1787203997373581) | > loss_0: 2.464587688446045 (2.464587688446045) | > loss_gen: 1.9260400533676147 (1.9260400533676147) | > loss_kl: 2.7140181064605713 (2.7140181064605713) | > loss_feat: 6.279603958129883 (6.279603958129883) | > loss_mel: 26.251123428344727 (26.251123428344727) | > loss_duration: 2.2598814964294434 (2.2598814964294434) | > loss_1: 39.4306640625 (39.4306640625)  --> STEP: 2 | > loss_disc: 2.058166742324829 (2.261377215385437) | > loss_disc_real_0: 0.031589850783348083 (0.04097074270248413) | > loss_disc_real_1: 0.20532847940921783 (0.2536643370985985) | > loss_disc_real_2: 0.06404344737529755 (0.11058610677719116) | > loss_disc_real_3: 0.1630767285823822 (0.15971443057060242) | > loss_disc_real_4: 0.13247574865818024 (0.17349988222122192) | > loss_disc_real_5: 0.08927662670612335 (0.13399851322174072) | > loss_0: 2.058166742324829 (2.261377215385437) | > loss_gen: 2.0061163902282715 (1.9660782217979431) | > loss_kl: 2.907362937927246 (2.8106905221939087) | > loss_feat: 7.810717582702637 (7.04516077041626) | > loss_mel: 29.642908096313477 (27.9470157623291) | > loss_duration: 2.3286709785461426 (2.294276237487793) | > loss_1: 44.69577407836914 (42.06321907043457)  --> STEP: 3 | > loss_disc: 1.564422607421875 (2.0290590127309165) | > loss_disc_real_0: 0.09093904495239258 (0.05762684345245361) | > loss_disc_real_1: 0.17808212339878082 (0.22847026586532593) | > loss_disc_real_2: 0.13841046392917633 (0.11986089249451955) | > loss_disc_real_3: 0.15427324175834656 (0.15790070096651712) | > loss_disc_real_4: 0.14154323935508728 (0.16284766793251038) | > loss_disc_real_5: 0.040945302695035934 (0.1029807763795058) | > loss_0: 1.564422607421875 (2.0290590127309165) | > loss_gen: 2.831688642501831 (2.2546150286992392) | > loss_kl: 1.2917855978012085 (2.3043888807296753) | > loss_feat: 7.512287616729736 (7.200869719187419) | > loss_mel: 24.319154739379883 (26.737728754679363) | > loss_duration: 2.219926357269287 (2.2694929440816245) | > loss_1: 38.174842834472656 (40.767093658447266) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027129650115966797 (-0.00799091657002767) | > avg_loss_disc: 2.0290590127309165 (-0.46328608194986964) | > avg_loss_disc_real_0: 0.05762684345245361 (-0.15085074305534363) | > avg_loss_disc_real_1: 0.22847026586532593 (-0.026829794049263) | > avg_loss_disc_real_2: 0.11986089249451955 (-0.13272173206011456) | > avg_loss_disc_real_3: 0.15790070096651712 (-0.10302389164765677) | > avg_loss_disc_real_4: 0.16284766793251038 (+0.003880836069583893) | > avg_loss_disc_real_5: 0.1029807763795058 (-0.06678510084748267) | > avg_loss_0: 2.0290590127309165 (-0.46328608194986964) | > avg_loss_gen: 2.2546150286992392 (+0.125487526257833) | > avg_loss_kl: 2.3043888807296753 (-0.11577375729878758) | > avg_loss_feat: 7.200869719187419 (+1.6822272141774501) | > avg_loss_mel: 26.737728754679363 (+2.5461978912353516) | > avg_loss_duration: 2.2694929440816245 (+0.0021657943725585938) | > avg_loss_1: 40.767093658447266 (+4.2403036753336565)  > EPOCH: 139/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:10:00)   --> TIME: 2023-10-20 01:10:14 -- STEP: 19/50 -- GLOBAL_STEP: 59970 | > loss_disc: 2.0692524909973145 (2.52498858225973) | > loss_disc_real_0: 0.06313866376876831 (0.17432368311442828) | > loss_disc_real_1: 0.15004734694957733 (0.2190078732214476) | > loss_disc_real_2: 0.2068673074245453 (0.22652096693453036) | > loss_disc_real_3: 0.027599312365055084 (0.22512728828740747) | > loss_disc_real_4: 0.39584189653396606 (0.2422054394295341) | > loss_disc_real_5: 0.26403164863586426 (0.23081646114587784) | > loss_0: 2.0692524909973145 (2.52498858225973) | > grad_norm_0: tensor(1061.0739, device='cuda:0') (tensor(1202.4668, device='cuda:0')) | > loss_gen: 3.0198745727539062 (2.400772860175685) | > loss_kl: 1.3166099786758423 (1.063515371397922) | > loss_feat: 9.203811645507812 (6.195748382885205) | > loss_mel: 26.07014274597168 (25.07234269066861) | > loss_duration: 1.8298118114471436 (1.7854238623066951) | > loss_1: 41.440250396728516 (36.51780289097836) | > grad_norm_1: tensor(76561.6328, device='cuda:0') (tensor(40939.1250, device='cuda:0')) | > current_lr_0: 0.0001740440935509983 | > current_lr_1: 0.0001740440935509983 | > step_time: 0.6352 (0.49828477909690455) | > loader_time: 0.0244 (0.021378190893875926)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0767197608947754 (2.0767197608947754) | > loss_disc_real_0: 0.1174883097410202 (0.1174883097410202) | > loss_disc_real_1: 0.2494724988937378 (0.2494724988937378) | > loss_disc_real_2: 0.1351936310529709 (0.1351936310529709) | > loss_disc_real_3: 0.3989972174167633 (0.3989972174167633) | > loss_disc_real_4: 0.13119016587734222 (0.13119016587734222) | > loss_disc_real_5: 0.1868530511856079 (0.1868530511856079) | > loss_0: 2.0767197608947754 (2.0767197608947754) | > loss_gen: 3.2387452125549316 (3.2387452125549316) | > loss_kl: 2.474717140197754 (2.474717140197754) | > loss_feat: 8.31497859954834 (8.31497859954834) | > loss_mel: 26.21820640563965 (26.21820640563965) | > loss_duration: 2.0694539546966553 (2.0694539546966553) | > loss_1: 42.316104888916016 (42.316104888916016)  --> STEP: 1 | > loss_disc: 2.1862289905548096 (2.1862289905548096) | > loss_disc_real_0: 0.23150114715099335 (0.23150114715099335) | > loss_disc_real_1: 0.2400265634059906 (0.2400265634059906) | > loss_disc_real_2: 0.20811699330806732 (0.20811699330806732) | > loss_disc_real_3: 0.4219258725643158 (0.4219258725643158) | > loss_disc_real_4: 0.13017503917217255 (0.13017503917217255) | > loss_disc_real_5: 0.19257117807865143 (0.19257117807865143) | > loss_0: 2.1862289905548096 (2.1862289905548096) | > loss_gen: 2.807211399078369 (2.807211399078369) | > loss_kl: 2.988187551498413 (2.988187551498413) | > loss_feat: 3.8941192626953125 (3.8941192626953125) | > loss_mel: 25.37049674987793 (25.37049674987793) | > loss_duration: 2.2437565326690674 (2.2437565326690674) | > loss_1: 37.30377197265625 (37.30377197265625)  --> STEP: 2 | > loss_disc: 1.9646761417388916 (2.0754525661468506) | > loss_disc_real_0: 0.1336904615163803 (0.18259580433368683) | > loss_disc_real_1: 0.2033451348543167 (0.22168584913015366) | > loss_disc_real_2: 0.16841590404510498 (0.18826644867658615) | > loss_disc_real_3: 0.24353082478046417 (0.33272834867239) | > loss_disc_real_4: 0.09557590633630753 (0.11287547275424004) | > loss_disc_real_5: 0.12474645674228668 (0.15865881741046906) | > loss_0: 1.9646761417388916 (2.0754525661468506) | > loss_gen: 3.147346019744873 (2.977278709411621) | > loss_kl: 2.6085939407348633 (2.798390746116638) | > loss_feat: 11.264495849609375 (7.579307556152344) | > loss_mel: 34.444976806640625 (29.907736778259277) | > loss_duration: 2.2604544162750244 (2.252105474472046) | > loss_1: 53.725868225097656 (45.51482009887695)  --> STEP: 3 | > loss_disc: 2.8896124362945557 (2.346839189529419) | > loss_disc_real_0: 0.22985175251960754 (0.19834778706232706) | > loss_disc_real_1: 0.30220478773117065 (0.24852549533049265) | > loss_disc_real_2: 0.22413228452205658 (0.20022172729174295) | > loss_disc_real_3: 0.3567889332771301 (0.3407485435406367) | > loss_disc_real_4: 0.3028613030910492 (0.17620408286650976) | > loss_disc_real_5: 0.33587902784347534 (0.21773222088813782) | > loss_0: 2.8896124362945557 (2.346839189529419) | > loss_gen: 1.991502285003662 (2.6486865679423013) | > loss_kl: 1.5121955871582031 (2.3696590264638266) | > loss_feat: 0.6629505753517151 (5.273855229218801) | > loss_mel: 10.608072280883789 (23.474515279134113) | > loss_duration: 2.190176486968994 (2.2314624786376953) | > loss_1: 16.96489715576172 (35.99817911783854)  --> TIME: 2023-10-20 01:10:31 -- STEP: 49/50 -- GLOBAL_STEP: 60000 | > loss_disc: 2.9928698539733887 (2.534410099593961) | > loss_disc_real_0: 0.23006409406661987 (0.16795824076600213) | > loss_disc_real_1: 0.3188077211380005 (0.22556755045542912) | > loss_disc_real_2: 0.2198714166879654 (0.22691310980186172) | > loss_disc_real_3: 0.3520335853099823 (0.24538684130779334) | > loss_disc_real_4: 0.306774377822876 (0.23685327841311085) | > loss_disc_real_5: 0.3419608175754547 (0.23540564242522327) | > loss_0: 2.9928698539733887 (2.534410099593961) | > grad_norm_0: tensor(1807.1708, device='cuda:0') (tensor(1123.8103, device='cuda:0')) | > loss_gen: 1.9544570446014404 (2.364187313585865) | > loss_kl: 0.7981916069984436 (1.0547415808755525) | > loss_feat: 0.46038442850112915 (5.231338883312988) | > loss_mel: 4.295791149139404 (23.09469731973142) | > loss_duration: 1.816054105758667 (1.7341819052793541) | > loss_1: 9.324878692626953 (33.479146850352386) | > grad_norm_1: tensor(21594.3574, device='cuda:0') (tensor(39376.9922, device='cuda:0')) | > current_lr_0: 0.0001740440935509983 | > current_lr_1: 0.0001740440935509983 | > step_time: 1.0187 (0.4400914055960519) | > loader_time: 4.7579 (0.11201479483623894) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_60000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7562174797058105 (2.199183762073517) | > loss_disc_real_0: 0.19116106629371643 (0.1965511068701744) | > loss_disc_real_1: 0.1789572536945343 (0.23113343492150307) | > loss_disc_real_2: 0.0836656242609024 (0.17108270153403282) | > loss_disc_real_3: 0.21303752064704895 (0.30882078781723976) | > loss_disc_real_4: 0.04068208485841751 (0.1423235833644867) | > loss_disc_real_5: 0.16462168097496033 (0.20445458590984344) | > loss_0: 1.7562174797058105 (2.199183762073517) | > loss_gen: 3.203026533126831 (2.787271559238434) | > loss_kl: 2.172856569290161 (2.32045841217041) | > loss_feat: 9.144172668457031 (6.2414345890283585) | > loss_mel: 26.45159912109375 (24.218786239624023) | > loss_duration: 2.120004892349243 (2.2035980820655823) | > loss_1: 43.09165954589844 (37.771549224853516)  --> STEP: 1 | > loss_disc: 2.682941436767578 (2.295935297012329) | > loss_disc_real_0: 0.21945318579673767 (0.20113152265548706) | > loss_disc_real_1: 0.20186159014701843 (0.22527906596660613) | > loss_disc_real_2: 0.36230209469795227 (0.2093265801668167) | > loss_disc_real_3: 0.5019879341125488 (0.3474542170763016) | > loss_disc_real_4: 0.2474941462278366 (0.16335769593715668) | > loss_disc_real_5: 0.31536370515823364 (0.22663640975952148) | > loss_0: 2.682941436767578 (2.295935297012329) | > loss_gen: 3.019813060760498 (2.8337798595428465) | > loss_kl: 2.5860848426818848 (2.373583698272705) | > loss_feat: 6.350074291229248 (6.263162529468536) | > loss_mel: 27.509706497192383 (24.876970291137695) | > loss_duration: 2.3823981285095215 (2.23935809135437) | > loss_1: 41.84807586669922 (38.58685455322266)  --> STEP: 2 | > loss_disc: 2.8413901329040527 (2.3868444363276162) | > loss_disc_real_0: 0.28221699595451355 (0.2146457682053248) | > loss_disc_real_1: 0.29592201113700867 (0.23705289016167322) | > loss_disc_real_2: 0.3164865970611572 (0.22718658298254013) | > loss_disc_real_3: 0.4524204134941101 (0.3649485831459363) | > loss_disc_real_4: 0.3005771338939667 (0.18622760226329169) | > loss_disc_real_5: 0.30013570189476013 (0.23888629178206125) | > loss_0: 2.8413901329040527 (2.3868444363276162) | > loss_gen: 3.05637264251709 (2.8708786567052207) | > loss_kl: 2.6350975036621094 (2.4171693325042725) | > loss_feat: 6.320157051086426 (6.272661616404851) | > loss_mel: 29.464868545532227 (25.64162000020345) | > loss_duration: 2.282816171646118 (2.246601104736328) | > loss_1: 43.759315490722656 (39.44893137613932)  --> STEP: 3 | > loss_disc: 3.163530111312866 (2.4977995327540805) | > loss_disc_real_0: 0.44248807430267334 (0.2471946690763746) | > loss_disc_real_1: 0.4145142138004303 (0.2624045078243528) | > loss_disc_real_2: 0.3311607539653778 (0.24204003598008836) | > loss_disc_real_3: 0.4656042456626892 (0.37932796350547243) | > loss_disc_real_4: 0.32128816843032837 (0.20552196885858262) | > loss_disc_real_5: 0.30864283442497253 (0.24885151215962) | > loss_0: 3.163530111312866 (2.4977995327540805) | > loss_gen: 3.2240209579467773 (2.9213275568825856) | > loss_kl: 1.7765793800354004 (2.3256564821515764) | > loss_feat: 4.116218566894531 (5.964598323617663) | > loss_mel: 24.33790397644043 (25.45537485395159) | > loss_duration: 2.225450038909912 (2.243579523903983) | > loss_1: 35.680171966552734 (38.91053717476981) --> EVAL PERFORMANCE | > avg_loader_time: 0.5613610063280378 (+0.5586480413164411) | > avg_loss_disc: 2.4977995327540805 (+0.468740520023164) | > avg_loss_disc_real_0: 0.2471946690763746 (+0.189567825623921) | > avg_loss_disc_real_1: 0.2624045078243528 (+0.03393424195902689) | > avg_loss_disc_real_2: 0.24204003598008836 (+0.12217914348556881) | > avg_loss_disc_real_3: 0.37932796350547243 (+0.2214272625389553) | > avg_loss_disc_real_4: 0.20552196885858262 (+0.042674300926072245) | > avg_loss_disc_real_5: 0.24885151215962 (+0.14587073578011422) | > avg_loss_0: 2.4977995327540805 (+0.468740520023164) | > avg_loss_gen: 2.9213275568825856 (+0.6667125281833464) | > avg_loss_kl: 2.3256564821515764 (+0.021267601421901094) | > avg_loss_feat: 5.964598323617663 (-1.236271395569756) | > avg_loss_mel: 25.45537485395159 (-1.2823539007277738) | > avg_loss_duration: 2.243579523903983 (-0.025913420177641644) | > avg_loss_1: 38.91053717476981 (-1.8565564836774584)  > EPOCH: 140/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:10:45)   --> TIME: 2023-10-20 01:11:05 -- STEP: 29/50 -- GLOBAL_STEP: 60030 | > loss_disc: 3.015076160430908 (2.448940351091582) | > loss_disc_real_0: 0.19193577766418457 (0.15534485221422953) | > loss_disc_real_1: 0.2729491591453552 (0.24245869933531203) | > loss_disc_real_2: 0.2733020782470703 (0.24058774961479779) | > loss_disc_real_3: 0.24805386364459991 (0.23333571594336938) | > loss_disc_real_4: 0.26017770171165466 (0.2301939158732521) | > loss_disc_real_5: 0.2636813819408417 (0.20260495246098986) | > loss_0: 3.015076160430908 (2.448940351091582) | > grad_norm_0: tensor(631.5930, device='cuda:0') (tensor(1105.2406, device='cuda:0')) | > loss_gen: 1.5590989589691162 (2.401196372920069) | > loss_kl: 0.8059196472167969 (1.110176659863571) | > loss_feat: 0.37337982654571533 (5.184585574372061) | > loss_mel: 15.428108215332031 (23.944051569905778) | > loss_duration: 1.7188926935195923 (1.7439059717901821) | > loss_1: 19.885400772094727 (34.38391583541344) | > grad_norm_1: tensor(24870.3438, device='cuda:0') (tensor(41266.0469, device='cuda:0')) | > current_lr_0: 0.00017387012558270508 | > current_lr_1: 0.00017387012558270508 | > step_time: 0.3136 (0.49805867260900044) | > loader_time: 0.0254 (0.022019772694028657)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.88997745513916 (2.88997745513916) | > loss_disc_real_0: 0.15557318925857544 (0.15557318925857544) | > loss_disc_real_1: 0.30158987641334534 (0.30158987641334534) | > loss_disc_real_2: 0.24815841019153595 (0.24815841019153595) | > loss_disc_real_3: 0.3466315269470215 (0.3466315269470215) | > loss_disc_real_4: 0.21905434131622314 (0.21905434131622314) | > loss_disc_real_5: 0.21076001226902008 (0.21076001226902008) | > loss_0: 2.88997745513916 (2.88997745513916) | > loss_gen: 1.6747264862060547 (1.6747264862060547) | > loss_kl: 2.651531457901001 (2.651531457901001) | > loss_feat: 0.7738709449768066 (0.7738709449768066) | > loss_mel: 23.87881851196289 (23.87881851196289) | > loss_duration: 2.2113568782806396 (2.2113568782806396) | > loss_1: 31.190303802490234 (31.190303802490234)  --> STEP: 1 | > loss_disc: 2.999906539916992 (2.999906539916992) | > loss_disc_real_0: 0.3204135298728943 (0.3204135298728943) | > loss_disc_real_1: 0.27199769020080566 (0.27199769020080566) | > loss_disc_real_2: 0.2696630656719208 (0.2696630656719208) | > loss_disc_real_3: 0.36366957426071167 (0.36366957426071167) | > loss_disc_real_4: 0.3458212912082672 (0.3458212912082672) | > loss_disc_real_5: 0.5117006301879883 (0.5117006301879883) | > loss_0: 2.999906539916992 (2.999906539916992) | > loss_gen: 2.483633518218994 (2.483633518218994) | > loss_kl: 3.152047872543335 (3.152047872543335) | > loss_feat: 4.243871688842773 (4.243871688842773) | > loss_mel: 27.59065818786621 (27.59065818786621) | > loss_duration: 2.3345084190368652 (2.3345084190368652) | > loss_1: 39.80472183227539 (39.80472183227539)  --> STEP: 2 | > loss_disc: 3.080195426940918 (3.040050983428955) | > loss_disc_real_0: 0.13356076180934906 (0.22698714584112167) | > loss_disc_real_1: 0.29913830757141113 (0.2855679988861084) | > loss_disc_real_2: 0.25571003556251526 (0.262686550617218) | > loss_disc_real_3: 0.36544269323349 (0.36455613374710083) | > loss_disc_real_4: 0.198111429810524 (0.2719663605093956) | > loss_disc_real_5: 0.18701854348182678 (0.34935958683490753) | > loss_0: 3.080195426940918 (3.040050983428955) | > loss_gen: 1.440286636352539 (1.9619600772857666) | > loss_kl: 2.876946210861206 (3.0144970417022705) | > loss_feat: 0.013846417888998985 (2.128859053365886) | > loss_mel: 1.5733201503753662 (14.581989169120789) | > loss_duration: 2.331831693649292 (2.3331700563430786) | > loss_1: 8.236230850219727 (24.02047634124756)  --> STEP: 3 | > loss_disc: 2.9018235206604004 (2.9939751625061035) | > loss_disc_real_0: 0.2920447587966919 (0.24867301682631174) | > loss_disc_real_1: 0.3251953721046448 (0.2987771232922872) | > loss_disc_real_2: 0.3083920180797577 (0.2779217064380646) | > loss_disc_real_3: 0.30501121282577515 (0.3447078267733256) | > loss_disc_real_4: 0.2820717394351959 (0.27533482015132904) | > loss_disc_real_5: 0.40790486335754395 (0.3688746790091197) | > loss_0: 2.9018235206604004 (2.9939751625061035) | > loss_gen: 2.4253172874450684 (2.1164124806722007) | > loss_kl: 1.418204426765442 (2.482399503389994) | > loss_feat: 3.472590923309326 (2.576769676680366) | > loss_mel: 24.78571891784668 (17.983232418696087) | > loss_duration: 2.204023838043213 (2.29012131690979) | > loss_1: 34.30585479736328 (27.448935826619465) --> EVAL PERFORMANCE | > avg_loader_time: 0.008779605229695639 (-0.5525814010983421) | > avg_loss_disc: 2.9939751625061035 (+0.496175629752023) | > avg_loss_disc_real_0: 0.24867301682631174 (+0.0014783477499371311) | > avg_loss_disc_real_1: 0.2987771232922872 (+0.036372615467934355) | > avg_loss_disc_real_2: 0.2779217064380646 (+0.03588167045797622) | > avg_loss_disc_real_3: 0.3447078267733256 (-0.03462013673214681) | > avg_loss_disc_real_4: 0.27533482015132904 (+0.06981285129274642) | > avg_loss_disc_real_5: 0.3688746790091197 (+0.12002316684949968) | > avg_loss_0: 2.9939751625061035 (+0.496175629752023) | > avg_loss_gen: 2.1164124806722007 (-0.8049150762103849) | > avg_loss_kl: 2.482399503389994 (+0.15674302123841777) | > avg_loss_feat: 2.576769676680366 (-3.387828646937297) | > avg_loss_mel: 17.983232418696087 (-7.472142435255503) | > avg_loss_duration: 2.29012131690979 (+0.046541793005807186) | > avg_loss_1: 27.448935826619465 (-11.461601348150342)  > EPOCH: 141/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:11:27)   --> TIME: 2023-10-20 01:11:35 -- STEP: 9/50 -- GLOBAL_STEP: 60060 | > loss_disc: 3.220707893371582 (2.394968112309774) | > loss_disc_real_0: 0.6170051693916321 (0.2233358762330479) | > loss_disc_real_1: 0.2922569215297699 (0.22097882255911827) | > loss_disc_real_2: 0.28771260380744934 (0.21456245498524773) | > loss_disc_real_3: 0.3220692276954651 (0.27058563464217716) | > loss_disc_real_4: 0.22466857731342316 (0.19653361580438083) | > loss_disc_real_5: 0.29619887471199036 (0.24232297639052072) | > loss_0: 3.220707893371582 (2.394968112309774) | > grad_norm_0: tensor(2213.2131, device='cuda:0') (tensor(1145.9761, device='cuda:0')) | > loss_gen: 1.534188985824585 (2.5370649496714273) | > loss_kl: 0.4965934753417969 (1.2547649674945407) | > loss_feat: 0.09239855408668518 (6.048681990967856) | > loss_mel: 2.073458433151245 (21.152758677800495) | > loss_duration: 1.723239779472351 (1.7250779337353177) | > loss_1: 5.919878959655762 (32.71834913889567) | > grad_norm_1: tensor(45303.3711, device='cuda:0') (tensor(39688.6875, device='cuda:0')) | > current_lr_0: 0.00017369633150628823 | > current_lr_1: 0.00017369633150628823 | > step_time: 0.3154 (0.4942723645104302) | > loader_time: 0.0018 (0.012951532999674479)  --> TIME: 2023-10-20 01:11:51 -- STEP: 39/50 -- GLOBAL_STEP: 60090 | > loss_disc: 2.0923757553100586 (2.5176232930941462) | > loss_disc_real_0: 0.11163346469402313 (0.16830435543297195) | > loss_disc_real_1: 0.21596604585647583 (0.23468845137036765) | > loss_disc_real_2: 0.15286144614219666 (0.23825374302955774) | > loss_disc_real_3: 0.14023667573928833 (0.24804763056528875) | > loss_disc_real_4: 0.20374569296836853 (0.2404468348966195) | > loss_disc_real_5: 0.37552085518836975 (0.25975767484842205) | > loss_0: 2.0923757553100586 (2.5176232930941462) | > grad_norm_0: tensor(2213.1670, device='cuda:0') (tensor(1144.1208, device='cuda:0')) | > loss_gen: 2.8277335166931152 (2.43297627950326) | > loss_kl: 0.8005514144897461 (1.178302824497223) | > loss_feat: 5.769244194030762 (5.364055086022767) | > loss_mel: 24.03480339050293 (23.341504408763) | > loss_duration: 1.7792506217956543 (1.7257132163414588) | > loss_1: 35.21158218383789 (34.042551713112076) | > grad_norm_1: tensor(68298.9453, device='cuda:0') (tensor(38289.9141, device='cuda:0')) | > current_lr_0: 0.00017369633150628823 | > current_lr_1: 0.00017369633150628823 | > step_time: 0.5806 (0.5058283928113106) | > loader_time: 0.0255 (0.01326907598055326)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.5083296298980713 (3.5083296298980713) | > loss_disc_real_0: 0.2174099087715149 (0.2174099087715149) | > loss_disc_real_1: 0.3333890736103058 (0.3333890736103058) | > loss_disc_real_2: 0.24262969195842743 (0.24262969195842743) | > loss_disc_real_3: 0.31292834877967834 (0.31292834877967834) | > loss_disc_real_4: 0.18655991554260254 (0.18655991554260254) | > loss_disc_real_5: 0.33328965306282043 (0.33328965306282043) | > loss_0: 3.5083296298980713 (3.5083296298980713) | > loss_gen: 1.586160659790039 (1.586160659790039) | > loss_kl: 4.157661437988281 (4.157661437988281) | > loss_feat: 4.758694171905518 (4.758694171905518) | > loss_mel: 27.786888122558594 (27.786888122558594) | > loss_duration: 2.2044007778167725 (2.2044007778167725) | > loss_1: 40.493804931640625 (40.493804931640625)  --> STEP: 1 | > loss_disc: 2.3586044311523438 (2.3586044311523438) | > loss_disc_real_0: 0.05925282835960388 (0.05925282835960388) | > loss_disc_real_1: 0.1714545637369156 (0.1714545637369156) | > loss_disc_real_2: 0.09324473142623901 (0.09324473142623901) | > loss_disc_real_3: 0.19423475861549377 (0.19423475861549377) | > loss_disc_real_4: 0.030620399862527847 (0.030620399862527847) | > loss_disc_real_5: 0.15558920800685883 (0.15558920800685883) | > loss_0: 2.3586044311523438 (2.3586044311523438) | > loss_gen: 1.7423648834228516 (1.7423648834228516) | > loss_kl: 3.7396562099456787 (3.7396562099456787) | > loss_feat: 9.398890495300293 (9.398890495300293) | > loss_mel: 29.291431427001953 (29.291431427001953) | > loss_duration: 2.2863686084747314 (2.2863686084747314) | > loss_1: 46.458709716796875 (46.458709716796875)  --> STEP: 2 | > loss_disc: 2.665006637573242 (2.511805534362793) | > loss_disc_real_0: 0.47966718673706055 (0.2694600075483322) | > loss_disc_real_1: 0.3552125096321106 (0.2633335366845131) | > loss_disc_real_2: 0.23207373917102814 (0.16265923529863358) | > loss_disc_real_3: 0.2599742114543915 (0.22710448503494263) | > loss_disc_real_4: 0.16688622534275055 (0.0987533126026392) | > loss_disc_real_5: 0.12354091554880142 (0.13956506177783012) | > loss_0: 2.665006637573242 (2.511805534362793) | > loss_gen: 2.638357400894165 (2.1903611421585083) | > loss_kl: 2.3785901069641113 (3.059123158454895) | > loss_feat: 4.3179168701171875 (6.85840368270874) | > loss_mel: 29.01150131225586 (29.151466369628906) | > loss_duration: 2.2381367683410645 (2.262252688407898) | > loss_1: 40.584503173828125 (43.5216064453125)  --> STEP: 3 | > loss_disc: 3.022188186645508 (2.6819330851236978) | > loss_disc_real_0: 0.5397748351097107 (0.3595649500687917) | > loss_disc_real_1: 0.33348044753074646 (0.2867158402999242) | > loss_disc_real_2: 0.3636592924594879 (0.22965925435225168) | > loss_disc_real_3: 0.28011956810951233 (0.24477617939313254) | > loss_disc_real_4: 0.2740615904331207 (0.1571894052127997) | > loss_disc_real_5: 0.31861960887908936 (0.1992499108115832) | > loss_0: 3.022188186645508 (2.6819330851236978) | > loss_gen: 2.8121795654296875 (2.397633949915568) | > loss_kl: 1.6472525596618652 (2.5884996255238852) | > loss_feat: 1.8919639587402344 (5.202923774719238) | > loss_mel: 22.334060668945312 (26.878997802734375) | > loss_duration: 2.2783985137939453 (2.267634630203247) | > loss_1: 30.963855743408203 (39.335689544677734) --> EVAL PERFORMANCE | > avg_loader_time: 0.007463375727335612 (-0.0013162295023600263) | > avg_loss_disc: 2.6819330851236978 (-0.31204207738240575) | > avg_loss_disc_real_0: 0.3595649500687917 (+0.11089193324247995) | > avg_loss_disc_real_1: 0.2867158402999242 (-0.012061282992362976) | > avg_loss_disc_real_2: 0.22965925435225168 (-0.048262452085812896) | > avg_loss_disc_real_3: 0.24477617939313254 (-0.09993164738019308) | > avg_loss_disc_real_4: 0.1571894052127997 (-0.11814541493852934) | > avg_loss_disc_real_5: 0.1992499108115832 (-0.1696247681975365) | > avg_loss_0: 2.6819330851236978 (-0.31204207738240575) | > avg_loss_gen: 2.397633949915568 (+0.2812214692433672) | > avg_loss_kl: 2.5884996255238852 (+0.10610012213389108) | > avg_loss_feat: 5.202923774719238 (+2.6261540980388722) | > avg_loss_mel: 26.878997802734375 (+8.895765384038288) | > avg_loss_duration: 2.267634630203247 (-0.02248668670654297) | > avg_loss_1: 39.335689544677734 (+11.88675371805827)  > EPOCH: 142/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:12:05)   --> TIME: 2023-10-20 01:12:18 -- STEP: 19/50 -- GLOBAL_STEP: 60120 | > loss_disc: 2.937161922454834 (2.6767649399606803) | > loss_disc_real_0: 0.21908433735370636 (0.1970589314832499) | > loss_disc_real_1: 0.09310094267129898 (0.24525731409850873) | > loss_disc_real_2: 0.2329222857952118 (0.24645591723291496) | > loss_disc_real_3: 0.3885396718978882 (0.2406615610969694) | > loss_disc_real_4: 0.25416234135627747 (0.2308732982920973) | > loss_disc_real_5: 0.31901055574417114 (0.2674750524916147) | > loss_0: 2.937161922454834 (2.6767649399606803) | > grad_norm_0: tensor(2673.3213, device='cuda:0') (tensor(1509.4951, device='cuda:0')) | > loss_gen: 1.9028897285461426 (2.244028172994915) | > loss_kl: 1.0712867975234985 (1.1143841712098372) | > loss_feat: 2.249500036239624 (4.554645544016047) | > loss_mel: 22.667163848876953 (21.816387515319022) | > loss_duration: 1.8482531309127808 (1.7738766983935708) | > loss_1: 29.739093780517578 (31.503322400544818) | > grad_norm_1: tensor(14813.5283, device='cuda:0') (tensor(49563.3164, device='cuda:0')) | > current_lr_0: 0.00017352271114793184 | > current_lr_1: 0.00017352271114793184 | > step_time: 0.2528 (0.4776245292864348) | > loader_time: 0.0021 (0.0189618938847592)  --> TIME: 2023-10-20 01:12:31 -- STEP: 49/50 -- GLOBAL_STEP: 60150 | > loss_disc: 2.6815521717071533 (2.528671074886712) | > loss_disc_real_0: 0.22792382538318634 (0.20071432781310714) | > loss_disc_real_1: 0.3000728189945221 (0.23002910340318874) | > loss_disc_real_2: 0.23757939040660858 (0.22559752558567087) | > loss_disc_real_3: 0.3130880892276764 (0.22808321033205306) | > loss_disc_real_4: 0.14246505498886108 (0.2125427409322286) | > loss_disc_real_5: 0.31480905413627625 (0.2237385076527693) | > loss_0: 2.6815521717071533 (2.528671074886712) | > grad_norm_0: tensor(853.8362, device='cuda:0') (tensor(1248.1893, device='cuda:0')) | > loss_gen: 2.112816095352173 (2.3303111426684326) | > loss_kl: 0.7587277889251709 (1.0611683142428496) | > loss_feat: 2.3462061882019043 (4.958395254627174) | > loss_mel: 28.760234832763672 (23.317959167519394) | > loss_duration: 1.7928122282028198 (1.7248783306199678) | > loss_1: 35.77079772949219 (33.392712466570806) | > grad_norm_1: tensor(19399.5176, device='cuda:0') (tensor(40291.7227, device='cuda:0')) | > current_lr_0: 0.00017352271114793184 | > current_lr_1: 0.00017352271114793184 | > step_time: 0.6787 (0.4269412780294613) | > loader_time: 0.3031 (0.018660735110847315)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.809537887573242 (2.809537887573242) | > loss_disc_real_0: 0.18340115249156952 (0.18340115249156952) | > loss_disc_real_1: 0.3366355001926422 (0.3366355001926422) | > loss_disc_real_2: 0.23085804283618927 (0.23085804283618927) | > loss_disc_real_3: 0.47073227167129517 (0.47073227167129517) | > loss_disc_real_4: 0.21283994615077972 (0.21283994615077972) | > loss_disc_real_5: 0.2843848466873169 (0.2843848466873169) | > loss_0: 2.809537887573242 (2.809537887573242) | > loss_gen: 2.346400260925293 (2.346400260925293) | > loss_kl: 1.9415438175201416 (1.9415438175201416) | > loss_feat: 4.937864780426025 (4.937864780426025) | > loss_mel: 21.248016357421875 (21.248016357421875) | > loss_duration: 2.0844571590423584 (2.0844571590423584) | > loss_1: 32.558284759521484 (32.558284759521484)  --> STEP: 1 | > loss_disc: 2.1956677436828613 (2.1956677436828613) | > loss_disc_real_0: 0.30903515219688416 (0.30903515219688416) | > loss_disc_real_1: 0.3310708701610565 (0.3310708701610565) | > loss_disc_real_2: 0.17315559089183807 (0.17315559089183807) | > loss_disc_real_3: 0.296550452709198 (0.296550452709198) | > loss_disc_real_4: 0.31195229291915894 (0.31195229291915894) | > loss_disc_real_5: 0.13974465429782867 (0.13974465429782867) | > loss_0: 2.1956677436828613 (2.1956677436828613) | > loss_gen: 3.0720138549804688 (3.0720138549804688) | > loss_kl: 2.5899693965911865 (2.5899693965911865) | > loss_feat: 6.426844120025635 (6.426844120025635) | > loss_mel: 24.32072639465332 (24.32072639465332) | > loss_duration: 2.2656331062316895 (2.2656331062316895) | > loss_1: 38.67518615722656 (38.67518615722656)  --> STEP: 2 | > loss_disc: 2.277169942855835 (2.236418843269348) | > loss_disc_real_0: 0.1332911252975464 (0.22116313874721527) | > loss_disc_real_1: 0.1742076426744461 (0.2526392564177513) | > loss_disc_real_2: 0.25432920455932617 (0.21374239772558212) | > loss_disc_real_3: 0.4265443980693817 (0.36154742538928986) | > loss_disc_real_4: 0.3146750032901764 (0.31331364810466766) | > loss_disc_real_5: 0.311938613653183 (0.22584163397550583) | > loss_0: 2.277169942855835 (2.236418843269348) | > loss_gen: 3.137664318084717 (3.1048390865325928) | > loss_kl: 3.1184041500091553 (2.854186773300171) | > loss_feat: 5.7424635887146 (6.084653854370117) | > loss_mel: 31.599090576171875 (27.959908485412598) | > loss_duration: 2.1956188678741455 (2.2306259870529175) | > loss_1: 45.79323959350586 (42.23421287536621)  --> STEP: 3 | > loss_disc: 3.2211313247680664 (2.5646563371022544) | > loss_disc_real_0: 0.24998584389686584 (0.23077070713043213) | > loss_disc_real_1: 0.3781731426715851 (0.29448388516902924) | > loss_disc_real_2: 0.32865914702415466 (0.2520479808251063) | > loss_disc_real_3: 0.3237577974796295 (0.3489508827527364) | > loss_disc_real_4: 0.30063703656196594 (0.3090881109237671) | > loss_disc_real_5: 0.2965720295906067 (0.24941843251387277) | > loss_0: 3.2211313247680664 (2.5646563371022544) | > loss_gen: 1.7484508752822876 (2.652709682782491) | > loss_kl: 1.483809232711792 (2.3973942597707114) | > loss_feat: 1.4982457160949707 (4.555851141611735) | > loss_mel: 21.31387710571289 (25.744564692179363) | > loss_duration: 2.1688144207000732 (2.2100221316019693) | > loss_1: 28.213197708129883 (37.5605411529541) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031119187672932944 (-0.004351456960042318) | > avg_loss_disc: 2.5646563371022544 (-0.11727674802144339) | > avg_loss_disc_real_0: 0.23077070713043213 (-0.12879424293835956) | > avg_loss_disc_real_1: 0.29448388516902924 (+0.00776804486910504) | > avg_loss_disc_real_2: 0.2520479808251063 (+0.022388726472854642) | > avg_loss_disc_real_3: 0.3489508827527364 (+0.10417470335960385) | > avg_loss_disc_real_4: 0.3090881109237671 (+0.1518987057109674) | > avg_loss_disc_real_5: 0.24941843251387277 (+0.05016852170228958) | > avg_loss_0: 2.5646563371022544 (-0.11727674802144339) | > avg_loss_gen: 2.652709682782491 (+0.2550757328669233) | > avg_loss_kl: 2.3973942597707114 (-0.19110536575317383) | > avg_loss_feat: 4.555851141611735 (-0.647072633107503) | > avg_loss_mel: 25.744564692179363 (-1.1344331105550118) | > avg_loss_duration: 2.2100221316019693 (-0.05761249860127782) | > avg_loss_1: 37.5605411529541 (-1.7751483917236328)  > EPOCH: 143/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:12:43)   --> TIME: 2023-10-20 01:13:03 -- STEP: 29/50 -- GLOBAL_STEP: 60180 | > loss_disc: 2.4982733726501465 (2.282918543651186) | > loss_disc_real_0: 0.18731960654258728 (0.15318048764662495) | > loss_disc_real_1: 0.24277149140834808 (0.2166094601411244) | > loss_disc_real_2: 0.16440489888191223 (0.22497411194289552) | > loss_disc_real_3: 0.2582506537437439 (0.22893609761677938) | > loss_disc_real_4: 0.1616770476102829 (0.1924524768416224) | > loss_disc_real_5: 0.15794877707958221 (0.19400146600372833) | > loss_0: 2.4982733726501465 (2.282918543651186) | > grad_norm_0: tensor(397.7475, device='cuda:0') (tensor(1202.4861, device='cuda:0')) | > loss_gen: 2.041938543319702 (2.5934632482199826) | > loss_kl: 0.6424123644828796 (0.9570733863731911) | > loss_feat: 3.356729030609131 (6.330982706413187) | > loss_mel: 15.172016143798828 (24.55215257611768) | > loss_duration: 1.7278205156326294 (1.743517542707509) | > loss_1: 22.94091796875 (36.177189300800194) | > grad_norm_1: tensor(60104.6055, device='cuda:0') (tensor(55992.8672, device='cuda:0')) | > current_lr_0: 0.00017334926433399393 | > current_lr_1: 0.00017334926433399393 | > step_time: 0.2874 (0.506848540799371) | > loader_time: 0.0248 (0.020664938564958244)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8463587760925293 (2.8463587760925293) | > loss_disc_real_0: 0.13314944505691528 (0.13314944505691528) | > loss_disc_real_1: 0.28937602043151855 (0.28937602043151855) | > loss_disc_real_2: 0.2759746313095093 (0.2759746313095093) | > loss_disc_real_3: 0.291204035282135 (0.291204035282135) | > loss_disc_real_4: 0.24302761256694794 (0.24302761256694794) | > loss_disc_real_5: 0.30721360445022583 (0.30721360445022583) | > loss_0: 2.8463587760925293 (2.8463587760925293) | > loss_gen: 1.7374616861343384 (1.7374616861343384) | > loss_kl: 1.971392035484314 (1.971392035484314) | > loss_feat: 0.9669346213340759 (0.9669346213340759) | > loss_mel: 18.08428192138672 (18.08428192138672) | > loss_duration: 2.1497888565063477 (2.1497888565063477) | > loss_1: 24.90985870361328 (24.90985870361328)  --> STEP: 1 | > loss_disc: 2.3330209255218506 (2.3330209255218506) | > loss_disc_real_0: 0.028431199491024017 (0.028431199491024017) | > loss_disc_real_1: 0.1409488022327423 (0.1409488022327423) | > loss_disc_real_2: 0.15488408505916595 (0.15488408505916595) | > loss_disc_real_3: 0.15989366173744202 (0.15989366173744202) | > loss_disc_real_4: 0.18320879340171814 (0.18320879340171814) | > loss_disc_real_5: 0.26693400740623474 (0.26693400740623474) | > loss_0: 2.3330209255218506 (2.3330209255218506) | > loss_gen: 2.0132999420166016 (2.0132999420166016) | > loss_kl: 2.2961301803588867 (2.2961301803588867) | > loss_feat: 6.46126651763916 (6.46126651763916) | > loss_mel: 25.965545654296875 (25.965545654296875) | > loss_duration: 2.272885322570801 (2.272885322570801) | > loss_1: 39.00912857055664 (39.00912857055664)  --> STEP: 2 | > loss_disc: 1.9770745038986206 (2.1550477147102356) | > loss_disc_real_0: 0.08911626785993576 (0.05877373367547989) | > loss_disc_real_1: 0.07916031777858734 (0.11005456000566483) | > loss_disc_real_2: 0.12045890837907791 (0.13767149671912193) | > loss_disc_real_3: 0.06396220624446869 (0.11192793399095535) | > loss_disc_real_4: 0.19371727108955383 (0.188463032245636) | > loss_disc_real_5: 0.11242814362049103 (0.18968107551336288) | > loss_0: 1.9770745038986206 (2.1550477147102356) | > loss_gen: 2.35376238822937 (2.183531165122986) | > loss_kl: 2.6255950927734375 (2.460862636566162) | > loss_feat: 11.622096061706543 (9.041681289672852) | > loss_mel: 25.94478988647461 (25.955167770385742) | > loss_duration: 2.241664171218872 (2.2572747468948364) | > loss_1: 44.78791046142578 (41.89851951599121)  --> STEP: 3 | > loss_disc: 2.260685682296753 (2.190260370572408) | > loss_disc_real_0: 0.12209927290678024 (0.07988224675258) | > loss_disc_real_1: 0.2959444522857666 (0.17201785743236542) | > loss_disc_real_2: 0.22088786959648132 (0.16541028767824173) | > loss_disc_real_3: 0.3139081299304962 (0.1792546659708023) | > loss_disc_real_4: 0.11528607457876205 (0.16407071302334467) | > loss_disc_real_5: 0.13331562280654907 (0.17089259127775827) | > loss_0: 2.260685682296753 (2.190260370572408) | > loss_gen: 2.1902503967285156 (2.1857709089914956) | > loss_kl: 1.2568025588989258 (2.05950927734375) | > loss_feat: 2.897923231124878 (6.993761936823527) | > loss_mel: 22.70600128173828 (24.872112274169922) | > loss_duration: 2.2633204460144043 (2.2592899799346924) | > loss_1: 31.314298629760742 (38.37044588724772) --> EVAL PERFORMANCE | > avg_loader_time: 0.005702892939249675 (+0.0025909741719563804) | > avg_loss_disc: 2.190260370572408 (-0.3743959665298462) | > avg_loss_disc_real_0: 0.07988224675258 (-0.15088846037785214) | > avg_loss_disc_real_1: 0.17201785743236542 (-0.12246602773666382) | > avg_loss_disc_real_2: 0.16541028767824173 (-0.08663769314686459) | > avg_loss_disc_real_3: 0.1792546659708023 (-0.16969621678193408) | > avg_loss_disc_real_4: 0.16407071302334467 (-0.14501739790042242) | > avg_loss_disc_real_5: 0.17089259127775827 (-0.0785258412361145) | > avg_loss_0: 2.190260370572408 (-0.3743959665298462) | > avg_loss_gen: 2.1857709089914956 (-0.4669387737909956) | > avg_loss_kl: 2.05950927734375 (-0.3378849824269614) | > avg_loss_feat: 6.993761936823527 (+2.437910795211792) | > avg_loss_mel: 24.872112274169922 (-0.8724524180094413) | > avg_loss_duration: 2.2592899799346924 (+0.04926784833272313) | > avg_loss_1: 38.37044588724772 (+0.8099047342936174)  > EPOCH: 144/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:13:24)   --> TIME: 2023-10-20 01:13:32 -- STEP: 9/50 -- GLOBAL_STEP: 60210 | > loss_disc: 2.823117256164551 (2.4993045330047607) | > loss_disc_real_0: 0.14765530824661255 (0.17780260865887007) | > loss_disc_real_1: 0.2872205078601837 (0.2460245903995302) | > loss_disc_real_2: 0.2739674746990204 (0.24710311895857254) | > loss_disc_real_3: 0.3008676767349243 (0.23862269644935927) | > loss_disc_real_4: 0.21281619369983673 (0.24455226212739944) | > loss_disc_real_5: 0.2562616169452667 (0.23748420675595602) | > loss_0: 2.823117256164551 (2.4993045330047607) | > grad_norm_0: tensor(3687.8474, device='cuda:0') (tensor(1634.3248, device='cuda:0')) | > loss_gen: 1.7311979532241821 (2.5452465613683066) | > loss_kl: 1.0211660861968994 (1.166995432641771) | > loss_feat: 0.7927278280258179 (5.984196702639262) | > loss_mel: 7.247954368591309 (22.477824846903484) | > loss_duration: 1.653263807296753 (1.7422774765226576) | > loss_1: 12.446310997009277 (33.91654131147597) | > grad_norm_1: tensor(21923.1113, device='cuda:0') (tensor(51847.8047, device='cuda:0')) | > current_lr_0: 0.0001731759908910059 | > current_lr_1: 0.0001731759908910059 | > step_time: 0.4153 (0.43432047632005477) | > loader_time: 0.0097 (0.01176762580871582)  --> TIME: 2023-10-20 01:13:49 -- STEP: 39/50 -- GLOBAL_STEP: 60240 | > loss_disc: 2.2483158111572266 (2.463267757342412) | > loss_disc_real_0: 0.06231649965047836 (0.14470433639601255) | > loss_disc_real_1: 0.09684182703495026 (0.22479163091152143) | > loss_disc_real_2: 0.11743339896202087 (0.2432417652498071) | > loss_disc_real_3: 0.2480565458536148 (0.23723124913298166) | > loss_disc_real_4: 0.10603874176740646 (0.21543380121390024) | > loss_disc_real_5: 0.19892655313014984 (0.23495236330498487) | > loss_0: 2.2483158111572266 (2.463267757342412) | > grad_norm_0: tensor(1834.5085, device='cuda:0') (tensor(1697.6533, device='cuda:0')) | > loss_gen: 2.332803964614868 (2.4882347033574033) | > loss_kl: 0.6239143013954163 (1.0016993834422185) | > loss_feat: 6.7263407707214355 (5.518160107999276) | > loss_mel: 24.497255325317383 (24.296350454672787) | > loss_duration: 1.774893045425415 (1.7314859934342213) | > loss_1: 35.9552116394043 (35.03593090252999) | > grad_norm_1: tensor(64897.2539, device='cuda:0') (tensor(48994.5312, device='cuda:0')) | > current_lr_0: 0.0001731759908910059 | > current_lr_1: 0.0001731759908910059 | > step_time: 0.3191 (0.5068153784825253) | > loader_time: 0.0249 (0.014392779423640324)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9912469387054443 (1.9912469387054443) | > loss_disc_real_0: 0.045246534049510956 (0.045246534049510956) | > loss_disc_real_1: 0.047311849892139435 (0.047311849892139435) | > loss_disc_real_2: 0.1443127542734146 (0.1443127542734146) | > loss_disc_real_3: 0.16097213327884674 (0.16097213327884674) | > loss_disc_real_4: 0.061373304575681686 (0.061373304575681686) | > loss_disc_real_5: 0.0991390272974968 (0.0991390272974968) | > loss_0: 1.9912469387054443 (1.9912469387054443) | > loss_gen: 2.1080470085144043 (2.1080470085144043) | > loss_kl: 1.6679154634475708 (1.6679154634475708) | > loss_feat: 10.119406700134277 (10.119406700134277) | > loss_mel: 26.515716552734375 (26.515716552734375) | > loss_duration: 2.156243324279785 (2.156243324279785) | > loss_1: 42.56732940673828 (42.56732940673828)  --> STEP: 1 | > loss_disc: 2.834379196166992 (2.834379196166992) | > loss_disc_real_0: 0.08533070236444473 (0.08533070236444473) | > loss_disc_real_1: 0.4559592604637146 (0.4559592604637146) | > loss_disc_real_2: 0.38882356882095337 (0.38882356882095337) | > loss_disc_real_3: 0.34178486466407776 (0.34178486466407776) | > loss_disc_real_4: 0.43002596497535706 (0.43002596497535706) | > loss_disc_real_5: 0.27343130111694336 (0.27343130111694336) | > loss_0: 2.834379196166992 (2.834379196166992) | > loss_gen: 2.669726848602295 (2.669726848602295) | > loss_kl: 2.6524393558502197 (2.6524393558502197) | > loss_feat: 5.394044399261475 (5.394044399261475) | > loss_mel: 29.931711196899414 (29.931711196899414) | > loss_duration: 2.2672455310821533 (2.2672455310821533) | > loss_1: 42.91516876220703 (42.91516876220703)  --> STEP: 2 | > loss_disc: 1.9514216184616089 (2.3929004073143005) | > loss_disc_real_0: 0.06678186357021332 (0.07605628296732903) | > loss_disc_real_1: 0.11911510676145554 (0.28753718361258507) | > loss_disc_real_2: 0.1334681659936905 (0.26114586740732193) | > loss_disc_real_3: 0.12548476457595825 (0.233634814620018) | > loss_disc_real_4: 0.09315003454685211 (0.2615879997611046) | > loss_disc_real_5: 0.06924606114625931 (0.17133868113160133) | > loss_0: 1.9514216184616089 (2.3929004073143005) | > loss_gen: 2.472076892852783 (2.570901870727539) | > loss_kl: 2.7185370922088623 (2.685488224029541) | > loss_feat: 10.325502395629883 (7.859773397445679) | > loss_mel: 26.424959182739258 (28.178335189819336) | > loss_duration: 2.3471522331237793 (2.3071988821029663) | > loss_1: 44.28822708129883 (43.60169792175293)  --> STEP: 3 | > loss_disc: 3.1754279136657715 (2.6537429094314575) | > loss_disc_real_0: 0.08516024053096771 (0.07909093548854192) | > loss_disc_real_1: 0.2520153820514679 (0.2756965830922127) | > loss_disc_real_2: 0.22305133938789368 (0.24844769140084585) | > loss_disc_real_3: 0.26939111948013306 (0.24555358290672302) | > loss_disc_real_4: 0.1409367322921753 (0.22137091060479483) | > loss_disc_real_5: 0.23903155326843262 (0.19390297184387842) | > loss_0: 3.1754279136657715 (2.6537429094314575) | > loss_gen: 1.1802231073379517 (2.10734228293101) | > loss_kl: 1.4841564893722534 (2.285044312477112) | > loss_feat: 0.22746481001377106 (5.315670534968376) | > loss_mel: 3.6001803874969482 (19.98561692237854) | > loss_duration: 2.36281681060791 (2.3257381916046143) | > loss_1: 8.854841232299805 (32.01941235860189) --> EVAL PERFORMANCE | > avg_loader_time: 0.01043995221455892 (+0.004737059275309245) | > avg_loss_disc: 2.6537429094314575 (+0.46348253885904933) | > avg_loss_disc_real_0: 0.07909093548854192 (-0.0007913112640380859) | > avg_loss_disc_real_1: 0.2756965830922127 (+0.10367872565984726) | > avg_loss_disc_real_2: 0.24844769140084585 (+0.08303740372260413) | > avg_loss_disc_real_3: 0.24555358290672302 (+0.06629891693592072) | > avg_loss_disc_real_4: 0.22137091060479483 (+0.05730019758145016) | > avg_loss_disc_real_5: 0.19390297184387842 (+0.023010380566120148) | > avg_loss_0: 2.6537429094314575 (+0.46348253885904933) | > avg_loss_gen: 2.10734228293101 (-0.07842862606048584) | > avg_loss_kl: 2.285044312477112 (+0.22553503513336182) | > avg_loss_feat: 5.315670534968376 (-1.6780914018551512) | > avg_loss_mel: 19.98561692237854 (-4.886495351791382) | > avg_loss_duration: 2.3257381916046143 (+0.06644821166992188) | > avg_loss_1: 32.01941235860189 (-6.351033528645829)  > EPOCH: 145/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:14:02)   --> TIME: 2023-10-20 01:14:15 -- STEP: 19/50 -- GLOBAL_STEP: 60270 | > loss_disc: 1.7118885517120361 (2.587904647776955) | > loss_disc_real_0: 0.043938715010881424 (0.18847747093164607) | > loss_disc_real_1: 0.16035310924053192 (0.2441746964070358) | > loss_disc_real_2: 0.11336009204387665 (0.23479731733861722) | > loss_disc_real_3: 0.013539246283471584 (0.2307869407201284) | > loss_disc_real_4: 0.27103662490844727 (0.24762263188236638) | > loss_disc_real_5: 0.08105530589818954 (0.2485267683177402) | > loss_0: 1.7118885517120361 (2.587904647776955) | > grad_norm_0: tensor(838.5857, device='cuda:0') (tensor(1102.6898, device='cuda:0')) | > loss_gen: 2.565186023712158 (2.2444061040878296) | > loss_kl: 1.049439787864685 (1.060348906015095) | > loss_feat: 10.474569320678711 (4.429568277769968) | > loss_mel: 28.177570343017578 (23.307705640792847) | > loss_duration: 1.8266191482543945 (1.7358107441350032) | > loss_1: 44.0933837890625 (32.77783981122469) | > grad_norm_1: tensor(74727.5156, device='cuda:0') (tensor(43145.4102, device='cuda:0')) | > current_lr_0: 0.00017300289064567267 | > current_lr_1: 0.00017300289064567267 | > step_time: 0.3628 (0.4921110931195711) | > loader_time: 0.0025 (0.01789781921788266)  --> TIME: 2023-10-20 01:14:28 -- STEP: 49/50 -- GLOBAL_STEP: 60300 | > loss_disc: 3.270569086074829 (2.6286878585815434) | > loss_disc_real_0: 0.7108625769615173 (0.17598785355459062) | > loss_disc_real_1: 0.3154109716415405 (0.23724225798279655) | > loss_disc_real_2: 0.26729509234428406 (0.22400188552481787) | > loss_disc_real_3: 0.3440976142883301 (0.23947521829407434) | > loss_disc_real_4: 0.30873605608940125 (0.23685998416372708) | > loss_disc_real_5: 0.40122056007385254 (0.24959758982746574) | > loss_0: 3.270569086074829 (2.6286878585815434) | > grad_norm_0: tensor(3440.9187, device='cuda:0') (tensor(1223.9913, device='cuda:0')) | > loss_gen: 2.868469476699829 (2.2217017071587697) | > loss_kl: 0.746338963508606 (1.0221025469351788) | > loss_feat: 1.7519352436065674 (4.2238726643275255) | > loss_mel: 28.258678436279297 (23.215749862242724) | > loss_duration: 1.8147239685058594 (1.7054697469789155) | > loss_1: 35.440147399902344 (32.388896650197566) | > grad_norm_1: tensor(9330.3486, device='cuda:0') (tensor(36271.7070, device='cuda:0')) | > current_lr_0: 0.00017300289064567267 | > current_lr_1: 0.00017300289064567267 | > step_time: 0.6662 (0.4423060903743822) | > loader_time: 0.3203 (0.01861453542903978)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3625402450561523 (2.3625402450561523) | > loss_disc_real_0: 0.33559268712997437 (0.33559268712997437) | > loss_disc_real_1: 0.15283295512199402 (0.15283295512199402) | > loss_disc_real_2: 0.13082951307296753 (0.13082951307296753) | > loss_disc_real_3: 0.19242289662361145 (0.19242289662361145) | > loss_disc_real_4: 0.2487771213054657 (0.2487771213054657) | > loss_disc_real_5: 0.2326911985874176 (0.2326911985874176) | > loss_0: 2.3625402450561523 (2.3625402450561523) | > loss_gen: 2.599914073944092 (2.599914073944092) | > loss_kl: 2.0918242931365967 (2.0918242931365967) | > loss_feat: 6.450001239776611 (6.450001239776611) | > loss_mel: 23.56459617614746 (23.56459617614746) | > loss_duration: 2.2448716163635254 (2.2448716163635254) | > loss_1: 36.951210021972656 (36.951210021972656)  --> STEP: 1 | > loss_disc: 2.0486905574798584 (2.0486905574798584) | > loss_disc_real_0: 0.28757259249687195 (0.28757259249687195) | > loss_disc_real_1: 0.17980124056339264 (0.17980124056339264) | > loss_disc_real_2: 0.07418767362833023 (0.07418767362833023) | > loss_disc_real_3: 0.13562209904193878 (0.13562209904193878) | > loss_disc_real_4: 0.1449456512928009 (0.1449456512928009) | > loss_disc_real_5: 0.21286416053771973 (0.21286416053771973) | > loss_0: 2.0486905574798584 (2.0486905574798584) | > loss_gen: 3.548341751098633 (3.548341751098633) | > loss_kl: 3.288226366043091 (3.288226366043091) | > loss_feat: 8.814103126525879 (8.814103126525879) | > loss_mel: 24.206262588500977 (24.206262588500977) | > loss_duration: 2.287562131881714 (2.287562131881714) | > loss_1: 42.14449691772461 (42.14449691772461)  --> STEP: 2 | > loss_disc: 1.6874202489852905 (1.8680554032325745) | > loss_disc_real_0: 0.017526403069496155 (0.15254949778318405) | > loss_disc_real_1: 0.06076955050230026 (0.12028539553284645) | > loss_disc_real_2: 0.024743307381868362 (0.0494654905050993) | > loss_disc_real_3: 0.038481730967760086 (0.08705191500484943) | > loss_disc_real_4: 0.052605461329221725 (0.09877555631101131) | > loss_disc_real_5: 0.054768119007349014 (0.13381613977253437) | > loss_0: 1.6874202489852905 (1.8680554032325745) | > loss_gen: 2.203986406326294 (2.8761640787124634) | > loss_kl: 3.0368118286132812 (3.162519097328186) | > loss_feat: 15.13858413696289 (11.976343631744385) | > loss_mel: 26.871164321899414 (25.538713455200195) | > loss_duration: 2.412606716156006 (2.35008442401886) | > loss_1: 49.66315460205078 (45.903825759887695)  --> STEP: 3 | > loss_disc: 2.6969902515411377 (2.1443670193354287) | > loss_disc_real_0: 0.4325523376464844 (0.2458837777376175) | > loss_disc_real_1: 0.28391751646995544 (0.17482943584521612) | > loss_disc_real_2: 0.22245186567306519 (0.10712761556108792) | > loss_disc_real_3: 0.3150586783885956 (0.16305416946609816) | > loss_disc_real_4: 0.29597118496894836 (0.16450743253032366) | > loss_disc_real_5: 0.21145443618297577 (0.15969557190934816) | > loss_0: 2.6969902515411377 (2.1443670193354287) | > loss_gen: 2.8297717571258545 (2.8606999715169272) | > loss_kl: 1.0483566522598267 (2.4577982823053994) | > loss_feat: 4.391284942626953 (9.447990735371908) | > loss_mel: 21.485374450683594 (24.18760045369466) | > loss_duration: 2.269974946975708 (2.323381265004476) | > loss_1: 32.02476119995117 (41.27747090657552) --> EVAL PERFORMANCE | > avg_loader_time: 0.010151147842407227 (-0.0002888043721516933) | > avg_loss_disc: 2.1443670193354287 (-0.5093758900960288) | > avg_loss_disc_real_0: 0.2458837777376175 (+0.1667928422490756) | > avg_loss_disc_real_1: 0.17482943584521612 (-0.10086714724699655) | > avg_loss_disc_real_2: 0.10712761556108792 (-0.14132007583975792) | > avg_loss_disc_real_3: 0.16305416946609816 (-0.08249941344062486) | > avg_loss_disc_real_4: 0.16450743253032366 (-0.056863478074471174) | > avg_loss_disc_real_5: 0.15969557190934816 (-0.03420739993453026) | > avg_loss_0: 2.1443670193354287 (-0.5093758900960288) | > avg_loss_gen: 2.8606999715169272 (+0.7533576885859175) | > avg_loss_kl: 2.4577982823053994 (+0.1727539698282876) | > avg_loss_feat: 9.447990735371908 (+4.132320200403532) | > avg_loss_mel: 24.18760045369466 (+4.20198353131612) | > avg_loss_duration: 2.323381265004476 (-0.0023569266001381983) | > avg_loss_1: 41.27747090657552 (+9.258058547973633)  > EPOCH: 146/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:14:40)   --> TIME: 2023-10-20 01:14:59 -- STEP: 29/50 -- GLOBAL_STEP: 60330 | > loss_disc: 2.5602705478668213 (2.422007059228832) | > loss_disc_real_0: 0.10985090583562851 (0.1746244102331071) | > loss_disc_real_1: 0.28377529978752136 (0.213698940158918) | > loss_disc_real_2: 0.2572714388370514 (0.21534131454496547) | > loss_disc_real_3: 0.32280492782592773 (0.21554821357131004) | > loss_disc_real_4: 0.17600148916244507 (0.21578807236048683) | > loss_disc_real_5: 0.16652370989322662 (0.20982633508613396) | > loss_0: 2.5602705478668213 (2.422007059228832) | > grad_norm_0: tensor(691.0722, device='cuda:0') (tensor(1080.8622, device='cuda:0')) | > loss_gen: 1.883862018585205 (2.3677448486459665) | > loss_kl: 0.8627989888191223 (1.15437938427103) | > loss_feat: 1.5491549968719482 (5.08081070796169) | > loss_mel: 19.726795196533203 (23.85233392386601) | > loss_duration: 1.7079938650131226 (1.7484910570341965) | > loss_1: 25.73060417175293 (34.203759324961695) | > grad_norm_1: tensor(11842.6250, device='cuda:0') (tensor(45123.2578, device='cuda:0')) | > current_lr_0: 0.00017282996342487237 | > current_lr_1: 0.00017282996342487237 | > step_time: 0.562 (0.4829220936216157) | > loader_time: 0.0181 (0.021046605603448277)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4935288429260254 (2.4935288429260254) | > loss_disc_real_0: 0.16258911788463593 (0.16258911788463593) | > loss_disc_real_1: 0.2931500971317291 (0.2931500971317291) | > loss_disc_real_2: 0.1753532737493515 (0.1753532737493515) | > loss_disc_real_3: 0.47897014021873474 (0.47897014021873474) | > loss_disc_real_4: 0.12034542858600616 (0.12034542858600616) | > loss_disc_real_5: 0.3211320638656616 (0.3211320638656616) | > loss_0: 2.4935288429260254 (2.4935288429260254) | > loss_gen: 2.503255844116211 (2.503255844116211) | > loss_kl: 1.9974148273468018 (1.9974148273468018) | > loss_feat: 6.700012683868408 (6.700012683868408) | > loss_mel: 24.869400024414062 (24.869400024414062) | > loss_duration: 2.1669466495513916 (2.1669466495513916) | > loss_1: 38.237030029296875 (38.237030029296875)  --> STEP: 1 | > loss_disc: 2.9659695625305176 (2.9659695625305176) | > loss_disc_real_0: 0.2172999233007431 (0.2172999233007431) | > loss_disc_real_1: 0.29278114438056946 (0.29278114438056946) | > loss_disc_real_2: 0.2570315897464752 (0.2570315897464752) | > loss_disc_real_3: 0.33076211810112 (0.33076211810112) | > loss_disc_real_4: 0.2524167597293854 (0.2524167597293854) | > loss_disc_real_5: 0.22408737242221832 (0.22408737242221832) | > loss_0: 2.9659695625305176 (2.9659695625305176) | > loss_gen: 1.6280595064163208 (1.6280595064163208) | > loss_kl: 2.4977853298187256 (2.4977853298187256) | > loss_feat: 0.1351568102836609 (0.1351568102836609) | > loss_mel: 12.271206855773926 (12.271206855773926) | > loss_duration: 2.325796127319336 (2.325796127319336) | > loss_1: 18.85800552368164 (18.85800552368164)  --> STEP: 2 | > loss_disc: 1.7332563400268555 (2.3496129512786865) | > loss_disc_real_0: 0.1163211390376091 (0.1668105311691761) | > loss_disc_real_1: 0.07145993411540985 (0.18212053924798965) | > loss_disc_real_2: 0.08676182478666306 (0.17189670726656914) | > loss_disc_real_3: 0.1320490688085556 (0.2314055934548378) | > loss_disc_real_4: 0.05968916043639183 (0.1560529600828886) | > loss_disc_real_5: 0.19108140468597412 (0.20758438855409622) | > loss_0: 1.7332563400268555 (2.3496129512786865) | > loss_gen: 2.5938720703125 (2.1109657883644104) | > loss_kl: 2.90864634513855 (2.7032158374786377) | > loss_feat: 11.417665481567383 (5.776411145925522) | > loss_mel: 26.892589569091797 (19.58189821243286) | > loss_duration: 2.2567992210388184 (2.291297674179077) | > loss_1: 46.06957244873047 (32.463788986206055)  --> STEP: 3 | > loss_disc: 2.7069129943847656 (2.4687129656473794) | > loss_disc_real_0: 0.07666590064764023 (0.1367623209953308) | > loss_disc_real_1: 0.34014272689819336 (0.23479460179805756) | > loss_disc_real_2: 0.3972927927970886 (0.2470287357767423) | > loss_disc_real_3: 0.4065546691417694 (0.289788618683815) | > loss_disc_real_4: 0.28295430541038513 (0.19835340852538744) | > loss_disc_real_5: 0.28432273864746094 (0.2331638385852178) | > loss_0: 2.7069129943847656 (2.4687129656473794) | > loss_gen: 2.357038974761963 (2.1929901838302612) | > loss_kl: 1.5369127988815308 (2.3144481579462686) | > loss_feat: 2.394193649291992 (4.649005313714345) | > loss_mel: 21.048521041870117 (20.070772488911945) | > loss_duration: 2.285994052886963 (2.289529800415039) | > loss_1: 29.62265968322754 (31.516745885213215) --> EVAL PERFORMANCE | > avg_loader_time: 0.012435118357340494 (+0.0022839705149332677) | > avg_loss_disc: 2.4687129656473794 (+0.3243459463119507) | > avg_loss_disc_real_0: 0.1367623209953308 (-0.10912145674228668) | > avg_loss_disc_real_1: 0.23479460179805756 (+0.05996516595284143) | > avg_loss_disc_real_2: 0.2470287357767423 (+0.13990112021565437) | > avg_loss_disc_real_3: 0.289788618683815 (+0.12673444921771684) | > avg_loss_disc_real_4: 0.19835340852538744 (+0.03384597599506378) | > avg_loss_disc_real_5: 0.2331638385852178 (+0.07346826667586964) | > avg_loss_0: 2.4687129656473794 (+0.3243459463119507) | > avg_loss_gen: 2.1929901838302612 (-0.667709787686666) | > avg_loss_kl: 2.3144481579462686 (-0.14335012435913086) | > avg_loss_feat: 4.649005313714345 (-4.798985421657563) | > avg_loss_mel: 20.070772488911945 (-4.116827964782715) | > avg_loss_duration: 2.289529800415039 (-0.033851464589437) | > avg_loss_1: 31.516745885213215 (-9.760725021362308)  > EPOCH: 147/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:15:21)   --> TIME: 2023-10-20 01:15:29 -- STEP: 9/50 -- GLOBAL_STEP: 60360 | > loss_disc: 3.165086030960083 (2.472572088241577) | > loss_disc_real_0: 0.5205275416374207 (0.2078049952785174) | > loss_disc_real_1: 0.42749667167663574 (0.19946437060005134) | > loss_disc_real_2: 0.5001512169837952 (0.2532818987965584) | > loss_disc_real_3: 0.4048152565956116 (0.24330854208932984) | > loss_disc_real_4: 0.3147552013397217 (0.2066896433631579) | > loss_disc_real_5: 0.2363768070936203 (0.20014595571491453) | > loss_0: 3.165086030960083 (2.472572088241577) | > grad_norm_0: tensor(1299.4424, device='cuda:0') (tensor(902.1810, device='cuda:0')) | > loss_gen: 2.7285499572753906 (2.3496472040812173) | > loss_kl: 1.3309175968170166 (1.143422418170505) | > loss_feat: 3.620447874069214 (5.670339392291175) | > loss_mel: 22.47308349609375 (21.161796887715656) | > loss_duration: 1.6523222923278809 (1.7253767251968384) | > loss_1: 31.805322647094727 (32.050583097669815) | > grad_norm_1: tensor(25819.6621, device='cuda:0') (tensor(53513.1328, device='cuda:0')) | > current_lr_0: 0.00017265720905565617 | > current_lr_1: 0.00017265720905565617 | > step_time: 0.6699 (0.3998173077901204) | > loader_time: 0.022 (0.009648111131456163)  --> TIME: 2023-10-20 01:15:44 -- STEP: 39/50 -- GLOBAL_STEP: 60390 | > loss_disc: 1.2693748474121094 (2.4480033440467635) | > loss_disc_real_0: 0.022003382444381714 (0.18578776243166664) | > loss_disc_real_1: 0.08726222068071365 (0.23365746347759014) | > loss_disc_real_2: 0.03539682552218437 (0.2465913507800836) | > loss_disc_real_3: 0.06009844318032265 (0.23921293306809205) | > loss_disc_real_4: 0.025979192927479744 (0.23396584682930738) | > loss_disc_real_5: 0.031184501945972443 (0.18853573388873768) | > loss_0: 1.2693748474121094 (2.4480033440467635) | > grad_norm_0: tensor(1072.2615, device='cuda:0') (tensor(1313.0662, device='cuda:0')) | > loss_gen: 2.6858747005462646 (2.591875137426914) | > loss_kl: 0.5402039885520935 (1.099643922769106) | > loss_feat: 9.890735626220703 (6.064875019666476) | > loss_mel: 31.674375534057617 (24.59987595142462) | > loss_duration: 1.779509425163269 (1.7217698127795489) | > loss_1: 46.570701599121094 (36.0780396094689) | > grad_norm_1: tensor(110845.9062, device='cuda:0') (tensor(52834.9375, device='cuda:0')) | > current_lr_0: 0.00017265720905565617 | > current_lr_1: 0.00017265720905565617 | > step_time: 0.5581 (0.46006269332690114) | > loader_time: 0.0174 (0.013188521067301432)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.011124610900879 (3.011124610900879) | > loss_disc_real_0: 0.23275132477283478 (0.23275132477283478) | > loss_disc_real_1: 0.23828838765621185 (0.23828838765621185) | > loss_disc_real_2: 0.2609005570411682 (0.2609005570411682) | > loss_disc_real_3: 0.22544580698013306 (0.22544580698013306) | > loss_disc_real_4: 0.23312227427959442 (0.23312227427959442) | > loss_disc_real_5: 0.3038245439529419 (0.3038245439529419) | > loss_0: 3.011124610900879 (3.011124610900879) | > loss_gen: 1.4927375316619873 (1.4927375316619873) | > loss_kl: 2.283574342727661 (2.283574342727661) | > loss_feat: 0.005525584332644939 (0.005525584332644939) | > loss_mel: 0.9085159301757812 (0.9085159301757812) | > loss_duration: 2.2225120067596436 (2.2225120067596436) | > loss_1: 6.91286563873291 (6.91286563873291)  --> STEP: 1 | > loss_disc: 2.644406318664551 (2.644406318664551) | > loss_disc_real_0: 0.2727241516113281 (0.2727241516113281) | > loss_disc_real_1: 0.252038836479187 (0.252038836479187) | > loss_disc_real_2: 0.35115164518356323 (0.35115164518356323) | > loss_disc_real_3: 0.23187971115112305 (0.23187971115112305) | > loss_disc_real_4: 0.4328728914260864 (0.4328728914260864) | > loss_disc_real_5: 0.22729156911373138 (0.22729156911373138) | > loss_0: 2.644406318664551 (2.644406318664551) | > loss_gen: 2.655409812927246 (2.655409812927246) | > loss_kl: 2.1279079914093018 (2.1279079914093018) | > loss_feat: 5.718334674835205 (5.718334674835205) | > loss_mel: 26.58167839050293 (26.58167839050293) | > loss_duration: 2.3247461318969727 (2.3247461318969727) | > loss_1: 39.408077239990234 (39.408077239990234)  --> STEP: 2 | > loss_disc: 2.166141986846924 (2.4052741527557373) | > loss_disc_real_0: 0.12573662400245667 (0.1992303878068924) | > loss_disc_real_1: 0.16113793849945068 (0.20658838748931885) | > loss_disc_real_2: 0.1530536562204361 (0.25210265070199966) | > loss_disc_real_3: 0.1788840889930725 (0.20538190007209778) | > loss_disc_real_4: 0.2776458263397217 (0.35525935888290405) | > loss_disc_real_5: 0.2498648762702942 (0.2385782226920128) | > loss_0: 2.166141986846924 (2.4052741527557373) | > loss_gen: 2.2031564712524414 (2.4292831420898438) | > loss_kl: 2.861109972000122 (2.494508981704712) | > loss_feat: 6.146280288696289 (5.932307481765747) | > loss_mel: 26.485422134399414 (26.533550262451172) | > loss_duration: 2.375985622406006 (2.3503658771514893) | > loss_1: 40.07195281982422 (39.74001502990723)  --> STEP: 3 | > loss_disc: 2.6511788368225098 (2.4872423807779946) | > loss_disc_real_0: 0.2493736445903778 (0.21594480673472086) | > loss_disc_real_1: 0.31790050864219666 (0.24369242787361145) | > loss_disc_real_2: 0.25751450657844543 (0.25390660266081494) | > loss_disc_real_3: 0.22870737314224243 (0.213157057762146) | > loss_disc_real_4: 0.3979647755622864 (0.3694944977760315) | > loss_disc_real_5: 0.3511209189891815 (0.27609245479106903) | > loss_0: 2.6511788368225098 (2.4872423807779946) | > loss_gen: 2.5240750312805176 (2.460880438486735) | > loss_kl: 1.5052433013916016 (2.1647537549336753) | > loss_feat: 3.1689553260803223 (5.011190096537272) | > loss_mel: 21.195945739746094 (24.754348754882812) | > loss_duration: 2.186781167984009 (2.295837640762329) | > loss_1: 30.58099937438965 (36.68700981140137) --> EVAL PERFORMANCE | > avg_loader_time: 0.003811438878377279 (-0.008623679478963215) | > avg_loss_disc: 2.4872423807779946 (+0.018529415130615234) | > avg_loss_disc_real_0: 0.21594480673472086 (+0.07918248573939005) | > avg_loss_disc_real_1: 0.24369242787361145 (+0.008897826075553894) | > avg_loss_disc_real_2: 0.25390660266081494 (+0.006877866884072631) | > avg_loss_disc_real_3: 0.213157057762146 (-0.076631560921669) | > avg_loss_disc_real_4: 0.3694944977760315 (+0.17114108925064406) | > avg_loss_disc_real_5: 0.27609245479106903 (+0.04292861620585123) | > avg_loss_0: 2.4872423807779946 (+0.018529415130615234) | > avg_loss_gen: 2.460880438486735 (+0.26789025465647365) | > avg_loss_kl: 2.1647537549336753 (-0.1496944030125933) | > avg_loss_feat: 5.011190096537272 (+0.36218478282292743) | > avg_loss_mel: 24.754348754882812 (+4.683576265970867) | > avg_loss_duration: 2.295837640762329 (+0.006307840347290039) | > avg_loss_1: 36.68700981140137 (+5.170263926188152)  > EPOCH: 148/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:15:59)   --> TIME: 2023-10-20 01:16:13 -- STEP: 19/50 -- GLOBAL_STEP: 60420 | > loss_disc: 2.929002285003662 (2.54855425734269) | > loss_disc_real_0: 0.1858118176460266 (0.17083590183603137) | > loss_disc_real_1: 0.2307470589876175 (0.230266603592195) | > loss_disc_real_2: 0.21915175020694733 (0.2317478472464963) | > loss_disc_real_3: 0.1964174211025238 (0.22199321185287677) | > loss_disc_real_4: 0.25123628973960876 (0.2322237844529905) | > loss_disc_real_5: 0.24687865376472473 (0.2933772314143808) | > loss_0: 2.929002285003662 (2.54855425734269) | > grad_norm_0: tensor(1610.2888, device='cuda:0') (tensor(1082.3096, device='cuda:0')) | > loss_gen: 1.8235357999801636 (2.2563690762770805) | > loss_kl: 0.9048516154289246 (1.0944743062320508) | > loss_feat: 5.1143646240234375 (4.257983017908899) | > loss_mel: 24.613271713256836 (22.612481932891043) | > loss_duration: 1.882202386856079 (1.7520500735232705) | > loss_1: 34.338226318359375 (31.97335820449026) | > grad_norm_1: tensor(23123.6445, device='cuda:0') (tensor(38621.4961, device='cuda:0')) | > current_lr_0: 0.00017248462736524798 | > current_lr_1: 0.00017248462736524798 | > step_time: 0.5784 (0.5107111428913317) | > loader_time: 0.0249 (0.0193472285019724)  --> TIME: 2023-10-20 01:16:25 -- STEP: 49/50 -- GLOBAL_STEP: 60450 | > loss_disc: 2.15277099609375 (2.3463658094406115) | > loss_disc_real_0: 0.15379682183265686 (0.14299543131599013) | > loss_disc_real_1: 0.26669010519981384 (0.22177598952334754) | > loss_disc_real_2: 0.2131066471338272 (0.22377087403925097) | > loss_disc_real_3: 0.3762783706188202 (0.2313729827957494) | > loss_disc_real_4: 0.28377565741539 (0.21390313115351053) | > loss_disc_real_5: 0.15017206966876984 (0.20727954489388023) | > loss_0: 2.15277099609375 (2.3463658094406115) | > grad_norm_0: tensor(782.8908, device='cuda:0') (tensor(1135.9045, device='cuda:0')) | > loss_gen: 2.7641007900238037 (2.508229095108655) | > loss_kl: 0.49189746379852295 (1.0576028677881981) | > loss_feat: 5.157341957092285 (5.715841382589873) | > loss_mel: 25.850017547607422 (23.380355830095247) | > loss_duration: 1.8517014980316162 (1.7132130788297069) | > loss_1: 36.115055084228516 (34.37524188294704) | > grad_norm_1: tensor(12895.3975, device='cuda:0') (tensor(42980.2227, device='cuda:0')) | > current_lr_0: 0.00017248462736524798 | > current_lr_1: 0.00017248462736524798 | > step_time: 0.6712 (0.42422926669218103) | > loader_time: 0.325 (0.018147157163036113)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4757843017578125 (2.4757843017578125) | > loss_disc_real_0: 0.254808247089386 (0.254808247089386) | > loss_disc_real_1: 0.2189788967370987 (0.2189788967370987) | > loss_disc_real_2: 0.2600935399532318 (0.2600935399532318) | > loss_disc_real_3: 0.2582615315914154 (0.2582615315914154) | > loss_disc_real_4: 0.22901205718517303 (0.22901205718517303) | > loss_disc_real_5: 0.17854468524456024 (0.17854468524456024) | > loss_0: 2.4757843017578125 (2.4757843017578125) | > loss_gen: 2.1075096130371094 (2.1075096130371094) | > loss_kl: 2.341500759124756 (2.341500759124756) | > loss_feat: 3.9934918880462646 (3.9934918880462646) | > loss_mel: 13.513460159301758 (13.513460159301758) | > loss_duration: 2.2503228187561035 (2.2503228187561035) | > loss_1: 24.20628547668457 (24.20628547668457)  --> STEP: 1 | > loss_disc: 2.7768492698669434 (2.7768492698669434) | > loss_disc_real_0: 0.2665538191795349 (0.2665538191795349) | > loss_disc_real_1: 0.2525393068790436 (0.2525393068790436) | > loss_disc_real_2: 0.3377269506454468 (0.3377269506454468) | > loss_disc_real_3: 0.2773481011390686 (0.2773481011390686) | > loss_disc_real_4: 0.3305570185184479 (0.3305570185184479) | > loss_disc_real_5: 0.4804847538471222 (0.4804847538471222) | > loss_0: 2.7768492698669434 (2.7768492698669434) | > loss_gen: 2.8571858406066895 (2.8571858406066895) | > loss_kl: 2.5046985149383545 (2.5046985149383545) | > loss_feat: 5.27968168258667 (5.27968168258667) | > loss_mel: 26.527128219604492 (26.527128219604492) | > loss_duration: 2.31235408782959 (2.31235408782959) | > loss_1: 39.481048583984375 (39.481048583984375)  --> STEP: 2 | > loss_disc: 1.2237629890441895 (2.0003061294555664) | > loss_disc_real_0: 0.049208931624889374 (0.15788137540221214) | > loss_disc_real_1: 0.07600188255310059 (0.16427059471607208) | > loss_disc_real_2: 0.10978293418884277 (0.22375494241714478) | > loss_disc_real_3: 0.10339408367872238 (0.1903710924088955) | > loss_disc_real_4: 0.021338867023587227 (0.17594794277101755) | > loss_disc_real_5: 0.04945658519864082 (0.2649706695228815) | > loss_0: 1.2237629890441895 (2.0003061294555664) | > loss_gen: 3.0037543773651123 (2.930470108985901) | > loss_kl: 2.7424275875091553 (2.623563051223755) | > loss_feat: 12.604769706726074 (8.942225694656372) | > loss_mel: 25.402372360229492 (25.964750289916992) | > loss_duration: 2.39687442779541 (2.3546142578125) | > loss_1: 46.15019607543945 (42.815622329711914)  --> STEP: 3 | > loss_disc: 2.726656436920166 (2.242422898610433) | > loss_disc_real_0: 0.1747778207063675 (0.1635135238369306) | > loss_disc_real_1: 0.20555661618709564 (0.17803260187307993) | > loss_disc_real_2: 0.28433263301849365 (0.24394750595092773) | > loss_disc_real_3: 0.22725830972194672 (0.2026668315132459) | > loss_disc_real_4: 0.2383914440870285 (0.19676244320968786) | > loss_disc_real_5: 0.13523712754249573 (0.22172615552941957) | > loss_0: 2.726656436920166 (2.242422898610433) | > loss_gen: 1.7454438209533691 (2.53546134630839) | > loss_kl: 1.2997134923934937 (2.182279864947001) | > loss_feat: 2.653618097305298 (6.846023162206014) | > loss_mel: 11.71253490447998 (21.214011828104656) | > loss_duration: 2.35636043548584 (2.3551963170369468) | > loss_1: 19.767669677734375 (35.1329714457194) --> EVAL PERFORMANCE | > avg_loader_time: 0.002199411392211914 (-0.0016120274861653647) | > avg_loss_disc: 2.242422898610433 (-0.24481948216756155) | > avg_loss_disc_real_0: 0.1635135238369306 (-0.052431282897790255) | > avg_loss_disc_real_1: 0.17803260187307993 (-0.06565982600053152) | > avg_loss_disc_real_2: 0.24394750595092773 (-0.009959096709887205) | > avg_loss_disc_real_3: 0.2026668315132459 (-0.010490226248900086) | > avg_loss_disc_real_4: 0.19676244320968786 (-0.17273205456634363) | > avg_loss_disc_real_5: 0.22172615552941957 (-0.05436629926164946) | > avg_loss_0: 2.242422898610433 (-0.24481948216756155) | > avg_loss_gen: 2.53546134630839 (+0.07458090782165527) | > avg_loss_kl: 2.182279864947001 (+0.017526110013325713) | > avg_loss_feat: 6.846023162206014 (+1.8348330656687413) | > avg_loss_mel: 21.214011828104656 (-3.5403369267781564) | > avg_loss_duration: 2.3551963170369468 (+0.05935867627461766) | > avg_loss_1: 35.1329714457194 (-1.5540383656819685)  > EPOCH: 149/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:16:39)   --> TIME: 2023-10-20 01:16:57 -- STEP: 29/50 -- GLOBAL_STEP: 60480 | > loss_disc: 2.3898491859436035 (2.4062341122791686) | > loss_disc_real_0: 0.25195279717445374 (0.15434020767309542) | > loss_disc_real_1: 0.3164503872394562 (0.22144053426795993) | > loss_disc_real_2: 0.3454733192920685 (0.21016420282680412) | > loss_disc_real_3: 0.2847728431224823 (0.2217337491054987) | > loss_disc_real_4: 0.33685624599456787 (0.19780033043232456) | > loss_disc_real_5: 0.14731603860855103 (0.22058824937919097) | > loss_0: 2.3898491859436035 (2.4062341122791686) | > grad_norm_0: tensor(954.0858, device='cuda:0') (tensor(1374.9808, device='cuda:0')) | > loss_gen: 3.343336343765259 (2.4559099715331505) | > loss_kl: 1.1497831344604492 (1.1782179598150582) | > loss_feat: 6.169750213623047 (5.506356853863288) | > loss_mel: 26.158376693725586 (24.695353803963496) | > loss_duration: 1.6714868545532227 (1.7429328499169185) | > loss_1: 38.492733001708984 (35.578771426759914) | > grad_norm_1: tensor(26341.1777, device='cuda:0') (tensor(38299.8203, device='cuda:0')) | > current_lr_0: 0.0001723122181810446 | > current_lr_1: 0.0001723122181810446 | > step_time: 0.5408 (0.49120997560435326) | > loader_time: 0.0236 (0.021288740223851698)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8970108032226562 (2.8970108032226562) | > loss_disc_real_0: 0.18911296129226685 (0.18911296129226685) | > loss_disc_real_1: 0.22729432582855225 (0.22729432582855225) | > loss_disc_real_2: 0.23503892123699188 (0.23503892123699188) | > loss_disc_real_3: 0.23829524219036102 (0.23829524219036102) | > loss_disc_real_4: 0.4500427544116974 (0.4500427544116974) | > loss_disc_real_5: 0.17873819172382355 (0.17873819172382355) | > loss_0: 2.8970108032226562 (2.8970108032226562) | > loss_gen: 1.8900643587112427 (1.8900643587112427) | > loss_kl: 3.0096611976623535 (3.0096611976623535) | > loss_feat: 6.8264384269714355 (6.8264384269714355) | > loss_mel: 26.024751663208008 (26.024751663208008) | > loss_duration: 2.15849232673645 (2.15849232673645) | > loss_1: 39.90940856933594 (39.90940856933594)  --> STEP: 1 | > loss_disc: 2.6675894260406494 (2.6675894260406494) | > loss_disc_real_0: 0.11724283546209335 (0.11724283546209335) | > loss_disc_real_1: 0.18342213332653046 (0.18342213332653046) | > loss_disc_real_2: 0.15305253863334656 (0.15305253863334656) | > loss_disc_real_3: 0.22285018861293793 (0.22285018861293793) | > loss_disc_real_4: 0.218746155500412 (0.218746155500412) | > loss_disc_real_5: 0.21097099781036377 (0.21097099781036377) | > loss_0: 2.6675894260406494 (2.6675894260406494) | > loss_gen: 1.7050044536590576 (1.7050044536590576) | > loss_kl: 2.376770257949829 (2.376770257949829) | > loss_feat: 4.796624183654785 (4.796624183654785) | > loss_mel: 22.756671905517578 (22.756671905517578) | > loss_duration: 2.2470357418060303 (2.2470357418060303) | > loss_1: 33.882102966308594 (33.882102966308594)  --> STEP: 2 | > loss_disc: 3.3793723583221436 (3.0234808921813965) | > loss_disc_real_0: 0.33408230543136597 (0.22566257044672966) | > loss_disc_real_1: 0.2241446077823639 (0.20378337055444717) | > loss_disc_real_2: 0.2641489505767822 (0.2086007446050644) | > loss_disc_real_3: 0.26960524916648865 (0.2462277188897133) | > loss_disc_real_4: 0.3112636208534241 (0.26500488817691803) | > loss_disc_real_5: 0.3150789737701416 (0.2630249857902527) | > loss_0: 3.3793723583221436 (3.0234808921813965) | > loss_gen: 1.5331768989562988 (1.6190906763076782) | > loss_kl: 2.4871582984924316 (2.4319642782211304) | > loss_feat: 2.210508346557617 (3.503566265106201) | > loss_mel: 17.284351348876953 (20.020511627197266) | > loss_duration: 2.3741705417633057 (2.310603141784668) | > loss_1: 25.88936424255371 (29.885733604431152)  --> STEP: 3 | > loss_disc: 2.182361602783203 (2.743107795715332) | > loss_disc_real_0: 0.14550459384918213 (0.1989432449142138) | > loss_disc_real_1: 0.3405455946922302 (0.24937077860037485) | > loss_disc_real_2: 0.22189205884933472 (0.21303118268648782) | > loss_disc_real_3: 0.32622504234313965 (0.2728934933741887) | > loss_disc_real_4: 0.13943423330783844 (0.22314800322055817) | > loss_disc_real_5: 0.20085996389389038 (0.24230331182479858) | > loss_0: 2.182361602783203 (2.743107795715332) | > loss_gen: 2.581026792526245 (1.939736048380534) | > loss_kl: 1.4386423826217651 (2.1008569796880088) | > loss_feat: 3.741863965988159 (3.582998832066854) | > loss_mel: 27.431013107299805 (22.490678787231445) | > loss_duration: 2.1820504665374756 (2.267752250035604) | > loss_1: 37.374595642089844 (32.38202095031738) --> EVAL PERFORMANCE | > avg_loader_time: 0.002887090047200521 (+0.0006876786549886069) | > avg_loss_disc: 2.743107795715332 (+0.5006848971048989) | > avg_loss_disc_real_0: 0.1989432449142138 (+0.035429721077283205) | > avg_loss_disc_real_1: 0.24937077860037485 (+0.07133817672729492) | > avg_loss_disc_real_2: 0.21303118268648782 (-0.03091632326443991) | > avg_loss_disc_real_3: 0.2728934933741887 (+0.07022666186094281) | > avg_loss_disc_real_4: 0.22314800322055817 (+0.026385560010870307) | > avg_loss_disc_real_5: 0.24230331182479858 (+0.020577156295379012) | > avg_loss_0: 2.743107795715332 (+0.5006848971048989) | > avg_loss_gen: 1.939736048380534 (-0.5957252979278562) | > avg_loss_kl: 2.1008569796880088 (-0.08142288525899222) | > avg_loss_feat: 3.582998832066854 (-3.2630243301391597) | > avg_loss_mel: 22.490678787231445 (+1.2766669591267892) | > avg_loss_duration: 2.267752250035604 (-0.08744406700134277) | > avg_loss_1: 32.38202095031738 (-2.750950495402016)  > EPOCH: 150/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:17:19)   --> TIME: 2023-10-20 01:17:26 -- STEP: 9/50 -- GLOBAL_STEP: 60510 | > loss_disc: 3.119903564453125 (2.5338956117630005) | > loss_disc_real_0: 0.15765050053596497 (0.14214176146520507) | > loss_disc_real_1: 0.276775985956192 (0.256410903400845) | > loss_disc_real_2: 0.254253625869751 (0.21146758811341393) | > loss_disc_real_3: 0.295326292514801 (0.2221121738354365) | > loss_disc_real_4: 0.3488750159740448 (0.22798406663868162) | > loss_disc_real_5: 0.5265362858772278 (0.33094819490280414) | > loss_0: 3.119903564453125 (2.5338956117630005) | > grad_norm_0: tensor(1447.5796, device='cuda:0') (tensor(1105.0638, device='cuda:0')) | > loss_gen: 1.8488112688064575 (2.5971861018074884) | > loss_kl: 1.302605152130127 (1.020858175224728) | > loss_feat: 0.2136741578578949 (5.850745773977703) | > loss_mel: 2.5517313480377197 (21.434232208463882) | > loss_duration: 1.6353775262832642 (1.7038834757275052) | > loss_1: 7.552199363708496 (32.60690636105008) | > grad_norm_1: tensor(16695.6543, device='cuda:0') (tensor(33317.1289, device='cuda:0')) | > current_lr_0: 0.0001721399813306152 | > current_lr_1: 0.0001721399813306152 | > step_time: 0.2485 (0.26349947187635636) | > loader_time: 0.0033 (0.002386702431572808)  --> TIME: 2023-10-20 01:17:41 -- STEP: 39/50 -- GLOBAL_STEP: 60540 | > loss_disc: 2.6893200874328613 (2.6069885003261075) | > loss_disc_real_0: 0.41276469826698303 (0.16200647426721382) | > loss_disc_real_1: 0.35759657621383667 (0.24960824178579527) | > loss_disc_real_2: 0.30617281794548035 (0.25315798551608354) | > loss_disc_real_3: 0.27192556858062744 (0.24553857600459686) | > loss_disc_real_4: 0.23253537714481354 (0.2499767209474856) | > loss_disc_real_5: 0.252051442861557 (0.26419900071162444) | > loss_0: 2.6893200874328613 (2.6069885003261075) | > grad_norm_0: tensor(1930.5376, device='cuda:0') (tensor(1186.4247, device='cuda:0')) | > loss_gen: 2.553725004196167 (2.404838754580571) | > loss_kl: 0.9475222229957581 (1.0619758413388178) | > loss_feat: 2.4134063720703125 (5.015036541299943) | > loss_mel: 22.90953254699707 (22.47495355361547) | > loss_duration: 1.7532644271850586 (1.7186259612058983) | > loss_1: 30.577449798583984 (32.67543073800895) | > grad_norm_1: tensor(36938.6250, device='cuda:0') (tensor(43350.6914, device='cuda:0')) | > current_lr_0: 0.0001721399813306152 | > current_lr_1: 0.0001721399813306152 | > step_time: 0.614 (0.4267220802796193) | > loader_time: 0.0095 (0.010444029783591246)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0853490829467773 (3.0853490829467773) | > loss_disc_real_0: 0.31256532669067383 (0.31256532669067383) | > loss_disc_real_1: 0.27699053287506104 (0.27699053287506104) | > loss_disc_real_2: 0.18950124084949493 (0.18950124084949493) | > loss_disc_real_3: 0.31016770005226135 (0.31016770005226135) | > loss_disc_real_4: 0.16158422827720642 (0.16158422827720642) | > loss_disc_real_5: 0.35932913422584534 (0.35932913422584534) | > loss_0: 3.0853490829467773 (3.0853490829467773) | > loss_gen: 2.376929998397827 (2.376929998397827) | > loss_kl: 2.198800802230835 (2.198800802230835) | > loss_feat: 6.404815196990967 (6.404815196990967) | > loss_mel: 23.808826446533203 (23.808826446533203) | > loss_duration: 2.1690289974212646 (2.1690289974212646) | > loss_1: 36.95840072631836 (36.95840072631836)  --> STEP: 1 | > loss_disc: 3.614769220352173 (3.614769220352173) | > loss_disc_real_0: 0.36350128054618835 (0.36350128054618835) | > loss_disc_real_1: 0.30257338285446167 (0.30257338285446167) | > loss_disc_real_2: 0.3330172002315521 (0.3330172002315521) | > loss_disc_real_3: 0.23964670300483704 (0.23964670300483704) | > loss_disc_real_4: 0.3709019422531128 (0.3709019422531128) | > loss_disc_real_5: 0.26951053738594055 (0.26951053738594055) | > loss_0: 3.614769220352173 (3.614769220352173) | > loss_gen: 1.9537814855575562 (1.9537814855575562) | > loss_kl: 2.533939838409424 (2.533939838409424) | > loss_feat: 7.1434550285339355 (7.1434550285339355) | > loss_mel: 24.183425903320312 (24.183425903320312) | > loss_duration: 2.255945920944214 (2.255945920944214) | > loss_1: 38.07054901123047 (38.07054901123047)  --> STEP: 2 | > loss_disc: 2.5249977111816406 (3.0698834657669067) | > loss_disc_real_0: 0.14547321200370789 (0.2544872462749481) | > loss_disc_real_1: 0.10505158454179764 (0.20381248369812965) | > loss_disc_real_2: 0.2120913565158844 (0.27255427837371826) | > loss_disc_real_3: 0.05474456772208214 (0.1471956353634596) | > loss_disc_real_4: 0.13374486565589905 (0.2523234039545059) | > loss_disc_real_5: 0.219874769449234 (0.24469265341758728) | > loss_0: 2.5249977111816406 (3.0698834657669067) | > loss_gen: 1.8183146715164185 (1.8860480785369873) | > loss_kl: 2.978987693786621 (2.7564637660980225) | > loss_feat: 7.427700042724609 (7.2855775356292725) | > loss_mel: 28.189241409301758 (26.186333656311035) | > loss_duration: 2.3899714946746826 (2.3229587078094482) | > loss_1: 42.80421447753906 (40.437381744384766)  --> STEP: 3 | > loss_disc: 2.2055726051330566 (2.7817798455556235) | > loss_disc_real_0: 0.6131007671356201 (0.3740250865618388) | > loss_disc_real_1: 0.25079667568206787 (0.21947388102610907) | > loss_disc_real_2: 0.10343106836080551 (0.2161798750360807) | > loss_disc_real_3: 0.2687356173992157 (0.18770896270871162) | > loss_disc_real_4: 0.07732345908880234 (0.1939900889992714) | > loss_disc_real_5: 0.11954385042190552 (0.20297638575236002) | > loss_0: 2.2055726051330566 (2.7817798455556235) | > loss_gen: 3.6662633419036865 (2.479453166325887) | > loss_kl: 1.5906150341033936 (2.367847522099813) | > loss_feat: 7.2221455574035645 (7.26443354288737) | > loss_mel: 27.70956039428711 (26.69407590230306) | > loss_duration: 2.2745020389556885 (2.306806484858195) | > loss_1: 42.46308517456055 (41.112616221110024) --> EVAL PERFORMANCE | > avg_loader_time: 0.011571804682413736 (+0.008684714635213215) | > avg_loss_disc: 2.7817798455556235 (+0.03867204984029149) | > avg_loss_disc_real_0: 0.3740250865618388 (+0.175081841647625) | > avg_loss_disc_real_1: 0.21947388102610907 (-0.02989689757426578) | > avg_loss_disc_real_2: 0.2161798750360807 (+0.003148692349592863) | > avg_loss_disc_real_3: 0.18770896270871162 (-0.0851845306654771) | > avg_loss_disc_real_4: 0.1939900889992714 (-0.029157914221286774) | > avg_loss_disc_real_5: 0.20297638575236002 (-0.03932692607243857) | > avg_loss_0: 2.7817798455556235 (+0.03867204984029149) | > avg_loss_gen: 2.479453166325887 (+0.5397171179453533) | > avg_loss_kl: 2.367847522099813 (+0.2669905424118042) | > avg_loss_feat: 7.26443354288737 (+3.681434710820516) | > avg_loss_mel: 26.69407590230306 (+4.203397115071613) | > avg_loss_duration: 2.306806484858195 (+0.03905423482259085) | > avg_loss_1: 41.112616221110024 (+8.73059527079264)  > EPOCH: 151/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:17:58)   --> TIME: 2023-10-20 01:18:11 -- STEP: 19/50 -- GLOBAL_STEP: 60570 | > loss_disc: 2.296018123626709 (2.772277254807322) | > loss_disc_real_0: 0.06351199001073837 (0.21484791056105965) | > loss_disc_real_1: 0.2988183796405792 (0.2588771189513959) | > loss_disc_real_2: 0.33850255608558655 (0.2416318802064971) | > loss_disc_real_3: 0.2880966365337372 (0.2800221317692807) | > loss_disc_real_4: 0.3096780776977539 (0.21984047991664787) | > loss_disc_real_5: 0.2045518010854721 (0.2617858683592395) | > loss_0: 2.296018123626709 (2.772277254807322) | > grad_norm_0: tensor(742.9306, device='cuda:0') (tensor(1338.7726, device='cuda:0')) | > loss_gen: 2.9360713958740234 (2.280331536343223) | > loss_kl: 1.3089842796325684 (1.2833592013308877) | > loss_feat: 6.563240051269531 (5.4465878617606664) | > loss_mel: 31.02581214904785 (25.711257558119925) | > loss_duration: 1.8774824142456055 (1.7572334753839594) | > loss_1: 43.71158981323242 (36.47876960352847) | > grad_norm_1: tensor(56783.6133, device='cuda:0') (tensor(51333.6484, device='cuda:0')) | > current_lr_0: 0.00017196791664170148 | > current_lr_1: 0.00017196791664170148 | > step_time: 0.5967 (0.5229941794746801) | > loader_time: 0.0245 (0.018732635598433644)  --> TIME: 2023-10-20 01:18:23 -- STEP: 49/50 -- GLOBAL_STEP: 60600 | > loss_disc: 2.454914093017578 (2.523411383434218) | > loss_disc_real_0: 0.32593387365341187 (0.17735285716777555) | > loss_disc_real_1: 0.2575608193874359 (0.23324747033873383) | > loss_disc_real_2: 0.19237706065177917 (0.2244076139616723) | > loss_disc_real_3: 0.27293965220451355 (0.2430653701327285) | > loss_disc_real_4: 0.3136192858219147 (0.21105042472481728) | > loss_disc_real_5: 0.5402957201004028 (0.22780303227506127) | > loss_0: 2.454914093017578 (2.523411383434218) | > grad_norm_0: tensor(937.9269, device='cuda:0') (tensor(1112.1492, device='cuda:0')) | > loss_gen: 3.477269411087036 (2.3521136921279284) | > loss_kl: 0.9637051820755005 (1.1310360845254392) | > loss_feat: 6.366416931152344 (5.27792679258071) | > loss_mel: 28.16988754272461 (23.28494163921901) | > loss_duration: 1.839845061302185 (1.7082767291944854) | > loss_1: 40.81711959838867 (33.75429503771724) | > grad_norm_1: tensor(46596.1719, device='cuda:0') (tensor(40041.4648, device='cuda:0')) | > current_lr_0: 0.00017196791664170148 | > current_lr_1: 0.00017196791664170148 | > step_time: 0.6776 (0.4302680200460005) | > loader_time: 0.3223 (0.018950189862932475)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9424171447753906 (2.9424171447753906) | > loss_disc_real_0: 0.28345000743865967 (0.28345000743865967) | > loss_disc_real_1: 0.2894330322742462 (0.2894330322742462) | > loss_disc_real_2: 0.3044012188911438 (0.3044012188911438) | > loss_disc_real_3: 0.2887645661830902 (0.2887645661830902) | > loss_disc_real_4: 0.29195690155029297 (0.29195690155029297) | > loss_disc_real_5: 0.23073126375675201 (0.23073126375675201) | > loss_0: 2.9424171447753906 (2.9424171447753906) | > loss_gen: 1.7815768718719482 (1.7815768718719482) | > loss_kl: 2.504338264465332 (2.504338264465332) | > loss_feat: 0.39874106645584106 (0.39874106645584106) | > loss_mel: 13.606929779052734 (13.606929779052734) | > loss_duration: 2.206226348876953 (2.206226348876953) | > loss_1: 20.497812271118164 (20.497812271118164)  --> STEP: 1 | > loss_disc: 2.9731321334838867 (2.9731321334838867) | > loss_disc_real_0: 0.29624050855636597 (0.29624050855636597) | > loss_disc_real_1: 0.28921034932136536 (0.28921034932136536) | > loss_disc_real_2: 0.3041194677352905 (0.3041194677352905) | > loss_disc_real_3: 0.28851208090782166 (0.28851208090782166) | > loss_disc_real_4: 0.29073256254196167 (0.29073256254196167) | > loss_disc_real_5: 0.23319315910339355 (0.23319315910339355) | > loss_0: 2.9731321334838867 (2.9731321334838867) | > loss_gen: 1.755281925201416 (1.755281925201416) | > loss_kl: 2.7643930912017822 (2.7643930912017822) | > loss_feat: 0.3143582344055176 (0.3143582344055176) | > loss_mel: 11.070352554321289 (11.070352554321289) | > loss_duration: 2.300079584121704 (2.300079584121704) | > loss_1: 18.204465866088867 (18.204465866088867)  --> STEP: 2 | > loss_disc: 2.639620780944824 (2.8063764572143555) | > loss_disc_real_0: 0.21349936723709106 (0.2548699378967285) | > loss_disc_real_1: 0.2757434546947479 (0.28247690200805664) | > loss_disc_real_2: 0.23171761631965637 (0.26791854202747345) | > loss_disc_real_3: 0.34335699677467346 (0.31593453884124756) | > loss_disc_real_4: 0.3107055127620697 (0.3007190376520157) | > loss_disc_real_5: 0.29200541973114014 (0.26259928941726685) | > loss_0: 2.639620780944824 (2.8063764572143555) | > loss_gen: 2.262089967727661 (2.0086859464645386) | > loss_kl: 2.906496286392212 (2.835444688796997) | > loss_feat: 2.593235731124878 (1.4537969827651978) | > loss_mel: 24.982810974121094 (18.02658176422119) | > loss_duration: 2.3131825923919678 (2.306631088256836) | > loss_1: 35.05781555175781 (26.63114070892334)  --> STEP: 3 | > loss_disc: 1.8161152601242065 (2.476289391517639) | > loss_disc_real_0: 0.1726348102092743 (0.22745822866757712) | > loss_disc_real_1: 0.2643929421901703 (0.27644891540209454) | > loss_disc_real_2: 0.16547130048274994 (0.2337694615125656) | > loss_disc_real_3: 0.21023407578468323 (0.28070105115572613) | > loss_disc_real_4: 0.18497192859649658 (0.26213666796684265) | > loss_disc_real_5: 0.3304285705089569 (0.2852090497811635) | > loss_0: 1.8161152601242065 (2.476289391517639) | > loss_gen: 3.607842445373535 (2.5417381127675376) | > loss_kl: 4.26952600479126 (3.313471794128418) | > loss_feat: 6.059126377105713 (2.9889067808787027) | > loss_mel: 21.229948043823242 (19.094370524088543) | > loss_duration: 2.6947898864746094 (2.4360173543294272) | > loss_1: 37.86123275756836 (30.374504725138348) --> EVAL PERFORMANCE | > avg_loader_time: 0.009952863057454428 (-0.0016189416249593087) | > avg_loss_disc: 2.476289391517639 (-0.30549045403798436) | > avg_loss_disc_real_0: 0.22745822866757712 (-0.1465668578942617) | > avg_loss_disc_real_1: 0.27644891540209454 (+0.05697503437598547) | > avg_loss_disc_real_2: 0.2337694615125656 (+0.017589586476484925) | > avg_loss_disc_real_3: 0.28070105115572613 (+0.09299208844701451) | > avg_loss_disc_real_4: 0.26213666796684265 (+0.06814657896757126) | > avg_loss_disc_real_5: 0.2852090497811635 (+0.0822326640288035) | > avg_loss_0: 2.476289391517639 (-0.30549045403798436) | > avg_loss_gen: 2.5417381127675376 (+0.06228494644165039) | > avg_loss_kl: 3.313471794128418 (+0.945624272028605) | > avg_loss_feat: 2.9889067808787027 (-4.275526762008667) | > avg_loss_mel: 19.094370524088543 (-7.599705378214516) | > avg_loss_duration: 2.4360173543294272 (+0.1292108694712324) | > avg_loss_1: 30.374504725138348 (-10.738111495971676)  > EPOCH: 152/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:18:36)   --> TIME: 2023-10-20 01:18:55 -- STEP: 29/50 -- GLOBAL_STEP: 60630 | > loss_disc: 1.5997954607009888 (2.494984071830223) | > loss_disc_real_0: 0.05361668020486832 (0.1906137353387372) | > loss_disc_real_1: 0.25745972990989685 (0.22923002006678744) | > loss_disc_real_2: 0.1590879112482071 (0.23018365199195925) | > loss_disc_real_3: 0.1412343531847 (0.23078544335118656) | > loss_disc_real_4: 0.10048668831586838 (0.21795112495150032) | > loss_disc_real_5: 0.038964513689279556 (0.2177896217667851) | > loss_0: 1.5997954607009888 (2.494984071830223) | > grad_norm_0: tensor(506.0502, device='cuda:0') (tensor(724.1812, device='cuda:0')) | > loss_gen: 2.861052989959717 (2.2176532992001228) | > loss_kl: 0.8284738063812256 (1.0940034636135765) | > loss_feat: 9.208845138549805 (4.2558093803196115) | > loss_mel: 28.72699546813965 (22.73049364418819) | > loss_duration: 1.7010598182678223 (1.7283105274726605) | > loss_1: 43.3264274597168 (32.026270619754136) | > grad_norm_1: tensor(17415.4824, device='cuda:0') (tensor(20056.4414, device='cuda:0')) | > current_lr_0: 0.00017179602394221723 | > current_lr_1: 0.00017179602394221723 | > step_time: 0.6346 (0.5074055688134556) | > loader_time: 0.0243 (0.01914062993279819)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1605336666107178 (3.1605336666107178) | > loss_disc_real_0: 0.0923609808087349 (0.0923609808087349) | > loss_disc_real_1: 0.15529316663742065 (0.15529316663742065) | > loss_disc_real_2: 0.24674080312252045 (0.24674080312252045) | > loss_disc_real_3: 0.22734051942825317 (0.22734051942825317) | > loss_disc_real_4: 0.1073538288474083 (0.1073538288474083) | > loss_disc_real_5: 0.11385659128427505 (0.11385659128427505) | > loss_0: 3.1605336666107178 (3.1605336666107178) | > loss_gen: 1.51412034034729 (1.51412034034729) | > loss_kl: 2.2533018589019775 (2.2533018589019775) | > loss_feat: 6.8590617179870605 (6.8590617179870605) | > loss_mel: 25.675630569458008 (25.675630569458008) | > loss_duration: 2.104065418243408 (2.104065418243408) | > loss_1: 38.40618133544922 (38.40618133544922)  --> STEP: 1 | > loss_disc: 2.419888734817505 (2.419888734817505) | > loss_disc_real_0: 0.24843621253967285 (0.24843621253967285) | > loss_disc_real_1: 0.2720217704772949 (0.2720217704772949) | > loss_disc_real_2: 0.15462850034236908 (0.15462850034236908) | > loss_disc_real_3: 0.23981328308582306 (0.23981328308582306) | > loss_disc_real_4: 0.16963958740234375 (0.16963958740234375) | > loss_disc_real_5: 0.21283401548862457 (0.21283401548862457) | > loss_0: 2.419888734817505 (2.419888734817505) | > loss_gen: 2.2688539028167725 (2.2688539028167725) | > loss_kl: 2.156489849090576 (2.156489849090576) | > loss_feat: 6.552082061767578 (6.552082061767578) | > loss_mel: 28.551477432250977 (28.551477432250977) | > loss_duration: 2.2030391693115234 (2.2030391693115234) | > loss_1: 41.73194122314453 (41.73194122314453)  --> STEP: 2 | > loss_disc: 3.082808494567871 (2.751348614692688) | > loss_disc_real_0: 0.17616388201713562 (0.21230004727840424) | > loss_disc_real_1: 0.12827077507972717 (0.20014627277851105) | > loss_disc_real_2: 0.1403365284204483 (0.1474825143814087) | > loss_disc_real_3: 0.34607070684432983 (0.29294199496507645) | > loss_disc_real_4: 0.24677205085754395 (0.20820581912994385) | > loss_disc_real_5: 0.40018370747566223 (0.3065088614821434) | > loss_0: 3.082808494567871 (2.751348614692688) | > loss_gen: 1.9125224351882935 (2.090688169002533) | > loss_kl: 2.8521296977996826 (2.5043097734451294) | > loss_feat: 8.116429328918457 (7.334255695343018) | > loss_mel: 28.3855037689209 (28.468490600585938) | > loss_duration: 2.2195229530334473 (2.2112810611724854) | > loss_1: 43.48611068725586 (42.609025955200195)  --> STEP: 3 | > loss_disc: 2.5029196739196777 (2.668538967768351) | > loss_disc_real_0: 0.445461630821228 (0.29002057512601215) | > loss_disc_real_1: 0.37291884422302246 (0.2577371299266815) | > loss_disc_real_2: 0.2910611629486084 (0.1953420639038086) | > loss_disc_real_3: 0.193025141954422 (0.2596363772948583) | > loss_disc_real_4: 0.06604515016078949 (0.16081892947355905) | > loss_disc_real_5: 0.24680490791797638 (0.2866075436274211) | > loss_0: 2.5029196739196777 (2.668538967768351) | > loss_gen: 2.437544345855713 (2.2063068946202598) | > loss_kl: 1.5609112977981567 (2.1898436148961387) | > loss_feat: 6.07450532913208 (6.914338906606038) | > loss_mel: 24.85541343688965 (27.264131546020508) | > loss_duration: 2.3033580780029297 (2.241973400115967) | > loss_1: 37.23173522949219 (40.816595713297524) --> EVAL PERFORMANCE | > avg_loader_time: 0.014467795689900717 (+0.004514932632446289) | > avg_loss_disc: 2.668538967768351 (+0.19224957625071193) | > avg_loss_disc_real_0: 0.29002057512601215 (+0.06256234645843503) | > avg_loss_disc_real_1: 0.2577371299266815 (-0.018711785475413023) | > avg_loss_disc_real_2: 0.1953420639038086 (-0.03842739760875702) | > avg_loss_disc_real_3: 0.2596363772948583 (-0.021064673860867855) | > avg_loss_disc_real_4: 0.16081892947355905 (-0.1013177384932836) | > avg_loss_disc_real_5: 0.2866075436274211 (+0.0013984938462575647) | > avg_loss_0: 2.668538967768351 (+0.19224957625071193) | > avg_loss_gen: 2.2063068946202598 (-0.33543121814727783) | > avg_loss_kl: 2.1898436148961387 (-1.1236281792322793) | > avg_loss_feat: 6.914338906606038 (+3.9254321257273355) | > avg_loss_mel: 27.264131546020508 (+8.169761021931965) | > avg_loss_duration: 2.241973400115967 (-0.19404395421346043) | > avg_loss_1: 40.816595713297524 (+10.442090988159176)  > EPOCH: 153/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:19:16)   --> TIME: 2023-10-20 01:19:23 -- STEP: 9/50 -- GLOBAL_STEP: 60660 | > loss_disc: 3.052354335784912 (2.797074384159512) | > loss_disc_real_0: 0.14157629013061523 (0.1864046628276507) | > loss_disc_real_1: 0.4403235614299774 (0.24045106106334263) | > loss_disc_real_2: 0.3203105032444 (0.249074078268475) | > loss_disc_real_3: 0.2698928713798523 (0.276357716984219) | > loss_disc_real_4: 0.5205943584442139 (0.2740023169252608) | > loss_disc_real_5: 0.47043323516845703 (0.2652348263396157) | > loss_0: 3.052354335784912 (2.797074384159512) | > grad_norm_0: tensor(521.4482, device='cuda:0') (tensor(871.3168, device='cuda:0')) | > loss_gen: 2.6889352798461914 (2.4897014564938016) | > loss_kl: 0.9636192917823792 (1.1046228806177776) | > loss_feat: 4.579019069671631 (6.346397552225325) | > loss_mel: 24.779918670654297 (23.882777955796982) | > loss_duration: 1.6574245691299438 (1.6858657995859783) | > loss_1: 34.66891860961914 (35.50936592949761) | > grad_norm_1: tensor(12597.3672, device='cuda:0') (tensor(16872.3301, device='cuda:0')) | > current_lr_0: 0.00017162430306024817 | > current_lr_1: 0.00017162430306024817 | > step_time: 0.2876 (0.29538634088304305) | > loader_time: 0.005 (0.0050313472747802734)  --> TIME: 2023-10-20 01:19:37 -- STEP: 39/50 -- GLOBAL_STEP: 60690 | > loss_disc: 3.034334897994995 (2.707388801452441) | > loss_disc_real_0: 0.38873276114463806 (0.18925082674011207) | > loss_disc_real_1: 0.22276748716831207 (0.24710487268674064) | > loss_disc_real_2: 0.288593053817749 (0.23884513859565443) | > loss_disc_real_3: 0.24735413491725922 (0.29102804655065906) | > loss_disc_real_4: 0.24674615263938904 (0.25140845909332615) | > loss_disc_real_5: 0.29619157314300537 (0.25764671856394183) | > loss_0: 3.034334897994995 (2.707388801452441) | > grad_norm_0: tensor(299.3414, device='cuda:0') (tensor(828.0077, device='cuda:0')) | > loss_gen: 1.5976368188858032 (2.3118924055344032) | > loss_kl: 0.9210788607597351 (1.0434583551608605) | > loss_feat: 0.08694437891244888 (5.044814783220108) | > loss_mel: 4.6577935218811035 (22.2169051414881) | > loss_duration: 1.7426820993423462 (1.703254601894281) | > loss_1: 9.006135940551758 (32.32032547241602) | > grad_norm_1: tensor(18807.7305, device='cuda:0') (tensor(18010.5156, device='cuda:0')) | > current_lr_0: 0.00017162430306024817 | > current_lr_1: 0.00017162430306024817 | > step_time: 0.2823 (0.40607913335164386) | > loader_time: 0.0233 (0.009311382587139424)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.11676025390625 (2.11676025390625) | > loss_disc_real_0: 0.1249132752418518 (0.1249132752418518) | > loss_disc_real_1: 0.2882983982563019 (0.2882983982563019) | > loss_disc_real_2: 0.27335473895072937 (0.27335473895072937) | > loss_disc_real_3: 0.17003779113292694 (0.17003779113292694) | > loss_disc_real_4: 0.11934693902730942 (0.11934693902730942) | > loss_disc_real_5: 0.18186485767364502 (0.18186485767364502) | > loss_0: 2.11676025390625 (2.11676025390625) | > loss_gen: 2.9491069316864014 (2.9491069316864014) | > loss_kl: 1.9422117471694946 (1.9422117471694946) | > loss_feat: 5.972765922546387 (5.972765922546387) | > loss_mel: 23.18211555480957 (23.18211555480957) | > loss_duration: 2.154132843017578 (2.154132843017578) | > loss_1: 36.20033264160156 (36.20033264160156)  --> STEP: 1 | > loss_disc: 3.1767539978027344 (3.1767539978027344) | > loss_disc_real_0: 0.5452836751937866 (0.5452836751937866) | > loss_disc_real_1: 0.2280239313840866 (0.2280239313840866) | > loss_disc_real_2: 0.23839250206947327 (0.23839250206947327) | > loss_disc_real_3: 0.27228203415870667 (0.27228203415870667) | > loss_disc_real_4: 0.2255210280418396 (0.2255210280418396) | > loss_disc_real_5: 0.5094917416572571 (0.5094917416572571) | > loss_0: 3.1767539978027344 (3.1767539978027344) | > loss_gen: 3.300420045852661 (3.300420045852661) | > loss_kl: 3.2190282344818115 (3.2190282344818115) | > loss_feat: 6.642319202423096 (6.642319202423096) | > loss_mel: 26.57910919189453 (26.57910919189453) | > loss_duration: 2.3203818798065186 (2.3203818798065186) | > loss_1: 42.061256408691406 (42.061256408691406)  --> STEP: 2 | > loss_disc: 3.0524141788482666 (3.1145840883255005) | > loss_disc_real_0: 0.16806836426258087 (0.35667601972818375) | > loss_disc_real_1: 0.31291043758392334 (0.270467184484005) | > loss_disc_real_2: 0.25416046380996704 (0.24627648293972015) | > loss_disc_real_3: 0.2609582841396332 (0.2666201591491699) | > loss_disc_real_4: 0.33695143461227417 (0.2812362313270569) | > loss_disc_real_5: 0.3049926459789276 (0.40724219381809235) | > loss_0: 3.0524141788482666 (3.1145840883255005) | > loss_gen: 1.6301265954971313 (2.4652733206748962) | > loss_kl: 2.649338722229004 (2.9341834783554077) | > loss_feat: 0.06054310500621796 (3.351431153714657) | > loss_mel: 2.807260751724243 (14.693184971809387) | > loss_duration: 2.2583184242248535 (2.289350152015686) | > loss_1: 9.405587196350098 (25.733421802520752)  --> STEP: 3 | > loss_disc: 2.9854679107666016 (3.071545362472534) | > loss_disc_real_0: 0.29391008615493774 (0.33575404187043506) | > loss_disc_real_1: 0.29840248823165894 (0.27977895239988965) | > loss_disc_real_2: 0.2622017562389374 (0.25158490737279254) | > loss_disc_real_3: 0.2682018280029297 (0.26714738210042316) | > loss_disc_real_4: 0.30013981461524963 (0.28753742575645447) | > loss_disc_real_5: 0.27415263652801514 (0.3628790080547333) | > loss_0: 2.9854679107666016 (3.071545362472534) | > loss_gen: 1.7583560943603516 (2.229634245236715) | > loss_kl: 1.3890005350112915 (2.419122497240702) | > loss_feat: 0.4629870057106018 (2.388616437713305) | > loss_mel: 18.774995803833008 (16.05378858248393) | > loss_duration: 2.203371524810791 (2.260690609614054) | > loss_1: 24.58871078491211 (25.35185146331787) --> EVAL PERFORMANCE | > avg_loader_time: 0.01071461041768392 (-0.003753185272216797) | > avg_loss_disc: 3.071545362472534 (+0.4030063947041831) | > avg_loss_disc_real_0: 0.33575404187043506 (+0.04573346674442291) | > avg_loss_disc_real_1: 0.27977895239988965 (+0.022041822473208128) | > avg_loss_disc_real_2: 0.25158490737279254 (+0.05624284346898395) | > avg_loss_disc_real_3: 0.26714738210042316 (+0.00751100480556488) | > avg_loss_disc_real_4: 0.28753742575645447 (+0.12671849628289542) | > avg_loss_disc_real_5: 0.3628790080547333 (+0.0762714644273122) | > avg_loss_0: 3.071545362472534 (+0.4030063947041831) | > avg_loss_gen: 2.229634245236715 (+0.023327350616455078) | > avg_loss_kl: 2.419122497240702 (+0.2292788823445635) | > avg_loss_feat: 2.388616437713305 (-4.525722468892733) | > avg_loss_mel: 16.05378858248393 (-11.21034296353658) | > avg_loss_duration: 2.260690609614054 (+0.018717209498087417) | > avg_loss_1: 25.35185146331787 (-15.464744249979653)  > EPOCH: 154/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:19:53)   --> TIME: 2023-10-20 01:20:07 -- STEP: 19/50 -- GLOBAL_STEP: 60720 | > loss_disc: 2.748137950897217 (2.4599073811581262) | > loss_disc_real_0: 0.24053220450878143 (0.16376592336516632) | > loss_disc_real_1: 0.2866297960281372 (0.24440064869428935) | > loss_disc_real_2: 0.2701045572757721 (0.22884998470544815) | > loss_disc_real_3: 0.24077890813350677 (0.23833748619807393) | > loss_disc_real_4: 0.3560960590839386 (0.22628672244517425) | > loss_disc_real_5: 0.3091622591018677 (0.18934630656516865) | > loss_0: 2.748137950897217 (2.4599073811581262) | > grad_norm_0: tensor(421.9619, device='cuda:0') (tensor(461.6987, device='cuda:0')) | > loss_gen: 2.070301055908203 (2.378574534466392) | > loss_kl: 1.0356038808822632 (1.0334764562155072) | > loss_feat: 1.328138828277588 (5.161260871510756) | > loss_mel: 22.018871307373047 (21.880764233438594) | > loss_duration: 1.845987319946289 (1.7582495024329738) | > loss_1: 28.29890251159668 (32.21232579883776) | > grad_norm_1: tensor(3473.4395, device='cuda:0') (tensor(20301.7070, device='cuda:0')) | > current_lr_0: 0.00017145275382405195 | > current_lr_1: 0.00017145275382405195 | > step_time: 0.2912 (0.4791453010157535) | > loader_time: 0.0235 (0.022527832733957392)  --> TIME: 2023-10-20 01:20:19 -- STEP: 49/50 -- GLOBAL_STEP: 60750 | > loss_disc: 3.2568728923797607 (2.523095191741477) | > loss_disc_real_0: 0.6054608821868896 (0.17179523617485346) | > loss_disc_real_1: 0.21508556604385376 (0.2370840729195245) | > loss_disc_real_2: 0.27480000257492065 (0.2303029472122387) | > loss_disc_real_3: 0.3425463140010834 (0.23845341292266942) | > loss_disc_real_4: 0.4657175838947296 (0.23528126695630502) | > loss_disc_real_5: 0.3920745253562927 (0.26006588189653596) | > loss_0: 3.2568728923797607 (2.523095191741477) | > grad_norm_0: tensor(1069.7524, device='cuda:0') (tensor(657.5891, device='cuda:0')) | > loss_gen: 2.6855173110961914 (2.4443229266575397) | > loss_kl: 0.8695016503334045 (1.011489871813327) | > loss_feat: 2.97786545753479 (5.264606285460142) | > loss_mel: 22.507402420043945 (23.072604262098974) | > loss_duration: 1.8208422660827637 (1.7061599468698307) | > loss_1: 30.861129760742188 (33.49918349908323) | > grad_norm_1: tensor(9310.8516, device='cuda:0') (tensor(16112.1221, device='cuda:0')) | > current_lr_0: 0.00017145275382405195 | > current_lr_1: 0.00017145275382405195 | > step_time: 0.2597 (0.4237830687542351) | > loader_time: 0.2642 (0.02050905324974838)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.757751226425171 (2.757751226425171) | > loss_disc_real_0: 0.18720489740371704 (0.18720489740371704) | > loss_disc_real_1: 0.28933438658714294 (0.28933438658714294) | > loss_disc_real_2: 0.25442856550216675 (0.25442856550216675) | > loss_disc_real_3: 0.3367901146411896 (0.3367901146411896) | > loss_disc_real_4: 0.3500204086303711 (0.3500204086303711) | > loss_disc_real_5: 0.38402432203292847 (0.38402432203292847) | > loss_0: 2.757751226425171 (2.757751226425171) | > loss_gen: 2.3077807426452637 (2.3077807426452637) | > loss_kl: 1.9959275722503662 (1.9959275722503662) | > loss_feat: 3.0667505264282227 (3.0667505264282227) | > loss_mel: 27.051673889160156 (27.051673889160156) | > loss_duration: 2.159468412399292 (2.159468412399292) | > loss_1: 36.58160400390625 (36.58160400390625)  --> STEP: 1 | > loss_disc: 3.1126983165740967 (3.1126983165740967) | > loss_disc_real_0: 0.3109757900238037 (0.3109757900238037) | > loss_disc_real_1: 0.28559446334838867 (0.28559446334838867) | > loss_disc_real_2: 0.21151068806648254 (0.21151068806648254) | > loss_disc_real_3: 0.2793560326099396 (0.2793560326099396) | > loss_disc_real_4: 0.3096023201942444 (0.3096023201942444) | > loss_disc_real_5: 0.22407497465610504 (0.22407497465610504) | > loss_0: 3.1126983165740967 (3.1126983165740967) | > loss_gen: 1.5333008766174316 (1.5333008766174316) | > loss_kl: 3.040900707244873 (3.040900707244873) | > loss_feat: 0.20539221167564392 (0.20539221167564392) | > loss_mel: 11.695539474487305 (11.695539474487305) | > loss_duration: 2.4046032428741455 (2.4046032428741455) | > loss_1: 18.879737854003906 (18.879737854003906)  --> STEP: 2 | > loss_disc: 3.074446439743042 (3.0935723781585693) | > loss_disc_real_0: 0.24949094653129578 (0.28023336827754974) | > loss_disc_real_1: 0.27184346318244934 (0.278718963265419) | > loss_disc_real_2: 0.21287217736244202 (0.21219143271446228) | > loss_disc_real_3: 0.28050437569618225 (0.2799302041530609) | > loss_disc_real_4: 0.3112100660800934 (0.3104061931371689) | > loss_disc_real_5: 0.22434577345848083 (0.22421037405729294) | > loss_0: 3.074446439743042 (3.0935723781585693) | > loss_gen: 1.5128754377365112 (1.5230881571769714) | > loss_kl: 2.63641095161438 (2.8386558294296265) | > loss_feat: 0.3468111455440521 (0.276101678609848) | > loss_mel: 23.497291564941406 (17.596415519714355) | > loss_duration: 2.394641160964966 (2.3996222019195557) | > loss_1: 30.388031005859375 (24.63388442993164)  --> STEP: 3 | > loss_disc: 2.887788772583008 (3.0249778429667153) | > loss_disc_real_0: 0.18769124150276184 (0.24938599268595377) | > loss_disc_real_1: 0.2858523726463318 (0.28109676639238995) | > loss_disc_real_2: 0.2193375527858734 (0.214573472738266) | > loss_disc_real_3: 0.28458699584007263 (0.2814824680487315) | > loss_disc_real_4: 0.272061288356781 (0.2976245582103729) | > loss_disc_real_5: 0.243475079536438 (0.23063194255034128) | > loss_0: 2.887788772583008 (3.0249778429667153) | > loss_gen: 1.6967079639434814 (1.5809614260991414) | > loss_kl: 1.517615795135498 (2.3983091513315835) | > loss_feat: 1.1397631168365479 (0.5639888246854147) | > loss_mel: 20.725801467895508 (18.639544169108074) | > loss_duration: 2.241600513458252 (2.3469483057657876) | > loss_1: 27.321489334106445 (25.529752731323242) --> EVAL PERFORMANCE | > avg_loader_time: 0.02595218022664388 (+0.01523756980895996) | > avg_loss_disc: 3.0249778429667153 (-0.04656751950581883) | > avg_loss_disc_real_0: 0.24938599268595377 (-0.0863680491844813) | > avg_loss_disc_real_1: 0.28109676639238995 (+0.0013178139925003052) | > avg_loss_disc_real_2: 0.214573472738266 (-0.03701143463452655) | > avg_loss_disc_real_3: 0.2814824680487315 (+0.014335085948308346) | > avg_loss_disc_real_4: 0.2976245582103729 (+0.010087132453918457) | > avg_loss_disc_real_5: 0.23063194255034128 (-0.132247065504392) | > avg_loss_0: 3.0249778429667153 (-0.04656751950581883) | > avg_loss_gen: 1.5809614260991414 (-0.6486728191375735) | > avg_loss_kl: 2.3983091513315835 (-0.020813345909118652) | > avg_loss_feat: 0.5639888246854147 (-1.8246276130278902) | > avg_loss_mel: 18.639544169108074 (+2.5857555866241455) | > avg_loss_duration: 2.3469483057657876 (+0.0862576961517334) | > avg_loss_1: 25.529752731323242 (+0.1779012680053711)  > EPOCH: 155/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:20:32)   --> TIME: 2023-10-20 01:20:51 -- STEP: 29/50 -- GLOBAL_STEP: 60780 | > loss_disc: 3.0209834575653076 (2.485962723863536) | > loss_disc_real_0: 0.2433181256055832 (0.16620932166175595) | > loss_disc_real_1: 0.2354333996772766 (0.23793933900265865) | > loss_disc_real_2: 0.29470404982566833 (0.22665684785822343) | > loss_disc_real_3: 0.2703246474266052 (0.2518035617881808) | > loss_disc_real_4: 0.25284242630004883 (0.22656575127922254) | > loss_disc_real_5: 0.2588803172111511 (0.2024542172921115) | > loss_0: 3.0209834575653076 (2.485962723863536) | > grad_norm_0: tensor(125.7558, device='cuda:0') (tensor(553.2426, device='cuda:0')) | > loss_gen: 1.573768138885498 (2.342562844013345) | > loss_kl: 0.7789332270622253 (1.056510532724446) | > loss_feat: 0.0363224558532238 (5.4170926755358435) | > loss_mel: 10.31726360321045 (22.528147072627625) | > loss_duration: 1.7100366353988647 (1.7232303783811371) | > loss_1: 14.4163236618042 (33.067543999902135) | > grad_norm_1: tensor(31053.2422, device='cuda:0') (tensor(23676.1055, device='cuda:0')) | > current_lr_0: 0.00017128137606205792 | > current_lr_1: 0.00017128137606205792 | > step_time: 0.555 (0.4972323960271376) | > loader_time: 0.0119 (0.018517173569777917)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3839986324310303 (2.3839986324310303) | > loss_disc_real_0: 0.14501410722732544 (0.14501410722732544) | > loss_disc_real_1: 0.2781139314174652 (0.2781139314174652) | > loss_disc_real_2: 0.3722889721393585 (0.3722889721393585) | > loss_disc_real_3: 0.22065342962741852 (0.22065342962741852) | > loss_disc_real_4: 0.1974606066942215 (0.1974606066942215) | > loss_disc_real_5: 0.2596029043197632 (0.2596029043197632) | > loss_0: 2.3839986324310303 (2.3839986324310303) | > loss_gen: 2.5476856231689453 (2.5476856231689453) | > loss_kl: 2.0900843143463135 (2.0900843143463135) | > loss_feat: 4.946697235107422 (4.946697235107422) | > loss_mel: 23.141820907592773 (23.141820907592773) | > loss_duration: 2.139481782913208 (2.139481782913208) | > loss_1: 34.86576843261719 (34.86576843261719)  --> STEP: 1 | > loss_disc: 2.3072586059570312 (2.3072586059570312) | > loss_disc_real_0: 0.22261857986450195 (0.22261857986450195) | > loss_disc_real_1: 0.3461024761199951 (0.3461024761199951) | > loss_disc_real_2: 0.2893136143684387 (0.2893136143684387) | > loss_disc_real_3: 0.2962128221988678 (0.2962128221988678) | > loss_disc_real_4: 0.17587429285049438 (0.17587429285049438) | > loss_disc_real_5: 0.07451950758695602 (0.07451950758695602) | > loss_0: 2.3072586059570312 (2.3072586059570312) | > loss_gen: 2.7237870693206787 (2.7237870693206787) | > loss_kl: 2.7724785804748535 (2.7724785804748535) | > loss_feat: 8.353391647338867 (8.353391647338867) | > loss_mel: 26.575428009033203 (26.575428009033203) | > loss_duration: 2.316502571105957 (2.316502571105957) | > loss_1: 42.74158477783203 (42.74158477783203)  --> STEP: 2 | > loss_disc: 2.838609457015991 (2.5729340314865112) | > loss_disc_real_0: 0.3610886335372925 (0.2918536067008972) | > loss_disc_real_1: 0.2695642411708832 (0.30783335864543915) | > loss_disc_real_2: 0.35466498136520386 (0.3219892978668213) | > loss_disc_real_3: 0.25903934240341187 (0.27762608230113983) | > loss_disc_real_4: 0.18241135776042938 (0.17914282530546188) | > loss_disc_real_5: 0.28010615706443787 (0.17731283232569695) | > loss_0: 2.838609457015991 (2.5729340314865112) | > loss_gen: 2.2197492122650146 (2.4717681407928467) | > loss_kl: 2.7282586097717285 (2.750368595123291) | > loss_feat: 2.544621467590332 (5.4490065574646) | > loss_mel: 28.720130920410156 (27.64777946472168) | > loss_duration: 2.256671667098999 (2.286587119102478) | > loss_1: 38.46943283081055 (40.60550880432129)  --> STEP: 3 | > loss_disc: 3.3034088611602783 (2.816425641377767) | > loss_disc_real_0: 0.731468915939331 (0.4383920431137085) | > loss_disc_real_1: 0.3341737389564514 (0.31661348541577655) | > loss_disc_real_2: 0.37394315004348755 (0.3393072485923767) | > loss_disc_real_3: 0.1688646525144577 (0.2413722723722458) | > loss_disc_real_4: 0.3445594310760498 (0.23428169389565787) | > loss_disc_real_5: 0.3978690207004547 (0.25083156178394955) | > loss_0: 3.3034088611602783 (2.816425641377767) | > loss_gen: 2.445127010345459 (2.462887763977051) | > loss_kl: 1.724013090133667 (2.408250093460083) | > loss_feat: 2.828401565551758 (4.575471560160319) | > loss_mel: 20.010231018066406 (25.101929982503254) | > loss_duration: 2.2414143085479736 (2.27152951558431) | > loss_1: 29.249187469482422 (36.820068359375) --> EVAL PERFORMANCE | > avg_loader_time: 0.016934633255004883 (-0.009017546971638996) | > avg_loss_disc: 2.816425641377767 (-0.20855220158894827) | > avg_loss_disc_real_0: 0.4383920431137085 (+0.18900605042775473) | > avg_loss_disc_real_1: 0.31661348541577655 (+0.0355167190233866) | > avg_loss_disc_real_2: 0.3393072485923767 (+0.12473377585411072) | > avg_loss_disc_real_3: 0.2413722723722458 (-0.040110195676485716) | > avg_loss_disc_real_4: 0.23428169389565787 (-0.06334286431471506) | > avg_loss_disc_real_5: 0.25083156178394955 (+0.020199619233608274) | > avg_loss_0: 2.816425641377767 (-0.20855220158894827) | > avg_loss_gen: 2.462887763977051 (+0.8819263378779094) | > avg_loss_kl: 2.408250093460083 (+0.009940942128499497) | > avg_loss_feat: 4.575471560160319 (+4.011482735474905) | > avg_loss_mel: 25.101929982503254 (+6.46238581339518) | > avg_loss_duration: 2.27152951558431 (-0.07541879018147757) | > avg_loss_1: 36.820068359375 (+11.290315628051758)  > EPOCH: 156/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:21:11)   --> TIME: 2023-10-20 01:21:20 -- STEP: 9/50 -- GLOBAL_STEP: 60810 | > loss_disc: 2.621443033218384 (2.6065913438796997) | > loss_disc_real_0: 0.22921159863471985 (0.1726010007162889) | > loss_disc_real_1: 0.13348370790481567 (0.21579702777995002) | > loss_disc_real_2: 0.3584820628166199 (0.292946371767256) | > loss_disc_real_3: 0.3294215798377991 (0.2700085664788882) | > loss_disc_real_4: 0.3138578236103058 (0.18913152979479897) | > loss_disc_real_5: 0.20842958986759186 (0.1916165045566029) | > loss_0: 2.621443033218384 (2.6065913438796997) | > grad_norm_0: tensor(449.7979, device='cuda:0') (tensor(589.9639, device='cuda:0')) | > loss_gen: 2.3216168880462646 (2.219732231563992) | > loss_kl: 0.9279235005378723 (1.0587391588422987) | > loss_feat: 4.217606067657471 (4.976670410897997) | > loss_mel: 23.877029418945312 (24.460148493448894) | > loss_duration: 1.5882854461669922 (1.6726969612969294) | > loss_1: 32.932464599609375 (34.38798734876845) | > grad_norm_1: tensor(10377.8145, device='cuda:0') (tensor(17824.4238, device='cuda:0')) | > current_lr_0: 0.00017111016960286683 | > current_lr_1: 0.00017111016960286683 | > step_time: 0.3043 (0.3732900884416368) | > loader_time: 0.0025 (0.006940841674804687)  --> TIME: 2023-10-20 01:21:33 -- STEP: 39/50 -- GLOBAL_STEP: 60840 | > loss_disc: 2.4374890327453613 (2.5596775947472987) | > loss_disc_real_0: 0.04422455281019211 (0.16140270543595156) | > loss_disc_real_1: 0.17095257341861725 (0.23168468102812767) | > loss_disc_real_2: 0.2355954498052597 (0.2413645178461686) | > loss_disc_real_3: 0.2576580345630646 (0.23960164647835952) | > loss_disc_real_4: 0.38928744196891785 (0.22084425275142378) | > loss_disc_real_5: 0.3800276219844818 (0.20836388147794282) | > loss_0: 2.4374890327453613 (2.5596775947472987) | > grad_norm_0: tensor(1508.5662, device='cuda:0') (tensor(711.9657, device='cuda:0')) | > loss_gen: 2.575646162033081 (2.248593834730295) | > loss_kl: 0.4584867060184479 (0.9216246750110235) | > loss_feat: 4.821579456329346 (5.041120403470138) | > loss_mel: 26.267074584960938 (23.430101718658058) | > loss_duration: 1.8047614097595215 (1.705703270740998) | > loss_1: 35.927547454833984 (33.347144249158035) | > grad_norm_1: tensor(18663.3750, device='cuda:0') (tensor(21104.9551, device='cuda:0')) | > current_lr_0: 0.00017111016960286683 | > current_lr_1: 0.00017111016960286683 | > step_time: 0.589 (0.408450267253778) | > loader_time: 0.0247 (0.006895101987398588)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.400420904159546 (2.400420904159546) | > loss_disc_real_0: 0.24952548742294312 (0.24952548742294312) | > loss_disc_real_1: 0.19829601049423218 (0.19829601049423218) | > loss_disc_real_2: 0.26280897855758667 (0.26280897855758667) | > loss_disc_real_3: 0.2796345055103302 (0.2796345055103302) | > loss_disc_real_4: 0.2850792109966278 (0.2850792109966278) | > loss_disc_real_5: 0.27106955647468567 (0.27106955647468567) | > loss_0: 2.400420904159546 (2.400420904159546) | > loss_gen: 2.9712772369384766 (2.9712772369384766) | > loss_kl: 2.0050413608551025 (2.0050413608551025) | > loss_feat: 5.858738899230957 (5.858738899230957) | > loss_mel: 24.84925079345703 (24.84925079345703) | > loss_duration: 2.126763105392456 (2.126763105392456) | > loss_1: 37.811073303222656 (37.811073303222656)  --> STEP: 1 | > loss_disc: 2.459949493408203 (2.459949493408203) | > loss_disc_real_0: 0.04634195193648338 (0.04634195193648338) | > loss_disc_real_1: 0.16420596837997437 (0.16420596837997437) | > loss_disc_real_2: 0.22976528108119965 (0.22976528108119965) | > loss_disc_real_3: 0.2284170687198639 (0.2284170687198639) | > loss_disc_real_4: 0.2615848779678345 (0.2615848779678345) | > loss_disc_real_5: 0.3175823390483856 (0.3175823390483856) | > loss_0: 2.459949493408203 (2.459949493408203) | > loss_gen: 2.2946715354919434 (2.2946715354919434) | > loss_kl: 3.166250228881836 (3.166250228881836) | > loss_feat: 5.632940769195557 (5.632940769195557) | > loss_mel: 25.74798011779785 (25.74798011779785) | > loss_duration: 2.3122055530548096 (2.3122055530548096) | > loss_1: 39.154048919677734 (39.154048919677734)  --> STEP: 2 | > loss_disc: 2.0039234161376953 (2.231936454772949) | > loss_disc_real_0: 0.09100904315710068 (0.06867549754679203) | > loss_disc_real_1: 0.22554424405097961 (0.194875106215477) | > loss_disc_real_2: 0.22382867336273193 (0.2267969772219658) | > loss_disc_real_3: 0.21694371104240417 (0.22268038988113403) | > loss_disc_real_4: 0.14186851680278778 (0.20172669738531113) | > loss_disc_real_5: 0.24447709321975708 (0.28102971613407135) | > loss_0: 2.0039234161376953 (2.231936454772949) | > loss_gen: 2.697024345397949 (2.4958479404449463) | > loss_kl: 2.493046998977661 (2.8296486139297485) | > loss_feat: 6.075394630432129 (5.854167699813843) | > loss_mel: 27.681533813476562 (26.714756965637207) | > loss_duration: 2.23492169380188 (2.2735636234283447) | > loss_1: 41.181922912597656 (40.167985916137695)  --> STEP: 3 | > loss_disc: 2.6439740657806396 (2.369282325108846) | > loss_disc_real_0: 0.20558685064315796 (0.11431261524558067) | > loss_disc_real_1: 0.2520560920238495 (0.21393543481826782) | > loss_disc_real_2: 0.2161046713590622 (0.22323287526766458) | > loss_disc_real_3: 0.2405509352684021 (0.22863723834355673) | > loss_disc_real_4: 0.22132477164268494 (0.20825938880443573) | > loss_disc_real_5: 0.2170676440000534 (0.25970902542273205) | > loss_0: 2.6439740657806396 (2.369282325108846) | > loss_gen: 1.825777530670166 (2.272491137186686) | > loss_kl: 1.408889889717102 (2.356062372525533) | > loss_feat: 2.1708030700683594 (4.626379489898682) | > loss_mel: 12.155019760131836 (21.86151123046875) | > loss_duration: 2.2069804668426514 (2.2513692378997803) | > loss_1: 19.76746940612793 (33.36781374613444) --> EVAL PERFORMANCE | > avg_loader_time: 0.015920162200927734 (-0.0010144710540771484) | > avg_loss_disc: 2.369282325108846 (-0.4471433162689209) | > avg_loss_disc_real_0: 0.11431261524558067 (-0.3240794278681278) | > avg_loss_disc_real_1: 0.21393543481826782 (-0.10267805059750873) | > avg_loss_disc_real_2: 0.22323287526766458 (-0.11607437332471213) | > avg_loss_disc_real_3: 0.22863723834355673 (-0.012735034028689057) | > avg_loss_disc_real_4: 0.20825938880443573 (-0.026022305091222137) | > avg_loss_disc_real_5: 0.25970902542273205 (+0.008877463638782501) | > avg_loss_0: 2.369282325108846 (-0.4471433162689209) | > avg_loss_gen: 2.272491137186686 (-0.19039662679036473) | > avg_loss_kl: 2.356062372525533 (-0.05218772093454982) | > avg_loss_feat: 4.626379489898682 (+0.050907929738362334) | > avg_loss_mel: 21.86151123046875 (-3.240418752034504) | > avg_loss_duration: 2.2513692378997803 (-0.02016027768452977) | > avg_loss_1: 33.36781374613444 (-3.4522546132405623)  > EPOCH: 157/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:21:49)   --> TIME: 2023-10-20 01:22:04 -- STEP: 19/50 -- GLOBAL_STEP: 60870 | > loss_disc: 1.2593084573745728 (2.3777010315342952) | > loss_disc_real_0: 0.01812196522951126 (0.15049335782073045) | > loss_disc_real_1: 0.101437047123909 (0.21609050849158512) | > loss_disc_real_2: 0.07307160645723343 (0.21983535568180837) | > loss_disc_real_3: 0.1915006786584854 (0.22063591870430269) | > loss_disc_real_4: 0.06532807648181915 (0.2105866886283222) | > loss_disc_real_5: 0.08928816765546799 (0.1872297603833048) | > loss_0: 1.2593084573745728 (2.3777010315342952) | > grad_norm_0: tensor(232.4999, device='cuda:0') (tensor(761.3207, device='cuda:0')) | > loss_gen: 3.222386360168457 (2.4062826507969906) | > loss_kl: 1.097970962524414 (0.9683635109349301) | > loss_feat: 10.974212646484375 (5.132624088933594) | > loss_mel: 26.712873458862305 (20.318911828492816) | > loss_duration: 1.8498753309249878 (1.7507239329187494) | > loss_1: 43.85731887817383 (30.576905827773246) | > grad_norm_1: tensor(46407.9375, device='cuda:0') (tensor(27697.6055, device='cuda:0')) | > current_lr_0: 0.00017093913427525086 | > current_lr_1: 0.00017093913427525086 | > step_time: 0.5998 (0.504112394232499) | > loader_time: 0.0229 (0.02125146514491031)  --> TIME: 2023-10-20 01:22:17 -- STEP: 49/50 -- GLOBAL_STEP: 60900 | > loss_disc: 2.547503709793091 (2.3876193104958054) | > loss_disc_real_0: 0.2280709147453308 (0.15313452862355179) | > loss_disc_real_1: 0.1199447438120842 (0.22544368884849306) | > loss_disc_real_2: 0.25631675124168396 (0.22241534756458536) | > loss_disc_real_3: 0.16974905133247375 (0.22297088752443694) | > loss_disc_real_4: 0.21622538566589355 (0.2112665051708416) | > loss_disc_real_5: 0.22938278317451477 (0.1997164473393742) | > loss_0: 2.547503709793091 (2.3876193104958054) | > grad_norm_0: tensor(646.7548, device='cuda:0') (tensor(638.8929, device='cuda:0')) | > loss_gen: 2.5551061630249023 (2.3823424431742453) | > loss_kl: 0.9956566095352173 (0.9524502377120816) | > loss_feat: 5.879691123962402 (5.188603395558133) | > loss_mel: 25.605453491210938 (22.150143102723725) | > loss_duration: 1.8222949504852295 (1.7081741289216645) | > loss_1: 36.85820388793945 (32.3817131373347) | > grad_norm_1: tensor(35619.6523, device='cuda:0') (tensor(20552.4336, device='cuda:0')) | > current_lr_0: 0.00017093913427525086 | > current_lr_1: 0.00017093913427525086 | > step_time: 0.2914 (0.44941867614278985) | > loader_time: 0.3486 (0.022578507053608796)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0788121223449707 (3.0788121223449707) | > loss_disc_real_0: 0.16317176818847656 (0.16317176818847656) | > loss_disc_real_1: 0.11997053027153015 (0.11997053027153015) | > loss_disc_real_2: 0.09760481119155884 (0.09760481119155884) | > loss_disc_real_3: 0.22358381748199463 (0.22358381748199463) | > loss_disc_real_4: 0.0975857526063919 (0.0975857526063919) | > loss_disc_real_5: 0.11123880743980408 (0.11123880743980408) | > loss_0: 3.0788121223449707 (3.0788121223449707) | > loss_gen: 1.429049015045166 (1.429049015045166) | > loss_kl: 2.3961658477783203 (2.3961658477783203) | > loss_feat: 9.1023588180542 (9.1023588180542) | > loss_mel: 27.907384872436523 (27.907384872436523) | > loss_duration: 2.2228152751922607 (2.2228152751922607) | > loss_1: 43.057777404785156 (43.057777404785156)  --> STEP: 1 | > loss_disc: 2.138810634613037 (2.138810634613037) | > loss_disc_real_0: 0.23958247900009155 (0.23958247900009155) | > loss_disc_real_1: 0.14091992378234863 (0.14091992378234863) | > loss_disc_real_2: 0.13239015638828278 (0.13239015638828278) | > loss_disc_real_3: 0.13922397792339325 (0.13922397792339325) | > loss_disc_real_4: 0.04088921472430229 (0.04088921472430229) | > loss_disc_real_5: 0.05324099212884903 (0.05324099212884903) | > loss_0: 2.138810634613037 (2.138810634613037) | > loss_gen: 1.8244417905807495 (1.8244417905807495) | > loss_kl: 2.8300440311431885 (2.8300440311431885) | > loss_feat: 7.589348793029785 (7.589348793029785) | > loss_mel: 25.443578720092773 (25.443578720092773) | > loss_duration: 2.461329460144043 (2.461329460144043) | > loss_1: 40.14874267578125 (40.14874267578125)  --> STEP: 2 | > loss_disc: 2.421109914779663 (2.27996027469635) | > loss_disc_real_0: 0.08519019186496735 (0.16238633543252945) | > loss_disc_real_1: 0.0672985389828682 (0.10410923138260841) | > loss_disc_real_2: 0.04075571894645691 (0.08657293766736984) | > loss_disc_real_3: 0.1100420281291008 (0.12463300302624702) | > loss_disc_real_4: 0.020642340183258057 (0.030765777453780174) | > loss_disc_real_5: 0.0465116873383522 (0.049876339733600616) | > loss_0: 2.421109914779663 (2.27996027469635) | > loss_gen: 1.5168778896331787 (1.6706598401069641) | > loss_kl: 2.2527997493743896 (2.541421890258789) | > loss_feat: 10.6361083984375 (9.112728595733643) | > loss_mel: 28.36896514892578 (26.906271934509277) | > loss_duration: 2.3502140045166016 (2.4057717323303223) | > loss_1: 45.124961853027344 (42.6368522644043)  --> STEP: 3 | > loss_disc: 1.9562104940414429 (2.1720436811447144) | > loss_disc_real_0: 0.06869328767061234 (0.1311553195118904) | > loss_disc_real_1: 0.11961660534143448 (0.10927835603555043) | > loss_disc_real_2: 0.10847123712301254 (0.09387237081925075) | > loss_disc_real_3: 0.10914578288793564 (0.11947059631347656) | > loss_disc_real_4: 0.01784740388393402 (0.026459652930498123) | > loss_disc_real_5: 0.012384789064526558 (0.0373791561772426) | > loss_0: 1.9562104940414429 (2.1720436811447144) | > loss_gen: 2.037276029586792 (1.79286523660024) | > loss_kl: 1.3803775310516357 (2.1544071038564048) | > loss_feat: 7.893851280212402 (8.706436157226562) | > loss_mel: 27.994035720825195 (27.26885986328125) | > loss_duration: 2.3285770416259766 (2.380040168762207) | > loss_1: 41.634117126464844 (42.30260721842448) --> EVAL PERFORMANCE | > avg_loader_time: 0.013729492823282877 (-0.0021906693776448573) | > avg_loss_disc: 2.1720436811447144 (-0.19723864396413182) | > avg_loss_disc_real_0: 0.1311553195118904 (+0.016842704266309738) | > avg_loss_disc_real_1: 0.10927835603555043 (-0.10465707878271739) | > avg_loss_disc_real_2: 0.09387237081925075 (-0.12936050444841385) | > avg_loss_disc_real_3: 0.11947059631347656 (-0.10916664203008017) | > avg_loss_disc_real_4: 0.026459652930498123 (-0.1817997358739376) | > avg_loss_disc_real_5: 0.0373791561772426 (-0.22232986924548945) | > avg_loss_0: 2.1720436811447144 (-0.19723864396413182) | > avg_loss_gen: 1.79286523660024 (-0.47962590058644605) | > avg_loss_kl: 2.1544071038564048 (-0.20165526866912842) | > avg_loss_feat: 8.706436157226562 (+4.080056667327881) | > avg_loss_mel: 27.26885986328125 (+5.4073486328125) | > avg_loss_duration: 2.380040168762207 (+0.12867093086242676) | > avg_loss_1: 42.30260721842448 (+8.934793472290039)  > EPOCH: 158/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:22:29)   --> TIME: 2023-10-20 01:22:48 -- STEP: 29/50 -- GLOBAL_STEP: 60930 | > loss_disc: 2.8197312355041504 (2.627676404755691) | > loss_disc_real_0: 0.17831555008888245 (0.24145549323795168) | > loss_disc_real_1: 0.29687872529029846 (0.24708899881305366) | > loss_disc_real_2: 0.24004310369491577 (0.2250252820808312) | > loss_disc_real_3: 0.2643447518348694 (0.25355268834993755) | > loss_disc_real_4: 0.3167392909526825 (0.22342640842343198) | > loss_disc_real_5: 0.2722514867782593 (0.2201948925082026) | > loss_0: 2.8197312355041504 (2.627676404755691) | > grad_norm_0: tensor(566.1624, device='cuda:0') (tensor(883.7876, device='cuda:0')) | > loss_gen: 1.8068076372146606 (2.5465153250200996) | > loss_kl: 0.7499377131462097 (1.0310685120779892) | > loss_feat: 0.5295043587684631 (5.656573008039389) | > loss_mel: 8.688446998596191 (23.50314164161682) | > loss_duration: 1.6684411764144897 (1.7237276126598489) | > loss_1: 13.443137168884277 (34.46102629036739) | > grad_norm_1: tensor(12015.9727, device='cuda:0') (tensor(27269.2148, device='cuda:0')) | > current_lr_0: 0.00017076826990815322 | > current_lr_1: 0.00017076826990815322 | > step_time: 0.6836 (0.49779127384054256) | > loader_time: 0.0244 (0.020631954587739084)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7800211906433105 (1.7800211906433105) | > loss_disc_real_0: 0.11043542623519897 (0.11043542623519897) | > loss_disc_real_1: 0.31243157386779785 (0.31243157386779785) | > loss_disc_real_2: 0.1721504181623459 (0.1721504181623459) | > loss_disc_real_3: 0.22428059577941895 (0.22428059577941895) | > loss_disc_real_4: 0.20073822140693665 (0.20073822140693665) | > loss_disc_real_5: 0.061197951436042786 (0.061197951436042786) | > loss_0: 1.7800211906433105 (1.7800211906433105) | > loss_gen: 3.177668809890747 (3.177668809890747) | > loss_kl: 2.2073895931243896 (2.2073895931243896) | > loss_feat: 7.589665412902832 (7.589665412902832) | > loss_mel: 24.18463134765625 (24.18463134765625) | > loss_duration: 2.155588388442993 (2.155588388442993) | > loss_1: 39.314945220947266 (39.314945220947266)  --> STEP: 1 | > loss_disc: 2.9067134857177734 (2.9067134857177734) | > loss_disc_real_0: 0.20861601829528809 (0.20861601829528809) | > loss_disc_real_1: 0.2448980063199997 (0.2448980063199997) | > loss_disc_real_2: 0.23465673625469208 (0.23465673625469208) | > loss_disc_real_3: 0.2552671730518341 (0.2552671730518341) | > loss_disc_real_4: 0.3433244824409485 (0.3433244824409485) | > loss_disc_real_5: 0.3325803279876709 (0.3325803279876709) | > loss_0: 2.9067134857177734 (2.9067134857177734) | > loss_gen: 1.7587857246398926 (1.7587857246398926) | > loss_kl: 2.6352429389953613 (2.6352429389953613) | > loss_feat: 0.7342284917831421 (0.7342284917831421) | > loss_mel: 16.946990966796875 (16.946990966796875) | > loss_duration: 2.3403892517089844 (2.3403892517089844) | > loss_1: 24.415637969970703 (24.415637969970703)  --> STEP: 2 | > loss_disc: 2.7799723148345947 (2.843342900276184) | > loss_disc_real_0: 0.009593062102794647 (0.10910454019904137) | > loss_disc_real_1: 0.11612352728843689 (0.1805107668042183) | > loss_disc_real_2: 0.07838425040245056 (0.15652049332857132) | > loss_disc_real_3: 0.14162689447402954 (0.19844703376293182) | > loss_disc_real_4: 0.18114130198955536 (0.2622328922152519) | > loss_disc_real_5: 0.34102725982666016 (0.3368037939071655) | > loss_0: 2.7799723148345947 (2.843342900276184) | > loss_gen: 1.3913447856903076 (1.5750652551651) | > loss_kl: 3.0326995849609375 (2.8339712619781494) | > loss_feat: 8.544547080993652 (4.639387786388397) | > loss_mel: 26.05336570739746 (21.500178337097168) | > loss_duration: 2.283599615097046 (2.311994433403015) | > loss_1: 41.30555725097656 (32.86059761047363)  --> STEP: 3 | > loss_disc: 2.3026864528656006 (2.6631240844726562) | > loss_disc_real_0: 0.18617525696754456 (0.13479477912187576) | > loss_disc_real_1: 0.3979230225086212 (0.2529815187056859) | > loss_disc_real_2: 0.26805856823921204 (0.19369985163211823) | > loss_disc_real_3: 0.28831225633621216 (0.22840210795402527) | > loss_disc_real_4: 0.2716841697692871 (0.265383318066597) | > loss_disc_real_5: 0.23582075536251068 (0.30314278105894726) | > loss_0: 2.3026864528656006 (2.6631240844726562) | > loss_gen: 2.9393913745880127 (2.029840628306071) | > loss_kl: 1.751060128211975 (2.4730008840560913) | > loss_feat: 4.172621250152588 (4.4837989409764605) | > loss_mel: 28.130306243896484 (23.71022097269694) | > loss_duration: 2.331420660018921 (2.318469842274984) | > loss_1: 39.324798583984375 (35.01533126831055) --> EVAL PERFORMANCE | > avg_loader_time: 0.010840654373168945 (-0.0028888384501139317) | > avg_loss_disc: 2.6631240844726562 (+0.4910804033279419) | > avg_loss_disc_real_0: 0.13479477912187576 (+0.0036394596099853516) | > avg_loss_disc_real_1: 0.2529815187056859 (+0.1437031626701355) | > avg_loss_disc_real_2: 0.19369985163211823 (+0.09982748081286748) | > avg_loss_disc_real_3: 0.22840210795402527 (+0.1089315116405487) | > avg_loss_disc_real_4: 0.265383318066597 (+0.23892366513609886) | > avg_loss_disc_real_5: 0.30314278105894726 (+0.2657636248817047) | > avg_loss_0: 2.6631240844726562 (+0.4910804033279419) | > avg_loss_gen: 2.029840628306071 (+0.23697539170583082) | > avg_loss_kl: 2.4730008840560913 (+0.31859378019968654) | > avg_loss_feat: 4.4837989409764605 (-4.222637216250102) | > avg_loss_mel: 23.71022097269694 (-3.5586388905843087) | > avg_loss_duration: 2.318469842274984 (-0.06157032648722316) | > avg_loss_1: 35.01533126831055 (-7.28727595011393)  > EPOCH: 159/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:23:10)   --> TIME: 2023-10-20 01:23:18 -- STEP: 9/50 -- GLOBAL_STEP: 60960 | > loss_disc: 2.608823776245117 (2.422949367099338) | > loss_disc_real_0: 0.1547868698835373 (0.13102119540174803) | > loss_disc_real_1: 0.18994081020355225 (0.20161894294950697) | > loss_disc_real_2: 0.33625343441963196 (0.20066222382916343) | > loss_disc_real_3: 0.2712135910987854 (0.2201719938053025) | > loss_disc_real_4: 0.37727946043014526 (0.21851448611252838) | > loss_disc_real_5: 0.32836225628852844 (0.2304503247141838) | > loss_0: 2.608823776245117 (2.422949367099338) | > grad_norm_0: tensor(558.0666, device='cuda:0') (tensor(725.0541, device='cuda:0')) | > loss_gen: 2.5863919258117676 (2.4072220060560436) | > loss_kl: 1.4593796730041504 (0.9964057521687614) | > loss_feat: 2.9649970531463623 (6.473515702618493) | > loss_mel: 28.420286178588867 (23.657265424728394) | > loss_duration: 1.6728181838989258 (1.6898959742652044) | > loss_1: 37.1038703918457 (35.22430366939969) | > grad_norm_1: tensor(8045.2749, device='cuda:0') (tensor(19459.3926, device='cuda:0')) | > current_lr_0: 0.00017059757633068823 | > current_lr_1: 0.00017059757633068823 | > step_time: 0.2467 (0.293938504325019) | > loader_time: 0.0018 (0.00671643680996365)  --> TIME: 2023-10-20 01:23:34 -- STEP: 39/50 -- GLOBAL_STEP: 60990 | > loss_disc: 3.007507562637329 (2.623143718792842) | > loss_disc_real_0: 0.2371528595685959 (0.1843166618775099) | > loss_disc_real_1: 0.2316778302192688 (0.23733173205684394) | > loss_disc_real_2: 0.2277858704328537 (0.23397207670868972) | > loss_disc_real_3: 0.24605509638786316 (0.22060419518787128) | > loss_disc_real_4: 0.2468758076429367 (0.2529439796717503) | > loss_disc_real_5: 0.2710978388786316 (0.2752564199841939) | > loss_0: 3.007507562637329 (2.623143718792842) | > grad_norm_0: tensor(682.5246, device='cuda:0') (tensor(686.5839, device='cuda:0')) | > loss_gen: 1.4746310710906982 (2.2692978382110596) | > loss_kl: 1.3459442853927612 (1.0596627680919108) | > loss_feat: 0.04450632259249687 (4.483502140507484) | > loss_mel: 1.989091157913208 (22.02570583881476) | > loss_duration: 1.7666534185409546 (1.7033104590880566) | > loss_1: 6.620826244354248 (31.54147871946677) | > grad_norm_1: tensor(19542.8438, device='cuda:0') (tensor(17317.3906, device='cuda:0')) | > current_lr_0: 0.00017059757633068823 | > current_lr_1: 0.00017059757633068823 | > step_time: 0.593 (0.4602212416820037) | > loader_time: 0.0246 (0.012765621527647361)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.437727689743042 (2.437727689743042) | > loss_disc_real_0: 0.15664613246917725 (0.15664613246917725) | > loss_disc_real_1: 0.0777122974395752 (0.0777122974395752) | > loss_disc_real_2: 0.126029372215271 (0.126029372215271) | > loss_disc_real_3: 0.1407892256975174 (0.1407892256975174) | > loss_disc_real_4: 0.1709967404603958 (0.1709967404603958) | > loss_disc_real_5: 0.21399252116680145 (0.21399252116680145) | > loss_0: 2.437727689743042 (2.437727689743042) | > loss_gen: 1.9950069189071655 (1.9950069189071655) | > loss_kl: 1.8479429483413696 (1.8479429483413696) | > loss_feat: 5.401937007904053 (5.401937007904053) | > loss_mel: 24.76856231689453 (24.76856231689453) | > loss_duration: 2.1558165550231934 (2.1558165550231934) | > loss_1: 36.16926193237305 (36.16926193237305)  --> STEP: 1 | > loss_disc: 2.5898702144622803 (2.5898702144622803) | > loss_disc_real_0: 0.14987841248512268 (0.14987841248512268) | > loss_disc_real_1: 0.307120680809021 (0.307120680809021) | > loss_disc_real_2: 0.27032333612442017 (0.27032333612442017) | > loss_disc_real_3: 0.21089354157447815 (0.21089354157447815) | > loss_disc_real_4: 0.15895158052444458 (0.15895158052444458) | > loss_disc_real_5: 0.13758912682533264 (0.13758912682533264) | > loss_0: 2.5898702144622803 (2.5898702144622803) | > loss_gen: 2.1571085453033447 (2.1571085453033447) | > loss_kl: 2.4950687885284424 (2.4950687885284424) | > loss_feat: 4.9107794761657715 (4.9107794761657715) | > loss_mel: 25.645172119140625 (25.645172119140625) | > loss_duration: 2.259300708770752 (2.259300708770752) | > loss_1: 37.467430114746094 (37.467430114746094)  --> STEP: 2 | > loss_disc: 2.8140668869018555 (2.701968550682068) | > loss_disc_real_0: 0.25435957312583923 (0.20211899280548096) | > loss_disc_real_1: 0.1309197098016739 (0.21902019530534744) | > loss_disc_real_2: 0.1312638819217682 (0.20079360902309418) | > loss_disc_real_3: 0.12364213913679123 (0.1672678403556347) | > loss_disc_real_4: 0.1398155689239502 (0.1493835747241974) | > loss_disc_real_5: 0.2893460690975189 (0.21346759796142578) | > loss_0: 2.8140668869018555 (2.701968550682068) | > loss_gen: 1.767109990119934 (1.9621092677116394) | > loss_kl: 2.7123405933380127 (2.6037046909332275) | > loss_feat: 6.902230262756348 (5.90650486946106) | > loss_mel: 23.245811462402344 (24.445491790771484) | > loss_duration: 2.330430030822754 (2.294865369796753) | > loss_1: 36.95792007446289 (37.21267509460449)  --> STEP: 3 | > loss_disc: 2.250149726867676 (2.5513622760772705) | > loss_disc_real_0: 0.1312635838985443 (0.17850052316983542) | > loss_disc_real_1: 0.2026945948600769 (0.21357832849025726) | > loss_disc_real_2: 0.18918277323246002 (0.19692333042621613) | > loss_disc_real_3: 0.10568048804998398 (0.14673872292041779) | > loss_disc_real_4: 0.18346568942070007 (0.16074427962303162) | > loss_disc_real_5: 0.2554694712162018 (0.22746822237968445) | > loss_0: 2.250149726867676 (2.5513622760772705) | > loss_gen: 2.2184059619903564 (2.0475414991378784) | > loss_kl: 1.5844297409057617 (2.2639463742574057) | > loss_feat: 5.534762859344482 (5.782590866088867) | > loss_mel: 24.427221298217773 (24.439401626586914) | > loss_duration: 2.141376256942749 (2.2437023321787515) | > loss_1: 35.90619659423828 (36.777182261149086) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_61000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.970578193664551 (2.6561662554740906) | > loss_disc_real_0: 0.2761269211769104 (0.20290712267160416) | > loss_disc_real_1: 0.1234888806939125 (0.19105596654117107) | > loss_disc_real_2: 0.25678423047065735 (0.21188855543732643) | > loss_disc_real_3: 0.12791895866394043 (0.14203378185629845) | > loss_disc_real_4: 0.31373560428619385 (0.19899211078882217) | > loss_disc_real_5: 0.3715493083000183 (0.2634884938597679) | > loss_0: 2.970578193664551 (2.6561662554740906) | > loss_gen: 1.9099886417388916 (2.0131532847881317) | > loss_kl: 1.5064918994903564 (2.0745827555656433) | > loss_feat: 6.9603753089904785 (6.07703697681427) | > loss_mel: 24.281007766723633 (24.399803161621094) | > loss_duration: 2.1743857860565186 (2.2263731956481934) | > loss_1: 36.83224868774414 (36.79094886779785)  --> STEP: 1 | > loss_disc: 2.124026298522949 (2.5497382640838624) | > loss_disc_real_0: 0.039734236896038055 (0.17027254551649093) | > loss_disc_real_1: 0.1874702423810959 (0.19033882170915603) | > loss_disc_real_2: 0.21027685701847076 (0.2115662157535553) | > loss_disc_real_3: 0.0863364189863205 (0.13089430928230286) | > loss_disc_real_4: 0.11735887825489044 (0.18266546428203584) | > loss_disc_real_5: 0.021118106320500374 (0.2150144163519144) | > loss_0: 2.124026298522949 (2.5497382640838624) | > loss_gen: 1.783460021018982 (1.9672146320343018) | > loss_kl: 3.1223857402801514 (2.284143352508545) | > loss_feat: 10.237509727478027 (6.9091315269470215) | > loss_mel: 28.76827621459961 (25.273497772216796) | > loss_duration: 2.357215642929077 (2.25254168510437) | > loss_1: 46.26884841918945 (38.68652877807617)  --> STEP: 2 | > loss_disc: 3.086432933807373 (2.6391873757044473) | > loss_disc_real_0: 0.22646251320838928 (0.17963754013180733) | > loss_disc_real_1: 0.2408134639263153 (0.19875126207868257) | > loss_disc_real_2: 0.2668825089931488 (0.2207855979601542) | > loss_disc_real_3: 0.25448334217071533 (0.1514924814303716) | > loss_disc_real_4: 0.24934548139572144 (0.1937788004676501) | > loss_disc_real_5: 0.22149109840393066 (0.21609386336058378) | > loss_0: 3.086432933807373 (2.6391873757044473) | > loss_gen: 1.425540566444397 (1.8769356211026509) | > loss_kl: 2.4822349548339844 (2.3171586195627847) | > loss_feat: 0.6878211498260498 (5.872246464093526) | > loss_mel: 26.07398796081543 (25.406912803649902) | > loss_duration: 2.3558387756347656 (2.269757866859436) | > loss_1: 33.025421142578125 (37.7430108388265)  --> STEP: 3 | > loss_disc: 1.3638200759887695 (2.456992047173636) | > loss_disc_real_0: 0.05630373954772949 (0.16201842576265335) | > loss_disc_real_1: 0.03466903418302536 (0.1753109438078744) | > loss_disc_real_2: 0.012186646461486816 (0.19098574774605886) | > loss_disc_real_3: 0.054825667291879654 (0.13768293655344419) | > loss_disc_real_4: 0.20273371040821075 (0.19505807331630162) | > loss_disc_real_5: 0.03459300473332405 (0.19016516927097524) | > loss_0: 1.3638200759887695 (2.456992047173636) | > loss_gen: 2.4373536109924316 (1.9569953339440482) | > loss_kl: 1.3814992904663086 (2.183493001120431) | > loss_feat: 12.002403259277344 (6.7479831491197855) | > loss_mel: 38.05484390258789 (27.213760103498185) | > loss_duration: 2.171292543411255 (2.2556913920811246) | > loss_1: 56.047393798828125 (40.3579226902553) --> EVAL PERFORMANCE | > avg_loader_time: 0.3186890738351004 (+0.3078484194619315) | > avg_loss_disc: 2.456992047173636 (-0.20613203729902008) | > avg_loss_disc_real_0: 0.16201842576265335 (+0.027223646640777588) | > avg_loss_disc_real_1: 0.1753109438078744 (-0.07767057489781151) | > avg_loss_disc_real_2: 0.19098574774605886 (-0.0027141038860593603) | > avg_loss_disc_real_3: 0.13768293655344419 (-0.09071917140058108) | > avg_loss_disc_real_4: 0.19505807331630162 (-0.07032524475029536) | > avg_loss_disc_real_5: 0.19016516927097524 (-0.11297761178797203) | > avg_loss_0: 2.456992047173636 (-0.20613203729902008) | > avg_loss_gen: 1.9569953339440482 (-0.07284529436202258) | > avg_loss_kl: 2.183493001120431 (-0.2895078829356601) | > avg_loss_feat: 6.7479831491197855 (+2.264184208143325) | > avg_loss_mel: 27.213760103498185 (+3.5035391308012436) | > avg_loss_duration: 2.2556913920811246 (-0.0627784501938593) | > avg_loss_1: 40.3579226902553 (+5.3425914219447534)  > EPOCH: 160/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:23:55)   --> TIME: 2023-10-20 01:24:07 -- STEP: 19/50 -- GLOBAL_STEP: 61020 | > loss_disc: 2.0256009101867676 (2.5297557303780005) | > loss_disc_real_0: 0.09185077250003815 (0.1502901356863348) | > loss_disc_real_1: 0.27410364151000977 (0.23893059868561595) | > loss_disc_real_2: 0.3333640992641449 (0.2230994664132595) | > loss_disc_real_3: 0.23328737914562225 (0.24491766095161438) | > loss_disc_real_4: 0.12051504850387573 (0.207312754306354) | > loss_disc_real_5: 0.09657905995845795 (0.18117438697893368) | > loss_0: 2.0256009101867676 (2.5297557303780005) | > grad_norm_0: tensor(271.0819, device='cuda:0') (tensor(422.3145, device='cuda:0')) | > loss_gen: 2.5579562187194824 (2.0676274111396387) | > loss_kl: 1.1826921701431274 (1.0495759217362655) | > loss_feat: 4.777908802032471 (3.7340819802331295) | > loss_mel: 23.9800968170166 (21.112060433939885) | > loss_duration: 1.859581470489502 (1.7463642860713757) | > loss_1: 34.35823440551758 (29.709709719607705) | > grad_norm_1: tensor(16514.8516, device='cuda:0') (tensor(18726.0293, device='cuda:0')) | > current_lr_0: 0.00017042705337214092 | > current_lr_1: 0.00017042705337214092 | > step_time: 0.3708 (0.41194362389413935) | > loader_time: 0.0089 (0.014509891208849456)  --> TIME: 2023-10-20 01:24:21 -- STEP: 49/50 -- GLOBAL_STEP: 61050 | > loss_disc: 3.093939781188965 (2.4818357618487616) | > loss_disc_real_0: 0.13109329342842102 (0.16556461976498973) | > loss_disc_real_1: 0.23071084916591644 (0.22704791809831346) | > loss_disc_real_2: 0.13799718022346497 (0.21073043475649794) | > loss_disc_real_3: 0.3808231055736542 (0.23240078362275143) | > loss_disc_real_4: 0.24651068449020386 (0.22472728401118394) | > loss_disc_real_5: 0.45647338032722473 (0.1996053947629977) | > loss_0: 3.093939781188965 (2.4818357618487616) | > grad_norm_0: tensor(343.9803, device='cuda:0') (tensor(545.1960, device='cuda:0')) | > loss_gen: 2.2206666469573975 (2.202855903275159) | > loss_kl: 0.6062904000282288 (0.9548789925721223) | > loss_feat: 4.403141498565674 (4.469650836015236) | > loss_mel: 30.055133819580078 (22.233443177476218) | > loss_duration: 1.7634207010269165 (1.710184939053594) | > loss_1: 39.04865264892578 (31.571013917728347) | > grad_norm_1: tensor(19244.3770, device='cuda:0') (tensor(17516.3945, device='cuda:0')) | > current_lr_0: 0.00017042705337214092 | > current_lr_1: 0.00017042705337214092 | > step_time: 0.3398 (0.4347778437088947) | > loader_time: 0.4149 (0.020135349156905197)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.637299060821533 (2.637299060821533) | > loss_disc_real_0: 0.17229242622852325 (0.17229242622852325) | > loss_disc_real_1: 0.20132245123386383 (0.20132245123386383) | > loss_disc_real_2: 0.43675464391708374 (0.43675464391708374) | > loss_disc_real_3: 0.27624958753585815 (0.27624958753585815) | > loss_disc_real_4: 0.3675917983055115 (0.3675917983055115) | > loss_disc_real_5: 0.2859555184841156 (0.2859555184841156) | > loss_0: 2.637299060821533 (2.637299060821533) | > loss_gen: 2.6544852256774902 (2.6544852256774902) | > loss_kl: 1.732798457145691 (1.732798457145691) | > loss_feat: 5.062140941619873 (5.062140941619873) | > loss_mel: 25.269813537597656 (25.269813537597656) | > loss_duration: 2.1504836082458496 (2.1504836082458496) | > loss_1: 36.869720458984375 (36.869720458984375)  --> STEP: 1 | > loss_disc: 2.245237350463867 (2.245237350463867) | > loss_disc_real_0: 0.15558022260665894 (0.15558022260665894) | > loss_disc_real_1: 0.17762884497642517 (0.17762884497642517) | > loss_disc_real_2: 0.2485981434583664 (0.2485981434583664) | > loss_disc_real_3: 0.25392428040504456 (0.25392428040504456) | > loss_disc_real_4: 0.23013673722743988 (0.23013673722743988) | > loss_disc_real_5: 0.360132098197937 (0.360132098197937) | > loss_0: 2.245237350463867 (2.245237350463867) | > loss_gen: 3.574456214904785 (3.574456214904785) | > loss_kl: 2.3642165660858154 (2.3642165660858154) | > loss_feat: 7.913354873657227 (7.913354873657227) | > loss_mel: 24.984588623046875 (24.984588623046875) | > loss_duration: 2.305999517440796 (2.305999517440796) | > loss_1: 41.142616271972656 (41.142616271972656)  --> STEP: 2 | > loss_disc: 1.454867959022522 (1.8500526547431946) | > loss_disc_real_0: 0.046030089259147644 (0.10080515593290329) | > loss_disc_real_1: 0.060539279133081436 (0.1190840620547533) | > loss_disc_real_2: 0.09059500694274902 (0.1695965752005577) | > loss_disc_real_3: 0.13915230333805084 (0.1965382918715477) | > loss_disc_real_4: 0.11092059314250946 (0.17052866518497467) | > loss_disc_real_5: 0.10582791268825531 (0.23298000544309616) | > loss_0: 1.454867959022522 (1.8500526547431946) | > loss_gen: 2.7066123485565186 (3.140534281730652) | > loss_kl: 2.873013973236084 (2.6186152696609497) | > loss_feat: 9.506614685058594 (8.70998477935791) | > loss_mel: 25.114316940307617 (25.049452781677246) | > loss_duration: 2.3237991333007812 (2.3148993253707886) | > loss_1: 42.524356842041016 (41.833486557006836)  --> STEP: 3 | > loss_disc: 2.3379905223846436 (2.0126986106236777) | > loss_disc_real_0: 0.3974195122718811 (0.1996766080458959) | > loss_disc_real_1: 0.21285267174243927 (0.15034026528398195) | > loss_disc_real_2: 0.1148189827799797 (0.1513373777270317) | > loss_disc_real_3: 0.21922098100185394 (0.20409918824831644) | > loss_disc_real_4: 0.14912839233875275 (0.1633952409029007) | > loss_disc_real_5: 0.019270727410912514 (0.16174357943236828) | > loss_0: 2.3379905223846436 (2.0126986106236777) | > loss_gen: 2.3081002235412598 (2.863056262334188) | > loss_kl: 1.1551209688186646 (2.1307838360468545) | > loss_feat: 5.3113932609558105 (7.577120939890544) | > loss_mel: 26.827198028564453 (25.64203453063965) | > loss_duration: 2.1331350803375244 (2.2543112436930337) | > loss_1: 37.73495101928711 (40.467308044433594) --> EVAL PERFORMANCE | > avg_loader_time: 0.002111037572224935 (-0.3165780362628755) | > avg_loss_disc: 2.0126986106236777 (-0.44429343654995845) | > avg_loss_disc_real_0: 0.1996766080458959 (+0.03765818228324255) | > avg_loss_disc_real_1: 0.15034026528398195 (-0.024970678523892453) | > avg_loss_disc_real_2: 0.1513373777270317 (-0.03964837001902716) | > avg_loss_disc_real_3: 0.20409918824831644 (+0.06641625169487225) | > avg_loss_disc_real_4: 0.1633952409029007 (-0.031662832413400926) | > avg_loss_disc_real_5: 0.16174357943236828 (-0.02842158983860696) | > avg_loss_0: 2.0126986106236777 (-0.44429343654995845) | > avg_loss_gen: 2.863056262334188 (+0.9060609283901397) | > avg_loss_kl: 2.1307838360468545 (-0.0527091650735767) | > avg_loss_feat: 7.577120939890544 (+0.8291377907707584) | > avg_loss_mel: 25.64203453063965 (-1.5717255728585364) | > avg_loss_duration: 2.2543112436930337 (-0.0013801483880908627) | > avg_loss_1: 40.467308044433594 (+0.10938535417829343)  > EPOCH: 161/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:24:31)   --> TIME: 2023-10-20 01:24:50 -- STEP: 29/50 -- GLOBAL_STEP: 61080 | > loss_disc: 2.362579584121704 (2.431853631447102) | > loss_disc_real_0: 0.05410248041152954 (0.15999764493056412) | > loss_disc_real_1: 0.27594491839408875 (0.21346230098399624) | > loss_disc_real_2: 0.12377897650003433 (0.22913086619870415) | > loss_disc_real_3: 0.20089028775691986 (0.22215152095104085) | > loss_disc_real_4: 0.27380868792533875 (0.2172717845131611) | > loss_disc_real_5: 0.12281806021928787 (0.2507003101295439) | > loss_0: 2.362579584121704 (2.431853631447102) | > grad_norm_0: tensor(634.2546, device='cuda:0') (tensor(552.1619, device='cuda:0')) | > loss_gen: 2.0553908348083496 (2.4521995166252397) | > loss_kl: 0.8443032503128052 (1.068712609595266) | > loss_feat: 4.597620964050293 (5.762892599249708) | > loss_mel: 24.167612075805664 (26.493527223323955) | > loss_duration: 1.7580724954605103 (1.723717870383427) | > loss_1: 33.42300033569336 (37.50104958435585) | > grad_norm_1: tensor(6110.9893, device='cuda:0') (tensor(21730.1172, device='cuda:0')) | > current_lr_0: 0.00017025670086196702 | > current_lr_1: 0.00017025670086196702 | > step_time: 0.5737 (0.502741369707831) | > loader_time: 0.0248 (0.01904848526264059)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4101436138153076 (2.4101436138153076) | > loss_disc_real_0: 0.06719477474689484 (0.06719477474689484) | > loss_disc_real_1: 0.20497724413871765 (0.20497724413871765) | > loss_disc_real_2: 0.1916303187608719 (0.1916303187608719) | > loss_disc_real_3: 0.34896960854530334 (0.34896960854530334) | > loss_disc_real_4: 0.1139233186841011 (0.1139233186841011) | > loss_disc_real_5: 0.018881166353821754 (0.018881166353821754) | > loss_0: 2.4101436138153076 (2.4101436138153076) | > loss_gen: 1.7823189496994019 (1.7823189496994019) | > loss_kl: 1.5595122575759888 (1.5595122575759888) | > loss_feat: 5.338703155517578 (5.338703155517578) | > loss_mel: 27.882787704467773 (27.882787704467773) | > loss_duration: 2.1516687870025635 (2.1516687870025635) | > loss_1: 38.714988708496094 (38.714988708496094)  --> STEP: 1 | > loss_disc: 2.743906259536743 (2.743906259536743) | > loss_disc_real_0: 0.0680091381072998 (0.0680091381072998) | > loss_disc_real_1: 0.2647813558578491 (0.2647813558578491) | > loss_disc_real_2: 0.1985112875699997 (0.1985112875699997) | > loss_disc_real_3: 0.32394206523895264 (0.32394206523895264) | > loss_disc_real_4: 0.20565219223499298 (0.20565219223499298) | > loss_disc_real_5: 0.3266506493091583 (0.3266506493091583) | > loss_0: 2.743906259536743 (2.743906259536743) | > loss_gen: 1.8952465057373047 (1.8952465057373047) | > loss_kl: 2.6751503944396973 (2.6751503944396973) | > loss_feat: 3.283024787902832 (3.283024787902832) | > loss_mel: 23.116764068603516 (23.116764068603516) | > loss_duration: 2.224461555480957 (2.224461555480957) | > loss_1: 33.19464874267578 (33.19464874267578)  --> STEP: 2 | > loss_disc: 3.3184874057769775 (3.0311968326568604) | > loss_disc_real_0: 0.3595666289329529 (0.21378788352012634) | > loss_disc_real_1: 0.3180468678474426 (0.2914141118526459) | > loss_disc_real_2: 0.22342441976070404 (0.21096785366535187) | > loss_disc_real_3: 0.3371640741825104 (0.3305530697107315) | > loss_disc_real_4: 0.2852623760700226 (0.24545728415250778) | > loss_disc_real_5: 0.3930591344833374 (0.35985489189624786) | > loss_0: 3.3184874057769775 (3.0311968326568604) | > loss_gen: 1.783453345298767 (1.8393499255180359) | > loss_kl: 2.570157766342163 (2.62265408039093) | > loss_feat: 1.7204355001449585 (2.5017301440238953) | > loss_mel: 26.610788345336914 (24.863776206970215) | > loss_duration: 2.284034252166748 (2.2542479038238525) | > loss_1: 34.9688720703125 (34.08176040649414)  --> STEP: 3 | > loss_disc: 2.930020570755005 (2.9974714120229087) | > loss_disc_real_0: 0.22694002091884613 (0.21817192931969961) | > loss_disc_real_1: 0.4430534541606903 (0.3419605592886607) | > loss_disc_real_2: 0.20019060373306274 (0.2073754370212555) | > loss_disc_real_3: 0.29856181144714355 (0.3198893169562022) | > loss_disc_real_4: 0.29918625950813293 (0.2633669426043828) | > loss_disc_real_5: 0.3301839828491211 (0.34996458888053894) | > loss_0: 2.930020570755005 (2.9974714120229087) | > loss_gen: 2.4843459129333496 (2.054348587989807) | > loss_kl: 1.251905083656311 (2.165737748146057) | > loss_feat: 4.869520664215088 (3.290993650754293) | > loss_mel: 30.317380905151367 (26.681644439697266) | > loss_duration: 2.14007830619812 (2.216191371281942) | > loss_1: 41.063228607177734 (36.40891647338867) --> EVAL PERFORMANCE | > avg_loader_time: 0.006325324376424153 (+0.004214286804199219) | > avg_loss_disc: 2.9974714120229087 (+0.984772801399231) | > avg_loss_disc_real_0: 0.21817192931969961 (+0.01849532127380371) | > avg_loss_disc_real_1: 0.3419605592886607 (+0.19162029400467875) | > avg_loss_disc_real_2: 0.2073754370212555 (+0.056038059294223785) | > avg_loss_disc_real_3: 0.3198893169562022 (+0.11579012870788577) | > avg_loss_disc_real_4: 0.2633669426043828 (+0.09997170170148212) | > avg_loss_disc_real_5: 0.34996458888053894 (+0.18822100944817066) | > avg_loss_0: 2.9974714120229087 (+0.984772801399231) | > avg_loss_gen: 2.054348587989807 (-0.8087076743443808) | > avg_loss_kl: 2.165737748146057 (+0.03495391209920262) | > avg_loss_feat: 3.290993650754293 (-4.286127289136251) | > avg_loss_mel: 26.681644439697266 (+1.0396099090576172) | > avg_loss_duration: 2.216191371281942 (-0.038119872411091826) | > avg_loss_1: 36.40891647338867 (-4.058391571044922)  > EPOCH: 162/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:25:12)   --> TIME: 2023-10-20 01:25:20 -- STEP: 9/50 -- GLOBAL_STEP: 61110 | > loss_disc: 3.162846565246582 (2.6370919015672474) | > loss_disc_real_0: 0.3128576874732971 (0.20579056897097164) | > loss_disc_real_1: 0.37638363242149353 (0.2677739163239797) | > loss_disc_real_2: 0.3737887442111969 (0.22747904890113407) | > loss_disc_real_3: 0.4619922637939453 (0.2569390750593609) | > loss_disc_real_4: 0.41664931178092957 (0.20198265318241385) | > loss_disc_real_5: 0.4385282099246979 (0.19787817026695442) | > loss_0: 3.162846565246582 (2.6370919015672474) | > grad_norm_0: tensor(568.3757, device='cuda:0') (tensor(467.5577, device='cuda:0')) | > loss_gen: 2.5704658031463623 (2.125247677167257) | > loss_kl: 1.1954550743103027 (1.1546919875674777) | > loss_feat: 3.2374515533447266 (4.358953358398543) | > loss_mel: 26.492063522338867 (22.863043361239964) | > loss_duration: 1.6507006883621216 (1.699247611893548) | > loss_1: 35.14613723754883 (32.20118374294705) | > grad_norm_1: tensor(4606.1528, device='cuda:0') (tensor(11329.9453, device='cuda:0')) | > current_lr_0: 0.00017008651862979271 | > current_lr_1: 0.00017008651862979271 | > step_time: 0.4203 (0.4792068534427219) | > loader_time: 0.0182 (0.009348842832777236)  --> TIME: 2023-10-20 01:25:36 -- STEP: 39/50 -- GLOBAL_STEP: 61140 | > loss_disc: 2.8760619163513184 (2.613638110649892) | > loss_disc_real_0: 0.16306814551353455 (0.1859502202998369) | > loss_disc_real_1: 0.27933773398399353 (0.2422344122941677) | > loss_disc_real_2: 0.23699380457401276 (0.2290193409873889) | > loss_disc_real_3: 0.22929273545742035 (0.2667078286027297) | > loss_disc_real_4: 0.2857033908367157 (0.24035517283930227) | > loss_disc_real_5: 0.2903364598751068 (0.23850770770476606) | > loss_0: 2.8760619163513184 (2.613638110649892) | > grad_norm_0: tensor(560.3687, device='cuda:0') (tensor(636.8260, device='cuda:0')) | > loss_gen: 1.8034336566925049 (2.2558101751865487) | > loss_kl: 0.792784571647644 (1.0460660870258625) | > loss_feat: 1.5666757822036743 (4.350785372683253) | > loss_mel: 10.840920448303223 (22.270576862188484) | > loss_duration: 1.7782827615737915 (1.7051572921948555) | > loss_1: 16.78209686279297 (31.628395374004658) | > grad_norm_1: tensor(14455.0068, device='cuda:0') (tensor(22513.6035, device='cuda:0')) | > current_lr_0: 0.00017008651862979271 | > current_lr_1: 0.00017008651862979271 | > step_time: 0.6041 (0.48631924849290115) | > loader_time: 0.0245 (0.013999590506920448)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5520222187042236 (2.5520222187042236) | > loss_disc_real_0: 0.028697870671749115 (0.028697870671749115) | > loss_disc_real_1: 0.16956202685832977 (0.16956202685832977) | > loss_disc_real_2: 0.5300360321998596 (0.5300360321998596) | > loss_disc_real_3: 0.28110748529434204 (0.28110748529434204) | > loss_disc_real_4: 0.309251606464386 (0.309251606464386) | > loss_disc_real_5: 0.30774256587028503 (0.30774256587028503) | > loss_0: 2.5520222187042236 (2.5520222187042236) | > loss_gen: 2.575281858444214 (2.575281858444214) | > loss_kl: 2.6088733673095703 (2.6088733673095703) | > loss_feat: 8.104726791381836 (8.104726791381836) | > loss_mel: 24.80914306640625 (24.80914306640625) | > loss_duration: 2.181288719177246 (2.181288719177246) | > loss_1: 40.27931594848633 (40.27931594848633)  --> STEP: 1 | > loss_disc: 2.443798303604126 (2.443798303604126) | > loss_disc_real_0: 0.09197372198104858 (0.09197372198104858) | > loss_disc_real_1: 0.28108343482017517 (0.28108343482017517) | > loss_disc_real_2: 0.3034076392650604 (0.3034076392650604) | > loss_disc_real_3: 0.23727042973041534 (0.23727042973041534) | > loss_disc_real_4: 0.24331115186214447 (0.24331115186214447) | > loss_disc_real_5: 0.37076887488365173 (0.37076887488365173) | > loss_0: 2.443798303604126 (2.443798303604126) | > loss_gen: 2.544461727142334 (2.544461727142334) | > loss_kl: 3.7101171016693115 (3.7101171016693115) | > loss_feat: 5.0014519691467285 (5.0014519691467285) | > loss_mel: 23.535354614257812 (23.535354614257812) | > loss_duration: 2.3257081508636475 (2.3257081508636475) | > loss_1: 37.11709213256836 (37.11709213256836)  --> STEP: 2 | > loss_disc: 2.8263211250305176 (2.6350597143173218) | > loss_disc_real_0: 0.05775582790374756 (0.07486477494239807) | > loss_disc_real_1: 0.22488288581371307 (0.2529831603169441) | > loss_disc_real_2: 0.27454182505607605 (0.28897473216056824) | > loss_disc_real_3: 0.3221834599971771 (0.27972694486379623) | > loss_disc_real_4: 0.23120923340320587 (0.23726019263267517) | > loss_disc_real_5: 0.23015616834163666 (0.3004625216126442) | > loss_0: 2.8263211250305176 (2.6350597143173218) | > loss_gen: 1.6298701763153076 (2.087165951728821) | > loss_kl: 2.9104232788085938 (3.3102701902389526) | > loss_feat: 1.904145359992981 (3.4527986645698547) | > loss_mel: 26.2128849029541 (24.874119758605957) | > loss_duration: 2.2853808403015137 (2.3055444955825806) | > loss_1: 34.94270706176758 (36.02989959716797)  --> STEP: 3 | > loss_disc: 2.490363597869873 (2.5868276755015054) | > loss_disc_real_0: 0.17292210459709167 (0.1075505514939626) | > loss_disc_real_1: 0.27426034212112427 (0.26007555425167084) | > loss_disc_real_2: 0.40095019340515137 (0.32629988590876263) | > loss_disc_real_3: 0.25424131751060486 (0.2712317357460658) | > loss_disc_real_4: 0.2827857434749603 (0.2524353762467702) | > loss_disc_real_5: 0.37554264068603516 (0.32548922797044116) | > loss_0: 2.490363597869873 (2.5868276755015054) | > loss_gen: 3.0316011905670166 (2.4019776980082193) | > loss_kl: 1.5510162115097046 (2.723852197329203) | > loss_feat: 5.515751361846924 (4.140449563662211) | > loss_mel: 23.495254516601562 (24.41449801127116) | > loss_duration: 2.2109012603759766 (2.2739967505137124) | > loss_1: 35.804527282714844 (35.95477549235026) --> EVAL PERFORMANCE | > avg_loader_time: 0.0029791990915934243 (-0.003346125284830729) | > avg_loss_disc: 2.5868276755015054 (-0.4106437365214033) | > avg_loss_disc_real_0: 0.1075505514939626 (-0.11062137782573701) | > avg_loss_disc_real_1: 0.26007555425167084 (-0.08188500503698987) | > avg_loss_disc_real_2: 0.32629988590876263 (+0.11892444888750714) | > avg_loss_disc_real_3: 0.2712317357460658 (-0.048657581210136414) | > avg_loss_disc_real_4: 0.2524353762467702 (-0.01093156635761261) | > avg_loss_disc_real_5: 0.32548922797044116 (-0.024475360910097776) | > avg_loss_0: 2.5868276755015054 (-0.4106437365214033) | > avg_loss_gen: 2.4019776980082193 (+0.3476291100184121) | > avg_loss_kl: 2.723852197329203 (+0.558114449183146) | > avg_loss_feat: 4.140449563662211 (+0.8494559129079184) | > avg_loss_mel: 24.41449801127116 (-2.2671464284261056) | > avg_loss_duration: 2.2739967505137124 (+0.05780537923177054) | > avg_loss_1: 35.95477549235026 (-0.4541409810384138)  > EPOCH: 163/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:25:50)   --> TIME: 2023-10-20 01:26:04 -- STEP: 19/50 -- GLOBAL_STEP: 61170 | > loss_disc: 2.744736671447754 (2.5477923719506514) | > loss_disc_real_0: 0.1066122055053711 (0.18914289537229037) | > loss_disc_real_1: 0.18802542984485626 (0.24786683132773946) | > loss_disc_real_2: 0.3943520784378052 (0.2727384743721862) | > loss_disc_real_3: 0.37437668442726135 (0.23578574704496483) | > loss_disc_real_4: 0.31006380915641785 (0.2321662185223479) | > loss_disc_real_5: 0.27973905205726624 (0.21461520951829458) | > loss_0: 2.744736671447754 (2.5477923719506514) | > grad_norm_0: tensor(386.0993, device='cuda:0') (tensor(948.9037, device='cuda:0')) | > loss_gen: 2.1902058124542236 (2.386060219062002) | > loss_kl: 1.2799807786941528 (0.9205030342073817) | > loss_feat: 4.743932247161865 (4.295024992604005) | > loss_mel: 21.56819725036621 (21.43457085207889) | > loss_duration: 1.755972146987915 (1.7388905412272404) | > loss_1: 31.538288116455078 (30.775049761721963) | > grad_norm_1: tensor(17202.6895, device='cuda:0') (tensor(23211.5762, device='cuda:0')) | > current_lr_0: 0.00016991650650541448 | > current_lr_1: 0.00016991650650541448 | > step_time: 0.2595 (0.5002389958030299) | > loader_time: 0.0021 (0.01783291917098196)  --> TIME: 2023-10-20 01:26:17 -- STEP: 49/50 -- GLOBAL_STEP: 61200 | > loss_disc: 2.7184348106384277 (2.467303779660439) | > loss_disc_real_0: 0.18145552277565002 (0.16995636603737974) | > loss_disc_real_1: 0.23397612571716309 (0.2326670417524114) | > loss_disc_real_2: 0.16092640161514282 (0.2316779924594626) | > loss_disc_real_3: 0.22506634891033173 (0.23519427891896696) | > loss_disc_real_4: 0.29072755575180054 (0.23063837945917431) | > loss_disc_real_5: 0.34592804312705994 (0.21380179225258072) | > loss_0: 2.7184348106384277 (2.467303779660439) | > grad_norm_0: tensor(498.8069, device='cuda:0') (tensor(743.6923, device='cuda:0')) | > loss_gen: 1.9279842376708984 (2.38000518691783) | > loss_kl: 0.47427985072135925 (0.9418356867925245) | > loss_feat: 1.2714958190917969 (4.836474136734493) | > loss_mel: 22.323720932006836 (22.352040757938312) | > loss_duration: 1.8007303476333618 (1.6965151271041559) | > loss_1: 27.79821014404297 (32.206871246804994) | > grad_norm_1: tensor(6216.4180, device='cuda:0') (tensor(21419.6406, device='cuda:0')) | > current_lr_0: 0.00016991650650541448 | > current_lr_1: 0.00016991650650541448 | > step_time: 0.6765 (0.4376664064368423) | > loader_time: 0.3183 (0.01834227114307637)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7413182258605957 (2.7413182258605957) | > loss_disc_real_0: 0.15310755372047424 (0.15310755372047424) | > loss_disc_real_1: 0.21677526831626892 (0.21677526831626892) | > loss_disc_real_2: 0.1846020668745041 (0.1846020668745041) | > loss_disc_real_3: 0.24257349967956543 (0.24257349967956543) | > loss_disc_real_4: 0.2122226059436798 (0.2122226059436798) | > loss_disc_real_5: 0.30466967821121216 (0.30466967821121216) | > loss_0: 2.7413182258605957 (2.7413182258605957) | > loss_gen: 1.7068321704864502 (1.7068321704864502) | > loss_kl: 2.131039619445801 (2.131039619445801) | > loss_feat: 2.2633728981018066 (2.2633728981018066) | > loss_mel: 21.5234432220459 (21.5234432220459) | > loss_duration: 2.1430883407592773 (2.1430883407592773) | > loss_1: 29.767776489257812 (29.767776489257812)  --> STEP: 1 | > loss_disc: 2.8417325019836426 (2.8417325019836426) | > loss_disc_real_0: 0.21964947879314423 (0.21964947879314423) | > loss_disc_real_1: 0.22384923696517944 (0.22384923696517944) | > loss_disc_real_2: 0.2591928243637085 (0.2591928243637085) | > loss_disc_real_3: 0.2189747840166092 (0.2189747840166092) | > loss_disc_real_4: 0.2576466202735901 (0.2576466202735901) | > loss_disc_real_5: 0.3494277894496918 (0.3494277894496918) | > loss_0: 2.8417325019836426 (2.8417325019836426) | > loss_gen: 1.837424874305725 (1.837424874305725) | > loss_kl: 3.143643856048584 (3.143643856048584) | > loss_feat: 0.8644916415214539 (0.8644916415214539) | > loss_mel: 22.687854766845703 (22.687854766845703) | > loss_duration: 2.298586368560791 (2.298586368560791) | > loss_1: 30.832000732421875 (30.832000732421875)  --> STEP: 2 | > loss_disc: 3.0116724967956543 (2.9267024993896484) | > loss_disc_real_0: 0.28052353858947754 (0.2500865086913109) | > loss_disc_real_1: 0.2206147164106369 (0.22223197668790817) | > loss_disc_real_2: 0.2646414041519165 (0.2619171142578125) | > loss_disc_real_3: 0.21485298871994019 (0.2169138863682747) | > loss_disc_real_4: 0.25764796137809753 (0.2576472908258438) | > loss_disc_real_5: 0.34805411100387573 (0.34874095022678375) | > loss_0: 3.0116724967956543 (2.9267024993896484) | > loss_gen: 1.603277325630188 (1.7203510999679565) | > loss_kl: 2.325815439224243 (2.7347296476364136) | > loss_feat: 0.04704791679978371 (0.4557697791606188) | > loss_mel: 1.8092877864837646 (12.248571276664734) | > loss_duration: 2.204878330230713 (2.251732349395752) | > loss_1: 7.990306377410889 (19.411153554916382)  --> STEP: 3 | > loss_disc: 3.0849082469940186 (2.979437748591105) | > loss_disc_real_0: 0.47682490944862366 (0.32566597561041516) | > loss_disc_real_1: 0.16608926653862 (0.2035177399714788) | > loss_disc_real_2: 0.3294092118740082 (0.28441448012987774) | > loss_disc_real_3: 0.2578694522380829 (0.23056574165821075) | > loss_disc_real_4: 0.3155888319015503 (0.2769611378510793) | > loss_disc_real_5: 0.36593377590179443 (0.354471892118454) | > loss_0: 3.0849082469940186 (2.979437748591105) | > loss_gen: 2.0201613903045654 (1.820287863413493) | > loss_kl: 1.1979740858078003 (2.2224777936935425) | > loss_feat: 1.7869516611099243 (0.8994970731437206) | > loss_mel: 20.5521297454834 (15.016424099604288) | > loss_duration: 2.2382216453552246 (2.2472287813822427) | > loss_1: 27.795438766479492 (22.205915292104084) --> EVAL PERFORMANCE | > avg_loader_time: 0.00619045893351237 (+0.0032112598419189457) | > avg_loss_disc: 2.979437748591105 (+0.3926100730895996) | > avg_loss_disc_real_0: 0.32566597561041516 (+0.21811542411645257) | > avg_loss_disc_real_1: 0.2035177399714788 (-0.05655781428019205) | > avg_loss_disc_real_2: 0.28441448012987774 (-0.04188540577888489) | > avg_loss_disc_real_3: 0.23056574165821075 (-0.04066599408785504) | > avg_loss_disc_real_4: 0.2769611378510793 (+0.024525761604309082) | > avg_loss_disc_real_5: 0.354471892118454 (+0.028982664148012816) | > avg_loss_0: 2.979437748591105 (+0.3926100730895996) | > avg_loss_gen: 1.820287863413493 (-0.5816898345947263) | > avg_loss_kl: 2.2224777936935425 (-0.5013744036356607) | > avg_loss_feat: 0.8994970731437206 (-3.2409524905184908) | > avg_loss_mel: 15.016424099604288 (-9.398073911666872) | > avg_loss_duration: 2.2472287813822427 (-0.026767969131469727) | > avg_loss_1: 22.205915292104084 (-13.748860200246174)  > EPOCH: 164/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:26:28)   --> TIME: 2023-10-20 01:26:46 -- STEP: 29/50 -- GLOBAL_STEP: 61230 | > loss_disc: 3.062495708465576 (2.40224564897603) | > loss_disc_real_0: 0.4807503819465637 (0.15463136171857858) | > loss_disc_real_1: 0.2850075662136078 (0.21596484066083513) | > loss_disc_real_2: 0.21229936182498932 (0.21658853023987398) | > loss_disc_real_3: 0.22933517396450043 (0.24671609667611535) | > loss_disc_real_4: 0.5247318744659424 (0.19823512916677985) | > loss_disc_real_5: 0.8438299298286438 (0.23213045254092793) | > loss_0: 3.062495708465576 (2.40224564897603) | > grad_norm_0: tensor(429.1256, device='cuda:0') (tensor(507.2852, device='cuda:0')) | > loss_gen: 4.400485038757324 (2.5441947065550705) | > loss_kl: 0.8853252530097961 (1.0184892066593825) | > loss_feat: 12.144503593444824 (6.61185081354503) | > loss_mel: 24.57118797302246 (26.59672816046353) | > loss_duration: 1.7084546089172363 (1.7154302514832596) | > loss_1: 43.709957122802734 (38.48669331649255) | > grad_norm_1: tensor(18429.3457, device='cuda:0') (tensor(23601.3984, device='cuda:0')) | > current_lr_0: 0.0001697466643187989 | > current_lr_1: 0.0001697466643187989 | > step_time: 0.3612 (0.5128697362439384) | > loader_time: 0.0251 (0.01899632092179923)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.89033579826355 (2.89033579826355) | > loss_disc_real_0: 0.2982131242752075 (0.2982131242752075) | > loss_disc_real_1: 0.21715079247951508 (0.21715079247951508) | > loss_disc_real_2: 0.37512528896331787 (0.37512528896331787) | > loss_disc_real_3: 0.24763046205043793 (0.24763046205043793) | > loss_disc_real_4: 0.3721573054790497 (0.3721573054790497) | > loss_disc_real_5: 0.37935447692871094 (0.37935447692871094) | > loss_0: 2.89033579826355 (2.89033579826355) | > loss_gen: 2.4353396892547607 (2.4353396892547607) | > loss_kl: 1.8319363594055176 (1.8319363594055176) | > loss_feat: 4.5738983154296875 (4.5738983154296875) | > loss_mel: 23.804956436157227 (23.804956436157227) | > loss_duration: 2.2125637531280518 (2.2125637531280518) | > loss_1: 34.85869216918945 (34.85869216918945)  --> STEP: 1 | > loss_disc: 1.8651992082595825 (1.8651992082595825) | > loss_disc_real_0: 0.1826457679271698 (0.1826457679271698) | > loss_disc_real_1: 0.1498948186635971 (0.1498948186635971) | > loss_disc_real_2: 0.1651318371295929 (0.1651318371295929) | > loss_disc_real_3: 0.16115130484104156 (0.16115130484104156) | > loss_disc_real_4: 0.18970337510108948 (0.18970337510108948) | > loss_disc_real_5: 0.07935891300439835 (0.07935891300439835) | > loss_0: 1.8651992082595825 (1.8651992082595825) | > loss_gen: 2.561100959777832 (2.561100959777832) | > loss_kl: 2.8349196910858154 (2.8349196910858154) | > loss_feat: 6.650934219360352 (6.650934219360352) | > loss_mel: 25.773700714111328 (25.773700714111328) | > loss_duration: 2.3900396823883057 (2.3900396823883057) | > loss_1: 40.210697174072266 (40.210697174072266)  --> STEP: 2 | > loss_disc: 2.4281418323516846 (2.1466705203056335) | > loss_disc_real_0: 0.1798436939716339 (0.18124473094940186) | > loss_disc_real_1: 0.20622190833091736 (0.17805836349725723) | > loss_disc_real_2: 0.27645814418792725 (0.22079499065876007) | > loss_disc_real_3: 0.3121545910835266 (0.2366529479622841) | > loss_disc_real_4: 0.1531679481267929 (0.1714356616139412) | > loss_disc_real_5: 0.29019126296043396 (0.18477508798241615) | > loss_0: 2.4281418323516846 (2.1466705203056335) | > loss_gen: 2.426093816757202 (2.493597388267517) | > loss_kl: 2.9169607162475586 (2.875940203666687) | > loss_feat: 5.841698169708252 (6.246316194534302) | > loss_mel: 23.7469539642334 (24.760327339172363) | > loss_duration: 2.445131778717041 (2.4175857305526733) | > loss_1: 37.3768424987793 (38.79376983642578)  --> STEP: 3 | > loss_disc: 1.2314237356185913 (1.8415882587432861) | > loss_disc_real_0: 0.05141107738018036 (0.13796684642632803) | > loss_disc_real_1: 0.03991119563579559 (0.13200930754343668) | > loss_disc_real_2: 0.10333383083343506 (0.18164127071698508) | > loss_disc_real_3: 0.08765273541212082 (0.186986210445563) | > loss_disc_real_4: 0.12783481180667877 (0.15690204501152039) | > loss_disc_real_5: 0.042622096836566925 (0.1373907576004664) | > loss_0: 1.2314237356185913 (1.8415882587432861) | > loss_gen: 2.6464180946350098 (2.544537623723348) | > loss_kl: 0.810683012008667 (2.18752113978068) | > loss_feat: 8.295509338378906 (6.929380575815837) | > loss_mel: 27.200729370117188 (25.573794682820637) | > loss_duration: 2.2907683849334717 (2.3753132820129395) | > loss_1: 41.244110107421875 (39.61054992675781) --> EVAL PERFORMANCE | > avg_loader_time: 0.004695812861124675 (-0.0014946460723876953) | > avg_loss_disc: 1.8415882587432861 (-1.1378494898478189) | > avg_loss_disc_real_0: 0.13796684642632803 (-0.18769912918408713) | > avg_loss_disc_real_1: 0.13200930754343668 (-0.07150843242804211) | > avg_loss_disc_real_2: 0.18164127071698508 (-0.10277320941289267) | > avg_loss_disc_real_3: 0.186986210445563 (-0.043579531212647765) | > avg_loss_disc_real_4: 0.15690204501152039 (-0.1200590928395589) | > avg_loss_disc_real_5: 0.1373907576004664 (-0.21708113451798758) | > avg_loss_0: 1.8415882587432861 (-1.1378494898478189) | > avg_loss_gen: 2.544537623723348 (+0.7242497603098552) | > avg_loss_kl: 2.18752113978068 (-0.03495665391286229) | > avg_loss_feat: 6.929380575815837 (+6.029883502672116) | > avg_loss_mel: 25.573794682820637 (+10.557370583216349) | > avg_loss_duration: 2.3753132820129395 (+0.12808450063069676) | > avg_loss_1: 39.61054992675781 (+17.40463463465373)  > EPOCH: 165/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:27:08)   --> TIME: 2023-10-20 01:27:15 -- STEP: 9/50 -- GLOBAL_STEP: 61260 | > loss_disc: 2.6189589500427246 (2.257087296909756) | > loss_disc_real_0: 0.21322722733020782 (0.12650669862826666) | > loss_disc_real_1: 0.3489387631416321 (0.22533723380830553) | > loss_disc_real_2: 0.44355475902557373 (0.26712123304605484) | > loss_disc_real_3: 0.3607080280780792 (0.26464824626843136) | > loss_disc_real_4: 0.23644205927848816 (0.15267145136992136) | > loss_disc_real_5: 0.16122913360595703 (0.22876544503702056) | > loss_0: 2.6189589500427246 (2.257087296909756) | > grad_norm_0: tensor(506.1569, device='cuda:0') (tensor(365.9603, device='cuda:0')) | > loss_gen: 2.4589531421661377 (2.600215885374281) | > loss_kl: 1.2945712804794312 (1.179788304699792) | > loss_feat: 2.8987741470336914 (6.0650153160095215) | > loss_mel: 26.89503288269043 (22.962434238857693) | > loss_duration: 1.739344596862793 (1.724102841483222) | > loss_1: 35.286678314208984 (34.53155665927463) | > grad_norm_1: tensor(4414.1890, device='cuda:0') (tensor(26555.6094, device='cuda:0')) | > current_lr_0: 0.0001695769919000825 | > current_lr_1: 0.0001695769919000825 | > step_time: 0.6677 (0.36638302273220485) | > loader_time: 0.022 (0.0059096018473307295)  --> TIME: 2023-10-20 01:27:32 -- STEP: 39/50 -- GLOBAL_STEP: 61290 | > loss_disc: 1.397726058959961 (2.354687947493333) | > loss_disc_real_0: 0.04831834137439728 (0.14039629592727393) | > loss_disc_real_1: 0.027225986123085022 (0.2191162311639159) | > loss_disc_real_2: 0.058673519641160965 (0.24855222084965461) | > loss_disc_real_3: 0.10861000418663025 (0.23796760921294874) | > loss_disc_real_4: 0.09039098024368286 (0.1957712182058738) | > loss_disc_real_5: 0.05787346512079239 (0.2132247563164968) | > loss_0: 1.397726058959961 (2.354687947493333) | > grad_norm_0: tensor(637.1445, device='cuda:0') (tensor(550.7825, device='cuda:0')) | > loss_gen: 2.8371317386627197 (2.436283820714706) | > loss_kl: 0.697544276714325 (1.1073978130634015) | > loss_feat: 7.998160362243652 (5.461659050904787) | > loss_mel: 23.193756103515625 (23.554566328342144) | > loss_duration: 1.772925853729248 (1.7034512819387975) | > loss_1: 36.49951934814453 (34.2633579205244) | > grad_norm_1: tensor(14250.1211, device='cuda:0') (tensor(20702.1348, device='cuda:0')) | > current_lr_0: 0.0001695769919000825 | > current_lr_1: 0.0001695769919000825 | > step_time: 0.6352 (0.5089895969782122) | > loader_time: 0.0169 (0.012721905341515174)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.012746810913086 (3.012746810913086) | > loss_disc_real_0: 0.0798368752002716 (0.0798368752002716) | > loss_disc_real_1: 0.32902291417121887 (0.32902291417121887) | > loss_disc_real_2: 0.456685334444046 (0.456685334444046) | > loss_disc_real_3: 0.44976893067359924 (0.44976893067359924) | > loss_disc_real_4: 0.35585492849349976 (0.35585492849349976) | > loss_disc_real_5: 0.4767707586288452 (0.4767707586288452) | > loss_0: 3.012746810913086 (3.012746810913086) | > loss_gen: 2.5345458984375 (2.5345458984375) | > loss_kl: 1.9144442081451416 (1.9144442081451416) | > loss_feat: 4.685450077056885 (4.685450077056885) | > loss_mel: 23.465213775634766 (23.465213775634766) | > loss_duration: 2.166325807571411 (2.166325807571411) | > loss_1: 34.7659797668457 (34.7659797668457)  --> STEP: 1 | > loss_disc: 2.547334671020508 (2.547334671020508) | > loss_disc_real_0: 0.16965970396995544 (0.16965970396995544) | > loss_disc_real_1: 0.27811217308044434 (0.27811217308044434) | > loss_disc_real_2: 0.26501625776290894 (0.26501625776290894) | > loss_disc_real_3: 0.378240168094635 (0.378240168094635) | > loss_disc_real_4: 0.22495132684707642 (0.22495132684707642) | > loss_disc_real_5: 0.25543320178985596 (0.25543320178985596) | > loss_0: 2.547334671020508 (2.547334671020508) | > loss_gen: 2.4656291007995605 (2.4656291007995605) | > loss_kl: 3.1578598022460938 (3.1578598022460938) | > loss_feat: 6.499002933502197 (6.499002933502197) | > loss_mel: 25.895231246948242 (25.895231246948242) | > loss_duration: 2.3252615928649902 (2.3252615928649902) | > loss_1: 40.34298324584961 (40.34298324584961)  --> STEP: 2 | > loss_disc: 2.4256227016448975 (2.4864786863327026) | > loss_disc_real_0: 0.1404869109392166 (0.15507330745458603) | > loss_disc_real_1: 0.3381512463092804 (0.30813170969486237) | > loss_disc_real_2: 0.2976636290550232 (0.28133994340896606) | > loss_disc_real_3: 0.5346352458000183 (0.45643770694732666) | > loss_disc_real_4: 0.2014688104391098 (0.2132100686430931) | > loss_disc_real_5: 0.28471723198890686 (0.2700752168893814) | > loss_0: 2.4256227016448975 (2.4864786863327026) | > loss_gen: 2.9409890174865723 (2.7033090591430664) | > loss_kl: 2.874305486679077 (3.0160826444625854) | > loss_feat: 4.975437164306641 (5.737220048904419) | > loss_mel: 27.67062759399414 (26.78292942047119) | > loss_duration: 2.3055710792541504 (2.3154163360595703) | > loss_1: 40.76693344116211 (40.55495834350586)  --> STEP: 3 | > loss_disc: 3.0140433311462402 (2.6623335679372153) | > loss_disc_real_0: 0.23569899797439575 (0.18194853762785593) | > loss_disc_real_1: 0.26107755303382874 (0.29244699080785114) | > loss_disc_real_2: 0.2743334174156189 (0.279004434744517) | > loss_disc_real_3: 0.333029180765152 (0.41530153155326843) | > loss_disc_real_4: 0.3177145719528198 (0.24804490307966867) | > loss_disc_real_5: 0.5838412046432495 (0.3746638794740041) | > loss_0: 3.0140433311462402 (2.6623335679372153) | > loss_gen: 2.4884226322174072 (2.6316802501678467) | > loss_kl: 1.682460904121399 (2.5715420643488565) | > loss_feat: 3.9839863777160645 (5.152808825174968) | > loss_mel: 23.463092803955078 (25.67631721496582) | > loss_duration: 2.216651439666748 (2.2824947039286294) | > loss_1: 33.83461380004883 (38.31484349568685) --> EVAL PERFORMANCE | > avg_loader_time: 0.003376563390096029 (-0.001319249471028646) | > avg_loss_disc: 2.6623335679372153 (+0.8207453091939292) | > avg_loss_disc_real_0: 0.18194853762785593 (+0.043981691201527895) | > avg_loss_disc_real_1: 0.29244699080785114 (+0.16043768326441446) | > avg_loss_disc_real_2: 0.279004434744517 (+0.09736316402753195) | > avg_loss_disc_real_3: 0.41530153155326843 (+0.22831532110770544) | > avg_loss_disc_real_4: 0.24804490307966867 (+0.09114285806814829) | > avg_loss_disc_real_5: 0.3746638794740041 (+0.2372731218735377) | > avg_loss_0: 2.6623335679372153 (+0.8207453091939292) | > avg_loss_gen: 2.6316802501678467 (+0.08714262644449855) | > avg_loss_kl: 2.5715420643488565 (+0.38402092456817627) | > avg_loss_feat: 5.152808825174968 (-1.7765717506408691) | > avg_loss_mel: 25.67631721496582 (+0.10252253214518348) | > avg_loss_duration: 2.2824947039286294 (-0.09281857808431004) | > avg_loss_1: 38.31484349568685 (-1.2957064310709612)  > EPOCH: 166/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:27:46)   --> TIME: 2023-10-20 01:28:00 -- STEP: 19/50 -- GLOBAL_STEP: 61320 | > loss_disc: 2.0630762577056885 (2.5429390606127287) | > loss_disc_real_0: 0.07677052915096283 (0.18996417571447397) | > loss_disc_real_1: 0.2137259542942047 (0.2385981384860842) | > loss_disc_real_2: 0.21003586053848267 (0.2510610399277587) | > loss_disc_real_3: 0.21767586469650269 (0.24514793134049365) | > loss_disc_real_4: 0.1376556158065796 (0.2124974162955033) | > loss_disc_real_5: 0.12773343920707703 (0.24307830533698985) | > loss_0: 2.0630762577056885 (2.5429390606127287) | > grad_norm_0: tensor(990.5253, device='cuda:0') (tensor(849.8475, device='cuda:0')) | > loss_gen: 2.867887496948242 (2.3139754157317314) | > loss_kl: 1.2292066812515259 (1.2308716428907294) | > loss_feat: 8.364103317260742 (3.867130062297771) | > loss_mel: 28.391632080078125 (21.345447439896432) | > loss_duration: 1.7808473110198975 (1.731490185386256) | > loss_1: 42.63367462158203 (30.4889144646494) | > grad_norm_1: tensor(36797.9375, device='cuda:0') (tensor(17009.6094, device='cuda:0')) | > current_lr_0: 0.0001694074890795717 | > current_lr_1: 0.0001694074890795717 | > step_time: 0.559 (0.507423576555754) | > loader_time: 0.0108 (0.015165291334453383)  --> TIME: 2023-10-20 01:28:12 -- STEP: 49/50 -- GLOBAL_STEP: 61350 | > loss_disc: 2.454026222229004 (2.4649397670006263) | > loss_disc_real_0: 0.13669201731681824 (0.1913865415417418) | > loss_disc_real_1: 0.18375036120414734 (0.2366789212944556) | > loss_disc_real_2: 0.2041034698486328 (0.2325167284936321) | > loss_disc_real_3: 0.2784901261329651 (0.23898035888465083) | > loss_disc_real_4: 0.33657947182655334 (0.2093787380513184) | > loss_disc_real_5: 0.19745399057865143 (0.21296121776864238) | > loss_0: 2.454026222229004 (2.4649397670006263) | > grad_norm_0: tensor(790.0214, device='cuda:0') (tensor(713.1670, device='cuda:0')) | > loss_gen: 2.2183597087860107 (2.392469591023971) | > loss_kl: 0.5718326568603516 (1.0703849828973107) | > loss_feat: 2.1392486095428467 (4.8555439934134474) | > loss_mel: 26.11741828918457 (21.980199137512518) | > loss_duration: 1.8062679767608643 (1.6830387407419634) | > loss_1: 32.853126525878906 (31.981636572857298) | > grad_norm_1: tensor(4210.9927, device='cuda:0') (tensor(21868.2168, device='cuda:0')) | > current_lr_0: 0.0001694074890795717 | > current_lr_1: 0.0001694074890795717 | > step_time: 0.6905 (0.43068002194774396) | > loader_time: 0.3841 (0.01876030649457659)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.682823896408081 (2.682823896408081) | > loss_disc_real_0: 0.14847101271152496 (0.14847101271152496) | > loss_disc_real_1: 0.30955642461776733 (0.30955642461776733) | > loss_disc_real_2: 0.24261897802352905 (0.24261897802352905) | > loss_disc_real_3: 0.2447356879711151 (0.2447356879711151) | > loss_disc_real_4: 0.19776812195777893 (0.19776812195777893) | > loss_disc_real_5: 0.24525204300880432 (0.24525204300880432) | > loss_0: 2.682823896408081 (2.682823896408081) | > loss_gen: 2.008598566055298 (2.008598566055298) | > loss_kl: 2.011874198913574 (2.011874198913574) | > loss_feat: 6.032746315002441 (6.032746315002441) | > loss_mel: 23.798940658569336 (23.798940658569336) | > loss_duration: 2.1920089721679688 (2.1920089721679688) | > loss_1: 36.04417037963867 (36.04417037963867)  --> STEP: 1 | > loss_disc: 1.8677561283111572 (1.8677561283111572) | > loss_disc_real_0: 0.04405800998210907 (0.04405800998210907) | > loss_disc_real_1: 0.10843465477228165 (0.10843465477228165) | > loss_disc_real_2: 0.11414562165737152 (0.11414562165737152) | > loss_disc_real_3: 0.05180449038743973 (0.05180449038743973) | > loss_disc_real_4: 0.16335316002368927 (0.16335316002368927) | > loss_disc_real_5: 0.07578897476196289 (0.07578897476196289) | > loss_0: 1.8677561283111572 (1.8677561283111572) | > loss_gen: 1.858240008354187 (1.858240008354187) | > loss_kl: 2.820080280303955 (2.820080280303955) | > loss_feat: 7.641671180725098 (7.641671180725098) | > loss_mel: 24.505884170532227 (24.505884170532227) | > loss_duration: 2.3248274326324463 (2.3248274326324463) | > loss_1: 39.15070343017578 (39.15070343017578)  --> STEP: 2 | > loss_disc: 2.558621883392334 (2.2131890058517456) | > loss_disc_real_0: 0.07159169018268585 (0.05782485008239746) | > loss_disc_real_1: 0.17165260016918182 (0.14004362747073174) | > loss_disc_real_2: 0.2762603163719177 (0.19520296901464462) | > loss_disc_real_3: 0.3340631127357483 (0.192933801561594) | > loss_disc_real_4: 0.2526359558105469 (0.20799455791711807) | > loss_disc_real_5: 0.4543312191963196 (0.26506009697914124) | > loss_0: 2.558621883392334 (2.2131890058517456) | > loss_gen: 2.4802334308624268 (2.169236719608307) | > loss_kl: 2.839789628982544 (2.8299349546432495) | > loss_feat: 9.505952835083008 (8.573812007904053) | > loss_mel: 27.20331573486328 (25.854599952697754) | > loss_duration: 2.3082051277160645 (2.3165162801742554) | > loss_1: 44.337493896484375 (41.74409866333008)  --> STEP: 3 | > loss_disc: 2.7617087364196777 (2.396028916041056) | > loss_disc_real_0: 0.40412282943725586 (0.17325750986735025) | > loss_disc_real_1: 0.2351793795824051 (0.17175554484128952) | > loss_disc_real_2: 0.2004331797361374 (0.19694637258847555) | > loss_disc_real_3: 0.2022990733385086 (0.19605555882056555) | > loss_disc_real_4: 0.26862895488739014 (0.22820602357387543) | > loss_disc_real_5: 0.35332003235816956 (0.2944800754388173) | > loss_0: 2.7617087364196777 (2.396028916041056) | > loss_gen: 2.2729923725128174 (2.2038219372431436) | > loss_kl: 1.2116715908050537 (2.290513833363851) | > loss_feat: 3.370698928833008 (6.839440981547038) | > loss_mel: 23.19111442565918 (24.966771443684895) | > loss_duration: 2.1755475997924805 (2.269526720046997) | > loss_1: 32.22202682495117 (38.570074717203774) --> EVAL PERFORMANCE | > avg_loader_time: 0.013579368591308594 (+0.010202805201212565) | > avg_loss_disc: 2.396028916041056 (-0.26630465189615915) | > avg_loss_disc_real_0: 0.17325750986735025 (-0.008691027760505676) | > avg_loss_disc_real_1: 0.17175554484128952 (-0.12069144596656162) | > avg_loss_disc_real_2: 0.19694637258847555 (-0.08205806215604147) | > avg_loss_disc_real_3: 0.19605555882056555 (-0.21924597273270288) | > avg_loss_disc_real_4: 0.22820602357387543 (-0.019838879505793244) | > avg_loss_disc_real_5: 0.2944800754388173 (-0.08018380403518677) | > avg_loss_0: 2.396028916041056 (-0.26630465189615915) | > avg_loss_gen: 2.2038219372431436 (-0.4278583129247031) | > avg_loss_kl: 2.290513833363851 (-0.2810282309850054) | > avg_loss_feat: 6.839440981547038 (+1.6866321563720703) | > avg_loss_mel: 24.966771443684895 (-0.7095457712809257) | > avg_loss_duration: 2.269526720046997 (-0.012967983881632339) | > avg_loss_1: 38.570074717203774 (+0.25523122151692235)  > EPOCH: 167/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:28:25)   --> TIME: 2023-10-20 01:28:44 -- STEP: 29/50 -- GLOBAL_STEP: 61380 | > loss_disc: 2.7151803970336914 (2.3096290497944274) | > loss_disc_real_0: 0.42618244886398315 (0.1613251108611966) | > loss_disc_real_1: 0.27152952551841736 (0.2169101087633392) | > loss_disc_real_2: 0.26286476850509644 (0.21272717287828183) | > loss_disc_real_3: 0.3465390205383301 (0.2262917803279285) | > loss_disc_real_4: 0.36408141255378723 (0.19934811321055068) | > loss_disc_real_5: 0.21417942643165588 (0.1829018553012404) | > loss_0: 2.7151803970336914 (2.3096290497944274) | > grad_norm_0: tensor(474.3439, device='cuda:0') (tensor(569.2531, device='cuda:0')) | > loss_gen: 3.0202722549438477 (2.518662312935138) | > loss_kl: 0.8977886438369751 (1.035270179140157) | > loss_feat: 5.018817901611328 (6.195865145531194) | > loss_mel: 23.33430290222168 (24.893181545981044) | > loss_duration: 1.6892354488372803 (1.7165080226700882) | > loss_1: 33.960418701171875 (36.35948702384684) | > grad_norm_1: tensor(20596.8945, device='cuda:0') (tensor(26839.5078, device='cuda:0')) | > current_lr_0: 0.00016923815568774253 | > current_lr_1: 0.00016923815568774253 | > step_time: 0.6818 (0.5167089330738988) | > loader_time: 0.0239 (0.018425472851457268)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0493152141571045 (2.0493152141571045) | > loss_disc_real_0: 0.02526213973760605 (0.02526213973760605) | > loss_disc_real_1: 0.18832556903362274 (0.18832556903362274) | > loss_disc_real_2: 0.17809449136257172 (0.17809449136257172) | > loss_disc_real_3: 0.2156234234571457 (0.2156234234571457) | > loss_disc_real_4: 0.17921985685825348 (0.17921985685825348) | > loss_disc_real_5: 0.14176498353481293 (0.14176498353481293) | > loss_0: 2.0493152141571045 (2.0493152141571045) | > loss_gen: 2.2833635807037354 (2.2833635807037354) | > loss_kl: 1.898411512374878 (1.898411512374878) | > loss_feat: 7.633935928344727 (7.633935928344727) | > loss_mel: 24.616697311401367 (24.616697311401367) | > loss_duration: 2.1586759090423584 (2.1586759090423584) | > loss_1: 38.59108352661133 (38.59108352661133)  --> STEP: 1 | > loss_disc: 3.1900665760040283 (3.1900665760040283) | > loss_disc_real_0: 0.2523118257522583 (0.2523118257522583) | > loss_disc_real_1: 0.3271687626838684 (0.3271687626838684) | > loss_disc_real_2: 0.28277787566185 (0.28277787566185) | > loss_disc_real_3: 0.3931947350502014 (0.3931947350502014) | > loss_disc_real_4: 0.2006697803735733 (0.2006697803735733) | > loss_disc_real_5: 0.37724220752716064 (0.37724220752716064) | > loss_0: 3.1900665760040283 (3.1900665760040283) | > loss_gen: 2.3291423320770264 (2.3291423320770264) | > loss_kl: 2.9457168579101562 (2.9457168579101562) | > loss_feat: 4.382124423980713 (4.382124423980713) | > loss_mel: 27.250974655151367 (27.250974655151367) | > loss_duration: 2.3830597400665283 (2.3830597400665283) | > loss_1: 39.291019439697266 (39.291019439697266)  --> STEP: 2 | > loss_disc: 2.1041579246520996 (2.647112250328064) | > loss_disc_real_0: 0.25236082077026367 (0.252336323261261) | > loss_disc_real_1: 0.20078200101852417 (0.2639753818511963) | > loss_disc_real_2: 0.17118412256240845 (0.2269809991121292) | > loss_disc_real_3: 0.23692317306995392 (0.31505895406007767) | > loss_disc_real_4: 0.18269474804401398 (0.19168226420879364) | > loss_disc_real_5: 0.14602693915367126 (0.26163457334041595) | > loss_0: 2.1041579246520996 (2.647112250328064) | > loss_gen: 2.4633684158325195 (2.396255373954773) | > loss_kl: 2.884871244430542 (2.915294051170349) | > loss_feat: 5.808798313140869 (5.095461368560791) | > loss_mel: 21.961021423339844 (24.605998039245605) | > loss_duration: 2.3282742500305176 (2.355666995048523) | > loss_1: 35.44633102416992 (37.368675231933594)  --> STEP: 3 | > loss_disc: 3.0393152236938477 (2.777846574783325) | > loss_disc_real_0: 0.46625638008117676 (0.3236430088678996) | > loss_disc_real_1: 0.2737222909927368 (0.26722435156504315) | > loss_disc_real_2: 0.2899705171585083 (0.2479775051275889) | > loss_disc_real_3: 0.31201043725013733 (0.31404278179009754) | > loss_disc_real_4: 0.25381597876548767 (0.2123935023943583) | > loss_disc_real_5: 0.21764549612998962 (0.24697154760360718) | > loss_0: 3.0393152236938477 (2.777846574783325) | > loss_gen: 1.9414845705032349 (2.2446651061375937) | > loss_kl: 1.519224762916565 (2.449937621752421) | > loss_feat: 0.6897381544113159 (3.6268869638442993) | > loss_mel: 18.433412551879883 (22.54846954345703) | > loss_duration: 2.3032734394073486 (2.338202476501465) | > loss_1: 24.887134552001953 (33.20816167195638) --> EVAL PERFORMANCE | > avg_loader_time: 0.006598154703776042 (-0.006981213887532552) | > avg_loss_disc: 2.777846574783325 (+0.38181765874226903) | > avg_loss_disc_real_0: 0.3236430088678996 (+0.15038549900054934) | > avg_loss_disc_real_1: 0.26722435156504315 (+0.09546880672375363) | > avg_loss_disc_real_2: 0.2479775051275889 (+0.051031132539113344) | > avg_loss_disc_real_3: 0.31404278179009754 (+0.11798722296953199) | > avg_loss_disc_real_4: 0.2123935023943583 (-0.01581252117951712) | > avg_loss_disc_real_5: 0.24697154760360718 (-0.047508527835210146) | > avg_loss_0: 2.777846574783325 (+0.38181765874226903) | > avg_loss_gen: 2.2446651061375937 (+0.040843168894450166) | > avg_loss_kl: 2.449937621752421 (+0.15942378838856985) | > avg_loss_feat: 3.6268869638442993 (-3.2125540177027387) | > avg_loss_mel: 22.54846954345703 (-2.4183019002278634) | > avg_loss_duration: 2.338202476501465 (+0.06867575645446777) | > avg_loss_1: 33.20816167195638 (-5.361913045247391)  > EPOCH: 168/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:29:06)   --> TIME: 2023-10-20 01:29:13 -- STEP: 9/50 -- GLOBAL_STEP: 61410 | > loss_disc: 1.9807804822921753 (2.32519977622562) | > loss_disc_real_0: 0.10295967012643814 (0.18605803098115656) | > loss_disc_real_1: 0.28257060050964355 (0.19396129333310658) | > loss_disc_real_2: 0.3502217233181 (0.23641596775915888) | > loss_disc_real_3: 0.27052927017211914 (0.24142112831274667) | > loss_disc_real_4: 0.2429470270872116 (0.1929961865146955) | > loss_disc_real_5: 0.14727163314819336 (0.20568467469678986) | > loss_0: 1.9807804822921753 (2.32519977622562) | > grad_norm_0: tensor(515.9241, device='cuda:0') (tensor(654.8540, device='cuda:0')) | > loss_gen: 3.1899800300598145 (2.6133291323979697) | > loss_kl: 0.7301197052001953 (1.1336373885472615) | > loss_feat: 6.776679039001465 (6.157228867212932) | > loss_mel: 22.65253448486328 (21.572541342841255) | > loss_duration: 1.6848671436309814 (1.6882327530119154) | > loss_1: 35.0341796875 (33.16496933831109) | > grad_norm_1: tensor(22198.3613, device='cuda:0') (tensor(25490.1074, device='cuda:0')) | > current_lr_0: 0.00016906899155524031 | > current_lr_1: 0.00016906899155524031 | > step_time: 0.2924 (0.3361073070102268) | > loader_time: 0.0028 (0.006967332628038194)  --> TIME: 2023-10-20 01:29:27 -- STEP: 39/50 -- GLOBAL_STEP: 61440 | > loss_disc: 2.604124069213867 (2.5173127773480535) | > loss_disc_real_0: 0.07727161049842834 (0.16964960721536324) | > loss_disc_real_1: 0.27500399947166443 (0.22994752763173518) | > loss_disc_real_2: 0.20514963567256927 (0.22565633703309756) | > loss_disc_real_3: 0.3496550917625427 (0.2744503617286683) | > loss_disc_real_4: 0.33804845809936523 (0.2107029853340907) | > loss_disc_real_5: 0.32225295901298523 (0.22262721680677855) | > loss_0: 2.604124069213867 (2.5173127773480535) | > grad_norm_0: tensor(1469.7434, device='cuda:0') (tensor(598.7598, device='cuda:0')) | > loss_gen: 2.308804988861084 (2.406081117116488) | > loss_kl: 0.5254677534103394 (1.019333847058125) | > loss_feat: 3.0438413619995117 (5.385885027356637) | > loss_mel: 21.31426239013672 (22.695082664489746) | > loss_duration: 1.7028931379318237 (1.6946557821371617) | > loss_1: 28.8952693939209 (33.20103864180736) | > grad_norm_1: tensor(20975.8887, device='cuda:0') (tensor(23151.8379, device='cuda:0')) | > current_lr_0: 0.00016906899155524031 | > current_lr_1: 0.00016906899155524031 | > step_time: 0.4869 (0.43053632516127366) | > loader_time: 0.0248 (0.010074609365218725)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9693808555603027 (2.9693808555603027) | > loss_disc_real_0: 0.2886207699775696 (0.2886207699775696) | > loss_disc_real_1: 0.28772395849227905 (0.28772395849227905) | > loss_disc_real_2: 0.3417402505874634 (0.3417402505874634) | > loss_disc_real_3: 0.3066335916519165 (0.3066335916519165) | > loss_disc_real_4: 0.30163341760635376 (0.30163341760635376) | > loss_disc_real_5: 0.2328762263059616 (0.2328762263059616) | > loss_0: 2.9693808555603027 (2.9693808555603027) | > loss_gen: 1.8446121215820312 (1.8446121215820312) | > loss_kl: 2.4220871925354004 (2.4220871925354004) | > loss_feat: 0.1659388542175293 (0.1659388542175293) | > loss_mel: 12.612358093261719 (12.612358093261719) | > loss_duration: 2.1493282318115234 (2.1493282318115234) | > loss_1: 19.194324493408203 (19.194324493408203)  --> STEP: 1 | > loss_disc: 2.3576321601867676 (2.3576321601867676) | > loss_disc_real_0: 0.2109808474779129 (0.2109808474779129) | > loss_disc_real_1: 0.24775566160678864 (0.24775566160678864) | > loss_disc_real_2: 0.20103023946285248 (0.20103023946285248) | > loss_disc_real_3: 0.38321492075920105 (0.38321492075920105) | > loss_disc_real_4: 0.34150460362434387 (0.34150460362434387) | > loss_disc_real_5: 0.11346948146820068 (0.11346948146820068) | > loss_0: 2.3576321601867676 (2.3576321601867676) | > loss_gen: 3.40566349029541 (3.40566349029541) | > loss_kl: 2.2603201866149902 (2.2603201866149902) | > loss_feat: 8.668264389038086 (8.668264389038086) | > loss_mel: 27.288829803466797 (27.288829803466797) | > loss_duration: 2.3378396034240723 (2.3378396034240723) | > loss_1: 43.96091842651367 (43.96091842651367)  --> STEP: 2 | > loss_disc: 2.326803684234619 (2.3422179222106934) | > loss_disc_real_0: 0.09361247718334198 (0.15229666233062744) | > loss_disc_real_1: 0.1573418378829956 (0.20254874974489212) | > loss_disc_real_2: 0.23716044425964355 (0.21909534186124802) | > loss_disc_real_3: 0.3568322956562042 (0.37002360820770264) | > loss_disc_real_4: 0.3832356631755829 (0.3623701333999634) | > loss_disc_real_5: 0.4482573866844177 (0.2808634340763092) | > loss_0: 2.326803684234619 (2.3422179222106934) | > loss_gen: 3.301487684249878 (3.353575587272644) | > loss_kl: 2.9247140884399414 (2.592517137527466) | > loss_feat: 7.933084487915039 (8.300674438476562) | > loss_mel: 26.83203887939453 (27.060434341430664) | > loss_duration: 2.291379928588867 (2.3146097660064697) | > loss_1: 43.28270721435547 (43.62181282043457)  --> STEP: 3 | > loss_disc: 2.3377039432525635 (2.3407132625579834) | > loss_disc_real_0: 0.4136567711830139 (0.23941669861475626) | > loss_disc_real_1: 0.3314862847328186 (0.24552792807420096) | > loss_disc_real_2: 0.2558104395866394 (0.23133370776971182) | > loss_disc_real_3: 0.3482323884963989 (0.36275986830393475) | > loss_disc_real_4: 0.22202377021312714 (0.31558801233768463) | > loss_disc_real_5: 0.1418047994375229 (0.23451055586338043) | > loss_0: 2.3377039432525635 (2.3407132625579834) | > loss_gen: 3.5219502449035645 (3.4097004731496177) | > loss_kl: 1.2585772275924683 (2.147870500882467) | > loss_feat: 5.7085041999816895 (7.4366176923116045) | > loss_mel: 20.55099868774414 (24.89062245686849) | > loss_duration: 2.274378538131714 (2.3011993567148843) | > loss_1: 33.31440734863281 (40.18601099650065) --> EVAL PERFORMANCE | > avg_loader_time: 0.015154361724853516 (+0.008556207021077473) | > avg_loss_disc: 2.3407132625579834 (-0.4371333122253418) | > avg_loss_disc_real_0: 0.23941669861475626 (-0.08422631025314334) | > avg_loss_disc_real_1: 0.24552792807420096 (-0.021696423490842193) | > avg_loss_disc_real_2: 0.23133370776971182 (-0.016643797357877077) | > avg_loss_disc_real_3: 0.36275986830393475 (+0.048717086513837216) | > avg_loss_disc_real_4: 0.31558801233768463 (+0.10319450994332632) | > avg_loss_disc_real_5: 0.23451055586338043 (-0.012460991740226746) | > avg_loss_0: 2.3407132625579834 (-0.4371333122253418) | > avg_loss_gen: 3.4097004731496177 (+1.165035367012024) | > avg_loss_kl: 2.147870500882467 (-0.30206712086995413) | > avg_loss_feat: 7.4366176923116045 (+3.809730728467305) | > avg_loss_mel: 24.89062245686849 (+2.342152913411457) | > avg_loss_duration: 2.3011993567148843 (-0.03700311978658055) | > avg_loss_1: 40.18601099650065 (+6.977849324544266)  > EPOCH: 169/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:29:42)   --> TIME: 2023-10-20 01:29:55 -- STEP: 19/50 -- GLOBAL_STEP: 61470 | > loss_disc: 2.010446310043335 (2.4273346788004826) | > loss_disc_real_0: 0.2457379400730133 (0.14402073680570252) | > loss_disc_real_1: 0.16828139126300812 (0.21987994211284737) | > loss_disc_real_2: 0.22176018357276917 (0.21194632802354663) | > loss_disc_real_3: 0.1499277800321579 (0.2446123106699241) | > loss_disc_real_4: 0.167258158326149 (0.2537323626640596) | > loss_disc_real_5: 0.039668355137109756 (0.22918002488777825) | > loss_0: 2.010446310043335 (2.4273346788004826) | > grad_norm_0: tensor(284.3495, device='cuda:0') (tensor(635.1784, device='cuda:0')) | > loss_gen: 2.806777000427246 (2.4704253108877885) | > loss_kl: 0.7450664639472961 (0.9790339877730921) | > loss_feat: 9.9413480758667 (5.921254572115447) | > loss_mel: 27.964689254760742 (25.98711355108964) | > loss_duration: 1.808326244354248 (1.7289663678721379) | > loss_1: 43.26620864868164 (37.086794200696446) | > grad_norm_1: tensor(12069.8008, device='cuda:0') (tensor(24994.2324, device='cuda:0')) | > current_lr_0: 0.00016889999651287978 | > current_lr_1: 0.00016889999651287978 | > step_time: 0.6141 (0.4958593343433581) | > loader_time: 0.0242 (0.01875882399709601)  --> TIME: 2023-10-20 01:30:08 -- STEP: 49/50 -- GLOBAL_STEP: 61500 | > loss_disc: 2.7409965991973877 (2.4411124720865356) | > loss_disc_real_0: 0.0984722375869751 (0.15370777199919128) | > loss_disc_real_1: 0.299346387386322 (0.22594697385722276) | > loss_disc_real_2: 0.22266785800457 (0.23372501286925101) | > loss_disc_real_3: 0.21893897652626038 (0.23398001889261055) | > loss_disc_real_4: 0.4043026268482208 (0.2372076612117947) | > loss_disc_real_5: 0.462534636259079 (0.2263757315825443) | > loss_0: 2.7409965991973877 (2.4411124720865356) | > grad_norm_0: tensor(645.2201, device='cuda:0') (tensor(608.1732, device='cuda:0')) | > loss_gen: 2.3552863597869873 (2.4019106407554776) | > loss_kl: 0.7655620574951172 (1.026868683343031) | > loss_feat: 4.401692867279053 (5.390171004497275) | > loss_mel: 28.094934463500977 (24.815035313976054) | > loss_duration: 1.838741660118103 (1.6850364232549861) | > loss_1: 37.456214904785156 (35.31902231488911) | > grad_norm_1: tensor(8153.4756, device='cuda:0') (tensor(20718.4688, device='cuda:0')) | > current_lr_0: 0.00016889999651287978 | > current_lr_1: 0.00016889999651287978 | > step_time: 0.2854 (0.4469817171291429) | > loader_time: 0.333 (0.021175403984225526)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.638305902481079 (2.638305902481079) | > loss_disc_real_0: 0.16437895596027374 (0.16437895596027374) | > loss_disc_real_1: 0.23998218774795532 (0.23998218774795532) | > loss_disc_real_2: 0.31723544001579285 (0.31723544001579285) | > loss_disc_real_3: 0.21133865416049957 (0.21133865416049957) | > loss_disc_real_4: 0.2255779206752777 (0.2255779206752777) | > loss_disc_real_5: 0.24143630266189575 (0.24143630266189575) | > loss_0: 2.638305902481079 (2.638305902481079) | > loss_gen: 1.912858247756958 (1.912858247756958) | > loss_kl: 2.275266170501709 (2.275266170501709) | > loss_feat: 2.7779738903045654 (2.7779738903045654) | > loss_mel: 12.323230743408203 (12.323230743408203) | > loss_duration: 2.057058334350586 (2.057058334350586) | > loss_1: 21.34638786315918 (21.34638786315918)  --> STEP: 1 | > loss_disc: 1.8916983604431152 (1.8916983604431152) | > loss_disc_real_0: 0.11104584485292435 (0.11104584485292435) | > loss_disc_real_1: 0.2647576928138733 (0.2647576928138733) | > loss_disc_real_2: 0.23622289299964905 (0.23622289299964905) | > loss_disc_real_3: 0.19444577395915985 (0.19444577395915985) | > loss_disc_real_4: 0.1647326648235321 (0.1647326648235321) | > loss_disc_real_5: 0.16594557464122772 (0.16594557464122772) | > loss_0: 1.8916983604431152 (1.8916983604431152) | > loss_gen: 2.9899630546569824 (2.9899630546569824) | > loss_kl: 2.573673725128174 (2.573673725128174) | > loss_feat: 7.443395614624023 (7.443395614624023) | > loss_mel: 25.98858642578125 (25.98858642578125) | > loss_duration: 2.2404024600982666 (2.2404024600982666) | > loss_1: 41.236019134521484 (41.236019134521484)  --> STEP: 2 | > loss_disc: 2.8110735416412354 (2.3513859510421753) | > loss_disc_real_0: 0.1636187881231308 (0.13733231648802757) | > loss_disc_real_1: 0.24322949349880219 (0.25399359315633774) | > loss_disc_real_2: 0.314308226108551 (0.27526555955410004) | > loss_disc_real_3: 0.24107424914836884 (0.21776001155376434) | > loss_disc_real_4: 0.2189902812242508 (0.19186147302389145) | > loss_disc_real_5: 0.29150140285491943 (0.22872348874807358) | > loss_0: 2.8110735416412354 (2.3513859510421753) | > loss_gen: 1.7909055948257446 (2.3904343247413635) | > loss_kl: 2.468330144882202 (2.521001935005188) | > loss_feat: 2.3919241428375244 (4.917659878730774) | > loss_mel: 38.10016632080078 (32.044376373291016) | > loss_duration: 2.233072519302368 (2.2367374897003174) | > loss_1: 46.984397888183594 (44.11020851135254)  --> STEP: 3 | > loss_disc: 2.4403491020202637 (2.381040334701538) | > loss_disc_real_0: 0.0754501074552536 (0.11670491347710292) | > loss_disc_real_1: 0.28948014974594116 (0.2658224453528722) | > loss_disc_real_2: 0.34870216250419617 (0.2997444272041321) | > loss_disc_real_3: 0.3022644817829132 (0.24592816829681396) | > loss_disc_real_4: 0.24308766424655914 (0.208936870098114) | > loss_disc_real_5: 0.2997242510318756 (0.25239040950934094) | > loss_0: 2.4403491020202637 (2.381040334701538) | > loss_gen: 2.484837532043457 (2.421902060508728) | > loss_kl: 1.5715155601501465 (2.2045064767201743) | > loss_feat: 2.121502637863159 (3.985607465108236) | > loss_mel: 22.89630699157715 (28.995019912719727) | > loss_duration: 2.174643039703369 (2.2160393397013345) | > loss_1: 31.248804092407227 (39.82307370503744) --> EVAL PERFORMANCE | > avg_loader_time: 0.017825762430826824 (+0.0026714007059733084) | > avg_loss_disc: 2.381040334701538 (+0.04032707214355469) | > avg_loss_disc_real_0: 0.11670491347710292 (-0.12271178513765334) | > avg_loss_disc_real_1: 0.2658224453528722 (+0.020294517278671237) | > avg_loss_disc_real_2: 0.2997444272041321 (+0.06841071943442026) | > avg_loss_disc_real_3: 0.24592816829681396 (-0.11683170000712079) | > avg_loss_disc_real_4: 0.208936870098114 (-0.10665114223957062) | > avg_loss_disc_real_5: 0.25239040950934094 (+0.01787985364596051) | > avg_loss_0: 2.381040334701538 (+0.04032707214355469) | > avg_loss_gen: 2.421902060508728 (-0.9877984126408896) | > avg_loss_kl: 2.2045064767201743 (+0.05663597583770752) | > avg_loss_feat: 3.985607465108236 (-3.4510102272033687) | > avg_loss_mel: 28.995019912719727 (+4.104397455851238) | > avg_loss_duration: 2.2160393397013345 (-0.0851600170135498) | > avg_loss_1: 39.82307370503744 (-0.3629372914632114)  > EPOCH: 170/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:30:22)   --> TIME: 2023-10-20 01:30:41 -- STEP: 29/50 -- GLOBAL_STEP: 61530 | > loss_disc: 2.867509365081787 (2.53697014266047) | > loss_disc_real_0: 0.18802742660045624 (0.1598660009431428) | > loss_disc_real_1: 0.275524377822876 (0.2264423121152253) | > loss_disc_real_2: 0.30234020948410034 (0.24749844996579762) | > loss_disc_real_3: 0.29796102643013 (0.23896892188951888) | > loss_disc_real_4: 0.3047701418399811 (0.2275852694593627) | > loss_disc_real_5: 0.2405855506658554 (0.23895339886176176) | > loss_0: 2.867509365081787 (2.53697014266047) | > grad_norm_0: tensor(371.3802, device='cuda:0') (tensor(620.1990, device='cuda:0')) | > loss_gen: 1.8637603521347046 (2.3543346421471956) | > loss_kl: 1.0101711750030518 (1.080956952325229) | > loss_feat: 0.498421847820282 (4.773976490929209) | > loss_mel: 7.889368534088135 (23.094889887448016) | > loss_duration: 1.6750832796096802 (1.7314752628063332) | > loss_1: 12.93680477142334 (33.03563338312609) | > grad_norm_1: tensor(5542.2178, device='cuda:0') (tensor(20010.3770, device='cuda:0')) | > current_lr_0: 0.00016873117039164476 | > current_lr_1: 0.00016873117039164476 | > step_time: 0.2938 (0.505959017523404) | > loader_time: 0.0253 (0.019968632994026972)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8392107486724854 (2.8392107486724854) | > loss_disc_real_0: 0.24755625426769257 (0.24755625426769257) | > loss_disc_real_1: 0.2513667643070221 (0.2513667643070221) | > loss_disc_real_2: 0.25009340047836304 (0.25009340047836304) | > loss_disc_real_3: 0.4484338164329529 (0.4484338164329529) | > loss_disc_real_4: 0.38803282380104065 (0.38803282380104065) | > loss_disc_real_5: 0.3882600963115692 (0.3882600963115692) | > loss_0: 2.8392107486724854 (2.8392107486724854) | > loss_gen: 2.9549496173858643 (2.9549496173858643) | > loss_kl: 2.619725465774536 (2.619725465774536) | > loss_feat: 4.960144996643066 (4.960144996643066) | > loss_mel: 22.63512420654297 (22.63512420654297) | > loss_duration: 2.1595492362976074 (2.1595492362976074) | > loss_1: 35.32949447631836 (35.32949447631836)  --> STEP: 1 | > loss_disc: 2.3089027404785156 (2.3089027404785156) | > loss_disc_real_0: 0.04941699653863907 (0.04941699653863907) | > loss_disc_real_1: 0.2256884127855301 (0.2256884127855301) | > loss_disc_real_2: 0.1472289115190506 (0.1472289115190506) | > loss_disc_real_3: 0.19362816214561462 (0.19362816214561462) | > loss_disc_real_4: 0.08135531842708588 (0.08135531842708588) | > loss_disc_real_5: 0.07122194021940231 (0.07122194021940231) | > loss_0: 2.3089027404785156 (2.3089027404785156) | > loss_gen: 2.2219178676605225 (2.2219178676605225) | > loss_kl: 2.164855480194092 (2.164855480194092) | > loss_feat: 7.148930549621582 (7.148930549621582) | > loss_mel: 25.766572952270508 (25.766572952270508) | > loss_duration: 2.223965644836426 (2.223965644836426) | > loss_1: 39.526241302490234 (39.526241302490234)  --> STEP: 2 | > loss_disc: 2.31168794631958 (2.310295343399048) | > loss_disc_real_0: 0.12977293133735657 (0.08959496393799782) | > loss_disc_real_1: 0.212261363863945 (0.21897488832473755) | > loss_disc_real_2: 0.12423039227724075 (0.13572965189814568) | > loss_disc_real_3: 0.280505895614624 (0.23706702888011932) | > loss_disc_real_4: 0.12380523979663849 (0.10258027911186218) | > loss_disc_real_5: 0.14903809130191803 (0.11013001576066017) | > loss_0: 2.31168794631958 (2.310295343399048) | > loss_gen: 2.0909273624420166 (2.1564226150512695) | > loss_kl: 2.5948522090911865 (2.379853844642639) | > loss_feat: 7.716923236846924 (7.432926893234253) | > loss_mel: 29.34343910217285 (27.55500602722168) | > loss_duration: 2.341668128967285 (2.2828168869018555) | > loss_1: 44.087806701660156 (41.807024002075195)  --> STEP: 3 | > loss_disc: 2.2128679752349854 (2.277819554011027) | > loss_disc_real_0: 0.1316310316324234 (0.10360698650280635) | > loss_disc_real_1: 0.28867706656455994 (0.2422089477380117) | > loss_disc_real_2: 0.25763070583343506 (0.17636333654324213) | > loss_disc_real_3: 0.24334639310836792 (0.23916015028953552) | > loss_disc_real_4: 0.23225656151771545 (0.14580570658047995) | > loss_disc_real_5: 0.16965670883655548 (0.12997224678595862) | > loss_0: 2.2128679752349854 (2.277819554011027) | > loss_gen: 2.6099562644958496 (2.307600498199463) | > loss_kl: 1.6471447944641113 (2.13561749458313) | > loss_feat: 4.052918434143066 (6.306257406870524) | > loss_mel: 26.280925750732422 (27.13031260172526) | > loss_duration: 2.1789469718933105 (2.2481935818990073) | > loss_1: 36.769893646240234 (40.12798055013021) --> EVAL PERFORMANCE | > avg_loader_time: 0.01005864143371582 (-0.007767120997111004) | > avg_loss_disc: 2.277819554011027 (-0.10322078069051122) | > avg_loss_disc_real_0: 0.10360698650280635 (-0.01309792697429657) | > avg_loss_disc_real_1: 0.2422089477380117 (-0.023613497614860507) | > avg_loss_disc_real_2: 0.17636333654324213 (-0.12338109066088995) | > avg_loss_disc_real_3: 0.23916015028953552 (-0.006768018007278442) | > avg_loss_disc_real_4: 0.14580570658047995 (-0.06313116351763406) | > avg_loss_disc_real_5: 0.12997224678595862 (-0.12241816272338232) | > avg_loss_0: 2.277819554011027 (-0.10322078069051122) | > avg_loss_gen: 2.307600498199463 (-0.11430156230926514) | > avg_loss_kl: 2.13561749458313 (-0.06888898213704442) | > avg_loss_feat: 6.306257406870524 (+2.3206499417622886) | > avg_loss_mel: 27.13031260172526 (-1.864707310994465) | > avg_loss_duration: 2.2481935818990073 (+0.03215424219767282) | > avg_loss_1: 40.12798055013021 (+0.30490684509277344)  > EPOCH: 171/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:31:00)   --> TIME: 2023-10-20 01:31:08 -- STEP: 9/50 -- GLOBAL_STEP: 61560 | > loss_disc: 3.0527291297912598 (2.593202100859748) | > loss_disc_real_0: 0.31253698468208313 (0.12101895175874233) | > loss_disc_real_1: 0.24630622565746307 (0.26265643537044525) | > loss_disc_real_2: 0.2559644877910614 (0.2679453243811925) | > loss_disc_real_3: 0.2374386489391327 (0.2575288299057219) | > loss_disc_real_4: 0.21656917035579681 (0.22171387904220158) | > loss_disc_real_5: 0.25170859694480896 (0.26324205431673264) | > loss_0: 3.0527291297912598 (2.593202100859748) | > grad_norm_0: tensor(640.1003, device='cuda:0') (tensor(536.5526, device='cuda:0')) | > loss_gen: 1.4280314445495605 (2.1744341320461698) | > loss_kl: 0.8088060617446899 (0.9272737304369608) | > loss_feat: 0.11164470762014389 (4.5148782307902975) | > loss_mel: 2.3484017848968506 (20.633931981192696) | > loss_duration: 1.5901755094528198 (1.6618292993969388) | > loss_1: 6.287059783935547 (29.912348323398167) | > grad_norm_1: tensor(26615.8574, device='cuda:0') (tensor(16538.0938, device='cuda:0')) | > current_lr_0: 0.00016856251302268797 | > current_lr_1: 0.00016856251302268797 | > step_time: 0.5837 (0.5145518779754639) | > loader_time: 0.005 (0.02103037304348416)  --> TIME: 2023-10-20 01:31:22 -- STEP: 39/50 -- GLOBAL_STEP: 61590 | > loss_disc: 1.5688294172286987 (2.5986377153641143) | > loss_disc_real_0: 0.035818614065647125 (0.16776873582066634) | > loss_disc_real_1: 0.12829814851284027 (0.23464024926607424) | > loss_disc_real_2: 0.3084152638912201 (0.2445820611065779) | > loss_disc_real_3: 0.07917553186416626 (0.2362542715974343) | > loss_disc_real_4: 0.09079168736934662 (0.22776028685844862) | > loss_disc_real_5: 0.03242510184645653 (0.23597603883498755) | > loss_0: 1.5688294172286987 (2.5986377153641143) | > grad_norm_0: tensor(564.0757, device='cuda:0') (tensor(778.5009, device='cuda:0')) | > loss_gen: 3.422786235809326 (2.2483766659712185) | > loss_kl: 0.5698094964027405 (0.9805359446849579) | > loss_feat: 9.373590469360352 (4.925445820754156) | > loss_mel: 32.475616455078125 (22.115137534263805) | > loss_duration: 1.7418917417526245 (1.679925215549958) | > loss_1: 47.58369445800781 (31.949421369112454) | > grad_norm_1: tensor(43847.3594, device='cuda:0') (tensor(20255.9512, device='cuda:0')) | > current_lr_0: 0.00016856251302268797 | > current_lr_1: 0.00016856251302268797 | > step_time: 0.6874 (0.449615729160798) | > loader_time: 0.022 (0.011112500459719926)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.728100538253784 (2.728100538253784) | > loss_disc_real_0: 0.1899838000535965 (0.1899838000535965) | > loss_disc_real_1: 0.21979548037052155 (0.21979548037052155) | > loss_disc_real_2: 0.25771012902259827 (0.25771012902259827) | > loss_disc_real_3: 0.2722177803516388 (0.2722177803516388) | > loss_disc_real_4: 0.212618887424469 (0.212618887424469) | > loss_disc_real_5: 0.29848140478134155 (0.29848140478134155) | > loss_0: 2.728100538253784 (2.728100538253784) | > loss_gen: 1.9788875579833984 (1.9788875579833984) | > loss_kl: 2.452143430709839 (2.452143430709839) | > loss_feat: 5.558297634124756 (5.558297634124756) | > loss_mel: 22.684736251831055 (22.684736251831055) | > loss_duration: 2.171302556991577 (2.171302556991577) | > loss_1: 34.845367431640625 (34.845367431640625)  --> STEP: 1 | > loss_disc: 2.481787919998169 (2.481787919998169) | > loss_disc_real_0: 0.0748717188835144 (0.0748717188835144) | > loss_disc_real_1: 0.20746512711048126 (0.20746512711048126) | > loss_disc_real_2: 0.28731223940849304 (0.28731223940849304) | > loss_disc_real_3: 0.34508901834487915 (0.34508901834487915) | > loss_disc_real_4: 0.1732148677110672 (0.1732148677110672) | > loss_disc_real_5: 0.21482309699058533 (0.21482309699058533) | > loss_0: 2.481787919998169 (2.481787919998169) | > loss_gen: 2.121325969696045 (2.121325969696045) | > loss_kl: 2.851560115814209 (2.851560115814209) | > loss_feat: 5.3593244552612305 (5.3593244552612305) | > loss_mel: 25.2149715423584 (25.2149715423584) | > loss_duration: 2.3739383220672607 (2.3739383220672607) | > loss_1: 37.92112350463867 (37.92112350463867)  --> STEP: 2 | > loss_disc: 2.5567760467529297 (2.5192819833755493) | > loss_disc_real_0: 0.17228202521800995 (0.12357687205076218) | > loss_disc_real_1: 0.2596977651119232 (0.23358144611120224) | > loss_disc_real_2: 0.2478378415107727 (0.2675750404596329) | > loss_disc_real_3: 0.264571875333786 (0.3048304468393326) | > loss_disc_real_4: 0.20064210891723633 (0.18692848831415176) | > loss_disc_real_5: 0.2184154987335205 (0.21661929786205292) | > loss_0: 2.5567760467529297 (2.5192819833755493) | > loss_gen: 2.055908679962158 (2.0886173248291016) | > loss_kl: 2.8429510593414307 (2.84725558757782) | > loss_feat: 2.2755584716796875 (3.817441463470459) | > loss_mel: 24.69745635986328 (24.95621395111084) | > loss_duration: 2.2719368934631348 (2.3229376077651978) | > loss_1: 34.1438102722168 (36.032466888427734)  --> STEP: 3 | > loss_disc: 2.6204047203063965 (2.5529895623524985) | > loss_disc_real_0: 0.10870638489723206 (0.11862004299958546) | > loss_disc_real_1: 0.20683209598064423 (0.2246649960676829) | > loss_disc_real_2: 0.21591998636722565 (0.25035668909549713) | > loss_disc_real_3: 0.25147825479507446 (0.2870463828245799) | > loss_disc_real_4: 0.25157955288887024 (0.20847884317239126) | > loss_disc_real_5: 0.34056875109672546 (0.2579357822736104) | > loss_0: 2.6204047203063965 (2.5529895623524985) | > loss_gen: 1.9222419261932373 (2.033158858617147) | > loss_kl: 1.5173041820526123 (2.4039384524027505) | > loss_feat: 2.275291681289673 (3.3033915360768638) | > loss_mel: 22.785287857055664 (24.232571919759113) | > loss_duration: 2.207084894180298 (2.284320036570231) | > loss_1: 30.707210540771484 (34.257381439208984) --> EVAL PERFORMANCE | > avg_loader_time: 0.023737351099650066 (+0.013678709665934246) | > avg_loss_disc: 2.5529895623524985 (+0.27517000834147165) | > avg_loss_disc_real_0: 0.11862004299958546 (+0.015013056496779115) | > avg_loss_disc_real_1: 0.2246649960676829 (-0.017543951670328795) | > avg_loss_disc_real_2: 0.25035668909549713 (+0.073993352552255) | > avg_loss_disc_real_3: 0.2870463828245799 (+0.04788623253504437) | > avg_loss_disc_real_4: 0.20847884317239126 (+0.06267313659191132) | > avg_loss_disc_real_5: 0.2579357822736104 (+0.1279635354876518) | > avg_loss_0: 2.5529895623524985 (+0.27517000834147165) | > avg_loss_gen: 2.033158858617147 (-0.27444163958231593) | > avg_loss_kl: 2.4039384524027505 (+0.2683209578196206) | > avg_loss_feat: 3.3033915360768638 (-3.0028658707936606) | > avg_loss_mel: 24.232571919759113 (-2.897740681966148) | > avg_loss_duration: 2.284320036570231 (+0.03612645467122366) | > avg_loss_1: 34.257381439208984 (-5.870599110921226)  > EPOCH: 172/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:31:36)   --> TIME: 2023-10-20 01:31:50 -- STEP: 19/50 -- GLOBAL_STEP: 61620 | > loss_disc: 2.189455509185791 (2.418563485145569) | > loss_disc_real_0: 0.13090915977954865 (0.16293915424888072) | > loss_disc_real_1: 0.15181313455104828 (0.2269645615627891) | > loss_disc_real_2: 0.16356074810028076 (0.2161488015400736) | > loss_disc_real_3: 0.12931647896766663 (0.22297318279743195) | > loss_disc_real_4: 0.15800204873085022 (0.2183774239138553) | > loss_disc_real_5: 0.11109597980976105 (0.2309309267684033) | > loss_0: 2.189455509185791 (2.418563485145569) | > grad_norm_0: tensor(943.4720, device='cuda:0') (tensor(1143.2129, device='cuda:0')) | > loss_gen: 1.7887601852416992 (2.2929367077978027) | > loss_kl: 1.1608892679214478 (1.110082955736863) | > loss_feat: 4.041622161865234 (4.415824802298295) | > loss_mel: 21.227584838867188 (21.621184600026982) | > loss_duration: 1.8215422630310059 (1.7350714645887677) | > loss_1: 30.0403995513916 (31.175101305309095) | > grad_norm_1: tensor(11709.8379, device='cuda:0') (tensor(41720.7188, device='cuda:0')) | > current_lr_0: 0.00016839402423733102 | > current_lr_1: 0.00016839402423733102 | > step_time: 0.2883 (0.4899645479101884) | > loader_time: 0.0252 (0.019993920075265986)  --> TIME: 2023-10-20 01:32:06 -- STEP: 49/50 -- GLOBAL_STEP: 61650 | > loss_disc: 1.6999011039733887 (2.5080198000888436) | > loss_disc_real_0: 0.1366470605134964 (0.1754531623719602) | > loss_disc_real_1: 0.1890377402305603 (0.22511702091718205) | > loss_disc_real_2: 0.08283580094575882 (0.23188278615018543) | > loss_disc_real_3: 0.2322150617837906 (0.23539077984739323) | > loss_disc_real_4: 0.12711313366889954 (0.24666753548140433) | > loss_disc_real_5: 0.014798341318964958 (0.23515138923361592) | > loss_0: 1.6999011039733887 (2.5080198000888436) | > grad_norm_0: tensor(1567.6958, device='cuda:0') (tensor(1392.6090, device='cuda:0')) | > loss_gen: 2.7661426067352295 (2.3680107374580537) | > loss_kl: 0.879414975643158 (1.0014731519076285) | > loss_feat: 7.090210914611816 (5.0157973656848975) | > loss_mel: 27.20745086669922 (22.113451755776698) | > loss_duration: 1.7711416482925415 (1.689483034367464) | > loss_1: 39.71436309814453 (32.18821634565081) | > grad_norm_1: tensor(43760.7461, device='cuda:0') (tensor(41940.0469, device='cuda:0')) | > current_lr_0: 0.00016839402423733102 | > current_lr_1: 0.00016839402423733102 | > step_time: 0.3876 (0.4907157031857238) | > loader_time: 0.3528 (0.027312084120147077)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9928157329559326 (2.9928157329559326) | > loss_disc_real_0: 0.19811555743217468 (0.19811555743217468) | > loss_disc_real_1: 0.21259745955467224 (0.21259745955467224) | > loss_disc_real_2: 0.25068050622940063 (0.25068050622940063) | > loss_disc_real_3: 0.25305843353271484 (0.25305843353271484) | > loss_disc_real_4: 0.23507560789585114 (0.23507560789585114) | > loss_disc_real_5: 0.24621543288230896 (0.24621543288230896) | > loss_0: 2.9928157329559326 (2.9928157329559326) | > loss_gen: 1.4266417026519775 (1.4266417026519775) | > loss_kl: 2.3585562705993652 (2.3585562705993652) | > loss_feat: 0.2982044219970703 (0.2982044219970703) | > loss_mel: 15.177058219909668 (15.177058219909668) | > loss_duration: 2.150174617767334 (2.150174617767334) | > loss_1: 21.410634994506836 (21.410634994506836)  --> STEP: 1 | > loss_disc: 2.3479690551757812 (2.3479690551757812) | > loss_disc_real_0: 0.084784597158432 (0.084784597158432) | > loss_disc_real_1: 0.17222356796264648 (0.17222356796264648) | > loss_disc_real_2: 0.16232581436634064 (0.16232581436634064) | > loss_disc_real_3: 0.24088236689567566 (0.24088236689567566) | > loss_disc_real_4: 0.25616592168807983 (0.25616592168807983) | > loss_disc_real_5: 0.26684677600860596 (0.26684677600860596) | > loss_0: 2.3479690551757812 (2.3479690551757812) | > loss_gen: 2.1792430877685547 (2.1792430877685547) | > loss_kl: 3.0535526275634766 (3.0535526275634766) | > loss_feat: 5.006031513214111 (5.006031513214111) | > loss_mel: 20.822341918945312 (20.822341918945312) | > loss_duration: 2.2868151664733887 (2.2868151664733887) | > loss_1: 33.347984313964844 (33.347984313964844)  --> STEP: 2 | > loss_disc: 3.0136218070983887 (2.680795431137085) | > loss_disc_real_0: 0.19314734637737274 (0.13896597176790237) | > loss_disc_real_1: 0.2125110775232315 (0.192367322742939) | > loss_disc_real_2: 0.2520042657852173 (0.20716504007577896) | > loss_disc_real_3: 0.25230923295021057 (0.24659579992294312) | > loss_disc_real_4: 0.2351389229297638 (0.24565242230892181) | > loss_disc_real_5: 0.24612198770046234 (0.25648438185453415) | > loss_0: 3.0136218070983887 (2.680795431137085) | > loss_gen: 1.407353162765503 (1.7932981252670288) | > loss_kl: 2.5932350158691406 (2.8233938217163086) | > loss_feat: 0.29014885425567627 (2.648090183734894) | > loss_mel: 5.493577003479004 (13.157959461212158) | > loss_duration: 2.413224458694458 (2.3500198125839233) | > loss_1: 12.197538375854492 (22.772761344909668)  --> STEP: 3 | > loss_disc: 3.3275885581970215 (2.896393140157064) | > loss_disc_real_0: 0.6936987638473511 (0.32387690246105194) | > loss_disc_real_1: 0.32293984293937683 (0.23589149614175162) | > loss_disc_real_2: 0.442801833152771 (0.2857106377681096) | > loss_disc_real_3: 0.4019768238067627 (0.298389474550883) | > loss_disc_real_4: 0.2978476881980896 (0.2630508442719777) | > loss_disc_real_5: 0.4677286744117737 (0.32689914604028064) | > loss_0: 3.3275885581970215 (2.896393140157064) | > loss_gen: 3.1126818656921387 (2.233092705408732) | > loss_kl: 1.668492317199707 (2.438426653544108) | > loss_feat: 3.8526055812835693 (3.049595316251119) | > loss_mel: 29.99999237060547 (18.77197043100993) | > loss_duration: 2.2851569652557373 (2.328398863474528) | > loss_1: 40.91893005371094 (28.821484247843426) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028626124064127603 (-0.020874738693237305) | > avg_loss_disc: 2.896393140157064 (+0.34340357780456543) | > avg_loss_disc_real_0: 0.32387690246105194 (+0.2052568594614665) | > avg_loss_disc_real_1: 0.23589149614175162 (+0.011226500074068724) | > avg_loss_disc_real_2: 0.2857106377681096 (+0.03535394867261249) | > avg_loss_disc_real_3: 0.298389474550883 (+0.0113430917263031) | > avg_loss_disc_real_4: 0.2630508442719777 (+0.05457200109958646) | > avg_loss_disc_real_5: 0.32689914604028064 (+0.06896336376667023) | > avg_loss_0: 2.896393140157064 (+0.34340357780456543) | > avg_loss_gen: 2.233092705408732 (+0.199933846791585) | > avg_loss_kl: 2.438426653544108 (+0.03448820114135742) | > avg_loss_feat: 3.049595316251119 (-0.25379621982574463) | > avg_loss_mel: 18.77197043100993 (-5.460601488749184) | > avg_loss_duration: 2.328398863474528 (+0.044078826904296875) | > avg_loss_1: 28.821484247843426 (-5.435897191365559)  > EPOCH: 173/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:32:18)   --> TIME: 2023-10-20 01:32:36 -- STEP: 29/50 -- GLOBAL_STEP: 61680 | > loss_disc: 2.887937545776367 (2.2780837478308844) | > loss_disc_real_0: 0.11295285820960999 (0.16270766728397076) | > loss_disc_real_1: 0.22728976607322693 (0.19920209255711785) | > loss_disc_real_2: 0.2431519776582718 (0.19325338997717562) | > loss_disc_real_3: 0.28860753774642944 (0.24924645161834255) | > loss_disc_real_4: 0.20730285346508026 (0.1996549154663908) | > loss_disc_real_5: 0.29467976093292236 (0.18249041397638363) | > loss_0: 2.887937545776367 (2.2780837478308844) | > grad_norm_0: tensor(1098.0393, device='cuda:0') (tensor(1242.6425, device='cuda:0')) | > loss_gen: 2.0976905822753906 (2.630539318610882) | > loss_kl: 0.8714494705200195 (1.1235402452534642) | > loss_feat: 5.2076239585876465 (6.5496623304126595) | > loss_mel: 20.59206199645996 (24.680348116776038) | > loss_duration: 1.7019381523132324 (1.7010715336635196) | > loss_1: 30.47076416015625 (36.68516159057617) | > grad_norm_1: tensor(20726.0664, device='cuda:0') (tensor(59665.6562, device='cuda:0')) | > current_lr_0: 0.00016822570386706404 | > current_lr_1: 0.00016822570386706404 | > step_time: 0.2926 (0.4848946127398261) | > loader_time: 0.0249 (0.01761022107354526)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.670686960220337 (1.670686960220337) | > loss_disc_real_0: 0.13591903448104858 (0.13591903448104858) | > loss_disc_real_1: 0.22799347341060638 (0.22799347341060638) | > loss_disc_real_2: 0.060846902430057526 (0.060846902430057526) | > loss_disc_real_3: 0.15593428909778595 (0.15593428909778595) | > loss_disc_real_4: 0.10979554057121277 (0.10979554057121277) | > loss_disc_real_5: 0.060217998921871185 (0.060217998921871185) | > loss_0: 1.670686960220337 (1.670686960220337) | > loss_gen: 2.576655387878418 (2.576655387878418) | > loss_kl: 2.430384397506714 (2.430384397506714) | > loss_feat: 9.559076309204102 (9.559076309204102) | > loss_mel: 22.463560104370117 (22.463560104370117) | > loss_duration: 2.179600477218628 (2.179600477218628) | > loss_1: 39.20927810668945 (39.20927810668945)  --> STEP: 1 | > loss_disc: 1.7744853496551514 (1.7744853496551514) | > loss_disc_real_0: 0.060603395104408264 (0.060603395104408264) | > loss_disc_real_1: 0.1991584748029709 (0.1991584748029709) | > loss_disc_real_2: 0.14246664941310883 (0.14246664941310883) | > loss_disc_real_3: 0.262541264295578 (0.262541264295578) | > loss_disc_real_4: 0.08331860601902008 (0.08331860601902008) | > loss_disc_real_5: 0.05308990925550461 (0.05308990925550461) | > loss_0: 1.7744853496551514 (1.7744853496551514) | > loss_gen: 2.544121026992798 (2.544121026992798) | > loss_kl: 3.009343147277832 (3.009343147277832) | > loss_feat: 8.24906063079834 (8.24906063079834) | > loss_mel: 26.4144344329834 (26.4144344329834) | > loss_duration: 2.3772261142730713 (2.3772261142730713) | > loss_1: 42.59418487548828 (42.59418487548828)  --> STEP: 2 | > loss_disc: 4.614349365234375 (3.194417357444763) | > loss_disc_real_0: 0.025721602141857147 (0.043162498623132706) | > loss_disc_real_1: 0.19062107801437378 (0.19488977640867233) | > loss_disc_real_2: 0.12880463898181915 (0.135635644197464) | > loss_disc_real_3: 0.15045563876628876 (0.20649845153093338) | > loss_disc_real_4: 0.13799580931663513 (0.1106572076678276) | > loss_disc_real_5: 0.16762718558311462 (0.11035854741930962) | > loss_0: 4.614349365234375 (3.194417357444763) | > loss_gen: 1.556626319885254 (2.050373673439026) | > loss_kl: 2.8928029537200928 (2.9510730504989624) | > loss_feat: 8.973344802856445 (8.611202716827393) | > loss_mel: 32.83653259277344 (29.625483512878418) | > loss_duration: 2.285438060760498 (2.3313320875167847) | > loss_1: 48.54474639892578 (45.56946563720703)  --> STEP: 3 | > loss_disc: 2.9684176445007324 (3.119084119796753) | > loss_disc_real_0: 0.2069908082485199 (0.09777193516492844) | > loss_disc_real_1: 0.25152814388275146 (0.21376923223336539) | > loss_disc_real_2: 0.22091573476791382 (0.1640623410542806) | > loss_disc_real_3: 0.24898268282413483 (0.22065986196200052) | > loss_disc_real_4: 0.2672218978404999 (0.16284543772538504) | > loss_disc_real_5: 0.27610674500465393 (0.16560794661442438) | > loss_0: 2.9684176445007324 (3.119084119796753) | > loss_gen: 1.515626072883606 (1.872124473253886) | > loss_kl: 1.5825690031051636 (2.4949050347010293) | > loss_feat: 0.10977454483509064 (5.777393326163292) | > loss_mel: 3.2367966175079346 (20.829254547754925) | > loss_duration: 2.274622917175293 (2.3124290307362876) | > loss_1: 8.719388961791992 (33.286106745402016) --> EVAL PERFORMANCE | > avg_loader_time: 0.007093032201131185 (+0.004230419794718424) | > avg_loss_disc: 3.119084119796753 (+0.22269097963968898) | > avg_loss_disc_real_0: 0.09777193516492844 (-0.2261049672961235) | > avg_loss_disc_real_1: 0.21376923223336539 (-0.02212226390838623) | > avg_loss_disc_real_2: 0.1640623410542806 (-0.12164829671382901) | > avg_loss_disc_real_3: 0.22065986196200052 (-0.07772961258888247) | > avg_loss_disc_real_4: 0.16284543772538504 (-0.10020540654659268) | > avg_loss_disc_real_5: 0.16560794661442438 (-0.16129119942585626) | > avg_loss_0: 3.119084119796753 (+0.22269097963968898) | > avg_loss_gen: 1.872124473253886 (-0.36096823215484597) | > avg_loss_kl: 2.4949050347010293 (+0.05647838115692139) | > avg_loss_feat: 5.777393326163292 (+2.727798009912173) | > avg_loss_mel: 20.829254547754925 (+2.057284116744995) | > avg_loss_duration: 2.3124290307362876 (-0.015969832738240264) | > avg_loss_1: 33.286106745402016 (+4.46462249755859)  > EPOCH: 174/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:32:57)   --> TIME: 2023-10-20 01:33:05 -- STEP: 9/50 -- GLOBAL_STEP: 61710 | > loss_disc: 1.8384519815444946 (2.4037753211127386) | > loss_disc_real_0: 0.03983422741293907 (0.18218432573808563) | > loss_disc_real_1: 0.16164365410804749 (0.24121053102943632) | > loss_disc_real_2: 0.33162921667099 (0.2572128739621904) | > loss_disc_real_3: 0.22624383866786957 (0.22336298558447096) | > loss_disc_real_4: 0.19740800559520721 (0.20701012636224428) | > loss_disc_real_5: 0.13347768783569336 (0.23532205302682188) | > loss_0: 1.8384519815444946 (2.4037753211127386) | > grad_norm_0: tensor(975.2864, device='cuda:0') (tensor(1008.9427, device='cuda:0')) | > loss_gen: 2.8092174530029297 (2.512744903564453) | > loss_kl: 0.9519179463386536 (1.1280071934064229) | > loss_feat: 6.768092155456543 (5.3840965032577515) | > loss_mel: 22.945598602294922 (24.14115333557129) | > loss_duration: 1.6443220376968384 (1.6815202765994601) | > loss_1: 35.11914825439453 (34.8475227355957) | > grad_norm_1: tensor(55524.9414, device='cuda:0') (tensor(36107.1992, device='cuda:0')) | > current_lr_0: 0.0001680575517435456 | > current_lr_1: 0.0001680575517435456 | > step_time: 0.5765 (0.5294286410013834) | > loader_time: 0.0248 (0.017747163772583008)  --> TIME: 2023-10-20 01:33:17 -- STEP: 39/50 -- GLOBAL_STEP: 61740 | > loss_disc: 3.0205183029174805 (2.4722868509781666) | > loss_disc_real_0: 0.2145322859287262 (0.1836503032977) | > loss_disc_real_1: 0.2527164816856384 (0.22906084607044855) | > loss_disc_real_2: 0.27707090973854065 (0.22229783337276715) | > loss_disc_real_3: 0.29133179783821106 (0.23585997798886055) | > loss_disc_real_4: 0.2605988681316376 (0.2380073947402147) | > loss_disc_real_5: 0.37508320808410645 (0.2391270221903538) | > loss_0: 3.0205183029174805 (2.4722868509781666) | > grad_norm_0: tensor(2560.0676, device='cuda:0') (tensor(1318.4916, device='cuda:0')) | > loss_gen: 1.7433022260665894 (2.3541669448216758) | > loss_kl: 0.9453747868537903 (1.0505644595011687) | > loss_feat: 0.12130711227655411 (4.754230142785953) | > loss_mel: 8.187664031982422 (23.94007408924592) | > loss_duration: 1.7208470106124878 (1.6855438886544643) | > loss_1: 12.71849536895752 (33.78457966828957) | > grad_norm_1: tensor(51284.1719, device='cuda:0') (tensor(33567.2656, device='cuda:0')) | > current_lr_0: 0.0001680575517435456 | > current_lr_1: 0.0001680575517435456 | > step_time: 0.6722 (0.4207986318148099) | > loader_time: 0.022 (0.011408237310556265)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5826711654663086 (2.5826711654663086) | > loss_disc_real_0: 0.35614651441574097 (0.35614651441574097) | > loss_disc_real_1: 0.21699529886245728 (0.21699529886245728) | > loss_disc_real_2: 0.26151400804519653 (0.26151400804519653) | > loss_disc_real_3: 0.2741043269634247 (0.2741043269634247) | > loss_disc_real_4: 0.25787827372550964 (0.25787827372550964) | > loss_disc_real_5: 0.23261627554893494 (0.23261627554893494) | > loss_0: 2.5826711654663086 (2.5826711654663086) | > loss_gen: 2.3937346935272217 (2.3937346935272217) | > loss_kl: 2.024864912033081 (2.024864912033081) | > loss_feat: 3.7370128631591797 (3.7370128631591797) | > loss_mel: 23.323028564453125 (23.323028564453125) | > loss_duration: 2.2101850509643555 (2.2101850509643555) | > loss_1: 33.68882751464844 (33.68882751464844)  --> STEP: 1 | > loss_disc: 3.1834559440612793 (3.1834559440612793) | > loss_disc_real_0: 0.4619898200035095 (0.4619898200035095) | > loss_disc_real_1: 0.38819965720176697 (0.38819965720176697) | > loss_disc_real_2: 0.3025015890598297 (0.3025015890598297) | > loss_disc_real_3: 0.25562387704849243 (0.25562387704849243) | > loss_disc_real_4: 0.2836278975009918 (0.2836278975009918) | > loss_disc_real_5: 0.27709314227104187 (0.27709314227104187) | > loss_0: 3.1834559440612793 (3.1834559440612793) | > loss_gen: 2.6276967525482178 (2.6276967525482178) | > loss_kl: 2.7620062828063965 (2.7620062828063965) | > loss_feat: 5.974571228027344 (5.974571228027344) | > loss_mel: 27.662261962890625 (27.662261962890625) | > loss_duration: 2.3488731384277344 (2.3488731384277344) | > loss_1: 41.37541198730469 (41.37541198730469)  --> STEP: 2 | > loss_disc: 2.1388094425201416 (2.6611326932907104) | > loss_disc_real_0: 0.320671021938324 (0.39133042097091675) | > loss_disc_real_1: 0.13129325211048126 (0.2597464546561241) | > loss_disc_real_2: 0.19646385312080383 (0.24948272109031677) | > loss_disc_real_3: 0.28484997153282166 (0.27023692429065704) | > loss_disc_real_4: 0.10778401046991348 (0.19570595398545265) | > loss_disc_real_5: 0.26303043961524963 (0.27006179094314575) | > loss_0: 2.1388094425201416 (2.6611326932907104) | > loss_gen: 3.1876518726348877 (2.9076743125915527) | > loss_kl: 2.968909502029419 (2.8654578924179077) | > loss_feat: 8.484134674072266 (7.229352951049805) | > loss_mel: 25.267467498779297 (26.46486473083496) | > loss_duration: 2.339709758758545 (2.3442914485931396) | > loss_1: 42.24787521362305 (41.81164360046387)  --> STEP: 3 | > loss_disc: 2.134553909301758 (2.4856064319610596) | > loss_disc_real_0: 0.26105406880378723 (0.3479049702485402) | > loss_disc_real_1: 0.2585911452770233 (0.2593613515297572) | > loss_disc_real_2: 0.29075413942337036 (0.26323986053466797) | > loss_disc_real_3: 0.23117578029632568 (0.25721654295921326) | > loss_disc_real_4: 0.25902271270751953 (0.2168115402261416) | > loss_disc_real_5: 0.1772332638502121 (0.23911894857883453) | > loss_0: 2.134553909301758 (2.4856064319610596) | > loss_gen: 3.0198593139648438 (2.9450693130493164) | > loss_kl: 1.3184362649917603 (2.349784016609192) | > loss_feat: 5.296742916107178 (6.585149606068929) | > loss_mel: 22.284345626831055 (25.07135836283366) | > loss_duration: 2.284515857696533 (2.324366251627604) | > loss_1: 34.20389938354492 (39.27572886149088) --> EVAL PERFORMANCE | > avg_loader_time: 0.005528847376505534 (-0.0015641848246256505) | > avg_loss_disc: 2.4856064319610596 (-0.6334776878356934) | > avg_loss_disc_real_0: 0.3479049702485402 (+0.2501330350836118) | > avg_loss_disc_real_1: 0.2593613515297572 (+0.045592119296391814) | > avg_loss_disc_real_2: 0.26323986053466797 (+0.09917751948038736) | > avg_loss_disc_real_3: 0.25721654295921326 (+0.03655668099721274) | > avg_loss_disc_real_4: 0.2168115402261416 (+0.05396610250075656) | > avg_loss_disc_real_5: 0.23911894857883453 (+0.07351100196441016) | > avg_loss_0: 2.4856064319610596 (-0.6334776878356934) | > avg_loss_gen: 2.9450693130493164 (+1.0729448397954304) | > avg_loss_kl: 2.349784016609192 (-0.14512101809183742) | > avg_loss_feat: 6.585149606068929 (+0.8077562799056368) | > avg_loss_mel: 25.07135836283366 (+4.242103815078735) | > avg_loss_duration: 2.324366251627604 (+0.011937220891316436) | > avg_loss_1: 39.27572886149088 (+5.989622116088867)  > EPOCH: 175/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:33:33)   --> TIME: 2023-10-20 01:33:47 -- STEP: 19/50 -- GLOBAL_STEP: 61770 | > loss_disc: 2.543165683746338 (2.3773304537722937) | > loss_disc_real_0: 0.12077441811561584 (0.14947073632165006) | > loss_disc_real_1: 0.21166379749774933 (0.22258212456577703) | > loss_disc_real_2: 0.2549798786640167 (0.23866728810887583) | > loss_disc_real_3: 0.25191637873649597 (0.21702876628229492) | > loss_disc_real_4: 0.1985752433538437 (0.22960924866952395) | > loss_disc_real_5: 0.30518367886543274 (0.23378140244044757) | > loss_0: 2.543165683746338 (2.3773304537722937) | > grad_norm_0: tensor(1071.5336, device='cuda:0') (tensor(1573.4874, device='cuda:0')) | > loss_gen: 2.2689290046691895 (2.5727940170388472) | > loss_kl: 0.9765360355377197 (1.1382213736835278) | > loss_feat: 4.97358512878418 (5.523805985325261) | > loss_mel: 25.294021606445312 (24.09392361891897) | > loss_duration: 1.7959558963775635 (1.7285695264213963) | > loss_1: 35.30902862548828 (35.05731507351524) | > grad_norm_1: tensor(18275.6484, device='cuda:0') (tensor(53084.0156, device='cuda:0')) | > current_lr_0: 0.00016788956769860246 | > current_lr_1: 0.00016788956769860246 | > step_time: 0.5312 (0.5023869840722335) | > loader_time: 0.015 (0.018128671144184313)  --> TIME: 2023-10-20 01:34:03 -- STEP: 49/50 -- GLOBAL_STEP: 61800 | > loss_disc: 2.419408082962036 (2.484904559291139) | > loss_disc_real_0: 0.5367178916931152 (0.17684440656888242) | > loss_disc_real_1: 0.2108735591173172 (0.2375796339949783) | > loss_disc_real_2: 0.20775793492794037 (0.2160046389516519) | > loss_disc_real_3: 0.30573979020118713 (0.23411931994618201) | > loss_disc_real_4: 0.3159080147743225 (0.2330662507031645) | > loss_disc_real_5: 0.27340805530548096 (0.2289593667932311) | > loss_0: 2.419408082962036 (2.484904559291139) | > grad_norm_0: tensor(2267.6558, device='cuda:0') (tensor(1399.7767, device='cuda:0')) | > loss_gen: 3.1154675483703613 (2.478369948815327) | > loss_kl: 0.5411919355392456 (1.0848461997752283) | > loss_feat: 4.900285243988037 (5.394082827075405) | > loss_mel: 26.413436889648438 (23.923381844345403) | > loss_duration: 1.8138083219528198 (1.690041082245963) | > loss_1: 36.7841911315918 (34.57072191822286) | > grad_norm_1: tensor(40108.4375, device='cuda:0') (tensor(43435.6211, device='cuda:0')) | > current_lr_0: 0.00016788956769860246 | > current_lr_1: 0.00016788956769860246 | > step_time: 0.3478 (0.5001778310658983) | > loader_time: 0.3379 (0.02613943450304926)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.093168258666992 (3.093168258666992) | > loss_disc_real_0: 0.5534072518348694 (0.5534072518348694) | > loss_disc_real_1: 0.2139812409877777 (0.2139812409877777) | > loss_disc_real_2: 0.34617143869400024 (0.34617143869400024) | > loss_disc_real_3: 0.3549962639808655 (0.3549962639808655) | > loss_disc_real_4: 0.3565535545349121 (0.3565535545349121) | > loss_disc_real_5: 0.33169037103652954 (0.33169037103652954) | > loss_0: 3.093168258666992 (3.093168258666992) | > loss_gen: 2.7534451484680176 (2.7534451484680176) | > loss_kl: 2.681993007659912 (2.681993007659912) | > loss_feat: 4.881338119506836 (4.881338119506836) | > loss_mel: 21.54709243774414 (21.54709243774414) | > loss_duration: 2.197772979736328 (2.197772979736328) | > loss_1: 34.061641693115234 (34.061641693115234)  --> STEP: 1 | > loss_disc: 2.1997268199920654 (2.1997268199920654) | > loss_disc_real_0: 0.18923814594745636 (0.18923814594745636) | > loss_disc_real_1: 0.18933214247226715 (0.18933214247226715) | > loss_disc_real_2: 0.2335377335548401 (0.2335377335548401) | > loss_disc_real_3: 0.2151462286710739 (0.2151462286710739) | > loss_disc_real_4: 0.19199110567569733 (0.19199110567569733) | > loss_disc_real_5: 0.08167614042758942 (0.08167614042758942) | > loss_0: 2.1997268199920654 (2.1997268199920654) | > loss_gen: 2.452767848968506 (2.452767848968506) | > loss_kl: 2.6877317428588867 (2.6877317428588867) | > loss_feat: 5.1522111892700195 (5.1522111892700195) | > loss_mel: 24.748313903808594 (24.748313903808594) | > loss_duration: 2.291853904724121 (2.291853904724121) | > loss_1: 37.33287811279297 (37.33287811279297)  --> STEP: 2 | > loss_disc: 2.3620214462280273 (2.2808741331100464) | > loss_disc_real_0: 0.1528153121471405 (0.17102672904729843) | > loss_disc_real_1: 0.1357785016298294 (0.16255532205104828) | > loss_disc_real_2: 0.32393550872802734 (0.2787366211414337) | > loss_disc_real_3: 0.27822551131248474 (0.24668586999177933) | > loss_disc_real_4: 0.38200974464416504 (0.2870004251599312) | > loss_disc_real_5: 0.3685956299304962 (0.22513588517904282) | > loss_0: 2.3620214462280273 (2.2808741331100464) | > loss_gen: 3.035525321960449 (2.7441465854644775) | > loss_kl: 3.099036693572998 (2.8933842182159424) | > loss_feat: 5.887353897094727 (5.519782543182373) | > loss_mel: 28.710430145263672 (26.729372024536133) | > loss_duration: 2.3559937477111816 (2.3239238262176514) | > loss_1: 43.08834457397461 (40.21061134338379)  --> STEP: 3 | > loss_disc: 2.9890003204345703 (2.516916195551554) | > loss_disc_real_0: 0.46927544474601746 (0.2704429676135381) | > loss_disc_real_1: 0.35015952587127686 (0.22509005665779114) | > loss_disc_real_2: 0.28362560272216797 (0.28036628166834515) | > loss_disc_real_3: 0.38520941138267517 (0.2928603837887446) | > loss_disc_real_4: 0.29987549781799316 (0.29129211604595184) | > loss_disc_real_5: 0.3449329733848572 (0.26506824791431427) | > loss_0: 2.9890003204345703 (2.516916195551554) | > loss_gen: 2.553330898284912 (2.6805413564046225) | > loss_kl: 1.3266509771347046 (2.3711398045221963) | > loss_feat: 1.7296154499053955 (4.256393512090047) | > loss_mel: 22.257896423339844 (25.238880157470703) | > loss_duration: 2.2358858585357666 (2.2945778369903564) | > loss_1: 30.10338020324707 (36.84153429667155) --> EVAL PERFORMANCE | > avg_loader_time: 0.023595571517944336 (+0.0180667241414388) | > avg_loss_disc: 2.516916195551554 (+0.031309763590494644) | > avg_loss_disc_real_0: 0.2704429676135381 (-0.07746200263500214) | > avg_loss_disc_real_1: 0.22509005665779114 (-0.03427129487196606) | > avg_loss_disc_real_2: 0.28036628166834515 (+0.017126421133677183) | > avg_loss_disc_real_3: 0.2928603837887446 (+0.03564384082953137) | > avg_loss_disc_real_4: 0.29129211604595184 (+0.07448057581981024) | > avg_loss_disc_real_5: 0.26506824791431427 (+0.025949299335479736) | > avg_loss_0: 2.516916195551554 (+0.031309763590494644) | > avg_loss_gen: 2.6805413564046225 (-0.26452795664469386) | > avg_loss_kl: 2.3711398045221963 (+0.02135578791300441) | > avg_loss_feat: 4.256393512090047 (-2.328756093978882) | > avg_loss_mel: 25.238880157470703 (+0.1675217946370431) | > avg_loss_duration: 2.2945778369903564 (-0.029788414637247573) | > avg_loss_1: 36.84153429667155 (-2.434194564819336)  > EPOCH: 176/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:34:14)   --> TIME: 2023-10-20 01:34:33 -- STEP: 29/50 -- GLOBAL_STEP: 61830 | > loss_disc: 2.7503035068511963 (2.5329391504156185) | > loss_disc_real_0: 0.015649862587451935 (0.160566755666815) | > loss_disc_real_1: 0.2547972798347473 (0.23044718390908733) | > loss_disc_real_2: 0.11342546343803406 (0.23972360815467506) | > loss_disc_real_3: 0.25338953733444214 (0.24153473035528739) | > loss_disc_real_4: 0.24419669806957245 (0.21620486641366934) | > loss_disc_real_5: 0.24663016200065613 (0.22707789135968376) | > loss_0: 2.7503035068511963 (2.5329391504156185) | > grad_norm_0: tensor(4034.7043, device='cuda:0') (tensor(1469.1207, device='cuda:0')) | > loss_gen: 1.575555443763733 (2.2682390500759255) | > loss_kl: 0.6271293759346008 (1.020081774941806) | > loss_feat: 1.1737867593765259 (5.319779318982158) | > loss_mel: 16.215681076049805 (24.763192867410595) | > loss_duration: 1.6499146223068237 (1.7094914008831155) | > loss_1: 21.242067337036133 (35.080784501700556) | > grad_norm_1: tensor(20237.5137, device='cuda:0') (tensor(45890.5195, device='cuda:0')) | > current_lr_0: 0.00016772175156422965 | > current_lr_1: 0.00016772175156422965 | > step_time: 0.5936 (0.48784113752430885) | > loader_time: 0.0038 (0.014012147640359813)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.763336658477783 (2.763336658477783) | > loss_disc_real_0: 0.2573587894439697 (0.2573587894439697) | > loss_disc_real_1: 0.3208235204219818 (0.3208235204219818) | > loss_disc_real_2: 0.24081437289714813 (0.24081437289714813) | > loss_disc_real_3: 0.26400482654571533 (0.26400482654571533) | > loss_disc_real_4: 0.228540301322937 (0.228540301322937) | > loss_disc_real_5: 0.25356367230415344 (0.25356367230415344) | > loss_0: 2.763336658477783 (2.763336658477783) | > loss_gen: 1.8909106254577637 (1.8909106254577637) | > loss_kl: 2.1219077110290527 (2.1219077110290527) | > loss_feat: 0.655444860458374 (0.655444860458374) | > loss_mel: 17.90708351135254 (17.90708351135254) | > loss_duration: 2.243290662765503 (2.243290662765503) | > loss_1: 24.81863784790039 (24.81863784790039)  --> STEP: 1 | > loss_disc: 2.0574188232421875 (2.0574188232421875) | > loss_disc_real_0: 0.02986522577702999 (0.02986522577702999) | > loss_disc_real_1: 0.25780633091926575 (0.25780633091926575) | > loss_disc_real_2: 0.2614104151725769 (0.2614104151725769) | > loss_disc_real_3: 0.27237430214881897 (0.27237430214881897) | > loss_disc_real_4: 0.11849164217710495 (0.11849164217710495) | > loss_disc_real_5: 0.1511813849210739 (0.1511813849210739) | > loss_0: 2.0574188232421875 (2.0574188232421875) | > loss_gen: 2.714622974395752 (2.714622974395752) | > loss_kl: 2.465921640396118 (2.465921640396118) | > loss_feat: 4.941320419311523 (4.941320419311523) | > loss_mel: 23.802335739135742 (23.802335739135742) | > loss_duration: 2.36386775970459 (2.36386775970459) | > loss_1: 36.28807067871094 (36.28807067871094)  --> STEP: 2 | > loss_disc: 2.2453103065490723 (2.15136456489563) | > loss_disc_real_0: 0.07716511934995651 (0.05351517256349325) | > loss_disc_real_1: 0.055185552686452866 (0.1564959418028593) | > loss_disc_real_2: 0.130343958735466 (0.19587718695402145) | > loss_disc_real_3: 0.1552945077419281 (0.21383440494537354) | > loss_disc_real_4: 0.17772281169891357 (0.14810722693800926) | > loss_disc_real_5: 0.14614062011241913 (0.14866100251674652) | > loss_0: 2.2453103065490723 (2.15136456489563) | > loss_gen: 1.8856141567230225 (2.300118565559387) | > loss_kl: 3.0820555686950684 (2.7739886045455933) | > loss_feat: 9.641936302185059 (7.291628360748291) | > loss_mel: 27.90192413330078 (25.85212993621826) | > loss_duration: 2.3691272735595703 (2.36649751663208) | > loss_1: 44.880653381347656 (40.5843620300293)  --> STEP: 3 | > loss_disc: 2.4803948402404785 (2.2610413233439126) | > loss_disc_real_0: 0.28129246830940247 (0.12944093781212965) | > loss_disc_real_1: 0.3636721670627594 (0.22555468355615935) | > loss_disc_real_2: 0.3210979402065277 (0.23761743803819022) | > loss_disc_real_3: 0.25478261709213257 (0.2274838089942932) | > loss_disc_real_4: 0.24396485090255737 (0.1800597682595253) | > loss_disc_real_5: 0.2947550117969513 (0.1973590056101481) | > loss_0: 2.4803948402404785 (2.2610413233439126) | > loss_gen: 2.9342989921569824 (2.511512041091919) | > loss_kl: 1.6049530506134033 (2.3843100865681968) | > loss_feat: 4.20882511138916 (6.264027277628581) | > loss_mel: 25.119064331054688 (25.60777473449707) | > loss_duration: 2.246634006500244 (2.3265430132548013) | > loss_1: 36.11377716064453 (39.09416707356771) --> EVAL PERFORMANCE | > avg_loader_time: 0.006021181742350261 (-0.017574389775594074) | > avg_loss_disc: 2.2610413233439126 (-0.2558748722076416) | > avg_loss_disc_real_0: 0.12944093781212965 (-0.14100202980140844) | > avg_loss_disc_real_1: 0.22555468355615935 (+0.0004646268983682089) | > avg_loss_disc_real_2: 0.23761743803819022 (-0.04274884363015494) | > avg_loss_disc_real_3: 0.2274838089942932 (-0.06537657479445141) | > avg_loss_disc_real_4: 0.1800597682595253 (-0.11123234778642654) | > avg_loss_disc_real_5: 0.1973590056101481 (-0.06770924230416617) | > avg_loss_0: 2.2610413233439126 (-0.2558748722076416) | > avg_loss_gen: 2.511512041091919 (-0.1690293153127036) | > avg_loss_kl: 2.3843100865681968 (+0.013170282046000459) | > avg_loss_feat: 6.264027277628581 (+2.007633765538534) | > avg_loss_mel: 25.60777473449707 (+0.3688945770263672) | > avg_loss_duration: 2.3265430132548013 (+0.03196517626444484) | > avg_loss_1: 39.09416707356771 (+2.2526327768961636)  > EPOCH: 177/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:34:52)   --> TIME: 2023-10-20 01:35:00 -- STEP: 9/50 -- GLOBAL_STEP: 61860 | > loss_disc: 2.8911006450653076 (2.3266027635998197) | > loss_disc_real_0: 0.063751719892025 (0.14034873868028322) | > loss_disc_real_1: 0.2731865644454956 (0.2400321149163776) | > loss_disc_real_2: 0.24997715651988983 (0.23187624021536773) | > loss_disc_real_3: 0.2644524872303009 (0.25744779573546517) | > loss_disc_real_4: 0.26617851853370667 (0.18750527749458948) | > loss_disc_real_5: 0.24874065816402435 (0.16767388499445385) | > loss_0: 2.8911006450653076 (2.3266027635998197) | > grad_norm_0: tensor(2937.1128, device='cuda:0') (tensor(1441.0421, device='cuda:0')) | > loss_gen: 1.6656179428100586 (2.515672392315335) | > loss_kl: 0.5754727125167847 (1.0285502804650202) | > loss_feat: 0.6561964154243469 (6.389657557010651) | > loss_mel: 10.166669845581055 (22.604077021280926) | > loss_duration: 1.6733086109161377 (1.6836594343185425) | > loss_1: 14.737265586853027 (34.22161706288656) | > grad_norm_1: tensor(10774.3027, device='cuda:0') (tensor(57502.6133, device='cuda:0')) | > current_lr_0: 0.00016755410317258995 | > current_lr_1: 0.00016755410317258995 | > step_time: 0.5561 (0.46618175506591797) | > loader_time: 0.0038 (0.013753387663099501)  --> TIME: 2023-10-20 01:35:13 -- STEP: 39/50 -- GLOBAL_STEP: 61890 | > loss_disc: 1.496506929397583 (2.4797931848428187) | > loss_disc_real_0: 0.03356225788593292 (0.1808233725336882) | > loss_disc_real_1: 0.034736644476652145 (0.23243900780112314) | > loss_disc_real_2: 0.04738840460777283 (0.2373850310746676) | > loss_disc_real_3: 0.16394729912281036 (0.2397347350533192) | > loss_disc_real_4: 0.04320811480283737 (0.2109793731226371) | > loss_disc_real_5: 0.07631665468215942 (0.21097476403109539) | > loss_0: 1.496506929397583 (2.4797931848428187) | > grad_norm_0: tensor(1552.1193, device='cuda:0') (tensor(1463.6041, device='cuda:0')) | > loss_gen: 2.9968039989471436 (2.4079931607613196) | > loss_kl: 0.811068594455719 (0.9425762434704945) | > loss_feat: 10.609933853149414 (5.211059249746493) | > loss_mel: 35.03770065307617 (22.909724492293137) | > loss_duration: 1.7199252843856812 (1.6781297280238225) | > loss_1: 51.17543029785156 (33.14948310607518) | > grad_norm_1: tensor(157168.7969, device='cuda:0') (tensor(41946.0508, device='cuda:0')) | > current_lr_0: 0.00016755410317258995 | > current_lr_1: 0.00016755410317258995 | > step_time: 0.2689 (0.4310893156589606) | > loader_time: 0.0026 (0.01151216335785695)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.743492603302002 (2.743492603302002) | > loss_disc_real_0: 0.18492352962493896 (0.18492352962493896) | > loss_disc_real_1: 0.19000650942325592 (0.19000650942325592) | > loss_disc_real_2: 0.28325963020324707 (0.28325963020324707) | > loss_disc_real_3: 0.46587568521499634 (0.46587568521499634) | > loss_disc_real_4: 0.33485937118530273 (0.33485937118530273) | > loss_disc_real_5: 0.34688666462898254 (0.34688666462898254) | > loss_0: 2.743492603302002 (2.743492603302002) | > loss_gen: 2.7285399436950684 (2.7285399436950684) | > loss_kl: 2.411637544631958 (2.411637544631958) | > loss_feat: 5.301044940948486 (5.301044940948486) | > loss_mel: 24.052202224731445 (24.052202224731445) | > loss_duration: 2.161876678466797 (2.161876678466797) | > loss_1: 36.65530014038086 (36.65530014038086)  --> STEP: 1 | > loss_disc: 2.483732223510742 (2.483732223510742) | > loss_disc_real_0: 0.051589883863925934 (0.051589883863925934) | > loss_disc_real_1: 0.18264687061309814 (0.18264687061309814) | > loss_disc_real_2: 0.2930973768234253 (0.2930973768234253) | > loss_disc_real_3: 0.3513500988483429 (0.3513500988483429) | > loss_disc_real_4: 0.39075005054473877 (0.39075005054473877) | > loss_disc_real_5: 0.40227431058883667 (0.40227431058883667) | > loss_0: 2.483732223510742 (2.483732223510742) | > loss_gen: 2.564669132232666 (2.564669132232666) | > loss_kl: 3.0235726833343506 (3.0235726833343506) | > loss_feat: 6.472992420196533 (6.472992420196533) | > loss_mel: 24.58167839050293 (24.58167839050293) | > loss_duration: 2.2877063751220703 (2.2877063751220703) | > loss_1: 38.93061828613281 (38.93061828613281)  --> STEP: 2 | > loss_disc: 1.8682355880737305 (2.1759839057922363) | > loss_disc_real_0: 0.025417817756533623 (0.03850385081022978) | > loss_disc_real_1: 0.22794589400291443 (0.2052963823080063) | > loss_disc_real_2: 0.24760381877422333 (0.2703505977988243) | > loss_disc_real_3: 0.3541073799133301 (0.3527287393808365) | > loss_disc_real_4: 0.1628997027873993 (0.27682487666606903) | > loss_disc_real_5: 0.2881445288658142 (0.34520941972732544) | > loss_0: 1.8682355880737305 (2.1759839057922363) | > loss_gen: 3.4420394897460938 (3.00335431098938) | > loss_kl: 3.040050506591797 (3.0318115949630737) | > loss_feat: 8.203784942626953 (7.338388681411743) | > loss_mel: 23.69595718383789 (24.13881778717041) | > loss_duration: 2.2811577320098877 (2.284432053565979) | > loss_1: 40.66299057006836 (39.796804428100586)  --> STEP: 3 | > loss_disc: 3.3186440467834473 (2.556870619455973) | > loss_disc_real_0: 0.025230977684259415 (0.034079559768239655) | > loss_disc_real_1: 0.26361265778541565 (0.22473514080047607) | > loss_disc_real_2: 0.26285648345947266 (0.2678525596857071) | > loss_disc_real_3: 0.3036196529865265 (0.33635904391606647) | > loss_disc_real_4: 0.2775438725948334 (0.27706454197565716) | > loss_disc_real_5: 0.36222830414772034 (0.3508823812007904) | > loss_0: 3.3186440467834473 (2.556870619455973) | > loss_gen: 1.401076316833496 (2.469261646270752) | > loss_kl: 1.574077844619751 (2.545900344848633) | > loss_feat: 0.832591712474823 (5.169789691766103) | > loss_mel: 20.79815101623535 (23.025262196858723) | > loss_duration: 2.169463872909546 (2.2461093266805015) | > loss_1: 26.775360107421875 (35.45632298787435) --> EVAL PERFORMANCE | > avg_loader_time: 0.014008283615112305 (+0.007987101872762043) | > avg_loss_disc: 2.556870619455973 (+0.29582929611206055) | > avg_loss_disc_real_0: 0.034079559768239655 (-0.09536137804389) | > avg_loss_disc_real_1: 0.22473514080047607 (-0.0008195427556832724) | > avg_loss_disc_real_2: 0.2678525596857071 (+0.030235121647516877) | > avg_loss_disc_real_3: 0.33635904391606647 (+0.10887523492177326) | > avg_loss_disc_real_4: 0.27706454197565716 (+0.09700477371613186) | > avg_loss_disc_real_5: 0.3508823812007904 (+0.1535233755906423) | > avg_loss_0: 2.556870619455973 (+0.29582929611206055) | > avg_loss_gen: 2.469261646270752 (-0.04225039482116699) | > avg_loss_kl: 2.545900344848633 (+0.16159025828043605) | > avg_loss_feat: 5.169789691766103 (-1.0942375858624782) | > avg_loss_mel: 23.025262196858723 (-2.5825125376383475) | > avg_loss_duration: 2.2461093266805015 (-0.08043368657429983) | > avg_loss_1: 35.45632298787435 (-3.6378440856933594)  > EPOCH: 178/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:35:31)   --> TIME: 2023-10-20 01:35:45 -- STEP: 19/50 -- GLOBAL_STEP: 61920 | > loss_disc: 1.7379008531570435 (2.3608608622299996) | > loss_disc_real_0: 0.09072631597518921 (0.1399974615166062) | > loss_disc_real_1: 0.24505765736103058 (0.2451853799192529) | > loss_disc_real_2: 0.10537637770175934 (0.2174996276827235) | > loss_disc_real_3: 0.18695637583732605 (0.26999674815880625) | > loss_disc_real_4: 0.10861843824386597 (0.21787579632119128) | > loss_disc_real_5: 0.05776350200176239 (0.23830238827749303) | > loss_0: 1.7379008531570435 (2.3608608622299996) | > grad_norm_0: tensor(1289.6827, device='cuda:0') (tensor(988.5689, device='cuda:0')) | > loss_gen: 2.8221445083618164 (2.560043127913224) | > loss_kl: 1.004069209098816 (1.1332893214727704) | > loss_feat: 7.661590576171875 (5.622135548215163) | > loss_mel: 33.348304748535156 (23.112802166687814) | > loss_duration: 1.872738242149353 (1.734671021762647) | > loss_1: 46.70884704589844 (34.16294122997083) | > grad_norm_1: tensor(96204.8516, device='cuda:0') (tensor(56415.4688, device='cuda:0')) | > current_lr_0: 0.0001673866223560141 | > current_lr_1: 0.0001673866223560141 | > step_time: 0.3184 (0.49574361349407003) | > loader_time: 0.0248 (0.019510670712119656)  --> TIME: 2023-10-20 01:36:01 -- STEP: 49/50 -- GLOBAL_STEP: 61950 | > loss_disc: 3.1777503490448 (2.317093379643499) | > loss_disc_real_0: 0.49353253841400146 (0.14182438435299058) | > loss_disc_real_1: 0.2833314538002014 (0.2194616587794557) | > loss_disc_real_2: 0.2877950072288513 (0.208718085091333) | > loss_disc_real_3: 0.25535187125205994 (0.2472949689444231) | > loss_disc_real_4: 0.22213706374168396 (0.21788138789790018) | > loss_disc_real_5: 0.3070281445980072 (0.2288490135830884) | > loss_0: 3.1777503490448 (2.317093379643499) | > grad_norm_0: tensor(2099.2146, device='cuda:0') (tensor(1061.0608, device='cuda:0')) | > loss_gen: 1.6380987167358398 (2.55912618977683) | > loss_kl: 0.82789546251297 (1.083723087700046) | > loss_feat: 0.31652721762657166 (5.556369842315207) | > loss_mel: 3.457550525665283 (22.542747302931183) | > loss_duration: 1.8488600254058838 (1.6777128978651397) | > loss_1: 8.088932037353516 (33.41967936924524) | > grad_norm_1: tensor(19133.6934, device='cuda:0') (tensor(49857.0664, device='cuda:0')) | > current_lr_0: 0.0001673866223560141 | > current_lr_1: 0.0001673866223560141 | > step_time: 0.6128 (0.500783428853872) | > loader_time: 0.3389 (0.026179104435200592)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.67378830909729 (2.67378830909729) | > loss_disc_real_0: 0.19768044352531433 (0.19768044352531433) | > loss_disc_real_1: 0.2526032030582428 (0.2526032030582428) | > loss_disc_real_2: 0.2698993682861328 (0.2698993682861328) | > loss_disc_real_3: 0.2730078399181366 (0.2730078399181366) | > loss_disc_real_4: 0.17880786955356598 (0.17880786955356598) | > loss_disc_real_5: 0.3613642454147339 (0.3613642454147339) | > loss_0: 2.67378830909729 (2.67378830909729) | > loss_gen: 2.0956926345825195 (2.0956926345825195) | > loss_kl: 2.484895706176758 (2.484895706176758) | > loss_feat: 2.0150058269500732 (2.0150058269500732) | > loss_mel: 14.155450820922852 (14.155450820922852) | > loss_duration: 2.194899559020996 (2.194899559020996) | > loss_1: 22.945945739746094 (22.945945739746094)  --> STEP: 1 | > loss_disc: 2.126569986343384 (2.126569986343384) | > loss_disc_real_0: 0.08790948987007141 (0.08790948987007141) | > loss_disc_real_1: 0.173868328332901 (0.173868328332901) | > loss_disc_real_2: 0.18709702789783478 (0.18709702789783478) | > loss_disc_real_3: 0.25084245204925537 (0.25084245204925537) | > loss_disc_real_4: 0.12472449988126755 (0.12472449988126755) | > loss_disc_real_5: 0.12928608059883118 (0.12928608059883118) | > loss_0: 2.126569986343384 (2.126569986343384) | > loss_gen: 2.0965116024017334 (2.0965116024017334) | > loss_kl: 3.325726270675659 (3.325726270675659) | > loss_feat: 5.93412446975708 (5.93412446975708) | > loss_mel: 29.863862991333008 (29.863862991333008) | > loss_duration: 2.3667194843292236 (2.3667194843292236) | > loss_1: 43.586944580078125 (43.586944580078125)  --> STEP: 2 | > loss_disc: 2.7814762592315674 (2.4540231227874756) | > loss_disc_real_0: 0.3158203363418579 (0.20186491310596466) | > loss_disc_real_1: 0.20714108645915985 (0.19050470739603043) | > loss_disc_real_2: 0.20150338113307953 (0.19430020451545715) | > loss_disc_real_3: 0.3989184498786926 (0.324880450963974) | > loss_disc_real_4: 0.09712034463882446 (0.110922422260046) | > loss_disc_real_5: 0.3857562243938446 (0.2575211524963379) | > loss_0: 2.7814762592315674 (2.4540231227874756) | > loss_gen: 2.1874451637268066 (2.14197838306427) | > loss_kl: 2.858116388320923 (3.091921329498291) | > loss_feat: 4.961245059967041 (5.4476847648620605) | > loss_mel: 25.21104621887207 (27.53745460510254) | > loss_duration: 2.3029098510742188 (2.334814667701721) | > loss_1: 37.5207633972168 (40.55385398864746)  --> STEP: 3 | > loss_disc: 2.0687992572784424 (2.325615167617798) | > loss_disc_real_0: 0.22293703258037567 (0.20888895293076834) | > loss_disc_real_1: 0.23177853226661682 (0.20426264901955923) | > loss_disc_real_2: 0.2675095796585083 (0.21870332956314087) | > loss_disc_real_3: 0.14460739493370056 (0.2647894322872162) | > loss_disc_real_4: 0.14308427274227142 (0.12164303908745448) | > loss_disc_real_5: 0.36001381278038025 (0.2916853725910187) | > loss_0: 2.0687992572784424 (2.325615167617798) | > loss_gen: 2.8905858993530273 (2.391514221827189) | > loss_kl: 1.6118135452270508 (2.5985520680745444) | > loss_feat: 5.353176116943359 (5.416181882222493) | > loss_mel: 24.025123596191406 (26.36667760213216) | > loss_duration: 2.277097702026367 (2.31557567914327) | > loss_1: 36.157798767089844 (39.08850224812826) --> EVAL PERFORMANCE | > avg_loader_time: 0.01857622464497884 (+0.004567941029866535) | > avg_loss_disc: 2.325615167617798 (-0.2312554518381753) | > avg_loss_disc_real_0: 0.20888895293076834 (+0.1748093931625287) | > avg_loss_disc_real_1: 0.20426264901955923 (-0.02047249178091684) | > avg_loss_disc_real_2: 0.21870332956314087 (-0.04914923012256622) | > avg_loss_disc_real_3: 0.2647894322872162 (-0.07156961162885028) | > avg_loss_disc_real_4: 0.12164303908745448 (-0.15542150288820267) | > avg_loss_disc_real_5: 0.2916853725910187 (-0.05919700860977173) | > avg_loss_0: 2.325615167617798 (-0.2312554518381753) | > avg_loss_gen: 2.391514221827189 (-0.07774742444356297) | > avg_loss_kl: 2.5985520680745444 (+0.052651723225911606) | > avg_loss_feat: 5.416181882222493 (+0.24639219045639038) | > avg_loss_mel: 26.36667760213216 (+3.3414154052734375) | > avg_loss_duration: 2.31557567914327 (+0.06946635246276855) | > avg_loss_1: 39.08850224812826 (+3.6321792602539062)  > EPOCH: 179/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:36:11)   --> TIME: 2023-10-20 01:36:28 -- STEP: 29/50 -- GLOBAL_STEP: 61980 | > loss_disc: 2.753462076187134 (2.3404023030708574) | > loss_disc_real_0: 0.08416548371315002 (0.12889770781300186) | > loss_disc_real_1: 0.3520817458629608 (0.20813571539675368) | > loss_disc_real_2: 0.4183589816093445 (0.2037786489416813) | > loss_disc_real_3: 0.3785122334957123 (0.23333088019541626) | > loss_disc_real_4: 0.4227063059806824 (0.22064162469629583) | > loss_disc_real_5: 0.3751365840435028 (0.2114154875342702) | > loss_0: 2.753462076187134 (2.3404023030708574) | > grad_norm_0: tensor(1382.1940, device='cuda:0') (tensor(1233.3350, device='cuda:0')) | > loss_gen: 2.9383246898651123 (2.490524982583934) | > loss_kl: 0.8621079325675964 (1.0354615634885327) | > loss_feat: 5.515692234039307 (5.667832482991549) | > loss_mel: 25.9504337310791 (24.612284906979266) | > loss_duration: 1.6744858026504517 (1.6888202593244355) | > loss_1: 36.9410400390625 (35.494924052008265) | > grad_norm_1: tensor(21905.1777, device='cuda:0') (tensor(31491.9375, device='cuda:0')) | > current_lr_0: 0.00016721930894700028 | > current_lr_1: 0.00016721930894700028 | > step_time: 0.6064 (0.43521071302479714) | > loader_time: 0.0244 (0.006496733632580987)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8414535522460938 (2.8414535522460938) | > loss_disc_real_0: 0.30539774894714355 (0.30539774894714355) | > loss_disc_real_1: 0.17333656549453735 (0.17333656549453735) | > loss_disc_real_2: 0.1456591933965683 (0.1456591933965683) | > loss_disc_real_3: 0.21656005084514618 (0.21656005084514618) | > loss_disc_real_4: 0.3665432333946228 (0.3665432333946228) | > loss_disc_real_5: 0.026704197749495506 (0.026704197749495506) | > loss_0: 2.8414535522460938 (2.8414535522460938) | > loss_gen: 1.8095093965530396 (1.8095093965530396) | > loss_kl: 2.2853944301605225 (2.2853944301605225) | > loss_feat: 6.565430164337158 (6.565430164337158) | > loss_mel: 23.927457809448242 (23.927457809448242) | > loss_duration: 2.243178367614746 (2.243178367614746) | > loss_1: 36.830970764160156 (36.830970764160156)  --> STEP: 1 | > loss_disc: 1.8440409898757935 (1.8440409898757935) | > loss_disc_real_0: 0.08084756880998611 (0.08084756880998611) | > loss_disc_real_1: 0.21685926616191864 (0.21685926616191864) | > loss_disc_real_2: 0.17628708481788635 (0.17628708481788635) | > loss_disc_real_3: 0.17077988386154175 (0.17077988386154175) | > loss_disc_real_4: 0.19453947246074677 (0.19453947246074677) | > loss_disc_real_5: 0.21594582498073578 (0.21594582498073578) | > loss_0: 1.8440409898757935 (1.8440409898757935) | > loss_gen: 2.85190486907959 (2.85190486907959) | > loss_kl: 2.7056682109832764 (2.7056682109832764) | > loss_feat: 9.282979011535645 (9.282979011535645) | > loss_mel: 26.617996215820312 (26.617996215820312) | > loss_duration: 2.3775455951690674 (2.3775455951690674) | > loss_1: 43.83609390258789 (43.83609390258789)  --> STEP: 2 | > loss_disc: 2.9401967525482178 (2.3921188712120056) | > loss_disc_real_0: 0.30137455463409424 (0.19111106172204018) | > loss_disc_real_1: 0.2010667473077774 (0.20896300673484802) | > loss_disc_real_2: 0.1901293843984604 (0.18320823460817337) | > loss_disc_real_3: 0.2801417410373688 (0.22546081244945526) | > loss_disc_real_4: 0.2539055049419403 (0.22422248870134354) | > loss_disc_real_5: 0.21170175075531006 (0.21382378786802292) | > loss_0: 2.9401967525482178 (2.3921188712120056) | > loss_gen: 1.5479520559310913 (2.1999284625053406) | > loss_kl: 3.0587658882141113 (2.882217049598694) | > loss_feat: 0.30376461148262024 (4.793371811509132) | > loss_mel: 12.29117202758789 (19.4545841217041) | > loss_duration: 2.304405689239502 (2.3409756422042847) | > loss_1: 19.506059646606445 (31.671076774597168)  --> STEP: 3 | > loss_disc: 3.0860610008239746 (2.623432914415995) | > loss_disc_real_0: 0.6012823581695557 (0.3278348272045453) | > loss_disc_real_1: 0.24322403967380524 (0.22038335104783377) | > loss_disc_real_2: 0.20337478816509247 (0.1899304191271464) | > loss_disc_real_3: 0.253142774105072 (0.23468813300132751) | > loss_disc_real_4: 0.2705247402191162 (0.2396565725406011) | > loss_disc_real_5: 0.25049498677253723 (0.22604752083619437) | > loss_0: 3.0860610008239746 (2.623432914415995) | > loss_gen: 1.9970940351486206 (2.132316986719767) | > loss_kl: 1.208320140838623 (2.324251413345337) | > loss_feat: 2.011256694793701 (3.866000105937322) | > loss_mel: 23.828908920288086 (20.912692387898762) | > loss_duration: 2.3918378353118896 (2.3579297065734863) | > loss_1: 31.437416076660156 (31.593189875284832) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_62000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5539157390594482 (2.6060536205768585) | > loss_disc_real_0: 0.18832089006900787 (0.292956342920661) | > loss_disc_real_1: 0.18665511906147003 (0.21195129305124283) | > loss_disc_real_2: 0.20255890488624573 (0.19308754056692123) | > loss_disc_real_3: 0.18301746249198914 (0.22177046537399292) | > loss_disc_real_4: 0.1131187155842781 (0.20802210830152035) | > loss_disc_real_5: 0.1374475508928299 (0.20389752835035324) | > loss_0: 2.5539157390594482 (2.6060536205768585) | > loss_gen: 2.1213948726654053 (2.1295864582061768) | > loss_kl: 2.6148295402526855 (2.396895945072174) | > loss_feat: 5.044390678405762 (4.160597749054432) | > loss_mel: 24.445327758789062 (21.795851230621338) | > loss_duration: 2.2411811351776123 (2.328742563724518) | > loss_1: 36.467124938964844 (32.811673641204834)  --> STEP: 1 | > loss_disc: 2.841538190841675 (2.653150534629822) | > loss_disc_real_0: 0.21407124400138855 (0.2771793231368065) | > loss_disc_real_1: 0.2812837064266205 (0.22581777572631836) | > loss_disc_real_2: 0.15713441371917725 (0.18589691519737245) | > loss_disc_real_3: 0.29613324999809265 (0.23664302229881287) | > loss_disc_real_4: 0.49141621589660645 (0.26470092982053756) | > loss_disc_real_5: 0.31346532702445984 (0.22581108808517455) | > loss_0: 2.841538190841675 (2.653150534629822) | > loss_gen: 2.363297462463379 (2.176328659057617) | > loss_kl: 2.279209613800049 (2.373358678817749) | > loss_feat: 7.055940628051758 (4.739666324853897) | > loss_mel: 26.436996459960938 (22.724080276489257) | > loss_duration: 2.3793373107910156 (2.338861513137817) | > loss_1: 40.5147819519043 (34.352295303344725)  --> STEP: 2 | > loss_disc: 1.917527437210083 (2.5305466850598655) | > loss_disc_real_0: 0.143896222114563 (0.25496547296643257) | > loss_disc_real_1: 0.23823316395282745 (0.2278870070974032) | > loss_disc_real_2: 0.22843964397907257 (0.19298736999432245) | > loss_disc_real_3: 0.05405879393219948 (0.20621231757104397) | > loss_disc_real_4: 0.13407689332962036 (0.24293025707205138) | > loss_disc_real_5: 0.15801803767681122 (0.21451224635044733) | > loss_0: 1.917527437210083 (2.5305466850598655) | > loss_gen: 2.5891904830932617 (2.245138963063558) | > loss_kl: 3.1771583557128906 (2.507325291633606) | > loss_feat: 13.777645111083984 (6.245996122558911) | > loss_mel: 33.047119140625 (24.444586753845215) | > loss_duration: 2.3227694034576416 (2.336179494857788) | > loss_1: 54.913883209228516 (37.77922662099203)  --> STEP: 3 | > loss_disc: 2.447063684463501 (2.5186205421175276) | > loss_disc_real_0: 0.19964805245399475 (0.2470629843217986) | > loss_disc_real_1: 0.2484825700521469 (0.23082923037665232) | > loss_disc_real_2: 0.09438852220773697 (0.17890182031052454) | > loss_disc_real_3: 0.330007940530777 (0.22389740656529153) | > loss_disc_real_4: 0.24105989933013916 (0.24266306310892105) | > loss_disc_real_5: 0.1382092386484146 (0.20361181667872838) | > loss_0: 2.447063684463501 (2.5186205421175276) | > loss_gen: 2.5201430320739746 (2.2844252586364746) | > loss_kl: 1.424562931060791 (2.3526449544089183) | > loss_feat: 5.393558025360107 (6.124219251530511) | > loss_mel: 24.923105239868164 (24.51294653756278) | > loss_duration: 2.4199275970458984 (2.3481435094560896) | > loss_1: 36.681297302246094 (37.62237957545689) --> EVAL PERFORMANCE | > avg_loader_time: 0.3401237896510533 (+0.32154756500607445) | > avg_loss_disc: 2.5186205421175276 (+0.19300537449972976) | > avg_loss_disc_real_0: 0.2470629843217986 (+0.03817403139103026) | > avg_loss_disc_real_1: 0.23082923037665232 (+0.026566581357093083) | > avg_loss_disc_real_2: 0.17890182031052454 (-0.03980150925261633) | > avg_loss_disc_real_3: 0.22389740656529153 (-0.04089202572192466) | > avg_loss_disc_real_4: 0.24266306310892105 (+0.12102002402146657) | > avg_loss_disc_real_5: 0.20361181667872838 (-0.0880735559122903) | > avg_loss_0: 2.5186205421175276 (+0.19300537449972976) | > avg_loss_gen: 2.2844252586364746 (-0.10708896319071437) | > avg_loss_kl: 2.3526449544089183 (-0.24590711366562612) | > avg_loss_feat: 6.124219251530511 (+0.708037369308018) | > avg_loss_mel: 24.51294653756278 (-1.8537310645693807) | > avg_loss_duration: 2.3481435094560896 (+0.03256783031281962) | > avg_loss_1: 37.62237957545689 (-1.4661226726713679)  > EPOCH: 180/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:36:54)   --> TIME: 2023-10-20 01:37:04 -- STEP: 9/50 -- GLOBAL_STEP: 62010 | > loss_disc: 2.077317237854004 (2.387616025076972) | > loss_disc_real_0: 0.02705804631114006 (0.1161802409009801) | > loss_disc_real_1: 0.31834807991981506 (0.22629953092998928) | > loss_disc_real_2: 0.11702459305524826 (0.2090890043311649) | > loss_disc_real_3: 0.22655662894248962 (0.21852911387880644) | > loss_disc_real_4: 0.1590685248374939 (0.18495790908734003) | > loss_disc_real_5: 0.10170020908117294 (0.20342697865433162) | > loss_0: 2.077317237854004 (2.387616025076972) | > grad_norm_0: tensor(1059.1146, device='cuda:0') (tensor(1282.8077, device='cuda:0')) | > loss_gen: 2.4335074424743652 (2.2460293107562594) | > loss_kl: 0.9854323863983154 (1.1640969117482503) | > loss_feat: 5.23032808303833 (4.410818644695812) | > loss_mel: 24.803743362426758 (23.710706816779243) | > loss_duration: 1.703431248664856 (1.6990388499365912) | > loss_1: 35.15644073486328 (33.23068957858615) | > grad_norm_1: tensor(14564.6045, device='cuda:0') (tensor(36254.9453, device='cuda:0')) | > current_lr_0: 0.00016705216277821414 | > current_lr_1: 0.00016705216277821414 | > step_time: 0.5 (0.4851202964782715) | > loader_time: 0.0268 (0.01743899451361762)  --> TIME: 2023-10-20 01:37:17 -- STEP: 39/50 -- GLOBAL_STEP: 62040 | > loss_disc: 1.9884189367294312 (2.375478820923048) | > loss_disc_real_0: 0.1899520307779312 (0.14218457601964474) | > loss_disc_real_1: 0.19046899676322937 (0.22615432748809838) | > loss_disc_real_2: 0.11145373433828354 (0.21164758398364752) | > loss_disc_real_3: 0.1388312131166458 (0.23259431085525414) | > loss_disc_real_4: 0.19258558750152588 (0.21179837566346693) | > loss_disc_real_5: 0.22024860978126526 (0.21946680631775123) | > loss_0: 1.9884189367294312 (2.375478820923048) | > grad_norm_0: tensor(1344.3480, device='cuda:0') (tensor(1383.8497, device='cuda:0')) | > loss_gen: 3.1310038566589355 (2.4901487705035086) | > loss_kl: 0.6855095028877258 (1.0626211854127738) | > loss_feat: 8.736074447631836 (5.369621383742644) | > loss_mel: 28.169382095336914 (24.261392789009292) | > loss_duration: 1.7053736448287964 (1.6938059329986572) | > loss_1: 42.42734146118164 (34.87758983709874) | > grad_norm_1: tensor(132351.9844, device='cuda:0') (tensor(38147.6719, device='cuda:0')) | > current_lr_0: 0.00016705216277821414 | > current_lr_1: 0.00016705216277821414 | > step_time: 0.5734 (0.4398296490693704) | > loader_time: 0.0244 (0.01158602421100323)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.39878511428833 (3.39878511428833) | > loss_disc_real_0: 0.4316459596157074 (0.4316459596157074) | > loss_disc_real_1: 0.3807142674922943 (0.3807142674922943) | > loss_disc_real_2: 0.36631065607070923 (0.36631065607070923) | > loss_disc_real_3: 0.26956698298454285 (0.26956698298454285) | > loss_disc_real_4: 0.22777411341667175 (0.22777411341667175) | > loss_disc_real_5: 0.2539685368537903 (0.2539685368537903) | > loss_0: 3.39878511428833 (3.39878511428833) | > loss_gen: 2.147721767425537 (2.147721767425537) | > loss_kl: 2.226362705230713 (2.226362705230713) | > loss_feat: 5.209024906158447 (5.209024906158447) | > loss_mel: 25.335193634033203 (25.335193634033203) | > loss_duration: 2.17618727684021 (2.17618727684021) | > loss_1: 37.094486236572266 (37.094486236572266)  --> STEP: 1 | > loss_disc: 2.806457757949829 (2.806457757949829) | > loss_disc_real_0: 0.5609339475631714 (0.5609339475631714) | > loss_disc_real_1: 0.320949912071228 (0.320949912071228) | > loss_disc_real_2: 0.20254504680633545 (0.20254504680633545) | > loss_disc_real_3: 0.42197611927986145 (0.42197611927986145) | > loss_disc_real_4: 0.10831908881664276 (0.10831908881664276) | > loss_disc_real_5: 0.24902427196502686 (0.24902427196502686) | > loss_0: 2.806457757949829 (2.806457757949829) | > loss_gen: 3.0640392303466797 (3.0640392303466797) | > loss_kl: 3.0046677589416504 (3.0046677589416504) | > loss_feat: 3.9304285049438477 (3.9304285049438477) | > loss_mel: 27.10299301147461 (27.10299301147461) | > loss_duration: 2.345122814178467 (2.345122814178467) | > loss_1: 39.44725036621094 (39.44725036621094)  --> STEP: 2 | > loss_disc: 3.487861156463623 (3.147159457206726) | > loss_disc_real_0: 0.5289590358734131 (0.5449464917182922) | > loss_disc_real_1: 0.3993203938007355 (0.36013515293598175) | > loss_disc_real_2: 0.4561718702316284 (0.32935845851898193) | > loss_disc_real_3: 0.3703022301197052 (0.3961391746997833) | > loss_disc_real_4: 0.5784552097320557 (0.3433871492743492) | > loss_disc_real_5: 0.4170375466346741 (0.33303090929985046) | > loss_0: 3.487861156463623 (3.147159457206726) | > loss_gen: 3.653820037841797 (3.3589296340942383) | > loss_kl: 3.0292460918426514 (3.016956925392151) | > loss_feat: 4.371267795562744 (4.150848150253296) | > loss_mel: 26.730018615722656 (26.916505813598633) | > loss_duration: 2.294332265853882 (2.3197275400161743) | > loss_1: 40.07868194580078 (39.76296615600586)  --> STEP: 3 | > loss_disc: 1.7616398334503174 (2.6853195826212564) | > loss_disc_real_0: 0.2827562093734741 (0.4575497309366862) | > loss_disc_real_1: 0.277090847492218 (0.3324537177880605) | > loss_disc_real_2: 0.03874979540705681 (0.23248890414834023) | > loss_disc_real_3: 0.32890111207962036 (0.373726487159729) | > loss_disc_real_4: 0.04950292780995369 (0.2454257421195507) | > loss_disc_real_5: 0.1398410052061081 (0.26863427460193634) | > loss_0: 1.7616398334503174 (2.6853195826212564) | > loss_gen: 3.366010904312134 (3.3612900575002036) | > loss_kl: 1.4627150297164917 (2.4988762935002646) | > loss_feat: 7.315649032592773 (5.205781777699788) | > loss_mel: 23.797212600708008 (25.876741409301758) | > loss_duration: 2.3326051235198975 (2.3240200678507485) | > loss_1: 38.274192810058594 (39.26670837402344) --> EVAL PERFORMANCE | > avg_loader_time: 0.005090951919555664 (-0.3350328377314976) | > avg_loss_disc: 2.6853195826212564 (+0.16669904050372875) | > avg_loss_disc_real_0: 0.4575497309366862 (+0.21048674661488762) | > avg_loss_disc_real_1: 0.3324537177880605 (+0.10162448741140817) | > avg_loss_disc_real_2: 0.23248890414834023 (+0.053587083837815686) | > avg_loss_disc_real_3: 0.373726487159729 (+0.14982908059443747) | > avg_loss_disc_real_4: 0.2454257421195507 (+0.002762679010629654) | > avg_loss_disc_real_5: 0.26863427460193634 (+0.06502245792320796) | > avg_loss_0: 2.6853195826212564 (+0.16669904050372875) | > avg_loss_gen: 3.3612900575002036 (+1.076864798863729) | > avg_loss_kl: 2.4988762935002646 (+0.14623133909134634) | > avg_loss_feat: 5.205781777699788 (-0.918437473830723) | > avg_loss_mel: 25.876741409301758 (+1.3637948717389783) | > avg_loss_duration: 2.3240200678507485 (-0.02412344160534108) | > avg_loss_1: 39.26670837402344 (+1.6443287985665478)  > EPOCH: 181/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:37:31)   --> TIME: 2023-10-20 01:37:46 -- STEP: 19/50 -- GLOBAL_STEP: 62070 | > loss_disc: 3.05060076713562 (2.4632614129468013) | > loss_disc_real_0: 0.42994821071624756 (0.1858419197562494) | > loss_disc_real_1: 0.3246874511241913 (0.20921485871076584) | > loss_disc_real_2: 0.32260581851005554 (0.22861972078680992) | > loss_disc_real_3: 0.3396447002887726 (0.233164402999376) | > loss_disc_real_4: 0.3817335069179535 (0.2568039303939593) | > loss_disc_real_5: 0.360266774892807 (0.2276894069325767) | > loss_0: 3.05060076713562 (2.4632614129468013) | > grad_norm_0: tensor(840.2620, device='cuda:0') (tensor(839.7908, device='cuda:0')) | > loss_gen: 2.623713254928589 (2.567611110837836) | > loss_kl: 0.7377644181251526 (1.137573213953721) | > loss_feat: 3.130967378616333 (6.714024068101456) | > loss_mel: 21.929153442382812 (24.667601823806763) | > loss_duration: 1.7755300998687744 (1.744083561395344) | > loss_1: 30.197128295898438 (36.83089369221737) | > grad_norm_1: tensor(17002.6680, device='cuda:0') (tensor(47957.2617, device='cuda:0')) | > current_lr_0: 0.0001668851836824886 | > current_lr_1: 0.0001668851836824886 | > step_time: 0.6268 (0.5047356329466167) | > loader_time: 0.0038 (0.01865900190253007)  --> TIME: 2023-10-20 01:38:02 -- STEP: 49/50 -- GLOBAL_STEP: 62100 | > loss_disc: 2.7193093299865723 (2.5071971708414496) | > loss_disc_real_0: 0.02689782902598381 (0.16758289583483524) | > loss_disc_real_1: 0.33529409766197205 (0.23823747434178177) | > loss_disc_real_2: 0.1922483891248703 (0.22018271585812374) | > loss_disc_real_3: 0.33683475852012634 (0.24764630578610367) | > loss_disc_real_4: 0.25587016344070435 (0.24588246373649766) | > loss_disc_real_5: 0.3108697235584259 (0.22253943491270956) | > loss_0: 2.7193093299865723 (2.5071971708414496) | > grad_norm_0: tensor(1605.8517, device='cuda:0') (tensor(906.0090, device='cuda:0')) | > loss_gen: 2.234504222869873 (2.359802343407457) | > loss_kl: 0.698126494884491 (0.9927750038819346) | > loss_feat: 2.08575701713562 (4.98946371978643) | > loss_mel: 23.514301300048828 (21.44486482532657) | > loss_duration: 1.7874685525894165 (1.6728734118597848) | > loss_1: 30.320158004760742 (31.45977900952708) | > grad_norm_1: tensor(6040.4814, device='cuda:0') (tensor(40763.5820, device='cuda:0')) | > current_lr_0: 0.0001668851836824886 | > current_lr_1: 0.0001668851836824886 | > step_time: 0.6733 (0.499333109174456) | > loader_time: 0.3067 (0.024940996753926185)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8034701347351074 (2.8034701347351074) | > loss_disc_real_0: 0.3057672083377838 (0.3057672083377838) | > loss_disc_real_1: 0.22150522470474243 (0.22150522470474243) | > loss_disc_real_2: 0.26377159357070923 (0.26377159357070923) | > loss_disc_real_3: 0.32249948382377625 (0.32249948382377625) | > loss_disc_real_4: 0.19760428369045258 (0.19760428369045258) | > loss_disc_real_5: 0.38704273104667664 (0.38704273104667664) | > loss_0: 2.8034701347351074 (2.8034701347351074) | > loss_gen: 2.252047061920166 (2.252047061920166) | > loss_kl: 2.3464386463165283 (2.3464386463165283) | > loss_feat: 1.959852933883667 (1.959852933883667) | > loss_mel: 15.148506164550781 (15.148506164550781) | > loss_duration: 2.2171757221221924 (2.2171757221221924) | > loss_1: 23.924020767211914 (23.924020767211914)  --> STEP: 1 | > loss_disc: 1.7946335077285767 (1.7946335077285767) | > loss_disc_real_0: 0.07479012757539749 (0.07479012757539749) | > loss_disc_real_1: 0.16659578680992126 (0.16659578680992126) | > loss_disc_real_2: 0.22978858649730682 (0.22978858649730682) | > loss_disc_real_3: 0.26410508155822754 (0.26410508155822754) | > loss_disc_real_4: 0.12616318464279175 (0.12616318464279175) | > loss_disc_real_5: 0.19820162653923035 (0.19820162653923035) | > loss_0: 1.7946335077285767 (1.7946335077285767) | > loss_gen: 4.889739513397217 (4.889739513397217) | > loss_kl: 2.6968588829040527 (2.6968588829040527) | > loss_feat: 10.648371696472168 (10.648371696472168) | > loss_mel: 26.94674301147461 (26.94674301147461) | > loss_duration: 2.4594361782073975 (2.4594361782073975) | > loss_1: 47.64114761352539 (47.64114761352539)  --> STEP: 2 | > loss_disc: 1.9315457344055176 (1.8630896210670471) | > loss_disc_real_0: 0.12048915028572083 (0.09763963893055916) | > loss_disc_real_1: 0.2618821859359741 (0.2142389863729477) | > loss_disc_real_2: 0.21573098003864288 (0.22275978326797485) | > loss_disc_real_3: 0.17348310351371765 (0.2187940925359726) | > loss_disc_real_4: 0.08063150197267532 (0.10339734330773354) | > loss_disc_real_5: 0.06699575483798981 (0.13259869068861008) | > loss_0: 1.9315457344055176 (1.8630896210670471) | > loss_gen: 2.767049789428711 (3.828394651412964) | > loss_kl: 3.053954839706421 (2.875406861305237) | > loss_feat: 7.871362686157227 (9.259867191314697) | > loss_mel: 26.757705688476562 (26.852224349975586) | > loss_duration: 2.3575475215911865 (2.408491849899292) | > loss_1: 42.807621002197266 (45.22438430786133)  --> STEP: 3 | > loss_disc: 1.9853752851486206 (1.9038515090942383) | > loss_disc_real_0: 0.2742955684661865 (0.15652494877576828) | > loss_disc_real_1: 0.3540986180305481 (0.2608588635921478) | > loss_disc_real_2: 0.3108452260494232 (0.25212159752845764) | > loss_disc_real_3: 0.30155643820762634 (0.24638154109319052) | > loss_disc_real_4: 0.11552785336971283 (0.10744084666172664) | > loss_disc_real_5: 0.10356596857309341 (0.12292111665010452) | > loss_0: 1.9853752851486206 (1.9038515090942383) | > loss_gen: 4.129400253295898 (3.928729852040609) | > loss_kl: 1.2358084917068481 (2.3288740714391074) | > loss_feat: 6.660958290100098 (8.393564224243164) | > loss_mel: 27.109371185302734 (26.9379399617513) | > loss_duration: 2.3318614959716797 (2.382948398590088) | > loss_1: 41.46739959716797 (43.97205607096354) --> EVAL PERFORMANCE | > avg_loader_time: 0.008028745651245117 (+0.002937793731689453) | > avg_loss_disc: 1.9038515090942383 (-0.7814680735270181) | > avg_loss_disc_real_0: 0.15652494877576828 (-0.30102478216091794) | > avg_loss_disc_real_1: 0.2608588635921478 (-0.07159485419591266) | > avg_loss_disc_real_2: 0.25212159752845764 (+0.019632693380117416) | > avg_loss_disc_real_3: 0.24638154109319052 (-0.12734494606653848) | > avg_loss_disc_real_4: 0.10744084666172664 (-0.13798489545782405) | > avg_loss_disc_real_5: 0.12292111665010452 (-0.14571315795183182) | > avg_loss_0: 1.9038515090942383 (-0.7814680735270181) | > avg_loss_gen: 3.928729852040609 (+0.5674397945404053) | > avg_loss_kl: 2.3288740714391074 (-0.17000222206115723) | > avg_loss_feat: 8.393564224243164 (+3.187782446543376) | > avg_loss_mel: 26.9379399617513 (+1.061198552449543) | > avg_loss_duration: 2.382948398590088 (+0.05892833073933934) | > avg_loss_1: 43.97205607096354 (+4.705347696940102)  > EPOCH: 182/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:38:12)   --> TIME: 2023-10-20 01:38:31 -- STEP: 29/50 -- GLOBAL_STEP: 62130 | > loss_disc: 3.174561023712158 (2.4734917550251403) | > loss_disc_real_0: 0.6225133538246155 (0.18302176539497128) | > loss_disc_real_1: 0.2624501585960388 (0.2250303153333993) | > loss_disc_real_2: 0.2372429072856903 (0.23254745427904458) | > loss_disc_real_3: 0.27645498514175415 (0.23769442094811077) | > loss_disc_real_4: 0.2221928983926773 (0.21621807433407883) | > loss_disc_real_5: 0.24513965845108032 (0.2167764018964151) | > loss_0: 3.174561023712158 (2.4734917550251403) | > grad_norm_0: tensor(1769.8416, device='cuda:0') (tensor(1176.6981, device='cuda:0')) | > loss_gen: 1.758268117904663 (2.485315738053157) | > loss_kl: 0.9532315731048584 (0.9731769253467691) | > loss_feat: 0.13391591608524323 (5.269678710863508) | > loss_mel: 6.8181304931640625 (19.938991439753565) | > loss_duration: 1.6539899110794067 (1.69288104978101) | > loss_1: 11.317536354064941 (30.360043328383874) | > grad_norm_1: tensor(55447.5508, device='cuda:0') (tensor(48243.3086, device='cuda:0')) | > current_lr_0: 0.00016671837149282375 | > current_lr_1: 0.00016671837149282375 | > step_time: 0.6767 (0.5157941045432256) | > loader_time: 0.0227 (0.014750110691991346)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0350465774536133 (3.0350465774536133) | > loss_disc_real_0: 0.25622183084487915 (0.25622183084487915) | > loss_disc_real_1: 0.2650514245033264 (0.2650514245033264) | > loss_disc_real_2: 0.2571772038936615 (0.2571772038936615) | > loss_disc_real_3: 0.2737511992454529 (0.2737511992454529) | > loss_disc_real_4: 0.3894146978855133 (0.3894146978855133) | > loss_disc_real_5: 0.25341561436653137 (0.25341561436653137) | > loss_0: 3.0350465774536133 (3.0350465774536133) | > loss_gen: 1.6940832138061523 (1.6940832138061523) | > loss_kl: 1.7887301445007324 (1.7887301445007324) | > loss_feat: 0.007640832103788853 (0.007640832103788853) | > loss_mel: 1.116721510887146 (1.116721510887146) | > loss_duration: 2.2939395904541016 (2.2939395904541016) | > loss_1: 6.901115417480469 (6.901115417480469)  --> STEP: 1 | > loss_disc: 1.9130475521087646 (1.9130475521087646) | > loss_disc_real_0: 0.2416747808456421 (0.2416747808456421) | > loss_disc_real_1: 0.10079077631235123 (0.10079077631235123) | > loss_disc_real_2: 0.16933947801589966 (0.16933947801589966) | > loss_disc_real_3: 0.3461315333843231 (0.3461315333843231) | > loss_disc_real_4: 0.04108433052897453 (0.04108433052897453) | > loss_disc_real_5: 0.026569874957203865 (0.026569874957203865) | > loss_0: 1.9130475521087646 (1.9130475521087646) | > loss_gen: 2.6189000606536865 (2.6189000606536865) | > loss_kl: 3.186768054962158 (3.186768054962158) | > loss_feat: 8.056337356567383 (8.056337356567383) | > loss_mel: 25.815303802490234 (25.815303802490234) | > loss_duration: 2.4136688709259033 (2.4136688709259033) | > loss_1: 42.090980529785156 (42.090980529785156)  --> STEP: 2 | > loss_disc: 2.0359058380126953 (1.97447669506073) | > loss_disc_real_0: 0.07479354739189148 (0.15823416411876678) | > loss_disc_real_1: 0.18952350318431854 (0.14515713974833488) | > loss_disc_real_2: 0.1428024172782898 (0.15607094764709473) | > loss_disc_real_3: 0.3390125334262848 (0.34257203340530396) | > loss_disc_real_4: 0.09706442803144455 (0.06907437928020954) | > loss_disc_real_5: 0.0685279443860054 (0.04754890967160463) | > loss_0: 2.0359058380126953 (1.97447669506073) | > loss_gen: 2.288703441619873 (2.45380175113678) | > loss_kl: 2.8808915615081787 (3.0338298082351685) | > loss_feat: 6.049362659454346 (7.052850008010864) | > loss_mel: 30.04828643798828 (27.931795120239258) | > loss_duration: 2.45535945892334 (2.4345141649246216) | > loss_1: 43.72260284423828 (42.90679168701172)  --> STEP: 3 | > loss_disc: 1.89779794216156 (1.9489171107610066) | > loss_disc_real_0: 0.18602952361106873 (0.1674992839495341) | > loss_disc_real_1: 0.17910529673099518 (0.1564731920758883) | > loss_disc_real_2: 0.16540588438510895 (0.1591825932264328) | > loss_disc_real_3: 0.1799539476633072 (0.28836600482463837) | > loss_disc_real_4: 0.09544585645198822 (0.07786487167080243) | > loss_disc_real_5: 0.057056974619627 (0.050718264654278755) | > loss_0: 1.89779794216156 (1.9489171107610066) | > loss_gen: 2.280337333679199 (2.3959802786509194) | > loss_kl: 1.5095462799072266 (2.525735298792521) | > loss_feat: 5.9941229820251465 (6.699940999348958) | > loss_mel: 25.92462921142578 (27.262739817301433) | > loss_duration: 2.290344476699829 (2.386457602183024) | > loss_1: 37.99898147583008 (41.27085494995117) --> EVAL PERFORMANCE | > avg_loader_time: 0.015144983927408854 (+0.007116238276163736) | > avg_loss_disc: 1.9489171107610066 (+0.04506560166676832) | > avg_loss_disc_real_0: 0.1674992839495341 (+0.010974335173765809) | > avg_loss_disc_real_1: 0.1564731920758883 (-0.10438567151625952) | > avg_loss_disc_real_2: 0.1591825932264328 (-0.09293900430202484) | > avg_loss_disc_real_3: 0.28836600482463837 (+0.041984463731447846) | > avg_loss_disc_real_4: 0.07786487167080243 (-0.02957597499092421) | > avg_loss_disc_real_5: 0.050718264654278755 (-0.07220285199582577) | > avg_loss_0: 1.9489171107610066 (+0.04506560166676832) | > avg_loss_gen: 2.3959802786509194 (-1.5327495733896894) | > avg_loss_kl: 2.525735298792521 (+0.1968612273534136) | > avg_loss_feat: 6.699940999348958 (-1.693623224894206) | > avg_loss_mel: 27.262739817301433 (+0.3247998555501326) | > avg_loss_duration: 2.386457602183024 (+0.00350920359293605) | > avg_loss_1: 41.27085494995117 (-2.7012011210123674)  > EPOCH: 183/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:38:51)   --> TIME: 2023-10-20 01:38:59 -- STEP: 9/50 -- GLOBAL_STEP: 62160 | > loss_disc: 3.030775547027588 (2.3382510079277887) | > loss_disc_real_0: 0.193118155002594 (0.14025231450796127) | > loss_disc_real_1: 0.28249233961105347 (0.22601968298355737) | > loss_disc_real_2: 0.3191791772842407 (0.2581307970815235) | > loss_disc_real_3: 0.3012010157108307 (0.2654096844295661) | > loss_disc_real_4: 0.2713073790073395 (0.21289215236902237) | > loss_disc_real_5: 0.3647741675376892 (0.21729359527428946) | > loss_0: 3.030775547027588 (2.3382510079277887) | > grad_norm_0: tensor(731.9428, device='cuda:0') (tensor(909.2263, device='cuda:0')) | > loss_gen: 1.714895248413086 (2.541043374273512) | > loss_kl: 0.12304764986038208 (0.7246423893504672) | > loss_feat: 0.08009926974773407 (5.582929364509052) | > loss_mel: 7.620110034942627 (23.443555884891087) | > loss_duration: 1.6173793077468872 (1.6964801285001967) | > loss_1: 11.155531883239746 (33.98865138159858) | > grad_norm_1: tensor(50261.0234, device='cuda:0') (tensor(41234.2695, device='cuda:0')) | > current_lr_0: 0.00016655172604238642 | > current_lr_1: 0.00016655172604238642 | > step_time: 0.4626 (0.5042240354749892) | > loader_time: 0.0252 (0.017392476399739582)  --> TIME: 2023-10-20 01:39:13 -- STEP: 39/50 -- GLOBAL_STEP: 62190 | > loss_disc: 3.0070595741271973 (2.52067009302286) | > loss_disc_real_0: 0.26842665672302246 (0.1836185223208024) | > loss_disc_real_1: 0.25087666511535645 (0.24356067944795656) | > loss_disc_real_2: 0.22953087091445923 (0.23291155925163856) | > loss_disc_real_3: 0.239676833152771 (0.2521683519276289) | > loss_disc_real_4: 0.2925484776496887 (0.21364984212395471) | > loss_disc_real_5: 0.2648441195487976 (0.21273278724402184) | > loss_0: 3.0070595741271973 (2.52067009302286) | > grad_norm_0: tensor(1953.8759, device='cuda:0') (tensor(1182.4736, device='cuda:0')) | > loss_gen: 1.6456507444381714 (2.370072080538823) | > loss_kl: 0.9199538230895996 (0.9548549827856895) | > loss_feat: 0.24061717092990875 (5.137903768282669) | > loss_mel: 15.232385635375977 (23.55618549004579) | > loss_duration: 1.722892165184021 (1.6768145530651777) | > loss_1: 19.761499404907227 (33.695831005389884) | > grad_norm_1: tensor(17217.7051, device='cuda:0') (tensor(43287.0664, device='cuda:0')) | > current_lr_0: 0.00016655172604238642 | > current_lr_1: 0.00016655172604238642 | > step_time: 0.6791 (0.44182685094001967) | > loader_time: 0.022 (0.011845026260767227)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.184138774871826 (3.184138774871826) | > loss_disc_real_0: 0.09900327026844025 (0.09900327026844025) | > loss_disc_real_1: 0.2443544864654541 (0.2443544864654541) | > loss_disc_real_2: 0.2736581265926361 (0.2736581265926361) | > loss_disc_real_3: 0.13868330419063568 (0.13868330419063568) | > loss_disc_real_4: 0.1983177661895752 (0.1983177661895752) | > loss_disc_real_5: 0.3614061176776886 (0.3614061176776886) | > loss_0: 3.184138774871826 (3.184138774871826) | > loss_gen: 1.539056658744812 (1.539056658744812) | > loss_kl: 2.708817481994629 (2.708817481994629) | > loss_feat: 5.573053359985352 (5.573053359985352) | > loss_mel: 27.404470443725586 (27.404470443725586) | > loss_duration: 2.206851005554199 (2.206851005554199) | > loss_1: 39.432247161865234 (39.432247161865234)  --> STEP: 1 | > loss_disc: 2.664597272872925 (2.664597272872925) | > loss_disc_real_0: 0.0201924666762352 (0.0201924666762352) | > loss_disc_real_1: 0.1390276700258255 (0.1390276700258255) | > loss_disc_real_2: 0.16728408634662628 (0.16728408634662628) | > loss_disc_real_3: 0.17145882546901703 (0.17145882546901703) | > loss_disc_real_4: 0.3034106492996216 (0.3034106492996216) | > loss_disc_real_5: 0.17961761355400085 (0.17961761355400085) | > loss_0: 2.664597272872925 (2.664597272872925) | > loss_gen: 1.6951403617858887 (1.6951403617858887) | > loss_kl: 3.4024887084960938 (3.4024887084960938) | > loss_feat: 6.510969638824463 (6.510969638824463) | > loss_mel: 24.727134704589844 (24.727134704589844) | > loss_duration: 2.444103717803955 (2.444103717803955) | > loss_1: 38.77983856201172 (38.77983856201172)  --> STEP: 2 | > loss_disc: 1.8809750080108643 (2.2727861404418945) | > loss_disc_real_0: 0.14171062409877777 (0.08095154538750648) | > loss_disc_real_1: 0.1391727179288864 (0.13910019397735596) | > loss_disc_real_2: 0.08498367667198181 (0.12613388150930405) | > loss_disc_real_3: 0.1798975020647049 (0.17567816376686096) | > loss_disc_real_4: 0.060053568333387375 (0.18173210881650448) | > loss_disc_real_5: 0.06764822453260422 (0.12363291904330254) | > loss_0: 1.8809750080108643 (2.2727861404418945) | > loss_gen: 2.0138373374938965 (1.8544888496398926) | > loss_kl: 2.7068660259246826 (3.054677367210388) | > loss_feat: 8.810551643371582 (7.6607606410980225) | > loss_mel: 30.741012573242188 (27.734073638916016) | > loss_duration: 2.364534378051758 (2.4043190479278564) | > loss_1: 46.636802673339844 (42.70832061767578)  --> STEP: 3 | > loss_disc: 2.791379690170288 (2.445650657018026) | > loss_disc_real_0: 0.3009216785430908 (0.1542749231060346) | > loss_disc_real_1: 0.29173973202705383 (0.1899800399939219) | > loss_disc_real_2: 0.26760464906692505 (0.17329080402851105) | > loss_disc_real_3: 0.28340908885002136 (0.21158847212791443) | > loss_disc_real_4: 0.19489739835262299 (0.1861205386618773) | > loss_disc_real_5: 0.34910327196121216 (0.1987897033492724) | > loss_0: 2.791379690170288 (2.445650657018026) | > loss_gen: 2.190317392349243 (1.966431697209676) | > loss_kl: 1.48472261428833 (2.5313591162363687) | > loss_feat: 3.9088494777679443 (6.410123586654663) | > loss_mel: 24.350250244140625 (26.60613250732422) | > loss_duration: 2.3326985836029053 (2.3804455598195395) | > loss_1: 34.26683807373047 (39.894493103027344) --> EVAL PERFORMANCE | > avg_loader_time: 0.008945544560750326 (-0.0061994393666585275) | > avg_loss_disc: 2.445650657018026 (+0.49673354625701927) | > avg_loss_disc_real_0: 0.1542749231060346 (-0.013224360843499483) | > avg_loss_disc_real_1: 0.1899800399939219 (+0.0335068479180336) | > avg_loss_disc_real_2: 0.17329080402851105 (+0.014108210802078247) | > avg_loss_disc_real_3: 0.21158847212791443 (-0.07677753269672394) | > avg_loss_disc_real_4: 0.1861205386618773 (+0.10825566699107488) | > avg_loss_disc_real_5: 0.1987897033492724 (+0.14807143869499365) | > avg_loss_0: 2.445650657018026 (+0.49673354625701927) | > avg_loss_gen: 1.966431697209676 (-0.4295485814412434) | > avg_loss_kl: 2.5313591162363687 (+0.005623817443847656) | > avg_loss_feat: 6.410123586654663 (-0.28981741269429495) | > avg_loss_mel: 26.60613250732422 (-0.6566073099772147) | > avg_loss_duration: 2.3804455598195395 (-0.0060120423634844045) | > avg_loss_1: 39.894493103027344 (-1.3763618469238281)  > EPOCH: 184/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:39:27)   --> TIME: 2023-10-20 01:39:41 -- STEP: 19/50 -- GLOBAL_STEP: 62220 | > loss_disc: 2.9820075035095215 (2.5592774403722665) | > loss_disc_real_0: 0.3102719783782959 (0.214518256877598) | > loss_disc_real_1: 0.3110327422618866 (0.25718311808611216) | > loss_disc_real_2: 0.25927990674972534 (0.24066748666135887) | > loss_disc_real_3: 0.2713479995727539 (0.24521503832779432) | > loss_disc_real_4: 0.3999343514442444 (0.25127134481935126) | > loss_disc_real_5: 0.3898189067840576 (0.26626258412081943) | > loss_0: 2.9820075035095215 (2.5592774403722665) | > grad_norm_0: tensor(1009.6500, device='cuda:0') (tensor(1066.5289, device='cuda:0')) | > loss_gen: 1.9863262176513672 (2.4391925962347734) | > loss_kl: 1.2525277137756348 (1.128594834553568) | > loss_feat: 0.6248142123222351 (5.027769934974219) | > loss_mel: 7.611287593841553 (23.482941150665283) | > loss_duration: 1.799717903137207 (1.7124498078697605) | > loss_1: 13.274673461914062 (33.79094866702431) | > grad_norm_1: tensor(27196.4414, device='cuda:0') (tensor(45477.9805, device='cuda:0')) | > current_lr_0: 0.00016638524716451034 | > current_lr_1: 0.00016638524716451034 | > step_time: 0.3257 (0.5066959356006823) | > loader_time: 0.0243 (0.01836401537845009)  --> TIME: 2023-10-20 01:39:57 -- STEP: 49/50 -- GLOBAL_STEP: 62250 | > loss_disc: 2.6793551445007324 (2.4698319337805925) | > loss_disc_real_0: 0.049509160220623016 (0.18224971110419352) | > loss_disc_real_1: 0.28238779306411743 (0.23733683059714278) | > loss_disc_real_2: 0.26506462693214417 (0.21289952547878635) | > loss_disc_real_3: 0.40051576495170593 (0.23715352860032296) | > loss_disc_real_4: 0.289699524641037 (0.23030614503184144) | > loss_disc_real_5: 0.30111825466156006 (0.2297560792910506) | > loss_0: 2.6793551445007324 (2.4698319337805925) | > grad_norm_0: tensor(1433.4434, device='cuda:0') (tensor(1192.0398, device='cuda:0')) | > loss_gen: 2.1780428886413574 (2.4594859055110385) | > loss_kl: 0.6287259459495544 (1.03521410178165) | > loss_feat: 2.3870232105255127 (5.143702797059504) | > loss_mel: 25.407262802124023 (22.47270879940111) | > loss_duration: 1.827216625213623 (1.6745475627938096) | > loss_1: 32.42827224731445 (32.78565906018627) | > grad_norm_1: tensor(12401.7734, device='cuda:0') (tensor(38051.8398, device='cuda:0')) | > current_lr_0: 0.00016638524716451034 | > current_lr_1: 0.00016638524716451034 | > step_time: 0.6186 (0.5020109439382748) | > loader_time: 0.32 (0.02547514681913414)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2763333320617676 (2.2763333320617676) | > loss_disc_real_0: 0.13205073773860931 (0.13205073773860931) | > loss_disc_real_1: 0.2779954671859741 (0.2779954671859741) | > loss_disc_real_2: 0.2588425278663635 (0.2588425278663635) | > loss_disc_real_3: 0.24028898775577545 (0.24028898775577545) | > loss_disc_real_4: 0.28500181436538696 (0.28500181436538696) | > loss_disc_real_5: 0.2458738535642624 (0.2458738535642624) | > loss_0: 2.2763333320617676 (2.2763333320617676) | > loss_gen: 2.6507017612457275 (2.6507017612457275) | > loss_kl: 2.233502149581909 (2.233502149581909) | > loss_feat: 5.620647430419922 (5.620647430419922) | > loss_mel: 22.127704620361328 (22.127704620361328) | > loss_duration: 2.264624834060669 (2.264624834060669) | > loss_1: 34.89718246459961 (34.89718246459961)  --> STEP: 1 | > loss_disc: 2.051905632019043 (2.051905632019043) | > loss_disc_real_0: 0.10422222316265106 (0.10422222316265106) | > loss_disc_real_1: 0.16136902570724487 (0.16136902570724487) | > loss_disc_real_2: 0.2419067919254303 (0.2419067919254303) | > loss_disc_real_3: 0.28169840574264526 (0.28169840574264526) | > loss_disc_real_4: 0.21166402101516724 (0.21166402101516724) | > loss_disc_real_5: 0.1897660344839096 (0.1897660344839096) | > loss_0: 2.051905632019043 (2.051905632019043) | > loss_gen: 2.6756484508514404 (2.6756484508514404) | > loss_kl: 2.5955677032470703 (2.5955677032470703) | > loss_feat: 5.43448543548584 (5.43448543548584) | > loss_mel: 24.88512420654297 (24.88512420654297) | > loss_duration: 2.38338041305542 (2.38338041305542) | > loss_1: 37.974205017089844 (37.974205017089844)  --> STEP: 2 | > loss_disc: 2.306392192840576 (2.1791489124298096) | > loss_disc_real_0: 0.2428411841392517 (0.17353170365095139) | > loss_disc_real_1: 0.11693888157606125 (0.13915395364165306) | > loss_disc_real_2: 0.09170429408550262 (0.16680554300546646) | > loss_disc_real_3: 0.14812889695167542 (0.21491365134716034) | > loss_disc_real_4: 0.05060367286205292 (0.13113384693861008) | > loss_disc_real_5: 0.061876531690359116 (0.12582128308713436) | > loss_0: 2.306392192840576 (2.1791489124298096) | > loss_gen: 1.7827376127243042 (2.2291930317878723) | > loss_kl: 2.7362921237945557 (2.665929913520813) | > loss_feat: 7.882667541503906 (6.658576488494873) | > loss_mel: 29.294883728027344 (27.090003967285156) | > loss_duration: 2.426758289337158 (2.405069351196289) | > loss_1: 44.12333679199219 (41.048770904541016)  --> STEP: 3 | > loss_disc: 2.128431558609009 (2.162243127822876) | > loss_disc_real_0: 0.11410897970199585 (0.15372412900129953) | > loss_disc_real_1: 0.13656707108020782 (0.13829165945450464) | > loss_disc_real_2: 0.22304297983646393 (0.1855513552824656) | > loss_disc_real_3: 0.2566209137439728 (0.2288160721460978) | > loss_disc_real_4: 0.32211965322494507 (0.1947957823673884) | > loss_disc_real_5: 0.16177359223365784 (0.1378053861359755) | > loss_0: 2.128431558609009 (2.162243127822876) | > loss_gen: 2.4944746494293213 (2.3176202376683555) | > loss_kl: 1.4014519453048706 (2.244437257448832) | > loss_feat: 6.443449020385742 (6.586867332458496) | > loss_mel: 27.663349151611328 (27.281119028727215) | > loss_duration: 2.3490161895751953 (2.386384963989258) | > loss_1: 40.35174560546875 (40.816429138183594) --> EVAL PERFORMANCE | > avg_loader_time: 0.0029755433400472007 (-0.005970001220703125) | > avg_loss_disc: 2.162243127822876 (-0.2834075291951499) | > avg_loss_disc_real_0: 0.15372412900129953 (-0.0005507941047350751) | > avg_loss_disc_real_1: 0.13829165945450464 (-0.05168838053941727) | > avg_loss_disc_real_2: 0.1855513552824656 (+0.01226055125395456) | > avg_loss_disc_real_3: 0.2288160721460978 (+0.01722760001818338) | > avg_loss_disc_real_4: 0.1947957823673884 (+0.008675243705511093) | > avg_loss_disc_real_5: 0.1378053861359755 (-0.06098431721329689) | > avg_loss_0: 2.162243127822876 (-0.2834075291951499) | > avg_loss_gen: 2.3176202376683555 (+0.3511885404586794) | > avg_loss_kl: 2.244437257448832 (-0.2869218587875366) | > avg_loss_feat: 6.586867332458496 (+0.176743745803833) | > avg_loss_mel: 27.281119028727215 (+0.674986521402996) | > avg_loss_duration: 2.386384963989258 (+0.0059394041697182764) | > avg_loss_1: 40.816429138183594 (+0.92193603515625)  > EPOCH: 185/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:40:08)   --> TIME: 2023-10-20 01:40:27 -- STEP: 29/50 -- GLOBAL_STEP: 62280 | > loss_disc: 1.8743321895599365 (2.394045973646229) | > loss_disc_real_0: 0.2746276557445526 (0.16635258624265936) | > loss_disc_real_1: 0.1517595648765564 (0.21040587191437854) | > loss_disc_real_2: 0.10226324200630188 (0.2132677091606732) | > loss_disc_real_3: 0.09528754651546478 (0.2473071654295099) | > loss_disc_real_4: 0.08909116685390472 (0.21222600096772457) | > loss_disc_real_5: 0.03680572286248207 (0.201971299432475) | > loss_0: 1.8743321895599365 (2.394045973646229) | > grad_norm_0: tensor(671.5298, device='cuda:0') (tensor(1144.0315, device='cuda:0')) | > loss_gen: 2.5072169303894043 (2.4445029291613354) | > loss_kl: 0.9841154217720032 (1.1039250081983103) | > loss_feat: 7.5373125076293945 (5.495751137620416) | > loss_mel: 23.429065704345703 (24.147128943739265) | > loss_duration: 1.6695828437805176 (1.7117234345140129) | > loss_1: 36.12729263305664 (34.90303182601929) | > grad_norm_1: tensor(6285.1548, device='cuda:0') (tensor(47235.7930, device='cuda:0')) | > current_lr_0: 0.00016621893469269587 | > current_lr_1: 0.00016621893469269587 | > step_time: 0.5203 (0.49641023833176184) | > loader_time: 0.0017 (0.012079329326235014)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5145394802093506 (2.5145394802093506) | > loss_disc_real_0: 0.23383700847625732 (0.23383700847625732) | > loss_disc_real_1: 0.26922711730003357 (0.26922711730003357) | > loss_disc_real_2: 0.3129052519798279 (0.3129052519798279) | > loss_disc_real_3: 0.2544553279876709 (0.2544553279876709) | > loss_disc_real_4: 0.2023678869009018 (0.2023678869009018) | > loss_disc_real_5: 0.1921786218881607 (0.1921786218881607) | > loss_0: 2.5145394802093506 (2.5145394802093506) | > loss_gen: 2.2487571239471436 (2.2487571239471436) | > loss_kl: 2.0608396530151367 (2.0608396530151367) | > loss_feat: 1.9448572397232056 (1.9448572397232056) | > loss_mel: 20.70138931274414 (20.70138931274414) | > loss_duration: 2.173480749130249 (2.173480749130249) | > loss_1: 29.129323959350586 (29.129323959350586)  --> STEP: 1 | > loss_disc: 2.5918705463409424 (2.5918705463409424) | > loss_disc_real_0: 0.2331865429878235 (0.2331865429878235) | > loss_disc_real_1: 0.31958314776420593 (0.31958314776420593) | > loss_disc_real_2: 0.37416890263557434 (0.37416890263557434) | > loss_disc_real_3: 0.24337846040725708 (0.24337846040725708) | > loss_disc_real_4: 0.27099609375 (0.27099609375) | > loss_disc_real_5: 0.1743970364332199 (0.1743970364332199) | > loss_0: 2.5918705463409424 (2.5918705463409424) | > loss_gen: 2.31292986869812 (2.31292986869812) | > loss_kl: 2.67179274559021 (2.67179274559021) | > loss_feat: 3.0652904510498047 (3.0652904510498047) | > loss_mel: 21.76296043395996 (21.76296043395996) | > loss_duration: 2.2884678840637207 (2.2884678840637207) | > loss_1: 32.1014404296875 (32.1014404296875)  --> STEP: 2 | > loss_disc: 3.1232025623321533 (2.857536554336548) | > loss_disc_real_0: 0.22213464975357056 (0.22766059637069702) | > loss_disc_real_1: 0.08328647166490555 (0.20143480971455574) | > loss_disc_real_2: 0.05215543508529663 (0.21316216886043549) | > loss_disc_real_3: 0.08825396746397018 (0.16581621393561363) | > loss_disc_real_4: 0.1362258642911911 (0.20361097902059555) | > loss_disc_real_5: 0.1487491875886917 (0.1615731120109558) | > loss_0: 3.1232025623321533 (2.857536554336548) | > loss_gen: 1.1636991500854492 (1.7383145093917847) | > loss_kl: 2.9185850620269775 (2.7951889038085938) | > loss_feat: 8.702618598937988 (5.8839545249938965) | > loss_mel: 26.811580657958984 (24.287270545959473) | > loss_duration: 2.2576303482055664 (2.2730491161346436) | > loss_1: 41.8541145324707 (36.9777774810791)  --> STEP: 3 | > loss_disc: 2.7230591773986816 (2.812710762023926) | > loss_disc_real_0: 0.3471682071685791 (0.2674964666366577) | > loss_disc_real_1: 0.2416234016418457 (0.2148310070236524) | > loss_disc_real_2: 0.2454187273979187 (0.22391435503959656) | > loss_disc_real_3: 0.26236477494239807 (0.19799906760454178) | > loss_disc_real_4: 0.41657134890556335 (0.27459776898225147) | > loss_disc_real_5: 0.19985485076904297 (0.17433369159698486) | > loss_0: 2.7230591773986816 (2.812710762023926) | > loss_gen: 2.5997235774993896 (2.025450865427653) | > loss_kl: 1.1165398359298706 (2.235639214515686) | > loss_feat: 4.252735614776611 (5.340214888254802) | > loss_mel: 26.0741024017334 (24.88288116455078) | > loss_duration: 2.216226100921631 (2.254108111063639) | > loss_1: 36.25932693481445 (36.738293965657554) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022754669189453125 (-0.0007000764211018882) | > avg_loss_disc: 2.812710762023926 (+0.6504676342010498) | > avg_loss_disc_real_0: 0.2674964666366577 (+0.11377233763535818) | > avg_loss_disc_real_1: 0.2148310070236524 (+0.07653934756914776) | > avg_loss_disc_real_2: 0.22391435503959656 (+0.03836299975713095) | > avg_loss_disc_real_3: 0.19799906760454178 (-0.03081700454155603) | > avg_loss_disc_real_4: 0.27459776898225147 (+0.07980198661486307) | > avg_loss_disc_real_5: 0.17433369159698486 (+0.03652830546100935) | > avg_loss_0: 2.812710762023926 (+0.6504676342010498) | > avg_loss_gen: 2.025450865427653 (-0.2921693722407026) | > avg_loss_kl: 2.235639214515686 (-0.00879804293314601) | > avg_loss_feat: 5.340214888254802 (-1.2466524442036944) | > avg_loss_mel: 24.88288116455078 (-2.3982378641764335) | > avg_loss_duration: 2.254108111063639 (-0.13227685292561864) | > avg_loss_1: 36.738293965657554 (-4.078135172526039)  > EPOCH: 186/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:40:46)   --> TIME: 2023-10-20 01:40:54 -- STEP: 9/50 -- GLOBAL_STEP: 62310 | > loss_disc: 2.3118391036987305 (2.5261062251196966) | > loss_disc_real_0: 0.052304331213235855 (0.1384388825131787) | > loss_disc_real_1: 0.36619284749031067 (0.22812379399935404) | > loss_disc_real_2: 0.31371334195137024 (0.23777935405572256) | > loss_disc_real_3: 0.23392419517040253 (0.20974602384699714) | > loss_disc_real_4: 0.1489117294549942 (0.1967351929181152) | > loss_disc_real_5: 0.14745937287807465 (0.19171207222259706) | > loss_0: 2.3118391036987305 (2.5261062251196966) | > grad_norm_0: tensor(928.0698, device='cuda:0') (tensor(919.6404, device='cuda:0')) | > loss_gen: 2.4500327110290527 (2.107222808731927) | > loss_kl: 0.6424580812454224 (0.9635862774319119) | > loss_feat: 4.311408519744873 (5.2817524671554565) | > loss_mel: 24.535202026367188 (24.164648903740776) | > loss_duration: 1.6433998346328735 (1.682159384091695) | > loss_1: 33.58250045776367 (34.19937006632487) | > grad_norm_1: tensor(10816.7100, device='cuda:0') (tensor(36878.5859, device='cuda:0')) | > current_lr_0: 0.00016605278846060968 | > current_lr_1: 0.00016605278846060968 | > step_time: 0.5831 (0.5102468331654867) | > loader_time: 0.0134 (0.015488386154174805)  --> TIME: 2023-10-20 01:41:08 -- STEP: 39/50 -- GLOBAL_STEP: 62340 | > loss_disc: 3.0141897201538086 (2.4429089503410535) | > loss_disc_real_0: 0.2751426100730896 (0.1533577265456701) | > loss_disc_real_1: 0.2880712151527405 (0.23095228828680822) | > loss_disc_real_2: 0.17685455083847046 (0.2214963351113674) | > loss_disc_real_3: 0.17675495147705078 (0.24503832119397634) | > loss_disc_real_4: 0.33146119117736816 (0.20467276747028032) | > loss_disc_real_5: 0.43870851397514343 (0.22407048804542193) | > loss_0: 3.0141897201538086 (2.4429089503410535) | > grad_norm_0: tensor(1608.0056, device='cuda:0') (tensor(1199.2482, device='cuda:0')) | > loss_gen: 1.8270971775054932 (2.394346203559484) | > loss_kl: 1.14549720287323 (1.0032683970072331) | > loss_feat: 0.2717665135860443 (5.509794017825371) | > loss_mel: 2.51601505279541 (24.375662858669568) | > loss_duration: 1.7097545862197876 (1.6737459500630696) | > loss_1: 7.470130443572998 (34.956817309061684) | > grad_norm_1: tensor(40178.0664, device='cuda:0') (tensor(49857.1094, device='cuda:0')) | > current_lr_0: 0.00016605278846060968 | > current_lr_1: 0.00016605278846060968 | > step_time: 0.6826 (0.4436433804340852) | > loader_time: 0.022 (0.0116731203519381)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2602901458740234 (3.2602901458740234) | > loss_disc_real_0: 0.37954244017601013 (0.37954244017601013) | > loss_disc_real_1: 0.4042224586009979 (0.4042224586009979) | > loss_disc_real_2: 0.29344990849494934 (0.29344990849494934) | > loss_disc_real_3: 0.2928345799446106 (0.2928345799446106) | > loss_disc_real_4: 0.26620903611183167 (0.26620903611183167) | > loss_disc_real_5: 0.20062628388404846 (0.20062628388404846) | > loss_0: 3.2602901458740234 (3.2602901458740234) | > loss_gen: 2.2134809494018555 (2.2134809494018555) | > loss_kl: 2.4678664207458496 (2.4678664207458496) | > loss_feat: 4.668162822723389 (4.668162822723389) | > loss_mel: 22.64594078063965 (22.64594078063965) | > loss_duration: 2.2229464054107666 (2.2229464054107666) | > loss_1: 34.21839904785156 (34.21839904785156)  --> STEP: 1 | > loss_disc: 1.9821577072143555 (1.9821577072143555) | > loss_disc_real_0: 0.03646641969680786 (0.03646641969680786) | > loss_disc_real_1: 0.30931130051612854 (0.30931130051612854) | > loss_disc_real_2: 0.2254604697227478 (0.2254604697227478) | > loss_disc_real_3: 0.15205004811286926 (0.15205004811286926) | > loss_disc_real_4: 0.11383426189422607 (0.11383426189422607) | > loss_disc_real_5: 0.05778814107179642 (0.05778814107179642) | > loss_0: 1.9821577072143555 (1.9821577072143555) | > loss_gen: 2.512049436569214 (2.512049436569214) | > loss_kl: 2.515650987625122 (2.515650987625122) | > loss_feat: 7.809698581695557 (7.809698581695557) | > loss_mel: 26.825702667236328 (26.825702667236328) | > loss_duration: 2.343519449234009 (2.343519449234009) | > loss_1: 42.00662612915039 (42.00662612915039)  --> STEP: 2 | > loss_disc: 1.795902967453003 (1.8890303373336792) | > loss_disc_real_0: 0.036379486322402954 (0.03642295300960541) | > loss_disc_real_1: 0.07514826953411102 (0.19222978502511978) | > loss_disc_real_2: 0.04686570167541504 (0.13616308569908142) | > loss_disc_real_3: 0.08597873151302338 (0.11901438981294632) | > loss_disc_real_4: 0.07159928977489471 (0.0927167758345604) | > loss_disc_real_5: 0.1012331172823906 (0.0795106291770935) | > loss_0: 1.795902967453003 (1.8890303373336792) | > loss_gen: 1.9760481119155884 (2.244048774242401) | > loss_kl: 3.0349483489990234 (2.7752996683120728) | > loss_feat: 12.359371185302734 (10.084534883499146) | > loss_mel: 25.90919303894043 (26.36744785308838) | > loss_duration: 2.297243356704712 (2.3203814029693604) | > loss_1: 45.576805114746094 (43.79171562194824)  --> STEP: 3 | > loss_disc: 3.176992893218994 (2.3183511892954507) | > loss_disc_real_0: 0.5382746458053589 (0.2037068506081899) | > loss_disc_real_1: 0.2992616593837738 (0.22790707647800446) | > loss_disc_real_2: 0.2588777542114258 (0.1770679752031962) | > loss_disc_real_3: 0.30869606137275696 (0.18224161366621652) | > loss_disc_real_4: 0.36499202251434326 (0.183475191394488) | > loss_disc_real_5: 0.3661651909351349 (0.1750621497631073) | > loss_0: 3.176992893218994 (2.3183511892954507) | > loss_gen: 2.1347148418426514 (2.2076041301091514) | > loss_kl: 1.6580781936645508 (2.402892510096232) | > loss_feat: 0.12084499001502991 (6.76330491900444) | > loss_mel: 5.548483848571777 (19.42779318491618) | > loss_duration: 2.2658965587615967 (2.302219788233439) | > loss_1: 11.728018760681152 (33.10381666819254) --> EVAL PERFORMANCE | > avg_loader_time: 0.013267437616984049 (+0.010991970698038736) | > avg_loss_disc: 2.3183511892954507 (-0.4943595727284751) | > avg_loss_disc_real_0: 0.2037068506081899 (-0.0637896160284678) | > avg_loss_disc_real_1: 0.22790707647800446 (+0.013076069454352052) | > avg_loss_disc_real_2: 0.1770679752031962 (-0.04684637983640036) | > avg_loss_disc_real_3: 0.18224161366621652 (-0.015757453938325255) | > avg_loss_disc_real_4: 0.183475191394488 (-0.09112257758776346) | > avg_loss_disc_real_5: 0.1750621497631073 (+0.0007284581661224365) | > avg_loss_0: 2.3183511892954507 (-0.4943595727284751) | > avg_loss_gen: 2.2076041301091514 (+0.1821532646814985) | > avg_loss_kl: 2.402892510096232 (+0.1672532955805459) | > avg_loss_feat: 6.76330491900444 (+1.4230900307496386) | > avg_loss_mel: 19.42779318491618 (-5.455087979634602) | > avg_loss_duration: 2.302219788233439 (+0.048111677169799805) | > avg_loss_1: 33.10381666819254 (-3.6344772974650112)  > EPOCH: 187/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:41:23)   --> TIME: 2023-10-20 01:41:37 -- STEP: 19/50 -- GLOBAL_STEP: 62370 | > loss_disc: 1.6945335865020752 (2.5806774151952645) | > loss_disc_real_0: 0.040605105459690094 (0.15564699098467827) | > loss_disc_real_1: 0.3112291991710663 (0.2407203871560724) | > loss_disc_real_2: 0.18600983917713165 (0.24121390636029996) | > loss_disc_real_3: 0.3458173871040344 (0.24926162403272956) | > loss_disc_real_4: 0.13802726566791534 (0.24155039497111974) | > loss_disc_real_5: 0.09594759345054626 (0.26050625839515734) | > loss_0: 1.6945335865020752 (2.5806774151952645) | > grad_norm_0: tensor(774.6726, device='cuda:0') (tensor(1318.1636, device='cuda:0')) | > loss_gen: 3.3068127632141113 (2.222346255653783) | > loss_kl: 0.8728147149085999 (1.0858589348040129) | > loss_feat: 8.093631744384766 (4.184031907272966) | > loss_mel: 27.07213020324707 (22.531349847191258) | > loss_duration: 1.79463529586792 (1.731284875618784) | > loss_1: 41.1400260925293 (31.754871970728825) | > grad_norm_1: tensor(79340.8672, device='cuda:0') (tensor(41151.2188, device='cuda:0')) | > current_lr_0: 0.00016588680830208476 | > current_lr_1: 0.00016588680830208476 | > step_time: 0.6414 (0.509536906292564) | > loader_time: 0.0247 (0.019330802716706928)  --> TIME: 2023-10-20 01:41:53 -- STEP: 49/50 -- GLOBAL_STEP: 62400 | > loss_disc: 2.3789870738983154 (2.53926869314544) | > loss_disc_real_0: 0.19581238925457 (0.1702594706142435) | > loss_disc_real_1: 0.33525100350379944 (0.23114525412722509) | > loss_disc_real_2: 0.22581642866134644 (0.2387602973957451) | > loss_disc_real_3: 0.198276087641716 (0.2451683554646312) | > loss_disc_real_4: 0.12876485288143158 (0.22180458762663968) | > loss_disc_real_5: 0.17795057594776154 (0.23072742495913895) | > loss_0: 2.3789870738983154 (2.53926869314544) | > grad_norm_0: tensor(705.1723, device='cuda:0') (tensor(1362.7277, device='cuda:0')) | > loss_gen: 2.140974521636963 (2.213982985944164) | > loss_kl: 0.5937035083770752 (1.0099961350919033) | > loss_feat: 3.6943182945251465 (4.3502006133143984) | > loss_mel: 24.984182357788086 (22.46761876709607) | > loss_duration: 1.7962672710418701 (1.6777041274674085) | > loss_1: 33.20944595336914 (31.719502877215948) | > grad_norm_1: tensor(26629.7461, device='cuda:0') (tensor(34541.9883, device='cuda:0')) | > current_lr_0: 0.00016588680830208476 | > current_lr_1: 0.00016588680830208476 | > step_time: 0.4556 (0.4966222996614417) | > loader_time: 0.3911 (0.02617378624118104)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7464370727539062 (2.7464370727539062) | > loss_disc_real_0: 0.12475049495697021 (0.12475049495697021) | > loss_disc_real_1: 0.3559316098690033 (0.3559316098690033) | > loss_disc_real_2: 0.2448381930589676 (0.2448381930589676) | > loss_disc_real_3: 0.3566822111606598 (0.3566822111606598) | > loss_disc_real_4: 0.4997634291648865 (0.4997634291648865) | > loss_disc_real_5: 0.24155493080615997 (0.24155493080615997) | > loss_0: 2.7464370727539062 (2.7464370727539062) | > loss_gen: 2.4783239364624023 (2.4783239364624023) | > loss_kl: 2.125562906265259 (2.125562906265259) | > loss_feat: 5.535460472106934 (5.535460472106934) | > loss_mel: 25.225671768188477 (25.225671768188477) | > loss_duration: 2.190570831298828 (2.190570831298828) | > loss_1: 37.55559158325195 (37.55559158325195)  --> STEP: 1 | > loss_disc: 2.2876431941986084 (2.2876431941986084) | > loss_disc_real_0: 0.12630240619182587 (0.12630240619182587) | > loss_disc_real_1: 0.3850019872188568 (0.3850019872188568) | > loss_disc_real_2: 0.23280084133148193 (0.23280084133148193) | > loss_disc_real_3: 0.2163516879081726 (0.2163516879081726) | > loss_disc_real_4: 0.11164891719818115 (0.11164891719818115) | > loss_disc_real_5: 0.12307021766901016 (0.12307021766901016) | > loss_0: 2.2876431941986084 (2.2876431941986084) | > loss_gen: 2.5967440605163574 (2.5967440605163574) | > loss_kl: 2.4578986167907715 (2.4578986167907715) | > loss_feat: 6.917442798614502 (6.917442798614502) | > loss_mel: 26.28106689453125 (26.28106689453125) | > loss_duration: 2.3431568145751953 (2.3431568145751953) | > loss_1: 40.5963134765625 (40.5963134765625)  --> STEP: 2 | > loss_disc: 1.8245973587036133 (2.056120276451111) | > loss_disc_real_0: 0.026559991762042046 (0.07643119897693396) | > loss_disc_real_1: 0.21590828895568848 (0.30045513808727264) | > loss_disc_real_2: 0.1594334840774536 (0.19611716270446777) | > loss_disc_real_3: 0.13490594923496246 (0.17562881857156754) | > loss_disc_real_4: 0.06808637082576752 (0.08986764401197433) | > loss_disc_real_5: 0.04852573946118355 (0.08579797856509686) | > loss_0: 1.8245973587036133 (2.056120276451111) | > loss_gen: 2.40242075920105 (2.4995824098587036) | > loss_kl: 3.153419256210327 (2.8056589365005493) | > loss_feat: 9.481491088867188 (8.199466943740845) | > loss_mel: 25.240493774414062 (25.760780334472656) | > loss_duration: 2.338334798812866 (2.3407458066940308) | > loss_1: 42.61615753173828 (41.60623550415039)  --> STEP: 3 | > loss_disc: 3.1039907932281494 (2.4054104487101235) | > loss_disc_real_0: 0.34149885177612305 (0.16478708324333033) | > loss_disc_real_1: 0.3429151177406311 (0.31460846463839215) | > loss_disc_real_2: 0.32851484417915344 (0.24024972319602966) | > loss_disc_real_3: 0.37603357434272766 (0.2424304038286209) | > loss_disc_real_4: 0.385757178068161 (0.1884974886973699) | > loss_disc_real_5: 0.2962869107723236 (0.15596095596750578) | > loss_0: 3.1039907932281494 (2.4054104487101235) | > loss_gen: 2.4643378257751465 (2.4878342151641846) | > loss_kl: 1.2634843587875366 (2.291600743929545) | > loss_feat: 3.7393128871917725 (6.712748924891154) | > loss_mel: 26.473560333251953 (25.99837366739909) | > loss_duration: 2.2441723346710205 (2.3085546493530273) | > loss_1: 36.18486404418945 (39.799111684163414) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024573802947998047 (-0.010810057322184244) | > avg_loss_disc: 2.4054104487101235 (+0.08705925941467285) | > avg_loss_disc_real_0: 0.16478708324333033 (-0.03891976736485958) | > avg_loss_disc_real_1: 0.31460846463839215 (+0.0867013881603877) | > avg_loss_disc_real_2: 0.24024972319602966 (+0.06318174799283346) | > avg_loss_disc_real_3: 0.2424304038286209 (+0.06018879016240439) | > avg_loss_disc_real_4: 0.1884974886973699 (+0.005022297302881895) | > avg_loss_disc_real_5: 0.15596095596750578 (-0.019101193795601518) | > avg_loss_0: 2.4054104487101235 (+0.08705925941467285) | > avg_loss_gen: 2.4878342151641846 (+0.2802300850550332) | > avg_loss_kl: 2.291600743929545 (-0.11129176616668701) | > avg_loss_feat: 6.712748924891154 (-0.05055599411328604) | > avg_loss_mel: 25.99837366739909 (+6.57058048248291) | > avg_loss_duration: 2.3085546493530273 (+0.006334861119588364) | > avg_loss_1: 39.799111684163414 (+6.695295015970871)  > EPOCH: 188/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:42:04)   --> TIME: 2023-10-20 01:42:22 -- STEP: 29/50 -- GLOBAL_STEP: 62430 | > loss_disc: 1.9698089361190796 (2.1011219435724717) | > loss_disc_real_0: 0.05006542056798935 (0.13957318792055393) | > loss_disc_real_1: 0.3853653073310852 (0.23060198834743992) | > loss_disc_real_2: 0.3045153021812439 (0.21325566118647313) | > loss_disc_real_3: 0.2688242793083191 (0.21356550681179967) | > loss_disc_real_4: 0.24096643924713135 (0.24827694687350046) | > loss_disc_real_5: 0.23335915803909302 (0.1610115860942109) | > loss_0: 1.9698089361190796 (2.1011219435724717) | > grad_norm_0: tensor(811.2136, device='cuda:0') (tensor(1086.6255, device='cuda:0')) | > loss_gen: 3.5433077812194824 (3.0463268797973106) | > loss_kl: 1.2988635301589966 (1.0502565359247142) | > loss_feat: 7.8066582679748535 (8.178083427507302) | > loss_mel: 23.579408645629883 (24.56253300041988) | > loss_duration: 1.6696429252624512 (1.6937350075820397) | > loss_1: 37.89788055419922 (38.530934202259985) | > grad_norm_1: tensor(62551.6992, device='cuda:0') (tensor(56106.0508, device='cuda:0')) | > current_lr_0: 0.0001657209940511202 | > current_lr_1: 0.0001657209940511202 | > step_time: 0.5395 (0.43910126850522796) | > loader_time: 0.0111 (0.013921589686952788)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.800665259361267 (1.800665259361267) | > loss_disc_real_0: 0.08888928592205048 (0.08888928592205048) | > loss_disc_real_1: 0.05029582232236862 (0.05029582232236862) | > loss_disc_real_2: 0.21640273928642273 (0.21640273928642273) | > loss_disc_real_3: 0.2483353465795517 (0.2483353465795517) | > loss_disc_real_4: 0.11633133888244629 (0.11633133888244629) | > loss_disc_real_5: 0.15389931201934814 (0.15389931201934814) | > loss_0: 1.800665259361267 (1.800665259361267) | > loss_gen: 2.8905029296875 (2.8905029296875) | > loss_kl: 2.5272865295410156 (2.5272865295410156) | > loss_feat: 10.98458194732666 (10.98458194732666) | > loss_mel: 23.269512176513672 (23.269512176513672) | > loss_duration: 2.2175729274749756 (2.2175729274749756) | > loss_1: 41.88945388793945 (41.88945388793945)  --> STEP: 1 | > loss_disc: 2.699894666671753 (2.699894666671753) | > loss_disc_real_0: 0.17090100049972534 (0.17090100049972534) | > loss_disc_real_1: 0.26088985800743103 (0.26088985800743103) | > loss_disc_real_2: 0.2191002368927002 (0.2191002368927002) | > loss_disc_real_3: 0.3267113268375397 (0.3267113268375397) | > loss_disc_real_4: 0.2867822051048279 (0.2867822051048279) | > loss_disc_real_5: 0.2700307071208954 (0.2700307071208954) | > loss_0: 2.699894666671753 (2.699894666671753) | > loss_gen: 2.189898729324341 (2.189898729324341) | > loss_kl: 2.8508481979370117 (2.8508481979370117) | > loss_feat: 5.4219865798950195 (5.4219865798950195) | > loss_mel: 26.258758544921875 (26.258758544921875) | > loss_duration: 2.464237689971924 (2.464237689971924) | > loss_1: 39.18572998046875 (39.18572998046875)  --> STEP: 2 | > loss_disc: 3.141721248626709 (2.920807957649231) | > loss_disc_real_0: 0.5735880136489868 (0.3722445070743561) | > loss_disc_real_1: 0.2613217234611511 (0.2611057907342911) | > loss_disc_real_2: 0.33588093519210815 (0.2774905860424042) | > loss_disc_real_3: 0.33571094274520874 (0.3312111347913742) | > loss_disc_real_4: 0.2651742696762085 (0.2759782373905182) | > loss_disc_real_5: 0.28399214148521423 (0.2770114243030548) | > loss_0: 3.141721248626709 (2.920807957649231) | > loss_gen: 2.1662240028381348 (2.178061366081238) | > loss_kl: 2.694729804992676 (2.7727890014648438) | > loss_feat: 0.32378727197647095 (2.8728869259357452) | > loss_mel: 10.996947288513184 (18.62785291671753) | > loss_duration: 2.31087064743042 (2.387554168701172) | > loss_1: 18.4925594329834 (28.839144706726074)  --> STEP: 3 | > loss_disc: 2.562774181365967 (2.8014633655548096) | > loss_disc_real_0: 0.19658076763153076 (0.313689927260081) | > loss_disc_real_1: 0.2906566560268402 (0.2709560791651408) | > loss_disc_real_2: 0.3033849895000458 (0.28612205386161804) | > loss_disc_real_3: 0.23944011330604553 (0.30062079429626465) | > loss_disc_real_4: 0.13820098340511322 (0.23005248606204987) | > loss_disc_real_5: 0.21333016455173492 (0.2557843377192815) | > loss_0: 2.562774181365967 (2.8014633655548096) | > loss_gen: 1.9853780269622803 (2.1138335863749185) | > loss_kl: 1.598562240600586 (2.381380081176758) | > loss_feat: 4.741420269012451 (3.4957313736279807) | > loss_mel: 27.314294815063477 (21.52333354949951) | > loss_duration: 2.4311602115631104 (2.402089516321818) | > loss_1: 38.07081604003906 (31.91636848449707) --> EVAL PERFORMANCE | > avg_loader_time: 0.006110668182373047 (+0.003653287887573242) | > avg_loss_disc: 2.8014633655548096 (+0.396052916844686) | > avg_loss_disc_real_0: 0.313689927260081 (+0.14890284401675066) | > avg_loss_disc_real_1: 0.2709560791651408 (-0.04365238547325134) | > avg_loss_disc_real_2: 0.28612205386161804 (+0.04587233066558838) | > avg_loss_disc_real_3: 0.30062079429626465 (+0.05819039046764374) | > avg_loss_disc_real_4: 0.23005248606204987 (+0.04155499736467996) | > avg_loss_disc_real_5: 0.2557843377192815 (+0.09982338175177571) | > avg_loss_0: 2.8014633655548096 (+0.396052916844686) | > avg_loss_gen: 2.1138335863749185 (-0.3740006287892661) | > avg_loss_kl: 2.381380081176758 (+0.08977933724721288) | > avg_loss_feat: 3.4957313736279807 (-3.2170175512631736) | > avg_loss_mel: 21.52333354949951 (-4.475040117899578) | > avg_loss_duration: 2.402089516321818 (+0.09353486696879054) | > avg_loss_1: 31.91636848449707 (-7.8827431996663435)  > EPOCH: 189/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:42:42)   --> TIME: 2023-10-20 01:42:51 -- STEP: 9/50 -- GLOBAL_STEP: 62460 | > loss_disc: 2.7228994369506836 (2.6032296551598444) | > loss_disc_real_0: 0.1881084144115448 (0.23970823528038132) | > loss_disc_real_1: 0.2910972237586975 (0.24943269458081987) | > loss_disc_real_2: 0.2945103943347931 (0.22029160832365355) | > loss_disc_real_3: 0.3027176856994629 (0.2955585999621285) | > loss_disc_real_4: 0.20338976383209229 (0.20606703807910284) | > loss_disc_real_5: 0.23649297654628754 (0.22009126966198286) | > loss_0: 2.7228994369506836 (2.6032296551598444) | > grad_norm_0: tensor(1392.0955, device='cuda:0') (tensor(1043.4453, device='cuda:0')) | > loss_gen: 1.8174716234207153 (2.239952630466885) | > loss_kl: 0.8654466867446899 (0.8187509791718589) | > loss_feat: 1.0717825889587402 (5.312289864238766) | > loss_mel: 20.127670288085938 (21.35546953148312) | > loss_duration: 1.6168874502182007 (1.66982811027103) | > loss_1: 25.49925994873047 (31.396291308932835) | > grad_norm_1: tensor(11552.7559, device='cuda:0') (tensor(37800.6133, device='cuda:0')) | > current_lr_0: 0.000165555345541881 | > current_lr_1: 0.000165555345541881 | > step_time: 0.5679 (0.53895017835829) | > loader_time: 0.0251 (0.01759224467807346)  --> TIME: 2023-10-20 01:43:03 -- STEP: 39/50 -- GLOBAL_STEP: 62490 | > loss_disc: 3.099079132080078 (2.4598675721730943) | > loss_disc_real_0: 0.3507097065448761 (0.16026761459234434) | > loss_disc_real_1: 0.24976947903633118 (0.23279457061718672) | > loss_disc_real_2: 0.25619927048683167 (0.21595301202092415) | > loss_disc_real_3: 0.24372410774230957 (0.24359770138294268) | > loss_disc_real_4: 0.298552930355072 (0.2225694648730449) | > loss_disc_real_5: 0.3212438225746155 (0.23285328931151292) | > loss_0: 3.099079132080078 (2.4598675721730943) | > grad_norm_0: tensor(1049.3833, device='cuda:0') (tensor(1000.3373, device='cuda:0')) | > loss_gen: 1.6118125915527344 (2.353825859534434) | > loss_kl: 0.6035137176513672 (0.8977477966974943) | > loss_feat: 0.13056398928165436 (5.488307497917842) | > loss_mel: 2.9828336238861084 (23.695018343436413) | > loss_duration: 1.7273770570755005 (1.6775513734572973) | > loss_1: 7.056100845336914 (34.11245116209373) | > grad_norm_1: tensor(25094.0488, device='cuda:0') (tensor(37911.1719, device='cuda:0')) | > current_lr_0: 0.000165555345541881 | > current_lr_1: 0.000165555345541881 | > step_time: 0.2616 (0.4094314208397498) | > loader_time: 0.0026 (0.010451182340964293)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.364450454711914 (2.364450454711914) | > loss_disc_real_0: 0.20342397689819336 (0.20342397689819336) | > loss_disc_real_1: 0.36686640977859497 (0.36686640977859497) | > loss_disc_real_2: 0.24711690843105316 (0.24711690843105316) | > loss_disc_real_3: 0.32107168436050415 (0.32107168436050415) | > loss_disc_real_4: 0.2456895112991333 (0.2456895112991333) | > loss_disc_real_5: 0.12108185142278671 (0.12108185142278671) | > loss_0: 2.364450454711914 (2.364450454711914) | > loss_gen: 3.4851291179656982 (3.4851291179656982) | > loss_kl: 2.393975257873535 (2.393975257873535) | > loss_feat: 6.040149688720703 (6.040149688720703) | > loss_mel: 24.151124954223633 (24.151124954223633) | > loss_duration: 2.271448850631714 (2.271448850631714) | > loss_1: 38.34183120727539 (38.34183120727539)  --> STEP: 1 | > loss_disc: 2.5364737510681152 (2.5364737510681152) | > loss_disc_real_0: 0.18081533908843994 (0.18081533908843994) | > loss_disc_real_1: 0.2310861051082611 (0.2310861051082611) | > loss_disc_real_2: 0.1853506863117218 (0.1853506863117218) | > loss_disc_real_3: 0.28997674584388733 (0.28997674584388733) | > loss_disc_real_4: 0.1447717398405075 (0.1447717398405075) | > loss_disc_real_5: 0.10753714293241501 (0.10753714293241501) | > loss_0: 2.5364737510681152 (2.5364737510681152) | > loss_gen: 2.15163516998291 (2.15163516998291) | > loss_kl: 2.986680030822754 (2.986680030822754) | > loss_feat: 2.8605337142944336 (2.8605337142944336) | > loss_mel: 21.6815185546875 (21.6815185546875) | > loss_duration: 2.4141573905944824 (2.4141573905944824) | > loss_1: 32.09452438354492 (32.09452438354492)  --> STEP: 2 | > loss_disc: 2.9654667377471924 (2.750970244407654) | > loss_disc_real_0: 0.24217011034488678 (0.21149272471666336) | > loss_disc_real_1: 0.31450286507606506 (0.2727944850921631) | > loss_disc_real_2: 0.276694655418396 (0.2310226708650589) | > loss_disc_real_3: 0.3480243682861328 (0.31900055706501007) | > loss_disc_real_4: 0.3292716145515442 (0.23702167719602585) | > loss_disc_real_5: 0.11006832122802734 (0.10880273208022118) | > loss_0: 2.9654667377471924 (2.750970244407654) | > loss_gen: 2.0118863582611084 (2.0817607641220093) | > loss_kl: 2.694755792617798 (2.840717911720276) | > loss_feat: 2.5537211894989014 (2.7071274518966675) | > loss_mel: 28.17919158935547 (24.930355072021484) | > loss_duration: 2.3858094215393066 (2.3999834060668945) | > loss_1: 37.82536697387695 (34.95994567871094)  --> STEP: 3 | > loss_disc: 2.3977596759796143 (2.633233388264974) | > loss_disc_real_0: 0.30782550573349 (0.24360365172227225) | > loss_disc_real_1: 0.1840985268354416 (0.24322916567325592) | > loss_disc_real_2: 0.21373817324638367 (0.22526117165883383) | > loss_disc_real_3: 0.3400796949863434 (0.32602693637212116) | > loss_disc_real_4: 0.3308353126049042 (0.2682928889989853) | > loss_disc_real_5: 0.22512146830558777 (0.14757564415534338) | > loss_0: 2.3977596759796143 (2.633233388264974) | > loss_gen: 2.885312080383301 (2.349611202875773) | > loss_kl: 1.327886939048767 (2.336440920829773) | > loss_feat: 2.9060049057006836 (2.7734199364980063) | > loss_mel: 20.343990325927734 (23.401566823323567) | > loss_duration: 2.2855160236358643 (2.3618276119232178) | > loss_1: 29.74871253967285 (33.22286796569824) --> EVAL PERFORMANCE | > avg_loader_time: 0.0050207773844401045 (-0.0010898907979329424) | > avg_loss_disc: 2.633233388264974 (-0.16822997728983546) | > avg_loss_disc_real_0: 0.24360365172227225 (-0.07008627553780875) | > avg_loss_disc_real_1: 0.24322916567325592 (-0.027726913491884886) | > avg_loss_disc_real_2: 0.22526117165883383 (-0.06086088220278421) | > avg_loss_disc_real_3: 0.32602693637212116 (+0.025406142075856508) | > avg_loss_disc_real_4: 0.2682928889989853 (+0.038240402936935425) | > avg_loss_disc_real_5: 0.14757564415534338 (-0.10820869356393811) | > avg_loss_0: 2.633233388264974 (-0.16822997728983546) | > avg_loss_gen: 2.349611202875773 (+0.2357776165008545) | > avg_loss_kl: 2.336440920829773 (-0.04493916034698486) | > avg_loss_feat: 2.7734199364980063 (-0.7223114371299744) | > avg_loss_mel: 23.401566823323567 (+1.8782332738240548) | > avg_loss_duration: 2.3618276119232178 (-0.04026190439860011) | > avg_loss_1: 33.22286796569824 (+1.3064994812011719)  > EPOCH: 190/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:43:20)   --> TIME: 2023-10-20 01:43:35 -- STEP: 19/50 -- GLOBAL_STEP: 62520 | > loss_disc: 2.665248155593872 (2.4043034064142326) | > loss_disc_real_0: 0.026102330535650253 (0.1427811794963322) | > loss_disc_real_1: 0.2283848524093628 (0.25555173915467766) | > loss_disc_real_2: 0.24681295454502106 (0.22593969067460612) | > loss_disc_real_3: 0.15829773247241974 (0.24313759333208987) | > loss_disc_real_4: 0.23444628715515137 (0.19577314077239288) | > loss_disc_real_5: 0.0626819059252739 (0.1770731147966887) | > loss_0: 2.665248155593872 (2.4043034064142326) | > grad_norm_0: tensor(915.2592, device='cuda:0') (tensor(1330.8571, device='cuda:0')) | > loss_gen: 2.2110331058502197 (2.5197563045903255) | > loss_kl: 0.8927964568138123 (0.9582103898650721) | > loss_feat: 7.473741054534912 (5.793772007240669) | > loss_mel: 26.960721969604492 (24.004050875964918) | > loss_duration: 1.81313955783844 (1.7078271602329456) | > loss_1: 39.35143280029297 (34.98361675362838) | > grad_norm_1: tensor(50758.7656, device='cuda:0') (tensor(49805.2461, device='cuda:0')) | > current_lr_0: 0.00016538986260869793 | > current_lr_1: 0.00016538986260869793 | > step_time: 0.6361 (0.5108665667082134) | > loader_time: 0.0227 (0.021144189332660875)  --> TIME: 2023-10-20 01:43:51 -- STEP: 49/50 -- GLOBAL_STEP: 62550 | > loss_disc: 2.8169097900390625 (2.3618956682633376) | > loss_disc_real_0: 0.29954859614372253 (0.15214771275617642) | > loss_disc_real_1: 0.26501893997192383 (0.23027564326719363) | > loss_disc_real_2: 0.2380635142326355 (0.22390967554279737) | > loss_disc_real_3: 0.29104405641555786 (0.2384730258158275) | > loss_disc_real_4: 0.42942890524864197 (0.22299321132655048) | > loss_disc_real_5: 0.4307336211204529 (0.21593024901931687) | > loss_0: 2.8169097900390625 (2.3618956682633376) | > grad_norm_0: tensor(866.3790, device='cuda:0') (tensor(1194.5062, device='cuda:0')) | > loss_gen: 2.6536319255828857 (2.519853032365137) | > loss_kl: 0.8477258086204529 (0.9431551646213142) | > loss_feat: 3.981029987335205 (5.499612464037326) | > loss_mel: 25.689455032348633 (22.69917583465576) | > loss_duration: 1.7695417404174805 (1.6654000768856125) | > loss_1: 34.94138717651367 (33.32719660778436) | > grad_norm_1: tensor(48890.9062, device='cuda:0') (tensor(46551.3672, device='cuda:0')) | > current_lr_0: 0.00016538986260869793 | > current_lr_1: 0.00016538986260869793 | > step_time: 0.5685 (0.5078089577811105) | > loader_time: 0.3285 (0.026761862696433554)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0616390705108643 (2.0616390705108643) | > loss_disc_real_0: 0.04661107808351517 (0.04661107808351517) | > loss_disc_real_1: 0.15910769999027252 (0.15910769999027252) | > loss_disc_real_2: 0.10428420454263687 (0.10428420454263687) | > loss_disc_real_3: 0.18550971150398254 (0.18550971150398254) | > loss_disc_real_4: 0.030274314805865288 (0.030274314805865288) | > loss_disc_real_5: 0.019672049209475517 (0.019672049209475517) | > loss_0: 2.0616390705108643 (2.0616390705108643) | > loss_gen: 1.6677639484405518 (1.6677639484405518) | > loss_kl: 2.760370969772339 (2.760370969772339) | > loss_feat: 8.228681564331055 (8.228681564331055) | > loss_mel: 24.217985153198242 (24.217985153198242) | > loss_duration: 2.202096462249756 (2.202096462249756) | > loss_1: 39.07689666748047 (39.07689666748047)  --> STEP: 1 | > loss_disc: 2.598870038986206 (2.598870038986206) | > loss_disc_real_0: 0.09903863072395325 (0.09903863072395325) | > loss_disc_real_1: 0.21846428513526917 (0.21846428513526917) | > loss_disc_real_2: 0.22164972126483917 (0.22164972126483917) | > loss_disc_real_3: 0.20635005831718445 (0.20635005831718445) | > loss_disc_real_4: 0.2599891126155853 (0.2599891126155853) | > loss_disc_real_5: 0.2068743258714676 (0.2068743258714676) | > loss_0: 2.598870038986206 (2.598870038986206) | > loss_gen: 1.744741678237915 (1.744741678237915) | > loss_kl: 2.7470717430114746 (2.7470717430114746) | > loss_feat: 2.5201797485351562 (2.5201797485351562) | > loss_mel: 18.444217681884766 (18.444217681884766) | > loss_duration: 2.322317361831665 (2.322317361831665) | > loss_1: 27.778528213500977 (27.778528213500977)  --> STEP: 2 | > loss_disc: 2.0071301460266113 (2.3030000925064087) | > loss_disc_real_0: 0.035236891359090805 (0.06713776104152203) | > loss_disc_real_1: 0.1885831207036972 (0.20352370291948318) | > loss_disc_real_2: 0.16456784307956696 (0.19310878217220306) | > loss_disc_real_3: 0.26136553287506104 (0.23385779559612274) | > loss_disc_real_4: 0.09907190501689911 (0.17953050881624222) | > loss_disc_real_5: 0.082442507147789 (0.1446584165096283) | > loss_0: 2.0071301460266113 (2.3030000925064087) | > loss_gen: 2.0612385272979736 (1.9029901027679443) | > loss_kl: 2.732346534729004 (2.7397091388702393) | > loss_feat: 7.069190502166748 (4.794685125350952) | > loss_mel: 27.39781379699707 (22.921015739440918) | > loss_duration: 2.3118553161621094 (2.317086338996887) | > loss_1: 41.57244110107422 (34.6754846572876)  --> STEP: 3 | > loss_disc: 3.051321029663086 (2.5524404048919678) | > loss_disc_real_0: 0.14386865496635437 (0.09271472568313281) | > loss_disc_real_1: 0.2792336344718933 (0.22876034677028656) | > loss_disc_real_2: 0.235179141163826 (0.2071322351694107) | > loss_disc_real_3: 0.260725736618042 (0.24281377593676248) | > loss_disc_real_4: 0.24116560816764832 (0.2000755419333776) | > loss_disc_real_5: 0.24361898005008698 (0.17764527102311453) | > loss_0: 3.051321029663086 (2.5524404048919678) | > loss_gen: 1.3918769359588623 (1.732619047164917) | > loss_kl: 1.3977000713348389 (2.292372783025106) | > loss_feat: 0.07660254091024399 (3.2219909305373826) | > loss_mel: 7.161648750305176 (17.667893409729004) | > loss_duration: 2.281785488128662 (2.305319388707479) | > loss_1: 12.309614181518555 (27.220194498697918) --> EVAL PERFORMANCE | > avg_loader_time: 0.011801322301228842 (+0.006780544916788737) | > avg_loss_disc: 2.5524404048919678 (-0.08079298337300633) | > avg_loss_disc_real_0: 0.09271472568313281 (-0.15088892603913945) | > avg_loss_disc_real_1: 0.22876034677028656 (-0.01446881890296936) | > avg_loss_disc_real_2: 0.2071322351694107 (-0.018128936489423125) | > avg_loss_disc_real_3: 0.24281377593676248 (-0.08321316043535867) | > avg_loss_disc_real_4: 0.2000755419333776 (-0.0682173470656077) | > avg_loss_disc_real_5: 0.17764527102311453 (+0.03006962686777115) | > avg_loss_0: 2.5524404048919678 (-0.08079298337300633) | > avg_loss_gen: 1.732619047164917 (-0.616992155710856) | > avg_loss_kl: 2.292372783025106 (-0.04406813780466701) | > avg_loss_feat: 3.2219909305373826 (+0.4485709940393763) | > avg_loss_mel: 17.667893409729004 (-5.733673413594563) | > avg_loss_duration: 2.305319388707479 (-0.056508223215738784) | > avg_loss_1: 27.220194498697918 (-6.002673467000324)  > EPOCH: 191/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:44:03)   --> TIME: 2023-10-20 01:44:21 -- STEP: 29/50 -- GLOBAL_STEP: 62580 | > loss_disc: 2.8648104667663574 (2.423701787817067) | > loss_disc_real_0: 0.2029031664133072 (0.13539855940074752) | > loss_disc_real_1: 0.2349916249513626 (0.21931146046724811) | > loss_disc_real_2: 0.5248558521270752 (0.23845325808586745) | > loss_disc_real_3: 0.23365898430347443 (0.24354519065597965) | > loss_disc_real_4: 0.2745315432548523 (0.2184706089440091) | > loss_disc_real_5: 0.2821076810359955 (0.20994026955730957) | > loss_0: 2.8648104667663574 (2.423701787817067) | > grad_norm_0: tensor(665.1437, device='cuda:0') (tensor(1027.6364, device='cuda:0')) | > loss_gen: 2.43493390083313 (2.4477332666002467) | > loss_kl: 0.8244597315788269 (1.041636956149134) | > loss_feat: 5.259449481964111 (5.855296038861932) | > loss_mel: 25.978832244873047 (25.39042399258449) | > loss_duration: 1.6838178634643555 (1.688505740001284) | > loss_1: 36.18149185180664 (36.42359580664798) | > grad_norm_1: tensor(22042.4492, device='cuda:0') (tensor(50925.6523, device='cuda:0')) | > current_lr_0: 0.00016522454508606738 | > current_lr_1: 0.00016522454508606738 | > step_time: 0.5682 (0.5008100887824749) | > loader_time: 0.004 (0.012925222002226735)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2264115810394287 (2.2264115810394287) | > loss_disc_real_0: 0.1788853108882904 (0.1788853108882904) | > loss_disc_real_1: 0.19771133363246918 (0.19771133363246918) | > loss_disc_real_2: 0.24472065269947052 (0.24472065269947052) | > loss_disc_real_3: 0.15272635221481323 (0.15272635221481323) | > loss_disc_real_4: 0.16247636079788208 (0.16247636079788208) | > loss_disc_real_5: 0.13355129957199097 (0.13355129957199097) | > loss_0: 2.2264115810394287 (2.2264115810394287) | > loss_gen: 2.1833503246307373 (2.1833503246307373) | > loss_kl: 1.8747575283050537 (1.8747575283050537) | > loss_feat: 5.064424991607666 (5.064424991607666) | > loss_mel: 19.012773513793945 (19.012773513793945) | > loss_duration: 2.250598669052124 (2.250598669052124) | > loss_1: 30.38590431213379 (30.38590431213379)  --> STEP: 1 | > loss_disc: 2.871189594268799 (2.871189594268799) | > loss_disc_real_0: 0.19866037368774414 (0.19866037368774414) | > loss_disc_real_1: 0.19345597922801971 (0.19345597922801971) | > loss_disc_real_2: 0.1565113067626953 (0.1565113067626953) | > loss_disc_real_3: 0.33608266711235046 (0.33608266711235046) | > loss_disc_real_4: 0.26006680727005005 (0.26006680727005005) | > loss_disc_real_5: 0.33178210258483887 (0.33178210258483887) | > loss_0: 2.871189594268799 (2.871189594268799) | > loss_gen: 1.8634092807769775 (1.8634092807769775) | > loss_kl: 2.8558287620544434 (2.8558287620544434) | > loss_feat: 5.670536518096924 (5.670536518096924) | > loss_mel: 24.4350528717041 (24.4350528717041) | > loss_duration: 2.339304208755493 (2.339304208755493) | > loss_1: 37.16413497924805 (37.16413497924805)  --> STEP: 2 | > loss_disc: 3.0066680908203125 (2.9389288425445557) | > loss_disc_real_0: 0.25899556279182434 (0.22882796823978424) | > loss_disc_real_1: 0.33643245697021484 (0.2649442180991173) | > loss_disc_real_2: 0.1517529934644699 (0.1541321501135826) | > loss_disc_real_3: 0.3385803997516632 (0.33733153343200684) | > loss_disc_real_4: 0.18669769167900085 (0.22338224947452545) | > loss_disc_real_5: 0.16858892142772675 (0.2501855120062828) | > loss_0: 3.0066680908203125 (2.9389288425445557) | > loss_gen: 2.0323617458343506 (1.947885513305664) | > loss_kl: 2.9212942123413086 (2.888561487197876) | > loss_feat: 9.39249038696289 (7.531513452529907) | > loss_mel: 26.230358123779297 (25.3327054977417) | > loss_duration: 2.40802264213562 (2.3736634254455566) | > loss_1: 42.984527587890625 (40.074331283569336)  --> STEP: 3 | > loss_disc: 3.0049784183502197 (2.9609453678131104) | > loss_disc_real_0: 0.3411422669887543 (0.26626606782277423) | > loss_disc_real_1: 0.2515453100204468 (0.2604779154062271) | > loss_disc_real_2: 0.26151254773139954 (0.18992561598618826) | > loss_disc_real_3: 0.2625516355037689 (0.31240490078926086) | > loss_disc_real_4: 0.22476749122142792 (0.22384399672349295) | > loss_disc_real_5: 0.30994635820388794 (0.2701057940721512) | > loss_0: 3.0049784183502197 (2.9609453678131104) | > loss_gen: 1.672336220741272 (1.8560357491175334) | > loss_kl: 1.6668851375579834 (2.4813360373179116) | > loss_feat: 0.08240020275115967 (5.048475702603658) | > loss_mel: 5.278848171234131 (18.648086388905842) | > loss_duration: 2.2830393314361572 (2.3434553941090903) | > loss_1: 10.983509063720703 (30.377390543619793) --> EVAL PERFORMANCE | > avg_loader_time: 0.0060730775197347 (-0.0057282447814941415) | > avg_loss_disc: 2.9609453678131104 (+0.4085049629211426) | > avg_loss_disc_real_0: 0.26626606782277423 (+0.1735513421396414) | > avg_loss_disc_real_1: 0.2604779154062271 (+0.03171756863594055) | > avg_loss_disc_real_2: 0.18992561598618826 (-0.017206619183222444) | > avg_loss_disc_real_3: 0.31240490078926086 (+0.06959112485249838) | > avg_loss_disc_real_4: 0.22384399672349295 (+0.023768454790115356) | > avg_loss_disc_real_5: 0.2701057940721512 (+0.09246052304903665) | > avg_loss_0: 2.9609453678131104 (+0.4085049629211426) | > avg_loss_gen: 1.8560357491175334 (+0.12341670195261645) | > avg_loss_kl: 2.4813360373179116 (+0.1889632542928057) | > avg_loss_feat: 5.048475702603658 (+1.8264847720662751) | > avg_loss_mel: 18.648086388905842 (+0.980192979176838) | > avg_loss_duration: 2.3434553941090903 (+0.03813600540161133) | > avg_loss_1: 30.377390543619793 (+3.157196044921875)  > EPOCH: 192/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:44:42)   --> TIME: 2023-10-20 01:44:51 -- STEP: 9/50 -- GLOBAL_STEP: 62610 | > loss_disc: 2.631582021713257 (2.3005496793323092) | > loss_disc_real_0: 0.15805357694625854 (0.1808426719572809) | > loss_disc_real_1: 0.3156159222126007 (0.1984959923558765) | > loss_disc_real_2: 0.21552295982837677 (0.2564850043919351) | > loss_disc_real_3: 0.2194364368915558 (0.20910584491988024) | > loss_disc_real_4: 0.19702984392642975 (0.14836126193404198) | > loss_disc_real_5: 0.19273489713668823 (0.16022412520315912) | > loss_0: 2.631582021713257 (2.3005496793323092) | > grad_norm_0: tensor(646.9514, device='cuda:0') (tensor(1978.7721, device='cuda:0')) | > loss_gen: 1.8610814809799194 (2.520533323287964) | > loss_kl: 0.6436392664909363 (0.9665376411543952) | > loss_feat: 1.8692238330841064 (7.213462909062703) | > loss_mel: 11.026934623718262 (25.03507963816325) | > loss_duration: 1.6541054248809814 (1.668795731332567) | > loss_1: 17.05498504638672 (37.40440856085883) | > grad_norm_1: tensor(30137.9414, device='cuda:0') (tensor(86700.3672, device='cuda:0')) | > current_lr_0: 0.0001650593928086511 | > current_lr_1: 0.0001650593928086511 | > step_time: 0.6918 (0.4963981575436062) | > loader_time: 0.0237 (0.02006861898634169)  --> TIME: 2023-10-20 01:45:02 -- STEP: 39/50 -- GLOBAL_STEP: 62640 | > loss_disc: 2.5185811519622803 (2.443831679148552) | > loss_disc_real_0: 0.25594061613082886 (0.1787890141400007) | > loss_disc_real_1: 0.26003792881965637 (0.23012560911667654) | > loss_disc_real_2: 0.44975587725639343 (0.22988920429578194) | > loss_disc_real_3: 0.2345045655965805 (0.22988996372964138) | > loss_disc_real_4: 0.31106746196746826 (0.19352508966739362) | > loss_disc_real_5: 0.32713139057159424 (0.2229819875688125) | > loss_0: 2.5185811519622803 (2.443831679148552) | > grad_norm_0: tensor(1798.0249, device='cuda:0') (tensor(1349.6410, device='cuda:0')) | > loss_gen: 3.2117691040039062 (2.342065826440469) | > loss_kl: 0.5843315124511719 (0.9532798299422631) | > loss_feat: 5.5355119705200195 (5.040230974077414) | > loss_mel: 21.502599716186523 (21.74529947990026) | > loss_duration: 1.7103999853134155 (1.6655854047873082) | > loss_1: 32.544612884521484 (31.746461232503254) | > grad_norm_1: tensor(80425.5156, device='cuda:0') (tensor(48544.6523, device='cuda:0')) | > current_lr_0: 0.0001650593928086511 | > current_lr_1: 0.0001650593928086511 | > step_time: 0.3315 (0.4015022485684126) | > loader_time: 0.0037 (0.011020574814234024)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9256484508514404 (2.9256484508514404) | > loss_disc_real_0: 0.2589761018753052 (0.2589761018753052) | > loss_disc_real_1: 0.31352218985557556 (0.31352218985557556) | > loss_disc_real_2: 0.32191312313079834 (0.32191312313079834) | > loss_disc_real_3: 0.3527618944644928 (0.3527618944644928) | > loss_disc_real_4: 0.37415504455566406 (0.37415504455566406) | > loss_disc_real_5: 0.24223662912845612 (0.24223662912845612) | > loss_0: 2.9256484508514404 (2.9256484508514404) | > loss_gen: 2.1486897468566895 (2.1486897468566895) | > loss_kl: 2.662264347076416 (2.662264347076416) | > loss_feat: 1.0618343353271484 (1.0618343353271484) | > loss_mel: 20.400100708007812 (20.400100708007812) | > loss_duration: 2.31374454498291 (2.31374454498291) | > loss_1: 28.586631774902344 (28.586631774902344)  --> STEP: 1 | > loss_disc: 2.660108804702759 (2.660108804702759) | > loss_disc_real_0: 0.13446280360221863 (0.13446280360221863) | > loss_disc_real_1: 0.19680027663707733 (0.19680027663707733) | > loss_disc_real_2: 0.1972927302122116 (0.1972927302122116) | > loss_disc_real_3: 0.32833853363990784 (0.32833853363990784) | > loss_disc_real_4: 0.37804901599884033 (0.37804901599884033) | > loss_disc_real_5: 0.16166986525058746 (0.16166986525058746) | > loss_0: 2.660108804702759 (2.660108804702759) | > loss_gen: 2.1719300746917725 (2.1719300746917725) | > loss_kl: 3.0407485961914062 (3.0407485961914062) | > loss_feat: 6.659605026245117 (6.659605026245117) | > loss_mel: 24.830446243286133 (24.830446243286133) | > loss_duration: 2.3886876106262207 (2.3886876106262207) | > loss_1: 39.09141540527344 (39.09141540527344)  --> STEP: 2 | > loss_disc: 2.594620704650879 (2.627364754676819) | > loss_disc_real_0: 0.07541900128126144 (0.10494090244174004) | > loss_disc_real_1: 0.25429338216781616 (0.22554682940244675) | > loss_disc_real_2: 0.1364281326532364 (0.166860431432724) | > loss_disc_real_3: 0.376506507396698 (0.3524225205183029) | > loss_disc_real_4: 0.07950243353843689 (0.2287757247686386) | > loss_disc_real_5: 0.1798277199268341 (0.17074879258871078) | > loss_0: 2.594620704650879 (2.627364754676819) | > loss_gen: 1.82830011844635 (2.0001150965690613) | > loss_kl: 2.736145257949829 (2.8884469270706177) | > loss_feat: 8.846334457397461 (7.752969741821289) | > loss_mel: 22.832473754882812 (23.831459999084473) | > loss_duration: 2.4269580841064453 (2.407822847366333) | > loss_1: 38.67021179199219 (38.88081359863281)  --> STEP: 3 | > loss_disc: 3.0941245555877686 (2.7829513549804688) | > loss_disc_real_0: 0.17358513176441193 (0.127822312215964) | > loss_disc_real_1: 0.2864741384983063 (0.24585593243439993) | > loss_disc_real_2: 0.28594982624053955 (0.2065568963686625) | > loss_disc_real_3: 0.37031787633895874 (0.3583876391251882) | > loss_disc_real_4: 0.3251580595970154 (0.26090316971143085) | > loss_disc_real_5: 0.24046289920806885 (0.1939868281284968) | > loss_0: 3.0941245555877686 (2.7829513549804688) | > loss_gen: 1.6957314014434814 (1.8986538648605347) | > loss_kl: 1.933656930923462 (2.570183595021566) | > loss_feat: 0.3267315924167633 (5.277557025353114) | > loss_mel: 3.3238024711608887 (16.99557415644328) | > loss_duration: 2.2992513179779053 (2.3716323375701904) | > loss_1: 9.579174041748047 (29.11360041300456) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022637049357096353 (-0.003809372584025065) | > avg_loss_disc: 2.7829513549804688 (-0.1779940128326416) | > avg_loss_disc_real_0: 0.127822312215964 (-0.13844375560681024) | > avg_loss_disc_real_1: 0.24585593243439993 (-0.01462198297182718) | > avg_loss_disc_real_2: 0.2065568963686625 (+0.016631280382474245) | > avg_loss_disc_real_3: 0.3583876391251882 (+0.04598273833592731) | > avg_loss_disc_real_4: 0.26090316971143085 (+0.0370591729879379) | > avg_loss_disc_real_5: 0.1939868281284968 (-0.07611896594365439) | > avg_loss_0: 2.7829513549804688 (-0.1779940128326416) | > avg_loss_gen: 1.8986538648605347 (+0.04261811574300123) | > avg_loss_kl: 2.570183595021566 (+0.08884755770365427) | > avg_loss_feat: 5.277557025353114 (+0.22908132274945636) | > avg_loss_mel: 16.99557415644328 (-1.6525122324625627) | > avg_loss_duration: 2.3716323375701904 (+0.028176943461100112) | > avg_loss_1: 29.11360041300456 (-1.2637901306152344)  > EPOCH: 193/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:45:19)   --> TIME: 2023-10-20 01:45:33 -- STEP: 19/50 -- GLOBAL_STEP: 62670 | > loss_disc: 2.938187599182129 (2.4836077878349707) | > loss_disc_real_0: 0.1645798683166504 (0.19709473809129313) | > loss_disc_real_1: 0.3070828914642334 (0.233906088102805) | > loss_disc_real_2: 0.26206067204475403 (0.21351027841630735) | > loss_disc_real_3: 0.25300952792167664 (0.2787561989144275) | > loss_disc_real_4: 0.19475029408931732 (0.21139455312176755) | > loss_disc_real_5: 0.3329637050628662 (0.21076955126696512) | > loss_0: 2.938187599182129 (2.4836077878349707) | > grad_norm_0: tensor(2004.5613, device='cuda:0') (tensor(1417.3202, device='cuda:0')) | > loss_gen: 1.6639246940612793 (2.3829155658420764) | > loss_kl: 0.6864664554595947 (1.07842492116125) | > loss_feat: 0.3252105116844177 (4.760550040947764) | > loss_mel: 2.4197192192077637 (20.635862400657253) | > loss_duration: 1.7874237298965454 (1.72079242530622) | > loss_1: 6.882744312286377 (30.578545093536377) | > grad_norm_1: tensor(33796.4336, device='cuda:0') (tensor(55160.8711, device='cuda:0')) | > current_lr_0: 0.00016489440561127619 | > current_lr_1: 0.00016489440561127619 | > step_time: 0.6259 (0.4981706518875925) | > loader_time: 0.0247 (0.02086118647926732)  --> TIME: 2023-10-20 01:45:48 -- STEP: 49/50 -- GLOBAL_STEP: 62700 | > loss_disc: 1.9507651329040527 (2.4308976105281284) | > loss_disc_real_0: 0.18741993606090546 (0.16367888388851168) | > loss_disc_real_1: 0.40203648805618286 (0.22674778369920595) | > loss_disc_real_2: 0.17509698867797852 (0.21697854919701207) | > loss_disc_real_3: 0.2988090515136719 (0.2402109130456738) | > loss_disc_real_4: 0.094960518181324 (0.19367689251595613) | > loss_disc_real_5: 0.05285467579960823 (0.20680496714324975) | > loss_0: 1.9507651329040527 (2.4308976105281284) | > grad_norm_0: tensor(1403.1903, device='cuda:0') (tensor(1194.2478, device='cuda:0')) | > loss_gen: 3.5336711406707764 (2.3495324582469705) | > loss_kl: 0.36840376257896423 (0.9833450621488145) | > loss_feat: 8.474946022033691 (5.159162146400432) | > loss_mel: 27.096477508544922 (21.716517594395846) | > loss_duration: 1.7954610586166382 (1.6670477876857834) | > loss_1: 41.268959045410156 (31.875604814412643) | > grad_norm_1: tensor(20696.9023, device='cuda:0') (tensor(41677.8555, device='cuda:0')) | > current_lr_0: 0.00016489440561127619 | > current_lr_1: 0.00016489440561127619 | > step_time: 0.4342 (0.48963533129010883) | > loader_time: 0.3559 (0.027387711466575156)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5824177265167236 (1.5824177265167236) | > loss_disc_real_0: 0.17337587475776672 (0.17337587475776672) | > loss_disc_real_1: 0.30581679940223694 (0.30581679940223694) | > loss_disc_real_2: 0.1981543004512787 (0.1981543004512787) | > loss_disc_real_3: 0.30197498202323914 (0.30197498202323914) | > loss_disc_real_4: 0.1117883175611496 (0.1117883175611496) | > loss_disc_real_5: 0.030202871188521385 (0.030202871188521385) | > loss_0: 1.5824177265167236 (1.5824177265167236) | > loss_gen: 3.944194793701172 (3.944194793701172) | > loss_kl: 2.8196637630462646 (2.8196637630462646) | > loss_feat: 8.70085334777832 (8.70085334777832) | > loss_mel: 24.787500381469727 (24.787500381469727) | > loss_duration: 2.277817964553833 (2.277817964553833) | > loss_1: 42.530029296875 (42.530029296875)  --> STEP: 1 | > loss_disc: 2.3051958084106445 (2.3051958084106445) | > loss_disc_real_0: 0.12174618244171143 (0.12174618244171143) | > loss_disc_real_1: 0.40137654542922974 (0.40137654542922974) | > loss_disc_real_2: 0.30879393219947815 (0.30879393219947815) | > loss_disc_real_3: 0.4050452709197998 (0.4050452709197998) | > loss_disc_real_4: 0.08174172043800354 (0.08174172043800354) | > loss_disc_real_5: 0.40096622705459595 (0.40096622705459595) | > loss_0: 2.3051958084106445 (2.3051958084106445) | > loss_gen: 3.1187071800231934 (3.1187071800231934) | > loss_kl: 2.8740439414978027 (2.8740439414978027) | > loss_feat: 6.012629508972168 (6.012629508972168) | > loss_mel: 30.306415557861328 (30.306415557861328) | > loss_duration: 2.4118001461029053 (2.4118001461029053) | > loss_1: 44.723594665527344 (44.723594665527344)  --> STEP: 2 | > loss_disc: 2.8570775985717773 (2.581136703491211) | > loss_disc_real_0: 0.14003725349903107 (0.13089171797037125) | > loss_disc_real_1: 0.3157283067703247 (0.3585524260997772) | > loss_disc_real_2: 0.2657344341278076 (0.2872641831636429) | > loss_disc_real_3: 0.43886661529541016 (0.421955943107605) | > loss_disc_real_4: 0.3948594629764557 (0.23830059170722961) | > loss_disc_real_5: 0.46389880776405334 (0.43243251740932465) | > loss_0: 2.8570775985717773 (2.581136703491211) | > loss_gen: 2.4786205291748047 (2.798663854598999) | > loss_kl: 3.5349104404449463 (3.2044771909713745) | > loss_feat: 2.312910318374634 (4.162769913673401) | > loss_mel: 24.753543853759766 (27.529979705810547) | > loss_duration: 2.3778932094573975 (2.3948466777801514) | > loss_1: 35.45787811279297 (40.090736389160156)  --> STEP: 3 | > loss_disc: 2.4824492931365967 (2.548240900039673) | > loss_disc_real_0: 0.2913840413093567 (0.1843891590833664) | > loss_disc_real_1: 0.2647312581539154 (0.3272787034511566) | > loss_disc_real_2: 0.26206448674201965 (0.2788642843564351) | > loss_disc_real_3: 0.31617119908332825 (0.3866943617661794) | > loss_disc_real_4: 0.07288752496242523 (0.18316290279229483) | > loss_disc_real_5: 0.2710287570953369 (0.37863126397132874) | > loss_0: 2.4824492931365967 (2.548240900039673) | > loss_gen: 2.7206532955169678 (2.7726603349049888) | > loss_kl: 1.2698447704315186 (2.5595997174580893) | > loss_feat: 4.985325336456299 (4.436955054601033) | > loss_mel: 26.323890686035156 (27.127950032552082) | > loss_duration: 2.305746555328369 (2.3651466369628906) | > loss_1: 37.60546112060547 (39.26231129964193) --> EVAL PERFORMANCE | > avg_loader_time: 0.008936087290445963 (+0.006672382354736328) | > avg_loss_disc: 2.548240900039673 (-0.2347104549407959) | > avg_loss_disc_real_0: 0.1843891590833664 (+0.056566846867402404) | > avg_loss_disc_real_1: 0.3272787034511566 (+0.08142277101675668) | > avg_loss_disc_real_2: 0.2788642843564351 (+0.07230738798777261) | > avg_loss_disc_real_3: 0.3866943617661794 (+0.02830672264099121) | > avg_loss_disc_real_4: 0.18316290279229483 (-0.07774026691913602) | > avg_loss_disc_real_5: 0.37863126397132874 (+0.18464443584283194) | > avg_loss_0: 2.548240900039673 (-0.2347104549407959) | > avg_loss_gen: 2.7726603349049888 (+0.8740064700444541) | > avg_loss_kl: 2.5595997174580893 (-0.010583877563476562) | > avg_loss_feat: 4.436955054601033 (-0.8406019707520809) | > avg_loss_mel: 27.127950032552082 (+10.132375876108803) | > avg_loss_duration: 2.3651466369628906 (-0.006485700607299805) | > avg_loss_1: 39.26231129964193 (+10.148710886637371)  > EPOCH: 194/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:46:01)   --> TIME: 2023-10-20 01:46:19 -- STEP: 29/50 -- GLOBAL_STEP: 62730 | > loss_disc: 2.3866143226623535 (2.457956420964208) | > loss_disc_real_0: 0.05516180396080017 (0.15121353944313937) | > loss_disc_real_1: 0.12093772739171982 (0.2227835557584105) | > loss_disc_real_2: 0.16197283565998077 (0.2202360252368039) | > loss_disc_real_3: 0.2937905192375183 (0.23325563710311362) | > loss_disc_real_4: 0.10705287009477615 (0.24962820061321905) | > loss_disc_real_5: 0.12263545393943787 (0.2078215073922585) | > loss_0: 2.3866143226623535 (2.457956420964208) | > grad_norm_0: tensor(829.1653, device='cuda:0') (tensor(1672.7947, device='cuda:0')) | > loss_gen: 2.4052915573120117 (2.3405699812132736) | > loss_kl: 0.8272363543510437 (1.0390518800965671) | > loss_feat: 11.100887298583984 (5.093603265857132) | > loss_mel: 24.829957962036133 (20.024160006950638) | > loss_duration: 1.6191742420196533 (1.6824980604237523) | > loss_1: 40.78254699707031 (30.179883578727985) | > grad_norm_1: tensor(48591.4453, device='cuda:0') (tensor(45045.3867, device='cuda:0')) | > current_lr_0: 0.00016472958332893476 | > current_lr_1: 0.00016472958332893476 | > step_time: 0.6321 (0.4829811063306085) | > loader_time: 0.0039 (0.013966437043814823)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.672666549682617 (2.672666549682617) | > loss_disc_real_0: 0.04023409262299538 (0.04023409262299538) | > loss_disc_real_1: 0.20466232299804688 (0.20466232299804688) | > loss_disc_real_2: 0.42237669229507446 (0.42237669229507446) | > loss_disc_real_3: 0.34410393238067627 (0.34410393238067627) | > loss_disc_real_4: 0.32465842366218567 (0.32465842366218567) | > loss_disc_real_5: 0.3726571500301361 (0.3726571500301361) | > loss_0: 2.672666549682617 (2.672666549682617) | > loss_gen: 2.533737897872925 (2.533737897872925) | > loss_kl: 3.1349427700042725 (3.1349427700042725) | > loss_feat: 4.106964588165283 (4.106964588165283) | > loss_mel: 29.946088790893555 (29.946088790893555) | > loss_duration: 2.298403739929199 (2.298403739929199) | > loss_1: 42.020137786865234 (42.020137786865234)  --> STEP: 1 | > loss_disc: 2.941551923751831 (2.941551923751831) | > loss_disc_real_0: 0.1392664909362793 (0.1392664909362793) | > loss_disc_real_1: 0.2489435374736786 (0.2489435374736786) | > loss_disc_real_2: 0.27781879901885986 (0.27781879901885986) | > loss_disc_real_3: 0.24581775069236755 (0.24581775069236755) | > loss_disc_real_4: 0.4325920641422272 (0.4325920641422272) | > loss_disc_real_5: 0.2498464733362198 (0.2498464733362198) | > loss_0: 2.941551923751831 (2.941551923751831) | > loss_gen: 1.718799114227295 (1.718799114227295) | > loss_kl: 2.7029075622558594 (2.7029075622558594) | > loss_feat: 0.3047616183757782 (0.3047616183757782) | > loss_mel: 14.710224151611328 (14.710224151611328) | > loss_duration: 2.409686326980591 (2.409686326980591) | > loss_1: 21.84638023376465 (21.84638023376465)  --> STEP: 2 | > loss_disc: 3.052030324935913 (2.996791124343872) | > loss_disc_real_0: 0.17616403102874756 (0.15771526098251343) | > loss_disc_real_1: 0.22670334577560425 (0.23782344162464142) | > loss_disc_real_2: 0.2914050817489624 (0.28461194038391113) | > loss_disc_real_3: 0.2332683503627777 (0.23954305052757263) | > loss_disc_real_4: 0.4432505965232849 (0.43792133033275604) | > loss_disc_real_5: 0.2429495006799698 (0.2463979870080948) | > loss_0: 3.052030324935913 (2.996791124343872) | > loss_gen: 1.6506919860839844 (1.6847455501556396) | > loss_kl: 3.219872236251831 (2.961389899253845) | > loss_feat: 0.5841175317764282 (0.4444395750761032) | > loss_mel: 9.469090461730957 (12.089657306671143) | > loss_duration: 2.3483643531799316 (2.3790253400802612) | > loss_1: 17.272136688232422 (19.559258460998535)  --> STEP: 3 | > loss_disc: 1.7258471250534058 (2.5731431245803833) | > loss_disc_real_0: 0.1737106442451477 (0.1630470554033915) | > loss_disc_real_1: 0.19953598082065582 (0.22506095468997955) | > loss_disc_real_2: 0.17266888916492462 (0.2472975899775823) | > loss_disc_real_3: 0.2763259708881378 (0.25180402398109436) | > loss_disc_real_4: 0.09850700944662094 (0.324783223370711) | > loss_disc_real_5: 0.03749104216694832 (0.17676233872771263) | > loss_0: 1.7258471250534058 (2.5731431245803833) | > loss_gen: 3.23481822013855 (2.201436440149943) | > loss_kl: 1.407260537147522 (2.4433467785517373) | > loss_feat: 7.229546070098877 (2.7061417400836945) | > loss_mel: 28.0400333404541 (17.40644931793213) | > loss_duration: 2.3402209281921387 (2.3660905361175537) | > loss_1: 42.25188064575195 (27.12346585591634) --> EVAL PERFORMANCE | > avg_loader_time: 0.010380903879801432 (+0.0014448165893554688) | > avg_loss_disc: 2.5731431245803833 (+0.02490222454071045) | > avg_loss_disc_real_0: 0.1630470554033915 (-0.021342103679974883) | > avg_loss_disc_real_1: 0.22506095468997955 (-0.10221774876117706) | > avg_loss_disc_real_2: 0.2472975899775823 (-0.031566694378852816) | > avg_loss_disc_real_3: 0.25180402398109436 (-0.13489033778508502) | > avg_loss_disc_real_4: 0.324783223370711 (+0.1416203205784162) | > avg_loss_disc_real_5: 0.17676233872771263 (-0.2018689252436161) | > avg_loss_0: 2.5731431245803833 (+0.02490222454071045) | > avg_loss_gen: 2.201436440149943 (-0.5712238947550459) | > avg_loss_kl: 2.4433467785517373 (-0.11625293890635202) | > avg_loss_feat: 2.7061417400836945 (-1.7308133145173388) | > avg_loss_mel: 17.40644931793213 (-9.721500714619953) | > avg_loss_duration: 2.3660905361175537 (+0.0009438991546630859) | > avg_loss_1: 27.12346585591634 (-12.13884544372559)  > EPOCH: 195/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:46:40)   --> TIME: 2023-10-20 01:46:49 -- STEP: 9/50 -- GLOBAL_STEP: 62760 | > loss_disc: 2.680711507797241 (2.327363067203098) | > loss_disc_real_0: 0.15018229186534882 (0.12479795474145147) | > loss_disc_real_1: 0.32156676054000854 (0.19437485933303833) | > loss_disc_real_2: 0.3855426013469696 (0.24707422157128653) | > loss_disc_real_3: 0.3325922191143036 (0.2604362650050057) | > loss_disc_real_4: 0.33005598187446594 (0.22230035894446903) | > loss_disc_real_5: 0.41728875041007996 (0.19997656924857032) | > loss_0: 2.680711507797241 (2.327363067203098) | > grad_norm_0: tensor(651.4492, device='cuda:0') (tensor(1431.0785, device='cuda:0')) | > loss_gen: 2.7568793296813965 (2.878138118320041) | > loss_kl: 0.5308769345283508 (1.0703248315387301) | > loss_feat: 2.212357997894287 (7.292545200222069) | > loss_mel: 20.63100242614746 (22.995261311531067) | > loss_duration: 1.6227126121520996 (1.6484717792934842) | > loss_1: 27.753829956054688 (35.88474146525065) | > grad_norm_1: tensor(16215.0068, device='cuda:0') (tensor(82236.2344, device='cuda:0')) | > current_lr_0: 0.00016456492579678398 | > current_lr_1: 0.00016456492579678398 | > step_time: 0.2674 (0.5064114199744331) | > loader_time: 0.0132 (0.016975561777750652)  --> TIME: 2023-10-20 01:47:01 -- STEP: 39/50 -- GLOBAL_STEP: 62790 | > loss_disc: 2.8818209171295166 (2.3812926426911964) | > loss_disc_real_0: 0.17632636427879333 (0.18295372048249606) | > loss_disc_real_1: 0.24868632853031158 (0.22002830623816222) | > loss_disc_real_2: 0.261992871761322 (0.21521285606118348) | > loss_disc_real_3: 0.2620299160480499 (0.24212996470622522) | > loss_disc_real_4: 0.24022050201892853 (0.23396517150104046) | > loss_disc_real_5: 0.23867186903953552 (0.2190644983202219) | > loss_0: 2.8818209171295166 (2.3812926426911964) | > grad_norm_0: tensor(800.6000, device='cuda:0') (tensor(1291.8855, device='cuda:0')) | > loss_gen: 1.5699489116668701 (2.6481711742205496) | > loss_kl: 0.5810369849205017 (0.912494835181114) | > loss_feat: 0.49669837951660156 (6.0689402247468625) | > loss_mel: 20.634653091430664 (21.958434083522896) | > loss_duration: 1.6988720893859863 (1.6615287218338404) | > loss_1: 24.98120880126953 (33.24956904924833) | > grad_norm_1: tensor(15922.3545, device='cuda:0') (tensor(50086.6914, device='cuda:0')) | > current_lr_0: 0.00016456492579678398 | > current_lr_1: 0.00016456492579678398 | > step_time: 0.2534 (0.41314268112182617) | > loader_time: 0.0041 (0.01157439672029935)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8932340145111084 (2.8932340145111084) | > loss_disc_real_0: 0.22610405087471008 (0.22610405087471008) | > loss_disc_real_1: 0.2876109778881073 (0.2876109778881073) | > loss_disc_real_2: 0.39309072494506836 (0.39309072494506836) | > loss_disc_real_3: 0.22561492025852203 (0.22561492025852203) | > loss_disc_real_4: 0.3194226920604706 (0.3194226920604706) | > loss_disc_real_5: 0.4029446542263031 (0.4029446542263031) | > loss_0: 2.8932340145111084 (2.8932340145111084) | > loss_gen: 2.4466755390167236 (2.4466755390167236) | > loss_kl: 3.338905096054077 (3.338905096054077) | > loss_feat: 4.91597843170166 (4.91597843170166) | > loss_mel: 22.471384048461914 (22.471384048461914) | > loss_duration: 2.3172030448913574 (2.3172030448913574) | > loss_1: 35.49014663696289 (35.49014663696289)  --> STEP: 1 | > loss_disc: 2.904090642929077 (2.904090642929077) | > loss_disc_real_0: 0.1243993490934372 (0.1243993490934372) | > loss_disc_real_1: 0.23996058106422424 (0.23996058106422424) | > loss_disc_real_2: 0.27064236998558044 (0.27064236998558044) | > loss_disc_real_3: 0.2846607565879822 (0.2846607565879822) | > loss_disc_real_4: 0.2717999815940857 (0.2717999815940857) | > loss_disc_real_5: 0.28143101930618286 (0.28143101930618286) | > loss_0: 2.904090642929077 (2.904090642929077) | > loss_gen: 1.5968517065048218 (1.5968517065048218) | > loss_kl: 2.645720958709717 (2.645720958709717) | > loss_feat: 1.0395569801330566 (1.0395569801330566) | > loss_mel: 18.018922805786133 (18.018922805786133) | > loss_duration: 2.41888165473938 (2.41888165473938) | > loss_1: 25.719934463500977 (25.719934463500977)  --> STEP: 2 | > loss_disc: 3.4969727993011475 (3.2005317211151123) | > loss_disc_real_0: 0.545647144317627 (0.3350232467055321) | > loss_disc_real_1: 0.3106166124343872 (0.2752885967493057) | > loss_disc_real_2: 0.6476173400878906 (0.45912985503673553) | > loss_disc_real_3: 0.21790428459644318 (0.2512825205922127) | > loss_disc_real_4: 0.360504150390625 (0.31615206599235535) | > loss_disc_real_5: 0.6553376317024231 (0.468384325504303) | > loss_0: 3.4969727993011475 (3.2005317211151123) | > loss_gen: 2.944981575012207 (2.2709166407585144) | > loss_kl: 2.912365198135376 (2.7790430784225464) | > loss_feat: 4.594001770019531 (2.816779375076294) | > loss_mel: 31.09994888305664 (24.559435844421387) | > loss_duration: 2.4109137058258057 (2.4148976802825928) | > loss_1: 43.96221160888672 (34.84107303619385)  --> STEP: 3 | > loss_disc: 3.087858200073242 (3.1629738807678223) | > loss_disc_real_0: 0.19745787978172302 (0.2891681243975957) | > loss_disc_real_1: 0.2685202956199646 (0.2730324963728587) | > loss_disc_real_2: 0.2866360545158386 (0.4016319215297699) | > loss_disc_real_3: 0.27825140953063965 (0.260272150238355) | > loss_disc_real_4: 0.27933138608932495 (0.30387850602467853) | > loss_disc_real_5: 0.2532306909561157 (0.3966664473215739) | > loss_0: 3.087858200073242 (3.1629738807678223) | > loss_gen: 1.511900782585144 (2.017911354700724) | > loss_kl: 1.6406434774398804 (2.3995765447616577) | > loss_feat: 0.2269585132598877 (1.9535057544708252) | > loss_mel: 3.5855777263641357 (17.56814980506897) | > loss_duration: 2.205852746963501 (2.3452160358428955) | > loss_1: 9.170933723449707 (26.2843599319458) --> EVAL PERFORMANCE | > avg_loader_time: 0.00952442487080892 (-0.0008564790089925119) | > avg_loss_disc: 3.1629738807678223 (+0.589830756187439) | > avg_loss_disc_real_0: 0.2891681243975957 (+0.1261210689942042) | > avg_loss_disc_real_1: 0.2730324963728587 (+0.04797154168287915) | > avg_loss_disc_real_2: 0.4016319215297699 (+0.1543343315521876) | > avg_loss_disc_real_3: 0.260272150238355 (+0.008468126257260622) | > avg_loss_disc_real_4: 0.30387850602467853 (-0.020904717346032498) | > avg_loss_disc_real_5: 0.3966664473215739 (+0.21990410859386128) | > avg_loss_0: 3.1629738807678223 (+0.589830756187439) | > avg_loss_gen: 2.017911354700724 (-0.18352508544921875) | > avg_loss_kl: 2.3995765447616577 (-0.043770233790079605) | > avg_loss_feat: 1.9535057544708252 (-0.7526359856128693) | > avg_loss_mel: 17.56814980506897 (+0.16170048713684082) | > avg_loss_duration: 2.3452160358428955 (-0.020874500274658203) | > avg_loss_1: 26.2843599319458 (-0.8391059239705392)  > EPOCH: 196/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:47:18)   --> TIME: 2023-10-20 01:47:31 -- STEP: 19/50 -- GLOBAL_STEP: 62820 | > loss_disc: 2.014557123184204 (2.501250618382504) | > loss_disc_real_0: 0.030347958207130432 (0.15142526163866646) | > loss_disc_real_1: 0.2415364682674408 (0.22296959573501035) | > loss_disc_real_2: 0.30103743076324463 (0.2364778281434586) | > loss_disc_real_3: 0.2663220763206482 (0.25420124750388307) | > loss_disc_real_4: 0.15338265895843506 (0.23797906307797684) | > loss_disc_real_5: 0.025907304137945175 (0.214130318674602) | > loss_0: 2.014557123184204 (2.501250618382504) | > grad_norm_0: tensor(1800.0239, device='cuda:0') (tensor(1391.2683, device='cuda:0')) | > loss_gen: 2.5611767768859863 (2.680579160389147) | > loss_kl: 0.9124017953872681 (0.9568612324564081) | > loss_feat: 6.363978862762451 (5.421448053498017) | > loss_mel: 24.687231063842773 (22.759140190325287) | > loss_duration: 1.8143364191055298 (1.7190639847203304) | > loss_1: 36.3391227722168 (33.53709215866892) | > grad_norm_1: tensor(39568.3164, device='cuda:0') (tensor(46093.2148, device='cuda:0')) | > current_lr_0: 0.00016440043285014568 | > current_lr_1: 0.00016440043285014568 | > step_time: 0.5537 (0.49776237889340047) | > loader_time: 0.0179 (0.019192043103669818)  --> TIME: 2023-10-20 01:47:47 -- STEP: 49/50 -- GLOBAL_STEP: 62850 | > loss_disc: 1.845391869544983 (2.4729442036881735) | > loss_disc_real_0: 0.03017651103436947 (0.1770659214721955) | > loss_disc_real_1: 0.28296008706092834 (0.23064837247437361) | > loss_disc_real_2: 0.125601664185524 (0.23286342613246977) | > loss_disc_real_3: 0.2267092764377594 (0.24293835643602885) | > loss_disc_real_4: 0.10338801145553589 (0.20279303037238364) | > loss_disc_real_5: 0.02832818776369095 (0.19344478971039764) | > loss_0: 1.845391869544983 (2.4729442036881735) | > grad_norm_0: tensor(536.6373, device='cuda:0') (tensor(941.0765, device='cuda:0')) | > loss_gen: 2.302159547805786 (2.408851166160739) | > loss_kl: 0.8299100995063782 (0.9054368132231186) | > loss_feat: 5.773319721221924 (4.801249435741682) | > loss_mel: 24.245492935180664 (21.19864699791889) | > loss_duration: 1.8147966861724854 (1.6609113994909792) | > loss_1: 34.96567916870117 (30.975095739170005) | > grad_norm_1: tensor(11688.6348, device='cuda:0') (tensor(27817.5430, device='cuda:0')) | > current_lr_0: 0.00016440043285014568 | > current_lr_1: 0.00016440043285014568 | > step_time: 0.6631 (0.49578437513234663) | > loader_time: 0.3312 (0.026206298750274037)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.012592315673828 (3.012592315673828) | > loss_disc_real_0: 0.2648104429244995 (0.2648104429244995) | > loss_disc_real_1: 0.2864658236503601 (0.2864658236503601) | > loss_disc_real_2: 0.20971238613128662 (0.20971238613128662) | > loss_disc_real_3: 0.2954452633857727 (0.2954452633857727) | > loss_disc_real_4: 0.2921661138534546 (0.2921661138534546) | > loss_disc_real_5: 0.31778958439826965 (0.31778958439826965) | > loss_0: 3.012592315673828 (3.012592315673828) | > loss_gen: 1.676784634590149 (1.676784634590149) | > loss_kl: 2.7859208583831787 (2.7859208583831787) | > loss_feat: 0.0349813774228096 (0.0349813774228096) | > loss_mel: 7.7426910400390625 (7.7426910400390625) | > loss_duration: 2.2494640350341797 (2.2494640350341797) | > loss_1: 14.48984146118164 (14.48984146118164)  --> STEP: 1 | > loss_disc: 2.002636671066284 (2.002636671066284) | > loss_disc_real_0: 0.10390626639127731 (0.10390626639127731) | > loss_disc_real_1: 0.30226075649261475 (0.30226075649261475) | > loss_disc_real_2: 0.25324350595474243 (0.25324350595474243) | > loss_disc_real_3: 0.13432414829730988 (0.13432414829730988) | > loss_disc_real_4: 0.3038731515407562 (0.3038731515407562) | > loss_disc_real_5: 0.11306271702051163 (0.11306271702051163) | > loss_0: 2.002636671066284 (2.002636671066284) | > loss_gen: 2.8401122093200684 (2.8401122093200684) | > loss_kl: 2.8238635063171387 (2.8238635063171387) | > loss_feat: 6.944108009338379 (6.944108009338379) | > loss_mel: 26.674652099609375 (26.674652099609375) | > loss_duration: 2.456787109375 (2.456787109375) | > loss_1: 41.73952102661133 (41.73952102661133)  --> STEP: 2 | > loss_disc: 3.024869680404663 (2.5137531757354736) | > loss_disc_real_0: 0.2663983702659607 (0.185152318328619) | > loss_disc_real_1: 0.28615477681159973 (0.29420776665210724) | > loss_disc_real_2: 0.21178093552589417 (0.2325122207403183) | > loss_disc_real_3: 0.2965974509716034 (0.21546079963445663) | > loss_disc_real_4: 0.2909019887447357 (0.29738757014274597) | > loss_disc_real_5: 0.31883466243743896 (0.2159486897289753) | > loss_0: 3.024869680404663 (2.5137531757354736) | > loss_gen: 1.668574333190918 (2.254343271255493) | > loss_kl: 3.0540308952331543 (2.9389472007751465) | > loss_feat: 0.043825313448905945 (3.4939666613936424) | > loss_mel: 7.004305839538574 (16.839478969573975) | > loss_duration: 2.440345525741577 (2.4485663175582886) | > loss_1: 14.211082458496094 (27.97530174255371)  --> STEP: 3 | > loss_disc: 2.963937759399414 (2.6638147036234536) | > loss_disc_real_0: 0.2265324592590332 (0.19894569863875708) | > loss_disc_real_1: 0.2922961115837097 (0.29357054829597473) | > loss_disc_real_2: 0.21985888481140137 (0.22829444209734598) | > loss_disc_real_3: 0.29761090874671936 (0.24284416933854422) | > loss_disc_real_4: 0.29981476068496704 (0.29819663365681964) | > loss_disc_real_5: 0.3279278874397278 (0.2532750889658928) | > loss_0: 2.963937759399414 (2.6638147036234536) | > loss_gen: 1.7287718057632446 (2.079152782758077) | > loss_kl: 1.5249664783477783 (2.467620293299357) | > loss_feat: 0.27701568603515625 (2.4216496696074805) | > loss_mel: 17.819103240966797 (17.166020393371582) | > loss_duration: 2.320011854171753 (2.405714829762777) | > loss_1: 23.66986846923828 (26.540157318115234) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028781890869140625 (-0.006646235783894857) | > avg_loss_disc: 2.6638147036234536 (-0.49915917714436864) | > avg_loss_disc_real_0: 0.19894569863875708 (-0.09022242575883863) | > avg_loss_disc_real_1: 0.29357054829597473 (+0.02053805192311603) | > avg_loss_disc_real_2: 0.22829444209734598 (-0.17333747943242392) | > avg_loss_disc_real_3: 0.24284416933854422 (-0.017427980899810763) | > avg_loss_disc_real_4: 0.29819663365681964 (-0.005681872367858887) | > avg_loss_disc_real_5: 0.2532750889658928 (-0.14339135835568112) | > avg_loss_0: 2.6638147036234536 (-0.49915917714436864) | > avg_loss_gen: 2.079152782758077 (+0.061241428057353) | > avg_loss_kl: 2.467620293299357 (+0.06804374853769923) | > avg_loss_feat: 2.4216496696074805 (+0.4681439151366553) | > avg_loss_mel: 17.166020393371582 (-0.4021294116973877) | > avg_loss_duration: 2.405714829762777 (+0.06049879391988133) | > avg_loss_1: 26.540157318115234 (+0.2557973861694336)  > EPOCH: 197/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:47:58)   --> TIME: 2023-10-20 01:48:16 -- STEP: 29/50 -- GLOBAL_STEP: 62880 | > loss_disc: 2.70131254196167 (2.5027987340400957) | > loss_disc_real_0: 0.13683933019638062 (0.1378443233090742) | > loss_disc_real_1: 0.26897528767585754 (0.22690779959847188) | > loss_disc_real_2: 0.17355474829673767 (0.22114042398230782) | > loss_disc_real_3: 0.26080095767974854 (0.23123383393575406) | > loss_disc_real_4: 0.3166809678077698 (0.24603708383852038) | > loss_disc_real_5: 0.2927182912826538 (0.23260841794825834) | > loss_0: 2.70131254196167 (2.5027987340400957) | > grad_norm_0: tensor(364.2431, device='cuda:0') (tensor(452.8274, device='cuda:0')) | > loss_gen: 1.9133708477020264 (2.3821504280484955) | > loss_kl: 0.6975220441818237 (1.0832696618704962) | > loss_feat: 1.7565336227416992 (5.768250030947143) | > loss_mel: 23.509838104248047 (25.095491664163003) | > loss_duration: 1.6181657314300537 (1.677410701225544) | > loss_1: 29.49542999267578 (36.006572591847394) | > grad_norm_1: tensor(3870.9170, device='cuda:0') (tensor(19319.0293, device='cuda:0')) | > current_lr_0: 0.00016423610432450637 | > current_lr_1: 0.00016423610432450637 | > step_time: 0.61 (0.4546786670027108) | > loader_time: 0.004 (0.010438664206143084)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.017024040222168 (3.017024040222168) | > loss_disc_real_0: 0.29743701219558716 (0.29743701219558716) | > loss_disc_real_1: 0.31528306007385254 (0.31528306007385254) | > loss_disc_real_2: 0.31429344415664673 (0.31429344415664673) | > loss_disc_real_3: 0.27639883756637573 (0.27639883756637573) | > loss_disc_real_4: 0.21175818145275116 (0.21175818145275116) | > loss_disc_real_5: 0.25214555859565735 (0.25214555859565735) | > loss_0: 3.017024040222168 (3.017024040222168) | > loss_gen: 1.6750667095184326 (1.6750667095184326) | > loss_kl: 3.028985023498535 (3.028985023498535) | > loss_feat: 0.15666009485721588 (0.15666009485721588) | > loss_mel: 12.610966682434082 (12.610966682434082) | > loss_duration: 2.259467601776123 (2.259467601776123) | > loss_1: 19.73114585876465 (19.73114585876465)  --> STEP: 1 | > loss_disc: 2.337388277053833 (2.337388277053833) | > loss_disc_real_0: 0.07981354743242264 (0.07981354743242264) | > loss_disc_real_1: 0.22899678349494934 (0.22899678349494934) | > loss_disc_real_2: 0.18971888720989227 (0.18971888720989227) | > loss_disc_real_3: 0.247085303068161 (0.247085303068161) | > loss_disc_real_4: 0.2006727010011673 (0.2006727010011673) | > loss_disc_real_5: 0.1579878032207489 (0.1579878032207489) | > loss_0: 2.337388277053833 (2.337388277053833) | > loss_gen: 1.995531439781189 (1.995531439781189) | > loss_kl: 3.0049662590026855 (3.0049662590026855) | > loss_feat: 4.5704264640808105 (4.5704264640808105) | > loss_mel: 26.06884765625 (26.06884765625) | > loss_duration: 2.4160189628601074 (2.4160189628601074) | > loss_1: 38.05579376220703 (38.05579376220703)  --> STEP: 2 | > loss_disc: 1.8638014793395996 (2.1005948781967163) | > loss_disc_real_0: 0.14440812170505524 (0.11211083456873894) | > loss_disc_real_1: 0.18621787428855896 (0.20760732889175415) | > loss_disc_real_2: 0.18432404100894928 (0.18702146410942078) | > loss_disc_real_3: 0.09749975800514221 (0.1722925305366516) | > loss_disc_real_4: 0.14012303948402405 (0.17039787024259567) | > loss_disc_real_5: 0.25197258591651917 (0.20498019456863403) | > loss_0: 1.8638014793395996 (2.1005948781967163) | > loss_gen: 2.7974634170532227 (2.396497428417206) | > loss_kl: 3.361858367919922 (3.1834123134613037) | > loss_feat: 8.000578880310059 (6.285502672195435) | > loss_mel: 27.548044204711914 (26.808445930480957) | > loss_duration: 2.350393772125244 (2.383206367492676) | > loss_1: 44.0583381652832 (41.05706596374512)  --> STEP: 3 | > loss_disc: 2.487767219543457 (2.2296523253122964) | > loss_disc_real_0: 0.2976354658603668 (0.1739523783326149) | > loss_disc_real_1: 0.3448745906352997 (0.25336308280626935) | > loss_disc_real_2: 0.3281174600124359 (0.23405346274375916) | > loss_disc_real_3: 0.24190166592597961 (0.1954955756664276) | > loss_disc_real_4: 0.2755154073238373 (0.2054370492696762) | > loss_disc_real_5: 0.3753354251384735 (0.2617652714252472) | > loss_0: 2.487767219543457 (2.2296523253122964) | > loss_gen: 3.2800872325897217 (2.691027363141378) | > loss_kl: 1.8084514141082764 (2.7250920136769614) | > loss_feat: 4.068996429443359 (5.546667257944743) | > loss_mel: 23.2519474029541 (25.62294642130534) | > loss_duration: 2.3708815574645996 (2.379098097483317) | > loss_1: 34.78036117553711 (38.964831034342446) --> EVAL PERFORMANCE | > avg_loader_time: 0.011229356129964193 (+0.00835116704305013) | > avg_loss_disc: 2.2296523253122964 (-0.4341623783111572) | > avg_loss_disc_real_0: 0.1739523783326149 (-0.02499332030614218) | > avg_loss_disc_real_1: 0.25336308280626935 (-0.040207465489705385) | > avg_loss_disc_real_2: 0.23405346274375916 (+0.005759020646413177) | > avg_loss_disc_real_3: 0.1954955756664276 (-0.04734859367211661) | > avg_loss_disc_real_4: 0.2054370492696762 (-0.09275958438714343) | > avg_loss_disc_real_5: 0.2617652714252472 (+0.0084901824593544) | > avg_loss_0: 2.2296523253122964 (-0.4341623783111572) | > avg_loss_gen: 2.691027363141378 (+0.6118745803833008) | > avg_loss_kl: 2.7250920136769614 (+0.25747172037760446) | > avg_loss_feat: 5.546667257944743 (+3.1250175883372626) | > avg_loss_mel: 25.62294642130534 (+8.456926027933758) | > avg_loss_duration: 2.379098097483317 (-0.02661673227945993) | > avg_loss_1: 38.964831034342446 (+12.424673716227211)  > EPOCH: 198/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:48:37)   --> TIME: 2023-10-20 01:48:46 -- STEP: 9/50 -- GLOBAL_STEP: 62910 | > loss_disc: 2.4284417629241943 (2.1622851689656577) | > loss_disc_real_0: 0.17807400226593018 (0.13049482595589426) | > loss_disc_real_1: 0.3054938316345215 (0.24492835419045556) | > loss_disc_real_2: 0.33041849732398987 (0.2616364161173503) | > loss_disc_real_3: 0.2443818897008896 (0.17308714158005184) | > loss_disc_real_4: 0.28653377294540405 (0.254812128841877) | > loss_disc_real_5: 0.2987253963947296 (0.20126475259247753) | > loss_0: 2.4284417629241943 (2.1622851689656577) | > grad_norm_0: tensor(368.8415, device='cuda:0') (tensor(459.3289, device='cuda:0')) | > loss_gen: 2.664799928665161 (2.747940328386095) | > loss_kl: 0.7183665037155151 (1.1271766622861226) | > loss_feat: 5.414360046386719 (7.988764471477932) | > loss_mel: 24.479692459106445 (26.658125347561306) | > loss_duration: 1.5872421264648438 (1.6525502337349787) | > loss_1: 34.86445999145508 (40.17455694410536) | > grad_norm_1: tensor(8420.9131, device='cuda:0') (tensor(13751.7344, device='cuda:0')) | > current_lr_0: 0.00016407194005551692 | > current_lr_1: 0.00016407194005551692 | > step_time: 0.3849 (0.5609165297614204) | > loader_time: 0.0032 (0.01508421368069119)  --> TIME: 2023-10-20 01:48:58 -- STEP: 39/50 -- GLOBAL_STEP: 62940 | > loss_disc: 2.389993667602539 (2.3076472740906935) | > loss_disc_real_0: 0.03845125064253807 (0.1544539745992575) | > loss_disc_real_1: 0.12190932035446167 (0.22536110706054246) | > loss_disc_real_2: 0.11181632429361343 (0.2163792697665019) | > loss_disc_real_3: 0.7565542459487915 (0.23014717236256751) | > loss_disc_real_4: 0.01840459369122982 (0.22092142276083812) | > loss_disc_real_5: 0.020877564325928688 (0.21485591008781624) | > loss_0: 2.389993667602539 (2.3076472740906935) | > grad_norm_0: tensor(565.1276, device='cuda:0') (tensor(483.4575, device='cuda:0')) | > loss_gen: 2.5770132541656494 (2.528106845342195) | > loss_kl: 0.6026784181594849 (0.9395335487639289) | > loss_feat: 11.181714057922363 (6.299206964480571) | > loss_mel: 33.11213684082031 (25.01278542249631) | > loss_duration: 1.690475583076477 (1.6601448303613908) | > loss_1: 49.16402053833008 (36.43977766770583) | > grad_norm_1: tensor(30430.7383, device='cuda:0') (tensor(18929.5098, device='cuda:0')) | > current_lr_0: 0.00016407194005551692 | > current_lr_1: 0.00016407194005551692 | > step_time: 0.3314 (0.42641217891986555) | > loader_time: 0.0123 (0.011090798255724784)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7758569717407227 (2.7758569717407227) | > loss_disc_real_0: 0.4149831533432007 (0.4149831533432007) | > loss_disc_real_1: 0.34629741311073303 (0.34629741311073303) | > loss_disc_real_2: 0.32695651054382324 (0.32695651054382324) | > loss_disc_real_3: 0.3447955250740051 (0.3447955250740051) | > loss_disc_real_4: 0.3135235905647278 (0.3135235905647278) | > loss_disc_real_5: 0.2928270399570465 (0.2928270399570465) | > loss_0: 2.7758569717407227 (2.7758569717407227) | > loss_gen: 2.7785403728485107 (2.7785403728485107) | > loss_kl: 2.4691648483276367 (2.4691648483276367) | > loss_feat: 3.1408281326293945 (3.1408281326293945) | > loss_mel: 27.36491584777832 (27.36491584777832) | > loss_duration: 2.3425099849700928 (2.3425099849700928) | > loss_1: 38.0959587097168 (38.0959587097168)  --> STEP: 1 | > loss_disc: 2.395956039428711 (2.395956039428711) | > loss_disc_real_0: 0.2808464467525482 (0.2808464467525482) | > loss_disc_real_1: 0.3315975069999695 (0.3315975069999695) | > loss_disc_real_2: 0.17471694946289062 (0.17471694946289062) | > loss_disc_real_3: 0.28970351815223694 (0.28970351815223694) | > loss_disc_real_4: 0.2743062973022461 (0.2743062973022461) | > loss_disc_real_5: 0.17864608764648438 (0.17864608764648438) | > loss_0: 2.395956039428711 (2.395956039428711) | > loss_gen: 3.141268491744995 (3.141268491744995) | > loss_kl: 3.2935264110565186 (3.2935264110565186) | > loss_feat: 7.396176338195801 (7.396176338195801) | > loss_mel: 26.065677642822266 (26.065677642822266) | > loss_duration: 2.4318690299987793 (2.4318690299987793) | > loss_1: 42.32851791381836 (42.32851791381836)  --> STEP: 2 | > loss_disc: 2.8879616260528564 (2.6419588327407837) | > loss_disc_real_0: 0.3300056457519531 (0.30542604625225067) | > loss_disc_real_1: 0.24417230486869812 (0.2878849059343338) | > loss_disc_real_2: 0.26019200682640076 (0.2174544781446457) | > loss_disc_real_3: 0.27201592922210693 (0.28085972368717194) | > loss_disc_real_4: 0.2945704758167267 (0.2844383865594864) | > loss_disc_real_5: 0.22761814296245575 (0.20313211530447006) | > loss_0: 2.8879616260528564 (2.6419588327407837) | > loss_gen: 1.787898063659668 (2.4645832777023315) | > loss_kl: 3.127580165863037 (3.210553288459778) | > loss_feat: 0.3765200972557068 (3.886348217725754) | > loss_mel: 3.664891242980957 (14.865284442901611) | > loss_duration: 2.4618120193481445 (2.446840524673462) | > loss_1: 11.418702125549316 (26.873610019683838)  --> STEP: 3 | > loss_disc: 3.00606369972229 (2.763327121734619) | > loss_disc_real_0: 0.48647162318229675 (0.36577457189559937) | > loss_disc_real_1: 0.32890963554382324 (0.30155981580416363) | > loss_disc_real_2: 0.19650942087173462 (0.21047279238700867) | > loss_disc_real_3: 0.2568230926990509 (0.2728475133577983) | > loss_disc_real_4: 0.44507479667663574 (0.3379838565985362) | > loss_disc_real_5: 0.4914599061012268 (0.299241378903389) | > loss_0: 3.00606369972229 (2.763327121734619) | > loss_gen: 2.785097122192383 (2.571421225865682) | > loss_kl: 1.50445556640625 (2.6418540477752686) | > loss_feat: 4.14125394821167 (3.9713167945543923) | > loss_mel: 21.923982620239258 (17.218183835347492) | > loss_duration: 2.3909599781036377 (2.428213675816854) | > loss_1: 32.745750427246094 (28.830990155537922) --> EVAL PERFORMANCE | > avg_loader_time: 0.017760674158732098 (+0.006531318028767904) | > avg_loss_disc: 2.763327121734619 (+0.5336747964223227) | > avg_loss_disc_real_0: 0.36577457189559937 (+0.19182219356298447) | > avg_loss_disc_real_1: 0.30155981580416363 (+0.04819673299789429) | > avg_loss_disc_real_2: 0.21047279238700867 (-0.02358067035675049) | > avg_loss_disc_real_3: 0.2728475133577983 (+0.07735193769137066) | > avg_loss_disc_real_4: 0.3379838565985362 (+0.13254680732885998) | > avg_loss_disc_real_5: 0.299241378903389 (+0.037476107478141785) | > avg_loss_0: 2.763327121734619 (+0.5336747964223227) | > avg_loss_gen: 2.571421225865682 (-0.1196061372756958) | > avg_loss_kl: 2.6418540477752686 (-0.08323796590169286) | > avg_loss_feat: 3.9713167945543923 (-1.5753504633903508) | > avg_loss_mel: 17.218183835347492 (-8.404762585957847) | > avg_loss_duration: 2.428213675816854 (+0.04911557833353708) | > avg_loss_1: 28.830990155537922 (-10.133840878804524)  > EPOCH: 199/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:49:15)   --> TIME: 2023-10-20 01:49:29 -- STEP: 19/50 -- GLOBAL_STEP: 62970 | > loss_disc: 3.2132177352905273 (2.504989354233993) | > loss_disc_real_0: 0.3491911292076111 (0.17869741783330315) | > loss_disc_real_1: 0.46458467841148376 (0.24173994038842225) | > loss_disc_real_2: 0.4966089129447937 (0.24142520521816455) | > loss_disc_real_3: 0.3510112464427948 (0.22513827975643308) | > loss_disc_real_4: 0.38222402334213257 (0.25781827282748726) | > loss_disc_real_5: 0.33256158232688904 (0.2279763286443133) | > loss_0: 3.2132177352905273 (2.504989354233993) | > grad_norm_0: tensor(472.0222, device='cuda:0') (tensor(551.0526, device='cuda:0')) | > loss_gen: 2.705615520477295 (2.4700267503136084) | > loss_kl: 0.8108837008476257 (0.8933382222526952) | > loss_feat: 4.125307559967041 (5.9502940522997) | > loss_mel: 23.975820541381836 (23.568673108753405) | > loss_duration: 1.7549434900283813 (1.688253038807919) | > loss_1: 33.3725700378418 (34.57058560220819) | > grad_norm_1: tensor(8808.4082, device='cuda:0') (tensor(22301.8496, device='cuda:0')) | > current_lr_0: 0.00016390793987899256 | > current_lr_1: 0.00016390793987899256 | > step_time: 0.5648 (0.5155698751148424) | > loader_time: 0.0142 (0.0171388073971397)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6700963973999023 (2.6700963973999023) | > loss_disc_real_0: 0.16243071854114532 (0.16243071854114532) | > loss_disc_real_1: 0.16329587996006012 (0.16329587996006012) | > loss_disc_real_2: 0.3371393382549286 (0.3371393382549286) | > loss_disc_real_3: 0.15739813446998596 (0.15739813446998596) | > loss_disc_real_4: 0.2503224015235901 (0.2503224015235901) | > loss_disc_real_5: 0.33044010400772095 (0.33044010400772095) | > loss_0: 2.6700963973999023 (2.6700963973999023) | > loss_gen: 2.2733020782470703 (2.2733020782470703) | > loss_kl: 1.8076726198196411 (1.8076726198196411) | > loss_feat: 6.636294364929199 (6.636294364929199) | > loss_mel: 24.262916564941406 (24.262916564941406) | > loss_duration: 2.2699832916259766 (2.2699832916259766) | > loss_1: 37.25016784667969 (37.25016784667969)  --> STEP: 1 | > loss_disc: 2.7700247764587402 (2.7700247764587402) | > loss_disc_real_0: 0.22205062210559845 (0.22205062210559845) | > loss_disc_real_1: 0.3745720088481903 (0.3745720088481903) | > loss_disc_real_2: 0.3869860768318176 (0.3869860768318176) | > loss_disc_real_3: 0.27944785356521606 (0.27944785356521606) | > loss_disc_real_4: 0.3691873550415039 (0.3691873550415039) | > loss_disc_real_5: 0.346986323595047 (0.346986323595047) | > loss_0: 2.7700247764587402 (2.7700247764587402) | > loss_gen: 3.1341373920440674 (3.1341373920440674) | > loss_kl: 3.103952407836914 (3.103952407836914) | > loss_feat: 5.928544521331787 (5.928544521331787) | > loss_mel: 23.2431697845459 (23.2431697845459) | > loss_duration: 2.4675047397613525 (2.4675047397613525) | > loss_1: 37.8773078918457 (37.8773078918457)  --> STEP: 2 | > loss_disc: 1.787902593612671 (2.2789636850357056) | > loss_disc_real_0: 0.017035000026226044 (0.11954281106591225) | > loss_disc_real_1: 0.23378679156303406 (0.3041794002056122) | > loss_disc_real_2: 0.17705702781677246 (0.28202155232429504) | > loss_disc_real_3: 0.17828920483589172 (0.2288685292005539) | > loss_disc_real_4: 0.12235929816961288 (0.2457733266055584) | > loss_disc_real_5: 0.12420126050710678 (0.2355937920510769) | > loss_0: 1.787902593612671 (2.2789636850357056) | > loss_gen: 3.0449581146240234 (3.0895477533340454) | > loss_kl: 3.1273398399353027 (3.1156461238861084) | > loss_feat: 12.032912254333496 (8.980728387832642) | > loss_mel: 22.510221481323242 (22.87669563293457) | > loss_duration: 2.453643321990967 (2.4605740308761597) | > loss_1: 43.16907501220703 (40.52319145202637)  --> STEP: 3 | > loss_disc: 3.2186596393585205 (2.592195669809977) | > loss_disc_real_0: 0.6340820789337158 (0.2910559003551801) | > loss_disc_real_1: 0.3083907961845398 (0.3055831988652547) | > loss_disc_real_2: 0.23348289728164673 (0.2658420006434123) | > loss_disc_real_3: 0.26325133442878723 (0.24032946427663168) | > loss_disc_real_4: 0.25821518898010254 (0.24992061406373978) | > loss_disc_real_5: 0.2630298137664795 (0.24473913262287775) | > loss_0: 3.2186596393585205 (2.592195669809977) | > loss_gen: 2.3009755611419678 (2.826690355936686) | > loss_kl: 1.7249482870101929 (2.6520801782608032) | > loss_feat: 0.8329203128814697 (6.264792362848918) | > loss_mel: 20.405282974243164 (22.05289141337077) | > loss_duration: 2.2309110164642334 (2.384019692738851) | > loss_1: 27.495038986206055 (36.180473963419594)  --> TIME: 2023-10-20 01:49:50 -- STEP: 49/50 -- GLOBAL_STEP: 63000 | > loss_disc: 1.9351954460144043 (2.473370462047811) | > loss_disc_real_0: 0.21151182055473328 (0.16024325195015693) | > loss_disc_real_1: 0.2609458863735199 (0.22923717058586832) | > loss_disc_real_2: 0.1333620548248291 (0.25081598439386904) | > loss_disc_real_3: 0.2722037136554718 (0.2252712388884048) | > loss_disc_real_4: 0.10248800367116928 (0.23677230269020919) | > loss_disc_real_5: 0.2705608010292053 (0.23438893380213757) | > loss_0: 1.9351954460144043 (2.473370462047811) | > grad_norm_0: tensor(1252.3131, device='cuda:0') (tensor(570.5203, device='cuda:0')) | > loss_gen: 3.3026700019836426 (2.41784849215527) | > loss_kl: 1.0097873210906982 (0.8923718856305493) | > loss_feat: 5.674016952514648 (5.618293140007525) | > loss_mel: 25.743526458740234 (24.44043390118346) | > loss_duration: 1.7850481271743774 (1.6534368991851807) | > loss_1: 37.51504898071289 (35.02238454624097) | > grad_norm_1: tensor(20410.2969, device='cuda:0') (tensor(18791.4277, device='cuda:0')) | > current_lr_0: 0.00016390793987899256 | > current_lr_1: 0.00016390793987899256 | > step_time: 1.2304 (0.5235605191211312) | > loader_time: 5.4051 (0.1287846954501405) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_63000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9038329124450684 (2.67010498046875) | > loss_disc_real_0: 0.2950688600540161 (0.2920591402798891) | > loss_disc_real_1: 0.38562798500061035 (0.32559439539909363) | > loss_disc_real_2: 0.34347909688949585 (0.28525127470493317) | > loss_disc_real_3: 0.3079574406147003 (0.25723645836114883) | > loss_disc_real_4: 0.3411105275154114 (0.2727180924266577) | > loss_disc_real_5: 0.3826098144054413 (0.27920680306851864) | > loss_0: 2.9038329124450684 (2.67010498046875) | > loss_gen: 2.962043046951294 (2.860528528690338) | > loss_kl: 1.9003788232803345 (2.464154839515686) | > loss_feat: 2.896334409713745 (5.4226778745651245) | > loss_mel: 23.370037078857422 (22.38217782974243) | > loss_duration: 2.2788431644439697 (2.3577255606651306) | > loss_1: 33.40763854980469 (35.48726511001587)  --> STEP: 1 | > loss_disc: 2.2984790802001953 (2.595779800415039) | > loss_disc_real_0: 0.08736172318458557 (0.2511196568608284) | > loss_disc_real_1: 0.24963578581809998 (0.3104026734828949) | > loss_disc_real_2: 0.2591743469238281 (0.28003588914871214) | > loss_disc_real_3: 0.16194434463977814 (0.2381780356168747) | > loss_disc_real_4: 0.18196962773799896 (0.25456839948892596) | > loss_disc_real_5: 0.27519679069519043 (0.278404800593853) | > loss_0: 2.2984790802001953 (2.595779800415039) | > loss_gen: 2.224377155303955 (2.7332982540130617) | > loss_kl: 3.0348751544952393 (2.5782989025115968) | > loss_feat: 4.607054710388184 (5.259553241729736) | > loss_mel: 23.75238800048828 (22.6562198638916) | > loss_duration: 2.4987411499023438 (2.385928678512573) | > loss_1: 36.117435455322266 (35.613299179077146)  --> STEP: 2 | > loss_disc: 2.7338247299194336 (2.6187872886657715) | > loss_disc_real_0: 0.30049818754196167 (0.25934941197435063) | > loss_disc_real_1: 0.3733014762401581 (0.3208858072757721) | > loss_disc_real_2: 0.261736661195755 (0.2769860178232193) | > loss_disc_real_3: 0.45323848724365234 (0.2740214442213376) | > loss_disc_real_4: 0.3418552279472351 (0.26911620423197746) | > loss_disc_real_5: 0.33900925517082214 (0.28850554302334785) | > loss_0: 2.7338247299194336 (2.6187872886657715) | > loss_gen: 2.9263806343078613 (2.7654786507288613) | > loss_kl: 2.922977924346924 (2.635745406150818) | > loss_feat: 3.3209152221679688 (4.936446905136108) | > loss_mel: 29.746105194091797 (23.83786741892497) | > loss_duration: 2.4366652965545654 (2.394384781519572) | > loss_1: 41.35304260253906 (36.569923082987465)  --> STEP: 3 | > loss_disc: 3.21030592918396 (2.703289951596941) | > loss_disc_real_0: 0.6214418411254883 (0.31107690185308456) | > loss_disc_real_1: 0.2915424108505249 (0.3166938935007368) | > loss_disc_real_2: 0.23581300675868988 (0.2711041590997151) | > loss_disc_real_3: 0.2671644985675812 (0.2730418805565153) | > loss_disc_real_4: 0.24465914070606232 (0.2656223380139896) | > loss_disc_real_5: 0.2408190369606018 (0.2816931850143841) | > loss_0: 3.21030592918396 (2.703289951596941) | > loss_gen: 1.902513027191162 (2.642197847366333) | > loss_kl: 1.4798182249069214 (2.470612951687404) | > loss_feat: 0.2761242389678955 (4.270686524254935) | > loss_mel: 23.02553367614746 (23.721819741385325) | > loss_duration: 2.3110692501068115 (2.3824825627463206) | > loss_1: 28.995059967041016 (35.4877997807094) --> EVAL PERFORMANCE | > avg_loader_time: 0.3749803474971226 (+0.3572196733383905) | > avg_loss_disc: 2.703289951596941 (-0.060037170137678064) | > avg_loss_disc_real_0: 0.31107690185308456 (-0.0546976700425148) | > avg_loss_disc_real_1: 0.3166938935007368 (+0.015134077696573156) | > avg_loss_disc_real_2: 0.2711041590997151 (+0.060631366712706414) | > avg_loss_disc_real_3: 0.2730418805565153 (+0.0001943671987170159) | > avg_loss_disc_real_4: 0.2656223380139896 (-0.07236151858454659) | > avg_loss_disc_real_5: 0.2816931850143841 (-0.01754819388900486) | > avg_loss_0: 2.703289951596941 (-0.060037170137678064) | > avg_loss_gen: 2.642197847366333 (+0.0707766215006509) | > avg_loss_kl: 2.470612951687404 (-0.17124109608786453) | > avg_loss_feat: 4.270686524254935 (+0.29936972970054265) | > avg_loss_mel: 23.721819741385325 (+6.503635906037832) | > avg_loss_duration: 2.3824825627463206 (-0.04573111307053335) | > avg_loss_1: 35.4877997807094 (+6.65680962517148)  > EPOCH: 200/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:50:03)   --> TIME: 2023-10-20 01:50:22 -- STEP: 29/50 -- GLOBAL_STEP: 63030 | > loss_disc: 2.626887559890747 (2.3820405211941944) | > loss_disc_real_0: 0.12849003076553345 (0.15298892371356487) | > loss_disc_real_1: 0.30507758259773254 (0.22328282969778981) | > loss_disc_real_2: 0.4003064036369324 (0.23483928537060475) | > loss_disc_real_3: 0.2650372385978699 (0.2507528549638288) | > loss_disc_real_4: 0.2777526378631592 (0.2071590454413973) | > loss_disc_real_5: 0.20306994020938873 (0.21293482711089068) | > loss_0: 2.626887559890747 (2.3820405211941944) | > grad_norm_0: tensor(471.9111, device='cuda:0') (tensor(670.0389, device='cuda:0')) | > loss_gen: 2.4024970531463623 (2.574069684949414) | > loss_kl: 1.259686827659607 (0.9600629590708634) | > loss_feat: 5.475281715393066 (5.792652873771972) | > loss_mel: 24.66501235961914 (23.579837470219054) | > loss_duration: 1.6178431510925293 (1.66895553161358) | > loss_1: 35.42032241821289 (34.57557928151098) | > grad_norm_1: tensor(10260.5264, device='cuda:0') (tensor(20012.5039, device='cuda:0')) | > current_lr_0: 0.0001637441036309126 | > current_lr_1: 0.0001637441036309126 | > step_time: 0.5507 (0.5007984309360899) | > loader_time: 0.0251 (0.013039909560104897)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.1741454601287842 (1.1741454601287842) | > loss_disc_real_0: 0.15423066914081573 (0.15423066914081573) | > loss_disc_real_1: 0.12039509415626526 (0.12039509415626526) | > loss_disc_real_2: 0.105433888733387 (0.105433888733387) | > loss_disc_real_3: 0.12045851349830627 (0.12045851349830627) | > loss_disc_real_4: 0.02660592645406723 (0.02660592645406723) | > loss_disc_real_5: 0.023117030039429665 (0.023117030039429665) | > loss_0: 1.1741454601287842 (1.1741454601287842) | > loss_gen: 3.6335604190826416 (3.6335604190826416) | > loss_kl: 2.634617567062378 (2.634617567062378) | > loss_feat: 12.98971939086914 (12.98971939086914) | > loss_mel: 25.176258087158203 (25.176258087158203) | > loss_duration: 2.224255084991455 (2.224255084991455) | > loss_1: 46.658409118652344 (46.658409118652344)  --> STEP: 1 | > loss_disc: 3.2214243412017822 (3.2214243412017822) | > loss_disc_real_0: 0.3934282958507538 (0.3934282958507538) | > loss_disc_real_1: 0.30233895778656006 (0.30233895778656006) | > loss_disc_real_2: 0.31677135825157166 (0.31677135825157166) | > loss_disc_real_3: 0.36353760957717896 (0.36353760957717896) | > loss_disc_real_4: 0.4953468143939972 (0.4953468143939972) | > loss_disc_real_5: 0.5984892249107361 (0.5984892249107361) | > loss_0: 3.2214243412017822 (3.2214243412017822) | > loss_gen: 3.1740705966949463 (3.1740705966949463) | > loss_kl: 3.178102731704712 (3.178102731704712) | > loss_feat: 3.7699856758117676 (3.7699856758117676) | > loss_mel: 23.067447662353516 (23.067447662353516) | > loss_duration: 2.436539888381958 (2.436539888381958) | > loss_1: 35.62614822387695 (35.62614822387695)  --> STEP: 2 | > loss_disc: 3.0549304485321045 (3.1381773948669434) | > loss_disc_real_0: 0.11451785266399384 (0.2539730742573738) | > loss_disc_real_1: 0.2618201971054077 (0.2820795774459839) | > loss_disc_real_2: 0.22835589945316315 (0.2725636288523674) | > loss_disc_real_3: 0.22951269149780273 (0.29652515053749084) | > loss_disc_real_4: 0.2551961839199066 (0.3752714991569519) | > loss_disc_real_5: 0.24015487730503082 (0.41932205110788345) | > loss_0: 3.0549304485321045 (3.1381773948669434) | > loss_gen: 1.3310436010360718 (2.252557098865509) | > loss_kl: 3.149298906326294 (3.163700819015503) | > loss_feat: 0.006474350579082966 (1.8882300131954253) | > loss_mel: 0.7741826772689819 (11.920815169811249) | > loss_duration: 2.325967788696289 (2.3812538385391235) | > loss_1: 7.586967468261719 (21.606557846069336)  --> STEP: 3 | > loss_disc: 2.7282676696777344 (3.0015408198038735) | > loss_disc_real_0: 0.23264695703983307 (0.24686436851819357) | > loss_disc_real_1: 0.3201272487640381 (0.29476213455200195) | > loss_disc_real_2: 0.20784543454647064 (0.2509908974170685) | > loss_disc_real_3: 0.2784512937068939 (0.29050053159395856) | > loss_disc_real_4: 0.3516576588153839 (0.3674002190430959) | > loss_disc_real_5: 0.3751733899116516 (0.4046058307091395) | > loss_0: 2.7282676696777344 (3.0015408198038735) | > loss_gen: 2.2828094959259033 (2.2626412312189736) | > loss_kl: 1.6464011669158936 (2.6579342683156333) | > loss_feat: 2.0793097019195557 (1.9519232427701354) | > loss_mel: 21.670164108276367 (15.170598149299622) | > loss_duration: 2.3419625759124756 (2.3681567509969077) | > loss_1: 30.020647048950195 (24.41125424702962) --> EVAL PERFORMANCE | > avg_loader_time: 0.016439278920491535 (-0.3585410685766311) | > avg_loss_disc: 3.0015408198038735 (+0.2982508682069325) | > avg_loss_disc_real_0: 0.24686436851819357 (-0.06421253333489099) | > avg_loss_disc_real_1: 0.29476213455200195 (-0.021931758948734836) | > avg_loss_disc_real_2: 0.2509908974170685 (-0.0201132616826466) | > avg_loss_disc_real_3: 0.29050053159395856 (+0.017458651037443262) | > avg_loss_disc_real_4: 0.3674002190430959 (+0.10177788102910629) | > avg_loss_disc_real_5: 0.4046058307091395 (+0.1229126456947554) | > avg_loss_0: 3.0015408198038735 (+0.2982508682069325) | > avg_loss_gen: 2.2626412312189736 (-0.37955661614735936) | > avg_loss_kl: 2.6579342683156333 (+0.18732131662822926) | > avg_loss_feat: 1.9519232427701354 (-2.3187632814847996) | > avg_loss_mel: 15.170598149299622 (-8.551221592085703) | > avg_loss_duration: 2.3681567509969077 (-0.014325811749412942) | > avg_loss_1: 24.41125424702962 (-11.07654553367978)  > EPOCH: 201/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:50:43)   --> TIME: 2023-10-20 01:50:51 -- STEP: 9/50 -- GLOBAL_STEP: 63060 | > loss_disc: 2.56056547164917 (2.4173536830478244) | > loss_disc_real_0: 0.11711008846759796 (0.15426922879285282) | > loss_disc_real_1: 0.18375839293003082 (0.1919607768456141) | > loss_disc_real_2: 0.21512144804000854 (0.19717100262641907) | > loss_disc_real_3: 0.28910377621650696 (0.2328779155181514) | > loss_disc_real_4: 0.1234203577041626 (0.2012065113004711) | > loss_disc_real_5: 0.22319456934928894 (0.2201778261611859) | > loss_0: 2.56056547164917 (2.4173536830478244) | > grad_norm_0: tensor(566.7627, device='cuda:0') (tensor(519.0145, device='cuda:0')) | > loss_gen: 1.906423807144165 (2.4779892100228205) | > loss_kl: 1.329270601272583 (1.0331819785965815) | > loss_feat: 3.110128879547119 (6.646872679392497) | > loss_mel: 15.987981796264648 (25.071716096666123) | > loss_duration: 1.622341275215149 (1.6465504434373643) | > loss_1: 23.956146240234375 (36.87631034851074) | > grad_norm_1: tensor(20299.0996, device='cuda:0') (tensor(23756.6836, device='cuda:0')) | > current_lr_0: 0.00016358043114742026 | > current_lr_1: 0.00016358043114742026 | > step_time: 0.3891 (0.47202380498250324) | > loader_time: 0.0035 (0.01608088281419542)  --> TIME: 2023-10-20 01:51:04 -- STEP: 39/50 -- GLOBAL_STEP: 63090 | > loss_disc: 1.4434185028076172 (2.348072675558237) | > loss_disc_real_0: 0.07826186716556549 (0.15200602635741234) | > loss_disc_real_1: 0.3541295826435089 (0.22183733309308687) | > loss_disc_real_2: 0.1742534637451172 (0.20672289797892937) | > loss_disc_real_3: 0.15693987905979156 (0.23390909570914054) | > loss_disc_real_4: 0.04257822036743164 (0.20369986475755772) | > loss_disc_real_5: 0.06163550913333893 (0.21320468072707838) | > loss_0: 1.4434185028076172 (2.348072675558237) | > grad_norm_0: tensor(300.2404, device='cuda:0') (tensor(572.2097, device='cuda:0')) | > loss_gen: 3.356870651245117 (2.4826311973425064) | > loss_kl: 0.4125792682170868 (1.0621303083040776) | > loss_feat: 8.323576927185059 (5.67665794950265) | > loss_mel: 28.860675811767578 (23.413321510339394) | > loss_duration: 1.697367548942566 (1.6638727768873558) | > loss_1: 42.65107345581055 (34.29861378058409) | > grad_norm_1: tensor(19137.7734, device='cuda:0') (tensor(20406.1836, device='cuda:0')) | > current_lr_0: 0.00016358043114742026 | > current_lr_1: 0.00016358043114742026 | > step_time: 0.674 (0.4312647183736165) | > loader_time: 0.022 (0.01049390205970177)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0995569229125977 (2.0995569229125977) | > loss_disc_real_0: 0.03827299550175667 (0.03827299550175667) | > loss_disc_real_1: 0.1482762098312378 (0.1482762098312378) | > loss_disc_real_2: 0.2341233491897583 (0.2341233491897583) | > loss_disc_real_3: 0.3559395968914032 (0.3559395968914032) | > loss_disc_real_4: 0.19219902157783508 (0.19219902157783508) | > loss_disc_real_5: 0.16266146302223206 (0.16266146302223206) | > loss_0: 2.0995569229125977 (2.0995569229125977) | > loss_gen: 2.562213182449341 (2.562213182449341) | > loss_kl: 2.3647348880767822 (2.3647348880767822) | > loss_feat: 5.233745098114014 (5.233745098114014) | > loss_mel: 27.731090545654297 (27.731090545654297) | > loss_duration: 2.2101192474365234 (2.2101192474365234) | > loss_1: 40.101905822753906 (40.101905822753906)  --> STEP: 1 | > loss_disc: 2.486745595932007 (2.486745595932007) | > loss_disc_real_0: 0.1400148570537567 (0.1400148570537567) | > loss_disc_real_1: 0.1745389699935913 (0.1745389699935913) | > loss_disc_real_2: 0.2539821267127991 (0.2539821267127991) | > loss_disc_real_3: 0.22249668836593628 (0.22249668836593628) | > loss_disc_real_4: 0.2442757785320282 (0.2442757785320282) | > loss_disc_real_5: 0.19160082936286926 (0.19160082936286926) | > loss_0: 2.486745595932007 (2.486745595932007) | > loss_gen: 2.372704267501831 (2.372704267501831) | > loss_kl: 2.7009437084198 (2.7009437084198) | > loss_feat: 6.140488624572754 (6.140488624572754) | > loss_mel: 23.594411849975586 (23.594411849975586) | > loss_duration: 2.4912068843841553 (2.4912068843841553) | > loss_1: 37.29975509643555 (37.29975509643555)  --> STEP: 2 | > loss_disc: 2.957944631576538 (2.7223451137542725) | > loss_disc_real_0: 0.1739782989025116 (0.15699657797813416) | > loss_disc_real_1: 0.20173349976539612 (0.1881362348794937) | > loss_disc_real_2: 0.1732822209596634 (0.21363217383623123) | > loss_disc_real_3: 0.28932568430900574 (0.255911186337471) | > loss_disc_real_4: 0.2920657992362976 (0.2681707888841629) | > loss_disc_real_5: 0.21210666000843048 (0.20185374468564987) | > loss_0: 2.957944631576538 (2.7223451137542725) | > loss_gen: 1.4335793256759644 (1.9031417965888977) | > loss_kl: 3.7679035663604736 (3.2344236373901367) | > loss_feat: 0.8921408653259277 (3.516314744949341) | > loss_mel: 15.358233451843262 (19.476322650909424) | > loss_duration: 2.393324136734009 (2.442265510559082) | > loss_1: 23.84518051147461 (30.572467803955078)  --> STEP: 3 | > loss_disc: 2.853740930557251 (2.766143719355265) | > loss_disc_real_0: 0.15938276052474976 (0.15779197216033936) | > loss_disc_real_1: 0.20637737214565277 (0.1942166139682134) | > loss_disc_real_2: 0.1927739977836609 (0.20667944848537445) | > loss_disc_real_3: 0.29710230231285095 (0.26964155832926434) | > loss_disc_real_4: 0.28193148970603943 (0.27275768915812176) | > loss_disc_real_5: 0.26016977429389954 (0.2212924212217331) | > loss_0: 2.853740930557251 (2.766143719355265) | > loss_gen: 1.6075495481491089 (1.804611047108968) | > loss_kl: 1.46377694606781 (2.644208073616028) | > loss_feat: 0.8103634119033813 (2.6143309672673545) | > loss_mel: 18.08382797241211 (19.012157758076984) | > loss_duration: 2.3310434818267822 (2.405191500981649) | > loss_1: 24.296560287475586 (28.480498631795246) --> EVAL PERFORMANCE | > avg_loader_time: 0.020234187444051106 (+0.0037949085235595703) | > avg_loss_disc: 2.766143719355265 (-0.2353971004486084) | > avg_loss_disc_real_0: 0.15779197216033936 (-0.08907239635785422) | > avg_loss_disc_real_1: 0.1942166139682134 (-0.10054552058378854) | > avg_loss_disc_real_2: 0.20667944848537445 (-0.04431144893169403) | > avg_loss_disc_real_3: 0.26964155832926434 (-0.020858973264694214) | > avg_loss_disc_real_4: 0.27275768915812176 (-0.09464252988497412) | > avg_loss_disc_real_5: 0.2212924212217331 (-0.18331340948740643) | > avg_loss_0: 2.766143719355265 (-0.2353971004486084) | > avg_loss_gen: 1.804611047108968 (-0.4580301841100056) | > avg_loss_kl: 2.644208073616028 (-0.013726194699605454) | > avg_loss_feat: 2.6143309672673545 (+0.6624077244972191) | > avg_loss_mel: 19.012157758076984 (+3.841559608777363) | > avg_loss_duration: 2.405191500981649 (+0.03703474998474121) | > avg_loss_1: 28.480498631795246 (+4.069244384765625)  > EPOCH: 202/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:51:19)   --> TIME: 2023-10-20 01:51:32 -- STEP: 19/50 -- GLOBAL_STEP: 63120 | > loss_disc: 1.5470905303955078 (2.291885699096479) | > loss_disc_real_0: 0.1266363114118576 (0.14951716030114576) | > loss_disc_real_1: 0.23236556351184845 (0.2280053214022988) | > loss_disc_real_2: 0.16710786521434784 (0.21816899392165637) | > loss_disc_real_3: 0.23302528262138367 (0.22060877099437148) | > loss_disc_real_4: 0.12833090126514435 (0.1837112325194635) | > loss_disc_real_5: 0.04982009902596474 (0.19424095651821086) | > loss_0: 1.5470905303955078 (2.291885699096479) | > grad_norm_0: tensor(405.0011, device='cuda:0') (tensor(468.5406, device='cuda:0')) | > loss_gen: 3.386492967605591 (2.5239024036809017) | > loss_kl: 0.9300174117088318 (0.9614047408103943) | > loss_feat: 7.7733659744262695 (5.952310986424747) | > loss_mel: 29.68075942993164 (22.112672968914634) | > loss_duration: 1.7753757238388062 (1.6957972363421792) | > loss_1: 43.54601287841797 (33.24608840440449) | > grad_norm_1: tensor(15385.3799, device='cuda:0') (tensor(24025.2852, device='cuda:0')) | > current_lr_0: 0.00016341692226482259 | > current_lr_1: 0.00016341692226482259 | > step_time: 0.2938 (0.4839049389487819) | > loader_time: 0.0231 (0.02069006468120374)  --> TIME: 2023-10-20 01:51:49 -- STEP: 49/50 -- GLOBAL_STEP: 63150 | > loss_disc: 2.726001024246216 (2.439157200102903) | > loss_disc_real_0: 0.33920198678970337 (0.15033188461307057) | > loss_disc_real_1: 0.27469557523727417 (0.22922290561302583) | > loss_disc_real_2: 0.2642649710178375 (0.2370968005258818) | > loss_disc_real_3: 0.3341655433177948 (0.24353948286829555) | > loss_disc_real_4: 0.21448354423046112 (0.21049235966436716) | > loss_disc_real_5: 0.1496165543794632 (0.21758436938101539) | > loss_0: 2.726001024246216 (2.439157200102903) | > grad_norm_0: tensor(1692.2145, device='cuda:0') (tensor(523.9698, device='cuda:0')) | > loss_gen: 2.3267412185668945 (2.3703276575828087) | > loss_kl: 0.7806214690208435 (0.9727625737384874) | > loss_feat: 2.0575878620147705 (5.092118489860121) | > loss_mel: 23.916542053222656 (21.891488026599493) | > loss_duration: 1.7758476734161377 (1.6498714563797932) | > loss_1: 30.857341766357422 (31.97656823177726) | > grad_norm_1: tensor(9442.0947, device='cuda:0') (tensor(20942.9121, device='cuda:0')) | > current_lr_0: 0.00016341692226482259 | > current_lr_1: 0.00016341692226482259 | > step_time: 0.5848 (0.4953166319399464) | > loader_time: 0.3463 (0.02612320257692921)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0692245960235596 (3.0692245960235596) | > loss_disc_real_0: 0.34850841760635376 (0.34850841760635376) | > loss_disc_real_1: 0.31085968017578125 (0.31085968017578125) | > loss_disc_real_2: 0.3334213197231293 (0.3334213197231293) | > loss_disc_real_3: 0.4316997528076172 (0.4316997528076172) | > loss_disc_real_4: 0.24564020335674286 (0.24564020335674286) | > loss_disc_real_5: 0.2778727412223816 (0.2778727412223816) | > loss_0: 3.0692245960235596 (3.0692245960235596) | > loss_gen: 2.74208402633667 (2.74208402633667) | > loss_kl: 2.6598825454711914 (2.6598825454711914) | > loss_feat: 4.4706711769104 (4.4706711769104) | > loss_mel: 24.943105697631836 (24.943105697631836) | > loss_duration: 2.1908528804779053 (2.1908528804779053) | > loss_1: 37.006595611572266 (37.006595611572266)  --> STEP: 1 | > loss_disc: 2.3204972743988037 (2.3204972743988037) | > loss_disc_real_0: 0.31000953912734985 (0.31000953912734985) | > loss_disc_real_1: 0.22024193406105042 (0.22024193406105042) | > loss_disc_real_2: 0.2671062648296356 (0.2671062648296356) | > loss_disc_real_3: 0.3784923255443573 (0.3784923255443573) | > loss_disc_real_4: 0.24655693769454956 (0.24655693769454956) | > loss_disc_real_5: 0.17404188215732574 (0.17404188215732574) | > loss_0: 2.3204972743988037 (2.3204972743988037) | > loss_gen: 3.5272104740142822 (3.5272104740142822) | > loss_kl: 3.035306692123413 (3.035306692123413) | > loss_feat: 6.54590368270874 (6.54590368270874) | > loss_mel: 27.184877395629883 (27.184877395629883) | > loss_duration: 2.3239574432373047 (2.3239574432373047) | > loss_1: 42.61725616455078 (42.61725616455078)  --> STEP: 2 | > loss_disc: 1.7538135051727295 (2.0371553897857666) | > loss_disc_real_0: 0.09249934554100037 (0.2012544423341751) | > loss_disc_real_1: 0.09789802134037018 (0.1590699777007103) | > loss_disc_real_2: 0.04157416522502899 (0.1543402150273323) | > loss_disc_real_3: 0.35279178619384766 (0.3656420558691025) | > loss_disc_real_4: 0.02930423803627491 (0.13793058786541224) | > loss_disc_real_5: 0.06312250345945358 (0.11858219280838966) | > loss_0: 1.7538135051727295 (2.0371553897857666) | > loss_gen: 2.4699270725250244 (2.9985687732696533) | > loss_kl: 3.570185661315918 (3.3027461767196655) | > loss_feat: 12.220959663391113 (9.383431673049927) | > loss_mel: 28.688737869262695 (27.93680763244629) | > loss_duration: 2.3055880069732666 (2.3147727251052856) | > loss_1: 49.25539779663086 (45.93632698059082)  --> STEP: 3 | > loss_disc: 4.296917915344238 (2.790409564971924) | > loss_disc_real_0: 0.6949560642242432 (0.36582164963086444) | > loss_disc_real_1: 0.3445787727832794 (0.22090624272823334) | > loss_disc_real_2: 0.5380052328109741 (0.28222855428854626) | > loss_disc_real_3: 0.5332300066947937 (0.4215047061443329) | > loss_disc_real_4: 0.5990275740623474 (0.29162958326439065) | > loss_disc_real_5: 0.3404446244239807 (0.19253633668025336) | > loss_0: 4.296917915344238 (2.790409564971924) | > loss_gen: 3.189940929412842 (3.0623594919840493) | > loss_kl: 1.3544762134552002 (2.6533228556315103) | > loss_feat: 5.305465221405029 (8.024109522501627) | > loss_mel: 28.498733520507812 (28.12411626180013) | > loss_duration: 2.2620699405670166 (2.297205130259196) | > loss_1: 40.610687255859375 (44.16111373901367) --> EVAL PERFORMANCE | > avg_loader_time: 0.002768357594807943 (-0.017465829849243164) | > avg_loss_disc: 2.790409564971924 (+0.024265845616658677) | > avg_loss_disc_real_0: 0.36582164963086444 (+0.2080296774705251) | > avg_loss_disc_real_1: 0.22090624272823334 (+0.02668962876001993) | > avg_loss_disc_real_2: 0.28222855428854626 (+0.07554910580317181) | > avg_loss_disc_real_3: 0.4215047061443329 (+0.15186314781506854) | > avg_loss_disc_real_4: 0.29162958326439065 (+0.018871894106268883) | > avg_loss_disc_real_5: 0.19253633668025336 (-0.028756084541479737) | > avg_loss_0: 2.790409564971924 (+0.024265845616658677) | > avg_loss_gen: 3.0623594919840493 (+1.2577484448750813) | > avg_loss_kl: 2.6533228556315103 (+0.009114782015482437) | > avg_loss_feat: 8.024109522501627 (+5.409778555234272) | > avg_loss_mel: 28.12411626180013 (+9.111958503723145) | > avg_loss_duration: 2.297205130259196 (-0.1079863707224531) | > avg_loss_1: 44.16111373901367 (+15.680615107218426)  > EPOCH: 203/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:51:59)   --> TIME: 2023-10-20 01:52:17 -- STEP: 29/50 -- GLOBAL_STEP: 63180 | > loss_disc: 2.3899872303009033 (2.5704915934595567) | > loss_disc_real_0: 0.27010810375213623 (0.1844366706329687) | > loss_disc_real_1: 0.17980220913887024 (0.23611076638616357) | > loss_disc_real_2: 0.08013110607862473 (0.2405285252065494) | > loss_disc_real_3: 0.28005921840667725 (0.2698119239046655) | > loss_disc_real_4: 0.12200747430324554 (0.2315593009878849) | > loss_disc_real_5: 0.21204960346221924 (0.22984898250935407) | > loss_0: 2.3899872303009033 (2.5704915934595567) | > grad_norm_0: tensor(489.5980, device='cuda:0') (tensor(714.8464, device='cuda:0')) | > loss_gen: 2.01488995552063 (2.447654345939899) | > loss_kl: 0.6908464431762695 (1.0128604112000303) | > loss_feat: 3.127120018005371 (5.605599012868158) | > loss_mel: 26.45379066467285 (26.224783272578797) | > loss_duration: 1.6552183628082275 (1.7049824821537938) | > loss_1: 33.94186782836914 (36.99587930482011) | > grad_norm_1: tensor(5294.6108, device='cuda:0') (tensor(19246.0547, device='cuda:0')) | > current_lr_0: 0.0001632535768195903 | > current_lr_1: 0.0001632535768195903 | > step_time: 0.5975 (0.46759147479616364) | > loader_time: 0.0246 (0.016772368858600485)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6638028621673584 (2.6638028621673584) | > loss_disc_real_0: 0.2645978331565857 (0.2645978331565857) | > loss_disc_real_1: 0.3260842561721802 (0.3260842561721802) | > loss_disc_real_2: 0.31939834356307983 (0.31939834356307983) | > loss_disc_real_3: 0.39807963371276855 (0.39807963371276855) | > loss_disc_real_4: 0.27259472012519836 (0.27259472012519836) | > loss_disc_real_5: 0.23381145298480988 (0.23381145298480988) | > loss_0: 2.6638028621673584 (2.6638028621673584) | > loss_gen: 2.703615427017212 (2.703615427017212) | > loss_kl: 2.3235931396484375 (2.3235931396484375) | > loss_feat: 4.074490547180176 (4.074490547180176) | > loss_mel: 23.49186134338379 (23.49186134338379) | > loss_duration: 2.232611894607544 (2.232611894607544) | > loss_1: 34.826175689697266 (34.826175689697266)  --> STEP: 1 | > loss_disc: 1.9159517288208008 (1.9159517288208008) | > loss_disc_real_0: 0.16994699835777283 (0.16994699835777283) | > loss_disc_real_1: 0.2579025626182556 (0.2579025626182556) | > loss_disc_real_2: 0.1651545614004135 (0.1651545614004135) | > loss_disc_real_3: 0.27439555525779724 (0.27439555525779724) | > loss_disc_real_4: 0.1454368233680725 (0.1454368233680725) | > loss_disc_real_5: 0.05232850834727287 (0.05232850834727287) | > loss_0: 1.9159517288208008 (1.9159517288208008) | > loss_gen: 2.854255199432373 (2.854255199432373) | > loss_kl: 3.0256898403167725 (3.0256898403167725) | > loss_feat: 7.256131649017334 (7.256131649017334) | > loss_mel: 22.951969146728516 (22.951969146728516) | > loss_duration: 2.5365469455718994 (2.5365469455718994) | > loss_1: 38.624595642089844 (38.624595642089844)  --> STEP: 2 | > loss_disc: 2.3487792015075684 (2.1323654651641846) | > loss_disc_real_0: 0.7879795432090759 (0.4789632707834244) | > loss_disc_real_1: 0.3146476149559021 (0.28627508878707886) | > loss_disc_real_2: 0.21435080468654633 (0.18975268304347992) | > loss_disc_real_3: 0.24988484382629395 (0.2621401995420456) | > loss_disc_real_4: 0.25607946515083313 (0.20075814425945282) | > loss_disc_real_5: 0.15206961333751678 (0.10219906084239483) | > loss_0: 2.3487792015075684 (2.1323654651641846) | > loss_gen: 4.47655725479126 (3.6654062271118164) | > loss_kl: 3.5600197315216064 (3.2928547859191895) | > loss_feat: 8.483133316040039 (7.8696324825286865) | > loss_mel: 29.884504318237305 (26.41823673248291) | > loss_duration: 2.345457077026367 (2.4410020112991333) | > loss_1: 48.749671936035156 (43.6871337890625)  --> STEP: 3 | > loss_disc: 2.513976573944092 (2.2595691680908203) | > loss_disc_real_0: 0.10434819757938385 (0.3540915797154109) | > loss_disc_real_1: 0.2500479519367218 (0.2741993765036265) | > loss_disc_real_2: 0.3105049729347229 (0.2300034463405609) | > loss_disc_real_3: 0.21026550233364105 (0.24484863380591074) | > loss_disc_real_4: 0.3164379298686981 (0.23931807279586792) | > loss_disc_real_5: 0.4171496033668518 (0.20718257501721382) | > loss_0: 2.513976573944092 (2.2595691680908203) | > loss_gen: 2.460949182510376 (3.263920545578003) | > loss_kl: 1.3330179452896118 (2.6395758390426636) | > loss_feat: 3.3030576705932617 (6.347440878550212) | > loss_mel: 28.058330535888672 (26.964934666951496) | > loss_duration: 2.3495101928710938 (2.4105047384897866) | > loss_1: 37.50486373901367 (41.62637710571289) --> EVAL PERFORMANCE | > avg_loader_time: 0.00640098253885905 (+0.003632624944051107) | > avg_loss_disc: 2.2595691680908203 (-0.5308403968811035) | > avg_loss_disc_real_0: 0.3540915797154109 (-0.011730069915453556) | > avg_loss_disc_real_1: 0.2741993765036265 (+0.05329313377539319) | > avg_loss_disc_real_2: 0.2300034463405609 (-0.05222510794798535) | > avg_loss_disc_real_3: 0.24484863380591074 (-0.17665607233842215) | > avg_loss_disc_real_4: 0.23931807279586792 (-0.052311510468522726) | > avg_loss_disc_real_5: 0.20718257501721382 (+0.014646238336960465) | > avg_loss_0: 2.2595691680908203 (-0.5308403968811035) | > avg_loss_gen: 3.263920545578003 (+0.2015610535939536) | > avg_loss_kl: 2.6395758390426636 (-0.013747016588846694) | > avg_loss_feat: 6.347440878550212 (-1.6766686439514151) | > avg_loss_mel: 26.964934666951496 (-1.1591815948486328) | > avg_loss_duration: 2.4105047384897866 (+0.11329960823059082) | > avg_loss_1: 41.62637710571289 (-2.5347366333007812)  > EPOCH: 204/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:52:38)   --> TIME: 2023-10-20 01:52:47 -- STEP: 9/50 -- GLOBAL_STEP: 63210 | > loss_disc: 2.4701030254364014 (2.707251297103034) | > loss_disc_real_0: 0.10211112350225449 (0.16149530104464954) | > loss_disc_real_1: 0.2769695222377777 (0.252492268052366) | > loss_disc_real_2: 0.24569085240364075 (0.27018309467368656) | > loss_disc_real_3: 0.4077964127063751 (0.2584509129325549) | > loss_disc_real_4: 0.31403809785842896 (0.29380981789694893) | > loss_disc_real_5: 0.19131098687648773 (0.23409504857328203) | > loss_0: 2.4701030254364014 (2.707251297103034) | > grad_norm_0: tensor(430.7255, device='cuda:0') (tensor(886.5606, device='cuda:0')) | > loss_gen: 2.475924015045166 (2.247435530026754) | > loss_kl: 1.0763055086135864 (1.00795003440645) | > loss_feat: 4.412297248840332 (4.494008176856571) | > loss_mel: 24.416316986083984 (21.026470104853313) | > loss_duration: 1.6125195026397705 (1.6987791591220431) | > loss_1: 33.99336242675781 (30.47464312447442) | > grad_norm_1: tensor(2249.1748, device='cuda:0') (tensor(12100.3828, device='cuda:0')) | > current_lr_0: 0.0001630903946483574 | > current_lr_1: 0.0001630903946483574 | > step_time: 0.6493 (0.5183934105767144) | > loader_time: 0.0069 (0.018978145387437608)  --> TIME: 2023-10-20 01:52:59 -- STEP: 39/50 -- GLOBAL_STEP: 63240 | > loss_disc: 1.6579047441482544 (2.3731549825423803) | > loss_disc_real_0: 0.07436962425708771 (0.16064304519349185) | > loss_disc_real_1: 0.21973462402820587 (0.2201163805066011) | > loss_disc_real_2: 0.051145248115062714 (0.21414495546084183) | > loss_disc_real_3: 0.2172606885433197 (0.22906208229370606) | > loss_disc_real_4: 0.13452602922916412 (0.23614995195888555) | > loss_disc_real_5: 0.24364127218723297 (0.2148369628792772) | > loss_0: 1.6579047441482544 (2.3731549825423803) | > grad_norm_0: tensor(585.7081, device='cuda:0') (tensor(577.5444, device='cuda:0')) | > loss_gen: 2.8987021446228027 (2.4183801993345604) | > loss_kl: 0.376020222902298 (0.9969177910914789) | > loss_feat: 6.341923236846924 (5.449964229113016) | > loss_mel: 24.095699310302734 (24.003352538133278) | > loss_duration: 1.6940680742263794 (1.672821689874698) | > loss_1: 35.40641403198242 (34.54143647658519) | > grad_norm_1: tensor(19988.7422, device='cuda:0') (tensor(18360.9551, device='cuda:0')) | > current_lr_0: 0.0001630903946483574 | > current_lr_1: 0.0001630903946483574 | > step_time: 0.705 (0.4201873143513997) | > loader_time: 0.022 (0.010894567538530398)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.945507049560547 (2.945507049560547) | > loss_disc_real_0: 0.1380586326122284 (0.1380586326122284) | > loss_disc_real_1: 0.2167309820652008 (0.2167309820652008) | > loss_disc_real_2: 0.24217404425144196 (0.24217404425144196) | > loss_disc_real_3: 0.2173885554075241 (0.2173885554075241) | > loss_disc_real_4: 0.2960287928581238 (0.2960287928581238) | > loss_disc_real_5: 0.3262750804424286 (0.3262750804424286) | > loss_0: 2.945507049560547 (2.945507049560547) | > loss_gen: 1.9051787853240967 (1.9051787853240967) | > loss_kl: 3.9907619953155518 (3.9907619953155518) | > loss_feat: 5.728643417358398 (5.728643417358398) | > loss_mel: 26.84339141845703 (26.84339141845703) | > loss_duration: 2.304628849029541 (2.304628849029541) | > loss_1: 40.772605895996094 (40.772605895996094)  --> STEP: 1 | > loss_disc: 2.909067392349243 (2.909067392349243) | > loss_disc_real_0: 0.39268556237220764 (0.39268556237220764) | > loss_disc_real_1: 0.30687856674194336 (0.30687856674194336) | > loss_disc_real_2: 0.21921135485172272 (0.21921135485172272) | > loss_disc_real_3: 0.2706163823604584 (0.2706163823604584) | > loss_disc_real_4: 0.2485092729330063 (0.2485092729330063) | > loss_disc_real_5: 0.3604152202606201 (0.3604152202606201) | > loss_0: 2.909067392349243 (2.909067392349243) | > loss_gen: 2.1358859539031982 (2.1358859539031982) | > loss_kl: 3.47622013092041 (3.47622013092041) | > loss_feat: 1.0753523111343384 (1.0753523111343384) | > loss_mel: 24.681434631347656 (24.681434631347656) | > loss_duration: 2.5048303604125977 (2.5048303604125977) | > loss_1: 33.873722076416016 (33.873722076416016)  --> STEP: 2 | > loss_disc: 3.183960437774658 (3.0465139150619507) | > loss_disc_real_0: 0.39868253469467163 (0.39568404853343964) | > loss_disc_real_1: 0.27003607153892517 (0.28845731914043427) | > loss_disc_real_2: 0.23753397166728973 (0.22837266325950623) | > loss_disc_real_3: 0.2757265269756317 (0.27317145466804504) | > loss_disc_real_4: 0.24752190709114075 (0.24801559001207352) | > loss_disc_real_5: 0.31962287425994873 (0.3400190472602844) | > loss_0: 3.183960437774658 (3.0465139150619507) | > loss_gen: 1.6619218587875366 (1.8989039063453674) | > loss_kl: 3.189080238342285 (3.3326501846313477) | > loss_feat: 1.0241773128509521 (1.0497648119926453) | > loss_mel: 28.534433364868164 (26.60793399810791) | > loss_duration: 2.3945465087890625 (2.44968843460083) | > loss_1: 36.804161071777344 (35.33894157409668)  --> STEP: 3 | > loss_disc: 2.80657958984375 (2.966535806655884) | > loss_disc_real_0: 0.12792281806468964 (0.3064303050438563) | > loss_disc_real_1: 0.1699889749288559 (0.24896787106990814) | > loss_disc_real_2: 0.22942596673965454 (0.22872376441955566) | > loss_disc_real_3: 0.3004356920719147 (0.28225953380266827) | > loss_disc_real_4: 0.3186495900154114 (0.2715602566798528) | > loss_disc_real_5: 0.44422411918640137 (0.37475407123565674) | > loss_0: 2.80657958984375 (2.966535806655884) | > loss_gen: 2.0034961700439453 (1.9337679942448933) | > loss_kl: 1.6945244073867798 (2.786608258883158) | > loss_feat: 4.102557182312012 (2.0673622687657676) | > loss_mel: 25.798768997192383 (26.338212331136067) | > loss_duration: 2.269270181655884 (2.3895490169525146) | > loss_1: 35.86861801147461 (35.51550038655599) --> EVAL PERFORMANCE | > avg_loader_time: 0.006592988967895508 (+0.00019200642903645804) | > avg_loss_disc: 2.966535806655884 (+0.7069666385650635) | > avg_loss_disc_real_0: 0.3064303050438563 (-0.047661274671554565) | > avg_loss_disc_real_1: 0.24896787106990814 (-0.025231505433718382) | > avg_loss_disc_real_2: 0.22872376441955566 (-0.001279681921005249) | > avg_loss_disc_real_3: 0.28225953380266827 (+0.037410899996757535) | > avg_loss_disc_real_4: 0.2715602566798528 (+0.032242183883984865) | > avg_loss_disc_real_5: 0.37475407123565674 (+0.16757149621844292) | > avg_loss_0: 2.966535806655884 (+0.7069666385650635) | > avg_loss_gen: 1.9337679942448933 (-1.3301525513331096) | > avg_loss_kl: 2.786608258883158 (+0.14703241984049464) | > avg_loss_feat: 2.0673622687657676 (-4.280078609784445) | > avg_loss_mel: 26.338212331136067 (-0.6267223358154297) | > avg_loss_duration: 2.3895490169525146 (-0.020955721537271987) | > avg_loss_1: 35.51550038655599 (-6.110876719156899)  > EPOCH: 205/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:53:15)   --> TIME: 2023-10-20 01:53:30 -- STEP: 19/50 -- GLOBAL_STEP: 63270 | > loss_disc: 1.9659863710403442 (2.407456586235448) | > loss_disc_real_0: 0.06815023720264435 (0.17327082735535349) | > loss_disc_real_1: 0.21063371002674103 (0.24045230134537346) | > loss_disc_real_2: 0.26193833351135254 (0.2399452465929483) | > loss_disc_real_3: 0.2171589583158493 (0.2268350253763952) | > loss_disc_real_4: 0.10228147357702255 (0.1865018446390566) | > loss_disc_real_5: 0.10633815079927444 (0.1778669034768092) | > loss_0: 1.9659863710403442 (2.407456586235448) | > grad_norm_0: tensor(369.2198, device='cuda:0') (tensor(637.2772, device='cuda:0')) | > loss_gen: 2.7254676818847656 (2.371697739550942) | > loss_kl: 1.1912364959716797 (1.0526556153046458) | > loss_feat: 6.628027439117432 (5.258129566123611) | > loss_mel: 21.796634674072266 (22.98437255307248) | > loss_duration: 1.8398487567901611 (1.7381174438878109) | > loss_1: 34.18121337890625 (33.40497328105726) | > grad_norm_1: tensor(16022.4072, device='cuda:0') (tensor(23759.4961, device='cuda:0')) | > current_lr_0: 0.00016292737558792146 | > current_lr_1: 0.00016292737558792146 | > step_time: 0.5717 (0.4975396582954808) | > loader_time: 0.0223 (0.01970430424338893)  --> TIME: 2023-10-20 01:53:46 -- STEP: 49/50 -- GLOBAL_STEP: 63300 | > loss_disc: 2.5856568813323975 (2.503818348962434) | > loss_disc_real_0: 0.172596275806427 (0.16630325006435112) | > loss_disc_real_1: 0.344524085521698 (0.2271979857920384) | > loss_disc_real_2: 0.24284662306308746 (0.23604395111300508) | > loss_disc_real_3: 0.23268403112888336 (0.2286155283146975) | > loss_disc_real_4: 0.2789086401462555 (0.23008122743696582) | > loss_disc_real_5: 0.2892312705516815 (0.21348869308297122) | > loss_0: 2.5856568813323975 (2.503818348962434) | > grad_norm_0: tensor(320.2198, device='cuda:0') (tensor(486.1201, device='cuda:0')) | > loss_gen: 2.3569581508636475 (2.316405233071775) | > loss_kl: 0.6241757273674011 (0.8982296573872467) | > loss_feat: 3.233656883239746 (4.959424998535185) | > loss_mel: 22.593276977539062 (21.940662155345994) | > loss_duration: 1.7690292596817017 (1.6856448528717973) | > loss_1: 30.577096939086914 (31.800366966091858) | > grad_norm_1: tensor(6896.8745, device='cuda:0') (tensor(19186.9023, device='cuda:0')) | > current_lr_0: 0.00016292737558792146 | > current_lr_1: 0.00016292737558792146 | > step_time: 0.3207 (0.49559475937668157) | > loader_time: 0.4639 (0.029755339330556435)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.174100160598755 (3.174100160598755) | > loss_disc_real_0: 0.17721541225910187 (0.17721541225910187) | > loss_disc_real_1: 0.3118339478969574 (0.3118339478969574) | > loss_disc_real_2: 0.40259402990341187 (0.40259402990341187) | > loss_disc_real_3: 0.1556953638792038 (0.1556953638792038) | > loss_disc_real_4: 0.47144854068756104 (0.47144854068756104) | > loss_disc_real_5: 0.343514621257782 (0.343514621257782) | > loss_0: 3.174100160598755 (3.174100160598755) | > loss_gen: 2.050595998764038 (2.050595998764038) | > loss_kl: 2.4409091472625732 (2.4409091472625732) | > loss_feat: 5.551440715789795 (5.551440715789795) | > loss_mel: 23.839374542236328 (23.839374542236328) | > loss_duration: 2.2168209552764893 (2.2168209552764893) | > loss_1: 36.09914016723633 (36.09914016723633)  --> STEP: 1 | > loss_disc: 2.8519632816314697 (2.8519632816314697) | > loss_disc_real_0: 0.23792853951454163 (0.23792853951454163) | > loss_disc_real_1: 0.4081004858016968 (0.4081004858016968) | > loss_disc_real_2: 0.2561720311641693 (0.2561720311641693) | > loss_disc_real_3: 0.2651072144508362 (0.2651072144508362) | > loss_disc_real_4: 0.33531537652015686 (0.33531537652015686) | > loss_disc_real_5: 0.35343238711357117 (0.35343238711357117) | > loss_0: 2.8519632816314697 (2.8519632816314697) | > loss_gen: 2.528716802597046 (2.528716802597046) | > loss_kl: 3.082409620285034 (3.082409620285034) | > loss_feat: 2.4806625843048096 (2.4806625843048096) | > loss_mel: 21.094093322753906 (21.094093322753906) | > loss_duration: 2.407153606414795 (2.407153606414795) | > loss_1: 31.593036651611328 (31.593036651611328)  --> STEP: 2 | > loss_disc: 2.95613431930542 (2.904048800468445) | > loss_disc_real_0: 0.28593748807907104 (0.26193301379680634) | > loss_disc_real_1: 0.30891019105911255 (0.35850533843040466) | > loss_disc_real_2: 0.2856045365333557 (0.2708882838487625) | > loss_disc_real_3: 0.2960208058357239 (0.28056401014328003) | > loss_disc_real_4: 0.3086957037448883 (0.3220055401325226) | > loss_disc_real_5: 0.2944110035896301 (0.32392169535160065) | > loss_0: 2.95613431930542 (2.904048800468445) | > loss_gen: 1.902358055114746 (2.215537428855896) | > loss_kl: 3.0213875770568848 (3.0518985986709595) | > loss_feat: 0.9487314820289612 (1.7146970331668854) | > loss_mel: 22.065242767333984 (21.579668045043945) | > loss_duration: 2.3605034351348877 (2.3838285207748413) | > loss_1: 30.29822540283203 (30.94563102722168)  --> STEP: 3 | > loss_disc: 2.6007132530212402 (2.8029369513193765) | > loss_disc_real_0: 0.3199461102485657 (0.28127071261405945) | > loss_disc_real_1: 0.3058350086212158 (0.34094856182734173) | > loss_disc_real_2: 0.1722370833158493 (0.23800455033779144) | > loss_disc_real_3: 0.20436924695968628 (0.2551657557487488) | > loss_disc_real_4: 0.27795979380607605 (0.3073236246903737) | > loss_disc_real_5: 0.3658316731452942 (0.3378916879494985) | > loss_0: 2.6007132530212402 (2.8029369513193765) | > loss_gen: 2.4029624462127686 (2.27801243464152) | > loss_kl: 1.515869379043579 (2.539888858795166) | > loss_feat: 3.6697757244110107 (2.3663899302482605) | > loss_mel: 22.325450897216797 (21.828262329101562) | > loss_duration: 2.2224948406219482 (2.3300506273905435) | > loss_1: 32.13655471801758 (31.342605590820312) --> EVAL PERFORMANCE | > avg_loader_time: 0.011828899383544922 (+0.005235910415649414) | > avg_loss_disc: 2.8029369513193765 (-0.1635988553365073) | > avg_loss_disc_real_0: 0.28127071261405945 (-0.025159592429796873) | > avg_loss_disc_real_1: 0.34094856182734173 (+0.09198069075743359) | > avg_loss_disc_real_2: 0.23800455033779144 (+0.009280785918235779) | > avg_loss_disc_real_3: 0.2551657557487488 (-0.027093778053919493) | > avg_loss_disc_real_4: 0.3073236246903737 (+0.035763368010520935) | > avg_loss_disc_real_5: 0.3378916879494985 (-0.03686238328615826) | > avg_loss_0: 2.8029369513193765 (-0.1635988553365073) | > avg_loss_gen: 2.27801243464152 (+0.3442444403966267) | > avg_loss_kl: 2.539888858795166 (-0.2467194000879922) | > avg_loss_feat: 2.3663899302482605 (+0.29902766148249293) | > avg_loss_mel: 21.828262329101562 (-4.509950002034504) | > avg_loss_duration: 2.3300506273905435 (-0.05949838956197118) | > avg_loss_1: 31.342605590820312 (-4.1728947957356795)  > EPOCH: 206/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:53:57)   --> TIME: 2023-10-20 01:54:16 -- STEP: 29/50 -- GLOBAL_STEP: 63330 | > loss_disc: 2.9704601764678955 (2.4370774811711806) | > loss_disc_real_0: 0.2798513174057007 (0.18302588813520712) | > loss_disc_real_1: 0.2861306071281433 (0.2364624510037488) | > loss_disc_real_2: 0.27098047733306885 (0.25563063806500935) | > loss_disc_real_3: 0.2992366850376129 (0.241354411532139) | > loss_disc_real_4: 0.2659299075603485 (0.20740426678595872) | > loss_disc_real_5: 0.24407798051834106 (0.2302740065958993) | > loss_0: 2.9704601764678955 (2.4370774811711806) | > grad_norm_0: tensor(182.2497, device='cuda:0') (tensor(531.9374, device='cuda:0')) | > loss_gen: 1.649771809577942 (2.5274946031899286) | > loss_kl: 0.9521852731704712 (1.0156363598231615) | > loss_feat: 0.1593942642211914 (5.4937085082497585) | > loss_mel: 13.494726181030273 (23.578942224897187) | > loss_duration: 1.7187366485595703 (1.6935078933321197) | > loss_1: 17.974815368652344 (34.309289702053725) | > grad_norm_1: tensor(15962.4111, device='cuda:0') (tensor(26253.1211, device='cuda:0')) | > current_lr_0: 0.0001627645194752429 | > current_lr_1: 0.0001627645194752429 | > step_time: 0.6511 (0.4794014157920048) | > loader_time: 0.0245 (0.01650627728166251)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.85066819190979 (2.85066819190979) | > loss_disc_real_0: 0.07728010416030884 (0.07728010416030884) | > loss_disc_real_1: 0.17625176906585693 (0.17625176906585693) | > loss_disc_real_2: 0.2643493413925171 (0.2643493413925171) | > loss_disc_real_3: 0.39073655009269714 (0.39073655009269714) | > loss_disc_real_4: 0.203341543674469 (0.203341543674469) | > loss_disc_real_5: 0.22653551399707794 (0.22653551399707794) | > loss_0: 2.85066819190979 (2.85066819190979) | > loss_gen: 1.861767292022705 (1.861767292022705) | > loss_kl: 2.6792047023773193 (2.6792047023773193) | > loss_feat: 5.069929122924805 (5.069929122924805) | > loss_mel: 25.708911895751953 (25.708911895751953) | > loss_duration: 2.20770263671875 (2.20770263671875) | > loss_1: 37.52751541137695 (37.52751541137695)  --> STEP: 1 | > loss_disc: 2.8514702320098877 (2.8514702320098877) | > loss_disc_real_0: 0.13241145014762878 (0.13241145014762878) | > loss_disc_real_1: 0.17593497037887573 (0.17593497037887573) | > loss_disc_real_2: 0.19832013547420502 (0.19832013547420502) | > loss_disc_real_3: 0.34760361909866333 (0.34760361909866333) | > loss_disc_real_4: 0.19773836433887482 (0.19773836433887482) | > loss_disc_real_5: 0.2523040771484375 (0.2523040771484375) | > loss_0: 2.8514702320098877 (2.8514702320098877) | > loss_gen: 1.815212607383728 (1.815212607383728) | > loss_kl: 3.4066848754882812 (3.4066848754882812) | > loss_feat: 5.26987886428833 (5.26987886428833) | > loss_mel: 25.90951919555664 (25.90951919555664) | > loss_duration: 2.447113275527954 (2.447113275527954) | > loss_1: 38.84840774536133 (38.84840774536133)  --> STEP: 2 | > loss_disc: 3.0437893867492676 (2.9476298093795776) | > loss_disc_real_0: 0.3222876787185669 (0.22734956443309784) | > loss_disc_real_1: 0.321167528629303 (0.24855124950408936) | > loss_disc_real_2: 0.32286179065704346 (0.26059096306562424) | > loss_disc_real_3: 0.28315460681915283 (0.3153791129589081) | > loss_disc_real_4: 0.28982245922088623 (0.24378041177988052) | > loss_disc_real_5: 0.28056368231773376 (0.26643387973308563) | > loss_0: 3.0437893867492676 (2.9476298093795776) | > loss_gen: 1.8101646900177002 (1.8126886487007141) | > loss_kl: 3.1562938690185547 (3.281489372253418) | > loss_feat: 0.04323327913880348 (2.656556071713567) | > loss_mel: 2.2743165493011475 (14.091917872428894) | > loss_duration: 2.4397852420806885 (2.4434492588043213) | > loss_1: 9.723793029785156 (24.286100387573242)  --> STEP: 3 | > loss_disc: 2.1054534912109375 (2.6669043699900308) | > loss_disc_real_0: 0.149606853723526 (0.20143532752990723) | > loss_disc_real_1: 0.22022970020771027 (0.23911073307196298) | > loss_disc_real_2: 0.19064876437187195 (0.23727689683437347) | > loss_disc_real_3: 0.1488122045993805 (0.25985681017239887) | > loss_disc_real_4: 0.11471959203481674 (0.20076013853152594) | > loss_disc_real_5: 0.09059196710586548 (0.20781990885734558) | > loss_0: 2.1054534912109375 (2.6669043699900308) | > loss_gen: 2.4269821643829346 (2.017453153928121) | > loss_kl: 1.4578279256820679 (2.6736022233963013) | > loss_feat: 6.186699867248535 (3.833270670225223) | > loss_mel: 26.30978012084961 (18.164538621902466) | > loss_duration: 2.2995076179504395 (2.3954687118530273) | > loss_1: 38.6807975769043 (29.084332784016926) --> EVAL PERFORMANCE | > avg_loader_time: 0.0113371213277181 (-0.0004917780558268223) | > avg_loss_disc: 2.6669043699900308 (-0.1360325813293457) | > avg_loss_disc_real_0: 0.20143532752990723 (-0.07983538508415222) | > avg_loss_disc_real_1: 0.23911073307196298 (-0.10183782875537875) | > avg_loss_disc_real_2: 0.23727689683437347 (-0.0007276535034179688) | > avg_loss_disc_real_3: 0.25985681017239887 (+0.004691054423650087) | > avg_loss_disc_real_4: 0.20076013853152594 (-0.10656348615884778) | > avg_loss_disc_real_5: 0.20781990885734558 (-0.1300717790921529) | > avg_loss_0: 2.6669043699900308 (-0.1360325813293457) | > avg_loss_gen: 2.017453153928121 (-0.26055928071339896) | > avg_loss_kl: 2.6736022233963013 (+0.13371336460113525) | > avg_loss_feat: 3.833270670225223 (+1.4668807399769626) | > avg_loss_mel: 18.164538621902466 (-3.6637237071990967) | > avg_loss_duration: 2.3954687118530273 (+0.06541808446248387) | > avg_loss_1: 29.084332784016926 (-2.2582728068033866)  > EPOCH: 207/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:54:35)   --> TIME: 2023-10-20 01:54:44 -- STEP: 9/50 -- GLOBAL_STEP: 63360 | > loss_disc: 2.335355758666992 (2.4018553495407104) | > loss_disc_real_0: 0.027937866747379303 (0.13102473939458528) | > loss_disc_real_1: 0.2791607081890106 (0.21222287830379274) | > loss_disc_real_2: 0.31468287110328674 (0.23425839924150044) | > loss_disc_real_3: 0.3281390070915222 (0.22885996268855202) | > loss_disc_real_4: 0.3455646336078644 (0.2049805207384957) | > loss_disc_real_5: 0.2759163975715637 (0.20077873828510442) | > loss_0: 2.335355758666992 (2.4018553495407104) | > grad_norm_0: tensor(540.7415, device='cuda:0') (tensor(538.8984, device='cuda:0')) | > loss_gen: 2.8726634979248047 (2.565390533871121) | > loss_kl: 0.9156181216239929 (0.8782034698459837) | > loss_feat: 6.020096302032471 (6.338682678010729) | > loss_mel: 23.808475494384766 (25.669063780042862) | > loss_duration: 1.6320465803146362 (1.6299627092149522) | > loss_1: 35.248897552490234 (37.081302642822266) | > grad_norm_1: tensor(9200.3477, device='cuda:0') (tensor(24357.1992, device='cuda:0')) | > current_lr_0: 0.0001626018261474453 | > current_lr_1: 0.0001626018261474453 | > step_time: 0.6192 (0.49445769521925187) | > loader_time: 0.0251 (0.022624439663357206)  --> TIME: 2023-10-20 01:54:55 -- STEP: 39/50 -- GLOBAL_STEP: 63390 | > loss_disc: 3.101893901824951 (2.4887230824201536) | > loss_disc_real_0: 0.30473634600639343 (0.1773146796398438) | > loss_disc_real_1: 0.24643775820732117 (0.22644163171450296) | > loss_disc_real_2: 0.08299286663532257 (0.24203988145559263) | > loss_disc_real_3: 0.21444888412952423 (0.23093888899072623) | > loss_disc_real_4: 0.24969933927059174 (0.2151471475760142) | > loss_disc_real_5: 0.3102104365825653 (0.2379098045042693) | > loss_0: 3.101893901824951 (2.4887230824201536) | > grad_norm_0: tensor(410.9290, device='cuda:0') (tensor(648.7091, device='cuda:0')) | > loss_gen: 1.441737174987793 (2.414891071808644) | > loss_kl: 0.6304866671562195 (0.9726397605278553) | > loss_feat: 0.06722899526357651 (4.8962444331592465) | > loss_mel: 2.0477235317230225 (21.600323475324192) | > loss_duration: 1.6832821369171143 (1.654322902361552) | > loss_1: 5.870458602905273 (31.538421398554103) | > grad_norm_1: tensor(18537.8281, device='cuda:0') (tensor(20836.9004, device='cuda:0')) | > current_lr_0: 0.0001626018261474453 | > current_lr_1: 0.0001626018261474453 | > step_time: 0.3131 (0.3912761272528233) | > loader_time: 0.004 (0.011721849441528324)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.934518814086914 (2.934518814086914) | > loss_disc_real_0: 0.28564882278442383 (0.28564882278442383) | > loss_disc_real_1: 0.30222517251968384 (0.30222517251968384) | > loss_disc_real_2: 0.4214669167995453 (0.4214669167995453) | > loss_disc_real_3: 0.22116029262542725 (0.22116029262542725) | > loss_disc_real_4: 0.3326513469219208 (0.3326513469219208) | > loss_disc_real_5: 0.25542759895324707 (0.25542759895324707) | > loss_0: 2.934518814086914 (2.934518814086914) | > loss_gen: 2.061185836791992 (2.061185836791992) | > loss_kl: 2.4554295539855957 (2.4554295539855957) | > loss_feat: 1.1140334606170654 (1.1140334606170654) | > loss_mel: 21.07233428955078 (21.07233428955078) | > loss_duration: 2.2531094551086426 (2.2531094551086426) | > loss_1: 28.956092834472656 (28.956092834472656)  --> STEP: 1 | > loss_disc: 2.4094014167785645 (2.4094014167785645) | > loss_disc_real_0: 0.1741575002670288 (0.1741575002670288) | > loss_disc_real_1: 0.3098767101764679 (0.3098767101764679) | > loss_disc_real_2: 0.28837037086486816 (0.28837037086486816) | > loss_disc_real_3: 0.16541528701782227 (0.16541528701782227) | > loss_disc_real_4: 0.2993455231189728 (0.2993455231189728) | > loss_disc_real_5: 0.23417282104492188 (0.23417282104492188) | > loss_0: 2.4094014167785645 (2.4094014167785645) | > loss_gen: 2.6782824993133545 (2.6782824993133545) | > loss_kl: 2.6457531452178955 (2.6457531452178955) | > loss_feat: 7.880880355834961 (7.880880355834961) | > loss_mel: 25.522096633911133 (25.522096633911133) | > loss_duration: 2.353025197982788 (2.353025197982788) | > loss_1: 41.08003616333008 (41.08003616333008)  --> STEP: 2 | > loss_disc: 2.591829538345337 (2.5006154775619507) | > loss_disc_real_0: 0.15552900731563568 (0.16484325379133224) | > loss_disc_real_1: 0.1591508835554123 (0.2345137968659401) | > loss_disc_real_2: 0.22676047682762146 (0.2575654238462448) | > loss_disc_real_3: 0.16124282777309418 (0.16332905739545822) | > loss_disc_real_4: 0.3318512737751007 (0.31559839844703674) | > loss_disc_real_5: 0.38330674171447754 (0.3087397813796997) | > loss_0: 2.591829538345337 (2.5006154775619507) | > loss_gen: 2.4572620391845703 (2.5677722692489624) | > loss_kl: 3.232172966003418 (2.9389630556106567) | > loss_feat: 7.738860130310059 (7.80987024307251) | > loss_mel: 25.401233673095703 (25.461665153503418) | > loss_duration: 2.397265911102295 (2.3751455545425415) | > loss_1: 41.2267951965332 (41.15341567993164)  --> STEP: 3 | > loss_disc: 2.4321036338806152 (2.477778196334839) | > loss_disc_real_0: 0.4205453395843506 (0.250077282389005) | > loss_disc_real_1: 0.35450708866119385 (0.27451156079769135) | > loss_disc_real_2: 0.36796706914901733 (0.2943659722805023) | > loss_disc_real_3: 0.20754481852054596 (0.17806764443715414) | > loss_disc_real_4: 0.22520814836025238 (0.28546831508477527) | > loss_disc_real_5: 0.2171003520488739 (0.2781933049360911) | > loss_0: 2.4321036338806152 (2.477778196334839) | > loss_gen: 3.483680248260498 (2.873074928919474) | > loss_kl: 1.7024048566818237 (2.526776989301046) | > loss_feat: 5.155982494354248 (6.925240993499756) | > loss_mel: 26.70892333984375 (25.877417882283527) | > loss_duration: 2.371220111846924 (2.3738370736440024) | > loss_1: 39.422210693359375 (40.57634735107422) --> EVAL PERFORMANCE | > avg_loader_time: 0.007965485254923502 (-0.0033716360727945975) | > avg_loss_disc: 2.477778196334839 (-0.1891261736551919) | > avg_loss_disc_real_0: 0.250077282389005 (+0.04864195485909778) | > avg_loss_disc_real_1: 0.27451156079769135 (+0.03540082772572836) | > avg_loss_disc_real_2: 0.2943659722805023 (+0.057089075446128845) | > avg_loss_disc_real_3: 0.17806764443715414 (-0.08178916573524472) | > avg_loss_disc_real_4: 0.28546831508477527 (+0.08470817655324933) | > avg_loss_disc_real_5: 0.2781933049360911 (+0.07037339607874554) | > avg_loss_0: 2.477778196334839 (-0.1891261736551919) | > avg_loss_gen: 2.873074928919474 (+0.8556217749913531) | > avg_loss_kl: 2.526776989301046 (-0.14682523409525539) | > avg_loss_feat: 6.925240993499756 (+3.091970323274533) | > avg_loss_mel: 25.877417882283527 (+7.712879260381062) | > avg_loss_duration: 2.3738370736440024 (-0.021631638209024917) | > avg_loss_1: 40.57634735107422 (+11.492014567057293)  > EPOCH: 208/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:55:13)   --> TIME: 2023-10-20 01:55:28 -- STEP: 19/50 -- GLOBAL_STEP: 63420 | > loss_disc: 1.804909110069275 (2.6358583726381) | > loss_disc_real_0: 0.03453236445784569 (0.1651120211340879) | > loss_disc_real_1: 0.21128907799720764 (0.24131339396301069) | > loss_disc_real_2: 0.1427209973335266 (0.24698927959329203) | > loss_disc_real_3: 0.21292515099048615 (0.253571145628628) | > loss_disc_real_4: 0.2007438689470291 (0.2659897416045791) | > loss_disc_real_5: 0.07754058390855789 (0.2496366798877716) | > loss_0: 1.804909110069275 (2.6358583726381) | > grad_norm_0: tensor(311.2224, device='cuda:0') (tensor(641.7144, device='cuda:0')) | > loss_gen: 2.789654016494751 (2.2204414919803015) | > loss_kl: 1.113992691040039 (0.9008349839009737) | > loss_feat: 8.655576705932617 (3.9213353567021456) | > loss_mel: 26.853235244750977 (19.355163712250558) | > loss_duration: 1.756219744682312 (1.696870163867348) | > loss_1: 41.16867446899414 (28.094645525279798) | > grad_norm_1: tensor(44412.1016, device='cuda:0') (tensor(19114.7910, device='cuda:0')) | > current_lr_0: 0.00016243929544181498 | > current_lr_1: 0.00016243929544181498 | > step_time: 0.5581 (0.5066594826547723) | > loader_time: 0.0155 (0.01985956493176912)  --> TIME: 2023-10-20 01:55:43 -- STEP: 49/50 -- GLOBAL_STEP: 63450 | > loss_disc: 2.2225496768951416 (2.507830700095819) | > loss_disc_real_0: 0.06434907764196396 (0.1480954857162979) | > loss_disc_real_1: 0.3378257155418396 (0.23413381862397098) | > loss_disc_real_2: 0.2732563614845276 (0.21932811738581073) | > loss_disc_real_3: 0.320591539144516 (0.2433927105549647) | > loss_disc_real_4: 0.13869914412498474 (0.23274466859138743) | > loss_disc_real_5: 0.09481648355722427 (0.20958329151783675) | > loss_0: 2.2225496768951416 (2.507830700095819) | > grad_norm_0: tensor(503.3611, device='cuda:0') (tensor(562.6950, device='cuda:0')) | > loss_gen: 2.4739370346069336 (2.296851642277776) | > loss_kl: 0.5751014947891235 (0.971854850953939) | > loss_feat: 3.978003740310669 (5.150087205084915) | > loss_mel: 24.88572120666504 (22.60477125887968) | > loss_duration: 1.7676993608474731 (1.645931416628312) | > loss_1: 33.68046569824219 (32.66949613726869) | > grad_norm_1: tensor(3911.2881, device='cuda:0') (tensor(17750.8828, device='cuda:0')) | > current_lr_0: 0.00016243929544181498 | > current_lr_1: 0.00016243929544181498 | > step_time: 0.6278 (0.49661251476832796) | > loader_time: 0.3896 (0.028633828065833273)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.310105800628662 (2.310105800628662) | > loss_disc_real_0: 0.27584928274154663 (0.27584928274154663) | > loss_disc_real_1: 0.3064923882484436 (0.3064923882484436) | > loss_disc_real_2: 0.2718419134616852 (0.2718419134616852) | > loss_disc_real_3: 0.3035597801208496 (0.3035597801208496) | > loss_disc_real_4: 0.2079835832118988 (0.2079835832118988) | > loss_disc_real_5: 0.21662551164627075 (0.21662551164627075) | > loss_0: 2.310105800628662 (2.310105800628662) | > loss_gen: 3.091348886489868 (3.091348886489868) | > loss_kl: 2.346416711807251 (2.346416711807251) | > loss_feat: 4.37300443649292 (4.37300443649292) | > loss_mel: 24.38283348083496 (24.38283348083496) | > loss_duration: 2.372075080871582 (2.372075080871582) | > loss_1: 36.565677642822266 (36.565677642822266)  --> STEP: 1 | > loss_disc: 2.7025935649871826 (2.7025935649871826) | > loss_disc_real_0: 0.3048873543739319 (0.3048873543739319) | > loss_disc_real_1: 0.3042497932910919 (0.3042497932910919) | > loss_disc_real_2: 0.26758429408073425 (0.26758429408073425) | > loss_disc_real_3: 0.3634866774082184 (0.3634866774082184) | > loss_disc_real_4: 0.23262232542037964 (0.23262232542037964) | > loss_disc_real_5: 0.3409099578857422 (0.3409099578857422) | > loss_0: 2.7025935649871826 (2.7025935649871826) | > loss_gen: 2.716003894805908 (2.716003894805908) | > loss_kl: 3.2214767932891846 (3.2214767932891846) | > loss_feat: 3.1737661361694336 (3.1737661361694336) | > loss_mel: 24.97034454345703 (24.97034454345703) | > loss_duration: 2.475949287414551 (2.475949287414551) | > loss_1: 36.55754089355469 (36.55754089355469)  --> STEP: 2 | > loss_disc: 2.8766350746154785 (2.7896143198013306) | > loss_disc_real_0: 0.16744095087051392 (0.2361641526222229) | > loss_disc_real_1: 0.2579675316810608 (0.28110866248607635) | > loss_disc_real_2: 0.3159201443195343 (0.2917522192001343) | > loss_disc_real_3: 0.4120604991912842 (0.3877735882997513) | > loss_disc_real_4: 0.411286860704422 (0.3219545930624008) | > loss_disc_real_5: 0.2754499614238739 (0.30817995965480804) | > loss_0: 2.8766350746154785 (2.7896143198013306) | > loss_gen: 2.2689061164855957 (2.492455005645752) | > loss_kl: 3.507429599761963 (3.3644531965255737) | > loss_feat: 6.302295207977295 (4.738030672073364) | > loss_mel: 31.57501220703125 (28.27267837524414) | > loss_duration: 2.4114251136779785 (2.4436872005462646) | > loss_1: 46.065067291259766 (41.31130409240723)  --> STEP: 3 | > loss_disc: 2.988966941833496 (2.8560651938120523) | > loss_disc_real_0: 0.2591474950313568 (0.24382526675860086) | > loss_disc_real_1: 0.2711605131626129 (0.27779261271158856) | > loss_disc_real_2: 0.28563565015792847 (0.28971336285273236) | > loss_disc_real_3: 0.26440054178237915 (0.34664923946062726) | > loss_disc_real_4: 0.24512352049350739 (0.29634423553943634) | > loss_disc_real_5: 0.2680017948150635 (0.2947872380415599) | > loss_0: 2.988966941833496 (2.8560651938120523) | > loss_gen: 1.614995002746582 (2.1999683380126953) | > loss_kl: 1.4300981760025024 (2.71966818968455) | > loss_feat: 0.08519519120454788 (3.1870855117837587) | > loss_mel: 3.3612942695617676 (19.968883673350017) | > loss_duration: 2.369833469390869 (2.419069290161133) | > loss_1: 8.86141586303711 (30.494674682617188) --> EVAL PERFORMANCE | > avg_loader_time: 0.0021088123321533203 (-0.005856672922770182) | > avg_loss_disc: 2.8560651938120523 (+0.3782869974772134) | > avg_loss_disc_real_0: 0.24382526675860086 (-0.006252015630404145) | > avg_loss_disc_real_1: 0.27779261271158856 (+0.003281051913897215) | > avg_loss_disc_real_2: 0.28971336285273236 (-0.00465260942776996) | > avg_loss_disc_real_3: 0.34664923946062726 (+0.1685815950234731) | > avg_loss_disc_real_4: 0.29634423553943634 (+0.01087592045466107) | > avg_loss_disc_real_5: 0.2947872380415599 (+0.01659393310546875) | > avg_loss_0: 2.8560651938120523 (+0.3782869974772134) | > avg_loss_gen: 2.1999683380126953 (-0.6731065909067788) | > avg_loss_kl: 2.71966818968455 (+0.19289120038350394) | > avg_loss_feat: 3.1870855117837587 (-3.738155481715997) | > avg_loss_mel: 19.968883673350017 (-5.90853420893351) | > avg_loss_duration: 2.419069290161133 (+0.045232216517130386) | > avg_loss_1: 30.494674682617188 (-10.081672668457031)  > EPOCH: 209/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:55:55)   --> TIME: 2023-10-20 01:56:12 -- STEP: 29/50 -- GLOBAL_STEP: 63480 | > loss_disc: 2.444385290145874 (2.6845459157022935) | > loss_disc_real_0: 0.13111191987991333 (0.1836712520954938) | > loss_disc_real_1: 0.23420646786689758 (0.24358745356058253) | > loss_disc_real_2: 0.2137240320444107 (0.25017350937785765) | > loss_disc_real_3: 0.2882677912712097 (0.2411269319468531) | > loss_disc_real_4: 0.30716705322265625 (0.27660772544813567) | > loss_disc_real_5: 0.31046023964881897 (0.2899717390537261) | > loss_0: 2.444385290145874 (2.6845459157022935) | > grad_norm_0: tensor(236.1773, device='cuda:0') (tensor(532.7381, device='cuda:0')) | > loss_gen: 2.4881606101989746 (2.2752251995020893) | > loss_kl: 0.7856389284133911 (0.9827063453608545) | > loss_feat: 4.474466323852539 (4.51759043753404) | > loss_mel: 24.542184829711914 (22.457460259569103) | > loss_duration: 1.6654495000839233 (1.6757938286353802) | > loss_1: 33.955902099609375 (31.908775855754985) | > grad_norm_1: tensor(4412.5278, device='cuda:0') (tensor(21896.5625, device='cuda:0')) | > current_lr_0: 0.00016227692719580084 | > current_lr_1: 0.00016227692719580084 | > step_time: 0.3109 (0.45122194290161133) | > loader_time: 0.0253 (0.011730005001199657)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5663262605667114 (1.5663262605667114) | > loss_disc_real_0: 0.10109992325305939 (0.10109992325305939) | > loss_disc_real_1: 0.18361006677150726 (0.18361006677150726) | > loss_disc_real_2: 0.09618131071329117 (0.09618131071329117) | > loss_disc_real_3: 0.2517886161804199 (0.2517886161804199) | > loss_disc_real_4: 0.07155483961105347 (0.07155483961105347) | > loss_disc_real_5: 0.04883335530757904 (0.04883335530757904) | > loss_0: 1.5663262605667114 (1.5663262605667114) | > loss_gen: 3.352674961090088 (3.352674961090088) | > loss_kl: 2.3443782329559326 (2.3443782329559326) | > loss_feat: 9.675050735473633 (9.675050735473633) | > loss_mel: 24.40180206298828 (24.40180206298828) | > loss_duration: 2.20969295501709 (2.20969295501709) | > loss_1: 41.98360061645508 (41.98360061645508)  --> STEP: 1 | > loss_disc: 1.424009084701538 (1.424009084701538) | > loss_disc_real_0: 0.0771050825715065 (0.0771050825715065) | > loss_disc_real_1: 0.16863447427749634 (0.16863447427749634) | > loss_disc_real_2: 0.08275848627090454 (0.08275848627090454) | > loss_disc_real_3: 0.023997874930500984 (0.023997874930500984) | > loss_disc_real_4: 0.020109549164772034 (0.020109549164772034) | > loss_disc_real_5: 0.0014098655665293336 (0.0014098655665293336) | > loss_0: 1.424009084701538 (1.424009084701538) | > loss_gen: 2.5610766410827637 (2.5610766410827637) | > loss_kl: 3.189478874206543 (3.189478874206543) | > loss_feat: 12.286358833312988 (12.286358833312988) | > loss_mel: 26.6975040435791 (26.6975040435791) | > loss_duration: 2.4073269367218018 (2.4073269367218018) | > loss_1: 47.14174270629883 (47.14174270629883)  --> STEP: 2 | > loss_disc: 2.2738358974456787 (1.8489224910736084) | > loss_disc_real_0: 0.09652324765920639 (0.08681416511535645) | > loss_disc_real_1: 0.25483089685440063 (0.2117326855659485) | > loss_disc_real_2: 0.27873358130455017 (0.18074603378772736) | > loss_disc_real_3: 0.38985881209373474 (0.20692834351211786) | > loss_disc_real_4: 0.15854822099208832 (0.08932888507843018) | > loss_disc_real_5: 0.3007480502128601 (0.15107895788969472) | > loss_0: 2.2738358974456787 (1.8489224910736084) | > loss_gen: 2.856981039047241 (2.7090288400650024) | > loss_kl: 3.382427453994751 (3.285953164100647) | > loss_feat: 5.252536773681641 (8.769447803497314) | > loss_mel: 28.056215286254883 (27.376859664916992) | > loss_duration: 2.297935962677002 (2.352631449699402) | > loss_1: 41.846092224121094 (44.49391746520996)  --> STEP: 3 | > loss_disc: 2.2002837657928467 (1.9660429159800212) | > loss_disc_real_0: 0.2736667990684509 (0.1490983764330546) | > loss_disc_real_1: 0.2762629985809326 (0.23324278990427652) | > loss_disc_real_2: 0.3317320644855499 (0.23107471068700156) | > loss_disc_real_3: 0.19773200154304504 (0.2038628961890936) | > loss_disc_real_4: 0.1554117500782013 (0.11135650674502055) | > loss_disc_real_5: 0.14362461864948273 (0.1485941781429574) | > loss_0: 2.2002837657928467 (1.9660429159800212) | > loss_gen: 2.770923614501953 (2.729660431543986) | > loss_kl: 1.1451425552368164 (2.5723496278127036) | > loss_feat: 5.213228225708008 (7.584041277567546) | > loss_mel: 20.037307739257812 (24.930342356363933) | > loss_duration: 2.205274820327759 (2.3035125732421875) | > loss_1: 31.371877670288086 (40.119904200236) --> EVAL PERFORMANCE | > avg_loader_time: 0.014051993687947592 (+0.011943181355794271) | > avg_loss_disc: 1.9660429159800212 (-0.890022277832031) | > avg_loss_disc_real_0: 0.1490983764330546 (-0.09472689032554626) | > avg_loss_disc_real_1: 0.23324278990427652 (-0.04454982280731204) | > avg_loss_disc_real_2: 0.23107471068700156 (-0.058638652165730804) | > avg_loss_disc_real_3: 0.2038628961890936 (-0.14278634327153367) | > avg_loss_disc_real_4: 0.11135650674502055 (-0.18498772879441577) | > avg_loss_disc_real_5: 0.1485941781429574 (-0.14619305989860248) | > avg_loss_0: 1.9660429159800212 (-0.890022277832031) | > avg_loss_gen: 2.729660431543986 (+0.5296920935312905) | > avg_loss_kl: 2.5723496278127036 (-0.14731856187184622) | > avg_loss_feat: 7.584041277567546 (+4.396955765783787) | > avg_loss_mel: 24.930342356363933 (+4.961458683013916) | > avg_loss_duration: 2.3035125732421875 (-0.11555671691894531) | > avg_loss_1: 40.119904200236 (+9.625229517618813)  > EPOCH: 210/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:56:33)   --> TIME: 2023-10-20 01:56:42 -- STEP: 9/50 -- GLOBAL_STEP: 63510 | > loss_disc: 2.9363393783569336 (2.7702731026543512) | > loss_disc_real_0: 0.16672107577323914 (0.19135751864976352) | > loss_disc_real_1: 0.4157581925392151 (0.2840217070447074) | > loss_disc_real_2: 0.45381009578704834 (0.2509194057848718) | > loss_disc_real_3: 0.3897114098072052 (0.2790266614821222) | > loss_disc_real_4: 0.467119425535202 (0.27393936696979737) | > loss_disc_real_5: 0.3176780343055725 (0.22616222562889257) | > loss_0: 2.9363393783569336 (2.7702731026543512) | > grad_norm_0: tensor(325.1410, device='cuda:0') (tensor(515.8297, device='cuda:0')) | > loss_gen: 3.1393747329711914 (2.363792300224304) | > loss_kl: 0.9091058373451233 (1.0670417812135484) | > loss_feat: 5.242750644683838 (5.253908535672559) | > loss_mel: 25.130884170532227 (22.867298550075954) | > loss_duration: 1.6215227842330933 (1.648818850517273) | > loss_1: 36.043636322021484 (33.20085959964328) | > grad_norm_1: tensor(15484.1191, device='cuda:0') (tensor(24859.0195, device='cuda:0')) | > current_lr_0: 0.00016211472124701438 | > current_lr_1: 0.00016211472124701438 | > step_time: 0.6115 (0.5409588548872206) | > loader_time: 0.0244 (0.020442194408840604)  --> TIME: 2023-10-20 01:56:53 -- STEP: 39/50 -- GLOBAL_STEP: 63540 | > loss_disc: 1.5516536235809326 (2.4877870296820617) | > loss_disc_real_0: 0.008015123195946217 (0.18214897880665) | > loss_disc_real_1: 0.12470401078462601 (0.2341826231433795) | > loss_disc_real_2: 0.13749568164348602 (0.21628582487121606) | > loss_disc_real_3: 0.23068366944789886 (0.24058573578412717) | > loss_disc_real_4: 0.03710129112005234 (0.24204867003628833) | > loss_disc_real_5: 0.08461921662092209 (0.22329687446546861) | > loss_0: 1.5516536235809326 (2.4877870296820617) | > grad_norm_0: tensor(542.2195, device='cuda:0') (tensor(562.8548, device='cuda:0')) | > loss_gen: 2.8939054012298584 (2.314795915897076) | > loss_kl: 0.661209225654602 (0.9547924529283477) | > loss_feat: 8.612951278686523 (4.967104654663648) | > loss_mel: 25.81019401550293 (22.795854574594742) | > loss_duration: 1.706408143043518 (1.642715973731799) | > loss_1: 39.684669494628906 (32.675263502658936) | > grad_norm_1: tensor(66082.0625, device='cuda:0') (tensor(20544.3906, device='cuda:0')) | > current_lr_0: 0.00016211472124701438 | > current_lr_1: 0.00016211472124701438 | > step_time: 0.2585 (0.40638111187861525) | > loader_time: 0.0022 (0.011740690622574244)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.374450922012329 (2.374450922012329) | > loss_disc_real_0: 0.07588914036750793 (0.07588914036750793) | > loss_disc_real_1: 0.18099351227283478 (0.18099351227283478) | > loss_disc_real_2: 0.2628823220729828 (0.2628823220729828) | > loss_disc_real_3: 0.2790374457836151 (0.2790374457836151) | > loss_disc_real_4: 0.24649718403816223 (0.24649718403816223) | > loss_disc_real_5: 0.11716771125793457 (0.11716771125793457) | > loss_0: 2.374450922012329 (2.374450922012329) | > loss_gen: 2.046121835708618 (2.046121835708618) | > loss_kl: 2.2663774490356445 (2.2663774490356445) | > loss_feat: 5.071510314941406 (5.071510314941406) | > loss_mel: 25.78719711303711 (25.78719711303711) | > loss_duration: 2.1518056392669678 (2.1518056392669678) | > loss_1: 37.32301330566406 (37.32301330566406)  --> STEP: 1 | > loss_disc: 1.4127248525619507 (1.4127248525619507) | > loss_disc_real_0: 0.02792176976799965 (0.02792176976799965) | > loss_disc_real_1: 0.09313362091779709 (0.09313362091779709) | > loss_disc_real_2: 0.07569274306297302 (0.07569274306297302) | > loss_disc_real_3: 0.034522172063589096 (0.034522172063589096) | > loss_disc_real_4: 0.07502524554729462 (0.07502524554729462) | > loss_disc_real_5: 0.10392723977565765 (0.10392723977565765) | > loss_0: 1.4127248525619507 (1.4127248525619507) | > loss_gen: 2.366898536682129 (2.366898536682129) | > loss_kl: 3.0863895416259766 (3.0863895416259766) | > loss_feat: 12.622766494750977 (12.622766494750977) | > loss_mel: 25.537784576416016 (25.537784576416016) | > loss_duration: 2.391914129257202 (2.391914129257202) | > loss_1: 46.00575256347656 (46.00575256347656)  --> STEP: 2 | > loss_disc: 3.2462830543518066 (2.3295039534568787) | > loss_disc_real_0: 0.026694539934396744 (0.027308154851198196) | > loss_disc_real_1: 0.31590360403060913 (0.2045186124742031) | > loss_disc_real_2: 0.25997599959373474 (0.16783437132835388) | > loss_disc_real_3: 0.20388111472129822 (0.11920164339244366) | > loss_disc_real_4: 0.13307802379131317 (0.1040516346693039) | > loss_disc_real_5: 0.46701568365097046 (0.28547146171331406) | > loss_0: 3.2462830543518066 (2.3295039534568787) | > loss_gen: 1.8343007564544678 (2.1005996465682983) | > loss_kl: 3.1912379264831543 (3.1388137340545654) | > loss_feat: 7.322535037994385 (9.97265076637268) | > loss_mel: 26.18971061706543 (25.863747596740723) | > loss_duration: 2.3827507495880127 (2.3873324394226074) | > loss_1: 40.920536041259766 (43.463144302368164)  --> STEP: 3 | > loss_disc: 3.0610458850860596 (2.573351263999939) | > loss_disc_real_0: 0.3309977948665619 (0.12853803485631943) | > loss_disc_real_1: 0.46334680914878845 (0.2907946780323982) | > loss_disc_real_2: 0.3785932660102844 (0.23808733622233072) | > loss_disc_real_3: 0.24238741397857666 (0.16026356692115465) | > loss_disc_real_4: 0.2255101054906845 (0.1445377916097641) | > loss_disc_real_5: 0.3829883933067322 (0.31797710557778675) | > loss_0: 3.0610458850860596 (2.573351263999939) | > loss_gen: 2.43032169342041 (2.2105069955190024) | > loss_kl: 1.4202497005462646 (2.5659590562184653) | > loss_feat: 3.9000275135040283 (7.948443015416463) | > loss_mel: 24.430212020874023 (25.385902404785156) | > loss_duration: 2.278980255126953 (2.351215044657389) | > loss_1: 34.45978927612305 (40.46202596028646) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018401940663655598 (-0.012211799621582031) | > avg_loss_disc: 2.573351263999939 (+0.6073083480199177) | > avg_loss_disc_real_0: 0.12853803485631943 (-0.02056034157673517) | > avg_loss_disc_real_1: 0.2907946780323982 (+0.0575518881281217) | > avg_loss_disc_real_2: 0.23808733622233072 (+0.0070126255353291644) | > avg_loss_disc_real_3: 0.16026356692115465 (-0.04359932926793894) | > avg_loss_disc_real_4: 0.1445377916097641 (+0.033181284864743546) | > avg_loss_disc_real_5: 0.31797710557778675 (+0.16938292743482936) | > avg_loss_0: 2.573351263999939 (+0.6073083480199177) | > avg_loss_gen: 2.2105069955190024 (-0.5191534360249834) | > avg_loss_kl: 2.5659590562184653 (-0.006390571594238281) | > avg_loss_feat: 7.948443015416463 (+0.36440173784891705) | > avg_loss_mel: 25.385902404785156 (+0.4555600484212228) | > avg_loss_duration: 2.351215044657389 (+0.047702471415201675) | > avg_loss_1: 40.46202596028646 (+0.34212176005046047)  > EPOCH: 211/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:57:12)   --> TIME: 2023-10-20 01:57:27 -- STEP: 19/50 -- GLOBAL_STEP: 63570 | > loss_disc: 1.821488857269287 (2.539822471769233) | > loss_disc_real_0: 0.1468312293291092 (0.21259760091963567) | > loss_disc_real_1: 0.17778296768665314 (0.2786609046161175) | > loss_disc_real_2: 0.25109630823135376 (0.23817681168255053) | > loss_disc_real_3: 0.28843194246292114 (0.22916354709549955) | > loss_disc_real_4: 0.17907729744911194 (0.2021452990409575) | > loss_disc_real_5: 0.04939231276512146 (0.1970121546305324) | > loss_0: 1.821488857269287 (2.539822471769233) | > grad_norm_0: tensor(439.0741, device='cuda:0') (tensor(657.1231, device='cuda:0')) | > loss_gen: 3.085846424102783 (2.4496799330962333) | > loss_kl: 1.270896553993225 (0.9731791411575518) | > loss_feat: 6.909018039703369 (5.352286619967536) | > loss_mel: 24.524486541748047 (20.85558824162734) | > loss_duration: 1.7332183122634888 (1.6884930510269969) | > loss_1: 37.52346420288086 (31.319227143337844) | > grad_norm_1: tensor(28343.0176, device='cuda:0') (tensor(26953.6855, device='cuda:0')) | > current_lr_0: 0.00016195267743322934 | > current_lr_1: 0.00016195267743322934 | > step_time: 0.6178 (0.5142802313754433) | > loader_time: 0.0228 (0.02172808898122687)  --> TIME: 2023-10-20 01:57:43 -- STEP: 49/50 -- GLOBAL_STEP: 63600 | > loss_disc: 2.276484251022339 (2.511435949072546) | > loss_disc_real_0: 0.03076888993382454 (0.1813291784147827) | > loss_disc_real_1: 0.17256852984428406 (0.2535999786032707) | > loss_disc_real_2: 0.12511992454528809 (0.2493628541729888) | > loss_disc_real_3: 0.32265669107437134 (0.2394097734774862) | > loss_disc_real_4: 0.12942543625831604 (0.21772170452667133) | > loss_disc_real_5: 0.04548422619700432 (0.21683801320970666) | > loss_0: 2.276484251022339 (2.511435949072546) | > grad_norm_0: tensor(463.2168, device='cuda:0') (tensor(573.5917, device='cuda:0')) | > loss_gen: 2.1452674865722656 (2.4292664771177335) | > loss_kl: 0.8669731020927429 (0.9939458491850871) | > loss_feat: 7.0172953605651855 (5.367806195300454) | > loss_mel: 26.298580169677734 (21.683137954497823) | > loss_duration: 1.7758042812347412 (1.649585307860861) | > loss_1: 38.103919982910156 (32.123741928411995) | > grad_norm_1: tensor(15444.9990, device='cuda:0') (tensor(22471.0508, device='cuda:0')) | > current_lr_0: 0.00016195267743322934 | > current_lr_1: 0.00016195267743322934 | > step_time: 0.4475 (0.4948107028494076) | > loader_time: 0.3291 (0.0271638315551135)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.152684211730957 (3.152684211730957) | > loss_disc_real_0: 0.42629995942115784 (0.42629995942115784) | > loss_disc_real_1: 0.4177021086215973 (0.4177021086215973) | > loss_disc_real_2: 0.3644479513168335 (0.3644479513168335) | > loss_disc_real_3: 0.35600006580352783 (0.35600006580352783) | > loss_disc_real_4: 0.49932488799095154 (0.49932488799095154) | > loss_disc_real_5: 0.4430294632911682 (0.4430294632911682) | > loss_0: 3.152684211730957 (3.152684211730957) | > loss_gen: 3.314838409423828 (3.314838409423828) | > loss_kl: 2.7255771160125732 (2.7255771160125732) | > loss_feat: 3.6802358627319336 (3.6802358627319336) | > loss_mel: 23.776472091674805 (23.776472091674805) | > loss_duration: 2.229074001312256 (2.229074001312256) | > loss_1: 35.7261962890625 (35.7261962890625)  --> STEP: 1 | > loss_disc: 2.5421741008758545 (2.5421741008758545) | > loss_disc_real_0: 0.1571120321750641 (0.1571120321750641) | > loss_disc_real_1: 0.4070349931716919 (0.4070349931716919) | > loss_disc_real_2: 0.3002120554447174 (0.3002120554447174) | > loss_disc_real_3: 0.24656778573989868 (0.24656778573989868) | > loss_disc_real_4: 0.33390846848487854 (0.33390846848487854) | > loss_disc_real_5: 0.24296361207962036 (0.24296361207962036) | > loss_0: 2.5421741008758545 (2.5421741008758545) | > loss_gen: 2.5493502616882324 (2.5493502616882324) | > loss_kl: 2.931889057159424 (2.931889057159424) | > loss_feat: 6.082464218139648 (6.082464218139648) | > loss_mel: 24.254880905151367 (24.254880905151367) | > loss_duration: 2.470659017562866 (2.470659017562866) | > loss_1: 38.289241790771484 (38.289241790771484)  --> STEP: 2 | > loss_disc: 2.9746055603027344 (2.7583898305892944) | > loss_disc_real_0: 0.3123750388622284 (0.23474353551864624) | > loss_disc_real_1: 0.3304103910923004 (0.36872269213199615) | > loss_disc_real_2: 0.2921237349510193 (0.29616789519786835) | > loss_disc_real_3: 0.3674496114253998 (0.30700869858264923) | > loss_disc_real_4: 0.33639687299728394 (0.33515267074108124) | > loss_disc_real_5: 0.34321683645248413 (0.29309022426605225) | > loss_0: 2.9746055603027344 (2.7583898305892944) | > loss_gen: 2.364053249359131 (2.4567017555236816) | > loss_kl: 3.7388229370117188 (3.3353559970855713) | > loss_feat: 1.8653723001480103 (3.9739182591438293) | > loss_mel: 24.386486053466797 (24.320683479309082) | > loss_duration: 2.3810348510742188 (2.4258469343185425) | > loss_1: 34.73576736450195 (36.51250457763672)  --> STEP: 3 | > loss_disc: 1.8233858346939087 (2.446721831957499) | > loss_disc_real_0: 0.08155947923660278 (0.18368218342463175) | > loss_disc_real_1: 0.0410061776638031 (0.2594838539759318) | > loss_disc_real_2: 0.039995063096284866 (0.2107769511640072) | > loss_disc_real_3: 0.09843845665454865 (0.2374852846066157) | > loss_disc_real_4: 0.04826441407203674 (0.23952325185139975) | > loss_disc_real_5: 0.00994281005114317 (0.19870775286108255) | > loss_0: 1.8233858346939087 (2.446721831957499) | > loss_gen: 1.8472003936767578 (2.2535346349080405) | > loss_kl: 1.438639760017395 (2.703117251396179) | > loss_feat: 8.149837493896484 (5.365891337394714) | > loss_mel: 27.60382843017578 (25.41506512959798) | > loss_duration: 2.2708089351654053 (2.3741676012674966) | > loss_1: 41.3103141784668 (38.11177444458008) --> EVAL PERFORMANCE | > avg_loader_time: 0.002115170160929362 (+0.000274976094563802) | > avg_loss_disc: 2.446721831957499 (-0.12662943204243993) | > avg_loss_disc_real_0: 0.18368218342463175 (+0.05514414856831232) | > avg_loss_disc_real_1: 0.2594838539759318 (-0.0313108240564664) | > avg_loss_disc_real_2: 0.2107769511640072 (-0.027310385058323533) | > avg_loss_disc_real_3: 0.2374852846066157 (+0.07722171768546104) | > avg_loss_disc_real_4: 0.23952325185139975 (+0.09498546024163565) | > avg_loss_disc_real_5: 0.19870775286108255 (-0.11926935271670419) | > avg_loss_0: 2.446721831957499 (-0.12662943204243993) | > avg_loss_gen: 2.2535346349080405 (+0.043027639389038086) | > avg_loss_kl: 2.703117251396179 (+0.13715819517771388) | > avg_loss_feat: 5.365891337394714 (-2.5825516780217486) | > avg_loss_mel: 25.41506512959798 (+0.029162724812824337) | > avg_loss_duration: 2.3741676012674966 (+0.022952556610107422) | > avg_loss_1: 38.11177444458008 (-2.3502515157063826)  > EPOCH: 212/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:57:54)   --> TIME: 2023-10-20 01:58:14 -- STEP: 29/50 -- GLOBAL_STEP: 63630 | > loss_disc: 2.2258830070495605 (2.507327934791302) | > loss_disc_real_0: 0.28738540410995483 (0.15813246751525278) | > loss_disc_real_1: 0.2770896255970001 (0.21662211495226827) | > loss_disc_real_2: 0.2994963824748993 (0.20161466554192634) | > loss_disc_real_3: 0.2633732557296753 (0.23213814841262226) | > loss_disc_real_4: 0.3343588411808014 (0.22095894068479538) | > loss_disc_real_5: 0.1419152319431305 (0.21110825969612804) | > loss_0: 2.2258830070495605 (2.507327934791302) | > grad_norm_0: tensor(684.4037, device='cuda:0') (tensor(606.0648, device='cuda:0')) | > loss_gen: 4.189023017883301 (2.2912143345536853) | > loss_kl: 0.5865380764007568 (0.9667952327892699) | > loss_feat: 8.804312705993652 (5.341715070242382) | > loss_mel: 25.739553451538086 (22.820603915329638) | > loss_duration: 1.647518277168274 (1.6562751202747739) | > loss_1: 40.96694564819336 (33.076603248201565) | > grad_norm_1: tensor(8721.9795, device='cuda:0') (tensor(22484.9004, device='cuda:0')) | > current_lr_0: 0.00016179079559238164 | > current_lr_1: 0.00016179079559238164 | > step_time: 0.5701 (0.5100409491308805) | > loader_time: 0.0225 (0.01511432384622508)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8604867458343506 (2.8604867458343506) | > loss_disc_real_0: 0.15384867787361145 (0.15384867787361145) | > loss_disc_real_1: 0.25968632102012634 (0.25968632102012634) | > loss_disc_real_2: 0.24180665612220764 (0.24180665612220764) | > loss_disc_real_3: 0.2850548028945923 (0.2850548028945923) | > loss_disc_real_4: 0.29650622606277466 (0.29650622606277466) | > loss_disc_real_5: 0.3078858256340027 (0.3078858256340027) | > loss_0: 2.8604867458343506 (2.8604867458343506) | > loss_gen: 1.7053560018539429 (1.7053560018539429) | > loss_kl: 2.3394548892974854 (2.3394548892974854) | > loss_feat: 0.6426746249198914 (0.6426746249198914) | > loss_mel: 16.044841766357422 (16.044841766357422) | > loss_duration: 2.2143335342407227 (2.2143335342407227) | > loss_1: 22.94666290283203 (22.94666290283203)  --> STEP: 1 | > loss_disc: 2.1253738403320312 (2.1253738403320312) | > loss_disc_real_0: 0.09377537667751312 (0.09377537667751312) | > loss_disc_real_1: 0.09977248311042786 (0.09977248311042786) | > loss_disc_real_2: 0.17412403225898743 (0.17412403225898743) | > loss_disc_real_3: 0.31561172008514404 (0.31561172008514404) | > loss_disc_real_4: 0.22725500166416168 (0.22725500166416168) | > loss_disc_real_5: 0.29801106452941895 (0.29801106452941895) | > loss_0: 2.1253738403320312 (2.1253738403320312) | > loss_gen: 2.894461154937744 (2.894461154937744) | > loss_kl: 2.9685473442077637 (2.9685473442077637) | > loss_feat: 7.059738636016846 (7.059738636016846) | > loss_mel: 27.12523651123047 (27.12523651123047) | > loss_duration: 2.367833137512207 (2.367833137512207) | > loss_1: 42.41581726074219 (42.41581726074219)  --> STEP: 2 | > loss_disc: 2.9041543006896973 (2.5147640705108643) | > loss_disc_real_0: 0.1748650074005127 (0.1343201920390129) | > loss_disc_real_1: 0.19806359708309174 (0.1489180400967598) | > loss_disc_real_2: 0.1164403185248375 (0.14528217539191246) | > loss_disc_real_3: 0.29508399963378906 (0.30534785985946655) | > loss_disc_real_4: 0.2684396803379059 (0.24784734100103378) | > loss_disc_real_5: 0.19349916279315948 (0.24575511366128922) | > loss_0: 2.9041543006896973 (2.5147640705108643) | > loss_gen: 1.597884178161621 (2.2461726665496826) | > loss_kl: 3.494633436203003 (3.2315903902053833) | > loss_feat: 6.172729969024658 (6.616234302520752) | > loss_mel: 24.194520950317383 (25.659878730773926) | > loss_duration: 2.335721015930176 (2.3517770767211914) | > loss_1: 37.79549026489258 (40.10565376281738)  --> STEP: 3 | > loss_disc: 1.7540196180343628 (2.2611825863520303) | > loss_disc_real_0: 0.07560636103153229 (0.11474891503651936) | > loss_disc_real_1: 0.09954556822776794 (0.1324605494737625) | > loss_disc_real_2: 0.1606934517621994 (0.15041926751534143) | > loss_disc_real_3: 0.1876445710659027 (0.26611343026161194) | > loss_disc_real_4: 0.07542309165000916 (0.19037259121735892) | > loss_disc_real_5: 0.08546517789363861 (0.19232513507207236) | > loss_0: 1.7540196180343628 (2.2611825863520303) | > loss_gen: 2.3594579696655273 (2.2839344342549643) | > loss_kl: 1.3305693864822388 (2.5979167222976685) | > loss_feat: 7.672149658203125 (6.96820608774821) | > loss_mel: 25.700130462646484 (25.673295974731445) | > loss_duration: 2.2594549655914307 (2.321003039677938) | > loss_1: 39.3217658996582 (39.84435780843099) --> EVAL PERFORMANCE | > avg_loader_time: 0.010824839274088541 (+0.00870966911315918) | > avg_loss_disc: 2.2611825863520303 (-0.18553924560546875) | > avg_loss_disc_real_0: 0.11474891503651936 (-0.06893326838811238) | > avg_loss_disc_real_1: 0.1324605494737625 (-0.1270233045021693) | > avg_loss_disc_real_2: 0.15041926751534143 (-0.060357683648665755) | > avg_loss_disc_real_3: 0.26611343026161194 (+0.028628145654996245) | > avg_loss_disc_real_4: 0.19037259121735892 (-0.04915066063404083) | > avg_loss_disc_real_5: 0.19232513507207236 (-0.006382617789010198) | > avg_loss_0: 2.2611825863520303 (-0.18553924560546875) | > avg_loss_gen: 2.2839344342549643 (+0.030399799346923828) | > avg_loss_kl: 2.5979167222976685 (-0.10520052909851074) | > avg_loss_feat: 6.96820608774821 (+1.6023147503534956) | > avg_loss_mel: 25.673295974731445 (+0.2582308451334647) | > avg_loss_duration: 2.321003039677938 (-0.05316456158955862) | > avg_loss_1: 39.84435780843099 (+1.7325833638509138)  > EPOCH: 213/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:58:34)   --> TIME: 2023-10-20 01:58:42 -- STEP: 9/50 -- GLOBAL_STEP: 63660 | > loss_disc: 2.996613025665283 (2.303673187891642) | > loss_disc_real_0: 0.1500571072101593 (0.13401760616236263) | > loss_disc_real_1: 0.3101254999637604 (0.21710437701808083) | > loss_disc_real_2: 0.33184173703193665 (0.24662389606237411) | > loss_disc_real_3: 0.29001879692077637 (0.24441755563020706) | > loss_disc_real_4: 0.3203331530094147 (0.19003378061784637) | > loss_disc_real_5: 0.3286633789539337 (0.21882495118512046) | > loss_0: 2.996613025665283 (2.303673187891642) | > grad_norm_0: tensor(361.2254, device='cuda:0') (tensor(453.3061, device='cuda:0')) | > loss_gen: 1.8744139671325684 (2.5175499651167126) | > loss_kl: 0.6845802068710327 (0.9234558741251627) | > loss_feat: 1.3105652332305908 (6.237395127614339) | > loss_mel: 20.980424880981445 (25.31310929192437) | > loss_duration: 1.5801115036010742 (1.6218213902579413) | > loss_1: 26.430095672607422 (36.613331688774956) | > grad_norm_1: tensor(2640.1941, device='cuda:0') (tensor(14525.9512, device='cuda:0')) | > current_lr_0: 0.00016162907556256916 | > current_lr_1: 0.00016162907556256916 | > step_time: 0.2807 (0.4913319746653239) | > loader_time: 0.0245 (0.02025016148885091)  --> TIME: 2023-10-20 01:58:54 -- STEP: 39/50 -- GLOBAL_STEP: 63690 | > loss_disc: 2.334501028060913 (2.4738537012002406) | > loss_disc_real_0: 0.31283944845199585 (0.152420548387827) | > loss_disc_real_1: 0.18740710616111755 (0.22367729227512312) | > loss_disc_real_2: 0.288179874420166 (0.2348638511238954) | > loss_disc_real_3: 0.222855344414711 (0.2299163748916143) | > loss_disc_real_4: 0.3123931586742401 (0.23579783329310325) | > loss_disc_real_5: 0.36133110523223877 (0.2589843724018488) | > loss_0: 2.334501028060913 (2.4738537012002406) | > grad_norm_0: tensor(1050.2495, device='cuda:0') (tensor(483.3269, device='cuda:0')) | > loss_gen: 3.370265483856201 (2.414670895307492) | > loss_kl: 0.5228359699249268 (0.9428171821129627) | > loss_feat: 5.531272888183594 (5.270006544505937) | > loss_mel: 24.344093322753906 (24.404580617562317) | > loss_duration: 1.669014573097229 (1.641196574920263) | > loss_1: 35.43748092651367 (34.673272352952225) | > grad_norm_1: tensor(25714.4844, device='cuda:0') (tensor(16430.7969, device='cuda:0')) | > current_lr_0: 0.00016162907556256916 | > current_lr_1: 0.00016162907556256916 | > step_time: 0.2522 (0.39428618626716816) | > loader_time: 0.0024 (0.010299254686404496)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1526923179626465 (3.1526923179626465) | > loss_disc_real_0: 0.3464532792568207 (0.3464532792568207) | > loss_disc_real_1: 0.3692692220211029 (0.3692692220211029) | > loss_disc_real_2: 0.19880837202072144 (0.19880837202072144) | > loss_disc_real_3: 0.46546170115470886 (0.46546170115470886) | > loss_disc_real_4: 0.44448497891426086 (0.44448497891426086) | > loss_disc_real_5: 0.21232526004314423 (0.21232526004314423) | > loss_0: 3.1526923179626465 (3.1526923179626465) | > loss_gen: 2.559678077697754 (2.559678077697754) | > loss_kl: 2.448561191558838 (2.448561191558838) | > loss_feat: 5.605179309844971 (5.605179309844971) | > loss_mel: 24.403118133544922 (24.403118133544922) | > loss_duration: 2.248732566833496 (2.248732566833496) | > loss_1: 37.2652702331543 (37.2652702331543)  --> STEP: 1 | > loss_disc: 2.4272327423095703 (2.4272327423095703) | > loss_disc_real_0: 0.29298701882362366 (0.29298701882362366) | > loss_disc_real_1: 0.3787463307380676 (0.3787463307380676) | > loss_disc_real_2: 0.18468479812145233 (0.18468479812145233) | > loss_disc_real_3: 0.39364051818847656 (0.39364051818847656) | > loss_disc_real_4: 0.2412472367286682 (0.2412472367286682) | > loss_disc_real_5: 0.13637608289718628 (0.13637608289718628) | > loss_0: 2.4272327423095703 (2.4272327423095703) | > loss_gen: 3.1275007724761963 (3.1275007724761963) | > loss_kl: 3.382185935974121 (3.382185935974121) | > loss_feat: 5.477102279663086 (5.477102279663086) | > loss_mel: 26.76896858215332 (26.76896858215332) | > loss_duration: 2.432583808898926 (2.432583808898926) | > loss_1: 41.1883430480957 (41.1883430480957)  --> STEP: 2 | > loss_disc: 2.017613172531128 (2.222422957420349) | > loss_disc_real_0: 0.23432239890098572 (0.2636547088623047) | > loss_disc_real_1: 0.32023748755455017 (0.3494919091463089) | > loss_disc_real_2: 0.08554960787296295 (0.13511720299720764) | > loss_disc_real_3: 0.4639825224876404 (0.42881152033805847) | > loss_disc_real_4: 0.135447159409523 (0.1883471980690956) | > loss_disc_real_5: 0.05812894552946091 (0.0972525142133236) | > loss_0: 2.017613172531128 (2.222422957420349) | > loss_gen: 3.051422357559204 (3.0894615650177) | > loss_kl: 3.1221394538879395 (3.2521626949310303) | > loss_feat: 9.569190979003906 (7.523146629333496) | > loss_mel: 24.776165008544922 (25.77256679534912) | > loss_duration: 2.3829174041748047 (2.4077506065368652) | > loss_1: 42.901832580566406 (42.045087814331055)  --> STEP: 3 | > loss_disc: 2.6237378120422363 (2.356194575627645) | > loss_disc_real_0: 0.2952727973461151 (0.2741940716902415) | > loss_disc_real_1: 0.287208616733551 (0.3287308116753896) | > loss_disc_real_2: 0.24227072298526764 (0.17083504299322763) | > loss_disc_real_3: 0.35154423117637634 (0.40305575728416443) | > loss_disc_real_4: 0.2557673454284668 (0.21082058052221933) | > loss_disc_real_5: 0.25917667150497437 (0.15122723331054053) | > loss_0: 2.6237378120422363 (2.356194575627645) | > loss_gen: 2.620431423187256 (2.9331181844075522) | > loss_kl: 1.7585337162017822 (2.7542863686879477) | > loss_feat: 2.4779911041259766 (5.841428120930989) | > loss_mel: 19.46540069580078 (23.670178095499676) | > loss_duration: 2.3560874462127686 (2.3905295530954995) | > loss_1: 28.678443908691406 (37.58953984578451) --> EVAL PERFORMANCE | > avg_loader_time: 0.009175777435302734 (-0.0016490618387858067) | > avg_loss_disc: 2.356194575627645 (+0.09501198927561472) | > avg_loss_disc_real_0: 0.2741940716902415 (+0.15944515665372216) | > avg_loss_disc_real_1: 0.3287308116753896 (+0.19627026220162708) | > avg_loss_disc_real_2: 0.17083504299322763 (+0.0204157754778862) | > avg_loss_disc_real_3: 0.40305575728416443 (+0.1369423270225525) | > avg_loss_disc_real_4: 0.21082058052221933 (+0.020447989304860414) | > avg_loss_disc_real_5: 0.15122723331054053 (-0.04109790176153183) | > avg_loss_0: 2.356194575627645 (+0.09501198927561472) | > avg_loss_gen: 2.9331181844075522 (+0.6491837501525879) | > avg_loss_kl: 2.7542863686879477 (+0.15636964639027928) | > avg_loss_feat: 5.841428120930989 (-1.1267779668172206) | > avg_loss_mel: 23.670178095499676 (-2.0031178792317696) | > avg_loss_duration: 2.3905295530954995 (+0.06952651341756155) | > avg_loss_1: 37.58953984578451 (-2.2548179626464844)  > EPOCH: 214/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:59:11)   --> TIME: 2023-10-20 01:59:25 -- STEP: 19/50 -- GLOBAL_STEP: 63720 | > loss_disc: 2.6031486988067627 (2.689476496294925) | > loss_disc_real_0: 0.04640628397464752 (0.22922110361488243) | > loss_disc_real_1: 0.4109419286251068 (0.24240580867779882) | > loss_disc_real_2: 0.18491630256175995 (0.2316477837923326) | > loss_disc_real_3: 0.39733538031578064 (0.2595013713366107) | > loss_disc_real_4: 0.13442254066467285 (0.24597996688987078) | > loss_disc_real_5: 0.23463144898414612 (0.2571734125284772) | > loss_0: 2.6031486988067627 (2.689476496294925) | > grad_norm_0: tensor(418.0293, device='cuda:0') (tensor(383.2717, device='cuda:0')) | > loss_gen: 2.1935131549835205 (2.0858597065273083) | > loss_kl: 1.246904730796814 (0.9551158319962653) | > loss_feat: 4.598052978515625 (3.5737948092190837) | > loss_mel: 23.1080322265625 (20.8840592660402) | > loss_duration: 1.7446260452270508 (1.6907604556334646) | > loss_1: 32.89112854003906 (29.18958975139417) | > grad_norm_1: tensor(15754.3027, device='cuda:0') (tensor(18769.0703, device='cuda:0')) | > current_lr_0: 0.00016146751718205173 | > current_lr_1: 0.00016146751718205173 | > step_time: 0.3153 (0.4891209978806345) | > loader_time: 0.0234 (0.01802808360049599)  --> TIME: 2023-10-20 01:59:41 -- STEP: 49/50 -- GLOBAL_STEP: 63750 | > loss_disc: 1.4839718341827393 (2.503983220275568) | > loss_disc_real_0: 0.07726316154003143 (0.17563845726604366) | > loss_disc_real_1: 0.15221495926380157 (0.22786452301910945) | > loss_disc_real_2: 0.04657851159572601 (0.2076062856584179) | > loss_disc_real_3: 0.33185702562332153 (0.2502713216354653) | > loss_disc_real_4: 0.18984484672546387 (0.2330221763374854) | > loss_disc_real_5: 0.025754230096936226 (0.2183967768309676) | > loss_0: 1.4839718341827393 (2.503983220275568) | > grad_norm_0: tensor(334.9603, device='cuda:0') (tensor(426.5589, device='cuda:0')) | > loss_gen: 3.3931775093078613 (2.2213305770134437) | > loss_kl: 0.5889891386032104 (0.9041769218688108) | > loss_feat: 8.229134559631348 (4.513376558465617) | > loss_mel: 23.16478729248047 (23.129333101973238) | > loss_duration: 1.8246197700500488 (1.65276985509055) | > loss_1: 37.200706481933594 (32.420986662105626) | > grad_norm_1: tensor(11652.2852, device='cuda:0') (tensor(17205.6211, device='cuda:0')) | > current_lr_0: 0.00016146751718205173 | > current_lr_1: 0.00016146751718205173 | > step_time: 0.4666 (0.49261288253628477) | > loader_time: 0.3323 (0.02620587056996871)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6582207679748535 (2.6582207679748535) | > loss_disc_real_0: 0.11805151402950287 (0.11805151402950287) | > loss_disc_real_1: 0.2666896879673004 (0.2666896879673004) | > loss_disc_real_2: 0.4543764591217041 (0.4543764591217041) | > loss_disc_real_3: 0.2756997346878052 (0.2756997346878052) | > loss_disc_real_4: 0.32804107666015625 (0.32804107666015625) | > loss_disc_real_5: 0.3199133276939392 (0.3199133276939392) | > loss_0: 2.6582207679748535 (2.6582207679748535) | > loss_gen: 2.8996779918670654 (2.8996779918670654) | > loss_kl: 2.765200138092041 (2.765200138092041) | > loss_feat: 4.2392988204956055 (4.2392988204956055) | > loss_mel: 26.420467376708984 (26.420467376708984) | > loss_duration: 2.299048900604248 (2.299048900604248) | > loss_1: 38.62369155883789 (38.62369155883789)  --> STEP: 1 | > loss_disc: 1.4220277070999146 (1.4220277070999146) | > loss_disc_real_0: 0.046631019562482834 (0.046631019562482834) | > loss_disc_real_1: 0.18886679410934448 (0.18886679410934448) | > loss_disc_real_2: 0.26667529344558716 (0.26667529344558716) | > loss_disc_real_3: 0.050225310027599335 (0.050225310027599335) | > loss_disc_real_4: 0.0374058298766613 (0.0374058298766613) | > loss_disc_real_5: 0.10652687400579453 (0.10652687400579453) | > loss_0: 1.4220277070999146 (1.4220277070999146) | > loss_gen: 2.948770046234131 (2.948770046234131) | > loss_kl: 3.2776200771331787 (3.2776200771331787) | > loss_feat: 12.213895797729492 (12.213895797729492) | > loss_mel: 28.486873626708984 (28.486873626708984) | > loss_duration: 2.4519476890563965 (2.4519476890563965) | > loss_1: 49.37910461425781 (49.37910461425781)  --> STEP: 2 | > loss_disc: 2.9369091987609863 (2.1794684529304504) | > loss_disc_real_0: 0.195730060338974 (0.12118053995072842) | > loss_disc_real_1: 0.30077308416366577 (0.24481993913650513) | > loss_disc_real_2: 0.22432686388492584 (0.2455010786652565) | > loss_disc_real_3: 0.3237978518009186 (0.18701158091425896) | > loss_disc_real_4: 0.21415042877197266 (0.12577812932431698) | > loss_disc_real_5: 0.2277350276708603 (0.1671309508383274) | > loss_0: 2.9369091987609863 (2.1794684529304504) | > loss_gen: 1.569039225578308 (2.2589046359062195) | > loss_kl: 3.0712530612945557 (3.174436569213867) | > loss_feat: 0.20938906073570251 (6.211642429232597) | > loss_mel: 4.349658966064453 (16.41826629638672) | > loss_duration: 2.372021198272705 (2.411984443664551) | > loss_1: 11.571361541748047 (30.47523307800293)  --> STEP: 3 | > loss_disc: 2.9371769428253174 (2.4320379495620728) | > loss_disc_real_0: 0.1958051323890686 (0.1460554040968418) | > loss_disc_real_1: 0.3007698655128479 (0.26346991459528607) | > loss_disc_real_2: 0.22442851960659027 (0.23847689231236777) | > loss_disc_real_3: 0.3237816393375397 (0.23260160038868585) | > loss_disc_real_4: 0.2141747921705246 (0.15524368360638618) | > loss_disc_real_5: 0.2277224063873291 (0.18732810268799463) | > loss_0: 2.9371769428253174 (2.4320379495620728) | > loss_gen: 1.5689467191696167 (2.028918663660685) | > loss_kl: 1.1131386756896973 (2.487337271372477) | > loss_feat: 0.2087540477514267 (4.2106796354055405) | > loss_mel: 3.1387381553649902 (11.991756916046143) | > loss_duration: 2.3120017051696777 (2.3786568641662598) | > loss_1: 8.34157943725586 (23.09734853108724) --> EVAL PERFORMANCE | > avg_loader_time: 0.002520958582560221 (-0.006654818852742514) | > avg_loss_disc: 2.4320379495620728 (+0.07584337393442775) | > avg_loss_disc_real_0: 0.1460554040968418 (-0.1281386675933997) | > avg_loss_disc_real_1: 0.26346991459528607 (-0.06526089708010352) | > avg_loss_disc_real_2: 0.23847689231236777 (+0.06764184931914013) | > avg_loss_disc_real_3: 0.23260160038868585 (-0.17045415689547858) | > avg_loss_disc_real_4: 0.15524368360638618 (-0.055576896915833146) | > avg_loss_disc_real_5: 0.18732810268799463 (+0.0361008693774541) | > avg_loss_0: 2.4320379495620728 (+0.07584337393442775) | > avg_loss_gen: 2.028918663660685 (-0.9041995207468672) | > avg_loss_kl: 2.487337271372477 (-0.2669490973154707) | > avg_loss_feat: 4.2106796354055405 (-1.6307484855254488) | > avg_loss_mel: 11.991756916046143 (-11.678421179453533) | > avg_loss_duration: 2.3786568641662598 (-0.01187268892923976) | > avg_loss_1: 23.09734853108724 (-14.49219131469727)  > EPOCH: 215/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 01:59:52)   --> TIME: 2023-10-20 02:00:11 -- STEP: 29/50 -- GLOBAL_STEP: 63780 | > loss_disc: 2.2573769092559814 (2.4588887362644596) | > loss_disc_real_0: 0.08981238305568695 (0.14370855509207164) | > loss_disc_real_1: 0.26341554522514343 (0.23097752587034784) | > loss_disc_real_2: 0.22745166718959808 (0.24051211228401492) | > loss_disc_real_3: 0.14972533285617828 (0.23527953067216373) | > loss_disc_real_4: 0.2059958577156067 (0.24259332403669073) | > loss_disc_real_5: 0.3140055239200592 (0.26520328795344666) | > loss_0: 2.2573769092559814 (2.4588887362644596) | > grad_norm_0: tensor(437.8250, device='cuda:0') (tensor(662.0938, device='cuda:0')) | > loss_gen: 2.576082706451416 (2.6371400726252587) | > loss_kl: 0.8375090956687927 (0.9939452430297588) | > loss_feat: 5.171897888183594 (6.59700860018874) | > loss_mel: 21.85122299194336 (25.971798859793566) | > loss_duration: 1.6045349836349487 (1.6751831441090024) | > loss_1: 32.0412483215332 (37.8750764254866) | > grad_norm_1: tensor(11021.1074, device='cuda:0') (tensor(26698.2715, device='cuda:0')) | > current_lr_0: 0.00016130612028925065 | > current_lr_1: 0.00016130612028925065 | > step_time: 0.3259 (0.4950735322360336) | > loader_time: 0.0251 (0.01456105298009412)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.282508373260498 (2.282508373260498) | > loss_disc_real_0: 0.17512255907058716 (0.17512255907058716) | > loss_disc_real_1: 0.11295410990715027 (0.11295410990715027) | > loss_disc_real_2: 0.16217440366744995 (0.16217440366744995) | > loss_disc_real_3: 0.19599661231040955 (0.19599661231040955) | > loss_disc_real_4: 0.3156132698059082 (0.3156132698059082) | > loss_disc_real_5: 0.3807527720928192 (0.3807527720928192) | > loss_0: 2.282508373260498 (2.282508373260498) | > loss_gen: 2.696406364440918 (2.696406364440918) | > loss_kl: 2.382598400115967 (2.382598400115967) | > loss_feat: 6.6550374031066895 (6.6550374031066895) | > loss_mel: 24.534631729125977 (24.534631729125977) | > loss_duration: 2.247103452682495 (2.247103452682495) | > loss_1: 38.515777587890625 (38.515777587890625)  --> STEP: 1 | > loss_disc: 2.949495315551758 (2.949495315551758) | > loss_disc_real_0: 0.28968513011932373 (0.28968513011932373) | > loss_disc_real_1: 0.26347553730010986 (0.26347553730010986) | > loss_disc_real_2: 0.2470233291387558 (0.2470233291387558) | > loss_disc_real_3: 0.24434974789619446 (0.24434974789619446) | > loss_disc_real_4: 0.27658143639564514 (0.27658143639564514) | > loss_disc_real_5: 0.2926795184612274 (0.2926795184612274) | > loss_0: 2.949495315551758 (2.949495315551758) | > loss_gen: 1.6983360052108765 (1.6983360052108765) | > loss_kl: 3.1774492263793945 (3.1774492263793945) | > loss_feat: 0.17528878152370453 (0.17528878152370453) | > loss_mel: 15.642797470092773 (15.642797470092773) | > loss_duration: 2.4071261882781982 (2.4071261882781982) | > loss_1: 23.100996017456055 (23.100996017456055)  --> STEP: 2 | > loss_disc: 1.9870059490203857 (2.4682506322860718) | > loss_disc_real_0: 0.011493750847876072 (0.1505894404835999) | > loss_disc_real_1: 0.13394290208816528 (0.19870921969413757) | > loss_disc_real_2: 0.10796955227851868 (0.17749644070863724) | > loss_disc_real_3: 0.3406471014022827 (0.2924984246492386) | > loss_disc_real_4: 0.16337108612060547 (0.2199762612581253) | > loss_disc_real_5: 0.09870823472738266 (0.19569387659430504) | > loss_0: 1.9870059490203857 (2.4682506322860718) | > loss_gen: 2.1076629161834717 (1.902999460697174) | > loss_kl: 3.094548225402832 (3.1359987258911133) | > loss_feat: 7.225337982177734 (3.7003133818507195) | > loss_mel: 26.160762786865234 (20.901780128479004) | > loss_duration: 2.389599084854126 (2.398362636566162) | > loss_1: 40.977909088134766 (32.03945255279541)  --> STEP: 3 | > loss_disc: 2.8680267333984375 (2.6015093326568604) | > loss_disc_real_0: 0.2722800076007843 (0.1911529628559947) | > loss_disc_real_1: 0.32311922311782837 (0.24017922083536783) | > loss_disc_real_2: 0.2922833561897278 (0.21575874586900076) | > loss_disc_real_3: 0.35301071405410767 (0.31266918778419495) | > loss_disc_real_4: 0.2633168697357178 (0.23442313075065613) | > loss_disc_real_5: 0.32347795367240906 (0.23828856895367304) | > loss_0: 2.8680267333984375 (2.6015093326568604) | > loss_gen: 2.1445374488830566 (1.9835121234258015) | > loss_kl: 1.1494702100753784 (2.473822553952535) | > loss_feat: 2.1644248962402344 (3.188350553313891) | > loss_mel: 23.765445709228516 (21.856335322062176) | > loss_duration: 2.2253174781799316 (2.3406809171040854) | > loss_1: 31.449195861816406 (31.842700322469074) --> EVAL PERFORMANCE | > avg_loader_time: 0.011028051376342773 (+0.008507092793782553) | > avg_loss_disc: 2.6015093326568604 (+0.1694713830947876) | > avg_loss_disc_real_0: 0.1911529628559947 (+0.04509755875915289) | > avg_loss_disc_real_1: 0.24017922083536783 (-0.02329069375991824) | > avg_loss_disc_real_2: 0.21575874586900076 (-0.022718146443367004) | > avg_loss_disc_real_3: 0.31266918778419495 (+0.0800675873955091) | > avg_loss_disc_real_4: 0.23442313075065613 (+0.07917944714426994) | > avg_loss_disc_real_5: 0.23828856895367304 (+0.050960466265678406) | > avg_loss_0: 2.6015093326568604 (+0.1694713830947876) | > avg_loss_gen: 1.9835121234258015 (-0.04540654023488355) | > avg_loss_kl: 2.473822553952535 (-0.013514717419941924) | > avg_loss_feat: 3.188350553313891 (-1.0223290820916495) | > avg_loss_mel: 21.856335322062176 (+9.864578406016033) | > avg_loss_duration: 2.3406809171040854 (-0.03797594706217433) | > avg_loss_1: 31.842700322469074 (+8.745351791381836)  > EPOCH: 216/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:00:32)   --> TIME: 2023-10-20 02:00:40 -- STEP: 9/50 -- GLOBAL_STEP: 63810 | > loss_disc: 3.254263401031494 (2.346947352091471) | > loss_disc_real_0: 0.01317461859434843 (0.1659300092400776) | > loss_disc_real_1: 0.4121626019477844 (0.26758039163218605) | > loss_disc_real_2: 0.5460982322692871 (0.23201284888717863) | > loss_disc_real_3: 0.3615407347679138 (0.25113263560665977) | > loss_disc_real_4: 0.36378777027130127 (0.2111304509970877) | > loss_disc_real_5: 0.4264008700847626 (0.2131115918358167) | > loss_0: 3.254263401031494 (2.346947352091471) | > grad_norm_0: tensor(989.7430, device='cuda:0') (tensor(693.8641, device='cuda:0')) | > loss_gen: 2.401578187942505 (2.699323574701945) | > loss_kl: 1.1386398077011108 (1.046926478544871) | > loss_feat: 3.0330045223236084 (5.696228477689955) | > loss_mel: 28.474166870117188 (25.46983422173394) | > loss_duration: 1.5728516578674316 (1.624932222896152) | > loss_1: 36.620243072509766 (36.53724479675293) | > grad_norm_1: tensor(10624.6104, device='cuda:0') (tensor(23230.3223, device='cuda:0')) | > current_lr_0: 0.00016114488472274892 | > current_lr_1: 0.00016114488472274892 | > step_time: 0.5796 (0.4860453075832791) | > loader_time: 0.012 (0.019773695203993056)  --> TIME: 2023-10-20 02:00:51 -- STEP: 39/50 -- GLOBAL_STEP: 63840 | > loss_disc: 3.3806681632995605 (2.4118133233143735) | > loss_disc_real_0: 0.12949909269809723 (0.1495519767348201) | > loss_disc_real_1: 0.1928325742483139 (0.23581289729246727) | > loss_disc_real_2: 0.41137218475341797 (0.23655952627842242) | > loss_disc_real_3: 0.2522449493408203 (0.23535979118866798) | > loss_disc_real_4: 0.3161320984363556 (0.21454377185839874) | > loss_disc_real_5: 0.3416098654270172 (0.21574044877137893) | > loss_0: 3.3806681632995605 (2.4118133233143735) | > grad_norm_0: tensor(3781.7043, device='cuda:0') (tensor(869.2778, device='cuda:0')) | > loss_gen: 1.7038462162017822 (2.4580566791387706) | > loss_kl: 0.7236632704734802 (1.0458762233073895) | > loss_feat: 4.376224517822266 (5.667810624990707) | > loss_mel: 24.6425838470459 (25.289990302843922) | > loss_duration: 1.6986693143844604 (1.639672114298894) | > loss_1: 33.14498519897461 (36.101405950692985) | > grad_norm_1: tensor(32115.2031, device='cuda:0') (tensor(28757.6738, device='cuda:0')) | > current_lr_0: 0.00016114488472274892 | > current_lr_1: 0.00016114488472274892 | > step_time: 0.2922 (0.3848537970811893) | > loader_time: 0.0022 (0.010473385835305238)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4999301433563232 (2.4999301433563232) | > loss_disc_real_0: 0.2625522017478943 (0.2625522017478943) | > loss_disc_real_1: 0.2260526418685913 (0.2260526418685913) | > loss_disc_real_2: 0.2806127965450287 (0.2806127965450287) | > loss_disc_real_3: 0.14568562805652618 (0.14568562805652618) | > loss_disc_real_4: 0.2738146483898163 (0.2738146483898163) | > loss_disc_real_5: 0.2516203820705414 (0.2516203820705414) | > loss_0: 2.4999301433563232 (2.4999301433563232) | > loss_gen: 2.5077548027038574 (2.5077548027038574) | > loss_kl: 2.453535556793213 (2.453535556793213) | > loss_feat: 5.053860664367676 (5.053860664367676) | > loss_mel: 22.337547302246094 (22.337547302246094) | > loss_duration: 2.307286500930786 (2.307286500930786) | > loss_1: 34.65998458862305 (34.65998458862305)  --> STEP: 1 | > loss_disc: 1.4779592752456665 (1.4779592752456665) | > loss_disc_real_0: 0.13222487270832062 (0.13222487270832062) | > loss_disc_real_1: 0.2818731367588043 (0.2818731367588043) | > loss_disc_real_2: 0.17287561297416687 (0.17287561297416687) | > loss_disc_real_3: 0.034280359745025635 (0.034280359745025635) | > loss_disc_real_4: 0.0871552973985672 (0.0871552973985672) | > loss_disc_real_5: 0.02549632452428341 (0.02549632452428341) | > loss_0: 1.4779592752456665 (1.4779592752456665) | > loss_gen: 4.735125541687012 (4.735125541687012) | > loss_kl: 3.6686575412750244 (3.6686575412750244) | > loss_feat: 13.329673767089844 (13.329673767089844) | > loss_mel: 26.570255279541016 (26.570255279541016) | > loss_duration: 2.4414429664611816 (2.4414429664611816) | > loss_1: 50.74515914916992 (50.74515914916992)  --> STEP: 2 | > loss_disc: 3.0618627071380615 (2.269910991191864) | > loss_disc_real_0: 0.39599478244781494 (0.2641098275780678) | > loss_disc_real_1: 0.31395643949508667 (0.2979147881269455) | > loss_disc_real_2: 0.3089846670627594 (0.24093014001846313) | > loss_disc_real_3: 0.2659018337726593 (0.15009109675884247) | > loss_disc_real_4: 0.2869117856025696 (0.1870335415005684) | > loss_disc_real_5: 0.29496222734451294 (0.16022927593439817) | > loss_0: 3.0618627071380615 (2.269910991191864) | > loss_gen: 1.8586872816085815 (3.2969064116477966) | > loss_kl: 3.1717121601104736 (3.420184850692749) | > loss_feat: 0.035852156579494476 (6.682762961834669) | > loss_mel: 2.3508493900299072 (14.460552334785461) | > loss_duration: 2.4598753452301025 (2.450659155845642) | > loss_1: 9.876976013183594 (30.311067581176758)  --> STEP: 3 | > loss_disc: 2.2097222805023193 (2.2498480876286826) | > loss_disc_real_0: 0.24525411427021027 (0.2578245898087819) | > loss_disc_real_1: 0.203659325838089 (0.26649630069732666) | > loss_disc_real_2: 0.15616805851459503 (0.2126761128505071) | > loss_disc_real_3: 0.22296476364135742 (0.17438231905301413) | > loss_disc_real_4: 0.25506332516670227 (0.20971013605594635) | > loss_disc_real_5: 0.3035910129547119 (0.2080165216078361) | > loss_0: 2.2097222805023193 (2.2498480876286826) | > loss_gen: 2.8504841327667236 (3.1480989853541055) | > loss_kl: 1.598446011543274 (2.8129385709762573) | > loss_feat: 4.904195785522461 (6.089907236397266) | > loss_mel: 21.658740997314453 (16.85994855562846) | > loss_duration: 2.3948872089385986 (2.4320685068766275) | > loss_1: 33.40675354003906 (31.342962900797527) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022236506144205728 (-0.008804400761922201) | > avg_loss_disc: 2.2498480876286826 (-0.35166124502817775) | > avg_loss_disc_real_0: 0.2578245898087819 (+0.06667162695278722) | > avg_loss_disc_real_1: 0.26649630069732666 (+0.02631707986195883) | > avg_loss_disc_real_2: 0.2126761128505071 (-0.0030826330184936523) | > avg_loss_disc_real_3: 0.17438231905301413 (-0.13828686873118082) | > avg_loss_disc_real_4: 0.20971013605594635 (-0.024712994694709778) | > avg_loss_disc_real_5: 0.2080165216078361 (-0.03027204734583694) | > avg_loss_0: 2.2498480876286826 (-0.35166124502817775) | > avg_loss_gen: 3.1480989853541055 (+1.164586861928304) | > avg_loss_kl: 2.8129385709762573 (+0.3391160170237222) | > avg_loss_feat: 6.089907236397266 (+2.9015566830833754) | > avg_loss_mel: 16.85994855562846 (-4.996386766433716) | > avg_loss_duration: 2.4320685068766275 (+0.09138758977254202) | > avg_loss_1: 31.342962900797527 (-0.4997374216715471)  > EPOCH: 217/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:01:09)   --> TIME: 2023-10-20 02:01:23 -- STEP: 19/50 -- GLOBAL_STEP: 63870 | > loss_disc: 2.298308849334717 (2.579729287247909) | > loss_disc_real_0: 0.042770542204380035 (0.17843232578352877) | > loss_disc_real_1: 0.17817337810993195 (0.2373517120355054) | > loss_disc_real_2: 0.15814612805843353 (0.2601488105168468) | > loss_disc_real_3: 0.19176088273525238 (0.2643007883115819) | > loss_disc_real_4: 0.17030200362205505 (0.2635687869042158) | > loss_disc_real_5: 0.07208863645792007 (0.21136025300151423) | > loss_0: 2.298308849334717 (2.579729287247909) | > grad_norm_0: tensor(1757.9551, device='cuda:0') (tensor(1447.2319, device='cuda:0')) | > loss_gen: 1.7578314542770386 (2.3146360861627677) | > loss_kl: 1.197928786277771 (0.9414876573964169) | > loss_feat: 3.587862014770508 (4.074691794714646) | > loss_mel: 26.365629196166992 (19.398130793320504) | > loss_duration: 1.7649543285369873 (1.6811811673013788) | > loss_1: 34.6742057800293 (28.410127413900273) | > grad_norm_1: tensor(12241.4248, device='cuda:0') (tensor(48201.8750, device='cuda:0')) | > current_lr_0: 0.00016098381032129074 | > current_lr_1: 0.00016098381032129074 | > step_time: 0.5401 (0.5204483584353798) | > loader_time: 0.0221 (0.020704043538946854)  --> TIME: 2023-10-20 02:01:39 -- STEP: 49/50 -- GLOBAL_STEP: 63900 | > loss_disc: 2.3838748931884766 (2.4651466121478958) | > loss_disc_real_0: 0.2500491142272949 (0.16759043762802472) | > loss_disc_real_1: 0.23881123960018158 (0.22230250365575965) | > loss_disc_real_2: 0.23662836849689484 (0.23173444056693387) | > loss_disc_real_3: 0.36413466930389404 (0.24806322856825225) | > loss_disc_real_4: 0.4003327190876007 (0.23981179981207362) | > loss_disc_real_5: 0.24815107882022858 (0.22204075987469785) | > loss_0: 2.3838748931884766 (2.4651466121478958) | > grad_norm_0: tensor(1421.5286, device='cuda:0') (tensor(1422.6466, device='cuda:0')) | > loss_gen: 3.1727523803710938 (2.3841281375106504) | > loss_kl: 0.38201358914375305 (0.9270807182302281) | > loss_feat: 4.335346698760986 (4.9513597179356275) | > loss_mel: 27.002836227416992 (21.868970900165795) | > loss_duration: 1.7377358675003052 (1.6497441603212941) | > loss_1: 36.63068389892578 (31.781283582959855) | > grad_norm_1: tensor(23106.6367, device='cuda:0') (tensor(42857.9727, device='cuda:0')) | > current_lr_0: 0.00016098381032129074 | > current_lr_1: 0.00016098381032129074 | > step_time: 0.6532 (0.5049499589569717) | > loader_time: 0.3781 (0.028457923811309186)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.462858200073242 (2.462858200073242) | > loss_disc_real_0: 0.20575623214244843 (0.20575623214244843) | > loss_disc_real_1: 0.26306983828544617 (0.26306983828544617) | > loss_disc_real_2: 0.19960860908031464 (0.19960860908031464) | > loss_disc_real_3: 0.32196569442749023 (0.32196569442749023) | > loss_disc_real_4: 0.16707688570022583 (0.16707688570022583) | > loss_disc_real_5: 0.6154651641845703 (0.6154651641845703) | > loss_0: 2.462858200073242 (2.462858200073242) | > loss_gen: 3.0702223777770996 (3.0702223777770996) | > loss_kl: 2.6055362224578857 (2.6055362224578857) | > loss_feat: 6.440162181854248 (6.440162181854248) | > loss_mel: 22.02593231201172 (22.02593231201172) | > loss_duration: 2.231992721557617 (2.231992721557617) | > loss_1: 36.37384796142578 (36.37384796142578)  --> STEP: 1 | > loss_disc: 2.965339183807373 (2.965339183807373) | > loss_disc_real_0: 0.09084201604127884 (0.09084201604127884) | > loss_disc_real_1: 0.24590139091014862 (0.24590139091014862) | > loss_disc_real_2: 0.26783618330955505 (0.26783618330955505) | > loss_disc_real_3: 0.2522187829017639 (0.2522187829017639) | > loss_disc_real_4: 0.27068617939949036 (0.27068617939949036) | > loss_disc_real_5: 0.2937154471874237 (0.2937154471874237) | > loss_0: 2.965339183807373 (2.965339183807373) | > loss_gen: 1.491600513458252 (1.491600513458252) | > loss_kl: 2.9095044136047363 (2.9095044136047363) | > loss_feat: 0.2785623073577881 (0.2785623073577881) | > loss_mel: 16.201446533203125 (16.201446533203125) | > loss_duration: 2.3702023029327393 (2.3702023029327393) | > loss_1: 23.25131607055664 (23.25131607055664)  --> STEP: 2 | > loss_disc: 3.074183940887451 (3.019761562347412) | > loss_disc_real_0: 0.4847705662250519 (0.28780629113316536) | > loss_disc_real_1: 0.267575740814209 (0.2567385658621788) | > loss_disc_real_2: 0.33054450154304504 (0.29919034242630005) | > loss_disc_real_3: 0.2875981330871582 (0.26990845799446106) | > loss_disc_real_4: 0.2582113742828369 (0.26444877684116364) | > loss_disc_real_5: 0.3446805775165558 (0.31919801235198975) | > loss_0: 3.074183940887451 (3.019761562347412) | > loss_gen: 2.176826238632202 (1.834213376045227) | > loss_kl: 3.3084208965301514 (3.108962655067444) | > loss_feat: 1.2978150844573975 (0.7881886959075928) | > loss_mel: 24.660629272460938 (20.43103790283203) | > loss_duration: 2.399165153503418 (2.3846837282180786) | > loss_1: 33.842857360839844 (28.547086715698242)  --> STEP: 3 | > loss_disc: 3.065156936645508 (3.034893353780111) | > loss_disc_real_0: 0.3568306565284729 (0.3108144129316012) | > loss_disc_real_1: 0.4115174412727356 (0.3083315243323644) | > loss_disc_real_2: 0.37720102071762085 (0.3251939018567403) | > loss_disc_real_3: 0.3812355697154999 (0.3070174952348073) | > loss_disc_real_4: 0.3334600031375885 (0.2874525189399719) | > loss_disc_real_5: 0.3956905007362366 (0.344695508480072) | > loss_0: 3.065156936645508 (3.034893353780111) | > loss_gen: 2.728790760040283 (2.1324058373769126) | > loss_kl: 1.1947712898254395 (2.4708988666534424) | > loss_feat: 2.32369327545166 (1.3000235557556152) | > loss_mel: 20.480327606201172 (20.447467803955078) | > loss_duration: 2.257136583328247 (2.3421680132548013) | > loss_1: 28.98472023010254 (28.692964553833008) --> EVAL PERFORMANCE | > avg_loader_time: 0.015032609303792318 (+0.012808958689371746) | > avg_loss_disc: 3.034893353780111 (+0.7850452661514282) | > avg_loss_disc_real_0: 0.3108144129316012 (+0.0529898231228193) | > avg_loss_disc_real_1: 0.3083315243323644 (+0.04183522363503772) | > avg_loss_disc_real_2: 0.3251939018567403 (+0.11251778900623319) | > avg_loss_disc_real_3: 0.3070174952348073 (+0.13263517618179319) | > avg_loss_disc_real_4: 0.2874525189399719 (+0.07774238288402557) | > avg_loss_disc_real_5: 0.344695508480072 (+0.13667898687223592) | > avg_loss_0: 3.034893353780111 (+0.7850452661514282) | > avg_loss_gen: 2.1324058373769126 (-1.015693147977193) | > avg_loss_kl: 2.4708988666534424 (-0.34203970432281494) | > avg_loss_feat: 1.3000235557556152 (-4.789883680641651) | > avg_loss_mel: 20.447467803955078 (+3.5875192483266183) | > avg_loss_duration: 2.3421680132548013 (-0.08990049362182617) | > avg_loss_1: 28.692964553833008 (-2.6499983469645194)  > EPOCH: 218/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:01:50)   --> TIME: 2023-10-20 02:02:08 -- STEP: 29/50 -- GLOBAL_STEP: 63930 | > loss_disc: 2.772031784057617 (2.3484613813202957) | > loss_disc_real_0: 0.2416052669286728 (0.15396357709863062) | > loss_disc_real_1: 0.24945218861103058 (0.22163473660575933) | > loss_disc_real_2: 0.19449679553508759 (0.2045325018979352) | > loss_disc_real_3: 0.3092012107372284 (0.23709762661621492) | > loss_disc_real_4: 0.27378177642822266 (0.20659921806434106) | > loss_disc_real_5: 0.30067890882492065 (0.19972620975097705) | > loss_0: 2.772031784057617 (2.3484613813202957) | > grad_norm_0: tensor(1724.5005, device='cuda:0') (tensor(975.6063, device='cuda:0')) | > loss_gen: 1.9938730001449585 (2.4614203880573147) | > loss_kl: 1.0046719312667847 (1.069376030872608) | > loss_feat: 1.3386417627334595 (6.072984389190016) | > loss_mel: 17.48780059814453 (22.459106058909974) | > loss_duration: 1.641783356666565 (1.6634022655158207) | > loss_1: 23.46677017211914 (33.72628937096431) | > grad_norm_1: tensor(4617.3330, device='cuda:0') (tensor(48999.5547, device='cuda:0')) | > current_lr_0: 0.00016082289692378156 | > current_lr_1: 0.00016082289692378156 | > step_time: 0.5243 (0.4621059483495252) | > loader_time: 0.0059 (0.012585648174943596)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5990469455718994 (2.5990469455718994) | > loss_disc_real_0: 0.23746657371520996 (0.23746657371520996) | > loss_disc_real_1: 0.2909829616546631 (0.2909829616546631) | > loss_disc_real_2: 0.22299307584762573 (0.22299307584762573) | > loss_disc_real_3: 0.23256313800811768 (0.23256313800811768) | > loss_disc_real_4: 0.29716652631759644 (0.29716652631759644) | > loss_disc_real_5: 0.18727603554725647 (0.18727603554725647) | > loss_0: 2.5990469455718994 (2.5990469455718994) | > loss_gen: 1.9697864055633545 (1.9697864055633545) | > loss_kl: 3.319329023361206 (3.319329023361206) | > loss_feat: 1.74335515499115 (1.74335515499115) | > loss_mel: 20.974166870117188 (20.974166870117188) | > loss_duration: 2.2799248695373535 (2.2799248695373535) | > loss_1: 30.28656005859375 (30.28656005859375)  --> STEP: 1 | > loss_disc: 2.941150426864624 (2.941150426864624) | > loss_disc_real_0: 0.27157679200172424 (0.27157679200172424) | > loss_disc_real_1: 0.35064756870269775 (0.35064756870269775) | > loss_disc_real_2: 0.19034264981746674 (0.19034264981746674) | > loss_disc_real_3: 0.26258784532546997 (0.26258784532546997) | > loss_disc_real_4: 0.24735979735851288 (0.24735979735851288) | > loss_disc_real_5: 0.4614042043685913 (0.4614042043685913) | > loss_0: 2.941150426864624 (2.941150426864624) | > loss_gen: 2.295830249786377 (2.295830249786377) | > loss_kl: 3.9253692626953125 (3.9253692626953125) | > loss_feat: 4.510368824005127 (4.510368824005127) | > loss_mel: 25.54364776611328 (25.54364776611328) | > loss_duration: 2.4727537631988525 (2.4727537631988525) | > loss_1: 38.74797058105469 (38.74797058105469)  --> STEP: 2 | > loss_disc: 2.482120990753174 (2.711635708808899) | > loss_disc_real_0: 0.08242802321910858 (0.1770024076104164) | > loss_disc_real_1: 0.3068802058696747 (0.3287638872861862) | > loss_disc_real_2: 0.25735795497894287 (0.2238503023982048) | > loss_disc_real_3: 0.2798440456390381 (0.27121594548225403) | > loss_disc_real_4: 0.31005656719207764 (0.27870818227529526) | > loss_disc_real_5: 0.3409396708011627 (0.401171937584877) | > loss_0: 2.482120990753174 (2.711635708808899) | > loss_gen: 2.6701159477233887 (2.482973098754883) | > loss_kl: 3.010321855545044 (3.4678455591201782) | > loss_feat: 5.523559093475342 (5.016963958740234) | > loss_mel: 27.89432144165039 (26.718984603881836) | > loss_duration: 2.381406784057617 (2.427080273628235) | > loss_1: 41.47972869873047 (40.11384963989258)  --> STEP: 3 | > loss_disc: 2.542243003845215 (2.6551714738210044) | > loss_disc_real_0: 0.23534703254699707 (0.19645061592260996) | > loss_disc_real_1: 0.2726890742778778 (0.31007228295008343) | > loss_disc_real_2: 0.15701907873153687 (0.20157322784264883) | > loss_disc_real_3: 0.29793402552604675 (0.28012197216351825) | > loss_disc_real_4: 0.3047895133495331 (0.2874019593000412) | > loss_disc_real_5: 0.3642834722995758 (0.3888757824897766) | > loss_0: 2.542243003845215 (2.6551714738210044) | > loss_gen: 2.428445339202881 (2.4647971789042153) | > loss_kl: 1.66146981716156 (2.8657203118006387) | > loss_feat: 3.6901562213897705 (4.574694712956746) | > loss_mel: 21.89249038696289 (25.110153198242188) | > loss_duration: 2.277578830718994 (2.3772464593251548) | > loss_1: 31.95013999938965 (37.392613093058266) --> EVAL PERFORMANCE | > avg_loader_time: 0.015861113866170246 (+0.000828504562377928) | > avg_loss_disc: 2.6551714738210044 (-0.37972187995910645) | > avg_loss_disc_real_0: 0.19645061592260996 (-0.11436379700899127) | > avg_loss_disc_real_1: 0.31007228295008343 (+0.0017407586177190515) | > avg_loss_disc_real_2: 0.20157322784264883 (-0.12362067401409146) | > avg_loss_disc_real_3: 0.28012197216351825 (-0.026895523071289062) | > avg_loss_disc_real_4: 0.2874019593000412 (-5.05596399307251e-05) | > avg_loss_disc_real_5: 0.3888757824897766 (+0.04418027400970459) | > avg_loss_0: 2.6551714738210044 (-0.37972187995910645) | > avg_loss_gen: 2.4647971789042153 (+0.33239134152730276) | > avg_loss_kl: 2.8657203118006387 (+0.3948214451471963) | > avg_loss_feat: 4.574694712956746 (+3.274671157201131) | > avg_loss_mel: 25.110153198242188 (+4.662685394287109) | > avg_loss_duration: 2.3772464593251548 (+0.035078446070353486) | > avg_loss_1: 37.392613093058266 (+8.699648539225258)  > EPOCH: 219/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:02:29)   --> TIME: 2023-10-20 02:02:39 -- STEP: 9/50 -- GLOBAL_STEP: 63960 | > loss_disc: 2.999581813812256 (2.5375925964779324) | > loss_disc_real_0: 0.29738014936447144 (0.20265833474695683) | > loss_disc_real_1: 0.2558716833591461 (0.24233644869592455) | > loss_disc_real_2: 0.2967076897621155 (0.2123944809039434) | > loss_disc_real_3: 0.28619393706321716 (0.24303051291240585) | > loss_disc_real_4: 0.24627423286437988 (0.24887806094355053) | > loss_disc_real_5: 0.22500689327716827 (0.19283304197920692) | > loss_0: 2.999581813812256 (2.5375925964779324) | > grad_norm_0: tensor(359.8839, device='cuda:0') (tensor(1591.8126, device='cuda:0')) | > loss_gen: 1.5618391036987305 (2.1674118836720786) | > loss_kl: 0.9781617522239685 (1.0863214135169983) | > loss_feat: 0.09388712048530579 (4.652607957522075) | > loss_mel: 2.5686678886413574 (17.70939376619127) | > loss_duration: 1.6092172861099243 (1.637161586019728) | > loss_1: 6.81177282333374 (27.25289667977227) | > grad_norm_1: tensor(24091.2539, device='cuda:0') (tensor(32658.0215, device='cuda:0')) | > current_lr_0: 0.00016066214436928787 | > current_lr_1: 0.00016066214436928787 | > step_time: 0.5783 (0.5336698426140679) | > loader_time: 0.0236 (0.01743186844719781)  --> TIME: 2023-10-20 02:02:51 -- STEP: 39/50 -- GLOBAL_STEP: 63990 | > loss_disc: 1.694827675819397 (2.483143678078285) | > loss_disc_real_0: 0.020900707691907883 (0.17590124546908414) | > loss_disc_real_1: 0.20874615013599396 (0.23163390933321074) | > loss_disc_real_2: 0.1458529680967331 (0.223364501618422) | > loss_disc_real_3: 0.1370314508676529 (0.24060270772912565) | > loss_disc_real_4: 0.03931343927979469 (0.21516932895741397) | > loss_disc_real_5: 0.03800539672374725 (0.20287279531550712) | > loss_0: 1.694827675819397 (2.483143678078285) | > grad_norm_0: tensor(1016.8483, device='cuda:0') (tensor(952.2906, device='cuda:0')) | > loss_gen: 2.8148446083068848 (2.256542083544609) | > loss_kl: 0.6547186374664307 (1.0272333025932312) | > loss_feat: 8.691774368286133 (4.975510471715376) | > loss_mel: 26.817087173461914 (21.11623704739106) | > loss_duration: 1.6634595394134521 (1.641240303332989) | > loss_1: 40.64188766479492 (31.0167632714296) | > grad_norm_1: tensor(71717.6875, device='cuda:0') (tensor(38279.9922, device='cuda:0')) | > current_lr_0: 0.00016066214436928787 | > current_lr_1: 0.00016066214436928787 | > step_time: 0.6692 (0.424738456041385) | > loader_time: 0.0371 (0.009855502691024389)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6412949562072754 (2.6412949562072754) | > loss_disc_real_0: 0.0251212939620018 (0.0251212939620018) | > loss_disc_real_1: 0.17963305115699768 (0.17963305115699768) | > loss_disc_real_2: 0.2128096967935562 (0.2128096967935562) | > loss_disc_real_3: 0.30118492245674133 (0.30118492245674133) | > loss_disc_real_4: 0.47303593158721924 (0.47303593158721924) | > loss_disc_real_5: 0.3948003351688385 (0.3948003351688385) | > loss_0: 2.6412949562072754 (2.6412949562072754) | > loss_gen: 2.4876880645751953 (2.4876880645751953) | > loss_kl: 2.942993640899658 (2.942993640899658) | > loss_feat: 7.523852348327637 (7.523852348327637) | > loss_mel: 25.748149871826172 (25.748149871826172) | > loss_duration: 2.3262789249420166 (2.3262789249420166) | > loss_1: 41.028961181640625 (41.028961181640625)  --> STEP: 1 | > loss_disc: 2.5920794010162354 (2.5920794010162354) | > loss_disc_real_0: 0.15201401710510254 (0.15201401710510254) | > loss_disc_real_1: 0.21786491572856903 (0.21786491572856903) | > loss_disc_real_2: 0.19947095215320587 (0.19947095215320587) | > loss_disc_real_3: 0.2352849841117859 (0.2352849841117859) | > loss_disc_real_4: 0.27832573652267456 (0.27832573652267456) | > loss_disc_real_5: 0.24516353011131287 (0.24516353011131287) | > loss_0: 2.5920794010162354 (2.5920794010162354) | > loss_gen: 1.8260804414749146 (1.8260804414749146) | > loss_kl: 3.9246816635131836 (3.9246816635131836) | > loss_feat: 2.4921584129333496 (2.4921584129333496) | > loss_mel: 21.032188415527344 (21.032188415527344) | > loss_duration: 2.5665202140808105 (2.5665202140808105) | > loss_1: 31.841629028320312 (31.841629028320312)  --> STEP: 2 | > loss_disc: 1.9548962116241455 (2.2734878063201904) | > loss_disc_real_0: 0.05459316819906235 (0.10330359265208244) | > loss_disc_real_1: 0.1913534551858902 (0.20460918545722961) | > loss_disc_real_2: 0.23606248199939728 (0.21776671707630157) | > loss_disc_real_3: 0.03467319533228874 (0.13497908972203732) | > loss_disc_real_4: 0.09898645430803299 (0.18865609541535378) | > loss_disc_real_5: 0.3584977090358734 (0.30183061957359314) | > loss_0: 1.9548962116241455 (2.2734878063201904) | > loss_gen: 3.0395078659057617 (2.432794153690338) | > loss_kl: 3.5117063522338867 (3.718194007873535) | > loss_feat: 10.001476287841797 (6.246817350387573) | > loss_mel: 33.02127456665039 (27.026731491088867) | > loss_duration: 2.4488065242767334 (2.507663369178772) | > loss_1: 52.02277374267578 (41.93220138549805)  --> STEP: 3 | > loss_disc: 3.0004959106445312 (2.5158238410949707) | > loss_disc_real_0: 0.23752683401107788 (0.14804467310508093) | > loss_disc_real_1: 0.3233763873577118 (0.24419825275739035) | > loss_disc_real_2: 0.279620885848999 (0.2383847733338674) | > loss_disc_real_3: 0.30991923809051514 (0.19329247251152992) | > loss_disc_real_4: 0.26991716027259827 (0.21574311703443527) | > loss_disc_real_5: 0.32969942688941956 (0.31112022201220196) | > loss_0: 3.0004959106445312 (2.5158238410949707) | > loss_gen: 1.7788466215133667 (2.214811642964681) | > loss_kl: 1.5262064933776855 (2.9875315030415854) | > loss_feat: 0.22077950835227966 (4.238138069709142) | > loss_mel: 16.311979293823242 (23.45514742533366) | > loss_duration: 2.2759995460510254 (2.4304420948028564) | > loss_1: 22.113811492919922 (35.326071421305336) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_64000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9759585857391357 (2.630857527256012) | > loss_disc_real_0: 0.03420422226190567 (0.11958456039428711) | > loss_disc_real_1: 0.18516770005226135 (0.2294406145811081) | > loss_disc_real_2: 0.3179670572280884 (0.25828034430742264) | > loss_disc_real_3: 0.2764137387275696 (0.21407278906553984) | > loss_disc_real_4: 0.27506574988365173 (0.2305737752467394) | > loss_disc_real_5: 0.32939326763153076 (0.31568848341703415) | > loss_0: 2.9759585857391357 (2.630857527256012) | > loss_gen: 1.8256019353866577 (2.117509216070175) | > loss_kl: 3.0847737789154053 (3.0118420720100403) | > loss_feat: 5.955151081085205 (4.667391322553158) | > loss_mel: 21.064756393432617 (22.8575496673584) | > loss_duration: 2.277306318283081 (2.3921581506729126) | > loss_1: 34.20758819580078 (35.0464506149292)  --> STEP: 1 | > loss_disc: 2.7827723026275635 (2.661240482330322) | > loss_disc_real_0: 0.1487373560667038 (0.12541511952877044) | > loss_disc_real_1: 0.3599728047847748 (0.2555470526218414) | > loss_disc_real_2: 0.2739458382129669 (0.2614134430885315) | > loss_disc_real_3: 0.3235953748226166 (0.23597730621695517) | > loss_disc_real_4: 0.257901668548584 (0.2360393539071083) | > loss_disc_real_5: 0.3205762505531311 (0.31666603684425354) | > loss_0: 2.7827723026275635 (2.661240482330322) | > loss_gen: 2.0370020866394043 (2.101407790184021) | > loss_kl: 4.303188323974609 (3.270111322402954) | > loss_feat: 0.8881831765174866 (3.9115496933460236) | > loss_mel: 25.04717254638672 (23.295474243164062) | > loss_duration: 2.5759284496307373 (2.4289122104644774) | > loss_1: 34.85147476196289 (35.00745544433594)  --> STEP: 2 | > loss_disc: 2.6094183921813965 (2.6526034673055015) | > loss_disc_real_0: 0.08224625885486603 (0.11822030941645305) | > loss_disc_real_1: 0.19579336047172546 (0.24558810393015543) | > loss_disc_real_2: 0.23989936709403992 (0.2578277637561162) | > loss_disc_real_3: 0.1978982836008072 (0.22963080244759718) | > loss_disc_real_4: 0.2337280511856079 (0.23565413678685823) | > loss_disc_real_5: 0.3536496162414551 (0.3228299667437871) | > loss_0: 2.6094183921813965 (2.6526034673055015) | > loss_gen: 1.848497748374939 (2.059256116549174) | > loss_kl: 3.4111151695251465 (3.2936119635899863) | > loss_feat: 4.746113300323486 (4.050643627842267) | > loss_mel: 30.43890953063965 (24.48604679107666) | > loss_duration: 2.3956522941589355 (2.4233688910802207) | > loss_1: 42.84029006958008 (36.312927881876625)  --> STEP: 3 | > loss_disc: 2.445880174636841 (2.6230715683528354) | > loss_disc_real_0: 0.1594095081090927 (0.12410448065825871) | > loss_disc_real_1: 0.2796264886856079 (0.2504507303237915) | > loss_disc_real_2: 0.23436632752418518 (0.2544761300086975) | > loss_disc_real_3: 0.2915906608104706 (0.23848221078515053) | > loss_disc_real_4: 0.21181224286556244 (0.23224815194095885) | > loss_disc_real_5: 0.30273741483688354 (0.31995960218565805) | > loss_0: 2.445880174636841 (2.6230715683528354) | > loss_gen: 2.2639951705932617 (2.0885045528411865) | > loss_kl: 1.370627999305725 (3.0188999686922346) | > loss_feat: 2.8366646766662598 (3.877218063388552) | > loss_mel: 22.912134170532227 (24.261202130998885) | > loss_duration: 2.325529098510742 (2.409391777856009) | > loss_1: 31.708951950073242 (35.655217034476145) --> EVAL PERFORMANCE | > avg_loader_time: 0.3380180767604283 (+0.32215696289425805) | > avg_loss_disc: 2.6230715683528354 (-0.03209990546816899) | > avg_loss_disc_real_0: 0.12410448065825871 (-0.07234613526435124) | > avg_loss_disc_real_1: 0.2504507303237915 (-0.05962155262629193) | > avg_loss_disc_real_2: 0.2544761300086975 (+0.052902902166048676) | > avg_loss_disc_real_3: 0.23848221078515053 (-0.04163976137836772) | > avg_loss_disc_real_4: 0.23224815194095885 (-0.055153807359082346) | > avg_loss_disc_real_5: 0.31995960218565805 (-0.06891618030411856) | > avg_loss_0: 2.6230715683528354 (-0.03209990546816899) | > avg_loss_gen: 2.0885045528411865 (-0.3762926260630288) | > avg_loss_kl: 3.0188999686922346 (+0.15317965689159596) | > avg_loss_feat: 3.877218063388552 (-0.6974766495681943) | > avg_loss_mel: 24.261202130998885 (-0.848951067243302) | > avg_loss_duration: 2.409391777856009 (+0.03214531853085445) | > avg_loss_1: 35.655217034476145 (-1.7373960585821209)  > EPOCH: 220/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:03:16)   --> TIME: 2023-10-20 02:03:29 -- STEP: 19/50 -- GLOBAL_STEP: 64020 | > loss_disc: 2.0624892711639404 (2.435554316169337) | > loss_disc_real_0: 0.2726828455924988 (0.16415970145087494) | > loss_disc_real_1: 0.227134108543396 (0.2355247684999516) | > loss_disc_real_2: 0.2486102432012558 (0.2255207539389008) | > loss_disc_real_3: 0.1317005306482315 (0.21394493156357816) | > loss_disc_real_4: 0.18285207450389862 (0.20609137768808164) | > loss_disc_real_5: 0.20953573286533356 (0.2132700588063974) | > loss_0: 2.0624892711639404 (2.435554316169337) | > grad_norm_0: tensor(1129.9547, device='cuda:0') (tensor(1086.2139, device='cuda:0')) | > loss_gen: 2.905930757522583 (2.2627886094545064) | > loss_kl: 1.3369745016098022 (1.0174565503471775) | > loss_feat: 6.562292575836182 (4.685394752770662) | > loss_mel: 26.040401458740234 (22.66302608816247) | > loss_duration: 1.8257691860198975 (1.704749954374213) | > loss_1: 38.671363830566406 (32.333416286267735) | > grad_norm_1: tensor(14540.9033, device='cuda:0') (tensor(36960.4062, device='cuda:0')) | > current_lr_0: 0.00016050155249703704 | > current_lr_1: 0.00016050155249703704 | > step_time: 0.255 (0.4796209962744462) | > loader_time: 0.0016 (0.01832111258255808)  --> TIME: 2023-10-20 02:03:44 -- STEP: 49/50 -- GLOBAL_STEP: 64050 | > loss_disc: 3.096374273300171 (2.4176886738563073) | > loss_disc_real_0: 0.13490498065948486 (0.1695125022028782) | > loss_disc_real_1: 0.31457120180130005 (0.22779658109861978) | > loss_disc_real_2: 0.2872575521469116 (0.21458108776382037) | > loss_disc_real_3: 0.33459749817848206 (0.2226370854341254) | > loss_disc_real_4: 0.29751941561698914 (0.2187789739774806) | > loss_disc_real_5: 0.266299843788147 (0.21236166158424957) | > loss_0: 3.096374273300171 (2.4176886738563073) | > grad_norm_0: tensor(2983.3076, device='cuda:0') (tensor(1003.4104, device='cuda:0')) | > loss_gen: 1.7770980596542358 (2.3128645639030303) | > loss_kl: 0.5178878307342529 (0.9299756787261184) | > loss_feat: 0.5953267216682434 (4.922837757258393) | > loss_mel: 20.528688430786133 (21.645008070128306) | > loss_duration: 1.715804100036621 (1.6602502453083894) | > loss_1: 25.134803771972656 (31.470936171862544) | > grad_norm_1: tensor(15442.8076, device='cuda:0') (tensor(38028.6992, device='cuda:0')) | > current_lr_0: 0.00016050155249703704 | > current_lr_1: 0.00016050155249703704 | > step_time: 0.2521 (0.4716107699335837) | > loader_time: 0.3887 (0.023689493841054482)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.025977611541748 (3.025977611541748) | > loss_disc_real_0: 0.1369248926639557 (0.1369248926639557) | > loss_disc_real_1: 0.20313088595867157 (0.20313088595867157) | > loss_disc_real_2: 0.18337029218673706 (0.18337029218673706) | > loss_disc_real_3: 0.3537699580192566 (0.3537699580192566) | > loss_disc_real_4: 0.37689530849456787 (0.37689530849456787) | > loss_disc_real_5: 0.41055411100387573 (0.41055411100387573) | > loss_0: 3.025977611541748 (3.025977611541748) | > loss_gen: 2.1452748775482178 (2.1452748775482178) | > loss_kl: 2.377004384994507 (2.377004384994507) | > loss_feat: 5.516302585601807 (5.516302585601807) | > loss_mel: 19.209144592285156 (19.209144592285156) | > loss_duration: 2.2151265144348145 (2.2151265144348145) | > loss_1: 31.462852478027344 (31.462852478027344)  --> STEP: 1 | > loss_disc: 2.6281304359436035 (2.6281304359436035) | > loss_disc_real_0: 0.26377004384994507 (0.26377004384994507) | > loss_disc_real_1: 0.30583420395851135 (0.30583420395851135) | > loss_disc_real_2: 0.10742275416851044 (0.10742275416851044) | > loss_disc_real_3: 0.48962920904159546 (0.48962920904159546) | > loss_disc_real_4: 0.39976343512535095 (0.39976343512535095) | > loss_disc_real_5: 0.3249295651912689 (0.3249295651912689) | > loss_0: 2.6281304359436035 (2.6281304359436035) | > loss_gen: 2.9688596725463867 (2.9688596725463867) | > loss_kl: 3.133694887161255 (3.133694887161255) | > loss_feat: 6.109644889831543 (6.109644889831543) | > loss_mel: 26.657676696777344 (26.657676696777344) | > loss_duration: 2.4721224308013916 (2.4721224308013916) | > loss_1: 41.34199905395508 (41.34199905395508)  --> STEP: 2 | > loss_disc: 1.9671952724456787 (2.297662854194641) | > loss_disc_real_0: 0.22351184487342834 (0.2436409443616867) | > loss_disc_real_1: 0.052818041294813156 (0.17932612262666225) | > loss_disc_real_2: 0.061908476054668427 (0.08466561511158943) | > loss_disc_real_3: 0.13049155473709106 (0.31006038188934326) | > loss_disc_real_4: 0.011117074638605118 (0.20544025488197803) | > loss_disc_real_5: 0.1273210197687149 (0.2261252924799919) | > loss_0: 1.9671952724456787 (2.297662854194641) | > loss_gen: 3.4672369956970215 (3.218048334121704) | > loss_kl: 3.423567771911621 (3.278631329536438) | > loss_feat: 14.240326881408691 (10.174985885620117) | > loss_mel: 27.923992156982422 (27.290834426879883) | > loss_duration: 2.435638666152954 (2.453880548477173) | > loss_1: 51.490760803222656 (46.41637992858887)  --> STEP: 3 | > loss_disc: 2.697429895401001 (2.430918534596761) | > loss_disc_real_0: 0.4197509288787842 (0.30234427253405255) | > loss_disc_real_1: 0.24007098376750946 (0.1995744096736113) | > loss_disc_real_2: 0.28861889243125916 (0.15265004088481268) | > loss_disc_real_3: 0.4381060004234314 (0.3527422547340393) | > loss_disc_real_4: 0.25980839133262634 (0.22356296703219414) | > loss_disc_real_5: 0.2593930661678314 (0.23721455037593842) | > loss_0: 2.697429895401001 (2.430918534596761) | > loss_gen: 2.7002668380737305 (3.045454502105713) | > loss_kl: 0.9941329956054688 (2.5171318848927817) | > loss_feat: 3.766730785369873 (8.03890085220337) | > loss_mel: 23.289384841918945 (25.95701789855957) | > loss_duration: 2.373812437057495 (2.427191178003947) | > loss_1: 33.12432861328125 (41.985696156819664) --> EVAL PERFORMANCE | > avg_loader_time: 0.013823668162027994 (-0.32419440859840026) | > avg_loss_disc: 2.430918534596761 (-0.19215303375607418) | > avg_loss_disc_real_0: 0.30234427253405255 (+0.17823979187579383) | > avg_loss_disc_real_1: 0.1995744096736113 (-0.05087632065018019) | > avg_loss_disc_real_2: 0.15265004088481268 (-0.10182608912388483) | > avg_loss_disc_real_3: 0.3527422547340393 (+0.11426004394888878) | > avg_loss_disc_real_4: 0.22356296703219414 (-0.008685184908764715) | > avg_loss_disc_real_5: 0.23721455037593842 (-0.08274505180971964) | > avg_loss_0: 2.430918534596761 (-0.19215303375607418) | > avg_loss_gen: 3.045454502105713 (+0.9569499492645264) | > avg_loss_kl: 2.5171318848927817 (-0.5017680837994529) | > avg_loss_feat: 8.03890085220337 (+4.161682788814817) | > avg_loss_mel: 25.95701789855957 (+1.6958157675606849) | > avg_loss_duration: 2.427191178003947 (+0.017799400147937572) | > avg_loss_1: 41.985696156819664 (+6.330479122343519)  > EPOCH: 221/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:03:57)   --> TIME: 2023-10-20 02:04:16 -- STEP: 29/50 -- GLOBAL_STEP: 64080 | > loss_disc: 2.5093154907226562 (2.3747725240115463) | > loss_disc_real_0: 0.13362856209278107 (0.16859289843203693) | > loss_disc_real_1: 0.14482234418392181 (0.22230228332096133) | > loss_disc_real_2: 0.22096258401870728 (0.2123347976855163) | > loss_disc_real_3: 0.36139553785324097 (0.26527341557987805) | > loss_disc_real_4: 0.3558993637561798 (0.2312383934341628) | > loss_disc_real_5: 0.30411431193351746 (0.23783820116057477) | > loss_0: 2.5093154907226562 (2.3747725240115463) | > grad_norm_0: tensor(612.3655, device='cuda:0') (tensor(1274.2189, device='cuda:0')) | > loss_gen: 2.5826804637908936 (2.524363406773271) | > loss_kl: 0.9985094666481018 (1.061649640058649) | > loss_feat: 6.208751201629639 (5.597862845864789) | > loss_mel: 23.832197189331055 (24.28923036312235) | > loss_duration: 1.710111379623413 (1.6708062065058742) | > loss_1: 35.33224868774414 (35.143912923747095) | > grad_norm_1: tensor(35944.0898, device='cuda:0') (tensor(46112.8086, device='cuda:0')) | > current_lr_0: 0.00016034112114641705 | > current_lr_1: 0.00016034112114641705 | > step_time: 0.5939 (0.4882910333830735) | > loader_time: 0.0244 (0.016678489487746664)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4223809242248535 (2.4223809242248535) | > loss_disc_real_0: 0.045069411396980286 (0.045069411396980286) | > loss_disc_real_1: 0.10527604818344116 (0.10527604818344116) | > loss_disc_real_2: 0.3501729965209961 (0.3501729965209961) | > loss_disc_real_3: 0.17082706093788147 (0.17082706093788147) | > loss_disc_real_4: 0.2707107663154602 (0.2707107663154602) | > loss_disc_real_5: 0.5204700231552124 (0.5204700231552124) | > loss_0: 2.4223809242248535 (2.4223809242248535) | > loss_gen: 2.7300186157226562 (2.7300186157226562) | > loss_kl: 2.5099096298217773 (2.5099096298217773) | > loss_feat: 6.879530906677246 (6.879530906677246) | > loss_mel: 25.620487213134766 (25.620487213134766) | > loss_duration: 2.2049765586853027 (2.2049765586853027) | > loss_1: 39.94491958618164 (39.94491958618164)  --> STEP: 1 | > loss_disc: 3.0457115173339844 (3.0457115173339844) | > loss_disc_real_0: 0.04682894051074982 (0.04682894051074982) | > loss_disc_real_1: 0.13786789774894714 (0.13786789774894714) | > loss_disc_real_2: 0.11564638465642929 (0.11564638465642929) | > loss_disc_real_3: 0.18021586537361145 (0.18021586537361145) | > loss_disc_real_4: 0.13282722234725952 (0.13282722234725952) | > loss_disc_real_5: 0.15381261706352234 (0.15381261706352234) | > loss_0: 3.0457115173339844 (3.0457115173339844) | > loss_gen: 1.2674943208694458 (1.2674943208694458) | > loss_kl: 3.4618186950683594 (3.4618186950683594) | > loss_feat: 4.844809055328369 (4.844809055328369) | > loss_mel: 25.127948760986328 (25.127948760986328) | > loss_duration: 2.4880897998809814 (2.4880897998809814) | > loss_1: 37.190162658691406 (37.190162658691406)  --> STEP: 2 | > loss_disc: 3.0637667179107666 (3.0547391176223755) | > loss_disc_real_0: 0.42334282398223877 (0.2350858822464943) | > loss_disc_real_1: 0.22222024202346802 (0.18004406988620758) | > loss_disc_real_2: 0.2474706768989563 (0.1815585307776928) | > loss_disc_real_3: 0.2881087362766266 (0.23416230082511902) | > loss_disc_real_4: 0.2721545696258545 (0.202490895986557) | > loss_disc_real_5: 0.23872911930084229 (0.1962708681821823) | > loss_0: 3.0637667179107666 (3.0547391176223755) | > loss_gen: 1.6936328411102295 (1.4805635809898376) | > loss_kl: 3.354372978210449 (3.4080958366394043) | > loss_feat: 0.2108098268508911 (2.52780944108963) | > loss_mel: 20.388343811035156 (22.758146286010742) | > loss_duration: 2.4320120811462402 (2.460050940513611) | > loss_1: 28.07917022705078 (32.634666442871094)  --> STEP: 3 | > loss_disc: 2.8208274841308594 (2.9767685731252036) | > loss_disc_real_0: 0.2802600860595703 (0.2501439501841863) | > loss_disc_real_1: 0.22752994298934937 (0.1958726942539215) | > loss_disc_real_2: 0.22718258202075958 (0.19676654785871506) | > loss_disc_real_3: 0.2942635715007782 (0.25419605771700543) | > loss_disc_real_4: 0.22974824905395508 (0.21157668034235635) | > loss_disc_real_5: 0.22484001517295837 (0.20579391717910767) | > loss_0: 2.8208274841308594 (2.9767685731252036) | > loss_gen: 1.7281755208969116 (1.5631008942921956) | > loss_kl: 1.501039743423462 (2.7724104722340903) | > loss_feat: 0.8332741856575012 (1.9629643559455872) | > loss_mel: 17.315322875976562 (20.943871815999348) | > loss_duration: 2.2964253425598145 (2.405509074529012) | > loss_1: 23.674238204956055 (29.647857030232746) --> EVAL PERFORMANCE | > avg_loader_time: 0.007890860239664713 (-0.005932807922363281) | > avg_loss_disc: 2.9767685731252036 (+0.5458500385284424) | > avg_loss_disc_real_0: 0.2501439501841863 (-0.05220032234986627) | > avg_loss_disc_real_1: 0.1958726942539215 (-0.003701715419689805) | > avg_loss_disc_real_2: 0.19676654785871506 (+0.044116506973902375) | > avg_loss_disc_real_3: 0.25419605771700543 (-0.09854619701703388) | > avg_loss_disc_real_4: 0.21157668034235635 (-0.011986286689837783) | > avg_loss_disc_real_5: 0.20579391717910767 (-0.03142063319683075) | > avg_loss_0: 2.9767685731252036 (+0.5458500385284424) | > avg_loss_gen: 1.5631008942921956 (-1.4823536078135173) | > avg_loss_kl: 2.7724104722340903 (+0.2552785873413086) | > avg_loss_feat: 1.9629643559455872 (-6.075936496257782) | > avg_loss_mel: 20.943871815999348 (-5.0131460825602225) | > avg_loss_duration: 2.405509074529012 (-0.0216821034749346) | > avg_loss_1: 29.647857030232746 (-12.337839126586918)  > EPOCH: 222/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:04:38)   --> TIME: 2023-10-20 02:04:46 -- STEP: 9/50 -- GLOBAL_STEP: 64110 | > loss_disc: 3.0394651889801025 (2.311752332581414) | > loss_disc_real_0: 0.46853142976760864 (0.14633948066168362) | > loss_disc_real_1: 0.30888283252716064 (0.24710027045673794) | > loss_disc_real_2: 0.23335880041122437 (0.24795562111669117) | > loss_disc_real_3: 0.30757251381874084 (0.24033680599596766) | > loss_disc_real_4: 0.30572184920310974 (0.21833498610390556) | > loss_disc_real_5: 0.24906976521015167 (0.17602559675772986) | > loss_0: 3.0394651889801025 (2.311752332581414) | > grad_norm_0: tensor(1780.6854, device='cuda:0') (tensor(961.6213, device='cuda:0')) | > loss_gen: 1.901953101158142 (2.6644607517454357) | > loss_kl: 1.1107245683670044 (1.1562177472644382) | > loss_feat: 0.4341766834259033 (6.207699881659614) | > loss_mel: 14.768226623535156 (24.371917724609375) | > loss_duration: 1.5829582214355469 (1.652204738722907) | > loss_1: 19.798038482666016 (36.05250019497342) | > grad_norm_1: tensor(17275.8535, device='cuda:0') (tensor(38742.9883, device='cuda:0')) | > current_lr_0: 0.00016018085015697653 | > current_lr_1: 0.00016018085015697653 | > step_time: 0.2476 (0.4434860547383626) | > loader_time: 0.0027 (0.013728035820855035)  --> TIME: 2023-10-20 02:04:57 -- STEP: 39/50 -- GLOBAL_STEP: 64140 | > loss_disc: 3.015346050262451 (2.517222095758487) | > loss_disc_real_0: 0.15025408565998077 (0.16522023468636543) | > loss_disc_real_1: 0.2731282711029053 (0.24289875687696996) | > loss_disc_real_2: 0.2661002278327942 (0.2404670088719099) | > loss_disc_real_3: 0.23936140537261963 (0.2508566308862123) | > loss_disc_real_4: 0.2602822482585907 (0.23916038240377718) | > loss_disc_real_5: 0.2576564848423004 (0.23719900149183396) | > loss_0: 3.015346050262451 (2.517222095758487) | > grad_norm_0: tensor(766.4269, device='cuda:0') (tensor(979.1501, device='cuda:0')) | > loss_gen: 1.5057066679000854 (2.3536512698882666) | > loss_kl: 0.7435674071311951 (0.9614801926490588) | > loss_feat: 0.08292703330516815 (4.757255574067433) | > loss_mel: 2.5395562648773193 (21.54818416864444) | > loss_duration: 1.7007088661193848 (1.6329134977780855) | > loss_1: 6.5724663734436035 (31.253484628139397) | > grad_norm_1: tensor(21488.1758, device='cuda:0') (tensor(37441.4805, device='cuda:0')) | > current_lr_0: 0.00016018085015697653 | > current_lr_1: 0.00016018085015697653 | > step_time: 0.2904 (0.37763628592857945) | > loader_time: 0.0026 (0.008656189991877629)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1492836475372314 (2.1492836475372314) | > loss_disc_real_0: 0.20386838912963867 (0.20386838912963867) | > loss_disc_real_1: 0.214531809091568 (0.214531809091568) | > loss_disc_real_2: 0.08865891396999359 (0.08865891396999359) | > loss_disc_real_3: 0.21616590023040771 (0.21616590023040771) | > loss_disc_real_4: 0.23724959790706635 (0.23724959790706635) | > loss_disc_real_5: 0.2729814052581787 (0.2729814052581787) | > loss_0: 2.1492836475372314 (2.1492836475372314) | > loss_gen: 2.9230763912200928 (2.9230763912200928) | > loss_kl: 2.3469035625457764 (2.3469035625457764) | > loss_feat: 9.492486000061035 (9.492486000061035) | > loss_mel: 24.223922729492188 (24.223922729492188) | > loss_duration: 2.2484018802642822 (2.2484018802642822) | > loss_1: 41.23479080200195 (41.23479080200195)  --> STEP: 1 | > loss_disc: 2.715100049972534 (2.715100049972534) | > loss_disc_real_0: 0.2225663959980011 (0.2225663959980011) | > loss_disc_real_1: 0.2856120765209198 (0.2856120765209198) | > loss_disc_real_2: 0.11951557546854019 (0.11951557546854019) | > loss_disc_real_3: 0.3138120770454407 (0.3138120770454407) | > loss_disc_real_4: 0.3735922873020172 (0.3735922873020172) | > loss_disc_real_5: 0.2753990888595581 (0.2753990888595581) | > loss_0: 2.715100049972534 (2.715100049972534) | > loss_gen: 2.2786953449249268 (2.2786953449249268) | > loss_kl: 2.8793418407440186 (2.8793418407440186) | > loss_feat: 7.340010166168213 (7.340010166168213) | > loss_mel: 23.367774963378906 (23.367774963378906) | > loss_duration: 2.403254508972168 (2.403254508972168) | > loss_1: 38.26907730102539 (38.26907730102539)  --> STEP: 2 | > loss_disc: 2.2353007793426514 (2.4752004146575928) | > loss_disc_real_0: 0.1477893441915512 (0.18517787009477615) | > loss_disc_real_1: 0.1997782289981842 (0.242695152759552) | > loss_disc_real_2: 0.1243758350610733 (0.12194570526480675) | > loss_disc_real_3: 0.4410957992076874 (0.377453938126564) | > loss_disc_real_4: 0.23098264634609222 (0.3022874668240547) | > loss_disc_real_5: 0.26606181263923645 (0.2707304507493973) | > loss_0: 2.2353007793426514 (2.4752004146575928) | > loss_gen: 2.9530863761901855 (2.615890860557556) | > loss_kl: 3.0517194271087646 (2.9655306339263916) | > loss_feat: 7.771259307861328 (7.5556347370147705) | > loss_mel: 27.55524444580078 (25.461509704589844) | > loss_duration: 2.4058470726013184 (2.404550790786743) | > loss_1: 43.73715591430664 (41.003116607666016)  --> STEP: 3 | > loss_disc: 1.4343208074569702 (2.1282405455907187) | > loss_disc_real_0: 0.18893416225910187 (0.18642996748288473) | > loss_disc_real_1: 0.24513529241085052 (0.24350853264331818) | > loss_disc_real_2: 0.15706472098827362 (0.13365204383929571) | > loss_disc_real_3: 0.2201751321554184 (0.3250276694695155) | > loss_disc_real_4: 0.07201680541038513 (0.22553057968616486) | > loss_disc_real_5: 0.09268831461668015 (0.21138307203849158) | > loss_0: 1.4343208074569702 (2.1282405455907187) | > loss_gen: 3.6555819511413574 (2.9624545574188232) | > loss_kl: 1.323006510734558 (2.4180225928624473) | > loss_feat: 8.540666580200195 (7.883978684743245) | > loss_mel: 26.309186935424805 (25.744068781534832) | > loss_duration: 2.404043674468994 (2.40438175201416) | > loss_1: 42.232486724853516 (41.412906646728516) --> EVAL PERFORMANCE | > avg_loader_time: 0.002573410669962565 (-0.0053174495697021484) | > avg_loss_disc: 2.1282405455907187 (-0.8485280275344849) | > avg_loss_disc_real_0: 0.18642996748288473 (-0.06371398270130155) | > avg_loss_disc_real_1: 0.24350853264331818 (+0.04763583838939667) | > avg_loss_disc_real_2: 0.13365204383929571 (-0.06311450401941934) | > avg_loss_disc_real_3: 0.3250276694695155 (+0.07083161175251007) | > avg_loss_disc_real_4: 0.22553057968616486 (+0.013953899343808501) | > avg_loss_disc_real_5: 0.21138307203849158 (+0.00558915485938391) | > avg_loss_0: 2.1282405455907187 (-0.8485280275344849) | > avg_loss_gen: 2.9624545574188232 (+1.3993536631266277) | > avg_loss_kl: 2.4180225928624473 (-0.35438787937164307) | > avg_loss_feat: 7.883978684743245 (+5.921014328797658) | > avg_loss_mel: 25.744068781534832 (+4.800196965535484) | > avg_loss_duration: 2.40438175201416 (-0.001127322514852036) | > avg_loss_1: 41.412906646728516 (+11.76504961649577)  > EPOCH: 223/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:05:14)   --> TIME: 2023-10-20 02:05:28 -- STEP: 19/50 -- GLOBAL_STEP: 64170 | > loss_disc: 2.169265031814575 (2.376842831310473) | > loss_disc_real_0: 0.1466699093580246 (0.18947015565476918) | > loss_disc_real_1: 0.210775226354599 (0.2286164227284883) | > loss_disc_real_2: 0.23848675191402435 (0.21981694706176458) | > loss_disc_real_3: 0.17114128172397614 (0.21894761096490056) | > loss_disc_real_4: 0.15707126259803772 (0.19189920394044174) | > loss_disc_real_5: 0.16423919796943665 (0.21259962610508265) | > loss_0: 2.169265031814575 (2.376842831310473) | > grad_norm_0: tensor(665.1622, device='cuda:0') (tensor(1093.9542, device='cuda:0')) | > loss_gen: 2.5271952152252197 (2.443474029239855) | > loss_kl: 1.2916661500930786 (0.8806851333693454) | > loss_feat: 5.821474075317383 (5.21868139966146) | > loss_mel: 25.79762077331543 (22.238663585562456) | > loss_duration: 1.7690908908843994 (1.69829177229028) | > loss_1: 37.20704650878906 (32.47979598296316) | > grad_norm_1: tensor(12939.5596, device='cuda:0') (tensor(52071.1797, device='cuda:0')) | > current_lr_0: 0.0001600207393684244 | > current_lr_1: 0.0001600207393684244 | > step_time: 0.5565 (0.5076377266331723) | > loader_time: 0.025 (0.020269255889089483)  --> TIME: 2023-10-20 02:05:44 -- STEP: 49/50 -- GLOBAL_STEP: 64200 | > loss_disc: 1.5860735177993774 (2.3076837427762094) | > loss_disc_real_0: 0.15541715919971466 (0.16622270105824788) | > loss_disc_real_1: 0.17275120317935944 (0.22258727754257163) | > loss_disc_real_2: 0.09351980686187744 (0.2130849893604006) | > loss_disc_real_3: 0.13920505344867706 (0.22198409807621217) | > loss_disc_real_4: 0.07455020397901535 (0.18761215879752927) | > loss_disc_real_5: 0.039709821343421936 (0.20134546432872208) | > loss_0: 1.5860735177993774 (2.3076837427762094) | > grad_norm_0: tensor(824.4644, device='cuda:0') (tensor(1002.7630, device='cuda:0')) | > loss_gen: 2.776719808578491 (2.4709100358340206) | > loss_kl: 0.425493985414505 (0.8827978892593967) | > loss_feat: 7.9028706550598145 (5.936867223520364) | > loss_mel: 28.254859924316406 (22.413099439776673) | > loss_duration: 1.7627143859863281 (1.6451842638911034) | > loss_1: 41.122657775878906 (33.34885897928355) | > grad_norm_1: tensor(36054.7070, device='cuda:0') (tensor(44773.8906, device='cuda:0')) | > current_lr_0: 0.0001600207393684244 | > current_lr_1: 0.0001600207393684244 | > step_time: 0.4376 (0.49822243865655386) | > loader_time: 0.4986 (0.028483327554196726)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.830793619155884 (2.830793619155884) | > loss_disc_real_0: 0.2703108787536621 (0.2703108787536621) | > loss_disc_real_1: 0.29615920782089233 (0.29615920782089233) | > loss_disc_real_2: 0.3956707715988159 (0.3956707715988159) | > loss_disc_real_3: 0.21495816111564636 (0.21495816111564636) | > loss_disc_real_4: 0.3603852093219757 (0.3603852093219757) | > loss_disc_real_5: 0.2538927495479584 (0.2538927495479584) | > loss_0: 2.830793619155884 (2.830793619155884) | > loss_gen: 2.2191596031188965 (2.2191596031188965) | > loss_kl: 1.8232120275497437 (1.8232120275497437) | > loss_feat: 1.927915334701538 (1.927915334701538) | > loss_mel: 22.922651290893555 (22.922651290893555) | > loss_duration: 2.3393313884735107 (2.3393313884735107) | > loss_1: 31.232269287109375 (31.232269287109375)  --> STEP: 1 | > loss_disc: 2.328691005706787 (2.328691005706787) | > loss_disc_real_0: 0.08102862536907196 (0.08102862536907196) | > loss_disc_real_1: 0.17631369829177856 (0.17631369829177856) | > loss_disc_real_2: 0.25830012559890747 (0.25830012559890747) | > loss_disc_real_3: 0.25973784923553467 (0.25973784923553467) | > loss_disc_real_4: 0.2393132597208023 (0.2393132597208023) | > loss_disc_real_5: 0.34672728180885315 (0.34672728180885315) | > loss_0: 2.328691005706787 (2.328691005706787) | > loss_gen: 2.3259479999542236 (2.3259479999542236) | > loss_kl: 2.7383675575256348 (2.7383675575256348) | > loss_feat: 5.325075149536133 (5.325075149536133) | > loss_mel: 23.16425132751465 (23.16425132751465) | > loss_duration: 2.4402692317962646 (2.4402692317962646) | > loss_1: 35.99391174316406 (35.99391174316406)  --> STEP: 2 | > loss_disc: 3.046412467956543 (2.687551736831665) | > loss_disc_real_0: 0.24446451663970947 (0.16274657100439072) | > loss_disc_real_1: 0.25936800241470337 (0.21784085035324097) | > loss_disc_real_2: 0.2532811164855957 (0.2557906210422516) | > loss_disc_real_3: 0.21893395483493805 (0.23933590203523636) | > loss_disc_real_4: 0.30042731761932373 (0.269870288670063) | > loss_disc_real_5: 0.20422589778900146 (0.2754765897989273) | > loss_0: 3.046412467956543 (2.687551736831665) | > loss_gen: 1.5279000997543335 (1.9269240498542786) | > loss_kl: 3.100541114807129 (2.919454336166382) | > loss_feat: 1.1716876029968262 (3.2483813762664795) | > loss_mel: 9.249297142028809 (16.20677423477173) | > loss_duration: 2.5007519721984863 (2.4705106019973755) | > loss_1: 17.55017852783203 (26.772045135498047)  --> STEP: 3 | > loss_disc: 2.9414284229278564 (2.772177298863729) | > loss_disc_real_0: 0.2684633731842041 (0.19798550506432852) | > loss_disc_real_1: 0.26576003432273865 (0.23381391167640686) | > loss_disc_real_2: 0.22623687982559204 (0.24593937397003174) | > loss_disc_real_3: 0.22964893281459808 (0.2361069122950236) | > loss_disc_real_4: 0.31120985746383667 (0.28365014493465424) | > loss_disc_real_5: 0.2610580027103424 (0.27067039410273236) | > loss_0: 2.9414284229278564 (2.772177298863729) | > loss_gen: 1.639012336730957 (1.8309534788131714) | > loss_kl: 1.5665202140808105 (2.4684762954711914) | > loss_feat: 0.2036292552947998 (2.233464002609253) | > loss_mel: 3.262397289276123 (11.891981919606527) | > loss_duration: 2.3788986206054688 (2.4399732748667398) | > loss_1: 9.050457954406738 (20.86484940846761) --> EVAL PERFORMANCE | > avg_loader_time: 0.011526346206665039 (+0.008952935536702475) | > avg_loss_disc: 2.772177298863729 (+0.6439367532730103) | > avg_loss_disc_real_0: 0.19798550506432852 (+0.011555537581443787) | > avg_loss_disc_real_1: 0.23381391167640686 (-0.009694620966911316) | > avg_loss_disc_real_2: 0.24593937397003174 (+0.11228733013073602) | > avg_loss_disc_real_3: 0.2361069122950236 (-0.08892075717449191) | > avg_loss_disc_real_4: 0.28365014493465424 (+0.05811956524848938) | > avg_loss_disc_real_5: 0.27067039410273236 (+0.05928732206424078) | > avg_loss_0: 2.772177298863729 (+0.6439367532730103) | > avg_loss_gen: 1.8309534788131714 (-1.1315010786056519) | > avg_loss_kl: 2.4684762954711914 (+0.050453702608744155) | > avg_loss_feat: 2.233464002609253 (-5.650514682133992) | > avg_loss_mel: 11.891981919606527 (-13.852086861928305) | > avg_loss_duration: 2.4399732748667398 (+0.035591522852579605) | > avg_loss_1: 20.86484940846761 (-20.548057238260906)  > EPOCH: 224/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:05:54)   --> TIME: 2023-10-20 02:06:14 -- STEP: 29/50 -- GLOBAL_STEP: 64230 | > loss_disc: 2.43066668510437 (2.36326081177284) | > loss_disc_real_0: 0.22078877687454224 (0.16278529902598982) | > loss_disc_real_1: 0.21359850466251373 (0.21835580725094367) | > loss_disc_real_2: 0.23337604105472565 (0.2369226444641064) | > loss_disc_real_3: 0.22554831206798553 (0.22249859404461136) | > loss_disc_real_4: 0.2015979290008545 (0.2136018750867967) | > loss_disc_real_5: 0.26274850964546204 (0.22236911429028058) | > loss_0: 2.43066668510437 (2.36326081177284) | > grad_norm_0: tensor(519.8202, device='cuda:0') (tensor(1079.9054, device='cuda:0')) | > loss_gen: 2.172811269760132 (2.5106444605465588) | > loss_kl: 0.7188758850097656 (0.9365571377606228) | > loss_feat: 3.6891562938690186 (5.5323854361114835) | > loss_mel: 17.305246353149414 (21.159573045270196) | > loss_duration: 1.6264387369155884 (1.6534101140910182) | > loss_1: 25.512529373168945 (31.792569851053173) | > grad_norm_1: tensor(20215.7266, device='cuda:0') (tensor(47837.7227, device='cuda:0')) | > current_lr_0: 0.00015986078862062988 | > current_lr_1: 0.00015986078862062988 | > step_time: 0.4439 (0.5200663270621464) | > loader_time: 0.0256 (0.011266165766222724)  > EVALUATION   --> STEP: 0 | > loss_disc: 0.6968650817871094 (0.6968650817871094) | > loss_disc_real_0: 0.008716002106666565 (0.008716002106666565) | > loss_disc_real_1: 0.08518575876951218 (0.08518575876951218) | > loss_disc_real_2: 0.05200521647930145 (0.05200521647930145) | > loss_disc_real_3: 0.02269510179758072 (0.02269510179758072) | > loss_disc_real_4: 0.08439753949642181 (0.08439753949642181) | > loss_disc_real_5: 0.06098788604140282 (0.06098788604140282) | > loss_0: 0.6968650817871094 (0.6968650817871094) | > loss_gen: 4.531169891357422 (4.531169891357422) | > loss_kl: 2.77614688873291 (2.77614688873291) | > loss_feat: 16.34394645690918 (16.34394645690918) | > loss_mel: 26.18459701538086 (26.18459701538086) | > loss_duration: 2.232316255569458 (2.232316255569458) | > loss_1: 52.06817626953125 (52.06817626953125)  --> STEP: 1 | > loss_disc: 0.885879635810852 (0.885879635810852) | > loss_disc_real_0: 0.045666247606277466 (0.045666247606277466) | > loss_disc_real_1: 0.11059556901454926 (0.11059556901454926) | > loss_disc_real_2: 0.19045314192771912 (0.19045314192771912) | > loss_disc_real_3: 0.042833320796489716 (0.042833320796489716) | > loss_disc_real_4: 0.12240927666425705 (0.12240927666425705) | > loss_disc_real_5: 0.017459185793995857 (0.017459185793995857) | > loss_0: 0.885879635810852 (0.885879635810852) | > loss_gen: 4.272795677185059 (4.272795677185059) | > loss_kl: 3.5848443508148193 (3.5848443508148193) | > loss_feat: 15.092870712280273 (15.092870712280273) | > loss_mel: 28.966535568237305 (28.966535568237305) | > loss_duration: 2.443687915802002 (2.443687915802002) | > loss_1: 54.36073303222656 (54.36073303222656)  --> STEP: 2 | > loss_disc: 2.577465057373047 (1.7316723465919495) | > loss_disc_real_0: 0.19253236055374146 (0.11909930408000946) | > loss_disc_real_1: 0.23182441294193268 (0.17120999097824097) | > loss_disc_real_2: 0.26167234778404236 (0.22606274485588074) | > loss_disc_real_3: 0.23619967699050903 (0.13951649889349937) | > loss_disc_real_4: 0.17820577323436737 (0.1503075249493122) | > loss_disc_real_5: 0.18298381567001343 (0.10022150073200464) | > loss_0: 2.577465057373047 (1.7316723465919495) | > loss_gen: 1.9529815912246704 (3.1128886342048645) | > loss_kl: 3.1135759353637695 (3.3492101430892944) | > loss_feat: 3.150561809539795 (9.121716260910034) | > loss_mel: 28.620357513427734 (28.79344654083252) | > loss_duration: 2.3354480266571045 (2.3895679712295532) | > loss_1: 39.17292404174805 (46.766828536987305)  --> STEP: 3 | > loss_disc: 2.927502155303955 (2.1302822828292847) | > loss_disc_real_0: 0.2463284432888031 (0.16150901714960733) | > loss_disc_real_1: 0.2753072679042816 (0.20590908328692117) | > loss_disc_real_2: 0.29173997044563293 (0.24795515338579813) | > loss_disc_real_3: 0.3342219889163971 (0.20441832890113196) | > loss_disc_real_4: 0.23308305442333221 (0.17789936810731888) | > loss_disc_real_5: 0.22894790768623352 (0.14313030305008093) | > loss_0: 2.927502155303955 (2.1302822828292847) | > loss_gen: 1.7187392711639404 (2.6481721798578897) | > loss_kl: 1.7577587366104126 (2.818726340929667) | > loss_feat: 0.3258010447025299 (6.189744522174199) | > loss_mel: 19.21510124206543 (25.600664774576824) | > loss_duration: 2.368807315826416 (2.382647752761841) | > loss_1: 25.386205673217773 (39.639954249064125) --> EVAL PERFORMANCE | > avg_loader_time: 0.006929477055867513 (-0.004596869150797526) | > avg_loss_disc: 2.1302822828292847 (-0.6418950160344443) | > avg_loss_disc_real_0: 0.16150901714960733 (-0.03647648791472119) | > avg_loss_disc_real_1: 0.20590908328692117 (-0.027904828389485686) | > avg_loss_disc_real_2: 0.24795515338579813 (+0.002015779415766389) | > avg_loss_disc_real_3: 0.20441832890113196 (-0.031688583393891634) | > avg_loss_disc_real_4: 0.17789936810731888 (-0.10575077682733536) | > avg_loss_disc_real_5: 0.14313030305008093 (-0.12754009105265143) | > avg_loss_0: 2.1302822828292847 (-0.6418950160344443) | > avg_loss_gen: 2.6481721798578897 (+0.8172187010447183) | > avg_loss_kl: 2.818726340929667 (+0.3502500454584756) | > avg_loss_feat: 6.189744522174199 (+3.956280519564946) | > avg_loss_mel: 25.600664774576824 (+13.708682854970297) | > avg_loss_duration: 2.382647752761841 (-0.05732552210489894) | > avg_loss_1: 39.639954249064125 (+18.775104840596516)  > EPOCH: 225/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:06:30)   --> TIME: 2023-10-20 02:06:39 -- STEP: 9/50 -- GLOBAL_STEP: 64260 | > loss_disc: 2.7773118019104004 (2.5494150386916266) | > loss_disc_real_0: 0.21616485714912415 (0.1660841953319808) | > loss_disc_real_1: 0.38799160718917847 (0.25274461176660323) | > loss_disc_real_2: 0.23110856115818024 (0.21838056130541694) | > loss_disc_real_3: 0.48312807083129883 (0.3353676713175244) | > loss_disc_real_4: 0.3338399827480316 (0.3257442091902097) | > loss_disc_real_5: 0.45200666785240173 (0.3975462209847238) | > loss_0: 2.7773118019104004 (2.5494150386916266) | > grad_norm_0: tensor(987.4423, device='cuda:0') (tensor(974.6339, device='cuda:0')) | > loss_gen: 2.779095411300659 (2.98842986424764) | > loss_kl: 0.6618764400482178 (0.899808406829834) | > loss_feat: 3.9448037147521973 (7.135398560100132) | > loss_mel: 25.71797752380371 (24.19870662689209) | > loss_duration: 1.580658197402954 (1.6644425789515178) | > loss_1: 34.684410095214844 (36.88678487141927) | > grad_norm_1: tensor(15814.5059, device='cuda:0') (tensor(51632.8672, device='cuda:0')) | > current_lr_0: 0.0001597009977536222 | > current_lr_1: 0.0001597009977536222 | > step_time: 0.689 (0.5450245804256864) | > loader_time: 0.025 (0.01752116945054796)  --> TIME: 2023-10-20 02:06:54 -- STEP: 39/50 -- GLOBAL_STEP: 64290 | > loss_disc: 2.6113553047180176 (2.5869658650496064) | > loss_disc_real_0: 0.13938705623149872 (0.1890784831932531) | > loss_disc_real_1: 0.38595134019851685 (0.24657907852759728) | > loss_disc_real_2: 0.29071465134620667 (0.2287845695630098) | > loss_disc_real_3: 0.35433077812194824 (0.25391841393250697) | > loss_disc_real_4: 0.23705299198627472 (0.28986287097900343) | > loss_disc_real_5: 0.19864633679389954 (0.29457789115034616) | > loss_0: 2.6113553047180176 (2.5869658650496064) | > grad_norm_0: tensor(594.1626, device='cuda:0') (tensor(1020.8547, device='cuda:0')) | > loss_gen: 2.323434591293335 (2.414642789424994) | > loss_kl: 0.8706139326095581 (1.0000625558388538) | > loss_feat: 2.5806872844696045 (5.047859016471567) | > loss_mel: 21.16503143310547 (21.98120653323638) | > loss_duration: 1.6545532941818237 (1.6400446402720916) | > loss_1: 28.59432029724121 (32.0838155624194) | > grad_norm_1: tensor(20566.6133, device='cuda:0') (tensor(36736.4180, device='cuda:0')) | > current_lr_0: 0.0001597009977536222 | > current_lr_1: 0.0001597009977536222 | > step_time: 0.3821 (0.47818922996521007) | > loader_time: 0.0164 (0.016196776659060743)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7476396560668945 (2.7476396560668945) | > loss_disc_real_0: 0.27564120292663574 (0.27564120292663574) | > loss_disc_real_1: 0.24198442697525024 (0.24198442697525024) | > loss_disc_real_2: 0.2850593626499176 (0.2850593626499176) | > loss_disc_real_3: 0.28142181038856506 (0.28142181038856506) | > loss_disc_real_4: 0.2954307794570923 (0.2954307794570923) | > loss_disc_real_5: 0.32742607593536377 (0.32742607593536377) | > loss_0: 2.7476396560668945 (2.7476396560668945) | > loss_gen: 2.3076846599578857 (2.3076846599578857) | > loss_kl: 2.8926830291748047 (2.8926830291748047) | > loss_feat: 2.1502740383148193 (2.1502740383148193) | > loss_mel: 18.123775482177734 (18.123775482177734) | > loss_duration: 2.2773897647857666 (2.2773897647857666) | > loss_1: 27.751806259155273 (27.751806259155273)  --> STEP: 1 | > loss_disc: 3.3389673233032227 (3.3389673233032227) | > loss_disc_real_0: 0.4202343225479126 (0.4202343225479126) | > loss_disc_real_1: 0.24097533524036407 (0.24097533524036407) | > loss_disc_real_2: 0.32303157448768616 (0.32303157448768616) | > loss_disc_real_3: 0.28772181272506714 (0.28772181272506714) | > loss_disc_real_4: 0.38040265440940857 (0.38040265440940857) | > loss_disc_real_5: 0.40238460898399353 (0.40238460898399353) | > loss_0: 3.3389673233032227 (3.3389673233032227) | > loss_gen: 2.1868371963500977 (2.1868371963500977) | > loss_kl: 3.961845636367798 (3.961845636367798) | > loss_feat: 5.204950332641602 (5.204950332641602) | > loss_mel: 26.523826599121094 (26.523826599121094) | > loss_duration: 2.4965479373931885 (2.4965479373931885) | > loss_1: 40.37400436401367 (40.37400436401367)  --> STEP: 2 | > loss_disc: 2.1133155822753906 (2.7261414527893066) | > loss_disc_real_0: 0.24699100852012634 (0.33361266553401947) | > loss_disc_real_1: 0.19042381644248962 (0.21569957584142685) | > loss_disc_real_2: 0.1066703200340271 (0.21485094726085663) | > loss_disc_real_3: 0.19212216138839722 (0.23992198705673218) | > loss_disc_real_4: 0.33251285552978516 (0.35645775496959686) | > loss_disc_real_5: 0.2816804051399231 (0.3420325070619583) | > loss_0: 2.1133155822753906 (2.7261414527893066) | > loss_gen: 2.930459499359131 (2.5586483478546143) | > loss_kl: 3.4834437370300293 (3.7226446866989136) | > loss_feat: 6.735374927520752 (5.970162630081177) | > loss_mel: 28.004491806030273 (27.264159202575684) | > loss_duration: 2.348590135574341 (2.4225690364837646) | > loss_1: 43.50236129760742 (41.93818283081055)  --> STEP: 3 | > loss_disc: 1.986227035522461 (2.479503313700358) | > loss_disc_real_0: 0.2909930646419525 (0.3194061319033305) | > loss_disc_real_1: 0.19352008402347565 (0.20830641190210977) | > loss_disc_real_2: 0.14817184209823608 (0.19262457887331644) | > loss_disc_real_3: 0.1631355732679367 (0.21432651579380035) | > loss_disc_real_4: 0.11364731192588806 (0.2755209406216939) | > loss_disc_real_5: 0.09971961379051208 (0.2612615426381429) | > loss_0: 1.986227035522461 (2.479503313700358) | > loss_gen: 3.373030662536621 (2.830109119415283) | > loss_kl: 1.8726046085357666 (3.1059646606445312) | > loss_feat: 7.179264068603516 (6.373196442921956) | > loss_mel: 24.649662017822266 (26.39266014099121) | > loss_duration: 2.3554224967956543 (2.400186856587728) | > loss_1: 39.42998504638672 (41.10211690266927) --> EVAL PERFORMANCE | > avg_loader_time: 0.018137534459431965 (+0.011208057403564453) | > avg_loss_disc: 2.479503313700358 (+0.34922103087107326) | > avg_loss_disc_real_0: 0.3194061319033305 (+0.15789711475372317) | > avg_loss_disc_real_1: 0.20830641190210977 (+0.0023973286151885986) | > avg_loss_disc_real_2: 0.19262457887331644 (-0.05533057451248169) | > avg_loss_disc_real_3: 0.21432651579380035 (+0.009908186892668397) | > avg_loss_disc_real_4: 0.2755209406216939 (+0.09762157251437503) | > avg_loss_disc_real_5: 0.2612615426381429 (+0.11813123958806196) | > avg_loss_0: 2.479503313700358 (+0.34922103087107326) | > avg_loss_gen: 2.830109119415283 (+0.18193693955739354) | > avg_loss_kl: 3.1059646606445312 (+0.28723831971486424) | > avg_loss_feat: 6.373196442921956 (+0.18345192074775696) | > avg_loss_mel: 26.39266014099121 (+0.7919953664143868) | > avg_loss_duration: 2.400186856587728 (+0.017539103825887192) | > avg_loss_1: 41.10211690266927 (+1.462162653605148)  > EPOCH: 226/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:07:10)   --> TIME: 2023-10-20 02:07:24 -- STEP: 19/50 -- GLOBAL_STEP: 64320 | > loss_disc: 1.476135492324829 (2.2709837022580595) | > loss_disc_real_0: 0.08862290531396866 (0.13595601582997724) | > loss_disc_real_1: 0.19701258838176727 (0.20564999764687136) | > loss_disc_real_2: 0.2543029189109802 (0.2204910583401981) | > loss_disc_real_3: 0.17243681848049164 (0.23505894761336477) | > loss_disc_real_4: 0.15071523189544678 (0.2178405397816708) | > loss_disc_real_5: 0.04964296892285347 (0.2058217991143465) | > loss_0: 1.476135492324829 (2.2709837022580595) | > grad_norm_0: tensor(1246.2566, device='cuda:0') (tensor(956.7719, device='cuda:0')) | > loss_gen: 4.062103748321533 (2.5485087570391203) | > loss_kl: 1.26616370677948 (1.0064224789017124) | > loss_feat: 8.38096809387207 (6.166976898712547) | > loss_mel: 24.165542602539062 (24.642185637825413) | > loss_duration: 1.7409054040908813 (1.6727748042658757) | > loss_1: 39.615684509277344 (36.03686867262188) | > grad_norm_1: tensor(69220.4922, device='cuda:0') (tensor(54078.4180, device='cuda:0')) | > current_lr_0: 0.00015954136660759045 | > current_lr_1: 0.00015954136660759045 | > step_time: 0.6289 (0.5137472152709961) | > loader_time: 0.0036 (0.016882269006026417)  --> TIME: 2023-10-20 02:07:40 -- STEP: 49/50 -- GLOBAL_STEP: 64350 | > loss_disc: 1.5070756673812866 (2.2800048832990676) | > loss_disc_real_0: 0.03513304889202118 (0.14000302326998534) | > loss_disc_real_1: 0.20887143909931183 (0.21565203011340026) | > loss_disc_real_2: 0.10065972805023193 (0.2303359304763833) | > loss_disc_real_3: 0.09027190506458282 (0.24615252595774978) | > loss_disc_real_4: 0.04884373024106026 (0.21137752315523672) | > loss_disc_real_5: 0.11578676849603653 (0.21202073835444693) | > loss_0: 1.5070756673812866 (2.2800048832990676) | > grad_norm_0: tensor(1338.3485, device='cuda:0') (tensor(1054.6202, device='cuda:0')) | > loss_gen: 2.8670005798339844 (2.6111536171971523) | > loss_kl: 0.8155296444892883 (0.9007586672598001) | > loss_feat: 7.837679386138916 (6.077668418974748) | > loss_mel: 23.664644241333008 (23.526156362222167) | > loss_duration: 1.7358614206314087 (1.636962630310837) | > loss_1: 36.92071533203125 (34.752699667093715) | > grad_norm_1: tensor(44487.1016, device='cuda:0') (tensor(45012.3320, device='cuda:0')) | > current_lr_0: 0.00015954136660759045 | > current_lr_1: 0.00015954136660759045 | > step_time: 0.4895 (0.5008617907154315) | > loader_time: 0.3307 (0.022951899742593575)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.842082977294922 (2.842082977294922) | > loss_disc_real_0: 0.14812883734703064 (0.14812883734703064) | > loss_disc_real_1: 0.2017708122730255 (0.2017708122730255) | > loss_disc_real_2: 0.4189256429672241 (0.4189256429672241) | > loss_disc_real_3: 0.36626195907592773 (0.36626195907592773) | > loss_disc_real_4: 0.2905532121658325 (0.2905532121658325) | > loss_disc_real_5: 0.2350366711616516 (0.2350366711616516) | > loss_0: 2.842082977294922 (2.842082977294922) | > loss_gen: 2.1696512699127197 (2.1696512699127197) | > loss_kl: 2.3486328125 (2.3486328125) | > loss_feat: 5.193624973297119 (5.193624973297119) | > loss_mel: 22.917400360107422 (22.917400360107422) | > loss_duration: 2.2358148097991943 (2.2358148097991943) | > loss_1: 34.8651237487793 (34.8651237487793)  --> STEP: 1 | > loss_disc: 2.5035200119018555 (2.5035200119018555) | > loss_disc_real_0: 0.19911092519760132 (0.19911092519760132) | > loss_disc_real_1: 0.1795901507139206 (0.1795901507139206) | > loss_disc_real_2: 0.2320030927658081 (0.2320030927658081) | > loss_disc_real_3: 0.23639363050460815 (0.23639363050460815) | > loss_disc_real_4: 0.4003225266933441 (0.4003225266933441) | > loss_disc_real_5: 0.2176181674003601 (0.2176181674003601) | > loss_0: 2.5035200119018555 (2.5035200119018555) | > loss_gen: 2.299755096435547 (2.299755096435547) | > loss_kl: 2.6550540924072266 (2.6550540924072266) | > loss_feat: 6.657257556915283 (6.657257556915283) | > loss_mel: 28.2860050201416 (28.2860050201416) | > loss_duration: 2.406742572784424 (2.406742572784424) | > loss_1: 42.304813385009766 (42.304813385009766)  --> STEP: 2 | > loss_disc: 3.106184959411621 (2.8048524856567383) | > loss_disc_real_0: 0.15773698687553406 (0.1784239560365677) | > loss_disc_real_1: 0.2711164653301239 (0.22535330802202225) | > loss_disc_real_2: 0.2534371316432953 (0.2427201122045517) | > loss_disc_real_3: 0.23980018496513367 (0.2380969077348709) | > loss_disc_real_4: 0.37366580963134766 (0.3869941681623459) | > loss_disc_real_5: 0.3648301064968109 (0.2912241369485855) | > loss_0: 3.106184959411621 (2.8048524856567383) | > loss_gen: 1.5997474193572998 (1.9497512578964233) | > loss_kl: 3.447195053100586 (3.0511245727539062) | > loss_feat: 0.20030181109905243 (3.428779684007168) | > loss_mel: 3.183089017868042 (15.734547019004822) | > loss_duration: 2.4391438961029053 (2.4229432344436646) | > loss_1: 10.869477272033691 (26.58714532852173)  --> STEP: 3 | > loss_disc: 3.141080856323242 (2.9169286092122397) | > loss_disc_real_0: 0.22667503356933594 (0.19450764854749045) | > loss_disc_real_1: 0.3760598301887512 (0.2755888154109319) | > loss_disc_real_2: 0.4688883423805237 (0.31810952226320904) | > loss_disc_real_3: 0.2687474191188812 (0.24831374486287436) | > loss_disc_real_4: 0.3426470160484314 (0.3722117841243744) | > loss_disc_real_5: 0.5890406966209412 (0.3904963235060374) | > loss_0: 3.141080856323242 (2.9169286092122397) | > loss_gen: 2.507598876953125 (2.1357004642486572) | > loss_kl: 1.2444205284118652 (2.448889891306559) | > loss_feat: 3.7916648387908936 (3.5497414022684097) | > loss_mel: 26.779258728027344 (19.416117588678997) | > loss_duration: 2.3820013999938965 (2.4092959562937417) | > loss_1: 36.7049446105957 (29.959745089213055) --> EVAL PERFORMANCE | > avg_loader_time: 0.008963346481323242 (-0.009174187978108723) | > avg_loss_disc: 2.9169286092122397 (+0.4374252955118818) | > avg_loss_disc_real_0: 0.19450764854749045 (-0.12489848335584006) | > avg_loss_disc_real_1: 0.2755888154109319 (+0.06728240350882211) | > avg_loss_disc_real_2: 0.31810952226320904 (+0.1254849433898926) | > avg_loss_disc_real_3: 0.24831374486287436 (+0.033987229069074004) | > avg_loss_disc_real_4: 0.3722117841243744 (+0.09669084350268048) | > avg_loss_disc_real_5: 0.3904963235060374 (+0.12923478086789453) | > avg_loss_0: 2.9169286092122397 (+0.4374252955118818) | > avg_loss_gen: 2.1357004642486572 (-0.694408655166626) | > avg_loss_kl: 2.448889891306559 (-0.6570747693379722) | > avg_loss_feat: 3.5497414022684097 (-2.8234550406535464) | > avg_loss_mel: 19.416117588678997 (-6.976542552312214) | > avg_loss_duration: 2.4092959562937417 (+0.009109099706013701) | > avg_loss_1: 29.959745089213055 (-11.142371813456219)  > EPOCH: 227/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:07:50)   --> TIME: 2023-10-20 02:08:05 -- STEP: 29/50 -- GLOBAL_STEP: 64380 | > loss_disc: 2.6723546981811523 (2.4989374094995958) | > loss_disc_real_0: 0.14050568640232086 (0.153928037475923) | > loss_disc_real_1: 0.19517476856708527 (0.23912121522529373) | > loss_disc_real_2: 0.2111009806394577 (0.22219146171520496) | > loss_disc_real_3: 0.2228509783744812 (0.2425348626385475) | > loss_disc_real_4: 0.46209245920181274 (0.2219064687860423) | > loss_disc_real_5: 0.25946924090385437 (0.22949198871080217) | > loss_0: 2.6723546981811523 (2.4989374094995958) | > grad_norm_0: tensor(589.0860, device='cuda:0') (tensor(862.9163, device='cuda:0')) | > loss_gen: 2.2909016609191895 (2.385923180086859) | > loss_kl: 0.9160735011100769 (1.0001234699939863) | > loss_feat: 3.541067123413086 (5.110898372781431) | > loss_mel: 22.474929809570312 (22.858074915820154) | > loss_duration: 1.6135072708129883 (1.6497889346089856) | > loss_1: 30.83647918701172 (33.00480888629782) | > grad_norm_1: tensor(11190.9951, device='cuda:0') (tensor(27274.4316, device='cuda:0')) | > current_lr_0: 0.00015938189502288358 | > current_lr_1: 0.00015938189502288358 | > step_time: 0.3927 (0.3522087212266594) | > loader_time: 0.0019 (0.00651928474163187)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7282909154891968 (1.7282909154891968) | > loss_disc_real_0: 0.21749837696552277 (0.21749837696552277) | > loss_disc_real_1: 0.079768605530262 (0.079768605530262) | > loss_disc_real_2: 0.10448356717824936 (0.10448356717824936) | > loss_disc_real_3: 0.09004893898963928 (0.09004893898963928) | > loss_disc_real_4: 0.06060676649212837 (0.06060676649212837) | > loss_disc_real_5: 0.012329168617725372 (0.012329168617725372) | > loss_0: 1.7282909154891968 (1.7282909154891968) | > loss_gen: 2.6173269748687744 (2.6173269748687744) | > loss_kl: 2.5143086910247803 (2.5143086910247803) | > loss_feat: 10.6404447555542 (10.6404447555542) | > loss_mel: 23.661251068115234 (23.661251068115234) | > loss_duration: 2.198181390762329 (2.198181390762329) | > loss_1: 41.63151550292969 (41.63151550292969)  --> STEP: 1 | > loss_disc: 1.9980359077453613 (1.9980359077453613) | > loss_disc_real_0: 0.043058883398771286 (0.043058883398771286) | > loss_disc_real_1: 0.19521450996398926 (0.19521450996398926) | > loss_disc_real_2: 0.2507932186126709 (0.2507932186126709) | > loss_disc_real_3: 0.20750951766967773 (0.20750951766967773) | > loss_disc_real_4: 0.1640608310699463 (0.1640608310699463) | > loss_disc_real_5: 0.24206240475177765 (0.24206240475177765) | > loss_0: 1.9980359077453613 (1.9980359077453613) | > loss_gen: 2.7091901302337646 (2.7091901302337646) | > loss_kl: 2.8274643421173096 (2.8274643421173096) | > loss_feat: 6.775978088378906 (6.775978088378906) | > loss_mel: 25.544757843017578 (25.544757843017578) | > loss_duration: 2.4018964767456055 (2.4018964767456055) | > loss_1: 40.2592887878418 (40.2592887878418)  --> STEP: 2 | > loss_disc: 2.2033181190490723 (2.100677013397217) | > loss_disc_real_0: 0.109606072306633 (0.07633247785270214) | > loss_disc_real_1: 0.28920188546180725 (0.24220819771289825) | > loss_disc_real_2: 0.1714504510164261 (0.2111218348145485) | > loss_disc_real_3: 0.3741660714149475 (0.2908377945423126) | > loss_disc_real_4: 0.1068425104022026 (0.13545167073607445) | > loss_disc_real_5: 0.09974254667758942 (0.17090247571468353) | > loss_0: 2.2033181190490723 (2.100677013397217) | > loss_gen: 2.34136700630188 (2.5252785682678223) | > loss_kl: 3.8051376342773438 (3.3163009881973267) | > loss_feat: 5.52170991897583 (6.148844003677368) | > loss_mel: 25.66726303100586 (25.60601043701172) | > loss_duration: 2.4720280170440674 (2.4369622468948364) | > loss_1: 39.80750274658203 (40.033395767211914)  --> STEP: 3 | > loss_disc: 3.014207601547241 (2.405187209447225) | > loss_disc_real_0: 0.2656436264514923 (0.13943619405229887) | > loss_disc_real_1: 0.28971269726753235 (0.2580430308977763) | > loss_disc_real_2: 0.31050166487693787 (0.24424844483534494) | > loss_disc_real_3: 0.2680603265762329 (0.28324530522028607) | > loss_disc_real_4: 0.3245837092399597 (0.19849568357070288) | > loss_disc_real_5: 0.2679353356361389 (0.20324676235516867) | > loss_0: 3.014207601547241 (2.405187209447225) | > loss_gen: 1.7372180223464966 (2.2625917196273804) | > loss_kl: 1.8900957107543945 (2.8408992290496826) | > loss_feat: 0.05493086203932762 (4.117539623131354) | > loss_mel: 2.635650157928467 (17.949223677317303) | > loss_duration: 2.4328041076660156 (2.4355762004852295) | > loss_1: 8.75069808959961 (29.60582987467448) --> EVAL PERFORMANCE | > avg_loader_time: 0.003516038258870443 (-0.005447308222452799) | > avg_loss_disc: 2.405187209447225 (-0.5117413997650146) | > avg_loss_disc_real_0: 0.13943619405229887 (-0.055071454495191574) | > avg_loss_disc_real_1: 0.2580430308977763 (-0.017545784513155582) | > avg_loss_disc_real_2: 0.24424844483534494 (-0.0738610774278641) | > avg_loss_disc_real_3: 0.28324530522028607 (+0.03493156035741171) | > avg_loss_disc_real_4: 0.19849568357070288 (-0.1737161005536715) | > avg_loss_disc_real_5: 0.20324676235516867 (-0.18724956115086874) | > avg_loss_0: 2.405187209447225 (-0.5117413997650146) | > avg_loss_gen: 2.2625917196273804 (+0.12689125537872314) | > avg_loss_kl: 2.8408992290496826 (+0.3920093377431235) | > avg_loss_feat: 4.117539623131354 (+0.5677982208629446) | > avg_loss_mel: 17.949223677317303 (-1.4668939113616943) | > avg_loss_duration: 2.4355762004852295 (+0.026280244191487778) | > avg_loss_1: 29.60582987467448 (-0.3539152145385742)  > EPOCH: 228/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:08:27)   --> TIME: 2023-10-20 02:08:36 -- STEP: 9/50 -- GLOBAL_STEP: 64410 | > loss_disc: 3.0831918716430664 (2.1069905360539756) | > loss_disc_real_0: 0.1488543152809143 (0.15014040801260206) | > loss_disc_real_1: 0.28150567412376404 (0.22553506824705336) | > loss_disc_real_2: 0.31349989771842957 (0.2155275618036588) | > loss_disc_real_3: 0.28759315609931946 (0.1887899740702576) | > loss_disc_real_4: 0.32496342062950134 (0.20074280516968834) | > loss_disc_real_5: 0.251654714345932 (0.16991172999971443) | > loss_0: 3.0831918716430664 (2.1069905360539756) | > grad_norm_0: tensor(492.0567, device='cuda:0') (tensor(479.1164, device='cuda:0')) | > loss_gen: 1.5787146091461182 (2.70860575305091) | > loss_kl: 0.4226430654525757 (0.8016553322474161) | > loss_feat: 0.08282283693552017 (7.28243291626374) | > loss_mel: 2.5367612838745117 (22.28317599826389) | > loss_duration: 1.6020227670669556 (1.619564996825324) | > loss_1: 6.222964763641357 (34.6954353650411) | > grad_norm_1: tensor(11830.7773, device='cuda:0') (tensor(31833.5273, device='cuda:0')) | > current_lr_0: 0.00015922258284001 | > current_lr_1: 0.00015922258284001 | > step_time: 0.5994 (0.5490632322099473) | > loader_time: 0.0049 (0.015286684036254883)  --> TIME: 2023-10-20 02:08:51 -- STEP: 39/50 -- GLOBAL_STEP: 64440 | > loss_disc: 2.1323583126068115 (2.3262559542289143) | > loss_disc_real_0: 0.01902933418750763 (0.21818413199761358) | > loss_disc_real_1: 0.13439123332500458 (0.2199634701395646) | > loss_disc_real_2: 0.2615940570831299 (0.24123749977503067) | > loss_disc_real_3: 0.25997790694236755 (0.23898901475163606) | > loss_disc_real_4: 0.12753036618232727 (0.2248086301753154) | > loss_disc_real_5: 0.23026885092258453 (0.19282726157838712) | > loss_0: 2.1323583126068115 (2.3262559542289143) | > grad_norm_0: tensor(731.2680, device='cuda:0') (tensor(533.5826, device='cuda:0')) | > loss_gen: 2.422654628753662 (2.715546785256802) | > loss_kl: 0.600170373916626 (0.9168607179935162) | > loss_feat: 6.613465785980225 (6.947120654850434) | > loss_mel: 27.675569534301758 (24.057772911511933) | > loss_duration: 1.6280430555343628 (1.6376483562665107) | > loss_1: 38.939903259277344 (36.27494948949569) | > grad_norm_1: tensor(38701.0469, device='cuda:0') (tensor(19884.7559, device='cuda:0')) | > current_lr_0: 0.00015922258284001 | > current_lr_1: 0.00015922258284001 | > step_time: 0.2541 (0.49455986267481095) | > loader_time: 0.0038 (0.0177006782629551)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0335147380828857 (3.0335147380828857) | > loss_disc_real_0: 0.4443601071834564 (0.4443601071834564) | > loss_disc_real_1: 0.2902112603187561 (0.2902112603187561) | > loss_disc_real_2: 0.2084721326828003 (0.2084721326828003) | > loss_disc_real_3: 0.2888362407684326 (0.2888362407684326) | > loss_disc_real_4: 0.24644002318382263 (0.24644002318382263) | > loss_disc_real_5: 0.252961128950119 (0.252961128950119) | > loss_0: 3.0335147380828857 (3.0335147380828857) | > loss_gen: 1.816575050354004 (1.816575050354004) | > loss_kl: 2.7778453826904297 (2.7778453826904297) | > loss_feat: 0.49637606739997864 (0.49637606739997864) | > loss_mel: 20.30393409729004 (20.30393409729004) | > loss_duration: 2.240870714187622 (2.240870714187622) | > loss_1: 27.635601043701172 (27.635601043701172)  --> STEP: 1 | > loss_disc: 2.947913646697998 (2.947913646697998) | > loss_disc_real_0: 0.33149513602256775 (0.33149513602256775) | > loss_disc_real_1: 0.25595927238464355 (0.25595927238464355) | > loss_disc_real_2: 0.18733926117420197 (0.18733926117420197) | > loss_disc_real_3: 0.28961288928985596 (0.28961288928985596) | > loss_disc_real_4: 0.26265448331832886 (0.26265448331832886) | > loss_disc_real_5: 0.25721681118011475 (0.25721681118011475) | > loss_0: 2.947913646697998 (2.947913646697998) | > loss_gen: 1.7156128883361816 (1.7156128883361816) | > loss_kl: 3.558128595352173 (3.558128595352173) | > loss_feat: 0.6658222675323486 (0.6658222675323486) | > loss_mel: 17.863941192626953 (17.863941192626953) | > loss_duration: 2.408917188644409 (2.408917188644409) | > loss_1: 26.212421417236328 (26.212421417236328)  --> STEP: 2 | > loss_disc: 1.7633023262023926 (2.3556079864501953) | > loss_disc_real_0: 0.08978457748889923 (0.2106398567557335) | > loss_disc_real_1: 0.3567982614040375 (0.3063787668943405) | > loss_disc_real_2: 0.1664053052663803 (0.17687228322029114) | > loss_disc_real_3: 0.1527857482433319 (0.22119931876659393) | > loss_disc_real_4: 0.08291934430599213 (0.1727869138121605) | > loss_disc_real_5: 0.147177055478096 (0.20219693332910538) | > loss_0: 1.7633023262023926 (2.3556079864501953) | > loss_gen: 2.862307071685791 (2.2889599800109863) | > loss_kl: 3.2435173988342285 (3.4008229970932007) | > loss_feat: 7.774911403656006 (4.220366835594177) | > loss_mel: 27.94792938232422 (22.905935287475586) | > loss_duration: 2.369786262512207 (2.389351725578308) | > loss_1: 44.19845199584961 (35.20543670654297)  --> STEP: 3 | > loss_disc: 3.408493995666504 (2.7065699895222983) | > loss_disc_real_0: 0.29419928789138794 (0.23849300046761832) | > loss_disc_real_1: 0.3361598253250122 (0.3163057863712311) | > loss_disc_real_2: 0.4426194429397583 (0.26545466979344684) | > loss_disc_real_3: 0.3251093924045563 (0.25583600997924805) | > loss_disc_real_4: 0.4082997739315033 (0.2512912005186081) | > loss_disc_real_5: 0.4522469937801361 (0.285546953479449) | > loss_0: 3.408493995666504 (2.7065699895222983) | > loss_gen: 2.2171690464019775 (2.2650296688079834) | > loss_kl: 1.527656078338623 (2.7764340241750083) | > loss_feat: 3.7051966190338135 (4.048643430074056) | > loss_mel: 24.723730087280273 (23.51186688741048) | > loss_duration: 2.349755048751831 (2.376152833302816) | > loss_1: 34.52350616455078 (34.978126525878906) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018868446350097656 (-0.0016291936238606772) | > avg_loss_disc: 2.7065699895222983 (+0.30138278007507324) | > avg_loss_disc_real_0: 0.23849300046761832 (+0.09905680641531944) | > avg_loss_disc_real_1: 0.3163057863712311 (+0.058262755473454775) | > avg_loss_disc_real_2: 0.26545466979344684 (+0.0212062249581019) | > avg_loss_disc_real_3: 0.25583600997924805 (-0.027409295241038023) | > avg_loss_disc_real_4: 0.2512912005186081 (+0.05279551694790521) | > avg_loss_disc_real_5: 0.285546953479449 (+0.0823001911242803) | > avg_loss_0: 2.7065699895222983 (+0.30138278007507324) | > avg_loss_gen: 2.2650296688079834 (+0.0024379491806030273) | > avg_loss_kl: 2.7764340241750083 (-0.06446520487467433) | > avg_loss_feat: 4.048643430074056 (-0.06889619305729866) | > avg_loss_mel: 23.51186688741048 (+5.562643210093178) | > avg_loss_duration: 2.376152833302816 (-0.05942336718241359) | > avg_loss_1: 34.978126525878906 (+5.372296651204426)  > EPOCH: 229/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:09:07)   --> TIME: 2023-10-20 02:09:21 -- STEP: 19/50 -- GLOBAL_STEP: 64470 | > loss_disc: 2.9754374027252197 (2.2884726649836495) | > loss_disc_real_0: 0.18285197019577026 (0.13235710051498914) | > loss_disc_real_1: 0.2023993879556656 (0.22395677354774976) | > loss_disc_real_2: 0.23743084073066711 (0.20385177864840157) | > loss_disc_real_3: 0.29116424918174744 (0.24136337088911156) | > loss_disc_real_4: 0.3011130094528198 (0.21572710495246084) | > loss_disc_real_5: 0.24623587727546692 (0.20648737555663838) | > loss_0: 2.9754374027252197 (2.2884726649836495) | > grad_norm_0: tensor(268.6598, device='cuda:0') (tensor(412.2815, device='cuda:0')) | > loss_gen: 1.5427643060684204 (2.595836087277061) | > loss_kl: 1.0383864641189575 (0.9241593135030646) | > loss_feat: 0.30153200030326843 (6.353869187400529) | > loss_mel: 15.265145301818848 (24.446669283666107) | > loss_duration: 1.7957634925842285 (1.6522764218480963) | > loss_1: 19.943592071533203 (35.97281024330541) | > grad_norm_1: tensor(6656.3418, device='cuda:0') (tensor(25672.2344, device='cuda:0')) | > current_lr_0: 0.00015906342989963768 | > current_lr_1: 0.00015906342989963768 | > step_time: 0.6047 (0.5026058397795025) | > loader_time: 0.0224 (0.020289032082808644)  --> TIME: 2023-10-20 02:09:37 -- STEP: 49/50 -- GLOBAL_STEP: 64500 | > loss_disc: 2.3715662956237793 (2.3439861438712306) | > loss_disc_real_0: 0.03089013323187828 (0.13909589050679785) | > loss_disc_real_1: 0.2463180422782898 (0.2317206015696331) | > loss_disc_real_2: 0.17436334490776062 (0.22111449345033996) | > loss_disc_real_3: 0.22039863467216492 (0.23520504059840222) | > loss_disc_real_4: 0.2289961576461792 (0.211710553084101) | > loss_disc_real_5: 0.28978943824768066 (0.20336183814369901) | > loss_0: 2.3715662956237793 (2.3439861438712306) | > grad_norm_0: tensor(502.9937, device='cuda:0') (tensor(447.7978, device='cuda:0')) | > loss_gen: 2.17368483543396 (2.4392108698280497) | > loss_kl: 0.9458174109458923 (0.9351380753273867) | > loss_feat: 4.161925315856934 (5.5087203629771055) | > loss_mel: 22.952550888061523 (22.566730934746406) | > loss_duration: 1.721137285232544 (1.6199731534841109) | > loss_1: 31.955116271972656 (33.06977327502503) | > grad_norm_1: tensor(17526.0195, device='cuda:0') (tensor(20781.2324, device='cuda:0')) | > current_lr_0: 0.00015906342989963768 | > current_lr_1: 0.00015906342989963768 | > step_time: 0.6402 (0.515200814422296) | > loader_time: 0.3657 (0.025580737055564413)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.460792303085327 (2.460792303085327) | > loss_disc_real_0: 0.02290130965411663 (0.02290130965411663) | > loss_disc_real_1: 0.16280503571033478 (0.16280503571033478) | > loss_disc_real_2: 0.1835877150297165 (0.1835877150297165) | > loss_disc_real_3: 0.19945594668388367 (0.19945594668388367) | > loss_disc_real_4: 0.2786312699317932 (0.2786312699317932) | > loss_disc_real_5: 0.2267507165670395 (0.2267507165670395) | > loss_0: 2.460792303085327 (2.460792303085327) | > loss_gen: 1.9330179691314697 (1.9330179691314697) | > loss_kl: 2.7096168994903564 (2.7096168994903564) | > loss_feat: 6.409676551818848 (6.409676551818848) | > loss_mel: 25.158082962036133 (25.158082962036133) | > loss_duration: 2.314758062362671 (2.314758062362671) | > loss_1: 38.525150299072266 (38.525150299072266)  --> STEP: 1 | > loss_disc: 2.1558196544647217 (2.1558196544647217) | > loss_disc_real_0: 0.04993137717247009 (0.04993137717247009) | > loss_disc_real_1: 0.21044455468654633 (0.21044455468654633) | > loss_disc_real_2: 0.18713641166687012 (0.18713641166687012) | > loss_disc_real_3: 0.12265544384717941 (0.12265544384717941) | > loss_disc_real_4: 0.26363497972488403 (0.26363497972488403) | > loss_disc_real_5: 0.1007188931107521 (0.1007188931107521) | > loss_0: 2.1558196544647217 (2.1558196544647217) | > loss_gen: 1.9424200057983398 (1.9424200057983398) | > loss_kl: 3.0427017211914062 (3.0427017211914062) | > loss_feat: 7.458672523498535 (7.458672523498535) | > loss_mel: 25.065122604370117 (25.065122604370117) | > loss_duration: 2.485276699066162 (2.485276699066162) | > loss_1: 39.99419403076172 (39.99419403076172)  --> STEP: 2 | > loss_disc: 2.745742082595825 (2.4507808685302734) | > loss_disc_real_0: 0.07033969461917877 (0.06013553589582443) | > loss_disc_real_1: 0.24139218032360077 (0.22591836750507355) | > loss_disc_real_2: 0.18067267537117004 (0.18390454351902008) | > loss_disc_real_3: 0.17556358873844147 (0.14910951629281044) | > loss_disc_real_4: 0.35214531421661377 (0.3078901469707489) | > loss_disc_real_5: 0.16566680371761322 (0.13319284841418266) | > loss_0: 2.745742082595825 (2.4507808685302734) | > loss_gen: 1.8245071172714233 (1.8834635615348816) | > loss_kl: 3.364760398864746 (3.203731060028076) | > loss_feat: 7.12954568862915 (7.294109106063843) | > loss_mel: 25.869800567626953 (25.467461585998535) | > loss_duration: 2.538153886795044 (2.511715292930603) | > loss_1: 40.726768493652344 (40.36048126220703)  --> STEP: 3 | > loss_disc: 2.6904990673065186 (2.530686934789022) | > loss_disc_real_0: 0.20973321795463562 (0.11000142991542816) | > loss_disc_real_1: 0.23366141319274902 (0.2284993827342987) | > loss_disc_real_2: 0.22801995277404785 (0.19860967993736267) | > loss_disc_real_3: 0.25714772939682007 (0.18512225399414697) | > loss_disc_real_4: 0.2413543313741684 (0.28571154177188873) | > loss_disc_real_5: 0.2727251350879669 (0.1797036106387774) | > loss_0: 2.6904990673065186 (2.530686934789022) | > loss_gen: 1.8132836818695068 (1.86007026831309) | > loss_kl: 1.815067172050476 (2.740843097368876) | > loss_feat: 0.9329468011856079 (5.173721671104431) | > loss_mel: 17.60718536376953 (22.8473695119222) | > loss_duration: 2.5227582454681396 (2.5153962771097818) | > loss_1: 24.691242218017578 (35.13740158081055) --> EVAL PERFORMANCE | > avg_loader_time: 0.01091305414835612 (+0.009026209513346354) | > avg_loss_disc: 2.530686934789022 (-0.17588305473327637) | > avg_loss_disc_real_0: 0.11000142991542816 (-0.12849157055219015) | > avg_loss_disc_real_1: 0.2284993827342987 (-0.08780640363693237) | > avg_loss_disc_real_2: 0.19860967993736267 (-0.06684498985608417) | > avg_loss_disc_real_3: 0.18512225399414697 (-0.07071375598510107) | > avg_loss_disc_real_4: 0.28571154177188873 (+0.03442034125328064) | > avg_loss_disc_real_5: 0.1797036106387774 (-0.10584334284067157) | > avg_loss_0: 2.530686934789022 (-0.17588305473327637) | > avg_loss_gen: 1.86007026831309 (-0.4049594004948933) | > avg_loss_kl: 2.740843097368876 (-0.035590926806132295) | > avg_loss_feat: 5.173721671104431 (+1.1250782410303755) | > avg_loss_mel: 22.8473695119222 (-0.6644973754882812) | > avg_loss_duration: 2.5153962771097818 (+0.13924344380696585) | > avg_loss_1: 35.13740158081055 (+0.15927505493164062)  > EPOCH: 230/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:09:47)   --> TIME: 2023-10-20 02:10:05 -- STEP: 29/50 -- GLOBAL_STEP: 64530 | > loss_disc: 2.680729389190674 (2.43422504951214) | > loss_disc_real_0: 0.287434846162796 (0.1806728223274494) | > loss_disc_real_1: 0.3320664167404175 (0.23729813047524156) | > loss_disc_real_2: 0.18528202176094055 (0.22687551559045396) | > loss_disc_real_3: 0.29664185643196106 (0.21253732668942418) | > loss_disc_real_4: 0.19329729676246643 (0.19459215795685506) | > loss_disc_real_5: 0.4051505923271179 (0.1926447687477901) | > loss_0: 2.680729389190674 (2.43422504951214) | > grad_norm_0: tensor(312.7941, device='cuda:0') (tensor(726.4801, device='cuda:0')) | > loss_gen: 2.3823437690734863 (2.4497239959651025) | > loss_kl: 0.8542878031730652 (1.007400006569665) | > loss_feat: 2.6945629119873047 (5.111854660999159) | > loss_mel: 21.503799438476562 (19.77160538476089) | > loss_duration: 1.667603611946106 (1.652382414916466) | > loss_1: 29.102598190307617 (29.992966619031183) | > grad_norm_1: tensor(3648.0786, device='cuda:0') (tensor(22137.6660, device='cuda:0')) | > current_lr_0: 0.00015890443604259374 | > current_lr_1: 0.00015890443604259374 | > step_time: 0.3407 (0.4309960562607338) | > loader_time: 0.0038 (0.0099586453931085)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7322357892990112 (1.7322357892990112) | > loss_disc_real_0: 0.2806299924850464 (0.2806299924850464) | > loss_disc_real_1: 0.22346097230911255 (0.22346097230911255) | > loss_disc_real_2: 0.09087146073579788 (0.09087146073579788) | > loss_disc_real_3: 0.11754310876131058 (0.11754310876131058) | > loss_disc_real_4: 0.0484045036137104 (0.0484045036137104) | > loss_disc_real_5: 0.013020861893892288 (0.013020861893892288) | > loss_0: 1.7322357892990112 (1.7322357892990112) | > loss_gen: 4.641582489013672 (4.641582489013672) | > loss_kl: 2.768294095993042 (2.768294095993042) | > loss_feat: 11.74673843383789 (11.74673843383789) | > loss_mel: 25.544849395751953 (25.544849395751953) | > loss_duration: 2.278751850128174 (2.278751850128174) | > loss_1: 46.98021697998047 (46.98021697998047)  --> STEP: 1 | > loss_disc: 2.7269299030303955 (2.7269299030303955) | > loss_disc_real_0: 0.4073978662490845 (0.4073978662490845) | > loss_disc_real_1: 0.2722587585449219 (0.2722587585449219) | > loss_disc_real_2: 0.32359957695007324 (0.32359957695007324) | > loss_disc_real_3: 0.24595504999160767 (0.24595504999160767) | > loss_disc_real_4: 0.2215287834405899 (0.2215287834405899) | > loss_disc_real_5: 0.23919451236724854 (0.23919451236724854) | > loss_0: 2.7269299030303955 (2.7269299030303955) | > loss_gen: 2.2467761039733887 (2.2467761039733887) | > loss_kl: 3.5155270099639893 (3.5155270099639893) | > loss_feat: 1.9838544130325317 (1.9838544130325317) | > loss_mel: 20.33513069152832 (20.33513069152832) | > loss_duration: 2.5019912719726562 (2.5019912719726562) | > loss_1: 30.583280563354492 (30.583280563354492)  --> STEP: 2 | > loss_disc: 3.094024896621704 (2.91047739982605) | > loss_disc_real_0: 0.4548850953578949 (0.4311414808034897) | > loss_disc_real_1: 0.36638396978378296 (0.3193213641643524) | > loss_disc_real_2: 0.35858821868896484 (0.34109389781951904) | > loss_disc_real_3: 0.25821030139923096 (0.2520826756954193) | > loss_disc_real_4: 0.2483729124069214 (0.23495084792375565) | > loss_disc_real_5: 0.3412491977214813 (0.29022185504436493) | > loss_0: 3.094024896621704 (2.91047739982605) | > loss_gen: 2.068549633026123 (2.157662868499756) | > loss_kl: 3.1226649284362793 (3.3190959692001343) | > loss_feat: 0.09952007979154587 (1.0416872464120388) | > loss_mel: 3.1498031616210938 (11.742466926574707) | > loss_duration: 2.5319457054138184 (2.5169684886932373) | > loss_1: 10.972484588623047 (20.77788257598877)  --> STEP: 3 | > loss_disc: 3.036496639251709 (2.952483812967936) | > loss_disc_real_0: 0.5444043874740601 (0.4688957830270131) | > loss_disc_real_1: 0.37609609961509705 (0.3382462759812673) | > loss_disc_real_2: 0.28787481784820557 (0.32335420449574787) | > loss_disc_real_3: 0.17774240672588348 (0.22730258603890738) | > loss_disc_real_4: 0.20583736896514893 (0.2252463549375534) | > loss_disc_real_5: 0.3670848309993744 (0.3158428470293681) | > loss_0: 3.036496639251709 (2.952483812967936) | > loss_gen: 3.3269741535186768 (2.547433296839396) | > loss_kl: 1.7090256214141846 (2.7824058532714844) | > loss_feat: 3.2311439514160156 (1.7715061480800312) | > loss_mel: 19.87788200378418 (14.454271952311197) | > loss_duration: 2.4100003242492676 (2.4813124338785806) | > loss_1: 30.555025100708008 (24.036930084228516) --> EVAL PERFORMANCE | > avg_loader_time: 0.014393329620361328 (+0.003480275472005209) | > avg_loss_disc: 2.952483812967936 (+0.4217968781789141) | > avg_loss_disc_real_0: 0.4688957830270131 (+0.35889435311158496) | > avg_loss_disc_real_1: 0.3382462759812673 (+0.10974689324696857) | > avg_loss_disc_real_2: 0.32335420449574787 (+0.1247445245583852) | > avg_loss_disc_real_3: 0.22730258603890738 (+0.042180332044760405) | > avg_loss_disc_real_4: 0.2252463549375534 (-0.06046518683433533) | > avg_loss_disc_real_5: 0.3158428470293681 (+0.1361392363905907) | > avg_loss_0: 2.952483812967936 (+0.4217968781789141) | > avg_loss_gen: 2.547433296839396 (+0.6873630285263059) | > avg_loss_kl: 2.7824058532714844 (+0.041562755902608384) | > avg_loss_feat: 1.7715061480800312 (-3.4022155230244) | > avg_loss_mel: 14.454271952311197 (-8.393097559611002) | > avg_loss_duration: 2.4813124338785806 (-0.03408384323120117) | > avg_loss_1: 24.036930084228516 (-11.100471496582031)  > EPOCH: 231/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:10:24)   --> TIME: 2023-10-20 02:10:33 -- STEP: 9/50 -- GLOBAL_STEP: 64560 | > loss_disc: 3.0957894325256348 (2.4461462100346885) | > loss_disc_real_0: 0.27023452520370483 (0.19397812791996533) | > loss_disc_real_1: 0.34041914343833923 (0.21385959287484488) | > loss_disc_real_2: 0.4281989634037018 (0.22021424025297165) | > loss_disc_real_3: 0.3796865940093994 (0.22520911486612427) | > loss_disc_real_4: 0.2991805970668793 (0.2507503202391995) | > loss_disc_real_5: 0.47490572929382324 (0.21635333179599708) | > loss_0: 3.0957894325256348 (2.4461462100346885) | > grad_norm_0: tensor(346.5416, device='cuda:0') (tensor(474.4138, device='cuda:0')) | > loss_gen: 2.411358118057251 (2.4000370502471924) | > loss_kl: 0.8860150575637817 (0.9278123246298896) | > loss_feat: 3.2214014530181885 (5.783852318922679) | > loss_mel: 24.19430923461914 (22.03704833984375) | > loss_duration: 1.5675158500671387 (1.6263052357567682) | > loss_1: 32.28059768676758 (32.77505535549588) | > grad_norm_1: tensor(5848.0337, device='cuda:0') (tensor(14177.9111, device='cuda:0')) | > current_lr_0: 0.0001587456011098644 | > current_lr_1: 0.0001587456011098644 | > step_time: 0.6182 (0.5081817838880751) | > loader_time: 0.0246 (0.017129023869832356)  --> TIME: 2023-10-20 02:10:48 -- STEP: 39/50 -- GLOBAL_STEP: 64590 | > loss_disc: 2.9291772842407227 (2.516820189280388) | > loss_disc_real_0: 0.21639171242713928 (0.16922017053151742) | > loss_disc_real_1: 0.21847409009933472 (0.238311006854742) | > loss_disc_real_2: 0.37191787362098694 (0.2131337478565864) | > loss_disc_real_3: 0.28518202900886536 (0.24477608850560126) | > loss_disc_real_4: 0.29533541202545166 (0.21975998952984804) | > loss_disc_real_5: 0.20934906601905823 (0.24043150059878826) | > loss_0: 2.9291772842407227 (2.516820189280388) | > grad_norm_0: tensor(580.0361, device='cuda:0') (tensor(499.4649, device='cuda:0')) | > loss_gen: 1.7870385646820068 (2.259034028420082) | > loss_kl: 0.6601749062538147 (0.947678118180006) | > loss_feat: 0.6721442341804504 (4.649852875715647) | > loss_mel: 17.081262588500977 (22.936384470034866) | > loss_duration: 1.6735466718673706 (1.6332685519487429) | > loss_1: 21.87416648864746 (32.42621783721141) | > grad_norm_1: tensor(11684.2695, device='cuda:0') (tensor(12739.5273, device='cuda:0')) | > current_lr_0: 0.0001587456011098644 | > current_lr_1: 0.0001587456011098644 | > step_time: 0.2768 (0.4783227810492882) | > loader_time: 0.0042 (0.0176540766006861)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0235230922698975 (3.0235230922698975) | > loss_disc_real_0: 0.34731975197792053 (0.34731975197792053) | > loss_disc_real_1: 0.3046930730342865 (0.3046930730342865) | > loss_disc_real_2: 0.2930665910243988 (0.2930665910243988) | > loss_disc_real_3: 0.4138597846031189 (0.4138597846031189) | > loss_disc_real_4: 0.3291673958301544 (0.3291673958301544) | > loss_disc_real_5: 0.34134912490844727 (0.34134912490844727) | > loss_0: 3.0235230922698975 (3.0235230922698975) | > loss_gen: 2.449185609817505 (2.449185609817505) | > loss_kl: 2.9328858852386475 (2.9328858852386475) | > loss_feat: 5.3224029541015625 (5.3224029541015625) | > loss_mel: 25.50958824157715 (25.50958824157715) | > loss_duration: 2.263864755630493 (2.263864755630493) | > loss_1: 38.477928161621094 (38.477928161621094)  --> STEP: 1 | > loss_disc: 2.504133701324463 (2.504133701324463) | > loss_disc_real_0: 0.4405452609062195 (0.4405452609062195) | > loss_disc_real_1: 0.27163922786712646 (0.27163922786712646) | > loss_disc_real_2: 0.3257584869861603 (0.3257584869861603) | > loss_disc_real_3: 0.2976820170879364 (0.2976820170879364) | > loss_disc_real_4: 0.2851576805114746 (0.2851576805114746) | > loss_disc_real_5: 0.26673373579978943 (0.26673373579978943) | > loss_0: 2.504133701324463 (2.504133701324463) | > loss_gen: 3.2907638549804688 (3.2907638549804688) | > loss_kl: 3.515463352203369 (3.515463352203369) | > loss_feat: 5.537801265716553 (5.537801265716553) | > loss_mel: 22.907001495361328 (22.907001495361328) | > loss_duration: 2.527796745300293 (2.527796745300293) | > loss_1: 37.77882766723633 (37.77882766723633)  --> STEP: 2 | > loss_disc: 3.1284196376800537 (2.8162766695022583) | > loss_disc_real_0: 0.2656652629375458 (0.35310526192188263) | > loss_disc_real_1: 0.34067559242248535 (0.3061574101448059) | > loss_disc_real_2: 0.4300253391265869 (0.3778919130563736) | > loss_disc_real_3: 0.30342897772789 (0.3005554974079132) | > loss_disc_real_4: 0.3755197525024414 (0.330338716506958) | > loss_disc_real_5: 0.2148607224225998 (0.2407972291111946) | > loss_0: 3.1284196376800537 (2.8162766695022583) | > loss_gen: 1.8561310768127441 (2.5734474658966064) | > loss_kl: 3.2531578540802 (3.3843106031417847) | > loss_feat: 0.31864315271377563 (2.928222209215164) | > loss_mel: 3.3651068210601807 (13.136054158210754) | > loss_duration: 2.473763942718506 (2.5007803440093994) | > loss_1: 11.266803741455078 (24.522815704345703)  --> STEP: 3 | > loss_disc: 2.3928563594818115 (2.6751365661621094) | > loss_disc_real_0: 0.3268457055091858 (0.3443520764509837) | > loss_disc_real_1: 0.274080365896225 (0.2954650620619456) | > loss_disc_real_2: 0.29244986176490784 (0.3494112292925517) | > loss_disc_real_3: 0.1624973863363266 (0.25453612705071765) | > loss_disc_real_4: 0.1672317534685135 (0.2759697288274765) | > loss_disc_real_5: 0.08545910567045212 (0.1890178546309471) | > loss_0: 2.3928563594818115 (2.6751365661621094) | > loss_gen: 2.435204029083252 (2.527366320292155) | > loss_kl: 1.700312614440918 (2.8229779402414956) | > loss_feat: 7.55594539642334 (4.470796604951222) | > loss_mel: 24.361766815185547 (16.87795837720235) | > loss_duration: 2.3452236652374268 (2.448928117752075) | > loss_1: 38.39845275878906 (29.148028055826824) --> EVAL PERFORMANCE | > avg_loader_time: 0.005734046300252278 (-0.00865928332010905) | > avg_loss_disc: 2.6751365661621094 (-0.2773472468058267) | > avg_loss_disc_real_0: 0.3443520764509837 (-0.12454370657602942) | > avg_loss_disc_real_1: 0.2954650620619456 (-0.04278121391932166) | > avg_loss_disc_real_2: 0.3494112292925517 (+0.02605702479680383) | > avg_loss_disc_real_3: 0.25453612705071765 (+0.027233541011810275) | > avg_loss_disc_real_4: 0.2759697288274765 (+0.050723373889923096) | > avg_loss_disc_real_5: 0.1890178546309471 (-0.126824992398421) | > avg_loss_0: 2.6751365661621094 (-0.2773472468058267) | > avg_loss_gen: 2.527366320292155 (-0.02006697654724121) | > avg_loss_kl: 2.8229779402414956 (+0.040572086970011245) | > avg_loss_feat: 4.470796604951222 (+2.699290456871191) | > avg_loss_mel: 16.87795837720235 (+2.4236864248911534) | > avg_loss_duration: 2.448928117752075 (-0.032384316126505386) | > avg_loss_1: 29.148028055826824 (+5.1110979715983085)  > EPOCH: 232/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:11:03)   --> TIME: 2023-10-20 02:11:18 -- STEP: 19/50 -- GLOBAL_STEP: 64620 | > loss_disc: 1.7336798906326294 (2.4579261039432727) | > loss_disc_real_0: 0.11578375101089478 (0.12522518801453866) | > loss_disc_real_1: 0.22742204368114471 (0.2597854729545744) | > loss_disc_real_2: 0.1904047280550003 (0.2798598981217334) | > loss_disc_real_3: 0.18981273472309113 (0.2611008676651277) | > loss_disc_real_4: 0.26004916429519653 (0.2613990254896252) | > loss_disc_real_5: 0.016251130029559135 (0.23782533789543728) | > loss_0: 1.7336798906326294 (2.4579261039432727) | > grad_norm_0: tensor(593.7066, device='cuda:0') (tensor(522.3915, device='cuda:0')) | > loss_gen: 4.154080867767334 (2.553353108857807) | > loss_kl: 1.2640297412872314 (0.9536546437363875) | > loss_feat: 10.905929565429688 (5.797901583345313) | > loss_mel: 27.368528366088867 (24.359325321097124) | > loss_duration: 1.8241567611694336 (1.674818384019952) | > loss_1: 45.5167236328125 (35.33905317908839) | > grad_norm_1: tensor(55039.9570, device='cuda:0') (tensor(28933.7773, device='cuda:0')) | > current_lr_0: 0.0001585869249425949 | > current_lr_1: 0.0001585869249425949 | > step_time: 0.3426 (0.5111610136534038) | > loader_time: 0.0016 (0.017083004901283665)  --> TIME: 2023-10-20 02:11:35 -- STEP: 49/50 -- GLOBAL_STEP: 64650 | > loss_disc: 2.8973586559295654 (2.453488121227342) | > loss_disc_real_0: 0.16965323686599731 (0.1395116307373558) | > loss_disc_real_1: 0.24158848822116852 (0.2282904673899923) | > loss_disc_real_2: 0.13205991685390472 (0.2476093875510352) | > loss_disc_real_3: 0.3888356387615204 (0.24812465822514224) | > loss_disc_real_4: 0.2489139586687088 (0.2505327618243743) | > loss_disc_real_5: 0.2969779968261719 (0.22128909503166772) | > loss_0: 2.8973586559295654 (2.453488121227342) | > grad_norm_0: tensor(440.0029, device='cuda:0') (tensor(481.0264, device='cuda:0')) | > loss_gen: 2.2066853046417236 (2.4169637086440106) | > loss_kl: 0.6013249158859253 (0.8943570596831185) | > loss_feat: 4.7382354736328125 (5.58125580999316) | > loss_mel: 25.565658569335938 (24.134129908620096) | > loss_duration: 1.7938941717147827 (1.6354834352220808) | > loss_1: 34.905799865722656 (34.66218997994247) | > grad_norm_1: tensor(22458.4062, device='cuda:0') (tensor(19156.5488, device='cuda:0')) | > current_lr_0: 0.0001585869249425949 | > current_lr_1: 0.0001585869249425949 | > step_time: 0.6727 (0.5127525134962433) | > loader_time: 0.3412 (0.025539349536506502)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.292348861694336 (2.292348861694336) | > loss_disc_real_0: 0.05032419413328171 (0.05032419413328171) | > loss_disc_real_1: 0.1532192975282669 (0.1532192975282669) | > loss_disc_real_2: 0.12216436862945557 (0.12216436862945557) | > loss_disc_real_3: 0.321755588054657 (0.321755588054657) | > loss_disc_real_4: 0.4573775827884674 (0.4573775827884674) | > loss_disc_real_5: 0.3365890383720398 (0.3365890383720398) | > loss_0: 2.292348861694336 (2.292348861694336) | > loss_gen: 2.774677276611328 (2.774677276611328) | > loss_kl: 2.6821129322052 (2.6821129322052) | > loss_feat: 6.480641841888428 (6.480641841888428) | > loss_mel: 23.137680053710938 (23.137680053710938) | > loss_duration: 2.3178772926330566 (2.3178772926330566) | > loss_1: 37.39299011230469 (37.39299011230469)  --> STEP: 1 | > loss_disc: 2.293595314025879 (2.293595314025879) | > loss_disc_real_0: 0.08630545437335968 (0.08630545437335968) | > loss_disc_real_1: 0.14860577881336212 (0.14860577881336212) | > loss_disc_real_2: 0.28136777877807617 (0.28136777877807617) | > loss_disc_real_3: 0.3117697238922119 (0.3117697238922119) | > loss_disc_real_4: 0.23274187743663788 (0.23274187743663788) | > loss_disc_real_5: 0.24305564165115356 (0.24305564165115356) | > loss_0: 2.293595314025879 (2.293595314025879) | > loss_gen: 2.741814613342285 (2.741814613342285) | > loss_kl: 3.4417777061462402 (3.4417777061462402) | > loss_feat: 6.804213523864746 (6.804213523864746) | > loss_mel: 21.809656143188477 (21.809656143188477) | > loss_duration: 2.4705653190612793 (2.4705653190612793) | > loss_1: 37.268028259277344 (37.268028259277344)  --> STEP: 2 | > loss_disc: 2.0973687171936035 (2.195482015609741) | > loss_disc_real_0: 0.09465014934539795 (0.09047780185937881) | > loss_disc_real_1: 0.23411668837070465 (0.1913612335920334) | > loss_disc_real_2: 0.22379770874977112 (0.25258274376392365) | > loss_disc_real_3: 0.18045112490653992 (0.24611042439937592) | > loss_disc_real_4: 0.3759579360485077 (0.3043499067425728) | > loss_disc_real_5: 0.3272644877433777 (0.2851600646972656) | > loss_0: 2.0973687171936035 (2.195482015609741) | > loss_gen: 3.262418270111084 (3.0021164417266846) | > loss_kl: 3.006044387817383 (3.2239110469818115) | > loss_feat: 6.454148292541504 (6.629180908203125) | > loss_mel: 26.725080490112305 (24.26736831665039) | > loss_duration: 2.3932299613952637 (2.4318976402282715) | > loss_1: 41.840919494628906 (39.554473876953125)  --> STEP: 3 | > loss_disc: 2.1275415420532227 (2.172835191090902) | > loss_disc_real_0: 0.12725788354873657 (0.10273782908916473) | > loss_disc_real_1: 0.23858463764190674 (0.2071023682753245) | > loss_disc_real_2: 0.16840122640132904 (0.22452223797639212) | > loss_disc_real_3: 0.1268092542886734 (0.2063433676958084) | > loss_disc_real_4: 0.1868383139371872 (0.2651793758074443) | > loss_disc_real_5: 0.06533071398735046 (0.21188361446062723) | > loss_0: 2.1275415420532227 (2.172835191090902) | > loss_gen: 2.1476333141326904 (2.7172887325286865) | > loss_kl: 2.028377056121826 (2.82539971669515) | > loss_feat: 7.806070327758789 (7.021477381388347) | > loss_mel: 23.644895553588867 (24.059877395629883) | > loss_duration: 2.518998146057129 (2.460931142171224) | > loss_1: 38.145973205566406 (39.084973653157554) --> EVAL PERFORMANCE | > avg_loader_time: 0.013106902440388998 (+0.00737285614013672) | > avg_loss_disc: 2.172835191090902 (-0.5023013750712075) | > avg_loss_disc_real_0: 0.10273782908916473 (-0.24161424736181897) | > avg_loss_disc_real_1: 0.2071023682753245 (-0.08836269378662112) | > avg_loss_disc_real_2: 0.22452223797639212 (-0.12488899131615958) | > avg_loss_disc_real_3: 0.2063433676958084 (-0.04819275935490924) | > avg_loss_disc_real_4: 0.2651793758074443 (-0.010790353020032228) | > avg_loss_disc_real_5: 0.21188361446062723 (+0.022865759829680116) | > avg_loss_0: 2.172835191090902 (-0.5023013750712075) | > avg_loss_gen: 2.7172887325286865 (+0.18992241223653172) | > avg_loss_kl: 2.82539971669515 (+0.0024217764536542674) | > avg_loss_feat: 7.021477381388347 (+2.550680776437124) | > avg_loss_mel: 24.059877395629883 (+7.181919018427532) | > avg_loss_duration: 2.460931142171224 (+0.012003024419148911) | > avg_loss_1: 39.084973653157554 (+9.93694559733073)  > EPOCH: 233/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:11:45)   --> TIME: 2023-10-20 02:12:01 -- STEP: 29/50 -- GLOBAL_STEP: 64680 | > loss_disc: 2.918879747390747 (2.4309279548710787) | > loss_disc_real_0: 0.3198712170124054 (0.16757970788227072) | > loss_disc_real_1: 0.3272383213043213 (0.22918063299409275) | > loss_disc_real_2: 0.30993297696113586 (0.2302318996396558) | > loss_disc_real_3: 0.22271013259887695 (0.22991907031371675) | > loss_disc_real_4: 0.24417062103748322 (0.232315000853148) | > loss_disc_real_5: 0.2720378339290619 (0.2121056728065014) | > loss_0: 2.918879747390747 (2.4309279548710787) | > grad_norm_0: tensor(420.2289, device='cuda:0') (tensor(542.1060, device='cuda:0')) | > loss_gen: 1.8224601745605469 (2.5048211812973027) | > loss_kl: 0.8303770422935486 (1.1098456423858114) | > loss_feat: 0.49945682287216187 (6.072295973013187) | > loss_mel: 17.978485107421875 (23.810679986559112) | > loss_duration: 1.6540379524230957 (1.6658125910265693) | > loss_1: 22.78481674194336 (35.16345571649486) | > grad_norm_1: tensor(4719.2051, device='cuda:0') (tensor(18151.8301, device='cuda:0')) | > current_lr_0: 0.0001584284073820892 | > current_lr_1: 0.0001584284073820892 | > step_time: 0.4344 (0.3726468826162404) | > loader_time: 0.0032 (0.007541146771661168)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.234349250793457 (2.234349250793457) | > loss_disc_real_0: 0.2952897250652313 (0.2952897250652313) | > loss_disc_real_1: 0.29115110635757446 (0.29115110635757446) | > loss_disc_real_2: 0.25208383798599243 (0.25208383798599243) | > loss_disc_real_3: 0.20640991628170013 (0.20640991628170013) | > loss_disc_real_4: 0.18130381405353546 (0.18130381405353546) | > loss_disc_real_5: 0.3526388704776764 (0.3526388704776764) | > loss_0: 2.234349250793457 (2.234349250793457) | > loss_gen: 3.183504104614258 (3.183504104614258) | > loss_kl: 2.7394933700561523 (2.7394933700561523) | > loss_feat: 7.604669094085693 (7.604669094085693) | > loss_mel: 23.318836212158203 (23.318836212158203) | > loss_duration: 2.413485288619995 (2.413485288619995) | > loss_1: 39.25999069213867 (39.25999069213867)  --> STEP: 1 | > loss_disc: 2.4759671688079834 (2.4759671688079834) | > loss_disc_real_0: 0.41120535135269165 (0.41120535135269165) | > loss_disc_real_1: 0.293393611907959 (0.293393611907959) | > loss_disc_real_2: 0.2894589304924011 (0.2894589304924011) | > loss_disc_real_3: 0.33234071731567383 (0.33234071731567383) | > loss_disc_real_4: 0.26285919547080994 (0.26285919547080994) | > loss_disc_real_5: 0.2638987898826599 (0.2638987898826599) | > loss_0: 2.4759671688079834 (2.4759671688079834) | > loss_gen: 3.2057442665100098 (3.2057442665100098) | > loss_kl: 3.279463768005371 (3.279463768005371) | > loss_feat: 6.251101493835449 (6.251101493835449) | > loss_mel: 26.325706481933594 (26.325706481933594) | > loss_duration: 2.564655065536499 (2.564655065536499) | > loss_1: 41.626670837402344 (41.626670837402344)  --> STEP: 2 | > loss_disc: 1.4563425779342651 (1.9661548733711243) | > loss_disc_real_0: 0.14083652198314667 (0.27602093666791916) | > loss_disc_real_1: 0.1850333958864212 (0.2392135038971901) | > loss_disc_real_2: 0.18388482928276062 (0.23667187988758087) | > loss_disc_real_3: 0.16680626571178436 (0.2495734915137291) | > loss_disc_real_4: 0.10848179459571838 (0.18567049503326416) | > loss_disc_real_5: 0.05876423791050911 (0.1613315138965845) | > loss_0: 1.4563425779342651 (1.9661548733711243) | > loss_gen: 3.500082492828369 (3.3529133796691895) | > loss_kl: 3.7576370239257812 (3.518550395965576) | > loss_feat: 9.036219596862793 (7.643660545349121) | > loss_mel: 29.567155838012695 (27.946431159973145) | > loss_duration: 2.4571292400360107 (2.510892152786255) | > loss_1: 48.3182258605957 (44.97244834899902)  --> STEP: 3 | > loss_disc: 2.636603832244873 (2.189637859662374) | > loss_disc_real_0: 0.30110839009284973 (0.284383421142896) | > loss_disc_real_1: 0.2490771859884262 (0.24250139792760214) | > loss_disc_real_2: 0.16186755895614624 (0.21173710624376932) | > loss_disc_real_3: 0.25007402896881104 (0.24974033733208975) | > loss_disc_real_4: 0.20758987963199615 (0.19297695656617483) | > loss_disc_real_5: 0.17219235002994537 (0.1649517926077048) | > loss_0: 2.636603832244873 (2.189637859662374) | > loss_gen: 1.957215666770935 (2.8876808087031045) | > loss_kl: 1.2593950033187866 (2.7654985984166465) | > loss_feat: 5.68417501449585 (6.990498701731364) | > loss_mel: 24.332082748413086 (26.741648356119793) | > loss_duration: 2.4076216220855713 (2.476468642552694) | > loss_1: 35.6404914855957 (41.861796061197914) --> EVAL PERFORMANCE | > avg_loader_time: 0.008410215377807617 (-0.004696687062581381) | > avg_loss_disc: 2.189637859662374 (+0.016802668571472168) | > avg_loss_disc_real_0: 0.284383421142896 (+0.18164559205373126) | > avg_loss_disc_real_1: 0.24250139792760214 (+0.03539902965227765) | > avg_loss_disc_real_2: 0.21173710624376932 (-0.012785131732622801) | > avg_loss_disc_real_3: 0.24974033733208975 (+0.04339696963628134) | > avg_loss_disc_real_4: 0.19297695656617483 (-0.07220241924126944) | > avg_loss_disc_real_5: 0.1649517926077048 (-0.04693182185292244) | > avg_loss_0: 2.189637859662374 (+0.016802668571472168) | > avg_loss_gen: 2.8876808087031045 (+0.17039207617441798) | > avg_loss_kl: 2.7654985984166465 (-0.05990111827850342) | > avg_loss_feat: 6.990498701731364 (-0.030978679656982422) | > avg_loss_mel: 26.741648356119793 (+2.68177096048991) | > avg_loss_duration: 2.476468642552694 (+0.015537500381469727) | > avg_loss_1: 41.861796061197914 (+2.77682240804036)  > EPOCH: 234/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:12:22)   --> TIME: 2023-10-20 02:12:31 -- STEP: 9/50 -- GLOBAL_STEP: 64710 | > loss_disc: 2.9984421730041504 (1.9596113761266072) | > loss_disc_real_0: 0.2714921534061432 (0.08135999532209502) | > loss_disc_real_1: 0.3832417130470276 (0.22235684469342232) | > loss_disc_real_2: 0.3384276032447815 (0.1955106556415558) | > loss_disc_real_3: 0.36871960759162903 (0.22271493987904656) | > loss_disc_real_4: 0.29498806595802307 (0.16862785443663597) | > loss_disc_real_5: 0.2926006019115448 (0.20641087740659714) | > loss_0: 2.9984421730041504 (1.9596113761266072) | > grad_norm_0: tensor(319.5028, device='cuda:0') (tensor(420.2139, device='cuda:0')) | > loss_gen: 2.4446585178375244 (2.9512974421183267) | > loss_kl: 0.7590845227241516 (1.1538673374387953) | > loss_feat: 2.626657485961914 (9.056575351291233) | > loss_mel: 17.081308364868164 (27.727705849541557) | > loss_duration: 1.5757687091827393 (1.6241438918643527) | > loss_1: 24.487478256225586 (42.513589435153534) | > grad_norm_1: tensor(7841.0654, device='cuda:0') (tensor(24391.4316, device='cuda:0')) | > current_lr_0: 0.00015827004826980988 | > current_lr_1: 0.00015827004826980988 | > step_time: 0.2821 (0.5011811786227756) | > loader_time: 0.0294 (0.016700771119859483)  --> TIME: 2023-10-20 02:12:46 -- STEP: 39/50 -- GLOBAL_STEP: 64740 | > loss_disc: 3.02536678314209 (2.4461464423399706) | > loss_disc_real_0: 0.20620377361774445 (0.15917240823499668) | > loss_disc_real_1: 0.24507875740528107 (0.24286213870614004) | > loss_disc_real_2: 0.20461314916610718 (0.20883430884434626) | > loss_disc_real_3: 0.25357794761657715 (0.27631915456209427) | > loss_disc_real_4: 0.27710801362991333 (0.2554522404112877) | > loss_disc_real_5: 0.19939260184764862 (0.24700460411035097) | > loss_0: 3.02536678314209 (2.4461464423399706) | > grad_norm_0: tensor(2807.6802, device='cuda:0') (tensor(540.3618, device='cuda:0')) | > loss_gen: 1.4861599206924438 (2.4542583318857045) | > loss_kl: 0.5239419937133789 (0.9938495113299447) | > loss_feat: 0.14579136669635773 (5.6658019711956) | > loss_mel: 13.352694511413574 (23.199840887998924) | > loss_duration: 1.6741641759872437 (1.6265640289355547) | > loss_1: 17.18275260925293 (33.94031463525234) | > grad_norm_1: tensor(12459.0273, device='cuda:0') (tensor(14998.8574, device='cuda:0')) | > current_lr_0: 0.00015827004826980988 | > current_lr_1: 0.00015827004826980988 | > step_time: 0.252 (0.49039132778461164) | > loader_time: 0.0147 (0.019598698004698135)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.345396041870117 (2.345396041870117) | > loss_disc_real_0: 0.22261643409729004 (0.22261643409729004) | > loss_disc_real_1: 0.21919752657413483 (0.21919752657413483) | > loss_disc_real_2: 0.25842151045799255 (0.25842151045799255) | > loss_disc_real_3: 0.24782277643680573 (0.24782277643680573) | > loss_disc_real_4: 0.18409734964370728 (0.18409734964370728) | > loss_disc_real_5: 0.11471682786941528 (0.11471682786941528) | > loss_0: 2.345396041870117 (2.345396041870117) | > loss_gen: 2.3029468059539795 (2.3029468059539795) | > loss_kl: 2.655587673187256 (2.655587673187256) | > loss_feat: 4.678139686584473 (4.678139686584473) | > loss_mel: 25.526575088500977 (25.526575088500977) | > loss_duration: 2.3127737045288086 (2.3127737045288086) | > loss_1: 37.47602462768555 (37.47602462768555)  --> STEP: 1 | > loss_disc: 2.9137675762176514 (2.9137675762176514) | > loss_disc_real_0: 0.08780655264854431 (0.08780655264854431) | > loss_disc_real_1: 0.26648786664009094 (0.26648786664009094) | > loss_disc_real_2: 0.19955314695835114 (0.19955314695835114) | > loss_disc_real_3: 0.2841041684150696 (0.2841041684150696) | > loss_disc_real_4: 0.3077412545681 (0.3077412545681) | > loss_disc_real_5: 0.32120373845100403 (0.32120373845100403) | > loss_0: 2.9137675762176514 (2.9137675762176514) | > loss_gen: 1.638138771057129 (1.638138771057129) | > loss_kl: 3.4053378105163574 (3.4053378105163574) | > loss_feat: 1.2651926279067993 (1.2651926279067993) | > loss_mel: 20.840435028076172 (20.840435028076172) | > loss_duration: 2.4603934288024902 (2.4603934288024902) | > loss_1: 29.609498977661133 (29.609498977661133)  --> STEP: 2 | > loss_disc: 1.9116332530975342 (2.4127004146575928) | > loss_disc_real_0: 0.04611584544181824 (0.06696119904518127) | > loss_disc_real_1: 0.23707114160060883 (0.2517795041203499) | > loss_disc_real_2: 0.16953282058238983 (0.18454298377037048) | > loss_disc_real_3: 0.24504932761192322 (0.2645767480134964) | > loss_disc_real_4: 0.4523712396621704 (0.3800562471151352) | > loss_disc_real_5: 0.20768265426158905 (0.26444319635629654) | > loss_0: 1.9116332530975342 (2.4127004146575928) | > loss_gen: 3.872253894805908 (2.7551963329315186) | > loss_kl: 2.99202299118042 (3.1986804008483887) | > loss_feat: 8.518403053283691 (4.891797840595245) | > loss_mel: 23.77939224243164 (22.309913635253906) | > loss_duration: 2.410722255706787 (2.4355578422546387) | > loss_1: 41.572792053222656 (35.591145515441895)  --> STEP: 3 | > loss_disc: 1.9018003940582275 (2.2424004077911377) | > loss_disc_real_0: 0.10279887914657593 (0.07890709241231282) | > loss_disc_real_1: 0.18551947176456451 (0.22969282666842142) | > loss_disc_real_2: 0.2553357183933258 (0.20814056197802225) | > loss_disc_real_3: 0.26621559262275696 (0.26512302954991657) | > loss_disc_real_4: 0.17058143019676208 (0.3102313081423442) | > loss_disc_real_5: 0.25042885541915894 (0.25977174937725067) | > loss_0: 1.9018003940582275 (2.2424004077911377) | > loss_gen: 3.3107030391693115 (2.9403652350107827) | > loss_kl: 1.481687068939209 (2.6263492902119956) | > loss_feat: 5.9755539894104 (5.253049890200297) | > loss_mel: 21.34383201599121 (21.987886428833008) | > loss_duration: 2.338718891143799 (2.403278191884359) | > loss_1: 34.45049285888672 (35.210927963256836) --> EVAL PERFORMANCE | > avg_loader_time: 0.0016623338063557942 (-0.006747881571451823) | > avg_loss_disc: 2.2424004077911377 (+0.05276254812876369) | > avg_loss_disc_real_0: 0.07890709241231282 (-0.2054763287305832) | > avg_loss_disc_real_1: 0.22969282666842142 (-0.012808571259180723) | > avg_loss_disc_real_2: 0.20814056197802225 (-0.0035965442657470703) | > avg_loss_disc_real_3: 0.26512302954991657 (+0.015382692217826816) | > avg_loss_disc_real_4: 0.3102313081423442 (+0.11725435157616934) | > avg_loss_disc_real_5: 0.25977174937725067 (+0.09481995676954588) | > avg_loss_0: 2.2424004077911377 (+0.05276254812876369) | > avg_loss_gen: 2.9403652350107827 (+0.05268442630767822) | > avg_loss_kl: 2.6263492902119956 (-0.13914930820465088) | > avg_loss_feat: 5.253049890200297 (-1.737448811531067) | > avg_loss_mel: 21.987886428833008 (-4.753761927286785) | > avg_loss_duration: 2.403278191884359 (-0.07319045066833496) | > avg_loss_1: 35.210927963256836 (-6.650868097941078)  > EPOCH: 235/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:13:03)   --> TIME: 2023-10-20 02:13:18 -- STEP: 19/50 -- GLOBAL_STEP: 64770 | > loss_disc: 2.9867498874664307 (2.408540731982181) | > loss_disc_real_0: 0.16349446773529053 (0.14947988308574023) | > loss_disc_real_1: 0.20136059820652008 (0.21462728788978175) | > loss_disc_real_2: 0.26764294505119324 (0.2292909549647256) | > loss_disc_real_3: 0.28801384568214417 (0.266586497426033) | > loss_disc_real_4: 0.35581493377685547 (0.230732354090402) | > loss_disc_real_5: 0.3911769390106201 (0.21935013681650162) | > loss_0: 2.9867498874664307 (2.408540731982181) | > grad_norm_0: tensor(345.0320, device='cuda:0') (tensor(501.4193, device='cuda:0')) | > loss_gen: 1.776633620262146 (2.5275716844357943) | > loss_kl: 0.7489275336265564 (0.938267278828119) | > loss_feat: 2.0264933109283447 (5.6436650968695945) | > loss_mel: 25.455427169799805 (22.882006293848942) | > loss_duration: 1.7571296691894531 (1.6908544364728426) | > loss_1: 31.764612197875977 (33.68236541748046) | > grad_norm_1: tensor(5730.3984, device='cuda:0') (tensor(21474.3613, device='cuda:0')) | > current_lr_0: 0.00015811184744737806 | > current_lr_1: 0.00015811184744737806 | > step_time: 0.5913 (0.5041181539234362) | > loader_time: 0.0098 (0.017230397776553507)  --> TIME: 2023-10-20 02:13:33 -- STEP: 49/50 -- GLOBAL_STEP: 64800 | > loss_disc: 2.470197916030884 (2.361798651364385) | > loss_disc_real_0: 0.0469861663877964 (0.15057076764654143) | > loss_disc_real_1: 0.33249208331108093 (0.2214341212292107) | > loss_disc_real_2: 0.14165754616260529 (0.21424460593534975) | > loss_disc_real_3: 0.3614574074745178 (0.24157320274686328) | > loss_disc_real_4: 0.28871044516563416 (0.22319299453983502) | > loss_disc_real_5: 0.38301050662994385 (0.2096520357062014) | > loss_0: 2.470197916030884 (2.361798651364385) | > grad_norm_0: tensor(495.0683, device='cuda:0') (tensor(587.9053, device='cuda:0')) | > loss_gen: 2.531442642211914 (2.496804006245672) | > loss_kl: 0.837652325630188 (0.9189126503710844) | > loss_feat: 2.290923595428467 (5.683660318504791) | > loss_mel: 24.16979217529297 (22.811509852506678) | > loss_duration: 1.7091681957244873 (1.6326157535825456) | > loss_1: 31.538978576660156 (33.54350282707994) | > grad_norm_1: tensor(10377.1357, device='cuda:0') (tensor(18324.7070, device='cuda:0')) | > current_lr_0: 0.00015811184744737806 | > current_lr_1: 0.00015811184744737806 | > step_time: 0.3879 (0.4980885058033224) | > loader_time: 0.348 (0.025789820418065917)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5855674743652344 (2.5855674743652344) | > loss_disc_real_0: 0.13435575366020203 (0.13435575366020203) | > loss_disc_real_1: 0.2609149217605591 (0.2609149217605591) | > loss_disc_real_2: 0.2763577699661255 (0.2763577699661255) | > loss_disc_real_3: 0.3466169834136963 (0.3466169834136963) | > loss_disc_real_4: 0.2934624254703522 (0.2934624254703522) | > loss_disc_real_5: 0.3483481705188751 (0.3483481705188751) | > loss_0: 2.5855674743652344 (2.5855674743652344) | > loss_gen: 2.552462339401245 (2.552462339401245) | > loss_kl: 2.8341968059539795 (2.8341968059539795) | > loss_feat: 5.747410774230957 (5.747410774230957) | > loss_mel: 23.148212432861328 (23.148212432861328) | > loss_duration: 2.2724554538726807 (2.2724554538726807) | > loss_1: 36.55474090576172 (36.55474090576172)  --> STEP: 1 | > loss_disc: 2.6404078006744385 (2.6404078006744385) | > loss_disc_real_0: 0.05656072869896889 (0.05656072869896889) | > loss_disc_real_1: 0.2622617483139038 (0.2622617483139038) | > loss_disc_real_2: 0.3555779755115509 (0.3555779755115509) | > loss_disc_real_3: 0.3312866985797882 (0.3312866985797882) | > loss_disc_real_4: 0.23135367035865784 (0.23135367035865784) | > loss_disc_real_5: 0.268961638212204 (0.268961638212204) | > loss_0: 2.6404078006744385 (2.6404078006744385) | > loss_gen: 2.2420613765716553 (2.2420613765716553) | > loss_kl: 3.5029828548431396 (3.5029828548431396) | > loss_feat: 6.643594264984131 (6.643594264984131) | > loss_mel: 23.403730392456055 (23.403730392456055) | > loss_duration: 2.487680196762085 (2.487680196762085) | > loss_1: 38.28004837036133 (38.28004837036133)  --> STEP: 2 | > loss_disc: 2.94970703125 (2.7950574159622192) | > loss_disc_real_0: 0.19929707050323486 (0.12792889960110188) | > loss_disc_real_1: 0.2827695608139038 (0.2725156545639038) | > loss_disc_real_2: 0.2627473473548889 (0.3091626614332199) | > loss_disc_real_3: 0.2958780527114868 (0.3135823756456375) | > loss_disc_real_4: 0.2732127904891968 (0.2522832304239273) | > loss_disc_real_5: 0.35383257269859314 (0.31139710545539856) | > loss_0: 2.94970703125 (2.7950574159622192) | > loss_gen: 1.752404808998108 (1.9972330927848816) | > loss_kl: 3.266827344894409 (3.3849050998687744) | > loss_feat: 0.5132202506065369 (3.578407257795334) | > loss_mel: 14.588327407836914 (18.996028900146484) | > loss_duration: 2.510697603225708 (2.4991888999938965) | > loss_1: 22.631479263305664 (30.455763816833496)  --> STEP: 3 | > loss_disc: 2.9231996536254883 (2.837771495183309) | > loss_disc_real_0: 0.24675071239471436 (0.16753617053230604) | > loss_disc_real_1: 0.37291890382766724 (0.30598340431849164) | > loss_disc_real_2: 0.434287965297699 (0.35087109605471295) | > loss_disc_real_3: 0.2707120180130005 (0.2992922564347585) | > loss_disc_real_4: 0.3477464020252228 (0.28410428762435913) | > loss_disc_real_5: 0.2569234073162079 (0.29323920607566833) | > loss_0: 2.9231996536254883 (2.837771495183309) | > loss_gen: 2.546477794647217 (2.1803146600723267) | > loss_kl: 1.4009515047073364 (2.723587234814962) | > loss_feat: 4.2378363609313965 (3.798216958840688) | > loss_mel: 25.38875961303711 (21.12693913777669) | > loss_duration: 2.349696159362793 (2.4493579864501953) | > loss_1: 35.92372131347656 (32.278416315714516) --> EVAL PERFORMANCE | > avg_loader_time: 0.02608942985534668 (+0.024427096048990887) | > avg_loss_disc: 2.837771495183309 (+0.5953710873921714) | > avg_loss_disc_real_0: 0.16753617053230604 (+0.08862907811999322) | > avg_loss_disc_real_1: 0.30598340431849164 (+0.07629057765007022) | > avg_loss_disc_real_2: 0.35087109605471295 (+0.1427305340766907) | > avg_loss_disc_real_3: 0.2992922564347585 (+0.03416922688484192) | > avg_loss_disc_real_4: 0.28410428762435913 (-0.026127020517985045) | > avg_loss_disc_real_5: 0.29323920607566833 (+0.033467456698417664) | > avg_loss_0: 2.837771495183309 (+0.5953710873921714) | > avg_loss_gen: 2.1803146600723267 (-0.7600505749384561) | > avg_loss_kl: 2.723587234814962 (+0.09723794460296631) | > avg_loss_feat: 3.798216958840688 (-1.4548329313596091) | > avg_loss_mel: 21.12693913777669 (-0.8609472910563163) | > avg_loss_duration: 2.4493579864501953 (+0.04607979456583644) | > avg_loss_1: 32.278416315714516 (-2.93251164754232)  > EPOCH: 236/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:13:44)   --> TIME: 2023-10-20 02:14:02 -- STEP: 29/50 -- GLOBAL_STEP: 64830 | > loss_disc: 2.366206645965576 (2.461231856510557) | > loss_disc_real_0: 0.10729791224002838 (0.19245064181500468) | > loss_disc_real_1: 0.21473659574985504 (0.23561812487655673) | > loss_disc_real_2: 0.11935917288064957 (0.24675101285864579) | > loss_disc_real_3: 0.13284090161323547 (0.23696415408931928) | > loss_disc_real_4: 0.16110000014305115 (0.23568767710620986) | > loss_disc_real_5: 0.2185664027929306 (0.24959580709451232) | > loss_0: 2.366206645965576 (2.461231856510557) | > grad_norm_0: tensor(685.2609, device='cuda:0') (tensor(582.0180, device='cuda:0')) | > loss_gen: 1.775280475616455 (2.462475641020413) | > loss_kl: 0.9179750084877014 (1.021518119450273) | > loss_feat: 2.5624020099639893 (5.687912646552612) | > loss_mel: 18.886499404907227 (24.476258179237103) | > loss_duration: 1.6156375408172607 (1.6502020770105823) | > loss_1: 25.757793426513672 (35.298366875484064) | > grad_norm_1: tensor(5311.3154, device='cuda:0') (tensor(16378.2197, device='cuda:0')) | > current_lr_0: 0.00015795380475657308 | > current_lr_1: 0.00015795380475657308 | > step_time: 0.3108 (0.45053853659794246) | > loader_time: 0.0018 (0.008806664368201947)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.107954502105713 (2.107954502105713) | > loss_disc_real_0: 0.054200876504182816 (0.054200876504182816) | > loss_disc_real_1: 0.18115165829658508 (0.18115165829658508) | > loss_disc_real_2: 0.24520546197891235 (0.24520546197891235) | > loss_disc_real_3: 0.33530041575431824 (0.33530041575431824) | > loss_disc_real_4: 0.22278816998004913 (0.22278816998004913) | > loss_disc_real_5: 0.11647380888462067 (0.11647380888462067) | > loss_0: 2.107954502105713 (2.107954502105713) | > loss_gen: 2.272806406021118 (2.272806406021118) | > loss_kl: 2.8302080631256104 (2.8302080631256104) | > loss_feat: 4.765311241149902 (4.765311241149902) | > loss_mel: 23.666589736938477 (23.666589736938477) | > loss_duration: 2.21972393989563 (2.21972393989563) | > loss_1: 35.754638671875 (35.754638671875)  --> STEP: 1 | > loss_disc: 2.538292646408081 (2.538292646408081) | > loss_disc_real_0: 0.13473695516586304 (0.13473695516586304) | > loss_disc_real_1: 0.1291782557964325 (0.1291782557964325) | > loss_disc_real_2: 0.02876608446240425 (0.02876608446240425) | > loss_disc_real_3: 0.1319064050912857 (0.1319064050912857) | > loss_disc_real_4: 0.019689083099365234 (0.019689083099365234) | > loss_disc_real_5: 0.043043170124292374 (0.043043170124292374) | > loss_0: 2.538292646408081 (2.538292646408081) | > loss_gen: 1.3457129001617432 (1.3457129001617432) | > loss_kl: 2.869448184967041 (2.869448184967041) | > loss_feat: 7.286767959594727 (7.286767959594727) | > loss_mel: 27.456235885620117 (27.456235885620117) | > loss_duration: 2.4664318561553955 (2.4664318561553955) | > loss_1: 41.42459487915039 (41.42459487915039)  --> STEP: 2 | > loss_disc: 2.955207347869873 (2.746749997138977) | > loss_disc_real_0: 0.373250812292099 (0.253993883728981) | > loss_disc_real_1: 0.29662030935287476 (0.21289928257465363) | > loss_disc_real_2: 0.18968532979488373 (0.10922570712864399) | > loss_disc_real_3: 0.33337080478668213 (0.23263860493898392) | > loss_disc_real_4: 0.29113996028900146 (0.15541452169418335) | > loss_disc_real_5: 0.2091371715068817 (0.12609017081558704) | > loss_0: 2.955207347869873 (2.746749997138977) | > loss_gen: 2.000547170639038 (1.6731300354003906) | > loss_kl: 2.8652358055114746 (2.867341995239258) | > loss_feat: 0.5457414984703064 (3.9162547290325165) | > loss_mel: 22.945518493652344 (25.20087718963623) | > loss_duration: 2.4401094913482666 (2.453270673751831) | > loss_1: 30.797151565551758 (36.110873222351074)  --> STEP: 3 | > loss_disc: 3.1069259643554688 (2.8668086528778076) | > loss_disc_real_0: 0.3118329644203186 (0.2732735772927602) | > loss_disc_real_1: 0.2897339463233948 (0.23851083715756735) | > loss_disc_real_2: 0.3019639551639557 (0.17347178980708122) | > loss_disc_real_3: 0.33228230476379395 (0.2658531715472539) | > loss_disc_real_4: 0.37475523352622986 (0.2285280923048655) | > loss_disc_real_5: 0.32430413365364075 (0.19216149176160494) | > loss_0: 3.1069259643554688 (2.8668086528778076) | > loss_gen: 2.068551778793335 (1.8049372831980388) | > loss_kl: 1.8220524787902832 (2.518912156422933) | > loss_feat: 2.2185189723968506 (3.350342810153961) | > loss_mel: 19.7235107421875 (23.375088373819988) | > loss_duration: 2.343139171600342 (2.416560173034668) | > loss_1: 28.17577362060547 (33.4658400217692) --> EVAL PERFORMANCE | > avg_loader_time: 0.01864798863728841 (-0.007441441218058269) | > avg_loss_disc: 2.8668086528778076 (+0.02903715769449855) | > avg_loss_disc_real_0: 0.2732735772927602 (+0.10573740676045415) | > avg_loss_disc_real_1: 0.23851083715756735 (-0.06747256716092428) | > avg_loss_disc_real_2: 0.17347178980708122 (-0.17739930624763173) | > avg_loss_disc_real_3: 0.2658531715472539 (-0.03343908488750458) | > avg_loss_disc_real_4: 0.2285280923048655 (-0.05557619531949362) | > avg_loss_disc_real_5: 0.19216149176160494 (-0.1010777143140634) | > avg_loss_0: 2.8668086528778076 (+0.02903715769449855) | > avg_loss_gen: 1.8049372831980388 (-0.37537737687428785) | > avg_loss_kl: 2.518912156422933 (-0.2046750783920288) | > avg_loss_feat: 3.350342810153961 (-0.44787414868672704) | > avg_loss_mel: 23.375088373819988 (+2.2481492360432966) | > avg_loss_duration: 2.416560173034668 (-0.032797813415527344) | > avg_loss_1: 33.4658400217692 (+1.1874237060546875)  > EPOCH: 237/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:14:22)   --> TIME: 2023-10-20 02:14:31 -- STEP: 9/50 -- GLOBAL_STEP: 64860 | > loss_disc: 2.4034481048583984 (2.472273495462206) | > loss_disc_real_0: 0.14193233847618103 (0.16620583232078287) | > loss_disc_real_1: 0.40302640199661255 (0.24917602663238844) | > loss_disc_real_2: 0.26612162590026855 (0.2259471598598692) | > loss_disc_real_3: 0.33017462491989136 (0.21731273747152752) | > loss_disc_real_4: 0.14104551076889038 (0.21052750241425303) | > loss_disc_real_5: 0.22552749514579773 (0.18355231483777365) | > loss_0: 2.4034481048583984 (2.472273495462206) | > grad_norm_0: tensor(387.3510, device='cuda:0') (tensor(436.0896, device='cuda:0')) | > loss_gen: 2.5071017742156982 (2.3053442769580417) | > loss_kl: 0.7750551104545593 (0.8315190176169077) | > loss_feat: 3.3835396766662598 (5.376455964313613) | > loss_mel: 27.087678909301758 (22.021318912506104) | > loss_duration: 1.5757883787155151 (1.620983772807651) | > loss_1: 35.32916259765625 (32.15562152862549) | > grad_norm_1: tensor(4089.5122, device='cuda:0') (tensor(15272.6787, device='cuda:0')) | > current_lr_0: 0.00015779592003933255 | > current_lr_1: 0.00015779592003933255 | > step_time: 0.5802 (0.5038833088344998) | > loader_time: 0.0254 (0.020165893766615126)  --> TIME: 2023-10-20 02:14:45 -- STEP: 39/50 -- GLOBAL_STEP: 64890 | > loss_disc: 3.0327534675598145 (2.4759700206609874) | > loss_disc_real_0: 0.29890504479408264 (0.14846400761355957) | > loss_disc_real_1: 0.22018882632255554 (0.23403067409228057) | > loss_disc_real_2: 0.24435743689537048 (0.2450345098399199) | > loss_disc_real_3: 0.2335096299648285 (0.2542078603918736) | > loss_disc_real_4: 0.28093260526657104 (0.22257513949313226) | > loss_disc_real_5: 0.22066177427768707 (0.21685261589785418) | > loss_0: 3.0327534675598145 (2.4759700206609874) | > grad_norm_0: tensor(251.8104, device='cuda:0') (tensor(563.3260, device='cuda:0')) | > loss_gen: 1.4450819492340088 (2.3870770533879595) | > loss_kl: 0.6319310665130615 (0.907726125075267) | > loss_feat: 0.04669875651597977 (5.157114994831574) | > loss_mel: 1.7265275716781616 (21.11074435710907) | > loss_duration: 1.6555341482162476 (1.6330970861972907) | > loss_1: 5.505773544311523 (31.195759761027812) | > grad_norm_1: tensor(23268.1836, device='cuda:0') (tensor(23144.2520, device='cuda:0')) | > current_lr_0: 0.00015779592003933255 | > current_lr_1: 0.00015779592003933255 | > step_time: 0.2599 (0.4615162030244485) | > loader_time: 0.0028 (0.016061238753489963)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.623974323272705 (2.623974323272705) | > loss_disc_real_0: 0.04706064984202385 (0.04706064984202385) | > loss_disc_real_1: 0.2506107985973358 (0.2506107985973358) | > loss_disc_real_2: 0.2891175150871277 (0.2891175150871277) | > loss_disc_real_3: 0.24658341705799103 (0.24658341705799103) | > loss_disc_real_4: 0.7190188765525818 (0.7190188765525818) | > loss_disc_real_5: 0.5163133144378662 (0.5163133144378662) | > loss_0: 2.623974323272705 (2.623974323272705) | > loss_gen: 3.8288464546203613 (3.8288464546203613) | > loss_kl: 2.836488723754883 (2.836488723754883) | > loss_feat: 7.263047218322754 (7.263047218322754) | > loss_mel: 24.509050369262695 (24.509050369262695) | > loss_duration: 2.4049885272979736 (2.4049885272979736) | > loss_1: 40.8424186706543 (40.8424186706543)  --> STEP: 1 | > loss_disc: 2.038835287094116 (2.038835287094116) | > loss_disc_real_0: 0.10893033444881439 (0.10893033444881439) | > loss_disc_real_1: 0.25971555709838867 (0.25971555709838867) | > loss_disc_real_2: 0.2189791202545166 (0.2189791202545166) | > loss_disc_real_3: 0.32452961802482605 (0.32452961802482605) | > loss_disc_real_4: 0.1745167076587677 (0.1745167076587677) | > loss_disc_real_5: 0.21397946774959564 (0.21397946774959564) | > loss_0: 2.038835287094116 (2.038835287094116) | > loss_gen: 2.9363503456115723 (2.9363503456115723) | > loss_kl: 3.4192464351654053 (3.4192464351654053) | > loss_feat: 5.5309834480285645 (5.5309834480285645) | > loss_mel: 25.978782653808594 (25.978782653808594) | > loss_duration: 2.487861156463623 (2.487861156463623) | > loss_1: 40.35322570800781 (40.35322570800781)  --> STEP: 2 | > loss_disc: 1.9481232166290283 (1.9934792518615723) | > loss_disc_real_0: 0.013588909059762955 (0.06125962175428867) | > loss_disc_real_1: 0.21983592212200165 (0.23977573961019516) | > loss_disc_real_2: 0.18638938665390015 (0.20268425345420837) | > loss_disc_real_3: 0.16962920129299164 (0.24707940965890884) | > loss_disc_real_4: 0.4527239203453064 (0.31362031400203705) | > loss_disc_real_5: 0.4642448425292969 (0.33911215513944626) | > loss_0: 1.9481232166290283 (1.9934792518615723) | > loss_gen: 4.535102844238281 (3.7357265949249268) | > loss_kl: 3.3543546199798584 (3.386800527572632) | > loss_feat: 10.705903053283691 (8.118443250656128) | > loss_mel: 27.292409896850586 (26.63559627532959) | > loss_duration: 2.4725489616394043 (2.4802050590515137) | > loss_1: 48.360321044921875 (44.356773376464844)  --> STEP: 3 | > loss_disc: 2.7300753593444824 (2.239011287689209) | > loss_disc_real_0: 0.3201952278614044 (0.1475714904566606) | > loss_disc_real_1: 0.419476181268692 (0.2996758868296941) | > loss_disc_real_2: 0.5040509104728699 (0.3031398057937622) | > loss_disc_real_3: 0.3500559628009796 (0.28140492737293243) | > loss_disc_real_4: 0.35336801409721375 (0.32686954736709595) | > loss_disc_real_5: 0.33745142817497253 (0.3385585794846217) | > loss_0: 2.7300753593444824 (2.239011287689209) | > loss_gen: 3.650238037109375 (3.7072304089864097) | > loss_kl: 1.4397767782211304 (2.7377926111221313) | > loss_feat: 4.962410926818848 (7.066432476043701) | > loss_mel: 29.676265716552734 (27.649152755737305) | > loss_duration: 2.3615756034851074 (2.440661907196045) | > loss_1: 42.090267181396484 (43.601271311442055) --> EVAL PERFORMANCE | > avg_loader_time: 0.013607263565063477 (-0.005040725072224934) | > avg_loss_disc: 2.239011287689209 (-0.6277973651885986) | > avg_loss_disc_real_0: 0.1475714904566606 (-0.1257020868360996) | > avg_loss_disc_real_1: 0.2996758868296941 (+0.06116504967212674) | > avg_loss_disc_real_2: 0.3031398057937622 (+0.12966801598668098) | > avg_loss_disc_real_3: 0.28140492737293243 (+0.015551755825678526) | > avg_loss_disc_real_4: 0.32686954736709595 (+0.09834145506223044) | > avg_loss_disc_real_5: 0.3385585794846217 (+0.14639708772301677) | > avg_loss_0: 2.239011287689209 (-0.6277973651885986) | > avg_loss_gen: 3.7072304089864097 (+1.9022931257883708) | > avg_loss_kl: 2.7377926111221313 (+0.21888045469919826) | > avg_loss_feat: 7.066432476043701 (+3.71608966588974) | > avg_loss_mel: 27.649152755737305 (+4.2740643819173165) | > avg_loss_duration: 2.440661907196045 (+0.024101734161376953) | > avg_loss_1: 43.601271311442055 (+10.135431289672852)  > EPOCH: 238/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:15:02)   --> TIME: 2023-10-20 02:15:17 -- STEP: 19/50 -- GLOBAL_STEP: 64920 | > loss_disc: 1.9836509227752686 (2.2660425681816903) | > loss_disc_real_0: 0.017404651269316673 (0.14276749660309992) | > loss_disc_real_1: 0.37622183561325073 (0.23701311843959907) | > loss_disc_real_2: 0.2545909583568573 (0.22493313841129603) | > loss_disc_real_3: 0.2735830843448639 (0.24787116011506632) | > loss_disc_real_4: 0.12632063031196594 (0.19393217426381612) | > loss_disc_real_5: 0.06274580210447311 (0.1903494433254788) | > loss_0: 1.9836509227752686 (2.2660425681816903) | > grad_norm_0: tensor(385.3428, device='cuda:0') (tensor(609.0347, device='cuda:0')) | > loss_gen: 2.7642757892608643 (2.8761467870913053) | > loss_kl: 0.8988744020462036 (0.9510436740360761) | > loss_feat: 6.988736152648926 (6.8642190765393405) | > loss_mel: 21.713855743408203 (26.04714150177805) | > loss_duration: 1.7633326053619385 (1.653493040486386) | > loss_1: 34.12907409667969 (38.39204374112581) | > grad_norm_1: tensor(13016.1152, device='cuda:0') (tensor(27534.9121, device='cuda:0')) | > current_lr_0: 0.00015763819313775195 | > current_lr_1: 0.00015763819313775195 | > step_time: 0.6464 (0.5376093638570685) | > loader_time: 0.0125 (0.01935409244738127)  --> TIME: 2023-10-20 02:15:34 -- STEP: 49/50 -- GLOBAL_STEP: 64950 | > loss_disc: 2.4769022464752197 (2.282751593054557) | > loss_disc_real_0: 0.15391415357589722 (0.14009456166389336) | > loss_disc_real_1: 0.22053521871566772 (0.22955106791793084) | > loss_disc_real_2: 0.21578462421894073 (0.21903543531590577) | > loss_disc_real_3: 0.38194406032562256 (0.23805829025424866) | > loss_disc_real_4: 0.2632247805595398 (0.20650486826744616) | > loss_disc_real_5: 0.21824140846729279 (0.19635582879679847) | > loss_0: 2.4769022464752197 (2.282751593054557) | > grad_norm_0: tensor(1056.0885, device='cuda:0') (tensor(649.3553, device='cuda:0')) | > loss_gen: 2.6176135540008545 (2.659798884878353) | > loss_kl: 1.1946663856506348 (0.8966325646152302) | > loss_feat: 4.027369022369385 (6.083208404329358) | > loss_mel: 34.233612060546875 (24.290549132288724) | > loss_duration: 1.7609974145889282 (1.6272391835037543) | > loss_1: 43.834259033203125 (35.55742788314819) | > grad_norm_1: tensor(14149.5918, device='cuda:0') (tensor(25885.4922, device='cuda:0')) | > current_lr_0: 0.00015763819313775195 | > current_lr_1: 0.00015763819313775195 | > step_time: 0.6644 (0.5387370489081558) | > loader_time: 0.3481 (0.024379044162983796)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1912362575531006 (2.1912362575531006) | > loss_disc_real_0: 0.1538984477519989 (0.1538984477519989) | > loss_disc_real_1: 0.24179746210575104 (0.24179746210575104) | > loss_disc_real_2: 0.18959099054336548 (0.18959099054336548) | > loss_disc_real_3: 0.3727071285247803 (0.3727071285247803) | > loss_disc_real_4: 0.1130669042468071 (0.1130669042468071) | > loss_disc_real_5: 0.07664957642555237 (0.07664957642555237) | > loss_0: 2.1912362575531006 (2.1912362575531006) | > loss_gen: 2.4113929271698 (2.4113929271698) | > loss_kl: 2.6084234714508057 (2.6084234714508057) | > loss_feat: 6.163629531860352 (6.163629531860352) | > loss_mel: 24.126981735229492 (24.126981735229492) | > loss_duration: 2.322067975997925 (2.322067975997925) | > loss_1: 37.63249206542969 (37.63249206542969)  --> STEP: 1 | > loss_disc: 2.222285747528076 (2.222285747528076) | > loss_disc_real_0: 0.16549573838710785 (0.16549573838710785) | > loss_disc_real_1: 0.27753299474716187 (0.27753299474716187) | > loss_disc_real_2: 0.1599327176809311 (0.1599327176809311) | > loss_disc_real_3: 0.25795382261276245 (0.25795382261276245) | > loss_disc_real_4: 0.060194145888090134 (0.060194145888090134) | > loss_disc_real_5: 0.032816532999277115 (0.032816532999277115) | > loss_0: 2.222285747528076 (2.222285747528076) | > loss_gen: 2.069016695022583 (2.069016695022583) | > loss_kl: 2.558875799179077 (2.558875799179077) | > loss_feat: 6.587941646575928 (6.587941646575928) | > loss_mel: 23.695220947265625 (23.695220947265625) | > loss_duration: 2.5415732860565186 (2.5415732860565186) | > loss_1: 37.4526252746582 (37.4526252746582)  --> STEP: 2 | > loss_disc: 3.0158591270446777 (2.619072437286377) | > loss_disc_real_0: 0.215462788939476 (0.19047926366329193) | > loss_disc_real_1: 0.3281923532485962 (0.30286267399787903) | > loss_disc_real_2: 0.30413511395454407 (0.23203391581773758) | > loss_disc_real_3: 0.3178481459617615 (0.28790098428726196) | > loss_disc_real_4: 0.2512926757335663 (0.1557434108108282) | > loss_disc_real_5: 0.2263801097869873 (0.1295983213931322) | > loss_0: 3.0158591270446777 (2.619072437286377) | > loss_gen: 1.65541410446167 (1.8622153997421265) | > loss_kl: 3.7870426177978516 (3.1729592084884644) | > loss_feat: 0.03227360174059868 (3.310107624158263) | > loss_mel: 2.0602259635925293 (12.877723455429077) | > loss_duration: 2.40993332862854 (2.4757533073425293) | > loss_1: 9.944890022277832 (23.698757648468018)  --> STEP: 3 | > loss_disc: 2.788753032684326 (2.67563263575236) | > loss_disc_real_0: 0.3278461992740631 (0.23626824220021567) | > loss_disc_real_1: 0.38439202308654785 (0.330039123694102) | > loss_disc_real_2: 0.31362175941467285 (0.2592298636833827) | > loss_disc_real_3: 0.3717307448387146 (0.31584423780441284) | > loss_disc_real_4: 0.20427167415618896 (0.17191949859261513) | > loss_disc_real_5: 0.20759201049804688 (0.1555962177614371) | > loss_0: 2.788753032684326 (2.67563263575236) | > loss_gen: 2.451801300048828 (2.058744033177694) | > loss_kl: 1.4290038347244263 (2.591640750567118) | > loss_feat: 3.8459866046905518 (3.4887339510023594) | > loss_mel: 27.037704467773438 (17.59771712621053) | > loss_duration: 2.3095996379852295 (2.420368750890096) | > loss_1: 37.0740966796875 (28.157203992207844) --> EVAL PERFORMANCE | > avg_loader_time: 0.002402226130167643 (-0.011205037434895834) | > avg_loss_disc: 2.67563263575236 (+0.4366213480631509) | > avg_loss_disc_real_0: 0.23626824220021567 (+0.08869675174355507) | > avg_loss_disc_real_1: 0.330039123694102 (+0.030363236864407894) | > avg_loss_disc_real_2: 0.2592298636833827 (-0.04390994211037952) | > avg_loss_disc_real_3: 0.31584423780441284 (+0.03443931043148041) | > avg_loss_disc_real_4: 0.17191949859261513 (-0.15495004877448082) | > avg_loss_disc_real_5: 0.1555962177614371 (-0.1829623617231846) | > avg_loss_0: 2.67563263575236 (+0.4366213480631509) | > avg_loss_gen: 2.058744033177694 (-1.6484863758087158) | > avg_loss_kl: 2.591640750567118 (-0.14615186055501317) | > avg_loss_feat: 3.4887339510023594 (-3.577698525041342) | > avg_loss_mel: 17.59771712621053 (-10.051435629526775) | > avg_loss_duration: 2.420368750890096 (-0.020293156305948745) | > avg_loss_1: 28.157203992207844 (-15.444067319234211)  > EPOCH: 239/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:15:43)   --> TIME: 2023-10-20 02:16:01 -- STEP: 29/50 -- GLOBAL_STEP: 64980 | > loss_disc: 2.8758599758148193 (2.3412030565327613) | > loss_disc_real_0: 0.1781618446111679 (0.1579788484578503) | > loss_disc_real_1: 0.2801143229007721 (0.21739289826103325) | > loss_disc_real_2: 0.24291589856147766 (0.21037250757217407) | > loss_disc_real_3: 0.2749912440776825 (0.23025577232755465) | > loss_disc_real_4: 0.21088488399982452 (0.19920246534306427) | > loss_disc_real_5: 0.1788133680820465 (0.1870492769983308) | > loss_0: 2.8758599758148193 (2.3412030565327613) | > grad_norm_0: tensor(314.9470, device='cuda:0') (tensor(561.1039, device='cuda:0')) | > loss_gen: 1.564154863357544 (2.448580211606519) | > loss_kl: 0.8579438328742981 (1.0289275933956274) | > loss_feat: 1.010127067565918 (5.4019125707704445) | > loss_mel: 19.717947006225586 (22.179091017821737) | > loss_duration: 1.5505919456481934 (1.649061766164056) | > loss_1: 24.70076560974121 (32.70757282191309) | > grad_norm_1: tensor(9995.6807, device='cuda:0') (tensor(20153.3477, device='cuda:0')) | > current_lr_0: 0.00015748062389408466 | > current_lr_1: 0.00015748062389408466 | > step_time: 0.25 (0.4341733620084565) | > loader_time: 0.0019 (0.008922486469663423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.945723056793213 (2.945723056793213) | > loss_disc_real_0: 0.2894081473350525 (0.2894081473350525) | > loss_disc_real_1: 0.27735966444015503 (0.27735966444015503) | > loss_disc_real_2: 0.28748828172683716 (0.28748828172683716) | > loss_disc_real_3: 0.26847612857818604 (0.26847612857818604) | > loss_disc_real_4: 0.26179561018943787 (0.26179561018943787) | > loss_disc_real_5: 0.2557445466518402 (0.2557445466518402) | > loss_0: 2.945723056793213 (2.945723056793213) | > loss_gen: 1.7361781597137451 (1.7361781597137451) | > loss_kl: 2.069301128387451 (2.069301128387451) | > loss_feat: 0.38510605692863464 (0.38510605692863464) | > loss_mel: 16.119522094726562 (16.119522094726562) | > loss_duration: 2.233001947402954 (2.233001947402954) | > loss_1: 22.543107986450195 (22.543107986450195)  --> STEP: 1 | > loss_disc: 2.095226526260376 (2.095226526260376) | > loss_disc_real_0: 0.3844940662384033 (0.3844940662384033) | > loss_disc_real_1: 0.1503143310546875 (0.1503143310546875) | > loss_disc_real_2: 0.11532806605100632 (0.11532806605100632) | > loss_disc_real_3: 0.1774265468120575 (0.1774265468120575) | > loss_disc_real_4: 0.23755203187465668 (0.23755203187465668) | > loss_disc_real_5: 0.07375992834568024 (0.07375992834568024) | > loss_0: 2.095226526260376 (2.095226526260376) | > loss_gen: 2.853731632232666 (2.853731632232666) | > loss_kl: 2.939465284347534 (2.939465284347534) | > loss_feat: 9.142952919006348 (9.142952919006348) | > loss_mel: 26.88380241394043 (26.88380241394043) | > loss_duration: 2.4167027473449707 (2.4167027473449707) | > loss_1: 44.236656188964844 (44.236656188964844)  --> STEP: 2 | > loss_disc: 2.3847899436950684 (2.240008234977722) | > loss_disc_real_0: 0.49814650416374207 (0.4413202852010727) | > loss_disc_real_1: 0.18476168811321259 (0.16753800958395004) | > loss_disc_real_2: 0.17622621357440948 (0.1457771398127079) | > loss_disc_real_3: 0.26220521330833435 (0.21981588006019592) | > loss_disc_real_4: 0.1991071105003357 (0.21832957118749619) | > loss_disc_real_5: 0.14289012551307678 (0.10832502692937851) | > loss_0: 2.3847899436950684 (2.240008234977722) | > loss_gen: 2.7679941654205322 (2.810862898826599) | > loss_kl: 2.921868085861206 (2.93066668510437) | > loss_feat: 8.454885482788086 (8.798919200897217) | > loss_mel: 26.653467178344727 (26.768634796142578) | > loss_duration: 2.38201642036438 (2.3993595838546753) | > loss_1: 43.18022918701172 (43.70844268798828)  --> STEP: 3 | > loss_disc: 2.455307722091675 (2.311774730682373) | > loss_disc_real_0: 0.2982705235481262 (0.3936370313167572) | > loss_disc_real_1: 0.1122782975435257 (0.14911810557047525) | > loss_disc_real_2: 0.1998395025730133 (0.16379792739947638) | > loss_disc_real_3: 0.2500564754009247 (0.2298960785071055) | > loss_disc_real_4: 0.05099165067076683 (0.1625502643485864) | > loss_disc_real_5: 0.022548450157046318 (0.07973283467193444) | > loss_0: 2.455307722091675 (2.311774730682373) | > loss_gen: 1.9575743675231934 (2.5264333883921304) | > loss_kl: 1.7867817878723145 (2.5493717193603516) | > loss_feat: 6.109976768493652 (7.902605056762695) | > loss_mel: 21.579647064208984 (25.03897221883138) | > loss_duration: 2.29954195022583 (2.366087039311727) | > loss_1: 33.733524322509766 (40.383469899495445) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_65000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9663598537445068 (2.2254210114479065) | > loss_disc_real_0: 0.03114284947514534 (0.30301348585635424) | > loss_disc_real_1: 0.024929413571953773 (0.11807093257084489) | > loss_disc_real_2: 0.060266926884651184 (0.13791517727077007) | > loss_disc_real_3: 0.09700386971235275 (0.19667302630841732) | > loss_disc_real_4: 0.03392697125673294 (0.13039444107562304) | > loss_disc_real_5: 0.03270558640360832 (0.06797602260485291) | > loss_0: 1.9663598537445068 (2.2254210114479065) | > loss_gen: 1.7467031478881836 (2.331500828266144) | > loss_kl: 2.516482353210449 (2.541149377822876) | > loss_feat: 10.462002754211426 (8.542454481124878) | > loss_mel: 27.692703247070312 (25.702404975891113) | > loss_duration: 2.278820514678955 (2.344270408153534) | > loss_1: 44.696712493896484 (41.4617805480957)  --> STEP: 1 | > loss_disc: 2.7091755867004395 (2.322171926498413) | > loss_disc_real_0: 0.2332916110754013 (0.28906911090016363) | > loss_disc_real_1: 0.3770039975643158 (0.16985754556953908) | > loss_disc_real_2: 0.3173902928829193 (0.17381020039319992) | > loss_disc_real_3: 0.3308893144130707 (0.223516283929348) | > loss_disc_real_4: 0.38875702023506165 (0.18206695690751076) | > loss_disc_real_5: 0.28581979870796204 (0.11154477782547474) | > loss_0: 2.7091755867004395 (2.322171926498413) | > loss_gen: 2.7994236946105957 (2.4250854015350343) | > loss_kl: 2.8636202812194824 (2.605643558502197) | > loss_feat: 6.9777936935424805 (8.229522323608398) | > loss_mel: 25.72121238708496 (25.706166458129882) | > loss_duration: 2.4628050327301025 (2.367977333068848) | > loss_1: 40.82485580444336 (41.33439559936524)  --> STEP: 2 | > loss_disc: 2.3057377338409424 (2.3194328943888345) | > loss_disc_real_0: 0.21561288833618164 (0.27682640713949996) | > loss_disc_real_1: 0.22258086502552032 (0.1786447654788693) | > loss_disc_real_2: 0.17741480469703674 (0.17441096777717272) | > loss_disc_real_3: 0.2126077264547348 (0.22169819101691246) | > loss_disc_real_4: 0.16165445744991302 (0.1786648736645778) | > loss_disc_real_5: 0.12156315892934799 (0.11321450800945361) | > loss_0: 2.3057377338409424 (2.3194328943888345) | > loss_gen: 2.534965753555298 (2.4433987935384116) | > loss_kl: 3.0057685375213623 (2.6723310550053916) | > loss_feat: 6.252591609954834 (7.900033871332805) | > loss_mel: 24.88027000427246 (25.568517049153645) | > loss_duration: 2.4375715255737305 (2.3795763651529946) | > loss_1: 39.111167907714844 (40.963857650756836)  --> STEP: 3 | > loss_disc: 2.4670767784118652 (2.340524877820696) | > loss_disc_real_0: 0.18113532662391663 (0.26315625278013094) | > loss_disc_real_1: 0.34411391615867615 (0.20228321557598455) | > loss_disc_real_2: 0.4230826199054718 (0.20993548950978688) | > loss_disc_real_3: 0.16233059763908386 (0.21321710624865123) | > loss_disc_real_4: 0.17607447504997253 (0.17829481671963418) | > loss_disc_real_5: 0.13690030574798584 (0.1165981934006725) | > loss_0: 2.4670767784118652 (2.340524877820696) | > loss_gen: 2.6107797622680664 (2.467310360499791) | > loss_kl: 1.3842129707336426 (2.488314185823713) | > loss_feat: 5.674574375152588 (7.582111086164202) | > loss_mel: 22.98670768737793 (25.199687140328543) | > loss_duration: 2.3277060985565186 (2.372166327067784) | > loss_1: 34.983978271484375 (40.10958916800363) --> EVAL PERFORMANCE | > avg_loader_time: 0.3187119620186942 (+0.3163097358885265) | > avg_loss_disc: 2.340524877820696 (-0.3351077579316639) | > avg_loss_disc_real_0: 0.26315625278013094 (+0.026888010579915272) | > avg_loss_disc_real_1: 0.20228321557598455 (-0.12775590811811743) | > avg_loss_disc_real_2: 0.20993548950978688 (-0.049294374173595806) | > avg_loss_disc_real_3: 0.21321710624865123 (-0.10262713155576161) | > avg_loss_disc_real_4: 0.17829481671963418 (+0.006375318127019053) | > avg_loss_disc_real_5: 0.1165981934006725 (-0.03899802436076459) | > avg_loss_0: 2.340524877820696 (-0.3351077579316639) | > avg_loss_gen: 2.467310360499791 (+0.40856632732209697) | > avg_loss_kl: 2.488314185823713 (-0.10332656474340496) | > avg_loss_feat: 7.582111086164202 (+4.093377135161843) | > avg_loss_mel: 25.199687140328543 (+7.601970014118013) | > avg_loss_duration: 2.372166327067784 (-0.04820242382231221) | > avg_loss_1: 40.10958916800363 (+11.952385175795786)  > EPOCH: 240/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:16:27)   --> TIME: 2023-10-20 02:16:36 -- STEP: 9/50 -- GLOBAL_STEP: 65010 | > loss_disc: 2.869821786880493 (2.5311103794309826) | > loss_disc_real_0: 0.2854231297969818 (0.16365176066756248) | > loss_disc_real_1: 0.30478689074516296 (0.25018689119153553) | > loss_disc_real_2: 0.26317569613456726 (0.23416914666692415) | > loss_disc_real_3: 0.32713961601257324 (0.2503242856926388) | > loss_disc_real_4: 0.33203527331352234 (0.2764067484272851) | > loss_disc_real_5: 0.32231831550598145 (0.206930971187022) | > loss_0: 2.869821786880493 (2.5311103794309826) | > grad_norm_0: tensor(577.2178, device='cuda:0') (tensor(577.5154, device='cuda:0')) | > loss_gen: 2.0221195220947266 (2.478328439924452) | > loss_kl: 0.6700518131256104 (0.8565101755989922) | > loss_feat: 0.7731745839118958 (5.732605069875717) | > loss_mel: 16.483430862426758 (21.00585174560547) | > loss_duration: 1.5499504804611206 (1.6163553661770291) | > loss_1: 21.49872589111328 (31.68965032365587) | > grad_norm_1: tensor(7498.4858, device='cuda:0') (tensor(22372.5371, device='cuda:0')) | > current_lr_0: 0.0001573232121507417 | > current_lr_1: 0.0001573232121507417 | > step_time: 0.58 (0.4824833869934082) | > loader_time: 0.011 (0.021115541458129883)  --> TIME: 2023-10-20 02:16:48 -- STEP: 39/50 -- GLOBAL_STEP: 65040 | > loss_disc: 1.252726674079895 (2.37241015678797) | > loss_disc_real_0: 0.030432220548391342 (0.14190055081286493) | > loss_disc_real_1: 0.09806797653436661 (0.23890611433830017) | > loss_disc_real_2: 0.052776679396629333 (0.2186727762604371) | > loss_disc_real_3: 0.054263848811388016 (0.24110721920927367) | > loss_disc_real_4: 0.06725802272558212 (0.24223507596896246) | > loss_disc_real_5: 0.026007456704974174 (0.2108748878997106) | > loss_0: 1.252726674079895 (2.37241015678797) | > grad_norm_0: tensor(394.0527, device='cuda:0') (tensor(553.5555, device='cuda:0')) | > loss_gen: 2.838932991027832 (2.548865434450981) | > loss_kl: 0.42138874530792236 (0.9204954443833767) | > loss_feat: 10.24647045135498 (5.558534734524215) | > loss_mel: 28.664424896240234 (21.739784121513367) | > loss_duration: 1.6986013650894165 (1.615015922448574) | > loss_1: 43.869815826416016 (32.38269480680809) | > grad_norm_1: tensor(49962.1484, device='cuda:0') (tensor(24736.1035, device='cuda:0')) | > current_lr_0: 0.0001573232121507417 | > current_lr_1: 0.0001573232121507417 | > step_time: 0.7114 (0.405814250310262) | > loader_time: 0.0244 (0.01273485941764636)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.525036573410034 (2.525036573410034) | > loss_disc_real_0: 0.1898801624774933 (0.1898801624774933) | > loss_disc_real_1: 0.24278096854686737 (0.24278096854686737) | > loss_disc_real_2: 0.40330901741981506 (0.40330901741981506) | > loss_disc_real_3: 0.5583592057228088 (0.5583592057228088) | > loss_disc_real_4: 0.4706838130950928 (0.4706838130950928) | > loss_disc_real_5: 0.1674932986497879 (0.1674932986497879) | > loss_0: 2.525036573410034 (2.525036573410034) | > loss_gen: 3.984576940536499 (3.984576940536499) | > loss_kl: 3.114152669906616 (3.114152669906616) | > loss_feat: 7.6840105056762695 (7.6840105056762695) | > loss_mel: 24.584291458129883 (24.584291458129883) | > loss_duration: 2.3529157638549805 (2.3529157638549805) | > loss_1: 41.719947814941406 (41.719947814941406)  --> STEP: 1 | > loss_disc: 3.054889678955078 (3.054889678955078) | > loss_disc_real_0: 0.3779776096343994 (0.3779776096343994) | > loss_disc_real_1: 0.28594061732292175 (0.28594061732292175) | > loss_disc_real_2: 0.27856138348579407 (0.27856138348579407) | > loss_disc_real_3: 0.34006184339523315 (0.34006184339523315) | > loss_disc_real_4: 0.3478565216064453 (0.3478565216064453) | > loss_disc_real_5: 0.25215619802474976 (0.25215619802474976) | > loss_0: 3.054889678955078 (3.054889678955078) | > loss_gen: 2.0565714836120605 (2.0565714836120605) | > loss_kl: 3.1344964504241943 (3.1344964504241943) | > loss_feat: 0.7936939001083374 (0.7936939001083374) | > loss_mel: 20.345911026000977 (20.345911026000977) | > loss_duration: 2.5310676097869873 (2.5310676097869873) | > loss_1: 28.861740112304688 (28.861740112304688)  --> STEP: 2 | > loss_disc: 3.156430721282959 (3.1056602001190186) | > loss_disc_real_0: 0.5785142183303833 (0.47824591398239136) | > loss_disc_real_1: 0.30237019062042236 (0.29415540397167206) | > loss_disc_real_2: 0.3352983593940735 (0.3069298714399338) | > loss_disc_real_3: 0.3228253424167633 (0.33144359290599823) | > loss_disc_real_4: 0.3093400001525879 (0.3285982608795166) | > loss_disc_real_5: 0.2337254136800766 (0.24294080585241318) | > loss_0: 3.156430721282959 (3.1056602001190186) | > loss_gen: 2.1052467823028564 (2.0809091329574585) | > loss_kl: 3.0324928760528564 (3.0834946632385254) | > loss_feat: 0.04334600642323494 (0.41851995326578617) | > loss_mel: 3.6070783138275146 (11.976494669914246) | > loss_duration: 2.4993133544921875 (2.5151904821395874) | > loss_1: 11.287477493286133 (20.07460880279541)  --> STEP: 3 | > loss_disc: 2.276829242706299 (2.829383214314779) | > loss_disc_real_0: 0.2797764837741852 (0.41208943724632263) | > loss_disc_real_1: 0.19777323305606842 (0.2620280136664708) | > loss_disc_real_2: 0.20144276320934296 (0.2717675020297368) | > loss_disc_real_3: 0.2301153689622879 (0.2976675182580948) | > loss_disc_real_4: 0.1563938409090042 (0.27119678755601245) | > loss_disc_real_5: 0.07528980076313019 (0.18705713748931885) | > loss_0: 2.276829242706299 (2.829383214314779) | > loss_gen: 2.2292702198028564 (2.1303628285725913) | > loss_kl: 1.4485710859298706 (2.5385201374689736) | > loss_feat: 5.923020362854004 (2.2533534231285253) | > loss_mel: 14.124691009521484 (12.692560116449991) | > loss_duration: 2.3086254596710205 (2.446335474650065) | > loss_1: 26.0341796875 (22.061132431030273) --> EVAL PERFORMANCE | > avg_loader_time: 0.006199200948079427 (-0.31251276107061476) | > avg_loss_disc: 2.829383214314779 (+0.48885833649408283) | > avg_loss_disc_real_0: 0.41208943724632263 (+0.1489331844661917) | > avg_loss_disc_real_1: 0.2620280136664708 (+0.05974479809048627) | > avg_loss_disc_real_2: 0.2717675020297368 (+0.061832012519949936) | > avg_loss_disc_real_3: 0.2976675182580948 (+0.08445041200944356) | > avg_loss_disc_real_4: 0.27119678755601245 (+0.09290197083637827) | > avg_loss_disc_real_5: 0.18705713748931885 (+0.07045894408864635) | > avg_loss_0: 2.829383214314779 (+0.48885833649408283) | > avg_loss_gen: 2.1303628285725913 (-0.3369475319271995) | > avg_loss_kl: 2.5385201374689736 (+0.05020595164526043) | > avg_loss_feat: 2.2533534231285253 (-5.328757663035677) | > avg_loss_mel: 12.692560116449991 (-12.507127023878551) | > avg_loss_duration: 2.446335474650065 (+0.07416914758228099) | > avg_loss_1: 22.061132431030273 (-18.048456736973357)  > EPOCH: 241/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:17:05)   --> TIME: 2023-10-20 02:17:19 -- STEP: 19/50 -- GLOBAL_STEP: 65070 | > loss_disc: 2.497598648071289 (2.392299959534093) | > loss_disc_real_0: 0.15800949931144714 (0.13478044185199237) | > loss_disc_real_1: 0.260515421628952 (0.227730759076382) | > loss_disc_real_2: 0.19898827373981476 (0.2473608000498069) | > loss_disc_real_3: 0.21910351514816284 (0.27147214036238826) | > loss_disc_real_4: 0.15919655561447144 (0.22786679569827883) | > loss_disc_real_5: 0.10468219220638275 (0.2107281054517156) | > loss_0: 2.497598648071289 (2.392299959534093) | > grad_norm_0: tensor(704.4749, device='cuda:0') (tensor(661.7883, device='cuda:0')) | > loss_gen: 1.8771846294403076 (2.6149289796226904) | > loss_kl: 1.207987904548645 (0.9144343743590932) | > loss_feat: 3.3297061920166016 (5.508588986765397) | > loss_mel: 12.45852279663086 (21.403829624778346) | > loss_duration: 1.7822024822235107 (1.666228595532869) | > loss_1: 20.655601501464844 (32.10801024185984) | > grad_norm_1: tensor(18777.1250, device='cuda:0') (tensor(29792.9219, device='cuda:0')) | > current_lr_0: 0.00015716595775029166 | > current_lr_1: 0.00015716595775029166 | > step_time: 0.3228 (0.5186706091228285) | > loader_time: 0.0234 (0.01738168063916658)  --> TIME: 2023-10-20 02:17:35 -- STEP: 49/50 -- GLOBAL_STEP: 65100 | > loss_disc: 2.3306548595428467 (2.3233428293344924) | > loss_disc_real_0: 0.2904982268810272 (0.14056835815842655) | > loss_disc_real_1: 0.3184448778629303 (0.22481278261663962) | > loss_disc_real_2: 0.25091004371643066 (0.2207943531019347) | > loss_disc_real_3: 0.3598635196685791 (0.24263984922851842) | > loss_disc_real_4: 0.28375938534736633 (0.20051221739576788) | > loss_disc_real_5: 0.35134464502334595 (0.2049663684958098) | > loss_0: 2.3306548595428467 (2.3233428293344924) | > grad_norm_0: tensor(799.9783, device='cuda:0') (tensor(676.4529, device='cuda:0')) | > loss_gen: 4.465526580810547 (2.58263061484512) | > loss_kl: 0.9169439077377319 (0.9299114356387634) | > loss_feat: 8.317845344543457 (5.954801483345883) | > loss_mel: 26.295848846435547 (22.42866818758906) | > loss_duration: 1.7300031185150146 (1.6320543240527718) | > loss_1: 41.72616958618164 (33.52806604151824) | > grad_norm_1: tensor(50509.2109, device='cuda:0') (tensor(25544.6406, device='cuda:0')) | > current_lr_0: 0.00015716595775029166 | > current_lr_1: 0.00015716595775029166 | > step_time: 0.5267 (0.5061688325843031) | > loader_time: 0.3341 (0.02500093226530114)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9248113632202148 (1.9248113632202148) | > loss_disc_real_0: 0.0865371897816658 (0.0865371897816658) | > loss_disc_real_1: 0.2125975340604782 (0.2125975340604782) | > loss_disc_real_2: 0.2316213995218277 (0.2316213995218277) | > loss_disc_real_3: 0.4923118054866791 (0.4923118054866791) | > loss_disc_real_4: 0.18090203404426575 (0.18090203404426575) | > loss_disc_real_5: 0.1522323489189148 (0.1522323489189148) | > loss_0: 1.9248113632202148 (1.9248113632202148) | > loss_gen: 3.355356216430664 (3.355356216430664) | > loss_kl: 2.607539653778076 (2.607539653778076) | > loss_feat: 6.648486614227295 (6.648486614227295) | > loss_mel: 23.282934188842773 (23.282934188842773) | > loss_duration: 2.4137632846832275 (2.4137632846832275) | > loss_1: 38.308082580566406 (38.308082580566406)  --> STEP: 1 | > loss_disc: 2.2129597663879395 (2.2129597663879395) | > loss_disc_real_0: 0.14011164009571075 (0.14011164009571075) | > loss_disc_real_1: 0.3061074912548065 (0.3061074912548065) | > loss_disc_real_2: 0.2002732753753662 (0.2002732753753662) | > loss_disc_real_3: 0.4942891001701355 (0.4942891001701355) | > loss_disc_real_4: 0.17969396710395813 (0.17969396710395813) | > loss_disc_real_5: 0.10318650305271149 (0.10318650305271149) | > loss_0: 2.2129597663879395 (2.2129597663879395) | > loss_gen: 2.7804346084594727 (2.7804346084594727) | > loss_kl: 3.3499984741210938 (3.3499984741210938) | > loss_feat: 5.962207317352295 (5.962207317352295) | > loss_mel: 24.92966079711914 (24.92966079711914) | > loss_duration: 2.5190634727478027 (2.5190634727478027) | > loss_1: 39.54136276245117 (39.54136276245117)  --> STEP: 2 | > loss_disc: 2.452707290649414 (2.3328335285186768) | > loss_disc_real_0: 0.1892595887184143 (0.16468561440706253) | > loss_disc_real_1: 0.2741009593009949 (0.2901042252779007) | > loss_disc_real_2: 0.2408868819475174 (0.2205800786614418) | > loss_disc_real_3: 0.42583394050598145 (0.46006152033805847) | > loss_disc_real_4: 0.21964094042778015 (0.19966745376586914) | > loss_disc_real_5: 0.4722457826137543 (0.2877161428332329) | > loss_0: 2.452707290649414 (2.3328335285186768) | > loss_gen: 3.31107759475708 (3.0457561016082764) | > loss_kl: 3.037116765975952 (3.193557620048523) | > loss_feat: 7.010186672210693 (6.486196994781494) | > loss_mel: 26.952241897583008 (25.940951347351074) | > loss_duration: 2.494828462600708 (2.5069459676742554) | > loss_1: 42.805450439453125 (41.17340660095215)  --> STEP: 3 | > loss_disc: 3.4472179412841797 (2.704294999440511) | > loss_disc_real_0: 0.5224046111106873 (0.28392527997493744) | > loss_disc_real_1: 0.35518878698349 (0.3117990791797638) | > loss_disc_real_2: 0.537531316280365 (0.3262304912010829) | > loss_disc_real_3: 0.4027939736843109 (0.44097233812014264) | > loss_disc_real_4: 0.48853811621665955 (0.29595767458279926) | > loss_disc_real_5: 0.6431001424789429 (0.40617747604846954) | > loss_0: 3.4472179412841797 (2.704294999440511) | > loss_gen: 3.5326757431030273 (3.2080626487731934) | > loss_kl: 1.2047020196914673 (2.530605753262838) | > loss_feat: 3.7238807678222656 (5.565424919128418) | > loss_mel: 25.476980209350586 (25.78629430135091) | > loss_duration: 2.3486509323120117 (2.454180955886841) | > loss_1: 36.28689193725586 (39.544568379720054) --> EVAL PERFORMANCE | > avg_loader_time: 0.012955983479817709 (+0.006756782531738282) | > avg_loss_disc: 2.704294999440511 (-0.12508821487426758) | > avg_loss_disc_real_0: 0.28392527997493744 (-0.1281641572713852) | > avg_loss_disc_real_1: 0.3117990791797638 (+0.04977106551329297) | > avg_loss_disc_real_2: 0.3262304912010829 (+0.054462989171346066) | > avg_loss_disc_real_3: 0.44097233812014264 (+0.14330481986204785) | > avg_loss_disc_real_4: 0.29595767458279926 (+0.024760887026786804) | > avg_loss_disc_real_5: 0.40617747604846954 (+0.2191203385591507) | > avg_loss_0: 2.704294999440511 (-0.12508821487426758) | > avg_loss_gen: 3.2080626487731934 (+1.077699820200602) | > avg_loss_kl: 2.530605753262838 (-0.007914384206135772) | > avg_loss_feat: 5.565424919128418 (+3.3120714959998927) | > avg_loss_mel: 25.78629430135091 (+13.093734184900919) | > avg_loss_duration: 2.454180955886841 (+0.007845481236775864) | > avg_loss_1: 39.544568379720054 (+17.48343594868978)  > EPOCH: 242/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:17:46)   --> TIME: 2023-10-20 02:18:05 -- STEP: 29/50 -- GLOBAL_STEP: 65130 | > loss_disc: 2.890048027038574 (2.44120717870778) | > loss_disc_real_0: 0.27183839678764343 (0.13580684569375268) | > loss_disc_real_1: 0.3204149603843689 (0.22088337175804992) | > loss_disc_real_2: 0.548467755317688 (0.22323222962561354) | > loss_disc_real_3: 0.323085218667984 (0.24866419638796097) | > loss_disc_real_4: 0.24808888137340546 (0.24540220567121587) | > loss_disc_real_5: 0.38899827003479004 (0.23150676556316943) | > loss_0: 2.890048027038574 (2.44120717870778) | > grad_norm_0: tensor(407.6714, device='cuda:0') (tensor(494.7816, device='cuda:0')) | > loss_gen: 2.9120256900787354 (2.4273928239427764) | > loss_kl: 0.6413644552230835 (0.9651827976621429) | > loss_feat: 4.684216499328613 (5.577830776893375) | > loss_mel: 22.895803451538086 (22.28783077207105) | > loss_duration: 1.6559152603149414 (1.6551895922627942) | > loss_1: 32.78932571411133 (32.91342722136398) | > grad_norm_1: tensor(2239.0884, device='cuda:0') (tensor(19531.6699, device='cuda:0')) | > current_lr_0: 0.00015700886053546047 | > current_lr_1: 0.00015700886053546047 | > step_time: 0.6175 (0.5099262944583235) | > loader_time: 0.0249 (0.015744151740238584)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1531991958618164 (3.1531991958618164) | > loss_disc_real_0: 0.49227672815322876 (0.49227672815322876) | > loss_disc_real_1: 0.41172152757644653 (0.41172152757644653) | > loss_disc_real_2: 0.35973724722862244 (0.35973724722862244) | > loss_disc_real_3: 0.4137490689754486 (0.4137490689754486) | > loss_disc_real_4: 0.4976733326911926 (0.4976733326911926) | > loss_disc_real_5: 0.5254438519477844 (0.5254438519477844) | > loss_0: 3.1531991958618164 (3.1531991958618164) | > loss_gen: 4.121354103088379 (4.121354103088379) | > loss_kl: 2.7841200828552246 (2.7841200828552246) | > loss_feat: 5.098184108734131 (5.098184108734131) | > loss_mel: 26.358095169067383 (26.358095169067383) | > loss_duration: 2.2466158866882324 (2.2466158866882324) | > loss_1: 40.608367919921875 (40.608367919921875)  --> STEP: 1 | > loss_disc: 2.9190921783447266 (2.9190921783447266) | > loss_disc_real_0: 0.41169458627700806 (0.41169458627700806) | > loss_disc_real_1: 0.36251479387283325 (0.36251479387283325) | > loss_disc_real_2: 0.24626487493515015 (0.24626487493515015) | > loss_disc_real_3: 0.19829894602298737 (0.19829894602298737) | > loss_disc_real_4: 0.47452664375305176 (0.47452664375305176) | > loss_disc_real_5: 0.42096570134162903 (0.42096570134162903) | > loss_0: 2.9190921783447266 (2.9190921783447266) | > loss_gen: 3.144794225692749 (3.144794225692749) | > loss_kl: 2.8696415424346924 (2.8696415424346924) | > loss_feat: 6.150104522705078 (6.150104522705078) | > loss_mel: 24.527511596679688 (24.527511596679688) | > loss_duration: 2.557365894317627 (2.557365894317627) | > loss_1: 39.24941635131836 (39.24941635131836)  --> STEP: 2 | > loss_disc: 2.9559202194213867 (2.9375061988830566) | > loss_disc_real_0: 0.40169861912727356 (0.4066966027021408) | > loss_disc_real_1: 0.3035027086734772 (0.3330087512731552) | > loss_disc_real_2: 0.30587974190711975 (0.27607230842113495) | > loss_disc_real_3: 0.34969839453697205 (0.2739986702799797) | > loss_disc_real_4: 0.2124606966972351 (0.34349367022514343) | > loss_disc_real_5: 0.3602302670478821 (0.39059798419475555) | > loss_0: 2.9559202194213867 (2.9375061988830566) | > loss_gen: 2.6724090576171875 (2.9086016416549683) | > loss_kl: 3.247680425643921 (3.0586609840393066) | > loss_feat: 3.2961549758911133 (4.723129749298096) | > loss_mel: 26.289365768432617 (25.408438682556152) | > loss_duration: 2.4636707305908203 (2.5105183124542236) | > loss_1: 37.96928405761719 (38.60935020446777)  --> STEP: 3 | > loss_disc: 2.9267752170562744 (2.933929204940796) | > loss_disc_real_0: 0.649126410484314 (0.48750653862953186) | > loss_disc_real_1: 0.4200657904148102 (0.36202776432037354) | > loss_disc_real_2: 0.31454551219940186 (0.28889670968055725) | > loss_disc_real_3: 0.32219916582107544 (0.2900655021270116) | > loss_disc_real_4: 0.33088451623916626 (0.3392906188964844) | > loss_disc_real_5: 0.36948129534721375 (0.38355908791224164) | > loss_0: 2.9267752170562744 (2.933929204940796) | > loss_gen: 3.901223659515381 (3.239475647608439) | > loss_kl: 1.1649316549301147 (2.4274178743362427) | > loss_feat: 2.971919059753418 (4.139392852783203) | > loss_mel: 21.299339294433594 (24.0387388865153) | > loss_duration: 2.3952295780181885 (2.4720887343088784) | > loss_1: 31.732643127441406 (36.31711451212565) --> EVAL PERFORMANCE | > avg_loader_time: 0.008495489756266275 (-0.0044604937235514334) | > avg_loss_disc: 2.933929204940796 (+0.22963420550028468) | > avg_loss_disc_real_0: 0.48750653862953186 (+0.20358125865459442) | > avg_loss_disc_real_1: 0.36202776432037354 (+0.05022868514060974) | > avg_loss_disc_real_2: 0.28889670968055725 (-0.03733378152052563) | > avg_loss_disc_real_3: 0.2900655021270116 (-0.15090683599313104) | > avg_loss_disc_real_4: 0.3392906188964844 (+0.04333294431368512) | > avg_loss_disc_real_5: 0.38355908791224164 (-0.022618388136227907) | > avg_loss_0: 2.933929204940796 (+0.22963420550028468) | > avg_loss_gen: 3.239475647608439 (+0.03141299883524562) | > avg_loss_kl: 2.4274178743362427 (-0.1031878789265952) | > avg_loss_feat: 4.139392852783203 (-1.4260320663452148) | > avg_loss_mel: 24.0387388865153 (-1.7475554148356096) | > avg_loss_duration: 2.4720887343088784 (+0.017907778422037612) | > avg_loss_1: 36.31711451212565 (-3.227453867594406)  > EPOCH: 243/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:18:25)   --> TIME: 2023-10-20 02:18:35 -- STEP: 9/50 -- GLOBAL_STEP: 65160 | > loss_disc: 2.339442491531372 (2.461212409867181) | > loss_disc_real_0: 0.09445826709270477 (0.16410479446252188) | > loss_disc_real_1: 0.18315063416957855 (0.24866811061898866) | > loss_disc_real_2: 0.27897724509239197 (0.24330759710735744) | > loss_disc_real_3: 0.30330222845077515 (0.24256170127126905) | > loss_disc_real_4: 0.23790891468524933 (0.22633522666162914) | > loss_disc_real_5: 0.21487411856651306 (0.22536586431993377) | > loss_0: 2.339442491531372 (2.461212409867181) | > grad_norm_0: tensor(245.4772, device='cuda:0') (tensor(528.8281, device='cuda:0')) | > loss_gen: 2.418726921081543 (2.5066952970292835) | > loss_kl: 0.6274421811103821 (0.8296143511931101) | > loss_feat: 5.395174026489258 (7.193454345067342) | > loss_mel: 25.055471420288086 (23.939067840576172) | > loss_duration: 1.54447340965271 (1.624207960234748) | > loss_1: 35.04128646850586 (36.09304004245334) | > grad_norm_1: tensor(4817.6299, device='cuda:0') (tensor(30836.5586, device='cuda:0')) | > current_lr_0: 0.00015685192034913125 | > current_lr_1: 0.00015685192034913125 | > step_time: 0.6096 (0.5358142852783203) | > loader_time: 0.0243 (0.019707732730441622)  --> TIME: 2023-10-20 02:18:47 -- STEP: 39/50 -- GLOBAL_STEP: 65190 | > loss_disc: 2.028968572616577 (2.503363010210869) | > loss_disc_real_0: 0.04913643002510071 (0.1888456918681279) | > loss_disc_real_1: 0.20493829250335693 (0.24603373079727858) | > loss_disc_real_2: 0.341276079416275 (0.24311200586649087) | > loss_disc_real_3: 0.23066824674606323 (0.24449052948218125) | > loss_disc_real_4: 0.2871991991996765 (0.23194376713572404) | > loss_disc_real_5: 0.3111119866371155 (0.22228240427107382) | > loss_0: 2.028968572616577 (2.503363010210869) | > grad_norm_0: tensor(344.6180, device='cuda:0') (tensor(463.2389, device='cuda:0')) | > loss_gen: 3.057102680206299 (2.368859220773745) | > loss_kl: 0.368158757686615 (0.8283187028689262) | > loss_feat: 5.953728675842285 (5.159838743316821) | > loss_mel: 26.764266967773438 (21.370448320339882) | > loss_duration: 1.6662806272506714 (1.6187956424859853) | > loss_1: 37.80953598022461 (31.346260718810253) | > grad_norm_1: tensor(22913.5020, device='cuda:0') (tensor(21362.2480, device='cuda:0')) | > current_lr_0: 0.00015685192034913125 | > current_lr_1: 0.00015685192034913125 | > step_time: 0.9938 (0.42285886788979554) | > loader_time: 0.022 (0.009982139636308719)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8102104663848877 (2.8102104663848877) | > loss_disc_real_0: 0.6682968735694885 (0.6682968735694885) | > loss_disc_real_1: 0.25866252183914185 (0.25866252183914185) | > loss_disc_real_2: 0.28964510560035706 (0.28964510560035706) | > loss_disc_real_3: 0.385483980178833 (0.385483980178833) | > loss_disc_real_4: 0.1593663990497589 (0.1593663990497589) | > loss_disc_real_5: 0.18811194598674774 (0.18811194598674774) | > loss_0: 2.8102104663848877 (2.8102104663848877) | > loss_gen: 3.0410115718841553 (3.0410115718841553) | > loss_kl: 3.436671018600464 (3.436671018600464) | > loss_feat: 7.590691566467285 (7.590691566467285) | > loss_mel: 23.210472106933594 (23.210472106933594) | > loss_duration: 2.334132432937622 (2.334132432937622) | > loss_1: 39.612979888916016 (39.612979888916016)  --> STEP: 1 | > loss_disc: 2.8689558506011963 (2.8689558506011963) | > loss_disc_real_0: 0.6468501091003418 (0.6468501091003418) | > loss_disc_real_1: 0.24007411301136017 (0.24007411301136017) | > loss_disc_real_2: 0.3440206050872803 (0.3440206050872803) | > loss_disc_real_3: 0.37398624420166016 (0.37398624420166016) | > loss_disc_real_4: 0.24995768070220947 (0.24995768070220947) | > loss_disc_real_5: 0.32061153650283813 (0.32061153650283813) | > loss_0: 2.8689558506011963 (2.8689558506011963) | > loss_gen: 3.563054084777832 (3.563054084777832) | > loss_kl: 3.985262155532837 (3.985262155532837) | > loss_feat: 6.184985637664795 (6.184985637664795) | > loss_mel: 23.95326042175293 (23.95326042175293) | > loss_duration: 2.540712833404541 (2.540712833404541) | > loss_1: 40.22727584838867 (40.22727584838867)  --> STEP: 2 | > loss_disc: 2.6989545822143555 (2.783955216407776) | > loss_disc_real_0: 0.5312055349349976 (0.5890278220176697) | > loss_disc_real_1: 0.18665209412574768 (0.21336310356855392) | > loss_disc_real_2: 0.23762276768684387 (0.2908216863870621) | > loss_disc_real_3: 0.2282850742340088 (0.3011356592178345) | > loss_disc_real_4: 0.25053298473358154 (0.2502453327178955) | > loss_disc_real_5: 0.14555594325065613 (0.23308373987674713) | > loss_0: 2.6989545822143555 (2.783955216407776) | > loss_gen: 2.706540107727051 (3.1347970962524414) | > loss_kl: 3.224790334701538 (3.6050262451171875) | > loss_feat: 4.613632678985596 (5.399309158325195) | > loss_mel: 29.022497177124023 (26.487878799438477) | > loss_duration: 2.4761507511138916 (2.5084317922592163) | > loss_1: 42.043609619140625 (41.13544273376465)  --> STEP: 3 | > loss_disc: 3.005110025405884 (2.857673486073812) | > loss_disc_real_0: 0.2742033004760742 (0.4840863148371379) | > loss_disc_real_1: 0.3350408971309662 (0.25392236808935803) | > loss_disc_real_2: 0.292096346616745 (0.29124657313028973) | > loss_disc_real_3: 0.27961280941963196 (0.29396137595176697) | > loss_disc_real_4: 0.26392000913619995 (0.25480355819066364) | > loss_disc_real_5: 0.26565712690353394 (0.24394153555234274) | > loss_0: 3.005110025405884 (2.857673486073812) | > loss_gen: 1.733515977859497 (2.66770339012146) | > loss_kl: 1.5782718658447266 (2.929441452026367) | > loss_feat: 0.10082067549228668 (3.6331463307142258) | > loss_mel: 3.2255825996398926 (18.733780066172283) | > loss_duration: 2.4664247035980225 (2.494429429372152) | > loss_1: 9.104616165161133 (30.458500544230144) --> EVAL PERFORMANCE | > avg_loader_time: 0.00845630963643392 (-3.9180119832355614e-05) | > avg_loss_disc: 2.857673486073812 (-0.0762557188669839) | > avg_loss_disc_real_0: 0.4840863148371379 (-0.0034202237923939838) | > avg_loss_disc_real_1: 0.25392236808935803 (-0.1081053962310155) | > avg_loss_disc_real_2: 0.29124657313028973 (+0.002349863449732481) | > avg_loss_disc_real_3: 0.29396137595176697 (+0.0038958738247553693) | > avg_loss_disc_real_4: 0.25480355819066364 (-0.08448706070582074) | > avg_loss_disc_real_5: 0.24394153555234274 (-0.1396175523598989) | > avg_loss_0: 2.857673486073812 (-0.0762557188669839) | > avg_loss_gen: 2.66770339012146 (-0.571772257486979) | > avg_loss_kl: 2.929441452026367 (+0.5020235776901245) | > avg_loss_feat: 3.6331463307142258 (-0.5062465220689774) | > avg_loss_mel: 18.733780066172283 (-5.304958820343018) | > avg_loss_duration: 2.494429429372152 (+0.022340695063273408) | > avg_loss_1: 30.458500544230144 (-5.858613967895504)  > EPOCH: 244/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:19:02)   --> TIME: 2023-10-20 02:19:16 -- STEP: 19/50 -- GLOBAL_STEP: 65220 | > loss_disc: 2.1319382190704346 (2.2924832042894865) | > loss_disc_real_0: 0.189829021692276 (0.17362476826498383) | > loss_disc_real_1: 0.1548275649547577 (0.2279599489350068) | > loss_disc_real_2: 0.18707489967346191 (0.24093727571399592) | > loss_disc_real_3: 0.20128580927848816 (0.21300677955150604) | > loss_disc_real_4: 0.23912034928798676 (0.1911549258388971) | > loss_disc_real_5: 0.08475786447525024 (0.18229558574967086) | > loss_0: 2.1319382190704346 (2.2924832042894865) | > grad_norm_0: tensor(820.6457, device='cuda:0') (tensor(562.9957, device='cuda:0')) | > loss_gen: 2.276845693588257 (2.5994554067912854) | > loss_kl: 1.2508844137191772 (0.9928164199778908) | > loss_feat: 5.9867072105407715 (5.982254511431644) | > loss_mel: 28.92321014404297 (24.090690763373125) | > loss_duration: 1.734866976737976 (1.6588529097406488) | > loss_1: 40.17251205444336 (35.32406937448602) | > grad_norm_1: tensor(13718.5225, device='cuda:0') (tensor(21593.8086, device='cuda:0')) | > current_lr_0: 0.00015669513703434423 | > current_lr_1: 0.00015669513703434423 | > step_time: 0.6586 (0.47896134225945725) | > loader_time: 0.0241 (0.020132591849879214)  --> TIME: 2023-10-20 02:19:32 -- STEP: 49/50 -- GLOBAL_STEP: 65250 | > loss_disc: 2.7549965381622314 (2.3800269851879197) | > loss_disc_real_0: 0.13140985369682312 (0.16033733742577688) | > loss_disc_real_1: 0.35023683309555054 (0.23073453684242404) | > loss_disc_real_2: 0.2553972899913788 (0.22254271759670607) | > loss_disc_real_3: 0.31446629762649536 (0.23270118373389148) | > loss_disc_real_4: 0.24216321110725403 (0.21184819309535075) | > loss_disc_real_5: 0.2392629086971283 (0.20505481130177422) | > loss_0: 2.7549965381622314 (2.3800269851879197) | > grad_norm_0: tensor(454.8924, device='cuda:0') (tensor(539.8370, device='cuda:0')) | > loss_gen: 1.9045544862747192 (2.563427078480623) | > loss_kl: 1.0289757251739502 (0.9905517636513224) | > loss_feat: 1.5678479671478271 (6.097429386511141) | > loss_mel: 24.27884864807129 (24.397599979322784) | > loss_duration: 1.761041283607483 (1.6367728223606033) | > loss_1: 30.54126739501953 (35.68578081714864) | > grad_norm_1: tensor(6034.0234, device='cuda:0') (tensor(20903.1504, device='cuda:0')) | > current_lr_0: 0.00015669513703434423 | > current_lr_1: 0.00015669513703434423 | > step_time: 0.376 (0.481902755036646) | > loader_time: 0.3603 (0.02652409125347526)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.227342128753662 (3.227342128753662) | > loss_disc_real_0: 0.2774500250816345 (0.2774500250816345) | > loss_disc_real_1: 0.2829650342464447 (0.2829650342464447) | > loss_disc_real_2: 0.184273824095726 (0.184273824095726) | > loss_disc_real_3: 0.3458123505115509 (0.3458123505115509) | > loss_disc_real_4: 0.2679271101951599 (0.2679271101951599) | > loss_disc_real_5: 0.14815299212932587 (0.14815299212932587) | > loss_0: 3.227342128753662 (3.227342128753662) | > loss_gen: 2.0251240730285645 (2.0251240730285645) | > loss_kl: 4.979733943939209 (4.979733943939209) | > loss_feat: 5.472397804260254 (5.472397804260254) | > loss_mel: 21.478456497192383 (21.478456497192383) | > loss_duration: 2.2976443767547607 (2.2976443767547607) | > loss_1: 36.25335693359375 (36.25335693359375)  --> STEP: 1 | > loss_disc: 1.989485502243042 (1.989485502243042) | > loss_disc_real_0: 0.08406184613704681 (0.08406184613704681) | > loss_disc_real_1: 0.38555002212524414 (0.38555002212524414) | > loss_disc_real_2: 0.21740038692951202 (0.21740038692951202) | > loss_disc_real_3: 0.15443657338619232 (0.15443657338619232) | > loss_disc_real_4: 0.09015434235334396 (0.09015434235334396) | > loss_disc_real_5: 0.10124631971120834 (0.10124631971120834) | > loss_0: 1.989485502243042 (1.989485502243042) | > loss_gen: 2.4975745677948 (2.4975745677948) | > loss_kl: 3.8537983894348145 (3.8537983894348145) | > loss_feat: 5.992528915405273 (5.992528915405273) | > loss_mel: 24.322534561157227 (24.322534561157227) | > loss_duration: 2.455366849899292 (2.455366849899292) | > loss_1: 39.121803283691406 (39.121803283691406)  --> STEP: 2 | > loss_disc: 2.9980525970458984 (2.49376904964447) | > loss_disc_real_0: 0.3107985854148865 (0.19743021577596664) | > loss_disc_real_1: 0.2702718675136566 (0.3279109448194504) | > loss_disc_real_2: 0.4058237373828888 (0.3116120621562004) | > loss_disc_real_3: 0.26614490151405334 (0.21029073745012283) | > loss_disc_real_4: 0.2254108339548111 (0.15778258815407753) | > loss_disc_real_5: 0.24038289487361908 (0.1708146072924137) | > loss_0: 2.9980525970458984 (2.49376904964447) | > loss_gen: 1.7832744121551514 (2.1404244899749756) | > loss_kl: 3.1901485919952393 (3.521973490715027) | > loss_feat: 0.13460351526737213 (3.063566215336323) | > loss_mel: 3.5229263305664062 (13.922730445861816) | > loss_duration: 2.4871811866760254 (2.4712740182876587) | > loss_1: 11.118133544921875 (25.11996841430664)  --> STEP: 3 | > loss_disc: 2.8265461921691895 (2.6046947638193765) | > loss_disc_real_0: 0.13864220678806305 (0.17783421277999878) | > loss_disc_real_1: 0.4163288474082947 (0.3573835790157318) | > loss_disc_real_2: 0.29355400800704956 (0.30559271077315014) | > loss_disc_real_3: 0.13610181212425232 (0.18556109567483267) | > loss_disc_real_4: 0.5478240251541138 (0.28779640048742294) | > loss_disc_real_5: 0.2268066704273224 (0.18947862833738327) | > loss_0: 2.8265461921691895 (2.6046947638193765) | > loss_gen: 2.517080307006836 (2.2659764289855957) | > loss_kl: 1.844732642173767 (2.9628932078679404) | > loss_feat: 5.637887001037598 (3.9216731439034143) | > loss_mel: 25.789039611816406 (17.878166834513348) | > loss_duration: 2.3772449493408203 (2.4399309953053794) | > loss_1: 38.165985107421875 (29.46864064534505) --> EVAL PERFORMANCE | > avg_loader_time: 0.006359497706095378 (-0.002096811930338542) | > avg_loss_disc: 2.6046947638193765 (-0.2529787222544355) | > avg_loss_disc_real_0: 0.17783421277999878 (-0.3062521020571391) | > avg_loss_disc_real_1: 0.3573835790157318 (+0.10346121092637378) | > avg_loss_disc_real_2: 0.30559271077315014 (+0.014346137642860413) | > avg_loss_disc_real_3: 0.18556109567483267 (-0.1084002802769343) | > avg_loss_disc_real_4: 0.28779640048742294 (+0.032992842296759306) | > avg_loss_disc_real_5: 0.18947862833738327 (-0.05446290721495947) | > avg_loss_0: 2.6046947638193765 (-0.2529787222544355) | > avg_loss_gen: 2.2659764289855957 (-0.40172696113586426) | > avg_loss_kl: 2.9628932078679404 (+0.03345175584157323) | > avg_loss_feat: 3.9216731439034143 (+0.2885268131891885) | > avg_loss_mel: 17.878166834513348 (-0.8556132316589355) | > avg_loss_duration: 2.4399309953053794 (-0.05449843406677246) | > avg_loss_1: 29.46864064534505 (-0.9898598988850935)  > EPOCH: 245/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:19:44)   --> TIME: 2023-10-20 02:20:02 -- STEP: 29/50 -- GLOBAL_STEP: 65280 | > loss_disc: 2.8527400493621826 (2.425502600341008) | > loss_disc_real_0: 0.07719827443361282 (0.13006831011895478) | > loss_disc_real_1: 0.25161266326904297 (0.23132956927192622) | > loss_disc_real_2: 0.09486182034015656 (0.2145512873499558) | > loss_disc_real_3: 0.25483056902885437 (0.23780003780948705) | > loss_disc_real_4: 0.3056015074253082 (0.20444929407074533) | > loss_disc_real_5: 0.3580256402492523 (0.20260767510225036) | > loss_0: 2.8527400493621826 (2.425502600341008) | > grad_norm_0: tensor(1675.2992, device='cuda:0') (tensor(643.9455, device='cuda:0')) | > loss_gen: 1.8077932596206665 (2.3104846189761985) | > loss_kl: 0.6262811422348022 (0.8508650609131517) | > loss_feat: 0.553118884563446 (5.044274095831247) | > loss_mel: 17.04987335205078 (23.04439555365464) | > loss_duration: 1.6264629364013672 (1.650930170355172) | > loss_1: 21.663528442382812 (32.90094974123199) | > grad_norm_1: tensor(15826.3701, device='cuda:0') (tensor(25380.2598, device='cuda:0')) | > current_lr_0: 0.0001565385104342964 | > current_lr_1: 0.0001565385104342964 | > step_time: 0.3742 (0.47895582791032465) | > loader_time: 0.0018 (0.011869808723186622)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.917776107788086 (1.917776107788086) | > loss_disc_real_0: 0.09715533256530762 (0.09715533256530762) | > loss_disc_real_1: 0.2141958624124527 (0.2141958624124527) | > loss_disc_real_2: 0.19902902841567993 (0.19902902841567993) | > loss_disc_real_3: 0.27310335636138916 (0.27310335636138916) | > loss_disc_real_4: 0.17592625319957733 (0.17592625319957733) | > loss_disc_real_5: 0.11276621371507645 (0.11276621371507645) | > loss_0: 1.917776107788086 (1.917776107788086) | > loss_gen: 2.9515256881713867 (2.9515256881713867) | > loss_kl: 1.9826831817626953 (1.9826831817626953) | > loss_feat: 6.776206016540527 (6.776206016540527) | > loss_mel: 17.907129287719727 (17.907129287719727) | > loss_duration: 2.2881999015808105 (2.2881999015808105) | > loss_1: 31.905746459960938 (31.905746459960938)  --> STEP: 1 | > loss_disc: 2.745222568511963 (2.745222568511963) | > loss_disc_real_0: 0.22051692008972168 (0.22051692008972168) | > loss_disc_real_1: 0.23362283408641815 (0.23362283408641815) | > loss_disc_real_2: 0.4146954417228699 (0.4146954417228699) | > loss_disc_real_3: 0.2371637523174286 (0.2371637523174286) | > loss_disc_real_4: 0.416067898273468 (0.416067898273468) | > loss_disc_real_5: 0.3312557339668274 (0.3312557339668274) | > loss_0: 2.745222568511963 (2.745222568511963) | > loss_gen: 2.8779122829437256 (2.8779122829437256) | > loss_kl: 2.586484909057617 (2.586484909057617) | > loss_feat: 6.079458236694336 (6.079458236694336) | > loss_mel: 23.142616271972656 (23.142616271972656) | > loss_duration: 2.444608211517334 (2.444608211517334) | > loss_1: 37.13107681274414 (37.13107681274414)  --> STEP: 2 | > loss_disc: 2.16357159614563 (2.4543970823287964) | > loss_disc_real_0: 0.255154550075531 (0.23783573508262634) | > loss_disc_real_1: 0.1424769014120102 (0.18804986774921417) | > loss_disc_real_2: 0.1629728525876999 (0.2888341471552849) | > loss_disc_real_3: 0.20142275094985962 (0.2192932516336441) | > loss_disc_real_4: 0.21103186905384064 (0.3135498836636543) | > loss_disc_real_5: 0.22750824689865112 (0.27938199043273926) | > loss_0: 2.16357159614563 (2.4543970823287964) | > loss_gen: 3.3960378170013428 (3.136975049972534) | > loss_kl: 3.3397703170776367 (2.963127613067627) | > loss_feat: 9.175609588623047 (7.627533912658691) | > loss_mel: 30.424304962158203 (26.78346061706543) | > loss_duration: 2.4746510982513428 (2.4596296548843384) | > loss_1: 48.81037521362305 (42.970726013183594)  --> STEP: 3 | > loss_disc: 2.65169095993042 (2.5201617081960044) | > loss_disc_real_0: 0.12287180125713348 (0.19951442380746207) | > loss_disc_real_1: 0.27863261103630066 (0.21824411551157633) | > loss_disc_real_2: 0.29682040214538574 (0.29149623215198517) | > loss_disc_real_3: 0.1636979728937149 (0.2007614920536677) | > loss_disc_real_4: 0.34946879744529724 (0.32552285492420197) | > loss_disc_real_5: 0.3755478262901306 (0.3114372690518697) | > loss_0: 2.65169095993042 (2.5201617081960044) | > loss_gen: 2.18099045753479 (2.8183135191599527) | > loss_kl: 1.7369318008422852 (2.5543956756591797) | > loss_feat: 3.180424451828003 (6.145164092381795) | > loss_mel: 23.054916381835938 (25.540612538655598) | > loss_duration: 2.388035297393799 (2.4357648690541587) | > loss_1: 32.541297912597656 (39.494249979654946) --> EVAL PERFORMANCE | > avg_loader_time: 0.007204135258992513 (+0.0008446375528971348) | > avg_loss_disc: 2.5201617081960044 (-0.0845330556233721) | > avg_loss_disc_real_0: 0.19951442380746207 (+0.021680211027463286) | > avg_loss_disc_real_1: 0.21824411551157633 (-0.1391394635041555) | > avg_loss_disc_real_2: 0.29149623215198517 (-0.014096478621164976) | > avg_loss_disc_real_3: 0.2007614920536677 (+0.015200396378835024) | > avg_loss_disc_real_4: 0.32552285492420197 (+0.03772645443677902) | > avg_loss_disc_real_5: 0.3114372690518697 (+0.12195864071448642) | > avg_loss_0: 2.5201617081960044 (-0.0845330556233721) | > avg_loss_gen: 2.8183135191599527 (+0.552337090174357) | > avg_loss_kl: 2.5543956756591797 (-0.4084975322087607) | > avg_loss_feat: 6.145164092381795 (+2.2234909484783807) | > avg_loss_mel: 25.540612538655598 (+7.66244570414225) | > avg_loss_duration: 2.4357648690541587 (-0.004166126251220703) | > avg_loss_1: 39.494249979654946 (+10.025609334309895)  > EPOCH: 246/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:20:22)   --> TIME: 2023-10-20 02:20:31 -- STEP: 9/50 -- GLOBAL_STEP: 65310 | > loss_disc: 2.9585256576538086 (2.3686011367373996) | > loss_disc_real_0: 0.15315783023834229 (0.10266700573265553) | > loss_disc_real_1: 0.36878257989883423 (0.24606720275349087) | > loss_disc_real_2: 0.25862663984298706 (0.253719478017754) | > loss_disc_real_3: 0.31873619556427 (0.22221867574585807) | > loss_disc_real_4: 0.27563145756721497 (0.22596905794408587) | > loss_disc_real_5: 0.2866874933242798 (0.25015569002264076) | > loss_0: 2.9585256576538086 (2.3686011367373996) | > grad_norm_0: tensor(2190.7327, device='cuda:0') (tensor(808.8104, device='cuda:0')) | > loss_gen: 1.8538013696670532 (2.758730080392626) | > loss_kl: 0.9233289957046509 (1.0419164167510138) | > loss_feat: 0.18504658341407776 (6.73067311445872) | > loss_mel: 12.624051094055176 (21.179206159379746) | > loss_duration: 1.5787650346755981 (1.6320191621780396) | > loss_1: 17.164993286132812 (33.34254529741075) | > grad_norm_1: tensor(27017.3652, device='cuda:0') (tensor(30771.9863, device='cuda:0')) | > current_lr_0: 0.00015638204039234165 | > current_lr_1: 0.00015638204039234165 | > step_time: 0.6432 (0.5181912581125895) | > loader_time: 0.0047 (0.0196482605404324)  --> TIME: 2023-10-20 02:20:42 -- STEP: 39/50 -- GLOBAL_STEP: 65340 | > loss_disc: 2.7661795616149902 (2.5178442490406527) | > loss_disc_real_0: 0.2761543095111847 (0.1661384550329202) | > loss_disc_real_1: 0.21595963835716248 (0.2281723033923369) | > loss_disc_real_2: 0.24099339544773102 (0.22917942807842523) | > loss_disc_real_3: 0.2861689329147339 (0.24317240151457298) | > loss_disc_real_4: 0.33789557218551636 (0.23891328991605684) | > loss_disc_real_5: 0.4665723443031311 (0.2545826468998805) | > loss_0: 2.7661795616149902 (2.5178442490406527) | > grad_norm_0: tensor(640.3215, device='cuda:0') (tensor(682.3222, device='cuda:0')) | > loss_gen: 2.4943246841430664 (2.4571068623127084) | > loss_kl: 0.9214006662368774 (1.0098456732737713) | > loss_feat: 2.8453636169433594 (5.225318985107617) | > loss_mel: 24.44131088256836 (22.880269723060803) | > loss_duration: 1.6641839742660522 (1.6296860835491083) | > loss_1: 32.36658477783203 (33.20222744574914) | > grad_norm_1: tensor(10242.4277, device='cuda:0') (tensor(19936.4395, device='cuda:0')) | > current_lr_0: 0.00015638204039234165 | > current_lr_1: 0.00015638204039234165 | > step_time: 0.3464 (0.39585375174497944) | > loader_time: 0.0023 (0.008675984847239958)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5850658416748047 (2.5850658416748047) | > loss_disc_real_0: 0.17168746888637543 (0.17168746888637543) | > loss_disc_real_1: 0.24470825493335724 (0.24470825493335724) | > loss_disc_real_2: 0.27712228894233704 (0.27712228894233704) | > loss_disc_real_3: 0.23941722512245178 (0.23941722512245178) | > loss_disc_real_4: 0.24202489852905273 (0.24202489852905273) | > loss_disc_real_5: 0.2835116684436798 (0.2835116684436798) | > loss_0: 2.5850658416748047 (2.5850658416748047) | > loss_gen: 2.1841814517974854 (2.1841814517974854) | > loss_kl: 2.331087589263916 (2.331087589263916) | > loss_feat: 5.7919206619262695 (5.7919206619262695) | > loss_mel: 26.28630828857422 (26.28630828857422) | > loss_duration: 2.3082406520843506 (2.3082406520843506) | > loss_1: 38.901737213134766 (38.901737213134766)  --> STEP: 1 | > loss_disc: 1.8993825912475586 (1.8993825912475586) | > loss_disc_real_0: 0.05388469994068146 (0.05388469994068146) | > loss_disc_real_1: 0.20330052077770233 (0.20330052077770233) | > loss_disc_real_2: 0.07240059226751328 (0.07240059226751328) | > loss_disc_real_3: 0.19063542783260345 (0.19063542783260345) | > loss_disc_real_4: 0.20539113879203796 (0.20539113879203796) | > loss_disc_real_5: 0.06568323820829391 (0.06568323820829391) | > loss_0: 1.8993825912475586 (1.8993825912475586) | > loss_gen: 2.099487066268921 (2.099487066268921) | > loss_kl: 3.6327123641967773 (3.6327123641967773) | > loss_feat: 8.192001342773438 (8.192001342773438) | > loss_mel: 26.223751068115234 (26.223751068115234) | > loss_duration: 2.5926029682159424 (2.5926029682159424) | > loss_1: 42.74055480957031 (42.74055480957031)  --> STEP: 2 | > loss_disc: 3.1617136001586914 (2.530548095703125) | > loss_disc_real_0: 0.44934743642807007 (0.25161606818437576) | > loss_disc_real_1: 0.26410070061683655 (0.23370061069726944) | > loss_disc_real_2: 0.3506823778152466 (0.21154148504137993) | > loss_disc_real_3: 0.28403523564338684 (0.23733533173799515) | > loss_disc_real_4: 0.2856491208076477 (0.24552012979984283) | > loss_disc_real_5: 0.3564169406890869 (0.21105008944869041) | > loss_0: 3.1617136001586914 (2.530548095703125) | > loss_gen: 1.9074782133102417 (2.0034826397895813) | > loss_kl: 3.166395425796509 (3.399553894996643) | > loss_feat: 0.18393871188163757 (4.1879700273275375) | > loss_mel: 3.102785348892212 (14.663268208503723) | > loss_duration: 2.4491899013519287 (2.5208964347839355) | > loss_1: 10.80978775024414 (26.775171279907227)  --> STEP: 3 | > loss_disc: 0.9461657404899597 (2.002420643965403) | > loss_disc_real_0: 0.025420695543289185 (0.1762176106373469) | > loss_disc_real_1: 0.08129063993692398 (0.1828972871104876) | > loss_disc_real_2: 0.0941215455532074 (0.17240150521198908) | > loss_disc_real_3: 0.05678076297044754 (0.17715047548214594) | > loss_disc_real_4: 0.023557638749480247 (0.1715326327830553) | > loss_disc_real_5: 0.003999731037765741 (0.14203330331171551) | > loss_0: 0.9461657404899597 (2.002420643965403) | > loss_gen: 3.526681900024414 (2.5112157265345254) | > loss_kl: 1.4628187417984009 (2.753975510597229) | > loss_feat: 12.420136451721191 (6.9320255021254225) | > loss_mel: 24.392436981201172 (17.906324466069538) | > loss_duration: 2.389146327972412 (2.4769797325134277) | > loss_1: 44.19121551513672 (32.580519358317055) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022041797637939453 (-0.004999955495198567) | > avg_loss_disc: 2.002420643965403 (-0.5177410642306013) | > avg_loss_disc_real_0: 0.1762176106373469 (-0.02329681317011517) | > avg_loss_disc_real_1: 0.1828972871104876 (-0.035346828401088715) | > avg_loss_disc_real_2: 0.17240150521198908 (-0.11909472693999609) | > avg_loss_disc_real_3: 0.17715047548214594 (-0.02361101657152176) | > avg_loss_disc_real_4: 0.1715326327830553 (-0.15399022214114666) | > avg_loss_disc_real_5: 0.14203330331171551 (-0.16940396574015418) | > avg_loss_0: 2.002420643965403 (-0.5177410642306013) | > avg_loss_gen: 2.5112157265345254 (-0.30709779262542725) | > avg_loss_kl: 2.753975510597229 (+0.19957983493804932) | > avg_loss_feat: 6.9320255021254225 (+0.7868614097436275) | > avg_loss_mel: 17.906324466069538 (-7.63428807258606) | > avg_loss_duration: 2.4769797325134277 (+0.04121486345926906) | > avg_loss_1: 32.580519358317055 (-6.913730621337891)  > EPOCH: 247/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:21:00)   --> TIME: 2023-10-20 02:21:15 -- STEP: 19/50 -- GLOBAL_STEP: 65370 | > loss_disc: 2.9964096546173096 (2.5677589680019177) | > loss_disc_real_0: 0.2605415880680084 (0.18424315887846446) | > loss_disc_real_1: 0.2740976810455322 (0.25679334645208557) | > loss_disc_real_2: 0.3588966131210327 (0.26202925059356186) | > loss_disc_real_3: 0.22321872413158417 (0.2640586664017878) | > loss_disc_real_4: 0.23379066586494446 (0.2243123401544596) | > loss_disc_real_5: 0.27708953619003296 (0.24119836660592178) | > loss_0: 2.9964096546173096 (2.5677589680019177) | > grad_norm_0: tensor(846.2944, device='cuda:0') (tensor(538.8853, device='cuda:0')) | > loss_gen: 1.671966791152954 (2.333272275171782) | > loss_kl: 1.1105698347091675 (1.0083620391393964) | > loss_feat: 0.18757687509059906 (5.030854600824808) | > loss_mel: 7.93422794342041 (23.146793365478516) | > loss_duration: 1.7409597635269165 (1.6650440002742566) | > loss_1: 12.64530086517334 (33.184326824389004) | > grad_norm_1: tensor(28349.6875, device='cuda:0') (tensor(17485.4961, device='cuda:0')) | > current_lr_0: 0.00015622572675199028 | > current_lr_1: 0.00015622572675199028 | > step_time: 0.5671 (0.5029913877186022) | > loader_time: 0.0247 (0.020576376664011103)  --> TIME: 2023-10-20 02:21:31 -- STEP: 49/50 -- GLOBAL_STEP: 65400 | > loss_disc: 1.4373027086257935 (2.5439101773865374) | > loss_disc_real_0: 0.017950691282749176 (0.17030934537095682) | > loss_disc_real_1: 0.07822049409151077 (0.23505479994477055) | > loss_disc_real_2: 0.07843121886253357 (0.23740888523812198) | > loss_disc_real_3: 0.1713239997625351 (0.25549793882029403) | > loss_disc_real_4: 0.19095981121063232 (0.235202143462945) | > loss_disc_real_5: 0.06331651657819748 (0.23022838210573002) | > loss_0: 1.4373027086257935 (2.5439101773865374) | > grad_norm_0: tensor(1415.4723, device='cuda:0') (tensor(829.7076, device='cuda:0')) | > loss_gen: 2.8617944717407227 (2.270604722353877) | > loss_kl: 0.9802117347717285 (0.8944836873181012) | > loss_feat: 7.079248905181885 (4.693737003420082) | > loss_mel: 27.105924606323242 (22.89659109407542) | > loss_duration: 1.7201261520385742 (1.614502765694443) | > loss_1: 39.74730682373047 (32.369919446049906) | > grad_norm_1: tensor(65853.1250, device='cuda:0') (tensor(23176.8457, device='cuda:0')) | > current_lr_0: 0.00015622572675199028 | > current_lr_1: 0.00015622572675199028 | > step_time: 0.591 (0.5061154949421786) | > loader_time: 0.3383 (0.025950465883527483)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9116616249084473 (2.9116616249084473) | > loss_disc_real_0: 0.13741639256477356 (0.13741639256477356) | > loss_disc_real_1: 0.18532690405845642 (0.18532690405845642) | > loss_disc_real_2: 0.33290040493011475 (0.33290040493011475) | > loss_disc_real_3: 0.25828099250793457 (0.25828099250793457) | > loss_disc_real_4: 0.42096254229545593 (0.42096254229545593) | > loss_disc_real_5: 0.44149062037467957 (0.44149062037467957) | > loss_0: 2.9116616249084473 (2.9116616249084473) | > loss_gen: 2.1905648708343506 (2.1905648708343506) | > loss_kl: 2.549602746963501 (2.549602746963501) | > loss_feat: 4.658514499664307 (4.658514499664307) | > loss_mel: 22.651945114135742 (22.651945114135742) | > loss_duration: 2.3258886337280273 (2.3258886337280273) | > loss_1: 34.37651443481445 (34.37651443481445)  --> STEP: 1 | > loss_disc: 2.4709811210632324 (2.4709811210632324) | > loss_disc_real_0: 0.1573953479528427 (0.1573953479528427) | > loss_disc_real_1: 0.22355923056602478 (0.22355923056602478) | > loss_disc_real_2: 0.08704624325037003 (0.08704624325037003) | > loss_disc_real_3: 0.19640327990055084 (0.19640327990055084) | > loss_disc_real_4: 0.179019033908844 (0.179019033908844) | > loss_disc_real_5: 0.1474544107913971 (0.1474544107913971) | > loss_0: 2.4709811210632324 (2.4709811210632324) | > loss_gen: 1.6876360177993774 (1.6876360177993774) | > loss_kl: 3.66957426071167 (3.66957426071167) | > loss_feat: 7.047802448272705 (7.047802448272705) | > loss_mel: 25.599836349487305 (25.599836349487305) | > loss_duration: 2.584987163543701 (2.584987163543701) | > loss_1: 40.589839935302734 (40.589839935302734)  --> STEP: 2 | > loss_disc: 2.2531776428222656 (2.362079381942749) | > loss_disc_real_0: 0.051890648901462555 (0.10464299842715263) | > loss_disc_real_1: 0.20470893383026123 (0.214134082198143) | > loss_disc_real_2: 0.1949387639760971 (0.14099250361323357) | > loss_disc_real_3: 0.26931658387184143 (0.23285993188619614) | > loss_disc_real_4: 0.23895077407360077 (0.20898490399122238) | > loss_disc_real_5: 0.19207312166690826 (0.16976376622915268) | > loss_0: 2.2531776428222656 (2.362079381942749) | > loss_gen: 2.113959312438965 (1.9007976651191711) | > loss_kl: 3.4888758659362793 (3.5792250633239746) | > loss_feat: 3.5454752445220947 (5.2966388463974) | > loss_mel: 28.80486297607422 (27.20234966278076) | > loss_duration: 2.5198352336883545 (2.552411198616028) | > loss_1: 40.4730110168457 (40.53142547607422)  --> STEP: 3 | > loss_disc: 3.2651519775390625 (2.6631035804748535) | > loss_disc_real_0: 0.08053421974182129 (0.09660673886537552) | > loss_disc_real_1: 0.2928016185760498 (0.24035659432411194) | > loss_disc_real_2: 0.19823727011680603 (0.16007409244775772) | > loss_disc_real_3: 0.3639233708381653 (0.27654774487018585) | > loss_disc_real_4: 0.3232959806919098 (0.24708859622478485) | > loss_disc_real_5: 0.4079507887363434 (0.24915944039821625) | > loss_0: 3.2651519775390625 (2.6631035804748535) | > loss_gen: 1.6220173835754395 (1.807870904604594) | > loss_kl: 1.534980297088623 (2.897810141245524) | > loss_feat: 4.476504802703857 (5.023260831832886) | > loss_mel: 23.11422348022461 (25.839640935262043) | > loss_duration: 2.405177116394043 (2.5033331712086997) | > loss_1: 33.15290451049805 (38.07191848754883) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025243759155273438 (+0.00032019615173339844) | > avg_loss_disc: 2.6631035804748535 (+0.6606829365094504) | > avg_loss_disc_real_0: 0.09660673886537552 (-0.07961087177197138) | > avg_loss_disc_real_1: 0.24035659432411194 (+0.05745930721362433) | > avg_loss_disc_real_2: 0.16007409244775772 (-0.012327412764231355) | > avg_loss_disc_real_3: 0.27654774487018585 (+0.09939726938803992) | > avg_loss_disc_real_4: 0.24708859622478485 (+0.07555596344172955) | > avg_loss_disc_real_5: 0.24915944039821625 (+0.10712613708650073) | > avg_loss_0: 2.6631035804748535 (+0.6606829365094504) | > avg_loss_gen: 1.807870904604594 (-0.7033448219299314) | > avg_loss_kl: 2.897810141245524 (+0.14383463064829494) | > avg_loss_feat: 5.023260831832886 (-1.9087646702925367) | > avg_loss_mel: 25.839640935262043 (+7.933316469192505) | > avg_loss_duration: 2.5033331712086997 (+0.026353438695271958) | > avg_loss_1: 38.07191848754883 (+5.491399129231773)  > EPOCH: 248/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:21:42)   --> TIME: 2023-10-20 02:22:00 -- STEP: 29/50 -- GLOBAL_STEP: 65430 | > loss_disc: 1.9569240808486938 (2.629326413417685) | > loss_disc_real_0: 0.10984542965888977 (0.17896579257373152) | > loss_disc_real_1: 0.26438772678375244 (0.2258862398307899) | > loss_disc_real_2: 0.2542811334133148 (0.24205594175848474) | > loss_disc_real_3: 0.1657775193452835 (0.23092231873808236) | > loss_disc_real_4: 0.10941639542579651 (0.245798894300543) | > loss_disc_real_5: 0.06167805939912796 (0.23996560673775344) | > loss_0: 1.9569240808486938 (2.629326413417685) | > grad_norm_0: tensor(656.3666, device='cuda:0') (tensor(1208.0560, device='cuda:0')) | > loss_gen: 2.405722141265869 (2.1174580886446197) | > loss_kl: 0.6331283450126648 (0.9434737623508634) | > loss_feat: 7.179202079772949 (4.009063655446315) | > loss_mel: 26.651214599609375 (21.57298962823276) | > loss_duration: 1.5646002292633057 (1.6347873252013634) | > loss_1: 38.43387222290039 (30.27777262391715) | > grad_norm_1: tensor(5821.4316, device='cuda:0') (tensor(26438.0430, device='cuda:0')) | > current_lr_0: 0.0001560695693569092 | > current_lr_1: 0.0001560695693569092 | > step_time: 0.3323 (0.46493361736166067) | > loader_time: 0.0018 (0.00888984778831745)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2204179763793945 (2.2204179763793945) | > loss_disc_real_0: 0.3710503876209259 (0.3710503876209259) | > loss_disc_real_1: 0.3890657424926758 (0.3890657424926758) | > loss_disc_real_2: 0.23742246627807617 (0.23742246627807617) | > loss_disc_real_3: 0.2959296703338623 (0.2959296703338623) | > loss_disc_real_4: 0.2848765254020691 (0.2848765254020691) | > loss_disc_real_5: 0.15782687067985535 (0.15782687067985535) | > loss_0: 2.2204179763793945 (2.2204179763793945) | > loss_gen: 3.452238082885742 (3.452238082885742) | > loss_kl: 2.5971179008483887 (2.5971179008483887) | > loss_feat: 8.380732536315918 (8.380732536315918) | > loss_mel: 22.46039390563965 (22.46039390563965) | > loss_duration: 2.2294435501098633 (2.2294435501098633) | > loss_1: 39.11992263793945 (39.11992263793945)  --> STEP: 1 | > loss_disc: 2.7217037677764893 (2.7217037677764893) | > loss_disc_real_0: 0.11961597204208374 (0.11961597204208374) | > loss_disc_real_1: 0.2711735963821411 (0.2711735963821411) | > loss_disc_real_2: 0.30671289563179016 (0.30671289563179016) | > loss_disc_real_3: 0.2756488621234894 (0.2756488621234894) | > loss_disc_real_4: 0.2992907464504242 (0.2992907464504242) | > loss_disc_real_5: 0.21937428414821625 (0.21937428414821625) | > loss_0: 2.7217037677764893 (2.7217037677764893) | > loss_gen: 1.822782039642334 (1.822782039642334) | > loss_kl: 3.8496150970458984 (3.8496150970458984) | > loss_feat: 1.0991926193237305 (1.0991926193237305) | > loss_mel: 19.64008331298828 (19.64008331298828) | > loss_duration: 2.5194568634033203 (2.5194568634033203) | > loss_1: 28.931129455566406 (28.931129455566406)  --> STEP: 2 | > loss_disc: 3.1065917015075684 (2.914147734642029) | > loss_disc_real_0: 0.2849973142147064 (0.20230664312839508) | > loss_disc_real_1: 0.5260449647903442 (0.3986092805862427) | > loss_disc_real_2: 0.2725001275539398 (0.289606511592865) | > loss_disc_real_3: 0.46338939666748047 (0.3695191293954849) | > loss_disc_real_4: 0.2688111960887909 (0.28405097126960754) | > loss_disc_real_5: 0.21766474843025208 (0.21851951628923416) | > loss_0: 3.1065917015075684 (2.914147734642029) | > loss_gen: 2.4661002159118652 (2.1444411277770996) | > loss_kl: 3.4643666744232178 (3.656990885734558) | > loss_feat: 4.658299922943115 (2.878746271133423) | > loss_mel: 26.962480545043945 (23.301281929016113) | > loss_duration: 2.3971948623657227 (2.4583258628845215) | > loss_1: 39.94844055175781 (34.43978500366211)  --> STEP: 3 | > loss_disc: 1.901899814605713 (2.5767317612965903) | > loss_disc_real_0: 0.10285589843988419 (0.16915639489889145) | > loss_disc_real_1: 0.18311460316181183 (0.32677772144476575) | > loss_disc_real_2: 0.23568032681941986 (0.2716311166683833) | > loss_disc_real_3: 0.2238934189081192 (0.32097722589969635) | > loss_disc_real_4: 0.11887310445308685 (0.2289916823307673) | > loss_disc_real_5: 0.1312451958656311 (0.18942807614803314) | > loss_0: 1.901899814605713 (2.5767317612965903) | > loss_gen: 2.4936699867248535 (2.260850747426351) | > loss_kl: 1.7280051708221436 (3.01399564743042) | > loss_feat: 5.138838291168213 (3.632110277811686) | > loss_mel: 26.7917537689209 (24.464772542317707) | > loss_duration: 2.375485897064209 (2.4307125409444175) | > loss_1: 38.52775192260742 (35.80244064331055) --> EVAL PERFORMANCE | > avg_loader_time: 0.006112019220987956 (+0.0035876433054606123) | > avg_loss_disc: 2.5767317612965903 (-0.0863718191782632) | > avg_loss_disc_real_0: 0.16915639489889145 (+0.07254965603351593) | > avg_loss_disc_real_1: 0.32677772144476575 (+0.0864211271206538) | > avg_loss_disc_real_2: 0.2716311166683833 (+0.11155702422062558) | > avg_loss_disc_real_3: 0.32097722589969635 (+0.0444294810295105) | > avg_loss_disc_real_4: 0.2289916823307673 (-0.018096913894017547) | > avg_loss_disc_real_5: 0.18942807614803314 (-0.059731364250183105) | > avg_loss_0: 2.5767317612965903 (-0.0863718191782632) | > avg_loss_gen: 2.260850747426351 (+0.4529798428217571) | > avg_loss_kl: 3.01399564743042 (+0.11618550618489598) | > avg_loss_feat: 3.632110277811686 (-1.3911505540211997) | > avg_loss_mel: 24.464772542317707 (-1.374868392944336) | > avg_loss_duration: 2.4307125409444175 (-0.07262063026428223) | > avg_loss_1: 35.80244064331055 (-2.2694778442382812)  > EPOCH: 249/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:22:21)   --> TIME: 2023-10-20 02:22:29 -- STEP: 9/50 -- GLOBAL_STEP: 65460 | > loss_disc: 1.379397988319397 (2.3665435711542764) | > loss_disc_real_0: 0.06151985377073288 (0.14324946204821268) | > loss_disc_real_1: 0.07878375053405762 (0.1982688249813186) | > loss_disc_real_2: 0.10658478736877441 (0.24960412085056305) | > loss_disc_real_3: 0.14894692599773407 (0.24564127292897966) | > loss_disc_real_4: 0.09612031280994415 (0.19902592566278246) | > loss_disc_real_5: 0.03154780715703964 (0.18426058855321673) | > loss_0: 1.379397988319397 (2.3665435711542764) | > grad_norm_0: tensor(964.1918, device='cuda:0') (tensor(960.3557, device='cuda:0')) | > loss_gen: 2.5922067165374756 (2.3243161704805164) | > loss_kl: 0.7920514345169067 (0.9529468483395047) | > loss_feat: 8.361858367919922 (4.999653548002243) | > loss_mel: 25.034910202026367 (22.913192960951065) | > loss_duration: 1.5575354099273682 (1.6223300165600247) | > loss_1: 38.33856201171875 (32.812439388699005) | > grad_norm_1: tensor(5004.5127, device='cuda:0') (tensor(15403.3369, device='cuda:0')) | > current_lr_0: 0.0001559135680509214 | > current_lr_1: 0.0001559135680509214 | > step_time: 0.5994 (0.5134340392218696) | > loader_time: 0.0137 (0.019625875684950087)  --> TIME: 2023-10-20 02:22:42 -- STEP: 39/50 -- GLOBAL_STEP: 65490 | > loss_disc: 3.0424861907958984 (2.2688778822238627) | > loss_disc_real_0: 0.34764909744262695 (0.13874358559648198) | > loss_disc_real_1: 0.25377267599105835 (0.20602775670779058) | > loss_disc_real_2: 0.24421246349811554 (0.19880333538047776) | > loss_disc_real_3: 0.25917258858680725 (0.23282386649113435) | > loss_disc_real_4: 0.24756690859794617 (0.21467831616218275) | > loss_disc_real_5: 0.22713224589824677 (0.23268083072243592) | > loss_0: 3.0424861907958984 (2.2688778822238627) | > grad_norm_0: tensor(1562.0625, device='cuda:0') (tensor(945.4816, device='cuda:0')) | > loss_gen: 1.5433040857315063 (2.526705561540066) | > loss_kl: 0.9554288983345032 (0.9903513023104423) | > loss_feat: 0.20325268805027008 (5.885668945618165) | > loss_mel: 14.341987609863281 (22.953573887164776) | > loss_duration: 1.6401087045669556 (1.628471117753249) | > loss_1: 18.68408203125 (33.98477106827956) | > grad_norm_1: tensor(10321.7998, device='cuda:0') (tensor(36152.6367, device='cuda:0')) | > current_lr_0: 0.0001559135680509214 | > current_lr_1: 0.0001559135680509214 | > step_time: 0.3012 (0.42394524354201096) | > loader_time: 0.0041 (0.013136820915417794)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.5703697204589844 (3.5703697204589844) | > loss_disc_real_0: 0.5102894902229309 (0.5102894902229309) | > loss_disc_real_1: 0.48911669850349426 (0.48911669850349426) | > loss_disc_real_2: 0.451357901096344 (0.451357901096344) | > loss_disc_real_3: 0.3911709189414978 (0.3911709189414978) | > loss_disc_real_4: 0.30040091276168823 (0.30040091276168823) | > loss_disc_real_5: 0.47062280774116516 (0.47062280774116516) | > loss_0: 3.5703697204589844 (3.5703697204589844) | > loss_gen: 3.137507200241089 (3.137507200241089) | > loss_kl: 2.2753608226776123 (2.2753608226776123) | > loss_feat: 6.27130651473999 (6.27130651473999) | > loss_mel: 23.300798416137695 (23.300798416137695) | > loss_duration: 2.244478225708008 (2.244478225708008) | > loss_1: 37.229454040527344 (37.229454040527344)  --> STEP: 1 | > loss_disc: 2.8844540119171143 (2.8844540119171143) | > loss_disc_real_0: 0.3713509738445282 (0.3713509738445282) | > loss_disc_real_1: 0.3775508403778076 (0.3775508403778076) | > loss_disc_real_2: 0.4057687222957611 (0.4057687222957611) | > loss_disc_real_3: 0.38286447525024414 (0.38286447525024414) | > loss_disc_real_4: 0.27388933300971985 (0.27388933300971985) | > loss_disc_real_5: 0.21144580841064453 (0.21144580841064453) | > loss_0: 2.8844540119171143 (2.8844540119171143) | > loss_gen: 2.7208781242370605 (2.7208781242370605) | > loss_kl: 3.087043046951294 (3.087043046951294) | > loss_feat: 3.7705469131469727 (3.7705469131469727) | > loss_mel: 25.34921646118164 (25.34921646118164) | > loss_duration: 2.449904203414917 (2.449904203414917) | > loss_1: 37.37759017944336 (37.37759017944336)  --> STEP: 2 | > loss_disc: 2.7785236835479736 (2.831488847732544) | > loss_disc_real_0: 0.19541297852993011 (0.28338197618722916) | > loss_disc_real_1: 0.29029417037963867 (0.33392250537872314) | > loss_disc_real_2: 0.25172626972198486 (0.328747496008873) | > loss_disc_real_3: 0.2987067699432373 (0.3407856225967407) | > loss_disc_real_4: 0.3030286133289337 (0.2884589731693268) | > loss_disc_real_5: 0.21072275936603546 (0.21108428388834) | > loss_0: 2.7785236835479736 (2.831488847732544) | > loss_gen: 1.8241297006607056 (2.272503912448883) | > loss_kl: 3.517279624938965 (3.3021613359451294) | > loss_feat: 0.6786368489265442 (2.2245918810367584) | > loss_mel: 22.55138397216797 (23.950300216674805) | > loss_duration: 2.4776790142059326 (2.463791608810425) | > loss_1: 31.049108505249023 (34.21334934234619)  --> STEP: 3 | > loss_disc: 2.025482654571533 (2.5628201166788735) | > loss_disc_real_0: 0.07159106433391571 (0.212785005569458) | > loss_disc_real_1: 0.1887223869562149 (0.2855224659045537) | > loss_disc_real_2: 0.1851179450750351 (0.280870979030927) | > loss_disc_real_3: 0.18067608773708344 (0.2874157776435216) | > loss_disc_real_4: 0.16784074902534485 (0.24825289845466614) | > loss_disc_real_5: 0.12726135551929474 (0.18314330776532492) | > loss_0: 2.025482654571533 (2.5628201166788735) | > loss_gen: 2.116039752960205 (2.2203491926193237) | > loss_kl: 1.6859334707260132 (2.763418714205424) | > loss_feat: 4.250092029571533 (2.899758597215017) | > loss_mel: 23.55563735961914 (23.818745930989582) | > loss_duration: 2.4067883491516113 (2.444790522257487) | > loss_1: 34.01449203491211 (34.1470635732015) --> EVAL PERFORMANCE | > avg_loader_time: 0.011013348897298178 (+0.004901329676310222) | > avg_loss_disc: 2.5628201166788735 (-0.013911644617716767) | > avg_loss_disc_real_0: 0.212785005569458 (+0.04362861067056656) | > avg_loss_disc_real_1: 0.2855224659045537 (-0.04125525554021203) | > avg_loss_disc_real_2: 0.280870979030927 (+0.009239862362543705) | > avg_loss_disc_real_3: 0.2874157776435216 (-0.03356144825617474) | > avg_loss_disc_real_4: 0.24825289845466614 (+0.019261216123898833) | > avg_loss_disc_real_5: 0.18314330776532492 (-0.006284768382708222) | > avg_loss_0: 2.5628201166788735 (-0.013911644617716767) | > avg_loss_gen: 2.2203491926193237 (-0.04050155480702733) | > avg_loss_kl: 2.763418714205424 (-0.2505769332249961) | > avg_loss_feat: 2.899758597215017 (-0.7323516805966692) | > avg_loss_mel: 23.818745930989582 (-0.646026611328125) | > avg_loss_duration: 2.444790522257487 (+0.014077981313069365) | > avg_loss_1: 34.1470635732015 (-1.655377070109047)  > EPOCH: 250/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:23:00)   --> TIME: 2023-10-20 02:23:15 -- STEP: 19/50 -- GLOBAL_STEP: 65520 | > loss_disc: 1.6097437143325806 (2.1716099852009823) | > loss_disc_real_0: 0.05730297043919563 (0.14426840096712112) | > loss_disc_real_1: 0.12488120049238205 (0.22099380597080054) | > loss_disc_real_2: 0.12636932730674744 (0.19661641013073294) | > loss_disc_real_3: 0.11928368359804153 (0.24985308925572194) | > loss_disc_real_4: 0.05566921457648277 (0.18891961892184458) | > loss_disc_real_5: 0.07156829535961151 (0.1939521365259823) | > loss_0: 1.6097437143325806 (2.1716099852009823) | > grad_norm_0: tensor(1261.3428, device='cuda:0') (tensor(1119.2679, device='cuda:0')) | > loss_gen: 2.5145347118377686 (2.812405410565828) | > loss_kl: 0.8099385499954224 (0.9015445332778128) | > loss_feat: 9.88863754272461 (6.9941739067435265) | > loss_mel: 25.3742733001709 (25.54993102425023) | > loss_duration: 1.759800910949707 (1.6777793231763338) | > loss_1: 40.34718322753906 (37.93583448309647) | > grad_norm_1: tensor(51711.8281, device='cuda:0') (tensor(59704.1914, device='cuda:0')) | > current_lr_0: 0.00015575772267800605 | > current_lr_1: 0.00015575772267800605 | > step_time: 0.3826 (0.49386937994706004) | > loader_time: 0.0095 (0.020018728155838817)  --> TIME: 2023-10-20 02:23:31 -- STEP: 49/50 -- GLOBAL_STEP: 65550 | > loss_disc: 2.983112335205078 (2.3187873168867448) | > loss_disc_real_0: 0.2354617714881897 (0.15727738859321994) | > loss_disc_real_1: 0.2667372226715088 (0.21783663632766326) | > loss_disc_real_2: 0.210165336728096 (0.21500296005028852) | > loss_disc_real_3: 0.26396510004997253 (0.24705890421660578) | > loss_disc_real_4: 0.2128080427646637 (0.20449609811208685) | > loss_disc_real_5: 0.25339117646217346 (0.20973581140290717) | > loss_0: 2.983112335205078 (2.3187873168867448) | > grad_norm_0: tensor(965.7532, device='cuda:0') (tensor(1263.8373, device='cuda:0')) | > loss_gen: 1.4651036262512207 (2.546378687936433) | > loss_kl: 0.7885681986808777 (0.9434385561213201) | > loss_feat: 0.12894538044929504 (5.735683944000273) | > loss_mel: 3.1499617099761963 (23.355819658357266) | > loss_duration: 1.742923378944397 (1.6370819782724186) | > loss_1: 7.2755022048950195 (34.21840296959391) | > grad_norm_1: tensor(29460.2656, device='cuda:0') (tensor(41321.3828, device='cuda:0')) | > current_lr_0: 0.00015575772267800605 | > current_lr_1: 0.00015575772267800605 | > step_time: 0.5494 (0.49896205688009443) | > loader_time: 0.4526 (0.027555198085551354)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6677448749542236 (2.6677448749542236) | > loss_disc_real_0: 0.23965202271938324 (0.23965202271938324) | > loss_disc_real_1: 0.2229779213666916 (0.2229779213666916) | > loss_disc_real_2: 0.20565927028656006 (0.20565927028656006) | > loss_disc_real_3: 0.23286667466163635 (0.23286667466163635) | > loss_disc_real_4: 0.15040019154548645 (0.15040019154548645) | > loss_disc_real_5: 0.19035209715366364 (0.19035209715366364) | > loss_0: 2.6677448749542236 (2.6677448749542236) | > loss_gen: 1.6366280317306519 (1.6366280317306519) | > loss_kl: 3.1252264976501465 (3.1252264976501465) | > loss_feat: 1.5983660221099854 (1.5983660221099854) | > loss_mel: 17.929676055908203 (17.929676055908203) | > loss_duration: 2.2479069232940674 (2.2479069232940674) | > loss_1: 26.537803649902344 (26.537803649902344)  --> STEP: 1 | > loss_disc: 2.1166768074035645 (2.1166768074035645) | > loss_disc_real_0: 0.2009391188621521 (0.2009391188621521) | > loss_disc_real_1: 0.2778506875038147 (0.2778506875038147) | > loss_disc_real_2: 0.18461288511753082 (0.18461288511753082) | > loss_disc_real_3: 0.27358192205429077 (0.27358192205429077) | > loss_disc_real_4: 0.289521187543869 (0.289521187543869) | > loss_disc_real_5: 0.2446005940437317 (0.2446005940437317) | > loss_0: 2.1166768074035645 (2.1166768074035645) | > loss_gen: 2.992274284362793 (2.992274284362793) | > loss_kl: 3.192528247833252 (3.192528247833252) | > loss_feat: 6.727007865905762 (6.727007865905762) | > loss_mel: 25.300304412841797 (25.300304412841797) | > loss_duration: 2.4566643238067627 (2.4566643238067627) | > loss_1: 40.66878128051758 (40.66878128051758)  --> STEP: 2 | > loss_disc: 2.903475284576416 (2.5100760459899902) | > loss_disc_real_0: 0.25019633769989014 (0.22556772828102112) | > loss_disc_real_1: 0.3414144217967987 (0.3096325546503067) | > loss_disc_real_2: 0.23596009612083435 (0.2102864906191826) | > loss_disc_real_3: 0.158477321267128 (0.21602962166070938) | > loss_disc_real_4: 0.2928604185581207 (0.2911908030509949) | > loss_disc_real_5: 0.3555847108364105 (0.3000926524400711) | > loss_0: 2.903475284576416 (2.5100760459899902) | > loss_gen: 2.136354923248291 (2.564314603805542) | > loss_kl: 3.9263925552368164 (3.559460401535034) | > loss_feat: 5.869906425476074 (6.298457145690918) | > loss_mel: 24.792545318603516 (25.046424865722656) | > loss_duration: 2.4466099739074707 (2.4516371488571167) | > loss_1: 39.171810150146484 (39.92029571533203)  --> STEP: 3 | > loss_disc: 2.8572659492492676 (2.6258060137430825) | > loss_disc_real_0: 0.39051109552383423 (0.2805488506952922) | > loss_disc_real_1: 0.28403788805007935 (0.3011009991168976) | > loss_disc_real_2: 0.23820893466472626 (0.21959397196769714) | > loss_disc_real_3: 0.2803772985935211 (0.23747884730497995) | > loss_disc_real_4: 0.29031944274902344 (0.2909003496170044) | > loss_disc_real_5: 0.2853192389011383 (0.2951681812604268) | > loss_0: 2.8572659492492676 (2.6258060137430825) | > loss_gen: 2.1864137649536133 (2.438347657521566) | > loss_kl: 1.7255569696426392 (2.9481592575709024) | > loss_feat: 1.6203120946884155 (4.7390754620234175) | > loss_mel: 20.832040786743164 (23.641630172729492) | > loss_duration: 2.4028751850128174 (2.435383160909017) | > loss_1: 28.76719856262207 (36.20259666442871) --> EVAL PERFORMANCE | > avg_loader_time: 0.010294119517008463 (-0.0007192293802897147) | > avg_loss_disc: 2.6258060137430825 (+0.06298589706420898) | > avg_loss_disc_real_0: 0.2805488506952922 (+0.06776384512583417) | > avg_loss_disc_real_1: 0.3011009991168976 (+0.01557853321234387) | > avg_loss_disc_real_2: 0.21959397196769714 (-0.06127700706322986) | > avg_loss_disc_real_3: 0.23747884730497995 (-0.04993693033854166) | > avg_loss_disc_real_4: 0.2909003496170044 (+0.04264745116233826) | > avg_loss_disc_real_5: 0.2951681812604268 (+0.1120248734951019) | > avg_loss_0: 2.6258060137430825 (+0.06298589706420898) | > avg_loss_gen: 2.438347657521566 (+0.21799846490224217) | > avg_loss_kl: 2.9481592575709024 (+0.18474054336547852) | > avg_loss_feat: 4.7390754620234175 (+1.8393168648084006) | > avg_loss_mel: 23.641630172729492 (-0.17711575826008996) | > avg_loss_duration: 2.435383160909017 (-0.009407361348469756) | > avg_loss_1: 36.20259666442871 (+2.055533091227211)  > EPOCH: 251/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:23:42)   --> TIME: 2023-10-20 02:24:00 -- STEP: 29/50 -- GLOBAL_STEP: 65580 | > loss_disc: 2.420339584350586 (2.3750949152584733) | > loss_disc_real_0: 0.061621733009815216 (0.15244911068343914) | > loss_disc_real_1: 0.252997487783432 (0.21587044540150413) | > loss_disc_real_2: 0.19414600729942322 (0.21833592871653623) | > loss_disc_real_3: 0.2026386857032776 (0.2389328116229896) | > loss_disc_real_4: 0.43151289224624634 (0.2365214713720669) | > loss_disc_real_5: 0.4529201090335846 (0.22852811146655988) | > loss_0: 2.420339584350586 (2.3750949152584733) | > grad_norm_0: tensor(1074.9797, device='cuda:0') (tensor(1259.2139, device='cuda:0')) | > loss_gen: 2.876171588897705 (2.6134243504754426) | > loss_kl: 0.7642777562141418 (0.9507412088328394) | > loss_feat: 5.329592227935791 (6.586951806627471) | > loss_mel: 24.76673126220703 (25.529166550471864) | > loss_duration: 1.5744144916534424 (1.6300521842364608) | > loss_1: 35.311187744140625 (37.31033601432011) | > grad_norm_1: tensor(28032.0859, device='cuda:0') (tensor(55334.2188, device='cuda:0')) | > current_lr_0: 0.00015560203308229834 | > current_lr_1: 0.00015560203308229834 | > step_time: 0.6884 (0.48540514090965536) | > loader_time: 0.0247 (0.009985882660438275)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.977818489074707 (1.977818489074707) | > loss_disc_real_0: 0.09563332796096802 (0.09563332796096802) | > loss_disc_real_1: 0.15090717375278473 (0.15090717375278473) | > loss_disc_real_2: 0.09864025563001633 (0.09864025563001633) | > loss_disc_real_3: 0.3461202085018158 (0.3461202085018158) | > loss_disc_real_4: 0.027731837704777718 (0.027731837704777718) | > loss_disc_real_5: 0.02655917778611183 (0.02655917778611183) | > loss_0: 1.977818489074707 (1.977818489074707) | > loss_gen: 2.556398868560791 (2.556398868560791) | > loss_kl: 2.4936838150024414 (2.4936838150024414) | > loss_feat: 8.904182434082031 (8.904182434082031) | > loss_mel: 26.282072067260742 (26.282072067260742) | > loss_duration: 2.3187994956970215 (2.3187994956970215) | > loss_1: 42.555137634277344 (42.555137634277344)  --> STEP: 1 | > loss_disc: 2.019693374633789 (2.019693374633789) | > loss_disc_real_0: 0.17447204887866974 (0.17447204887866974) | > loss_disc_real_1: 0.22558677196502686 (0.22558677196502686) | > loss_disc_real_2: 0.24591465294361115 (0.24591465294361115) | > loss_disc_real_3: 0.22450311481952667 (0.22450311481952667) | > loss_disc_real_4: 0.14923302829265594 (0.14923302829265594) | > loss_disc_real_5: 0.17922572791576385 (0.17922572791576385) | > loss_0: 2.019693374633789 (2.019693374633789) | > loss_gen: 2.6795647144317627 (2.6795647144317627) | > loss_kl: 2.7983930110931396 (2.7983930110931396) | > loss_feat: 6.572774887084961 (6.572774887084961) | > loss_mel: 23.26805305480957 (23.26805305480957) | > loss_duration: 2.495224952697754 (2.495224952697754) | > loss_1: 37.81401062011719 (37.81401062011719)  --> STEP: 2 | > loss_disc: 1.6822432279586792 (1.8509683012962341) | > loss_disc_real_0: 0.11622130870819092 (0.14534667879343033) | > loss_disc_real_1: 0.1434335857629776 (0.18451017886400223) | > loss_disc_real_2: 0.041637152433395386 (0.14377590268850327) | > loss_disc_real_3: 0.16706092655658722 (0.19578202068805695) | > loss_disc_real_4: 0.03097933903336525 (0.0901061836630106) | > loss_disc_real_5: 0.051572468131780624 (0.11539909802377224) | > loss_0: 1.6822432279586792 (1.8509683012962341) | > loss_gen: 2.833672046661377 (2.75661838054657) | > loss_kl: 3.325181484222412 (3.061787247657776) | > loss_feat: 12.414163589477539 (9.49346923828125) | > loss_mel: 22.4416561126709 (22.854854583740234) | > loss_duration: 2.447582483291626 (2.47140371799469) | > loss_1: 43.46225357055664 (40.638132095336914)  --> STEP: 3 | > loss_disc: 3.195833206176758 (2.299256602923075) | > loss_disc_real_0: 0.5281909108161926 (0.27296142280101776) | > loss_disc_real_1: 0.3056868612766266 (0.22490240633487701) | > loss_disc_real_2: 0.44680988788604736 (0.24478723108768463) | > loss_disc_real_3: 0.36162495613098145 (0.2510629991690318) | > loss_disc_real_4: 0.3516094386577606 (0.17727393532792726) | > loss_disc_real_5: 0.39588725566864014 (0.20889515057206154) | > loss_0: 3.195833206176758 (2.299256602923075) | > loss_gen: 2.5451149940490723 (2.686117251714071) | > loss_kl: 1.4432634115219116 (2.5222793022791543) | > loss_feat: 1.7329890727996826 (6.906642516454061) | > loss_mel: 21.191911697387695 (22.300540288289387) | > loss_duration: 2.4481101036071777 (2.463639179865519) | > loss_1: 29.36138916015625 (36.879217783610024) --> EVAL PERFORMANCE | > avg_loader_time: 0.014826456705729166 (+0.004532337188720703) | > avg_loss_disc: 2.299256602923075 (-0.3265494108200073) | > avg_loss_disc_real_0: 0.27296142280101776 (-0.007587427894274412) | > avg_loss_disc_real_1: 0.22490240633487701 (-0.07619859278202057) | > avg_loss_disc_real_2: 0.24478723108768463 (+0.025193259119987488) | > avg_loss_disc_real_3: 0.2510629991690318 (+0.013584151864051847) | > avg_loss_disc_real_4: 0.17727393532792726 (-0.11362641428907713) | > avg_loss_disc_real_5: 0.20889515057206154 (-0.08627303068836528) | > avg_loss_0: 2.299256602923075 (-0.3265494108200073) | > avg_loss_gen: 2.686117251714071 (+0.24776959419250488) | > avg_loss_kl: 2.5222793022791543 (-0.42587995529174805) | > avg_loss_feat: 6.906642516454061 (+2.167567054430643) | > avg_loss_mel: 22.300540288289387 (-1.3410898844401054) | > avg_loss_duration: 2.463639179865519 (+0.028256018956501983) | > avg_loss_1: 36.879217783610024 (+0.6766211191813127)  > EPOCH: 252/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:24:21)   --> TIME: 2023-10-20 02:24:31 -- STEP: 9/50 -- GLOBAL_STEP: 65610 | > loss_disc: 2.4096462726593018 (2.0539848274654813) | > loss_disc_real_0: 0.26666224002838135 (0.16787928508387673) | > loss_disc_real_1: 0.3662675619125366 (0.21806929922766155) | > loss_disc_real_2: 0.23285715281963348 (0.2371401372883055) | > loss_disc_real_3: 0.3629269003868103 (0.2847775916258494) | > loss_disc_real_4: 0.20398980379104614 (0.12773173923293749) | > loss_disc_real_5: 0.2384043186903 (0.2086084791355663) | > loss_0: 2.4096462726593018 (2.0539848274654813) | > grad_norm_0: tensor(1250.8801, device='cuda:0') (tensor(1242.0634, device='cuda:0')) | > loss_gen: 2.8567075729370117 (3.0093741416931152) | > loss_kl: 0.8820934891700745 (0.8829146027565002) | > loss_feat: 4.996235370635986 (8.029016123877632) | > loss_mel: 27.526166915893555 (26.203196843465168) | > loss_duration: 1.587633490562439 (1.6038413577609592) | > loss_1: 37.848838806152344 (39.72834226820204) | > grad_norm_1: tensor(11329.9092, device='cuda:0') (tensor(24214.7402, device='cuda:0')) | > current_lr_0: 0.00015544649910808912 | > current_lr_1: 0.00015544649910808912 | > step_time: 0.572 (0.5081962214575874) | > loader_time: 0.0044 (0.022195392184787326)  --> TIME: 2023-10-20 02:24:42 -- STEP: 39/50 -- GLOBAL_STEP: 65640 | > loss_disc: 2.0369064807891846 (2.4235485211396828) | > loss_disc_real_0: 0.05140499398112297 (0.16748744822465456) | > loss_disc_real_1: 0.19818007946014404 (0.2182648378687027) | > loss_disc_real_2: 0.3750382363796234 (0.22053509167371652) | > loss_disc_real_3: 0.3590938150882721 (0.2441758182950509) | > loss_disc_real_4: 0.05872098729014397 (0.22863942442032006) | > loss_disc_real_5: 0.13447575271129608 (0.219698772025414) | > loss_0: 2.0369064807891846 (2.4235485211396828) | > grad_norm_0: tensor(1545.2206, device='cuda:0') (tensor(1220.1978, device='cuda:0')) | > loss_gen: 3.2344255447387695 (2.4771748078175087) | > loss_kl: 0.4882619380950928 (0.918322008389693) | > loss_feat: 6.843260765075684 (6.093644170329357) | > loss_mel: 26.97658348083496 (25.146222481360798) | > loss_duration: 1.6492669582366943 (1.6168183516233394) | > loss_1: 39.191795349121094 (36.252181957929565) | > grad_norm_1: tensor(74493.5156, device='cuda:0') (tensor(28661.9082, device='cuda:0')) | > current_lr_0: 0.00015544649910808912 | > current_lr_1: 0.00015544649910808912 | > step_time: 0.2615 (0.38573604363661546) | > loader_time: 0.0024 (0.010871661015045948)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6261813640594482 (2.6261813640594482) | > loss_disc_real_0: 0.19297191500663757 (0.19297191500663757) | > loss_disc_real_1: 0.39470192790031433 (0.39470192790031433) | > loss_disc_real_2: 0.20832093060016632 (0.20832093060016632) | > loss_disc_real_3: 0.20712536573410034 (0.20712536573410034) | > loss_disc_real_4: 0.29348716139793396 (0.29348716139793396) | > loss_disc_real_5: 0.24986962974071503 (0.24986962974071503) | > loss_0: 2.6261813640594482 (2.6261813640594482) | > loss_gen: 2.1403045654296875 (2.1403045654296875) | > loss_kl: 2.5066890716552734 (2.5066890716552734) | > loss_feat: 2.9630050659179688 (2.9630050659179688) | > loss_mel: 29.834217071533203 (29.834217071533203) | > loss_duration: 2.210502862930298 (2.210502862930298) | > loss_1: 39.65471649169922 (39.65471649169922)  --> STEP: 1 | > loss_disc: 2.604098081588745 (2.604098081588745) | > loss_disc_real_0: 0.2565620541572571 (0.2565620541572571) | > loss_disc_real_1: 0.36336418986320496 (0.36336418986320496) | > loss_disc_real_2: 0.2597898840904236 (0.2597898840904236) | > loss_disc_real_3: 0.21986760199069977 (0.21986760199069977) | > loss_disc_real_4: 0.2562331557273865 (0.2562331557273865) | > loss_disc_real_5: 0.36575281620025635 (0.36575281620025635) | > loss_0: 2.604098081588745 (2.604098081588745) | > loss_gen: 2.5951671600341797 (2.5951671600341797) | > loss_kl: 3.309893846511841 (3.309893846511841) | > loss_feat: 4.094870090484619 (4.094870090484619) | > loss_mel: 25.94504737854004 (25.94504737854004) | > loss_duration: 2.3840577602386475 (2.3840577602386475) | > loss_1: 38.32903289794922 (38.32903289794922)  --> STEP: 2 | > loss_disc: 2.349268674850464 (2.4766833782196045) | > loss_disc_real_0: 0.16011908650398254 (0.2083405703306198) | > loss_disc_real_1: 0.11539530754089355 (0.23937974870204926) | > loss_disc_real_2: 0.09205909073352814 (0.17592448741197586) | > loss_disc_real_3: 0.18194247782230377 (0.20090503990650177) | > loss_disc_real_4: 0.1458335518836975 (0.201033353805542) | > loss_disc_real_5: 0.18610331416130066 (0.2759280651807785) | > loss_0: 2.349268674850464 (2.4766833782196045) | > loss_gen: 2.0397136211395264 (2.317440390586853) | > loss_kl: 3.5459561347961426 (3.4279249906539917) | > loss_feat: 7.924863815307617 (6.009866952896118) | > loss_mel: 27.983959197998047 (26.964503288269043) | > loss_duration: 2.3897688388824463 (2.386913299560547) | > loss_1: 43.8842658996582 (41.10664939880371)  --> STEP: 3 | > loss_disc: 1.9043657779693604 (2.2859108448028564) | > loss_disc_real_0: 0.13069075345993042 (0.18245729804039001) | > loss_disc_real_1: 0.18062496185302734 (0.21979481975237528) | > loss_disc_real_2: 0.1667519211769104 (0.1728669653336207) | > loss_disc_real_3: 0.11978442966938019 (0.1738648364941279) | > loss_disc_real_4: 0.07969949394464493 (0.16058873385190964) | > loss_disc_real_5: 0.025522174313664436 (0.19245943489174047) | > loss_0: 1.9043657779693604 (2.2859108448028564) | > loss_gen: 1.9448596239089966 (2.1932468016942344) | > loss_kl: 1.6583250761032104 (2.838058352470398) | > loss_feat: 4.988450527191162 (5.669394810994466) | > loss_mel: 22.133878707885742 (25.35429509480794) | > loss_duration: 2.3130836486816406 (2.3623034159342446) | > loss_1: 33.038597106933594 (38.41729863484701) --> EVAL PERFORMANCE | > avg_loader_time: 0.002117713292439779 (-0.012708743413289387) | > avg_loss_disc: 2.2859108448028564 (-0.013345758120218765) | > avg_loss_disc_real_0: 0.18245729804039001 (-0.09050412476062775) | > avg_loss_disc_real_1: 0.21979481975237528 (-0.005107586582501739) | > avg_loss_disc_real_2: 0.1728669653336207 (-0.07192026575406393) | > avg_loss_disc_real_3: 0.1738648364941279 (-0.0771981626749039) | > avg_loss_disc_real_4: 0.16058873385190964 (-0.016685201476017625) | > avg_loss_disc_real_5: 0.19245943489174047 (-0.016435715680321067) | > avg_loss_0: 2.2859108448028564 (-0.013345758120218765) | > avg_loss_gen: 2.1932468016942344 (-0.4928704500198364) | > avg_loss_kl: 2.838058352470398 (+0.31577905019124364) | > avg_loss_feat: 5.669394810994466 (-1.2372477054595947) | > avg_loss_mel: 25.35429509480794 (+3.0537548065185547) | > avg_loss_duration: 2.3623034159342446 (-0.10133576393127441) | > avg_loss_1: 38.41729863484701 (+1.538080851236984)  > EPOCH: 253/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:24:59)   --> TIME: 2023-10-20 02:25:13 -- STEP: 19/50 -- GLOBAL_STEP: 65670 | > loss_disc: 2.0071892738342285 (2.276447001256441) | > loss_disc_real_0: 0.08031396567821503 (0.1372596410740363) | > loss_disc_real_1: 0.21092303097248077 (0.22884066638193631) | > loss_disc_real_2: 0.2910940647125244 (0.19815514256295405) | > loss_disc_real_3: 0.11698450893163681 (0.2150716593391017) | > loss_disc_real_4: 0.23999354243278503 (0.25013274395544277) | > loss_disc_real_5: 0.1720956265926361 (0.23094041449458977) | > loss_0: 2.0071892738342285 (2.276447001256441) | > grad_norm_0: tensor(1014.9410, device='cuda:0') (tensor(1079.8837, device='cuda:0')) | > loss_gen: 2.8434786796569824 (2.6073845122989856) | > loss_kl: 0.8271673917770386 (0.9989109635353088) | > loss_feat: 6.546543121337891 (6.473628303330195) | > loss_mel: 25.76634407043457 (23.453160863173636) | > loss_duration: 1.7370829582214355 (1.664887735718175) | > loss_1: 37.72061538696289 (35.19797257373207) | > grad_norm_1: tensor(30607.4355, device='cuda:0') (tensor(44791.0938, device='cuda:0')) | > current_lr_0: 0.00015529112059982505 | > current_lr_1: 0.00015529112059982505 | > step_time: 0.3318 (0.4930066183993691) | > loader_time: 0.0254 (0.02003315875404759)  --> TIME: 2023-10-20 02:25:29 -- STEP: 49/50 -- GLOBAL_STEP: 65700 | > loss_disc: 3.060739517211914 (2.3525693173311195) | > loss_disc_real_0: 0.11327953636646271 (0.1477467799749301) | > loss_disc_real_1: 0.3123905062675476 (0.2268290760337698) | > loss_disc_real_2: 0.24505077302455902 (0.21886979834157594) | > loss_disc_real_3: 0.3346126079559326 (0.22519350173522015) | > loss_disc_real_4: 0.27559298276901245 (0.2239136168239068) | > loss_disc_real_5: 0.27634087204933167 (0.21475047511713846) | > loss_0: 3.060739517211914 (2.3525693173311195) | > grad_norm_0: tensor(1334.5226, device='cuda:0') (tensor(1018.9659, device='cuda:0')) | > loss_gen: 1.6607407331466675 (2.4670834419678673) | > loss_kl: 0.8182460069656372 (0.932467829284011) | > loss_feat: 0.16515402495861053 (5.734459675620405) | > loss_mel: 17.30424690246582 (23.102011836304953) | > loss_duration: 1.747563123703003 (1.633191137897725) | > loss_1: 21.69594955444336 (33.86921335726369) | > grad_norm_1: tensor(66702.6953, device='cuda:0') (tensor(37425.4219, device='cuda:0')) | > current_lr_0: 0.00015529112059982505 | > current_lr_1: 0.00015529112059982505 | > step_time: 0.6278 (0.4984276197394546) | > loader_time: 0.3399 (0.026405178770727046)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8236424922943115 (2.8236424922943115) | > loss_disc_real_0: 0.03981690853834152 (0.03981690853834152) | > loss_disc_real_1: 0.16983836889266968 (0.16983836889266968) | > loss_disc_real_2: 0.3730390965938568 (0.3730390965938568) | > loss_disc_real_3: 0.36372286081314087 (0.36372286081314087) | > loss_disc_real_4: 0.34872204065322876 (0.34872204065322876) | > loss_disc_real_5: 0.35664188861846924 (0.35664188861846924) | > loss_0: 2.8236424922943115 (2.8236424922943115) | > loss_gen: 2.1317596435546875 (2.1317596435546875) | > loss_kl: 2.257009506225586 (2.257009506225586) | > loss_feat: 5.307076454162598 (5.307076454162598) | > loss_mel: 26.816776275634766 (26.816776275634766) | > loss_duration: 2.2537827491760254 (2.2537827491760254) | > loss_1: 38.76640701293945 (38.76640701293945)  --> STEP: 1 | > loss_disc: 2.9351119995117188 (2.9351119995117188) | > loss_disc_real_0: 0.1940039098262787 (0.1940039098262787) | > loss_disc_real_1: 0.31597602367401123 (0.31597602367401123) | > loss_disc_real_2: 0.23981374502182007 (0.23981374502182007) | > loss_disc_real_3: 0.33983314037323 (0.33983314037323) | > loss_disc_real_4: 0.27062755823135376 (0.27062755823135376) | > loss_disc_real_5: 0.2717779576778412 (0.2717779576778412) | > loss_0: 2.9351119995117188 (2.9351119995117188) | > loss_gen: 1.7289175987243652 (1.7289175987243652) | > loss_kl: 2.8895018100738525 (2.8895018100738525) | > loss_feat: 0.28956764936447144 (0.28956764936447144) | > loss_mel: 12.989392280578613 (12.989392280578613) | > loss_duration: 2.4706029891967773 (2.4706029891967773) | > loss_1: 20.36798095703125 (20.36798095703125)  --> STEP: 2 | > loss_disc: 2.2524497509002686 (2.5937808752059937) | > loss_disc_real_0: 0.11209844052791595 (0.15305117517709732) | > loss_disc_real_1: 0.28276267647743225 (0.29936935007572174) | > loss_disc_real_2: 0.24430784583091736 (0.2420607954263687) | > loss_disc_real_3: 0.43152549862861633 (0.38567931950092316) | > loss_disc_real_4: 0.23543667793273926 (0.2530321180820465) | > loss_disc_real_5: 0.11041155457496643 (0.1910947561264038) | > loss_0: 2.2524497509002686 (2.5937808752059937) | > loss_gen: 2.777362823486328 (2.2531402111053467) | > loss_kl: 3.142472505569458 (3.0159871578216553) | > loss_feat: 5.641774654388428 (2.9656711518764496) | > loss_mel: 26.101633071899414 (19.545512676239014) | > loss_duration: 2.394113779067993 (2.4323583841323853) | > loss_1: 40.05735778808594 (30.212669372558594)  --> STEP: 3 | > loss_disc: 1.9117265939712524 (2.3664294481277466) | > loss_disc_real_0: 0.2549947500228882 (0.18703236679236093) | > loss_disc_real_1: 0.2283342331647873 (0.2756909777720769) | > loss_disc_real_2: 0.2246946096420288 (0.23627206683158875) | > loss_disc_real_3: 0.2535663843154907 (0.34164167443911236) | > loss_disc_real_4: 0.17262980341911316 (0.22623134652773538) | > loss_disc_real_5: 0.2394905835390091 (0.20722669859727225) | > loss_0: 1.9117265939712524 (2.3664294481277466) | > loss_gen: 3.5793886184692383 (2.695223013559977) | > loss_kl: 1.994472622871399 (2.6754823128382363) | > loss_feat: 7.190520286560059 (4.373954196770986) | > loss_mel: 24.88263511657715 (21.32455348968506) | > loss_duration: 2.44683575630188 (2.4371841748555503) | > loss_1: 40.093849182128906 (33.506395975748696) --> EVAL PERFORMANCE | > avg_loader_time: 0.013790527979532877 (+0.011672814687093098) | > avg_loss_disc: 2.3664294481277466 (+0.08051860332489014) | > avg_loss_disc_real_0: 0.18703236679236093 (+0.004575068751970918) | > avg_loss_disc_real_1: 0.2756909777720769 (+0.05589615801970163) | > avg_loss_disc_real_2: 0.23627206683158875 (+0.06340510149796805) | > avg_loss_disc_real_3: 0.34164167443911236 (+0.16777683794498446) | > avg_loss_disc_real_4: 0.22623134652773538 (+0.06564261267582575) | > avg_loss_disc_real_5: 0.20722669859727225 (+0.014767263705531775) | > avg_loss_0: 2.3664294481277466 (+0.08051860332489014) | > avg_loss_gen: 2.695223013559977 (+0.5019762118657427) | > avg_loss_kl: 2.6754823128382363 (-0.1625760396321616) | > avg_loss_feat: 4.373954196770986 (-1.2954406142234802) | > avg_loss_mel: 21.32455348968506 (-4.029741605122883) | > avg_loss_duration: 2.4371841748555503 (+0.07488075892130563) | > avg_loss_1: 33.506395975748696 (-4.910902659098312)  > EPOCH: 254/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:25:40)   --> TIME: 2023-10-20 02:25:59 -- STEP: 29/50 -- GLOBAL_STEP: 65730 | > loss_disc: 2.520059823989868 (2.2057398516556312) | > loss_disc_real_0: 0.07520817220211029 (0.13283302750566908) | > loss_disc_real_1: 0.2761840522289276 (0.219352875804079) | > loss_disc_real_2: 0.35861459374427795 (0.2281039235149992) | > loss_disc_real_3: 0.2665477991104126 (0.25964413030908023) | > loss_disc_real_4: 0.3603685796260834 (0.2133928178970156) | > loss_disc_real_5: 0.5391550660133362 (0.21199843197547155) | > loss_0: 2.520059823989868 (2.2057398516556312) | > grad_norm_0: tensor(766.8159, device='cuda:0') (tensor(847.8689, device='cuda:0')) | > loss_gen: 2.9481701850891113 (2.817821206717656) | > loss_kl: 0.6441953182220459 (1.0381899311624725) | > loss_feat: 6.181766033172607 (6.675533480942249) | > loss_mel: 22.43476104736328 (22.502314320926008) | > loss_duration: 1.5910062789916992 (1.6464405594200924) | > loss_1: 33.79990005493164 (34.680299331401955) | > grad_norm_1: tensor(44925.0312, device='cuda:0') (tensor(51793.6250, device='cuda:0')) | > current_lr_0: 0.00015513589740210815 | > current_lr_1: 0.00015513589740210815 | > step_time: 0.3087 (0.49671981252472974) | > loader_time: 0.0244 (0.013494343593202788)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7312612533569336 (2.7312612533569336) | > loss_disc_real_0: 0.10966615378856659 (0.10966615378856659) | > loss_disc_real_1: 0.2462589144706726 (0.2462589144706726) | > loss_disc_real_2: 0.13234607875347137 (0.13234607875347137) | > loss_disc_real_3: 0.27933409810066223 (0.27933409810066223) | > loss_disc_real_4: 0.25407981872558594 (0.25407981872558594) | > loss_disc_real_5: 0.2651297450065613 (0.2651297450065613) | > loss_0: 2.7312612533569336 (2.7312612533569336) | > loss_gen: 1.5932550430297852 (1.5932550430297852) | > loss_kl: 3.4593801498413086 (3.4593801498413086) | > loss_feat: 0.9339503049850464 (0.9339503049850464) | > loss_mel: 15.140665054321289 (15.140665054321289) | > loss_duration: 2.3917691707611084 (2.3917691707611084) | > loss_1: 23.519020080566406 (23.519020080566406)  --> STEP: 1 | > loss_disc: 2.3837180137634277 (2.3837180137634277) | > loss_disc_real_0: 0.29859429597854614 (0.29859429597854614) | > loss_disc_real_1: 0.13930009305477142 (0.13930009305477142) | > loss_disc_real_2: 0.14410217106342316 (0.14410217106342316) | > loss_disc_real_3: 0.3074456751346588 (0.3074456751346588) | > loss_disc_real_4: 0.3939647376537323 (0.3939647376537323) | > loss_disc_real_5: 0.2593909502029419 (0.2593909502029419) | > loss_0: 2.3837180137634277 (2.3837180137634277) | > loss_gen: 4.233015060424805 (4.233015060424805) | > loss_kl: 3.0947377681732178 (3.0947377681732178) | > loss_feat: 7.127744197845459 (7.127744197845459) | > loss_mel: 28.351085662841797 (28.351085662841797) | > loss_duration: 2.470738410949707 (2.470738410949707) | > loss_1: 45.27731704711914 (45.27731704711914)  --> STEP: 2 | > loss_disc: 2.5015478134155273 (2.4426329135894775) | > loss_disc_real_0: 0.1700805276632309 (0.23433741182088852) | > loss_disc_real_1: 0.27837786078453064 (0.20883897691965103) | > loss_disc_real_2: 0.2141377031803131 (0.17911993712186813) | > loss_disc_real_3: 0.31386029720306396 (0.3106529861688614) | > loss_disc_real_4: 0.22952339053153992 (0.3117440640926361) | > loss_disc_real_5: 0.23411822319030762 (0.24675458669662476) | > loss_0: 2.5015478134155273 (2.4426329135894775) | > loss_gen: 2.3563146591186523 (3.2946648597717285) | > loss_kl: 3.3039095401763916 (3.1993236541748047) | > loss_feat: 6.981222629547119 (7.054483413696289) | > loss_mel: 23.378591537475586 (25.86483860015869) | > loss_duration: 2.4088706970214844 (2.4398045539855957) | > loss_1: 38.42890930175781 (41.85311317443848)  --> STEP: 3 | > loss_disc: 2.831387996673584 (2.5722179412841797) | > loss_disc_real_0: 0.12418649345636368 (0.19762043903271356) | > loss_disc_real_1: 0.2463400661945343 (0.22133934001127878) | > loss_disc_real_2: 0.13256384432315826 (0.1636012395222982) | > loss_disc_real_3: 0.27873092889785767 (0.30001230041186017) | > loss_disc_real_4: 0.25423896312713623 (0.29257569710413617) | > loss_disc_real_5: 0.2651250660419464 (0.252878079811732) | > loss_0: 2.831387996673584 (2.5722179412841797) | > loss_gen: 1.479224443435669 (2.6895180543263755) | > loss_kl: 1.6775133609771729 (2.6920535564422607) | > loss_feat: 0.684852123260498 (4.931272983551025) | > loss_mel: 3.9805104732513428 (18.570062557856243) | > loss_duration: 2.3436386585235596 (2.4077492554982505) | > loss_1: 10.165739059448242 (31.2906551361084) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027048587799072266 (-0.01108566919962565) | > avg_loss_disc: 2.5722179412841797 (+0.2057884931564331) | > avg_loss_disc_real_0: 0.19762043903271356 (+0.01058807224035263) | > avg_loss_disc_real_1: 0.22133934001127878 (-0.05435163776079813) | > avg_loss_disc_real_2: 0.1636012395222982 (-0.07267082730929056) | > avg_loss_disc_real_3: 0.30001230041186017 (-0.0416293740272522) | > avg_loss_disc_real_4: 0.29257569710413617 (+0.06634435057640078) | > avg_loss_disc_real_5: 0.252878079811732 (+0.045651381214459746) | > avg_loss_0: 2.5722179412841797 (+0.2057884931564331) | > avg_loss_gen: 2.6895180543263755 (-0.005704959233601592) | > avg_loss_kl: 2.6920535564422607 (+0.0165712436040244) | > avg_loss_feat: 4.931272983551025 (+0.5573187867800398) | > avg_loss_mel: 18.570062557856243 (-2.7544909318288155) | > avg_loss_duration: 2.4077492554982505 (-0.029434919357299805) | > avg_loss_1: 31.2906551361084 (-2.215740839640297)  > EPOCH: 255/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:26:19)   --> TIME: 2023-10-20 02:26:27 -- STEP: 9/50 -- GLOBAL_STEP: 65760 | > loss_disc: 3.1671998500823975 (2.2001701725853815) | > loss_disc_real_0: 0.33754289150238037 (0.09428105337752236) | > loss_disc_real_1: 0.3645557463169098 (0.1997580002579424) | > loss_disc_real_2: 0.33243444561958313 (0.18911685484151045) | > loss_disc_real_3: 0.3970881402492523 (0.23659412190318108) | > loss_disc_real_4: 0.39863234758377075 (0.21748520019981596) | > loss_disc_real_5: 0.4109518527984619 (0.24458668525848123) | > loss_0: 3.1671998500823975 (2.2001701725853815) | > grad_norm_0: tensor(900.2842, device='cuda:0') (tensor(1058.4978, device='cuda:0')) | > loss_gen: 2.498321771621704 (2.846679210662842) | > loss_kl: 0.6075486540794373 (0.9197331137127347) | > loss_feat: 3.183736562728882 (8.048694637086657) | > loss_mel: 21.675996780395508 (25.188714769151474) | > loss_duration: 1.543682336807251 (1.6029157771004572) | > loss_1: 29.50928497314453 (38.606737772623696) | > grad_norm_1: tensor(8229.3389, device='cuda:0') (tensor(61046.5820, device='cuda:0')) | > current_lr_0: 0.00015498082935969576 | > current_lr_1: 0.00015498082935969576 | > step_time: 0.5784 (0.5033121903737386) | > loader_time: 0.0245 (0.020832591586642794)  --> TIME: 2023-10-20 02:26:39 -- STEP: 39/50 -- GLOBAL_STEP: 65790 | > loss_disc: 2.5967392921447754 (2.390681624412536) | > loss_disc_real_0: 0.3984556794166565 (0.14605421477403396) | > loss_disc_real_1: 0.19818127155303955 (0.22265745556125274) | > loss_disc_real_2: 0.1785591095685959 (0.19859678532259584) | > loss_disc_real_3: 0.19876648485660553 (0.23071313104950464) | > loss_disc_real_4: 0.13651280105113983 (0.21765042359057146) | > loss_disc_real_5: 0.1647145301103592 (0.2205330662859174) | > loss_0: 2.5967392921447754 (2.390681624412536) | > grad_norm_0: tensor(2053.0266, device='cuda:0') (tensor(1426.3470, device='cuda:0')) | > loss_gen: 3.022930860519409 (2.439815701582493) | > loss_kl: 0.7384803891181946 (0.9724025405370272) | > loss_feat: 5.75670051574707 (5.756611973811418) | > loss_mel: 23.211227416992188 (22.817366520563763) | > loss_duration: 1.6371564865112305 (1.6103088366679656) | > loss_1: 34.36649703979492 (33.59650523845966) | > grad_norm_1: tensor(67579.6016, device='cuda:0') (tensor(42465.1523, device='cuda:0')) | > current_lr_0: 0.00015498082935969576 | > current_lr_1: 0.00015498082935969576 | > step_time: 0.2582 (0.41104732415614986) | > loader_time: 0.0026 (0.010869203469692135)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.807847023010254 (2.807847023010254) | > loss_disc_real_0: 0.13268673419952393 (0.13268673419952393) | > loss_disc_real_1: 0.31383222341537476 (0.31383222341537476) | > loss_disc_real_2: 0.31854355335235596 (0.31854355335235596) | > loss_disc_real_3: 0.34321853518486023 (0.34321853518486023) | > loss_disc_real_4: 0.286173939704895 (0.286173939704895) | > loss_disc_real_5: 0.1578700691461563 (0.1578700691461563) | > loss_0: 2.807847023010254 (2.807847023010254) | > loss_gen: 2.0599803924560547 (2.0599803924560547) | > loss_kl: 2.581407308578491 (2.581407308578491) | > loss_feat: 4.227526664733887 (4.227526664733887) | > loss_mel: 24.446556091308594 (24.446556091308594) | > loss_duration: 2.335855007171631 (2.335855007171631) | > loss_1: 35.65132141113281 (35.65132141113281)  --> STEP: 1 | > loss_disc: 2.2498857975006104 (2.2498857975006104) | > loss_disc_real_0: 0.15062430500984192 (0.15062430500984192) | > loss_disc_real_1: 0.2238195687532425 (0.2238195687532425) | > loss_disc_real_2: 0.23142538964748383 (0.23142538964748383) | > loss_disc_real_3: 0.21974080801010132 (0.21974080801010132) | > loss_disc_real_4: 0.2306164801120758 (0.2306164801120758) | > loss_disc_real_5: 0.22663027048110962 (0.22663027048110962) | > loss_0: 2.2498857975006104 (2.2498857975006104) | > loss_gen: 2.342773914337158 (2.342773914337158) | > loss_kl: 3.1454882621765137 (3.1454882621765137) | > loss_feat: 6.496131420135498 (6.496131420135498) | > loss_mel: 24.27655792236328 (24.27655792236328) | > loss_duration: 2.5659492015838623 (2.5659492015838623) | > loss_1: 38.826900482177734 (38.826900482177734)  --> STEP: 2 | > loss_disc: 3.0410494804382324 (2.6454676389694214) | > loss_disc_real_0: 0.4574747085571289 (0.3040495067834854) | > loss_disc_real_1: 0.25381624698638916 (0.23881790786981583) | > loss_disc_real_2: 0.2746734619140625 (0.25304942578077316) | > loss_disc_real_3: 0.24370034039020538 (0.23172057420015335) | > loss_disc_real_4: 0.24467802047729492 (0.23764725029468536) | > loss_disc_real_5: 0.33465537428855896 (0.2806428223848343) | > loss_0: 3.0410494804382324 (2.6454676389694214) | > loss_gen: 1.8579469919204712 (2.1003604531288147) | > loss_kl: 3.4347262382507324 (3.290107250213623) | > loss_feat: 0.14249110221862793 (3.319311261177063) | > loss_mel: 5.461059093475342 (14.868808507919312) | > loss_duration: 2.4976437091827393 (2.531796455383301) | > loss_1: 13.393867492675781 (26.110383987426758)  --> STEP: 3 | > loss_disc: 2.021026134490967 (2.4373204708099365) | > loss_disc_real_0: 0.12168539315462112 (0.24326146890719733) | > loss_disc_real_1: 0.16231109201908112 (0.21331563591957092) | > loss_disc_real_2: 0.31429964303970337 (0.27346616486708325) | > loss_disc_real_3: 0.21773533523082733 (0.22705882787704468) | > loss_disc_real_4: 0.036401424556970596 (0.17056530838211378) | > loss_disc_real_5: 0.35796263813972473 (0.3064160943031311) | > loss_0: 2.021026134490967 (2.4373204708099365) | > loss_gen: 2.786048412322998 (2.3289231061935425) | > loss_kl: 1.4735842943191528 (2.6845995982488) | > loss_feat: 7.611443519592285 (4.750022013982137) | > loss_mel: 26.145545959472656 (18.627720991770428) | > loss_duration: 2.42175555229187 (2.4951161543528237) | > loss_1: 40.43838119506836 (30.886383056640625) --> EVAL PERFORMANCE | > avg_loader_time: 0.013392289479573568 (+0.010687430699666342) | > avg_loss_disc: 2.4373204708099365 (-0.13489747047424316) | > avg_loss_disc_real_0: 0.24326146890719733 (+0.04564102987448376) | > avg_loss_disc_real_1: 0.21331563591957092 (-0.008023704091707856) | > avg_loss_disc_real_2: 0.27346616486708325 (+0.10986492534478506) | > avg_loss_disc_real_3: 0.22705882787704468 (-0.07295347253481549) | > avg_loss_disc_real_4: 0.17056530838211378 (-0.12201038872202238) | > avg_loss_disc_real_5: 0.3064160943031311 (+0.05353801449139911) | > avg_loss_0: 2.4373204708099365 (-0.13489747047424316) | > avg_loss_gen: 2.3289231061935425 (-0.360594948132833) | > avg_loss_kl: 2.6845995982488 (-0.007453958193460952) | > avg_loss_feat: 4.750022013982137 (-0.18125096956888864) | > avg_loss_mel: 18.627720991770428 (+0.05765843391418457) | > avg_loss_duration: 2.4951161543528237 (+0.08736689885457327) | > avg_loss_1: 30.886383056640625 (-0.40427207946777344)  > EPOCH: 256/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:26:56)   --> TIME: 2023-10-20 02:27:10 -- STEP: 19/50 -- GLOBAL_STEP: 65820 | > loss_disc: 2.4593825340270996 (2.30243046032755) | > loss_disc_real_0: 0.020582828670740128 (0.14862373461456677) | > loss_disc_real_1: 0.3246631622314453 (0.22374571389273593) | > loss_disc_real_2: 0.15505316853523254 (0.21462201483939825) | > loss_disc_real_3: 0.3426000475883484 (0.24425856259308362) | > loss_disc_real_4: 0.11379143595695496 (0.22706278428239257) | > loss_disc_real_5: 0.129574716091156 (0.236713414031424) | > loss_0: 2.4593825340270996 (2.30243046032755) | > grad_norm_0: tensor(1449.7736, device='cuda:0') (tensor(1516.1581, device='cuda:0')) | > loss_gen: 2.4222421646118164 (2.7221708046762565) | > loss_kl: 1.05899178981781 (0.9747005868703127) | > loss_feat: 6.826348781585693 (6.181644994961588) | > loss_mel: 27.728534698486328 (23.482326356988203) | > loss_duration: 1.7563064098358154 (1.6386021814848248) | > loss_1: 39.792423248291016 (34.99944516232139) | > grad_norm_1: tensor(73353.6016, device='cuda:0') (tensor(44756.7070, device='cuda:0')) | > current_lr_0: 0.00015482591631750048 | > current_lr_1: 0.00015482591631750048 | > step_time: 0.5726 (0.5125870830134341) | > loader_time: 0.0058 (0.01711265664351614)  --> TIME: 2023-10-20 02:27:26 -- STEP: 49/50 -- GLOBAL_STEP: 65850 | > loss_disc: 1.6584746837615967 (2.4557523873387543) | > loss_disc_real_0: 0.19309034943580627 (0.16883591015119942) | > loss_disc_real_1: 0.11914189904928207 (0.22212390046642752) | > loss_disc_real_2: 0.10808707773685455 (0.22845228320481825) | > loss_disc_real_3: 0.09571758657693863 (0.24017204496325278) | > loss_disc_real_4: 0.1058700755238533 (0.22401756137533455) | > loss_disc_real_5: 0.18182867765426636 (0.24816252652327625) | > loss_0: 1.6584746837615967 (2.4557523873387543) | > grad_norm_0: tensor(1104.2137, device='cuda:0') (tensor(1364.5840, device='cuda:0')) | > loss_gen: 2.678981304168701 (2.431943467685154) | > loss_kl: 0.5492613315582275 (0.9249038992411628) | > loss_feat: 6.506624698638916 (5.005429012510849) | > loss_mel: 27.732666015625 (21.827200145137553) | > loss_duration: 1.7702935934066772 (1.6048519854642906) | > loss_1: 39.23782730102539 (31.794328855008505) | > grad_norm_1: tensor(64521.8398, device='cuda:0') (tensor(40833.1484, device='cuda:0')) | > current_lr_0: 0.00015482591631750048 | > current_lr_1: 0.00015482591631750048 | > step_time: 0.6541 (0.5016875704940484) | > loader_time: 0.3443 (0.025836822937945935)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5238893032073975 (1.5238893032073975) | > loss_disc_real_0: 0.02372078225016594 (0.02372078225016594) | > loss_disc_real_1: 0.06188336759805679 (0.06188336759805679) | > loss_disc_real_2: 0.06021546572446823 (0.06021546572446823) | > loss_disc_real_3: 0.061723653227090836 (0.061723653227090836) | > loss_disc_real_4: 0.06124020740389824 (0.06124020740389824) | > loss_disc_real_5: 0.08318302780389786 (0.08318302780389786) | > loss_0: 1.5238893032073975 (1.5238893032073975) | > loss_gen: 2.247709035873413 (2.247709035873413) | > loss_kl: 3.602412700653076 (3.602412700653076) | > loss_feat: 11.557031631469727 (11.557031631469727) | > loss_mel: 26.5366153717041 (26.5366153717041) | > loss_duration: 2.3409318923950195 (2.3409318923950195) | > loss_1: 46.284698486328125 (46.284698486328125)  --> STEP: 1 | > loss_disc: 2.242115020751953 (2.242115020751953) | > loss_disc_real_0: 0.24395562708377838 (0.24395562708377838) | > loss_disc_real_1: 0.16052605211734772 (0.16052605211734772) | > loss_disc_real_2: 0.15836454927921295 (0.15836454927921295) | > loss_disc_real_3: 0.19552867114543915 (0.19552867114543915) | > loss_disc_real_4: 0.228590190410614 (0.228590190410614) | > loss_disc_real_5: 0.2531997263431549 (0.2531997263431549) | > loss_0: 2.242115020751953 (2.242115020751953) | > loss_gen: 2.376523733139038 (2.376523733139038) | > loss_kl: 3.1699507236480713 (3.1699507236480713) | > loss_feat: 5.46648645401001 (5.46648645401001) | > loss_mel: 27.535619735717773 (27.535619735717773) | > loss_duration: 2.4890923500061035 (2.4890923500061035) | > loss_1: 41.03767395019531 (41.03767395019531)  --> STEP: 2 | > loss_disc: 2.5298333168029785 (2.385974168777466) | > loss_disc_real_0: 0.26892149448394775 (0.25643856078386307) | > loss_disc_real_1: 0.19933226704597473 (0.17992915958166122) | > loss_disc_real_2: 0.20635302364826202 (0.1823587864637375) | > loss_disc_real_3: 0.3304899334907532 (0.26300930231809616) | > loss_disc_real_4: 0.20141839981079102 (0.21500429511070251) | > loss_disc_real_5: 0.21802370250225067 (0.2356117144227028) | > loss_0: 2.5298333168029785 (2.385974168777466) | > loss_gen: 2.1184158325195312 (2.2474697828292847) | > loss_kl: 3.017031669616699 (3.0934911966323853) | > loss_feat: 4.5391998291015625 (5.002843141555786) | > loss_mel: 17.233400344848633 (22.384510040283203) | > loss_duration: 2.379995584487915 (2.4345439672470093) | > loss_1: 29.288042068481445 (35.16285800933838)  --> STEP: 3 | > loss_disc: 2.807692050933838 (2.5265467961629233) | > loss_disc_real_0: 0.2558867931365967 (0.2562546382347743) | > loss_disc_real_1: 0.3057518005371094 (0.22187003990014395) | > loss_disc_real_2: 0.4162962734699249 (0.2603379487991333) | > loss_disc_real_3: 0.320344477891922 (0.28212102750937146) | > loss_disc_real_4: 0.23137594759464264 (0.2204615126053492) | > loss_disc_real_5: 0.26371753215789795 (0.2449803203344345) | > loss_0: 2.807692050933838 (2.5265467961629233) | > loss_gen: 2.3255414962768555 (2.273493687311808) | > loss_kl: 1.4935771226882935 (2.560186505317688) | > loss_feat: 2.9642038345336914 (4.323296705881755) | > loss_mel: 21.333728790283203 (22.034249623616535) | > loss_duration: 2.445430278778076 (2.4381727377573648) | > loss_1: 30.562480926513672 (33.62939898173014) --> EVAL PERFORMANCE | > avg_loader_time: 0.006330808003743489 (-0.007061481475830079) | > avg_loss_disc: 2.5265467961629233 (+0.0892263253529868) | > avg_loss_disc_real_0: 0.2562546382347743 (+0.012993169327576964) | > avg_loss_disc_real_1: 0.22187003990014395 (+0.008554403980573028) | > avg_loss_disc_real_2: 0.2603379487991333 (-0.01312821606794995) | > avg_loss_disc_real_3: 0.28212102750937146 (+0.05506219963232678) | > avg_loss_disc_real_4: 0.2204615126053492 (+0.04989620422323543) | > avg_loss_disc_real_5: 0.2449803203344345 (-0.061435773968696594) | > avg_loss_0: 2.5265467961629233 (+0.0892263253529868) | > avg_loss_gen: 2.273493687311808 (-0.05542941888173436) | > avg_loss_kl: 2.560186505317688 (-0.1244130929311118) | > avg_loss_feat: 4.323296705881755 (-0.4267253081003819) | > avg_loss_mel: 22.034249623616535 (+3.4065286318461077) | > avg_loss_duration: 2.4381727377573648 (-0.056943416595458984) | > avg_loss_1: 33.62939898173014 (+2.743015925089516)  > EPOCH: 257/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:27:38)   --> TIME: 2023-10-20 02:27:55 -- STEP: 29/50 -- GLOBAL_STEP: 65880 | > loss_disc: 2.5477182865142822 (2.6321045365826836) | > loss_disc_real_0: 0.15138748288154602 (0.18660193585373205) | > loss_disc_real_1: 0.26681816577911377 (0.23378720751096463) | > loss_disc_real_2: 0.16750022768974304 (0.24174579977989205) | > loss_disc_real_3: 0.22270232439041138 (0.25800124311755446) | > loss_disc_real_4: 0.20439742505550385 (0.26365991540510086) | > loss_disc_real_5: 0.14323273301124573 (0.25561337738201534) | > loss_0: 2.5477182865142822 (2.6321045365826836) | > grad_norm_0: tensor(1177.9395, device='cuda:0') (tensor(1726.7061, device='cuda:0')) | > loss_gen: 1.7832188606262207 (2.324831226776386) | > loss_kl: 1.0176023244857788 (0.9879322072555279) | > loss_feat: 1.7829406261444092 (4.9294316085248155) | > loss_mel: 19.581424713134766 (22.878552921887103) | > loss_duration: 1.5572868585586548 (1.627597689628601) | > loss_1: 25.72247314453125 (32.74834547371701) | > grad_norm_1: tensor(9302.7148, device='cuda:0') (tensor(38607.4180, device='cuda:0')) | > current_lr_0: 0.00015467115812058983 | > current_lr_1: 0.00015467115812058983 | > step_time: 0.5918 (0.43243986162646064) | > loader_time: 0.025 (0.01263075039304536)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2854061126708984 (3.2854061126708984) | > loss_disc_real_0: 0.4624965786933899 (0.4624965786933899) | > loss_disc_real_1: 0.30941906571388245 (0.30941906571388245) | > loss_disc_real_2: 0.23381933569908142 (0.23381933569908142) | > loss_disc_real_3: 0.31813445687294006 (0.31813445687294006) | > loss_disc_real_4: 0.5045612454414368 (0.5045612454414368) | > loss_disc_real_5: 0.39026233553886414 (0.39026233553886414) | > loss_0: 3.2854061126708984 (3.2854061126708984) | > loss_gen: 2.2524821758270264 (2.2524821758270264) | > loss_kl: 2.8827199935913086 (2.8827199935913086) | > loss_feat: 5.661848068237305 (5.661848068237305) | > loss_mel: 22.862424850463867 (22.862424850463867) | > loss_duration: 2.348989725112915 (2.348989725112915) | > loss_1: 36.00846862792969 (36.00846862792969)  --> STEP: 1 | > loss_disc: 3.1322271823883057 (3.1322271823883057) | > loss_disc_real_0: 0.20324061810970306 (0.20324061810970306) | > loss_disc_real_1: 0.3947669565677643 (0.3947669565677643) | > loss_disc_real_2: 0.25670763850212097 (0.25670763850212097) | > loss_disc_real_3: 0.43717092275619507 (0.43717092275619507) | > loss_disc_real_4: 0.42384740710258484 (0.42384740710258484) | > loss_disc_real_5: 0.3709670901298523 (0.3709670901298523) | > loss_0: 3.1322271823883057 (3.1322271823883057) | > loss_gen: 2.3303537368774414 (2.3303537368774414) | > loss_kl: 2.8127005100250244 (2.8127005100250244) | > loss_feat: 5.187170505523682 (5.187170505523682) | > loss_mel: 24.149566650390625 (24.149566650390625) | > loss_duration: 2.5295345783233643 (2.5295345783233643) | > loss_1: 37.00932312011719 (37.00932312011719)  --> STEP: 2 | > loss_disc: 2.8092479705810547 (2.97073757648468) | > loss_disc_real_0: 0.19316652417182922 (0.19820357114076614) | > loss_disc_real_1: 0.3165167272090912 (0.35564184188842773) | > loss_disc_real_2: 0.2672313451766968 (0.2619694918394089) | > loss_disc_real_3: 0.2907664179801941 (0.3639686703681946) | > loss_disc_real_4: 0.2016342282295227 (0.31274081766605377) | > loss_disc_real_5: 0.23366931080818176 (0.30231820046901703) | > loss_0: 2.8092479705810547 (2.97073757648468) | > loss_gen: 1.9175570011138916 (2.1239553689956665) | > loss_kl: 3.6509227752685547 (3.2318116426467896) | > loss_feat: 1.6097474098205566 (3.398458957672119) | > loss_mel: 24.77826499938965 (24.463915824890137) | > loss_duration: 2.444666862487793 (2.4871007204055786) | > loss_1: 34.40115737915039 (35.70524024963379)  --> STEP: 3 | > loss_disc: 3.246143341064453 (3.062539498011271) | > loss_disc_real_0: 0.4411602020263672 (0.2791891147692998) | > loss_disc_real_1: 0.23847897350788116 (0.31658755242824554) | > loss_disc_real_2: 0.2337965965270996 (0.2525785267353058) | > loss_disc_real_3: 0.3811452388763428 (0.36969419320424396) | > loss_disc_real_4: 0.6547631621360779 (0.42674826582272846) | > loss_disc_real_5: 0.356544554233551 (0.3203936517238617) | > loss_0: 3.246143341064453 (3.062539498011271) | > loss_gen: 2.531012535095215 (2.259641091028849) | > loss_kl: 1.3411381244659424 (2.6015871365865073) | > loss_feat: 3.7870826721191406 (3.5280001958211265) | > loss_mel: 22.173015594482422 (23.70028241475423) | > loss_duration: 2.4618563652038574 (2.4786859353383384) | > loss_1: 32.294105529785156 (34.56819534301758) --> EVAL PERFORMANCE | > avg_loader_time: 0.01854530970255534 (+0.012214501698811851) | > avg_loss_disc: 3.062539498011271 (+0.5359927018483477) | > avg_loss_disc_real_0: 0.2791891147692998 (+0.022934476534525516) | > avg_loss_disc_real_1: 0.31658755242824554 (+0.0947175125281016) | > avg_loss_disc_real_2: 0.2525785267353058 (-0.007759422063827515) | > avg_loss_disc_real_3: 0.36969419320424396 (+0.0875731656948725) | > avg_loss_disc_real_4: 0.42674826582272846 (+0.20628675321737924) | > avg_loss_disc_real_5: 0.3203936517238617 (+0.07541333138942719) | > avg_loss_0: 3.062539498011271 (+0.5359927018483477) | > avg_loss_gen: 2.259641091028849 (-0.013852596282958984) | > avg_loss_kl: 2.6015871365865073 (+0.04140063126881932) | > avg_loss_feat: 3.5280001958211265 (-0.7952965100606284) | > avg_loss_mel: 23.70028241475423 (+1.6660327911376953) | > avg_loss_duration: 2.4786859353383384 (+0.0405131975809736) | > avg_loss_1: 34.56819534301758 (+0.9387963612874373)  > EPOCH: 258/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:28:17)   --> TIME: 2023-10-20 02:28:26 -- STEP: 9/50 -- GLOBAL_STEP: 65910 | > loss_disc: 2.170476198196411 (2.0197114414638944) | > loss_disc_real_0: 0.06706944108009338 (0.13620817247364256) | > loss_disc_real_1: 0.20077385008335114 (0.20206688510047066) | > loss_disc_real_2: 0.2806515097618103 (0.22354467709859213) | > loss_disc_real_3: 0.36072832345962524 (0.256314674185382) | > loss_disc_real_4: 0.31628742814064026 (0.22588669239646858) | > loss_disc_real_5: 0.13379235565662384 (0.14437706313199467) | > loss_0: 2.170476198196411 (2.0197114414638944) | > grad_norm_0: tensor(586.1609, device='cuda:0') (tensor(885.9406, device='cuda:0')) | > loss_gen: 3.2926173210144043 (3.018044630686442) | > loss_kl: 1.085425853729248 (0.9818521208233304) | > loss_feat: 7.374594211578369 (8.45512866973877) | > loss_mel: 23.979259490966797 (26.471506966484917) | > loss_duration: 1.5766806602478027 (1.635018202993605) | > loss_1: 37.30857467651367 (40.561549716525604) | > grad_norm_1: tensor(33591.0469, device='cuda:0') (tensor(75311.8047, device='cuda:0')) | > current_lr_0: 0.00015451655461418633 | > current_lr_1: 0.00015451655461418633 | > step_time: 0.6353 (0.5425495836469862) | > loader_time: 0.0241 (0.018206251992119685)  --> TIME: 2023-10-20 02:28:37 -- STEP: 39/50 -- GLOBAL_STEP: 65940 | > loss_disc: 2.686767339706421 (2.386121560365726) | > loss_disc_real_0: 0.1443425416946411 (0.17221142194018915) | > loss_disc_real_1: 0.30620667338371277 (0.22473052277778968) | > loss_disc_real_2: 0.1980694681406021 (0.21734594923850054) | > loss_disc_real_3: 0.17407967150211334 (0.246973050901523) | > loss_disc_real_4: 0.3997911214828491 (0.22361869513033292) | > loss_disc_real_5: 0.4141036570072174 (0.21376341781937158) | > loss_0: 2.686767339706421 (2.386121560365726) | > grad_norm_0: tensor(938.5422, device='cuda:0') (tensor(1455.8715, device='cuda:0')) | > loss_gen: 2.357778549194336 (2.5402978383577786) | > loss_kl: 0.8457618951797485 (0.9567138747527053) | > loss_feat: 2.769298553466797 (5.788276170690854) | > loss_mel: 21.891019821166992 (23.418144785440884) | > loss_duration: 1.657367467880249 (1.6254609120197785) | > loss_1: 29.52122688293457 (34.32889306239593) | > grad_norm_1: tensor(19536.4277, device='cuda:0') (tensor(43034.4219, device='cuda:0')) | > current_lr_0: 0.00015451655461418633 | > current_lr_1: 0.00015451655461418633 | > step_time: 0.2693 (0.4055776962867151) | > loader_time: 0.0026 (0.011065953817123018)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.3026432991027832 (1.3026432991027832) | > loss_disc_real_0: 0.1608140468597412 (0.1608140468597412) | > loss_disc_real_1: 0.11195656657218933 (0.11195656657218933) | > loss_disc_real_2: 0.026351559907197952 (0.026351559907197952) | > loss_disc_real_3: 0.21660882234573364 (0.21660882234573364) | > loss_disc_real_4: 0.039186906069517136 (0.039186906069517136) | > loss_disc_real_5: 0.04595692828297615 (0.04595692828297615) | > loss_0: 1.3026432991027832 (1.3026432991027832) | > loss_gen: 3.1824049949645996 (3.1824049949645996) | > loss_kl: 2.308742046356201 (2.308742046356201) | > loss_feat: 11.32343864440918 (11.32343864440918) | > loss_mel: 22.964933395385742 (22.964933395385742) | > loss_duration: 2.2930986881256104 (2.2930986881256104) | > loss_1: 42.07261657714844 (42.07261657714844)  --> STEP: 1 | > loss_disc: 3.027857542037964 (3.027857542037964) | > loss_disc_real_0: 0.46488046646118164 (0.46488046646118164) | > loss_disc_real_1: 0.31945204734802246 (0.31945204734802246) | > loss_disc_real_2: 0.4196084141731262 (0.4196084141731262) | > loss_disc_real_3: 0.3198891282081604 (0.3198891282081604) | > loss_disc_real_4: 0.3450433909893036 (0.3450433909893036) | > loss_disc_real_5: 0.3719736635684967 (0.3719736635684967) | > loss_0: 3.027857542037964 (3.027857542037964) | > loss_gen: 2.893920660018921 (2.893920660018921) | > loss_kl: 3.173539638519287 (3.173539638519287) | > loss_feat: 3.2557623386383057 (3.2557623386383057) | > loss_mel: 24.391637802124023 (24.391637802124023) | > loss_duration: 2.4746556282043457 (2.4746556282043457) | > loss_1: 36.18951416015625 (36.18951416015625)  --> STEP: 2 | > loss_disc: 2.6699280738830566 (2.8488928079605103) | > loss_disc_real_0: 0.27042245864868164 (0.36765146255493164) | > loss_disc_real_1: 0.29898005723953247 (0.30921605229377747) | > loss_disc_real_2: 0.287991464138031 (0.3537999391555786) | > loss_disc_real_3: 0.21203361451625824 (0.2659613713622093) | > loss_disc_real_4: 0.2776183485984802 (0.3113308697938919) | > loss_disc_real_5: 0.3493982255458832 (0.36068594455718994) | > loss_0: 2.6699280738830566 (2.8488928079605103) | > loss_gen: 2.516183853149414 (2.7050522565841675) | > loss_kl: 3.4316883087158203 (3.3026139736175537) | > loss_feat: 4.749269485473633 (4.002515912055969) | > loss_mel: 29.312217712402344 (26.851927757263184) | > loss_duration: 2.5310049057006836 (2.5028302669525146) | > loss_1: 42.540367126464844 (39.36494064331055)  --> STEP: 3 | > loss_disc: 2.9667725563049316 (2.888186057408651) | > loss_disc_real_0: 0.1917206048965454 (0.30900784333546955) | > loss_disc_real_1: 0.3287745714187622 (0.3157355586687724) | > loss_disc_real_2: 0.2799665927886963 (0.32918882369995117) | > loss_disc_real_3: 0.3095463216304779 (0.28048968811829883) | > loss_disc_real_4: 0.29974380135536194 (0.30746851364771527) | > loss_disc_real_5: 0.24454832077026367 (0.32197340329488117) | > loss_0: 2.9667725563049316 (2.888186057408651) | > loss_gen: 1.7163463830947876 (2.3754836320877075) | > loss_kl: 1.694264531135559 (2.766497492790222) | > loss_feat: 0.2036651074886322 (2.7362323105335236) | > loss_mel: 18.665996551513672 (24.123284022013348) | > loss_duration: 2.4232661724090576 (2.476308902104696) | > loss_1: 24.70353889465332 (34.47780672709147) --> EVAL PERFORMANCE | > avg_loader_time: 0.005907376607259114 (-0.012637933095296226) | > avg_loss_disc: 2.888186057408651 (-0.17435344060262015) | > avg_loss_disc_real_0: 0.30900784333546955 (+0.02981872856616974) | > avg_loss_disc_real_1: 0.3157355586687724 (-0.0008519937594731464) | > avg_loss_disc_real_2: 0.32918882369995117 (+0.07661029696464539) | > avg_loss_disc_real_3: 0.28048968811829883 (-0.08920450508594513) | > avg_loss_disc_real_4: 0.30746851364771527 (-0.11927975217501319) | > avg_loss_disc_real_5: 0.32197340329488117 (+0.001579751571019472) | > avg_loss_0: 2.888186057408651 (-0.17435344060262015) | > avg_loss_gen: 2.3754836320877075 (+0.11584254105885838) | > avg_loss_kl: 2.766497492790222 (+0.16491035620371486) | > avg_loss_feat: 2.7362323105335236 (-0.7917678852876029) | > avg_loss_mel: 24.123284022013348 (+0.42300160725911695) | > avg_loss_duration: 2.476308902104696 (-0.002377033233642578) | > avg_loss_1: 34.47780672709147 (-0.09038861592610914)  > EPOCH: 259/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:28:55)   --> TIME: 2023-10-20 02:29:10 -- STEP: 19/50 -- GLOBAL_STEP: 65970 | > loss_disc: 2.0863938331604004 (2.3743216865941097) | > loss_disc_real_0: 0.06774468719959259 (0.14785016975120494) | > loss_disc_real_1: 0.2551268935203552 (0.2445258807979132) | > loss_disc_real_2: 0.3550001382827759 (0.24106114044001228) | > loss_disc_real_3: 0.350076824426651 (0.23322798252889984) | > loss_disc_real_4: 0.20039477944374084 (0.24468254258758143) | > loss_disc_real_5: 0.07470954209566116 (0.20275249841966128) | > loss_0: 2.0863938331604004 (2.3743216865941097) | > grad_norm_0: tensor(1030.3900, device='cuda:0') (tensor(1726.5336, device='cuda:0')) | > loss_gen: 2.900906562805176 (2.690831002436186) | > loss_kl: 0.9631805419921875 (0.8800317880354429) | > loss_feat: 6.415051460266113 (6.334472311170478) | > loss_mel: 25.82084083557129 (25.42615122544138) | > loss_duration: 1.7166905403137207 (1.6613806235162836) | > loss_1: 37.81666946411133 (36.9928671184339) | > grad_norm_1: tensor(19829.6133, device='cuda:0') (tensor(50323.0508, device='cuda:0')) | > current_lr_0: 0.0001543621056436671 | > current_lr_1: 0.0001543621056436671 | > step_time: 0.5435 (0.4973178537268388) | > loader_time: 0.0238 (0.0183107852935791)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0651047229766846 (3.0651047229766846) | > loss_disc_real_0: 0.4898405075073242 (0.4898405075073242) | > loss_disc_real_1: 0.3028445541858673 (0.3028445541858673) | > loss_disc_real_2: 0.2779465317726135 (0.2779465317726135) | > loss_disc_real_3: 0.32414039969444275 (0.32414039969444275) | > loss_disc_real_4: 0.26033568382263184 (0.26033568382263184) | > loss_disc_real_5: 0.4440189003944397 (0.4440189003944397) | > loss_0: 3.0651047229766846 (3.0651047229766846) | > loss_gen: 2.636138439178467 (2.636138439178467) | > loss_kl: 2.4308712482452393 (2.4308712482452393) | > loss_feat: 3.544642925262451 (3.544642925262451) | > loss_mel: 20.871366500854492 (20.871366500854492) | > loss_duration: 2.3135926723480225 (2.3135926723480225) | > loss_1: 31.796613693237305 (31.796613693237305)  --> STEP: 1 | > loss_disc: 2.1735992431640625 (2.1735992431640625) | > loss_disc_real_0: 0.24253205955028534 (0.24253205955028534) | > loss_disc_real_1: 0.26741501688957214 (0.26741501688957214) | > loss_disc_real_2: 0.2142278552055359 (0.2142278552055359) | > loss_disc_real_3: 0.29268306493759155 (0.29268306493759155) | > loss_disc_real_4: 0.1768403947353363 (0.1768403947353363) | > loss_disc_real_5: 0.19275681674480438 (0.19275681674480438) | > loss_0: 2.1735992431640625 (2.1735992431640625) | > loss_gen: 3.1594531536102295 (3.1594531536102295) | > loss_kl: 3.280290126800537 (3.280290126800537) | > loss_feat: 6.577846527099609 (6.577846527099609) | > loss_mel: 28.434656143188477 (28.434656143188477) | > loss_duration: 2.5190951824188232 (2.5190951824188232) | > loss_1: 43.971343994140625 (43.971343994140625)  --> STEP: 2 | > loss_disc: 3.116410732269287 (2.645004987716675) | > loss_disc_real_0: 0.4626944065093994 (0.3526132330298424) | > loss_disc_real_1: 0.24576519429683685 (0.2565901055932045) | > loss_disc_real_2: 0.3255012035369873 (0.2698645293712616) | > loss_disc_real_3: 0.19231247901916504 (0.2424977719783783) | > loss_disc_real_4: 0.2086900770664215 (0.1927652359008789) | > loss_disc_real_5: 0.4812852144241333 (0.33702101558446884) | > loss_0: 3.116410732269287 (2.645004987716675) | > loss_gen: 2.320401906967163 (2.7399275302886963) | > loss_kl: 3.8055102825164795 (3.5429002046585083) | > loss_feat: 4.358265399932861 (5.468055963516235) | > loss_mel: 24.810026168823242 (26.62234115600586) | > loss_duration: 2.499305486679077 (2.50920033454895) | > loss_1: 37.79350662231445 (40.88242530822754)  --> STEP: 3 | > loss_disc: 3.109919548034668 (2.7999765078226724) | > loss_disc_real_0: 0.49663200974464417 (0.4006194919347763) | > loss_disc_real_1: 0.3229707181453705 (0.2787169764439265) | > loss_disc_real_2: 0.34440067410469055 (0.29470991094907123) | > loss_disc_real_3: 0.43645724654197693 (0.3071509301662445) | > loss_disc_real_4: 0.27886655926704407 (0.22146567702293396) | > loss_disc_real_5: 0.526964545249939 (0.40033552547295886) | > loss_0: 3.109919548034668 (2.7999765078226724) | > loss_gen: 3.6740221977233887 (3.0512924194335938) | > loss_kl: 2.094653606414795 (3.0601513385772705) | > loss_feat: 4.84532356262207 (5.260478496551514) | > loss_mel: 29.424345016479492 (27.556342442830402) | > loss_duration: 2.4471018314361572 (2.4885008335113525) | > loss_1: 42.48544692993164 (41.41676584879557)  --> TIME: 2023-10-20 02:29:31 -- STEP: 49/50 -- GLOBAL_STEP: 66000 | > loss_disc: 2.6276533603668213 (2.396182546810228) | > loss_disc_real_0: 0.21226726472377777 (0.15369498110091195) | > loss_disc_real_1: 0.23147433996200562 (0.2322004732428765) | > loss_disc_real_2: 0.25286865234375 (0.2364011847851228) | > loss_disc_real_3: 0.2887077033519745 (0.22406974318912443) | > loss_disc_real_4: 0.27270182967185974 (0.21800018744353128) | > loss_disc_real_5: 0.3368033766746521 (0.20431421636318675) | > loss_0: 2.6276533603668213 (2.396182546810228) | > grad_norm_0: tensor(2446.7817, device='cuda:0') (tensor(1305.5474, device='cuda:0')) | > loss_gen: 2.4713447093963623 (2.4373925072806224) | > loss_kl: 0.6349970102310181 (0.8964520121107296) | > loss_feat: 2.2804384231567383 (5.509420982885118) | > loss_mel: 23.328079223632812 (23.514536254260005) | > loss_duration: 1.818636178970337 (1.6226165367632497) | > loss_1: 30.53349494934082 (33.98041823445534) | > grad_norm_1: tensor(5688.2803, device='cuda:0') (tensor(37173.5156, device='cuda:0')) | > current_lr_0: 0.0001543621056436671 | > current_lr_1: 0.0001543621056436671 | > step_time: 0.9118 (0.5189705040990088) | > loader_time: 4.6253 (0.11382328247537418) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_66000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4216392040252686 (2.9553921818733215) | > loss_disc_real_0: 0.4313960075378418 (0.4083136208355427) | > loss_disc_real_1: 0.4164997935295105 (0.3131626807153225) | > loss_disc_real_2: 0.4303707182407379 (0.3286251127719879) | > loss_disc_real_3: 0.31545719504356384 (0.30922749638557434) | > loss_disc_real_4: 0.5041317343711853 (0.2921321913599968) | > loss_disc_real_5: 0.5180951952934265 (0.4297754429280758) | > loss_0: 3.4216392040252686 (2.9553921818733215) | > loss_gen: 3.1393356323242188 (3.07330322265625) | > loss_kl: 2.7690701484680176 (2.9873810410499573) | > loss_feat: 4.712791442871094 (5.123556733131409) | > loss_mel: 24.649293899536133 (26.829580307006836) | > loss_duration: 2.301543712615967 (2.441761553287506) | > loss_1: 37.57203674316406 (40.455583572387695)  --> STEP: 1 | > loss_disc: 2.0503947734832764 (2.7743927001953126) | > loss_disc_real_0: 0.1364423930644989 (0.3539393752813339) | > loss_disc_real_1: 0.22044922411441803 (0.2946199893951416) | > loss_disc_real_2: 0.15880201756954193 (0.2946604937314987) | > loss_disc_real_3: 0.2019825577735901 (0.2877785086631775) | > loss_disc_real_4: 0.22000890970230103 (0.27770753502845763) | > loss_disc_real_5: 0.31909170746803284 (0.4076386958360672) | > loss_0: 2.0503947734832764 (2.7743927001953126) | > loss_gen: 2.906585454940796 (3.039959669113159) | > loss_kl: 3.074289560317993 (3.0047627449035645) | > loss_feat: 7.867596626281738 (5.672364711761475) | > loss_mel: 24.337867736816406 (26.33123779296875) | > loss_duration: 2.5530970096588135 (2.4640286445617674) | > loss_1: 40.739437103271484 (40.51235427856445)  --> STEP: 2 | > loss_disc: 3.0406084060668945 (2.8187619845072427) | > loss_disc_real_0: 0.1745104193687439 (0.32403454929590225) | > loss_disc_real_1: 0.22829949855804443 (0.2835665742556254) | > loss_disc_real_2: 0.29558584094047546 (0.29481471826632816) | > loss_disc_real_3: 0.24157753586769104 (0.28007834653059643) | > loss_disc_real_4: 0.2771642506122589 (0.27761698762575787) | > loss_disc_real_5: 0.3496946692466736 (0.39798135807116825) | > loss_0: 3.0406084060668945 (2.8187619845072427) | > loss_gen: 1.5626397132873535 (2.793739676475525) | > loss_kl: 3.326840400695801 (3.0584423542022705) | > loss_feat: 0.10563130676746368 (4.744575810929139) | > loss_mel: 3.335488796234131 (22.498612960179646) | > loss_duration: 2.484860420227051 (2.467500607172648) | > loss_1: 10.815461158752441 (35.562872091929115)  --> STEP: 3 | > loss_disc: 2.8599023818969727 (2.8246391841343472) | > loss_disc_real_0: 0.23248529434204102 (0.3109560843024935) | > loss_disc_real_1: 0.22516745328903198 (0.2752238426889692) | > loss_disc_real_2: 0.22949053347110748 (0.2854826918670109) | > loss_disc_real_3: 0.15535852313041687 (0.2622612289019993) | > loss_disc_real_4: 0.2889711856842041 (0.2792390159198216) | > loss_disc_real_5: 0.36323651671409607 (0.3930178093058722) | > loss_0: 2.8599023818969727 (2.8246391841343472) | > loss_gen: 2.040910243988037 (2.686192614691598) | > loss_kl: 1.9279323816299438 (2.896940929549081) | > loss_feat: 5.251903057098389 (4.8170511318104605) | > loss_mel: 21.418418884277344 (22.34429952076503) | > loss_duration: 2.439762592315674 (2.463538033621652) | > loss_1: 33.07892990112305 (35.20802320752825) --> EVAL PERFORMANCE | > avg_loader_time: 0.3714986528669085 (+0.3655912762596494) | > avg_loss_disc: 2.8246391841343472 (-0.06354687327430364) | > avg_loss_disc_real_0: 0.3109560843024935 (+0.0019482409670239509) | > avg_loss_disc_real_1: 0.2752238426889692 (-0.04051171597980319) | > avg_loss_disc_real_2: 0.2854826918670109 (-0.043706131832940254) | > avg_loss_disc_real_3: 0.2622612289019993 (-0.01822845921629951) | > avg_loss_disc_real_4: 0.2792390159198216 (-0.028229497727893682) | > avg_loss_disc_real_5: 0.3930178093058722 (+0.07104440601099105) | > avg_loss_0: 2.8246391841343472 (-0.06354687327430364) | > avg_loss_gen: 2.686192614691598 (+0.3107089826038907) | > avg_loss_kl: 2.896940929549081 (+0.13044343675885894) | > avg_loss_feat: 4.8170511318104605 (+2.080818821276937) | > avg_loss_mel: 22.34429952076503 (-1.778984501248317) | > avg_loss_duration: 2.463538033621652 (-0.012770868483043873) | > avg_loss_1: 35.20802320752825 (+0.7302164804367806)  > EPOCH: 260/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:29:43)   --> TIME: 2023-10-20 02:30:03 -- STEP: 29/50 -- GLOBAL_STEP: 66030 | > loss_disc: 2.517853021621704 (2.431095805661432) | > loss_disc_real_0: 0.17681339383125305 (0.13305323057133575) | > loss_disc_real_1: 0.2506822347640991 (0.22879978590484323) | > loss_disc_real_2: 0.3018983006477356 (0.23041698773359431) | > loss_disc_real_3: 0.35279396176338196 (0.24676614742854547) | > loss_disc_real_4: 0.2836083173751831 (0.2237719860056351) | > loss_disc_real_5: 0.24932155013084412 (0.23886207317740757) | > loss_0: 2.517853021621704 (2.431095805661432) | > grad_norm_0: tensor(560.6435, device='cuda:0') (tensor(1179.8639, device='cuda:0')) | > loss_gen: 2.5646560192108154 (2.443352732165106) | > loss_kl: 0.8028563261032104 (1.0522993515277734) | > loss_feat: 4.322142601013184 (5.77208054836454) | > loss_mel: 23.834793090820312 (24.0277684063747) | > loss_duration: 1.6269161701202393 (1.6432648239464596) | > loss_1: 33.151363372802734 (34.938765690244466) | > grad_norm_1: tensor(4998.4912, device='cuda:0') (tensor(45706.7031, device='cuda:0')) | > current_lr_0: 0.0001542078110545639 | > current_lr_1: 0.0001542078110545639 | > step_time: 0.3141 (0.5098799508193445) | > loader_time: 0.0246 (0.015280312505261651)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.602562665939331 (2.602562665939331) | > loss_disc_real_0: 0.11144328117370605 (0.11144328117370605) | > loss_disc_real_1: 0.21581830084323883 (0.21581830084323883) | > loss_disc_real_2: 0.18086306750774384 (0.18086306750774384) | > loss_disc_real_3: 0.20504605770111084 (0.20504605770111084) | > loss_disc_real_4: 0.12267641723155975 (0.12267641723155975) | > loss_disc_real_5: 0.15105123817920685 (0.15105123817920685) | > loss_0: 2.602562665939331 (2.602562665939331) | > loss_gen: 1.7888433933258057 (1.7888433933258057) | > loss_kl: 2.3464837074279785 (2.3464837074279785) | > loss_feat: 9.340137481689453 (9.340137481689453) | > loss_mel: 24.91922950744629 (24.91922950744629) | > loss_duration: 2.2835617065429688 (2.2835617065429688) | > loss_1: 40.67825698852539 (40.67825698852539)  --> STEP: 1 | > loss_disc: 2.7577991485595703 (2.7577991485595703) | > loss_disc_real_0: 0.193320631980896 (0.193320631980896) | > loss_disc_real_1: 0.22675658762454987 (0.22675658762454987) | > loss_disc_real_2: 0.2254769206047058 (0.2254769206047058) | > loss_disc_real_3: 0.16878415644168854 (0.16878415644168854) | > loss_disc_real_4: 0.22287704050540924 (0.22287704050540924) | > loss_disc_real_5: 0.20149050652980804 (0.20149050652980804) | > loss_0: 2.7577991485595703 (2.7577991485595703) | > loss_gen: 2.1844980716705322 (2.1844980716705322) | > loss_kl: 3.101665496826172 (3.101665496826172) | > loss_feat: 6.25837516784668 (6.25837516784668) | > loss_mel: 28.74964141845703 (28.74964141845703) | > loss_duration: 2.5875558853149414 (2.5875558853149414) | > loss_1: 42.88173294067383 (42.88173294067383)  --> STEP: 2 | > loss_disc: 2.651819944381714 (2.704809546470642) | > loss_disc_real_0: 0.2964310944080353 (0.24487586319446564) | > loss_disc_real_1: 0.2217176854610443 (0.2242371365427971) | > loss_disc_real_2: 0.21495449542999268 (0.22021570801734924) | > loss_disc_real_3: 0.1585170477628708 (0.16365060210227966) | > loss_disc_real_4: 0.19003896415233612 (0.20645800232887268) | > loss_disc_real_5: 0.26392900943756104 (0.23270975798368454) | > loss_0: 2.651819944381714 (2.704809546470642) | > loss_gen: 2.000993013381958 (2.092745542526245) | > loss_kl: 3.6099536418914795 (3.3558095693588257) | > loss_feat: 6.01045560836792 (6.1344153881073) | > loss_mel: 25.856021881103516 (27.302831649780273) | > loss_duration: 2.428776979446411 (2.5081664323806763) | > loss_1: 39.90620040893555 (41.39396667480469)  --> STEP: 3 | > loss_disc: 2.5020668506622314 (2.6372286478678384) | > loss_disc_real_0: 0.14794914424419403 (0.21256695687770844) | > loss_disc_real_1: 0.2711256444454193 (0.2398666391770045) | > loss_disc_real_2: 0.2206234484910965 (0.22035162150859833) | > loss_disc_real_3: 0.33272436261177063 (0.22000852227210999) | > loss_disc_real_4: 0.28713929653167725 (0.23335176706314087) | > loss_disc_real_5: 0.2733907997608185 (0.2462701052427292) | > loss_0: 2.5020668506622314 (2.6372286478678384) | > loss_gen: 2.3715760707855225 (2.1856890519460044) | > loss_kl: 1.7732245922088623 (2.8282812436421714) | > loss_feat: 2.6344730854034424 (4.967767953872681) | > loss_mel: 20.630929946899414 (25.078864415486652) | > loss_duration: 2.408132553100586 (2.4748218059539795) | > loss_1: 29.818336486816406 (37.535423278808594) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018225510915120442 (-0.36967610177539645) | > avg_loss_disc: 2.6372286478678384 (-0.18741053626650883) | > avg_loss_disc_real_0: 0.21256695687770844 (-0.09838912742478506) | > avg_loss_disc_real_1: 0.2398666391770045 (-0.035357203511964724) | > avg_loss_disc_real_2: 0.22035162150859833 (-0.06513107035841259) | > avg_loss_disc_real_3: 0.22000852227210999 (-0.042252706629889336) | > avg_loss_disc_real_4: 0.23335176706314087 (-0.04588724885668072) | > avg_loss_disc_real_5: 0.2462701052427292 (-0.14674770406314303) | > avg_loss_0: 2.6372286478678384 (-0.18741053626650883) | > avg_loss_gen: 2.1856890519460044 (-0.5005035627455938) | > avg_loss_kl: 2.8282812436421714 (-0.06865968590690974) | > avg_loss_feat: 4.967767953872681 (+0.15071682206222015) | > avg_loss_mel: 25.078864415486652 (+2.734564894721622) | > avg_loss_duration: 2.4748218059539795 (+0.01128377233232758) | > avg_loss_1: 37.535423278808594 (+2.327400071280344)  > EPOCH: 261/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:30:25)   --> TIME: 2023-10-20 02:30:33 -- STEP: 9/50 -- GLOBAL_STEP: 66060 | > loss_disc: 2.2722220420837402 (2.3980913956960044) | > loss_disc_real_0: 0.06996241211891174 (0.15951573258886734) | > loss_disc_real_1: 0.09824661165475845 (0.2090629388888677) | > loss_disc_real_2: 0.10525752604007721 (0.20712169425355065) | > loss_disc_real_3: 0.3279108703136444 (0.2068531471821997) | > loss_disc_real_4: 0.08025626838207245 (0.21479001310136583) | > loss_disc_real_5: 0.3571602404117584 (0.220464329338736) | > loss_0: 2.2722220420837402 (2.3980913956960044) | > grad_norm_0: tensor(2039.3623, device='cuda:0') (tensor(1165.5303, device='cuda:0')) | > loss_gen: 2.3645236492156982 (2.68935489654541) | > loss_kl: 0.9865567088127136 (0.8666738073031107) | > loss_feat: 5.939868927001953 (6.695815476692385) | > loss_mel: 22.737382888793945 (21.643254849645828) | > loss_duration: 1.534122347831726 (1.6061766412523057) | > loss_1: 33.56245422363281 (33.50127644009061) | > grad_norm_1: tensor(53858.9023, device='cuda:0') (tensor(63350.0273, device='cuda:0')) | > current_lr_0: 0.00015405367069256276 | > current_lr_1: 0.00015405367069256276 | > step_time: 0.2857 (0.4689950942993164) | > loader_time: 0.0053 (0.010766930050320096)  --> TIME: 2023-10-20 02:30:47 -- STEP: 39/50 -- GLOBAL_STEP: 66090 | > loss_disc: 2.212132215499878 (2.4391209987493663) | > loss_disc_real_0: 0.03222227841615677 (0.15840059430457848) | > loss_disc_real_1: 0.2634710967540741 (0.2304255866851562) | > loss_disc_real_2: 0.3200761377811432 (0.24022065083949995) | > loss_disc_real_3: 0.30636540055274963 (0.24301759210916665) | > loss_disc_real_4: 0.29631224274635315 (0.2271840213200985) | > loss_disc_real_5: 0.41590458154678345 (0.22051561719331986) | > loss_0: 2.212132215499878 (2.4391209987493663) | > grad_norm_0: tensor(802.8392, device='cuda:0') (tensor(1013.7405, device='cuda:0')) | > loss_gen: 3.404188871383667 (2.493190273260458) | > loss_kl: 0.7157697677612305 (0.9733767860975021) | > loss_feat: 4.908048629760742 (5.473876663029958) | > loss_mel: 20.928607940673828 (20.91625278729659) | > loss_duration: 1.6363716125488281 (1.616544818266844) | > loss_1: 31.592985153198242 (31.47324173267071) | > grad_norm_1: tensor(11137.8760, device='cuda:0') (tensor(36431.8867, device='cuda:0')) | > current_lr_0: 0.00015405367069256276 | > current_lr_1: 0.00015405367069256276 | > step_time: 0.7436 (0.43817321459452313) | > loader_time: 0.0027 (0.008386795337383565)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.766306161880493 (2.766306161880493) | > loss_disc_real_0: 0.21605536341667175 (0.21605536341667175) | > loss_disc_real_1: 0.12799742817878723 (0.12799742817878723) | > loss_disc_real_2: 0.24056923389434814 (0.24056923389434814) | > loss_disc_real_3: 0.2901729941368103 (0.2901729941368103) | > loss_disc_real_4: 0.22210243344306946 (0.22210243344306946) | > loss_disc_real_5: 0.27201607823371887 (0.27201607823371887) | > loss_0: 2.766306161880493 (2.766306161880493) | > loss_gen: 1.906204342842102 (1.906204342842102) | > loss_kl: 2.6385691165924072 (2.6385691165924072) | > loss_feat: 5.975135326385498 (5.975135326385498) | > loss_mel: 25.61370086669922 (25.61370086669922) | > loss_duration: 2.367888927459717 (2.367888927459717) | > loss_1: 38.50149917602539 (38.50149917602539)  --> STEP: 1 | > loss_disc: 2.5671539306640625 (2.5671539306640625) | > loss_disc_real_0: 0.18957746028900146 (0.18957746028900146) | > loss_disc_real_1: 0.23016828298568726 (0.23016828298568726) | > loss_disc_real_2: 0.23548440635204315 (0.23548440635204315) | > loss_disc_real_3: 0.5294621586799622 (0.5294621586799622) | > loss_disc_real_4: 0.20674891769886017 (0.20674891769886017) | > loss_disc_real_5: 0.2808842360973358 (0.2808842360973358) | > loss_0: 2.5671539306640625 (2.5671539306640625) | > loss_gen: 2.7142672538757324 (2.7142672538757324) | > loss_kl: 3.6880710124969482 (3.6880710124969482) | > loss_feat: 6.122244834899902 (6.122244834899902) | > loss_mel: 30.915964126586914 (30.915964126586914) | > loss_duration: 2.5109431743621826 (2.5109431743621826) | > loss_1: 45.95149230957031 (45.95149230957031)  --> STEP: 2 | > loss_disc: 2.8965303897857666 (2.7318421602249146) | > loss_disc_real_0: 0.39289605617523193 (0.2912367582321167) | > loss_disc_real_1: 0.20000573992729187 (0.21508701145648956) | > loss_disc_real_2: 0.17703914642333984 (0.2062617763876915) | > loss_disc_real_3: 0.4047194719314575 (0.46709081530570984) | > loss_disc_real_4: 0.29643675684928894 (0.25159283727407455) | > loss_disc_real_5: 0.2847946882247925 (0.28283946216106415) | > loss_0: 2.8965303897857666 (2.7318421602249146) | > loss_gen: 2.4497783184051514 (2.582022786140442) | > loss_kl: 3.5740966796875 (3.631083846092224) | > loss_feat: 5.860034942626953 (5.991139888763428) | > loss_mel: 36.67970657348633 (33.79783535003662) | > loss_duration: 2.456831932067871 (2.483887553215027) | > loss_1: 51.020450592041016 (48.485971450805664)  --> STEP: 3 | > loss_disc: 2.7604312896728516 (2.7413718700408936) | > loss_disc_real_0: 0.24940703809261322 (0.27729351818561554) | > loss_disc_real_1: 0.2882772982120514 (0.2394837737083435) | > loss_disc_real_2: 0.3779224157333374 (0.2634819895029068) | > loss_disc_real_3: 0.3255012333393097 (0.4198942879835765) | > loss_disc_real_4: 0.27643293142318726 (0.2598728686571121) | > loss_disc_real_5: 0.30217450857162476 (0.28928447763125104) | > loss_0: 2.7604312896728516 (2.7413718700408936) | > loss_gen: 2.2980551719665527 (2.4873669147491455) | > loss_kl: 1.5244667530059814 (2.92887814839681) | > loss_feat: 1.344303846359253 (4.442194541295369) | > loss_mel: 19.564239501953125 (29.053303400675457) | > loss_duration: 2.379817008972168 (2.4491973718007407) | > loss_1: 27.110881805419922 (41.360941569010414) --> EVAL PERFORMANCE | > avg_loader_time: 0.011017322540283203 (+0.009194771448771158) | > avg_loss_disc: 2.7413718700408936 (+0.10414322217305516) | > avg_loss_disc_real_0: 0.27729351818561554 (+0.0647265613079071) | > avg_loss_disc_real_1: 0.2394837737083435 (-0.00038286546866098115) | > avg_loss_disc_real_2: 0.2634819895029068 (+0.04313036799430847) | > avg_loss_disc_real_3: 0.4198942879835765 (+0.1998857657114665) | > avg_loss_disc_real_4: 0.2598728686571121 (+0.026521101593971252) | > avg_loss_disc_real_5: 0.28928447763125104 (+0.04301437238852185) | > avg_loss_0: 2.7413718700408936 (+0.10414322217305516) | > avg_loss_gen: 2.4873669147491455 (+0.30167786280314113) | > avg_loss_kl: 2.92887814839681 (+0.10059690475463867) | > avg_loss_feat: 4.442194541295369 (-0.5255734125773115) | > avg_loss_mel: 29.053303400675457 (+3.9744389851888045) | > avg_loss_duration: 2.4491973718007407 (-0.025624434153238784) | > avg_loss_1: 41.360941569010414 (+3.8255182902018205)  > EPOCH: 262/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:31:00)   --> TIME: 2023-10-20 02:31:14 -- STEP: 19/50 -- GLOBAL_STEP: 66120 | > loss_disc: 2.0169999599456787 (2.517425123013948) | > loss_disc_real_0: 0.03257165849208832 (0.15652788479469323) | > loss_disc_real_1: 0.20169751346111298 (0.22188983622350192) | > loss_disc_real_2: 0.19640794396400452 (0.22206057961049833) | > loss_disc_real_3: 0.2620784640312195 (0.24954649335459658) | > loss_disc_real_4: 0.29197990894317627 (0.22759773346938586) | > loss_disc_real_5: 0.2595486044883728 (0.22561846565651267) | > loss_0: 2.0169999599456787 (2.517425123013948) | > grad_norm_0: tensor(1200.2615, device='cuda:0') (tensor(922.3013, device='cuda:0')) | > loss_gen: 2.947658061981201 (2.28729163972955) | > loss_kl: 1.106134295463562 (0.9152391647037706) | > loss_feat: 5.554995059967041 (5.090005800520119) | > loss_mel: 23.079483032226562 (23.882249361590336) | > loss_duration: 1.6975791454315186 (1.6404824821572555) | > loss_1: 34.38584899902344 (33.8152682655736) | > grad_norm_1: tensor(23629.6719, device='cuda:0') (tensor(44103.6406, device='cuda:0')) | > current_lr_0: 0.00015389968440350407 | > current_lr_1: 0.00015389968440350407 | > step_time: 0.3068 (0.5046945998543187) | > loader_time: 0.0236 (0.01908439084103233)  --> TIME: 2023-10-20 02:31:30 -- STEP: 49/50 -- GLOBAL_STEP: 66150 | > loss_disc: 1.4887654781341553 (2.5027481512147554) | > loss_disc_real_0: 0.05996006727218628 (0.15327078335899477) | > loss_disc_real_1: 0.3067454695701599 (0.22826190460093168) | > loss_disc_real_2: 0.07700341939926147 (0.2295902705542287) | > loss_disc_real_3: 0.15860497951507568 (0.24454651818591724) | > loss_disc_real_4: 0.055775370448827744 (0.2267096503732764) | > loss_disc_real_5: 0.25996118783950806 (0.2339429305676295) | > loss_0: 1.4887654781341553 (2.5027481512147554) | > grad_norm_0: tensor(776.1813, device='cuda:0') (tensor(1108.8469, device='cuda:0')) | > loss_gen: 3.2108843326568604 (2.356014497426092) | > loss_kl: 0.7113185524940491 (0.8745257714573218) | > loss_feat: 7.297065734863281 (5.190670636083399) | > loss_mel: 24.94416618347168 (22.927450600935487) | > loss_duration: 1.6981724500656128 (1.6010795637052886) | > loss_1: 37.861610412597656 (32.94974122728621) | > grad_norm_1: tensor(36208.5234, device='cuda:0') (tensor(38972.5312, device='cuda:0')) | > current_lr_0: 0.00015389968440350407 | > current_lr_1: 0.00015389968440350407 | > step_time: 0.3416 (0.4884351808197645) | > loader_time: 0.3526 (0.026029625717474494)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.653207540512085 (2.653207540512085) | > loss_disc_real_0: 0.10678476840257645 (0.10678476840257645) | > loss_disc_real_1: 0.27039608359336853 (0.27039608359336853) | > loss_disc_real_2: 0.3207753598690033 (0.3207753598690033) | > loss_disc_real_3: 0.2609102427959442 (0.2609102427959442) | > loss_disc_real_4: 0.1652062088251114 (0.1652062088251114) | > loss_disc_real_5: 0.2589283585548401 (0.2589283585548401) | > loss_0: 2.653207540512085 (2.653207540512085) | > loss_gen: 1.8378983736038208 (1.8378983736038208) | > loss_kl: 2.7642641067504883 (2.7642641067504883) | > loss_feat: 3.7004661560058594 (3.7004661560058594) | > loss_mel: 22.235689163208008 (22.235689163208008) | > loss_duration: 2.4132251739501953 (2.4132251739501953) | > loss_1: 32.95154571533203 (32.95154571533203)  --> STEP: 1 | > loss_disc: 2.799281358718872 (2.799281358718872) | > loss_disc_real_0: 0.3167009949684143 (0.3167009949684143) | > loss_disc_real_1: 0.16661514341831207 (0.16661514341831207) | > loss_disc_real_2: 0.19771595299243927 (0.19771595299243927) | > loss_disc_real_3: 0.3215084671974182 (0.3215084671974182) | > loss_disc_real_4: 0.3283942639827728 (0.3283942639827728) | > loss_disc_real_5: 0.3108730912208557 (0.3108730912208557) | > loss_0: 2.799281358718872 (2.799281358718872) | > loss_gen: 2.1580467224121094 (2.1580467224121094) | > loss_kl: 3.0361852645874023 (3.0361852645874023) | > loss_feat: 4.53786563873291 (4.53786563873291) | > loss_mel: 24.648361206054688 (24.648361206054688) | > loss_duration: 2.5856244564056396 (2.5856244564056396) | > loss_1: 36.96608352661133 (36.96608352661133)  --> STEP: 2 | > loss_disc: 2.809864044189453 (2.8045727014541626) | > loss_disc_real_0: 0.35434508323669434 (0.3355230391025543) | > loss_disc_real_1: 0.2655966877937317 (0.21610591560602188) | > loss_disc_real_2: 0.19871102273464203 (0.19821348786354065) | > loss_disc_real_3: 0.1501101851463318 (0.235809326171875) | > loss_disc_real_4: 0.27463802695274353 (0.3015161454677582) | > loss_disc_real_5: 0.32276755571365356 (0.31682032346725464) | > loss_0: 2.809864044189453 (2.8045727014541626) | > loss_gen: 2.054178476333618 (2.1061125993728638) | > loss_kl: 3.5567996501922607 (3.2964924573898315) | > loss_feat: 4.532357692718506 (4.535111665725708) | > loss_mel: 21.880531311035156 (23.264446258544922) | > loss_duration: 2.4429938793182373 (2.5143091678619385) | > loss_1: 34.466861724853516 (35.71647262573242)  --> STEP: 3 | > loss_disc: 2.802157402038574 (2.8037676016489663) | > loss_disc_real_0: 0.10620226711034775 (0.2590827817718188) | > loss_disc_real_1: 0.3313583731651306 (0.2545234014590581) | > loss_disc_real_2: 0.24428750574588776 (0.21357149382432303) | > loss_disc_real_3: 0.2911425232887268 (0.2542537252108256) | > loss_disc_real_4: 0.3301279842853546 (0.31105342507362366) | > loss_disc_real_5: 0.3305058181285858 (0.3213821550210317) | > loss_0: 2.802157402038574 (2.8037676016489663) | > loss_gen: 2.028414487838745 (2.0802132288614907) | > loss_kl: 1.6063649654388428 (2.733116626739502) | > loss_feat: 2.447509288787842 (3.8392442067464194) | > loss_mel: 24.57993507385254 (23.70294253031413) | > loss_duration: 2.4023489952087402 (2.4769891103108725) | > loss_1: 33.064571380615234 (34.832505544026695) --> EVAL PERFORMANCE | > avg_loader_time: 0.009311914443969727 (-0.0017054080963134766) | > avg_loss_disc: 2.8037676016489663 (+0.06239573160807277) | > avg_loss_disc_real_0: 0.2590827817718188 (-0.018210736413796724) | > avg_loss_disc_real_1: 0.2545234014590581 (+0.015039627750714601) | > avg_loss_disc_real_2: 0.21357149382432303 (-0.04991049567858377) | > avg_loss_disc_real_3: 0.2542537252108256 (-0.16564056277275085) | > avg_loss_disc_real_4: 0.31105342507362366 (+0.051180556416511536) | > avg_loss_disc_real_5: 0.3213821550210317 (+0.03209767738978064) | > avg_loss_0: 2.8037676016489663 (+0.06239573160807277) | > avg_loss_gen: 2.0802132288614907 (-0.40715368588765477) | > avg_loss_kl: 2.733116626739502 (-0.1957615216573081) | > avg_loss_feat: 3.8392442067464194 (-0.6029503345489498) | > avg_loss_mel: 23.70294253031413 (-5.350360870361328) | > avg_loss_duration: 2.4769891103108725 (+0.027791738510131836) | > avg_loss_1: 34.832505544026695 (-6.528436024983719)  > EPOCH: 263/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:31:42)   --> TIME: 2023-10-20 02:32:02 -- STEP: 29/50 -- GLOBAL_STEP: 66180 | > loss_disc: 2.095754623413086 (2.496512552787518) | > loss_disc_real_0: 0.12281481921672821 (0.1948608011007309) | > loss_disc_real_1: 0.2164057195186615 (0.2103814582886367) | > loss_disc_real_2: 0.3843019902706146 (0.21192441829319658) | > loss_disc_real_3: 0.2813214063644409 (0.22485435355840058) | > loss_disc_real_4: 0.12187088280916214 (0.23097155211043768) | > loss_disc_real_5: 0.08685952425003052 (0.222875011763696) | > loss_0: 2.095754623413086 (2.496512552787518) | > grad_norm_0: tensor(594.6103, device='cuda:0') (tensor(1885.5088, device='cuda:0')) | > loss_gen: 2.6669235229492188 (2.3204243100922683) | > loss_kl: 0.8628011345863342 (0.9137991101577364) | > loss_feat: 5.588034629821777 (5.160633072770875) | > loss_mel: 26.653945922851562 (21.275537297643464) | > loss_duration: 1.5867547988891602 (1.6197855636991303) | > loss_1: 37.35845947265625 (31.29017923618185) | > grad_norm_1: tensor(12308.7588, device='cuda:0') (tensor(44449.8711, device='cuda:0')) | > current_lr_0: 0.00015374585203338232 | > current_lr_1: 0.00015374585203338232 | > step_time: 0.6344 (0.5112456042191079) | > loader_time: 0.0043 (0.018072309165165345)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6421051025390625 (2.6421051025390625) | > loss_disc_real_0: 0.06290079653263092 (0.06290079653263092) | > loss_disc_real_1: 0.2320096641778946 (0.2320096641778946) | > loss_disc_real_2: 0.21689045429229736 (0.21689045429229736) | > loss_disc_real_3: 0.23961828649044037 (0.23961828649044037) | > loss_disc_real_4: 0.19668227434158325 (0.19668227434158325) | > loss_disc_real_5: 0.13358159363269806 (0.13358159363269806) | > loss_0: 2.6421051025390625 (2.6421051025390625) | > loss_gen: 1.492348074913025 (1.492348074913025) | > loss_kl: 2.7943732738494873 (2.7943732738494873) | > loss_feat: 1.7306891679763794 (1.7306891679763794) | > loss_mel: 19.500524520874023 (19.500524520874023) | > loss_duration: 2.24165415763855 (2.24165415763855) | > loss_1: 27.75958824157715 (27.75958824157715)  --> STEP: 1 | > loss_disc: 2.7966294288635254 (2.7966294288635254) | > loss_disc_real_0: 0.19119209051132202 (0.19119209051132202) | > loss_disc_real_1: 0.17630963027477264 (0.17630963027477264) | > loss_disc_real_2: 0.4576822817325592 (0.4576822817325592) | > loss_disc_real_3: 0.3705107569694519 (0.3705107569694519) | > loss_disc_real_4: 0.17561554908752441 (0.17561554908752441) | > loss_disc_real_5: 0.3362695276737213 (0.3362695276737213) | > loss_0: 2.7966294288635254 (2.7966294288635254) | > loss_gen: 2.3569867610931396 (2.3569867610931396) | > loss_kl: 3.4525108337402344 (3.4525108337402344) | > loss_feat: 6.113381385803223 (6.113381385803223) | > loss_mel: 24.493446350097656 (24.493446350097656) | > loss_duration: 2.430377721786499 (2.430377721786499) | > loss_1: 38.846702575683594 (38.846702575683594)  --> STEP: 2 | > loss_disc: 2.852731704711914 (2.8246805667877197) | > loss_disc_real_0: 0.025581510737538338 (0.10838680062443018) | > loss_disc_real_1: 0.11007069051265717 (0.1431901603937149) | > loss_disc_real_2: 0.09341253340244293 (0.27554740756750107) | > loss_disc_real_3: 0.056243717670440674 (0.2133772373199463) | > loss_disc_real_4: 0.029002217575907707 (0.10230888333171606) | > loss_disc_real_5: 0.012526382692158222 (0.17439795518293977) | > loss_0: 2.852731704711914 (2.8246805667877197) | > loss_gen: 1.4140362739562988 (1.8855115175247192) | > loss_kl: 3.3580963611602783 (3.4053035974502563) | > loss_feat: 10.629910469055176 (8.3716459274292) | > loss_mel: 27.595033645629883 (26.04423999786377) | > loss_duration: 2.43420672416687 (2.4322922229766846) | > loss_1: 45.43128204345703 (42.13899230957031)  --> STEP: 3 | > loss_disc: 2.640143394470215 (2.7631681760152182) | > loss_disc_real_0: 0.08843788504600525 (0.10173716209828854) | > loss_disc_real_1: 0.16294211149215698 (0.1497741440931956) | > loss_disc_real_2: 0.19033260643482208 (0.24714247385660806) | > loss_disc_real_3: 0.2734852433204651 (0.23341323932011923) | > loss_disc_real_4: 0.30681127309799194 (0.17047634658714136) | > loss_disc_real_5: 0.265654981136322 (0.2048169638340672) | > loss_0: 2.640143394470215 (2.7631681760152182) | > loss_gen: 1.6983720064163208 (1.8231316804885864) | > loss_kl: 1.7188341617584229 (2.843147118886312) | > loss_feat: 1.6518605947494507 (6.131717483202617) | > loss_mel: 21.489540100097656 (24.5260066986084) | > loss_duration: 2.3222930431365967 (2.3956258296966553) | > loss_1: 28.88089942932129 (37.71962801615397) --> EVAL PERFORMANCE | > avg_loader_time: 0.012840350468953451 (+0.0035284360249837245) | > avg_loss_disc: 2.7631681760152182 (-0.040599425633748076) | > avg_loss_disc_real_0: 0.10173716209828854 (-0.15734561967353028) | > avg_loss_disc_real_1: 0.1497741440931956 (-0.10474925736586252) | > avg_loss_disc_real_2: 0.24714247385660806 (+0.033570980032285036) | > avg_loss_disc_real_3: 0.23341323932011923 (-0.02084048589070639) | > avg_loss_disc_real_4: 0.17047634658714136 (-0.1405770784864823) | > avg_loss_disc_real_5: 0.2048169638340672 (-0.11656519118696448) | > avg_loss_0: 2.7631681760152182 (-0.040599425633748076) | > avg_loss_gen: 1.8231316804885864 (-0.2570815483729043) | > avg_loss_kl: 2.843147118886312 (+0.11003049214681004) | > avg_loss_feat: 6.131717483202617 (+2.2924732764561973) | > avg_loss_mel: 24.5260066986084 (+0.8230641682942696) | > avg_loss_duration: 2.3956258296966553 (-0.08136328061421727) | > avg_loss_1: 37.71962801615397 (+2.887122472127274)  > EPOCH: 264/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:32:23)   --> TIME: 2023-10-20 02:32:30 -- STEP: 9/50 -- GLOBAL_STEP: 66210 | > loss_disc: 2.7450766563415527 (2.254813975758023) | > loss_disc_real_0: 0.22478561103343964 (0.12479002421928777) | > loss_disc_real_1: 0.29686063528060913 (0.20167799790700278) | > loss_disc_real_2: 0.23739628493785858 (0.1725262730485863) | > loss_disc_real_3: 0.33402740955352783 (0.2557397236426671) | > loss_disc_real_4: 0.2748129665851593 (0.17146320910089546) | > loss_disc_real_5: 0.22252647578716278 (0.16942987808336815) | > loss_0: 2.7450766563415527 (2.254813975758023) | > grad_norm_0: tensor(931.9025, device='cuda:0') (tensor(963.1323, device='cuda:0')) | > loss_gen: 1.9233802556991577 (2.450354562865363) | > loss_kl: 1.0790609121322632 (0.8679729070928361) | > loss_feat: 0.8797840476036072 (6.154212001297209) | > loss_mel: 17.71034812927246 (23.751087612575954) | > loss_duration: 1.6070830821990967 (1.6478459305233426) | > loss_1: 23.199655532836914 (34.871472888522675) | > grad_norm_1: tensor(10540.2500, device='cuda:0') (tensor(50681.9453, device='cuda:0')) | > current_lr_0: 0.00015359217342834588 | > current_lr_1: 0.00015359217342834588 | > step_time: 0.2731 (0.42769773801167804) | > loader_time: 0.0063 (0.011663066016303169)  --> TIME: 2023-10-20 02:32:41 -- STEP: 39/50 -- GLOBAL_STEP: 66240 | > loss_disc: 3.0105607509613037 (2.4606394309263964) | > loss_disc_real_0: 0.20183050632476807 (0.16002634989145476) | > loss_disc_real_1: 0.23855829238891602 (0.22545513291007432) | > loss_disc_real_2: 0.24656102061271667 (0.241797059487838) | > loss_disc_real_3: 0.27569347620010376 (0.2629227592394902) | > loss_disc_real_4: 0.2826288938522339 (0.21820680751727942) | > loss_disc_real_5: 0.2535764276981354 (0.2363500555213063) | > loss_0: 3.0105607509613037 (2.4606394309263964) | > grad_norm_0: tensor(799.4468, device='cuda:0') (tensor(1043.3359, device='cuda:0')) | > loss_gen: 1.4447485208511353 (2.3701002964606643) | > loss_kl: 0.38812005519866943 (0.930148335890128) | > loss_feat: 0.05065196007490158 (5.5810364828182335) | > loss_mel: 2.038425922393799 (24.2644640482389) | > loss_duration: 1.6564345359802246 (1.6213713028492072) | > loss_1: 5.578381061553955 (34.76712056918022) | > grad_norm_1: tensor(31991.2188, device='cuda:0') (tensor(44576.2969, device='cuda:0')) | > current_lr_0: 0.00015359217342834588 | > current_lr_1: 0.00015359217342834588 | > step_time: 0.6809 (0.372149999325092) | > loader_time: 0.022 (0.00756065662090595)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.241359233856201 (2.241359233856201) | > loss_disc_real_0: 0.06616407632827759 (0.06616407632827759) | > loss_disc_real_1: 0.253669798374176 (0.253669798374176) | > loss_disc_real_2: 0.18328483402729034 (0.18328483402729034) | > loss_disc_real_3: 0.2320653349161148 (0.2320653349161148) | > loss_disc_real_4: 0.27681636810302734 (0.27681636810302734) | > loss_disc_real_5: 0.27808457612991333 (0.27808457612991333) | > loss_0: 2.241359233856201 (2.241359233856201) | > loss_gen: 2.7339274883270264 (2.7339274883270264) | > loss_kl: 2.170720100402832 (2.170720100402832) | > loss_feat: 6.601701736450195 (6.601701736450195) | > loss_mel: 27.272857666015625 (27.272857666015625) | > loss_duration: 2.284414529800415 (2.284414529800415) | > loss_1: 41.06362533569336 (41.06362533569336)  --> STEP: 1 | > loss_disc: 2.151010513305664 (2.151010513305664) | > loss_disc_real_0: 0.04625784233212471 (0.04625784233212471) | > loss_disc_real_1: 0.1661515086889267 (0.1661515086889267) | > loss_disc_real_2: 0.19765999913215637 (0.19765999913215637) | > loss_disc_real_3: 0.33164411783218384 (0.33164411783218384) | > loss_disc_real_4: 0.1905255764722824 (0.1905255764722824) | > loss_disc_real_5: 0.2193020135164261 (0.2193020135164261) | > loss_0: 2.151010513305664 (2.151010513305664) | > loss_gen: 2.601933717727661 (2.601933717727661) | > loss_kl: 3.02230167388916 (3.02230167388916) | > loss_feat: 6.866976737976074 (6.866976737976074) | > loss_mel: 25.057575225830078 (25.057575225830078) | > loss_duration: 2.4948108196258545 (2.4948108196258545) | > loss_1: 40.04359817504883 (40.04359817504883)  --> STEP: 2 | > loss_disc: 2.984649658203125 (2.5678300857543945) | > loss_disc_real_0: 0.32265767455101013 (0.18445775844156742) | > loss_disc_real_1: 0.2199803590774536 (0.19306593388319016) | > loss_disc_real_2: 0.2615697383880615 (0.22961486876010895) | > loss_disc_real_3: 0.2229471355676651 (0.27729562669992447) | > loss_disc_real_4: 0.26404449343681335 (0.22728503495454788) | > loss_disc_real_5: 0.2682259678840637 (0.2437639907002449) | > loss_0: 2.984649658203125 (2.5678300857543945) | > loss_gen: 1.598401665687561 (2.100167691707611) | > loss_kl: 3.7697510719299316 (3.396026372909546) | > loss_feat: 0.15918941795825958 (3.513083077967167) | > loss_mel: 8.437121391296387 (16.747348308563232) | > loss_duration: 2.3582589626312256 (2.42653489112854) | > loss_1: 16.322723388671875 (28.18316078186035)  --> STEP: 3 | > loss_disc: 2.984389305114746 (2.7066831588745117) | > loss_disc_real_0: 0.32160452008247375 (0.23017334565520287) | > loss_disc_real_1: 0.21992123126983643 (0.20201769967873892) | > loss_disc_real_2: 0.26126712560653687 (0.2401656210422516) | > loss_disc_real_3: 0.22292733192443848 (0.25917286177476245) | > loss_disc_real_4: 0.26395732164382935 (0.2395091305176417) | > loss_disc_real_5: 0.2684539258480072 (0.25199396908283234) | > loss_0: 2.984389305114746 (2.7066831588745117) | > loss_gen: 1.5969983339309692 (1.9324445724487305) | > loss_kl: 1.6409375667572021 (2.8109967708587646) | > loss_feat: 0.15926720201969147 (2.395144452651342) | > loss_mel: 3.6791648864746094 (12.391287167867025) | > loss_duration: 2.4537317752838135 (2.435600519180298) | > loss_1: 9.530099868774414 (21.965473810831707) --> EVAL PERFORMANCE | > avg_loader_time: 0.004942099253336589 (-0.007898251215616863) | > avg_loss_disc: 2.7066831588745117 (-0.05648501714070653) | > avg_loss_disc_real_0: 0.23017334565520287 (+0.12843618355691433) | > avg_loss_disc_real_1: 0.20201769967873892 (+0.05224355558554333) | > avg_loss_disc_real_2: 0.2401656210422516 (-0.006976852814356477) | > avg_loss_disc_real_3: 0.25917286177476245 (+0.025759622454643222) | > avg_loss_disc_real_4: 0.2395091305176417 (+0.06903278393050033) | > avg_loss_disc_real_5: 0.25199396908283234 (+0.04717700524876514) | > avg_loss_0: 2.7066831588745117 (-0.05648501714070653) | > avg_loss_gen: 1.9324445724487305 (+0.10931289196014404) | > avg_loss_kl: 2.8109967708587646 (-0.03215034802754735) | > avg_loss_feat: 2.395144452651342 (-3.7365730305512748) | > avg_loss_mel: 12.391287167867025 (-12.134719530741373) | > avg_loss_duration: 2.435600519180298 (+0.03997468948364258) | > avg_loss_1: 21.965473810831707 (-15.754154205322262)  > EPOCH: 265/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:32:58)   --> TIME: 2023-10-20 02:33:12 -- STEP: 19/50 -- GLOBAL_STEP: 66270 | > loss_disc: 2.319032669067383 (2.323852488869115) | > loss_disc_real_0: 0.04551219567656517 (0.1209643242978736) | > loss_disc_real_1: 0.37802544236183167 (0.2201622010845887) | > loss_disc_real_2: 0.167007714509964 (0.2008737389390406) | > loss_disc_real_3: 0.3158910870552063 (0.2464770909986998) | > loss_disc_real_4: 0.2775353193283081 (0.23171199730744488) | > loss_disc_real_5: 0.23028980195522308 (0.22684982164125694) | > loss_0: 2.319032669067383 (2.323852488869115) | > grad_norm_0: tensor(1550.1864, device='cuda:0') (tensor(1698.7097, device='cuda:0')) | > loss_gen: 2.552607536315918 (2.5956413243946277) | > loss_kl: 1.159784197807312 (0.7303267874215779) | > loss_feat: 5.615377426147461 (6.218695964468153) | > loss_mel: 25.95905113220215 (24.348904132843018) | > loss_duration: 1.7623465061187744 (1.6485048657969426) | > loss_1: 37.049171447753906 (35.54207287336651) | > grad_norm_1: tensor(45532.9570, device='cuda:0') (tensor(54737.8359, device='cuda:0')) | > current_lr_0: 0.00015343864843469685 | > current_lr_1: 0.00015343864843469685 | > step_time: 0.3057 (0.5052776713120309) | > loader_time: 0.0246 (0.01765976454082288)  --> TIME: 2023-10-20 02:33:28 -- STEP: 49/50 -- GLOBAL_STEP: 66300 | > loss_disc: 1.893092393875122 (2.4502690568262215) | > loss_disc_real_0: 0.03182906657457352 (0.14696719432819863) | > loss_disc_real_1: 0.14689134061336517 (0.23661200109185004) | > loss_disc_real_2: 0.08637668937444687 (0.2172193802056872) | > loss_disc_real_3: 0.1191507875919342 (0.245534566136039) | > loss_disc_real_4: 0.07085739821195602 (0.21360132504938817) | > loss_disc_real_5: 0.04357163608074188 (0.21012350221221543) | > loss_0: 1.893092393875122 (2.4502690568262215) | > grad_norm_0: tensor(1687.0709, device='cuda:0') (tensor(1338.8730, device='cuda:0')) | > loss_gen: 2.201472282409668 (2.3640166715699804) | > loss_kl: 0.6707464456558228 (0.8241627115984352) | > loss_feat: 7.751913070678711 (5.1870388305004775) | > loss_mel: 25.17495346069336 (22.13393012601502) | > loss_duration: 1.7092441320419312 (1.6039316678533748) | > loss_1: 37.508331298828125 (32.11308022907803) | > grad_norm_1: tensor(68736.7891, device='cuda:0') (tensor(44763.3359, device='cuda:0')) | > current_lr_0: 0.00015343864843469685 | > current_lr_1: 0.00015343864843469685 | > step_time: 0.5902 (0.5029568428895912) | > loader_time: 0.3706 (0.025422782314066986)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7773189544677734 (2.7773189544677734) | > loss_disc_real_0: 0.12697845697402954 (0.12697845697402954) | > loss_disc_real_1: 0.3320161998271942 (0.3320161998271942) | > loss_disc_real_2: 0.3464566469192505 (0.3464566469192505) | > loss_disc_real_3: 0.26025131344795227 (0.26025131344795227) | > loss_disc_real_4: 0.2356230914592743 (0.2356230914592743) | > loss_disc_real_5: 0.24218662083148956 (0.24218662083148956) | > loss_0: 2.7773189544677734 (2.7773189544677734) | > loss_gen: 2.0031869411468506 (2.0031869411468506) | > loss_kl: 3.5397744178771973 (3.5397744178771973) | > loss_feat: 3.6419448852539062 (3.6419448852539062) | > loss_mel: 23.71343994140625 (23.71343994140625) | > loss_duration: 2.4570815563201904 (2.4570815563201904) | > loss_1: 35.35542678833008 (35.35542678833008)  --> STEP: 1 | > loss_disc: 2.770170211791992 (2.770170211791992) | > loss_disc_real_0: 0.15933090448379517 (0.15933090448379517) | > loss_disc_real_1: 0.2695956826210022 (0.2695956826210022) | > loss_disc_real_2: 0.29522016644477844 (0.29522016644477844) | > loss_disc_real_3: 0.21276496350765228 (0.21276496350765228) | > loss_disc_real_4: 0.2805866301059723 (0.2805866301059723) | > loss_disc_real_5: 0.31817761063575745 (0.31817761063575745) | > loss_0: 2.770170211791992 (2.770170211791992) | > loss_gen: 1.9036884307861328 (1.9036884307861328) | > loss_kl: 3.2582919597625732 (3.2582919597625732) | > loss_feat: 2.977701187133789 (2.977701187133789) | > loss_mel: 24.0780029296875 (24.0780029296875) | > loss_duration: 2.5232772827148438 (2.5232772827148438) | > loss_1: 34.74095916748047 (34.74095916748047)  --> STEP: 2 | > loss_disc: 3.0485637187957764 (2.9093669652938843) | > loss_disc_real_0: 0.14037376642227173 (0.14985233545303345) | > loss_disc_real_1: 0.2779425084590912 (0.2737690955400467) | > loss_disc_real_2: 0.357268363237381 (0.3262442648410797) | > loss_disc_real_3: 0.27755188941955566 (0.24515842646360397) | > loss_disc_real_4: 0.2704586684703827 (0.2755226492881775) | > loss_disc_real_5: 0.26199933886528015 (0.2900884747505188) | > loss_0: 3.0485637187957764 (2.9093669652938843) | > loss_gen: 1.5997626781463623 (1.7517255544662476) | > loss_kl: 3.358081817626953 (3.308186888694763) | > loss_feat: 0.10750693827867508 (1.542604062706232) | > loss_mel: 5.156639575958252 (14.617321252822876) | > loss_duration: 2.4911420345306396 (2.5072096586227417) | > loss_1: 12.713133811950684 (23.727046489715576)  --> STEP: 3 | > loss_disc: 3.0757408142089844 (2.964824914932251) | > loss_disc_real_0: 0.16551066935062408 (0.15507178008556366) | > loss_disc_real_1: 0.287640780210495 (0.2783929904301961) | > loss_disc_real_2: 0.34787842631340027 (0.3334556519985199) | > loss_disc_real_3: 0.2887680232524872 (0.25969495872656506) | > loss_disc_real_4: 0.28033679723739624 (0.2771273652712504) | > loss_disc_real_5: 0.27617892622947693 (0.2854519585768382) | > loss_0: 3.0757408142089844 (2.964824914932251) | > loss_gen: 1.639394760131836 (1.714281956354777) | > loss_kl: 1.4637917280197144 (2.69338850180308) | > loss_feat: 0.3272111713886261 (1.1374730989336967) | > loss_mel: 17.799362182617188 (15.678001562754313) | > loss_duration: 2.453871965408325 (2.4894304275512695) | > loss_1: 23.683631896972656 (23.71257495880127) --> EVAL PERFORMANCE | > avg_loader_time: 0.002850612004597982 (-0.002091487248738607) | > avg_loss_disc: 2.964824914932251 (+0.25814175605773926) | > avg_loss_disc_real_0: 0.15507178008556366 (-0.0751015655696392) | > avg_loss_disc_real_1: 0.2783929904301961 (+0.07637529075145719) | > avg_loss_disc_real_2: 0.3334556519985199 (+0.09329003095626831) | > avg_loss_disc_real_3: 0.25969495872656506 (+0.0005220969518026086) | > avg_loss_disc_real_4: 0.2771273652712504 (+0.03761823475360873) | > avg_loss_disc_real_5: 0.2854519585768382 (+0.03345798949400586) | > avg_loss_0: 2.964824914932251 (+0.25814175605773926) | > avg_loss_gen: 1.714281956354777 (-0.21816261609395338) | > avg_loss_kl: 2.69338850180308 (-0.11760826905568456) | > avg_loss_feat: 1.1374730989336967 (-1.2576713537176452) | > avg_loss_mel: 15.678001562754313 (+3.2867143948872872) | > avg_loss_duration: 2.4894304275512695 (+0.05382990837097168) | > avg_loss_1: 23.71257495880127 (+1.7471011479695626)  > EPOCH: 266/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:33:40)   --> TIME: 2023-10-20 02:33:58 -- STEP: 29/50 -- GLOBAL_STEP: 66330 | > loss_disc: 2.781878709793091 (2.481406228295688) | > loss_disc_real_0: 0.24642087519168854 (0.15818457189818907) | > loss_disc_real_1: 0.26938363909721375 (0.20348662189368544) | > loss_disc_real_2: 0.2654475271701813 (0.22395432586299963) | > loss_disc_real_3: 0.27845221757888794 (0.22654051320820018) | > loss_disc_real_4: 0.29399165511131287 (0.23317580670118332) | > loss_disc_real_5: 0.3064042031764984 (0.26244813563494845) | > loss_0: 2.781878709793091 (2.481406228295688) | > grad_norm_0: tensor(834.9913, device='cuda:0') (tensor(1048.2860, device='cuda:0')) | > loss_gen: 2.0215134620666504 (2.4089505425814925) | > loss_kl: 0.9923729300498962 (0.9517364584166428) | > loss_feat: 0.8442859053611755 (5.356456955445223) | > loss_mel: 16.547279357910156 (20.99235758288153) | > loss_duration: 1.6253612041473389 (1.6282103842702405) | > loss_1: 22.030811309814453 (31.33771189327898) | > grad_norm_1: tensor(11869.6631, device='cuda:0') (tensor(43516.3164, device='cuda:0')) | > current_lr_0: 0.00015328527689889107 | > current_lr_1: 0.00015328527689889107 | > step_time: 0.2768 (0.4682511543405467) | > loader_time: 0.0243 (0.014156834832553205)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9579367637634277 (2.9579367637634277) | > loss_disc_real_0: 0.31495505571365356 (0.31495505571365356) | > loss_disc_real_1: 0.3003796637058258 (0.3003796637058258) | > loss_disc_real_2: 0.2752569615840912 (0.2752569615840912) | > loss_disc_real_3: 0.2825164794921875 (0.2825164794921875) | > loss_disc_real_4: 0.2543764114379883 (0.2543764114379883) | > loss_disc_real_5: 0.3199126422405243 (0.3199126422405243) | > loss_0: 2.9579367637634277 (2.9579367637634277) | > loss_gen: 1.8622353076934814 (1.8622353076934814) | > loss_kl: 2.7721517086029053 (2.7721517086029053) | > loss_feat: 0.2786112129688263 (0.2786112129688263) | > loss_mel: 14.9574556350708 (14.9574556350708) | > loss_duration: 2.280073881149292 (2.280073881149292) | > loss_1: 22.150527954101562 (22.150527954101562)  --> STEP: 1 | > loss_disc: 2.080051898956299 (2.080051898956299) | > loss_disc_real_0: 0.05816724896430969 (0.05816724896430969) | > loss_disc_real_1: 0.31894758343696594 (0.31894758343696594) | > loss_disc_real_2: 0.2600416839122772 (0.2600416839122772) | > loss_disc_real_3: 0.3122241795063019 (0.3122241795063019) | > loss_disc_real_4: 0.15984421968460083 (0.15984421968460083) | > loss_disc_real_5: 0.18180003762245178 (0.18180003762245178) | > loss_0: 2.080051898956299 (2.080051898956299) | > loss_gen: 3.0124340057373047 (3.0124340057373047) | > loss_kl: 3.1626698970794678 (3.1626698970794678) | > loss_feat: 6.329570770263672 (6.329570770263672) | > loss_mel: 26.93546485900879 (26.93546485900879) | > loss_duration: 2.4714574813842773 (2.4714574813842773) | > loss_1: 41.911598205566406 (41.911598205566406)  --> STEP: 2 | > loss_disc: 2.1158220767974854 (2.097936987876892) | > loss_disc_real_0: 0.03971961885690689 (0.04894343391060829) | > loss_disc_real_1: 0.14495949447155 (0.23195353895425797) | > loss_disc_real_2: 0.19549955427646637 (0.2277706190943718) | > loss_disc_real_3: 0.060711514204740524 (0.1864678468555212) | > loss_disc_real_4: 0.04883289709687233 (0.10433855839073658) | > loss_disc_real_5: 0.02830754593014717 (0.10505379177629948) | > loss_0: 2.1158220767974854 (2.097936987876892) | > loss_gen: 1.965832233428955 (2.48913311958313) | > loss_kl: 3.552765130996704 (3.357717514038086) | > loss_feat: 8.505874633789062 (7.417722702026367) | > loss_mel: 28.819765090942383 (27.877614974975586) | > loss_duration: 2.3637382984161377 (2.4175978899002075) | > loss_1: 45.20797348022461 (43.55978584289551)  --> STEP: 3 | > loss_disc: 1.534220814704895 (1.9100315968195598) | > loss_disc_real_0: 0.04874733090400696 (0.04887806624174118) | > loss_disc_real_1: 0.22948211431503296 (0.23112973074118295) | > loss_disc_real_2: 0.09477464109659195 (0.1834386264284452) | > loss_disc_real_3: 0.3169109523296356 (0.22994888201355934) | > loss_disc_real_4: 0.1590905338525772 (0.12258921687801679) | > loss_disc_real_5: 0.0451299324631691 (0.08507917200525601) | > loss_0: 1.534220814704895 (1.9100315968195598) | > loss_gen: 3.291752338409424 (2.7566728591918945) | > loss_kl: 1.6540167331695557 (2.7898172537485757) | > loss_feat: 7.59655237197876 (7.477332592010498) | > loss_mel: 20.32350730895996 (25.35957908630371) | > loss_duration: 2.410196542739868 (2.4151307741800943) | > loss_1: 35.27602767944336 (40.79853312174479) --> EVAL PERFORMANCE | > avg_loader_time: 0.0065678755442301435 (+0.0037172635396321616) | > avg_loss_disc: 1.9100315968195598 (-1.0547933181126912) | > avg_loss_disc_real_0: 0.04887806624174118 (-0.10619371384382248) | > avg_loss_disc_real_1: 0.23112973074118295 (-0.047263259689013154) | > avg_loss_disc_real_2: 0.1834386264284452 (-0.1500170255700747) | > avg_loss_disc_real_3: 0.22994888201355934 (-0.02974607671300572) | > avg_loss_disc_real_4: 0.12258921687801679 (-0.15453814839323365) | > avg_loss_disc_real_5: 0.08507917200525601 (-0.2003727865715822) | > avg_loss_0: 1.9100315968195598 (-1.0547933181126912) | > avg_loss_gen: 2.7566728591918945 (+1.0423909028371174) | > avg_loss_kl: 2.7898172537485757 (+0.0964287519454956) | > avg_loss_feat: 7.477332592010498 (+6.339859493076801) | > avg_loss_mel: 25.35957908630371 (+9.681577523549398) | > avg_loss_duration: 2.4151307741800943 (-0.07429965337117528) | > avg_loss_1: 40.79853312174479 (+17.08595816294352)  > EPOCH: 267/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:34:21)   --> TIME: 2023-10-20 02:34:30 -- STEP: 9/50 -- GLOBAL_STEP: 66360 | > loss_disc: 2.915706157684326 (2.5264848470687866) | > loss_disc_real_0: 0.19310179352760315 (0.16768070879495806) | > loss_disc_real_1: 0.41617551445961 (0.24879247695207596) | > loss_disc_real_2: 0.3826506733894348 (0.27376356679532265) | > loss_disc_real_3: 0.4829215109348297 (0.31319330798255074) | > loss_disc_real_4: 0.34502294659614563 (0.2338892544309298) | > loss_disc_real_5: 0.25692057609558105 (0.1935254345751471) | > loss_0: 2.915706157684326 (2.5264848470687866) | > grad_norm_0: tensor(1141.0675, device='cuda:0') (tensor(1068.6918, device='cuda:0')) | > loss_gen: 2.7395272254943848 (2.312728590435452) | > loss_kl: 0.8509464859962463 (0.9847837885220846) | > loss_feat: 3.6406846046447754 (4.567536267969343) | > loss_mel: 23.651561737060547 (22.13455030653212) | > loss_duration: 1.6042848825454712 (1.6152521901660495) | > loss_1: 32.487003326416016 (31.614850574069553) | > grad_norm_1: tensor(5816.9478, device='cuda:0') (tensor(33430.1172, device='cuda:0')) | > current_lr_0: 0.0001531320586675378 | > current_lr_1: 0.0001531320586675378 | > step_time: 0.3803 (0.47255420684814453) | > loader_time: 0.0026 (0.01613195737202962)  --> TIME: 2023-10-20 02:34:41 -- STEP: 39/50 -- GLOBAL_STEP: 66390 | > loss_disc: 2.838898181915283 (2.573860831749745) | > loss_disc_real_0: 0.3171037435531616 (0.17504971911414313) | > loss_disc_real_1: 0.3768829107284546 (0.24382339513454682) | > loss_disc_real_2: 0.2080707997083664 (0.2296683659347204) | > loss_disc_real_3: 0.2413632869720459 (0.2610366623371076) | > loss_disc_real_4: 0.26914647221565247 (0.2324381010272564) | > loss_disc_real_5: 0.2391565889120102 (0.2257759312931926) | > loss_0: 2.838898181915283 (2.573860831749745) | > grad_norm_0: tensor(5668.4731, device='cuda:0') (tensor(2017.6559, device='cuda:0')) | > loss_gen: 1.8712396621704102 (2.3048126177910047) | > loss_kl: 0.5216288566589355 (0.9284133888207949) | > loss_feat: 0.6721476912498474 (4.675257805066231) | > loss_mel: 3.1355881690979004 (22.689908565619053) | > loss_duration: 1.6984366178512573 (1.6181354064207811) | > loss_1: 7.899041175842285 (32.21652757204496) | > grad_norm_1: tensor(31027.9805, device='cuda:0') (tensor(50312.1602, device='cuda:0')) | > current_lr_0: 0.0001531320586675378 | > current_lr_1: 0.0001531320586675378 | > step_time: 0.4387 (0.39137065716278857) | > loader_time: 0.0222 (0.00944986098851913)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6871447563171387 (2.6871447563171387) | > loss_disc_real_0: 0.23562553524971008 (0.23562553524971008) | > loss_disc_real_1: 0.2883588373661041 (0.2883588373661041) | > loss_disc_real_2: 0.25490689277648926 (0.25490689277648926) | > loss_disc_real_3: 0.23508773744106293 (0.23508773744106293) | > loss_disc_real_4: 0.21375705301761627 (0.21375705301761627) | > loss_disc_real_5: 0.18707652390003204 (0.18707652390003204) | > loss_0: 2.6871447563171387 (2.6871447563171387) | > loss_gen: 2.115049362182617 (2.115049362182617) | > loss_kl: 2.8086612224578857 (2.8086612224578857) | > loss_feat: 1.8336350917816162 (1.8336350917816162) | > loss_mel: 20.143199920654297 (20.143199920654297) | > loss_duration: 2.3189055919647217 (2.3189055919647217) | > loss_1: 29.219449996948242 (29.219449996948242)  --> STEP: 1 | > loss_disc: 1.566732406616211 (1.566732406616211) | > loss_disc_real_0: 0.08954634517431259 (0.08954634517431259) | > loss_disc_real_1: 0.11727152019739151 (0.11727152019739151) | > loss_disc_real_2: 0.04777911677956581 (0.04777911677956581) | > loss_disc_real_3: 0.07358801364898682 (0.07358801364898682) | > loss_disc_real_4: 0.10754091292619705 (0.10754091292619705) | > loss_disc_real_5: 0.07408291101455688 (0.07408291101455688) | > loss_0: 1.566732406616211 (1.566732406616211) | > loss_gen: 2.4520187377929688 (2.4520187377929688) | > loss_kl: 3.6438634395599365 (3.6438634395599365) | > loss_feat: 10.052515983581543 (10.052515983581543) | > loss_mel: 28.37961196899414 (28.37961196899414) | > loss_duration: 2.525381088256836 (2.525381088256836) | > loss_1: 47.05339050292969 (47.05339050292969)  --> STEP: 2 | > loss_disc: 2.6449379920959473 (2.105835199356079) | > loss_disc_real_0: 0.14785964787006378 (0.11870299652218819) | > loss_disc_real_1: 0.20270760357379913 (0.15998956188559532) | > loss_disc_real_2: 0.15459246933460236 (0.10118579305708408) | > loss_disc_real_3: 0.29586949944496155 (0.18472875654697418) | > loss_disc_real_4: 0.3102298378944397 (0.20888537541031837) | > loss_disc_real_5: 0.30354252457618713 (0.188812717795372) | > loss_0: 2.6449379920959473 (2.105835199356079) | > loss_gen: 2.13885498046875 (2.2954368591308594) | > loss_kl: 3.57206130027771 (3.6079623699188232) | > loss_feat: 3.2509703636169434 (6.651743173599243) | > loss_mel: 27.21404457092285 (27.796828269958496) | > loss_duration: 2.4073486328125 (2.466364860534668) | > loss_1: 38.58327865600586 (42.81833457946777)  --> STEP: 3 | > loss_disc: 2.6715054512023926 (2.294391949971517) | > loss_disc_real_0: 0.22278380393981934 (0.1533965989947319) | > loss_disc_real_1: 0.23296192288398743 (0.1843136822183927) | > loss_disc_real_2: 0.17520110309123993 (0.12585756306846937) | > loss_disc_real_3: 0.2815399169921875 (0.2169991433620453) | > loss_disc_real_4: 0.26811063289642334 (0.2286271279056867) | > loss_disc_real_5: 0.22481384873390198 (0.200813094774882) | > loss_0: 2.6715054512023926 (2.294391949971517) | > loss_gen: 1.914265513420105 (2.1683797438939414) | > loss_kl: 1.7076395750045776 (2.9745214382807412) | > loss_feat: 1.4599257707595825 (4.92113737265269) | > loss_mel: 21.02676010131836 (25.540138880411785) | > loss_duration: 2.406161069869995 (2.4462969303131104) | > loss_1: 28.51474952697754 (38.05047289530436) --> EVAL PERFORMANCE | > avg_loader_time: 0.014601945877075195 (+0.008034070332845051) | > avg_loss_disc: 2.294391949971517 (+0.38436035315195727) | > avg_loss_disc_real_0: 0.1533965989947319 (+0.10451853275299072) | > avg_loss_disc_real_1: 0.1843136822183927 (-0.046816048522790255) | > avg_loss_disc_real_2: 0.12585756306846937 (-0.057581063359975815) | > avg_loss_disc_real_3: 0.2169991433620453 (-0.012949738651514053) | > avg_loss_disc_real_4: 0.2286271279056867 (+0.10603791102766992) | > avg_loss_disc_real_5: 0.200813094774882 (+0.11573392276962598) | > avg_loss_0: 2.294391949971517 (+0.38436035315195727) | > avg_loss_gen: 2.1683797438939414 (-0.5882931152979531) | > avg_loss_kl: 2.9745214382807412 (+0.18470418453216553) | > avg_loss_feat: 4.92113737265269 (-2.556195219357808) | > avg_loss_mel: 25.540138880411785 (+0.1805597941080741) | > avg_loss_duration: 2.4462969303131104 (+0.0311661561330161) | > avg_loss_1: 38.05047289530436 (-2.7480602264404297)  > EPOCH: 268/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:34:57)   --> TIME: 2023-10-20 02:35:12 -- STEP: 19/50 -- GLOBAL_STEP: 66420 | > loss_disc: 3.136072874069214 (2.413002183562831) | > loss_disc_real_0: 0.3146132528781891 (0.15136624088412834) | > loss_disc_real_1: 0.267011433839798 (0.2193342359050324) | > loss_disc_real_2: 0.21591168642044067 (0.22104327164982496) | > loss_disc_real_3: 0.24238507449626923 (0.2345211645098109) | > loss_disc_real_4: 0.23989488184452057 (0.20826971021137738) | > loss_disc_real_5: 0.3088032007217407 (0.22018289860141904) | > loss_0: 3.136072874069214 (2.413002183562831) | > grad_norm_0: tensor(4043.9822, device='cuda:0') (tensor(1461.5594, device='cuda:0')) | > loss_gen: 1.5571918487548828 (2.3305243128224418) | > loss_kl: 0.6921151280403137 (0.8938789101023423) | > loss_feat: 0.31717151403427124 (4.544486794032548) | > loss_mel: 2.351496934890747 (21.55320412234256) | > loss_duration: 1.7285653352737427 (1.6466019843754016) | > loss_1: 6.646540641784668 (30.96869589153089) | > grad_norm_1: tensor(21468.8457, device='cuda:0') (tensor(50397.2344, device='cuda:0')) | > current_lr_0: 0.00015297899358739968 | > current_lr_1: 0.00015297899358739968 | > step_time: 0.6151 (0.4961602311385305) | > loader_time: 0.0226 (0.018707965549669768)  --> TIME: 2023-10-20 02:35:27 -- STEP: 49/50 -- GLOBAL_STEP: 66450 | > loss_disc: 1.853543996810913 (2.390072238688566) | > loss_disc_real_0: 0.06078944727778435 (0.17187281770213522) | > loss_disc_real_1: 0.1444743275642395 (0.21935882092434533) | > loss_disc_real_2: 0.07110575586557388 (0.20791244369988537) | > loss_disc_real_3: 0.3760421574115753 (0.23162500575488928) | > loss_disc_real_4: 0.25157690048217773 (0.2113925408647985) | > loss_disc_real_5: 0.1745445877313614 (0.22389476632281224) | > loss_0: 1.853543996810913 (2.390072238688566) | > grad_norm_0: tensor(590.0810, device='cuda:0') (tensor(1272.2775, device='cuda:0')) | > loss_gen: 2.9720382690429688 (2.4047508896613614) | > loss_kl: 0.4847188889980316 (0.9664417602577989) | > loss_feat: 4.656786918640137 (5.278695039451122) | > loss_mel: 29.463930130004883 (22.52710548225714) | > loss_duration: 1.7292596101760864 (1.6046994073050362) | > loss_1: 39.306732177734375 (32.781692524345544) | > grad_norm_1: tensor(13426.3857, device='cuda:0') (tensor(39477.3164, device='cuda:0')) | > current_lr_0: 0.00015297899358739968 | > current_lr_1: 0.00015297899358739968 | > step_time: 0.703 (0.4889213503623495) | > loader_time: 0.3144 (0.02523966224826112)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9156296253204346 (2.9156296253204346) | > loss_disc_real_0: 0.21393093466758728 (0.21393093466758728) | > loss_disc_real_1: 0.29065752029418945 (0.29065752029418945) | > loss_disc_real_2: 0.248097226023674 (0.248097226023674) | > loss_disc_real_3: 0.29291051626205444 (0.29291051626205444) | > loss_disc_real_4: 0.25868934392929077 (0.25868934392929077) | > loss_disc_real_5: 0.2654896676540375 (0.2654896676540375) | > loss_0: 2.9156296253204346 (2.9156296253204346) | > loss_gen: 1.687150478363037 (1.687150478363037) | > loss_kl: 3.2261295318603516 (3.2261295318603516) | > loss_feat: 0.4272751808166504 (0.4272751808166504) | > loss_mel: 19.945537567138672 (19.945537567138672) | > loss_duration: 2.4140191078186035 (2.4140191078186035) | > loss_1: 27.700111389160156 (27.700111389160156)  --> STEP: 1 | > loss_disc: 2.9454994201660156 (2.9454994201660156) | > loss_disc_real_0: 0.4076439142227173 (0.4076439142227173) | > loss_disc_real_1: 0.18742258846759796 (0.18742258846759796) | > loss_disc_real_2: 0.1695089340209961 (0.1695089340209961) | > loss_disc_real_3: 0.2015947550535202 (0.2015947550535202) | > loss_disc_real_4: 0.24132582545280457 (0.24132582545280457) | > loss_disc_real_5: 0.2917894124984741 (0.2917894124984741) | > loss_0: 2.9454994201660156 (2.9454994201660156) | > loss_gen: 1.901347041130066 (1.901347041130066) | > loss_kl: 3.2968411445617676 (3.2968411445617676) | > loss_feat: 4.375720977783203 (4.375720977783203) | > loss_mel: 25.004182815551758 (25.004182815551758) | > loss_duration: 2.541444778442383 (2.541444778442383) | > loss_1: 37.119537353515625 (37.119537353515625)  --> STEP: 2 | > loss_disc: 2.9682745933532715 (2.9568870067596436) | > loss_disc_real_0: 0.2906038463115692 (0.34912388026714325) | > loss_disc_real_1: 0.15349982678890228 (0.17046120762825012) | > loss_disc_real_2: 0.077079176902771 (0.12329405546188354) | > loss_disc_real_3: 0.22872242331504822 (0.2151585891842842) | > loss_disc_real_4: 0.1667373776435852 (0.20403160154819489) | > loss_disc_real_5: 0.25310036540031433 (0.2724448889493942) | > loss_0: 2.9682745933532715 (2.9568870067596436) | > loss_gen: 2.0355186462402344 (1.9684328436851501) | > loss_kl: 3.8055195808410645 (3.551180362701416) | > loss_feat: 7.0178422927856445 (5.696781635284424) | > loss_mel: 23.793197631835938 (24.398690223693848) | > loss_duration: 2.4687752723693848 (2.505110025405884) | > loss_1: 39.12085723876953 (38.12019729614258)  --> STEP: 3 | > loss_disc: 1.8695178031921387 (2.594430605570475) | > loss_disc_real_0: 0.11763115972280502 (0.2719596400856972) | > loss_disc_real_1: 0.2818399667739868 (0.207587460676829) | > loss_disc_real_2: 0.0958053320646286 (0.11413114766279857) | > loss_disc_real_3: 0.21297204494476318 (0.21442974110444388) | > loss_disc_real_4: 0.03904460743069649 (0.14903593684236208) | > loss_disc_real_5: 0.029207579791545868 (0.1913657858967781) | > loss_0: 1.8695178031921387 (2.594430605570475) | > loss_gen: 2.8139679431915283 (2.250277876853943) | > loss_kl: 1.762559413909912 (2.9549733797709146) | > loss_feat: 6.994709491729736 (6.129424254099528) | > loss_mel: 26.591053009033203 (25.129477818806965) | > loss_duration: 2.460956335067749 (2.4903921286265054) | > loss_1: 40.62324523925781 (38.95454661051432) --> EVAL PERFORMANCE | > avg_loader_time: 0.002291123072306315 (-0.01231082280476888) | > avg_loss_disc: 2.594430605570475 (+0.30003865559895804) | > avg_loss_disc_real_0: 0.2719596400856972 (+0.11856304109096527) | > avg_loss_disc_real_1: 0.207587460676829 (+0.02327377845843631) | > avg_loss_disc_real_2: 0.11413114766279857 (-0.011726415405670806) | > avg_loss_disc_real_3: 0.21442974110444388 (-0.002569402257601411) | > avg_loss_disc_real_4: 0.14903593684236208 (-0.07959119106332463) | > avg_loss_disc_real_5: 0.1913657858967781 (-0.009447308878103883) | > avg_loss_0: 2.594430605570475 (+0.30003865559895804) | > avg_loss_gen: 2.250277876853943 (+0.08189813296000148) | > avg_loss_kl: 2.9549733797709146 (-0.01954805850982666) | > avg_loss_feat: 6.129424254099528 (+1.2082868814468384) | > avg_loss_mel: 25.129477818806965 (-0.4106610616048201) | > avg_loss_duration: 2.4903921286265054 (+0.044095198313395034) | > avg_loss_1: 38.95454661051432 (+0.9040737152099609)  > EPOCH: 269/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:35:38)   --> TIME: 2023-10-20 02:35:58 -- STEP: 29/50 -- GLOBAL_STEP: 66480 | > loss_disc: 2.458217144012451 (2.5743918048924415) | > loss_disc_real_0: 0.020502889528870583 (0.1769004245128097) | > loss_disc_real_1: 0.3704744875431061 (0.20286731017303877) | > loss_disc_real_2: 0.2452871948480606 (0.22237079487792377) | > loss_disc_real_3: 0.4297493100166321 (0.2363495589073362) | > loss_disc_real_4: 0.031741805374622345 (0.22757583843736812) | > loss_disc_real_5: 0.17938752472400665 (0.2349138114729832) | > loss_0: 2.458217144012451 (2.5743918048924415) | > grad_norm_0: tensor(1727.9122, device='cuda:0') (tensor(1074.3582, device='cuda:0')) | > loss_gen: 2.566619396209717 (2.287602449285573) | > loss_kl: 0.8286199569702148 (0.9630606698578802) | > loss_feat: 6.658037185668945 (5.3207772112098235) | > loss_mel: 26.647537231445312 (23.409620243927527) | > loss_duration: 1.6002670526504517 (1.6116914872465462) | > loss_1: 38.30107879638672 (33.59275212781182) | > grad_norm_1: tensor(24214.7793, device='cuda:0') (tensor(40697.6758, device='cuda:0')) | > current_lr_0: 0.00015282608150539245 | > current_lr_1: 0.00015282608150539245 | > step_time: 0.6412 (0.5146623397695607) | > loader_time: 0.004 (0.011821722162180933)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5043692588806152 (1.5043692588806152) | > loss_disc_real_0: 0.0906314104795456 (0.0906314104795456) | > loss_disc_real_1: 0.0846237763762474 (0.0846237763762474) | > loss_disc_real_2: 0.12515850365161896 (0.12515850365161896) | > loss_disc_real_3: 0.18045881390571594 (0.18045881390571594) | > loss_disc_real_4: 0.12240225821733475 (0.12240225821733475) | > loss_disc_real_5: 0.15274260938167572 (0.15274260938167572) | > loss_0: 1.5043692588806152 (1.5043692588806152) | > loss_gen: 2.9649574756622314 (2.9649574756622314) | > loss_kl: 2.1716296672821045 (2.1716296672821045) | > loss_feat: 8.234763145446777 (8.234763145446777) | > loss_mel: 25.027700424194336 (25.027700424194336) | > loss_duration: 2.4085140228271484 (2.4085140228271484) | > loss_1: 40.80756378173828 (40.80756378173828)  --> STEP: 1 | > loss_disc: 3.065525770187378 (3.065525770187378) | > loss_disc_real_0: 0.4300360083580017 (0.4300360083580017) | > loss_disc_real_1: 0.32490769028663635 (0.32490769028663635) | > loss_disc_real_2: 0.2743164300918579 (0.2743164300918579) | > loss_disc_real_3: 0.277797132730484 (0.277797132730484) | > loss_disc_real_4: 0.3148135244846344 (0.3148135244846344) | > loss_disc_real_5: 0.23778226971626282 (0.23778226971626282) | > loss_0: 3.065525770187378 (3.065525770187378) | > loss_gen: 1.9131383895874023 (1.9131383895874023) | > loss_kl: 3.1534135341644287 (3.1534135341644287) | > loss_feat: 0.22099171578884125 (0.22099171578884125) | > loss_mel: 14.090616226196289 (14.090616226196289) | > loss_duration: 2.6550400257110596 (2.6550400257110596) | > loss_1: 22.033199310302734 (22.033199310302734)  --> STEP: 2 | > loss_disc: 2.7907707691192627 (2.9281482696533203) | > loss_disc_real_0: 0.2862677574157715 (0.3581518828868866) | > loss_disc_real_1: 0.4489196240901947 (0.3869136571884155) | > loss_disc_real_2: 0.20610709488391876 (0.24021176248788834) | > loss_disc_real_3: 0.34441515803337097 (0.3111061453819275) | > loss_disc_real_4: 0.2389366775751114 (0.2768751010298729) | > loss_disc_real_5: 0.21366609632968903 (0.22572418302297592) | > loss_0: 2.7907707691192627 (2.9281482696533203) | > loss_gen: 2.451569080352783 (2.1823537349700928) | > loss_kl: 3.625993490219116 (3.3897035121917725) | > loss_feat: 5.5696868896484375 (2.8953393027186394) | > loss_mel: 25.63407325744629 (19.86234474182129) | > loss_duration: 2.5683679580688477 (2.6117039918899536) | > loss_1: 39.84968948364258 (30.941444396972656)  --> STEP: 3 | > loss_disc: 2.0407629013061523 (2.632353146870931) | > loss_disc_real_0: 0.13010531663894653 (0.2821363608042399) | > loss_disc_real_1: 0.20786884427070618 (0.3272320528825124) | > loss_disc_real_2: 0.17670658230781555 (0.21904336909453073) | > loss_disc_real_3: 0.1120031476020813 (0.2447384794553121) | > loss_disc_real_4: 0.14682070910930634 (0.2335236370563507) | > loss_disc_real_5: 0.04810227081179619 (0.1665168789525827) | > loss_0: 2.0407629013061523 (2.632353146870931) | > loss_gen: 2.4552628993988037 (2.2733234564463296) | > loss_kl: 1.5364789962768555 (2.7719620068868003) | > loss_feat: 7.526633262634277 (4.439103956023852) | > loss_mel: 29.10246467590332 (22.942384719848633) | > loss_duration: 2.5121450424194336 (2.5785176753997803) | > loss_1: 43.13298416137695 (35.00529098510742) --> EVAL PERFORMANCE | > avg_loader_time: 0.0064347585042317705 (+0.004143635431925455) | > avg_loss_disc: 2.632353146870931 (+0.037922541300456025) | > avg_loss_disc_real_0: 0.2821363608042399 (+0.010176720718542753) | > avg_loss_disc_real_1: 0.3272320528825124 (+0.11964459220568338) | > avg_loss_disc_real_2: 0.21904336909453073 (+0.10491222143173216) | > avg_loss_disc_real_3: 0.2447384794553121 (+0.030308738350868225) | > avg_loss_disc_real_4: 0.2335236370563507 (+0.08448770021398863) | > avg_loss_disc_real_5: 0.1665168789525827 (-0.02484890694419542) | > avg_loss_0: 2.632353146870931 (+0.037922541300456025) | > avg_loss_gen: 2.2733234564463296 (+0.023045579592386733) | > avg_loss_kl: 2.7719620068868003 (-0.1830113728841143) | > avg_loss_feat: 4.439103956023852 (-1.690320298075676) | > avg_loss_mel: 22.942384719848633 (-2.187093098958332) | > avg_loss_duration: 2.5785176753997803 (+0.08812554677327489) | > avg_loss_1: 35.00529098510742 (-3.9492556254068987)  > EPOCH: 270/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:36:17)   --> TIME: 2023-10-20 02:36:25 -- STEP: 9/50 -- GLOBAL_STEP: 66510 | > loss_disc: 2.6123828887939453 (2.156898339589437) | > loss_disc_real_0: 0.06500458717346191 (0.167096682306793) | > loss_disc_real_1: 0.2019883543252945 (0.24776291102170944) | > loss_disc_real_2: 0.17751477658748627 (0.2505980415476693) | > loss_disc_real_3: 0.23205360770225525 (0.26188164287143284) | > loss_disc_real_4: 0.138045534491539 (0.15872502761582533) | > loss_disc_real_5: 0.17096757888793945 (0.16290874489479595) | > loss_0: 2.6123828887939453 (2.156898339589437) | > grad_norm_0: tensor(847.2533, device='cuda:0') (tensor(952.9411, device='cuda:0')) | > loss_gen: 1.5627381801605225 (2.9384191830952964) | > loss_kl: 0.906302809715271 (0.9818207621574402) | > loss_feat: 5.152679920196533 (7.323618200090197) | > loss_mel: 20.275127410888672 (24.00996208190918) | > loss_duration: 1.5412743091583252 (1.5928311745325725) | > loss_1: 29.43812370300293 (36.84665171305338) | > grad_norm_1: tensor(8911.3828, device='cuda:0') (tensor(56048.5508, device='cuda:0')) | > current_lr_0: 0.00015267332226858493 | > current_lr_1: 0.00015267332226858493 | > step_time: 0.5233 (0.5278037918938531) | > loader_time: 0.0018 (0.015997224383884005)  --> TIME: 2023-10-20 02:36:38 -- STEP: 39/50 -- GLOBAL_STEP: 66540 | > loss_disc: 2.170045852661133 (2.203207547848041) | > loss_disc_real_0: 0.021851714700460434 (0.12906209018845594) | > loss_disc_real_1: 0.08122674375772476 (0.23250286300212908) | > loss_disc_real_2: 0.08288425207138062 (0.2078673436951179) | > loss_disc_real_3: 0.03653334081172943 (0.2469793394781076) | > loss_disc_real_4: 0.06756485998630524 (0.17086867226335484) | > loss_disc_real_5: 0.026340600103139877 (0.183029899540811) | > loss_0: 2.170045852661133 (2.203207547848041) | > grad_norm_0: tensor(1645.1969, device='cuda:0') (tensor(1133.7836, device='cuda:0')) | > loss_gen: 1.9912970066070557 (2.784599188046578) | > loss_kl: 0.7785564661026001 (0.9345733790825574) | > loss_feat: 10.30248737335205 (7.136525587107126) | > loss_mel: 28.39533805847168 (24.99389996895423) | > loss_duration: 1.64222252368927 (1.5913736697955012) | > loss_1: 43.10990524291992 (37.44097203474779) | > grad_norm_1: tensor(52190.6641, device='cuda:0') (tensor(62533.1016, device='cuda:0')) | > current_lr_0: 0.00015267332226858493 | > current_lr_1: 0.00015267332226858493 | > step_time: 0.7694 (0.4453567052498842) | > loader_time: 0.0244 (0.009985825954339443)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1466236114501953 (2.1466236114501953) | > loss_disc_real_0: 0.28272947669029236 (0.28272947669029236) | > loss_disc_real_1: 0.14391249418258667 (0.14391249418258667) | > loss_disc_real_2: 0.1355178952217102 (0.1355178952217102) | > loss_disc_real_3: 0.2741549015045166 (0.2741549015045166) | > loss_disc_real_4: 0.10673423111438751 (0.10673423111438751) | > loss_disc_real_5: 0.24434179067611694 (0.24434179067611694) | > loss_0: 2.1466236114501953 (2.1466236114501953) | > loss_gen: 2.9161312580108643 (2.9161312580108643) | > loss_kl: 2.673739433288574 (2.673739433288574) | > loss_feat: 7.369674205780029 (7.369674205780029) | > loss_mel: 26.719999313354492 (26.719999313354492) | > loss_duration: 2.310962677001953 (2.310962677001953) | > loss_1: 41.99050521850586 (41.99050521850586)  --> STEP: 1 | > loss_disc: 2.4404616355895996 (2.4404616355895996) | > loss_disc_real_0: 0.15297289192676544 (0.15297289192676544) | > loss_disc_real_1: 0.17227984964847565 (0.17227984964847565) | > loss_disc_real_2: 0.11518847197294235 (0.11518847197294235) | > loss_disc_real_3: 0.21460960805416107 (0.21460960805416107) | > loss_disc_real_4: 0.21815645694732666 (0.21815645694732666) | > loss_disc_real_5: 0.27700379490852356 (0.27700379490852356) | > loss_0: 2.4404616355895996 (2.4404616355895996) | > loss_gen: 2.0695767402648926 (2.0695767402648926) | > loss_kl: 3.588071584701538 (3.588071584701538) | > loss_feat: 4.210959434509277 (4.210959434509277) | > loss_mel: 22.629335403442383 (22.629335403442383) | > loss_duration: 2.528881788253784 (2.528881788253784) | > loss_1: 35.026824951171875 (35.026824951171875)  --> STEP: 2 | > loss_disc: 1.5966250896453857 (2.0185433626174927) | > loss_disc_real_0: 0.11012770235538483 (0.13155029714107513) | > loss_disc_real_1: 0.08914605528116226 (0.13071295246481895) | > loss_disc_real_2: 0.11437711119651794 (0.11478279158473015) | > loss_disc_real_3: 0.1316278576850891 (0.1731187328696251) | > loss_disc_real_4: 0.05085822567343712 (0.1345073413103819) | > loss_disc_real_5: 0.03905981034040451 (0.15803180262446404) | > loss_0: 1.5966250896453857 (2.0185433626174927) | > loss_gen: 2.7113723754882812 (2.390474557876587) | > loss_kl: 4.045260906219482 (3.8166662454605103) | > loss_feat: 12.20147705078125 (8.206218242645264) | > loss_mel: 28.111080169677734 (25.37020778656006) | > loss_duration: 2.42387056350708 (2.476376175880432) | > loss_1: 49.49306106567383 (42.25994300842285)  --> STEP: 3 | > loss_disc: 3.1282973289489746 (2.3884613513946533) | > loss_disc_real_0: 0.26288744807243347 (0.17532934745152792) | > loss_disc_real_1: 0.30532291531562805 (0.18891627341508865) | > loss_disc_real_2: 0.2582830488681793 (0.1626162106792132) | > loss_disc_real_3: 0.3126581311225891 (0.2196318656206131) | > loss_disc_real_4: 0.3873650133609772 (0.21879323199391365) | > loss_disc_real_5: 0.42478203773498535 (0.24694854766130447) | > loss_0: 3.1282973289489746 (2.3884613513946533) | > loss_gen: 2.1690986156463623 (2.3166825771331787) | > loss_kl: 1.7232751846313477 (3.1188692251841226) | > loss_feat: 2.3156542778015137 (6.242696921030681) | > loss_mel: 22.528858184814453 (24.423091252644856) | > loss_duration: 2.350066661834717 (2.4342730045318604) | > loss_1: 31.086952209472656 (38.53561274210612) --> EVAL PERFORMANCE | > avg_loader_time: 0.005885203679402669 (-0.0005495548248291016) | > avg_loss_disc: 2.3884613513946533 (-0.24389179547627782) | > avg_loss_disc_real_0: 0.17532934745152792 (-0.106807013352712) | > avg_loss_disc_real_1: 0.18891627341508865 (-0.13831577946742374) | > avg_loss_disc_real_2: 0.1626162106792132 (-0.056427158415317535) | > avg_loss_disc_real_3: 0.2196318656206131 (-0.025106613834699004) | > avg_loss_disc_real_4: 0.21879323199391365 (-0.014730405062437057) | > avg_loss_disc_real_5: 0.24694854766130447 (+0.08043166870872179) | > avg_loss_0: 2.3884613513946533 (-0.24389179547627782) | > avg_loss_gen: 2.3166825771331787 (+0.043359120686849106) | > avg_loss_kl: 3.1188692251841226 (+0.3469072182973223) | > avg_loss_feat: 6.242696921030681 (+1.8035929650068283) | > avg_loss_mel: 24.423091252644856 (+1.4807065327962228) | > avg_loss_duration: 2.4342730045318604 (-0.14424467086791992) | > avg_loss_1: 38.53561274210612 (+3.5303217569986955)  > EPOCH: 271/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:36:55)   --> TIME: 2023-10-20 02:37:09 -- STEP: 19/50 -- GLOBAL_STEP: 66570 | > loss_disc: 2.3844656944274902 (2.351107302464937) | > loss_disc_real_0: 0.201118603348732 (0.18556128216809348) | > loss_disc_real_1: 0.2465798407793045 (0.19733875499744163) | > loss_disc_real_2: 0.12611767649650574 (0.1922575542213101) | > loss_disc_real_3: 0.24738599359989166 (0.21445320958369657) | > loss_disc_real_4: 0.2055843621492386 (0.2036968270120652) | > loss_disc_real_5: 0.2309015691280365 (0.23671636799056278) | > loss_0: 2.3844656944274902 (2.351107302464937) | > grad_norm_0: tensor(1302.9208, device='cuda:0') (tensor(1117.9343, device='cuda:0')) | > loss_gen: 2.8200125694274902 (2.4308613476000334) | > loss_kl: 0.9491413831710815 (0.8498341817604868) | > loss_feat: 8.330190658569336 (5.751587306639474) | > loss_mel: 26.64511489868164 (23.355695523713763) | > loss_duration: 1.764604926109314 (1.660076749952216) | > loss_1: 40.509063720703125 (34.04805426848562) | > grad_norm_1: tensor(60115.3086, device='cuda:0') (tensor(48987.9102, device='cuda:0')) | > current_lr_0: 0.00015252071572419878 | > current_lr_1: 0.00015252071572419878 | > step_time: 0.5903 (0.5237645350004497) | > loader_time: 0.0245 (0.017996336284436677)  --> TIME: 2023-10-20 02:37:25 -- STEP: 49/50 -- GLOBAL_STEP: 66600 | > loss_disc: 2.8961546421051025 (2.4818124625147604) | > loss_disc_real_0: 0.30905547738075256 (0.18884919165652625) | > loss_disc_real_1: 0.2721744775772095 (0.21879260188766889) | > loss_disc_real_2: 0.23713022470474243 (0.21308120001791692) | > loss_disc_real_3: 0.31015467643737793 (0.22510586823431813) | > loss_disc_real_4: 0.23091112077236176 (0.2255311837343841) | > loss_disc_real_5: 0.25648340582847595 (0.2206755058117667) | > loss_0: 2.8961546421051025 (2.4818124625147604) | > grad_norm_0: tensor(1113.8831, device='cuda:0') (tensor(1067.8922, device='cuda:0')) | > loss_gen: 1.7665390968322754 (2.2890643076020845) | > loss_kl: 0.529190719127655 (0.8826352224058035) | > loss_feat: 0.515518844127655 (5.091244346728281) | > loss_mel: 5.368609428405762 (21.446363962426478) | > loss_duration: 1.7755413055419922 (1.6134985125794703) | > loss_1: 9.955399513244629 (31.322805978813946) | > grad_norm_1: tensor(38946.2266, device='cuda:0') (tensor(41795.9922, device='cuda:0')) | > current_lr_0: 0.00015252071572419878 | > current_lr_1: 0.00015252071572419878 | > step_time: 0.3911 (0.4997789470516907) | > loader_time: 0.3605 (0.025299923760550357)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9264988899230957 (2.9264988899230957) | > loss_disc_real_0: 0.3527602553367615 (0.3527602553367615) | > loss_disc_real_1: 0.21340347826480865 (0.21340347826480865) | > loss_disc_real_2: 0.4100932478904724 (0.4100932478904724) | > loss_disc_real_3: 0.2049873322248459 (0.2049873322248459) | > loss_disc_real_4: 0.21846143901348114 (0.21846143901348114) | > loss_disc_real_5: 0.357697069644928 (0.357697069644928) | > loss_0: 2.9264988899230957 (2.9264988899230957) | > loss_gen: 2.3829257488250732 (2.3829257488250732) | > loss_kl: 2.6011276245117188 (2.6011276245117188) | > loss_feat: 6.973299026489258 (6.973299026489258) | > loss_mel: 22.53525733947754 (22.53525733947754) | > loss_duration: 2.3398051261901855 (2.3398051261901855) | > loss_1: 36.83241653442383 (36.83241653442383)  --> STEP: 1 | > loss_disc: 2.8688864707946777 (2.8688864707946777) | > loss_disc_real_0: 0.21707716584205627 (0.21707716584205627) | > loss_disc_real_1: 0.25492340326309204 (0.25492340326309204) | > loss_disc_real_2: 0.20143689215183258 (0.20143689215183258) | > loss_disc_real_3: 0.32351061701774597 (0.32351061701774597) | > loss_disc_real_4: 0.25852057337760925 (0.25852057337760925) | > loss_disc_real_5: 0.28864482045173645 (0.28864482045173645) | > loss_0: 2.8688864707946777 (2.8688864707946777) | > loss_gen: 1.725480318069458 (1.725480318069458) | > loss_kl: 3.3504550457000732 (3.3504550457000732) | > loss_feat: 0.8060324788093567 (0.8060324788093567) | > loss_mel: 17.634761810302734 (17.634761810302734) | > loss_duration: 2.571392774581909 (2.571392774581909) | > loss_1: 26.08812141418457 (26.08812141418457)  --> STEP: 2 | > loss_disc: 2.4552268981933594 (2.6620566844940186) | > loss_disc_real_0: 0.17386534810066223 (0.19547125697135925) | > loss_disc_real_1: 0.18338342010974884 (0.21915341168642044) | > loss_disc_real_2: 0.1657373011112213 (0.18358709663152695) | > loss_disc_real_3: 0.10615994036197662 (0.2148352786898613) | > loss_disc_real_4: 0.11127172410488129 (0.18489614874124527) | > loss_disc_real_5: 0.07359485328197479 (0.18111983686685562) | > loss_0: 2.4552268981933594 (2.6620566844940186) | > loss_gen: 2.283330202102661 (2.0044052600860596) | > loss_kl: 3.7204723358154297 (3.5354636907577515) | > loss_feat: 11.163615226745605 (5.984823852777481) | > loss_mel: 25.818443298339844 (21.72660255432129) | > loss_duration: 2.464751958847046 (2.5180723667144775) | > loss_1: 45.45061111450195 (35.76936626434326)  --> STEP: 3 | > loss_disc: 2.0503861904144287 (2.458166519800822) | > loss_disc_real_0: 0.18085335195064545 (0.19059862196445465) | > loss_disc_real_1: 0.07575815916061401 (0.1713549941778183) | > loss_disc_real_2: 0.05966930091381073 (0.14228116472562155) | > loss_disc_real_3: 0.060891009867191315 (0.16352052241563797) | > loss_disc_real_4: 0.09132961183786392 (0.15370730310678482) | > loss_disc_real_5: 0.19607806205749512 (0.18610591193040213) | > loss_0: 2.0503861904144287 (2.458166519800822) | > loss_gen: 3.6761186122894287 (2.561643044153849) | > loss_kl: 1.5579794645309448 (2.8763022820154824) | > loss_feat: 9.181817054748535 (7.050488253434499) | > loss_mel: 25.35064697265625 (22.93461736043294) | > loss_duration: 2.3102223873138428 (2.448789040247599) | > loss_1: 42.0767822265625 (37.87183825174967) --> EVAL PERFORMANCE | > avg_loader_time: 0.007084846496582031 (+0.0011996428171793623) | > avg_loss_disc: 2.458166519800822 (+0.06970516840616847) | > avg_loss_disc_real_0: 0.19059862196445465 (+0.015269274512926728) | > avg_loss_disc_real_1: 0.1713549941778183 (-0.017561279237270355) | > avg_loss_disc_real_2: 0.14228116472562155 (-0.020335045953591646) | > avg_loss_disc_real_3: 0.16352052241563797 (-0.05611134320497513) | > avg_loss_disc_real_4: 0.15370730310678482 (-0.06508592888712883) | > avg_loss_disc_real_5: 0.18610591193040213 (-0.060842635730902345) | > avg_loss_0: 2.458166519800822 (+0.06970516840616847) | > avg_loss_gen: 2.561643044153849 (+0.24496046702067042) | > avg_loss_kl: 2.8763022820154824 (-0.24256694316864014) | > avg_loss_feat: 7.050488253434499 (+0.8077913324038182) | > avg_loss_mel: 22.93461736043294 (-1.488473892211914) | > avg_loss_duration: 2.448789040247599 (+0.014516035715738784) | > avg_loss_1: 37.87183825174967 (-0.6637744903564453)  > EPOCH: 272/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:37:37)   --> TIME: 2023-10-20 02:37:57 -- STEP: 29/50 -- GLOBAL_STEP: 66630 | > loss_disc: 2.926823854446411 (2.4794533540462624) | > loss_disc_real_0: 0.22684773802757263 (0.16874170251961412) | > loss_disc_real_1: 0.25596603751182556 (0.22001747196090632) | > loss_disc_real_2: 0.2545609772205353 (0.21834458975956358) | > loss_disc_real_3: 0.2502395510673523 (0.24115107478252773) | > loss_disc_real_4: 0.23132874071598053 (0.2515740674631349) | > loss_disc_real_5: 0.21982930600643158 (0.24118264636089062) | > loss_0: 2.926823854446411 (2.4794533540462624) | > grad_norm_0: tensor(1180.6489, device='cuda:0') (tensor(1099.7815, device='cuda:0')) | > loss_gen: 1.5554704666137695 (2.2956394244884617) | > loss_kl: 0.956153929233551 (0.8994389525775252) | > loss_feat: 0.3024875521659851 (4.964040586660648) | > loss_mel: 10.373200416564941 (21.462163999162872) | > loss_duration: 1.6457480192184448 (1.6290001951414963) | > loss_1: 14.833060264587402 (31.250282780877477) | > grad_norm_1: tensor(21247.7012, device='cuda:0') (tensor(44858.9766, device='cuda:0')) | > current_lr_0: 0.0001523682617196083 | > current_lr_1: 0.0001523682617196083 | > step_time: 0.5913 (0.5000301393969306) | > loader_time: 0.0039 (0.017464473329741374)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.205203056335449 (2.205203056335449) | > loss_disc_real_0: 0.12482499331235886 (0.12482499331235886) | > loss_disc_real_1: 0.1829896867275238 (0.1829896867275238) | > loss_disc_real_2: 0.28502485156059265 (0.28502485156059265) | > loss_disc_real_3: 0.33958566188812256 (0.33958566188812256) | > loss_disc_real_4: 0.3438138961791992 (0.3438138961791992) | > loss_disc_real_5: 0.20020189881324768 (0.20020189881324768) | > loss_0: 2.205203056335449 (2.205203056335449) | > loss_gen: 2.868784189224243 (2.868784189224243) | > loss_kl: 3.8205487728118896 (3.8205487728118896) | > loss_feat: 7.129837989807129 (7.129837989807129) | > loss_mel: 24.531742095947266 (24.531742095947266) | > loss_duration: 2.442800760269165 (2.442800760269165) | > loss_1: 40.79371643066406 (40.79371643066406)  --> STEP: 1 | > loss_disc: 2.960972785949707 (2.960972785949707) | > loss_disc_real_0: 0.34023594856262207 (0.34023594856262207) | > loss_disc_real_1: 0.28104618191719055 (0.28104618191719055) | > loss_disc_real_2: 0.2960832118988037 (0.2960832118988037) | > loss_disc_real_3: 0.2566213309764862 (0.2566213309764862) | > loss_disc_real_4: 0.23476745188236237 (0.23476745188236237) | > loss_disc_real_5: 0.24864181876182556 (0.24864181876182556) | > loss_0: 2.960972785949707 (2.960972785949707) | > loss_gen: 1.738173484802246 (1.738173484802246) | > loss_kl: 2.575525999069214 (2.575525999069214) | > loss_feat: 0.20299935340881348 (0.20299935340881348) | > loss_mel: 16.858280181884766 (16.858280181884766) | > loss_duration: 2.4864132404327393 (2.4864132404327393) | > loss_1: 23.86139488220215 (23.86139488220215)  --> STEP: 2 | > loss_disc: 3.027833938598633 (2.99440336227417) | > loss_disc_real_0: 0.34345299005508423 (0.34184446930885315) | > loss_disc_real_1: 0.28463536500930786 (0.2828407734632492) | > loss_disc_real_2: 0.31070828437805176 (0.30339574813842773) | > loss_disc_real_3: 0.2589512765407562 (0.2577863037586212) | > loss_disc_real_4: 0.24131280183792114 (0.23804012686014175) | > loss_disc_real_5: 0.24815160036087036 (0.24839670956134796) | > loss_0: 3.027833938598633 (2.99440336227417) | > loss_gen: 1.6840169429779053 (1.7110952138900757) | > loss_kl: 3.531933546066284 (3.053729772567749) | > loss_feat: 0.008903970010578632 (0.10595166170969605) | > loss_mel: 0.8517670035362244 (8.855023592710495) | > loss_duration: 2.417567253112793 (2.451990246772766) | > loss_1: 8.49418830871582 (16.177791595458984)  --> STEP: 3 | > loss_disc: 3.0287444591522217 (3.005850394566854) | > loss_disc_real_0: 0.34394586086273193 (0.34254493316014606) | > loss_disc_real_1: 0.2846553325653076 (0.2834456264972687) | > loss_disc_real_2: 0.3106730878353119 (0.3058215280373891) | > loss_disc_real_3: 0.25896596908569336 (0.25817952553431195) | > loss_disc_real_4: 0.24127793312072754 (0.23911939561367035) | > loss_disc_real_5: 0.24820959568023682 (0.24833433826764426) | > loss_0: 3.0287444591522217 (3.005850394566854) | > loss_gen: 1.6835225820541382 (1.70190433661143) | > loss_kl: 1.5133137702941895 (2.540257771809896) | > loss_feat: 0.012008128687739372 (0.07463715070237716) | > loss_mel: 1.545621633529663 (6.418556272983551) | > loss_duration: 2.444443702697754 (2.4494747320810952) | > loss_1: 7.198909759521484 (13.184830983479818) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031652450561523438 (-0.0039196014404296875) | > avg_loss_disc: 3.005850394566854 (+0.5476838747660322) | > avg_loss_disc_real_0: 0.34254493316014606 (+0.1519463111956914) | > avg_loss_disc_real_1: 0.2834456264972687 (+0.11209063231945038) | > avg_loss_disc_real_2: 0.3058215280373891 (+0.16354036331176755) | > avg_loss_disc_real_3: 0.25817952553431195 (+0.09465900311867398) | > avg_loss_disc_real_4: 0.23911939561367035 (+0.08541209250688553) | > avg_loss_disc_real_5: 0.24833433826764426 (+0.062228426337242126) | > avg_loss_0: 3.005850394566854 (+0.5476838747660322) | > avg_loss_gen: 1.70190433661143 (-0.8597387075424192) | > avg_loss_kl: 2.540257771809896 (-0.33604451020558646) | > avg_loss_feat: 0.07463715070237716 (-6.975851102732122) | > avg_loss_mel: 6.418556272983551 (-16.51606108744939) | > avg_loss_duration: 2.4494747320810952 (+0.0006856918334960938) | > avg_loss_1: 13.184830983479818 (-24.687007268269852) > BEST MODEL : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/best_model_66651.pth  > EPOCH: 273/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:38:18)   --> TIME: 2023-10-20 02:38:27 -- STEP: 9/50 -- GLOBAL_STEP: 66660 | > loss_disc: 1.757096767425537 (2.3084008958604603) | > loss_disc_real_0: 0.0412602461874485 (0.14956779591739178) | > loss_disc_real_1: 0.154652938246727 (0.21252714925342137) | > loss_disc_real_2: 0.13321581482887268 (0.21330889148844612) | > loss_disc_real_3: 0.36980172991752625 (0.25360651148690116) | > loss_disc_real_4: 0.0774962306022644 (0.18408616880575815) | > loss_disc_real_5: 0.21328061819076538 (0.17896177536911434) | > loss_0: 1.757096767425537 (2.3084008958604603) | > grad_norm_0: tensor(842.7706, device='cuda:0') (tensor(939.8644, device='cuda:0')) | > loss_gen: 2.9320476055145264 (2.40393861134847) | > loss_kl: 0.7793933749198914 (0.9359110196431478) | > loss_feat: 7.50260591506958 (6.498809100853072) | > loss_mel: 24.88648223876953 (22.710139645470512) | > loss_duration: 1.5598762035369873 (1.6187022262149386) | > loss_1: 37.660404205322266 (34.1675001780192) | > grad_norm_1: tensor(6266.2627, device='cuda:0') (tensor(34246.8203, device='cuda:0')) | > current_lr_0: 0.00015221596010234046 | > current_lr_1: 0.00015221596010234046 | > step_time: 0.2539 (0.503506580988566) | > loader_time: 0.003 (0.016344308853149414)  --> TIME: 2023-10-20 02:38:40 -- STEP: 39/50 -- GLOBAL_STEP: 66690 | > loss_disc: 2.864525556564331 (2.429201673238705) | > loss_disc_real_0: 0.2932056188583374 (0.1653892308091506) | > loss_disc_real_1: 0.24227790534496307 (0.21654557360288423) | > loss_disc_real_2: 0.2304234653711319 (0.2270535588837587) | > loss_disc_real_3: 0.25142672657966614 (0.2304266435213578) | > loss_disc_real_4: 0.31327277421951294 (0.2157721458337246) | > loss_disc_real_5: 0.30739638209342957 (0.21807928677075183) | > loss_0: 2.864525556564331 (2.429201673238705) | > grad_norm_0: tensor(1287.9647, device='cuda:0') (tensor(1151.6075, device='cuda:0')) | > loss_gen: 1.8661597967147827 (2.473349717947153) | > loss_kl: 0.4428435266017914 (0.9558477822022561) | > loss_feat: 0.4487580358982086 (5.337174319686034) | > loss_mel: 2.4877116680145264 (22.41024447710086) | > loss_duration: 1.7086315155029297 (1.6127492709037585) | > loss_1: 6.954104423522949 (32.789365108196556) | > grad_norm_1: tensor(25469.9883, device='cuda:0') (tensor(34343.3633, device='cuda:0')) | > current_lr_0: 0.00015221596010234046 | > current_lr_1: 0.00015221596010234046 | > step_time: 0.7054 (0.4263516389406644) | > loader_time: 0.022 (0.010865621077708708)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.963202953338623 (1.963202953338623) | > loss_disc_real_0: 0.04640738293528557 (0.04640738293528557) | > loss_disc_real_1: 0.07219739258289337 (0.07219739258289337) | > loss_disc_real_2: 0.10175449401140213 (0.10175449401140213) | > loss_disc_real_3: 0.16230595111846924 (0.16230595111846924) | > loss_disc_real_4: 0.07396210730075836 (0.07396210730075836) | > loss_disc_real_5: 0.17165936529636383 (0.17165936529636383) | > loss_0: 1.963202953338623 (1.963202953338623) | > loss_gen: 2.0566415786743164 (2.0566415786743164) | > loss_kl: 3.5197670459747314 (3.5197670459747314) | > loss_feat: 8.462478637695312 (8.462478637695312) | > loss_mel: 32.261592864990234 (32.261592864990234) | > loss_duration: 2.3826487064361572 (2.3826487064361572) | > loss_1: 48.683128356933594 (48.683128356933594)  --> STEP: 1 | > loss_disc: 3.3925538063049316 (3.3925538063049316) | > loss_disc_real_0: 0.4353732466697693 (0.4353732466697693) | > loss_disc_real_1: 0.4149992763996124 (0.4149992763996124) | > loss_disc_real_2: 0.511064887046814 (0.511064887046814) | > loss_disc_real_3: 0.3894263207912445 (0.3894263207912445) | > loss_disc_real_4: 0.26000499725341797 (0.26000499725341797) | > loss_disc_real_5: 0.296252578496933 (0.296252578496933) | > loss_0: 3.3925538063049316 (3.3925538063049316) | > loss_gen: 2.064730405807495 (2.064730405807495) | > loss_kl: 3.7932040691375732 (3.7932040691375732) | > loss_feat: 0.50059974193573 (0.50059974193573) | > loss_mel: 14.623796463012695 (14.623796463012695) | > loss_duration: 2.533535957336426 (2.533535957336426) | > loss_1: 23.515865325927734 (23.515865325927734)  --> STEP: 2 | > loss_disc: 3.41798996925354 (3.405271887779236) | > loss_disc_real_0: 0.4259730577468872 (0.43067315220832825) | > loss_disc_real_1: 0.41488775610923767 (0.41494351625442505) | > loss_disc_real_2: 0.5103448629379272 (0.5107048749923706) | > loss_disc_real_3: 0.3895789086818695 (0.389502614736557) | > loss_disc_real_4: 0.26079583168029785 (0.2604004144668579) | > loss_disc_real_5: 0.29625242948532104 (0.296252503991127) | > loss_0: 3.41798996925354 (3.405271887779236) | > loss_gen: 2.0119307041168213 (2.038330554962158) | > loss_kl: 3.32673978805542 (3.5599719285964966) | > loss_feat: 0.5581938624382019 (0.5293968021869659) | > loss_mel: 3.4413089752197266 (9.032552719116211) | > loss_duration: 2.3879785537719727 (2.460757255554199) | > loss_1: 11.726151466369629 (17.62100839614868)  --> STEP: 3 | > loss_disc: 2.393350601196289 (3.067964792251587) | > loss_disc_real_0: 0.27154624462127686 (0.3776308496793111) | > loss_disc_real_1: 0.23485299944877625 (0.35491334398587543) | > loss_disc_real_2: 0.1857946366071701 (0.40240146219730377) | > loss_disc_real_3: 0.3204779624938965 (0.36649439732233685) | > loss_disc_real_4: 0.04411100968718529 (0.18830394620696703) | > loss_disc_real_5: 0.13319940865039825 (0.2419014722108841) | > loss_0: 2.393350601196289 (3.067964792251587) | > loss_gen: 2.318140983581543 (2.1316006978352866) | > loss_kl: 1.7591861486434937 (2.9597100019454956) | > loss_feat: 5.40071964263916 (2.1531710823376975) | > loss_mel: 24.070167541503906 (14.045090993245443) | > loss_duration: 2.4575514793395996 (2.459688663482666) | > loss_1: 36.00576400756836 (23.749260266621906) --> EVAL PERFORMANCE | > avg_loader_time: 0.002126455307006836 (-0.0010387897491455078) | > avg_loss_disc: 3.067964792251587 (+0.062114397684732925) | > avg_loss_disc_real_0: 0.3776308496793111 (+0.03508591651916504) | > avg_loss_disc_real_1: 0.35491334398587543 (+0.07146771748860675) | > avg_loss_disc_real_2: 0.40240146219730377 (+0.09657993415991467) | > avg_loss_disc_real_3: 0.36649439732233685 (+0.1083148717880249) | > avg_loss_disc_real_4: 0.18830394620696703 (-0.05081544940670332) | > avg_loss_disc_real_5: 0.2419014722108841 (-0.006432866056760161) | > avg_loss_0: 3.067964792251587 (+0.062114397684732925) | > avg_loss_gen: 2.1316006978352866 (+0.4296963612238567) | > avg_loss_kl: 2.9597100019454956 (+0.4194522301355996) | > avg_loss_feat: 2.1531710823376975 (+2.07853393163532) | > avg_loss_mel: 14.045090993245443 (+7.626534720261892) | > avg_loss_duration: 2.459688663482666 (+0.010213931401570786) | > avg_loss_1: 23.749260266621906 (+10.564429283142088)  > EPOCH: 274/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:38:57)   --> TIME: 2023-10-20 02:39:11 -- STEP: 19/50 -- GLOBAL_STEP: 66720 | > loss_disc: 2.9004955291748047 (2.437637529875103) | > loss_disc_real_0: 0.18713681399822235 (0.1772290589778047) | > loss_disc_real_1: 0.2436002492904663 (0.20968483466851084) | > loss_disc_real_2: 0.17786231637001038 (0.2500978817084902) | > loss_disc_real_3: 0.3865559995174408 (0.24574167987233714) | > loss_disc_real_4: 0.23196735978126526 (0.2089479303869762) | > loss_disc_real_5: 0.34062308073043823 (0.2452923584925501) | > loss_0: 2.9004955291748047 (2.437637529875103) | > grad_norm_0: tensor(997.1000, device='cuda:0') (tensor(953.8920, device='cuda:0')) | > loss_gen: 1.9402079582214355 (2.5446418084596334) | > loss_kl: 0.9851647615432739 (0.8777284308483726) | > loss_feat: 2.524104118347168 (5.9417786421744445) | > loss_mel: 27.161344528198242 (20.918720295554714) | > loss_duration: 1.74126398563385 (1.6539019973654496) | > loss_1: 34.35208511352539 (31.936770790501644) | > grad_norm_1: tensor(10594.5479, device='cuda:0') (tensor(48048.9414, device='cuda:0')) | > current_lr_0: 0.00015206381072007457 | > current_lr_1: 0.00015206381072007457 | > step_time: 0.638 (0.5339477564159193) | > loader_time: 0.0111 (0.01865344298513312)  --> TIME: 2023-10-20 02:39:27 -- STEP: 49/50 -- GLOBAL_STEP: 66750 | > loss_disc: 2.916569709777832 (2.5151831714474424) | > loss_disc_real_0: 0.5504956245422363 (0.18043259459034522) | > loss_disc_real_1: 0.28531157970428467 (0.2006268098722307) | > loss_disc_real_2: 0.2216579169034958 (0.22407562844455242) | > loss_disc_real_3: 0.34982091188430786 (0.26076051820905843) | > loss_disc_real_4: 0.29866036772727966 (0.23242065618384858) | > loss_disc_real_5: 0.23881493508815765 (0.23631982931068965) | > loss_0: 2.916569709777832 (2.5151831714474424) | > grad_norm_0: tensor(2307.4773, device='cuda:0') (tensor(1152.0693, device='cuda:0')) | > loss_gen: 2.24965238571167 (2.376006773539952) | > loss_kl: 0.777423620223999 (0.9024788293303275) | > loss_feat: 1.519365668296814 (5.460138672240535) | > loss_mel: 21.749584197998047 (21.947785306950006) | > loss_duration: 1.761702299118042 (1.6105623269567684) | > loss_1: 28.057727813720703 (32.29697180767449) | > grad_norm_1: tensor(10570.3945, device='cuda:0') (tensor(46024.3242, device='cuda:0')) | > current_lr_0: 0.00015206381072007457 | > current_lr_1: 0.00015206381072007457 | > step_time: 0.3126 (0.5126699622796507) | > loader_time: 0.4666 (0.02830274737611108)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0541985034942627 (2.0541985034942627) | > loss_disc_real_0: 0.23083871603012085 (0.23083871603012085) | > loss_disc_real_1: 0.15691819787025452 (0.15691819787025452) | > loss_disc_real_2: 0.15570570528507233 (0.15570570528507233) | > loss_disc_real_3: 0.3115634024143219 (0.3115634024143219) | > loss_disc_real_4: 0.05954822152853012 (0.05954822152853012) | > loss_disc_real_5: 0.05074511095881462 (0.05074511095881462) | > loss_0: 2.0541985034942627 (2.0541985034942627) | > loss_gen: 2.334325075149536 (2.334325075149536) | > loss_kl: 2.4538087844848633 (2.4538087844848633) | > loss_feat: 7.430208683013916 (7.430208683013916) | > loss_mel: 18.388641357421875 (18.388641357421875) | > loss_duration: 2.3261115550994873 (2.3261115550994873) | > loss_1: 32.93309783935547 (32.93309783935547)  --> STEP: 1 | > loss_disc: 2.2636876106262207 (2.2636876106262207) | > loss_disc_real_0: 0.18156883120536804 (0.18156883120536804) | > loss_disc_real_1: 0.23041625320911407 (0.23041625320911407) | > loss_disc_real_2: 0.13297399878501892 (0.13297399878501892) | > loss_disc_real_3: 0.2010032683610916 (0.2010032683610916) | > loss_disc_real_4: 0.250125527381897 (0.250125527381897) | > loss_disc_real_5: 0.18689799308776855 (0.18689799308776855) | > loss_0: 2.2636876106262207 (2.2636876106262207) | > loss_gen: 2.2804200649261475 (2.2804200649261475) | > loss_kl: 3.027261972427368 (3.027261972427368) | > loss_feat: 5.402918815612793 (5.402918815612793) | > loss_mel: 28.3499755859375 (28.3499755859375) | > loss_duration: 2.5164682865142822 (2.5164682865142822) | > loss_1: 41.57704162597656 (41.57704162597656)  --> STEP: 2 | > loss_disc: 3.1986565589904785 (2.7311720848083496) | > loss_disc_real_0: 0.38271528482437134 (0.2821420580148697) | > loss_disc_real_1: 0.35362735390663147 (0.29202180355787277) | > loss_disc_real_2: 0.2109885960817337 (0.1719812974333763) | > loss_disc_real_3: 0.33763524889945984 (0.2693192586302757) | > loss_disc_real_4: 0.33661937713623047 (0.2933724522590637) | > loss_disc_real_5: 0.316223680973053 (0.25156083703041077) | > loss_0: 3.1986565589904785 (2.7311720848083496) | > loss_gen: 2.3136727809906006 (2.297046422958374) | > loss_kl: 3.6842617988586426 (3.3557618856430054) | > loss_feat: 4.4144415855407715 (4.908680200576782) | > loss_mel: 29.664228439331055 (29.007102012634277) | > loss_duration: 2.4161717891693115 (2.466320037841797) | > loss_1: 42.492774963378906 (42.034908294677734)  --> STEP: 3 | > loss_disc: 2.8984713554382324 (2.786938508351644) | > loss_disc_real_0: 0.25927841663360596 (0.2745208442211151) | > loss_disc_real_1: 0.3244340419769287 (0.3028258830308914) | > loss_disc_real_2: 0.3012385070323944 (0.21506703396638235) | > loss_disc_real_3: 0.3011767864227295 (0.27993843456109363) | > loss_disc_real_4: 0.278394490480423 (0.28837979833285016) | > loss_disc_real_5: 0.19646376371383667 (0.23319514592488608) | > loss_0: 2.8984713554382324 (2.786938508351644) | > loss_gen: 1.810612440109253 (2.134901762008667) | > loss_kl: 1.4538829326629639 (2.721802234649658) | > loss_feat: 0.5317915081977844 (3.4497173031171164) | > loss_mel: 15.573943138122559 (24.52938238779704) | > loss_duration: 2.3526737689971924 (2.4284379482269287) | > loss_1: 21.722904205322266 (35.26424026489258) --> EVAL PERFORMANCE | > avg_loader_time: 0.015186309814453125 (+0.013059854507446289) | > avg_loss_disc: 2.786938508351644 (-0.2810262838999429) | > avg_loss_disc_real_0: 0.2745208442211151 (-0.10311000545819599) | > avg_loss_disc_real_1: 0.3028258830308914 (-0.05208746095498401) | > avg_loss_disc_real_2: 0.21506703396638235 (-0.18733442823092142) | > avg_loss_disc_real_3: 0.27993843456109363 (-0.08655596276124322) | > avg_loss_disc_real_4: 0.28837979833285016 (+0.10007585212588313) | > avg_loss_disc_real_5: 0.23319514592488608 (-0.008706326285998017) | > avg_loss_0: 2.786938508351644 (-0.2810262838999429) | > avg_loss_gen: 2.134901762008667 (+0.003301064173380386) | > avg_loss_kl: 2.721802234649658 (-0.2379077672958374) | > avg_loss_feat: 3.4497173031171164 (+1.296546220779419) | > avg_loss_mel: 24.52938238779704 (+10.484291394551596) | > avg_loss_duration: 2.4284379482269287 (-0.031250715255737305) | > avg_loss_1: 35.26424026489258 (+11.514979998270672)  > EPOCH: 275/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:39:37)   --> TIME: 2023-10-20 02:39:56 -- STEP: 29/50 -- GLOBAL_STEP: 66780 | > loss_disc: 1.5226866006851196 (2.4045063175004104) | > loss_disc_real_0: 0.1397532820701599 (0.14402868855616136) | > loss_disc_real_1: 0.12074074149131775 (0.23443723547047582) | > loss_disc_real_2: 0.04690811410546303 (0.2234711993871064) | > loss_disc_real_3: 0.268807053565979 (0.22869899329440346) | > loss_disc_real_4: 0.05880405381321907 (0.19313916878710533) | > loss_disc_real_5: 0.17239777743816376 (0.2100453918863987) | > loss_0: 1.5226866006851196 (2.4045063175004104) | > grad_norm_0: tensor(770.7951, device='cuda:0') (tensor(1096.9449, device='cuda:0')) | > loss_gen: 3.0760021209716797 (2.3445002950471023) | > loss_kl: 1.0684678554534912 (0.9772995104049814) | > loss_feat: 7.915863513946533 (5.371295067256896) | > loss_mel: 27.048965454101562 (23.079757320469824) | > loss_duration: 1.600872278213501 (1.6336508496054287) | > loss_1: 40.71017074584961 (33.40650287167779) | > grad_norm_1: tensor(36970.6641, device='cuda:0') (tensor(38636.4844, device='cuda:0')) | > current_lr_0: 0.00015191181342064225 | > current_lr_1: 0.00015191181342064225 | > step_time: 0.5651 (0.49964635125521956) | > loader_time: 0.0231 (0.013695799071213295)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.752364158630371 (2.752364158630371) | > loss_disc_real_0: 0.1973486840724945 (0.1973486840724945) | > loss_disc_real_1: 0.1484578251838684 (0.1484578251838684) | > loss_disc_real_2: 0.28397631645202637 (0.28397631645202637) | > loss_disc_real_3: 0.2527831792831421 (0.2527831792831421) | > loss_disc_real_4: 0.2156367003917694 (0.2156367003917694) | > loss_disc_real_5: 0.27269840240478516 (0.27269840240478516) | > loss_0: 2.752364158630371 (2.752364158630371) | > loss_gen: 1.8862855434417725 (1.8862855434417725) | > loss_kl: 3.7541306018829346 (3.7541306018829346) | > loss_feat: 5.844361305236816 (5.844361305236816) | > loss_mel: 24.751630783081055 (24.751630783081055) | > loss_duration: 2.4045279026031494 (2.4045279026031494) | > loss_1: 38.640933990478516 (38.640933990478516)  --> STEP: 1 | > loss_disc: 1.9568630456924438 (1.9568630456924438) | > loss_disc_real_0: 0.19388146698474884 (0.19388146698474884) | > loss_disc_real_1: 0.1529005467891693 (0.1529005467891693) | > loss_disc_real_2: 0.14526954293251038 (0.14526954293251038) | > loss_disc_real_3: 0.06026007607579231 (0.06026007607579231) | > loss_disc_real_4: 0.29039180278778076 (0.29039180278778076) | > loss_disc_real_5: 0.03483336791396141 (0.03483336791396141) | > loss_0: 1.9568630456924438 (1.9568630456924438) | > loss_gen: 2.4053711891174316 (2.4053711891174316) | > loss_kl: 3.377415657043457 (3.377415657043457) | > loss_feat: 9.739422798156738 (9.739422798156738) | > loss_mel: 26.589834213256836 (26.589834213256836) | > loss_duration: 2.47936749458313 (2.47936749458313) | > loss_1: 44.59141159057617 (44.59141159057617)  --> STEP: 2 | > loss_disc: 2.4800548553466797 (2.2184589505195618) | > loss_disc_real_0: 0.2545551657676697 (0.22421831637620926) | > loss_disc_real_1: 0.18938614428043365 (0.17114334553480148) | > loss_disc_real_2: 0.3127887547016144 (0.22902914881706238) | > loss_disc_real_3: 0.12291325628757477 (0.09158666618168354) | > loss_disc_real_4: 0.19166021049022675 (0.24102600663900375) | > loss_disc_real_5: 0.14914560317993164 (0.09198948554694653) | > loss_0: 2.4800548553466797 (2.2184589505195618) | > loss_gen: 2.214046001434326 (2.309708595275879) | > loss_kl: 3.7345824241638184 (3.5559990406036377) | > loss_feat: 7.835549354553223 (8.78748607635498) | > loss_mel: 23.929794311523438 (25.259814262390137) | > loss_duration: 2.497371196746826 (2.488369345664978) | > loss_1: 40.211341857910156 (42.401376724243164)  --> STEP: 3 | > loss_disc: 2.6502580642700195 (2.362391988436381) | > loss_disc_real_0: 0.1483323872089386 (0.1989230066537857) | > loss_disc_real_1: 0.2677595317363739 (0.20334874093532562) | > loss_disc_real_2: 0.2585676908493042 (0.23887532949447632) | > loss_disc_real_3: 0.28840768337249756 (0.15719367191195488) | > loss_disc_real_4: 0.31148889660835266 (0.26451363662878674) | > loss_disc_real_5: 0.23062437772750854 (0.13820111627380052) | > loss_0: 2.6502580642700195 (2.362391988436381) | > loss_gen: 1.9460183382034302 (2.1884785095850625) | > loss_kl: 1.8501732349395752 (2.9873904387156167) | > loss_feat: 1.2473158836364746 (6.2740960121154785) | > loss_mel: 18.39822006225586 (22.97261619567871) | > loss_duration: 2.4388439655303955 (2.471860885620117) | > loss_1: 25.880571365356445 (36.89444160461426) --> EVAL PERFORMANCE | > avg_loader_time: 0.0038251876831054688 (-0.011361122131347656) | > avg_loss_disc: 2.362391988436381 (-0.42454651991526315) | > avg_loss_disc_real_0: 0.1989230066537857 (-0.0755978375673294) | > avg_loss_disc_real_1: 0.20334874093532562 (-0.0994771420955658) | > avg_loss_disc_real_2: 0.23887532949447632 (+0.023808295528093965) | > avg_loss_disc_real_3: 0.15719367191195488 (-0.12274476264913875) | > avg_loss_disc_real_4: 0.26451363662878674 (-0.023866161704063416) | > avg_loss_disc_real_5: 0.13820111627380052 (-0.09499402965108555) | > avg_loss_0: 2.362391988436381 (-0.42454651991526315) | > avg_loss_gen: 2.1884785095850625 (+0.05357674757639552) | > avg_loss_kl: 2.9873904387156167 (+0.2655882040659585) | > avg_loss_feat: 6.2740960121154785 (+2.824378708998362) | > avg_loss_mel: 22.97261619567871 (-1.556766192118328) | > avg_loss_duration: 2.471860885620117 (+0.04342293739318848) | > avg_loss_1: 36.89444160461426 (+1.6302013397216797)  > EPOCH: 276/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:40:17)   --> TIME: 2023-10-20 02:40:25 -- STEP: 9/50 -- GLOBAL_STEP: 66810 | > loss_disc: 2.7409024238586426 (2.4680172072516546) | > loss_disc_real_0: 0.21289673447608948 (0.15907218576305443) | > loss_disc_real_1: 0.2955959737300873 (0.2725563562578625) | > loss_disc_real_2: 0.29469430446624756 (0.24743610454930198) | > loss_disc_real_3: 0.404233455657959 (0.26918069769938785) | > loss_disc_real_4: 0.16501806676387787 (0.20574922114610672) | > loss_disc_real_5: 0.13474346697330475 (0.20298325384242666) | > loss_0: 2.7409024238586426 (2.4680172072516546) | > grad_norm_0: tensor(1181.2069, device='cuda:0') (tensor(1267.9281, device='cuda:0')) | > loss_gen: 2.0115270614624023 (2.4461536010106406) | > loss_kl: 0.5982354283332825 (0.9400137033727434) | > loss_feat: 2.864492177963257 (5.325277510616514) | > loss_mel: 23.151235580444336 (20.35492671860589) | > loss_duration: 1.538283109664917 (1.628612134191725) | > loss_1: 30.163774490356445 (30.694983588324654) | > grad_norm_1: tensor(11892.4658, device='cuda:0') (tensor(58568.3945, device='cuda:0')) | > current_lr_0: 0.0001517599680520272 | > current_lr_1: 0.0001517599680520272 | > step_time: 0.6087 (0.5235157542758517) | > loader_time: 0.0225 (0.018203841315375432)  --> TIME: 2023-10-20 02:40:38 -- STEP: 39/50 -- GLOBAL_STEP: 66840 | > loss_disc: 3.023347854614258 (2.469205257220146) | > loss_disc_real_0: 0.15833543241024017 (0.18687051768677357) | > loss_disc_real_1: 0.2604235112667084 (0.24991468483438858) | > loss_disc_real_2: 0.26880982518196106 (0.23560651917106065) | > loss_disc_real_3: 0.24242623150348663 (0.25342265038918227) | > loss_disc_real_4: 0.2523254156112671 (0.206115428931438) | > loss_disc_real_5: 0.24231205880641937 (0.2084354701666878) | > loss_0: 3.023347854614258 (2.469205257220146) | > grad_norm_0: tensor(1741.4937, device='cuda:0') (tensor(1331.1566, device='cuda:0')) | > loss_gen: 1.433484673500061 (2.391773361426133) | > loss_kl: 0.7450246214866638 (0.9081577253647339) | > loss_feat: 0.03046043962240219 (4.997198140582977) | > loss_mel: 1.1292707920074463 (21.47370637991489) | > loss_duration: 1.6176267862319946 (1.590702555118463) | > loss_1: 4.955867290496826 (31.36153792112302) | > grad_norm_1: tensor(115761.6250, device='cuda:0') (tensor(43923.4141, device='cuda:0')) | > current_lr_0: 0.0001517599680520272 | > current_lr_1: 0.0001517599680520272 | > step_time: 0.2631 (0.4317371539580516) | > loader_time: 0.0023 (0.013956962487636471)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.3929353952407837 (1.3929353952407837) | > loss_disc_real_0: 0.09043551981449127 (0.09043551981449127) | > loss_disc_real_1: 0.1378658413887024 (0.1378658413887024) | > loss_disc_real_2: 0.16846495866775513 (0.16846495866775513) | > loss_disc_real_3: 0.21134060621261597 (0.21134060621261597) | > loss_disc_real_4: 0.11130806803703308 (0.11130806803703308) | > loss_disc_real_5: 0.16037669777870178 (0.16037669777870178) | > loss_0: 1.3929353952407837 (1.3929353952407837) | > loss_gen: 3.4806790351867676 (3.4806790351867676) | > loss_kl: 3.166865587234497 (3.166865587234497) | > loss_feat: 8.904633522033691 (8.904633522033691) | > loss_mel: 24.843591690063477 (24.843591690063477) | > loss_duration: 2.3731648921966553 (2.3731648921966553) | > loss_1: 42.76893615722656 (42.76893615722656)  --> STEP: 1 | > loss_disc: 2.8976943492889404 (2.8976943492889404) | > loss_disc_real_0: 0.3388864994049072 (0.3388864994049072) | > loss_disc_real_1: 0.2674197256565094 (0.2674197256565094) | > loss_disc_real_2: 0.30753451585769653 (0.30753451585769653) | > loss_disc_real_3: 0.2876407206058502 (0.2876407206058502) | > loss_disc_real_4: 0.2445971965789795 (0.2445971965789795) | > loss_disc_real_5: 0.19696560502052307 (0.19696560502052307) | > loss_0: 2.8976943492889404 (2.8976943492889404) | > loss_gen: 1.8417572975158691 (1.8417572975158691) | > loss_kl: 3.4878580570220947 (3.4878580570220947) | > loss_feat: 0.8067672252655029 (0.8067672252655029) | > loss_mel: 21.151674270629883 (21.151674270629883) | > loss_duration: 2.5733113288879395 (2.5733113288879395) | > loss_1: 29.86136817932129 (29.86136817932129)  --> STEP: 2 | > loss_disc: 1.7188642024993896 (2.308279275894165) | > loss_disc_real_0: 0.1623840630054474 (0.2506352812051773) | > loss_disc_real_1: 0.09991636127233505 (0.18366804346442223) | > loss_disc_real_2: 0.12883684039115906 (0.2181856781244278) | > loss_disc_real_3: 0.166434645652771 (0.2270376831293106) | > loss_disc_real_4: 0.09471934288740158 (0.16965826973319054) | > loss_disc_real_5: 0.22250080108642578 (0.20973320305347443) | > loss_0: 1.7188642024993896 (2.308279275894165) | > loss_gen: 2.6790318489074707 (2.26039457321167) | > loss_kl: 3.523930311203003 (3.505894184112549) | > loss_feat: 9.189970016479492 (4.998368620872498) | > loss_mel: 24.788061141967773 (22.969867706298828) | > loss_duration: 2.4716956615448 (2.5225034952163696) | > loss_1: 42.652687072753906 (36.2570276260376)  --> STEP: 3 | > loss_disc: 2.5696985721588135 (2.3954190413157144) | > loss_disc_real_0: 0.44160330295562744 (0.31429128845532733) | > loss_disc_real_1: 0.2171608805656433 (0.1948323224981626) | > loss_disc_real_2: 0.29306888580322266 (0.24314674735069275) | > loss_disc_real_3: 0.22453612089157104 (0.2262038290500641) | > loss_disc_real_4: 0.35712507367134094 (0.23214720437924066) | > loss_disc_real_5: 0.2344769388437271 (0.21798111498355865) | > loss_0: 2.5696985721588135 (2.3954190413157144) | > loss_gen: 2.9866456985473633 (2.502478281656901) | > loss_kl: 1.5541671514511108 (2.8553185065587363) | > loss_feat: 5.4840474128723145 (5.1602615515391035) | > loss_mel: 28.559791564941406 (24.833175659179688) | > loss_duration: 2.3859663009643555 (2.4769910971323648) | > loss_1: 40.970619201660156 (37.82822481791178) --> EVAL PERFORMANCE | > avg_loader_time: 0.013952970504760742 (+0.010127782821655273) | > avg_loss_disc: 2.3954190413157144 (+0.033027052879333496) | > avg_loss_disc_real_0: 0.31429128845532733 (+0.11536828180154163) | > avg_loss_disc_real_1: 0.1948323224981626 (-0.008516418437163026) | > avg_loss_disc_real_2: 0.24314674735069275 (+0.004271417856216431) | > avg_loss_disc_real_3: 0.2262038290500641 (+0.06901015713810921) | > avg_loss_disc_real_4: 0.23214720437924066 (-0.03236643224954608) | > avg_loss_disc_real_5: 0.21798111498355865 (+0.07977999870975813) | > avg_loss_0: 2.3954190413157144 (+0.033027052879333496) | > avg_loss_gen: 2.502478281656901 (+0.3139997720718384) | > avg_loss_kl: 2.8553185065587363 (-0.1320719321568804) | > avg_loss_feat: 5.1602615515391035 (-1.113834460576375) | > avg_loss_mel: 24.833175659179688 (+1.8605594635009766) | > avg_loss_duration: 2.4769910971323648 (+0.005130211512247573) | > avg_loss_1: 37.82822481791178 (+0.9337832132975237)  > EPOCH: 277/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:40:57)   --> TIME: 2023-10-20 02:41:12 -- STEP: 19/50 -- GLOBAL_STEP: 66870 | > loss_disc: 2.2901554107666016 (2.441959399926035) | > loss_disc_real_0: 0.14645642042160034 (0.1267958665756803) | > loss_disc_real_1: 0.17084208130836487 (0.21294797368739782) | > loss_disc_real_2: 0.13516071438789368 (0.25453864841869) | > loss_disc_real_3: 0.2799970209598541 (0.25823884898502575) | > loss_disc_real_4: 0.206154003739357 (0.24995815577475647) | > loss_disc_real_5: 0.14481818675994873 (0.24273162492011724) | > loss_0: 2.2901554107666016 (2.441959399926035) | > grad_norm_0: tensor(701.9047, device='cuda:0') (tensor(1074.2308, device='cuda:0')) | > loss_gen: 2.5550060272216797 (2.564502891741301) | > loss_kl: 0.9576506614685059 (0.9003098897243801) | > loss_feat: 6.231601715087891 (6.174885931767915) | > loss_mel: 23.221399307250977 (25.425563661675703) | > loss_duration: 1.7654569149017334 (1.658541008045799) | > loss_1: 34.731117248535156 (36.72380336962248) | > grad_norm_1: tensor(7269.2256, device='cuda:0') (tensor(34818.9297, device='cuda:0')) | > current_lr_0: 0.00015160827446236496 | > current_lr_1: 0.00015160827446236496 | > step_time: 0.6822 (0.5038124636599892) | > loader_time: 0.0229 (0.019517773076107622)  --> TIME: 2023-10-20 02:41:28 -- STEP: 49/50 -- GLOBAL_STEP: 66900 | > loss_disc: 1.8718256950378418 (2.3686736651829303) | > loss_disc_real_0: 0.08122017234563828 (0.13405499027623813) | > loss_disc_real_1: 0.22338972985744476 (0.21553052444847262) | > loss_disc_real_2: 0.11620622873306274 (0.23314363311748112) | > loss_disc_real_3: 0.19397692382335663 (0.23884398539607626) | > loss_disc_real_4: 0.2087959498167038 (0.2234604183432399) | > loss_disc_real_5: 0.12826891243457794 (0.21038813569716044) | > loss_0: 1.8718256950378418 (2.3686736651829303) | > grad_norm_0: tensor(1127.4447, device='cuda:0') (tensor(1242.0839, device='cuda:0')) | > loss_gen: 2.7493197917938232 (2.4602530902745765) | > loss_kl: 0.6023504734039307 (0.8700312044547529) | > loss_feat: 5.403682708740234 (5.759629729450966) | > loss_mel: 22.142858505249023 (23.50362288708589) | > loss_duration: 1.6896802186965942 (1.6040631216399523) | > loss_1: 32.587890625 (34.19759987811652) | > grad_norm_1: tensor(16710.9434, device='cuda:0') (tensor(33797.6406, device='cuda:0')) | > current_lr_0: 0.00015160827446236496 | > current_lr_1: 0.00015160827446236496 | > step_time: 0.3704 (0.4926735819602499) | > loader_time: 0.3837 (0.026901848462163175)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.07132625579834 (3.07132625579834) | > loss_disc_real_0: 0.18625105917453766 (0.18625105917453766) | > loss_disc_real_1: 0.2042645961046219 (0.2042645961046219) | > loss_disc_real_2: 0.2805333435535431 (0.2805333435535431) | > loss_disc_real_3: 0.3408583402633667 (0.3408583402633667) | > loss_disc_real_4: 0.33604535460472107 (0.33604535460472107) | > loss_disc_real_5: 0.18183045089244843 (0.18183045089244843) | > loss_0: 3.07132625579834 (3.07132625579834) | > loss_gen: 1.9633787870407104 (1.9633787870407104) | > loss_kl: 2.6390480995178223 (2.6390480995178223) | > loss_feat: 7.141530990600586 (7.141530990600586) | > loss_mel: 27.131893157958984 (27.131893157958984) | > loss_duration: 2.420626401901245 (2.420626401901245) | > loss_1: 41.296478271484375 (41.296478271484375)  --> STEP: 1 | > loss_disc: 3.404412269592285 (3.404412269592285) | > loss_disc_real_0: 0.18086811900138855 (0.18086811900138855) | > loss_disc_real_1: 0.09080086648464203 (0.09080086648464203) | > loss_disc_real_2: 0.17072418332099915 (0.17072418332099915) | > loss_disc_real_3: 0.20282942056655884 (0.20282942056655884) | > loss_disc_real_4: 0.11912140995264053 (0.11912140995264053) | > loss_disc_real_5: 0.026693496853113174 (0.026693496853113174) | > loss_0: 3.404412269592285 (3.404412269592285) | > loss_gen: 0.9333429336547852 (0.9333429336547852) | > loss_kl: 3.748478412628174 (3.748478412628174) | > loss_feat: 9.630731582641602 (9.630731582641602) | > loss_mel: 29.26407241821289 (29.26407241821289) | > loss_duration: 2.637479543685913 (2.637479543685913) | > loss_1: 46.2140998840332 (46.2140998840332)  --> STEP: 2 | > loss_disc: 2.3138620853424072 (2.859137177467346) | > loss_disc_real_0: 0.4076194167137146 (0.2942437678575516) | > loss_disc_real_1: 0.2373817265033722 (0.1640912964940071) | > loss_disc_real_2: 0.35142436623573303 (0.2610742747783661) | > loss_disc_real_3: 0.3808005750179291 (0.29181499779224396) | > loss_disc_real_4: 0.18420849740505219 (0.15166495367884636) | > loss_disc_real_5: 0.08253518491983414 (0.054614340886473656) | > loss_0: 2.3138620853424072 (2.859137177467346) | > loss_gen: 3.051076650619507 (1.992209792137146) | > loss_kl: 3.4558138847351074 (3.6021461486816406) | > loss_feat: 8.229979515075684 (8.930355548858643) | > loss_mel: 24.004131317138672 (26.63410186767578) | > loss_duration: 2.6619746685028076 (2.6497271060943604) | > loss_1: 41.402976989746094 (43.80853843688965)  --> STEP: 3 | > loss_disc: 2.912684917449951 (2.8769864241282144) | > loss_disc_real_0: 0.38718125224113464 (0.3252229293187459) | > loss_disc_real_1: 0.2747635543346405 (0.20098204910755157) | > loss_disc_real_2: 0.2803562879562378 (0.2675016125043233) | > loss_disc_real_3: 0.37275463342666626 (0.3187948763370514) | > loss_disc_real_4: 0.265694797039032 (0.1896749014655749) | > loss_disc_real_5: 0.30993276834487915 (0.1397204833726088) | > loss_0: 2.912684917449951 (2.8769864241282144) | > loss_gen: 2.120067834854126 (2.0348291397094727) | > loss_kl: 1.6905272006988525 (2.964939832687378) | > loss_feat: 0.6076205372810364 (6.15611054499944) | > loss_mel: 8.206897735595703 (20.491700490315754) | > loss_duration: 2.442854404449463 (2.5807695388793945) | > loss_1: 15.06796646118164 (34.22834777832031) --> EVAL PERFORMANCE | > avg_loader_time: 0.016703128814697266 (+0.0027501583099365234) | > avg_loss_disc: 2.8769864241282144 (+0.4815673828125) | > avg_loss_disc_real_0: 0.3252229293187459 (+0.010931640863418579) | > avg_loss_disc_real_1: 0.20098204910755157 (+0.006149726609388978) | > avg_loss_disc_real_2: 0.2675016125043233 (+0.024354865153630556) | > avg_loss_disc_real_3: 0.3187948763370514 (+0.0925910472869873) | > avg_loss_disc_real_4: 0.1896749014655749 (-0.04247230291366577) | > avg_loss_disc_real_5: 0.1397204833726088 (-0.07826063161094984) | > avg_loss_0: 2.8769864241282144 (+0.4815673828125) | > avg_loss_gen: 2.0348291397094727 (-0.46764914194742824) | > avg_loss_kl: 2.964939832687378 (+0.10962132612864162) | > avg_loss_feat: 6.15611054499944 (+0.9958489934603367) | > avg_loss_mel: 20.491700490315754 (-4.3414751688639335) | > avg_loss_duration: 2.5807695388793945 (+0.10377844174702977) | > avg_loss_1: 34.22834777832031 (-3.599877039591469)  > EPOCH: 278/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:41:39)   --> TIME: 2023-10-20 02:41:56 -- STEP: 29/50 -- GLOBAL_STEP: 66930 | > loss_disc: 2.144515037536621 (2.5679253997473874) | > loss_disc_real_0: 0.1357136070728302 (0.18412254989982166) | > loss_disc_real_1: 0.1859896183013916 (0.23709642655890562) | > loss_disc_real_2: 0.26084333658218384 (0.2582359162384065) | > loss_disc_real_3: 0.22688370943069458 (0.28091732566726624) | > loss_disc_real_4: 0.07804006338119507 (0.2305862158536911) | > loss_disc_real_5: 0.1867772787809372 (0.23183444566253958) | > loss_0: 2.144515037536621 (2.5679253997473874) | > grad_norm_0: tensor(934.9712, device='cuda:0') (tensor(1108.5991, device='cuda:0')) | > loss_gen: 2.2090179920196533 (2.418642825093763) | > loss_kl: 0.7153801918029785 (1.094758855885473) | > loss_feat: 4.351130962371826 (5.01095054016031) | > loss_mel: 22.140932083129883 (21.572822792776698) | > loss_duration: 1.6251131296157837 (1.6004638425235092) | > loss_1: 31.041574478149414 (31.697639268020104) | > grad_norm_1: tensor(10776.6592, device='cuda:0') (tensor(47132.0703, device='cuda:0')) | > current_lr_0: 0.00015145673249994306 | > current_lr_1: 0.00015145673249994306 | > step_time: 1.0954 (0.419492376261744) | > loader_time: 0.011 (0.006739805484640187)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7956335544586182 (1.7956335544586182) | > loss_disc_real_0: 0.0347394160926342 (0.0347394160926342) | > loss_disc_real_1: 0.10875732451677322 (0.10875732451677322) | > loss_disc_real_2: 0.19866886734962463 (0.19866886734962463) | > loss_disc_real_3: 0.24305033683776855 (0.24305033683776855) | > loss_disc_real_4: 0.10529733449220657 (0.10529733449220657) | > loss_disc_real_5: 0.10295664519071579 (0.10295664519071579) | > loss_0: 1.7956335544586182 (1.7956335544586182) | > loss_gen: 2.376864433288574 (2.376864433288574) | > loss_kl: 2.8159337043762207 (2.8159337043762207) | > loss_feat: 8.51334285736084 (8.51334285736084) | > loss_mel: 23.955608367919922 (23.955608367919922) | > loss_duration: 2.4205076694488525 (2.4205076694488525) | > loss_1: 40.08226013183594 (40.08226013183594)  --> STEP: 1 | > loss_disc: 2.9152779579162598 (2.9152779579162598) | > loss_disc_real_0: 0.24234715104103088 (0.24234715104103088) | > loss_disc_real_1: 0.31852537393569946 (0.31852537393569946) | > loss_disc_real_2: 0.3112058937549591 (0.3112058937549591) | > loss_disc_real_3: 0.3133153021335602 (0.3133153021335602) | > loss_disc_real_4: 0.2752712666988373 (0.2752712666988373) | > loss_disc_real_5: 0.2787286937236786 (0.2787286937236786) | > loss_0: 2.9152779579162598 (2.9152779579162598) | > loss_gen: 1.8845714330673218 (1.8845714330673218) | > loss_kl: 3.0501489639282227 (3.0501489639282227) | > loss_feat: 0.4778842031955719 (0.4778842031955719) | > loss_mel: 19.30918312072754 (19.30918312072754) | > loss_duration: 2.540099620819092 (2.540099620819092) | > loss_1: 27.261886596679688 (27.261886596679688)  --> STEP: 2 | > loss_disc: 2.9657909870147705 (2.940534472465515) | > loss_disc_real_0: 0.33302590250968933 (0.2876865267753601) | > loss_disc_real_1: 0.3233250081539154 (0.32092519104480743) | > loss_disc_real_2: 0.2865423560142517 (0.2988741248846054) | > loss_disc_real_3: 0.3149196207523346 (0.3141174614429474) | > loss_disc_real_4: 0.2694469094276428 (0.27235908806324005) | > loss_disc_real_5: 0.2742314040660858 (0.2764800488948822) | > loss_0: 2.9657909870147705 (2.940534472465515) | > loss_gen: 1.9035812616348267 (1.8940763473510742) | > loss_kl: 3.809779405593872 (3.4299641847610474) | > loss_feat: 0.3221457600593567 (0.4000149816274643) | > loss_mel: 23.0916690826416 (21.20042610168457) | > loss_duration: 2.581580400466919 (2.5608400106430054) | > loss_1: 31.708757400512695 (29.48532199859619)  --> STEP: 3 | > loss_disc: 2.792175769805908 (2.8910815715789795) | > loss_disc_real_0: 0.20652708411216736 (0.2606333792209625) | > loss_disc_real_1: 0.3185594379901886 (0.3201366066932678) | > loss_disc_real_2: 0.336628794670105 (0.3114590148131053) | > loss_disc_real_3: 0.34884336590766907 (0.32569276293118793) | > loss_disc_real_4: 0.2808222472667694 (0.2751801411310832) | > loss_disc_real_5: 0.34410572052001953 (0.29902193943659466) | > loss_0: 2.792175769805908 (2.8910815715789795) | > loss_gen: 2.3117010593414307 (2.033284584681193) | > loss_kl: 1.3603943586349487 (2.7401075760523477) | > loss_feat: 2.1772842407226562 (0.9924380679925283) | > loss_mel: 18.91305923461914 (20.437970479329426) | > loss_duration: 2.4746744632720947 (2.5321181615193686) | > loss_1: 27.237112045288086 (28.735918680826824) --> EVAL PERFORMANCE | > avg_loader_time: 0.01679054896036784 (+8.742014567057407e-05) | > avg_loss_disc: 2.8910815715789795 (+0.014095147450765122) | > avg_loss_disc_real_0: 0.2606333792209625 (-0.06458955009778339) | > avg_loss_disc_real_1: 0.3201366066932678 (+0.11915455758571625) | > avg_loss_disc_real_2: 0.3114590148131053 (+0.04395740230878198) | > avg_loss_disc_real_3: 0.32569276293118793 (+0.0068978865941365375) | > avg_loss_disc_real_4: 0.2751801411310832 (+0.0855052396655083) | > avg_loss_disc_real_5: 0.29902193943659466 (+0.15930145606398585) | > avg_loss_0: 2.8910815715789795 (+0.014095147450765122) | > avg_loss_gen: 2.033284584681193 (-0.0015445550282797704) | > avg_loss_kl: 2.7401075760523477 (-0.22483225663503026) | > avg_loss_feat: 0.9924380679925283 (-5.163672477006912) | > avg_loss_mel: 20.437970479329426 (-0.053730010986328125) | > avg_loss_duration: 2.5321181615193686 (-0.048651377360025894) | > avg_loss_1: 28.735918680826824 (-5.492429097493488)  > EPOCH: 279/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:42:16)   --> TIME: 2023-10-20 02:42:26 -- STEP: 9/50 -- GLOBAL_STEP: 66960 | > loss_disc: 3.0870065689086914 (2.4490897523032293) | > loss_disc_real_0: 0.06082744151353836 (0.13911680897904766) | > loss_disc_real_1: 0.26086878776550293 (0.2535679274135166) | > loss_disc_real_2: 0.1927984356880188 (0.2510769193371137) | > loss_disc_real_3: 0.2899681329727173 (0.25123246593607795) | > loss_disc_real_4: 0.28642237186431885 (0.2237637187871668) | > loss_disc_real_5: 0.28652554750442505 (0.21879620684517753) | > loss_0: 3.0870065689086914 (2.4490897523032293) | > grad_norm_0: tensor(13489.1367, device='cuda:0') (tensor(2462.8721, device='cuda:0')) | > loss_gen: 1.766108751296997 (2.3840552700890436) | > loss_kl: 0.6158836483955383 (1.1973320378197565) | > loss_feat: 0.382956326007843 (5.483230027887556) | > loss_mel: 2.503868818283081 (23.167482243643867) | > loss_duration: 1.5600271224975586 (1.605875849723816) | > loss_1: 6.828845024108887 (33.83797571394179) | > grad_norm_1: tensor(27066.4258, device='cuda:0') (tensor(31658.6523, device='cuda:0')) | > current_lr_0: 0.00015130534201320052 | > current_lr_1: 0.00015130534201320052 | > step_time: 0.575 (0.5213052166832818) | > loader_time: 0.0232 (0.019963582356770832)  --> TIME: 2023-10-20 02:42:41 -- STEP: 39/50 -- GLOBAL_STEP: 66990 | > loss_disc: 1.3555943965911865 (2.3884761791962843) | > loss_disc_real_0: 0.062153685837984085 (0.16467196757021624) | > loss_disc_real_1: 0.09482228755950928 (0.22683960046523657) | > loss_disc_real_2: 0.14785857498645782 (0.2159517546876883) | > loss_disc_real_3: 0.1206817701458931 (0.2331053540110588) | > loss_disc_real_4: 0.06538000702857971 (0.20977193466984692) | > loss_disc_real_5: 0.04581019654870033 (0.22246243374852034) | > loss_0: 1.3555943965911865 (2.3884761791962843) | > grad_norm_0: tensor(813.4950, device='cuda:0') (tensor(1432.5388, device='cuda:0')) | > loss_gen: 3.162982702255249 (2.430711153226021) | > loss_kl: 0.5115949511528015 (1.0399501575873449) | > loss_feat: 9.861011505126953 (5.305321196810556) | > loss_mel: 30.796907424926758 (23.591704319684933) | > loss_duration: 1.6466162204742432 (1.6080643152579284) | > loss_1: 45.9791145324707 (33.97575121659497) | > grad_norm_1: tensor(84745.6562, device='cuda:0') (tensor(43818.8711, device='cuda:0')) | > current_lr_0: 0.00015130534201320052 | > current_lr_1: 0.00015130534201320052 | > step_time: 0.5922 (0.48978459529387647) | > loader_time: 0.0156 (0.02080428294646434)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7749128341674805 (2.7749128341674805) | > loss_disc_real_0: 0.29955077171325684 (0.29955077171325684) | > loss_disc_real_1: 0.2586658000946045 (0.2586658000946045) | > loss_disc_real_2: 0.33335989713668823 (0.33335989713668823) | > loss_disc_real_3: 0.38452112674713135 (0.38452112674713135) | > loss_disc_real_4: 0.35892727971076965 (0.35892727971076965) | > loss_disc_real_5: 0.3421996831893921 (0.3421996831893921) | > loss_0: 2.7749128341674805 (2.7749128341674805) | > loss_gen: 2.704566717147827 (2.704566717147827) | > loss_kl: 2.5634076595306396 (2.5634076595306396) | > loss_feat: 4.195513725280762 (4.195513725280762) | > loss_mel: 23.79337501525879 (23.79337501525879) | > loss_duration: 2.372128486633301 (2.372128486633301) | > loss_1: 35.628990173339844 (35.628990173339844)  --> STEP: 1 | > loss_disc: 2.5019688606262207 (2.5019688606262207) | > loss_disc_real_0: 0.2683713138103485 (0.2683713138103485) | > loss_disc_real_1: 0.21792855858802795 (0.21792855858802795) | > loss_disc_real_2: 0.379162073135376 (0.379162073135376) | > loss_disc_real_3: 0.18418952822685242 (0.18418952822685242) | > loss_disc_real_4: 0.4086400866508484 (0.4086400866508484) | > loss_disc_real_5: 0.20648248493671417 (0.20648248493671417) | > loss_0: 2.5019688606262207 (2.5019688606262207) | > loss_gen: 2.8175156116485596 (2.8175156116485596) | > loss_kl: 3.281168222427368 (3.281168222427368) | > loss_feat: 5.859456539154053 (5.859456539154053) | > loss_mel: 26.80561637878418 (26.80561637878418) | > loss_duration: 2.4698588848114014 (2.4698588848114014) | > loss_1: 41.233619689941406 (41.233619689941406)  --> STEP: 2 | > loss_disc: 1.816688895225525 (2.159328877925873) | > loss_disc_real_0: 0.15132099390029907 (0.2098461538553238) | > loss_disc_real_1: 0.24417009949684143 (0.2310493290424347) | > loss_disc_real_2: 0.17997169494628906 (0.2795668840408325) | > loss_disc_real_3: 0.11058405786752701 (0.1473867930471897) | > loss_disc_real_4: 0.14556945860385895 (0.27710477262735367) | > loss_disc_real_5: 0.11360400170087814 (0.16004324331879616) | > loss_0: 1.816688895225525 (2.159328877925873) | > loss_gen: 2.9036738872528076 (2.8605947494506836) | > loss_kl: 4.394248008728027 (3.8377081155776978) | > loss_feat: 9.62934398651123 (7.744400262832642) | > loss_mel: 23.511865615844727 (25.158740997314453) | > loss_duration: 2.5843937397003174 (2.5271263122558594) | > loss_1: 43.02352523803711 (42.12857246398926)  --> STEP: 3 | > loss_disc: 3.167296886444092 (2.4953182140986123) | > loss_disc_real_0: 0.3908895254135132 (0.2701939443747203) | > loss_disc_real_1: 0.24970918893814087 (0.23726928234100342) | > loss_disc_real_2: 0.3513253927230835 (0.3034863869349162) | > loss_disc_real_3: 0.30774882435798645 (0.20084080348412195) | > loss_disc_real_4: 0.3297690451145172 (0.29465953012307483) | > loss_disc_real_5: 0.4333370327949524 (0.25114117314418155) | > loss_0: 3.167296886444092 (2.4953182140986123) | > loss_gen: 2.180997371673584 (2.6340622901916504) | > loss_kl: 1.8274365663528442 (3.167617599169413) | > loss_feat: 2.166943073272705 (5.885247866312663) | > loss_mel: 18.8399600982666 (23.052480697631836) | > loss_duration: 2.4827589988708496 (2.5123372077941895) | > loss_1: 27.498096466064453 (37.251747131347656) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_67000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6770076751708984 (2.540740579366684) | > loss_disc_real_0: 0.15762870013713837 (0.24205263331532478) | > loss_disc_real_1: 0.33733314275741577 (0.2622852474451065) | > loss_disc_real_2: 0.33319908380508423 (0.3109145611524582) | > loss_disc_real_3: 0.29511338472366333 (0.2244089487940073) | > loss_disc_real_4: 0.352813720703125 (0.3091980777680874) | > loss_disc_real_5: 0.3140343725681305 (0.2668644730001688) | > loss_0: 2.6770076751708984 (2.540740579366684) | > loss_gen: 2.8324692249298096 (2.68366402387619) | > loss_kl: 2.7319865226745605 (3.0587098300457) | > loss_feat: 5.173978805541992 (5.707430601119995) | > loss_mel: 23.255826950073242 (23.103317260742188) | > loss_duration: 2.3635194301605225 (2.4751327633857727) | > loss_1: 36.35778045654297 (37.028255462646484)  --> STEP: 1 | > loss_disc: 3.187638521194458 (2.6701201677322386) | > loss_disc_real_0: 0.32842469215393066 (0.25932704508304594) | > loss_disc_real_1: 0.2358996570110321 (0.25700812935829165) | > loss_disc_real_2: 0.3650660812854767 (0.32174486517906187) | > loss_disc_real_3: 0.30592894554138184 (0.2407129481434822) | > loss_disc_real_4: 0.4082891047000885 (0.3290162831544876) | > loss_disc_real_5: 0.4610959589481354 (0.3057107701897621) | > loss_0: 3.187638521194458 (2.6701201677322386) | > loss_gen: 2.2301197052001953 (2.592955160140991) | > loss_kl: 3.431412696838379 (3.1332504034042357) | > loss_feat: 3.0516281127929688 (5.1762701034545895) | > loss_mel: 23.754013061523438 (23.233456420898438) | > loss_duration: 2.5513393878936768 (2.4903740882873535) | > loss_1: 35.01850891113281 (36.62630615234375)  --> STEP: 2 | > loss_disc: 1.9882915019989014 (2.5564820567766824) | > loss_disc_real_0: 0.051499925553798676 (0.2246891918281714) | > loss_disc_real_1: 0.22015421092510223 (0.2508658096194267) | > loss_disc_real_2: 0.2829211950302124 (0.315274253487587) | > loss_disc_real_3: 0.3262232542037964 (0.2549646658202012) | > loss_disc_real_4: 0.19668078422546387 (0.306960366666317) | > loss_disc_real_5: 0.3657517731189728 (0.3157176040112972) | > loss_0: 1.9882915019989014 (2.5564820567766824) | > loss_gen: 3.4943060874938965 (2.7431803146998086) | > loss_kl: 3.5309972763061523 (3.1995415488878884) | > loss_feat: 7.9405694007873535 (5.636986653010051) | > loss_mel: 23.09117317199707 (23.209742546081543) | > loss_duration: 2.5617077350616455 (2.5022630294164023) | > loss_1: 40.618751525878906 (37.29171371459961)  --> STEP: 3 | > loss_disc: 2.6227874755859375 (2.565954259463719) | > loss_disc_real_0: 0.1635826975107193 (0.21595969263996398) | > loss_disc_real_1: 0.2604098916053772 (0.25222924990313395) | > loss_disc_real_2: 0.29341819882392883 (0.31215195996420725) | > loss_disc_real_3: 0.4079427123069763 (0.2768186724611691) | > loss_disc_real_4: 0.3397669494152069 (0.3116470213447298) | > loss_disc_real_5: 0.275295615196228 (0.30994303418057306) | > loss_0: 2.6227874755859375 (2.565954259463719) | > loss_gen: 2.7979087829589844 (2.7509986673082625) | > loss_kl: 1.9210257530212402 (3.016896435192653) | > loss_feat: 4.21881103515625 (5.434390136173794) | > loss_mel: 25.06218910217285 (23.4743777683803) | > loss_duration: 2.4628825187683105 (2.4966372421809604) | > loss_1: 36.46281814575195 (37.173300061907085) --> EVAL PERFORMANCE | > avg_loader_time: 0.35666230746677946 (+0.3398717585064116) | > avg_loss_disc: 2.565954259463719 (-0.32512731211526047) | > avg_loss_disc_real_0: 0.21595969263996398 (-0.044673686580998545) | > avg_loss_disc_real_1: 0.25222924990313395 (-0.06790735679013388) | > avg_loss_disc_real_2: 0.31215195996420725 (+0.0006929451511019646) | > avg_loss_disc_real_3: 0.2768186724611691 (-0.04887409047001884) | > avg_loss_disc_real_4: 0.3116470213447298 (+0.036466880213646635) | > avg_loss_disc_real_5: 0.30994303418057306 (+0.010921094743978399) | > avg_loss_0: 2.565954259463719 (-0.32512731211526047) | > avg_loss_gen: 2.7509986673082625 (+0.7177140826270696) | > avg_loss_kl: 3.016896435192653 (+0.2767888591403054) | > avg_loss_feat: 5.434390136173794 (+4.441952068181266) | > avg_loss_mel: 23.4743777683803 (+3.0364072890508744) | > avg_loss_duration: 2.4966372421809604 (-0.035480919338408246) | > avg_loss_1: 37.173300061907085 (+8.437381381080261)  > EPOCH: 280/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:43:04)   --> TIME: 2023-10-20 02:43:18 -- STEP: 19/50 -- GLOBAL_STEP: 67020 | > loss_disc: 3.0400586128234863 (2.490740336869892) | > loss_disc_real_0: 0.2093868851661682 (0.17648929622220366) | > loss_disc_real_1: 0.25611957907676697 (0.22043535976033463) | > loss_disc_real_2: 0.2352001667022705 (0.22622410678549817) | > loss_disc_real_3: 0.24711661040782928 (0.25889186012117493) | > loss_disc_real_4: 0.2157757580280304 (0.21294655464589596) | > loss_disc_real_5: 0.2304375171661377 (0.23148972217581773) | > loss_0: 3.0400586128234863 (2.490740336869892) | > grad_norm_0: tensor(591.9402, device='cuda:0') (tensor(1865.8455, device='cuda:0')) | > loss_gen: 1.4029784202575684 (2.512604983229386) | > loss_kl: 0.7116997838020325 (1.1347497011485852) | > loss_feat: 0.06680168956518173 (5.072438663950092) | > loss_mel: 1.680116057395935 (20.44942309354481) | > loss_duration: 1.721659779548645 (1.6368097317846197) | > loss_1: 5.583255767822266 (30.80602643364354) | > grad_norm_1: tensor(60033.0586, device='cuda:0') (tensor(61660.9883, device='cuda:0')) | > current_lr_0: 0.00015115410285072796 | > current_lr_1: 0.00015115410285072796 | > step_time: 0.277 (0.497513494993511) | > loader_time: 0.0246 (0.01856441246835809)  --> TIME: 2023-10-20 02:43:34 -- STEP: 49/50 -- GLOBAL_STEP: 67050 | > loss_disc: 1.7363258600234985 (2.5261679547173626) | > loss_disc_real_0: 0.12152773886919022 (0.1744446503188537) | > loss_disc_real_1: 0.20561084151268005 (0.21767184564045497) | > loss_disc_real_2: 0.1919378638267517 (0.230296362495544) | > loss_disc_real_3: 0.22345349192619324 (0.24062175448147624) | > loss_disc_real_4: 0.10052788257598877 (0.22811675482258506) | > loss_disc_real_5: 0.2168954610824585 (0.23445306159555912) | > loss_0: 1.7363258600234985 (2.5261679547173626) | > grad_norm_0: tensor(1362.5426, device='cuda:0') (tensor(1286.0942, device='cuda:0')) | > loss_gen: 3.2484092712402344 (2.303545873992298) | > loss_kl: 0.8286310434341431 (1.0188277813853046) | > loss_feat: 7.006755352020264 (4.609989544984941) | > loss_mel: 25.75690269470215 (20.855312525009627) | > loss_duration: 1.7749979496002197 (1.6052985872541154) | > loss_1: 38.61569595336914 (30.392974366947097) | > grad_norm_1: tensor(72240.2266, device='cuda:0') (tensor(49031.7305, device='cuda:0')) | > current_lr_0: 0.00015115410285072796 | > current_lr_1: 0.00015115410285072796 | > step_time: 0.5544 (0.49657587129242564) | > loader_time: 0.424 (0.02836669221216319)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.393944025039673 (2.393944025039673) | > loss_disc_real_0: 0.4352934956550598 (0.4352934956550598) | > loss_disc_real_1: 0.16386200487613678 (0.16386200487613678) | > loss_disc_real_2: 0.2148263156414032 (0.2148263156414032) | > loss_disc_real_3: 0.17405836284160614 (0.17405836284160614) | > loss_disc_real_4: 0.11651496589183807 (0.11651496589183807) | > loss_disc_real_5: 0.12303347885608673 (0.12303347885608673) | > loss_0: 2.393944025039673 (2.393944025039673) | > loss_gen: 2.276961088180542 (2.276961088180542) | > loss_kl: 2.5469322204589844 (2.5469322204589844) | > loss_feat: 6.244724273681641 (6.244724273681641) | > loss_mel: 24.844707489013672 (24.844707489013672) | > loss_duration: 2.4179022312164307 (2.4179022312164307) | > loss_1: 38.33123016357422 (38.33123016357422)  --> STEP: 1 | > loss_disc: 2.3422200679779053 (2.3422200679779053) | > loss_disc_real_0: 0.25973954796791077 (0.25973954796791077) | > loss_disc_real_1: 0.17903880774974823 (0.17903880774974823) | > loss_disc_real_2: 0.2376396805047989 (0.2376396805047989) | > loss_disc_real_3: 0.05307640880346298 (0.05307640880346298) | > loss_disc_real_4: 0.07471133023500443 (0.07471133023500443) | > loss_disc_real_5: 0.06848474591970444 (0.06848474591970444) | > loss_0: 2.3422200679779053 (2.3422200679779053) | > loss_gen: 1.8383617401123047 (1.8383617401123047) | > loss_kl: 3.0785863399505615 (3.0785863399505615) | > loss_feat: 9.1969575881958 (9.1969575881958) | > loss_mel: 26.72579002380371 (26.72579002380371) | > loss_duration: 2.6234171390533447 (2.6234171390533447) | > loss_1: 43.46311569213867 (43.46311569213867)  --> STEP: 2 | > loss_disc: 3.0110080242156982 (2.6766140460968018) | > loss_disc_real_0: 0.2777335047721863 (0.2687365263700485) | > loss_disc_real_1: 0.277068555355072 (0.22805368155241013) | > loss_disc_real_2: 0.28746312856674194 (0.2625514045357704) | > loss_disc_real_3: 0.27091601490974426 (0.16199621185660362) | > loss_disc_real_4: 0.27891719341278076 (0.1768142618238926) | > loss_disc_real_5: 0.3100767135620117 (0.18928072974085808) | > loss_0: 3.0110080242156982 (2.6766140460968018) | > loss_gen: 1.7069611549377441 (1.7726614475250244) | > loss_kl: 3.5675413608551025 (3.323063850402832) | > loss_feat: 0.01217672973871231 (4.6045671589672565) | > loss_mel: 1.2182506322860718 (13.972020328044891) | > loss_duration: 2.502485513687134 (2.5629513263702393) | > loss_1: 9.007415771484375 (26.235265731811523)  --> STEP: 3 | > loss_disc: 2.8304266929626465 (2.7278849283854165) | > loss_disc_real_0: 0.28185707330703735 (0.2731100420157115) | > loss_disc_real_1: 0.3017036020755768 (0.2526036550601323) | > loss_disc_real_2: 0.2744123935699463 (0.26650506754716236) | > loss_disc_real_3: 0.2638928294181824 (0.19596175104379654) | > loss_disc_real_4: 0.27348485589027405 (0.2090377931793531) | > loss_disc_real_5: 0.3000269830226898 (0.22619614750146866) | > loss_0: 2.8304266929626465 (2.7278849283854165) | > loss_gen: 1.9616985321044922 (1.8356738090515137) | > loss_kl: 1.27570378780365 (2.6406104962031045) | > loss_feat: 1.085023283958435 (3.4313858672976494) | > loss_mel: 21.332529067993164 (16.42552324136098) | > loss_duration: 2.4651148319244385 (2.530339161554972) | > loss_1: 28.12006950378418 (26.86353365580241) --> EVAL PERFORMANCE | > avg_loader_time: 0.00911728541056315 (-0.3475450220562163) | > avg_loss_disc: 2.7278849283854165 (+0.1619306689216975) | > avg_loss_disc_real_0: 0.2731100420157115 (+0.057150349375747506) | > avg_loss_disc_real_1: 0.2526036550601323 (+0.00037440515699838084) | > avg_loss_disc_real_2: 0.26650506754716236 (-0.04564689241704489) | > avg_loss_disc_real_3: 0.19596175104379654 (-0.08085692141737255) | > avg_loss_disc_real_4: 0.2090377931793531 (-0.10260922816537674) | > avg_loss_disc_real_5: 0.22619614750146866 (-0.0837468866791044) | > avg_loss_0: 2.7278849283854165 (+0.1619306689216975) | > avg_loss_gen: 1.8356738090515137 (-0.9153248582567488) | > avg_loss_kl: 2.6406104962031045 (-0.37628593898954854) | > avg_loss_feat: 3.4313858672976494 (-2.0030042688761442) | > avg_loss_mel: 16.42552324136098 (-7.048854527019319) | > avg_loss_duration: 2.530339161554972 (+0.03370191937401179) | > avg_loss_1: 26.86353365580241 (-10.309766406104675)  > EPOCH: 281/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:43:46)   --> TIME: 2023-10-20 02:44:03 -- STEP: 29/50 -- GLOBAL_STEP: 67080 | > loss_disc: 2.5357437133789062 (2.4944796644408127) | > loss_disc_real_0: 0.256427139043808 (0.17235450658561854) | > loss_disc_real_1: 0.2711295485496521 (0.21212284472481957) | > loss_disc_real_2: 0.25604596734046936 (0.21554589862453527) | > loss_disc_real_3: 0.2713426649570465 (0.21672154667562452) | > loss_disc_real_4: 0.23650531470775604 (0.25738474399108313) | > loss_disc_real_5: 0.24649445712566376 (0.22978732632151966) | > loss_0: 2.5357437133789062 (2.4944796644408127) | > grad_norm_0: tensor(946.3150, device='cuda:0') (tensor(1282.0848, device='cuda:0')) | > loss_gen: 2.351984977722168 (2.4670284328789545) | > loss_kl: 1.3189117908477783 (1.0845770876983112) | > loss_feat: 2.3270959854125977 (5.690114939521099) | > loss_mel: 21.32015609741211 (21.97988130717442) | > loss_duration: 1.5926330089569092 (1.6274641300069874) | > loss_1: 28.910781860351562 (32.84906602727956) | > grad_norm_1: tensor(6520.3179, device='cuda:0') (tensor(54532.8906, device='cuda:0')) | > current_lr_0: 0.00015100301486126728 | > current_lr_1: 0.00015100301486126728 | > step_time: 0.6067 (0.45291355560565816) | > loader_time: 0.0045 (0.012029976680360991)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7378923892974854 (2.7378923892974854) | > loss_disc_real_0: 0.2785230875015259 (0.2785230875015259) | > loss_disc_real_1: 0.2869097590446472 (0.2869097590446472) | > loss_disc_real_2: 0.160787433385849 (0.160787433385849) | > loss_disc_real_3: 0.3800452947616577 (0.3800452947616577) | > loss_disc_real_4: 0.21640974283218384 (0.21640974283218384) | > loss_disc_real_5: 0.45043423771858215 (0.45043423771858215) | > loss_0: 2.7378923892974854 (2.7378923892974854) | > loss_gen: 2.470916748046875 (2.470916748046875) | > loss_kl: 2.6081197261810303 (2.6081197261810303) | > loss_feat: 3.7155749797821045 (3.7155749797821045) | > loss_mel: 23.421096801757812 (23.421096801757812) | > loss_duration: 2.2965312004089355 (2.2965312004089355) | > loss_1: 34.512237548828125 (34.512237548828125)  --> STEP: 1 | > loss_disc: 2.496497392654419 (2.496497392654419) | > loss_disc_real_0: 0.35159334540367126 (0.35159334540367126) | > loss_disc_real_1: 0.22399403154850006 (0.22399403154850006) | > loss_disc_real_2: 0.18010781705379486 (0.18010781705379486) | > loss_disc_real_3: 0.24805869162082672 (0.24805869162082672) | > loss_disc_real_4: 0.19215339422225952 (0.19215339422225952) | > loss_disc_real_5: 0.21012409031391144 (0.21012409031391144) | > loss_0: 2.496497392654419 (2.496497392654419) | > loss_gen: 2.558213233947754 (2.558213233947754) | > loss_kl: 3.2650651931762695 (3.2650651931762695) | > loss_feat: 4.838335037231445 (4.838335037231445) | > loss_mel: 24.502559661865234 (24.502559661865234) | > loss_duration: 2.611117124557495 (2.611117124557495) | > loss_1: 37.775291442871094 (37.775291442871094)  --> STEP: 2 | > loss_disc: 2.1042208671569824 (2.3003591299057007) | > loss_disc_real_0: 0.45211005210876465 (0.40185169875621796) | > loss_disc_real_1: 0.23007352650165558 (0.22703377902507782) | > loss_disc_real_2: 0.12644511461257935 (0.1532764658331871) | > loss_disc_real_3: 0.25713780522346497 (0.25259824842214584) | > loss_disc_real_4: 0.12201616913080215 (0.15708478167653084) | > loss_disc_real_5: 0.19808848202228546 (0.20410628616809845) | > loss_0: 2.1042208671569824 (2.3003591299057007) | > loss_gen: 3.101858139038086 (2.83003568649292) | > loss_kl: 3.5809133052825928 (3.422989249229431) | > loss_feat: 8.430475234985352 (6.634405136108398) | > loss_mel: 27.435068130493164 (25.9688138961792) | > loss_duration: 2.512861967086792 (2.5619895458221436) | > loss_1: 45.061180114746094 (41.418235778808594)  --> STEP: 3 | > loss_disc: 2.8392186164855957 (2.4799789587656655) | > loss_disc_real_0: 0.3944738209247589 (0.3993924061457316) | > loss_disc_real_1: 0.23799099028110504 (0.23068618277708688) | > loss_disc_real_2: 0.18152983486652374 (0.16269425551096597) | > loss_disc_real_3: 0.23994870483875275 (0.24838173389434814) | > loss_disc_real_4: 0.2566062808036804 (0.19025861471891403) | > loss_disc_real_5: 0.272894024848938 (0.22703553239504495) | > loss_0: 2.8392186164855957 (2.4799789587656655) | > loss_gen: 1.8605914115905762 (2.506887594858805) | > loss_kl: 1.4759067296981812 (2.7739617427190146) | > loss_feat: 1.635546088218689 (4.968118786811829) | > loss_mel: 19.33570098876953 (23.757776260375977) | > loss_duration: 2.4402878284454346 (2.5214223066965737) | > loss_1: 26.74803352355957 (36.52816836039225) --> EVAL PERFORMANCE | > avg_loader_time: 0.010085503260294596 (+0.0009682178497314453) | > avg_loss_disc: 2.4799789587656655 (-0.24790596961975098) | > avg_loss_disc_real_0: 0.3993924061457316 (+0.12628236413002014) | > avg_loss_disc_real_1: 0.23068618277708688 (-0.02191747228304544) | > avg_loss_disc_real_2: 0.16269425551096597 (-0.10381081203619638) | > avg_loss_disc_real_3: 0.24838173389434814 (+0.052419982850551605) | > avg_loss_disc_real_4: 0.19025861471891403 (-0.018779178460439055) | > avg_loss_disc_real_5: 0.22703553239504495 (+0.0008393848935762949) | > avg_loss_0: 2.4799789587656655 (-0.24790596961975098) | > avg_loss_gen: 2.506887594858805 (+0.6712137858072915) | > avg_loss_kl: 2.7739617427190146 (+0.13335124651591013) | > avg_loss_feat: 4.968118786811829 (+1.5367329195141792) | > avg_loss_mel: 23.757776260375977 (+7.3322530190149955) | > avg_loss_duration: 2.5214223066965737 (-0.008916854858398438) | > avg_loss_1: 36.52816836039225 (+9.66463470458984)  > EPOCH: 282/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:44:24)   --> TIME: 2023-10-20 02:44:32 -- STEP: 9/50 -- GLOBAL_STEP: 67110 | > loss_disc: 3.0648791790008545 (2.5306636095046997) | > loss_disc_real_0: 0.06190503388643265 (0.22721616841024822) | > loss_disc_real_1: 0.2635347843170166 (0.22714842855930328) | > loss_disc_real_2: 0.37905529141426086 (0.2454573255446222) | > loss_disc_real_3: 0.31629469990730286 (0.23162809014320374) | > loss_disc_real_4: 0.259609580039978 (0.20792442974117067) | > loss_disc_real_5: 0.2511022686958313 (0.22669719542480177) | > loss_0: 3.0648791790008545 (2.5306636095046997) | > grad_norm_0: tensor(1087.0542, device='cuda:0') (tensor(979.0516, device='cuda:0')) | > loss_gen: 1.7288172245025635 (2.284221159087287) | > loss_kl: 0.9966709613800049 (1.0150512059529622) | > loss_feat: 2.19395112991333 (5.648270736138026) | > loss_mel: 24.166893005371094 (22.826619784037273) | > loss_duration: 1.5752424001693726 (1.6309310860104032) | > loss_1: 30.661575317382812 (33.40509457058377) | > grad_norm_1: tensor(4898.9893, device='cuda:0') (tensor(35552.2109, device='cuda:0')) | > current_lr_0: 0.0001508520778937116 | > current_lr_1: 0.0001508520778937116 | > step_time: 0.3069 (0.510693179236518) | > loader_time: 0.0268 (0.01635138193766276)  --> TIME: 2023-10-20 02:44:43 -- STEP: 39/50 -- GLOBAL_STEP: 67140 | > loss_disc: 2.974660873413086 (2.5444729389288487) | > loss_disc_real_0: 0.10252821445465088 (0.19260747310442802) | > loss_disc_real_1: 0.32466644048690796 (0.24813589797570154) | > loss_disc_real_2: 0.29160308837890625 (0.22528582639419115) | > loss_disc_real_3: 0.2516145706176758 (0.24622253481394205) | > loss_disc_real_4: 0.22831231355667114 (0.2353812970985205) | > loss_disc_real_5: 0.24679824709892273 (0.22948807107810026) | > loss_0: 2.974660873413086 (2.5444729389288487) | > grad_norm_0: tensor(1353.1923, device='cuda:0') (tensor(849.5121, device='cuda:0')) | > loss_gen: 1.5668566226959229 (2.3291443219551673) | > loss_kl: 0.8402050733566284 (0.9376767904330523) | > loss_feat: 0.29499781131744385 (5.121935983307851) | > loss_mel: 2.8627686500549316 (23.073744578239246) | > loss_duration: 1.623047947883606 (1.595995334478525) | > loss_1: 7.187875747680664 (33.05849706209623) | > grad_norm_1: tensor(11940.4814, device='cuda:0') (tensor(27759.8945, device='cuda:0')) | > current_lr_0: 0.0001508520778937116 | > current_lr_1: 0.0001508520778937116 | > step_time: 0.2595 (0.3924147532536433) | > loader_time: 0.0024 (0.009143890478672126)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.080641508102417 (3.080641508102417) | > loss_disc_real_0: 0.27734750509262085 (0.27734750509262085) | > loss_disc_real_1: 0.24156320095062256 (0.24156320095062256) | > loss_disc_real_2: 0.2520197331905365 (0.2520197331905365) | > loss_disc_real_3: 0.30029061436653137 (0.30029061436653137) | > loss_disc_real_4: 0.29974597692489624 (0.29974597692489624) | > loss_disc_real_5: 0.24519756436347961 (0.24519756436347961) | > loss_0: 3.080641508102417 (3.080641508102417) | > loss_gen: 1.5492717027664185 (1.5492717027664185) | > loss_kl: 2.6114981174468994 (2.6114981174468994) | > loss_feat: 0.20100617408752441 (0.20100617408752441) | > loss_mel: 17.32792854309082 (17.32792854309082) | > loss_duration: 2.2601938247680664 (2.2601938247680664) | > loss_1: 23.94989776611328 (23.94989776611328)  --> STEP: 1 | > loss_disc: 1.3350725173950195 (1.3350725173950195) | > loss_disc_real_0: 0.05024975538253784 (0.05024975538253784) | > loss_disc_real_1: 0.15332791209220886 (0.15332791209220886) | > loss_disc_real_2: 0.30218374729156494 (0.30218374729156494) | > loss_disc_real_3: 0.2081047147512436 (0.2081047147512436) | > loss_disc_real_4: 0.11387953162193298 (0.11387953162193298) | > loss_disc_real_5: 0.031298015266656876 (0.031298015266656876) | > loss_0: 1.3350725173950195 (1.3350725173950195) | > loss_gen: 4.073782920837402 (4.073782920837402) | > loss_kl: 3.519587278366089 (3.519587278366089) | > loss_feat: 11.204144477844238 (11.204144477844238) | > loss_mel: 26.261760711669922 (26.261760711669922) | > loss_duration: 2.5003914833068848 (2.5003914833068848) | > loss_1: 47.559669494628906 (47.559669494628906)  --> STEP: 2 | > loss_disc: 3.078687906265259 (2.206880211830139) | > loss_disc_real_0: 0.27908754348754883 (0.16466864943504333) | > loss_disc_real_1: 0.24121201038360596 (0.1972699612379074) | > loss_disc_real_2: 0.2512819766998291 (0.276732861995697) | > loss_disc_real_3: 0.2997027337551117 (0.25390372425317764) | > loss_disc_real_4: 0.3001542091369629 (0.20701687037944794) | > loss_disc_real_5: 0.24518461525440216 (0.13824131526052952) | > loss_0: 3.078687906265259 (2.206880211830139) | > loss_gen: 1.549355149269104 (2.811569035053253) | > loss_kl: 3.931795835494995 (3.725691556930542) | > loss_feat: 0.16130775213241577 (5.682726114988327) | > loss_mel: 2.9621105194091797 (14.61193561553955) | > loss_duration: 2.399179458618164 (2.4497854709625244) | > loss_1: 11.003748893737793 (29.28170919418335)  --> STEP: 3 | > loss_disc: 3.078979015350342 (2.49757981300354) | > loss_disc_real_0: 0.2796635031700134 (0.20300026734670004) | > loss_disc_real_1: 0.24118752777576447 (0.21190915008385977) | > loss_disc_real_2: 0.25112244486808777 (0.26819605628649396) | > loss_disc_real_3: 0.29967251420021057 (0.2691599875688553) | > loss_disc_real_4: 0.3001183867454529 (0.23805070916811624) | > loss_disc_real_5: 0.24521099030971527 (0.1738978736102581) | > loss_0: 3.078979015350342 (2.49757981300354) | > loss_gen: 1.549391746520996 (2.3908432722091675) | > loss_kl: 1.5627036094665527 (3.0046955744425454) | > loss_feat: 0.16148652136325836 (3.842312917113304) | > loss_mel: 3.05373477935791 (10.759202003479004) | > loss_duration: 2.510291337966919 (2.4699540932973227) | > loss_1: 8.837608337402344 (22.46700890858968) --> EVAL PERFORMANCE | > avg_loader_time: 0.006460984547932942 (-0.0036245187123616534) | > avg_loss_disc: 2.49757981300354 (+0.017600854237874497) | > avg_loss_disc_real_0: 0.20300026734670004 (-0.19639213879903158) | > avg_loss_disc_real_1: 0.21190915008385977 (-0.018777032693227114) | > avg_loss_disc_real_2: 0.26819605628649396 (+0.10550180077552798) | > avg_loss_disc_real_3: 0.2691599875688553 (+0.02077825367450714) | > avg_loss_disc_real_4: 0.23805070916811624 (+0.04779209444920221) | > avg_loss_disc_real_5: 0.1738978736102581 (-0.05313765878478685) | > avg_loss_0: 2.49757981300354 (+0.017600854237874497) | > avg_loss_gen: 2.3908432722091675 (-0.11604432264963771) | > avg_loss_kl: 3.0046955744425454 (+0.2307338317235308) | > avg_loss_feat: 3.842312917113304 (-1.1258058696985245) | > avg_loss_mel: 10.759202003479004 (-12.998574256896973) | > avg_loss_duration: 2.4699540932973227 (-0.051468213399251006) | > avg_loss_1: 22.46700890858968 (-14.06115945180257)  > EPOCH: 283/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:45:02)   --> TIME: 2023-10-20 02:45:16 -- STEP: 19/50 -- GLOBAL_STEP: 67170 | > loss_disc: 2.100184917449951 (2.4635252576125297) | > loss_disc_real_0: 0.08727086335420609 (0.1569995024290524) | > loss_disc_real_1: 0.1941494345664978 (0.20390134442009425) | > loss_disc_real_2: 0.28226906061172485 (0.22537683695554733) | > loss_disc_real_3: 0.09751257300376892 (0.23444224031347977) | > loss_disc_real_4: 0.2408333569765091 (0.19837226012819692) | > loss_disc_real_5: 0.2927425503730774 (0.20238513675959488) | > loss_0: 2.100184917449951 (2.4635252576125297) | > grad_norm_0: tensor(324.4084, device='cuda:0') (tensor(466.2169, device='cuda:0')) | > loss_gen: 2.792799949645996 (2.2356502256895365) | > loss_kl: 1.2004441022872925 (1.0866294848291498) | > loss_feat: 7.300334453582764 (4.631466029604014) | > loss_mel: 24.733686447143555 (21.51512366846988) | > loss_duration: 1.7177268266677856 (1.6479189270421077) | > loss_1: 37.7449951171875 (31.116788588072126) | > grad_norm_1: tensor(11166.6523, device='cuda:0') (tensor(23089.3574, device='cuda:0')) | > current_lr_0: 0.00015070129179710505 | > current_lr_1: 0.00015070129179710505 | > step_time: 0.5319 (0.49430027760957423) | > loader_time: 0.0171 (0.020336226413124485)  --> TIME: 2023-10-20 02:45:32 -- STEP: 49/50 -- GLOBAL_STEP: 67200 | > loss_disc: 2.9428234100341797 (2.4379923051717323) | > loss_disc_real_0: 0.12690645456314087 (0.15308078119949414) | > loss_disc_real_1: 0.3759773373603821 (0.22028005814978055) | > loss_disc_real_2: 0.4289097189903259 (0.2126338292597508) | > loss_disc_real_3: 0.35563552379608154 (0.24768433522204963) | > loss_disc_real_4: 0.27441099286079407 (0.2124896251349425) | > loss_disc_real_5: 0.5474267601966858 (0.19780921502685064) | > loss_0: 2.9428234100341797 (2.4379923051717323) | > grad_norm_0: tensor(1114.4858, device='cuda:0') (tensor(511.6405, device='cuda:0')) | > loss_gen: 2.8202457427978516 (2.2776985217113896) | > loss_kl: 0.5425568222999573 (1.0290992862107802) | > loss_feat: 5.467285633087158 (4.767355995328756) | > loss_mel: 24.125255584716797 (21.639043423594252) | > loss_duration: 1.6663285493850708 (1.605254394667489) | > loss_1: 34.621673583984375 (31.318451959259654) | > grad_norm_1: tensor(25979.1875, device='cuda:0') (tensor(22898.3047, device='cuda:0')) | > current_lr_0: 0.00015070129179710505 | > current_lr_1: 0.00015070129179710505 | > step_time: 0.6509 (0.4938833032335554) | > loader_time: 0.3697 (0.028515134538922987)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.314164400100708 (2.314164400100708) | > loss_disc_real_0: 0.23887181282043457 (0.23887181282043457) | > loss_disc_real_1: 0.19131335616111755 (0.19131335616111755) | > loss_disc_real_2: 0.2561446726322174 (0.2561446726322174) | > loss_disc_real_3: 0.258670449256897 (0.258670449256897) | > loss_disc_real_4: 0.1329476237297058 (0.1329476237297058) | > loss_disc_real_5: 0.2712976336479187 (0.2712976336479187) | > loss_0: 2.314164400100708 (2.314164400100708) | > loss_gen: 2.926111936569214 (2.926111936569214) | > loss_kl: 3.6374101638793945 (3.6374101638793945) | > loss_feat: 5.472571849822998 (5.472571849822998) | > loss_mel: 21.767616271972656 (21.767616271972656) | > loss_duration: 2.39795184135437 (2.39795184135437) | > loss_1: 36.201663970947266 (36.201663970947266)  --> STEP: 1 | > loss_disc: 2.8015761375427246 (2.8015761375427246) | > loss_disc_real_0: 0.3764975666999817 (0.3764975666999817) | > loss_disc_real_1: 0.27331408858299255 (0.27331408858299255) | > loss_disc_real_2: 0.25823378562927246 (0.25823378562927246) | > loss_disc_real_3: 0.23120583593845367 (0.23120583593845367) | > loss_disc_real_4: 0.29060032963752747 (0.29060032963752747) | > loss_disc_real_5: 0.30696719884872437 (0.30696719884872437) | > loss_0: 2.8015761375427246 (2.8015761375427246) | > loss_gen: 2.1387646198272705 (2.1387646198272705) | > loss_kl: 3.365316390991211 (3.365316390991211) | > loss_feat: 0.7610007524490356 (0.7610007524490356) | > loss_mel: 15.14401912689209 (15.14401912689209) | > loss_duration: 2.568122625350952 (2.568122625350952) | > loss_1: 23.977224349975586 (23.977224349975586)  --> STEP: 2 | > loss_disc: 2.716848373413086 (2.7592122554779053) | > loss_disc_real_0: 0.13719898462295532 (0.2568482756614685) | > loss_disc_real_1: 0.1860019713640213 (0.22965802997350693) | > loss_disc_real_2: 0.2762371003627777 (0.2672354429960251) | > loss_disc_real_3: 0.15362676978111267 (0.19241630285978317) | > loss_disc_real_4: 0.20712223649024963 (0.24886128306388855) | > loss_disc_real_5: 0.3938853144645691 (0.35042625665664673) | > loss_0: 2.716848373413086 (2.7592122554779053) | > loss_gen: 2.045968770980835 (2.0923666954040527) | > loss_kl: 3.9823334217071533 (3.673824906349182) | > loss_feat: 5.174252986907959 (2.9676268696784973) | > loss_mel: 28.472972869873047 (21.80849599838257) | > loss_duration: 2.5058720111846924 (2.5369973182678223) | > loss_1: 42.181396484375 (33.07931041717529)  --> STEP: 3 | > loss_disc: 2.818012237548828 (2.7788122495015464) | > loss_disc_real_0: 0.2741541564464569 (0.262616902589798) | > loss_disc_real_1: 0.2713622748851776 (0.2435594449440638) | > loss_disc_real_2: 0.31027281284332275 (0.2815812329451243) | > loss_disc_real_3: 0.32107990980148315 (0.23530417184034982) | > loss_disc_real_4: 0.325408935546875 (0.27437716722488403) | > loss_disc_real_5: 0.3513270616531372 (0.35072652498881024) | > loss_0: 2.818012237548828 (2.7788122495015464) | > loss_gen: 2.2905874252319336 (2.158440272013346) | > loss_kl: 1.9315119981765747 (3.093053936958313) | > loss_feat: 1.7523170709609985 (2.562523603439331) | > loss_mel: 23.014020919799805 (22.21033763885498) | > loss_duration: 2.481508255004883 (2.5185009638468423) | > loss_1: 31.469945907592773 (32.54285558064779) --> EVAL PERFORMANCE | > avg_loader_time: 0.005710045496622722 (-0.0007509390513102208) | > avg_loss_disc: 2.7788122495015464 (+0.28123243649800633) | > avg_loss_disc_real_0: 0.262616902589798 (+0.05961663524309793) | > avg_loss_disc_real_1: 0.2435594449440638 (+0.03165029486020404) | > avg_loss_disc_real_2: 0.2815812329451243 (+0.013385176658630371) | > avg_loss_disc_real_3: 0.23530417184034982 (-0.03385581572850546) | > avg_loss_disc_real_4: 0.27437716722488403 (+0.03632645805676779) | > avg_loss_disc_real_5: 0.35072652498881024 (+0.17682865137855214) | > avg_loss_0: 2.7788122495015464 (+0.28123243649800633) | > avg_loss_gen: 2.158440272013346 (-0.23240300019582127) | > avg_loss_kl: 3.093053936958313 (+0.08835836251576756) | > avg_loss_feat: 2.562523603439331 (-1.279789313673973) | > avg_loss_mel: 22.21033763885498 (+11.451135635375977) | > avg_loss_duration: 2.5185009638468423 (+0.04854687054951956) | > avg_loss_1: 32.54285558064779 (+10.075846672058109)  > EPOCH: 284/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:45:43)   --> TIME: 2023-10-20 02:46:03 -- STEP: 29/50 -- GLOBAL_STEP: 67230 | > loss_disc: 2.8382790088653564 (2.5176249536974677) | > loss_disc_real_0: 0.09286118298768997 (0.16666229750061856) | > loss_disc_real_1: 0.24808873236179352 (0.24542056948974209) | > loss_disc_real_2: 0.2700050175189972 (0.26012588472201903) | > loss_disc_real_3: 0.23169900476932526 (0.2462373966158464) | > loss_disc_real_4: 0.2780952453613281 (0.23841418300209374) | > loss_disc_real_5: 0.2152508646249771 (0.22667105740000462) | > loss_0: 2.8382790088653564 (2.5176249536974677) | > grad_norm_0: tensor(597.8518, device='cuda:0') (tensor(741.4376, device='cuda:0')) | > loss_gen: 1.6102688312530518 (2.3579052686691284) | > loss_kl: 0.9844423532485962 (1.0338663931550651) | > loss_feat: 1.0200711488723755 (4.738975705771611) | > loss_mel: 10.997455596923828 (21.19196337667005) | > loss_duration: 1.5886666774749756 (1.5996505597542072) | > loss_1: 16.200904846191406 (30.92236145611466) | > grad_norm_1: tensor(5702.7256, device='cuda:0') (tensor(20020.2461, device='cuda:0')) | > current_lr_0: 0.00015055065642064267 | > current_lr_1: 0.00015055065642064267 | > step_time: 0.6391 (0.48958800578939504) | > loader_time: 0.0118 (0.01222688576270794)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.130307674407959 (2.130307674407959) | > loss_disc_real_0: 0.24393485486507416 (0.24393485486507416) | > loss_disc_real_1: 0.14924533665180206 (0.14924533665180206) | > loss_disc_real_2: 0.2142373025417328 (0.2142373025417328) | > loss_disc_real_3: 0.2158983200788498 (0.2158983200788498) | > loss_disc_real_4: 0.2543429434299469 (0.2543429434299469) | > loss_disc_real_5: 0.20731639862060547 (0.20731639862060547) | > loss_0: 2.130307674407959 (2.130307674407959) | > loss_gen: 2.7530431747436523 (2.7530431747436523) | > loss_kl: 2.6013829708099365 (2.6013829708099365) | > loss_feat: 7.734503746032715 (7.734503746032715) | > loss_mel: 25.044429779052734 (25.044429779052734) | > loss_duration: 2.3709793090820312 (2.3709793090820312) | > loss_1: 40.50434112548828 (40.50434112548828)  --> STEP: 1 | > loss_disc: 2.4130804538726807 (2.4130804538726807) | > loss_disc_real_0: 0.08804678171873093 (0.08804678171873093) | > loss_disc_real_1: 0.3290407657623291 (0.3290407657623291) | > loss_disc_real_2: 0.22688166797161102 (0.22688166797161102) | > loss_disc_real_3: 0.2576971650123596 (0.2576971650123596) | > loss_disc_real_4: 0.1550654023885727 (0.1550654023885727) | > loss_disc_real_5: 0.2448292374610901 (0.2448292374610901) | > loss_0: 2.4130804538726807 (2.4130804538726807) | > loss_gen: 2.1537530422210693 (2.1537530422210693) | > loss_kl: 3.2859623432159424 (3.2859623432159424) | > loss_feat: 3.144737482070923 (3.144737482070923) | > loss_mel: 22.817672729492188 (22.817672729492188) | > loss_duration: 2.6122148036956787 (2.6122148036956787) | > loss_1: 34.014339447021484 (34.014339447021484)  --> STEP: 2 | > loss_disc: 2.3147623538970947 (2.3639214038848877) | > loss_disc_real_0: 0.35147687792778015 (0.21976182982325554) | > loss_disc_real_1: 0.2620733976364136 (0.29555708169937134) | > loss_disc_real_2: 0.15677304565906525 (0.19182735681533813) | > loss_disc_real_3: 0.3294852375984192 (0.2935912013053894) | > loss_disc_real_4: 0.14224927127361298 (0.14865733683109283) | > loss_disc_real_5: 0.12596644461154938 (0.18539784103631973) | > loss_0: 2.3147623538970947 (2.3639214038848877) | > loss_gen: 2.676422357559204 (2.4150876998901367) | > loss_kl: 3.4419829845428467 (3.3639726638793945) | > loss_feat: 7.902838706970215 (5.523788094520569) | > loss_mel: 23.754348754882812 (23.2860107421875) | > loss_duration: 2.5350513458251953 (2.573633074760437) | > loss_1: 40.310646057128906 (37.162492752075195)  --> STEP: 3 | > loss_disc: 2.289851188659668 (2.339231332143148) | > loss_disc_real_0: 0.1042400673031807 (0.18125457564989725) | > loss_disc_real_1: 0.25611257553100586 (0.2824089129765828) | > loss_disc_real_2: 0.292376309633255 (0.22534367442131042) | > loss_disc_real_3: 0.24184711277484894 (0.27634317179520923) | > loss_disc_real_4: 0.3679755628108978 (0.2217634121576945) | > loss_disc_real_5: 0.1578913927078247 (0.17622902492682138) | > loss_0: 2.289851188659668 (2.339231332143148) | > loss_gen: 2.7398781776428223 (2.5233511924743652) | > loss_kl: 1.427543044090271 (2.7184961239496865) | > loss_feat: 4.991566181182861 (5.346380790074666) | > loss_mel: 23.900625228881836 (23.490882237752277) | > loss_duration: 2.550435781478882 (2.5659006436665854) | > loss_1: 35.61004638671875 (36.64501063028971) --> EVAL PERFORMANCE | > avg_loader_time: 0.009665966033935547 (+0.003955920537312825) | > avg_loss_disc: 2.339231332143148 (-0.43958091735839844) | > avg_loss_disc_real_0: 0.18125457564989725 (-0.08136232693990073) | > avg_loss_disc_real_1: 0.2824089129765828 (+0.03884946803251901) | > avg_loss_disc_real_2: 0.22534367442131042 (-0.0562375585238139) | > avg_loss_disc_real_3: 0.27634317179520923 (+0.041038999954859406) | > avg_loss_disc_real_4: 0.2217634121576945 (-0.052613755067189544) | > avg_loss_disc_real_5: 0.17622902492682138 (-0.17449750006198886) | > avg_loss_0: 2.339231332143148 (-0.43958091735839844) | > avg_loss_gen: 2.5233511924743652 (+0.36491092046101903) | > avg_loss_kl: 2.7184961239496865 (-0.37455781300862645) | > avg_loss_feat: 5.346380790074666 (+2.783857186635335) | > avg_loss_mel: 23.490882237752277 (+1.280544598897297) | > avg_loss_duration: 2.5659006436665854 (+0.047399679819743135) | > avg_loss_1: 36.64501063028971 (+4.102155049641922)  > EPOCH: 285/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:46:24)   --> TIME: 2023-10-20 02:46:33 -- STEP: 9/50 -- GLOBAL_STEP: 67260 | > loss_disc: 2.490868330001831 (2.24681027730306) | > loss_disc_real_0: 0.0396709144115448 (0.12696150317788124) | > loss_disc_real_1: 0.33390241861343384 (0.19101796733836332) | > loss_disc_real_2: 0.3033021092414856 (0.20573598767320314) | > loss_disc_real_3: 0.40301966667175293 (0.2364774358769258) | > loss_disc_real_4: 0.2379702776670456 (0.19733716485400996) | > loss_disc_real_5: 0.12957435846328735 (0.13958201774706444) | > loss_0: 2.490868330001831 (2.24681027730306) | > grad_norm_0: tensor(757.3506, device='cuda:0') (tensor(615.5674, device='cuda:0')) | > loss_gen: 2.4035229682922363 (2.6765609317355685) | > loss_kl: 0.7420445084571838 (0.928149594200982) | > loss_feat: 5.4397501945495605 (6.998942534128825) | > loss_mel: 24.662208557128906 (25.7664672003852) | > loss_duration: 1.5558183193206787 (1.6125109195709229) | > loss_1: 34.8033447265625 (37.98263147142198) | > grad_norm_1: tensor(5546.2861, device='cuda:0') (tensor(16871.3711, device='cuda:0')) | > current_lr_0: 0.00015040017161367027 | > current_lr_1: 0.00015040017161367027 | > step_time: 0.2962 (0.4856122069888645) | > loader_time: 0.0248 (0.018359369701809354)  --> TIME: 2023-10-20 02:46:46 -- STEP: 39/50 -- GLOBAL_STEP: 67290 | > loss_disc: 3.0894031524658203 (2.48400602890895) | > loss_disc_real_0: 0.48670148849487305 (0.16888839832674235) | > loss_disc_real_1: 0.25845983624458313 (0.22390103306716833) | > loss_disc_real_2: 0.2507530450820923 (0.22428766093575037) | > loss_disc_real_3: 0.27081024646759033 (0.24566108723863578) | > loss_disc_real_4: 0.266801655292511 (0.21724266563661587) | > loss_disc_real_5: 0.277588427066803 (0.21572742661317953) | > loss_0: 3.0894031524658203 (2.48400602890895) | > grad_norm_0: tensor(972.7072, device='cuda:0') (tensor(705.0863, device='cuda:0')) | > loss_gen: 1.807003378868103 (2.3479388463191495) | > loss_kl: 0.5362932682037354 (0.914509728932992) | > loss_feat: 0.1274433434009552 (4.882444304915575) | > loss_mel: 2.3171608448028564 (21.682526447834114) | > loss_duration: 1.6041268110275269 (1.5931399846688294) | > loss_1: 6.392027854919434 (31.420559504093273) | > grad_norm_1: tensor(18064.6816, device='cuda:0') (tensor(15762.7275, device='cuda:0')) | > current_lr_0: 0.00015040017161367027 | > current_lr_1: 0.00015040017161367027 | > step_time: 0.6821 (0.42337699425526154) | > loader_time: 0.022 (0.010742004101092998)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0021510124206543 (2.0021510124206543) | > loss_disc_real_0: 0.24722552299499512 (0.24722552299499512) | > loss_disc_real_1: 0.23382118344306946 (0.23382118344306946) | > loss_disc_real_2: 0.19764401018619537 (0.19764401018619537) | > loss_disc_real_3: 0.19275103509426117 (0.19275103509426117) | > loss_disc_real_4: 0.11142583191394806 (0.11142583191394806) | > loss_disc_real_5: 0.13195307552814484 (0.13195307552814484) | > loss_0: 2.0021510124206543 (2.0021510124206543) | > loss_gen: 2.6927268505096436 (2.6927268505096436) | > loss_kl: 2.759911298751831 (2.759911298751831) | > loss_feat: 7.207554340362549 (7.207554340362549) | > loss_mel: 28.70561981201172 (28.70561981201172) | > loss_duration: 2.3370730876922607 (2.3370730876922607) | > loss_1: 43.702884674072266 (43.702884674072266)  --> STEP: 1 | > loss_disc: 2.3694958686828613 (2.3694958686828613) | > loss_disc_real_0: 0.0621013268828392 (0.0621013268828392) | > loss_disc_real_1: 0.22572827339172363 (0.22572827339172363) | > loss_disc_real_2: 0.1525295376777649 (0.1525295376777649) | > loss_disc_real_3: 0.15835946798324585 (0.15835946798324585) | > loss_disc_real_4: 0.2626115083694458 (0.2626115083694458) | > loss_disc_real_5: 0.13869941234588623 (0.13869941234588623) | > loss_0: 2.3694958686828613 (2.3694958686828613) | > loss_gen: 1.8373310565948486 (1.8373310565948486) | > loss_kl: 3.167860746383667 (3.167860746383667) | > loss_feat: 8.428616523742676 (8.428616523742676) | > loss_mel: 27.155059814453125 (27.155059814453125) | > loss_duration: 2.4836416244506836 (2.4836416244506836) | > loss_1: 43.072509765625 (43.072509765625)  --> STEP: 2 | > loss_disc: 1.601638913154602 (1.9855673909187317) | > loss_disc_real_0: 0.07118673622608185 (0.06664403155446053) | > loss_disc_real_1: 0.10798109322786331 (0.16685468330979347) | > loss_disc_real_2: 0.13412566483020782 (0.14332760125398636) | > loss_disc_real_3: 0.13936474919319153 (0.1488621085882187) | > loss_disc_real_4: 0.20646889507770538 (0.2345402017235756) | > loss_disc_real_5: 0.08248678594827652 (0.11059309914708138) | > loss_0: 1.601638913154602 (1.9855673909187317) | > loss_gen: 2.64041805267334 (2.2388745546340942) | > loss_kl: 3.4422290325164795 (3.3050448894500732) | > loss_feat: 9.259610176086426 (8.84411334991455) | > loss_mel: 28.378372192382812 (27.76671600341797) | > loss_duration: 2.466648578643799 (2.475145101547241) | > loss_1: 46.187278747558594 (44.6298942565918)  --> STEP: 3 | > loss_disc: 2.631053924560547 (2.200729568799337) | > loss_disc_real_0: 0.07996516674757004 (0.0710844099521637) | > loss_disc_real_1: 0.21193741261959076 (0.18188225974639258) | > loss_disc_real_2: 0.43544113636016846 (0.24069877962271372) | > loss_disc_real_3: 0.24180954694747925 (0.17984458804130554) | > loss_disc_real_4: 0.37566491961479187 (0.281581774353981) | > loss_disc_real_5: 0.3554414212703705 (0.19220920652151108) | > loss_0: 2.631053924560547 (2.200729568799337) | > loss_gen: 2.448435068130493 (2.308728059132894) | > loss_kl: 1.949982762336731 (2.853357513745626) | > loss_feat: 5.574908256530762 (7.754378318786621) | > loss_mel: 22.136098861694336 (25.889843622843426) | > loss_duration: 2.4751713275909424 (2.475153843561808) | > loss_1: 34.5845947265625 (41.28146107991537) --> EVAL PERFORMANCE | > avg_loader_time: 0.008104801177978516 (-0.0015611648559570312) | > avg_loss_disc: 2.200729568799337 (-0.13850176334381104) | > avg_loss_disc_real_0: 0.0710844099521637 (-0.11017016569773355) | > avg_loss_disc_real_1: 0.18188225974639258 (-0.10052665323019025) | > avg_loss_disc_real_2: 0.24069877962271372 (+0.01535510520140329) | > avg_loss_disc_real_3: 0.17984458804130554 (-0.09649858375390369) | > avg_loss_disc_real_4: 0.281581774353981 (+0.05981836219628653) | > avg_loss_disc_real_5: 0.19220920652151108 (+0.015980181594689696) | > avg_loss_0: 2.200729568799337 (-0.13850176334381104) | > avg_loss_gen: 2.308728059132894 (-0.2146231333414712) | > avg_loss_kl: 2.853357513745626 (+0.13486138979593942) | > avg_loss_feat: 7.754378318786621 (+2.407997528711955) | > avg_loss_mel: 25.889843622843426 (+2.398961385091148) | > avg_loss_duration: 2.475153843561808 (-0.09074680010477731) | > avg_loss_1: 41.28146107991537 (+4.636450449625656)  > EPOCH: 286/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:47:00)   --> TIME: 2023-10-20 02:47:14 -- STEP: 19/50 -- GLOBAL_STEP: 67320 | > loss_disc: 1.6869155168533325 (2.2977238517058525) | > loss_disc_real_0: 0.0654304027557373 (0.12843956778708257) | > loss_disc_real_1: 0.2926872670650482 (0.21246260875149778) | > loss_disc_real_2: 0.13431817293167114 (0.20447664884360214) | > loss_disc_real_3: 0.3940970301628113 (0.25770577317789983) | > loss_disc_real_4: 0.07862205803394318 (0.1993911512392132) | > loss_disc_real_5: 0.22125473618507385 (0.19574610241933874) | > loss_0: 1.6869155168533325 (2.2977238517058525) | > grad_norm_0: tensor(425.0112, device='cuda:0') (tensor(433.5511, device='cuda:0')) | > loss_gen: 3.960801601409912 (2.4423021203593205) | > loss_kl: 0.7990881204605103 (0.7874608118283121) | > loss_feat: 10.313614845275879 (5.355824624776448) | > loss_mel: 25.243833541870117 (22.83097279071808) | > loss_duration: 1.7117764949798584 (1.6453077040220563) | > loss_1: 42.02911376953125 (33.06186756334807) | > grad_norm_1: tensor(52218.0820, device='cuda:0') (tensor(24564.2949, device='cuda:0')) | > current_lr_0: 0.00015024983722568418 | > current_lr_1: 0.00015024983722568418 | > step_time: 0.2819 (0.48046139666908666) | > loader_time: 0.0252 (0.021031781246787624)  --> TIME: 2023-10-20 02:47:30 -- STEP: 49/50 -- GLOBAL_STEP: 67350 | > loss_disc: 2.0073416233062744 (2.3265543519234164) | > loss_disc_real_0: 0.06947952508926392 (0.11896677849320125) | > loss_disc_real_1: 0.18262261152267456 (0.22373331893159418) | > loss_disc_real_2: 0.19859980046749115 (0.22403549007615264) | > loss_disc_real_3: 0.4092177450656891 (0.2412660658663633) | > loss_disc_real_4: 0.10797742754220963 (0.22604897572677962) | > loss_disc_real_5: 0.24407412111759186 (0.21912602141347468) | > loss_0: 2.0073416233062744 (2.3265543519234164) | > grad_norm_0: tensor(668.8134, device='cuda:0') (tensor(521.5638, device='cuda:0')) | > loss_gen: 2.8292295932769775 (2.4717442283824997) | > loss_kl: 0.616866946220398 (0.8669422323606453) | > loss_feat: 4.898720741271973 (5.4341538337686535) | > loss_mel: 24.347074508666992 (22.037327997538508) | > loss_duration: 1.7096933126449585 (1.6001411384465742) | > loss_1: 34.401588439941406 (32.41030961640026) | > grad_norm_1: tensor(22671.1719, device='cuda:0') (tensor(18813.8945, device='cuda:0')) | > current_lr_0: 0.00015024983722568418 | > current_lr_1: 0.00015024983722568418 | > step_time: 0.5507 (0.4913252908356336) | > loader_time: 0.398 (0.028550595653300374)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.3243157863616943 (3.3243157863616943) | > loss_disc_real_0: 0.455253541469574 (0.455253541469574) | > loss_disc_real_1: 0.339336097240448 (0.339336097240448) | > loss_disc_real_2: 0.34032142162323 (0.34032142162323) | > loss_disc_real_3: 0.38561418652534485 (0.38561418652534485) | > loss_disc_real_4: 0.34232673048973083 (0.34232673048973083) | > loss_disc_real_5: 0.2209775298833847 (0.2209775298833847) | > loss_0: 3.3243157863616943 (3.3243157863616943) | > loss_gen: 2.076946973800659 (2.076946973800659) | > loss_kl: 2.7783093452453613 (2.7783093452453613) | > loss_feat: 3.4769322872161865 (3.4769322872161865) | > loss_mel: 24.5181884765625 (24.5181884765625) | > loss_duration: 2.3829751014709473 (2.3829751014709473) | > loss_1: 35.23335266113281 (35.23335266113281)  --> STEP: 1 | > loss_disc: 2.987487316131592 (2.987487316131592) | > loss_disc_real_0: 0.4449126422405243 (0.4449126422405243) | > loss_disc_real_1: 0.28864943981170654 (0.28864943981170654) | > loss_disc_real_2: 0.4173397123813629 (0.4173397123813629) | > loss_disc_real_3: 0.3242211639881134 (0.3242211639881134) | > loss_disc_real_4: 0.5687705278396606 (0.5687705278396606) | > loss_disc_real_5: 0.22559942305088043 (0.22559942305088043) | > loss_0: 2.987487316131592 (2.987487316131592) | > loss_gen: 3.2485573291778564 (3.2485573291778564) | > loss_kl: 3.3969833850860596 (3.3969833850860596) | > loss_feat: 5.698755264282227 (5.698755264282227) | > loss_mel: 25.36697769165039 (25.36697769165039) | > loss_duration: 2.6111135482788086 (2.6111135482788086) | > loss_1: 40.3223876953125 (40.3223876953125)  --> STEP: 2 | > loss_disc: 1.6602240800857544 (2.323855698108673) | > loss_disc_real_0: 0.1879471391439438 (0.31642989069223404) | > loss_disc_real_1: 0.07566595822572708 (0.1821576990187168) | > loss_disc_real_2: 0.0944470763206482 (0.25589339435100555) | > loss_disc_real_3: 0.1533012092113495 (0.23876118659973145) | > loss_disc_real_4: 0.05155544355511665 (0.31016298569738865) | > loss_disc_real_5: 0.10824525356292725 (0.16692233830690384) | > loss_0: 1.6602240800857544 (2.323855698108673) | > loss_gen: 2.6668176651000977 (2.957687497138977) | > loss_kl: 3.280393362045288 (3.338688373565674) | > loss_feat: 10.33515739440918 (8.016956329345703) | > loss_mel: 26.794696807861328 (26.08083724975586) | > loss_duration: 2.511479139328003 (2.5612963438034058) | > loss_1: 45.58854293823242 (42.95546531677246)  --> STEP: 3 | > loss_disc: 2.586940288543701 (2.4115505615870156) | > loss_disc_real_0: 0.40379661321640015 (0.34555213153362274) | > loss_disc_real_1: 0.3084236979484558 (0.22424636532862982) | > loss_disc_real_2: 0.34142500162124634 (0.2844039301077525) | > loss_disc_real_3: 0.2972120940685272 (0.2582448224226634) | > loss_disc_real_4: 0.20545300841331482 (0.2752596599360307) | > loss_disc_real_5: 0.29026171565055847 (0.20803546408812204) | > loss_0: 2.586940288543701 (2.4115505615870156) | > loss_gen: 3.054697275161743 (2.9900240898132324) | > loss_kl: 1.5358233451843262 (2.7377333641052246) | > loss_feat: 3.695910930633545 (6.576607863108317) | > loss_mel: 22.877042770385742 (25.012905756632488) | > loss_duration: 2.443526268005371 (2.5220396518707275) | > loss_1: 33.606998443603516 (39.83930969238281) --> EVAL PERFORMANCE | > avg_loader_time: 0.004714647928873698 (-0.0033901532491048174) | > avg_loss_disc: 2.4115505615870156 (+0.21082099278767874) | > avg_loss_disc_real_0: 0.34555213153362274 (+0.27446772158145905) | > avg_loss_disc_real_1: 0.22424636532862982 (+0.042364105582237244) | > avg_loss_disc_real_2: 0.2844039301077525 (+0.043705150485038785) | > avg_loss_disc_real_3: 0.2582448224226634 (+0.07840023438135785) | > avg_loss_disc_real_4: 0.2752596599360307 (-0.006322114417950331) | > avg_loss_disc_real_5: 0.20803546408812204 (+0.015826257566610963) | > avg_loss_0: 2.4115505615870156 (+0.21082099278767874) | > avg_loss_gen: 2.9900240898132324 (+0.6812960306803384) | > avg_loss_kl: 2.7377333641052246 (-0.11562414964040135) | > avg_loss_feat: 6.576607863108317 (-1.1777704556783037) | > avg_loss_mel: 25.012905756632488 (-0.8769378662109375) | > avg_loss_duration: 2.5220396518707275 (+0.04688580830891942) | > avg_loss_1: 39.83930969238281 (-1.4421513875325545)  > EPOCH: 287/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:47:41)   --> TIME: 2023-10-20 02:48:00 -- STEP: 29/50 -- GLOBAL_STEP: 67380 | > loss_disc: 2.1199452877044678 (2.3665593369253752) | > loss_disc_real_0: 0.10145694762468338 (0.1593497767723326) | > loss_disc_real_1: 0.3347828686237335 (0.21595760627553381) | > loss_disc_real_2: 0.18565070629119873 (0.21003386789354786) | > loss_disc_real_3: 0.2656465768814087 (0.24219530024405184) | > loss_disc_real_4: 0.34064197540283203 (0.20299204612343474) | > loss_disc_real_5: 0.09871123731136322 (0.24180264507645163) | > loss_0: 2.1199452877044678 (2.3665593369253752) | > grad_norm_0: tensor(220.4074, device='cuda:0') (tensor(500.4197, device='cuda:0')) | > loss_gen: 3.028188705444336 (2.489063530132688) | > loss_kl: 0.9719719886779785 (0.9056092988828133) | > loss_feat: 7.415539264678955 (6.186648176661853) | > loss_mel: 25.006664276123047 (23.428200639527418) | > loss_duration: 1.5375237464904785 (1.6085224932637707) | > loss_1: 37.95988845825195 (34.618044524357245) | > grad_norm_1: tensor(25287.3516, device='cuda:0') (tensor(19701.7148, device='cuda:0')) | > current_lr_0: 0.0001500996531063312 | > current_lr_1: 0.0001500996531063312 | > step_time: 0.2863 (0.4878106610528354) | > loader_time: 0.0247 (0.013897040794635641)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2968690395355225 (2.2968690395355225) | > loss_disc_real_0: 0.1928369402885437 (0.1928369402885437) | > loss_disc_real_1: 0.2677351236343384 (0.2677351236343384) | > loss_disc_real_2: 0.27508771419525146 (0.27508771419525146) | > loss_disc_real_3: 0.3048107922077179 (0.3048107922077179) | > loss_disc_real_4: 0.34240469336509705 (0.34240469336509705) | > loss_disc_real_5: 0.40020254254341125 (0.40020254254341125) | > loss_0: 2.2968690395355225 (2.2968690395355225) | > loss_gen: 3.4600882530212402 (3.4600882530212402) | > loss_kl: 3.1126708984375 (3.1126708984375) | > loss_feat: 5.8636298179626465 (5.8636298179626465) | > loss_mel: 25.387161254882812 (25.387161254882812) | > loss_duration: 2.321882486343384 (2.321882486343384) | > loss_1: 40.14543533325195 (40.14543533325195)  --> STEP: 1 | > loss_disc: 1.9883437156677246 (1.9883437156677246) | > loss_disc_real_0: 0.11856801807880402 (0.11856801807880402) | > loss_disc_real_1: 0.24913354218006134 (0.24913354218006134) | > loss_disc_real_2: 0.12918062508106232 (0.12918062508106232) | > loss_disc_real_3: 0.13229048252105713 (0.13229048252105713) | > loss_disc_real_4: 0.2292414754629135 (0.2292414754629135) | > loss_disc_real_5: 0.1578383892774582 (0.1578383892774582) | > loss_0: 1.9883437156677246 (1.9883437156677246) | > loss_gen: 3.0477123260498047 (3.0477123260498047) | > loss_kl: 3.646117687225342 (3.646117687225342) | > loss_feat: 8.06408977508545 (8.06408977508545) | > loss_mel: 28.6375675201416 (28.6375675201416) | > loss_duration: 2.5646145343780518 (2.5646145343780518) | > loss_1: 45.96009826660156 (45.96009826660156)  --> STEP: 2 | > loss_disc: 2.376675605773926 (2.182509660720825) | > loss_disc_real_0: 0.1339125782251358 (0.1262402981519699) | > loss_disc_real_1: 0.25118908286094666 (0.250161312520504) | > loss_disc_real_2: 0.3054211735725403 (0.2173008993268013) | > loss_disc_real_3: 0.21524807810783386 (0.1737692803144455) | > loss_disc_real_4: 0.23028972744941711 (0.2297656014561653) | > loss_disc_real_5: 0.23383264243602753 (0.19583551585674286) | > loss_0: 2.376675605773926 (2.182509660720825) | > loss_gen: 2.468811273574829 (2.758261799812317) | > loss_kl: 3.4088430404663086 (3.527480363845825) | > loss_feat: 4.717407703399658 (6.390748739242554) | > loss_mel: 25.81259536743164 (27.22508144378662) | > loss_duration: 2.4807872772216797 (2.5227009057998657) | > loss_1: 38.88844299316406 (42.42427062988281)  --> STEP: 3 | > loss_disc: 1.9668885469436646 (2.1106359561284385) | > loss_disc_real_0: 0.13476043939590454 (0.12908034523328146) | > loss_disc_real_1: 0.1988287717103958 (0.23305046558380127) | > loss_disc_real_2: 0.2415582537651062 (0.2253866841395696) | > loss_disc_real_3: 0.2731468081474304 (0.20689512292544046) | > loss_disc_real_4: 0.24752183258533478 (0.23568434516588846) | > loss_disc_real_5: 0.11998959630727768 (0.1705535426735878) | > loss_0: 1.9668885469436646 (2.1106359561284385) | > loss_gen: 3.1560819149017334 (2.8908685048421225) | > loss_kl: 1.9214102029800415 (2.9921236435572305) | > loss_feat: 5.60952615737915 (6.130341211954753) | > loss_mel: 21.99909210205078 (25.48308499654134) | > loss_duration: 2.5208868980407715 (2.5220962365468345) | > loss_1: 35.20699691772461 (40.01851272583008) --> EVAL PERFORMANCE | > avg_loader_time: 0.0023508071899414062 (-0.002363840738932292) | > avg_loss_disc: 2.1106359561284385 (-0.3009146054585772) | > avg_loss_disc_real_0: 0.12908034523328146 (-0.21647178630034128) | > avg_loss_disc_real_1: 0.23305046558380127 (+0.008804100255171449) | > avg_loss_disc_real_2: 0.2253866841395696 (-0.05901724596818289) | > avg_loss_disc_real_3: 0.20689512292544046 (-0.05134969949722293) | > avg_loss_disc_real_4: 0.23568434516588846 (-0.03957531477014223) | > avg_loss_disc_real_5: 0.1705535426735878 (-0.03748192141453424) | > avg_loss_0: 2.1106359561284385 (-0.3009146054585772) | > avg_loss_gen: 2.8908685048421225 (-0.09915558497110988) | > avg_loss_kl: 2.9921236435572305 (+0.2543902794520059) | > avg_loss_feat: 6.130341211954753 (-0.44626665115356445) | > avg_loss_mel: 25.48308499654134 (+0.4701792399088518) | > avg_loss_duration: 2.5220962365468345 (+5.658467610691886e-05) | > avg_loss_1: 40.01851272583008 (+0.17920303344726562)  > EPOCH: 288/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:48:21)   --> TIME: 2023-10-20 02:48:30 -- STEP: 9/50 -- GLOBAL_STEP: 67410 | > loss_disc: 2.917741298675537 (2.4467154608832464) | > loss_disc_real_0: 0.17023983597755432 (0.14011684991419315) | > loss_disc_real_1: 0.20558054745197296 (0.22129038472970328) | > loss_disc_real_2: 0.23813609778881073 (0.21727941268020207) | > loss_disc_real_3: 0.2541595995426178 (0.23539811828070217) | > loss_disc_real_4: 0.27975034713745117 (0.27400124445557594) | > loss_disc_real_5: 0.22764870524406433 (0.177667415752593) | > loss_0: 2.917741298675537 (2.4467154608832464) | > grad_norm_0: tensor(656.3503, device='cuda:0') (tensor(702.7245, device='cuda:0')) | > loss_gen: 1.5665490627288818 (2.3833097219467163) | > loss_kl: 0.5390989780426025 (1.1311763458781772) | > loss_feat: 0.3207787573337555 (6.716646449433432) | > loss_mel: 3.1164329051971436 (24.430305772357517) | > loss_duration: 1.522304892539978 (1.6126128037770588) | > loss_1: 7.065165042877197 (36.27405150731405) | > grad_norm_1: tensor(8366.0293, device='cuda:0') (tensor(31624.5625, device='cuda:0')) | > current_lr_0: 0.00014994961910540848 | > current_lr_1: 0.00014994961910540848 | > step_time: 0.326 (0.523681746588813) | > loader_time: 0.0253 (0.0189463562435574)  --> TIME: 2023-10-20 02:48:41 -- STEP: 39/50 -- GLOBAL_STEP: 67440 | > loss_disc: 2.9973416328430176 (2.472316155066857) | > loss_disc_real_0: 0.3709123730659485 (0.17650114157452032) | > loss_disc_real_1: 0.2553427517414093 (0.2075313749985817) | > loss_disc_real_2: 0.296413391828537 (0.2342017305871615) | > loss_disc_real_3: 0.2889738082885742 (0.23778660585864997) | > loss_disc_real_4: 0.2546805441379547 (0.2289803775552756) | > loss_disc_real_5: 0.25520989298820496 (0.20465918247086498) | > loss_0: 2.9973416328430176 (2.472316155066857) | > grad_norm_0: tensor(571.2156, device='cuda:0') (tensor(637.7288, device='cuda:0')) | > loss_gen: 1.7471238374710083 (2.316427912467565) | > loss_kl: 0.5944803357124329 (0.952894125193453) | > loss_feat: 0.14202535152435303 (5.273222730518916) | > loss_mel: 2.291506290435791 (22.3646601102291) | > loss_duration: 1.5996582508087158 (1.5905514924954143) | > loss_1: 6.374794006347656 (32.49775650562383) | > grad_norm_1: tensor(15576.9473, device='cuda:0') (tensor(21317.8105, device='cuda:0')) | > current_lr_0: 0.00014994961910540848 | > current_lr_1: 0.00014994961910540848 | > step_time: 0.7157 (0.40829747762435525) | > loader_time: 0.022 (0.010063574864314152)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8092081546783447 (2.8092081546783447) | > loss_disc_real_0: 0.27750182151794434 (0.27750182151794434) | > loss_disc_real_1: 0.21779532730579376 (0.21779532730579376) | > loss_disc_real_2: 0.2035422921180725 (0.2035422921180725) | > loss_disc_real_3: 0.19719640910625458 (0.19719640910625458) | > loss_disc_real_4: 0.18775810301303864 (0.18775810301303864) | > loss_disc_real_5: 0.21332691609859467 (0.21332691609859467) | > loss_0: 2.8092081546783447 (2.8092081546783447) | > loss_gen: 1.5752233266830444 (1.5752233266830444) | > loss_kl: 2.6709043979644775 (2.6709043979644775) | > loss_feat: 0.7564498782157898 (0.7564498782157898) | > loss_mel: 13.77346420288086 (13.77346420288086) | > loss_duration: 2.454850673675537 (2.454850673675537) | > loss_1: 21.230894088745117 (21.230894088745117)  --> STEP: 1 | > loss_disc: 2.6352105140686035 (2.6352105140686035) | > loss_disc_real_0: 0.3101908564567566 (0.3101908564567566) | > loss_disc_real_1: 0.21565091609954834 (0.21565091609954834) | > loss_disc_real_2: 0.2772330343723297 (0.2772330343723297) | > loss_disc_real_3: 0.22233733534812927 (0.22233733534812927) | > loss_disc_real_4: 0.18008437752723694 (0.18008437752723694) | > loss_disc_real_5: 0.2618381977081299 (0.2618381977081299) | > loss_0: 2.6352105140686035 (2.6352105140686035) | > loss_gen: 2.1678473949432373 (2.1678473949432373) | > loss_kl: 3.850212335586548 (3.850212335586548) | > loss_feat: 6.855255603790283 (6.855255603790283) | > loss_mel: 25.54346466064453 (25.54346466064453) | > loss_duration: 2.713160753250122 (2.713160753250122) | > loss_1: 41.129940032958984 (41.129940032958984)  --> STEP: 2 | > loss_disc: 2.935168504714966 (2.7851895093917847) | > loss_disc_real_0: 0.3519600033760071 (0.33107542991638184) | > loss_disc_real_1: 0.2768711447715759 (0.24626103043556213) | > loss_disc_real_2: 0.30037835240364075 (0.28880569338798523) | > loss_disc_real_3: 0.2665482759475708 (0.24444280564785004) | > loss_disc_real_4: 0.23516546189785004 (0.2076249197125435) | > loss_disc_real_5: 0.32862886786460876 (0.2952335327863693) | > loss_0: 2.935168504714966 (2.7851895093917847) | > loss_gen: 2.025540828704834 (2.0966941118240356) | > loss_kl: 3.3451154232025146 (3.5976638793945312) | > loss_feat: 1.2492315769195557 (4.052243590354919) | > loss_mel: 22.18795394897461 (23.86570930480957) | > loss_duration: 2.5987446308135986 (2.6559526920318604) | > loss_1: 31.406587600708008 (36.268263816833496)  --> STEP: 3 | > loss_disc: 2.730781316757202 (2.7670534451802573) | > loss_disc_real_0: 0.19498902559280396 (0.2857132951418559) | > loss_disc_real_1: 0.28672489523887634 (0.2597489853700002) | > loss_disc_real_2: 0.2815501093864441 (0.2863871653874715) | > loss_disc_real_3: 0.2936777174472809 (0.26085444291432697) | > loss_disc_real_4: 0.2892278730869293 (0.2348259041706721) | > loss_disc_real_5: 0.32196611166000366 (0.3041443924109141) | > loss_0: 2.730781316757202 (2.7670534451802573) | > loss_gen: 2.272425413131714 (2.1552712122599282) | > loss_kl: 1.939881443977356 (3.0450697342554727) | > loss_feat: 2.651205062866211 (3.585230747858683) | > loss_mel: 23.140087127685547 (23.62383524576823) | > loss_duration: 2.474607467651367 (2.5955042839050293) | > loss_1: 32.478206634521484 (35.00491142272949) --> EVAL PERFORMANCE | > avg_loader_time: 0.006430784861246745 (+0.004079977671305339) | > avg_loss_disc: 2.7670534451802573 (+0.6564174890518188) | > avg_loss_disc_real_0: 0.2857132951418559 (+0.15663294990857443) | > avg_loss_disc_real_1: 0.2597489853700002 (+0.026698519786198915) | > avg_loss_disc_real_2: 0.2863871653874715 (+0.06100048124790189) | > avg_loss_disc_real_3: 0.26085444291432697 (+0.053959319988886506) | > avg_loss_disc_real_4: 0.2348259041706721 (-0.0008584409952163696) | > avg_loss_disc_real_5: 0.3041443924109141 (+0.13359084973732632) | > avg_loss_0: 2.7670534451802573 (+0.6564174890518188) | > avg_loss_gen: 2.1552712122599282 (-0.7355972925821943) | > avg_loss_kl: 3.0450697342554727 (+0.05294609069824219) | > avg_loss_feat: 3.585230747858683 (-2.54511046409607) | > avg_loss_mel: 23.62383524576823 (-1.8592497507731096) | > avg_loss_duration: 2.5955042839050293 (+0.07340804735819484) | > avg_loss_1: 35.00491142272949 (-5.013601303100586)  > EPOCH: 289/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:48:58)   --> TIME: 2023-10-20 02:49:13 -- STEP: 19/50 -- GLOBAL_STEP: 67470 | > loss_disc: 1.9298231601715088 (2.4323551654815674) | > loss_disc_real_0: 0.07540369033813477 (0.15328651627427653) | > loss_disc_real_1: 0.21306848526000977 (0.22383436717485128) | > loss_disc_real_2: 0.2817806601524353 (0.23064931913426048) | > loss_disc_real_3: 0.31261947751045227 (0.251383951031848) | > loss_disc_real_4: 0.16679038107395172 (0.23573932463401243) | > loss_disc_real_5: 0.12894508242607117 (0.23977314891587748) | > loss_0: 1.9298231601715088 (2.4323551654815674) | > grad_norm_0: tensor(763.4468, device='cuda:0') (tensor(576.6621, device='cuda:0')) | > loss_gen: 2.8353846073150635 (2.342479235247562) | > loss_kl: 0.8100224733352661 (0.8756926938107139) | > loss_feat: 6.717616081237793 (4.951665948880346) | > loss_mel: 24.96665382385254 (21.90308992486251) | > loss_duration: 1.729985237121582 (1.6302218562678288) | > loss_1: 37.059661865234375 (31.703149594758685) | > grad_norm_1: tensor(24013.1543, device='cuda:0') (tensor(26422.1699, device='cuda:0')) | > current_lr_0: 0.0001497997350728632 | > current_lr_1: 0.0001497997350728632 | > step_time: 0.2959 (0.5394466801693564) | > loader_time: 0.0245 (0.01725459098815918)  --> TIME: 2023-10-20 02:49:29 -- STEP: 49/50 -- GLOBAL_STEP: 67500 | > loss_disc: 2.0243539810180664 (2.544496156731431) | > loss_disc_real_0: 0.16026246547698975 (0.20252737889484485) | > loss_disc_real_1: 0.19185814261436462 (0.22608492154704066) | > loss_disc_real_2: 0.16190828382968903 (0.2213055132603159) | > loss_disc_real_3: 0.19447265565395355 (0.24918721517433925) | > loss_disc_real_4: 0.14847180247306824 (0.26075498189549057) | > loss_disc_real_5: 0.22661922872066498 (0.28355308004407853) | > loss_0: 2.0243539810180664 (2.544496156731431) | > grad_norm_0: tensor(823.7014, device='cuda:0') (tensor(581.3001, device='cuda:0')) | > loss_gen: 2.649810791015625 (2.409114363242169) | > loss_kl: 0.545110821723938 (0.88186065335663) | > loss_feat: 5.494891166687012 (5.397648103991331) | > loss_mel: 26.5482234954834 (23.432499068123953) | > loss_duration: 1.7325356006622314 (1.5932938176758435) | > loss_1: 36.97057342529297 (33.71441619250241) | > grad_norm_1: tensor(8727.2295, device='cuda:0') (tensor(18925.3691, device='cuda:0')) | > current_lr_0: 0.0001497997350728632 | > current_lr_1: 0.0001497997350728632 | > step_time: 0.5434 (0.516187400233989) | > loader_time: 0.432 (0.02585106966446857)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8324737548828125 (2.8324737548828125) | > loss_disc_real_0: 0.34984245896339417 (0.34984245896339417) | > loss_disc_real_1: 0.3144730031490326 (0.3144730031490326) | > loss_disc_real_2: 0.25376278162002563 (0.25376278162002563) | > loss_disc_real_3: 0.30647972226142883 (0.30647972226142883) | > loss_disc_real_4: 0.23838120698928833 (0.23838120698928833) | > loss_disc_real_5: 0.3462393879890442 (0.3462393879890442) | > loss_0: 2.8324737548828125 (2.8324737548828125) | > loss_gen: 2.206533432006836 (2.206533432006836) | > loss_kl: 3.1556856632232666 (3.1556856632232666) | > loss_feat: 2.2241666316986084 (2.2241666316986084) | > loss_mel: 21.87484359741211 (21.87484359741211) | > loss_duration: 2.3596577644348145 (2.3596577644348145) | > loss_1: 31.820886611938477 (31.820886611938477)  --> STEP: 1 | > loss_disc: 2.5263638496398926 (2.5263638496398926) | > loss_disc_real_0: 0.1631118506193161 (0.1631118506193161) | > loss_disc_real_1: 0.28314071893692017 (0.28314071893692017) | > loss_disc_real_2: 0.29186469316482544 (0.29186469316482544) | > loss_disc_real_3: 0.24491538107395172 (0.24491538107395172) | > loss_disc_real_4: 0.27905717492103577 (0.27905717492103577) | > loss_disc_real_5: 0.18941999971866608 (0.18941999971866608) | > loss_0: 2.5263638496398926 (2.5263638496398926) | > loss_gen: 2.167208433151245 (2.167208433151245) | > loss_kl: 4.044790744781494 (4.044790744781494) | > loss_feat: 2.8442440032958984 (2.8442440032958984) | > loss_mel: 22.79591941833496 (22.79591941833496) | > loss_duration: 2.635349988937378 (2.635349988937378) | > loss_1: 34.487510681152344 (34.487510681152344)  --> STEP: 2 | > loss_disc: 2.9681663513183594 (2.747265100479126) | > loss_disc_real_0: 0.30393239855766296 (0.23352212458848953) | > loss_disc_real_1: 0.24184949696063995 (0.26249510794878006) | > loss_disc_real_2: 0.25468379259109497 (0.2732742428779602) | > loss_disc_real_3: 0.24193404614925385 (0.24342471361160278) | > loss_disc_real_4: 0.2478109747171402 (0.263434074819088) | > loss_disc_real_5: 0.21859140694141388 (0.20400570333003998) | > loss_0: 2.9681663513183594 (2.747265100479126) | > loss_gen: 1.5713070631027222 (1.8692577481269836) | > loss_kl: 3.5762617588043213 (3.8105262517929077) | > loss_feat: 0.23893514275550842 (1.5415895730257034) | > loss_mel: 2.389636278152466 (12.592777848243713) | > loss_duration: 2.520324230194092 (2.577837109565735) | > loss_1: 10.296464920043945 (22.391987800598145)  --> STEP: 3 | > loss_disc: 3.2594985961914062 (2.918009599049886) | > loss_disc_real_0: 0.5694026350975037 (0.3454822947581609) | > loss_disc_real_1: 0.34619781374931335 (0.29039600988229114) | > loss_disc_real_2: 0.3561605215072632 (0.3009030024210612) | > loss_disc_real_3: 0.26248660683631897 (0.24977867801984152) | > loss_disc_real_4: 0.3343663513660431 (0.28707816700140637) | > loss_disc_real_5: 0.2836628556251526 (0.23055808742841086) | > loss_0: 3.2594985961914062 (2.918009599049886) | > loss_gen: 2.1128227710723877 (1.950446089108785) | > loss_kl: 1.9251388311386108 (3.1820637782414756) | > loss_feat: 2.376751184463501 (1.8199767768383026) | > loss_mel: 20.440797805786133 (15.208784500757853) | > loss_duration: 2.603330612182617 (2.5863349437713623) | > loss_1: 29.45884132385254 (24.74760564168294) --> EVAL PERFORMANCE | > avg_loader_time: 0.010009527206420898 (+0.0035787423451741534) | > avg_loss_disc: 2.918009599049886 (+0.1509561538696289) | > avg_loss_disc_real_0: 0.3454822947581609 (+0.059768999616304996) | > avg_loss_disc_real_1: 0.29039600988229114 (+0.030647024512290955) | > avg_loss_disc_real_2: 0.3009030024210612 (+0.014515837033589718) | > avg_loss_disc_real_3: 0.24977867801984152 (-0.011075764894485446) | > avg_loss_disc_real_4: 0.28707816700140637 (+0.05225226283073428) | > avg_loss_disc_real_5: 0.23055808742841086 (-0.07358630498250326) | > avg_loss_0: 2.918009599049886 (+0.1509561538696289) | > avg_loss_gen: 1.950446089108785 (-0.20482512315114332) | > avg_loss_kl: 3.1820637782414756 (+0.1369940439860029) | > avg_loss_feat: 1.8199767768383026 (-1.7652539710203805) | > avg_loss_mel: 15.208784500757853 (-8.415050745010378) | > avg_loss_duration: 2.5863349437713623 (-0.009169340133666992) | > avg_loss_1: 24.74760564168294 (-10.25730578104655)  > EPOCH: 290/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:49:40)   --> TIME: 2023-10-20 02:49:58 -- STEP: 29/50 -- GLOBAL_STEP: 67530 | > loss_disc: 3.1031548976898193 (2.33249818456584) | > loss_disc_real_0: 0.20189906656742096 (0.16332134598031126) | > loss_disc_real_1: 0.2519746422767639 (0.21808005920771895) | > loss_disc_real_2: 0.22369958460330963 (0.2050599879103488) | > loss_disc_real_3: 0.3369947373867035 (0.2361879671185181) | > loss_disc_real_4: 0.2919338643550873 (0.2111594633456191) | > loss_disc_real_5: 0.42911699414253235 (0.19425720814615488) | > loss_0: 3.1031548976898193 (2.33249818456584) | > grad_norm_0: tensor(383.5383, device='cuda:0') (tensor(582.1546, device='cuda:0')) | > loss_gen: 1.9872429370880127 (2.4737253271300217) | > loss_kl: 0.773571252822876 (1.021154550642803) | > loss_feat: 3.2168126106262207 (5.8798160134204505) | > loss_mel: 21.75198745727539 (21.03655888705418) | > loss_duration: 1.5483582019805908 (1.606853254910173) | > loss_1: 29.277973175048828 (32.01810851590387) | > grad_norm_1: tensor(9514.5918, device='cuda:0') (tensor(23923.2500, device='cuda:0')) | > current_lr_0: 0.0001496500008587926 | > current_lr_1: 0.0001496500008587926 | > step_time: 0.3331 (0.45840926828055545) | > loader_time: 0.0022 (0.009199643957203832)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0253820419311523 (3.0253820419311523) | > loss_disc_real_0: 0.1499728560447693 (0.1499728560447693) | > loss_disc_real_1: 0.2818804085254669 (0.2818804085254669) | > loss_disc_real_2: 0.2959069609642029 (0.2959069609642029) | > loss_disc_real_3: 0.2834964990615845 (0.2834964990615845) | > loss_disc_real_4: 0.24436679482460022 (0.24436679482460022) | > loss_disc_real_5: 0.36840006709098816 (0.36840006709098816) | > loss_0: 3.0253820419311523 (3.0253820419311523) | > loss_gen: 1.656854271888733 (1.656854271888733) | > loss_kl: 3.587764263153076 (3.587764263153076) | > loss_feat: 0.0907108336687088 (0.0907108336687088) | > loss_mel: 8.274739265441895 (8.274739265441895) | > loss_duration: 2.381779670715332 (2.381779670715332) | > loss_1: 15.991848945617676 (15.991848945617676)  --> STEP: 1 | > loss_disc: 2.8931236267089844 (2.8931236267089844) | > loss_disc_real_0: 0.14645229279994965 (0.14645229279994965) | > loss_disc_real_1: 0.30731767416000366 (0.30731767416000366) | > loss_disc_real_2: 0.29219067096710205 (0.29219067096710205) | > loss_disc_real_3: 0.297929584980011 (0.297929584980011) | > loss_disc_real_4: 0.24812056124210358 (0.24812056124210358) | > loss_disc_real_5: 0.35643908381462097 (0.35643908381462097) | > loss_0: 2.8931236267089844 (2.8931236267089844) | > loss_gen: 1.8454519510269165 (1.8454519510269165) | > loss_kl: 3.7535898685455322 (3.7535898685455322) | > loss_feat: 0.8746404647827148 (0.8746404647827148) | > loss_mel: 18.824729919433594 (18.824729919433594) | > loss_duration: 2.526998281478882 (2.526998281478882) | > loss_1: 27.825410842895508 (27.825410842895508)  --> STEP: 2 | > loss_disc: 2.8461201190948486 (2.8696218729019165) | > loss_disc_real_0: 0.0880189761519432 (0.11723563447594643) | > loss_disc_real_1: 0.2694357931613922 (0.28837673366069794) | > loss_disc_real_2: 0.3176172375679016 (0.30490395426750183) | > loss_disc_real_3: 0.3111345171928406 (0.3045320510864258) | > loss_disc_real_4: 0.2316315919160843 (0.23987607657909393) | > loss_disc_real_5: 0.3787933886051178 (0.3676162362098694) | > loss_0: 2.8461201190948486 (2.8696218729019165) | > loss_gen: 1.8714507818222046 (1.8584513664245605) | > loss_kl: 3.3475964069366455 (3.550593137741089) | > loss_feat: 1.1931309700012207 (1.0338857173919678) | > loss_mel: 21.492433547973633 (20.158581733703613) | > loss_duration: 2.5209929943084717 (2.5239956378936768) | > loss_1: 30.42560386657715 (29.125507354736328)  --> STEP: 3 | > loss_disc: 3.0358736515045166 (2.9250391324361167) | > loss_disc_real_0: 0.1521497368812561 (0.12887366861104965) | > loss_disc_real_1: 0.2818470597267151 (0.2862001756827037) | > loss_disc_real_2: 0.29592910408973694 (0.3019123375415802) | > loss_disc_real_3: 0.28354009985923767 (0.2975347340106964) | > loss_disc_real_4: 0.24440127611160278 (0.24138447642326355) | > loss_disc_real_5: 0.3679219186306 (0.3677181303501129) | > loss_0: 3.0358736515045166 (2.9250391324361167) | > loss_gen: 1.6502879858016968 (1.789063572883606) | > loss_kl: 1.8644520044326782 (2.988546093304952) | > loss_feat: 0.06882407516241074 (0.7121985033154488) | > loss_mel: 2.159205675125122 (14.15878971417745) | > loss_duration: 2.4716508388519287 (2.5065473715464273) | > loss_1: 8.214420318603516 (22.155145009358723) --> EVAL PERFORMANCE | > avg_loader_time: 0.007016420364379883 (-0.0029931068420410156) | > avg_loss_disc: 2.9250391324361167 (+0.007029533386230469) | > avg_loss_disc_real_0: 0.12887366861104965 (-0.21660862614711124) | > avg_loss_disc_real_1: 0.2862001756827037 (-0.004195834199587467) | > avg_loss_disc_real_2: 0.3019123375415802 (+0.0010093351205189838) | > avg_loss_disc_real_3: 0.2975347340106964 (+0.04775605599085489) | > avg_loss_disc_real_4: 0.24138447642326355 (-0.04569369057814282) | > avg_loss_disc_real_5: 0.3677181303501129 (+0.13716004292170206) | > avg_loss_0: 2.9250391324361167 (+0.007029533386230469) | > avg_loss_gen: 1.789063572883606 (-0.16138251622517896) | > avg_loss_kl: 2.988546093304952 (-0.19351768493652344) | > avg_loss_feat: 0.7121985033154488 (-1.1077782735228539) | > avg_loss_mel: 14.15878971417745 (-1.0499947865804025) | > avg_loss_duration: 2.5065473715464273 (-0.07978757222493504) | > avg_loss_1: 22.155145009358723 (-2.5924606323242188)  > EPOCH: 291/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:50:18)   --> TIME: 2023-10-20 02:50:27 -- STEP: 9/50 -- GLOBAL_STEP: 67560 | > loss_disc: 2.9612362384796143 (2.493446151415507) | > loss_disc_real_0: 0.10821900516748428 (0.17599209232462776) | > loss_disc_real_1: 0.3134306073188782 (0.2256315184964074) | > loss_disc_real_2: 0.28619396686553955 (0.22964810248878267) | > loss_disc_real_3: 0.26585403084754944 (0.22770734048551983) | > loss_disc_real_4: 0.20508334040641785 (0.17603213981621796) | > loss_disc_real_5: 0.24137240648269653 (0.22074821844903958) | > loss_0: 2.9612362384796143 (2.493446151415507) | > grad_norm_0: tensor(811.9051, device='cuda:0') (tensor(574.3718, device='cuda:0')) | > loss_gen: 1.61844801902771 (2.098758578300476) | > loss_kl: 0.8299674391746521 (1.0294314357969496) | > loss_feat: 1.3423311710357666 (3.9882313509782157) | > loss_mel: 22.628093719482422 (19.9128827518887) | > loss_duration: 1.5447001457214355 (1.605368733406067) | > loss_1: 27.96354103088379 (28.63467290666368) | > grad_norm_1: tensor(4239.8999, device='cuda:0') (tensor(18872.9062, device='cuda:0')) | > current_lr_0: 0.00014950041631344374 | > current_lr_1: 0.00014950041631344374 | > step_time: 0.6275 (0.5242812633514404) | > loader_time: 0.0267 (0.021058320999145508)  --> TIME: 2023-10-20 02:50:38 -- STEP: 39/50 -- GLOBAL_STEP: 67590 | > loss_disc: 1.6832553148269653 (2.4453537555841303) | > loss_disc_real_0: 0.1040254756808281 (0.16362526095830474) | > loss_disc_real_1: 0.2013275921344757 (0.2223665937781334) | > loss_disc_real_2: 0.19856202602386475 (0.23010361481171387) | > loss_disc_real_3: 0.18699170649051666 (0.2226989651337648) | > loss_disc_real_4: 0.12657274305820465 (0.2125800227603087) | > loss_disc_real_5: 0.08011949807405472 (0.2088339417719115) | > loss_0: 1.6832553148269653 (2.4453537555841303) | > grad_norm_0: tensor(301.0304, device='cuda:0') (tensor(610.2521, device='cuda:0')) | > loss_gen: 2.9526760578155518 (2.2115662678694115) | > loss_kl: 0.39789846539497375 (0.899546877695964) | > loss_feat: 5.975949287414551 (4.37229092247211) | > loss_mel: 20.576066970825195 (20.396546602249146) | > loss_duration: 1.638705849647522 (1.5934285720189412) | > loss_1: 31.541297912597656 (29.473379208491398) | > grad_norm_1: tensor(20287.5820, device='cuda:0') (tensor(18942.1934, device='cuda:0')) | > current_lr_0: 0.00014950041631344374 | > current_lr_1: 0.00014950041631344374 | > step_time: 0.2632 (0.39971013558216584) | > loader_time: 0.0024 (0.011394665791438175)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.80600905418396 (2.80600905418396) | > loss_disc_real_0: 0.24730485677719116 (0.24730485677719116) | > loss_disc_real_1: 0.20364883542060852 (0.20364883542060852) | > loss_disc_real_2: 0.3273512125015259 (0.3273512125015259) | > loss_disc_real_3: 0.3140430748462677 (0.3140430748462677) | > loss_disc_real_4: 0.22668853402137756 (0.22668853402137756) | > loss_disc_real_5: 0.33269748091697693 (0.33269748091697693) | > loss_0: 2.80600905418396 (2.80600905418396) | > loss_gen: 2.0392441749572754 (2.0392441749572754) | > loss_kl: 2.966181755065918 (2.966181755065918) | > loss_feat: 2.545388698577881 (2.545388698577881) | > loss_mel: 22.446706771850586 (22.446706771850586) | > loss_duration: 2.4403891563415527 (2.4403891563415527) | > loss_1: 32.43790817260742 (32.43790817260742)  --> STEP: 1 | > loss_disc: 1.7410948276519775 (1.7410948276519775) | > loss_disc_real_0: 0.1023445799946785 (0.1023445799946785) | > loss_disc_real_1: 0.10557390004396439 (0.10557390004396439) | > loss_disc_real_2: 0.17951928079128265 (0.17951928079128265) | > loss_disc_real_3: 0.21648235619068146 (0.21648235619068146) | > loss_disc_real_4: 0.1214805319905281 (0.1214805319905281) | > loss_disc_real_5: 0.16337800025939941 (0.16337800025939941) | > loss_0: 1.7410948276519775 (1.7410948276519775) | > loss_gen: 2.5760626792907715 (2.5760626792907715) | > loss_kl: 3.9977080821990967 (3.9977080821990967) | > loss_feat: 8.115827560424805 (8.115827560424805) | > loss_mel: 26.065319061279297 (26.065319061279297) | > loss_duration: 2.6052842140197754 (2.6052842140197754) | > loss_1: 43.36020278930664 (43.36020278930664)  --> STEP: 2 | > loss_disc: 2.5825490951538086 (2.161821961402893) | > loss_disc_real_0: 0.20774805545806885 (0.15504631772637367) | > loss_disc_real_1: 0.11864688992500305 (0.11211039498448372) | > loss_disc_real_2: 0.20210865139961243 (0.19081396609544754) | > loss_disc_real_3: 0.15910670161247253 (0.187794528901577) | > loss_disc_real_4: 0.14787082374095917 (0.13467567786574364) | > loss_disc_real_5: 0.19037127494812012 (0.17687463760375977) | > loss_0: 2.5825490951538086 (2.161821961402893) | > loss_gen: 1.78641676902771 (2.1812397241592407) | > loss_kl: 3.5681087970733643 (3.7829084396362305) | > loss_feat: 6.674649238586426 (7.395238399505615) | > loss_mel: 23.324718475341797 (24.695018768310547) | > loss_duration: 2.5899462699890137 (2.5976152420043945) | > loss_1: 37.9438362121582 (40.65201950073242)  --> STEP: 3 | > loss_disc: 2.430175542831421 (2.2512731552124023) | > loss_disc_real_0: 0.24749794602394104 (0.18586352715889612) | > loss_disc_real_1: 0.270620733499527 (0.16494717448949814) | > loss_disc_real_2: 0.3657210171222687 (0.24911631643772125) | > loss_disc_real_3: 0.1782378852367401 (0.18460898101329803) | > loss_disc_real_4: 0.32447704672813416 (0.1979428008198738) | > loss_disc_real_5: 0.1938319355249405 (0.18252707024415335) | > loss_0: 2.430175542831421 (2.2512731552124023) | > loss_gen: 2.516422748565674 (2.2929673989613852) | > loss_kl: 1.635746717453003 (3.0671878655751548) | > loss_feat: 4.158088207244873 (6.316188335418701) | > loss_mel: 25.53929901123047 (24.97644551595052) | > loss_duration: 2.523505687713623 (2.572912057240804) | > loss_1: 36.37306213378906 (39.22570037841797) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028122266133626304 (-0.004204193751017252) | > avg_loss_disc: 2.2512731552124023 (-0.6737659772237143) | > avg_loss_disc_real_0: 0.18586352715889612 (+0.05698985854784647) | > avg_loss_disc_real_1: 0.16494717448949814 (-0.12125300119320553) | > avg_loss_disc_real_2: 0.24911631643772125 (-0.05279602110385895) | > avg_loss_disc_real_3: 0.18460898101329803 (-0.11292575299739838) | > avg_loss_disc_real_4: 0.1979428008198738 (-0.04344167560338974) | > avg_loss_disc_real_5: 0.18252707024415335 (-0.18519106010595957) | > avg_loss_0: 2.2512731552124023 (-0.6737659772237143) | > avg_loss_gen: 2.2929673989613852 (+0.5039038260777793) | > avg_loss_kl: 3.0671878655751548 (+0.07864177227020264) | > avg_loss_feat: 6.316188335418701 (+5.603989832103252) | > avg_loss_mel: 24.97644551595052 (+10.81765580177307) | > avg_loss_duration: 2.572912057240804 (+0.06636468569437692) | > avg_loss_1: 39.22570037841797 (+17.070555369059246)  > EPOCH: 292/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:50:57)   --> TIME: 2023-10-20 02:51:12 -- STEP: 19/50 -- GLOBAL_STEP: 67620 | > loss_disc: 2.6195716857910156 (2.440903324829905) | > loss_disc_real_0: 0.3008733093738556 (0.1892359757207726) | > loss_disc_real_1: 0.3037247061729431 (0.23811207672483042) | > loss_disc_real_2: 0.3422947824001312 (0.24419916970165154) | > loss_disc_real_3: 0.2659471929073334 (0.24881633645609805) | > loss_disc_real_4: 0.3472231924533844 (0.22074245318378272) | > loss_disc_real_5: 0.22091275453567505 (0.19024463341032205) | > loss_0: 2.6195716857910156 (2.440903324829905) | > grad_norm_0: tensor(778.2206, device='cuda:0') (tensor(731.5373, device='cuda:0')) | > loss_gen: 2.39388370513916 (2.5373660639712683) | > loss_kl: 1.3300871849060059 (0.9994714620866274) | > loss_feat: 3.053142547607422 (5.820271366913068) | > loss_mel: 24.513343811035156 (22.514912605285645) | > loss_duration: 1.679506540298462 (1.628546118736267) | > loss_1: 32.969966888427734 (33.500567963248805) | > grad_norm_1: tensor(3366.1553, device='cuda:0') (tensor(23291.3320, device='cuda:0')) | > current_lr_0: 0.0001493509812872133 | > current_lr_1: 0.0001493509812872133 | > step_time: 0.3781 (0.4980261074869257) | > loader_time: 0.0019 (0.01831557876185367)  --> TIME: 2023-10-20 02:51:28 -- STEP: 49/50 -- GLOBAL_STEP: 67650 | > loss_disc: 2.691723108291626 (2.375372485238678) | > loss_disc_real_0: 0.5424807071685791 (0.16072569257218622) | > loss_disc_real_1: 0.32141566276550293 (0.22627656435479923) | > loss_disc_real_2: 0.34605157375335693 (0.2243144155232882) | > loss_disc_real_3: 0.3039717972278595 (0.23088223209642633) | > loss_disc_real_4: 0.3225603401660919 (0.2184565343646979) | > loss_disc_real_5: 0.39721226692199707 (0.20746653957520517) | > loss_0: 2.691723108291626 (2.375372485238678) | > grad_norm_0: tensor(1571.0466, device='cuda:0') (tensor(649.9025, device='cuda:0')) | > loss_gen: 4.076992988586426 (2.5485454530132063) | > loss_kl: 0.8166149854660034 (0.9104201474360059) | > loss_feat: 5.547281742095947 (5.842008910921156) | > loss_mel: 27.201934814453125 (23.06301007952009) | > loss_duration: 1.7382197380065918 (1.5878328595842635) | > loss_1: 39.38104248046875 (33.95181732761617) | > grad_norm_1: tensor(27945.0020, device='cuda:0') (tensor(24418.0703, device='cuda:0')) | > current_lr_0: 0.0001493509812872133 | > current_lr_1: 0.0001493509812872133 | > step_time: 0.595 (0.5001986707959857) | > loader_time: 0.424 (0.027698331949662185)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5695626735687256 (2.5695626735687256) | > loss_disc_real_0: 0.21874305605888367 (0.21874305605888367) | > loss_disc_real_1: 0.3927377462387085 (0.3927377462387085) | > loss_disc_real_2: 0.26599088311195374 (0.26599088311195374) | > loss_disc_real_3: 0.3746681809425354 (0.3746681809425354) | > loss_disc_real_4: 0.1962440013885498 (0.1962440013885498) | > loss_disc_real_5: 0.291947603225708 (0.291947603225708) | > loss_0: 2.5695626735687256 (2.5695626735687256) | > loss_gen: 2.8583030700683594 (2.8583030700683594) | > loss_kl: 4.21279764175415 (4.21279764175415) | > loss_feat: 5.971577167510986 (5.971577167510986) | > loss_mel: 23.002689361572266 (23.002689361572266) | > loss_duration: 2.5460991859436035 (2.5460991859436035) | > loss_1: 38.591468811035156 (38.591468811035156)  --> STEP: 1 | > loss_disc: 2.5222811698913574 (2.5222811698913574) | > loss_disc_real_0: 0.07549559324979782 (0.07549559324979782) | > loss_disc_real_1: 0.26146864891052246 (0.26146864891052246) | > loss_disc_real_2: 0.2549653947353363 (0.2549653947353363) | > loss_disc_real_3: 0.28273805975914 (0.28273805975914) | > loss_disc_real_4: 0.2357563078403473 (0.2357563078403473) | > loss_disc_real_5: 0.20447762310504913 (0.20447762310504913) | > loss_0: 2.5222811698913574 (2.5222811698913574) | > loss_gen: 1.9060211181640625 (1.9060211181640625) | > loss_kl: 4.036144256591797 (4.036144256591797) | > loss_feat: 2.1271657943725586 (2.1271657943725586) | > loss_mel: 24.530853271484375 (24.530853271484375) | > loss_duration: 2.6855366230010986 (2.6855366230010986) | > loss_1: 35.28572082519531 (35.28572082519531)  --> STEP: 2 | > loss_disc: 1.68369722366333 (2.1029891967773438) | > loss_disc_real_0: 0.19084778428077698 (0.1331716887652874) | > loss_disc_real_1: 0.33743277192115784 (0.29945071041584015) | > loss_disc_real_2: 0.1869686096906662 (0.22096700221300125) | > loss_disc_real_3: 0.28657644987106323 (0.2846572548151016) | > loss_disc_real_4: 0.13000313937664032 (0.1828797236084938) | > loss_disc_real_5: 0.021262647584080696 (0.11287013534456491) | > loss_0: 1.68369722366333 (2.1029891967773438) | > loss_gen: 4.826109886169434 (3.366065502166748) | > loss_kl: 3.685957908630371 (3.861051082611084) | > loss_feat: 12.110835075378418 (7.119000434875488) | > loss_mel: 35.49306869506836 (30.011960983276367) | > loss_duration: 2.5825388431549072 (2.634037733078003) | > loss_1: 58.69851303100586 (46.992116928100586)  --> STEP: 3 | > loss_disc: 2.634036064147949 (2.2800048192342124) | > loss_disc_real_0: 0.09245463460683823 (0.11959933737913768) | > loss_disc_real_1: 0.26579922437667847 (0.28823354840278625) | > loss_disc_real_2: 0.2804468274116516 (0.24079361061255136) | > loss_disc_real_3: 0.29763251543045044 (0.2889823416868846) | > loss_disc_real_4: 0.26796141266822815 (0.21124028662840524) | > loss_disc_real_5: 0.32749244570732117 (0.18441090546548367) | > loss_0: 2.634036064147949 (2.2800048192342124) | > loss_gen: 1.988879680633545 (2.90700356165568) | > loss_kl: 1.8945057392120361 (3.205535968144735) | > loss_feat: 1.3010495901107788 (5.179683486620585) | > loss_mel: 19.154457092285156 (26.39279301961263) | > loss_duration: 2.4926133155822754 (2.5868962605794272) | > loss_1: 26.831504821777344 (40.27191289265951) --> EVAL PERFORMANCE | > avg_loader_time: 0.006429274876912435 (+0.0036170482635498043) | > avg_loss_disc: 2.2800048192342124 (+0.028731664021810044) | > avg_loss_disc_real_0: 0.11959933737913768 (-0.06626418977975844) | > avg_loss_disc_real_1: 0.28823354840278625 (+0.12328637391328812) | > avg_loss_disc_real_2: 0.24079361061255136 (-0.00832270582516989) | > avg_loss_disc_real_3: 0.2889823416868846 (+0.10437336067358655) | > avg_loss_disc_real_4: 0.21124028662840524 (+0.013297485808531434) | > avg_loss_disc_real_5: 0.18441090546548367 (+0.0018838352213303156) | > avg_loss_0: 2.2800048192342124 (+0.028731664021810044) | > avg_loss_gen: 2.90700356165568 (+0.614036162694295) | > avg_loss_kl: 3.205535968144735 (+0.13834810256958008) | > avg_loss_feat: 5.179683486620585 (-1.1365048487981158) | > avg_loss_mel: 26.39279301961263 (+1.4163475036621094) | > avg_loss_duration: 2.5868962605794272 (+0.013984203338623047) | > avg_loss_1: 40.27191289265951 (+1.0462125142415388)  > EPOCH: 293/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:51:39)   --> TIME: 2023-10-20 02:51:58 -- STEP: 29/50 -- GLOBAL_STEP: 67680 | > loss_disc: 2.6994946002960205 (2.6202253391002785) | > loss_disc_real_0: 0.13286498188972473 (0.17728184022266288) | > loss_disc_real_1: 0.22708895802497864 (0.23509973030665826) | > loss_disc_real_2: 0.1832893043756485 (0.2365383189813844) | > loss_disc_real_3: 0.2614893317222595 (0.24969433402193003) | > loss_disc_real_4: 0.23407822847366333 (0.24515816016957678) | > loss_disc_real_5: 0.2634834945201874 (0.2073877152569335) | > loss_0: 2.6994946002960205 (2.6202253391002785) | > grad_norm_0: tensor(802.3298, device='cuda:0') (tensor(694.0770, device='cuda:0')) | > loss_gen: 1.66055428981781 (2.2179491355501373) | > loss_kl: 0.18949325382709503 (1.0307250911819525) | > loss_feat: 0.9942134618759155 (4.8472827533581135) | > loss_mel: 19.43189239501953 (20.886851532705897) | > loss_duration: 1.5850231647491455 (1.5965516526123573) | > loss_1: 23.861177444458008 (30.579360501519567) | > grad_norm_1: tensor(31608.5312, device='cuda:0') (tensor(21906.2363, device='cuda:0')) | > current_lr_0: 0.0001492016956306476 | > current_lr_1: 0.0001492016956306476 | > step_time: 0.2762 (0.4949599792217387) | > loader_time: 0.0243 (0.014080984839077654)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8907575607299805 (2.8907575607299805) | > loss_disc_real_0: 0.23486873507499695 (0.23486873507499695) | > loss_disc_real_1: 0.2394638955593109 (0.2394638955593109) | > loss_disc_real_2: 0.3090633153915405 (0.3090633153915405) | > loss_disc_real_3: 0.28953415155410767 (0.28953415155410767) | > loss_disc_real_4: 0.3033168613910675 (0.3033168613910675) | > loss_disc_real_5: 0.253969669342041 (0.253969669342041) | > loss_0: 2.8907575607299805 (2.8907575607299805) | > loss_gen: 2.055119514465332 (2.055119514465332) | > loss_kl: 3.151292085647583 (3.151292085647583) | > loss_feat: 4.156891822814941 (4.156891822814941) | > loss_mel: 23.67732810974121 (23.67732810974121) | > loss_duration: 2.400972843170166 (2.400972843170166) | > loss_1: 35.44160461425781 (35.44160461425781)  --> STEP: 1 | > loss_disc: 1.931885004043579 (1.931885004043579) | > loss_disc_real_0: 0.24764402210712433 (0.24764402210712433) | > loss_disc_real_1: 0.18584713339805603 (0.18584713339805603) | > loss_disc_real_2: 0.1813737452030182 (0.1813737452030182) | > loss_disc_real_3: 0.16645121574401855 (0.16645121574401855) | > loss_disc_real_4: 0.08745455741882324 (0.08745455741882324) | > loss_disc_real_5: 0.05802031606435776 (0.05802031606435776) | > loss_0: 1.931885004043579 (1.931885004043579) | > loss_gen: 2.347382068634033 (2.347382068634033) | > loss_kl: 3.212728500366211 (3.212728500366211) | > loss_feat: 8.592132568359375 (8.592132568359375) | > loss_mel: 25.332815170288086 (25.332815170288086) | > loss_duration: 2.4863743782043457 (2.4863743782043457) | > loss_1: 41.971431732177734 (41.971431732177734)  --> STEP: 2 | > loss_disc: 2.995777130126953 (2.463831067085266) | > loss_disc_real_0: 0.18909583985805511 (0.21836993098258972) | > loss_disc_real_1: 0.29330018162727356 (0.2395736575126648) | > loss_disc_real_2: 0.33482420444488525 (0.2580989748239517) | > loss_disc_real_3: 0.23335760831832886 (0.1999044120311737) | > loss_disc_real_4: 0.27423664927482605 (0.18084560334682465) | > loss_disc_real_5: 0.20918874442577362 (0.1336045302450657) | > loss_0: 2.995777130126953 (2.463831067085266) | > loss_gen: 1.5594394207000732 (1.9534107446670532) | > loss_kl: 3.363010883331299 (3.287869691848755) | > loss_feat: 0.16572585701942444 (4.3789292126894) | > loss_mel: 3.1512649059295654 (14.242040038108826) | > loss_duration: 2.6281745433807373 (2.5572744607925415) | > loss_1: 10.867615699768066 (26.4195237159729)  --> STEP: 3 | > loss_disc: 3.137157440185547 (2.6882731914520264) | > loss_disc_real_0: 0.5437269806861877 (0.32682228088378906) | > loss_disc_real_1: 0.23491093516349792 (0.23801941672960916) | > loss_disc_real_2: 0.3174859285354614 (0.27789462606112164) | > loss_disc_real_3: 0.20865130424499512 (0.20282004276911417) | > loss_disc_real_4: 0.3194662928581238 (0.22705249985059103) | > loss_disc_real_5: 0.24741674959659576 (0.17154193669557571) | > loss_0: 3.137157440185547 (2.6882731914520264) | > loss_gen: 1.9716588258743286 (1.9594934384028118) | > loss_kl: 1.9572927951812744 (2.8443440596262612) | > loss_feat: 3.1051316261291504 (3.9543300171693168) | > loss_mel: 23.4586181640625 (17.31423274676005) | > loss_duration: 2.5903966426849365 (2.5683151880900064) | > loss_1: 33.08309555053711 (28.640714327494305) --> EVAL PERFORMANCE | > avg_loader_time: 0.01223595937093099 (+0.0058066844940185556) | > avg_loss_disc: 2.6882731914520264 (+0.408268372217814) | > avg_loss_disc_real_0: 0.32682228088378906 (+0.20722294350465137) | > avg_loss_disc_real_1: 0.23801941672960916 (-0.05021413167317709) | > avg_loss_disc_real_2: 0.27789462606112164 (+0.03710101544857028) | > avg_loss_disc_real_3: 0.20282004276911417 (-0.08616229891777041) | > avg_loss_disc_real_4: 0.22705249985059103 (+0.01581221322218579) | > avg_loss_disc_real_5: 0.17154193669557571 (-0.012868968769907951) | > avg_loss_0: 2.6882731914520264 (+0.408268372217814) | > avg_loss_gen: 1.9594934384028118 (-0.9475101232528684) | > avg_loss_kl: 2.8443440596262612 (-0.3611919085184736) | > avg_loss_feat: 3.9543300171693168 (-1.2253534694512687) | > avg_loss_mel: 17.31423274676005 (-9.078560272852577) | > avg_loss_duration: 2.5683151880900064 (-0.01858107248942087) | > avg_loss_1: 28.640714327494305 (-11.631198565165203)  > EPOCH: 294/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:52:19)   --> TIME: 2023-10-20 02:52:28 -- STEP: 9/50 -- GLOBAL_STEP: 67710 | > loss_disc: 2.5790045261383057 (2.4748050239351063) | > loss_disc_real_0: 0.21221321821212769 (0.15357710452129444) | > loss_disc_real_1: 0.356401652097702 (0.2439753454592493) | > loss_disc_real_2: 0.17653526365756989 (0.23896911243597665) | > loss_disc_real_3: 0.2628304958343506 (0.19956346270110872) | > loss_disc_real_4: 0.1493680328130722 (0.20235129156046444) | > loss_disc_real_5: 0.16579926013946533 (0.1717699704070886) | > loss_0: 2.5790045261383057 (2.4748050239351063) | > grad_norm_0: tensor(895.9112, device='cuda:0') (tensor(519.2538, device='cuda:0')) | > loss_gen: 1.9383909702301025 (2.121105511983236) | > loss_kl: 1.054836392402649 (0.8047678603066338) | > loss_feat: 2.3412415981292725 (5.240393854625937) | > loss_mel: 22.350229263305664 (20.083434224128723) | > loss_duration: 1.5232243537902832 (1.599968049261305) | > loss_1: 29.207921981811523 (29.849668396843803) | > grad_norm_1: tensor(4774.2778, device='cuda:0') (tensor(20343.1328, device='cuda:0')) | > current_lr_0: 0.00014905255919444237 | > current_lr_1: 0.00014905255919444237 | > step_time: 0.3749 (0.47350796063741046) | > loader_time: 0.0019 (0.016310453414916992)  --> TIME: 2023-10-20 02:52:41 -- STEP: 39/50 -- GLOBAL_STEP: 67740 | > loss_disc: 2.8191871643066406 (2.427998429689652) | > loss_disc_real_0: 0.342052698135376 (0.14762002948480538) | > loss_disc_real_1: 0.23536215722560883 (0.23992336159333205) | > loss_disc_real_2: 0.2844942510128021 (0.21505887443438554) | > loss_disc_real_3: 0.24566367268562317 (0.22649209315960223) | > loss_disc_real_4: 0.22874495387077332 (0.21936385171153608) | > loss_disc_real_5: 0.31531164050102234 (0.20235092154680154) | > loss_0: 2.8191871643066406 (2.427998429689652) | > grad_norm_0: tensor(817.7612, device='cuda:0') (tensor(578.1142, device='cuda:0')) | > loss_gen: 2.1833181381225586 (2.3823096813299713) | > loss_kl: 0.6424099802970886 (0.9276194175084432) | > loss_feat: 1.4147746562957764 (5.087480645710363) | > loss_mel: 16.475360870361328 (20.998066147168476) | > loss_duration: 1.6235841512680054 (1.5780466336470385) | > loss_1: 22.339447021484375 (30.973522455264362) | > grad_norm_1: tensor(4331.6992, device='cuda:0') (tensor(19948.9570, device='cuda:0')) | > current_lr_0: 0.00014905255919444237 | > current_lr_1: 0.00014905255919444237 | > step_time: 0.9635 (0.4311381609011919) | > loader_time: 0.022 (0.010727625626784105)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.707399368286133 (2.707399368286133) | > loss_disc_real_0: 0.21784338355064392 (0.21784338355064392) | > loss_disc_real_1: 0.20849469304084778 (0.20849469304084778) | > loss_disc_real_2: 0.30001401901245117 (0.30001401901245117) | > loss_disc_real_3: 0.5587548613548279 (0.5587548613548279) | > loss_disc_real_4: 0.11661751568317413 (0.11661751568317413) | > loss_disc_real_5: 0.33176809549331665 (0.33176809549331665) | > loss_0: 2.707399368286133 (2.707399368286133) | > loss_gen: 3.141550302505493 (3.141550302505493) | > loss_kl: 3.011507511138916 (3.011507511138916) | > loss_feat: 6.248276710510254 (6.248276710510254) | > loss_mel: 23.25376319885254 (23.25376319885254) | > loss_duration: 2.3201611042022705 (2.3201611042022705) | > loss_1: 37.97526168823242 (37.97526168823242)  --> STEP: 1 | > loss_disc: 2.3540027141571045 (2.3540027141571045) | > loss_disc_real_0: 0.3934493660926819 (0.3934493660926819) | > loss_disc_real_1: 0.28549233078956604 (0.28549233078956604) | > loss_disc_real_2: 0.21603363752365112 (0.21603363752365112) | > loss_disc_real_3: 0.2946200966835022 (0.2946200966835022) | > loss_disc_real_4: 0.1004927009344101 (0.1004927009344101) | > loss_disc_real_5: 0.1991506665945053 (0.1991506665945053) | > loss_0: 2.3540027141571045 (2.3540027141571045) | > loss_gen: 3.1110880374908447 (3.1110880374908447) | > loss_kl: 3.489105224609375 (3.489105224609375) | > loss_feat: 6.895791053771973 (6.895791053771973) | > loss_mel: 24.196779251098633 (24.196779251098633) | > loss_duration: 2.5682239532470703 (2.5682239532470703) | > loss_1: 40.260986328125 (40.260986328125)  --> STEP: 2 | > loss_disc: 1.9734739065170288 (2.1637383103370667) | > loss_disc_real_0: 0.20760303735733032 (0.3005262017250061) | > loss_disc_real_1: 0.2585718631744385 (0.27203209698200226) | > loss_disc_real_2: 0.1210072860121727 (0.1685204617679119) | > loss_disc_real_3: 0.43386730551719666 (0.3642437011003494) | > loss_disc_real_4: 0.1580430418252945 (0.1292678713798523) | > loss_disc_real_5: 0.07356370240449905 (0.13635718449950218) | > loss_0: 1.9734739065170288 (2.1637383103370667) | > loss_gen: 3.3349008560180664 (3.2229944467544556) | > loss_kl: 3.7502124309539795 (3.6196588277816772) | > loss_feat: 8.525445938110352 (7.710618495941162) | > loss_mel: 24.296537399291992 (24.246658325195312) | > loss_duration: 2.506680488586426 (2.537452220916748) | > loss_1: 42.41377639770508 (41.33738136291504)  --> STEP: 3 | > loss_disc: 2.2257344722747803 (2.1844036976496377) | > loss_disc_real_0: 0.10659919679164886 (0.23588386674722037) | > loss_disc_real_1: 0.41551440954208374 (0.3198595345020294) | > loss_disc_real_2: 0.19371666014194489 (0.17691919455925623) | > loss_disc_real_3: 0.3428569436073303 (0.3571147819360097) | > loss_disc_real_4: 0.1501798927783966 (0.13623854517936707) | > loss_disc_real_5: 0.05943257734179497 (0.11071564878026645) | > loss_0: 2.2257344722747803 (2.1844036976496377) | > loss_gen: 2.6559033393859863 (3.0339640776316323) | > loss_kl: 1.6130505800247192 (2.9507894118626914) | > loss_feat: 6.106963157653809 (7.176066716512044) | > loss_mel: 22.514698028564453 (23.66933822631836) | > loss_duration: 2.4029722213745117 (2.4926255544026694) | > loss_1: 35.29358673095703 (39.32278315226237) --> EVAL PERFORMANCE | > avg_loader_time: 0.005005041758219401 (-0.007230917612711589) | > avg_loss_disc: 2.1844036976496377 (-0.5038694938023887) | > avg_loss_disc_real_0: 0.23588386674722037 (-0.0909384141365687) | > avg_loss_disc_real_1: 0.3198595345020294 (+0.08184011777242026) | > avg_loss_disc_real_2: 0.17691919455925623 (-0.10097543150186541) | > avg_loss_disc_real_3: 0.3571147819360097 (+0.15429473916689554) | > avg_loss_disc_real_4: 0.13623854517936707 (-0.09081395467122397) | > avg_loss_disc_real_5: 0.11071564878026645 (-0.060826287915309266) | > avg_loss_0: 2.1844036976496377 (-0.5038694938023887) | > avg_loss_gen: 3.0339640776316323 (+1.0744706392288206) | > avg_loss_kl: 2.9507894118626914 (+0.10644535223643015) | > avg_loss_feat: 7.176066716512044 (+3.221736699342727) | > avg_loss_mel: 23.66933822631836 (+6.355105479558308) | > avg_loss_duration: 2.4926255544026694 (-0.07568963368733694) | > avg_loss_1: 39.32278315226237 (+10.682068824768063)  > EPOCH: 295/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:52:56)   --> TIME: 2023-10-20 02:53:10 -- STEP: 19/50 -- GLOBAL_STEP: 67770 | > loss_disc: 2.337494134902954 (2.1951637644516793) | > loss_disc_real_0: 0.05139809846878052 (0.12714358860332714) | > loss_disc_real_1: 0.24941124022006989 (0.22218921113955348) | > loss_disc_real_2: 0.3133695423603058 (0.23726865472762207) | > loss_disc_real_3: 0.29701539874076843 (0.2423080703929851) | > loss_disc_real_4: 0.2058192789554596 (0.1859894271351789) | > loss_disc_real_5: 0.11645229905843735 (0.19354780204594135) | > loss_0: 2.337494134902954 (2.1951637644516793) | > grad_norm_0: tensor(493.9109, device='cuda:0') (tensor(613.7004, device='cuda:0')) | > loss_gen: 2.288393259048462 (2.7867818819849113) | > loss_kl: 0.9760159850120544 (0.8456722294029436) | > loss_feat: 4.050241947174072 (6.931905904882832) | > loss_mel: 23.33648681640625 (23.475842563729536) | > loss_duration: 1.723031759262085 (1.645902903456437) | > loss_1: 32.374168395996094 (35.686105602665954) | > grad_norm_1: tensor(17052.1133, device='cuda:0') (tensor(36992.7969, device='cuda:0')) | > current_lr_0: 0.00014890357182944245 | > current_lr_1: 0.00014890357182944245 | > step_time: 0.6718 (0.5064042869367098) | > loader_time: 0.0227 (0.02039571812278346)  --> TIME: 2023-10-20 02:53:25 -- STEP: 49/50 -- GLOBAL_STEP: 67800 | > loss_disc: 2.4972786903381348 (2.3965732783687357) | > loss_disc_real_0: 0.07732509821653366 (0.1487028418983124) | > loss_disc_real_1: 0.28468695282936096 (0.22451056897336122) | > loss_disc_real_2: 0.21586266160011292 (0.23104341457388838) | > loss_disc_real_3: 0.26710179448127747 (0.23870117217302322) | > loss_disc_real_4: 0.25639787316322327 (0.2061937857343226) | > loss_disc_real_5: 0.2847120761871338 (0.2052951256497478) | > loss_0: 2.4972786903381348 (2.3965732783687357) | > grad_norm_0: tensor(540.6248, device='cuda:0') (tensor(565.5762, device='cuda:0')) | > loss_gen: 2.1425247192382812 (2.394896327232828) | > loss_kl: 0.7472575306892395 (0.8807286501538997) | > loss_feat: 1.9632877111434937 (5.102190523693451) | > loss_mel: 19.292747497558594 (21.269407664026527) | > loss_duration: 1.6964316368103027 (1.599408212973147) | > loss_1: 25.842248916625977 (31.246631612583073) | > grad_norm_1: tensor(5866.8301, device='cuda:0') (tensor(25994.1172, device='cuda:0')) | > current_lr_0: 0.00014890357182944245 | > current_lr_1: 0.00014890357182944245 | > step_time: 0.3294 (0.4894405141168711) | > loader_time: 0.4106 (0.02939850456860601)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2624125480651855 (2.2624125480651855) | > loss_disc_real_0: 0.1798621416091919 (0.1798621416091919) | > loss_disc_real_1: 0.22309176623821259 (0.22309176623821259) | > loss_disc_real_2: 0.2502813935279846 (0.2502813935279846) | > loss_disc_real_3: 0.3378222584724426 (0.3378222584724426) | > loss_disc_real_4: 0.19040147960186005 (0.19040147960186005) | > loss_disc_real_5: 0.1282196044921875 (0.1282196044921875) | > loss_0: 2.2624125480651855 (2.2624125480651855) | > loss_gen: 2.607729434967041 (2.607729434967041) | > loss_kl: 2.779280185699463 (2.779280185699463) | > loss_feat: 6.60825252532959 (6.60825252532959) | > loss_mel: 24.625648498535156 (24.625648498535156) | > loss_duration: 2.3773622512817383 (2.3773622512817383) | > loss_1: 38.99827575683594 (38.99827575683594)  --> STEP: 1 | > loss_disc: 1.8990038633346558 (1.8990038633346558) | > loss_disc_real_0: 0.15484550595283508 (0.15484550595283508) | > loss_disc_real_1: 0.2557491660118103 (0.2557491660118103) | > loss_disc_real_2: 0.20421522855758667 (0.20421522855758667) | > loss_disc_real_3: 0.226634219288826 (0.226634219288826) | > loss_disc_real_4: 0.2073589563369751 (0.2073589563369751) | > loss_disc_real_5: 0.1414680927991867 (0.1414680927991867) | > loss_0: 1.8990038633346558 (1.8990038633346558) | > loss_gen: 2.867483615875244 (2.867483615875244) | > loss_kl: 4.184573173522949 (4.184573173522949) | > loss_feat: 7.418982982635498 (7.418982982635498) | > loss_mel: 26.339696884155273 (26.339696884155273) | > loss_duration: 2.6910784244537354 (2.6910784244537354) | > loss_1: 43.50181579589844 (43.50181579589844)  --> STEP: 2 | > loss_disc: 2.273547649383545 (2.0862757563591003) | > loss_disc_real_0: 0.15718360245227814 (0.1560145542025566) | > loss_disc_real_1: 0.24877919256687164 (0.252264179289341) | > loss_disc_real_2: 0.19658510386943817 (0.20040016621351242) | > loss_disc_real_3: 0.2668679356575012 (0.2467510774731636) | > loss_disc_real_4: 0.18399976193904877 (0.19567935913801193) | > loss_disc_real_5: 0.20841747522354126 (0.17494278401136398) | > loss_0: 2.273547649383545 (2.0862757563591003) | > loss_gen: 2.3712692260742188 (2.6193764209747314) | > loss_kl: 3.2401528358459473 (3.7123630046844482) | > loss_feat: 5.59688138961792 (6.507932186126709) | > loss_mel: 22.6278076171875 (24.483752250671387) | > loss_duration: 2.597566604614258 (2.6443225145339966) | > loss_1: 36.433677673339844 (39.96774673461914)  --> STEP: 3 | > loss_disc: 3.041569471359253 (2.4047069946924844) | > loss_disc_real_0: 0.3763774633407593 (0.22946885724862418) | > loss_disc_real_1: 0.3200942873954773 (0.27487421532471973) | > loss_disc_real_2: 0.2759031653404236 (0.22556783258914948) | > loss_disc_real_3: 0.2839643359184265 (0.2591554969549179) | > loss_disc_real_4: 0.2809537351131439 (0.2241041511297226) | > loss_disc_real_5: 0.25712138414382935 (0.20233565072218576) | > loss_0: 3.041569471359253 (2.4047069946924844) | > loss_gen: 1.7939985990524292 (2.344250480333964) | > loss_kl: 1.6887433528900146 (3.0378231207529702) | > loss_feat: 0.004188220947980881 (4.340017531067133) | > loss_mel: 1.3042689561843872 (16.75725781917572) | > loss_duration: 2.500260829925537 (2.5963019529978433) | > loss_1: 7.291460037231445 (29.075651168823242) --> EVAL PERFORMANCE | > avg_loader_time: 0.0062745412190755205 (+0.0012694994608561192) | > avg_loss_disc: 2.4047069946924844 (+0.22030329704284668) | > avg_loss_disc_real_0: 0.22946885724862418 (-0.006415009498596191) | > avg_loss_disc_real_1: 0.27487421532471973 (-0.04498531917730969) | > avg_loss_disc_real_2: 0.22556783258914948 (+0.04864863802989325) | > avg_loss_disc_real_3: 0.2591554969549179 (-0.0979592849810918) | > avg_loss_disc_real_4: 0.2241041511297226 (+0.08786560595035553) | > avg_loss_disc_real_5: 0.20233565072218576 (+0.09162000194191931) | > avg_loss_0: 2.4047069946924844 (+0.22030329704284668) | > avg_loss_gen: 2.344250480333964 (-0.6897135972976685) | > avg_loss_kl: 3.0378231207529702 (+0.08703370889027884) | > avg_loss_feat: 4.340017531067133 (-2.836049185444911) | > avg_loss_mel: 16.75725781917572 (-6.912080407142639) | > avg_loss_duration: 2.5963019529978433 (+0.10367639859517386) | > avg_loss_1: 29.075651168823242 (-10.247131983439125)  > EPOCH: 296/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:53:37)   --> TIME: 2023-10-20 02:53:55 -- STEP: 29/50 -- GLOBAL_STEP: 67830 | > loss_disc: 2.7206432819366455 (2.512042493655764) | > loss_disc_real_0: 0.11342161893844604 (0.16507837060710479) | > loss_disc_real_1: 0.34857454895973206 (0.23570710471991835) | > loss_disc_real_2: 0.2966274619102478 (0.2107355441769649) | > loss_disc_real_3: 0.41285255551338196 (0.2308207012969872) | > loss_disc_real_4: 0.28011804819107056 (0.21043648660696787) | > loss_disc_real_5: 0.23701924085617065 (0.22260543935257812) | > loss_0: 2.7206432819366455 (2.512042493655764) | > grad_norm_0: tensor(302.2762, device='cuda:0') (tensor(676.3719, device='cuda:0')) | > loss_gen: 2.366271495819092 (2.2803213925197214) | > loss_kl: 0.8268012404441833 (0.9959338060740764) | > loss_feat: 3.995396375656128 (5.08001530003445) | > loss_mel: 23.895692825317383 (20.375591467166768) | > loss_duration: 1.5670772790908813 (1.6106911979872605) | > loss_1: 32.65123748779297 (30.342553007191626) | > grad_norm_1: tensor(4155.3047, device='cuda:0') (tensor(24659.8184, device='cuda:0')) | > current_lr_0: 0.00014875473338664185 | > current_lr_1: 0.00014875473338664185 | > step_time: 0.2905 (0.46143826122941645) | > loader_time: 0.0248 (0.01511064891157479)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9296505451202393 (2.9296505451202393) | > loss_disc_real_0: 0.36071595549583435 (0.36071595549583435) | > loss_disc_real_1: 0.2182149440050125 (0.2182149440050125) | > loss_disc_real_2: 0.22048363089561462 (0.22048363089561462) | > loss_disc_real_3: 0.19543322920799255 (0.19543322920799255) | > loss_disc_real_4: 0.23975104093551636 (0.23975104093551636) | > loss_disc_real_5: 0.23590916395187378 (0.23590916395187378) | > loss_0: 2.9296505451202393 (2.9296505451202393) | > loss_gen: 1.6135830879211426 (1.6135830879211426) | > loss_kl: 3.272900104522705 (3.272900104522705) | > loss_feat: 0.5124133825302124 (0.5124133825302124) | > loss_mel: 8.38945198059082 (8.38945198059082) | > loss_duration: 2.4311978816986084 (2.4311978816986084) | > loss_1: 16.219547271728516 (16.219547271728516)  --> STEP: 1 | > loss_disc: 3.0719780921936035 (3.0719780921936035) | > loss_disc_real_0: 0.3143250644207001 (0.3143250644207001) | > loss_disc_real_1: 0.21816758811473846 (0.21816758811473846) | > loss_disc_real_2: 0.2331831157207489 (0.2331831157207489) | > loss_disc_real_3: 0.21633975207805634 (0.21633975207805634) | > loss_disc_real_4: 0.26014789938926697 (0.26014789938926697) | > loss_disc_real_5: 0.28226855397224426 (0.28226855397224426) | > loss_0: 3.0719780921936035 (3.0719780921936035) | > loss_gen: 1.561608910560608 (1.561608910560608) | > loss_kl: 3.198256254196167 (3.198256254196167) | > loss_feat: 0.9567570686340332 (0.9567570686340332) | > loss_mel: 7.589498043060303 (7.589498043060303) | > loss_duration: 2.6616060733795166 (2.6616060733795166) | > loss_1: 15.96772575378418 (15.96772575378418)  --> STEP: 2 | > loss_disc: 2.046661138534546 (2.5593196153640747) | > loss_disc_real_0: 0.08419927954673767 (0.19926217198371887) | > loss_disc_real_1: 0.17051278054714203 (0.19434018433094025) | > loss_disc_real_2: 0.16158778965473175 (0.19738545268774033) | > loss_disc_real_3: 0.2615163326263428 (0.23892804235219955) | > loss_disc_real_4: 0.13032041490077972 (0.19523415714502335) | > loss_disc_real_5: 0.1557491272687912 (0.21900884062051773) | > loss_0: 2.046661138534546 (2.5593196153640747) | > loss_gen: 2.4607791900634766 (2.0111940503120422) | > loss_kl: 3.173673629760742 (3.1859649419784546) | > loss_feat: 8.175225257873535 (4.565991163253784) | > loss_mel: 28.140764236450195 (17.86513113975525) | > loss_duration: 2.5922672748565674 (2.626936674118042) | > loss_1: 44.54270553588867 (30.255215644836426)  --> STEP: 3 | > loss_disc: 1.8020771741867065 (2.306905468304952) | > loss_disc_real_0: 0.10165221244096756 (0.16672551880280176) | > loss_disc_real_1: 0.19926418364048004 (0.19598151743412018) | > loss_disc_real_2: 0.2689606249332428 (0.22124384343624115) | > loss_disc_real_3: 0.20245598256587982 (0.226770689090093) | > loss_disc_real_4: 0.1786489635705948 (0.1897057592868805) | > loss_disc_real_5: 0.17415888607501984 (0.20405885577201843) | > loss_0: 1.8020771741867065 (2.306905468304952) | > loss_gen: 2.9685230255126953 (2.33030370871226) | > loss_kl: 1.613677740097046 (2.661869208017985) | > loss_feat: 6.544890880584717 (5.225624402364095) | > loss_mel: 23.555015563964844 (19.761759281158447) | > loss_duration: 2.425046920776367 (2.559640089670817) | > loss_1: 37.107154846191406 (32.53919537862142) --> EVAL PERFORMANCE | > avg_loader_time: 0.008140881856282553 (+0.0018663406372070321) | > avg_loss_disc: 2.306905468304952 (-0.09780152638753226) | > avg_loss_disc_real_0: 0.16672551880280176 (-0.06274333844582242) | > avg_loss_disc_real_1: 0.19598151743412018 (-0.07889269789059955) | > avg_loss_disc_real_2: 0.22124384343624115 (-0.004323989152908325) | > avg_loss_disc_real_3: 0.226770689090093 (-0.03238480786482492) | > avg_loss_disc_real_4: 0.1897057592868805 (-0.0343983918428421) | > avg_loss_disc_real_5: 0.20405885577201843 (+0.0017232050498326712) | > avg_loss_0: 2.306905468304952 (-0.09780152638753226) | > avg_loss_gen: 2.33030370871226 (-0.013946771621704102) | > avg_loss_kl: 2.661869208017985 (-0.37595391273498535) | > avg_loss_feat: 5.225624402364095 (+0.8856068712969618) | > avg_loss_mel: 19.761759281158447 (+3.004501461982727) | > avg_loss_duration: 2.559640089670817 (-0.03666186332702637) | > avg_loss_1: 32.53919537862142 (+3.4635442097981795)  > EPOCH: 297/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:54:15)   --> TIME: 2023-10-20 02:54:25 -- STEP: 9/50 -- GLOBAL_STEP: 67860 | > loss_disc: 3.0982682704925537 (2.4880272679858737) | > loss_disc_real_0: 0.1464357078075409 (0.16353192201091182) | > loss_disc_real_1: 0.3384404480457306 (0.2046837049225966) | > loss_disc_real_2: 0.3330959379673004 (0.19244569540023804) | > loss_disc_real_3: 0.2509985566139221 (0.1951574683189392) | > loss_disc_real_4: 0.1735209971666336 (0.18664020051558813) | > loss_disc_real_5: 0.22844545543193817 (0.18977344118886524) | > loss_0: 3.0982682704925537 (2.4880272679858737) | > grad_norm_0: tensor(303.6701, device='cuda:0') (tensor(667.3896, device='cuda:0')) | > loss_gen: 1.6954946517944336 (2.101318213674757) | > loss_kl: 0.6799620985984802 (0.9836478034655253) | > loss_feat: 2.991736650466919 (5.227215144369337) | > loss_mel: 15.960538864135742 (20.382726510365803) | > loss_duration: 1.5137053728103638 (1.6376483970218234) | > loss_1: 22.84143829345703 (30.332556353674995) | > grad_norm_1: tensor(5130.2207, device='cuda:0') (tensor(21852.3359, device='cuda:0')) | > current_lr_0: 0.00014860604371718354 | > current_lr_1: 0.00014860604371718354 | > step_time: 0.5563 (0.5492285887400309) | > loader_time: 0.0247 (0.016559044520060223)  --> TIME: 2023-10-20 02:54:38 -- STEP: 39/50 -- GLOBAL_STEP: 67890 | > loss_disc: 1.6192539930343628 (2.4148122500150633) | > loss_disc_real_0: 0.0420369878411293 (0.14730836608662054) | > loss_disc_real_1: 0.1907150149345398 (0.22855556063736096) | > loss_disc_real_2: 0.13313883543014526 (0.21198452646151567) | > loss_disc_real_3: 0.1308402568101883 (0.22747888807684946) | > loss_disc_real_4: 0.05996498093008995 (0.21368832112504885) | > loss_disc_real_5: 0.030549993738532066 (0.2055260140257768) | > loss_0: 1.6192539930343628 (2.4148122500150633) | > grad_norm_0: tensor(1091.5798, device='cuda:0') (tensor(688.7005, device='cuda:0')) | > loss_gen: 2.7926993370056152 (2.3608931150191874) | > loss_kl: 0.730471670627594 (1.0182833488170917) | > loss_feat: 8.70388412475586 (5.546316077693916) | > loss_mel: 28.636280059814453 (21.94646256397932) | > loss_duration: 1.5816508531570435 (1.592925808368585) | > loss_1: 42.444984436035156 (32.46488094329835) | > grad_norm_1: tensor(29312.4961, device='cuda:0') (tensor(19862.5039, device='cuda:0')) | > current_lr_0: 0.00014860604371718354 | > current_lr_1: 0.00014860604371718354 | > step_time: 0.6933 (0.4492739286178198) | > loader_time: 0.022 (0.010895564005925106)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.985665202140808 (1.985665202140808) | > loss_disc_real_0: 0.22891420125961304 (0.22891420125961304) | > loss_disc_real_1: 0.14768704771995544 (0.14768704771995544) | > loss_disc_real_2: 0.08746113628149033 (0.08746113628149033) | > loss_disc_real_3: 0.2286001741886139 (0.2286001741886139) | > loss_disc_real_4: 0.03897653520107269 (0.03897653520107269) | > loss_disc_real_5: 0.01783684268593788 (0.01783684268593788) | > loss_0: 1.985665202140808 (1.985665202140808) | > loss_gen: 2.194068670272827 (2.194068670272827) | > loss_kl: 2.5960774421691895 (2.5960774421691895) | > loss_feat: 12.001931190490723 (12.001931190490723) | > loss_mel: 26.838455200195312 (26.838455200195312) | > loss_duration: 2.3515729904174805 (2.3515729904174805) | > loss_1: 45.98210525512695 (45.98210525512695)  --> STEP: 1 | > loss_disc: 2.7544445991516113 (2.7544445991516113) | > loss_disc_real_0: 0.15379993617534637 (0.15379993617534637) | > loss_disc_real_1: 0.22880420088768005 (0.22880420088768005) | > loss_disc_real_2: 0.2693575322628021 (0.2693575322628021) | > loss_disc_real_3: 0.23686589300632477 (0.23686589300632477) | > loss_disc_real_4: 0.3215191066265106 (0.3215191066265106) | > loss_disc_real_5: 0.23424047231674194 (0.23424047231674194) | > loss_0: 2.7544445991516113 (2.7544445991516113) | > loss_gen: 1.7290565967559814 (1.7290565967559814) | > loss_kl: 3.0159459114074707 (3.0159459114074707) | > loss_feat: 0.7854487299919128 (0.7854487299919128) | > loss_mel: 23.184024810791016 (23.184024810791016) | > loss_duration: 2.624253511428833 (2.624253511428833) | > loss_1: 31.33873176574707 (31.33873176574707)  --> STEP: 2 | > loss_disc: 3.0410077571868896 (2.8977261781692505) | > loss_disc_real_0: 0.17929646372795105 (0.1665481999516487) | > loss_disc_real_1: 0.24190284311771393 (0.235353522002697) | > loss_disc_real_2: 0.15027333796024323 (0.20981543511152267) | > loss_disc_real_3: 0.1223650574684143 (0.17961547523736954) | > loss_disc_real_4: 0.4252963364124298 (0.3734077215194702) | > loss_disc_real_5: 0.48818281292915344 (0.3612116426229477) | > loss_0: 3.0410077571868896 (2.8977261781692505) | > loss_gen: 2.7536771297454834 (2.2413668632507324) | > loss_kl: 3.36376690864563 (3.1898564100265503) | > loss_feat: 15.514092445373535 (8.149770587682724) | > loss_mel: 26.36565589904785 (24.774840354919434) | > loss_duration: 2.3973097801208496 (2.5107816457748413) | > loss_1: 50.394500732421875 (40.86661624908447)  --> STEP: 3 | > loss_disc: 2.707557439804077 (2.834336598714193) | > loss_disc_real_0: 0.1443338394165039 (0.15914341310660043) | > loss_disc_real_1: 0.24957910180091858 (0.24009538193543753) | > loss_disc_real_2: 0.2083960920572281 (0.20934232076009116) | > loss_disc_real_3: 0.23439128696918488 (0.19787407914797464) | > loss_disc_real_4: 0.24965272843837738 (0.33215605715910596) | > loss_disc_real_5: 0.22232256829738617 (0.3149152845144272) | > loss_0: 2.707557439804077 (2.834336598714193) | > loss_gen: 1.6236437559127808 (2.0354591608047485) | > loss_kl: 1.7179453372955322 (2.6992193857828775) | > loss_feat: 0.9388126134872437 (5.746117929617564) | > loss_mel: 16.110353469848633 (21.886678059895832) | > loss_duration: 2.4808313846588135 (2.500798225402832) | > loss_1: 22.871585845947266 (34.86827278137207) --> EVAL PERFORMANCE | > avg_loader_time: 0.008127689361572266 (-1.3192494710287037e-05) | > avg_loss_disc: 2.834336598714193 (+0.5274311304092407) | > avg_loss_disc_real_0: 0.15914341310660043 (-0.0075821056962013245) | > avg_loss_disc_real_1: 0.24009538193543753 (+0.04411386450131735) | > avg_loss_disc_real_2: 0.20934232076009116 (-0.011901522676149995) | > avg_loss_disc_real_3: 0.19787407914797464 (-0.028896609942118345) | > avg_loss_disc_real_4: 0.33215605715910596 (+0.14245029787222546) | > avg_loss_disc_real_5: 0.3149152845144272 (+0.11085642874240875) | > avg_loss_0: 2.834336598714193 (+0.5274311304092407) | > avg_loss_gen: 2.0354591608047485 (-0.29484454790751125) | > avg_loss_kl: 2.6992193857828775 (+0.03735017776489258) | > avg_loss_feat: 5.746117929617564 (+0.5204935272534694) | > avg_loss_mel: 21.886678059895832 (+2.124918778737385) | > avg_loss_duration: 2.500798225402832 (-0.05884186426798488) | > avg_loss_1: 34.86827278137207 (+2.3290774027506487)  > EPOCH: 298/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:54:52)   --> TIME: 2023-10-20 02:55:06 -- STEP: 19/50 -- GLOBAL_STEP: 67920 | > loss_disc: 2.4572463035583496 (2.4629670757996407) | > loss_disc_real_0: 0.15463967621326447 (0.18029495034562915) | > loss_disc_real_1: 0.2109949141740799 (0.2293677016308433) | > loss_disc_real_2: 0.09196403622627258 (0.23631224663634048) | > loss_disc_real_3: 0.130544051527977 (0.24641518961442144) | > loss_disc_real_4: 0.06456070393323898 (0.23858745023608202) | > loss_disc_real_5: 0.09520629048347473 (0.21876491518004945) | > loss_0: 2.4572463035583496 (2.4629670757996407) | > grad_norm_0: tensor(350.8616, device='cuda:0') (tensor(547.1895, device='cuda:0')) | > loss_gen: 2.0227973461151123 (2.4696823797727885) | > loss_kl: 1.211395263671875 (1.0227354451229698) | > loss_feat: 6.412960529327393 (5.87740384042263) | > loss_mel: 22.502803802490234 (25.049630566647178) | > loss_duration: 1.6923946142196655 (1.6325264980918484) | > loss_1: 33.842350006103516 (36.051978035977015) | > grad_norm_1: tensor(8208.9619, device='cuda:0') (tensor(25179.1738, device='cuda:0')) | > current_lr_0: 0.0001484575026723592 | > current_lr_1: 0.0001484575026723592 | > step_time: 0.6146 (0.489539761292307) | > loader_time: 0.023 (0.02048717047038831)  --> TIME: 2023-10-20 02:55:22 -- STEP: 49/50 -- GLOBAL_STEP: 67950 | > loss_disc: 1.7664928436279297 (2.3325102012984607) | > loss_disc_real_0: 0.103995680809021 (0.1583535513099359) | > loss_disc_real_1: 0.13051928579807281 (0.21186550942306615) | > loss_disc_real_2: 0.23207500576972961 (0.22145292094471503) | > loss_disc_real_3: 0.2929035425186157 (0.24750625902824863) | > loss_disc_real_4: 0.10025173425674438 (0.20650575724335346) | > loss_disc_real_5: 0.15171901881694794 (0.19890435986524943) | > loss_0: 1.7664928436279297 (2.3325102012984607) | > grad_norm_0: tensor(211.8811, device='cuda:0') (tensor(494.6761, device='cuda:0')) | > loss_gen: 2.8785762786865234 (2.588252517641807) | > loss_kl: 0.6654478907585144 (0.9610465479140377) | > loss_feat: 6.487254619598389 (6.320615429013055) | > loss_mel: 24.060882568359375 (23.215438465682826) | > loss_duration: 1.706944465637207 (1.5833703401137371) | > loss_1: 35.79910659790039 (34.668722756054926) | > grad_norm_1: tensor(20861.5781, device='cuda:0') (tensor(23581.5293, device='cuda:0')) | > current_lr_0: 0.0001484575026723592 | > current_lr_1: 0.0001484575026723592 | > step_time: 0.5796 (0.49988170545928334) | > loader_time: 0.465 (0.029012130231273418)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.653496265411377 (1.653496265411377) | > loss_disc_real_0: 0.12726569175720215 (0.12726569175720215) | > loss_disc_real_1: 0.19333584606647491 (0.19333584606647491) | > loss_disc_real_2: 0.17073336243629456 (0.17073336243629456) | > loss_disc_real_3: 0.05780159309506416 (0.05780159309506416) | > loss_disc_real_4: 0.1020442396402359 (0.1020442396402359) | > loss_disc_real_5: 0.08072778582572937 (0.08072778582572937) | > loss_0: 1.653496265411377 (1.653496265411377) | > loss_gen: 2.5670037269592285 (2.5670037269592285) | > loss_kl: 2.294131278991699 (2.294131278991699) | > loss_feat: 8.760494232177734 (8.760494232177734) | > loss_mel: 23.28730583190918 (23.28730583190918) | > loss_duration: 2.4747698307037354 (2.4747698307037354) | > loss_1: 39.383705139160156 (39.383705139160156)  --> STEP: 1 | > loss_disc: 2.932313919067383 (2.932313919067383) | > loss_disc_real_0: 0.061406709253787994 (0.061406709253787994) | > loss_disc_real_1: 0.29776397347450256 (0.29776397347450256) | > loss_disc_real_2: 0.22738228738307953 (0.22738228738307953) | > loss_disc_real_3: 0.22286759316921234 (0.22286759316921234) | > loss_disc_real_4: 0.20790459215641022 (0.20790459215641022) | > loss_disc_real_5: 0.20751914381980896 (0.20751914381980896) | > loss_0: 2.932313919067383 (2.932313919067383) | > loss_gen: 1.3594945669174194 (1.3594945669174194) | > loss_kl: 3.398571729660034 (3.398571729660034) | > loss_feat: 0.4712158143520355 (0.4712158143520355) | > loss_mel: 15.36962890625 (15.36962890625) | > loss_duration: 2.7105531692504883 (2.7105531692504883) | > loss_1: 23.309463500976562 (23.309463500976562)  --> STEP: 2 | > loss_disc: 1.888070821762085 (2.410192370414734) | > loss_disc_real_0: 0.08509409427642822 (0.07325040176510811) | > loss_disc_real_1: 0.18650339543819427 (0.24213368445634842) | > loss_disc_real_2: 0.10371822118759155 (0.16555025428533554) | > loss_disc_real_3: 0.16236260533332825 (0.1926150992512703) | > loss_disc_real_4: 0.07867325842380524 (0.14328892529010773) | > loss_disc_real_5: 0.13646551966667175 (0.17199233174324036) | > loss_0: 1.888070821762085 (2.410192370414734) | > loss_gen: 2.5689377784729004 (1.96421617269516) | > loss_kl: 3.7545289993286133 (3.5765503644943237) | > loss_feat: 9.29360580444336 (4.8824108093976974) | > loss_mel: 24.429855346679688 (19.899742126464844) | > loss_duration: 2.5487823486328125 (2.6296677589416504) | > loss_1: 42.59571075439453 (32.95258712768555)  --> STEP: 3 | > loss_disc: 2.107767105102539 (2.3093839486440024) | > loss_disc_real_0: 0.013611335307359695 (0.053370712945858635) | > loss_disc_real_1: 0.15218587219715118 (0.21215108036994934) | > loss_disc_real_2: 0.2815988063812256 (0.20423310498396555) | > loss_disc_real_3: 0.17611166834831238 (0.187113955616951) | > loss_disc_real_4: 0.1885998547077179 (0.15839256842931113) | > loss_disc_real_5: 0.09725190699100494 (0.14707885682582855) | > loss_0: 2.107767105102539 (2.3093839486440024) | > loss_gen: 2.0910356044769287 (2.006489316622416) | > loss_kl: 1.6280827522277832 (2.927061160405477) | > loss_feat: 5.759531497955322 (5.174784372250239) | > loss_mel: 30.697853088378906 (23.499112447102863) | > loss_duration: 2.4618425369262695 (2.573726018269857) | > loss_1: 42.638343811035156 (36.181172688802086) --> EVAL PERFORMANCE | > avg_loader_time: 0.007731993993123372 (-0.0003956953684488935) | > avg_loss_disc: 2.3093839486440024 (-0.5249526500701904) | > avg_loss_disc_real_0: 0.053370712945858635 (-0.1057727001607418) | > avg_loss_disc_real_1: 0.21215108036994934 (-0.02794430156548819) | > avg_loss_disc_real_2: 0.20423310498396555 (-0.0051092157761256085) | > avg_loss_disc_real_3: 0.187113955616951 (-0.010760123531023652) | > avg_loss_disc_real_4: 0.15839256842931113 (-0.17376348872979483) | > avg_loss_disc_real_5: 0.14707885682582855 (-0.16783642768859863) | > avg_loss_0: 2.3093839486440024 (-0.5249526500701904) | > avg_loss_gen: 2.006489316622416 (-0.028969844182332505) | > avg_loss_kl: 2.927061160405477 (+0.22784177462259958) | > avg_loss_feat: 5.174784372250239 (-0.5713335573673248) | > avg_loss_mel: 23.499112447102863 (+1.6124343872070312) | > avg_loss_duration: 2.573726018269857 (+0.07292779286702489) | > avg_loss_1: 36.181172688802086 (+1.3128999074300154)  > EPOCH: 299/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:55:33)   --> TIME: 2023-10-20 02:55:51 -- STEP: 29/50 -- GLOBAL_STEP: 67980 | > loss_disc: 2.052276134490967 (2.570740954629306) | > loss_disc_real_0: 0.16162970662117004 (0.16643410272382453) | > loss_disc_real_1: 0.2163461148738861 (0.22337914502312398) | > loss_disc_real_2: 0.2267046421766281 (0.23794996841200466) | > loss_disc_real_3: 0.20351973176002502 (0.23905719457001526) | > loss_disc_real_4: 0.40676236152648926 (0.2553162700014896) | > loss_disc_real_5: 0.13914290070533752 (0.23244186285240898) | > loss_0: 2.052276134490967 (2.570740954629306) | > grad_norm_0: tensor(506.4432, device='cuda:0') (tensor(540.2692, device='cuda:0')) | > loss_gen: 3.5443267822265625 (2.3430948956259368) | > loss_kl: 0.935454785823822 (0.9354768888703708) | > loss_feat: 7.563788890838623 (4.771189302077581) | > loss_mel: 22.563661575317383 (19.473735357153004) | > loss_duration: 1.590551733970642 (1.5935984479969945) | > loss_1: 36.197784423828125 (29.117094796279385) | > grad_norm_1: tensor(2872.9124, device='cuda:0') (tensor(20013.9316, device='cuda:0')) | > current_lr_0: 0.0001483091101036092 | > current_lr_1: 0.0001483091101036092 | > step_time: 0.6322 (0.45264138846561824) | > loader_time: 0.0131 (0.016000295507496803)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.942622423171997 (2.942622423171997) | > loss_disc_real_0: 0.30657958984375 (0.30657958984375) | > loss_disc_real_1: 0.34324318170547485 (0.34324318170547485) | > loss_disc_real_2: 0.3272285461425781 (0.3272285461425781) | > loss_disc_real_3: 0.28433161973953247 (0.28433161973953247) | > loss_disc_real_4: 0.25053003430366516 (0.25053003430366516) | > loss_disc_real_5: 0.21854980289936066 (0.21854980289936066) | > loss_0: 2.942622423171997 (2.942622423171997) | > loss_gen: 1.8578343391418457 (1.8578343391418457) | > loss_kl: 2.9719884395599365 (2.9719884395599365) | > loss_feat: 0.27096182107925415 (0.27096182107925415) | > loss_mel: 15.85733413696289 (15.85733413696289) | > loss_duration: 2.3258748054504395 (2.3258748054504395) | > loss_1: 23.283992767333984 (23.283992767333984)  --> STEP: 1 | > loss_disc: 2.2305283546447754 (2.2305283546447754) | > loss_disc_real_0: 0.1799723207950592 (0.1799723207950592) | > loss_disc_real_1: 0.2164236456155777 (0.2164236456155777) | > loss_disc_real_2: 0.14910118281841278 (0.14910118281841278) | > loss_disc_real_3: 0.1399335414171219 (0.1399335414171219) | > loss_disc_real_4: 0.1379316747188568 (0.1379316747188568) | > loss_disc_real_5: 0.16568878293037415 (0.16568878293037415) | > loss_0: 2.2305283546447754 (2.2305283546447754) | > loss_gen: 2.141177177429199 (2.141177177429199) | > loss_kl: 2.9111437797546387 (2.9111437797546387) | > loss_feat: 7.235301971435547 (7.235301971435547) | > loss_mel: 23.061630249023438 (23.061630249023438) | > loss_duration: 2.5628662109375 (2.5628662109375) | > loss_1: 37.9121208190918 (37.9121208190918)  --> STEP: 2 | > loss_disc: 2.520381450653076 (2.375454902648926) | > loss_disc_real_0: 0.26110368967056274 (0.22053800523281097) | > loss_disc_real_1: 0.3107309639453888 (0.26357730478048325) | > loss_disc_real_2: 0.14732876420021057 (0.14821497350931168) | > loss_disc_real_3: 0.32568785548210144 (0.23281069844961166) | > loss_disc_real_4: 0.24469797313213348 (0.19131482392549515) | > loss_disc_real_5: 0.23971806466579437 (0.20270342379808426) | > loss_0: 2.520381450653076 (2.375454902648926) | > loss_gen: 2.3608036041259766 (2.250990390777588) | > loss_kl: 3.5084049701690674 (3.209774374961853) | > loss_feat: 5.617944717407227 (6.426623344421387) | > loss_mel: 25.9427547454834 (24.502192497253418) | > loss_duration: 2.540013551712036 (2.551439881324768) | > loss_1: 39.96992111206055 (38.94102096557617)  --> STEP: 3 | > loss_disc: 2.334615707397461 (2.361841837565104) | > loss_disc_real_0: 0.1235572025179863 (0.18821107099453607) | > loss_disc_real_1: 0.3753049671649933 (0.30081985890865326) | > loss_disc_real_2: 0.28900572657585144 (0.1951452245314916) | > loss_disc_real_3: 0.14685297012329102 (0.2041581223408381) | > loss_disc_real_4: 0.29364103078842163 (0.22542355954647064) | > loss_disc_real_5: 0.13377068936824799 (0.1797258456548055) | > loss_0: 2.334615707397461 (2.361841837565104) | > loss_gen: 2.4306273460388184 (2.3108693758646646) | > loss_kl: 1.7702012062072754 (2.7299166520436606) | > loss_feat: 4.6657915115356445 (5.83967940012614) | > loss_mel: 21.677555084228516 (23.560646692911785) | > loss_duration: 2.461760997772217 (2.5215469201405845) | > loss_1: 33.00593566894531 (36.962659200032554) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_68000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5568432807922363 (2.410592198371887) | > loss_disc_real_0: 0.14678269624710083 (0.17785397730767727) | > loss_disc_real_1: 0.2710563838481903 (0.2933789901435375) | > loss_disc_real_2: 0.29944539070129395 (0.22122026607394218) | > loss_disc_real_3: 0.27799728512763977 (0.22261791303753853) | > loss_disc_real_4: 0.40149986743927 (0.2694426365196705) | > loss_disc_real_5: 0.3183000385761261 (0.21436939388513565) | > loss_0: 2.5568432807922363 (2.410592198371887) | > loss_gen: 2.6449246406555176 (2.394383192062378) | > loss_kl: 2.8721532821655273 (2.765475809574127) | > loss_feat: 5.8764967918396 (5.848883748054504) | > loss_mel: 24.499361038208008 (23.79532527923584) | > loss_duration: 2.38727068901062 (2.4879778623580933) | > loss_1: 38.28020477294922 (37.29204559326172)  --> STEP: 1 | > loss_disc: 2.8183205127716064 (2.4921378612518312) | > loss_disc_real_0: 0.1474561095237732 (0.17177440375089645) | > loss_disc_real_1: 0.3515933156013489 (0.3050218552350998) | > loss_disc_real_2: 0.3418347239494324 (0.24534315764904022) | > loss_disc_real_3: 0.29529818892478943 (0.23715396821498871) | > loss_disc_real_4: 0.2719992697238922 (0.26995396316051484) | > loss_disc_real_5: 0.22548983991146088 (0.2165934830904007) | > loss_0: 2.8183205127716064 (2.4921378612518312) | > loss_gen: 1.8879115581512451 (2.2930888652801515) | > loss_kl: 3.0571844577789307 (2.8238175392150877) | > loss_feat: 0.7355579733848572 (4.826218593120575) | > loss_mel: 23.288223266601562 (23.693904876708984) | > loss_duration: 2.6844568252563477 (2.527273654937744) | > loss_1: 31.653331756591797 (36.164302825927734)  --> STEP: 2 | > loss_disc: 2.0223917961120605 (2.4138468503952026) | > loss_disc_real_0: 0.1403941959142685 (0.16654436911145845) | > loss_disc_real_1: 0.2158661037683487 (0.2901625633239746) | > loss_disc_real_2: 0.1344970464706421 (0.22686880578597388) | > loss_disc_real_3: 0.2328648567199707 (0.23643911629915237) | > loss_disc_real_4: 0.16645297408103943 (0.2527037983139356) | > loss_disc_real_5: 0.1990121603012085 (0.21366326262553534) | > loss_0: 2.0223917961120605 (2.4138468503952026) | > loss_gen: 2.3875937461853027 (2.3088396787643433) | > loss_kl: 3.848559856414795 (2.994607925415039) | > loss_feat: 6.44038200378418 (5.0952458282311754) | > loss_mel: 26.82732582092285 (24.21614170074463) | > loss_duration: 2.6152825355529785 (2.5419418017069497) | > loss_1: 42.119144439697266 (37.156776428222656)  --> STEP: 3 | > loss_disc: 2.860973358154297 (2.477722065789359) | > loss_disc_real_0: 0.14054593443870544 (0.1628303070153509) | > loss_disc_real_1: 0.412495493888855 (0.30763869626181467) | > loss_disc_real_2: 0.2573286294937134 (0.2312202091727938) | > loss_disc_real_3: 0.30886349081993103 (0.24678545551640646) | > loss_disc_real_4: 0.23476573824882507 (0.2501412183046341) | > loss_disc_real_5: 0.3102055490016937 (0.22745501782212937) | > loss_0: 2.860973358154297 (2.477722065789359) | > loss_gen: 1.9616994857788086 (2.2592482226235524) | > loss_kl: 2.0854055881500244 (2.864721877234323) | > loss_feat: 2.1427652835845947 (4.673462893281664) | > loss_mel: 19.655302047729492 (23.564593178885325) | > loss_duration: 2.3993802070617676 (2.521575859614781) | > loss_1: 28.244552612304688 (35.88360159737723) --> EVAL PERFORMANCE | > avg_loader_time: 0.34231506075177875 (+0.3345830667586554) | > avg_loss_disc: 2.477722065789359 (+0.1683381171453564) | > avg_loss_disc_real_0: 0.1628303070153509 (+0.10945959406949227) | > avg_loss_disc_real_1: 0.30763869626181467 (+0.09548761589186533) | > avg_loss_disc_real_2: 0.2312202091727938 (+0.026987104188828243) | > avg_loss_disc_real_3: 0.24678545551640646 (+0.05967149989945547) | > avg_loss_disc_real_4: 0.2501412183046341 (+0.09174864987532297) | > avg_loss_disc_real_5: 0.22745501782212937 (+0.08037616099630082) | > avg_loss_0: 2.477722065789359 (+0.1683381171453564) | > avg_loss_gen: 2.2592482226235524 (+0.2527589060011364) | > avg_loss_kl: 2.864721877234323 (-0.062339283171154225) | > avg_loss_feat: 4.673462893281664 (-0.5013214789685749) | > avg_loss_mel: 23.564593178885325 (+0.06548073178246128) | > avg_loss_duration: 2.521575859614781 (-0.052150158655075884) | > avg_loss_1: 35.88360159737723 (-0.2975710914248566)  > EPOCH: 300/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:56:18)   --> TIME: 2023-10-20 02:56:25 -- STEP: 9/50 -- GLOBAL_STEP: 68010 | > loss_disc: 3.017436981201172 (2.4132324854532876) | > loss_disc_real_0: 0.2879764437675476 (0.14478657932745087) | > loss_disc_real_1: 0.32970961928367615 (0.2356490840514501) | > loss_disc_real_2: 0.3258451819419861 (0.2470026272866461) | > loss_disc_real_3: 0.2389933317899704 (0.277343029777209) | > loss_disc_real_4: 0.27041661739349365 (0.2516464541355769) | > loss_disc_real_5: 0.2221783697605133 (0.22561807930469513) | > loss_0: 3.017436981201172 (2.4132324854532876) | > grad_norm_0: tensor(601.4310, device='cuda:0') (tensor(547.4880, device='cuda:0')) | > loss_gen: 1.677367925643921 (2.487164272202386) | > loss_kl: 0.4677739143371582 (0.9439656005965339) | > loss_feat: 0.06762059032917023 (4.545401795042886) | > loss_mel: 2.067026376724243 (18.95583218998379) | > loss_duration: 1.5607672929763794 (1.5778900914722018) | > loss_1: 5.8405561447143555 (28.510253694322373) | > grad_norm_1: tensor(19015.7656, device='cuda:0') (tensor(26111.7090, device='cuda:0')) | > current_lr_0: 0.00014816086586252246 | > current_lr_1: 0.00014816086586252246 | > step_time: 0.2611 (0.35476024945576984) | > loader_time: 0.0057 (0.008665455712212456)  --> TIME: 2023-10-20 02:56:40 -- STEP: 39/50 -- GLOBAL_STEP: 68040 | > loss_disc: 3.0299057960510254 (2.4087705398217225) | > loss_disc_real_0: 0.3623637557029724 (0.14298585682916334) | > loss_disc_real_1: 0.27542364597320557 (0.22873508882446167) | > loss_disc_real_2: 0.2712673842906952 (0.22448214621115953) | > loss_disc_real_3: 0.2701963782310486 (0.24660571148762336) | > loss_disc_real_4: 0.290641188621521 (0.22560962127187315) | > loss_disc_real_5: 0.26621758937835693 (0.2064274630557077) | > loss_0: 3.0299057960510254 (2.4087705398217225) | > grad_norm_0: tensor(1588.4930, device='cuda:0') (tensor(641.9547, device='cuda:0')) | > loss_gen: 1.6635788679122925 (2.3888845993922305) | > loss_kl: 0.08024044334888458 (0.9387093358314954) | > loss_feat: 0.07870985567569733 (4.972904972254466) | > loss_mel: 2.3733530044555664 (20.322781837903538) | > loss_duration: 1.6333132982254028 (1.5687745381624272) | > loss_1: 5.829195499420166 (30.192055359864845) | > grad_norm_1: tensor(26806.5840, device='cuda:0') (tensor(25247.5000, device='cuda:0')) | > current_lr_0: 0.00014816086586252246 | > current_lr_1: 0.00014816086586252246 | > step_time: 0.513 (0.4534409229572003) | > loader_time: 0.0143 (0.009743213653564455)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7507741451263428 (1.7507741451263428) | > loss_disc_real_0: 0.06945789605379105 (0.06945789605379105) | > loss_disc_real_1: 0.2670760154724121 (0.2670760154724121) | > loss_disc_real_2: 0.26425445079803467 (0.26425445079803467) | > loss_disc_real_3: 0.3428584039211273 (0.3428584039211273) | > loss_disc_real_4: 0.08701276779174805 (0.08701276779174805) | > loss_disc_real_5: 0.013408676721155643 (0.013408676721155643) | > loss_0: 1.7507741451263428 (1.7507741451263428) | > loss_gen: 3.0243313312530518 (3.0243313312530518) | > loss_kl: 3.8087005615234375 (3.8087005615234375) | > loss_feat: 8.209506034851074 (8.209506034851074) | > loss_mel: 25.342483520507812 (25.342483520507812) | > loss_duration: 2.4008309841156006 (2.4008309841156006) | > loss_1: 42.785850524902344 (42.785850524902344)  --> STEP: 1 | > loss_disc: 2.3784801959991455 (2.3784801959991455) | > loss_disc_real_0: 0.07505857944488525 (0.07505857944488525) | > loss_disc_real_1: 0.19310522079467773 (0.19310522079467773) | > loss_disc_real_2: 0.32711225748062134 (0.32711225748062134) | > loss_disc_real_3: 0.35283997654914856 (0.35283997654914856) | > loss_disc_real_4: 0.26930826902389526 (0.26930826902389526) | > loss_disc_real_5: 0.28864169120788574 (0.28864169120788574) | > loss_0: 2.3784801959991455 (2.3784801959991455) | > loss_gen: 2.763468027114868 (2.763468027114868) | > loss_kl: 3.345205068588257 (3.345205068588257) | > loss_feat: 6.096039772033691 (6.096039772033691) | > loss_mel: 31.322940826416016 (31.322940826416016) | > loss_duration: 2.650844097137451 (2.650844097137451) | > loss_1: 46.17850112915039 (46.17850112915039)  --> STEP: 2 | > loss_disc: 2.07198429107666 (2.225232243537903) | > loss_disc_real_0: 0.28516215085983276 (0.180110365152359) | > loss_disc_real_1: 0.25804343819618225 (0.22557432949543) | > loss_disc_real_2: 0.23642240464687347 (0.2817673310637474) | > loss_disc_real_3: 0.30894169211387634 (0.33089083433151245) | > loss_disc_real_4: 0.13557913899421692 (0.2024437040090561) | > loss_disc_real_5: 0.23807565867900848 (0.2633586749434471) | > loss_0: 2.07198429107666 (2.225232243537903) | > loss_gen: 4.085859298706055 (3.4246636629104614) | > loss_kl: 3.420653820037842 (3.3829294443130493) | > loss_feat: 8.936688423156738 (7.516364097595215) | > loss_mel: 22.041913986206055 (26.682427406311035) | > loss_duration: 2.5452933311462402 (2.5980687141418457) | > loss_1: 41.0304069519043 (43.604454040527344)  --> STEP: 3 | > loss_disc: 2.3865513801574707 (2.279005289077759) | > loss_disc_real_0: 0.22849154472351074 (0.19623742500940958) | > loss_disc_real_1: 0.3316265940666199 (0.2609250843524933) | > loss_disc_real_2: 0.34244897961616516 (0.30199454724788666) | > loss_disc_real_3: 0.2636173367500305 (0.3084663351376851) | > loss_disc_real_4: 0.19011379778385162 (0.19833373526732126) | > loss_disc_real_5: 0.34529784321784973 (0.29067173103491467) | > loss_0: 2.3865513801574707 (2.279005289077759) | > loss_gen: 3.415407657623291 (3.421578327814738) | > loss_kl: 1.7731192111968994 (2.8463260332743325) | > loss_feat: 5.931456565856934 (6.988061587015788) | > loss_mel: 23.7239933013916 (25.696282704671223) | > loss_duration: 2.5188469886779785 (2.5716614723205566) | > loss_1: 37.36282730102539 (41.523911794026695) --> EVAL PERFORMANCE | > avg_loader_time: 0.010063648223876953 (-0.3322514125279018) | > avg_loss_disc: 2.279005289077759 (-0.19871677671160004) | > avg_loss_disc_real_0: 0.19623742500940958 (+0.03340711799405868) | > avg_loss_disc_real_1: 0.2609250843524933 (-0.046713611909321384) | > avg_loss_disc_real_2: 0.30199454724788666 (+0.07077433807509287) | > avg_loss_disc_real_3: 0.3084663351376851 (+0.06168087962127866) | > avg_loss_disc_real_4: 0.19833373526732126 (-0.051807483037312835) | > avg_loss_disc_real_5: 0.29067173103491467 (+0.0632167132127853) | > avg_loss_0: 2.279005289077759 (-0.19871677671160004) | > avg_loss_gen: 3.421578327814738 (+1.1623301051911854) | > avg_loss_kl: 2.8463260332743325 (-0.018395843959990277) | > avg_loss_feat: 6.988061587015788 (+2.3145986937341236) | > avg_loss_mel: 25.696282704671223 (+2.131689525785898) | > avg_loss_duration: 2.5716614723205566 (+0.050085612705775606) | > avg_loss_1: 41.523911794026695 (+5.640310196649466)  > EPOCH: 301/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:56:55)   --> TIME: 2023-10-20 02:57:09 -- STEP: 19/50 -- GLOBAL_STEP: 68070 | > loss_disc: 3.0618929862976074 (2.4774353441439176) | > loss_disc_real_0: 0.10126125067472458 (0.15983510742846288) | > loss_disc_real_1: 0.2982548773288727 (0.24028796702623367) | > loss_disc_real_2: 0.42547744512557983 (0.2413765878269547) | > loss_disc_real_3: 0.21898438036441803 (0.2285189114903149) | > loss_disc_real_4: 0.435726523399353 (0.20742225882254148) | > loss_disc_real_5: 0.27327170968055725 (0.20727653012267852) | > loss_0: 3.0618929862976074 (2.4774353441439176) | > grad_norm_0: tensor(1530.8745, device='cuda:0') (tensor(693.9689, device='cuda:0')) | > loss_gen: 2.515092134475708 (2.3197820437581917) | > loss_kl: 0.9955765008926392 (0.9566960507317593) | > loss_feat: 6.588204860687256 (5.328375833599191) | > loss_mel: 22.482629776000977 (21.649837117446097) | > loss_duration: 1.7526909112930298 (1.6218077509026778) | > loss_1: 34.334190368652344 (31.87649837293123) | > grad_norm_1: tensor(33053.6367, device='cuda:0') (tensor(25654.4102, device='cuda:0')) | > current_lr_0: 0.00014801276980083616 | > current_lr_1: 0.00014801276980083616 | > step_time: 0.304 (0.5002179647746839) | > loader_time: 0.0254 (0.018390392002306487)  --> TIME: 2023-10-20 02:57:23 -- STEP: 49/50 -- GLOBAL_STEP: 68100 | > loss_disc: 2.4743340015411377 (2.425609900026905) | > loss_disc_real_0: 0.14946576952934265 (0.15755196611339944) | > loss_disc_real_1: 0.16240954399108887 (0.2215922199645821) | > loss_disc_real_2: 0.27604490518569946 (0.227986554140035) | > loss_disc_real_3: 0.3168170154094696 (0.2335898107563963) | > loss_disc_real_4: 0.3851219415664673 (0.21586610091736122) | > loss_disc_real_5: 0.21726062893867493 (0.20585262239435498) | > loss_0: 2.4743340015411377 (2.425609900026905) | > grad_norm_0: tensor(481.1385, device='cuda:0') (tensor(634.6281, device='cuda:0')) | > loss_gen: 2.6033899784088135 (2.380944395551875) | > loss_kl: 0.25098511576652527 (0.9045012009387113) | > loss_feat: 3.9440956115722656 (5.291385984390366) | > loss_mel: 24.611703872680664 (22.097569915713095) | > loss_duration: 1.7146944999694824 (1.5771514688219344) | > loss_1: 33.12487030029297 (32.25155268883218) | > grad_norm_1: tensor(3498.9861, device='cuda:0') (tensor(21845.6992, device='cuda:0')) | > current_lr_0: 0.00014801276980083616 | > current_lr_1: 0.00014801276980083616 | > step_time: 0.4324 (0.46932171315562976) | > loader_time: 0.4504 (0.024805064104041267)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0636465549468994 (2.0636465549468994) | > loss_disc_real_0: 0.13387364149093628 (0.13387364149093628) | > loss_disc_real_1: 0.27660927176475525 (0.27660927176475525) | > loss_disc_real_2: 0.1972133368253708 (0.1972133368253708) | > loss_disc_real_3: 0.31034037470817566 (0.31034037470817566) | > loss_disc_real_4: 0.14170849323272705 (0.14170849323272705) | > loss_disc_real_5: 0.12239480018615723 (0.12239480018615723) | > loss_0: 2.0636465549468994 (2.0636465549468994) | > loss_gen: 2.84940505027771 (2.84940505027771) | > loss_kl: 3.116443157196045 (3.116443157196045) | > loss_feat: 4.77743673324585 (4.77743673324585) | > loss_mel: 26.157350540161133 (26.157350540161133) | > loss_duration: 2.534109354019165 (2.534109354019165) | > loss_1: 39.43474578857422 (39.43474578857422)  --> STEP: 1 | > loss_disc: 2.7146198749542236 (2.7146198749542236) | > loss_disc_real_0: 0.1806238740682602 (0.1806238740682602) | > loss_disc_real_1: 0.3067597448825836 (0.3067597448825836) | > loss_disc_real_2: 0.22651594877243042 (0.22651594877243042) | > loss_disc_real_3: 0.2740115225315094 (0.2740115225315094) | > loss_disc_real_4: 0.2933550179004669 (0.2933550179004669) | > loss_disc_real_5: 0.2814449965953827 (0.2814449965953827) | > loss_0: 2.7146198749542236 (2.7146198749542236) | > loss_gen: 1.9419499635696411 (1.9419499635696411) | > loss_kl: 3.3899006843566895 (3.3899006843566895) | > loss_feat: 0.9673287868499756 (0.9673287868499756) | > loss_mel: 23.030797958374023 (23.030797958374023) | > loss_duration: 2.708735942840576 (2.708735942840576) | > loss_1: 32.03871154785156 (32.03871154785156)  --> STEP: 2 | > loss_disc: 1.7803395986557007 (2.247479736804962) | > loss_disc_real_0: 0.03411095589399338 (0.10736741498112679) | > loss_disc_real_1: 0.05219873785972595 (0.17947924137115479) | > loss_disc_real_2: 0.08634212613105774 (0.15642903745174408) | > loss_disc_real_3: 0.1700979322195053 (0.22205472737550735) | > loss_disc_real_4: 0.21140700578689575 (0.25238101184368134) | > loss_disc_real_5: 0.24816249310970306 (0.2648037448525429) | > loss_0: 1.7803395986557007 (2.247479736804962) | > loss_gen: 2.9167709350585938 (2.4293604493141174) | > loss_kl: 4.01258659362793 (3.7012436389923096) | > loss_feat: 11.188905715942383 (6.078117251396179) | > loss_mel: 25.1181640625 (24.07448101043701) | > loss_duration: 2.6320807933807373 (2.6704083681106567) | > loss_1: 45.868507385253906 (38.953609466552734)  --> STEP: 3 | > loss_disc: 2.906139612197876 (2.4670330286026) | > loss_disc_real_0: 0.4050431251525879 (0.20659265170494714) | > loss_disc_real_1: 0.36993536353111267 (0.2429646154244741) | > loss_disc_real_2: 0.2572178542613983 (0.19002530972162882) | > loss_disc_real_3: 0.30985885858535767 (0.25132277111212414) | > loss_disc_real_4: 0.38728079199790955 (0.2973476052284241) | > loss_disc_real_5: 0.3266814947128296 (0.28542966147263843) | > loss_0: 2.906139612197876 (2.4670330286026) | > loss_gen: 2.492917060852051 (2.4505459864934287) | > loss_kl: 1.6001194715499878 (3.0008689165115356) | > loss_feat: 3.030730962753296 (5.062321821848552) | > loss_mel: 25.3309383392334 (24.49330012003581) | > loss_duration: 2.6082348823547363 (2.649683872858683) | > loss_1: 35.06293869018555 (37.65671920776367) --> EVAL PERFORMANCE | > avg_loader_time: 0.002311150232950846 (-0.007752497990926107) | > avg_loss_disc: 2.4670330286026 (+0.1880277395248413) | > avg_loss_disc_real_0: 0.20659265170494714 (+0.010355226695537567) | > avg_loss_disc_real_1: 0.2429646154244741 (-0.017960468928019196) | > avg_loss_disc_real_2: 0.19002530972162882 (-0.11196923752625784) | > avg_loss_disc_real_3: 0.25132277111212414 (-0.05714356402556098) | > avg_loss_disc_real_4: 0.2973476052284241 (+0.09901386996110281) | > avg_loss_disc_real_5: 0.28542966147263843 (-0.0052420695622762414) | > avg_loss_0: 2.4670330286026 (+0.1880277395248413) | > avg_loss_gen: 2.4505459864934287 (-0.9710323413213091) | > avg_loss_kl: 3.0008689165115356 (+0.1545428832372031) | > avg_loss_feat: 5.062321821848552 (-1.9257397651672363) | > avg_loss_mel: 24.49330012003581 (-1.2029825846354143) | > avg_loss_duration: 2.649683872858683 (+0.07802240053812648) | > avg_loss_1: 37.65671920776367 (-3.867192586263023)  > EPOCH: 302/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:57:34)   --> TIME: 2023-10-20 02:57:55 -- STEP: 29/50 -- GLOBAL_STEP: 68130 | > loss_disc: 2.6688761711120605 (2.3708355467894986) | > loss_disc_real_0: 0.045318152755498886 (0.15292105602164727) | > loss_disc_real_1: 0.2738446593284607 (0.23404277334439344) | > loss_disc_real_2: 0.13624267280101776 (0.20732838788936878) | > loss_disc_real_3: 0.1911645084619522 (0.22960988663393875) | > loss_disc_real_4: 0.2223474532365799 (0.20810374900184828) | > loss_disc_real_5: 0.2354862540960312 (0.18759848691266162) | > loss_0: 2.6688761711120605 (2.3708355467894986) | > grad_norm_0: tensor(2549.7058, device='cuda:0') (tensor(896.1200, device='cuda:0')) | > loss_gen: 1.6803197860717773 (2.4221552076010875) | > loss_kl: 1.16548490524292 (1.0047749239822914) | > loss_feat: 1.586700439453125 (5.7624794807413515) | > loss_mel: 18.273170471191406 (23.589650051347142) | > loss_duration: 1.5943630933761597 (1.6057856411769473) | > loss_1: 24.300039291381836 (34.38484540478937) | > grad_norm_1: tensor(12741.7988, device='cuda:0') (tensor(23844.4883, device='cuda:0')) | > current_lr_0: 0.00014786482177043568 | > current_lr_1: 0.00014786482177043568 | > step_time: 0.5685 (0.49528460667051116) | > loader_time: 0.0043 (0.014785988577480974)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2611072063446045 (2.2611072063446045) | > loss_disc_real_0: 0.08547626435756683 (0.08547626435756683) | > loss_disc_real_1: 0.045695412904024124 (0.045695412904024124) | > loss_disc_real_2: 0.08214528113603592 (0.08214528113603592) | > loss_disc_real_3: 0.2462949901819229 (0.2462949901819229) | > loss_disc_real_4: 0.05036754906177521 (0.05036754906177521) | > loss_disc_real_5: 0.10072393715381622 (0.10072393715381622) | > loss_0: 2.2611072063446045 (2.2611072063446045) | > loss_gen: 1.7573623657226562 (1.7573623657226562) | > loss_kl: 4.381439685821533 (4.381439685821533) | > loss_feat: 7.270843982696533 (7.270843982696533) | > loss_mel: 22.744518280029297 (22.744518280029297) | > loss_duration: 2.5682213306427 (2.5682213306427) | > loss_1: 38.72238540649414 (38.72238540649414)  --> STEP: 1 | > loss_disc: 2.2062811851501465 (2.2062811851501465) | > loss_disc_real_0: 0.1694939285516739 (0.1694939285516739) | > loss_disc_real_1: 0.1779833287000656 (0.1779833287000656) | > loss_disc_real_2: 0.15373045206069946 (0.15373045206069946) | > loss_disc_real_3: 0.13895444571971893 (0.13895444571971893) | > loss_disc_real_4: 0.20550109446048737 (0.20550109446048737) | > loss_disc_real_5: 0.13882361352443695 (0.13882361352443695) | > loss_0: 2.2062811851501465 (2.2062811851501465) | > loss_gen: 2.217158079147339 (2.217158079147339) | > loss_kl: 3.5616891384124756 (3.5616891384124756) | > loss_feat: 7.950098514556885 (7.950098514556885) | > loss_mel: 27.158597946166992 (27.158597946166992) | > loss_duration: 2.662020206451416 (2.662020206451416) | > loss_1: 43.54956817626953 (43.54956817626953)  --> STEP: 2 | > loss_disc: 2.0419020652770996 (2.124091625213623) | > loss_disc_real_0: 0.08185548335313797 (0.12567470595240593) | > loss_disc_real_1: 0.19685077667236328 (0.18741705268621445) | > loss_disc_real_2: 0.2166513055562973 (0.18519087880849838) | > loss_disc_real_3: 0.15221434831619263 (0.14558439701795578) | > loss_disc_real_4: 0.09245038777589798 (0.14897574111819267) | > loss_disc_real_5: 0.23170027136802673 (0.18526194244623184) | > loss_0: 2.0419020652770996 (2.124091625213623) | > loss_gen: 2.691592216491699 (2.454375147819519) | > loss_kl: 3.607404947280884 (3.5845470428466797) | > loss_feat: 10.685287475585938 (9.317692995071411) | > loss_mel: 33.37677001953125 (30.26768398284912) | > loss_duration: 2.5946457386016846 (2.6283329725265503) | > loss_1: 52.95570373535156 (48.25263595581055)  --> STEP: 3 | > loss_disc: 1.697993278503418 (1.982058842976888) | > loss_disc_real_0: 0.1554616242647171 (0.13560367872317633) | > loss_disc_real_1: 0.17453813552856445 (0.18312408030033112) | > loss_disc_real_2: 0.14526763558387756 (0.1718831310669581) | > loss_disc_real_3: 0.29954493045806885 (0.1969045748313268) | > loss_disc_real_4: 0.0970093384385109 (0.13165360689163208) | > loss_disc_real_5: 0.018841128796339035 (0.12978833789626756) | > loss_0: 1.697993278503418 (1.982058842976888) | > loss_gen: 2.954256057739258 (2.621002117792765) | > loss_kl: 1.5639277696609497 (2.911007285118103) | > loss_feat: 7.319066047668457 (8.65148401260376) | > loss_mel: 24.802797317504883 (28.446055094401043) | > loss_duration: 2.5625805854797363 (2.6064155101776123) | > loss_1: 39.2026252746582 (45.235965728759766) --> EVAL PERFORMANCE | > avg_loader_time: 0.01030890146891276 (+0.007997751235961914) | > avg_loss_disc: 1.982058842976888 (-0.48497418562571215) | > avg_loss_disc_real_0: 0.13560367872317633 (-0.07098897298177081) | > avg_loss_disc_real_1: 0.18312408030033112 (-0.059840535124142974) | > avg_loss_disc_real_2: 0.1718831310669581 (-0.018142178654670715) | > avg_loss_disc_real_3: 0.1969045748313268 (-0.05441819628079733) | > avg_loss_disc_real_4: 0.13165360689163208 (-0.165693998336792) | > avg_loss_disc_real_5: 0.12978833789626756 (-0.15564132357637087) | > avg_loss_0: 1.982058842976888 (-0.48497418562571215) | > avg_loss_gen: 2.621002117792765 (+0.17045613129933646) | > avg_loss_kl: 2.911007285118103 (-0.08986163139343262) | > avg_loss_feat: 8.65148401260376 (+3.589162190755208) | > avg_loss_mel: 28.446055094401043 (+3.9527549743652344) | > avg_loss_duration: 2.6064155101776123 (-0.043268362681070816) | > avg_loss_1: 45.235965728759766 (+7.579246520996094)  > EPOCH: 303/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:58:18)   --> TIME: 2023-10-20 02:58:26 -- STEP: 9/50 -- GLOBAL_STEP: 68160 | > loss_disc: 2.265357255935669 (2.1786213450961642) | > loss_disc_real_0: 0.05405712127685547 (0.13388258674078518) | > loss_disc_real_1: 0.34716612100601196 (0.22799943594468963) | > loss_disc_real_2: 0.3041054308414459 (0.22886882970730463) | > loss_disc_real_3: 0.32114818692207336 (0.2278418992128637) | > loss_disc_real_4: 0.33846089243888855 (0.19013226528962454) | > loss_disc_real_5: 0.18930001556873322 (0.23181870124406284) | > loss_0: 2.265357255935669 (2.1786213450961642) | > grad_norm_0: tensor(587.1105, device='cuda:0') (tensor(791.0522, device='cuda:0')) | > loss_gen: 2.9480111598968506 (2.8117906517452664) | > loss_kl: 1.1473890542984009 (1.0066767401165433) | > loss_feat: 4.462862968444824 (7.214868942896525) | > loss_mel: 23.85428810119629 (24.75183041890462) | > loss_duration: 1.516487717628479 (1.6196504433949788) | > loss_1: 33.929039001464844 (37.404816733466255) | > grad_norm_1: tensor(14022.9482, device='cuda:0') (tensor(28369.8672, device='cuda:0')) | > current_lr_0: 0.00014771702162335454 | > current_lr_1: 0.00014771702162335454 | > step_time: 0.4268 (0.3650103939904107) | > loader_time: 0.0158 (0.007962279849582247)  --> TIME: 2023-10-20 02:58:40 -- STEP: 39/50 -- GLOBAL_STEP: 68190 | > loss_disc: 2.7355237007141113 (2.223852512163994) | > loss_disc_real_0: 0.18243566155433655 (0.11889802674070382) | > loss_disc_real_1: 0.26171809434890747 (0.22165213038141912) | > loss_disc_real_2: 0.2014475166797638 (0.21011296650155997) | > loss_disc_real_3: 0.24688616394996643 (0.23106618426167047) | > loss_disc_real_4: 0.26310959458351135 (0.18812257357132736) | > loss_disc_real_5: 0.21776597201824188 (0.19131379918410227) | > loss_0: 2.7355237007141113 (2.223852512163994) | > grad_norm_0: tensor(2232.0776, device='cuda:0') (tensor(1033.5701, device='cuda:0')) | > loss_gen: 1.8632392883300781 (2.6571605450067763) | > loss_kl: 0.6402958631515503 (1.0002131561438243) | > loss_feat: 1.1190111637115479 (6.323738509263748) | > loss_mel: 17.371994018554688 (23.570214540530475) | > loss_duration: 1.59644615650177 (1.5830899660403912) | > loss_1: 22.590988159179688 (35.13441665355976) | > grad_norm_1: tensor(6082.1162, device='cuda:0') (tensor(44321.5391, device='cuda:0')) | > current_lr_0: 0.00014771702162335454 | > current_lr_1: 0.00014771702162335454 | > step_time: 0.3415 (0.4102639051584097) | > loader_time: 0.0064 (0.009655188291500777)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5071632862091064 (2.5071632862091064) | > loss_disc_real_0: 0.33291566371917725 (0.33291566371917725) | > loss_disc_real_1: 0.22616234421730042 (0.22616234421730042) | > loss_disc_real_2: 0.20460985600948334 (0.20460985600948334) | > loss_disc_real_3: 0.2673517167568207 (0.2673517167568207) | > loss_disc_real_4: 0.04910208657383919 (0.04910208657383919) | > loss_disc_real_5: 0.08470530062913895 (0.08470530062913895) | > loss_0: 2.5071632862091064 (2.5071632862091064) | > loss_gen: 2.1438472270965576 (2.1438472270965576) | > loss_kl: 2.898784637451172 (2.898784637451172) | > loss_feat: 6.4982218742370605 (6.4982218742370605) | > loss_mel: 25.85907554626465 (25.85907554626465) | > loss_duration: 2.371217727661133 (2.371217727661133) | > loss_1: 39.771148681640625 (39.771148681640625)  --> STEP: 1 | > loss_disc: 1.9695730209350586 (1.9695730209350586) | > loss_disc_real_0: 0.0431438684463501 (0.0431438684463501) | > loss_disc_real_1: 0.08226432651281357 (0.08226432651281357) | > loss_disc_real_2: 0.09629255533218384 (0.09629255533218384) | > loss_disc_real_3: 0.23855912685394287 (0.23855912685394287) | > loss_disc_real_4: 0.13745613396167755 (0.13745613396167755) | > loss_disc_real_5: 0.14278872311115265 (0.14278872311115265) | > loss_0: 1.9695730209350586 (1.9695730209350586) | > loss_gen: 2.2599194049835205 (2.2599194049835205) | > loss_kl: 3.2768611907958984 (3.2768611907958984) | > loss_feat: 12.644990921020508 (12.644990921020508) | > loss_mel: 25.707551956176758 (25.707551956176758) | > loss_duration: 2.61824369430542 (2.61824369430542) | > loss_1: 46.507564544677734 (46.507564544677734)  --> STEP: 2 | > loss_disc: 2.79842472076416 (2.3839988708496094) | > loss_disc_real_0: 0.2584712505340576 (0.15080755949020386) | > loss_disc_real_1: 0.2717781066894531 (0.17702121660113335) | > loss_disc_real_2: 0.27749326825141907 (0.18689291179180145) | > loss_disc_real_3: 0.3668665289878845 (0.3027128279209137) | > loss_disc_real_4: 0.2596243619918823 (0.19854024797677994) | > loss_disc_real_5: 0.3751088082790375 (0.25894876569509506) | > loss_0: 2.79842472076416 (2.3839988708496094) | > loss_gen: 2.2804136276245117 (2.270166516304016) | > loss_kl: 4.354331970214844 (3.815596580505371) | > loss_feat: 2.896454095840454 (7.770722508430481) | > loss_mel: 24.949337005615234 (25.328444480895996) | > loss_duration: 2.5836095809936523 (2.600926637649536) | > loss_1: 37.06414794921875 (41.78585624694824)  --> STEP: 3 | > loss_disc: 2.596099376678467 (2.4546990394592285) | > loss_disc_real_0: 0.6295838356018066 (0.3103996515274048) | > loss_disc_real_1: 0.3153061270713806 (0.22311618675788245) | > loss_disc_real_2: 0.29012060165405273 (0.22130214174588522) | > loss_disc_real_3: 0.19858042895793915 (0.26800202826658887) | > loss_disc_real_4: 0.2460833489894867 (0.21438794831434885) | > loss_disc_real_5: 0.30641207098960876 (0.274769867459933) | > loss_0: 2.596099376678467 (2.4546990394592285) | > loss_gen: 3.3180646896362305 (2.6194659074147544) | > loss_kl: 2.0445330142974854 (3.2252420584360757) | > loss_feat: 5.077304363250732 (6.8729164600372314) | > loss_mel: 23.527870178222656 (24.72825304667155) | > loss_duration: 2.503249406814575 (2.5683675607045493) | > loss_1: 36.47102355957031 (40.0142453511556) --> EVAL PERFORMANCE | > avg_loader_time: 0.014113823572794596 (+0.003804922103881836) | > avg_loss_disc: 2.4546990394592285 (+0.47264019648234057) | > avg_loss_disc_real_0: 0.3103996515274048 (+0.17479597280422846) | > avg_loss_disc_real_1: 0.22311618675788245 (+0.03999210645755133) | > avg_loss_disc_real_2: 0.22130214174588522 (+0.04941901067892712) | > avg_loss_disc_real_3: 0.26800202826658887 (+0.07109745343526205) | > avg_loss_disc_real_4: 0.21438794831434885 (+0.08273434142271677) | > avg_loss_disc_real_5: 0.274769867459933 (+0.14498152956366542) | > avg_loss_0: 2.4546990394592285 (+0.47264019648234057) | > avg_loss_gen: 2.6194659074147544 (-0.0015362103780107716) | > avg_loss_kl: 3.2252420584360757 (+0.31423477331797267) | > avg_loss_feat: 6.8729164600372314 (-1.7785675525665283) | > avg_loss_mel: 24.72825304667155 (-3.717802047729492) | > avg_loss_duration: 2.5683675607045493 (-0.038047949473063) | > avg_loss_1: 40.0142453511556 (-5.221720377604164)  > EPOCH: 304/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:58:54)   --> TIME: 2023-10-20 02:59:08 -- STEP: 19/50 -- GLOBAL_STEP: 68220 | > loss_disc: 2.3079562187194824 (2.4544884531121505) | > loss_disc_real_0: 0.18720091879367828 (0.18538641576704226) | > loss_disc_real_1: 0.2792856693267822 (0.24517353624105453) | > loss_disc_real_2: 0.19452649354934692 (0.2422640496178677) | > loss_disc_real_3: 0.3455162048339844 (0.2506147772073746) | > loss_disc_real_4: 0.24987654387950897 (0.21200351573918996) | > loss_disc_real_5: 0.2064458280801773 (0.21670344687606158) | > loss_0: 2.3079562187194824 (2.4544884531121505) | > grad_norm_0: tensor(590.1732, device='cuda:0') (tensor(1252.8839, device='cuda:0')) | > loss_gen: 2.5820674896240234 (2.5374402748911002) | > loss_kl: 0.7267111539840698 (0.9074743735162836) | > loss_feat: 5.585659503936768 (5.054740531075942) | > loss_mel: 22.925384521484375 (21.15543300227115) | > loss_duration: 1.7120858430862427 (1.628490592304029) | > loss_1: 33.53190994262695 (31.283578195069964) | > grad_norm_1: tensor(15868.2334, device='cuda:0') (tensor(46168.0664, device='cuda:0')) | > current_lr_0: 0.0001475693692117741 | > current_lr_1: 0.0001475693692117741 | > step_time: 0.2876 (0.4811228827426308) | > loader_time: 0.0246 (0.020377836729350843)  --> TIME: 2023-10-20 02:59:23 -- STEP: 49/50 -- GLOBAL_STEP: 68250 | > loss_disc: 2.6134190559387207 (2.414820077467938) | > loss_disc_real_0: 0.26715508103370667 (0.16023467823254814) | > loss_disc_real_1: 0.2631557881832123 (0.22623722411083932) | > loss_disc_real_2: 0.19304032623767853 (0.22471225238880332) | > loss_disc_real_3: 0.2492130845785141 (0.23369240608750558) | > loss_disc_real_4: 0.3137129545211792 (0.22071412988767333) | > loss_disc_real_5: 0.2552240788936615 (0.21842888518407635) | > loss_0: 2.6134190559387207 (2.414820077467938) | > grad_norm_0: tensor(803.6685, device='cuda:0') (tensor(1111.3284, device='cuda:0')) | > loss_gen: 2.2526772022247314 (2.414673693326055) | > loss_kl: 0.659502387046814 (0.9392848927147535) | > loss_feat: 2.3981614112854004 (5.1909898457934665) | > loss_mel: 10.476831436157227 (21.6636837209974) | > loss_duration: 1.669377326965332 (1.579215168952942) | > loss_1: 17.45655059814453 (31.787846925307292) | > grad_norm_1: tensor(22242.6758, device='cuda:0') (tensor(35112.1211, device='cuda:0')) | > current_lr_0: 0.0001475693692117741 | > current_lr_1: 0.0001475693692117741 | > step_time: 0.3948 (0.46400041482886484) | > loader_time: 0.4923 (0.026209446848655234)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.71122407913208 (2.71122407913208) | > loss_disc_real_0: 0.23482905328273773 (0.23482905328273773) | > loss_disc_real_1: 0.21097593009471893 (0.21097593009471893) | > loss_disc_real_2: 0.19016312062740326 (0.19016312062740326) | > loss_disc_real_3: 0.2528570294380188 (0.2528570294380188) | > loss_disc_real_4: 0.10031138360500336 (0.10031138360500336) | > loss_disc_real_5: 0.07695871591567993 (0.07695871591567993) | > loss_0: 2.71122407913208 (2.71122407913208) | > loss_gen: 1.9683841466903687 (1.9683841466903687) | > loss_kl: 4.125415325164795 (4.125415325164795) | > loss_feat: 7.300337791442871 (7.300337791442871) | > loss_mel: 24.215761184692383 (24.215761184692383) | > loss_duration: 2.46601939201355 (2.46601939201355) | > loss_1: 40.0759162902832 (40.0759162902832)  --> STEP: 1 | > loss_disc: 3.7398266792297363 (3.7398266792297363) | > loss_disc_real_0: 0.24338510632514954 (0.24338510632514954) | > loss_disc_real_1: 0.3860602378845215 (0.3860602378845215) | > loss_disc_real_2: 0.20080293715000153 (0.20080293715000153) | > loss_disc_real_3: 0.260963499546051 (0.260963499546051) | > loss_disc_real_4: 0.08551390469074249 (0.08551390469074249) | > loss_disc_real_5: 0.06475759297609329 (0.06475759297609329) | > loss_0: 3.7398266792297363 (3.7398266792297363) | > loss_gen: 1.4801712036132812 (1.4801712036132812) | > loss_kl: 3.6546833515167236 (3.6546833515167236) | > loss_feat: 7.683436870574951 (7.683436870574951) | > loss_mel: 26.38097381591797 (26.38097381591797) | > loss_duration: 2.608595371246338 (2.608595371246338) | > loss_1: 41.807861328125 (41.807861328125)  --> STEP: 2 | > loss_disc: 1.8046001195907593 (2.772213399410248) | > loss_disc_real_0: 0.105504609644413 (0.17444485798478127) | > loss_disc_real_1: 0.07553962618112564 (0.23079993203282356) | > loss_disc_real_2: 0.27120086550712585 (0.2360019013285637) | > loss_disc_real_3: 0.24809327721595764 (0.25452838838100433) | > loss_disc_real_4: 0.0691656619310379 (0.0773397833108902) | > loss_disc_real_5: 0.17246346175670624 (0.11861052736639977) | > loss_0: 1.8046001195907593 (2.772213399410248) | > loss_gen: 3.2986512184143066 (2.389411211013794) | > loss_kl: 3.7080178260803223 (3.681350588798523) | > loss_feat: 12.670586585998535 (10.177011728286743) | > loss_mel: 33.642417907714844 (30.011695861816406) | > loss_duration: 2.632986307144165 (2.6207908391952515) | > loss_1: 55.95266342163086 (48.88026237487793)  --> STEP: 3 | > loss_disc: 1.7393100261688232 (2.4279122749964395) | > loss_disc_real_0: 0.12324365973472595 (0.1573777919014295) | > loss_disc_real_1: 0.11300194263458252 (0.19153393556674322) | > loss_disc_real_2: 0.13691042363643646 (0.20297140876452127) | > loss_disc_real_3: 0.07241492718458176 (0.19382390131553015) | > loss_disc_real_4: 0.1364872306585312 (0.0970555990934372) | > loss_disc_real_5: 0.07650826126337051 (0.10457643866539001) | > loss_0: 1.7393100261688232 (2.4279122749964395) | > loss_gen: 2.348327875137329 (2.375716765721639) | > loss_kl: 1.7436033487319946 (3.03543484210968) | > loss_feat: 6.782186508178711 (9.045403321584066) | > loss_mel: 25.4996395111084 (28.50767707824707) | > loss_duration: 2.510809898376465 (2.5841305255889893) | > loss_1: 38.88456726074219 (45.54836400349935) --> EVAL PERFORMANCE | > avg_loader_time: 0.0019795894622802734 (-0.012134234110514322) | > avg_loss_disc: 2.4279122749964395 (-0.026786764462789048) | > avg_loss_disc_real_0: 0.1573777919014295 (-0.15302185962597528) | > avg_loss_disc_real_1: 0.19153393556674322 (-0.03158225119113922) | > avg_loss_disc_real_2: 0.20297140876452127 (-0.01833073298136395) | > avg_loss_disc_real_3: 0.19382390131553015 (-0.07417812695105871) | > avg_loss_disc_real_4: 0.0970555990934372 (-0.11733234922091165) | > avg_loss_disc_real_5: 0.10457643866539001 (-0.17019342879454297) | > avg_loss_0: 2.4279122749964395 (-0.026786764462789048) | > avg_loss_gen: 2.375716765721639 (-0.24374914169311523) | > avg_loss_kl: 3.03543484210968 (-0.18980721632639552) | > avg_loss_feat: 9.045403321584066 (+2.172486861546835) | > avg_loss_mel: 28.50767707824707 (+3.7794240315755196) | > avg_loss_duration: 2.5841305255889893 (+0.015762964884439956) | > avg_loss_1: 45.54836400349935 (+5.53411865234375)  > EPOCH: 305/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 02:59:35)   --> TIME: 2023-10-20 02:59:57 -- STEP: 29/50 -- GLOBAL_STEP: 68280 | > loss_disc: 2.2713823318481445 (2.418673005597345) | > loss_disc_real_0: 0.05157752335071564 (0.13865685552872462) | > loss_disc_real_1: 0.20519593358039856 (0.21671507147879437) | > loss_disc_real_2: 0.16491052508354187 (0.2416341962485478) | > loss_disc_real_3: 0.1778883934020996 (0.24589530648342492) | > loss_disc_real_4: 0.3129573166370392 (0.2189503599857462) | > loss_disc_real_5: 0.06809453666210175 (0.2094291481992294) | > loss_0: 2.2713823318481445 (2.418673005597345) | > grad_norm_0: tensor(1093.7841, device='cuda:0') (tensor(1414.8528, device='cuda:0')) | > loss_gen: 2.525808811187744 (2.5398958962539147) | > loss_kl: 0.7462345361709595 (0.9648132560581998) | > loss_feat: 6.849634170532227 (6.2396455119396075) | > loss_mel: 25.143156051635742 (22.677099260790595) | > loss_duration: 1.5427148342132568 (1.5989993810653687) | > loss_1: 36.80754852294922 (34.02045322286672) | > grad_norm_1: tensor(50190.1602, device='cuda:0') (tensor(53344.4531, device='cuda:0')) | > current_lr_0: 0.00014742186438802338 | > current_lr_1: 0.00014742186438802338 | > step_time: 0.5483 (0.4914826689095333) | > loader_time: 0.024 (0.018556044019501786)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9059102535247803 (2.9059102535247803) | > loss_disc_real_0: 0.39388102293014526 (0.39388102293014526) | > loss_disc_real_1: 0.29423001408576965 (0.29423001408576965) | > loss_disc_real_2: 0.2829113006591797 (0.2829113006591797) | > loss_disc_real_3: 0.262550413608551 (0.262550413608551) | > loss_disc_real_4: 0.272284597158432 (0.272284597158432) | > loss_disc_real_5: 0.2866506576538086 (0.2866506576538086) | > loss_0: 2.9059102535247803 (2.9059102535247803) | > loss_gen: 2.320943593978882 (2.320943593978882) | > loss_kl: 3.0194146633148193 (3.0194146633148193) | > loss_feat: 1.59011971950531 (1.59011971950531) | > loss_mel: 21.132305145263672 (21.132305145263672) | > loss_duration: 2.51789927482605 (2.51789927482605) | > loss_1: 30.5806827545166 (30.5806827545166)  --> STEP: 1 | > loss_disc: 2.6988368034362793 (2.6988368034362793) | > loss_disc_real_0: 0.16291141510009766 (0.16291141510009766) | > loss_disc_real_1: 0.37355077266693115 (0.37355077266693115) | > loss_disc_real_2: 0.24265050888061523 (0.24265050888061523) | > loss_disc_real_3: 0.16350220143795013 (0.16350220143795013) | > loss_disc_real_4: 0.2617209851741791 (0.2617209851741791) | > loss_disc_real_5: 0.2863997220993042 (0.2863997220993042) | > loss_0: 2.6988368034362793 (2.6988368034362793) | > loss_gen: 2.1180102825164795 (2.1180102825164795) | > loss_kl: 3.461911201477051 (3.461911201477051) | > loss_feat: 6.0358967781066895 (6.0358967781066895) | > loss_mel: 24.686859130859375 (24.686859130859375) | > loss_duration: 2.6525607109069824 (2.6525607109069824) | > loss_1: 38.95524215698242 (38.95524215698242)  --> STEP: 2 | > loss_disc: 2.132941722869873 (2.415889263153076) | > loss_disc_real_0: 0.05444851890206337 (0.10867996700108051) | > loss_disc_real_1: 0.20521844923496246 (0.2893846109509468) | > loss_disc_real_2: 0.1653718799352646 (0.2040111944079399) | > loss_disc_real_3: 0.11617110669612885 (0.1398366540670395) | > loss_disc_real_4: 0.13960766792297363 (0.20066432654857635) | > loss_disc_real_5: 0.13615159690380096 (0.21127565950155258) | > loss_0: 2.132941722869873 (2.415889263153076) | > loss_gen: 2.524644136428833 (2.3213272094726562) | > loss_kl: 3.878941297531128 (3.6704262495040894) | > loss_feat: 11.111204147338867 (8.573550462722778) | > loss_mel: 24.776195526123047 (24.73152732849121) | > loss_duration: 2.559492588043213 (2.6060266494750977) | > loss_1: 44.85047912597656 (41.90286064147949)  --> STEP: 3 | > loss_disc: 2.36710524559021 (2.399627923965454) | > loss_disc_real_0: 0.2431211918592453 (0.15349370862046877) | > loss_disc_real_1: 0.27251455187797546 (0.28376125792662305) | > loss_disc_real_2: 0.2903355658054352 (0.23278598487377167) | > loss_disc_real_3: 0.21781297028064728 (0.1658287594715754) | > loss_disc_real_4: 0.18427030742168427 (0.195199653506279) | > loss_disc_real_5: 0.20522312819957733 (0.20925814906756082) | > loss_0: 2.36710524559021 (2.399627923965454) | > loss_gen: 2.2574193477630615 (2.3000245889027915) | > loss_kl: 1.2862707376480103 (2.875707745552063) | > loss_feat: 2.8570127487182617 (6.6680378913879395) | > loss_mel: 18.052837371826172 (22.5052973429362) | > loss_duration: 2.5184977054595947 (2.576850334803263) | > loss_1: 26.97203826904297 (36.92591985066732) --> EVAL PERFORMANCE | > avg_loader_time: 0.01037740707397461 (+0.008397817611694336) | > avg_loss_disc: 2.399627923965454 (-0.028284351030985366) | > avg_loss_disc_real_0: 0.15349370862046877 (-0.0038840832809607373) | > avg_loss_disc_real_1: 0.28376125792662305 (+0.09222732235987982) | > avg_loss_disc_real_2: 0.23278598487377167 (+0.029814576109250396) | > avg_loss_disc_real_3: 0.1658287594715754 (-0.02799514184395474) | > avg_loss_disc_real_4: 0.195199653506279 (+0.0981440544128418) | > avg_loss_disc_real_5: 0.20925814906756082 (+0.10468171040217081) | > avg_loss_0: 2.399627923965454 (-0.028284351030985366) | > avg_loss_gen: 2.3000245889027915 (-0.07569217681884766) | > avg_loss_kl: 2.875707745552063 (-0.1597270965576172) | > avg_loss_feat: 6.6680378913879395 (-2.377365430196127) | > avg_loss_mel: 22.5052973429362 (-6.002379735310871) | > avg_loss_duration: 2.576850334803263 (-0.0072801907857260595) | > avg_loss_1: 36.92591985066732 (-8.622444152832031)  > EPOCH: 306/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:00:19)   --> TIME: 2023-10-20 03:00:27 -- STEP: 9/50 -- GLOBAL_STEP: 68310 | > loss_disc: 2.3165550231933594 (2.5641961759991116) | > loss_disc_real_0: 0.2129497528076172 (0.10048422858946854) | > loss_disc_real_1: 0.24012978374958038 (0.21842586994171143) | > loss_disc_real_2: 0.12327682971954346 (0.22672472563054827) | > loss_disc_real_3: 0.25581037998199463 (0.22879545638958612) | > loss_disc_real_4: 0.2282637506723404 (0.27573808862103355) | > loss_disc_real_5: 0.09044592082500458 (0.18377825617790222) | > loss_0: 2.3165550231933594 (2.5641961759991116) | > grad_norm_0: tensor(913.9940, device='cuda:0') (tensor(1474.0918, device='cuda:0')) | > loss_gen: 2.3406732082366943 (2.381899979379442) | > loss_kl: 0.8885304927825928 (1.026826752556695) | > loss_feat: 5.61773157119751 (6.812734888659583) | > loss_mel: 23.397472381591797 (23.52786980734931) | > loss_duration: 1.537179708480835 (1.578847395049201) | > loss_1: 33.781585693359375 (35.32817734612359) | > grad_norm_1: tensor(12461.2891, device='cuda:0') (tensor(49495.4609, device='cuda:0')) | > current_lr_0: 0.00014727450700457924 | > current_lr_1: 0.00014727450700457924 | > step_time: 0.4216 (0.36121810807122123) | > loader_time: 0.0044 (0.005903800328572591)  --> TIME: 2023-10-20 03:00:39 -- STEP: 39/50 -- GLOBAL_STEP: 68340 | > loss_disc: 2.18280029296875 (2.519861054726136) | > loss_disc_real_0: 0.19619740545749664 (0.16246462064102674) | > loss_disc_real_1: 0.24057172238826752 (0.2306001535975016) | > loss_disc_real_2: 0.18252624571323395 (0.22814700227135268) | > loss_disc_real_3: 0.2622604966163635 (0.23621881266052908) | > loss_disc_real_4: 0.21899276971817017 (0.2570805947463482) | > loss_disc_real_5: 0.1502634584903717 (0.2187550326761527) | > loss_0: 2.18280029296875 (2.519861054726136) | > grad_norm_0: tensor(906.5330, device='cuda:0') (tensor(1259.6981, device='cuda:0')) | > loss_gen: 2.501657724380493 (2.4136990828391833) | > loss_kl: 0.49925392866134644 (0.924312581618627) | > loss_feat: 3.7110540866851807 (5.606274189284215) | > loss_mel: 15.069647789001465 (22.119358509014813) | > loss_duration: 1.5694148540496826 (1.5622038291050837) | > loss_1: 23.351028442382812 (32.62584768197475) | > grad_norm_1: tensor(10961.5420, device='cuda:0') (tensor(40614.3867, device='cuda:0')) | > current_lr_0: 0.00014727450700457924 | > current_lr_1: 0.00014727450700457924 | > step_time: 0.3624 (0.3898759866372133) | > loader_time: 0.0294 (0.008381299483470427)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9458093643188477 (2.9458093643188477) | > loss_disc_real_0: 0.21280573308467865 (0.21280573308467865) | > loss_disc_real_1: 0.29204443097114563 (0.29204443097114563) | > loss_disc_real_2: 0.21158884465694427 (0.21158884465694427) | > loss_disc_real_3: 0.25131645798683167 (0.25131645798683167) | > loss_disc_real_4: 0.21759997308254242 (0.21759997308254242) | > loss_disc_real_5: 0.27935144305229187 (0.27935144305229187) | > loss_0: 2.9458093643188477 (2.9458093643188477) | > loss_gen: 1.5307281017303467 (1.5307281017303467) | > loss_kl: 3.2601265907287598 (3.2601265907287598) | > loss_feat: 0.1573677957057953 (0.1573677957057953) | > loss_mel: 8.821307182312012 (8.821307182312012) | > loss_duration: 2.4583041667938232 (2.4583041667938232) | > loss_1: 16.227834701538086 (16.227834701538086)  --> STEP: 1 | > loss_disc: 2.96236515045166 (2.96236515045166) | > loss_disc_real_0: 0.33121490478515625 (0.33121490478515625) | > loss_disc_real_1: 0.49888232350349426 (0.49888232350349426) | > loss_disc_real_2: 0.36042705178260803 (0.36042705178260803) | > loss_disc_real_3: 0.30896419286727905 (0.30896419286727905) | > loss_disc_real_4: 0.22153156995773315 (0.22153156995773315) | > loss_disc_real_5: 0.40212497115135193 (0.40212497115135193) | > loss_0: 2.96236515045166 (2.96236515045166) | > loss_gen: 2.94124174118042 (2.94124174118042) | > loss_kl: 3.6583287715911865 (3.6583287715911865) | > loss_feat: 5.67950963973999 (5.67950963973999) | > loss_mel: 30.217002868652344 (30.217002868652344) | > loss_duration: 2.6120598316192627 (2.6120598316192627) | > loss_1: 45.1081428527832 (45.1081428527832)  --> STEP: 2 | > loss_disc: 3.3930420875549316 (3.177703619003296) | > loss_disc_real_0: 0.3627334237098694 (0.3469741642475128) | > loss_disc_real_1: 0.38718539476394653 (0.4430338591337204) | > loss_disc_real_2: 0.3342473804950714 (0.3473372161388397) | > loss_disc_real_3: 0.3237636387348175 (0.3163639158010483) | > loss_disc_real_4: 0.337516725063324 (0.27952414751052856) | > loss_disc_real_5: 0.3748718202114105 (0.3884983956813812) | > loss_0: 3.3930420875549316 (3.177703619003296) | > loss_gen: 1.9375200271606445 (2.4393808841705322) | > loss_kl: 3.764103651046753 (3.7112162113189697) | > loss_feat: 1.4524754285812378 (3.565992534160614) | > loss_mel: 22.716161727905273 (26.46658229827881) | > loss_duration: 2.5788915157318115 (2.595475673675537) | > loss_1: 32.449153900146484 (38.778648376464844)  --> STEP: 3 | > loss_disc: 2.4991796016693115 (2.9515289465586343) | > loss_disc_real_0: 0.30001410841941833 (0.33132081230481464) | > loss_disc_real_1: 0.38593360781669617 (0.42400044202804565) | > loss_disc_real_2: 0.24675250053405762 (0.31380897760391235) | > loss_disc_real_3: 0.13061806559562683 (0.25444863239924115) | > loss_disc_real_4: 0.30655694007873535 (0.2885350783665975) | > loss_disc_real_5: 0.39109814167022705 (0.38936497767766315) | > loss_0: 2.4991796016693115 (2.9515289465586343) | > loss_gen: 3.04801082611084 (2.6422575314839682) | > loss_kl: 1.8215645551681519 (3.0813323259353638) | > loss_feat: 4.348102569580078 (3.8266958793004355) | > loss_mel: 22.623537063598633 (25.185567220052082) | > loss_duration: 2.4218156337738037 (2.5375889937082925) | > loss_1: 34.263031005859375 (37.27344258626302) --> EVAL PERFORMANCE | > avg_loader_time: 0.011488914489746094 (+0.0011115074157714844) | > avg_loss_disc: 2.9515289465586343 (+0.5519010225931802) | > avg_loss_disc_real_0: 0.33132081230481464 (+0.17782710368434587) | > avg_loss_disc_real_1: 0.42400044202804565 (+0.1402391841014226) | > avg_loss_disc_real_2: 0.31380897760391235 (+0.08102299273014069) | > avg_loss_disc_real_3: 0.25444863239924115 (+0.08861987292766574) | > avg_loss_disc_real_4: 0.2885350783665975 (+0.09333542486031848) | > avg_loss_disc_real_5: 0.38936497767766315 (+0.18010682861010233) | > avg_loss_0: 2.9515289465586343 (+0.5519010225931802) | > avg_loss_gen: 2.6422575314839682 (+0.34223294258117676) | > avg_loss_kl: 3.0813323259353638 (+0.20562458038330078) | > avg_loss_feat: 3.8266958793004355 (-2.841342012087504) | > avg_loss_mel: 25.185567220052082 (+2.680269877115883) | > avg_loss_duration: 2.5375889937082925 (-0.0392613410949707) | > avg_loss_1: 37.27344258626302 (+0.3475227355957031)  > EPOCH: 307/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:00:57)   --> TIME: 2023-10-20 03:01:11 -- STEP: 19/50 -- GLOBAL_STEP: 68370 | > loss_disc: 2.853393077850342 (2.5136117684213737) | > loss_disc_real_0: 0.22147224843502045 (0.159048616690071) | > loss_disc_real_1: 0.25764691829681396 (0.22253212568007016) | > loss_disc_real_2: 0.33113983273506165 (0.2316185561449904) | > loss_disc_real_3: 0.30197271704673767 (0.252009446487615) | > loss_disc_real_4: 0.3050216734409332 (0.22285981142991468) | > loss_disc_real_5: 0.30120861530303955 (0.2507406477081148) | > loss_0: 2.853393077850342 (2.5136117684213737) | > grad_norm_0: tensor(2924.9500, device='cuda:0') (tensor(1269.2805, device='cuda:0')) | > loss_gen: 2.065598726272583 (2.3349619852869132) | > loss_kl: 1.0253435373306274 (1.0291137444345575) | > loss_feat: 1.4292532205581665 (4.832731379490149) | > loss_mel: 21.018537521362305 (21.25440638316305) | > loss_duration: 1.6416200399398804 (1.5860516774026971) | > loss_1: 27.180355072021484 (31.03726487410696) | > grad_norm_1: tensor(21587.7129, device='cuda:0') (tensor(49538.5430, device='cuda:0')) | > current_lr_0: 0.00014712729691406578 | > current_lr_1: 0.00014712729691406578 | > step_time: 0.6575 (0.49919667996858297) | > loader_time: 0.0131 (0.020356667669195878)  --> TIME: 2023-10-20 03:01:25 -- STEP: 49/50 -- GLOBAL_STEP: 68400 | > loss_disc: 2.2947278022766113 (2.582700011681537) | > loss_disc_real_0: 0.14686749875545502 (0.1608934234447625) | > loss_disc_real_1: 0.22186432778835297 (0.22630129283180042) | > loss_disc_real_2: 0.39652276039123535 (0.23685339990319038) | > loss_disc_real_3: 0.3260924816131592 (0.23768348421673385) | > loss_disc_real_4: 0.2710859179496765 (0.23173965718977305) | > loss_disc_real_5: 0.1453920304775238 (0.24136292698736095) | > loss_0: 2.2947278022766113 (2.582700011681537) | > grad_norm_0: tensor(1828.2102, device='cuda:0') (tensor(1368.0623, device='cuda:0')) | > loss_gen: 2.9572906494140625 (2.2178808402042005) | > loss_kl: 0.670253574848175 (1.0127792309741581) | > loss_feat: 5.498563289642334 (4.615279778838158) | > loss_mel: 26.313331604003906 (21.117309149430724) | > loss_duration: 1.7708508968353271 (1.5547439857405059) | > loss_1: 37.210289001464844 (30.51799323607464) | > grad_norm_1: tensor(92286.1719, device='cuda:0') (tensor(41270.6836, device='cuda:0')) | > current_lr_0: 0.00014712729691406578 | > current_lr_1: 0.00014712729691406578 | > step_time: 0.3338 (0.45788562541105304) | > loader_time: 0.3488 (0.02169945288677605)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3899660110473633 (2.3899660110473633) | > loss_disc_real_0: 0.0916760265827179 (0.0916760265827179) | > loss_disc_real_1: 0.1938280612230301 (0.1938280612230301) | > loss_disc_real_2: 0.26825040578842163 (0.26825040578842163) | > loss_disc_real_3: 0.2766062617301941 (0.2766062617301941) | > loss_disc_real_4: 0.14457233250141144 (0.14457233250141144) | > loss_disc_real_5: 0.25843968987464905 (0.25843968987464905) | > loss_0: 2.3899660110473633 (2.3899660110473633) | > loss_gen: 2.1529972553253174 (2.1529972553253174) | > loss_kl: 3.656449794769287 (3.656449794769287) | > loss_feat: 6.696438789367676 (6.696438789367676) | > loss_mel: 25.644302368164062 (25.644302368164062) | > loss_duration: 2.4878978729248047 (2.4878978729248047) | > loss_1: 40.638084411621094 (40.638084411621094)  --> STEP: 1 | > loss_disc: 3.3561601638793945 (3.3561601638793945) | > loss_disc_real_0: 0.31034380197525024 (0.31034380197525024) | > loss_disc_real_1: 0.441927969455719 (0.441927969455719) | > loss_disc_real_2: 0.3763885200023651 (0.3763885200023651) | > loss_disc_real_3: 0.486826092004776 (0.486826092004776) | > loss_disc_real_4: 0.3689773976802826 (0.3689773976802826) | > loss_disc_real_5: 0.23147980868816376 (0.23147980868816376) | > loss_0: 3.3561601638793945 (3.3561601638793945) | > loss_gen: 2.525824785232544 (2.525824785232544) | > loss_kl: 3.379539966583252 (3.379539966583252) | > loss_feat: 5.4268903732299805 (5.4268903732299805) | > loss_mel: 23.704410552978516 (23.704410552978516) | > loss_duration: 2.706336498260498 (2.706336498260498) | > loss_1: 37.743003845214844 (37.743003845214844)  --> STEP: 2 | > loss_disc: 2.552137613296509 (2.9541488885879517) | > loss_disc_real_0: 0.239191934466362 (0.2747678682208061) | > loss_disc_real_1: 0.2960675358772278 (0.3689977526664734) | > loss_disc_real_2: 0.2707580626010895 (0.3235732913017273) | > loss_disc_real_3: 0.3039161264896393 (0.39537110924720764) | > loss_disc_real_4: 0.14213892817497253 (0.25555816292762756) | > loss_disc_real_5: 0.19107040762901306 (0.2112751081585884) | > loss_0: 2.552137613296509 (2.9541488885879517) | > loss_gen: 2.5848097801208496 (2.5553172826766968) | > loss_kl: 3.7913448810577393 (3.5854424238204956) | > loss_feat: 5.573963642120361 (5.500427007675171) | > loss_mel: 30.823514938354492 (27.263962745666504) | > loss_duration: 2.5645499229431152 (2.6354432106018066) | > loss_1: 45.33818054199219 (41.540592193603516)  --> STEP: 3 | > loss_disc: 3.3184995651245117 (3.075599114100138) | > loss_disc_real_0: 0.18043085932731628 (0.24332219858964285) | > loss_disc_real_1: 0.3908774256706238 (0.3762909770011902) | > loss_disc_real_2: 0.36384329199790955 (0.3369966248671214) | > loss_disc_real_3: 0.26507046818733215 (0.35193756222724915) | > loss_disc_real_4: 0.4527755081653595 (0.3212972780068715) | > loss_disc_real_5: 0.5138140320777893 (0.3121214161316554) | > loss_0: 3.3184995651245117 (3.075599114100138) | > loss_gen: 2.84734845161438 (2.6526610056559243) | > loss_kl: 1.5372635126113892 (2.902716120084127) | > loss_feat: 5.757987022399902 (5.586280345916748) | > loss_mel: 26.227567672729492 (26.918497721354168) | > loss_duration: 2.5595107078552246 (2.610132376352946) | > loss_1: 38.9296760559082 (40.67028681437174) --> EVAL PERFORMANCE | > avg_loader_time: 0.019823233286539715 (+0.008334318796793621) | > avg_loss_disc: 3.075599114100138 (+0.1240701675415039) | > avg_loss_disc_real_0: 0.24332219858964285 (-0.08799861371517179) | > avg_loss_disc_real_1: 0.3762909770011902 (-0.04770946502685547) | > avg_loss_disc_real_2: 0.3369966248671214 (+0.023187647263209044) | > avg_loss_disc_real_3: 0.35193756222724915 (+0.097488929828008) | > avg_loss_disc_real_4: 0.3212972780068715 (+0.03276219964027405) | > avg_loss_disc_real_5: 0.3121214161316554 (-0.07724356154600776) | > avg_loss_0: 3.075599114100138 (+0.1240701675415039) | > avg_loss_gen: 2.6526610056559243 (+0.010403474171956084) | > avg_loss_kl: 2.902716120084127 (-0.17861620585123683) | > avg_loss_feat: 5.586280345916748 (+1.7595844666163125) | > avg_loss_mel: 26.918497721354168 (+1.7329305013020857) | > avg_loss_duration: 2.610132376352946 (+0.07254338264465332) | > avg_loss_1: 40.67028681437174 (+3.396844228108719)  > EPOCH: 308/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:01:36)   --> TIME: 2023-10-20 03:01:57 -- STEP: 29/50 -- GLOBAL_STEP: 68430 | > loss_disc: 1.4899117946624756 (2.327750637613494) | > loss_disc_real_0: 0.13625134527683258 (0.14056155464515604) | > loss_disc_real_1: 0.14720840752124786 (0.21190861329950136) | > loss_disc_real_2: 0.16662470996379852 (0.2125862211245915) | > loss_disc_real_3: 0.10731717199087143 (0.217355749216573) | > loss_disc_real_4: 0.02633635513484478 (0.2103523308218553) | > loss_disc_real_5: 0.018661119043827057 (0.19771274885740772) | > loss_0: 1.4899117946624756 (2.327750637613494) | > grad_norm_0: tensor(879.8518, device='cuda:0') (tensor(1007.4283, device='cuda:0')) | > loss_gen: 2.8490898609161377 (2.5140480501898406) | > loss_kl: 0.7303918600082397 (0.9898973395084513) | > loss_feat: 8.882040977478027 (6.171044697021616) | > loss_mel: 28.617643356323242 (24.11236651190396) | > loss_duration: 1.5125460624694824 (1.5969021772516185) | > loss_1: 42.591712951660156 (35.3842583360343) | > grad_norm_1: tensor(26649.0332, device='cuda:0') (tensor(47190.3633, device='cuda:0')) | > current_lr_0: 0.0001469802339692545 | > current_lr_1: 0.0001469802339692545 | > step_time: 0.3743 (0.5070788942534348) | > loader_time: 0.0027 (0.01891829227579051)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.736842155456543 (2.736842155456543) | > loss_disc_real_0: 0.34217625856399536 (0.34217625856399536) | > loss_disc_real_1: 0.3070068061351776 (0.3070068061351776) | > loss_disc_real_2: 0.2833370268344879 (0.2833370268344879) | > loss_disc_real_3: 0.2111227959394455 (0.2111227959394455) | > loss_disc_real_4: 0.2200818955898285 (0.2200818955898285) | > loss_disc_real_5: 0.26341402530670166 (0.26341402530670166) | > loss_0: 2.736842155456543 (2.736842155456543) | > loss_gen: 2.296887159347534 (2.296887159347534) | > loss_kl: 3.076859951019287 (3.076859951019287) | > loss_feat: 1.4223390817642212 (1.4223390817642212) | > loss_mel: 19.327072143554688 (19.327072143554688) | > loss_duration: 2.3946373462677 (2.3946373462677) | > loss_1: 28.51779556274414 (28.51779556274414)  --> STEP: 1 | > loss_disc: 1.2395049333572388 (1.2395049333572388) | > loss_disc_real_0: 0.0338883213698864 (0.0338883213698864) | > loss_disc_real_1: 0.18489496409893036 (0.18489496409893036) | > loss_disc_real_2: 0.06557455658912659 (0.06557455658912659) | > loss_disc_real_3: 0.02856188453733921 (0.02856188453733921) | > loss_disc_real_4: 0.06104589253664017 (0.06104589253664017) | > loss_disc_real_5: 0.03612104803323746 (0.03612104803323746) | > loss_0: 1.2395049333572388 (1.2395049333572388) | > loss_gen: 3.1865265369415283 (3.1865265369415283) | > loss_kl: 3.679711103439331 (3.679711103439331) | > loss_feat: 13.371826171875 (13.371826171875) | > loss_mel: 29.777292251586914 (29.777292251586914) | > loss_duration: 2.693936347961426 (2.693936347961426) | > loss_1: 52.70928955078125 (52.70928955078125)  --> STEP: 2 | > loss_disc: 2.3925118446350098 (1.8160083889961243) | > loss_disc_real_0: 0.1992138773202896 (0.116551099345088) | > loss_disc_real_1: 0.30547624826431274 (0.24518560618162155) | > loss_disc_real_2: 0.33875444531440735 (0.20216450095176697) | > loss_disc_real_3: 0.27599072456359863 (0.15227630455046892) | > loss_disc_real_4: 0.2629300653934479 (0.16198797896504402) | > loss_disc_real_5: 0.13032150268554688 (0.08322127535939217) | > loss_0: 2.3925118446350098 (1.8160083889961243) | > loss_gen: 2.6071174144744873 (2.896821975708008) | > loss_kl: 3.6218743324279785 (3.650792717933655) | > loss_feat: 5.008262634277344 (9.190044403076172) | > loss_mel: 28.98360824584961 (29.38045024871826) | > loss_duration: 2.5999739170074463 (2.646955132484436) | > loss_1: 42.820838928222656 (47.76506423950195)  --> STEP: 3 | > loss_disc: 3.102962017059326 (2.2449929316838584) | > loss_disc_real_0: 0.4216332733631134 (0.21824515735109648) | > loss_disc_real_1: 0.20664945244789124 (0.23234022160371146) | > loss_disc_real_2: 0.5143004059791565 (0.3062098026275635) | > loss_disc_real_3: 0.2703864574432373 (0.19164635551472506) | > loss_disc_real_4: 0.4611310064792633 (0.2617023214697838) | > loss_disc_real_5: 0.5634253025054932 (0.2432892844080925) | > loss_0: 3.102962017059326 (2.2449929316838584) | > loss_gen: 3.1245458126068115 (2.9727299213409424) | > loss_kl: 1.883621096611023 (3.061735510826111) | > loss_feat: 4.322691440582275 (7.567593415578206) | > loss_mel: 26.45183753967285 (28.404246012369793) | > loss_duration: 2.4792044162750244 (2.591038227081299) | > loss_1: 38.26190185546875 (44.59734344482422) --> EVAL PERFORMANCE | > avg_loader_time: 0.00733184814453125 (-0.012491385142008465) | > avg_loss_disc: 2.2449929316838584 (-0.8306061824162798) | > avg_loss_disc_real_0: 0.21824515735109648 (-0.02507704123854637) | > avg_loss_disc_real_1: 0.23234022160371146 (-0.14395075539747873) | > avg_loss_disc_real_2: 0.3062098026275635 (-0.03078682223955792) | > avg_loss_disc_real_3: 0.19164635551472506 (-0.1602912067125241) | > avg_loss_disc_real_4: 0.2617023214697838 (-0.05959495653708774) | > avg_loss_disc_real_5: 0.2432892844080925 (-0.0688321317235629) | > avg_loss_0: 2.2449929316838584 (-0.8306061824162798) | > avg_loss_gen: 2.9727299213409424 (+0.32006891568501805) | > avg_loss_kl: 3.061735510826111 (+0.1590193907419839) | > avg_loss_feat: 7.567593415578206 (+1.981313069661458) | > avg_loss_mel: 28.404246012369793 (+1.485748291015625) | > avg_loss_duration: 2.591038227081299 (-0.019094149271646987) | > avg_loss_1: 44.59734344482422 (+3.9270566304524763)  > EPOCH: 309/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:02:19)   --> TIME: 2023-10-20 03:02:27 -- STEP: 9/50 -- GLOBAL_STEP: 68460 | > loss_disc: 2.9528472423553467 (2.2986974583731756) | > loss_disc_real_0: 0.029383478686213493 (0.12503967454863918) | > loss_disc_real_1: 0.28140318393707275 (0.3188169043925073) | > loss_disc_real_2: 0.27027761936187744 (0.2577618766162131) | > loss_disc_real_3: 0.33747225999832153 (0.21770998338858286) | > loss_disc_real_4: 0.2268485724925995 (0.2247765101492405) | > loss_disc_real_5: 0.26824700832366943 (0.19009877637856537) | > loss_0: 2.9528472423553467 (2.2986974583731756) | > grad_norm_0: tensor(2539.2478, device='cuda:0') (tensor(1230.3708, device='cuda:0')) | > loss_gen: 1.5837877988815308 (2.759338763025072) | > loss_kl: 0.8845160007476807 (0.8505438367525736) | > loss_feat: 0.5471155643463135 (6.0071665818492574) | > loss_mel: 18.215126037597656 (22.030615594651962) | > loss_duration: 1.5614013671875 (1.5649573935402765) | > loss_1: 22.791946411132812 (33.21262264251709) | > grad_norm_1: tensor(29474.7598, device='cuda:0') (tensor(66011.1172, device='cuda:0')) | > current_lr_0: 0.00014683331802306418 | > current_lr_1: 0.00014683331802306418 | > step_time: 0.3118 (0.3451719019148085) | > loader_time: 0.009 (0.007364908854166667)  --> TIME: 2023-10-20 03:02:41 -- STEP: 39/50 -- GLOBAL_STEP: 68490 | > loss_disc: 2.334383964538574 (2.312401293179927) | > loss_disc_real_0: 0.051491327583789825 (0.13098607293497289) | > loss_disc_real_1: 0.1915556788444519 (0.23784276460989928) | > loss_disc_real_2: 0.11781831085681915 (0.22552653000904962) | > loss_disc_real_3: 0.10548143088817596 (0.212229846093135) | > loss_disc_real_4: 0.1529082953929901 (0.21623305226556766) | > loss_disc_real_5: 0.10986720770597458 (0.1994364903224871) | > loss_0: 2.334383964538574 (2.312401293179927) | > grad_norm_0: tensor(1740.5675, device='cuda:0') (tensor(1230.9080, device='cuda:0')) | > loss_gen: 2.1502127647399902 (2.6031302580466646) | > loss_kl: 0.5141437649726868 (0.8957916759909728) | > loss_feat: 7.1101250648498535 (6.061837092997171) | > loss_mel: 25.274303436279297 (22.73421079073197) | > loss_duration: 1.6208248138427734 (1.5529376818583562) | > loss_1: 36.66960906982422 (33.847907824394035) | > grad_norm_1: tensor(88483.5703, device='cuda:0') (tensor(48235.3477, device='cuda:0')) | > current_lr_0: 0.00014683331802306418 | > current_lr_1: 0.00014683331802306418 | > step_time: 0.5962 (0.431727287096855) | > loader_time: 0.0249 (0.009093828690357698)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6832678318023682 (1.6832678318023682) | > loss_disc_real_0: 0.08495675772428513 (0.08495675772428513) | > loss_disc_real_1: 0.2060699164867401 (0.2060699164867401) | > loss_disc_real_2: 0.21481159329414368 (0.21481159329414368) | > loss_disc_real_3: 0.20852559804916382 (0.20852559804916382) | > loss_disc_real_4: 0.21826735138893127 (0.21826735138893127) | > loss_disc_real_5: 0.11908013373613358 (0.11908013373613358) | > loss_0: 1.6832678318023682 (1.6832678318023682) | > loss_gen: 3.248589277267456 (3.248589277267456) | > loss_kl: 3.2328476905822754 (3.2328476905822754) | > loss_feat: 8.77348518371582 (8.77348518371582) | > loss_mel: 25.12379264831543 (25.12379264831543) | > loss_duration: 2.313495397567749 (2.313495397567749) | > loss_1: 42.69221115112305 (42.69221115112305)  --> STEP: 1 | > loss_disc: 2.690965414047241 (2.690965414047241) | > loss_disc_real_0: 0.08329395949840546 (0.08329395949840546) | > loss_disc_real_1: 0.24691759049892426 (0.24691759049892426) | > loss_disc_real_2: 0.28730788826942444 (0.28730788826942444) | > loss_disc_real_3: 0.2328188121318817 (0.2328188121318817) | > loss_disc_real_4: 0.24974624812602997 (0.24974624812602997) | > loss_disc_real_5: 0.22424131631851196 (0.22424131631851196) | > loss_0: 2.690965414047241 (2.690965414047241) | > loss_gen: 1.753417730331421 (1.753417730331421) | > loss_kl: 3.7051029205322266 (3.7051029205322266) | > loss_feat: 2.7854361534118652 (2.7854361534118652) | > loss_mel: 19.97467041015625 (19.97467041015625) | > loss_duration: 2.52532696723938 (2.52532696723938) | > loss_1: 30.743955612182617 (30.743955612182617)  --> STEP: 2 | > loss_disc: 3.0965259075164795 (2.8937456607818604) | > loss_disc_real_0: 0.10084915906190872 (0.09207155928015709) | > loss_disc_real_1: 0.21566544473171234 (0.2312915176153183) | > loss_disc_real_2: 0.19571098685264587 (0.24150943756103516) | > loss_disc_real_3: 0.26220500469207764 (0.24751190841197968) | > loss_disc_real_4: 0.27370375394821167 (0.2617250010371208) | > loss_disc_real_5: 0.30236127972602844 (0.2633012980222702) | > loss_0: 3.0965259075164795 (2.8937456607818604) | > loss_gen: 1.3322887420654297 (1.5428532361984253) | > loss_kl: 3.761190891265869 (3.733146905899048) | > loss_feat: 0.10092850029468536 (1.4431823268532753) | > loss_mel: 9.458257675170898 (14.716464042663574) | > loss_duration: 2.5433759689331055 (2.5343514680862427) | > loss_1: 17.196041107177734 (23.969998359680176)  --> STEP: 3 | > loss_disc: 1.642488718032837 (2.4766600131988525) | > loss_disc_real_0: 0.23474109172821045 (0.13962807009617487) | > loss_disc_real_1: 0.12627668678760529 (0.19628657400608063) | > loss_disc_real_2: 0.053192682564258575 (0.17873718589544296) | > loss_disc_real_3: 0.2052745372056961 (0.23343278467655182) | > loss_disc_real_4: 0.06633729487657547 (0.19659576565027237) | > loss_disc_real_5: 0.04526282101869583 (0.19062180568774542) | > loss_0: 1.642488718032837 (2.4766600131988525) | > loss_gen: 2.6670196056365967 (1.9175753593444824) | > loss_kl: 1.5824151039123535 (3.0162363052368164) | > loss_feat: 7.4257917404174805 (3.43738546470801) | > loss_mel: 22.607589721679688 (17.346839269002277) | > loss_duration: 2.435175895690918 (2.5012929439544678) | > loss_1: 36.717994689941406 (28.219330469767254) --> EVAL PERFORMANCE | > avg_loader_time: 0.010604778925577799 (+0.003272930781046549) | > avg_loss_disc: 2.4766600131988525 (+0.23166708151499416) | > avg_loss_disc_real_0: 0.13962807009617487 (-0.07861708725492161) | > avg_loss_disc_real_1: 0.19628657400608063 (-0.03605364759763083) | > avg_loss_disc_real_2: 0.17873718589544296 (-0.12747261673212051) | > avg_loss_disc_real_3: 0.23343278467655182 (+0.04178642916182676) | > avg_loss_disc_real_4: 0.19659576565027237 (-0.06510655581951141) | > avg_loss_disc_real_5: 0.19062180568774542 (-0.05266747872034708) | > avg_loss_0: 2.4766600131988525 (+0.23166708151499416) | > avg_loss_gen: 1.9175753593444824 (-1.05515456199646) | > avg_loss_kl: 3.0162363052368164 (-0.045499205589294434) | > avg_loss_feat: 3.43738546470801 (-4.130207950870195) | > avg_loss_mel: 17.346839269002277 (-11.057406743367515) | > avg_loss_duration: 2.5012929439544678 (-0.08974528312683105) | > avg_loss_1: 28.219330469767254 (-16.378012975056965)  > EPOCH: 310/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:02:57)   --> TIME: 2023-10-20 03:03:11 -- STEP: 19/50 -- GLOBAL_STEP: 68520 | > loss_disc: 3.305239677429199 (2.4625110187028585) | > loss_disc_real_0: 0.27298998832702637 (0.17133710533380508) | > loss_disc_real_1: 0.45269009470939636 (0.2485494727366849) | > loss_disc_real_2: 0.3565133810043335 (0.24094594191563756) | > loss_disc_real_3: 0.3132220506668091 (0.2549363131585874) | > loss_disc_real_4: 0.37704506516456604 (0.24189400633699015) | > loss_disc_real_5: 0.5111456513404846 (0.2169022102301058) | > loss_0: 3.305239677429199 (2.4625110187028585) | > grad_norm_0: tensor(923.6086, device='cuda:0') (tensor(1082.0629, device='cuda:0')) | > loss_gen: 2.509822368621826 (2.6540384731794657) | > loss_kl: 0.741615355014801 (0.9073705704588639) | > loss_feat: 4.446329116821289 (7.265981655371816) | > loss_mel: 21.82999038696289 (26.101094145523874) | > loss_duration: 1.654149055480957 (1.59297271778709) | > loss_1: 31.181907653808594 (38.521457521538984) | > grad_norm_1: tensor(18337.7305, device='cuda:0') (tensor(48262.1367, device='cuda:0')) | > current_lr_0: 0.0001466865489285603 | > current_lr_1: 0.0001466865489285603 | > step_time: 0.627 (0.4982946044520328) | > loader_time: 0.0228 (0.017792400560880963)  --> TIME: 2023-10-20 03:03:23 -- STEP: 49/50 -- GLOBAL_STEP: 68550 | > loss_disc: 2.2573142051696777 (2.535443057819289) | > loss_disc_real_0: 0.33070123195648193 (0.17144598903096453) | > loss_disc_real_1: 0.15539537370204926 (0.23684098130586193) | > loss_disc_real_2: 0.12494327127933502 (0.23071186974340555) | > loss_disc_real_3: 0.24170653522014618 (0.24275297557516978) | > loss_disc_real_4: 0.37549352645874023 (0.24755021367146043) | > loss_disc_real_5: 0.3188266158103943 (0.24262895423690872) | > loss_0: 2.2573142051696777 (2.535443057819289) | > grad_norm_0: tensor(1697.1952, device='cuda:0') (tensor(1304.9895, device='cuda:0')) | > loss_gen: 3.39547061920166 (2.3745349742928323) | > loss_kl: 0.7482417821884155 (0.9018934271773513) | > loss_feat: 8.897672653198242 (5.522236326975482) | > loss_mel: 33.493106842041016 (23.415086938410383) | > loss_duration: 1.7595165967941284 (1.5677992421753553) | > loss_1: 48.294010162353516 (33.781550884246826) | > grad_norm_1: tensor(143246.2969, device='cuda:0') (tensor(42308.0898, device='cuda:0')) | > current_lr_0: 0.0001466865489285603 | > current_lr_1: 0.0001466865489285603 | > step_time: 0.2899 (0.42454403273913327) | > loader_time: 0.3436 (0.02014186430950554)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0575335025787354 (2.0575335025787354) | > loss_disc_real_0: 0.02694205939769745 (0.02694205939769745) | > loss_disc_real_1: 0.18393835425376892 (0.18393835425376892) | > loss_disc_real_2: 0.19879303872585297 (0.19879303872585297) | > loss_disc_real_3: 0.37743401527404785 (0.37743401527404785) | > loss_disc_real_4: 0.13171185553073883 (0.13171185553073883) | > loss_disc_real_5: 0.1845192313194275 (0.1845192313194275) | > loss_0: 2.0575335025787354 (2.0575335025787354) | > loss_gen: 2.4355993270874023 (2.4355993270874023) | > loss_kl: 3.2395665645599365 (3.2395665645599365) | > loss_feat: 6.938957214355469 (6.938957214355469) | > loss_mel: 21.498397827148438 (21.498397827148438) | > loss_duration: 2.394343376159668 (2.394343376159668) | > loss_1: 36.506866455078125 (36.506866455078125)  --> STEP: 1 | > loss_disc: 2.9014432430267334 (2.9014432430267334) | > loss_disc_real_0: 0.09264746308326721 (0.09264746308326721) | > loss_disc_real_1: 0.2992425858974457 (0.2992425858974457) | > loss_disc_real_2: 0.2606319189071655 (0.2606319189071655) | > loss_disc_real_3: 0.2981865704059601 (0.2981865704059601) | > loss_disc_real_4: 0.2902190685272217 (0.2902190685272217) | > loss_disc_real_5: 0.2465372532606125 (0.2465372532606125) | > loss_0: 2.9014432430267334 (2.9014432430267334) | > loss_gen: 1.605570673942566 (1.605570673942566) | > loss_kl: 3.3466739654541016 (3.3466739654541016) | > loss_feat: 0.4074348211288452 (0.4074348211288452) | > loss_mel: 14.267794609069824 (14.267794609069824) | > loss_duration: 2.514613628387451 (2.514613628387451) | > loss_1: 22.142087936401367 (22.142087936401367)  --> STEP: 2 | > loss_disc: 2.9787096977233887 (2.940076470375061) | > loss_disc_real_0: 0.10223975777626038 (0.0974436104297638) | > loss_disc_real_1: 0.2993035614490509 (0.2992730736732483) | > loss_disc_real_2: 0.25942185521125793 (0.26002688705921173) | > loss_disc_real_3: 0.2980208098888397 (0.2981036901473999) | > loss_disc_real_4: 0.2898649275302887 (0.2900419980287552) | > loss_disc_real_5: 0.24656759202480316 (0.24655242264270782) | > loss_0: 2.9787096977233887 (2.940076470375061) | > loss_gen: 1.555659532546997 (1.5806151032447815) | > loss_kl: 3.5548081398010254 (3.4507410526275635) | > loss_feat: 0.2553247809410095 (0.33137980103492737) | > loss_mel: 2.623520851135254 (8.445657730102539) | > loss_duration: 2.4023149013519287 (2.45846426486969) | > loss_1: 10.39162826538086 (16.266858100891113)  --> STEP: 3 | > loss_disc: 2.725001335144043 (2.868384758631388) | > loss_disc_real_0: 0.5754425525665283 (0.2567765911420186) | > loss_disc_real_1: 0.17280541360378265 (0.2571171869834264) | > loss_disc_real_2: 0.13399818539619446 (0.21801731983820596) | > loss_disc_real_3: 0.3624613881111145 (0.31955625613530475) | > loss_disc_real_4: 0.16493868827819824 (0.24834089477856955) | > loss_disc_real_5: 0.14545945823192596 (0.21285476783911386) | > loss_0: 2.725001335144043 (2.868384758631388) | > loss_gen: 2.2592711448669434 (1.8068337837855022) | > loss_kl: 2.0452680587768555 (2.9822500546773276) | > loss_feat: 5.050795078277588 (1.904518226782481) | > loss_mel: 25.432836532592773 (14.108050664265951) | > loss_duration: 2.3837530612945557 (2.433560530344645) | > loss_1: 37.17192459106445 (23.23521359761556) --> EVAL PERFORMANCE | > avg_loader_time: 0.013683239618937174 (+0.003078460693359375) | > avg_loss_disc: 2.868384758631388 (+0.39172474543253566) | > avg_loss_disc_real_0: 0.2567765911420186 (+0.11714852104584375) | > avg_loss_disc_real_1: 0.2571171869834264 (+0.060830612977345766) | > avg_loss_disc_real_2: 0.21801731983820596 (+0.039280133942763) | > avg_loss_disc_real_3: 0.31955625613530475 (+0.08612347145875293) | > avg_loss_disc_real_4: 0.24834089477856955 (+0.05174512912829718) | > avg_loss_disc_real_5: 0.21285476783911386 (+0.02223296215136844) | > avg_loss_0: 2.868384758631388 (+0.39172474543253566) | > avg_loss_gen: 1.8068337837855022 (-0.11074157555898023) | > avg_loss_kl: 2.9822500546773276 (-0.033986250559488784) | > avg_loss_feat: 1.904518226782481 (-1.5328672379255293) | > avg_loss_mel: 14.108050664265951 (-3.2387886047363263) | > avg_loss_duration: 2.433560530344645 (-0.06773241360982274) | > avg_loss_1: 23.23521359761556 (-4.984116872151695)  > EPOCH: 311/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:03:37)   --> TIME: 2023-10-20 03:03:56 -- STEP: 29/50 -- GLOBAL_STEP: 68580 | > loss_disc: 2.2089672088623047 (2.4882713350756416) | > loss_disc_real_0: 0.11473186314105988 (0.15083385682825384) | > loss_disc_real_1: 0.32352814078330994 (0.21579217628158373) | > loss_disc_real_2: 0.24853025376796722 (0.23923424631357193) | > loss_disc_real_3: 0.2344772070646286 (0.24060952689113288) | > loss_disc_real_4: 0.24162635207176208 (0.22383972938204633) | > loss_disc_real_5: 0.25964608788490295 (0.24479256499687146) | > loss_0: 2.2089672088623047 (2.4882713350756416) | > grad_norm_0: tensor(649.9229, device='cuda:0') (tensor(1596.0717, device='cuda:0')) | > loss_gen: 2.8595938682556152 (2.4633526596529736) | > loss_kl: 1.1401054859161377 (1.0642597387576926) | > loss_feat: 5.950285911560059 (5.97926007159825) | > loss_mel: 25.181745529174805 (24.777248744306892) | > loss_duration: 1.5951942205429077 (1.5952297777965152) | > loss_1: 36.726924896240234 (35.879350925314014) | > grad_norm_1: tensor(38402.4688, device='cuda:0') (tensor(50326.0547, device='cuda:0')) | > current_lr_0: 0.00014653992653895553 | > current_lr_1: 0.00014653992653895553 | > step_time: 0.2882 (0.5050594888884444) | > loader_time: 0.0233 (0.01846466393306338)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.1888113021850586 (1.1888113021850586) | > loss_disc_real_0: 0.10374194383621216 (0.10374194383621216) | > loss_disc_real_1: 0.055766526609659195 (0.055766526609659195) | > loss_disc_real_2: 0.06416931003332138 (0.06416931003332138) | > loss_disc_real_3: 0.05052979663014412 (0.05052979663014412) | > loss_disc_real_4: 0.05763527378439903 (0.05763527378439903) | > loss_disc_real_5: 0.01791638694703579 (0.01791638694703579) | > loss_0: 1.1888113021850586 (1.1888113021850586) | > loss_gen: 2.7374510765075684 (2.7374510765075684) | > loss_kl: 2.5468661785125732 (2.5468661785125732) | > loss_feat: 12.061989784240723 (12.061989784240723) | > loss_mel: 27.030731201171875 (27.030731201171875) | > loss_duration: 2.3085882663726807 (2.3085882663726807) | > loss_1: 46.68562698364258 (46.68562698364258)  --> STEP: 1 | > loss_disc: 2.896792411804199 (2.896792411804199) | > loss_disc_real_0: 0.24250486493110657 (0.24250486493110657) | > loss_disc_real_1: 0.3003607392311096 (0.3003607392311096) | > loss_disc_real_2: 0.20010679960250854 (0.20010679960250854) | > loss_disc_real_3: 0.417106568813324 (0.417106568813324) | > loss_disc_real_4: 0.31038838624954224 (0.31038838624954224) | > loss_disc_real_5: 0.2744261920452118 (0.2744261920452118) | > loss_0: 2.896792411804199 (2.896792411804199) | > loss_gen: 2.074753761291504 (2.074753761291504) | > loss_kl: 4.057328701019287 (4.057328701019287) | > loss_feat: 3.5814011096954346 (3.5814011096954346) | > loss_mel: 24.291141510009766 (24.291141510009766) | > loss_duration: 2.676097869873047 (2.676097869873047) | > loss_1: 36.680721282958984 (36.680721282958984)  --> STEP: 2 | > loss_disc: 2.745878219604492 (2.8213353157043457) | > loss_disc_real_0: 0.32141703367233276 (0.28196094930171967) | > loss_disc_real_1: 0.13672491908073425 (0.21854282915592194) | > loss_disc_real_2: 0.1615128368139267 (0.18080981820821762) | > loss_disc_real_3: 0.21026140451431274 (0.31368398666381836) | > loss_disc_real_4: 0.2540281116962433 (0.28220824897289276) | > loss_disc_real_5: 0.3320539593696594 (0.3032400757074356) | > loss_0: 2.745878219604492 (2.8213353157043457) | > loss_gen: 2.509002447128296 (2.2918781042099) | > loss_kl: 3.9040849208831787 (3.980706810951233) | > loss_feat: 8.10511589050293 (5.843258500099182) | > loss_mel: 26.530359268188477 (25.41075038909912) | > loss_duration: 2.557671546936035 (2.616884708404541) | > loss_1: 43.606231689453125 (40.143476486206055)  --> STEP: 3 | > loss_disc: 1.2325879335403442 (2.2917528549830117) | > loss_disc_real_0: 0.09467637538909912 (0.21953275799751282) | > loss_disc_real_1: 0.08907228708267212 (0.175385981798172) | > loss_disc_real_2: 0.04490985348820686 (0.13550982996821404) | > loss_disc_real_3: 0.05127284303307533 (0.2262136054535707) | > loss_disc_real_4: 0.11135228723287582 (0.22525626172622046) | > loss_disc_real_5: 0.014241567812860012 (0.20690723974257708) | > loss_0: 1.2325879335403442 (2.2917528549830117) | > loss_gen: 2.623746395111084 (2.402500867843628) | > loss_kl: 1.772818684577942 (3.2447441021601358) | > loss_feat: 8.30362319946289 (6.663380066553752) | > loss_mel: 28.149295806884766 (26.323598861694336) | > loss_duration: 2.4601805210113525 (2.564649979273478) | > loss_1: 43.30966567993164 (41.198872884114586) --> EVAL PERFORMANCE | > avg_loader_time: 0.0060719648996988935 (-0.00761127471923828) | > avg_loss_disc: 2.2917528549830117 (-0.5766319036483765) | > avg_loss_disc_real_0: 0.21953275799751282 (-0.0372438331445058) | > avg_loss_disc_real_1: 0.175385981798172 (-0.0817312051852544) | > avg_loss_disc_real_2: 0.13550982996821404 (-0.08250748986999193) | > avg_loss_disc_real_3: 0.2262136054535707 (-0.09334265068173406) | > avg_loss_disc_real_4: 0.22525626172622046 (-0.02308463305234909) | > avg_loss_disc_real_5: 0.20690723974257708 (-0.005947528096536786) | > avg_loss_0: 2.2917528549830117 (-0.5766319036483765) | > avg_loss_gen: 2.402500867843628 (+0.5956670840581257) | > avg_loss_kl: 3.2447441021601358 (+0.26249404748280813) | > avg_loss_feat: 6.663380066553752 (+4.758861839771271) | > avg_loss_mel: 26.323598861694336 (+12.215548197428385) | > avg_loss_duration: 2.564649979273478 (+0.131089448928833) | > avg_loss_1: 41.198872884114586 (+17.963659286499027)  > EPOCH: 312/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:04:18)   --> TIME: 2023-10-20 03:04:25 -- STEP: 9/50 -- GLOBAL_STEP: 68610 | > loss_disc: 2.0197010040283203 (2.448227220111423) | > loss_disc_real_0: 0.09810265898704529 (0.15129565944274267) | > loss_disc_real_1: 0.42299631237983704 (0.23823394295242098) | > loss_disc_real_2: 0.27939265966415405 (0.2484056038988961) | > loss_disc_real_3: 0.1905798614025116 (0.23729467971457374) | > loss_disc_real_4: 0.08784163743257523 (0.18917868327763346) | > loss_disc_real_5: 0.08761594444513321 (0.18785851862695482) | > loss_0: 2.0197010040283203 (2.448227220111423) | > grad_norm_0: tensor(866.1293, device='cuda:0') (tensor(967.7842, device='cuda:0')) | > loss_gen: 2.7534561157226562 (2.406040655242072) | > loss_kl: 1.1105667352676392 (0.9830266502168443) | > loss_feat: 6.178938388824463 (6.584703259997898) | > loss_mel: 23.802644729614258 (25.692792680528427) | > loss_duration: 1.4969737529754639 (1.5873569382561579) | > loss_1: 35.34257888793945 (37.25392087300619) | > grad_norm_1: tensor(10565.1543, device='cuda:0') (tensor(36855.8281, device='cuda:0')) | > current_lr_0: 0.00014639345070760907 | > current_lr_1: 0.00014639345070760907 | > step_time: 0.3515 (0.28047476874457467) | > loader_time: 0.0101 (0.004277971055772569)  --> TIME: 2023-10-20 03:04:41 -- STEP: 39/50 -- GLOBAL_STEP: 68640 | > loss_disc: 2.682710647583008 (2.4546887263273574) | > loss_disc_real_0: 0.07778839021921158 (0.1581861265481282) | > loss_disc_real_1: 0.2523069977760315 (0.22525463921901506) | > loss_disc_real_2: 0.30931955575942993 (0.2269697647828322) | > loss_disc_real_3: 0.38691937923431396 (0.24492877492537865) | > loss_disc_real_4: 0.30582284927368164 (0.22862598481468666) | > loss_disc_real_5: 0.3257410526275635 (0.23484687640880927) | > loss_0: 2.682710647583008 (2.4546887263273574) | > grad_norm_0: tensor(2608.2163, device='cuda:0') (tensor(1415.0568, device='cuda:0')) | > loss_gen: 2.3166141510009766 (2.383424511322609) | > loss_kl: 1.2071888446807861 (0.9670137537595553) | > loss_feat: 3.6456522941589355 (5.42069281026339) | > loss_mel: 21.661434173583984 (23.163089165320763) | > loss_duration: 1.539283037185669 (1.5726916514910185) | > loss_1: 30.37017250061035 (33.506911571209244) | > grad_norm_1: tensor(28796.8672, device='cuda:0') (tensor(35608.9531, device='cuda:0')) | > current_lr_0: 0.00014639345070760907 | > current_lr_1: 0.00014639345070760907 | > step_time: 0.3224 (0.45771233852093035) | > loader_time: 0.0235 (0.011651088029910354)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.706281900405884 (2.706281900405884) | > loss_disc_real_0: 0.33039307594299316 (0.33039307594299316) | > loss_disc_real_1: 0.35982415080070496 (0.35982415080070496) | > loss_disc_real_2: 0.3219122290611267 (0.3219122290611267) | > loss_disc_real_3: 0.37771105766296387 (0.37771105766296387) | > loss_disc_real_4: 0.27521294355392456 (0.27521294355392456) | > loss_disc_real_5: 0.2434028536081314 (0.2434028536081314) | > loss_0: 2.706281900405884 (2.706281900405884) | > loss_gen: 2.689868688583374 (2.689868688583374) | > loss_kl: 3.932041883468628 (3.932041883468628) | > loss_feat: 5.477367401123047 (5.477367401123047) | > loss_mel: 24.97786521911621 (24.97786521911621) | > loss_duration: 2.451162815093994 (2.451162815093994) | > loss_1: 39.5283088684082 (39.5283088684082)  --> STEP: 1 | > loss_disc: 2.745002508163452 (2.745002508163452) | > loss_disc_real_0: 0.28039050102233887 (0.28039050102233887) | > loss_disc_real_1: 0.2207152545452118 (0.2207152545452118) | > loss_disc_real_2: 0.23541928827762604 (0.23541928827762604) | > loss_disc_real_3: 0.26998090744018555 (0.26998090744018555) | > loss_disc_real_4: 0.14892031252384186 (0.14892031252384186) | > loss_disc_real_5: 0.09954439848661423 (0.09954439848661423) | > loss_0: 2.745002508163452 (2.745002508163452) | > loss_gen: 1.9668004512786865 (1.9668004512786865) | > loss_kl: 3.8081161975860596 (3.8081161975860596) | > loss_feat: 6.144649982452393 (6.144649982452393) | > loss_mel: 28.438003540039062 (28.438003540039062) | > loss_duration: 2.6542632579803467 (2.6542632579803467) | > loss_1: 43.01183319091797 (43.01183319091797)  --> STEP: 2 | > loss_disc: 1.293898105621338 (2.019450306892395) | > loss_disc_real_0: 0.05513541027903557 (0.16776295565068722) | > loss_disc_real_1: 0.16005370020866394 (0.19038447737693787) | > loss_disc_real_2: 0.12104109674692154 (0.1782301925122738) | > loss_disc_real_3: 0.1702808141708374 (0.22013086080551147) | > loss_disc_real_4: 0.05671536922454834 (0.1028178408741951) | > loss_disc_real_5: 0.01040645595639944 (0.054975427221506834) | > loss_0: 1.293898105621338 (2.019450306892395) | > loss_gen: 3.1815905570983887 (2.5741955041885376) | > loss_kl: 3.902989625930786 (3.855552911758423) | > loss_feat: 11.358402252197266 (8.751526117324829) | > loss_mel: 27.299480438232422 (27.868741989135742) | > loss_duration: 2.527252435684204 (2.5907578468322754) | > loss_1: 48.26971435546875 (45.64077377319336)  --> STEP: 3 | > loss_disc: 3.3139753341674805 (2.4509586493174234) | > loss_disc_real_0: 0.5786899328231812 (0.3047386147081852) | > loss_disc_real_1: 0.29804447293281555 (0.22627114256223044) | > loss_disc_real_2: 0.33014976978302 (0.22887005160252252) | > loss_disc_real_3: 0.3475177586078644 (0.26259316007296246) | > loss_disc_real_4: 0.43060487508773804 (0.21208018561204275) | > loss_disc_real_5: 0.4036312997341156 (0.17119405139237642) | > loss_0: 3.3139753341674805 (2.4509586493174234) | > loss_gen: 2.648664951324463 (2.599018653233846) | > loss_kl: 1.8225880861282349 (3.1778979698816934) | > loss_feat: 3.137543201446533 (6.8801984786987305) | > loss_mel: 25.353290557861328 (27.030258178710938) | > loss_duration: 2.491635799407959 (2.5577171643575034) | > loss_1: 35.45372009277344 (42.24508921305338) --> EVAL PERFORMANCE | > avg_loader_time: 0.0029413700103759766 (-0.003130594889322917) | > avg_loss_disc: 2.4509586493174234 (+0.15920579433441162) | > avg_loss_disc_real_0: 0.3047386147081852 (+0.08520585671067238) | > avg_loss_disc_real_1: 0.22627114256223044 (+0.05088516076405844) | > avg_loss_disc_real_2: 0.22887005160252252 (+0.09336022163430849) | > avg_loss_disc_real_3: 0.26259316007296246 (+0.03637955461939177) | > avg_loss_disc_real_4: 0.21208018561204275 (-0.013176076114177704) | > avg_loss_disc_real_5: 0.17119405139237642 (-0.03571318835020065) | > avg_loss_0: 2.4509586493174234 (+0.15920579433441162) | > avg_loss_gen: 2.599018653233846 (+0.19651778539021825) | > avg_loss_kl: 3.1778979698816934 (-0.06684613227844238) | > avg_loss_feat: 6.8801984786987305 (+0.21681841214497855) | > avg_loss_mel: 27.030258178710938 (+0.7066593170166016) | > avg_loss_duration: 2.5577171643575034 (-0.006932814915974639) | > avg_loss_1: 42.24508921305338 (+1.0462163289387973)  > EPOCH: 313/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:04:55)   --> TIME: 2023-10-20 03:05:10 -- STEP: 19/50 -- GLOBAL_STEP: 68670 | > loss_disc: 2.9110817909240723 (2.2487351957120394) | > loss_disc_real_0: 0.3497704863548279 (0.14023271516749733) | > loss_disc_real_1: 0.24013426899909973 (0.22329989585437274) | > loss_disc_real_2: 0.30420368909835815 (0.18804821254391418) | > loss_disc_real_3: 0.2857639193534851 (0.26852354348490115) | > loss_disc_real_4: 0.36000701785087585 (0.22512847773338618) | > loss_disc_real_5: 0.40230947732925415 (0.24200166095244252) | > loss_0: 2.9110817909240723 (2.2487351957120394) | > grad_norm_0: tensor(3289.8921, device='cuda:0') (tensor(1339.8369, device='cuda:0')) | > loss_gen: 2.6260383129119873 (2.6806045331453023) | > loss_kl: 1.0053722858428955 (1.107339975080992) | > loss_feat: 2.6010022163391113 (5.9956966497396165) | > loss_mel: 22.021894454956055 (23.569286685240897) | > loss_duration: 1.7092885971069336 (1.6214721642042462) | > loss_1: 29.96359634399414 (34.97440034464786) | > grad_norm_1: tensor(20235.7148, device='cuda:0') (tensor(55153.0859, device='cuda:0')) | > current_lr_0: 0.00014624712128802678 | > current_lr_1: 0.00014624712128802678 | > step_time: 0.4238 (0.5407476048720511) | > loader_time: 0.0019 (0.014279804731670181)  --> TIME: 2023-10-20 03:05:24 -- STEP: 49/50 -- GLOBAL_STEP: 68700 | > loss_disc: 1.7876038551330566 (2.3150278402834523) | > loss_disc_real_0: 0.0854487419128418 (0.13687940228882492) | > loss_disc_real_1: 0.2081577479839325 (0.21955938686673737) | > loss_disc_real_2: 0.11813761293888092 (0.21020616256460853) | > loss_disc_real_3: 0.3851180672645569 (0.236194943819119) | > loss_disc_real_4: 0.09217774122953415 (0.2128304880188436) | > loss_disc_real_5: 0.0398719348013401 (0.21849833885017705) | > loss_0: 1.7876038551330566 (2.3150278402834523) | > grad_norm_0: tensor(1563.7656, device='cuda:0') (tensor(1199.7788, device='cuda:0')) | > loss_gen: 3.1258556842803955 (2.4809537347482173) | > loss_kl: 0.7556254863739014 (0.9534463991544077) | > loss_feat: 8.158374786376953 (5.693127200311544) | > loss_mel: 25.629188537597656 (22.863698635782516) | > loss_duration: 1.7614609003067017 (1.585338332215134) | > loss_1: 39.430503845214844 (33.57656448714586) | > grad_norm_1: tensor(19297.9434, device='cuda:0') (tensor(43869.5508, device='cuda:0')) | > current_lr_0: 0.00014624712128802678 | > current_lr_1: 0.00014624712128802678 | > step_time: 0.797 (0.46629334469230815) | > loader_time: 0.4301 (0.020404591852304886)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.795741081237793 (2.795741081237793) | > loss_disc_real_0: 0.12682582437992096 (0.12682582437992096) | > loss_disc_real_1: 0.293739914894104 (0.293739914894104) | > loss_disc_real_2: 0.28039997816085815 (0.28039997816085815) | > loss_disc_real_3: 0.31908687949180603 (0.31908687949180603) | > loss_disc_real_4: 0.3145199716091156 (0.3145199716091156) | > loss_disc_real_5: 0.25537073612213135 (0.25537073612213135) | > loss_0: 2.795741081237793 (2.795741081237793) | > loss_gen: 1.8524625301361084 (1.8524625301361084) | > loss_kl: 3.853950262069702 (3.853950262069702) | > loss_feat: 0.8392231464385986 (0.8392231464385986) | > loss_mel: 17.3727970123291 (17.3727970123291) | > loss_duration: 2.489137887954712 (2.489137887954712) | > loss_1: 26.40757179260254 (26.40757179260254)  --> STEP: 1 | > loss_disc: 2.2062761783599854 (2.2062761783599854) | > loss_disc_real_0: 0.10924851894378662 (0.10924851894378662) | > loss_disc_real_1: 0.219633087515831 (0.219633087515831) | > loss_disc_real_2: 0.27297231554985046 (0.27297231554985046) | > loss_disc_real_3: 0.22280609607696533 (0.22280609607696533) | > loss_disc_real_4: 0.2135494500398636 (0.2135494500398636) | > loss_disc_real_5: 0.12143632024526596 (0.12143632024526596) | > loss_0: 2.2062761783599854 (2.2062761783599854) | > loss_gen: 2.485062599182129 (2.485062599182129) | > loss_kl: 3.1503257751464844 (3.1503257751464844) | > loss_feat: 6.6819748878479 (6.6819748878479) | > loss_mel: 23.457918167114258 (23.457918167114258) | > loss_duration: 2.5977940559387207 (2.5977940559387207) | > loss_1: 38.37307357788086 (38.37307357788086)  --> STEP: 2 | > loss_disc: 2.426596164703369 (2.3164361715316772) | > loss_disc_real_0: 0.07248750329017639 (0.0908680111169815) | > loss_disc_real_1: 0.3158010244369507 (0.26771705597639084) | > loss_disc_real_2: 0.22254148125648499 (0.24775689840316772) | > loss_disc_real_3: 0.39833563566207886 (0.3105708658695221) | > loss_disc_real_4: 0.22169305384159088 (0.21762125194072723) | > loss_disc_real_5: 0.2583511471748352 (0.18989373371005058) | > loss_0: 2.426596164703369 (2.3164361715316772) | > loss_gen: 2.406102418899536 (2.4455825090408325) | > loss_kl: 3.410574197769165 (3.2804499864578247) | > loss_feat: 5.250422477722168 (5.966198682785034) | > loss_mel: 26.189489364624023 (24.82370376586914) | > loss_duration: 2.6045384407043457 (2.601166248321533) | > loss_1: 39.86112594604492 (39.11709976196289)  --> STEP: 3 | > loss_disc: 2.8555941581726074 (2.4961555004119873) | > loss_disc_real_0: 0.14887484908103943 (0.11020362377166748) | > loss_disc_real_1: 0.29668983817100525 (0.2773746500412623) | > loss_disc_real_2: 0.2821000814437866 (0.259204626083374) | > loss_disc_real_3: 0.3117227554321289 (0.3109548290570577) | > loss_disc_real_4: 0.30330517888069153 (0.24618256092071533) | > loss_disc_real_5: 0.2608214318752289 (0.21353629976511002) | > loss_0: 2.8555941581726074 (2.4961555004119873) | > loss_gen: 1.7781357765197754 (2.223100264867147) | > loss_kl: 1.3001948595046997 (2.6203649441401162) | > loss_feat: 0.40346163511276245 (4.111953000227611) | > loss_mel: 16.909868240356445 (22.185758590698242) | > loss_duration: 2.396174907684326 (2.5328358014424643) | > loss_1: 22.7878360748291 (33.674011866251625) --> EVAL PERFORMANCE | > avg_loader_time: 0.013542493184407553 (+0.010601123174031576) | > avg_loss_disc: 2.4961555004119873 (+0.04519685109456395) | > avg_loss_disc_real_0: 0.11020362377166748 (-0.19453499093651772) | > avg_loss_disc_real_1: 0.2773746500412623 (+0.05110350747903189) | > avg_loss_disc_real_2: 0.259204626083374 (+0.0303345744808515) | > avg_loss_disc_real_3: 0.3109548290570577 (+0.04836166898409522) | > avg_loss_disc_real_4: 0.24618256092071533 (+0.03410237530867258) | > avg_loss_disc_real_5: 0.21353629976511002 (+0.04234224837273359) | > avg_loss_0: 2.4961555004119873 (+0.04519685109456395) | > avg_loss_gen: 2.223100264867147 (-0.3759183883666992) | > avg_loss_kl: 2.6203649441401162 (-0.5575330257415771) | > avg_loss_feat: 4.111953000227611 (-2.76824547847112) | > avg_loss_mel: 22.185758590698242 (-4.844499588012695) | > avg_loss_duration: 2.5328358014424643 (-0.024881362915039062) | > avg_loss_1: 33.674011866251625 (-8.571077346801758)  > EPOCH: 314/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:05:36)   --> TIME: 2023-10-20 03:05:55 -- STEP: 29/50 -- GLOBAL_STEP: 68730 | > loss_disc: 3.055162191390991 (2.381839238364121) | > loss_disc_real_0: 0.09852667897939682 (0.138157004169349) | > loss_disc_real_1: 0.13780567049980164 (0.22082279314254893) | > loss_disc_real_2: 0.26614949107170105 (0.23354355220136971) | > loss_disc_real_3: 0.37819477915763855 (0.2397732462348609) | > loss_disc_real_4: 0.18770082294940948 (0.24602696415165376) | > loss_disc_real_5: 0.1756742298603058 (0.2183535303278216) | > loss_0: 3.055162191390991 (2.381839238364121) | > grad_norm_0: tensor(1441.8395, device='cuda:0') (tensor(1434.3282, device='cuda:0')) | > loss_gen: 1.780766487121582 (2.538155938016957) | > loss_kl: 0.8348945379257202 (0.9981893116030199) | > loss_feat: 5.225019454956055 (5.8368261515580375) | > loss_mel: 24.179025650024414 (21.662576864505635) | > loss_duration: 1.5702059268951416 (1.6089574057480385) | > loss_1: 33.58991241455078 (32.644705377776056) | > grad_norm_1: tensor(6406.7119, device='cuda:0') (tensor(50873.2812, device='cuda:0')) | > current_lr_0: 0.000146100938133861 | > current_lr_1: 0.000146100938133861 | > step_time: 0.4853 (0.48728036880493164) | > loader_time: 0.0232 (0.016215554599104256)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3942527770996094 (2.3942527770996094) | > loss_disc_real_0: 0.08384779840707779 (0.08384779840707779) | > loss_disc_real_1: 0.21476036310195923 (0.21476036310195923) | > loss_disc_real_2: 0.2475721836090088 (0.2475721836090088) | > loss_disc_real_3: 0.2341768443584442 (0.2341768443584442) | > loss_disc_real_4: 0.3388122618198395 (0.3388122618198395) | > loss_disc_real_5: 0.25547048449516296 (0.25547048449516296) | > loss_0: 2.3942527770996094 (2.3942527770996094) | > loss_gen: 2.5781075954437256 (2.5781075954437256) | > loss_kl: 3.308572769165039 (3.308572769165039) | > loss_feat: 5.624955177307129 (5.624955177307129) | > loss_mel: 23.676301956176758 (23.676301956176758) | > loss_duration: 2.4758496284484863 (2.4758496284484863) | > loss_1: 37.66378402709961 (37.66378402709961)  --> STEP: 1 | > loss_disc: 3.3733575344085693 (3.3733575344085693) | > loss_disc_real_0: 0.14846107363700867 (0.14846107363700867) | > loss_disc_real_1: 0.2385336011648178 (0.2385336011648178) | > loss_disc_real_2: 0.3002653419971466 (0.3002653419971466) | > loss_disc_real_3: 0.3940722644329071 (0.3940722644329071) | > loss_disc_real_4: 0.37135419249534607 (0.37135419249534607) | > loss_disc_real_5: 0.2702140510082245 (0.2702140510082245) | > loss_0: 3.3733575344085693 (3.3733575344085693) | > loss_gen: 1.7491761445999146 (1.7491761445999146) | > loss_kl: 3.361419916152954 (3.361419916152954) | > loss_feat: 7.587200164794922 (7.587200164794922) | > loss_mel: 24.935230255126953 (24.935230255126953) | > loss_duration: 2.628796100616455 (2.628796100616455) | > loss_1: 40.26182174682617 (40.26182174682617)  --> STEP: 2 | > loss_disc: 1.9125053882598877 (2.6429314613342285) | > loss_disc_real_0: 0.010138612240552902 (0.07929984293878078) | > loss_disc_real_1: 0.145030215382576 (0.1917819082736969) | > loss_disc_real_2: 0.15735682845115662 (0.2288110852241516) | > loss_disc_real_3: 0.11120942234992981 (0.25264084339141846) | > loss_disc_real_4: 0.11531045287847519 (0.24333232268691063) | > loss_disc_real_5: 0.07762877643108368 (0.17392141371965408) | > loss_0: 1.9125053882598877 (2.6429314613342285) | > loss_gen: 2.5540106296539307 (2.1515933871269226) | > loss_kl: 3.839169979095459 (3.6002949476242065) | > loss_feat: 10.003656387329102 (8.795428276062012) | > loss_mel: 24.849409103393555 (24.892319679260254) | > loss_duration: 2.506469488143921 (2.567632794380188) | > loss_1: 43.75271987915039 (42.00727081298828)  --> STEP: 3 | > loss_disc: 2.439464569091797 (2.5751091639200845) | > loss_disc_real_0: 0.1433819681406021 (0.1006605513393879) | > loss_disc_real_1: 0.169265478849411 (0.18427643179893494) | > loss_disc_real_2: 0.15453048050403595 (0.20405088365077972) | > loss_disc_real_3: 0.2151346206665039 (0.24013876914978027) | > loss_disc_real_4: 0.15179352462291718 (0.2128193899989128) | > loss_disc_real_5: 0.21334807574748993 (0.18706363439559937) | > loss_0: 2.439464569091797 (2.5751091639200845) | > loss_gen: 1.7726819515228271 (2.0252895752588906) | > loss_kl: 2.0539090633392334 (3.0848329861958823) | > loss_feat: 2.729574680328369 (6.773477077484131) | > loss_mel: 21.849138259887695 (23.877925872802734) | > loss_duration: 2.536233425140381 (2.557166337966919) | > loss_1: 30.941537857055664 (38.31869316101074) --> EVAL PERFORMANCE | > avg_loader_time: 0.020889123280843098 (+0.007346630096435545) | > avg_loss_disc: 2.5751091639200845 (+0.07895366350809718) | > avg_loss_disc_real_0: 0.1006605513393879 (-0.009543072432279587) | > avg_loss_disc_real_1: 0.18427643179893494 (-0.09309821824232739) | > avg_loss_disc_real_2: 0.20405088365077972 (-0.0551537424325943) | > avg_loss_disc_real_3: 0.24013876914978027 (-0.0708160599072774) | > avg_loss_disc_real_4: 0.2128193899989128 (-0.03336317092180252) | > avg_loss_disc_real_5: 0.18706363439559937 (-0.02647266536951065) | > avg_loss_0: 2.5751091639200845 (+0.07895366350809718) | > avg_loss_gen: 2.0252895752588906 (-0.19781068960825632) | > avg_loss_kl: 3.0848329861958823 (+0.4644680420557661) | > avg_loss_feat: 6.773477077484131 (+2.6615240772565203) | > avg_loss_mel: 23.877925872802734 (+1.6921672821044922) | > avg_loss_duration: 2.557166337966919 (+0.024330536524454605) | > avg_loss_1: 38.31869316101074 (+4.644681294759117)  > EPOCH: 315/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:06:17)   --> TIME: 2023-10-20 03:06:25 -- STEP: 9/50 -- GLOBAL_STEP: 68760 | > loss_disc: 2.2231907844543457 (2.437863137986925) | > loss_disc_real_0: 0.11364370584487915 (0.19132501093877685) | > loss_disc_real_1: 0.19723522663116455 (0.21268806979060173) | > loss_disc_real_2: 0.3040887415409088 (0.24223048074377906) | > loss_disc_real_3: 0.39839252829551697 (0.2847779840230942) | > loss_disc_real_4: 0.20731762051582336 (0.23051841225888994) | > loss_disc_real_5: 0.21867237985134125 (0.19199398905038834) | > loss_0: 2.2231907844543457 (2.437863137986925) | > grad_norm_0: tensor(295.4698, device='cuda:0') (tensor(631.4903, device='cuda:0')) | > loss_gen: 2.8808789253234863 (2.514380839135912) | > loss_kl: 1.0408027172088623 (0.9461356533898247) | > loss_feat: 6.532003879547119 (5.573702699608273) | > loss_mel: 22.491296768188477 (20.430993662940132) | > loss_duration: 1.5551520586013794 (1.5828901131947835) | > loss_1: 34.5001335144043 (31.048102802700466) | > grad_norm_1: tensor(8736.4453, device='cuda:0') (tensor(13022.7783, device='cuda:0')) | > current_lr_0: 0.0001459549010989102 | > current_lr_1: 0.0001459549010989102 | > step_time: 0.249 (0.3590114646487766) | > loader_time: 0.0053 (0.006702952914767795)  --> TIME: 2023-10-20 03:06:36 -- STEP: 39/50 -- GLOBAL_STEP: 68790 | > loss_disc: 3.1181604862213135 (2.656009777998313) | > loss_disc_real_0: 0.14339667558670044 (0.17683237657333034) | > loss_disc_real_1: 0.2591271698474884 (0.2487409230417166) | > loss_disc_real_2: 0.240855872631073 (0.2487286414282444) | > loss_disc_real_3: 0.26007699966430664 (0.24405225786643156) | > loss_disc_real_4: 0.269062340259552 (0.26313473800053966) | > loss_disc_real_5: 0.19827280938625336 (0.2756977222668819) | > loss_0: 3.1181604862213135 (2.656009777998313) | > grad_norm_0: tensor(1964.3296, device='cuda:0') (tensor(947.0256, device='cuda:0')) | > loss_gen: 1.3867539167404175 (2.294127161686237) | > loss_kl: 0.622033417224884 (0.94305441624079) | > loss_feat: 0.1486230045557022 (4.297612938074729) | > loss_mel: 2.0398213863372803 (20.155132388457275) | > loss_duration: 1.5912364721298218 (1.5699494863167787) | > loss_1: 5.788468360900879 (29.25987656911214) | > grad_norm_1: tensor(15005.2539, device='cuda:0') (tensor(14232.3721, device='cuda:0')) | > current_lr_0: 0.0001459549010989102 | > current_lr_1: 0.0001459549010989102 | > step_time: 0.6827 (0.37310560544331867) | > loader_time: 0.0234 (0.005338522104116588)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8614773750305176 (2.8614773750305176) | > loss_disc_real_0: 0.08864691108465195 (0.08864691108465195) | > loss_disc_real_1: 0.19682328402996063 (0.19682328402996063) | > loss_disc_real_2: 0.226017564535141 (0.226017564535141) | > loss_disc_real_3: 0.37868642807006836 (0.37868642807006836) | > loss_disc_real_4: 0.3666498363018036 (0.3666498363018036) | > loss_disc_real_5: 0.21094995737075806 (0.21094995737075806) | > loss_0: 2.8614773750305176 (2.8614773750305176) | > loss_gen: 2.000981092453003 (2.000981092453003) | > loss_kl: 2.5928523540496826 (2.5928523540496826) | > loss_feat: 4.933460712432861 (4.933460712432861) | > loss_mel: 27.131746292114258 (27.131746292114258) | > loss_duration: 2.341829299926758 (2.341829299926758) | > loss_1: 39.00086975097656 (39.00086975097656)  --> STEP: 1 | > loss_disc: 2.837247371673584 (2.837247371673584) | > loss_disc_real_0: 0.12790915369987488 (0.12790915369987488) | > loss_disc_real_1: 0.19723773002624512 (0.19723773002624512) | > loss_disc_real_2: 0.32544252276420593 (0.32544252276420593) | > loss_disc_real_3: 0.39006930589675903 (0.39006930589675903) | > loss_disc_real_4: 0.295064240694046 (0.295064240694046) | > loss_disc_real_5: 0.23618115484714508 (0.23618115484714508) | > loss_0: 2.837247371673584 (2.837247371673584) | > loss_gen: 2.0270116329193115 (2.0270116329193115) | > loss_kl: 3.1571266651153564 (3.1571266651153564) | > loss_feat: 4.290647983551025 (4.290647983551025) | > loss_mel: 24.19686508178711 (24.19686508178711) | > loss_duration: 2.575091600418091 (2.575091600418091) | > loss_1: 36.246742248535156 (36.246742248535156)  --> STEP: 2 | > loss_disc: 2.9548113346099854 (2.8960293531417847) | > loss_disc_real_0: 0.11549971252679825 (0.12170443311333656) | > loss_disc_real_1: 0.21187958121299744 (0.20455865561962128) | > loss_disc_real_2: 0.13867837190628052 (0.23206044733524323) | > loss_disc_real_3: 0.406191349029541 (0.39813032746315) | > loss_disc_real_4: 0.13355137407779694 (0.21430780738592148) | > loss_disc_real_5: 0.0957835242152214 (0.16598233953118324) | > loss_0: 2.9548113346099854 (2.8960293531417847) | > loss_gen: 1.5168168544769287 (1.7719142436981201) | > loss_kl: 3.3546104431152344 (3.2558685541152954) | > loss_feat: 7.144047737121582 (5.717347860336304) | > loss_mel: 25.010889053344727 (24.603877067565918) | > loss_duration: 2.5939574241638184 (2.5845245122909546) | > loss_1: 39.62031936645508 (37.93353080749512)  --> STEP: 3 | > loss_disc: 1.865843415260315 (2.552634040514628) | > loss_disc_real_0: 0.13481105864048004 (0.12607330828905106) | > loss_disc_real_1: 0.13144797086715698 (0.18018842736879984) | > loss_disc_real_2: 0.22713150084018707 (0.23041746517022452) | > loss_disc_real_3: 0.14765290915966034 (0.31463785469532013) | > loss_disc_real_4: 0.07281741499900818 (0.16714434325695038) | > loss_disc_real_5: 0.08146984875202179 (0.13781150927146277) | > loss_0: 1.865843415260315 (2.552634040514628) | > loss_gen: 2.2078990936279297 (1.9172425270080566) | > loss_kl: 1.5662623643875122 (2.692666490872701) | > loss_feat: 6.96653938293457 (6.133745034535726) | > loss_mel: 23.48479461669922 (24.230849583943684) | > loss_duration: 2.4346046447753906 (2.5345512231191) | > loss_1: 36.660099029541016 (37.509053548177086) --> EVAL PERFORMANCE | > avg_loader_time: 0.008871952692667643 (-0.012017170588175455) | > avg_loss_disc: 2.552634040514628 (-0.022475123405456543) | > avg_loss_disc_real_0: 0.12607330828905106 (+0.025412756949663162) | > avg_loss_disc_real_1: 0.18018842736879984 (-0.0040880044301351) | > avg_loss_disc_real_2: 0.23041746517022452 (+0.026366581519444793) | > avg_loss_disc_real_3: 0.31463785469532013 (+0.07449908554553986) | > avg_loss_disc_real_4: 0.16714434325695038 (-0.04567504674196243) | > avg_loss_disc_real_5: 0.13781150927146277 (-0.0492521251241366) | > avg_loss_0: 2.552634040514628 (-0.022475123405456543) | > avg_loss_gen: 1.9172425270080566 (-0.108047048250834) | > avg_loss_kl: 2.692666490872701 (-0.39216649532318115) | > avg_loss_feat: 6.133745034535726 (-0.6397320429484052) | > avg_loss_mel: 24.230849583943684 (+0.35292371114094934) | > avg_loss_duration: 2.5345512231191 (-0.022615114847818862) | > avg_loss_1: 37.509053548177086 (-0.8096396128336565)  > EPOCH: 316/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:06:53)   --> TIME: 2023-10-20 03:07:07 -- STEP: 19/50 -- GLOBAL_STEP: 68820 | > loss_disc: 2.8588790893554688 (2.565364260422556) | > loss_disc_real_0: 0.1960553228855133 (0.2059814785852244) | > loss_disc_real_1: 0.28430917859077454 (0.2271028196341113) | > loss_disc_real_2: 0.29463857412338257 (0.22257706248446515) | > loss_disc_real_3: 0.27594566345214844 (0.2314740299786392) | > loss_disc_real_4: 0.2870417833328247 (0.22416875589835017) | > loss_disc_real_5: 0.2768097221851349 (0.19059570545428678) | > loss_0: 2.8588790893554688 (2.565364260422556) | > grad_norm_0: tensor(327.8986, device='cuda:0') (tensor(564.8068, device='cuda:0')) | > loss_gen: 1.8157546520233154 (2.1026964375847266) | > loss_kl: 0.7357255816459656 (0.9892701224276897) | > loss_feat: 0.6480950713157654 (4.157650927081704) | > loss_mel: 15.370991706848145 (18.096839089142648) | > loss_duration: 1.7001841068267822 (1.5946316781796908) | > loss_1: 20.270750045776367 (26.941088074132015) | > grad_norm_1: tensor(6659.6934, device='cuda:0') (tensor(17660.1191, device='cuda:0')) | > current_lr_0: 0.00014580901003711914 | > current_lr_1: 0.00014580901003711914 | > step_time: 0.2954 (0.5072100664439955) | > loader_time: 0.025 (0.02169824901380037)  --> TIME: 2023-10-20 03:07:21 -- STEP: 49/50 -- GLOBAL_STEP: 68850 | > loss_disc: 2.8550872802734375 (2.4879063392172047) | > loss_disc_real_0: 0.2948402762413025 (0.1839815759461145) | > loss_disc_real_1: 0.26321104168891907 (0.23018870860034105) | > loss_disc_real_2: 0.2297065258026123 (0.21332456407194234) | > loss_disc_real_3: 0.3165186047554016 (0.24725945005003286) | > loss_disc_real_4: 0.25783640146255493 (0.211707381265504) | > loss_disc_real_5: 0.24237160384655 (0.21703120037837295) | > loss_0: 2.8550872802734375 (2.4879063392172047) | > grad_norm_0: tensor(590.7565, device='cuda:0') (tensor(546.1582, device='cuda:0')) | > loss_gen: 1.6803779602050781 (2.253605090841955) | > loss_kl: 0.4117465019226074 (0.8989884178249204) | > loss_feat: 0.7177065014839172 (4.705618085130592) | > loss_mel: 18.807937622070312 (19.803696144600305) | > loss_duration: 1.6812797784805298 (1.5710745149729204) | > loss_1: 23.299049377441406 (29.23298231436282) | > grad_norm_1: tensor(6719.7197, device='cuda:0') (tensor(21225.5762, device='cuda:0')) | > current_lr_0: 0.00014580901003711914 | > current_lr_1: 0.00014580901003711914 | > step_time: 0.3077 (0.4489029183679697) | > loader_time: 0.4069 (0.02412624748385683)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.086852788925171 (3.086852788925171) | > loss_disc_real_0: 0.28280091285705566 (0.28280091285705566) | > loss_disc_real_1: 0.23879610002040863 (0.23879610002040863) | > loss_disc_real_2: 0.42004477977752686 (0.42004477977752686) | > loss_disc_real_3: 0.3207542300224304 (0.3207542300224304) | > loss_disc_real_4: 0.46027204394340515 (0.46027204394340515) | > loss_disc_real_5: 0.4496821165084839 (0.4496821165084839) | > loss_0: 3.086852788925171 (3.086852788925171) | > loss_gen: 2.4647951126098633 (2.4647951126098633) | > loss_kl: 3.410651683807373 (3.410651683807373) | > loss_feat: 4.996554851531982 (4.996554851531982) | > loss_mel: 26.764062881469727 (26.764062881469727) | > loss_duration: 2.4393794536590576 (2.4393794536590576) | > loss_1: 40.075443267822266 (40.075443267822266)  --> STEP: 1 | > loss_disc: 2.816082000732422 (2.816082000732422) | > loss_disc_real_0: 0.17364400625228882 (0.17364400625228882) | > loss_disc_real_1: 0.22654683887958527 (0.22654683887958527) | > loss_disc_real_2: 0.167430579662323 (0.167430579662323) | > loss_disc_real_3: 0.3141098916530609 (0.3141098916530609) | > loss_disc_real_4: 0.2676427364349365 (0.2676427364349365) | > loss_disc_real_5: 0.24579663574695587 (0.24579663574695587) | > loss_0: 2.816082000732422 (2.816082000732422) | > loss_gen: 1.6077724695205688 (1.6077724695205688) | > loss_kl: 3.61421537399292 (3.61421537399292) | > loss_feat: 0.8085910677909851 (0.8085910677909851) | > loss_mel: 17.32203483581543 (17.32203483581543) | > loss_duration: 2.6176533699035645 (2.6176533699035645) | > loss_1: 25.970266342163086 (25.970266342163086)  --> STEP: 2 | > loss_disc: 1.2353764772415161 (2.025729238986969) | > loss_disc_real_0: 0.035487376153469086 (0.10456569120287895) | > loss_disc_real_1: 0.07710912823677063 (0.15182798355817795) | > loss_disc_real_2: 0.18952178955078125 (0.17847618460655212) | > loss_disc_real_3: 0.031025070697069168 (0.17256748117506504) | > loss_disc_real_4: 0.05063553899526596 (0.15913913771510124) | > loss_disc_real_5: 0.10652681440114975 (0.1761617250740528) | > loss_0: 1.2353764772415161 (2.025729238986969) | > loss_gen: 3.333406925201416 (2.4705896973609924) | > loss_kl: 3.6842377185821533 (3.6492265462875366) | > loss_feat: 14.628372192382812 (7.718481630086899) | > loss_mel: 25.663480758666992 (21.49275779724121) | > loss_duration: 2.5944466590881348 (2.6060500144958496) | > loss_1: 49.90394592285156 (37.937106132507324)  --> STEP: 3 | > loss_disc: 2.9758009910583496 (2.3424198230107627) | > loss_disc_real_0: 0.25532594323158264 (0.15481910854578018) | > loss_disc_real_1: 0.26011067628860474 (0.18792221446832022) | > loss_disc_real_2: 0.2227574735879898 (0.19323661426703134) | > loss_disc_real_3: 0.3049183785915375 (0.21668444698055586) | > loss_disc_real_4: 0.25029098987579346 (0.18952308843533197) | > loss_disc_real_5: 0.235707089304924 (0.19601017981767654) | > loss_0: 2.9758009910583496 (2.3424198230107627) | > loss_gen: 1.562817096710205 (2.1679988304773965) | > loss_kl: 1.9334962368011475 (3.0773164431254068) | > loss_feat: 0.0942203551530838 (5.17706120510896) | > loss_mel: 2.8428518772125244 (15.276122490564982) | > loss_duration: 2.5355710983276367 (2.582557042439779) | > loss_1: 8.968955993652344 (28.281056086222332) --> EVAL PERFORMANCE | > avg_loader_time: 0.03009772300720215 (+0.021225770314534508) | > avg_loss_disc: 2.3424198230107627 (-0.21021421750386526) | > avg_loss_disc_real_0: 0.15481910854578018 (+0.028745800256729126) | > avg_loss_disc_real_1: 0.18792221446832022 (+0.007733787099520384) | > avg_loss_disc_real_2: 0.19323661426703134 (-0.037180850903193174) | > avg_loss_disc_real_3: 0.21668444698055586 (-0.09795340771476427) | > avg_loss_disc_real_4: 0.18952308843533197 (+0.022378745178381593) | > avg_loss_disc_real_5: 0.19601017981767654 (+0.05819867054621378) | > avg_loss_0: 2.3424198230107627 (-0.21021421750386526) | > avg_loss_gen: 2.1679988304773965 (+0.25075630346933986) | > avg_loss_kl: 3.0773164431254068 (+0.3846499522527056) | > avg_loss_feat: 5.17706120510896 (-0.9566838294267654) | > avg_loss_mel: 15.276122490564982 (-8.954727093378702) | > avg_loss_duration: 2.582557042439779 (+0.04800581932067871) | > avg_loss_1: 28.281056086222332 (-9.227997461954754)  > EPOCH: 317/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:07:33)   --> TIME: 2023-10-20 03:07:53 -- STEP: 29/50 -- GLOBAL_STEP: 68880 | > loss_disc: 2.372070550918579 (2.437676643503123) | > loss_disc_real_0: 0.20953693985939026 (0.1373485000482921) | > loss_disc_real_1: 0.18098147213459015 (0.2727499026162871) | > loss_disc_real_2: 0.12455838173627853 (0.23031583710991102) | > loss_disc_real_3: 0.20338031649589539 (0.24521875458544698) | > loss_disc_real_4: 0.09399744868278503 (0.21133717509179278) | > loss_disc_real_5: 0.12887363135814667 (0.23315030503375778) | > loss_0: 2.372070550918579 (2.437676643503123) | > grad_norm_0: tensor(422.8140, device='cuda:0') (tensor(501.5683, device='cuda:0')) | > loss_gen: 1.8577572107315063 (2.5437345998040555) | > loss_kl: 0.9221494197845459 (0.9199979997657496) | > loss_feat: 2.9254515171051025 (5.813586411034239) | > loss_mel: 21.795616149902344 (24.05916796881577) | > loss_duration: 1.5234144926071167 (1.5867137045695865) | > loss_1: 29.024389266967773 (34.92320070595576) | > grad_norm_1: tensor(4312.0063, device='cuda:0') (tensor(28186.7441, device='cuda:0')) | > current_lr_0: 0.0001456632648025785 | > current_lr_1: 0.0001456632648025785 | > step_time: 0.3056 (0.509435168628035) | > loader_time: 0.0251 (0.017503228680840855)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6229217052459717 (2.6229217052459717) | > loss_disc_real_0: 0.3216226398944855 (0.3216226398944855) | > loss_disc_real_1: 0.27923327684402466 (0.27923327684402466) | > loss_disc_real_2: 0.1942390501499176 (0.1942390501499176) | > loss_disc_real_3: 0.19889886677265167 (0.19889886677265167) | > loss_disc_real_4: 0.23896272480487823 (0.23896272480487823) | > loss_disc_real_5: 0.35793206095695496 (0.35793206095695496) | > loss_0: 2.6229217052459717 (2.6229217052459717) | > loss_gen: 2.4415805339813232 (2.4415805339813232) | > loss_kl: 3.378713607788086 (3.378713607788086) | > loss_feat: 4.141209602355957 (4.141209602355957) | > loss_mel: 24.016197204589844 (24.016197204589844) | > loss_duration: 2.325878858566284 (2.325878858566284) | > loss_1: 36.30358123779297 (36.30358123779297)  --> STEP: 1 | > loss_disc: 2.547433853149414 (2.547433853149414) | > loss_disc_real_0: 0.23917809128761292 (0.23917809128761292) | > loss_disc_real_1: 0.2793169915676117 (0.2793169915676117) | > loss_disc_real_2: 0.2960515320301056 (0.2960515320301056) | > loss_disc_real_3: 0.1609014868736267 (0.1609014868736267) | > loss_disc_real_4: 0.22421690821647644 (0.22421690821647644) | > loss_disc_real_5: 0.40962883830070496 (0.40962883830070496) | > loss_0: 2.547433853149414 (2.547433853149414) | > loss_gen: 2.6786086559295654 (2.6786086559295654) | > loss_kl: 2.8189263343811035 (2.8189263343811035) | > loss_feat: 6.25659704208374 (6.25659704208374) | > loss_mel: 27.41731834411621 (27.41731834411621) | > loss_duration: 2.580944538116455 (2.580944538116455) | > loss_1: 41.75239562988281 (41.75239562988281)  --> STEP: 2 | > loss_disc: 1.4039303064346313 (1.9756820797920227) | > loss_disc_real_0: 0.18060746788978577 (0.20989277958869934) | > loss_disc_real_1: 0.08200234174728394 (0.18065966665744781) | > loss_disc_real_2: 0.10178560763597488 (0.19891856983304024) | > loss_disc_real_3: 0.13390162587165833 (0.14740155637264252) | > loss_disc_real_4: 0.1797809898853302 (0.20199894905090332) | > loss_disc_real_5: 0.14669393002986908 (0.278161384165287) | > loss_0: 1.4039303064346313 (1.9756820797920227) | > loss_gen: 3.1506853103637695 (2.9146469831466675) | > loss_kl: 3.4005236625671387 (3.109724998474121) | > loss_feat: 9.288476943969727 (7.772536993026733) | > loss_mel: 26.906147003173828 (27.16173267364502) | > loss_duration: 2.499725580215454 (2.5403350591659546) | > loss_1: 45.24555587768555 (43.49897575378418)  --> STEP: 3 | > loss_disc: 2.8864340782165527 (2.279266079266866) | > loss_disc_real_0: 0.18127144873142242 (0.20035233596960703) | > loss_disc_real_1: 0.37317657470703125 (0.2448319693406423) | > loss_disc_real_2: 0.3190854489803314 (0.23897419621547064) | > loss_disc_real_3: 0.29487383365631104 (0.19655898213386536) | > loss_disc_real_4: 0.3190438747406006 (0.2410139242808024) | > loss_disc_real_5: 0.28802892565727234 (0.2814505646626155) | > loss_0: 2.8864340782165527 (2.279266079266866) | > loss_gen: 2.2464208602905273 (2.6919049421946206) | > loss_kl: 1.740235686302185 (2.6532285610834756) | > loss_feat: 2.896357774734497 (6.147143920262654) | > loss_mel: 23.513790130615234 (25.945751825968426) | > loss_duration: 2.503690481185913 (2.528120199839274) | > loss_1: 32.90049362182617 (39.966148376464844) --> EVAL PERFORMANCE | > avg_loader_time: 0.006224870681762695 (-0.023872852325439453) | > avg_loss_disc: 2.279266079266866 (-0.06315374374389648) | > avg_loss_disc_real_0: 0.20035233596960703 (+0.045533227423826844) | > avg_loss_disc_real_1: 0.2448319693406423 (+0.05690975487232208) | > avg_loss_disc_real_2: 0.23897419621547064 (+0.0457375819484393) | > avg_loss_disc_real_3: 0.19655898213386536 (-0.020125464846690505) | > avg_loss_disc_real_4: 0.2410139242808024 (+0.05149083584547043) | > avg_loss_disc_real_5: 0.2814505646626155 (+0.08544038484493893) | > avg_loss_0: 2.279266079266866 (-0.06315374374389648) | > avg_loss_gen: 2.6919049421946206 (+0.5239061117172241) | > avg_loss_kl: 2.6532285610834756 (-0.42408788204193115) | > avg_loss_feat: 6.147143920262654 (+0.9700827151536942) | > avg_loss_mel: 25.945751825968426 (+10.669629335403444) | > avg_loss_duration: 2.528120199839274 (-0.05443684260050485) | > avg_loss_1: 39.966148376464844 (+11.685092290242512)  > EPOCH: 318/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:08:15)   --> TIME: 2023-10-20 03:08:22 -- STEP: 9/50 -- GLOBAL_STEP: 68910 | > loss_disc: 2.7276127338409424 (2.284595489501953) | > loss_disc_real_0: 0.20871217548847198 (0.20034156636231476) | > loss_disc_real_1: 0.3831900954246521 (0.2271821772058805) | > loss_disc_real_2: 0.3590533435344696 (0.20899735473924214) | > loss_disc_real_3: 0.35805636644363403 (0.23935413857301077) | > loss_disc_real_4: 0.34601011872291565 (0.19261396593517727) | > loss_disc_real_5: 0.4047004282474518 (0.21250655274424288) | > loss_0: 2.7276127338409424 (2.284595489501953) | > grad_norm_0: tensor(457.5594, device='cuda:0') (tensor(450.9344, device='cuda:0')) | > loss_gen: 2.895991325378418 (2.615727318657769) | > loss_kl: 1.1056466102600098 (0.9765517512957255) | > loss_feat: 3.1274681091308594 (6.222357696957058) | > loss_mel: 24.848045349121094 (23.715816709730362) | > loss_duration: 1.5382707118988037 (1.5773038334316678) | > loss_1: 33.515419006347656 (35.10775799221463) | > grad_norm_1: tensor(5850.0659, device='cuda:0') (tensor(11080.0781, device='cuda:0')) | > current_lr_0: 0.0001455176652495248 | > current_lr_1: 0.0001455176652495248 | > step_time: 0.2806 (0.28974586062961155) | > loader_time: 0.004 (0.0036931302812364367)  --> TIME: 2023-10-20 03:08:37 -- STEP: 39/50 -- GLOBAL_STEP: 68940 | > loss_disc: 2.6867446899414062 (2.524473074154976) | > loss_disc_real_0: 0.21282988786697388 (0.18896673591091082) | > loss_disc_real_1: 0.22119079530239105 (0.23030397849969375) | > loss_disc_real_2: 0.16830867528915405 (0.22672863323719072) | > loss_disc_real_3: 0.28129661083221436 (0.25173489157205975) | > loss_disc_real_4: 0.4905918836593628 (0.2520184140556898) | > loss_disc_real_5: 0.4118916392326355 (0.2663086297897957) | > loss_0: 2.6867446899414062 (2.524473074154976) | > grad_norm_0: tensor(502.1189, device='cuda:0') (tensor(544.4662, device='cuda:0')) | > loss_gen: 2.257779598236084 (2.376385899690481) | > loss_kl: 0.7738332152366638 (0.9452306414261843) | > loss_feat: 2.965507745742798 (5.252927598280785) | > loss_mel: 24.766122817993164 (22.286148138535324) | > loss_duration: 1.5864635705947876 (1.560228155209468) | > loss_1: 32.349708557128906 (32.42092054318159) | > grad_norm_1: tensor(10377.0273, device='cuda:0') (tensor(14502.5645, device='cuda:0')) | > current_lr_0: 0.0001455176652495248 | > current_lr_1: 0.0001455176652495248 | > step_time: 0.5855 (0.45136215136601376) | > loader_time: 0.0246 (0.010423067288521009)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.805537223815918 (2.805537223815918) | > loss_disc_real_0: 0.4384647607803345 (0.4384647607803345) | > loss_disc_real_1: 0.19020241498947144 (0.19020241498947144) | > loss_disc_real_2: 0.2903195023536682 (0.2903195023536682) | > loss_disc_real_3: 0.2950177490711212 (0.2950177490711212) | > loss_disc_real_4: 0.2688591182231903 (0.2688591182231903) | > loss_disc_real_5: 0.23686404526233673 (0.23686404526233673) | > loss_0: 2.805537223815918 (2.805537223815918) | > loss_gen: 2.2590622901916504 (2.2590622901916504) | > loss_kl: 3.7634565830230713 (3.7634565830230713) | > loss_feat: 6.611225128173828 (6.611225128173828) | > loss_mel: 20.516172409057617 (20.516172409057617) | > loss_duration: 2.5121283531188965 (2.5121283531188965) | > loss_1: 35.662044525146484 (35.662044525146484)  --> STEP: 1 | > loss_disc: 2.773097038269043 (2.773097038269043) | > loss_disc_real_0: 0.14784622192382812 (0.14784622192382812) | > loss_disc_real_1: 0.2945125102996826 (0.2945125102996826) | > loss_disc_real_2: 0.3539462387561798 (0.3539462387561798) | > loss_disc_real_3: 0.2642778158187866 (0.2642778158187866) | > loss_disc_real_4: 0.34096890687942505 (0.34096890687942505) | > loss_disc_real_5: 0.28230029344558716 (0.28230029344558716) | > loss_0: 2.773097038269043 (2.773097038269043) | > loss_gen: 2.198904514312744 (2.198904514312744) | > loss_kl: 3.559706926345825 (3.559706926345825) | > loss_feat: 8.152649879455566 (8.152649879455566) | > loss_mel: 25.761852264404297 (25.761852264404297) | > loss_duration: 2.689063787460327 (2.689063787460327) | > loss_1: 42.362178802490234 (42.362178802490234)  --> STEP: 2 | > loss_disc: 2.797369956970215 (2.785233497619629) | > loss_disc_real_0: 0.019650910049676895 (0.08374856598675251) | > loss_disc_real_1: 0.3234425485134125 (0.30897752940654755) | > loss_disc_real_2: 0.27662333846092224 (0.315284788608551) | > loss_disc_real_3: 0.30189618468284607 (0.28308700025081635) | > loss_disc_real_4: 0.23474186658859253 (0.2878553867340088) | > loss_disc_real_5: 0.2636171281337738 (0.2729587107896805) | > loss_0: 2.797369956970215 (2.785233497619629) | > loss_gen: 1.7105852365493774 (1.9547448754310608) | > loss_kl: 3.5416955947875977 (3.5507012605667114) | > loss_feat: 1.8909406661987305 (5.021795272827148) | > loss_mel: 24.384973526000977 (25.073412895202637) | > loss_duration: 2.6510531902313232 (2.670058488845825) | > loss_1: 34.17924880981445 (38.270713806152344)  --> STEP: 3 | > loss_disc: 3.0386807918548584 (2.869715929031372) | > loss_disc_real_0: 0.14344440400600433 (0.10364717865983646) | > loss_disc_real_1: 0.37160491943359375 (0.3298533260822296) | > loss_disc_real_2: 0.30892327427864075 (0.31316428383191425) | > loss_disc_real_3: 0.33875760436058044 (0.30164386828740436) | > loss_disc_real_4: 0.3557621240615845 (0.3104909658432007) | > loss_disc_real_5: 0.3678869903087616 (0.3046014706293742) | > loss_0: 3.0386807918548584 (2.869715929031372) | > loss_gen: 2.080650568008423 (1.9967134396235149) | > loss_kl: 1.817191481590271 (2.9728646675745645) | > loss_feat: 3.405318021774292 (4.482969522476196) | > loss_mel: 25.401275634765625 (25.182700475056965) | > loss_duration: 2.458407163619995 (2.599508047103882) | > loss_1: 35.162845611572266 (37.23475774129232) --> EVAL PERFORMANCE | > avg_loader_time: 0.012994050979614258 (+0.0067691802978515625) | > avg_loss_disc: 2.869715929031372 (+0.5904498497645059) | > avg_loss_disc_real_0: 0.10364717865983646 (-0.09670515730977057) | > avg_loss_disc_real_1: 0.3298533260822296 (+0.08502135674158731) | > avg_loss_disc_real_2: 0.31316428383191425 (+0.0741900876164436) | > avg_loss_disc_real_3: 0.30164386828740436 (+0.105084886153539) | > avg_loss_disc_real_4: 0.3104909658432007 (+0.06947704156239828) | > avg_loss_disc_real_5: 0.3046014706293742 (+0.023150905966758728) | > avg_loss_0: 2.869715929031372 (+0.5904498497645059) | > avg_loss_gen: 1.9967134396235149 (-0.6951915025711057) | > avg_loss_kl: 2.9728646675745645 (+0.31963610649108887) | > avg_loss_feat: 4.482969522476196 (-1.664174397786458) | > avg_loss_mel: 25.182700475056965 (-0.7630513509114607) | > avg_loss_duration: 2.599508047103882 (+0.0713878472646079) | > avg_loss_1: 37.23475774129232 (-2.7313906351725237)  > EPOCH: 319/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:08:53)   --> TIME: 2023-10-20 03:09:07 -- STEP: 19/50 -- GLOBAL_STEP: 68970 | > loss_disc: 2.7161900997161865 (2.518943748976055) | > loss_disc_real_0: 0.06574732065200806 (0.1846988587395141) | > loss_disc_real_1: 0.2401496022939682 (0.21624266179768661) | > loss_disc_real_2: 0.21666429936885834 (0.24295102608831307) | > loss_disc_real_3: 0.24143731594085693 (0.26506100281288747) | > loss_disc_real_4: 0.26162612438201904 (0.2444687707251624) | > loss_disc_real_5: 0.2506963908672333 (0.2811836914012307) | > loss_0: 2.7161900997161865 (2.518943748976055) | > grad_norm_0: tensor(1064.2753, device='cuda:0') (tensor(657.6475, device='cuda:0')) | > loss_gen: 1.6714155673980713 (2.3988654425269678) | > loss_kl: 0.9483404755592346 (1.020595161538375) | > loss_feat: 0.989314615726471 (5.331622760546835) | > loss_mel: 14.291397094726562 (23.832238749453897) | > loss_duration: 1.7197864055633545 (1.6200698614120483) | > loss_1: 19.62025260925293 (34.203392129195365) | > grad_norm_1: tensor(6040.5571, device='cuda:0') (tensor(10604.4189, device='cuda:0')) | > current_lr_0: 0.00014537221123234024 | > current_lr_1: 0.00014537221123234024 | > step_time: 0.3632 (0.48116537144309596) | > loader_time: 0.0028 (0.01974705645912572)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7087817192077637 (2.7087817192077637) | > loss_disc_real_0: 0.1836256980895996 (0.1836256980895996) | > loss_disc_real_1: 0.24858984351158142 (0.24858984351158142) | > loss_disc_real_2: 0.22295589745044708 (0.22295589745044708) | > loss_disc_real_3: 0.2629605829715729 (0.2629605829715729) | > loss_disc_real_4: 0.26704496145248413 (0.26704496145248413) | > loss_disc_real_5: 0.24312736093997955 (0.24312736093997955) | > loss_0: 2.7087817192077637 (2.7087817192077637) | > loss_gen: 1.7623087167739868 (1.7623087167739868) | > loss_kl: 3.437920570373535 (3.437920570373535) | > loss_feat: 0.923916220664978 (0.923916220664978) | > loss_mel: 20.66172981262207 (20.66172981262207) | > loss_duration: 2.4224026203155518 (2.4224026203155518) | > loss_1: 29.20827865600586 (29.20827865600586)  --> STEP: 1 | > loss_disc: 2.9797863960266113 (2.9797863960266113) | > loss_disc_real_0: 0.2823525071144104 (0.2823525071144104) | > loss_disc_real_1: 0.2698545455932617 (0.2698545455932617) | > loss_disc_real_2: 0.2762503921985626 (0.2762503921985626) | > loss_disc_real_3: 0.26668837666511536 (0.26668837666511536) | > loss_disc_real_4: 0.28320276737213135 (0.28320276737213135) | > loss_disc_real_5: 0.2850407660007477 (0.2850407660007477) | > loss_0: 2.9797863960266113 (2.9797863960266113) | > loss_gen: 1.7012429237365723 (1.7012429237365723) | > loss_kl: 3.4838039875030518 (3.4838039875030518) | > loss_feat: 0.08891548216342926 (0.08891548216342926) | > loss_mel: 10.926405906677246 (10.926405906677246) | > loss_duration: 2.602938652038574 (2.602938652038574) | > loss_1: 18.803306579589844 (18.803306579589844)  --> STEP: 2 | > loss_disc: 2.9987869262695312 (2.9892866611480713) | > loss_disc_real_0: 0.2769738435745239 (0.27966317534446716) | > loss_disc_real_1: 0.2695609927177429 (0.2697077691555023) | > loss_disc_real_2: 0.27641761302948 (0.2763340026140213) | > loss_disc_real_3: 0.2665491998195648 (0.2666187882423401) | > loss_disc_real_4: 0.2830198407173157 (0.2831113040447235) | > loss_disc_real_5: 0.28510576486587524 (0.28507326543331146) | > loss_0: 2.9987869262695312 (2.9892866611480713) | > loss_gen: 1.6699559688568115 (1.685599446296692) | > loss_kl: 3.442700147628784 (3.463252067565918) | > loss_feat: 0.03956398740410805 (0.06423973478376865) | > loss_mel: 1.531897783279419 (6.2291518449783325) | > loss_duration: 2.6179540157318115 (2.610446333885193) | > loss_1: 9.302072525024414 (14.052689552307129)  --> STEP: 3 | > loss_disc: 2.832976818084717 (2.937183380126953) | > loss_disc_real_0: 0.2095796912908554 (0.25630201399326324) | > loss_disc_real_1: 0.22060804069042206 (0.2533411930004756) | > loss_disc_real_2: 0.17897191643714905 (0.24387997388839722) | > loss_disc_real_3: 0.27609342336654663 (0.26977699995040894) | > loss_disc_real_4: 0.27454814314842224 (0.28025691707928974) | > loss_disc_real_5: 0.25096753239631653 (0.27370468775431317) | > loss_0: 2.832976818084717 (2.937183380126953) | > loss_gen: 1.6074013710021973 (1.659533421198527) | > loss_kl: 1.7385197877883911 (2.8883413076400757) | > loss_feat: 1.222542405128479 (0.4503406248986721) | > loss_mel: 20.615034103393555 (11.02444593111674) | > loss_duration: 2.528841495513916 (2.583244721094767) | > loss_1: 27.712337493896484 (18.605905532836914)  --> TIME: 2023-10-20 03:09:24 -- STEP: 49/50 -- GLOBAL_STEP: 69000 | > loss_disc: 2.3287079334259033 (2.4591512144828322) | > loss_disc_real_0: 0.034972529858350754 (0.16777952087624945) | > loss_disc_real_1: 0.2547956705093384 (0.2144254888502919) | > loss_disc_real_2: 0.12783201038837433 (0.2144239145730223) | > loss_disc_real_3: 0.3178968131542206 (0.24356503556577533) | > loss_disc_real_4: 0.18101076781749725 (0.21493536165478277) | > loss_disc_real_5: 0.21941135823726654 (0.22188889288476538) | > loss_0: 2.3287079334259033 (2.4591512144828322) | > grad_norm_0: tensor(655.0109, device='cuda:0') (tensor(640.9130, device='cuda:0')) | > loss_gen: 2.4446959495544434 (2.294661570568474) | > loss_kl: 0.5925623774528503 (0.9307182390166788) | > loss_feat: 6.242259502410889 (5.377425338540759) | > loss_mel: 26.104896545410156 (22.682391227508077) | > loss_duration: 1.6363377571105957 (1.5594382772640305) | > loss_1: 37.020751953125 (32.84463456212258) | > grad_norm_1: tensor(26610.1113, device='cuda:0') (tensor(15004.8730, device='cuda:0')) | > current_lr_0: 0.00014537221123234024 | > current_lr_1: 0.00014537221123234024 | > step_time: 0.5987 (0.41679638745833414) | > loader_time: 5.5096 (0.12565805960674675) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_69000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5691075325012207 (2.84516441822052) | > loss_disc_real_0: 0.3275640904903412 (0.27411753311753273) | > loss_disc_real_1: 0.2663370966911316 (0.25659016892313957) | > loss_disc_real_2: 0.30033591389656067 (0.2579939588904381) | > loss_disc_real_3: 0.2778049111366272 (0.2717839777469635) | > loss_disc_real_4: 0.3953545093536377 (0.30903131514787674) | > loss_disc_real_5: 0.2546429932117462 (0.2689392641186714) | > loss_0: 2.5691075325012207 (2.84516441822052) | > loss_gen: 2.8778743743896484 (1.9641186594963074) | > loss_kl: 3.05301833152771 (2.9295105636119843) | > loss_feat: 5.745996952056885 (1.7742547066882253) | > loss_mel: 22.759571075439453 (13.958227217197418) | > loss_duration: 2.4306859970092773 (2.5451050400733948) | > loss_1: 36.867149353027344 (23.17121648788452)  --> STEP: 1 | > loss_disc: 2.9985952377319336 (2.8758505821228026) | > loss_disc_real_0: 0.2765609622001648 (0.2746062189340591) | > loss_disc_real_1: 0.26842495799064636 (0.25895712673664095) | > loss_disc_real_2: 0.29220300912857056 (0.2648357689380646) | > loss_disc_real_3: 0.2683817148208618 (0.2711035251617432) | > loss_disc_real_4: 0.28172963857650757 (0.3035709798336029) | > loss_disc_real_5: 0.28958559036254883 (0.2730685293674469) | > loss_0: 2.9985952377319336 (2.8758505821228026) | > loss_gen: 1.6923749446868896 (1.9097699165344237) | > loss_kl: 3.6143486499786377 (3.0664781808853148) | > loss_feat: 0.04774666950106621 (1.4289530992507935) | > loss_mel: 5.9990339279174805 (12.36638855934143) | > loss_duration: 2.699004888534546 (2.575885009765625) | > loss_1: 14.052509307861328 (21.347475051879883)  --> STEP: 2 | > loss_disc: 2.265650987625122 (2.7741506497065225) | > loss_disc_real_0: 0.11375097930431366 (0.24779701232910156) | > loss_disc_real_1: 0.20543694496154785 (0.2500370964407921) | > loss_disc_real_2: 0.2292589694261551 (0.2589063023527463) | > loss_disc_real_3: 0.27734053134918213 (0.272143026192983) | > loss_disc_real_4: 0.19231627881526947 (0.28502852966388065) | > loss_disc_real_5: 0.3122696876525879 (0.2796020557483037) | > loss_0: 2.265650987625122 (2.7741506497065225) | > loss_gen: 2.5935630798339844 (2.023735443751017) | > loss_kl: 3.6893959045410156 (3.1702978014945984) | > loss_feat: 8.54775619506836 (2.6154202818870544) | > loss_mel: 26.214067459106445 (14.6743350426356) | > loss_duration: 2.5812582969665527 (2.5767805576324463) | > loss_1: 43.62603759765625 (25.060568809509277)  --> STEP: 3 | > loss_disc: 3.3418502807617188 (2.855250597000122) | > loss_disc_real_0: 0.2768327295780182 (0.25194497193608967) | > loss_disc_real_1: 0.26687344908714294 (0.2524422896759851) | > loss_disc_real_2: 0.5740033388137817 (0.3039201647043228) | > loss_disc_real_3: 0.2173154205083847 (0.2643105110951832) | > loss_disc_real_4: 0.45538607239723206 (0.3093653214829309) | > loss_disc_real_5: 0.6353224515914917 (0.33041925515447346) | > loss_0: 3.3418502807617188 (2.855250597000122) | > loss_gen: 2.6471993923187256 (2.112801722117833) | > loss_kl: 1.4772429466247559 (2.928432822227478) | > loss_feat: 5.48170804977417 (3.024889963013785) | > loss_mel: 28.736793518066406 (16.68325768198286) | > loss_duration: 2.5365467071533203 (2.571032864706857) | > loss_1: 40.879486083984375 (27.32041413443429) --> EVAL PERFORMANCE | > avg_loader_time: 0.3347299439566476 (+0.32173589297703337) | > avg_loss_disc: 2.855250597000122 (-0.01446533203125) | > avg_loss_disc_real_0: 0.25194497193608967 (+0.1482977932762532) | > avg_loss_disc_real_1: 0.2524422896759851 (-0.07741103640624453) | > avg_loss_disc_real_2: 0.3039201647043228 (-0.009244119127591433) | > avg_loss_disc_real_3: 0.2643105110951832 (-0.03733335719222114) | > avg_loss_disc_real_4: 0.3093653214829309 (-0.0011256443602697952) | > avg_loss_disc_real_5: 0.33041925515447346 (+0.025817784525099252) | > avg_loss_0: 2.855250597000122 (-0.01446533203125) | > avg_loss_gen: 2.112801722117833 (+0.11608828249431791) | > avg_loss_kl: 2.928432822227478 (-0.04443184534708644) | > avg_loss_feat: 3.024889963013785 (-1.4580795594624112) | > avg_loss_mel: 16.68325768198286 (-8.499442793074106) | > avg_loss_duration: 2.571032864706857 (-0.028475182397024845) | > avg_loss_1: 27.32041413443429 (-9.91434360685803)  > EPOCH: 320/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:09:40)   --> TIME: 2023-10-20 03:09:59 -- STEP: 29/50 -- GLOBAL_STEP: 69030 | > loss_disc: 2.179551124572754 (2.4473147926659418) | > loss_disc_real_0: 0.1367756575345993 (0.12967811113801495) | > loss_disc_real_1: 0.1647413671016693 (0.22602265084098125) | > loss_disc_real_2: 0.3239942491054535 (0.24360493885288975) | > loss_disc_real_3: 0.2729737162590027 (0.23633558457267695) | > loss_disc_real_4: 0.1279626041650772 (0.2345562591378031) | > loss_disc_real_5: 0.09829503297805786 (0.2564537616382385) | > loss_0: 2.179551124572754 (2.4473147926659418) | > grad_norm_0: tensor(289.7654, device='cuda:0') (tensor(474.5276, device='cuda:0')) | > loss_gen: 2.374953269958496 (2.4690391359658075) | > loss_kl: 1.1100090742111206 (0.9242571386797674) | > loss_feat: 5.432101249694824 (6.0022643437159475) | > loss_mel: 24.413434982299805 (23.645066808009968) | > loss_duration: 1.5437798500061035 (1.5768267943941314) | > loss_1: 34.8742790222168 (34.61745449592326) | > grad_norm_1: tensor(9897.5879, device='cuda:0') (tensor(19281.8008, device='cuda:0')) | > current_lr_0: 0.00014522690260555267 | > current_lr_1: 0.00014522690260555267 | > step_time: 0.5409 (0.5032795544328361) | > loader_time: 0.0229 (0.020162368642872776)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9856820106506348 (2.9856820106506348) | > loss_disc_real_0: 0.49734044075012207 (0.49734044075012207) | > loss_disc_real_1: 0.2963506877422333 (0.2963506877422333) | > loss_disc_real_2: 0.2211718112230301 (0.2211718112230301) | > loss_disc_real_3: 0.2655442953109741 (0.2655442953109741) | > loss_disc_real_4: 0.2649711072444916 (0.2649711072444916) | > loss_disc_real_5: 0.29731497168540955 (0.29731497168540955) | > loss_0: 2.9856820106506348 (2.9856820106506348) | > loss_gen: 2.185445547103882 (2.185445547103882) | > loss_kl: 3.890493631362915 (3.890493631362915) | > loss_feat: 0.7416927814483643 (0.7416927814483643) | > loss_mel: 20.866491317749023 (20.866491317749023) | > loss_duration: 2.53105092048645 (2.53105092048645) | > loss_1: 30.21517562866211 (30.21517562866211)  --> STEP: 1 | > loss_disc: 2.2798683643341064 (2.2798683643341064) | > loss_disc_real_0: 0.29490146040916443 (0.29490146040916443) | > loss_disc_real_1: 0.23817750811576843 (0.23817750811576843) | > loss_disc_real_2: 0.2982385754585266 (0.2982385754585266) | > loss_disc_real_3: 0.2221844643354416 (0.2221844643354416) | > loss_disc_real_4: 0.20478585362434387 (0.20478585362434387) | > loss_disc_real_5: 0.09038642048835754 (0.09038642048835754) | > loss_0: 2.2798683643341064 (2.2798683643341064) | > loss_gen: 2.4392716884613037 (2.4392716884613037) | > loss_kl: 4.095462322235107 (4.095462322235107) | > loss_feat: 6.910149574279785 (6.910149574279785) | > loss_mel: 24.2917423248291 (24.2917423248291) | > loss_duration: 2.675812005996704 (2.675812005996704) | > loss_1: 40.412437438964844 (40.412437438964844)  --> STEP: 2 | > loss_disc: 2.887791633605957 (2.5838299989700317) | > loss_disc_real_0: 0.23016323149204254 (0.2625323459506035) | > loss_disc_real_1: 0.28280070424079895 (0.2604891061782837) | > loss_disc_real_2: 0.36801379919052124 (0.3331261873245239) | > loss_disc_real_3: 0.3544539213180542 (0.2883191928267479) | > loss_disc_real_4: 0.29372307658195496 (0.24925446510314941) | > loss_disc_real_5: 0.30262747406959534 (0.19650694727897644) | > loss_0: 2.887791633605957 (2.5838299989700317) | > loss_gen: 2.373126983642578 (2.406199336051941) | > loss_kl: 3.3922436237335205 (3.743852972984314) | > loss_feat: 5.788671493530273 (6.349410533905029) | > loss_mel: 25.27385139465332 (24.78279685974121) | > loss_duration: 2.487778902053833 (2.5817954540252686) | > loss_1: 39.315670013427734 (39.86405372619629)  --> STEP: 3 | > loss_disc: 1.1190448999404907 (2.095568299293518) | > loss_disc_real_0: 0.027259506285190582 (0.1841080660621325) | > loss_disc_real_1: 0.09506510198116302 (0.20534777144591013) | > loss_disc_real_2: 0.11573677510023117 (0.26066304991642636) | > loss_disc_real_3: 0.009239563718438148 (0.19529264979064465) | > loss_disc_real_4: 0.021120743826031685 (0.17320989134411016) | > loss_disc_real_5: 0.02707115188241005 (0.1400283488134543) | > loss_0: 1.1190448999404907 (2.095568299293518) | > loss_gen: 2.7192721366882324 (2.510556936264038) | > loss_kl: 1.8712528944015503 (3.1196529467900596) | > loss_feat: 12.39190673828125 (8.36357593536377) | > loss_mel: 29.952829360961914 (26.506141026814777) | > loss_duration: 2.5821003913879395 (2.5818970998128257) | > loss_1: 49.51736068725586 (43.08182271321615) --> EVAL PERFORMANCE | > avg_loader_time: 0.006114006042480469 (-0.32861593791416716) | > avg_loss_disc: 2.095568299293518 (-0.759682297706604) | > avg_loss_disc_real_0: 0.1841080660621325 (-0.06783690587395716) | > avg_loss_disc_real_1: 0.20534777144591013 (-0.04709451823007496) | > avg_loss_disc_real_2: 0.26066304991642636 (-0.043257114787896456) | > avg_loss_disc_real_3: 0.19529264979064465 (-0.06901786130453857) | > avg_loss_disc_real_4: 0.17320989134411016 (-0.13615543013882073) | > avg_loss_disc_real_5: 0.1400283488134543 (-0.19039090634101916) | > avg_loss_0: 2.095568299293518 (-0.759682297706604) | > avg_loss_gen: 2.510556936264038 (+0.3977552141462053) | > avg_loss_kl: 3.1196529467900596 (+0.19122012456258153) | > avg_loss_feat: 8.36357593536377 (+5.338685972349984) | > avg_loss_mel: 26.506141026814777 (+9.822883344831919) | > avg_loss_duration: 2.5818970998128257 (+0.010864235105968678) | > avg_loss_1: 43.08182271321615 (+15.761408578781857)  > EPOCH: 321/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:10:22)   --> TIME: 2023-10-20 03:10:31 -- STEP: 9/50 -- GLOBAL_STEP: 69060 | > loss_disc: 3.1339900493621826 (2.5530860953860812) | > loss_disc_real_0: 0.10326546430587769 (0.18010058336787754) | > loss_disc_real_1: 0.32506662607192993 (0.2938733415471183) | > loss_disc_real_2: 0.3270113170146942 (0.2156442076795631) | > loss_disc_real_3: 0.275601863861084 (0.28132974604765576) | > loss_disc_real_4: 0.24713487923145294 (0.22240714935792816) | > loss_disc_real_5: 0.2578379213809967 (0.25240886956453323) | > loss_0: 3.1339900493621826 (2.5530860953860812) | > grad_norm_0: tensor(672.8624, device='cuda:0') (tensor(572.3063, device='cuda:0')) | > loss_gen: 1.5470277070999146 (2.3601121505101523) | > loss_kl: 0.910102903842926 (1.0469832685258653) | > loss_feat: 0.5148662328720093 (5.043304963244332) | > loss_mel: 4.714158535003662 (20.170538902282715) | > loss_duration: 1.559802532196045 (1.5590423478020563) | > loss_1: 9.24595832824707 (30.17998144361708) | > grad_norm_1: tensor(9272.9678, device='cuda:0') (tensor(21868.1504, device='cuda:0')) | > current_lr_0: 0.00014508173922383525 | > current_lr_1: 0.00014508173922383525 | > step_time: 0.278 (0.5225500795576308) | > loader_time: 0.0024 (0.012029409408569336)  --> TIME: 2023-10-20 03:10:46 -- STEP: 39/50 -- GLOBAL_STEP: 69090 | > loss_disc: 2.458381414413452 (2.5456112073018) | > loss_disc_real_0: 0.17135481536388397 (0.16904130114767796) | > loss_disc_real_1: 0.2667999863624573 (0.24619773412362123) | > loss_disc_real_2: 0.24490609765052795 (0.23183210452015585) | > loss_disc_real_3: 0.2275599241256714 (0.2537853136085547) | > loss_disc_real_4: 0.19685161113739014 (0.22181253474301252) | > loss_disc_real_5: 0.15707778930664062 (0.23421680650267845) | > loss_0: 2.458381414413452 (2.5456112073018) | > grad_norm_0: tensor(392.2564, device='cuda:0') (tensor(580.0828, device='cuda:0')) | > loss_gen: 2.1057610511779785 (2.2227940528820715) | > loss_kl: 0.6917230486869812 (0.9642154987041767) | > loss_feat: 2.362518787384033 (4.3978748355920505) | > loss_mel: 18.95829200744629 (19.902427893418537) | > loss_duration: 1.6111538410186768 (1.5665025252562303) | > loss_1: 25.729448318481445 (29.05381450897608) | > grad_norm_1: tensor(13232.4707, device='cuda:0') (tensor(21572.9180, device='cuda:0')) | > current_lr_0: 0.00014508173922383525 | > current_lr_1: 0.00014508173922383525 | > step_time: 0.3401 (0.4999474317599565) | > loader_time: 0.0232 (0.01667808875059471)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6926896572113037 (2.6926896572113037) | > loss_disc_real_0: 0.07433182746171951 (0.07433182746171951) | > loss_disc_real_1: 0.2283821403980255 (0.2283821403980255) | > loss_disc_real_2: 0.2003009021282196 (0.2003009021282196) | > loss_disc_real_3: 0.2693636119365692 (0.2693636119365692) | > loss_disc_real_4: 0.2837260663509369 (0.2837260663509369) | > loss_disc_real_5: 0.30081382393836975 (0.30081382393836975) | > loss_0: 2.6926896572113037 (2.6926896572113037) | > loss_gen: 1.6960824728012085 (1.6960824728012085) | > loss_kl: 3.2907495498657227 (3.2907495498657227) | > loss_feat: 1.3314950466156006 (1.3314950466156006) | > loss_mel: 17.278125762939453 (17.278125762939453) | > loss_duration: 2.3572824001312256 (2.3572824001312256) | > loss_1: 25.953737258911133 (25.953737258911133)  --> STEP: 1 | > loss_disc: 2.9671826362609863 (2.9671826362609863) | > loss_disc_real_0: 0.16856682300567627 (0.16856682300567627) | > loss_disc_real_1: 0.24996697902679443 (0.24996697902679443) | > loss_disc_real_2: 0.26846835017204285 (0.26846835017204285) | > loss_disc_real_3: 0.26556336879730225 (0.26556336879730225) | > loss_disc_real_4: 0.2822923958301544 (0.2822923958301544) | > loss_disc_real_5: 0.2976240813732147 (0.2976240813732147) | > loss_0: 2.9671826362609863 (2.9671826362609863) | > loss_gen: 1.5744372606277466 (1.5744372606277466) | > loss_kl: 3.180388927459717 (3.180388927459717) | > loss_feat: 0.25902029871940613 (0.25902029871940613) | > loss_mel: 5.980555534362793 (5.980555534362793) | > loss_duration: 2.531379461288452 (2.531379461288452) | > loss_1: 13.525781631469727 (13.525781631469727)  --> STEP: 2 | > loss_disc: 2.968412399291992 (2.9677975177764893) | > loss_disc_real_0: 0.16743698716163635 (0.1680019050836563) | > loss_disc_real_1: 0.24993766844272614 (0.24995232373476028) | > loss_disc_real_2: 0.2685745656490326 (0.2685214579105377) | > loss_disc_real_3: 0.26558372378349304 (0.26557354629039764) | > loss_disc_real_4: 0.28237608075141907 (0.28233423829078674) | > loss_disc_real_5: 0.2977178394794464 (0.29767096042633057) | > loss_0: 2.968412399291992 (2.9677975177764893) | > loss_gen: 1.572556734085083 (1.5734969973564148) | > loss_kl: 3.4769816398620605 (3.3286852836608887) | > loss_feat: 0.2578037977218628 (0.25841204822063446) | > loss_mel: 3.162224769592285 (4.571390151977539) | > loss_duration: 2.5156116485595703 (2.5234955549240112) | > loss_1: 10.98517894744873 (12.255480289459229)  --> STEP: 3 | > loss_disc: 2.348149061203003 (2.7612480322519937) | > loss_disc_real_0: 0.2034820020198822 (0.17982860406239828) | > loss_disc_real_1: 0.20473815500736237 (0.23488093415896097) | > loss_disc_real_2: 0.24642238020896912 (0.2611550986766815) | > loss_disc_real_3: 0.2518371045589447 (0.26099473237991333) | > loss_disc_real_4: 0.32593584060668945 (0.29686810572942096) | > loss_disc_real_5: 0.23075246810913086 (0.27536479632059735) | > loss_0: 2.348149061203003 (2.7612480322519937) | > loss_gen: 2.413174867630005 (1.8533896207809448) | > loss_kl: 1.6094131469726562 (2.755594571431478) | > loss_feat: 3.931560516357422 (1.4827948709328969) | > loss_mel: 20.97918701171875 (10.040655771891275) | > loss_duration: 2.4824700355529785 (2.5098203818003335) | > loss_1: 31.41580581665039 (18.642255465189617) --> EVAL PERFORMANCE | > avg_loader_time: 0.016527732213338215 (+0.010413726170857746) | > avg_loss_disc: 2.7612480322519937 (+0.6656797329584756) | > avg_loss_disc_real_0: 0.17982860406239828 (-0.004279461999734224) | > avg_loss_disc_real_1: 0.23488093415896097 (+0.029533162713050842) | > avg_loss_disc_real_2: 0.2611550986766815 (+0.0004920487602551593) | > avg_loss_disc_real_3: 0.26099473237991333 (+0.06570208258926868) | > avg_loss_disc_real_4: 0.29686810572942096 (+0.1236582143853108) | > avg_loss_disc_real_5: 0.27536479632059735 (+0.13533644750714305) | > avg_loss_0: 2.7612480322519937 (+0.6656797329584756) | > avg_loss_gen: 1.8533896207809448 (-0.6571673154830933) | > avg_loss_kl: 2.755594571431478 (-0.36405837535858154) | > avg_loss_feat: 1.4827948709328969 (-6.880781064430873) | > avg_loss_mel: 10.040655771891275 (-16.4654852549235) | > avg_loss_duration: 2.5098203818003335 (-0.07207671801249216) | > avg_loss_1: 18.642255465189617 (-24.43956724802653)  > EPOCH: 322/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:11:01)   --> TIME: 2023-10-20 03:11:13 -- STEP: 19/50 -- GLOBAL_STEP: 69120 | > loss_disc: 2.0413029193878174 (2.26670577651576) | > loss_disc_real_0: 0.08463232964277267 (0.1519795064079134) | > loss_disc_real_1: 0.1534155011177063 (0.19287089611354627) | > loss_disc_real_2: 0.09989389032125473 (0.23727265627760635) | > loss_disc_real_3: 0.21181876957416534 (0.2134800114129719) | > loss_disc_real_4: 0.11929740756750107 (0.24013439467863032) | > loss_disc_real_5: 0.10533896088600159 (0.2212379635556748) | > loss_0: 2.0413029193878174 (2.26670577651576) | > grad_norm_0: tensor(1665.7574, device='cuda:0') (tensor(517.3486, device='cuda:0')) | > loss_gen: 2.125732660293579 (2.670570687243813) | > loss_kl: 0.7992715239524841 (0.8711446570722681) | > loss_feat: 5.040308475494385 (6.137519789369483) | > loss_mel: 17.662254333496094 (22.503320593582956) | > loss_duration: 1.6720088720321655 (1.6109316160804348) | > loss_1: 27.299575805664062 (33.793487573924814) | > grad_norm_1: tensor(33003.8984, device='cuda:0') (tensor(21573.8574, device='cuda:0')) | > current_lr_0: 0.00014493672094200645 | > current_lr_1: 0.00014493672094200645 | > step_time: 0.402 (0.4294010463513826) | > loader_time: 0.0056 (0.011450491453471937)  --> TIME: 2023-10-20 03:11:28 -- STEP: 49/50 -- GLOBAL_STEP: 69150 | > loss_disc: 2.7973151206970215 (2.305008100003613) | > loss_disc_real_0: 0.42719632387161255 (0.1752066302436347) | > loss_disc_real_1: 0.3234645128250122 (0.20630037761768516) | > loss_disc_real_2: 0.21694576740264893 (0.207386243556227) | > loss_disc_real_3: 0.33375149965286255 (0.2309101303773267) | > loss_disc_real_4: 0.23848620057106018 (0.2067764044872352) | > loss_disc_real_5: 0.38394835591316223 (0.20992692356587064) | > loss_0: 2.7973151206970215 (2.305008100003613) | > grad_norm_0: tensor(586.0070, device='cuda:0') (tensor(653.9686, device='cuda:0')) | > loss_gen: 2.9209275245666504 (2.615967551056219) | > loss_kl: 1.064611792564392 (0.9638673693549876) | > loss_feat: 6.2700724601745605 (6.205914907309474) | > loss_mel: 27.397069931030273 (22.747571400233678) | > loss_duration: 1.6927142143249512 (1.5655999134997933) | > loss_1: 39.34539794921875 (34.098921551996355) | > grad_norm_1: tensor(26987.5000, device='cuda:0') (tensor(19693.5371, device='cuda:0')) | > current_lr_0: 0.00014493672094200645 | > current_lr_1: 0.00014493672094200645 | > step_time: 0.5004 (0.4370230752594617) | > loader_time: 0.5417 (0.021337475095476423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0814318656921387 (2.0814318656921387) | > loss_disc_real_0: 0.1004008948802948 (0.1004008948802948) | > loss_disc_real_1: 0.22421951591968536 (0.22421951591968536) | > loss_disc_real_2: 0.06950441002845764 (0.06950441002845764) | > loss_disc_real_3: 0.25876301527023315 (0.25876301527023315) | > loss_disc_real_4: 0.25465771555900574 (0.25465771555900574) | > loss_disc_real_5: 0.29647698998451233 (0.29647698998451233) | > loss_0: 2.0814318656921387 (2.0814318656921387) | > loss_gen: 3.040553331375122 (3.040553331375122) | > loss_kl: 3.3199832439422607 (3.3199832439422607) | > loss_feat: 9.383563041687012 (9.383563041687012) | > loss_mel: 25.378782272338867 (25.378782272338867) | > loss_duration: 2.4439690113067627 (2.4439690113067627) | > loss_1: 43.56685256958008 (43.56685256958008)  --> STEP: 1 | > loss_disc: 2.6764769554138184 (2.6764769554138184) | > loss_disc_real_0: 0.054871633648872375 (0.054871633648872375) | > loss_disc_real_1: 0.27798569202423096 (0.27798569202423096) | > loss_disc_real_2: 0.09635398536920547 (0.09635398536920547) | > loss_disc_real_3: 0.30757007002830505 (0.30757007002830505) | > loss_disc_real_4: 0.3246668577194214 (0.3246668577194214) | > loss_disc_real_5: 0.27917346358299255 (0.27917346358299255) | > loss_0: 2.6764769554138184 (2.6764769554138184) | > loss_gen: 1.9555977582931519 (1.9555977582931519) | > loss_kl: 3.4410619735717773 (3.4410619735717773) | > loss_feat: 8.836008071899414 (8.836008071899414) | > loss_mel: 25.623676300048828 (25.623676300048828) | > loss_duration: 2.633267641067505 (2.633267641067505) | > loss_1: 42.48960876464844 (42.48960876464844)  --> STEP: 2 | > loss_disc: 2.1159684658050537 (2.396222710609436) | > loss_disc_real_0: 0.23404203355312347 (0.14445683360099792) | > loss_disc_real_1: 0.21820855140686035 (0.24809712171554565) | > loss_disc_real_2: 0.22385525703430176 (0.16010462120175362) | > loss_disc_real_3: 0.19639937579631805 (0.25198472291231155) | > loss_disc_real_4: 0.11098448932170868 (0.21782567352056503) | > loss_disc_real_5: 0.21978382766246796 (0.24947864562273026) | > loss_0: 2.1159684658050537 (2.396222710609436) | > loss_gen: 2.810852289199829 (2.3832250237464905) | > loss_kl: 3.3638837337493896 (3.4024728536605835) | > loss_feat: 5.850565433502197 (7.343286752700806) | > loss_mel: 26.195911407470703 (25.909793853759766) | > loss_duration: 2.602342367172241 (2.617805004119873) | > loss_1: 40.82355499267578 (41.65658187866211)  --> STEP: 3 | > loss_disc: 2.9993789196014404 (2.5972747802734375) | > loss_disc_real_0: 0.18709158897399902 (0.15866841872533163) | > loss_disc_real_1: 0.261814683675766 (0.25266964236895245) | > loss_disc_real_2: 0.3243579566478729 (0.2148557330171267) | > loss_disc_real_3: 0.23858273029327393 (0.247517392039299) | > loss_disc_real_4: 0.24618269503116608 (0.22727801402409872) | > loss_disc_real_5: 0.17561998963356018 (0.22485909362634024) | > loss_0: 2.9993789196014404 (2.5972747802734375) | > loss_gen: 1.466890811920166 (2.077780286471049) | > loss_kl: 1.7657371759414673 (2.856894294420878) | > loss_feat: 0.09722360223531723 (4.92793236921231) | > loss_mel: 3.019824981689453 (18.279804229736328) | > loss_duration: 2.563149929046631 (2.5995866457621255) | > loss_1: 8.912826538085938 (30.74199676513672) --> EVAL PERFORMANCE | > avg_loader_time: 0.014497041702270508 (-0.002030690511067707) | > avg_loss_disc: 2.5972747802734375 (-0.16397325197855617) | > avg_loss_disc_real_0: 0.15866841872533163 (-0.02116018533706665) | > avg_loss_disc_real_1: 0.25266964236895245 (+0.017788708209991483) | > avg_loss_disc_real_2: 0.2148557330171267 (-0.04629936565955481) | > avg_loss_disc_real_3: 0.247517392039299 (-0.013477340340614319) | > avg_loss_disc_real_4: 0.22727801402409872 (-0.06959009170532224) | > avg_loss_disc_real_5: 0.22485909362634024 (-0.05050570269425711) | > avg_loss_0: 2.5972747802734375 (-0.16397325197855617) | > avg_loss_gen: 2.077780286471049 (+0.22439066569010402) | > avg_loss_kl: 2.856894294420878 (+0.10129972298939993) | > avg_loss_feat: 4.92793236921231 (+3.445137498279413) | > avg_loss_mel: 18.279804229736328 (+8.239148457845053) | > avg_loss_duration: 2.5995866457621255 (+0.08976626396179199) | > avg_loss_1: 30.74199676513672 (+12.099741299947102)  > EPOCH: 323/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:11:38)   --> TIME: 2023-10-20 03:11:57 -- STEP: 29/50 -- GLOBAL_STEP: 69180 | > loss_disc: 2.6982293128967285 (2.4855717173938094) | > loss_disc_real_0: 0.1747736930847168 (0.1679845540302581) | > loss_disc_real_1: 0.26045894622802734 (0.24613889075558762) | > loss_disc_real_2: 0.1954939365386963 (0.2236527907180375) | > loss_disc_real_3: 0.2352326661348343 (0.2402182822597438) | > loss_disc_real_4: 0.28699034452438354 (0.2208303639601017) | > loss_disc_real_5: 0.2771872580051422 (0.2126010456283031) | > loss_0: 2.6982293128967285 (2.4855717173938094) | > grad_norm_0: tensor(911.5726, device='cuda:0') (tensor(499.8452, device='cuda:0')) | > loss_gen: 1.8865070343017578 (2.304520471342679) | > loss_kl: 1.1895172595977783 (1.03064169092425) | > loss_feat: 1.2901685237884521 (4.969311789577376) | > loss_mel: 16.711885452270508 (20.353911243636034) | > loss_duration: 1.5328238010406494 (1.6022230756693874) | > loss_1: 22.61090087890625 (30.260607998946618) | > grad_norm_1: tensor(5964.0840, device='cuda:0') (tensor(19676.1719, device='cuda:0')) | > current_lr_0: 0.0001447918476150298 | > current_lr_1: 0.0001447918476150298 | > step_time: 0.284 (0.5216920046970762) | > loader_time: 0.0235 (0.018105991955461174)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6790671348571777 (2.6790671348571777) | > loss_disc_real_0: 0.4511883556842804 (0.4511883556842804) | > loss_disc_real_1: 0.22389072179794312 (0.22389072179794312) | > loss_disc_real_2: 0.31395819783210754 (0.31395819783210754) | > loss_disc_real_3: 0.2111155092716217 (0.2111155092716217) | > loss_disc_real_4: 0.25561049580574036 (0.25561049580574036) | > loss_disc_real_5: 0.2977757155895233 (0.2977757155895233) | > loss_0: 2.6790671348571777 (2.6790671348571777) | > loss_gen: 2.669243812561035 (2.669243812561035) | > loss_kl: 2.8158388137817383 (2.8158388137817383) | > loss_feat: 4.956584930419922 (4.956584930419922) | > loss_mel: 24.804683685302734 (24.804683685302734) | > loss_duration: 2.4085896015167236 (2.4085896015167236) | > loss_1: 37.654937744140625 (37.654937744140625)  --> STEP: 1 | > loss_disc: 2.437551498413086 (2.437551498413086) | > loss_disc_real_0: 0.41075289249420166 (0.41075289249420166) | > loss_disc_real_1: 0.29488876461982727 (0.29488876461982727) | > loss_disc_real_2: 0.17751866579055786 (0.17751866579055786) | > loss_disc_real_3: 0.243341326713562 (0.243341326713562) | > loss_disc_real_4: 0.33036962151527405 (0.33036962151527405) | > loss_disc_real_5: 0.22746193408966064 (0.22746193408966064) | > loss_0: 2.437551498413086 (2.437551498413086) | > loss_gen: 2.7943320274353027 (2.7943320274353027) | > loss_kl: 3.9900434017181396 (3.9900434017181396) | > loss_feat: 4.563851356506348 (4.563851356506348) | > loss_mel: 25.577573776245117 (25.577573776245117) | > loss_duration: 2.66814923286438 (2.66814923286438) | > loss_1: 39.59394836425781 (39.59394836425781)  --> STEP: 2 | > loss_disc: 2.4250941276550293 (2.4313228130340576) | > loss_disc_real_0: 0.13906900584697723 (0.27491094917058945) | > loss_disc_real_1: 0.2854096293449402 (0.29014919698238373) | > loss_disc_real_2: 0.1498536318540573 (0.1636861488223076) | > loss_disc_real_3: 0.34945592284202576 (0.2963986247777939) | > loss_disc_real_4: 0.46013548970222473 (0.3952525556087494) | > loss_disc_real_5: 0.2049407660961151 (0.21620135009288788) | > loss_0: 2.4250941276550293 (2.4313228130340576) | > loss_gen: 2.6827521324157715 (2.738542079925537) | > loss_kl: 3.2675158977508545 (3.628779649734497) | > loss_feat: 6.036327362060547 (5.300089359283447) | > loss_mel: 26.020912170410156 (25.799242973327637) | > loss_duration: 2.7139487266540527 (2.6910489797592163) | > loss_1: 40.72145462036133 (40.15770149230957)  --> STEP: 3 | > loss_disc: 3.0442118644714355 (2.6356191635131836) | > loss_disc_real_0: 0.25919920206069946 (0.26967370013395947) | > loss_disc_real_1: 0.3623049259185791 (0.31420110662778217) | > loss_disc_real_2: 0.43915432691574097 (0.25550887485345203) | > loss_disc_real_3: 0.45696935057640076 (0.34992220004399616) | > loss_disc_real_4: 0.47732025384902954 (0.4226084550221761) | > loss_disc_real_5: 0.3870610296726227 (0.2731545766194661) | > loss_0: 3.0442118644714355 (2.6356191635131836) | > loss_gen: 3.0855722427368164 (2.8542188008626304) | > loss_kl: 1.5926567316055298 (2.950072010358175) | > loss_feat: 3.9514946937561035 (4.850557804107666) | > loss_mel: 24.352834701538086 (25.31710688273112) | > loss_duration: 2.5032060146331787 (2.628434658050537) | > loss_1: 35.48576354980469 (38.600388844807945) --> EVAL PERFORMANCE | > avg_loader_time: 0.008530378341674805 (-0.005966663360595703) | > avg_loss_disc: 2.6356191635131836 (+0.038344383239746094) | > avg_loss_disc_real_0: 0.26967370013395947 (+0.11100528140862784) | > avg_loss_disc_real_1: 0.31420110662778217 (+0.061531464258829716) | > avg_loss_disc_real_2: 0.25550887485345203 (+0.04065314183632532) | > avg_loss_disc_real_3: 0.34992220004399616 (+0.10240480800469715) | > avg_loss_disc_real_4: 0.4226084550221761 (+0.19533044099807736) | > avg_loss_disc_real_5: 0.2731545766194661 (+0.04829548299312589) | > avg_loss_0: 2.6356191635131836 (+0.038344383239746094) | > avg_loss_gen: 2.8542188008626304 (+0.7764385143915815) | > avg_loss_kl: 2.950072010358175 (+0.09317771593729685) | > avg_loss_feat: 4.850557804107666 (-0.0773745651046438) | > avg_loss_mel: 25.31710688273112 (+7.037302652994793) | > avg_loss_duration: 2.628434658050537 (+0.028848012288411606) | > avg_loss_1: 38.600388844807945 (+7.858392079671226)  > EPOCH: 324/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:12:19)   --> TIME: 2023-10-20 03:12:28 -- STEP: 9/50 -- GLOBAL_STEP: 69210 | > loss_disc: 1.9035983085632324 (2.192287908660041) | > loss_disc_real_0: 0.12618160247802734 (0.13391419417328304) | > loss_disc_real_1: 0.159163236618042 (0.2101376611325476) | > loss_disc_real_2: 0.2490377575159073 (0.22442551205555597) | > loss_disc_real_3: 0.23594065010547638 (0.21548914329873192) | > loss_disc_real_4: 0.17311707139015198 (0.1920251842174265) | > loss_disc_real_5: 0.11283879727125168 (0.18972275323337978) | > loss_0: 1.9035983085632324 (2.192287908660041) | > grad_norm_0: tensor(279.3711, device='cuda:0') (tensor(390.7934, device='cuda:0')) | > loss_gen: 2.8379480838775635 (2.4708196189668445) | > loss_kl: 1.0228537321090698 (0.8532986177338494) | > loss_feat: 5.988869667053223 (6.044881443182628) | > loss_mel: 24.667285919189453 (22.341213544209797) | > loss_duration: 1.529753565788269 (1.576839632458157) | > loss_1: 36.04671096801758 (33.28705279032389) | > grad_norm_1: tensor(3994.2410, device='cuda:0') (tensor(20592.8906, device='cuda:0')) | > current_lr_0: 0.00014464711909801392 | > current_lr_1: 0.00014464711909801392 | > step_time: 1.1639 (0.5698834525214301) | > loader_time: 0.0444 (0.015360593795776367)  --> TIME: 2023-10-20 03:12:42 -- STEP: 39/50 -- GLOBAL_STEP: 69240 | > loss_disc: 2.8492445945739746 (2.4458532486206437) | > loss_disc_real_0: 0.13060897588729858 (0.1704980762054523) | > loss_disc_real_1: 0.24611273407936096 (0.22055016515346673) | > loss_disc_real_2: 0.16146112978458405 (0.22670641923562074) | > loss_disc_real_3: 0.2475615292787552 (0.24931785215934119) | > loss_disc_real_4: 0.25153231620788574 (0.21132226976064536) | > loss_disc_real_5: 0.2702067792415619 (0.2118753193376156) | > loss_0: 2.8492445945739746 (2.4458532486206437) | > grad_norm_0: tensor(738.1119, device='cuda:0') (tensor(581.8854, device='cuda:0')) | > loss_gen: 1.5052396059036255 (2.3211777363068022) | > loss_kl: 0.821807324886322 (0.8973761735818325) | > loss_feat: 0.5440400242805481 (5.14237858961599) | > loss_mel: 2.605963706970215 (20.389603486427898) | > loss_duration: 1.5862915515899658 (1.5656648446352055) | > loss_1: 7.063342094421387 (30.316200928810314) | > grad_norm_1: tensor(10636.9746, device='cuda:0') (tensor(21037.8086, device='cuda:0')) | > current_lr_0: 0.00014464711909801392 | > current_lr_1: 0.00014464711909801392 | > step_time: 0.547 (0.468425683486156) | > loader_time: 0.0247 (0.014987701024764623)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.855893850326538 (1.855893850326538) | > loss_disc_real_0: 0.128361314535141 (0.128361314535141) | > loss_disc_real_1: 0.09568513929843903 (0.09568513929843903) | > loss_disc_real_2: 0.077247753739357 (0.077247753739357) | > loss_disc_real_3: 0.09273667633533478 (0.09273667633533478) | > loss_disc_real_4: 0.09398840367794037 (0.09398840367794037) | > loss_disc_real_5: 0.020070401951670647 (0.020070401951670647) | > loss_0: 1.855893850326538 (1.855893850326538) | > loss_gen: 2.15968918800354 (2.15968918800354) | > loss_kl: 4.923905849456787 (4.923905849456787) | > loss_feat: 10.847622871398926 (10.847622871398926) | > loss_mel: 24.2840576171875 (24.2840576171875) | > loss_duration: 2.503939390182495 (2.503939390182495) | > loss_1: 44.71921920776367 (44.71921920776367)  --> STEP: 1 | > loss_disc: 2.933309555053711 (2.933309555053711) | > loss_disc_real_0: 0.3570154905319214 (0.3570154905319214) | > loss_disc_real_1: 0.34127581119537354 (0.34127581119537354) | > loss_disc_real_2: 0.3016681671142578 (0.3016681671142578) | > loss_disc_real_3: 0.2878643572330475 (0.2878643572330475) | > loss_disc_real_4: 0.27558809518814087 (0.27558809518814087) | > loss_disc_real_5: 0.30115193128585815 (0.30115193128585815) | > loss_0: 2.933309555053711 (2.933309555053711) | > loss_gen: 2.208470344543457 (2.208470344543457) | > loss_kl: 4.148731708526611 (4.148731708526611) | > loss_feat: 1.649705410003662 (1.649705410003662) | > loss_mel: 18.222349166870117 (18.222349166870117) | > loss_duration: 2.672921657562256 (2.672921657562256) | > loss_1: 28.902177810668945 (28.902177810668945)  --> STEP: 2 | > loss_disc: 2.74432110786438 (2.8388153314590454) | > loss_disc_real_0: 0.2264886200428009 (0.29175205528736115) | > loss_disc_real_1: 0.23471848666667938 (0.28799714893102646) | > loss_disc_real_2: 0.16269931197166443 (0.23218373954296112) | > loss_disc_real_3: 0.27479368448257446 (0.281329020857811) | > loss_disc_real_4: 0.23338337242603302 (0.25448573380708694) | > loss_disc_real_5: 0.3957931399345398 (0.348472535610199) | > loss_0: 2.74432110786438 (2.8388153314590454) | > loss_gen: 2.0828402042388916 (2.1456552743911743) | > loss_kl: 3.4889001846313477 (3.8188159465789795) | > loss_feat: 6.262428283691406 (3.956066846847534) | > loss_mel: 24.36574935913086 (21.29404926300049) | > loss_duration: 2.5470902919769287 (2.6100059747695923) | > loss_1: 38.747005462646484 (33.824591636657715)  --> STEP: 3 | > loss_disc: 3.0302658081054688 (2.902632157007853) | > loss_disc_real_0: 0.39456185698509216 (0.3260219891866048) | > loss_disc_real_1: 0.24496625363826752 (0.2736535171667735) | > loss_disc_real_2: 0.2839342951774597 (0.24943392475446066) | > loss_disc_real_3: 0.2705127000808716 (0.2777235805988312) | > loss_disc_real_4: 0.3207402527332306 (0.2765705734491348) | > loss_disc_real_5: 0.39088159799575806 (0.3626088897387187) | > loss_0: 3.0302658081054688 (2.902632157007853) | > loss_gen: 2.307760715484619 (2.1996904214223227) | > loss_kl: 1.4371943473815918 (3.02494208017985) | > loss_feat: 2.6220529079437256 (3.511395533879598) | > loss_mel: 18.518735885620117 (20.3689448038737) | > loss_duration: 2.44852876663208 (2.556180238723755) | > loss_1: 27.334272384643555 (31.661151885986328) --> EVAL PERFORMANCE | > avg_loader_time: 0.015202840169270834 (+0.006672461827596029) | > avg_loss_disc: 2.902632157007853 (+0.26701299349466945) | > avg_loss_disc_real_0: 0.3260219891866048 (+0.05634828905264533) | > avg_loss_disc_real_1: 0.2736535171667735 (-0.04054758946100867) | > avg_loss_disc_real_2: 0.24943392475446066 (-0.006074950098991366) | > avg_loss_disc_real_3: 0.2777235805988312 (-0.07219861944516498) | > avg_loss_disc_real_4: 0.2765705734491348 (-0.14603788157304126) | > avg_loss_disc_real_5: 0.3626088897387187 (+0.08945431311925256) | > avg_loss_0: 2.902632157007853 (+0.26701299349466945) | > avg_loss_gen: 2.1996904214223227 (-0.6545283794403076) | > avg_loss_kl: 3.02494208017985 (+0.07487006982167532) | > avg_loss_feat: 3.511395533879598 (-1.3391622702280679) | > avg_loss_mel: 20.3689448038737 (-4.948162078857422) | > avg_loss_duration: 2.556180238723755 (-0.07225441932678223) | > avg_loss_1: 31.661151885986328 (-6.939236958821617)  > EPOCH: 325/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:12:57)   --> TIME: 2023-10-20 03:13:11 -- STEP: 19/50 -- GLOBAL_STEP: 69270 | > loss_disc: 2.206796407699585 (2.563684476049323) | > loss_disc_real_0: 0.17481443285942078 (0.14383684569283536) | > loss_disc_real_1: 0.16585129499435425 (0.22478556123219037) | > loss_disc_real_2: 0.15398238599300385 (0.2300320753925725) | > loss_disc_real_3: 0.22806669771671295 (0.215997388488368) | > loss_disc_real_4: 0.28692397475242615 (0.22382737794204763) | > loss_disc_real_5: 0.29169780015945435 (0.25584829539844867) | > loss_0: 2.206796407699585 (2.563684476049323) | > grad_norm_0: tensor(413.0793, device='cuda:0') (tensor(696.5565, device='cuda:0')) | > loss_gen: 2.643110752105713 (2.2280626108771875) | > loss_kl: 0.9911071062088013 (1.0107774609013607) | > loss_feat: 4.700484275817871 (4.784081195530137) | > loss_mel: 22.003650665283203 (21.63405203819275) | > loss_duration: 1.7603888511657715 (1.6185775367837203) | > loss_1: 32.09873962402344 (31.275550440738076) | > grad_norm_1: tensor(5237.1094, device='cuda:0') (tensor(22111.5273, device='cuda:0')) | > current_lr_0: 0.00014450253524621217 | > current_lr_1: 0.00014450253524621217 | > step_time: 0.2775 (0.46930038301568283) | > loader_time: 0.0043 (0.01762272182263826)  --> TIME: 2023-10-20 03:13:24 -- STEP: 49/50 -- GLOBAL_STEP: 69300 | > loss_disc: 2.4620869159698486 (2.5125081052585525) | > loss_disc_real_0: 0.32115477323532104 (0.15881517103740153) | > loss_disc_real_1: 0.21317987143993378 (0.22867916129073318) | > loss_disc_real_2: 0.13121667504310608 (0.22247053587771193) | > loss_disc_real_3: 0.3501987159252167 (0.2447702080315473) | > loss_disc_real_4: 0.589599609375 (0.23272822987364264) | > loss_disc_real_5: 0.07414121180772781 (0.23226595198621555) | > loss_0: 2.4620869159698486 (2.5125081052585525) | > grad_norm_0: tensor(1437.1976, device='cuda:0') (tensor(698.2136, device='cuda:0')) | > loss_gen: 3.1687517166137695 (2.356525586575878) | > loss_kl: 0.459977924823761 (0.919035580693459) | > loss_feat: 6.936718940734863 (5.349918658636056) | > loss_mel: 24.690881729125977 (22.687946173609514) | > loss_duration: 1.6723541021347046 (1.5670978755367047) | > loss_1: 36.92868423461914 (32.88052375949159) | > grad_norm_1: tensor(37719.1953, device='cuda:0') (tensor(19389.9023, device='cuda:0')) | > current_lr_0: 0.00014450253524621217 | > current_lr_1: 0.00014450253524621217 | > step_time: 0.3908 (0.4344917900708256) | > loader_time: 0.4553 (0.021238993625251616)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.034964084625244 (3.034964084625244) | > loss_disc_real_0: 0.34386464953422546 (0.34386464953422546) | > loss_disc_real_1: 0.29479122161865234 (0.29479122161865234) | > loss_disc_real_2: 0.08638806641101837 (0.08638806641101837) | > loss_disc_real_3: 0.3016265034675598 (0.3016265034675598) | > loss_disc_real_4: 0.21000869572162628 (0.21000869572162628) | > loss_disc_real_5: 0.31603822112083435 (0.31603822112083435) | > loss_0: 3.034964084625244 (3.034964084625244) | > loss_gen: 1.6195298433303833 (1.6195298433303833) | > loss_kl: 3.5254054069519043 (3.5254054069519043) | > loss_feat: 0.3413601219654083 (0.3413601219654083) | > loss_mel: 2.7527551651000977 (2.7527551651000977) | > loss_duration: 2.3943369388580322 (2.3943369388580322) | > loss_1: 10.633387565612793 (10.633387565612793)  --> STEP: 1 | > loss_disc: 2.808797597885132 (2.808797597885132) | > loss_disc_real_0: 0.2975947856903076 (0.2975947856903076) | > loss_disc_real_1: 0.2827606201171875 (0.2827606201171875) | > loss_disc_real_2: 0.2241167277097702 (0.2241167277097702) | > loss_disc_real_3: 0.40048399567604065 (0.40048399567604065) | > loss_disc_real_4: 0.3800804615020752 (0.3800804615020752) | > loss_disc_real_5: 0.34117963910102844 (0.34117963910102844) | > loss_0: 2.808797597885132 (2.808797597885132) | > loss_gen: 2.679194211959839 (2.679194211959839) | > loss_kl: 3.4126474857330322 (3.4126474857330322) | > loss_feat: 5.745346546173096 (5.745346546173096) | > loss_mel: 23.79103660583496 (23.79103660583496) | > loss_duration: 2.5674357414245605 (2.5674357414245605) | > loss_1: 38.19566345214844 (38.19566345214844)  --> STEP: 2 | > loss_disc: 1.7970446348190308 (2.3029211163520813) | > loss_disc_real_0: 0.15986567735671997 (0.2287302315235138) | > loss_disc_real_1: 0.24700313806533813 (0.2648818790912628) | > loss_disc_real_2: 0.1297876387834549 (0.17695218324661255) | > loss_disc_real_3: 0.44238901138305664 (0.42143650352954865) | > loss_disc_real_4: 0.15776574611663818 (0.2689231038093567) | > loss_disc_real_5: 0.10425449162721634 (0.2227170653641224) | > loss_0: 1.7970446348190308 (2.3029211163520813) | > loss_gen: 3.1518096923828125 (2.9155019521713257) | > loss_kl: 4.35941743850708 (3.886032462120056) | > loss_feat: 6.86273193359375 (6.304039239883423) | > loss_mel: 26.188373565673828 (24.989705085754395) | > loss_duration: 2.5389435291290283 (2.5531896352767944) | > loss_1: 43.10127639770508 (40.64846992492676)  --> STEP: 3 | > loss_disc: 2.990565061569214 (2.532135764757792) | > loss_disc_real_0: 0.38472598791122437 (0.280728816986084) | > loss_disc_real_1: 0.3664347231388092 (0.29873282710711163) | > loss_disc_real_2: 0.30292725563049316 (0.2189438740412394) | > loss_disc_real_3: 0.2897827923297882 (0.3775519331296285) | > loss_disc_real_4: 0.5314991474151611 (0.3564484516779582) | > loss_disc_real_5: 0.22386164963245392 (0.22309859345356622) | > loss_0: 2.990565061569214 (2.532135764757792) | > loss_gen: 2.529326915740967 (2.7867769400278726) | > loss_kl: 2.002518653869629 (3.2581945260365806) | > loss_feat: 4.309017658233643 (5.639032046000163) | > loss_mel: 27.558717727661133 (25.84604263305664) | > loss_duration: 2.4356513023376465 (2.514010190963745) | > loss_1: 38.83523178100586 (40.04405721028646) --> EVAL PERFORMANCE | > avg_loader_time: 0.011020024617513021 (-0.0041828155517578125) | > avg_loss_disc: 2.532135764757792 (-0.37049639225006104) | > avg_loss_disc_real_0: 0.280728816986084 (-0.045293172200520815) | > avg_loss_disc_real_1: 0.29873282710711163 (+0.025079309940338135) | > avg_loss_disc_real_2: 0.2189438740412394 (-0.03049005071322125) | > avg_loss_disc_real_3: 0.3775519331296285 (+0.0998283525307973) | > avg_loss_disc_real_4: 0.3564484516779582 (+0.07987787822882336) | > avg_loss_disc_real_5: 0.22309859345356622 (-0.13951029628515246) | > avg_loss_0: 2.532135764757792 (-0.37049639225006104) | > avg_loss_gen: 2.7867769400278726 (+0.5870865186055498) | > avg_loss_kl: 3.2581945260365806 (+0.23325244585673044) | > avg_loss_feat: 5.639032046000163 (+2.127636512120565) | > avg_loss_mel: 25.84604263305664 (+5.4770978291829415) | > avg_loss_duration: 2.514010190963745 (-0.042170047760009766) | > avg_loss_1: 40.04405721028646 (+8.382905324300133)  > EPOCH: 326/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:13:35)   --> TIME: 2023-10-20 03:13:55 -- STEP: 29/50 -- GLOBAL_STEP: 69330 | > loss_disc: 2.4219284057617188 (2.4838266783747174) | > loss_disc_real_0: 0.0927736759185791 (0.1670962540625498) | > loss_disc_real_1: 0.20982155203819275 (0.23166569926101585) | > loss_disc_real_2: 0.23433800041675568 (0.2434151140523368) | > loss_disc_real_3: 0.3571504056453705 (0.24708373793240251) | > loss_disc_real_4: 0.1737661212682724 (0.2463943737334219) | > loss_disc_real_5: 0.3964058458805084 (0.232719494222567) | > loss_0: 2.4219284057617188 (2.4838266783747174) | > grad_norm_0: tensor(280.6444, device='cuda:0') (tensor(512.8638, device='cuda:0')) | > loss_gen: 2.7171342372894287 (2.3346946239471436) | > loss_kl: 0.8554934859275818 (0.973319425665099) | > loss_feat: 5.566594123840332 (5.242256996575101) | > loss_mel: 23.442399978637695 (22.46176711444197) | > loss_duration: 1.5449038743972778 (1.587700103891307) | > loss_1: 34.126522064208984 (32.59973815391804) | > grad_norm_1: tensor(8500.5859, device='cuda:0') (tensor(17710.8730, device='cuda:0')) | > current_lr_0: 0.0001443580959150226 | > current_lr_1: 0.0001443580959150226 | > step_time: 0.6839 (0.5056284542741446) | > loader_time: 0.0242 (0.019613923697636045)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.937337875366211 (2.937337875366211) | > loss_disc_real_0: 0.2550974488258362 (0.2550974488258362) | > loss_disc_real_1: 0.25699514150619507 (0.25699514150619507) | > loss_disc_real_2: 0.3014529049396515 (0.3014529049396515) | > loss_disc_real_3: 0.3107796311378479 (0.3107796311378479) | > loss_disc_real_4: 0.18805019557476044 (0.18805019557476044) | > loss_disc_real_5: 0.290449857711792 (0.290449857711792) | > loss_0: 2.937337875366211 (2.937337875366211) | > loss_gen: 1.7424933910369873 (1.7424933910369873) | > loss_kl: 3.9915239810943604 (3.9915239810943604) | > loss_feat: 0.49352139234542847 (0.49352139234542847) | > loss_mel: 19.878128051757812 (19.878128051757812) | > loss_duration: 2.375011444091797 (2.375011444091797) | > loss_1: 28.48067855834961 (28.48067855834961)  --> STEP: 1 | > loss_disc: 3.0327835083007812 (3.0327835083007812) | > loss_disc_real_0: 0.4134250581264496 (0.4134250581264496) | > loss_disc_real_1: 0.242126926779747 (0.242126926779747) | > loss_disc_real_2: 0.3391846716403961 (0.3391846716403961) | > loss_disc_real_3: 0.28621533513069153 (0.28621533513069153) | > loss_disc_real_4: 0.2503979802131653 (0.2503979802131653) | > loss_disc_real_5: 0.3298385441303253 (0.3298385441303253) | > loss_0: 3.0327835083007812 (3.0327835083007812) | > loss_gen: 2.2485713958740234 (2.2485713958740234) | > loss_kl: 3.7240512371063232 (3.7240512371063232) | > loss_feat: 2.984131336212158 (2.984131336212158) | > loss_mel: 22.52665901184082 (22.52665901184082) | > loss_duration: 2.5822322368621826 (2.5822322368621826) | > loss_1: 34.065643310546875 (34.065643310546875)  --> STEP: 2 | > loss_disc: 3.005876302719116 (3.0193299055099487) | > loss_disc_real_0: 0.2597702741622925 (0.33659766614437103) | > loss_disc_real_1: 0.2427143156528473 (0.24242062121629715) | > loss_disc_real_2: 0.3113853335380554 (0.32528500258922577) | > loss_disc_real_3: 0.31295400857925415 (0.29958467185497284) | > loss_disc_real_4: 0.17191952466964722 (0.21115875244140625) | > loss_disc_real_5: 0.2832765281200409 (0.3065575361251831) | > loss_0: 3.005876302719116 (3.0193299055099487) | > loss_gen: 1.6236861944198608 (1.9361287951469421) | > loss_kl: 3.5404670238494873 (3.6322591304779053) | > loss_feat: 0.16322332620620728 (1.5736773312091827) | > loss_mel: 2.7669458389282227 (12.646802425384521) | > loss_duration: 2.6179230213165283 (2.6000776290893555) | > loss_1: 10.712244987487793 (22.388944149017334)  --> STEP: 3 | > loss_disc: 2.531367063522339 (2.856675624847412) | > loss_disc_real_0: 0.0922849029302597 (0.2551600784063339) | > loss_disc_real_1: 0.2550733983516693 (0.24663821359475455) | > loss_disc_real_2: 0.23936623334884644 (0.2966454128424327) | > loss_disc_real_3: 0.25915777683258057 (0.2861090401808421) | > loss_disc_real_4: 0.2548658847808838 (0.22572779655456543) | > loss_disc_real_5: 0.36190634965896606 (0.3250071406364441) | > loss_0: 2.531367063522339 (2.856675624847412) | > loss_gen: 2.115156888961792 (1.9958048264185588) | > loss_kl: 2.091109275817871 (3.118542512257894) | > loss_feat: 2.2868525981903076 (1.811402420202891) | > loss_mel: 18.85032081604004 (14.714641888936361) | > loss_duration: 2.3871099948883057 (2.5290884176890054) | > loss_1: 27.730548858642578 (24.16947905222575) --> EVAL PERFORMANCE | > avg_loader_time: 0.003588596979777018 (-0.007431427637736004) | > avg_loss_disc: 2.856675624847412 (+0.3245398600896201) | > avg_loss_disc_real_0: 0.2551600784063339 (-0.02556873857975006) | > avg_loss_disc_real_1: 0.24663821359475455 (-0.052094613512357085) | > avg_loss_disc_real_2: 0.2966454128424327 (+0.07770153880119327) | > avg_loss_disc_real_3: 0.2861090401808421 (-0.09144289294878638) | > avg_loss_disc_real_4: 0.22572779655456543 (-0.13072065512339276) | > avg_loss_disc_real_5: 0.3250071406364441 (+0.10190854718287787) | > avg_loss_0: 2.856675624847412 (+0.3245398600896201) | > avg_loss_gen: 1.9958048264185588 (-0.7909721136093137) | > avg_loss_kl: 3.118542512257894 (-0.13965201377868652) | > avg_loss_feat: 1.811402420202891 (-3.8276296257972717) | > avg_loss_mel: 14.714641888936361 (-11.13140074412028) | > avg_loss_duration: 2.5290884176890054 (+0.015078226725260269) | > avg_loss_1: 24.16947905222575 (-15.87457815806071)  > EPOCH: 327/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:14:16)   --> TIME: 2023-10-20 03:14:24 -- STEP: 9/50 -- GLOBAL_STEP: 69360 | > loss_disc: 2.852180004119873 (2.3107328944736056) | > loss_disc_real_0: 0.20661963522434235 (0.11204688540763325) | > loss_disc_real_1: 0.2609107792377472 (0.20191452983352873) | > loss_disc_real_2: 0.3382226228713989 (0.2182603453596433) | > loss_disc_real_3: 0.3331841230392456 (0.21173256801234352) | > loss_disc_real_4: 0.2216571420431137 (0.18737723429997763) | > loss_disc_real_5: 0.3170492351055145 (0.18877017125487328) | > loss_0: 2.852180004119873 (2.3107328944736056) | > grad_norm_0: tensor(289.6951, device='cuda:0') (tensor(498.5851, device='cuda:0')) | > loss_gen: 1.9182257652282715 (2.500894202126397) | > loss_kl: 0.6762239336967468 (0.831412179602517) | > loss_feat: 0.612545907497406 (6.720820029576619) | > loss_mel: 18.62622833251953 (24.28638415866428) | > loss_duration: 1.520707130432129 (1.5753075414233737) | > loss_1: 23.353931427001953 (35.914817598130966) | > grad_norm_1: tensor(3448.0593, device='cuda:0') (tensor(19965.6914, device='cuda:0')) | > current_lr_0: 0.0001442138009599878 | > current_lr_1: 0.0001442138009599878 | > step_time: 0.4276 (0.38250790701972115) | > loader_time: 0.0104 (0.011133829752604166)  --> TIME: 2023-10-20 03:14:40 -- STEP: 39/50 -- GLOBAL_STEP: 69390 | > loss_disc: 2.033212661743164 (2.3438101181617146) | > loss_disc_real_0: 0.059181224554777145 (0.16060092739569834) | > loss_disc_real_1: 0.226461261510849 (0.20705179564463785) | > loss_disc_real_2: 0.10476220399141312 (0.2108274034391611) | > loss_disc_real_3: 0.2771979570388794 (0.24573341919443545) | > loss_disc_real_4: 0.15171930193901062 (0.2121877068032821) | > loss_disc_real_5: 0.11639568954706192 (0.20621381532878447) | > loss_0: 2.033212661743164 (2.3438101181617146) | > grad_norm_0: tensor(715.7557, device='cuda:0') (tensor(559.9876, device='cuda:0')) | > loss_gen: 2.3059275150299072 (2.488893530307672) | > loss_kl: 0.5652905106544495 (0.8858908498898531) | > loss_feat: 5.236867904663086 (6.2679433937256155) | > loss_mel: 20.289976119995117 (23.816498016699768) | > loss_duration: 1.6195569038391113 (1.5803108368164454) | > loss_1: 30.01761817932129 (35.03953626828316) | > grad_norm_1: tensor(22908.5195, device='cuda:0') (tensor(19155.3359, device='cuda:0')) | > current_lr_0: 0.0001442138009599878 | > current_lr_1: 0.0001442138009599878 | > step_time: 0.3096 (0.4865417113670936) | > loader_time: 0.025 (0.01599226853786371)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.036437511444092 (3.036437511444092) | > loss_disc_real_0: 0.29576194286346436 (0.29576194286346436) | > loss_disc_real_1: 0.37680160999298096 (0.37680160999298096) | > loss_disc_real_2: 0.18289770185947418 (0.18289770185947418) | > loss_disc_real_3: 0.2884102761745453 (0.2884102761745453) | > loss_disc_real_4: 0.2709028124809265 (0.2709028124809265) | > loss_disc_real_5: 0.34898701310157776 (0.34898701310157776) | > loss_0: 3.036437511444092 (3.036437511444092) | > loss_gen: 1.7933177947998047 (1.7933177947998047) | > loss_kl: 3.8346211910247803 (3.8346211910247803) | > loss_feat: 0.21934078633785248 (0.21934078633785248) | > loss_mel: 15.068997383117676 (15.068997383117676) | > loss_duration: 2.4964823722839355 (2.4964823722839355) | > loss_1: 23.41275978088379 (23.41275978088379)  --> STEP: 1 | > loss_disc: 2.7660083770751953 (2.7660083770751953) | > loss_disc_real_0: 0.3667568862438202 (0.3667568862438202) | > loss_disc_real_1: 0.24063172936439514 (0.24063172936439514) | > loss_disc_real_2: 0.2132696509361267 (0.2132696509361267) | > loss_disc_real_3: 0.27246391773223877 (0.27246391773223877) | > loss_disc_real_4: 0.20336249470710754 (0.20336249470710754) | > loss_disc_real_5: 0.07872632145881653 (0.07872632145881653) | > loss_0: 2.7660083770751953 (2.7660083770751953) | > loss_gen: 1.9169337749481201 (1.9169337749481201) | > loss_kl: 3.3334972858428955 (3.3334972858428955) | > loss_feat: 5.867457866668701 (5.867457866668701) | > loss_mel: 27.6645450592041 (27.6645450592041) | > loss_duration: 2.62060546875 (2.62060546875) | > loss_1: 41.40304183959961 (41.40304183959961)  --> STEP: 2 | > loss_disc: 2.1276400089263916 (2.4468241930007935) | > loss_disc_real_0: 0.1971069872379303 (0.28193193674087524) | > loss_disc_real_1: 0.1646285355091095 (0.20263013243675232) | > loss_disc_real_2: 0.23227590322494507 (0.2227727770805359) | > loss_disc_real_3: 0.2735053300857544 (0.2729846239089966) | > loss_disc_real_4: 0.14018039405345917 (0.17177144438028336) | > loss_disc_real_5: 0.13690020143985748 (0.107813261449337) | > loss_0: 2.1276400089263916 (2.4468241930007935) | > loss_gen: 3.4771549701690674 (2.6970443725585938) | > loss_kl: 3.2840194702148438 (3.3087583780288696) | > loss_feat: 9.110554695129395 (7.489006280899048) | > loss_mel: 22.153919219970703 (24.909232139587402) | > loss_duration: 2.635352611541748 (2.627979040145874) | > loss_1: 40.6609992980957 (41.032020568847656)  --> STEP: 3 | > loss_disc: 2.8569767475128174 (2.5835417111714682) | > loss_disc_real_0: 0.25120294094085693 (0.27168893814086914) | > loss_disc_real_1: 0.40223678946495056 (0.26916568477948505) | > loss_disc_real_2: 0.33141687512397766 (0.2589874764283498) | > loss_disc_real_3: 0.31072431802749634 (0.2855645219484965) | > loss_disc_real_4: 0.3313414454460144 (0.22496144473552704) | > loss_disc_real_5: 0.36623260378837585 (0.19395304222901663) | > loss_0: 2.8569767475128174 (2.5835417111714682) | > loss_gen: 2.404430866241455 (2.5995065371195474) | > loss_kl: 1.7130199670791626 (2.7768455743789673) | > loss_feat: 1.4546171426773071 (5.477543234825134) | > loss_mel: 21.0557918548584 (23.624752044677734) | > loss_duration: 2.5531208515167236 (2.6030263106028237) | > loss_1: 29.180980682373047 (37.08167394002279) --> EVAL PERFORMANCE | > avg_loader_time: 0.0061388810475667315 (+0.0025502840677897134) | > avg_loss_disc: 2.5835417111714682 (-0.27313391367594386) | > avg_loss_disc_real_0: 0.27168893814086914 (+0.016528859734535217) | > avg_loss_disc_real_1: 0.26916568477948505 (+0.022527471184730502) | > avg_loss_disc_real_2: 0.2589874764283498 (-0.03765793641408288) | > avg_loss_disc_real_3: 0.2855645219484965 (-0.0005445182323455811) | > avg_loss_disc_real_4: 0.22496144473552704 (-0.0007663518190383911) | > avg_loss_disc_real_5: 0.19395304222901663 (-0.13105409840742746) | > avg_loss_0: 2.5835417111714682 (-0.27313391367594386) | > avg_loss_gen: 2.5995065371195474 (+0.6037017107009885) | > avg_loss_kl: 2.7768455743789673 (-0.34169693787892674) | > avg_loss_feat: 5.477543234825134 (+3.666140814622243) | > avg_loss_mel: 23.624752044677734 (+8.910110155741373) | > avg_loss_duration: 2.6030263106028237 (+0.07393789291381836) | > avg_loss_1: 37.08167394002279 (+12.912194887797039)  > EPOCH: 328/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:14:56)   --> TIME: 2023-10-20 03:15:09 -- STEP: 19/50 -- GLOBAL_STEP: 69420 | > loss_disc: 2.39347767829895 (2.60732901096344) | > loss_disc_real_0: 0.3101568818092346 (0.17992338244067996) | > loss_disc_real_1: 0.2899642884731293 (0.2683630640569486) | > loss_disc_real_2: 0.3236581087112427 (0.26104722603371266) | > loss_disc_real_3: 0.25770658254623413 (0.27469928562641144) | > loss_disc_real_4: 0.2712688446044922 (0.24618335303507352) | > loss_disc_real_5: 0.16112284362316132 (0.23792725076016627) | > loss_0: 2.39347767829895 (2.60732901096344) | > grad_norm_0: tensor(472.6068, device='cuda:0') (tensor(484.6997, device='cuda:0')) | > loss_gen: 2.7393579483032227 (2.3121785176427743) | > loss_kl: 1.2041460275650024 (1.0037832166019238) | > loss_feat: 5.257386207580566 (4.092792082774012) | > loss_mel: 26.428674697875977 (19.939639631070587) | > loss_duration: 1.665546178817749 (1.6208815951096385) | > loss_1: 37.295108795166016 (28.9692745961641) | > grad_norm_1: tensor(20027.8105, device='cuda:0') (tensor(20957.2559, device='cuda:0')) | > current_lr_0: 0.00014406965023679475 | > current_lr_1: 0.00014406965023679475 | > step_time: 0.3317 (0.44037552883750514) | > loader_time: 0.0036 (0.0167798870488217)  --> TIME: 2023-10-20 03:15:22 -- STEP: 49/50 -- GLOBAL_STEP: 69450 | > loss_disc: 2.6396737098693848 (2.4268303477034276) | > loss_disc_real_0: 0.1082833781838417 (0.15044591602470195) | > loss_disc_real_1: 0.3025965094566345 (0.2360837485413162) | > loss_disc_real_2: 0.26104700565338135 (0.2216558021550276) | > loss_disc_real_3: 0.25580894947052 (0.2351906241811052) | > loss_disc_real_4: 0.4422401189804077 (0.21946135284949322) | > loss_disc_real_5: 0.3329378068447113 (0.21583565391067946) | > loss_0: 2.6396737098693848 (2.4268303477034276) | > grad_norm_0: tensor(364.1154, device='cuda:0') (tensor(494.6745, device='cuda:0')) | > loss_gen: 2.251197338104248 (2.4157179594039917) | > loss_kl: 0.9898787140846252 (0.954270461384131) | > loss_feat: 2.145808219909668 (5.3916900528937) | > loss_mel: 19.804555892944336 (22.52025161957254) | > loss_duration: 1.7607605457305908 (1.5729409821179448) | > loss_1: 26.95220184326172 (32.854871195189816) | > grad_norm_1: tensor(7982.0913, device='cuda:0') (tensor(19242.4746, device='cuda:0')) | > current_lr_0: 0.00014406965023679475 | > current_lr_1: 0.00014406965023679475 | > step_time: 0.3986 (0.41998145045066365) | > loader_time: 0.464 (0.021564347403390065)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.711387872695923 (2.711387872695923) | > loss_disc_real_0: 0.18702268600463867 (0.18702268600463867) | > loss_disc_real_1: 0.32736724615097046 (0.32736724615097046) | > loss_disc_real_2: 0.31554317474365234 (0.31554317474365234) | > loss_disc_real_3: 0.24141807854175568 (0.24141807854175568) | > loss_disc_real_4: 0.22176896035671234 (0.22176896035671234) | > loss_disc_real_5: 0.21296590566635132 (0.21296590566635132) | > loss_0: 2.711387872695923 (2.711387872695923) | > loss_gen: 2.0246827602386475 (2.0246827602386475) | > loss_kl: 3.329617977142334 (3.329617977142334) | > loss_feat: 2.7892749309539795 (2.7892749309539795) | > loss_mel: 19.83780288696289 (19.83780288696289) | > loss_duration: 2.409031391143799 (2.409031391143799) | > loss_1: 30.390409469604492 (30.390409469604492)  --> STEP: 1 | > loss_disc: 3.3019189834594727 (3.3019189834594727) | > loss_disc_real_0: 0.4593542814254761 (0.4593542814254761) | > loss_disc_real_1: 0.466037780046463 (0.466037780046463) | > loss_disc_real_2: 0.5151281356811523 (0.5151281356811523) | > loss_disc_real_3: 0.3597438335418701 (0.3597438335418701) | > loss_disc_real_4: 0.6418555974960327 (0.6418555974960327) | > loss_disc_real_5: 0.3463171124458313 (0.3463171124458313) | > loss_0: 3.3019189834594727 (3.3019189834594727) | > loss_gen: 3.686490058898926 (3.686490058898926) | > loss_kl: 3.3031983375549316 (3.3031983375549316) | > loss_feat: 5.9154052734375 (5.9154052734375) | > loss_mel: 23.74693489074707 (23.74693489074707) | > loss_duration: 2.5926055908203125 (2.5926055908203125) | > loss_1: 39.244632720947266 (39.244632720947266)  --> STEP: 2 | > loss_disc: 2.7073702812194824 (3.0046446323394775) | > loss_disc_real_0: 0.17108458280563354 (0.3152194321155548) | > loss_disc_real_1: 0.258442759513855 (0.362240269780159) | > loss_disc_real_2: 0.23308683931827545 (0.3741074874997139) | > loss_disc_real_3: 0.22430795431137085 (0.2920258939266205) | > loss_disc_real_4: 0.26380109786987305 (0.4528283476829529) | > loss_disc_real_5: 0.1813494712114334 (0.26383329182863235) | > loss_0: 2.7073702812194824 (3.0046446323394775) | > loss_gen: 1.9379745721817017 (2.8122323155403137) | > loss_kl: 3.676466941833496 (3.489832639694214) | > loss_feat: 3.4440648555755615 (4.679735064506531) | > loss_mel: 25.465478897094727 (24.6062068939209) | > loss_duration: 2.588024139404297 (2.5903148651123047) | > loss_1: 37.11200714111328 (38.17831993103027)  --> STEP: 3 | > loss_disc: 2.8114280700683594 (2.940239111582438) | > loss_disc_real_0: 0.10509705543518066 (0.24517863988876343) | > loss_disc_real_1: 0.30211248993873596 (0.34219767649968463) | > loss_disc_real_2: 0.33312925696372986 (0.36044807732105255) | > loss_disc_real_3: 0.24665363132953644 (0.27690180639425915) | > loss_disc_real_4: 0.40444818139076233 (0.43670162558555603) | > loss_disc_real_5: 0.39308783411979675 (0.3069181392590205) | > loss_0: 2.8114280700683594 (2.940239111582438) | > loss_gen: 2.2702698707580566 (2.6315781672795615) | > loss_kl: 2.0399985313415527 (3.00655460357666) | > loss_feat: 1.9364242553710938 (3.7652981281280518) | > loss_mel: 19.368986129760742 (22.860466639200848) | > loss_duration: 2.4333300590515137 (2.5379865964253745) | > loss_1: 28.049009323120117 (34.80188306172689) --> EVAL PERFORMANCE | > avg_loader_time: 0.0023882389068603516 (-0.00375064214070638) | > avg_loss_disc: 2.940239111582438 (+0.35669740041096976) | > avg_loss_disc_real_0: 0.24517863988876343 (-0.026510298252105713) | > avg_loss_disc_real_1: 0.34219767649968463 (+0.07303199172019958) | > avg_loss_disc_real_2: 0.36044807732105255 (+0.10146060089270276) | > avg_loss_disc_real_3: 0.27690180639425915 (-0.008662715554237366) | > avg_loss_disc_real_4: 0.43670162558555603 (+0.211740180850029) | > avg_loss_disc_real_5: 0.3069181392590205 (+0.11296509703000387) | > avg_loss_0: 2.940239111582438 (+0.35669740041096976) | > avg_loss_gen: 2.6315781672795615 (+0.03207163016001413) | > avg_loss_kl: 3.00655460357666 (+0.22970902919769287) | > avg_loss_feat: 3.7652981281280518 (-1.7122451066970825) | > avg_loss_mel: 22.860466639200848 (-0.7642854054768868) | > avg_loss_duration: 2.5379865964253745 (-0.06503971417744925) | > avg_loss_1: 34.80188306172689 (-2.2797908782958984)  > EPOCH: 329/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:15:34)   --> TIME: 2023-10-20 03:15:53 -- STEP: 29/50 -- GLOBAL_STEP: 69480 | > loss_disc: 1.9363398551940918 (2.5109447857429243) | > loss_disc_real_0: 0.13390697538852692 (0.15168423953883606) | > loss_disc_real_1: 0.10894404351711273 (0.2294401320917853) | > loss_disc_real_2: 0.09043632447719574 (0.21646986619151873) | > loss_disc_real_3: 0.13561870157718658 (0.24130872637033463) | > loss_disc_real_4: 0.06341353803873062 (0.20508374838993468) | > loss_disc_real_5: 0.1265127807855606 (0.2392234252444629) | > loss_0: 1.9363398551940918 (2.5109447857429243) | > grad_norm_0: tensor(574.0810, device='cuda:0') (tensor(511.1755, device='cuda:0')) | > loss_gen: 2.590921401977539 (2.434896526665523) | > loss_kl: 1.0586060285568237 (0.9592510996193722) | > loss_feat: 10.880614280700684 (5.870628364898008) | > loss_mel: 25.195451736450195 (20.84722493845841) | > loss_duration: 1.5330913066864014 (1.5783929742615799) | > loss_1: 41.25868606567383 (31.690393678073224) | > grad_norm_1: tensor(17212.2402, device='cuda:0') (tensor(29352.2051, device='cuda:0')) | > current_lr_0: 0.00014392564360127475 | > current_lr_1: 0.00014392564360127475 | > step_time: 0.5377 (0.4951822593294341) | > loader_time: 0.0177 (0.020017549909394368)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9824063777923584 (2.9824063777923584) | > loss_disc_real_0: 0.04603685066103935 (0.04603685066103935) | > loss_disc_real_1: 0.2463158518075943 (0.2463158518075943) | > loss_disc_real_2: 0.25842106342315674 (0.25842106342315674) | > loss_disc_real_3: 0.3219420909881592 (0.3219420909881592) | > loss_disc_real_4: 0.2872922122478485 (0.2872922122478485) | > loss_disc_real_5: 0.28729474544525146 (0.28729474544525146) | > loss_0: 2.9824063777923584 (2.9824063777923584) | > loss_gen: 1.6065365076065063 (1.6065365076065063) | > loss_kl: 4.016394138336182 (4.016394138336182) | > loss_feat: 1.9608595371246338 (1.9608595371246338) | > loss_mel: 16.542539596557617 (16.542539596557617) | > loss_duration: 2.52847957611084 (2.52847957611084) | > loss_1: 26.65481185913086 (26.65481185913086)  --> STEP: 1 | > loss_disc: 2.9832894802093506 (2.9832894802093506) | > loss_disc_real_0: 0.01653270795941353 (0.01653270795941353) | > loss_disc_real_1: 0.26318150758743286 (0.26318150758743286) | > loss_disc_real_2: 0.2518172562122345 (0.2518172562122345) | > loss_disc_real_3: 0.2675763666629791 (0.2675763666629791) | > loss_disc_real_4: 0.27075010538101196 (0.27075010538101196) | > loss_disc_real_5: 0.24160023033618927 (0.24160023033618927) | > loss_0: 2.9832894802093506 (2.9832894802093506) | > loss_gen: 1.4442470073699951 (1.4442470073699951) | > loss_kl: 3.934187889099121 (3.934187889099121) | > loss_feat: 0.5649455189704895 (0.5649455189704895) | > loss_mel: 7.197079658508301 (7.197079658508301) | > loss_duration: 2.7402660846710205 (2.7402660846710205) | > loss_1: 15.880725860595703 (15.880725860595703)  --> STEP: 2 | > loss_disc: 1.1995171308517456 (2.091403305530548) | > loss_disc_real_0: 0.0779733657836914 (0.04725303687155247) | > loss_disc_real_1: 0.132124125957489 (0.19765281677246094) | > loss_disc_real_2: 0.045554377138614655 (0.14868581667542458) | > loss_disc_real_3: 0.08815574645996094 (0.17786605656147003) | > loss_disc_real_4: 0.05518561974167824 (0.1629678625613451) | > loss_disc_real_5: 0.03029036894440651 (0.1359452996402979) | > loss_0: 1.1995171308517456 (2.091403305530548) | > loss_gen: 3.337143659591675 (2.390695333480835) | > loss_kl: 3.6633832454681396 (3.7987855672836304) | > loss_feat: 13.770258903503418 (7.167602211236954) | > loss_mel: 29.293704986572266 (18.245392322540283) | > loss_duration: 2.742673397064209 (2.7414697408676147) | > loss_1: 52.80716323852539 (34.34394454956055)  --> STEP: 3 | > loss_disc: 2.687593460083008 (2.2901333570480347) | > loss_disc_real_0: 0.28329944610595703 (0.12593517328302065) | > loss_disc_real_1: 0.41804713010787964 (0.27111758788426715) | > loss_disc_real_2: 0.31233444809913635 (0.2032353604833285) | > loss_disc_real_3: 0.407720685005188 (0.25448426604270935) | > loss_disc_real_4: 0.2113562673330307 (0.17909733081857362) | > loss_disc_real_5: 0.21269004046916962 (0.16152687991658846) | > loss_0: 2.687593460083008 (2.2901333570480347) | > loss_gen: 2.6940553188323975 (2.4918153285980225) | > loss_kl: 1.7670568227767944 (3.1215426524480185) | > loss_feat: 4.886038303375244 (6.407080908616384) | > loss_mel: 24.985992431640625 (20.49225902557373) | > loss_duration: 2.517456293106079 (2.6667985916137695) | > loss_1: 36.8505973815918 (35.17949549357096) --> EVAL PERFORMANCE | > avg_loader_time: 0.006002267201741536 (+0.0036140282948811846) | > avg_loss_disc: 2.2901333570480347 (-0.6501057545344033) | > avg_loss_disc_real_0: 0.12593517328302065 (-0.11924346660574278) | > avg_loss_disc_real_1: 0.27111758788426715 (-0.07108008861541748) | > avg_loss_disc_real_2: 0.2032353604833285 (-0.15721271683772406) | > avg_loss_disc_real_3: 0.25448426604270935 (-0.022417540351549803) | > avg_loss_disc_real_4: 0.17909733081857362 (-0.25760429476698243) | > avg_loss_disc_real_5: 0.16152687991658846 (-0.14539125934243205) | > avg_loss_0: 2.2901333570480347 (-0.6501057545344033) | > avg_loss_gen: 2.4918153285980225 (-0.13976283868153905) | > avg_loss_kl: 3.1215426524480185 (+0.11498804887135838) | > avg_loss_feat: 6.407080908616384 (+2.641782780488332) | > avg_loss_mel: 20.49225902557373 (-2.368207613627117) | > avg_loss_duration: 2.6667985916137695 (+0.12881199518839503) | > avg_loss_1: 35.17949549357096 (+0.3776124318440708)  > EPOCH: 330/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:16:15)   --> TIME: 2023-10-20 03:16:24 -- STEP: 9/50 -- GLOBAL_STEP: 69510 | > loss_disc: 2.887671947479248 (2.5444277260038586) | > loss_disc_real_0: 0.37962406873703003 (0.17885517039232784) | > loss_disc_real_1: 0.30528396368026733 (0.2343307961192396) | > loss_disc_real_2: 0.4922870099544525 (0.26610219499303234) | > loss_disc_real_3: 0.3470682203769684 (0.22634349390864372) | > loss_disc_real_4: 0.34449079632759094 (0.22125367903047138) | > loss_disc_real_5: 0.3439311385154724 (0.17909727431833744) | > loss_0: 2.887671947479248 (2.5444277260038586) | > grad_norm_0: tensor(559.6953, device='cuda:0') (tensor(1292.4493, device='cuda:0')) | > loss_gen: 2.9163711071014404 (2.433872487809923) | > loss_kl: 0.9268794655799866 (0.9841580324702792) | > loss_feat: 4.089273452758789 (6.25716213716401) | > loss_mel: 23.649816513061523 (22.446993086073135) | > loss_duration: 1.554545283317566 (1.559762544102139) | > loss_1: 33.13688659667969 (33.681948026021324) | > grad_norm_1: tensor(5934.9360, device='cuda:0') (tensor(24861.7031, device='cuda:0')) | > current_lr_0: 0.00014378178090940306 | > current_lr_1: 0.00014378178090940306 | > step_time: 0.3358 (0.4774971803029378) | > loader_time: 0.0021 (0.01918768882751465)  --> TIME: 2023-10-20 03:16:39 -- STEP: 39/50 -- GLOBAL_STEP: 69540 | > loss_disc: 3.0427322387695312 (2.611235679724278) | > loss_disc_real_0: 0.14915156364440918 (0.1744820999029355) | > loss_disc_real_1: 0.21440273523330688 (0.22900665732912528) | > loss_disc_real_2: 0.29182326793670654 (0.24581391426424176) | > loss_disc_real_3: 0.20345361530780792 (0.23153035065684563) | > loss_disc_real_4: 0.2814582586288452 (0.25733694434165955) | > loss_disc_real_5: 0.2227800190448761 (0.22315693374436635) | > loss_0: 3.0427322387695312 (2.611235679724278) | > grad_norm_0: tensor(419.8041, device='cuda:0') (tensor(721.7203, device='cuda:0')) | > loss_gen: 1.4168760776519775 (2.2471418625269184) | > loss_kl: 0.8307244777679443 (0.9770930218390931) | > loss_feat: 0.020021315664052963 (4.572701463045982) | > loss_mel: 1.8100115060806274 (21.439490981591053) | > loss_duration: 1.5860464572906494 (1.556027623323294) | > loss_1: 5.663680076599121 (30.79245492739555) | > grad_norm_1: tensor(60644.7070, device='cuda:0') (tensor(20451.1816, device='cuda:0')) | > current_lr_0: 0.00014378178090940306 | > current_lr_1: 0.00014378178090940306 | > step_time: 0.5528 (0.49495265422723234) | > loader_time: 0.025 (0.017053738618508365)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.799473762512207 (2.799473762512207) | > loss_disc_real_0: 0.11427238583564758 (0.11427238583564758) | > loss_disc_real_1: 0.2698398530483246 (0.2698398530483246) | > loss_disc_real_2: 0.25087469816207886 (0.25087469816207886) | > loss_disc_real_3: 0.41814088821411133 (0.41814088821411133) | > loss_disc_real_4: 0.25315555930137634 (0.25315555930137634) | > loss_disc_real_5: 0.2944214344024658 (0.2944214344024658) | > loss_0: 2.799473762512207 (2.799473762512207) | > loss_gen: 2.0168426036834717 (2.0168426036834717) | > loss_kl: 3.8779726028442383 (3.8779726028442383) | > loss_feat: 3.0878968238830566 (3.0878968238830566) | > loss_mel: 22.350025177001953 (22.350025177001953) | > loss_duration: 2.4562973976135254 (2.4562973976135254) | > loss_1: 33.78903579711914 (33.78903579711914)  --> STEP: 1 | > loss_disc: 2.5946860313415527 (2.5946860313415527) | > loss_disc_real_0: 0.05294708535075188 (0.05294708535075188) | > loss_disc_real_1: 0.330098420381546 (0.330098420381546) | > loss_disc_real_2: 0.3111725449562073 (0.3111725449562073) | > loss_disc_real_3: 0.3345940113067627 (0.3345940113067627) | > loss_disc_real_4: 0.32869982719421387 (0.32869982719421387) | > loss_disc_real_5: 0.3497699201107025 (0.3497699201107025) | > loss_0: 2.5946860313415527 (2.5946860313415527) | > loss_gen: 2.6926581859588623 (2.6926581859588623) | > loss_kl: 4.082491874694824 (4.082491874694824) | > loss_feat: 6.365356922149658 (6.365356922149658) | > loss_mel: 25.453346252441406 (25.453346252441406) | > loss_duration: 2.702411413192749 (2.702411413192749) | > loss_1: 41.2962646484375 (41.2962646484375)  --> STEP: 2 | > loss_disc: 2.318253755569458 (2.4564698934555054) | > loss_disc_real_0: 0.050217486917972565 (0.05158228613436222) | > loss_disc_real_1: 0.0839228481054306 (0.2070106342434883) | > loss_disc_real_2: 0.15126965939998627 (0.23122110217809677) | > loss_disc_real_3: 0.39391547441482544 (0.36425474286079407) | > loss_disc_real_4: 0.05959939584136009 (0.19414961151778698) | > loss_disc_real_5: 0.24662259221076965 (0.2981962561607361) | > loss_0: 2.318253755569458 (2.4564698934555054) | > loss_gen: 2.508673667907715 (2.6006659269332886) | > loss_kl: 3.3817625045776367 (3.7321271896362305) | > loss_feat: 10.587804794311523 (8.47658085823059) | > loss_mel: 26.629127502441406 (26.041236877441406) | > loss_duration: 2.669492483139038 (2.6859519481658936) | > loss_1: 45.776859283447266 (43.53656196594238)  --> STEP: 3 | > loss_disc: 1.5472965240478516 (2.153412103652954) | > loss_disc_real_0: 0.09351237118244171 (0.06555898115038872) | > loss_disc_real_1: 0.22580471634864807 (0.21327532827854156) | > loss_disc_real_2: 0.1927214413881302 (0.21838788191477457) | > loss_disc_real_3: 0.1917487382888794 (0.3067527413368225) | > loss_disc_real_4: 0.051670048385858536 (0.14665642380714417) | > loss_disc_real_5: 0.07181215286254883 (0.22273488839467367) | > loss_0: 1.5472965240478516 (2.153412103652954) | > loss_gen: 2.905113458633423 (2.7021484375) | > loss_kl: 1.7686535120010376 (3.077635963757833) | > loss_feat: 9.13027286529541 (8.694478193918863) | > loss_mel: 23.82583236694336 (25.30276870727539) | > loss_duration: 2.512533664703369 (2.6281458536783853) | > loss_1: 40.14240646362305 (42.4051767985026) --> EVAL PERFORMANCE | > avg_loader_time: 0.010235786437988281 (+0.004233519236246745) | > avg_loss_disc: 2.153412103652954 (-0.13672125339508057) | > avg_loss_disc_real_0: 0.06555898115038872 (-0.06037619213263193) | > avg_loss_disc_real_1: 0.21327532827854156 (-0.05784225960572559) | > avg_loss_disc_real_2: 0.21838788191477457 (+0.015152521431446075) | > avg_loss_disc_real_3: 0.3067527413368225 (+0.05226847529411316) | > avg_loss_disc_real_4: 0.14665642380714417 (-0.03244090701142946) | > avg_loss_disc_real_5: 0.22273488839467367 (+0.06120800847808522) | > avg_loss_0: 2.153412103652954 (-0.13672125339508057) | > avg_loss_gen: 2.7021484375 (+0.21033310890197754) | > avg_loss_kl: 3.077635963757833 (-0.04390668869018555) | > avg_loss_feat: 8.694478193918863 (+2.2873972853024798) | > avg_loss_mel: 25.30276870727539 (+4.81050968170166) | > avg_loss_duration: 2.6281458536783853 (-0.03865273793538426) | > avg_loss_1: 42.4051767985026 (+7.225681304931641)  > EPOCH: 331/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:16:54)   --> TIME: 2023-10-20 03:17:05 -- STEP: 19/50 -- GLOBAL_STEP: 69570 | > loss_disc: 2.5260236263275146 (2.444145359491047) | > loss_disc_real_0: 0.24489474296569824 (0.17364596124542386) | > loss_disc_real_1: 0.30533140897750854 (0.23473352036978068) | > loss_disc_real_2: 0.23055268824100494 (0.22187691015240393) | > loss_disc_real_3: 0.25870630145072937 (0.2481973120256474) | > loss_disc_real_4: 0.2345772534608841 (0.1713257085924086) | > loss_disc_real_5: 0.2049883008003235 (0.2352149278709763) | > loss_0: 2.5260236263275146 (2.444145359491047) | > grad_norm_0: tensor(523.8793, device='cuda:0') (tensor(485.1485, device='cuda:0')) | > loss_gen: 2.2343666553497314 (2.5331580952594153) | > loss_kl: 1.08199942111969 (0.8376188050759467) | > loss_feat: 3.5531094074249268 (5.927805669213596) | > loss_mel: 27.610645294189453 (21.935502736192) | > loss_duration: 1.6675113439559937 (1.593754818564967) | > loss_1: 36.14763259887695 (32.82784022782978) | > grad_norm_1: tensor(8345.7012, device='cuda:0') (tensor(26966.4434, device='cuda:0')) | > current_lr_0: 0.0001436380620172991 | > current_lr_1: 0.0001436380620172991 | > step_time: 0.2998 (0.3245501392766049) | > loader_time: 0.0021 (0.006479602111013312)  --> TIME: 2023-10-20 03:17:20 -- STEP: 49/50 -- GLOBAL_STEP: 69600 | > loss_disc: 1.6572906970977783 (2.4410145282745357) | > loss_disc_real_0: 0.14167030155658722 (0.16857485549182308) | > loss_disc_real_1: 0.16135936975479126 (0.22921537950026746) | > loss_disc_real_2: 0.1980874389410019 (0.2144220549309132) | > loss_disc_real_3: 0.24587491154670715 (0.24455821103587447) | > loss_disc_real_4: 0.19420145452022552 (0.21202220585273238) | > loss_disc_real_5: 0.1993684470653534 (0.2215552029713076) | > loss_0: 1.6572906970977783 (2.4410145282745357) | > grad_norm_0: tensor(661.6605, device='cuda:0') (tensor(493.0027, device='cuda:0')) | > loss_gen: 3.4269299507141113 (2.395388043656641) | > loss_kl: 1.0333501100540161 (0.8965226785869015) | > loss_feat: 6.570490837097168 (5.5072375495671) | > loss_mel: 24.566478729248047 (22.39461583264019) | > loss_duration: 1.6758524179458618 (1.5586299725941248) | > loss_1: 37.273101806640625 (32.752393995012554) | > grad_norm_1: tensor(25035.6855, device='cuda:0') (tensor(22330.9414, device='cuda:0')) | > current_lr_0: 0.0001436380620172991 | > current_lr_1: 0.0001436380620172991 | > step_time: 0.425 (0.419864693466498) | > loader_time: 0.6062 (0.022938475316884567)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7164394855499268 (2.7164394855499268) | > loss_disc_real_0: 0.09466967731714249 (0.09466967731714249) | > loss_disc_real_1: 0.17473182082176208 (0.17473182082176208) | > loss_disc_real_2: 0.2886468768119812 (0.2886468768119812) | > loss_disc_real_3: 0.30281227827072144 (0.30281227827072144) | > loss_disc_real_4: 0.2827198803424835 (0.2827198803424835) | > loss_disc_real_5: 0.15607045590877533 (0.15607045590877533) | > loss_0: 2.7164394855499268 (2.7164394855499268) | > loss_gen: 1.7481259107589722 (1.7481259107589722) | > loss_kl: 4.844258785247803 (4.844258785247803) | > loss_feat: 3.0137081146240234 (3.0137081146240234) | > loss_mel: 26.698373794555664 (26.698373794555664) | > loss_duration: 2.4774858951568604 (2.4774858951568604) | > loss_1: 38.781951904296875 (38.781951904296875)  --> STEP: 1 | > loss_disc: 2.6230337619781494 (2.6230337619781494) | > loss_disc_real_0: 0.044731296598911285 (0.044731296598911285) | > loss_disc_real_1: 0.04717768728733063 (0.04717768728733063) | > loss_disc_real_2: 0.2698102295398712 (0.2698102295398712) | > loss_disc_real_3: 0.2995426058769226 (0.2995426058769226) | > loss_disc_real_4: 0.23689301311969757 (0.23689301311969757) | > loss_disc_real_5: 0.24997474253177643 (0.24997474253177643) | > loss_0: 2.6230337619781494 (2.6230337619781494) | > loss_gen: 1.9837915897369385 (1.9837915897369385) | > loss_kl: 3.5744245052337646 (3.5744245052337646) | > loss_feat: 6.023067474365234 (6.023067474365234) | > loss_mel: 25.277896881103516 (25.277896881103516) | > loss_duration: 2.54557728767395 (2.54557728767395) | > loss_1: 39.40475845336914 (39.40475845336914)  --> STEP: 2 | > loss_disc: 2.1974563598632812 (2.4102450609207153) | > loss_disc_real_0: 0.16311976313591003 (0.10392552986741066) | > loss_disc_real_1: 0.17461436986923218 (0.1108960285782814) | > loss_disc_real_2: 0.22035521268844604 (0.24508272111415863) | > loss_disc_real_3: 0.21393537521362305 (0.2567389905452728) | > loss_disc_real_4: 0.23280063271522522 (0.2348468229174614) | > loss_disc_real_5: 0.19835330545902252 (0.22416402399539948) | > loss_0: 2.1974563598632812 (2.4102450609207153) | > loss_gen: 2.59018611907959 (2.286988854408264) | > loss_kl: 3.412564277648926 (3.493494391441345) | > loss_feat: 7.027270793914795 (6.525169134140015) | > loss_mel: 24.956172943115234 (25.117034912109375) | > loss_duration: 2.549344539642334 (2.547460913658142) | > loss_1: 40.53553771972656 (39.97014808654785)  --> STEP: 3 | > loss_disc: 2.4269304275512695 (2.415806849797567) | > loss_disc_real_0: 0.20683282613754272 (0.13822796195745468) | > loss_disc_real_1: 0.3051426112651825 (0.1756448894739151) | > loss_disc_real_2: 0.28973010182380676 (0.259965181350708) | > loss_disc_real_3: 0.28164467215538025 (0.26504088441530865) | > loss_disc_real_4: 0.2239924520254135 (0.23122869928677878) | > loss_disc_real_5: 0.12807893753051758 (0.19213566184043884) | > loss_0: 2.4269304275512695 (2.415806849797567) | > loss_gen: 2.2417917251586914 (2.2719231446584067) | > loss_kl: 1.4859626293182373 (2.824317137400309) | > loss_feat: 3.161712169647217 (5.404016812642415) | > loss_mel: 25.45152473449707 (25.22853151957194) | > loss_duration: 2.516202449798584 (2.537041425704956) | > loss_1: 34.85719299316406 (38.265829722086586) --> EVAL PERFORMANCE | > avg_loader_time: 0.0019416014353434246 (-0.008294185002644857) | > avg_loss_disc: 2.415806849797567 (+0.2623947461446128) | > avg_loss_disc_real_0: 0.13822796195745468 (+0.07266898080706596) | > avg_loss_disc_real_1: 0.1756448894739151 (-0.037630438804626465) | > avg_loss_disc_real_2: 0.259965181350708 (+0.04157729943593344) | > avg_loss_disc_real_3: 0.26504088441530865 (-0.04171185692151386) | > avg_loss_disc_real_4: 0.23122869928677878 (+0.08457227547963461) | > avg_loss_disc_real_5: 0.19213566184043884 (-0.030599226554234832) | > avg_loss_0: 2.415806849797567 (+0.2623947461446128) | > avg_loss_gen: 2.2719231446584067 (-0.4302252928415933) | > avg_loss_kl: 2.824317137400309 (-0.2533188263575239) | > avg_loss_feat: 5.404016812642415 (-3.2904613812764483) | > avg_loss_mel: 25.22853151957194 (-0.07423718770344934) | > avg_loss_duration: 2.537041425704956 (-0.09110442797342921) | > avg_loss_1: 38.265829722086586 (-4.139347076416016)  > EPOCH: 332/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:17:29)   --> TIME: 2023-10-20 03:17:51 -- STEP: 29/50 -- GLOBAL_STEP: 69630 | > loss_disc: 2.976844072341919 (2.409549285625589) | > loss_disc_real_0: 0.30916011333465576 (0.17630314855868445) | > loss_disc_real_1: 0.28111717104911804 (0.21793532564208426) | > loss_disc_real_2: 0.2965523302555084 (0.22317898787301163) | > loss_disc_real_3: 0.31107646226882935 (0.21641717876853614) | > loss_disc_real_4: 0.28815633058547974 (0.21218032338495912) | > loss_disc_real_5: 0.2249935418367386 (0.2157766176066522) | > loss_0: 2.976844072341919 (2.409549285625589) | > grad_norm_0: tensor(292.1972, device='cuda:0') (tensor(528.5449, device='cuda:0')) | > loss_gen: 1.7710449695587158 (2.357411253041234) | > loss_kl: 0.6355101466178894 (0.9510020757543629) | > loss_feat: 0.1634232997894287 (5.569961690954093) | > loss_mel: 16.25712013244629 (23.259374552759628) | > loss_duration: 1.5345286130905151 (1.5739977565304986) | > loss_1: 20.36162757873535 (33.71174707083866) | > grad_norm_1: tensor(12463.7754, device='cuda:0') (tensor(19125.8789, device='cuda:0')) | > current_lr_0: 0.00014349448678122593 | > current_lr_1: 0.00014349448678122593 | > step_time: 0.682 (0.5314188825673071) | > loader_time: 0.0247 (0.018553454300452923)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.097140312194824 (3.097140312194824) | > loss_disc_real_0: 0.04863603040575981 (0.04863603040575981) | > loss_disc_real_1: 0.27553895115852356 (0.27553895115852356) | > loss_disc_real_2: 0.27266475558280945 (0.27266475558280945) | > loss_disc_real_3: 0.29449158906936646 (0.29449158906936646) | > loss_disc_real_4: 0.2855840027332306 (0.2855840027332306) | > loss_disc_real_5: 0.24982956051826477 (0.24982956051826477) | > loss_0: 3.097140312194824 (3.097140312194824) | > loss_gen: 1.4778298139572144 (1.4778298139572144) | > loss_kl: 3.7240028381347656 (3.7240028381347656) | > loss_feat: 0.19476118683815002 (0.19476118683815002) | > loss_mel: 11.86534595489502 (11.86534595489502) | > loss_duration: 2.470439910888672 (2.470439910888672) | > loss_1: 19.732379913330078 (19.732379913330078)  --> STEP: 1 | > loss_disc: 2.379387617111206 (2.379387617111206) | > loss_disc_real_0: 0.07102236896753311 (0.07102236896753311) | > loss_disc_real_1: 0.22505517303943634 (0.22505517303943634) | > loss_disc_real_2: 0.371224582195282 (0.371224582195282) | > loss_disc_real_3: 0.35335803031921387 (0.35335803031921387) | > loss_disc_real_4: 0.18835227191448212 (0.18835227191448212) | > loss_disc_real_5: 0.24885648488998413 (0.24885648488998413) | > loss_0: 2.379387617111206 (2.379387617111206) | > loss_gen: 2.496572256088257 (2.496572256088257) | > loss_kl: 4.025229454040527 (4.025229454040527) | > loss_feat: 5.623479843139648 (5.623479843139648) | > loss_mel: 27.625385284423828 (27.625385284423828) | > loss_duration: 2.7053210735321045 (2.7053210735321045) | > loss_1: 42.47598648071289 (42.47598648071289)  --> STEP: 2 | > loss_disc: 2.2618119716644287 (2.3205997943878174) | > loss_disc_real_0: 0.12373477220535278 (0.09737857058644295) | > loss_disc_real_1: 0.10498881340026855 (0.16502199321985245) | > loss_disc_real_2: 0.2867313623428345 (0.3289779722690582) | > loss_disc_real_3: 0.21277742087841034 (0.2830677255988121) | > loss_disc_real_4: 0.12608367204666138 (0.15721797198057175) | > loss_disc_real_5: 0.05243856832385063 (0.15064752660691738) | > loss_0: 2.2618119716644287 (2.3205997943878174) | > loss_gen: 2.051508903503418 (2.2740405797958374) | > loss_kl: 3.346449613571167 (3.685839533805847) | > loss_feat: 9.291722297668457 (7.457601070404053) | > loss_mel: 27.54913330078125 (27.58725929260254) | > loss_duration: 2.5389139652252197 (2.622117519378662) | > loss_1: 44.77772903442383 (43.62685775756836)  --> STEP: 3 | > loss_disc: 3.141566753387451 (2.5942554473876953) | > loss_disc_real_0: 0.04680898040533066 (0.08052204052607219) | > loss_disc_real_1: 0.27556243538856506 (0.20186880727609) | > loss_disc_real_2: 0.2732177674770355 (0.310391237338384) | > loss_disc_real_3: 0.29446810483932495 (0.2868678520123164) | > loss_disc_real_4: 0.2856159806251526 (0.20001730819543204) | > loss_disc_real_5: 0.24958619475364685 (0.1836270826558272) | > loss_0: 3.141566753387451 (2.5942554473876953) | > loss_gen: 1.4625813961029053 (2.003554185231527) | > loss_kl: 1.3607816696166992 (2.910820245742798) | > loss_feat: 0.15137219429016113 (5.022191445032756) | > loss_mel: 4.089058876037598 (19.754525820414226) | > loss_duration: 2.5016446113586426 (2.581959883371989) | > loss_1: 9.565439224243164 (32.2730515797933) --> EVAL PERFORMANCE | > avg_loader_time: 0.010293960571289062 (+0.008352359135945639) | > avg_loss_disc: 2.5942554473876953 (+0.17844859759012843) | > avg_loss_disc_real_0: 0.08052204052607219 (-0.05770592143138249) | > avg_loss_disc_real_1: 0.20186880727609 (+0.026223917802174895) | > avg_loss_disc_real_2: 0.310391237338384 (+0.050426055987675966) | > avg_loss_disc_real_3: 0.2868678520123164 (+0.02182696759700775) | > avg_loss_disc_real_4: 0.20001730819543204 (-0.03121139109134674) | > avg_loss_disc_real_5: 0.1836270826558272 (-0.008508579184611648) | > avg_loss_0: 2.5942554473876953 (+0.17844859759012843) | > avg_loss_gen: 2.003554185231527 (-0.2683689594268799) | > avg_loss_kl: 2.910820245742798 (+0.08650310834248875) | > avg_loss_feat: 5.022191445032756 (-0.38182536760965924) | > avg_loss_mel: 19.754525820414226 (-5.474005699157715) | > avg_loss_duration: 2.581959883371989 (+0.04491845766703273) | > avg_loss_1: 32.2730515797933 (-5.9927781422932895)  > EPOCH: 333/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:18:13)   --> TIME: 2023-10-20 03:18:20 -- STEP: 9/50 -- GLOBAL_STEP: 69660 | > loss_disc: 2.785835027694702 (2.199134522014194) | > loss_disc_real_0: 0.18736685812473297 (0.1165441373984019) | > loss_disc_real_1: 0.3651648163795471 (0.2634771188928021) | > loss_disc_real_2: 0.3951870799064636 (0.2095562434858746) | > loss_disc_real_3: 0.35546669363975525 (0.26237831947704154) | > loss_disc_real_4: 0.3171054720878601 (0.2307678738401996) | > loss_disc_real_5: 0.26301413774490356 (0.1624099454945988) | > loss_0: 2.785835027694702 (2.199134522014194) | > grad_norm_0: tensor(524.4214, device='cuda:0') (tensor(508.9761, device='cuda:0')) | > loss_gen: 2.404163360595703 (2.80574803882175) | > loss_kl: 1.2453279495239258 (0.6609189179208543) | > loss_feat: 3.0886693000793457 (7.0374510536591215) | > loss_mel: 26.001920700073242 (22.969088104036118) | > loss_duration: 1.516422152519226 (1.548807077937656) | > loss_1: 34.25650405883789 (35.02201329337226) | > grad_norm_1: tensor(6931.0532, device='cuda:0') (tensor(31722.4766, device='cuda:0')) | > current_lr_0: 0.00014335105505759035 | > current_lr_1: 0.00014335105505759035 | > step_time: 0.3088 (0.33999307950337726) | > loader_time: 0.0203 (0.009047110875447592)  --> TIME: 2023-10-20 03:18:34 -- STEP: 39/50 -- GLOBAL_STEP: 69690 | > loss_disc: 2.1562469005584717 (2.3575220658228946) | > loss_disc_real_0: 0.143553227186203 (0.1419563772252355) | > loss_disc_real_1: 0.16104987263679504 (0.23593422015890098) | > loss_disc_real_2: 0.07189273089170456 (0.22408074054580468) | > loss_disc_real_3: 0.22144511342048645 (0.24012073764625264) | > loss_disc_real_4: 0.3556049168109894 (0.22792044470612055) | > loss_disc_real_5: 0.2916451096534729 (0.222068508901896) | > loss_0: 2.1562469005584717 (2.3575220658228946) | > grad_norm_0: tensor(981.9166, device='cuda:0') (tensor(513.6866, device='cuda:0')) | > loss_gen: 2.3193821907043457 (2.5187911375975) | > loss_kl: 0.5131181478500366 (0.7823211054007213) | > loss_feat: 4.612922668457031 (5.827035404550723) | > loss_mel: 22.5327205657959 (23.283497578058487) | > loss_duration: 1.5745843648910522 (1.5484777780679555) | > loss_1: 31.5527286529541 (33.96012304990721) | > grad_norm_1: tensor(15232.8887, device='cuda:0') (tensor(23253.8301, device='cuda:0')) | > current_lr_0: 0.00014335105505759035 | > current_lr_1: 0.00014335105505759035 | > step_time: 0.2767 (0.41419422932160205) | > loader_time: 0.003 (0.008799479557917668)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.998581886291504 (2.998581886291504) | > loss_disc_real_0: 0.1907900869846344 (0.1907900869846344) | > loss_disc_real_1: 0.30239248275756836 (0.30239248275756836) | > loss_disc_real_2: 0.2927711308002472 (0.2927711308002472) | > loss_disc_real_3: 0.30734631419181824 (0.30734631419181824) | > loss_disc_real_4: 0.29670438170433044 (0.29670438170433044) | > loss_disc_real_5: 0.29850801825523376 (0.29850801825523376) | > loss_0: 2.998581886291504 (2.998581886291504) | > loss_gen: 1.7369681596755981 (1.7369681596755981) | > loss_kl: 3.2818410396575928 (3.2818410396575928) | > loss_feat: 0.7731621265411377 (0.7731621265411377) | > loss_mel: 8.621145248413086 (8.621145248413086) | > loss_duration: 2.3760273456573486 (2.3760273456573486) | > loss_1: 16.78914451599121 (16.78914451599121)  --> STEP: 1 | > loss_disc: 2.3042373657226562 (2.3042373657226562) | > loss_disc_real_0: 0.16482405364513397 (0.16482405364513397) | > loss_disc_real_1: 0.19441425800323486 (0.19441425800323486) | > loss_disc_real_2: 0.34157466888427734 (0.34157466888427734) | > loss_disc_real_3: 0.3522782623767853 (0.3522782623767853) | > loss_disc_real_4: 0.09224134683609009 (0.09224134683609009) | > loss_disc_real_5: 0.14026498794555664 (0.14026498794555664) | > loss_0: 2.3042373657226562 (2.3042373657226562) | > loss_gen: 2.9344279766082764 (2.9344279766082764) | > loss_kl: 3.497123956680298 (3.497123956680298) | > loss_feat: 6.638420581817627 (6.638420581817627) | > loss_mel: 25.103574752807617 (25.103574752807617) | > loss_duration: 2.646127462387085 (2.646127462387085) | > loss_1: 40.81967544555664 (40.81967544555664)  --> STEP: 2 | > loss_disc: 2.5784506797790527 (2.4413440227508545) | > loss_disc_real_0: 0.08469051122665405 (0.12475728243589401) | > loss_disc_real_1: 0.2074454128742218 (0.20092983543872833) | > loss_disc_real_2: 0.2199483960866928 (0.2807615324854851) | > loss_disc_real_3: 0.2874085307121277 (0.3198433965444565) | > loss_disc_real_4: 0.267387717962265 (0.17981453239917755) | > loss_disc_real_5: 0.4508342146873474 (0.295549601316452) | > loss_0: 2.5784506797790527 (2.4413440227508545) | > loss_gen: 2.325388193130493 (2.6299080848693848) | > loss_kl: 3.934060573577881 (3.7155922651290894) | > loss_feat: 6.094674587249756 (6.366547584533691) | > loss_mel: 26.898954391479492 (26.001264572143555) | > loss_duration: 2.549623727798462 (2.5978755950927734) | > loss_1: 41.802703857421875 (41.31118965148926)  --> STEP: 3 | > loss_disc: 3.367098569869995 (2.749928871790568) | > loss_disc_real_0: 0.580747127532959 (0.276753897468249) | > loss_disc_real_1: 0.36956077814102173 (0.2571401496728261) | > loss_disc_real_2: 0.3615640103816986 (0.3076956917842229) | > loss_disc_real_3: 0.4197944104671478 (0.3531604011853536) | > loss_disc_real_4: 0.37748444080352783 (0.2457045018672943) | > loss_disc_real_5: 0.37213945388793945 (0.3210795521736145) | > loss_0: 3.367098569869995 (2.749928871790568) | > loss_gen: 2.8234195709228516 (2.6944119135538735) | > loss_kl: 1.6562912464141846 (3.029158592224121) | > loss_feat: 2.4112420082092285 (5.048112392425537) | > loss_mel: 18.455795288085938 (23.486108144124348) | > loss_duration: 2.463667154312134 (2.5531394481658936) | > loss_1: 27.810415267944336 (36.81093152364095) --> EVAL PERFORMANCE | > avg_loader_time: 0.017927805582682293 (+0.00763384501139323) | > avg_loss_disc: 2.749928871790568 (+0.15567342440287257) | > avg_loss_disc_real_0: 0.276753897468249 (+0.19623185694217682) | > avg_loss_disc_real_1: 0.2571401496728261 (+0.05527134239673612) | > avg_loss_disc_real_2: 0.3076956917842229 (-0.0026955455541610718) | > avg_loss_disc_real_3: 0.3531604011853536 (+0.06629254917303717) | > avg_loss_disc_real_4: 0.2457045018672943 (+0.045687193671862275) | > avg_loss_disc_real_5: 0.3210795521736145 (+0.1374524695177873) | > avg_loss_0: 2.749928871790568 (+0.15567342440287257) | > avg_loss_gen: 2.6944119135538735 (+0.6908577283223467) | > avg_loss_kl: 3.029158592224121 (+0.11833834648132324) | > avg_loss_feat: 5.048112392425537 (+0.02592094739278128) | > avg_loss_mel: 23.486108144124348 (+3.7315823237101213) | > avg_loss_duration: 2.5531394481658936 (-0.02882043520609523) | > avg_loss_1: 36.81093152364095 (+4.537879943847656)  > EPOCH: 334/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:18:48)   --> TIME: 2023-10-20 03:19:02 -- STEP: 19/50 -- GLOBAL_STEP: 69720 | > loss_disc: 2.9943737983703613 (2.4567245056754663) | > loss_disc_real_0: 0.3219289779663086 (0.160810303482178) | > loss_disc_real_1: 0.2526376247406006 (0.2373504077917651) | > loss_disc_real_2: 0.22859446704387665 (0.21703045923066766) | > loss_disc_real_3: 0.28560635447502136 (0.2231780708228287) | > loss_disc_real_4: 0.27520066499710083 (0.2340115614627537) | > loss_disc_real_5: 0.2786385118961334 (0.22073016379420696) | > loss_0: 2.9943737983703613 (2.4567245056754663) | > grad_norm_0: tensor(319.0786, device='cuda:0') (tensor(531.8112, device='cuda:0')) | > loss_gen: 1.6525187492370605 (2.3300428327761193) | > loss_kl: 1.121403694152832 (0.8659514149552897) | > loss_feat: 0.05951586738228798 (5.281833157923661) | > loss_mel: 1.6617825031280518 (21.763221477207384) | > loss_duration: 1.6887931823730469 (1.5973553908498663) | > loss_1: 6.184013843536377 (31.83840362649215) | > grad_norm_1: tensor(29579.1055, device='cuda:0') (tensor(20867.5312, device='cuda:0')) | > current_lr_0: 0.00014320776670294274 | > current_lr_1: 0.00014320776670294274 | > step_time: 0.3146 (0.4983026102969521) | > loader_time: 0.0242 (0.017548749321385435)  --> TIME: 2023-10-20 03:19:16 -- STEP: 49/50 -- GLOBAL_STEP: 69750 | > loss_disc: 2.5212149620056152 (2.481764569574473) | > loss_disc_real_0: 0.09566424787044525 (0.1594426771815942) | > loss_disc_real_1: 0.22572922706604004 (0.23238975592717834) | > loss_disc_real_2: 0.2254243791103363 (0.23003749575998103) | > loss_disc_real_3: 0.31850308179855347 (0.2311350073741407) | > loss_disc_real_4: 0.3018531799316406 (0.2656511995675308) | > loss_disc_real_5: 0.32920581102371216 (0.2385606236793861) | > loss_0: 2.5212149620056152 (2.481764569574473) | > grad_norm_0: tensor(844.9595, device='cuda:0') (tensor(633.6642, device='cuda:0')) | > loss_gen: 2.4911766052246094 (2.35512802795488) | > loss_kl: 0.550933301448822 (0.880399830791415) | > loss_feat: 3.6242880821228027 (4.92550303581722) | > loss_mel: 24.663209915161133 (21.648854610871286) | > loss_duration: 1.6236275434494019 (1.5667971080663252) | > loss_1: 32.9532356262207 (31.376682563703888) | > grad_norm_1: tensor(8036.3555, device='cuda:0') (tensor(16497.4863, device='cuda:0')) | > current_lr_0: 0.00014320776670294274 | > current_lr_1: 0.00014320776670294274 | > step_time: 0.4263 (0.4735585183513408) | > loader_time: 0.3755 (0.024165941744434594)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.922761917114258 (2.922761917114258) | > loss_disc_real_0: 0.2205621600151062 (0.2205621600151062) | > loss_disc_real_1: 0.23899857699871063 (0.23899857699871063) | > loss_disc_real_2: 0.29981735348701477 (0.29981735348701477) | > loss_disc_real_3: 0.2644544541835785 (0.2644544541835785) | > loss_disc_real_4: 0.21246474981307983 (0.21246474981307983) | > loss_disc_real_5: 0.15670013427734375 (0.15670013427734375) | > loss_0: 2.922761917114258 (2.922761917114258) | > loss_gen: 1.5188883543014526 (1.5188883543014526) | > loss_kl: 4.141350746154785 (4.141350746154785) | > loss_feat: 0.8241727352142334 (0.8241727352142334) | > loss_mel: 8.270896911621094 (8.270896911621094) | > loss_duration: 2.4641408920288086 (2.4641408920288086) | > loss_1: 17.219449996948242 (17.219449996948242)  --> STEP: 1 | > loss_disc: 2.839024305343628 (2.839024305343628) | > loss_disc_real_0: 0.09366167336702347 (0.09366167336702347) | > loss_disc_real_1: 0.16999922692775726 (0.16999922692775726) | > loss_disc_real_2: 0.28720250725746155 (0.28720250725746155) | > loss_disc_real_3: 0.14947398006916046 (0.14947398006916046) | > loss_disc_real_4: 0.4672161042690277 (0.4672161042690277) | > loss_disc_real_5: 0.5763306617736816 (0.5763306617736816) | > loss_0: 2.839024305343628 (2.839024305343628) | > loss_gen: 2.3019444942474365 (2.3019444942474365) | > loss_kl: 3.842860221862793 (3.842860221862793) | > loss_feat: 6.8700852394104 (6.8700852394104) | > loss_mel: 24.80632972717285 (24.80632972717285) | > loss_duration: 2.5608391761779785 (2.5608391761779785) | > loss_1: 40.38206100463867 (40.38206100463867)  --> STEP: 2 | > loss_disc: 2.9502382278442383 (2.894631266593933) | > loss_disc_real_0: 0.30838656425476074 (0.2010241188108921) | > loss_disc_real_1: 0.28785839676856995 (0.2289288118481636) | > loss_disc_real_2: 0.26750415563583374 (0.27735333144664764) | > loss_disc_real_3: 0.12285121530294418 (0.13616259768605232) | > loss_disc_real_4: 0.39971596002578735 (0.43346603214740753) | > loss_disc_real_5: 0.38858821988105774 (0.4824594408273697) | > loss_0: 2.9502382278442383 (2.894631266593933) | > loss_gen: 2.5660550594329834 (2.43399977684021) | > loss_kl: 3.238511085510254 (3.5406856536865234) | > loss_feat: 6.727438449859619 (6.79876184463501) | > loss_mel: 22.836700439453125 (23.82151508331299) | > loss_duration: 2.527104377746582 (2.5439717769622803) | > loss_1: 37.895809173583984 (39.13893508911133)  --> STEP: 3 | > loss_disc: 3.287492513656616 (3.0255850156148276) | > loss_disc_real_0: 0.3145850896835327 (0.23887777576843897) | > loss_disc_real_1: 0.2662421762943268 (0.24136659999688467) | > loss_disc_real_2: 0.3230776786804199 (0.2925947805245717) | > loss_disc_real_3: 0.33414608240127563 (0.20215709259112677) | > loss_disc_real_4: 0.3578531742095947 (0.4082617461681366) | > loss_disc_real_5: 0.2769222855567932 (0.41394705573717755) | > loss_0: 3.287492513656616 (3.0255850156148276) | > loss_gen: 1.7000154256820679 (2.1893383264541626) | > loss_kl: 1.8920167684555054 (2.9911293586095176) | > loss_feat: 2.1325840950012207 (5.243369261423747) | > loss_mel: 21.348655700683594 (22.997228622436523) | > loss_duration: 2.3963723182678223 (2.494771957397461) | > loss_1: 29.46964454650879 (35.91583824157715) --> EVAL PERFORMANCE | > avg_loader_time: 0.0020900567372639975 (-0.015837748845418297) | > avg_loss_disc: 3.0255850156148276 (+0.27565614382425974) | > avg_loss_disc_real_0: 0.23887777576843897 (-0.037876121699810056) | > avg_loss_disc_real_1: 0.24136659999688467 (-0.01577354967594144) | > avg_loss_disc_real_2: 0.2925947805245717 (-0.015100911259651184) | > avg_loss_disc_real_3: 0.20215709259112677 (-0.1510033085942268) | > avg_loss_disc_real_4: 0.4082617461681366 (+0.16255724430084229) | > avg_loss_disc_real_5: 0.41394705573717755 (+0.09286750356356305) | > avg_loss_0: 3.0255850156148276 (+0.27565614382425974) | > avg_loss_gen: 2.1893383264541626 (-0.505073587099711) | > avg_loss_kl: 2.9911293586095176 (-0.03802923361460353) | > avg_loss_feat: 5.243369261423747 (+0.19525686899820993) | > avg_loss_mel: 22.997228622436523 (-0.48887952168782434) | > avg_loss_duration: 2.494771957397461 (-0.05836749076843262) | > avg_loss_1: 35.91583824157715 (-0.8950932820638045)  > EPOCH: 335/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:19:28)   --> TIME: 2023-10-20 03:19:49 -- STEP: 29/50 -- GLOBAL_STEP: 69780 | > loss_disc: 2.7296011447906494 (2.6220198499745333) | > loss_disc_real_0: 0.21823075413703918 (0.1742032356881376) | > loss_disc_real_1: 0.26644718647003174 (0.2312748769362425) | > loss_disc_real_2: 0.24953368306159973 (0.24808807966524163) | > loss_disc_real_3: 0.3096362352371216 (0.2593175274287833) | > loss_disc_real_4: 0.1917722523212433 (0.22984931695050206) | > loss_disc_real_5: 0.23323804140090942 (0.2324631518587984) | > loss_0: 2.7296011447906494 (2.6220198499745333) | > grad_norm_0: tensor(379.7175, device='cuda:0') (tensor(695.8304, device='cuda:0')) | > loss_gen: 1.8530833721160889 (2.2010201585703886) | > loss_kl: 0.9595571160316467 (0.9648790051197184) | > loss_feat: 0.8632080554962158 (4.60470696519418) | > loss_mel: 18.672544479370117 (21.59141198725536) | > loss_duration: 1.5249245166778564 (1.5612013504422944) | > loss_1: 23.87331771850586 (30.92322009185265) | > grad_norm_1: tensor(5755.4663, device='cuda:0') (tensor(18681.4023, device='cuda:0')) | > current_lr_0: 0.0001430646215739768 | > current_lr_1: 0.0001430646215739768 | > step_time: 0.7061 (0.517083242021758) | > loader_time: 0.0255 (0.016133719477160226)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.339597702026367 (3.339597702026367) | > loss_disc_real_0: 0.29863739013671875 (0.29863739013671875) | > loss_disc_real_1: 0.23837605118751526 (0.23837605118751526) | > loss_disc_real_2: 0.42824068665504456 (0.42824068665504456) | > loss_disc_real_3: 0.24347539246082306 (0.24347539246082306) | > loss_disc_real_4: 0.49052509665489197 (0.49052509665489197) | > loss_disc_real_5: 0.6070919632911682 (0.6070919632911682) | > loss_0: 3.339597702026367 (3.339597702026367) | > loss_gen: 2.3292527198791504 (2.3292527198791504) | > loss_kl: 2.5401790142059326 (2.5401790142059326) | > loss_feat: 4.801135063171387 (4.801135063171387) | > loss_mel: 27.57844352722168 (27.57844352722168) | > loss_duration: 2.350968837738037 (2.350968837738037) | > loss_1: 39.599979400634766 (39.599979400634766)  --> STEP: 1 | > loss_disc: 3.1058053970336914 (3.1058053970336914) | > loss_disc_real_0: 0.4218785762786865 (0.4218785762786865) | > loss_disc_real_1: 0.3376121520996094 (0.3376121520996094) | > loss_disc_real_2: 0.3426103889942169 (0.3426103889942169) | > loss_disc_real_3: 0.34997719526290894 (0.34997719526290894) | > loss_disc_real_4: 0.44514933228492737 (0.44514933228492737) | > loss_disc_real_5: 0.42578068375587463 (0.42578068375587463) | > loss_0: 3.1058053970336914 (3.1058053970336914) | > loss_gen: 2.655693531036377 (2.655693531036377) | > loss_kl: 3.647320032119751 (3.647320032119751) | > loss_feat: 3.71187162399292 (3.71187162399292) | > loss_mel: 24.514392852783203 (24.514392852783203) | > loss_duration: 2.711690664291382 (2.711690664291382) | > loss_1: 37.240966796875 (37.240966796875)  --> STEP: 2 | > loss_disc: 2.432826042175293 (2.769315719604492) | > loss_disc_real_0: 0.09822937101125717 (0.26005397364497185) | > loss_disc_real_1: 0.11993713676929474 (0.22877464443445206) | > loss_disc_real_2: 0.1966034322977066 (0.26960691064596176) | > loss_disc_real_3: 0.2538420557975769 (0.3019096255302429) | > loss_disc_real_4: 0.19177977740764618 (0.3184645548462868) | > loss_disc_real_5: 0.018214812502264977 (0.2219977481290698) | > loss_0: 2.432826042175293 (2.769315719604492) | > loss_gen: 1.9604578018188477 (2.3080756664276123) | > loss_kl: 3.1690175533294678 (3.4081687927246094) | > loss_feat: 8.950949668884277 (6.331410646438599) | > loss_mel: 26.30686378479004 (25.41062831878662) | > loss_duration: 2.5852363109588623 (2.648463487625122) | > loss_1: 42.9725227355957 (40.10674476623535)  --> STEP: 3 | > loss_disc: 2.758082389831543 (2.7655712763468423) | > loss_disc_real_0: 0.2163611799478531 (0.2454897090792656) | > loss_disc_real_1: 0.29921889305114746 (0.2522560606400172) | > loss_disc_real_2: 0.24886460602283478 (0.26269280910491943) | > loss_disc_real_3: 0.26180341839790344 (0.2885408898194631) | > loss_disc_real_4: 0.30127638578414917 (0.3127351651589076) | > loss_disc_real_5: 0.31341809034347534 (0.25247119553387165) | > loss_0: 2.758082389831543 (2.7655712763468423) | > loss_gen: 2.01088809967041 (2.2090131441752114) | > loss_kl: 1.6451683044433594 (2.820501963297526) | > loss_feat: 1.0491286516189575 (4.570649981498718) | > loss_mel: 18.35088348388672 (23.057380040486652) | > loss_duration: 2.469508409500122 (2.5888117949167886) | > loss_1: 25.525577545166016 (35.24635569254557) --> EVAL PERFORMANCE | > avg_loader_time: 0.02566361427307129 (+0.023573557535807293) | > avg_loss_disc: 2.7655712763468423 (-0.2600137392679853) | > avg_loss_disc_real_0: 0.2454897090792656 (+0.006611933310826629) | > avg_loss_disc_real_1: 0.2522560606400172 (+0.010889460643132537) | > avg_loss_disc_real_2: 0.26269280910491943 (-0.029901971419652285) | > avg_loss_disc_real_3: 0.2885408898194631 (+0.0863837972283363) | > avg_loss_disc_real_4: 0.3127351651589076 (-0.095526581009229) | > avg_loss_disc_real_5: 0.25247119553387165 (-0.1614758602033059) | > avg_loss_0: 2.7655712763468423 (-0.2600137392679853) | > avg_loss_gen: 2.2090131441752114 (+0.019674817721048843) | > avg_loss_kl: 2.820501963297526 (-0.17062739531199167) | > avg_loss_feat: 4.570649981498718 (-0.6727192799250288) | > avg_loss_mel: 23.057380040486652 (+0.060151418050129024) | > avg_loss_duration: 2.5888117949167886 (+0.09403983751932765) | > avg_loss_1: 35.24635569254557 (-0.6694825490315779)  > EPOCH: 336/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:20:10)   --> TIME: 2023-10-20 03:20:17 -- STEP: 9/50 -- GLOBAL_STEP: 69810 | > loss_disc: 2.7999229431152344 (2.4803111023373074) | > loss_disc_real_0: 0.2236676812171936 (0.15480521093640062) | > loss_disc_real_1: 0.3047846853733063 (0.2503278859787517) | > loss_disc_real_2: 0.24601739645004272 (0.28066494564215344) | > loss_disc_real_3: 0.2722444236278534 (0.26023539983563954) | > loss_disc_real_4: 0.23923330008983612 (0.2165454998612404) | > loss_disc_real_5: 0.2856493592262268 (0.23993712849915028) | > loss_0: 2.7999229431152344 (2.4803111023373074) | > grad_norm_0: tensor(1133.5382, device='cuda:0') (tensor(738.1678, device='cuda:0')) | > loss_gen: 1.784911870956421 (2.402836389011807) | > loss_kl: 1.0079604387283325 (0.8809913198153178) | > loss_feat: 0.5664622187614441 (4.9351890153355065) | > loss_mel: 17.18334197998047 (21.48590686586168) | > loss_duration: 1.5033704042434692 (1.5390788714090984) | > loss_1: 22.04604721069336 (31.24400266011556) | > grad_norm_1: tensor(16841.5781, device='cuda:0') (tensor(24191.8223, device='cuda:0')) | > current_lr_0: 0.0001429216195275294 | > current_lr_1: 0.0001429216195275294 | > step_time: 0.4112 (0.3822731177012126) | > loader_time: 0.0369 (0.011931074990166558)  --> TIME: 2023-10-20 03:20:31 -- STEP: 39/50 -- GLOBAL_STEP: 69840 | > loss_disc: 3.0926008224487305 (2.4915794837169156) | > loss_disc_real_0: 0.24268397688865662 (0.16383522123289415) | > loss_disc_real_1: 0.2277866005897522 (0.23186476528644562) | > loss_disc_real_2: 0.262433797121048 (0.220777456003886) | > loss_disc_real_3: 0.2484821081161499 (0.24134961229104263) | > loss_disc_real_4: 0.2756279706954956 (0.22387923758763534) | > loss_disc_real_5: 0.2553463578224182 (0.22205042108320272) | > loss_0: 3.0926008224487305 (2.4915794837169156) | > grad_norm_0: tensor(458.2714, device='cuda:0') (tensor(559.5945, device='cuda:0')) | > loss_gen: 1.466043472290039 (2.255188969465403) | > loss_kl: 0.6400937438011169 (0.9211967029632666) | > loss_feat: 0.18710307776927948 (4.904007066327793) | > loss_mel: 2.144493579864502 (21.13086222379635) | > loss_duration: 1.6570864915847778 (1.5496037342609503) | > loss_1: 6.094820022583008 (30.760858645805946) | > grad_norm_1: tensor(15400.4258, device='cuda:0') (tensor(19989.4766, device='cuda:0')) | > current_lr_0: 0.0001429216195275294 | > current_lr_1: 0.0001429216195275294 | > step_time: 0.3008 (0.4375450366582626) | > loader_time: 0.0027 (0.010839474506867237)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.78987193107605 (2.78987193107605) | > loss_disc_real_0: 0.017858827486634254 (0.017858827486634254) | > loss_disc_real_1: 0.19770246744155884 (0.19770246744155884) | > loss_disc_real_2: 0.2186603993177414 (0.2186603993177414) | > loss_disc_real_3: 0.27751055359840393 (0.27751055359840393) | > loss_disc_real_4: 0.2229137271642685 (0.2229137271642685) | > loss_disc_real_5: 0.2142096757888794 (0.2142096757888794) | > loss_0: 2.78987193107605 (2.78987193107605) | > loss_gen: 1.5993165969848633 (1.5993165969848633) | > loss_kl: 3.8911890983581543 (3.8911890983581543) | > loss_feat: 2.24086332321167 (2.24086332321167) | > loss_mel: 20.241313934326172 (20.241313934326172) | > loss_duration: 2.3777103424072266 (2.3777103424072266) | > loss_1: 30.350393295288086 (30.350393295288086)  --> STEP: 1 | > loss_disc: 2.7189736366271973 (2.7189736366271973) | > loss_disc_real_0: 0.05175117775797844 (0.05175117775797844) | > loss_disc_real_1: 0.24709710478782654 (0.24709710478782654) | > loss_disc_real_2: 0.17709296941757202 (0.17709296941757202) | > loss_disc_real_3: 0.26080185174942017 (0.26080185174942017) | > loss_disc_real_4: 0.28139641880989075 (0.28139641880989075) | > loss_disc_real_5: 0.23291811347007751 (0.23291811347007751) | > loss_0: 2.7189736366271973 (2.7189736366271973) | > loss_gen: 1.5908775329589844 (1.5908775329589844) | > loss_kl: 3.7282145023345947 (3.7282145023345947) | > loss_feat: 1.1641303300857544 (1.1641303300857544) | > loss_mel: 20.656023025512695 (20.656023025512695) | > loss_duration: 2.626143217086792 (2.626143217086792) | > loss_1: 29.76538848876953 (29.76538848876953)  --> STEP: 2 | > loss_disc: 1.7614734172821045 (2.240223526954651) | > loss_disc_real_0: 0.02211066149175167 (0.036930919624865055) | > loss_disc_real_1: 0.10204824060201645 (0.1745726726949215) | > loss_disc_real_2: 0.04671730101108551 (0.11190513521432877) | > loss_disc_real_3: 0.06396786868572235 (0.16238486021757126) | > loss_disc_real_4: 0.01211476605385542 (0.14675559243187308) | > loss_disc_real_5: 0.019293496385216713 (0.1261058049276471) | > loss_0: 1.7614734172821045 (2.240223526954651) | > loss_gen: 1.8031227588653564 (1.6970001459121704) | > loss_kl: 4.012350559234619 (3.870282530784607) | > loss_feat: 10.551172256469727 (5.8576512932777405) | > loss_mel: 26.26791000366211 (23.461966514587402) | > loss_duration: 2.584024667739868 (2.60508394241333) | > loss_1: 45.21858215332031 (37.49198532104492)  --> STEP: 3 | > loss_disc: 3.2858097553253174 (2.588752269744873) | > loss_disc_real_0: 0.24887458980083466 (0.10757880968352158) | > loss_disc_real_1: 0.3577215373516083 (0.23562229424715042) | > loss_disc_real_2: 0.4467301666736603 (0.22351347903410593) | > loss_disc_real_3: 0.2737075984477997 (0.1994924396276474) | > loss_disc_real_4: 0.3892103135585785 (0.22757383280744156) | > loss_disc_real_5: 0.4530080258846283 (0.23507321191330752) | > loss_0: 3.2858097553253174 (2.588752269744873) | > loss_gen: 2.15096378326416 (1.8483213583628337) | > loss_kl: 1.7172874212265015 (3.1526174942652383) | > loss_feat: 3.153261661529541 (4.956188082695007) | > loss_mel: 21.226247787475586 (22.716726938883465) | > loss_duration: 2.5769522190093994 (2.5957067012786865) | > loss_1: 30.8247127532959 (35.26956113179525) --> EVAL PERFORMANCE | > avg_loader_time: 0.00351715087890625 (-0.02214646339416504) | > avg_loss_disc: 2.588752269744873 (-0.17681900660196925) | > avg_loss_disc_real_0: 0.10757880968352158 (-0.13791089939574402) | > avg_loss_disc_real_1: 0.23562229424715042 (-0.01663376639286679) | > avg_loss_disc_real_2: 0.22351347903410593 (-0.039179330070813506) | > avg_loss_disc_real_3: 0.1994924396276474 (-0.08904845019181568) | > avg_loss_disc_real_4: 0.22757383280744156 (-0.08516133235146603) | > avg_loss_disc_real_5: 0.23507321191330752 (-0.017397983620564134) | > avg_loss_0: 2.588752269744873 (-0.17681900660196925) | > avg_loss_gen: 1.8483213583628337 (-0.3606917858123777) | > avg_loss_kl: 3.1526174942652383 (+0.3321155309677124) | > avg_loss_feat: 4.956188082695007 (+0.38553810119628906) | > avg_loss_mel: 22.716726938883465 (-0.34065310160318774) | > avg_loss_duration: 2.5957067012786865 (+0.0068949063618979345) | > avg_loss_1: 35.26956113179525 (+0.023205439249679216)  > EPOCH: 337/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:20:45)   --> TIME: 2023-10-20 03:20:59 -- STEP: 19/50 -- GLOBAL_STEP: 69870 | > loss_disc: 2.4053876399993896 (2.440431274865803) | > loss_disc_real_0: 0.012477914802730083 (0.13088501372227543) | > loss_disc_real_1: 0.33100426197052 (0.2347202963734928) | > loss_disc_real_2: 0.17738060653209686 (0.2250999404411567) | > loss_disc_real_3: 0.2061002403497696 (0.20406629890203476) | > loss_disc_real_4: 0.13262026011943817 (0.23479156509826063) | > loss_disc_real_5: 0.1538800448179245 (0.21781314600651203) | > loss_0: 2.4053876399993896 (2.440431274865803) | > grad_norm_0: tensor(401.7783, device='cuda:0') (tensor(493.7549, device='cuda:0')) | > loss_gen: 2.585974931716919 (2.5286991658963656) | > loss_kl: 0.6566347479820251 (1.0422445347434597) | > loss_feat: 7.879707336425781 (6.56459735569201) | > loss_mel: 25.742631912231445 (24.70954583820544) | > loss_duration: 1.669408917427063 (1.605864775808234) | > loss_1: 38.534358978271484 (36.450951425652754) | > grad_norm_1: tensor(11914.5254, device='cuda:0') (tensor(26777.1836, device='cuda:0')) | > current_lr_0: 0.00014277876042058079 | > current_lr_1: 0.00014277876042058079 | > step_time: 0.5643 (0.49260273732637105) | > loader_time: 0.0245 (0.019702484733179995)  --> TIME: 2023-10-20 03:21:14 -- STEP: 49/50 -- GLOBAL_STEP: 69900 | > loss_disc: 2.7999227046966553 (2.4543784005301337) | > loss_disc_real_0: 0.12093334645032883 (0.14013975410132984) | > loss_disc_real_1: 0.3389342129230499 (0.2163318435148317) | > loss_disc_real_2: 0.3757679760456085 (0.21742652961033948) | > loss_disc_real_3: 0.31631404161453247 (0.22630571680409567) | > loss_disc_real_4: 0.2528125047683716 (0.22553125487602488) | > loss_disc_real_5: 0.2228722870349884 (0.22744120765781525) | > loss_0: 2.7999227046966553 (2.4543784005301337) | > grad_norm_0: tensor(416.3505, device='cuda:0') (tensor(516.4601, device='cuda:0')) | > loss_gen: 2.0084171295166016 (2.3393901221606197) | > loss_kl: 0.7733154892921448 (0.9385039477932214) | > loss_feat: 0.9966777563095093 (5.5492777091507985) | > loss_mel: 18.673328399658203 (22.520579610552108) | > loss_duration: 1.6981333494186401 (1.562117221404095) | > loss_1: 24.149871826171875 (32.909868454446595) | > grad_norm_1: tensor(2991.1934, device='cuda:0') (tensor(18972.6895, device='cuda:0')) | > current_lr_0: 0.00014277876042058079 | > current_lr_1: 0.00014277876042058079 | > step_time: 0.4951 (0.4705795122652638) | > loader_time: 0.4378 (0.026295253208705356)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.012582778930664 (2.012582778930664) | > loss_disc_real_0: 0.15461333096027374 (0.15461333096027374) | > loss_disc_real_1: 0.2296827882528305 (0.2296827882528305) | > loss_disc_real_2: 0.243544340133667 (0.243544340133667) | > loss_disc_real_3: 0.22937478125095367 (0.22937478125095367) | > loss_disc_real_4: 0.11600194126367569 (0.11600194126367569) | > loss_disc_real_5: 0.06572993099689484 (0.06572993099689484) | > loss_0: 2.012582778930664 (2.012582778930664) | > loss_gen: 2.6292667388916016 (2.6292667388916016) | > loss_kl: 3.6647753715515137 (3.6647753715515137) | > loss_feat: 7.798466205596924 (7.798466205596924) | > loss_mel: 24.808204650878906 (24.808204650878906) | > loss_duration: 2.3231656551361084 (2.3231656551361084) | > loss_1: 41.223876953125 (41.223876953125)  --> STEP: 1 | > loss_disc: 2.178995132446289 (2.178995132446289) | > loss_disc_real_0: 0.051957868039608 (0.051957868039608) | > loss_disc_real_1: 0.2853225767612457 (0.2853225767612457) | > loss_disc_real_2: 0.16714705526828766 (0.16714705526828766) | > loss_disc_real_3: 0.29565587639808655 (0.29565587639808655) | > loss_disc_real_4: 0.386265367269516 (0.386265367269516) | > loss_disc_real_5: 0.21325141191482544 (0.21325141191482544) | > loss_0: 2.178995132446289 (2.178995132446289) | > loss_gen: 2.7822141647338867 (2.7822141647338867) | > loss_kl: 3.8903350830078125 (3.8903350830078125) | > loss_feat: 7.943195343017578 (7.943195343017578) | > loss_mel: 25.40484046936035 (25.40484046936035) | > loss_duration: 2.6586594581604004 (2.6586594581604004) | > loss_1: 42.67924880981445 (42.67924880981445)  --> STEP: 2 | > loss_disc: 2.1582067012786865 (2.168600916862488) | > loss_disc_real_0: 0.09040183573961258 (0.07117985188961029) | > loss_disc_real_1: 0.288608193397522 (0.28696538507938385) | > loss_disc_real_2: 0.09264203161001205 (0.12989454343914986) | > loss_disc_real_3: 0.3175541162490845 (0.3066049963235855) | > loss_disc_real_4: 0.1602737456560135 (0.27326955646276474) | > loss_disc_real_5: 0.20919065177440643 (0.21122103184461594) | > loss_0: 2.1582067012786865 (2.168600916862488) | > loss_gen: 2.45192813873291 (2.6170711517333984) | > loss_kl: 3.439175844192505 (3.6647554636001587) | > loss_feat: 5.36273717880249 (6.652966260910034) | > loss_mel: 26.42740821838379 (25.91612434387207) | > loss_duration: 2.5121679306030273 (2.585413694381714) | > loss_1: 40.193416595458984 (41.43633270263672)  --> STEP: 3 | > loss_disc: 2.6960015296936035 (2.3444011211395264) | > loss_disc_real_0: 0.06253257393836975 (0.06829742590586345) | > loss_disc_real_1: 0.3024597465991974 (0.29213017225265503) | > loss_disc_real_2: 0.2713647782802582 (0.17705128838618597) | > loss_disc_real_3: 0.3279045820236206 (0.3137048582235972) | > loss_disc_real_4: 0.21936653554439545 (0.2553018828233083) | > loss_disc_real_5: 0.1766735315322876 (0.19970519840717316) | > loss_0: 2.6960015296936035 (2.3444011211395264) | > loss_gen: 1.7236779928207397 (2.3192734320958457) | > loss_kl: 1.7389322519302368 (3.022814393043518) | > loss_feat: 1.315522313117981 (4.873818278312683) | > loss_mel: 17.836515426635742 (23.22292137145996) | > loss_duration: 2.4691197872161865 (2.5466490586598716) | > loss_1: 25.083768844604492 (35.98547808329264) --> EVAL PERFORMANCE | > avg_loader_time: 0.0029021104176839194 (-0.0006150404612223306) | > avg_loss_disc: 2.3444011211395264 (-0.24435114860534668) | > avg_loss_disc_real_0: 0.06829742590586345 (-0.039281383777658135) | > avg_loss_disc_real_1: 0.29213017225265503 (+0.05650787800550461) | > avg_loss_disc_real_2: 0.17705128838618597 (-0.046462190647919954) | > avg_loss_disc_real_3: 0.3137048582235972 (+0.11421241859594983) | > avg_loss_disc_real_4: 0.2553018828233083 (+0.02772805001586673) | > avg_loss_disc_real_5: 0.19970519840717316 (-0.03536801350613436) | > avg_loss_0: 2.3444011211395264 (-0.24435114860534668) | > avg_loss_gen: 2.3192734320958457 (+0.47095207373301196) | > avg_loss_kl: 3.022814393043518 (-0.12980310122172023) | > avg_loss_feat: 4.873818278312683 (-0.08236980438232422) | > avg_loss_mel: 23.22292137145996 (+0.5061944325764962) | > avg_loss_duration: 2.5466490586598716 (-0.049057642618814956) | > avg_loss_1: 35.98547808329264 (+0.7159169514973911)  > EPOCH: 338/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:21:26)   --> TIME: 2023-10-20 03:21:49 -- STEP: 29/50 -- GLOBAL_STEP: 69930 | > loss_disc: 2.2612557411193848 (2.368312223204251) | > loss_disc_real_0: 0.05336223170161247 (0.15513819115686006) | > loss_disc_real_1: 0.21981127560138702 (0.22630401392435207) | > loss_disc_real_2: 0.12536944448947906 (0.20402286105371756) | > loss_disc_real_3: 0.19404570758342743 (0.24069138947103558) | > loss_disc_real_4: 0.17787966132164001 (0.2063357180690971) | > loss_disc_real_5: 0.23233281075954437 (0.24077378919926182) | > loss_0: 2.2612557411193848 (2.368312223204251) | > grad_norm_0: tensor(552.8495, device='cuda:0') (tensor(580.3813, device='cuda:0')) | > loss_gen: 1.8704408407211304 (2.585161727050255) | > loss_kl: 0.7399974465370178 (1.0364706742352454) | > loss_feat: 2.3171958923339844 (6.165205067858614) | > loss_mel: 18.779165267944336 (21.78641730341418) | > loss_duration: 1.5389540195465088 (1.5856958093314335) | > loss_1: 25.24575424194336 (33.15895069056543) | > grad_norm_1: tensor(8881.0713, device='cuda:0') (tensor(22563.0664, device='cuda:0')) | > current_lr_0: 0.00014263604411025386 | > current_lr_1: 0.00014263604411025386 | > step_time: 0.5761 (0.5151545343727902) | > loader_time: 0.0191 (0.01751015926229543)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1102869510650635 (3.1102869510650635) | > loss_disc_real_0: 0.24628521502017975 (0.24628521502017975) | > loss_disc_real_1: 0.05920330807566643 (0.05920330807566643) | > loss_disc_real_2: 0.2506372928619385 (0.2506372928619385) | > loss_disc_real_3: 0.27629801630973816 (0.27629801630973816) | > loss_disc_real_4: 0.34601491689682007 (0.34601491689682007) | > loss_disc_real_5: 0.6031002998352051 (0.6031002998352051) | > loss_0: 3.1102869510650635 (3.1102869510650635) | > loss_gen: 2.0643248558044434 (2.0643248558044434) | > loss_kl: 3.3921689987182617 (3.3921689987182617) | > loss_feat: 7.180509567260742 (7.180509567260742) | > loss_mel: 23.982025146484375 (23.982025146484375) | > loss_duration: 2.381638288497925 (2.381638288497925) | > loss_1: 39.00066375732422 (39.00066375732422)  --> STEP: 1 | > loss_disc: 2.527888774871826 (2.527888774871826) | > loss_disc_real_0: 0.25264135003089905 (0.25264135003089905) | > loss_disc_real_1: 0.1876130998134613 (0.1876130998134613) | > loss_disc_real_2: 0.1376769095659256 (0.1376769095659256) | > loss_disc_real_3: 0.33199673891067505 (0.33199673891067505) | > loss_disc_real_4: 0.18749360740184784 (0.18749360740184784) | > loss_disc_real_5: 0.22423772513866425 (0.22423772513866425) | > loss_0: 2.527888774871826 (2.527888774871826) | > loss_gen: 2.553654670715332 (2.553654670715332) | > loss_kl: 3.60562801361084 (3.60562801361084) | > loss_feat: 7.440361022949219 (7.440361022949219) | > loss_mel: 23.527875900268555 (23.527875900268555) | > loss_duration: 2.645918607711792 (2.645918607711792) | > loss_1: 39.7734375 (39.7734375)  --> STEP: 2 | > loss_disc: 2.835209369659424 (2.681549072265625) | > loss_disc_real_0: 0.20381046831607819 (0.22822590917348862) | > loss_disc_real_1: 0.2196604162454605 (0.2036367580294609) | > loss_disc_real_2: 0.2128698080778122 (0.1752733588218689) | > loss_disc_real_3: 0.2977084219455719 (0.3148525804281235) | > loss_disc_real_4: 0.16768436133861542 (0.17758898437023163) | > loss_disc_real_5: 0.29976704716682434 (0.2620023861527443) | > loss_0: 2.835209369659424 (2.681549072265625) | > loss_gen: 1.7681094408035278 (2.16088205575943) | > loss_kl: 3.8314027786254883 (3.718515396118164) | > loss_feat: 3.0131664276123047 (5.226763725280762) | > loss_mel: 12.228053092956543 (17.87796449661255) | > loss_duration: 2.5227210521698 (2.584319829940796) | > loss_1: 23.363452911376953 (31.568445205688477)  --> STEP: 3 | > loss_disc: 2.9053382873535156 (2.756145477294922) | > loss_disc_real_0: 0.19825512170791626 (0.2182356466849645) | > loss_disc_real_1: 0.3059997260570526 (0.23775774737199148) | > loss_disc_real_2: 0.2715832591056824 (0.2073766589164734) | > loss_disc_real_3: 0.2769013047218323 (0.30220215519269306) | > loss_disc_real_4: 0.29120543599128723 (0.2154611349105835) | > loss_disc_real_5: 0.3400645852088928 (0.28802311917146045) | > loss_0: 2.9053382873535156 (2.756145477294922) | > loss_gen: 1.8705778121948242 (2.064113974571228) | > loss_kl: 1.6366370916366577 (3.024555961290995) | > loss_feat: 1.2198199033737183 (3.8911157846450806) | > loss_mel: 22.14288330078125 (19.299604098002117) | > loss_duration: 2.5040695667266846 (2.557569742202759) | > loss_1: 29.37398910522461 (30.836959838867188) --> EVAL PERFORMANCE | > avg_loader_time: 0.007406552632649739 (+0.00450444221496582) | > avg_loss_disc: 2.756145477294922 (+0.4117443561553955) | > avg_loss_disc_real_0: 0.2182356466849645 (+0.14993822077910107) | > avg_loss_disc_real_1: 0.23775774737199148 (-0.054372424880663545) | > avg_loss_disc_real_2: 0.2073766589164734 (+0.030325370530287415) | > avg_loss_disc_real_3: 0.30220215519269306 (-0.011502703030904171) | > avg_loss_disc_real_4: 0.2154611349105835 (-0.039840747912724794) | > avg_loss_disc_real_5: 0.28802311917146045 (+0.0883179207642873) | > avg_loss_0: 2.756145477294922 (+0.4117443561553955) | > avg_loss_gen: 2.064113974571228 (-0.25515945752461766) | > avg_loss_kl: 3.024555961290995 (+0.0017415682474770655) | > avg_loss_feat: 3.8911157846450806 (-0.9827024936676025) | > avg_loss_mel: 19.299604098002117 (-3.923317273457844) | > avg_loss_duration: 2.557569742202759 (+0.010920683542887222) | > avg_loss_1: 30.836959838867188 (-5.148518244425453)  > EPOCH: 339/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:22:09)   --> TIME: 2023-10-20 03:22:17 -- STEP: 9/50 -- GLOBAL_STEP: 69960 | > loss_disc: 3.016183614730835 (2.647834539413452) | > loss_disc_real_0: 0.15947818756103516 (0.14688481763005257) | > loss_disc_real_1: 0.16145306825637817 (0.19158459703127542) | > loss_disc_real_2: 0.17814162373542786 (0.23286838250027764) | > loss_disc_real_3: 0.08284544944763184 (0.24404161837365893) | > loss_disc_real_4: 0.07133015245199203 (0.1824599727988243) | > loss_disc_real_5: 0.08699497580528259 (0.1797585528757837) | > loss_0: 3.016183614730835 (2.647834539413452) | > grad_norm_0: tensor(1422.2083, device='cuda:0') (tensor(755.0544, device='cuda:0')) | > loss_gen: 1.635076642036438 (2.2423992024527655) | > loss_kl: 0.8948934674263 (0.8888835046026442) | > loss_feat: 7.897024631500244 (5.299005027446482) | > loss_mel: 22.612314224243164 (21.138469325171577) | > loss_duration: 1.4898719787597656 (1.5517454147338867) | > loss_1: 34.52918243408203 (31.120502683851456) | > grad_norm_1: tensor(6480.5010, device='cuda:0') (tensor(12728.0518, device='cuda:0')) | > current_lr_0: 0.0001424934704538145 | > current_lr_1: 0.0001424934704538145 | > step_time: 0.4996 (0.3867773479885525) | > loader_time: 0.0062 (0.008290290832519531)  --> TIME: 2023-10-20 03:22:31 -- STEP: 39/50 -- GLOBAL_STEP: 69990 | > loss_disc: 2.7679390907287598 (2.5049037352586403) | > loss_disc_real_0: 0.13173940777778625 (0.1531947029229158) | > loss_disc_real_1: 0.2597396671772003 (0.21544632468468103) | > loss_disc_real_2: 0.22370032966136932 (0.23692151330984557) | > loss_disc_real_3: 0.2770201563835144 (0.2421214039891194) | > loss_disc_real_4: 0.2798537313938141 (0.23618364200378075) | > loss_disc_real_5: 0.3661544919013977 (0.24654996796296194) | > loss_0: 2.7679390907287598 (2.5049037352586403) | > grad_norm_0: tensor(616.0258, device='cuda:0') (tensor(645.7880, device='cuda:0')) | > loss_gen: 2.1001832485198975 (2.3525822957356772) | > loss_kl: 0.6531480550765991 (0.9232462422970014) | > loss_feat: 2.468632459640503 (5.190137779292388) | > loss_mel: 17.86154556274414 (23.03880558258448) | > loss_duration: 1.602040410041809 (1.5476295489531298) | > loss_1: 24.685550689697266 (33.05240126145191) | > grad_norm_1: tensor(14442.2178, device='cuda:0') (tensor(19844.6738, device='cuda:0')) | > current_lr_0: 0.0001424934704538145 | > current_lr_1: 0.0001424934704538145 | > step_time: 0.4704 (0.43049018810956907) | > loader_time: 0.01 (0.008581265425070738)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7747375965118408 (1.7747375965118408) | > loss_disc_real_0: 0.04099610820412636 (0.04099610820412636) | > loss_disc_real_1: 0.141506627202034 (0.141506627202034) | > loss_disc_real_2: 0.1283188909292221 (0.1283188909292221) | > loss_disc_real_3: 0.1645592749118805 (0.1645592749118805) | > loss_disc_real_4: 0.07518121600151062 (0.07518121600151062) | > loss_disc_real_5: 0.11395908147096634 (0.11395908147096634) | > loss_0: 1.7747375965118408 (1.7747375965118408) | > loss_gen: 2.316246509552002 (2.316246509552002) | > loss_kl: 3.4856648445129395 (3.4856648445129395) | > loss_feat: 9.336549758911133 (9.336549758911133) | > loss_mel: 30.817556381225586 (30.817556381225586) | > loss_duration: 2.479126453399658 (2.479126453399658) | > loss_1: 48.435142517089844 (48.435142517089844)  --> STEP: 1 | > loss_disc: 2.937325954437256 (2.937325954437256) | > loss_disc_real_0: 0.2569133937358856 (0.2569133937358856) | > loss_disc_real_1: 0.2692776918411255 (0.2692776918411255) | > loss_disc_real_2: 0.21144767105579376 (0.21144767105579376) | > loss_disc_real_3: 0.2425009161233902 (0.2425009161233902) | > loss_disc_real_4: 0.26083430647850037 (0.26083430647850037) | > loss_disc_real_5: 0.24462570250034332 (0.24462570250034332) | > loss_0: 2.937325954437256 (2.937325954437256) | > loss_gen: 1.5684523582458496 (1.5684523582458496) | > loss_kl: 3.2528340816497803 (3.2528340816497803) | > loss_feat: 0.32479849457740784 (0.32479849457740784) | > loss_mel: 11.252653121948242 (11.252653121948242) | > loss_duration: 2.684380531311035 (2.684380531311035) | > loss_1: 19.083118438720703 (19.083118438720703)  --> STEP: 2 | > loss_disc: 2.046058416366577 (2.4916921854019165) | > loss_disc_real_0: 0.02691839076578617 (0.1419158922508359) | > loss_disc_real_1: 0.2544243037700653 (0.2618509978055954) | > loss_disc_real_2: 0.1219533309340477 (0.16670050099492073) | > loss_disc_real_3: 0.26257383823394775 (0.252537377178669) | > loss_disc_real_4: 0.20430882275104523 (0.2325715646147728) | > loss_disc_real_5: 0.07143810391426086 (0.1580319032073021) | > loss_0: 2.046058416366577 (2.4916921854019165) | > loss_gen: 2.3366692066192627 (1.9525607824325562) | > loss_kl: 3.8229846954345703 (3.5379093885421753) | > loss_feat: 5.963553428649902 (3.144175961613655) | > loss_mel: 26.379297256469727 (18.815975189208984) | > loss_duration: 2.6309025287628174 (2.6576415300369263) | > loss_1: 41.13340759277344 (30.10826301574707)  --> STEP: 3 | > loss_disc: 2.304687023162842 (2.429357131322225) | > loss_disc_real_0: 0.14419764280319214 (0.14267647576828799) | > loss_disc_real_1: 0.24969913065433502 (0.2578003754218419) | > loss_disc_real_2: 0.18877777457237244 (0.17405959218740463) | > loss_disc_real_3: 0.2472248375415802 (0.2507665306329727) | > loss_disc_real_4: 0.16390429437160492 (0.20968247453371683) | > loss_disc_real_5: 0.13574948906898499 (0.15060443182786307) | > loss_0: 2.304687023162842 (2.429357131322225) | > loss_gen: 1.936954140663147 (1.9473585685094197) | > loss_kl: 1.5429432392120361 (2.8729206720987954) | > loss_feat: 3.084155797958374 (3.124169240395228) | > loss_mel: 20.531091690063477 (19.387680689493816) | > loss_duration: 2.460836410522461 (2.5920398235321045) | > loss_1: 29.55598258972168 (29.924169540405273) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_70000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.673933506011963 (2.4905012249946594) | > loss_disc_real_0: 0.3119991421699524 (0.18500714236870408) | > loss_disc_real_1: 0.44647708535194397 (0.30496955290436745) | > loss_disc_real_2: 0.32942619919776917 (0.21290124393999577) | > loss_disc_real_3: 0.31380510330200195 (0.26652617380023) | > loss_disc_real_4: 0.3590894639492035 (0.2470342218875885) | > loss_disc_real_5: 0.2037048488855362 (0.16387953609228134) | > loss_0: 2.673933506011963 (2.4905012249946594) | > loss_gen: 2.9471752643585205 (2.197312742471695) | > loss_kl: 3.871354103088379 (3.1225290298461914) | > loss_feat: 5.103403091430664 (3.618977703154087) | > loss_mel: 25.28569221496582 (20.862183570861816) | > loss_duration: 2.4297049045562744 (2.551456093788147) | > loss_1: 39.6373291015625 (32.35245943069458)  --> STEP: 1 | > loss_disc: 1.7372677326202393 (2.339854526519775) | > loss_disc_real_0: 0.09124072641134262 (0.1662538591772318) | > loss_disc_real_1: 0.1394973248243332 (0.2718751072883606) | > loss_disc_real_2: 0.2076246738433838 (0.21184592992067336) | > loss_disc_real_3: 0.1528559774160385 (0.2437921345233917) | > loss_disc_real_4: 0.10168103873729706 (0.2179635852575302) | > loss_disc_real_5: 0.24890084564685822 (0.1808837980031967) | > loss_0: 1.7372677326202393 (2.339854526519775) | > loss_gen: 2.8732330799102783 (2.3324968099594114) | > loss_kl: 3.6889421939849854 (3.2358116626739504) | > loss_feat: 8.81196403503418 (4.657574969530105) | > loss_mel: 23.38085174560547 (21.365917205810547) | > loss_duration: 2.6904618740081787 (2.5792572498321533) | > loss_1: 41.44545364379883 (34.17105827331543)  --> STEP: 2 | > loss_disc: 3.1775448322296143 (2.479469577471415) | > loss_disc_real_0: 0.2546054422855377 (0.1809791230286161) | > loss_disc_real_1: 0.41100549697875977 (0.2950635055700938) | > loss_disc_real_2: 0.16574726998806 (0.20416281993190447) | > loss_disc_real_3: 0.2776087522506714 (0.24942823747793832) | > loss_disc_real_4: 0.37071332335472107 (0.24342187494039536) | > loss_disc_real_5: 0.3069664537906647 (0.20189757396777472) | > loss_0: 3.1775448322296143 (2.479469577471415) | > loss_gen: 2.0796992778778076 (2.290363887945811) | > loss_kl: 3.686387538909912 (3.3109076420466104) | > loss_feat: 4.733760356903076 (4.670272534092267) | > loss_mel: 29.422937393188477 (22.708753903706867) | > loss_duration: 2.567359685897827 (2.5772743225097656) | > loss_1: 42.49014663696289 (35.557573000590004)  --> STEP: 3 | > loss_disc: 2.3814876079559326 (2.4654721532549178) | > loss_disc_real_0: 0.29642215371131897 (0.1974709845547165) | > loss_disc_real_1: 0.24831780791282654 (0.28838554876191275) | > loss_disc_real_2: 0.15558260679244995 (0.19722278948341096) | > loss_disc_real_3: 0.25908973813056946 (0.25080845185688566) | > loss_disc_real_4: 0.21740105748176575 (0.23970461530344828) | > loss_disc_real_5: 0.3487268388271332 (0.22287318323339736) | > loss_0: 2.3814876079559326 (2.4654721532549178) | > loss_gen: 2.645833969116211 (2.341145328113011) | > loss_kl: 2.1131296157836914 (3.139796495437622) | > loss_feat: 4.2335381507873535 (4.607881907905851) | > loss_mel: 25.571393966674805 (23.11770248413086) | > loss_duration: 2.5665838718414307 (2.575747115271432) | > loss_1: 37.1304817199707 (35.78227424621582) --> EVAL PERFORMANCE | > avg_loader_time: 0.3412034170968192 (+0.33379686446416945) | > avg_loss_disc: 2.4654721532549178 (-0.2906733240400041) | > avg_loss_disc_real_0: 0.1974709845547165 (-0.020764662130247996) | > avg_loss_disc_real_1: 0.28838554876191275 (+0.05062780138992126) | > avg_loss_disc_real_2: 0.19722278948341096 (-0.010153869433062429) | > avg_loss_disc_real_3: 0.25080845185688566 (-0.051393703335807395) | > avg_loss_disc_real_4: 0.23970461530344828 (+0.02424348039286478) | > avg_loss_disc_real_5: 0.22287318323339736 (-0.06514993593806309) | > avg_loss_0: 2.4654721532549178 (-0.2906733240400041) | > avg_loss_gen: 2.341145328113011 (+0.277031353541783) | > avg_loss_kl: 3.139796495437622 (+0.11524053414662694) | > avg_loss_feat: 4.607881907905851 (+0.7167661232607703) | > avg_loss_mel: 23.11770248413086 (+3.8180983861287423) | > avg_loss_duration: 2.575747115271432 (+0.018177373068673397) | > avg_loss_1: 35.78227424621582 (+4.945314407348633)  > EPOCH: 340/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:22:55)   --> TIME: 2023-10-20 03:23:08 -- STEP: 19/50 -- GLOBAL_STEP: 70020 | > loss_disc: 1.8885027170181274 (2.3276655297530326) | > loss_disc_real_0: 0.0315813384950161 (0.13957229271335037) | > loss_disc_real_1: 0.20162558555603027 (0.20973653973717438) | > loss_disc_real_2: 0.20958584547042847 (0.20352363645246155) | > loss_disc_real_3: 0.12490756064653397 (0.19213389762138067) | > loss_disc_real_4: 0.05706588923931122 (0.1887611129174107) | > loss_disc_real_5: 0.05590257793664932 (0.18901565337651655) | > loss_0: 1.8885027170181274 (2.3276655297530326) | > grad_norm_0: tensor(650.2485, device='cuda:0') (tensor(426.2352, device='cuda:0')) | > loss_gen: 2.6181728839874268 (2.4304316294820687) | > loss_kl: 1.0200212001800537 (1.0129828721677006) | > loss_feat: 10.71889877319336 (6.505520439461658) | > loss_mel: 26.078678131103516 (20.365802614312422) | > loss_duration: 1.686557650566101 (1.5928278910486322) | > loss_1: 42.1223258972168 (31.90756516707571) | > grad_norm_1: tensor(46988.8203, device='cuda:0') (tensor(26177.6543, device='cuda:0')) | > current_lr_0: 0.00014235103930867112 | > current_lr_1: 0.00014235103930867112 | > step_time: 0.3024 (0.45146058735094574) | > loader_time: 0.0041 (0.013051560050562808)  --> TIME: 2023-10-20 03:23:22 -- STEP: 49/50 -- GLOBAL_STEP: 70050 | > loss_disc: 2.5349817276000977 (2.32182486203252) | > loss_disc_real_0: 0.12255142629146576 (0.12335445302329501) | > loss_disc_real_1: 0.17517344653606415 (0.22008364229482047) | > loss_disc_real_2: 0.25080811977386475 (0.21184264974934713) | > loss_disc_real_3: 0.4077977240085602 (0.215057478419372) | > loss_disc_real_4: 0.28103068470954895 (0.2205406725026515) | > loss_disc_real_5: 0.2606506049633026 (0.2050068598924851) | > loss_0: 2.5349817276000977 (2.32182486203252) | > grad_norm_0: tensor(833.6791, device='cuda:0') (tensor(486.0060, device='cuda:0')) | > loss_gen: 2.541818380355835 (2.4763672668106698) | > loss_kl: 0.6333671808242798 (0.9477630452994181) | > loss_feat: 2.3359811305999756 (6.058987577502825) | > loss_mel: 28.866926193237305 (21.815083367483957) | > loss_duration: 1.668105125427246 (1.5532192235090294) | > loss_1: 36.046199798583984 (32.851420616617006) | > grad_norm_1: tensor(3959.4138, device='cuda:0') (tensor(20721.1289, device='cuda:0')) | > current_lr_0: 0.00014235103930867112 | > current_lr_1: 0.00014235103930867112 | > step_time: 0.4956 (0.4445698455888398) | > loader_time: 0.488 (0.021198627900104135)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.469639778137207 (2.469639778137207) | > loss_disc_real_0: 0.09055688232183456 (0.09055688232183456) | > loss_disc_real_1: 0.24220596253871918 (0.24220596253871918) | > loss_disc_real_2: 0.3705759346485138 (0.3705759346485138) | > loss_disc_real_3: 0.34199538826942444 (0.34199538826942444) | > loss_disc_real_4: 0.27648672461509705 (0.27648672461509705) | > loss_disc_real_5: 0.34782761335372925 (0.34782761335372925) | > loss_0: 2.469639778137207 (2.469639778137207) | > loss_gen: 2.8391590118408203 (2.8391590118408203) | > loss_kl: 2.682826280593872 (2.682826280593872) | > loss_feat: 5.260697841644287 (5.260697841644287) | > loss_mel: 24.345252990722656 (24.345252990722656) | > loss_duration: 2.333620071411133 (2.333620071411133) | > loss_1: 37.46155548095703 (37.46155548095703)  --> STEP: 1 | > loss_disc: 2.78096866607666 (2.78096866607666) | > loss_disc_real_0: 0.04083963483572006 (0.04083963483572006) | > loss_disc_real_1: 0.20418903231620789 (0.20418903231620789) | > loss_disc_real_2: 0.3147139549255371 (0.3147139549255371) | > loss_disc_real_3: 0.41994044184684753 (0.41994044184684753) | > loss_disc_real_4: 0.27615296840667725 (0.27615296840667725) | > loss_disc_real_5: 0.3676697313785553 (0.3676697313785553) | > loss_0: 2.78096866607666 (2.78096866607666) | > loss_gen: 2.230531930923462 (2.230531930923462) | > loss_kl: 3.3254852294921875 (3.3254852294921875) | > loss_feat: 6.036728382110596 (6.036728382110596) | > loss_mel: 23.072891235351562 (23.072891235351562) | > loss_duration: 2.5835230350494385 (2.5835230350494385) | > loss_1: 37.24916076660156 (37.24916076660156)  --> STEP: 2 | > loss_disc: 1.6126770973205566 (2.1968228816986084) | > loss_disc_real_0: 0.09068239480257034 (0.0657610148191452) | > loss_disc_real_1: 0.20514839887619019 (0.20466871559619904) | > loss_disc_real_2: 0.22601117193698883 (0.27036256343126297) | > loss_disc_real_3: 0.24465790390968323 (0.3322991728782654) | > loss_disc_real_4: 0.0765053927898407 (0.17632918059825897) | > loss_disc_real_5: 0.06513320654630661 (0.21640146896243095) | > loss_0: 1.6126770973205566 (2.1968228816986084) | > loss_gen: 4.079527854919434 (3.1550298929214478) | > loss_kl: 3.7821662425994873 (3.5538257360458374) | > loss_feat: 10.40574836730957 (8.221238374710083) | > loss_mel: 25.925020217895508 (24.498955726623535) | > loss_duration: 2.5968053340911865 (2.5901641845703125) | > loss_1: 46.789268493652344 (42.01921463012695)  --> STEP: 3 | > loss_disc: 2.108931303024292 (2.1675256888071694) | > loss_disc_real_0: 0.1545403152704239 (0.09535411496957143) | > loss_disc_real_1: 0.25144991278648376 (0.2202624479929606) | > loss_disc_real_2: 0.28775423765182495 (0.2761597881714503) | > loss_disc_real_3: 0.3491005301475525 (0.3378996253013611) | > loss_disc_real_4: 0.1439000815153122 (0.1655194809039434) | > loss_disc_real_5: 0.23267599940299988 (0.2218263124426206) | > loss_0: 2.108931303024292 (2.1675256888071694) | > loss_gen: 3.2939107418060303 (3.2013235092163086) | > loss_kl: 1.543752908706665 (2.8838014602661133) | > loss_feat: 6.663319110870361 (7.701931953430176) | > loss_mel: 21.574796676635742 (23.52423604329427) | > loss_duration: 2.58596134185791 (2.5887632369995117) | > loss_1: 35.661739349365234 (39.90005620320638) --> EVAL PERFORMANCE | > avg_loader_time: 0.004788557688395183 (-0.33641485940842397) | > avg_loss_disc: 2.1675256888071694 (-0.2979464644477483) | > avg_loss_disc_real_0: 0.09535411496957143 (-0.10211686958514508) | > avg_loss_disc_real_1: 0.2202624479929606 (-0.06812310076895214) | > avg_loss_disc_real_2: 0.2761597881714503 (+0.07893699868803936) | > avg_loss_disc_real_3: 0.3378996253013611 (+0.08709117344447542) | > avg_loss_disc_real_4: 0.1655194809039434 (-0.07418513439950489) | > avg_loss_disc_real_5: 0.2218263124426206 (-0.001046870790776755) | > avg_loss_0: 2.1675256888071694 (-0.2979464644477483) | > avg_loss_gen: 3.2013235092163086 (+0.8601781811032976) | > avg_loss_kl: 2.8838014602661133 (-0.2559950351715088) | > avg_loss_feat: 7.701931953430176 (+3.094050045524325) | > avg_loss_mel: 23.52423604329427 (+0.4065335591634103) | > avg_loss_duration: 2.5887632369995117 (+0.013016121728079533) | > avg_loss_1: 39.90005620320638 (+4.117781956990562)  > EPOCH: 341/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:23:33)   --> TIME: 2023-10-20 03:23:52 -- STEP: 29/50 -- GLOBAL_STEP: 70080 | > loss_disc: 2.4425950050354004 (2.4646310765167763) | > loss_disc_real_0: 0.19434672594070435 (0.17255651225046864) | > loss_disc_real_1: 0.300507128238678 (0.21629417661962838) | > loss_disc_real_2: 0.23566369712352753 (0.2246678327691966) | > loss_disc_real_3: 0.24747635424137115 (0.22768692376798597) | > loss_disc_real_4: 0.24191083014011383 (0.22800226689412675) | > loss_disc_real_5: 0.15640324354171753 (0.2203698457973399) | > loss_0: 2.4425950050354004 (2.4646310765167763) | > grad_norm_0: tensor(462.9486, device='cuda:0') (tensor(645.7734, device='cuda:0')) | > loss_gen: 2.7256600856781006 (2.481626638050737) | > loss_kl: 0.6519210934638977 (0.9822060712452593) | > loss_feat: 5.582294940948486 (6.102908921138994) | > loss_mel: 23.090978622436523 (22.464035326036914) | > loss_duration: 1.559837818145752 (1.5711222023799503) | > loss_1: 33.61069107055664 (33.601898949721765) | > grad_norm_1: tensor(29815.8320, device='cuda:0') (tensor(22131.5879, device='cuda:0')) | > current_lr_0: 0.00014220875053237491 | > current_lr_1: 0.00014220875053237491 | > step_time: 0.6882 (0.5167762164411873) | > loader_time: 0.023 (0.018349729735275797)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.452930450439453 (2.452930450439453) | > loss_disc_real_0: 0.07355014234781265 (0.07355014234781265) | > loss_disc_real_1: 0.37930870056152344 (0.37930870056152344) | > loss_disc_real_2: 0.2219567894935608 (0.2219567894935608) | > loss_disc_real_3: 0.2809111475944519 (0.2809111475944519) | > loss_disc_real_4: 0.22413857281208038 (0.22413857281208038) | > loss_disc_real_5: 0.15909560024738312 (0.15909560024738312) | > loss_0: 2.452930450439453 (2.452930450439453) | > loss_gen: 2.248098373413086 (2.248098373413086) | > loss_kl: 3.377290964126587 (3.377290964126587) | > loss_feat: 8.569598197937012 (8.569598197937012) | > loss_mel: 25.03965187072754 (25.03965187072754) | > loss_duration: 2.306608200073242 (2.306608200073242) | > loss_1: 41.54125213623047 (41.54125213623047)  --> STEP: 1 | > loss_disc: 2.6537280082702637 (2.6537280082702637) | > loss_disc_real_0: 0.0813184604048729 (0.0813184604048729) | > loss_disc_real_1: 0.35056382417678833 (0.35056382417678833) | > loss_disc_real_2: 0.14984625577926636 (0.14984625577926636) | > loss_disc_real_3: 0.3787107467651367 (0.3787107467651367) | > loss_disc_real_4: 0.28571727871894836 (0.28571727871894836) | > loss_disc_real_5: 0.2272661328315735 (0.2272661328315735) | > loss_0: 2.6537280082702637 (2.6537280082702637) | > loss_gen: 2.069227695465088 (2.069227695465088) | > loss_kl: 3.2643961906433105 (3.2643961906433105) | > loss_feat: 4.780848503112793 (4.780848503112793) | > loss_mel: 24.31748390197754 (24.31748390197754) | > loss_duration: 2.594433069229126 (2.594433069229126) | > loss_1: 37.026390075683594 (37.026390075683594)  --> STEP: 2 | > loss_disc: 1.9385790824890137 (2.2961535453796387) | > loss_disc_real_0: 0.15178321301937103 (0.11655083671212196) | > loss_disc_real_1: 0.2532811760902405 (0.3019225001335144) | > loss_disc_real_2: 0.11342659592628479 (0.13163642585277557) | > loss_disc_real_3: 0.1714576780796051 (0.2750842124223709) | > loss_disc_real_4: 0.07766829431056976 (0.18169278651475906) | > loss_disc_real_5: 0.06416548788547516 (0.14571581035852432) | > loss_0: 1.9385790824890137 (2.2961535453796387) | > loss_gen: 2.201869010925293 (2.1355483531951904) | > loss_kl: 3.4013960361480713 (3.332896113395691) | > loss_feat: 9.951753616333008 (7.3663010597229) | > loss_mel: 26.440900802612305 (25.379192352294922) | > loss_duration: 2.555727243423462 (2.575080156326294) | > loss_1: 44.55165100097656 (40.78902053833008)  --> STEP: 3 | > loss_disc: 2.934925079345703 (2.5090773900349936) | > loss_disc_real_0: 0.3100447356700897 (0.18104880303144455) | > loss_disc_real_1: 0.290012925863266 (0.2979526420434316) | > loss_disc_real_2: 0.2800106406211853 (0.18109449744224548) | > loss_disc_real_3: 0.2518874406814575 (0.2673519551753998) | > loss_disc_real_4: 0.2569742500782013 (0.20678660770257315) | > loss_disc_real_5: 0.22639425098896027 (0.17260862390200296) | > loss_0: 2.934925079345703 (2.5090773900349936) | > loss_gen: 1.7029428482055664 (1.9913465181986492) | > loss_kl: 1.6626996994018555 (2.7761639753977456) | > loss_feat: 0.4299287796020508 (5.054176966349284) | > loss_mel: 3.8631210327148438 (18.207168579101562) | > loss_duration: 2.5338919162750244 (2.5613507429758706) | > loss_1: 10.192584037780762 (30.590208371480305) --> EVAL PERFORMANCE | > avg_loader_time: 0.012179931004842123 (+0.00739137331644694) | > avg_loss_disc: 2.5090773900349936 (+0.3415517012278242) | > avg_loss_disc_real_0: 0.18104880303144455 (+0.08569468806187312) | > avg_loss_disc_real_1: 0.2979526420434316 (+0.07769019405047098) | > avg_loss_disc_real_2: 0.18109449744224548 (-0.09506529072920483) | > avg_loss_disc_real_3: 0.2673519551753998 (-0.0705476701259613) | > avg_loss_disc_real_4: 0.20678660770257315 (+0.04126712679862976) | > avg_loss_disc_real_5: 0.17260862390200296 (-0.04921768854061764) | > avg_loss_0: 2.5090773900349936 (+0.3415517012278242) | > avg_loss_gen: 1.9913465181986492 (-1.2099769910176594) | > avg_loss_kl: 2.7761639753977456 (-0.10763748486836766) | > avg_loss_feat: 5.054176966349284 (-2.6477549870808916) | > avg_loss_mel: 18.207168579101562 (-5.317067464192707) | > avg_loss_duration: 2.5613507429758706 (-0.0274124940236411) | > avg_loss_1: 30.590208371480305 (-9.309847831726078)  > EPOCH: 342/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:24:14)   --> TIME: 2023-10-20 03:24:23 -- STEP: 9/50 -- GLOBAL_STEP: 70110 | > loss_disc: 2.7433831691741943 (2.2355829079945884) | > loss_disc_real_0: 0.3430812358856201 (0.12267889599833223) | > loss_disc_real_1: 0.27810123562812805 (0.2101643801563316) | > loss_disc_real_2: 0.3703603744506836 (0.19222775350014368) | > loss_disc_real_3: 0.345124214887619 (0.24602306137482324) | > loss_disc_real_4: 0.3202483654022217 (0.2503823524134027) | > loss_disc_real_5: 0.3867241144180298 (0.23508861909310022) | > loss_0: 2.7433831691741943 (2.2355829079945884) | > grad_norm_0: tensor(596.1639, device='cuda:0') (tensor(422.1595, device='cuda:0')) | > loss_gen: 2.93066143989563 (2.5641663869222007) | > loss_kl: 1.0111980438232422 (1.112627214855618) | > loss_feat: 4.863122463226318 (6.231866174274021) | > loss_mel: 25.298336029052734 (24.983356687757706) | > loss_duration: 1.5032858848571777 (1.5217935111787584) | > loss_1: 35.60660171508789 (36.413809882269966) | > grad_norm_1: tensor(15915.2471, device='cuda:0') (tensor(13646.3691, device='cuda:0')) | > current_lr_0: 0.00014206660398261923 | > current_lr_1: 0.00014206660398261923 | > step_time: 0.2868 (0.4041111204359267) | > loader_time: 0.0129 (0.010172128677368164)  --> TIME: 2023-10-20 03:24:37 -- STEP: 39/50 -- GLOBAL_STEP: 70140 | > loss_disc: 2.187314510345459 (2.3637540187591166) | > loss_disc_real_0: 0.15464802086353302 (0.1446162597873272) | > loss_disc_real_1: 0.21065914630889893 (0.2330429699176397) | > loss_disc_real_2: 0.2130390703678131 (0.21473980828737602) | > loss_disc_real_3: 0.2411108762025833 (0.2606266602300681) | > loss_disc_real_4: 0.1055329293012619 (0.22455242462456226) | > loss_disc_real_5: 0.1735949069261551 (0.23286335571454123) | > loss_0: 2.187314510345459 (2.3637540187591166) | > grad_norm_0: tensor(549.7197, device='cuda:0') (tensor(603.2481, device='cuda:0')) | > loss_gen: 2.624433994293213 (2.503813486832839) | > loss_kl: 0.8089206218719482 (0.9176621347283705) | > loss_feat: 5.998547077178955 (5.6086940016502) | > loss_mel: 23.408367156982422 (24.111725782736755) | > loss_duration: 1.608307957649231 (1.5544878886296198) | > loss_1: 34.448577880859375 (34.696383109459525) | > grad_norm_1: tensor(53426.2812, device='cuda:0') (tensor(23391.8281, device='cuda:0')) | > current_lr_0: 0.00014206660398261923 | > current_lr_1: 0.00014206660398261923 | > step_time: 0.5496 (0.4351229789929512) | > loader_time: 0.0109 (0.012048244476318358)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.388939380645752 (2.388939380645752) | > loss_disc_real_0: 0.4611831307411194 (0.4611831307411194) | > loss_disc_real_1: 0.24822157621383667 (0.24822157621383667) | > loss_disc_real_2: 0.19345442950725555 (0.19345442950725555) | > loss_disc_real_3: 0.2827953100204468 (0.2827953100204468) | > loss_disc_real_4: 0.236475870013237 (0.236475870013237) | > loss_disc_real_5: 0.17221590876579285 (0.17221590876579285) | > loss_0: 2.388939380645752 (2.388939380645752) | > loss_gen: 3.6192805767059326 (3.6192805767059326) | > loss_kl: 2.8439888954162598 (2.8439888954162598) | > loss_feat: 6.1623215675354 (6.1623215675354) | > loss_mel: 21.960481643676758 (21.960481643676758) | > loss_duration: 2.4092495441436768 (2.4092495441436768) | > loss_1: 36.995323181152344 (36.995323181152344)  --> STEP: 1 | > loss_disc: 2.569580078125 (2.569580078125) | > loss_disc_real_0: 0.35288500785827637 (0.35288500785827637) | > loss_disc_real_1: 0.22700797021389008 (0.22700797021389008) | > loss_disc_real_2: 0.224076047539711 (0.224076047539711) | > loss_disc_real_3: 0.29694101214408875 (0.29694101214408875) | > loss_disc_real_4: 0.21012286841869354 (0.21012286841869354) | > loss_disc_real_5: 0.11356667429208755 (0.11356667429208755) | > loss_0: 2.569580078125 (2.569580078125) | > loss_gen: 2.2034406661987305 (2.2034406661987305) | > loss_kl: 3.6485376358032227 (3.6485376358032227) | > loss_feat: 2.909421682357788 (2.909421682357788) | > loss_mel: 24.8243408203125 (24.8243408203125) | > loss_duration: 2.6525192260742188 (2.6525192260742188) | > loss_1: 36.23826217651367 (36.23826217651367)  --> STEP: 2 | > loss_disc: 3.0643768310546875 (2.8169784545898438) | > loss_disc_real_0: 0.6144870519638062 (0.48368602991104126) | > loss_disc_real_1: 0.27222469449043274 (0.2496163323521614) | > loss_disc_real_2: 0.32324934005737305 (0.273662693798542) | > loss_disc_real_3: 0.3400963544845581 (0.3185186833143234) | > loss_disc_real_4: 0.3171041011810303 (0.2636134847998619) | > loss_disc_real_5: 0.29154640436172485 (0.2025565393269062) | > loss_0: 3.0643768310546875 (2.8169784545898438) | > loss_gen: 2.9864652156829834 (2.594952940940857) | > loss_kl: 3.679802656173706 (3.6641701459884644) | > loss_feat: 4.239877700805664 (3.574649691581726) | > loss_mel: 29.112232208251953 (26.968286514282227) | > loss_duration: 2.6323657035827637 (2.642442464828491) | > loss_1: 42.6507453918457 (39.44450378417969)  --> STEP: 3 | > loss_disc: 2.5010480880737305 (2.711668332417806) | > loss_disc_real_0: 0.2141638994216919 (0.3938453197479248) | > loss_disc_real_1: 0.2889801263809204 (0.2627375970284144) | > loss_disc_real_2: 0.23619914054870605 (0.26117484271526337) | > loss_disc_real_3: 0.21202810108661652 (0.28302182257175446) | > loss_disc_real_4: 0.18111620843410492 (0.2361143926779429) | > loss_disc_real_5: 0.1772823929786682 (0.19413182387749353) | > loss_0: 2.5010480880737305 (2.711668332417806) | > loss_gen: 2.0058460235595703 (2.398583968480428) | > loss_kl: 2.1908857822418213 (3.1730753580729165) | > loss_feat: 3.4043850898742676 (3.5178948243459067) | > loss_mel: 11.480447769165039 (21.805673599243164) | > loss_duration: 2.5941638946533203 (2.626349608103434) | > loss_1: 21.67572784423828 (33.52157847086588) --> EVAL PERFORMANCE | > avg_loader_time: 0.016454776128133137 (+0.004274845123291014) | > avg_loss_disc: 2.711668332417806 (+0.2025909423828125) | > avg_loss_disc_real_0: 0.3938453197479248 (+0.21279651671648026) | > avg_loss_disc_real_1: 0.2627375970284144 (-0.035215045015017155) | > avg_loss_disc_real_2: 0.26117484271526337 (+0.08008034527301788) | > avg_loss_disc_real_3: 0.28302182257175446 (+0.015669867396354675) | > avg_loss_disc_real_4: 0.2361143926779429 (+0.029327784975369753) | > avg_loss_disc_real_5: 0.19413182387749353 (+0.02152319997549057) | > avg_loss_0: 2.711668332417806 (+0.2025909423828125) | > avg_loss_gen: 2.398583968480428 (+0.40723745028177905) | > avg_loss_kl: 3.1730753580729165 (+0.3969113826751709) | > avg_loss_feat: 3.5178948243459067 (-1.5362821420033774) | > avg_loss_mel: 21.805673599243164 (+3.5985050201416016) | > avg_loss_duration: 2.626349608103434 (+0.06499886512756348) | > avg_loss_1: 33.52157847086588 (+2.9313700993855782)  > EPOCH: 343/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:24:51)   --> TIME: 2023-10-20 03:25:04 -- STEP: 19/50 -- GLOBAL_STEP: 70170 | > loss_disc: 1.8666521310806274 (2.275739908218384) | > loss_disc_real_0: 0.03921941667795181 (0.1350427055241246) | > loss_disc_real_1: 0.17133712768554688 (0.2296242343359872) | > loss_disc_real_2: 0.17543363571166992 (0.21519142036375247) | > loss_disc_real_3: 0.21404585242271423 (0.2427739395122779) | > loss_disc_real_4: 0.11381084471940994 (0.18281657993793488) | > loss_disc_real_5: 0.06574418395757675 (0.17352402680798582) | > loss_0: 1.8666521310806274 (2.275739908218384) | > grad_norm_0: tensor(708.5128, device='cuda:0') (tensor(609.5153, device='cuda:0')) | > loss_gen: 2.2962844371795654 (2.488320840032477) | > loss_kl: 1.2654505968093872 (0.9382350852614955) | > loss_feat: 5.240903854370117 (5.416594321790495) | > loss_mel: 22.431983947753906 (23.462647889789782) | > loss_duration: 1.6685678958892822 (1.6256029480382015) | > loss_1: 32.90319061279297 (33.9314011774565) | > grad_norm_1: tensor(3208.6362, device='cuda:0') (tensor(25044.9355, device='cuda:0')) | > current_lr_0: 0.00014192459951723973 | > current_lr_1: 0.00014192459951723973 | > step_time: 0.288 (0.48293993347569514) | > loader_time: 0.0231 (0.019127030121652705)  --> TIME: 2023-10-20 03:25:16 -- STEP: 49/50 -- GLOBAL_STEP: 70200 | > loss_disc: 2.534754753112793 (2.3528732377655652) | > loss_disc_real_0: 0.1360914409160614 (0.15089120789031893) | > loss_disc_real_1: 0.2589731812477112 (0.21922428594255933) | > loss_disc_real_2: 0.21035225689411163 (0.22773638109163363) | > loss_disc_real_3: 0.2689635753631592 (0.2375712676011786) | > loss_disc_real_4: 0.2665919065475464 (0.2213439375010072) | > loss_disc_real_5: 0.24266491830348969 (0.1976392903574267) | > loss_0: 2.534754753112793 (2.3528732377655652) | > grad_norm_0: tensor(504.3116, device='cuda:0') (tensor(582.8518, device='cuda:0')) | > loss_gen: 2.198408842086792 (2.471482882694321) | > loss_kl: 1.0247858762741089 (0.8743993840655502) | > loss_feat: 3.3499879837036133 (5.685272666264553) | > loss_mel: 22.546152114868164 (23.02813338260262) | > loss_duration: 1.686414361000061 (1.57389036733277) | > loss_1: 30.805747985839844 (33.63317885690806) | > grad_norm_1: tensor(13766.8887, device='cuda:0') (tensor(23522.6406, device='cuda:0')) | > current_lr_0: 0.00014192459951723973 | > current_lr_1: 0.00014192459951723973 | > step_time: 0.2637 (0.40813569146759654) | > loader_time: 0.3756 (0.020299040541356922)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9957377910614014 (2.9957377910614014) | > loss_disc_real_0: 0.2166750431060791 (0.2166750431060791) | > loss_disc_real_1: 0.14194270968437195 (0.14194270968437195) | > loss_disc_real_2: 0.15409362316131592 (0.15409362316131592) | > loss_disc_real_3: 0.198280930519104 (0.198280930519104) | > loss_disc_real_4: 0.15434007346630096 (0.15434007346630096) | > loss_disc_real_5: 0.12488158792257309 (0.12488158792257309) | > loss_0: 2.9957377910614014 (2.9957377910614014) | > loss_gen: 1.2726320028305054 (1.2726320028305054) | > loss_kl: 3.015864610671997 (3.015864610671997) | > loss_feat: 4.677675247192383 (4.677675247192383) | > loss_mel: 16.711917877197266 (16.711917877197266) | > loss_duration: 2.3888051509857178 (2.3888051509857178) | > loss_1: 28.06689453125 (28.06689453125)  --> STEP: 1 | > loss_disc: 2.9183201789855957 (2.9183201789855957) | > loss_disc_real_0: 0.2539166808128357 (0.2539166808128357) | > loss_disc_real_1: 0.1702980101108551 (0.1702980101108551) | > loss_disc_real_2: 0.15756720304489136 (0.15756720304489136) | > loss_disc_real_3: 0.2340346723794937 (0.2340346723794937) | > loss_disc_real_4: 0.3231588900089264 (0.3231588900089264) | > loss_disc_real_5: 0.2787485122680664 (0.2787485122680664) | > loss_0: 2.9183201789855957 (2.9183201789855957) | > loss_gen: 1.6817282438278198 (1.6817282438278198) | > loss_kl: 3.6158697605133057 (3.6158697605133057) | > loss_feat: 1.2236900329589844 (1.2236900329589844) | > loss_mel: 19.454349517822266 (19.454349517822266) | > loss_duration: 2.6192879676818848 (2.6192879676818848) | > loss_1: 28.594924926757812 (28.594924926757812)  --> STEP: 2 | > loss_disc: 3.5311927795410156 (3.2247564792633057) | > loss_disc_real_0: 0.3152315020561218 (0.28457409143447876) | > loss_disc_real_1: 0.2559809684753418 (0.21313948929309845) | > loss_disc_real_2: 0.39969098567962646 (0.2786290943622589) | > loss_disc_real_3: 0.5216901898384094 (0.37786243110895157) | > loss_disc_real_4: 0.4011402726173401 (0.36214958131313324) | > loss_disc_real_5: 0.4429665207862854 (0.3608575165271759) | > loss_0: 3.5311927795410156 (3.2247564792633057) | > loss_gen: 2.062136173248291 (1.8719322085380554) | > loss_kl: 3.107294797897339 (3.3615822792053223) | > loss_feat: 4.470264434814453 (2.8469772338867188) | > loss_mel: 28.247961044311523 (23.851155281066895) | > loss_duration: 2.588120460510254 (2.6037042140960693) | > loss_1: 40.47577667236328 (34.53535079956055)  --> STEP: 3 | > loss_disc: 3.156397581100464 (3.201970179875692) | > loss_disc_real_0: 0.2705484628677368 (0.27989888191223145) | > loss_disc_real_1: 0.29330557584762573 (0.23986151814460754) | > loss_disc_real_2: 0.3315029740333557 (0.2962537209192912) | > loss_disc_real_3: 0.30173739790916443 (0.35248742004235584) | > loss_disc_real_4: 0.44060757756233215 (0.3883022467295329) | > loss_disc_real_5: 0.4293390214443207 (0.3836846848328908) | > loss_0: 3.156397581100464 (3.201970179875692) | > loss_gen: 2.2224552631378174 (1.988773226737976) | > loss_kl: 1.9407223463058472 (2.887962301572164) | > loss_feat: 3.3617961406707764 (3.0185835361480713) | > loss_mel: 25.782739639282227 (24.49501673380534) | > loss_duration: 2.599886894226074 (2.6024317741394043) | > loss_1: 35.90760040283203 (34.992767333984375) --> EVAL PERFORMANCE | > avg_loader_time: 0.01398317019144694 (-0.0024716059366861973) | > avg_loss_disc: 3.201970179875692 (+0.49030184745788574) | > avg_loss_disc_real_0: 0.27989888191223145 (-0.11394643783569336) | > avg_loss_disc_real_1: 0.23986151814460754 (-0.022876078883806883) | > avg_loss_disc_real_2: 0.2962537209192912 (+0.03507887820402783) | > avg_loss_disc_real_3: 0.35248742004235584 (+0.06946559747060138) | > avg_loss_disc_real_4: 0.3883022467295329 (+0.15218785405159) | > avg_loss_disc_real_5: 0.3836846848328908 (+0.18955286095539728) | > avg_loss_0: 3.201970179875692 (+0.49030184745788574) | > avg_loss_gen: 1.988773226737976 (-0.40981074174245213) | > avg_loss_kl: 2.887962301572164 (-0.28511305650075247) | > avg_loss_feat: 3.0185835361480713 (-0.49931128819783543) | > avg_loss_mel: 24.49501673380534 (+2.6893431345621757) | > avg_loss_duration: 2.6024317741394043 (-0.0239178339640298) | > avg_loss_1: 34.992767333984375 (+1.471188863118492)  > EPOCH: 344/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:25:31)   --> TIME: 2023-10-20 03:25:50 -- STEP: 29/50 -- GLOBAL_STEP: 70230 | > loss_disc: 2.651695966720581 (2.326007086655189) | > loss_disc_real_0: 0.1186935156583786 (0.1355219287797809) | > loss_disc_real_1: 0.17781130969524384 (0.22495166122399526) | > loss_disc_real_2: 0.13753654062747955 (0.2321307621896267) | > loss_disc_real_3: 0.1985633373260498 (0.23604844985850926) | > loss_disc_real_4: 0.19422340393066406 (0.20675715315958548) | > loss_disc_real_5: 0.32955676317214966 (0.19616570432895217) | > loss_0: 2.651695966720581 (2.326007086655189) | > grad_norm_0: tensor(551.3060, device='cuda:0') (tensor(618.7924, device='cuda:0')) | > loss_gen: 1.6762803792953491 (2.545586417461263) | > loss_kl: 1.0827771425247192 (1.0605758223040354) | > loss_feat: 1.7694330215454102 (6.31285251471503) | > loss_mel: 18.858169555664062 (23.023048894158727) | > loss_duration: 1.5099008083343506 (1.5743994055123165) | > loss_1: 24.896562576293945 (34.516462983756234) | > grad_norm_1: tensor(3380.5481, device='cuda:0') (tensor(24000.8965, device='cuda:0')) | > current_lr_0: 0.00014178273699421413 | > current_lr_1: 0.00014178273699421413 | > step_time: 0.6349 (0.5026368437142208) | > loader_time: 0.0112 (0.019526489849748283)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1097238063812256 (2.1097238063812256) | > loss_disc_real_0: 0.07048368453979492 (0.07048368453979492) | > loss_disc_real_1: 0.20638255774974823 (0.20638255774974823) | > loss_disc_real_2: 0.24681702256202698 (0.24681702256202698) | > loss_disc_real_3: 0.2567237317562103 (0.2567237317562103) | > loss_disc_real_4: 0.11020077019929886 (0.11020077019929886) | > loss_disc_real_5: 0.0479281060397625 (0.0479281060397625) | > loss_0: 2.1097238063812256 (2.1097238063812256) | > loss_gen: 2.1863839626312256 (2.1863839626312256) | > loss_kl: 2.7831201553344727 (2.7831201553344727) | > loss_feat: 5.328021049499512 (5.328021049499512) | > loss_mel: 22.672481536865234 (22.672481536865234) | > loss_duration: 2.3937301635742188 (2.3937301635742188) | > loss_1: 35.36373519897461 (35.36373519897461)  --> STEP: 1 | > loss_disc: 2.405269145965576 (2.405269145965576) | > loss_disc_real_0: 0.09669418632984161 (0.09669418632984161) | > loss_disc_real_1: 0.10028016567230225 (0.10028016567230225) | > loss_disc_real_2: 0.07901712507009506 (0.07901712507009506) | > loss_disc_real_3: 0.3221389055252075 (0.3221389055252075) | > loss_disc_real_4: 0.1937168687582016 (0.1937168687582016) | > loss_disc_real_5: 0.10787272453308105 (0.10787272453308105) | > loss_0: 2.405269145965576 (2.405269145965576) | > loss_gen: 1.7820550203323364 (1.7820550203323364) | > loss_kl: 3.229663133621216 (3.229663133621216) | > loss_feat: 7.29496955871582 (7.29496955871582) | > loss_mel: 24.086894989013672 (24.086894989013672) | > loss_duration: 2.59978985786438 (2.59978985786438) | > loss_1: 38.993370056152344 (38.993370056152344)  --> STEP: 2 | > loss_disc: 3.2985734939575195 (2.851921319961548) | > loss_disc_real_0: 0.09953128546476364 (0.09811273589730263) | > loss_disc_real_1: 0.2519616186618805 (0.17612089216709137) | > loss_disc_real_2: 0.26492947340011597 (0.17197329923510551) | > loss_disc_real_3: 0.3158262073993683 (0.3189825564622879) | > loss_disc_real_4: 0.2672055959701538 (0.2304612323641777) | > loss_disc_real_5: 0.2539795935153961 (0.1809261590242386) | > loss_0: 3.2985734939575195 (2.851921319961548) | > loss_gen: 1.283538818359375 (1.5327969193458557) | > loss_kl: 3.8570077419281006 (3.543335437774658) | > loss_feat: 1.0632421970367432 (4.179105877876282) | > loss_mel: 18.496013641357422 (21.291454315185547) | > loss_duration: 2.6957144737243652 (2.6477521657943726) | > loss_1: 27.395517349243164 (33.194443702697754)  --> STEP: 3 | > loss_disc: 1.570085048675537 (2.424642562866211) | > loss_disc_real_0: 0.05008764564990997 (0.08210437248150508) | > loss_disc_real_1: 0.08772049099206924 (0.14665409177541733) | > loss_disc_real_2: 0.08060422539710999 (0.141516941289107) | > loss_disc_real_3: 0.26556673645973206 (0.3011772831281026) | > loss_disc_real_4: 0.034329358488321304 (0.16508394107222557) | > loss_disc_real_5: 0.03644854947924614 (0.13276695584257445) | > loss_0: 1.570085048675537 (2.424642562866211) | > loss_gen: 2.6275105476379395 (1.8977014621098836) | > loss_kl: 1.5911847352981567 (2.8926185369491577) | > loss_feat: 9.322876930236816 (5.893696228663127) | > loss_mel: 24.689525604248047 (22.424144744873047) | > loss_duration: 2.493513822555542 (2.596339384714762) | > loss_1: 40.724613189697266 (35.70450019836426) --> EVAL PERFORMANCE | > avg_loader_time: 0.009112119674682617 (-0.004871050516764322) | > avg_loss_disc: 2.424642562866211 (-0.7773276170094809) | > avg_loss_disc_real_0: 0.08210437248150508 (-0.19779450943072635) | > avg_loss_disc_real_1: 0.14665409177541733 (-0.09320742636919022) | > avg_loss_disc_real_2: 0.141516941289107 (-0.1547367796301842) | > avg_loss_disc_real_3: 0.3011772831281026 (-0.051310136914253235) | > avg_loss_disc_real_4: 0.16508394107222557 (-0.22321830565730733) | > avg_loss_disc_real_5: 0.13276695584257445 (-0.2509177289903164) | > avg_loss_0: 2.424642562866211 (-0.7773276170094809) | > avg_loss_gen: 1.8977014621098836 (-0.09107176462809252) | > avg_loss_kl: 2.8926185369491577 (+0.004656235376993667) | > avg_loss_feat: 5.893696228663127 (+2.8751126925150556) | > avg_loss_mel: 22.424144744873047 (-2.070871988932293) | > avg_loss_duration: 2.596339384714762 (-0.006092389424642075) | > avg_loss_1: 35.70450019836426 (+0.7117328643798828)  > EPOCH: 345/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:26:12)   --> TIME: 2023-10-20 03:26:19 -- STEP: 9/50 -- GLOBAL_STEP: 70260 | > loss_disc: 2.76523756980896 (2.306244240866767) | > loss_disc_real_0: 0.0962044894695282 (0.20238594131337273) | > loss_disc_real_1: 0.2795157730579376 (0.22392566005388895) | > loss_disc_real_2: 0.18391598761081696 (0.2423282414674759) | > loss_disc_real_3: 0.2953503429889679 (0.2609870392415259) | > loss_disc_real_4: 0.21437764167785645 (0.1739435518781344) | > loss_disc_real_5: 0.27933716773986816 (0.18998457988103232) | > loss_0: 2.76523756980896 (2.306244240866767) | > grad_norm_0: tensor(1820.8317, device='cuda:0') (tensor(862.0413, device='cuda:0')) | > loss_gen: 1.7025015354156494 (2.735501872168647) | > loss_kl: 0.6167154908180237 (0.9683671858575609) | > loss_feat: 0.9517005085945129 (5.967820968892839) | > loss_mel: 10.08659839630127 (22.036649386088055) | > loss_duration: 1.5148736238479614 (1.542753365304735) | > loss_1: 14.87238883972168 (33.25109312269423) | > grad_norm_1: tensor(10863.4658, device='cuda:0') (tensor(31672.5488, device='cuda:0')) | > current_lr_0: 0.00014164101627166223 | > current_lr_1: 0.00014164101627166223 | > step_time: 0.3288 (0.35990823639763725) | > loader_time: 0.003 (0.00516359011332194)  --> TIME: 2023-10-20 03:26:34 -- STEP: 39/50 -- GLOBAL_STEP: 70290 | > loss_disc: 2.9354805946350098 (2.5542130944056387) | > loss_disc_real_0: 0.2602103352546692 (0.18347438281545272) | > loss_disc_real_1: 0.24715498089790344 (0.23278985420862833) | > loss_disc_real_2: 0.2513441741466522 (0.2337215986007299) | > loss_disc_real_3: 0.2467670738697052 (0.25955312613111275) | > loss_disc_real_4: 0.24157178401947021 (0.23554612815571138) | > loss_disc_real_5: 0.29428377747535706 (0.23563189541873258) | > loss_0: 2.9354805946350098 (2.5542130944056387) | > grad_norm_0: tensor(220.2503, device='cuda:0') (tensor(644.5585, device='cuda:0')) | > loss_gen: 1.6596423387527466 (2.3168757053521962) | > loss_kl: 0.7312362790107727 (0.9514417441991659) | > loss_feat: 0.34047237038612366 (4.411142729986936) | > loss_mel: 8.339247703552246 (20.797323826031807) | > loss_duration: 1.633109450340271 (1.5561423699061074) | > loss_1: 12.703707695007324 (30.032926645034404) | > grad_norm_1: tensor(24085.4824, device='cuda:0') (tensor(21697.6484, device='cuda:0')) | > current_lr_0: 0.00014164101627166223 | > current_lr_1: 0.00014164101627166223 | > step_time: 0.2826 (0.44221175022614306) | > loader_time: 0.0248 (0.011182247064052483)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.114668846130371 (2.114668846130371) | > loss_disc_real_0: 0.06494998186826706 (0.06494998186826706) | > loss_disc_real_1: 0.1567644625902176 (0.1567644625902176) | > loss_disc_real_2: 0.10471121966838837 (0.10471121966838837) | > loss_disc_real_3: 0.1638370156288147 (0.1638370156288147) | > loss_disc_real_4: 0.0711171105504036 (0.0711171105504036) | > loss_disc_real_5: 0.06378348171710968 (0.06378348171710968) | > loss_0: 2.114668846130371 (2.114668846130371) | > loss_gen: 2.3497543334960938 (2.3497543334960938) | > loss_kl: 3.1987245082855225 (3.1987245082855225) | > loss_feat: 9.021344184875488 (9.021344184875488) | > loss_mel: 29.10158348083496 (29.10158348083496) | > loss_duration: 2.4262094497680664 (2.4262094497680664) | > loss_1: 46.09761428833008 (46.09761428833008)  --> STEP: 1 | > loss_disc: 2.4230363368988037 (2.4230363368988037) | > loss_disc_real_0: 0.28354936838150024 (0.28354936838150024) | > loss_disc_real_1: 0.2385035753250122 (0.2385035753250122) | > loss_disc_real_2: 0.18559330701828003 (0.18559330701828003) | > loss_disc_real_3: 0.3119089603424072 (0.3119089603424072) | > loss_disc_real_4: 0.21121624112129211 (0.21121624112129211) | > loss_disc_real_5: 0.29920485615730286 (0.29920485615730286) | > loss_0: 2.4230363368988037 (2.4230363368988037) | > loss_gen: 2.7377238273620605 (2.7377238273620605) | > loss_kl: 3.4960944652557373 (3.4960944652557373) | > loss_feat: 5.944504737854004 (5.944504737854004) | > loss_mel: 25.397729873657227 (25.397729873657227) | > loss_duration: 2.7357921600341797 (2.7357921600341797) | > loss_1: 40.31184387207031 (40.31184387207031)  --> STEP: 2 | > loss_disc: 2.8202619552612305 (2.621649146080017) | > loss_disc_real_0: 0.19548816978931427 (0.23951876908540726) | > loss_disc_real_1: 0.2139981985092163 (0.22625088691711426) | > loss_disc_real_2: 0.2833779454231262 (0.23448562622070312) | > loss_disc_real_3: 0.2912198603153229 (0.30156441032886505) | > loss_disc_real_4: 0.37347719073295593 (0.292346715927124) | > loss_disc_real_5: 0.3417983651161194 (0.3205016106367111) | > loss_0: 2.8202619552612305 (2.621649146080017) | > loss_gen: 2.1865715980529785 (2.4621477127075195) | > loss_kl: 4.070572376251221 (3.783333420753479) | > loss_feat: 3.0720574855804443 (4.508281111717224) | > loss_mel: 23.298051834106445 (24.347890853881836) | > loss_duration: 2.7997047901153564 (2.767748475074768) | > loss_1: 35.42695999145508 (37.869401931762695)  --> STEP: 3 | > loss_disc: 2.7655012607574463 (2.6695998509724936) | > loss_disc_real_0: 0.3810284733772278 (0.2866886705160141) | > loss_disc_real_1: 0.3924398422241211 (0.2816472053527832) | > loss_disc_real_2: 0.3161364197731018 (0.261702557404836) | > loss_disc_real_3: 0.2922487258911133 (0.2984591821829478) | > loss_disc_real_4: 0.30700555443763733 (0.2972329954306285) | > loss_disc_real_5: 0.35257643461227417 (0.3311932186285655) | > loss_0: 2.7655012607574463 (2.6695998509724936) | > loss_gen: 2.9993135929107666 (2.641203006108602) | > loss_kl: 1.4985074996948242 (3.0217247804005942) | > loss_feat: 4.1470627784729 (4.387875000635783) | > loss_mel: 24.081607818603516 (24.259129842122395) | > loss_duration: 2.5570154190063477 (2.6975041230519614) | > loss_1: 35.28350830078125 (37.00743738810221) --> EVAL PERFORMANCE | > avg_loader_time: 0.010492483774820963 (+0.0013803641001383458) | > avg_loss_disc: 2.6695998509724936 (+0.2449572881062827) | > avg_loss_disc_real_0: 0.2866886705160141 (+0.204584298034509) | > avg_loss_disc_real_1: 0.2816472053527832 (+0.13499311357736588) | > avg_loss_disc_real_2: 0.261702557404836 (+0.120185616115729) | > avg_loss_disc_real_3: 0.2984591821829478 (-0.002718100945154789) | > avg_loss_disc_real_4: 0.2972329954306285 (+0.1321490543584029) | > avg_loss_disc_real_5: 0.3311932186285655 (+0.19842626278599104) | > avg_loss_0: 2.6695998509724936 (+0.2449572881062827) | > avg_loss_gen: 2.641203006108602 (+0.7435015439987185) | > avg_loss_kl: 3.0217247804005942 (+0.1291062434514365) | > avg_loss_feat: 4.387875000635783 (-1.5058212280273438) | > avg_loss_mel: 24.259129842122395 (+1.8349850972493478) | > avg_loss_duration: 2.6975041230519614 (+0.10116473833719919) | > avg_loss_1: 37.00743738810221 (+1.3029371897379534)  > EPOCH: 346/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:26:51)   --> TIME: 2023-10-20 03:27:05 -- STEP: 19/50 -- GLOBAL_STEP: 70320 | > loss_disc: 2.9907212257385254 (2.4883531708466378) | > loss_disc_real_0: 0.12510180473327637 (0.17863347518600917) | > loss_disc_real_1: 0.2649691700935364 (0.22334107913469015) | > loss_disc_real_2: 0.3992527425289154 (0.2330683769756242) | > loss_disc_real_3: 0.30508294701576233 (0.2363685832211846) | > loss_disc_real_4: 0.27897220849990845 (0.20691826616070771) | > loss_disc_real_5: 0.33945006132125854 (0.2371326094297202) | > loss_0: 2.9907212257385254 (2.4883531708466378) | > grad_norm_0: tensor(448.5255, device='cuda:0') (tensor(537.1940, device='cuda:0')) | > loss_gen: 1.92931067943573 (2.3434226450167204) | > loss_kl: 0.8362853527069092 (1.0522918826655339) | > loss_feat: 2.7643697261810303 (5.257664154626821) | > loss_mel: 22.478273391723633 (21.513317898700112) | > loss_duration: 1.633383870124817 (1.575304301161515) | > loss_1: 29.64162254333496 (31.742000579833984) | > grad_norm_1: tensor(7216.6670, device='cuda:0') (tensor(34622.0117, device='cuda:0')) | > current_lr_0: 0.00014149943720784562 | > current_lr_1: 0.00014149943720784562 | > step_time: 0.5528 (0.5055252878289473) | > loader_time: 0.0149 (0.017793868717394377)  --> TIME: 2023-10-20 03:27:18 -- STEP: 49/50 -- GLOBAL_STEP: 70350 | > loss_disc: 2.2399117946624756 (2.4442259681468106) | > loss_disc_real_0: 0.21712562441825867 (0.15872016298223515) | > loss_disc_real_1: 0.2986561357975006 (0.2229422952751724) | > loss_disc_real_2: 0.25642335414886475 (0.23441946137772537) | > loss_disc_real_3: 0.37268373370170593 (0.2238672102744482) | > loss_disc_real_4: 0.13006599247455597 (0.20763147466492896) | > loss_disc_real_5: 0.10648799687623978 (0.21831029187887907) | > loss_0: 2.2399117946624756 (2.4442259681468106) | > grad_norm_0: tensor(655.9550, device='cuda:0') (tensor(559.2297, device='cuda:0')) | > loss_gen: 2.6858232021331787 (2.377281432249108) | > loss_kl: 1.0740076303482056 (0.9072485414086556) | > loss_feat: 4.726182460784912 (5.436462582374106) | > loss_mel: 24.35648536682129 (20.613310483037218) | > loss_duration: 1.6322293281555176 (1.5370974492053597) | > loss_1: 34.474727630615234 (30.871400434143688) | > grad_norm_1: tensor(5275.4233, device='cuda:0') (tensor(28504.6328, device='cuda:0')) | > current_lr_0: 0.00014149943720784562 | > current_lr_1: 0.00014149943720784562 | > step_time: 0.6736 (0.43171653942186006) | > loader_time: 0.395 (0.019672087260654995)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.509615659713745 (2.509615659713745) | > loss_disc_real_0: 0.2575041651725769 (0.2575041651725769) | > loss_disc_real_1: 0.32119864225387573 (0.32119864225387573) | > loss_disc_real_2: 0.3811807334423065 (0.3811807334423065) | > loss_disc_real_3: 0.21872158348560333 (0.21872158348560333) | > loss_disc_real_4: 0.26118192076683044 (0.26118192076683044) | > loss_disc_real_5: 0.2653563916683197 (0.2653563916683197) | > loss_0: 2.509615659713745 (2.509615659713745) | > loss_gen: 3.579047918319702 (3.579047918319702) | > loss_kl: 3.108281373977661 (3.108281373977661) | > loss_feat: 5.825928211212158 (5.825928211212158) | > loss_mel: 26.37373924255371 (26.37373924255371) | > loss_duration: 2.4608726501464844 (2.4608726501464844) | > loss_1: 41.347869873046875 (41.347869873046875)  --> STEP: 1 | > loss_disc: 3.340818405151367 (3.340818405151367) | > loss_disc_real_0: 0.432521790266037 (0.432521790266037) | > loss_disc_real_1: 0.2785925567150116 (0.2785925567150116) | > loss_disc_real_2: 0.39392539858818054 (0.39392539858818054) | > loss_disc_real_3: 0.21275334060192108 (0.21275334060192108) | > loss_disc_real_4: 0.45668017864227295 (0.45668017864227295) | > loss_disc_real_5: 0.3013698160648346 (0.3013698160648346) | > loss_0: 3.340818405151367 (3.340818405151367) | > loss_gen: 2.0838353633880615 (2.0838353633880615) | > loss_kl: 4.252052307128906 (4.252052307128906) | > loss_feat: 4.032717704772949 (4.032717704772949) | > loss_mel: 24.665376663208008 (24.665376663208008) | > loss_duration: 2.692352056503296 (2.692352056503296) | > loss_1: 37.72633361816406 (37.72633361816406)  --> STEP: 2 | > loss_disc: 2.65792179107666 (2.9993700981140137) | > loss_disc_real_0: 0.1665361374616623 (0.29952896386384964) | > loss_disc_real_1: 0.2682265341281891 (0.27340954542160034) | > loss_disc_real_2: 0.15534250438213348 (0.274633951485157) | > loss_disc_real_3: 0.4149458408355713 (0.3138495907187462) | > loss_disc_real_4: 0.43025049567222595 (0.44346533715724945) | > loss_disc_real_5: 0.3704247772693634 (0.335897296667099) | > loss_0: 2.65792179107666 (2.9993700981140137) | > loss_gen: 3.422307252883911 (2.7530713081359863) | > loss_kl: 3.848315477371216 (4.050183892250061) | > loss_feat: 9.746184349060059 (6.889451026916504) | > loss_mel: 25.298782348632812 (24.98207950592041) | > loss_duration: 2.737169027328491 (2.7147605419158936) | > loss_1: 45.05275344848633 (41.389543533325195)  --> STEP: 3 | > loss_disc: 3.625459671020508 (3.2080666224161782) | > loss_disc_real_0: 0.5264915227890015 (0.3751831501722336) | > loss_disc_real_1: 0.5459732413291931 (0.3642641107241313) | > loss_disc_real_2: 0.3988564908504486 (0.3160414646069209) | > loss_disc_real_3: 0.42664971947669983 (0.3514496336380641) | > loss_disc_real_4: 0.6601802706718445 (0.5157036483287811) | > loss_disc_real_5: 0.40854498744010925 (0.36011319359143573) | > loss_0: 3.625459671020508 (3.2080666224161782) | > loss_gen: 3.1307129859924316 (2.8789518674214682) | > loss_kl: 1.7959163188934326 (3.2987613677978516) | > loss_feat: 2.7188706398010254 (5.499257564544678) | > loss_mel: 25.977481842041016 (25.313880284627277) | > loss_duration: 2.4844424724578857 (2.6379878520965576) | > loss_1: 36.107425689697266 (39.62883758544922) --> EVAL PERFORMANCE | > avg_loader_time: 0.013315518697102865 (+0.002823034922281902) | > avg_loss_disc: 3.2080666224161782 (+0.5384667714436846) | > avg_loss_disc_real_0: 0.3751831501722336 (+0.08849447965621948) | > avg_loss_disc_real_1: 0.3642641107241313 (+0.08261690537134808) | > avg_loss_disc_real_2: 0.3160414646069209 (+0.054338907202084896) | > avg_loss_disc_real_3: 0.3514496336380641 (+0.05299045145511627) | > avg_loss_disc_real_4: 0.5157036483287811 (+0.21847065289815265) | > avg_loss_disc_real_5: 0.36011319359143573 (+0.028919974962870243) | > avg_loss_0: 3.2080666224161782 (+0.5384667714436846) | > avg_loss_gen: 2.8789518674214682 (+0.2377488613128662) | > avg_loss_kl: 3.2987613677978516 (+0.27703658739725734) | > avg_loss_feat: 5.499257564544678 (+1.1113825639088946) | > avg_loss_mel: 25.313880284627277 (+1.0547504425048828) | > avg_loss_duration: 2.6379878520965576 (-0.059516270955403794) | > avg_loss_1: 39.62883758544922 (+2.6214001973470076)  > EPOCH: 347/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:27:31)   --> TIME: 2023-10-20 03:27:50 -- STEP: 29/50 -- GLOBAL_STEP: 70380 | > loss_disc: 2.305180788040161 (2.4975725247942173) | > loss_disc_real_0: 0.1723679006099701 (0.1683388415338664) | > loss_disc_real_1: 0.15982569754123688 (0.22842921586386083) | > loss_disc_real_2: 0.2036934792995453 (0.23802353570173526) | > loss_disc_real_3: 0.2214755117893219 (0.2542372598987201) | > loss_disc_real_4: 0.11730720102787018 (0.25493798173707105) | > loss_disc_real_5: 0.2904246747493744 (0.2387559924531599) | > loss_0: 2.305180788040161 (2.4975725247942173) | > grad_norm_0: tensor(250.4177, device='cuda:0') (tensor(431.5204, device='cuda:0')) | > loss_gen: 2.278040885925293 (2.356153130531311) | > loss_kl: 0.9321733117103577 (0.9311815818835949) | > loss_feat: 5.764769554138184 (5.440413709344535) | > loss_mel: 22.966556549072266 (22.17992589391511) | > loss_duration: 1.569772720336914 (1.5634216522348339) | > loss_1: 33.511314392089844 (32.471096170359644) | > grad_norm_1: tensor(5570.9673, device='cuda:0') (tensor(15595.1396, device='cuda:0')) | > current_lr_0: 0.00014135799966116742 | > current_lr_1: 0.00014135799966116742 | > step_time: 0.2961 (0.5032866576622272) | > loader_time: 0.0255 (0.01909072645779313)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2676613330841064 (2.2676613330841064) | > loss_disc_real_0: 0.022365447133779526 (0.022365447133779526) | > loss_disc_real_1: 0.15162293612957 (0.15162293612957) | > loss_disc_real_2: 0.10126252472400665 (0.10126252472400665) | > loss_disc_real_3: 0.22906813025474548 (0.22906813025474548) | > loss_disc_real_4: 0.06765707582235336 (0.06765707582235336) | > loss_disc_real_5: 0.11122458428144455 (0.11122458428144455) | > loss_0: 2.2676613330841064 (2.2676613330841064) | > loss_gen: 1.8613604307174683 (1.8613604307174683) | > loss_kl: 2.670907974243164 (2.670907974243164) | > loss_feat: 7.581122398376465 (7.581122398376465) | > loss_mel: 29.4371337890625 (29.4371337890625) | > loss_duration: 2.354260206222534 (2.354260206222534) | > loss_1: 43.904781341552734 (43.904781341552734)  --> STEP: 1 | > loss_disc: 2.9494590759277344 (2.9494590759277344) | > loss_disc_real_0: 0.3458116352558136 (0.3458116352558136) | > loss_disc_real_1: 0.4197908341884613 (0.4197908341884613) | > loss_disc_real_2: 0.2705950438976288 (0.2705950438976288) | > loss_disc_real_3: 0.3464469909667969 (0.3464469909667969) | > loss_disc_real_4: 0.35791903734207153 (0.35791903734207153) | > loss_disc_real_5: 0.32111942768096924 (0.32111942768096924) | > loss_0: 2.9494590759277344 (2.9494590759277344) | > loss_gen: 2.489665985107422 (2.489665985107422) | > loss_kl: 3.729097366333008 (3.729097366333008) | > loss_feat: 5.58441162109375 (5.58441162109375) | > loss_mel: 23.657466888427734 (23.657466888427734) | > loss_duration: 2.682772397994995 (2.682772397994995) | > loss_1: 38.14341735839844 (38.14341735839844)  --> STEP: 2 | > loss_disc: 2.9378714561462402 (2.9436652660369873) | > loss_disc_real_0: 0.16180822253227234 (0.25380992889404297) | > loss_disc_real_1: 0.22007447481155396 (0.31993265450000763) | > loss_disc_real_2: 0.2572309970855713 (0.26391302049160004) | > loss_disc_real_3: 0.2570951581001282 (0.3017710745334625) | > loss_disc_real_4: 0.3016981780529022 (0.3298086076974869) | > loss_disc_real_5: 0.29404935240745544 (0.30758439004421234) | > loss_0: 2.9378714561462402 (2.9436652660369873) | > loss_gen: 1.5837284326553345 (2.036697208881378) | > loss_kl: 4.025209903717041 (3.8771536350250244) | > loss_feat: 0.310184508562088 (2.947298064827919) | > loss_mel: 6.432034969329834 (15.044750928878784) | > loss_duration: 2.630955934524536 (2.6568641662597656) | > loss_1: 14.9821138381958 (26.56276559829712)  --> STEP: 3 | > loss_disc: 2.5621280670166016 (2.816486199696859) | > loss_disc_real_0: 0.10144083946943283 (0.2030202324191729) | > loss_disc_real_1: 0.26654699444770813 (0.30213743448257446) | > loss_disc_real_2: 0.24943023920059204 (0.2590854267279307) | > loss_disc_real_3: 0.26555147767066956 (0.2896978755791982) | > loss_disc_real_4: 0.4013422429561615 (0.35365315278371173) | > loss_disc_real_5: 0.2950383424758911 (0.3034023741881053) | > loss_0: 2.5621280670166016 (2.816486199696859) | > loss_gen: 2.236234188079834 (2.1032095352808633) | > loss_kl: 1.959580421447754 (3.237962563832601) | > loss_feat: 2.221909523010254 (2.7055018842220306) | > loss_mel: 20.160079956054688 (16.749860604604084) | > loss_duration: 2.549747943878174 (2.621158758799235) | > loss_1: 29.127552032470703 (27.417694409688313) --> EVAL PERFORMANCE | > avg_loader_time: 0.013407389322916666 (+9.187062581380093e-05) | > avg_loss_disc: 2.816486199696859 (-0.39158042271931937) | > avg_loss_disc_real_0: 0.2030202324191729 (-0.17216291775306067) | > avg_loss_disc_real_1: 0.30213743448257446 (-0.06212667624155682) | > avg_loss_disc_real_2: 0.2590854267279307 (-0.05695603787899017) | > avg_loss_disc_real_3: 0.2896978755791982 (-0.0617517580588659) | > avg_loss_disc_real_4: 0.35365315278371173 (-0.1620504955450694) | > avg_loss_disc_real_5: 0.3034023741881053 (-0.05671081940333045) | > avg_loss_0: 2.816486199696859 (-0.39158042271931937) | > avg_loss_gen: 2.1032095352808633 (-0.775742332140605) | > avg_loss_kl: 3.237962563832601 (-0.0607988039652505) | > avg_loss_feat: 2.7055018842220306 (-2.793755680322647) | > avg_loss_mel: 16.749860604604084 (-8.564019680023193) | > avg_loss_duration: 2.621158758799235 (-0.01682909329732274) | > avg_loss_1: 27.417694409688313 (-12.211143175760906)  > EPOCH: 348/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:28:12)   --> TIME: 2023-10-20 03:28:21 -- STEP: 9/50 -- GLOBAL_STEP: 70410 | > loss_disc: 2.8662397861480713 (2.210668762524923) | > loss_disc_real_0: 0.1720123589038849 (0.10958658862445089) | > loss_disc_real_1: 0.24910569190979004 (0.22148541195525062) | > loss_disc_real_2: 0.24661889672279358 (0.18229207065370348) | > loss_disc_real_3: 0.27683398127555847 (0.23728998377919197) | > loss_disc_real_4: 0.3224213719367981 (0.22486177097178167) | > loss_disc_real_5: 0.26511868834495544 (0.20686202744642893) | > loss_0: 2.8662397861480713 (2.210668762524923) | > grad_norm_0: tensor(423.3080, device='cuda:0') (tensor(395.6601, device='cuda:0')) | > loss_gen: 1.7385084629058838 (2.564531538221571) | > loss_kl: 1.0809239149093628 (1.0046746929486592) | > loss_feat: 0.44194459915161133 (7.095101303524441) | > loss_mel: 13.396842956542969 (24.02018780178494) | > loss_duration: 1.5255324840545654 (1.5487490892410278) | > loss_1: 18.183752059936523 (36.233244366116) | > grad_norm_1: tensor(10883.8623, device='cuda:0') (tensor(19601.7949, device='cuda:0')) | > current_lr_0: 0.00014121670349017244 | > current_lr_1: 0.00014121670349017244 | > step_time: 0.6734 (0.5202519363827176) | > loader_time: 0.0243 (0.013802157508002387)  --> TIME: 2023-10-20 03:28:37 -- STEP: 39/50 -- GLOBAL_STEP: 70440 | > loss_disc: 2.711315155029297 (2.5435804709410057) | > loss_disc_real_0: 0.10501426458358765 (0.1927276902282849) | > loss_disc_real_1: 0.12654323875904083 (0.22278592277031678) | > loss_disc_real_2: 0.13586218655109406 (0.21663355664947095) | > loss_disc_real_3: 0.16739727556705475 (0.23033621114416) | > loss_disc_real_4: 0.10171079635620117 (0.24470849810406947) | > loss_disc_real_5: 0.17128247022628784 (0.246852355889785) | > loss_0: 2.711315155029297 (2.5435804709410057) | > grad_norm_0: tensor(580.3953, device='cuda:0') (tensor(450.4349, device='cuda:0')) | > loss_gen: 1.7288258075714111 (2.202288642907753) | > loss_kl: 0.535879373550415 (0.8688200299556439) | > loss_feat: 5.064481735229492 (4.530909300041504) | > loss_mel: 25.737825393676758 (20.94831448334914) | > loss_duration: 1.6436772346496582 (1.5567737817764282) | > loss_1: 34.710689544677734 (30.107106331067207) | > grad_norm_1: tensor(43690.6602, device='cuda:0') (tensor(16436.6289, device='cuda:0')) | > current_lr_0: 0.00014121670349017244 | > current_lr_1: 0.00014121670349017244 | > step_time: 0.5739 (0.49458621098445005) | > loader_time: 0.0241 (0.014204703844510592)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4979898929595947 (2.4979898929595947) | > loss_disc_real_0: 0.050053492188453674 (0.050053492188453674) | > loss_disc_real_1: 0.17317111790180206 (0.17317111790180206) | > loss_disc_real_2: 0.11255709826946259 (0.11255709826946259) | > loss_disc_real_3: 0.25785723328590393 (0.25785723328590393) | > loss_disc_real_4: 0.18534821271896362 (0.18534821271896362) | > loss_disc_real_5: 0.16845589876174927 (0.16845589876174927) | > loss_0: 2.4979898929595947 (2.4979898929595947) | > loss_gen: 1.5596736669540405 (1.5596736669540405) | > loss_kl: 3.3032898902893066 (3.3032898902893066) | > loss_feat: 2.799145221710205 (2.799145221710205) | > loss_mel: 24.45728874206543 (24.45728874206543) | > loss_duration: 2.4184677600860596 (2.4184677600860596) | > loss_1: 34.537864685058594 (34.537864685058594)  --> STEP: 1 | > loss_disc: 2.133273124694824 (2.133273124694824) | > loss_disc_real_0: 0.08007319271564484 (0.08007319271564484) | > loss_disc_real_1: 0.197393000125885 (0.197393000125885) | > loss_disc_real_2: 0.14036762714385986 (0.14036762714385986) | > loss_disc_real_3: 0.3096301257610321 (0.3096301257610321) | > loss_disc_real_4: 0.26213985681533813 (0.26213985681533813) | > loss_disc_real_5: 0.15965093672275543 (0.15965093672275543) | > loss_0: 2.133273124694824 (2.133273124694824) | > loss_gen: 2.4235317707061768 (2.4235317707061768) | > loss_kl: 3.2581562995910645 (3.2581562995910645) | > loss_feat: 4.689906597137451 (4.689906597137451) | > loss_mel: 23.34687042236328 (23.34687042236328) | > loss_duration: 2.606893539428711 (2.606893539428711) | > loss_1: 36.325355529785156 (36.325355529785156)  --> STEP: 2 | > loss_disc: 2.02447509765625 (2.078874111175537) | > loss_disc_real_0: 0.017193755134940147 (0.04863347392529249) | > loss_disc_real_1: 0.13730882108211517 (0.1673509106040001) | > loss_disc_real_2: 0.10674784332513809 (0.12355773523449898) | > loss_disc_real_3: 0.2209237515926361 (0.2652769386768341) | > loss_disc_real_4: 0.14676707983016968 (0.2044534683227539) | > loss_disc_real_5: 0.10538974404335022 (0.13252034038305283) | > loss_0: 2.02447509765625 (2.078874111175537) | > loss_gen: 2.0938093662261963 (2.2586705684661865) | > loss_kl: 3.8048057556152344 (3.5314810276031494) | > loss_feat: 8.843395233154297 (6.766650915145874) | > loss_mel: 29.8656005859375 (26.60623550415039) | > loss_duration: 2.6813411712646484 (2.6441173553466797) | > loss_1: 47.28895568847656 (41.80715560913086)  --> STEP: 3 | > loss_disc: 2.6597020626068115 (2.2724834283192954) | > loss_disc_real_0: 0.028460314497351646 (0.04190908744931221) | > loss_disc_real_1: 0.30854493379592896 (0.21441558500130972) | > loss_disc_real_2: 0.18574000895023346 (0.14428515980641046) | > loss_disc_real_3: 0.2910245954990387 (0.2738594909509023) | > loss_disc_real_4: 0.3164173364639282 (0.24177475770314535) | > loss_disc_real_5: 0.20154859125614166 (0.15552975734074911) | > loss_0: 2.6597020626068115 (2.2724834283192954) | > loss_gen: 1.8713302612304688 (2.1295571327209473) | > loss_kl: 1.742632508277893 (2.935198187828064) | > loss_feat: 3.501009941101074 (5.678103923797607) | > loss_mel: 20.272342681884766 (24.494937896728516) | > loss_duration: 2.568096399307251 (2.61877703666687) | > loss_1: 29.955411911010742 (37.856574376424156) --> EVAL PERFORMANCE | > avg_loader_time: 0.011833429336547852 (-0.0015739599863688145) | > avg_loss_disc: 2.2724834283192954 (-0.5440027713775635) | > avg_loss_disc_real_0: 0.04190908744931221 (-0.1611111449698607) | > avg_loss_disc_real_1: 0.21441558500130972 (-0.08772184948126474) | > avg_loss_disc_real_2: 0.14428515980641046 (-0.11480026692152026) | > avg_loss_disc_real_3: 0.2738594909509023 (-0.0158383846282959) | > avg_loss_disc_real_4: 0.24177475770314535 (-0.11187839508056638) | > avg_loss_disc_real_5: 0.15552975734074911 (-0.14787261684735617) | > avg_loss_0: 2.2724834283192954 (-0.5440027713775635) | > avg_loss_gen: 2.1295571327209473 (+0.02634759744008397) | > avg_loss_kl: 2.935198187828064 (-0.3027643760045371) | > avg_loss_feat: 5.678103923797607 (+2.972602039575577) | > avg_loss_mel: 24.494937896728516 (+7.7450772921244315) | > avg_loss_duration: 2.61877703666687 (-0.002381722132364761) | > avg_loss_1: 37.856574376424156 (+10.438879966735843)  > EPOCH: 349/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:28:51)   --> TIME: 2023-10-20 03:29:06 -- STEP: 19/50 -- GLOBAL_STEP: 70470 | > loss_disc: 1.4438235759735107 (2.355213984062797) | > loss_disc_real_0: 0.01821305602788925 (0.16146768453089813) | > loss_disc_real_1: 0.10613539069890976 (0.2186248853410545) | > loss_disc_real_2: 0.16284464299678802 (0.20481857373134085) | > loss_disc_real_3: 0.09742999076843262 (0.22400746533745214) | > loss_disc_real_4: 0.03136665001511574 (0.210157441857614) | > loss_disc_real_5: 0.09569769352674484 (0.20764053573733882) | > loss_0: 1.4438235759735107 (2.355213984062797) | > grad_norm_0: tensor(289.2161, device='cuda:0') (tensor(611.2128, device='cuda:0')) | > loss_gen: 2.7374613285064697 (2.4652657697075293) | > loss_kl: 0.9644105434417725 (0.9592901436906112) | > loss_feat: 8.84268856048584 (5.331777688311903) | > loss_mel: 30.70571517944336 (20.270885856528032) | > loss_duration: 1.7327258586883545 (1.5943050760971873) | > loss_1: 44.983001708984375 (30.62152458492078) | > grad_norm_1: tensor(17130.8223, device='cuda:0') (tensor(27805.1875, device='cuda:0')) | > current_lr_0: 0.00014107554855354685 | > current_lr_1: 0.00014107554855354685 | > step_time: 0.4837 (0.5231049688238847) | > loader_time: 0.0249 (0.017274241698415654)  --> TIME: 2023-10-20 03:29:17 -- STEP: 49/50 -- GLOBAL_STEP: 70500 | > loss_disc: 2.0845947265625 (2.4041172813396066) | > loss_disc_real_0: 0.023356707766652107 (0.15063615686887377) | > loss_disc_real_1: 0.21590638160705566 (0.22571982815861702) | > loss_disc_real_2: 0.1397107094526291 (0.2212773834792327) | > loss_disc_real_3: 0.22994562983512878 (0.2223759704858673) | > loss_disc_real_4: 0.22647498548030853 (0.21396848437737445) | > loss_disc_real_5: 0.18751494586467743 (0.21500781746771264) | > loss_0: 2.0845947265625 (2.4041172813396066) | > grad_norm_0: tensor(658.1811, device='cuda:0') (tensor(550.4783, device='cuda:0')) | > loss_gen: 2.4888687133789062 (2.3960655124820005) | > loss_kl: 0.6449659466743469 (0.8536914182560784) | > loss_feat: 4.968120098114014 (5.579638124576637) | > loss_mel: 24.994945526123047 (21.666251552348236) | > loss_duration: 1.6289844512939453 (1.5557826246534074) | > loss_1: 34.72588348388672 (32.051428921368654) | > grad_norm_1: tensor(16305.5156, device='cuda:0') (tensor(22823.1621, device='cuda:0')) | > current_lr_0: 0.00014107554855354685 | > current_lr_1: 0.00014107554855354685 | > step_time: 0.6777 (0.4224887770049426) | > loader_time: 0.3626 (0.017174745092586596)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.193289279937744 (3.193289279937744) | > loss_disc_real_0: 0.08295747637748718 (0.08295747637748718) | > loss_disc_real_1: 0.28904569149017334 (0.28904569149017334) | > loss_disc_real_2: 0.09913031756877899 (0.09913031756877899) | > loss_disc_real_3: 0.20268253982067108 (0.20268253982067108) | > loss_disc_real_4: 0.27580389380455017 (0.27580389380455017) | > loss_disc_real_5: 0.2594299614429474 (0.2594299614429474) | > loss_0: 3.193289279937744 (3.193289279937744) | > loss_gen: 1.199480414390564 (1.199480414390564) | > loss_kl: 3.6147663593292236 (3.6147663593292236) | > loss_feat: 0.03913106769323349 (0.03913106769323349) | > loss_mel: 1.4422180652618408 (1.4422180652618408) | > loss_duration: 2.5107593536376953 (2.5107593536376953) | > loss_1: 8.806355476379395 (8.806355476379395)  --> STEP: 1 | > loss_disc: 3.0820910930633545 (3.0820910930633545) | > loss_disc_real_0: 0.0766848623752594 (0.0766848623752594) | > loss_disc_real_1: 0.2892210781574249 (0.2892210781574249) | > loss_disc_real_2: 0.09943073987960815 (0.09943073987960815) | > loss_disc_real_3: 0.2026819884777069 (0.2026819884777069) | > loss_disc_real_4: 0.2756616771221161 (0.2756616771221161) | > loss_disc_real_5: 0.2593575716018677 (0.2593575716018677) | > loss_0: 3.0820910930633545 (3.0820910930633545) | > loss_gen: 1.2491183280944824 (1.2491183280944824) | > loss_kl: 3.235302448272705 (3.235302448272705) | > loss_feat: 0.2021009624004364 (0.2021009624004364) | > loss_mel: 14.436716079711914 (14.436716079711914) | > loss_duration: 2.6688477993011475 (2.6688477993011475) | > loss_1: 21.792085647583008 (21.792085647583008)  --> STEP: 2 | > loss_disc: 3.182706356048584 (3.1323987245559692) | > loss_disc_real_0: 0.08153942227363586 (0.07911214232444763) | > loss_disc_real_1: 0.2889244258403778 (0.28907275199890137) | > loss_disc_real_2: 0.09937040507793427 (0.09940057247877121) | > loss_disc_real_3: 0.202623650431633 (0.20265281945466995) | > loss_disc_real_4: 0.2758241593837738 (0.27574291825294495) | > loss_disc_real_5: 0.25944748520851135 (0.2594025284051895) | > loss_0: 3.182706356048584 (3.1323987245559692) | > loss_gen: 1.2032802104949951 (1.2261992692947388) | > loss_kl: 3.325441837310791 (3.280372142791748) | > loss_feat: 0.05708802491426468 (0.12959449365735054) | > loss_mel: 5.914263725280762 (10.175489902496338) | > loss_duration: 2.650698661804199 (2.6597732305526733) | > loss_1: 13.150773048400879 (17.471429347991943)  --> STEP: 3 | > loss_disc: 3.193542957305908 (3.1527801354726157) | > loss_disc_real_0: 0.08323661983013153 (0.0804869681596756) | > loss_disc_real_1: 0.28906455636024475 (0.2890700201193492) | > loss_disc_real_2: 0.09920517355203629 (0.0993354395031929) | > loss_disc_real_3: 0.2026810199022293 (0.2026622196038564) | > loss_disc_real_4: 0.27579188346862793 (0.2757592399915059) | > loss_disc_real_5: 0.25950467586517334 (0.25943657755851746) | > loss_0: 3.193542957305908 (3.1527801354726157) | > loss_gen: 1.1995694637298584 (1.2173226674397786) | > loss_kl: 2.2647159099578857 (2.9418200651804605) | > loss_feat: 0.040259309113025665 (0.09981609880924225) | > loss_mel: 2.537029981613159 (7.629336595535278) | > loss_duration: 2.6263632774353027 (2.64863657951355) | > loss_1: 8.667938232421875 (14.536932309468588) --> EVAL PERFORMANCE | > avg_loader_time: 0.013803323109944662 (+0.0019698937733968105) | > avg_loss_disc: 3.1527801354726157 (+0.8802967071533203) | > avg_loss_disc_real_0: 0.0804869681596756 (+0.03857788071036339) | > avg_loss_disc_real_1: 0.2890700201193492 (+0.07465443511803946) | > avg_loss_disc_real_2: 0.0993354395031929 (-0.04494972030321756) | > avg_loss_disc_real_3: 0.2026622196038564 (-0.07119727134704587) | > avg_loss_disc_real_4: 0.2757592399915059 (+0.03398448228836057) | > avg_loss_disc_real_5: 0.25943657755851746 (+0.10390682021776834) | > avg_loss_0: 3.1527801354726157 (+0.8802967071533203) | > avg_loss_gen: 1.2173226674397786 (-0.9122344652811687) | > avg_loss_kl: 2.9418200651804605 (+0.006621877352396499) | > avg_loss_feat: 0.09981609880924225 (-5.578287824988365) | > avg_loss_mel: 7.629336595535278 (-16.865601301193237) | > avg_loss_duration: 2.64863657951355 (+0.029859542846679688) | > avg_loss_1: 14.536932309468588 (-23.319642066955566)  > EPOCH: 350/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:29:32)   --> TIME: 2023-10-20 03:29:51 -- STEP: 29/50 -- GLOBAL_STEP: 70530 | > loss_disc: 2.9251227378845215 (2.2596937664623913) | > loss_disc_real_0: 0.44678550958633423 (0.1401513647930376) | > loss_disc_real_1: 0.2825169265270233 (0.20832095564953212) | > loss_disc_real_2: 0.1528741419315338 (0.20423215293678745) | > loss_disc_real_3: 0.20455364882946014 (0.2234886941210977) | > loss_disc_real_4: 0.09469354152679443 (0.19157981949633565) | > loss_disc_real_5: 0.1252846121788025 (0.21829905457280832) | > loss_0: 2.9251227378845215 (2.2596937664623913) | > grad_norm_0: tensor(600.8322, device='cuda:0') (tensor(602.5599, device='cuda:0')) | > loss_gen: 1.797539472579956 (2.5986545168120285) | > loss_kl: 1.1558905839920044 (0.9614155045871077) | > loss_feat: 2.8478527069091797 (6.365961422180307) | > loss_mel: 20.521263122558594 (24.998792878512678) | > loss_duration: 1.5148422718048096 (1.58897589815074) | > loss_1: 27.837387084960938 (36.51380025929417) | > grad_norm_1: tensor(3036.1902, device='cuda:0') (tensor(24241.7441, device='cuda:0')) | > current_lr_0: 0.00014093453471011804 | > current_lr_1: 0.00014093453471011804 | > step_time: 0.2929 (0.5064703102769523) | > loader_time: 0.0249 (0.019517109311860188)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.079768657684326 (3.079768657684326) | > loss_disc_real_0: 0.46398746967315674 (0.46398746967315674) | > loss_disc_real_1: 0.4755062162876129 (0.4755062162876129) | > loss_disc_real_2: 0.3202054798603058 (0.3202054798603058) | > loss_disc_real_3: 0.42856207489967346 (0.42856207489967346) | > loss_disc_real_4: 0.3273959755897522 (0.3273959755897522) | > loss_disc_real_5: 0.364236980676651 (0.364236980676651) | > loss_0: 3.079768657684326 (3.079768657684326) | > loss_gen: 3.388845682144165 (3.388845682144165) | > loss_kl: 3.2880048751831055 (3.2880048751831055) | > loss_feat: 4.76159143447876 (4.76159143447876) | > loss_mel: 25.117704391479492 (25.117704391479492) | > loss_duration: 2.5353240966796875 (2.5353240966796875) | > loss_1: 39.09147262573242 (39.09147262573242)  --> STEP: 1 | > loss_disc: 2.014324426651001 (2.014324426651001) | > loss_disc_real_0: 0.26308807730674744 (0.26308807730674744) | > loss_disc_real_1: 0.24548499286174774 (0.24548499286174774) | > loss_disc_real_2: 0.1942831128835678 (0.1942831128835678) | > loss_disc_real_3: 0.33125168085098267 (0.33125168085098267) | > loss_disc_real_4: 0.11931326985359192 (0.11931326985359192) | > loss_disc_real_5: 0.04419767111539841 (0.04419767111539841) | > loss_0: 2.014324426651001 (2.014324426651001) | > loss_gen: 2.925469398498535 (2.925469398498535) | > loss_kl: 4.2735724449157715 (4.2735724449157715) | > loss_feat: 7.785146236419678 (7.785146236419678) | > loss_mel: 22.48799705505371 (22.48799705505371) | > loss_duration: 2.8929896354675293 (2.8929896354675293) | > loss_1: 40.36517333984375 (40.36517333984375)  --> STEP: 2 | > loss_disc: 3.4022676944732666 (2.708296060562134) | > loss_disc_real_0: 0.580008864402771 (0.4215484708547592) | > loss_disc_real_1: 0.31471583247184753 (0.28010041266679764) | > loss_disc_real_2: 0.34937790036201477 (0.2718305066227913) | > loss_disc_real_3: 0.3416820764541626 (0.33646687865257263) | > loss_disc_real_4: 0.4040544331073761 (0.261683851480484) | > loss_disc_real_5: 0.27204322814941406 (0.15812044963240623) | > loss_0: 3.4022676944732666 (2.708296060562134) | > loss_gen: 2.0693612098693848 (2.49741530418396) | > loss_kl: 3.743016481399536 (4.008294463157654) | > loss_feat: 1.6647664308547974 (4.7249563336372375) | > loss_mel: 10.57394027709961 (16.53096866607666) | > loss_duration: 2.5928313732147217 (2.7429105043411255) | > loss_1: 20.6439151763916 (30.504544258117676)  --> STEP: 3 | > loss_disc: 2.975748300552368 (2.7974468072255454) | > loss_disc_real_0: 0.3197293281555176 (0.38760875662167865) | > loss_disc_real_1: 0.32000064849853516 (0.29340049127737683) | > loss_disc_real_2: 0.25790801644325256 (0.26718967656294507) | > loss_disc_real_3: 0.2758733630180359 (0.31626904010772705) | > loss_disc_real_4: 0.27207112312316895 (0.26514627536137897) | > loss_disc_real_5: 0.2795690894126892 (0.19860332955916724) | > loss_0: 2.975748300552368 (2.7974468072255454) | > loss_gen: 1.8213557004928589 (2.272062102953593) | > loss_kl: 1.8730703592300415 (3.296553095181783) | > loss_feat: 0.502660870552063 (3.317524512608846) | > loss_mel: 16.411836624145508 (16.49125798543294) | > loss_duration: 2.550166130065918 (2.678662379582723) | > loss_1: 23.159088134765625 (28.056058883666992) --> EVAL PERFORMANCE | > avg_loader_time: 0.01420434315999349 (+0.0004010200500488281) | > avg_loss_disc: 2.7974468072255454 (-0.3553333282470703) | > avg_loss_disc_real_0: 0.38760875662167865 (+0.30712178846200305) | > avg_loss_disc_real_1: 0.29340049127737683 (+0.004330471158027649) | > avg_loss_disc_real_2: 0.26718967656294507 (+0.16785423705975216) | > avg_loss_disc_real_3: 0.31626904010772705 (+0.11360682050387064) | > avg_loss_disc_real_4: 0.26514627536137897 (-0.010612964630126953) | > avg_loss_disc_real_5: 0.19860332955916724 (-0.06083324799935022) | > avg_loss_0: 2.7974468072255454 (-0.3553333282470703) | > avg_loss_gen: 2.272062102953593 (+1.0547394355138142) | > avg_loss_kl: 3.296553095181783 (+0.3547330300013227) | > avg_loss_feat: 3.317524512608846 (+3.217708413799604) | > avg_loss_mel: 16.49125798543294 (+8.861921389897663) | > avg_loss_duration: 2.678662379582723 (+0.030025800069173325) | > avg_loss_1: 28.056058883666992 (+13.519126574198404)  > EPOCH: 351/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:30:13)   --> TIME: 2023-10-20 03:30:21 -- STEP: 9/50 -- GLOBAL_STEP: 70560 | > loss_disc: 2.608826160430908 (2.322879195213318) | > loss_disc_real_0: 0.12281562387943268 (0.16082734324865872) | > loss_disc_real_1: 0.32067275047302246 (0.24721062266164356) | > loss_disc_real_2: 0.34476470947265625 (0.2374955846203698) | > loss_disc_real_3: 0.35931718349456787 (0.21972806006669998) | > loss_disc_real_4: 0.26175782084465027 (0.2675941586494446) | > loss_disc_real_5: 0.3129839301109314 (0.17927107256319788) | > loss_0: 2.608826160430908 (2.322879195213318) | > grad_norm_0: tensor(268.3553, device='cuda:0') (tensor(500.8261, device='cuda:0')) | > loss_gen: 2.6129794120788574 (2.574044015672472) | > loss_kl: 0.9092916250228882 (1.1524537073241339) | > loss_feat: 4.156440734863281 (6.068057980802324) | > loss_mel: 21.066240310668945 (20.946143998040093) | > loss_duration: 1.5142873525619507 (1.5639061662885878) | > loss_1: 30.259241104125977 (32.304607179429794) | > grad_norm_1: tensor(10473.1357, device='cuda:0') (tensor(13769.2783, device='cuda:0')) | > current_lr_0: 0.0001407936618188545 | > current_lr_1: 0.0001407936618188545 | > step_time: 0.668 (0.4043561882442898) | > loader_time: 0.0244 (0.010179969999525283)  --> TIME: 2023-10-20 03:30:36 -- STEP: 39/50 -- GLOBAL_STEP: 70590 | > loss_disc: 2.444427013397217 (2.54744455141899) | > loss_disc_real_0: 0.1758764684200287 (0.16810387946092165) | > loss_disc_real_1: 0.32426244020462036 (0.2447496980237655) | > loss_disc_real_2: 0.2572976052761078 (0.23946057240932417) | > loss_disc_real_3: 0.2263576090335846 (0.23114356303062195) | > loss_disc_real_4: 0.19506843388080597 (0.2663687335757109) | > loss_disc_real_5: 0.19646917283535004 (0.24583418055986747) | > loss_0: 2.444427013397217 (2.54744455141899) | > grad_norm_0: tensor(567.8356, device='cuda:0') (tensor(594.6074, device='cuda:0')) | > loss_gen: 2.217388391494751 (2.354909487259694) | > loss_kl: 0.8443450331687927 (0.911808485404039) | > loss_feat: 3.099360704421997 (4.933220439805434) | > loss_mel: 15.15400218963623 (22.241370574021953) | > loss_duration: 1.6441394090652466 (1.5438789618320956) | > loss_1: 22.95923614501953 (31.985188031807922) | > grad_norm_1: tensor(9028.6807, device='cuda:0') (tensor(15499.7002, device='cuda:0')) | > current_lr_0: 0.0001407936618188545 | > current_lr_1: 0.0001407936618188545 | > step_time: 0.6122 (0.4798013858306102) | > loader_time: 0.0245 (0.015133276963845277)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.548959970474243 (2.548959970474243) | > loss_disc_real_0: 0.1408608853816986 (0.1408608853816986) | > loss_disc_real_1: 0.28916868567466736 (0.28916868567466736) | > loss_disc_real_2: 0.303826242685318 (0.303826242685318) | > loss_disc_real_3: 0.3486815094947815 (0.3486815094947815) | > loss_disc_real_4: 0.16096192598342896 (0.16096192598342896) | > loss_disc_real_5: 0.2570108473300934 (0.2570108473300934) | > loss_0: 2.548959970474243 (2.548959970474243) | > loss_gen: 2.2564926147460938 (2.2564926147460938) | > loss_kl: 4.978123188018799 (4.978123188018799) | > loss_feat: 5.281163215637207 (5.281163215637207) | > loss_mel: 24.044252395629883 (24.044252395629883) | > loss_duration: 2.59702205657959 (2.59702205657959) | > loss_1: 39.15705490112305 (39.15705490112305)  --> STEP: 1 | > loss_disc: 2.5558221340179443 (2.5558221340179443) | > loss_disc_real_0: 0.10478192567825317 (0.10478192567825317) | > loss_disc_real_1: 0.23681065440177917 (0.23681065440177917) | > loss_disc_real_2: 0.27022305130958557 (0.27022305130958557) | > loss_disc_real_3: 0.3049424886703491 (0.3049424886703491) | > loss_disc_real_4: 0.2312869131565094 (0.2312869131565094) | > loss_disc_real_5: 0.14108450710773468 (0.14108450710773468) | > loss_0: 2.5558221340179443 (2.5558221340179443) | > loss_gen: 1.9275486469268799 (1.9275486469268799) | > loss_kl: 3.8655083179473877 (3.8655083179473877) | > loss_feat: 3.5016608238220215 (3.5016608238220215) | > loss_mel: 20.544879913330078 (20.544879913330078) | > loss_duration: 2.8550448417663574 (2.8550448417663574) | > loss_1: 32.69464111328125 (32.69464111328125)  --> STEP: 2 | > loss_disc: 2.945101737976074 (2.7504619359970093) | > loss_disc_real_0: 0.13824743032455444 (0.12151467800140381) | > loss_disc_real_1: 0.26219087839126587 (0.24950076639652252) | > loss_disc_real_2: 0.20867595076560974 (0.23944950103759766) | > loss_disc_real_3: 0.33519816398620605 (0.3200703263282776) | > loss_disc_real_4: 0.21859245002269745 (0.22493968158960342) | > loss_disc_real_5: 0.2309158891439438 (0.18600019812583923) | > loss_0: 2.945101737976074 (2.7504619359970093) | > loss_gen: 1.5001814365386963 (1.713865041732788) | > loss_kl: 3.031059741973877 (3.4482840299606323) | > loss_feat: 0.3767048120498657 (1.9391828179359436) | > loss_mel: 11.069557189941406 (15.807218551635742) | > loss_duration: 2.62654447555542 (2.7407946586608887) | > loss_1: 18.604047775268555 (25.649344444274902)  --> STEP: 3 | > loss_disc: 1.6906129121780396 (2.3971789280573526) | > loss_disc_real_0: 0.1665116846561432 (0.13651368021965027) | > loss_disc_real_1: 0.18072757124900818 (0.22657636801401773) | > loss_disc_real_2: 0.16506177186965942 (0.21465359131495157) | > loss_disc_real_3: 0.21850939095020294 (0.2862166812022527) | > loss_disc_real_4: 0.17718707025051117 (0.20902214447657266) | > loss_disc_real_5: 0.0899299904704094 (0.1539767955740293) | > loss_0: 1.6906129121780396 (2.3971789280573526) | > loss_gen: 3.1736888885498047 (2.2004729906717935) | > loss_kl: 1.6313111782073975 (2.842626412709554) | > loss_feat: 6.770726203918457 (3.5496972799301147) | > loss_mel: 20.423683166503906 (17.34604008992513) | > loss_duration: 2.62970232963562 (2.7037638823191323) | > loss_1: 34.629112243652344 (28.642600377400715) --> EVAL PERFORMANCE | > avg_loader_time: 0.003832737604777018 (-0.010371605555216473) | > avg_loss_disc: 2.3971789280573526 (-0.40026787916819284) | > avg_loss_disc_real_0: 0.13651368021965027 (-0.2510950764020284) | > avg_loss_disc_real_1: 0.22657636801401773 (-0.0668241232633591) | > avg_loss_disc_real_2: 0.21465359131495157 (-0.0525360852479935) | > avg_loss_disc_real_3: 0.2862166812022527 (-0.030052358905474363) | > avg_loss_disc_real_4: 0.20902214447657266 (-0.056124130884806306) | > avg_loss_disc_real_5: 0.1539767955740293 (-0.04462653398513794) | > avg_loss_0: 2.3971789280573526 (-0.40026787916819284) | > avg_loss_gen: 2.2004729906717935 (-0.07158911228179932) | > avg_loss_kl: 2.842626412709554 (-0.453926682472229) | > avg_loss_feat: 3.5496972799301147 (+0.23217276732126857) | > avg_loss_mel: 17.34604008992513 (+0.8547821044921875) | > avg_loss_duration: 2.7037638823191323 (+0.02510150273640921) | > avg_loss_1: 28.642600377400715 (+0.5865414937337228)  > EPOCH: 352/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:30:52)   --> TIME: 2023-10-20 03:31:06 -- STEP: 19/50 -- GLOBAL_STEP: 70620 | > loss_disc: 2.009399652481079 (2.366973142874868) | > loss_disc_real_0: 0.1426183432340622 (0.14630555488953464) | > loss_disc_real_1: 0.33328959345817566 (0.2255975282505939) | > loss_disc_real_2: 0.27936315536499023 (0.23683904895656988) | > loss_disc_real_3: 0.1711263507604599 (0.25860642367287684) | > loss_disc_real_4: 0.15079349279403687 (0.20865795310390622) | > loss_disc_real_5: 0.0923699289560318 (0.20116360431635066) | > loss_0: 2.009399652481079 (2.366973142874868) | > grad_norm_0: tensor(493.6579, device='cuda:0') (tensor(549.9185, device='cuda:0')) | > loss_gen: 2.649850845336914 (2.5009992875550924) | > loss_kl: 0.9529426693916321 (0.9062494396379119) | > loss_feat: 6.561692237854004 (5.429991568389692) | > loss_mel: 24.149059295654297 (22.54892289011102) | > loss_duration: 1.6997261047363281 (1.5894864483883506) | > loss_1: 36.01327133178711 (32.97565003445274) | > grad_norm_1: tensor(3762.7410, device='cuda:0') (tensor(21491.0801, device='cuda:0')) | > current_lr_0: 0.00014065292973886576 | > current_lr_1: 0.00014065292973886576 | > step_time: 0.2922 (0.4814248586955823) | > loader_time: 0.0022 (0.019238584919979696)  --> TIME: 2023-10-20 03:31:19 -- STEP: 49/50 -- GLOBAL_STEP: 70650 | > loss_disc: 2.2041587829589844 (2.43133858758576) | > loss_disc_real_0: 0.16962791979312897 (0.1531046192845976) | > loss_disc_real_1: 0.2067045420408249 (0.22496220309819495) | > loss_disc_real_2: 0.12545818090438843 (0.22768016547268752) | > loss_disc_real_3: 0.22890664637088776 (0.2494075622181503) | > loss_disc_real_4: 0.20457473397254944 (0.20342456275711254) | > loss_disc_real_5: 0.24941523373126984 (0.2082297682800159) | > loss_0: 2.2041587829589844 (2.43133858758576) | > grad_norm_0: tensor(588.9005, device='cuda:0') (tensor(547.0277, device='cuda:0')) | > loss_gen: 2.534602403640747 (2.3339432502279474) | > loss_kl: 0.5978928804397583 (0.8631095428551946) | > loss_feat: 5.657040596008301 (5.197912907322908) | > loss_mel: 24.140766143798828 (22.201121354589652) | > loss_duration: 1.707398772239685 (1.5578092944865327) | > loss_1: 34.637699127197266 (32.1538963317871) | > grad_norm_1: tensor(18399.1582, device='cuda:0') (tensor(20006.1387, device='cuda:0')) | > current_lr_0: 0.00014065292973886576 | > current_lr_1: 0.00014065292973886576 | > step_time: 0.5247 (0.4247931801542944) | > loader_time: 0.3735 (0.019688937128806604)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4131882190704346 (2.4131882190704346) | > loss_disc_real_0: 0.2318933755159378 (0.2318933755159378) | > loss_disc_real_1: 0.2655068337917328 (0.2655068337917328) | > loss_disc_real_2: 0.3428786098957062 (0.3428786098957062) | > loss_disc_real_3: 0.1826353371143341 (0.1826353371143341) | > loss_disc_real_4: 0.296059250831604 (0.296059250831604) | > loss_disc_real_5: 0.1867026537656784 (0.1867026537656784) | > loss_0: 2.4131882190704346 (2.4131882190704346) | > loss_gen: 2.6209716796875 (2.6209716796875) | > loss_kl: 3.2822060585021973 (3.2822060585021973) | > loss_feat: 8.362029075622559 (8.362029075622559) | > loss_mel: 26.98907470703125 (26.98907470703125) | > loss_duration: 2.499084234237671 (2.499084234237671) | > loss_1: 43.75336456298828 (43.75336456298828)  --> STEP: 1 | > loss_disc: 2.2427659034729004 (2.2427659034729004) | > loss_disc_real_0: 0.08836378902196884 (0.08836378902196884) | > loss_disc_real_1: 0.277826726436615 (0.277826726436615) | > loss_disc_real_2: 0.15586841106414795 (0.15586841106414795) | > loss_disc_real_3: 0.40503349900245667 (0.40503349900245667) | > loss_disc_real_4: 0.2328205406665802 (0.2328205406665802) | > loss_disc_real_5: 0.26636171340942383 (0.26636171340942383) | > loss_0: 2.2427659034729004 (2.2427659034729004) | > loss_gen: 2.657762050628662 (2.657762050628662) | > loss_kl: 4.110042572021484 (4.110042572021484) | > loss_feat: 6.113256454467773 (6.113256454467773) | > loss_mel: 24.620075225830078 (24.620075225830078) | > loss_duration: 2.7411696910858154 (2.7411696910858154) | > loss_1: 40.242305755615234 (40.242305755615234)  --> STEP: 2 | > loss_disc: 2.7900888919830322 (2.5164273977279663) | > loss_disc_real_0: 0.5968838334083557 (0.3426238112151623) | > loss_disc_real_1: 0.37953561544418335 (0.32868117094039917) | > loss_disc_real_2: 0.23974475264549255 (0.19780658185482025) | > loss_disc_real_3: 0.3465817868709564 (0.37580764293670654) | > loss_disc_real_4: 0.1558753103017807 (0.19434792548418045) | > loss_disc_real_5: 0.3737236559391022 (0.320042684674263) | > loss_0: 2.7900888919830322 (2.5164273977279663) | > loss_gen: 3.1546361446380615 (2.906199097633362) | > loss_kl: 3.7313122749328613 (3.920677423477173) | > loss_feat: 4.594684600830078 (5.353970527648926) | > loss_mel: 32.710384368896484 (28.66522979736328) | > loss_duration: 2.550906181335449 (2.6460379362106323) | > loss_1: 46.74192428588867 (43.49211502075195)  --> STEP: 3 | > loss_disc: 2.882007598876953 (2.6382874647776284) | > loss_disc_real_0: 0.2816691994667053 (0.32230560729901) | > loss_disc_real_1: 0.3759620785713196 (0.3444414734840393) | > loss_disc_real_2: 0.30290931463241577 (0.23284082611401877) | > loss_disc_real_3: 0.3619181215763092 (0.3711778024832408) | > loss_disc_real_4: 0.3015720546245575 (0.23008930186430612) | > loss_disc_real_5: 0.34241512417793274 (0.3275001645088196) | > loss_0: 2.882007598876953 (2.6382874647776284) | > loss_gen: 2.575690746307373 (2.7960296471913657) | > loss_kl: 1.519049882888794 (3.1201349099477134) | > loss_feat: 3.489795684814453 (4.7325789133707685) | > loss_mel: 21.452836990356445 (26.261098861694336) | > loss_duration: 2.473850965499878 (2.5886422793070474) | > loss_1: 31.51122283935547 (39.49848429361979) --> EVAL PERFORMANCE | > avg_loader_time: 0.014354785283406576 (+0.010522047678629558) | > avg_loss_disc: 2.6382874647776284 (+0.24110853672027588) | > avg_loss_disc_real_0: 0.32230560729901 (+0.1857919270793597) | > avg_loss_disc_real_1: 0.3444414734840393 (+0.11786510547002158) | > avg_loss_disc_real_2: 0.23284082611401877 (+0.018187234799067198) | > avg_loss_disc_real_3: 0.3711778024832408 (+0.0849611212809881) | > avg_loss_disc_real_4: 0.23008930186430612 (+0.02106715738773346) | > avg_loss_disc_real_5: 0.3275001645088196 (+0.17352336893479028) | > avg_loss_0: 2.6382874647776284 (+0.24110853672027588) | > avg_loss_gen: 2.7960296471913657 (+0.5955566565195722) | > avg_loss_kl: 3.1201349099477134 (+0.2775084972381592) | > avg_loss_feat: 4.7325789133707685 (+1.1828816334406538) | > avg_loss_mel: 26.261098861694336 (+8.915058771769207) | > avg_loss_duration: 2.5886422793070474 (-0.11512160301208496) | > avg_loss_1: 39.49848429361979 (+10.855883916219074)  > EPOCH: 353/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:31:31)   --> TIME: 2023-10-20 03:31:51 -- STEP: 29/50 -- GLOBAL_STEP: 70680 | > loss_disc: 2.917668342590332 (2.249612750678227) | > loss_disc_real_0: 0.39392268657684326 (0.125484649316761) | > loss_disc_real_1: 0.31656497716903687 (0.21692293882369995) | > loss_disc_real_2: 0.22199633717536926 (0.20641144801830424) | > loss_disc_real_3: 0.2971331477165222 (0.22984986691253964) | > loss_disc_real_4: 0.31586092710494995 (0.19055765571779218) | > loss_disc_real_5: 0.2920476794242859 (0.18887667878177658) | > loss_0: 2.917668342590332 (2.249612750678227) | > grad_norm_0: tensor(775.6716, device='cuda:0') (tensor(613.7424, device='cuda:0')) | > loss_gen: 2.1908063888549805 (2.557493912762609) | > loss_kl: 0.7826865911483765 (0.9905163306614448) | > loss_feat: 0.6330071687698364 (6.779244270817987) | > loss_mel: 17.326316833496094 (25.053893187950397) | > loss_duration: 1.5272181034088135 (1.569096536471926) | > loss_1: 22.460033416748047 (36.950244048546104) | > grad_norm_1: tensor(8002.6055, device='cuda:0') (tensor(29305.9102, device='cuda:0')) | > current_lr_0: 0.00014051233832940206 | > current_lr_1: 0.00014051233832940206 | > step_time: 0.574 (0.4999318451716984) | > loader_time: 0.0065 (0.019577815614897628)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6460827589035034 (1.6460827589035034) | > loss_disc_real_0: 0.053750231862068176 (0.053750231862068176) | > loss_disc_real_1: 0.15134206414222717 (0.15134206414222717) | > loss_disc_real_2: 0.17670665681362152 (0.17670665681362152) | > loss_disc_real_3: 0.2546887993812561 (0.2546887993812561) | > loss_disc_real_4: 0.11647524684667587 (0.11647524684667587) | > loss_disc_real_5: 0.07015888392925262 (0.07015888392925262) | > loss_0: 1.6460827589035034 (1.6460827589035034) | > loss_gen: 3.305694580078125 (3.305694580078125) | > loss_kl: 3.514739513397217 (3.514739513397217) | > loss_feat: 9.955473899841309 (9.955473899841309) | > loss_mel: 23.421451568603516 (23.421451568603516) | > loss_duration: 2.4799039363861084 (2.4799039363861084) | > loss_1: 42.67726135253906 (42.67726135253906)  --> STEP: 1 | > loss_disc: 2.4098961353302 (2.4098961353302) | > loss_disc_real_0: 0.09412230551242828 (0.09412230551242828) | > loss_disc_real_1: 0.3325679302215576 (0.3325679302215576) | > loss_disc_real_2: 0.17171455919742584 (0.17171455919742584) | > loss_disc_real_3: 0.21695567667484283 (0.21695567667484283) | > loss_disc_real_4: 0.2502813935279846 (0.2502813935279846) | > loss_disc_real_5: 0.387764036655426 (0.387764036655426) | > loss_0: 2.4098961353302 (2.4098961353302) | > loss_gen: 2.4133243560791016 (2.4133243560791016) | > loss_kl: 3.6818621158599854 (3.6818621158599854) | > loss_feat: 3.53829288482666 (3.53829288482666) | > loss_mel: 24.26201629638672 (24.26201629638672) | > loss_duration: 2.7285280227661133 (2.7285280227661133) | > loss_1: 36.624019622802734 (36.624019622802734)  --> STEP: 2 | > loss_disc: 3.007626533508301 (2.7087613344192505) | > loss_disc_real_0: 0.13498537242412567 (0.11455383896827698) | > loss_disc_real_1: 0.2788937985897064 (0.305730864405632) | > loss_disc_real_2: 0.2539425492286682 (0.21282855421304703) | > loss_disc_real_3: 0.283926397562027 (0.2504410371184349) | > loss_disc_real_4: 0.26469817757606506 (0.25748978555202484) | > loss_disc_real_5: 0.2542734444141388 (0.3210187405347824) | > loss_0: 3.007626533508301 (2.7087613344192505) | > loss_gen: 1.4962050914764404 (1.954764723777771) | > loss_kl: 3.7647383213043213 (3.7233002185821533) | > loss_feat: 0.07531751692295074 (1.8068052008748055) | > loss_mel: 11.654502868652344 (17.95825958251953) | > loss_duration: 2.6416053771972656 (2.6850666999816895) | > loss_1: 19.632368087768555 (28.128193855285645)  --> STEP: 3 | > loss_disc: 2.491436719894409 (2.6363197962443032) | > loss_disc_real_0: 0.14063093066215515 (0.12324620286623637) | > loss_disc_real_1: 0.36123237013816833 (0.3242313663164775) | > loss_disc_real_2: 0.3284282088279724 (0.25136177241802216) | > loss_disc_real_3: 0.2929156422615051 (0.26459923883279163) | > loss_disc_real_4: 0.3686214089393616 (0.2945336600144704) | > loss_disc_real_5: 0.17186826467514038 (0.27130191524823505) | > loss_0: 2.491436719894409 (2.6363197962443032) | > loss_gen: 2.5425524711608887 (2.150693972905477) | > loss_kl: 2.0372791290283203 (3.1612931887308755) | > loss_feat: 3.457913398742676 (2.3571746001640954) | > loss_mel: 25.358177185058594 (20.424898783365887) | > loss_duration: 2.5323331356048584 (2.634155511856079) | > loss_1: 35.92825698852539 (30.728214899698894) --> EVAL PERFORMANCE | > avg_loader_time: 0.011170546213785807 (-0.0031842390696207694) | > avg_loss_disc: 2.6363197962443032 (-0.0019676685333251953) | > avg_loss_disc_real_0: 0.12324620286623637 (-0.1990594044327736) | > avg_loss_disc_real_1: 0.3242313663164775 (-0.02021010716756183) | > avg_loss_disc_real_2: 0.25136177241802216 (+0.01852094630400339) | > avg_loss_disc_real_3: 0.26459923883279163 (-0.10657856365044915) | > avg_loss_disc_real_4: 0.2945336600144704 (+0.06444435815016428) | > avg_loss_disc_real_5: 0.27130191524823505 (-0.05619824926058453) | > avg_loss_0: 2.6363197962443032 (-0.0019676685333251953) | > avg_loss_gen: 2.150693972905477 (-0.6453356742858887) | > avg_loss_kl: 3.1612931887308755 (+0.04115827878316214) | > avg_loss_feat: 2.3571746001640954 (-2.375404313206673) | > avg_loss_mel: 20.424898783365887 (-5.836200078328449) | > avg_loss_duration: 2.634155511856079 (+0.045513232549031724) | > avg_loss_1: 30.728214899698894 (-8.770269393920895)  > EPOCH: 354/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:32:13)   --> TIME: 2023-10-20 03:32:21 -- STEP: 9/50 -- GLOBAL_STEP: 70710 | > loss_disc: 2.936843156814575 (2.3380094236797757) | > loss_disc_real_0: 0.14091329276561737 (0.14093064723743332) | > loss_disc_real_1: 0.28191664814949036 (0.2025003714693917) | > loss_disc_real_2: 0.28545713424682617 (0.22955450581179726) | > loss_disc_real_3: 0.32794398069381714 (0.23491986509826449) | > loss_disc_real_4: 0.3290817439556122 (0.2225005121694671) | > loss_disc_real_5: 0.3225424289703369 (0.21237167509065735) | > loss_0: 2.936843156814575 (2.3380094236797757) | > grad_norm_0: tensor(359.3549, device='cuda:0') (tensor(587.4221, device='cuda:0')) | > loss_gen: 1.756814956665039 (2.5593015087975397) | > loss_kl: 0.4365187883377075 (0.8028390208880106) | > loss_feat: 0.3412325382232666 (6.929496844609578) | > loss_mel: 20.77840805053711 (24.726620568169487) | > loss_duration: 1.5258060693740845 (1.5457295046912298) | > loss_1: 24.838781356811523 (36.56398794386122) | > grad_norm_1: tensor(18072.9141, device='cuda:0') (tensor(28046.4766, device='cuda:0')) | > current_lr_0: 0.00014037188744985454 | > current_lr_1: 0.00014037188744985454 | > step_time: 0.4373 (0.41121024555630153) | > loader_time: 0.0035 (0.0069853199852837455)  --> TIME: 2023-10-20 03:32:37 -- STEP: 39/50 -- GLOBAL_STEP: 70740 | > loss_disc: 2.730799674987793 (2.38525739694253) | > loss_disc_real_0: 0.1405956745147705 (0.13861390258161685) | > loss_disc_real_1: 0.2283165156841278 (0.2271813085445991) | > loss_disc_real_2: 0.23856408894062042 (0.2311167183976907) | > loss_disc_real_3: 0.1992131918668747 (0.23472237692047385) | > loss_disc_real_4: 0.23355744779109955 (0.2213504915125668) | > loss_disc_real_5: 0.231781005859375 (0.21526468669374785) | > loss_0: 2.730799674987793 (2.38525739694253) | > grad_norm_0: tensor(693.3358, device='cuda:0') (tensor(533.4975, device='cuda:0')) | > loss_gen: 1.7026029825210571 (2.419124554365109) | > loss_kl: 0.3504640758037567 (0.8265624871620765) | > loss_feat: 1.5497066974639893 (5.35319201896588) | > loss_mel: 16.59721565246582 (22.02569085206741) | > loss_duration: 1.6112881898880005 (1.549551933239668) | > loss_1: 21.811277389526367 (32.17412200340858) | > grad_norm_1: tensor(3507.1436, device='cuda:0') (tensor(22430.0684, device='cuda:0')) | > current_lr_0: 0.00014037188744985454 | > current_lr_1: 0.00014037188744985454 | > step_time: 0.3062 (0.4811589167668269) | > loader_time: 0.0251 (0.014815550584059495)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4413928985595703 (2.4413928985595703) | > loss_disc_real_0: 0.251501202583313 (0.251501202583313) | > loss_disc_real_1: 0.4276901185512543 (0.4276901185512543) | > loss_disc_real_2: 0.32521796226501465 (0.32521796226501465) | > loss_disc_real_3: 0.2880393862724304 (0.2880393862724304) | > loss_disc_real_4: 0.11720932275056839 (0.11720932275056839) | > loss_disc_real_5: 0.16592071950435638 (0.16592071950435638) | > loss_0: 2.4413928985595703 (2.4413928985595703) | > loss_gen: 2.5494298934936523 (2.5494298934936523) | > loss_kl: 3.163088321685791 (3.163088321685791) | > loss_feat: 5.504880905151367 (5.504880905151367) | > loss_mel: 24.222705841064453 (24.222705841064453) | > loss_duration: 2.480752468109131 (2.480752468109131) | > loss_1: 37.92085647583008 (37.92085647583008)  --> STEP: 1 | > loss_disc: 2.02177095413208 (2.02177095413208) | > loss_disc_real_0: 0.07107464969158173 (0.07107464969158173) | > loss_disc_real_1: 0.17694829404354095 (0.17694829404354095) | > loss_disc_real_2: 0.15540443360805511 (0.15540443360805511) | > loss_disc_real_3: 0.27666041254997253 (0.27666041254997253) | > loss_disc_real_4: 0.09312326461076736 (0.09312326461076736) | > loss_disc_real_5: 0.2313036471605301 (0.2313036471605301) | > loss_0: 2.02177095413208 (2.02177095413208) | > loss_gen: 2.4129738807678223 (2.4129738807678223) | > loss_kl: 3.829740285873413 (3.829740285873413) | > loss_feat: 8.028924942016602 (8.028924942016602) | > loss_mel: 24.289945602416992 (24.289945602416992) | > loss_duration: 2.738173723220825 (2.738173723220825) | > loss_1: 41.29976272583008 (41.29976272583008)  --> STEP: 2 | > loss_disc: 3.018317222595215 (2.5200440883636475) | > loss_disc_real_0: 0.22568996250629425 (0.148382306098938) | > loss_disc_real_1: 0.2614750564098358 (0.21921167522668839) | > loss_disc_real_2: 0.2507137656211853 (0.2030590996146202) | > loss_disc_real_3: 0.30412110686302185 (0.2903907597064972) | > loss_disc_real_4: 0.20799818634986877 (0.15056072548031807) | > loss_disc_real_5: 0.21541476249694824 (0.22335920482873917) | > loss_0: 3.018317222595215 (2.5200440883636475) | > loss_gen: 1.4621367454528809 (1.9375553131103516) | > loss_kl: 3.4077558517456055 (3.6187480688095093) | > loss_feat: 0.03326696157455444 (4.031095951795578) | > loss_mel: 2.125432252883911 (13.207688927650452) | > loss_duration: 2.609447717666626 (2.6738107204437256) | > loss_1: 9.638039588928223 (25.46890115737915)  --> STEP: 3 | > loss_disc: 2.870028495788574 (2.6367055575052896) | > loss_disc_real_0: 0.08271176367998123 (0.12649212529261908) | > loss_disc_real_1: 0.39762818813323975 (0.2786838461955388) | > loss_disc_real_2: 0.26939716935157776 (0.2251717895269394) | > loss_disc_real_3: 0.41054123640060425 (0.3304409186045329) | > loss_disc_real_4: 0.3641597032546997 (0.22176038473844528) | > loss_disc_real_5: 0.28843340277671814 (0.24505060414473215) | > loss_0: 2.870028495788574 (2.6367055575052896) | > loss_gen: 2.185028314590454 (2.0200463136037192) | > loss_kl: 1.4084261655807495 (2.8819741010665894) | > loss_feat: 2.5889809131622314 (3.5503909389177957) | > loss_mel: 18.809812545776367 (15.075063467025757) | > loss_duration: 2.5366532802581787 (2.62809157371521) | > loss_1: 27.528902053833008 (26.15556812286377) --> EVAL PERFORMANCE | > avg_loader_time: 0.012269973754882812 (+0.0010994275410970058) | > avg_loss_disc: 2.6367055575052896 (+0.0003857612609863281) | > avg_loss_disc_real_0: 0.12649212529261908 (+0.0032459224263827052) | > avg_loss_disc_real_1: 0.2786838461955388 (-0.045547520120938656) | > avg_loss_disc_real_2: 0.2251717895269394 (-0.026189982891082764) | > avg_loss_disc_real_3: 0.3304409186045329 (+0.06584167977174127) | > avg_loss_disc_real_4: 0.22176038473844528 (-0.07277327527602512) | > avg_loss_disc_real_5: 0.24505060414473215 (-0.0262513111035029) | > avg_loss_0: 2.6367055575052896 (+0.0003857612609863281) | > avg_loss_gen: 2.0200463136037192 (-0.1306476593017578) | > avg_loss_kl: 2.8819741010665894 (-0.27931908766428615) | > avg_loss_feat: 3.5503909389177957 (+1.1932163387537003) | > avg_loss_mel: 15.075063467025757 (-5.34983531634013) | > avg_loss_duration: 2.62809157371521 (-0.006063938140869141) | > avg_loss_1: 26.15556812286377 (-4.572646776835125)  > EPOCH: 355/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:32:54)   --> TIME: 2023-10-20 03:33:07 -- STEP: 19/50 -- GLOBAL_STEP: 70770 | > loss_disc: 1.8301761150360107 (2.467944534201371) | > loss_disc_real_0: 0.028263963758945465 (0.1403967874418748) | > loss_disc_real_1: 0.13788250088691711 (0.2157420253283099) | > loss_disc_real_2: 0.11592136323451996 (0.21418972195763336) | > loss_disc_real_3: 0.19492898881435394 (0.24459075496384972) | > loss_disc_real_4: 0.14786645770072937 (0.1819790742041445) | > loss_disc_real_5: 0.18790507316589355 (0.21182166696771196) | > loss_0: 1.8301761150360107 (2.467944534201371) | > grad_norm_0: tensor(915.7190, device='cuda:0') (tensor(989.7378, device='cuda:0')) | > loss_gen: 2.934830904006958 (2.214787156958329) | > loss_kl: 0.8062989711761475 (0.9657607392260903) | > loss_feat: 7.735339641571045 (4.8288485637228735) | > loss_mel: 23.43596839904785 (21.945084810256958) | > loss_duration: 1.6023448705673218 (1.5853946648145978) | > loss_1: 36.5147819519043 (31.539876184965436) | > grad_norm_1: tensor(49061.7734, device='cuda:0') (tensor(47778.3633, device='cuda:0')) | > current_lr_0: 0.0001402315769597546 | > current_lr_1: 0.0001402315769597546 | > step_time: 0.2473 (0.44923276650278193) | > loader_time: 0.0029 (0.017225453728123716)  --> TIME: 2023-10-20 03:33:20 -- STEP: 49/50 -- GLOBAL_STEP: 70800 | > loss_disc: 2.342541217803955 (2.4661044636551215) | > loss_disc_real_0: 0.2776700258255005 (0.15044794379904564) | > loss_disc_real_1: 0.2714605927467346 (0.21505204040785225) | > loss_disc_real_2: 0.277372807264328 (0.21363547505164632) | > loss_disc_real_3: 0.26238903403282166 (0.2327986074497505) | > loss_disc_real_4: 0.16368019580841064 (0.20608404923553522) | > loss_disc_real_5: 0.18863257765769958 (0.21937970379937669) | > loss_0: 2.342541217803955 (2.4661044636551215) | > grad_norm_0: tensor(1844.2295, device='cuda:0') (tensor(1128.7252, device='cuda:0')) | > loss_gen: 3.7506489753723145 (2.25481405793404) | > loss_kl: 0.5153746008872986 (0.8649819322994777) | > loss_feat: 6.650567054748535 (4.870998347064062) | > loss_mel: 24.674110412597656 (21.878932140311417) | > loss_duration: 1.7418161630630493 (1.5588846595919863) | > loss_1: 37.33251953125 (31.428611074175155) | > grad_norm_1: tensor(97679.4844, device='cuda:0') (tensor(43113.5586, device='cuda:0')) | > current_lr_0: 0.0001402315769597546 | > current_lr_1: 0.0001402315769597546 | > step_time: 0.5166 (0.4158828647769227) | > loader_time: 0.4161 (0.019600624940833263)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2016799449920654 (2.2016799449920654) | > loss_disc_real_0: 0.25831836462020874 (0.25831836462020874) | > loss_disc_real_1: 0.18826580047607422 (0.18826580047607422) | > loss_disc_real_2: 0.21413514018058777 (0.21413514018058777) | > loss_disc_real_3: 0.28175798058509827 (0.28175798058509827) | > loss_disc_real_4: 0.19635240733623505 (0.19635240733623505) | > loss_disc_real_5: 0.21799153089523315 (0.21799153089523315) | > loss_0: 2.2016799449920654 (2.2016799449920654) | > loss_gen: 2.9255926609039307 (2.9255926609039307) | > loss_kl: 2.874422788619995 (2.874422788619995) | > loss_feat: 7.61696195602417 (7.61696195602417) | > loss_mel: 25.77243423461914 (25.77243423461914) | > loss_duration: 2.555788278579712 (2.555788278579712) | > loss_1: 41.745201110839844 (41.745201110839844)  --> STEP: 1 | > loss_disc: 2.5254061222076416 (2.5254061222076416) | > loss_disc_real_0: 0.36114126443862915 (0.36114126443862915) | > loss_disc_real_1: 0.24631403386592865 (0.24631403386592865) | > loss_disc_real_2: 0.3195926547050476 (0.3195926547050476) | > loss_disc_real_3: 0.19236057996749878 (0.19236057996749878) | > loss_disc_real_4: 0.32799240946769714 (0.32799240946769714) | > loss_disc_real_5: 0.27181288599967957 (0.27181288599967957) | > loss_0: 2.5254061222076416 (2.5254061222076416) | > loss_gen: 3.5140018463134766 (3.5140018463134766) | > loss_kl: 3.9247090816497803 (3.9247090816497803) | > loss_feat: 7.310223579406738 (7.310223579406738) | > loss_mel: 25.35643196105957 (25.35643196105957) | > loss_duration: 2.784961223602295 (2.784961223602295) | > loss_1: 42.89033126831055 (42.89033126831055)  --> STEP: 2 | > loss_disc: 2.901848077774048 (2.7136270999908447) | > loss_disc_real_0: 0.3138537108898163 (0.3374974876642227) | > loss_disc_real_1: 0.31028395891189575 (0.2782989963889122) | > loss_disc_real_2: 0.32837557792663574 (0.3239841163158417) | > loss_disc_real_3: 0.2927486002445221 (0.24255459010601044) | > loss_disc_real_4: 0.3334040939807892 (0.33069825172424316) | > loss_disc_real_5: 0.27975407242774963 (0.2757834792137146) | > loss_0: 2.901848077774048 (2.7136270999908447) | > loss_gen: 2.1880698204040527 (2.8510358333587646) | > loss_kl: 3.470670461654663 (3.6976897716522217) | > loss_feat: 1.0411030054092407 (4.1756632924079895) | > loss_mel: 19.572973251342773 (22.464702606201172) | > loss_duration: 2.6295289993286133 (2.707245111465454) | > loss_1: 28.902347564697266 (35.896339416503906)  --> STEP: 3 | > loss_disc: 3.7489280700683594 (3.058727423350016) | > loss_disc_real_0: 0.5517584681510925 (0.4089178144931793) | > loss_disc_real_1: 0.3448778986930847 (0.30049196382363635) | > loss_disc_real_2: 0.5717093348503113 (0.40655918916066486) | > loss_disc_real_3: 0.37055882811546326 (0.2852226694424947) | > loss_disc_real_4: 0.3400058448314667 (0.3338007827599843) | > loss_disc_real_5: 0.3872298300266266 (0.3129322628180186) | > loss_0: 3.7489280700683594 (3.058727423350016) | > loss_gen: 2.1641690731048584 (2.6220802466074624) | > loss_kl: 1.7833921909332275 (3.0595905780792236) | > loss_feat: 3.643707752227783 (3.9983447790145874) | > loss_mel: 22.132543563842773 (22.35398292541504) | > loss_duration: 2.598900556564331 (2.6711302598317466) | > loss_1: 32.32271194458008 (34.70513025919596) --> EVAL PERFORMANCE | > avg_loader_time: 0.007091363271077474 (-0.005178610483805339) | > avg_loss_disc: 3.058727423350016 (+0.42202186584472656) | > avg_loss_disc_real_0: 0.4089178144931793 (+0.2824256892005602) | > avg_loss_disc_real_1: 0.30049196382363635 (+0.021808117628097534) | > avg_loss_disc_real_2: 0.40655918916066486 (+0.18138739963372547) | > avg_loss_disc_real_3: 0.2852226694424947 (-0.045218249162038204) | > avg_loss_disc_real_4: 0.3338007827599843 (+0.11204039802153903) | > avg_loss_disc_real_5: 0.3129322628180186 (+0.06788165867328647) | > avg_loss_0: 3.058727423350016 (+0.42202186584472656) | > avg_loss_gen: 2.6220802466074624 (+0.6020339330037432) | > avg_loss_kl: 3.0595905780792236 (+0.17761647701263428) | > avg_loss_feat: 3.9983447790145874 (+0.44795384009679173) | > avg_loss_mel: 22.35398292541504 (+7.278919458389282) | > avg_loss_duration: 2.6711302598317466 (+0.043038686116536606) | > avg_loss_1: 34.70513025919596 (+8.549562136332192)  > EPOCH: 356/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:33:32)   --> TIME: 2023-10-20 03:33:52 -- STEP: 29/50 -- GLOBAL_STEP: 70830 | > loss_disc: 2.8544015884399414 (2.4259202439209506) | > loss_disc_real_0: 0.22591285407543182 (0.17095741128613212) | > loss_disc_real_1: 0.2456003725528717 (0.21818744108594698) | > loss_disc_real_2: 0.15734650194644928 (0.2208324316246756) | > loss_disc_real_3: 0.29758626222610474 (0.2441732837208386) | > loss_disc_real_4: 0.2467370331287384 (0.22627487393288775) | > loss_disc_real_5: 0.31352707743644714 (0.22962984339944248) | > loss_0: 2.8544015884399414 (2.4259202439209506) | > grad_norm_0: tensor(1498.2242, device='cuda:0') (tensor(1138.5529, device='cuda:0')) | > loss_gen: 1.6423604488372803 (2.312432313787526) | > loss_kl: 0.7496612668037415 (0.8295648437121819) | > loss_feat: 0.49714505672454834 (5.15841012936214) | > loss_mel: 6.941089630126953 (22.286222852509596) | > loss_duration: 1.5506093502044678 (1.578021423570041) | > loss_1: 11.380866050720215 (32.16465114725047) | > grad_norm_1: tensor(12376.5381, device='cuda:0') (tensor(40541.6602, device='cuda:0')) | > current_lr_0: 0.00014009140671877426 | > current_lr_1: 0.00014009140671877426 | > step_time: 0.5896 (0.49828548266969874) | > loader_time: 0.0041 (0.019199124697981212)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0474207401275635 (3.0474207401275635) | > loss_disc_real_0: 0.3895643949508667 (0.3895643949508667) | > loss_disc_real_1: 0.39392709732055664 (0.39392709732055664) | > loss_disc_real_2: 0.48482745885849 (0.48482745885849) | > loss_disc_real_3: 0.2999071776866913 (0.2999071776866913) | > loss_disc_real_4: 0.27808353304862976 (0.27808353304862976) | > loss_disc_real_5: 0.23241844773292542 (0.23241844773292542) | > loss_0: 3.0474207401275635 (3.0474207401275635) | > loss_gen: 2.542900800704956 (2.542900800704956) | > loss_kl: 2.8483972549438477 (2.8483972549438477) | > loss_feat: 5.12918758392334 (5.12918758392334) | > loss_mel: 24.6950626373291 (24.6950626373291) | > loss_duration: 2.5112156867980957 (2.5112156867980957) | > loss_1: 37.72676086425781 (37.72676086425781)  --> STEP: 1 | > loss_disc: 2.684563636779785 (2.684563636779785) | > loss_disc_real_0: 0.10432861000299454 (0.10432861000299454) | > loss_disc_real_1: 0.2376965582370758 (0.2376965582370758) | > loss_disc_real_2: 0.2524186670780182 (0.2524186670780182) | > loss_disc_real_3: 0.39957430958747864 (0.39957430958747864) | > loss_disc_real_4: 0.3254060745239258 (0.3254060745239258) | > loss_disc_real_5: 0.3455655872821808 (0.3455655872821808) | > loss_0: 2.684563636779785 (2.684563636779785) | > loss_gen: 2.189340114593506 (2.189340114593506) | > loss_kl: 3.7928695678710938 (3.7928695678710938) | > loss_feat: 4.169114589691162 (4.169114589691162) | > loss_mel: 26.003746032714844 (26.003746032714844) | > loss_duration: 2.7669265270233154 (2.7669265270233154) | > loss_1: 38.921993255615234 (38.921993255615234)  --> STEP: 2 | > loss_disc: 3.2225232124328613 (2.9535434246063232) | > loss_disc_real_0: 0.45899462699890137 (0.28166161850094795) | > loss_disc_real_1: 0.3419114053249359 (0.28980398178100586) | > loss_disc_real_2: 0.5122982859611511 (0.38235847651958466) | > loss_disc_real_3: 0.30260661244392395 (0.3510904610157013) | > loss_disc_real_4: 0.4761696755886078 (0.4007878750562668) | > loss_disc_real_5: 0.2943710684776306 (0.3199683278799057) | > loss_0: 3.2225232124328613 (2.9535434246063232) | > loss_gen: 2.9612231254577637 (2.5752816200256348) | > loss_kl: 3.927905797958374 (3.860387682914734) | > loss_feat: 7.918859958648682 (6.043987274169922) | > loss_mel: 25.103403091430664 (25.553574562072754) | > loss_duration: 2.6810662746429443 (2.72399640083313) | > loss_1: 42.59245681762695 (40.757225036621094)  --> STEP: 3 | > loss_disc: 2.7667136192321777 (2.8912668228149414) | > loss_disc_real_0: 0.26017892360687256 (0.2745007202029228) | > loss_disc_real_1: 0.2317119687795639 (0.2704399774471919) | > loss_disc_real_2: 0.5014063119888306 (0.4220410883426666) | > loss_disc_real_3: 0.3288191854953766 (0.3436667025089264) | > loss_disc_real_4: 0.3358742296695709 (0.3791499932607015) | > loss_disc_real_5: 0.25145789980888367 (0.2971315185228984) | > loss_0: 2.7667136192321777 (2.8912668228149414) | > loss_gen: 2.668414831161499 (2.6063260237375894) | > loss_kl: 1.6535166501998901 (3.124764005343119) | > loss_feat: 5.262121200561523 (5.783365249633789) | > loss_mel: 21.749544143676758 (24.285564422607422) | > loss_duration: 2.5303733348846436 (2.6594553788503013) | > loss_1: 33.86397171020508 (38.45947392781576) --> EVAL PERFORMANCE | > avg_loader_time: 0.013741095860799154 (+0.0066497325897216806) | > avg_loss_disc: 2.8912668228149414 (-0.16746060053507472) | > avg_loss_disc_real_0: 0.2745007202029228 (-0.1344170942902565) | > avg_loss_disc_real_1: 0.2704399774471919 (-0.03005198637644446) | > avg_loss_disc_real_2: 0.4220410883426666 (+0.015481899182001768) | > avg_loss_disc_real_3: 0.3436667025089264 (+0.0584440330664317) | > avg_loss_disc_real_4: 0.3791499932607015 (+0.04534921050071716) | > avg_loss_disc_real_5: 0.2971315185228984 (-0.01580074429512024) | > avg_loss_0: 2.8912668228149414 (-0.16746060053507472) | > avg_loss_gen: 2.6063260237375894 (-0.015754222869873047) | > avg_loss_kl: 3.124764005343119 (+0.06517342726389552) | > avg_loss_feat: 5.783365249633789 (+1.7850204706192017) | > avg_loss_mel: 24.285564422607422 (+1.9315814971923828) | > avg_loss_duration: 2.6594553788503013 (-0.011674880981445312) | > avg_loss_1: 38.45947392781576 (+3.7543436686197964)  > EPOCH: 357/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:34:15)   --> TIME: 2023-10-20 03:34:24 -- STEP: 9/50 -- GLOBAL_STEP: 70860 | > loss_disc: 2.7023844718933105 (2.3526156875822277) | > loss_disc_real_0: 0.10102211683988571 (0.1065002398358451) | > loss_disc_real_1: 0.27058523893356323 (0.24790442238251367) | > loss_disc_real_2: 0.22813042998313904 (0.2454594431651963) | > loss_disc_real_3: 0.2905485928058624 (0.2545551773574617) | > loss_disc_real_4: 0.23602449893951416 (0.2633333487643136) | > loss_disc_real_5: 0.23098662495613098 (0.21371305899487603) | > loss_0: 2.7023844718933105 (2.3526156875822277) | > grad_norm_0: tensor(2776.9617, device='cuda:0') (tensor(1297.1385, device='cuda:0')) | > loss_gen: 1.7930574417114258 (2.53069535891215) | > loss_kl: 0.7027350664138794 (0.9722337855233086) | > loss_feat: 1.2592276334762573 (5.436119410726759) | > loss_mel: 17.621625900268555 (22.546168857150608) | > loss_duration: 1.5104539394378662 (1.563957028918796) | > loss_1: 22.88709831237793 (33.049173990885414) | > grad_norm_1: tensor(13424.3857, device='cuda:0') (tensor(50346.4727, device='cuda:0')) | > current_lr_0: 0.00013995137658672578 | > current_lr_1: 0.00013995137658672578 | > step_time: 0.5826 (0.38874247339036727) | > loader_time: 0.0118 (0.01400915781656901)  --> TIME: 2023-10-20 03:34:38 -- STEP: 39/50 -- GLOBAL_STEP: 70890 | > loss_disc: 3.066279888153076 (2.4942981646611133) | > loss_disc_real_0: 0.3607255518436432 (0.1581907129058471) | > loss_disc_real_1: 0.30130791664123535 (0.22609581664586678) | > loss_disc_real_2: 0.3015933632850647 (0.23578402820305946) | > loss_disc_real_3: 0.23671668767929077 (0.2508479486673306) | > loss_disc_real_4: 0.24794763326644897 (0.2482107850508048) | > loss_disc_real_5: 0.3624473512172699 (0.23698874211941773) | > loss_0: 3.066279888153076 (2.4942981646611133) | > grad_norm_0: tensor(1158.9131, device='cuda:0') (tensor(1680.8424, device='cuda:0')) | > loss_gen: 1.687792181968689 (2.3567641362165794) | > loss_kl: 0.810829222202301 (0.8474442592033973) | > loss_feat: 0.10796521604061127 (4.927261504607323) | > loss_mel: 2.31108021736145 (21.522069863784008) | > loss_duration: 1.594496250152588 (1.5523740236575785) | > loss_1: 6.512163162231445 (31.205913568154365) | > grad_norm_1: tensor(43818.4570, device='cuda:0') (tensor(36115.1758, device='cuda:0')) | > current_lr_0: 0.00013995137658672578 | > current_lr_1: 0.00013995137658672578 | > step_time: 0.5521 (0.4361536074907352) | > loader_time: 0.0226 (0.012697916764479417)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.434140682220459 (3.434140682220459) | > loss_disc_real_0: 0.5598881244659424 (0.5598881244659424) | > loss_disc_real_1: 0.29042670130729675 (0.29042670130729675) | > loss_disc_real_2: 0.34699422121047974 (0.34699422121047974) | > loss_disc_real_3: 0.33990660309791565 (0.33990660309791565) | > loss_disc_real_4: 0.37274041771888733 (0.37274041771888733) | > loss_disc_real_5: 0.35294848680496216 (0.35294848680496216) | > loss_0: 3.434140682220459 (3.434140682220459) | > loss_gen: 2.1625819206237793 (2.1625819206237793) | > loss_kl: 3.2122561931610107 (3.2122561931610107) | > loss_feat: 2.221193790435791 (2.221193790435791) | > loss_mel: 20.569154739379883 (20.569154739379883) | > loss_duration: 2.549426555633545 (2.549426555633545) | > loss_1: 30.714614868164062 (30.714614868164062)  --> STEP: 1 | > loss_disc: 2.2136995792388916 (2.2136995792388916) | > loss_disc_real_0: 0.1405210793018341 (0.1405210793018341) | > loss_disc_real_1: 0.17535333335399628 (0.17535333335399628) | > loss_disc_real_2: 0.13519658148288727 (0.13519658148288727) | > loss_disc_real_3: 0.38501274585723877 (0.38501274585723877) | > loss_disc_real_4: 0.2501286566257477 (0.2501286566257477) | > loss_disc_real_5: 0.3254146873950958 (0.3254146873950958) | > loss_0: 2.2136995792388916 (2.2136995792388916) | > loss_gen: 2.8452155590057373 (2.8452155590057373) | > loss_kl: 3.737064838409424 (3.737064838409424) | > loss_feat: 6.023212909698486 (6.023212909698486) | > loss_mel: 24.922012329101562 (24.922012329101562) | > loss_duration: 2.819380283355713 (2.819380283355713) | > loss_1: 40.346885681152344 (40.346885681152344)  --> STEP: 2 | > loss_disc: 2.947960615158081 (2.5808300971984863) | > loss_disc_real_0: 0.39236098527908325 (0.2664410322904587) | > loss_disc_real_1: 0.2955828607082367 (0.23546809703111649) | > loss_disc_real_2: 0.36421167850494385 (0.24970412999391556) | > loss_disc_real_3: 0.3088171184062958 (0.3469149321317673) | > loss_disc_real_4: 0.23907381296157837 (0.24460123479366302) | > loss_disc_real_5: 0.20640316605567932 (0.2659089267253876) | > loss_0: 2.947960615158081 (2.5808300971984863) | > loss_gen: 2.000535011291504 (2.4228752851486206) | > loss_kl: 3.558845043182373 (3.6479549407958984) | > loss_feat: 0.8697869181632996 (3.446499913930893) | > loss_mel: 8.629337310791016 (16.77567481994629) | > loss_duration: 2.610231876373291 (2.714806079864502) | > loss_1: 17.66873550415039 (29.007810592651367)  --> STEP: 3 | > loss_disc: 1.4908716678619385 (2.2175106207529702) | > loss_disc_real_0: 0.018986186012625694 (0.183956083531181) | > loss_disc_real_1: 0.05904736369848251 (0.1766611859202385) | > loss_disc_real_2: 0.048711638897657394 (0.1827066329618295) | > loss_disc_real_3: 0.01322262454777956 (0.2356841629371047) | > loss_disc_real_4: 0.07161498814821243 (0.18693915257851282) | > loss_disc_real_5: 0.0208289697766304 (0.1842156077424685) | > loss_0: 1.4908716678619385 (2.2175106207529702) | > loss_gen: 2.2920825481414795 (2.3792777061462402) | > loss_kl: 2.059424638748169 (3.118444840113322) | > loss_feat: 9.451615333557129 (5.448205053806305) | > loss_mel: 27.08802032470703 (20.213123321533203) | > loss_duration: 2.6469781398773193 (2.692196766535441) | > loss_1: 43.53812026977539 (33.85124715169271) --> EVAL PERFORMANCE | > avg_loader_time: 0.0038350423177083335 (-0.00990605354309082) | > avg_loss_disc: 2.2175106207529702 (-0.6737562020619712) | > avg_loss_disc_real_0: 0.183956083531181 (-0.09054463667174181) | > avg_loss_disc_real_1: 0.1766611859202385 (-0.0937787915269534) | > avg_loss_disc_real_2: 0.1827066329618295 (-0.2393344553808371) | > avg_loss_disc_real_3: 0.2356841629371047 (-0.10798253957182169) | > avg_loss_disc_real_4: 0.18693915257851282 (-0.19221084068218866) | > avg_loss_disc_real_5: 0.1842156077424685 (-0.11291591078042987) | > avg_loss_0: 2.2175106207529702 (-0.6737562020619712) | > avg_loss_gen: 2.3792777061462402 (-0.22704831759134914) | > avg_loss_kl: 3.118444840113322 (-0.006319165229797363) | > avg_loss_feat: 5.448205053806305 (-0.33516019582748413) | > avg_loss_mel: 20.213123321533203 (-4.072441101074219) | > avg_loss_duration: 2.692196766535441 (+0.03274138768513968) | > avg_loss_1: 33.85124715169271 (-4.608226776123047)  > EPOCH: 358/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:34:54)   --> TIME: 2023-10-20 03:35:08 -- STEP: 19/50 -- GLOBAL_STEP: 70920 | > loss_disc: 2.244981288909912 (2.641239969353927) | > loss_disc_real_0: 0.222380131483078 (0.1974498122244289) | > loss_disc_real_1: 0.22322189807891846 (0.23261082221410775) | > loss_disc_real_2: 0.17173904180526733 (0.24933826099885137) | > loss_disc_real_3: 0.24454732239246368 (0.24625171642554433) | > loss_disc_real_4: 0.18425661325454712 (0.28883500240351023) | > loss_disc_real_5: 0.1638762652873993 (0.26779178804472875) | > loss_0: 2.244981288909912 (2.641239969353927) | > grad_norm_0: tensor(661.9016, device='cuda:0') (tensor(779.1430, device='cuda:0')) | > loss_gen: 2.690865993499756 (2.343099882728175) | > loss_kl: 0.9051045179367065 (0.9893425514823512) | > loss_feat: 5.667558193206787 (4.86926139949968) | > loss_mel: 24.96495819091797 (20.12936750838631) | > loss_duration: 1.6727643013000488 (1.5842774792721397) | > loss_1: 35.901248931884766 (29.915348329042132) | > grad_norm_1: tensor(17378.7383, device='cuda:0') (tensor(33637.1992, device='cuda:0')) | > current_lr_0: 0.00013981148642356144 | > current_lr_1: 0.00013981148642356144 | > step_time: 0.5685 (0.47965387294166967) | > loader_time: 0.0042 (0.015902820386384662)  --> TIME: 2023-10-20 03:35:22 -- STEP: 49/50 -- GLOBAL_STEP: 70950 | > loss_disc: 2.9461803436279297 (2.5638328255439293) | > loss_disc_real_0: 0.3283771872520447 (0.18866234343042787) | > loss_disc_real_1: 0.3250928223133087 (0.22916050091842) | > loss_disc_real_2: 0.228823721408844 (0.23689228341895707) | > loss_disc_real_3: 0.2794243097305298 (0.22904723795244886) | > loss_disc_real_4: 0.22603921592235565 (0.25398440974555453) | > loss_disc_real_5: 0.2501159906387329 (0.24374844487376351) | > loss_0: 2.9461803436279297 (2.5638328255439293) | > grad_norm_0: tensor(2774.6067, device='cuda:0') (tensor(754.8825, device='cuda:0')) | > loss_gen: 1.8174799680709839 (2.2682290977361252) | > loss_kl: 0.6128918528556824 (0.9110261645852303) | > loss_feat: 0.27090662717819214 (4.730108877910038) | > loss_mel: 13.547113418579102 (21.27333328431966) | > loss_duration: 1.6279816627502441 (1.5478462905299908) | > loss_1: 17.876373291015625 (30.730543379880945) | > grad_norm_1: tensor(17090.1387, device='cuda:0') (tensor(23878.5117, device='cuda:0')) | > current_lr_0: 0.00013981148642356144 | > current_lr_1: 0.00013981148642356144 | > step_time: 0.4076 (0.44505408832005094) | > loader_time: 0.6909 (0.02584445233247718)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.514104127883911 (2.514104127883911) | > loss_disc_real_0: 0.16019713878631592 (0.16019713878631592) | > loss_disc_real_1: 0.33979132771492004 (0.33979132771492004) | > loss_disc_real_2: 0.31665003299713135 (0.31665003299713135) | > loss_disc_real_3: 0.2934558689594269 (0.2934558689594269) | > loss_disc_real_4: 0.3660392761230469 (0.3660392761230469) | > loss_disc_real_5: 0.35568320751190186 (0.35568320751190186) | > loss_0: 2.514104127883911 (2.514104127883911) | > loss_gen: 2.947760820388794 (2.947760820388794) | > loss_kl: 2.896817922592163 (2.896817922592163) | > loss_feat: 6.3249077796936035 (6.3249077796936035) | > loss_mel: 25.591054916381836 (25.591054916381836) | > loss_duration: 2.467161178588867 (2.467161178588867) | > loss_1: 40.22770690917969 (40.22770690917969)  --> STEP: 1 | > loss_disc: 2.7086758613586426 (2.7086758613586426) | > loss_disc_real_0: 0.27420133352279663 (0.27420133352279663) | > loss_disc_real_1: 0.26902535557746887 (0.26902535557746887) | > loss_disc_real_2: 0.2630656361579895 (0.2630656361579895) | > loss_disc_real_3: 0.32142531871795654 (0.32142531871795654) | > loss_disc_real_4: 0.20320162177085876 (0.20320162177085876) | > loss_disc_real_5: 0.24044126272201538 (0.24044126272201538) | > loss_0: 2.7086758613586426 (2.7086758613586426) | > loss_gen: 2.014497995376587 (2.014497995376587) | > loss_kl: 3.5159997940063477 (3.5159997940063477) | > loss_feat: 1.9777255058288574 (1.9777255058288574) | > loss_mel: 20.05947494506836 (20.05947494506836) | > loss_duration: 2.7504422664642334 (2.7504422664642334) | > loss_1: 30.318140029907227 (30.318140029907227)  --> STEP: 2 | > loss_disc: 2.976238489151001 (2.8424571752548218) | > loss_disc_real_0: 0.3495899438858032 (0.3118956387042999) | > loss_disc_real_1: 0.31703734397888184 (0.29303134977817535) | > loss_disc_real_2: 0.2252083271741867 (0.2441369816660881) | > loss_disc_real_3: 0.2900471091270447 (0.3057362139225006) | > loss_disc_real_4: 0.2258395254611969 (0.21452057361602783) | > loss_disc_real_5: 0.26294004917144775 (0.25169065594673157) | > loss_0: 2.976238489151001 (2.8424571752548218) | > loss_gen: 1.7412906885147095 (1.8778943419456482) | > loss_kl: 3.8762009143829346 (3.696100354194641) | > loss_feat: 0.15153120458126068 (1.064628355205059) | > loss_mel: 2.4877288341522217 (11.27360188961029) | > loss_duration: 2.614912986755371 (2.6826776266098022) | > loss_1: 10.871665000915527 (20.594902515411377)  --> STEP: 3 | > loss_disc: 2.9801812171936035 (2.8883651892344155) | > loss_disc_real_0: 0.3537004590034485 (0.3258305788040161) | > loss_disc_real_1: 0.31717997789382935 (0.30108089248339337) | > loss_disc_real_2: 0.22506564855575562 (0.2377798706293106) | > loss_disc_real_3: 0.2899223864078522 (0.3004649380842845) | > loss_disc_real_4: 0.22590917348861694 (0.21831677357355753) | > loss_disc_real_5: 0.2630777359008789 (0.2554863492647807) | > loss_0: 2.9801812171936035 (2.8883651892344155) | > loss_gen: 1.7418168783187866 (1.832535187403361) | > loss_kl: 2.1976699829101562 (3.1966235637664795) | > loss_feat: 0.1439959853887558 (0.7577508985996246) | > loss_mel: 3.7838428020477295 (8.777015527089437) | > loss_duration: 2.468538284301758 (2.611297845840454) | > loss_1: 10.335864067077637 (17.175223032633465) --> EVAL PERFORMANCE | > avg_loader_time: 0.016701539357503254 (+0.01286649703979492) | > avg_loss_disc: 2.8883651892344155 (+0.6708545684814453) | > avg_loss_disc_real_0: 0.3258305788040161 (+0.1418744952728351) | > avg_loss_disc_real_1: 0.30108089248339337 (+0.12441970656315487) | > avg_loss_disc_real_2: 0.2377798706293106 (+0.055073237667481095) | > avg_loss_disc_real_3: 0.3004649380842845 (+0.06478077514717978) | > avg_loss_disc_real_4: 0.21831677357355753 (+0.03137762099504471) | > avg_loss_disc_real_5: 0.2554863492647807 (+0.07127074152231219) | > avg_loss_0: 2.8883651892344155 (+0.6708545684814453) | > avg_loss_gen: 1.832535187403361 (-0.5467425187428792) | > avg_loss_kl: 3.1966235637664795 (+0.0781787236531577) | > avg_loss_feat: 0.7577508985996246 (-4.69045415520668) | > avg_loss_mel: 8.777015527089437 (-11.436107794443766) | > avg_loss_duration: 2.611297845840454 (-0.08089892069498683) | > avg_loss_1: 17.175223032633465 (-16.676024119059246)  > EPOCH: 359/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:35:33)   --> TIME: 2023-10-20 03:35:53 -- STEP: 29/50 -- GLOBAL_STEP: 70980 | > loss_disc: 2.087536334991455 (2.263303090786111) | > loss_disc_real_0: 0.14593720436096191 (0.1360251715663692) | > loss_disc_real_1: 0.3568810224533081 (0.21824314772825817) | > loss_disc_real_2: 0.2945653200149536 (0.2174748743017172) | > loss_disc_real_3: 0.1720988005399704 (0.21439868687041874) | > loss_disc_real_4: 0.2888807952404022 (0.18922110630905833) | > loss_disc_real_5: 0.24681192636489868 (0.19054922673465877) | > loss_0: 2.087536334991455 (2.263303090786111) | > grad_norm_0: tensor(564.1422, device='cuda:0') (tensor(539.1298, device='cuda:0')) | > loss_gen: 3.4990711212158203 (2.566992056780848) | > loss_kl: 0.5399801135063171 (0.9051715680237474) | > loss_feat: 6.521642684936523 (6.217994255752399) | > loss_mel: 24.007610321044922 (23.00691379349807) | > loss_duration: 1.5514581203460693 (1.563182181325452) | > loss_1: 36.1197624206543 (34.26025403779129) | > grad_norm_1: tensor(8825.1562, device='cuda:0') (tensor(27855.3066, device='cuda:0')) | > current_lr_0: 0.00013967173608937366 | > current_lr_1: 0.00013967173608937366 | > step_time: 0.6919 (0.5008910771073967) | > loader_time: 0.0235 (0.020504655509159482)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3192994594573975 (2.3192994594573975) | > loss_disc_real_0: 0.3857489824295044 (0.3857489824295044) | > loss_disc_real_1: 0.3514266014099121 (0.3514266014099121) | > loss_disc_real_2: 0.4048270583152771 (0.4048270583152771) | > loss_disc_real_3: 0.30571457743644714 (0.30571457743644714) | > loss_disc_real_4: 0.22552679479122162 (0.22552679479122162) | > loss_disc_real_5: 0.029772883281111717 (0.029772883281111717) | > loss_0: 2.3192994594573975 (2.3192994594573975) | > loss_gen: 3.3058969974517822 (3.3058969974517822) | > loss_kl: 2.4267024993896484 (2.4267024993896484) | > loss_feat: 7.588166236877441 (7.588166236877441) | > loss_mel: 24.933326721191406 (24.933326721191406) | > loss_duration: 2.420346975326538 (2.420346975326538) | > loss_1: 40.6744384765625 (40.6744384765625)  --> STEP: 1 | > loss_disc: 3.1271800994873047 (3.1271800994873047) | > loss_disc_real_0: 0.22785735130310059 (0.22785735130310059) | > loss_disc_real_1: 0.2963503897190094 (0.2963503897190094) | > loss_disc_real_2: 0.21929356455802917 (0.21929356455802917) | > loss_disc_real_3: 0.4283354878425598 (0.4283354878425598) | > loss_disc_real_4: 0.27617785334587097 (0.27617785334587097) | > loss_disc_real_5: 0.23682187497615814 (0.23682187497615814) | > loss_0: 3.1271800994873047 (3.1271800994873047) | > loss_gen: 2.046839952468872 (2.046839952468872) | > loss_kl: 3.682330846786499 (3.682330846786499) | > loss_feat: 5.75557804107666 (5.75557804107666) | > loss_mel: 26.777101516723633 (26.777101516723633) | > loss_duration: 2.693070411682129 (2.693070411682129) | > loss_1: 40.95492172241211 (40.95492172241211)  --> STEP: 2 | > loss_disc: 2.480989933013916 (2.8040850162506104) | > loss_disc_real_0: 0.252360463142395 (0.2401089072227478) | > loss_disc_real_1: 0.3138462007045746 (0.305098295211792) | > loss_disc_real_2: 0.3613662123680115 (0.2903298884630203) | > loss_disc_real_3: 0.3086574375629425 (0.36849646270275116) | > loss_disc_real_4: 0.15700829029083252 (0.21659307181835175) | > loss_disc_real_5: 0.2698492109775543 (0.25333554297685623) | > loss_0: 2.480989933013916 (2.8040850162506104) | > loss_gen: 2.7165462970733643 (2.381693124771118) | > loss_kl: 3.4012277126312256 (3.5417792797088623) | > loss_feat: 5.046335220336914 (5.400956630706787) | > loss_mel: 26.51070213317871 (26.643901824951172) | > loss_duration: 2.595431327819824 (2.6442508697509766) | > loss_1: 40.27024459838867 (40.61258316040039)  --> STEP: 3 | > loss_disc: 3.04221773147583 (2.88346258799235) | > loss_disc_real_0: 0.22630545496940613 (0.2355077564716339) | > loss_disc_real_1: 0.26469922065734863 (0.29163193702697754) | > loss_disc_real_2: 0.2732239365577698 (0.28462790449460346) | > loss_disc_real_3: 0.3756033182144165 (0.37086541453997296) | > loss_disc_real_4: 0.26803654432296753 (0.233740895986557) | > loss_disc_real_5: 0.3257981836795807 (0.27748975654443103) | > loss_0: 3.04221773147583 (2.88346258799235) | > loss_gen: 1.7310845851898193 (2.164823611577352) | > loss_kl: 1.6453721523284912 (2.909643570582072) | > loss_feat: 0.009886812418699265 (3.6039333579440913) | > loss_mel: 1.639968752861023 (18.309257467587788) | > loss_duration: 2.444007158279419 (2.577502965927124) | > loss_1: 7.470319747924805 (29.565162022908527) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_71000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.760202407836914 (2.852647542953491) | > loss_disc_real_0: 0.17739027738571167 (0.22097838670015335) | > loss_disc_real_1: 0.2592278718948364 (0.28353092074394226) | > loss_disc_real_2: 0.36807483434677124 (0.3054896369576454) | > loss_disc_real_3: 0.48050278425216675 (0.3982747569680214) | > loss_disc_real_4: 0.4070263206958771 (0.277062252163887) | > loss_disc_real_5: 0.2548961937427521 (0.2718413658440113) | > loss_0: 2.760202407836914 (2.852647542953491) | > loss_gen: 2.7160565853118896 (2.3026318550109863) | > loss_kl: 2.4878664016723633 (2.8041992783546448) | > loss_feat: 6.31872034072876 (4.282630103640258) | > loss_mel: 23.76515769958496 (19.673232525587082) | > loss_duration: 2.4629123210906982 (2.5488553047180176) | > loss_1: 37.75071716308594 (31.61155080795288)  --> STEP: 1 | > loss_disc: 2.4044415950775146 (2.763006353378296) | > loss_disc_real_0: 0.048264287412166595 (0.186435566842556) | > loss_disc_real_1: 0.34286072850227356 (0.2953968822956085) | > loss_disc_real_2: 0.31847435235977173 (0.30808658003807066) | > loss_disc_real_3: 0.2174527943134308 (0.36211036443710326) | > loss_disc_real_4: 0.2315891832113266 (0.26796763837337495) | > loss_disc_real_5: 0.20427043735980988 (0.25832718014717104) | > loss_0: 2.4044415950775146 (2.763006353378296) | > loss_gen: 2.4242351055145264 (2.326952505111694) | > loss_kl: 3.6736295223236084 (2.9780853271484373) | > loss_feat: 7.343922138214111 (4.894888510555029) | > loss_mel: 28.30379295349121 (21.39934461116791) | > loss_duration: 2.687797784805298 (2.5766438007354737) | > loss_1: 44.43337631225586 (34.17591590881348)  --> STEP: 2 | > loss_disc: 3.0295023918151855 (2.8074223597844443) | > loss_disc_real_0: 0.19731326401233673 (0.1882485163708528) | > loss_disc_real_1: 0.22568590939044952 (0.2837783868114154) | > loss_disc_real_2: 0.28606048226356506 (0.30441556374231976) | > loss_disc_real_3: 0.37267211079597473 (0.36387065549691516) | > loss_disc_real_4: 0.27709195017814636 (0.2694883570075035) | > loss_disc_real_5: 0.29307055473327637 (0.2641177425781886) | > loss_0: 3.0295023918151855 (2.8074223597844443) | > loss_gen: 1.671562671661377 (2.217720866203308) | > loss_kl: 3.8379132747650146 (3.1213899850845337) | > loss_feat: 0.4863007962703705 (4.1601238915075855) | > loss_mel: 9.254951477050781 (19.375279088815052) | > loss_duration: 2.6319501399993896 (2.5858615239461265) | > loss_1: 17.882678985595703 (31.460376421610516)  --> STEP: 3 | > loss_disc: 2.4373366832733154 (2.7545529774257114) | > loss_disc_real_0: 0.3542179763317108 (0.21195843922240393) | > loss_disc_real_1: 0.21803748607635498 (0.2743868295635496) | > loss_disc_real_2: 0.2114531397819519 (0.29113521746226717) | > loss_disc_real_3: 0.38676008582115173 (0.3671405741146633) | > loss_disc_real_4: 0.2795165777206421 (0.2709209599665233) | > loss_disc_real_5: 0.2745022177696228 (0.26560123903410776) | > loss_0: 2.4373366832733154 (2.7545529774257114) | > loss_gen: 3.4570212364196777 (2.394763776234218) | > loss_kl: 1.4012712240219116 (2.8756587335041592) | > loss_feat: 5.046530723571777 (4.286753438945327) | > loss_mel: 19.8139591217041 (19.43794766494206) | > loss_duration: 2.493712902069092 (2.57269743510655) | > loss_1: 32.212493896484375 (31.567821775163925) --> EVAL PERFORMANCE | > avg_loader_time: 0.42244223185947966 (+0.4057406925019764) | > avg_loss_disc: 2.7545529774257114 (-0.13381221180870417) | > avg_loss_disc_real_0: 0.21195843922240393 (-0.11387213958161219) | > avg_loss_disc_real_1: 0.2743868295635496 (-0.026694062919843775) | > avg_loss_disc_real_2: 0.29113521746226717 (+0.05335534683295656) | > avg_loss_disc_real_3: 0.3671405741146633 (+0.0666756360303788) | > avg_loss_disc_real_4: 0.2709209599665233 (+0.052604186392965796) | > avg_loss_disc_real_5: 0.26560123903410776 (+0.010114889769327062) | > avg_loss_0: 2.7545529774257114 (-0.13381221180870417) | > avg_loss_gen: 2.394763776234218 (+0.5622285888308569) | > avg_loss_kl: 2.8756587335041592 (-0.32096483026232026) | > avg_loss_feat: 4.286753438945327 (+3.5290025403457026) | > avg_loss_mel: 19.43794766494206 (+10.660932137852624) | > avg_loss_duration: 2.57269743510655 (-0.03860041073390397) | > avg_loss_1: 31.567821775163925 (+14.39259874253046)  > EPOCH: 360/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:36:21)   --> TIME: 2023-10-20 03:36:33 -- STEP: 9/50 -- GLOBAL_STEP: 71010 | > loss_disc: 2.949922800064087 (2.705240594016181) | > loss_disc_real_0: 0.18484371900558472 (0.16437284938163227) | > loss_disc_real_1: 0.19363828003406525 (0.22260566179951033) | > loss_disc_real_2: 0.17463505268096924 (0.29260243144300246) | > loss_disc_real_3: 0.2180366963148117 (0.28593869590097004) | > loss_disc_real_4: 0.23996604979038239 (0.267316449019644) | > loss_disc_real_5: 0.24318034946918488 (0.275537162191338) | > loss_0: 2.949922800064087 (2.705240594016181) | > grad_norm_0: tensor(621.5593, device='cuda:0') (tensor(643.1533, device='cuda:0')) | > loss_gen: 1.509199857711792 (2.299061417579651) | > loss_kl: 0.6797769665718079 (0.8790279461277856) | > loss_feat: 0.31656426191329956 (4.471784409549501) | > loss_mel: 17.988861083984375 (19.916383054521347) | > loss_duration: 1.5186824798583984 (1.528293251991272) | > loss_1: 22.013084411621094 (29.094550768534344) | > grad_norm_1: tensor(17933.2168, device='cuda:0') (tensor(24764.6484, device='cuda:0')) | > current_lr_0: 0.00013953212544439458 | > current_lr_1: 0.00013953212544439458 | > step_time: 0.6875 (0.5378335052066379) | > loader_time: 0.0248 (0.017815139558580186)  --> TIME: 2023-10-20 03:36:48 -- STEP: 39/50 -- GLOBAL_STEP: 71040 | > loss_disc: 2.678251028060913 (2.5026245973049077) | > loss_disc_real_0: 0.12136906385421753 (0.14573003977346113) | > loss_disc_real_1: 0.261478066444397 (0.2396247160549347) | > loss_disc_real_2: 0.33708497881889343 (0.25012886638824755) | > loss_disc_real_3: 0.2814587354660034 (0.24337572680834002) | > loss_disc_real_4: 0.25526949763298035 (0.2409346621388044) | > loss_disc_real_5: 0.2445574253797531 (0.2634591643149272) | > loss_0: 2.678251028060913 (2.5026245973049077) | > grad_norm_0: tensor(375.9735, device='cuda:0') (tensor(663.4501, device='cuda:0')) | > loss_gen: 2.0264971256256104 (2.3954822497490125) | > loss_kl: 0.6801464557647705 (0.9377396286298069) | > loss_feat: 2.0213282108306885 (4.962680746347476) | > loss_mel: 20.91874885559082 (22.20262841689281) | > loss_duration: 1.613167405128479 (1.5368580237413063) | > loss_1: 27.2598876953125 (32.035389435596954) | > grad_norm_1: tensor(8725.0332, device='cuda:0') (tensor(20848.9961, device='cuda:0')) | > current_lr_0: 0.00013953212544439458 | > current_lr_1: 0.00013953212544439458 | > step_time: 0.3493 (0.5048872568668464) | > loader_time: 0.0246 (0.018295832169361606)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.390331745147705 (2.390331745147705) | > loss_disc_real_0: 0.11292416602373123 (0.11292416602373123) | > loss_disc_real_1: 0.17736929655075073 (0.17736929655075073) | > loss_disc_real_2: 0.2673972249031067 (0.2673972249031067) | > loss_disc_real_3: 0.21413864195346832 (0.21413864195346832) | > loss_disc_real_4: 0.2073407620191574 (0.2073407620191574) | > loss_disc_real_5: 0.25439536571502686 (0.25439536571502686) | > loss_0: 2.390331745147705 (2.390331745147705) | > loss_gen: 2.3307836055755615 (2.3307836055755615) | > loss_kl: 2.3619489669799805 (2.3619489669799805) | > loss_feat: 4.709819316864014 (4.709819316864014) | > loss_mel: 29.895078659057617 (29.895078659057617) | > loss_duration: 2.459583282470703 (2.459583282470703) | > loss_1: 41.7572135925293 (41.7572135925293)  --> STEP: 1 | > loss_disc: 2.9782538414001465 (2.9782538414001465) | > loss_disc_real_0: 0.32789289951324463 (0.32789289951324463) | > loss_disc_real_1: 0.3007771968841553 (0.3007771968841553) | > loss_disc_real_2: 0.2861982583999634 (0.2861982583999634) | > loss_disc_real_3: 0.27159810066223145 (0.27159810066223145) | > loss_disc_real_4: 0.3032301068305969 (0.3032301068305969) | > loss_disc_real_5: 0.418765664100647 (0.418765664100647) | > loss_0: 2.9782538414001465 (2.9782538414001465) | > loss_gen: 2.0707149505615234 (2.0707149505615234) | > loss_kl: 3.0997443199157715 (3.0997443199157715) | > loss_feat: 0.3181094527244568 (0.3181094527244568) | > loss_mel: 16.12566375732422 (16.12566375732422) | > loss_duration: 2.827268362045288 (2.827268362045288) | > loss_1: 24.44150161743164 (24.44150161743164)  --> STEP: 2 | > loss_disc: 2.31121563911438 (2.644734740257263) | > loss_disc_real_0: 0.4896506667137146 (0.4087717831134796) | > loss_disc_real_1: 0.05003504455089569 (0.17540612071752548) | > loss_disc_real_2: 0.20212334394454956 (0.24416080117225647) | > loss_disc_real_3: 0.1642160415649414 (0.21790707111358643) | > loss_disc_real_4: 0.025220969691872597 (0.16422553826123476) | > loss_disc_real_5: 0.11814939975738525 (0.2684575319290161) | > loss_0: 2.31121563911438 (2.644734740257263) | > loss_gen: 2.6662890911102295 (2.3685020208358765) | > loss_kl: 3.3147358894348145 (3.207240104675293) | > loss_feat: 9.853521347045898 (5.085815399885178) | > loss_mel: 26.042396545410156 (21.084030151367188) | > loss_duration: 2.6405653953552246 (2.7339168787002563) | > loss_1: 44.51750946044922 (34.47950553894043)  --> STEP: 3 | > loss_disc: 2.471614360809326 (2.5870279471079507) | > loss_disc_real_0: 0.45013076066970825 (0.42255810896555585) | > loss_disc_real_1: 0.1707058697938919 (0.17383937040964761) | > loss_disc_real_2: 0.2687843143939972 (0.25236863891283673) | > loss_disc_real_3: 0.3932982087135315 (0.27637078364690143) | > loss_disc_real_4: 0.20971567928791046 (0.17938891860345998) | > loss_disc_real_5: 0.20929373800754547 (0.2487362672885259) | > loss_0: 2.471614360809326 (2.5870279471079507) | > loss_gen: 3.3540680408477783 (2.6970240275065103) | > loss_kl: 1.8291137218475342 (2.7478646437327066) | > loss_feat: 5.536304950714111 (5.2359785834948225) | > loss_mel: 22.575260162353516 (21.581106821695965) | > loss_duration: 2.6152071952819824 (2.6943469842274985) | > loss_1: 35.90995407104492 (34.956321716308594) --> EVAL PERFORMANCE | > avg_loader_time: 0.006692330042521159 (-0.4157499018169585) | > avg_loss_disc: 2.5870279471079507 (-0.16752503031776067) | > avg_loss_disc_real_0: 0.42255810896555585 (+0.21059966974315192) | > avg_loss_disc_real_1: 0.17383937040964761 (-0.10054745915390198) | > avg_loss_disc_real_2: 0.25236863891283673 (-0.03876657854943044) | > avg_loss_disc_real_3: 0.27637078364690143 (-0.09076979046776185) | > avg_loss_disc_real_4: 0.17938891860345998 (-0.09153204136306334) | > avg_loss_disc_real_5: 0.2487362672885259 (-0.016864971745581853) | > avg_loss_0: 2.5870279471079507 (-0.16752503031776067) | > avg_loss_gen: 2.6970240275065103 (+0.3022602512722923) | > avg_loss_kl: 2.7478646437327066 (-0.12779408977145268) | > avg_loss_feat: 5.2359785834948225 (+0.9492251445494952) | > avg_loss_mel: 21.581106821695965 (+2.143159156753903) | > avg_loss_duration: 2.6943469842274985 (+0.12164954912094839) | > avg_loss_1: 34.956321716308594 (+3.3884999411446692)  > EPOCH: 361/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:37:04)   --> TIME: 2023-10-20 03:37:14 -- STEP: 19/50 -- GLOBAL_STEP: 71070 | > loss_disc: 2.3161542415618896 (2.6833200015519796) | > loss_disc_real_0: 0.06054086238145828 (0.2355869200668837) | > loss_disc_real_1: 0.11324407905340195 (0.25019764625712443) | > loss_disc_real_2: 0.215232253074646 (0.24777482842144213) | > loss_disc_real_3: 0.33406463265419006 (0.27843754973850754) | > loss_disc_real_4: 0.19800309836864471 (0.2592625566022961) | > loss_disc_real_5: 0.17186330258846283 (0.23826252835753717) | > loss_0: 2.3161542415618896 (2.6833200015519796) | > grad_norm_0: tensor(473.1612, device='cuda:0') (tensor(832.2842, device='cuda:0')) | > loss_gen: 2.0007245540618896 (2.288173048119796) | > loss_kl: 1.0705080032348633 (0.9142198766532698) | > loss_feat: 3.325676918029785 (4.515516865018167) | > loss_mel: 22.230350494384766 (22.24831081691541) | > loss_duration: 1.6738020181655884 (1.5858679068715948) | > loss_1: 30.301061630249023 (31.552088586907637) | > grad_norm_1: tensor(9706.1582, device='cuda:0') (tensor(20671.1406, device='cuda:0')) | > current_lr_0: 0.00013939265434899606 | > current_lr_1: 0.00013939265434899606 | > step_time: 0.256 (0.33076505911977666) | > loader_time: 0.0019 (0.007551858299656918)  --> TIME: 2023-10-20 03:37:31 -- STEP: 49/50 -- GLOBAL_STEP: 71100 | > loss_disc: 2.5596258640289307 (2.5675595536523925) | > loss_disc_real_0: 0.24975624680519104 (0.1897096460951226) | > loss_disc_real_1: 0.3122148811817169 (0.24303352498278322) | > loss_disc_real_2: 0.09164610505104065 (0.23567273733871325) | > loss_disc_real_3: 0.2728922963142395 (0.24439573652890267) | > loss_disc_real_4: 0.23816627264022827 (0.23193943154598987) | > loss_disc_real_5: 0.2016817182302475 (0.22546580475660002) | > loss_0: 2.5596258640289307 (2.5675595536523925) | > grad_norm_0: tensor(1119.6705, device='cuda:0') (tensor(605.7437, device='cuda:0')) | > loss_gen: 2.0386762619018555 (2.255297410244844) | > loss_kl: 1.0400091409683228 (0.9308893996842054) | > loss_feat: 2.075923204421997 (4.538312305677303) | > loss_mel: 22.911514282226562 (21.420825274623176) | > loss_duration: 1.6619689464569092 (1.5439332091078466) | > loss_1: 29.728092193603516 (30.689257719078842) | > grad_norm_1: tensor(5165.1123, device='cuda:0') (tensor(20090.9902, device='cuda:0')) | > current_lr_0: 0.00013939265434899606 | > current_lr_1: 0.00013939265434899606 | > step_time: 0.4352 (0.45214858347055864) | > loader_time: 0.4186 (0.01943969239993971)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.267040252685547 (2.267040252685547) | > loss_disc_real_0: 0.32004308700561523 (0.32004308700561523) | > loss_disc_real_1: 0.11629931628704071 (0.11629931628704071) | > loss_disc_real_2: 0.19122131168842316 (0.19122131168842316) | > loss_disc_real_3: 0.19113127887248993 (0.19113127887248993) | > loss_disc_real_4: 0.12386733293533325 (0.12386733293533325) | > loss_disc_real_5: 0.15019264817237854 (0.15019264817237854) | > loss_0: 2.267040252685547 (2.267040252685547) | > loss_gen: 2.519606828689575 (2.519606828689575) | > loss_kl: 3.1167409420013428 (3.1167409420013428) | > loss_feat: 9.977747917175293 (9.977747917175293) | > loss_mel: 24.214982986450195 (24.214982986450195) | > loss_duration: 2.4908273220062256 (2.4908273220062256) | > loss_1: 42.31990432739258 (42.31990432739258)  --> STEP: 1 | > loss_disc: 2.9006567001342773 (2.9006567001342773) | > loss_disc_real_0: 0.2462356835603714 (0.2462356835603714) | > loss_disc_real_1: 0.2635464072227478 (0.2635464072227478) | > loss_disc_real_2: 0.3289943039417267 (0.3289943039417267) | > loss_disc_real_3: 0.25948500633239746 (0.25948500633239746) | > loss_disc_real_4: 0.32188546657562256 (0.32188546657562256) | > loss_disc_real_5: 0.30254217982292175 (0.30254217982292175) | > loss_0: 2.9006567001342773 (2.9006567001342773) | > loss_gen: 2.162172317504883 (2.162172317504883) | > loss_kl: 3.5525641441345215 (3.5525641441345215) | > loss_feat: 2.6163151264190674 (2.6163151264190674) | > loss_mel: 25.68327522277832 (25.68327522277832) | > loss_duration: 2.6845555305480957 (2.6845555305480957) | > loss_1: 36.698883056640625 (36.698883056640625)  --> STEP: 2 | > loss_disc: 2.988809108734131 (2.944732904434204) | > loss_disc_real_0: 0.39833417534828186 (0.32228492945432663) | > loss_disc_real_1: 0.27117034792900085 (0.26735837757587433) | > loss_disc_real_2: 0.4632088840007782 (0.39610159397125244) | > loss_disc_real_3: 0.3210248053073883 (0.2902549058198929) | > loss_disc_real_4: 0.2895093262195587 (0.30569739639759064) | > loss_disc_real_5: 0.13141915202140808 (0.21698066592216492) | > loss_0: 2.988809108734131 (2.944732904434204) | > loss_gen: 2.1076929569244385 (2.1349326372146606) | > loss_kl: 3.715137243270874 (3.6338506937026978) | > loss_feat: 3.3466973304748535 (2.9815062284469604) | > loss_mel: 27.954116821289062 (26.81869602203369) | > loss_duration: 2.551555633544922 (2.618055582046509) | > loss_1: 39.675201416015625 (38.187042236328125)  --> STEP: 3 | > loss_disc: 1.6575168371200562 (2.515660881996155) | > loss_disc_real_0: 0.1125999242067337 (0.25238992770512897) | > loss_disc_real_1: 0.19047531485557556 (0.2417306900024414) | > loss_disc_real_2: 0.1133335679769516 (0.3018455853064855) | > loss_disc_real_3: 0.07418625801801682 (0.21823202321926752) | > loss_disc_real_4: 0.3791075348854065 (0.3301674425601959) | > loss_disc_real_5: 0.07202453166246414 (0.16866195450226465) | > loss_0: 1.6575168371200562 (2.515660881996155) | > loss_gen: 3.0483288764953613 (2.4393980503082275) | > loss_kl: 1.649260401725769 (2.9723205963770547) | > loss_feat: 7.298286437988281 (4.420432964960734) | > loss_mel: 28.31571388244629 (27.31770197550456) | > loss_duration: 2.589360475540161 (2.608490546544393) | > loss_1: 42.90094757080078 (39.75834401448568) --> EVAL PERFORMANCE | > avg_loader_time: 0.02608029047648112 (+0.01938796043395996) | > avg_loss_disc: 2.515660881996155 (-0.07136706511179591) | > avg_loss_disc_real_0: 0.25238992770512897 (-0.17016818126042688) | > avg_loss_disc_real_1: 0.2417306900024414 (+0.06789131959279379) | > avg_loss_disc_real_2: 0.3018455853064855 (+0.049476946393648746) | > avg_loss_disc_real_3: 0.21823202321926752 (-0.05813876042763391) | > avg_loss_disc_real_4: 0.3301674425601959 (+0.15077852395673594) | > avg_loss_disc_real_5: 0.16866195450226465 (-0.08007431278626126) | > avg_loss_0: 2.515660881996155 (-0.07136706511179591) | > avg_loss_gen: 2.4393980503082275 (-0.25762597719828273) | > avg_loss_kl: 2.9723205963770547 (+0.22445595264434814) | > avg_loss_feat: 4.420432964960734 (-0.8155456185340881) | > avg_loss_mel: 27.31770197550456 (+5.736595153808594) | > avg_loss_duration: 2.608490546544393 (-0.08585643768310547) | > avg_loss_1: 39.75834401448568 (+4.802022298177086)  > EPOCH: 362/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:37:40)   --> TIME: 2023-10-20 03:37:59 -- STEP: 29/50 -- GLOBAL_STEP: 71130 | > loss_disc: 2.6571438312530518 (2.4415137562258487) | > loss_disc_real_0: 0.11821271479129791 (0.1622972334253377) | > loss_disc_real_1: 0.4669739902019501 (0.22123396640707707) | > loss_disc_real_2: 0.381904274225235 (0.23188351505789265) | > loss_disc_real_3: 0.2624107599258423 (0.24803596221167465) | > loss_disc_real_4: 0.28762558102607727 (0.21720715001996221) | > loss_disc_real_5: 0.1633642017841339 (0.22777519754037776) | > loss_0: 2.6571438312530518 (2.4415137562258487) | > grad_norm_0: tensor(396.1183, device='cuda:0') (tensor(549.2828, device='cuda:0')) | > loss_gen: 2.6953043937683105 (2.398503032223932) | > loss_kl: 0.813117504119873 (1.0665843157932675) | > loss_feat: 5.841209411621094 (5.7691431122607195) | > loss_mel: 22.79039764404297 (23.363138404385793) | > loss_duration: 1.5189108848571777 (1.5494540642047752) | > loss_1: 33.658939361572266 (34.146823159579576) | > grad_norm_1: tensor(8823.3730, device='cuda:0') (tensor(20662.9453, device='cuda:0')) | > current_lr_0: 0.00013925332266368962 | > current_lr_1: 0.00013925332266368962 | > step_time: 0.2902 (0.5059403057756093) | > loader_time: 0.0251 (0.018980223557044724)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6721835136413574 (1.6721835136413574) | > loss_disc_real_0: 0.08162540197372437 (0.08162540197372437) | > loss_disc_real_1: 0.15780022740364075 (0.15780022740364075) | > loss_disc_real_2: 0.07813889533281326 (0.07813889533281326) | > loss_disc_real_3: 0.06115427613258362 (0.06115427613258362) | > loss_disc_real_4: 0.11667171865701675 (0.11667171865701675) | > loss_disc_real_5: 0.14949651062488556 (0.14949651062488556) | > loss_0: 1.6721835136413574 (1.6721835136413574) | > loss_gen: 3.6550517082214355 (3.6550517082214355) | > loss_kl: 3.0119235515594482 (3.0119235515594482) | > loss_feat: 12.502305030822754 (12.502305030822754) | > loss_mel: 27.606000900268555 (27.606000900268555) | > loss_duration: 2.4873390197753906 (2.4873390197753906) | > loss_1: 49.26262283325195 (49.26262283325195)  --> STEP: 1 | > loss_disc: 2.925690174102783 (2.925690174102783) | > loss_disc_real_0: 0.20445701479911804 (0.20445701479911804) | > loss_disc_real_1: 0.33663538098335266 (0.33663538098335266) | > loss_disc_real_2: 0.26816290616989136 (0.26816290616989136) | > loss_disc_real_3: 0.27823546528816223 (0.27823546528816223) | > loss_disc_real_4: 0.2501697540283203 (0.2501697540283203) | > loss_disc_real_5: 0.2807598114013672 (0.2807598114013672) | > loss_0: 2.925690174102783 (2.925690174102783) | > loss_gen: 1.7316453456878662 (1.7316453456878662) | > loss_kl: 3.7983591556549072 (3.7983591556549072) | > loss_feat: 0.49573224782943726 (0.49573224782943726) | > loss_mel: 15.342785835266113 (15.342785835266113) | > loss_duration: 2.669977903366089 (2.669977903366089) | > loss_1: 24.03849983215332 (24.03849983215332)  --> STEP: 2 | > loss_disc: 1.629204273223877 (2.27744722366333) | > loss_disc_real_0: 0.03052521124482155 (0.1174911130219698) | > loss_disc_real_1: 0.1995384395122528 (0.26808691024780273) | > loss_disc_real_2: 0.22862711548805237 (0.24839501082897186) | > loss_disc_real_3: 0.03956471383571625 (0.15890008956193924) | > loss_disc_real_4: 0.11530106514692307 (0.1827354095876217) | > loss_disc_real_5: 0.2301759123802185 (0.25546786189079285) | > loss_0: 1.629204273223877 (2.27744722366333) | > loss_gen: 3.473365545272827 (2.6025054454803467) | > loss_kl: 3.3618743419647217 (3.5801167488098145) | > loss_feat: 10.093062400817871 (5.294397324323654) | > loss_mel: 24.227184295654297 (19.784985065460205) | > loss_duration: 2.6307895183563232 (2.650383710861206) | > loss_1: 43.786277770996094 (33.91238880157471)  --> STEP: 3 | > loss_disc: 2.6166722774505615 (2.3905222415924072) | > loss_disc_real_0: 0.09565968066453934 (0.11021396890282631) | > loss_disc_real_1: 0.3512265980243683 (0.2958001395066579) | > loss_disc_real_2: 0.2435373067855835 (0.2467757761478424) | > loss_disc_real_3: 0.2455958127975464 (0.1877986639738083) | > loss_disc_real_4: 0.3813927173614502 (0.24895451217889786) | > loss_disc_real_5: 0.3643759787082672 (0.2917705674966176) | > loss_0: 2.6166722774505615 (2.3905222415924072) | > loss_gen: 2.3521652221679688 (2.5190587043762207) | > loss_kl: 1.812872052192688 (2.9910351832707724) | > loss_feat: 2.679396152496338 (4.422730267047882) | > loss_mel: 21.586732864379883 (20.385567665100098) | > loss_duration: 2.4819719791412354 (2.5942464669545493) | > loss_1: 30.913137435913086 (32.912638346354164) --> EVAL PERFORMANCE | > avg_loader_time: 0.001766204833984375 (-0.024314085642496746) | > avg_loss_disc: 2.3905222415924072 (-0.12513864040374756) | > avg_loss_disc_real_0: 0.11021396890282631 (-0.14217595880230266) | > avg_loss_disc_real_1: 0.2958001395066579 (+0.054069449504216494) | > avg_loss_disc_real_2: 0.2467757761478424 (-0.05506980915864307) | > avg_loss_disc_real_3: 0.1877986639738083 (-0.03043335924545923) | > avg_loss_disc_real_4: 0.24895451217889786 (-0.08121293038129807) | > avg_loss_disc_real_5: 0.2917705674966176 (+0.12310861299435297) | > avg_loss_0: 2.3905222415924072 (-0.12513864040374756) | > avg_loss_gen: 2.5190587043762207 (+0.07966065406799316) | > avg_loss_kl: 2.9910351832707724 (+0.018714586893717744) | > avg_loss_feat: 4.422730267047882 (+0.0022973020871477345) | > avg_loss_mel: 20.385567665100098 (-6.932134310404461) | > avg_loss_duration: 2.5942464669545493 (-0.01424407958984375) | > avg_loss_1: 32.912638346354164 (-6.845705668131515)  > EPOCH: 363/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:38:21)   --> TIME: 2023-10-20 03:38:31 -- STEP: 9/50 -- GLOBAL_STEP: 71160 | > loss_disc: 2.7243354320526123 (2.5081825256347656) | > loss_disc_real_0: 0.23660725355148315 (0.16005859358443153) | > loss_disc_real_1: 0.32015252113342285 (0.24762273538443777) | > loss_disc_real_2: 0.41828811168670654 (0.27714275817076367) | > loss_disc_real_3: 0.30817610025405884 (0.22732621348566479) | > loss_disc_real_4: 0.2863314151763916 (0.2102780822250578) | > loss_disc_real_5: 0.3834505081176758 (0.2361341135369407) | > loss_0: 2.7243354320526123 (2.5081825256347656) | > grad_norm_0: tensor(1259.3956, device='cuda:0') (tensor(666.3045, device='cuda:0')) | > loss_gen: 2.7067174911499023 (2.391220953729418) | > loss_kl: 0.9478572607040405 (0.9658324718475342) | > loss_feat: 3.312397003173828 (4.868077742556731) | > loss_mel: 24.435375213623047 (21.1640178627438) | > loss_duration: 1.5369526147842407 (1.560174372461107) | > loss_1: 32.939300537109375 (30.949323071373833) | > grad_norm_1: tensor(11644.7588, device='cuda:0') (tensor(24290.2383, device='cuda:0')) | > current_lr_0: 0.0001391141302491261 | > current_lr_1: 0.0001391141302491261 | > step_time: 0.6309 (0.48043068250020343) | > loader_time: 0.01 (0.016089916229248047)  --> TIME: 2023-10-20 03:38:48 -- STEP: 39/50 -- GLOBAL_STEP: 71190 | > loss_disc: 0.7997940182685852 (2.509306389551896) | > loss_disc_real_0: 0.029974237084388733 (0.1773515770641657) | > loss_disc_real_1: 0.012481989338994026 (0.23507447516879973) | > loss_disc_real_2: 0.018350310623645782 (0.23475279124119344) | > loss_disc_real_3: 0.02023666352033615 (0.2298144831871375) | > loss_disc_real_4: 0.014874527230858803 (0.2013795434568937) | > loss_disc_real_5: 0.0323169119656086 (0.19401381885967192) | > loss_0: 0.7997940182685852 (2.509306389551896) | > grad_norm_0: tensor(199.2569, device='cuda:0') (tensor(857.7219, device='cuda:0')) | > loss_gen: 3.9676430225372314 (2.361795709683345) | > loss_kl: 0.7594509124755859 (1.0139261071498582) | > loss_feat: 13.13856315612793 (4.896972228796819) | > loss_mel: 27.751951217651367 (21.219977929041935) | > loss_duration: 1.6646804809570312 (1.5479733363176003) | > loss_1: 47.28228759765625 (31.040645024715324) | > grad_norm_1: tensor(60191.0703, device='cuda:0') (tensor(23367.6309, device='cuda:0')) | > current_lr_0: 0.0001391141302491261 | > current_lr_1: 0.0001391141302491261 | > step_time: 0.6159 (0.521404370283469) | > loader_time: 0.0243 (0.019676446914672855)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.71921443939209 (2.71921443939209) | > loss_disc_real_0: 0.3096463680267334 (0.3096463680267334) | > loss_disc_real_1: 0.2524070143699646 (0.2524070143699646) | > loss_disc_real_2: 0.47829872369766235 (0.47829872369766235) | > loss_disc_real_3: 0.38575971126556396 (0.38575971126556396) | > loss_disc_real_4: 0.33510059118270874 (0.33510059118270874) | > loss_disc_real_5: 0.1299324333667755 (0.1299324333667755) | > loss_0: 2.71921443939209 (2.71921443939209) | > loss_gen: 2.8158397674560547 (2.8158397674560547) | > loss_kl: 3.455871343612671 (3.455871343612671) | > loss_feat: 5.221593379974365 (5.221593379974365) | > loss_mel: 24.15125846862793 (24.15125846862793) | > loss_duration: 2.613780975341797 (2.613780975341797) | > loss_1: 38.25834274291992 (38.25834274291992)  --> STEP: 1 | > loss_disc: 2.5123517513275146 (2.5123517513275146) | > loss_disc_real_0: 0.2568613290786743 (0.2568613290786743) | > loss_disc_real_1: 0.20275139808654785 (0.20275139808654785) | > loss_disc_real_2: 0.2627379894256592 (0.2627379894256592) | > loss_disc_real_3: 0.2734130322933197 (0.2734130322933197) | > loss_disc_real_4: 0.27005618810653687 (0.27005618810653687) | > loss_disc_real_5: 0.39498281478881836 (0.39498281478881836) | > loss_0: 2.5123517513275146 (2.5123517513275146) | > loss_gen: 2.5756490230560303 (2.5756490230560303) | > loss_kl: 4.43693208694458 (4.43693208694458) | > loss_feat: 5.589298725128174 (5.589298725128174) | > loss_mel: 25.999197006225586 (25.999197006225586) | > loss_duration: 2.948493242263794 (2.948493242263794) | > loss_1: 41.5495719909668 (41.5495719909668)  --> STEP: 2 | > loss_disc: 2.978743553161621 (2.745547652244568) | > loss_disc_real_0: 0.2486482858657837 (0.252754807472229) | > loss_disc_real_1: 0.26118364930152893 (0.2319675236940384) | > loss_disc_real_2: 0.22312894463539124 (0.2429334670305252) | > loss_disc_real_3: 0.2706089913845062 (0.27201101183891296) | > loss_disc_real_4: 0.22882527112960815 (0.2494407296180725) | > loss_disc_real_5: 0.24366395175457 (0.3193233832716942) | > loss_0: 2.978743553161621 (2.745547652244568) | > loss_gen: 1.5019630193710327 (2.0388060212135315) | > loss_kl: 3.4089441299438477 (3.922938108444214) | > loss_feat: 0.06651309132575989 (2.827905908226967) | > loss_mel: 3.8392844200134277 (14.919240713119507) | > loss_duration: 2.718735933303833 (2.8336145877838135) | > loss_1: 11.535440444946289 (26.542506217956543)  --> STEP: 3 | > loss_disc: 2.972590446472168 (2.821228583653768) | > loss_disc_real_0: 0.29482302069664 (0.26677754521369934) | > loss_disc_real_1: 0.4113941192626953 (0.2917763888835907) | > loss_disc_real_2: 0.39884912967681885 (0.29490535457928974) | > loss_disc_real_3: 0.4038611352443695 (0.3159610529740651) | > loss_disc_real_4: 0.37722453474998474 (0.2920353313287099) | > loss_disc_real_5: 0.4020829498767853 (0.34690990547339123) | > loss_0: 2.972590446472168 (2.821228583653768) | > loss_gen: 2.9839930534362793 (2.3538683652877808) | > loss_kl: 1.9638326168060303 (3.2699029445648193) | > loss_feat: 3.667161226272583 (3.1076576809088388) | > loss_mel: 21.956378936767578 (17.26495345433553) | > loss_duration: 2.467707633972168 (2.7116456031799316) | > loss_1: 33.0390739440918 (28.70802879333496) --> EVAL PERFORMANCE | > avg_loader_time: 0.010672807693481445 (+0.00890660285949707) | > avg_loss_disc: 2.821228583653768 (+0.4307063420613608) | > avg_loss_disc_real_0: 0.26677754521369934 (+0.15656357631087303) | > avg_loss_disc_real_1: 0.2917763888835907 (-0.0040237506230672015) | > avg_loss_disc_real_2: 0.29490535457928974 (+0.04812957843144733) | > avg_loss_disc_real_3: 0.3159610529740651 (+0.12816238900025684) | > avg_loss_disc_real_4: 0.2920353313287099 (+0.043080819149812044) | > avg_loss_disc_real_5: 0.34690990547339123 (+0.05513933797677362) | > avg_loss_0: 2.821228583653768 (+0.4307063420613608) | > avg_loss_gen: 2.3538683652877808 (-0.16519033908843994) | > avg_loss_kl: 3.2699029445648193 (+0.2788677612940469) | > avg_loss_feat: 3.1076576809088388 (-1.3150725861390433) | > avg_loss_mel: 17.26495345433553 (-3.1206142107645682) | > avg_loss_duration: 2.7116456031799316 (+0.11739913622538234) | > avg_loss_1: 28.70802879333496 (-4.204609553019203)  > EPOCH: 364/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:39:02)   --> TIME: 2023-10-20 03:39:14 -- STEP: 19/50 -- GLOBAL_STEP: 71220 | > loss_disc: 1.628828525543213 (2.405427838626661) | > loss_disc_real_0: 0.048338498920202255 (0.15493850311950633) | > loss_disc_real_1: 0.14725905656814575 (0.19529495290235468) | > loss_disc_real_2: 0.052089937031269073 (0.22290323223722608) | > loss_disc_real_3: 0.11351770907640457 (0.22038035467267036) | > loss_disc_real_4: 0.030290232971310616 (0.18382083752045505) | > loss_disc_real_5: 0.00789565872400999 (0.18874927330762148) | > loss_0: 1.628828525543213 (2.405427838626661) | > grad_norm_0: tensor(569.1608, device='cuda:0') (tensor(408.3730, device='cuda:0')) | > loss_gen: 3.0583152770996094 (2.3091558845419637) | > loss_kl: 0.9267380237579346 (0.8883438439745652) | > loss_feat: 11.403697967529297 (5.532968211330865) | > loss_mel: 26.906938552856445 (19.955048561096188) | > loss_duration: 1.737607717514038 (1.589459450621354) | > loss_1: 44.033294677734375 (30.274975877059134) | > grad_norm_1: tensor(29100.0605, device='cuda:0') (tensor(18850.2324, device='cuda:0')) | > current_lr_0: 0.00013897507696609564 | > current_lr_1: 0.00013897507696609564 | > step_time: 0.2566 (0.33417216100190816) | > loader_time: 0.0019 (0.005652603350187603)  --> TIME: 2023-10-20 03:39:32 -- STEP: 49/50 -- GLOBAL_STEP: 71250 | > loss_disc: 1.930419921875 (2.4073206989132623) | > loss_disc_real_0: 0.03660357743501663 (0.13984958460668517) | > loss_disc_real_1: 0.08142851293087006 (0.22598131054214068) | > loss_disc_real_2: 0.1395106017589569 (0.21520726960532519) | > loss_disc_real_3: 0.21574050188064575 (0.22970246592042398) | > loss_disc_real_4: 0.07768978923559189 (0.2090553752697852) | > loss_disc_real_5: 0.07587213069200516 (0.2081243312366459) | > loss_0: 1.930419921875 (2.4073206989132623) | > grad_norm_0: tensor(459.2722, device='cuda:0') (tensor(434.1562, device='cuda:0')) | > loss_gen: 2.6887283325195312 (2.361199629550077) | > loss_kl: 0.4513755142688751 (0.8894004967747903) | > loss_feat: 7.854808807373047 (5.58671595399477) | > loss_mel: 23.006389617919922 (21.402608881191338) | > loss_duration: 1.6365330219268799 (1.5539000034332275) | > loss_1: 35.63783645629883 (31.793824799206792) | > grad_norm_1: tensor(35698.8945, device='cuda:0') (tensor(18392.2109, device='cuda:0')) | > current_lr_0: 0.00013897507696609564 | > current_lr_1: 0.00013897507696609564 | > step_time: 0.6011 (0.47853316092977716) | > loader_time: 0.5252 (0.02111783319590043)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.107970714569092 (3.107970714569092) | > loss_disc_real_0: 0.46210533380508423 (0.46210533380508423) | > loss_disc_real_1: 0.3049072027206421 (0.3049072027206421) | > loss_disc_real_2: 0.2881529927253723 (0.2881529927253723) | > loss_disc_real_3: 0.24341170489788055 (0.24341170489788055) | > loss_disc_real_4: 0.24916388094425201 (0.24916388094425201) | > loss_disc_real_5: 0.4023590087890625 (0.4023590087890625) | > loss_0: 3.107970714569092 (3.107970714569092) | > loss_gen: 2.124743700027466 (2.124743700027466) | > loss_kl: 3.4839565753936768 (3.4839565753936768) | > loss_feat: 5.573143482208252 (5.573143482208252) | > loss_mel: 22.88148307800293 (22.88148307800293) | > loss_duration: 2.4323060512542725 (2.4323060512542725) | > loss_1: 36.49563217163086 (36.49563217163086)  --> STEP: 1 | > loss_disc: 4.1288018226623535 (4.1288018226623535) | > loss_disc_real_0: 0.40163835883140564 (0.40163835883140564) | > loss_disc_real_1: 0.29631999135017395 (0.29631999135017395) | > loss_disc_real_2: 0.24573521316051483 (0.24573521316051483) | > loss_disc_real_3: 0.3464207649230957 (0.3464207649230957) | > loss_disc_real_4: 0.2073007971048355 (0.2073007971048355) | > loss_disc_real_5: 0.23254328966140747 (0.23254328966140747) | > loss_0: 4.1288018226623535 (4.1288018226623535) | > loss_gen: 1.3045262098312378 (1.3045262098312378) | > loss_kl: 3.4605178833007812 (3.4605178833007812) | > loss_feat: 7.259953022003174 (7.259953022003174) | > loss_mel: 23.161739349365234 (23.161739349365234) | > loss_duration: 2.8564040660858154 (2.8564040660858154) | > loss_1: 38.04314041137695 (38.04314041137695)  --> STEP: 2 | > loss_disc: 3.0486390590667725 (3.588720440864563) | > loss_disc_real_0: 0.4218709170818329 (0.41175463795661926) | > loss_disc_real_1: 0.2584499418735504 (0.2773849666118622) | > loss_disc_real_2: 0.30574163794517517 (0.275738425552845) | > loss_disc_real_3: 0.33736059069633484 (0.34189067780971527) | > loss_disc_real_4: 0.266250878572464 (0.23677583783864975) | > loss_disc_real_5: 0.264743447303772 (0.24864336848258972) | > loss_0: 3.0486390590667725 (3.588720440864563) | > loss_gen: 1.8823449611663818 (1.5934355854988098) | > loss_kl: 3.7535083293914795 (3.6070131063461304) | > loss_feat: 0.057871367782354355 (3.658912194892764) | > loss_mel: 1.6182279586791992 (12.389983654022217) | > loss_duration: 2.634000301361084 (2.7452021837234497) | > loss_1: 9.945953369140625 (23.99454689025879)  --> STEP: 3 | > loss_disc: 2.90765643119812 (3.361699104309082) | > loss_disc_real_0: 0.5305659174919128 (0.4513583978017171) | > loss_disc_real_1: 0.24358050525188446 (0.26611681282520294) | > loss_disc_real_2: 0.332112193107605 (0.29452968140443164) | > loss_disc_real_3: 0.25007981061935425 (0.3112870554129283) | > loss_disc_real_4: 0.13234920799732208 (0.20196696122487387) | > loss_disc_real_5: 0.18616078794002533 (0.22781584163506827) | > loss_0: 2.90765643119812 (3.361699104309082) | > loss_gen: 2.22092342376709 (1.802598198254903) | > loss_kl: 1.8689526319503784 (3.02765961488088) | > loss_feat: 4.0773539543151855 (3.7983927813669047) | > loss_mel: 20.14725112915039 (14.975739479064941) | > loss_duration: 2.5644803047180176 (2.6849615573883057) | > loss_1: 30.87895965576172 (26.289351145426433) --> EVAL PERFORMANCE | > avg_loader_time: 0.01226194699605306 (+0.0015891393025716152) | > avg_loss_disc: 3.361699104309082 (+0.540470520655314) | > avg_loss_disc_real_0: 0.4513583978017171 (+0.18458085258801776) | > avg_loss_disc_real_1: 0.26611681282520294 (-0.025659576058387756) | > avg_loss_disc_real_2: 0.29452968140443164 (-0.00037567317485809326) | > avg_loss_disc_real_3: 0.3112870554129283 (-0.0046739975611368445) | > avg_loss_disc_real_4: 0.20196696122487387 (-0.09006837010383603) | > avg_loss_disc_real_5: 0.22781584163506827 (-0.11909406383832297) | > avg_loss_0: 3.361699104309082 (+0.540470520655314) | > avg_loss_gen: 1.802598198254903 (-0.5512701670328777) | > avg_loss_kl: 3.02765961488088 (-0.24224332968393947) | > avg_loss_feat: 3.7983927813669047 (+0.690735100458066) | > avg_loss_mel: 14.975739479064941 (-2.289213975270588) | > avg_loss_duration: 2.6849615573883057 (-0.026684045791625977) | > avg_loss_1: 26.289351145426433 (-2.4186776479085275)  > EPOCH: 365/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:39:39)   --> TIME: 2023-10-20 03:39:59 -- STEP: 29/50 -- GLOBAL_STEP: 71280 | > loss_disc: 3.0835373401641846 (2.435824653197979) | > loss_disc_real_0: 0.46804505586624146 (0.15266061336572828) | > loss_disc_real_1: 0.2818225026130676 (0.21504251838758073) | > loss_disc_real_2: 0.23291945457458496 (0.2073810832767651) | > loss_disc_real_3: 0.30591246485710144 (0.23416588905042615) | > loss_disc_real_4: 0.3035385310649872 (0.22808972296529803) | > loss_disc_real_5: 0.32639962434768677 (0.20928690877967868) | > loss_0: 3.0835373401641846 (2.435824653197979) | > grad_norm_0: tensor(851.3743, device='cuda:0') (tensor(567.0497, device='cuda:0')) | > loss_gen: 1.9228034019470215 (2.362174704157073) | > loss_kl: 0.9810869097709656 (1.0210601584664705) | > loss_feat: 0.27115318179130554 (5.82535490521294) | > loss_mel: 13.695980072021484 (23.288906777727192) | > loss_duration: 1.5730654001235962 (1.5599898510965808) | > loss_1: 18.444087982177734 (34.05748633680672) | > grad_norm_1: tensor(6559.5010, device='cuda:0') (tensor(21552.6875, device='cuda:0')) | > current_lr_0: 0.00013883616267552765 | > current_lr_1: 0.00013883616267552765 | > step_time: 0.2996 (0.5031939868269296) | > loader_time: 0.0239 (0.019820558613744276)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8753533363342285 (2.8753533363342285) | > loss_disc_real_0: 0.22534719109535217 (0.22534719109535217) | > loss_disc_real_1: 0.27017301321029663 (0.27017301321029663) | > loss_disc_real_2: 0.2825952172279358 (0.2825952172279358) | > loss_disc_real_3: 0.24666625261306763 (0.24666625261306763) | > loss_disc_real_4: 0.31292471289634705 (0.31292471289634705) | > loss_disc_real_5: 0.3106742799282074 (0.3106742799282074) | > loss_0: 2.8753533363342285 (2.8753533363342285) | > loss_gen: 1.9893711805343628 (1.9893711805343628) | > loss_kl: 2.5098724365234375 (2.5098724365234375) | > loss_feat: 2.33375883102417 (2.33375883102417) | > loss_mel: 24.498516082763672 (24.498516082763672) | > loss_duration: 2.412221670150757 (2.412221670150757) | > loss_1: 33.74374008178711 (33.74374008178711)  --> STEP: 1 | > loss_disc: 2.721311569213867 (2.721311569213867) | > loss_disc_real_0: 0.33414074778556824 (0.33414074778556824) | > loss_disc_real_1: 0.3069086968898773 (0.3069086968898773) | > loss_disc_real_2: 0.36342713236808777 (0.36342713236808777) | > loss_disc_real_3: 0.3851969540119171 (0.3851969540119171) | > loss_disc_real_4: 0.22518585622310638 (0.22518585622310638) | > loss_disc_real_5: 0.40015944838523865 (0.40015944838523865) | > loss_0: 2.721311569213867 (2.721311569213867) | > loss_gen: 3.173996925354004 (3.173996925354004) | > loss_kl: 3.90836238861084 (3.90836238861084) | > loss_feat: 4.9374918937683105 (4.9374918937683105) | > loss_mel: 25.102243423461914 (25.102243423461914) | > loss_duration: 2.781803607940674 (2.781803607940674) | > loss_1: 39.90389633178711 (39.90389633178711)  --> STEP: 2 | > loss_disc: 1.909245252609253 (2.31527841091156) | > loss_disc_real_0: 0.026303162798285484 (0.18022195529192686) | > loss_disc_real_1: 0.25393208861351013 (0.2804203927516937) | > loss_disc_real_2: 0.1547141820192337 (0.25907065719366074) | > loss_disc_real_3: 0.11951489001512527 (0.2523559220135212) | > loss_disc_real_4: 0.10955620557069778 (0.16737103089690208) | > loss_disc_real_5: 0.025756483897566795 (0.21295796614140272) | > loss_0: 1.909245252609253 (2.31527841091156) | > loss_gen: 2.3368918895721436 (2.7554444074630737) | > loss_kl: 3.7268998622894287 (3.8176311254501343) | > loss_feat: 11.850899696350098 (8.394195795059204) | > loss_mel: 29.2602481842041 (27.181245803833008) | > loss_duration: 2.5878119468688965 (2.684807777404785) | > loss_1: 49.76274871826172 (44.833322525024414)  --> STEP: 3 | > loss_disc: 2.038832902908325 (2.223129908243815) | > loss_disc_real_0: 0.09279082715511322 (0.151078245912989) | > loss_disc_real_1: 0.2073597013950348 (0.25606682896614075) | > loss_disc_real_2: 0.20058681070804596 (0.2395760416984558) | > loss_disc_real_3: 0.19639326632022858 (0.23370170344909033) | > loss_disc_real_4: 0.1503080576658249 (0.1616833731532097) | > loss_disc_real_5: 0.10823172330856323 (0.17804921853045622) | > loss_0: 2.038832902908325 (2.223129908243815) | > loss_gen: 2.136350154876709 (2.549079656600952) | > loss_kl: 1.8521387577056885 (3.1624670028686523) | > loss_feat: 3.7758965492248535 (6.854762713114421) | > loss_mel: 20.206483840942383 (24.856325149536133) | > loss_duration: 2.5612311363220215 (2.6436155637105307) | > loss_1: 30.532100677490234 (40.06624857584635) --> EVAL PERFORMANCE | > avg_loader_time: 0.008548577626546225 (-0.003713369369506836) | > avg_loss_disc: 2.223129908243815 (-1.138569196065267) | > avg_loss_disc_real_0: 0.151078245912989 (-0.30028015188872814) | > avg_loss_disc_real_1: 0.25606682896614075 (-0.010049983859062195) | > avg_loss_disc_real_2: 0.2395760416984558 (-0.05495363970597583) | > avg_loss_disc_real_3: 0.23370170344909033 (-0.07758535196383795) | > avg_loss_disc_real_4: 0.1616833731532097 (-0.040283588071664184) | > avg_loss_disc_real_5: 0.17804921853045622 (-0.04976662310461205) | > avg_loss_0: 2.223129908243815 (-1.138569196065267) | > avg_loss_gen: 2.549079656600952 (+0.7464814583460491) | > avg_loss_kl: 3.1624670028686523 (+0.13480738798777248) | > avg_loss_feat: 6.854762713114421 (+3.056369931747516) | > avg_loss_mel: 24.856325149536133 (+9.880585670471191) | > avg_loss_duration: 2.6436155637105307 (-0.04134599367777492) | > avg_loss_1: 40.06624857584635 (+13.776897430419918)  > EPOCH: 366/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:40:20)   --> TIME: 2023-10-20 03:40:31 -- STEP: 9/50 -- GLOBAL_STEP: 71310 | > loss_disc: 2.2207093238830566 (2.3979889154434204) | > loss_disc_real_0: 0.12325716763734818 (0.12179007784773906) | > loss_disc_real_1: 0.24489347636699677 (0.23156291246414185) | > loss_disc_real_2: 0.27972933650016785 (0.266053915851646) | > loss_disc_real_3: 0.3353387117385864 (0.2559110124905904) | > loss_disc_real_4: 0.19185999035835266 (0.2525540234314071) | > loss_disc_real_5: 0.23194384574890137 (0.20949533498949474) | > loss_0: 2.2207093238830566 (2.3979889154434204) | > grad_norm_0: tensor(252.5726, device='cuda:0') (tensor(767.4267, device='cuda:0')) | > loss_gen: 2.7805819511413574 (2.49331788221995) | > loss_kl: 0.8685725927352905 (0.892105221748352) | > loss_feat: 5.541001319885254 (5.851878315210342) | > loss_mel: 25.366100311279297 (20.925842099719578) | > loss_duration: 1.4889678955078125 (1.5334860748714871) | > loss_1: 36.045223236083984 (31.69662931230333) | > grad_norm_1: tensor(3160.7769, device='cuda:0') (tensor(22936.4238, device='cuda:0')) | > current_lr_0: 0.00013869738723849042 | > current_lr_1: 0.00013869738723849042 | > step_time: 0.2792 (0.49735095765855575) | > loader_time: 0.023 (0.015364461474948458)  --> TIME: 2023-10-20 03:40:47 -- STEP: 39/50 -- GLOBAL_STEP: 71340 | > loss_disc: 2.944808006286621 (2.4859620179885473) | > loss_disc_real_0: 0.2777704894542694 (0.17426285565568086) | > loss_disc_real_1: 0.2130175232887268 (0.23418179899454117) | > loss_disc_real_2: 0.2507217526435852 (0.23689825469866777) | > loss_disc_real_3: 0.23781879246234894 (0.24479388159054977) | > loss_disc_real_4: 0.2813815772533417 (0.2179706432402898) | > loss_disc_real_5: 0.3168191909790039 (0.23215148722132048) | > loss_0: 2.944808006286621 (2.4859620179885473) | > grad_norm_0: tensor(383.4436, device='cuda:0') (tensor(709.5355, device='cuda:0')) | > loss_gen: 1.7276556491851807 (2.4572178369913353) | > loss_kl: 0.7448487877845764 (0.9728924265274634) | > loss_feat: 0.2656729817390442 (5.478899434590949) | > loss_mel: 2.406362533569336 (21.562919372167343) | > loss_duration: 1.5472102165222168 (1.5416360115393615) | > loss_1: 6.6917500495910645 (32.01356473335854) | > grad_norm_1: tensor(13407.1680, device='cuda:0') (tensor(19889.0156, device='cuda:0')) | > current_lr_0: 0.00013869738723849042 | > current_lr_1: 0.00013869738723849042 | > step_time: 0.5412 (0.5012288582630646) | > loader_time: 0.0177 (0.016688585281372067)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8946887254714966 (1.8946887254714966) | > loss_disc_real_0: 0.016630329191684723 (0.016630329191684723) | > loss_disc_real_1: 0.13228628039360046 (0.13228628039360046) | > loss_disc_real_2: 0.06631339341402054 (0.06631339341402054) | > loss_disc_real_3: 0.1965661644935608 (0.1965661644935608) | > loss_disc_real_4: 0.09034199267625809 (0.09034199267625809) | > loss_disc_real_5: 0.11405100673437119 (0.11405100673437119) | > loss_0: 1.8946887254714966 (1.8946887254714966) | > loss_gen: 2.1912665367126465 (2.1912665367126465) | > loss_kl: 3.3381292819976807 (3.3381292819976807) | > loss_feat: 9.64726734161377 (9.64726734161377) | > loss_mel: 27.666175842285156 (27.666175842285156) | > loss_duration: 2.402533531188965 (2.402533531188965) | > loss_1: 45.2453727722168 (45.2453727722168)  --> STEP: 1 | > loss_disc: 2.3141000270843506 (2.3141000270843506) | > loss_disc_real_0: 0.09985575079917908 (0.09985575079917908) | > loss_disc_real_1: 0.22578734159469604 (0.22578734159469604) | > loss_disc_real_2: 0.18367469310760498 (0.18367469310760498) | > loss_disc_real_3: 0.22179286181926727 (0.22179286181926727) | > loss_disc_real_4: 0.0702890083193779 (0.0702890083193779) | > loss_disc_real_5: 0.2112073302268982 (0.2112073302268982) | > loss_0: 2.3141000270843506 (2.3141000270843506) | > loss_gen: 1.9139169454574585 (1.9139169454574585) | > loss_kl: 4.030458927154541 (4.030458927154541) | > loss_feat: 5.700586318969727 (5.700586318969727) | > loss_mel: 20.895767211914062 (20.895767211914062) | > loss_duration: 2.7116446495056152 (2.7116446495056152) | > loss_1: 35.25237274169922 (35.25237274169922)  --> STEP: 2 | > loss_disc: 2.0824594497680664 (2.1982797384262085) | > loss_disc_real_0: 0.170653834939003 (0.13525479286909103) | > loss_disc_real_1: 0.09321320801973343 (0.15950027480721474) | > loss_disc_real_2: 0.11013052612543106 (0.14690260961651802) | > loss_disc_real_3: 0.13577409088611603 (0.17878347635269165) | > loss_disc_real_4: 0.11561272293329239 (0.09295086562633514) | > loss_disc_real_5: 0.18704456090927124 (0.19912594556808472) | > loss_0: 2.0824594497680664 (2.1982797384262085) | > loss_gen: 1.9969630241394043 (1.9554399847984314) | > loss_kl: 3.4344265460968018 (3.7324427366256714) | > loss_feat: 8.468832969665527 (7.084709644317627) | > loss_mel: 32.78679275512695 (26.841279983520508) | > loss_duration: 2.6770153045654297 (2.6943299770355225) | > loss_1: 49.36402893066406 (42.30820083618164)  --> STEP: 3 | > loss_disc: 2.906420946121216 (2.4343268076578775) | > loss_disc_real_0: 0.17295019328594208 (0.14781992634137472) | > loss_disc_real_1: 0.36893296241760254 (0.229311170677344) | > loss_disc_real_2: 0.2827879786491394 (0.19219773262739182) | > loss_disc_real_3: 0.2843340039253235 (0.21396698554356894) | > loss_disc_real_4: 0.2396378070116043 (0.1418465127547582) | > loss_disc_real_5: 0.31591740250587463 (0.23805643121401468) | > loss_0: 2.906420946121216 (2.4343268076578775) | > loss_gen: 1.8257942199707031 (1.9122247298558552) | > loss_kl: 1.7545702457427979 (3.0731519063313804) | > loss_feat: 0.9301342964172363 (5.03318452835083) | > loss_mel: 15.2404146194458 (22.974324862162273) | > loss_duration: 2.46677827835083 (2.6184794108072915) | > loss_1: 22.21769142150879 (35.61136436462402) --> EVAL PERFORMANCE | > avg_loader_time: 0.010018269220987955 (+0.0014696915944417306) | > avg_loss_disc: 2.4343268076578775 (+0.2111968994140625) | > avg_loss_disc_real_0: 0.14781992634137472 (-0.0032583195716142654) | > avg_loss_disc_real_1: 0.229311170677344 (-0.026755658288796752) | > avg_loss_disc_real_2: 0.19219773262739182 (-0.047378309071063995) | > avg_loss_disc_real_3: 0.21396698554356894 (-0.019734717905521393) | > avg_loss_disc_real_4: 0.1418465127547582 (-0.019836860398451478) | > avg_loss_disc_real_5: 0.23805643121401468 (+0.060007212683558464) | > avg_loss_0: 2.4343268076578775 (+0.2111968994140625) | > avg_loss_gen: 1.9122247298558552 (-0.6368549267450969) | > avg_loss_kl: 3.0731519063313804 (-0.08931509653727199) | > avg_loss_feat: 5.03318452835083 (-1.8215781847635908) | > avg_loss_mel: 22.974324862162273 (-1.8820002873738595) | > avg_loss_duration: 2.6184794108072915 (-0.02513615290323923) | > avg_loss_1: 35.61136436462402 (-4.454884211222328)  > EPOCH: 367/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:41:03)   --> TIME: 2023-10-20 03:41:13 -- STEP: 19/50 -- GLOBAL_STEP: 71370 | > loss_disc: 1.9321931600570679 (2.1910151682401957) | > loss_disc_real_0: 0.11972761154174805 (0.11791785061359406) | > loss_disc_real_1: 0.1087118461728096 (0.22025802476625694) | > loss_disc_real_2: 0.2532441318035126 (0.22581688647991732) | > loss_disc_real_3: 0.20795412361621857 (0.24703254452661463) | > loss_disc_real_4: 0.13959206640720367 (0.17738952605347885) | > loss_disc_real_5: 0.20973163843154907 (0.1963078411001908) | > loss_0: 1.9321931600570679 (2.1910151682401957) | > grad_norm_0: tensor(376.8123, device='cuda:0') (tensor(557.4623, device='cuda:0')) | > loss_gen: 2.701681613922119 (2.7018577738812097) | > loss_kl: 0.8425872325897217 (0.960805384736312) | > loss_feat: 7.099846839904785 (6.705118314510114) | > loss_mel: 23.891679763793945 (23.68052794431385) | > loss_duration: 1.6346763372421265 (1.58868492277045) | > loss_1: 36.170475006103516 (35.63699493910137) | > grad_norm_1: tensor(21216.7207, device='cuda:0') (tensor(29517.6875, device='cuda:0')) | > current_lr_0: 0.00013855875051619116 | > current_lr_1: 0.00013855875051619116 | > step_time: 0.3345 (0.35114073753356934) | > loader_time: 0.0019 (0.01032173006158126)  --> TIME: 2023-10-20 03:41:28 -- STEP: 49/50 -- GLOBAL_STEP: 71400 | > loss_disc: 1.4153881072998047 (2.1897517564345383) | > loss_disc_real_0: 0.22531208395957947 (0.12292144951239532) | > loss_disc_real_1: 0.14717790484428406 (0.2173874248199317) | > loss_disc_real_2: 0.09221501648426056 (0.20884756291551249) | > loss_disc_real_3: 0.21795791387557983 (0.23449848717724792) | > loss_disc_real_4: 0.17884017527103424 (0.20286312241259277) | > loss_disc_real_5: 0.07701080292463303 (0.19425449901431494) | > loss_0: 1.4153881072998047 (2.1897517564345383) | > grad_norm_0: tensor(1178.7338, device='cuda:0') (tensor(642.0809, device='cuda:0')) | > loss_gen: 4.1680426597595215 (2.717836187810314) | > loss_kl: 0.7893227338790894 (0.8529163343565804) | > loss_feat: 8.739906311035156 (6.734205703916294) | > loss_mel: 23.025741577148438 (23.08668420995985) | > loss_duration: 1.642453670501709 (1.5518084983436429) | > loss_1: 38.36546325683594 (34.94345094719711) | > grad_norm_1: tensor(43619.4297, device='cuda:0') (tensor(23722.6543, device='cuda:0')) | > current_lr_0: 0.00013855875051619116 | > current_lr_1: 0.00013855875051619116 | > step_time: 0.3745 (0.43418074140743335) | > loader_time: 0.3345 (0.01726345626675353)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.594696521759033 (2.594696521759033) | > loss_disc_real_0: 0.1401224583387375 (0.1401224583387375) | > loss_disc_real_1: 0.18075165152549744 (0.18075165152549744) | > loss_disc_real_2: 0.3181590735912323 (0.3181590735912323) | > loss_disc_real_3: 0.25172507762908936 (0.25172507762908936) | > loss_disc_real_4: 0.44406354427337646 (0.44406354427337646) | > loss_disc_real_5: 0.20607393980026245 (0.20607393980026245) | > loss_0: 2.594696521759033 (2.594696521759033) | > loss_gen: 2.3632848262786865 (2.3632848262786865) | > loss_kl: 3.5826518535614014 (3.5826518535614014) | > loss_feat: 6.657772541046143 (6.657772541046143) | > loss_mel: 24.89729118347168 (24.89729118347168) | > loss_duration: 2.579461097717285 (2.579461097717285) | > loss_1: 40.08045959472656 (40.08045959472656)  --> STEP: 1 | > loss_disc: 2.5128891468048096 (2.5128891468048096) | > loss_disc_real_0: 0.234464630484581 (0.234464630484581) | > loss_disc_real_1: 0.3004057705402374 (0.3004057705402374) | > loss_disc_real_2: 0.3134990930557251 (0.3134990930557251) | > loss_disc_real_3: 0.12812206149101257 (0.12812206149101257) | > loss_disc_real_4: 0.2867233157157898 (0.2867233157157898) | > loss_disc_real_5: 0.1889936625957489 (0.1889936625957489) | > loss_0: 2.5128891468048096 (2.5128891468048096) | > loss_gen: 2.737421751022339 (2.737421751022339) | > loss_kl: 3.908989429473877 (3.908989429473877) | > loss_feat: 9.106009483337402 (9.106009483337402) | > loss_mel: 25.940589904785156 (25.940589904785156) | > loss_duration: 2.690973997116089 (2.690973997116089) | > loss_1: 44.38398742675781 (44.38398742675781)  --> STEP: 2 | > loss_disc: 2.783432722091675 (2.648160934448242) | > loss_disc_real_0: 0.3284943699836731 (0.28147950023412704) | > loss_disc_real_1: 0.3152798116207123 (0.30784279108047485) | > loss_disc_real_2: 0.42937079071998596 (0.37143494188785553) | > loss_disc_real_3: 0.3999599516391754 (0.264041006565094) | > loss_disc_real_4: 0.4070912003517151 (0.34690725803375244) | > loss_disc_real_5: 0.26272648572921753 (0.22586007416248322) | > loss_0: 2.783432722091675 (2.648160934448242) | > loss_gen: 3.1380085945129395 (2.937715172767639) | > loss_kl: 3.5951313972473145 (3.7520604133605957) | > loss_feat: 4.479581356048584 (6.792795419692993) | > loss_mel: 29.876359939575195 (27.908474922180176) | > loss_duration: 2.631619930267334 (2.6612969636917114) | > loss_1: 43.720699310302734 (44.05234336853027)  --> STEP: 3 | > loss_disc: 2.9812138080596924 (2.759178558985392) | > loss_disc_real_0: 0.23083961009979248 (0.2645995368560155) | > loss_disc_real_1: 0.2947901785373688 (0.3034919202327728) | > loss_disc_real_2: 0.2419043928384781 (0.32825809220472973) | > loss_disc_real_3: 0.27062666416168213 (0.2662362257639567) | > loss_disc_real_4: 0.3160538077354431 (0.33662277460098267) | > loss_disc_real_5: 0.2959648370742798 (0.2492283284664154) | > loss_0: 2.9812138080596924 (2.759178558985392) | > loss_gen: 1.6944379806518555 (2.523289442062378) | > loss_kl: 2.0599169731140137 (3.1880125999450684) | > loss_feat: 0.10683722794055939 (4.564142689108849) | > loss_mel: 2.8066232204437256 (19.54119102160136) | > loss_duration: 2.5920510292053223 (2.6382149855295816) | > loss_1: 9.259866714477539 (32.454851150512695) --> EVAL PERFORMANCE | > avg_loader_time: 0.021759827931722004 (+0.011741558710734049) | > avg_loss_disc: 2.759178558985392 (+0.32485175132751465) | > avg_loss_disc_real_0: 0.2645995368560155 (+0.11677961051464078) | > avg_loss_disc_real_1: 0.3034919202327728 (+0.07418074955542883) | > avg_loss_disc_real_2: 0.32825809220472973 (+0.13606035957733792) | > avg_loss_disc_real_3: 0.2662362257639567 (+0.052269240220387786) | > avg_loss_disc_real_4: 0.33662277460098267 (+0.19477626184622446) | > avg_loss_disc_real_5: 0.2492283284664154 (+0.011171897252400725) | > avg_loss_0: 2.759178558985392 (+0.32485175132751465) | > avg_loss_gen: 2.523289442062378 (+0.6110647122065227) | > avg_loss_kl: 3.1880125999450684 (+0.114860693613688) | > avg_loss_feat: 4.564142689108849 (-0.4690418392419815) | > avg_loss_mel: 19.54119102160136 (-3.433133840560913) | > avg_loss_duration: 2.6382149855295816 (+0.01973557472229004) | > avg_loss_1: 32.454851150512695 (-3.156513214111328)  > EPOCH: 368/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:41:39)   --> TIME: 2023-10-20 03:41:58 -- STEP: 29/50 -- GLOBAL_STEP: 71430 | > loss_disc: 1.994901418685913 (2.3190871723766984) | > loss_disc_real_0: 0.10780904442071915 (0.15780597514119646) | > loss_disc_real_1: 0.23012857139110565 (0.2176492928430952) | > loss_disc_real_2: 0.1236223578453064 (0.21452369335396537) | > loss_disc_real_3: 0.33555907011032104 (0.223632606452909) | > loss_disc_real_4: 0.09925694018602371 (0.22322734342566852) | > loss_disc_real_5: 0.3629358112812042 (0.22304749707209653) | > loss_0: 1.994901418685913 (2.3190871723766984) | > grad_norm_0: tensor(352.2304, device='cuda:0') (tensor(597.9537, device='cuda:0')) | > loss_gen: 2.8510582447052 (2.5526293968332223) | > loss_kl: 1.1552835702896118 (0.971200562756637) | > loss_feat: 6.208233833312988 (5.82601272905695) | > loss_mel: 23.830581665039062 (22.88015203640379) | > loss_duration: 1.51117742061615 (1.5500788072059895) | > loss_1: 35.55633544921875 (33.780072820597674) | > grad_norm_1: tensor(3969.6750, device='cuda:0') (tensor(16580.6309, device='cuda:0')) | > current_lr_0: 0.00013842025236997577 | > current_lr_1: 0.00013842025236997577 | > step_time: 0.555 (0.49191310487944506) | > loader_time: 0.0116 (0.019023056687979864)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.014488458633423 (2.014488458633423) | > loss_disc_real_0: 0.11539635062217712 (0.11539635062217712) | > loss_disc_real_1: 0.19588953256607056 (0.19588953256607056) | > loss_disc_real_2: 0.16653937101364136 (0.16653937101364136) | > loss_disc_real_3: 0.1337302178144455 (0.1337302178144455) | > loss_disc_real_4: 0.18266452848911285 (0.18266452848911285) | > loss_disc_real_5: 0.33793628215789795 (0.33793628215789795) | > loss_0: 2.014488458633423 (2.014488458633423) | > loss_gen: 2.966555595397949 (2.966555595397949) | > loss_kl: 5.412548065185547 (5.412548065185547) | > loss_feat: 8.337615966796875 (8.337615966796875) | > loss_mel: 24.265636444091797 (24.265636444091797) | > loss_duration: 2.6390931606292725 (2.6390931606292725) | > loss_1: 43.6214485168457 (43.6214485168457)  --> STEP: 1 | > loss_disc: 2.351348638534546 (2.351348638534546) | > loss_disc_real_0: 0.08901993185281754 (0.08901993185281754) | > loss_disc_real_1: 0.21987687051296234 (0.21987687051296234) | > loss_disc_real_2: 0.19212839007377625 (0.19212839007377625) | > loss_disc_real_3: 0.3198770582675934 (0.3198770582675934) | > loss_disc_real_4: 0.3721362352371216 (0.3721362352371216) | > loss_disc_real_5: 0.3791523873806 (0.3791523873806) | > loss_0: 2.351348638534546 (2.351348638534546) | > loss_gen: 3.005589008331299 (3.005589008331299) | > loss_kl: 3.837419271469116 (3.837419271469116) | > loss_feat: 7.154232978820801 (7.154232978820801) | > loss_mel: 24.33814811706543 (24.33814811706543) | > loss_duration: 2.8350255489349365 (2.8350255489349365) | > loss_1: 41.170413970947266 (41.170413970947266)  --> STEP: 2 | > loss_disc: 3.140103340148926 (2.745725989341736) | > loss_disc_real_0: 0.21715965867042542 (0.15308979526162148) | > loss_disc_real_1: 0.38650962710380554 (0.30319324880838394) | > loss_disc_real_2: 0.33589231967926025 (0.26401035487651825) | > loss_disc_real_3: 0.4167962074279785 (0.36833663284778595) | > loss_disc_real_4: 0.346404105424881 (0.3592701703310013) | > loss_disc_real_5: 0.3903428018093109 (0.38474759459495544) | > loss_0: 3.140103340148926 (2.745725989341736) | > loss_gen: 2.5260677337646484 (2.7658283710479736) | > loss_kl: 3.757664203643799 (3.7975417375564575) | > loss_feat: 4.0381951332092285 (5.596214056015015) | > loss_mel: 26.939970016479492 (25.63905906677246) | > loss_duration: 2.5117905139923096 (2.673408031463623) | > loss_1: 39.773685455322266 (40.472049713134766)  --> STEP: 3 | > loss_disc: 2.7956156730651855 (2.7623558839162192) | > loss_disc_real_0: 0.32526135444641113 (0.2104803149898847) | > loss_disc_real_1: 0.23737823963165283 (0.28125491241614026) | > loss_disc_real_2: 0.22580742835998535 (0.25127604603767395) | > loss_disc_real_3: 0.22991210222244263 (0.3221951226393382) | > loss_disc_real_4: 0.245981827378273 (0.32150738934675854) | > loss_disc_real_5: 0.18506816029548645 (0.31818778316179913) | > loss_0: 2.7956156730651855 (2.7623558839162192) | > loss_gen: 1.7379329204559326 (2.42319655418396) | > loss_kl: 1.8633629083633423 (3.1528154611587524) | > loss_feat: 0.7691569328308105 (3.9871950149536133) | > loss_mel: 16.50931739807129 (22.59581184387207) | > loss_duration: 2.5845351219177246 (2.6437837282816568) | > loss_1: 23.464305877685547 (34.802801767985024) --> EVAL PERFORMANCE | > avg_loader_time: 0.004962841669718425 (-0.01679698626200358) | > avg_loss_disc: 2.7623558839162192 (+0.003177324930827119) | > avg_loss_disc_real_0: 0.2104803149898847 (-0.0541192218661308) | > avg_loss_disc_real_1: 0.28125491241614026 (-0.02223700781663257) | > avg_loss_disc_real_2: 0.25127604603767395 (-0.07698204616705578) | > avg_loss_disc_real_3: 0.3221951226393382 (+0.05595889687538147) | > avg_loss_disc_real_4: 0.32150738934675854 (-0.015115385254224123) | > avg_loss_disc_real_5: 0.31818778316179913 (+0.06895945469538373) | > avg_loss_0: 2.7623558839162192 (+0.003177324930827119) | > avg_loss_gen: 2.42319655418396 (-0.10009288787841797) | > avg_loss_kl: 3.1528154611587524 (-0.03519713878631592) | > avg_loss_feat: 3.9871950149536133 (-0.5769476741552353) | > avg_loss_mel: 22.59581184387207 (+3.05462082227071) | > avg_loss_duration: 2.6437837282816568 (+0.005568742752075195) | > avg_loss_1: 34.802801767985024 (+2.3479506174723284)  > EPOCH: 369/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:42:20)   --> TIME: 2023-10-20 03:42:29 -- STEP: 9/50 -- GLOBAL_STEP: 71460 | > loss_disc: 3.088392972946167 (2.075195868810018) | > loss_disc_real_0: 0.2402740716934204 (0.11909330605218808) | > loss_disc_real_1: 0.41476187109947205 (0.2273375822438134) | > loss_disc_real_2: 0.4212346076965332 (0.1985451521144973) | > loss_disc_real_3: 0.3180045783519745 (0.17430783808231354) | > loss_disc_real_4: 0.2701277732849121 (0.15671392995864153) | > loss_disc_real_5: 0.2609376311302185 (0.1743502966645691) | > loss_0: 3.088392972946167 (2.075195868810018) | > grad_norm_0: tensor(391.0343, device='cuda:0') (tensor(433.0432, device='cuda:0')) | > loss_gen: 2.3643958568573 (2.820804860856798) | > loss_kl: 0.8570897579193115 (0.8491738157139884) | > loss_feat: 3.737356185913086 (8.226322121090359) | > loss_mel: 26.00196647644043 (25.625542958577473) | > loss_duration: 1.513899326324463 (1.5654589997397528) | > loss_1: 34.474708557128906 (39.087303161621094) | > grad_norm_1: tensor(2683.8733, device='cuda:0') (tensor(31002.7812, device='cuda:0')) | > current_lr_0: 0.00013828189266132878 | > current_lr_1: 0.00013828189266132878 | > step_time: 0.4443 (0.4592038525475396) | > loader_time: 0.0252 (0.009169896443684896)  --> TIME: 2023-10-20 03:42:45 -- STEP: 39/50 -- GLOBAL_STEP: 71490 | > loss_disc: 2.906352996826172 (2.441733311384152) | > loss_disc_real_0: 0.2245163917541504 (0.15752566593866318) | > loss_disc_real_1: 0.2609407603740692 (0.23439208284402505) | > loss_disc_real_2: 0.20690065622329712 (0.23393968893931463) | > loss_disc_real_3: 0.2379496842622757 (0.2356869749342784) | > loss_disc_real_4: 0.2703506052494049 (0.22188410566498837) | > loss_disc_real_5: 0.3033980131149292 (0.23725355598024833) | > loss_0: 2.906352996826172 (2.441733311384152) | > grad_norm_0: tensor(325.4979, device='cuda:0') (tensor(521.4405, device='cuda:0')) | > loss_gen: 1.6071914434432983 (2.522796927354275) | > loss_kl: 0.7706178426742554 (0.913745335661448) | > loss_feat: 0.6378825902938843 (5.9673438139068775) | > loss_mel: 14.405707359313965 (22.82414466295487) | > loss_duration: 1.6015969514846802 (1.5411993784782214) | > loss_1: 19.02299690246582 (33.76923025571383) | > grad_norm_1: tensor(5098.0278, device='cuda:0') (tensor(21771.8164, device='cuda:0')) | > current_lr_0: 0.00013828189266132878 | > current_lr_1: 0.00013828189266132878 | > step_time: 0.5798 (0.4937423253670717) | > loader_time: 0.0083 (0.015319188435872396)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1817479133605957 (3.1817479133605957) | > loss_disc_real_0: 0.5804421901702881 (0.5804421901702881) | > loss_disc_real_1: 0.25343117117881775 (0.25343117117881775) | > loss_disc_real_2: 0.2518226206302643 (0.2518226206302643) | > loss_disc_real_3: 0.34708595275878906 (0.34708595275878906) | > loss_disc_real_4: 0.25428318977355957 (0.25428318977355957) | > loss_disc_real_5: 0.2535131573677063 (0.2535131573677063) | > loss_0: 3.1817479133605957 (3.1817479133605957) | > loss_gen: 2.2177417278289795 (2.2177417278289795) | > loss_kl: 3.3001549243927 (3.3001549243927) | > loss_feat: 2.28029727935791 (2.28029727935791) | > loss_mel: 21.359163284301758 (21.359163284301758) | > loss_duration: 2.488417148590088 (2.488417148590088) | > loss_1: 31.64577293395996 (31.64577293395996)  --> STEP: 1 | > loss_disc: 2.54082989692688 (2.54082989692688) | > loss_disc_real_0: 0.2401973009109497 (0.2401973009109497) | > loss_disc_real_1: 0.1464662104845047 (0.1464662104845047) | > loss_disc_real_2: 0.1265047788619995 (0.1265047788619995) | > loss_disc_real_3: 0.3124750256538391 (0.3124750256538391) | > loss_disc_real_4: 0.30240166187286377 (0.30240166187286377) | > loss_disc_real_5: 0.34486284852027893 (0.34486284852027893) | > loss_0: 2.54082989692688 (2.54082989692688) | > loss_gen: 2.9355227947235107 (2.9355227947235107) | > loss_kl: 3.090184450149536 (3.090184450149536) | > loss_feat: 7.64078426361084 (7.64078426361084) | > loss_mel: 24.566375732421875 (24.566375732421875) | > loss_duration: 2.6755189895629883 (2.6755189895629883) | > loss_1: 40.90838623046875 (40.90838623046875)  --> STEP: 2 | > loss_disc: 2.829944610595703 (2.6853872537612915) | > loss_disc_real_0: 0.23646660149097443 (0.23833195120096207) | > loss_disc_real_1: 0.14321257174015045 (0.14483939111232758) | > loss_disc_real_2: 0.15371765196323395 (0.14011121541261673) | > loss_disc_real_3: 0.05678756907582283 (0.18463129736483097) | > loss_disc_real_4: 0.052262600511312485 (0.17733213119208813) | > loss_disc_real_5: 0.053358256816864014 (0.19911055266857147) | > loss_0: 2.829944610595703 (2.6853872537612915) | > loss_gen: 1.471506118774414 (2.2035144567489624) | > loss_kl: 3.5877015590667725 (3.3389430046081543) | > loss_feat: 11.384634971618652 (9.512709617614746) | > loss_mel: 24.11343765258789 (24.339906692504883) | > loss_duration: 2.590099334716797 (2.6328091621398926) | > loss_1: 43.14738082885742 (42.027883529663086)  --> STEP: 3 | > loss_disc: 2.7623417377471924 (2.7110387484232583) | > loss_disc_real_0: 0.4022005498409271 (0.29295481741428375) | > loss_disc_real_1: 0.29203134775161743 (0.19390337665875754) | > loss_disc_real_2: 0.2750188708305359 (0.18508043388525644) | > loss_disc_real_3: 0.39098548889160156 (0.2534160278737545) | > loss_disc_real_4: 0.23667390644550323 (0.1971127229432265) | > loss_disc_real_5: 0.2839355766773224 (0.22738556067148843) | > loss_0: 2.7623417377471924 (2.7110387484232583) | > loss_gen: 2.6607418060302734 (2.355923573176066) | > loss_kl: 1.6283334493637085 (2.7687398195266724) | > loss_feat: 3.2604002952575684 (7.4286065101623535) | > loss_mel: 22.018768310546875 (23.56619389851888) | > loss_duration: 2.5652060508728027 (2.6102747917175293) | > loss_1: 32.13344955444336 (38.72973887125651) --> EVAL PERFORMANCE | > avg_loader_time: 0.02388914426167806 (+0.018926302591959633) | > avg_loss_disc: 2.7110387484232583 (-0.05131713549296091) | > avg_loss_disc_real_0: 0.29295481741428375 (+0.08247450242439905) | > avg_loss_disc_real_1: 0.19390337665875754 (-0.08735153575738272) | > avg_loss_disc_real_2: 0.18508043388525644 (-0.06619561215241751) | > avg_loss_disc_real_3: 0.2534160278737545 (-0.06877909476558369) | > avg_loss_disc_real_4: 0.1971127229432265 (-0.12439466640353206) | > avg_loss_disc_real_5: 0.22738556067148843 (-0.0908022224903107) | > avg_loss_0: 2.7110387484232583 (-0.05131713549296091) | > avg_loss_gen: 2.355923573176066 (-0.06727298100789403) | > avg_loss_kl: 2.7687398195266724 (-0.3840756416320801) | > avg_loss_feat: 7.4286065101623535 (+3.4414114952087402) | > avg_loss_mel: 23.56619389851888 (+0.9703820546468087) | > avg_loss_duration: 2.6102747917175293 (-0.033508936564127456) | > avg_loss_1: 38.72973887125651 (+3.9269371032714844)  > EPOCH: 370/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:43:03)   --> TIME: 2023-10-20 03:43:14 -- STEP: 19/50 -- GLOBAL_STEP: 71520 | > loss_disc: 3.1515841484069824 (2.4600796260331808) | > loss_disc_real_0: 0.23187780380249023 (0.16316456788856729) | > loss_disc_real_1: 0.27411115169525146 (0.22966046043132482) | > loss_disc_real_2: 0.2921348810195923 (0.23716637060830467) | > loss_disc_real_3: 0.23114930093288422 (0.2341754232582293) | > loss_disc_real_4: 0.352284699678421 (0.24139063550453438) | > loss_disc_real_5: 0.43389517068862915 (0.22659571625684438) | > loss_0: 3.1515841484069824 (2.4600796260331808) | > grad_norm_0: tensor(657.4597, device='cuda:0') (tensor(665.5997, device='cuda:0')) | > loss_gen: 2.0625061988830566 (2.5444630070736536) | > loss_kl: 1.0514423847198486 (0.9546872549935391) | > loss_feat: 4.2849202156066895 (5.791599938449891) | > loss_mel: 24.823688507080078 (23.05536645337155) | > loss_duration: 1.6141724586486816 (1.577303133512798) | > loss_1: 33.83673095703125 (33.92341924968518) | > grad_norm_1: tensor(6400.5171, device='cuda:0') (tensor(26176.5605, device='cuda:0')) | > current_lr_0: 0.00013814367125187323 | > current_lr_1: 0.00013814367125187323 | > step_time: 0.3812 (0.38221834835253266) | > loader_time: 0.006 (0.00806317831340589)  --> TIME: 2023-10-20 03:43:28 -- STEP: 49/50 -- GLOBAL_STEP: 71550 | > loss_disc: 2.7662696838378906 (2.458074440761489) | > loss_disc_real_0: 0.06433723866939545 (0.15014377023492545) | > loss_disc_real_1: 0.28152281045913696 (0.23749946308683376) | > loss_disc_real_2: 0.3014926016330719 (0.22659027546036) | > loss_disc_real_3: 0.282157838344574 (0.24538009963473492) | > loss_disc_real_4: 0.2700868248939514 (0.23336003751170878) | > loss_disc_real_5: 0.22461405396461487 (0.22393172661944918) | > loss_0: 2.7662696838378906 (2.458074440761489) | > grad_norm_0: tensor(1169.9994, device='cuda:0') (tensor(648.5146, device='cuda:0')) | > loss_gen: 2.118687868118286 (2.4929632167426914) | > loss_kl: 0.8015155792236328 (0.9257291944659486) | > loss_feat: 3.277026891708374 (6.146366479331436) | > loss_mel: 19.837308883666992 (23.597799802313045) | > loss_duration: 1.650062918663025 (1.5456899842437433) | > loss_1: 27.684602737426758 (34.70854862368838) | > grad_norm_1: tensor(7703.6104, device='cuda:0') (tensor(20964.6758, device='cuda:0')) | > current_lr_0: 0.00013814367125187323 | > current_lr_1: 0.00013814367125187323 | > step_time: 0.3359 (0.41368776924756107) | > loader_time: 0.4271 (0.01662820699263592)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3027567863464355 (2.3027567863464355) | > loss_disc_real_0: 0.024466879665851593 (0.024466879665851593) | > loss_disc_real_1: 0.18353548645973206 (0.18353548645973206) | > loss_disc_real_2: 0.20246824622154236 (0.20246824622154236) | > loss_disc_real_3: 0.2722259759902954 (0.2722259759902954) | > loss_disc_real_4: 0.25526130199432373 (0.25526130199432373) | > loss_disc_real_5: 0.28594908118247986 (0.28594908118247986) | > loss_0: 2.3027567863464355 (2.3027567863464355) | > loss_gen: 2.340604543685913 (2.340604543685913) | > loss_kl: 3.260545015335083 (3.260545015335083) | > loss_feat: 5.711862564086914 (5.711862564086914) | > loss_mel: 23.331012725830078 (23.331012725830078) | > loss_duration: 2.4844579696655273 (2.4844579696655273) | > loss_1: 37.128482818603516 (37.128482818603516)  --> STEP: 1 | > loss_disc: 2.431518793106079 (2.431518793106079) | > loss_disc_real_0: 0.15968021750450134 (0.15968021750450134) | > loss_disc_real_1: 0.29097041487693787 (0.29097041487693787) | > loss_disc_real_2: 0.17465296387672424 (0.17465296387672424) | > loss_disc_real_3: 0.16968445479869843 (0.16968445479869843) | > loss_disc_real_4: 0.30034464597702026 (0.30034464597702026) | > loss_disc_real_5: 0.30803248286247253 (0.30803248286247253) | > loss_0: 2.431518793106079 (2.431518793106079) | > loss_gen: 2.3183579444885254 (2.3183579444885254) | > loss_kl: 3.857130289077759 (3.857130289077759) | > loss_feat: 6.8300676345825195 (6.8300676345825195) | > loss_mel: 24.465551376342773 (24.465551376342773) | > loss_duration: 2.8400826454162598 (2.8400826454162598) | > loss_1: 40.31119155883789 (40.31119155883789)  --> STEP: 2 | > loss_disc: 3.083721876144409 (2.757620334625244) | > loss_disc_real_0: 0.4582529067993164 (0.3089665621519089) | > loss_disc_real_1: 0.28286346793174744 (0.28691694140434265) | > loss_disc_real_2: 0.3579544425010681 (0.2663037031888962) | > loss_disc_real_3: 0.2683810293674469 (0.21903274208307266) | > loss_disc_real_4: 0.2981385886669159 (0.2992416173219681) | > loss_disc_real_5: 0.3071739077568054 (0.307603195309639) | > loss_0: 3.083721876144409 (2.757620334625244) | > loss_gen: 2.0146093368530273 (2.1664836406707764) | > loss_kl: 4.101122856140137 (3.9791265726089478) | > loss_feat: 0.14546944200992584 (3.4877685382962227) | > loss_mel: 2.1238231658935547 (13.294687271118164) | > loss_duration: 2.7284109592437744 (2.784246802330017) | > loss_1: 11.113435745239258 (25.712313652038574)  --> STEP: 3 | > loss_disc: 2.797623634338379 (2.7709547678629556) | > loss_disc_real_0: 0.0794433057308197 (0.2324588100115458) | > loss_disc_real_1: 0.258710652589798 (0.27751484513282776) | > loss_disc_real_2: 0.29139289259910583 (0.27466676632563275) | > loss_disc_real_3: 0.26298797130584717 (0.23368448515733084) | > loss_disc_real_4: 0.32216936349868774 (0.30688419938087463) | > loss_disc_real_5: 0.497798353433609 (0.37100158135096234) | > loss_0: 2.797623634338379 (2.7709547678629556) | > loss_gen: 2.200712203979492 (2.1778931617736816) | > loss_kl: 1.8442456722259521 (3.2674996058146157) | > loss_feat: 3.8574254512786865 (3.610987509290377) | > loss_mel: 22.39150619506836 (16.32696024576823) | > loss_duration: 2.626485586166382 (2.731659730275472) | > loss_1: 32.92037582397461 (28.115001042683918) --> EVAL PERFORMANCE | > avg_loader_time: 0.006659587224324544 (-0.017229557037353516) | > avg_loss_disc: 2.7709547678629556 (+0.059916019439697266) | > avg_loss_disc_real_0: 0.2324588100115458 (-0.060496007402737945) | > avg_loss_disc_real_1: 0.27751484513282776 (+0.08361146847407022) | > avg_loss_disc_real_2: 0.27466676632563275 (+0.08958633244037631) | > avg_loss_disc_real_3: 0.23368448515733084 (-0.01973154271642366) | > avg_loss_disc_real_4: 0.30688419938087463 (+0.10977147643764815) | > avg_loss_disc_real_5: 0.37100158135096234 (+0.1436160206794739) | > avg_loss_0: 2.7709547678629556 (+0.059916019439697266) | > avg_loss_gen: 2.1778931617736816 (-0.1780304114023843) | > avg_loss_kl: 3.2674996058146157 (+0.4987597862879434) | > avg_loss_feat: 3.610987509290377 (-3.8176190008719764) | > avg_loss_mel: 16.32696024576823 (-7.239233652750649) | > avg_loss_duration: 2.731659730275472 (+0.12138493855794286) | > avg_loss_1: 28.115001042683918 (-10.61473782857259)  > EPOCH: 371/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:43:39)   --> TIME: 2023-10-20 03:43:58 -- STEP: 29/50 -- GLOBAL_STEP: 71580 | > loss_disc: 2.743785858154297 (2.46205919364403) | > loss_disc_real_0: 0.21308770775794983 (0.18557568170644087) | > loss_disc_real_1: 0.21241123974323273 (0.21889996811233717) | > loss_disc_real_2: 0.1904352605342865 (0.21404740297845726) | > loss_disc_real_3: 0.2802734076976776 (0.22730764900815897) | > loss_disc_real_4: 0.2907808721065521 (0.22967412823746944) | > loss_disc_real_5: 0.5082340240478516 (0.24110666521150487) | > loss_0: 2.743785858154297 (2.46205919364403) | > grad_norm_0: tensor(476.7692, device='cuda:0') (tensor(607.0710, device='cuda:0')) | > loss_gen: 2.442943572998047 (2.3327562027964097) | > loss_kl: 1.3296785354614258 (0.9195182878395607) | > loss_feat: 4.259166717529297 (5.439359173564048) | > loss_mel: 24.136852264404297 (21.160298215931864) | > loss_duration: 1.5530707836151123 (1.5582273417505725) | > loss_1: 33.721710205078125 (31.41015889726836) | > grad_norm_1: tensor(3616.7429, device='cuda:0') (tensor(21130.6738, device='cuda:0')) | > current_lr_0: 0.00013800558800337038 | > current_lr_1: 0.00013800558800337038 | > step_time: 0.5723 (0.49522827411520065) | > loader_time: 0.0069 (0.018787622451782227)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.220301866531372 (2.220301866531372) | > loss_disc_real_0: 0.08758410811424255 (0.08758410811424255) | > loss_disc_real_1: 0.21107563376426697 (0.21107563376426697) | > loss_disc_real_2: 0.1039232462644577 (0.1039232462644577) | > loss_disc_real_3: 0.22699756920337677 (0.22699756920337677) | > loss_disc_real_4: 0.18284040689468384 (0.18284040689468384) | > loss_disc_real_5: 0.06296341121196747 (0.06296341121196747) | > loss_0: 2.220301866531372 (2.220301866531372) | > loss_gen: 2.0020229816436768 (2.0020229816436768) | > loss_kl: 3.044283390045166 (3.044283390045166) | > loss_feat: 7.390776634216309 (7.390776634216309) | > loss_mel: 24.32469940185547 (24.32469940185547) | > loss_duration: 2.5892257690429688 (2.5892257690429688) | > loss_1: 39.35100555419922 (39.35100555419922)  --> STEP: 1 | > loss_disc: 2.8955941200256348 (2.8955941200256348) | > loss_disc_real_0: 0.28032606840133667 (0.28032606840133667) | > loss_disc_real_1: 0.24696236848831177 (0.24696236848831177) | > loss_disc_real_2: 0.21656951308250427 (0.21656951308250427) | > loss_disc_real_3: 0.32046082615852356 (0.32046082615852356) | > loss_disc_real_4: 0.25332725048065186 (0.25332725048065186) | > loss_disc_real_5: 0.20690307021141052 (0.20690307021141052) | > loss_0: 2.8955941200256348 (2.8955941200256348) | > loss_gen: 1.7891453504562378 (1.7891453504562378) | > loss_kl: 3.5658185482025146 (3.5658185482025146) | > loss_feat: 1.1587284803390503 (1.1587284803390503) | > loss_mel: 18.773513793945312 (18.773513793945312) | > loss_duration: 2.8086016178131104 (2.8086016178131104) | > loss_1: 28.095806121826172 (28.095806121826172)  --> STEP: 2 | > loss_disc: 2.2954888343811035 (2.595541477203369) | > loss_disc_real_0: 0.07793709635734558 (0.17913158237934113) | > loss_disc_real_1: 0.3428036570549011 (0.29488301277160645) | > loss_disc_real_2: 0.2716057598590851 (0.24408763647079468) | > loss_disc_real_3: 0.16880621016025543 (0.2446335181593895) | > loss_disc_real_4: 0.2732779085636139 (0.2633025795221329) | > loss_disc_real_5: 0.11628767848014832 (0.16159537434577942) | > loss_0: 2.2954888343811035 (2.595541477203369) | > loss_gen: 2.429090976715088 (2.109118163585663) | > loss_kl: 3.926755905151367 (3.746287226676941) | > loss_feat: 7.682631969451904 (4.420680224895477) | > loss_mel: 25.645689010620117 (22.209601402282715) | > loss_duration: 2.7609829902648926 (2.7847923040390015) | > loss_1: 42.445152282714844 (35.27047920227051)  --> STEP: 3 | > loss_disc: 1.8705205917358398 (2.353867848714193) | > loss_disc_real_0: 0.16850118339061737 (0.17558811604976654) | > loss_disc_real_1: 0.2511202394962311 (0.28029542167981464) | > loss_disc_real_2: 0.23910070955753326 (0.24242532749970755) | > loss_disc_real_3: 0.18146750330924988 (0.22357817987600961) | > loss_disc_real_4: 0.20809997618198395 (0.24490171174208322) | > loss_disc_real_5: 0.12540027499198914 (0.14953034122784933) | > loss_0: 1.8705205917358398 (2.353867848714193) | > loss_gen: 2.981187343597412 (2.399807890256246) | > loss_kl: 1.5918524265289307 (3.028142293294271) | > loss_feat: 6.42401647567749 (5.088458975156148) | > loss_mel: 29.66574478149414 (24.694982528686523) | > loss_duration: 2.613111972808838 (2.7275655269622803) | > loss_1: 43.27591323852539 (37.93895721435547) --> EVAL PERFORMANCE | > avg_loader_time: 0.002488215764363607 (-0.0041713714599609375) | > avg_loss_disc: 2.353867848714193 (-0.4170869191487627) | > avg_loss_disc_real_0: 0.17558811604976654 (-0.05687069396177927) | > avg_loss_disc_real_1: 0.28029542167981464 (+0.0027805765469868793) | > avg_loss_disc_real_2: 0.24242532749970755 (-0.0322414388259252) | > avg_loss_disc_real_3: 0.22357817987600961 (-0.010106305281321226) | > avg_loss_disc_real_4: 0.24490171174208322 (-0.06198248763879141) | > avg_loss_disc_real_5: 0.14953034122784933 (-0.221471240123113) | > avg_loss_0: 2.353867848714193 (-0.4170869191487627) | > avg_loss_gen: 2.399807890256246 (+0.22191472848256444) | > avg_loss_kl: 3.028142293294271 (-0.23935731252034476) | > avg_loss_feat: 5.088458975156148 (+1.4774714658657708) | > avg_loss_mel: 24.694982528686523 (+8.368022282918293) | > avg_loss_duration: 2.7275655269622803 (-0.00409420331319188) | > avg_loss_1: 37.93895721435547 (+9.82395617167155)  > EPOCH: 372/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:44:20)   --> TIME: 2023-10-20 03:44:30 -- STEP: 9/50 -- GLOBAL_STEP: 71610 | > loss_disc: 2.8870737552642822 (2.367440104484558) | > loss_disc_real_0: 0.12227918952703476 (0.19164486933085653) | > loss_disc_real_1: 0.30619633197784424 (0.26745602529909873) | > loss_disc_real_2: 0.2605659067630768 (0.2639824168549644) | > loss_disc_real_3: 0.32982996106147766 (0.24935071667035422) | > loss_disc_real_4: 0.2757318615913391 (0.19873016782932812) | > loss_disc_real_5: 0.3202163875102997 (0.18867564615276125) | > loss_0: 2.8870737552642822 (2.367440104484558) | > grad_norm_0: tensor(392.2381, device='cuda:0') (tensor(515.1898, device='cuda:0')) | > loss_gen: 1.7884807586669922 (2.547770526674059) | > loss_kl: 1.0025256872177124 (1.1383831169870164) | > loss_feat: 0.5200960040092468 (5.336836331420475) | > loss_mel: 15.815241813659668 (22.64113097720676) | > loss_duration: 1.4890953302383423 (1.5707626872592502) | > loss_1: 20.615440368652344 (33.234883626302086) | > grad_norm_1: tensor(10381.7617, device='cuda:0') (tensor(17601.8438, device='cuda:0')) | > current_lr_0: 0.00013786764277771974 | > current_lr_1: 0.00013786764277771974 | > step_time: 0.431 (0.4429030683305528) | > loader_time: 0.0244 (0.009214295281304253)  --> TIME: 2023-10-20 03:44:46 -- STEP: 39/50 -- GLOBAL_STEP: 71640 | > loss_disc: 3.251715898513794 (2.5736340192648086) | > loss_disc_real_0: 0.10974077880382538 (0.17936565077457672) | > loss_disc_real_1: 0.24966228008270264 (0.2402102017822938) | > loss_disc_real_2: 0.19695602357387543 (0.257982848259883) | > loss_disc_real_3: 0.22834953665733337 (0.249316212362968) | > loss_disc_real_4: 0.08693760633468628 (0.22869574001584297) | > loss_disc_real_5: 0.16740156710147858 (0.22717396876750848) | > loss_0: 3.251715898513794 (2.5736340192648086) | > grad_norm_0: tensor(2565.6633, device='cuda:0') (tensor(705.4923, device='cuda:0')) | > loss_gen: 1.1807706356048584 (2.2064802035307265) | > loss_kl: 0.6508222818374634 (0.8466358948976566) | > loss_feat: 0.11085812747478485 (4.293036461425706) | > loss_mel: 1.9650049209594727 (19.82203540740869) | > loss_duration: 1.5640512704849243 (1.5489466923933763) | > loss_1: 5.4715070724487305 (28.71713457352076) | > grad_norm_1: tensor(15536.2012, device='cuda:0') (tensor(18580.0332, device='cuda:0')) | > current_lr_0: 0.00013786764277771974 | > current_lr_1: 0.00013786764277771974 | > step_time: 0.5466 (0.5006718635559081) | > loader_time: 0.0227 (0.017621553861177884)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0109310150146484 (3.0109310150146484) | > loss_disc_real_0: 0.2629503905773163 (0.2629503905773163) | > loss_disc_real_1: 0.2807265520095825 (0.2807265520095825) | > loss_disc_real_2: 0.26389846205711365 (0.26389846205711365) | > loss_disc_real_3: 0.2798152267932892 (0.2798152267932892) | > loss_disc_real_4: 0.27578005194664 (0.27578005194664) | > loss_disc_real_5: 0.37514567375183105 (0.37514567375183105) | > loss_0: 3.0109310150146484 (3.0109310150146484) | > loss_gen: 1.7655431032180786 (1.7655431032180786) | > loss_kl: 3.0604450702667236 (3.0604450702667236) | > loss_feat: 0.3998957574367523 (0.3998957574367523) | > loss_mel: 14.595880508422852 (14.595880508422852) | > loss_duration: 2.508633852005005 (2.508633852005005) | > loss_1: 22.330398559570312 (22.330398559570312)  --> STEP: 1 | > loss_disc: 1.8163707256317139 (1.8163707256317139) | > loss_disc_real_0: 0.03570329770445824 (0.03570329770445824) | > loss_disc_real_1: 0.13802924752235413 (0.13802924752235413) | > loss_disc_real_2: 0.2510124444961548 (0.2510124444961548) | > loss_disc_real_3: 0.15642865002155304 (0.15642865002155304) | > loss_disc_real_4: 0.16586413979530334 (0.16586413979530334) | > loss_disc_real_5: 0.04015599191188812 (0.04015599191188812) | > loss_0: 1.8163707256317139 (1.8163707256317139) | > loss_gen: 2.5833890438079834 (2.5833890438079834) | > loss_kl: 3.725646495819092 (3.725646495819092) | > loss_feat: 10.914952278137207 (10.914952278137207) | > loss_mel: 28.517946243286133 (28.517946243286133) | > loss_duration: 2.800091028213501 (2.800091028213501) | > loss_1: 48.54202651977539 (48.54202651977539)  --> STEP: 2 | > loss_disc: 2.5187931060791016 (2.1675819158554077) | > loss_disc_real_0: 0.036624688655138016 (0.036163993179798126) | > loss_disc_real_1: 0.06940621882677078 (0.10371773317456245) | > loss_disc_real_2: 0.11432982981204987 (0.18267113715410233) | > loss_disc_real_3: 0.15963014960289001 (0.15802939981222153) | > loss_disc_real_4: 0.10016187280416489 (0.13301300629973412) | > loss_disc_real_5: 0.18120592832565308 (0.1106809601187706) | > loss_0: 2.5187931060791016 (2.1675819158554077) | > loss_gen: 1.3398852348327637 (1.9616371393203735) | > loss_kl: 3.854520559310913 (3.7900835275650024) | > loss_feat: 8.484793663024902 (9.699872970581055) | > loss_mel: 27.837379455566406 (28.17766284942627) | > loss_duration: 2.6446683406829834 (2.722379684448242) | > loss_1: 44.16124725341797 (46.35163688659668)  --> STEP: 3 | > loss_disc: 3.056537628173828 (2.4639004866282144) | > loss_disc_real_0: 0.24374616146087646 (0.1053580492734909) | > loss_disc_real_1: 0.28816574811935425 (0.16520040482282639) | > loss_disc_real_2: 0.26600751280784607 (0.21044992903868356) | > loss_disc_real_3: 0.28084054589271545 (0.1989664485057195) | > loss_disc_real_4: 0.2634916603565216 (0.17650589098532996) | > loss_disc_real_5: 0.3802039325237274 (0.20052195092042288) | > loss_0: 3.056537628173828 (2.4639004866282144) | > loss_gen: 1.6844956874847412 (1.8692566553751628) | > loss_kl: 1.800138235092163 (3.126768430074056) | > loss_feat: 0.4377058148384094 (6.61248391866684) | > loss_mel: 16.922636032104492 (24.425987243652344) | > loss_duration: 2.6009433269500732 (2.681900898615519) | > loss_1: 23.445919036865234 (38.71639760335287) --> EVAL PERFORMANCE | > avg_loader_time: 0.007462819417317708 (+0.0049746036529541016) | > avg_loss_disc: 2.4639004866282144 (+0.11003263791402151) | > avg_loss_disc_real_0: 0.1053580492734909 (-0.07023006677627563) | > avg_loss_disc_real_1: 0.16520040482282639 (-0.11509501685698825) | > avg_loss_disc_real_2: 0.21044992903868356 (-0.031975398461023985) | > avg_loss_disc_real_3: 0.1989664485057195 (-0.024611731370290102) | > avg_loss_disc_real_4: 0.17650589098532996 (-0.06839582075675327) | > avg_loss_disc_real_5: 0.20052195092042288 (+0.05099160969257355) | > avg_loss_0: 2.4639004866282144 (+0.11003263791402151) | > avg_loss_gen: 1.8692566553751628 (-0.5305512348810832) | > avg_loss_kl: 3.126768430074056 (+0.09862613677978516) | > avg_loss_feat: 6.61248391866684 (+1.5240249435106916) | > avg_loss_mel: 24.425987243652344 (-0.2689952850341797) | > avg_loss_duration: 2.681900898615519 (-0.045664628346761216) | > avg_loss_1: 38.71639760335287 (+0.7774403889973982)  > EPOCH: 373/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:45:05)   --> TIME: 2023-10-20 03:45:17 -- STEP: 19/50 -- GLOBAL_STEP: 71670 | > loss_disc: 2.111194372177124 (2.2304828355186865) | > loss_disc_real_0: 0.05907151848077774 (0.13188233331924207) | > loss_disc_real_1: 0.1411169469356537 (0.20844427045238645) | > loss_disc_real_2: 0.24565009772777557 (0.2029051959122482) | > loss_disc_real_3: 0.23141740262508392 (0.24173327574604436) | > loss_disc_real_4: 0.14443260431289673 (0.2001231921542632) | > loss_disc_real_5: 0.1415775716304779 (0.19089930994730248) | > loss_0: 2.111194372177124 (2.2304828355186865) | > grad_norm_0: tensor(380.4909, device='cuda:0') (tensor(476.0641, device='cuda:0')) | > loss_gen: 2.5526649951934814 (2.6797399018940173) | > loss_kl: 0.9385367035865784 (0.8127043176638452) | > loss_feat: 8.461325645446777 (6.080311227148693) | > loss_mel: 26.073196411132812 (20.028207785204838) | > loss_duration: 1.668594241142273 (1.5743933100449412) | > loss_1: 39.69432067871094 (31.17535696531597) | > grad_norm_1: tensor(25219.8398, device='cuda:0') (tensor(33260.3242, device='cuda:0')) | > current_lr_0: 0.00013772983543695874 | > current_lr_1: 0.00013772983543695874 | > step_time: 0.273 (0.3618927001953125) | > loader_time: 0.0021 (0.008662286557649312)  --> TIME: 2023-10-20 03:45:33 -- STEP: 49/50 -- GLOBAL_STEP: 71700 | > loss_disc: 2.5027782917022705 (2.442050987360428) | > loss_disc_real_0: 0.051488496363162994 (0.14554472430134002) | > loss_disc_real_1: 0.16271962225437164 (0.21327004691928017) | > loss_disc_real_2: 0.1997835338115692 (0.20747234360600003) | > loss_disc_real_3: 0.24568518996238708 (0.23863843691592312) | > loss_disc_real_4: 0.4020407795906067 (0.2287552671088856) | > loss_disc_real_5: 0.2831348180770874 (0.23039330110638118) | > loss_0: 2.5027782917022705 (2.442050987360428) | > grad_norm_0: tensor(1040.1217, device='cuda:0') (tensor(563.1881, device='cuda:0')) | > loss_gen: 2.246816635131836 (2.396368379495581) | > loss_kl: 0.3827192187309265 (0.8295917425836835) | > loss_feat: 4.412398815155029 (5.340968526196572) | > loss_mel: 31.018875122070312 (21.80930906655837) | > loss_duration: 1.7052968740463257 (1.5373999220984322) | > loss_1: 39.7661018371582 (31.91363760889793) | > grad_norm_1: tensor(10165.5791, device='cuda:0') (tensor(23155.8828, device='cuda:0')) | > current_lr_0: 0.00013772983543695874 | > current_lr_1: 0.00013772983543695874 | > step_time: 0.7372 (0.45017398133569836) | > loader_time: 0.4133 (0.018177168709891185)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.378391742706299 (2.378391742706299) | > loss_disc_real_0: 0.09928827732801437 (0.09928827732801437) | > loss_disc_real_1: 0.2509012222290039 (0.2509012222290039) | > loss_disc_real_2: 0.29280176758766174 (0.29280176758766174) | > loss_disc_real_3: 0.24721771478652954 (0.24721771478652954) | > loss_disc_real_4: 0.30944135785102844 (0.30944135785102844) | > loss_disc_real_5: 0.19170136749744415 (0.19170136749744415) | > loss_0: 2.378391742706299 (2.378391742706299) | > loss_gen: 2.2714240550994873 (2.2714240550994873) | > loss_kl: 3.5487220287323 (3.5487220287323) | > loss_feat: 5.510397911071777 (5.510397911071777) | > loss_mel: 23.58833122253418 (23.58833122253418) | > loss_duration: 2.476499080657959 (2.476499080657959) | > loss_1: 37.3953742980957 (37.3953742980957)  --> STEP: 1 | > loss_disc: 3.1465251445770264 (3.1465251445770264) | > loss_disc_real_0: 0.41725775599479675 (0.41725775599479675) | > loss_disc_real_1: 0.31503498554229736 (0.31503498554229736) | > loss_disc_real_2: 0.22555801272392273 (0.22555801272392273) | > loss_disc_real_3: 0.32202693819999695 (0.32202693819999695) | > loss_disc_real_4: 0.33559367060661316 (0.33559367060661316) | > loss_disc_real_5: 0.4058380126953125 (0.4058380126953125) | > loss_0: 3.1465251445770264 (3.1465251445770264) | > loss_gen: 2.2140614986419678 (2.2140614986419678) | > loss_kl: 3.350112199783325 (3.350112199783325) | > loss_feat: 3.9344685077667236 (3.9344685077667236) | > loss_mel: 21.900331497192383 (21.900331497192383) | > loss_duration: 2.74998140335083 (2.74998140335083) | > loss_1: 34.148956298828125 (34.148956298828125)  --> STEP: 2 | > loss_disc: 2.0246214866638184 (2.5855733156204224) | > loss_disc_real_0: 0.1475675106048584 (0.2824126332998276) | > loss_disc_real_1: 0.08795458823442459 (0.20149478688836098) | > loss_disc_real_2: 0.12041036039590836 (0.17298418655991554) | > loss_disc_real_3: 0.13758940994739532 (0.22980817407369614) | > loss_disc_real_4: 0.1201728880405426 (0.22788327932357788) | > loss_disc_real_5: 0.07839144021272659 (0.24211472645401955) | > loss_0: 2.0246214866638184 (2.5855733156204224) | > loss_gen: 2.42867112159729 (2.321366310119629) | > loss_kl: 4.106102466583252 (3.7281073331832886) | > loss_feat: 11.696776390075684 (7.815622448921204) | > loss_mel: 24.698287963867188 (23.299309730529785) | > loss_duration: 2.7097933292388916 (2.729887366294861) | > loss_1: 45.63963317871094 (39.89429473876953)  --> STEP: 3 | > loss_disc: 3.0569920539855957 (2.74271289507548) | > loss_disc_real_0: 0.48568886518478394 (0.3501713772614797) | > loss_disc_real_1: 0.2782203257083893 (0.22706996649503708) | > loss_disc_real_2: 0.2751537561416626 (0.20704070975383124) | > loss_disc_real_3: 0.297712504863739 (0.25244295100371045) | > loss_disc_real_4: 0.2912963032722473 (0.24902095397313437) | > loss_disc_real_5: 0.2771705985069275 (0.2538000171383222) | > loss_0: 3.0569920539855957 (2.74271289507548) | > loss_gen: 1.9498960971832275 (2.197542905807495) | > loss_kl: 2.1115522384643555 (3.189255634943644) | > loss_feat: 0.6547954082489014 (5.4286801020304365) | > loss_mel: 18.381242752075195 (21.659954071044922) | > loss_duration: 2.528541088104248 (2.6627719402313232) | > loss_1: 25.626028060913086 (35.13820584615072) --> EVAL PERFORMANCE | > avg_loader_time: 0.007188081741333008 (-0.00027473767598470023) | > avg_loss_disc: 2.74271289507548 (+0.2788124084472656) | > avg_loss_disc_real_0: 0.3501713772614797 (+0.24481332798798877) | > avg_loss_disc_real_1: 0.22706996649503708 (+0.06186956167221069) | > avg_loss_disc_real_2: 0.20704070975383124 (-0.0034092192848523273) | > avg_loss_disc_real_3: 0.25244295100371045 (+0.053476502497990935) | > avg_loss_disc_real_4: 0.24902095397313437 (+0.07251506298780441) | > avg_loss_disc_real_5: 0.2538000171383222 (+0.053278066217899295) | > avg_loss_0: 2.74271289507548 (+0.2788124084472656) | > avg_loss_gen: 2.197542905807495 (+0.3282862504323323) | > avg_loss_kl: 3.189255634943644 (+0.06248720486958792) | > avg_loss_feat: 5.4286801020304365 (-1.183803816636403) | > avg_loss_mel: 21.659954071044922 (-2.766033172607422) | > avg_loss_duration: 2.6627719402313232 (-0.019128958384195816) | > avg_loss_1: 35.13820584615072 (-3.5781917572021484)  > EPOCH: 374/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:45:41)   --> TIME: 2023-10-20 03:46:00 -- STEP: 29/50 -- GLOBAL_STEP: 71730 | > loss_disc: 2.530916213989258 (2.548216416917999) | > loss_disc_real_0: 0.11386621743440628 (0.18571212813900462) | > loss_disc_real_1: 0.1720687448978424 (0.2579678559097751) | > loss_disc_real_2: 0.24663642048835754 (0.2474547073501965) | > loss_disc_real_3: 0.30681946873664856 (0.26186632641173635) | > loss_disc_real_4: 0.22806626558303833 (0.24196278429108448) | > loss_disc_real_5: 0.29188764095306396 (0.21642767634756607) | > loss_0: 2.530916213989258 (2.548216416917999) | > grad_norm_0: tensor(290.3643, device='cuda:0') (tensor(532.6577, device='cuda:0')) | > loss_gen: 2.2436423301696777 (2.288569976543558) | > loss_kl: 0.7770057320594788 (0.8639485687017441) | > loss_feat: 4.96130895614624 (5.137100398540497) | > loss_mel: 22.849679946899414 (22.28112344084115) | > loss_duration: 1.6139827966690063 (1.5721420748480435) | > loss_1: 32.44561767578125 (32.142884238012904) | > grad_norm_1: tensor(8197.4561, device='cuda:0') (tensor(9723.7959, device='cuda:0')) | > current_lr_0: 0.00013759216584326286 | > current_lr_1: 0.00013759216584326286 | > step_time: 0.5663 (0.5017608609692803) | > loader_time: 0.025 (0.020205045568531955)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9018452167510986 (2.9018452167510986) | > loss_disc_real_0: 0.3000859320163727 (0.3000859320163727) | > loss_disc_real_1: 0.3311081826686859 (0.3311081826686859) | > loss_disc_real_2: 0.19984859228134155 (0.19984859228134155) | > loss_disc_real_3: 0.2840588688850403 (0.2840588688850403) | > loss_disc_real_4: 0.2975403368473053 (0.2975403368473053) | > loss_disc_real_5: 0.2253814935684204 (0.2253814935684204) | > loss_0: 2.9018452167510986 (2.9018452167510986) | > loss_gen: 1.9359486103057861 (1.9359486103057861) | > loss_kl: 2.6961588859558105 (2.6961588859558105) | > loss_feat: 2.6521246433258057 (2.6521246433258057) | > loss_mel: 24.820341110229492 (24.820341110229492) | > loss_duration: 2.4149417877197266 (2.4149417877197266) | > loss_1: 34.51951599121094 (34.51951599121094)  --> STEP: 1 | > loss_disc: 2.8535590171813965 (2.8535590171813965) | > loss_disc_real_0: 0.2531623840332031 (0.2531623840332031) | > loss_disc_real_1: 0.37899190187454224 (0.37899190187454224) | > loss_disc_real_2: 0.21432258188724518 (0.21432258188724518) | > loss_disc_real_3: 0.2423337697982788 (0.2423337697982788) | > loss_disc_real_4: 0.40124672651290894 (0.40124672651290894) | > loss_disc_real_5: 0.384732186794281 (0.384732186794281) | > loss_0: 2.8535590171813965 (2.8535590171813965) | > loss_gen: 2.4670791625976562 (2.4670791625976562) | > loss_kl: 3.679689884185791 (3.679689884185791) | > loss_feat: 6.274669170379639 (6.274669170379639) | > loss_mel: 24.452655792236328 (24.452655792236328) | > loss_duration: 2.6284265518188477 (2.6284265518188477) | > loss_1: 39.50251770019531 (39.50251770019531)  --> STEP: 2 | > loss_disc: 2.6114516258239746 (2.7325053215026855) | > loss_disc_real_0: 0.1679254174232483 (0.2105439007282257) | > loss_disc_real_1: 0.20884010195732117 (0.2939160019159317) | > loss_disc_real_2: 0.3518209159374237 (0.28307174891233444) | > loss_disc_real_3: 0.21497422456741333 (0.22865399718284607) | > loss_disc_real_4: 0.18330006301403046 (0.2922733947634697) | > loss_disc_real_5: 0.18190717697143555 (0.2833196818828583) | > loss_0: 2.6114516258239746 (2.7325053215026855) | > loss_gen: 1.8046497106552124 (2.1358644366264343) | > loss_kl: 4.100109577178955 (3.889899730682373) | > loss_feat: 3.1725070476531982 (4.7235881090164185) | > loss_mel: 28.717803955078125 (26.585229873657227) | > loss_duration: 2.6058123111724854 (2.6171194314956665) | > loss_1: 40.400882720947266 (39.95170021057129)  --> STEP: 3 | > loss_disc: 2.6271255016326904 (2.697378714879354) | > loss_disc_real_0: 0.36013251543045044 (0.26040677229563397) | > loss_disc_real_1: 0.4502863585948944 (0.3460394541422526) | > loss_disc_real_2: 0.23634479939937592 (0.2674960990746816) | > loss_disc_real_3: 0.2995621860027313 (0.2522900601228078) | > loss_disc_real_4: 0.2844831645488739 (0.28967665135860443) | > loss_disc_real_5: 0.2290412336587906 (0.26522686580816907) | > loss_0: 2.6271255016326904 (2.697378714879354) | > loss_gen: 3.225602388381958 (2.4991104205449424) | > loss_kl: 1.7145155668258667 (3.1647716760635376) | > loss_feat: 4.9937744140625 (4.813650210698445) | > loss_mel: 22.519855499267578 (25.23010508219401) | > loss_duration: 2.4602901935577393 (2.564843018849691) | > loss_1: 34.91403579711914 (38.27247873942057) --> EVAL PERFORMANCE | > avg_loader_time: 0.004422346750895183 (-0.0027657349904378252) | > avg_loss_disc: 2.697378714879354 (-0.045334180196126006) | > avg_loss_disc_real_0: 0.26040677229563397 (-0.0897646049658457) | > avg_loss_disc_real_1: 0.3460394541422526 (+0.11896948764721554) | > avg_loss_disc_real_2: 0.2674960990746816 (+0.060455389320850345) | > avg_loss_disc_real_3: 0.2522900601228078 (-0.00015289088090264524) | > avg_loss_disc_real_4: 0.28967665135860443 (+0.04065569738547006) | > avg_loss_disc_real_5: 0.26522686580816907 (+0.01142684866984689) | > avg_loss_0: 2.697378714879354 (-0.045334180196126006) | > avg_loss_gen: 2.4991104205449424 (+0.30156751473744725) | > avg_loss_kl: 3.1647716760635376 (-0.02448395888010646) | > avg_loss_feat: 4.813650210698445 (-0.6150298913319912) | > avg_loss_mel: 25.23010508219401 (+3.5701510111490897) | > avg_loss_duration: 2.564843018849691 (-0.09792892138163234) | > avg_loss_1: 38.27247873942057 (+3.134272893269852)  > EPOCH: 375/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:46:21)   --> TIME: 2023-10-20 03:46:31 -- STEP: 9/50 -- GLOBAL_STEP: 71760 | > loss_disc: 1.910033941268921 (2.5372247563468084) | > loss_disc_real_0: 0.2125663012266159 (0.13649934178425205) | > loss_disc_real_1: 0.21172365546226501 (0.21038397236002815) | > loss_disc_real_2: 0.13935615122318268 (0.25009695771667695) | > loss_disc_real_3: 0.13261525332927704 (0.23225018133719763) | > loss_disc_real_4: 0.08035889267921448 (0.21735205915239122) | > loss_disc_real_5: 0.10919933021068573 (0.21328777902656132) | > loss_0: 1.910033941268921 (2.5372247563468084) | > grad_norm_0: tensor(359.2242, device='cuda:0') (tensor(467.2388, device='cuda:0')) | > loss_gen: 2.7069928646087646 (2.1914594570795694) | > loss_kl: 0.82899010181427 (1.0242404606607225) | > loss_feat: 6.400994300842285 (4.889079206519657) | > loss_mel: 23.36271095275879 (21.93047873179118) | > loss_duration: 1.5293656587600708 (1.5590142144097223) | > loss_1: 34.82905197143555 (31.594272083706326) | > grad_norm_1: tensor(4222.9072, device='cuda:0') (tensor(20109.2520, device='cuda:0')) | > current_lr_0: 0.00013745463385894533 | > current_lr_1: 0.00013745463385894533 | > step_time: 0.4521 (0.2957927915785048) | > loader_time: 0.0026 (0.004876825544569228)  --> TIME: 2023-10-20 03:46:47 -- STEP: 39/50 -- GLOBAL_STEP: 71790 | > loss_disc: 2.9900670051574707 (2.457404818290319) | > loss_disc_real_0: 0.11023998260498047 (0.1389893775758071) | > loss_disc_real_1: 0.2765757143497467 (0.2192052129942637) | > loss_disc_real_2: 0.27058470249176025 (0.22948701001512697) | > loss_disc_real_3: 0.2583152949810028 (0.23912375210187373) | > loss_disc_real_4: 0.27793946862220764 (0.22093196175037286) | > loss_disc_real_5: 0.27580347657203674 (0.23705227042619997) | > loss_0: 2.9900670051574707 (2.457404818290319) | > grad_norm_0: tensor(1431.6980, device='cuda:0') (tensor(547.3180, device='cuda:0')) | > loss_gen: 1.492719292640686 (2.3865272907110358) | > loss_kl: 0.6268659830093384 (0.9445476428820533) | > loss_feat: 0.29374760389328003 (5.145263678752459) | > loss_mel: 10.291529655456543 (21.09583683197315) | > loss_duration: 1.591439127922058 (1.5509004623461993) | > loss_1: 14.29630184173584 (31.123075998746437) | > grad_norm_1: tensor(15092.3643, device='cuda:0') (tensor(20965.5684, device='cuda:0')) | > current_lr_0: 0.00013745463385894533 | > current_lr_1: 0.00013745463385894533 | > step_time: 0.6013 (0.46535508449261004) | > loader_time: 0.0251 (0.015982829607450046)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3225672245025635 (2.3225672245025635) | > loss_disc_real_0: 0.2547215223312378 (0.2547215223312378) | > loss_disc_real_1: 0.1927201747894287 (0.1927201747894287) | > loss_disc_real_2: 0.2481410950422287 (0.2481410950422287) | > loss_disc_real_3: 0.29269298911094666 (0.29269298911094666) | > loss_disc_real_4: 0.14355015754699707 (0.14355015754699707) | > loss_disc_real_5: 0.032513249665498734 (0.032513249665498734) | > loss_0: 2.3225672245025635 (2.3225672245025635) | > loss_gen: 2.5016603469848633 (2.5016603469848633) | > loss_kl: 3.221930980682373 (3.221930980682373) | > loss_feat: 6.530517578125 (6.530517578125) | > loss_mel: 20.07718849182129 (20.07718849182129) | > loss_duration: 2.40260648727417 (2.40260648727417) | > loss_1: 34.73390579223633 (34.73390579223633)  --> STEP: 1 | > loss_disc: 3.026455879211426 (3.026455879211426) | > loss_disc_real_0: 0.616193413734436 (0.616193413734436) | > loss_disc_real_1: 0.21666763722896576 (0.21666763722896576) | > loss_disc_real_2: 0.3066547214984894 (0.3066547214984894) | > loss_disc_real_3: 0.30547863245010376 (0.30547863245010376) | > loss_disc_real_4: 0.3428979218006134 (0.3428979218006134) | > loss_disc_real_5: 0.26079675555229187 (0.26079675555229187) | > loss_0: 3.026455879211426 (3.026455879211426) | > loss_gen: 2.677445888519287 (2.677445888519287) | > loss_kl: 3.88303542137146 (3.88303542137146) | > loss_feat: 3.216747522354126 (3.216747522354126) | > loss_mel: 22.907773971557617 (22.907773971557617) | > loss_duration: 2.686995267868042 (2.686995267868042) | > loss_1: 35.37199783325195 (35.37199783325195)  --> STEP: 2 | > loss_disc: 1.878566861152649 (2.4525113701820374) | > loss_disc_real_0: 0.14545083045959473 (0.3808221220970154) | > loss_disc_real_1: 0.11940691620111465 (0.1680372767150402) | > loss_disc_real_2: 0.16868442296981812 (0.23766957223415375) | > loss_disc_real_3: 0.19039960205554962 (0.2479391172528267) | > loss_disc_real_4: 0.12911038100719452 (0.23600415140390396) | > loss_disc_real_5: 0.16176101565361023 (0.21127888560295105) | > loss_0: 1.878566861152649 (2.4525113701820374) | > loss_gen: 2.536076545715332 (2.6067612171173096) | > loss_kl: 3.9810903072357178 (3.932062864303589) | > loss_feat: 10.151257514953613 (6.68400251865387) | > loss_mel: 26.31583595275879 (24.611804962158203) | > loss_duration: 2.555872678756714 (2.621433973312378) | > loss_1: 45.54013442993164 (40.4560661315918)  --> STEP: 3 | > loss_disc: 3.215196132659912 (2.706739624341329) | > loss_disc_real_0: 0.7199450135231018 (0.4938630859057109) | > loss_disc_real_1: 0.26122066378593445 (0.19909840573867163) | > loss_disc_real_2: 0.2914733290672302 (0.25560415784517926) | > loss_disc_real_3: 0.2849760353565216 (0.260284756620725) | > loss_disc_real_4: 0.32043561339378357 (0.26414797206719715) | > loss_disc_real_5: 0.228953018784523 (0.2171702633301417) | > loss_0: 3.215196132659912 (2.706739624341329) | > loss_gen: 2.1441876888275146 (2.4525700410207114) | > loss_kl: 2.1698343753814697 (3.344653367996216) | > loss_feat: 0.26294538378715515 (4.5436501403649645) | > loss_mel: 3.286304235458374 (17.503304719924927) | > loss_duration: 2.4728739261627197 (2.571913957595825) | > loss_1: 10.336145401000977 (30.41609255472819) --> EVAL PERFORMANCE | > avg_loader_time: 0.011251211166381836 (+0.006828864415486653) | > avg_loss_disc: 2.706739624341329 (+0.009360909461975098) | > avg_loss_disc_real_0: 0.4938630859057109 (+0.2334563136100769) | > avg_loss_disc_real_1: 0.19909840573867163 (-0.146941048403581) | > avg_loss_disc_real_2: 0.25560415784517926 (-0.011891941229502323) | > avg_loss_disc_real_3: 0.260284756620725 (+0.007994696497917175) | > avg_loss_disc_real_4: 0.26414797206719715 (-0.025528679291407286) | > avg_loss_disc_real_5: 0.2171702633301417 (-0.04805660247802737) | > avg_loss_0: 2.706739624341329 (+0.009360909461975098) | > avg_loss_gen: 2.4525700410207114 (-0.04654037952423096) | > avg_loss_kl: 3.344653367996216 (+0.17988169193267822) | > avg_loss_feat: 4.5436501403649645 (-0.27000007033348083) | > avg_loss_mel: 17.503304719924927 (-7.726800362269085) | > avg_loss_duration: 2.571913957595825 (+0.007070938746134292) | > avg_loss_1: 30.41609255472819 (-7.856386184692379)  > EPOCH: 376/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:47:06)   --> TIME: 2023-10-20 03:47:18 -- STEP: 19/50 -- GLOBAL_STEP: 71820 | > loss_disc: 1.948096752166748 (2.443096305194654) | > loss_disc_real_0: 0.09262680262327194 (0.19019041543728427) | > loss_disc_real_1: 0.13336212933063507 (0.2232268093840072) | > loss_disc_real_2: 0.1860516518354416 (0.23728581596361964) | > loss_disc_real_3: 0.19321823120117188 (0.2338762200976673) | > loss_disc_real_4: 0.19486497342586517 (0.2336223525436301) | > loss_disc_real_5: 0.18838132917881012 (0.2121447126724218) | > loss_0: 1.948096752166748 (2.443096305194654) | > grad_norm_0: tensor(300.7437, device='cuda:0') (tensor(472.5375, device='cuda:0')) | > loss_gen: 2.405818462371826 (2.4085932091662756) | > loss_kl: 0.5216057896614075 (0.8931930802370373) | > loss_feat: 5.131244659423828 (5.0206286993465925) | > loss_mel: 24.57317352294922 (19.25386697367618) | > loss_duration: 1.6433523893356323 (1.6124344813196283) | > loss_1: 34.27519607543945 (29.188716411590576) | > grad_norm_1: tensor(5149.2881, device='cuda:0') (tensor(26613.7129, device='cuda:0')) | > current_lr_0: 0.0001373172393464569 | > current_lr_1: 0.0001373172393464569 | > step_time: 0.2616 (0.36901541760093287) | > loader_time: 0.0018 (0.008263500113236276)  --> TIME: 2023-10-20 03:47:33 -- STEP: 49/50 -- GLOBAL_STEP: 71850 | > loss_disc: 1.2091811895370483 (2.3344778260406183) | > loss_disc_real_0: 0.09143244475126266 (0.1560066836144851) | > loss_disc_real_1: 0.06838111579418182 (0.2195694010552703) | > loss_disc_real_2: 0.02375354804098606 (0.22163288428315095) | > loss_disc_real_3: 0.08687371015548706 (0.23779417266499023) | > loss_disc_real_4: 0.0778404027223587 (0.22712774255446025) | > loss_disc_real_5: 0.03509782627224922 (0.20001867435378384) | > loss_0: 1.2091811895370483 (2.3344778260406183) | > grad_norm_0: tensor(628.1719, device='cuda:0') (tensor(555.4245, device='cuda:0')) | > loss_gen: 2.937082290649414 (2.5091557502746578) | > loss_kl: 0.6691060662269592 (0.8188229793188523) | > loss_feat: 9.430882453918457 (5.690548899222392) | > loss_mel: 24.600305557250977 (21.349913237046227) | > loss_duration: 1.6594717502593994 (1.5563066005706787) | > loss_1: 39.29684829711914 (31.92474753516061) | > grad_norm_1: tensor(24254.5781, device='cuda:0') (tensor(24161.7871, device='cuda:0')) | > current_lr_0: 0.0001373172393464569 | > current_lr_1: 0.0001373172393464569 | > step_time: 0.4128 (0.43603550171365535) | > loader_time: 0.3876 (0.016709332563439195)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.386657238006592 (2.386657238006592) | > loss_disc_real_0: 0.3008701801300049 (0.3008701801300049) | > loss_disc_real_1: 0.2882174551486969 (0.2882174551486969) | > loss_disc_real_2: 0.3227427005767822 (0.3227427005767822) | > loss_disc_real_3: 0.17679624259471893 (0.17679624259471893) | > loss_disc_real_4: 0.20605359971523285 (0.20605359971523285) | > loss_disc_real_5: 0.35841867327690125 (0.35841867327690125) | > loss_0: 2.386657238006592 (2.386657238006592) | > loss_gen: 3.699223041534424 (3.699223041534424) | > loss_kl: 2.6158037185668945 (2.6158037185668945) | > loss_feat: 6.618412494659424 (6.618412494659424) | > loss_mel: 26.307907104492188 (26.307907104492188) | > loss_duration: 2.3794240951538086 (2.3794240951538086) | > loss_1: 41.62076950073242 (41.62076950073242)  --> STEP: 1 | > loss_disc: 2.542551040649414 (2.542551040649414) | > loss_disc_real_0: 0.2026272565126419 (0.2026272565126419) | > loss_disc_real_1: 0.21014364063739777 (0.21014364063739777) | > loss_disc_real_2: 0.31495386362075806 (0.31495386362075806) | > loss_disc_real_3: 0.22184453904628754 (0.22184453904628754) | > loss_disc_real_4: 0.32589420676231384 (0.32589420676231384) | > loss_disc_real_5: 0.408066064119339 (0.408066064119339) | > loss_0: 2.542551040649414 (2.542551040649414) | > loss_gen: 2.9114043712615967 (2.9114043712615967) | > loss_kl: 3.776439666748047 (3.776439666748047) | > loss_feat: 6.485117435455322 (6.485117435455322) | > loss_mel: 25.60674285888672 (25.60674285888672) | > loss_duration: 2.8171048164367676 (2.8171048164367676) | > loss_1: 41.59680938720703 (41.59680938720703)  --> STEP: 2 | > loss_disc: 2.033456802368164 (2.288003921508789) | > loss_disc_real_0: 0.12757962942123413 (0.16510344296693802) | > loss_disc_real_1: 0.19987133145332336 (0.20500748604536057) | > loss_disc_real_2: 0.1222427561879158 (0.21859830990433693) | > loss_disc_real_3: 0.20612213015556335 (0.21398333460092545) | > loss_disc_real_4: 0.10700847208499908 (0.21645133942365646) | > loss_disc_real_5: 0.18504053354263306 (0.296553298830986) | > loss_0: 2.033456802368164 (2.288003921508789) | > loss_gen: 2.5776658058166504 (2.7445350885391235) | > loss_kl: 3.521289587020874 (3.6488646268844604) | > loss_feat: 9.687944412231445 (8.086530923843384) | > loss_mel: 25.747774124145508 (25.677258491516113) | > loss_duration: 2.6758718490600586 (2.746488332748413) | > loss_1: 44.210548400878906 (42.90367889404297)  --> STEP: 3 | > loss_disc: 2.8027231693267822 (2.4595770041147866) | > loss_disc_real_0: 0.22329847514629364 (0.18450178702672324) | > loss_disc_real_1: 0.25370916724205017 (0.22124137977759042) | > loss_disc_real_2: 0.25709953904151917 (0.23143205295006433) | > loss_disc_real_3: 0.2426564246416092 (0.22354103128115335) | > loss_disc_real_4: 0.3605107069015503 (0.2644711285829544) | > loss_disc_real_5: 0.3456694185733795 (0.3129253387451172) | > loss_0: 2.8027231693267822 (2.4595770041147866) | > loss_gen: 2.071932077407837 (2.520334084828695) | > loss_kl: 1.8367160558700562 (3.044815103212992) | > loss_feat: 1.0859367847442627 (5.752999544143677) | > loss_mel: 17.461009979248047 (22.938508987426758) | > loss_duration: 2.5031228065490723 (2.6653664906819663) | > loss_1: 24.958717346191406 (36.92202504475912) --> EVAL PERFORMANCE | > avg_loader_time: 0.002958536148071289 (-0.008292675018310547) | > avg_loss_disc: 2.4595770041147866 (-0.24716262022654245) | > avg_loss_disc_real_0: 0.18450178702672324 (-0.30936129887898767) | > avg_loss_disc_real_1: 0.22124137977759042 (+0.022142974038918795) | > avg_loss_disc_real_2: 0.23143205295006433 (-0.024172104895114926) | > avg_loss_disc_real_3: 0.22354103128115335 (-0.036743725339571626) | > avg_loss_disc_real_4: 0.2644711285829544 (+0.00032315651575726134) | > avg_loss_disc_real_5: 0.3129253387451172 (+0.0957550754149755) | > avg_loss_0: 2.4595770041147866 (-0.24716262022654245) | > avg_loss_gen: 2.520334084828695 (+0.0677640438079834) | > avg_loss_kl: 3.044815103212992 (-0.2998382647832236) | > avg_loss_feat: 5.752999544143677 (+1.2093494037787123) | > avg_loss_mel: 22.938508987426758 (+5.435204267501831) | > avg_loss_duration: 2.6653664906819663 (+0.0934525330861411) | > avg_loss_1: 36.92202504475912 (+6.505932490030926)  > EPOCH: 377/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:47:42)   --> TIME: 2023-10-20 03:48:02 -- STEP: 29/50 -- GLOBAL_STEP: 71880 | > loss_disc: 2.5009708404541016 (2.342603218966517) | > loss_disc_real_0: 0.21614700555801392 (0.13853763034246092) | > loss_disc_real_1: 0.18759885430335999 (0.2384592137973884) | > loss_disc_real_2: 0.17956070601940155 (0.2235868181391009) | > loss_disc_real_3: 0.19749407470226288 (0.22866940061593877) | > loss_disc_real_4: 0.45300114154815674 (0.2104207256744648) | > loss_disc_real_5: 0.6729872226715088 (0.21193870086351346) | > loss_0: 2.5009708404541016 (2.342603218966517) | > grad_norm_0: tensor(549.2638, device='cuda:0') (tensor(556.3764, device='cuda:0')) | > loss_gen: 3.6240172386169434 (2.703060326905086) | > loss_kl: 0.7983693480491638 (0.9248645675593409) | > loss_feat: 6.10580587387085 (6.534110713364749) | > loss_mel: 23.44134521484375 (24.471504499172344) | > loss_duration: 1.4766987562179565 (1.5742774215237847) | > loss_1: 35.44623565673828 (36.20781789976975) | > grad_norm_1: tensor(20923.6406, device='cuda:0') (tensor(30130.2656, device='cuda:0')) | > current_lr_0: 0.00013717998216838592 | > current_lr_1: 0.00013717998216838592 | > step_time: 0.2935 (0.5035313162310371) | > loader_time: 0.0252 (0.02003676315833782)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.32657790184021 (2.32657790184021) | > loss_disc_real_0: 0.06252060830593109 (0.06252060830593109) | > loss_disc_real_1: 0.13030719757080078 (0.13030719757080078) | > loss_disc_real_2: 0.08317910134792328 (0.08317910134792328) | > loss_disc_real_3: 0.04737840220332146 (0.04737840220332146) | > loss_disc_real_4: 0.1513783186674118 (0.1513783186674118) | > loss_disc_real_5: 0.06467166543006897 (0.06467166543006897) | > loss_0: 2.32657790184021 (2.32657790184021) | > loss_gen: 1.8656690120697021 (1.8656690120697021) | > loss_kl: 3.1135873794555664 (3.1135873794555664) | > loss_feat: 11.118002891540527 (11.118002891540527) | > loss_mel: 28.616989135742188 (28.616989135742188) | > loss_duration: 2.4732134342193604 (2.4732134342193604) | > loss_1: 47.187461853027344 (47.187461853027344)  --> STEP: 1 | > loss_disc: 3.2102856636047363 (3.2102856636047363) | > loss_disc_real_0: 0.19429612159729004 (0.19429612159729004) | > loss_disc_real_1: 0.27748945355415344 (0.27748945355415344) | > loss_disc_real_2: 0.34384268522262573 (0.34384268522262573) | > loss_disc_real_3: 0.4042842388153076 (0.4042842388153076) | > loss_disc_real_4: 0.3636126220226288 (0.3636126220226288) | > loss_disc_real_5: 0.298448383808136 (0.298448383808136) | > loss_0: 3.2102856636047363 (3.2102856636047363) | > loss_gen: 1.8296301364898682 (1.8296301364898682) | > loss_kl: 3.814690113067627 (3.814690113067627) | > loss_feat: 2.5823445320129395 (2.5823445320129395) | > loss_mel: 22.419086456298828 (22.419086456298828) | > loss_duration: 2.703855037689209 (2.703855037689209) | > loss_1: 33.349605560302734 (33.349605560302734)  --> STEP: 2 | > loss_disc: 2.5592682361602783 (2.8847769498825073) | > loss_disc_real_0: 0.128448486328125 (0.16137230396270752) | > loss_disc_real_1: 0.1505400687456131 (0.21401476114988327) | > loss_disc_real_2: 0.1287783831357956 (0.23631053417921066) | > loss_disc_real_3: 0.11365066468715668 (0.25896745175123215) | > loss_disc_real_4: 0.08341958373785019 (0.2235161028802395) | > loss_disc_real_5: 0.022912219166755676 (0.16068030148744583) | > loss_0: 2.5592682361602783 (2.8847769498825073) | > loss_gen: 1.8264617919921875 (1.8280459642410278) | > loss_kl: 3.9878063201904297 (3.9012482166290283) | > loss_feat: 11.674498558044434 (7.1284215450286865) | > loss_mel: 25.218372344970703 (23.818729400634766) | > loss_duration: 2.5633907318115234 (2.633622884750366) | > loss_1: 45.270530700683594 (39.310068130493164)  --> STEP: 3 | > loss_disc: 2.7084298133850098 (2.8259945710500083) | > loss_disc_real_0: 0.0763433575630188 (0.13302932182947794) | > loss_disc_real_1: 0.2974005341529846 (0.2418100188175837) | > loss_disc_real_2: 0.27541583776474 (0.24934563537438711) | > loss_disc_real_3: 0.3026573359966278 (0.2735307464996974) | > loss_disc_real_4: 0.2914336621761322 (0.24615528931220373) | > loss_disc_real_5: 0.24176298081874847 (0.18770786126454672) | > loss_0: 2.7084298133850098 (2.8259945710500083) | > loss_gen: 2.116476535797119 (1.9241894880930583) | > loss_kl: 1.4534708261489868 (3.0853224198023477) | > loss_feat: 4.104712009429932 (6.1205183664957685) | > loss_mel: 26.138906478881836 (24.592121760050457) | > loss_duration: 2.6038289070129395 (2.6236915588378906) | > loss_1: 36.417396545410156 (38.34584426879883) --> EVAL PERFORMANCE | > avg_loader_time: 0.021577994028727215 (+0.018619457880655926) | > avg_loss_disc: 2.8259945710500083 (+0.36641756693522165) | > avg_loss_disc_real_0: 0.13302932182947794 (-0.0514724651972453) | > avg_loss_disc_real_1: 0.2418100188175837 (+0.020568639039993286) | > avg_loss_disc_real_2: 0.24934563537438711 (+0.017913582424322783) | > avg_loss_disc_real_3: 0.2735307464996974 (+0.049989715218544034) | > avg_loss_disc_real_4: 0.24615528931220373 (-0.018315839270750672) | > avg_loss_disc_real_5: 0.18770786126454672 (-0.12521747748057047) | > avg_loss_0: 2.8259945710500083 (+0.36641756693522165) | > avg_loss_gen: 1.9241894880930583 (-0.5961445967356365) | > avg_loss_kl: 3.0853224198023477 (+0.04050731658935547) | > avg_loss_feat: 6.1205183664957685 (+0.36751882235209177) | > avg_loss_mel: 24.592121760050457 (+1.653612772623699) | > avg_loss_duration: 2.6236915588378906 (-0.04167493184407567) | > avg_loss_1: 38.34584426879883 (+1.4238192240397112)  > EPOCH: 378/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:48:23)   --> TIME: 2023-10-20 03:48:32 -- STEP: 9/50 -- GLOBAL_STEP: 71910 | > loss_disc: 2.6500961780548096 (2.6926217873891196) | > loss_disc_real_0: 0.06984902173280716 (0.19515212376912436) | > loss_disc_real_1: 0.24100081622600555 (0.26513876517613727) | > loss_disc_real_2: 0.18258386850357056 (0.2924750679069095) | > loss_disc_real_3: 0.30102670192718506 (0.3288107079764207) | > loss_disc_real_4: 0.2514441907405853 (0.28378954115841126) | > loss_disc_real_5: 0.22668704390525818 (0.24785740342405108) | > loss_0: 2.6500961780548096 (2.6926217873891196) | > grad_norm_0: tensor(1344.7515, device='cuda:0') (tensor(697.2116, device='cuda:0')) | > loss_gen: 1.6495940685272217 (2.570515407456292) | > loss_kl: 0.6966698169708252 (0.9186114362544484) | > loss_feat: 1.6096001863479614 (5.662956255177657) | > loss_mel: 19.522897720336914 (21.32072917620341) | > loss_duration: 1.4818040132522583 (1.5480188263787165) | > loss_1: 24.9605655670166 (32.02083179685805) | > grad_norm_1: tensor(13382.2217, device='cuda:0') (tensor(31717.0137, device='cuda:0')) | > current_lr_0: 0.00013704286218745796 | > current_lr_1: 0.00013704286218745796 | > step_time: 0.5926 (0.5303715599907769) | > loader_time: 0.0121 (0.015661901897854276)  --> TIME: 2023-10-20 03:48:48 -- STEP: 39/50 -- GLOBAL_STEP: 71940 | > loss_disc: 2.740079879760742 (2.6611115443400846) | > loss_disc_real_0: 0.16406512260437012 (0.1673083662127073) | > loss_disc_real_1: 0.2747832238674164 (0.24909326491447595) | > loss_disc_real_2: 0.26725879311561584 (0.25702794870504964) | > loss_disc_real_3: 0.14683477580547333 (0.25321702229288906) | > loss_disc_real_4: 0.22959639132022858 (0.25576613289423483) | > loss_disc_real_5: 0.13602609932422638 (0.24108116710797325) | > loss_0: 2.740079879760742 (2.6611115443400846) | > grad_norm_0: tensor(1416.6851, device='cuda:0') (tensor(1147.1527, device='cuda:0')) | > loss_gen: 1.6968172788619995 (2.26418336538168) | > loss_kl: 0.41492024064064026 (0.8879278659438475) | > loss_feat: 3.2797930240631104 (4.6319378316402435) | > loss_mel: 21.55194854736328 (21.305716942518185) | > loss_duration: 1.5873098373413086 (1.534028838842343) | > loss_1: 28.53078842163086 (30.623795056954407) | > grad_norm_1: tensor(39894.7031, device='cuda:0') (tensor(39766.2070, device='cuda:0')) | > current_lr_0: 0.00013704286218745796 | > current_lr_1: 0.00013704286218745796 | > step_time: 0.5437 (0.5001838696308625) | > loader_time: 0.0238 (0.017710166099743966)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.11605167388916 (3.11605167388916) | > loss_disc_real_0: 0.10713312774896622 (0.10713312774896622) | > loss_disc_real_1: 0.10341546684503555 (0.10341546684503555) | > loss_disc_real_2: 0.31379884481430054 (0.31379884481430054) | > loss_disc_real_3: 0.33540984988212585 (0.33540984988212585) | > loss_disc_real_4: 0.37655749917030334 (0.37655749917030334) | > loss_disc_real_5: 0.2502746880054474 (0.2502746880054474) | > loss_0: 3.11605167388916 (3.11605167388916) | > loss_gen: 1.571016788482666 (1.571016788482666) | > loss_kl: 3.4985852241516113 (3.4985852241516113) | > loss_feat: 6.449357032775879 (6.449357032775879) | > loss_mel: 25.98545265197754 (25.98545265197754) | > loss_duration: 2.491217851638794 (2.491217851638794) | > loss_1: 39.99563217163086 (39.99563217163086)  --> STEP: 1 | > loss_disc: 2.6014983654022217 (2.6014983654022217) | > loss_disc_real_0: 0.29278266429901123 (0.29278266429901123) | > loss_disc_real_1: 0.2559920847415924 (0.2559920847415924) | > loss_disc_real_2: 0.23991486430168152 (0.23991486430168152) | > loss_disc_real_3: 0.221640944480896 (0.221640944480896) | > loss_disc_real_4: 0.2986888885498047 (0.2986888885498047) | > loss_disc_real_5: 0.3227933943271637 (0.3227933943271637) | > loss_0: 2.6014983654022217 (2.6014983654022217) | > loss_gen: 2.529857873916626 (2.529857873916626) | > loss_kl: 3.5838189125061035 (3.5838189125061035) | > loss_feat: 3.5422911643981934 (3.5422911643981934) | > loss_mel: 21.97215461730957 (21.97215461730957) | > loss_duration: 2.7189342975616455 (2.7189342975616455) | > loss_1: 34.3470573425293 (34.3470573425293)  --> STEP: 2 | > loss_disc: 2.5840606689453125 (2.592779517173767) | > loss_disc_real_0: 0.2653254270553589 (0.27905404567718506) | > loss_disc_real_1: 0.1826348900794983 (0.21931348741054535) | > loss_disc_real_2: 0.22089532017707825 (0.23040509223937988) | > loss_disc_real_3: 0.24513201415538788 (0.23338647931814194) | > loss_disc_real_4: 0.16382578015327454 (0.2312573343515396) | > loss_disc_real_5: 0.17235217988491058 (0.24757278710603714) | > loss_0: 2.5840606689453125 (2.592779517173767) | > loss_gen: 2.0869712829589844 (2.308414578437805) | > loss_kl: 3.7003700733184814 (3.6420944929122925) | > loss_feat: 7.42701530456543 (5.4846532344818115) | > loss_mel: 27.858217239379883 (24.915185928344727) | > loss_duration: 2.7142841815948486 (2.716609239578247) | > loss_1: 43.78685760498047 (39.06695747375488)  --> STEP: 3 | > loss_disc: 2.5073585510253906 (2.564305861790975) | > loss_disc_real_0: 0.36676520109176636 (0.3082910974820455) | > loss_disc_real_1: 0.25511273741722107 (0.2312465707461039) | > loss_disc_real_2: 0.2578260004520416 (0.2395453949769338) | > loss_disc_real_3: 0.23558776080608368 (0.23412023981412253) | > loss_disc_real_4: 0.14479827880859375 (0.20243764917055765) | > loss_disc_real_5: 0.33427879214286804 (0.2764747887849808) | > loss_0: 2.5073585510253906 (2.564305861790975) | > loss_gen: 2.631150960922241 (2.4159933725992837) | > loss_kl: 1.945556402206421 (3.0765817960103354) | > loss_feat: 4.522455215454102 (5.163920561472575) | > loss_mel: 26.347122192382812 (25.392498016357422) | > loss_duration: 2.569058895111084 (2.667425791422526) | > loss_1: 38.01533889770508 (38.716417948404946) --> EVAL PERFORMANCE | > avg_loader_time: 0.005876064300537109 (-0.015701929728190105) | > avg_loss_disc: 2.564305861790975 (-0.2616887092590332) | > avg_loss_disc_real_0: 0.3082910974820455 (+0.17526177565256754) | > avg_loss_disc_real_1: 0.2312465707461039 (-0.010563448071479797) | > avg_loss_disc_real_2: 0.2395453949769338 (-0.009800240397453308) | > avg_loss_disc_real_3: 0.23412023981412253 (-0.03941050668557486) | > avg_loss_disc_real_4: 0.20243764917055765 (-0.043717640141646086) | > avg_loss_disc_real_5: 0.2764747887849808 (+0.08876692752043405) | > avg_loss_0: 2.564305861790975 (-0.2616887092590332) | > avg_loss_gen: 2.4159933725992837 (+0.49180388450622536) | > avg_loss_kl: 3.0765817960103354 (-0.008740623792012236) | > avg_loss_feat: 5.163920561472575 (-0.9565978050231934) | > avg_loss_mel: 25.392498016357422 (+0.800376256306965) | > avg_loss_duration: 2.667425791422526 (+0.04373423258463527) | > avg_loss_1: 38.716417948404946 (+0.3705736796061174)  > EPOCH: 379/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:49:05)   --> TIME: 2023-10-20 03:49:15 -- STEP: 19/50 -- GLOBAL_STEP: 71970 | > loss_disc: 1.6424106359481812 (2.5683310157374333) | > loss_disc_real_0: 0.11327825486660004 (0.1758030502027587) | > loss_disc_real_1: 0.16478675603866577 (0.22804740914388708) | > loss_disc_real_2: 0.14660421013832092 (0.22879729282699132) | > loss_disc_real_3: 0.20704512298107147 (0.26583362468763405) | > loss_disc_real_4: 0.20055413246154785 (0.24295290667367608) | > loss_disc_real_5: 0.15083858370780945 (0.2544553826906179) | > loss_0: 1.6424106359481812 (2.5683310157374333) | > grad_norm_0: tensor(788.9017, device='cuda:0') (tensor(1211.7084, device='cuda:0')) | > loss_gen: 3.187347650527954 (2.2897504505358244) | > loss_kl: 0.9382251501083374 (0.8819438124957838) | > loss_feat: 8.126286506652832 (5.094767798326518) | > loss_mel: 23.92258644104004 (19.691955760905618) | > loss_duration: 1.6317638158798218 (1.5693565858037848) | > loss_1: 37.806209564208984 (29.527774409243936) | > grad_norm_1: tensor(77638.3438, device='cuda:0') (tensor(38235.9531, device='cuda:0')) | > current_lr_0: 0.00013690587926653593 | > current_lr_1: 0.00013690587926653593 | > step_time: 0.279 (0.3153615625281083) | > loader_time: 0.0046 (0.005143868295769943)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.4104632139205933 (1.4104632139205933) | > loss_disc_real_0: 0.06563889980316162 (0.06563889980316162) | > loss_disc_real_1: 0.17966324090957642 (0.17966324090957642) | > loss_disc_real_2: 0.1566239595413208 (0.1566239595413208) | > loss_disc_real_3: 0.11168474704027176 (0.11168474704027176) | > loss_disc_real_4: 0.10089361667633057 (0.10089361667633057) | > loss_disc_real_5: 0.08262075483798981 (0.08262075483798981) | > loss_0: 1.4104632139205933 (1.4104632139205933) | > loss_gen: 2.987403154373169 (2.987403154373169) | > loss_kl: 2.9338698387145996 (2.9338698387145996) | > loss_feat: 9.662775993347168 (9.662775993347168) | > loss_mel: 25.54405975341797 (25.54405975341797) | > loss_duration: 2.4725100994110107 (2.4725100994110107) | > loss_1: 43.60062026977539 (43.60062026977539)  --> STEP: 1 | > loss_disc: 2.63649320602417 (2.63649320602417) | > loss_disc_real_0: 0.2240494340658188 (0.2240494340658188) | > loss_disc_real_1: 0.15936309099197388 (0.15936309099197388) | > loss_disc_real_2: 0.19962403178215027 (0.19962403178215027) | > loss_disc_real_3: 0.3255206346511841 (0.3255206346511841) | > loss_disc_real_4: 0.3629494309425354 (0.3629494309425354) | > loss_disc_real_5: 0.3775706887245178 (0.3775706887245178) | > loss_0: 2.63649320602417 (2.63649320602417) | > loss_gen: 2.669203996658325 (2.669203996658325) | > loss_kl: 3.962209463119507 (3.962209463119507) | > loss_feat: 6.7717976570129395 (6.7717976570129395) | > loss_mel: 23.54436683654785 (23.54436683654785) | > loss_duration: 2.7747204303741455 (2.7747204303741455) | > loss_1: 39.72229766845703 (39.72229766845703)  --> STEP: 2 | > loss_disc: 2.63649320602417 (2.63649320602417) | > loss_disc_real_0: 0.15379595756530762 (0.1889226958155632) | > loss_disc_real_1: 0.24373923242092133 (0.2015511617064476) | > loss_disc_real_2: 0.24973848462104797 (0.22468125820159912) | > loss_disc_real_3: 0.2660866379737854 (0.29580363631248474) | > loss_disc_real_4: 0.35148847103118896 (0.3572189509868622) | > loss_disc_real_5: 0.36591893434524536 (0.3717448115348816) | > loss_0: 2.63649320602417 (2.63649320602417) | > loss_gen: 2.4210894107818604 (2.5451467037200928) | > loss_kl: 3.627464771270752 (3.7948371171951294) | > loss_feat: 2.8045127391815186 (4.788155198097229) | > loss_mel: 26.09724235534668 (24.820804595947266) | > loss_duration: 2.664931058883667 (2.7198257446289062) | > loss_1: 37.61524200439453 (38.66876983642578)  --> STEP: 3 | > loss_disc: 2.6118671894073486 (2.628284533818563) | > loss_disc_real_0: 0.29605334997177124 (0.22463291386763254) | > loss_disc_real_1: 0.22892843186855316 (0.21067691842714945) | > loss_disc_real_2: 0.2638135254383087 (0.23772534728050232) | > loss_disc_real_3: 0.17270317673683167 (0.25477014978726703) | > loss_disc_real_4: 0.43994468450546265 (0.3847941954930623) | > loss_disc_real_5: 0.3783906400203705 (0.37396008769671124) | > loss_0: 2.6118671894073486 (2.628284533818563) | > loss_gen: 2.8000435829162598 (2.630112330118815) | > loss_kl: 1.967634916305542 (3.1857697168986) | > loss_feat: 4.328286647796631 (4.634865681330363) | > loss_mel: 20.701152801513672 (23.447587331136067) | > loss_duration: 2.57893705368042 (2.6728628476460776) | > loss_1: 32.37605285644531 (36.571197509765625)  --> TIME: 2023-10-20 03:49:34 -- STEP: 49/50 -- GLOBAL_STEP: 72000 | > loss_disc: 2.590719699859619 (2.63194084654049) | > loss_disc_real_0: 0.23302242159843445 (0.17837888595401022) | > loss_disc_real_1: 0.40733253955841064 (0.23099409218649475) | > loss_disc_real_2: 0.27673807740211487 (0.22401582936243136) | > loss_disc_real_3: 0.2863590717315674 (0.2526800307844367) | > loss_disc_real_4: 0.35312414169311523 (0.2515268851527753) | > loss_disc_real_5: 0.30870798230171204 (0.25313614118768246) | > loss_0: 2.590719699859619 (2.63194084654049) | > grad_norm_0: tensor(1931.0732, device='cuda:0') (tensor(1184.4296, device='cuda:0')) | > loss_gen: 3.366098403930664 (2.185861495076393) | > loss_kl: 0.8508767485618591 (0.9489985157032402) | > loss_feat: 5.9895195960998535 (4.536230777751427) | > loss_mel: 28.53225326538086 (19.867788205341423) | > loss_duration: 1.6615709066390991 (1.531302461818773) | > loss_1: 40.40031814575195 (29.070181593603017) | > grad_norm_1: tensor(31285.0508, device='cuda:0') (tensor(36621.2109, device='cuda:0')) | > current_lr_0: 0.00013690587926653593 | > current_lr_1: 0.00013690587926653593 | > step_time: 1.8563 (0.3997255928662358) | > loader_time: 4.6127 (0.09987029250787229) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_72000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8629488945007324 (2.6869506239891052) | > loss_disc_real_0: 0.14779746532440186 (0.20542405173182487) | > loss_disc_real_1: 0.2580670714378357 (0.22252445667982101) | > loss_disc_real_2: 0.26946109533309937 (0.24565928429365158) | > loss_disc_real_3: 0.28307732939720154 (0.26184694468975067) | > loss_disc_real_4: 0.33658158779144287 (0.37274104356765747) | > loss_disc_real_5: 0.3076719641685486 (0.35738805681467056) | > loss_0: 2.8629488945007324 (2.6869506239891052) | > loss_gen: 1.7797493934631348 (2.417521595954895) | > loss_kl: 2.6817989349365234 (3.059777021408081) | > loss_feat: 0.7369788289070129 (3.6603939682245255) | > loss_mel: 19.838844299316406 (22.545401573181152) | > loss_duration: 2.5020995140075684 (2.63017201423645) | > loss_1: 27.539470672607422 (34.313265800476074)  --> STEP: 1 | > loss_disc: 2.4642953872680664 (2.6424195766448975) | > loss_disc_real_0: 0.21560029685497284 (0.20745930075645447) | > loss_disc_real_1: 0.2625100612640381 (0.23052157759666442) | > loss_disc_real_2: 0.25769028067588806 (0.2480654835700989) | > loss_disc_real_3: 0.24644781649112701 (0.2587671190500259) | > loss_disc_real_4: 0.25517287850379944 (0.3492274105548859) | > loss_disc_real_5: 0.23306742310523987 (0.3325239300727844) | > loss_0: 2.4642953872680664 (2.6424195766448975) | > loss_gen: 2.9518284797668457 (2.524382972717285) | > loss_kl: 3.8861324787139893 (3.2250481128692625) | > loss_feat: 7.108279228210449 (4.349971020221711) | > loss_mel: 23.68603515625 (22.77352828979492) | > loss_duration: 2.9006428718566895 (2.684266185760498) | > loss_1: 40.53291702270508 (35.557196044921874)  --> STEP: 2 | > loss_disc: 2.951904535293579 (2.6940004030863443) | > loss_disc_real_0: 0.13947609066963196 (0.19612876574198404) | > loss_disc_real_1: 0.2298988401889801 (0.23041778802871704) | > loss_disc_real_2: 0.3144493103027344 (0.2591294546922048) | > loss_disc_real_3: 0.31454920768737793 (0.26806413382291794) | > loss_disc_real_4: 0.356418251991272 (0.3504258841276169) | > loss_disc_real_5: 0.33717310428619385 (0.333298792441686) | > loss_0: 2.951904535293579 (2.6940004030863443) | > loss_gen: 1.7991551160812378 (2.403511663277944) | > loss_kl: 3.3264000415802 (3.2419401009877524) | > loss_feat: 1.4573686122894287 (3.8678706188996634) | > loss_mel: 20.316808700561523 (22.364075024922688) | > loss_duration: 2.7325356006622314 (2.69231108824412) | > loss_1: 29.63226890563965 (34.56970818837484)  --> STEP: 3 | > loss_disc: 3.0053975582122803 (2.738485710961478) | > loss_disc_real_0: 0.21284186840057373 (0.19851635183606828) | > loss_disc_real_1: 0.2543236017227173 (0.23383290427071707) | > loss_disc_real_2: 0.2768658399581909 (0.2616632240159171) | > loss_disc_real_3: 0.2834399938583374 (0.2702606852565493) | > loss_disc_real_4: 0.3361971378326416 (0.3483932060854776) | > loss_disc_real_5: 0.30220866203308105 (0.32885734524045673) | > loss_0: 3.0053975582122803 (2.738485710961478) | > loss_gen: 1.6845784187316895 (2.3008069140570506) | > loss_kl: 1.444886565208435 (2.9852181673049927) | > loss_feat: 0.23479343950748444 (3.348859593272209) | > loss_mel: 3.7504427433013916 (19.70498469897679) | > loss_duration: 2.6146883964538574 (2.681222132274083) | > loss_1: 9.729389190673828 (31.021091188703263) --> EVAL PERFORMANCE | > avg_loader_time: 0.348046030317034 (+0.3421699660164969) | > avg_loss_disc: 2.738485710961478 (+0.1741798491705029) | > avg_loss_disc_real_0: 0.19851635183606828 (-0.1097747456459772) | > avg_loss_disc_real_1: 0.23383290427071707 (+0.0025863335246131547) | > avg_loss_disc_real_2: 0.2616632240159171 (+0.022117829038983267) | > avg_loss_disc_real_3: 0.2702606852565493 (+0.036140445442426755) | > avg_loss_disc_real_4: 0.3483932060854776 (+0.14595555691491993) | > avg_loss_disc_real_5: 0.32885734524045673 (+0.05238255645547596) | > avg_loss_0: 2.738485710961478 (+0.1741798491705029) | > avg_loss_gen: 2.3008069140570506 (-0.11518645854223308) | > avg_loss_kl: 2.9852181673049927 (-0.09136362870534276) | > avg_loss_feat: 3.348859593272209 (-1.815060968200366) | > avg_loss_mel: 19.70498469897679 (-5.687513317380631) | > avg_loss_duration: 2.681222132274083 (+0.013796340851556899) | > avg_loss_1: 31.021091188703263 (-7.695326759701683)  > EPOCH: 380/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:49:47)   --> TIME: 2023-10-20 03:50:05 -- STEP: 29/50 -- GLOBAL_STEP: 72030 | > loss_disc: 2.9866445064544678 (2.4708102427679908) | > loss_disc_real_0: 0.1605420708656311 (0.16076795788931436) | > loss_disc_real_1: 0.27043986320495605 (0.20750876503257915) | > loss_disc_real_2: 0.24637264013290405 (0.23702105186108885) | > loss_disc_real_3: 0.24479465186595917 (0.2408259802594267) | > loss_disc_real_4: 0.2575223743915558 (0.22700665891170502) | > loss_disc_real_5: 0.2259051352739334 (0.23269694813944655) | > loss_0: 2.9866445064544678 (2.4708102427679908) | > grad_norm_0: tensor(1296.8481, device='cuda:0') (tensor(1175.0530, device='cuda:0')) | > loss_gen: 1.5173890590667725 (2.3059642109377636) | > loss_kl: 0.8349617123603821 (0.966554841090893) | > loss_feat: 0.1825694441795349 (4.787040727919547) | > loss_mel: 4.767027854919434 (20.362273873953985) | > loss_duration: 1.5046453475952148 (1.5430508564258445) | > loss_1: 8.806593894958496 (29.96488426471578) | > grad_norm_1: tensor(29699.3438, device='cuda:0') (tensor(40530., device='cuda:0')) | > current_lr_0: 0.0001367690332686198 | > current_lr_1: 0.0001367690332686198 | > step_time: 0.3926 (0.4640894018370529) | > loader_time: 0.0115 (0.014748548639231716)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.705042839050293 (2.705042839050293) | > loss_disc_real_0: 0.3528814911842346 (0.3528814911842346) | > loss_disc_real_1: 0.30175068974494934 (0.30175068974494934) | > loss_disc_real_2: 0.2876005470752716 (0.2876005470752716) | > loss_disc_real_3: 0.32433146238327026 (0.32433146238327026) | > loss_disc_real_4: 0.308117538690567 (0.308117538690567) | > loss_disc_real_5: 0.24767547845840454 (0.24767547845840454) | > loss_0: 2.705042839050293 (2.705042839050293) | > loss_gen: 2.6513381004333496 (2.6513381004333496) | > loss_kl: 2.8546061515808105 (2.8546061515808105) | > loss_feat: 2.7599284648895264 (2.7599284648895264) | > loss_mel: 23.963571548461914 (23.963571548461914) | > loss_duration: 2.3734042644500732 (2.3734042644500732) | > loss_1: 34.602848052978516 (34.602848052978516)  --> STEP: 1 | > loss_disc: 2.808279037475586 (2.808279037475586) | > loss_disc_real_0: 0.2847065329551697 (0.2847065329551697) | > loss_disc_real_1: 0.274206280708313 (0.274206280708313) | > loss_disc_real_2: 0.29393982887268066 (0.29393982887268066) | > loss_disc_real_3: 0.2936342656612396 (0.2936342656612396) | > loss_disc_real_4: 0.29750117659568787 (0.29750117659568787) | > loss_disc_real_5: 0.29833531379699707 (0.29833531379699707) | > loss_0: 2.808279037475586 (2.808279037475586) | > loss_gen: 2.18623948097229 (2.18623948097229) | > loss_kl: 3.8644776344299316 (3.8644776344299316) | > loss_feat: 1.6916345357894897 (1.6916345357894897) | > loss_mel: 21.50191307067871 (21.50191307067871) | > loss_duration: 2.703291177749634 (2.703291177749634) | > loss_1: 31.947555541992188 (31.947555541992188)  --> STEP: 2 | > loss_disc: 1.8124806880950928 (2.3103798627853394) | > loss_disc_real_0: 0.19512982666492462 (0.23991817981004715) | > loss_disc_real_1: 0.2638450860977173 (0.26902568340301514) | > loss_disc_real_2: 0.21699075400829315 (0.2554652914404869) | > loss_disc_real_3: 0.2202162742614746 (0.2569252699613571) | > loss_disc_real_4: 0.09526579827070236 (0.19638348743319511) | > loss_disc_real_5: 0.07074035704135895 (0.184537835419178) | > loss_0: 1.8124806880950928 (2.3103798627853394) | > loss_gen: 2.857227325439453 (2.5217334032058716) | > loss_kl: 3.9138946533203125 (3.889186143875122) | > loss_feat: 8.119466781616211 (4.90555065870285) | > loss_mel: 26.577730178833008 (24.03982162475586) | > loss_duration: 2.6811110973358154 (2.6922011375427246) | > loss_1: 44.14942932128906 (38.048492431640625)  --> STEP: 3 | > loss_disc: 3.371143102645874 (2.6639676094055176) | > loss_disc_real_0: 0.29850834608078003 (0.25944823523362476) | > loss_disc_real_1: 0.33018890023231506 (0.2894134223461151) | > loss_disc_real_2: 0.3154226541519165 (0.27545107901096344) | > loss_disc_real_3: 0.25418469309806824 (0.2560117443402608) | > loss_disc_real_4: 0.3990011513233185 (0.2639227087299029) | > loss_disc_real_5: 0.3219763934612274 (0.23035068809986115) | > loss_0: 3.371143102645874 (2.6639676094055176) | > loss_gen: 1.7677996158599854 (2.2704221407572427) | > loss_kl: 1.509100317955017 (3.095824201901754) | > loss_feat: 1.9851077795028687 (3.932069698969523) | > loss_mel: 19.63722801208496 (22.572290420532227) | > loss_duration: 2.43325138092041 (2.605884552001953) | > loss_1: 27.33248519897461 (34.47649002075195) --> EVAL PERFORMANCE | > avg_loader_time: 0.0077868302663167315 (-0.3402592000507173) | > avg_loss_disc: 2.6639676094055176 (-0.07451810155596039) | > avg_loss_disc_real_0: 0.25944823523362476 (+0.06093188339755648) | > avg_loss_disc_real_1: 0.2894134223461151 (+0.055580518075398044) | > avg_loss_disc_real_2: 0.27545107901096344 (+0.013787854995046367) | > avg_loss_disc_real_3: 0.2560117443402608 (-0.014248940916288477) | > avg_loss_disc_real_4: 0.2639227087299029 (-0.08447049735557466) | > avg_loss_disc_real_5: 0.23035068809986115 (-0.09850665714059559) | > avg_loss_0: 2.6639676094055176 (-0.07451810155596039) | > avg_loss_gen: 2.2704221407572427 (-0.030384773299807932) | > avg_loss_kl: 3.095824201901754 (+0.11060603459676122) | > avg_loss_feat: 3.932069698969523 (+0.5832101056973138) | > avg_loss_mel: 22.572290420532227 (+2.867305721555436) | > avg_loss_duration: 2.605884552001953 (-0.07533758027212967) | > avg_loss_1: 34.47649002075195 (+3.45539883204869)  > EPOCH: 381/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:50:25)   --> TIME: 2023-10-20 03:50:35 -- STEP: 9/50 -- GLOBAL_STEP: 72060 | > loss_disc: 2.6946020126342773 (2.5620775090323553) | > loss_disc_real_0: 0.17638283967971802 (0.180747472991546) | > loss_disc_real_1: 0.3452102243900299 (0.2726237898071607) | > loss_disc_real_2: 0.2909737527370453 (0.2610398117038939) | > loss_disc_real_3: 0.35075467824935913 (0.2538626905944612) | > loss_disc_real_4: 0.2570958137512207 (0.21580549826224646) | > loss_disc_real_5: 0.22313836216926575 (0.25129765272140503) | > loss_0: 2.6946020126342773 (2.5620775090323553) | > grad_norm_0: tensor(1345.3833, device='cuda:0') (tensor(844.3281, device='cuda:0')) | > loss_gen: 2.2631418704986572 (2.31638601091173) | > loss_kl: 0.8519579768180847 (0.6590358946058485) | > loss_feat: 4.193220615386963 (4.373383623030451) | > loss_mel: 23.289756774902344 (18.126195404264664) | > loss_duration: 1.486748218536377 (1.5540040466520522) | > loss_1: 32.08482360839844 (27.029004255930584) | > grad_norm_1: tensor(30623.4863, device='cuda:0') (tensor(34085.0547, device='cuda:0')) | > current_lr_0: 0.00013663232405684644 | > current_lr_1: 0.00013663232405684644 | > step_time: 0.5841 (0.5504975318908691) | > loader_time: 0.0125 (0.013742897245619033)  --> TIME: 2023-10-20 03:50:51 -- STEP: 39/50 -- GLOBAL_STEP: 72090 | > loss_disc: 3.0054845809936523 (2.386509950344379) | > loss_disc_real_0: 0.40452754497528076 (0.1440676178019016) | > loss_disc_real_1: 0.28746551275253296 (0.2299133085478575) | > loss_disc_real_2: 0.31878966093063354 (0.2357233114158496) | > loss_disc_real_3: 0.2953305244445801 (0.23581875163393143) | > loss_disc_real_4: 0.280788391828537 (0.2067143381215059) | > loss_disc_real_5: 0.32785505056381226 (0.22895049203473788) | > loss_0: 3.0054845809936523 (2.386509950344379) | > grad_norm_0: tensor(4084.1311, device='cuda:0') (tensor(1044.5394, device='cuda:0')) | > loss_gen: 2.9462685585021973 (2.45915596301739) | > loss_kl: 0.16987451910972595 (0.7888292112411597) | > loss_feat: 3.7638986110687256 (5.407989294483111) | > loss_mel: 21.67158317565918 (22.23292500544817) | > loss_duration: 1.5887084007263184 (1.5342936240709746) | > loss_1: 30.14033317565918 (32.42319272114681) | > grad_norm_1: tensor(42234.9922, device='cuda:0') (tensor(40052.6562, device='cuda:0')) | > current_lr_0: 0.00013663232405684644 | > current_lr_1: 0.00013663232405684644 | > step_time: 0.6052 (0.5174814126430413) | > loader_time: 0.0245 (0.018084966219388522)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.339674711227417 (3.339674711227417) | > loss_disc_real_0: 0.10030976682901382 (0.10030976682901382) | > loss_disc_real_1: 0.3040126860141754 (0.3040126860141754) | > loss_disc_real_2: 0.38673722743988037 (0.38673722743988037) | > loss_disc_real_3: 0.4365774393081665 (0.4365774393081665) | > loss_disc_real_4: 0.43175429105758667 (0.43175429105758667) | > loss_disc_real_5: 0.4095158874988556 (0.4095158874988556) | > loss_0: 3.339674711227417 (3.339674711227417) | > loss_gen: 1.9285590648651123 (1.9285590648651123) | > loss_kl: 3.2478249073028564 (3.2478249073028564) | > loss_feat: 2.2442679405212402 (2.2442679405212402) | > loss_mel: 24.183998107910156 (24.183998107910156) | > loss_duration: 2.4720659255981445 (2.4720659255981445) | > loss_1: 34.07671356201172 (34.07671356201172)  --> STEP: 1 | > loss_disc: 2.3750083446502686 (2.3750083446502686) | > loss_disc_real_0: 0.30728408694267273 (0.30728408694267273) | > loss_disc_real_1: 0.14108681678771973 (0.14108681678771973) | > loss_disc_real_2: 0.23167215287685394 (0.23167215287685394) | > loss_disc_real_3: 0.19153285026550293 (0.19153285026550293) | > loss_disc_real_4: 0.1565236896276474 (0.1565236896276474) | > loss_disc_real_5: 0.20918214321136475 (0.20918214321136475) | > loss_0: 2.3750083446502686 (2.3750083446502686) | > loss_gen: 2.346907615661621 (2.346907615661621) | > loss_kl: 3.5107150077819824 (3.5107150077819824) | > loss_feat: 6.723750591278076 (6.723750591278076) | > loss_mel: 28.828516006469727 (28.828516006469727) | > loss_duration: 2.703225612640381 (2.703225612640381) | > loss_1: 44.11311340332031 (44.11311340332031)  --> STEP: 2 | > loss_disc: 2.636359214782715 (2.5056837797164917) | > loss_disc_real_0: 0.5880515575408936 (0.44766782224178314) | > loss_disc_real_1: 0.25715476274490356 (0.19912078976631165) | > loss_disc_real_2: 0.24792078137397766 (0.2397964671254158) | > loss_disc_real_3: 0.38453951478004456 (0.28803618252277374) | > loss_disc_real_4: 0.06571869552135468 (0.11112119257450104) | > loss_disc_real_5: 0.1983940452337265 (0.20378809422254562) | > loss_0: 2.636359214782715 (2.5056837797164917) | > loss_gen: 3.291304111480713 (2.819105863571167) | > loss_kl: 3.6351444721221924 (3.5729297399520874) | > loss_feat: 8.5283203125 (7.626035451889038) | > loss_mel: 26.44475746154785 (27.63663673400879) | > loss_duration: 2.710200548171997 (2.706713080406189) | > loss_1: 44.6097297668457 (44.36142158508301)  --> STEP: 3 | > loss_disc: 3.1317996978759766 (2.7143890857696533) | > loss_disc_real_0: 0.1241244226694107 (0.3398200223843257) | > loss_disc_real_1: 0.2931649088859558 (0.2304688294728597) | > loss_disc_real_2: 0.3450127840042114 (0.27486857275168103) | > loss_disc_real_3: 0.31943899393081665 (0.2985037863254547) | > loss_disc_real_4: 0.33444371819496155 (0.18556203444798788) | > loss_disc_real_5: 0.3944815695285797 (0.26735258599122363) | > loss_0: 3.1317996978759766 (2.7143890857696533) | > loss_gen: 1.7684019804000854 (2.468871235847473) | > loss_kl: 1.7023215293884277 (2.9493936697642007) | > loss_feat: 0.1722383201122284 (5.141436407963435) | > loss_mel: 2.8861567974090576 (19.386476755142212) | > loss_duration: 2.5446760654449463 (2.652700742085775) | > loss_1: 9.0737943649292 (32.598879178365074) --> EVAL PERFORMANCE | > avg_loader_time: 0.01586262385050456 (+0.008075793584187828) | > avg_loss_disc: 2.7143890857696533 (+0.05042147636413574) | > avg_loss_disc_real_0: 0.3398200223843257 (+0.08037178715070092) | > avg_loss_disc_real_1: 0.2304688294728597 (-0.0589445928732554) | > avg_loss_disc_real_2: 0.27486857275168103 (-0.0005825062592824115) | > avg_loss_disc_real_3: 0.2985037863254547 (+0.04249204198519391) | > avg_loss_disc_real_4: 0.18556203444798788 (-0.07836067428191504) | > avg_loss_disc_real_5: 0.26735258599122363 (+0.03700189789136249) | > avg_loss_0: 2.7143890857696533 (+0.05042147636413574) | > avg_loss_gen: 2.468871235847473 (+0.19844909509023045) | > avg_loss_kl: 2.9493936697642007 (-0.1464305321375532) | > avg_loss_feat: 5.141436407963435 (+1.2093667089939122) | > avg_loss_mel: 19.386476755142212 (-3.1858136653900146) | > avg_loss_duration: 2.652700742085775 (+0.04681619008382176) | > avg_loss_1: 32.598879178365074 (-1.8776108423868791)  > EPOCH: 382/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:51:06)   --> TIME: 2023-10-20 03:51:23 -- STEP: 19/50 -- GLOBAL_STEP: 72120 | > loss_disc: 2.4527907371520996 (2.5453277951792668) | > loss_disc_real_0: 0.17612409591674805 (0.1763125483534838) | > loss_disc_real_1: 0.2877271771430969 (0.23574931684293246) | > loss_disc_real_2: 0.3138760030269623 (0.2574180491072567) | > loss_disc_real_3: 0.3821607232093811 (0.24781034533914767) | > loss_disc_real_4: 0.3552546203136444 (0.25280422952614334) | > loss_disc_real_5: 0.21629472076892853 (0.25463065014857994) | > loss_0: 2.4527907371520996 (2.5453277951792668) | > grad_norm_0: tensor(1009.4544, device='cuda:0') (tensor(1794.2932, device='cuda:0')) | > loss_gen: 2.9373996257781982 (2.3502223805377356) | > loss_kl: 1.3120574951171875 (0.8931716006053122) | > loss_feat: 5.116866111755371 (4.58296886360959) | > loss_mel: 24.724414825439453 (19.57819668870223) | > loss_duration: 1.6682041883468628 (1.5692446043616848) | > loss_1: 35.75894546508789 (28.97380394684641) | > grad_norm_1: tensor(12475.9541, device='cuda:0') (tensor(32636.3750, device='cuda:0')) | > current_lr_0: 0.00013649575149448953 | > current_lr_1: 0.00013649575149448953 | > step_time: 0.2548 (0.558201413405569) | > loader_time: 0.002 (0.015441969821327612)  --> TIME: 2023-10-20 03:51:38 -- STEP: 49/50 -- GLOBAL_STEP: 72150 | > loss_disc: 1.8678425550460815 (2.4925980105692034) | > loss_disc_real_0: 0.032717619091272354 (0.1688047777481225) | > loss_disc_real_1: 0.24866139888763428 (0.22692977682668336) | > loss_disc_real_2: 0.09107517451047897 (0.23073749536914484) | > loss_disc_real_3: 0.16248510777950287 (0.23801827316685598) | > loss_disc_real_4: 0.13554325699806213 (0.24690998604103015) | > loss_disc_real_5: 0.12862461805343628 (0.2496333904564382) | > loss_0: 1.8678425550460815 (2.4925980105692034) | > grad_norm_0: tensor(1798.2372, device='cuda:0') (tensor(1504.1428, device='cuda:0')) | > loss_gen: 2.5361685752868652 (2.352777184272299) | > loss_kl: 0.9308428764343262 (0.8971822200989237) | > loss_feat: 7.050705432891846 (5.30361738998671) | > loss_mel: 23.09606170654297 (21.432515514140228) | > loss_duration: 1.6340731382369995 (1.5409887031633027) | > loss_1: 35.24784851074219 (31.527080740247452) | > grad_norm_1: tensor(34820.7734, device='cuda:0') (tensor(31883.1348, device='cuda:0')) | > current_lr_0: 0.00013649575149448953 | > current_lr_1: 0.00013649575149448953 | > step_time: 0.5094 (0.49535135347016) | > loader_time: 0.5078 (0.025834414423728476)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9825634956359863 (2.9825634956359863) | > loss_disc_real_0: 0.0644797757267952 (0.0644797757267952) | > loss_disc_real_1: 0.22024567425251007 (0.22024567425251007) | > loss_disc_real_2: 0.3183882534503937 (0.3183882534503937) | > loss_disc_real_3: 0.4131794571876526 (0.4131794571876526) | > loss_disc_real_4: 0.2210589498281479 (0.2210589498281479) | > loss_disc_real_5: 0.30056583881378174 (0.30056583881378174) | > loss_0: 2.9825634956359863 (2.9825634956359863) | > loss_gen: 1.8250763416290283 (1.8250763416290283) | > loss_kl: 2.850430965423584 (2.850430965423584) | > loss_feat: 3.8703715801239014 (3.8703715801239014) | > loss_mel: 25.110797882080078 (25.110797882080078) | > loss_duration: 2.4732329845428467 (2.4732329845428467) | > loss_1: 36.12990951538086 (36.12990951538086)  --> STEP: 1 | > loss_disc: 2.200601816177368 (2.200601816177368) | > loss_disc_real_0: 0.2148572951555252 (0.2148572951555252) | > loss_disc_real_1: 0.15226273238658905 (0.15226273238658905) | > loss_disc_real_2: 0.3087114989757538 (0.3087114989757538) | > loss_disc_real_3: 0.33988502621650696 (0.33988502621650696) | > loss_disc_real_4: 0.24255019426345825 (0.24255019426345825) | > loss_disc_real_5: 0.3613118529319763 (0.3613118529319763) | > loss_0: 2.200601816177368 (2.200601816177368) | > loss_gen: 3.077303886413574 (3.077303886413574) | > loss_kl: 3.2344446182250977 (3.2344446182250977) | > loss_feat: 7.2061991691589355 (7.2061991691589355) | > loss_mel: 25.343076705932617 (25.343076705932617) | > loss_duration: 2.751986026763916 (2.751986026763916) | > loss_1: 41.613014221191406 (41.613014221191406)  --> STEP: 2 | > loss_disc: 2.2000443935394287 (2.2003231048583984) | > loss_disc_real_0: 0.05274108797311783 (0.13379919156432152) | > loss_disc_real_1: 0.1628103107213974 (0.15753652155399323) | > loss_disc_real_2: 0.3203772008419037 (0.31454434990882874) | > loss_disc_real_3: 0.2804928123950958 (0.3101889193058014) | > loss_disc_real_4: 0.11913677304983139 (0.18084348365664482) | > loss_disc_real_5: 0.17684930562973022 (0.26908057928085327) | > loss_0: 2.2000443935394287 (2.2003231048583984) | > loss_gen: 2.4382333755493164 (2.7577686309814453) | > loss_kl: 3.957486867904663 (3.5959657430648804) | > loss_feat: 9.019290924072266 (8.1127450466156) | > loss_mel: 26.84205436706543 (26.092565536499023) | > loss_duration: 2.7161359786987305 (2.7340610027313232) | > loss_1: 44.973201751708984 (43.293107986450195)  --> STEP: 3 | > loss_disc: 2.7800519466400146 (2.393566052118937) | > loss_disc_real_0: 0.08184660226106644 (0.11648166179656982) | > loss_disc_real_1: 0.3128393590450287 (0.20930413405100504) | > loss_disc_real_2: 0.23277707397937775 (0.2872885912656784) | > loss_disc_real_3: 0.28184688091278076 (0.3007415731747945) | > loss_disc_real_4: 0.3194625675678253 (0.22704984496037164) | > loss_disc_real_5: 0.2961336076259613 (0.2780982553958893) | > loss_0: 2.7800519466400146 (2.393566052118937) | > loss_gen: 1.839271068572998 (2.4516027768452964) | > loss_kl: 1.3029553890228271 (2.831628958384196) | > loss_feat: 2.373098611831665 (6.199529568354289) | > loss_mel: 20.46866226196289 (24.217931111653645) | > loss_duration: 2.494347333908081 (2.654156446456909) | > loss_1: 28.478334426879883 (38.35485013326009) --> EVAL PERFORMANCE | > avg_loader_time: 0.01274720827738444 (-0.003115415573120119) | > avg_loss_disc: 2.393566052118937 (-0.3208230336507163) | > avg_loss_disc_real_0: 0.11648166179656982 (-0.22333836058775586) | > avg_loss_disc_real_1: 0.20930413405100504 (-0.021164695421854673) | > avg_loss_disc_real_2: 0.2872885912656784 (+0.012420018513997377) | > avg_loss_disc_real_3: 0.3007415731747945 (+0.0022377868493397846) | > avg_loss_disc_real_4: 0.22704984496037164 (+0.04148781051238376) | > avg_loss_disc_real_5: 0.2780982553958893 (+0.010745669404665648) | > avg_loss_0: 2.393566052118937 (-0.3208230336507163) | > avg_loss_gen: 2.4516027768452964 (-0.017268459002176773) | > avg_loss_kl: 2.831628958384196 (-0.11776471138000488) | > avg_loss_feat: 6.199529568354289 (+1.0580931603908539) | > avg_loss_mel: 24.217931111653645 (+4.831454356511433) | > avg_loss_duration: 2.654156446456909 (+0.001455704371134292) | > avg_loss_1: 38.35485013326009 (+5.7559709548950195)  > EPOCH: 383/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:51:47)   --> TIME: 2023-10-20 03:52:06 -- STEP: 29/50 -- GLOBAL_STEP: 72180 | > loss_disc: 3.1764793395996094 (2.419908540002231) | > loss_disc_real_0: 0.5643892288208008 (0.152431799869599) | > loss_disc_real_1: 0.2878582179546356 (0.21090612650431437) | > loss_disc_real_2: 0.2624726891517639 (0.2253553007633008) | > loss_disc_real_3: 0.2205614447593689 (0.25039221731753186) | > loss_disc_real_4: 0.28765663504600525 (0.22715162839098219) | > loss_disc_real_5: 0.25795701146125793 (0.239938591831717) | > loss_0: 3.1764793395996094 (2.419908540002231) | > grad_norm_0: tensor(2503.7239, device='cuda:0') (tensor(1224.5421, device='cuda:0')) | > loss_gen: 1.687698245048523 (2.5301226747447045) | > loss_kl: 0.6315690279006958 (0.886569989138636) | > loss_feat: 0.38889080286026 (6.678378485400101) | > loss_mel: 16.586877822875977 (25.31287800032517) | > loss_duration: 1.527831792831421 (1.552849399632421) | > loss_1: 20.82286834716797 (36.9607988883709) | > grad_norm_1: tensor(13191.9004, device='cuda:0') (tensor(57005.2148, device='cuda:0')) | > current_lr_0: 0.00013635931544495942 | > current_lr_1: 0.00013635931544495942 | > step_time: 0.3771 (0.47716440825626766) | > loader_time: 0.0019 (0.015190247831673458)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.914916515350342 (2.914916515350342) | > loss_disc_real_0: 0.20372852683067322 (0.20372852683067322) | > loss_disc_real_1: 0.2562481462955475 (0.2562481462955475) | > loss_disc_real_2: 0.25398603081703186 (0.25398603081703186) | > loss_disc_real_3: 0.2370956689119339 (0.2370956689119339) | > loss_disc_real_4: 0.24998584389686584 (0.24998584389686584) | > loss_disc_real_5: 0.2903999388217926 (0.2903999388217926) | > loss_0: 2.914916515350342 (2.914916515350342) | > loss_gen: 1.5879487991333008 (1.5879487991333008) | > loss_kl: 2.7652058601379395 (2.7652058601379395) | > loss_feat: 0.22737076878547668 (0.22737076878547668) | > loss_mel: 13.546951293945312 (13.546951293945312) | > loss_duration: 2.5840067863464355 (2.5840067863464355) | > loss_1: 20.711483001708984 (20.711483001708984)  --> STEP: 1 | > loss_disc: 1.9811959266662598 (1.9811959266662598) | > loss_disc_real_0: 0.07962824404239655 (0.07962824404239655) | > loss_disc_real_1: 0.30068862438201904 (0.30068862438201904) | > loss_disc_real_2: 0.22223258018493652 (0.22223258018493652) | > loss_disc_real_3: 0.08304749429225922 (0.08304749429225922) | > loss_disc_real_4: 0.1852768063545227 (0.1852768063545227) | > loss_disc_real_5: 0.054739680141210556 (0.054739680141210556) | > loss_0: 1.9811959266662598 (1.9811959266662598) | > loss_gen: 2.2329506874084473 (2.2329506874084473) | > loss_kl: 3.2298009395599365 (3.2298009395599365) | > loss_feat: 7.305647373199463 (7.305647373199463) | > loss_mel: 26.556312561035156 (26.556312561035156) | > loss_duration: 2.829244375228882 (2.829244375228882) | > loss_1: 42.153953552246094 (42.153953552246094)  --> STEP: 2 | > loss_disc: 2.958306312561035 (2.4697511196136475) | > loss_disc_real_0: 0.2221726030111313 (0.15090042352676392) | > loss_disc_real_1: 0.25607043504714966 (0.27837952971458435) | > loss_disc_real_2: 0.25291574001312256 (0.23757416009902954) | > loss_disc_real_3: 0.23691599071025848 (0.15998174250125885) | > loss_disc_real_4: 0.2501942217350006 (0.21773551404476166) | > loss_disc_real_5: 0.2882692515850067 (0.17150446586310863) | > loss_0: 2.958306312561035 (2.4697511196136475) | > loss_gen: 1.5548925399780273 (1.8939216136932373) | > loss_kl: 3.5839266777038574 (3.406863808631897) | > loss_feat: 0.10595165938138962 (3.7057995162904263) | > loss_mel: 2.3899881839752197 (14.473150372505188) | > loss_duration: 2.7697508335113525 (2.799497604370117) | > loss_1: 10.404509544372559 (26.279231548309326)  --> STEP: 3 | > loss_disc: 2.9899790287017822 (2.643160422643026) | > loss_disc_real_0: 0.12239596992731094 (0.14139893899361292) | > loss_disc_real_1: 0.23691414296627045 (0.26455773413181305) | > loss_disc_real_2: 0.2640478312969208 (0.2463987171649933) | > loss_disc_real_3: 0.24182456731796265 (0.18726268410682678) | > loss_disc_real_4: 0.2503969967365265 (0.2286226749420166) | > loss_disc_real_5: 0.2871629297733307 (0.21005728716651598) | > loss_0: 2.9899790287017822 (2.643160422643026) | > loss_gen: 1.426627278327942 (1.738156835238139) | > loss_kl: 1.5930956602096558 (2.8022744258244834) | > loss_feat: 0.4065608084201813 (2.606053280333678) | > loss_mel: 16.337059020996094 (15.09445325533549) | > loss_duration: 2.5536632537841797 (2.717552820841471) | > loss_1: 22.317007064819336 (24.958490053812664) --> EVAL PERFORMANCE | > avg_loader_time: 0.006223758061726888 (-0.006523450215657552) | > avg_loss_disc: 2.643160422643026 (+0.24959437052408884) | > avg_loss_disc_real_0: 0.14139893899361292 (+0.024917277197043092) | > avg_loss_disc_real_1: 0.26455773413181305 (+0.05525360008080801) | > avg_loss_disc_real_2: 0.2463987171649933 (-0.04088987410068512) | > avg_loss_disc_real_3: 0.18726268410682678 (-0.11347888906796771) | > avg_loss_disc_real_4: 0.2286226749420166 (+0.0015728299816449576) | > avg_loss_disc_real_5: 0.21005728716651598 (-0.0680409682293733) | > avg_loss_0: 2.643160422643026 (+0.24959437052408884) | > avg_loss_gen: 1.738156835238139 (-0.7134459416071575) | > avg_loss_kl: 2.8022744258244834 (-0.029354532559712432) | > avg_loss_feat: 2.606053280333678 (-3.5934762880206113) | > avg_loss_mel: 15.09445325533549 (-9.123477856318155) | > avg_loss_duration: 2.717552820841471 (+0.06339637438456203) | > avg_loss_1: 24.958490053812664 (-13.39636007944743)  > EPOCH: 384/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:52:28)   --> TIME: 2023-10-20 03:52:38 -- STEP: 9/50 -- GLOBAL_STEP: 72210 | > loss_disc: 3.032836437225342 (2.312741239865621) | > loss_disc_real_0: 0.3150697350502014 (0.15893436099092165) | > loss_disc_real_1: 0.29100748896598816 (0.2477381577094396) | > loss_disc_real_2: 0.3352784216403961 (0.2474072463810444) | > loss_disc_real_3: 0.2063208520412445 (0.21242568062411415) | > loss_disc_real_4: 0.22516387701034546 (0.18269286097751725) | > loss_disc_real_5: 0.18652434647083282 (0.17139233441816437) | > loss_0: 3.032836437225342 (2.312741239865621) | > grad_norm_0: tensor(847.4382, device='cuda:0') (tensor(1700.4536, device='cuda:0')) | > loss_gen: 1.4141112565994263 (2.433201379246182) | > loss_kl: 0.8916006088256836 (0.7527947028477987) | > loss_feat: 0.02842225506901741 (5.710850942879915) | > loss_mel: 0.8769364356994629 (20.429360336727566) | > loss_duration: 1.5350379943847656 (1.5476402176751032) | > loss_1: 4.746108531951904 (30.873847484588623) | > grad_norm_1: tensor(164237.2500, device='cuda:0') (tensor(83345.2422, device='cuda:0')) | > current_lr_0: 0.00013622301577180299 | > current_lr_1: 0.00013622301577180299 | > step_time: 0.5852 (0.5184195836385092) | > loader_time: 0.0251 (0.015590429306030273)  --> TIME: 2023-10-20 03:52:49 -- STEP: 39/50 -- GLOBAL_STEP: 72240 | > loss_disc: 2.479687213897705 (2.443578460277655) | > loss_disc_real_0: 0.020836658775806427 (0.16402535503491378) | > loss_disc_real_1: 0.3132755756378174 (0.2289646606032665) | > loss_disc_real_2: 0.30835238099098206 (0.217966872243545) | > loss_disc_real_3: 0.22139057517051697 (0.2224128748743962) | > loss_disc_real_4: 0.28186315298080444 (0.2122466956766752) | > loss_disc_real_5: 0.17257101833820343 (0.1961842036495606) | > loss_0: 2.479687213897705 (2.443578460277655) | > grad_norm_0: tensor(1069.1512, device='cuda:0') (tensor(1504.9282, device='cuda:0')) | > loss_gen: 2.693735361099243 (2.3335537727062516) | > loss_kl: 0.7458522915840149 (0.8657059852893536) | > loss_feat: 7.9717206954956055 (5.356214842448632) | > loss_mel: 28.904399871826172 (21.39713132075774) | > loss_duration: 1.6178267002105713 (1.5321405820357494) | > loss_1: 41.933536529541016 (31.48474638278668) | > grad_norm_1: tensor(75361.1016, device='cuda:0') (tensor(52257.2812, device='cuda:0')) | > current_lr_0: 0.00013622301577180299 | > current_lr_1: 0.00013622301577180299 | > step_time: 0.2661 (0.39410122235616046) | > loader_time: 0.0023 (0.009928336510291466)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.888031005859375 (2.888031005859375) | > loss_disc_real_0: 0.14439743757247925 (0.14439743757247925) | > loss_disc_real_1: 0.2854669690132141 (0.2854669690132141) | > loss_disc_real_2: 0.2618725597858429 (0.2618725597858429) | > loss_disc_real_3: 0.28219643235206604 (0.28219643235206604) | > loss_disc_real_4: 0.300022691488266 (0.300022691488266) | > loss_disc_real_5: 0.2632252871990204 (0.2632252871990204) | > loss_0: 2.888031005859375 (2.888031005859375) | > loss_gen: 1.664212703704834 (1.664212703704834) | > loss_kl: 2.8692827224731445 (2.8692827224731445) | > loss_feat: 0.3161866068840027 (0.3161866068840027) | > loss_mel: 15.286986351013184 (15.286986351013184) | > loss_duration: 2.51552677154541 (2.51552677154541) | > loss_1: 22.65219497680664 (22.65219497680664)  --> STEP: 1 | > loss_disc: 2.1650984287261963 (2.1650984287261963) | > loss_disc_real_0: 0.12347742915153503 (0.12347742915153503) | > loss_disc_real_1: 0.27410954236984253 (0.27410954236984253) | > loss_disc_real_2: 0.2307666391134262 (0.2307666391134262) | > loss_disc_real_3: 0.163816437125206 (0.163816437125206) | > loss_disc_real_4: 0.21827669441699982 (0.21827669441699982) | > loss_disc_real_5: 0.16656197607517242 (0.16656197607517242) | > loss_0: 2.1650984287261963 (2.1650984287261963) | > loss_gen: 2.4618098735809326 (2.4618098735809326) | > loss_kl: 3.3445627689361572 (3.3445627689361572) | > loss_feat: 7.34324836730957 (7.34324836730957) | > loss_mel: 28.837108612060547 (28.837108612060547) | > loss_duration: 2.7955286502838135 (2.7955286502838135) | > loss_1: 44.782257080078125 (44.782257080078125)  --> STEP: 2 | > loss_disc: 1.706021785736084 (1.9355601072311401) | > loss_disc_real_0: 0.07475212216377258 (0.09911477565765381) | > loss_disc_real_1: 0.14775826036930084 (0.21093390136957169) | > loss_disc_real_2: 0.08919189870357513 (0.15997926890850067) | > loss_disc_real_3: 0.12981179356575012 (0.14681411534547806) | > loss_disc_real_4: 0.03584695979952812 (0.12706182710826397) | > loss_disc_real_5: 0.0163139495998621 (0.09143796283751726) | > loss_0: 1.706021785736084 (1.9355601072311401) | > loss_gen: 2.3421413898468018 (2.401975631713867) | > loss_kl: 4.4038519859313965 (3.874207377433777) | > loss_feat: 12.07785701751709 (9.71055269241333) | > loss_mel: 26.216732025146484 (27.526920318603516) | > loss_duration: 2.803792715072632 (2.7996606826782227) | > loss_1: 47.8443717956543 (46.31331443786621)  --> STEP: 3 | > loss_disc: 2.848870277404785 (2.239996830622355) | > loss_disc_real_0: 0.0840190052986145 (0.0940828522046407) | > loss_disc_real_1: 0.30196499824523926 (0.24127760032812753) | > loss_disc_real_2: 0.2493293285369873 (0.18976262211799622) | > loss_disc_real_3: 0.2721373736858368 (0.1885885347922643) | > loss_disc_real_4: 0.307943731546402 (0.18735579525430998) | > loss_disc_real_5: 0.269807368516922 (0.15089443139731884) | > loss_0: 2.848870277404785 (2.239996830622355) | > loss_gen: 1.6770389080047607 (2.160330057144165) | > loss_kl: 1.725170373916626 (3.1578617095947266) | > loss_feat: 1.0011826753616333 (6.807429353396098) | > loss_mel: 18.043973922729492 (24.365938186645508) | > loss_duration: 2.5140814781188965 (2.7044676144917807) | > loss_1: 24.96144676208496 (39.1960252126058) --> EVAL PERFORMANCE | > avg_loader_time: 0.010899861653645834 (+0.004676103591918946) | > avg_loss_disc: 2.239996830622355 (-0.40316359202067087) | > avg_loss_disc_real_0: 0.0940828522046407 (-0.047316086788972214) | > avg_loss_disc_real_1: 0.24127760032812753 (-0.023280133803685515) | > avg_loss_disc_real_2: 0.18976262211799622 (-0.05663609504699707) | > avg_loss_disc_real_3: 0.1885885347922643 (+0.0013258506854375296) | > avg_loss_disc_real_4: 0.18735579525430998 (-0.04126687968770662) | > avg_loss_disc_real_5: 0.15089443139731884 (-0.05916285576919714) | > avg_loss_0: 2.239996830622355 (-0.40316359202067087) | > avg_loss_gen: 2.160330057144165 (+0.42217322190602613) | > avg_loss_kl: 3.1578617095947266 (+0.3555872837702432) | > avg_loss_feat: 6.807429353396098 (+4.20137607306242) | > avg_loss_mel: 24.365938186645508 (+9.271484931310018) | > avg_loss_duration: 2.7044676144917807 (-0.01308520634969046) | > avg_loss_1: 39.1960252126058 (+14.237535158793133)  > EPOCH: 385/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:53:06)   --> TIME: 2023-10-20 03:53:19 -- STEP: 19/50 -- GLOBAL_STEP: 72270 | > loss_disc: 2.690739154815674 (2.3530992834191573) | > loss_disc_real_0: 0.07402575016021729 (0.1454969424950449) | > loss_disc_real_1: 0.23123833537101746 (0.24157918450471602) | > loss_disc_real_2: 0.27437135577201843 (0.2429902408468096) | > loss_disc_real_3: 0.26184752583503723 (0.23973765283038742) | > loss_disc_real_4: 0.1477022022008896 (0.21608254205631583) | > loss_disc_real_5: 0.2429099828004837 (0.20703905083141044) | > loss_0: 2.690739154815674 (2.3530992834191573) | > grad_norm_0: tensor(1262.2047, device='cuda:0') (tensor(1132.0208, device='cuda:0')) | > loss_gen: 1.912035584449768 (2.460332563048915) | > loss_kl: 1.1328305006027222 (0.9304946276702379) | > loss_feat: 3.706462860107422 (5.234607674377529) | > loss_mel: 25.089540481567383 (22.399829124149523) | > loss_duration: 1.6370995044708252 (1.584563180019981) | > loss_1: 33.47796630859375 (32.60982704162598) | > grad_norm_1: tensor(11909.7168, device='cuda:0') (tensor(44525.1758, device='cuda:0')) | > current_lr_0: 0.00013608685233870347 | > current_lr_1: 0.00013608685233870347 | > step_time: 0.3648 (0.42525820983083623) | > loader_time: 0.0041 (0.010025664379722193)  --> TIME: 2023-10-20 03:53:31 -- STEP: 49/50 -- GLOBAL_STEP: 72300 | > loss_disc: 1.9551643133163452 (2.448334421430315) | > loss_disc_real_0: 0.08138889819383621 (0.15306279899514455) | > loss_disc_real_1: 0.21584242582321167 (0.23018619634819273) | > loss_disc_real_2: 0.20504458248615265 (0.23259718579297162) | > loss_disc_real_3: 0.23760083317756653 (0.24345305143874518) | > loss_disc_real_4: 0.18505732715129852 (0.21622364595532417) | > loss_disc_real_5: 0.19765391945838928 (0.22187269360245188) | > loss_0: 1.9551643133163452 (2.448334421430315) | > grad_norm_0: tensor(1600.5634, device='cuda:0') (tensor(1263.9172, device='cuda:0')) | > loss_gen: 2.924859046936035 (2.3540610147982237) | > loss_kl: 0.7095173597335815 (0.8710584211714414) | > loss_feat: 5.442737579345703 (5.006256808963967) | > loss_mel: 23.47004508972168 (21.315943005133647) | > loss_duration: 1.6741582155227661 (1.5412070872832317) | > loss_1: 34.221317291259766 (31.088526638186714) | > grad_norm_1: tensor(29907.8848, device='cuda:0') (tensor(45379.0508, device='cuda:0')) | > current_lr_0: 0.00013608685233870347 | > current_lr_1: 0.00013608685233870347 | > step_time: 0.5325 (0.39132704053606304) | > loader_time: 0.3825 (0.01678974287850516)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0861995220184326 (2.0861995220184326) | > loss_disc_real_0: 0.20024847984313965 (0.20024847984313965) | > loss_disc_real_1: 0.1793651282787323 (0.1793651282787323) | > loss_disc_real_2: 0.18798546493053436 (0.18798546493053436) | > loss_disc_real_3: 0.16602101922035217 (0.16602101922035217) | > loss_disc_real_4: 0.18146410584449768 (0.18146410584449768) | > loss_disc_real_5: 0.2638930380344391 (0.2638930380344391) | > loss_0: 2.0861995220184326 (2.0861995220184326) | > loss_gen: 2.573512077331543 (2.573512077331543) | > loss_kl: 3.326160192489624 (3.326160192489624) | > loss_feat: 6.994338035583496 (6.994338035583496) | > loss_mel: 23.8875789642334 (23.8875789642334) | > loss_duration: 2.5121519565582275 (2.5121519565582275) | > loss_1: 39.29374313354492 (39.29374313354492)  --> STEP: 1 | > loss_disc: 2.4893298149108887 (2.4893298149108887) | > loss_disc_real_0: 0.18860626220703125 (0.18860626220703125) | > loss_disc_real_1: 0.18646472692489624 (0.18646472692489624) | > loss_disc_real_2: 0.19098274409770966 (0.19098274409770966) | > loss_disc_real_3: 0.2556963264942169 (0.2556963264942169) | > loss_disc_real_4: 0.2576327919960022 (0.2576327919960022) | > loss_disc_real_5: 0.23411712050437927 (0.23411712050437927) | > loss_0: 2.4893298149108887 (2.4893298149108887) | > loss_gen: 2.1317968368530273 (2.1317968368530273) | > loss_kl: 3.9623467922210693 (3.9623467922210693) | > loss_feat: 4.871212959289551 (4.871212959289551) | > loss_mel: 24.65911102294922 (24.65911102294922) | > loss_duration: 2.9356043338775635 (2.9356043338775635) | > loss_1: 38.56007385253906 (38.56007385253906)  --> STEP: 2 | > loss_disc: 2.822463035583496 (2.6558964252471924) | > loss_disc_real_0: 0.24583645164966583 (0.21722135692834854) | > loss_disc_real_1: 0.18949687480926514 (0.1879808008670807) | > loss_disc_real_2: 0.12891137599945068 (0.15994706004858017) | > loss_disc_real_3: 0.1941181868314743 (0.2249072566628456) | > loss_disc_real_4: 0.12237949669361115 (0.19000614434480667) | > loss_disc_real_5: 0.15818767249584198 (0.19615239650011063) | > loss_0: 2.822463035583496 (2.6558964252471924) | > loss_gen: 2.0608816146850586 (2.096339225769043) | > loss_kl: 4.154263496398926 (4.058305144309998) | > loss_feat: 7.2440571784973145 (6.057635068893433) | > loss_mel: 24.04383659362793 (24.351473808288574) | > loss_duration: 2.633730888366699 (2.7846676111221313) | > loss_1: 40.13677215576172 (39.34842300415039)  --> STEP: 3 | > loss_disc: 2.909986734390259 (2.740593194961548) | > loss_disc_real_0: 0.1804647147655487 (0.20496914287408194) | > loss_disc_real_1: 0.2635543644428253 (0.21317198872566223) | > loss_disc_real_2: 0.2646937072277069 (0.1948626091082891) | > loss_disc_real_3: 0.25915852189064026 (0.2363243450721105) | > loss_disc_real_4: 0.22990494966506958 (0.20330574611822763) | > loss_disc_real_5: 0.2835342288017273 (0.22527967393398285) | > loss_0: 2.909986734390259 (2.740593194961548) | > loss_gen: 1.5789382457733154 (1.9238722324371338) | > loss_kl: 1.7681134939193726 (3.2949079275131226) | > loss_feat: 0.2698930501937866 (4.128387729326884) | > loss_mel: 13.804655075073242 (20.835867563883465) | > loss_duration: 2.6319470405578613 (2.7337607542673745) | > loss_1: 20.053546905517578 (32.91679763793945) --> EVAL PERFORMANCE | > avg_loader_time: 0.010108629862467447 (-0.0007912317911783866) | > avg_loss_disc: 2.740593194961548 (+0.5005963643391929) | > avg_loss_disc_real_0: 0.20496914287408194 (+0.11088629066944124) | > avg_loss_disc_real_1: 0.21317198872566223 (-0.028105611602465302) | > avg_loss_disc_real_2: 0.1948626091082891 (+0.005099986990292876) | > avg_loss_disc_real_3: 0.2363243450721105 (+0.04773581027984619) | > avg_loss_disc_real_4: 0.20330574611822763 (+0.01594995086391765) | > avg_loss_disc_real_5: 0.22527967393398285 (+0.07438524253666401) | > avg_loss_0: 2.740593194961548 (+0.5005963643391929) | > avg_loss_gen: 1.9238722324371338 (-0.23645782470703125) | > avg_loss_kl: 3.2949079275131226 (+0.137046217918396) | > avg_loss_feat: 4.128387729326884 (-2.679041624069214) | > avg_loss_mel: 20.835867563883465 (-3.530070622762043) | > avg_loss_duration: 2.7337607542673745 (+0.02929313977559378) | > avg_loss_1: 32.91679763793945 (-6.2792275746663435)  > EPOCH: 386/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:53:42)   --> TIME: 2023-10-20 03:54:01 -- STEP: 29/50 -- GLOBAL_STEP: 72330 | > loss_disc: 2.8339293003082275 (2.501309842898928) | > loss_disc_real_0: 0.14075207710266113 (0.14510596810101434) | > loss_disc_real_1: 0.3061450719833374 (0.21611570509086395) | > loss_disc_real_2: 0.24433016777038574 (0.22998153366919222) | > loss_disc_real_3: 0.24643974006175995 (0.24364202752195555) | > loss_disc_real_4: 0.2830263078212738 (0.23844953342180314) | > loss_disc_real_5: 0.21539095044136047 (0.23343762331481638) | > loss_0: 2.8339293003082275 (2.501309842898928) | > grad_norm_0: tensor(2761.5491, device='cuda:0') (tensor(1700.5425, device='cuda:0')) | > loss_gen: 1.6894276142120361 (2.3468435016171685) | > loss_kl: 0.9041672945022583 (0.8874833851025022) | > loss_feat: 0.6586318016052246 (5.092520845604354) | > loss_mel: 16.07709503173828 (21.820177242673676) | > loss_duration: 1.4972971677780151 (1.5584525897585113) | > loss_1: 20.82662010192871 (31.705477582997297) | > grad_norm_1: tensor(15773.7344, device='cuda:0') (tensor(53599.9727, device='cuda:0')) | > current_lr_0: 0.00013595082500948043 | > current_lr_1: 0.00013595082500948043 | > step_time: 0.2975 (0.494172268900378) | > loader_time: 0.0254 (0.020402308168082403)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7535839080810547 (2.7535839080810547) | > loss_disc_real_0: 0.3081866204738617 (0.3081866204738617) | > loss_disc_real_1: 0.23390284180641174 (0.23390284180641174) | > loss_disc_real_2: 0.31485405564308167 (0.31485405564308167) | > loss_disc_real_3: 0.21759600937366486 (0.21759600937366486) | > loss_disc_real_4: 0.23163896799087524 (0.23163896799087524) | > loss_disc_real_5: 0.2573349177837372 (0.2573349177837372) | > loss_0: 2.7535839080810547 (2.7535839080810547) | > loss_gen: 2.3054845333099365 (2.3054845333099365) | > loss_kl: 2.885836601257324 (2.885836601257324) | > loss_feat: 5.421359539031982 (5.421359539031982) | > loss_mel: 25.363191604614258 (25.363191604614258) | > loss_duration: 2.501494884490967 (2.501494884490967) | > loss_1: 38.47736740112305 (38.47736740112305)  --> STEP: 1 | > loss_disc: 1.8130444288253784 (1.8130444288253784) | > loss_disc_real_0: 0.050803497433662415 (0.050803497433662415) | > loss_disc_real_1: 0.24677690863609314 (0.24677690863609314) | > loss_disc_real_2: 0.14987699687480927 (0.14987699687480927) | > loss_disc_real_3: 0.05133539065718651 (0.05133539065718651) | > loss_disc_real_4: 0.09810440987348557 (0.09810440987348557) | > loss_disc_real_5: 0.02244504541158676 (0.02244504541158676) | > loss_0: 1.8130444288253784 (1.8130444288253784) | > loss_gen: 2.3743796348571777 (2.3743796348571777) | > loss_kl: 3.9090936183929443 (3.9090936183929443) | > loss_feat: 13.908659934997559 (13.908659934997559) | > loss_mel: 28.137121200561523 (28.137121200561523) | > loss_duration: 2.7767603397369385 (2.7767603397369385) | > loss_1: 51.10601043701172 (51.10601043701172)  --> STEP: 2 | > loss_disc: 2.8400769233703613 (2.32656067609787) | > loss_disc_real_0: 0.08190833777189255 (0.06635591760277748) | > loss_disc_real_1: 0.3126703202724457 (0.2797236144542694) | > loss_disc_real_2: 0.23845535516738892 (0.1941661760210991) | > loss_disc_real_3: 0.26721253991127014 (0.15927396528422832) | > loss_disc_real_4: 0.19832849502563477 (0.14821645244956017) | > loss_disc_real_5: 0.3943859934806824 (0.20841551944613457) | > loss_0: 2.8400769233703613 (2.32656067609787) | > loss_gen: 2.1202120780944824 (2.24729585647583) | > loss_kl: 4.3710761070251465 (4.140084862709045) | > loss_feat: 9.324028015136719 (11.616343975067139) | > loss_mel: 26.920658111572266 (27.528889656066895) | > loss_duration: 2.658724308013916 (2.7177423238754272) | > loss_1: 45.39469909667969 (48.2503547668457)  --> STEP: 3 | > loss_disc: 2.9545552730560303 (2.535892208417257) | > loss_disc_real_0: 0.16559213399887085 (0.09943465640147527) | > loss_disc_real_1: 0.2699955105781555 (0.27648091316223145) | > loss_disc_real_2: 0.27198004722595215 (0.22010413308938345) | > loss_disc_real_3: 0.2679263949394226 (0.19549144183595976) | > loss_disc_real_4: 0.2567574083805084 (0.1843967710932096) | > loss_disc_real_5: 0.2537935674190521 (0.2235415354371071) | > loss_0: 2.9545552730560303 (2.535892208417257) | > loss_gen: 1.5446891784667969 (2.013093630472819) | > loss_kl: 1.9269646406173706 (3.4023781220118203) | > loss_feat: 0.1507188081741333 (7.794468919436137) | > loss_mel: 4.369929790496826 (19.809236367543537) | > loss_duration: 2.5614113807678223 (2.6656320095062256) | > loss_1: 10.55371379852295 (35.684807777404785) --> EVAL PERFORMANCE | > avg_loader_time: 0.009892145792643229 (-0.00021648406982421875) | > avg_loss_disc: 2.535892208417257 (-0.20470098654429103) | > avg_loss_disc_real_0: 0.09943465640147527 (-0.10553448647260667) | > avg_loss_disc_real_1: 0.27648091316223145 (+0.06330892443656921) | > avg_loss_disc_real_2: 0.22010413308938345 (+0.02524152398109436) | > avg_loss_disc_real_3: 0.19549144183595976 (-0.04083290323615074) | > avg_loss_disc_real_4: 0.1843967710932096 (-0.018908975025018038) | > avg_loss_disc_real_5: 0.2235415354371071 (-0.001738138496875763) | > avg_loss_0: 2.535892208417257 (-0.20470098654429103) | > avg_loss_gen: 2.013093630472819 (+0.08922139803568507) | > avg_loss_kl: 3.4023781220118203 (+0.10747019449869777) | > avg_loss_feat: 7.794468919436137 (+3.666081190109253) | > avg_loss_mel: 19.809236367543537 (-1.0266311963399275) | > avg_loss_duration: 2.6656320095062256 (-0.06812874476114894) | > avg_loss_1: 35.684807777404785 (+2.768010139465332)  > EPOCH: 387/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:54:22)   --> TIME: 2023-10-20 03:54:32 -- STEP: 9/50 -- GLOBAL_STEP: 72360 | > loss_disc: 2.699681520462036 (2.225931247075399) | > loss_disc_real_0: 0.10819526016712189 (0.1168102514412668) | > loss_disc_real_1: 0.2958797812461853 (0.20149021223187447) | > loss_disc_real_2: 0.4252220690250397 (0.2510818847351604) | > loss_disc_real_3: 0.3670174479484558 (0.23420057611333) | > loss_disc_real_4: 0.2272632122039795 (0.16026188743611178) | > loss_disc_real_5: 0.31337201595306396 (0.16853337838417953) | > loss_0: 2.699681520462036 (2.225931247075399) | > grad_norm_0: tensor(886.9236, device='cuda:0') (tensor(812.9761, device='cuda:0')) | > loss_gen: 2.6054415702819824 (2.5293378697501288) | > loss_kl: 0.8679965138435364 (0.8798506326145596) | > loss_feat: 4.925390243530273 (6.414879944589403) | > loss_mel: 20.985383987426758 (23.248592164781357) | > loss_duration: 1.5243308544158936 (1.5387839476267497) | > loss_1: 30.90854263305664 (34.61144468519423) | > grad_norm_1: tensor(32045.3184, device='cuda:0') (tensor(37817.2266, device='cuda:0')) | > current_lr_0: 0.00013581493364808958 | > current_lr_1: 0.00013581493364808958 | > step_time: 0.4966 (0.5610740184783936) | > loader_time: 0.0233 (0.014518843756781684)  --> TIME: 2023-10-20 03:54:48 -- STEP: 39/50 -- GLOBAL_STEP: 72390 | > loss_disc: 2.267374277114868 (2.5025676060945563) | > loss_disc_real_0: 0.053086236119270325 (0.15501267544161051) | > loss_disc_real_1: 0.20492614805698395 (0.22230929050308007) | > loss_disc_real_2: 0.1730787307024002 (0.23817469943792388) | > loss_disc_real_3: 0.2334061712026596 (0.24284441520770392) | > loss_disc_real_4: 0.17349429428577423 (0.22650508157526836) | > loss_disc_real_5: 0.12508903443813324 (0.2168943636979048) | > loss_0: 2.267374277114868 (2.5025676060945563) | > grad_norm_0: tensor(875.2097, device='cuda:0') (tensor(1325.9216, device='cuda:0')) | > loss_gen: 1.8355456590652466 (2.2822399200537276) | > loss_kl: 1.009506106376648 (0.8845735054749709) | > loss_feat: 2.826582908630371 (4.733673007728962) | > loss_mel: 18.085269927978516 (21.219554363152916) | > loss_duration: 1.6134791374206543 (1.5304230543283315) | > loss_1: 25.370386123657227 (30.6504639845628) | > grad_norm_1: tensor(30549.7383, device='cuda:0') (tensor(51225.9297, device='cuda:0')) | > current_lr_0: 0.00013581493364808958 | > current_lr_1: 0.00013581493364808958 | > step_time: 0.63 (0.5217109643496) | > loader_time: 0.0048 (0.01804793798006498)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0172479152679443 (3.0172479152679443) | > loss_disc_real_0: 0.38066941499710083 (0.38066941499710083) | > loss_disc_real_1: 0.1308615654706955 (0.1308615654706955) | > loss_disc_real_2: 0.3086858093738556 (0.3086858093738556) | > loss_disc_real_3: 0.27590709924697876 (0.27590709924697876) | > loss_disc_real_4: 0.426327645778656 (0.426327645778656) | > loss_disc_real_5: 0.4373440742492676 (0.4373440742492676) | > loss_0: 3.0172479152679443 (3.0172479152679443) | > loss_gen: 2.490119457244873 (2.490119457244873) | > loss_kl: 3.1418838500976562 (3.1418838500976562) | > loss_feat: 5.876104831695557 (5.876104831695557) | > loss_mel: 24.031841278076172 (24.031841278076172) | > loss_duration: 2.5652077198028564 (2.5652077198028564) | > loss_1: 38.10515594482422 (38.10515594482422)  --> STEP: 1 | > loss_disc: 2.634042739868164 (2.634042739868164) | > loss_disc_real_0: 0.10470934212207794 (0.10470934212207794) | > loss_disc_real_1: 0.20586343109607697 (0.20586343109607697) | > loss_disc_real_2: 0.3188827335834503 (0.3188827335834503) | > loss_disc_real_3: 0.14708605408668518 (0.14708605408668518) | > loss_disc_real_4: 0.21115846931934357 (0.21115846931934357) | > loss_disc_real_5: 0.2863539159297943 (0.2863539159297943) | > loss_0: 2.634042739868164 (2.634042739868164) | > loss_gen: 1.9064733982086182 (1.9064733982086182) | > loss_kl: 3.4840855598449707 (3.4840855598449707) | > loss_feat: 5.944767951965332 (5.944767951965332) | > loss_mel: 25.484512329101562 (25.484512329101562) | > loss_duration: 2.6718616485595703 (2.6718616485595703) | > loss_1: 39.49170684814453 (39.49170684814453)  --> STEP: 2 | > loss_disc: 0.9621965885162354 (1.7981196641921997) | > loss_disc_real_0: 0.023945096880197525 (0.06432721950113773) | > loss_disc_real_1: 0.16038204729557037 (0.18312273919582367) | > loss_disc_real_2: 0.09224560856819153 (0.20556417107582092) | > loss_disc_real_3: 0.09379222244024277 (0.12043913826346397) | > loss_disc_real_4: 0.024953121319413185 (0.11805579531937838) | > loss_disc_real_5: 0.03981172665953636 (0.16308282129466534) | > loss_0: 0.9621965885162354 (1.7981196641921997) | > loss_gen: 4.949820041656494 (3.428146719932556) | > loss_kl: 4.681325435638428 (4.082705497741699) | > loss_feat: 15.67880630493164 (10.811787128448486) | > loss_mel: 30.87607192993164 (28.1802921295166) | > loss_duration: 2.7268457412719727 (2.6993536949157715) | > loss_1: 58.912872314453125 (49.20228958129883)  --> STEP: 3 | > loss_disc: 3.050678014755249 (2.215639114379883) | > loss_disc_real_0: 0.1724649965763092 (0.10037314519286156) | > loss_disc_real_1: 0.3154834806919098 (0.2272429863611857) | > loss_disc_real_2: 0.47406721115112305 (0.29506518443425495) | > loss_disc_real_3: 0.3276079595088959 (0.18949541201194128) | > loss_disc_real_4: 0.32155516743659973 (0.18588891935845217) | > loss_disc_real_5: 0.5178987979888916 (0.2813548135260741) | > loss_0: 3.050678014755249 (2.215639114379883) | > loss_gen: 2.430070400238037 (3.0954546133677163) | > loss_kl: 2.095442771911621 (3.4202845891316733) | > loss_feat: 3.5304367542266846 (8.38467033704122) | > loss_mel: 27.049522399902344 (27.803368886311848) | > loss_duration: 2.642674684524536 (2.6804606914520264) | > loss_1: 37.74814224243164 (45.3842404683431) --> EVAL PERFORMANCE | > avg_loader_time: 0.007816235224405924 (-0.0020759105682373047) | > avg_loss_disc: 2.215639114379883 (-0.320253094037374) | > avg_loss_disc_real_0: 0.10037314519286156 (+0.000938488791386291) | > avg_loss_disc_real_1: 0.2272429863611857 (-0.049237926801045745) | > avg_loss_disc_real_2: 0.29506518443425495 (+0.0749610513448715) | > avg_loss_disc_real_3: 0.18949541201194128 (-0.005996029824018478) | > avg_loss_disc_real_4: 0.18588891935845217 (+0.0014921482652425766) | > avg_loss_disc_real_5: 0.2813548135260741 (+0.057813278088967024) | > avg_loss_0: 2.215639114379883 (-0.320253094037374) | > avg_loss_gen: 3.0954546133677163 (+1.0823609828948975) | > avg_loss_kl: 3.4202845891316733 (+0.017906467119852998) | > avg_loss_feat: 8.38467033704122 (+0.5902014176050825) | > avg_loss_mel: 27.803368886311848 (+7.9941325187683105) | > avg_loss_duration: 2.6804606914520264 (+0.014828681945800781) | > avg_loss_1: 45.3842404683431 (+9.699432690938316)  > EPOCH: 388/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:55:05)   --> TIME: 2023-10-20 03:55:16 -- STEP: 19/50 -- GLOBAL_STEP: 72420 | > loss_disc: 2.662179470062256 (2.4061699164541146) | > loss_disc_real_0: 0.28134238719940186 (0.16718735996829837) | > loss_disc_real_1: 0.2682117223739624 (0.2214238937748106) | > loss_disc_real_2: 0.35536396503448486 (0.2544602328225186) | > loss_disc_real_3: 0.2885190546512604 (0.22854458383823695) | > loss_disc_real_4: 0.32250329852104187 (0.20476456398242399) | > loss_disc_real_5: 0.4033513069152832 (0.24108537217896236) | > loss_0: 2.662179470062256 (2.4061699164541146) | > grad_norm_0: tensor(934.7173, device='cuda:0') (tensor(1603.5406, device='cuda:0')) | > loss_gen: 2.860973358154297 (2.450624051846956) | > loss_kl: 0.7729552388191223 (0.8939867301991111) | > loss_feat: 3.515789270401001 (5.516035972065048) | > loss_mel: 22.41434097290039 (21.205568821806658) | > loss_duration: 1.595824956893921 (1.557653031851116) | > loss_1: 31.159883499145508 (31.62386844032689) | > grad_norm_1: tensor(13916.7207, device='cuda:0') (tensor(50075.4219, device='cuda:0')) | > current_lr_0: 0.00013567917811862243 | > current_lr_1: 0.00013567917811862243 | > step_time: 0.3227 (0.3952928969734593) | > loader_time: 0.0165 (0.014291913885819284)  --> TIME: 2023-10-20 03:55:29 -- STEP: 49/50 -- GLOBAL_STEP: 72450 | > loss_disc: 2.7432713508605957 (2.4496746574129378) | > loss_disc_real_0: 0.011581321246922016 (0.15980157482304744) | > loss_disc_real_1: 0.28359749913215637 (0.23149958617833197) | > loss_disc_real_2: 0.2429584562778473 (0.24360372034870847) | > loss_disc_real_3: 0.3113492727279663 (0.24077455881907014) | > loss_disc_real_4: 0.24206936359405518 (0.22626267571230324) | > loss_disc_real_5: 0.27007386088371277 (0.2483800474022116) | > loss_0: 2.7432713508605957 (2.4496746574129378) | > grad_norm_0: tensor(3718.8870, device='cuda:0') (tensor(1423.5781, device='cuda:0')) | > loss_gen: 1.9737519025802612 (2.4146202097133713) | > loss_kl: 0.8470792174339294 (0.9158370018917688) | > loss_feat: 1.5776668787002563 (5.521672761866026) | > loss_mel: 22.868383407592773 (21.61236164764482) | > loss_duration: 1.661099910736084 (1.5267461586971671) | > loss_1: 28.927980422973633 (31.99123746521618) | > grad_norm_1: tensor(7225.6929, device='cuda:0') (tensor(42437.1094, device='cuda:0')) | > current_lr_0: 0.00013567917811862243 | > current_lr_1: 0.00013567917811862243 | > step_time: 0.2659 (0.39872210852953843) | > loader_time: 0.3649 (0.018517849396686166)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7385506629943848 (2.7385506629943848) | > loss_disc_real_0: 0.06735731661319733 (0.06735731661319733) | > loss_disc_real_1: 0.3164287805557251 (0.3164287805557251) | > loss_disc_real_2: 0.3148113191127777 (0.3148113191127777) | > loss_disc_real_3: 0.3087214231491089 (0.3087214231491089) | > loss_disc_real_4: 0.48408323526382446 (0.48408323526382446) | > loss_disc_real_5: 0.3613702058792114 (0.3613702058792114) | > loss_0: 2.7385506629943848 (2.7385506629943848) | > loss_gen: 2.7812674045562744 (2.7812674045562744) | > loss_kl: 3.4134581089019775 (3.4134581089019775) | > loss_feat: 9.214595794677734 (9.214595794677734) | > loss_mel: 22.657915115356445 (22.657915115356445) | > loss_duration: 2.4752206802368164 (2.4752206802368164) | > loss_1: 40.542457580566406 (40.542457580566406)  --> STEP: 1 | > loss_disc: 2.6943295001983643 (2.6943295001983643) | > loss_disc_real_0: 0.30159303545951843 (0.30159303545951843) | > loss_disc_real_1: 0.23345428705215454 (0.23345428705215454) | > loss_disc_real_2: 0.18853271007537842 (0.18853271007537842) | > loss_disc_real_3: 0.2669922113418579 (0.2669922113418579) | > loss_disc_real_4: 0.240228533744812 (0.240228533744812) | > loss_disc_real_5: 0.18500767648220062 (0.18500767648220062) | > loss_0: 2.6943295001983643 (2.6943295001983643) | > loss_gen: 2.0190610885620117 (2.0190610885620117) | > loss_kl: 3.8106801509857178 (3.8106801509857178) | > loss_feat: 5.200366973876953 (5.200366973876953) | > loss_mel: 25.006677627563477 (25.006677627563477) | > loss_duration: 2.726834774017334 (2.726834774017334) | > loss_1: 38.76361846923828 (38.76361846923828)  --> STEP: 2 | > loss_disc: 2.4087531566619873 (2.551541328430176) | > loss_disc_real_0: 0.03417371213436127 (0.16788337379693985) | > loss_disc_real_1: 0.22185000777244568 (0.2276521474123001) | > loss_disc_real_2: 0.23516973853111267 (0.21185122430324554) | > loss_disc_real_3: 0.21758019924163818 (0.24228620529174805) | > loss_disc_real_4: 0.2828671634197235 (0.26154784858226776) | > loss_disc_real_5: 0.16969867050647736 (0.177353173494339) | > loss_0: 2.4087531566619873 (2.551541328430176) | > loss_gen: 1.919324517250061 (1.9691928029060364) | > loss_kl: 4.544064998626709 (4.177372574806213) | > loss_feat: 4.285455703735352 (4.742911338806152) | > loss_mel: 23.981992721557617 (24.494335174560547) | > loss_duration: 2.7896888256073 (2.758261799812317) | > loss_1: 37.52052688598633 (38.142072677612305)  --> STEP: 3 | > loss_disc: 2.9079418182373047 (2.6703414916992188) | > loss_disc_real_0: 0.15935659408569336 (0.165041113893191) | > loss_disc_real_1: 0.2429116815328598 (0.23273865878582) | > loss_disc_real_2: 0.24425938725471497 (0.2226539452870687) | > loss_disc_real_3: 0.2596386671066284 (0.2480703592300415) | > loss_disc_real_4: 0.24468177556991577 (0.2559258242448171) | > loss_disc_real_5: 0.27763131260871887 (0.21077921986579895) | > loss_0: 2.9079418182373047 (2.6703414916992188) | > loss_gen: 1.5242605209350586 (1.8208820422490437) | > loss_kl: 1.529626727104187 (3.2947906255722046) | > loss_feat: 0.3121515214443207 (3.2659913996855416) | > loss_mel: 15.51660442352295 (21.501758257548016) | > loss_duration: 2.515390396118164 (2.677304665247599) | > loss_1: 21.398035049438477 (32.56072680155436) --> EVAL PERFORMANCE | > avg_loader_time: 0.013829946517944336 (+0.006013711293538412) | > avg_loss_disc: 2.6703414916992188 (+0.45470237731933594) | > avg_loss_disc_real_0: 0.165041113893191 (+0.06466796870032945) | > avg_loss_disc_real_1: 0.23273865878582 (+0.005495672424634307) | > avg_loss_disc_real_2: 0.2226539452870687 (-0.07241123914718625) | > avg_loss_disc_real_3: 0.2480703592300415 (+0.05857494721810022) | > avg_loss_disc_real_4: 0.2559258242448171 (+0.07003690488636491) | > avg_loss_disc_real_5: 0.21077921986579895 (-0.07057559366027516) | > avg_loss_0: 2.6703414916992188 (+0.45470237731933594) | > avg_loss_gen: 1.8208820422490437 (-1.2745725711186726) | > avg_loss_kl: 3.2947906255722046 (-0.12549396355946874) | > avg_loss_feat: 3.2659913996855416 (-5.1186789373556785) | > avg_loss_mel: 21.501758257548016 (-6.301610628763832) | > avg_loss_duration: 2.677304665247599 (-0.0031560262044272314) | > avg_loss_1: 32.56072680155436 (-12.823513666788742)  > EPOCH: 389/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:55:39)   --> TIME: 2023-10-20 03:55:58 -- STEP: 29/50 -- GLOBAL_STEP: 72480 | > loss_disc: 2.0123753547668457 (2.3551020457826812) | > loss_disc_real_0: 0.1675063967704773 (0.14676390790605337) | > loss_disc_real_1: 0.12234862893819809 (0.21419465105081426) | > loss_disc_real_2: 0.12380652874708176 (0.2065322244989461) | > loss_disc_real_3: 0.17320577800273895 (0.24611339127195295) | > loss_disc_real_4: 0.2003326565027237 (0.23340489509804496) | > loss_disc_real_5: 0.25914493203163147 (0.23610818790721483) | > loss_0: 2.0123753547668457 (2.3551020457826812) | > grad_norm_0: tensor(765.3101, device='cuda:0') (tensor(991.3912, device='cuda:0')) | > loss_gen: 2.6081838607788086 (2.429534492821528) | > loss_kl: 0.8231044411659241 (0.9516283766976719) | > loss_feat: 6.234012603759766 (6.0723579191956025) | > loss_mel: 25.815189361572266 (24.072023687691523) | > loss_duration: 1.5453832149505615 (1.5424568735319992) | > loss_1: 37.025875091552734 (35.0680015169341) | > grad_norm_1: tensor(8019.4019, device='cuda:0') (tensor(37511.4297, device='cuda:0')) | > current_lr_0: 0.00013554355828530662 | > current_lr_1: 0.00013554355828530662 | > step_time: 0.285 (0.48694612239969187) | > loader_time: 0.0253 (0.018973029893020105)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.000246047973633 (3.000246047973633) | > loss_disc_real_0: 0.4371865391731262 (0.4371865391731262) | > loss_disc_real_1: 0.28359219431877136 (0.28359219431877136) | > loss_disc_real_2: 0.2234450727701187 (0.2234450727701187) | > loss_disc_real_3: 0.2569710910320282 (0.2569710910320282) | > loss_disc_real_4: 0.26900961995124817 (0.26900961995124817) | > loss_disc_real_5: 0.2927263081073761 (0.2927263081073761) | > loss_0: 3.000246047973633 (3.000246047973633) | > loss_gen: 1.9413340091705322 (1.9413340091705322) | > loss_kl: 2.8805718421936035 (2.8805718421936035) | > loss_feat: 0.29660436511039734 (0.29660436511039734) | > loss_mel: 10.118672370910645 (10.118672370910645) | > loss_duration: 2.499673843383789 (2.499673843383789) | > loss_1: 17.73685646057129 (17.73685646057129)  --> STEP: 1 | > loss_disc: 3.21071720123291 (3.21071720123291) | > loss_disc_real_0: 0.29975706338882446 (0.29975706338882446) | > loss_disc_real_1: 0.21952371299266815 (0.21952371299266815) | > loss_disc_real_2: 0.32394349575042725 (0.32394349575042725) | > loss_disc_real_3: 0.2281208485364914 (0.2281208485364914) | > loss_disc_real_4: 0.4300273060798645 (0.4300273060798645) | > loss_disc_real_5: 0.2557266056537628 (0.2557266056537628) | > loss_0: 3.21071720123291 (3.21071720123291) | > loss_gen: 2.137596845626831 (2.137596845626831) | > loss_kl: 3.2520387172698975 (3.2520387172698975) | > loss_feat: 7.174917221069336 (7.174917221069336) | > loss_mel: 26.77581214904785 (26.77581214904785) | > loss_duration: 2.865997791290283 (2.865997791290283) | > loss_1: 42.20635986328125 (42.20635986328125)  --> STEP: 2 | > loss_disc: 2.51699161529541 (2.86385440826416) | > loss_disc_real_0: 0.42277777194976807 (0.36126741766929626) | > loss_disc_real_1: 0.27964290976524353 (0.24958331137895584) | > loss_disc_real_2: 0.22415731847286224 (0.27405040711164474) | > loss_disc_real_3: 0.24943463504314423 (0.2387777417898178) | > loss_disc_real_4: 0.16762515902519226 (0.2988262325525284) | > loss_disc_real_5: 0.2823197841644287 (0.26902319490909576) | > loss_0: 2.51699161529541 (2.86385440826416) | > loss_gen: 3.7347803115844727 (2.936188578605652) | > loss_kl: 3.9761180877685547 (3.614078402519226) | > loss_feat: 7.251971244812012 (7.213444232940674) | > loss_mel: 28.1417293548584 (27.458770751953125) | > loss_duration: 2.816192388534546 (2.8410950899124146) | > loss_1: 45.92079162597656 (44.063575744628906)  --> STEP: 3 | > loss_disc: 3.0686120986938477 (2.9321069717407227) | > loss_disc_real_0: 0.44093212485313416 (0.3878223200639089) | > loss_disc_real_1: 0.28364238142967224 (0.26093633472919464) | > loss_disc_real_2: 0.22359725832939148 (0.2572326908508937) | > loss_disc_real_3: 0.2573750913143158 (0.2449768582979838) | > loss_disc_real_4: 0.26888614892959595 (0.2888462046782176) | > loss_disc_real_5: 0.2928091585636139 (0.2769518494606018) | > loss_0: 3.0686120986938477 (2.9321069717407227) | > loss_gen: 1.7645034790039062 (2.5456268787384033) | > loss_kl: 1.798636555671692 (3.008931120236715) | > loss_feat: 0.03729572519659996 (4.821394730359316) | > loss_mel: 2.387063503265381 (19.101535002390545) | > loss_duration: 2.598034620285034 (2.7600749333699546) | > loss_1: 8.58553409576416 (32.23756186167399) --> EVAL PERFORMANCE | > avg_loader_time: 0.003108501434326172 (-0.010721445083618164) | > avg_loss_disc: 2.9321069717407227 (+0.2617654800415039) | > avg_loss_disc_real_0: 0.3878223200639089 (+0.22278120617071787) | > avg_loss_disc_real_1: 0.26093633472919464 (+0.028197675943374634) | > avg_loss_disc_real_2: 0.2572326908508937 (+0.03457874556382498) | > avg_loss_disc_real_3: 0.2449768582979838 (-0.003093500932057708) | > avg_loss_disc_real_4: 0.2888462046782176 (+0.03292038043340051) | > avg_loss_disc_real_5: 0.2769518494606018 (+0.06617262959480286) | > avg_loss_0: 2.9321069717407227 (+0.2617654800415039) | > avg_loss_gen: 2.5456268787384033 (+0.7247448364893596) | > avg_loss_kl: 3.008931120236715 (-0.28585950533548976) | > avg_loss_feat: 4.821394730359316 (+1.5554033306737742) | > avg_loss_mel: 19.101535002390545 (-2.4002232551574707) | > avg_loss_duration: 2.7600749333699546 (+0.08277026812235544) | > avg_loss_1: 32.23756186167399 (-0.3231649398803711)  > EPOCH: 390/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:56:20)   --> TIME: 2023-10-20 03:56:29 -- STEP: 9/50 -- GLOBAL_STEP: 72510 | > loss_disc: 2.9408020973205566 (2.7637897729873657) | > loss_disc_real_0: 0.22581680119037628 (0.1614832700126701) | > loss_disc_real_1: 0.26041722297668457 (0.262758479350143) | > loss_disc_real_2: 0.2602672576904297 (0.22439591917726728) | > loss_disc_real_3: 0.34534427523612976 (0.2541915285918448) | > loss_disc_real_4: 0.2251051515340805 (0.22215683509906134) | > loss_disc_real_5: 0.2810550034046173 (0.25242198010285694) | > loss_0: 2.9408020973205566 (2.7637897729873657) | > grad_norm_0: tensor(562.2915, device='cuda:0') (tensor(847.5710, device='cuda:0')) | > loss_gen: 1.763614535331726 (1.964267439312405) | > loss_kl: 0.6473524570465088 (0.8749374945958456) | > loss_feat: 1.079072117805481 (4.936080346918768) | > loss_mel: 6.66552734375 (17.507653448316788) | > loss_duration: 1.5347521305084229 (1.5235216750038996) | > loss_1: 11.69031810760498 (26.806460009680855) | > grad_norm_1: tensor(32045.2539, device='cuda:0') (tensor(37546.7422, device='cuda:0')) | > current_lr_0: 0.00013540807401250527 | > current_lr_1: 0.00013540807401250527 | > step_time: 0.2879 (0.51385498046875) | > loader_time: 0.0209 (0.010115120146009658)  --> TIME: 2023-10-20 03:56:44 -- STEP: 39/50 -- GLOBAL_STEP: 72540 | > loss_disc: 2.6025898456573486 (2.58440148524749) | > loss_disc_real_0: 0.2165045440196991 (0.15257405642515573) | > loss_disc_real_1: 0.24918250739574432 (0.24257745813482848) | > loss_disc_real_2: 0.21346600353717804 (0.24415490079002503) | > loss_disc_real_3: 0.23269475996494293 (0.2496066027535843) | > loss_disc_real_4: 0.20458000898361206 (0.2234279342377797) | > loss_disc_real_5: 0.1581891030073166 (0.2347397771783364) | > loss_0: 2.6025898456573486 (2.58440148524749) | > grad_norm_0: tensor(900.4218, device='cuda:0') (tensor(1282.9982, device='cuda:0')) | > loss_gen: 1.7668949365615845 (2.1844044587551017) | > loss_kl: 0.7076101303100586 (0.9303145439196856) | > loss_feat: 1.7974772453308105 (4.712318840794838) | > loss_mel: 18.984588623046875 (21.154056475712704) | > loss_duration: 1.5435689687728882 (1.5198121529359083) | > loss_1: 24.800140380859375 (30.500906112866524) | > grad_norm_1: tensor(13912.3662, device='cuda:0') (tensor(31306.0391, device='cuda:0')) | > current_lr_0: 0.00013540807401250527 | > current_lr_1: 0.00013540807401250527 | > step_time: 0.3316 (0.48526514493502104) | > loader_time: 0.0252 (0.013952395854852138)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0835306644439697 (3.0835306644439697) | > loss_disc_real_0: 0.18770653009414673 (0.18770653009414673) | > loss_disc_real_1: 0.2521549165248871 (0.2521549165248871) | > loss_disc_real_2: 0.3065614700317383 (0.3065614700317383) | > loss_disc_real_3: 0.264238566160202 (0.264238566160202) | > loss_disc_real_4: 0.31145963072776794 (0.31145963072776794) | > loss_disc_real_5: 0.4586610198020935 (0.4586610198020935) | > loss_0: 3.0835306644439697 (3.0835306644439697) | > loss_gen: 1.8021506071090698 (1.8021506071090698) | > loss_kl: 3.405160665512085 (3.405160665512085) | > loss_feat: 0.13698866963386536 (0.13698866963386536) | > loss_mel: 13.396737098693848 (13.396737098693848) | > loss_duration: 2.4447760581970215 (2.4447760581970215) | > loss_1: 21.185813903808594 (21.185813903808594)  --> STEP: 1 | > loss_disc: 2.8400943279266357 (2.8400943279266357) | > loss_disc_real_0: 0.13071757555007935 (0.13071757555007935) | > loss_disc_real_1: 0.2217348963022232 (0.2217348963022232) | > loss_disc_real_2: 0.3075295388698578 (0.3075295388698578) | > loss_disc_real_3: 0.24949856102466583 (0.24949856102466583) | > loss_disc_real_4: 0.2655753493309021 (0.2655753493309021) | > loss_disc_real_5: 0.35593196749687195 (0.35593196749687195) | > loss_0: 2.8400943279266357 (2.8400943279266357) | > loss_gen: 1.9140777587890625 (1.9140777587890625) | > loss_kl: 3.449265956878662 (3.449265956878662) | > loss_feat: 1.359481692314148 (1.359481692314148) | > loss_mel: 9.267268180847168 (9.267268180847168) | > loss_duration: 2.7338571548461914 (2.7338571548461914) | > loss_1: 18.723949432373047 (18.723949432373047)  --> STEP: 2 | > loss_disc: 2.417067766189575 (2.6285810470581055) | > loss_disc_real_0: 0.10652127861976624 (0.11861942708492279) | > loss_disc_real_1: 0.15417706966400146 (0.18795598298311234) | > loss_disc_real_2: 0.1823682337999344 (0.2449488863348961) | > loss_disc_real_3: 0.17115941643714905 (0.21032898873090744) | > loss_disc_real_4: 0.29952025413513184 (0.28254780173301697) | > loss_disc_real_5: 0.4630435109138489 (0.4094877392053604) | > loss_0: 2.417067766189575 (2.6285810470581055) | > loss_gen: 2.898984909057617 (2.40653133392334) | > loss_kl: 3.8803458213806152 (3.6648058891296387) | > loss_feat: 7.7939324378967285 (4.576707065105438) | > loss_mel: 25.283430099487305 (17.275349140167236) | > loss_duration: 2.637092351913452 (2.6854747533798218) | > loss_1: 42.49378967285156 (30.608869552612305)  --> STEP: 3 | > loss_disc: 3.7829606533050537 (3.0133742491404214) | > loss_disc_real_0: 0.5563340187072754 (0.26452429095904034) | > loss_disc_real_1: 0.44749313592910767 (0.2744683672984441) | > loss_disc_real_2: 0.41099295020103455 (0.3002969076236089) | > loss_disc_real_3: 0.333048015832901 (0.25123533109823865) | > loss_disc_real_4: 0.35300859808921814 (0.3060347338517507) | > loss_disc_real_5: 0.544407308101654 (0.4544609288374583) | > loss_0: 3.7829606533050537 (3.0133742491404214) | > loss_gen: 2.3693270683288574 (2.394129912058512) | > loss_kl: 1.9773821830749512 (3.1023313204447427) | > loss_feat: 3.510006904602051 (4.221140344937642) | > loss_mel: 23.20918083190918 (19.25329303741455) | > loss_duration: 2.5470025539398193 (2.639317353566488) | > loss_1: 33.61289978027344 (31.610212961832683) --> EVAL PERFORMANCE | > avg_loader_time: 0.006354093551635742 (+0.0032455921173095703) | > avg_loss_disc: 3.0133742491404214 (+0.08126727739969875) | > avg_loss_disc_real_0: 0.26452429095904034 (-0.12329802910486853) | > avg_loss_disc_real_1: 0.2744683672984441 (+0.013532032569249453) | > avg_loss_disc_real_2: 0.3002969076236089 (+0.043064216772715214) | > avg_loss_disc_real_3: 0.25123533109823865 (+0.0062584728002548495) | > avg_loss_disc_real_4: 0.3060347338517507 (+0.017188529173533085) | > avg_loss_disc_real_5: 0.4544609288374583 (+0.1775090793768565) | > avg_loss_0: 3.0133742491404214 (+0.08126727739969875) | > avg_loss_gen: 2.394129912058512 (-0.1514969666798911) | > avg_loss_kl: 3.1023313204447427 (+0.09340020020802786) | > avg_loss_feat: 4.221140344937642 (-0.6002543854216738) | > avg_loss_mel: 19.25329303741455 (+0.15175803502400598) | > avg_loss_duration: 2.639317353566488 (-0.1207575798034668) | > avg_loss_1: 31.610212961832683 (-0.627348899841305)  > EPOCH: 391/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:56:59)   --> TIME: 2023-10-20 03:57:12 -- STEP: 19/50 -- GLOBAL_STEP: 72570 | > loss_disc: 1.5206297636032104 (2.5567532024885478) | > loss_disc_real_0: 0.014773399569094181 (0.17549233123856156) | > loss_disc_real_1: 0.23197337985038757 (0.24863302590031372) | > loss_disc_real_2: 0.04666972905397415 (0.239557355054115) | > loss_disc_real_3: 0.3041139841079712 (0.2582816226701987) | > loss_disc_real_4: 0.06196749210357666 (0.24329661754401116) | > loss_disc_real_5: 0.05177050083875656 (0.22400164486546265) | > loss_0: 1.5206297636032104 (2.5567532024885478) | > grad_norm_0: tensor(537.3806, device='cuda:0') (tensor(1173.6462, device='cuda:0')) | > loss_gen: 2.953367233276367 (2.3039500525123193) | > loss_kl: 0.9298292994499207 (0.9325914696643227) | > loss_feat: 9.85132122039795 (4.761118196735256) | > loss_mel: 26.88357925415039 (21.374484043372306) | > loss_duration: 1.5922200679779053 (1.5541978509802568) | > loss_1: 42.2103157043457 (30.92634173443443) | > grad_norm_1: tensor(31036.3105, device='cuda:0') (tensor(43068.0586, device='cuda:0')) | > current_lr_0: 0.00013527272516471715 | > current_lr_1: 0.00013527272516471715 | > step_time: 0.392 (0.46334837612352875) | > loader_time: 0.0062 (0.013973436857524668)  --> TIME: 2023-10-20 03:57:25 -- STEP: 49/50 -- GLOBAL_STEP: 72600 | > loss_disc: 2.958888053894043 (2.623649083838171) | > loss_disc_real_0: 0.28815945982933044 (0.17483595361438942) | > loss_disc_real_1: 0.2861747145652771 (0.24109759212148432) | > loss_disc_real_2: 0.28604575991630554 (0.23967374944869352) | > loss_disc_real_3: 0.2286793440580368 (0.2564576405043505) | > loss_disc_real_4: 0.26633337140083313 (0.2529684707370341) | > loss_disc_real_5: 0.30947360396385193 (0.23390801357371466) | > loss_0: 2.958888053894043 (2.623649083838171) | > grad_norm_0: tensor(524.7534, device='cuda:0') (tensor(1486.3386, device='cuda:0')) | > loss_gen: 1.8231427669525146 (2.1935893272867006) | > loss_kl: 1.026393175125122 (0.8524178248278949) | > loss_feat: 0.21710753440856934 (4.2487553348194576) | > loss_mel: 13.128671646118164 (20.148217772950932) | > loss_duration: 1.6537169218063354 (1.5282631431307112) | > loss_1: 17.849031448364258 (28.971243498276692) | > grad_norm_1: tensor(21890.4766, device='cuda:0') (tensor(44214.9922, device='cuda:0')) | > current_lr_0: 0.00013527272516471715 | > current_lr_1: 0.00013527272516471715 | > step_time: 0.345 (0.42367343999901597) | > loader_time: 0.4351 (0.018506702111691843)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8260698318481445 (2.8260698318481445) | > loss_disc_real_0: 0.3569355010986328 (0.3569355010986328) | > loss_disc_real_1: 0.24654999375343323 (0.24654999375343323) | > loss_disc_real_2: 0.23774369060993195 (0.23774369060993195) | > loss_disc_real_3: 0.26982975006103516 (0.26982975006103516) | > loss_disc_real_4: 0.2904660403728485 (0.2904660403728485) | > loss_disc_real_5: 0.34446385502815247 (0.34446385502815247) | > loss_0: 2.8260698318481445 (2.8260698318481445) | > loss_gen: 2.2595579624176025 (2.2595579624176025) | > loss_kl: 3.081479549407959 (3.081479549407959) | > loss_feat: 4.108047962188721 (4.108047962188721) | > loss_mel: 23.250415802001953 (23.250415802001953) | > loss_duration: 2.4055685997009277 (2.4055685997009277) | > loss_1: 35.10506820678711 (35.10506820678711)  --> STEP: 1 | > loss_disc: 2.347989559173584 (2.347989559173584) | > loss_disc_real_0: 0.2245052009820938 (0.2245052009820938) | > loss_disc_real_1: 0.23406685888767242 (0.23406685888767242) | > loss_disc_real_2: 0.2555491328239441 (0.2555491328239441) | > loss_disc_real_3: 0.18385544419288635 (0.18385544419288635) | > loss_disc_real_4: 0.205540731549263 (0.205540731549263) | > loss_disc_real_5: 0.3583270013332367 (0.3583270013332367) | > loss_0: 2.347989559173584 (2.347989559173584) | > loss_gen: 2.6628806591033936 (2.6628806591033936) | > loss_kl: 3.920474052429199 (3.920474052429199) | > loss_feat: 5.550964832305908 (5.550964832305908) | > loss_mel: 25.767839431762695 (25.767839431762695) | > loss_duration: 2.659205436706543 (2.659205436706543) | > loss_1: 40.56136703491211 (40.56136703491211)  --> STEP: 2 | > loss_disc: 2.501936435699463 (2.4249629974365234) | > loss_disc_real_0: 0.4717712998390198 (0.3481382504105568) | > loss_disc_real_1: 0.26047804951667786 (0.24727245420217514) | > loss_disc_real_2: 0.07683766633272171 (0.1661933995783329) | > loss_disc_real_3: 0.19214724004268646 (0.1880013421177864) | > loss_disc_real_4: 0.18957149982452393 (0.19755611568689346) | > loss_disc_real_5: 0.18829722702503204 (0.27331211417913437) | > loss_0: 2.501936435699463 (2.4249629974365234) | > loss_gen: 2.9471802711486816 (2.8050304651260376) | > loss_kl: 4.183297157287598 (4.051885604858398) | > loss_feat: 7.599916458129883 (6.5754406452178955) | > loss_mel: 25.422298431396484 (25.59506893157959) | > loss_duration: 2.6404738426208496 (2.6498396396636963) | > loss_1: 42.79316711425781 (41.67726707458496)  --> STEP: 3 | > loss_disc: 2.9127471446990967 (2.5875577131907144) | > loss_disc_real_0: 0.5578728318214417 (0.41804977754751843) | > loss_disc_real_1: 0.36867091059684753 (0.2877386063337326) | > loss_disc_real_2: 0.22800876200199127 (0.18679852038621902) | > loss_disc_real_3: 0.2825543284416199 (0.2195190042257309) | > loss_disc_real_4: 0.3258248567581177 (0.24031236271063486) | > loss_disc_real_5: 0.21205048263072968 (0.25289157032966614) | > loss_0: 2.9127471446990967 (2.5875577131907144) | > loss_gen: 2.455561399459839 (2.688540776570638) | > loss_kl: 1.828218936920166 (3.310663382212321) | > loss_feat: 2.7567975521087646 (5.3025596141815186) | > loss_mel: 19.947673797607422 (23.7126038869222) | > loss_duration: 2.6510400772094727 (2.6502397855122886) | > loss_1: 29.63928985595703 (37.664608001708984) --> EVAL PERFORMANCE | > avg_loader_time: 0.0032945473988850913 (-0.003059546152750651) | > avg_loss_disc: 2.5875577131907144 (-0.42581653594970703) | > avg_loss_disc_real_0: 0.41804977754751843 (+0.1535254865884781) | > avg_loss_disc_real_1: 0.2877386063337326 (+0.013270239035288511) | > avg_loss_disc_real_2: 0.18679852038621902 (-0.11349838723738986) | > avg_loss_disc_real_3: 0.2195190042257309 (-0.03171632687250775) | > avg_loss_disc_real_4: 0.24031236271063486 (-0.06572237114111582) | > avg_loss_disc_real_5: 0.25289157032966614 (-0.20156935850779217) | > avg_loss_0: 2.5875577131907144 (-0.42581653594970703) | > avg_loss_gen: 2.688540776570638 (+0.29441086451212595) | > avg_loss_kl: 3.310663382212321 (+0.20833206176757812) | > avg_loss_feat: 5.3025596141815186 (+1.0814192692438764) | > avg_loss_mel: 23.7126038869222 (+4.4593108495076486) | > avg_loss_duration: 2.6502397855122886 (+0.010922431945800781) | > avg_loss_1: 37.664608001708984 (+6.054395039876301)  > EPOCH: 392/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:57:37)   --> TIME: 2023-10-20 03:57:57 -- STEP: 29/50 -- GLOBAL_STEP: 72630 | > loss_disc: 2.0183866024017334 (2.3598407260302836) | > loss_disc_real_0: 0.21209722757339478 (0.1635940220720809) | > loss_disc_real_1: 0.21419057250022888 (0.23015767310200066) | > loss_disc_real_2: 0.18857918679714203 (0.19891926533831605) | > loss_disc_real_3: 0.2909995913505554 (0.24457298720191264) | > loss_disc_real_4: 0.08255564421415329 (0.18579947951667267) | > loss_disc_real_5: 0.14081378281116486 (0.18966190227917556) | > loss_0: 2.0183866024017334 (2.3598407260302836) | > grad_norm_0: tensor(1136.6627, device='cuda:0') (tensor(953.6356, device='cuda:0')) | > loss_gen: 3.3415277004241943 (2.5146132049889407) | > loss_kl: 0.662871241569519 (0.8555351002462979) | > loss_feat: 8.700809478759766 (6.292534028404746) | > loss_mel: 22.0882625579834 (22.930777266107757) | > loss_duration: 1.4890687465667725 (1.5562489690451786) | > loss_1: 36.282535552978516 (34.149707925730745) | > grad_norm_1: tensor(67903.5938, device='cuda:0') (tensor(53752.3320, device='cuda:0')) | > current_lr_0: 0.0001351375116065765 | > current_lr_1: 0.0001351375116065765 | > step_time: 0.5339 (0.5250820044813485) | > loader_time: 0.0024 (0.018059640095151704)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7129693031311035 (2.7129693031311035) | > loss_disc_real_0: 0.24474790692329407 (0.24474790692329407) | > loss_disc_real_1: 0.21342431008815765 (0.21342431008815765) | > loss_disc_real_2: 0.36679497361183167 (0.36679497361183167) | > loss_disc_real_3: 0.3072318136692047 (0.3072318136692047) | > loss_disc_real_4: 0.2515251636505127 (0.2515251636505127) | > loss_disc_real_5: 0.1874341070652008 (0.1874341070652008) | > loss_0: 2.7129693031311035 (2.7129693031311035) | > loss_gen: 2.0416266918182373 (2.0416266918182373) | > loss_kl: 3.2917187213897705 (3.2917187213897705) | > loss_feat: 3.227708578109741 (3.227708578109741) | > loss_mel: 24.392112731933594 (24.392112731933594) | > loss_duration: 2.4927639961242676 (2.4927639961242676) | > loss_1: 35.44593048095703 (35.44593048095703)  --> STEP: 1 | > loss_disc: 2.377697229385376 (2.377697229385376) | > loss_disc_real_0: 0.20761005580425262 (0.20761005580425262) | > loss_disc_real_1: 0.1740785390138626 (0.1740785390138626) | > loss_disc_real_2: 0.26636242866516113 (0.26636242866516113) | > loss_disc_real_3: 0.34181031584739685 (0.34181031584739685) | > loss_disc_real_4: 0.12360500544309616 (0.12360500544309616) | > loss_disc_real_5: 0.09101027995347977 (0.09101027995347977) | > loss_0: 2.377697229385376 (2.377697229385376) | > loss_gen: 2.096329689025879 (2.096329689025879) | > loss_kl: 4.032863616943359 (4.032863616943359) | > loss_feat: 6.58613920211792 (6.58613920211792) | > loss_mel: 23.564062118530273 (23.564062118530273) | > loss_duration: 2.8021583557128906 (2.8021583557128906) | > loss_1: 39.0815544128418 (39.0815544128418)  --> STEP: 2 | > loss_disc: 1.1481475830078125 (1.7629224061965942) | > loss_disc_real_0: 0.04822644591331482 (0.12791825085878372) | > loss_disc_real_1: 0.0859421119093895 (0.13001032546162605) | > loss_disc_real_2: 0.10427074879407883 (0.18531658872961998) | > loss_disc_real_3: 0.06846152245998383 (0.20513591915369034) | > loss_disc_real_4: 0.0769072026014328 (0.10025610402226448) | > loss_disc_real_5: 0.04746844992041588 (0.06923936493694782) | > loss_0: 1.1481475830078125 (1.7629224061965942) | > loss_gen: 4.052440166473389 (3.074384927749634) | > loss_kl: 4.37962007522583 (4.206241846084595) | > loss_feat: 16.07563018798828 (11.3308846950531) | > loss_mel: 27.43903350830078 (25.501547813415527) | > loss_duration: 2.769285202026367 (2.785721778869629) | > loss_1: 54.71601104736328 (46.89878273010254)  --> STEP: 3 | > loss_disc: 2.9300265312194824 (2.151957114537557) | > loss_disc_real_0: 0.30400216579437256 (0.18661288917064667) | > loss_disc_real_1: 0.3021247684955597 (0.18738180647293726) | > loss_disc_real_2: 0.2684919536113739 (0.21304171035687128) | > loss_disc_real_3: 0.2462325245141983 (0.218834787607193) | > loss_disc_real_4: 0.3088444769382477 (0.16978556166092554) | > loss_disc_real_5: 0.3310694992542267 (0.15651607637604079) | > loss_0: 2.9300265312194824 (2.151957114537557) | > loss_gen: 2.02057147026062 (2.723113775253296) | > loss_kl: 1.4033777713775635 (3.271953821182251) | > loss_feat: 1.8882949352264404 (8.18335477511088) | > loss_mel: 19.906213760375977 (23.636436462402344) | > loss_duration: 2.555511713027954 (2.7089850902557373) | > loss_1: 27.773969650268555 (40.52384503682455) --> EVAL PERFORMANCE | > avg_loader_time: 0.010195652643839518 (+0.006901105244954426) | > avg_loss_disc: 2.151957114537557 (-0.43560059865315726) | > avg_loss_disc_real_0: 0.18661288917064667 (-0.23143688837687176) | > avg_loss_disc_real_1: 0.18738180647293726 (-0.10035679986079535) | > avg_loss_disc_real_2: 0.21304171035687128 (+0.026243189970652253) | > avg_loss_disc_real_3: 0.218834787607193 (-0.0006842166185379028) | > avg_loss_disc_real_4: 0.16978556166092554 (-0.07052680104970932) | > avg_loss_disc_real_5: 0.15651607637604079 (-0.09637549395362535) | > avg_loss_0: 2.151957114537557 (-0.43560059865315726) | > avg_loss_gen: 2.723113775253296 (+0.03457299868265773) | > avg_loss_kl: 3.271953821182251 (-0.03870956103006984) | > avg_loss_feat: 8.18335477511088 (+2.8807951609293614) | > avg_loss_mel: 23.636436462402344 (-0.07616742451985559) | > avg_loss_duration: 2.7089850902557373 (+0.058745304743448745) | > avg_loss_1: 40.52384503682455 (+2.8592370351155623)  > EPOCH: 393/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:58:18)   --> TIME: 2023-10-20 03:58:26 -- STEP: 9/50 -- GLOBAL_STEP: 72660 | > loss_disc: 3.0335521697998047 (2.3446807066599527) | > loss_disc_real_0: 0.4226590692996979 (0.1607687340842353) | > loss_disc_real_1: 0.300315260887146 (0.2492134173711141) | > loss_disc_real_2: 0.24681749939918518 (0.23195168044832018) | > loss_disc_real_3: 0.2689201831817627 (0.24905447330739763) | > loss_disc_real_4: 0.25014856457710266 (0.18573605683114794) | > loss_disc_real_5: 0.23743510246276855 (0.20294937243064246) | > loss_0: 3.0335521697998047 (2.3446807066599527) | > grad_norm_0: tensor(993.7063, device='cuda:0') (tensor(1052.9216, device='cuda:0')) | > loss_gen: 1.6985218524932861 (2.5895231829749212) | > loss_kl: 0.4683930277824402 (0.6604422132174174) | > loss_feat: 0.10419812798500061 (6.817064301835166) | > loss_mel: 2.713999032974243 (22.260107702679104) | > loss_duration: 1.5292706489562988 (1.5501595205730863) | > loss_1: 6.514382839202881 (33.87729703055488) | > grad_norm_1: tensor(42359.9141, device='cuda:0') (tensor(34371.1328, device='cuda:0')) | > current_lr_0: 0.00013500243320285285 | > current_lr_1: 0.00013500243320285285 | > step_time: 0.4248 (0.40540944205390084) | > loader_time: 0.0358 (0.01640282736884223)  --> TIME: 2023-10-20 03:58:42 -- STEP: 39/50 -- GLOBAL_STEP: 72690 | > loss_disc: 2.969315528869629 (2.566242991349636) | > loss_disc_real_0: 0.20635807514190674 (0.16670456777016326) | > loss_disc_real_1: 0.2606704533100128 (0.22506826218122092) | > loss_disc_real_2: 0.25053030252456665 (0.24286761383215585) | > loss_disc_real_3: 0.23776566982269287 (0.24248007169136634) | > loss_disc_real_4: 0.2301001101732254 (0.25138561866986453) | > loss_disc_real_5: 0.21153771877288818 (0.23571116878436163) | > loss_0: 2.969315528869629 (2.566242991349636) | > grad_norm_0: tensor(805.0623, device='cuda:0') (tensor(1038.7408, device='cuda:0')) | > loss_gen: 1.4849255084991455 (2.3379689149367504) | > loss_kl: 0.6168219447135925 (0.8219650578804505) | > loss_feat: 0.1200794130563736 (5.004323202734575) | > loss_mel: 2.6282527446746826 (20.910443333479073) | > loss_duration: 1.5600942373275757 (1.520134381758861) | > loss_1: 6.4101738929748535 (30.594834780081726) | > grad_norm_1: tensor(30362.1074, device='cuda:0') (tensor(38204.2227, device='cuda:0')) | > current_lr_0: 0.00013500243320285285 | > current_lr_1: 0.00013500243320285285 | > step_time: 0.5766 (0.4956063429514567) | > loader_time: 0.0246 (0.016080373372787084)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4819695949554443 (2.4819695949554443) | > loss_disc_real_0: 0.32719695568084717 (0.32719695568084717) | > loss_disc_real_1: 0.10705166310071945 (0.10705166310071945) | > loss_disc_real_2: 0.32889416813850403 (0.32889416813850403) | > loss_disc_real_3: 0.23288440704345703 (0.23288440704345703) | > loss_disc_real_4: 0.333760529756546 (0.333760529756546) | > loss_disc_real_5: 0.42636430263519287 (0.42636430263519287) | > loss_0: 2.4819695949554443 (2.4819695949554443) | > loss_gen: 3.2143337726593018 (3.2143337726593018) | > loss_kl: 2.902724266052246 (2.902724266052246) | > loss_feat: 6.14995813369751 (6.14995813369751) | > loss_mel: 20.331295013427734 (20.331295013427734) | > loss_duration: 2.4263880252838135 (2.4263880252838135) | > loss_1: 35.02470016479492 (35.02470016479492)  --> STEP: 1 | > loss_disc: 2.163395404815674 (2.163395404815674) | > loss_disc_real_0: 0.2864272892475128 (0.2864272892475128) | > loss_disc_real_1: 0.212954580783844 (0.212954580783844) | > loss_disc_real_2: 0.3698463439941406 (0.3698463439941406) | > loss_disc_real_3: 0.212632954120636 (0.212632954120636) | > loss_disc_real_4: 0.23730412125587463 (0.23730412125587463) | > loss_disc_real_5: 0.13364997506141663 (0.13364997506141663) | > loss_0: 2.163395404815674 (2.163395404815674) | > loss_gen: 3.111496925354004 (3.111496925354004) | > loss_kl: 4.1309895515441895 (4.1309895515441895) | > loss_feat: 7.181194305419922 (7.181194305419922) | > loss_mel: 25.778223037719727 (25.778223037719727) | > loss_duration: 2.7483954429626465 (2.7483954429626465) | > loss_1: 42.95029830932617 (42.95029830932617)  --> STEP: 2 | > loss_disc: 2.734039306640625 (2.4487173557281494) | > loss_disc_real_0: 0.2833873927593231 (0.28490734100341797) | > loss_disc_real_1: 0.18765871226787567 (0.20030664652585983) | > loss_disc_real_2: 0.3183848261833191 (0.34411558508872986) | > loss_disc_real_3: 0.2336174100637436 (0.2231251820921898) | > loss_disc_real_4: 0.20614729821681976 (0.2217257097363472) | > loss_disc_real_5: 0.31936824321746826 (0.22650910913944244) | > loss_0: 2.734039306640625 (2.4487173557281494) | > loss_gen: 2.256378173828125 (2.6839375495910645) | > loss_kl: 4.034768581390381 (4.082879066467285) | > loss_feat: 3.742802858352661 (5.4619985818862915) | > loss_mel: 28.147321701049805 (26.962772369384766) | > loss_duration: 2.648860216140747 (2.6986278295516968) | > loss_1: 40.83013153076172 (41.890214920043945)  --> STEP: 3 | > loss_disc: 3.193157434463501 (2.696864048639933) | > loss_disc_real_0: 0.7800266146659851 (0.44994709889094037) | > loss_disc_real_1: 0.30209246277809143 (0.23423525194327036) | > loss_disc_real_2: 0.32173675298690796 (0.33665597438812256) | > loss_disc_real_3: 0.2785399854183197 (0.24159678320089975) | > loss_disc_real_4: 0.2674828767776489 (0.23697809875011444) | > loss_disc_real_5: 0.2767393887042999 (0.24325253566106161) | > loss_0: 3.193157434463501 (2.696864048639933) | > loss_gen: 2.4632089138031006 (2.610361337661743) | > loss_kl: 2.1539804935455322 (3.4399128754933677) | > loss_feat: 2.1934750080108643 (4.3724907239278155) | > loss_mel: 21.653766632080078 (25.193103790283203) | > loss_duration: 2.6063344478607178 (2.667863368988037) | > loss_1: 31.07076644897461 (38.283732096354164) --> EVAL PERFORMANCE | > avg_loader_time: 0.027565479278564453 (+0.017369826634724937) | > avg_loss_disc: 2.696864048639933 (+0.544906934102376) | > avg_loss_disc_real_0: 0.44994709889094037 (+0.2633342097202937) | > avg_loss_disc_real_1: 0.23423525194327036 (+0.0468534454703331) | > avg_loss_disc_real_2: 0.33665597438812256 (+0.12361426403125128) | > avg_loss_disc_real_3: 0.24159678320089975 (+0.022761995593706758) | > avg_loss_disc_real_4: 0.23697809875011444 (+0.0671925370891889) | > avg_loss_disc_real_5: 0.24325253566106161 (+0.08673645928502083) | > avg_loss_0: 2.696864048639933 (+0.544906934102376) | > avg_loss_gen: 2.610361337661743 (-0.11275243759155273) | > avg_loss_kl: 3.4399128754933677 (+0.16795905431111668) | > avg_loss_feat: 4.3724907239278155 (-3.8108640511830645) | > avg_loss_mel: 25.193103790283203 (+1.5566673278808594) | > avg_loss_duration: 2.667863368988037 (-0.041121721267700195) | > avg_loss_1: 38.283732096354164 (-2.2401129404703823)  > EPOCH: 394/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:58:57)   --> TIME: 2023-10-20 03:59:10 -- STEP: 19/50 -- GLOBAL_STEP: 72720 | > loss_disc: 2.3135392665863037 (2.46582651765723) | > loss_disc_real_0: 0.1673465371131897 (0.18543894422289572) | > loss_disc_real_1: 0.33412885665893555 (0.21439632283229576) | > loss_disc_real_2: 0.20177344977855682 (0.22742088099843577) | > loss_disc_real_3: 0.18379124999046326 (0.2372194508972921) | > loss_disc_real_4: 0.24902980029582977 (0.21938639619436703) | > loss_disc_real_5: 0.17215000092983246 (0.24328872674193822) | > loss_0: 2.3135392665863037 (2.46582651765723) | > grad_norm_0: tensor(653.4852, device='cuda:0') (tensor(1457.3123, device='cuda:0')) | > loss_gen: 2.4490716457366943 (2.293795253101148) | > loss_kl: 0.9254407286643982 (0.9178477557081925) | > loss_feat: 5.902270793914795 (4.615841314196587) | > loss_mel: 22.954309463500977 (20.741309423195688) | > loss_duration: 1.6381889581680298 (1.5709480109967684) | > loss_1: 33.86927795410156 (30.139741872486315) | > grad_norm_1: tensor(32332.7148, device='cuda:0') (tensor(36749.7461, device='cuda:0')) | > current_lr_0: 0.00013486748981845096 | > current_lr_1: 0.00013486748981845096 | > step_time: 0.2806 (0.4689060888792339) | > loader_time: 0.0036 (0.017745043102063623)  --> TIME: 2023-10-20 03:59:21 -- STEP: 49/50 -- GLOBAL_STEP: 72750 | > loss_disc: 1.8468875885009766 (2.3113631837222046) | > loss_disc_real_0: 0.21971459686756134 (0.15810376903688422) | > loss_disc_real_1: 0.2316029816865921 (0.19856588869374625) | > loss_disc_real_2: 0.16624236106872559 (0.21554965480249755) | > loss_disc_real_3: 0.11486189812421799 (0.2138780721140151) | > loss_disc_real_4: 0.05368150398135185 (0.19801418335956275) | > loss_disc_real_5: 0.19316352903842926 (0.22916450955886014) | > loss_0: 1.8468875885009766 (2.3113631837222046) | > grad_norm_0: tensor(630.7546, device='cuda:0') (tensor(1206.6639, device='cuda:0')) | > loss_gen: 2.7214765548706055 (2.3878509682051985) | > loss_kl: 0.8223715424537659 (0.8117769582539188) | > loss_feat: 7.278308391571045 (5.258675633492517) | > loss_mel: 24.837570190429688 (21.41957646243427) | > loss_duration: 1.6831642389297485 (1.5385443288452771) | > loss_1: 37.342891693115234 (31.41642443014651) | > grad_norm_1: tensor(30176.5527, device='cuda:0') (tensor(37933.0547, device='cuda:0')) | > current_lr_0: 0.00013486748981845096 | > current_lr_1: 0.00013486748981845096 | > step_time: 0.7019 (0.39356216119260207) | > loader_time: 0.4204 (0.01937555780216139)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8522827625274658 (1.8522827625274658) | > loss_disc_real_0: 0.13761937618255615 (0.13761937618255615) | > loss_disc_real_1: 0.20603123307228088 (0.20603123307228088) | > loss_disc_real_2: 0.2301691174507141 (0.2301691174507141) | > loss_disc_real_3: 0.25021782517433167 (0.25021782517433167) | > loss_disc_real_4: 0.1024458035826683 (0.1024458035826683) | > loss_disc_real_5: 0.07462941855192184 (0.07462941855192184) | > loss_0: 1.8522827625274658 (1.8522827625274658) | > loss_gen: 2.9328200817108154 (2.9328200817108154) | > loss_kl: 3.2898290157318115 (3.2898290157318115) | > loss_feat: 8.967416763305664 (8.967416763305664) | > loss_mel: 24.659025192260742 (24.659025192260742) | > loss_duration: 2.34089732170105 (2.34089732170105) | > loss_1: 42.18998718261719 (42.18998718261719)  --> STEP: 1 | > loss_disc: 2.334195852279663 (2.334195852279663) | > loss_disc_real_0: 0.13562002778053284 (0.13562002778053284) | > loss_disc_real_1: 0.3095317780971527 (0.3095317780971527) | > loss_disc_real_2: 0.2860828638076782 (0.2860828638076782) | > loss_disc_real_3: 0.46486273407936096 (0.46486273407936096) | > loss_disc_real_4: 0.24286893010139465 (0.24286893010139465) | > loss_disc_real_5: 0.1645890772342682 (0.1645890772342682) | > loss_0: 2.334195852279663 (2.334195852279663) | > loss_gen: 3.12819242477417 (3.12819242477417) | > loss_kl: 3.454970359802246 (3.454970359802246) | > loss_feat: 5.828372955322266 (5.828372955322266) | > loss_mel: 26.50909996032715 (26.50909996032715) | > loss_duration: 2.6074650287628174 (2.6074650287628174) | > loss_1: 41.528099060058594 (41.528099060058594)  --> STEP: 2 | > loss_disc: 2.4867095947265625 (2.410452723503113) | > loss_disc_real_0: 0.1778152585029602 (0.15671764314174652) | > loss_disc_real_1: 0.15121442079544067 (0.2303730994462967) | > loss_disc_real_2: 0.2068500518798828 (0.24646645784378052) | > loss_disc_real_3: 0.27196112275123596 (0.36841192841529846) | > loss_disc_real_4: 0.09066155552864075 (0.1667652428150177) | > loss_disc_real_5: 0.15920676290988922 (0.1618979200720787) | > loss_0: 2.4867095947265625 (2.410452723503113) | > loss_gen: 2.3272366523742676 (2.7277145385742188) | > loss_kl: 4.499590873718262 (3.977280616760254) | > loss_feat: 8.593019485473633 (7.210696220397949) | > loss_mel: 24.931215286254883 (25.720157623291016) | > loss_duration: 2.5933022499084473 (2.6003836393356323) | > loss_1: 42.944366455078125 (42.23623275756836)  --> STEP: 3 | > loss_disc: 3.160740375518799 (2.6605486075083413) | > loss_disc_real_0: 0.4770284593105316 (0.26348791519800824) | > loss_disc_real_1: 0.292208731174469 (0.2509849766890208) | > loss_disc_real_2: 0.3794836699962616 (0.29080552856127423) | > loss_disc_real_3: 0.2923101782798767 (0.3430446783701579) | > loss_disc_real_4: 0.38509124517440796 (0.23954057693481445) | > loss_disc_real_5: 0.41940054297447205 (0.2477321277062098) | > loss_0: 3.160740375518799 (2.6605486075083413) | > loss_gen: 2.4776201248168945 (2.644349733988444) | > loss_kl: 1.8063143491744995 (3.253625194231669) | > loss_feat: 1.3140095472335815 (5.245133996009827) | > loss_mel: 19.129364013671875 (23.523226420084637) | > loss_duration: 2.5020194053649902 (2.5675955613454184) | > loss_1: 27.229326248168945 (37.233930587768555) --> EVAL PERFORMANCE | > avg_loader_time: 0.012053648630777994 (-0.015511830647786459) | > avg_loss_disc: 2.6605486075083413 (-0.0363154411315918) | > avg_loss_disc_real_0: 0.26348791519800824 (-0.18645918369293213) | > avg_loss_disc_real_1: 0.2509849766890208 (+0.016749724745750455) | > avg_loss_disc_real_2: 0.29080552856127423 (-0.04585044582684833) | > avg_loss_disc_real_3: 0.3430446783701579 (+0.10144789516925815) | > avg_loss_disc_real_4: 0.23954057693481445 (+0.002562478184700012) | > avg_loss_disc_real_5: 0.2477321277062098 (+0.004479592045148195) | > avg_loss_0: 2.6605486075083413 (-0.0363154411315918) | > avg_loss_gen: 2.644349733988444 (+0.0339883963267007) | > avg_loss_kl: 3.253625194231669 (-0.1862876812616987) | > avg_loss_feat: 5.245133996009827 (+0.8726432720820112) | > avg_loss_mel: 23.523226420084637 (-1.6698773701985665) | > avg_loss_duration: 2.5675955613454184 (-0.10026780764261867) | > avg_loss_1: 37.233930587768555 (-1.0498015085856096)  > EPOCH: 395/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 03:59:36)   --> TIME: 2023-10-20 03:59:55 -- STEP: 29/50 -- GLOBAL_STEP: 72780 | > loss_disc: 2.87156343460083 (2.3719205363043425) | > loss_disc_real_0: 0.1151052936911583 (0.13258272261712062) | > loss_disc_real_1: 0.2021050602197647 (0.21764402579644632) | > loss_disc_real_2: 0.15455257892608643 (0.2246138097654129) | > loss_disc_real_3: 0.162644162774086 (0.23036928680436364) | > loss_disc_real_4: 0.27966803312301636 (0.2375530205538561) | > loss_disc_real_5: 0.37754207849502563 (0.25385549381889144) | > loss_0: 2.87156343460083 (2.3719205363043425) | > grad_norm_0: tensor(972.4152, device='cuda:0') (tensor(1121.3890, device='cuda:0')) | > loss_gen: 1.7250789403915405 (2.6286297050015675) | > loss_kl: 0.8664830327033997 (0.8868122403991634) | > loss_feat: 2.867656946182251 (6.924931746104668) | > loss_mel: 13.084856033325195 (23.989476236803778) | > loss_duration: 1.4959419965744019 (1.5601484282263394) | > loss_1: 20.040016174316406 (35.989998159737425) | > grad_norm_1: tensor(16311.8438, device='cuda:0') (tensor(41975.4102, device='cuda:0')) | > current_lr_0: 0.00013473268131841045 | > current_lr_1: 0.00013473268131841045 | > step_time: 0.5255 (0.5085974561757054) | > loader_time: 0.0252 (0.01914311277455297)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0602011680603027 (2.0602011680603027) | > loss_disc_real_0: 0.13068237900733948 (0.13068237900733948) | > loss_disc_real_1: 0.19051331281661987 (0.19051331281661987) | > loss_disc_real_2: 0.19844138622283936 (0.19844138622283936) | > loss_disc_real_3: 0.33455348014831543 (0.33455348014831543) | > loss_disc_real_4: 0.0961976945400238 (0.0961976945400238) | > loss_disc_real_5: 0.12114569544792175 (0.12114569544792175) | > loss_0: 2.0602011680603027 (2.0602011680603027) | > loss_gen: 2.6295173168182373 (2.6295173168182373) | > loss_kl: 3.5639727115631104 (3.5639727115631104) | > loss_feat: 6.602269172668457 (6.602269172668457) | > loss_mel: 21.35721206665039 (21.35721206665039) | > loss_duration: 2.535179376602173 (2.535179376602173) | > loss_1: 36.688148498535156 (36.688148498535156)  --> STEP: 1 | > loss_disc: 2.9040133953094482 (2.9040133953094482) | > loss_disc_real_0: 0.2107691764831543 (0.2107691764831543) | > loss_disc_real_1: 0.3199787735939026 (0.3199787735939026) | > loss_disc_real_2: 0.4019666314125061 (0.4019666314125061) | > loss_disc_real_3: 0.2930694818496704 (0.2930694818496704) | > loss_disc_real_4: 0.3257769048213959 (0.3257769048213959) | > loss_disc_real_5: 0.3140760064125061 (0.3140760064125061) | > loss_0: 2.9040133953094482 (2.9040133953094482) | > loss_gen: 2.367403745651245 (2.367403745651245) | > loss_kl: 3.953324317932129 (3.953324317932129) | > loss_feat: 3.6981191635131836 (3.6981191635131836) | > loss_mel: 24.383209228515625 (24.383209228515625) | > loss_duration: 2.6788461208343506 (2.6788461208343506) | > loss_1: 37.080902099609375 (37.080902099609375)  --> STEP: 2 | > loss_disc: 3.003796100616455 (2.9539047479629517) | > loss_disc_real_0: 0.28214094042778015 (0.24645505845546722) | > loss_disc_real_1: 0.21499645709991455 (0.26748761534690857) | > loss_disc_real_2: 0.24028097093105316 (0.32112380117177963) | > loss_disc_real_3: 0.27982306480407715 (0.2864462733268738) | > loss_disc_real_4: 0.20566482841968536 (0.2657208666205406) | > loss_disc_real_5: 0.27370184659957886 (0.2938889265060425) | > loss_0: 3.003796100616455 (2.9539047479629517) | > loss_gen: 1.5062696933746338 (1.9368367195129395) | > loss_kl: 3.930790901184082 (3.9420576095581055) | > loss_feat: 0.05069636553525925 (1.8744077645242214) | > loss_mel: 3.6737661361694336 (14.02848768234253) | > loss_duration: 2.6287617683410645 (2.6538039445877075) | > loss_1: 11.790285110473633 (24.435593605041504)  --> STEP: 3 | > loss_disc: 2.9935898780822754 (2.967133124669393) | > loss_disc_real_0: 0.13745300471782684 (0.21012104054292044) | > loss_disc_real_1: 0.23758508265018463 (0.2575201044480006) | > loss_disc_real_2: 0.3688477575778961 (0.3370317866404851) | > loss_disc_real_3: 0.31155404448509216 (0.2948155303796132) | > loss_disc_real_4: 0.268648236989975 (0.2666966567436854) | > loss_disc_real_5: 0.3108507990837097 (0.2995428840319316) | > loss_0: 2.9935898780822754 (2.967133124669393) | > loss_gen: 1.805423617362976 (1.8930323521296184) | > loss_kl: 1.6262844800949097 (3.1701332330703735) | > loss_feat: 3.718423366546631 (2.4890796318650246) | > loss_mel: 23.28669548034668 (17.114556948343914) | > loss_duration: 2.5203287601470947 (2.6093122164408364) | > loss_1: 32.957157135009766 (27.27611478169759) --> EVAL PERFORMANCE | > avg_loader_time: 0.014237403869628906 (+0.002183755238850912) | > avg_loss_disc: 2.967133124669393 (+0.30658451716105173) | > avg_loss_disc_real_0: 0.21012104054292044 (-0.0533668746550878) | > avg_loss_disc_real_1: 0.2575201044480006 (+0.006535127758979797) | > avg_loss_disc_real_2: 0.3370317866404851 (+0.04622625807921088) | > avg_loss_disc_real_3: 0.2948155303796132 (-0.048229147990544674) | > avg_loss_disc_real_4: 0.2666966567436854 (+0.02715607980887097) | > avg_loss_disc_real_5: 0.2995428840319316 (+0.05181075632572177) | > avg_loss_0: 2.967133124669393 (+0.30658451716105173) | > avg_loss_gen: 1.8930323521296184 (-0.7513173818588255) | > avg_loss_kl: 3.1701332330703735 (-0.08349196116129542) | > avg_loss_feat: 2.4890796318650246 (-2.756054364144802) | > avg_loss_mel: 17.114556948343914 (-6.408669471740723) | > avg_loss_duration: 2.6093122164408364 (+0.041716655095418) | > avg_loss_1: 27.27611478169759 (-9.957815806070965)  > EPOCH: 396/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:00:18)   --> TIME: 2023-10-20 04:00:25 -- STEP: 9/50 -- GLOBAL_STEP: 72810 | > loss_disc: 2.138456106185913 (2.5445782608456082) | > loss_disc_real_0: 0.07098449766635895 (0.13111875164839956) | > loss_disc_real_1: 0.24724610149860382 (0.3075840208265517) | > loss_disc_real_2: 0.28623440861701965 (0.31916968690024483) | > loss_disc_real_3: 0.11090095341205597 (0.27565564546320176) | > loss_disc_real_4: 0.23427635431289673 (0.2791106485658222) | > loss_disc_real_5: 0.28732869029045105 (0.25644449558522964) | > loss_0: 2.138456106185913 (2.5445782608456082) | > grad_norm_0: tensor(1306.5137, device='cuda:0') (tensor(856.4268, device='cuda:0')) | > loss_gen: 2.66402268409729 (2.531929850578308) | > loss_kl: 0.6583203077316284 (0.8357646365960439) | > loss_feat: 5.464328765869141 (4.372947090201908) | > loss_mel: 24.503828048706055 (19.782287491692436) | > loss_duration: 1.4975827932357788 (1.5367437336179945) | > loss_1: 34.788082122802734 (29.05967224968804) | > grad_norm_1: tensor(35323.6094, device='cuda:0') (tensor(55396.8281, device='cuda:0')) | > current_lr_0: 0.000134598007567906 | > current_lr_1: 0.000134598007567906 | > step_time: 0.3316 (0.36560821533203125) | > loader_time: 0.0167 (0.01128787464565701)  --> TIME: 2023-10-20 04:00:41 -- STEP: 39/50 -- GLOBAL_STEP: 72840 | > loss_disc: 1.676350474357605 (2.4845237273436327) | > loss_disc_real_0: 0.1275169849395752 (0.1699918950310885) | > loss_disc_real_1: 0.018685417249798775 (0.24424719605117262) | > loss_disc_real_2: 0.022312356159090996 (0.24537115233639872) | > loss_disc_real_3: 0.0281954575330019 (0.25009722993350947) | > loss_disc_real_4: 0.02673294022679329 (0.22566927386782107) | > loss_disc_real_5: 0.010310637764632702 (0.20937172898974937) | > loss_0: 1.676350474357605 (2.4845237273436327) | > grad_norm_0: tensor(1455.3663, device='cuda:0') (tensor(1167.8018, device='cuda:0')) | > loss_gen: 2.5026559829711914 (2.3268639154923267) | > loss_kl: 0.45460084080696106 (0.9007090070308783) | > loss_feat: 9.934736251831055 (4.6092096996039915) | > loss_mel: 25.682910919189453 (19.69759504611676) | > loss_duration: 1.5743756294250488 (1.5360459150412145) | > loss_1: 40.1492805480957 (29.07042339520577) | > grad_norm_1: tensor(113366.8359, device='cuda:0') (tensor(41401.4062, device='cuda:0')) | > current_lr_0: 0.000134598007567906 | > current_lr_1: 0.000134598007567906 | > step_time: 0.6036 (0.4810593556135129) | > loader_time: 0.025 (0.01416483903542543)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3325014114379883 (2.3325014114379883) | > loss_disc_real_0: 0.16739961504936218 (0.16739961504936218) | > loss_disc_real_1: 0.17594702541828156 (0.17594702541828156) | > loss_disc_real_2: 0.21168076992034912 (0.21168076992034912) | > loss_disc_real_3: 0.27301669120788574 (0.27301669120788574) | > loss_disc_real_4: 0.2190990000963211 (0.2190990000963211) | > loss_disc_real_5: 0.22731734812259674 (0.22731734812259674) | > loss_0: 2.3325014114379883 (2.3325014114379883) | > loss_gen: 2.348926067352295 (2.348926067352295) | > loss_kl: 2.948978900909424 (2.948978900909424) | > loss_feat: 5.178193092346191 (5.178193092346191) | > loss_mel: 22.973289489746094 (22.973289489746094) | > loss_duration: 2.420355796813965 (2.420355796813965) | > loss_1: 35.86974334716797 (35.86974334716797)  --> STEP: 1 | > loss_disc: 2.2125749588012695 (2.2125749588012695) | > loss_disc_real_0: 0.3140445947647095 (0.3140445947647095) | > loss_disc_real_1: 0.2314741015434265 (0.2314741015434265) | > loss_disc_real_2: 0.15005195140838623 (0.15005195140838623) | > loss_disc_real_3: 0.15767088532447815 (0.15767088532447815) | > loss_disc_real_4: 0.2711845636367798 (0.2711845636367798) | > loss_disc_real_5: 0.1561337113380432 (0.1561337113380432) | > loss_0: 2.2125749588012695 (2.2125749588012695) | > loss_gen: 2.869297504425049 (2.869297504425049) | > loss_kl: 3.7024831771850586 (3.7024831771850586) | > loss_feat: 8.524230003356934 (8.524230003356934) | > loss_mel: 26.1274356842041 (26.1274356842041) | > loss_duration: 2.7018589973449707 (2.7018589973449707) | > loss_1: 43.9253044128418 (43.9253044128418)  --> STEP: 2 | > loss_disc: 2.8927597999572754 (2.5526673793792725) | > loss_disc_real_0: 0.023625090718269348 (0.1688348427414894) | > loss_disc_real_1: 0.15459470450878143 (0.19303440302610397) | > loss_disc_real_2: 0.22375455498695374 (0.18690325319766998) | > loss_disc_real_3: 0.30024266242980957 (0.22895677387714386) | > loss_disc_real_4: 0.2490045130252838 (0.2600945383310318) | > loss_disc_real_5: 0.3745995759963989 (0.26536664366722107) | > loss_0: 2.8927597999572754 (2.5526673793792725) | > loss_gen: 2.0725395679473877 (2.4709185361862183) | > loss_kl: 3.8112738132476807 (3.7568784952163696) | > loss_feat: 11.102442741394043 (9.813336372375488) | > loss_mel: 26.13772201538086 (26.13257884979248) | > loss_duration: 2.705502986907959 (2.703680992126465) | > loss_1: 45.8294792175293 (44.87739181518555)  --> STEP: 3 | > loss_disc: 2.475079298019409 (2.5268046855926514) | > loss_disc_real_0: 0.24625709652900696 (0.19464226067066193) | > loss_disc_real_1: 0.32600387930870056 (0.2373575617869695) | > loss_disc_real_2: 0.3343540132045746 (0.23605350653330484) | > loss_disc_real_3: 0.17451749742031097 (0.2108103483915329) | > loss_disc_real_4: 0.32375264167785645 (0.2813139061133067) | > loss_disc_real_5: 0.24660728871822357 (0.25911352535088855) | > loss_0: 2.475079298019409 (2.5268046855926514) | > loss_gen: 2.7509520053863525 (2.564263025919596) | > loss_kl: 1.4036993980407715 (2.9724854628245034) | > loss_feat: 4.071238994598389 (7.899303913116455) | > loss_mel: 24.045703887939453 (25.436953862508137) | > loss_duration: 2.5432190895080566 (2.650193691253662) | > loss_1: 34.814815521240234 (41.523199717203774) --> EVAL PERFORMANCE | > avg_loader_time: 0.019481738408406574 (+0.005244334538777668) | > avg_loss_disc: 2.5268046855926514 (-0.4403284390767417) | > avg_loss_disc_real_0: 0.19464226067066193 (-0.015478779872258513) | > avg_loss_disc_real_1: 0.2373575617869695 (-0.020162542661031096) | > avg_loss_disc_real_2: 0.23605350653330484 (-0.10097828010718027) | > avg_loss_disc_real_3: 0.2108103483915329 (-0.08400518198808032) | > avg_loss_disc_real_4: 0.2813139061133067 (+0.014617249369621277) | > avg_loss_disc_real_5: 0.25911352535088855 (-0.040429358681043026) | > avg_loss_0: 2.5268046855926514 (-0.4403284390767417) | > avg_loss_gen: 2.564263025919596 (+0.6712306737899778) | > avg_loss_kl: 2.9724854628245034 (-0.1976477702458701) | > avg_loss_feat: 7.899303913116455 (+5.4102242812514305) | > avg_loss_mel: 25.436953862508137 (+8.322396914164223) | > avg_loss_duration: 2.650193691253662 (+0.04088147481282567) | > avg_loss_1: 41.523199717203774 (+14.247084935506184)  > EPOCH: 397/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:00:56)   --> TIME: 2023-10-20 04:01:09 -- STEP: 19/50 -- GLOBAL_STEP: 72870 | > loss_disc: 1.5039935111999512 (2.203448728511208) | > loss_disc_real_0: 0.05220935493707657 (0.12364432279412683) | > loss_disc_real_1: 0.288552850484848 (0.1983163529320767) | > loss_disc_real_2: 0.11550699919462204 (0.21809808360902885) | > loss_disc_real_3: 0.27268242835998535 (0.23184306998001902) | > loss_disc_real_4: 0.09148091077804565 (0.18680456947339208) | > loss_disc_real_5: 0.07908731698989868 (0.2071540158634123) | > loss_0: 1.5039935111999512 (2.203448728511208) | > grad_norm_0: tensor(979.7880, device='cuda:0') (tensor(893.7090, device='cuda:0')) | > loss_gen: 3.299556255340576 (2.5523327589035034) | > loss_kl: 0.8961020112037659 (0.927698364383296) | > loss_feat: 10.499200820922852 (6.583600176008124) | > loss_mel: 25.232757568359375 (24.663409684833727) | > loss_duration: 1.6635698080062866 (1.600785261706302) | > loss_1: 41.5911865234375 (36.32782584742496) | > grad_norm_1: tensor(112567.7266, device='cuda:0') (tensor(39165.5312, device='cuda:0')) | > current_lr_0: 0.000134463468432247 | > current_lr_1: 0.000134463468432247 | > step_time: 0.6237 (0.49258982507806076) | > loader_time: 0.004 (0.01831916758888646)  --> TIME: 2023-10-20 04:01:23 -- STEP: 49/50 -- GLOBAL_STEP: 72900 | > loss_disc: 2.6390528678894043 (2.3396226337977817) | > loss_disc_real_0: 0.11165040731430054 (0.13932819001148547) | > loss_disc_real_1: 0.2023945301771164 (0.21687849162488568) | > loss_disc_real_2: 0.281776487827301 (0.2193178892591778) | > loss_disc_real_3: 0.32388782501220703 (0.2315185152146281) | > loss_disc_real_4: 0.36067673563957214 (0.2077365219593048) | > loss_disc_real_5: 0.24100416898727417 (0.219195408252429) | > loss_0: 2.6390528678894043 (2.3396226337977817) | > grad_norm_0: tensor(1834.9373, device='cuda:0') (tensor(1012.1476, device='cuda:0')) | > loss_gen: 2.3307406902313232 (2.405997509859047) | > loss_kl: 0.314140260219574 (0.8792365187284897) | > loss_feat: 2.189702272415161 (5.430465073229707) | > loss_mel: 26.759445190429688 (21.6622120020341) | > loss_duration: 1.6260120868682861 (1.545144195459327) | > loss_1: 33.22003936767578 (31.9230549578764) | > grad_norm_1: tensor(5996.4419, device='cuda:0') (tensor(36983.2031, device='cuda:0')) | > current_lr_0: 0.000134463468432247 | > current_lr_1: 0.000134463468432247 | > step_time: 0.7527 (0.4501929526426354) | > loader_time: 0.3942 (0.020211049488612583)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0983424186706543 (2.0983424186706543) | > loss_disc_real_0: 0.2449507862329483 (0.2449507862329483) | > loss_disc_real_1: 0.1904045045375824 (0.1904045045375824) | > loss_disc_real_2: 0.3300744593143463 (0.3300744593143463) | > loss_disc_real_3: 0.25443750619888306 (0.25443750619888306) | > loss_disc_real_4: 0.21222327649593353 (0.21222327649593353) | > loss_disc_real_5: 0.2242966741323471 (0.2242966741323471) | > loss_0: 2.0983424186706543 (2.0983424186706543) | > loss_gen: 3.024366855621338 (3.024366855621338) | > loss_kl: 4.063145160675049 (4.063145160675049) | > loss_feat: 7.0348992347717285 (7.0348992347717285) | > loss_mel: 24.939075469970703 (24.939075469970703) | > loss_duration: 2.4915359020233154 (2.4915359020233154) | > loss_1: 41.55302429199219 (41.55302429199219)  --> STEP: 1 | > loss_disc: 3.0478782653808594 (3.0478782653808594) | > loss_disc_real_0: 0.45298004150390625 (0.45298004150390625) | > loss_disc_real_1: 0.2123517245054245 (0.2123517245054245) | > loss_disc_real_2: 0.3185918927192688 (0.3185918927192688) | > loss_disc_real_3: 0.23812508583068848 (0.23812508583068848) | > loss_disc_real_4: 0.3388352394104004 (0.3388352394104004) | > loss_disc_real_5: 0.22199642658233643 (0.22199642658233643) | > loss_0: 3.0478782653808594 (3.0478782653808594) | > loss_gen: 1.8784620761871338 (1.8784620761871338) | > loss_kl: 3.9745380878448486 (3.9745380878448486) | > loss_feat: 0.15052293241024017 (0.15052293241024017) | > loss_mel: 10.445843696594238 (10.445843696594238) | > loss_duration: 2.748258113861084 (2.748258113861084) | > loss_1: 19.1976261138916 (19.1976261138916)  --> STEP: 2 | > loss_disc: 2.957602024078369 (3.0027401447296143) | > loss_disc_real_0: 0.45094677805900574 (0.451963409781456) | > loss_disc_real_1: 0.23898427188396454 (0.22566799819469452) | > loss_disc_real_2: 0.31221863627433777 (0.3154052644968033) | > loss_disc_real_3: 0.24134977161884308 (0.23973742872476578) | > loss_disc_real_4: 0.33705204725265503 (0.3379436433315277) | > loss_disc_real_5: 0.21468284726142883 (0.21833963692188263) | > loss_0: 2.957602024078369 (3.0027401447296143) | > loss_gen: 2.061316728591919 (1.9698894023895264) | > loss_kl: 4.2379937171936035 (4.106265902519226) | > loss_feat: 0.707225501537323 (0.4288742169737816) | > loss_mel: 7.3708906173706055 (8.908367156982422) | > loss_duration: 2.633546829223633 (2.6909024715423584) | > loss_1: 17.01097297668457 (18.104299545288086)  --> STEP: 3 | > loss_disc: 2.61551570892334 (2.8736653327941895) | > loss_disc_real_0: 0.16343098878860474 (0.35578593611717224) | > loss_disc_real_1: 0.3886861801147461 (0.28000739216804504) | > loss_disc_real_2: 0.2785660922527313 (0.303125540415446) | > loss_disc_real_3: 0.1749034970998764 (0.218126118183136) | > loss_disc_real_4: 0.28303420543670654 (0.31964049736658734) | > loss_disc_real_5: 0.3199193775653839 (0.25219955046971637) | > loss_0: 2.61551570892334 (2.8736653327941895) | > loss_gen: 2.5946786403656006 (2.1781524817148843) | > loss_kl: 1.771083116531372 (3.327871640523275) | > loss_feat: 5.969384670257568 (2.275711034735044) | > loss_mel: 29.12802505493164 (15.648253122965494) | > loss_duration: 2.5059969425201416 (2.6292672952016196) | > loss_1: 41.96916580200195 (26.059254964192707) --> EVAL PERFORMANCE | > avg_loader_time: 0.006513436635335286 (-0.012968301773071289) | > avg_loss_disc: 2.8736653327941895 (+0.3468606472015381) | > avg_loss_disc_real_0: 0.35578593611717224 (+0.16114367544651031) | > avg_loss_disc_real_1: 0.28000739216804504 (+0.04264983038107553) | > avg_loss_disc_real_2: 0.303125540415446 (+0.06707203388214114) | > avg_loss_disc_real_3: 0.218126118183136 (+0.007315769791603088) | > avg_loss_disc_real_4: 0.31964049736658734 (+0.03832659125328064) | > avg_loss_disc_real_5: 0.25219955046971637 (-0.00691397488117218) | > avg_loss_0: 2.8736653327941895 (+0.3468606472015381) | > avg_loss_gen: 2.1781524817148843 (-0.3861105442047119) | > avg_loss_kl: 3.327871640523275 (+0.35538617769877145) | > avg_loss_feat: 2.275711034735044 (-5.623592878381411) | > avg_loss_mel: 15.648253122965494 (-9.788700739542643) | > avg_loss_duration: 2.6292672952016196 (-0.020926396052042495) | > avg_loss_1: 26.059254964192707 (-15.463944753011067)  > EPOCH: 398/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:01:35)   --> TIME: 2023-10-20 04:01:54 -- STEP: 29/50 -- GLOBAL_STEP: 72930 | > loss_disc: 2.7983474731445312 (2.516754047623996) | > loss_disc_real_0: 0.15603485703468323 (0.16123494261811513) | > loss_disc_real_1: 0.24802784621715546 (0.2207101573204172) | > loss_disc_real_2: 0.19119030237197876 (0.23043704443964466) | > loss_disc_real_3: 0.24814322590827942 (0.23504709490928158) | > loss_disc_real_4: 0.20862659811973572 (0.24416948475971303) | > loss_disc_real_5: 0.22160941362380981 (0.23172253293210063) | > loss_0: 2.7983474731445312 (2.516754047623996) | > grad_norm_0: tensor(784.4890, device='cuda:0') (tensor(1329.7307, device='cuda:0')) | > loss_gen: 1.5605669021606445 (2.3756788188013536) | > loss_kl: 1.0995944738388062 (0.8566914272719416) | > loss_feat: 0.7062040567398071 (5.200329198148744) | > loss_mel: 10.248388290405273 (21.863808253715778) | > loss_duration: 1.4694167375564575 (1.5430540997406532) | > loss_1: 15.0841703414917 (31.839562350306018) | > grad_norm_1: tensor(47020.8555, device='cuda:0') (tensor(35516.8867, device='cuda:0')) | > current_lr_0: 0.0001343290637768775 | > current_lr_1: 0.0001343290637768775 | > step_time: 0.2984 (0.4938824259001634) | > loader_time: 0.025 (0.01995890716026569)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.033130407333374 (2.033130407333374) | > loss_disc_real_0: 0.09536843746900558 (0.09536843746900558) | > loss_disc_real_1: 0.11359836161136627 (0.11359836161136627) | > loss_disc_real_2: 0.12458930909633636 (0.12458930909633636) | > loss_disc_real_3: 0.2638084590435028 (0.2638084590435028) | > loss_disc_real_4: 0.15162238478660583 (0.15162238478660583) | > loss_disc_real_5: 0.06522562354803085 (0.06522562354803085) | > loss_0: 2.033130407333374 (2.033130407333374) | > loss_gen: 1.9987378120422363 (1.9987378120422363) | > loss_kl: 3.0151023864746094 (3.0151023864746094) | > loss_feat: 6.718100070953369 (6.718100070953369) | > loss_mel: 24.912246704101562 (24.912246704101562) | > loss_duration: 2.4569997787475586 (2.4569997787475586) | > loss_1: 39.1011848449707 (39.1011848449707)  --> STEP: 1 | > loss_disc: 2.34627628326416 (2.34627628326416) | > loss_disc_real_0: 0.06002344191074371 (0.06002344191074371) | > loss_disc_real_1: 0.11869075894355774 (0.11869075894355774) | > loss_disc_real_2: 0.17813339829444885 (0.17813339829444885) | > loss_disc_real_3: 0.26623067259788513 (0.26623067259788513) | > loss_disc_real_4: 0.26292869448661804 (0.26292869448661804) | > loss_disc_real_5: 0.34343042969703674 (0.34343042969703674) | > loss_0: 2.34627628326416 (2.34627628326416) | > loss_gen: 2.266124725341797 (2.266124725341797) | > loss_kl: 3.76491117477417 (3.76491117477417) | > loss_feat: 6.811316967010498 (6.811316967010498) | > loss_mel: 25.19169807434082 (25.19169807434082) | > loss_duration: 2.7143936157226562 (2.7143936157226562) | > loss_1: 40.748443603515625 (40.748443603515625)  --> STEP: 2 | > loss_disc: 3.331059694290161 (2.8386679887771606) | > loss_disc_real_0: 0.34701821208000183 (0.20352082699537277) | > loss_disc_real_1: 0.35573723912239075 (0.23721399903297424) | > loss_disc_real_2: 0.3266795873641968 (0.2524064928293228) | > loss_disc_real_3: 0.36097949743270874 (0.31360508501529694) | > loss_disc_real_4: 0.372845321893692 (0.31788700819015503) | > loss_disc_real_5: 0.4756137430667877 (0.40952208638191223) | > loss_0: 3.331059694290161 (2.8386679887771606) | > loss_gen: 2.4373514652252197 (2.3517380952835083) | > loss_kl: 4.046947002410889 (3.9059290885925293) | > loss_feat: 4.352012634277344 (5.581664800643921) | > loss_mel: 28.711639404296875 (26.951668739318848) | > loss_duration: 2.6450746059417725 (2.6797341108322144) | > loss_1: 42.193023681640625 (41.470733642578125)  --> STEP: 3 | > loss_disc: 2.5708208084106445 (2.7493855953216553) | > loss_disc_real_0: 0.22323152422904968 (0.21009105940659842) | > loss_disc_real_1: 0.24737191200256348 (0.2405999700228373) | > loss_disc_real_2: 0.1592584252357483 (0.22135713696479797) | > loss_disc_real_3: 0.2838986814022064 (0.3037029504776001) | > loss_disc_real_4: 0.30398401618003845 (0.31325267752011615) | > loss_disc_real_5: 0.35461685061454773 (0.3912203411261241) | > loss_0: 2.5708208084106445 (2.7493855953216553) | > loss_gen: 2.2551636695861816 (2.319546620051066) | > loss_kl: 1.572772741317749 (3.1282103061676025) | > loss_feat: 2.2070424556732178 (4.4567906856536865) | > loss_mel: 20.858905792236328 (24.920747756958008) | > loss_duration: 2.457733154296875 (2.605733791987101) | > loss_1: 29.35161781311035 (37.43102836608887) --> EVAL PERFORMANCE | > avg_loader_time: 0.004029115041097005 (-0.0024843215942382812) | > avg_loss_disc: 2.7493855953216553 (-0.12427973747253418) | > avg_loss_disc_real_0: 0.21009105940659842 (-0.14569487671057382) | > avg_loss_disc_real_1: 0.2405999700228373 (-0.03940742214520773) | > avg_loss_disc_real_2: 0.22135713696479797 (-0.08176840345064801) | > avg_loss_disc_real_3: 0.3037029504776001 (+0.08557683229446411) | > avg_loss_disc_real_4: 0.31325267752011615 (-0.006387819846471188) | > avg_loss_disc_real_5: 0.3912203411261241 (+0.1390207906564077) | > avg_loss_0: 2.7493855953216553 (-0.12427973747253418) | > avg_loss_gen: 2.319546620051066 (+0.14139413833618164) | > avg_loss_kl: 3.1282103061676025 (-0.19966133435567235) | > avg_loss_feat: 4.4567906856536865 (+2.1810796509186425) | > avg_loss_mel: 24.920747756958008 (+9.272494633992514) | > avg_loss_duration: 2.605733791987101 (-0.023533503214518525) | > avg_loss_1: 37.43102836608887 (+11.37177340189616)  > EPOCH: 399/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:02:17)   --> TIME: 2023-10-20 04:02:26 -- STEP: 9/50 -- GLOBAL_STEP: 72960 | > loss_disc: 2.737299919128418 (2.362712846861945) | > loss_disc_real_0: 0.06775158643722534 (0.19118564658694798) | > loss_disc_real_1: 0.36246246099472046 (0.28325392968124813) | > loss_disc_real_2: 0.21910721063613892 (0.2401326596736908) | > loss_disc_real_3: 0.45600175857543945 (0.26479504712753826) | > loss_disc_real_4: 0.344326913356781 (0.20416684448719025) | > loss_disc_real_5: 0.30074000358581543 (0.2229741317116552) | > loss_0: 2.737299919128418 (2.362712846861945) | > grad_norm_0: tensor(908.9986, device='cuda:0') (tensor(1733.7412, device='cuda:0')) | > loss_gen: 2.358290195465088 (2.7173897425333657) | > loss_kl: 0.8084233403205872 (0.8159679108195834) | > loss_feat: 3.8140385150909424 (5.584985875421101) | > loss_mel: 23.87831687927246 (21.073893149693806) | > loss_duration: 1.4694064855575562 (1.5179559522204928) | > loss_1: 32.32847595214844 (31.710193104214138) | > grad_norm_1: tensor(20160.8965, device='cuda:0') (tensor(53153.6758, device='cuda:0')) | > current_lr_0: 0.00013419479346737603 | > current_lr_1: 0.00013419479346737603 | > step_time: 0.3113 (0.5278593434227837) | > loader_time: 0.0134 (0.0185544490814209)  --> TIME: 2023-10-20 04:02:41 -- STEP: 39/50 -- GLOBAL_STEP: 72990 | > loss_disc: 1.039114236831665 (2.301074926669781) | > loss_disc_real_0: 0.04543793946504593 (0.14487497159876886) | > loss_disc_real_1: 0.18730781972408295 (0.2357041348870366) | > loss_disc_real_2: 0.09003271162509918 (0.22362139190618807) | > loss_disc_real_3: 0.04955392703413963 (0.22274244586244607) | > loss_disc_real_4: 0.022354910150170326 (0.22078026972042444) | > loss_disc_real_5: 0.07657681405544281 (0.2012173593736803) | > loss_0: 1.039114236831665 (2.301074926669781) | > grad_norm_0: tensor(836.0920, device='cuda:0') (tensor(1371.6583, device='cuda:0')) | > loss_gen: 3.53005313873291 (2.601257122479953) | > loss_kl: 0.49270328879356384 (0.8097230142507797) | > loss_feat: 10.637910842895508 (6.333990470912212) | > loss_mel: 29.37040901184082 (23.045861335901115) | > loss_duration: 1.5732959508895874 (1.5147346900059626) | > loss_1: 45.6043701171875 (34.305566677680375) | > grad_norm_1: tensor(55754.5469, device='cuda:0') (tensor(43482.5664, device='cuda:0')) | > current_lr_0: 0.00013419479346737603 | > current_lr_1: 0.00013419479346737603 | > step_time: 0.5834 (0.4884500686938946) | > loader_time: 0.0047 (0.015917496803479307)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.47261905670166 (2.47261905670166) | > loss_disc_real_0: 0.26623281836509705 (0.26623281836509705) | > loss_disc_real_1: 0.22634582221508026 (0.22634582221508026) | > loss_disc_real_2: 0.3017577826976776 (0.3017577826976776) | > loss_disc_real_3: 0.24857290089130402 (0.24857290089130402) | > loss_disc_real_4: 0.1841767579317093 (0.1841767579317093) | > loss_disc_real_5: 0.17013400793075562 (0.17013400793075562) | > loss_0: 2.47261905670166 (2.47261905670166) | > loss_gen: 2.404332399368286 (2.404332399368286) | > loss_kl: 2.72446608543396 (2.72446608543396) | > loss_feat: 7.455079078674316 (7.455079078674316) | > loss_mel: 25.09904670715332 (25.09904670715332) | > loss_duration: 2.5033211708068848 (2.5033211708068848) | > loss_1: 40.18624496459961 (40.18624496459961)  --> STEP: 1 | > loss_disc: 1.85797917842865 (1.85797917842865) | > loss_disc_real_0: 0.3302139341831207 (0.3302139341831207) | > loss_disc_real_1: 0.22637562453746796 (0.22637562453746796) | > loss_disc_real_2: 0.19215965270996094 (0.19215965270996094) | > loss_disc_real_3: 0.24345612525939941 (0.24345612525939941) | > loss_disc_real_4: 0.11446920782327652 (0.11446920782327652) | > loss_disc_real_5: 0.17891620099544525 (0.17891620099544525) | > loss_0: 1.85797917842865 (1.85797917842865) | > loss_gen: 3.303596258163452 (3.303596258163452) | > loss_kl: 3.4239673614501953 (3.4239673614501953) | > loss_feat: 7.9978156089782715 (7.9978156089782715) | > loss_mel: 23.3975887298584 (23.3975887298584) | > loss_duration: 2.7115893363952637 (2.7115893363952637) | > loss_1: 40.83456039428711 (40.83456039428711)  --> STEP: 2 | > loss_disc: 2.668034791946411 (2.2630069851875305) | > loss_disc_real_0: 0.378231406211853 (0.3542226701974869) | > loss_disc_real_1: 0.2539033591747284 (0.24013949185609818) | > loss_disc_real_2: 0.3065297603607178 (0.24934470653533936) | > loss_disc_real_3: 0.2667473554611206 (0.25510174036026) | > loss_disc_real_4: 0.16061489284038544 (0.13754205033183098) | > loss_disc_real_5: 0.32294365763664246 (0.25092992931604385) | > loss_0: 2.668034791946411 (2.2630069851875305) | > loss_gen: 2.9069533348083496 (3.105274796485901) | > loss_kl: 3.837336540222168 (3.6306519508361816) | > loss_feat: 8.095895767211914 (8.046855688095093) | > loss_mel: 29.030046463012695 (26.213817596435547) | > loss_duration: 2.735273599624634 (2.7234314680099487) | > loss_1: 46.605506896972656 (43.72003364562988)  --> STEP: 3 | > loss_disc: 3.148360252380371 (2.5581247409184775) | > loss_disc_real_0: 0.1779569387435913 (0.29546742637952167) | > loss_disc_real_1: 0.3459780812263489 (0.27541902164618176) | > loss_disc_real_2: 0.4181888997554779 (0.30562610427538556) | > loss_disc_real_3: 0.2380509227514267 (0.2494181344906489) | > loss_disc_real_4: 0.31654879450798035 (0.1972109650572141) | > loss_disc_real_5: 0.4118703305721283 (0.30457672973473865) | > loss_0: 3.148360252380371 (2.5581247409184775) | > loss_gen: 1.9810538291931152 (2.730534474054972) | > loss_kl: 1.6291955709457397 (2.963499824206034) | > loss_feat: 3.356232166290283 (6.483314514160156) | > loss_mel: 25.78883171081543 (26.072155634562176) | > loss_duration: 2.660564661026001 (2.7024758656819663) | > loss_1: 35.41587829589844 (40.95198186238607) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_73000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5548675060272217 (2.5573104321956635) | > loss_disc_real_0: 0.16334590315818787 (0.26243704557418823) | > loss_disc_real_1: 0.22461676597595215 (0.26271845772862434) | > loss_disc_real_2: 0.35141974687576294 (0.3170745149254799) | > loss_disc_real_3: 0.23487451672554016 (0.24578223004937172) | > loss_disc_real_4: 0.19908958673477173 (0.1976806204766035) | > loss_disc_real_5: 0.22721192240715027 (0.28523552790284157) | > loss_0: 2.5548675060272217 (2.5573104321956635) | > loss_gen: 2.1872758865356445 (2.5947198271751404) | > loss_kl: 2.7741587162017822 (2.9161645472049713) | > loss_feat: 7.398360252380371 (6.71207594871521) | > loss_mel: 25.677038192749023 (25.973376274108887) | > loss_duration: 2.476680040359497 (2.646026909351349) | > loss_1: 40.513511657714844 (40.84236431121826)  --> STEP: 1 | > loss_disc: 2.3280465602874756 (2.511457657814026) | > loss_disc_real_0: 0.06209643557667732 (0.22236892357468604) | > loss_disc_real_1: 0.22113366425037384 (0.25440149903297427) | > loss_disc_real_2: 0.3098662495613098 (0.3156328618526459) | > loss_disc_real_3: 0.21924932301044464 (0.2404756486415863) | > loss_disc_real_4: 0.20491182804107666 (0.19912686198949814) | > loss_disc_real_5: 0.35379382967948914 (0.29894718825817107) | > loss_0: 2.3280465602874756 (2.511457657814026) | > loss_gen: 2.4775846004486084 (2.571292781829834) | > loss_kl: 3.3408639430999756 (3.0011044263839723) | > loss_feat: 6.397572040557861 (6.64917516708374) | > loss_mel: 24.231508255004883 (25.625002670288087) | > loss_duration: 2.7624692916870117 (2.6693153858184813) | > loss_1: 39.209999084472656 (40.51589126586914)  --> STEP: 2 | > loss_disc: 2.627359628677368 (2.5307746529579163) | > loss_disc_real_0: 0.758858323097229 (0.31178382349510986) | > loss_disc_real_1: 0.2503862679004669 (0.253732293844223) | > loss_disc_real_2: 0.2824549973011017 (0.31010321776072186) | > loss_disc_real_3: 0.24431295692920685 (0.24111520002285639) | > loss_disc_real_4: 0.15628311038017273 (0.19198623672127724) | > loss_disc_real_5: 0.2423776537179947 (0.28951893250147503) | > loss_0: 2.627359628677368 (2.5307746529579163) | > loss_gen: 3.2990546226501465 (2.6925864219665527) | > loss_kl: 4.233869552612305 (3.206565280755361) | > loss_feat: 9.691165924072266 (7.156173626581828) | > loss_mel: 26.443218231201172 (25.761371930440266) | > loss_duration: 2.764430522918701 (2.685167908668518) | > loss_1: 46.431739807128906 (41.501866022745766)  --> STEP: 3 | > loss_disc: 3.0121469497680664 (2.599542123930795) | > loss_disc_real_0: 0.1434679925441742 (0.28773870478783337) | > loss_disc_real_1: 0.2975388765335083 (0.2599903770855495) | > loss_disc_real_2: 0.26048293709754944 (0.3030146062374115) | > loss_disc_real_3: 0.319027841091156 (0.25224557731832775) | > loss_disc_real_4: 0.26502692699432373 (0.20242062104599817) | > loss_disc_real_5: 0.19869835674762726 (0.2765445645366396) | > loss_0: 3.0121469497680664 (2.599542123930795) | > loss_gen: 1.5003106594085693 (2.522261313029698) | > loss_kl: 1.68548583984375 (2.989268217767988) | > loss_feat: 0.29281389713287354 (6.175693665231977) | > loss_mel: 12.062894821166992 (23.804446629115514) | > loss_duration: 2.5856006145477295 (2.6709440095084056) | > loss_1: 18.127105712890625 (38.16261454990932) --> EVAL PERFORMANCE | > avg_loader_time: 0.37841010093688965 (+0.37438098589579266) | > avg_loss_disc: 2.599542123930795 (-0.1498434713908603) | > avg_loss_disc_real_0: 0.28773870478783337 (+0.07764764538123495) | > avg_loss_disc_real_1: 0.2599903770855495 (+0.019390407062712195) | > avg_loss_disc_real_2: 0.3030146062374115 (+0.08165746927261353) | > avg_loss_disc_real_3: 0.25224557731832775 (-0.051457373159272346) | > avg_loss_disc_real_4: 0.20242062104599817 (-0.11083205647411798) | > avg_loss_disc_real_5: 0.2765445645366396 (-0.11467577658948447) | > avg_loss_0: 2.599542123930795 (-0.1498434713908603) | > avg_loss_gen: 2.522261313029698 (+0.2027146929786321) | > avg_loss_kl: 2.989268217767988 (-0.13894208839961442) | > avg_loss_feat: 6.175693665231977 (+1.7189029795782904) | > avg_loss_mel: 23.804446629115514 (-1.116301127842494) | > avg_loss_duration: 2.6709440095084056 (+0.06521021752130451) | > avg_loss_1: 38.16261454990932 (+0.731586183820454)  > EPOCH: 400/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:03:03)   --> TIME: 2023-10-20 04:03:15 -- STEP: 19/50 -- GLOBAL_STEP: 73020 | > loss_disc: 3.004884719848633 (2.4714599283117997) | > loss_disc_real_0: 0.41948574781417847 (0.18853761956683898) | > loss_disc_real_1: 0.3556985557079315 (0.26190188821209104) | > loss_disc_real_2: 0.25364193320274353 (0.23050415790394732) | > loss_disc_real_3: 0.23455792665481567 (0.23002252046410976) | > loss_disc_real_4: 0.33330103754997253 (0.23513705204976232) | > loss_disc_real_5: 0.4746474325656891 (0.23486369750217387) | > loss_0: 3.004884719848633 (2.4714599283117997) | > grad_norm_0: tensor(1468.0837, device='cuda:0') (tensor(1010.4984, device='cuda:0')) | > loss_gen: 2.3785572052001953 (2.500445290615684) | > loss_kl: 0.9651985764503479 (0.9093284434393832) | > loss_feat: 3.173840045928955 (6.430682877176686) | > loss_mel: 23.88698959350586 (23.725474106638057) | > loss_duration: 1.6095598936080933 (1.5705100799861706) | > loss_1: 32.01414489746094 (35.13644052806654) | > grad_norm_1: tensor(19425.6035, device='cuda:0') (tensor(42742.8828, device='cuda:0')) | > current_lr_0: 0.00013406065736945547 | > current_lr_1: 0.00013406065736945547 | > step_time: 0.3049 (0.36294580760755035) | > loader_time: 0.0018 (0.007754978380705181)  --> TIME: 2023-10-20 04:03:29 -- STEP: 49/50 -- GLOBAL_STEP: 73050 | > loss_disc: 2.0327587127685547 (2.420609426741697) | > loss_disc_real_0: 0.03981619328260422 (0.14763800581270942) | > loss_disc_real_1: 0.11810733377933502 (0.23585520034693946) | > loss_disc_real_2: 0.14965565502643585 (0.21993729061618142) | > loss_disc_real_3: 0.2135937213897705 (0.23181346456083107) | > loss_disc_real_4: 0.26689910888671875 (0.22999241666830317) | > loss_disc_real_5: 0.22195155918598175 (0.22845749536111037) | > loss_0: 2.0327587127685547 (2.420609426741697) | > grad_norm_0: tensor(1313.3011, device='cuda:0') (tensor(1254.7806, device='cuda:0')) | > loss_gen: 2.5023772716522217 (2.3735376012568574) | > loss_kl: 0.6303118467330933 (0.8018596361638332) | > loss_feat: 3.433699607849121 (5.203514339193244) | > loss_mel: 26.078968048095703 (21.830470299234204) | > loss_duration: 1.6844578981399536 (1.5340286468972966) | > loss_1: 34.32981491088867 (31.74341042187748) | > grad_norm_1: tensor(23540.3418, device='cuda:0') (tensor(37978.8633, device='cuda:0')) | > current_lr_0: 0.00013406065736945547 | > current_lr_1: 0.00013406065736945547 | > step_time: 0.4073 (0.42380203519548687) | > loader_time: 0.3686 (0.015984043783071087)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.77992582321167 (2.77992582321167) | > loss_disc_real_0: 0.354043185710907 (0.354043185710907) | > loss_disc_real_1: 0.09177806973457336 (0.09177806973457336) | > loss_disc_real_2: 0.10715626925230026 (0.10715626925230026) | > loss_disc_real_3: 0.21884958446025848 (0.21884958446025848) | > loss_disc_real_4: 0.20932362973690033 (0.20932362973690033) | > loss_disc_real_5: 0.29921185970306396 (0.29921185970306396) | > loss_0: 2.77992582321167 (2.77992582321167) | > loss_gen: 1.6571991443634033 (1.6571991443634033) | > loss_kl: 3.093918800354004 (3.093918800354004) | > loss_feat: 7.975776195526123 (7.975776195526123) | > loss_mel: 23.303855895996094 (23.303855895996094) | > loss_duration: 2.491774559020996 (2.491774559020996) | > loss_1: 38.522525787353516 (38.522525787353516)  --> STEP: 1 | > loss_disc: 2.141852378845215 (2.141852378845215) | > loss_disc_real_0: 0.3165161907672882 (0.3165161907672882) | > loss_disc_real_1: 0.1194235235452652 (0.1194235235452652) | > loss_disc_real_2: 0.16001564264297485 (0.16001564264297485) | > loss_disc_real_3: 0.1939622163772583 (0.1939622163772583) | > loss_disc_real_4: 0.12642699480056763 (0.12642699480056763) | > loss_disc_real_5: 0.1479942798614502 (0.1479942798614502) | > loss_0: 2.141852378845215 (2.141852378845215) | > loss_gen: 2.537567615509033 (2.537567615509033) | > loss_kl: 3.9447884559631348 (3.9447884559631348) | > loss_feat: 7.762750148773193 (7.762750148773193) | > loss_mel: 23.119104385375977 (23.119104385375977) | > loss_duration: 2.64153790473938 (2.64153790473938) | > loss_1: 40.0057487487793 (40.0057487487793)  --> STEP: 2 | > loss_disc: 2.0272624492645264 (2.0845574140548706) | > loss_disc_real_0: 0.37649568915367126 (0.34650593996047974) | > loss_disc_real_1: 0.04471581429243088 (0.08206966891884804) | > loss_disc_real_2: 0.08206359297037125 (0.12103961780667305) | > loss_disc_real_3: 0.16351497173309326 (0.17873859405517578) | > loss_disc_real_4: 0.05955973267555237 (0.09299336373806) | > loss_disc_real_5: 0.14970983564853668 (0.14885205775499344) | > loss_0: 2.0272624492645264 (2.0845574140548706) | > loss_gen: 2.6435177326202393 (2.5905426740646362) | > loss_kl: 3.9904348850250244 (3.9676116704940796) | > loss_feat: 10.486226081848145 (9.124488115310669) | > loss_mel: 24.91374397277832 (24.01642417907715) | > loss_duration: 2.7209768295288086 (2.6812573671340942) | > loss_1: 44.75489807128906 (42.38032341003418)  --> STEP: 3 | > loss_disc: 3.1052310466766357 (2.4247819582621255) | > loss_disc_real_0: 0.6517907977104187 (0.4482675592104594) | > loss_disc_real_1: 0.27306362986564636 (0.14573432256778082) | > loss_disc_real_2: 0.26090019941329956 (0.16765981167554855) | > loss_disc_real_3: 0.2964470386505127 (0.21797474225362143) | > loss_disc_real_4: 0.24074797332286835 (0.14224490026632944) | > loss_disc_real_5: 0.23014584183692932 (0.1759499857823054) | > loss_0: 3.1052310466766357 (2.4247819582621255) | > loss_gen: 2.1481215953826904 (2.4430689811706543) | > loss_kl: 1.7699782848358154 (3.2350672086079917) | > loss_feat: 0.4842129051685333 (6.244396378596623) | > loss_mel: 18.616254806518555 (22.216367721557617) | > loss_duration: 2.558784008026123 (2.640432914098104) | > loss_1: 25.577350616455078 (36.77933247884115) --> EVAL PERFORMANCE | > avg_loader_time: 0.007828632990519205 (-0.3705814679463704) | > avg_loss_disc: 2.4247819582621255 (-0.17476016566866948) | > avg_loss_disc_real_0: 0.4482675592104594 (+0.16052885442262604) | > avg_loss_disc_real_1: 0.14573432256778082 (-0.11425605451776868) | > avg_loss_disc_real_2: 0.16765981167554855 (-0.13535479456186295) | > avg_loss_disc_real_3: 0.21797474225362143 (-0.03427083506470632) | > avg_loss_disc_real_4: 0.14224490026632944 (-0.060175720779668734) | > avg_loss_disc_real_5: 0.1759499857823054 (-0.10059457875433422) | > avg_loss_0: 2.4247819582621255 (-0.17476016566866948) | > avg_loss_gen: 2.4430689811706543 (-0.07919233185904373) | > avg_loss_kl: 3.2350672086079917 (+0.24579899084000356) | > avg_loss_feat: 6.244396378596623 (+0.0687027133646465) | > avg_loss_mel: 22.216367721557617 (-1.5880789075578967) | > avg_loss_duration: 2.640432914098104 (-0.030511095410301614) | > avg_loss_1: 36.77933247884115 (-1.383282071068173)  > EPOCH: 401/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:03:39)   --> TIME: 2023-10-20 04:03:59 -- STEP: 29/50 -- GLOBAL_STEP: 73080 | > loss_disc: 2.889742136001587 (2.4599343661604256) | > loss_disc_real_0: 0.27351513504981995 (0.15739500240005297) | > loss_disc_real_1: 0.3361940085887909 (0.221974963386511) | > loss_disc_real_2: 0.255204975605011 (0.2450458469062016) | > loss_disc_real_3: 0.24744293093681335 (0.2267082057379443) | > loss_disc_real_4: 0.23395401239395142 (0.22525557361800094) | > loss_disc_real_5: 0.23289059102535248 (0.22218782133583365) | > loss_0: 2.889742136001587 (2.4599343661604256) | > grad_norm_0: tensor(2093.7268, device='cuda:0') (tensor(1673.3696, device='cuda:0')) | > loss_gen: 1.7850712537765503 (2.395558817633267) | > loss_kl: 0.6072490215301514 (0.8496806662658165) | > loss_feat: 0.3581215739250183 (5.385065823793411) | > loss_mel: 15.40616226196289 (22.90198832544787) | > loss_duration: 1.5551718473434448 (1.535469182606401) | > loss_1: 19.711774826049805 (33.06776352586418) | > grad_norm_1: tensor(27229.7832, device='cuda:0') (tensor(46397.1797, device='cuda:0')) | > current_lr_0: 0.00013392665534896298 | > current_lr_1: 0.00013392665534896298 | > step_time: 0.2827 (0.5137992316278919) | > loader_time: 0.0233 (0.01793760266797296)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.238252639770508 (2.238252639770508) | > loss_disc_real_0: 0.34418684244155884 (0.34418684244155884) | > loss_disc_real_1: 0.1948455274105072 (0.1948455274105072) | > loss_disc_real_2: 0.17561054229736328 (0.17561054229736328) | > loss_disc_real_3: 0.1866338551044464 (0.1866338551044464) | > loss_disc_real_4: 0.1698099970817566 (0.1698099970817566) | > loss_disc_real_5: 0.11928247660398483 (0.11928247660398483) | > loss_0: 2.238252639770508 (2.238252639770508) | > loss_gen: 2.3395628929138184 (2.3395628929138184) | > loss_kl: 3.6002190113067627 (3.6002190113067627) | > loss_feat: 7.919081687927246 (7.919081687927246) | > loss_mel: 23.452898025512695 (23.452898025512695) | > loss_duration: 2.5259974002838135 (2.5259974002838135) | > loss_1: 39.8377571105957 (39.8377571105957)  --> STEP: 1 | > loss_disc: 2.4122321605682373 (2.4122321605682373) | > loss_disc_real_0: 0.13090644776821136 (0.13090644776821136) | > loss_disc_real_1: 0.1404285430908203 (0.1404285430908203) | > loss_disc_real_2: 0.11458578705787659 (0.11458578705787659) | > loss_disc_real_3: 0.37467530369758606 (0.37467530369758606) | > loss_disc_real_4: 0.0920027419924736 (0.0920027419924736) | > loss_disc_real_5: 0.08009235560894012 (0.08009235560894012) | > loss_0: 2.4122321605682373 (2.4122321605682373) | > loss_gen: 1.8267308473587036 (1.8267308473587036) | > loss_kl: 4.082174777984619 (4.082174777984619) | > loss_feat: 7.086848735809326 (7.086848735809326) | > loss_mel: 23.633689880371094 (23.633689880371094) | > loss_duration: 2.7485246658325195 (2.7485246658325195) | > loss_1: 39.377967834472656 (39.377967834472656)  --> STEP: 2 | > loss_disc: 3.085573673248291 (2.748902916908264) | > loss_disc_real_0: 0.35150468349456787 (0.24120556563138962) | > loss_disc_real_1: 0.251186341047287 (0.19580744206905365) | > loss_disc_real_2: 0.3412320017814636 (0.2279088944196701) | > loss_disc_real_3: 0.30245041847229004 (0.33856286108493805) | > loss_disc_real_4: 0.3468426764011383 (0.21942270919680595) | > loss_disc_real_5: 0.2897275686264038 (0.18490996211767197) | > loss_0: 3.085573673248291 (2.748902916908264) | > loss_gen: 1.8459222316741943 (1.836326539516449) | > loss_kl: 4.341248512268066 (4.211711645126343) | > loss_feat: 0.1729203313589096 (3.629884533584118) | > loss_mel: 4.683743000030518 (14.158716440200806) | > loss_duration: 2.671684741973877 (2.7101047039031982) | > loss_1: 13.715518951416016 (26.546743392944336)  --> STEP: 3 | > loss_disc: 2.394325017929077 (2.6307102839152017) | > loss_disc_real_0: 0.2993324398994446 (0.26058119038740796) | > loss_disc_real_1: 0.22194111347198486 (0.20451866587003073) | > loss_disc_real_2: 0.23381653428077698 (0.22987810770670572) | > loss_disc_real_3: 0.20775310695171356 (0.29495960970719654) | > loss_disc_real_4: 0.19868981838226318 (0.21251174559195837) | > loss_disc_real_5: 0.26923277974128723 (0.2130175679922104) | > loss_0: 2.394325017929077 (2.6307102839152017) | > loss_gen: 3.0317184925079346 (2.2347905238469443) | > loss_kl: 2.184814929962158 (3.5360794067382812) | > loss_feat: 5.726229667663574 (4.328666244943936) | > loss_mel: 21.658876419067383 (16.658769766489666) | > loss_duration: 2.63783860206604 (2.686016003290812) | > loss_1: 35.239479064941406 (29.44432195027669) --> EVAL PERFORMANCE | > avg_loader_time: 0.002037207285563151 (-0.005791425704956055) | > avg_loss_disc: 2.6307102839152017 (+0.20592832565307617) | > avg_loss_disc_real_0: 0.26058119038740796 (-0.18768636882305145) | > avg_loss_disc_real_1: 0.20451866587003073 (+0.05878434330224991) | > avg_loss_disc_real_2: 0.22987810770670572 (+0.062218296031157166) | > avg_loss_disc_real_3: 0.29495960970719654 (+0.0769848674535751) | > avg_loss_disc_real_4: 0.21251174559195837 (+0.07026684532562893) | > avg_loss_disc_real_5: 0.2130175679922104 (+0.037067582209905) | > avg_loss_0: 2.6307102839152017 (+0.20592832565307617) | > avg_loss_gen: 2.2347905238469443 (-0.20827845732370998) | > avg_loss_kl: 3.5360794067382812 (+0.30101219813028957) | > avg_loss_feat: 4.328666244943936 (-1.915730133652687) | > avg_loss_mel: 16.658769766489666 (-5.557597955067951) | > avg_loss_duration: 2.686016003290812 (+0.04558308919270804) | > avg_loss_1: 29.44432195027669 (-7.335010528564457)  > EPOCH: 402/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:04:21)   --> TIME: 2023-10-20 04:04:30 -- STEP: 9/50 -- GLOBAL_STEP: 73110 | > loss_disc: 2.9580330848693848 (2.6752421061197915) | > loss_disc_real_0: 0.2263033092021942 (0.167815536674526) | > loss_disc_real_1: 0.26906323432922363 (0.22764741546577877) | > loss_disc_real_2: 0.25652310252189636 (0.2339211197363006) | > loss_disc_real_3: 0.25265228748321533 (0.2310396350092358) | > loss_disc_real_4: 0.3294031620025635 (0.25125910590092343) | > loss_disc_real_5: 0.3592062294483185 (0.2937530138426357) | > loss_0: 2.9580330848693848 (2.6752421061197915) | > grad_norm_0: tensor(1506.0063, device='cuda:0') (tensor(1716.3917, device='cuda:0')) | > loss_gen: 1.6207232475280762 (2.193850517272949) | > loss_kl: 0.8830325603485107 (0.7174441615740458) | > loss_feat: 0.17941197752952576 (5.113606366846296) | > loss_mel: 10.100964546203613 (18.505433532926773) | > loss_duration: 1.5159496068954468 (1.5214736064275105) | > loss_1: 14.300081253051758 (28.05180899302165) | > grad_norm_1: tensor(51109.5000, device='cuda:0') (tensor(40630.6758, device='cuda:0')) | > current_lr_0: 0.00013379278727187975 | > current_lr_1: 0.00013379278727187975 | > step_time: 0.3698 (0.5479425854153104) | > loader_time: 0.0134 (0.012910419040256076)  --> TIME: 2023-10-20 04:04:46 -- STEP: 39/50 -- GLOBAL_STEP: 73140 | > loss_disc: 2.9648866653442383 (2.5008131815836983) | > loss_disc_real_0: 0.3242213726043701 (0.16717905594179264) | > loss_disc_real_1: 0.2929528057575226 (0.2318971390143419) | > loss_disc_real_2: 0.291052907705307 (0.23153593983405676) | > loss_disc_real_3: 0.26052185893058777 (0.22509347895781198) | > loss_disc_real_4: 0.2438034862279892 (0.24064924649130076) | > loss_disc_real_5: 0.3091968894004822 (0.24859374042791435) | > loss_0: 2.9648866653442383 (2.5008131815836983) | > grad_norm_0: tensor(1696.9250, device='cuda:0') (tensor(1434.0297, device='cuda:0')) | > loss_gen: 1.7976386547088623 (2.3864041597415233) | > loss_kl: 0.5036326050758362 (0.8741546609462836) | > loss_feat: 0.7328898906707764 (4.921680034162143) | > loss_mel: 15.694068908691406 (21.323151936897865) | > loss_duration: 1.55741548538208 (1.5234906520598976) | > loss_1: 20.28564453125 (31.028882026672363) | > grad_norm_1: tensor(15535.7100, device='cuda:0') (tensor(34657.7266, device='cuda:0')) | > current_lr_0: 0.00013379278727187975 | > current_lr_1: 0.00013379278727187975 | > step_time: 0.6984 (0.5208887992761074) | > loader_time: 0.0026 (0.01701812255076873)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3607892990112305 (2.3607892990112305) | > loss_disc_real_0: 0.066804900765419 (0.066804900765419) | > loss_disc_real_1: 0.16239289939403534 (0.16239289939403534) | > loss_disc_real_2: 0.17440879344940186 (0.17440879344940186) | > loss_disc_real_3: 0.39870724081993103 (0.39870724081993103) | > loss_disc_real_4: 0.15605075657367706 (0.15605075657367706) | > loss_disc_real_5: 0.10983012616634369 (0.10983012616634369) | > loss_0: 2.3607892990112305 (2.3607892990112305) | > loss_gen: 2.16339373588562 (2.16339373588562) | > loss_kl: 3.681521415710449 (3.681521415710449) | > loss_feat: 8.15397834777832 (8.15397834777832) | > loss_mel: 26.26981544494629 (26.26981544494629) | > loss_duration: 2.6083481311798096 (2.6083481311798096) | > loss_1: 42.87705993652344 (42.87705993652344)  --> STEP: 1 | > loss_disc: 2.511171817779541 (2.511171817779541) | > loss_disc_real_0: 0.1475135087966919 (0.1475135087966919) | > loss_disc_real_1: 0.2872887849807739 (0.2872887849807739) | > loss_disc_real_2: 0.2797415256500244 (0.2797415256500244) | > loss_disc_real_3: 0.2818138301372528 (0.2818138301372528) | > loss_disc_real_4: 0.29643914103507996 (0.29643914103507996) | > loss_disc_real_5: 0.27805227041244507 (0.27805227041244507) | > loss_0: 2.511171817779541 (2.511171817779541) | > loss_gen: 2.4582583904266357 (2.4582583904266357) | > loss_kl: 4.150232791900635 (4.150232791900635) | > loss_feat: 3.801225185394287 (3.801225185394287) | > loss_mel: 21.603164672851562 (21.603164672851562) | > loss_duration: 2.800877809524536 (2.800877809524536) | > loss_1: 34.813758850097656 (34.813758850097656)  --> STEP: 2 | > loss_disc: 2.5748419761657715 (2.5430068969726562) | > loss_disc_real_0: 0.15318794548511505 (0.15035072714090347) | > loss_disc_real_1: 0.22804264724254608 (0.25766571611166) | > loss_disc_real_2: 0.16692128777503967 (0.22333140671253204) | > loss_disc_real_3: 0.3212624788284302 (0.3015381544828415) | > loss_disc_real_4: 0.42430660128593445 (0.3603728711605072) | > loss_disc_real_5: 0.34480607509613037 (0.3114291727542877) | > loss_0: 2.5748419761657715 (2.5430068969726562) | > loss_gen: 2.736764907836914 (2.597511649131775) | > loss_kl: 3.8269309997558594 (3.988581895828247) | > loss_feat: 4.248556613922119 (4.024890899658203) | > loss_mel: 25.210433959960938 (23.40679931640625) | > loss_duration: 2.7015204429626465 (2.7511991262435913) | > loss_1: 38.72420120239258 (36.76898002624512)  --> STEP: 3 | > loss_disc: 2.019068479537964 (2.368360757827759) | > loss_disc_real_0: 0.10513332486152649 (0.1352782597144445) | > loss_disc_real_1: 0.33952105045318604 (0.28495082755883533) | > loss_disc_real_2: 0.1950719952583313 (0.21391160289446512) | > loss_disc_real_3: 0.23346813023090363 (0.2788481463988622) | > loss_disc_real_4: 0.11330298334360123 (0.27801624188820523) | > loss_disc_real_5: 0.11836075782775879 (0.24707303444544473) | > loss_0: 2.019068479537964 (2.368360757827759) | > loss_gen: 2.6274116039276123 (2.607478300730387) | > loss_kl: 1.4954413175582886 (3.1575350364049277) | > loss_feat: 7.606507301330566 (5.218763033548991) | > loss_mel: 24.68624496459961 (23.83328119913737) | > loss_duration: 2.5920569896698 (2.6981517473856607) | > loss_1: 39.007659912109375 (37.51520665486654) --> EVAL PERFORMANCE | > avg_loader_time: 0.012230952580769857 (+0.010193745295206707) | > avg_loss_disc: 2.368360757827759 (-0.2623495260874429) | > avg_loss_disc_real_0: 0.1352782597144445 (-0.12530293067296347) | > avg_loss_disc_real_1: 0.28495082755883533 (+0.0804321616888046) | > avg_loss_disc_real_2: 0.21391160289446512 (-0.0159665048122406) | > avg_loss_disc_real_3: 0.2788481463988622 (-0.01611146330833435) | > avg_loss_disc_real_4: 0.27801624188820523 (+0.06550449629624686) | > avg_loss_disc_real_5: 0.24707303444544473 (+0.034055466453234345) | > avg_loss_0: 2.368360757827759 (-0.2623495260874429) | > avg_loss_gen: 2.607478300730387 (+0.3726877768834429) | > avg_loss_kl: 3.1575350364049277 (-0.37854437033335353) | > avg_loss_feat: 5.218763033548991 (+0.8900967886050548) | > avg_loss_mel: 23.83328119913737 (+7.174511432647705) | > avg_loss_duration: 2.6981517473856607 (+0.012135744094848633) | > avg_loss_1: 37.51520665486654 (+8.070884704589847)  > EPOCH: 403/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:05:01)   --> TIME: 2023-10-20 04:05:13 -- STEP: 19/50 -- GLOBAL_STEP: 73170 | > loss_disc: 1.1115306615829468 (2.167147925025538) | > loss_disc_real_0: 0.07669267803430557 (0.16195567658073023) | > loss_disc_real_1: 0.12168958783149719 (0.184820228697438) | > loss_disc_real_2: 0.2062239944934845 (0.2136150880863792) | > loss_disc_real_3: 0.14109687507152557 (0.23284125553542062) | > loss_disc_real_4: 0.055672820657491684 (0.1792085654053249) | > loss_disc_real_5: 0.020778082311153412 (0.16915286361779036) | > loss_0: 1.1115306615829468 (2.167147925025538) | > grad_norm_0: tensor(579.0525, device='cuda:0') (tensor(1383.2042, device='cuda:0')) | > loss_gen: 4.43272590637207 (2.8796345434690775) | > loss_kl: 1.0983129739761353 (0.7711829229405052) | > loss_feat: 14.03717041015625 (8.11050597029297) | > loss_mel: 31.969568252563477 (25.560324304982235) | > loss_duration: 1.6332027912139893 (1.566862984707481) | > loss_1: 53.170982360839844 (38.888510151913295) | > grad_norm_1: tensor(127762.5000, device='cuda:0') (tensor(77837.6875, device='cuda:0')) | > current_lr_0: 0.00013365905300432096 | > current_lr_1: 0.00013365905300432096 | > step_time: 0.4071 (0.406135220276682) | > loader_time: 0.0066 (0.010738774349814966)  --> TIME: 2023-10-20 04:05:28 -- STEP: 49/50 -- GLOBAL_STEP: 73200 | > loss_disc: 2.6715891361236572 (2.3350105553257223) | > loss_disc_real_0: 0.030970480293035507 (0.1451192230594402) | > loss_disc_real_1: 0.30743011832237244 (0.2197507617576998) | > loss_disc_real_2: 0.2777946889400482 (0.23056153892254344) | > loss_disc_real_3: 0.33966705203056335 (0.24671663233668223) | > loss_disc_real_4: 0.25122344493865967 (0.2129156692903869) | > loss_disc_real_5: 0.4485342502593994 (0.21386113179353428) | > loss_0: 2.6715891361236572 (2.3350105553257223) | > grad_norm_0: tensor(1838.4565, device='cuda:0') (tensor(1444.0627, device='cuda:0')) | > loss_gen: 2.459059238433838 (2.654997239307481) | > loss_kl: 0.33347123861312866 (0.8338834412243902) | > loss_feat: 2.21148943901062 (6.698406771281544) | > loss_mel: 22.896352767944336 (23.907611199787684) | > loss_duration: 1.5843842029571533 (1.5131697168155593) | > loss_1: 29.484756469726562 (35.60806804773757) | > grad_norm_1: tensor(22305.0273, device='cuda:0') (tensor(56803.2930, device='cuda:0')) | > current_lr_0: 0.00013365905300432096 | > current_lr_1: 0.00013365905300432096 | > step_time: 0.4251 (0.43528290184176704) | > loader_time: 0.4777 (0.020137592237822865)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2834694385528564 (3.2834694385528564) | > loss_disc_real_0: 0.24085356295108795 (0.24085356295108795) | > loss_disc_real_1: 0.3165969252586365 (0.3165969252586365) | > loss_disc_real_2: 0.261018306016922 (0.261018306016922) | > loss_disc_real_3: 0.43906328082084656 (0.43906328082084656) | > loss_disc_real_4: 0.2837853729724884 (0.2837853729724884) | > loss_disc_real_5: 0.3994240462779999 (0.3994240462779999) | > loss_0: 3.2834694385528564 (3.2834694385528564) | > loss_gen: 2.312692642211914 (2.312692642211914) | > loss_kl: 3.570709228515625 (3.570709228515625) | > loss_feat: 5.83341121673584 (5.83341121673584) | > loss_mel: 25.343847274780273 (25.343847274780273) | > loss_duration: 2.480448007583618 (2.480448007583618) | > loss_1: 39.54111099243164 (39.54111099243164)  --> STEP: 1 | > loss_disc: 2.8039326667785645 (2.8039326667785645) | > loss_disc_real_0: 0.1885349601507187 (0.1885349601507187) | > loss_disc_real_1: 0.2742930054664612 (0.2742930054664612) | > loss_disc_real_2: 0.23270809650421143 (0.23270809650421143) | > loss_disc_real_3: 0.3167707026004791 (0.3167707026004791) | > loss_disc_real_4: 0.2866036891937256 (0.2866036891937256) | > loss_disc_real_5: 0.38582152128219604 (0.38582152128219604) | > loss_0: 2.8039326667785645 (2.8039326667785645) | > loss_gen: 2.0747337341308594 (2.0747337341308594) | > loss_kl: 3.636352062225342 (3.636352062225342) | > loss_feat: 1.8134751319885254 (1.8134751319885254) | > loss_mel: 19.732650756835938 (19.732650756835938) | > loss_duration: 2.8317863941192627 (2.8317863941192627) | > loss_1: 30.088998794555664 (30.088998794555664)  --> STEP: 2 | > loss_disc: 2.7521700859069824 (2.7780513763427734) | > loss_disc_real_0: 0.3919062614440918 (0.29022061079740524) | > loss_disc_real_1: 0.2325952649116516 (0.2534441351890564) | > loss_disc_real_2: 0.33503788709640503 (0.2838729918003082) | > loss_disc_real_3: 0.3677455484867096 (0.34225812554359436) | > loss_disc_real_4: 0.20421773195266724 (0.2454107105731964) | > loss_disc_real_5: 0.3754715621471405 (0.3806465417146683) | > loss_0: 2.7521700859069824 (2.7780513763427734) | > loss_gen: 3.146256685256958 (2.6104952096939087) | > loss_kl: 3.961773157119751 (3.7990626096725464) | > loss_feat: 8.42837905883789 (5.120927095413208) | > loss_mel: 25.207242965698242 (22.46994686126709) | > loss_duration: 2.7638769149780273 (2.797831654548645) | > loss_1: 43.507530212402344 (36.798264503479004)  --> STEP: 3 | > loss_disc: 2.9139628410339355 (2.823355197906494) | > loss_disc_real_0: 0.2761782109737396 (0.28553981085618335) | > loss_disc_real_1: 0.380815714597702 (0.2959013283252716) | > loss_disc_real_2: 0.266916960477829 (0.2782209813594818) | > loss_disc_real_3: 0.31757256388664246 (0.33402960499127704) | > loss_disc_real_4: 0.23550386726856232 (0.2421084294716517) | > loss_disc_real_5: 0.3687451183795929 (0.3766794006029765) | > loss_0: 2.9139628410339355 (2.823355197906494) | > loss_gen: 2.3653903007507324 (2.5287935733795166) | > loss_kl: 2.2482705116271973 (3.2821319103240967) | > loss_feat: 2.5155599117279053 (4.252471367518107) | > loss_mel: 20.952911376953125 (21.96426836649577) | > loss_duration: 2.6052422523498535 (2.733635187149048) | > loss_1: 30.687374114990234 (34.761301040649414) --> EVAL PERFORMANCE | > avg_loader_time: 0.011647621790568033 (-0.0005833307902018241) | > avg_loss_disc: 2.823355197906494 (+0.45499444007873535) | > avg_loss_disc_real_0: 0.28553981085618335 (+0.15026155114173886) | > avg_loss_disc_real_1: 0.2959013283252716 (+0.010950500766436277) | > avg_loss_disc_real_2: 0.2782209813594818 (+0.06430937846501669) | > avg_loss_disc_real_3: 0.33402960499127704 (+0.055181458592414856) | > avg_loss_disc_real_4: 0.2421084294716517 (-0.035907812416553525) | > avg_loss_disc_real_5: 0.3766794006029765 (+0.12960636615753177) | > avg_loss_0: 2.823355197906494 (+0.45499444007873535) | > avg_loss_gen: 2.5287935733795166 (-0.07868472735087062) | > avg_loss_kl: 3.2821319103240967 (+0.12459687391916896) | > avg_loss_feat: 4.252471367518107 (-0.9662916660308838) | > avg_loss_mel: 21.96426836649577 (-1.8690128326416016) | > avg_loss_duration: 2.733635187149048 (+0.03548343976338719) | > avg_loss_1: 34.761301040649414 (-2.7539056142171248)  > EPOCH: 404/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:05:37)   --> TIME: 2023-10-20 04:05:56 -- STEP: 29/50 -- GLOBAL_STEP: 73230 | > loss_disc: 3.1821236610412598 (2.419671346401347) | > loss_disc_real_0: 0.026517871767282486 (0.14800457951837573) | > loss_disc_real_1: 0.25107404589653015 (0.22786983295247473) | > loss_disc_real_2: 0.2553073465824127 (0.22823820918284612) | > loss_disc_real_3: 0.2544228136539459 (0.2576099893656271) | > loss_disc_real_4: 0.28599196672439575 (0.21137773984208189) | > loss_disc_real_5: 0.32175782322883606 (0.2454224837751224) | > loss_0: 3.1821236610412598 (2.419671346401347) | > grad_norm_0: tensor(8053.2617, device='cuda:0') (tensor(1751.2765, device='cuda:0')) | > loss_gen: 1.4798563718795776 (2.431292829842403) | > loss_kl: 1.1658203601837158 (0.8894628389128323) | > loss_feat: 0.30297303199768066 (5.465436218627568) | > loss_mel: 5.577532768249512 (21.968703796123638) | > loss_duration: 1.544287919998169 (1.529747403901199) | > loss_1: 10.070469856262207 (32.28464343630034) | > grad_norm_1: tensor(23829.5449, device='cuda:0') (tensor(47399.0273, device='cuda:0')) | > current_lr_0: 0.0001335254524125356 | > current_lr_1: 0.0001335254524125356 | > step_time: 0.2775 (0.4918691947542388) | > loader_time: 0.0254 (0.020539464621708314)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.705749273300171 (2.705749273300171) | > loss_disc_real_0: 0.17808198928833008 (0.17808198928833008) | > loss_disc_real_1: 0.22838129103183746 (0.22838129103183746) | > loss_disc_real_2: 0.27005088329315186 (0.27005088329315186) | > loss_disc_real_3: 0.32478663325309753 (0.32478663325309753) | > loss_disc_real_4: 0.25488799810409546 (0.25488799810409546) | > loss_disc_real_5: 0.283932626247406 (0.283932626247406) | > loss_0: 2.705749273300171 (2.705749273300171) | > loss_gen: 1.9664196968078613 (1.9664196968078613) | > loss_kl: 3.349350929260254 (3.349350929260254) | > loss_feat: 2.9014668464660645 (2.9014668464660645) | > loss_mel: 19.166988372802734 (19.166988372802734) | > loss_duration: 2.4677674770355225 (2.4677674770355225) | > loss_1: 29.851993560791016 (29.851993560791016)  --> STEP: 1 | > loss_disc: 1.9472923278808594 (1.9472923278808594) | > loss_disc_real_0: 0.02181863598525524 (0.02181863598525524) | > loss_disc_real_1: 0.26132309436798096 (0.26132309436798096) | > loss_disc_real_2: 0.22497887909412384 (0.22497887909412384) | > loss_disc_real_3: 0.12617135047912598 (0.12617135047912598) | > loss_disc_real_4: 0.08035591244697571 (0.08035591244697571) | > loss_disc_real_5: 0.16526974737644196 (0.16526974737644196) | > loss_0: 1.9472923278808594 (1.9472923278808594) | > loss_gen: 2.3319315910339355 (2.3319315910339355) | > loss_kl: 3.561953067779541 (3.561953067779541) | > loss_feat: 8.768177032470703 (8.768177032470703) | > loss_mel: 26.88852310180664 (26.88852310180664) | > loss_duration: 2.729856491088867 (2.729856491088867) | > loss_1: 44.28044128417969 (44.28044128417969)  --> STEP: 2 | > loss_disc: 3.0224766731262207 (2.48488450050354) | > loss_disc_real_0: 0.3153887391090393 (0.16860368754714727) | > loss_disc_real_1: 0.2953192889690399 (0.27832119166851044) | > loss_disc_real_2: 0.32564786076545715 (0.2753133699297905) | > loss_disc_real_3: 0.3201133608818054 (0.2231423556804657) | > loss_disc_real_4: 0.25934165716171265 (0.16984878480434418) | > loss_disc_real_5: 0.22041894495487213 (0.19284434616565704) | > loss_0: 3.0224766731262207 (2.48488450050354) | > loss_gen: 1.7497472763061523 (2.040839433670044) | > loss_kl: 4.133338451385498 (3.8476457595825195) | > loss_feat: 0.16531884670257568 (4.466747939586639) | > loss_mel: 2.5887491703033447 (14.738636136054993) | > loss_duration: 2.773405075073242 (2.7516307830810547) | > loss_1: 11.410558700561523 (27.845499992370605)  --> STEP: 3 | > loss_disc: 3.251997470855713 (2.740588823954264) | > loss_disc_real_0: 0.5854620933532715 (0.307556489482522) | > loss_disc_real_1: 0.295020192861557 (0.28388752539952594) | > loss_disc_real_2: 0.2671131491661072 (0.27257996300856274) | > loss_disc_real_3: 0.3615819811820984 (0.26928889751434326) | > loss_disc_real_4: 0.237978994846344 (0.19255885481834412) | > loss_disc_real_5: 0.4504479467868805 (0.2787122130393982) | > loss_0: 3.251997470855713 (2.740588823954264) | > loss_gen: 2.293583393096924 (2.1250874201456704) | > loss_kl: 1.7874444723129272 (3.1609119971593223) | > loss_feat: 3.7571651935577393 (4.230220357577006) | > loss_mel: 21.433082580566406 (16.970118284225464) | > loss_duration: 2.590465545654297 (2.6979090372721353) | > loss_1: 31.861740112304688 (29.1842466990153) --> EVAL PERFORMANCE | > avg_loader_time: 0.011675357818603516 (+2.773602803548235e-05) | > avg_loss_disc: 2.740588823954264 (-0.08276637395222997) | > avg_loss_disc_real_0: 0.307556489482522 (+0.02201667862633866) | > avg_loss_disc_real_1: 0.28388752539952594 (-0.012013802925745665) | > avg_loss_disc_real_2: 0.27257996300856274 (-0.005641018350919069) | > avg_loss_disc_real_3: 0.26928889751434326 (-0.06474070747693378) | > avg_loss_disc_real_4: 0.19255885481834412 (-0.04954957465330759) | > avg_loss_disc_real_5: 0.2787122130393982 (-0.0979671875635783) | > avg_loss_0: 2.740588823954264 (-0.08276637395222997) | > avg_loss_gen: 2.1250874201456704 (-0.4037061532338462) | > avg_loss_kl: 3.1609119971593223 (-0.12121991316477443) | > avg_loss_feat: 4.230220357577006 (-0.022251009941101074) | > avg_loss_mel: 16.970118284225464 (-4.9941500822703055) | > avg_loss_duration: 2.6979090372721353 (-0.03572614987691258) | > avg_loss_1: 29.1842466990153 (-5.577054341634113)  > EPOCH: 405/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:06:18)   --> TIME: 2023-10-20 04:06:28 -- STEP: 9/50 -- GLOBAL_STEP: 73260 | > loss_disc: 2.2765309810638428 (2.280597686767578) | > loss_disc_real_0: 0.11166223138570786 (0.09691065487762292) | > loss_disc_real_1: 0.2012576311826706 (0.22470501561959585) | > loss_disc_real_2: 0.13555048406124115 (0.18314826033181614) | > loss_disc_real_3: 0.23007512092590332 (0.2286115868224038) | > loss_disc_real_4: 0.09859208762645721 (0.15345462328857845) | > loss_disc_real_5: 0.06860995292663574 (0.2049229885968897) | > loss_0: 2.2765309810638428 (2.280597686767578) | > grad_norm_0: tensor(1180.5956, device='cuda:0') (tensor(1099.0164, device='cuda:0')) | > loss_gen: 1.7523555755615234 (2.457651204533047) | > loss_kl: 0.7411149144172668 (0.8406919828719563) | > loss_feat: 3.212892532348633 (6.610191174679333) | > loss_mel: 17.999418258666992 (21.887956592771744) | > loss_duration: 1.4556398391723633 (1.532173408402337) | > loss_1: 25.161422729492188 (33.32866430282593) | > grad_norm_1: tensor(17456.7734, device='cuda:0') (tensor(48874.5508, device='cuda:0')) | > current_lr_0: 0.00013339198536290638 | > current_lr_1: 0.00013339198536290638 | > step_time: 1.4335 (0.5748497645060221) | > loader_time: 0.0148 (0.01797726419236925)  --> TIME: 2023-10-20 04:06:43 -- STEP: 39/50 -- GLOBAL_STEP: 73290 | > loss_disc: 2.744551658630371 (2.4398002624511714) | > loss_disc_real_0: 0.13750074803829193 (0.1455000105958718) | > loss_disc_real_1: 0.15835639834403992 (0.22458806309180382) | > loss_disc_real_2: 0.15640930831432343 (0.22953213120882326) | > loss_disc_real_3: 0.1670607477426529 (0.24513848240558916) | > loss_disc_real_4: 0.3074333369731903 (0.24112067562647355) | > loss_disc_real_5: 0.2908485233783722 (0.22415675585850692) | > loss_0: 2.744551658630371 (2.4398002624511714) | > grad_norm_0: tensor(991.6654, device='cuda:0') (tensor(1138.3152, device='cuda:0')) | > loss_gen: 2.047189235687256 (2.4802763706598525) | > loss_kl: 0.8269650340080261 (0.8349801682126827) | > loss_feat: 4.718610763549805 (5.844949527046619) | > loss_mel: 22.851194381713867 (22.07883812525333) | > loss_duration: 1.5789538621902466 (1.5307189715214264) | > loss_1: 32.02291488647461 (32.76976298063231) | > grad_norm_1: tensor(21761.2852, device='cuda:0') (tensor(38190.9219, device='cuda:0')) | > current_lr_0: 0.00013339198536290638 | > current_lr_1: 0.00013339198536290638 | > step_time: 0.5685 (0.48975500082358336) | > loader_time: 0.0256 (0.015092067229442107)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6985132694244385 (2.6985132694244385) | > loss_disc_real_0: 0.29963287711143494 (0.29963287711143494) | > loss_disc_real_1: 0.2713203430175781 (0.2713203430175781) | > loss_disc_real_2: 0.2622028589248657 (0.2622028589248657) | > loss_disc_real_3: 0.2033853828907013 (0.2033853828907013) | > loss_disc_real_4: 0.20077478885650635 (0.20077478885650635) | > loss_disc_real_5: 0.2517685890197754 (0.2517685890197754) | > loss_0: 2.6985132694244385 (2.6985132694244385) | > loss_gen: 1.885008454322815 (1.885008454322815) | > loss_kl: 3.280324935913086 (3.280324935913086) | > loss_feat: 3.059333562850952 (3.059333562850952) | > loss_mel: 16.527223587036133 (16.527223587036133) | > loss_duration: 2.5303127765655518 (2.5303127765655518) | > loss_1: 27.282203674316406 (27.282203674316406)  --> STEP: 1 | > loss_disc: 2.562110662460327 (2.562110662460327) | > loss_disc_real_0: 0.39332258701324463 (0.39332258701324463) | > loss_disc_real_1: 0.2995227575302124 (0.2995227575302124) | > loss_disc_real_2: 0.26505041122436523 (0.26505041122436523) | > loss_disc_real_3: 0.43674609065055847 (0.43674609065055847) | > loss_disc_real_4: 0.22701720893383026 (0.22701720893383026) | > loss_disc_real_5: 0.4705120623111725 (0.4705120623111725) | > loss_0: 2.562110662460327 (2.562110662460327) | > loss_gen: 3.685427665710449 (3.685427665710449) | > loss_kl: 3.959238290786743 (3.959238290786743) | > loss_feat: 6.158834934234619 (6.158834934234619) | > loss_mel: 24.383991241455078 (24.383991241455078) | > loss_duration: 2.7848076820373535 (2.7848076820373535) | > loss_1: 40.9723014831543 (40.9723014831543)  --> STEP: 2 | > loss_disc: 2.8638229370117188 (2.712966799736023) | > loss_disc_real_0: 0.32239505648612976 (0.3578588217496872) | > loss_disc_real_1: 0.17623989284038544 (0.23788132518529892) | > loss_disc_real_2: 0.1881358027458191 (0.22659310698509216) | > loss_disc_real_3: 0.17372651398181915 (0.3052363023161888) | > loss_disc_real_4: 0.40452513098716736 (0.3157711699604988) | > loss_disc_real_5: 0.6243267059326172 (0.5474193841218948) | > loss_0: 2.8638229370117188 (2.712966799736023) | > loss_gen: 2.8087098598480225 (3.247068762779236) | > loss_kl: 4.043639659881592 (4.0014389753341675) | > loss_feat: 5.863387107849121 (6.01111102104187) | > loss_mel: 26.280311584472656 (25.332151412963867) | > loss_duration: 2.7737131118774414 (2.7792603969573975) | > loss_1: 41.76976013183594 (41.37103080749512)  --> STEP: 3 | > loss_disc: 3.0371170043945312 (2.821016867955526) | > loss_disc_real_0: 0.31474775075912476 (0.34348846475283307) | > loss_disc_real_1: 0.31816965341567993 (0.2646441012620926) | > loss_disc_real_2: 0.3545205891132355 (0.2692356010278066) | > loss_disc_real_3: 0.29703930020332336 (0.302503968278567) | > loss_disc_real_4: 0.2585987448692322 (0.2967136949300766) | > loss_disc_real_5: 0.26954957842826843 (0.4547961155573527) | > loss_0: 3.0371170043945312 (2.821016867955526) | > loss_gen: 1.8162274360656738 (2.7701216538747153) | > loss_kl: 1.477577567100525 (3.1601518392562866) | > loss_feat: 0.011789141222834587 (4.011337061102192) | > loss_mel: 1.7880346775054932 (17.48411250114441) | > loss_duration: 2.6477835178375244 (2.7354347705841064) | > loss_1: 7.741412162780762 (30.161157925923664) --> EVAL PERFORMANCE | > avg_loader_time: 0.016054312388102215 (+0.004378954569498699) | > avg_loss_disc: 2.821016867955526 (+0.08042804400126169) | > avg_loss_disc_real_0: 0.34348846475283307 (+0.035931975270311056) | > avg_loss_disc_real_1: 0.2646441012620926 (-0.01924342413743335) | > avg_loss_disc_real_2: 0.2692356010278066 (-0.003344361980756161) | > avg_loss_disc_real_3: 0.302503968278567 (+0.03321507076422375) | > avg_loss_disc_real_4: 0.2967136949300766 (+0.10415484011173248) | > avg_loss_disc_real_5: 0.4547961155573527 (+0.17608390251795453) | > avg_loss_0: 2.821016867955526 (+0.08042804400126169) | > avg_loss_gen: 2.7701216538747153 (+0.6450342337290449) | > avg_loss_kl: 3.1601518392562866 (-0.0007601579030356298) | > avg_loss_feat: 4.011337061102192 (-0.21888329647481441) | > avg_loss_mel: 17.48411250114441 (+0.5139942169189453) | > avg_loss_duration: 2.7354347705841064 (+0.03752573331197118) | > avg_loss_1: 30.161157925923664 (+0.9769112269083635)  > EPOCH: 406/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:06:57)   --> TIME: 2023-10-20 04:07:11 -- STEP: 19/50 -- GLOBAL_STEP: 73320 | > loss_disc: 2.6868669986724854 (2.257473456232171) | > loss_disc_real_0: 0.25693178176879883 (0.13140444783493876) | > loss_disc_real_1: 0.2336338758468628 (0.2119582322867293) | > loss_disc_real_2: 0.37340760231018066 (0.2332051678707725) | > loss_disc_real_3: 0.40552064776420593 (0.19636240876034686) | > loss_disc_real_4: 0.3018752336502075 (0.20317033423404945) | > loss_disc_real_5: 0.33108484745025635 (0.21263684273550384) | > loss_0: 2.6868669986724854 (2.257473456232171) | > grad_norm_0: tensor(3500.8853, device='cuda:0') (tensor(1422.7400, device='cuda:0')) | > loss_gen: 2.741657018661499 (2.521649530059413) | > loss_kl: 0.7308236360549927 (0.8690614606204786) | > loss_feat: 3.1191599369049072 (6.189708361108052) | > loss_mel: 21.717790603637695 (24.01585854982075) | > loss_duration: 1.5866564512252808 (1.5659902472245066) | > loss_1: 29.896087646484375 (35.16226803629022) | > grad_norm_1: tensor(22995.4102, device='cuda:0') (tensor(44630.0781, device='cuda:0')) | > current_lr_0: 0.00013325865172194958 | > current_lr_1: 0.00013325865172194958 | > step_time: 0.2827 (0.46896554294385406) | > loader_time: 0.0038 (0.013034557041368987)  --> TIME: 2023-10-20 04:07:24 -- STEP: 49/50 -- GLOBAL_STEP: 73350 | > loss_disc: 2.542804718017578 (2.32994292463575) | > loss_disc_real_0: 0.18793152272701263 (0.1555432513527268) | > loss_disc_real_1: 0.18845044076442719 (0.22062157254133904) | > loss_disc_real_2: 0.24058964848518372 (0.21450242111269308) | > loss_disc_real_3: 0.37085384130477905 (0.2190435800929459) | > loss_disc_real_4: 0.26907971501350403 (0.1942988494411111) | > loss_disc_real_5: 0.3539058268070221 (0.2162333084270358) | > loss_0: 2.542804718017578 (2.32994292463575) | > grad_norm_0: tensor(1363.7910, device='cuda:0') (tensor(1423.9036, device='cuda:0')) | > loss_gen: 2.2443249225616455 (2.4227421186408207) | > loss_kl: 0.6438077688217163 (0.8525079184648942) | > loss_feat: 1.8064839839935303 (5.71145812984632) | > loss_mel: 21.56924057006836 (22.44543019119574) | > loss_duration: 1.7051743268966675 (1.5243371822396103) | > loss_1: 27.969030380249023 (32.95647572497932) | > grad_norm_1: tensor(10596.7158, device='cuda:0') (tensor(44714.5352, device='cuda:0')) | > current_lr_0: 0.00013325865172194958 | > current_lr_1: 0.00013325865172194958 | > step_time: 0.373 (0.4322515312506228) | > loader_time: 0.5508 (0.021096467971801758)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.830453872680664 (2.830453872680664) | > loss_disc_real_0: 0.30241888761520386 (0.30241888761520386) | > loss_disc_real_1: 0.23448623716831207 (0.23448623716831207) | > loss_disc_real_2: 0.37863099575042725 (0.37863099575042725) | > loss_disc_real_3: 0.2927961051464081 (0.2927961051464081) | > loss_disc_real_4: 0.46837756037712097 (0.46837756037712097) | > loss_disc_real_5: 0.5709941387176514 (0.5709941387176514) | > loss_0: 2.830453872680664 (2.830453872680664) | > loss_gen: 3.3812813758850098 (3.3812813758850098) | > loss_kl: 2.900907516479492 (2.900907516479492) | > loss_feat: 5.337112903594971 (5.337112903594971) | > loss_mel: 21.020288467407227 (21.020288467407227) | > loss_duration: 2.41570782661438 (2.41570782661438) | > loss_1: 35.0552978515625 (35.0552978515625)  --> STEP: 1 | > loss_disc: 2.7475361824035645 (2.7475361824035645) | > loss_disc_real_0: 0.09831447899341583 (0.09831447899341583) | > loss_disc_real_1: 0.27150413393974304 (0.27150413393974304) | > loss_disc_real_2: 0.2841207981109619 (0.2841207981109619) | > loss_disc_real_3: 0.5046947598457336 (0.5046947598457336) | > loss_disc_real_4: 0.48460081219673157 (0.48460081219673157) | > loss_disc_real_5: 0.5761420130729675 (0.5761420130729675) | > loss_0: 2.7475361824035645 (2.7475361824035645) | > loss_gen: 3.3041934967041016 (3.3041934967041016) | > loss_kl: 4.341861724853516 (4.341861724853516) | > loss_feat: 6.299314022064209 (6.299314022064209) | > loss_mel: 28.859121322631836 (28.859121322631836) | > loss_duration: 2.7537484169006348 (2.7537484169006348) | > loss_1: 45.5582389831543 (45.5582389831543)  --> STEP: 2 | > loss_disc: 2.922907829284668 (2.835222005844116) | > loss_disc_real_0: 0.24951422214508057 (0.1739143505692482) | > loss_disc_real_1: 0.2530519664287567 (0.2622780501842499) | > loss_disc_real_2: 0.30828428268432617 (0.29620254039764404) | > loss_disc_real_3: 0.3274432420730591 (0.41606900095939636) | > loss_disc_real_4: 0.28220897912979126 (0.3834048956632614) | > loss_disc_real_5: 0.3641851842403412 (0.47016359865665436) | > loss_0: 2.922907829284668 (2.835222005844116) | > loss_gen: 1.9596325159072876 (2.6319130063056946) | > loss_kl: 3.7101657390594482 (4.026013731956482) | > loss_feat: 0.5804335474967957 (3.4398737847805023) | > loss_mel: 18.634920120239258 (23.747020721435547) | > loss_duration: 2.552198648452759 (2.6529735326766968) | > loss_1: 27.43735122680664 (36.49779510498047)  --> STEP: 3 | > loss_disc: 2.7964911460876465 (2.8223117192586265) | > loss_disc_real_0: 0.6399138569831848 (0.32924751937389374) | > loss_disc_real_1: 0.29085949063301086 (0.27180519700050354) | > loss_disc_real_2: 0.39481279253959656 (0.32907262444496155) | > loss_disc_real_3: 0.2650376260280609 (0.36572520931561786) | > loss_disc_real_4: 0.09992047399282455 (0.28891008843978244) | > loss_disc_real_5: 0.3595564365386963 (0.433294544617335) | > loss_0: 2.7964911460876465 (2.8223117192586265) | > loss_gen: 3.6704025268554688 (2.978076179822286) | > loss_kl: 2.024123430252075 (3.3587169647216797) | > loss_feat: 7.568214416503906 (4.815987328688304) | > loss_mel: 24.43604850769043 (23.976696650187176) | > loss_duration: 2.649165153503418 (2.6517040729522705) | > loss_1: 40.34795379638672 (37.78118133544922) --> EVAL PERFORMANCE | > avg_loader_time: 0.017532507578531902 (+0.0014781951904296875) | > avg_loss_disc: 2.8223117192586265 (+0.001294851303100586) | > avg_loss_disc_real_0: 0.32924751937389374 (-0.01424094537893933) | > avg_loss_disc_real_1: 0.27180519700050354 (+0.00716109573841095) | > avg_loss_disc_real_2: 0.32907262444496155 (+0.059837023417154966) | > avg_loss_disc_real_3: 0.36572520931561786 (+0.06322124103705085) | > avg_loss_disc_real_4: 0.28891008843978244 (-0.007803606490294157) | > avg_loss_disc_real_5: 0.433294544617335 (-0.0215015709400177) | > avg_loss_0: 2.8223117192586265 (+0.001294851303100586) | > avg_loss_gen: 2.978076179822286 (+0.2079545259475708) | > avg_loss_kl: 3.3587169647216797 (+0.19856512546539307) | > avg_loss_feat: 4.815987328688304 (+0.804650267586112) | > avg_loss_mel: 23.976696650187176 (+6.4925841490427665) | > avg_loss_duration: 2.6517040729522705 (-0.08373069763183594) | > avg_loss_1: 37.78118133544922 (+7.620023409525555)  > EPOCH: 407/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:07:35)   --> TIME: 2023-10-20 04:07:55 -- STEP: 29/50 -- GLOBAL_STEP: 73380 | > loss_disc: 3.4587790966033936 (2.302621109732266) | > loss_disc_real_0: 0.2994368374347687 (0.16289881571870427) | > loss_disc_real_1: 0.28826025128364563 (0.22197914496064186) | > loss_disc_real_2: 0.4654255509376526 (0.2199042546081132) | > loss_disc_real_3: 0.292130708694458 (0.2456678981924879) | > loss_disc_real_4: 0.3697164058685303 (0.1923749026489155) | > loss_disc_real_5: 0.4152293801307678 (0.22479260398139214) | > loss_0: 3.4587790966033936 (2.302621109732266) | > grad_norm_0: tensor(1048.3870, device='cuda:0') (tensor(1341.6243, device='cuda:0')) | > loss_gen: 2.019171953201294 (2.6406953745874864) | > loss_kl: 0.9338664412498474 (0.9225141395782602) | > loss_feat: 4.161027431488037 (6.294651500880718) | > loss_mel: 23.89072036743164 (20.995991419101582) | > loss_duration: 1.530493974685669 (1.5486944585010922) | > loss_1: 32.535282135009766 (32.40254689907204) | > grad_norm_1: tensor(5683.8735, device='cuda:0') (tensor(56422.1445, device='cuda:0')) | > current_lr_0: 0.0001331254513563148 | > current_lr_1: 0.0001331254513563148 | > step_time: 0.683 (0.5018990286465349) | > loader_time: 0.0244 (0.020133174698928308)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5083794593811035 (2.5083794593811035) | > loss_disc_real_0: 0.31743907928466797 (0.31743907928466797) | > loss_disc_real_1: 0.2591244578361511 (0.2591244578361511) | > loss_disc_real_2: 0.3501695394515991 (0.3501695394515991) | > loss_disc_real_3: 0.2548604905605316 (0.2548604905605316) | > loss_disc_real_4: 0.2838936746120453 (0.2838936746120453) | > loss_disc_real_5: 0.2523447275161743 (0.2523447275161743) | > loss_0: 2.5083794593811035 (2.5083794593811035) | > loss_gen: 3.191450595855713 (3.191450595855713) | > loss_kl: 2.92647123336792 (2.92647123336792) | > loss_feat: 7.469874858856201 (7.469874858856201) | > loss_mel: 22.804018020629883 (22.804018020629883) | > loss_duration: 2.551893472671509 (2.551893472671509) | > loss_1: 38.94371032714844 (38.94371032714844)  --> STEP: 1 | > loss_disc: 2.3972651958465576 (2.3972651958465576) | > loss_disc_real_0: 0.281056672334671 (0.281056672334671) | > loss_disc_real_1: 0.12156690657138824 (0.12156690657138824) | > loss_disc_real_2: 0.16929373145103455 (0.16929373145103455) | > loss_disc_real_3: 0.3909880518913269 (0.3909880518913269) | > loss_disc_real_4: 0.2891860604286194 (0.2891860604286194) | > loss_disc_real_5: 0.4288068115711212 (0.4288068115711212) | > loss_0: 2.3972651958465576 (2.3972651958465576) | > loss_gen: 3.0769708156585693 (3.0769708156585693) | > loss_kl: 3.588893175125122 (3.588893175125122) | > loss_feat: 5.908888816833496 (5.908888816833496) | > loss_mel: 25.237947463989258 (25.237947463989258) | > loss_duration: 2.7587966918945312 (2.7587966918945312) | > loss_1: 40.571495056152344 (40.571495056152344)  --> STEP: 2 | > loss_disc: 2.817692279815674 (2.6074787378311157) | > loss_disc_real_0: 0.07190686464309692 (0.17648176848888397) | > loss_disc_real_1: 0.260674387216568 (0.19112064689397812) | > loss_disc_real_2: 0.15304294228553772 (0.16116833686828613) | > loss_disc_real_3: 0.3181735873222351 (0.354580819606781) | > loss_disc_real_4: 0.3506784439086914 (0.3199322521686554) | > loss_disc_real_5: 0.3310300409793854 (0.3799184262752533) | > loss_0: 2.817692279815674 (2.6074787378311157) | > loss_gen: 1.823824405670166 (2.4503976106643677) | > loss_kl: 4.002713203430176 (3.795803189277649) | > loss_feat: 2.14029598236084 (4.024592399597168) | > loss_mel: 27.770729064941406 (26.504338264465332) | > loss_duration: 2.7354183197021484 (2.74710750579834) | > loss_1: 38.472984313964844 (39.522239685058594)  --> STEP: 3 | > loss_disc: 2.095212697982788 (2.4367233912150064) | > loss_disc_real_0: 0.2612348198890686 (0.20473278562227884) | > loss_disc_real_1: 0.17202293872833252 (0.18475474417209625) | > loss_disc_real_2: 0.1305883526802063 (0.15097500880559286) | > loss_disc_real_3: 0.15097357332706451 (0.2867117375135422) | > loss_disc_real_4: 0.14618323743343353 (0.2620159139235814) | > loss_disc_real_5: 0.4225880205631256 (0.39414162437121075) | > loss_0: 2.095212697982788 (2.4367233912150064) | > loss_gen: 2.9941391944885254 (2.6316448052724204) | > loss_kl: 1.890878438949585 (3.1608282725016275) | > loss_feat: 5.664308547973633 (4.571164449055989) | > loss_mel: 22.975906372070312 (25.32819430033366) | > loss_duration: 2.662430763244629 (2.718881924947103) | > loss_1: 36.18766403198242 (38.41071446736654) --> EVAL PERFORMANCE | > avg_loader_time: 0.004654407501220703 (-0.012878100077311199) | > avg_loss_disc: 2.4367233912150064 (-0.3855883280436201) | > avg_loss_disc_real_0: 0.20473278562227884 (-0.1245147337516149) | > avg_loss_disc_real_1: 0.18475474417209625 (-0.08705045282840729) | > avg_loss_disc_real_2: 0.15097500880559286 (-0.17809761563936868) | > avg_loss_disc_real_3: 0.2867117375135422 (-0.07901347180207569) | > avg_loss_disc_real_4: 0.2620159139235814 (-0.02689417451620102) | > avg_loss_disc_real_5: 0.39414162437121075 (-0.03915292024612427) | > avg_loss_0: 2.4367233912150064 (-0.3855883280436201) | > avg_loss_gen: 2.6316448052724204 (-0.3464313745498657) | > avg_loss_kl: 3.1608282725016275 (-0.19788869222005223) | > avg_loss_feat: 4.571164449055989 (-0.24482287963231464) | > avg_loss_mel: 25.32819430033366 (+1.3514976501464844) | > avg_loss_duration: 2.718881924947103 (+0.0671778519948325) | > avg_loss_1: 38.41071446736654 (+0.6295331319173201)  > EPOCH: 408/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:08:17)   --> TIME: 2023-10-20 04:08:26 -- STEP: 9/50 -- GLOBAL_STEP: 73410 | > loss_disc: 2.199723482131958 (2.337109512752957) | > loss_disc_real_0: 0.08574077486991882 (0.19355942640039656) | > loss_disc_real_1: 0.27812090516090393 (0.19859932528601754) | > loss_disc_real_2: 0.11452481150627136 (0.17516442139943442) | > loss_disc_real_3: 0.31203940510749817 (0.2253370558222135) | > loss_disc_real_4: 0.29357853531837463 (0.28446075485812294) | > loss_disc_real_5: 0.2550297677516937 (0.24177984727753532) | > loss_0: 2.199723482131958 (2.337109512752957) | > grad_norm_0: tensor(1063.8475, device='cuda:0') (tensor(1207.8560, device='cuda:0')) | > loss_gen: 2.6208338737487793 (2.5440026256773205) | > loss_kl: 0.5747951865196228 (1.2053912745581732) | > loss_feat: 5.581255912780762 (5.93057530042198) | > loss_mel: 24.547327041625977 (21.881020651923286) | > loss_duration: 1.4995208978652954 (1.535605125957065) | > loss_1: 34.82373046875 (33.096594386630585) | > grad_norm_1: tensor(6367.8145, device='cuda:0') (tensor(48114.8750, device='cuda:0')) | > current_lr_0: 0.0001329923841327851 | > current_lr_1: 0.0001329923841327851 | > step_time: 0.4965 (0.5231541527642144) | > loader_time: 0.0428 (0.011756102244059244)  --> TIME: 2023-10-20 04:08:42 -- STEP: 39/50 -- GLOBAL_STEP: 73440 | > loss_disc: 1.1257660388946533 (2.3905804126690597) | > loss_disc_real_0: 0.06891950219869614 (0.15563888311720428) | > loss_disc_real_1: 0.08729585260152817 (0.19850497272534245) | > loss_disc_real_2: 0.025297513231635094 (0.20683593441469547) | > loss_disc_real_3: 0.028971638530492783 (0.23034744165264642) | > loss_disc_real_4: 0.07263104617595673 (0.2369870845323954) | > loss_disc_real_5: 0.048400942236185074 (0.22009820328691068) | > loss_0: 1.1257660388946533 (2.3905804126690597) | > grad_norm_0: tensor(814.0285, device='cuda:0') (tensor(1220.9183, device='cuda:0')) | > loss_gen: 4.12821102142334 (2.4967981852017918) | > loss_kl: 0.21892814338207245 (0.9700136860975849) | > loss_feat: 12.216947555541992 (5.929458520709512) | > loss_mel: 24.89051055908203 (22.706579251167103) | > loss_duration: 1.5665764808654785 (1.5201134406603296) | > loss_1: 43.021175384521484 (33.62296280494103) | > grad_norm_1: tensor(139841.5312, device='cuda:0') (tensor(46733.7969, device='cuda:0')) | > current_lr_0: 0.0001329923841327851 | > current_lr_1: 0.0001329923841327851 | > step_time: 0.3017 (0.5033320524753666) | > loader_time: 0.0252 (0.01406567524640988)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.443236827850342 (2.443236827850342) | > loss_disc_real_0: 0.27190670371055603 (0.27190670371055603) | > loss_disc_real_1: 0.161224365234375 (0.161224365234375) | > loss_disc_real_2: 0.24603071808815002 (0.24603071808815002) | > loss_disc_real_3: 0.23460496962070465 (0.23460496962070465) | > loss_disc_real_4: 0.2671824097633362 (0.2671824097633362) | > loss_disc_real_5: 0.4230690598487854 (0.4230690598487854) | > loss_0: 2.443236827850342 (2.443236827850342) | > loss_gen: 2.628819227218628 (2.628819227218628) | > loss_kl: 3.3343453407287598 (3.3343453407287598) | > loss_feat: 5.8728790283203125 (5.8728790283203125) | > loss_mel: 22.730932235717773 (22.730932235717773) | > loss_duration: 2.4974422454833984 (2.4974422454833984) | > loss_1: 37.064414978027344 (37.064414978027344)  --> STEP: 1 | > loss_disc: 2.4376370906829834 (2.4376370906829834) | > loss_disc_real_0: 0.013445161283016205 (0.013445161283016205) | > loss_disc_real_1: 0.15359805524349213 (0.15359805524349213) | > loss_disc_real_2: 0.2785821259021759 (0.2785821259021759) | > loss_disc_real_3: 0.10876461863517761 (0.10876461863517761) | > loss_disc_real_4: 0.1612515151500702 (0.1612515151500702) | > loss_disc_real_5: 0.19931140542030334 (0.19931140542030334) | > loss_0: 2.4376370906829834 (2.4376370906829834) | > loss_gen: 1.7329052686691284 (1.7329052686691284) | > loss_kl: 3.665374279022217 (3.665374279022217) | > loss_feat: 10.77309799194336 (10.77309799194336) | > loss_mel: 27.87579917907715 (27.87579917907715) | > loss_duration: 2.7143988609313965 (2.7143988609313965) | > loss_1: 46.761573791503906 (46.761573791503906)  --> STEP: 2 | > loss_disc: 2.5596249103546143 (2.498631000518799) | > loss_disc_real_0: 0.17902490496635437 (0.09623503312468529) | > loss_disc_real_1: 0.1939903050661087 (0.17379418015480042) | > loss_disc_real_2: 0.2278851568698883 (0.2532336413860321) | > loss_disc_real_3: 0.08265316486358643 (0.09570889174938202) | > loss_disc_real_4: 0.1547192633152008 (0.1579853892326355) | > loss_disc_real_5: 0.11649934202432632 (0.15790537372231483) | > loss_0: 2.5596249103546143 (2.498631000518799) | > loss_gen: 1.9792041778564453 (1.8560547232627869) | > loss_kl: 3.5995051860809326 (3.6324397325515747) | > loss_feat: 7.853078365325928 (9.313088178634644) | > loss_mel: 25.340293884277344 (26.608046531677246) | > loss_duration: 2.7301337718963623 (2.7222663164138794) | > loss_1: 41.50221252441406 (44.131893157958984)  --> STEP: 3 | > loss_disc: 2.790292978286743 (2.5958516597747803) | > loss_disc_real_0: 0.22621384263038635 (0.13956130295991898) | > loss_disc_real_1: 0.37706974148750305 (0.24155270059903464) | > loss_disc_real_2: 0.3859662711620331 (0.2974778513113658) | > loss_disc_real_3: 0.29435473680496216 (0.1619241734345754) | > loss_disc_real_4: 0.28442952036857605 (0.2001334329446157) | > loss_disc_real_5: 0.18016266822814941 (0.16532447189092636) | > loss_0: 2.790292978286743 (2.5958516597747803) | > loss_gen: 2.482600688934326 (2.0649033784866333) | > loss_kl: 1.6189210414886475 (2.961266835530599) | > loss_feat: 5.596031188964844 (8.074069182078043) | > loss_mel: 25.548402786254883 (26.254831949869793) | > loss_duration: 2.6133031845092773 (2.6859452724456787) | > loss_1: 37.85926055908203 (42.041015625) --> EVAL PERFORMANCE | > avg_loader_time: 0.006778319676717122 (+0.002123912175496419) | > avg_loss_disc: 2.5958516597747803 (+0.1591282685597739) | > avg_loss_disc_real_0: 0.13956130295991898 (-0.06517148266235986) | > avg_loss_disc_real_1: 0.24155270059903464 (+0.056797956426938384) | > avg_loss_disc_real_2: 0.2974778513113658 (+0.14650284250577292) | > avg_loss_disc_real_3: 0.1619241734345754 (-0.12478756407896677) | > avg_loss_disc_real_4: 0.2001334329446157 (-0.06188248097896573) | > avg_loss_disc_real_5: 0.16532447189092636 (-0.2288171524802844) | > avg_loss_0: 2.5958516597747803 (+0.1591282685597739) | > avg_loss_gen: 2.0649033784866333 (-0.5667414267857871) | > avg_loss_kl: 2.961266835530599 (-0.19956143697102835) | > avg_loss_feat: 8.074069182078043 (+3.5029047330220537) | > avg_loss_mel: 26.254831949869793 (+0.9266376495361328) | > avg_loss_duration: 2.6859452724456787 (-0.0329366525014243) | > avg_loss_1: 42.041015625 (+3.630301157633461)  > EPOCH: 409/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:08:57)   --> TIME: 2023-10-20 04:09:11 -- STEP: 19/50 -- GLOBAL_STEP: 73470 | > loss_disc: 1.7158644199371338 (2.1551146130812797) | > loss_disc_real_0: 0.07927794754505157 (0.12497851762332414) | > loss_disc_real_1: 0.1547221839427948 (0.22389277315845615) | > loss_disc_real_2: 0.1770983338356018 (0.20095458264021496) | > loss_disc_real_3: 0.27926743030548096 (0.22961583184568504) | > loss_disc_real_4: 0.12581788003444672 (0.19633258790954164) | > loss_disc_real_5: 0.10365191102027893 (0.19133578466349527) | > loss_0: 1.7158644199371338 (2.1551146130812797) | > grad_norm_0: tensor(336.3615, device='cuda:0') (tensor(1133.7874, device='cuda:0')) | > loss_gen: 2.8578362464904785 (2.6703248400437203) | > loss_kl: 0.6476051211357117 (0.8744945796696764) | > loss_feat: 8.32036018371582 (6.713377854541728) | > loss_mel: 28.53557586669922 (22.796753193202772) | > loss_duration: 1.6013821363449097 (1.5819395780563354) | > loss_1: 41.96276092529297 (34.63689051176374) | > grad_norm_1: tensor(35798.0273, device='cuda:0') (tensor(60554.7422, device='cuda:0')) | > current_lr_0: 0.00013285944991827655 | > current_lr_1: 0.00013285944991827655 | > step_time: 0.2537 (0.43786693874158356) | > loader_time: 0.002 (0.010784839328966643)  --> TIME: 2023-10-20 04:09:26 -- STEP: 49/50 -- GLOBAL_STEP: 73500 | > loss_disc: 1.8525724411010742 (2.3919284100435214) | > loss_disc_real_0: 0.08433037996292114 (0.14122670934516562) | > loss_disc_real_1: 0.12163160741329193 (0.21532561633811922) | > loss_disc_real_2: 0.09948595613241196 (0.22524392722668696) | > loss_disc_real_3: 0.14448313415050507 (0.2344339058487391) | > loss_disc_real_4: 0.18432030081748962 (0.21476678181515665) | > loss_disc_real_5: 0.09348728507757187 (0.2109843308144078) | > loss_0: 1.8525724411010742 (2.3919284100435214) | > grad_norm_0: tensor(900.4229, device='cuda:0') (tensor(1190.7788, device='cuda:0')) | > loss_gen: 2.8506503105163574 (2.406060685916822) | > loss_kl: 0.4673173129558563 (0.8247370320011158) | > loss_feat: 8.67068099975586 (5.682707210888668) | > loss_mel: 24.51767349243164 (21.768741617397385) | > loss_duration: 1.6689149141311646 (1.5295764232168392) | > loss_1: 38.175235748291016 (32.211823482902695) | > grad_norm_1: tensor(110767.7109, device='cuda:0') (tensor(44745.8828, device='cuda:0')) | > current_lr_0: 0.00013285944991827655 | > current_lr_1: 0.00013285944991827655 | > step_time: 0.3789 (0.4506413887958137) | > loader_time: 0.6939 (0.02373715809413365)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2225804328918457 (2.2225804328918457) | > loss_disc_real_0: 0.21227696537971497 (0.21227696537971497) | > loss_disc_real_1: 0.2802686095237732 (0.2802686095237732) | > loss_disc_real_2: 0.28498387336730957 (0.28498387336730957) | > loss_disc_real_3: 0.10929574817419052 (0.10929574817419052) | > loss_disc_real_4: 0.2283821851015091 (0.2283821851015091) | > loss_disc_real_5: 0.16203637421131134 (0.16203637421131134) | > loss_0: 2.2225804328918457 (2.2225804328918457) | > loss_gen: 2.67366886138916 (2.67366886138916) | > loss_kl: 3.7214930057525635 (3.7214930057525635) | > loss_feat: 6.82987642288208 (6.82987642288208) | > loss_mel: 24.29420280456543 (24.29420280456543) | > loss_duration: 2.46946120262146 (2.46946120262146) | > loss_1: 39.98870086669922 (39.98870086669922)  --> STEP: 1 | > loss_disc: 2.864727258682251 (2.864727258682251) | > loss_disc_real_0: 0.40587371587753296 (0.40587371587753296) | > loss_disc_real_1: 0.35448068380355835 (0.35448068380355835) | > loss_disc_real_2: 0.29118067026138306 (0.29118067026138306) | > loss_disc_real_3: 0.29156988859176636 (0.29156988859176636) | > loss_disc_real_4: 0.2585178017616272 (0.2585178017616272) | > loss_disc_real_5: 0.2525361180305481 (0.2525361180305481) | > loss_0: 2.864727258682251 (2.864727258682251) | > loss_gen: 2.312628984451294 (2.312628984451294) | > loss_kl: 3.6240453720092773 (3.6240453720092773) | > loss_feat: 5.601478099822998 (5.601478099822998) | > loss_mel: 23.049274444580078 (23.049274444580078) | > loss_duration: 2.6806156635284424 (2.6806156635284424) | > loss_1: 37.26803970336914 (37.26803970336914)  --> STEP: 2 | > loss_disc: 2.893510103225708 (2.8791186809539795) | > loss_disc_real_0: 0.15870341658592224 (0.2822885662317276) | > loss_disc_real_1: 0.2537747919559479 (0.3041277378797531) | > loss_disc_real_2: 0.2671300172805786 (0.27915534377098083) | > loss_disc_real_3: 0.4251975417137146 (0.3583837151527405) | > loss_disc_real_4: 0.25283539295196533 (0.25567659735679626) | > loss_disc_real_5: 0.2247559279203415 (0.2386460229754448) | > loss_0: 2.893510103225708 (2.8791186809539795) | > loss_gen: 1.9219592809677124 (2.117294132709503) | > loss_kl: 3.877695322036743 (3.7508703470230103) | > loss_feat: 3.8436319828033447 (4.722555041313171) | > loss_mel: 27.719755172729492 (25.384514808654785) | > loss_duration: 2.605520248413086 (2.643067955970764) | > loss_1: 39.96855926513672 (38.61829948425293)  --> STEP: 3 | > loss_disc: 1.9392926692962646 (2.565843343734741) | > loss_disc_real_0: 0.1064467504620552 (0.2236746276418368) | > loss_disc_real_1: 0.22221650183200836 (0.2768239925305049) | > loss_disc_real_2: 0.13467572629451752 (0.2309954712788264) | > loss_disc_real_3: 0.23127003014087677 (0.3160124868154526) | > loss_disc_real_4: 0.2480081170797348 (0.25312043726444244) | > loss_disc_real_5: 0.12133616954088211 (0.19954273849725723) | > loss_0: 1.9392926692962646 (2.565843343734741) | > loss_gen: 2.666346549987793 (2.3003116051355996) | > loss_kl: 1.8519173860549927 (3.117886026700338) | > loss_feat: 6.890531063079834 (5.4452137152353925) | > loss_mel: 21.53626823425293 (24.101765950520832) | > loss_duration: 2.769963502883911 (2.68536647160848) | > loss_1: 35.71502685546875 (37.65054194132487) --> EVAL PERFORMANCE | > avg_loader_time: 0.010342836380004883 (+0.0035645167032877607) | > avg_loss_disc: 2.565843343734741 (-0.030008316040039062) | > avg_loss_disc_real_0: 0.2236746276418368 (+0.08411332468191782) | > avg_loss_disc_real_1: 0.2768239925305049 (+0.035271291931470244) | > avg_loss_disc_real_2: 0.2309954712788264 (-0.0664823800325394) | > avg_loss_disc_real_3: 0.3160124868154526 (+0.15408831338087717) | > avg_loss_disc_real_4: 0.25312043726444244 (+0.05298700431982675) | > avg_loss_disc_real_5: 0.19954273849725723 (+0.03421826660633087) | > avg_loss_0: 2.565843343734741 (-0.030008316040039062) | > avg_loss_gen: 2.3003116051355996 (+0.23540822664896632) | > avg_loss_kl: 3.117886026700338 (+0.15661919116973877) | > avg_loss_feat: 5.4452137152353925 (-2.6288554668426505) | > avg_loss_mel: 24.101765950520832 (-2.1530659993489607) | > avg_loss_duration: 2.68536647160848 (-0.0005788008371987452) | > avg_loss_1: 37.65054194132487 (-4.390473683675133)  > EPOCH: 410/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:09:34)   --> TIME: 2023-10-20 04:09:55 -- STEP: 29/50 -- GLOBAL_STEP: 73530 | > loss_disc: 1.5444003343582153 (2.520484344712619) | > loss_disc_real_0: 0.06933210790157318 (0.17097762325007854) | > loss_disc_real_1: 0.14839793741703033 (0.23504001351779905) | > loss_disc_real_2: 0.09797483682632446 (0.23617429260549874) | > loss_disc_real_3: 0.23271773755550385 (0.23617370709263044) | > loss_disc_real_4: 0.02275075949728489 (0.22441871727591958) | > loss_disc_real_5: 0.06622646003961563 (0.218610723727736) | > loss_0: 1.5444003343582153 (2.520484344712619) | > grad_norm_0: tensor(706.8253, device='cuda:0') (tensor(1226.4833, device='cuda:0')) | > loss_gen: 3.0473904609680176 (2.295850153627066) | > loss_kl: 0.8005066514015198 (0.9746463360457585) | > loss_feat: 8.273306846618652 (4.829882780539578) | > loss_mel: 23.343360900878906 (20.011594825777514) | > loss_duration: 1.481223702430725 (1.5583280407149216) | > loss_1: 36.9457893371582 (29.670302210182978) | > grad_norm_1: tensor(60922.4453, device='cuda:0') (tensor(48512.1680, device='cuda:0')) | > current_lr_0: 0.00013272664857983836 | > current_lr_1: 0.00013272664857983836 | > step_time: 0.6814 (0.5140364992207493) | > loader_time: 0.0256 (0.017267802665973525)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7915542125701904 (1.7915542125701904) | > loss_disc_real_0: 0.031777024269104004 (0.031777024269104004) | > loss_disc_real_1: 0.06321659684181213 (0.06321659684181213) | > loss_disc_real_2: 0.09248153120279312 (0.09248153120279312) | > loss_disc_real_3: 0.1244126409292221 (0.1244126409292221) | > loss_disc_real_4: 0.026876047253608704 (0.026876047253608704) | > loss_disc_real_5: 0.10197994858026505 (0.10197994858026505) | > loss_0: 1.7915542125701904 (1.7915542125701904) | > loss_gen: 1.8355967998504639 (1.8355967998504639) | > loss_kl: 3.081249475479126 (3.081249475479126) | > loss_feat: 9.786580085754395 (9.786580085754395) | > loss_mel: 27.478551864624023 (27.478551864624023) | > loss_duration: 2.483532667160034 (2.483532667160034) | > loss_1: 44.66551208496094 (44.66551208496094)  --> STEP: 1 | > loss_disc: 3.0030016899108887 (3.0030016899108887) | > loss_disc_real_0: 0.12394154071807861 (0.12394154071807861) | > loss_disc_real_1: 0.30032679438591003 (0.30032679438591003) | > loss_disc_real_2: 0.2125948965549469 (0.2125948965549469) | > loss_disc_real_3: 0.40534159541130066 (0.40534159541130066) | > loss_disc_real_4: 0.41095730662345886 (0.41095730662345886) | > loss_disc_real_5: 0.29894858598709106 (0.29894858598709106) | > loss_0: 3.0030016899108887 (3.0030016899108887) | > loss_gen: 1.9861416816711426 (1.9861416816711426) | > loss_kl: 3.6835269927978516 (3.6835269927978516) | > loss_feat: 4.298116683959961 (4.298116683959961) | > loss_mel: 26.27920913696289 (26.27920913696289) | > loss_duration: 2.795351982116699 (2.795351982116699) | > loss_1: 39.0423469543457 (39.0423469543457)  --> STEP: 2 | > loss_disc: 1.8819875717163086 (2.4424946308135986) | > loss_disc_real_0: 0.04177812114357948 (0.08285983093082905) | > loss_disc_real_1: 0.03755183517932892 (0.16893931478261948) | > loss_disc_real_2: 0.0713467076420784 (0.14197080209851265) | > loss_disc_real_3: 0.13137906789779663 (0.26836033165454865) | > loss_disc_real_4: 0.08142128586769104 (0.24618929624557495) | > loss_disc_real_5: 0.02520955353975296 (0.162079069763422) | > loss_0: 1.8819875717163086 (2.4424946308135986) | > loss_gen: 2.128995418548584 (2.0575685501098633) | > loss_kl: 4.137490749359131 (3.910508871078491) | > loss_feat: 13.47967529296875 (8.888895988464355) | > loss_mel: 24.942832946777344 (25.611021041870117) | > loss_duration: 2.6674795150756836 (2.7314157485961914) | > loss_1: 47.35647201538086 (43.19940948486328)  --> STEP: 3 | > loss_disc: 2.2200708389282227 (2.3683533668518066) | > loss_disc_real_0: 0.17402616143226624 (0.11324860776464145) | > loss_disc_real_1: 0.29840922355651855 (0.21209595104058585) | > loss_disc_real_2: 0.1566583216190338 (0.14686664193868637) | > loss_disc_real_3: 0.24057035148143768 (0.25909700493017834) | > loss_disc_real_4: 0.3141823410987854 (0.26885364452997845) | > loss_disc_real_5: 0.13613300025463104 (0.15343037992715836) | > loss_0: 2.2200708389282227 (2.3683533668518066) | > loss_gen: 2.583580493927002 (2.232905864715576) | > loss_kl: 1.8843786716461182 (3.2351321379343667) | > loss_feat: 5.853941917419434 (7.877244631449382) | > loss_mel: 24.520366668701172 (25.247469584147137) | > loss_duration: 2.522866725921631 (2.6618994077046714) | > loss_1: 37.36513137817383 (41.2546501159668) --> EVAL PERFORMANCE | > avg_loader_time: 0.00885311762491862 (-0.0014897187550862636) | > avg_loss_disc: 2.3683533668518066 (-0.19748997688293457) | > avg_loss_disc_real_0: 0.11324860776464145 (-0.11042601987719534) | > avg_loss_disc_real_1: 0.21209595104058585 (-0.06472804148991904) | > avg_loss_disc_real_2: 0.14686664193868637 (-0.08412882934014002) | > avg_loss_disc_real_3: 0.25909700493017834 (-0.05691548188527423) | > avg_loss_disc_real_4: 0.26885364452997845 (+0.01573320726553601) | > avg_loss_disc_real_5: 0.15343037992715836 (-0.04611235857009888) | > avg_loss_0: 2.3683533668518066 (-0.19748997688293457) | > avg_loss_gen: 2.232905864715576 (-0.06740574042002345) | > avg_loss_kl: 3.2351321379343667 (+0.11724611123402884) | > avg_loss_feat: 7.877244631449382 (+2.4320309162139893) | > avg_loss_mel: 25.247469584147137 (+1.1457036336263045) | > avg_loss_duration: 2.6618994077046714 (-0.023467063903808594) | > avg_loss_1: 41.2546501159668 (+3.6041081746419295)  > EPOCH: 411/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:10:16)   --> TIME: 2023-10-20 04:10:25 -- STEP: 9/50 -- GLOBAL_STEP: 73560 | > loss_disc: 1.8716256618499756 (2.3565428256988525) | > loss_disc_real_0: 0.10007865726947784 (0.19575595234831175) | > loss_disc_real_1: 0.18474972248077393 (0.1946605338404576) | > loss_disc_real_2: 0.2172735184431076 (0.19817280107074314) | > loss_disc_real_3: 0.22037869691848755 (0.20626982218689388) | > loss_disc_real_4: 0.13850043714046478 (0.16610994852251476) | > loss_disc_real_5: 0.24675947427749634 (0.17620123508903715) | > loss_0: 1.8716256618499756 (2.3565428256988525) | > grad_norm_0: tensor(835.4038, device='cuda:0') (tensor(1681.6158, device='cuda:0')) | > loss_gen: 2.859757423400879 (2.32918910185496) | > loss_kl: 0.6202746033668518 (0.8010016282399496) | > loss_feat: 5.746840000152588 (5.79072231054306) | > loss_mel: 24.215030670166016 (21.61177651087443) | > loss_duration: 1.4917184114456177 (1.5105039676030476) | > loss_1: 34.93362045288086 (32.0431940290663) | > grad_norm_1: tensor(7121.9756, device='cuda:0') (tensor(33818.9883, device='cuda:0')) | > current_lr_0: 0.0001325939799846525 | > current_lr_1: 0.0001325939799846525 | > step_time: 0.423 (0.5259854793548584) | > loader_time: 0.0209 (0.009225474463568794)  --> TIME: 2023-10-20 04:10:41 -- STEP: 39/50 -- GLOBAL_STEP: 73590 | > loss_disc: 0.8178821802139282 (2.3587942581910353) | > loss_disc_real_0: 0.006614261772483587 (0.13552803339627686) | > loss_disc_real_1: 0.023135242983698845 (0.20547368224614707) | > loss_disc_real_2: 0.02656541019678116 (0.2075158759760551) | > loss_disc_real_3: 0.0806700810790062 (0.22166364917006248) | > loss_disc_real_4: 0.02385696768760681 (0.21148931855956712) | > loss_disc_real_5: 0.07299007475376129 (0.2359297626102582) | > loss_0: 0.8178821802139282 (2.3587942581910353) | > grad_norm_0: tensor(394.8456, device='cuda:0') (tensor(1472.3096, device='cuda:0')) | > loss_gen: 3.4762508869171143 (2.3973406553268433) | > loss_kl: 0.794427216053009 (0.850141948232284) | > loss_feat: 11.452779769897461 (5.711185150039501) | > loss_mel: 26.807893753051758 (23.16146475229507) | > loss_duration: 1.540791630744934 (1.5137160282868607) | > loss_1: 44.072139739990234 (33.63384882609049) | > grad_norm_1: tensor(16772.6621, device='cuda:0') (tensor(39056.7578, device='cuda:0')) | > current_lr_0: 0.0001325939799846525 | > current_lr_1: 0.0001325939799846525 | > step_time: 0.536 (0.49921622031774276) | > loader_time: 0.0022 (0.012569164618467675)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.116713047027588 (2.116713047027588) | > loss_disc_real_0: 0.08188645541667938 (0.08188645541667938) | > loss_disc_real_1: 0.17185118794441223 (0.17185118794441223) | > loss_disc_real_2: 0.1572445034980774 (0.1572445034980774) | > loss_disc_real_3: 0.24019558727741241 (0.24019558727741241) | > loss_disc_real_4: 0.06789235770702362 (0.06789235770702362) | > loss_disc_real_5: 0.06720025092363358 (0.06720025092363358) | > loss_0: 2.116713047027588 (2.116713047027588) | > loss_gen: 2.0449252128601074 (2.0449252128601074) | > loss_kl: 3.1355955600738525 (3.1355955600738525) | > loss_feat: 8.51733112335205 (8.51733112335205) | > loss_mel: 24.37270164489746 (24.37270164489746) | > loss_duration: 2.3554344177246094 (2.3554344177246094) | > loss_1: 40.425987243652344 (40.425987243652344)  --> STEP: 1 | > loss_disc: 2.228073835372925 (2.228073835372925) | > loss_disc_real_0: 0.025006212294101715 (0.025006212294101715) | > loss_disc_real_1: 0.07033868879079819 (0.07033868879079819) | > loss_disc_real_2: 0.10173676162958145 (0.10173676162958145) | > loss_disc_real_3: 0.11902321130037308 (0.11902321130037308) | > loss_disc_real_4: 0.1495005041360855 (0.1495005041360855) | > loss_disc_real_5: 0.043471429497003555 (0.043471429497003555) | > loss_0: 2.228073835372925 (2.228073835372925) | > loss_gen: 1.8720667362213135 (1.8720667362213135) | > loss_kl: 3.436572313308716 (3.436572313308716) | > loss_feat: 11.738054275512695 (11.738054275512695) | > loss_mel: 28.35918617248535 (28.35918617248535) | > loss_duration: 2.6694281101226807 (2.6694281101226807) | > loss_1: 48.07530975341797 (48.07530975341797)  --> STEP: 2 | > loss_disc: 2.4456803798675537 (2.3368771076202393) | > loss_disc_real_0: 0.20154812932014465 (0.11327717080712318) | > loss_disc_real_1: 0.2781112790107727 (0.17422498390078545) | > loss_disc_real_2: 0.26594316959381104 (0.18383996561169624) | > loss_disc_real_3: 0.6021312475204468 (0.3605772294104099) | > loss_disc_real_4: 0.2608003616333008 (0.20515043288469315) | > loss_disc_real_5: 0.10272917151451111 (0.07310030050575733) | > loss_0: 2.4456803798675537 (2.3368771076202393) | > loss_gen: 3.191554069519043 (2.5318104028701782) | > loss_kl: 4.089892387390137 (3.7632323503494263) | > loss_feat: 7.853781700134277 (9.795917987823486) | > loss_mel: 21.639591217041016 (24.999388694763184) | > loss_duration: 2.6295576095581055 (2.649492859840393) | > loss_1: 39.404380798339844 (43.739845275878906)  --> STEP: 3 | > loss_disc: 1.9977667331695557 (2.223840316136678) | > loss_disc_real_0: 0.2251356840133667 (0.15056334187587103) | > loss_disc_real_1: 0.3418566882610321 (0.23010221868753433) | > loss_disc_real_2: 0.180215522646904 (0.1826318179567655) | > loss_disc_real_3: 0.2069990634918213 (0.30938450743754703) | > loss_disc_real_4: 0.10573238879442215 (0.1720110848546028) | > loss_disc_real_5: 0.10642021894454956 (0.08420693998535474) | > loss_0: 1.9977667331695557 (2.223840316136678) | > loss_gen: 2.9468445777893066 (2.670155127843221) | > loss_kl: 1.7397762537002563 (3.088746984799703) | > loss_feat: 5.872853755950928 (8.488229910532633) | > loss_mel: 24.212566375732422 (24.737114588419598) | > loss_duration: 2.6174862384796143 (2.638823986053467) | > loss_1: 37.3895263671875 (41.6230723063151) --> EVAL PERFORMANCE | > avg_loader_time: 0.009624083836873373 (+0.0007709662119547538) | > avg_loss_disc: 2.223840316136678 (-0.14451305071512843) | > avg_loss_disc_real_0: 0.15056334187587103 (+0.03731473411122958) | > avg_loss_disc_real_1: 0.23010221868753433 (+0.018006267646948487) | > avg_loss_disc_real_2: 0.1826318179567655 (+0.03576517601807913) | > avg_loss_disc_real_3: 0.30938450743754703 (+0.05028750250736869) | > avg_loss_disc_real_4: 0.1720110848546028 (-0.09684255967537564) | > avg_loss_disc_real_5: 0.08420693998535474 (-0.06922343994180362) | > avg_loss_0: 2.223840316136678 (-0.14451305071512843) | > avg_loss_gen: 2.670155127843221 (+0.437249263127645) | > avg_loss_kl: 3.088746984799703 (-0.1463851531346636) | > avg_loss_feat: 8.488229910532633 (+0.6109852790832511) | > avg_loss_mel: 24.737114588419598 (-0.5103549957275391) | > avg_loss_duration: 2.638823986053467 (-0.023075421651204575) | > avg_loss_1: 41.6230723063151 (+0.3684221903483049)  > EPOCH: 412/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:10:56)   --> TIME: 2023-10-20 04:11:08 -- STEP: 19/50 -- GLOBAL_STEP: 73620 | > loss_disc: 2.763293981552124 (2.5678968617790625) | > loss_disc_real_0: 0.20326144993305206 (0.17591703447856402) | > loss_disc_real_1: 0.20012463629245758 (0.24439934386234535) | > loss_disc_real_2: 0.25251951813697815 (0.2688241146112743) | > loss_disc_real_3: 0.2556861937046051 (0.23934237717797882) | > loss_disc_real_4: 0.3500168025493622 (0.2617284118344909) | > loss_disc_real_5: 0.37472596764564514 (0.244850229275854) | > loss_0: 2.763293981552124 (2.5678968617790625) | > grad_norm_0: tensor(971.4969, device='cuda:0') (tensor(1099.8411, device='cuda:0')) | > loss_gen: 2.0936787128448486 (2.4113908002251074) | > loss_kl: 0.7749984264373779 (0.924166130392175) | > loss_feat: 2.332437753677368 (5.13593670490541) | > loss_mel: 21.205509185791016 (22.757567644119263) | > loss_duration: 1.6819612979888916 (1.5781603863364773) | > loss_1: 28.088586807250977 (32.80722196478593) | > grad_norm_1: tensor(4442.9624, device='cuda:0') (tensor(42686.2812, device='cuda:0')) | > current_lr_0: 0.0001324614440000338 | > current_lr_1: 0.0001324614440000338 | > step_time: 0.4066 (0.4243134448402806) | > loader_time: 0.002 (0.0109942963248805)  --> TIME: 2023-10-20 04:11:22 -- STEP: 49/50 -- GLOBAL_STEP: 73650 | > loss_disc: 2.6191484928131104 (2.5234852883280547) | > loss_disc_real_0: 0.19011013209819794 (0.16183887980878353) | > loss_disc_real_1: 0.24901865422725677 (0.22998368846518652) | > loss_disc_real_2: 0.29609280824661255 (0.24653642305306026) | > loss_disc_real_3: 0.25031062960624695 (0.24356080158328525) | > loss_disc_real_4: 0.41965770721435547 (0.22687371307033666) | > loss_disc_real_5: 0.28363484144210815 (0.21703304529038012) | > loss_0: 2.6191484928131104 (2.5234852883280547) | > grad_norm_0: tensor(1102.4108, device='cuda:0') (tensor(1019.9268, device='cuda:0')) | > loss_gen: 2.62369704246521 (2.35782820594554) | > loss_kl: 1.0708956718444824 (0.8580291525137668) | > loss_feat: 3.931689500808716 (5.212272703685626) | > loss_mel: 23.435626983642578 (21.112588449400295) | > loss_duration: 1.6228876113891602 (1.5228401325186904) | > loss_1: 32.68479919433594 (31.063558597953957) | > grad_norm_1: tensor(29560.7168, device='cuda:0') (tensor(34070.6602, device='cuda:0')) | > current_lr_0: 0.0001324614440000338 | > current_lr_1: 0.0001324614440000338 | > step_time: 1.0529 (0.43137496344897214) | > loader_time: 0.4853 (0.019953630408462212)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7191147804260254 (2.7191147804260254) | > loss_disc_real_0: 0.508576512336731 (0.508576512336731) | > loss_disc_real_1: 0.26412537693977356 (0.26412537693977356) | > loss_disc_real_2: 0.25838878750801086 (0.25838878750801086) | > loss_disc_real_3: 0.2366848737001419 (0.2366848737001419) | > loss_disc_real_4: 0.27738603949546814 (0.27738603949546814) | > loss_disc_real_5: 0.39884573221206665 (0.39884573221206665) | > loss_0: 2.7191147804260254 (2.7191147804260254) | > loss_gen: 2.731823444366455 (2.731823444366455) | > loss_kl: 2.879855155944824 (2.879855155944824) | > loss_feat: 5.219053745269775 (5.219053745269775) | > loss_mel: 24.49156951904297 (24.49156951904297) | > loss_duration: 2.49102783203125 (2.49102783203125) | > loss_1: 37.81332778930664 (37.81332778930664)  --> STEP: 1 | > loss_disc: 2.5888633728027344 (2.5888633728027344) | > loss_disc_real_0: 0.1927698403596878 (0.1927698403596878) | > loss_disc_real_1: 0.33654749393463135 (0.33654749393463135) | > loss_disc_real_2: 0.21910236775875092 (0.21910236775875092) | > loss_disc_real_3: 0.19105777144432068 (0.19105777144432068) | > loss_disc_real_4: 0.2680438756942749 (0.2680438756942749) | > loss_disc_real_5: 0.1571117341518402 (0.1571117341518402) | > loss_0: 2.5888633728027344 (2.5888633728027344) | > loss_gen: 2.073878288269043 (2.073878288269043) | > loss_kl: 3.5125763416290283 (3.5125763416290283) | > loss_feat: 7.684445381164551 (7.684445381164551) | > loss_mel: 26.74638557434082 (26.74638557434082) | > loss_duration: 2.66277813911438 (2.66277813911438) | > loss_1: 42.68006134033203 (42.68006134033203)  --> STEP: 2 | > loss_disc: 1.6153866052627563 (2.1021249890327454) | > loss_disc_real_0: 0.2669384479522705 (0.22985414415597916) | > loss_disc_real_1: 0.15998554229736328 (0.24826651811599731) | > loss_disc_real_2: 0.138829305768013 (0.17896583676338196) | > loss_disc_real_3: 0.10556534677743912 (0.1483115591108799) | > loss_disc_real_4: 0.07180366665124893 (0.16992377117276192) | > loss_disc_real_5: 0.19192452728748322 (0.1745181307196617) | > loss_0: 1.6153866052627563 (2.1021249890327454) | > loss_gen: 3.1976513862609863 (2.6357648372650146) | > loss_kl: 3.968186855316162 (3.740381598472595) | > loss_feat: 11.090630531311035 (9.387537956237793) | > loss_mel: 24.133953094482422 (25.44016933441162) | > loss_duration: 2.6528255939483643 (2.657801866531372) | > loss_1: 45.04324722290039 (43.86165428161621)  --> STEP: 3 | > loss_disc: 3.1768407821655273 (2.460363586743673) | > loss_disc_real_0: 0.37827759981155396 (0.2793286293745041) | > loss_disc_real_1: 0.39696618914604187 (0.29783307512601215) | > loss_disc_real_2: 0.3754972815513611 (0.244476318359375) | > loss_disc_real_3: 0.2555277645587921 (0.18405029426018396) | > loss_disc_real_4: 0.4625331461429596 (0.26746022949616116) | > loss_disc_real_5: 0.46384337544441223 (0.27095987896124524) | > loss_0: 3.1768407821655273 (2.460363586743673) | > loss_gen: 2.6953272819519043 (2.655618985493978) | > loss_kl: 1.5364183187484741 (3.005727171897888) | > loss_feat: 3.4486944675445557 (7.407923460006714) | > loss_mel: 24.602493286132812 (25.16094398498535) | > loss_duration: 2.5156614780426025 (2.6104217370351157) | > loss_1: 34.7985954284668 (40.84063466389974) --> EVAL PERFORMANCE | > avg_loader_time: 0.01021575927734375 (+0.000591675440470377) | > avg_loss_disc: 2.460363586743673 (+0.23652327060699463) | > avg_loss_disc_real_0: 0.2793286293745041 (+0.12876528749863306) | > avg_loss_disc_real_1: 0.29783307512601215 (+0.06773085643847782) | > avg_loss_disc_real_2: 0.244476318359375 (+0.0618445004026095) | > avg_loss_disc_real_3: 0.18405029426018396 (-0.12533421317736307) | > avg_loss_disc_real_4: 0.26746022949616116 (+0.09544914464155835) | > avg_loss_disc_real_5: 0.27095987896124524 (+0.18675293897589051) | > avg_loss_0: 2.460363586743673 (+0.23652327060699463) | > avg_loss_gen: 2.655618985493978 (-0.014536142349243164) | > avg_loss_kl: 3.005727171897888 (-0.08301981290181493) | > avg_loss_feat: 7.407923460006714 (-1.080306450525919) | > avg_loss_mel: 25.16094398498535 (+0.423829396565754) | > avg_loss_duration: 2.6104217370351157 (-0.02840224901835109) | > avg_loss_1: 40.84063466389974 (-0.7824376424153598)  > EPOCH: 413/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:11:33)   --> TIME: 2023-10-20 04:11:52 -- STEP: 29/50 -- GLOBAL_STEP: 73680 | > loss_disc: 1.6691319942474365 (2.3211655863400154) | > loss_disc_real_0: 0.17484250664710999 (0.1750546011046089) | > loss_disc_real_1: 0.34489136934280396 (0.19817228422596536) | > loss_disc_real_2: 0.1108100563287735 (0.20765093123090678) | > loss_disc_real_3: 0.18566015362739563 (0.21134296188066745) | > loss_disc_real_4: 0.053539201617240906 (0.22672546333793936) | > loss_disc_real_5: 0.06395602226257324 (0.2198893023847506) | > loss_0: 1.6691319942474365 (2.3211655863400154) | > grad_norm_0: tensor(712.8064, device='cuda:0') (tensor(1240.3395, device='cuda:0')) | > loss_gen: 3.470618724822998 (2.448208977436197) | > loss_kl: 0.8568719625473022 (0.8730022167337352) | > loss_feat: 9.798863410949707 (5.936138634794745) | > loss_mel: 24.10149383544922 (23.447970160122576) | > loss_duration: 1.4874372482299805 (1.540387827774574) | > loss_1: 39.71528625488281 (34.245707873640384) | > grad_norm_1: tensor(28291.3281, device='cuda:0') (tensor(41950.6602, device='cuda:0')) | > current_lr_0: 0.00013232904049342978 | > current_lr_1: 0.00013232904049342978 | > step_time: 0.6598 (0.48650127443773994) | > loader_time: 0.0133 (0.017126321792602532)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.648728609085083 (2.648728609085083) | > loss_disc_real_0: 0.14056241512298584 (0.14056241512298584) | > loss_disc_real_1: 0.17136342823505402 (0.17136342823505402) | > loss_disc_real_2: 0.2407917082309723 (0.2407917082309723) | > loss_disc_real_3: 0.2651585042476654 (0.2651585042476654) | > loss_disc_real_4: 0.34389418363571167 (0.34389418363571167) | > loss_disc_real_5: 0.4208311438560486 (0.4208311438560486) | > loss_0: 2.648728609085083 (2.648728609085083) | > loss_gen: 2.2767703533172607 (2.2767703533172607) | > loss_kl: 3.018200635910034 (3.018200635910034) | > loss_feat: 5.421891212463379 (5.421891212463379) | > loss_mel: 23.09550666809082 (23.09550666809082) | > loss_duration: 2.5401108264923096 (2.5401108264923096) | > loss_1: 36.352481842041016 (36.352481842041016)  --> STEP: 1 | > loss_disc: 2.7688755989074707 (2.7688755989074707) | > loss_disc_real_0: 0.2590414881706238 (0.2590414881706238) | > loss_disc_real_1: 0.2686547338962555 (0.2686547338962555) | > loss_disc_real_2: 0.18088778853416443 (0.18088778853416443) | > loss_disc_real_3: 0.2782832682132721 (0.2782832682132721) | > loss_disc_real_4: 0.23840634524822235 (0.23840634524822235) | > loss_disc_real_5: 0.2519354224205017 (0.2519354224205017) | > loss_0: 2.7688755989074707 (2.7688755989074707) | > loss_gen: 2.072075366973877 (2.072075366973877) | > loss_kl: 3.742549419403076 (3.742549419403076) | > loss_feat: 5.925890922546387 (5.925890922546387) | > loss_mel: 24.546188354492188 (24.546188354492188) | > loss_duration: 2.9099819660186768 (2.9099819660186768) | > loss_1: 39.196685791015625 (39.196685791015625)  --> STEP: 2 | > loss_disc: 2.2089614868164062 (2.4889185428619385) | > loss_disc_real_0: 0.25107771158218384 (0.2550595998764038) | > loss_disc_real_1: 0.26493388414382935 (0.2667943090200424) | > loss_disc_real_2: 0.11490126699209213 (0.14789452776312828) | > loss_disc_real_3: 0.3051109313964844 (0.29169709980487823) | > loss_disc_real_4: 0.140391543507576 (0.18939894437789917) | > loss_disc_real_5: 0.267162948846817 (0.25954918563365936) | > loss_0: 2.2089614868164062 (2.4889185428619385) | > loss_gen: 2.7304632663726807 (2.401269316673279) | > loss_kl: 3.803318977355957 (3.7729341983795166) | > loss_feat: 9.46325969696045 (7.694575309753418) | > loss_mel: 23.465721130371094 (24.00595474243164) | > loss_duration: 2.73764705657959 (2.8238145112991333) | > loss_1: 42.20041275024414 (40.69854927062988)  --> STEP: 3 | > loss_disc: 2.8519155979156494 (2.6099175612131753) | > loss_disc_real_0: 0.12104406952857971 (0.21038775642712912) | > loss_disc_real_1: 0.35051339864730835 (0.29470067222913104) | > loss_disc_real_2: 0.2896007001399994 (0.19512991855541864) | > loss_disc_real_3: 0.32794666290283203 (0.30378028750419617) | > loss_disc_real_4: 0.27509838342666626 (0.21796542406082153) | > loss_disc_real_5: 0.23216675221920013 (0.2504217078288396) | > loss_0: 2.8519155979156494 (2.6099175612131753) | > loss_gen: 1.8075166940689087 (2.2033517758051553) | > loss_kl: 1.792704463005066 (3.1128576199213662) | > loss_feat: 0.6298168301582336 (5.339655816555023) | > loss_mel: 17.172718048095703 (21.728209177652996) | > loss_duration: 2.5844886302948 (2.744039217631022) | > loss_1: 23.98724365234375 (35.12811406453451) --> EVAL PERFORMANCE | > avg_loader_time: 0.010660171508789062 (+0.0004444122314453125) | > avg_loss_disc: 2.6099175612131753 (+0.14955397446950247) | > avg_loss_disc_real_0: 0.21038775642712912 (-0.06894087294737497) | > avg_loss_disc_real_1: 0.29470067222913104 (-0.0031324028968811035) | > avg_loss_disc_real_2: 0.19512991855541864 (-0.04934639980395636) | > avg_loss_disc_real_3: 0.30378028750419617 (+0.1197299932440122) | > avg_loss_disc_real_4: 0.21796542406082153 (-0.04949480543533963) | > avg_loss_disc_real_5: 0.2504217078288396 (-0.020538171132405636) | > avg_loss_0: 2.6099175612131753 (+0.14955397446950247) | > avg_loss_gen: 2.2033517758051553 (-0.4522672096888227) | > avg_loss_kl: 3.1128576199213662 (+0.10713044802347804) | > avg_loss_feat: 5.339655816555023 (-2.0682676434516907) | > avg_loss_mel: 21.728209177652996 (-3.4327348073323556) | > avg_loss_duration: 2.744039217631022 (+0.13361748059590628) | > avg_loss_1: 35.12811406453451 (-5.712520599365234)  > EPOCH: 414/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:12:14)   --> TIME: 2023-10-20 04:12:23 -- STEP: 9/50 -- GLOBAL_STEP: 73710 | > loss_disc: 2.5917065143585205 (2.482925772666931) | > loss_disc_real_0: 0.1569136530160904 (0.15244494295782512) | > loss_disc_real_1: 0.4046960771083832 (0.26159176147646374) | > loss_disc_real_2: 0.18392369151115417 (0.252679906371567) | > loss_disc_real_3: 0.29352235794067383 (0.2300595123734739) | > loss_disc_real_4: 0.08250909298658371 (0.1876031392150455) | > loss_disc_real_5: 0.1190037950873375 (0.17547200972007382) | > loss_0: 2.5917065143585205 (2.482925772666931) | > grad_norm_0: tensor(1432.2296, device='cuda:0') (tensor(1674.0973, device='cuda:0')) | > loss_gen: 1.7853119373321533 (2.2455643680360584) | > loss_kl: 0.6575168967247009 (0.920439706908332) | > loss_feat: 2.487283706665039 (5.111533953083886) | > loss_mel: 25.88351058959961 (22.986824989318848) | > loss_duration: 1.5295965671539307 (1.5104752381642659) | > loss_1: 32.34321975708008 (32.77483791775174) | > grad_norm_1: tensor(18795.9043, device='cuda:0') (tensor(49705.5547, device='cuda:0')) | > current_lr_0: 0.00013219676933242026 | > current_lr_1: 0.00013219676933242026 | > step_time: 1.1637 (0.5199355549282498) | > loader_time: 0.0236 (0.011047919591267904)  --> TIME: 2023-10-20 04:12:38 -- STEP: 39/50 -- GLOBAL_STEP: 73740 | > loss_disc: 2.906360626220703 (2.536544362703959) | > loss_disc_real_0: 0.23713825643062592 (0.1536926026814259) | > loss_disc_real_1: 0.2851962149143219 (0.24034840498979276) | > loss_disc_real_2: 0.3154372274875641 (0.21583974905885184) | > loss_disc_real_3: 0.35654035210609436 (0.2373120884100596) | > loss_disc_real_4: 0.19575931131839752 (0.24636968721946081) | > loss_disc_real_5: 0.1654430478811264 (0.24712132065533063) | > loss_0: 2.906360626220703 (2.536544362703959) | > grad_norm_0: tensor(714.3819, device='cuda:0') (tensor(1352.0049, device='cuda:0')) | > loss_gen: 1.7420681715011597 (2.2774755343412747) | > loss_kl: 0.6049257516860962 (0.9013169713509388) | > loss_feat: 1.2701719999313354 (5.194939178343002) | > loss_mel: 20.048845291137695 (21.91584561421321) | > loss_duration: 1.582343339920044 (1.5131502334888165) | > loss_1: 25.248353958129883 (31.802727185762844) | > grad_norm_1: tensor(17979.6699, device='cuda:0') (tensor(45775.4062, device='cuda:0')) | > current_lr_0: 0.00013219676933242026 | > current_lr_1: 0.00013219676933242026 | > step_time: 0.5591 (0.47442376919281787) | > loader_time: 0.0243 (0.01569356673803085)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6723439693450928 (2.6723439693450928) | > loss_disc_real_0: 0.12073361873626709 (0.12073361873626709) | > loss_disc_real_1: 0.2539481520652771 (0.2539481520652771) | > loss_disc_real_2: 0.3702988028526306 (0.3702988028526306) | > loss_disc_real_3: 0.2753632366657257 (0.2753632366657257) | > loss_disc_real_4: 0.3009927570819855 (0.3009927570819855) | > loss_disc_real_5: 0.32392778992652893 (0.32392778992652893) | > loss_0: 2.6723439693450928 (2.6723439693450928) | > loss_gen: 2.3723044395446777 (2.3723044395446777) | > loss_kl: 3.289210557937622 (3.289210557937622) | > loss_feat: 5.3415703773498535 (5.3415703773498535) | > loss_mel: 22.376134872436523 (22.376134872436523) | > loss_duration: 2.462024211883545 (2.462024211883545) | > loss_1: 35.841243743896484 (35.841243743896484)  --> STEP: 1 | > loss_disc: 2.106271982192993 (2.106271982192993) | > loss_disc_real_0: 0.1561441868543625 (0.1561441868543625) | > loss_disc_real_1: 0.18684223294258118 (0.18684223294258118) | > loss_disc_real_2: 0.23211292922496796 (0.23211292922496796) | > loss_disc_real_3: 0.16650733351707458 (0.16650733351707458) | > loss_disc_real_4: 0.20850370824337006 (0.20850370824337006) | > loss_disc_real_5: 0.21400858461856842 (0.21400858461856842) | > loss_0: 2.106271982192993 (2.106271982192993) | > loss_gen: 2.8244011402130127 (2.8244011402130127) | > loss_kl: 3.4947004318237305 (3.4947004318237305) | > loss_feat: 8.635924339294434 (8.635924339294434) | > loss_mel: 27.70106315612793 (27.70106315612793) | > loss_duration: 2.7397239208221436 (2.7397239208221436) | > loss_1: 45.39581298828125 (45.39581298828125)  --> STEP: 2 | > loss_disc: 2.893916606903076 (2.5000942945480347) | > loss_disc_real_0: 0.21934768557548523 (0.18774593621492386) | > loss_disc_real_1: 0.28466305136680603 (0.2357526421546936) | > loss_disc_real_2: 0.12306385487318039 (0.17758839204907417) | > loss_disc_real_3: 0.2480747103691101 (0.20729102194309235) | > loss_disc_real_4: 0.23555220663547516 (0.2220279574394226) | > loss_disc_real_5: 0.41717764735221863 (0.3155931159853935) | > loss_0: 2.893916606903076 (2.5000942945480347) | > loss_gen: 1.9295289516448975 (2.376965045928955) | > loss_kl: 4.4125189781188965 (3.9536097049713135) | > loss_feat: 6.24786376953125 (7.441894054412842) | > loss_mel: 27.479637145996094 (27.59035015106201) | > loss_duration: 2.704589605331421 (2.7221567630767822) | > loss_1: 42.774139404296875 (44.08497619628906)  --> STEP: 3 | > loss_disc: 2.6471872329711914 (2.5491252740224204) | > loss_disc_real_0: 0.16116830706596375 (0.17888672649860382) | > loss_disc_real_1: 0.24272014200687408 (0.23807514210542044) | > loss_disc_real_2: 0.21647723019123077 (0.19055133809645972) | > loss_disc_real_3: 0.3359837234020233 (0.25018858909606934) | > loss_disc_real_4: 0.5315676927566528 (0.3252078692118327) | > loss_disc_real_5: 0.32266873121261597 (0.31795165439446765) | > loss_0: 2.6471872329711914 (2.5491252740224204) | > loss_gen: 2.552008628845215 (2.4353129069010415) | > loss_kl: 1.8989187479019165 (3.2687127192815146) | > loss_feat: 4.2412109375 (6.3749996821085615) | > loss_mel: 24.449756622314453 (26.543485641479492) | > loss_duration: 2.6534712314605713 (2.6992615858713784) | > loss_1: 35.79536819458008 (41.321773529052734) --> EVAL PERFORMANCE | > avg_loader_time: 0.012270847956339518 (+0.0016106764475504552) | > avg_loss_disc: 2.5491252740224204 (-0.06079228719075491) | > avg_loss_disc_real_0: 0.17888672649860382 (-0.0315010299285253) | > avg_loss_disc_real_1: 0.23807514210542044 (-0.056625530123710605) | > avg_loss_disc_real_2: 0.19055133809645972 (-0.004578580458958925) | > avg_loss_disc_real_3: 0.25018858909606934 (-0.05359169840812683) | > avg_loss_disc_real_4: 0.3252078692118327 (+0.10724244515101117) | > avg_loss_disc_real_5: 0.31795165439446765 (+0.06752994656562805) | > avg_loss_0: 2.5491252740224204 (-0.06079228719075491) | > avg_loss_gen: 2.4353129069010415 (+0.23196113109588623) | > avg_loss_kl: 3.2687127192815146 (+0.1558550993601484) | > avg_loss_feat: 6.3749996821085615 (+1.0353438655535383) | > avg_loss_mel: 26.543485641479492 (+4.815276463826496) | > avg_loss_duration: 2.6992615858713784 (-0.044777631759643555) | > avg_loss_1: 41.321773529052734 (+6.193659464518227)  > EPOCH: 415/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:12:55)   --> TIME: 2023-10-20 04:13:08 -- STEP: 19/50 -- GLOBAL_STEP: 73770 | > loss_disc: 2.163456678390503 (2.4335180521011353) | > loss_disc_real_0: 0.24536679685115814 (0.18485389885149503) | > loss_disc_real_1: 0.14260739088058472 (0.2224611713501968) | > loss_disc_real_2: 0.20130424201488495 (0.2571740017125481) | > loss_disc_real_3: 0.21855758130550385 (0.24314929642959646) | > loss_disc_real_4: 0.21030445396900177 (0.23764218566449066) | > loss_disc_real_5: 0.20029696822166443 (0.25320008529448196) | > loss_0: 2.163456678390503 (2.4335180521011353) | > grad_norm_0: tensor(1643.7323, device='cuda:0') (tensor(1133.9706, device='cuda:0')) | > loss_gen: 2.9710049629211426 (2.5735145744524504) | > loss_kl: 0.8154129981994629 (0.8664238627411818) | > loss_feat: 8.741353034973145 (6.247971971568308) | > loss_mel: 28.0430965423584 (25.0834366585079) | > loss_duration: 1.6855530738830566 (1.5574481299048977) | > loss_1: 42.25642013549805 (36.32879568401136) | > grad_norm_1: tensor(102774.3594, device='cuda:0') (tensor(55690.1641, device='cuda:0')) | > current_lr_0: 0.0001320646303847176 | > current_lr_1: 0.0001320646303847176 | > step_time: 0.3816 (0.46452642741956207) | > loader_time: 0.002 (0.010799922441181383)  --> TIME: 2023-10-20 04:13:23 -- STEP: 49/50 -- GLOBAL_STEP: 73800 | > loss_disc: 2.4514992237091064 (2.5518115029043082) | > loss_disc_real_0: 0.1352716088294983 (0.17463653910981153) | > loss_disc_real_1: 0.21057286858558655 (0.231689116442386) | > loss_disc_real_2: 0.16761159896850586 (0.23769290121842404) | > loss_disc_real_3: 0.25221988558769226 (0.2456784721996103) | > loss_disc_real_4: 0.2731216549873352 (0.24646709676907988) | > loss_disc_real_5: 0.2619463801383972 (0.23626653019490898) | > loss_0: 2.4514992237091064 (2.5518115029043082) | > grad_norm_0: tensor(1442.3834, device='cuda:0') (tensor(1273.3344, device='cuda:0')) | > loss_gen: 2.0230700969696045 (2.291354953026285) | > loss_kl: 0.5927530527114868 (0.8360486484455819) | > loss_feat: 1.9372352361679077 (4.9262169816968395) | > loss_mel: 21.644550323486328 (22.03874584120147) | > loss_duration: 1.6324044466018677 (1.5144612375570805) | > loss_1: 27.83001136779785 (31.606827842945954) | > grad_norm_1: tensor(12272.7676, device='cuda:0') (tensor(45079.5195, device='cuda:0')) | > current_lr_0: 0.0001320646303847176 | > current_lr_1: 0.0001320646303847176 | > step_time: 1.1741 (0.45673180599601904) | > loader_time: 0.9001 (0.02747542517525809)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3652217388153076 (2.3652217388153076) | > loss_disc_real_0: 0.05658883601427078 (0.05658883601427078) | > loss_disc_real_1: 0.15150578320026398 (0.15150578320026398) | > loss_disc_real_2: 0.23205725848674774 (0.23205725848674774) | > loss_disc_real_3: 0.2347012162208557 (0.2347012162208557) | > loss_disc_real_4: 0.276001513004303 (0.276001513004303) | > loss_disc_real_5: 0.3860141932964325 (0.3860141932964325) | > loss_0: 2.3652217388153076 (2.3652217388153076) | > loss_gen: 2.3299989700317383 (2.3299989700317383) | > loss_kl: 2.9633028507232666 (2.9633028507232666) | > loss_feat: 5.198345184326172 (5.198345184326172) | > loss_mel: 23.978425979614258 (23.978425979614258) | > loss_duration: 2.489053964614868 (2.489053964614868) | > loss_1: 36.959129333496094 (36.959129333496094)  --> STEP: 1 | > loss_disc: 2.4644827842712402 (2.4644827842712402) | > loss_disc_real_0: 0.13893866539001465 (0.13893866539001465) | > loss_disc_real_1: 0.23607397079467773 (0.23607397079467773) | > loss_disc_real_2: 0.3618064820766449 (0.3618064820766449) | > loss_disc_real_3: 0.2698511779308319 (0.2698511779308319) | > loss_disc_real_4: 0.07038230448961258 (0.07038230448961258) | > loss_disc_real_5: 0.07111096382141113 (0.07111096382141113) | > loss_0: 2.4644827842712402 (2.4644827842712402) | > loss_gen: 1.807761788368225 (1.807761788368225) | > loss_kl: 3.5106866359710693 (3.5106866359710693) | > loss_feat: 6.2329535484313965 (6.2329535484313965) | > loss_mel: 26.883731842041016 (26.883731842041016) | > loss_duration: 2.636380910873413 (2.636380910873413) | > loss_1: 41.07151412963867 (41.07151412963867)  --> STEP: 2 | > loss_disc: 2.2815475463867188 (2.3730151653289795) | > loss_disc_real_0: 0.03877344727516174 (0.0888560563325882) | > loss_disc_real_1: 0.1018458753824234 (0.16895992308855057) | > loss_disc_real_2: 0.2857494056224823 (0.3237779438495636) | > loss_disc_real_3: 0.14737018942832947 (0.2086106836795807) | > loss_disc_real_4: 0.027946442365646362 (0.04916437342762947) | > loss_disc_real_5: 0.08059960603713989 (0.07585528492927551) | > loss_0: 2.2815475463867188 (2.3730151653289795) | > loss_gen: 1.6628193855285645 (1.7352905869483948) | > loss_kl: 4.209473133087158 (3.8600798845291138) | > loss_feat: 9.237106323242188 (7.735029935836792) | > loss_mel: 25.686729431152344 (26.28523063659668) | > loss_duration: 2.7694709300994873 (2.70292592048645) | > loss_1: 43.56559753417969 (42.31855583190918)  --> STEP: 3 | > loss_disc: 2.9669365882873535 (2.570988972981771) | > loss_disc_real_0: 0.19508841633796692 (0.12426684300104777) | > loss_disc_real_1: 0.3077409863471985 (0.21522027750809988) | > loss_disc_real_2: 0.2843993008136749 (0.3106517295042674) | > loss_disc_real_3: 0.2836063802242279 (0.2336092491944631) | > loss_disc_real_4: 0.26514625549316406 (0.121158334116141) | > loss_disc_real_5: 0.2793467938899994 (0.14368578791618347) | > loss_0: 2.9669365882873535 (2.570988972981771) | > loss_gen: 1.6903473138809204 (1.7203094959259033) | > loss_kl: 1.4351496696472168 (3.051769812901815) | > loss_feat: 0.27206820249557495 (5.247376024723053) | > loss_mel: 5.615108966827393 (19.395190080006916) | > loss_duration: 2.583172559738159 (2.663008133570353) | > loss_1: 11.595847129821777 (32.07765293121338) --> EVAL PERFORMANCE | > avg_loader_time: 0.002846399943033854 (-0.009424448013305664) | > avg_loss_disc: 2.570988972981771 (+0.021863698959350586) | > avg_loss_disc_real_0: 0.12426684300104777 (-0.054619883497556046) | > avg_loss_disc_real_1: 0.21522027750809988 (-0.022854864597320557) | > avg_loss_disc_real_2: 0.3106517295042674 (+0.12010039140780768) | > avg_loss_disc_real_3: 0.2336092491944631 (-0.016579339901606233) | > avg_loss_disc_real_4: 0.121158334116141 (-0.20404953509569168) | > avg_loss_disc_real_5: 0.14368578791618347 (-0.17426586647828418) | > avg_loss_0: 2.570988972981771 (+0.021863698959350586) | > avg_loss_gen: 1.7203094959259033 (-0.7150034109751382) | > avg_loss_kl: 3.051769812901815 (-0.2169429063796997) | > avg_loss_feat: 5.247376024723053 (-1.1276236573855085) | > avg_loss_mel: 19.395190080006916 (-7.148295561472576) | > avg_loss_duration: 2.663008133570353 (-0.03625345230102539) | > avg_loss_1: 32.07765293121338 (-9.244120597839355)  > EPOCH: 416/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:13:33)   --> TIME: 2023-10-20 04:13:52 -- STEP: 29/50 -- GLOBAL_STEP: 73830 | > loss_disc: 1.517600655555725 (2.4928897043754317) | > loss_disc_real_0: 0.05130970478057861 (0.1595480401582759) | > loss_disc_real_1: 0.1175273209810257 (0.22326017723515115) | > loss_disc_real_2: 0.06242751702666283 (0.2295238983271451) | > loss_disc_real_3: 0.24877603352069855 (0.22060936252618657) | > loss_disc_real_4: 0.06604484468698502 (0.22443037158970175) | > loss_disc_real_5: 0.17323410511016846 (0.22519041193199568) | > loss_0: 1.517600655555725 (2.4928897043754317) | > grad_norm_0: tensor(743.5813, device='cuda:0') (tensor(1225.5522, device='cuda:0')) | > loss_gen: 3.255633592605591 (2.275565040522608) | > loss_kl: 1.179401159286499 (0.9199886959174584) | > loss_feat: 9.005205154418945 (5.108976739426625) | > loss_mel: 21.8684024810791 (21.485410595762318) | > loss_duration: 1.525112271308899 (1.5502811999156558) | > loss_1: 36.83375549316406 (31.34022227649031) | > grad_norm_1: tensor(51691.0234, device='cuda:0') (tensor(52707.5664, device='cuda:0')) | > current_lr_0: 0.00013193262351816635 | > current_lr_1: 0.00013193262351816635 | > step_time: 0.5633 (0.4939063910780282) | > loader_time: 0.0127 (0.01912366932836073)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.327664613723755 (2.327664613723755) | > loss_disc_real_0: 0.2039192020893097 (0.2039192020893097) | > loss_disc_real_1: 0.20944973826408386 (0.20944973826408386) | > loss_disc_real_2: 0.3620673418045044 (0.3620673418045044) | > loss_disc_real_3: 0.2651788890361786 (0.2651788890361786) | > loss_disc_real_4: 0.2881074845790863 (0.2881074845790863) | > loss_disc_real_5: 0.2256704717874527 (0.2256704717874527) | > loss_0: 2.327664613723755 (2.327664613723755) | > loss_gen: 3.4230315685272217 (3.4230315685272217) | > loss_kl: 3.1731250286102295 (3.1731250286102295) | > loss_feat: 7.5415873527526855 (7.5415873527526855) | > loss_mel: 24.452434539794922 (24.452434539794922) | > loss_duration: 2.5350828170776367 (2.5350828170776367) | > loss_1: 41.12525939941406 (41.12525939941406)  --> STEP: 1 | > loss_disc: 1.654798150062561 (1.654798150062561) | > loss_disc_real_0: 0.04262624680995941 (0.04262624680995941) | > loss_disc_real_1: 0.2100963145494461 (0.2100963145494461) | > loss_disc_real_2: 0.1849474459886551 (0.1849474459886551) | > loss_disc_real_3: 0.23598133027553558 (0.23598133027553558) | > loss_disc_real_4: 0.09132823348045349 (0.09132823348045349) | > loss_disc_real_5: 0.15924128890037537 (0.15924128890037537) | > loss_0: 1.654798150062561 (1.654798150062561) | > loss_gen: 3.6435816287994385 (3.6435816287994385) | > loss_kl: 3.6253600120544434 (3.6253600120544434) | > loss_feat: 10.397379875183105 (10.397379875183105) | > loss_mel: 25.2360897064209 (25.2360897064209) | > loss_duration: 2.7853891849517822 (2.7853891849517822) | > loss_1: 45.68779754638672 (45.68779754638672)  --> STEP: 2 | > loss_disc: 2.6360490322113037 (2.1454235911369324) | > loss_disc_real_0: 0.325130820274353 (0.18387853354215622) | > loss_disc_real_1: 0.28064605593681335 (0.24537118524312973) | > loss_disc_real_2: 0.38766226172447205 (0.28630485385656357) | > loss_disc_real_3: 0.201271653175354 (0.2186264917254448) | > loss_disc_real_4: 0.11365769058465958 (0.10249296203255653) | > loss_disc_real_5: 0.17010192573070526 (0.1646716073155403) | > loss_0: 2.6360490322113037 (2.1454235911369324) | > loss_gen: 2.4827170372009277 (3.063149333000183) | > loss_kl: 3.642514705657959 (3.633937358856201) | > loss_feat: 7.342075824737549 (8.869727849960327) | > loss_mel: 27.18498992919922 (26.21053981781006) | > loss_duration: 2.7886412143707275 (2.787015199661255) | > loss_1: 43.44093704223633 (44.56436729431152)  --> STEP: 3 | > loss_disc: 3.1137771606445312 (2.468208114306132) | > loss_disc_real_0: 0.8329653739929199 (0.40024081369241077) | > loss_disc_real_1: 0.2673664093017578 (0.25270292659600574) | > loss_disc_real_2: 0.23214389383792877 (0.2682512005170186) | > loss_disc_real_3: 0.351283997297287 (0.2628456602493922) | > loss_disc_real_4: 0.2523214817047119 (0.152435801923275) | > loss_disc_real_5: 0.23492074012756348 (0.18808798491954803) | > loss_0: 3.1137771606445312 (2.468208114306132) | > loss_gen: 2.822115659713745 (2.982804775238037) | > loss_kl: 1.7810695171356201 (3.016314744949341) | > loss_feat: 2.2868549823760986 (6.675436894098918) | > loss_mel: 22.3531436920166 (24.92474110921224) | > loss_duration: 2.6078317165374756 (2.7272873719533286) | > loss_1: 31.851015090942383 (40.32658322652181) --> EVAL PERFORMANCE | > avg_loader_time: 0.024737119674682617 (+0.021890719731648762) | > avg_loss_disc: 2.468208114306132 (-0.10278085867563913) | > avg_loss_disc_real_0: 0.40024081369241077 (+0.275973970691363) | > avg_loss_disc_real_1: 0.25270292659600574 (+0.037482649087905856) | > avg_loss_disc_real_2: 0.2682512005170186 (-0.042400528987248776) | > avg_loss_disc_real_3: 0.2628456602493922 (+0.029236411054929107) | > avg_loss_disc_real_4: 0.152435801923275 (+0.03127746780713399) | > avg_loss_disc_real_5: 0.18808798491954803 (+0.04440219700336456) | > avg_loss_0: 2.468208114306132 (-0.10278085867563913) | > avg_loss_gen: 2.982804775238037 (+1.2624952793121338) | > avg_loss_kl: 3.016314744949341 (-0.035455067952474106) | > avg_loss_feat: 6.675436894098918 (+1.428060869375865) | > avg_loss_mel: 24.92474110921224 (+5.529551029205322) | > avg_loss_duration: 2.7272873719533286 (+0.06427923838297556) | > avg_loss_1: 40.32658322652181 (+8.248930295308433)  > EPOCH: 417/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:14:14)   --> TIME: 2023-10-20 04:14:22 -- STEP: 9/50 -- GLOBAL_STEP: 73860 | > loss_disc: 3.0442745685577393 (2.678097751405504) | > loss_disc_real_0: 0.24878263473510742 (0.16876966092321607) | > loss_disc_real_1: 0.32393866777420044 (0.23992822070916495) | > loss_disc_real_2: 0.3293618857860565 (0.28240404195255703) | > loss_disc_real_3: 0.33330824971199036 (0.26221395366721684) | > loss_disc_real_4: 0.3413735330104828 (0.224505508525504) | > loss_disc_real_5: 0.47463780641555786 (0.25735195519195664) | > loss_0: 3.0442745685577393 (2.678097751405504) | > grad_norm_0: tensor(675.7604, device='cuda:0') (tensor(1785.6696, device='cuda:0')) | > loss_gen: 2.354412794113159 (2.2849750916163125) | > loss_kl: 0.9136860966682434 (1.0405111842685275) | > loss_feat: 3.8424394130706787 (5.588592840565576) | > loss_mel: 22.886747360229492 (22.176639821794296) | > loss_duration: 1.5328888893127441 (1.5652323961257935) | > loss_1: 31.53017234802246 (32.65595128801134) | > grad_norm_1: tensor(13944.0068, device='cuda:0') (tensor(56428.3867, device='cuda:0')) | > current_lr_0: 0.00013180074860074309 | > current_lr_1: 0.00013180074860074309 | > step_time: 0.3587 (0.4000320964389377) | > loader_time: 0.0109 (0.010900311999850802)  --> TIME: 2023-10-20 04:14:40 -- STEP: 39/50 -- GLOBAL_STEP: 73890 | > loss_disc: 2.9372634887695312 (2.5447036241873713) | > loss_disc_real_0: 0.20306478440761566 (0.1781633873589528) | > loss_disc_real_1: 0.31988033652305603 (0.22679166476695967) | > loss_disc_real_2: 0.29156631231307983 (0.23665843980434603) | > loss_disc_real_3: 0.31643378734588623 (0.23720988688560632) | > loss_disc_real_4: 0.28163111209869385 (0.2168260148893564) | > loss_disc_real_5: 0.3102818429470062 (0.22027693340220514) | > loss_0: 2.9372634887695312 (2.5447036241873713) | > grad_norm_0: tensor(1098.9558, device='cuda:0') (tensor(1378.0367, device='cuda:0')) | > loss_gen: 1.8880141973495483 (2.178700578518403) | > loss_kl: 0.512265682220459 (0.8734131165039845) | > loss_feat: 1.0069841146469116 (4.583384537567887) | > loss_mel: 17.5413818359375 (20.559857727625435) | > loss_duration: 1.586173415184021 (1.5392019106791568) | > loss_1: 22.534818649291992 (29.734557958749626) | > grad_norm_1: tensor(17056.2695, device='cuda:0') (tensor(43981.0898, device='cuda:0')) | > current_lr_0: 0.00013180074860074309 | > current_lr_1: 0.00013180074860074309 | > step_time: 0.5772 (0.5267773285890238) | > loader_time: 0.0251 (0.015653451283772785)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.492845058441162 (2.492845058441162) | > loss_disc_real_0: 0.15468765795230865 (0.15468765795230865) | > loss_disc_real_1: 0.2056618630886078 (0.2056618630886078) | > loss_disc_real_2: 0.25655612349510193 (0.25655612349510193) | > loss_disc_real_3: 0.32728084921836853 (0.32728084921836853) | > loss_disc_real_4: 0.3957087993621826 (0.3957087993621826) | > loss_disc_real_5: 0.37113264203071594 (0.37113264203071594) | > loss_0: 2.492845058441162 (2.492845058441162) | > loss_gen: 2.849613666534424 (2.849613666534424) | > loss_kl: 2.7815277576446533 (2.7815277576446533) | > loss_feat: 5.109580993652344 (5.109580993652344) | > loss_mel: 21.896442413330078 (21.896442413330078) | > loss_duration: 2.4615771770477295 (2.4615771770477295) | > loss_1: 35.0987434387207 (35.0987434387207)  --> STEP: 1 | > loss_disc: 3.300074577331543 (3.300074577331543) | > loss_disc_real_0: 0.1676625907421112 (0.1676625907421112) | > loss_disc_real_1: 0.23530170321464539 (0.23530170321464539) | > loss_disc_real_2: 0.29094672203063965 (0.29094672203063965) | > loss_disc_real_3: 0.3329998552799225 (0.3329998552799225) | > loss_disc_real_4: 0.29091790318489075 (0.29091790318489075) | > loss_disc_real_5: 0.27760976552963257 (0.27760976552963257) | > loss_0: 3.300074577331543 (3.300074577331543) | > loss_gen: 1.5405919551849365 (1.5405919551849365) | > loss_kl: 3.610189914703369 (3.610189914703369) | > loss_feat: 3.016974449157715 (3.016974449157715) | > loss_mel: 24.236663818359375 (24.236663818359375) | > loss_duration: 2.7033329010009766 (2.7033329010009766) | > loss_1: 35.107749938964844 (35.107749938964844)  --> STEP: 2 | > loss_disc: 3.052950620651245 (3.176512598991394) | > loss_disc_real_0: 0.2334725707769394 (0.2005675807595253) | > loss_disc_real_1: 0.22370171546936035 (0.22950170934200287) | > loss_disc_real_2: 0.21152250468730927 (0.25123461335897446) | > loss_disc_real_3: 0.32874396443367004 (0.33087190985679626) | > loss_disc_real_4: 0.22797873616218567 (0.2594483196735382) | > loss_disc_real_5: 0.1693670004606247 (0.22348838299512863) | > loss_0: 3.052950620651245 (3.176512598991394) | > loss_gen: 1.5681774616241455 (1.554384708404541) | > loss_kl: 3.7508182525634766 (3.680504083633423) | > loss_feat: 3.4058690071105957 (3.2114217281341553) | > loss_mel: 26.492046356201172 (25.364355087280273) | > loss_duration: 2.7396841049194336 (2.721508502960205) | > loss_1: 37.95659637451172 (36.53217315673828)  --> STEP: 3 | > loss_disc: 3.0059103965759277 (3.1196451981862388) | > loss_disc_real_0: 0.1790495663881302 (0.1933949093023936) | > loss_disc_real_1: 0.22999940812587738 (0.22966760893662772) | > loss_disc_real_2: 0.25941386818885803 (0.2539610316356023) | > loss_disc_real_3: 0.2153773456811905 (0.292373721798261) | > loss_disc_real_4: 0.2547486126422882 (0.2578817506631215) | > loss_disc_real_5: 0.21657459437847137 (0.2211837867895762) | > loss_0: 3.0059103965759277 (3.1196451981862388) | > loss_gen: 1.3676385879516602 (1.492136001586914) | > loss_kl: 1.7919448614120483 (3.050984342892965) | > loss_feat: 0.20261889696121216 (2.2084874510765076) | > loss_mel: 2.87835431098938 (17.869021495183308) | > loss_duration: 2.6619491577148438 (2.701655387878418) | > loss_1: 8.902505874633789 (27.32228406270345) --> EVAL PERFORMANCE | > avg_loader_time: 0.015354633331298828 (-0.009382486343383789) | > avg_loss_disc: 3.1196451981862388 (+0.6514370838801069) | > avg_loss_disc_real_0: 0.1933949093023936 (-0.20684590439001718) | > avg_loss_disc_real_1: 0.22966760893662772 (-0.023035317659378024) | > avg_loss_disc_real_2: 0.2539610316356023 (-0.01429016888141632) | > avg_loss_disc_real_3: 0.292373721798261 (+0.029528061548868778) | > avg_loss_disc_real_4: 0.2578817506631215 (+0.10544594873984653) | > avg_loss_disc_real_5: 0.2211837867895762 (+0.03309580187002817) | > avg_loss_0: 3.1196451981862388 (+0.6514370838801069) | > avg_loss_gen: 1.492136001586914 (-1.490668773651123) | > avg_loss_kl: 3.050984342892965 (+0.03466959794362401) | > avg_loss_feat: 2.2084874510765076 (-4.46694944302241) | > avg_loss_mel: 17.869021495183308 (-7.055719614028931) | > avg_loss_duration: 2.701655387878418 (-0.02563198407491063) | > avg_loss_1: 27.32228406270345 (-13.004299163818363)  > EPOCH: 418/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:14:55)   --> TIME: 2023-10-20 04:15:08 -- STEP: 19/50 -- GLOBAL_STEP: 73920 | > loss_disc: 3.024815797805786 (2.462638409514176) | > loss_disc_real_0: 0.3381417691707611 (0.1662626960559895) | > loss_disc_real_1: 0.21530380845069885 (0.2228067432971377) | > loss_disc_real_2: 0.2592478394508362 (0.22404125940642858) | > loss_disc_real_3: 0.26926925778388977 (0.2139938750157231) | > loss_disc_real_4: 0.2741602957248688 (0.18828312984030499) | > loss_disc_real_5: 0.2188178449869156 (0.19167440789016454) | > loss_0: 3.024815797805786 (2.462638409514176) | > grad_norm_0: tensor(1196.3068, device='cuda:0') (tensor(2015.5337, device='cuda:0')) | > loss_gen: 1.556835412979126 (2.3045528436961926) | > loss_kl: 0.961778461933136 (0.7876056150386208) | > loss_feat: 0.14074741303920746 (5.2695683507542865) | > loss_mel: 2.0879900455474854 (19.951732685691432) | > loss_duration: 1.6510438919067383 (1.5466130846425106) | > loss_1: 6.398395538330078 (29.860072738245915) | > grad_norm_1: tensor(36653.7266, device='cuda:0') (tensor(42751.4922, device='cuda:0')) | > current_lr_0: 0.00013166900550055637 | > current_lr_1: 0.00013166900550055637 | > step_time: 0.3738 (0.42680282341806514) | > loader_time: 0.0021 (0.011441042548731753)  --> TIME: 2023-10-20 04:15:22 -- STEP: 49/50 -- GLOBAL_STEP: 73950 | > loss_disc: 2.501260280609131 (2.430442299161638) | > loss_disc_real_0: 0.08212590217590332 (0.1529788287850667) | > loss_disc_real_1: 0.2530394196510315 (0.22015178709157876) | > loss_disc_real_2: 0.1869194656610489 (0.23518822440991596) | > loss_disc_real_3: 0.3298359811306 (0.23352066712568) | > loss_disc_real_4: 0.2806969881057739 (0.2122069129919899) | > loss_disc_real_5: 0.24890746176242828 (0.21086539781405306) | > loss_0: 2.501260280609131 (2.430442299161638) | > grad_norm_0: tensor(651.3021, device='cuda:0') (tensor(1434.4924, device='cuda:0')) | > loss_gen: 2.1697146892547607 (2.337533004429875) | > loss_kl: 0.49291354417800903 (0.7870476130320101) | > loss_feat: 1.8196269273757935 (5.280907991152181) | > loss_mel: 20.51219367980957 (21.189466604164664) | > loss_duration: 1.683581829071045 (1.508252010053518) | > loss_1: 26.678030014038086 (31.103207169746867) | > grad_norm_1: tensor(9012.1660, device='cuda:0') (tensor(31376.2969, device='cuda:0')) | > current_lr_0: 0.00013166900550055637 | > current_lr_1: 0.00013166900550055637 | > step_time: 0.9324 (0.43712281207649073) | > loader_time: 0.6729 (0.023658022588613083)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.955960273742676 (2.955960273742676) | > loss_disc_real_0: 0.420623779296875 (0.420623779296875) | > loss_disc_real_1: 0.24946826696395874 (0.24946826696395874) | > loss_disc_real_2: 0.3477517068386078 (0.3477517068386078) | > loss_disc_real_3: 0.33056965470314026 (0.33056965470314026) | > loss_disc_real_4: 0.18367056548595428 (0.18367056548595428) | > loss_disc_real_5: 0.35882681608200073 (0.35882681608200073) | > loss_0: 2.955960273742676 (2.955960273742676) | > loss_gen: 2.5693628787994385 (2.5693628787994385) | > loss_kl: 3.1582021713256836 (3.1582021713256836) | > loss_feat: 6.135664939880371 (6.135664939880371) | > loss_mel: 25.08727264404297 (25.08727264404297) | > loss_duration: 2.549851417541504 (2.549851417541504) | > loss_1: 39.5003547668457 (39.5003547668457)  --> STEP: 1 | > loss_disc: 2.042032241821289 (2.042032241821289) | > loss_disc_real_0: 0.3447763919830322 (0.3447763919830322) | > loss_disc_real_1: 0.15277144312858582 (0.15277144312858582) | > loss_disc_real_2: 0.1176295056939125 (0.1176295056939125) | > loss_disc_real_3: 0.2869158089160919 (0.2869158089160919) | > loss_disc_real_4: 0.1416144222021103 (0.1416144222021103) | > loss_disc_real_5: 0.1436389982700348 (0.1436389982700348) | > loss_0: 2.042032241821289 (2.042032241821289) | > loss_gen: 2.996889352798462 (2.996889352798462) | > loss_kl: 3.4815449714660645 (3.4815449714660645) | > loss_feat: 7.944552421569824 (7.944552421569824) | > loss_mel: 24.2310791015625 (24.2310791015625) | > loss_duration: 2.7723753452301025 (2.7723753452301025) | > loss_1: 41.42644500732422 (41.42644500732422)  --> STEP: 2 | > loss_disc: 1.709190011024475 (1.875611126422882) | > loss_disc_real_0: 0.06306859105825424 (0.20392249152064323) | > loss_disc_real_1: 0.07975909858942032 (0.11626527085900307) | > loss_disc_real_2: 0.1258852183818817 (0.12175736203789711) | > loss_disc_real_3: 0.2037244737148285 (0.2453201413154602) | > loss_disc_real_4: 0.058594733476638794 (0.10010457783937454) | > loss_disc_real_5: 0.028788238763809204 (0.086213618516922) | > loss_0: 1.709190011024475 (1.875611126422882) | > loss_gen: 2.2029497623443604 (2.599919557571411) | > loss_kl: 3.8841779232025146 (3.6828614473342896) | > loss_feat: 9.860970497131348 (8.902761459350586) | > loss_mel: 21.069576263427734 (22.650327682495117) | > loss_duration: 2.744706630706787 (2.758540987968445) | > loss_1: 39.76237869262695 (40.594411849975586)  --> STEP: 3 | > loss_disc: 1.6592717170715332 (1.8034979899724324) | > loss_disc_real_0: 0.04802066832780838 (0.15195521712303162) | > loss_disc_real_1: 0.13514739274978638 (0.12255931148926417) | > loss_disc_real_2: 0.07263361662626266 (0.10538278023401897) | > loss_disc_real_3: 0.11839544773101807 (0.20301191012064615) | > loss_disc_real_4: 0.062080249190330505 (0.08742980162302653) | > loss_disc_real_5: 0.010984900407493114 (0.06113737914711237) | > loss_0: 1.6592717170715332 (1.8034979899724324) | > loss_gen: 2.389714002609253 (2.529851039250692) | > loss_kl: 1.6456596851348877 (3.0037941932678223) | > loss_feat: 8.327881813049316 (8.711134910583496) | > loss_mel: 26.603235244750977 (23.967963536580402) | > loss_duration: 2.665942668914795 (2.727674881617228) | > loss_1: 41.63243103027344 (40.9404182434082) --> EVAL PERFORMANCE | > avg_loader_time: 0.007212718327840169 (-0.00814191500345866) | > avg_loss_disc: 1.8034979899724324 (-1.3161472082138064) | > avg_loss_disc_real_0: 0.15195521712303162 (-0.04143969217936197) | > avg_loss_disc_real_1: 0.12255931148926417 (-0.10710829744736354) | > avg_loss_disc_real_2: 0.10538278023401897 (-0.14857825140158332) | > avg_loss_disc_real_3: 0.20301191012064615 (-0.08936181167761484) | > avg_loss_disc_real_4: 0.08742980162302653 (-0.17045194904009497) | > avg_loss_disc_real_5: 0.06113737914711237 (-0.16004640764246383) | > avg_loss_0: 1.8034979899724324 (-1.3161472082138064) | > avg_loss_gen: 2.529851039250692 (+1.0377150376637778) | > avg_loss_kl: 3.0037941932678223 (-0.04719014962514256) | > avg_loss_feat: 8.711134910583496 (+6.5026474595069885) | > avg_loss_mel: 23.967963536580402 (+6.098942041397095) | > avg_loss_duration: 2.727674881617228 (+0.026019493738810073) | > avg_loss_1: 40.9404182434082 (+13.618134180704754)  > EPOCH: 419/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:15:32)   --> TIME: 2023-10-20 04:15:52 -- STEP: 29/50 -- GLOBAL_STEP: 73980 | > loss_disc: 2.7330262660980225 (2.5022929865738437) | > loss_disc_real_0: 0.07672350108623505 (0.18373867259200277) | > loss_disc_real_1: 0.3064255118370056 (0.23477907787109242) | > loss_disc_real_2: 0.17075484991073608 (0.2351526972548715) | > loss_disc_real_3: 0.23250775039196014 (0.2413403153547953) | > loss_disc_real_4: 0.23741157352924347 (0.2108383659787219) | > loss_disc_real_5: 0.3154331147670746 (0.22609981586193217) | > loss_0: 2.7330262660980225 (2.5022929865738437) | > grad_norm_0: tensor(1116.8749, device='cuda:0') (tensor(719.2114, device='cuda:0')) | > loss_gen: 1.8578288555145264 (2.3442601499886346) | > loss_kl: 1.3588131666183472 (1.0132531400384572) | > loss_feat: 2.660352945327759 (5.417278919754358) | > loss_mel: 23.213422775268555 (22.300657691626714) | > loss_duration: 1.524566650390625 (1.5324729475481758) | > loss_1: 30.6149845123291 (32.60792270200005) | > grad_norm_1: tensor(5050.7925, device='cuda:0') (tensor(24371.6602, device='cuda:0')) | > current_lr_0: 0.00013153739408584665 | > current_lr_1: 0.00013153739408584665 | > step_time: 0.6343 (0.5157880207587932) | > loader_time: 0.0175 (0.018978053125841863)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5727243423461914 (2.5727243423461914) | > loss_disc_real_0: 0.3345998227596283 (0.3345998227596283) | > loss_disc_real_1: 0.20297347009181976 (0.20297347009181976) | > loss_disc_real_2: 0.24347089231014252 (0.24347089231014252) | > loss_disc_real_3: 0.22283950448036194 (0.22283950448036194) | > loss_disc_real_4: 0.2913050353527069 (0.2913050353527069) | > loss_disc_real_5: 0.24164380133152008 (0.24164380133152008) | > loss_0: 2.5727243423461914 (2.5727243423461914) | > loss_gen: 2.3517026901245117 (2.3517026901245117) | > loss_kl: 3.563490867614746 (3.563490867614746) | > loss_feat: 6.884880542755127 (6.884880542755127) | > loss_mel: 22.422569274902344 (22.422569274902344) | > loss_duration: 2.512819528579712 (2.512819528579712) | > loss_1: 37.73546600341797 (37.73546600341797)  --> STEP: 1 | > loss_disc: 2.645197629928589 (2.645197629928589) | > loss_disc_real_0: 0.533745527267456 (0.533745527267456) | > loss_disc_real_1: 0.1874610036611557 (0.1874610036611557) | > loss_disc_real_2: 0.23787596821784973 (0.23787596821784973) | > loss_disc_real_3: 0.1106385588645935 (0.1106385588645935) | > loss_disc_real_4: 0.26122695207595825 (0.26122695207595825) | > loss_disc_real_5: 0.19351160526275635 (0.19351160526275635) | > loss_0: 2.645197629928589 (2.645197629928589) | > loss_gen: 2.2420520782470703 (2.2420520782470703) | > loss_kl: 4.007689952850342 (4.007689952850342) | > loss_feat: 6.647567272186279 (6.647567272186279) | > loss_mel: 24.937095642089844 (24.937095642089844) | > loss_duration: 2.701366424560547 (2.701366424560547) | > loss_1: 40.535770416259766 (40.535770416259766)  --> STEP: 2 | > loss_disc: 2.456418991088867 (2.550808310508728) | > loss_disc_real_0: 0.10071532428264618 (0.3172304257750511) | > loss_disc_real_1: 0.22508522868156433 (0.20627311617136002) | > loss_disc_real_2: 0.23019185662269592 (0.23403391242027283) | > loss_disc_real_3: 0.20659658312797546 (0.15861757099628448) | > loss_disc_real_4: 0.1920199990272522 (0.22662347555160522) | > loss_disc_real_5: 0.12459564954042435 (0.15905362740159035) | > loss_0: 2.456418991088867 (2.550808310508728) | > loss_gen: 1.826925277709961 (2.0344886779785156) | > loss_kl: 4.246335983276367 (4.1270129680633545) | > loss_feat: 4.724153518676758 (5.6858603954315186) | > loss_mel: 21.483478546142578 (23.21028709411621) | > loss_duration: 2.654459238052368 (2.6779128313064575) | > loss_1: 34.93535232543945 (37.73556137084961)  --> STEP: 3 | > loss_disc: 3.214488983154297 (2.7720352013905845) | > loss_disc_real_0: 0.39389267563819885 (0.34278450906276703) | > loss_disc_real_1: 0.2615828216075897 (0.22470968465010324) | > loss_disc_real_2: 0.23306922614574432 (0.23371235032876334) | > loss_disc_real_3: 0.291633278131485 (0.20295614004135132) | > loss_disc_real_4: 0.24111485481262207 (0.2314539353052775) | > loss_disc_real_5: 0.28206515312194824 (0.2000574693083763) | > loss_0: 3.214488983154297 (2.7720352013905845) | > loss_gen: 1.5140879154205322 (1.8610217571258545) | > loss_kl: 1.9350507259368896 (3.3963588873545327) | > loss_feat: 0.7407825589179993 (4.0375011165936785) | > loss_mel: 10.036590576171875 (18.819054921468098) | > loss_duration: 2.5452802181243896 (2.633701960245768) | > loss_1: 16.771791458129883 (30.7476380666097) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_74000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.653052568435669 (2.7422895431518555) | > loss_disc_real_0: 0.20975586771965027 (0.30952734872698784) | > loss_disc_real_1: 0.2446429431438446 (0.2296929992735386) | > loss_disc_real_2: 0.3245055377483368 (0.2564106471836567) | > loss_disc_real_3: 0.30826088786125183 (0.22928232699632645) | > loss_disc_real_4: 0.30929961800575256 (0.25091535598039627) | > loss_disc_real_5: 0.17798471450805664 (0.1945392806082964) | > loss_0: 2.653052568435669 (2.7422895431518555) | > loss_gen: 2.310711145401001 (1.9734441041946411) | > loss_kl: 3.5991461277008057 (3.447055697441101) | > loss_feat: 4.513786315917969 (4.156572416424751) | > loss_mel: 23.728349685668945 (20.04637861251831) | > loss_duration: 2.4731595516204834 (2.593566358089447) | > loss_1: 36.625152587890625 (32.21701669692993)  --> STEP: 1 | > loss_disc: 1.695454716682434 (2.5329225778579714) | > loss_disc_real_0: 0.06556131690740585 (0.26073414236307146) | > loss_disc_real_1: 0.11078616231679916 (0.2059116318821907) | > loss_disc_real_2: 0.23916997015476227 (0.2529625117778778) | > loss_disc_real_3: 0.07677111774682999 (0.19878008514642714) | > loss_disc_real_4: 0.07543431222438812 (0.21581914722919465) | > loss_disc_real_5: 0.14758795499801636 (0.18514901548624038) | > loss_0: 1.695454716682434 (2.5329225778579714) | > loss_gen: 2.6048378944396973 (2.0997228622436523) | > loss_kl: 4.114648342132568 (3.5805742263793947) | > loss_feat: 10.308969497680664 (5.387051832675934) | > loss_mel: 26.67249870300293 (21.371602630615236) | > loss_duration: 2.6287930011749268 (2.600611686706543) | > loss_1: 46.32974624633789 (35.03956260681152)  --> STEP: 2 | > loss_disc: 3.2317850589752197 (2.6493996580441794) | > loss_disc_real_0: 0.39314764738082886 (0.282803059866031) | > loss_disc_real_1: 0.2994966506958008 (0.22150913501779237) | > loss_disc_real_2: 0.24916604161262512 (0.2523297667503357) | > loss_disc_real_3: 0.2802217900753021 (0.21235370263457298) | > loss_disc_real_4: 0.27079513669013977 (0.22498181213935217) | > loss_disc_real_5: 0.28513622283935547 (0.2018135500450929) | > loss_0: 3.2317850589752197 (2.6493996580441794) | > loss_gen: 1.5904830694198608 (2.0148495634396872) | > loss_kl: 3.9967472553253174 (3.649936397870382) | > loss_feat: 0.6504637598991394 (4.597620487213135) | > loss_mel: 17.19740104675293 (20.675902366638184) | > loss_duration: 2.688793659210205 (2.61530868212382) | > loss_1: 26.12388801574707 (33.55361684163412)  --> STEP: 3 | > loss_disc: 3.3214972019195557 (2.745413592883519) | > loss_disc_real_0: 0.2997240126132965 (0.2852203388299261) | > loss_disc_real_1: 0.29744040966033936 (0.23235645996672766) | > loss_disc_real_2: 0.29977041482925415 (0.2591070021901812) | > loss_disc_real_3: 0.29228663444519043 (0.22377269289323262) | > loss_disc_real_4: 0.35265490412712097 (0.243220825280462) | > loss_disc_real_5: 0.37047749757766724 (0.2259083996926035) | > loss_0: 3.3214972019195557 (2.745413592883519) | > loss_gen: 1.711120843887329 (1.9714597463607788) | > loss_kl: 1.5011335611343384 (3.342964564050947) | > loss_feat: 2.4604504108428955 (4.292310476303101) | > loss_mel: 19.710094451904297 (20.537929807390487) | > loss_duration: 2.491626739501953 (2.597639833177839) | > loss_1: 27.874425888061523 (32.7423038482666) --> EVAL PERFORMANCE | > avg_loader_time: 0.38880164282662527 (+0.3815889244987851) | > avg_loss_disc: 2.745413592883519 (+0.9419156029110864) | > avg_loss_disc_real_0: 0.2852203388299261 (+0.13326512170689447) | > avg_loss_disc_real_1: 0.23235645996672766 (+0.10979714847746348) | > avg_loss_disc_real_2: 0.2591070021901812 (+0.1537242219561622) | > avg_loss_disc_real_3: 0.22377269289323262 (+0.020760782772586472) | > avg_loss_disc_real_4: 0.243220825280462 (+0.15579102365743547) | > avg_loss_disc_real_5: 0.2259083996926035 (+0.16477102054549114) | > avg_loss_0: 2.745413592883519 (+0.9419156029110864) | > avg_loss_gen: 1.9714597463607788 (-0.5583912928899131) | > avg_loss_kl: 3.342964564050947 (+0.33917037078312484) | > avg_loss_feat: 4.292310476303101 (-4.4188244342803955) | > avg_loss_mel: 20.537929807390487 (-3.4300337291899154) | > avg_loss_duration: 2.597639833177839 (-0.13003504843938885) | > avg_loss_1: 32.7423038482666 (-8.198114395141602)  > EPOCH: 420/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:16:20)   --> TIME: 2023-10-20 04:16:31 -- STEP: 9/50 -- GLOBAL_STEP: 74010 | > loss_disc: 2.8661704063415527 (2.4831432501475015) | > loss_disc_real_0: 0.40831419825553894 (0.20530779701140192) | > loss_disc_real_1: 0.3934720456600189 (0.2632100250985887) | > loss_disc_real_2: 0.3189849853515625 (0.2754618376493454) | > loss_disc_real_3: 0.3415321707725525 (0.24442659401231343) | > loss_disc_real_4: 0.3303774893283844 (0.25535207448734176) | > loss_disc_real_5: 0.33081477880477905 (0.20918039853374162) | > loss_0: 2.8661704063415527 (2.4831432501475015) | > grad_norm_0: tensor(836.5801, device='cuda:0') (tensor(1062.0768, device='cuda:0')) | > loss_gen: 2.669376850128174 (2.523680991596646) | > loss_kl: 1.1313400268554688 (1.0492005348205566) | > loss_feat: 2.9423553943634033 (5.565123971965578) | > loss_mel: 22.50944709777832 (22.416109720865887) | > loss_duration: 1.4836617708206177 (1.509858422809177) | > loss_1: 30.73617935180664 (33.06397395663791) | > grad_norm_1: tensor(5075.0835, device='cuda:0') (tensor(23381.2695, device='cuda:0')) | > current_lr_0: 0.00013140591422498605 | > current_lr_1: 0.00013140591422498605 | > step_time: 0.5495 (0.5306056075625949) | > loader_time: 0.0024 (0.017621411217583552)  --> TIME: 2023-10-20 04:16:47 -- STEP: 39/50 -- GLOBAL_STEP: 74040 | > loss_disc: 2.3386268615722656 (2.450919933808155) | > loss_disc_real_0: 0.13613776862621307 (0.15794732125523764) | > loss_disc_real_1: 0.404560923576355 (0.23996040349205336) | > loss_disc_real_2: 0.26964062452316284 (0.23957481304517922) | > loss_disc_real_3: 0.23860564827919006 (0.2512837700927869) | > loss_disc_real_4: 0.27138450741767883 (0.23884648898950753) | > loss_disc_real_5: 0.24891352653503418 (0.23117047271285301) | > loss_0: 2.3386268615722656 (2.450919933808155) | > grad_norm_0: tensor(916.0803, device='cuda:0') (tensor(837.6339, device='cuda:0')) | > loss_gen: 2.896850109100342 (2.3829924296110105) | > loss_kl: 0.3395802974700928 (0.9208986499370673) | > loss_feat: 4.3949971199035645 (4.8483460895144015) | > loss_mel: 22.698280334472656 (20.6964670419693) | > loss_duration: 1.5809078216552734 (1.521782887287629) | > loss_1: 31.910615921020508 (30.370487616612362) | > grad_norm_1: tensor(9730.6436, device='cuda:0') (tensor(19561.9043, device='cuda:0')) | > current_lr_0: 0.00013140591422498605 | > current_lr_1: 0.00013140591422498605 | > step_time: 0.5977 (0.5145238301692867) | > loader_time: 0.0246 (0.01853672663370768)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.620311737060547 (2.620311737060547) | > loss_disc_real_0: 0.25826215744018555 (0.25826215744018555) | > loss_disc_real_1: 0.23596136271953583 (0.23596136271953583) | > loss_disc_real_2: 0.17191211879253387 (0.17191211879253387) | > loss_disc_real_3: 0.24707674980163574 (0.24707674980163574) | > loss_disc_real_4: 0.15576760470867157 (0.15576760470867157) | > loss_disc_real_5: 0.1348506659269333 (0.1348506659269333) | > loss_0: 2.620311737060547 (2.620311737060547) | > loss_gen: 1.8004101514816284 (1.8004101514816284) | > loss_kl: 3.5231292247772217 (3.5231292247772217) | > loss_feat: 3.2880373001098633 (3.2880373001098633) | > loss_mel: 24.792591094970703 (24.792591094970703) | > loss_duration: 2.5105361938476562 (2.5105361938476562) | > loss_1: 35.914703369140625 (35.914703369140625)  --> STEP: 1 | > loss_disc: 2.3968119621276855 (2.3968119621276855) | > loss_disc_real_0: 0.3277037739753723 (0.3277037739753723) | > loss_disc_real_1: 0.214901402592659 (0.214901402592659) | > loss_disc_real_2: 0.3235156536102295 (0.3235156536102295) | > loss_disc_real_3: 0.17870241403579712 (0.17870241403579712) | > loss_disc_real_4: 0.15815523266792297 (0.15815523266792297) | > loss_disc_real_5: 0.038300808519124985 (0.038300808519124985) | > loss_0: 2.3968119621276855 (2.3968119621276855) | > loss_gen: 2.405212640762329 (2.405212640762329) | > loss_kl: 4.009944915771484 (4.009944915771484) | > loss_feat: 9.189397811889648 (9.189397811889648) | > loss_mel: 28.402311325073242 (28.402311325073242) | > loss_duration: 2.711035966873169 (2.711035966873169) | > loss_1: 46.71790313720703 (46.71790313720703)  --> STEP: 2 | > loss_disc: 1.9423669576644897 (2.1695894598960876) | > loss_disc_real_0: 0.14039510488510132 (0.23404943943023682) | > loss_disc_real_1: 0.2265336662530899 (0.22071753442287445) | > loss_disc_real_2: 0.23476538062095642 (0.27914051711559296) | > loss_disc_real_3: 0.13385511934757233 (0.15627876669168472) | > loss_disc_real_4: 0.121623195707798 (0.1398892141878605) | > loss_disc_real_5: 0.07924298197031021 (0.0587718952447176) | > loss_0: 1.9423669576644897 (2.1695894598960876) | > loss_gen: 2.685762882232666 (2.5454877614974976) | > loss_kl: 4.167033672332764 (4.088489294052124) | > loss_feat: 9.453302383422852 (9.32135009765625) | > loss_mel: 27.127172470092773 (27.764741897583008) | > loss_duration: 2.623952865600586 (2.6674944162368774) | > loss_1: 46.057228088378906 (46.38756561279297)  --> STEP: 3 | > loss_disc: 3.0993728637695312 (2.4795172611872354) | > loss_disc_real_0: 0.5281058549880981 (0.3320682446161906) | > loss_disc_real_1: 0.2597186863422394 (0.2337179183959961) | > loss_disc_real_2: 0.23656685650348663 (0.2649492969115575) | > loss_disc_real_3: 0.2785480320453644 (0.1970351884762446) | > loss_disc_real_4: 0.278835266828537 (0.186204565068086) | > loss_disc_real_5: 0.24950304627418518 (0.12234894558787346) | > loss_0: 3.0993728637695312 (2.4795172611872354) | > loss_gen: 1.8668849468231201 (2.319286823272705) | > loss_kl: 1.2596776485443115 (3.145552078882853) | > loss_feat: 0.3569115102291107 (6.333203901847203) | > loss_mel: 12.444984436035156 (22.65815607706706) | > loss_duration: 2.5874173641204834 (2.6408020655314126) | > loss_1: 18.51587677001953 (37.09700266520182) --> EVAL PERFORMANCE | > avg_loader_time: 0.006783485412597656 (-0.3820181574140276) | > avg_loss_disc: 2.4795172611872354 (-0.26589633169628346) | > avg_loss_disc_real_0: 0.3320682446161906 (+0.04684790578626452) | > avg_loss_disc_real_1: 0.2337179183959961 (+0.0013614584292684362) | > avg_loss_disc_real_2: 0.2649492969115575 (+0.005842294721376318) | > avg_loss_disc_real_3: 0.1970351884762446 (-0.026737504416988023) | > avg_loss_disc_real_4: 0.186204565068086 (-0.05701626021237599) | > avg_loss_disc_real_5: 0.12234894558787346 (-0.10355945410473005) | > avg_loss_0: 2.4795172611872354 (-0.26589633169628346) | > avg_loss_gen: 2.319286823272705 (+0.34782707691192627) | > avg_loss_kl: 3.145552078882853 (-0.19741248516809407) | > avg_loss_feat: 6.333203901847203 (+2.0408934255441027) | > avg_loss_mel: 22.65815607706706 (+2.1202262696765715) | > avg_loss_duration: 2.6408020655314126 (+0.043162232353573415) | > avg_loss_1: 37.09700266520182 (+4.354698816935219)  > EPOCH: 421/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:17:03)   --> TIME: 2023-10-20 04:17:13 -- STEP: 19/50 -- GLOBAL_STEP: 74070 | > loss_disc: 2.9689905643463135 (2.3282721105374784) | > loss_disc_real_0: 0.3054838180541992 (0.1570034074155908) | > loss_disc_real_1: 0.24910998344421387 (0.2356871496886015) | > loss_disc_real_2: 0.3107137084007263 (0.23241094146904193) | > loss_disc_real_3: 0.28742241859436035 (0.2258880039382922) | > loss_disc_real_4: 0.35975149273872375 (0.21459276425211052) | > loss_disc_real_5: 0.37832969427108765 (0.2225675644647134) | > loss_0: 2.9689905643463135 (2.3282721105374784) | > grad_norm_0: tensor(1291.1376, device='cuda:0') (tensor(735.0065, device='cuda:0')) | > loss_gen: 2.2531661987304688 (2.4478829157979867) | > loss_kl: 0.9848421216011047 (0.9761646358590377) | > loss_feat: 2.31156849861145 (5.534085371580563) | > loss_mel: 21.341793060302734 (21.47069946715706) | > loss_duration: 1.6199474334716797 (1.5751288815548545) | > loss_1: 28.511316299438477 (32.00396088549965) | > grad_norm_1: tensor(9077.3164, device='cuda:0') (tensor(27030.0918, device='cuda:0')) | > current_lr_0: 0.00013127456578647823 | > current_lr_1: 0.00013127456578647823 | > step_time: 0.4749 (0.3338161644182707) | > loader_time: 0.0019 (0.006424000388697574)  --> TIME: 2023-10-20 04:17:30 -- STEP: 49/50 -- GLOBAL_STEP: 74100 | > loss_disc: 2.1482315063476562 (2.432660674562259) | > loss_disc_real_0: 0.046978045254945755 (0.15572067829115055) | > loss_disc_real_1: 0.21206000447273254 (0.22954485257517318) | > loss_disc_real_2: 0.23438991606235504 (0.22968162565815206) | > loss_disc_real_3: 0.298697829246521 (0.2287803967008177) | > loss_disc_real_4: 0.19482029974460602 (0.2153607759700746) | > loss_disc_real_5: 0.15353305637836456 (0.2207539366292102) | > loss_0: 2.1482315063476562 (2.432660674562259) | > grad_norm_0: tensor(873.4648, device='cuda:0') (tensor(824.7969, device='cuda:0')) | > loss_gen: 2.6574010848999023 (2.3201032706669396) | > loss_kl: 0.6008239984512329 (0.9391069783239948) | > loss_feat: 3.9770491123199463 (5.034786592864869) | > loss_mel: 25.15852165222168 (21.45914210348713) | > loss_duration: 1.627076268196106 (1.529605678149632) | > loss_1: 34.020870208740234 (31.282744378459686) | > grad_norm_1: tensor(18856.5625, device='cuda:0') (tensor(21318.4531, device='cuda:0')) | > current_lr_0: 0.00013127456578647823 | > current_lr_1: 0.00013127456578647823 | > step_time: 0.6436 (0.4540791219594527) | > loader_time: 0.4296 (0.01796975914312868)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9622516632080078 (1.9622516632080078) | > loss_disc_real_0: 0.11416327208280563 (0.11416327208280563) | > loss_disc_real_1: 0.19869789481163025 (0.19869789481163025) | > loss_disc_real_2: 0.31885427236557007 (0.31885427236557007) | > loss_disc_real_3: 0.07461033761501312 (0.07461033761501312) | > loss_disc_real_4: 0.3267900049686432 (0.3267900049686432) | > loss_disc_real_5: 0.1586371660232544 (0.1586371660232544) | > loss_0: 1.9622516632080078 (1.9622516632080078) | > loss_gen: 3.3097033500671387 (3.3097033500671387) | > loss_kl: 2.9585652351379395 (2.9585652351379395) | > loss_feat: 9.326277732849121 (9.326277732849121) | > loss_mel: 23.655622482299805 (23.655622482299805) | > loss_duration: 2.47021222114563 (2.47021222114563) | > loss_1: 41.72038269042969 (41.72038269042969)  --> STEP: 1 | > loss_disc: 3.034572124481201 (3.034572124481201) | > loss_disc_real_0: 0.2347930520772934 (0.2347930520772934) | > loss_disc_real_1: 0.27350589632987976 (0.27350589632987976) | > loss_disc_real_2: 0.2292611449956894 (0.2292611449956894) | > loss_disc_real_3: 0.09321841597557068 (0.09321841597557068) | > loss_disc_real_4: 0.5118795037269592 (0.5118795037269592) | > loss_disc_real_5: 0.43830856680870056 (0.43830856680870056) | > loss_0: 3.034572124481201 (3.034572124481201) | > loss_gen: 2.3871915340423584 (2.3871915340423584) | > loss_kl: 3.9221954345703125 (3.9221954345703125) | > loss_feat: 7.212494373321533 (7.212494373321533) | > loss_mel: 24.979827880859375 (24.979827880859375) | > loss_duration: 2.7483086585998535 (2.7483086585998535) | > loss_1: 41.25001907348633 (41.25001907348633)  --> STEP: 2 | > loss_disc: 2.578130006790161 (2.806351065635681) | > loss_disc_real_0: 0.25254184007644653 (0.24366744607686996) | > loss_disc_real_1: 0.26584434509277344 (0.2696751207113266) | > loss_disc_real_2: 0.34140270948410034 (0.28533192723989487) | > loss_disc_real_3: 0.19668689370155334 (0.144952654838562) | > loss_disc_real_4: 0.19976910948753357 (0.3558243066072464) | > loss_disc_real_5: 0.3690985143184662 (0.4037035405635834) | > loss_0: 2.578130006790161 (2.806351065635681) | > loss_gen: 2.828641891479492 (2.6079167127609253) | > loss_kl: 4.181493282318115 (4.051844358444214) | > loss_feat: 5.457019805908203 (6.334757089614868) | > loss_mel: 28.657320022583008 (26.81857395172119) | > loss_duration: 2.6508235931396484 (2.699566125869751) | > loss_1: 43.775299072265625 (42.51265907287598)  --> STEP: 3 | > loss_disc: 2.4921329021453857 (2.7016116778055825) | > loss_disc_real_0: 0.2066660225391388 (0.23133363823095957) | > loss_disc_real_1: 0.27767178416252136 (0.27234067519505817) | > loss_disc_real_2: 0.23175042867660522 (0.26747142771879834) | > loss_disc_real_3: 0.3058490753173828 (0.19858479499816895) | > loss_disc_real_4: 0.20883709192276 (0.3068285683790843) | > loss_disc_real_5: 0.22541819512844086 (0.3442750920852025) | > loss_0: 2.4921329021453857 (2.7016116778055825) | > loss_gen: 2.1174535751342773 (2.4444290002187095) | > loss_kl: 2.0644946098327637 (3.389394442240397) | > loss_feat: 2.087937116622925 (4.919150431950887) | > loss_mel: 17.525049209594727 (23.72073237101237) | > loss_duration: 2.597327947616577 (2.665486733118693) | > loss_1: 26.392261505126953 (37.13919321695963) --> EVAL PERFORMANCE | > avg_loader_time: 0.013825178146362305 (+0.0070416927337646484) | > avg_loss_disc: 2.7016116778055825 (+0.22209441661834717) | > avg_loss_disc_real_0: 0.23133363823095957 (-0.10073460638523105) | > avg_loss_disc_real_1: 0.27234067519505817 (+0.038622756799062075) | > avg_loss_disc_real_2: 0.26747142771879834 (+0.002522130807240841) | > avg_loss_disc_real_3: 0.19858479499816895 (+0.001549606521924346) | > avg_loss_disc_real_4: 0.3068285683790843 (+0.12062400331099829) | > avg_loss_disc_real_5: 0.3442750920852025 (+0.22192614649732906) | > avg_loss_0: 2.7016116778055825 (+0.22209441661834717) | > avg_loss_gen: 2.4444290002187095 (+0.12514217694600438) | > avg_loss_kl: 3.389394442240397 (+0.24384236335754395) | > avg_loss_feat: 4.919150431950887 (-1.4140534698963165) | > avg_loss_mel: 23.72073237101237 (+1.0625762939453125) | > avg_loss_duration: 2.665486733118693 (+0.024684667587280273) | > avg_loss_1: 37.13919321695963 (+0.0421905517578125)  > EPOCH: 422/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:17:39)   --> TIME: 2023-10-20 04:17:58 -- STEP: 29/50 -- GLOBAL_STEP: 74130 | > loss_disc: 3.0827391147613525 (2.6029743696081216) | > loss_disc_real_0: 0.4138907790184021 (0.1728768364108842) | > loss_disc_real_1: 0.329202800989151 (0.22464110753659544) | > loss_disc_real_2: 0.2973604202270508 (0.2449427673528935) | > loss_disc_real_3: 0.3541097044944763 (0.25706440891171317) | > loss_disc_real_4: 0.3643082082271576 (0.2364182142412354) | > loss_disc_real_5: 0.3117671608924866 (0.23836632278458825) | > loss_0: 3.0827391147613525 (2.6029743696081216) | > grad_norm_0: tensor(545.4000, device='cuda:0') (tensor(792.5254, device='cuda:0')) | > loss_gen: 2.3379242420196533 (2.2517236347856193) | > loss_kl: 0.5891253352165222 (0.9267227865498642) | > loss_feat: 3.565986156463623 (5.156293636765973) | > loss_mel: 22.932580947875977 (21.24105079831748) | > loss_duration: 1.5848978757858276 (1.5323721375958672) | > loss_1: 31.010515213012695 (31.108162764845222) | > grad_norm_1: tensor(3972.8550, device='cuda:0') (tensor(24212.9316, device='cuda:0')) | > current_lr_0: 0.00013114334863895832 | > current_lr_1: 0.00013114334863895832 | > step_time: 0.5385 (0.4879575515615529) | > loader_time: 0.0134 (0.021289808996792496)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.287715435028076 (2.287715435028076) | > loss_disc_real_0: 0.09197595715522766 (0.09197595715522766) | > loss_disc_real_1: 0.16448208689689636 (0.16448208689689636) | > loss_disc_real_2: 0.22153814136981964 (0.22153814136981964) | > loss_disc_real_3: 0.3523474931716919 (0.3523474931716919) | > loss_disc_real_4: 0.36065083742141724 (0.36065083742141724) | > loss_disc_real_5: 0.16271163523197174 (0.16271163523197174) | > loss_0: 2.287715435028076 (2.287715435028076) | > loss_gen: 2.4606213569641113 (2.4606213569641113) | > loss_kl: 3.6048567295074463 (3.6048567295074463) | > loss_feat: 6.482877254486084 (6.482877254486084) | > loss_mel: 22.988983154296875 (22.988983154296875) | > loss_duration: 2.6161556243896484 (2.6161556243896484) | > loss_1: 38.15349578857422 (38.15349578857422)  --> STEP: 1 | > loss_disc: 2.5147705078125 (2.5147705078125) | > loss_disc_real_0: 0.10989998281002045 (0.10989998281002045) | > loss_disc_real_1: 0.18721996247768402 (0.18721996247768402) | > loss_disc_real_2: 0.24155503511428833 (0.24155503511428833) | > loss_disc_real_3: 0.39167848229408264 (0.39167848229408264) | > loss_disc_real_4: 0.4350431263446808 (0.4350431263446808) | > loss_disc_real_5: 0.2818032503128052 (0.2818032503128052) | > loss_0: 2.5147705078125 (2.5147705078125) | > loss_gen: 2.5101985931396484 (2.5101985931396484) | > loss_kl: 4.040335655212402 (4.040335655212402) | > loss_feat: 5.355583667755127 (5.355583667755127) | > loss_mel: 26.616439819335938 (26.616439819335938) | > loss_duration: 2.8743090629577637 (2.8743090629577637) | > loss_1: 41.39686965942383 (41.39686965942383)  --> STEP: 2 | > loss_disc: 2.0767581462860107 (2.2957643270492554) | > loss_disc_real_0: 0.06344713270664215 (0.0866735577583313) | > loss_disc_real_1: 0.13495375216007233 (0.16108685731887817) | > loss_disc_real_2: 0.13278359174728394 (0.18716931343078613) | > loss_disc_real_3: 0.35047754645347595 (0.3710780143737793) | > loss_disc_real_4: 0.15247094631195068 (0.29375703632831573) | > loss_disc_real_5: 0.11287437379360199 (0.19733881205320358) | > loss_0: 2.0767581462860107 (2.2957643270492554) | > loss_gen: 2.399278163909912 (2.4547383785247803) | > loss_kl: 4.164443492889404 (4.102389574050903) | > loss_feat: 10.355154037475586 (7.8553688526153564) | > loss_mel: 27.570810317993164 (27.09362506866455) | > loss_duration: 2.737541913986206 (2.805925488471985) | > loss_1: 47.22722625732422 (44.31204795837402)  --> STEP: 3 | > loss_disc: 3.030435800552368 (2.5406548182169595) | > loss_disc_real_0: 0.17030945420265198 (0.11455218990643819) | > loss_disc_real_1: 0.24817273020744324 (0.19011548161506653) | > loss_disc_real_2: 0.24307380616664886 (0.20580414434274039) | > loss_disc_real_3: 0.27123603224754333 (0.337797353665034) | > loss_disc_real_4: 0.2897281348705292 (0.2924140691757202) | > loss_disc_real_5: 0.29407423734664917 (0.22958395381768545) | > loss_0: 3.030435800552368 (2.5406548182169595) | > loss_gen: 1.514760971069336 (2.1414125760396323) | > loss_kl: 1.9264322519302368 (3.3770704666773477) | > loss_feat: 0.047017842531204224 (5.252585182587306) | > loss_mel: 2.4304325580596924 (18.872560898462932) | > loss_duration: 2.6121208667755127 (2.741323947906494) | > loss_1: 8.53076457977295 (32.38495349884033) --> EVAL PERFORMANCE | > avg_loader_time: 0.025611321131388348 (+0.011786142985026043) | > avg_loss_disc: 2.5406548182169595 (-0.16095685958862305) | > avg_loss_disc_real_0: 0.11455218990643819 (-0.11678144832452138) | > avg_loss_disc_real_1: 0.19011548161506653 (-0.08222519357999164) | > avg_loss_disc_real_2: 0.20580414434274039 (-0.06166728337605795) | > avg_loss_disc_real_3: 0.337797353665034 (+0.13921255866686505) | > avg_loss_disc_real_4: 0.2924140691757202 (-0.014414499203364073) | > avg_loss_disc_real_5: 0.22958395381768545 (-0.11469113826751706) | > avg_loss_0: 2.5406548182169595 (-0.16095685958862305) | > avg_loss_gen: 2.1414125760396323 (-0.30301642417907715) | > avg_loss_kl: 3.3770704666773477 (-0.012323975563049316) | > avg_loss_feat: 5.252585182587306 (+0.33343475063641925) | > avg_loss_mel: 18.872560898462932 (-4.8481714725494385) | > avg_loss_duration: 2.741323947906494 (+0.07583721478780125) | > avg_loss_1: 32.38495349884033 (-4.754239718119301)  > EPOCH: 423/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:18:18)   --> TIME: 2023-10-20 04:18:30 -- STEP: 9/50 -- GLOBAL_STEP: 74160 | > loss_disc: 2.6850664615631104 (2.4266929229100547) | > loss_disc_real_0: 0.19497433304786682 (0.12736265195740593) | > loss_disc_real_1: 0.2403622567653656 (0.2418467104434967) | > loss_disc_real_2: 0.2657974064350128 (0.23043007403612137) | > loss_disc_real_3: 0.27172258496284485 (0.24440826972325644) | > loss_disc_real_4: 0.2426259070634842 (0.22088979184627533) | > loss_disc_real_5: 0.26519957184791565 (0.26521216498480904) | > loss_0: 2.6850664615631104 (2.4266929229100547) | > grad_norm_0: tensor(427.6852, device='cuda:0') (tensor(516.5784, device='cuda:0')) | > loss_gen: 1.8784523010253906 (2.3747873173819647) | > loss_kl: 0.8046343326568604 (0.9145516488287184) | > loss_feat: 1.0277903079986572 (5.847758458720313) | > loss_mel: 15.433144569396973 (22.454876793755425) | > loss_duration: 1.510088324546814 (1.5446212424172296) | > loss_1: 20.654109954833984 (33.136596043904625) | > grad_norm_1: tensor(8629.0723, device='cuda:0') (tensor(16750.0352, device='cuda:0')) | > current_lr_0: 0.00013101226265119283 | > current_lr_1: 0.00013101226265119283 | > step_time: 0.5528 (0.4978247218661838) | > loader_time: 0.0248 (0.020429743660820857)  --> TIME: 2023-10-20 04:18:45 -- STEP: 39/50 -- GLOBAL_STEP: 74190 | > loss_disc: 2.8896961212158203 (2.4482738390947008) | > loss_disc_real_0: 0.19915924966335297 (0.14073737433705574) | > loss_disc_real_1: 0.27724045515060425 (0.22479858975379896) | > loss_disc_real_2: 0.2228371948003769 (0.2287618132929007) | > loss_disc_real_3: 0.29558679461479187 (0.24387713426198715) | > loss_disc_real_4: 0.25862419605255127 (0.22826960453620324) | > loss_disc_real_5: 0.2730257213115692 (0.24438200938778046) | > loss_0: 2.8896961212158203 (2.4482738390947008) | > grad_norm_0: tensor(530.3215, device='cuda:0') (tensor(607.5893, device='cuda:0')) | > loss_gen: 1.7687206268310547 (2.3596383547171564) | > loss_kl: 0.755827009677887 (0.8935435337898059) | > loss_feat: 1.1133148670196533 (5.26244580707489) | > loss_mel: 8.653993606567383 (21.604525459118378) | > loss_duration: 1.5371651649475098 (1.5229274126199575) | > loss_1: 13.829021453857422 (31.643080479059456) | > grad_norm_1: tensor(23900.2148, device='cuda:0') (tensor(19912.7734, device='cuda:0')) | > current_lr_0: 0.00013101226265119283 | > current_lr_1: 0.00013101226265119283 | > step_time: 0.3842 (0.498627564845941) | > loader_time: 0.0023 (0.018405254070575416)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.203205108642578 (3.203205108642578) | > loss_disc_real_0: 0.4809710383415222 (0.4809710383415222) | > loss_disc_real_1: 0.29929643869400024 (0.29929643869400024) | > loss_disc_real_2: 0.2651074528694153 (0.2651074528694153) | > loss_disc_real_3: 0.22817161679267883 (0.22817161679267883) | > loss_disc_real_4: 0.1440984308719635 (0.1440984308719635) | > loss_disc_real_5: 0.26528650522232056 (0.26528650522232056) | > loss_0: 3.203205108642578 (3.203205108642578) | > loss_gen: 1.7521071434020996 (1.7521071434020996) | > loss_kl: 3.365133285522461 (3.365133285522461) | > loss_feat: 5.576928615570068 (5.576928615570068) | > loss_mel: 24.81155014038086 (24.81155014038086) | > loss_duration: 2.430109977722168 (2.430109977722168) | > loss_1: 37.935829162597656 (37.935829162597656)  --> STEP: 1 | > loss_disc: 1.769065499305725 (1.769065499305725) | > loss_disc_real_0: 0.07870491594076157 (0.07870491594076157) | > loss_disc_real_1: 0.2057224065065384 (0.2057224065065384) | > loss_disc_real_2: 0.10476576536893845 (0.10476576536893845) | > loss_disc_real_3: 0.10031376034021378 (0.10031376034021378) | > loss_disc_real_4: 0.0402010977268219 (0.0402010977268219) | > loss_disc_real_5: 0.08772394061088562 (0.08772394061088562) | > loss_0: 1.769065499305725 (1.769065499305725) | > loss_gen: 2.1078829765319824 (2.1078829765319824) | > loss_kl: 3.707618236541748 (3.707618236541748) | > loss_feat: 8.915811538696289 (8.915811538696289) | > loss_mel: 24.974361419677734 (24.974361419677734) | > loss_duration: 2.664480447769165 (2.664480447769165) | > loss_1: 42.37015914916992 (42.37015914916992)  --> STEP: 2 | > loss_disc: 3.499948024749756 (2.6345067620277405) | > loss_disc_real_0: 0.49392712116241455 (0.28631601855158806) | > loss_disc_real_1: 0.22577795386314392 (0.21575018018484116) | > loss_disc_real_2: 0.4632101058959961 (0.28398793563246727) | > loss_disc_real_3: 0.19384752213954926 (0.14708064123988152) | > loss_disc_real_4: 0.5177955627441406 (0.27899833023548126) | > loss_disc_real_5: 0.41714176535606384 (0.25243285298347473) | > loss_0: 3.499948024749756 (2.6345067620277405) | > loss_gen: 2.6585075855255127 (2.3831952810287476) | > loss_kl: 4.543325424194336 (4.125471830368042) | > loss_feat: 7.275407791137695 (8.095609664916992) | > loss_mel: 28.871145248413086 (26.92275333404541) | > loss_duration: 2.6227641105651855 (2.6436222791671753) | > loss_1: 45.971153259277344 (44.17065620422363)  --> STEP: 3 | > loss_disc: 2.6560003757476807 (2.641671299934387) | > loss_disc_real_0: 0.540149450302124 (0.3709271624684334) | > loss_disc_real_1: 0.22259201109409332 (0.2180307904879252) | > loss_disc_real_2: 0.2628369629383087 (0.2769376114010811) | > loss_disc_real_3: 0.2988716661930084 (0.19767764955759048) | > loss_disc_real_4: 0.20167315006256104 (0.2532232701778412) | > loss_disc_real_5: 0.2023034244775772 (0.23572304348150888) | > loss_0: 2.6560003757476807 (2.641671299934387) | > loss_gen: 2.808525562286377 (2.5249720414479575) | > loss_kl: 2.109549045562744 (3.453497568766276) | > loss_feat: 3.0711331367492676 (6.420784155527751) | > loss_mel: 24.29924964904785 (26.04825210571289) | > loss_duration: 2.608107805252075 (2.631784121195475) | > loss_1: 34.89656448364258 (41.07929229736328) --> EVAL PERFORMANCE | > avg_loader_time: 0.003362894058227539 (-0.02224842707316081) | > avg_loss_disc: 2.641671299934387 (+0.10101648171742772) | > avg_loss_disc_real_0: 0.3709271624684334 (+0.2563749725619952) | > avg_loss_disc_real_1: 0.2180307904879252 (+0.027915308872858674) | > avg_loss_disc_real_2: 0.2769376114010811 (+0.0711334670583407) | > avg_loss_disc_real_3: 0.19767764955759048 (-0.1401197041074435) | > avg_loss_disc_real_4: 0.2532232701778412 (-0.03919079899787903) | > avg_loss_disc_real_5: 0.23572304348150888 (+0.006139089663823427) | > avg_loss_0: 2.641671299934387 (+0.10101648171742772) | > avg_loss_gen: 2.5249720414479575 (+0.3835594654083252) | > avg_loss_kl: 3.453497568766276 (+0.07642710208892822) | > avg_loss_feat: 6.420784155527751 (+1.168198972940445) | > avg_loss_mel: 26.04825210571289 (+7.175691207249958) | > avg_loss_duration: 2.631784121195475 (-0.10953982671101903) | > avg_loss_1: 41.07929229736328 (+8.69433879852295)  > EPOCH: 424/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:19:02)   --> TIME: 2023-10-20 04:19:14 -- STEP: 19/50 -- GLOBAL_STEP: 74220 | > loss_disc: 3.0255110263824463 (2.5183068890320626) | > loss_disc_real_0: 0.40585392713546753 (0.18779851829535082) | > loss_disc_real_1: 0.22663524746894836 (0.21427740705640694) | > loss_disc_real_2: 0.4471912980079651 (0.22821711042993947) | > loss_disc_real_3: 0.39867299795150757 (0.22892661627970243) | > loss_disc_real_4: 0.3653336763381958 (0.22372985337125628) | > loss_disc_real_5: 0.32312533259391785 (0.2173603729982125) | > loss_0: 3.0255110263824463 (2.5183068890320626) | > grad_norm_0: tensor(403.1718, device='cuda:0') (tensor(655.3433, device='cuda:0')) | > loss_gen: 2.6880815029144287 (2.2713993348573385) | > loss_kl: 0.7463502287864685 (0.8013052297265906) | > loss_feat: 4.049664497375488 (4.746709075315218) | > loss_mel: 23.59010124206543 (21.160988070462878) | > loss_duration: 1.6235640048980713 (1.56074311231312) | > loss_1: 32.69776153564453 (30.541144396129408) | > grad_norm_1: tensor(7675.9692, device='cuda:0') (tensor(24608.9961, device='cuda:0')) | > current_lr_0: 0.00013088130769207926 | > current_lr_1: 0.00013088130769207926 | > step_time: 0.6916 (0.3795853665000514) | > loader_time: 0.0243 (0.0071473498093454465)  --> TIME: 2023-10-20 04:19:29 -- STEP: 49/50 -- GLOBAL_STEP: 74250 | > loss_disc: 1.5163538455963135 (2.5082636852653653) | > loss_disc_real_0: 0.12837384641170502 (0.1795159384456216) | > loss_disc_real_1: 0.12604500353336334 (0.23000558594963988) | > loss_disc_real_2: 0.0341348797082901 (0.22504902562620688) | > loss_disc_real_3: 0.10574488341808319 (0.23849644101395898) | > loss_disc_real_4: 0.07183028757572174 (0.24266362693921037) | > loss_disc_real_5: 0.03028402291238308 (0.2221884639667613) | > loss_0: 1.5163538455963135 (2.5082636852653653) | > grad_norm_0: tensor(377.2030, device='cuda:0') (tensor(582.3964, device='cuda:0')) | > loss_gen: 2.7445011138916016 (2.2931375795481164) | > loss_kl: 0.926300048828125 (0.813352954859028) | > loss_feat: 8.266847610473633 (4.996246623255464) | > loss_mel: 24.743579864501953 (20.50045027903149) | > loss_duration: 1.644598364830017 (1.5181366156558602) | > loss_1: 38.325828552246094 (30.121323906645483) | > grad_norm_1: tensor(38741.4102, device='cuda:0') (tensor(22472.0527, device='cuda:0')) | > current_lr_0: 0.00013088130769207926 | > current_lr_1: 0.00013088130769207926 | > step_time: 0.6339 (0.4269891417756374) | > loader_time: 0.3867 (0.017050796625565506)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.87105393409729 (2.87105393409729) | > loss_disc_real_0: 0.3773263394832611 (0.3773263394832611) | > loss_disc_real_1: 0.2748109698295593 (0.2748109698295593) | > loss_disc_real_2: 0.2791469991207123 (0.2791469991207123) | > loss_disc_real_3: 0.23614366352558136 (0.23614366352558136) | > loss_disc_real_4: 0.2704257667064667 (0.2704257667064667) | > loss_disc_real_5: 0.2530876398086548 (0.2530876398086548) | > loss_0: 2.87105393409729 (2.87105393409729) | > loss_gen: 2.1785666942596436 (2.1785666942596436) | > loss_kl: 3.591662883758545 (3.591662883758545) | > loss_feat: 2.0959556102752686 (2.0959556102752686) | > loss_mel: 19.99161148071289 (19.99161148071289) | > loss_duration: 2.5580852031707764 (2.5580852031707764) | > loss_1: 30.41588020324707 (30.41588020324707)  --> STEP: 1 | > loss_disc: 2.7347235679626465 (2.7347235679626465) | > loss_disc_real_0: 0.21014082431793213 (0.21014082431793213) | > loss_disc_real_1: 0.26527711749076843 (0.26527711749076843) | > loss_disc_real_2: 0.4197169542312622 (0.4197169542312622) | > loss_disc_real_3: 0.34846633672714233 (0.34846633672714233) | > loss_disc_real_4: 0.31817030906677246 (0.31817030906677246) | > loss_disc_real_5: 0.3941144049167633 (0.3941144049167633) | > loss_0: 2.7347235679626465 (2.7347235679626465) | > loss_gen: 2.8346714973449707 (2.8346714973449707) | > loss_kl: 4.748402118682861 (4.748402118682861) | > loss_feat: 6.949125289916992 (6.949125289916992) | > loss_mel: 23.955860137939453 (23.955860137939453) | > loss_duration: 2.676832437515259 (2.676832437515259) | > loss_1: 41.164894104003906 (41.164894104003906)  --> STEP: 2 | > loss_disc: 3.4963717460632324 (3.1155476570129395) | > loss_disc_real_0: 0.06497491151094437 (0.13755786791443825) | > loss_disc_real_1: 0.08963631838560104 (0.17745671793818474) | > loss_disc_real_2: 0.04324084147810936 (0.23147889785468578) | > loss_disc_real_3: 0.07094714045524597 (0.20970673859119415) | > loss_disc_real_4: 0.08155696094036102 (0.19986363500356674) | > loss_disc_real_5: 0.03764605149626732 (0.2158802282065153) | > loss_0: 3.4963717460632324 (3.1155476570129395) | > loss_gen: 0.9910422563552856 (1.9128568768501282) | > loss_kl: 4.167771816253662 (4.458086967468262) | > loss_feat: 11.849067687988281 (9.399096488952637) | > loss_mel: 26.882585525512695 (25.419222831726074) | > loss_duration: 2.7035253047943115 (2.690178871154785) | > loss_1: 46.593994140625 (43.87944412231445)  --> STEP: 3 | > loss_disc: 2.2528839111328125 (2.827993075052897) | > loss_disc_real_0: 0.2848016023635864 (0.18663911273082098) | > loss_disc_real_1: 0.30310702323913574 (0.21934015303850174) | > loss_disc_real_2: 0.26026588678359985 (0.24107456083099046) | > loss_disc_real_3: 0.2774736285209656 (0.23229570190111795) | > loss_disc_real_4: 0.13799744844436646 (0.17924157281716666) | > loss_disc_real_5: 0.1824413239955902 (0.2047339268028736) | > loss_0: 2.2528839111328125 (2.827993075052897) | > loss_gen: 2.673349380493164 (2.1663543780644736) | > loss_kl: 2.325854539871216 (3.747342824935913) | > loss_feat: 6.403379440307617 (8.400524139404297) | > loss_mel: 22.35332679748535 (24.397257486979168) | > loss_duration: 2.591862440109253 (2.657406727472941) | > loss_1: 36.347774505615234 (41.36888758341471) --> EVAL PERFORMANCE | > avg_loader_time: 0.006311337153116862 (+0.002948443094889323) | > avg_loss_disc: 2.827993075052897 (+0.18632177511850978) | > avg_loss_disc_real_0: 0.18663911273082098 (-0.1842880497376124) | > avg_loss_disc_real_1: 0.21934015303850174 (+0.0013093625505765372) | > avg_loss_disc_real_2: 0.24107456083099046 (-0.03586305057009062) | > avg_loss_disc_real_3: 0.23229570190111795 (+0.03461805234352747) | > avg_loss_disc_real_4: 0.17924157281716666 (-0.07398169736067453) | > avg_loss_disc_real_5: 0.2047339268028736 (-0.03098911667863527) | > avg_loss_0: 2.827993075052897 (+0.18632177511850978) | > avg_loss_gen: 2.1663543780644736 (-0.3586176633834839) | > avg_loss_kl: 3.747342824935913 (+0.2938452561696372) | > avg_loss_feat: 8.400524139404297 (+1.979739983876546) | > avg_loss_mel: 24.397257486979168 (-1.6509946187337228) | > avg_loss_duration: 2.657406727472941 (+0.02562260627746582) | > avg_loss_1: 41.36888758341471 (+0.2895952860514299)  > EPOCH: 425/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:19:39)   --> TIME: 2023-10-20 04:19:59 -- STEP: 29/50 -- GLOBAL_STEP: 74280 | > loss_disc: 2.469245433807373 (2.4127057091943156) | > loss_disc_real_0: 0.09236864745616913 (0.14190558228513284) | > loss_disc_real_1: 0.1851436048746109 (0.2042677921467814) | > loss_disc_real_2: 0.23457378149032593 (0.21413932291084323) | > loss_disc_real_3: 0.23826982080936432 (0.21939311189384297) | > loss_disc_real_4: 0.4406907856464386 (0.23578905494048677) | > loss_disc_real_5: 0.48942095041275024 (0.2507459309337468) | > loss_0: 2.469245433807373 (2.4127057091943156) | > grad_norm_0: tensor(520.0643, device='cuda:0') (tensor(644.4081, device='cuda:0')) | > loss_gen: 2.807556629180908 (2.4016243096055656) | > loss_kl: 0.9263378381729126 (0.8834127598795397) | > loss_feat: 6.167325496673584 (5.763269627145652) | > loss_mel: 21.62372589111328 (23.171953801451057) | > loss_duration: 1.484658122062683 (1.5252196459934628) | > loss_1: 33.00960159301758 (33.745480372987956) | > grad_norm_1: tensor(19219.4258, device='cuda:0') (tensor(22862.8066, device='cuda:0')) | > current_lr_0: 0.00013075048363064636 | > current_lr_1: 0.00013075048363064636 | > step_time: 0.697 (0.5259573952905066) | > loader_time: 0.023 (0.01983358942229172)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7714712619781494 (2.7714712619781494) | > loss_disc_real_0: 0.3079305589199066 (0.3079305589199066) | > loss_disc_real_1: 0.224729523062706 (0.224729523062706) | > loss_disc_real_2: 0.27454695105552673 (0.27454695105552673) | > loss_disc_real_3: 0.40661272406578064 (0.40661272406578064) | > loss_disc_real_4: 0.5039739608764648 (0.5039739608764648) | > loss_disc_real_5: 0.21591824293136597 (0.21591824293136597) | > loss_0: 2.7714712619781494 (2.7714712619781494) | > loss_gen: 2.666691303253174 (2.666691303253174) | > loss_kl: 3.315613031387329 (3.315613031387329) | > loss_feat: 5.504295349121094 (5.504295349121094) | > loss_mel: 20.812183380126953 (20.812183380126953) | > loss_duration: 2.578336238861084 (2.578336238861084) | > loss_1: 34.87711715698242 (34.87711715698242)  --> STEP: 1 | > loss_disc: 2.8471579551696777 (2.8471579551696777) | > loss_disc_real_0: 0.3224315941333771 (0.3224315941333771) | > loss_disc_real_1: 0.30941808223724365 (0.30941808223724365) | > loss_disc_real_2: 0.2603543698787689 (0.2603543698787689) | > loss_disc_real_3: 0.31600794196128845 (0.31600794196128845) | > loss_disc_real_4: 0.3995477855205536 (0.3995477855205536) | > loss_disc_real_5: 0.3678210377693176 (0.3678210377693176) | > loss_0: 2.8471579551696777 (2.8471579551696777) | > loss_gen: 2.6221821308135986 (2.6221821308135986) | > loss_kl: 3.6382102966308594 (3.6382102966308594) | > loss_feat: 5.510669231414795 (5.510669231414795) | > loss_mel: 26.912973403930664 (26.912973403930664) | > loss_duration: 2.7849318981170654 (2.7849318981170654) | > loss_1: 41.468963623046875 (41.468963623046875)  --> STEP: 2 | > loss_disc: 2.619445323944092 (2.7333016395568848) | > loss_disc_real_0: 0.2361876368522644 (0.27930961549282074) | > loss_disc_real_1: 0.3680517375469208 (0.3387349098920822) | > loss_disc_real_2: 0.2510053813457489 (0.2556798756122589) | > loss_disc_real_3: 0.34480127692222595 (0.3304046094417572) | > loss_disc_real_4: 0.2704521715641022 (0.3349999785423279) | > loss_disc_real_5: 0.3209248185157776 (0.3443729281425476) | > loss_0: 2.619445323944092 (2.7333016395568848) | > loss_gen: 2.814953565597534 (2.7185678482055664) | > loss_kl: 4.439418792724609 (4.038814544677734) | > loss_feat: 4.036670684814453 (4.773669958114624) | > loss_mel: 27.57910919189453 (27.246041297912598) | > loss_duration: 2.765509843826294 (2.7752208709716797) | > loss_1: 41.63566207885742 (41.55231285095215)  --> STEP: 3 | > loss_disc: 2.732966661453247 (2.7331899801890054) | > loss_disc_real_0: 0.4289221167564392 (0.32918044924736023) | > loss_disc_real_1: 0.27851948142051697 (0.3186631004015605) | > loss_disc_real_2: 0.20684459805488586 (0.23940144975980124) | > loss_disc_real_3: 0.3847014307975769 (0.3485035498936971) | > loss_disc_real_4: 0.20303551852703094 (0.29101182520389557) | > loss_disc_real_5: 0.29454508423805237 (0.3277636468410492) | > loss_0: 2.732966661453247 (2.7331899801890054) | > loss_gen: 2.634145736694336 (2.6904271443684897) | > loss_kl: 1.7713145017623901 (3.282981197039286) | > loss_feat: 4.103456020355225 (4.550265312194824) | > loss_mel: 22.302234649658203 (25.598105748494465) | > loss_duration: 2.620591163635254 (2.723677635192871) | > loss_1: 33.43174362182617 (38.84545644124349) --> EVAL PERFORMANCE | > avg_loader_time: 0.02382659912109375 (+0.017515261967976887) | > avg_loss_disc: 2.7331899801890054 (-0.0948030948638916) | > avg_loss_disc_real_0: 0.32918044924736023 (+0.14254133651653925) | > avg_loss_disc_real_1: 0.3186631004015605 (+0.09932294736305874) | > avg_loss_disc_real_2: 0.23940144975980124 (-0.001673111071189226) | > avg_loss_disc_real_3: 0.3485035498936971 (+0.11620784799257913) | > avg_loss_disc_real_4: 0.29101182520389557 (+0.11177025238672891) | > avg_loss_disc_real_5: 0.3277636468410492 (+0.12302972003817558) | > avg_loss_0: 2.7331899801890054 (-0.0948030948638916) | > avg_loss_gen: 2.6904271443684897 (+0.5240727663040161) | > avg_loss_kl: 3.282981197039286 (-0.46436162789662694) | > avg_loss_feat: 4.550265312194824 (-3.8502588272094727) | > avg_loss_mel: 25.598105748494465 (+1.200848261515297) | > avg_loss_duration: 2.723677635192871 (+0.06627090771993016) | > avg_loss_1: 38.84545644124349 (-2.523431142171219)  > EPOCH: 426/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:20:20)   --> TIME: 2023-10-20 04:20:29 -- STEP: 9/50 -- GLOBAL_STEP: 74310 | > loss_disc: 2.392141103744507 (2.3837157752778797) | > loss_disc_real_0: 0.10324234515428543 (0.15257376577291223) | > loss_disc_real_1: 0.2984439730644226 (0.23627063756187758) | > loss_disc_real_2: 0.5230500102043152 (0.28578922483656144) | > loss_disc_real_3: 0.30633556842803955 (0.24606994291146597) | > loss_disc_real_4: 0.2851608693599701 (0.2666130161119832) | > loss_disc_real_5: 0.2210644781589508 (0.22780620141161811) | > loss_0: 2.392141103744507 (2.3837157752778797) | > grad_norm_0: tensor(269.9170, device='cuda:0') (tensor(497.2584, device='cuda:0')) | > loss_gen: 2.8928980827331543 (2.596311026149326) | > loss_kl: 0.2521044909954071 (0.8989240626494089) | > loss_feat: 4.901998996734619 (6.650964922375149) | > loss_mel: 23.54794692993164 (22.03366568353441) | > loss_duration: 1.4907634258270264 (1.5007920662562053) | > loss_1: 33.08571243286133 (33.68065823449029) | > grad_norm_1: tensor(2711.8691, device='cuda:0') (tensor(26373.3066, device='cuda:0')) | > current_lr_0: 0.00013061979033605369 | > current_lr_1: 0.00013061979033605369 | > step_time: 0.6919 (0.5490394698248969) | > loader_time: 0.0226 (0.019418133629692927)  --> TIME: 2023-10-20 04:20:44 -- STEP: 39/50 -- GLOBAL_STEP: 74340 | > loss_disc: 2.7820746898651123 (2.5236800832626147) | > loss_disc_real_0: 0.13917317986488342 (0.13052165407973987) | > loss_disc_real_1: 0.2626543939113617 (0.22406849150474256) | > loss_disc_real_2: 0.21439659595489502 (0.26229472420154476) | > loss_disc_real_3: 0.2557820975780487 (0.2558038532256316) | > loss_disc_real_4: 0.28882765769958496 (0.2628679579267135) | > loss_disc_real_5: 0.274347722530365 (0.2459578241388767) | > loss_0: 2.7820746898651123 (2.5236800832626147) | > grad_norm_0: tensor(594.3143, device='cuda:0') (tensor(515.5943, device='cuda:0')) | > loss_gen: 1.7537630796432495 (2.390075035584278) | > loss_kl: 0.37390583753585815 (0.8970518501905295) | > loss_feat: 0.7532436847686768 (5.641391728073358) | > loss_mel: 9.8878755569458 (22.510363425963963) | > loss_duration: 1.5535396337509155 (1.5051132837931316) | > loss_1: 14.322327613830566 (32.9439955735818) | > grad_norm_1: tensor(11827.6230, device='cuda:0') (tensor(21181.9609, device='cuda:0')) | > current_lr_0: 0.00013061979033605369 | > current_lr_1: 0.00013061979033605369 | > step_time: 0.3161 (0.5068392753601072) | > loader_time: 0.0254 (0.020256696603237055)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4731781482696533 (2.4731781482696533) | > loss_disc_real_0: 0.10758036375045776 (0.10758036375045776) | > loss_disc_real_1: 0.2941112518310547 (0.2941112518310547) | > loss_disc_real_2: 0.25341761112213135 (0.25341761112213135) | > loss_disc_real_3: 0.2693326771259308 (0.2693326771259308) | > loss_disc_real_4: 0.20736414194107056 (0.20736414194107056) | > loss_disc_real_5: 0.06604943424463272 (0.06604943424463272) | > loss_0: 2.4731781482696533 (2.4731781482696533) | > loss_gen: 2.0193963050842285 (2.0193963050842285) | > loss_kl: 2.8722589015960693 (2.8722589015960693) | > loss_feat: 5.356405258178711 (5.356405258178711) | > loss_mel: 24.35142707824707 (24.35142707824707) | > loss_duration: 2.5656590461730957 (2.5656590461730957) | > loss_1: 37.1651496887207 (37.1651496887207)  --> STEP: 1 | > loss_disc: 1.367329478263855 (1.367329478263855) | > loss_disc_real_0: 0.15077413618564606 (0.15077413618564606) | > loss_disc_real_1: 0.11329300701618195 (0.11329300701618195) | > loss_disc_real_2: 0.08173339813947678 (0.08173339813947678) | > loss_disc_real_3: 0.1120990440249443 (0.1120990440249443) | > loss_disc_real_4: 0.10652074217796326 (0.10652074217796326) | > loss_disc_real_5: 0.026615219190716743 (0.026615219190716743) | > loss_0: 1.367329478263855 (1.367329478263855) | > loss_gen: 2.8756918907165527 (2.8756918907165527) | > loss_kl: 3.728224992752075 (3.728224992752075) | > loss_feat: 10.922309875488281 (10.922309875488281) | > loss_mel: 28.657878875732422 (28.657878875732422) | > loss_duration: 2.7483127117156982 (2.7483127117156982) | > loss_1: 48.93241882324219 (48.93241882324219)  --> STEP: 2 | > loss_disc: 2.109100580215454 (1.7382150292396545) | > loss_disc_real_0: 0.0888819694519043 (0.11982805281877518) | > loss_disc_real_1: 0.17782577872276306 (0.1455593928694725) | > loss_disc_real_2: 0.09190555661916733 (0.08681947737932205) | > loss_disc_real_3: 0.10856632143259048 (0.1103326827287674) | > loss_disc_real_4: 0.06313656270503998 (0.08482865244150162) | > loss_disc_real_5: 0.09902305155992508 (0.06281913537532091) | > loss_0: 2.109100580215454 (1.7382150292396545) | > loss_gen: 2.122729778289795 (2.499210834503174) | > loss_kl: 3.7954304218292236 (3.7618277072906494) | > loss_feat: 9.108454704284668 (10.015382289886475) | > loss_mel: 23.913644790649414 (26.285761833190918) | > loss_duration: 2.649961471557617 (2.6991370916366577) | > loss_1: 41.59021759033203 (45.26131820678711)  --> STEP: 3 | > loss_disc: 2.6935465335845947 (2.0566588640213013) | > loss_disc_real_0: 0.15381941199302673 (0.13115850587685904) | > loss_disc_real_1: 0.30617234110832214 (0.1990970422824224) | > loss_disc_real_2: 0.28086963295936584 (0.15150286257266998) | > loss_disc_real_3: 0.22238261997699738 (0.1476826618115107) | > loss_disc_real_4: 0.2907446026802063 (0.15346730252106985) | > loss_disc_real_5: 0.31815579533576965 (0.14793135536213717) | > loss_0: 2.6935465335845947 (2.0566588640213013) | > loss_gen: 2.1474945545196533 (2.381972074508667) | > loss_kl: 1.8309078216552734 (3.118187745412191) | > loss_feat: 3.641594171524048 (7.890786250432332) | > loss_mel: 25.271896362304688 (25.94780667622884) | > loss_duration: 2.5627496242523193 (2.653674602508545) | > loss_1: 35.45463943481445 (41.992425282796226) --> EVAL PERFORMANCE | > avg_loader_time: 0.006900469462076823 (-0.016926129659016926) | > avg_loss_disc: 2.0566588640213013 (-0.6765311161677041) | > avg_loss_disc_real_0: 0.13115850587685904 (-0.1980219433705012) | > avg_loss_disc_real_1: 0.1990970422824224 (-0.11956605811913809) | > avg_loss_disc_real_2: 0.15150286257266998 (-0.08789858718713126) | > avg_loss_disc_real_3: 0.1476826618115107 (-0.20082088808218637) | > avg_loss_disc_real_4: 0.15346730252106985 (-0.13754452268282572) | > avg_loss_disc_real_5: 0.14793135536213717 (-0.17983229147891203) | > avg_loss_0: 2.0566588640213013 (-0.6765311161677041) | > avg_loss_gen: 2.381972074508667 (-0.30845506985982274) | > avg_loss_kl: 3.118187745412191 (-0.16479345162709524) | > avg_loss_feat: 7.890786250432332 (+3.340520938237508) | > avg_loss_mel: 25.94780667622884 (+0.349700927734375) | > avg_loss_duration: 2.653674602508545 (-0.07000303268432617) | > avg_loss_1: 41.992425282796226 (+3.1469688415527344)  > EPOCH: 427/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:21:01)   --> TIME: 2023-10-20 04:21:14 -- STEP: 19/50 -- GLOBAL_STEP: 74370 | > loss_disc: 2.6860511302948 (2.403388450020238) | > loss_disc_real_0: 0.2220505326986313 (0.17463283456469836) | > loss_disc_real_1: 0.30207517743110657 (0.23208809447915932) | > loss_disc_real_2: 0.2955532968044281 (0.223093245374529) | > loss_disc_real_3: 0.4077909588813782 (0.2176168303152448) | > loss_disc_real_4: 0.27917930483818054 (0.20929036858050445) | > loss_disc_real_5: 0.20940056443214417 (0.22863068362992062) | > loss_0: 2.6860511302948 (2.403388450020238) | > grad_norm_0: tensor(484.9738, device='cuda:0') (tensor(682.2473, device='cuda:0')) | > loss_gen: 2.3155527114868164 (2.3851691986385144) | > loss_kl: 1.1188876628875732 (0.8385822059292543) | > loss_feat: 3.7614943981170654 (5.768273894724093) | > loss_mel: 21.968585968017578 (23.148454992394697) | > loss_duration: 1.661908745765686 (1.54763064258977) | > loss_1: 30.82642936706543 (33.68811140562359) | > grad_norm_1: tensor(4089.7322, device='cuda:0') (tensor(22408.5059, device='cuda:0')) | > current_lr_0: 0.00013048922767759153 | > current_lr_1: 0.00013048922767759153 | > step_time: 0.309 (0.3866585179379112) | > loader_time: 0.0019 (0.009055551729704204)  --> TIME: 2023-10-20 04:21:29 -- STEP: 49/50 -- GLOBAL_STEP: 74400 | > loss_disc: 2.1547107696533203 (2.496156325145644) | > loss_disc_real_0: 0.15298643708229065 (0.15870466630677788) | > loss_disc_real_1: 0.30601832270622253 (0.23411564049976213) | > loss_disc_real_2: 0.27241426706314087 (0.2283058730999426) | > loss_disc_real_3: 0.3087286651134491 (0.22621547685441923) | > loss_disc_real_4: 0.14590001106262207 (0.2223833559879235) | > loss_disc_real_5: 0.10643325001001358 (0.23479468227193065) | > loss_0: 2.1547107696533203 (2.496156325145644) | > grad_norm_0: tensor(707.2189, device='cuda:0') (tensor(663.0422, device='cuda:0')) | > loss_gen: 2.6314170360565186 (2.241706585397526) | > loss_kl: 0.5350464582443237 (0.8224610762328518) | > loss_feat: 4.699470520019531 (4.913165084865629) | > loss_mel: 23.534921646118164 (21.641921028798944) | > loss_duration: 1.6265960931777954 (1.510570202554975) | > loss_1: 33.02745056152344 (31.12982415179817) | > grad_norm_1: tensor(26322.6406, device='cuda:0') (tensor(19087.2910, device='cuda:0')) | > current_lr_0: 0.00013048922767759153 | > current_lr_1: 0.00013048922767759153 | > step_time: 0.3089 (0.43678073980370347) | > loader_time: 0.4562 (0.01976034592609016)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.651167154312134 (2.651167154312134) | > loss_disc_real_0: 0.11605870723724365 (0.11605870723724365) | > loss_disc_real_1: 0.2754952907562256 (0.2754952907562256) | > loss_disc_real_2: 0.2664414644241333 (0.2664414644241333) | > loss_disc_real_3: 0.33204540610313416 (0.33204540610313416) | > loss_disc_real_4: 0.16211563348770142 (0.16211563348770142) | > loss_disc_real_5: 0.14911620318889618 (0.14911620318889618) | > loss_0: 2.651167154312134 (2.651167154312134) | > loss_gen: 1.7463583946228027 (1.7463583946228027) | > loss_kl: 3.0637803077697754 (3.0637803077697754) | > loss_feat: 2.256497859954834 (2.256497859954834) | > loss_mel: 24.615461349487305 (24.615461349487305) | > loss_duration: 2.4453113079071045 (2.4453113079071045) | > loss_1: 34.127410888671875 (34.127410888671875)  --> STEP: 1 | > loss_disc: 2.3060832023620605 (2.3060832023620605) | > loss_disc_real_0: 0.20487014949321747 (0.20487014949321747) | > loss_disc_real_1: 0.3149419128894806 (0.3149419128894806) | > loss_disc_real_2: 0.23248673975467682 (0.23248673975467682) | > loss_disc_real_3: 0.4163949191570282 (0.4163949191570282) | > loss_disc_real_4: 0.14129243791103363 (0.14129243791103363) | > loss_disc_real_5: 0.21298997104167938 (0.21298997104167938) | > loss_0: 2.3060832023620605 (2.3060832023620605) | > loss_gen: 2.6719446182250977 (2.6719446182250977) | > loss_kl: 3.704082727432251 (3.704082727432251) | > loss_feat: 4.360042095184326 (4.360042095184326) | > loss_mel: 23.994524002075195 (23.994524002075195) | > loss_duration: 2.5934107303619385 (2.5934107303619385) | > loss_1: 37.32400131225586 (37.32400131225586)  --> STEP: 2 | > loss_disc: 2.680572271347046 (2.4933277368545532) | > loss_disc_real_0: 0.24375911056995392 (0.2243146300315857) | > loss_disc_real_1: 0.21445636451244354 (0.26469913870096207) | > loss_disc_real_2: 0.344363272190094 (0.2884250059723854) | > loss_disc_real_3: 0.31551966071128845 (0.3659572899341583) | > loss_disc_real_4: 0.2801068127155304 (0.210699625313282) | > loss_disc_real_5: 0.34990760684013367 (0.2814487889409065) | > loss_0: 2.680572271347046 (2.4933277368545532) | > loss_gen: 2.411468744277954 (2.541706681251526) | > loss_kl: 4.495270252227783 (4.099676489830017) | > loss_feat: 4.759501934051514 (4.55977201461792) | > loss_mel: 28.896331787109375 (26.445427894592285) | > loss_duration: 2.704824447631836 (2.649117588996887) | > loss_1: 43.26739501953125 (40.295698165893555)  --> STEP: 3 | > loss_disc: 3.422245502471924 (2.8029669920603433) | > loss_disc_real_0: 0.29033204913139343 (0.24632043639818826) | > loss_disc_real_1: 0.44053494930267334 (0.32331107556819916) | > loss_disc_real_2: 0.3935070037841797 (0.32345233857631683) | > loss_disc_real_3: 0.5929107666015625 (0.44160844882329303) | > loss_disc_real_4: 0.2599731981754303 (0.22712414960066477) | > loss_disc_real_5: 0.4494817554950714 (0.3374597777922948) | > loss_0: 3.422245502471924 (2.8029669920603433) | > loss_gen: 2.949394464492798 (2.6776026089986167) | > loss_kl: 2.1553640365600586 (3.4515723387400308) | > loss_feat: 5.05131721496582 (4.723620414733887) | > loss_mel: 26.360414505004883 (26.417090098063152) | > loss_duration: 2.58500337600708 (2.6277461846669516) | > loss_1: 39.10149383544922 (39.897630055745445) --> EVAL PERFORMANCE | > avg_loader_time: 0.007615009943644206 (+0.0007145404815673828) | > avg_loss_disc: 2.8029669920603433 (+0.746308128039042) | > avg_loss_disc_real_0: 0.24632043639818826 (+0.11516193052132923) | > avg_loss_disc_real_1: 0.32331107556819916 (+0.12421403328577676) | > avg_loss_disc_real_2: 0.32345233857631683 (+0.17194947600364685) | > avg_loss_disc_real_3: 0.44160844882329303 (+0.2939257870117823) | > avg_loss_disc_real_4: 0.22712414960066477 (+0.07365684707959491) | > avg_loss_disc_real_5: 0.3374597777922948 (+0.18952842243015763) | > avg_loss_0: 2.8029669920603433 (+0.746308128039042) | > avg_loss_gen: 2.6776026089986167 (+0.2956305344899497) | > avg_loss_kl: 3.4515723387400308 (+0.3333845933278399) | > avg_loss_feat: 4.723620414733887 (-3.1671658356984453) | > avg_loss_mel: 26.417090098063152 (+0.46928342183431226) | > avg_loss_duration: 2.6277461846669516 (-0.025928417841593276) | > avg_loss_1: 39.897630055745445 (-2.0947952270507812)  > EPOCH: 428/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:21:40)   --> TIME: 2023-10-20 04:21:58 -- STEP: 29/50 -- GLOBAL_STEP: 74430 | > loss_disc: 1.8974812030792236 (2.4552360485339983) | > loss_disc_real_0: 0.017451602965593338 (0.12260666181301245) | > loss_disc_real_1: 0.22635209560394287 (0.2153878328872138) | > loss_disc_real_2: 0.25831466913223267 (0.21290437671644935) | > loss_disc_real_3: 0.27761906385421753 (0.25317618019621946) | > loss_disc_real_4: 0.22271108627319336 (0.22461066407890157) | > loss_disc_real_5: 0.10097406059503555 (0.22706677167323128) | > loss_0: 1.8974812030792236 (2.4552360485339983) | > grad_norm_0: tensor(524.7476, device='cuda:0') (tensor(554.8608, device='cuda:0')) | > loss_gen: 3.176603317260742 (2.293184140632893) | > loss_kl: 0.8789420127868652 (0.8714700895522175) | > loss_feat: 7.312923431396484 (5.466533166581188) | > loss_mel: 24.831872940063477 (22.195952596335573) | > loss_duration: 1.4257720708847046 (1.5227474796360936) | > loss_1: 37.62611389160156 (32.349887223079286) | > grad_norm_1: tensor(41955.2695, device='cuda:0') (tensor(26533.6230, device='cuda:0')) | > current_lr_0: 0.000130358795524681 | > current_lr_1: 0.000130358795524681 | > step_time: 0.2503 (0.48345731866770775) | > loader_time: 0.0021 (0.020404371721991176)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0528550148010254 (2.0528550148010254) | > loss_disc_real_0: 0.24916590750217438 (0.24916590750217438) | > loss_disc_real_1: 0.15125082433223724 (0.15125082433223724) | > loss_disc_real_2: 0.28871938586235046 (0.28871938586235046) | > loss_disc_real_3: 0.1667594462633133 (0.1667594462633133) | > loss_disc_real_4: 0.21845439076423645 (0.21845439076423645) | > loss_disc_real_5: 0.0898195430636406 (0.0898195430636406) | > loss_0: 2.0528550148010254 (2.0528550148010254) | > loss_gen: 3.3858861923217773 (3.3858861923217773) | > loss_kl: 3.5228285789489746 (3.5228285789489746) | > loss_feat: 10.720943450927734 (10.720943450927734) | > loss_mel: 25.756847381591797 (25.756847381591797) | > loss_duration: 2.4804365634918213 (2.4804365634918213) | > loss_1: 45.866943359375 (45.866943359375)  --> STEP: 1 | > loss_disc: 2.7630836963653564 (2.7630836963653564) | > loss_disc_real_0: 0.12456855922937393 (0.12456855922937393) | > loss_disc_real_1: 0.27834782004356384 (0.27834782004356384) | > loss_disc_real_2: 0.31822916865348816 (0.31822916865348816) | > loss_disc_real_3: 0.3363317847251892 (0.3363317847251892) | > loss_disc_real_4: 0.30417197942733765 (0.30417197942733765) | > loss_disc_real_5: 0.2037416249513626 (0.2037416249513626) | > loss_0: 2.7630836963653564 (2.7630836963653564) | > loss_gen: 2.1385366916656494 (2.1385366916656494) | > loss_kl: 3.040329694747925 (3.040329694747925) | > loss_feat: 3.4708096981048584 (3.4708096981048584) | > loss_mel: 24.997512817382812 (24.997512817382812) | > loss_duration: 2.731335163116455 (2.731335163116455) | > loss_1: 36.37852478027344 (36.37852478027344)  --> STEP: 2 | > loss_disc: 2.9871039390563965 (2.8750938177108765) | > loss_disc_real_0: 0.19236639142036438 (0.15846747532486916) | > loss_disc_real_1: 0.234686478972435 (0.2565171495079994) | > loss_disc_real_2: 0.14977692067623138 (0.23400304466485977) | > loss_disc_real_3: 0.2428937405347824 (0.2896127626299858) | > loss_disc_real_4: 0.2628440856933594 (0.2835080325603485) | > loss_disc_real_5: 0.23050612211227417 (0.2171238735318184) | > loss_0: 2.9871039390563965 (2.8750938177108765) | > loss_gen: 1.38307785987854 (1.7608072757720947) | > loss_kl: 4.845666885375977 (3.9429982900619507) | > loss_feat: 0.4297637641429901 (1.9502867311239243) | > loss_mel: 17.6568603515625 (21.327186584472656) | > loss_duration: 2.6829917430877686 (2.707163453102112) | > loss_1: 26.99835968017578 (31.68844223022461)  --> STEP: 3 | > loss_disc: 2.3683435916900635 (2.706177075703939) | > loss_disc_real_0: 0.1360321193933487 (0.15098902334769568) | > loss_disc_real_1: 0.19341138005256653 (0.23548189302285513) | > loss_disc_real_2: 0.11683208495378494 (0.1949460580945015) | > loss_disc_real_3: 0.19705131649971008 (0.25875894725322723) | > loss_disc_real_4: 0.14528435468673706 (0.23743347326914468) | > loss_disc_real_5: 0.08164750784635544 (0.1719650849699974) | > loss_0: 2.3683435916900635 (2.706177075703939) | > loss_gen: 1.8581383228302002 (1.7932509581247966) | > loss_kl: 1.9147807359695435 (3.2669257720311484) | > loss_feat: 5.055259704589844 (2.9852777222792306) | > loss_mel: 13.038087844848633 (18.56415367126465) | > loss_duration: 2.57936429977417 (2.6645637353261313) | > loss_1: 24.445632934570312 (29.27417246500651) --> EVAL PERFORMANCE | > avg_loader_time: 0.013721148173014322 (+0.006106138229370116) | > avg_loss_disc: 2.706177075703939 (-0.09678991635640433) | > avg_loss_disc_real_0: 0.15098902334769568 (-0.09533141305049259) | > avg_loss_disc_real_1: 0.23548189302285513 (-0.08782918254534403) | > avg_loss_disc_real_2: 0.1949460580945015 (-0.12850628048181534) | > avg_loss_disc_real_3: 0.25875894725322723 (-0.1828495015700658) | > avg_loss_disc_real_4: 0.23743347326914468 (+0.01030932366847992) | > avg_loss_disc_real_5: 0.1719650849699974 (-0.1654946928222974) | > avg_loss_0: 2.706177075703939 (-0.09678991635640433) | > avg_loss_gen: 1.7932509581247966 (-0.8843516508738201) | > avg_loss_kl: 3.2669257720311484 (-0.18464656670888235) | > avg_loss_feat: 2.9852777222792306 (-1.7383426924546561) | > avg_loss_mel: 18.56415367126465 (-7.852936426798504) | > avg_loss_duration: 2.6645637353261313 (+0.03681755065917969) | > avg_loss_1: 29.27417246500651 (-10.623457590738933)  > EPOCH: 429/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:22:19)   --> TIME: 2023-10-20 04:22:28 -- STEP: 9/50 -- GLOBAL_STEP: 74460 | > loss_disc: 2.9200026988983154 (2.5080308384365506) | > loss_disc_real_0: 0.1856648176908493 (0.12281041344006856) | > loss_disc_real_1: 0.27737167477607727 (0.2744158481558164) | > loss_disc_real_2: 0.28530386090278625 (0.25950517339838874) | > loss_disc_real_3: 0.26980456709861755 (0.24940887755817837) | > loss_disc_real_4: 0.25341877341270447 (0.21790788488255608) | > loss_disc_real_5: 0.29501965641975403 (0.21663391672902638) | > loss_0: 2.9200026988983154 (2.5080308384365506) | > grad_norm_0: tensor(428.8813, device='cuda:0') (tensor(652.9839, device='cuda:0')) | > loss_gen: 1.666385531425476 (2.2878724998897977) | > loss_kl: 1.1050037145614624 (0.8555262188116709) | > loss_feat: 0.3262903690338135 (3.8679405219025083) | > loss_mel: 10.261163711547852 (17.28104289372762) | > loss_duration: 1.4639652967453003 (1.5439549419615004) | > loss_1: 14.822809219360352 (25.836336506737602) | > grad_norm_1: tensor(11814.3750, device='cuda:0') (tensor(20880.6836, device='cuda:0')) | > current_lr_0: 0.0001302284937468736 | > current_lr_1: 0.0001302284937468736 | > step_time: 0.6263 (0.5281221336788602) | > loader_time: 0.0128 (0.019827259911431208)  --> TIME: 2023-10-20 04:22:43 -- STEP: 39/50 -- GLOBAL_STEP: 74490 | > loss_disc: 2.945648431777954 (2.5458408471865535) | > loss_disc_real_0: 0.2418336570262909 (0.14445393176701588) | > loss_disc_real_1: 0.2651098072528839 (0.231404796624795) | > loss_disc_real_2: 0.2633262872695923 (0.2238740144440761) | > loss_disc_real_3: 0.264324426651001 (0.24162323944843733) | > loss_disc_real_4: 0.23608435690402985 (0.23190560822303483) | > loss_disc_real_5: 0.28713542222976685 (0.24033551882856932) | > loss_0: 2.945648431777954 (2.5458408471865535) | > grad_norm_0: tensor(911.4053, device='cuda:0') (tensor(801.3143, device='cuda:0')) | > loss_gen: 1.625033974647522 (2.275540715608842) | > loss_kl: 0.1472959965467453 (0.8379917156954224) | > loss_feat: 0.3171372413635254 (4.830386842290561) | > loss_mel: 14.942327499389648 (20.68389690227997) | > loss_duration: 1.5851492881774902 (1.5314388519678361) | > loss_1: 18.616945266723633 (30.15925491773165) | > grad_norm_1: tensor(3624.2222, device='cuda:0') (tensor(20425.1328, device='cuda:0')) | > current_lr_0: 0.0001302284937468736 | > current_lr_1: 0.0001302284937468736 | > step_time: 0.3074 (0.4939226737389197) | > loader_time: 0.0251 (0.019082112190050956)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.306044101715088 (2.306044101715088) | > loss_disc_real_0: 0.15962548553943634 (0.15962548553943634) | > loss_disc_real_1: 0.24152378737926483 (0.24152378737926483) | > loss_disc_real_2: 0.21832028031349182 (0.21832028031349182) | > loss_disc_real_3: 0.20159563422203064 (0.20159563422203064) | > loss_disc_real_4: 0.2118077278137207 (0.2118077278137207) | > loss_disc_real_5: 0.2617684006690979 (0.2617684006690979) | > loss_0: 2.306044101715088 (2.306044101715088) | > loss_gen: 2.2797951698303223 (2.2797951698303223) | > loss_kl: 4.223171234130859 (4.223171234130859) | > loss_feat: 4.326077938079834 (4.326077938079834) | > loss_mel: 22.139936447143555 (22.139936447143555) | > loss_duration: 2.653722047805786 (2.653722047805786) | > loss_1: 35.622703552246094 (35.622703552246094)  --> STEP: 1 | > loss_disc: 2.7319087982177734 (2.7319087982177734) | > loss_disc_real_0: 0.1566203236579895 (0.1566203236579895) | > loss_disc_real_1: 0.3804866373538971 (0.3804866373538971) | > loss_disc_real_2: 0.5282464027404785 (0.5282464027404785) | > loss_disc_real_3: 0.23879721760749817 (0.23879721760749817) | > loss_disc_real_4: 0.4595765769481659 (0.4595765769481659) | > loss_disc_real_5: 0.16650323569774628 (0.16650323569774628) | > loss_0: 2.7319087982177734 (2.7319087982177734) | > loss_gen: 2.675086736679077 (2.675086736679077) | > loss_kl: 3.7321183681488037 (3.7321183681488037) | > loss_feat: 7.914119720458984 (7.914119720458984) | > loss_mel: 28.220775604248047 (28.220775604248047) | > loss_duration: 2.7935080528259277 (2.7935080528259277) | > loss_1: 45.33560562133789 (45.33560562133789)  --> STEP: 2 | > loss_disc: 2.496018171310425 (2.613963484764099) | > loss_disc_real_0: 0.28347092866897583 (0.22004562616348267) | > loss_disc_real_1: 0.21534229815006256 (0.29791446775197983) | > loss_disc_real_2: 0.16292311251163483 (0.34558475762605667) | > loss_disc_real_3: 0.24529202282428741 (0.2420446202158928) | > loss_disc_real_4: 0.2610416114330292 (0.36030909419059753) | > loss_disc_real_5: 0.381537526845932 (0.27402038127183914) | > loss_0: 2.496018171310425 (2.613963484764099) | > loss_gen: 3.264026403427124 (2.9695565700531006) | > loss_kl: 3.891420602798462 (3.811769485473633) | > loss_feat: 8.640998840332031 (8.277559280395508) | > loss_mel: 22.221145629882812 (25.22096061706543) | > loss_duration: 2.757755994796753 (2.7756320238113403) | > loss_1: 40.77534484863281 (43.05547523498535)  --> STEP: 3 | > loss_disc: 2.709610939025879 (2.645845969518026) | > loss_disc_real_0: 0.16262374818325043 (0.20090500017007193) | > loss_disc_real_1: 0.22768935561180115 (0.2745060970385869) | > loss_disc_real_2: 0.14037257432937622 (0.2771806965271632) | > loss_disc_real_3: 0.3392266631126404 (0.27443863451480865) | > loss_disc_real_4: 0.23676688969135284 (0.319128359357516) | > loss_disc_real_5: 0.4300588369369507 (0.32603319982687634) | > loss_0: 2.709610939025879 (2.645845969518026) | > loss_gen: 1.9978084564208984 (2.6456405321756997) | > loss_kl: 1.8371456861495972 (3.153561552365621) | > loss_feat: 3.529149055480957 (6.694755872090657) | > loss_mel: 20.115297317504883 (23.519072850545246) | > loss_duration: 2.627796173095703 (2.726353406906128) | > loss_1: 30.107196807861328 (38.73938242594401) --> EVAL PERFORMANCE | > avg_loader_time: 0.006107489267985026 (-0.007613658905029296) | > avg_loss_disc: 2.645845969518026 (-0.060331106185913086) | > avg_loss_disc_real_0: 0.20090500017007193 (+0.04991597682237625) | > avg_loss_disc_real_1: 0.2745060970385869 (+0.039024204015731784) | > avg_loss_disc_real_2: 0.2771806965271632 (+0.08223463843266171) | > avg_loss_disc_real_3: 0.27443863451480865 (+0.01567968726158142) | > avg_loss_disc_real_4: 0.319128359357516 (+0.0816948860883713) | > avg_loss_disc_real_5: 0.32603319982687634 (+0.15406811485687893) | > avg_loss_0: 2.645845969518026 (-0.060331106185913086) | > avg_loss_gen: 2.6456405321756997 (+0.8523895740509031) | > avg_loss_kl: 3.153561552365621 (-0.11336421966552734) | > avg_loss_feat: 6.694755872090657 (+3.7094781498114267) | > avg_loss_mel: 23.519072850545246 (+4.954919179280598) | > avg_loss_duration: 2.726353406906128 (+0.0617896715799966) | > avg_loss_1: 38.73938242594401 (+9.465209960937496)  > EPOCH: 430/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:23:02)   --> TIME: 2023-10-20 04:23:13 -- STEP: 19/50 -- GLOBAL_STEP: 74520 | > loss_disc: 1.918266773223877 (2.4973935202548376) | > loss_disc_real_0: 0.06548674404621124 (0.17759263456652039) | > loss_disc_real_1: 0.15488475561141968 (0.23241681135014483) | > loss_disc_real_2: 0.08541776984930038 (0.2229483255038136) | > loss_disc_real_3: 0.15085725486278534 (0.21771316426364998) | > loss_disc_real_4: 0.22075533866882324 (0.2771658808189003) | > loss_disc_real_5: 0.11994645744562149 (0.23564820668022884) | > loss_0: 1.918266773223877 (2.4973935202548376) | > grad_norm_0: tensor(537.0784, device='cuda:0') (tensor(597.9543, device='cuda:0')) | > loss_gen: 2.9660000801086426 (2.297626997295179) | > loss_kl: 1.1003469228744507 (0.9087582199197066) | > loss_feat: 9.015848159790039 (5.074193785800354) | > loss_mel: 23.597217559814453 (21.165263201061048) | > loss_duration: 1.6085466146469116 (1.5518041347202503) | > loss_1: 38.287960052490234 (30.99764625649703) | > grad_norm_1: tensor(28281.6523, device='cuda:0') (tensor(21157.2988, device='cuda:0')) | > current_lr_0: 0.00013009832221385115 | > current_lr_1: 0.00013009832221385115 | > step_time: 0.3898 (0.3474784148366828) | > loader_time: 0.0259 (0.008256360104209498)  --> TIME: 2023-10-20 04:23:29 -- STEP: 49/50 -- GLOBAL_STEP: 74550 | > loss_disc: 2.3945212364196777 (2.472997908689537) | > loss_disc_real_0: 0.08556509017944336 (0.17611675663870205) | > loss_disc_real_1: 0.21444691717624664 (0.221362688635685) | > loss_disc_real_2: 0.13188040256500244 (0.21858596953810477) | > loss_disc_real_3: 0.20700019598007202 (0.2342690008939529) | > loss_disc_real_4: 0.13028261065483093 (0.24004123420739654) | > loss_disc_real_5: 0.24443373084068298 (0.2169240685750027) | > loss_0: 2.3945212364196777 (2.472997908689537) | > grad_norm_0: tensor(877.4621, device='cuda:0') (tensor(593.4297, device='cuda:0')) | > loss_gen: 1.996812105178833 (2.274692744624858) | > loss_kl: 1.1806282997131348 (0.8898914795444937) | > loss_feat: 4.258134365081787 (5.354222360143096) | > loss_mel: 29.003204345703125 (21.96170787908594) | > loss_duration: 1.628947138786316 (1.5090184017103543) | > loss_1: 38.067726135253906 (31.989532850226578) | > grad_norm_1: tensor(12335.8057, device='cuda:0') (tensor(16673.8281, device='cuda:0')) | > current_lr_0: 0.00013009832221385115 | > current_lr_1: 0.00013009832221385115 | > step_time: 0.6138 (0.4342838598757374) | > loader_time: 0.3885 (0.018516000436276804)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6122655868530273 (2.6122655868530273) | > loss_disc_real_0: 0.060495052486658096 (0.060495052486658096) | > loss_disc_real_1: 0.2822595238685608 (0.2822595238685608) | > loss_disc_real_2: 0.24093134701251984 (0.24093134701251984) | > loss_disc_real_3: 0.2651251256465912 (0.2651251256465912) | > loss_disc_real_4: 0.18867681920528412 (0.18867681920528412) | > loss_disc_real_5: 0.16337113082408905 (0.16337113082408905) | > loss_0: 2.6122655868530273 (2.6122655868530273) | > loss_gen: 1.6905986070632935 (1.6905986070632935) | > loss_kl: 3.470566749572754 (3.470566749572754) | > loss_feat: 1.956592082977295 (1.956592082977295) | > loss_mel: 19.370380401611328 (19.370380401611328) | > loss_duration: 2.524311065673828 (2.524311065673828) | > loss_1: 29.012449264526367 (29.012449264526367)  --> STEP: 1 | > loss_disc: 2.6224653720855713 (2.6224653720855713) | > loss_disc_real_0: 0.20303499698638916 (0.20303499698638916) | > loss_disc_real_1: 0.3443047106266022 (0.3443047106266022) | > loss_disc_real_2: 0.33879953622817993 (0.33879953622817993) | > loss_disc_real_3: 0.44000834226608276 (0.44000834226608276) | > loss_disc_real_4: 0.2221459597349167 (0.2221459597349167) | > loss_disc_real_5: 0.2843700647354126 (0.2843700647354126) | > loss_0: 2.6224653720855713 (2.6224653720855713) | > loss_gen: 2.6649341583251953 (2.6649341583251953) | > loss_kl: 3.313873052597046 (3.313873052597046) | > loss_feat: 5.632308483123779 (5.632308483123779) | > loss_mel: 23.6115665435791 (23.6115665435791) | > loss_duration: 2.674715280532837 (2.674715280532837) | > loss_1: 37.897396087646484 (37.897396087646484)  --> STEP: 2 | > loss_disc: 2.021390438079834 (2.3219279050827026) | > loss_disc_real_0: 0.08526939898729324 (0.1441521979868412) | > loss_disc_real_1: 0.13155464828014374 (0.23792967945337296) | > loss_disc_real_2: 0.23052239418029785 (0.2846609652042389) | > loss_disc_real_3: 0.21988798677921295 (0.32994816452264786) | > loss_disc_real_4: 0.16205479204654694 (0.1921003758907318) | > loss_disc_real_5: 0.11971614509820938 (0.202043104916811) | > loss_0: 2.021390438079834 (2.3219279050827026) | > loss_gen: 2.470897674560547 (2.567915916442871) | > loss_kl: 3.9223263263702393 (3.6180996894836426) | > loss_feat: 10.749896049499512 (8.191102266311646) | > loss_mel: 26.253990173339844 (24.932778358459473) | > loss_duration: 2.6368448734283447 (2.655780076980591) | > loss_1: 46.03395462036133 (41.965675354003906)  --> STEP: 3 | > loss_disc: 3.040684461593628 (2.5615134239196777) | > loss_disc_real_0: 0.1731358766555786 (0.15381342420975366) | > loss_disc_real_1: 0.2534685730934143 (0.24310931066672006) | > loss_disc_real_2: 0.23972119390964508 (0.26968104143937427) | > loss_disc_real_3: 0.2803015410900116 (0.3133992900451024) | > loss_disc_real_4: 0.24571280181407928 (0.20997118453184763) | > loss_disc_real_5: 0.233793705701828 (0.21262663851181665) | > loss_0: 3.040684461593628 (2.5615134239196777) | > loss_gen: 1.41585111618042 (2.183894316355387) | > loss_kl: 1.7858655452728271 (3.007354974746704) | > loss_feat: 0.11907122284173965 (5.500425251821677) | > loss_mel: 3.0404322147369385 (17.635329643885296) | > loss_duration: 2.613992929458618 (2.6418510278066) | > loss_1: 8.975213050842285 (30.968854586283367) --> EVAL PERFORMANCE | > avg_loader_time: 0.025035937627156574 (+0.018928448359171547) | > avg_loss_disc: 2.5615134239196777 (-0.08433254559834813) | > avg_loss_disc_real_0: 0.15381342420975366 (-0.047091575960318266) | > avg_loss_disc_real_1: 0.24310931066672006 (-0.03139678637186685) | > avg_loss_disc_real_2: 0.26968104143937427 (-0.007499655087788937) | > avg_loss_disc_real_3: 0.3133992900451024 (+0.038960655530293764) | > avg_loss_disc_real_4: 0.20997118453184763 (-0.10915717482566836) | > avg_loss_disc_real_5: 0.21262663851181665 (-0.11340656131505969) | > avg_loss_0: 2.5615134239196777 (-0.08433254559834813) | > avg_loss_gen: 2.183894316355387 (-0.4617462158203125) | > avg_loss_kl: 3.007354974746704 (-0.14620657761891698) | > avg_loss_feat: 5.500425251821677 (-1.19433062026898) | > avg_loss_mel: 17.635329643885296 (-5.88374320665995) | > avg_loss_duration: 2.6418510278066 (-0.08450237909952785) | > avg_loss_1: 30.968854586283367 (-7.770527839660641)  > EPOCH: 431/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:23:39)   --> TIME: 2023-10-20 04:23:58 -- STEP: 29/50 -- GLOBAL_STEP: 74580 | > loss_disc: 3.0428028106689453 (2.417780514421134) | > loss_disc_real_0: 0.1636473536491394 (0.16062591051490144) | > loss_disc_real_1: 0.6649464964866638 (0.22926025972541036) | > loss_disc_real_2: 0.4753689765930176 (0.22442046514359013) | > loss_disc_real_3: 0.16577395796775818 (0.2229734736269918) | > loss_disc_real_4: 0.3948618769645691 (0.22258840334312668) | > loss_disc_real_5: 0.18619754910469055 (0.24194888102597203) | > loss_0: 3.0428028106689453 (2.417780514421134) | > grad_norm_0: tensor(383.4609, device='cuda:0') (tensor(539.9871, device='cuda:0')) | > loss_gen: 2.756685495376587 (2.3548392139632126) | > loss_kl: 0.6044775247573853 (0.9683043093516909) | > loss_feat: 8.4540433883667 (5.3182270457518515) | > loss_mel: 22.589019775390625 (22.088948858195337) | > loss_duration: 1.5493669509887695 (1.5365081285608226) | > loss_1: 35.95359420776367 (32.266827484657036) | > grad_norm_1: tensor(17509.0566, device='cuda:0') (tensor(20619.8809, device='cuda:0')) | > current_lr_0: 0.00012996828079542592 | > current_lr_1: 0.00012996828079542592 | > step_time: 0.31 (0.4921105894549138) | > loader_time: 0.0247 (0.018975183881562333)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.620727062225342 (2.620727062225342) | > loss_disc_real_0: 0.09422235935926437 (0.09422235935926437) | > loss_disc_real_1: 0.1930304914712906 (0.1930304914712906) | > loss_disc_real_2: 0.30695393681526184 (0.30695393681526184) | > loss_disc_real_3: 0.3020748496055603 (0.3020748496055603) | > loss_disc_real_4: 0.2590208947658539 (0.2590208947658539) | > loss_disc_real_5: 0.239543616771698 (0.239543616771698) | > loss_0: 2.620727062225342 (2.620727062225342) | > loss_gen: 2.11995005607605 (2.11995005607605) | > loss_kl: 2.860400438308716 (2.860400438308716) | > loss_feat: 7.215442180633545 (7.215442180633545) | > loss_mel: 28.583049774169922 (28.583049774169922) | > loss_duration: 2.5461766719818115 (2.5461766719818115) | > loss_1: 43.32501983642578 (43.32501983642578)  --> STEP: 1 | > loss_disc: 2.8759217262268066 (2.8759217262268066) | > loss_disc_real_0: 0.3301198184490204 (0.3301198184490204) | > loss_disc_real_1: 0.34451568126678467 (0.34451568126678467) | > loss_disc_real_2: 0.30978551506996155 (0.30978551506996155) | > loss_disc_real_3: 0.29204320907592773 (0.29204320907592773) | > loss_disc_real_4: 0.2726421654224396 (0.2726421654224396) | > loss_disc_real_5: 0.1883145421743393 (0.1883145421743393) | > loss_0: 2.8759217262268066 (2.8759217262268066) | > loss_gen: 2.0979931354522705 (2.0979931354522705) | > loss_kl: 3.9709010124206543 (3.9709010124206543) | > loss_feat: 2.7365105152130127 (2.7365105152130127) | > loss_mel: 20.01050567626953 (20.01050567626953) | > loss_duration: 2.7880287170410156 (2.7880287170410156) | > loss_1: 31.603940963745117 (31.603940963745117)  --> STEP: 2 | > loss_disc: 1.9599080085754395 (2.417914867401123) | > loss_disc_real_0: 0.0912211537361145 (0.21067048609256744) | > loss_disc_real_1: 0.2097167670726776 (0.27711622416973114) | > loss_disc_real_2: 0.0957125723361969 (0.20274904370307922) | > loss_disc_real_3: 0.2808467745780945 (0.2864449918270111) | > loss_disc_real_4: 0.1861990988254547 (0.22942063212394714) | > loss_disc_real_5: 0.12482787668704987 (0.15657120943069458) | > loss_0: 1.9599080085754395 (2.417914867401123) | > loss_gen: 2.591583728790283 (2.344788432121277) | > loss_kl: 4.291358470916748 (4.131129741668701) | > loss_feat: 6.663421154022217 (4.699965834617615) | > loss_mel: 25.255308151245117 (22.632906913757324) | > loss_duration: 2.75054669380188 (2.7692877054214478) | > loss_1: 41.552215576171875 (36.578078269958496)  --> STEP: 3 | > loss_disc: 2.703695774078369 (2.5131751696268716) | > loss_disc_real_0: 0.21242260932922363 (0.21125452717145285) | > loss_disc_real_1: 0.27273067831993103 (0.2756543755531311) | > loss_disc_real_2: 0.2412472814321518 (0.21558178961277008) | > loss_disc_real_3: 0.31739863753318787 (0.29676287372907) | > loss_disc_real_4: 0.2641838788986206 (0.2410083810488383) | > loss_disc_real_5: 0.27711954712867737 (0.1967539886633555) | > loss_0: 2.703695774078369 (2.5131751696268716) | > loss_gen: 2.157728672027588 (2.282435178756714) | > loss_kl: 1.8128821849822998 (3.3583805561065674) | > loss_feat: 1.7613935470581055 (3.720441738764445) | > loss_mel: 20.870384216308594 (22.045399347941082) | > loss_duration: 2.5789482593536377 (2.7058412233988443) | > loss_1: 29.181337356567383 (34.11249796549479) --> EVAL PERFORMANCE | > avg_loader_time: 0.01878070831298828 (-0.006255229314168293) | > avg_loss_disc: 2.5131751696268716 (-0.04833825429280614) | > avg_loss_disc_real_0: 0.21125452717145285 (+0.057441102961699186) | > avg_loss_disc_real_1: 0.2756543755531311 (+0.03254506488641104) | > avg_loss_disc_real_2: 0.21558178961277008 (-0.05409925182660419) | > avg_loss_disc_real_3: 0.29676287372907 (-0.01663641631603241) | > avg_loss_disc_real_4: 0.2410083810488383 (+0.03103719651699066) | > avg_loss_disc_real_5: 0.1967539886633555 (-0.01587264984846115) | > avg_loss_0: 2.5131751696268716 (-0.04833825429280614) | > avg_loss_gen: 2.282435178756714 (+0.09854086240132665) | > avg_loss_kl: 3.3583805561065674 (+0.3510255813598633) | > avg_loss_feat: 3.720441738764445 (-1.7799835130572323) | > avg_loss_mel: 22.045399347941082 (+4.410069704055786) | > avg_loss_duration: 2.7058412233988443 (+0.06399019559224417) | > avg_loss_1: 34.11249796549479 (+3.1436433792114222)  > EPOCH: 432/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:24:19)   --> TIME: 2023-10-20 04:24:28 -- STEP: 9/50 -- GLOBAL_STEP: 74610 | > loss_disc: 2.9054317474365234 (2.3863122860590615) | > loss_disc_real_0: 0.08035002648830414 (0.1315477453172207) | > loss_disc_real_1: 0.2216716855764389 (0.25026392936706543) | > loss_disc_real_2: 0.4941294491291046 (0.26225025786293876) | > loss_disc_real_3: 0.2544128894805908 (0.22109144512150022) | > loss_disc_real_4: 0.30674809217453003 (0.21050724366472828) | > loss_disc_real_5: 0.36646679043769836 (0.2169858105480671) | > loss_0: 2.9054317474365234 (2.3863122860590615) | > grad_norm_0: tensor(780.6955, device='cuda:0') (tensor(555.4419, device='cuda:0')) | > loss_gen: 2.125530958175659 (2.488286428981357) | > loss_kl: 0.5435103178024292 (0.8781765500704447) | > loss_feat: 3.4894397258758545 (6.06091385665867) | > loss_mel: 25.84089469909668 (20.210545301437378) | > loss_duration: 1.5718978643417358 (1.5512838496102228) | > loss_1: 33.57127380371094 (31.189206494225395) | > grad_norm_1: tensor(3267.1670, device='cuda:0') (tensor(36076.7695, device='cuda:0')) | > current_lr_0: 0.00012983836936154023 | > current_lr_1: 0.00012983836936154023 | > step_time: 0.6127 (0.49071399370829266) | > loader_time: 0.0228 (0.01899674203660753)  --> TIME: 2023-10-20 04:24:44 -- STEP: 39/50 -- GLOBAL_STEP: 74640 | > loss_disc: 1.5476610660552979 (2.4415565270643977) | > loss_disc_real_0: 0.10688981413841248 (0.1430233127604692) | > loss_disc_real_1: 0.03746418654918671 (0.22703905136157304) | > loss_disc_real_2: 0.05873860418796539 (0.22511840162751) | > loss_disc_real_3: 0.01662345416843891 (0.2219423673187311) | > loss_disc_real_4: 0.021433671936392784 (0.2160833666148858) | > loss_disc_real_5: 0.0035201178397983313 (0.21051348654481655) | > loss_0: 1.5476610660552979 (2.4415565270643977) | > grad_norm_0: tensor(627.2214, device='cuda:0') (tensor(749.2435, device='cuda:0')) | > loss_gen: 2.628519296646118 (2.5007050312482395) | > loss_kl: 0.4665408432483673 (0.83482270133801) | > loss_feat: 11.040328979492188 (6.180369610778796) | > loss_mel: 34.91203689575195 (23.338957737653683) | > loss_duration: 1.533511757850647 (1.5344114639820197) | > loss_1: 50.58094024658203 (34.38926671101497) | > grad_norm_1: tensor(41571.9297, device='cuda:0') (tensor(28454.1406, device='cuda:0')) | > current_lr_0: 0.00012983836936154023 | > current_lr_1: 0.00012983836936154023 | > step_time: 0.2833 (0.4960060975490471) | > loader_time: 0.0252 (0.018674233020880282)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6668691635131836 (2.6668691635131836) | > loss_disc_real_0: 0.21911759674549103 (0.21911759674549103) | > loss_disc_real_1: 0.3023807406425476 (0.3023807406425476) | > loss_disc_real_2: 0.37017935514450073 (0.37017935514450073) | > loss_disc_real_3: 0.4467202425003052 (0.4467202425003052) | > loss_disc_real_4: 0.4645983576774597 (0.4645983576774597) | > loss_disc_real_5: 0.3644312024116516 (0.3644312024116516) | > loss_0: 2.6668691635131836 (2.6668691635131836) | > loss_gen: 3.2390332221984863 (3.2390332221984863) | > loss_kl: 3.044339656829834 (3.044339656829834) | > loss_feat: 6.748220443725586 (6.748220443725586) | > loss_mel: 25.083587646484375 (25.083587646484375) | > loss_duration: 2.541402816772461 (2.541402816772461) | > loss_1: 40.656585693359375 (40.656585693359375)  --> STEP: 1 | > loss_disc: 2.6660878658294678 (2.6660878658294678) | > loss_disc_real_0: 0.13408437371253967 (0.13408437371253967) | > loss_disc_real_1: 0.23611095547676086 (0.23611095547676086) | > loss_disc_real_2: 0.28626036643981934 (0.28626036643981934) | > loss_disc_real_3: 0.33254382014274597 (0.33254382014274597) | > loss_disc_real_4: 0.27908986806869507 (0.27908986806869507) | > loss_disc_real_5: 0.3423367440700531 (0.3423367440700531) | > loss_0: 2.6660878658294678 (2.6660878658294678) | > loss_gen: 2.226210832595825 (2.226210832595825) | > loss_kl: 3.881615400314331 (3.881615400314331) | > loss_feat: 1.7267892360687256 (1.7267892360687256) | > loss_mel: 19.64440155029297 (19.64440155029297) | > loss_duration: 2.8081276416778564 (2.8081276416778564) | > loss_1: 30.287145614624023 (30.287145614624023)  --> STEP: 2 | > loss_disc: 2.614362955093384 (2.640225410461426) | > loss_disc_real_0: 0.2382732331752777 (0.1861788034439087) | > loss_disc_real_1: 0.28556883335113525 (0.26083989441394806) | > loss_disc_real_2: 0.256303995847702 (0.2712821811437607) | > loss_disc_real_3: 0.3688681721687317 (0.35070599615573883) | > loss_disc_real_4: 0.2068706899881363 (0.24298027902841568) | > loss_disc_real_5: 0.305442214012146 (0.32388947904109955) | > loss_0: 2.614362955093384 (2.640225410461426) | > loss_gen: 2.8501791954040527 (2.538195013999939) | > loss_kl: 4.06233549118042 (3.9719754457473755) | > loss_feat: 3.871661424636841 (2.799225330352783) | > loss_mel: 26.5343017578125 (23.089351654052734) | > loss_duration: 2.7593562602996826 (2.7837419509887695) | > loss_1: 40.07783508300781 (35.18249034881592)  --> STEP: 3 | > loss_disc: 2.9777889251708984 (2.75274658203125) | > loss_disc_real_0: 0.23748931288719177 (0.2032823065916697) | > loss_disc_real_1: 0.2730996310710907 (0.2649264732996623) | > loss_disc_real_2: 0.24089664220809937 (0.2611536681652069) | > loss_disc_real_3: 0.28738951683044434 (0.3296005030473073) | > loss_disc_real_4: 0.25133123993873596 (0.24576393266518912) | > loss_disc_real_5: 0.3046613335609436 (0.3174800972143809) | > loss_0: 2.9777889251708984 (2.75274658203125) | > loss_gen: 1.6275291442871094 (2.2346397240956626) | > loss_kl: 1.617611050605774 (3.1871873140335083) | > loss_feat: 0.29520562291145325 (1.9645520945390065) | > loss_mel: 3.0855588912963867 (16.421420733133953) | > loss_duration: 2.589815139770508 (2.719099680582682) | > loss_1: 9.215719223022461 (26.526899973551433) --> EVAL PERFORMANCE | > avg_loader_time: 0.006574789683024089 (-0.012205918629964192) | > avg_loss_disc: 2.75274658203125 (+0.2395714124043784) | > avg_loss_disc_real_0: 0.2032823065916697 (-0.00797222057978314) | > avg_loss_disc_real_1: 0.2649264732996623 (-0.010727902253468813) | > avg_loss_disc_real_2: 0.2611536681652069 (+0.04557187855243683) | > avg_loss_disc_real_3: 0.3296005030473073 (+0.032837629318237305) | > avg_loss_disc_real_4: 0.24576393266518912 (+0.004755551616350828) | > avg_loss_disc_real_5: 0.3174800972143809 (+0.12072610855102542) | > avg_loss_0: 2.75274658203125 (+0.2395714124043784) | > avg_loss_gen: 2.2346397240956626 (-0.047795454661051284) | > avg_loss_kl: 3.1871873140335083 (-0.17119324207305908) | > avg_loss_feat: 1.9645520945390065 (-1.7558896442254384) | > avg_loss_mel: 16.421420733133953 (-5.623978614807129) | > avg_loss_duration: 2.719099680582682 (+0.01325845718383789) | > avg_loss_1: 26.526899973551433 (-7.585597991943356)  > EPOCH: 433/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:25:01)   --> TIME: 2023-10-20 04:25:13 -- STEP: 19/50 -- GLOBAL_STEP: 74670 | > loss_disc: 1.7380706071853638 (2.455196135922482) | > loss_disc_real_0: 0.02369731292128563 (0.16156826403580213) | > loss_disc_real_1: 0.12148404121398926 (0.21572724063145488) | > loss_disc_real_2: 0.10287360101938248 (0.23374047208773463) | > loss_disc_real_3: 0.2130746841430664 (0.2330019154438847) | > loss_disc_real_4: 0.08502573519945145 (0.20225151687076218) | > loss_disc_real_5: 0.055863119661808014 (0.2082344738668517) | > loss_0: 1.7380706071853638 (2.455196135922482) | > grad_norm_0: tensor(295.8163, device='cuda:0') (tensor(581.6948, device='cuda:0')) | > loss_gen: 2.5194814205169678 (2.2603037545555518) | > loss_kl: 1.1450310945510864 (0.8759211466500634) | > loss_feat: 10.191948890686035 (5.6727394469964665) | > loss_mel: 27.898151397705078 (20.676521524002677) | > loss_duration: 1.6608024835586548 (1.5698471069335938) | > loss_1: 43.41541290283203 (31.05533228422466) | > grad_norm_1: tensor(31266.0391, device='cuda:0') (tensor(23573.5000, device='cuda:0')) | > current_lr_0: 0.0001297085877822664 | > current_lr_1: 0.0001297085877822664 | > step_time: 0.3128 (0.3575207057752107) | > loader_time: 0.0021 (0.007462865427920693)  --> TIME: 2023-10-20 04:25:27 -- STEP: 49/50 -- GLOBAL_STEP: 74700 | > loss_disc: 2.6056742668151855 (2.5021225943857317) | > loss_disc_real_0: 0.11567418277263641 (0.15009854370918194) | > loss_disc_real_1: 0.2965756356716156 (0.23311571518377383) | > loss_disc_real_2: 0.2658769190311432 (0.23383727745742225) | > loss_disc_real_3: 0.3079020082950592 (0.23614749183156053) | > loss_disc_real_4: 0.2877405881881714 (0.22658203344564048) | > loss_disc_real_5: 0.32755959033966064 (0.22905563190579414) | > loss_0: 2.6056742668151855 (2.5021225943857317) | > grad_norm_0: tensor(849.3404, device='cuda:0') (tensor(708.1454, device='cuda:0')) | > loss_gen: 2.2581698894500732 (2.242364209525439) | > loss_kl: 0.6923767924308777 (0.8366663205076237) | > loss_feat: 1.9561874866485596 (4.851433041771608) | > loss_mel: 22.222637176513672 (20.509726824809093) | > loss_duration: 1.639930248260498 (1.5268521819795882) | > loss_1: 28.76930046081543 (29.967042514256068) | > grad_norm_1: tensor(7152.7354, device='cuda:0') (tensor(21227.2617, device='cuda:0')) | > current_lr_0: 0.0001297085877822664 | > current_lr_1: 0.0001297085877822664 | > step_time: 0.3312 (0.4198576382228306) | > loader_time: 0.4199 (0.019499467343700175)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9276156425476074 (2.9276156425476074) | > loss_disc_real_0: 0.2145480215549469 (0.2145480215549469) | > loss_disc_real_1: 0.25244030356407166 (0.25244030356407166) | > loss_disc_real_2: 0.29590389132499695 (0.29590389132499695) | > loss_disc_real_3: 0.2752244770526886 (0.2752244770526886) | > loss_disc_real_4: 0.26961514353752136 (0.26961514353752136) | > loss_disc_real_5: 0.32295218110084534 (0.32295218110084534) | > loss_0: 2.9276156425476074 (2.9276156425476074) | > loss_gen: 1.724605679512024 (1.724605679512024) | > loss_kl: 3.4960107803344727 (3.4960107803344727) | > loss_feat: 0.2657167315483093 (0.2657167315483093) | > loss_mel: 13.692428588867188 (13.692428588867188) | > loss_duration: 2.4480490684509277 (2.4480490684509277) | > loss_1: 21.626811981201172 (21.626811981201172)  --> STEP: 1 | > loss_disc: 2.3521344661712646 (2.3521344661712646) | > loss_disc_real_0: 0.20179614424705505 (0.20179614424705505) | > loss_disc_real_1: 0.26981571316719055 (0.26981571316719055) | > loss_disc_real_2: 0.07584960758686066 (0.07584960758686066) | > loss_disc_real_3: 0.3476808965206146 (0.3476808965206146) | > loss_disc_real_4: 0.18717464804649353 (0.18717464804649353) | > loss_disc_real_5: 0.2616388499736786 (0.2616388499736786) | > loss_0: 2.3521344661712646 (2.3521344661712646) | > loss_gen: 2.6700751781463623 (2.6700751781463623) | > loss_kl: 3.4431872367858887 (3.4431872367858887) | > loss_feat: 4.736242771148682 (4.736242771148682) | > loss_mel: 23.39334487915039 (23.39334487915039) | > loss_duration: 2.727088451385498 (2.727088451385498) | > loss_1: 36.969940185546875 (36.969940185546875)  --> STEP: 2 | > loss_disc: 2.1180028915405273 (2.235068678855896) | > loss_disc_real_0: 0.22138866782188416 (0.2115924060344696) | > loss_disc_real_1: 0.3688112199306488 (0.3193134665489197) | > loss_disc_real_2: 0.19820113480091095 (0.1370253711938858) | > loss_disc_real_3: 0.1132863312959671 (0.23048361390829086) | > loss_disc_real_4: 0.107091523706913 (0.14713308587670326) | > loss_disc_real_5: 0.11728303134441376 (0.18946094065904617) | > loss_0: 2.1180028915405273 (2.235068678855896) | > loss_gen: 3.0720224380493164 (2.8710488080978394) | > loss_kl: 4.183669090270996 (3.8134281635284424) | > loss_feat: 9.966068267822266 (7.351155519485474) | > loss_mel: 24.974140167236328 (24.18374252319336) | > loss_duration: 2.691972255706787 (2.7095303535461426) | > loss_1: 44.88787078857422 (40.92890548706055)  --> STEP: 3 | > loss_disc: 2.6257476806640625 (2.3652950127919516) | > loss_disc_real_0: 0.23458969593048096 (0.21925816933314005) | > loss_disc_real_1: 0.2796461880207062 (0.3060910403728485) | > loss_disc_real_2: 0.22581514716148376 (0.16662196318308511) | > loss_disc_real_3: 0.227796733379364 (0.22958798706531525) | > loss_disc_real_4: 0.28151750564575195 (0.19192789246638617) | > loss_disc_real_5: 0.34856098890304565 (0.24249429007371268) | > loss_0: 2.6257476806640625 (2.3652950127919516) | > loss_gen: 2.6367108821868896 (2.792936166127523) | > loss_kl: 1.4074856042861938 (3.011447310447693) | > loss_feat: 2.6910860538482666 (5.797799030939738) | > loss_mel: 20.84937286376953 (23.072285970052082) | > loss_duration: 2.6812260150909424 (2.7000955740610757) | > loss_1: 30.26588249206543 (37.37456448872884) --> EVAL PERFORMANCE | > avg_loader_time: 0.007239182790120442 (+0.0006643931070963536) | > avg_loss_disc: 2.3652950127919516 (-0.38745156923929835) | > avg_loss_disc_real_0: 0.21925816933314005 (+0.015975862741470337) | > avg_loss_disc_real_1: 0.3060910403728485 (+0.04116456707318622) | > avg_loss_disc_real_2: 0.16662196318308511 (-0.0945317049821218) | > avg_loss_disc_real_3: 0.22958798706531525 (-0.10001251598199207) | > avg_loss_disc_real_4: 0.19192789246638617 (-0.05383604019880295) | > avg_loss_disc_real_5: 0.24249429007371268 (-0.07498580714066824) | > avg_loss_0: 2.3652950127919516 (-0.38745156923929835) | > avg_loss_gen: 2.792936166127523 (+0.5582964420318604) | > avg_loss_kl: 3.011447310447693 (-0.17574000358581543) | > avg_loss_feat: 5.797799030939738 (+3.833246936400732) | > avg_loss_mel: 23.072285970052082 (+6.650865236918129) | > avg_loss_duration: 2.7000955740610757 (-0.019004106521606445) | > avg_loss_1: 37.37456448872884 (+10.84766451517741)  > EPOCH: 434/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:25:39)   --> TIME: 2023-10-20 04:25:58 -- STEP: 29/50 -- GLOBAL_STEP: 74730 | > loss_disc: 2.0799131393432617 (2.4311707636405684) | > loss_disc_real_0: 0.04611340910196304 (0.13368588878676813) | > loss_disc_real_1: 0.23346853256225586 (0.2289710545848156) | > loss_disc_real_2: 0.24561651051044464 (0.22279502990944633) | > loss_disc_real_3: 0.22829768061637878 (0.23159322746354957) | > loss_disc_real_4: 0.08572210371494293 (0.21839017408161326) | > loss_disc_real_5: 0.2328488528728485 (0.2221677877522748) | > loss_0: 2.0799131393432617 (2.4311707636405684) | > grad_norm_0: tensor(322.0858, device='cuda:0') (tensor(647.3414, device='cuda:0')) | > loss_gen: 2.6170835494995117 (2.383031462800914) | > loss_kl: 0.6828957796096802 (0.8270143671282406) | > loss_feat: 5.886706829071045 (5.885148171849292) | > loss_mel: 22.042776107788086 (21.934549496091645) | > loss_duration: 1.4588133096694946 (1.542131045769001) | > loss_1: 32.68827438354492 (32.57187481584221) | > grad_norm_1: tensor(2411.5808, device='cuda:0') (tensor(27476.7812, device='cuda:0')) | > current_lr_0: 0.00012957893592780657 | > current_lr_1: 0.00012957893592780657 | > step_time: 0.4806 (0.49748936192742704) | > loader_time: 0.0232 (0.019492642632846176)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6296446323394775 (2.6296446323394775) | > loss_disc_real_0: 0.3231601119041443 (0.3231601119041443) | > loss_disc_real_1: 0.2482227385044098 (0.2482227385044098) | > loss_disc_real_2: 0.2945437431335449 (0.2945437431335449) | > loss_disc_real_3: 0.27744564414024353 (0.27744564414024353) | > loss_disc_real_4: 0.3764089345932007 (0.3764089345932007) | > loss_disc_real_5: 0.3099355697631836 (0.3099355697631836) | > loss_0: 2.6296446323394775 (2.6296446323394775) | > loss_gen: 3.3067567348480225 (3.3067567348480225) | > loss_kl: 3.504692554473877 (3.504692554473877) | > loss_feat: 5.410830974578857 (5.410830974578857) | > loss_mel: 23.970491409301758 (23.970491409301758) | > loss_duration: 2.5160610675811768 (2.5160610675811768) | > loss_1: 38.708831787109375 (38.708831787109375)  --> STEP: 1 | > loss_disc: 2.584573745727539 (2.584573745727539) | > loss_disc_real_0: 0.32792404294013977 (0.32792404294013977) | > loss_disc_real_1: 0.2623234987258911 (0.2623234987258911) | > loss_disc_real_2: 0.22414183616638184 (0.22414183616638184) | > loss_disc_real_3: 0.39620745182037354 (0.39620745182037354) | > loss_disc_real_4: 0.28334948420524597 (0.28334948420524597) | > loss_disc_real_5: 0.38741880655288696 (0.38741880655288696) | > loss_0: 2.584573745727539 (2.584573745727539) | > loss_gen: 3.3845021724700928 (3.3845021724700928) | > loss_kl: 3.775956392288208 (3.775956392288208) | > loss_feat: 5.629543781280518 (5.629543781280518) | > loss_mel: 25.169281005859375 (25.169281005859375) | > loss_duration: 2.862856864929199 (2.862856864929199) | > loss_1: 40.8221435546875 (40.8221435546875)  --> STEP: 2 | > loss_disc: 3.0374903678894043 (2.8110320568084717) | > loss_disc_real_0: 0.3521745502948761 (0.34004929661750793) | > loss_disc_real_1: 0.4182395040988922 (0.34028150141239166) | > loss_disc_real_2: 0.3844459652900696 (0.3042939007282257) | > loss_disc_real_3: 0.2866359353065491 (0.3414216935634613) | > loss_disc_real_4: 0.2656260132789612 (0.2744877487421036) | > loss_disc_real_5: 0.43451008200645447 (0.4109644442796707) | > loss_0: 3.0374903678894043 (2.8110320568084717) | > loss_gen: 2.755760669708252 (3.0701314210891724) | > loss_kl: 3.810063600540161 (3.7930099964141846) | > loss_feat: 4.94370698928833 (5.286625385284424) | > loss_mel: 24.917678833007812 (25.043479919433594) | > loss_duration: 2.7516307830810547 (2.807243824005127) | > loss_1: 39.17884063720703 (40.000492095947266)  --> STEP: 3 | > loss_disc: 2.4619548320770264 (2.6946729818979898) | > loss_disc_real_0: 0.08030729740858078 (0.2534686302145322) | > loss_disc_real_1: 0.2689446210861206 (0.31650254130363464) | > loss_disc_real_2: 0.326943039894104 (0.3118436137835185) | > loss_disc_real_3: 0.37838369607925415 (0.3537423610687256) | > loss_disc_real_4: 0.40549591183662415 (0.3181571364402771) | > loss_disc_real_5: 0.5404097437858582 (0.45411287744839984) | > loss_0: 2.4619548320770264 (2.6946729818979898) | > loss_gen: 3.6110987663269043 (3.2504538695017495) | > loss_kl: 2.0072834491729736 (3.1977678140004477) | > loss_feat: 4.858867645263672 (5.144039471944173) | > loss_mel: 24.457746505737305 (24.848235448201496) | > loss_duration: 2.6605725288391113 (2.7583533922831216) | > loss_1: 37.5955696105957 (39.19885126749674) --> EVAL PERFORMANCE | > avg_loader_time: 0.02433125178019206 (+0.017092068990071617) | > avg_loss_disc: 2.6946729818979898 (+0.3293779691060381) | > avg_loss_disc_real_0: 0.2534686302145322 (+0.03421046088139215) | > avg_loss_disc_real_1: 0.31650254130363464 (+0.010411500930786133) | > avg_loss_disc_real_2: 0.3118436137835185 (+0.14522165060043338) | > avg_loss_disc_real_3: 0.3537423610687256 (+0.12415437400341034) | > avg_loss_disc_real_4: 0.3181571364402771 (+0.12622924397389093) | > avg_loss_disc_real_5: 0.45411287744839984 (+0.21161858737468717) | > avg_loss_0: 2.6946729818979898 (+0.3293779691060381) | > avg_loss_gen: 3.2504538695017495 (+0.4575177033742266) | > avg_loss_kl: 3.1977678140004477 (+0.18632050355275487) | > avg_loss_feat: 5.144039471944173 (-0.6537595589955654) | > avg_loss_mel: 24.848235448201496 (+1.775949478149414) | > avg_loss_duration: 2.7583533922831216 (+0.0582578182220459) | > avg_loss_1: 39.19885126749674 (+1.824286778767899)  > EPOCH: 435/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:26:20)   --> TIME: 2023-10-20 04:26:29 -- STEP: 9/50 -- GLOBAL_STEP: 74760 | > loss_disc: 2.8624675273895264 (2.5547604163487754) | > loss_disc_real_0: 0.16177624464035034 (0.1630430185339517) | > loss_disc_real_1: 0.2904970943927765 (0.23291002358827326) | > loss_disc_real_2: 0.40634605288505554 (0.2556576062407758) | > loss_disc_real_3: 0.35858583450317383 (0.2335600753625234) | > loss_disc_real_4: 0.380196213722229 (0.19305219506430957) | > loss_disc_real_5: 0.22325552999973297 (0.19265827536582947) | > loss_0: 2.8624675273895264 (2.5547604163487754) | > grad_norm_0: tensor(552.5173, device='cuda:0') (tensor(642.5518, device='cuda:0')) | > loss_gen: 2.3094542026519775 (2.253857175509135) | > loss_kl: 1.0407466888427734 (0.7918466064665053) | > loss_feat: 4.416233539581299 (6.248273306422764) | > loss_mel: 22.823652267456055 (22.999011569552952) | > loss_duration: 1.462285041809082 (1.5350871880849202) | > loss_1: 32.052371978759766 (33.82807710435655) | > grad_norm_1: tensor(14086.4590, device='cuda:0') (tensor(25199.1582, device='cuda:0')) | > current_lr_0: 0.00012944941366849268 | > current_lr_1: 0.00012944941366849268 | > step_time: 0.537 (0.5167939927842882) | > loader_time: 0.0267 (0.020877864625718858)  --> TIME: 2023-10-20 04:26:44 -- STEP: 39/50 -- GLOBAL_STEP: 74790 | > loss_disc: 3.0525529384613037 (2.5296574189112744) | > loss_disc_real_0: 0.15480926632881165 (0.16015828928599754) | > loss_disc_real_1: 0.30263274908065796 (0.2217418888153938) | > loss_disc_real_2: 0.29529982805252075 (0.22346387364161321) | > loss_disc_real_3: 0.2996770739555359 (0.23599103417916176) | > loss_disc_real_4: 0.25739189982414246 (0.23048310942995626) | > loss_disc_real_5: 0.29006698727607727 (0.21972172993880051) | > loss_0: 3.0525529384613037 (2.5296574189112744) | > grad_norm_0: tensor(1439.6659, device='cuda:0') (tensor(612.3359, device='cuda:0')) | > loss_gen: 1.6233761310577393 (2.2567929365696044) | > loss_kl: 0.38915908336639404 (0.8174740824943934) | > loss_feat: 0.021236706525087357 (5.662087973207235) | > loss_mel: 1.5118931531906128 (21.901566844720108) | > loss_duration: 1.5531315803527832 (1.513510444225409) | > loss_1: 5.098796844482422 (32.151432343018364) | > grad_norm_1: tensor(52270.9922, device='cuda:0') (tensor(26258.5000, device='cuda:0')) | > current_lr_0: 0.00012944941366849268 | > current_lr_1: 0.00012944941366849268 | > step_time: 0.5918 (0.4991736717713185) | > loader_time: 0.0247 (0.01847607050186548)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2176835536956787 (2.2176835536956787) | > loss_disc_real_0: 0.09203916788101196 (0.09203916788101196) | > loss_disc_real_1: 0.2152794897556305 (0.2152794897556305) | > loss_disc_real_2: 0.30582118034362793 (0.30582118034362793) | > loss_disc_real_3: 0.23487694561481476 (0.23487694561481476) | > loss_disc_real_4: 0.40698814392089844 (0.40698814392089844) | > loss_disc_real_5: 0.2944071590900421 (0.2944071590900421) | > loss_0: 2.2176835536956787 (2.2176835536956787) | > loss_gen: 3.193103075027466 (3.193103075027466) | > loss_kl: 2.8268043994903564 (2.8268043994903564) | > loss_feat: 7.7015275955200195 (7.7015275955200195) | > loss_mel: 25.035873413085938 (25.035873413085938) | > loss_duration: 2.475431442260742 (2.475431442260742) | > loss_1: 41.23274230957031 (41.23274230957031)  --> STEP: 1 | > loss_disc: 2.25150203704834 (2.25150203704834) | > loss_disc_real_0: 0.06802905350923538 (0.06802905350923538) | > loss_disc_real_1: 0.2564983665943146 (0.2564983665943146) | > loss_disc_real_2: 0.13273702561855316 (0.13273702561855316) | > loss_disc_real_3: 0.1872912347316742 (0.1872912347316742) | > loss_disc_real_4: 0.14495466649532318 (0.14495466649532318) | > loss_disc_real_5: 0.1866888850927353 (0.1866888850927353) | > loss_0: 2.25150203704834 (2.25150203704834) | > loss_gen: 2.3942129611968994 (2.3942129611968994) | > loss_kl: 4.072635173797607 (4.072635173797607) | > loss_feat: 7.738521575927734 (7.738521575927734) | > loss_mel: 24.958955764770508 (24.958955764770508) | > loss_duration: 2.8405840396881104 (2.8405840396881104) | > loss_1: 42.00490951538086 (42.00490951538086)  --> STEP: 2 | > loss_disc: 2.8589088916778564 (2.555205464363098) | > loss_disc_real_0: 0.19419607520103455 (0.13111256435513496) | > loss_disc_real_1: 0.2603878080844879 (0.25844308733940125) | > loss_disc_real_2: 0.24441465735435486 (0.188575841486454) | > loss_disc_real_3: 0.21436460316181183 (0.200827918946743) | > loss_disc_real_4: 0.23831138014793396 (0.19163302332162857) | > loss_disc_real_5: 0.2570357918739319 (0.2218623384833336) | > loss_0: 2.8589088916778564 (2.555205464363098) | > loss_gen: 1.5597431659698486 (1.976978063583374) | > loss_kl: 4.159355640411377 (4.115995407104492) | > loss_feat: 0.3460327982902527 (4.0422771871089935) | > loss_mel: 2.1985225677490234 (13.578739166259766) | > loss_duration: 2.760664463043213 (2.8006242513656616) | > loss_1: 11.02431869506836 (26.51461410522461)  --> STEP: 3 | > loss_disc: 2.858304977416992 (2.656238635381063) | > loss_disc_real_0: 0.19320610165596008 (0.15181041012207666) | > loss_disc_real_1: 0.2603725790977478 (0.2590862512588501) | > loss_disc_real_2: 0.2444833219051361 (0.20721166829268137) | > loss_disc_real_3: 0.21436087787151337 (0.2053389052549998) | > loss_disc_real_4: 0.2383522093296051 (0.20720608532428741) | > loss_disc_real_5: 0.257059782743454 (0.23359481990337372) | > loss_0: 2.858304977416992 (2.656238635381063) | > loss_gen: 1.5594747066497803 (1.8378102779388428) | > loss_kl: 1.6948820352554321 (3.3089576164881387) | > loss_feat: 0.34759432077407837 (2.810716231664022) | > loss_mel: 3.0618479251861572 (10.073108752568563) | > loss_duration: 2.591585636138916 (2.7309447129567466) | > loss_1: 9.25538444519043 (20.761537551879883) --> EVAL PERFORMANCE | > avg_loader_time: 0.005986611048380534 (-0.018344640731811523) | > avg_loss_disc: 2.656238635381063 (-0.03843434651692679) | > avg_loss_disc_real_0: 0.15181041012207666 (-0.10165822009245554) | > avg_loss_disc_real_1: 0.2590862512588501 (-0.057416290044784546) | > avg_loss_disc_real_2: 0.20721166829268137 (-0.10463194549083712) | > avg_loss_disc_real_3: 0.2053389052549998 (-0.1484034558137258) | > avg_loss_disc_real_4: 0.20720608532428741 (-0.11095105111598969) | > avg_loss_disc_real_5: 0.23359481990337372 (-0.22051805754502612) | > avg_loss_0: 2.656238635381063 (-0.03843434651692679) | > avg_loss_gen: 1.8378102779388428 (-1.4126435915629068) | > avg_loss_kl: 3.3089576164881387 (+0.11118980248769095) | > avg_loss_feat: 2.810716231664022 (-2.333323240280151) | > avg_loss_mel: 10.073108752568563 (-14.775126695632933) | > avg_loss_duration: 2.7309447129567466 (-0.02740867932637503) | > avg_loss_1: 20.761537551879883 (-18.43731371561686)  > EPOCH: 436/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:27:00)   --> TIME: 2023-10-20 04:27:12 -- STEP: 19/50 -- GLOBAL_STEP: 74820 | > loss_disc: 2.683387517929077 (2.483719982598957) | > loss_disc_real_0: 0.33040642738342285 (0.16997298372811392) | > loss_disc_real_1: 0.17304204404354095 (0.2104060740063065) | > loss_disc_real_2: 0.21985125541687012 (0.2252772515149493) | > loss_disc_real_3: 0.2307850867509842 (0.22131059034482428) | > loss_disc_real_4: 0.3228440582752228 (0.22478457746144972) | > loss_disc_real_5: 0.2780471444129944 (0.2603449674421235) | > loss_0: 2.683387517929077 (2.483719982598957) | > grad_norm_0: tensor(580.3514, device='cuda:0') (tensor(775.9782, device='cuda:0')) | > loss_gen: 2.229214906692505 (2.3073100855475976) | > loss_kl: 0.9785972237586975 (0.9177762458198949) | > loss_feat: 2.520394802093506 (4.773436911796269) | > loss_mel: 20.757417678833008 (20.99964609899019) | > loss_duration: 1.6332340240478516 (1.548242870130037) | > loss_1: 28.118858337402344 (30.546412267183) | > grad_norm_1: tensor(18595.7051, device='cuda:0') (tensor(27457.5781, device='cuda:0')) | > current_lr_0: 0.00012932002087478634 | > current_lr_1: 0.00012932002087478634 | > step_time: 0.3761 (0.327373931282445) | > loader_time: 0.0259 (0.006510847493221885)  --> TIME: 2023-10-20 04:27:27 -- STEP: 49/50 -- GLOBAL_STEP: 74850 | > loss_disc: 2.1657609939575195 (2.464210220745631) | > loss_disc_real_0: 0.3042665719985962 (0.15711879874674642) | > loss_disc_real_1: 0.14664489030838013 (0.22656644105303045) | > loss_disc_real_2: 0.29434171319007874 (0.22014740208277897) | > loss_disc_real_3: 0.09119177609682083 (0.23513762998793805) | > loss_disc_real_4: 0.35343992710113525 (0.22245011041511079) | > loss_disc_real_5: 0.21007418632507324 (0.23074518433030775) | > loss_0: 2.1657609939575195 (2.464210220745631) | > grad_norm_0: tensor(469.7645, device='cuda:0') (tensor(679.9026, device='cuda:0')) | > loss_gen: 3.6550636291503906 (2.331805543023713) | > loss_kl: 0.5719699263572693 (0.8812920511985312) | > loss_feat: 8.672268867492676 (5.3820145522453355) | > loss_mel: 37.33895492553711 (22.410456156244084) | > loss_duration: 1.663212537765503 (1.5224985443815893) | > loss_1: 51.90147018432617 (32.52806667405732) | > grad_norm_1: tensor(9690.3516, device='cuda:0') (tensor(24256.2734, device='cuda:0')) | > current_lr_0: 0.00012932002087478634 | > current_lr_1: 0.00012932002087478634 | > step_time: 0.5442 (0.4186637109639693) | > loader_time: 0.4298 (0.01952859333583287)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0683507919311523 (3.0683507919311523) | > loss_disc_real_0: 0.5084072351455688 (0.5084072351455688) | > loss_disc_real_1: 0.22022075951099396 (0.22022075951099396) | > loss_disc_real_2: 0.2236148715019226 (0.2236148715019226) | > loss_disc_real_3: 0.2450011819601059 (0.2450011819601059) | > loss_disc_real_4: 0.3026983141899109 (0.3026983141899109) | > loss_disc_real_5: 0.3358214795589447 (0.3358214795589447) | > loss_0: 3.0683507919311523 (3.0683507919311523) | > loss_gen: 2.018050193786621 (2.018050193786621) | > loss_kl: 3.517845392227173 (3.517845392227173) | > loss_feat: 2.037569999694824 (2.037569999694824) | > loss_mel: 21.102895736694336 (21.102895736694336) | > loss_duration: 2.5089073181152344 (2.5089073181152344) | > loss_1: 31.18526840209961 (31.18526840209961)  --> STEP: 1 | > loss_disc: 2.8217742443084717 (2.8217742443084717) | > loss_disc_real_0: 0.2672003507614136 (0.2672003507614136) | > loss_disc_real_1: 0.1854483038187027 (0.1854483038187027) | > loss_disc_real_2: 0.2507234811782837 (0.2507234811782837) | > loss_disc_real_3: 0.2633276581764221 (0.2633276581764221) | > loss_disc_real_4: 0.29928380250930786 (0.29928380250930786) | > loss_disc_real_5: 0.3106800615787506 (0.3106800615787506) | > loss_0: 2.8217742443084717 (2.8217742443084717) | > loss_gen: 2.0282580852508545 (2.0282580852508545) | > loss_kl: 3.2241103649139404 (3.2241103649139404) | > loss_feat: 1.301271677017212 (1.301271677017212) | > loss_mel: 19.988645553588867 (19.988645553588867) | > loss_duration: 2.6412458419799805 (2.6412458419799805) | > loss_1: 29.183528900146484 (29.183528900146484)  --> STEP: 2 | > loss_disc: 2.9197046756744385 (2.870739459991455) | > loss_disc_real_0: 0.23021817207336426 (0.24870926141738892) | > loss_disc_real_1: 0.18019762635231018 (0.18282296508550644) | > loss_disc_real_2: 0.20029988884925842 (0.22551168501377106) | > loss_disc_real_3: 0.318759024143219 (0.29104334115982056) | > loss_disc_real_4: 0.36869826912879944 (0.33399103581905365) | > loss_disc_real_5: 0.32635191082954407 (0.31851598620414734) | > loss_0: 2.9197046756744385 (2.870739459991455) | > loss_gen: 2.29770565032959 (2.162981867790222) | > loss_kl: 4.859486103057861 (4.041798233985901) | > loss_feat: 6.332825660705566 (3.817048668861389) | > loss_mel: 24.687480926513672 (22.33806324005127) | > loss_duration: 2.6631336212158203 (2.6521897315979004) | > loss_1: 40.84062957763672 (35.0120792388916)  --> STEP: 3 | > loss_disc: 3.10408616065979 (2.948521693547567) | > loss_disc_real_0: 0.4477970004081726 (0.31507184108098346) | > loss_disc_real_1: 0.1905771642923355 (0.18540769815444946) | > loss_disc_real_2: 0.19950269162654877 (0.21684202055136362) | > loss_disc_real_3: 0.20762932300567627 (0.26323866844177246) | > loss_disc_real_4: 0.29078584909439087 (0.3195893069108327) | > loss_disc_real_5: 0.4150565266609192 (0.3506961663564046) | > loss_0: 3.10408616065979 (2.948521693547567) | > loss_gen: 1.799069881439209 (2.0416778723398843) | > loss_kl: 1.8104146718978882 (3.2980037132898965) | > loss_feat: 1.4657926559448242 (3.0332966645558677) | > loss_mel: 8.425812721252441 (17.70064640045166) | > loss_duration: 2.5589051246643066 (2.6210948626200357) | > loss_1: 16.059995651245117 (28.69471804300944) --> EVAL PERFORMANCE | > avg_loader_time: 0.012750943501790365 (+0.006764332453409831) | > avg_loss_disc: 2.948521693547567 (+0.2922830581665039) | > avg_loss_disc_real_0: 0.31507184108098346 (+0.1632614309589068) | > avg_loss_disc_real_1: 0.18540769815444946 (-0.07367855310440063) | > avg_loss_disc_real_2: 0.21684202055136362 (+0.009630352258682251) | > avg_loss_disc_real_3: 0.26323866844177246 (+0.057899763186772674) | > avg_loss_disc_real_4: 0.3195893069108327 (+0.11238322158654529) | > avg_loss_disc_real_5: 0.3506961663564046 (+0.11710134645303089) | > avg_loss_0: 2.948521693547567 (+0.2922830581665039) | > avg_loss_gen: 2.0416778723398843 (+0.20386759440104152) | > avg_loss_kl: 3.2980037132898965 (-0.010953903198242188) | > avg_loss_feat: 3.0332966645558677 (+0.2225804328918457) | > avg_loss_mel: 17.70064640045166 (+7.627537647883097) | > avg_loss_duration: 2.6210948626200357 (-0.10984985033671091) | > avg_loss_1: 28.69471804300944 (+7.9331804911295585)  > EPOCH: 437/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:27:39)   --> TIME: 2023-10-20 04:27:57 -- STEP: 29/50 -- GLOBAL_STEP: 74880 | > loss_disc: 2.421578884124756 (2.619378184450084) | > loss_disc_real_0: 0.03817672282457352 (0.17672333753956804) | > loss_disc_real_1: 0.21131572127342224 (0.24536858165058598) | > loss_disc_real_2: 0.19050337374210358 (0.2458788022912782) | > loss_disc_real_3: 0.2802512049674988 (0.25517733382253804) | > loss_disc_real_4: 0.18023835122585297 (0.2518387909593254) | > loss_disc_real_5: 0.2350921779870987 (0.24498950118391677) | > loss_0: 2.421578884124756 (2.619378184450084) | > grad_norm_0: tensor(923.4958, device='cuda:0') (tensor(779.9510, device='cuda:0')) | > loss_gen: 1.9995836019515991 (2.288712419312575) | > loss_kl: 1.3532408475875854 (0.9189969357745401) | > loss_feat: 2.626946449279785 (4.93629235748587) | > loss_mel: 22.70777130126953 (23.522588844957024) | > loss_duration: 1.5537207126617432 (1.5229200823553677) | > loss_1: 30.241262435913086 (33.189510838738805) | > grad_norm_1: tensor(6293.9531, device='cuda:0') (tensor(19218.3496, device='cuda:0')) | > current_lr_0: 0.00012919075741727847 | > current_lr_1: 0.00012919075741727847 | > step_time: 0.4961 (0.4870080125742945) | > loader_time: 0.0246 (0.018169863470669453)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.830085277557373 (2.830085277557373) | > loss_disc_real_0: 0.3591635227203369 (0.3591635227203369) | > loss_disc_real_1: 0.26213163137435913 (0.26213163137435913) | > loss_disc_real_2: 0.30498436093330383 (0.30498436093330383) | > loss_disc_real_3: 0.3000836670398712 (0.3000836670398712) | > loss_disc_real_4: 0.26014843583106995 (0.26014843583106995) | > loss_disc_real_5: 0.4295571744441986 (0.4295571744441986) | > loss_0: 2.830085277557373 (2.830085277557373) | > loss_gen: 2.478397846221924 (2.478397846221924) | > loss_kl: 3.550166130065918 (3.550166130065918) | > loss_feat: 4.742454528808594 (4.742454528808594) | > loss_mel: 27.04131507873535 (27.04131507873535) | > loss_duration: 2.3984296321868896 (2.3984296321868896) | > loss_1: 40.21076202392578 (40.21076202392578)  --> STEP: 1 | > loss_disc: 2.6886110305786133 (2.6886110305786133) | > loss_disc_real_0: 0.14704613387584686 (0.14704613387584686) | > loss_disc_real_1: 0.2635769844055176 (0.2635769844055176) | > loss_disc_real_2: 0.2788684666156769 (0.2788684666156769) | > loss_disc_real_3: 0.26593807339668274 (0.26593807339668274) | > loss_disc_real_4: 0.3035029172897339 (0.3035029172897339) | > loss_disc_real_5: 0.3379914164543152 (0.3379914164543152) | > loss_0: 2.6886110305786133 (2.6886110305786133) | > loss_gen: 2.2044169902801514 (2.2044169902801514) | > loss_kl: 3.814711809158325 (3.814711809158325) | > loss_feat: 6.479339122772217 (6.479339122772217) | > loss_mel: 25.38848876953125 (25.38848876953125) | > loss_duration: 2.71207332611084 (2.71207332611084) | > loss_1: 40.59903335571289 (40.59903335571289)  --> STEP: 2 | > loss_disc: 3.0046494007110596 (2.8466302156448364) | > loss_disc_real_0: 0.26204004883766174 (0.2045430913567543) | > loss_disc_real_1: 0.3088451623916626 (0.2862110733985901) | > loss_disc_real_2: 0.29614344239234924 (0.28750595450401306) | > loss_disc_real_3: 0.30489879846572876 (0.28541843593120575) | > loss_disc_real_4: 0.2692236602306366 (0.28636328876018524) | > loss_disc_real_5: 0.3008497953414917 (0.31942060589790344) | > loss_0: 3.0046494007110596 (2.8466302156448364) | > loss_gen: 1.763389229774475 (1.9839031100273132) | > loss_kl: 3.88608455657959 (3.8503981828689575) | > loss_feat: 0.05659446492791176 (3.2679667938500643) | > loss_mel: 3.932220697402954 (14.660354733467102) | > loss_duration: 2.6000051498413086 (2.656039237976074) | > loss_1: 12.23829460144043 (26.41866397857666)  --> STEP: 3 | > loss_disc: 2.6320126056671143 (2.775091012318929) | > loss_disc_real_0: 0.11351883411407471 (0.1742016722758611) | > loss_disc_real_1: 0.3414311707019806 (0.3046177724997203) | > loss_disc_real_2: 0.3450772166252136 (0.3066963752110799) | > loss_disc_real_3: 0.21593590080738068 (0.2622575908899307) | > loss_disc_real_4: 0.31718650460243225 (0.29663769404093426) | > loss_disc_real_5: 0.36363711953163147 (0.3341594437758128) | > loss_0: 2.6320126056671143 (2.775091012318929) | > loss_gen: 2.278337001800537 (2.0820477406183877) | > loss_kl: 1.8107279539108276 (3.170508106549581) | > loss_feat: 2.6968002319335938 (3.0775779398779073) | > loss_mel: 22.635242462158203 (17.318650643030804) | > loss_duration: 2.6377508640289307 (2.6499431133270264) | > loss_1: 32.058860778808594 (28.298729578653973) --> EVAL PERFORMANCE | > avg_loader_time: 0.01378162701924642 (+0.0010306835174560547) | > avg_loss_disc: 2.775091012318929 (-0.1734306812286377) | > avg_loss_disc_real_0: 0.1742016722758611 (-0.14087016880512235) | > avg_loss_disc_real_1: 0.3046177724997203 (+0.11921007434527081) | > avg_loss_disc_real_2: 0.3066963752110799 (+0.08985435465971628) | > avg_loss_disc_real_3: 0.2622575908899307 (-0.0009810775518417358) | > avg_loss_disc_real_4: 0.29663769404093426 (-0.02295161286989844) | > avg_loss_disc_real_5: 0.3341594437758128 (-0.0165367225805918) | > avg_loss_0: 2.775091012318929 (-0.1734306812286377) | > avg_loss_gen: 2.0820477406183877 (+0.04036986827850342) | > avg_loss_kl: 3.170508106549581 (-0.12749560674031546) | > avg_loss_feat: 3.0775779398779073 (+0.044281275322039626) | > avg_loss_mel: 17.318650643030804 (-0.38199575742085656) | > avg_loss_duration: 2.6499431133270264 (+0.028848250706990708) | > avg_loss_1: 28.298729578653973 (-0.39598846435546875)  > EPOCH: 438/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:28:19)   --> TIME: 2023-10-20 04:28:27 -- STEP: 9/50 -- GLOBAL_STEP: 74910 | > loss_disc: 2.8691134452819824 (2.5734338892830744) | > loss_disc_real_0: 0.14759179949760437 (0.13678652420639992) | > loss_disc_real_1: 0.20000095665454865 (0.25086314893431133) | > loss_disc_real_2: 0.2725156247615814 (0.27552244149976307) | > loss_disc_real_3: 0.31576547026634216 (0.26672781507174176) | > loss_disc_real_4: 0.25732049345970154 (0.2191602943672074) | > loss_disc_real_5: 0.31501564383506775 (0.2743060133523411) | > loss_0: 2.8691134452819824 (2.5734338892830744) | > grad_norm_0: tensor(443.2176, device='cuda:0') (tensor(672.1830, device='cuda:0')) | > loss_gen: 1.9553970098495483 (2.316279583507114) | > loss_kl: 1.4327259063720703 (1.0375358528561063) | > loss_feat: 2.4823617935180664 (5.019345190789965) | > loss_mel: 21.03205108642578 (19.885008176167805) | > loss_duration: 1.4999902248382568 (1.5258132881588407) | > loss_1: 28.40252685546875 (29.783982382880318) | > grad_norm_1: tensor(6451.4248, device='cuda:0') (tensor(18839.8262, device='cuda:0')) | > current_lr_0: 0.00012906162316668948 | > current_lr_1: 0.00012906162316668948 | > step_time: 0.3115 (0.3749552302890354) | > loader_time: 0.0112 (0.006711244583129883)  --> TIME: 2023-10-20 04:28:38 -- STEP: 39/50 -- GLOBAL_STEP: 74940 | > loss_disc: 2.043165922164917 (2.3941859327829795) | > loss_disc_real_0: 0.1176053136587143 (0.15766079609210676) | > loss_disc_real_1: 0.29333558678627014 (0.22984991060235563) | > loss_disc_real_2: 0.26265501976013184 (0.21926525435768637) | > loss_disc_real_3: 0.1997435986995697 (0.24002160561772493) | > loss_disc_real_4: 0.14139142632484436 (0.21405575734873614) | > loss_disc_real_5: 0.12403342127799988 (0.21891502221711936) | > loss_0: 2.043165922164917 (2.3941859327829795) | > grad_norm_0: tensor(1474.3905, device='cuda:0') (tensor(729.5264, device='cuda:0')) | > loss_gen: 2.509486675262451 (2.361104598412147) | > loss_kl: 0.7809898257255554 (0.9791903472863711) | > loss_feat: 4.436262607574463 (5.306121728383005) | > loss_mel: 20.88690185546875 (21.194463509779705) | > loss_duration: 1.6421246528625488 (1.5375876487829745) | > loss_1: 30.255765914916992 (31.37846774321337) | > grad_norm_1: tensor(33163.6602, device='cuda:0') (tensor(31255.3906, device='cuda:0')) | > current_lr_0: 0.00012906162316668948 | > current_lr_1: 0.00012906162316668948 | > step_time: 0.5433 (0.37045533229143196) | > loader_time: 0.0243 (0.007660413399720803)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.384774923324585 (2.384774923324585) | > loss_disc_real_0: 0.10208460688591003 (0.10208460688591003) | > loss_disc_real_1: 0.1932576596736908 (0.1932576596736908) | > loss_disc_real_2: 0.1686697006225586 (0.1686697006225586) | > loss_disc_real_3: 0.3334340453147888 (0.3334340453147888) | > loss_disc_real_4: 0.26447218656539917 (0.26447218656539917) | > loss_disc_real_5: 0.28195488452911377 (0.28195488452911377) | > loss_0: 2.384774923324585 (2.384774923324585) | > loss_gen: 2.3301191329956055 (2.3301191329956055) | > loss_kl: 4.515097618103027 (4.515097618103027) | > loss_feat: 6.410384654998779 (6.410384654998779) | > loss_mel: 24.304325103759766 (24.304325103759766) | > loss_duration: 2.48149037361145 (2.48149037361145) | > loss_1: 40.04141616821289 (40.04141616821289)  --> STEP: 1 | > loss_disc: 1.8150475025177002 (1.8150475025177002) | > loss_disc_real_0: 0.01645841635763645 (0.01645841635763645) | > loss_disc_real_1: 0.0567537397146225 (0.0567537397146225) | > loss_disc_real_2: 0.0907491073012352 (0.0907491073012352) | > loss_disc_real_3: 0.17819468677043915 (0.17819468677043915) | > loss_disc_real_4: 0.16330550611019135 (0.16330550611019135) | > loss_disc_real_5: 0.07275906205177307 (0.07275906205177307) | > loss_0: 1.8150475025177002 (1.8150475025177002) | > loss_gen: 2.448866844177246 (2.448866844177246) | > loss_kl: 4.7528228759765625 (4.7528228759765625) | > loss_feat: 10.730502128601074 (10.730502128601074) | > loss_mel: 25.586036682128906 (25.586036682128906) | > loss_duration: 2.7334439754486084 (2.7334439754486084) | > loss_1: 46.25167465209961 (46.25167465209961)  --> STEP: 2 | > loss_disc: 2.2648282051086426 (2.0399378538131714) | > loss_disc_real_0: 0.12835700809955597 (0.07240771222859621) | > loss_disc_real_1: 0.25517815351486206 (0.15596594661474228) | > loss_disc_real_2: 0.22668033838272095 (0.15871472284197807) | > loss_disc_real_3: 0.24445775151252747 (0.2113262191414833) | > loss_disc_real_4: 0.2051936686038971 (0.18424958735704422) | > loss_disc_real_5: 0.210452139377594 (0.14160560071468353) | > loss_0: 2.2648282051086426 (2.0399378538131714) | > loss_gen: 2.2999157905578613 (2.3743913173675537) | > loss_kl: 4.228387355804443 (4.490605115890503) | > loss_feat: 8.573418617248535 (9.651960372924805) | > loss_mel: 26.53524398803711 (26.060640335083008) | > loss_duration: 2.6069393157958984 (2.6701916456222534) | > loss_1: 44.24390411376953 (45.24778938293457)  --> STEP: 3 | > loss_disc: 2.7848711013793945 (2.2882489363352456) | > loss_disc_real_0: 0.16364461183547974 (0.10282001209755738) | > loss_disc_real_1: 0.36459973454475403 (0.22551054259141287) | > loss_disc_real_2: 0.2542007267475128 (0.19054339081048965) | > loss_disc_real_3: 0.2964719831943512 (0.23970814049243927) | > loss_disc_real_4: 0.3402307331562042 (0.23624330262343088) | > loss_disc_real_5: 0.4491959810256958 (0.24413572748502096) | > loss_0: 2.7848711013793945 (2.2882489363352456) | > loss_gen: 2.446964979171753 (2.3985825379689536) | > loss_kl: 1.9740022420883179 (3.6517374912897744) | > loss_feat: 3.892056465148926 (7.731992403666179) | > loss_mel: 23.690919876098633 (25.27073351542155) | > loss_duration: 2.5864546298980713 (2.642279307047526) | > loss_1: 34.59040069580078 (41.695326487223305) --> EVAL PERFORMANCE | > avg_loader_time: 0.00690770149230957 (-0.0068739255269368495) | > avg_loss_disc: 2.2882489363352456 (-0.48684207598368356) | > avg_loss_disc_real_0: 0.10282001209755738 (-0.07138166017830373) | > avg_loss_disc_real_1: 0.22551054259141287 (-0.0791072299083074) | > avg_loss_disc_real_2: 0.19054339081048965 (-0.11615298440059024) | > avg_loss_disc_real_3: 0.23970814049243927 (-0.022549450397491455) | > avg_loss_disc_real_4: 0.23624330262343088 (-0.060394391417503385) | > avg_loss_disc_real_5: 0.24413572748502096 (-0.09002371629079184) | > avg_loss_0: 2.2882489363352456 (-0.48684207598368356) | > avg_loss_gen: 2.3985825379689536 (+0.3165347973505659) | > avg_loss_kl: 3.6517374912897744 (+0.4812293847401934) | > avg_loss_feat: 7.731992403666179 (+4.654414463788271) | > avg_loss_mel: 25.27073351542155 (+7.952082872390747) | > avg_loss_duration: 2.642279307047526 (-0.0076638062795004736) | > avg_loss_1: 41.695326487223305 (+13.396596908569332)  > EPOCH: 439/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:28:54)   --> TIME: 2023-10-20 04:29:08 -- STEP: 19/50 -- GLOBAL_STEP: 74970 | > loss_disc: 2.34002423286438 (2.393171191215515) | > loss_disc_real_0: 0.18901827931404114 (0.14312586364777466) | > loss_disc_real_1: 0.28603440523147583 (0.2396678124603472) | > loss_disc_real_2: 0.36939531564712524 (0.23898702938305705) | > loss_disc_real_3: 0.26614683866500854 (0.2528575535275434) | > loss_disc_real_4: 0.19490784406661987 (0.2594337347698839) | > loss_disc_real_5: 0.1894831508398056 (0.23194023045270065) | > loss_0: 2.34002423286438 (2.393171191215515) | > grad_norm_0: tensor(1240.1633, device='cuda:0') (tensor(1527.8514, device='cuda:0')) | > loss_gen: 2.702552080154419 (2.625383602945428) | > loss_kl: 1.1690773963928223 (0.9803078896120975) | > loss_feat: 5.973716735839844 (6.433653111814668) | > loss_mel: 24.152305603027344 (24.291371558841906) | > loss_duration: 1.740947961807251 (1.5715818154184442) | > loss_1: 35.73859786987305 (35.902297321118816) | > grad_norm_1: tensor(10868.5859, device='cuda:0') (tensor(72838.1484, device='cuda:0')) | > current_lr_0: 0.00012893261799386895 | > current_lr_1: 0.00012893261799386895 | > step_time: 0.2793 (0.5054452795731393) | > loader_time: 0.0036 (0.016672711623342412)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.650951862335205 (2.650951862335205) | > loss_disc_real_0: 0.24856986105442047 (0.24856986105442047) | > loss_disc_real_1: 0.273029088973999 (0.273029088973999) | > loss_disc_real_2: 0.3349461257457733 (0.3349461257457733) | > loss_disc_real_3: 0.3242391049861908 (0.3242391049861908) | > loss_disc_real_4: 0.2572881579399109 (0.2572881579399109) | > loss_disc_real_5: 0.2336244285106659 (0.2336244285106659) | > loss_0: 2.650951862335205 (2.650951862335205) | > loss_gen: 2.3161990642547607 (2.3161990642547607) | > loss_kl: 4.143189430236816 (4.143189430236816) | > loss_feat: 3.544034242630005 (3.544034242630005) | > loss_mel: 24.82376480102539 (24.82376480102539) | > loss_duration: 2.4800422191619873 (2.4800422191619873) | > loss_1: 37.307228088378906 (37.307228088378906)  --> STEP: 1 | > loss_disc: 2.404050827026367 (2.404050827026367) | > loss_disc_real_0: 0.15876837074756622 (0.15876837074756622) | > loss_disc_real_1: 0.1309804618358612 (0.1309804618358612) | > loss_disc_real_2: 0.10984436422586441 (0.10984436422586441) | > loss_disc_real_3: 0.19811779260635376 (0.19811779260635376) | > loss_disc_real_4: 0.08639552444219589 (0.08639552444219589) | > loss_disc_real_5: 0.14823049306869507 (0.14823049306869507) | > loss_0: 2.404050827026367 (2.404050827026367) | > loss_gen: 2.0979671478271484 (2.0979671478271484) | > loss_kl: 3.699132204055786 (3.699132204055786) | > loss_feat: 10.005556106567383 (10.005556106567383) | > loss_mel: 27.310089111328125 (27.310089111328125) | > loss_duration: 2.822200298309326 (2.822200298309326) | > loss_1: 45.9349479675293 (45.9349479675293)  --> STEP: 2 | > loss_disc: 4.005683422088623 (3.204867124557495) | > loss_disc_real_0: 0.38937652111053467 (0.27407244592905045) | > loss_disc_real_1: 0.2516355514526367 (0.19130800664424896) | > loss_disc_real_2: 0.23017114400863647 (0.17000775411725044) | > loss_disc_real_3: 0.3275398015975952 (0.2628287971019745) | > loss_disc_real_4: 0.21959912776947021 (0.15299732610583305) | > loss_disc_real_5: 0.29656273126602173 (0.2223966121673584) | > loss_0: 4.005683422088623 (3.204867124557495) | > loss_gen: 1.157516598701477 (1.6277418732643127) | > loss_kl: 3.893134355545044 (3.796133279800415) | > loss_feat: 7.040658950805664 (8.523107528686523) | > loss_mel: 23.831815719604492 (25.57095241546631) | > loss_duration: 2.671860456466675 (2.7470303773880005) | > loss_1: 38.59498596191406 (42.26496696472168)  --> STEP: 3 | > loss_disc: 1.9320250749588013 (2.7805864413579306) | > loss_disc_real_0: 0.11220352351665497 (0.22011613845825195) | > loss_disc_real_1: 0.1993057280778885 (0.19397391378879547) | > loss_disc_real_2: 0.1441284418106079 (0.16138131668170294) | > loss_disc_real_3: 0.29333212971687317 (0.27299657464027405) | > loss_disc_real_4: 0.2157650738954544 (0.1739199087023735) | > loss_disc_real_5: 0.20182588696479797 (0.21553970376650491) | > loss_0: 1.9320250749588013 (2.7805864413579306) | > loss_gen: 3.1277077198028564 (2.1277304887771606) | > loss_kl: 1.9716755151748657 (3.1879806915918985) | > loss_feat: 6.37443733215332 (7.806884129842122) | > loss_mel: 21.557510375976562 (24.23313840230306) | > loss_duration: 2.630075216293335 (2.708045323689779) | > loss_1: 35.66140365600586 (40.06377919514974)  --> TIME: 2023-10-20 04:29:25 -- STEP: 49/50 -- GLOBAL_STEP: 75000 | > loss_disc: 2.11635422706604 (2.4895394675585685) | > loss_disc_real_0: 0.11807537823915482 (0.15779858090135515) | > loss_disc_real_1: 0.1688951998949051 (0.22763856135460794) | > loss_disc_real_2: 0.1806054711341858 (0.22822500734913106) | > loss_disc_real_3: 0.2771371603012085 (0.23692782975885332) | > loss_disc_real_4: 0.2164311408996582 (0.24480975183601275) | > loss_disc_real_5: 0.1890784502029419 (0.23956653943323358) | > loss_0: 2.11635422706604 (2.4895394675585685) | > grad_norm_0: tensor(1626.9033, device='cuda:0') (tensor(1261.6826, device='cuda:0')) | > loss_gen: 2.599536895751953 (2.331220132963998) | > loss_kl: 0.9423992037773132 (0.8584380265401335) | > loss_feat: 5.2830891609191895 (5.160067217196434) | > loss_mel: 25.605810165405273 (23.32366358990572) | > loss_duration: 1.7152191400527954 (1.5317567805854642) | > loss_1: 36.146053314208984 (33.20514550500987) | > grad_norm_1: tensor(47366.0664, device='cuda:0') (tensor(43549.0156, device='cuda:0')) | > current_lr_0: 0.00012893261799386895 | > current_lr_1: 0.00012893261799386895 | > step_time: 0.8642 (0.40513794276179094) | > loader_time: 6.8695 (0.14981435756294095) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_75000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6765530109405518 (2.754578083753586) | > loss_disc_real_0: 0.22951889038085938 (0.2224668264389038) | > loss_disc_real_1: 0.1780371218919754 (0.18998971581459045) | > loss_disc_real_2: 0.10050233453512192 (0.14616157114505768) | > loss_disc_real_3: 0.4132930338382721 (0.30807068943977356) | > loss_disc_real_4: 0.04293552413582802 (0.14117381256073713) | > loss_disc_real_5: 0.28235724568367004 (0.2322440892457962) | > loss_0: 2.6765530109405518 (2.754578083753586) | > loss_gen: 1.999817132949829 (2.0957521498203278) | > loss_kl: 4.137615203857422 (3.4253893196582794) | > loss_feat: 7.614701271057129 (7.758838415145874) | > loss_mel: 23.80112075805664 (24.125133991241455) | > loss_duration: 2.5066139698028564 (2.657687485218048) | > loss_1: 40.05986785888672 (40.062801361083984)  --> STEP: 1 | > loss_disc: 2.7564563751220703 (2.7549537420272827) | > loss_disc_real_0: 0.1639154851436615 (0.21075655817985534) | > loss_disc_real_1: 0.17902423441410065 (0.1877966195344925) | > loss_disc_real_2: 0.13667631149291992 (0.14426451921463013) | > loss_disc_real_3: 0.4622962176799774 (0.33891579508781433) | > loss_disc_real_4: 0.21394911408424377 (0.15572887286543846) | > loss_disc_real_5: 0.27065327763557434 (0.23992592692375184) | > loss_0: 2.7564563751220703 (2.7549537420272827) | > loss_gen: 2.2271125316619873 (2.1220242261886595) | > loss_kl: 4.0543293952941895 (3.5511773347854616) | > loss_feat: 6.758635997772217 (7.558797931671142) | > loss_mel: 20.4962215423584 (23.399351501464842) | > loss_duration: 2.771256446838379 (2.6804012775421144) | > loss_1: 36.30755615234375 (39.31175231933594)  --> STEP: 2 | > loss_disc: 2.978400230407715 (2.7921948234240213) | > loss_disc_real_0: 0.2721320390701294 (0.22098580499490103) | > loss_disc_real_1: 0.2209598422050476 (0.19332382331291834) | > loss_disc_real_2: 0.2634789049625397 (0.1641335835059484) | > loss_disc_real_3: 0.3092152178287506 (0.3339656988779704) | > loss_disc_real_4: 0.27787116169929504 (0.17608592100441456) | > loss_disc_real_5: 0.26759546995162964 (0.24453751742839813) | > loss_0: 2.978400230407715 (2.7921948234240213) | > loss_gen: 1.6473376750946045 (2.042909801006317) | > loss_kl: 4.290579319000244 (3.6744109988212585) | > loss_feat: 0.08550379425287247 (6.313248908768098) | > loss_mel: 2.778817892074585 (19.9625958998998) | > loss_duration: 2.6619675159454346 (2.6773289839426675) | > loss_1: 11.464205741882324 (34.670494556427)  --> STEP: 3 | > loss_disc: 2.916325330734253 (2.809927753039769) | > loss_disc_real_0: 0.2938995361328125 (0.23140205230031693) | > loss_disc_real_1: 0.2456197589635849 (0.20079467126301356) | > loss_disc_real_2: 0.26652488112449646 (0.17876091173716954) | > loss_disc_real_3: 0.310028076171875 (0.3305460384913853) | > loss_disc_real_4: 0.2754884362220764 (0.19028628032122338) | > loss_disc_real_5: 0.2682496905326843 (0.24792497072901046) | > loss_0: 2.916325330734253 (2.809927753039769) | > loss_gen: 1.807261347770691 (2.0092457362583707) | > loss_kl: 1.6794718503952026 (3.3894196919032504) | > loss_feat: 0.37371692061424255 (5.464744339031832) | > loss_mel: 15.470044136047363 (19.320802790778025) | > loss_duration: 2.640123128890991 (2.6720138617924283) | > loss_1: 21.970617294311523 (32.85622637612479) --> EVAL PERFORMANCE | > avg_loader_time: 0.3553814547402518 (+0.3484737532479422) | > avg_loss_disc: 2.809927753039769 (+0.5216788167045232) | > avg_loss_disc_real_0: 0.23140205230031693 (+0.12858204020275954) | > avg_loss_disc_real_1: 0.20079467126301356 (-0.024715871328399308) | > avg_loss_disc_real_2: 0.17876091173716954 (-0.011782479073320112) | > avg_loss_disc_real_3: 0.3305460384913853 (+0.09083789799894604) | > avg_loss_disc_real_4: 0.19028628032122338 (-0.045957022302207495) | > avg_loss_disc_real_5: 0.24792497072901046 (+0.003789243243989493) | > avg_loss_0: 2.809927753039769 (+0.5216788167045232) | > avg_loss_gen: 2.0092457362583707 (-0.38933680171058294) | > avg_loss_kl: 3.3894196919032504 (-0.262317799386524) | > avg_loss_feat: 5.464744339031832 (-2.2672480646343462) | > avg_loss_mel: 19.320802790778025 (-5.949930724643526) | > avg_loss_duration: 2.6720138617924283 (+0.029734554744902386) | > avg_loss_1: 32.85622637612479 (-8.839100111098517)  > EPOCH: 440/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:29:37)   --> TIME: 2023-10-20 04:29:56 -- STEP: 29/50 -- GLOBAL_STEP: 75030 | > loss_disc: 2.764556884765625 (2.6291955709457397) | > loss_disc_real_0: 0.10393611341714859 (0.1516000133264681) | > loss_disc_real_1: 0.33910319209098816 (0.2329556263726333) | > loss_disc_real_2: 0.20552979409694672 (0.23687833470517192) | > loss_disc_real_3: 0.2669696509838104 (0.24203764242601805) | > loss_disc_real_4: 0.21007461845874786 (0.24716765407858227) | > loss_disc_real_5: 0.2187831997871399 (0.25643723880358305) | > loss_0: 2.764556884765625 (2.6291955709457397) | > grad_norm_0: tensor(1045.7478, device='cuda:0') (tensor(1613.0193, device='cuda:0')) | > loss_gen: 1.6829180717468262 (2.3000391433978904) | > loss_kl: 0.8809860944747925 (0.8965305274930494) | > loss_feat: 1.2941431999206543 (5.212805013718276) | > loss_mel: 18.38718605041504 (20.79205542597277) | > loss_duration: 1.5131654739379883 (1.535016392839366) | > loss_1: 23.758399963378906 (30.736446232631288) | > grad_norm_1: tensor(13505.4229, device='cuda:0') (tensor(38238.3242, device='cuda:0')) | > current_lr_0: 0.00012880374176979563 | > current_lr_1: 0.00012880374176979563 | > step_time: 0.5779 (0.5116429082278547) | > loader_time: 0.0184 (0.02175335226387813)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.00704026222229 (3.00704026222229) | > loss_disc_real_0: 0.19738537073135376 (0.19738537073135376) | > loss_disc_real_1: 0.3089290261268616 (0.3089290261268616) | > loss_disc_real_2: 0.2738896608352661 (0.2738896608352661) | > loss_disc_real_3: 0.3066630959510803 (0.3066630959510803) | > loss_disc_real_4: 0.2968529760837555 (0.2968529760837555) | > loss_disc_real_5: 0.3207422196865082 (0.3207422196865082) | > loss_0: 3.00704026222229 (3.00704026222229) | > loss_gen: 1.887326955795288 (1.887326955795288) | > loss_kl: 4.395064830780029 (4.395064830780029) | > loss_feat: 4.125049591064453 (4.125049591064453) | > loss_mel: 23.61966896057129 (23.61966896057129) | > loss_duration: 2.5302093029022217 (2.5302093029022217) | > loss_1: 36.55731964111328 (36.55731964111328)  --> STEP: 1 | > loss_disc: 3.032271146774292 (3.032271146774292) | > loss_disc_real_0: 0.33339983224868774 (0.33339983224868774) | > loss_disc_real_1: 0.3206634521484375 (0.3206634521484375) | > loss_disc_real_2: 0.35803934931755066 (0.35803934931755066) | > loss_disc_real_3: 0.2558004558086395 (0.2558004558086395) | > loss_disc_real_4: 0.2864879071712494 (0.2864879071712494) | > loss_disc_real_5: 0.31687748432159424 (0.31687748432159424) | > loss_0: 3.032271146774292 (3.032271146774292) | > loss_gen: 1.962195873260498 (1.962195873260498) | > loss_kl: 3.9092161655426025 (3.9092161655426025) | > loss_feat: 0.5420026183128357 (0.5420026183128357) | > loss_mel: 11.866722106933594 (11.866722106933594) | > loss_duration: 2.850532054901123 (2.850532054901123) | > loss_1: 21.13066864013672 (21.13066864013672)  --> STEP: 2 | > loss_disc: 3.052372932434082 (3.042322039604187) | > loss_disc_real_0: 0.3328332304954529 (0.3331165313720703) | > loss_disc_real_1: 0.31779173016548157 (0.31922759115695953) | > loss_disc_real_2: 0.35879069566726685 (0.35841502249240875) | > loss_disc_real_3: 0.2530825436115265 (0.254441499710083) | > loss_disc_real_4: 0.2936418652534485 (0.29006488621234894) | > loss_disc_real_5: 0.3177326023578644 (0.3173050433397293) | > loss_0: 3.052372932434082 (3.042322039604187) | > loss_gen: 1.9084720611572266 (1.9353339672088623) | > loss_kl: 4.818875312805176 (4.364045739173889) | > loss_feat: 0.4066653251647949 (0.4743339717388153) | > loss_mel: 3.320622682571411 (7.593672394752502) | > loss_duration: 2.814552068710327 (2.832542061805725) | > loss_1: 13.269187927246094 (17.199928283691406)  --> STEP: 3 | > loss_disc: 2.2564332485198975 (2.7803591092427573) | > loss_disc_real_0: 0.22412538528442383 (0.2967861493428548) | > loss_disc_real_1: 0.3042448163032532 (0.31423333287239075) | > loss_disc_real_2: 0.29718950390815735 (0.33800651629765827) | > loss_disc_real_3: 0.32806336879730225 (0.27898212273915607) | > loss_disc_real_4: 0.11058983951807022 (0.23023987064758936) | > loss_disc_real_5: 0.20551109313964844 (0.2800403932730357) | > loss_0: 2.2564332485198975 (2.7803591092427573) | > loss_gen: 2.793809413909912 (2.2214924494425454) | > loss_kl: 1.8047592639923096 (3.510950247446696) | > loss_feat: 5.241262912750244 (2.0633102854092917) | > loss_mel: 27.527969360351562 (14.238438049952189) | > loss_duration: 2.554718017578125 (2.739934047063192) | > loss_1: 39.922515869140625 (24.774124145507812) --> EVAL PERFORMANCE | > avg_loader_time: 0.020541906356811523 (-0.33483954838344027) | > avg_loss_disc: 2.7803591092427573 (-0.029568643797011518) | > avg_loss_disc_real_0: 0.2967861493428548 (+0.06538409704253786) | > avg_loss_disc_real_1: 0.31423333287239075 (+0.11343866160937718) | > avg_loss_disc_real_2: 0.33800651629765827 (+0.15924560456048872) | > avg_loss_disc_real_3: 0.27898212273915607 (-0.05156391575222924) | > avg_loss_disc_real_4: 0.23023987064758936 (+0.03995359032636597) | > avg_loss_disc_real_5: 0.2800403932730357 (+0.032115422544025246) | > avg_loss_0: 2.7803591092427573 (-0.029568643797011518) | > avg_loss_gen: 2.2214924494425454 (+0.21224671318417476) | > avg_loss_kl: 3.510950247446696 (+0.12153055554344538) | > avg_loss_feat: 2.0633102854092917 (-3.4014340536225407) | > avg_loss_mel: 14.238438049952189 (-5.082364740825836) | > avg_loss_duration: 2.739934047063192 (+0.0679201852707636) | > avg_loss_1: 24.774124145507812 (-8.082102230616975)  > EPOCH: 441/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:30:16)   --> TIME: 2023-10-20 04:30:28 -- STEP: 9/50 -- GLOBAL_STEP: 75060 | > loss_disc: 2.9462890625 (2.4669739405314126) | > loss_disc_real_0: 0.19750429689884186 (0.14359374675485823) | > loss_disc_real_1: 0.3174176812171936 (0.2549390354090267) | > loss_disc_real_2: 0.37953150272369385 (0.25887517010172206) | > loss_disc_real_3: 0.3408925533294678 (0.24472524432672393) | > loss_disc_real_4: 0.2904838025569916 (0.21071623803840744) | > loss_disc_real_5: 0.31436774134635925 (0.19970115098274416) | > loss_0: 2.9462890625 (2.4669739405314126) | > grad_norm_0: tensor(1808.4700, device='cuda:0') (tensor(1077.6139, device='cuda:0')) | > loss_gen: 2.2272486686706543 (2.3297768433888755) | > loss_kl: 0.919596791267395 (1.0592396126853094) | > loss_feat: 2.176745653152466 (6.445074743694729) | > loss_mel: 22.3737735748291 (23.236173099941677) | > loss_duration: 1.4435176849365234 (1.5415669282277424) | > loss_1: 29.14088249206543 (34.611830393473305) | > grad_norm_1: tensor(6449.1763, device='cuda:0') (tensor(33893.9727, device='cuda:0')) | > current_lr_0: 0.0001286749943655771 | > current_lr_1: 0.0001286749943655771 | > step_time: 0.5765 (0.5309815406799316) | > loader_time: 0.0133 (0.017883857091267902)  --> TIME: 2023-10-20 04:30:43 -- STEP: 39/50 -- GLOBAL_STEP: 75090 | > loss_disc: 3.0144753456115723 (2.4800349412820277) | > loss_disc_real_0: 0.18493254482746124 (0.1461474082122247) | > loss_disc_real_1: 0.3166101574897766 (0.23606119247583243) | > loss_disc_real_2: 0.269255667924881 (0.23424724709147063) | > loss_disc_real_3: 0.3117326498031616 (0.2400496498896525) | > loss_disc_real_4: 0.2859463393688202 (0.24116212444809768) | > loss_disc_real_5: 0.27369117736816406 (0.24701478368101212) | > loss_0: 3.0144753456115723 (2.4800349412820277) | > grad_norm_0: tensor(855.5252, device='cuda:0') (tensor(1196.5300, device='cuda:0')) | > loss_gen: 1.692772388458252 (2.342407015653757) | > loss_kl: 0.4700895845890045 (0.9123051915413294) | > loss_feat: 0.044337768107652664 (5.467386397127157) | > loss_mel: 3.5409913063049316 (23.612849027682575) | > loss_duration: 1.6031372547149658 (1.5411858497521813) | > loss_1: 7.351327896118164 (33.87613340524528) | > grad_norm_1: tensor(71476.1875, device='cuda:0') (tensor(32549.1797, device='cuda:0')) | > current_lr_0: 0.0001286749943655771 | > current_lr_1: 0.0001286749943655771 | > step_time: 0.4837 (0.4959233418489114) | > loader_time: 0.017 (0.019997902405567657)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9436962604522705 (1.9436962604522705) | > loss_disc_real_0: 0.29089194536209106 (0.29089194536209106) | > loss_disc_real_1: 0.20536741614341736 (0.20536741614341736) | > loss_disc_real_2: 0.06600920110940933 (0.06600920110940933) | > loss_disc_real_3: 0.10476096719503403 (0.10476096719503403) | > loss_disc_real_4: 0.04823348671197891 (0.04823348671197891) | > loss_disc_real_5: 0.11080411076545715 (0.11080411076545715) | > loss_0: 1.9436962604522705 (1.9436962604522705) | > loss_gen: 2.3122646808624268 (2.3122646808624268) | > loss_kl: 2.558528184890747 (2.558528184890747) | > loss_feat: 8.667526245117188 (8.667526245117188) | > loss_mel: 25.455507278442383 (25.455507278442383) | > loss_duration: 2.5376296043395996 (2.5376296043395996) | > loss_1: 41.53145217895508 (41.53145217895508)  --> STEP: 1 | > loss_disc: 2.1643145084381104 (2.1643145084381104) | > loss_disc_real_0: 0.07434665411710739 (0.07434665411710739) | > loss_disc_real_1: 0.18725189566612244 (0.18725189566612244) | > loss_disc_real_2: 0.10856413841247559 (0.10856413841247559) | > loss_disc_real_3: 0.16844542324543 (0.16844542324543) | > loss_disc_real_4: 0.16541320085525513 (0.16541320085525513) | > loss_disc_real_5: 0.1822827309370041 (0.1822827309370041) | > loss_0: 2.1643145084381104 (2.1643145084381104) | > loss_gen: 2.130703926086426 (2.130703926086426) | > loss_kl: 4.360297203063965 (4.360297203063965) | > loss_feat: 7.195910453796387 (7.195910453796387) | > loss_mel: 23.114410400390625 (23.114410400390625) | > loss_duration: 2.9434895515441895 (2.9434895515441895) | > loss_1: 39.744808197021484 (39.744808197021484)  --> STEP: 2 | > loss_disc: 2.1711390018463135 (2.167726755142212) | > loss_disc_real_0: 0.26116299629211426 (0.16775482520461082) | > loss_disc_real_1: 0.2053757905960083 (0.19631384313106537) | > loss_disc_real_2: 0.17481963336467743 (0.1416918858885765) | > loss_disc_real_3: 0.2361508011817932 (0.2022981122136116) | > loss_disc_real_4: 0.11488521099090576 (0.14014920592308044) | > loss_disc_real_5: 0.14169004559516907 (0.16198638826608658) | > loss_0: 2.1711390018463135 (2.167726755142212) | > loss_gen: 2.2770111560821533 (2.2038575410842896) | > loss_kl: 4.555962562561035 (4.4581298828125) | > loss_feat: 6.0927557945251465 (6.644333124160767) | > loss_mel: 21.894367218017578 (22.5043888092041) | > loss_duration: 2.6792075634002686 (2.811348557472229) | > loss_1: 37.49930191040039 (38.62205505371094)  --> STEP: 3 | > loss_disc: 2.7063496112823486 (2.3472677071889243) | > loss_disc_real_0: 0.16655626893043518 (0.16735530644655228) | > loss_disc_real_1: 0.26234033703804016 (0.2183226744333903) | > loss_disc_real_2: 0.2835080921649933 (0.1889639546473821) | > loss_disc_real_3: 0.3285914957523346 (0.24439590672651926) | > loss_disc_real_4: 0.4486749768257141 (0.24299112955729166) | > loss_disc_real_5: 0.3907465636730194 (0.23823978006839752) | > loss_0: 2.7063496112823486 (2.3472677071889243) | > loss_gen: 2.7738490104675293 (2.3938546975453696) | > loss_kl: 2.179307460784912 (3.698522408803304) | > loss_feat: 4.5923237800598145 (5.960330009460449) | > loss_mel: 21.98663902282715 (22.33180554707845) | > loss_duration: 2.6370487213134766 (2.753248612085978) | > loss_1: 34.169166564941406 (37.13775889078776) --> EVAL PERFORMANCE | > avg_loader_time: 0.011159102121988932 (-0.009382804234822592) | > avg_loss_disc: 2.3472677071889243 (-0.433091402053833) | > avg_loss_disc_real_0: 0.16735530644655228 (-0.12943084289630252) | > avg_loss_disc_real_1: 0.2183226744333903 (-0.09591065843900046) | > avg_loss_disc_real_2: 0.1889639546473821 (-0.14904256165027616) | > avg_loss_disc_real_3: 0.24439590672651926 (-0.03458621601263681) | > avg_loss_disc_real_4: 0.24299112955729166 (+0.012751258909702301) | > avg_loss_disc_real_5: 0.23823978006839752 (-0.04180061320463818) | > avg_loss_0: 2.3472677071889243 (-0.433091402053833) | > avg_loss_gen: 2.3938546975453696 (+0.1723622481028242) | > avg_loss_kl: 3.698522408803304 (+0.18757216135660837) | > avg_loss_feat: 5.960330009460449 (+3.8970197240511575) | > avg_loss_mel: 22.33180554707845 (+8.09336749712626) | > avg_loss_duration: 2.753248612085978 (+0.013314565022786162) | > avg_loss_1: 37.13775889078776 (+12.363634745279946)  > EPOCH: 442/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:31:00)   --> TIME: 2023-10-20 04:31:11 -- STEP: 19/50 -- GLOBAL_STEP: 75120 | > loss_disc: 2.3959450721740723 (2.3481816053390503) | > loss_disc_real_0: 0.020263297483325005 (0.15027879619676815) | > loss_disc_real_1: 0.05664125457406044 (0.22064815010679395) | > loss_disc_real_2: 0.059410229325294495 (0.2192362746910045) | > loss_disc_real_3: 0.11615734547376633 (0.24496473264145224) | > loss_disc_real_4: 0.1016419380903244 (0.21174003713225065) | > loss_disc_real_5: 0.19773732125759125 (0.2133241639913697) | > loss_0: 2.3959450721740723 (2.3481816053390503) | > grad_norm_0: tensor(1718.0812, device='cuda:0') (tensor(1236.1984, device='cuda:0')) | > loss_gen: 2.1196200847625732 (2.5102289601376184) | > loss_kl: 1.1409441232681274 (0.8676339921198393) | > loss_feat: 9.077143669128418 (6.762065899999518) | > loss_mel: 26.419601440429688 (23.83165444825825) | > loss_duration: 1.609480857849121 (1.5980872041300724) | > loss_1: 40.366790771484375 (35.569670727378444) | > grad_norm_1: tensor(82781.7109, device='cuda:0') (tensor(50961.4102, device='cuda:0')) | > current_lr_0: 0.00012854637565244993 | > current_lr_1: 0.00012854637565244993 | > step_time: 0.6729 (0.3467584158244886) | > loader_time: 0.022 (0.008268569645128752)  --> TIME: 2023-10-20 04:31:26 -- STEP: 49/50 -- GLOBAL_STEP: 75150 | > loss_disc: 2.728126287460327 (2.4195216237282264) | > loss_disc_real_0: 0.06736940145492554 (0.14001615558351793) | > loss_disc_real_1: 0.25494384765625 (0.22088909658546352) | > loss_disc_real_2: 0.21477118134498596 (0.21691613937062876) | > loss_disc_real_3: 0.2504255771636963 (0.25209400890281) | > loss_disc_real_4: 0.2607536315917969 (0.22684112822218816) | > loss_disc_real_5: 0.27624180912971497 (0.22614337218811317) | > loss_0: 2.728126287460327 (2.4195216237282264) | > grad_norm_0: tensor(2169.4900, device='cuda:0') (tensor(1122.1503, device='cuda:0')) | > loss_gen: 1.7899267673492432 (2.4072605274161525) | > loss_kl: 0.8513512015342712 (0.839991212499385) | > loss_feat: 1.6584810018539429 (5.889952870047822) | > loss_mel: 20.985414505004883 (22.993501998940292) | > loss_duration: 1.6207630634307861 (1.5419131906665102) | > loss_1: 26.90593719482422 (33.67261996561168) | > grad_norm_1: tensor(6101.9609, device='cuda:0') (tensor(43007.6914, device='cuda:0')) | > current_lr_0: 0.00012854637565244993 | > current_lr_1: 0.00012854637565244993 | > step_time: 0.6285 (0.41950652064109334) | > loader_time: 0.3863 (0.0177279637784374)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8546946048736572 (2.8546946048736572) | > loss_disc_real_0: 0.1532021313905716 (0.1532021313905716) | > loss_disc_real_1: 0.2551546096801758 (0.2551546096801758) | > loss_disc_real_2: 0.27798929810523987 (0.27798929810523987) | > loss_disc_real_3: 0.22256749868392944 (0.22256749868392944) | > loss_disc_real_4: 0.25532206892967224 (0.25532206892967224) | > loss_disc_real_5: 0.2509809136390686 (0.2509809136390686) | > loss_0: 2.8546946048736572 (2.8546946048736572) | > loss_gen: 1.602174997329712 (1.602174997329712) | > loss_kl: 3.3393068313598633 (3.3393068313598633) | > loss_feat: 0.751566469669342 (0.751566469669342) | > loss_mel: 18.470251083374023 (18.470251083374023) | > loss_duration: 2.656704902648926 (2.656704902648926) | > loss_1: 26.820003509521484 (26.820003509521484)  --> STEP: 1 | > loss_disc: 2.7530689239501953 (2.7530689239501953) | > loss_disc_real_0: 0.20583575963974 (0.20583575963974) | > loss_disc_real_1: 0.354277640581131 (0.354277640581131) | > loss_disc_real_2: 0.2227836400270462 (0.2227836400270462) | > loss_disc_real_3: 0.3692040741443634 (0.3692040741443634) | > loss_disc_real_4: 0.3434361219406128 (0.3434361219406128) | > loss_disc_real_5: 0.28207850456237793 (0.28207850456237793) | > loss_0: 2.7530689239501953 (2.7530689239501953) | > loss_gen: 2.615689516067505 (2.615689516067505) | > loss_kl: 3.794349193572998 (3.794349193572998) | > loss_feat: 5.903905868530273 (5.903905868530273) | > loss_mel: 21.835535049438477 (21.835535049438477) | > loss_duration: 2.8602452278137207 (2.8602452278137207) | > loss_1: 37.00972366333008 (37.00972366333008)  --> STEP: 2 | > loss_disc: 2.478940010070801 (2.616004467010498) | > loss_disc_real_0: 0.23553234338760376 (0.22068405151367188) | > loss_disc_real_1: 0.2958967387676239 (0.32508718967437744) | > loss_disc_real_2: 0.4106791317462921 (0.31673138588666916) | > loss_disc_real_3: 0.20114165544509888 (0.28517286479473114) | > loss_disc_real_4: 0.1819908767938614 (0.2627134993672371) | > loss_disc_real_5: 0.17859910428524017 (0.23033880442380905) | > loss_0: 2.478940010070801 (2.616004467010498) | > loss_gen: 2.963831663131714 (2.7897605895996094) | > loss_kl: 4.5209574699401855 (4.157653331756592) | > loss_feat: 11.731084823608398 (8.817495346069336) | > loss_mel: 26.343202590942383 (24.08936882019043) | > loss_duration: 2.653810977935791 (2.757028102874756) | > loss_1: 48.212890625 (42.61130714416504)  --> STEP: 3 | > loss_disc: 2.8129420280456543 (2.6816503206888833) | > loss_disc_real_0: 0.2779553532600403 (0.23977448542912802) | > loss_disc_real_1: 0.18307794630527496 (0.27775077521800995) | > loss_disc_real_2: 0.2440706044435501 (0.29251112540562946) | > loss_disc_real_3: 0.2601446807384491 (0.27683013677597046) | > loss_disc_real_4: 0.14850832521915436 (0.22464510798454285) | > loss_disc_real_5: 0.2512686848640442 (0.23731543123722076) | > loss_0: 2.8129420280456543 (2.6816503206888833) | > loss_gen: 2.432326078414917 (2.6706157525380454) | > loss_kl: 1.8323413133621216 (3.3825493256251016) | > loss_feat: 5.617825508117676 (7.750938733418782) | > loss_mel: 25.419315338134766 (24.532684326171875) | > loss_duration: 2.6531853675842285 (2.7224138577779136) | > loss_1: 37.95499801635742 (41.0592041015625) --> EVAL PERFORMANCE | > avg_loader_time: 0.0021723111470540366 (-0.008986790974934895) | > avg_loss_disc: 2.6816503206888833 (+0.334382613499959) | > avg_loss_disc_real_0: 0.23977448542912802 (+0.07241917898257574) | > avg_loss_disc_real_1: 0.27775077521800995 (+0.05942810078461966) | > avg_loss_disc_real_2: 0.29251112540562946 (+0.10354717075824735) | > avg_loss_disc_real_3: 0.27683013677597046 (+0.0324342300494512) | > avg_loss_disc_real_4: 0.22464510798454285 (-0.01834602157274881) | > avg_loss_disc_real_5: 0.23731543123722076 (-0.0009243488311767578) | > avg_loss_0: 2.6816503206888833 (+0.334382613499959) | > avg_loss_gen: 2.6706157525380454 (+0.2767610549926758) | > avg_loss_kl: 3.3825493256251016 (-0.3159730831782026) | > avg_loss_feat: 7.750938733418782 (+1.790608723958333) | > avg_loss_mel: 24.532684326171875 (+2.2008787790934257) | > avg_loss_duration: 2.7224138577779136 (-0.030834754308064483) | > avg_loss_1: 41.0592041015625 (+3.921445210774742)  > EPOCH: 443/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:31:35)   --> TIME: 2023-10-20 04:31:54 -- STEP: 29/50 -- GLOBAL_STEP: 75180 | > loss_disc: 2.348203182220459 (2.259010886323863) | > loss_disc_real_0: 0.04185621440410614 (0.13811514333918176) | > loss_disc_real_1: 0.15867629647254944 (0.2044144793060319) | > loss_disc_real_2: 0.17493583261966705 (0.22475348348761426) | > loss_disc_real_3: 0.23778942227363586 (0.2251804519830079) | > loss_disc_real_4: 0.171809121966362 (0.20037300011207318) | > loss_disc_real_5: 0.12895873188972473 (0.19506386285326605) | > loss_0: 2.348203182220459 (2.259010886323863) | > grad_norm_0: tensor(1879.5323, device='cuda:0') (tensor(1148.9708, device='cuda:0')) | > loss_gen: 1.8914070129394531 (2.5907054070768685) | > loss_kl: 0.4257453382015228 (0.9595738443835029) | > loss_feat: 5.358774185180664 (6.301076679394163) | > loss_mel: 18.258623123168945 (21.212947746803025) | > loss_duration: 1.449787974357605 (1.5411611548785507) | > loss_1: 27.384336471557617 (32.6054651983853) | > grad_norm_1: tensor(7191.4126, device='cuda:0') (tensor(39984.2773, device='cuda:0')) | > current_lr_0: 0.00012841788550177922 | > current_lr_1: 0.00012841788550177922 | > step_time: 0.3872 (0.49350720438463935) | > loader_time: 0.0018 (0.020746140644468114)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.618419647216797 (2.618419647216797) | > loss_disc_real_0: 0.11636613309383392 (0.11636613309383392) | > loss_disc_real_1: 0.18637534976005554 (0.18637534976005554) | > loss_disc_real_2: 0.1786191314458847 (0.1786191314458847) | > loss_disc_real_3: 0.23411524295806885 (0.23411524295806885) | > loss_disc_real_4: 0.22849220037460327 (0.22849220037460327) | > loss_disc_real_5: 0.1799902766942978 (0.1799902766942978) | > loss_0: 2.618419647216797 (2.618419647216797) | > loss_gen: 1.8095810413360596 (1.8095810413360596) | > loss_kl: 3.654257297515869 (3.654257297515869) | > loss_feat: 5.358303070068359 (5.358303070068359) | > loss_mel: 23.178611755371094 (23.178611755371094) | > loss_duration: 2.5586330890655518 (2.5586330890655518) | > loss_1: 36.559383392333984 (36.559383392333984)  --> STEP: 1 | > loss_disc: 2.8382744789123535 (2.8382744789123535) | > loss_disc_real_0: 0.28670480847358704 (0.28670480847358704) | > loss_disc_real_1: 0.24707233905792236 (0.24707233905792236) | > loss_disc_real_2: 0.2196224480867386 (0.2196224480867386) | > loss_disc_real_3: 0.28519514203071594 (0.28519514203071594) | > loss_disc_real_4: 0.1614447832107544 (0.1614447832107544) | > loss_disc_real_5: 0.1486322581768036 (0.1486322581768036) | > loss_0: 2.8382744789123535 (2.8382744789123535) | > loss_gen: 1.6994268894195557 (1.6994268894195557) | > loss_kl: 3.947557210922241 (3.947557210922241) | > loss_feat: 1.974919080734253 (1.974919080734253) | > loss_mel: 20.84728240966797 (20.84728240966797) | > loss_duration: 2.764225482940674 (2.764225482940674) | > loss_1: 31.233409881591797 (31.233409881591797)  --> STEP: 2 | > loss_disc: 2.3468990325927734 (2.5925867557525635) | > loss_disc_real_0: 0.1765555739402771 (0.23163019120693207) | > loss_disc_real_1: 0.15958397090435028 (0.20332815498113632) | > loss_disc_real_2: 0.16455920040607452 (0.19209082424640656) | > loss_disc_real_3: 0.21330149471759796 (0.24924831837415695) | > loss_disc_real_4: 0.09767662733793259 (0.1295607052743435) | > loss_disc_real_5: 0.25063592195510864 (0.19963409006595612) | > loss_0: 2.3468990325927734 (2.5925867557525635) | > loss_gen: 2.357525587081909 (2.0284762382507324) | > loss_kl: 3.933149576187134 (3.9403533935546875) | > loss_feat: 7.982898235321045 (4.978908658027649) | > loss_mel: 28.750520706176758 (24.798901557922363) | > loss_duration: 2.6528868675231934 (2.7085561752319336) | > loss_1: 45.676979064941406 (38.4551944732666)  --> STEP: 3 | > loss_disc: 2.777951240539551 (2.654374917348226) | > loss_disc_real_0: 0.17615826427936554 (0.21313954889774323) | > loss_disc_real_1: 0.40620994567871094 (0.2709554185469945) | > loss_disc_real_2: 0.293476939201355 (0.22588619589805603) | > loss_disc_real_3: 0.40628868341445923 (0.3015951067209244) | > loss_disc_real_4: 0.2926119863986969 (0.18391113231579462) | > loss_disc_real_5: 0.5104591846466064 (0.3032424549261729) | > loss_0: 2.777951240539551 (2.654374917348226) | > loss_gen: 2.8523952960968018 (2.3031159241994223) | > loss_kl: 1.6654365062713623 (3.1820477644602456) | > loss_feat: 3.9819650650024414 (4.646594127019246) | > loss_mel: 21.447044372558594 (23.681615829467773) | > loss_duration: 2.683821201324463 (2.7003111839294434) | > loss_1: 32.63066482543945 (36.513684590657554) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022881031036376953 (+0.00011579195658365871) | > avg_loss_disc: 2.654374917348226 (-0.027275403340657256) | > avg_loss_disc_real_0: 0.21313954889774323 (-0.026634936531384795) | > avg_loss_disc_real_1: 0.2709554185469945 (-0.00679535667101544) | > avg_loss_disc_real_2: 0.22588619589805603 (-0.06662492950757343) | > avg_loss_disc_real_3: 0.3015951067209244 (+0.02476496994495392) | > avg_loss_disc_real_4: 0.18391113231579462 (-0.04073397566874823) | > avg_loss_disc_real_5: 0.3032424549261729 (+0.06592702368895215) | > avg_loss_0: 2.654374917348226 (-0.027275403340657256) | > avg_loss_gen: 2.3031159241994223 (-0.36749982833862305) | > avg_loss_kl: 3.1820477644602456 (-0.20050156116485596) | > avg_loss_feat: 4.646594127019246 (-3.104344606399536) | > avg_loss_mel: 23.681615829467773 (-0.8510684967041016) | > avg_loss_duration: 2.7003111839294434 (-0.0221026738484702) | > avg_loss_1: 36.513684590657554 (-4.5455195109049455)  > EPOCH: 444/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:32:15)   --> TIME: 2023-10-20 04:32:26 -- STEP: 9/50 -- GLOBAL_STEP: 75210 | > loss_disc: 3.029388904571533 (2.3762782679663763) | > loss_disc_real_0: 0.14457131922245026 (0.16785279868377578) | > loss_disc_real_1: 0.2755514085292816 (0.25700831413269043) | > loss_disc_real_2: 0.24775712192058563 (0.2136979970253176) | > loss_disc_real_3: 0.27611789107322693 (0.25691183573669857) | > loss_disc_real_4: 0.2703537940979004 (0.21562495082616806) | > loss_disc_real_5: 0.29600197076797485 (0.25083240162995124) | > loss_0: 3.029388904571533 (2.3762782679663763) | > grad_norm_0: tensor(794.6024, device='cuda:0') (tensor(1039.3533, device='cuda:0')) | > loss_gen: 1.5529054403305054 (2.5728038549423218) | > loss_kl: 1.1336641311645508 (0.694323307938046) | > loss_feat: 0.043536774814128876 (5.221086741321617) | > loss_mel: 2.587916374206543 (22.249848471747505) | > loss_duration: 1.4466114044189453 (1.5066970189412434) | > loss_1: 6.764634132385254 (32.24475934770372) | > grad_norm_1: tensor(62328.2266, device='cuda:0') (tensor(45235.0977, device='cuda:0')) | > current_lr_0: 0.0001282895237850588 | > current_lr_1: 0.0001282895237850588 | > step_time: 0.5873 (0.531968355178833) | > loader_time: 0.0246 (0.019134680430094402)  --> TIME: 2023-10-20 04:32:42 -- STEP: 39/50 -- GLOBAL_STEP: 75240 | > loss_disc: 2.7253942489624023 (2.4175882033812695) | > loss_disc_real_0: 0.3436320722103119 (0.16394012306745237) | > loss_disc_real_1: 0.26619288325309753 (0.2308047745281305) | > loss_disc_real_2: 0.302769273519516 (0.2062363199507579) | > loss_disc_real_3: 0.15506155788898468 (0.24478180286211854) | > loss_disc_real_4: 0.18521785736083984 (0.2157427053898573) | > loss_disc_real_5: 0.103953056037426 (0.24957383347627443) | > loss_0: 2.7253942489624023 (2.4175882033812695) | > grad_norm_0: tensor(1377.0487, device='cuda:0') (tensor(1034.8953, device='cuda:0')) | > loss_gen: 2.3912439346313477 (2.4049131564604926) | > loss_kl: 0.5022171139717102 (0.8235324598275698) | > loss_feat: 6.791929244995117 (4.951545190472061) | > loss_mel: 23.72293472290039 (21.218962146685673) | > loss_duration: 1.59022057056427 (1.518311708401411) | > loss_1: 34.9985466003418 (30.917264669369427) | > grad_norm_1: tensor(54145.1289, device='cuda:0') (tensor(39953.7266, device='cuda:0')) | > current_lr_0: 0.0001282895237850588 | > current_lr_1: 0.0001282895237850588 | > step_time: 0.5855 (0.5146233363029284) | > loader_time: 0.0249 (0.018939770185030423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8602077960968018 (2.8602077960968018) | > loss_disc_real_0: 0.6239501237869263 (0.6239501237869263) | > loss_disc_real_1: 0.22116811573505402 (0.22116811573505402) | > loss_disc_real_2: 0.13164928555488586 (0.13164928555488586) | > loss_disc_real_3: 0.22887277603149414 (0.22887277603149414) | > loss_disc_real_4: 0.1239071637392044 (0.1239071637392044) | > loss_disc_real_5: 0.1458316296339035 (0.1458316296339035) | > loss_0: 2.8602077960968018 (2.8602077960968018) | > loss_gen: 2.3034815788269043 (2.3034815788269043) | > loss_kl: 3.481884479522705 (3.481884479522705) | > loss_feat: 8.608248710632324 (8.608248710632324) | > loss_mel: 25.056224822998047 (25.056224822998047) | > loss_duration: 2.453111410140991 (2.453111410140991) | > loss_1: 41.902950286865234 (41.902950286865234)  --> STEP: 1 | > loss_disc: 2.7434654235839844 (2.7434654235839844) | > loss_disc_real_0: 0.3049491047859192 (0.3049491047859192) | > loss_disc_real_1: 0.2006502002477646 (0.2006502002477646) | > loss_disc_real_2: 0.20621277391910553 (0.20621277391910553) | > loss_disc_real_3: 0.2743656039237976 (0.2743656039237976) | > loss_disc_real_4: 0.3022468388080597 (0.3022468388080597) | > loss_disc_real_5: 0.43264040350914 (0.43264040350914) | > loss_0: 2.7434654235839844 (2.7434654235839844) | > loss_gen: 2.403735876083374 (2.403735876083374) | > loss_kl: 4.0282111167907715 (4.0282111167907715) | > loss_feat: 7.178616523742676 (7.178616523742676) | > loss_mel: 24.314294815063477 (24.314294815063477) | > loss_duration: 2.768446683883667 (2.768446683883667) | > loss_1: 40.69330596923828 (40.69330596923828)  --> STEP: 2 | > loss_disc: 2.147404432296753 (2.4454349279403687) | > loss_disc_real_0: 0.19255036115646362 (0.2487497329711914) | > loss_disc_real_1: 0.03978545591235161 (0.1202178280800581) | > loss_disc_real_2: 0.11133547127246857 (0.15877412259578705) | > loss_disc_real_3: 0.07572920620441437 (0.175047405064106) | > loss_disc_real_4: 0.07359455525875092 (0.1879206970334053) | > loss_disc_real_5: 0.16760163009166718 (0.3001210168004036) | > loss_0: 2.147404432296753 (2.4454349279403687) | > loss_gen: 2.0785412788391113 (2.2411385774612427) | > loss_kl: 3.9275777339935303 (3.977894425392151) | > loss_feat: 10.590291023254395 (8.884453773498535) | > loss_mel: 26.89110565185547 (25.602700233459473) | > loss_duration: 2.608400583267212 (2.6884236335754395) | > loss_1: 46.095916748046875 (43.39461135864258)  --> STEP: 3 | > loss_disc: 2.7090702056884766 (2.5333133538564048) | > loss_disc_real_0: 0.34211647510528564 (0.27987198034922284) | > loss_disc_real_1: 0.3036613166332245 (0.18136565759778023) | > loss_disc_real_2: 0.30577054619789124 (0.20777293046315512) | > loss_disc_real_3: 0.38203227519989014 (0.24404236177603403) | > loss_disc_real_4: 0.34284284710884094 (0.2395614137252172) | > loss_disc_real_5: 0.2987571060657501 (0.2996663798888524) | > loss_0: 2.7090702056884766 (2.5333133538564048) | > loss_gen: 3.1795010566711426 (2.5539260705312095) | > loss_kl: 1.7290613651275635 (3.228283405303955) | > loss_feat: 3.568803071975708 (7.11257020632426) | > loss_mel: 20.061851501464844 (23.75575065612793) | > loss_duration: 2.491685628890991 (2.6228442986806235) | > loss_1: 31.030902862548828 (39.27337519327799) --> EVAL PERFORMANCE | > avg_loader_time: 0.012807766596476236 (+0.010519663492838541) | > avg_loss_disc: 2.5333133538564048 (-0.12106156349182129) | > avg_loss_disc_real_0: 0.27987198034922284 (+0.06673243145147961) | > avg_loss_disc_real_1: 0.18136565759778023 (-0.08958976094921428) | > avg_loss_disc_real_2: 0.20777293046315512 (-0.01811326543490091) | > avg_loss_disc_real_3: 0.24404236177603403 (-0.05755274494489035) | > avg_loss_disc_real_4: 0.2395614137252172 (+0.055650281409422575) | > avg_loss_disc_real_5: 0.2996663798888524 (-0.003576075037320492) | > avg_loss_0: 2.5333133538564048 (-0.12106156349182129) | > avg_loss_gen: 2.5539260705312095 (+0.2508101463317871) | > avg_loss_kl: 3.228283405303955 (+0.04623564084370946) | > avg_loss_feat: 7.11257020632426 (+2.4659760793050136) | > avg_loss_mel: 23.75575065612793 (+0.07413482666015625) | > avg_loss_duration: 2.6228442986806235 (-0.07746688524881984) | > avg_loss_1: 39.27337519327799 (+2.759690602620438)  > EPOCH: 445/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:32:57)   --> TIME: 2023-10-20 04:33:12 -- STEP: 19/50 -- GLOBAL_STEP: 75270 | > loss_disc: 2.9375200271606445 (2.550372606829593) | > loss_disc_real_0: 0.3434235751628876 (0.16120198780768796) | > loss_disc_real_1: 0.18376240134239197 (0.2329748100356052) | > loss_disc_real_2: 0.2916679084300995 (0.2481129277301462) | > loss_disc_real_3: 0.24881459772586823 (0.25534431263804447) | > loss_disc_real_4: 0.33213281631469727 (0.26514611246162345) | > loss_disc_real_5: 0.2657199800014496 (0.22792918117422806) | > loss_0: 2.9375200271606445 (2.550372606829593) | > grad_norm_0: tensor(1157.2323, device='cuda:0') (tensor(1114.3877, device='cuda:0')) | > loss_gen: 2.0771548748016357 (2.3444262993963143) | > loss_kl: 0.8175670504570007 (0.7999838112216247) | > loss_feat: 3.8787009716033936 (5.113772197773582) | > loss_mel: 21.38945770263672 (21.315957809749403) | > loss_duration: 1.6431598663330078 (1.5693750193244533) | > loss_1: 29.806039810180664 (31.14351493433902) | > grad_norm_1: tensor(8308.6289, device='cuda:0') (tensor(35831.8594, device='cuda:0')) | > current_lr_0: 0.00012816129037391088 | > current_lr_1: 0.00012816129037391088 | > step_time: 0.3945 (0.4444967445574309) | > loader_time: 0.0021 (0.01024056735791658)  --> TIME: 2023-10-20 04:33:29 -- STEP: 49/50 -- GLOBAL_STEP: 75300 | > loss_disc: 2.5719106197357178 (2.5079485786204434) | > loss_disc_real_0: 0.10687564313411713 (0.1605129460519066) | > loss_disc_real_1: 0.2749987542629242 (0.22440555919798053) | > loss_disc_real_2: 0.20235499739646912 (0.2209146177130086) | > loss_disc_real_3: 0.30775904655456543 (0.2433642701682996) | > loss_disc_real_4: 0.3092312812805176 (0.2455940611128296) | > loss_disc_real_5: 0.3086617887020111 (0.23632900720956374) | > loss_0: 2.5719106197357178 (2.5079485786204434) | > grad_norm_0: tensor(911.0896, device='cuda:0') (tensor(1047.8502, device='cuda:0')) | > loss_gen: 2.1636898517608643 (2.311670373897164) | > loss_kl: 0.6573164463043213 (0.7596074647973386) | > loss_feat: 1.9214155673980713 (5.251629115671528) | > loss_mel: 21.361125946044922 (21.782933074600837) | > loss_duration: 1.6382430791854858 (1.5369881537495826) | > loss_1: 27.741790771484375 (31.642828007133645) | > grad_norm_1: tensor(8725.3242, device='cuda:0') (tensor(30271.3848, device='cuda:0')) | > current_lr_0: 0.00012816129037391088 | > current_lr_1: 0.00012816129037391088 | > step_time: 0.7924 (0.48036458054367376) | > loader_time: 0.4937 (0.02107494218008859)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7019262313842773 (2.7019262313842773) | > loss_disc_real_0: 0.16679523885250092 (0.16679523885250092) | > loss_disc_real_1: 0.35418686270713806 (0.35418686270713806) | > loss_disc_real_2: 0.3439965546131134 (0.3439965546131134) | > loss_disc_real_3: 0.42616498470306396 (0.42616498470306396) | > loss_disc_real_4: 0.4341345727443695 (0.4341345727443695) | > loss_disc_real_5: 0.3722932040691376 (0.3722932040691376) | > loss_0: 2.7019262313842773 (2.7019262313842773) | > loss_gen: 3.247053861618042 (3.247053861618042) | > loss_kl: 3.2419533729553223 (3.2419533729553223) | > loss_feat: 6.333174705505371 (6.333174705505371) | > loss_mel: 25.652746200561523 (25.652746200561523) | > loss_duration: 2.49649715423584 (2.49649715423584) | > loss_1: 40.97142791748047 (40.97142791748047)  --> STEP: 1 | > loss_disc: 3.4535701274871826 (3.4535701274871826) | > loss_disc_real_0: 0.44531726837158203 (0.44531726837158203) | > loss_disc_real_1: 0.3955078721046448 (0.3955078721046448) | > loss_disc_real_2: 0.3608661890029907 (0.3608661890029907) | > loss_disc_real_3: 0.37964752316474915 (0.37964752316474915) | > loss_disc_real_4: 0.4370043873786926 (0.4370043873786926) | > loss_disc_real_5: 0.399381160736084 (0.399381160736084) | > loss_0: 3.4535701274871826 (3.4535701274871826) | > loss_gen: 2.9892818927764893 (2.9892818927764893) | > loss_kl: 3.805893898010254 (3.805893898010254) | > loss_feat: 6.609033107757568 (6.609033107757568) | > loss_mel: 25.362903594970703 (25.362903594970703) | > loss_duration: 2.7136762142181396 (2.7136762142181396) | > loss_1: 41.48078918457031 (41.48078918457031)  --> STEP: 2 | > loss_disc: 3.017557144165039 (3.235563635826111) | > loss_disc_real_0: 0.2181849628686905 (0.33175111562013626) | > loss_disc_real_1: 0.26155421137809753 (0.32853104174137115) | > loss_disc_real_2: 0.24693059921264648 (0.3038983941078186) | > loss_disc_real_3: 0.26311278343200684 (0.321380153298378) | > loss_disc_real_4: 0.283441960811615 (0.3602231740951538) | > loss_disc_real_5: 0.3078260123729706 (0.3536035865545273) | > loss_0: 3.017557144165039 (3.235563635826111) | > loss_gen: 1.5734176635742188 (2.281349778175354) | > loss_kl: 4.327749252319336 (4.066821575164795) | > loss_feat: 0.05076323449611664 (3.3298981711268425) | > loss_mel: 1.7539045810699463 (13.558404088020325) | > loss_duration: 2.603003740310669 (2.6583399772644043) | > loss_1: 10.308837890625 (25.894813537597656)  --> STEP: 3 | > loss_disc: 1.1454031467437744 (2.5388434727986655) | > loss_disc_real_0: 0.05822635069489479 (0.2405761939783891) | > loss_disc_real_1: 0.15114812552928925 (0.2694034030040105) | > loss_disc_real_2: 0.15480268001556396 (0.2541998227437337) | > loss_disc_real_3: 0.1608724445104599 (0.2678775837024053) | > loss_disc_real_4: 0.07367894053459167 (0.26470842957496643) | > loss_disc_real_5: 0.1375386267900467 (0.28158193329970044) | > loss_0: 1.1454031467437744 (2.5388434727986655) | > loss_gen: 3.8327248096466064 (2.7984747886657715) | > loss_kl: 1.6771396398544312 (3.2702609300613403) | > loss_feat: 10.125636100769043 (5.595144147674243) | > loss_mel: 23.64862060546875 (16.921809593836468) | > loss_duration: 2.57326078414917 (2.6299802462259927) | > loss_1: 41.857383728027344 (31.215670267740887) --> EVAL PERFORMANCE | > avg_loader_time: 0.012947320938110352 (+0.00013955434163411516) | > avg_loss_disc: 2.5388434727986655 (+0.005530118942260742) | > avg_loss_disc_real_0: 0.2405761939783891 (-0.039295786370833724) | > avg_loss_disc_real_1: 0.2694034030040105 (+0.08803774540623027) | > avg_loss_disc_real_2: 0.2541998227437337 (+0.046426892280578586) | > avg_loss_disc_real_3: 0.2678775837024053 (+0.023835221926371247) | > avg_loss_disc_real_4: 0.26470842957496643 (+0.025147015849749238) | > avg_loss_disc_real_5: 0.28158193329970044 (-0.01808444658915198) | > avg_loss_0: 2.5388434727986655 (+0.005530118942260742) | > avg_loss_gen: 2.7984747886657715 (+0.24454871813456203) | > avg_loss_kl: 3.2702609300613403 (+0.041977524757385254) | > avg_loss_feat: 5.595144147674243 (-1.5174260586500168) | > avg_loss_mel: 16.921809593836468 (-6.833941062291462) | > avg_loss_duration: 2.6299802462259927 (+0.00713594754536917) | > avg_loss_1: 31.215670267740887 (-8.057704925537106)  > EPOCH: 446/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:33:36)   --> TIME: 2023-10-20 04:33:56 -- STEP: 29/50 -- GLOBAL_STEP: 75330 | > loss_disc: 2.915632724761963 (2.258249517144828) | > loss_disc_real_0: 0.07228245586156845 (0.13711055344099113) | > loss_disc_real_1: 0.4210255444049835 (0.218397856657875) | > loss_disc_real_2: 0.6034629344940186 (0.21942365824662405) | > loss_disc_real_3: 0.5076743960380554 (0.22943214738163456) | > loss_disc_real_4: 0.42600908875465393 (0.21987816864817306) | > loss_disc_real_5: 0.2136109322309494 (0.19921498193309226) | > loss_0: 2.915632724761963 (2.258249517144828) | > grad_norm_0: tensor(1441.7396, device='cuda:0') (tensor(1003.2026, device='cuda:0')) | > loss_gen: 3.3426928520202637 (2.6351758529400002) | > loss_kl: 0.7913230061531067 (0.8665585939226479) | > loss_feat: 6.776683330535889 (6.251228565029029) | > loss_mel: 25.46370506286621 (22.54603266304937) | > loss_duration: 1.5302461385726929 (1.5599244627459297) | > loss_1: 37.9046516418457 (33.858919636956585) | > grad_norm_1: tensor(69886.4453, device='cuda:0') (tensor(56146.5312, device='cuda:0')) | > current_lr_0: 0.00012803318514008604 | > current_lr_1: 0.00012803318514008604 | > step_time: 0.6284 (0.49838808487201564) | > loader_time: 0.0231 (0.019541008719082535)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.2605791091918945 (1.2605791091918945) | > loss_disc_real_0: 0.01272307988256216 (0.01272307988256216) | > loss_disc_real_1: 0.13327455520629883 (0.13327455520629883) | > loss_disc_real_2: 0.044326867908239365 (0.044326867908239365) | > loss_disc_real_3: 0.15366163849830627 (0.15366163849830627) | > loss_disc_real_4: 0.05405105650424957 (0.05405105650424957) | > loss_disc_real_5: 0.09879929572343826 (0.09879929572343826) | > loss_0: 1.2605791091918945 (1.2605791091918945) | > loss_gen: 3.3930065631866455 (3.3930065631866455) | > loss_kl: 2.83773136138916 (2.83773136138916) | > loss_feat: 11.197134971618652 (11.197134971618652) | > loss_mel: 28.70691680908203 (28.70691680908203) | > loss_duration: 2.494302988052368 (2.494302988052368) | > loss_1: 48.629093170166016 (48.629093170166016)  --> STEP: 1 | > loss_disc: 2.4105584621429443 (2.4105584621429443) | > loss_disc_real_0: 0.26176583766937256 (0.26176583766937256) | > loss_disc_real_1: 0.2803874909877777 (0.2803874909877777) | > loss_disc_real_2: 0.17803585529327393 (0.17803585529327393) | > loss_disc_real_3: 0.2593401372432709 (0.2593401372432709) | > loss_disc_real_4: 0.19883891940116882 (0.19883891940116882) | > loss_disc_real_5: 0.15651966631412506 (0.15651966631412506) | > loss_0: 2.4105584621429443 (2.4105584621429443) | > loss_gen: 2.3940117359161377 (2.3940117359161377) | > loss_kl: 3.4090535640716553 (3.4090535640716553) | > loss_feat: 6.735958099365234 (6.735958099365234) | > loss_mel: 25.253971099853516 (25.253971099853516) | > loss_duration: 2.7633566856384277 (2.7633566856384277) | > loss_1: 40.55635070800781 (40.55635070800781)  --> STEP: 2 | > loss_disc: 3.0296292304992676 (2.720093846321106) | > loss_disc_real_0: 0.3540038466453552 (0.3078848421573639) | > loss_disc_real_1: 0.2691267132759094 (0.27475710213184357) | > loss_disc_real_2: 0.29041922092437744 (0.23422753810882568) | > loss_disc_real_3: 0.3099234998226166 (0.2846318185329437) | > loss_disc_real_4: 0.23060615360736847 (0.21472253650426865) | > loss_disc_real_5: 0.24851897358894348 (0.20251931995153427) | > loss_0: 3.0296292304992676 (2.720093846321106) | > loss_gen: 1.7055093050003052 (2.0497605204582214) | > loss_kl: 3.937682867050171 (3.673368215560913) | > loss_feat: 0.0253132414072752 (3.380635670386255) | > loss_mel: 1.783383846282959 (13.518677473068237) | > loss_duration: 2.641892671585083 (2.7026246786117554) | > loss_1: 10.093781471252441 (25.325066089630127)  --> STEP: 3 | > loss_disc: 3.040079116821289 (2.8267556031545005) | > loss_disc_real_0: 0.4775608479976654 (0.36444351077079773) | > loss_disc_real_1: 0.2535223066806793 (0.2676788369814555) | > loss_disc_real_2: 0.325814813375473 (0.2647566298643748) | > loss_disc_real_3: 0.2998882830142975 (0.28971730669339496) | > loss_disc_real_4: 0.28696805238723755 (0.23880437513192496) | > loss_disc_real_5: 0.32931002974510193 (0.24478288988272348) | > loss_0: 3.040079116821289 (2.8267556031545005) | > loss_gen: 2.7440664768218994 (2.2811958392461142) | > loss_kl: 1.8202706575393677 (3.0556690295537314) | > loss_feat: 2.0686542987823486 (2.943308546518286) | > loss_mel: 20.18100357055664 (15.739452838897705) | > loss_duration: 2.6196813583374023 (2.674976905186971) | > loss_1: 29.433677673339844 (26.69460328420003) --> EVAL PERFORMANCE | > avg_loader_time: 0.026158571243286133 (+0.013211250305175781) | > avg_loss_disc: 2.8267556031545005 (+0.28791213035583496) | > avg_loss_disc_real_0: 0.36444351077079773 (+0.12386731679240862) | > avg_loss_disc_real_1: 0.2676788369814555 (-0.0017245660225549964) | > avg_loss_disc_real_2: 0.2647566298643748 (+0.01055680712064111) | > avg_loss_disc_real_3: 0.28971730669339496 (+0.021839722990989685) | > avg_loss_disc_real_4: 0.23880437513192496 (-0.025904054443041474) | > avg_loss_disc_real_5: 0.24478288988272348 (-0.036799043416976956) | > avg_loss_0: 2.8267556031545005 (+0.28791213035583496) | > avg_loss_gen: 2.2811958392461142 (-0.5172789494196572) | > avg_loss_kl: 3.0556690295537314 (-0.2145919005076089) | > avg_loss_feat: 2.943308546518286 (-2.6518356011559567) | > avg_loss_mel: 15.739452838897705 (-1.1823567549387626) | > avg_loss_duration: 2.674976905186971 (+0.044996658960978486) | > avg_loss_1: 26.69460328420003 (-4.521066983540855)  > EPOCH: 447/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:34:18)   --> TIME: 2023-10-20 04:34:26 -- STEP: 9/50 -- GLOBAL_STEP: 75360 | > loss_disc: 3.0040628910064697 (2.25472621122996) | > loss_disc_real_0: 0.20014770328998566 (0.1178208693034119) | > loss_disc_real_1: 0.3176476061344147 (0.22687291395333078) | > loss_disc_real_2: 0.2521451413631439 (0.22295396485262448) | > loss_disc_real_3: 0.2812959551811218 (0.24861536630325848) | > loss_disc_real_4: 0.25424396991729736 (0.18886634748842981) | > loss_disc_real_5: 0.2345723807811737 (0.15784626868036059) | > loss_0: 3.0040628910064697 (2.25472621122996) | > grad_norm_0: tensor(470.0291, device='cuda:0') (tensor(870.2027, device='cuda:0')) | > loss_gen: 1.5701650381088257 (2.4908533096313477) | > loss_kl: 0.9172834157943726 (0.780338274108039) | > loss_feat: 0.04287661612033844 (5.494218463699023) | > loss_mel: 4.187844753265381 (21.50575855043199) | > loss_duration: 1.5083626508712769 (1.532556374867757) | > loss_1: 8.226531982421875 (31.80372471279568) | > grad_norm_1: tensor(68883.6250, device='cuda:0') (tensor(44028.2461, device='cuda:0')) | > current_lr_0: 0.00012790520795546298 | > current_lr_1: 0.00012790520795546298 | > step_time: 0.561 (0.4944923453860813) | > loader_time: 0.0112 (0.020395225948757596)  --> TIME: 2023-10-20 04:34:42 -- STEP: 39/50 -- GLOBAL_STEP: 75390 | > loss_disc: 3.030399799346924 (2.436693255717938) | > loss_disc_real_0: 0.34693795442581177 (0.15305315297192487) | > loss_disc_real_1: 0.26825398206710815 (0.22766365483403206) | > loss_disc_real_2: 0.2555985450744629 (0.20845908442368874) | > loss_disc_real_3: 0.2044314742088318 (0.2431368928593703) | > loss_disc_real_4: 0.23331283032894135 (0.22897422910691836) | > loss_disc_real_5: 0.20292723178863525 (0.22063860746148306) | > loss_0: 3.030399799346924 (2.436693255717938) | > grad_norm_0: tensor(919.4750, device='cuda:0') (tensor(1174.6083, device='cuda:0')) | > loss_gen: 1.5146337747573853 (2.3823604369774842) | > loss_kl: 0.5529033541679382 (0.8476730508682055) | > loss_feat: 0.0886228084564209 (5.451413372006172) | > loss_mel: 1.7036062479019165 (22.635610901392425) | > loss_duration: 1.6301604509353638 (1.5336211491853762) | > loss_1: 5.489926338195801 (32.85067925086386) | > grad_norm_1: tensor(52362.4648, device='cuda:0') (tensor(43616.5664, device='cuda:0')) | > current_lr_0: 0.00012790520795546298 | > current_lr_1: 0.00012790520795546298 | > step_time: 0.5657 (0.4924870026417268) | > loader_time: 0.0136 (0.019481353270701877)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9841225147247314 (2.9841225147247314) | > loss_disc_real_0: 0.19441702961921692 (0.19441702961921692) | > loss_disc_real_1: 0.44381752610206604 (0.44381752610206604) | > loss_disc_real_2: 0.328022301197052 (0.328022301197052) | > loss_disc_real_3: 0.27347615361213684 (0.27347615361213684) | > loss_disc_real_4: 0.34122589230537415 (0.34122589230537415) | > loss_disc_real_5: 0.2649085223674774 (0.2649085223674774) | > loss_0: 2.9841225147247314 (2.9841225147247314) | > loss_gen: 2.3373303413391113 (2.3373303413391113) | > loss_kl: 3.886821746826172 (3.886821746826172) | > loss_feat: 8.631888389587402 (8.631888389587402) | > loss_mel: 21.866880416870117 (21.866880416870117) | > loss_duration: 2.605267286300659 (2.605267286300659) | > loss_1: 39.32818603515625 (39.32818603515625)  --> STEP: 1 | > loss_disc: 2.7719054222106934 (2.7719054222106934) | > loss_disc_real_0: 0.19145768880844116 (0.19145768880844116) | > loss_disc_real_1: 0.38892224431037903 (0.38892224431037903) | > loss_disc_real_2: 0.3534319996833801 (0.3534319996833801) | > loss_disc_real_3: 0.2498948723077774 (0.2498948723077774) | > loss_disc_real_4: 0.1479308307170868 (0.1479308307170868) | > loss_disc_real_5: 0.07601720094680786 (0.07601720094680786) | > loss_0: 2.7719054222106934 (2.7719054222106934) | > loss_gen: 1.9047647714614868 (1.9047647714614868) | > loss_kl: 3.9096477031707764 (3.9096477031707764) | > loss_feat: 6.9605841636657715 (6.9605841636657715) | > loss_mel: 24.227832794189453 (24.227832794189453) | > loss_duration: 2.9505550861358643 (2.9505550861358643) | > loss_1: 39.95338439941406 (39.95338439941406)  --> STEP: 2 | > loss_disc: 2.5881097316741943 (2.680007576942444) | > loss_disc_real_0: 0.1706167459487915 (0.18103721737861633) | > loss_disc_real_1: 0.28353992104530334 (0.3362310826778412) | > loss_disc_real_2: 0.2865527868270874 (0.31999239325523376) | > loss_disc_real_3: 0.3551037907600403 (0.30249933153390884) | > loss_disc_real_4: 0.16571906208992004 (0.15682494640350342) | > loss_disc_real_5: 0.157032772898674 (0.11652498692274094) | > loss_0: 2.5881097316741943 (2.680007576942444) | > loss_gen: 2.4905056953430176 (2.197635233402252) | > loss_kl: 4.2232279777526855 (4.066437840461731) | > loss_feat: 7.300073146820068 (7.13032865524292) | > loss_mel: 23.236799240112305 (23.73231601715088) | > loss_duration: 2.5995428562164307 (2.7750489711761475) | > loss_1: 39.85015106201172 (39.90176773071289)  --> STEP: 3 | > loss_disc: 2.934006690979004 (2.764673948287964) | > loss_disc_real_0: 0.20851635932922363 (0.1901969313621521) | > loss_disc_real_1: 0.4104212820529938 (0.3609611491362254) | > loss_disc_real_2: 0.44693994522094727 (0.3623082439104716) | > loss_disc_real_3: 0.46360883116722107 (0.35620249807834625) | > loss_disc_real_4: 0.2889564037322998 (0.2008687655131022) | > loss_disc_real_5: 0.4545639455318451 (0.22920463979244232) | > loss_0: 2.934006690979004 (2.764673948287964) | > loss_gen: 3.9058144092559814 (2.767028292020162) | > loss_kl: 1.772082805633545 (3.3016528288523355) | > loss_feat: 5.507378578186035 (6.589345296223958) | > loss_mel: 22.109630584716797 (23.191420873006184) | > loss_duration: 2.5374786853790283 (2.695858875910441) | > loss_1: 35.8323860168457 (38.54530715942383) --> EVAL PERFORMANCE | > avg_loader_time: 0.0068560441335042315 (-0.019302527109781902) | > avg_loss_disc: 2.764673948287964 (-0.062081654866536606) | > avg_loss_disc_real_0: 0.1901969313621521 (-0.17424657940864563) | > avg_loss_disc_real_1: 0.3609611491362254 (+0.0932823121547699) | > avg_loss_disc_real_2: 0.3623082439104716 (+0.0975516140460968) | > avg_loss_disc_real_3: 0.35620249807834625 (+0.06648519138495129) | > avg_loss_disc_real_4: 0.2008687655131022 (-0.03793560961882275) | > avg_loss_disc_real_5: 0.22920463979244232 (-0.01557825009028116) | > avg_loss_0: 2.764673948287964 (-0.062081654866536606) | > avg_loss_gen: 2.767028292020162 (+0.48583245277404785) | > avg_loss_kl: 3.3016528288523355 (+0.24598379929860403) | > avg_loss_feat: 6.589345296223958 (+3.646036749705672) | > avg_loss_mel: 23.191420873006184 (+7.451968034108479) | > avg_loss_duration: 2.695858875910441 (+0.020881970723469756) | > avg_loss_1: 38.54530715942383 (+11.850703875223797)  > EPOCH: 448/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:35:00)   --> TIME: 2023-10-20 04:35:12 -- STEP: 19/50 -- GLOBAL_STEP: 75420 | > loss_disc: 2.475501537322998 (2.500271194859555) | > loss_disc_real_0: 0.19141148030757904 (0.15196283313592798) | > loss_disc_real_1: 0.33223533630371094 (0.24820287074697645) | > loss_disc_real_2: 0.18372979760169983 (0.2544945637254338) | > loss_disc_real_3: 0.2598525285720825 (0.24165722021931096) | > loss_disc_real_4: 0.4315641224384308 (0.24601695921860242) | > loss_disc_real_5: 0.2888581156730652 (0.25012709768979174) | > loss_0: 2.475501537322998 (2.500271194859555) | > grad_norm_0: tensor(1246.3428, device='cuda:0') (tensor(1468.5679, device='cuda:0')) | > loss_gen: 2.8245482444763184 (2.5711669294457686) | > loss_kl: 0.9706361293792725 (0.9323271528670662) | > loss_feat: 6.649304389953613 (6.3623143058074145) | > loss_mel: 27.535381317138672 (25.071909854286595) | > loss_duration: 1.7081010341644287 (1.5901660229030408) | > loss_1: 39.68796920776367 (36.527883830823406) | > grad_norm_1: tensor(62363.4492, device='cuda:0') (tensor(65129.9727, device='cuda:0')) | > current_lr_0: 0.00012777735869204854 | > current_lr_1: 0.00012777735869204854 | > step_time: 0.3425 (0.37921330803319026) | > loader_time: 0.0019 (0.006432734037700452)  --> TIME: 2023-10-20 04:35:28 -- STEP: 49/50 -- GLOBAL_STEP: 75450 | > loss_disc: 1.5730801820755005 (2.4018362687558534) | > loss_disc_real_0: 0.028342802077531815 (0.1429897597895897) | > loss_disc_real_1: 0.14116957783699036 (0.22543533085560313) | > loss_disc_real_2: 0.07912490516901016 (0.23500770208786945) | > loss_disc_real_3: 0.2961210608482361 (0.24021393463623766) | > loss_disc_real_4: 0.09800386428833008 (0.21991557175559656) | > loss_disc_real_5: 0.18117941915988922 (0.21715442707039873) | > loss_0: 1.5730801820755005 (2.4018362687558534) | > grad_norm_0: tensor(2234.9050, device='cuda:0') (tensor(1256.7202, device='cuda:0')) | > loss_gen: 3.0469396114349365 (2.4656313755074337) | > loss_kl: 0.9793776869773865 (0.8257285581559551) | > loss_feat: 7.647763729095459 (5.853164158761501) | > loss_mel: 26.787282943725586 (22.679131196469676) | > loss_duration: 1.662405252456665 (1.5449030156038246) | > loss_1: 40.12377166748047 (33.36855824139655) | > grad_norm_1: tensor(48017.3359, device='cuda:0') (tensor(49662.1250, device='cuda:0')) | > current_lr_0: 0.00012777735869204854 | > current_lr_1: 0.00012777735869204854 | > step_time: 0.5545 (0.46126027983062123) | > loader_time: 0.5227 (0.023035268394314513)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.3830986022949219 (1.3830986022949219) | > loss_disc_real_0: 0.026773903518915176 (0.026773903518915176) | > loss_disc_real_1: 0.10103635489940643 (0.10103635489940643) | > loss_disc_real_2: 0.08910292387008667 (0.08910292387008667) | > loss_disc_real_3: 0.24343496561050415 (0.24343496561050415) | > loss_disc_real_4: 0.02237938717007637 (0.02237938717007637) | > loss_disc_real_5: 0.12473281472921371 (0.12473281472921371) | > loss_0: 1.3830986022949219 (1.3830986022949219) | > loss_gen: 2.894866466522217 (2.894866466522217) | > loss_kl: 2.874922037124634 (2.874922037124634) | > loss_feat: 12.587233543395996 (12.587233543395996) | > loss_mel: 25.04009437561035 (25.04009437561035) | > loss_duration: 2.6218748092651367 (2.6218748092651367) | > loss_1: 46.01899337768555 (46.01899337768555)  --> STEP: 1 | > loss_disc: 2.612417221069336 (2.612417221069336) | > loss_disc_real_0: 0.135807603597641 (0.135807603597641) | > loss_disc_real_1: 0.29711005091667175 (0.29711005091667175) | > loss_disc_real_2: 0.2820422649383545 (0.2820422649383545) | > loss_disc_real_3: 0.27166903018951416 (0.27166903018951416) | > loss_disc_real_4: 0.2124568074941635 (0.2124568074941635) | > loss_disc_real_5: 0.26633989810943604 (0.26633989810943604) | > loss_0: 2.612417221069336 (2.612417221069336) | > loss_gen: 2.206308126449585 (2.206308126449585) | > loss_kl: 2.966010332107544 (2.966010332107544) | > loss_feat: 3.2680270671844482 (3.2680270671844482) | > loss_mel: 20.829837799072266 (20.829837799072266) | > loss_duration: 2.9226267337799072 (2.9226267337799072) | > loss_1: 32.19281005859375 (32.19281005859375)  --> STEP: 2 | > loss_disc: 2.0393571853637695 (2.3258872032165527) | > loss_disc_real_0: 0.07821990549564362 (0.1070137545466423) | > loss_disc_real_1: 0.2985594868659973 (0.29783476889133453) | > loss_disc_real_2: 0.23396478593349457 (0.25800352543592453) | > loss_disc_real_3: 0.269003301858902 (0.27033616602420807) | > loss_disc_real_4: 0.15630120038986206 (0.1843790039420128) | > loss_disc_real_5: 0.2450433075428009 (0.25569160282611847) | > loss_0: 2.0393571853637695 (2.3258872032165527) | > loss_gen: 2.853492021560669 (2.529900074005127) | > loss_kl: 3.945009708404541 (3.4555100202560425) | > loss_feat: 8.471146583557129 (5.869586825370789) | > loss_mel: 23.07613754272461 (21.952987670898438) | > loss_duration: 2.6977994441986084 (2.810213088989258) | > loss_1: 41.04358673095703 (36.61819839477539)  --> STEP: 3 | > loss_disc: 1.9490751028060913 (2.200283169746399) | > loss_disc_real_0: 0.09657397121191025 (0.10353382676839828) | > loss_disc_real_1: 0.19496341049671173 (0.26354431609312695) | > loss_disc_real_2: 0.19639723002910614 (0.23746809363365173) | > loss_disc_real_3: 0.26583176851272583 (0.2688347001870473) | > loss_disc_real_4: 0.16145667433738708 (0.17673822740713754) | > loss_disc_real_5: 0.13287363946437836 (0.21475228170553842) | > loss_0: 1.9490751028060913 (2.200283169746399) | > loss_gen: 2.5784425735473633 (2.5460809071858725) | > loss_kl: 2.0058207511901855 (2.972280263900757) | > loss_feat: 5.121909141540527 (5.620360930760701) | > loss_mel: 22.908369064331055 (22.271448135375977) | > loss_duration: 2.730513572692871 (2.783646583557129) | > loss_1: 35.345054626464844 (36.193817138671875) --> EVAL PERFORMANCE | > avg_loader_time: 0.004688580830891927 (-0.0021674633026123047) | > avg_loss_disc: 2.200283169746399 (-0.5643907785415649) | > avg_loss_disc_real_0: 0.10353382676839828 (-0.08666310459375381) | > avg_loss_disc_real_1: 0.26354431609312695 (-0.09741683304309845) | > avg_loss_disc_real_2: 0.23746809363365173 (-0.12484015027681988) | > avg_loss_disc_real_3: 0.2688347001870473 (-0.08736779789129895) | > avg_loss_disc_real_4: 0.17673822740713754 (-0.02413053810596466) | > avg_loss_disc_real_5: 0.21475228170553842 (-0.0144523580869039) | > avg_loss_0: 2.200283169746399 (-0.5643907785415649) | > avg_loss_gen: 2.5460809071858725 (-0.22094738483428955) | > avg_loss_kl: 2.972280263900757 (-0.32937256495157863) | > avg_loss_feat: 5.620360930760701 (-0.9689843654632568) | > avg_loss_mel: 22.271448135375977 (-0.9199727376302071) | > avg_loss_duration: 2.783646583557129 (+0.08778770764668797) | > avg_loss_1: 36.193817138671875 (-2.351490020751953)  > EPOCH: 449/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:35:38)   --> TIME: 2023-10-20 04:35:56 -- STEP: 29/50 -- GLOBAL_STEP: 75480 | > loss_disc: 2.726555347442627 (2.3104336138429313) | > loss_disc_real_0: 0.2414427101612091 (0.1681682426996272) | > loss_disc_real_1: 0.29236477613449097 (0.2064992836837111) | > loss_disc_real_2: 0.37583813071250916 (0.21568433375194154) | > loss_disc_real_3: 0.3719899654388428 (0.24371699192400637) | > loss_disc_real_4: 0.43652084469795227 (0.20605898918262844) | > loss_disc_real_5: 0.2874516546726227 (0.20938829075673532) | > loss_0: 2.726555347442627 (2.3104336138429313) | > grad_norm_0: tensor(752.5052, device='cuda:0') (tensor(1125.6206, device='cuda:0')) | > loss_gen: 2.9954795837402344 (2.453525999496723) | > loss_kl: 0.8581811189651489 (0.8503570453873996) | > loss_feat: 4.665833473205566 (5.121721306751514) | > loss_mel: 22.680559158325195 (19.92653762883154) | > loss_duration: 1.5264244079589844 (1.5553852155290802) | > loss_1: 32.726478576660156 (29.907527117893615) | > grad_norm_1: tensor(4626.2988, device='cuda:0') (tensor(44584.0430, device='cuda:0')) | > current_lr_0: 0.00012764963722197738 | > current_lr_1: 0.00012764963722197738 | > step_time: 0.2907 (0.4784791798427187) | > loader_time: 0.0024 (0.017880694619540515)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9348342418670654 (1.9348342418670654) | > loss_disc_real_0: 0.04617341607809067 (0.04617341607809067) | > loss_disc_real_1: 0.12007612735033035 (0.12007612735033035) | > loss_disc_real_2: 0.09169134497642517 (0.09169134497642517) | > loss_disc_real_3: 0.12662187218666077 (0.12662187218666077) | > loss_disc_real_4: 0.02024679072201252 (0.02024679072201252) | > loss_disc_real_5: 0.13774022459983826 (0.13774022459983826) | > loss_0: 1.9348342418670654 (1.9348342418670654) | > loss_gen: 2.017617702484131 (2.017617702484131) | > loss_kl: 4.161495208740234 (4.161495208740234) | > loss_feat: 11.719956398010254 (11.719956398010254) | > loss_mel: 24.2435359954834 (24.2435359954834) | > loss_duration: 2.5963551998138428 (2.5963551998138428) | > loss_1: 44.73896026611328 (44.73896026611328)  --> STEP: 1 | > loss_disc: 2.995565414428711 (2.995565414428711) | > loss_disc_real_0: 0.05590245872735977 (0.05590245872735977) | > loss_disc_real_1: 0.3147094249725342 (0.3147094249725342) | > loss_disc_real_2: 0.36901459097862244 (0.36901459097862244) | > loss_disc_real_3: 0.4191643297672272 (0.4191643297672272) | > loss_disc_real_4: 0.2335062026977539 (0.2335062026977539) | > loss_disc_real_5: 0.3399619162082672 (0.3399619162082672) | > loss_0: 2.995565414428711 (2.995565414428711) | > loss_gen: 2.025541067123413 (2.025541067123413) | > loss_kl: 3.986351251602173 (3.986351251602173) | > loss_feat: 4.08836555480957 (4.08836555480957) | > loss_mel: 25.164512634277344 (25.164512634277344) | > loss_duration: 2.7386868000030518 (2.7386868000030518) | > loss_1: 38.00345230102539 (38.00345230102539)  --> STEP: 2 | > loss_disc: 2.69469952583313 (2.8451324701309204) | > loss_disc_real_0: 0.07198015600442886 (0.06394130736589432) | > loss_disc_real_1: 0.2579536437988281 (0.28633153438568115) | > loss_disc_real_2: 0.26244279742240906 (0.31572869420051575) | > loss_disc_real_3: 0.36208051443099976 (0.39062242209911346) | > loss_disc_real_4: 0.2815237045288086 (0.25751495361328125) | > loss_disc_real_5: 0.3769757151603699 (0.35846881568431854) | > loss_0: 2.69469952583313 (2.8451324701309204) | > loss_gen: 2.2374985218048096 (2.1315197944641113) | > loss_kl: 3.608537197113037 (3.797444224357605) | > loss_feat: 3.015367269515991 (3.5518664121627808) | > loss_mel: 22.548383712768555 (23.85644817352295) | > loss_duration: 2.6251304149627686 (2.68190860748291) | > loss_1: 34.034915924072266 (36.01918411254883)  --> STEP: 3 | > loss_disc: 2.616222381591797 (2.768829107284546) | > loss_disc_real_0: 0.09011196345090866 (0.07266485939423244) | > loss_disc_real_1: 0.32400551438331604 (0.29888952771822613) | > loss_disc_real_2: 0.2368786334991455 (0.28944534063339233) | > loss_disc_real_3: 0.26690569519996643 (0.34938351313273114) | > loss_disc_real_4: 0.21597130596637726 (0.24366707106431326) | > loss_disc_real_5: 0.21908268332481384 (0.31200677156448364) | > loss_0: 2.616222381591797 (2.768829107284546) | > loss_gen: 1.9017536640167236 (2.054931084314982) | > loss_kl: 2.040358781814575 (3.2117490768432617) | > loss_feat: 3.3889269828796387 (3.4975532690684) | > loss_mel: 20.640295028686523 (22.78439712524414) | > loss_duration: 2.6570546627044678 (2.673623959223429) | > loss_1: 30.628389358520508 (34.22225252787272) --> EVAL PERFORMANCE | > avg_loader_time: 0.013901551564534506 (+0.009212970733642578) | > avg_loss_disc: 2.768829107284546 (+0.568545937538147) | > avg_loss_disc_real_0: 0.07266485939423244 (-0.030868967374165848) | > avg_loss_disc_real_1: 0.29888952771822613 (+0.03534521162509918) | > avg_loss_disc_real_2: 0.28944534063339233 (+0.0519772469997406) | > avg_loss_disc_real_3: 0.34938351313273114 (+0.08054881294568383) | > avg_loss_disc_real_4: 0.24366707106431326 (+0.06692884365717572) | > avg_loss_disc_real_5: 0.31200677156448364 (+0.09725448985894522) | > avg_loss_0: 2.768829107284546 (+0.568545937538147) | > avg_loss_gen: 2.054931084314982 (-0.4911498228708906) | > avg_loss_kl: 3.2117490768432617 (+0.23946881294250488) | > avg_loss_feat: 3.4975532690684 (-2.1228076616923013) | > avg_loss_mel: 22.78439712524414 (+0.5129489898681641) | > avg_loss_duration: 2.673623959223429 (-0.11002262433369969) | > avg_loss_1: 34.22225252787272 (-1.971564610799156)  > EPOCH: 450/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:36:19)   --> TIME: 2023-10-20 04:36:28 -- STEP: 9/50 -- GLOBAL_STEP: 75510 | > loss_disc: 3.152620315551758 (2.429097135861715) | > loss_disc_real_0: 0.5745248794555664 (0.15816715815001064) | > loss_disc_real_1: 0.3004617691040039 (0.21890057168073124) | > loss_disc_real_2: 0.21533752977848053 (0.19907956860131687) | > loss_disc_real_3: 0.2743392288684845 (0.2696154806762934) | > loss_disc_real_4: 0.2762739658355713 (0.21303880959749222) | > loss_disc_real_5: 0.2538163363933563 (0.16441565834813648) | > loss_0: 3.152620315551758 (2.429097135861715) | > grad_norm_0: tensor(2068.7122, device='cuda:0') (tensor(1320.4259, device='cuda:0')) | > loss_gen: 1.8929572105407715 (2.373832212554084) | > loss_kl: 0.8898971080780029 (0.9014297591315376) | > loss_feat: 0.33416134119033813 (5.528480695353614) | > loss_mel: 12.284035682678223 (23.523823738098145) | > loss_duration: 1.4655039310455322 (1.520431187417772) | > loss_1: 16.866554260253906 (33.84799724155002) | > grad_norm_1: tensor(24430.9688, device='cuda:0') (tensor(26701.9570, device='cuda:0')) | > current_lr_0: 0.00012752204341751216 | > current_lr_1: 0.00012752204341751216 | > step_time: 0.5581 (0.4535689618852403) | > loader_time: 0.0137 (0.017195277743869357)  --> TIME: 2023-10-20 04:36:43 -- STEP: 39/50 -- GLOBAL_STEP: 75540 | > loss_disc: 1.8082590103149414 (2.506795638646835) | > loss_disc_real_0: 0.061712414026260376 (0.15294562514202717) | > loss_disc_real_1: 0.11717867851257324 (0.23466584267906654) | > loss_disc_real_2: 0.14644549787044525 (0.22601935773705825) | > loss_disc_real_3: 0.262919157743454 (0.241424097894476) | > loss_disc_real_4: 0.10159605741500854 (0.23415281986578917) | > loss_disc_real_5: 0.07402539253234863 (0.22679279095087296) | > loss_0: 1.8082590103149414 (2.506795638646835) | > grad_norm_0: tensor(2215.4077, device='cuda:0') (tensor(1303.0089, device='cuda:0')) | > loss_gen: 2.5028438568115234 (2.2878502821310978) | > loss_kl: 0.6641820073127747 (0.8750214393322284) | > loss_feat: 7.057597637176514 (5.080672953373347) | > loss_mel: 25.593303680419922 (22.480022100301888) | > loss_duration: 1.5913071632385254 (1.5228552390367558) | > loss_1: 37.40923309326172 (32.246421765058464) | > grad_norm_1: tensor(92182.0547, device='cuda:0') (tensor(35106.2773, device='cuda:0')) | > current_lr_0: 0.00012752204341751216 | > current_lr_1: 0.00012752204341751216 | > step_time: 0.5678 (0.4797482918470334) | > loader_time: 0.0083 (0.020164257440811552)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.616602897644043 (2.616602897644043) | > loss_disc_real_0: 0.24088966846466064 (0.24088966846466064) | > loss_disc_real_1: 0.11712519824504852 (0.11712519824504852) | > loss_disc_real_2: 0.2551227807998657 (0.2551227807998657) | > loss_disc_real_3: 0.33763211965560913 (0.33763211965560913) | > loss_disc_real_4: 0.1873270720243454 (0.1873270720243454) | > loss_disc_real_5: 0.42524880170822144 (0.42524880170822144) | > loss_0: 2.616602897644043 (2.616602897644043) | > loss_gen: 2.3873815536499023 (2.3873815536499023) | > loss_kl: 3.0169146060943604 (3.0169146060943604) | > loss_feat: 6.19809627532959 (6.19809627532959) | > loss_mel: 24.062620162963867 (24.062620162963867) | > loss_duration: 2.6568198204040527 (2.6568198204040527) | > loss_1: 38.32183074951172 (38.32183074951172)  --> STEP: 1 | > loss_disc: 2.6114954948425293 (2.6114954948425293) | > loss_disc_real_0: 0.4229399561882019 (0.4229399561882019) | > loss_disc_real_1: 0.20288507640361786 (0.20288507640361786) | > loss_disc_real_2: 0.31581684947013855 (0.31581684947013855) | > loss_disc_real_3: 0.422097384929657 (0.422097384929657) | > loss_disc_real_4: 0.32528701424598694 (0.32528701424598694) | > loss_disc_real_5: 0.3283308446407318 (0.3283308446407318) | > loss_0: 2.6114954948425293 (2.6114954948425293) | > loss_gen: 3.890305519104004 (3.890305519104004) | > loss_kl: 3.6293938159942627 (3.6293938159942627) | > loss_feat: 6.737152099609375 (6.737152099609375) | > loss_mel: 24.18842124938965 (24.18842124938965) | > loss_duration: 2.912545919418335 (2.912545919418335) | > loss_1: 41.35781478881836 (41.35781478881836)  --> STEP: 2 | > loss_disc: 3.1394031047821045 (2.875449299812317) | > loss_disc_real_0: 0.13769328594207764 (0.28031662106513977) | > loss_disc_real_1: 0.3198380768299103 (0.26136157661676407) | > loss_disc_real_2: 0.168156236410141 (0.24198654294013977) | > loss_disc_real_3: 0.28386175632476807 (0.3529795706272125) | > loss_disc_real_4: 0.24073262512683868 (0.2830098196864128) | > loss_disc_real_5: 0.19664835929870605 (0.26248960196971893) | > loss_0: 3.1394031047821045 (2.875449299812317) | > loss_gen: 1.3417026996612549 (2.6160041093826294) | > loss_kl: 4.229905128479004 (3.9296494722366333) | > loss_feat: 0.8773999214172363 (3.8072760105133057) | > loss_mel: 6.1455302238464355 (15.166975736618042) | > loss_duration: 2.8528311252593994 (2.882688522338867) | > loss_1: 15.447368621826172 (28.402591705322266)  --> STEP: 3 | > loss_disc: 2.8693342208862305 (2.873410940170288) | > loss_disc_real_0: 0.17546701431274414 (0.24536675214767456) | > loss_disc_real_1: 0.3064286708831787 (0.2763839413722356) | > loss_disc_real_2: 0.1749083399772644 (0.21962714195251465) | > loss_disc_real_3: 0.25995030999183655 (0.3219698170820872) | > loss_disc_real_4: 0.26379820704460144 (0.276605948805809) | > loss_disc_real_5: 0.2343074381351471 (0.253095547358195) | > loss_0: 2.8693342208862305 (2.873410940170288) | > loss_gen: 1.563364863395691 (2.2651243607203164) | > loss_kl: 1.3465726375579834 (3.0686238606770835) | > loss_feat: 0.39942997694015503 (2.6713273326555886) | > loss_mel: 15.027778625488281 (15.120576699574789) | > loss_duration: 2.645090103149414 (2.8034890492757163) | > loss_1: 20.982234954833984 (25.929139455159504) --> EVAL PERFORMANCE | > avg_loader_time: 0.0051271915435791016 (-0.008774360020955404) | > avg_loss_disc: 2.873410940170288 (+0.10458183288574219) | > avg_loss_disc_real_0: 0.24536675214767456 (+0.1727018927534421) | > avg_loss_disc_real_1: 0.2763839413722356 (-0.022505586345990536) | > avg_loss_disc_real_2: 0.21962714195251465 (-0.06981819868087769) | > avg_loss_disc_real_3: 0.3219698170820872 (-0.02741369605064392) | > avg_loss_disc_real_4: 0.276605948805809 (+0.03293887774149576) | > avg_loss_disc_real_5: 0.253095547358195 (-0.05891122420628864) | > avg_loss_0: 2.873410940170288 (+0.10458183288574219) | > avg_loss_gen: 2.2651243607203164 (+0.21019327640533447) | > avg_loss_kl: 3.0686238606770835 (-0.14312521616617824) | > avg_loss_feat: 2.6713273326555886 (-0.8262259364128113) | > avg_loss_mel: 15.120576699574789 (-7.663820425669352) | > avg_loss_duration: 2.8034890492757163 (+0.12986509005228708) | > avg_loss_1: 25.929139455159504 (-8.293113072713215)  > EPOCH: 451/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:37:00)   --> TIME: 2023-10-20 04:37:12 -- STEP: 19/50 -- GLOBAL_STEP: 75570 | > loss_disc: 1.5082321166992188 (2.3146257965188277) | > loss_disc_real_0: 0.06197551637887955 (0.1280751460672993) | > loss_disc_real_1: 0.13608841598033905 (0.22710425994898142) | > loss_disc_real_2: 0.08579465746879578 (0.21386827528476715) | > loss_disc_real_3: 0.16999854147434235 (0.22686070517489784) | > loss_disc_real_4: 0.07230255752801895 (0.21332229144479098) | > loss_disc_real_5: 0.11968763172626495 (0.22224270454362818) | > loss_0: 1.5082321166992188 (2.3146257965188277) | > grad_norm_0: tensor(638.0609, device='cuda:0') (tensor(1428.0994, device='cuda:0')) | > loss_gen: 2.6664373874664307 (2.47524556988164) | > loss_kl: 0.7061458826065063 (0.8711896350509242) | > loss_feat: 8.39250659942627 (5.108576287956614) | > loss_mel: 22.637571334838867 (21.50147064736015) | > loss_duration: 1.6854043006896973 (1.5497065029646222) | > loss_1: 36.088069915771484 (31.50618879418624) | > grad_norm_1: tensor(24371.5840, device='cuda:0') (tensor(50530.8242, device='cuda:0')) | > current_lr_0: 0.00012739457715104304 | > current_lr_1: 0.00012739457715104304 | > step_time: 0.3246 (0.36315274238586426) | > loader_time: 0.0045 (0.00934072544700221)  --> TIME: 2023-10-20 04:37:27 -- STEP: 49/50 -- GLOBAL_STEP: 75600 | > loss_disc: 2.1198830604553223 (2.3312225390453727) | > loss_disc_real_0: 0.01254342496395111 (0.13318361235516413) | > loss_disc_real_1: 0.1679556965827942 (0.22239571672921277) | > loss_disc_real_2: 0.13027499616146088 (0.21142112684189057) | > loss_disc_real_3: 0.3567543625831604 (0.2233685918760543) | > loss_disc_real_4: 0.41279396414756775 (0.2201552647260987) | > loss_disc_real_5: 0.2929134666919708 (0.21656970847017912) | > loss_0: 2.1198830604553223 (2.3312225390453727) | > grad_norm_0: tensor(1386.0609, device='cuda:0') (tensor(1400.0446, device='cuda:0')) | > loss_gen: 3.6106626987457275 (2.481141177975401) | > loss_kl: 0.3397338092327118 (0.8503283615014992) | > loss_feat: 8.504743576049805 (5.482061024299082) | > loss_mel: 31.76641082763672 (22.14333337910321) | > loss_duration: 1.6501014232635498 (1.5277498327955907) | > loss_1: 45.87165451049805 (32.484613914879) | > grad_norm_1: tensor(99619.5547, device='cuda:0') (tensor(45066.7500, device='cuda:0')) | > current_lr_0: 0.00012739457715104304 | > current_lr_1: 0.00012739457715104304 | > step_time: 0.3145 (0.432288612638201) | > loader_time: 0.4498 (0.018714301440180565)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3710834980010986 (2.3710834980010986) | > loss_disc_real_0: 0.10199957340955734 (0.10199957340955734) | > loss_disc_real_1: 0.3471687436103821 (0.3471687436103821) | > loss_disc_real_2: 0.4961489737033844 (0.4961489737033844) | > loss_disc_real_3: 0.252511203289032 (0.252511203289032) | > loss_disc_real_4: 0.2924959659576416 (0.2924959659576416) | > loss_disc_real_5: 0.31389009952545166 (0.31389009952545166) | > loss_0: 2.3710834980010986 (2.3710834980010986) | > loss_gen: 3.478703022003174 (3.478703022003174) | > loss_kl: 3.641787052154541 (3.641787052154541) | > loss_feat: 5.6381072998046875 (5.6381072998046875) | > loss_mel: 23.33787727355957 (23.33787727355957) | > loss_duration: 2.6127517223358154 (2.6127517223358154) | > loss_1: 38.709224700927734 (38.709224700927734)  --> STEP: 1 | > loss_disc: 2.9022955894470215 (2.9022955894470215) | > loss_disc_real_0: 0.2158827781677246 (0.2158827781677246) | > loss_disc_real_1: 0.39607536792755127 (0.39607536792755127) | > loss_disc_real_2: 0.20806825160980225 (0.20806825160980225) | > loss_disc_real_3: 0.15298248827457428 (0.15298248827457428) | > loss_disc_real_4: 0.42131754755973816 (0.42131754755973816) | > loss_disc_real_5: 0.4561040699481964 (0.4561040699481964) | > loss_0: 2.9022955894470215 (2.9022955894470215) | > loss_gen: 4.357398986816406 (4.357398986816406) | > loss_kl: 3.7099905014038086 (3.7099905014038086) | > loss_feat: 9.08857250213623 (9.08857250213623) | > loss_mel: 34.846622467041016 (34.846622467041016) | > loss_duration: 2.8971903324127197 (2.8971903324127197) | > loss_1: 54.899776458740234 (54.899776458740234)  --> STEP: 2 | > loss_disc: 3.079623222351074 (2.990959405899048) | > loss_disc_real_0: 0.09379978477954865 (0.15484128147363663) | > loss_disc_real_1: 0.29529163241386414 (0.3456835001707077) | > loss_disc_real_2: 0.39764541387557983 (0.30285683274269104) | > loss_disc_real_3: 0.36240729689598083 (0.25769489258527756) | > loss_disc_real_4: 0.20730634033679962 (0.3143119439482689) | > loss_disc_real_5: 0.3323515057563782 (0.3942277878522873) | > loss_0: 3.079623222351074 (2.990959405899048) | > loss_gen: 1.8604575395584106 (3.1089282631874084) | > loss_kl: 3.9589970111846924 (3.8344937562942505) | > loss_feat: 2.7092792987823486 (5.8989259004592896) | > loss_mel: 25.410097122192383 (30.1283597946167) | > loss_duration: 2.744412660598755 (2.8208014965057373) | > loss_1: 36.68324279785156 (45.7915096282959)  --> STEP: 3 | > loss_disc: 2.5390124320983887 (2.8403104146321616) | > loss_disc_real_0: 0.04498317092657089 (0.11822191129128139) | > loss_disc_real_1: 0.2975645661354065 (0.329643855492274) | > loss_disc_real_2: 0.43093836307525635 (0.34555067618687946) | > loss_disc_real_3: 0.3238532543182373 (0.2797476798295975) | > loss_disc_real_4: 0.32566332817077637 (0.31809573868910473) | > loss_disc_real_5: 0.4844343662261963 (0.42429664731025696) | > loss_0: 2.5390124320983887 (2.8403104146321616) | > loss_gen: 3.1658146381378174 (3.127890388170878) | > loss_kl: 1.9483169317245483 (3.2057681481043496) | > loss_feat: 4.262589454650879 (5.353480418523152) | > loss_mel: 24.918062210083008 (28.39159393310547) | > loss_duration: 2.5635488033294678 (2.735050598780314) | > loss_1: 36.858333587646484 (42.81378428141276) --> EVAL PERFORMANCE | > avg_loader_time: 0.010373195012410482 (+0.005246003468831381) | > avg_loss_disc: 2.8403104146321616 (-0.03310052553812648) | > avg_loss_disc_real_0: 0.11822191129128139 (-0.12714484085639316) | > avg_loss_disc_real_1: 0.329643855492274 (+0.05325991412003839) | > avg_loss_disc_real_2: 0.34555067618687946 (+0.1259235342343648) | > avg_loss_disc_real_3: 0.2797476798295975 (-0.042222137252489744) | > avg_loss_disc_real_4: 0.31809573868910473 (+0.041489789883295713) | > avg_loss_disc_real_5: 0.42429664731025696 (+0.17120109995206195) | > avg_loss_0: 2.8403104146321616 (-0.03310052553812648) | > avg_loss_gen: 3.127890388170878 (+0.8627660274505615) | > avg_loss_kl: 3.2057681481043496 (+0.13714428742726614) | > avg_loss_feat: 5.353480418523152 (+2.6821530858675637) | > avg_loss_mel: 28.39159393310547 (+13.27101723353068) | > avg_loss_duration: 2.735050598780314 (-0.06843845049540231) | > avg_loss_1: 42.81378428141276 (+16.884644826253254)  > EPOCH: 452/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:37:38)   --> TIME: 2023-10-20 04:37:57 -- STEP: 29/50 -- GLOBAL_STEP: 75630 | > loss_disc: 2.583664894104004 (2.443861262551669) | > loss_disc_real_0: 0.10325665026903152 (0.16655846778303385) | > loss_disc_real_1: 0.22712643444538116 (0.23422983070385867) | > loss_disc_real_2: 0.25711095333099365 (0.22985442547962584) | > loss_disc_real_3: 0.26549962162971497 (0.23985015388963551) | > loss_disc_real_4: 0.21133287250995636 (0.23028864531681456) | > loss_disc_real_5: 0.21518351137638092 (0.20572974430076008) | > loss_0: 2.583664894104004 (2.443861262551669) | > grad_norm_0: tensor(1041.2966, device='cuda:0') (tensor(1561.9185, device='cuda:0')) | > loss_gen: 1.9735887050628662 (2.50326185390867) | > loss_kl: 0.9069238305091858 (0.888780514741766) | > loss_feat: 1.882297158241272 (5.524804212152958) | > loss_mel: 18.894052505493164 (21.549268590992895) | > loss_duration: 1.4961836338043213 (1.5489552021026611) | > loss_1: 25.153045654296875 (32.01507032328639) | > grad_norm_1: tensor(10222.0391, device='cuda:0') (tensor(49756.9297, device='cuda:0')) | > current_lr_0: 0.00012726723829508787 | > current_lr_1: 0.00012726723829508787 | > step_time: 0.5547 (0.5033081975476494) | > loader_time: 0.0102 (0.01783705579823461)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.168630838394165 (3.168630838394165) | > loss_disc_real_0: 0.43980923295021057 (0.43980923295021057) | > loss_disc_real_1: 0.29166558384895325 (0.29166558384895325) | > loss_disc_real_2: 0.34157511591911316 (0.34157511591911316) | > loss_disc_real_3: 0.24595443904399872 (0.24595443904399872) | > loss_disc_real_4: 0.2727069556713104 (0.2727069556713104) | > loss_disc_real_5: 0.32256901264190674 (0.32256901264190674) | > loss_0: 3.168630838394165 (3.168630838394165) | > loss_gen: 1.8172128200531006 (1.8172128200531006) | > loss_kl: 2.011453866958618 (2.011453866958618) | > loss_feat: 0.7747454643249512 (0.7747454643249512) | > loss_mel: 22.1442813873291 (22.1442813873291) | > loss_duration: 2.4482171535491943 (2.4482171535491943) | > loss_1: 29.195911407470703 (29.195911407470703)  --> STEP: 1 | > loss_disc: 3.2738661766052246 (3.2738661766052246) | > loss_disc_real_0: 0.42801618576049805 (0.42801618576049805) | > loss_disc_real_1: 0.27733030915260315 (0.27733030915260315) | > loss_disc_real_2: 0.5093034505844116 (0.5093034505844116) | > loss_disc_real_3: 0.31636151671409607 (0.31636151671409607) | > loss_disc_real_4: 0.294767290353775 (0.294767290353775) | > loss_disc_real_5: 0.24604323506355286 (0.24604323506355286) | > loss_0: 3.2738661766052246 (3.2738661766052246) | > loss_gen: 2.1251604557037354 (2.1251604557037354) | > loss_kl: 3.218916654586792 (3.218916654586792) | > loss_feat: 5.482488632202148 (5.482488632202148) | > loss_mel: 23.203325271606445 (23.203325271606445) | > loss_duration: 2.8149633407592773 (2.8149633407592773) | > loss_1: 36.84485626220703 (36.84485626220703)  --> STEP: 2 | > loss_disc: 2.3912954330444336 (2.832580804824829) | > loss_disc_real_0: 0.1905846893787384 (0.3093004375696182) | > loss_disc_real_1: 0.3879072368144989 (0.332618772983551) | > loss_disc_real_2: 0.3328666090965271 (0.42108502984046936) | > loss_disc_real_3: 0.2264224886894226 (0.27139200270175934) | > loss_disc_real_4: 0.10734555125236511 (0.20105642080307007) | > loss_disc_real_5: 0.25368428230285645 (0.24986375868320465) | > loss_0: 2.3912954330444336 (2.832580804824829) | > loss_gen: 2.5262327194213867 (2.325696587562561) | > loss_kl: 3.762577772140503 (3.4907472133636475) | > loss_feat: 3.7714178562164307 (4.6269532442092896) | > loss_mel: 30.433351516723633 (26.81833839416504) | > loss_duration: 2.695868968963623 (2.75541615486145) | > loss_1: 43.189449310302734 (40.01715278625488)  --> STEP: 3 | > loss_disc: 2.486156940460205 (2.7171061833699546) | > loss_disc_real_0: 0.2954011559486389 (0.30466734369595844) | > loss_disc_real_1: 0.28837525844573975 (0.3178709348042806) | > loss_disc_real_2: 0.2944777011871338 (0.37888258695602417) | > loss_disc_real_3: 0.16986000537872314 (0.2375480035940806) | > loss_disc_real_4: 0.1659131497144699 (0.18934199710687002) | > loss_disc_real_5: 0.13886944949626923 (0.21286565562089285) | > loss_0: 2.486156940460205 (2.7171061833699546) | > loss_gen: 2.1805286407470703 (2.2773072719573975) | > loss_kl: 1.6186116933822632 (2.8667020400365195) | > loss_feat: 3.490460157394409 (4.248122215270996) | > loss_mel: 18.316848754882812 (23.984508514404297) | > loss_duration: 2.5562584400177 (2.6890302499135337) | > loss_1: 28.162708282470703 (36.06567128499349) --> EVAL PERFORMANCE | > avg_loader_time: 0.0023087660471598306 (-0.008064428965250652) | > avg_loss_disc: 2.7171061833699546 (-0.12320423126220703) | > avg_loss_disc_real_0: 0.30466734369595844 (+0.18644543240467704) | > avg_loss_disc_real_1: 0.3178709348042806 (-0.011772920687993405) | > avg_loss_disc_real_2: 0.37888258695602417 (+0.03333191076914471) | > avg_loss_disc_real_3: 0.2375480035940806 (-0.042199676235516875) | > avg_loss_disc_real_4: 0.18934199710687002 (-0.1287537415822347) | > avg_loss_disc_real_5: 0.21286565562089285 (-0.2114309916893641) | > avg_loss_0: 2.7171061833699546 (-0.12320423126220703) | > avg_loss_gen: 2.2773072719573975 (-0.8505831162134805) | > avg_loss_kl: 2.8667020400365195 (-0.3390661080678301) | > avg_loss_feat: 4.248122215270996 (-1.1053582032521563) | > avg_loss_mel: 23.984508514404297 (-4.407085418701172) | > avg_loss_duration: 2.6890302499135337 (-0.0460203488667803) | > avg_loss_1: 36.06567128499349 (-6.748112996419266)  > EPOCH: 453/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:38:16)   --> TIME: 2023-10-20 04:38:28 -- STEP: 9/50 -- GLOBAL_STEP: 75660 | > loss_disc: 2.2035505771636963 (2.4326894018385143) | > loss_disc_real_0: 0.12573230266571045 (0.1525089261122048) | > loss_disc_real_1: 0.12570072710514069 (0.23115203612380558) | > loss_disc_real_2: 0.16549594700336456 (0.24009117318524253) | > loss_disc_real_3: 0.14383336901664734 (0.2346230008535915) | > loss_disc_real_4: 0.22105111181735992 (0.24444865352577633) | > loss_disc_real_5: 0.3641579747200012 (0.25724542720450294) | > loss_0: 2.2035505771636963 (2.4326894018385143) | > grad_norm_0: tensor(882.1301, device='cuda:0') (tensor(1520.7515, device='cuda:0')) | > loss_gen: 2.4561100006103516 (2.3110646539264255) | > loss_kl: 0.6939744353294373 (0.8101764420668284) | > loss_feat: 5.767259120941162 (3.9706304139561124) | > loss_mel: 21.991098403930664 (20.201043870713974) | > loss_duration: 1.5034949779510498 (1.5162252982457478) | > loss_1: 32.41193771362305 (28.80914094712999) | > grad_norm_1: tensor(35861.5703, device='cuda:0') (tensor(30731.4316, device='cuda:0')) | > current_lr_0: 0.00012714002672229178 | > current_lr_1: 0.00012714002672229178 | > step_time: 0.5428 (0.4901922543843587) | > loader_time: 0.0227 (0.016973919338650174)  --> TIME: 2023-10-20 04:38:44 -- STEP: 39/50 -- GLOBAL_STEP: 75690 | > loss_disc: 3.0114941596984863 (2.4034328644092264) | > loss_disc_real_0: 0.20202139019966125 (0.14853765441773412) | > loss_disc_real_1: 0.2852901220321655 (0.2197457383840512) | > loss_disc_real_2: 0.2312830537557602 (0.22594020611200577) | > loss_disc_real_3: 0.2574918568134308 (0.22253444146078366) | > loss_disc_real_4: 0.2661365866661072 (0.22514041169331625) | > loss_disc_real_5: 0.2824862003326416 (0.22940529352770403) | > loss_0: 3.0114941596984863 (2.4034328644092264) | > grad_norm_0: tensor(303.1159, device='cuda:0') (tensor(923.6789, device='cuda:0')) | > loss_gen: 1.5483615398406982 (2.3584267176114597) | > loss_kl: 0.5821506381034851 (0.7973067187345945) | > loss_feat: 0.050031259655952454 (5.139376586446395) | > loss_mel: 1.5840390920639038 (21.27757191963685) | > loss_duration: 1.6020108461380005 (1.5262227333509004) | > loss_1: 5.366593360900879 (31.09890493979821) | > grad_norm_1: tensor(38139.5859, device='cuda:0') (tensor(27394.6289, device='cuda:0')) | > current_lr_0: 0.00012714002672229178 | > current_lr_1: 0.00012714002672229178 | > step_time: 0.6143 (0.5114730810507749) | > loader_time: 0.0219 (0.016130050023396805)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.3864085674285889 (1.3864085674285889) | > loss_disc_real_0: 0.09764364361763 (0.09764364361763) | > loss_disc_real_1: 0.033552054315805435 (0.033552054315805435) | > loss_disc_real_2: 0.02915913611650467 (0.02915913611650467) | > loss_disc_real_3: 0.2041112333536148 (0.2041112333536148) | > loss_disc_real_4: 0.016072971746325493 (0.016072971746325493) | > loss_disc_real_5: 0.07427840679883957 (0.07427840679883957) | > loss_0: 1.3864085674285889 (1.3864085674285889) | > loss_gen: 2.566593647003174 (2.566593647003174) | > loss_kl: 3.2304646968841553 (3.2304646968841553) | > loss_feat: 12.007575035095215 (12.007575035095215) | > loss_mel: 26.210983276367188 (26.210983276367188) | > loss_duration: 2.495541572570801 (2.495541572570801) | > loss_1: 46.51115798950195 (46.51115798950195)  --> STEP: 1 | > loss_disc: 3.2502126693725586 (3.2502126693725586) | > loss_disc_real_0: 0.3669959306716919 (0.3669959306716919) | > loss_disc_real_1: 0.2983614504337311 (0.2983614504337311) | > loss_disc_real_2: 0.20271679759025574 (0.20271679759025574) | > loss_disc_real_3: 0.34138643741607666 (0.34138643741607666) | > loss_disc_real_4: 0.10617347061634064 (0.10617347061634064) | > loss_disc_real_5: 0.15954580903053284 (0.15954580903053284) | > loss_0: 3.2502126693725586 (3.2502126693725586) | > loss_gen: 1.532088041305542 (1.532088041305542) | > loss_kl: 3.82918119430542 (3.82918119430542) | > loss_feat: 1.9497593641281128 (1.9497593641281128) | > loss_mel: 21.938457489013672 (21.938457489013672) | > loss_duration: 2.758119821548462 (2.758119821548462) | > loss_1: 32.007606506347656 (32.007606506347656)  --> STEP: 2 | > loss_disc: 2.5830459594726562 (2.9166293144226074) | > loss_disc_real_0: 0.5365191698074341 (0.451757550239563) | > loss_disc_real_1: 0.14341792464256287 (0.22088968753814697) | > loss_disc_real_2: 0.13810382783412933 (0.17041031271219254) | > loss_disc_real_3: 0.33992019295692444 (0.34065331518650055) | > loss_disc_real_4: 0.12456892430782318 (0.11537119746208191) | > loss_disc_real_5: 0.20418193936347961 (0.18186387419700623) | > loss_0: 2.5830459594726562 (2.9166293144226074) | > loss_gen: 2.6622862815856934 (2.0971871614456177) | > loss_kl: 4.51195764541626 (4.17056941986084) | > loss_feat: 9.041952133178711 (5.495855748653412) | > loss_mel: 24.95470428466797 (23.44658088684082) | > loss_duration: 2.6936073303222656 (2.7258635759353638) | > loss_1: 43.864505767822266 (37.93605613708496)  --> STEP: 3 | > loss_disc: 2.794257402420044 (2.8758386770884194) | > loss_disc_real_0: 0.38660478591918945 (0.4300399621327718) | > loss_disc_real_1: 0.3243696391582489 (0.2553830047448476) | > loss_disc_real_2: 0.36756256222724915 (0.2361277292172114) | > loss_disc_real_3: 0.366192489862442 (0.3491663734118144) | > loss_disc_real_4: 0.2781960070133209 (0.1696461339791616) | > loss_disc_real_5: 0.36363691091537476 (0.2424548864364624) | > loss_0: 2.794257402420044 (2.8758386770884194) | > loss_gen: 3.020900249481201 (2.4050915241241455) | > loss_kl: 1.7471675872802734 (3.362768809000651) | > loss_feat: 4.034582614898682 (5.0087647040685015) | > loss_mel: 22.72599220275879 (23.206384658813477) | > loss_duration: 2.619699716567993 (2.6904756228129068) | > loss_1: 34.14834213256836 (36.673484802246094) --> EVAL PERFORMANCE | > avg_loader_time: 0.013437668482462565 (+0.011128902435302734) | > avg_loss_disc: 2.8758386770884194 (+0.15873249371846487) | > avg_loss_disc_real_0: 0.4300399621327718 (+0.12537261843681335) | > avg_loss_disc_real_1: 0.2553830047448476 (-0.06248793005943298) | > avg_loss_disc_real_2: 0.2361277292172114 (-0.14275485773881277) | > avg_loss_disc_real_3: 0.3491663734118144 (+0.11161836981773379) | > avg_loss_disc_real_4: 0.1696461339791616 (-0.019695863127708435) | > avg_loss_disc_real_5: 0.2424548864364624 (+0.02958923081556955) | > avg_loss_0: 2.8758386770884194 (+0.15873249371846487) | > avg_loss_gen: 2.4050915241241455 (+0.12778425216674805) | > avg_loss_kl: 3.362768809000651 (+0.4960667689641314) | > avg_loss_feat: 5.0087647040685015 (+0.7606424887975054) | > avg_loss_mel: 23.206384658813477 (-0.7781238555908203) | > avg_loss_duration: 2.6904756228129068 (+0.0014453728993730763) | > avg_loss_1: 36.673484802246094 (+0.6078135172526018)  > EPOCH: 454/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:39:01)   --> TIME: 2023-10-20 04:39:12 -- STEP: 19/50 -- GLOBAL_STEP: 75720 | > loss_disc: 2.990990161895752 (2.5019215659091345) | > loss_disc_real_0: 0.25139233469963074 (0.17868519182267942) | > loss_disc_real_1: 0.25073790550231934 (0.22324966835348228) | > loss_disc_real_2: 0.24237069487571716 (0.2571075439060989) | > loss_disc_real_3: 0.2846655547618866 (0.24957031835066645) | > loss_disc_real_4: 0.24594458937644958 (0.22411778059444928) | > loss_disc_real_5: 0.25837212800979614 (0.22285012547907077) | > loss_0: 2.990990161895752 (2.5019215659091345) | > grad_norm_0: tensor(393.4414, device='cuda:0') (tensor(694.8586, device='cuda:0')) | > loss_gen: 1.5815507173538208 (2.3110712641163875) | > loss_kl: 0.5839232206344604 (0.8349911711717907) | > loss_feat: 0.2119608074426651 (4.2749559181301215) | > loss_mel: 3.568462610244751 (19.871562895021942) | > loss_duration: 1.7041709423065186 (1.5611007590042918) | > loss_1: 7.650068283081055 (28.853681639621133) | > grad_norm_1: tensor(3671.3833, device='cuda:0') (tensor(19666.2500, device='cuda:0')) | > current_lr_0: 0.0001270129423054274 | > current_lr_1: 0.0001270129423054274 | > step_time: 0.6683 (0.35874661646391215) | > loader_time: 0.0244 (0.007935097343043276)  --> TIME: 2023-10-20 04:39:28 -- STEP: 49/50 -- GLOBAL_STEP: 75750 | > loss_disc: 2.0792934894561768 (2.4641928113236724) | > loss_disc_real_0: 0.08913642168045044 (0.1687928254773118) | > loss_disc_real_1: 0.2806805372238159 (0.226060952953234) | > loss_disc_real_2: 0.20702779293060303 (0.2385937407308695) | > loss_disc_real_3: 0.2673530578613281 (0.23931755011483113) | > loss_disc_real_4: 0.18515677750110626 (0.2336084271343995) | > loss_disc_real_5: 0.1704975962638855 (0.2282273174852741) | > loss_0: 2.0792934894561768 (2.4641928113236724) | > grad_norm_0: tensor(520.6689, device='cuda:0') (tensor(689.1976, device='cuda:0')) | > loss_gen: 2.986621618270874 (2.3763876861455495) | > loss_kl: 0.3481283485889435 (0.8275327179200795) | > loss_feat: 6.201210975646973 (5.359920669879234) | > loss_mel: 22.802249908447266 (20.961721125914124) | > loss_duration: 1.6478562355041504 (1.5221614375406385) | > loss_1: 33.98606872558594 (31.047723526857336) | > grad_norm_1: tensor(17753.0410, device='cuda:0') (tensor(22061.1426, device='cuda:0')) | > current_lr_0: 0.0001270129423054274 | > current_lr_1: 0.0001270129423054274 | > step_time: 0.3126 (0.4389596277353715) | > loader_time: 0.3871 (0.018785121489544303)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7664803266525269 (1.7664803266525269) | > loss_disc_real_0: 0.02699974738061428 (0.02699974738061428) | > loss_disc_real_1: 0.11364194750785828 (0.11364194750785828) | > loss_disc_real_2: 0.12006157636642456 (0.12006157636642456) | > loss_disc_real_3: 0.16899912059307098 (0.16899912059307098) | > loss_disc_real_4: 0.1545146107673645 (0.1545146107673645) | > loss_disc_real_5: 0.06076737493276596 (0.06076737493276596) | > loss_0: 1.7664803266525269 (1.7664803266525269) | > loss_gen: 2.5488669872283936 (2.5488669872283936) | > loss_kl: 4.088533878326416 (4.088533878326416) | > loss_feat: 12.050180435180664 (12.050180435180664) | > loss_mel: 26.456470489501953 (26.456470489501953) | > loss_duration: 2.560875415802002 (2.560875415802002) | > loss_1: 47.704925537109375 (47.704925537109375)  --> STEP: 1 | > loss_disc: 3.277308940887451 (3.277308940887451) | > loss_disc_real_0: 0.19257642328739166 (0.19257642328739166) | > loss_disc_real_1: 0.1592496633529663 (0.1592496633529663) | > loss_disc_real_2: 0.32047441601753235 (0.32047441601753235) | > loss_disc_real_3: 0.3906058073043823 (0.3906058073043823) | > loss_disc_real_4: 0.5080435872077942 (0.5080435872077942) | > loss_disc_real_5: 0.3831448256969452 (0.3831448256969452) | > loss_0: 3.277308940887451 (3.277308940887451) | > loss_gen: 2.146716356277466 (2.146716356277466) | > loss_kl: 3.64406681060791 (3.64406681060791) | > loss_feat: 6.530257225036621 (6.530257225036621) | > loss_mel: 28.454601287841797 (28.454601287841797) | > loss_duration: 2.7773172855377197 (2.7773172855377197) | > loss_1: 43.55295944213867 (43.55295944213867)  --> STEP: 2 | > loss_disc: 2.595399856567383 (2.936354398727417) | > loss_disc_real_0: 0.060893550515174866 (0.12673498690128326) | > loss_disc_real_1: 0.19479119777679443 (0.17702043056488037) | > loss_disc_real_2: 0.2546396553516388 (0.28755703568458557) | > loss_disc_real_3: 0.19793015718460083 (0.2942679822444916) | > loss_disc_real_4: 0.2539862096309662 (0.3810148984193802) | > loss_disc_real_5: 0.19948388636112213 (0.29131435602903366) | > loss_0: 2.595399856567383 (2.936354398727417) | > loss_gen: 1.672856092453003 (1.9097862243652344) | > loss_kl: 4.241593360900879 (3.9428300857543945) | > loss_feat: 4.929346084594727 (5.729801654815674) | > loss_mel: 24.28827476501465 (26.371438026428223) | > loss_duration: 2.7422873973846436 (2.7598023414611816) | > loss_1: 37.87435531616211 (40.71365737915039)  --> STEP: 3 | > loss_disc: 2.969360113143921 (2.9473563035329184) | > loss_disc_real_0: 0.2598567605018616 (0.17110891143480936) | > loss_disc_real_1: 0.2529081106185913 (0.20231632391611734) | > loss_disc_real_2: 0.28150463104248047 (0.28553956747055054) | > loss_disc_real_3: 0.26657527685165405 (0.2850370804468791) | > loss_disc_real_4: 0.2821601927280426 (0.348063329855601) | > loss_disc_real_5: 0.25893405079841614 (0.28052092095216113) | > loss_0: 2.969360113143921 (2.9473563035329184) | > loss_gen: 1.6419548988342285 (1.8205091158548992) | > loss_kl: 2.216032028198242 (3.3672307332356772) | > loss_feat: 0.09922480583190918 (3.852942705154419) | > loss_mel: 2.4902710914611816 (18.411049048105877) | > loss_duration: 2.598522663116455 (2.706042448679606) | > loss_1: 9.046005249023438 (30.15777333577474) --> EVAL PERFORMANCE | > avg_loader_time: 0.01603047053019206 (+0.002592802047729494) | > avg_loss_disc: 2.9473563035329184 (+0.071517626444499) | > avg_loss_disc_real_0: 0.17110891143480936 (-0.2589310506979624) | > avg_loss_disc_real_1: 0.20231632391611734 (-0.053066680828730256) | > avg_loss_disc_real_2: 0.28553956747055054 (+0.04941183825333914) | > avg_loss_disc_real_3: 0.2850370804468791 (-0.0641292929649353) | > avg_loss_disc_real_4: 0.348063329855601 (+0.17841719587643942) | > avg_loss_disc_real_5: 0.28052092095216113 (+0.03806603451569873) | > avg_loss_0: 2.9473563035329184 (+0.071517626444499) | > avg_loss_gen: 1.8205091158548992 (-0.5845824082692463) | > avg_loss_kl: 3.3672307332356772 (+0.004461924235026338) | > avg_loss_feat: 3.852942705154419 (-1.1558219989140825) | > avg_loss_mel: 18.411049048105877 (-4.7953356107076) | > avg_loss_duration: 2.706042448679606 (+0.015566825866699219) | > avg_loss_1: 30.15777333577474 (-6.515711466471355)  > EPOCH: 455/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:39:38)   --> TIME: 2023-10-20 04:39:57 -- STEP: 29/50 -- GLOBAL_STEP: 75780 | > loss_disc: 1.6867350339889526 (2.4620340733692556) | > loss_disc_real_0: 0.13696563243865967 (0.15404410968566762) | > loss_disc_real_1: 0.2928486466407776 (0.22956749385800854) | > loss_disc_real_2: 0.09123226255178452 (0.21794599089129219) | > loss_disc_real_3: 0.23064017295837402 (0.23714066939107306) | > loss_disc_real_4: 0.10569652915000916 (0.22152664204095973) | > loss_disc_real_5: 0.03601374477148056 (0.23047853023584547) | > loss_0: 1.6867350339889526 (2.4620340733692556) | > grad_norm_0: tensor(481.3952, device='cuda:0') (tensor(560.7606, device='cuda:0')) | > loss_gen: 3.391299247741699 (2.2859138579204172) | > loss_kl: 0.5201495885848999 (0.9143632897015276) | > loss_feat: 10.666622161865234 (5.544813385554427) | > loss_mel: 23.13590431213379 (21.682671427726746) | > loss_duration: 1.4930545091629028 (1.536647837737511) | > loss_1: 39.20703125 (31.964409762415393) | > grad_norm_1: tensor(66857.3281, device='cuda:0') (tensor(22316.2148, device='cuda:0')) | > current_lr_0: 0.00012688598491739434 | > current_lr_1: 0.00012688598491739434 | > step_time: 0.6912 (0.49830916832233296) | > loader_time: 0.0251 (0.020250303991909684)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9520046710968018 (2.9520046710968018) | > loss_disc_real_0: 0.29768040776252747 (0.29768040776252747) | > loss_disc_real_1: 0.2513023018836975 (0.2513023018836975) | > loss_disc_real_2: 0.28859761357307434 (0.28859761357307434) | > loss_disc_real_3: 0.2956099808216095 (0.2956099808216095) | > loss_disc_real_4: 0.27020588517189026 (0.27020588517189026) | > loss_disc_real_5: 0.2526484429836273 (0.2526484429836273) | > loss_0: 2.9520046710968018 (2.9520046710968018) | > loss_gen: 1.7629848718643188 (1.7629848718643188) | > loss_kl: 3.086632013320923 (3.086632013320923) | > loss_feat: 0.3198096454143524 (0.3198096454143524) | > loss_mel: 14.290336608886719 (14.290336608886719) | > loss_duration: 2.608771800994873 (2.608771800994873) | > loss_1: 22.06853485107422 (22.06853485107422)  --> STEP: 1 | > loss_disc: 2.3175883293151855 (2.3175883293151855) | > loss_disc_real_0: 0.17866070568561554 (0.17866070568561554) | > loss_disc_real_1: 0.17553603649139404 (0.17553603649139404) | > loss_disc_real_2: 0.2892754375934601 (0.2892754375934601) | > loss_disc_real_3: 0.2927475571632385 (0.2927475571632385) | > loss_disc_real_4: 0.16660143435001373 (0.16660143435001373) | > loss_disc_real_5: 0.23776014149188995 (0.23776014149188995) | > loss_0: 2.3175883293151855 (2.3175883293151855) | > loss_gen: 2.5001492500305176 (2.5001492500305176) | > loss_kl: 3.4547946453094482 (3.4547946453094482) | > loss_feat: 6.415492057800293 (6.415492057800293) | > loss_mel: 22.45540428161621 (22.45540428161621) | > loss_duration: 2.8862950801849365 (2.8862950801849365) | > loss_1: 37.712135314941406 (37.712135314941406)  --> STEP: 2 | > loss_disc: 2.636060953140259 (2.476824641227722) | > loss_disc_real_0: 0.12501752376556396 (0.15183911472558975) | > loss_disc_real_1: 0.06631000339984894 (0.12092301994562149) | > loss_disc_real_2: 0.1692919284105301 (0.2292836830019951) | > loss_disc_real_3: 0.14521333575248718 (0.21898044645786285) | > loss_disc_real_4: 0.1926928609609604 (0.17964714765548706) | > loss_disc_real_5: 0.3000047206878662 (0.2688824310898781) | > loss_0: 2.636060953140259 (2.476824641227722) | > loss_gen: 1.7011669874191284 (2.100658118724823) | > loss_kl: 3.9933111667633057 (3.724052906036377) | > loss_feat: 8.984155654907227 (7.69982385635376) | > loss_mel: 24.76580047607422 (23.610602378845215) | > loss_duration: 2.756849527359009 (2.8215723037719727) | > loss_1: 42.20128631591797 (39.95671081542969)  --> STEP: 3 | > loss_disc: 2.941089630126953 (2.631579637527466) | > loss_disc_real_0: 0.3191181421279907 (0.20759879052639008) | > loss_disc_real_1: 0.26122042536735535 (0.16768882175286612) | > loss_disc_real_2: 0.3483160138130188 (0.2689611266056697) | > loss_disc_real_3: 0.30473506450653076 (0.24756531914075217) | > loss_disc_real_4: 0.40251970291137695 (0.2539379994074504) | > loss_disc_real_5: 0.3727293312549591 (0.3034980644782384) | > loss_0: 2.941089630126953 (2.631579637527466) | > loss_gen: 2.354745388031006 (2.1853538751602173) | > loss_kl: 1.9435020685195923 (3.1305359601974487) | > loss_feat: 2.093555212020874 (5.831067641576131) | > loss_mel: 19.26656723022461 (22.162590662638348) | > loss_duration: 2.602076292037964 (2.748406966527303) | > loss_1: 28.260446548461914 (36.057956059773765) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018203258514404297 (-0.014210144678751629) | > avg_loss_disc: 2.631579637527466 (-0.3157766660054526) | > avg_loss_disc_real_0: 0.20759879052639008 (+0.03648987909158072) | > avg_loss_disc_real_1: 0.16768882175286612 (-0.03462750216325122) | > avg_loss_disc_real_2: 0.2689611266056697 (-0.01657844086488086) | > avg_loss_disc_real_3: 0.24756531914075217 (-0.03747176130612692) | > avg_loss_disc_real_4: 0.2539379994074504 (-0.09412533044815063) | > avg_loss_disc_real_5: 0.3034980644782384 (+0.02297714352607727) | > avg_loss_0: 2.631579637527466 (-0.3157766660054526) | > avg_loss_gen: 2.1853538751602173 (+0.3648447593053181) | > avg_loss_kl: 3.1305359601974487 (-0.2366947730382285) | > avg_loss_feat: 5.831067641576131 (+1.978124936421712) | > avg_loss_mel: 22.162590662638348 (+3.7515416145324707) | > avg_loss_duration: 2.748406966527303 (+0.042364517847697236) | > avg_loss_1: 36.057956059773765 (+5.900182723999027)  > EPOCH: 456/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:40:17)   --> TIME: 2023-10-20 04:40:29 -- STEP: 9/50 -- GLOBAL_STEP: 75810 | > loss_disc: 1.9862055778503418 (2.231244365374247) | > loss_disc_real_0: 0.10979991406202316 (0.12788638431164953) | > loss_disc_real_1: 0.1533983051776886 (0.21935615854130852) | > loss_disc_real_2: 0.18418219685554504 (0.23625164975722632) | > loss_disc_real_3: 0.19926662743091583 (0.20229437864489025) | > loss_disc_real_4: 0.12985995411872864 (0.15049634501338005) | > loss_disc_real_5: 0.16673386096954346 (0.23177447666724524) | > loss_0: 1.9862055778503418 (2.231244365374247) | > grad_norm_0: tensor(264.6218, device='cuda:0') (tensor(488.7907, device='cuda:0')) | > loss_gen: 2.4938671588897705 (2.526082542207506) | > loss_kl: 0.5948073863983154 (0.6063988357782364) | > loss_feat: 6.532399654388428 (6.723715464274089) | > loss_mel: 24.373939514160156 (23.376032299465603) | > loss_duration: 1.4847493171691895 (1.5187243223190308) | > loss_1: 35.47976303100586 (34.75095431009928) | > grad_norm_1: tensor(15103.2959, device='cuda:0') (tensor(18825.6719, device='cuda:0')) | > current_lr_0: 0.0001267591544312193 | > current_lr_1: 0.0001267591544312193 | > step_time: 0.5942 (0.5366602208879259) | > loader_time: 0.0107 (0.01665655771891276)  --> TIME: 2023-10-20 04:40:45 -- STEP: 39/50 -- GLOBAL_STEP: 75840 | > loss_disc: 3.1981098651885986 (2.292488999855824) | > loss_disc_real_0: 0.40773987770080566 (0.16462920238383308) | > loss_disc_real_1: 0.4677705466747284 (0.21005320357970703) | > loss_disc_real_2: 0.49673178791999817 (0.21566586994016781) | > loss_disc_real_3: 0.31144076585769653 (0.2258569645958069) | > loss_disc_real_4: 0.47884586453437805 (0.2014734480673304) | > loss_disc_real_5: 0.36801308393478394 (0.21685605489004117) | > loss_0: 3.1981098651885986 (2.292488999855824) | > grad_norm_0: tensor(1533.1627, device='cuda:0') (tensor(573.0510, device='cuda:0')) | > loss_gen: 3.376154661178589 (2.5822577537634435) | > loss_kl: 0.6243646144866943 (0.8093326943807113) | > loss_feat: 2.995112895965576 (6.348530939660775) | > loss_mel: 23.398193359375 (22.355581246889557) | > loss_duration: 1.5639653205871582 (1.5054669777552288) | > loss_1: 31.95779037475586 (33.60117019751133) | > grad_norm_1: tensor(6186.3496, device='cuda:0') (tensor(19297.0156, device='cuda:0')) | > current_lr_0: 0.0001267591544312193 | > current_lr_1: 0.0001267591544312193 | > step_time: 0.6321 (0.5095065984970485) | > loader_time: 0.0231 (0.019534037663386423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.644369602203369 (2.644369602203369) | > loss_disc_real_0: 0.10679449141025543 (0.10679449141025543) | > loss_disc_real_1: 0.2376168668270111 (0.2376168668270111) | > loss_disc_real_2: 0.27328020334243774 (0.27328020334243774) | > loss_disc_real_3: 0.42959392070770264 (0.42959392070770264) | > loss_disc_real_4: 0.32737016677856445 (0.32737016677856445) | > loss_disc_real_5: 0.4207081198692322 (0.4207081198692322) | > loss_0: 2.644369602203369 (2.644369602203369) | > loss_gen: 2.8670575618743896 (2.8670575618743896) | > loss_kl: 3.1865603923797607 (3.1865603923797607) | > loss_feat: 5.867809295654297 (5.867809295654297) | > loss_mel: 24.913089752197266 (24.913089752197266) | > loss_duration: 2.4726083278656006 (2.4726083278656006) | > loss_1: 39.307125091552734 (39.307125091552734)  --> STEP: 1 | > loss_disc: 2.7830450534820557 (2.7830450534820557) | > loss_disc_real_0: 0.22449487447738647 (0.22449487447738647) | > loss_disc_real_1: 0.2884485423564911 (0.2884485423564911) | > loss_disc_real_2: 0.29008498787879944 (0.29008498787879944) | > loss_disc_real_3: 0.3154216408729553 (0.3154216408729553) | > loss_disc_real_4: 0.29722172021865845 (0.29722172021865845) | > loss_disc_real_5: 0.27292516827583313 (0.27292516827583313) | > loss_0: 2.7830450534820557 (2.7830450534820557) | > loss_gen: 2.1651318073272705 (2.1651318073272705) | > loss_kl: 3.4016151428222656 (3.4016151428222656) | > loss_feat: 1.097124457359314 (1.097124457359314) | > loss_mel: 23.629459381103516 (23.629459381103516) | > loss_duration: 2.821826457977295 (2.821826457977295) | > loss_1: 33.11515808105469 (33.11515808105469)  --> STEP: 2 | > loss_disc: 3.424015760421753 (3.1035304069519043) | > loss_disc_real_0: 0.5556758642196655 (0.390085369348526) | > loss_disc_real_1: 0.2413063943386078 (0.26487746834754944) | > loss_disc_real_2: 0.1772104799747467 (0.23364773392677307) | > loss_disc_real_3: 0.2542974054813385 (0.2848595231771469) | > loss_disc_real_4: 0.18173828721046448 (0.23948000371456146) | > loss_disc_real_5: 0.31894272565841675 (0.29593394696712494) | > loss_0: 3.424015760421753 (3.1035304069519043) | > loss_gen: 1.8860753774642944 (2.0256035923957825) | > loss_kl: 4.128727436065674 (3.7651712894439697) | > loss_feat: 4.891387462615967 (2.9942559599876404) | > loss_mel: 17.426036834716797 (20.527748107910156) | > loss_duration: 2.719102621078491 (2.770464539527893) | > loss_1: 31.05133056640625 (32.08324432373047)  --> STEP: 3 | > loss_disc: 1.927544355392456 (2.7115350564320884) | > loss_disc_real_0: 0.3568379580974579 (0.3790028989315033) | > loss_disc_real_1: 0.17686477303504944 (0.23553990324338278) | > loss_disc_real_2: 0.31504642963409424 (0.2607806324958801) | > loss_disc_real_3: 0.261522114276886 (0.27708038687705994) | > loss_disc_real_4: 0.22127550840377808 (0.233411838610967) | > loss_disc_real_5: 0.04031619057059288 (0.21072802816828093) | > loss_0: 1.927544355392456 (2.7115350564320884) | > loss_gen: 3.2818446159362793 (2.4443506002426147) | > loss_kl: 2.0952601432800293 (3.2085342407226562) | > loss_feat: 8.115931510925293 (4.701481143633525) | > loss_mel: 24.347578048706055 (21.80102475484212) | > loss_duration: 2.660607099533081 (2.7338453928629556) | > loss_1: 40.501220703125 (34.88923645019531) --> EVAL PERFORMANCE | > avg_loader_time: 0.008026599884033203 (+0.0062062740325927734) | > avg_loss_disc: 2.7115350564320884 (+0.07995541890462254) | > avg_loss_disc_real_0: 0.3790028989315033 (+0.17140410840511322) | > avg_loss_disc_real_1: 0.23553990324338278 (+0.06785108149051666) | > avg_loss_disc_real_2: 0.2607806324958801 (-0.008180494109789549) | > avg_loss_disc_real_3: 0.27708038687705994 (+0.02951506773630777) | > avg_loss_disc_real_4: 0.233411838610967 (-0.020526160796483367) | > avg_loss_disc_real_5: 0.21072802816828093 (-0.09277003630995748) | > avg_loss_0: 2.7115350564320884 (+0.07995541890462254) | > avg_loss_gen: 2.4443506002426147 (+0.25899672508239746) | > avg_loss_kl: 3.2085342407226562 (+0.07799828052520752) | > avg_loss_feat: 4.701481143633525 (-1.129586497942606) | > avg_loss_mel: 21.80102475484212 (-0.3615659077962263) | > avg_loss_duration: 2.7338453928629556 (-0.014561573664347627) | > avg_loss_1: 34.88923645019531 (-1.168719609578453)  > EPOCH: 457/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:41:02)   --> TIME: 2023-10-20 04:41:13 -- STEP: 19/50 -- GLOBAL_STEP: 75870 | > loss_disc: 1.8224146366119385 (2.453680898013868) | > loss_disc_real_0: 0.1453060507774353 (0.15187651781659378) | > loss_disc_real_1: 0.1939931958913803 (0.2490657991484592) | > loss_disc_real_2: 0.20665736496448517 (0.23742979510050072) | > loss_disc_real_3: 0.26019009947776794 (0.27094556067727116) | > loss_disc_real_4: 0.2665620446205139 (0.2318405297241713) | > loss_disc_real_5: 0.06241767108440399 (0.23946945055534966) | > loss_0: 1.8224146366119385 (2.453680898013868) | > grad_norm_0: tensor(425.7372, device='cuda:0') (tensor(512.8458, device='cuda:0')) | > loss_gen: 3.217010021209717 (2.482851894278275) | > loss_kl: 1.126115322113037 (0.7998435418856772) | > loss_feat: 10.205099105834961 (5.752154548701487) | > loss_mel: 26.398088455200195 (23.979692823008488) | > loss_duration: 1.6226518154144287 (1.5396114713267277) | > loss_1: 42.56896209716797 (34.55415439605713) | > grad_norm_1: tensor(59462.7539, device='cuda:0') (tensor(21303.2773, device='cuda:0')) | > current_lr_0: 0.000126632450720056 | > current_lr_1: 0.000126632450720056 | > step_time: 0.6738 (0.36990160691110713) | > loader_time: 0.0243 (0.007405143035085578)  --> TIME: 2023-10-20 04:41:28 -- STEP: 49/50 -- GLOBAL_STEP: 75900 | > loss_disc: 1.7314883470535278 (2.541537185104526) | > loss_disc_real_0: 0.12063853442668915 (0.1770492550365779) | > loss_disc_real_1: 0.2402118742465973 (0.23218461331360193) | > loss_disc_real_2: 0.21130125224590302 (0.23402106343787543) | > loss_disc_real_3: 0.2118874341249466 (0.248875282666817) | > loss_disc_real_4: 0.16585831344127655 (0.23330930555809518) | > loss_disc_real_5: 0.12979747354984283 (0.24366470107010432) | > loss_0: 1.7314883470535278 (2.541537185104526) | > grad_norm_0: tensor(555.7086, device='cuda:0') (tensor(780.9985, device='cuda:0')) | > loss_gen: 3.489485263824463 (2.330595481152437) | > loss_kl: 0.6159718036651611 (0.8135263506247072) | > loss_feat: 8.092528343200684 (5.169660624192686) | > loss_mel: 26.45241928100586 (22.556153951858988) | > loss_duration: 1.673738956451416 (1.510850220310445) | > loss_1: 40.32414627075195 (32.38078670112454) | > grad_norm_1: tensor(55353.1211, device='cuda:0') (tensor(19041.5762, device='cuda:0')) | > current_lr_0: 0.000126632450720056 | > current_lr_1: 0.000126632450720056 | > step_time: 0.3075 (0.43021630754276197) | > loader_time: 0.4071 (0.018905430423970124)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7608702182769775 (2.7608702182769775) | > loss_disc_real_0: 0.10626423358917236 (0.10626423358917236) | > loss_disc_real_1: 0.32302454113960266 (0.32302454113960266) | > loss_disc_real_2: 0.34531089663505554 (0.34531089663505554) | > loss_disc_real_3: 0.26199042797088623 (0.26199042797088623) | > loss_disc_real_4: 0.2786713242530823 (0.2786713242530823) | > loss_disc_real_5: 0.2711942791938782 (0.2711942791938782) | > loss_0: 2.7608702182769775 (2.7608702182769775) | > loss_gen: 1.9993276596069336 (1.9993276596069336) | > loss_kl: 5.619442939758301 (5.619442939758301) | > loss_feat: 4.346548080444336 (4.346548080444336) | > loss_mel: 23.159507751464844 (23.159507751464844) | > loss_duration: 2.6128153800964355 (2.6128153800964355) | > loss_1: 37.73764419555664 (37.73764419555664)  --> STEP: 1 | > loss_disc: 2.949772357940674 (2.949772357940674) | > loss_disc_real_0: 0.13790152966976166 (0.13790152966976166) | > loss_disc_real_1: 0.2875487208366394 (0.2875487208366394) | > loss_disc_real_2: 0.21606691181659698 (0.21606691181659698) | > loss_disc_real_3: 0.23928271234035492 (0.23928271234035492) | > loss_disc_real_4: 0.2782038450241089 (0.2782038450241089) | > loss_disc_real_5: 0.21546749770641327 (0.21546749770641327) | > loss_0: 2.949772357940674 (2.949772357940674) | > loss_gen: 1.5219109058380127 (1.5219109058380127) | > loss_kl: 4.0545783042907715 (4.0545783042907715) | > loss_feat: 1.3435052633285522 (1.3435052633285522) | > loss_mel: 16.833263397216797 (16.833263397216797) | > loss_duration: 2.7749834060668945 (2.7749834060668945) | > loss_1: 26.528240203857422 (26.528240203857422)  --> STEP: 2 | > loss_disc: 1.8230756521224976 (2.3864240050315857) | > loss_disc_real_0: 0.10087919235229492 (0.11939036101102829) | > loss_disc_real_1: 0.1541122943162918 (0.2208305075764656) | > loss_disc_real_2: 0.15994508564472198 (0.18800599873065948) | > loss_disc_real_3: 0.17196118831634521 (0.20562195032835007) | > loss_disc_real_4: 0.041867297142744064 (0.16003557108342648) | > loss_disc_real_5: 0.11423802375793457 (0.16485276073217392) | > loss_0: 1.8230756521224976 (2.3864240050315857) | > loss_gen: 2.4203691482543945 (1.9711400270462036) | > loss_kl: 4.018982410430908 (4.03678035736084) | > loss_feat: 10.377117156982422 (5.860311210155487) | > loss_mel: 27.03986167907715 (21.936562538146973) | > loss_duration: 2.770746946334839 (2.7728651762008667) | > loss_1: 46.6270751953125 (36.57765769958496)  --> STEP: 3 | > loss_disc: 2.830185651779175 (2.5343445539474487) | > loss_disc_real_0: 0.3703707456588745 (0.20305048922697702) | > loss_disc_real_1: 0.21958240866661072 (0.22041447460651398) | > loss_disc_real_2: 0.42601463198661804 (0.267342209815979) | > loss_disc_real_3: 0.24204854667186737 (0.2177641491095225) | > loss_disc_real_4: 0.29065147042274475 (0.20357420419653258) | > loss_disc_real_5: 0.37939688563346863 (0.2363674690326055) | > loss_0: 2.830185651779175 (2.5343445539474487) | > loss_gen: 2.4390170574188232 (2.12709903717041) | > loss_kl: 1.8806118965148926 (3.3180575370788574) | > loss_feat: 3.8210113048553467 (5.18054457505544) | > loss_mel: 24.539752960205078 (22.804292678833008) | > loss_duration: 2.608336925506592 (2.718022425969442) | > loss_1: 35.28873062133789 (36.14801534016927) --> EVAL PERFORMANCE | > avg_loader_time: 0.008376995722452799 (+0.0003503958384195958) | > avg_loss_disc: 2.5343445539474487 (-0.17719050248463963) | > avg_loss_disc_real_0: 0.20305048922697702 (-0.17595240970452627) | > avg_loss_disc_real_1: 0.22041447460651398 (-0.015125428636868804) | > avg_loss_disc_real_2: 0.267342209815979 (+0.006561577320098877) | > avg_loss_disc_real_3: 0.2177641491095225 (-0.059316237767537444) | > avg_loss_disc_real_4: 0.20357420419653258 (-0.029837634414434433) | > avg_loss_disc_real_5: 0.2363674690326055 (+0.02563944086432457) | > avg_loss_0: 2.5343445539474487 (-0.17719050248463963) | > avg_loss_gen: 2.12709903717041 (-0.3172515630722046) | > avg_loss_kl: 3.3180575370788574 (+0.10952329635620117) | > avg_loss_feat: 5.18054457505544 (+0.4790634314219151) | > avg_loss_mel: 22.804292678833008 (+1.0032679239908866) | > avg_loss_duration: 2.718022425969442 (-0.0158229668935137) | > avg_loss_1: 36.14801534016927 (+1.2587788899739607)  > EPOCH: 458/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:41:38)   --> TIME: 2023-10-20 04:41:58 -- STEP: 29/50 -- GLOBAL_STEP: 75930 | > loss_disc: 1.6469271183013916 (2.1318093003897833) | > loss_disc_real_0: 0.10549556463956833 (0.13346963343692236) | > loss_disc_real_1: 0.170255646109581 (0.21940301859687114) | > loss_disc_real_2: 0.18184636533260345 (0.1855236858386418) | > loss_disc_real_3: 0.1390434056520462 (0.20417043515320482) | > loss_disc_real_4: 0.13669955730438232 (0.1953773575610128) | > loss_disc_real_5: 0.24476754665374756 (0.17362909211680808) | > loss_0: 1.6469271183013916 (2.1318093003897833) | > grad_norm_0: tensor(376.7013, device='cuda:0') (tensor(486.4651, device='cuda:0')) | > loss_gen: 3.1043243408203125 (2.58567777584339) | > loss_kl: 0.7195010185241699 (0.8497332940841543) | > loss_feat: 7.340875625610352 (6.924786144289477) | > loss_mel: 22.529050827026367 (25.740931938434468) | > loss_duration: 1.5088950395584106 (1.5287415241372997) | > loss_1: 35.2026481628418 (37.62987077647242) | > grad_norm_1: tensor(33147.1758, device='cuda:0') (tensor(23213.5898, device='cuda:0')) | > current_lr_0: 0.00012650587365718485 | > current_lr_1: 0.00012650587365718485 | > step_time: 0.293 (0.5021157840202595) | > loader_time: 0.0249 (0.020873916560205916)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0310659408569336 (2.0310659408569336) | > loss_disc_real_0: 0.3919372856616974 (0.3919372856616974) | > loss_disc_real_1: 0.10548801720142365 (0.10548801720142365) | > loss_disc_real_2: 0.11833690851926804 (0.11833690851926804) | > loss_disc_real_3: 0.24838493764400482 (0.24838493764400482) | > loss_disc_real_4: 0.21533669531345367 (0.21533669531345367) | > loss_disc_real_5: 0.1328427493572235 (0.1328427493572235) | > loss_0: 2.0310659408569336 (2.0310659408569336) | > loss_gen: 2.829029083251953 (2.829029083251953) | > loss_kl: 3.9894185066223145 (3.9894185066223145) | > loss_feat: 8.7603120803833 (8.7603120803833) | > loss_mel: 24.194725036621094 (24.194725036621094) | > loss_duration: 2.6494603157043457 (2.6494603157043457) | > loss_1: 42.42294692993164 (42.42294692993164)  --> STEP: 1 | > loss_disc: 1.3694404363632202 (1.3694404363632202) | > loss_disc_real_0: 0.07854823023080826 (0.07854823023080826) | > loss_disc_real_1: 0.08769205957651138 (0.08769205957651138) | > loss_disc_real_2: 0.028179803863167763 (0.028179803863167763) | > loss_disc_real_3: 0.17000877857208252 (0.17000877857208252) | > loss_disc_real_4: 0.09757951647043228 (0.09757951647043228) | > loss_disc_real_5: 0.09726551175117493 (0.09726551175117493) | > loss_0: 1.3694404363632202 (1.3694404363632202) | > loss_gen: 2.6564009189605713 (2.6564009189605713) | > loss_kl: 3.6186602115631104 (3.6186602115631104) | > loss_feat: 8.964926719665527 (8.964926719665527) | > loss_mel: 24.62874412536621 (24.62874412536621) | > loss_duration: 2.784306049346924 (2.784306049346924) | > loss_1: 42.653038024902344 (42.653038024902344)  --> STEP: 2 | > loss_disc: 3.024301052093506 (2.196870744228363) | > loss_disc_real_0: 0.370625376701355 (0.22458680346608162) | > loss_disc_real_1: 0.24354206025600433 (0.16561705991625786) | > loss_disc_real_2: 0.2414790242910385 (0.13482941407710314) | > loss_disc_real_3: 0.27468910813331604 (0.22234894335269928) | > loss_disc_real_4: 0.1879304200410843 (0.14275496825575829) | > loss_disc_real_5: 0.3040096163749695 (0.2006375640630722) | > loss_0: 3.024301052093506 (2.196870744228363) | > loss_gen: 1.6427897214889526 (2.149595320224762) | > loss_kl: 3.688790798187256 (3.653725504875183) | > loss_feat: 0.2985859513282776 (4.6317563354969025) | > loss_mel: 2.4881033897399902 (13.5584237575531) | > loss_duration: 2.6990530490875244 (2.741679549217224) | > loss_1: 10.817322731018066 (26.735180377960205)  --> STEP: 3 | > loss_disc: 2.553030490875244 (2.3155906597773233) | > loss_disc_real_0: 0.2561877965927124 (0.2351204678416252) | > loss_disc_real_1: 0.13683976233005524 (0.15602462738752365) | > loss_disc_real_2: 0.19615082442760468 (0.15526988419393697) | > loss_disc_real_3: 0.31062549352645874 (0.25177446007728577) | > loss_disc_real_4: 0.23956136405467987 (0.1750237668553988) | > loss_disc_real_5: 0.21528875827789307 (0.20552129546801248) | > loss_0: 2.553030490875244 (2.3155906597773233) | > loss_gen: 2.1751999855041504 (2.1581302086512246) | > loss_kl: 1.4339473247528076 (2.913799444834391) | > loss_feat: 5.548406600952148 (4.937306423981984) | > loss_mel: 22.974027633666992 (16.696958382924397) | > loss_duration: 2.65878963470459 (2.7140495777130127) | > loss_1: 34.790374755859375 (29.42024517059326) --> EVAL PERFORMANCE | > avg_loader_time: 0.0021505355834960938 (-0.006226460138956705) | > avg_loss_disc: 2.3155906597773233 (-0.21875389417012547) | > avg_loss_disc_real_0: 0.2351204678416252 (+0.03206997861464819) | > avg_loss_disc_real_1: 0.15602462738752365 (-0.06438984721899033) | > avg_loss_disc_real_2: 0.15526988419393697 (-0.11207232562204203) | > avg_loss_disc_real_3: 0.25177446007728577 (+0.034010310967763274) | > avg_loss_disc_real_4: 0.1750237668553988 (-0.028550437341133772) | > avg_loss_disc_real_5: 0.20552129546801248 (-0.030846173564593016) | > avg_loss_0: 2.3155906597773233 (-0.21875389417012547) | > avg_loss_gen: 2.1581302086512246 (+0.031031171480814468) | > avg_loss_kl: 2.913799444834391 (-0.4042580922444663) | > avg_loss_feat: 4.937306423981984 (-0.2432381510734558) | > avg_loss_mel: 16.696958382924397 (-6.107334295908611) | > avg_loss_duration: 2.7140495777130127 (-0.0039728482564291845) | > avg_loss_1: 29.42024517059326 (-6.7277701695760115)  > EPOCH: 459/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:42:18)   --> TIME: 2023-10-20 04:42:29 -- STEP: 9/50 -- GLOBAL_STEP: 75960 | > loss_disc: 1.1871122121810913 (2.0200492673450046) | > loss_disc_real_0: 0.060137707740068436 (0.12592727856503594) | > loss_disc_real_1: 0.222429096698761 (0.17054826145370802) | > loss_disc_real_2: 0.14382387697696686 (0.17673677288823658) | > loss_disc_real_3: 0.17351645231246948 (0.21344387655456862) | > loss_disc_real_4: 0.046748653054237366 (0.18626698479056358) | > loss_disc_real_5: 0.05965070426464081 (0.15095822740760115) | > loss_0: 1.1871122121810913 (2.0200492673450046) | > grad_norm_0: tensor(222.7038, device='cuda:0') (tensor(481.7491, device='cuda:0')) | > loss_gen: 3.680873155593872 (2.70038804743025) | > loss_kl: 0.4911171495914459 (0.8591467241446177) | > loss_feat: 10.110273361206055 (8.487709058655632) | > loss_mel: 21.910459518432617 (24.02217674255371) | > loss_duration: 1.457168459892273 (1.503972782029046) | > loss_1: 37.6498908996582 (37.57339307996962) | > grad_norm_1: tensor(16664.6309, device='cuda:0') (tensor(34859.5078, device='cuda:0')) | > current_lr_0: 0.00012637942311601296 | > current_lr_1: 0.00012637942311601296 | > step_time: 0.3679 (0.520429770151774) | > loader_time: 0.0021 (0.017158322864108615)  --> TIME: 2023-10-20 04:42:45 -- STEP: 39/50 -- GLOBAL_STEP: 75990 | > loss_disc: 2.325134038925171 (2.1952395867078733) | > loss_disc_real_0: 0.062304262071847916 (0.13816748745739463) | > loss_disc_real_1: 0.19685395061969757 (0.21104651531920984) | > loss_disc_real_2: 0.195765882730484 (0.19979575080558276) | > loss_disc_real_3: 0.27215683460235596 (0.234237787194359) | > loss_disc_real_4: 0.21458636224269867 (0.19875084040447688) | > loss_disc_real_5: 0.35639557242393494 (0.19017590921467695) | > loss_0: 2.325134038925171 (2.1952395867078733) | > grad_norm_0: tensor(1595.5914, device='cuda:0') (tensor(600.4502, device='cuda:0')) | > loss_gen: 2.281318426132202 (2.727775928301689) | > loss_kl: 0.6896433234214783 (0.8705267822131132) | > loss_feat: 3.3336753845214844 (6.902367972792724) | > loss_mel: 22.437461853027344 (22.55793278033917) | > loss_duration: 1.6220210790634155 (1.5023732796693459) | > loss_1: 30.364120483398438 (34.56097655418593) | > grad_norm_1: tensor(13323.0420, device='cuda:0') (tensor(31348.6641, device='cuda:0')) | > current_lr_0: 0.00012637942311601296 | > current_lr_1: 0.00012637942311601296 | > step_time: 0.5582 (0.5092840561499961) | > loader_time: 0.0112 (0.018142217244857393)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0784502029418945 (3.0784502029418945) | > loss_disc_real_0: 0.31190401315689087 (0.31190401315689087) | > loss_disc_real_1: 0.22836831212043762 (0.22836831212043762) | > loss_disc_real_2: 0.2805958390235901 (0.2805958390235901) | > loss_disc_real_3: 0.2934843897819519 (0.2934843897819519) | > loss_disc_real_4: 0.2271399050951004 (0.2271399050951004) | > loss_disc_real_5: 0.18319985270500183 (0.18319985270500183) | > loss_0: 3.0784502029418945 (3.0784502029418945) | > loss_gen: 1.6628705263137817 (1.6628705263137817) | > loss_kl: 3.2906506061553955 (3.2906506061553955) | > loss_feat: 1.4430047273635864 (1.4430047273635864) | > loss_mel: 15.558690071105957 (15.558690071105957) | > loss_duration: 2.5149736404418945 (2.5149736404418945) | > loss_1: 24.47018814086914 (24.47018814086914)  --> STEP: 1 | > loss_disc: 2.7262678146362305 (2.7262678146362305) | > loss_disc_real_0: 0.3388172388076782 (0.3388172388076782) | > loss_disc_real_1: 0.09724988788366318 (0.09724988788366318) | > loss_disc_real_2: 0.3639673888683319 (0.3639673888683319) | > loss_disc_real_3: 0.3219188153743744 (0.3219188153743744) | > loss_disc_real_4: 0.18818871676921844 (0.18818871676921844) | > loss_disc_real_5: 0.19309638440608978 (0.19309638440608978) | > loss_0: 2.7262678146362305 (2.7262678146362305) | > loss_gen: 2.179832696914673 (2.179832696914673) | > loss_kl: 4.115237712860107 (4.115237712860107) | > loss_feat: 5.271083354949951 (5.271083354949951) | > loss_mel: 29.26013946533203 (29.26013946533203) | > loss_duration: 2.8252487182617188 (2.8252487182617188) | > loss_1: 43.65154266357422 (43.65154266357422)  --> STEP: 2 | > loss_disc: 2.728800058364868 (2.7275339365005493) | > loss_disc_real_0: 0.2996145486831665 (0.31921589374542236) | > loss_disc_real_1: 0.24729390442371368 (0.17227189615368843) | > loss_disc_real_2: 0.5416750311851501 (0.45282121002674103) | > loss_disc_real_3: 0.2773004472255707 (0.29960963129997253) | > loss_disc_real_4: 0.30697813630104065 (0.24758342653512955) | > loss_disc_real_5: 0.1543739289045334 (0.17373515665531158) | > loss_0: 2.728800058364868 (2.7275339365005493) | > loss_gen: 2.8626294136047363 (2.5212310552597046) | > loss_kl: 4.426878452301025 (4.271058082580566) | > loss_feat: 7.306793689727783 (6.288938522338867) | > loss_mel: 31.030315399169922 (30.145227432250977) | > loss_duration: 2.664077043533325 (2.744662880897522) | > loss_1: 48.29069519042969 (45.97111892700195)  --> STEP: 3 | > loss_disc: 2.666914701461792 (2.7073275248209634) | > loss_disc_real_0: 0.36693716049194336 (0.3351229826609294) | > loss_disc_real_1: 0.30468273162841797 (0.2164088413119316) | > loss_disc_real_2: 0.34009552001953125 (0.41524598002433777) | > loss_disc_real_3: 0.23453201353549957 (0.2779170920451482) | > loss_disc_real_4: 0.3566158711910248 (0.2839275747537613) | > loss_disc_real_5: 0.3132551610469818 (0.22024182478586832) | > loss_0: 2.666914701461792 (2.7073275248209634) | > loss_gen: 2.910888433456421 (2.6511168479919434) | > loss_kl: 1.7808077335357666 (3.4409746328989663) | > loss_feat: 3.8121323585510254 (5.46333646774292) | > loss_mel: 27.056684494018555 (29.115713119506836) | > loss_duration: 2.6562063694000244 (2.715177377065023) | > loss_1: 38.21672058105469 (43.38631947835287) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_76000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0520122051239014 (2.543498694896698) | > loss_disc_real_0: 0.2884213924407959 (0.323447585105896) | > loss_disc_real_1: 0.1378801167011261 (0.19677666015923023) | > loss_disc_real_2: 0.19646327197551727 (0.36055030301213264) | > loss_disc_real_3: 0.2700091004371643 (0.27594009414315224) | > loss_disc_real_4: 0.16885314881801605 (0.255158968269825) | > loss_disc_real_5: 0.10153968632221222 (0.1905662901699543) | > loss_0: 2.0520122051239014 (2.543498694896698) | > loss_gen: 2.5616726875305176 (2.628755807876587) | > loss_kl: 3.0205740928649902 (3.3358744978904724) | > loss_feat: 7.636016845703125 (6.006506562232971) | > loss_mel: 23.031095504760742 (27.594558715820312) | > loss_duration: 2.4537601470947266 (2.6498230695724487) | > loss_1: 38.70311737060547 (42.215518951416016)  --> STEP: 1 | > loss_disc: 2.298999071121216 (2.4945987701416015) | > loss_disc_real_0: 0.26970231533050537 (0.31269853115081786) | > loss_disc_real_1: 0.11085768789052963 (0.1795928657054901) | > loss_disc_real_2: 0.2837517261505127 (0.34519058763980864) | > loss_disc_real_3: 0.024798771366477013 (0.2257118295878172) | > loss_disc_real_4: 0.2961866855621338 (0.26336451172828673) | > loss_disc_real_5: 0.03994658216834068 (0.16044234856963158) | > loss_0: 2.298999071121216 (2.4945987701416015) | > loss_gen: 2.1942801475524902 (2.5418606758117677) | > loss_kl: 4.154515743255615 (3.499602746963501) | > loss_feat: 12.066679000854492 (7.218541049957276) | > loss_mel: 29.125263214111328 (27.900699615478516) | > loss_duration: 2.865384101867676 (2.692935276031494) | > loss_1: 50.40612030029297 (43.85363922119141)  --> STEP: 2 | > loss_disc: 2.6557421684265137 (2.521456003189087) | > loss_disc_real_0: 0.5711193084716797 (0.35576866070429486) | > loss_disc_real_1: 0.26006919145584106 (0.19300558666388193) | > loss_disc_real_2: 0.4322059750556946 (0.35969315220912296) | > loss_disc_real_3: 0.31889423727989197 (0.24124223086982965) | > loss_disc_real_4: 0.29343703389167786 (0.2683765987555186) | > loss_disc_real_5: 0.10517873615026474 (0.1512317464997371) | > loss_0: 2.6557421684265137 (2.521456003189087) | > loss_gen: 3.4861748218536377 (2.699246366818746) | > loss_kl: 4.5218706130981445 (3.6699807246526084) | > loss_feat: 10.59540843963623 (7.781352281570435) | > loss_mel: 22.858747482299805 (27.06037425994873) | > loss_duration: 2.634028434753418 (2.683117469151815) | > loss_1: 44.09623336791992 (43.89407157897949)  --> STEP: 3 | > loss_disc: 3.0508365631103516 (2.597081797463553) | > loss_disc_real_0: 0.270569771528244 (0.34359739082200186) | > loss_disc_real_1: 0.26211827993392944 (0.202878828559603) | > loss_disc_real_2: 0.302364706993103 (0.3515033743211201) | > loss_disc_real_3: 0.32959556579589844 (0.25386413585926804) | > loss_disc_real_4: 0.29310205578804016 (0.27190880690302166) | > loss_disc_real_5: 0.29095950722694397 (0.17119285517505237) | > loss_0: 3.0508365631103516 (2.597081797463553) | > loss_gen: 1.734885811805725 (2.5614805732454573) | > loss_kl: 2.153933525085449 (3.4534025532858714) | > loss_feat: 0.5190541744232178 (6.743881123406546) | > loss_mel: 6.558436393737793 (24.131525993347168) | > loss_duration: 2.5385513305664062 (2.6624651636396135) | > loss_1: 13.504861831665039 (39.552755900791716) --> EVAL PERFORMANCE | > avg_loader_time: 0.359060423714774 (+0.3569098881312779) | > avg_loss_disc: 2.597081797463553 (+0.2814911376862299) | > avg_loss_disc_real_0: 0.34359739082200186 (+0.10847692298037664) | > avg_loss_disc_real_1: 0.202878828559603 (+0.04685420117207936) | > avg_loss_disc_real_2: 0.3515033743211201 (+0.19623349012718314) | > avg_loss_disc_real_3: 0.25386413585926804 (+0.0020896757819822698) | > avg_loss_disc_real_4: 0.27190880690302166 (+0.09688504004762286) | > avg_loss_disc_real_5: 0.17119285517505237 (-0.034328440292960116) | > avg_loss_0: 2.597081797463553 (+0.2814911376862299) | > avg_loss_gen: 2.5614805732454573 (+0.4033503645942327) | > avg_loss_kl: 3.4534025532858714 (+0.5396031084514803) | > avg_loss_feat: 6.743881123406546 (+1.8065746994245622) | > avg_loss_mel: 24.131525993347168 (+7.434567610422771) | > avg_loss_duration: 2.6624651636396135 (-0.0515844140733992) | > avg_loss_1: 39.552755900791716 (+10.132510730198454)  > EPOCH: 460/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:43:09)   --> TIME: 2023-10-20 04:43:21 -- STEP: 19/50 -- GLOBAL_STEP: 76020 | > loss_disc: 2.964376211166382 (2.3515663962615165) | > loss_disc_real_0: 0.5564643740653992 (0.17534162653119942) | > loss_disc_real_1: 0.24676649272441864 (0.2289842553436756) | > loss_disc_real_2: 0.34891098737716675 (0.2629065132258754) | > loss_disc_real_3: 0.36504533886909485 (0.21641175409680918) | > loss_disc_real_4: 0.2476380616426468 (0.25571607072886665) | > loss_disc_real_5: 0.2230503112077713 (0.22765299682750514) | > loss_0: 2.964376211166382 (2.3515663962615165) | > grad_norm_0: tensor(1461.5182, device='cuda:0') (tensor(672.1529, device='cuda:0')) | > loss_gen: 2.296441078186035 (2.697077744885495) | > loss_kl: 0.8548672795295715 (0.8687031284758919) | > loss_feat: 2.509923219680786 (6.322034688372361) | > loss_mel: 24.16495132446289 (23.34385068793046) | > loss_duration: 1.6796997785568237 (1.5546843503650867) | > loss_1: 31.505882263183594 (34.78635095295153) | > grad_norm_1: tensor(10422.2207, device='cuda:0') (tensor(24949.4297, device='cuda:0')) | > current_lr_0: 0.00012625309897007394 | > current_lr_1: 0.00012625309897007394 | > step_time: 0.5167 (0.39786186971162496) | > loader_time: 0.0247 (0.00994529222187243)  --> TIME: 2023-10-20 04:43:37 -- STEP: 49/50 -- GLOBAL_STEP: 76050 | > loss_disc: 2.3805878162384033 (2.3660314788623737) | > loss_disc_real_0: 0.021370775997638702 (0.15497912371493122) | > loss_disc_real_1: 0.12146565318107605 (0.21449418803106765) | > loss_disc_real_2: 0.11369780451059341 (0.22966120578348637) | > loss_disc_real_3: 0.2987879514694214 (0.22472847484964498) | > loss_disc_real_4: 0.28374171257019043 (0.22327342522995813) | > loss_disc_real_5: 0.22700956463813782 (0.21874981620634087) | > loss_0: 2.3805878162384033 (2.3660314788623737) | > grad_norm_0: tensor(916.9164, device='cuda:0') (tensor(580.6509, device='cuda:0')) | > loss_gen: 1.9944157600402832 (2.4355242349663553) | > loss_kl: 0.6688603162765503 (0.823071115175072) | > loss_feat: 2.4184184074401855 (5.578594636628213) | > loss_mel: 25.123973846435547 (21.187638426313594) | > loss_duration: 1.6232874393463135 (1.5232641404988814) | > loss_1: 31.828954696655273 (31.54809277398246) | > grad_norm_1: tensor(8304.8418, device='cuda:0') (tensor(22594.9453, device='cuda:0')) | > current_lr_0: 0.00012625309897007394 | > current_lr_1: 0.00012625309897007394 | > step_time: 0.3166 (0.4529504240775595) | > loader_time: 0.4054 (0.023345543413746114)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7980120182037354 (2.7980120182037354) | > loss_disc_real_0: 0.25499868392944336 (0.25499868392944336) | > loss_disc_real_1: 0.24749043583869934 (0.24749043583869934) | > loss_disc_real_2: 0.2872406840324402 (0.2872406840324402) | > loss_disc_real_3: 0.24024753272533417 (0.24024753272533417) | > loss_disc_real_4: 0.21560001373291016 (0.21560001373291016) | > loss_disc_real_5: 0.23673288524150848 (0.23673288524150848) | > loss_0: 2.7980120182037354 (2.7980120182037354) | > loss_gen: 1.9347046613693237 (1.9347046613693237) | > loss_kl: 3.61751127243042 (3.61751127243042) | > loss_feat: 2.736248016357422 (2.736248016357422) | > loss_mel: 11.708894729614258 (11.708894729614258) | > loss_duration: 2.5451972484588623 (2.5451972484588623) | > loss_1: 22.54255485534668 (22.54255485534668)  --> STEP: 1 | > loss_disc: 2.812849998474121 (2.812849998474121) | > loss_disc_real_0: 0.31552600860595703 (0.31552600860595703) | > loss_disc_real_1: 0.2858811914920807 (0.2858811914920807) | > loss_disc_real_2: 0.28780800104141235 (0.28780800104141235) | > loss_disc_real_3: 0.2603433132171631 (0.2603433132171631) | > loss_disc_real_4: 0.29405921697616577 (0.29405921697616577) | > loss_disc_real_5: 0.2285582423210144 (0.2285582423210144) | > loss_0: 2.812849998474121 (2.812849998474121) | > loss_gen: 2.054767608642578 (2.054767608642578) | > loss_kl: 4.051991939544678 (4.051991939544678) | > loss_feat: 0.8993104100227356 (0.8993104100227356) | > loss_mel: 21.22393798828125 (21.22393798828125) | > loss_duration: 2.812854290008545 (2.812854290008545) | > loss_1: 31.042861938476562 (31.042861938476562)  --> STEP: 2 | > loss_disc: 2.235217332839966 (2.5240336656570435) | > loss_disc_real_0: 0.2267359495162964 (0.2711309790611267) | > loss_disc_real_1: 0.34654974937438965 (0.31621547043323517) | > loss_disc_real_2: 0.21560125052928925 (0.2517046257853508) | > loss_disc_real_3: 0.3958228528499603 (0.3280830830335617) | > loss_disc_real_4: 0.17241506278514862 (0.2332371398806572) | > loss_disc_real_5: 0.15152296423912048 (0.19004060328006744) | > loss_0: 2.235217332839966 (2.5240336656570435) | > loss_gen: 3.021179437637329 (2.5379735231399536) | > loss_kl: 3.7283520698547363 (3.890172004699707) | > loss_feat: 4.581090927124023 (2.7402006685733795) | > loss_mel: 25.173686981201172 (23.19881248474121) | > loss_duration: 2.5459773540496826 (2.6794158220291138) | > loss_1: 39.050289154052734 (35.04657554626465)  --> STEP: 3 | > loss_disc: 2.3063278198242188 (2.451465050379435) | > loss_disc_real_0: 0.21164532005786896 (0.2513024260600408) | > loss_disc_real_1: 0.27904579043388367 (0.303825577100118) | > loss_disc_real_2: 0.20960231125354767 (0.2376705209414164) | > loss_disc_real_3: 0.17043593525886536 (0.2755340337753296) | > loss_disc_real_4: 0.2355778068304062 (0.2340173621972402) | > loss_disc_real_5: 0.11392298340797424 (0.16466806332270303) | > loss_0: 2.3063278198242188 (2.451465050379435) | > loss_gen: 2.1540799140930176 (2.410008986790975) | > loss_kl: 1.861897349357605 (3.2140804529190063) | > loss_feat: 3.264953136444092 (2.915118157863617) | > loss_mel: 20.355056762695312 (22.25089391072591) | > loss_duration: 2.5494539737701416 (2.6360952059427896) | > loss_1: 30.185440063476562 (33.42619705200195) --> EVAL PERFORMANCE | > avg_loader_time: 0.010755300521850586 (-0.3483051231929234) | > avg_loss_disc: 2.451465050379435 (-0.1456167470841181) | > avg_loss_disc_real_0: 0.2513024260600408 (-0.09229496476196108) | > avg_loss_disc_real_1: 0.303825577100118 (+0.10094674854051497) | > avg_loss_disc_real_2: 0.2376705209414164 (-0.1138328533797037) | > avg_loss_disc_real_3: 0.2755340337753296 (+0.021669897916061553) | > avg_loss_disc_real_4: 0.2340173621972402 (-0.03789144470578146) | > avg_loss_disc_real_5: 0.16466806332270303 (-0.006524791852349332) | > avg_loss_0: 2.451465050379435 (-0.1456167470841181) | > avg_loss_gen: 2.410008986790975 (-0.15147158645448222) | > avg_loss_kl: 3.2140804529190063 (-0.23932210036686508) | > avg_loss_feat: 2.915118157863617 (-3.8287629655429294) | > avg_loss_mel: 22.25089391072591 (-1.8806320826212577) | > avg_loss_duration: 2.6360952059427896 (-0.02636995769682393) | > avg_loss_1: 33.42619705200195 (-6.126558848789763)  > EPOCH: 461/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:43:50)   --> TIME: 2023-10-20 04:44:07 -- STEP: 29/50 -- GLOBAL_STEP: 76080 | > loss_disc: 2.4850895404815674 (2.5225610609712272) | > loss_disc_real_0: 0.13570740818977356 (0.1731287569192977) | > loss_disc_real_1: 0.2613372802734375 (0.2314676153634129) | > loss_disc_real_2: 0.27253034710884094 (0.2654835198973787) | > loss_disc_real_3: 0.2750483751296997 (0.22701895108510708) | > loss_disc_real_4: 0.3344280421733856 (0.2554449813504671) | > loss_disc_real_5: 0.30802103877067566 (0.22740534294782014) | > loss_0: 2.4850895404815674 (2.5225610609712272) | > grad_norm_0: tensor(574.7542, device='cuda:0') (tensor(499.4359, device='cuda:0')) | > loss_gen: 2.6594491004943848 (2.34935333399937) | > loss_kl: 1.005429744720459 (0.8779528711376519) | > loss_feat: 4.274845123291016 (5.447025833458736) | > loss_mel: 20.275535583496094 (21.039837578247333) | > loss_duration: 1.4913004636764526 (1.5191532167895088) | > loss_1: 29.706560134887695 (31.233322439522578) | > grad_norm_1: tensor(19039.9883, device='cuda:0') (tensor(26810.5645, device='cuda:0')) | > current_lr_0: 0.00012612690109302786 | > current_lr_1: 0.00012612690109302786 | > step_time: 0.3899 (0.4566681878320102) | > loader_time: 0.0039 (0.013872442574336612)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9966847896575928 (2.9966847896575928) | > loss_disc_real_0: 0.18510480225086212 (0.18510480225086212) | > loss_disc_real_1: 0.2788175940513611 (0.2788175940513611) | > loss_disc_real_2: 0.41099438071250916 (0.41099438071250916) | > loss_disc_real_3: 0.3983035981655121 (0.3983035981655121) | > loss_disc_real_4: 0.33818134665489197 (0.33818134665489197) | > loss_disc_real_5: 0.2369135022163391 (0.2369135022163391) | > loss_0: 2.9966847896575928 (2.9966847896575928) | > loss_gen: 2.13779354095459 (2.13779354095459) | > loss_kl: 3.350951910018921 (3.350951910018921) | > loss_feat: 4.929357528686523 (4.929357528686523) | > loss_mel: 24.67336654663086 (24.67336654663086) | > loss_duration: 2.580244302749634 (2.580244302749634) | > loss_1: 37.671714782714844 (37.671714782714844)  --> STEP: 1 | > loss_disc: 1.9807684421539307 (1.9807684421539307) | > loss_disc_real_0: 0.04378920793533325 (0.04378920793533325) | > loss_disc_real_1: 0.13966549932956696 (0.13966549932956696) | > loss_disc_real_2: 0.06917928159236908 (0.06917928159236908) | > loss_disc_real_3: 0.18015925586223602 (0.18015925586223602) | > loss_disc_real_4: 0.1370944082736969 (0.1370944082736969) | > loss_disc_real_5: 0.07225579768419266 (0.07225579768419266) | > loss_0: 1.9807684421539307 (1.9807684421539307) | > loss_gen: 2.047964334487915 (2.047964334487915) | > loss_kl: 3.2100534439086914 (3.2100534439086914) | > loss_feat: 9.03625202178955 (9.03625202178955) | > loss_mel: 26.00716781616211 (26.00716781616211) | > loss_duration: 2.8348851203918457 (2.8348851203918457) | > loss_1: 43.136322021484375 (43.136322021484375)  --> STEP: 2 | > loss_disc: 2.4055659770965576 (2.193167209625244) | > loss_disc_real_0: 0.13628162443637848 (0.09003541618585587) | > loss_disc_real_1: 0.1038472056388855 (0.12175635248422623) | > loss_disc_real_2: 0.11604780703783035 (0.09261354431509972) | > loss_disc_real_3: 0.18808814883232117 (0.1841237023472786) | > loss_disc_real_4: 0.2646963596343994 (0.20089538395404816) | > loss_disc_real_5: 0.08410406857728958 (0.07817993313074112) | > loss_0: 2.4055659770965576 (2.193167209625244) | > loss_gen: 1.8327903747558594 (1.9403773546218872) | > loss_kl: 3.964761972427368 (3.58740770816803) | > loss_feat: 10.668842315673828 (9.85254716873169) | > loss_mel: 24.02079963684082 (25.013983726501465) | > loss_duration: 2.7641525268554688 (2.7995188236236572) | > loss_1: 43.251346588134766 (43.19383430480957)  --> STEP: 3 | > loss_disc: 2.2266035079956055 (2.2043126424153647) | > loss_disc_real_0: 0.2221446931362152 (0.13407184183597565) | > loss_disc_real_1: 0.24307051301002502 (0.16219440599282584) | > loss_disc_real_2: 0.27607491612434387 (0.1537673349181811) | > loss_disc_real_3: 0.19012166559696198 (0.18612302343050638) | > loss_disc_real_4: 0.25230780243873596 (0.21803285678227743) | > loss_disc_real_5: 0.06683503836393356 (0.07439830154180527) | > loss_0: 2.2266035079956055 (2.2043126424153647) | > loss_gen: 2.872288227081299 (2.251014312108358) | > loss_kl: 1.758300542831421 (2.9777053197224936) | > loss_feat: 7.636167526245117 (9.113753954569498) | > loss_mel: 25.65386199951172 (25.22727648417155) | > loss_duration: 2.5614168643951416 (2.720151503880819) | > loss_1: 40.48203659057617 (42.28990173339844) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025978883107503257 (-0.00815741221110026) | > avg_loss_disc: 2.2043126424153647 (-0.24715240796407034) | > avg_loss_disc_real_0: 0.13407184183597565 (-0.11723058422406513) | > avg_loss_disc_real_1: 0.16219440599282584 (-0.14163117110729215) | > avg_loss_disc_real_2: 0.1537673349181811 (-0.08390318602323532) | > avg_loss_disc_real_3: 0.18612302343050638 (-0.08941101034482321) | > avg_loss_disc_real_4: 0.21803285678227743 (-0.01598450541496277) | > avg_loss_disc_real_5: 0.07439830154180527 (-0.09026976178089777) | > avg_loss_0: 2.2043126424153647 (-0.24715240796407034) | > avg_loss_gen: 2.251014312108358 (-0.1589946746826172) | > avg_loss_kl: 2.9777053197224936 (-0.2363751331965127) | > avg_loss_feat: 9.113753954569498 (+6.198635796705881) | > avg_loss_mel: 25.22727648417155 (+2.9763825734456404) | > avg_loss_duration: 2.720151503880819 (+0.08405629793802927) | > avg_loss_1: 42.28990173339844 (+8.863704681396484)  > EPOCH: 462/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:44:28)   --> TIME: 2023-10-20 04:44:37 -- STEP: 9/50 -- GLOBAL_STEP: 76110 | > loss_disc: 2.7897613048553467 (2.280226661099328) | > loss_disc_real_0: 0.36065638065338135 (0.12080228349400891) | > loss_disc_real_1: 0.27774038910865784 (0.19730757052699724) | > loss_disc_real_2: 0.4202715754508972 (0.22458956680364078) | > loss_disc_real_3: 0.41734543442726135 (0.20640132607271275) | > loss_disc_real_4: 0.2713168263435364 (0.19993624918990666) | > loss_disc_real_5: 0.3818140923976898 (0.32417919155624175) | > loss_0: 2.7897613048553467 (2.280226661099328) | > grad_norm_0: tensor(514.9913, device='cuda:0') (tensor(467.1100, device='cuda:0')) | > loss_gen: 2.8823320865631104 (2.6407594945695667) | > loss_kl: 0.7855159640312195 (0.7947900825076633) | > loss_feat: 3.5661003589630127 (7.289026631249322) | > loss_mel: 22.035541534423828 (21.850097311867607) | > loss_duration: 1.4168317317962646 (1.4790565967559814) | > loss_1: 30.686321258544922 (34.053729905022514) | > grad_norm_1: tensor(8461.9609, device='cuda:0') (tensor(41631.6406, device='cuda:0')) | > current_lr_0: 0.00012600082935866107 | > current_lr_1: 0.00012600082935866107 | > step_time: 0.6876 (0.5390984747144911) | > loader_time: 0.0247 (0.020085970560709637)  --> TIME: 2023-10-20 04:44:52 -- STEP: 39/50 -- GLOBAL_STEP: 76140 | > loss_disc: 1.189797282218933 (2.4653075490242395) | > loss_disc_real_0: 0.062080979347229004 (0.14249001123393196) | > loss_disc_real_1: 0.1173059493303299 (0.23556287481616706) | > loss_disc_real_2: 0.21130821108818054 (0.22756474321851364) | > loss_disc_real_3: 0.08810730278491974 (0.24069135299382302) | > loss_disc_real_4: 0.1075633317232132 (0.21706490046702898) | > loss_disc_real_5: 0.05905423313379288 (0.27746509770170247) | > loss_0: 1.189797282218933 (2.4653075490242395) | > grad_norm_0: tensor(662.7723, device='cuda:0') (tensor(665.5640, device='cuda:0')) | > loss_gen: 4.023588180541992 (2.4163035215475626) | > loss_kl: 0.4156418442726135 (0.8322569384024694) | > loss_feat: 13.680577278137207 (5.415291314801345) | > loss_mel: 31.380048751831055 (21.261428881914192) | > loss_duration: 1.539060354232788 (1.4994549048252594) | > loss_1: 51.03891372680664 (31.424735570565247) | > grad_norm_1: tensor(97722.6172, device='cuda:0') (tensor(26613.5684, device='cuda:0')) | > current_lr_0: 0.00012600082935866107 | > current_lr_1: 0.00012600082935866107 | > step_time: 0.5521 (0.4998120711399959) | > loader_time: 0.023 (0.021124937595465246)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.805711030960083 (2.805711030960083) | > loss_disc_real_0: 0.357687771320343 (0.357687771320343) | > loss_disc_real_1: 0.27500179409980774 (0.27500179409980774) | > loss_disc_real_2: 0.23980699479579926 (0.23980699479579926) | > loss_disc_real_3: 0.37863337993621826 (0.37863337993621826) | > loss_disc_real_4: 0.3582649827003479 (0.3582649827003479) | > loss_disc_real_5: 0.3827884793281555 (0.3827884793281555) | > loss_0: 2.805711030960083 (2.805711030960083) | > loss_gen: 3.211841583251953 (3.211841583251953) | > loss_kl: 3.4378304481506348 (3.4378304481506348) | > loss_feat: 5.756862640380859 (5.756862640380859) | > loss_mel: 24.110370635986328 (24.110370635986328) | > loss_duration: 2.602039098739624 (2.602039098739624) | > loss_1: 39.11894226074219 (39.11894226074219)  --> STEP: 1 | > loss_disc: 2.6361565589904785 (2.6361565589904785) | > loss_disc_real_0: 0.5418438911437988 (0.5418438911437988) | > loss_disc_real_1: 0.2630973160266876 (0.2630973160266876) | > loss_disc_real_2: 0.3022290766239166 (0.3022290766239166) | > loss_disc_real_3: 0.29008805751800537 (0.29008805751800537) | > loss_disc_real_4: 0.2868592143058777 (0.2868592143058777) | > loss_disc_real_5: 0.17887333035469055 (0.17887333035469055) | > loss_0: 2.6361565589904785 (2.6361565589904785) | > loss_gen: 3.0826683044433594 (3.0826683044433594) | > loss_kl: 3.8775885105133057 (3.8775885105133057) | > loss_feat: 6.685314655303955 (6.685314655303955) | > loss_mel: 23.42491912841797 (23.42491912841797) | > loss_duration: 2.933804988861084 (2.933804988861084) | > loss_1: 40.004295349121094 (40.004295349121094)  --> STEP: 2 | > loss_disc: 2.9193115234375 (2.7777340412139893) | > loss_disc_real_0: 0.29436159133911133 (0.4181027412414551) | > loss_disc_real_1: 0.22983253002166748 (0.24646492302417755) | > loss_disc_real_2: 0.1997392773628235 (0.25098417699337006) | > loss_disc_real_3: 0.255433052778244 (0.2727605551481247) | > loss_disc_real_4: 0.3645743429660797 (0.3257167786359787) | > loss_disc_real_5: 0.32172074913978577 (0.25029703974723816) | > loss_0: 2.9193115234375 (2.7777340412139893) | > loss_gen: 2.3129193782806396 (2.6977938413619995) | > loss_kl: 4.172389030456543 (4.024988770484924) | > loss_feat: 5.909000396728516 (6.297157526016235) | > loss_mel: 23.760787963867188 (23.592853546142578) | > loss_duration: 2.68673038482666 (2.810267686843872) | > loss_1: 38.841827392578125 (39.42306137084961)  --> STEP: 3 | > loss_disc: 3.0591917037963867 (2.8715532620747886) | > loss_disc_real_0: 0.4993225932121277 (0.44517602523167926) | > loss_disc_real_1: 0.23556208610534668 (0.24283064405123392) | > loss_disc_real_2: 0.2406962662935257 (0.24755487342675528) | > loss_disc_real_3: 0.257526159286499 (0.26768242319424945) | > loss_disc_real_4: 0.27247411012649536 (0.30796922246615094) | > loss_disc_real_5: 0.19910570979118347 (0.23323326309521994) | > loss_0: 3.0591917037963867 (2.8715532620747886) | > loss_gen: 1.8193089962005615 (2.40496555964152) | > loss_kl: 1.8417942523956299 (3.2972572644551597) | > loss_feat: 0.34077391028404236 (4.311696320772171) | > loss_mel: 16.284971237182617 (21.156892776489258) | > loss_duration: 2.608773946762085 (2.74310310681661) | > loss_1: 22.89562225341797 (33.9139149983724) --> EVAL PERFORMANCE | > avg_loader_time: 0.015423059463500977 (+0.01282517115275065) | > avg_loss_disc: 2.8715532620747886 (+0.6672406196594238) | > avg_loss_disc_real_0: 0.44517602523167926 (+0.3111041833957036) | > avg_loss_disc_real_1: 0.24283064405123392 (+0.08063623805840808) | > avg_loss_disc_real_2: 0.24755487342675528 (+0.09378753850857419) | > avg_loss_disc_real_3: 0.26768242319424945 (+0.08155939976374307) | > avg_loss_disc_real_4: 0.30796922246615094 (+0.0899363656838735) | > avg_loss_disc_real_5: 0.23323326309521994 (+0.15883496155341467) | > avg_loss_0: 2.8715532620747886 (+0.6672406196594238) | > avg_loss_gen: 2.40496555964152 (+0.15395124753316214) | > avg_loss_kl: 3.2972572644551597 (+0.319551944732666) | > avg_loss_feat: 4.311696320772171 (-4.802057633797327) | > avg_loss_mel: 21.156892776489258 (-4.070383707682293) | > avg_loss_duration: 2.74310310681661 (+0.022951602935791016) | > avg_loss_1: 33.9139149983724 (-8.37598673502604)  > EPOCH: 463/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:45:09)   --> TIME: 2023-10-20 04:45:22 -- STEP: 19/50 -- GLOBAL_STEP: 76170 | > loss_disc: 1.6962958574295044 (2.390394869603609) | > loss_disc_real_0: 0.027872875332832336 (0.1601114061317946) | > loss_disc_real_1: 0.1442682445049286 (0.2178721922008615) | > loss_disc_real_2: 0.13168272376060486 (0.20995680321204035) | > loss_disc_real_3: 0.11677835881710052 (0.2471005900910026) | > loss_disc_real_4: 0.07646241039037704 (0.2215771145726505) | > loss_disc_real_5: 0.0778014063835144 (0.2072406683705355) | > loss_0: 1.6962958574295044 (2.390394869603609) | > grad_norm_0: tensor(387.6552, device='cuda:0') (tensor(589.3413, device='cuda:0')) | > loss_gen: 2.399524211883545 (2.4091955925288944) | > loss_kl: 0.9593197703361511 (0.8871509056342276) | > loss_feat: 9.395143508911133 (5.298734615311811) | > loss_mel: 24.927278518676758 (19.83935072547511) | > loss_duration: 1.6303842067718506 (1.5786450850336176) | > loss_1: 39.311649322509766 (30.013076706936484) | > grad_norm_1: tensor(5620.5059, device='cuda:0') (tensor(30341.5957, device='cuda:0')) | > current_lr_0: 0.000125874883640886 | > current_lr_1: 0.000125874883640886 | > step_time: 0.2721 (0.46495787720931203) | > loader_time: 0.0028 (0.008946054860165245)  --> TIME: 2023-10-20 04:45:39 -- STEP: 49/50 -- GLOBAL_STEP: 76200 | > loss_disc: 2.5494384765625 (2.4458100211863623) | > loss_disc_real_0: 0.006488331593573093 (0.1568671689007659) | > loss_disc_real_1: 0.11502235382795334 (0.21522936053878192) | > loss_disc_real_2: 0.060074903070926666 (0.2120744283406102) | > loss_disc_real_3: 0.28226593136787415 (0.25999944550650467) | > loss_disc_real_4: 0.27447310090065 (0.2352578337399327) | > loss_disc_real_5: 0.2962207794189453 (0.22566423671586172) | > loss_0: 2.5494384765625 (2.4458100211863623) | > grad_norm_0: tensor(2364.0166, device='cuda:0') (tensor(713.9385, device='cuda:0')) | > loss_gen: 2.00607967376709 (2.3883048928513815) | > loss_kl: 0.5511293411254883 (0.8364954092064683) | > loss_feat: 2.84550142288208 (5.115891914434579) | > loss_mel: 24.2928466796875 (21.45559177593309) | > loss_duration: 1.6451852321624756 (1.5225474226231475) | > loss_1: 31.340742111206055 (31.31883143405525) | > grad_norm_1: tensor(8096.4985, device='cuda:0') (tensor(25800.9609, device='cuda:0')) | > current_lr_0: 0.000125874883640886 | > current_lr_1: 0.000125874883640886 | > step_time: 0.4738 (0.4887815300299197) | > loader_time: 0.3675 (0.02021609033857073)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7796967029571533 (1.7796967029571533) | > loss_disc_real_0: 0.295052170753479 (0.295052170753479) | > loss_disc_real_1: 0.23883923888206482 (0.23883923888206482) | > loss_disc_real_2: 0.26387152075767517 (0.26387152075767517) | > loss_disc_real_3: 0.1290331482887268 (0.1290331482887268) | > loss_disc_real_4: 0.18503494560718536 (0.18503494560718536) | > loss_disc_real_5: 0.08265521377325058 (0.08265521377325058) | > loss_0: 1.7796967029571533 (1.7796967029571533) | > loss_gen: 3.348092555999756 (3.348092555999756) | > loss_kl: 3.8521265983581543 (3.8521265983581543) | > loss_feat: 9.971161842346191 (9.971161842346191) | > loss_mel: 28.74577522277832 (28.74577522277832) | > loss_duration: 2.629829168319702 (2.629829168319702) | > loss_1: 48.54698181152344 (48.54698181152344)  --> STEP: 1 | > loss_disc: 1.845956563949585 (1.845956563949585) | > loss_disc_real_0: 0.013121683150529861 (0.013121683150529861) | > loss_disc_real_1: 0.13877534866333008 (0.13877534866333008) | > loss_disc_real_2: 0.19529275596141815 (0.19529275596141815) | > loss_disc_real_3: 0.1892678439617157 (0.1892678439617157) | > loss_disc_real_4: 0.21137678623199463 (0.21137678623199463) | > loss_disc_real_5: 0.2735159695148468 (0.2735159695148468) | > loss_0: 1.845956563949585 (1.845956563949585) | > loss_gen: 2.8378243446350098 (2.8378243446350098) | > loss_kl: 3.9094932079315186 (3.9094932079315186) | > loss_feat: 8.138453483581543 (8.138453483581543) | > loss_mel: 25.973804473876953 (25.973804473876953) | > loss_duration: 2.889455556869507 (2.889455556869507) | > loss_1: 43.74903106689453 (43.74903106689453)  --> STEP: 2 | > loss_disc: 2.007096767425537 (1.926526665687561) | > loss_disc_real_0: 0.4532555043697357 (0.2331885937601328) | > loss_disc_real_1: 0.08103816956281662 (0.10990675911307335) | > loss_disc_real_2: 0.10107854753732681 (0.14818565174937248) | > loss_disc_real_3: 0.18157532811164856 (0.18542158603668213) | > loss_disc_real_4: 0.09580538421869278 (0.1535910852253437) | > loss_disc_real_5: 0.25942105054855347 (0.26646851003170013) | > loss_0: 2.007096767425537 (1.926526665687561) | > loss_gen: 2.761611223220825 (2.7997177839279175) | > loss_kl: 3.9185991287231445 (3.9140461683273315) | > loss_feat: 9.689764976501465 (8.914109230041504) | > loss_mel: 27.447481155395508 (26.71064281463623) | > loss_duration: 2.8094868659973145 (2.8494712114334106) | > loss_1: 46.62694549560547 (45.18798828125)  --> STEP: 3 | > loss_disc: 3.079627275466919 (2.3108935356140137) | > loss_disc_real_0: 0.2225794792175293 (0.22965222224593163) | > loss_disc_real_1: 0.452059268951416 (0.22395759572585425) | > loss_disc_real_2: 0.3987026810646057 (0.23169132818778357) | > loss_disc_real_3: 0.3387362062931061 (0.2365264594554901) | > loss_disc_real_4: 0.43795183300971985 (0.24837800115346909) | > loss_disc_real_5: 0.44717973470687866 (0.32670558492342633) | > loss_0: 3.079627275466919 (2.3108935356140137) | > loss_gen: 2.9922356605529785 (2.8638904094696045) | > loss_kl: 1.6636910438537598 (3.1639277935028076) | > loss_feat: 3.9382357597351074 (7.255484739939372) | > loss_mel: 23.688819885253906 (25.70336850484212) | > loss_duration: 2.6589202880859375 (2.785954236984253) | > loss_1: 34.94190216064453 (41.77262624104818) --> EVAL PERFORMANCE | > avg_loader_time: 0.005003293355305989 (-0.010419766108194988) | > avg_loss_disc: 2.3108935356140137 (-0.5606597264607749) | > avg_loss_disc_real_0: 0.22965222224593163 (-0.21552380298574764) | > avg_loss_disc_real_1: 0.22395759572585425 (-0.01887304832537967) | > avg_loss_disc_real_2: 0.23169132818778357 (-0.01586354523897171) | > avg_loss_disc_real_3: 0.2365264594554901 (-0.03115596373875934) | > avg_loss_disc_real_4: 0.24837800115346909 (-0.05959122131268185) | > avg_loss_disc_real_5: 0.32670558492342633 (+0.09347232182820639) | > avg_loss_0: 2.3108935356140137 (-0.5606597264607749) | > avg_loss_gen: 2.8638904094696045 (+0.45892484982808446) | > avg_loss_kl: 3.1639277935028076 (-0.13332947095235204) | > avg_loss_feat: 7.255484739939372 (+2.943788419167201) | > avg_loss_mel: 25.70336850484212 (+4.546475728352863) | > avg_loss_duration: 2.785954236984253 (+0.04285113016764308) | > avg_loss_1: 41.77262624104818 (+7.858711242675781)  > EPOCH: 464/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:45:49)   --> TIME: 2023-10-20 04:46:06 -- STEP: 29/50 -- GLOBAL_STEP: 76230 | > loss_disc: 2.7400131225585938 (2.353771203550799) | > loss_disc_real_0: 0.2671031355857849 (0.13825857825577256) | > loss_disc_real_1: 0.2082972377538681 (0.21712265459114108) | > loss_disc_real_2: 0.19551311433315277 (0.23660230212684336) | > loss_disc_real_3: 0.24313290417194366 (0.24116492849485627) | > loss_disc_real_4: 0.29374822974205017 (0.20360097507464475) | > loss_disc_real_5: 0.2528495490550995 (0.2117260385561606) | > loss_0: 2.7400131225585938 (2.353771203550799) | > grad_norm_0: tensor(640.7295, device='cuda:0') (tensor(723.8645, device='cuda:0')) | > loss_gen: 1.9211806058883667 (2.464361671743722) | > loss_kl: 0.8729619979858398 (0.8605029089697476) | > loss_feat: 0.8713278770446777 (6.203629360116762) | > loss_mel: 17.8533935546875 (22.727427877228834) | > loss_duration: 1.5460766553878784 (1.5306937858976166) | > loss_1: 23.064939498901367 (33.786615437474744) | > grad_norm_1: tensor(17664.8594, device='cuda:0') (tensor(23505.7520, device='cuda:0')) | > current_lr_0: 0.00012574906381374124 | > current_lr_1: 0.00012574906381374124 | > step_time: 0.253 (0.43593450250296756) | > loader_time: 0.004 (0.012715857604454307)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0881760120391846 (2.0881760120391846) | > loss_disc_real_0: 0.22406414151191711 (0.22406414151191711) | > loss_disc_real_1: 0.2724131941795349 (0.2724131941795349) | > loss_disc_real_2: 0.24889276921749115 (0.24889276921749115) | > loss_disc_real_3: 0.27162113785743713 (0.27162113785743713) | > loss_disc_real_4: 0.19308610260486603 (0.19308610260486603) | > loss_disc_real_5: 0.0961649939417839 (0.0961649939417839) | > loss_0: 2.0881760120391846 (2.0881760120391846) | > loss_gen: 2.8906869888305664 (2.8906869888305664) | > loss_kl: 3.770479917526245 (3.770479917526245) | > loss_feat: 6.17870569229126 (6.17870569229126) | > loss_mel: 24.62936019897461 (24.62936019897461) | > loss_duration: 2.657773733139038 (2.657773733139038) | > loss_1: 40.12700271606445 (40.12700271606445)  --> STEP: 1 | > loss_disc: 2.5714216232299805 (2.5714216232299805) | > loss_disc_real_0: 0.21733060479164124 (0.21733060479164124) | > loss_disc_real_1: 0.2589223086833954 (0.2589223086833954) | > loss_disc_real_2: 0.1552000343799591 (0.1552000343799591) | > loss_disc_real_3: 0.3043091893196106 (0.3043091893196106) | > loss_disc_real_4: 0.29403379559516907 (0.29403379559516907) | > loss_disc_real_5: 0.21810534596443176 (0.21810534596443176) | > loss_0: 2.5714216232299805 (2.5714216232299805) | > loss_gen: 2.329369306564331 (2.329369306564331) | > loss_kl: 3.857893466949463 (3.857893466949463) | > loss_feat: 7.311483860015869 (7.311483860015869) | > loss_mel: 25.6313419342041 (25.6313419342041) | > loss_duration: 2.9619410037994385 (2.9619410037994385) | > loss_1: 42.0920295715332 (42.0920295715332)  --> STEP: 2 | > loss_disc: 2.8466532230377197 (2.70903742313385) | > loss_disc_real_0: 0.10928139090538025 (0.16330599784851074) | > loss_disc_real_1: 0.26003268361091614 (0.25947749614715576) | > loss_disc_real_2: 0.21852639317512512 (0.18686321377754211) | > loss_disc_real_3: 0.2911458909511566 (0.2977275401353836) | > loss_disc_real_4: 0.17360062897205353 (0.2338172122836113) | > loss_disc_real_5: 0.1864911913871765 (0.20229826867580414) | > loss_0: 2.8466532230377197 (2.70903742313385) | > loss_gen: 1.5063525438308716 (1.9178609251976013) | > loss_kl: 4.582576751708984 (4.220235109329224) | > loss_feat: 2.1263418197631836 (4.718912839889526) | > loss_mel: 9.812942504882812 (17.722142219543457) | > loss_duration: 2.777433156967163 (2.869687080383301) | > loss_1: 20.805648803710938 (31.44883918762207)  --> STEP: 3 | > loss_disc: 2.960329294204712 (2.7928013801574707) | > loss_disc_real_0: 0.15398460626602173 (0.1601988673210144) | > loss_disc_real_1: 0.28472253680229187 (0.2678925096988678) | > loss_disc_real_2: 0.23862995207309723 (0.20411879320939383) | > loss_disc_real_3: 0.289429634809494 (0.2949615716934204) | > loss_disc_real_4: 0.2681832015514374 (0.24527254203955332) | > loss_disc_real_5: 0.2341921627521515 (0.21292956670125326) | > loss_0: 2.960329294204712 (2.7928013801574707) | > loss_gen: 1.5170507431030273 (1.7842575311660767) | > loss_kl: 2.0947988033294678 (3.511756340662638) | > loss_feat: 0.5389572978019714 (3.3255943258603415) | > loss_mel: 16.806419372558594 (17.416901270548504) | > loss_duration: 2.6258203983306885 (2.788398186365763) | > loss_1: 23.583045959472656 (28.826908111572266) --> EVAL PERFORMANCE | > avg_loader_time: 0.009763002395629883 (+0.0047597090403238935) | > avg_loss_disc: 2.7928013801574707 (+0.48190784454345703) | > avg_loss_disc_real_0: 0.1601988673210144 (-0.06945335492491722) | > avg_loss_disc_real_1: 0.2678925096988678 (+0.04393491397301355) | > avg_loss_disc_real_2: 0.20411879320939383 (-0.02757253497838974) | > avg_loss_disc_real_3: 0.2949615716934204 (+0.0584351122379303) | > avg_loss_disc_real_4: 0.24527254203955332 (-0.0031054591139157706) | > avg_loss_disc_real_5: 0.21292956670125326 (-0.11377601822217306) | > avg_loss_0: 2.7928013801574707 (+0.48190784454345703) | > avg_loss_gen: 1.7842575311660767 (-1.0796328783035278) | > avg_loss_kl: 3.511756340662638 (+0.3478285471598306) | > avg_loss_feat: 3.3255943258603415 (-3.9298904140790305) | > avg_loss_mel: 17.416901270548504 (-8.286467234293617) | > avg_loss_duration: 2.788398186365763 (+0.0024439493815102686) | > avg_loss_1: 28.826908111572266 (-12.945718129475914)  > EPOCH: 465/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:46:28)   --> TIME: 2023-10-20 04:46:37 -- STEP: 9/50 -- GLOBAL_STEP: 76260 | > loss_disc: 2.905789375305176 (2.4980670478608875) | > loss_disc_real_0: 0.1808466613292694 (0.1517656101948685) | > loss_disc_real_1: 0.21047787368297577 (0.24109666008088323) | > loss_disc_real_2: 0.3083486557006836 (0.2484023024638494) | > loss_disc_real_3: 0.35585451126098633 (0.2594880660374959) | > loss_disc_real_4: 0.2510429620742798 (0.23932049651112822) | > loss_disc_real_5: 0.2655354142189026 (0.20928655937314034) | > loss_0: 2.905789375305176 (2.4980670478608875) | > grad_norm_0: tensor(281.0300, device='cuda:0') (tensor(473.5697, device='cuda:0')) | > loss_gen: 1.8276499509811401 (2.2952632241778903) | > loss_kl: 1.0294266939163208 (0.8885756267441643) | > loss_feat: 2.1756277084350586 (5.433148614234394) | > loss_mel: 9.59565544128418 (19.767417669296265) | > loss_duration: 1.4437286853790283 (1.5242816739612155) | > loss_1: 16.07208824157715 (29.908686690860325) | > grad_norm_1: tensor(13591.0410, device='cuda:0') (tensor(26645.2910, device='cuda:0')) | > current_lr_0: 0.00012562336975139123 | > current_lr_1: 0.00012562336975139123 | > step_time: 0.5806 (0.5348452726999918) | > loader_time: 0.0186 (0.019559065500895183)  --> TIME: 2023-10-20 04:46:53 -- STEP: 39/50 -- GLOBAL_STEP: 76290 | > loss_disc: 2.9811763763427734 (2.521560412186843) | > loss_disc_real_0: 0.25407445430755615 (0.1610011064137022) | > loss_disc_real_1: 0.37628963589668274 (0.244131164959608) | > loss_disc_real_2: 0.3359186351299286 (0.22733996923153216) | > loss_disc_real_3: 0.32698914408683777 (0.23944231571677405) | > loss_disc_real_4: 0.3031695783138275 (0.23642310896554056) | > loss_disc_real_5: 0.34425169229507446 (0.2299294566305784) | > loss_0: 2.9811763763427734 (2.521560412186843) | > grad_norm_0: tensor(1545.1522, device='cuda:0') (tensor(532.0879, device='cuda:0')) | > loss_gen: 2.378957748413086 (2.2492547921645336) | > loss_kl: 0.8677728772163391 (0.8772839422409351) | > loss_feat: 2.3107173442840576 (4.784426579968286) | > loss_mel: 21.832162857055664 (20.329967801387493) | > loss_duration: 1.5577048063278198 (1.5179660411981437) | > loss_1: 28.947315216064453 (29.758899248563328) | > grad_norm_1: tensor(10036.5947, device='cuda:0') (tensor(21562.9570, device='cuda:0')) | > current_lr_0: 0.00012562336975139123 | > current_lr_1: 0.00012562336975139123 | > step_time: 0.5553 (0.5061393639980218) | > loader_time: 0.0116 (0.018567996147351384)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.707933187484741 (2.707933187484741) | > loss_disc_real_0: 0.43267202377319336 (0.43267202377319336) | > loss_disc_real_1: 0.25773319602012634 (0.25773319602012634) | > loss_disc_real_2: 0.19548434019088745 (0.19548434019088745) | > loss_disc_real_3: 0.29151052236557007 (0.29151052236557007) | > loss_disc_real_4: 0.23392608761787415 (0.23392608761787415) | > loss_disc_real_5: 0.33669570088386536 (0.33669570088386536) | > loss_0: 2.707933187484741 (2.707933187484741) | > loss_gen: 2.705517292022705 (2.705517292022705) | > loss_kl: 3.600762128829956 (3.600762128829956) | > loss_feat: 5.460517883300781 (5.460517883300781) | > loss_mel: 23.401351928710938 (23.401351928710938) | > loss_duration: 2.6045334339141846 (2.6045334339141846) | > loss_1: 37.772682189941406 (37.772682189941406)  --> STEP: 1 | > loss_disc: 2.1149137020111084 (2.1149137020111084) | > loss_disc_real_0: 0.0333656407892704 (0.0333656407892704) | > loss_disc_real_1: 0.2375604659318924 (0.2375604659318924) | > loss_disc_real_2: 0.09702087193727493 (0.09702087193727493) | > loss_disc_real_3: 0.1910504400730133 (0.1910504400730133) | > loss_disc_real_4: 0.12910081446170807 (0.12910081446170807) | > loss_disc_real_5: 0.11986606568098068 (0.11986606568098068) | > loss_0: 2.1149137020111084 (2.1149137020111084) | > loss_gen: 2.317906141281128 (2.317906141281128) | > loss_kl: 3.517554521560669 (3.517554521560669) | > loss_feat: 6.1576433181762695 (6.1576433181762695) | > loss_mel: 23.184175491333008 (23.184175491333008) | > loss_duration: 2.9255452156066895 (2.9255452156066895) | > loss_1: 38.10282516479492 (38.10282516479492)  --> STEP: 2 | > loss_disc: 2.4855940341949463 (2.3002538681030273) | > loss_disc_real_0: 0.11750815063714981 (0.0754368957132101) | > loss_disc_real_1: 0.32090726494789124 (0.2792338654398918) | > loss_disc_real_2: 0.3242546319961548 (0.21063775196671486) | > loss_disc_real_3: 0.2366907149553299 (0.2138705775141716) | > loss_disc_real_4: 0.13467809557914734 (0.1318894550204277) | > loss_disc_real_5: 0.24179600179195404 (0.18083103373646736) | > loss_0: 2.4855940341949463 (2.3002538681030273) | > loss_gen: 2.117471694946289 (2.2176889181137085) | > loss_kl: 4.289061546325684 (3.9033080339431763) | > loss_feat: 4.799150466918945 (5.478396892547607) | > loss_mel: 26.604442596435547 (24.894309043884277) | > loss_duration: 2.7157318592071533 (2.8206385374069214) | > loss_1: 40.52585983276367 (39.3143424987793)  --> STEP: 3 | > loss_disc: 2.2113497257232666 (2.2706191539764404) | > loss_disc_real_0: 0.02595302276313305 (0.058942271396517754) | > loss_disc_real_1: 0.2971274256706238 (0.2851983855168025) | > loss_disc_real_2: 0.1496938169002533 (0.190323106944561) | > loss_disc_real_3: 0.20898599922657013 (0.21224238475163779) | > loss_disc_real_4: 0.2618837058544159 (0.17522087196509042) | > loss_disc_real_5: 0.3188783824443817 (0.22684681663910547) | > loss_0: 2.2113497257232666 (2.2706191539764404) | > loss_gen: 2.354900360107422 (2.2634260654449463) | > loss_kl: 2.2115259170532227 (3.339380661646525) | > loss_feat: 5.463870525360107 (5.473554770151774) | > loss_mel: 20.4766902923584 (23.421769460042317) | > loss_duration: 2.694347381591797 (2.7785414854685464) | > loss_1: 33.201332092285156 (37.27667236328125) --> EVAL PERFORMANCE | > avg_loader_time: 0.0100709597269694 (+0.00030795733133951765) | > avg_loss_disc: 2.2706191539764404 (-0.5221822261810303) | > avg_loss_disc_real_0: 0.058942271396517754 (-0.10125659592449665) | > avg_loss_disc_real_1: 0.2851983855168025 (+0.01730587581793469) | > avg_loss_disc_real_2: 0.190323106944561 (-0.013795686264832824) | > avg_loss_disc_real_3: 0.21224238475163779 (-0.08271918694178262) | > avg_loss_disc_real_4: 0.17522087196509042 (-0.07005167007446289) | > avg_loss_disc_real_5: 0.22684681663910547 (+0.013917249937852205) | > avg_loss_0: 2.2706191539764404 (-0.5221822261810303) | > avg_loss_gen: 2.2634260654449463 (+0.47916853427886963) | > avg_loss_kl: 3.339380661646525 (-0.17237567901611328) | > avg_loss_feat: 5.473554770151774 (+2.147960444291433) | > avg_loss_mel: 23.421769460042317 (+6.004868189493813) | > avg_loss_duration: 2.7785414854685464 (-0.009856700897216797) | > avg_loss_1: 37.27667236328125 (+8.449764251708984)  > EPOCH: 466/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:47:09)   --> TIME: 2023-10-20 04:47:21 -- STEP: 19/50 -- GLOBAL_STEP: 76320 | > loss_disc: 2.1126692295074463 (2.5386720205608166) | > loss_disc_real_0: 0.07660960406064987 (0.15940387978365547) | > loss_disc_real_1: 0.20315967500209808 (0.23734320464887118) | > loss_disc_real_2: 0.1297755241394043 (0.21914655127023397) | > loss_disc_real_3: 0.11674641817808151 (0.2585754617068328) | > loss_disc_real_4: 0.0850544348359108 (0.22432824008558927) | > loss_disc_real_5: 0.05760569125413895 (0.23608291590292202) | > loss_0: 2.1126692295074463 (2.5386720205608166) | > grad_norm_0: tensor(782.1787, device='cuda:0') (tensor(651.8461, device='cuda:0')) | > loss_gen: 1.8241348266601562 (2.235881385050322) | > loss_kl: 0.7359919548034668 (0.920404345581406) | > loss_feat: 4.697861671447754 (4.803244314695661) | > loss_mel: 19.045639038085938 (21.22950137288947) | > loss_duration: 1.6760458946228027 (1.542219318841633) | > loss_1: 27.979673385620117 (30.73125081313284) | > grad_norm_1: tensor(7215.0591, device='cuda:0') (tensor(20046.0527, device='cuda:0')) | > current_lr_0: 0.00012549780132812616 | > current_lr_1: 0.00012549780132812616 | > step_time: 1.2084 (0.44064727582429586) | > loader_time: 0.0262 (0.010236827950728567)  --> TIME: 2023-10-20 04:47:37 -- STEP: 49/50 -- GLOBAL_STEP: 76350 | > loss_disc: 2.639282703399658 (2.4878918686691596) | > loss_disc_real_0: 0.22566041350364685 (0.16023057265853397) | > loss_disc_real_1: 0.23651932179927826 (0.22943586491200388) | > loss_disc_real_2: 0.2137034684419632 (0.22187337492193496) | > loss_disc_real_3: 0.2586423456668854 (0.25067535069371966) | > loss_disc_real_4: 0.22626914083957672 (0.21236058096496427) | > loss_disc_real_5: 0.23059792816638947 (0.21954148160103631) | > loss_0: 2.639282703399658 (2.4878918686691596) | > grad_norm_0: tensor(685.7267, device='cuda:0') (tensor(548.0688, device='cuda:0')) | > loss_gen: 1.8065015077590942 (2.2887932086477485) | > loss_kl: 0.52285236120224 (0.9270058149585918) | > loss_feat: 1.412115216255188 (4.907439102323689) | > loss_mel: 18.120361328125 (21.042299270629883) | > loss_duration: 1.6290847063064575 (1.5045518096612425) | > loss_1: 23.490915298461914 (30.670089069677857) | > grad_norm_1: tensor(4138.1670, device='cuda:0') (tensor(16829.5918, device='cuda:0')) | > current_lr_0: 0.00012549780132812616 | > current_lr_1: 0.00012549780132812616 | > step_time: 0.607 (0.46768226428907744) | > loader_time: 0.3663 (0.020731453992882554)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5968282222747803 (2.5968282222747803) | > loss_disc_real_0: 0.21417860686779022 (0.21417860686779022) | > loss_disc_real_1: 0.3136219382286072 (0.3136219382286072) | > loss_disc_real_2: 0.3253420889377594 (0.3253420889377594) | > loss_disc_real_3: 0.3134380578994751 (0.3134380578994751) | > loss_disc_real_4: 0.2850725054740906 (0.2850725054740906) | > loss_disc_real_5: 0.13756656646728516 (0.13756656646728516) | > loss_0: 2.5968282222747803 (2.5968282222747803) | > loss_gen: 2.323758363723755 (2.323758363723755) | > loss_kl: 3.655489206314087 (3.655489206314087) | > loss_feat: 4.7941484451293945 (4.7941484451293945) | > loss_mel: 23.36661148071289 (23.36661148071289) | > loss_duration: 2.626356363296509 (2.626356363296509) | > loss_1: 36.76636505126953 (36.76636505126953)  --> STEP: 1 | > loss_disc: 2.6826441287994385 (2.6826441287994385) | > loss_disc_real_0: 0.1665259450674057 (0.1665259450674057) | > loss_disc_real_1: 0.24711085855960846 (0.24711085855960846) | > loss_disc_real_2: 0.18747933208942413 (0.18747933208942413) | > loss_disc_real_3: 0.3154344856739044 (0.3154344856739044) | > loss_disc_real_4: 0.4572461247444153 (0.4572461247444153) | > loss_disc_real_5: 0.3326071798801422 (0.3326071798801422) | > loss_0: 2.6826441287994385 (2.6826441287994385) | > loss_gen: 2.471529006958008 (2.471529006958008) | > loss_kl: 3.83833909034729 (3.83833909034729) | > loss_feat: 6.355942249298096 (6.355942249298096) | > loss_mel: 22.593950271606445 (22.593950271606445) | > loss_duration: 2.966947317123413 (2.966947317123413) | > loss_1: 38.22670364379883 (38.22670364379883)  --> STEP: 2 | > loss_disc: 2.9606258869171143 (2.8216350078582764) | > loss_disc_real_0: 0.23712249100208282 (0.20182421803474426) | > loss_disc_real_1: 0.25540632009506226 (0.25125858932733536) | > loss_disc_real_2: 0.2781689763069153 (0.2328241541981697) | > loss_disc_real_3: 0.2669483423233032 (0.2911914139986038) | > loss_disc_real_4: 0.28553682565689087 (0.3713914752006531) | > loss_disc_real_5: 0.24961955845355988 (0.29111336916685104) | > loss_0: 2.9606258869171143 (2.8216350078582764) | > loss_gen: 1.6212693452835083 (2.046399176120758) | > loss_kl: 4.4539899826049805 (4.146164536476135) | > loss_feat: 0.13007546961307526 (3.2430088594555855) | > loss_mel: 2.8358054161071777 (12.714877843856812) | > loss_duration: 2.757082462310791 (2.862014889717102) | > loss_1: 11.798223495483398 (25.012463569641113)  --> STEP: 3 | > loss_disc: 3.0674431324005127 (2.903571049372355) | > loss_disc_real_0: 0.3183344006538391 (0.24066094557444254) | > loss_disc_real_1: 0.26682859659194946 (0.2564485917488734) | > loss_disc_real_2: 0.3674391210079193 (0.27769580980141956) | > loss_disc_real_3: 0.30044320225715637 (0.29427534341812134) | > loss_disc_real_4: 0.3521745502948761 (0.3649858335653941) | > loss_disc_real_5: 0.33082711696624756 (0.3043512850999832) | > loss_0: 3.0674431324005127 (2.903571049372355) | > loss_gen: 1.977792739868164 (2.02353036403656) | > loss_kl: 1.8718302249908447 (3.3880530993143716) | > loss_feat: 1.3902642726898193 (2.6254273305336633) | > loss_mel: 19.078304290771484 (14.83601999282837) | > loss_duration: 2.703526258468628 (2.809185345967611) | > loss_1: 27.021717071533203 (25.682214736938477) --> EVAL PERFORMANCE | > avg_loader_time: 0.002404451370239258 (-0.007666508356730143) | > avg_loss_disc: 2.903571049372355 (+0.6329518953959146) | > avg_loss_disc_real_0: 0.24066094557444254 (+0.18171867417792478) | > avg_loss_disc_real_1: 0.2564485917488734 (-0.028749793767929077) | > avg_loss_disc_real_2: 0.27769580980141956 (+0.08737270285685855) | > avg_loss_disc_real_3: 0.29427534341812134 (+0.08203295866648355) | > avg_loss_disc_real_4: 0.3649858335653941 (+0.18976496160030368) | > avg_loss_disc_real_5: 0.3043512850999832 (+0.07750446846087775) | > avg_loss_0: 2.903571049372355 (+0.6329518953959146) | > avg_loss_gen: 2.02353036403656 (-0.23989570140838623) | > avg_loss_kl: 3.3880530993143716 (+0.04867243766784668) | > avg_loss_feat: 2.6254273305336633 (-2.848127439618111) | > avg_loss_mel: 14.83601999282837 (-8.585749467213947) | > avg_loss_duration: 2.809185345967611 (+0.030643860499064424) | > avg_loss_1: 25.682214736938477 (-11.594457626342773)  > EPOCH: 467/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:47:50)   --> TIME: 2023-10-20 04:48:08 -- STEP: 29/50 -- GLOBAL_STEP: 76380 | > loss_disc: 2.6960086822509766 (2.471687230570563) | > loss_disc_real_0: 0.04660388454794884 (0.17256015307944397) | > loss_disc_real_1: 0.29375287890434265 (0.21601258372438364) | > loss_disc_real_2: 0.2483316957950592 (0.2185344833495288) | > loss_disc_real_3: 0.23003998398780823 (0.2303749337021647) | > loss_disc_real_4: 0.31255486607551575 (0.25054027949427743) | > loss_disc_real_5: 0.40233826637268066 (0.23033067417042002) | > loss_0: 2.6960086822509766 (2.471687230570563) | > grad_norm_0: tensor(724.6509, device='cuda:0') (tensor(733.7205, device='cuda:0')) | > loss_gen: 2.143665313720703 (2.331672795887651) | > loss_kl: 0.6106789708137512 (0.9290809035301208) | > loss_feat: 3.2819015979766846 (4.781503753222781) | > loss_mel: 23.51365852355957 (21.732768017670203) | > loss_duration: 1.4568307399749756 (1.5200917638581375) | > loss_1: 31.00673484802246 (31.29511706582431) | > grad_norm_1: tensor(6955.2944, device='cuda:0') (tensor(22076.8730, device='cuda:0')) | > current_lr_0: 0.00012537235841836186 | > current_lr_1: 0.00012537235841836186 | > step_time: 0.4321 (0.46501167067166027) | > loader_time: 0.0123 (0.013258333863883183)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5945565700531006 (2.5945565700531006) | > loss_disc_real_0: 0.223987877368927 (0.223987877368927) | > loss_disc_real_1: 0.2719533443450928 (0.2719533443450928) | > loss_disc_real_2: 0.23161768913269043 (0.23161768913269043) | > loss_disc_real_3: 0.26434653997421265 (0.26434653997421265) | > loss_disc_real_4: 0.3522956967353821 (0.3522956967353821) | > loss_disc_real_5: 0.2080814242362976 (0.2080814242362976) | > loss_0: 2.5945565700531006 (2.5945565700531006) | > loss_gen: 2.3437204360961914 (2.3437204360961914) | > loss_kl: 3.1626312732696533 (3.1626312732696533) | > loss_feat: 5.633858680725098 (5.633858680725098) | > loss_mel: 24.153413772583008 (24.153413772583008) | > loss_duration: 2.5822513103485107 (2.5822513103485107) | > loss_1: 37.875877380371094 (37.875877380371094)  --> STEP: 1 | > loss_disc: 1.721743106842041 (1.721743106842041) | > loss_disc_real_0: 0.13980771601200104 (0.13980771601200104) | > loss_disc_real_1: 0.14869195222854614 (0.14869195222854614) | > loss_disc_real_2: 0.16712166368961334 (0.16712166368961334) | > loss_disc_real_3: 0.24522088468074799 (0.24522088468074799) | > loss_disc_real_4: 0.19559450447559357 (0.19559450447559357) | > loss_disc_real_5: 0.13757699728012085 (0.13757699728012085) | > loss_0: 1.721743106842041 (1.721743106842041) | > loss_gen: 2.9549663066864014 (2.9549663066864014) | > loss_kl: 3.755366802215576 (3.755366802215576) | > loss_feat: 8.055490493774414 (8.055490493774414) | > loss_mel: 22.902620315551758 (22.902620315551758) | > loss_duration: 2.7557437419891357 (2.7557437419891357) | > loss_1: 40.424190521240234 (40.424190521240234)  --> STEP: 2 | > loss_disc: 2.3219521045684814 (2.0218476057052612) | > loss_disc_real_0: 0.18491680920124054 (0.1623622626066208) | > loss_disc_real_1: 0.2707337737083435 (0.20971286296844482) | > loss_disc_real_2: 0.3769625723361969 (0.2720421180129051) | > loss_disc_real_3: 0.31101951003074646 (0.2781201973557472) | > loss_disc_real_4: 0.28774890303611755 (0.24167170375585556) | > loss_disc_real_5: 0.19958321750164032 (0.16858010739088058) | > loss_0: 2.3219521045684814 (2.0218476057052612) | > loss_gen: 3.4309232234954834 (3.1929447650909424) | > loss_kl: 4.3186259269714355 (4.036996364593506) | > loss_feat: 8.747048377990723 (8.401269435882568) | > loss_mel: 30.69476318359375 (26.798691749572754) | > loss_duration: 2.7462589740753174 (2.7510013580322266) | > loss_1: 49.937618255615234 (45.180904388427734)  --> STEP: 3 | > loss_disc: 2.8625717163085938 (2.302088975906372) | > loss_disc_real_0: 0.3405478000640869 (0.2217574417591095) | > loss_disc_real_1: 0.26909753680229187 (0.22950775424639383) | > loss_disc_real_2: 0.24370244145393372 (0.26259555915991467) | > loss_disc_real_3: 0.17786000669002533 (0.2447001338005066) | > loss_disc_real_4: 0.23094184696674347 (0.23809508482615152) | > loss_disc_real_5: 0.4912034869194031 (0.27612123390038806) | > loss_0: 2.8625717163085938 (2.302088975906372) | > loss_gen: 2.74299693107605 (3.042962153752645) | > loss_kl: 1.7515302896499634 (3.275174339612325) | > loss_feat: 6.2970757484436035 (7.69987154006958) | > loss_mel: 23.447921752929688 (25.6817684173584) | > loss_duration: 2.65269136428833 (2.7182313601175943) | > loss_1: 36.892215728759766 (42.418008168538414) --> EVAL PERFORMANCE | > avg_loader_time: 0.010033369064331055 (+0.007628917694091797) | > avg_loss_disc: 2.302088975906372 (-0.6014820734659829) | > avg_loss_disc_real_0: 0.2217574417591095 (-0.01890350381533304) | > avg_loss_disc_real_1: 0.22950775424639383 (-0.02694083750247958) | > avg_loss_disc_real_2: 0.26259555915991467 (-0.015100250641504886) | > avg_loss_disc_real_3: 0.2447001338005066 (-0.049575209617614746) | > avg_loss_disc_real_4: 0.23809508482615152 (-0.12689074873924258) | > avg_loss_disc_real_5: 0.27612123390038806 (-0.028230051199595152) | > avg_loss_0: 2.302088975906372 (-0.6014820734659829) | > avg_loss_gen: 3.042962153752645 (+1.019431789716085) | > avg_loss_kl: 3.275174339612325 (-0.11287875970204642) | > avg_loss_feat: 7.69987154006958 (+5.074444209535917) | > avg_loss_mel: 25.6817684173584 (+10.84574842453003) | > avg_loss_duration: 2.7182313601175943 (-0.09095398585001657) | > avg_loss_1: 42.418008168538414 (+16.735793431599937)  > EPOCH: 468/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:48:30)   --> TIME: 2023-10-20 04:48:39 -- STEP: 9/50 -- GLOBAL_STEP: 76410 | > loss_disc: 3.093132257461548 (2.4918914238611856) | > loss_disc_real_0: 0.2488955557346344 (0.1875241200129191) | > loss_disc_real_1: 0.26030153036117554 (0.3068869188427925) | > loss_disc_real_2: 0.30463072657585144 (0.274696231716209) | > loss_disc_real_3: 0.275497168302536 (0.254936379690965) | > loss_disc_real_4: 0.33964085578918457 (0.26026760497026974) | > loss_disc_real_5: 0.3530546724796295 (0.2780778801275624) | > loss_0: 3.093132257461548 (2.4918914238611856) | > grad_norm_0: tensor(290.5696, device='cuda:0') (tensor(700.9644, device='cuda:0')) | > loss_gen: 1.7270617485046387 (2.6988476382361517) | > loss_kl: 1.0488508939743042 (0.9070982535680135) | > loss_feat: 0.1720980703830719 (5.293943025999599) | > loss_mel: 9.459158897399902 (19.08380381266276) | > loss_duration: 1.470027208328247 (1.5275720092985365) | > loss_1: 13.877196311950684 (29.51126464207967) | > grad_norm_1: tensor(13075.8965, device='cuda:0') (tensor(36930.3867, device='cuda:0')) | > current_lr_0: 0.00012524704089663985 | > current_lr_1: 0.00012524704089663985 | > step_time: 0.5977 (0.4990767902798123) | > loader_time: 0.0046 (0.01957779460483127)  --> TIME: 2023-10-20 04:48:55 -- STEP: 39/50 -- GLOBAL_STEP: 76440 | > loss_disc: 2.6207711696624756 (2.4925717115402226) | > loss_disc_real_0: 0.014101948589086533 (0.15764786876164952) | > loss_disc_real_1: 0.32977789640426636 (0.24394522741054878) | > loss_disc_real_2: 0.3112829625606537 (0.2458608514175583) | > loss_disc_real_3: 0.24951575696468353 (0.2460948198269575) | > loss_disc_real_4: 0.31352388858795166 (0.24650708796122137) | > loss_disc_real_5: 0.25444915890693665 (0.23292026668787003) | > loss_0: 2.6207711696624756 (2.4925717115402226) | > grad_norm_0: tensor(557.0676, device='cuda:0') (tensor(613.3804, device='cuda:0')) | > loss_gen: 2.267554759979248 (2.3947846461565065) | > loss_kl: 0.520220160484314 (0.7850792851203529) | > loss_feat: 3.211172580718994 (4.8391364102180185) | > loss_mel: 24.297630310058594 (21.44088830703344) | > loss_duration: 1.5482980012893677 (1.5046009895129084) | > loss_1: 31.84487533569336 (30.96448941108508) | > grad_norm_1: tensor(14238.8623, device='cuda:0') (tensor(23448.7754, device='cuda:0')) | > current_lr_0: 0.00012524704089663985 | > current_lr_1: 0.00012524704089663985 | > step_time: 0.6627 (0.5047481549091828) | > loader_time: 0.0232 (0.02056553424933018)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5553274154663086 (2.5553274154663086) | > loss_disc_real_0: 0.1629948914051056 (0.1629948914051056) | > loss_disc_real_1: 0.3147728741168976 (0.3147728741168976) | > loss_disc_real_2: 0.27444958686828613 (0.27444958686828613) | > loss_disc_real_3: 0.2321578413248062 (0.2321578413248062) | > loss_disc_real_4: 0.19543926417827606 (0.19543926417827606) | > loss_disc_real_5: 0.16433659195899963 (0.16433659195899963) | > loss_0: 2.5553274154663086 (2.5553274154663086) | > loss_gen: 1.972610592842102 (1.972610592842102) | > loss_kl: 3.8562114238739014 (3.8562114238739014) | > loss_feat: 3.3675222396850586 (3.3675222396850586) | > loss_mel: 20.075624465942383 (20.075624465942383) | > loss_duration: 2.6218678951263428 (2.6218678951263428) | > loss_1: 31.893836975097656 (31.893836975097656)  --> STEP: 1 | > loss_disc: 2.1137657165527344 (2.1137657165527344) | > loss_disc_real_0: 0.14858955144882202 (0.14858955144882202) | > loss_disc_real_1: 0.21355973184108734 (0.21355973184108734) | > loss_disc_real_2: 0.2094157636165619 (0.2094157636165619) | > loss_disc_real_3: 0.1436840146780014 (0.1436840146780014) | > loss_disc_real_4: 0.22605673968791962 (0.22605673968791962) | > loss_disc_real_5: 0.08351380378007889 (0.08351380378007889) | > loss_0: 2.1137657165527344 (2.1137657165527344) | > loss_gen: 2.2822506427764893 (2.2822506427764893) | > loss_kl: 3.562704563140869 (3.562704563140869) | > loss_feat: 6.6619415283203125 (6.6619415283203125) | > loss_mel: 25.981290817260742 (25.981290817260742) | > loss_duration: 2.7867400646209717 (2.7867400646209717) | > loss_1: 41.274925231933594 (41.274925231933594)  --> STEP: 2 | > loss_disc: 1.8308051824569702 (1.9722854495048523) | > loss_disc_real_0: 0.27323824167251587 (0.21091389656066895) | > loss_disc_real_1: 0.08936494588851929 (0.15146233886480331) | > loss_disc_real_2: 0.14237162470817566 (0.17589369416236877) | > loss_disc_real_3: 0.10500558465719223 (0.12434479966759682) | > loss_disc_real_4: 0.15053622424602509 (0.18829648196697235) | > loss_disc_real_5: 0.138864666223526 (0.11118923500180244) | > loss_0: 1.8308051824569702 (1.9722854495048523) | > loss_gen: 2.958866834640503 (2.620558738708496) | > loss_kl: 3.9263498783111572 (3.744527220726013) | > loss_feat: 8.889957427978516 (7.775949478149414) | > loss_mel: 27.278385162353516 (26.62983798980713) | > loss_duration: 2.6978814601898193 (2.7423107624053955) | > loss_1: 45.75143814086914 (43.51318168640137)  --> STEP: 3 | > loss_disc: 1.8724968433380127 (1.9390225807825725) | > loss_disc_real_0: 0.04066449776291847 (0.15416409696141878) | > loss_disc_real_1: 0.1650955080986023 (0.15600672860940298) | > loss_disc_real_2: 0.1777026653289795 (0.176496684551239) | > loss_disc_real_3: 0.19908396899700165 (0.14925785611073175) | > loss_disc_real_4: 0.11281795054674149 (0.16313697149356207) | > loss_disc_real_5: 0.09122290462255478 (0.10453379154205322) | > loss_0: 1.8724968433380127 (1.9390225807825725) | > loss_gen: 2.6355340480804443 (2.6255505084991455) | > loss_kl: 2.287412405014038 (3.258822282155355) | > loss_feat: 7.4166364669799805 (7.6561784744262695) | > loss_mel: 27.732702255249023 (26.997459411621094) | > loss_duration: 2.6293258666992188 (2.7046491305033364) | > loss_1: 42.70161056518555 (43.24265797932943) --> EVAL PERFORMANCE | > avg_loader_time: 0.023337682088216145 (+0.01330431302388509) | > avg_loss_disc: 1.9390225807825725 (-0.36306639512379957) | > avg_loss_disc_real_0: 0.15416409696141878 (-0.06759334479769072) | > avg_loss_disc_real_1: 0.15600672860940298 (-0.07350102563699085) | > avg_loss_disc_real_2: 0.176496684551239 (-0.08609887460867566) | > avg_loss_disc_real_3: 0.14925785611073175 (-0.09544227768977484) | > avg_loss_disc_real_4: 0.16313697149356207 (-0.07495811333258945) | > avg_loss_disc_real_5: 0.10453379154205322 (-0.17158744235833484) | > avg_loss_0: 1.9390225807825725 (-0.36306639512379957) | > avg_loss_gen: 2.6255505084991455 (-0.4174116452534995) | > avg_loss_kl: 3.258822282155355 (-0.016352057456970215) | > avg_loss_feat: 7.6561784744262695 (-0.04369306564331055) | > avg_loss_mel: 26.997459411621094 (+1.3156909942626953) | > avg_loss_duration: 2.7046491305033364 (-0.013582229614257812) | > avg_loss_1: 43.24265797932943 (+0.8246498107910156)  > EPOCH: 469/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:49:12)   --> TIME: 2023-10-20 04:49:25 -- STEP: 19/50 -- GLOBAL_STEP: 76470 | > loss_disc: 1.7780616283416748 (2.3659541042227494) | > loss_disc_real_0: 0.088001549243927 (0.16390731381742576) | > loss_disc_real_1: 0.16657337546348572 (0.22945399543172434) | > loss_disc_real_2: 0.19503848254680634 (0.22933592902202354) | > loss_disc_real_3: 0.08939442038536072 (0.22593026642540567) | > loss_disc_real_4: 0.10919322818517685 (0.22215435653924942) | > loss_disc_real_5: 0.0354837030172348 (0.22619474208668658) | > loss_0: 1.7780616283416748 (2.3659541042227494) | > grad_norm_0: tensor(438.3849, device='cuda:0') (tensor(452.4763, device='cuda:0')) | > loss_gen: 2.232095956802368 (2.4262149522179053) | > loss_kl: 0.8903953433036804 (0.8205248493897287) | > loss_feat: 7.323742866516113 (5.507379997717707) | > loss_mel: 22.822250366210938 (23.132836693211605) | > loss_duration: 1.6379495859146118 (1.5557336869992708) | > loss_1: 34.906436920166016 (33.44269059833727) | > grad_norm_1: tensor(17619.1250, device='cuda:0') (tensor(23324.9023, device='cuda:0')) | > current_lr_0: 0.00012512184863762682 | > current_lr_1: 0.00012512184863762682 | > step_time: 0.2975 (0.4260028286984092) | > loader_time: 0.0021 (0.010766292873181794)  --> TIME: 2023-10-20 04:49:42 -- STEP: 49/50 -- GLOBAL_STEP: 76500 | > loss_disc: 3.419339179992676 (2.4612895590918398) | > loss_disc_real_0: 0.9998261332511902 (0.18482401469076165) | > loss_disc_real_1: 0.19843541085720062 (0.2252903519084259) | > loss_disc_real_2: 0.3283870220184326 (0.22732763159639982) | > loss_disc_real_3: 0.21793770790100098 (0.2448824420001129) | > loss_disc_real_4: 0.3500652611255646 (0.22150949479974047) | > loss_disc_real_5: 0.6148161888122559 (0.2171550673071523) | > loss_0: 3.419339179992676 (2.4612895590918398) | > grad_norm_0: tensor(2172.7561, device='cuda:0') (tensor(620.3214, device='cuda:0')) | > loss_gen: 2.901573419570923 (2.3838581795595126) | > loss_kl: 0.5555112361907959 (0.845715736856266) | > loss_feat: 3.064345359802246 (5.468248056513922) | > loss_mel: 22.816814422607422 (22.05720446061115) | > loss_duration: 1.662286400794983 (1.5192766432859466) | > loss_1: 31.000530242919922 (32.27430304702447) | > grad_norm_1: tensor(8893.4443, device='cuda:0') (tensor(19141.1035, device='cuda:0')) | > current_lr_0: 0.00012512184863762682 | > current_lr_1: 0.00012512184863762682 | > step_time: 0.6194 (0.4975601945604597) | > loader_time: 0.4073 (0.021727469502663126)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1497268676757812 (3.1497268676757812) | > loss_disc_real_0: 0.6511545777320862 (0.6511545777320862) | > loss_disc_real_1: 0.3270382285118103 (0.3270382285118103) | > loss_disc_real_2: 0.3335798680782318 (0.3335798680782318) | > loss_disc_real_3: 0.3695576786994934 (0.3695576786994934) | > loss_disc_real_4: 0.24235296249389648 (0.24235296249389648) | > loss_disc_real_5: 0.23057344555854797 (0.23057344555854797) | > loss_0: 3.1497268676757812 (3.1497268676757812) | > loss_gen: 3.6353297233581543 (3.6353297233581543) | > loss_kl: 2.4645893573760986 (2.4645893573760986) | > loss_feat: 8.29725456237793 (8.29725456237793) | > loss_mel: 25.55276870727539 (25.55276870727539) | > loss_duration: 2.4812498092651367 (2.4812498092651367) | > loss_1: 42.43119430541992 (42.43119430541992)  --> STEP: 1 | > loss_disc: 2.7142298221588135 (2.7142298221588135) | > loss_disc_real_0: 0.11015152931213379 (0.11015152931213379) | > loss_disc_real_1: 0.3048713505268097 (0.3048713505268097) | > loss_disc_real_2: 0.2018241137266159 (0.2018241137266159) | > loss_disc_real_3: 0.2456521987915039 (0.2456521987915039) | > loss_disc_real_4: 0.2436150759458542 (0.2436150759458542) | > loss_disc_real_5: 0.4106499254703522 (0.4106499254703522) | > loss_0: 2.7142298221588135 (2.7142298221588135) | > loss_gen: 2.0053136348724365 (2.0053136348724365) | > loss_kl: 3.644829511642456 (3.644829511642456) | > loss_feat: 2.771280288696289 (2.771280288696289) | > loss_mel: 23.475444793701172 (23.475444793701172) | > loss_duration: 2.8105599880218506 (2.8105599880218506) | > loss_1: 34.707427978515625 (34.707427978515625)  --> STEP: 2 | > loss_disc: 3.1671433448791504 (2.940686583518982) | > loss_disc_real_0: 0.39385849237442017 (0.252005010843277) | > loss_disc_real_1: 0.26321449875831604 (0.28404292464256287) | > loss_disc_real_2: 0.36905571818351746 (0.2854399159550667) | > loss_disc_real_3: 0.2979606091976166 (0.27180640399456024) | > loss_disc_real_4: 0.2991905212402344 (0.2714027985930443) | > loss_disc_real_5: 0.45411819219589233 (0.43238405883312225) | > loss_0: 3.1671433448791504 (2.940686583518982) | > loss_gen: 2.2341182231903076 (2.119715929031372) | > loss_kl: 4.185525417327881 (3.9151774644851685) | > loss_feat: 1.5320420265197754 (2.1516611576080322) | > loss_mel: 22.98666000366211 (23.23105239868164) | > loss_duration: 2.6476361751556396 (2.729098081588745) | > loss_1: 33.58597946166992 (34.14670372009277)  --> STEP: 3 | > loss_disc: 2.886219024658203 (2.922530730565389) | > loss_disc_real_0: 0.4031398296356201 (0.30238328377405804) | > loss_disc_real_1: 0.3595947027206421 (0.3092268506685893) | > loss_disc_real_2: 0.296234130859375 (0.2890379875898361) | > loss_disc_real_3: 0.25513333082199097 (0.26624871293703717) | > loss_disc_real_4: 0.3369373679161072 (0.29324765503406525) | > loss_disc_real_5: 0.40744492411613464 (0.4240710139274597) | > loss_0: 2.886219024658203 (2.922530730565389) | > loss_gen: 2.6448843479156494 (2.2947720686594644) | > loss_kl: 1.6017035245895386 (3.1440194845199585) | > loss_feat: 2.3654773235321045 (2.222933212916056) | > loss_mel: 23.220191955566406 (23.227432250976562) | > loss_duration: 2.6268532276153564 (2.6950164635976157) | > loss_1: 32.459110260009766 (33.58417256673177) --> EVAL PERFORMANCE | > avg_loader_time: 0.006023009618123372 (-0.017314672470092773) | > avg_loss_disc: 2.922530730565389 (+0.9835081497828166) | > avg_loss_disc_real_0: 0.30238328377405804 (+0.14821918681263926) | > avg_loss_disc_real_1: 0.3092268506685893 (+0.1532201220591863) | > avg_loss_disc_real_2: 0.2890379875898361 (+0.1125413030385971) | > avg_loss_disc_real_3: 0.26624871293703717 (+0.11699085682630542) | > avg_loss_disc_real_4: 0.29324765503406525 (+0.13011068354050317) | > avg_loss_disc_real_5: 0.4240710139274597 (+0.3195372223854065) | > avg_loss_0: 2.922530730565389 (+0.9835081497828166) | > avg_loss_gen: 2.2947720686594644 (-0.33077843983968114) | > avg_loss_kl: 3.1440194845199585 (-0.11480279763539647) | > avg_loss_feat: 2.222933212916056 (-5.433245261510214) | > avg_loss_mel: 23.227432250976562 (-3.7700271606445312) | > avg_loss_duration: 2.6950164635976157 (-0.009632666905720733) | > avg_loss_1: 33.58417256673177 (-9.658485412597656)  > EPOCH: 470/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:49:51)   --> TIME: 2023-10-20 04:50:09 -- STEP: 29/50 -- GLOBAL_STEP: 76530 | > loss_disc: 2.7664389610290527 (2.4578854256662828) | > loss_disc_real_0: 0.10786844789981842 (0.12115321231299434) | > loss_disc_real_1: 0.19387948513031006 (0.22170301539630727) | > loss_disc_real_2: 0.10052686184644699 (0.221786180061513) | > loss_disc_real_3: 0.19242091476917267 (0.2573651282181) | > loss_disc_real_4: 0.11607930064201355 (0.2016722783446312) | > loss_disc_real_5: 0.22795160114765167 (0.22428625706454802) | > loss_0: 2.7664389610290527 (2.4578854256662828) | > grad_norm_0: tensor(489.8089, device='cuda:0') (tensor(686.9002, device='cuda:0')) | > loss_gen: 1.4114660024642944 (2.3183055746144263) | > loss_kl: 0.7455957531929016 (0.9783107093695939) | > loss_feat: 1.5760473012924194 (5.546596548166768) | > loss_mel: 18.264860153198242 (23.01676691400594) | > loss_duration: 1.5075541734695435 (1.533626075448661) | > loss_1: 23.505525588989258 (33.39360570907592) | > grad_norm_1: tensor(4806.7090, device='cuda:0') (tensor(21754.8262, device='cuda:0')) | > current_lr_0: 0.00012499678151611486 | > current_lr_1: 0.00012499678151611486 | > step_time: 0.2602 (0.43862326391812023) | > loader_time: 0.0032 (0.015376658275209627)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8787784576416016 (2.8787784576416016) | > loss_disc_real_0: 0.3570683002471924 (0.3570683002471924) | > loss_disc_real_1: 0.2167779952287674 (0.2167779952287674) | > loss_disc_real_2: 0.2572186589241028 (0.2572186589241028) | > loss_disc_real_3: 0.2985721528530121 (0.2985721528530121) | > loss_disc_real_4: 0.22018569707870483 (0.22018569707870483) | > loss_disc_real_5: 0.20472466945648193 (0.20472466945648193) | > loss_0: 2.8787784576416016 (2.8787784576416016) | > loss_gen: 1.8965778350830078 (1.8965778350830078) | > loss_kl: 2.8172364234924316 (2.8172364234924316) | > loss_feat: 1.3859939575195312 (1.3859939575195312) | > loss_mel: 21.222240447998047 (21.222240447998047) | > loss_duration: 2.5819759368896484 (2.5819759368896484) | > loss_1: 29.904024124145508 (29.904024124145508)  --> STEP: 1 | > loss_disc: 2.9483394622802734 (2.9483394622802734) | > loss_disc_real_0: 0.35078930854797363 (0.35078930854797363) | > loss_disc_real_1: 0.21761886775493622 (0.21761886775493622) | > loss_disc_real_2: 0.248356431722641 (0.248356431722641) | > loss_disc_real_3: 0.28789928555488586 (0.28789928555488586) | > loss_disc_real_4: 0.27165451645851135 (0.27165451645851135) | > loss_disc_real_5: 0.26288169622421265 (0.26288169622421265) | > loss_0: 2.9483394622802734 (2.9483394622802734) | > loss_gen: 1.7412328720092773 (1.7412328720092773) | > loss_kl: 3.451524257659912 (3.451524257659912) | > loss_feat: 0.32622164487838745 (0.32622164487838745) | > loss_mel: 6.958921432495117 (6.958921432495117) | > loss_duration: 2.8838233947753906 (2.8838233947753906) | > loss_1: 15.361723899841309 (15.361723899841309)  --> STEP: 2 | > loss_disc: 3.2767786979675293 (3.1125590801239014) | > loss_disc_real_0: 0.4067898988723755 (0.37878960371017456) | > loss_disc_real_1: 0.21865834295749664 (0.21813860535621643) | > loss_disc_real_2: 0.32203981280326843 (0.2851981222629547) | > loss_disc_real_3: 0.2845456302165985 (0.2862224578857422) | > loss_disc_real_4: 0.2898184061050415 (0.28073646128177643) | > loss_disc_real_5: 0.25721263885498047 (0.26004716753959656) | > loss_0: 3.2767786979675293 (3.1125590801239014) | > loss_gen: 1.5879710912704468 (1.664601981639862) | > loss_kl: 4.785521984100342 (4.118523120880127) | > loss_feat: 0.8380961418151855 (0.5821588933467865) | > loss_mel: 17.6206111907959 (12.289766311645508) | > loss_duration: 2.79775071144104 (2.8407870531082153) | > loss_1: 27.62994956970215 (21.49583673477173)  --> STEP: 3 | > loss_disc: 2.1788463592529297 (2.801321506500244) | > loss_disc_real_0: 0.17783920466899872 (0.31180613736311596) | > loss_disc_real_1: 0.16453605890274048 (0.20027108987172446) | > loss_disc_real_2: 0.15211014449596405 (0.24083546300729117) | > loss_disc_real_3: 0.1433820277452469 (0.23860898117224374) | > loss_disc_real_4: 0.12343450635671616 (0.22830247630675635) | > loss_disc_real_5: 0.17060546576976776 (0.23023326694965363) | > loss_0: 2.1788463592529297 (2.801321506500244) | > loss_gen: 2.3919739723205566 (1.9070593118667603) | > loss_kl: 1.7509901523590088 (3.329345464706421) | > loss_feat: 6.149360179901123 (2.437892655531565) | > loss_mel: 22.168603897094727 (15.582712173461914) | > loss_duration: 2.6507644653320312 (2.777446190516154) | > loss_1: 35.1116943359375 (26.03445593516032) --> EVAL PERFORMANCE | > avg_loader_time: 0.0064351558685302734 (+0.00041214625040690133) | > avg_loss_disc: 2.801321506500244 (-0.121209224065145) | > avg_loss_disc_real_0: 0.31180613736311596 (+0.009422853589057922) | > avg_loss_disc_real_1: 0.20027108987172446 (-0.10895576079686484) | > avg_loss_disc_real_2: 0.24083546300729117 (-0.04820252458254495) | > avg_loss_disc_real_3: 0.23860898117224374 (-0.027639731764793424) | > avg_loss_disc_real_4: 0.22830247630675635 (-0.0649451787273089) | > avg_loss_disc_real_5: 0.23023326694965363 (-0.1938377469778061) | > avg_loss_0: 2.801321506500244 (-0.121209224065145) | > avg_loss_gen: 1.9070593118667603 (-0.3877127567927041) | > avg_loss_kl: 3.329345464706421 (+0.1853259801864624) | > avg_loss_feat: 2.437892655531565 (+0.21495944261550903) | > avg_loss_mel: 15.582712173461914 (-7.644720077514648) | > avg_loss_duration: 2.777446190516154 (+0.08242972691853812) | > avg_loss_1: 26.03445593516032 (-7.549716631571453)  > EPOCH: 471/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:50:30)   --> TIME: 2023-10-20 04:50:40 -- STEP: 9/50 -- GLOBAL_STEP: 76560 | > loss_disc: 2.884610652923584 (2.3820243411593967) | > loss_disc_real_0: 0.13448479771614075 (0.13747695036646393) | > loss_disc_real_1: 0.4822564423084259 (0.2262403377228313) | > loss_disc_real_2: 0.3958909511566162 (0.23029478059874642) | > loss_disc_real_3: 0.3748862147331238 (0.23613127445181212) | > loss_disc_real_4: 0.3922934830188751 (0.2444869933856858) | > loss_disc_real_5: 0.29781603813171387 (0.24322383188539082) | > loss_0: 2.884610652923584 (2.3820243411593967) | > grad_norm_0: tensor(294.5396, device='cuda:0') (tensor(513.5772, device='cuda:0')) | > loss_gen: 2.553922653198242 (2.5453547769122653) | > loss_kl: 1.149838924407959 (0.7405608826213412) | > loss_feat: 3.5571742057800293 (5.914711291591327) | > loss_mel: 23.132186889648438 (18.971820672353108) | > loss_duration: 1.4711506366729736 (1.5202267699771457) | > loss_1: 31.864273071289062 (29.692674954732258) | > grad_norm_1: tensor(4019.3379, device='cuda:0') (tensor(33984.2070, device='cuda:0')) | > current_lr_0: 0.00012487183940702127 | > current_lr_1: 0.00012487183940702127 | > step_time: 0.324 (0.5907610257466634) | > loader_time: 0.0249 (0.019474930233425565)  --> TIME: 2023-10-20 04:50:56 -- STEP: 39/50 -- GLOBAL_STEP: 76590 | > loss_disc: 2.9859390258789062 (2.4821796906300073) | > loss_disc_real_0: 0.08239851146936417 (0.14176162446920684) | > loss_disc_real_1: 0.22851593792438507 (0.23352119493751955) | > loss_disc_real_2: 0.2960950434207916 (0.24552541570021555) | > loss_disc_real_3: 0.25900334119796753 (0.24822577115339348) | > loss_disc_real_4: 0.2753960192203522 (0.2212453397611777) | > loss_disc_real_5: 0.37144723534584045 (0.23375326824875978) | > loss_0: 2.9859390258789062 (2.4821796906300073) | > grad_norm_0: tensor(855.7396, device='cuda:0') (tensor(756.5316, device='cuda:0')) | > loss_gen: 1.6898982524871826 (2.3109700312981234) | > loss_kl: 0.7172352075576782 (0.8025319217107234) | > loss_feat: 0.3930523991584778 (4.7515510118160496) | > loss_mel: 7.570996284484863 (21.460325999137684) | > loss_duration: 1.5656346082687378 (1.5165153802969515) | > loss_1: 11.936817169189453 (30.84189439431215) | > grad_norm_1: tensor(9229.6348, device='cuda:0') (tensor(23862.1328, device='cuda:0')) | > current_lr_0: 0.00012487183940702127 | > current_lr_1: 0.00012487183940702127 | > step_time: 0.3306 (0.5174700663639951) | > loader_time: 0.0251 (0.018499172650850732)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0672221183776855 (3.0672221183776855) | > loss_disc_real_0: 0.24518990516662598 (0.24518990516662598) | > loss_disc_real_1: 0.27844786643981934 (0.27844786643981934) | > loss_disc_real_2: 0.20378273725509644 (0.20378273725509644) | > loss_disc_real_3: 0.17175345122814178 (0.17175345122814178) | > loss_disc_real_4: 0.3155789375305176 (0.3155789375305176) | > loss_disc_real_5: 0.1472572684288025 (0.1472572684288025) | > loss_0: 3.0672221183776855 (3.0672221183776855) | > loss_gen: 1.5496150255203247 (1.5496150255203247) | > loss_kl: 2.823756217956543 (2.823756217956543) | > loss_feat: 5.605682849884033 (5.605682849884033) | > loss_mel: 22.062685012817383 (22.062685012817383) | > loss_duration: 2.5060036182403564 (2.5060036182403564) | > loss_1: 34.54774475097656 (34.54774475097656)  --> STEP: 1 | > loss_disc: 2.5858278274536133 (2.5858278274536133) | > loss_disc_real_0: 0.10156683623790741 (0.10156683623790741) | > loss_disc_real_1: 0.2898469567298889 (0.2898469567298889) | > loss_disc_real_2: 0.16666854918003082 (0.16666854918003082) | > loss_disc_real_3: 0.38716888427734375 (0.38716888427734375) | > loss_disc_real_4: 0.2106577605009079 (0.2106577605009079) | > loss_disc_real_5: 0.2250649780035019 (0.2250649780035019) | > loss_0: 2.5858278274536133 (2.5858278274536133) | > loss_gen: 2.225980043411255 (2.225980043411255) | > loss_kl: 3.7797765731811523 (3.7797765731811523) | > loss_feat: 6.714139938354492 (6.714139938354492) | > loss_mel: 21.176376342773438 (21.176376342773438) | > loss_duration: 2.6889889240264893 (2.6889889240264893) | > loss_1: 36.58525848388672 (36.58525848388672)  --> STEP: 2 | > loss_disc: 2.915815830230713 (2.750821828842163) | > loss_disc_real_0: 0.20361360907554626 (0.15259022265672684) | > loss_disc_real_1: 0.11409460753202438 (0.20197078213095665) | > loss_disc_real_2: 0.11578454822301865 (0.14122654870152473) | > loss_disc_real_3: 0.26422375440597534 (0.32569631934165955) | > loss_disc_real_4: 0.1773516833782196 (0.19400472193956375) | > loss_disc_real_5: 0.2045988142490387 (0.2148318961262703) | > loss_0: 2.915815830230713 (2.750821828842163) | > loss_gen: 1.5134984254837036 (1.8697392344474792) | > loss_kl: 5.249604225158691 (4.514690399169922) | > loss_feat: 8.61030101776123 (7.662220478057861) | > loss_mel: 25.017230987548828 (23.096803665161133) | > loss_duration: 2.6802215576171875 (2.6846052408218384) | > loss_1: 43.070858001708984 (39.82805824279785)  --> STEP: 3 | > loss_disc: 2.509115695953369 (2.670253117879232) | > loss_disc_real_0: 0.2630792260169983 (0.18941989044348398) | > loss_disc_real_1: 0.19356781244277954 (0.1991697922348976) | > loss_disc_real_2: 0.2028241902589798 (0.16175909588734308) | > loss_disc_real_3: 0.2684516906738281 (0.3066147764523824) | > loss_disc_real_4: 0.2570819854736328 (0.2150304764509201) | > loss_disc_real_5: 0.2087405025959015 (0.21280143161614737) | > loss_0: 2.509115695953369 (2.670253117879232) | > loss_gen: 2.1515350341796875 (1.9636711676915486) | > loss_kl: 1.773777723312378 (3.6010528405507407) | > loss_feat: 3.7045581340789795 (6.342999696731567) | > loss_mel: 20.357967376708984 (22.183858235677082) | > loss_duration: 2.607602119445801 (2.6589375336964927) | > loss_1: 30.595439910888672 (36.750518798828125) --> EVAL PERFORMANCE | > avg_loader_time: 0.003655592600504557 (-0.0027795632680257163) | > avg_loss_disc: 2.670253117879232 (-0.13106838862101222) | > avg_loss_disc_real_0: 0.18941989044348398 (-0.12238624691963199) | > avg_loss_disc_real_1: 0.1991697922348976 (-0.0011012976368268423) | > avg_loss_disc_real_2: 0.16175909588734308 (-0.07907636711994809) | > avg_loss_disc_real_3: 0.3066147764523824 (+0.06800579528013864) | > avg_loss_disc_real_4: 0.2150304764509201 (-0.013271999855836242) | > avg_loss_disc_real_5: 0.21280143161614737 (-0.017431835333506257) | > avg_loss_0: 2.670253117879232 (-0.13106838862101222) | > avg_loss_gen: 1.9636711676915486 (+0.05661185582478834) | > avg_loss_kl: 3.6010528405507407 (+0.2717073758443198) | > avg_loss_feat: 6.342999696731567 (+3.905107041200002) | > avg_loss_mel: 22.183858235677082 (+6.601146062215168) | > avg_loss_duration: 2.6589375336964927 (-0.11850865681966116) | > avg_loss_1: 36.750518798828125 (+10.716062863667805)  > EPOCH: 472/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:51:13)   --> TIME: 2023-10-20 04:51:27 -- STEP: 19/50 -- GLOBAL_STEP: 76620 | > loss_disc: 2.959400177001953 (2.519122926812423) | > loss_disc_real_0: 0.1743626892566681 (0.13698590380188666) | > loss_disc_real_1: 0.29161572456359863 (0.2583400001259226) | > loss_disc_real_2: 0.29574936628341675 (0.2283945267922) | > loss_disc_real_3: 0.23033253848552704 (0.24415379958717445) | > loss_disc_real_4: 0.2955983281135559 (0.262031336756129) | > loss_disc_real_5: 0.26233553886413574 (0.254783036481393) | > loss_0: 2.959400177001953 (2.519122926812423) | > grad_norm_0: tensor(267.3960, device='cuda:0') (tensor(731.8110, device='cuda:0')) | > loss_gen: 1.5785057544708252 (2.551133005242599) | > loss_kl: 1.0006599426269531 (0.8979599852310983) | > loss_feat: 0.1945318579673767 (5.396708419448451) | > loss_mel: 1.7920585870742798 (22.001748166586225) | > loss_duration: 1.5705680847167969 (1.5490028481734426) | > loss_1: 6.136323928833008 (32.396552888970625) | > grad_norm_1: tensor(21690.8984, device='cuda:0') (tensor(24847.6387, device='cuda:0')) | > current_lr_0: 0.00012474702218538824 | > current_lr_1: 0.00012474702218538824 | > step_time: 0.5106 (0.4834675663395932) | > loader_time: 0.0155 (0.010928015959890265)  --> TIME: 2023-10-20 04:51:43 -- STEP: 49/50 -- GLOBAL_STEP: 76650 | > loss_disc: 2.4758360385894775 (2.4824768937363917) | > loss_disc_real_0: 0.36974653601646423 (0.1309946364894205) | > loss_disc_real_1: 0.2390795201063156 (0.23850633682949202) | > loss_disc_real_2: 0.17067787051200867 (0.21721808049751787) | > loss_disc_real_3: 0.12843678891658783 (0.24220764659801308) | > loss_disc_real_4: 0.2906351387500763 (0.22839299224469126) | > loss_disc_real_5: 0.23573951423168182 (0.22095679225666182) | > loss_0: 2.4758360385894775 (2.4824768937363917) | > grad_norm_0: tensor(1225.1437, device='cuda:0') (tensor(683.3276, device='cuda:0')) | > loss_gen: 2.4193882942199707 (2.4177996139137115) | > loss_kl: 0.5064075589179993 (0.8751452667828725) | > loss_feat: 5.807585716247559 (5.4257445502646116) | > loss_mel: 24.43311882019043 (21.456144802424372) | > loss_duration: 1.67245352268219 (1.5186646738830878) | > loss_1: 34.83895492553711 (31.69349918560106) | > grad_norm_1: tensor(22863.5156, device='cuda:0') (tensor(23160.7441, device='cuda:0')) | > current_lr_0: 0.00012474702218538824 | > current_lr_1: 0.00012474702218538824 | > step_time: 0.4437 (0.48955220592265225) | > loader_time: 0.4239 (0.023284542317293128)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2855384349823 (2.2855384349823) | > loss_disc_real_0: 0.1001909077167511 (0.1001909077167511) | > loss_disc_real_1: 0.14306537806987762 (0.14306537806987762) | > loss_disc_real_2: 0.17034912109375 (0.17034912109375) | > loss_disc_real_3: 0.11168340593576431 (0.11168340593576431) | > loss_disc_real_4: 0.08172514289617538 (0.08172514289617538) | > loss_disc_real_5: 0.2038417011499405 (0.2038417011499405) | > loss_0: 2.2855384349823 (2.2855384349823) | > loss_gen: 2.4555716514587402 (2.4555716514587402) | > loss_kl: 3.619476795196533 (3.619476795196533) | > loss_feat: 8.478089332580566 (8.478089332580566) | > loss_mel: 25.035253524780273 (25.035253524780273) | > loss_duration: 2.67022967338562 (2.67022967338562) | > loss_1: 42.25862121582031 (42.25862121582031)  --> STEP: 1 | > loss_disc: 2.0779869556427 (2.0779869556427) | > loss_disc_real_0: 0.1422528177499771 (0.1422528177499771) | > loss_disc_real_1: 0.13474620878696442 (0.13474620878696442) | > loss_disc_real_2: 0.12736591696739197 (0.12736591696739197) | > loss_disc_real_3: 0.12851060926914215 (0.12851060926914215) | > loss_disc_real_4: 0.24611152708530426 (0.24611152708530426) | > loss_disc_real_5: 0.17018547654151917 (0.17018547654151917) | > loss_0: 2.0779869556427 (2.0779869556427) | > loss_gen: 2.4183030128479004 (2.4183030128479004) | > loss_kl: 4.067605972290039 (4.067605972290039) | > loss_feat: 7.412868499755859 (7.412868499755859) | > loss_mel: 23.581336975097656 (23.581336975097656) | > loss_duration: 3.0232481956481934 (3.0232481956481934) | > loss_1: 40.50336456298828 (40.50336456298828)  --> STEP: 2 | > loss_disc: 2.112759590148926 (2.095373272895813) | > loss_disc_real_0: 0.29374486207962036 (0.21799883991479874) | > loss_disc_real_1: 0.1815234273672104 (0.1581348180770874) | > loss_disc_real_2: 0.15773749351501465 (0.1425517052412033) | > loss_disc_real_3: 0.23217007517814636 (0.18034034222364426) | > loss_disc_real_4: 0.18807940185070038 (0.21709546446800232) | > loss_disc_real_5: 0.07018805295228958 (0.12018676474690437) | > loss_0: 2.112759590148926 (2.095373272895813) | > loss_gen: 2.5278079509735107 (2.4730554819107056) | > loss_kl: 4.385250568389893 (4.226428270339966) | > loss_feat: 8.696158409118652 (8.054513454437256) | > loss_mel: 22.817859649658203 (23.19959831237793) | > loss_duration: 2.844996452331543 (2.934122323989868) | > loss_1: 41.27207565307617 (40.88772010803223)  --> STEP: 3 | > loss_disc: 2.224431037902832 (2.138392527898153) | > loss_disc_real_0: 0.1551317423582077 (0.1970431407292684) | > loss_disc_real_1: 0.19531755149364471 (0.17052906254927316) | > loss_disc_real_2: 0.11457464098930359 (0.13322601715723673) | > loss_disc_real_3: 0.3009883761405945 (0.22055635352929434) | > loss_disc_real_4: 0.17769712209701538 (0.20396268367767334) | > loss_disc_real_5: 0.12406416982412338 (0.12147923310597737) | > loss_0: 2.224431037902832 (2.138392527898153) | > loss_gen: 2.878115653991699 (2.6080755392710366) | > loss_kl: 2.031205654144287 (3.4946873982747397) | > loss_feat: 6.565377235412598 (7.55813471476237) | > loss_mel: 22.938800811767578 (23.11266581217448) | > loss_duration: 2.744215965270996 (2.8708202044169107) | > loss_1: 37.15771484375 (39.64438501993815) --> EVAL PERFORMANCE | > avg_loader_time: 0.010082880655924479 (+0.006427288055419922) | > avg_loss_disc: 2.138392527898153 (-0.5318605899810791) | > avg_loss_disc_real_0: 0.1970431407292684 (+0.007623250285784422) | > avg_loss_disc_real_1: 0.17052906254927316 (-0.02864072968562445) | > avg_loss_disc_real_2: 0.13322601715723673 (-0.028533078730106354) | > avg_loss_disc_real_3: 0.22055635352929434 (-0.08605842292308805) | > avg_loss_disc_real_4: 0.20396268367767334 (-0.011067792773246765) | > avg_loss_disc_real_5: 0.12147923310597737 (-0.09132219851017) | > avg_loss_0: 2.138392527898153 (-0.5318605899810791) | > avg_loss_gen: 2.6080755392710366 (+0.644404371579488) | > avg_loss_kl: 3.4946873982747397 (-0.10636544227600098) | > avg_loss_feat: 7.55813471476237 (+1.2151350180308027) | > avg_loss_mel: 23.11266581217448 (+0.9288075764973982) | > avg_loss_duration: 2.8708202044169107 (+0.211882670720418) | > avg_loss_1: 39.64438501993815 (+2.8938662211100237)  > EPOCH: 473/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:51:53)   --> TIME: 2023-10-20 04:52:10 -- STEP: 29/50 -- GLOBAL_STEP: 76680 | > loss_disc: 1.7155213356018066 (2.482780645633566) | > loss_disc_real_0: 0.07379483431577682 (0.16026129059750457) | > loss_disc_real_1: 0.17224039137363434 (0.21206116149651594) | > loss_disc_real_2: 0.15408746898174286 (0.22804604419346514) | > loss_disc_real_3: 0.21163080632686615 (0.22764023085092677) | > loss_disc_real_4: 0.11959303170442581 (0.20364736483014864) | > loss_disc_real_5: 0.3853909373283386 (0.20553487976049556) | > loss_0: 1.7155213356018066 (2.482780645633566) | > grad_norm_0: tensor(741.7006, device='cuda:0') (tensor(1058.7028, device='cuda:0')) | > loss_gen: 3.664677143096924 (2.1981492741354574) | > loss_kl: 0.8732788562774658 (0.9195255308315672) | > loss_feat: 8.176331520080566 (4.951643461554215) | > loss_mel: 22.518329620361328 (21.713677636508283) | > loss_duration: 1.5217986106872559 (1.5032333423351418) | > loss_1: 36.75441360473633 (31.286229380245867) | > grad_norm_1: tensor(66935.6328, device='cuda:0') (tensor(26142.4746, device='cuda:0')) | > current_lr_0: 0.00012462232972638296 | > current_lr_1: 0.00012462232972638296 | > step_time: 0.2496 (0.41745893708590803) | > loader_time: 0.0031 (0.010080970566848228)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2348854541778564 (2.2348854541778564) | > loss_disc_real_0: 0.13299985229969025 (0.13299985229969025) | > loss_disc_real_1: 0.2782076299190521 (0.2782076299190521) | > loss_disc_real_2: 0.20793940126895905 (0.20793940126895905) | > loss_disc_real_3: 0.2758331000804901 (0.2758331000804901) | > loss_disc_real_4: 0.1918049305677414 (0.1918049305677414) | > loss_disc_real_5: 0.22305959463119507 (0.22305959463119507) | > loss_0: 2.2348854541778564 (2.2348854541778564) | > loss_gen: 2.495201587677002 (2.495201587677002) | > loss_kl: 2.6007869243621826 (2.6007869243621826) | > loss_feat: 5.113375663757324 (5.113375663757324) | > loss_mel: 23.077367782592773 (23.077367782592773) | > loss_duration: 2.503126382827759 (2.503126382827759) | > loss_1: 35.789859771728516 (35.789859771728516)  --> STEP: 1 | > loss_disc: 2.2706620693206787 (2.2706620693206787) | > loss_disc_real_0: 0.025565113872289658 (0.025565113872289658) | > loss_disc_real_1: 0.16599224507808685 (0.16599224507808685) | > loss_disc_real_2: 0.24279677867889404 (0.24279677867889404) | > loss_disc_real_3: 0.2945609390735626 (0.2945609390735626) | > loss_disc_real_4: 0.11764362454414368 (0.11764362454414368) | > loss_disc_real_5: 0.14382673799991608 (0.14382673799991608) | > loss_0: 2.2706620693206787 (2.2706620693206787) | > loss_gen: 2.053640365600586 (2.053640365600586) | > loss_kl: 3.2666802406311035 (3.2666802406311035) | > loss_feat: 6.504085540771484 (6.504085540771484) | > loss_mel: 27.286157608032227 (27.286157608032227) | > loss_duration: 2.96136474609375 (2.96136474609375) | > loss_1: 42.071929931640625 (42.071929931640625)  --> STEP: 2 | > loss_disc: 3.100900173187256 (2.6857811212539673) | > loss_disc_real_0: 0.318438857793808 (0.17200198583304882) | > loss_disc_real_1: 0.3194091022014618 (0.24270067363977432) | > loss_disc_real_2: 0.2508945167064667 (0.24684564769268036) | > loss_disc_real_3: 0.2812668979167938 (0.2879139184951782) | > loss_disc_real_4: 0.21842820942401886 (0.16803591698408127) | > loss_disc_real_5: 0.2694779634475708 (0.20665235072374344) | > loss_0: 3.100900173187256 (2.6857811212539673) | > loss_gen: 1.7490899562835693 (1.9013651609420776) | > loss_kl: 3.9932785034179688 (3.629979372024536) | > loss_feat: 4.708280086517334 (5.606182813644409) | > loss_mel: 28.203792572021484 (27.744975090026855) | > loss_duration: 2.7847676277160645 (2.8730661869049072) | > loss_1: 41.439205169677734 (41.75556755065918)  --> STEP: 3 | > loss_disc: 3.002455234527588 (2.791339159011841) | > loss_disc_real_0: 0.3865286707878113 (0.24351088081796965) | > loss_disc_real_1: 0.37578439712524414 (0.2870619148015976) | > loss_disc_real_2: 0.314619779586792 (0.2694370249907176) | > loss_disc_real_3: 0.2557356357574463 (0.2771878242492676) | > loss_disc_real_4: 0.260501503944397 (0.1988577793041865) | > loss_disc_real_5: 0.2566750943660736 (0.22332659860452017) | > loss_0: 3.002455234527588 (2.791339159011841) | > loss_gen: 1.9338644742965698 (1.912198265393575) | > loss_kl: 2.0493853092193604 (3.103114684422811) | > loss_feat: 0.18319609761238098 (3.7985205749670663) | > loss_mel: 4.511227607727051 (20.00039259592692) | > loss_duration: 2.711207866668701 (2.8191134134928384) | > loss_1: 11.38888168334961 (31.633338928222656) --> EVAL PERFORMANCE | > avg_loader_time: 0.011538108189900717 (+0.0014552275339762381) | > avg_loss_disc: 2.791339159011841 (+0.652946631113688) | > avg_loss_disc_real_0: 0.24351088081796965 (+0.04646774008870125) | > avg_loss_disc_real_1: 0.2870619148015976 (+0.11653285225232443) | > avg_loss_disc_real_2: 0.2694370249907176 (+0.13621100783348086) | > avg_loss_disc_real_3: 0.2771878242492676 (+0.05663147071997324) | > avg_loss_disc_real_4: 0.1988577793041865 (-0.005104904373486846) | > avg_loss_disc_real_5: 0.22332659860452017 (+0.1018473654985428) | > avg_loss_0: 2.791339159011841 (+0.652946631113688) | > avg_loss_gen: 1.912198265393575 (-0.6958772738774617) | > avg_loss_kl: 3.103114684422811 (-0.3915727138519287) | > avg_loss_feat: 3.7985205749670663 (-3.759614139795304) | > avg_loss_mel: 20.00039259592692 (-3.1122732162475586) | > avg_loss_duration: 2.8191134134928384 (-0.051706790924072266) | > avg_loss_1: 31.633338928222656 (-8.011046091715492)  > EPOCH: 474/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:52:31)   --> TIME: 2023-10-20 04:52:40 -- STEP: 9/50 -- GLOBAL_STEP: 76710 | > loss_disc: 2.7564597129821777 (2.7034458584255643) | > loss_disc_real_0: 0.16713771224021912 (0.15768402690688768) | > loss_disc_real_1: 0.23275429010391235 (0.2677718616194195) | > loss_disc_real_2: 0.30912455916404724 (0.3024434612856971) | > loss_disc_real_3: 0.3116477131843567 (0.23565798501173654) | > loss_disc_real_4: 0.1901681274175644 (0.2407350316643715) | > loss_disc_real_5: 0.33728471398353577 (0.21146620354718632) | > loss_0: 2.7564597129821777 (2.7034458584255643) | > grad_norm_0: tensor(2138.3352, device='cuda:0') (tensor(1264.5975, device='cuda:0')) | > loss_gen: 2.218087911605835 (2.479289929072062) | > loss_kl: 1.4163203239440918 (1.010627852545844) | > loss_feat: 4.1272454261779785 (6.894765383667416) | > loss_mel: 21.438274383544922 (23.814809693230522) | > loss_duration: 1.4363635778427124 (1.4839029577043321) | > loss_1: 30.63629150390625 (35.68339580959744) | > grad_norm_1: tensor(17763.4414, device='cuda:0') (tensor(40915.3711, device='cuda:0')) | > current_lr_0: 0.00012449776190529737 | > current_lr_1: 0.00012449776190529737 | > step_time: 0.5852 (0.5128116077846951) | > loader_time: 0.0243 (0.019671387142605253)  --> TIME: 2023-10-20 04:52:55 -- STEP: 39/50 -- GLOBAL_STEP: 76740 | > loss_disc: 3.02782940864563 (2.525765706331302) | > loss_disc_real_0: 0.25775620341300964 (0.1722884947577348) | > loss_disc_real_1: 0.2675779163837433 (0.24311270607778665) | > loss_disc_real_2: 0.2565106153488159 (0.2545981015532446) | > loss_disc_real_3: 0.3067359924316406 (0.22876185880830655) | > loss_disc_real_4: 0.30718740820884705 (0.23911236780576217) | > loss_disc_real_5: 0.25942620635032654 (0.21409046764557177) | > loss_0: 3.02782940864563 (2.525765706331302) | > grad_norm_0: tensor(482.0797, device='cuda:0') (tensor(1579.1890, device='cuda:0')) | > loss_gen: 1.646277904510498 (2.39128544086065) | > loss_kl: 0.4090105891227722 (0.8941237930303965) | > loss_feat: 0.03439544886350632 (5.66436562496118) | > loss_mel: 1.4382665157318115 (23.366078813870747) | > loss_duration: 1.5614782571792603 (1.5017467859463813) | > loss_1: 5.089428901672363 (33.81760031137711) | > grad_norm_1: tensor(75779.9922, device='cuda:0') (tensor(47655.3516, device='cuda:0')) | > current_lr_0: 0.00012449776190529737 | > current_lr_1: 0.00012449776190529737 | > step_time: 0.5769 (0.4937284115033272) | > loader_time: 0.0138 (0.017701809222881615)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.07708740234375 (3.07708740234375) | > loss_disc_real_0: 0.5072689056396484 (0.5072689056396484) | > loss_disc_real_1: 0.26595842838287354 (0.26595842838287354) | > loss_disc_real_2: 0.3002256155014038 (0.3002256155014038) | > loss_disc_real_3: 0.27257776260375977 (0.27257776260375977) | > loss_disc_real_4: 0.30690836906433105 (0.30690836906433105) | > loss_disc_real_5: 0.27162057161331177 (0.27162057161331177) | > loss_0: 3.07708740234375 (3.07708740234375) | > loss_gen: 2.0172829627990723 (2.0172829627990723) | > loss_kl: 2.882009506225586 (2.882009506225586) | > loss_feat: 0.1855139136314392 (0.1855139136314392) | > loss_mel: 11.052172660827637 (11.052172660827637) | > loss_duration: 2.520185947418213 (2.520185947418213) | > loss_1: 18.657163619995117 (18.657163619995117)  --> STEP: 1 | > loss_disc: 2.34201979637146 (2.34201979637146) | > loss_disc_real_0: 0.07879681140184402 (0.07879681140184402) | > loss_disc_real_1: 0.1862552911043167 (0.1862552911043167) | > loss_disc_real_2: 0.1155971884727478 (0.1155971884727478) | > loss_disc_real_3: 0.21235011518001556 (0.21235011518001556) | > loss_disc_real_4: 0.24538257718086243 (0.24538257718086243) | > loss_disc_real_5: 0.2965346872806549 (0.2965346872806549) | > loss_0: 2.34201979637146 (2.34201979637146) | > loss_gen: 2.0925233364105225 (2.0925233364105225) | > loss_kl: 3.664951801300049 (3.664951801300049) | > loss_feat: 6.009423732757568 (6.009423732757568) | > loss_mel: 24.303876876831055 (24.303876876831055) | > loss_duration: 2.8044040203094482 (2.8044040203094482) | > loss_1: 38.875179290771484 (38.875179290771484)  --> STEP: 2 | > loss_disc: 1.3562161922454834 (1.8491179943084717) | > loss_disc_real_0: 0.17624668776988983 (0.12752174958586693) | > loss_disc_real_1: 0.17712055146694183 (0.18168792128562927) | > loss_disc_real_2: 0.15414677560329437 (0.1348719820380211) | > loss_disc_real_3: 0.17674054205417633 (0.19454532861709595) | > loss_disc_real_4: 0.1108715832233429 (0.17812708020210266) | > loss_disc_real_5: 0.09690475463867188 (0.1967197209596634) | > loss_0: 1.3562161922454834 (1.8491179943084717) | > loss_gen: 3.7945971488952637 (2.943560242652893) | > loss_kl: 4.847434997558594 (4.256193399429321) | > loss_feat: 11.092459678649902 (8.550941705703735) | > loss_mel: 25.076173782348633 (24.690025329589844) | > loss_duration: 2.6730282306671143 (2.7387161254882812) | > loss_1: 47.48369216918945 (43.17943572998047)  --> STEP: 3 | > loss_disc: 2.655252456665039 (2.1178294817606607) | > loss_disc_real_0: 0.2896375358104706 (0.18156034499406815) | > loss_disc_real_1: 0.1990482360124588 (0.1874746928612391) | > loss_disc_real_2: 0.21827509999275208 (0.16267302135626474) | > loss_disc_real_3: 0.3023594915866852 (0.23048338294029236) | > loss_disc_real_4: 0.37889364361763 (0.24504926800727844) | > loss_disc_real_5: 0.2920859456062317 (0.2285084625085195) | > loss_0: 2.655252456665039 (2.1178294817606607) | > loss_gen: 2.44089412689209 (2.7760048707326255) | > loss_kl: 1.8421345949172974 (3.4515071312586465) | > loss_feat: 3.166602611541748 (6.756162007649739) | > loss_mel: 13.924240112304688 (21.101430257161457) | > loss_duration: 2.5578622817993164 (2.678431510925293) | > loss_1: 23.931732177734375 (36.76353454589844) --> EVAL PERFORMANCE | > avg_loader_time: 0.020493268966674805 (+0.008955160776774088) | > avg_loss_disc: 2.1178294817606607 (-0.6735096772511802) | > avg_loss_disc_real_0: 0.18156034499406815 (-0.061950535823901504) | > avg_loss_disc_real_1: 0.1874746928612391 (-0.09958722194035849) | > avg_loss_disc_real_2: 0.16267302135626474 (-0.10676400363445285) | > avg_loss_disc_real_3: 0.23048338294029236 (-0.04670444130897522) | > avg_loss_disc_real_4: 0.24504926800727844 (+0.04619148870309195) | > avg_loss_disc_real_5: 0.2285084625085195 (+0.005181863903999329) | > avg_loss_0: 2.1178294817606607 (-0.6735096772511802) | > avg_loss_gen: 2.7760048707326255 (+0.8638066053390505) | > avg_loss_kl: 3.4515071312586465 (+0.3483924468358355) | > avg_loss_feat: 6.756162007649739 (+2.957641432682673) | > avg_loss_mel: 21.101430257161457 (+1.1010376612345354) | > avg_loss_duration: 2.678431510925293 (-0.14068190256754542) | > avg_loss_1: 36.76353454589844 (+5.130195617675781)  > EPOCH: 475/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:53:12)   --> TIME: 2023-10-20 04:53:26 -- STEP: 19/50 -- GLOBAL_STEP: 76770 | > loss_disc: 1.7800545692443848 (2.5559418828863847) | > loss_disc_real_0: 0.01910574361681938 (0.14896304081929357) | > loss_disc_real_1: 0.12336181849241257 (0.22871902428175273) | > loss_disc_real_2: 0.21310237050056458 (0.2691813209339192) | > loss_disc_real_3: 0.13731536269187927 (0.24140396596569763) | > loss_disc_real_4: 0.1461443454027176 (0.27454370417092977) | > loss_disc_real_5: 0.13882990181446075 (0.22580680368762268) | > loss_0: 1.7800545692443848 (2.5559418828863847) | > grad_norm_0: tensor(767.6448, device='cuda:0') (tensor(1393.8094, device='cuda:0')) | > loss_gen: 2.5461130142211914 (2.2757863935671354) | > loss_kl: 1.0211714506149292 (0.9517237575430619) | > loss_feat: 6.509478569030762 (5.220731516417704) | > loss_mel: 23.639223098754883 (21.82056410689103) | > loss_duration: 1.631826400756836 (1.543842271754616) | > loss_1: 35.347808837890625 (31.812648120679352) | > grad_norm_1: tensor(32877.7656, device='cuda:0') (tensor(40182.1289, device='cuda:0')) | > current_lr_0: 0.00012437331859754805 | > current_lr_1: 0.00012437331859754805 | > step_time: 0.2563 (0.46751078806425395) | > loader_time: 0.0026 (0.012115742030896638)  --> TIME: 2023-10-20 04:53:41 -- STEP: 49/50 -- GLOBAL_STEP: 76800 | > loss_disc: 2.8777098655700684 (2.470646079705686) | > loss_disc_real_0: 0.1936851143836975 (0.15995140092409388) | > loss_disc_real_1: 0.24743211269378662 (0.21940087804532782) | > loss_disc_real_2: 0.3328268229961395 (0.22270936085557452) | > loss_disc_real_3: 0.36899474263191223 (0.2367392154980679) | > loss_disc_real_4: 0.26977622509002686 (0.22949358140479545) | > loss_disc_real_5: 0.2927853465080261 (0.22068937486797877) | > loss_0: 2.8777098655700684 (2.470646079705686) | > grad_norm_0: tensor(1250.1984, device='cuda:0') (tensor(1220.6779, device='cuda:0')) | > loss_gen: 2.126666307449341 (2.2426079487314037) | > loss_kl: 0.6751241087913513 (0.8908028274166341) | > loss_feat: 1.42610502243042 (4.99527358324552) | > loss_mel: 22.094188690185547 (21.725229282768407) | > loss_duration: 1.6492531299591064 (1.5047783267741301) | > loss_1: 27.971338272094727 (31.35869197456204) | > grad_norm_1: tensor(4390.2212, device='cuda:0') (tensor(35581.1797, device='cuda:0')) | > current_lr_0: 0.00012437331859754805 | > current_lr_1: 0.00012437331859754805 | > step_time: 0.2841 (0.4766520967288893) | > loader_time: 0.5204 (0.02422132784006547)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3869521617889404 (2.3869521617889404) | > loss_disc_real_0: 0.10725846886634827 (0.10725846886634827) | > loss_disc_real_1: 0.2758016586303711 (0.2758016586303711) | > loss_disc_real_2: 0.23781731724739075 (0.23781731724739075) | > loss_disc_real_3: 0.2682803273200989 (0.2682803273200989) | > loss_disc_real_4: 0.2029348909854889 (0.2029348909854889) | > loss_disc_real_5: 0.17799484729766846 (0.17799484729766846) | > loss_0: 2.3869521617889404 (2.3869521617889404) | > loss_gen: 2.07352352142334 (2.07352352142334) | > loss_kl: 3.5403292179107666 (3.5403292179107666) | > loss_feat: 3.1329522132873535 (3.1329522132873535) | > loss_mel: 18.57183265686035 (18.57183265686035) | > loss_duration: 2.6640589237213135 (2.6640589237213135) | > loss_1: 29.982696533203125 (29.982696533203125)  --> STEP: 1 | > loss_disc: 2.8597500324249268 (2.8597500324249268) | > loss_disc_real_0: 0.1957983374595642 (0.1957983374595642) | > loss_disc_real_1: 0.3490178883075714 (0.3490178883075714) | > loss_disc_real_2: 0.27420786023139954 (0.27420786023139954) | > loss_disc_real_3: 0.32411977648735046 (0.32411977648735046) | > loss_disc_real_4: 0.28042763471603394 (0.28042763471603394) | > loss_disc_real_5: 0.29354920983314514 (0.29354920983314514) | > loss_0: 2.8597500324249268 (2.8597500324249268) | > loss_gen: 2.102973222732544 (2.102973222732544) | > loss_kl: 3.9376466274261475 (3.9376466274261475) | > loss_feat: 1.9786734580993652 (1.9786734580993652) | > loss_mel: 18.366634368896484 (18.366634368896484) | > loss_duration: 2.987182378768921 (2.987182378768921) | > loss_1: 29.373111724853516 (29.373111724853516)  --> STEP: 2 | > loss_disc: 2.309893846511841 (2.584821939468384) | > loss_disc_real_0: 0.26861703395843506 (0.23220768570899963) | > loss_disc_real_1: 0.20369279384613037 (0.2763553410768509) | > loss_disc_real_2: 0.17634299397468567 (0.2252754271030426) | > loss_disc_real_3: 0.3544211685657501 (0.3392704725265503) | > loss_disc_real_4: 0.18972237408161163 (0.23507500439882278) | > loss_disc_real_5: 0.3357471823692322 (0.31464819610118866) | > loss_0: 2.309893846511841 (2.584821939468384) | > loss_gen: 2.7325985431671143 (2.417785882949829) | > loss_kl: 4.681130409240723 (4.309388518333435) | > loss_feat: 7.070034503936768 (4.524353981018066) | > loss_mel: 24.159040451049805 (21.262837409973145) | > loss_duration: 2.783508062362671 (2.885345220565796) | > loss_1: 41.42631149291992 (35.39971160888672)  --> STEP: 3 | > loss_disc: 2.5567429065704346 (2.575462261835734) | > loss_disc_real_0: 0.11909167468547821 (0.19450234870115915) | > loss_disc_real_1: 0.20139718055725098 (0.25136928757031757) | > loss_disc_real_2: 0.23234765231609344 (0.22763283550739288) | > loss_disc_real_3: 0.25942927598953247 (0.31265674034754437) | > loss_disc_real_4: 0.3100261986255646 (0.2600587358077367) | > loss_disc_real_5: 0.3166523277759552 (0.3153162399927775) | > loss_0: 2.5567429065704346 (2.575462261835734) | > loss_gen: 2.042307138442993 (2.2926263014475503) | > loss_kl: 1.877147912979126 (3.4986416498819985) | > loss_feat: 3.2892143726348877 (4.112640778223674) | > loss_mel: 18.704641342163086 (20.410105387369793) | > loss_duration: 2.6824588775634766 (2.817716439565023) | > loss_1: 28.59576988220215 (33.131731033325195) --> EVAL PERFORMANCE | > avg_loader_time: 0.006740570068359375 (-0.01375269889831543) | > avg_loss_disc: 2.575462261835734 (+0.45763278007507324) | > avg_loss_disc_real_0: 0.19450234870115915 (+0.012942003707091004) | > avg_loss_disc_real_1: 0.25136928757031757 (+0.06389459470907846) | > avg_loss_disc_real_2: 0.22763283550739288 (+0.06495981415112814) | > avg_loss_disc_real_3: 0.31265674034754437 (+0.08217335740725201) | > avg_loss_disc_real_4: 0.2600587358077367 (+0.015009467800458254) | > avg_loss_disc_real_5: 0.3153162399927775 (+0.08680777748425803) | > avg_loss_0: 2.575462261835734 (+0.45763278007507324) | > avg_loss_gen: 2.2926263014475503 (-0.48337856928507517) | > avg_loss_kl: 3.4986416498819985 (+0.04713451862335205) | > avg_loss_feat: 4.112640778223674 (-2.6435212294260655) | > avg_loss_mel: 20.410105387369793 (-0.6913248697916643) | > avg_loss_duration: 2.817716439565023 (+0.13928492863972997) | > avg_loss_1: 33.131731033325195 (-3.631803512573242)  > EPOCH: 476/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:53:52)   --> TIME: 2023-10-20 04:54:09 -- STEP: 29/50 -- GLOBAL_STEP: 76830 | > loss_disc: 1.871506690979004 (2.4319570681144453) | > loss_disc_real_0: 0.15420496463775635 (0.14608534701682374) | > loss_disc_real_1: 0.22154030203819275 (0.228375441940694) | > loss_disc_real_2: 0.1597178429365158 (0.2190249708705935) | > loss_disc_real_3: 0.2863817512989044 (0.23940107778742395) | > loss_disc_real_4: 0.049504101276397705 (0.2170535171854085) | > loss_disc_real_5: 0.1419573873281479 (0.21645699743309926) | > loss_0: 1.871506690979004 (2.4319570681144453) | > grad_norm_0: tensor(842.9664, device='cuda:0') (tensor(1027.7948, device='cuda:0')) | > loss_gen: 2.6229143142700195 (2.322029738590635) | > loss_kl: 0.9649204611778259 (0.8777945067348152) | > loss_feat: 6.177007675170898 (5.331215140120737) | > loss_mel: 22.41970443725586 (21.677425795588) | > loss_duration: 1.489618182182312 (1.5189828913787315) | > loss_1: 33.674163818359375 (31.727448019488104) | > grad_norm_1: tensor(30687.6602, device='cuda:0') (tensor(43660.7812, device='cuda:0')) | > current_lr_0: 0.00012424899967867616 | > current_lr_1: 0.00012424899967867616 | > step_time: 0.3904 (0.45381893782780086) | > loader_time: 0.0068 (0.01528998901104105)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1301043033599854 (2.1301043033599854) | > loss_disc_real_0: 0.19352544844150543 (0.19352544844150543) | > loss_disc_real_1: 0.25497931241989136 (0.25497931241989136) | > loss_disc_real_2: 0.2400420755147934 (0.2400420755147934) | > loss_disc_real_3: 0.11712677031755447 (0.11712677031755447) | > loss_disc_real_4: 0.18975943326950073 (0.18975943326950073) | > loss_disc_real_5: 0.2660965025424957 (0.2660965025424957) | > loss_0: 2.1301043033599854 (2.1301043033599854) | > loss_gen: 2.672729253768921 (2.672729253768921) | > loss_kl: 3.2452034950256348 (3.2452034950256348) | > loss_feat: 8.692959785461426 (8.692959785461426) | > loss_mel: 27.348392486572266 (27.348392486572266) | > loss_duration: 2.520571231842041 (2.520571231842041) | > loss_1: 44.4798583984375 (44.4798583984375)  --> STEP: 1 | > loss_disc: 2.787820816040039 (2.787820816040039) | > loss_disc_real_0: 0.23079821467399597 (0.23079821467399597) | > loss_disc_real_1: 0.2603904902935028 (0.2603904902935028) | > loss_disc_real_2: 0.2360878437757492 (0.2360878437757492) | > loss_disc_real_3: 0.32046568393707275 (0.32046568393707275) | > loss_disc_real_4: 0.2319221943616867 (0.2319221943616867) | > loss_disc_real_5: 0.19528621435165405 (0.19528621435165405) | > loss_0: 2.787820816040039 (2.787820816040039) | > loss_gen: 1.7595481872558594 (1.7595481872558594) | > loss_kl: 3.9916465282440186 (3.9916465282440186) | > loss_feat: 1.0837197303771973 (1.0837197303771973) | > loss_mel: 18.9666748046875 (18.9666748046875) | > loss_duration: 2.853393316268921 (2.853393316268921) | > loss_1: 28.654983520507812 (28.654983520507812)  --> STEP: 2 | > loss_disc: 2.368673324584961 (2.5782470703125) | > loss_disc_real_0: 0.2030068039894104 (0.21690250933170319) | > loss_disc_real_1: 0.2860320508480072 (0.273211270570755) | > loss_disc_real_2: 0.3212689459323883 (0.27867839485406876) | > loss_disc_real_3: 0.21735143661499023 (0.2689085602760315) | > loss_disc_real_4: 0.14194466173648834 (0.18693342804908752) | > loss_disc_real_5: 0.29065871238708496 (0.2429724633693695) | > loss_0: 2.368673324584961 (2.5782470703125) | > loss_gen: 2.8033478260040283 (2.281448006629944) | > loss_kl: 4.021610260009766 (4.006628394126892) | > loss_feat: 5.173381805419922 (3.1285507678985596) | > loss_mel: 29.720996856689453 (24.343835830688477) | > loss_duration: 2.7995049953460693 (2.826449155807495) | > loss_1: 44.51884078979492 (36.58691215515137)  --> STEP: 3 | > loss_disc: 2.556218385696411 (2.5709041754404702) | > loss_disc_real_0: 0.1788337528705597 (0.20421292384465536) | > loss_disc_real_1: 0.24725721776485443 (0.26455991963545483) | > loss_disc_real_2: 0.4135662317276001 (0.32364100714524585) | > loss_disc_real_3: 0.33399906754493713 (0.2906053960323334) | > loss_disc_real_4: 0.37872737646102905 (0.25086474418640137) | > loss_disc_real_5: 0.15222708880901337 (0.21272400518258414) | > loss_0: 2.556218385696411 (2.5709041754404702) | > loss_gen: 2.4859275817871094 (2.3496078650156655) | > loss_kl: 2.0029091835021973 (3.338721990585327) | > loss_feat: 3.5274758338928223 (3.261525789896647) | > loss_mel: 24.788482666015625 (24.49205144246419) | > loss_duration: 2.6212644577026367 (2.758054256439209) | > loss_1: 35.42605972290039 (36.19996134440104) --> EVAL PERFORMANCE | > avg_loader_time: 0.013174295425415039 (+0.006433725357055664) | > avg_loss_disc: 2.5709041754404702 (-0.004558086395263672) | > avg_loss_disc_real_0: 0.20421292384465536 (+0.009710575143496214) | > avg_loss_disc_real_1: 0.26455991963545483 (+0.013190632065137264) | > avg_loss_disc_real_2: 0.32364100714524585 (+0.09600817163785297) | > avg_loss_disc_real_3: 0.2906053960323334 (-0.022051344315210997) | > avg_loss_disc_real_4: 0.25086474418640137 (-0.009193991621335329) | > avg_loss_disc_real_5: 0.21272400518258414 (-0.10259223481019339) | > avg_loss_0: 2.5709041754404702 (-0.004558086395263672) | > avg_loss_gen: 2.3496078650156655 (+0.056981563568115234) | > avg_loss_kl: 3.338721990585327 (-0.1599196592966714) | > avg_loss_feat: 3.261525789896647 (-0.8511149883270268) | > avg_loss_mel: 24.49205144246419 (+4.081946055094399) | > avg_loss_duration: 2.758054256439209 (-0.05966218312581395) | > avg_loss_1: 36.19996134440104 (+3.068230311075844)  > EPOCH: 477/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:54:32)   --> TIME: 2023-10-20 04:54:41 -- STEP: 9/50 -- GLOBAL_STEP: 76860 | > loss_disc: 2.9839115142822266 (2.3479147619671292) | > loss_disc_real_0: 0.20064261555671692 (0.14275235641333792) | > loss_disc_real_1: 0.2547460198402405 (0.26434337513314354) | > loss_disc_real_2: 0.291823148727417 (0.2549086949891514) | > loss_disc_real_3: 0.3162092864513397 (0.2593843291203181) | > loss_disc_real_4: 0.2560296356678009 (0.15916886594560412) | > loss_disc_real_5: 0.2623697817325592 (0.18262302316725254) | > loss_0: 2.9839115142822266 (2.3479147619671292) | > grad_norm_0: tensor(445.8671, device='cuda:0') (tensor(968.4206, device='cuda:0')) | > loss_gen: 1.6087638139724731 (2.6063608858320446) | > loss_kl: 0.8072795271873474 (0.7008433573775821) | > loss_feat: 0.09139983355998993 (6.797350987792016) | > loss_mel: 8.885268211364746 (20.838526513841416) | > loss_duration: 1.4983431100845337 (1.5230677127838135) | > loss_1: 12.8910551071167 (32.46615038977729) | > grad_norm_1: tensor(28596.6641, device='cuda:0') (tensor(60985.1172, device='cuda:0')) | > current_lr_0: 0.00012412480502434718 | > current_lr_1: 0.00012412480502434718 | > step_time: 0.5515 (0.4897379345364041) | > loader_time: 0.0113 (0.021148337258232966)  --> TIME: 2023-10-20 04:54:57 -- STEP: 39/50 -- GLOBAL_STEP: 76890 | > loss_disc: 2.081831932067871 (2.6018305344459334) | > loss_disc_real_0: 0.014687055721879005 (0.1681751154649716) | > loss_disc_real_1: 0.015728099271655083 (0.23555242189039022) | > loss_disc_real_2: 0.005060757044702768 (0.252541370367488) | > loss_disc_real_3: 0.03240027278661728 (0.25310762035541046) | > loss_disc_real_4: 0.016007794067263603 (0.23761118341905943) | > loss_disc_real_5: 0.006665381137281656 (0.22807521517507914) | > loss_0: 2.081831932067871 (2.6018305344459334) | > grad_norm_0: tensor(2546.7195, device='cuda:0') (tensor(1088.9468, device='cuda:0')) | > loss_gen: 1.8322142362594604 (2.2547806348556128) | > loss_kl: 0.5770601630210876 (0.8113084809902387) | > loss_feat: 11.53557300567627 (5.182649928694352) | > loss_mel: 32.07510757446289 (21.77140737191224) | > loss_duration: 1.53113853931427 (1.5042461187411578) | > loss_1: 47.55109405517578 (31.524392494788536) | > grad_norm_1: tensor(102333.6172, device='cuda:0') (tensor(37360.2461, device='cuda:0')) | > current_lr_0: 0.00012412480502434718 | > current_lr_1: 0.00012412480502434718 | > step_time: 0.5426 (0.4909077913333208) | > loader_time: 0.0139 (0.020490426283616286)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.37553334236145 (2.37553334236145) | > loss_disc_real_0: 0.1408064365386963 (0.1408064365386963) | > loss_disc_real_1: 0.2394505739212036 (0.2394505739212036) | > loss_disc_real_2: 0.4502235949039459 (0.4502235949039459) | > loss_disc_real_3: 0.3055938184261322 (0.3055938184261322) | > loss_disc_real_4: 0.28051698207855225 (0.28051698207855225) | > loss_disc_real_5: 0.2034306824207306 (0.2034306824207306) | > loss_0: 2.37553334236145 (2.37553334236145) | > loss_gen: 2.8055977821350098 (2.8055977821350098) | > loss_kl: 3.3630623817443848 (3.3630623817443848) | > loss_feat: 5.156076431274414 (5.156076431274414) | > loss_mel: 23.453685760498047 (23.453685760498047) | > loss_duration: 2.645651340484619 (2.645651340484619) | > loss_1: 37.424076080322266 (37.424076080322266)  --> STEP: 1 | > loss_disc: 1.561606764793396 (1.561606764793396) | > loss_disc_real_0: 0.09832258522510529 (0.09832258522510529) | > loss_disc_real_1: 0.06860838830471039 (0.06860838830471039) | > loss_disc_real_2: 0.06133023649454117 (0.06133023649454117) | > loss_disc_real_3: 0.022056566551327705 (0.022056566551327705) | > loss_disc_real_4: 0.022861037403345108 (0.022861037403345108) | > loss_disc_real_5: 0.014020835049450397 (0.014020835049450397) | > loss_0: 1.561606764793396 (1.561606764793396) | > loss_gen: 2.496837854385376 (2.496837854385376) | > loss_kl: 3.80623459815979 (3.80623459815979) | > loss_feat: 14.680109977722168 (14.680109977722168) | > loss_mel: 27.9508056640625 (27.9508056640625) | > loss_duration: 2.940229892730713 (2.940229892730713) | > loss_1: 51.87421798706055 (51.87421798706055)  --> STEP: 2 | > loss_disc: 3.0075719356536865 (2.2845893502235413) | > loss_disc_real_0: 0.21914823353290558 (0.15873540937900543) | > loss_disc_real_1: 0.2462702840566635 (0.15743933618068695) | > loss_disc_real_2: 0.23111888766288757 (0.14622456207871437) | > loss_disc_real_3: 0.28721657395362854 (0.15463657025247812) | > loss_disc_real_4: 0.25808125734329224 (0.14047114737331867) | > loss_disc_real_5: 0.26390787959098816 (0.13896435732021928) | > loss_0: 3.0075719356536865 (2.2845893502235413) | > loss_gen: 1.5060566663742065 (2.0014472603797913) | > loss_kl: 4.190794467926025 (3.9985145330429077) | > loss_feat: 0.005400372669100761 (7.342755175195634) | > loss_mel: 1.2511029243469238 (14.600954294204712) | > loss_duration: 2.8118677139282227 (2.8760488033294678) | > loss_1: 9.765222549438477 (30.81972026824951)  --> STEP: 3 | > loss_disc: 2.6450448036193848 (2.4047411680221558) | > loss_disc_real_0: 0.3514162302017212 (0.22296234965324402) | > loss_disc_real_1: 0.43003174662590027 (0.24830347299575806) | > loss_disc_real_2: 0.4167596101760864 (0.23640291144450506) | > loss_disc_real_3: 0.3183576464653015 (0.20921026232341924) | > loss_disc_real_4: 0.21775352954864502 (0.1662319414317608) | > loss_disc_real_5: 0.24981896579265594 (0.17591589347769818) | > loss_0: 2.6450448036193848 (2.4047411680221558) | > loss_gen: 2.985440731048584 (2.3294450839360556) | > loss_kl: 1.736329436302185 (3.2444528341293335) | > loss_feat: 3.9729650020599365 (6.219491784150402) | > loss_mel: 22.41256332397461 (17.204823970794678) | > loss_duration: 2.693873882293701 (2.815323829650879) | > loss_1: 33.801170349121094 (31.81353696187337) --> EVAL PERFORMANCE | > avg_loader_time: 0.008272488911946615 (-0.004901806513468424) | > avg_loss_disc: 2.4047411680221558 (-0.16616300741831447) | > avg_loss_disc_real_0: 0.22296234965324402 (+0.018749425808588654) | > avg_loss_disc_real_1: 0.24830347299575806 (-0.016256446639696776) | > avg_loss_disc_real_2: 0.23640291144450506 (-0.08723809570074079) | > avg_loss_disc_real_3: 0.20921026232341924 (-0.08139513370891413) | > avg_loss_disc_real_4: 0.1662319414317608 (-0.08463280275464058) | > avg_loss_disc_real_5: 0.17591589347769818 (-0.03680811170488596) | > avg_loss_0: 2.4047411680221558 (-0.16616300741831447) | > avg_loss_gen: 2.3294450839360556 (-0.020162781079609893) | > avg_loss_kl: 3.2444528341293335 (-0.09426915645599365) | > avg_loss_feat: 6.219491784150402 (+2.957965994253755) | > avg_loss_mel: 17.204823970794678 (-7.287227471669514) | > avg_loss_duration: 2.815323829650879 (+0.05726957321166992) | > avg_loss_1: 31.81353696187337 (-4.386424382527668)  > EPOCH: 478/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:55:14)   --> TIME: 2023-10-20 04:55:27 -- STEP: 19/50 -- GLOBAL_STEP: 76920 | > loss_disc: 2.7654125690460205 (2.435501958194532) | > loss_disc_real_0: 0.05664937570691109 (0.1563312143675591) | > loss_disc_real_1: 0.21302440762519836 (0.21628013410066305) | > loss_disc_real_2: 0.09044481068849564 (0.2216629776123323) | > loss_disc_real_3: 0.21480590105056763 (0.2607458833801119) | > loss_disc_real_4: 0.30094069242477417 (0.24598711356520653) | > loss_disc_real_5: 0.28991174697875977 (0.23964236343377515) | > loss_0: 2.7654125690460205 (2.435501958194532) | > grad_norm_0: tensor(1890.0100, device='cuda:0') (tensor(1084.6215, device='cuda:0')) | > loss_gen: 1.6835860013961792 (2.426388376637509) | > loss_kl: 0.9580875635147095 (0.7142207724483389) | > loss_feat: 2.816471576690674 (5.618316438245146) | > loss_mel: 24.918968200683594 (22.535625922052485) | > loss_duration: 1.6545963287353516 (1.5493293435950029) | > loss_1: 32.031707763671875 (32.84388120550858) | > grad_norm_1: tensor(11051.1602, device='cuda:0') (tensor(47409.5156, device='cuda:0')) | > current_lr_0: 0.00012400073451035096 | > current_lr_1: 0.00012400073451035096 | > step_time: 0.2821 (0.45347695601613897) | > loader_time: 0.0026 (0.008616535287154349)  --> TIME: 2023-10-20 04:55:40 -- STEP: 49/50 -- GLOBAL_STEP: 76950 | > loss_disc: 2.516890048980713 (2.434872449660788) | > loss_disc_real_0: 0.02219981513917446 (0.15727339405566454) | > loss_disc_real_1: 0.2514820694923401 (0.2195693997248095) | > loss_disc_real_2: 0.20495425164699554 (0.21234743323709285) | > loss_disc_real_3: 0.27074164152145386 (0.24189540599377787) | > loss_disc_real_4: 0.15515555441379547 (0.2136000007847134) | > loss_disc_real_5: 0.16479428112506866 (0.2349342153008495) | > loss_0: 2.516890048980713 (2.434872449660788) | > grad_norm_0: tensor(2319.9661, device='cuda:0') (tensor(1191.1970, device='cuda:0')) | > loss_gen: 2.0129990577697754 (2.3575464560061086) | > loss_kl: 0.621493399143219 (0.7809671002383135) | > loss_feat: 3.5018110275268555 (5.426856350989974) | > loss_mel: 19.39507484436035 (22.50529048880752) | > loss_duration: 1.5939308404922485 (1.505273480804599) | > loss_1: 27.125308990478516 (32.575934312781506) | > grad_norm_1: tensor(21719.6738, device='cuda:0') (tensor(44477.2734, device='cuda:0')) | > current_lr_0: 0.00012400073451035096 | > current_lr_1: 0.00012400073451035096 | > step_time: 0.38 (0.4354538868884651) | > loader_time: 0.3563 (0.01964621641197983)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.620103359222412 (2.620103359222412) | > loss_disc_real_0: 0.22125458717346191 (0.22125458717346191) | > loss_disc_real_1: 0.2485354244709015 (0.2485354244709015) | > loss_disc_real_2: 0.22476163506507874 (0.22476163506507874) | > loss_disc_real_3: 0.3105435073375702 (0.3105435073375702) | > loss_disc_real_4: 0.14783518016338348 (0.14783518016338348) | > loss_disc_real_5: 0.1465425342321396 (0.1465425342321396) | > loss_0: 2.620103359222412 (2.620103359222412) | > loss_gen: 1.8174256086349487 (1.8174256086349487) | > loss_kl: 3.3696601390838623 (3.3696601390838623) | > loss_feat: 2.8229079246520996 (2.8229079246520996) | > loss_mel: 10.692536354064941 (10.692536354064941) | > loss_duration: 2.60011625289917 (2.60011625289917) | > loss_1: 21.30264663696289 (21.30264663696289)  --> STEP: 1 | > loss_disc: 2.3265233039855957 (2.3265233039855957) | > loss_disc_real_0: 0.10545007884502411 (0.10545007884502411) | > loss_disc_real_1: 0.20200073719024658 (0.20200073719024658) | > loss_disc_real_2: 0.2838412821292877 (0.2838412821292877) | > loss_disc_real_3: 0.23096971213817596 (0.23096971213817596) | > loss_disc_real_4: 0.1865103542804718 (0.1865103542804718) | > loss_disc_real_5: 0.191927969455719 (0.191927969455719) | > loss_0: 2.3265233039855957 (2.3265233039855957) | > loss_gen: 2.055025339126587 (2.055025339126587) | > loss_kl: 4.5636701583862305 (4.5636701583862305) | > loss_feat: 5.462949275970459 (5.462949275970459) | > loss_mel: 26.40270233154297 (26.40270233154297) | > loss_duration: 2.9606635570526123 (2.9606635570526123) | > loss_1: 41.445011138916016 (41.445011138916016)  --> STEP: 2 | > loss_disc: 2.6805572509765625 (2.503540277481079) | > loss_disc_real_0: 0.10364780575037003 (0.10454894229769707) | > loss_disc_real_1: 0.32160261273384094 (0.26180167496204376) | > loss_disc_real_2: 0.2632395625114441 (0.2735404223203659) | > loss_disc_real_3: 0.3446696698665619 (0.2878196910023689) | > loss_disc_real_4: 0.2256646752357483 (0.20608751475811005) | > loss_disc_real_5: 0.1962098479270935 (0.19406890869140625) | > loss_0: 2.6805572509765625 (2.503540277481079) | > loss_gen: 1.960135579109192 (2.0075804591178894) | > loss_kl: 4.584679126739502 (4.574174642562866) | > loss_feat: 3.192690372467041 (4.32781982421875) | > loss_mel: 26.820167541503906 (26.611434936523438) | > loss_duration: 2.7980566024780273 (2.87936007976532) | > loss_1: 39.35573196411133 (40.40037155151367)  --> STEP: 3 | > loss_disc: 2.6288537979125977 (2.545311450958252) | > loss_disc_real_0: 0.219058096408844 (0.14271866033474603) | > loss_disc_real_1: 0.3419814109802246 (0.2885282536347707) | > loss_disc_real_2: 0.4549836218357086 (0.33402148882548016) | > loss_disc_real_3: 0.31416016817092896 (0.2965998500585556) | > loss_disc_real_4: 0.2458178699016571 (0.21933096647262573) | > loss_disc_real_5: 0.1442624181509018 (0.17746674517790476) | > loss_0: 2.6288537979125977 (2.545311450958252) | > loss_gen: 2.6396398544311523 (2.2182669242223105) | > loss_kl: 2.0157737731933594 (3.7213743527730307) | > loss_feat: 5.52913236618042 (4.728257338205974) | > loss_mel: 22.238855361938477 (25.153908411661785) | > loss_duration: 2.67460298538208 (2.8111077149709067) | > loss_1: 35.09800338745117 (38.63291549682617) --> EVAL PERFORMANCE | > avg_loader_time: 0.015240112940470377 (+0.006967624028523762) | > avg_loss_disc: 2.545311450958252 (+0.1405702829360962) | > avg_loss_disc_real_0: 0.14271866033474603 (-0.08024368931849798) | > avg_loss_disc_real_1: 0.2885282536347707 (+0.040224780639012636) | > avg_loss_disc_real_2: 0.33402148882548016 (+0.0976185773809751) | > avg_loss_disc_real_3: 0.2965998500585556 (+0.08738958773513636) | > avg_loss_disc_real_4: 0.21933096647262573 (+0.053099025040864944) | > avg_loss_disc_real_5: 0.17746674517790476 (+0.0015508517002065791) | > avg_loss_0: 2.545311450958252 (+0.1405702829360962) | > avg_loss_gen: 2.2182669242223105 (-0.11117815971374512) | > avg_loss_kl: 3.7213743527730307 (+0.47692151864369725) | > avg_loss_feat: 4.728257338205974 (-1.4912344459444284) | > avg_loss_mel: 25.153908411661785 (+7.949084440867107) | > avg_loss_duration: 2.8111077149709067 (-0.004216114679972183) | > avg_loss_1: 38.63291549682617 (+6.819378534952801)  > EPOCH: 479/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:55:53)   --> TIME: 2023-10-20 04:56:11 -- STEP: 29/50 -- GLOBAL_STEP: 76980 | > loss_disc: 3.170546531677246 (2.6227354016797295) | > loss_disc_real_0: 0.363806813955307 (0.19391366139311214) | > loss_disc_real_1: 0.23256860673427582 (0.22835505984980484) | > loss_disc_real_2: 0.2419632077217102 (0.22948670875409555) | > loss_disc_real_3: 0.2663012444972992 (0.2585561668564534) | > loss_disc_real_4: 0.2648589313030243 (0.24661777939262058) | > loss_disc_real_5: 0.26988643407821655 (0.2455253166885212) | > loss_0: 3.170546531677246 (2.6227354016797295) | > grad_norm_0: tensor(1375.6060, device='cuda:0') (tensor(1327.3068, device='cuda:0')) | > loss_gen: 1.5640487670898438 (2.177882334281658) | > loss_kl: 1.0500296354293823 (0.8651078754457934) | > loss_feat: 0.9407777190208435 (4.128332704562568) | > loss_mel: 17.033239364624023 (19.484036437396338) | > loss_duration: 1.5231558084487915 (1.527091959427143) | > loss_1: 22.111249923706055 (28.18245188943271) | > grad_norm_1: tensor(7864.8979, device='cuda:0') (tensor(40479.7930, device='cuda:0')) | > current_lr_0: 0.00012387678801260144 | > current_lr_1: 0.00012387678801260144 | > step_time: 0.2854 (0.4717231536733693) | > loader_time: 0.0041 (0.01750454409369107)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8122808933258057 (2.8122808933258057) | > loss_disc_real_0: 0.3750361502170563 (0.3750361502170563) | > loss_disc_real_1: 0.1243545189499855 (0.1243545189499855) | > loss_disc_real_2: 0.2769389748573303 (0.2769389748573303) | > loss_disc_real_3: 0.2646150290966034 (0.2646150290966034) | > loss_disc_real_4: 0.2730009853839874 (0.2730009853839874) | > loss_disc_real_5: 0.39995718002319336 (0.39995718002319336) | > loss_0: 2.8122808933258057 (2.8122808933258057) | > loss_gen: 2.255805253982544 (2.255805253982544) | > loss_kl: 3.5701539516448975 (3.5701539516448975) | > loss_feat: 5.1020026206970215 (5.1020026206970215) | > loss_mel: 23.381189346313477 (23.381189346313477) | > loss_duration: 2.6425211429595947 (2.6425211429595947) | > loss_1: 36.9516716003418 (36.9516716003418)  --> STEP: 1 | > loss_disc: 2.240450382232666 (2.240450382232666) | > loss_disc_real_0: 0.3648477792739868 (0.3648477792739868) | > loss_disc_real_1: 0.1916537582874298 (0.1916537582874298) | > loss_disc_real_2: 0.39092546701431274 (0.39092546701431274) | > loss_disc_real_3: 0.23387424647808075 (0.23387424647808075) | > loss_disc_real_4: 0.15790259838104248 (0.15790259838104248) | > loss_disc_real_5: 0.18035733699798584 (0.18035733699798584) | > loss_0: 2.240450382232666 (2.240450382232666) | > loss_gen: 3.245990514755249 (3.245990514755249) | > loss_kl: 3.7912955284118652 (3.7912955284118652) | > loss_feat: 7.020504951477051 (7.020504951477051) | > loss_mel: 23.30453109741211 (23.30453109741211) | > loss_duration: 2.957674264907837 (2.957674264907837) | > loss_1: 40.31999969482422 (40.31999969482422)  --> STEP: 2 | > loss_disc: 2.7625603675842285 (2.5015053749084473) | > loss_disc_real_0: 0.5033639073371887 (0.43410584330558777) | > loss_disc_real_1: 0.0629270151257515 (0.12729038670659065) | > loss_disc_real_2: 0.1613275110721588 (0.2761264890432358) | > loss_disc_real_3: 0.15413324534893036 (0.19400374591350555) | > loss_disc_real_4: 0.21148529648780823 (0.18469394743442535) | > loss_disc_real_5: 0.27904999256134033 (0.22970366477966309) | > loss_0: 2.7625603675842285 (2.5015053749084473) | > loss_gen: 2.146710157394409 (2.696350336074829) | > loss_kl: 4.525646209716797 (4.158470869064331) | > loss_feat: 7.4275288581848145 (7.224016904830933) | > loss_mel: 23.977216720581055 (23.640873908996582) | > loss_duration: 2.779639720916748 (2.8686569929122925) | > loss_1: 40.85673904418945 (40.588369369506836)  --> STEP: 3 | > loss_disc: 3.55954647064209 (2.8541857401529946) | > loss_disc_real_0: 0.7693164348602295 (0.545842707157135) | > loss_disc_real_1: 0.30201640725135803 (0.18553239355484644) | > loss_disc_real_2: 0.4528347849845886 (0.3350292543570201) | > loss_disc_real_3: 0.3864198327064514 (0.2581424415111542) | > loss_disc_real_4: 0.40944698452949524 (0.2596116264661153) | > loss_disc_real_5: 0.3214990794658661 (0.26030213634173077) | > loss_0: 3.55954647064209 (2.8541857401529946) | > loss_gen: 2.745229721069336 (2.7126434644063315) | > loss_kl: 1.945976734161377 (3.4209728240966797) | > loss_feat: 3.2362449169158936 (5.89475957552592) | > loss_mel: 19.562644958496094 (22.281464258829754) | > loss_duration: 2.567450523376465 (2.76825483640035) | > loss_1: 30.057544708251953 (37.078094482421875) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_77000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.37911319732666 (2.985417604446411) | > loss_disc_real_0: 0.6922784447669983 (0.5824516415596008) | > loss_disc_real_1: 0.3936406075954437 (0.23755944706499577) | > loss_disc_real_2: 0.5038359761238098 (0.3772309347987175) | > loss_disc_real_3: 0.21668604016304016 (0.24777834117412567) | > loss_disc_real_4: 0.3342035114765167 (0.27825959771871567) | > loss_disc_real_5: 0.27777189016342163 (0.2646695747971535) | > loss_0: 3.37911319732666 (2.985417604446411) | > loss_gen: 2.5509159564971924 (2.6722115874290466) | > loss_kl: 3.4529800415039062 (3.4289746284484863) | > loss_feat: 3.66127610206604 (5.33638870716095) | > loss_mel: 22.799179077148438 (22.410892963409424) | > loss_duration: 2.6865522861480713 (2.7478291988372803) | > loss_1: 35.15090560913086 (36.59629726409912)  --> STEP: 1 | > loss_disc: 2.714456558227539 (2.931225395202637) | > loss_disc_real_0: 0.2884491980075836 (0.5236511528491974) | > loss_disc_real_1: 0.09145471453666687 (0.20833850055932998) | > loss_disc_real_2: 0.18879911303520203 (0.3395445704460144) | > loss_disc_real_3: 0.21690529584884644 (0.24160373210906982) | > loss_disc_real_4: 0.2993978261947632 (0.28248724341392517) | > loss_disc_real_5: 0.34555181860923767 (0.28084602355957033) | > loss_0: 2.714456558227539 (2.931225395202637) | > loss_gen: 1.9270765781402588 (2.523184585571289) | > loss_kl: 3.992868185043335 (3.541753339767456) | > loss_feat: 5.94050407409668 (5.4572117805480955) | > loss_mel: 23.316234588623047 (22.591961288452147) | > loss_duration: 2.9612364768981934 (2.790510654449463) | > loss_1: 38.13792037963867 (36.90462188720703)  --> STEP: 2 | > loss_disc: 1.9459311962127686 (2.767009695370992) | > loss_disc_real_0: 0.14654076099395752 (0.4607994208733241) | > loss_disc_real_1: 0.15175291895866394 (0.19890757029255232) | > loss_disc_real_2: 0.24365665018558502 (0.3235632504026095) | > loss_disc_real_3: 0.16542014479637146 (0.22890646755695343) | > loss_disc_real_4: 0.13760815560817719 (0.2583407287796338) | > loss_disc_real_5: 0.14256088435649872 (0.2577985003590584) | > loss_0: 1.9459311962127686 (2.767009695370992) | > loss_gen: 2.2982330322265625 (2.4856926600138345) | > loss_kl: 4.485422134399414 (3.6990314722061157) | > loss_feat: 6.06043815612793 (5.557749509811401) | > loss_mel: 27.42888641357422 (23.398115475972492) | > loss_duration: 2.7929723262786865 (2.790920933087667) | > loss_1: 43.06595230102539 (37.93151028951009)  --> STEP: 3 | > loss_disc: 3.0348496437072754 (2.805272545133318) | > loss_disc_real_0: 1.064807415008545 (0.5470862771783557) | > loss_disc_real_1: 0.18942993879318237 (0.19755362293549947) | > loss_disc_real_2: 0.3281451463699341 (0.32421780696937014) | > loss_disc_real_3: 0.2702724039554596 (0.23481588704245432) | > loss_disc_real_4: 0.22590169310569763 (0.2537065808262144) | > loss_disc_real_5: 0.2777915596961975 (0.2606546516929354) | > loss_0: 3.0348496437072754 (2.805272545133318) | > loss_gen: 3.296968460083008 (2.6015892028808594) | > loss_kl: 1.9541511535644531 (3.449762855257307) | > loss_feat: 5.0490288734436035 (5.48507513318743) | > loss_mel: 22.488014221191406 (23.26810101100377) | > loss_duration: 2.7073729038238525 (2.7789855003356934) | > loss_1: 35.49553680419922 (37.583514077322825) --> EVAL PERFORMANCE | > avg_loader_time: 0.5505396979195731 (+0.5352995849791028) | > avg_loss_disc: 2.805272545133318 (+0.2599610941750661) | > avg_loss_disc_real_0: 0.5470862771783557 (+0.40436761684360967) | > avg_loss_disc_real_1: 0.19755362293549947 (-0.09097463069927123) | > avg_loss_disc_real_2: 0.32421780696937014 (-0.009803681856110025) | > avg_loss_disc_real_3: 0.23481588704245432 (-0.061783963016101284) | > avg_loss_disc_real_4: 0.2537065808262144 (+0.03437561435358866) | > avg_loss_disc_real_5: 0.2606546516929354 (+0.08318790651503064) | > avg_loss_0: 2.805272545133318 (+0.2599610941750661) | > avg_loss_gen: 2.6015892028808594 (+0.38332227865854884) | > avg_loss_kl: 3.449762855257307 (-0.2716114975157238) | > avg_loss_feat: 5.48507513318743 (+0.7568177949814565) | > avg_loss_mel: 23.26810101100377 (-1.8858074006580168) | > avg_loss_duration: 2.7789855003356934 (-0.032122214635213364) | > avg_loss_1: 37.583514077322825 (-1.0494014195033472)  > EPOCH: 480/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:56:41)   --> TIME: 2023-10-20 04:56:50 -- STEP: 9/50 -- GLOBAL_STEP: 77010 | > loss_disc: 2.9787673950195312 (2.2391139931148953) | > loss_disc_real_0: 0.18964597582817078 (0.16085618403222826) | > loss_disc_real_1: 0.33328092098236084 (0.20035288607080778) | > loss_disc_real_2: 0.2738381028175354 (0.24855240558584532) | > loss_disc_real_3: 0.29395589232444763 (0.22003750503063202) | > loss_disc_real_4: 0.2824828624725342 (0.20231919321748945) | > loss_disc_real_5: 0.27962353825569153 (0.23204913321468565) | > loss_0: 2.9787673950195312 (2.2391139931148953) | > grad_norm_0: tensor(985.2050, device='cuda:0') (tensor(1033.2273, device='cuda:0')) | > loss_gen: 1.7223151922225952 (2.621259570121765) | > loss_kl: 0.7293025255203247 (0.7790026466051737) | > loss_feat: 0.32401183247566223 (6.3877547615104255) | > loss_mel: 19.562110900878906 (22.92643102010091) | > loss_duration: 1.4552996158599854 (1.511358870400323) | > loss_1: 23.793039321899414 (34.22580676608615) | > grad_norm_1: tensor(6760.2422, device='cuda:0') (tensor(49616.7734, device='cuda:0')) | > current_lr_0: 0.00012375296540713664 | > current_lr_1: 0.00012375296540713664 | > step_time: 0.6199 (0.5102517869737413) | > loader_time: 0.0266 (0.01973072687784831)  --> TIME: 2023-10-20 04:57:06 -- STEP: 39/50 -- GLOBAL_STEP: 77040 | > loss_disc: 0.9947847127914429 (2.3585322208893604) | > loss_disc_real_0: 0.011611174792051315 (0.15695900298081916) | > loss_disc_real_1: 0.041723206639289856 (0.21069019889602295) | > loss_disc_real_2: 0.023081041872501373 (0.2334858876390335) | > loss_disc_real_3: 0.05781726911664009 (0.2411383211803742) | > loss_disc_real_4: 0.028409302234649658 (0.21187326574745852) | > loss_disc_real_5: 0.01771584153175354 (0.2102085043413517) | > loss_0: 0.9947847127914429 (2.3585322208893604) | > grad_norm_0: tensor(911.0775, device='cuda:0') (tensor(1194.4623, device='cuda:0')) | > loss_gen: 3.2887187004089355 (2.477745676651979) | > loss_kl: 0.18349216878414154 (0.785412711592821) | > loss_feat: 11.663007736206055 (5.9674486722319555) | > loss_mel: 24.958145141601562 (22.586017578076092) | > loss_duration: 1.5644484758377075 (1.5124632425797293) | > loss_1: 41.657814025878906 (33.3290881621532) | > grad_norm_1: tensor(63569.7461, device='cuda:0') (tensor(48627.4414, device='cuda:0')) | > current_lr_0: 0.00012375296540713664 | > current_lr_1: 0.00012375296540713664 | > step_time: 0.3193 (0.49951684169280225) | > loader_time: 0.0234 (0.01997119952470828)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.92421555519104 (2.92421555519104) | > loss_disc_real_0: 0.2667772173881531 (0.2667772173881531) | > loss_disc_real_1: 0.24775943160057068 (0.24775943160057068) | > loss_disc_real_2: 0.2848145365715027 (0.2848145365715027) | > loss_disc_real_3: 0.25625792145729065 (0.25625792145729065) | > loss_disc_real_4: 0.25941285490989685 (0.25941285490989685) | > loss_disc_real_5: 0.21612583100795746 (0.21612583100795746) | > loss_0: 2.92421555519104 (2.92421555519104) | > loss_gen: 1.7181718349456787 (1.7181718349456787) | > loss_kl: 4.5747456550598145 (4.5747456550598145) | > loss_feat: 0.9059547781944275 (0.9059547781944275) | > loss_mel: 17.279949188232422 (17.279949188232422) | > loss_duration: 2.6963398456573486 (2.6963398456573486) | > loss_1: 27.17516326904297 (27.17516326904297)  --> STEP: 1 | > loss_disc: 3.044550657272339 (3.044550657272339) | > loss_disc_real_0: 0.5238350033760071 (0.5238350033760071) | > loss_disc_real_1: 0.23249933123588562 (0.23249933123588562) | > loss_disc_real_2: 0.3505692780017853 (0.3505692780017853) | > loss_disc_real_3: 0.2085026353597641 (0.2085026353597641) | > loss_disc_real_4: 0.26767438650131226 (0.26767438650131226) | > loss_disc_real_5: 0.4167722761631012 (0.4167722761631012) | > loss_0: 3.044550657272339 (3.044550657272339) | > loss_gen: 2.73390793800354 (2.73390793800354) | > loss_kl: 4.023493766784668 (4.023493766784668) | > loss_feat: 5.054018974304199 (5.054018974304199) | > loss_mel: 25.163793563842773 (25.163793563842773) | > loss_duration: 2.9808099269866943 (2.9808099269866943) | > loss_1: 39.956024169921875 (39.956024169921875)  --> STEP: 2 | > loss_disc: 2.766444206237793 (2.905497431755066) | > loss_disc_real_0: 0.3984207510948181 (0.4611278772354126) | > loss_disc_real_1: 0.4256880581378937 (0.32909369468688965) | > loss_disc_real_2: 0.27148884534835815 (0.3110290616750717) | > loss_disc_real_3: 0.3313274383544922 (0.26991503685712814) | > loss_disc_real_4: 0.2755567133426666 (0.27161554992198944) | > loss_disc_real_5: 0.2964029312133789 (0.35658760368824005) | > loss_0: 2.766444206237793 (2.905497431755066) | > loss_gen: 2.924809694290161 (2.8293588161468506) | > loss_kl: 4.003538608551025 (4.013516187667847) | > loss_feat: 4.433582782745361 (4.74380087852478) | > loss_mel: 29.670183181762695 (27.416988372802734) | > loss_duration: 2.765691041946411 (2.8732504844665527) | > loss_1: 43.79780197143555 (41.87691307067871)  --> STEP: 3 | > loss_disc: 2.5597665309906006 (2.7902537981669107) | > loss_disc_real_0: 0.4297042191028595 (0.4506533245245616) | > loss_disc_real_1: 0.42144516110420227 (0.35987751682599384) | > loss_disc_real_2: 0.11139468848705292 (0.24448427061239877) | > loss_disc_real_3: 0.19686654210090637 (0.24556553860505423) | > loss_disc_real_4: 0.13938230276107788 (0.22753780086835226) | > loss_disc_real_5: 0.2333906590938568 (0.3155219554901123) | > loss_0: 2.5597665309906006 (2.7902537981669107) | > loss_gen: 3.2599992752075195 (2.9729056358337402) | > loss_kl: 2.116177797317505 (3.381070057551066) | > loss_feat: 7.849876880645752 (5.7791595458984375) | > loss_mel: 24.6358642578125 (26.489947001139324) | > loss_duration: 2.6478970050811768 (2.7981326580047607) | > loss_1: 40.50981521606445 (41.42121378580729) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024108091990152993 (-0.5481288887205579) | > avg_loss_disc: 2.7902537981669107 (-0.01501874696640737) | > avg_loss_disc_real_0: 0.4506533245245616 (-0.09643295265379409) | > avg_loss_disc_real_1: 0.35987751682599384 (+0.16232389389049437) | > avg_loss_disc_real_2: 0.24448427061239877 (-0.07973353635697136) | > avg_loss_disc_real_3: 0.24556553860505423 (+0.01074965156259991) | > avg_loss_disc_real_4: 0.22753780086835226 (-0.026168779957862126) | > avg_loss_disc_real_5: 0.3155219554901123 (+0.054867303797176914) | > avg_loss_0: 2.7902537981669107 (-0.01501874696640737) | > avg_loss_gen: 2.9729056358337402 (+0.37131643295288086) | > avg_loss_kl: 3.381070057551066 (-0.06869279770624104) | > avg_loss_feat: 5.7791595458984375 (+0.2940844127110074) | > avg_loss_mel: 26.489947001139324 (+3.221845990135556) | > avg_loss_duration: 2.7981326580047607 (+0.019147157669067383) | > avg_loss_1: 41.42121378580729 (+3.8376997084844646)  > EPOCH: 481/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:57:23)   --> TIME: 2023-10-20 04:57:38 -- STEP: 19/50 -- GLOBAL_STEP: 77070 | > loss_disc: 3.0183897018432617 (2.3900800127732125) | > loss_disc_real_0: 0.38320091366767883 (0.15884442725463918) | > loss_disc_real_1: 0.3072235882282257 (0.23713017960912303) | > loss_disc_real_2: 0.3475009500980377 (0.23677657426972137) | > loss_disc_real_3: 0.32586511969566345 (0.24456212748038142) | > loss_disc_real_4: 0.2589109241962433 (0.22071620674901887) | > loss_disc_real_5: 0.25457999110221863 (0.1808226949682361) | > loss_0: 3.0183897018432617 (2.3900800127732125) | > grad_norm_0: tensor(1406.9127, device='cuda:0') (tensor(1041.9854, device='cuda:0')) | > loss_gen: 1.8808404207229614 (2.423985010699222) | > loss_kl: 1.0556282997131348 (0.9024061027326082) | > loss_feat: 0.745432436466217 (5.689308183365746) | > loss_mel: 19.35280990600586 (22.339274782883493) | > loss_duration: 1.6245405673980713 (1.556937198889883) | > loss_1: 24.659250259399414 (32.9119109605488) | > grad_norm_1: tensor(6829.1099, device='cuda:0') (tensor(52294.5977, device='cuda:0')) | > current_lr_0: 0.00012362926657011843 | > current_lr_1: 0.00012362926657011843 | > step_time: 0.5823 (0.510371961091694) | > loader_time: 0.0146 (0.013169614892256888)  --> TIME: 2023-10-20 04:57:54 -- STEP: 49/50 -- GLOBAL_STEP: 77100 | > loss_disc: 2.6821324825286865 (2.4525245671369587) | > loss_disc_real_0: 0.19387052953243256 (0.14866431681819411) | > loss_disc_real_1: 0.29124876856803894 (0.230411490539507) | > loss_disc_real_2: 0.23244708776474 (0.2220789958741896) | > loss_disc_real_3: 0.3650290071964264 (0.24130507262081516) | > loss_disc_real_4: 0.322730153799057 (0.2194561762545182) | > loss_disc_real_5: 0.3569387197494507 (0.21156151797052244) | > loss_0: 2.6821324825286865 (2.4525245671369587) | > grad_norm_0: tensor(1130.9896, device='cuda:0') (tensor(1132.6285, device='cuda:0')) | > loss_gen: 2.7420434951782227 (2.292989334281611) | > loss_kl: 0.49542897939682007 (0.8674055137196366) | > loss_feat: 4.09587287902832 (5.253506966543441) | > loss_mel: 26.25628089904785 (21.236955521058064) | > loss_duration: 1.670721411705017 (1.518950172833034) | > loss_1: 35.26034927368164 (31.16980755085847) | > grad_norm_1: tensor(70469.7266, device='cuda:0') (tensor(42728.3594, device='cuda:0')) | > current_lr_0: 0.00012362926657011843 | > current_lr_1: 0.00012362926657011843 | > step_time: 0.4987 (0.5125360926803277) | > loader_time: 0.4054 (0.02361365727015904)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0029983520507812 (3.0029983520507812) | > loss_disc_real_0: 0.1570693999528885 (0.1570693999528885) | > loss_disc_real_1: 0.25974714756011963 (0.25974714756011963) | > loss_disc_real_2: 0.2406860888004303 (0.2406860888004303) | > loss_disc_real_3: 0.2564118206501007 (0.2564118206501007) | > loss_disc_real_4: 0.2834879159927368 (0.2834879159927368) | > loss_disc_real_5: 0.23491719365119934 (0.23491719365119934) | > loss_0: 3.0029983520507812 (3.0029983520507812) | > loss_gen: 1.4498474597930908 (1.4498474597930908) | > loss_kl: 3.985560417175293 (3.985560417175293) | > loss_feat: 0.05024894326925278 (0.05024894326925278) | > loss_mel: 1.5946375131607056 (1.5946375131607056) | > loss_duration: 2.616633653640747 (2.616633653640747) | > loss_1: 9.696928024291992 (9.696928024291992)  --> STEP: 1 | > loss_disc: 3.1549324989318848 (3.1549324989318848) | > loss_disc_real_0: 0.3818868100643158 (0.3818868100643158) | > loss_disc_real_1: 0.2960244417190552 (0.2960244417190552) | > loss_disc_real_2: 0.24898038804531097 (0.24898038804531097) | > loss_disc_real_3: 0.26440340280532837 (0.26440340280532837) | > loss_disc_real_4: 0.4161502718925476 (0.4161502718925476) | > loss_disc_real_5: 0.44309505820274353 (0.44309505820274353) | > loss_0: 3.1549324989318848 (3.1549324989318848) | > loss_gen: 2.670591354370117 (2.670591354370117) | > loss_kl: 4.467710018157959 (4.467710018157959) | > loss_feat: 5.002730846405029 (5.002730846405029) | > loss_mel: 23.996509552001953 (23.996509552001953) | > loss_duration: 2.7775168418884277 (2.7775168418884277) | > loss_1: 38.91505813598633 (38.91505813598633)  --> STEP: 2 | > loss_disc: 1.9781043529510498 (2.5665184259414673) | > loss_disc_real_0: 0.18232958018779755 (0.28210819512605667) | > loss_disc_real_1: 0.10847000777721405 (0.2022472247481346) | > loss_disc_real_2: 0.1629142463207245 (0.20594731718301773) | > loss_disc_real_3: 0.24619132280349731 (0.25529736280441284) | > loss_disc_real_4: 0.11295623332262039 (0.264553252607584) | > loss_disc_real_5: 0.1280134618282318 (0.28555426001548767) | > loss_0: 1.9781043529510498 (2.5665184259414673) | > loss_gen: 2.64644455909729 (2.6585179567337036) | > loss_kl: 4.601119518280029 (4.534414768218994) | > loss_feat: 9.596173286437988 (7.299452066421509) | > loss_mel: 26.3172607421875 (25.156885147094727) | > loss_duration: 2.7873504161834717 (2.7824336290359497) | > loss_1: 45.94834899902344 (42.43170356750488)  --> STEP: 3 | > loss_disc: 3.0054962635040283 (2.7128443717956543) | > loss_disc_real_0: 0.1580667942762375 (0.24076106150945029) | > loss_disc_real_1: 0.2597358524799347 (0.22141010065873465) | > loss_disc_real_2: 0.24076984822750092 (0.2175548275311788) | > loss_disc_real_3: 0.25643420219421387 (0.25567630926767987) | > loss_disc_real_4: 0.28347086906433105 (0.27085912475983304) | > loss_disc_real_5: 0.23496703803539276 (0.26869185268878937) | > loss_0: 3.0054962635040283 (2.7128443717956543) | > loss_gen: 1.448800802230835 (2.2552789052327475) | > loss_kl: 2.025545120239258 (3.698124885559082) | > loss_feat: 0.04564553499221802 (4.881516555945079) | > loss_mel: 1.8919320106506348 (17.40190076828003) | > loss_duration: 2.605888605117798 (2.723585287729899) | > loss_1: 8.01781177520752 (30.96040630340576) --> EVAL PERFORMANCE | > avg_loader_time: 0.011571089426676432 (+0.009160280227661133) | > avg_loss_disc: 2.7128443717956543 (-0.07740942637125636) | > avg_loss_disc_real_0: 0.24076106150945029 (-0.2098922630151113) | > avg_loss_disc_real_1: 0.22141010065873465 (-0.1384674161672592) | > avg_loss_disc_real_2: 0.2175548275311788 (-0.026929443081219973) | > avg_loss_disc_real_3: 0.25567630926767987 (+0.01011077066262564) | > avg_loss_disc_real_4: 0.27085912475983304 (+0.04332132389148077) | > avg_loss_disc_real_5: 0.26869185268878937 (-0.04683010280132294) | > avg_loss_0: 2.7128443717956543 (-0.07740942637125636) | > avg_loss_gen: 2.2552789052327475 (-0.7176267306009927) | > avg_loss_kl: 3.698124885559082 (+0.3170548280080161) | > avg_loss_feat: 4.881516555945079 (-0.8976429899533587) | > avg_loss_mel: 17.40190076828003 (-9.088046232859295) | > avg_loss_duration: 2.723585287729899 (-0.0745473702748618) | > avg_loss_1: 30.96040630340576 (-10.460807482401528)  > EPOCH: 482/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:58:03)   --> TIME: 2023-10-20 04:58:19 -- STEP: 29/50 -- GLOBAL_STEP: 77130 | > loss_disc: 2.025768756866455 (2.3558957700071663) | > loss_disc_real_0: 0.07848092913627625 (0.1275060691324801) | > loss_disc_real_1: 0.19984634220600128 (0.21701628303733364) | > loss_disc_real_2: 0.1688217967748642 (0.2576846306950881) | > loss_disc_real_3: 0.219282865524292 (0.21865402239150014) | > loss_disc_real_4: 0.2341393381357193 (0.2144838859295023) | > loss_disc_real_5: 0.19176097214221954 (0.21608099290009203) | > loss_0: 2.025768756866455 (2.3558957700071663) | > grad_norm_0: tensor(217.5693, device='cuda:0') (tensor(797.3909, device='cuda:0')) | > loss_gen: 2.7974843978881836 (2.582796865496142) | > loss_kl: 0.8622946739196777 (0.8494715241008791) | > loss_feat: 6.030008792877197 (6.73050207644701) | > loss_mel: 22.212202072143555 (22.801149146310216) | > loss_duration: 1.4903264045715332 (1.5126643715233639) | > loss_1: 33.39231491088867 (34.476584204312026) | > grad_norm_1: tensor(14546.7070, device='cuda:0') (tensor(42463.1836, device='cuda:0')) | > current_lr_0: 0.00012350569137783258 | > current_lr_1: 0.00012350569137783258 | > step_time: 0.2885 (0.3696249271261281) | > loader_time: 0.0029 (0.009478182628236968)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.117337942123413 (3.117337942123413) | > loss_disc_real_0: 0.7048513293266296 (0.7048513293266296) | > loss_disc_real_1: 0.4676242768764496 (0.4676242768764496) | > loss_disc_real_2: 0.38682153820991516 (0.38682153820991516) | > loss_disc_real_3: 0.25430354475975037 (0.25430354475975037) | > loss_disc_real_4: 0.2748222053050995 (0.2748222053050995) | > loss_disc_real_5: 0.34382787346839905 (0.34382787346839905) | > loss_0: 3.117337942123413 (3.117337942123413) | > loss_gen: 3.0381646156311035 (3.0381646156311035) | > loss_kl: 3.710606575012207 (3.710606575012207) | > loss_feat: 4.482119560241699 (4.482119560241699) | > loss_mel: 22.507156372070312 (22.507156372070312) | > loss_duration: 2.68812894821167 (2.68812894821167) | > loss_1: 36.426177978515625 (36.426177978515625)  --> STEP: 1 | > loss_disc: 2.2292556762695312 (2.2292556762695312) | > loss_disc_real_0: 0.3730652332305908 (0.3730652332305908) | > loss_disc_real_1: 0.19994249939918518 (0.19994249939918518) | > loss_disc_real_2: 0.15505647659301758 (0.15505647659301758) | > loss_disc_real_3: 0.1853513866662979 (0.1853513866662979) | > loss_disc_real_4: 0.08540370315313339 (0.08540370315313339) | > loss_disc_real_5: 0.14204996824264526 (0.14204996824264526) | > loss_0: 2.2292556762695312 (2.2292556762695312) | > loss_gen: 2.973454713821411 (2.973454713821411) | > loss_kl: 4.125064849853516 (4.125064849853516) | > loss_feat: 7.8998308181762695 (7.8998308181762695) | > loss_mel: 22.38822364807129 (22.38822364807129) | > loss_duration: 2.884606122970581 (2.884606122970581) | > loss_1: 40.27117919921875 (40.27117919921875)  --> STEP: 2 | > loss_disc: 2.032055377960205 (2.130655527114868) | > loss_disc_real_0: 0.3531569242477417 (0.36311107873916626) | > loss_disc_real_1: 0.18575836718082428 (0.19285043329000473) | > loss_disc_real_2: 0.14782175421714783 (0.1514391154050827) | > loss_disc_real_3: 0.18835598230361938 (0.18685368448495865) | > loss_disc_real_4: 0.11364161968231201 (0.0995226614177227) | > loss_disc_real_5: 0.20421311259269714 (0.1731315404176712) | > loss_0: 2.032055377960205 (2.130655527114868) | > loss_gen: 2.7262210845947266 (2.849837899208069) | > loss_kl: 4.60597562789917 (4.365520238876343) | > loss_feat: 6.121115207672119 (7.010473012924194) | > loss_mel: 19.827102661132812 (21.10766315460205) | > loss_duration: 2.8899922370910645 (2.8872991800308228) | > loss_1: 36.170406341552734 (38.22079277038574)  --> STEP: 3 | > loss_disc: 2.9528207778930664 (2.404710610707601) | > loss_disc_real_0: 0.2395368218421936 (0.3219196597735087) | > loss_disc_real_1: 0.2762119472026825 (0.22063760459423065) | > loss_disc_real_2: 0.22528383135795593 (0.17605402072270712) | > loss_disc_real_3: 0.21223489940166473 (0.195314089457194) | > loss_disc_real_4: 0.3838048577308655 (0.19428339352210364) | > loss_disc_real_5: 0.5215383172035217 (0.2892671326796214) | > loss_0: 2.9528207778930664 (2.404710610707601) | > loss_gen: 2.2706665992736816 (2.65678079922994) | > loss_kl: 2.108949661254883 (3.613330046335856) | > loss_feat: 3.3696699142456055 (5.796871980031331) | > loss_mel: 26.38198471069336 (22.86577033996582) | > loss_duration: 2.7437360286712646 (2.8394447962443032) | > loss_1: 36.87500762939453 (37.77219772338867) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024144649505615234 (-0.009156624476114908) | > avg_loss_disc: 2.404710610707601 (-0.30813376108805324) | > avg_loss_disc_real_0: 0.3219196597735087 (+0.08115859826405844) | > avg_loss_disc_real_1: 0.22063760459423065 (-0.0007724960645039969) | > avg_loss_disc_real_2: 0.17605402072270712 (-0.04150080680847168) | > avg_loss_disc_real_3: 0.195314089457194 (-0.06036221981048587) | > avg_loss_disc_real_4: 0.19428339352210364 (-0.0765757312377294) | > avg_loss_disc_real_5: 0.2892671326796214 (+0.02057527999083203) | > avg_loss_0: 2.404710610707601 (-0.30813376108805324) | > avg_loss_gen: 2.65678079922994 (+0.4015018939971924) | > avg_loss_kl: 3.613330046335856 (-0.08479483922322606) | > avg_loss_feat: 5.796871980031331 (+0.9153554240862523) | > avg_loss_mel: 22.86577033996582 (+5.463869571685791) | > avg_loss_duration: 2.8394447962443032 (+0.1158595085144043) | > avg_loss_1: 37.77219772338867 (+6.81179141998291)  > EPOCH: 483/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:58:40)   --> TIME: 2023-10-20 04:58:49 -- STEP: 9/50 -- GLOBAL_STEP: 77160 | > loss_disc: 2.453657388687134 (2.472061448627048) | > loss_disc_real_0: 0.02879348397254944 (0.18876419754491913) | > loss_disc_real_1: 0.2818138599395752 (0.2630973876350456) | > loss_disc_real_2: 0.41874802112579346 (0.37436704337596893) | > loss_disc_real_3: 0.3455924093723297 (0.2501278099500471) | > loss_disc_real_4: 0.2140844464302063 (0.1902056439883179) | > loss_disc_real_5: 0.19092516601085663 (0.21954436682992512) | > loss_0: 2.453657388687134 (2.472061448627048) | > grad_norm_0: tensor(850.8282, device='cuda:0') (tensor(780.5897, device='cuda:0')) | > loss_gen: 2.4836676120758057 (2.5930579900741577) | > loss_kl: 0.9048588275909424 (0.9922416673766242) | > loss_feat: 3.5467662811279297 (5.428557163311376) | > loss_mel: 27.184646606445312 (21.852137035793728) | > loss_duration: 1.534494161605835 (1.541142874293857) | > loss_1: 35.65443420410156 (32.407136493259) | > grad_norm_1: tensor(8790.8271, device='cuda:0') (tensor(19493.2578, device='cuda:0')) | > current_lr_0: 0.00012338223970668831 | > current_lr_1: 0.00012338223970668831 | > step_time: 0.6412 (0.5019798013899062) | > loader_time: 0.0269 (0.018624544143676758)  --> TIME: 2023-10-20 04:59:04 -- STEP: 39/50 -- GLOBAL_STEP: 77190 | > loss_disc: 2.8697264194488525 (2.537902370477333) | > loss_disc_real_0: 0.23329833149909973 (0.15792773582805425) | > loss_disc_real_1: 0.2188357263803482 (0.23070977723751313) | > loss_disc_real_2: 0.23216569423675537 (0.2665974927636293) | > loss_disc_real_3: 0.2311650663614273 (0.2519666889252571) | > loss_disc_real_4: 0.2723248600959778 (0.22941686948522544) | > loss_disc_real_5: 0.31431302428245544 (0.24599679425740853) | > loss_0: 2.8697264194488525 (2.537902370477333) | > grad_norm_0: tensor(357.4766, device='cuda:0') (tensor(712.4608, device='cuda:0')) | > loss_gen: 1.7809998989105225 (2.3219844622489734) | > loss_kl: 0.8232641816139221 (0.9356517654198867) | > loss_feat: 0.8616029024124146 (4.832892874685618) | > loss_mel: 14.819321632385254 (21.941964063888943) | > loss_duration: 1.529996395111084 (1.5112469165753095) | > loss_1: 19.815185546875 (31.54374010134966) | > grad_norm_1: tensor(3374.1318, device='cuda:0') (tensor(15471.5947, device='cuda:0')) | > current_lr_0: 0.00012338223970668831 | > current_lr_1: 0.00012338223970668831 | > step_time: 0.6077 (0.4926435641753368) | > loader_time: 0.0242 (0.020407707263261844)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.285404920578003 (2.285404920578003) | > loss_disc_real_0: 0.08459023386240005 (0.08459023386240005) | > loss_disc_real_1: 0.09695446491241455 (0.09695446491241455) | > loss_disc_real_2: 0.14283877611160278 (0.14283877611160278) | > loss_disc_real_3: 0.01957060769200325 (0.01957060769200325) | > loss_disc_real_4: 0.19143638014793396 (0.19143638014793396) | > loss_disc_real_5: 0.13011635839939117 (0.13011635839939117) | > loss_0: 2.285404920578003 (2.285404920578003) | > loss_gen: 1.7544734477996826 (1.7544734477996826) | > loss_kl: 3.242108106613159 (3.242108106613159) | > loss_feat: 9.81015682220459 (9.81015682220459) | > loss_mel: 27.541166305541992 (27.541166305541992) | > loss_duration: 2.6165735721588135 (2.6165735721588135) | > loss_1: 44.9644775390625 (44.9644775390625)  --> STEP: 1 | > loss_disc: 2.364833116531372 (2.364833116531372) | > loss_disc_real_0: 0.2213478684425354 (0.2213478684425354) | > loss_disc_real_1: 0.29598110914230347 (0.29598110914230347) | > loss_disc_real_2: 0.16726408898830414 (0.16726408898830414) | > loss_disc_real_3: 0.25069811940193176 (0.25069811940193176) | > loss_disc_real_4: 0.08178778737783432 (0.08178778737783432) | > loss_disc_real_5: 0.2835446894168854 (0.2835446894168854) | > loss_0: 2.364833116531372 (2.364833116531372) | > loss_gen: 2.4053311347961426 (2.4053311347961426) | > loss_kl: 3.6975626945495605 (3.6975626945495605) | > loss_feat: 6.976305961608887 (6.976305961608887) | > loss_mel: 24.00712013244629 (24.00712013244629) | > loss_duration: 2.9304327964782715 (2.9304327964782715) | > loss_1: 40.01675033569336 (40.01675033569336)  --> STEP: 2 | > loss_disc: 2.811983585357666 (2.588408350944519) | > loss_disc_real_0: 0.3983572721481323 (0.30985257029533386) | > loss_disc_real_1: 0.4041385352611542 (0.3500598222017288) | > loss_disc_real_2: 0.3304438292980194 (0.24885395914316177) | > loss_disc_real_3: 0.2830013334751129 (0.26684972643852234) | > loss_disc_real_4: 0.3739601969718933 (0.22787399217486382) | > loss_disc_real_5: 0.22222895920276642 (0.2528868243098259) | > loss_0: 2.811983585357666 (2.588408350944519) | > loss_gen: 3.129239559173584 (2.7672853469848633) | > loss_kl: 4.692131519317627 (4.194847106933594) | > loss_feat: 4.4994025230407715 (5.737854242324829) | > loss_mel: 27.062416076660156 (25.534768104553223) | > loss_duration: 2.7805378437042236 (2.8554853200912476) | > loss_1: 42.163726806640625 (41.09023857116699)  --> STEP: 3 | > loss_disc: 2.760061502456665 (2.6456260681152344) | > loss_disc_real_0: 0.3479554057121277 (0.32255351543426514) | > loss_disc_real_1: 0.2675440013408661 (0.3225545485814412) | > loss_disc_real_2: 0.36944282054901123 (0.28905024627844494) | > loss_disc_real_3: 0.32808658480644226 (0.2872620125611623) | > loss_disc_real_4: 0.24577634036540985 (0.2338414415717125) | > loss_disc_real_5: 0.33943629264831543 (0.2817366470893224) | > loss_0: 2.760061502456665 (2.6456260681152344) | > loss_gen: 2.505434989929199 (2.680001894632975) | > loss_kl: 1.9986151456832886 (3.462769786516825) | > loss_feat: 2.597376823425293 (4.691028436024983) | > loss_mel: 17.381662368774414 (22.817066192626953) | > loss_duration: 2.6409060955047607 (2.783958911895752) | > loss_1: 27.123994827270508 (36.434823989868164) --> EVAL PERFORMANCE | > avg_loader_time: 0.008580764134724935 (+0.006166299184163412) | > avg_loss_disc: 2.6456260681152344 (+0.24091545740763332) | > avg_loss_disc_real_0: 0.32255351543426514 (+0.0006338556607564105) | > avg_loss_disc_real_1: 0.3225545485814412 (+0.10191694398721057) | > avg_loss_disc_real_2: 0.28905024627844494 (+0.11299622555573782) | > avg_loss_disc_real_3: 0.2872620125611623 (+0.0919479231039683) | > avg_loss_disc_real_4: 0.2338414415717125 (+0.03955804804960886) | > avg_loss_disc_real_5: 0.2817366470893224 (-0.0075304855902990075) | > avg_loss_0: 2.6456260681152344 (+0.24091545740763332) | > avg_loss_gen: 2.680001894632975 (+0.023221095403035186) | > avg_loss_kl: 3.462769786516825 (-0.15056025981903076) | > avg_loss_feat: 4.691028436024983 (-1.1058435440063477) | > avg_loss_mel: 22.817066192626953 (-0.04870414733886719) | > avg_loss_duration: 2.783958911895752 (-0.055485884348551284) | > avg_loss_1: 36.434823989868164 (-1.3373737335205078)  > EPOCH: 484/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 04:59:22)   --> TIME: 2023-10-20 04:59:34 -- STEP: 19/50 -- GLOBAL_STEP: 77220 | > loss_disc: 3.0044140815734863 (2.52314725675081) | > loss_disc_real_0: 0.1589108556509018 (0.17960017409763837) | > loss_disc_real_1: 0.24313198029994965 (0.24242017692641207) | > loss_disc_real_2: 0.2353266477584839 (0.24816770596723808) | > loss_disc_real_3: 0.2526113986968994 (0.2661090336347881) | > loss_disc_real_4: 0.2887907922267914 (0.2293784693863831) | > loss_disc_real_5: 0.2633697986602783 (0.22765478883918963) | > loss_0: 3.0044140815734863 (2.52314725675081) | > grad_norm_0: tensor(1046.7882, device='cuda:0') (tensor(794.6998, device='cuda:0')) | > loss_gen: 1.4578129053115845 (2.3884006424954065) | > loss_kl: 1.0004119873046875 (0.9404058330937436) | > loss_feat: 0.7376108765602112 (4.976510823557251) | > loss_mel: 10.362372398376465 (20.05736612018786) | > loss_duration: 1.575801968574524 (1.5292239377373142) | > loss_1: 15.134010314941406 (29.891907215118408) | > grad_norm_1: tensor(4314.1201, device='cuda:0') (tensor(25603.9668, device='cuda:0')) | > current_lr_0: 0.00012325891143321864 | > current_lr_1: 0.00012325891143321864 | > step_time: 0.6708 (0.4063638762423867) | > loader_time: 0.0226 (0.009345644398739463)  --> TIME: 2023-10-20 04:59:50 -- STEP: 49/50 -- GLOBAL_STEP: 77250 | > loss_disc: 2.831234931945801 (2.5645390165095425) | > loss_disc_real_0: 0.019466932862997055 (0.16225701589517447) | > loss_disc_real_1: 0.20131473243236542 (0.22719295611795115) | > loss_disc_real_2: 0.29603880643844604 (0.2304078694052842) | > loss_disc_real_3: 0.26245465874671936 (0.25643508166682955) | > loss_disc_real_4: 0.2547627091407776 (0.23993275698502453) | > loss_disc_real_5: 0.21746529638767242 (0.2432011638064773) | > loss_0: 2.831234931945801 (2.5645390165095425) | > grad_norm_0: tensor(1307.5055, device='cuda:0') (tensor(658.1410, device='cuda:0')) | > loss_gen: 1.666109561920166 (2.2246846374200313) | > loss_kl: 1.1153836250305176 (0.890014939162196) | > loss_feat: 1.5682921409606934 (4.8226137101954345) | > loss_mel: 20.898605346679688 (20.987503623475835) | > loss_duration: 1.6294169425964355 (1.506245690949109) | > loss_1: 26.8778076171875 (30.431062445348623) | > grad_norm_1: tensor(2815.1658, device='cuda:0') (tensor(18928.2383, device='cuda:0')) | > current_lr_0: 0.00012325891143321864 | > current_lr_1: 0.00012325891143321864 | > step_time: 0.5719 (0.46784578050885883) | > loader_time: 0.3778 (0.020285363100012953)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.928067207336426 (2.928067207336426) | > loss_disc_real_0: 0.2794751822948456 (0.2794751822948456) | > loss_disc_real_1: 0.26025474071502686 (0.26025474071502686) | > loss_disc_real_2: 0.2383061647415161 (0.2383061647415161) | > loss_disc_real_3: 0.21415957808494568 (0.21415957808494568) | > loss_disc_real_4: 0.23883013427257538 (0.23883013427257538) | > loss_disc_real_5: 0.22365383803844452 (0.22365383803844452) | > loss_0: 2.928067207336426 (2.928067207336426) | > loss_gen: 1.5482203960418701 (1.5482203960418701) | > loss_kl: 3.1950063705444336 (3.1950063705444336) | > loss_feat: 0.23497290909290314 (0.23497290909290314) | > loss_mel: 13.409622192382812 (13.409622192382812) | > loss_duration: 2.677748680114746 (2.677748680114746) | > loss_1: 21.065570831298828 (21.065570831298828)  --> STEP: 1 | > loss_disc: 3.3360674381256104 (3.3360674381256104) | > loss_disc_real_0: 0.5096241235733032 (0.5096241235733032) | > loss_disc_real_1: 0.2910643517971039 (0.2910643517971039) | > loss_disc_real_2: 0.3442535400390625 (0.3442535400390625) | > loss_disc_real_3: 0.3758293688297272 (0.3758293688297272) | > loss_disc_real_4: 0.4541873335838318 (0.4541873335838318) | > loss_disc_real_5: 0.25543683767318726 (0.25543683767318726) | > loss_0: 3.3360674381256104 (3.3360674381256104) | > loss_gen: 2.498249053955078 (2.498249053955078) | > loss_kl: 3.77720046043396 (3.77720046043396) | > loss_feat: 6.482571125030518 (6.482571125030518) | > loss_mel: 25.9035701751709 (25.9035701751709) | > loss_duration: 3.0138423442840576 (3.0138423442840576) | > loss_1: 41.67543411254883 (41.67543411254883)  --> STEP: 2 | > loss_disc: 2.690368413925171 (3.0132179260253906) | > loss_disc_real_0: 0.1082986444234848 (0.308961383998394) | > loss_disc_real_1: 0.31152352690696716 (0.3012939393520355) | > loss_disc_real_2: 0.25747501850128174 (0.3008642792701721) | > loss_disc_real_3: 0.2770019471645355 (0.32641565799713135) | > loss_disc_real_4: 0.2902272343635559 (0.37220728397369385) | > loss_disc_real_5: 0.2611115574836731 (0.2582741975784302) | > loss_0: 2.690368413925171 (3.0132179260253906) | > loss_gen: 2.0162925720214844 (2.2572708129882812) | > loss_kl: 4.528326034545898 (4.152763247489929) | > loss_feat: 1.9800796508789062 (4.231325387954712) | > loss_mel: 26.16302490234375 (26.033297538757324) | > loss_duration: 2.979487657546997 (2.9966650009155273) | > loss_1: 37.667213439941406 (39.67132377624512)  --> STEP: 3 | > loss_disc: 2.4479827880859375 (2.8248062133789062) | > loss_disc_real_0: 0.23858730494976044 (0.2855033576488495) | > loss_disc_real_1: 0.2779613435268402 (0.29351640741030377) | > loss_disc_real_2: 0.24169889092445374 (0.2811424831549327) | > loss_disc_real_3: 0.17809684574604034 (0.27697605391343433) | > loss_disc_real_4: 0.37694820761680603 (0.37378759185473126) | > loss_disc_real_5: 0.24352887272834778 (0.2533590892950694) | > loss_0: 2.4479827880859375 (2.8248062133789062) | > loss_gen: 2.523064613342285 (2.3458687464396157) | > loss_kl: 1.87276029586792 (3.3927622636159263) | > loss_feat: 4.35186243057251 (4.2715044021606445) | > loss_mel: 25.382932662963867 (25.816509246826172) | > loss_duration: 2.8184521198272705 (2.937260707219442) | > loss_1: 36.94906997680664 (38.76390584309896) --> EVAL PERFORMANCE | > avg_loader_time: 0.009750922520955404 (+0.0011701583862304688) | > avg_loss_disc: 2.8248062133789062 (+0.17918014526367188) | > avg_loss_disc_real_0: 0.2855033576488495 (-0.03705015778541565) | > avg_loss_disc_real_1: 0.29351640741030377 (-0.029038141171137455) | > avg_loss_disc_real_2: 0.2811424831549327 (-0.007907763123512268) | > avg_loss_disc_real_3: 0.27697605391343433 (-0.010285958647727966) | > avg_loss_disc_real_4: 0.37378759185473126 (+0.13994615028301877) | > avg_loss_disc_real_5: 0.2533590892950694 (-0.028377557794252994) | > avg_loss_0: 2.8248062133789062 (+0.17918014526367188) | > avg_loss_gen: 2.3458687464396157 (-0.3341331481933594) | > avg_loss_kl: 3.3927622636159263 (-0.07000752290089896) | > avg_loss_feat: 4.2715044021606445 (-0.4195240338643389) | > avg_loss_mel: 25.816509246826172 (+2.9994430541992188) | > avg_loss_duration: 2.937260707219442 (+0.15330179532368993) | > avg_loss_1: 38.76390584309896 (+2.3290818532307966)  > EPOCH: 485/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:00:00)   --> TIME: 2023-10-20 05:00:17 -- STEP: 29/50 -- GLOBAL_STEP: 77280 | > loss_disc: 2.1610827445983887 (2.3159854370972206) | > loss_disc_real_0: 0.10832236707210541 (0.17645811806593475) | > loss_disc_real_1: 0.17039798200130463 (0.22323444973805856) | > loss_disc_real_2: 0.31676754355430603 (0.20015615912090087) | > loss_disc_real_3: 0.3109157085418701 (0.22984603843812285) | > loss_disc_real_4: 0.26328691840171814 (0.20380861010273982) | > loss_disc_real_5: 0.24871891736984253 (0.20972011720055136) | > loss_0: 2.1610827445983887 (2.3159854370972206) | > grad_norm_0: tensor(239.6156, device='cuda:0') (tensor(535.1741, device='cuda:0')) | > loss_gen: 3.0572123527526855 (2.4478091412577134) | > loss_kl: 0.851456344127655 (0.9094171791241087) | > loss_feat: 6.023845672607422 (5.996598408910735) | > loss_mel: 21.35664939880371 (22.10506691603825) | > loss_duration: 1.5584185123443604 (1.534217776923344) | > loss_1: 32.84758377075195 (32.99310975239196) | > grad_norm_1: tensor(11735.4756, device='cuda:0') (tensor(22516.5293, device='cuda:0')) | > current_lr_0: 0.00012313570643407982 | > current_lr_1: 0.00012313570643407982 | > step_time: 0.2772 (0.4181574459733634) | > loader_time: 0.0021 (0.01231847960373451)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8642038106918335 (1.8642038106918335) | > loss_disc_real_0: 0.12585583329200745 (0.12585583329200745) | > loss_disc_real_1: 0.15513569116592407 (0.15513569116592407) | > loss_disc_real_2: 0.21464090049266815 (0.21464090049266815) | > loss_disc_real_3: 0.31594952940940857 (0.31594952940940857) | > loss_disc_real_4: 0.12769827246665955 (0.12769827246665955) | > loss_disc_real_5: 0.062315210700035095 (0.062315210700035095) | > loss_0: 1.8642038106918335 (1.8642038106918335) | > loss_gen: 3.443286895751953 (3.443286895751953) | > loss_kl: 3.515263557434082 (3.515263557434082) | > loss_feat: 7.556830406188965 (7.556830406188965) | > loss_mel: 14.390314102172852 (14.390314102172852) | > loss_duration: 2.5352866649627686 (2.5352866649627686) | > loss_1: 31.440980911254883 (31.440980911254883)  --> STEP: 1 | > loss_disc: 2.7618227005004883 (2.7618227005004883) | > loss_disc_real_0: 0.29246440529823303 (0.29246440529823303) | > loss_disc_real_1: 0.23174339532852173 (0.23174339532852173) | > loss_disc_real_2: 0.18801423907279968 (0.18801423907279968) | > loss_disc_real_3: 0.23506495356559753 (0.23506495356559753) | > loss_disc_real_4: 0.2503169775009155 (0.2503169775009155) | > loss_disc_real_5: 0.20487478375434875 (0.20487478375434875) | > loss_0: 2.7618227005004883 (2.7618227005004883) | > loss_gen: 1.7445485591888428 (1.7445485591888428) | > loss_kl: 3.713442802429199 (3.713442802429199) | > loss_feat: 1.4203835725784302 (1.4203835725784302) | > loss_mel: 20.407812118530273 (20.407812118530273) | > loss_duration: 2.755539894104004 (2.755539894104004) | > loss_1: 30.041725158691406 (30.041725158691406)  --> STEP: 2 | > loss_disc: 3.0286669731140137 (2.895244836807251) | > loss_disc_real_0: 0.4263889789581299 (0.35942669212818146) | > loss_disc_real_1: 0.20311036705970764 (0.21742688119411469) | > loss_disc_real_2: 0.33819854259490967 (0.2631063908338547) | > loss_disc_real_3: 0.25061970949172974 (0.24284233152866364) | > loss_disc_real_4: 0.15933175384998322 (0.20482436567544937) | > loss_disc_real_5: 0.4883815348148346 (0.3466281592845917) | > loss_0: 3.0286669731140137 (2.895244836807251) | > loss_gen: 2.207094430923462 (1.9758214950561523) | > loss_kl: 4.458465099334717 (4.085953950881958) | > loss_feat: 5.130247592926025 (3.275315582752228) | > loss_mel: 27.09920310974121 (23.753507614135742) | > loss_duration: 2.7786853313446045 (2.767112612724304) | > loss_1: 41.67369842529297 (35.85771179199219)  --> STEP: 3 | > loss_disc: 2.5041396617889404 (2.764876445134481) | > loss_disc_real_0: 0.27196598052978516 (0.3302731215953827) | > loss_disc_real_1: 0.3050105571746826 (0.246621439854304) | > loss_disc_real_2: 0.5288563370704651 (0.35168970624605816) | > loss_disc_real_3: 0.2819797694683075 (0.2558881441752116) | > loss_disc_real_4: 0.3019565939903259 (0.23720177511374155) | > loss_disc_real_5: 0.25972598791122437 (0.31766076882680255) | > loss_0: 2.5041396617889404 (2.764876445134481) | > loss_gen: 3.413240909576416 (2.4549612998962402) | > loss_kl: 2.102435827255249 (3.424781243006388) | > loss_feat: 5.253683090209961 (3.934771418571472) | > loss_mel: 20.79771614074707 (22.76824378967285) | > loss_duration: 2.552838087081909 (2.695687770843506) | > loss_1: 34.11991500854492 (35.278446197509766) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025257269541422525 (-0.007225195566813152) | > avg_loss_disc: 2.764876445134481 (-0.05992976824442531) | > avg_loss_disc_real_0: 0.3302731215953827 (+0.0447697639465332) | > avg_loss_disc_real_1: 0.246621439854304 (-0.046894967555999784) | > avg_loss_disc_real_2: 0.35168970624605816 (+0.07054722309112549) | > avg_loss_disc_real_3: 0.2558881441752116 (-0.02108790973822272) | > avg_loss_disc_real_4: 0.23720177511374155 (-0.1365858167409897) | > avg_loss_disc_real_5: 0.31766076882680255 (+0.06430167953173316) | > avg_loss_0: 2.764876445134481 (-0.05992976824442531) | > avg_loss_gen: 2.4549612998962402 (+0.1090925534566245) | > avg_loss_kl: 3.424781243006388 (+0.032018979390461944) | > avg_loss_feat: 3.934771418571472 (-0.33673298358917236) | > avg_loss_mel: 22.76824378967285 (-3.0482654571533203) | > avg_loss_duration: 2.695687770843506 (-0.24157293637593602) | > avg_loss_1: 35.278446197509766 (-3.485459645589195)  > EPOCH: 486/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:00:38)   --> TIME: 2023-10-20 05:00:47 -- STEP: 9/50 -- GLOBAL_STEP: 77310 | > loss_disc: 2.837998390197754 (2.2455645402272544) | > loss_disc_real_0: 0.28501367568969727 (0.13745434996154574) | > loss_disc_real_1: 0.33013731241226196 (0.2481874492433336) | > loss_disc_real_2: 0.27157512307167053 (0.22282516459623972) | > loss_disc_real_3: 0.2802808880805969 (0.24013232605324852) | > loss_disc_real_4: 0.30007100105285645 (0.17221955955028534) | > loss_disc_real_5: 0.25219422578811646 (0.1650080643594265) | > loss_0: 2.837998390197754 (2.2455645402272544) | > grad_norm_0: tensor(416.6443, device='cuda:0') (tensor(517.8345, device='cuda:0')) | > loss_gen: 2.049704074859619 (2.5272248321109347) | > loss_kl: 0.6757310628890991 (0.8814416858885024) | > loss_feat: 1.0468273162841797 (5.785296228196886) | > loss_mel: 16.191547393798828 (22.38035096062554) | > loss_duration: 1.4807028770446777 (1.4780767493777804) | > loss_1: 21.44451332092285 (33.05239020453559) | > grad_norm_1: tensor(4971.3633, device='cuda:0') (tensor(20311.6816, device='cuda:0')) | > current_lr_0: 0.00012301262458605145 | > current_lr_1: 0.00012301262458605145 | > step_time: 0.508 (0.4929045836130778) | > loader_time: 0.0194 (0.02087985144721137)  --> TIME: 2023-10-20 05:01:04 -- STEP: 39/50 -- GLOBAL_STEP: 77340 | > loss_disc: 1.2812368869781494 (2.5550777912139893) | > loss_disc_real_0: 0.031042203307151794 (0.1580811333961976) | > loss_disc_real_1: 0.12924222648143768 (0.2418997197961196) | > loss_disc_real_2: 0.04964771494269371 (0.23991528525948524) | > loss_disc_real_3: 0.26826077699661255 (0.2538471581080021) | > loss_disc_real_4: 0.019646920263767242 (0.2201094311208297) | > loss_disc_real_5: 0.04487447440624237 (0.22751521338254976) | > loss_0: 1.2812368869781494 (2.5550777912139893) | > grad_norm_0: tensor(280.8253, device='cuda:0') (tensor(601.3426, device='cuda:0')) | > loss_gen: 3.0005242824554443 (2.250664521486331) | > loss_kl: 0.6569535136222839 (0.8888102937967349) | > loss_feat: 8.855912208557129 (4.857525594341449) | > loss_mel: 24.66797637939453 (22.55656513189658) | > loss_duration: 1.562630295753479 (1.509015083312988) | > loss_1: 38.743995666503906 (32.06258057325313) | > grad_norm_1: tensor(28315.9395, device='cuda:0') (tensor(17998.1758, device='cuda:0')) | > current_lr_0: 0.00012301262458605145 | > current_lr_1: 0.00012301262458605145 | > step_time: 0.534 (0.5116356519552377) | > loader_time: 0.0244 (0.019471003459050104)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.895674228668213 (2.895674228668213) | > loss_disc_real_0: 0.031717266887426376 (0.031717266887426376) | > loss_disc_real_1: 0.2575712502002716 (0.2575712502002716) | > loss_disc_real_2: 0.3909764289855957 (0.3909764289855957) | > loss_disc_real_3: 0.26547926664352417 (0.26547926664352417) | > loss_disc_real_4: 0.23901568353176117 (0.23901568353176117) | > loss_disc_real_5: 0.2539505660533905 (0.2539505660533905) | > loss_0: 2.895674228668213 (2.895674228668213) | > loss_gen: 1.5936816930770874 (1.5936816930770874) | > loss_kl: 4.925299167633057 (4.925299167633057) | > loss_feat: 1.758086919784546 (1.758086919784546) | > loss_mel: 23.16756248474121 (23.16756248474121) | > loss_duration: 2.5470566749572754 (2.5470566749572754) | > loss_1: 33.9916877746582 (33.9916877746582)  --> STEP: 1 | > loss_disc: 2.3580336570739746 (2.3580336570739746) | > loss_disc_real_0: 0.1641763299703598 (0.1641763299703598) | > loss_disc_real_1: 0.31316307187080383 (0.31316307187080383) | > loss_disc_real_2: 0.20601105690002441 (0.20601105690002441) | > loss_disc_real_3: 0.3214157819747925 (0.3214157819747925) | > loss_disc_real_4: 0.24268555641174316 (0.24268555641174316) | > loss_disc_real_5: 0.13553965091705322 (0.13553965091705322) | > loss_0: 2.3580336570739746 (2.3580336570739746) | > loss_gen: 2.556208372116089 (2.556208372116089) | > loss_kl: 4.21112585067749 (4.21112585067749) | > loss_feat: 6.822544574737549 (6.822544574737549) | > loss_mel: 20.354633331298828 (20.354633331298828) | > loss_duration: 2.808614730834961 (2.808614730834961) | > loss_1: 36.75312805175781 (36.75312805175781)  --> STEP: 2 | > loss_disc: 2.8602206707000732 (2.609127163887024) | > loss_disc_real_0: 0.17290955781936646 (0.16854294389486313) | > loss_disc_real_1: 0.2748982608318329 (0.29403066635131836) | > loss_disc_real_2: 0.29152554273605347 (0.24876829981803894) | > loss_disc_real_3: 0.29379305243492126 (0.3076044172048569) | > loss_disc_real_4: 0.2647232115268707 (0.25370438396930695) | > loss_disc_real_5: 0.24652928113937378 (0.1910344660282135) | > loss_0: 2.8602206707000732 (2.609127163887024) | > loss_gen: 1.7044382095336914 (2.13032329082489) | > loss_kl: 4.284217357635498 (4.247671604156494) | > loss_feat: 0.4228476583957672 (3.622696116566658) | > loss_mel: 20.35081672668457 (20.3527250289917) | > loss_duration: 2.7031006813049316 (2.7558577060699463) | > loss_1: 29.465421676635742 (33.10927486419678)  --> STEP: 3 | > loss_disc: 1.6572966575622559 (2.2918503284454346) | > loss_disc_real_0: 0.10761528462171555 (0.14823372413714728) | > loss_disc_real_1: 0.16623985767364502 (0.25143373012542725) | > loss_disc_real_2: 0.08845691382884979 (0.1953311711549759) | > loss_disc_real_3: 0.32559916377067566 (0.3136026660601298) | > loss_disc_real_4: 0.08975233137607574 (0.1990536997715632) | > loss_disc_real_5: 0.043113186955451965 (0.14172737300395966) | > loss_0: 1.6572966575622559 (2.2918503284454346) | > loss_gen: 2.566920757293701 (2.275855779647827) | > loss_kl: 2.063314437866211 (3.5195525487264) | > loss_feat: 7.83175802230835 (5.0257167518138885) | > loss_mel: 25.24945831298828 (21.98496945699056) | > loss_duration: 2.6695456504821777 (2.7270870208740234) | > loss_1: 40.38099670410156 (35.53318214416504) --> EVAL PERFORMANCE | > avg_loader_time: 0.006404558817545573 (+0.0038788318634033207) | > avg_loss_disc: 2.2918503284454346 (-0.47302611668904637) | > avg_loss_disc_real_0: 0.14823372413714728 (-0.1820393974582354) | > avg_loss_disc_real_1: 0.25143373012542725 (+0.00481229027112326) | > avg_loss_disc_real_2: 0.1953311711549759 (-0.15635853509108227) | > avg_loss_disc_real_3: 0.3136026660601298 (+0.05771452188491821) | > avg_loss_disc_real_4: 0.1990536997715632 (-0.038148075342178345) | > avg_loss_disc_real_5: 0.14172737300395966 (-0.1759333958228429) | > avg_loss_0: 2.2918503284454346 (-0.47302611668904637) | > avg_loss_gen: 2.275855779647827 (-0.17910552024841309) | > avg_loss_kl: 3.5195525487264 (+0.09477130572001169) | > avg_loss_feat: 5.0257167518138885 (+1.0909453332424164) | > avg_loss_mel: 21.98496945699056 (-0.7832743326822929) | > avg_loss_duration: 2.7270870208740234 (+0.03139925003051758) | > avg_loss_1: 35.53318214416504 (+0.25473594665527344)  > EPOCH: 487/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:01:20)   --> TIME: 2023-10-20 05:01:32 -- STEP: 19/50 -- GLOBAL_STEP: 77370 | > loss_disc: 2.86622953414917 (2.463966633144178) | > loss_disc_real_0: 0.26449495553970337 (0.1510574980884006) | > loss_disc_real_1: 0.24281030893325806 (0.21894537539858566) | > loss_disc_real_2: 0.22032655775547028 (0.2036009677930882) | > loss_disc_real_3: 0.21528083086013794 (0.2518954792207009) | > loss_disc_real_4: 0.25055837631225586 (0.20656226496947439) | > loss_disc_real_5: 0.22837558388710022 (0.24057650095538088) | > loss_0: 2.86622953414917 (2.463966633144178) | > grad_norm_0: tensor(482.0193, device='cuda:0') (tensor(521.3722, device='cuda:0')) | > loss_gen: 1.6312042474746704 (2.3816095653333162) | > loss_kl: 1.0135116577148438 (0.8140547746106198) | > loss_feat: 0.5269123315811157 (4.796075034298394) | > loss_mel: 10.78896713256836 (20.068346400009958) | > loss_duration: 1.6166181564331055 (1.5659162308040417) | > loss_1: 15.577214241027832 (29.626001910159463) | > grad_norm_1: tensor(6366.5283, device='cuda:0') (tensor(22852.7734, device='cuda:0')) | > current_lr_0: 0.00012288966576603618 | > current_lr_1: 0.00012288966576603618 | > step_time: 0.6489 (0.39305754711753443) | > loader_time: 0.024 (0.012291619652195981)  --> TIME: 2023-10-20 05:01:47 -- STEP: 49/50 -- GLOBAL_STEP: 77400 | > loss_disc: 2.3861446380615234 (2.4838449492746464) | > loss_disc_real_0: 0.20804214477539062 (0.14917880595110505) | > loss_disc_real_1: 0.2853785753250122 (0.22510360302973767) | > loss_disc_real_2: 0.28048765659332275 (0.2200172522998586) | > loss_disc_real_3: 0.3109917938709259 (0.23639575709417768) | > loss_disc_real_4: 0.20701047778129578 (0.2101944361110123) | > loss_disc_real_5: 0.17602476477622986 (0.21312717561210906) | > loss_0: 2.3861446380615234 (2.4838449492746464) | > grad_norm_0: tensor(1176.7648, device='cuda:0') (tensor(548.1613, device='cuda:0')) | > loss_gen: 2.8273262977600098 (2.321906257648857) | > loss_kl: 0.9520864486694336 (0.8295353608472007) | > loss_feat: 5.2078351974487305 (4.910963108344954) | > loss_mel: 22.473888397216797 (20.25432456756125) | > loss_duration: 1.6615262031555176 (1.5194586296470798) | > loss_1: 33.12266159057617 (29.836187810313945) | > grad_norm_1: tensor(31584.5547, device='cuda:0') (tensor(20831.7207, device='cuda:0')) | > current_lr_0: 0.00012288966576603618 | > current_lr_1: 0.00012288966576603618 | > step_time: 0.4478 (0.45309029306684223) | > loader_time: 0.3708 (0.02205583513999472)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.014569044113159 (3.014569044113159) | > loss_disc_real_0: 0.5170643925666809 (0.5170643925666809) | > loss_disc_real_1: 0.3312980830669403 (0.3312980830669403) | > loss_disc_real_2: 0.4336370825767517 (0.4336370825767517) | > loss_disc_real_3: 0.3794395625591278 (0.3794395625591278) | > loss_disc_real_4: 0.2554708421230316 (0.2554708421230316) | > loss_disc_real_5: 0.23027671873569489 (0.23027671873569489) | > loss_0: 3.014569044113159 (3.014569044113159) | > loss_gen: 2.9925172328948975 (2.9925172328948975) | > loss_kl: 3.75289249420166 (3.75289249420166) | > loss_feat: 5.189752578735352 (5.189752578735352) | > loss_mel: 25.014986038208008 (25.014986038208008) | > loss_duration: 2.5990307331085205 (2.5990307331085205) | > loss_1: 39.54917526245117 (39.54917526245117)  --> STEP: 1 | > loss_disc: 2.725984811782837 (2.725984811782837) | > loss_disc_real_0: 0.39368996024131775 (0.39368996024131775) | > loss_disc_real_1: 0.27882707118988037 (0.27882707118988037) | > loss_disc_real_2: 0.2763383388519287 (0.2763383388519287) | > loss_disc_real_3: 0.28194308280944824 (0.28194308280944824) | > loss_disc_real_4: 0.24361059069633484 (0.24361059069633484) | > loss_disc_real_5: 0.2212730497121811 (0.2212730497121811) | > loss_0: 2.725984811782837 (2.725984811782837) | > loss_gen: 2.387829542160034 (2.387829542160034) | > loss_kl: 4.230005741119385 (4.230005741119385) | > loss_feat: 1.9128128290176392 (1.9128128290176392) | > loss_mel: 21.481128692626953 (21.481128692626953) | > loss_duration: 2.8351712226867676 (2.8351712226867676) | > loss_1: 32.846946716308594 (32.846946716308594)  --> STEP: 2 | > loss_disc: 2.464245080947876 (2.5951149463653564) | > loss_disc_real_0: 0.3159142732620239 (0.35480211675167084) | > loss_disc_real_1: 0.21845676004886627 (0.24864191561937332) | > loss_disc_real_2: 0.20746351778507233 (0.24190092831850052) | > loss_disc_real_3: 0.2489389032125473 (0.26544099301099777) | > loss_disc_real_4: 0.13033828139305115 (0.186974436044693) | > loss_disc_real_5: 0.151579812169075 (0.18642643094062805) | > loss_0: 2.464245080947876 (2.5951149463653564) | > loss_gen: 2.1710903644561768 (2.2794599533081055) | > loss_kl: 4.519262313842773 (4.374634027481079) | > loss_feat: 4.096230983734131 (3.004521906375885) | > loss_mel: 14.063543319702148 (17.77233600616455) | > loss_duration: 2.71795654296875 (2.776563882827759) | > loss_1: 27.568084716796875 (30.207515716552734)  --> STEP: 3 | > loss_disc: 3.04612135887146 (2.745450417200724) | > loss_disc_real_0: 0.4255272150039673 (0.37837714950243634) | > loss_disc_real_1: 0.2818884551525116 (0.25972409546375275) | > loss_disc_real_2: 0.29494425654411316 (0.2595820377270381) | > loss_disc_real_3: 0.2977815568447113 (0.27622118095556897) | > loss_disc_real_4: 0.2825983762741089 (0.21884908278783163) | > loss_disc_real_5: 0.2550998032093048 (0.20931755503018698) | > loss_0: 3.04612135887146 (2.745450417200724) | > loss_gen: 1.9549121856689453 (2.1712773640950522) | > loss_kl: 2.080545663833618 (3.609937906265259) | > loss_feat: 0.6619840860366821 (2.2236759662628174) | > loss_mel: 15.989448547363281 (17.17804018656413) | > loss_duration: 2.6007139682769775 (2.717947244644165) | > loss_1: 23.28760528564453 (27.90087890625) --> EVAL PERFORMANCE | > avg_loader_time: 0.010797421137491861 (+0.004392862319946288) | > avg_loss_disc: 2.745450417200724 (+0.45360008875528957) | > avg_loss_disc_real_0: 0.37837714950243634 (+0.23014342536528906) | > avg_loss_disc_real_1: 0.25972409546375275 (+0.0082903653383255) | > avg_loss_disc_real_2: 0.2595820377270381 (+0.06425086657206219) | > avg_loss_disc_real_3: 0.27622118095556897 (-0.03738148510456085) | > avg_loss_disc_real_4: 0.21884908278783163 (+0.01979538301626843) | > avg_loss_disc_real_5: 0.20931755503018698 (+0.06759018202622732) | > avg_loss_0: 2.745450417200724 (+0.45360008875528957) | > avg_loss_gen: 2.1712773640950522 (-0.10457841555277492) | > avg_loss_kl: 3.609937906265259 (+0.0903853575388589) | > avg_loss_feat: 2.2236759662628174 (-2.802040785551071) | > avg_loss_mel: 17.17804018656413 (-4.80692927042643) | > avg_loss_duration: 2.717947244644165 (-0.009139776229858398) | > avg_loss_1: 27.90087890625 (-7.632303237915039)  > EPOCH: 488/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:02:00)   --> TIME: 2023-10-20 05:02:17 -- STEP: 29/50 -- GLOBAL_STEP: 77430 | > loss_disc: 2.8120830059051514 (2.509042702872178) | > loss_disc_real_0: 0.2162991464138031 (0.1645032724301363) | > loss_disc_real_1: 0.24608741700649261 (0.23289802811782936) | > loss_disc_real_2: 0.35013294219970703 (0.23293216282437587) | > loss_disc_real_3: 0.24923038482666016 (0.23465208478015043) | > loss_disc_real_4: 0.27826330065727234 (0.2564566334516838) | > loss_disc_real_5: 0.38834142684936523 (0.2327928323427151) | > loss_0: 2.8120830059051514 (2.509042702872178) | > grad_norm_0: tensor(322.7796, device='cuda:0') (tensor(554.1556, device='cuda:0')) | > loss_gen: 2.152984619140625 (2.2966831716997875) | > loss_kl: 0.6159505248069763 (0.9343963748422163) | > loss_feat: 2.493476629257202 (5.186175581581634) | > loss_mel: 23.564319610595703 (21.960240125656128) | > loss_duration: 1.4864546060562134 (1.5339392341416458) | > loss_1: 30.31318473815918 (31.91143432156793) | > grad_norm_1: tensor(2932.7495, device='cuda:0') (tensor(17966.0996, device='cuda:0')) | > current_lr_0: 0.00012276682985105998 | > current_lr_1: 0.00012276682985105998 | > step_time: 0.2649 (0.43687188214269174) | > loader_time: 0.0024 (0.01164502110974542)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0506930351257324 (2.0506930351257324) | > loss_disc_real_0: 0.24908697605133057 (0.24908697605133057) | > loss_disc_real_1: 0.1012142226099968 (0.1012142226099968) | > loss_disc_real_2: 0.20629525184631348 (0.20629525184631348) | > loss_disc_real_3: 0.21353153884410858 (0.21353153884410858) | > loss_disc_real_4: 0.19595961272716522 (0.19595961272716522) | > loss_disc_real_5: 0.2709461450576782 (0.2709461450576782) | > loss_0: 2.0506930351257324 (2.0506930351257324) | > loss_gen: 2.810908317565918 (2.810908317565918) | > loss_kl: 3.3595736026763916 (3.3595736026763916) | > loss_feat: 7.012945652008057 (7.012945652008057) | > loss_mel: 23.880884170532227 (23.880884170532227) | > loss_duration: 2.484050989151001 (2.484050989151001) | > loss_1: 39.548362731933594 (39.548362731933594)  --> STEP: 1 | > loss_disc: 2.07364821434021 (2.07364821434021) | > loss_disc_real_0: 0.2697972059249878 (0.2697972059249878) | > loss_disc_real_1: 0.11608356237411499 (0.11608356237411499) | > loss_disc_real_2: 0.22219184041023254 (0.22219184041023254) | > loss_disc_real_3: 0.22936084866523743 (0.22936084866523743) | > loss_disc_real_4: 0.1928805410861969 (0.1928805410861969) | > loss_disc_real_5: 0.14782728254795074 (0.14782728254795074) | > loss_0: 2.07364821434021 (2.07364821434021) | > loss_gen: 2.7144086360931396 (2.7144086360931396) | > loss_kl: 3.482407808303833 (3.482407808303833) | > loss_feat: 5.5530548095703125 (5.5530548095703125) | > loss_mel: 25.533870697021484 (25.533870697021484) | > loss_duration: 2.6894071102142334 (2.6894071102142334) | > loss_1: 39.973148345947266 (39.973148345947266)  --> STEP: 2 | > loss_disc: 2.407388210296631 (2.2405182123184204) | > loss_disc_real_0: 0.4710500240325928 (0.3704236149787903) | > loss_disc_real_1: 0.10239463299512863 (0.10923909768462181) | > loss_disc_real_2: 0.09518591314554214 (0.15868887677788734) | > loss_disc_real_3: 0.10923586040735245 (0.16929835453629494) | > loss_disc_real_4: 0.16069607436656952 (0.1767883077263832) | > loss_disc_real_5: 0.10089565068483353 (0.12436146661639214) | > loss_0: 2.407388210296631 (2.2405182123184204) | > loss_gen: 3.5921308994293213 (3.1532697677612305) | > loss_kl: 4.136228561401367 (3.8093181848526) | > loss_feat: 9.543689727783203 (7.548372268676758) | > loss_mel: 23.376028060913086 (24.454949378967285) | > loss_duration: 2.6823999881744385 (2.685903549194336) | > loss_1: 43.33047866821289 (41.65181350708008)  --> STEP: 3 | > loss_disc: 2.9544851779937744 (2.4785072008768716) | > loss_disc_real_0: 0.31860774755477905 (0.35315165917078656) | > loss_disc_real_1: 0.27501797676086426 (0.1644987240433693) | > loss_disc_real_2: 0.33152586221694946 (0.2163012052575747) | > loss_disc_real_3: 0.3028097450733185 (0.21380215138196945) | > loss_disc_real_4: 0.2267998903989792 (0.1934588352839152) | > loss_disc_real_5: 0.27107343077659607 (0.17326545466979346) | > loss_0: 2.9544851779937744 (2.4785072008768716) | > loss_gen: 1.8263541460037231 (2.710964560508728) | > loss_kl: 1.946018934249878 (3.188218434651693) | > loss_feat: 0.5680646300315857 (5.2216030557950335) | > loss_mel: 17.38534164428711 (22.098413467407227) | > loss_duration: 2.656093120574951 (2.675966739654541) | > loss_1: 24.381874084472656 (35.8951670328776) --> EVAL PERFORMANCE | > avg_loader_time: 0.008591175079345703 (-0.0022062460581461583) | > avg_loss_disc: 2.4785072008768716 (-0.26694321632385254) | > avg_loss_disc_real_0: 0.35315165917078656 (-0.02522549033164978) | > avg_loss_disc_real_1: 0.1644987240433693 (-0.09522537142038345) | > avg_loss_disc_real_2: 0.2163012052575747 (-0.043280832469463376) | > avg_loss_disc_real_3: 0.21380215138196945 (-0.062419029573599516) | > avg_loss_disc_real_4: 0.1934588352839152 (-0.02539024750391644) | > avg_loss_disc_real_5: 0.17326545466979346 (-0.036052100360393524) | > avg_loss_0: 2.4785072008768716 (-0.26694321632385254) | > avg_loss_gen: 2.710964560508728 (+0.5396871964136758) | > avg_loss_kl: 3.188218434651693 (-0.42171947161356593) | > avg_loss_feat: 5.2216030557950335 (+2.997927089532216) | > avg_loss_mel: 22.098413467407227 (+4.920373280843098) | > avg_loss_duration: 2.675966739654541 (-0.04198050498962402) | > avg_loss_1: 35.8951670328776 (+7.994288126627602)  > EPOCH: 489/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:02:37)   --> TIME: 2023-10-20 05:02:47 -- STEP: 9/50 -- GLOBAL_STEP: 77460 | > loss_disc: 3.004108428955078 (2.5620501571231418) | > loss_disc_real_0: 0.2480359673500061 (0.21396816853019926) | > loss_disc_real_1: 0.3151360750198364 (0.24800851113266414) | > loss_disc_real_2: 0.2857055962085724 (0.25847724576791126) | > loss_disc_real_3: 0.34560251235961914 (0.26874055589238804) | > loss_disc_real_4: 0.23931704461574554 (0.1743114133261972) | > loss_disc_real_5: 0.26830384135246277 (0.18966345137192142) | > loss_0: 3.004108428955078 (2.5620501571231418) | > grad_norm_0: tensor(470.8679, device='cuda:0') (tensor(465.1401, device='cuda:0')) | > loss_gen: 1.720110297203064 (2.213536169793871) | > loss_kl: 0.8275490999221802 (0.9491135080655416) | > loss_feat: 0.17036652565002441 (5.327153891324997) | > loss_mel: 3.364609479904175 (18.505222188101875) | > loss_duration: 1.459527850151062 (1.5341789060168796) | > loss_1: 7.542163372039795 (28.529204103681778) | > grad_norm_1: tensor(10993.1250, device='cuda:0') (tensor(16600.5215, device='cuda:0')) | > current_lr_0: 0.0001226441167182714 | > current_lr_1: 0.0001226441167182714 | > step_time: 0.5959 (0.5483387046390109) | > loader_time: 0.0244 (0.01958452330695258)  --> TIME: 2023-10-20 05:03:03 -- STEP: 39/50 -- GLOBAL_STEP: 77490 | > loss_disc: 2.5888161659240723 (2.5153235472165623) | > loss_disc_real_0: 0.06608717143535614 (0.175598733795759) | > loss_disc_real_1: 0.3025050759315491 (0.2256843457237268) | > loss_disc_real_2: 0.2629656493663788 (0.24518425281470022) | > loss_disc_real_3: 0.2291594296693802 (0.24152647882986528) | > loss_disc_real_4: 0.24478158354759216 (0.21677737339184835) | > loss_disc_real_5: 0.37529534101486206 (0.24525932690654045) | > loss_0: 2.5888161659240723 (2.5153235472165623) | > grad_norm_0: tensor(469.4646, device='cuda:0') (tensor(540.1714, device='cuda:0')) | > loss_gen: 2.2654476165771484 (2.331560718707549) | > loss_kl: 0.6254624128341675 (0.8773855454264543) | > loss_feat: 4.339904308319092 (5.688181687528506) | > loss_mel: 19.909757614135742 (21.320486484429782) | > loss_duration: 1.5565142631530762 (1.5348880199285655) | > loss_1: 28.697086334228516 (31.752502685938126) | > grad_norm_1: tensor(9053.5654, device='cuda:0') (tensor(22032.0488, device='cuda:0')) | > current_lr_0: 0.0001226441167182714 | > current_lr_1: 0.0001226441167182714 | > step_time: 0.5473 (0.5060305106334198) | > loader_time: 0.0249 (0.019479806606586162)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1319947242736816 (2.1319947242736816) | > loss_disc_real_0: 0.14337317645549774 (0.14337317645549774) | > loss_disc_real_1: 0.21034899353981018 (0.21034899353981018) | > loss_disc_real_2: 0.1966475397348404 (0.1966475397348404) | > loss_disc_real_3: 0.22238218784332275 (0.22238218784332275) | > loss_disc_real_4: 0.07303658127784729 (0.07303658127784729) | > loss_disc_real_5: 0.10898590087890625 (0.10898590087890625) | > loss_0: 2.1319947242736816 (2.1319947242736816) | > loss_gen: 2.4510581493377686 (2.4510581493377686) | > loss_kl: 3.3334460258483887 (3.3334460258483887) | > loss_feat: 8.08094596862793 (8.08094596862793) | > loss_mel: 23.439390182495117 (23.439390182495117) | > loss_duration: 2.6639459133148193 (2.6639459133148193) | > loss_1: 39.96878433227539 (39.96878433227539)  --> STEP: 1 | > loss_disc: 2.743410587310791 (2.743410587310791) | > loss_disc_real_0: 0.17034730315208435 (0.17034730315208435) | > loss_disc_real_1: 0.29662564396858215 (0.29662564396858215) | > loss_disc_real_2: 0.3010842800140381 (0.3010842800140381) | > loss_disc_real_3: 0.2775117754936218 (0.2775117754936218) | > loss_disc_real_4: 0.2608495056629181 (0.2608495056629181) | > loss_disc_real_5: 0.16695427894592285 (0.16695427894592285) | > loss_0: 2.743410587310791 (2.743410587310791) | > loss_gen: 1.9037408828735352 (1.9037408828735352) | > loss_kl: 3.607146739959717 (3.607146739959717) | > loss_feat: 4.735172271728516 (4.735172271728516) | > loss_mel: 24.158323287963867 (24.158323287963867) | > loss_duration: 2.7240633964538574 (2.7240633964538574) | > loss_1: 37.12844467163086 (37.12844467163086)  --> STEP: 2 | > loss_disc: 1.7384350299835205 (2.2409228086471558) | > loss_disc_real_0: 0.040102846920490265 (0.10522507503628731) | > loss_disc_real_1: 0.12012600153684616 (0.20837582275271416) | > loss_disc_real_2: 0.10101309418678284 (0.20104868710041046) | > loss_disc_real_3: 0.19777430593967438 (0.2376430407166481) | > loss_disc_real_4: 0.050726283341646194 (0.15578789450228214) | > loss_disc_real_5: 0.05378854647278786 (0.11037141270935535) | > loss_0: 1.7384350299835205 (2.2409228086471558) | > loss_gen: 2.642883539199829 (2.273312211036682) | > loss_kl: 4.461641311645508 (4.034394025802612) | > loss_feat: 11.450749397277832 (8.092960834503174) | > loss_mel: 26.2425594329834 (25.200441360473633) | > loss_duration: 2.681077241897583 (2.70257031917572) | > loss_1: 47.47890853881836 (42.30367660522461)  --> STEP: 3 | > loss_disc: 2.0835580825805664 (2.1884678999582925) | > loss_disc_real_0: 0.05995762348175049 (0.09013592451810837) | > loss_disc_real_1: 0.3191410303115845 (0.24529755860567093) | > loss_disc_real_2: 0.21417255699634552 (0.20542331039905548) | > loss_disc_real_3: 0.3099595010280609 (0.261748527487119) | > loss_disc_real_4: 0.33575180172920227 (0.2157758635779222) | > loss_disc_real_5: 0.12877203524112701 (0.11650495355327924) | > loss_0: 2.0835580825805664 (2.1884678999582925) | > loss_gen: 2.7698802947998047 (2.4388349056243896) | > loss_kl: 2.2280020713806152 (3.4322633743286133) | > loss_feat: 5.90438175201416 (7.363434473673503) | > loss_mel: 23.590578079223633 (24.663820266723633) | > loss_duration: 2.6680493354797363 (2.691063324610392) | > loss_1: 37.160892486572266 (40.58941523234049) --> EVAL PERFORMANCE | > avg_loader_time: 0.002932866414388021 (-0.005658308664957682) | > avg_loss_disc: 2.1884678999582925 (-0.2900393009185791) | > avg_loss_disc_real_0: 0.09013592451810837 (-0.2630157346526782) | > avg_loss_disc_real_1: 0.24529755860567093 (+0.08079883456230164) | > avg_loss_disc_real_2: 0.20542331039905548 (-0.010877894858519227) | > avg_loss_disc_real_3: 0.261748527487119 (+0.04794637610514957) | > avg_loss_disc_real_4: 0.2157758635779222 (+0.022317028294007002) | > avg_loss_disc_real_5: 0.11650495355327924 (-0.05676050111651422) | > avg_loss_0: 2.1884678999582925 (-0.2900393009185791) | > avg_loss_gen: 2.4388349056243896 (-0.2721296548843384) | > avg_loss_kl: 3.4322633743286133 (+0.24404493967692042) | > avg_loss_feat: 7.363434473673503 (+2.1418314178784694) | > avg_loss_mel: 24.663820266723633 (+2.5654067993164062) | > avg_loss_duration: 2.691063324610392 (+0.015096584955851089) | > avg_loss_1: 40.58941523234049 (+4.694248199462891)  > EPOCH: 490/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:03:20)   --> TIME: 2023-10-20 05:03:33 -- STEP: 19/50 -- GLOBAL_STEP: 77520 | > loss_disc: 2.7787790298461914 (2.5424365746347526) | > loss_disc_real_0: 0.4012431800365448 (0.18320532216641464) | > loss_disc_real_1: 0.2631334066390991 (0.23099431807273313) | > loss_disc_real_2: 0.21055249869823456 (0.2283450722890465) | > loss_disc_real_3: 0.23718146979808807 (0.25564081682578516) | > loss_disc_real_4: 0.24180464446544647 (0.23638102804359637) | > loss_disc_real_5: 0.27268314361572266 (0.23395584261436997) | > loss_0: 2.7787790298461914 (2.5424365746347526) | > grad_norm_0: tensor(736.5804, device='cuda:0') (tensor(768.6970, device='cuda:0')) | > loss_gen: 2.022860527038574 (2.3316802225614848) | > loss_kl: 0.8680787086486816 (0.8521041117216411) | > loss_feat: 1.4381123781204224 (4.78554441583784) | > loss_mel: 8.670369148254395 (20.620240412260358) | > loss_duration: 1.662436604499817 (1.5526664194307829) | > loss_1: 14.661857604980469 (30.142235680630332) | > grad_norm_1: tensor(23578.9746, device='cuda:0') (tensor(26456.2578, device='cuda:0')) | > current_lr_0: 0.00012252152624494207 | > current_lr_1: 0.00012252152624494207 | > step_time: 0.3345 (0.48702454566955566) | > loader_time: 0.0018 (0.012535609697040758)  --> TIME: 2023-10-20 05:03:50 -- STEP: 49/50 -- GLOBAL_STEP: 77550 | > loss_disc: 2.7872941493988037 (2.5414908856761698) | > loss_disc_real_0: 0.18280865252017975 (0.17324740886308101) | > loss_disc_real_1: 0.12898075580596924 (0.21815951928800467) | > loss_disc_real_2: 0.24430184066295624 (0.2227793449573979) | > loss_disc_real_3: 0.2925647795200348 (0.2440135732521208) | > loss_disc_real_4: 0.14860358834266663 (0.23319039744686107) | > loss_disc_real_5: 0.21106670796871185 (0.23465725259703338) | > loss_0: 2.7872941493988037 (2.5414908856761698) | > grad_norm_0: tensor(435.1111, device='cuda:0') (tensor(757.4153, device='cuda:0')) | > loss_gen: 2.2615199089050293 (2.280573562699921) | > loss_kl: 0.7469058036804199 (0.8201294048708312) | > loss_feat: 7.172790050506592 (4.760747550093399) | > loss_mel: 33.2779541015625 (21.785833748019478) | > loss_duration: 1.6440025568008423 (1.517929612373819) | > loss_1: 45.103172302246094 (31.16521382818417) | > grad_norm_1: tensor(35881.4570, device='cuda:0') (tensor(19148.2305, device='cuda:0')) | > current_lr_0: 0.00012252152624494207 | > current_lr_1: 0.00012252152624494207 | > step_time: 0.598 (0.5146036342698701) | > loader_time: 0.6756 (0.030168907982962474)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.55454683303833 (2.55454683303833) | > loss_disc_real_0: 0.2602560818195343 (0.2602560818195343) | > loss_disc_real_1: 0.37532350420951843 (0.37532350420951843) | > loss_disc_real_2: 0.23412185907363892 (0.23412185907363892) | > loss_disc_real_3: 0.40178391337394714 (0.40178391337394714) | > loss_disc_real_4: 0.2090531885623932 (0.2090531885623932) | > loss_disc_real_5: 0.18728995323181152 (0.18728995323181152) | > loss_0: 2.55454683303833 (2.55454683303833) | > loss_gen: 2.532029867172241 (2.532029867172241) | > loss_kl: 3.6026742458343506 (3.6026742458343506) | > loss_feat: 7.13572359085083 (7.13572359085083) | > loss_mel: 22.950510025024414 (22.950510025024414) | > loss_duration: 2.4876537322998047 (2.4876537322998047) | > loss_1: 38.708587646484375 (38.708587646484375)  --> STEP: 1 | > loss_disc: 2.7320849895477295 (2.7320849895477295) | > loss_disc_real_0: 0.22243349254131317 (0.22243349254131317) | > loss_disc_real_1: 0.29617825150489807 (0.29617825150489807) | > loss_disc_real_2: 0.2508848309516907 (0.2508848309516907) | > loss_disc_real_3: 0.28950875997543335 (0.28950875997543335) | > loss_disc_real_4: 0.20472988486289978 (0.20472988486289978) | > loss_disc_real_5: 0.23175808787345886 (0.23175808787345886) | > loss_0: 2.7320849895477295 (2.7320849895477295) | > loss_gen: 1.928647756576538 (1.928647756576538) | > loss_kl: 4.2877302169799805 (4.2877302169799805) | > loss_feat: 2.400597095489502 (2.400597095489502) | > loss_mel: 20.156116485595703 (20.156116485595703) | > loss_duration: 2.8355183601379395 (2.8355183601379395) | > loss_1: 31.608610153198242 (31.608610153198242)  --> STEP: 2 | > loss_disc: 2.4238297939300537 (2.5779573917388916) | > loss_disc_real_0: 0.19904667139053345 (0.2107400819659233) | > loss_disc_real_1: 0.5180478692054749 (0.40711306035518646) | > loss_disc_real_2: 0.2097349762916565 (0.23030990362167358) | > loss_disc_real_3: 0.3671721816062927 (0.32834047079086304) | > loss_disc_real_4: 0.1446303129196167 (0.17468009889125824) | > loss_disc_real_5: 0.15742933750152588 (0.19459371268749237) | > loss_0: 2.4238297939300537 (2.5779573917388916) | > loss_gen: 2.720363140106201 (2.3245054483413696) | > loss_kl: 4.6447577476501465 (4.4662439823150635) | > loss_feat: 5.194114685058594 (3.797355890274048) | > loss_mel: 25.439193725585938 (22.79765510559082) | > loss_duration: 2.7597625255584717 (2.7976404428482056) | > loss_1: 40.75819396972656 (36.1834020614624)  --> STEP: 3 | > loss_disc: 2.0750672817230225 (2.410327355066935) | > loss_disc_real_0: 0.10558907687664032 (0.17568974693616232) | > loss_disc_real_1: 0.28698334097862244 (0.3670698205629985) | > loss_disc_real_2: 0.22732305526733398 (0.2293142875035604) | > loss_disc_real_3: 0.28050291538238525 (0.3123946189880371) | > loss_disc_real_4: 0.11711696535348892 (0.1554923877120018) | > loss_disc_real_5: 0.08816365152597427 (0.15911702563365301) | > loss_0: 2.0750672817230225 (2.410327355066935) | > loss_gen: 2.6438047885894775 (2.4309385617574057) | > loss_kl: 1.5204017162322998 (3.4842965602874756) | > loss_feat: 6.718521595001221 (4.771077791849772) | > loss_mel: 24.953514099121094 (23.51627477010091) | > loss_duration: 2.520038604736328 (2.705106496810913) | > loss_1: 38.35628128051758 (36.9076951344808) --> EVAL PERFORMANCE | > avg_loader_time: 0.011390924453735352 (+0.00845805803934733) | > avg_loss_disc: 2.410327355066935 (+0.22185945510864258) | > avg_loss_disc_real_0: 0.17568974693616232 (+0.08555382241805395) | > avg_loss_disc_real_1: 0.3670698205629985 (+0.12177226195732754) | > avg_loss_disc_real_2: 0.2293142875035604 (+0.023890977104504912) | > avg_loss_disc_real_3: 0.3123946189880371 (+0.05064609150091809) | > avg_loss_disc_real_4: 0.1554923877120018 (-0.060283475865920394) | > avg_loss_disc_real_5: 0.15911702563365301 (+0.04261207208037378) | > avg_loss_0: 2.410327355066935 (+0.22185945510864258) | > avg_loss_gen: 2.4309385617574057 (-0.007896343866983901) | > avg_loss_kl: 3.4842965602874756 (+0.052033185958862305) | > avg_loss_feat: 4.771077791849772 (-2.5923566818237305) | > avg_loss_mel: 23.51627477010091 (-1.1475454966227225) | > avg_loss_duration: 2.705106496810913 (+0.014043172200520981) | > avg_loss_1: 36.9076951344808 (-3.681720097859696)  > EPOCH: 491/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:03:59)   --> TIME: 2023-10-20 05:04:14 -- STEP: 29/50 -- GLOBAL_STEP: 77580 | > loss_disc: 2.950106143951416 (2.408072229089408) | > loss_disc_real_0: 0.23007357120513916 (0.15104632420015746) | > loss_disc_real_1: 0.2333400845527649 (0.24660768488357807) | > loss_disc_real_2: 0.235234797000885 (0.21933194635243253) | > loss_disc_real_3: 0.2344527691602707 (0.23714379144125972) | > loss_disc_real_4: 0.23246660828590393 (0.23787545977995314) | > loss_disc_real_5: 0.2153269648551941 (0.21285484808272329) | > loss_0: 2.950106143951416 (2.408072229089408) | > grad_norm_0: tensor(380.2718, device='cuda:0') (tensor(493.2220, device='cuda:0')) | > loss_gen: 1.471602439880371 (2.33223413187882) | > loss_kl: 0.8186807036399841 (0.8975764584952387) | > loss_feat: 0.24223852157592773 (5.3690177330683015) | > loss_mel: 8.568840980529785 (20.8432879447937) | > loss_duration: 1.541174054145813 (1.5278032524832363) | > loss_1: 12.642537117004395 (30.969919681549072) | > grad_norm_1: tensor(16399.7031, device='cuda:0') (tensor(23802.7227, device='cuda:0')) | > current_lr_0: 0.00012239905830846613 | > current_lr_1: 0.00012239905830846613 | > step_time: 0.684 (0.3454905131767536) | > loader_time: 0.0247 (0.007763994151148303)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9377541542053223 (1.9377541542053223) | > loss_disc_real_0: 0.23175764083862305 (0.23175764083862305) | > loss_disc_real_1: 0.2503027319908142 (0.2503027319908142) | > loss_disc_real_2: 0.2233591377735138 (0.2233591377735138) | > loss_disc_real_3: 0.34111011028289795 (0.34111011028289795) | > loss_disc_real_4: 0.12496640533208847 (0.12496640533208847) | > loss_disc_real_5: 0.1126319169998169 (0.1126319169998169) | > loss_0: 1.9377541542053223 (1.9377541542053223) | > loss_gen: 3.1953933238983154 (3.1953933238983154) | > loss_kl: 3.8016884326934814 (3.8016884326934814) | > loss_feat: 7.617011070251465 (7.617011070251465) | > loss_mel: 25.75166130065918 (25.75166130065918) | > loss_duration: 2.5927608013153076 (2.5927608013153076) | > loss_1: 42.95851516723633 (42.95851516723633)  --> STEP: 1 | > loss_disc: 2.1609363555908203 (2.1609363555908203) | > loss_disc_real_0: 0.1354566216468811 (0.1354566216468811) | > loss_disc_real_1: 0.1903621107339859 (0.1903621107339859) | > loss_disc_real_2: 0.18595333397388458 (0.18595333397388458) | > loss_disc_real_3: 0.2754982113838196 (0.2754982113838196) | > loss_disc_real_4: 0.34749895334243774 (0.34749895334243774) | > loss_disc_real_5: 0.2425423562526703 (0.2425423562526703) | > loss_0: 2.1609363555908203 (2.1609363555908203) | > loss_gen: 3.0775909423828125 (3.0775909423828125) | > loss_kl: 4.351954460144043 (4.351954460144043) | > loss_feat: 8.225841522216797 (8.225841522216797) | > loss_mel: 24.283065795898438 (24.283065795898438) | > loss_duration: 2.8040640354156494 (2.8040640354156494) | > loss_1: 42.74251937866211 (42.74251937866211)  --> STEP: 2 | > loss_disc: 2.802255868911743 (2.4815961122512817) | > loss_disc_real_0: 0.27838921546936035 (0.20692291855812073) | > loss_disc_real_1: 0.21403074264526367 (0.2021964266896248) | > loss_disc_real_2: 0.22478385269641876 (0.20536859333515167) | > loss_disc_real_3: 0.3021387457847595 (0.28881847858428955) | > loss_disc_real_4: 0.2606833279132843 (0.304091140627861) | > loss_disc_real_5: 0.2964632213115692 (0.26950278878211975) | > loss_0: 2.802255868911743 (2.4815961122512817) | > loss_gen: 2.087946891784668 (2.5827689170837402) | > loss_kl: 4.395270824432373 (4.373612642288208) | > loss_feat: 1.9341943264007568 (5.080017924308777) | > loss_mel: 27.832883834838867 (26.057974815368652) | > loss_duration: 2.8062384128570557 (2.8051512241363525) | > loss_1: 39.05653762817383 (40.89952850341797)  --> STEP: 3 | > loss_disc: 2.341614246368408 (2.4349354902903237) | > loss_disc_real_0: 0.15461690723896027 (0.18948758145173392) | > loss_disc_real_1: 0.27750465273857117 (0.22729916870594025) | > loss_disc_real_2: 0.2828787863254547 (0.23120532433191934) | > loss_disc_real_3: 0.40585336089134216 (0.32783010601997375) | > loss_disc_real_4: 0.2758520245552063 (0.29467810193697613) | > loss_disc_real_5: 0.2918938398361206 (0.2769664724667867) | > loss_0: 2.341614246368408 (2.4349354902903237) | > loss_gen: 4.335474491119385 (3.167004108428955) | > loss_kl: 2.1004669666290283 (3.6158974170684814) | > loss_feat: 5.734307289123535 (5.298114379247029) | > loss_mel: 19.688770294189453 (23.934906641642254) | > loss_duration: 2.6933915615081787 (2.7678980032602944) | > loss_1: 34.55241012573242 (38.78382237752279) --> EVAL PERFORMANCE | > avg_loader_time: 0.014761209487915039 (+0.0033702850341796875) | > avg_loss_disc: 2.4349354902903237 (+0.024608135223388672) | > avg_loss_disc_real_0: 0.18948758145173392 (+0.013797834515571594) | > avg_loss_disc_real_1: 0.22729916870594025 (-0.13977065185705823) | > avg_loss_disc_real_2: 0.23120532433191934 (+0.0018910368283589496) | > avg_loss_disc_real_3: 0.32783010601997375 (+0.015435487031936646) | > avg_loss_disc_real_4: 0.29467810193697613 (+0.13918571422497433) | > avg_loss_disc_real_5: 0.2769664724667867 (+0.11784944683313367) | > avg_loss_0: 2.4349354902903237 (+0.024608135223388672) | > avg_loss_gen: 3.167004108428955 (+0.7360655466715493) | > avg_loss_kl: 3.6158974170684814 (+0.13160085678100586) | > avg_loss_feat: 5.298114379247029 (+0.5270365873972569) | > avg_loss_mel: 23.934906641642254 (+0.4186318715413435) | > avg_loss_duration: 2.7678980032602944 (+0.06279150644938136) | > avg_loss_1: 38.78382237752279 (+1.8761272430419922)  > EPOCH: 492/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:04:36)   --> TIME: 2023-10-20 05:04:45 -- STEP: 9/50 -- GLOBAL_STEP: 77610 | > loss_disc: 1.759894847869873 (2.231938746240404) | > loss_disc_real_0: 0.09504406154155731 (0.09710741063786878) | > loss_disc_real_1: 0.17749488353729248 (0.16539890546765593) | > loss_disc_real_2: 0.14548970758914948 (0.18364983631504905) | > loss_disc_real_3: 0.2333100140094757 (0.20459887799289492) | > loss_disc_real_4: 0.04679596796631813 (0.1609326412694322) | > loss_disc_real_5: 0.15596187114715576 (0.2347476202994585) | > loss_0: 1.759894847869873 (2.231938746240404) | > grad_norm_0: tensor(362.1743, device='cuda:0') (tensor(504.9862, device='cuda:0')) | > loss_gen: 2.7774252891540527 (2.6231855286492243) | > loss_kl: 0.6987572312355042 (0.8662136130862765) | > loss_feat: 6.064909934997559 (7.8905764950646295) | > loss_mel: 22.468778610229492 (23.424768659803604) | > loss_duration: 1.4199140071868896 (1.4995586342281766) | > loss_1: 33.42978286743164 (36.3043024275038) | > grad_norm_1: tensor(15357.2188, device='cuda:0') (tensor(34640.2656, device='cuda:0')) | > current_lr_0: 0.00012227671278636034 | > current_lr_1: 0.00012227671278636034 | > step_time: 0.6289 (0.5330765247344971) | > loader_time: 0.025 (0.015879842970106337)  --> TIME: 2023-10-20 05:05:01 -- STEP: 39/50 -- GLOBAL_STEP: 77640 | > loss_disc: 3.0014896392822266 (2.3930283448635) | > loss_disc_real_0: 0.2702930271625519 (0.14448407206397795) | > loss_disc_real_1: 0.2687745988368988 (0.229808822608529) | > loss_disc_real_2: 0.2660250961780548 (0.2050870056144702) | > loss_disc_real_3: 0.26695311069488525 (0.22828351410153586) | > loss_disc_real_4: 0.2641095221042633 (0.21463854797184467) | > loss_disc_real_5: 0.23130440711975098 (0.22020481331035113) | > loss_0: 3.0014896392822266 (2.3930283448635) | > grad_norm_0: tensor(467.7078, device='cuda:0') (tensor(483.8783, device='cuda:0')) | > loss_gen: 1.5980019569396973 (2.3835514661593313) | > loss_kl: 0.3769210875034332 (0.8093502548260566) | > loss_feat: 0.09564173221588135 (5.41317328495475) | > loss_mel: 2.1172304153442383 (21.034176719494354) | > loss_duration: 1.5580451488494873 (1.5143657433681) | > loss_1: 5.745840072631836 (31.154617529649006) | > grad_norm_1: tensor(15873.7148, device='cuda:0') (tensor(24697.1484, device='cuda:0')) | > current_lr_0: 0.00012227671278636034 | > current_lr_1: 0.00012227671278636034 | > step_time: 0.5954 (0.5112738120250213) | > loader_time: 0.0228 (0.01719389206323868)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1936099529266357 (2.1936099529266357) | > loss_disc_real_0: 0.06187988072633743 (0.06187988072633743) | > loss_disc_real_1: 0.17354920506477356 (0.17354920506477356) | > loss_disc_real_2: 0.1889222115278244 (0.1889222115278244) | > loss_disc_real_3: 0.28917527198791504 (0.28917527198791504) | > loss_disc_real_4: 0.3209300935268402 (0.3209300935268402) | > loss_disc_real_5: 0.2993181049823761 (0.2993181049823761) | > loss_0: 2.1936099529266357 (2.1936099529266357) | > loss_gen: 2.889779567718506 (2.889779567718506) | > loss_kl: 3.973531723022461 (3.973531723022461) | > loss_feat: 6.2339043617248535 (6.2339043617248535) | > loss_mel: 23.144269943237305 (23.144269943237305) | > loss_duration: 2.586808443069458 (2.586808443069458) | > loss_1: 38.82829284667969 (38.82829284667969)  --> STEP: 1 | > loss_disc: 2.647702932357788 (2.647702932357788) | > loss_disc_real_0: 0.1555461585521698 (0.1555461585521698) | > loss_disc_real_1: 0.3440415859222412 (0.3440415859222412) | > loss_disc_real_2: 0.23155759274959564 (0.23155759274959564) | > loss_disc_real_3: 0.3577301502227783 (0.3577301502227783) | > loss_disc_real_4: 0.4677807688713074 (0.4677807688713074) | > loss_disc_real_5: 0.5374045968055725 (0.5374045968055725) | > loss_0: 2.647702932357788 (2.647702932357788) | > loss_gen: 3.982792854309082 (3.982792854309082) | > loss_kl: 3.7909767627716064 (3.7909767627716064) | > loss_feat: 8.08582592010498 (8.08582592010498) | > loss_mel: 26.406410217285156 (26.406410217285156) | > loss_duration: 2.741812229156494 (2.741812229156494) | > loss_1: 45.007816314697266 (45.007816314697266)  --> STEP: 2 | > loss_disc: 3.0138967037200928 (2.8307998180389404) | > loss_disc_real_0: 0.10013172775506973 (0.12783894315361977) | > loss_disc_real_1: 0.22089464962482452 (0.28246811777353287) | > loss_disc_real_2: 0.2664041519165039 (0.24898087233304977) | > loss_disc_real_3: 0.2891196608543396 (0.32342490553855896) | > loss_disc_real_4: 0.27636170387268066 (0.372071236371994) | > loss_disc_real_5: 0.24418357014656067 (0.3907940834760666) | > loss_0: 3.0138967037200928 (2.8307998180389404) | > loss_gen: 1.4588751792907715 (2.7208340167999268) | > loss_kl: 4.362401485443115 (4.076689124107361) | > loss_feat: 1.0128846168518066 (4.5493552684783936) | > loss_mel: 21.96650505065918 (24.186457633972168) | > loss_duration: 2.8056864738464355 (2.773749351501465) | > loss_1: 31.606353759765625 (38.307085037231445)  --> STEP: 3 | > loss_disc: 2.7764341831207275 (2.8126779397328696) | > loss_disc_real_0: 0.19578348100185394 (0.1504871224363645) | > loss_disc_real_1: 0.46851617097854614 (0.3444841355085373) | > loss_disc_real_2: 0.48614373803138733 (0.3280351608991623) | > loss_disc_real_3: 0.36808809638023376 (0.33831263581911725) | > loss_disc_real_4: 0.3186783790588379 (0.35427361726760864) | > loss_disc_real_5: 0.28593382239341736 (0.35584066311518353) | > loss_0: 2.7764341831207275 (2.8126779397328696) | > loss_gen: 3.023369550704956 (2.82167919476827) | > loss_kl: 2.051980495452881 (3.4017862478892007) | > loss_feat: 4.258432388305664 (4.452380975087483) | > loss_mel: 23.598466873168945 (23.990460713704426) | > loss_duration: 2.6549789905548096 (2.734159231185913) | > loss_1: 35.58723068237305 (37.40046691894531) --> EVAL PERFORMANCE | > avg_loader_time: 0.0072434743245442705 (-0.0075177351633707685) | > avg_loss_disc: 2.8126779397328696 (+0.37774244944254587) | > avg_loss_disc_real_0: 0.1504871224363645 (-0.039000459015369415) | > avg_loss_disc_real_1: 0.3444841355085373 (+0.11718496680259705) | > avg_loss_disc_real_2: 0.3280351608991623 (+0.09682983656724295) | > avg_loss_disc_real_3: 0.33831263581911725 (+0.010482529799143492) | > avg_loss_disc_real_4: 0.35427361726760864 (+0.05959551533063251) | > avg_loss_disc_real_5: 0.35584066311518353 (+0.07887419064839685) | > avg_loss_0: 2.8126779397328696 (+0.37774244944254587) | > avg_loss_gen: 2.82167919476827 (-0.3453249136606851) | > avg_loss_kl: 3.4017862478892007 (-0.21411116917928075) | > avg_loss_feat: 4.452380975087483 (-0.8457334041595459) | > avg_loss_mel: 23.990460713704426 (+0.05555407206217211) | > avg_loss_duration: 2.734159231185913 (-0.03373877207438136) | > avg_loss_1: 37.40046691894531 (-1.3833554585774763)  > EPOCH: 493/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:05:18)   --> TIME: 2023-10-20 05:05:32 -- STEP: 19/50 -- GLOBAL_STEP: 77670 | > loss_disc: 1.7616488933563232 (2.4338631567202116) | > loss_disc_real_0: 0.01039775088429451 (0.1834820824626245) | > loss_disc_real_1: 0.08805045485496521 (0.23470350315696314) | > loss_disc_real_2: 0.1310988962650299 (0.22060267078249077) | > loss_disc_real_3: 0.07996802777051926 (0.22161479608008736) | > loss_disc_real_4: 0.15545910596847534 (0.21683749556541443) | > loss_disc_real_5: 0.11135628819465637 (0.21055092267986192) | > loss_0: 1.7616488933563232 (2.4338631567202116) | > grad_norm_0: tensor(333.1921, device='cuda:0') (tensor(498.1563, device='cuda:0')) | > loss_gen: 2.2592813968658447 (2.420290206608019) | > loss_kl: 0.868781566619873 (0.8683812116321764) | > loss_feat: 8.833318710327148 (5.470526511927969) | > loss_mel: 29.060718536376953 (19.933187528660422) | > loss_duration: 1.6500617265701294 (1.5589573132364374) | > loss_1: 42.67216110229492 (30.251342698147422) | > grad_norm_1: tensor(6931.5576, device='cuda:0') (tensor(21865.6660, device='cuda:0')) | > current_lr_0: 0.00012215448955626385 | > current_lr_1: 0.00012215448955626385 | > step_time: 0.4071 (0.438346360859118) | > loader_time: 0.0018 (0.009757380736501594)  --> TIME: 2023-10-20 05:05:49 -- STEP: 49/50 -- GLOBAL_STEP: 77700 | > loss_disc: 2.967548370361328 (2.5262489513475073) | > loss_disc_real_0: 0.18897932767868042 (0.16673362346328038) | > loss_disc_real_1: 0.27807125449180603 (0.23299267804440188) | > loss_disc_real_2: 0.26349058747291565 (0.23128242064647528) | > loss_disc_real_3: 0.20560751855373383 (0.2421944629476995) | > loss_disc_real_4: 0.24806632101535797 (0.22317206928012323) | > loss_disc_real_5: 0.2358195185661316 (0.23590282851602046) | > loss_0: 2.967548370361328 (2.5262489513475073) | > grad_norm_0: tensor(637.1552, device='cuda:0') (tensor(493.4347, device='cuda:0')) | > loss_gen: 1.4932582378387451 (2.288455427909384) | > loss_kl: 0.912055492401123 (0.8100129888982189) | > loss_feat: 0.1772841066122055 (5.065460737034375) | > loss_mel: 2.918370246887207 (19.819129474309026) | > loss_duration: 1.6179503202438354 (1.5176816789471372) | > loss_1: 7.118918418884277 (29.50074041133024) | > grad_norm_1: tensor(11211.6289, device='cuda:0') (tensor(16045.6006, device='cuda:0')) | > current_lr_0: 0.00012215448955626385 | > current_lr_1: 0.00012215448955626385 | > step_time: 0.4799 (0.48292378990017637) | > loader_time: 0.4642 (0.022125764768950795)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2450029850006104 (2.2450029850006104) | > loss_disc_real_0: 0.04509352520108223 (0.04509352520108223) | > loss_disc_real_1: 0.2211163192987442 (0.2211163192987442) | > loss_disc_real_2: 0.2569732069969177 (0.2569732069969177) | > loss_disc_real_3: 0.47076308727264404 (0.47076308727264404) | > loss_disc_real_4: 0.09952633082866669 (0.09952633082866669) | > loss_disc_real_5: 0.2907021641731262 (0.2907021641731262) | > loss_0: 2.2450029850006104 (2.2450029850006104) | > loss_gen: 2.628908634185791 (2.628908634185791) | > loss_kl: 3.3566548824310303 (3.3566548824310303) | > loss_feat: 6.286081314086914 (6.286081314086914) | > loss_mel: 24.79591941833496 (24.79591941833496) | > loss_duration: 2.5220446586608887 (2.5220446586608887) | > loss_1: 39.5896110534668 (39.5896110534668)  --> STEP: 1 | > loss_disc: 2.8629674911499023 (2.8629674911499023) | > loss_disc_real_0: 0.1956743448972702 (0.1956743448972702) | > loss_disc_real_1: 0.2719590663909912 (0.2719590663909912) | > loss_disc_real_2: 0.262065052986145 (0.262065052986145) | > loss_disc_real_3: 0.21047894656658173 (0.21047894656658173) | > loss_disc_real_4: 0.2467803657054901 (0.2467803657054901) | > loss_disc_real_5: 0.23654933273792267 (0.23654933273792267) | > loss_0: 2.8629674911499023 (2.8629674911499023) | > loss_gen: 1.5843260288238525 (1.5843260288238525) | > loss_kl: 3.8651230335235596 (3.8651230335235596) | > loss_feat: 0.4382236897945404 (0.4382236897945404) | > loss_mel: 11.758818626403809 (11.758818626403809) | > loss_duration: 2.792085886001587 (2.792085886001587) | > loss_1: 20.438575744628906 (20.438575744628906)  --> STEP: 2 | > loss_disc: 2.4055957794189453 (2.634281635284424) | > loss_disc_real_0: 0.08393914252519608 (0.13980674371123314) | > loss_disc_real_1: 0.0885586142539978 (0.1802588403224945) | > loss_disc_real_2: 0.10098403692245483 (0.18152454495429993) | > loss_disc_real_3: 0.3022989332675934 (0.25638893991708755) | > loss_disc_real_4: 0.03482574597001076 (0.14080305583775043) | > loss_disc_real_5: 0.1693292111158371 (0.20293927192687988) | > loss_0: 2.4055957794189453 (2.634281635284424) | > loss_gen: 1.8448363542556763 (1.7145811915397644) | > loss_kl: 4.261463165283203 (4.063293099403381) | > loss_feat: 10.139066696166992 (5.288645192980766) | > loss_mel: 23.05614471435547 (17.40748167037964) | > loss_duration: 2.757750988006592 (2.7749184370040894) | > loss_1: 42.059261322021484 (31.248918533325195)  --> STEP: 3 | > loss_disc: 2.693659782409668 (2.6540743509928384) | > loss_disc_real_0: 0.29413139820098877 (0.19124829520781836) | > loss_disc_real_1: 0.17371772229671478 (0.1780784676472346) | > loss_disc_real_2: 0.14931266009807587 (0.17078725000222525) | > loss_disc_real_3: 0.18833214044570923 (0.23370334009329477) | > loss_disc_real_4: 0.22849278151988983 (0.17003296439846358) | > loss_disc_real_5: 0.15734370052814484 (0.18774074812730154) | > loss_0: 2.693659782409668 (2.6540743509928384) | > loss_gen: 1.7911473512649536 (1.7401032447814941) | > loss_kl: 1.8037246465682983 (3.3101036151250205) | > loss_feat: 5.334676265716553 (5.303988883892695) | > loss_mel: 23.86992835998535 (19.561630566914875) | > loss_duration: 2.678297281265259 (2.742711385091146) | > loss_1: 35.47777557373047 (32.65853754679362) --> EVAL PERFORMANCE | > avg_loader_time: 0.009774923324584961 (+0.0025314490000406904) | > avg_loss_disc: 2.6540743509928384 (-0.15860358874003122) | > avg_loss_disc_real_0: 0.19124829520781836 (+0.04076117277145386) | > avg_loss_disc_real_1: 0.1780784676472346 (-0.1664056678613027) | > avg_loss_disc_real_2: 0.17078725000222525 (-0.15724791089693704) | > avg_loss_disc_real_3: 0.23370334009329477 (-0.10460929572582248) | > avg_loss_disc_real_4: 0.17003296439846358 (-0.18424065286914507) | > avg_loss_disc_real_5: 0.18774074812730154 (-0.168099914987882) | > avg_loss_0: 2.6540743509928384 (-0.15860358874003122) | > avg_loss_gen: 1.7401032447814941 (-1.0815759499867759) | > avg_loss_kl: 3.3101036151250205 (-0.0916826327641802) | > avg_loss_feat: 5.303988883892695 (+0.851607908805212) | > avg_loss_mel: 19.561630566914875 (-4.428830146789551) | > avg_loss_duration: 2.742711385091146 (+0.008552153905232895) | > avg_loss_1: 32.65853754679362 (-4.741929372151695)  > EPOCH: 494/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:05:56)   --> TIME: 2023-10-20 05:06:16 -- STEP: 29/50 -- GLOBAL_STEP: 77730 | > loss_disc: 1.7334926128387451 (2.4272151897693504) | > loss_disc_real_0: 0.1296805739402771 (0.12958508758837806) | > loss_disc_real_1: 0.18300925195217133 (0.2164895460009575) | > loss_disc_real_2: 0.06833826750516891 (0.2260691067525025) | > loss_disc_real_3: 0.2938787043094635 (0.257280585709317) | > loss_disc_real_4: 0.18955586850643158 (0.2350195569211039) | > loss_disc_real_5: 0.12074676156044006 (0.22802289687739363) | > loss_0: 1.7334926128387451 (2.4272151897693504) | > grad_norm_0: tensor(354.3149, device='cuda:0') (tensor(498.6610, device='cuda:0')) | > loss_gen: 2.862394332885742 (2.442870353830272) | > loss_kl: 0.9422197341918945 (0.9624756199532541) | > loss_feat: 6.865370273590088 (5.755128498478182) | > loss_mel: 23.15751075744629 (24.133331323492115) | > loss_duration: 1.4971907138824463 (1.5119190873770878) | > loss_1: 35.32468795776367 (34.8057251963122) | > grad_norm_1: tensor(17809.9766, device='cuda:0') (tensor(22806.7559, device='cuda:0')) | > current_lr_0: 0.00012203238849593818 | > current_lr_1: 0.00012203238849593818 | > step_time: 0.2901 (0.5149631171390928) | > loader_time: 0.0031 (0.016817857479227)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.906585216522217 (2.906585216522217) | > loss_disc_real_0: 0.16176098585128784 (0.16176098585128784) | > loss_disc_real_1: 0.29375579953193665 (0.29375579953193665) | > loss_disc_real_2: 0.30570849776268005 (0.30570849776268005) | > loss_disc_real_3: 0.38165271282196045 (0.38165271282196045) | > loss_disc_real_4: 0.2444046139717102 (0.2444046139717102) | > loss_disc_real_5: 0.29683005809783936 (0.29683005809783936) | > loss_0: 2.906585216522217 (2.906585216522217) | > loss_gen: 2.2092528343200684 (2.2092528343200684) | > loss_kl: 3.789296865463257 (3.789296865463257) | > loss_feat: 6.223113059997559 (6.223113059997559) | > loss_mel: 22.696956634521484 (22.696956634521484) | > loss_duration: 2.472787618637085 (2.472787618637085) | > loss_1: 37.39140319824219 (37.39140319824219)  --> STEP: 1 | > loss_disc: 2.8783135414123535 (2.8783135414123535) | > loss_disc_real_0: 0.20722277462482452 (0.20722277462482452) | > loss_disc_real_1: 0.21700149774551392 (0.21700149774551392) | > loss_disc_real_2: 0.3027173578739166 (0.3027173578739166) | > loss_disc_real_3: 0.22216111421585083 (0.22216111421585083) | > loss_disc_real_4: 0.2160925269126892 (0.2160925269126892) | > loss_disc_real_5: 0.14181916415691376 (0.14181916415691376) | > loss_0: 2.8783135414123535 (2.8783135414123535) | > loss_gen: 1.6130733489990234 (1.6130733489990234) | > loss_kl: 4.331120491027832 (4.331120491027832) | > loss_feat: 2.126534938812256 (2.126534938812256) | > loss_mel: 10.094707489013672 (10.094707489013672) | > loss_duration: 2.7210121154785156 (2.7210121154785156) | > loss_1: 20.88644790649414 (20.88644790649414)  --> STEP: 2 | > loss_disc: 2.315216064453125 (2.5967648029327393) | > loss_disc_real_0: 0.022084342315793037 (0.11465355847030878) | > loss_disc_real_1: 0.10086317360401154 (0.15893233567476273) | > loss_disc_real_2: 0.13603384792804718 (0.2193756029009819) | > loss_disc_real_3: 0.09289022535085678 (0.1575256697833538) | > loss_disc_real_4: 0.0906870886683464 (0.1533898077905178) | > loss_disc_real_5: 0.034384701400995255 (0.0881019327789545) | > loss_0: 2.315216064453125 (2.5967648029327393) | > loss_gen: 1.9680525064468384 (1.790562927722931) | > loss_kl: 4.1664652824401855 (4.248792886734009) | > loss_feat: 13.397687911987305 (7.76211142539978) | > loss_mel: 28.279664993286133 (19.187186241149902) | > loss_duration: 2.7870585918426514 (2.7540353536605835) | > loss_1: 50.59893035888672 (35.74268913269043)  --> STEP: 3 | > loss_disc: 2.447605848312378 (2.5470451513926187) | > loss_disc_real_0: 0.23986229300498962 (0.15638980331520239) | > loss_disc_real_1: 0.227266326546669 (0.18171033263206482) | > loss_disc_real_2: 0.37384703755378723 (0.2708660811185837) | > loss_disc_real_3: 0.3415721356868744 (0.218874491751194) | > loss_disc_real_4: 0.2698151767253876 (0.19219826410214105) | > loss_disc_real_5: 0.2917555570602417 (0.15598647420605025) | > loss_0: 2.447605848312378 (2.5470451513926187) | > loss_gen: 2.943920850753784 (2.1750155687332153) | > loss_kl: 1.9628068208694458 (3.4867975314458213) | > loss_feat: 3.871845006942749 (6.46535595258077) | > loss_mel: 24.60313606262207 (20.992502848307293) | > loss_duration: 2.6780381202697754 (2.728702942530314) | > loss_1: 36.059749603271484 (35.848375956217446) --> EVAL PERFORMANCE | > avg_loader_time: 0.013652324676513672 (+0.003877401351928711) | > avg_loss_disc: 2.5470451513926187 (-0.10702919960021973) | > avg_loss_disc_real_0: 0.15638980331520239 (-0.03485849189261597) | > avg_loss_disc_real_1: 0.18171033263206482 (+0.00363186498483023) | > avg_loss_disc_real_2: 0.2708660811185837 (+0.10007883111635843) | > avg_loss_disc_real_3: 0.218874491751194 (-0.01482884834210077) | > avg_loss_disc_real_4: 0.19219826410214105 (+0.022165299703677477) | > avg_loss_disc_real_5: 0.15598647420605025 (-0.0317542739212513) | > avg_loss_0: 2.5470451513926187 (-0.10702919960021973) | > avg_loss_gen: 2.1750155687332153 (+0.4349123239517212) | > avg_loss_kl: 3.4867975314458213 (+0.17669391632080078) | > avg_loss_feat: 6.46535595258077 (+1.1613670686880742) | > avg_loss_mel: 20.992502848307293 (+1.4308722813924177) | > avg_loss_duration: 2.728702942530314 (-0.014008442560832002) | > avg_loss_1: 35.848375956217446 (+3.189838409423828)  > EPOCH: 495/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:06:37)   --> TIME: 2023-10-20 05:06:46 -- STEP: 9/50 -- GLOBAL_STEP: 77760 | > loss_disc: 2.5004055500030518 (2.258628739251031) | > loss_disc_real_0: 0.09896821528673172 (0.1416719944940673) | > loss_disc_real_1: 0.16523043811321259 (0.21372750070359972) | > loss_disc_real_2: 0.15446552634239197 (0.205354748500718) | > loss_disc_real_3: 0.14826202392578125 (0.19767942941851085) | > loss_disc_real_4: 0.5118179321289062 (0.2487335561050309) | > loss_disc_real_5: 0.30472511053085327 (0.1707715487314595) | > loss_0: 2.5004055500030518 (2.258628739251031) | > grad_norm_0: tensor(779.0369, device='cuda:0') (tensor(441.8249, device='cuda:0')) | > loss_gen: 2.2701256275177 (2.3812497986687555) | > loss_kl: 0.7500646114349365 (0.7678254776530795) | > loss_feat: 5.041153907775879 (5.992946015463935) | > loss_mel: 25.473289489746094 (22.581500583224827) | > loss_duration: 1.4351078271865845 (1.5124521652857463) | > loss_1: 34.96974182128906 (33.235974841647675) | > grad_norm_1: tensor(7863.0386, device='cuda:0') (tensor(16397.9473, device='cuda:0')) | > current_lr_0: 0.00012191040948326696 | > current_lr_1: 0.00012191040948326696 | > step_time: 0.603 (0.5322792794969347) | > loader_time: 0.0133 (0.018071121639675565)  --> TIME: 2023-10-20 05:07:02 -- STEP: 39/50 -- GLOBAL_STEP: 77790 | > loss_disc: 3.0548694133758545 (2.4118625659209036) | > loss_disc_real_0: 0.1401652991771698 (0.15861352662054395) | > loss_disc_real_1: 0.26412084698677063 (0.22439768528326964) | > loss_disc_real_2: 0.30119583010673523 (0.22481467488866586) | > loss_disc_real_3: 0.24686206877231598 (0.22863327654508445) | > loss_disc_real_4: 0.2534729242324829 (0.24141795594149676) | > loss_disc_real_5: 0.2286556214094162 (0.21004900364921644) | > loss_0: 3.0548694133758545 (2.4118625659209036) | > grad_norm_0: tensor(362.2051, device='cuda:0') (tensor(516.0939, device='cuda:0')) | > loss_gen: 1.4263348579406738 (2.422606040269901) | > loss_kl: 0.5903165936470032 (0.8501064104911609) | > loss_feat: 0.07656572759151459 (5.3089947412984495) | > loss_mel: 1.7200716733932495 (20.042934167079437) | > loss_duration: 1.5270631313323975 (1.4904336776488867) | > loss_1: 5.3403520584106445 (30.115075331467853) | > grad_norm_1: tensor(19927.6348, device='cuda:0') (tensor(22975.1230, device='cuda:0')) | > current_lr_0: 0.00012191040948326696 | > current_lr_1: 0.00012191040948326696 | > step_time: 0.5676 (0.512568473815918) | > loader_time: 0.0252 (0.019355492714123852)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.585815191268921 (2.585815191268921) | > loss_disc_real_0: 0.27967369556427 (0.27967369556427) | > loss_disc_real_1: 0.27736860513687134 (0.27736860513687134) | > loss_disc_real_2: 0.25315728783607483 (0.25315728783607483) | > loss_disc_real_3: 0.28126391768455505 (0.28126391768455505) | > loss_disc_real_4: 0.22111202776432037 (0.22111202776432037) | > loss_disc_real_5: 0.24003496766090393 (0.24003496766090393) | > loss_0: 2.585815191268921 (2.585815191268921) | > loss_gen: 2.431292772293091 (2.431292772293091) | > loss_kl: 3.475733995437622 (3.475733995437622) | > loss_feat: 2.5837979316711426 (2.5837979316711426) | > loss_mel: 20.74991226196289 (20.74991226196289) | > loss_duration: 2.5773138999938965 (2.5773138999938965) | > loss_1: 31.818052291870117 (31.818052291870117)  --> STEP: 1 | > loss_disc: 2.9726696014404297 (2.9726696014404297) | > loss_disc_real_0: 0.30706799030303955 (0.30706799030303955) | > loss_disc_real_1: 0.2852582335472107 (0.2852582335472107) | > loss_disc_real_2: 0.289858877658844 (0.289858877658844) | > loss_disc_real_3: 0.2934925854206085 (0.2934925854206085) | > loss_disc_real_4: 0.3356311023235321 (0.3356311023235321) | > loss_disc_real_5: 0.29962268471717834 (0.29962268471717834) | > loss_0: 2.9726696014404297 (2.9726696014404297) | > loss_gen: 2.1967601776123047 (2.1967601776123047) | > loss_kl: 4.063292980194092 (4.063292980194092) | > loss_feat: 5.541786193847656 (5.541786193847656) | > loss_mel: 24.456575393676758 (24.456575393676758) | > loss_duration: 2.969385862350464 (2.969385862350464) | > loss_1: 39.22780227661133 (39.22780227661133)  --> STEP: 2 | > loss_disc: 1.8904354572296143 (2.431552529335022) | > loss_disc_real_0: 0.043361544609069824 (0.1752147674560547) | > loss_disc_real_1: 0.1573447436094284 (0.22130148857831955) | > loss_disc_real_2: 0.32201969623565674 (0.30593928694725037) | > loss_disc_real_3: 0.18174560368061066 (0.2376190945506096) | > loss_disc_real_4: 0.14322051405906677 (0.23942580819129944) | > loss_disc_real_5: 0.054997313767671585 (0.17730999924242496) | > loss_0: 1.8904354572296143 (2.431552529335022) | > loss_gen: 2.407623052597046 (2.3021916151046753) | > loss_kl: 4.9091949462890625 (4.486243963241577) | > loss_feat: 9.375012397766113 (7.458399295806885) | > loss_mel: 23.251598358154297 (23.854086875915527) | > loss_duration: 2.856773614883423 (2.9130797386169434) | > loss_1: 42.800201416015625 (41.01400184631348)  --> STEP: 3 | > loss_disc: 2.9226369857788086 (2.5952473481496177) | > loss_disc_real_0: 0.22319430112838745 (0.19120794534683228) | > loss_disc_real_1: 0.29062703251838684 (0.24441000322500864) | > loss_disc_real_2: 0.3953644335269928 (0.33574766914049786) | > loss_disc_real_3: 0.27679353952407837 (0.2506772428750992) | > loss_disc_real_4: 0.25766414403915405 (0.24550525347391763) | > loss_disc_real_5: 0.3570866584777832 (0.2372355523208777) | > loss_0: 2.9226369857788086 (2.5952473481496177) | > loss_gen: 2.0712807178497314 (2.225221316019694) | > loss_kl: 1.813852310180664 (3.595446745554606) | > loss_feat: 2.4998316764831543 (5.805543422698975) | > loss_mel: 24.723966598510742 (24.144046783447266) | > loss_duration: 2.704373359680176 (2.843510945638021) | > loss_1: 33.81330490112305 (38.61376953125) --> EVAL PERFORMANCE | > avg_loader_time: 0.00589299201965332 (-0.0077593326568603516) | > avg_loss_disc: 2.5952473481496177 (+0.048202196756998994) | > avg_loss_disc_real_0: 0.19120794534683228 (+0.03481814203162989) | > avg_loss_disc_real_1: 0.24441000322500864 (+0.06269967059294382) | > avg_loss_disc_real_2: 0.33574766914049786 (+0.06488158802191418) | > avg_loss_disc_real_3: 0.2506772428750992 (+0.03180275112390518) | > avg_loss_disc_real_4: 0.24550525347391763 (+0.05330698937177658) | > avg_loss_disc_real_5: 0.2372355523208777 (+0.08124907811482746) | > avg_loss_0: 2.5952473481496177 (+0.048202196756998994) | > avg_loss_gen: 2.225221316019694 (+0.05020574728647853) | > avg_loss_kl: 3.595446745554606 (+0.1086492141087847) | > avg_loss_feat: 5.805543422698975 (-0.659812529881795) | > avg_loss_mel: 24.144046783447266 (+3.1515439351399728) | > avg_loss_duration: 2.843510945638021 (+0.114808003107707) | > avg_loss_1: 38.61376953125 (+2.7653935750325545)  > EPOCH: 496/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:07:18)   --> TIME: 2023-10-20 05:07:31 -- STEP: 19/50 -- GLOBAL_STEP: 77820 | > loss_disc: 3.1300127506256104 (2.3056478688591406) | > loss_disc_real_0: 0.21463364362716675 (0.15205096914187857) | > loss_disc_real_1: 0.2819896936416626 (0.2214359466574694) | > loss_disc_real_2: 0.4536062777042389 (0.23212855681777) | > loss_disc_real_3: 0.3320525586605072 (0.22958376964456156) | > loss_disc_real_4: 0.36435627937316895 (0.2291713211881487) | > loss_disc_real_5: 0.42425793409347534 (0.21385257749965317) | > loss_0: 3.1300127506256104 (2.3056478688591406) | > grad_norm_0: tensor(866.3619, device='cuda:0') (tensor(625.2620, device='cuda:0')) | > loss_gen: 2.4204745292663574 (2.5317215543044242) | > loss_kl: 1.0884610414505005 (0.8674874215533859) | > loss_feat: 4.552753448486328 (6.469816910593133) | > loss_mel: 28.245168685913086 (23.922658920288086) | > loss_duration: 1.5970349311828613 (1.5160091362501447) | > loss_1: 37.903892517089844 (35.307694585699785) | > grad_norm_1: tensor(4436.1177, device='cuda:0') (tensor(23900.9941, device='cuda:0')) | > current_lr_0: 0.00012178855239625591 | > current_lr_1: 0.00012178855239625591 | > step_time: 0.4148 (0.4289319264261346) | > loader_time: 0.0029 (0.010942245784558748)  --> TIME: 2023-10-20 05:07:46 -- STEP: 49/50 -- GLOBAL_STEP: 77850 | > loss_disc: 2.5526750087738037 (2.429599657350657) | > loss_disc_real_0: 0.1622888594865799 (0.14555557186202128) | > loss_disc_real_1: 0.3591136932373047 (0.214374342439126) | > loss_disc_real_2: 0.25817373394966125 (0.23107430141191093) | > loss_disc_real_3: 0.2670934200286865 (0.22738101751524575) | > loss_disc_real_4: 0.2702602744102478 (0.23669568673536487) | > loss_disc_real_5: 0.38985133171081543 (0.23849097768567046) | > loss_0: 2.5526750087738037 (2.429599657350657) | > grad_norm_0: tensor(926.6555, device='cuda:0') (tensor(550.2966, device='cuda:0')) | > loss_gen: 2.621495246887207 (2.3464009859124006) | > loss_kl: 0.6024622321128845 (0.8083213607267458) | > loss_feat: 3.436204195022583 (5.669835035670167) | > loss_mel: 22.550018310546875 (21.993519598123978) | > loss_duration: 1.6437723636627197 (1.4874749062012658) | > loss_1: 30.85395050048828 (32.305551781946306) | > grad_norm_1: tensor(20333.3027, device='cuda:0') (tensor(18782.9082, device='cuda:0')) | > current_lr_0: 0.00012178855239625591 | > current_lr_1: 0.00012178855239625591 | > step_time: 0.5733 (0.45874044359946736) | > loader_time: 0.4153 (0.018930444912034643)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.642063617706299 (2.642063617706299) | > loss_disc_real_0: 0.14351686835289001 (0.14351686835289001) | > loss_disc_real_1: 0.32528451085090637 (0.32528451085090637) | > loss_disc_real_2: 0.27959689497947693 (0.27959689497947693) | > loss_disc_real_3: 0.2718612551689148 (0.2718612551689148) | > loss_disc_real_4: 0.2679068148136139 (0.2679068148136139) | > loss_disc_real_5: 0.24645131826400757 (0.24645131826400757) | > loss_0: 2.642063617706299 (2.642063617706299) | > loss_gen: 2.0396499633789062 (2.0396499633789062) | > loss_kl: 4.087621212005615 (4.087621212005615) | > loss_feat: 1.3777939081192017 (1.3777939081192017) | > loss_mel: 20.128721237182617 (20.128721237182617) | > loss_duration: 2.683475971221924 (2.683475971221924) | > loss_1: 30.3172607421875 (30.3172607421875)  --> STEP: 1 | > loss_disc: 2.6400198936462402 (2.6400198936462402) | > loss_disc_real_0: 0.0811401829123497 (0.0811401829123497) | > loss_disc_real_1: 0.23598109185695648 (0.23598109185695648) | > loss_disc_real_2: 0.29008328914642334 (0.29008328914642334) | > loss_disc_real_3: 0.17549152672290802 (0.17549152672290802) | > loss_disc_real_4: 0.1308469921350479 (0.1308469921350479) | > loss_disc_real_5: 0.19005407392978668 (0.19005407392978668) | > loss_0: 2.6400198936462402 (2.6400198936462402) | > loss_gen: 2.109795093536377 (2.109795093536377) | > loss_kl: 3.970458984375 (3.970458984375) | > loss_feat: 6.995492458343506 (6.995492458343506) | > loss_mel: 22.505611419677734 (22.505611419677734) | > loss_duration: 3.0226681232452393 (3.0226681232452393) | > loss_1: 38.604026794433594 (38.604026794433594)  --> STEP: 2 | > loss_disc: 2.9511470794677734 (2.795583486557007) | > loss_disc_real_0: 0.10616432130336761 (0.09365225210785866) | > loss_disc_real_1: 0.3469344675540924 (0.29145777970552444) | > loss_disc_real_2: 0.36667442321777344 (0.3283788561820984) | > loss_disc_real_3: 0.3185030519962311 (0.24699728935956955) | > loss_disc_real_4: 0.3164818286895752 (0.22366441041231155) | > loss_disc_real_5: 0.293228417634964 (0.24164124578237534) | > loss_0: 2.9511470794677734 (2.795583486557007) | > loss_gen: 1.8847957849502563 (1.9972954392433167) | > loss_kl: 4.684767723083496 (4.327613353729248) | > loss_feat: 1.6936010122299194 (4.344546735286713) | > loss_mel: 27.470483779907227 (24.98804759979248) | > loss_duration: 2.9523439407348633 (2.9875060319900513) | > loss_1: 38.68599319458008 (38.645009994506836)  --> STEP: 3 | > loss_disc: 3.075784683227539 (2.888983885447184) | > loss_disc_real_0: 0.12598301470279694 (0.10442917297283809) | > loss_disc_real_1: 0.4634774327278137 (0.34879766404628754) | > loss_disc_real_2: 0.3295500576496124 (0.3287692566712697) | > loss_disc_real_3: 0.2565345764160156 (0.2501763850450516) | > loss_disc_real_4: 0.2795161306858063 (0.24228165050347647) | > loss_disc_real_5: 0.41580814123153687 (0.2996968775987625) | > loss_0: 3.075784683227539 (2.888983885447184) | > loss_gen: 1.928254246711731 (1.9742817083994548) | > loss_kl: 1.7365353107452393 (3.4639206727345786) | > loss_feat: 1.4061434268951416 (3.3650789658228555) | > loss_mel: 17.926103591918945 (22.634066263834637) | > loss_duration: 2.756330966949463 (2.910447676976522) | > loss_1: 25.753368377685547 (34.34779612223307) --> EVAL PERFORMANCE | > avg_loader_time: 0.002408901850382487 (-0.0034840901692708335) | > avg_loss_disc: 2.888983885447184 (+0.29373653729756644) | > avg_loss_disc_real_0: 0.10442917297283809 (-0.08677877237399419) | > avg_loss_disc_real_1: 0.34879766404628754 (+0.1043876608212789) | > avg_loss_disc_real_2: 0.3287692566712697 (-0.006978412469228146) | > avg_loss_disc_real_3: 0.2501763850450516 (-0.0005008578300476074) | > avg_loss_disc_real_4: 0.24228165050347647 (-0.003223602970441164) | > avg_loss_disc_real_5: 0.2996968775987625 (+0.06246132527788481) | > avg_loss_0: 2.888983885447184 (+0.29373653729756644) | > avg_loss_gen: 1.9742817083994548 (-0.25093960762023904) | > avg_loss_kl: 3.4639206727345786 (-0.13152607282002737) | > avg_loss_feat: 3.3650789658228555 (-2.440464456876119) | > avg_loss_mel: 22.634066263834637 (-1.509980519612629) | > avg_loss_duration: 2.910447676976522 (+0.06693673133850098) | > avg_loss_1: 34.34779612223307 (-4.2659734090169295)  > EPOCH: 497/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:07:56)   --> TIME: 2023-10-20 05:08:15 -- STEP: 29/50 -- GLOBAL_STEP: 77880 | > loss_disc: 2.7807648181915283 (2.652384198945144) | > loss_disc_real_0: 0.17978882789611816 (0.18425273721844987) | > loss_disc_real_1: 0.2912909686565399 (0.24756920157835402) | > loss_disc_real_2: 0.23070815205574036 (0.24201601769389777) | > loss_disc_real_3: 0.28026166558265686 (0.24677041327131205) | > loss_disc_real_4: 0.2316582202911377 (0.2493518233170797) | > loss_disc_real_5: 0.25214430689811707 (0.2323106006430141) | > loss_0: 2.7807648181915283 (2.652384198945144) | > grad_norm_0: tensor(462.6324, device='cuda:0') (tensor(585.0425, device='cuda:0')) | > loss_gen: 1.7128992080688477 (2.1730011290517344) | > loss_kl: 0.751717209815979 (0.8455012800364659) | > loss_feat: 0.7317994236946106 (4.680206158808593) | > loss_mel: 16.43001937866211 (20.825706605253547) | > loss_duration: 1.4786320924758911 (1.5027887903410813) | > loss_1: 21.105066299438477 (30.027204184696593) | > grad_norm_1: tensor(7949.9053, device='cuda:0') (tensor(25064.6113, device='cuda:0')) | > current_lr_0: 0.00012166681711303276 | > current_lr_1: 0.00012166681711303276 | > step_time: 0.6178 (0.49116857298489275) | > loader_time: 0.0052 (0.020835399627685547)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8882906436920166 (2.8882906436920166) | > loss_disc_real_0: 0.5327572226524353 (0.5327572226524353) | > loss_disc_real_1: 0.23599012196063995 (0.23599012196063995) | > loss_disc_real_2: 0.31487905979156494 (0.31487905979156494) | > loss_disc_real_3: 0.27768805623054504 (0.27768805623054504) | > loss_disc_real_4: 0.2863527238368988 (0.2863527238368988) | > loss_disc_real_5: 0.3594747483730316 (0.3594747483730316) | > loss_0: 2.8882906436920166 (2.8882906436920166) | > loss_gen: 2.586402654647827 (2.586402654647827) | > loss_kl: 4.062185287475586 (4.062185287475586) | > loss_feat: 5.129027843475342 (5.129027843475342) | > loss_mel: 22.880409240722656 (22.880409240722656) | > loss_duration: 2.709974765777588 (2.709974765777588) | > loss_1: 37.368003845214844 (37.368003845214844)  --> STEP: 1 | > loss_disc: 2.2541756629943848 (2.2541756629943848) | > loss_disc_real_0: 0.33717411756515503 (0.33717411756515503) | > loss_disc_real_1: 0.19249427318572998 (0.19249427318572998) | > loss_disc_real_2: 0.16461940109729767 (0.16461940109729767) | > loss_disc_real_3: 0.2360750138759613 (0.2360750138759613) | > loss_disc_real_4: 0.269024521112442 (0.269024521112442) | > loss_disc_real_5: 0.2452877312898636 (0.2452877312898636) | > loss_0: 2.2541756629943848 (2.2541756629943848) | > loss_gen: 2.8634254932403564 (2.8634254932403564) | > loss_kl: 4.146973133087158 (4.146973133087158) | > loss_feat: 4.684215068817139 (4.684215068817139) | > loss_mel: 24.191837310791016 (24.191837310791016) | > loss_duration: 2.9497339725494385 (2.9497339725494385) | > loss_1: 38.836185455322266 (38.836185455322266)  --> STEP: 2 | > loss_disc: 2.3941283226013184 (2.3241519927978516) | > loss_disc_real_0: 0.33228617906570435 (0.3347301483154297) | > loss_disc_real_1: 0.2180822491645813 (0.20528826117515564) | > loss_disc_real_2: 0.3180711269378662 (0.24134526401758194) | > loss_disc_real_3: 0.18794837594032288 (0.2120116949081421) | > loss_disc_real_4: 0.1468697339296341 (0.20794712752103806) | > loss_disc_real_5: 0.22278331220149994 (0.23403552174568176) | > loss_0: 2.3941283226013184 (2.3241519927978516) | > loss_gen: 2.676776885986328 (2.7701011896133423) | > loss_kl: 4.510456562042236 (4.328714847564697) | > loss_feat: 9.107963562011719 (6.896089315414429) | > loss_mel: 29.28505516052246 (26.73844623565674) | > loss_duration: 2.9777841567993164 (2.9637590646743774) | > loss_1: 48.55803298950195 (43.69710922241211)  --> STEP: 3 | > loss_disc: 2.9412050247192383 (2.529836336771647) | > loss_disc_real_0: 0.44340085983276367 (0.3709537188212077) | > loss_disc_real_1: 0.5091220736503601 (0.30656619866689044) | > loss_disc_real_2: 0.414508193731308 (0.299066240588824) | > loss_disc_real_3: 0.2936320900917053 (0.23921849330266318) | > loss_disc_real_4: 0.257959246635437 (0.22461783389250436) | > loss_disc_real_5: 0.13207364082336426 (0.20004822810490927) | > loss_0: 2.9412050247192383 (2.529836336771647) | > loss_gen: 3.1184380054473877 (2.886213461558024) | > loss_kl: 1.7266559600830078 (3.461361885070801) | > loss_feat: 4.755277633666992 (6.182485421498616) | > loss_mel: 24.46858024597168 (25.98182423909505) | > loss_duration: 2.7101240158081055 (2.87921404838562) | > loss_1: 36.779075622558594 (41.39109802246094) --> EVAL PERFORMANCE | > avg_loader_time: 0.015562216440836588 (+0.013153314590454102) | > avg_loss_disc: 2.529836336771647 (-0.3591475486755371) | > avg_loss_disc_real_0: 0.3709537188212077 (+0.2665245458483696) | > avg_loss_disc_real_1: 0.30656619866689044 (-0.04223146537939709) | > avg_loss_disc_real_2: 0.299066240588824 (-0.029703016082445743) | > avg_loss_disc_real_3: 0.23921849330266318 (-0.010957891742388398) | > avg_loss_disc_real_4: 0.22461783389250436 (-0.017663816610972105) | > avg_loss_disc_real_5: 0.20004822810490927 (-0.09964864949385324) | > avg_loss_0: 2.529836336771647 (-0.3591475486755371) | > avg_loss_gen: 2.886213461558024 (+0.9119317531585691) | > avg_loss_kl: 3.461361885070801 (-0.0025587876637778173) | > avg_loss_feat: 6.182485421498616 (+2.8174064556757608) | > avg_loss_mel: 25.98182423909505 (+3.3477579752604143) | > avg_loss_duration: 2.87921404838562 (-0.03123362859090184) | > avg_loss_1: 41.39109802246094 (+7.043301900227867)  > EPOCH: 498/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:08:35)   --> TIME: 2023-10-20 05:08:45 -- STEP: 9/50 -- GLOBAL_STEP: 77910 | > loss_disc: 3.1071696281433105 (2.2780220243665905) | > loss_disc_real_0: 0.2582590579986572 (0.12912682940562567) | > loss_disc_real_1: 0.3990725874900818 (0.24620831881960234) | > loss_disc_real_2: 0.36021801829338074 (0.2399858900656303) | > loss_disc_real_3: 0.31186556816101074 (0.22439261029163995) | > loss_disc_real_4: 0.25325462222099304 (0.17043216179849374) | > loss_disc_real_5: 0.37980011105537415 (0.1744541014648146) | > loss_0: 3.1071696281433105 (2.2780220243665905) | > grad_norm_0: tensor(414.7723, device='cuda:0') (tensor(507.7336, device='cuda:0')) | > loss_gen: 2.561746120452881 (2.3711210356818304) | > loss_kl: 0.7419654130935669 (0.8541965484619141) | > loss_feat: 4.563874244689941 (6.071926828887728) | > loss_mel: 21.371706008911133 (21.73147964477539) | > loss_duration: 1.4338785409927368 (1.4750895235273573) | > loss_1: 30.67317008972168 (32.50381321377225) | > grad_norm_1: tensor(4652.8462, device='cuda:0') (tensor(13808.8525, device='cuda:0')) | > current_lr_0: 0.00012154520351184696 | > current_lr_1: 0.00012154520351184696 | > step_time: 0.5766 (0.5814943578508165) | > loader_time: 0.0244 (0.021658605999416776)  --> TIME: 2023-10-20 05:09:01 -- STEP: 39/50 -- GLOBAL_STEP: 77940 | > loss_disc: 3.0058491230010986 (2.388794519962408) | > loss_disc_real_0: 0.3391917943954468 (0.1739556663789046) | > loss_disc_real_1: 0.2454262226819992 (0.22926213821539512) | > loss_disc_real_2: 0.21831895411014557 (0.21981759374149334) | > loss_disc_real_3: 0.22732312977313995 (0.21638456603082326) | > loss_disc_real_4: 0.2651829421520233 (0.21953243968817285) | > loss_disc_real_5: 0.25705912709236145 (0.22308778643417052) | > loss_0: 3.0058491230010986 (2.388794519962408) | > grad_norm_0: tensor(423.9567, device='cuda:0') (tensor(452.5548, device='cuda:0')) | > loss_gen: 1.5373499393463135 (2.4345600788409887) | > loss_kl: 0.5437108278274536 (0.9633054305345586) | > loss_feat: 0.070436030626297 (5.646435391874268) | > loss_mel: 1.7946256399154663 (20.68173488286825) | > loss_duration: 1.5550343990325928 (1.487324421222393) | > loss_1: 5.501156806945801 (31.213359869443455) | > grad_norm_1: tensor(18238.4414, device='cuda:0') (tensor(19058.3418, device='cuda:0')) | > current_lr_0: 0.00012154520351184696 | > current_lr_1: 0.00012154520351184696 | > step_time: 0.3408 (0.517074798926329) | > loader_time: 0.0022 (0.020200380912193887)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9392480850219727 (2.9392480850219727) | > loss_disc_real_0: 0.1406066119670868 (0.1406066119670868) | > loss_disc_real_1: 0.2716776728630066 (0.2716776728630066) | > loss_disc_real_2: 0.31878340244293213 (0.31878340244293213) | > loss_disc_real_3: 0.2940100431442261 (0.2940100431442261) | > loss_disc_real_4: 0.2546693980693817 (0.2546693980693817) | > loss_disc_real_5: 0.21951507031917572 (0.21951507031917572) | > loss_0: 2.9392480850219727 (2.9392480850219727) | > loss_gen: 1.5832103490829468 (1.5832103490829468) | > loss_kl: 3.183375597000122 (3.183375597000122) | > loss_feat: 0.2536221146583557 (0.2536221146583557) | > loss_mel: 14.990737915039062 (14.990737915039062) | > loss_duration: 2.6246895790100098 (2.6246895790100098) | > loss_1: 22.635635375976562 (22.635635375976562)  --> STEP: 1 | > loss_disc: 2.7240374088287354 (2.7240374088287354) | > loss_disc_real_0: 0.3698599338531494 (0.3698599338531494) | > loss_disc_real_1: 0.31165122985839844 (0.31165122985839844) | > loss_disc_real_2: 0.3234502971172333 (0.3234502971172333) | > loss_disc_real_3: 0.2964300215244293 (0.2964300215244293) | > loss_disc_real_4: 0.3130916655063629 (0.3130916655063629) | > loss_disc_real_5: 0.22401781380176544 (0.22401781380176544) | > loss_0: 2.7240374088287354 (2.7240374088287354) | > loss_gen: 2.5976901054382324 (2.5976901054382324) | > loss_kl: 3.954524040222168 (3.954524040222168) | > loss_feat: 5.9946489334106445 (5.9946489334106445) | > loss_mel: 22.42039680480957 (22.42039680480957) | > loss_duration: 2.8979570865631104 (2.8979570865631104) | > loss_1: 37.86521530151367 (37.86521530151367)  --> STEP: 2 | > loss_disc: 1.7916057109832764 (2.257821559906006) | > loss_disc_real_0: 0.16021393239498138 (0.2650369331240654) | > loss_disc_real_1: 0.07245296239852905 (0.19205209612846375) | > loss_disc_real_2: 0.08371491730213165 (0.20358260720968246) | > loss_disc_real_3: 0.043862391263246536 (0.17014620639383793) | > loss_disc_real_4: 0.21439017355442047 (0.2637409195303917) | > loss_disc_real_5: 0.2441793829202652 (0.23409859836101532) | > loss_0: 1.7916057109832764 (2.257821559906006) | > loss_gen: 2.6692538261413574 (2.633471965789795) | > loss_kl: 4.301653861999512 (4.12808895111084) | > loss_feat: 9.07179069519043 (7.533219814300537) | > loss_mel: 24.78321647644043 (23.601806640625) | > loss_duration: 2.8089230060577393 (2.853440046310425) | > loss_1: 43.63483810424805 (40.75002670288086)  --> STEP: 3 | > loss_disc: 2.911973714828491 (2.475872278213501) | > loss_disc_real_0: 0.1329658329486847 (0.22101323306560516) | > loss_disc_real_1: 0.25604328513145447 (0.21338249246279398) | > loss_disc_real_2: 0.31344807147979736 (0.2402044286330541) | > loss_disc_real_3: 0.2910863757133484 (0.21045959616700807) | > loss_disc_real_4: 0.26596567034721375 (0.264482503135999) | > loss_disc_real_5: 0.22774018347263336 (0.23197912673155466) | > loss_0: 2.911973714828491 (2.475872278213501) | > loss_gen: 1.6126222610473633 (2.293188730875651) | > loss_kl: 2.036580801010132 (3.430919567743937) | > loss_feat: 0.5622861385345459 (5.209575255711873) | > loss_mel: 16.425493240356445 (21.209702173868816) | > loss_duration: 2.647270917892456 (2.784717003504435) | > loss_1: 23.284252166748047 (34.92810185750326) --> EVAL PERFORMANCE | > avg_loader_time: 0.009150425593058268 (-0.00641179084777832) | > avg_loss_disc: 2.475872278213501 (-0.05396405855814601) | > avg_loss_disc_real_0: 0.22101323306560516 (-0.14994048575560254) | > avg_loss_disc_real_1: 0.21338249246279398 (-0.09318370620409647) | > avg_loss_disc_real_2: 0.2402044286330541 (-0.058861811955769866) | > avg_loss_disc_real_3: 0.21045959616700807 (-0.028758897135655104) | > avg_loss_disc_real_4: 0.264482503135999 (+0.03986466924349466) | > avg_loss_disc_real_5: 0.23197912673155466 (+0.03193089862664539) | > avg_loss_0: 2.475872278213501 (-0.05396405855814601) | > avg_loss_gen: 2.293188730875651 (-0.593024730682373) | > avg_loss_kl: 3.430919567743937 (-0.030442317326863755) | > avg_loss_feat: 5.209575255711873 (-0.9729101657867432) | > avg_loss_mel: 21.209702173868816 (-4.772122065226235) | > avg_loss_duration: 2.784717003504435 (-0.09449704488118504) | > avg_loss_1: 34.92810185750326 (-6.46299616495768)  > EPOCH: 499/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:09:19)   --> TIME: 2023-10-20 05:09:32 -- STEP: 19/50 -- GLOBAL_STEP: 77970 | > loss_disc: 1.453870177268982 (2.417828967696742) | > loss_disc_real_0: 0.09493926912546158 (0.17280536497894086) | > loss_disc_real_1: 0.20244728028774261 (0.23705113404675535) | > loss_disc_real_2: 0.2695891559123993 (0.23664828997693563) | > loss_disc_real_3: 0.09573271870613098 (0.2439891595981623) | > loss_disc_real_4: 0.1575445979833603 (0.22781577725943766) | > loss_disc_real_5: 0.06670958548784256 (0.20201139504972257) | > loss_0: 1.453870177268982 (2.417828967696742) | > grad_norm_0: tensor(538.3931, device='cuda:0') (tensor(541.0020, device='cuda:0')) | > loss_gen: 4.437160968780518 (2.448835096861187) | > loss_kl: 0.7589942812919617 (0.8129477877365915) | > loss_feat: 12.930590629577637 (5.710926673522121) | > loss_mel: 29.16033172607422 (23.595083387274492) | > loss_duration: 1.5890110731124878 (1.5188772866600437) | > loss_1: 48.8760871887207 (34.08667034851877) | > grad_norm_1: tensor(68873.0078, device='cuda:0') (tensor(18380.8379, device='cuda:0')) | > current_lr_0: 0.00012142371147106969 | > current_lr_1: 0.00012142371147106969 | > step_time: 0.3753 (0.41793947470815557) | > loader_time: 0.0021 (0.008440494537353516)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6239633560180664 (2.6239633560180664) | > loss_disc_real_0: 0.17949464917182922 (0.17949464917182922) | > loss_disc_real_1: 0.2580110728740692 (0.2580110728740692) | > loss_disc_real_2: 0.2190684974193573 (0.2190684974193573) | > loss_disc_real_3: 0.14973782002925873 (0.14973782002925873) | > loss_disc_real_4: 0.23352113366127014 (0.23352113366127014) | > loss_disc_real_5: 0.2217894345521927 (0.2217894345521927) | > loss_0: 2.6239633560180664 (2.6239633560180664) | > loss_gen: 1.9770644903182983 (1.9770644903182983) | > loss_kl: 3.717855930328369 (3.717855930328369) | > loss_feat: 7.288529872894287 (7.288529872894287) | > loss_mel: 23.161087036132812 (23.161087036132812) | > loss_duration: 2.679691791534424 (2.679691791534424) | > loss_1: 38.8242301940918 (38.8242301940918)  --> STEP: 1 | > loss_disc: 2.7819535732269287 (2.7819535732269287) | > loss_disc_real_0: 0.1458829790353775 (0.1458829790353775) | > loss_disc_real_1: 0.24981193244457245 (0.24981193244457245) | > loss_disc_real_2: 0.2007785141468048 (0.2007785141468048) | > loss_disc_real_3: 0.15563376247882843 (0.15563376247882843) | > loss_disc_real_4: 0.20357444882392883 (0.20357444882392883) | > loss_disc_real_5: 0.16279806196689606 (0.16279806196689606) | > loss_0: 2.7819535732269287 (2.7819535732269287) | > loss_gen: 1.818612813949585 (1.818612813949585) | > loss_kl: 3.82210111618042 (3.82210111618042) | > loss_feat: 7.439225196838379 (7.439225196838379) | > loss_mel: 24.333106994628906 (24.333106994628906) | > loss_duration: 2.921079158782959 (2.921079158782959) | > loss_1: 40.33412170410156 (40.33412170410156)  --> STEP: 2 | > loss_disc: 2.9653091430664062 (2.8736313581466675) | > loss_disc_real_0: 0.10430566221475601 (0.12509432062506676) | > loss_disc_real_1: 0.18681904673576355 (0.218315489590168) | > loss_disc_real_2: 0.2283514142036438 (0.2145649641752243) | > loss_disc_real_3: 0.1909664422273636 (0.173300102353096) | > loss_disc_real_4: 0.27754515409469604 (0.24055980145931244) | > loss_disc_real_5: 0.21414096653461456 (0.1884695142507553) | > loss_0: 2.9653091430664062 (2.8736313581466675) | > loss_gen: 2.0505001544952393 (1.934556484222412) | > loss_kl: 4.349966526031494 (4.086033821105957) | > loss_feat: 7.09852933883667 (7.268877267837524) | > loss_mel: 24.588031768798828 (24.460569381713867) | > loss_duration: 2.9052300453186035 (2.9131546020507812) | > loss_1: 40.99225997924805 (40.663190841674805)  --> STEP: 3 | > loss_disc: 2.9395248889923096 (2.8955958684285483) | > loss_disc_real_0: 0.16604173183441162 (0.1387434576948484) | > loss_disc_real_1: 0.28945392370224 (0.24202830096085867) | > loss_disc_real_2: 0.3187573552131653 (0.2492957611878713) | > loss_disc_real_3: 0.29671746492385864 (0.21443922321001688) | > loss_disc_real_4: 0.23544259369373322 (0.2388540655374527) | > loss_disc_real_5: 0.24852842092514038 (0.20848914980888367) | > loss_0: 2.9395248889923096 (2.8955958684285483) | > loss_gen: 1.6474246978759766 (1.8388458887736003) | > loss_kl: 2.2767088413238525 (3.4829254945119223) | > loss_feat: 0.31992781162261963 (4.952560782432556) | > loss_mel: 16.181066513061523 (21.700735092163086) | > loss_duration: 2.8178436756134033 (2.881384293238322) | > loss_1: 23.242971420288086 (34.8564510345459)  --> TIME: 2023-10-20 05:09:54 -- STEP: 49/50 -- GLOBAL_STEP: 78000 | > loss_disc: 2.217299222946167 (2.502069064549037) | > loss_disc_real_0: 0.015365292318165302 (0.15652522241354594) | > loss_disc_real_1: 0.08661015331745148 (0.24178711545406548) | > loss_disc_real_2: 0.13321740925312042 (0.22728325707875952) | > loss_disc_real_3: 0.2973672151565552 (0.2429654328342603) | > loss_disc_real_4: 0.2460326999425888 (0.23395141533442906) | > loss_disc_real_5: 0.24743272364139557 (0.22624068334698677) | > loss_0: 2.217299222946167 (2.502069064549037) | > grad_norm_0: tensor(904.6414, device='cuda:0') (tensor(527.3263, device='cuda:0')) | > loss_gen: 2.0704092979431152 (2.2816051488019977) | > loss_kl: 0.546286940574646 (0.8175084463187626) | > loss_feat: 2.735990285873413 (5.189705139672269) | > loss_mel: 26.48333740234375 (22.8278201185927) | > loss_duration: 1.6798912286758423 (1.4840378055767136) | > loss_1: 33.51591491699219 (32.600676945277606) | > grad_norm_1: tensor(5561.3716, device='cuda:0') (tensor(13515.1211, device='cuda:0')) | > current_lr_0: 0.00012142371147106969 | > current_lr_1: 0.00012142371147106969 | > step_time: 2.0203 (0.4933721143372205) | > loader_time: 5.9619 (0.13377745297490334) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_78000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8095550537109375 (2.8740856647491455) | > loss_disc_real_0: 0.2640936076641083 (0.17008099518716335) | > loss_disc_real_1: 0.2793104946613312 (0.2513488493859768) | > loss_disc_real_2: 0.2949273884296417 (0.2607036679983139) | > loss_disc_real_3: 0.31214451789855957 (0.23886554688215256) | > loss_disc_real_4: 0.24011315405368805 (0.23916883766651154) | > loss_disc_real_5: 0.2229832112789154 (0.2121126651763916) | > loss_0: 2.8095550537109375 (2.8740856647491455) | > loss_gen: 2.1561319828033447 (1.9181674122810364) | > loss_kl: 3.565077543258667 (3.5034635066986084) | > loss_feat: 1.8098273277282715 (4.166877418756485) | > loss_mel: 21.046539306640625 (21.53718614578247) | > loss_duration: 2.7712161540985107 (2.853842258453369) | > loss_1: 31.348791122436523 (33.979536056518555)  --> STEP: 1 | > loss_disc: 2.57066011428833 (2.8134005546569822) | > loss_disc_real_0: 0.237064927816391 (0.18347778171300888) | > loss_disc_real_1: 0.29159194231033325 (0.25939746797084806) | > loss_disc_real_2: 0.2592429220676422 (0.26041151881217955) | > loss_disc_real_3: 0.24591533839702606 (0.24027550518512725) | > loss_disc_real_4: 0.2501818537712097 (0.24137144088745116) | > loss_disc_real_5: 0.24354220926761627 (0.21839857399463652) | > loss_0: 2.57066011428833 (2.8134005546569822) | > loss_gen: 2.3931570053100586 (2.013165330886841) | > loss_kl: 4.257057189941406 (3.654182243347168) | > loss_feat: 3.580899477005005 (4.049681830406189) | > loss_mel: 24.923114776611328 (22.21437187194824) | > loss_duration: 2.9373490810394287 (2.870543622970581) | > loss_1: 38.091575622558594 (34.801943969726565)  --> STEP: 2 | > loss_disc: 2.8792972564697266 (2.82438333829244) | > loss_disc_real_0: 0.24776671826839447 (0.19419260447223982) | > loss_disc_real_1: 0.2723168730735779 (0.2615507021546364) | > loss_disc_real_2: 0.2781541645526886 (0.2633686264355977) | > loss_disc_real_3: 0.3115554451942444 (0.25215549518664676) | > loss_disc_real_4: 0.23874516785144806 (0.240933728714784) | > loss_disc_real_5: 0.25567424297332764 (0.22461118549108505) | > loss_0: 2.8792972564697266 (2.82438333829244) | > loss_gen: 1.7661972045898438 (1.972003976504008) | > loss_kl: 4.093899250030518 (3.727468411127726) | > loss_feat: 0.4798862338066101 (3.4547158976395926) | > loss_mel: 10.504356384277344 (20.262702624003094) | > loss_duration: 2.951514720916748 (2.884038805961609) | > loss_1: 19.795854568481445 (32.30092906951904)  --> STEP: 3 | > loss_disc: 3.1029069423675537 (2.8641724245888844) | > loss_disc_real_0: 0.1879349797964096 (0.19329865808997834) | > loss_disc_real_1: 0.3036114573478699 (0.26755938146795544) | > loss_disc_real_2: 0.2674987018108368 (0.26395863720348905) | > loss_disc_real_3: 0.3134107291698456 (0.2609062428985323) | > loss_disc_real_4: 0.3035717308521271 (0.24988201473440444) | > loss_disc_real_5: 0.40190625190734863 (0.24993905212197984) | > loss_0: 3.1029069423675537 (2.8641724245888844) | > loss_gen: 1.7748996019363403 (1.9438462087086268) | > loss_kl: 2.0573389530181885 (3.4888784885406494) | > loss_feat: 1.964643955230713 (3.2418484772954668) | > loss_mel: 20.43415069580078 (20.287195205688477) | > loss_duration: 2.7708754539489746 (2.8678726128169467) | > loss_1: 29.001911163330078 (31.829640797206334) --> EVAL PERFORMANCE | > avg_loader_time: 0.35637569427490234 (+0.34722526868184406) | > avg_loss_disc: 2.8641724245888844 (+0.38830014637538346) | > avg_loss_disc_real_0: 0.19329865808997834 (-0.02771457497562682) | > avg_loss_disc_real_1: 0.26755938146795544 (+0.05417688900516146) | > avg_loss_disc_real_2: 0.26395863720348905 (+0.023754208570434948) | > avg_loss_disc_real_3: 0.2609062428985323 (+0.05044664673152424) | > avg_loss_disc_real_4: 0.24988201473440444 (-0.014600488401594586) | > avg_loss_disc_real_5: 0.24993905212197984 (+0.01795992539042518) | > avg_loss_0: 2.8641724245888844 (+0.38830014637538346) | > avg_loss_gen: 1.9438462087086268 (-0.3493425221670241) | > avg_loss_kl: 3.4888784885406494 (+0.05795892079671239) | > avg_loss_feat: 3.2418484772954668 (-1.9677267784164063) | > avg_loss_mel: 20.287195205688477 (-0.9225069681803397) | > avg_loss_duration: 2.8678726128169467 (+0.08315560931251165) | > avg_loss_1: 31.829640797206334 (-3.0984610602969234)  > EPOCH: 500/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:10:04)   --> TIME: 2023-10-20 05:10:19 -- STEP: 29/50 -- GLOBAL_STEP: 78030 | > loss_disc: 2.5491228103637695 (2.4638565306005797) | > loss_disc_real_0: 0.12640777230262756 (0.17154090581782933) | > loss_disc_real_1: 0.2770088016986847 (0.23613150995867005) | > loss_disc_real_2: 0.1804431527853012 (0.25111118370089036) | > loss_disc_real_3: 0.24423658847808838 (0.23727562419813253) | > loss_disc_real_4: 0.27000826597213745 (0.22525560020886617) | > loss_disc_real_5: 0.2623104751110077 (0.21840107139071513) | > loss_0: 2.5491228103637695 (2.4638565306005797) | > grad_norm_0: tensor(274.3887, device='cuda:0') (tensor(463.3076, device='cuda:0')) | > loss_gen: 2.0388824939727783 (2.3861600119492103) | > loss_kl: 0.5889736413955688 (0.7796180705571997) | > loss_feat: 2.8090872764587402 (5.668551025334104) | > loss_mel: 21.465953826904297 (20.959528713390746) | > loss_duration: 1.4724655151367188 (1.4899971279604682) | > loss_1: 28.375362396240234 (31.28385459965673) | > grad_norm_1: tensor(2847.9810, device='cuda:0') (tensor(28045.5664, device='cuda:0')) | > current_lr_0: 0.0001213023408691937 | > current_lr_1: 0.0001213023408691937 | > step_time: 0.2697 (0.34577212662532414) | > loader_time: 0.0021 (0.006960794843476394)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8113913536071777 (2.8113913536071777) | > loss_disc_real_0: 0.09975990653038025 (0.09975990653038025) | > loss_disc_real_1: 0.1742982417345047 (0.1742982417345047) | > loss_disc_real_2: 0.4009101986885071 (0.4009101986885071) | > loss_disc_real_3: 0.2925547659397125 (0.2925547659397125) | > loss_disc_real_4: 0.36987772583961487 (0.36987772583961487) | > loss_disc_real_5: 0.3576468825340271 (0.3576468825340271) | > loss_0: 2.8113913536071777 (2.8113913536071777) | > loss_gen: 2.0992014408111572 (2.0992014408111572) | > loss_kl: 4.075293064117432 (4.075293064117432) | > loss_feat: 3.684471368789673 (3.684471368789673) | > loss_mel: 23.005029678344727 (23.005029678344727) | > loss_duration: 2.6368749141693115 (2.6368749141693115) | > loss_1: 35.50086975097656 (35.50086975097656)  --> STEP: 1 | > loss_disc: 2.7070534229278564 (2.7070534229278564) | > loss_disc_real_0: 0.20518290996551514 (0.20518290996551514) | > loss_disc_real_1: 0.23018261790275574 (0.23018261790275574) | > loss_disc_real_2: 0.23923571407794952 (0.23923571407794952) | > loss_disc_real_3: 0.2668078541755676 (0.2668078541755676) | > loss_disc_real_4: 0.1947270780801773 (0.1947270780801773) | > loss_disc_real_5: 0.20007868111133575 (0.20007868111133575) | > loss_0: 2.7070534229278564 (2.7070534229278564) | > loss_gen: 1.714377522468567 (1.714377522468567) | > loss_kl: 4.205816268920898 (4.205816268920898) | > loss_feat: 1.781153678894043 (1.781153678894043) | > loss_mel: 20.46382713317871 (20.46382713317871) | > loss_duration: 2.8914990425109863 (2.8914990425109863) | > loss_1: 31.05667495727539 (31.05667495727539)  --> STEP: 2 | > loss_disc: 2.964646100997925 (2.8358497619628906) | > loss_disc_real_0: 0.19080233573913574 (0.19799262285232544) | > loss_disc_real_1: 0.24416105449199677 (0.23717183619737625) | > loss_disc_real_2: 0.30028897523880005 (0.2697623446583748) | > loss_disc_real_3: 0.23656725883483887 (0.25168755650520325) | > loss_disc_real_4: 0.255600243806839 (0.22516366094350815) | > loss_disc_real_5: 0.25812068581581116 (0.22909968346357346) | > loss_0: 2.964646100997925 (2.8358497619628906) | > loss_gen: 1.5358177423477173 (1.625097632408142) | > loss_kl: 4.4591593742370605 (4.3324878215789795) | > loss_feat: 0.1270073503255844 (0.9540805146098137) | > loss_mel: 2.783444881439209 (11.62363600730896) | > loss_duration: 2.9036922454833984 (2.8975956439971924) | > loss_1: 11.809122085571289 (21.43289852142334)  --> STEP: 3 | > loss_disc: 2.4365477561950684 (2.7027490933736167) | > loss_disc_real_0: 0.3254607021808624 (0.24048198262850443) | > loss_disc_real_1: 0.1976117044687271 (0.22398512562115988) | > loss_disc_real_2: 0.2772176265716553 (0.27224743862946826) | > loss_disc_real_3: 0.21427863836288452 (0.23921791712443033) | > loss_disc_real_4: 0.25507086515426636 (0.2351327290137609) | > loss_disc_real_5: 0.23956769704818726 (0.2325890213251114) | > loss_0: 2.4365477561950684 (2.7027490933736167) | > loss_gen: 2.5209641456604004 (1.9237198034922283) | > loss_kl: 1.9517874717712402 (3.538921038309733) | > loss_feat: 5.810886859893799 (2.573015963037809) | > loss_mel: 23.060503005981445 (15.435925006866455) | > loss_duration: 2.5986948013305664 (2.797962029774984) | > loss_1: 35.94283676147461 (26.26954460144043) --> EVAL PERFORMANCE | > avg_loader_time: 0.012272040049235025 (-0.3441036542256673) | > avg_loss_disc: 2.7027490933736167 (-0.16142333121526775) | > avg_loss_disc_real_0: 0.24048198262850443 (+0.047183324538526084) | > avg_loss_disc_real_1: 0.22398512562115988 (-0.043574255846795557) | > avg_loss_disc_real_2: 0.27224743862946826 (+0.008288801425979209) | > avg_loss_disc_real_3: 0.23921791712443033 (-0.021688325774101985) | > avg_loss_disc_real_4: 0.2351327290137609 (-0.014749285720643546) | > avg_loss_disc_real_5: 0.2325890213251114 (-0.01735003079686845) | > avg_loss_0: 2.7027490933736167 (-0.16142333121526775) | > avg_loss_gen: 1.9237198034922283 (-0.020126405216398524) | > avg_loss_kl: 3.538921038309733 (+0.05004254976908351) | > avg_loss_feat: 2.573015963037809 (-0.6688325142576579) | > avg_loss_mel: 15.435925006866455 (-4.8512701988220215) | > avg_loss_duration: 2.797962029774984 (-0.06991058304196285) | > avg_loss_1: 26.26954460144043 (-5.5600961957659045)  > EPOCH: 501/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:10:41)   --> TIME: 2023-10-20 05:10:50 -- STEP: 9/50 -- GLOBAL_STEP: 78060 | > loss_disc: 1.6573418378829956 (2.121699094772339) | > loss_disc_real_0: 0.020425330847501755 (0.15175499435928133) | > loss_disc_real_1: 0.2620037794113159 (0.1978036430146959) | > loss_disc_real_2: 0.14301620423793793 (0.21643159952428606) | > loss_disc_real_3: 0.19879935681819916 (0.22078660213285023) | > loss_disc_real_4: 0.04146309569478035 (0.17382306646969584) | > loss_disc_real_5: 0.05583885312080383 (0.1459024747212728) | > loss_0: 1.6573418378829956 (2.121699094772339) | > grad_norm_0: tensor(473.0387, device='cuda:0') (tensor(488.3556, device='cuda:0')) | > loss_gen: 2.757793664932251 (2.543133325046963) | > loss_kl: 0.5024013519287109 (0.900075011783176) | > loss_feat: 7.937553405761719 (5.896096017625597) | > loss_mel: 23.560440063476562 (22.485547807481552) | > loss_duration: 1.4535335302352905 (1.4887335300445557) | > loss_1: 36.21172332763672 (33.313584857516815) | > grad_norm_1: tensor(23403.5508, device='cuda:0') (tensor(18410.9785, device='cuda:0')) | > current_lr_0: 0.00012118109158483323 | > current_lr_1: 0.00012118109158483323 | > step_time: 0.5584 (0.49917419751485187) | > loader_time: 0.0248 (0.01695728302001953)  --> TIME: 2023-10-20 05:11:06 -- STEP: 39/50 -- GLOBAL_STEP: 78090 | > loss_disc: 2.9983906745910645 (2.358998543176896) | > loss_disc_real_0: 0.24378016591072083 (0.1515879543163838) | > loss_disc_real_1: 0.2744433879852295 (0.21983720763371542) | > loss_disc_real_2: 0.23291701078414917 (0.22394170478368416) | > loss_disc_real_3: 0.28366467356681824 (0.22679948090360716) | > loss_disc_real_4: 0.27886149287223816 (0.21115597029431507) | > loss_disc_real_5: 0.28560948371887207 (0.2174265679831688) | > loss_0: 2.9983906745910645 (2.358998543176896) | > grad_norm_0: tensor(118.1284, device='cuda:0') (tensor(562.3913, device='cuda:0')) | > loss_gen: 1.614330768585205 (2.5144097529924827) | > loss_kl: 0.6230119466781616 (0.8486575109836383) | > loss_feat: 0.07385741174221039 (5.599142575493226) | > loss_mel: 2.540494918823242 (21.446487842462002) | > loss_duration: 1.5255846977233887 (1.4960990624550061) | > loss_1: 6.377279758453369 (31.904796783740704) | > grad_norm_1: tensor(46247.7852, device='cuda:0') (tensor(22507.1875, device='cuda:0')) | > current_lr_0: 0.00012118109158483323 | > current_lr_1: 0.00012118109158483323 | > step_time: 0.3994 (0.4964424035488031) | > loader_time: 0.025 (0.01938520333705804)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8439838886260986 (2.8439838886260986) | > loss_disc_real_0: 0.34345680475234985 (0.34345680475234985) | > loss_disc_real_1: 0.2596713900566101 (0.2596713900566101) | > loss_disc_real_2: 0.20577004551887512 (0.20577004551887512) | > loss_disc_real_3: 0.21203003823757172 (0.21203003823757172) | > loss_disc_real_4: 0.2153867483139038 (0.2153867483139038) | > loss_disc_real_5: 0.19150032103061676 (0.19150032103061676) | > loss_0: 2.8439838886260986 (2.8439838886260986) | > loss_gen: 1.7854323387145996 (1.7854323387145996) | > loss_kl: 4.3387250900268555 (4.3387250900268555) | > loss_feat: 1.8032644987106323 (1.8032644987106323) | > loss_mel: 21.9497013092041 (21.9497013092041) | > loss_duration: 2.677926778793335 (2.677926778793335) | > loss_1: 32.555049896240234 (32.555049896240234)  --> STEP: 1 | > loss_disc: 2.195307731628418 (2.195307731628418) | > loss_disc_real_0: 0.3795137405395508 (0.3795137405395508) | > loss_disc_real_1: 0.22667630016803741 (0.22667630016803741) | > loss_disc_real_2: 0.1828121542930603 (0.1828121542930603) | > loss_disc_real_3: 0.13574780523777008 (0.13574780523777008) | > loss_disc_real_4: 0.3072033226490021 (0.3072033226490021) | > loss_disc_real_5: 0.21408936381340027 (0.21408936381340027) | > loss_0: 2.195307731628418 (2.195307731628418) | > loss_gen: 3.0956735610961914 (3.0956735610961914) | > loss_kl: 3.7701241970062256 (3.7701241970062256) | > loss_feat: 8.269862174987793 (8.269862174987793) | > loss_mel: 24.6875 (24.6875) | > loss_duration: 2.8878889083862305 (2.8878889083862305) | > loss_1: 42.7110481262207 (42.7110481262207)  --> STEP: 2 | > loss_disc: 2.7842235565185547 (2.4897656440734863) | > loss_disc_real_0: 0.21449780464172363 (0.2970057725906372) | > loss_disc_real_1: 0.2658195495605469 (0.24624792486429214) | > loss_disc_real_2: 0.27881523966789246 (0.23081369698047638) | > loss_disc_real_3: 0.3165132999420166 (0.22613055258989334) | > loss_disc_real_4: 0.20886735618114471 (0.2580353394150734) | > loss_disc_real_5: 0.09379499405622482 (0.15394217893481255) | > loss_0: 2.7842235565185547 (2.4897656440734863) | > loss_gen: 1.8813631534576416 (2.4885183572769165) | > loss_kl: 4.214375019073486 (3.992249608039856) | > loss_feat: 6.6956939697265625 (7.482778072357178) | > loss_mel: 27.74477195739746 (26.21613597869873) | > loss_duration: 2.8970682621002197 (2.892478585243225) | > loss_1: 43.43326950073242 (43.07215881347656)  --> STEP: 3 | > loss_disc: 3.008624792098999 (2.6627186934153237) | > loss_disc_real_0: 0.21142688393592834 (0.26847947637240094) | > loss_disc_real_1: 0.25325289368629456 (0.24858291447162628) | > loss_disc_real_2: 0.2922983169555664 (0.2513085703055064) | > loss_disc_real_3: 0.23329512774944305 (0.22851874430974325) | > loss_disc_real_4: 0.30515602231025696 (0.2737422337134679) | > loss_disc_real_5: 0.26933610439300537 (0.19240682075421014) | > loss_0: 3.008624792098999 (2.6627186934153237) | > loss_gen: 1.570131540298462 (2.182389418284098) | > loss_kl: 2.3289244174957275 (3.43780787785848) | > loss_feat: 0.04913272708654404 (5.0048962906003) | > loss_mel: 5.46403694152832 (19.29876963297526) | > loss_duration: 2.6536760330200195 (2.8128777345021567) | > loss_1: 12.065901756286621 (32.736739794413246) --> EVAL PERFORMANCE | > avg_loader_time: 0.024050315221150715 (+0.01177827517191569) | > avg_loss_disc: 2.6627186934153237 (-0.04003039995829294) | > avg_loss_disc_real_0: 0.26847947637240094 (+0.027997493743896512) | > avg_loss_disc_real_1: 0.24858291447162628 (+0.0245977888504664) | > avg_loss_disc_real_2: 0.2513085703055064 (-0.020938868323961857) | > avg_loss_disc_real_3: 0.22851874430974325 (-0.010699172814687075) | > avg_loss_disc_real_4: 0.2737422337134679 (+0.038609504699707003) | > avg_loss_disc_real_5: 0.19240682075421014 (-0.040182200570901244) | > avg_loss_0: 2.6627186934153237 (-0.04003039995829294) | > avg_loss_gen: 2.182389418284098 (+0.2586696147918699) | > avg_loss_kl: 3.43780787785848 (-0.10111316045125296) | > avg_loss_feat: 5.0048962906003 (+2.431880327562491) | > avg_loss_mel: 19.29876963297526 (+3.8628446261088065) | > avg_loss_duration: 2.8128777345021567 (+0.014915704727172852) | > avg_loss_1: 32.736739794413246 (+6.467195192972817)  > EPOCH: 502/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:11:23)   --> TIME: 2023-10-20 05:11:37 -- STEP: 19/50 -- GLOBAL_STEP: 78120 | > loss_disc: 2.4294023513793945 (2.2870152435804667) | > loss_disc_real_0: 0.14049865305423737 (0.13043338530942014) | > loss_disc_real_1: 0.3560275733470917 (0.2101008456788565) | > loss_disc_real_2: 0.23555941879749298 (0.21491382937682302) | > loss_disc_real_3: 0.25361260771751404 (0.2398056587890575) | > loss_disc_real_4: 0.35932183265686035 (0.205238820102654) | > loss_disc_real_5: 0.27392837405204773 (0.17072469123492115) | > loss_0: 2.4294023513793945 (2.2870152435804667) | > grad_norm_0: tensor(714.3847, device='cuda:0') (tensor(994.8829, device='cuda:0')) | > loss_gen: 2.6264939308166504 (2.4876985738151953) | > loss_kl: 0.9408314228057861 (0.8939123718362105) | > loss_feat: 6.538871765136719 (6.305936847862444) | > loss_mel: 23.25478172302246 (24.8511703892758) | > loss_duration: 1.6242684125900269 (1.5354066647981341) | > loss_1: 34.98524856567383 (36.074125490690534) | > grad_norm_1: tensor(58129.5859, device='cuda:0') (tensor(46473.5469, device='cuda:0')) | > current_lr_0: 0.0001210599634967238 | > current_lr_1: 0.0001210599634967238 | > step_time: 0.3017 (0.5064989893059981) | > loader_time: 0.025 (0.01120548499257941)  --> TIME: 2023-10-20 05:11:53 -- STEP: 49/50 -- GLOBAL_STEP: 78150 | > loss_disc: 2.8841779232025146 (2.4738166770156553) | > loss_disc_real_0: 0.05614601448178291 (0.1382693511871051) | > loss_disc_real_1: 0.1959032416343689 (0.21843420866192603) | > loss_disc_real_2: 0.24109198153018951 (0.22539654541380552) | > loss_disc_real_3: 0.23713046312332153 (0.22968264121790322) | > loss_disc_real_4: 0.23680441081523895 (0.22708717193834635) | > loss_disc_real_5: 0.21938709914684296 (0.20465895674210421) | > loss_0: 2.8841779232025146 (2.4738166770156553) | > grad_norm_0: tensor(1108.2363, device='cuda:0') (tensor(990.8761, device='cuda:0')) | > loss_gen: 2.037616729736328 (2.2584247832395588) | > loss_kl: 0.3081687390804291 (0.852664232862239) | > loss_feat: 6.09659481048584 (5.256915846953587) | > loss_mel: 28.981822967529297 (22.056495749220556) | > loss_duration: 1.6296970844268799 (1.4939221873575323) | > loss_1: 39.053897857666016 (31.918423487215627) | > grad_norm_1: tensor(47863.2852, device='cuda:0') (tensor(41758.0977, device='cuda:0')) | > current_lr_0: 0.0001210599634967238 | > current_lr_1: 0.0001210599634967238 | > step_time: 0.5418 (0.4986372334616524) | > loader_time: 0.4824 (0.025440697767296617)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2549829483032227 (3.2549829483032227) | > loss_disc_real_0: 0.07679491490125656 (0.07679491490125656) | > loss_disc_real_1: 0.16487838327884674 (0.16487838327884674) | > loss_disc_real_2: 0.409553587436676 (0.409553587436676) | > loss_disc_real_3: 0.2790505886077881 (0.2790505886077881) | > loss_disc_real_4: 0.36540862917900085 (0.36540862917900085) | > loss_disc_real_5: 0.4558470547199249 (0.4558470547199249) | > loss_0: 3.2549829483032227 (3.2549829483032227) | > loss_gen: 1.7873810529708862 (1.7873810529708862) | > loss_kl: 3.1899325847625732 (3.1899325847625732) | > loss_feat: 6.594093322753906 (6.594093322753906) | > loss_mel: 26.16071128845215 (26.16071128845215) | > loss_duration: 2.519280433654785 (2.519280433654785) | > loss_1: 40.25139617919922 (40.25139617919922)  --> STEP: 1 | > loss_disc: 3.150881290435791 (3.150881290435791) | > loss_disc_real_0: 0.47241488099098206 (0.47241488099098206) | > loss_disc_real_1: 0.24254576861858368 (0.24254576861858368) | > loss_disc_real_2: 0.2546612322330475 (0.2546612322330475) | > loss_disc_real_3: 0.39231356978416443 (0.39231356978416443) | > loss_disc_real_4: 0.31257733702659607 (0.31257733702659607) | > loss_disc_real_5: 0.27662158012390137 (0.27662158012390137) | > loss_0: 3.150881290435791 (3.150881290435791) | > loss_gen: 2.092745780944824 (2.092745780944824) | > loss_kl: 3.5914077758789062 (3.5914077758789062) | > loss_feat: 4.292764186859131 (4.292764186859131) | > loss_mel: 24.98278045654297 (24.98278045654297) | > loss_duration: 2.8260385990142822 (2.8260385990142822) | > loss_1: 37.785736083984375 (37.785736083984375)  --> STEP: 2 | > loss_disc: 2.7774593830108643 (2.9641703367233276) | > loss_disc_real_0: 0.3324934244155884 (0.4024541527032852) | > loss_disc_real_1: 0.2649085819721222 (0.25372717529535294) | > loss_disc_real_2: 0.39225396513938904 (0.32345759868621826) | > loss_disc_real_3: 0.4072968661785126 (0.3998052179813385) | > loss_disc_real_4: 0.27624720335006714 (0.2944122701883316) | > loss_disc_real_5: 0.18390220403671265 (0.230261892080307) | > loss_0: 2.7774593830108643 (2.9641703367233276) | > loss_gen: 2.576493501663208 (2.334619641304016) | > loss_kl: 4.490261077880859 (4.040834426879883) | > loss_feat: 3.400118350982666 (3.8464412689208984) | > loss_mel: 26.747522354125977 (25.865151405334473) | > loss_duration: 2.7361886501312256 (2.781113624572754) | > loss_1: 39.95058059692383 (38.8681583404541)  --> STEP: 3 | > loss_disc: 2.775994300842285 (2.901444991429647) | > loss_disc_real_0: 0.18303430080413818 (0.3293142020702362) | > loss_disc_real_1: 0.27375105023384094 (0.26040180027484894) | > loss_disc_real_2: 0.3348362147808075 (0.327250470717748) | > loss_disc_real_3: 0.2629908323287964 (0.35420042276382446) | > loss_disc_real_4: 0.2613368034362793 (0.28338711460431415) | > loss_disc_real_5: 0.2896503806114197 (0.25005805492401123) | > loss_0: 2.775994300842285 (2.901444991429647) | > loss_gen: 1.9468066692352295 (2.2053486506144204) | > loss_kl: 2.3956856727600098 (3.4924515088399253) | > loss_feat: 1.2790508270263672 (2.9906444549560547) | > loss_mel: 18.185585021972656 (23.305295944213867) | > loss_duration: 2.7486298084259033 (2.770285685857137) | > loss_1: 26.555757522583008 (34.76402473449707) --> EVAL PERFORMANCE | > avg_loader_time: 0.004921754201253255 (-0.01912856101989746) | > avg_loss_disc: 2.901444991429647 (+0.2387262980143232) | > avg_loss_disc_real_0: 0.3293142020702362 (+0.06083472569783527) | > avg_loss_disc_real_1: 0.26040180027484894 (+0.011818885803222656) | > avg_loss_disc_real_2: 0.327250470717748 (+0.07594190041224158) | > avg_loss_disc_real_3: 0.35420042276382446 (+0.1256816784540812) | > avg_loss_disc_real_4: 0.28338711460431415 (+0.009644880890846252) | > avg_loss_disc_real_5: 0.25005805492401123 (+0.057651234169801086) | > avg_loss_0: 2.901444991429647 (+0.2387262980143232) | > avg_loss_gen: 2.2053486506144204 (+0.022959232330322266) | > avg_loss_kl: 3.4924515088399253 (+0.05464363098144531) | > avg_loss_feat: 2.9906444549560547 (-2.014251835644245) | > avg_loss_mel: 23.305295944213867 (+4.006526311238606) | > avg_loss_duration: 2.770285685857137 (-0.04259204864501953) | > avg_loss_1: 34.76402473449707 (+2.027284940083824)  > EPOCH: 503/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:12:02)   --> TIME: 2023-10-20 05:12:19 -- STEP: 29/50 -- GLOBAL_STEP: 78180 | > loss_disc: 2.909830093383789 (2.525575769358668) | > loss_disc_real_0: 0.30511370301246643 (0.1728039219782784) | > loss_disc_real_1: 0.1878253072500229 (0.22622333723923255) | > loss_disc_real_2: 0.29436609148979187 (0.21830199517566581) | > loss_disc_real_3: 0.21543636918067932 (0.25585453546252745) | > loss_disc_real_4: 0.46317729353904724 (0.24938995082830562) | > loss_disc_real_5: 0.39812904596328735 (0.23799396293430491) | > loss_0: 2.909830093383789 (2.525575769358668) | > grad_norm_0: tensor(1421.0175, device='cuda:0') (tensor(1161.2307, device='cuda:0')) | > loss_gen: 2.428032398223877 (2.2989899947725494) | > loss_kl: 1.1798444986343384 (0.8917363183251743) | > loss_feat: 5.197176456451416 (5.029310770910875) | > loss_mel: 23.808500289916992 (20.889097320622415) | > loss_duration: 1.4697010517120361 (1.5073393788830987) | > loss_1: 34.083251953125 (30.616473477462243) | > grad_norm_1: tensor(43883.9844, device='cuda:0') (tensor(35003.6562, device='cuda:0')) | > current_lr_0: 0.00012093895648372222 | > current_lr_1: 0.00012093895648372222 | > step_time: 0.3268 (0.4140093408781907) | > loader_time: 0.0067 (0.010045109124019229)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8221213817596436 (2.8221213817596436) | > loss_disc_real_0: 0.1837007701396942 (0.1837007701396942) | > loss_disc_real_1: 0.20345379412174225 (0.20345379412174225) | > loss_disc_real_2: 0.3084511458873749 (0.3084511458873749) | > loss_disc_real_3: 0.25593864917755127 (0.25593864917755127) | > loss_disc_real_4: 0.27066653966903687 (0.27066653966903687) | > loss_disc_real_5: 0.25141701102256775 (0.25141701102256775) | > loss_0: 2.8221213817596436 (2.8221213817596436) | > loss_gen: 1.6825251579284668 (1.6825251579284668) | > loss_kl: 3.676412582397461 (3.676412582397461) | > loss_feat: 0.5709556341171265 (0.5709556341171265) | > loss_mel: 14.931446075439453 (14.931446075439453) | > loss_duration: 2.5517165660858154 (2.5517165660858154) | > loss_1: 23.413055419921875 (23.413055419921875)  --> STEP: 1 | > loss_disc: 1.914760947227478 (1.914760947227478) | > loss_disc_real_0: 0.054804470390081406 (0.054804470390081406) | > loss_disc_real_1: 0.11769431829452515 (0.11769431829452515) | > loss_disc_real_2: 0.28999730944633484 (0.28999730944633484) | > loss_disc_real_3: 0.32839399576187134 (0.32839399576187134) | > loss_disc_real_4: 0.1939762383699417 (0.1939762383699417) | > loss_disc_real_5: 0.28474509716033936 (0.28474509716033936) | > loss_0: 1.914760947227478 (1.914760947227478) | > loss_gen: 3.093675374984741 (3.093675374984741) | > loss_kl: 3.7339577674865723 (3.7339577674865723) | > loss_feat: 6.850490570068359 (6.850490570068359) | > loss_mel: 22.99193572998047 (22.99193572998047) | > loss_duration: 2.873371124267578 (2.873371124267578) | > loss_1: 39.54343032836914 (39.54343032836914)  --> STEP: 2 | > loss_disc: 2.9812514781951904 (2.4480062127113342) | > loss_disc_real_0: 0.20554542541503906 (0.13017494790256023) | > loss_disc_real_1: 0.2128416895866394 (0.16526800394058228) | > loss_disc_real_2: 0.3226611316204071 (0.30632922053337097) | > loss_disc_real_3: 0.28171640634536743 (0.3050552010536194) | > loss_disc_real_4: 0.2727159559726715 (0.2333460971713066) | > loss_disc_real_5: 0.2656141221523285 (0.2751796096563339) | > loss_0: 2.9812514781951904 (2.4480062127113342) | > loss_gen: 1.6027257442474365 (2.348200559616089) | > loss_kl: 4.617303371429443 (4.175630569458008) | > loss_feat: 0.21859757602214813 (3.5345440730452538) | > loss_mel: 10.233978271484375 (16.612957000732422) | > loss_duration: 2.892951011657715 (2.8831610679626465) | > loss_1: 19.565555572509766 (29.554492950439453)  --> STEP: 3 | > loss_disc: 3.036729574203491 (2.6442473332087197) | > loss_disc_real_0: 0.14311784505844116 (0.13448924695452055) | > loss_disc_real_1: 0.2854030430316925 (0.20531301697095236) | > loss_disc_real_2: 0.4236499071121216 (0.34543611605962116) | > loss_disc_real_3: 0.39587098360061646 (0.3353271285692851) | > loss_disc_real_4: 0.37476828694343567 (0.2804868270953496) | > loss_disc_real_5: 0.3595494329929352 (0.3033028841018677) | > loss_0: 3.036729574203491 (2.6442473332087197) | > loss_gen: 2.140193223953247 (2.278864781061808) | > loss_kl: 2.028256893157959 (3.459839344024658) | > loss_feat: 1.8368831872940063 (2.9686571111281714) | > loss_mel: 20.298978805541992 (17.841630935668945) | > loss_duration: 2.705470323562622 (2.823930819829305) | > loss_1: 29.009784698486328 (29.372923533121746) --> EVAL PERFORMANCE | > avg_loader_time: 0.01660911242167155 (+0.011687358220418297) | > avg_loss_disc: 2.6442473332087197 (-0.2571976582209272) | > avg_loss_disc_real_0: 0.13448924695452055 (-0.19482495511571565) | > avg_loss_disc_real_1: 0.20531301697095236 (-0.05508878330389658) | > avg_loss_disc_real_2: 0.34543611605962116 (+0.01818564534187317) | > avg_loss_disc_real_3: 0.3353271285692851 (-0.01887329419453937) | > avg_loss_disc_real_4: 0.2804868270953496 (-0.0029002875089645386) | > avg_loss_disc_real_5: 0.3033028841018677 (+0.053244829177856445) | > avg_loss_0: 2.6442473332087197 (-0.2571976582209272) | > avg_loss_gen: 2.278864781061808 (+0.0735161304473877) | > avg_loss_kl: 3.459839344024658 (-0.032612164815267075) | > avg_loss_feat: 2.9686571111281714 (-0.021987343827883254) | > avg_loss_mel: 17.841630935668945 (-5.463665008544922) | > avg_loss_duration: 2.823930819829305 (+0.05364513397216797) | > avg_loss_1: 29.372923533121746 (-5.391101201375324)  > EPOCH: 504/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:12:39)   --> TIME: 2023-10-20 05:12:48 -- STEP: 9/50 -- GLOBAL_STEP: 78210 | > loss_disc: 2.356287956237793 (2.2988129456837973) | > loss_disc_real_0: 0.10433077067136765 (0.11655366213785277) | > loss_disc_real_1: 0.24581094086170197 (0.24682427942752838) | > loss_disc_real_2: 0.08868251740932465 (0.23073789891269472) | > loss_disc_real_3: 0.22203129529953003 (0.29316022660997176) | > loss_disc_real_4: 0.11454562842845917 (0.19190527436633906) | > loss_disc_real_5: 0.18836607038974762 (0.15869331008030307) | > loss_0: 2.356287956237793 (2.2988129456837973) | > grad_norm_0: tensor(1187.7815, device='cuda:0') (tensor(1141.4254, device='cuda:0')) | > loss_gen: 2.1920087337493896 (2.45823339621226) | > loss_kl: 0.9228405356407166 (0.907080676820543) | > loss_feat: 9.997282028198242 (6.84247393740548) | > loss_mel: 22.19729232788086 (22.358726501464844) | > loss_duration: 1.4292203187942505 (1.4946953588061862) | > loss_1: 36.7386474609375 (34.061210526360405) | > grad_norm_1: tensor(26714.1387, device='cuda:0') (tensor(32102.6641, device='cuda:0')) | > current_lr_0: 0.00012081807042480628 | > current_lr_1: 0.00012081807042480628 | > step_time: 0.5749 (0.49329619937472874) | > loader_time: 0.0234 (0.02049385176764594)  --> TIME: 2023-10-20 05:13:04 -- STEP: 39/50 -- GLOBAL_STEP: 78240 | > loss_disc: 1.4403059482574463 (2.5146121061765223) | > loss_disc_real_0: 0.15136246383190155 (0.16898787967287576) | > loss_disc_real_1: 0.28347325325012207 (0.2445662940541903) | > loss_disc_real_2: 0.10534864664077759 (0.24366948161369706) | > loss_disc_real_3: 0.14325058460235596 (0.2596108682262592) | > loss_disc_real_4: 0.09322309494018555 (0.24228779880855333) | > loss_disc_real_5: 0.027922790497541428 (0.23014587283325502) | > loss_0: 1.4403059482574463 (2.5146121061765223) | > grad_norm_0: tensor(1229.7566, device='cuda:0') (tensor(1331.6566, device='cuda:0')) | > loss_gen: 3.6913130283355713 (2.306368451852065) | > loss_kl: 0.5388385057449341 (0.9012418610927386) | > loss_feat: 10.327610969543457 (5.164851139180171) | > loss_mel: 23.914752960205078 (21.467456316336605) | > loss_duration: 1.5083173513412476 (1.477391716761467) | > loss_1: 39.9808349609375 (31.317309856414795) | > grad_norm_1: tensor(85694.5312, device='cuda:0') (tensor(39023.1055, device='cuda:0')) | > current_lr_0: 0.00012081807042480628 | > current_lr_1: 0.00012081807042480628 | > step_time: 0.5594 (0.4950267534989577) | > loader_time: 0.0242 (0.020283423937284033)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8152947425842285 (2.8152947425842285) | > loss_disc_real_0: 0.25101733207702637 (0.25101733207702637) | > loss_disc_real_1: 0.2626396417617798 (0.2626396417617798) | > loss_disc_real_2: 0.23395295441150665 (0.23395295441150665) | > loss_disc_real_3: 0.2644483149051666 (0.2644483149051666) | > loss_disc_real_4: 0.2346785068511963 (0.2346785068511963) | > loss_disc_real_5: 0.22990600764751434 (0.22990600764751434) | > loss_0: 2.8152947425842285 (2.8152947425842285) | > loss_gen: 1.6979721784591675 (1.6979721784591675) | > loss_kl: 3.4174888134002686 (3.4174888134002686) | > loss_feat: 0.6489387154579163 (0.6489387154579163) | > loss_mel: 15.486209869384766 (15.486209869384766) | > loss_duration: 2.555987596511841 (2.555987596511841) | > loss_1: 23.806596755981445 (23.806596755981445)  --> STEP: 1 | > loss_disc: 2.6699910163879395 (2.6699910163879395) | > loss_disc_real_0: 0.2018391191959381 (0.2018391191959381) | > loss_disc_real_1: 0.2517717778682709 (0.2517717778682709) | > loss_disc_real_2: 0.22727066278457642 (0.22727066278457642) | > loss_disc_real_3: 0.2960962951183319 (0.2960962951183319) | > loss_disc_real_4: 0.22032740712165833 (0.22032740712165833) | > loss_disc_real_5: 0.405752956867218 (0.405752956867218) | > loss_0: 2.6699910163879395 (2.6699910163879395) | > loss_gen: 2.232508420944214 (2.232508420944214) | > loss_kl: 3.648177146911621 (3.648177146911621) | > loss_feat: 5.94881010055542 (5.94881010055542) | > loss_mel: 23.41962432861328 (23.41962432861328) | > loss_duration: 2.9643616676330566 (2.9643616676330566) | > loss_1: 38.21348190307617 (38.21348190307617)  --> STEP: 2 | > loss_disc: 2.4661664962768555 (2.5680787563323975) | > loss_disc_real_0: 0.12699566781520844 (0.16441739350557327) | > loss_disc_real_1: 0.3442109525203705 (0.2979913651943207) | > loss_disc_real_2: 0.25812020897865295 (0.24269543588161469) | > loss_disc_real_3: 0.32497870922088623 (0.31053750216960907) | > loss_disc_real_4: 0.2998761236667633 (0.2601017653942108) | > loss_disc_real_5: 0.29061511158943176 (0.3481840342283249) | > loss_0: 2.4661664962768555 (2.5680787563323975) | > loss_gen: 2.5207576751708984 (2.376633048057556) | > loss_kl: 4.054079532623291 (3.851128339767456) | > loss_feat: 2.8360707759857178 (4.392440438270569) | > loss_mel: 23.600862503051758 (23.51024341583252) | > loss_duration: 2.8617608547210693 (2.913061261177063) | > loss_1: 35.873531341552734 (37.04350662231445)  --> STEP: 3 | > loss_disc: 2.4615838527679443 (2.5325804551442466) | > loss_disc_real_0: 0.1645767092704773 (0.1644704987605413) | > loss_disc_real_1: 0.2965981364250183 (0.2975269556045532) | > loss_disc_real_2: 0.1629856377840042 (0.2161255031824112) | > loss_disc_real_3: 0.3175930380821228 (0.31288934747378033) | > loss_disc_real_4: 0.22956115007400513 (0.24992156028747559) | > loss_disc_real_5: 0.3609570562839508 (0.3524417082468669) | > loss_0: 2.4615838527679443 (2.5325804551442466) | > loss_gen: 2.704305410385132 (2.4858571688334146) | > loss_kl: 2.214224100112915 (3.3054935932159424) | > loss_feat: 5.410772800445557 (4.7318845589955645) | > loss_mel: 21.26863670349121 (22.763041178385418) | > loss_duration: 2.6920039653778076 (2.8393754959106445) | > loss_1: 34.28994369506836 (36.12565231323242) --> EVAL PERFORMANCE | > avg_loader_time: 0.0034902095794677734 (-0.013118902842203777) | > avg_loss_disc: 2.5325804551442466 (-0.11166687806447317) | > avg_loss_disc_real_0: 0.1644704987605413 (+0.029981251806020737) | > avg_loss_disc_real_1: 0.2975269556045532 (+0.09221393863360086) | > avg_loss_disc_real_2: 0.2161255031824112 (-0.12931061287720996) | > avg_loss_disc_real_3: 0.31288934747378033 (-0.02243778109550476) | > avg_loss_disc_real_4: 0.24992156028747559 (-0.030565266807874025) | > avg_loss_disc_real_5: 0.3524417082468669 (+0.049138824144999205) | > avg_loss_0: 2.5325804551442466 (-0.11166687806447317) | > avg_loss_gen: 2.4858571688334146 (+0.20699238777160645) | > avg_loss_kl: 3.3054935932159424 (-0.15434575080871582) | > avg_loss_feat: 4.7318845589955645 (+1.763227447867393) | > avg_loss_mel: 22.763041178385418 (+4.9214102427164725) | > avg_loss_duration: 2.8393754959106445 (+0.01544467608133937) | > avg_loss_1: 36.12565231323242 (+6.752728780110676)  > EPOCH: 505/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:13:21)   --> TIME: 2023-10-20 05:13:35 -- STEP: 19/50 -- GLOBAL_STEP: 78270 | > loss_disc: 2.050337791442871 (2.668188496639854) | > loss_disc_real_0: 0.21831735968589783 (0.18930733507793202) | > loss_disc_real_1: 0.2232484668493271 (0.23296705437333962) | > loss_disc_real_2: 0.20576028525829315 (0.24022139765714345) | > loss_disc_real_3: 0.25709718465805054 (0.2694588436892158) | > loss_disc_real_4: 0.08773396909236908 (0.24540952357806659) | > loss_disc_real_5: 0.08878947049379349 (0.2801729711262803) | > loss_0: 2.050337791442871 (2.668188496639854) | > grad_norm_0: tensor(1350.0907, device='cuda:0') (tensor(956.9609, device='cuda:0')) | > loss_gen: 2.4879798889160156 (2.070413401252345) | > loss_kl: 0.9599528312683105 (0.84185181950268) | > loss_feat: 8.986959457397461 (3.611122886993383) | > loss_mel: 28.544586181640625 (19.191687433343183) | > loss_duration: 1.5891672372817993 (1.5182354701192755) | > loss_1: 42.56864929199219 (27.23331079984966) | > grad_norm_1: tensor(92117.1797, device='cuda:0') (tensor(28817.6719, device='cuda:0')) | > current_lr_0: 0.00012069730519907483 | > current_lr_1: 0.00012069730519907483 | > step_time: 0.5624 (0.4724850027184737) | > loader_time: 0.0208 (0.010780999535008481)  --> TIME: 2023-10-20 05:13:52 -- STEP: 49/50 -- GLOBAL_STEP: 78300 | > loss_disc: 2.947551965713501 (2.5729951128667716) | > loss_disc_real_0: 0.35972046852111816 (0.17873897661968152) | > loss_disc_real_1: 0.3400106430053711 (0.22975950399223638) | > loss_disc_real_2: 0.38283729553222656 (0.23091506669107748) | > loss_disc_real_3: 0.31029486656188965 (0.23201304172374765) | > loss_disc_real_4: 0.2962993085384369 (0.23252807215464358) | > loss_disc_real_5: 0.2856390178203583 (0.2507230830283798) | > loss_0: 2.947551965713501 (2.5729951128667716) | > grad_norm_0: tensor(2774.2351, device='cuda:0') (tensor(1013.3043, device='cuda:0')) | > loss_gen: 2.2268052101135254 (2.1312941045177225) | > loss_kl: 1.0536595582962036 (0.8488934727347627) | > loss_feat: 1.515079379081726 (4.378464553581208) | > loss_mel: 18.990962982177734 (19.21531244321745) | > loss_duration: 1.6333293914794922 (1.4836905902745772) | > loss_1: 25.419836044311523 (28.05765506199428) | > grad_norm_1: tensor(8711.1094, device='cuda:0') (tensor(30883.4258, device='cuda:0')) | > current_lr_0: 0.00012069730519907483 | > current_lr_1: 0.00012069730519907483 | > step_time: 0.7371 (0.5070663325640623) | > loader_time: 0.5182 (0.02658541348515725)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.599775791168213 (2.599775791168213) | > loss_disc_real_0: 0.15247304737567902 (0.15247304737567902) | > loss_disc_real_1: 0.16561508178710938 (0.16561508178710938) | > loss_disc_real_2: 0.24403488636016846 (0.24403488636016846) | > loss_disc_real_3: 0.2778458893299103 (0.2778458893299103) | > loss_disc_real_4: 0.08537544310092926 (0.08537544310092926) | > loss_disc_real_5: 0.4162505269050598 (0.4162505269050598) | > loss_0: 2.599775791168213 (2.599775791168213) | > loss_gen: 1.9689968824386597 (1.9689968824386597) | > loss_kl: 3.895711660385132 (3.895711660385132) | > loss_feat: 7.100674629211426 (7.100674629211426) | > loss_mel: 23.187225341796875 (23.187225341796875) | > loss_duration: 2.653308868408203 (2.653308868408203) | > loss_1: 38.8059196472168 (38.8059196472168)  --> STEP: 1 | > loss_disc: 3.3174705505371094 (3.3174705505371094) | > loss_disc_real_0: 0.3059489130973816 (0.3059489130973816) | > loss_disc_real_1: 0.25569090247154236 (0.25569090247154236) | > loss_disc_real_2: 0.4263869524002075 (0.4263869524002075) | > loss_disc_real_3: 0.3482031524181366 (0.3482031524181366) | > loss_disc_real_4: 0.3153769075870514 (0.3153769075870514) | > loss_disc_real_5: 0.40121424198150635 (0.40121424198150635) | > loss_0: 3.3174705505371094 (3.3174705505371094) | > loss_gen: 1.9215620756149292 (1.9215620756149292) | > loss_kl: 3.8866207599639893 (3.8866207599639893) | > loss_feat: 3.122455358505249 (3.122455358505249) | > loss_mel: 22.645204544067383 (22.645204544067383) | > loss_duration: 2.9632556438446045 (2.9632556438446045) | > loss_1: 34.539100646972656 (34.539100646972656)  --> STEP: 2 | > loss_disc: 3.4905574321746826 (3.404013991355896) | > loss_disc_real_0: 0.2750852406024933 (0.29051707684993744) | > loss_disc_real_1: 0.2743987441062927 (0.26504482328891754) | > loss_disc_real_2: 0.27288252115249634 (0.34963473677635193) | > loss_disc_real_3: 0.3182609975337982 (0.3332320749759674) | > loss_disc_real_4: 0.29550713300704956 (0.3054420202970505) | > loss_disc_real_5: 0.27707961201667786 (0.3391469269990921) | > loss_0: 3.4905574321746826 (3.404013991355896) | > loss_gen: 1.3125088214874268 (1.617035448551178) | > loss_kl: 4.848642349243164 (4.367631554603577) | > loss_feat: 1.5650465488433838 (2.3437509536743164) | > loss_mel: 19.376731872558594 (21.01096820831299) | > loss_duration: 2.856088638305664 (2.9096721410751343) | > loss_1: 29.95901870727539 (32.24905967712402)  --> STEP: 3 | > loss_disc: 2.883488893508911 (3.230505625406901) | > loss_disc_real_0: 0.2498214840888977 (0.2769518792629242) | > loss_disc_real_1: 0.25633561611175537 (0.26214175422986347) | > loss_disc_real_2: 0.22533836960792542 (0.3082026143868764) | > loss_disc_real_3: 0.2421007752418518 (0.3028549750645955) | > loss_disc_real_4: 0.25531065464019775 (0.28873156507809955) | > loss_disc_real_5: 0.2320321500301361 (0.30344200134277344) | > loss_0: 2.883488893508911 (3.230505625406901) | > loss_gen: 1.5950037240982056 (1.6096915404001872) | > loss_kl: 1.9142448902130127 (3.549835999806722) | > loss_feat: 0.6360421180725098 (1.7745146751403809) | > loss_mel: 5.583057403564453 (15.86833127339681) | > loss_duration: 2.6568639278411865 (2.8254027366638184) | > loss_1: 12.385212898254395 (25.627777417500813) --> EVAL PERFORMANCE | > avg_loader_time: 0.006885051727294922 (+0.0033948421478271484) | > avg_loss_disc: 3.230505625406901 (+0.6979251702626543) | > avg_loss_disc_real_0: 0.2769518792629242 (+0.1124813805023829) | > avg_loss_disc_real_1: 0.26214175422986347 (-0.035385201374689756) | > avg_loss_disc_real_2: 0.3082026143868764 (+0.09207711120446521) | > avg_loss_disc_real_3: 0.3028549750645955 (-0.01003437240918481) | > avg_loss_disc_real_4: 0.28873156507809955 (+0.038810004790623964) | > avg_loss_disc_real_5: 0.30344200134277344 (-0.04899970690409344) | > avg_loss_0: 3.230505625406901 (+0.6979251702626543) | > avg_loss_gen: 1.6096915404001872 (-0.8761656284332273) | > avg_loss_kl: 3.549835999806722 (+0.24434240659077977) | > avg_loss_feat: 1.7745146751403809 (-2.9573698838551836) | > avg_loss_mel: 15.86833127339681 (-6.894709904988607) | > avg_loss_duration: 2.8254027366638184 (-0.013972759246826172) | > avg_loss_1: 25.627777417500813 (-10.49787489573161)  > EPOCH: 506/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:14:01)   --> TIME: 2023-10-20 05:14:17 -- STEP: 29/50 -- GLOBAL_STEP: 78330 | > loss_disc: 1.8968969583511353 (2.3641393883474944) | > loss_disc_real_0: 0.09699058532714844 (0.1367706151293783) | > loss_disc_real_1: 0.11757536977529526 (0.2109606039935145) | > loss_disc_real_2: 0.13149547576904297 (0.23685770520362362) | > loss_disc_real_3: 0.10901112854480743 (0.2189289016713356) | > loss_disc_real_4: 0.19678190350532532 (0.20963434772244816) | > loss_disc_real_5: 0.23162390291690826 (0.2538193904891097) | > loss_0: 1.8968969583511353 (2.3641393883474944) | > grad_norm_0: tensor(1012.4062, device='cuda:0') (tensor(1140.9945, device='cuda:0')) | > loss_gen: 2.985470771789551 (2.5142371448977237) | > loss_kl: 0.7425444722175598 (0.8825579326728294) | > loss_feat: 9.482233047485352 (5.994734472177666) | > loss_mel: 25.427032470703125 (21.903909831211486) | > loss_duration: 1.537871241569519 (1.4954263136304657) | > loss_1: 40.17515182495117 (32.79086602967361) | > grad_norm_1: tensor(67452.3359, device='cuda:0') (tensor(44417.8477, device='cuda:0')) | > current_lr_0: 0.00012057666068574753 | > current_lr_1: 0.00012057666068574753 | > step_time: 0.3398 (0.37160766535791856) | > loader_time: 0.0032 (0.008958372576483364)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1121339797973633 (2.1121339797973633) | > loss_disc_real_0: 0.10815897583961487 (0.10815897583961487) | > loss_disc_real_1: 0.2437751740217209 (0.2437751740217209) | > loss_disc_real_2: 0.39996638894081116 (0.39996638894081116) | > loss_disc_real_3: 0.16946233808994293 (0.16946233808994293) | > loss_disc_real_4: 0.1475657820701599 (0.1475657820701599) | > loss_disc_real_5: 0.30490174889564514 (0.30490174889564514) | > loss_0: 2.1121339797973633 (2.1121339797973633) | > loss_gen: 2.849318027496338 (2.849318027496338) | > loss_kl: 3.837998628616333 (3.837998628616333) | > loss_feat: 7.481273174285889 (7.481273174285889) | > loss_mel: 22.35442352294922 (22.35442352294922) | > loss_duration: 2.559974193572998 (2.559974193572998) | > loss_1: 39.08298873901367 (39.08298873901367)  --> STEP: 1 | > loss_disc: 1.8073289394378662 (1.8073289394378662) | > loss_disc_real_0: 0.08957873284816742 (0.08957873284816742) | > loss_disc_real_1: 0.13591520488262177 (0.13591520488262177) | > loss_disc_real_2: 0.09128884226083755 (0.09128884226083755) | > loss_disc_real_3: 0.09916149824857712 (0.09916149824857712) | > loss_disc_real_4: 0.10244288295507431 (0.10244288295507431) | > loss_disc_real_5: 0.08681213110685349 (0.08681213110685349) | > loss_0: 1.8073289394378662 (1.8073289394378662) | > loss_gen: 2.2788636684417725 (2.2788636684417725) | > loss_kl: 4.299534320831299 (4.299534320831299) | > loss_feat: 9.278546333312988 (9.278546333312988) | > loss_mel: 25.729206085205078 (25.729206085205078) | > loss_duration: 2.8659398555755615 (2.8659398555755615) | > loss_1: 44.452091217041016 (44.452091217041016)  --> STEP: 2 | > loss_disc: 2.756305694580078 (2.281817317008972) | > loss_disc_real_0: 0.11040950566530228 (0.09999411925673485) | > loss_disc_real_1: 0.26150038838386536 (0.19870779663324356) | > loss_disc_real_2: 0.2846146523952484 (0.18795174732804298) | > loss_disc_real_3: 0.2798956632614136 (0.18952858075499535) | > loss_disc_real_4: 0.3131827712059021 (0.2078128270804882) | > loss_disc_real_5: 0.23752136528491974 (0.1621667481958866) | > loss_0: 2.756305694580078 (2.281817317008972) | > loss_gen: 1.7705228328704834 (2.024693250656128) | > loss_kl: 4.104992389678955 (4.202263355255127) | > loss_feat: 1.2878828048706055 (5.283214569091797) | > loss_mel: 23.22510528564453 (24.477155685424805) | > loss_duration: 2.800954580307007 (2.833447217941284) | > loss_1: 33.189456939697266 (38.82077407836914)  --> STEP: 3 | > loss_disc: 3.124523878097534 (2.5627195040384927) | > loss_disc_real_0: 0.11644291877746582 (0.10547705243031184) | > loss_disc_real_1: 0.5769999623298645 (0.3248051851987839) | > loss_disc_real_2: 0.3917781710624695 (0.25589388857285184) | > loss_disc_real_3: 0.4405823051929474 (0.273213155567646) | > loss_disc_real_4: 0.3378182053565979 (0.25114795317252475) | > loss_disc_real_5: 0.13754627108573914 (0.15395992249250412) | > loss_0: 3.124523878097534 (2.5627195040384927) | > loss_gen: 2.3136885166168213 (2.121025005976359) | > loss_kl: 1.9868450164794922 (3.4637905756632485) | > loss_feat: 5.7118000984191895 (5.426076412200928) | > loss_mel: 24.86112403869629 (24.6051451365153) | > loss_duration: 2.732908010482788 (2.799934148788452) | > loss_1: 37.60636520385742 (38.41597112019857) --> EVAL PERFORMANCE | > avg_loader_time: 0.01031343142191569 (+0.0034283796946207677) | > avg_loss_disc: 2.5627195040384927 (-0.6677861213684082) | > avg_loss_disc_real_0: 0.10547705243031184 (-0.17147482683261234) | > avg_loss_disc_real_1: 0.3248051851987839 (+0.06266343096892041) | > avg_loss_disc_real_2: 0.25589388857285184 (-0.05230872581402457) | > avg_loss_disc_real_3: 0.273213155567646 (-0.029641819496949495) | > avg_loss_disc_real_4: 0.25114795317252475 (-0.0375836119055748) | > avg_loss_disc_real_5: 0.15395992249250412 (-0.14948207885026932) | > avg_loss_0: 2.5627195040384927 (-0.6677861213684082) | > avg_loss_gen: 2.121025005976359 (+0.5113334655761717) | > avg_loss_kl: 3.4637905756632485 (-0.0860454241434736) | > avg_loss_feat: 5.426076412200928 (+3.651561737060547) | > avg_loss_mel: 24.6051451365153 (+8.73681386311849) | > avg_loss_duration: 2.799934148788452 (-0.02546858787536621) | > avg_loss_1: 38.41597112019857 (+12.788193702697757)  > EPOCH: 507/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:14:39)   --> TIME: 2023-10-20 05:14:48 -- STEP: 9/50 -- GLOBAL_STEP: 78360 | > loss_disc: 2.5789008140563965 (1.966387775209215) | > loss_disc_real_0: 0.19762377440929413 (0.11773294334610303) | > loss_disc_real_1: 0.30159449577331543 (0.2112002952231301) | > loss_disc_real_2: 0.43999147415161133 (0.18712590841783416) | > loss_disc_real_3: 0.47781211137771606 (0.23679791204631329) | > loss_disc_real_4: 0.3454410433769226 (0.18552471117840874) | > loss_disc_real_5: 0.2149740606546402 (0.13194721098989248) | > loss_0: 2.5789008140563965 (1.966387775209215) | > grad_norm_0: tensor(941.0707, device='cuda:0') (tensor(443.0144, device='cuda:0')) | > loss_gen: 3.548705816268921 (2.8822984430525036) | > loss_kl: 0.9295639395713806 (0.789330350028144) | > loss_feat: 5.7116217613220215 (8.862895965576172) | > loss_mel: 26.180374145507812 (25.227754804823135) | > loss_duration: 1.4509202241897583 (1.475012395117018) | > loss_1: 37.82118606567383 (39.23729260762533) | > grad_norm_1: tensor(2940.3364, device='cuda:0') (tensor(18043.6504, device='cuda:0')) | > current_lr_0: 0.00012045613676416477 | > current_lr_1: 0.00012045613676416477 | > step_time: 0.2807 (0.5096574359469943) | > loader_time: 0.0249 (0.017724858389960393)  --> TIME: 2023-10-20 05:15:03 -- STEP: 39/50 -- GLOBAL_STEP: 78390 | > loss_disc: 0.9223840832710266 (2.356096474023966) | > loss_disc_real_0: 0.018514107912778854 (0.14532258939475584) | > loss_disc_real_1: 0.02976718172430992 (0.21973588852546153) | > loss_disc_real_2: 0.020275121554732323 (0.230334758424224) | > loss_disc_real_3: 0.020676622167229652 (0.23408986971928522) | > loss_disc_real_4: 0.07841802388429642 (0.21952284046281606) | > loss_disc_real_5: 0.02321653440594673 (0.20873655522098908) | > loss_0: 0.9223840832710266 (2.356096474023966) | > grad_norm_0: tensor(300.6346, device='cuda:0') (tensor(604.2097, device='cuda:0')) | > loss_gen: 3.6931281089782715 (2.449462933418079) | > loss_kl: 0.24485157430171967 (0.8391827914195183) | > loss_feat: 11.694998741149902 (6.2907234983375435) | > loss_mel: 25.38094711303711 (23.46141648903871) | > loss_duration: 1.5078810453414917 (1.4799915032509048) | > loss_1: 42.52180480957031 (34.52077710322845) | > grad_norm_1: tensor(60878.5898, device='cuda:0') (tensor(21735.0195, device='cuda:0')) | > current_lr_0: 0.00012045613676416477 | > current_lr_1: 0.00012045613676416477 | > step_time: 0.302 (0.49669263301751543) | > loader_time: 0.0254 (0.018884016917302054)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.930419921875 (2.930419921875) | > loss_disc_real_0: 0.3257436752319336 (0.3257436752319336) | > loss_disc_real_1: 0.2549109160900116 (0.2549109160900116) | > loss_disc_real_2: 0.2713872790336609 (0.2713872790336609) | > loss_disc_real_3: 0.269979864358902 (0.269979864358902) | > loss_disc_real_4: 0.258109986782074 (0.258109986782074) | > loss_disc_real_5: 0.25274163484573364 (0.25274163484573364) | > loss_0: 2.930419921875 (2.930419921875) | > loss_gen: 1.879120111465454 (1.879120111465454) | > loss_kl: 3.914017915725708 (3.914017915725708) | > loss_feat: 0.7459122538566589 (0.7459122538566589) | > loss_mel: 20.79145050048828 (20.79145050048828) | > loss_duration: 2.594172954559326 (2.594172954559326) | > loss_1: 29.92467498779297 (29.92467498779297)  --> STEP: 1 | > loss_disc: 2.2485971450805664 (2.2485971450805664) | > loss_disc_real_0: 0.14108875393867493 (0.14108875393867493) | > loss_disc_real_1: 0.45905399322509766 (0.45905399322509766) | > loss_disc_real_2: 0.21206501126289368 (0.21206501126289368) | > loss_disc_real_3: 0.37006357312202454 (0.37006357312202454) | > loss_disc_real_4: 0.25325217843055725 (0.25325217843055725) | > loss_disc_real_5: 0.2372627705335617 (0.2372627705335617) | > loss_0: 2.2485971450805664 (2.2485971450805664) | > loss_gen: 3.190706729888916 (3.190706729888916) | > loss_kl: 4.281771659851074 (4.281771659851074) | > loss_feat: 6.417089462280273 (6.417089462280273) | > loss_mel: 26.91929054260254 (26.91929054260254) | > loss_duration: 2.9195687770843506 (2.9195687770843506) | > loss_1: 43.72842788696289 (43.72842788696289)  --> STEP: 2 | > loss_disc: 2.775287389755249 (2.5119422674179077) | > loss_disc_real_0: 0.10195466130971909 (0.121521707624197) | > loss_disc_real_1: 0.35298311710357666 (0.40601855516433716) | > loss_disc_real_2: 0.30903160572052 (0.26054830849170685) | > loss_disc_real_3: 0.2942427694797516 (0.33215317130088806) | > loss_disc_real_4: 0.21984981000423431 (0.23655099421739578) | > loss_disc_real_5: 0.2684755027294159 (0.2528691366314888) | > loss_0: 2.775287389755249 (2.5119422674179077) | > loss_gen: 1.9529383182525635 (2.5718225240707397) | > loss_kl: 4.251815319061279 (4.266793489456177) | > loss_feat: 2.603208303451538 (4.510148882865906) | > loss_mel: 25.076549530029297 (25.997920036315918) | > loss_duration: 2.717299699783325 (2.818434238433838) | > loss_1: 36.601810455322266 (40.16511917114258)  --> STEP: 3 | > loss_disc: 3.1067042350769043 (2.7101962566375732) | > loss_disc_real_0: 0.2153371423482895 (0.1527935191988945) | > loss_disc_real_1: 0.4143225848674774 (0.4087865650653839) | > loss_disc_real_2: 0.3058529794216156 (0.2756498654683431) | > loss_disc_real_3: 0.3110055923461914 (0.3251039783159892) | > loss_disc_real_4: 0.4348205327987671 (0.3026408404111862) | > loss_disc_real_5: 0.28846731781959534 (0.2647351970275243) | > loss_0: 3.1067042350769043 (2.7101962566375732) | > loss_gen: 2.0779848098754883 (2.4072099526723227) | > loss_kl: 2.238133192062378 (3.5905733903249106) | > loss_feat: 3.160738229751587 (4.0603453318278) | > loss_mel: 23.674707412719727 (25.22351582845052) | > loss_duration: 2.713782548904419 (2.7835503419240317) | > loss_1: 33.8653450012207 (38.06519444783529) --> EVAL PERFORMANCE | > avg_loader_time: 0.006846904754638672 (-0.0034665266672770177) | > avg_loss_disc: 2.7101962566375732 (+0.14747675259908055) | > avg_loss_disc_real_0: 0.1527935191988945 (+0.04731646676858266) | > avg_loss_disc_real_1: 0.4087865650653839 (+0.08398137986660004) | > avg_loss_disc_real_2: 0.2756498654683431 (+0.019755976895491245) | > avg_loss_disc_real_3: 0.3251039783159892 (+0.05189082274834317) | > avg_loss_disc_real_4: 0.3026408404111862 (+0.05149288723866147) | > avg_loss_disc_real_5: 0.2647351970275243 (+0.11077527453502017) | > avg_loss_0: 2.7101962566375732 (+0.14747675259908055) | > avg_loss_gen: 2.4072099526723227 (+0.28618494669596384) | > avg_loss_kl: 3.5905733903249106 (+0.12678281466166208) | > avg_loss_feat: 4.0603453318278 (-1.365731080373128) | > avg_loss_mel: 25.22351582845052 (+0.618370691935219) | > avg_loss_duration: 2.7835503419240317 (-0.016383806864420425) | > avg_loss_1: 38.06519444783529 (-0.35077667236328125)  > EPOCH: 508/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:15:20)   --> TIME: 2023-10-20 05:15:34 -- STEP: 19/50 -- GLOBAL_STEP: 78420 | > loss_disc: 2.6155121326446533 (2.2699670132837797) | > loss_disc_real_0: 0.08456679433584213 (0.13407362291687414) | > loss_disc_real_1: 0.2257062941789627 (0.232459801396257) | > loss_disc_real_2: 0.3270525336265564 (0.2098678060268101) | > loss_disc_real_3: 0.23299925029277802 (0.28247490329177755) | > loss_disc_real_4: 0.23808333277702332 (0.22161733770841047) | > loss_disc_real_5: 0.2860453426837921 (0.21206591925338694) | > loss_0: 2.6155121326446533 (2.2699670132837797) | > grad_norm_0: tensor(870.1499, device='cuda:0') (tensor(659.3265, device='cuda:0')) | > loss_gen: 1.9132583141326904 (2.6347822201879403) | > loss_kl: 0.9357030391693115 (0.8765643207650435) | > loss_feat: 2.4282214641571045 (6.213490517123749) | > loss_mel: 26.675451278686523 (23.034909047578505) | > loss_duration: 1.5707123279571533 (1.531010765778391) | > loss_1: 33.523345947265625 (34.290757154163565) | > grad_norm_1: tensor(5032.7812, device='cuda:0') (tensor(28104.0527, device='cuda:0')) | > current_lr_0: 0.00012033573331378757 | > current_lr_1: 0.00012033573331378757 | > step_time: 0.548 (0.46774378575776754) | > loader_time: 0.025 (0.011867360064857885)  --> TIME: 2023-10-20 05:15:50 -- STEP: 49/50 -- GLOBAL_STEP: 78450 | > loss_disc: 2.362949848175049 (2.397175522483125) | > loss_disc_real_0: 0.14356102049350739 (0.1317658997045792) | > loss_disc_real_1: 0.22614218294620514 (0.2257082648575306) | > loss_disc_real_2: 0.17163018882274628 (0.21391463507803118) | > loss_disc_real_3: 0.15355558693408966 (0.25096317654361533) | > loss_disc_real_4: 0.2197912335395813 (0.2156098976883353) | > loss_disc_real_5: 0.12944380939006805 (0.211171099117824) | > loss_0: 2.362949848175049 (2.397175522483125) | > grad_norm_0: tensor(674.3954, device='cuda:0') (tensor(707.4330, device='cuda:0')) | > loss_gen: 2.276320457458496 (2.3599905894727122) | > loss_kl: 0.8011168837547302 (0.8936865992692052) | > loss_feat: 5.594505310058594 (5.542900091607351) | > loss_mel: 23.84138298034668 (21.93445230016903) | > loss_duration: 1.6916180849075317 (1.4944051674434118) | > loss_1: 34.2049446105957 (32.225435023405126) | > grad_norm_1: tensor(7844.1724, device='cuda:0') (tensor(22124.6211, device='cuda:0')) | > current_lr_0: 0.00012033573331378757 | > current_lr_1: 0.00012033573331378757 | > step_time: 0.5609 (0.49282674400173887) | > loader_time: 0.4442 (0.023702533877625758)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1902549266815186 (2.1902549266815186) | > loss_disc_real_0: 0.2875947058200836 (0.2875947058200836) | > loss_disc_real_1: 0.353909969329834 (0.353909969329834) | > loss_disc_real_2: 0.14358164370059967 (0.14358164370059967) | > loss_disc_real_3: 0.2976384460926056 (0.2976384460926056) | > loss_disc_real_4: 0.07131991535425186 (0.07131991535425186) | > loss_disc_real_5: 0.10446576029062271 (0.10446576029062271) | > loss_0: 2.1902549266815186 (2.1902549266815186) | > loss_gen: 3.3754289150238037 (3.3754289150238037) | > loss_kl: 3.531301498413086 (3.531301498413086) | > loss_feat: 7.9915900230407715 (7.9915900230407715) | > loss_mel: 22.909088134765625 (22.909088134765625) | > loss_duration: 2.6636855602264404 (2.6636855602264404) | > loss_1: 40.471092224121094 (40.471092224121094)  --> STEP: 1 | > loss_disc: 2.093508005142212 (2.093508005142212) | > loss_disc_real_0: 0.24559970200061798 (0.24559970200061798) | > loss_disc_real_1: 0.21090444922447205 (0.21090444922447205) | > loss_disc_real_2: 0.18174852430820465 (0.18174852430820465) | > loss_disc_real_3: 0.25152653455734253 (0.25152653455734253) | > loss_disc_real_4: 0.15239043533802032 (0.15239043533802032) | > loss_disc_real_5: 0.15847530961036682 (0.15847530961036682) | > loss_0: 2.093508005142212 (2.093508005142212) | > loss_gen: 2.7597789764404297 (2.7597789764404297) | > loss_kl: 4.454079627990723 (4.454079627990723) | > loss_feat: 6.318141937255859 (6.318141937255859) | > loss_mel: 25.400177001953125 (25.400177001953125) | > loss_duration: 3.0599255561828613 (3.0599255561828613) | > loss_1: 41.99209976196289 (41.99209976196289)  --> STEP: 2 | > loss_disc: 2.8901007175445557 (2.491804361343384) | > loss_disc_real_0: 0.31876957416534424 (0.2821846380829811) | > loss_disc_real_1: 0.3095676004886627 (0.2602360248565674) | > loss_disc_real_2: 0.30100592970848083 (0.24137722700834274) | > loss_disc_real_3: 0.2840757966041565 (0.2678011655807495) | > loss_disc_real_4: 0.2540333867073059 (0.20321191102266312) | > loss_disc_real_5: 0.2427973449230194 (0.20063632726669312) | > loss_0: 2.8901007175445557 (2.491804361343384) | > loss_gen: 1.9213805198669434 (2.3405797481536865) | > loss_kl: 4.3283257484436035 (4.391202688217163) | > loss_feat: 0.5045533180236816 (3.4113476276397705) | > loss_mel: 11.298927307128906 (18.349552154541016) | > loss_duration: 2.9106907844543457 (2.9853081703186035) | > loss_1: 20.963876724243164 (31.477988243103027)  --> STEP: 3 | > loss_disc: 2.780385971069336 (2.5879982312520347) | > loss_disc_real_0: 0.3345775604248047 (0.2996489455302556) | > loss_disc_real_1: 0.39195138216018677 (0.30414114395777386) | > loss_disc_real_2: 0.38034358620643616 (0.28769934674104053) | > loss_disc_real_3: 0.28820234537124634 (0.2746015588442485) | > loss_disc_real_4: 0.33928975462913513 (0.24857119222482046) | > loss_disc_real_5: 0.2670353055000305 (0.22276932001113892) | > loss_0: 2.780385971069336 (2.5879982312520347) | > loss_gen: 2.8805227279663086 (2.5205607414245605) | > loss_kl: 1.863563895225525 (3.548656423886617) | > loss_feat: 5.196602821350098 (4.00643269220988) | > loss_mel: 25.548059463500977 (20.749054590861004) | > loss_duration: 2.7150983810424805 (2.895238240559896) | > loss_1: 38.20384979248047 (33.71994209289551) --> EVAL PERFORMANCE | > avg_loader_time: 0.008482853571573893 (+0.0016359488169352208) | > avg_loss_disc: 2.5879982312520347 (-0.12219802538553859) | > avg_loss_disc_real_0: 0.2996489455302556 (+0.14685542633136112) | > avg_loss_disc_real_1: 0.30414114395777386 (-0.10464542110761005) | > avg_loss_disc_real_2: 0.28769934674104053 (+0.012049481272697449) | > avg_loss_disc_real_3: 0.2746015588442485 (-0.05050241947174072) | > avg_loss_disc_real_4: 0.24857119222482046 (-0.054069648186365754) | > avg_loss_disc_real_5: 0.22276932001113892 (-0.04196587701638538) | > avg_loss_0: 2.5879982312520347 (-0.12219802538553859) | > avg_loss_gen: 2.5205607414245605 (+0.11335078875223781) | > avg_loss_kl: 3.548656423886617 (-0.04191696643829346) | > avg_loss_feat: 4.00643269220988 (-0.05391263961791992) | > avg_loss_mel: 20.749054590861004 (-4.474461237589516) | > avg_loss_duration: 2.895238240559896 (+0.11168789863586426) | > avg_loss_1: 33.71994209289551 (-4.345252354939781)  > EPOCH: 509/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:16:01)   --> TIME: 2023-10-20 05:16:18 -- STEP: 29/50 -- GLOBAL_STEP: 78480 | > loss_disc: 2.950091600418091 (2.4183012288192223) | > loss_disc_real_0: 0.19870254397392273 (0.16045544521305072) | > loss_disc_real_1: 0.26540350914001465 (0.2271316675790425) | > loss_disc_real_2: 0.26836317777633667 (0.2221103118539884) | > loss_disc_real_3: 0.2495877742767334 (0.22130093299623194) | > loss_disc_real_4: 0.2510122060775757 (0.2347733667441483) | > loss_disc_real_5: 0.2544158399105072 (0.24250092139017995) | > loss_0: 2.950091600418091 (2.4183012288192223) | > grad_norm_0: tensor(769.6263, device='cuda:0') (tensor(796.0776, device='cuda:0')) | > loss_gen: 1.5785648822784424 (2.423280284322541) | > loss_kl: 0.9525482058525085 (0.924616604015745) | > loss_feat: 0.30823051929473877 (5.240215653489375) | > loss_mel: 15.021506309509277 (19.141524902705488) | > loss_duration: 1.5137708187103271 (1.5262037803386819) | > loss_1: 19.374622344970703 (29.255841370286614) | > grad_norm_1: tensor(13286.8984, device='cuda:0') (tensor(26319.2031, device='cuda:0')) | > current_lr_0: 0.00012021545021419741 | > current_lr_1: 0.00012021545021419741 | > step_time: 0.3202 (0.42305342082319586) | > loader_time: 0.0024 (0.009569373624078156)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.555111885070801 (3.555111885070801) | > loss_disc_real_0: 0.17288032174110413 (0.17288032174110413) | > loss_disc_real_1: 0.21495011448860168 (0.21495011448860168) | > loss_disc_real_2: 0.42579615116119385 (0.42579615116119385) | > loss_disc_real_3: 0.23188742995262146 (0.23188742995262146) | > loss_disc_real_4: 0.3805747628211975 (0.3805747628211975) | > loss_disc_real_5: 0.3454780876636505 (0.3454780876636505) | > loss_0: 3.555111885070801 (3.555111885070801) | > loss_gen: 1.406861662864685 (1.406861662864685) | > loss_kl: 3.383058786392212 (3.383058786392212) | > loss_feat: 5.750613212585449 (5.750613212585449) | > loss_mel: 23.74875831604004 (23.74875831604004) | > loss_duration: 2.60797119140625 (2.60797119140625) | > loss_1: 36.89726257324219 (36.89726257324219)  --> STEP: 1 | > loss_disc: 2.509873390197754 (2.509873390197754) | > loss_disc_real_0: 0.2219993770122528 (0.2219993770122528) | > loss_disc_real_1: 0.3345874845981598 (0.3345874845981598) | > loss_disc_real_2: 0.23549091815948486 (0.23549091815948486) | > loss_disc_real_3: 0.29014652967453003 (0.29014652967453003) | > loss_disc_real_4: 0.2512758672237396 (0.2512758672237396) | > loss_disc_real_5: 0.14595329761505127 (0.14595329761505127) | > loss_0: 2.509873390197754 (2.509873390197754) | > loss_gen: 2.3611299991607666 (2.3611299991607666) | > loss_kl: 4.59843635559082 (4.59843635559082) | > loss_feat: 6.493772506713867 (6.493772506713867) | > loss_mel: 23.34040641784668 (23.34040641784668) | > loss_duration: 2.9037322998046875 (2.9037322998046875) | > loss_1: 39.697479248046875 (39.697479248046875)  --> STEP: 2 | > loss_disc: 2.3449413776397705 (2.427407383918762) | > loss_disc_real_0: 0.20131272077560425 (0.21165604889392853) | > loss_disc_real_1: 0.34884384274482727 (0.34171566367149353) | > loss_disc_real_2: 0.10167264938354492 (0.1685817837715149) | > loss_disc_real_3: 0.21020646393299103 (0.25017649680376053) | > loss_disc_real_4: 0.5645723342895508 (0.4079241007566452) | > loss_disc_real_5: 0.27161914110183716 (0.2087862193584442) | > loss_0: 2.3449413776397705 (2.427407383918762) | > loss_gen: 3.6566882133483887 (3.0089091062545776) | > loss_kl: 4.077493667602539 (4.33796501159668) | > loss_feat: 7.6936354637146 (7.093703985214233) | > loss_mel: 27.6685791015625 (25.50449275970459) | > loss_duration: 2.683887243270874 (2.7938097715377808) | > loss_1: 45.7802848815918 (42.738882064819336)  --> STEP: 3 | > loss_disc: 3.187088966369629 (2.6806345780690513) | > loss_disc_real_0: 0.4327230453491211 (0.28534504771232605) | > loss_disc_real_1: 0.45108893513679504 (0.37817342082659405) | > loss_disc_real_2: 0.4074106514453888 (0.24819140632947287) | > loss_disc_real_3: 0.31534188985824585 (0.271898294488589) | > loss_disc_real_4: 0.5401884913444519 (0.45201223095258075) | > loss_disc_real_5: 0.37257519364356995 (0.2633825441201528) | > loss_0: 3.187088966369629 (2.6806345780690513) | > loss_gen: 3.15588641166687 (3.0579015413920083) | > loss_kl: 2.0648062229156494 (3.5802454153696694) | > loss_feat: 2.915215492248535 (5.700874487559001) | > loss_mel: 22.23318099975586 (24.414055506388348) | > loss_duration: 2.7359981536865234 (2.7745392322540283) | > loss_1: 33.10508728027344 (39.52761713663737) --> EVAL PERFORMANCE | > avg_loader_time: 0.006638685862223308 (-0.001844167709350585) | > avg_loss_disc: 2.6806345780690513 (+0.0926363468170166) | > avg_loss_disc_real_0: 0.28534504771232605 (-0.014303897817929567) | > avg_loss_disc_real_1: 0.37817342082659405 (+0.07403227686882019) | > avg_loss_disc_real_2: 0.24819140632947287 (-0.03950794041156766) | > avg_loss_disc_real_3: 0.271898294488589 (-0.002703264355659485) | > avg_loss_disc_real_4: 0.45201223095258075 (+0.2034410387277603) | > avg_loss_disc_real_5: 0.2633825441201528 (+0.04061322410901386) | > avg_loss_0: 2.6806345780690513 (+0.0926363468170166) | > avg_loss_gen: 3.0579015413920083 (+0.5373407999674478) | > avg_loss_kl: 3.5802454153696694 (+0.031588991483052276) | > avg_loss_feat: 5.700874487559001 (+1.694441795349121) | > avg_loss_mel: 24.414055506388348 (+3.6650009155273438) | > avg_loss_duration: 2.7745392322540283 (-0.12069900830586766) | > avg_loss_1: 39.52761713663737 (+5.80767504374186)  > EPOCH: 510/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:16:38)   --> TIME: 2023-10-20 05:16:48 -- STEP: 9/50 -- GLOBAL_STEP: 78510 | > loss_disc: 3.0710530281066895 (2.836297220653958) | > loss_disc_real_0: 0.30123811960220337 (0.20707417362266117) | > loss_disc_real_1: 0.3167511522769928 (0.27337271720170975) | > loss_disc_real_2: 0.25018441677093506 (0.27462684031989837) | > loss_disc_real_3: 0.4315805435180664 (0.24141805784569847) | > loss_disc_real_4: 0.4192471206188202 (0.32648367144995266) | > loss_disc_real_5: 0.42709288001060486 (0.238007796721326) | > loss_0: 3.0710530281066895 (2.836297220653958) | > grad_norm_0: tensor(318.8161, device='cuda:0') (tensor(458.1020, device='cuda:0')) | > loss_gen: 2.2909505367279053 (2.3716606431537204) | > loss_kl: 0.7844719886779785 (0.6330594354205661) | > loss_feat: 2.085801124572754 (6.197029961480035) | > loss_mel: 22.856889724731445 (23.908661524454754) | > loss_duration: 1.4275803565979004 (1.4816351996527777) | > loss_1: 29.445693969726562 (34.59204716152615) | > grad_norm_1: tensor(5250.8774, device='cuda:0') (tensor(8826.8125, device='cuda:0')) | > current_lr_0: 0.00012009528734509614 | > current_lr_1: 0.00012009528734509614 | > step_time: 0.6375 (0.49624331792195636) | > loader_time: 0.0227 (0.021158907148573134)  --> TIME: 2023-10-20 05:17:03 -- STEP: 39/50 -- GLOBAL_STEP: 78540 | > loss_disc: 2.538487434387207 (2.713223111935151) | > loss_disc_real_0: 0.15074673295021057 (0.17666075335672268) | > loss_disc_real_1: 0.31243082880973816 (0.2470425512546148) | > loss_disc_real_2: 0.22986307740211487 (0.26138636699089646) | > loss_disc_real_3: 0.1940259486436844 (0.25930074678781706) | > loss_disc_real_4: 0.30607765913009644 (0.27690242765805667) | > loss_disc_real_5: 0.30638784170150757 (0.2596595956920049) | > loss_0: 2.538487434387207 (2.713223111935151) | > grad_norm_0: tensor(977.4745, device='cuda:0') (tensor(695.6400, device='cuda:0')) | > loss_gen: 2.417354106903076 (2.186749519445957) | > loss_kl: 0.58599853515625 (0.8565549544799023) | > loss_feat: 3.6250598430633545 (4.2608602426182) | > loss_mel: 22.967975616455078 (21.35653340510833) | > loss_duration: 1.5401254892349243 (1.4849953681994708) | > loss_1: 31.13651466369629 (30.145693375514103) | > grad_norm_1: tensor(20927.6914, device='cuda:0') (tensor(17550.7090, device='cuda:0')) | > current_lr_0: 0.00012009528734509614 | > current_lr_1: 0.00012009528734509614 | > step_time: 0.6095 (0.49309122256743604) | > loader_time: 0.025 (0.020000561689719174)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.687525749206543 (2.687525749206543) | > loss_disc_real_0: 0.2241591066122055 (0.2241591066122055) | > loss_disc_real_1: 0.2598411738872528 (0.2598411738872528) | > loss_disc_real_2: 0.22487300634384155 (0.22487300634384155) | > loss_disc_real_3: 0.25070449709892273 (0.25070449709892273) | > loss_disc_real_4: 0.27337074279785156 (0.27337074279785156) | > loss_disc_real_5: 0.25819090008735657 (0.25819090008735657) | > loss_0: 2.687525749206543 (2.687525749206543) | > loss_gen: 1.9379591941833496 (1.9379591941833496) | > loss_kl: 4.001298427581787 (4.001298427581787) | > loss_feat: 1.2419670820236206 (1.2419670820236206) | > loss_mel: 16.602664947509766 (16.602664947509766) | > loss_duration: 2.616684675216675 (2.616684675216675) | > loss_1: 26.40057373046875 (26.40057373046875)  --> STEP: 1 | > loss_disc: 3.1669769287109375 (3.1669769287109375) | > loss_disc_real_0: 0.24168671667575836 (0.24168671667575836) | > loss_disc_real_1: 0.25897642970085144 (0.25897642970085144) | > loss_disc_real_2: 0.26231077313423157 (0.26231077313423157) | > loss_disc_real_3: 0.2436169683933258 (0.2436169683933258) | > loss_disc_real_4: 0.3120577931404114 (0.3120577931404114) | > loss_disc_real_5: 0.27995237708091736 (0.27995237708091736) | > loss_0: 3.1669769287109375 (3.1669769287109375) | > loss_gen: 1.5877925157546997 (1.5877925157546997) | > loss_kl: 4.025987148284912 (4.025987148284912) | > loss_feat: 2.0927531719207764 (2.0927531719207764) | > loss_mel: 19.147003173828125 (19.147003173828125) | > loss_duration: 2.939460277557373 (2.939460277557373) | > loss_1: 29.792997360229492 (29.792997360229492)  --> STEP: 2 | > loss_disc: 2.2316935062408447 (2.699335217475891) | > loss_disc_real_0: 0.1362162083387375 (0.18895146250724792) | > loss_disc_real_1: 0.12036989629268646 (0.18967316299676895) | > loss_disc_real_2: 0.14074259996414185 (0.2015266865491867) | > loss_disc_real_3: 0.17337466776371002 (0.2084958180785179) | > loss_disc_real_4: 0.154738187789917 (0.23339799046516418) | > loss_disc_real_5: 0.0997583195567131 (0.18985534831881523) | > loss_0: 2.2316935062408447 (2.699335217475891) | > loss_gen: 1.8215152025222778 (1.7046538591384888) | > loss_kl: 4.167954921722412 (4.096971035003662) | > loss_feat: 9.296377182006836 (5.694565176963806) | > loss_mel: 26.5632381439209 (22.85512065887451) | > loss_duration: 2.8168129920959473 (2.87813663482666) | > loss_1: 44.66590118408203 (37.22944927215576)  --> STEP: 3 | > loss_disc: 1.703357219696045 (2.367342551549276) | > loss_disc_real_0: 0.13418486714363098 (0.1706959307193756) | > loss_disc_real_1: 0.1335177719593048 (0.17095469931761423) | > loss_disc_real_2: 0.12129419296979904 (0.17478252202272415) | > loss_disc_real_3: 0.13499405980110168 (0.18399523198604584) | > loss_disc_real_4: 0.10270167887210846 (0.18983255326747894) | > loss_disc_real_5: 0.11831612884998322 (0.16600894182920456) | > loss_0: 1.703357219696045 (2.367342551549276) | > loss_gen: 2.713806629180908 (2.0410381158192954) | > loss_kl: 2.483424425125122 (3.559122165044149) | > loss_feat: 7.93357515335083 (6.4409018357594805) | > loss_mel: 26.6400089263916 (24.116750081380207) | > loss_duration: 2.716754674911499 (2.824342648188273) | > loss_1: 42.48756790161133 (38.98215548197428) --> EVAL PERFORMANCE | > avg_loader_time: 0.0016598701477050781 (-0.0049788157145182295) | > avg_loss_disc: 2.367342551549276 (-0.3132920265197754) | > avg_loss_disc_real_0: 0.1706959307193756 (-0.11464911699295044) | > avg_loss_disc_real_1: 0.17095469931761423 (-0.20721872150897983) | > avg_loss_disc_real_2: 0.17478252202272415 (-0.07340888430674872) | > avg_loss_disc_real_3: 0.18399523198604584 (-0.08790306250254315) | > avg_loss_disc_real_4: 0.18983255326747894 (-0.2621796776851018) | > avg_loss_disc_real_5: 0.16600894182920456 (-0.09737360229094821) | > avg_loss_0: 2.367342551549276 (-0.3132920265197754) | > avg_loss_gen: 2.0410381158192954 (-1.016863425572713) | > avg_loss_kl: 3.559122165044149 (-0.021123250325520537) | > avg_loss_feat: 6.4409018357594805 (+0.7400273482004796) | > avg_loss_mel: 24.116750081380207 (-0.2973054250081404) | > avg_loss_duration: 2.824342648188273 (+0.049803415934244644) | > avg_loss_1: 38.98215548197428 (-0.5454616546630859)  > EPOCH: 511/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:17:20)   --> TIME: 2023-10-20 05:17:33 -- STEP: 19/50 -- GLOBAL_STEP: 78570 | > loss_disc: 1.598960280418396 (2.4712371010529366) | > loss_disc_real_0: 0.08376841247081757 (0.15394096203932636) | > loss_disc_real_1: 0.23249997198581696 (0.257640921559773) | > loss_disc_real_2: 0.1733875274658203 (0.2670422104236327) | > loss_disc_real_3: 0.16628281772136688 (0.22605998912139944) | > loss_disc_real_4: 0.1089867651462555 (0.2351103050536231) | > loss_disc_real_5: 0.13003194332122803 (0.22188466806945048) | > loss_0: 1.598960280418396 (2.4712371010529366) | > grad_norm_0: tensor(499.0426, device='cuda:0') (tensor(830.7287, device='cuda:0')) | > loss_gen: 3.095980644226074 (2.3492858472623324) | > loss_kl: 1.2832247018814087 (0.8615333030098363) | > loss_feat: 8.061062812805176 (5.102271316474989) | > loss_mel: 25.56974220275879 (21.876116777721204) | > loss_duration: 1.6443382501602173 (1.5272291334051835) | > loss_1: 39.65435028076172 (31.716435934367933) | > grad_norm_1: tensor(19408.3496, device='cuda:0') (tensor(12747.6602, device='cuda:0')) | > current_lr_0: 0.00011997524458630586 | > current_lr_1: 0.00011997524458630586 | > step_time: 0.2793 (0.4104657424123664) | > loader_time: 0.0254 (0.008177794908222399)  --> TIME: 2023-10-20 05:17:48 -- STEP: 49/50 -- GLOBAL_STEP: 78600 | > loss_disc: 1.5089229345321655 (2.4579285967106714) | > loss_disc_real_0: 0.09827693551778793 (0.1506733888551137) | > loss_disc_real_1: 0.0490250326693058 (0.22653986954567384) | > loss_disc_real_2: 0.04423978552222252 (0.22363627070979197) | > loss_disc_real_3: 0.20168232917785645 (0.2375281209848365) | > loss_disc_real_4: 0.1417086273431778 (0.2275573829835167) | > loss_disc_real_5: 0.09404825419187546 (0.21250725849246493) | > loss_0: 1.5089229345321655 (2.4579285967106714) | > grad_norm_0: tensor(824.7025, device='cuda:0') (tensor(684.6349, device='cuda:0')) | > loss_gen: 2.8406147956848145 (2.2720867979283237) | > loss_kl: 1.097604513168335 (0.85824923126065) | > loss_feat: 8.853399276733398 (5.084668353504063) | > loss_mel: 24.825904846191406 (21.088935248705805) | > loss_duration: 1.6562341451644897 (1.4949339603891179) | > loss_1: 39.27375793457031 (30.798873765128) | > grad_norm_1: tensor(41198.6172, device='cuda:0') (tensor(17444.6836, device='cuda:0')) | > current_lr_0: 0.00011997524458630586 | > current_lr_1: 0.00011997524458630586 | > step_time: 0.5937 (0.46109404369276397) | > loader_time: 0.4068 (0.022111498579687)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.95835280418396 (2.95835280418396) | > loss_disc_real_0: 0.3199283182621002 (0.3199283182621002) | > loss_disc_real_1: 0.2985083758831024 (0.2985083758831024) | > loss_disc_real_2: 0.28618115186691284 (0.28618115186691284) | > loss_disc_real_3: 0.2669948637485504 (0.2669948637485504) | > loss_disc_real_4: 0.2598145008087158 (0.2598145008087158) | > loss_disc_real_5: 0.2956755757331848 (0.2956755757331848) | > loss_0: 2.95835280418396 (2.95835280418396) | > loss_gen: 1.8174502849578857 (1.8174502849578857) | > loss_kl: 3.4701461791992188 (3.4701461791992188) | > loss_feat: 0.3616374433040619 (0.3616374433040619) | > loss_mel: 14.01465892791748 (14.01465892791748) | > loss_duration: 2.624213695526123 (2.624213695526123) | > loss_1: 22.28810691833496 (22.28810691833496)  --> STEP: 1 | > loss_disc: 2.473958730697632 (2.473958730697632) | > loss_disc_real_0: 0.141973078250885 (0.141973078250885) | > loss_disc_real_1: 0.3384372293949127 (0.3384372293949127) | > loss_disc_real_2: 0.3043438494205475 (0.3043438494205475) | > loss_disc_real_3: 0.2223847210407257 (0.2223847210407257) | > loss_disc_real_4: 0.2587220072746277 (0.2587220072746277) | > loss_disc_real_5: 0.1711576282978058 (0.1711576282978058) | > loss_0: 2.473958730697632 (2.473958730697632) | > loss_gen: 2.451033353805542 (2.451033353805542) | > loss_kl: 3.8557493686676025 (3.8557493686676025) | > loss_feat: 7.813587665557861 (7.813587665557861) | > loss_mel: 25.962614059448242 (25.962614059448242) | > loss_duration: 2.8657751083374023 (2.8657751083374023) | > loss_1: 42.948760986328125 (42.948760986328125)  --> STEP: 2 | > loss_disc: 2.718132972717285 (2.5960458517074585) | > loss_disc_real_0: 0.4689517617225647 (0.30546241998672485) | > loss_disc_real_1: 0.30367136001586914 (0.32105429470539093) | > loss_disc_real_2: 0.33182084560394287 (0.3180823475122452) | > loss_disc_real_3: 0.19953779876232147 (0.2109612599015236) | > loss_disc_real_4: 0.13968335092067719 (0.19920267909765244) | > loss_disc_real_5: 0.18109199404716492 (0.17612481117248535) | > loss_0: 2.718132972717285 (2.5960458517074585) | > loss_gen: 2.577676773071289 (2.5143550634384155) | > loss_kl: 4.088997840881348 (3.972373604774475) | > loss_feat: 7.079170227050781 (7.446378946304321) | > loss_mel: 24.260845184326172 (25.111729621887207) | > loss_duration: 2.931926727294922 (2.898850917816162) | > loss_1: 40.93861770629883 (41.94368934631348)  --> STEP: 3 | > loss_disc: 3.0116195678710938 (2.7345704237620034) | > loss_disc_real_0: 0.31864434480667114 (0.30985639492670697) | > loss_disc_real_1: 0.29818353056907654 (0.3134307066599528) | > loss_disc_real_2: 0.2860448956489563 (0.30740319689114887) | > loss_disc_real_3: 0.2668516933917999 (0.22959140439828238) | > loss_disc_real_4: 0.2596282362937927 (0.21934453149636587) | > loss_disc_real_5: 0.2953014075756073 (0.21585034330685934) | > loss_0: 3.0116195678710938 (2.7345704237620034) | > loss_gen: 1.7405897378921509 (2.256433288256327) | > loss_kl: 1.9924838542938232 (3.312410354614258) | > loss_feat: 0.33964550495147705 (5.0774677991867065) | > loss_mel: 3.1689975261688232 (17.79748558998108) | > loss_duration: 2.666205883026123 (2.821302572886149) | > loss_1: 9.907922744750977 (31.265100479125977) --> EVAL PERFORMANCE | > avg_loader_time: 0.0019545555114746094 (+0.00029468536376953125) | > avg_loss_disc: 2.7345704237620034 (+0.36722787221272757) | > avg_loss_disc_real_0: 0.30985639492670697 (+0.13916046420733136) | > avg_loss_disc_real_1: 0.3134307066599528 (+0.1424760073423386) | > avg_loss_disc_real_2: 0.30740319689114887 (+0.13262067486842471) | > avg_loss_disc_real_3: 0.22959140439828238 (+0.04559617241223654) | > avg_loss_disc_real_4: 0.21934453149636587 (+0.02951197822888693) | > avg_loss_disc_real_5: 0.21585034330685934 (+0.049841401477654784) | > avg_loss_0: 2.7345704237620034 (+0.36722787221272757) | > avg_loss_gen: 2.256433288256327 (+0.21539517243703177) | > avg_loss_kl: 3.312410354614258 (-0.2467118104298911) | > avg_loss_feat: 5.0774677991867065 (-1.363434036572774) | > avg_loss_mel: 17.79748558998108 (-6.319264491399128) | > avg_loss_duration: 2.821302572886149 (-0.0030400753021240234) | > avg_loss_1: 31.265100479125977 (-7.717055002848305)  > EPOCH: 512/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:18:01)   --> TIME: 2023-10-20 05:18:19 -- STEP: 29/50 -- GLOBAL_STEP: 78630 | > loss_disc: 1.3062855005264282 (2.5222704328339676) | > loss_disc_real_0: 0.14434045553207397 (0.18537013399703753) | > loss_disc_real_1: 0.05478593707084656 (0.2126320132921482) | > loss_disc_real_2: 0.051191847771406174 (0.2277578019119542) | > loss_disc_real_3: 0.06268590688705444 (0.24741420708596712) | > loss_disc_real_4: 0.13158157467842102 (0.23574072000538482) | > loss_disc_real_5: 0.16121219098567963 (0.2595128771881091) | > loss_0: 1.3062855005264282 (2.5222704328339676) | > grad_norm_0: tensor(415.4038, device='cuda:0') (tensor(796.9211, device='cuda:0')) | > loss_gen: 2.9911060333251953 (2.2909227774060996) | > loss_kl: 0.4890027344226837 (0.8619965869804909) | > loss_feat: 11.925660133361816 (5.333347671504678) | > loss_mel: 25.64011001586914 (22.166893597306878) | > loss_duration: 1.4560388326644897 (1.5011660764957298) | > loss_1: 42.501914978027344 (32.15432617582124) | > grad_norm_1: tensor(9782.6504, device='cuda:0') (tensor(20746.0977, device='cuda:0')) | > current_lr_0: 0.00011985532181776876 | > current_lr_1: 0.00011985532181776876 | > step_time: 0.2766 (0.4235830882499958) | > loader_time: 0.0025 (0.010489702224731445)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5408804416656494 (2.5408804416656494) | > loss_disc_real_0: 0.12291239947080612 (0.12291239947080612) | > loss_disc_real_1: 0.18811428546905518 (0.18811428546905518) | > loss_disc_real_2: 0.16792255640029907 (0.16792255640029907) | > loss_disc_real_3: 0.3008798658847809 (0.3008798658847809) | > loss_disc_real_4: 0.24338172376155853 (0.24338172376155853) | > loss_disc_real_5: 0.37772929668426514 (0.37772929668426514) | > loss_0: 2.5408804416656494 (2.5408804416656494) | > loss_gen: 2.2094717025756836 (2.2094717025756836) | > loss_kl: 3.361314296722412 (3.361314296722412) | > loss_feat: 5.17901611328125 (5.17901611328125) | > loss_mel: 23.82703399658203 (23.82703399658203) | > loss_duration: 2.5696895122528076 (2.5696895122528076) | > loss_1: 37.14652633666992 (37.14652633666992)  --> STEP: 1 | > loss_disc: 1.858048915863037 (1.858048915863037) | > loss_disc_real_0: 0.15959694981575012 (0.15959694981575012) | > loss_disc_real_1: 0.24295637011528015 (0.24295637011528015) | > loss_disc_real_2: 0.13193853199481964 (0.13193853199481964) | > loss_disc_real_3: 0.12365008890628815 (0.12365008890628815) | > loss_disc_real_4: 0.12688395380973816 (0.12688395380973816) | > loss_disc_real_5: 0.041109561920166016 (0.041109561920166016) | > loss_0: 1.858048915863037 (1.858048915863037) | > loss_gen: 2.9185397624969482 (2.9185397624969482) | > loss_kl: 3.493990421295166 (3.493990421295166) | > loss_feat: 11.068005561828613 (11.068005561828613) | > loss_mel: 25.612049102783203 (25.612049102783203) | > loss_duration: 2.8478550910949707 (2.8478550910949707) | > loss_1: 45.9404411315918 (45.9404411315918)  --> STEP: 2 | > loss_disc: 3.0336151123046875 (2.4458320140838623) | > loss_disc_real_0: 0.3792729079723358 (0.26943492889404297) | > loss_disc_real_1: 0.15636871755123138 (0.19966254383325577) | > loss_disc_real_2: 0.20308299362659454 (0.1675107628107071) | > loss_disc_real_3: 0.18783695995807648 (0.1557435244321823) | > loss_disc_real_4: 0.272031307220459 (0.19945763051509857) | > loss_disc_real_5: 0.39183366298675537 (0.2164716124534607) | > loss_0: 3.0336151123046875 (2.4458320140838623) | > loss_gen: 1.988924503326416 (2.453732132911682) | > loss_kl: 4.494997501373291 (3.9944939613342285) | > loss_feat: 6.3551106452941895 (8.711558103561401) | > loss_mel: 21.370922088623047 (23.491485595703125) | > loss_duration: 2.7738120555877686 (2.8108335733413696) | > loss_1: 36.983768463134766 (41.46210479736328)  --> STEP: 3 | > loss_disc: 2.685756206512451 (2.525806744893392) | > loss_disc_real_0: 0.6522606611251831 (0.39704350630442303) | > loss_disc_real_1: 0.20570068061351776 (0.2016752560933431) | > loss_disc_real_2: 0.172362819314003 (0.16912811497847238) | > loss_disc_real_3: 0.20337815582752228 (0.17162173489729562) | > loss_disc_real_4: 0.2766704559326172 (0.22519523898760477) | > loss_disc_real_5: 0.3718990683555603 (0.2682807644208272) | > loss_0: 2.685756206512451 (2.525806744893392) | > loss_gen: 3.511467456817627 (2.8063105742136636) | > loss_kl: 1.5691007375717163 (3.186029553413391) | > loss_feat: 5.504378795623779 (7.64249833424886) | > loss_mel: 24.964698791503906 (23.98255666097005) | > loss_duration: 2.700751304626465 (2.774139483769735) | > loss_1: 38.250396728515625 (40.39153544108073) --> EVAL PERFORMANCE | > avg_loader_time: 0.00963735580444336 (+0.00768280029296875) | > avg_loss_disc: 2.525806744893392 (-0.20876367886861136) | > avg_loss_disc_real_0: 0.39704350630442303 (+0.08718711137771606) | > avg_loss_disc_real_1: 0.2016752560933431 (-0.11175545056660971) | > avg_loss_disc_real_2: 0.16912811497847238 (-0.13827508191267648) | > avg_loss_disc_real_3: 0.17162173489729562 (-0.057969669500986754) | > avg_loss_disc_real_4: 0.22519523898760477 (+0.0058507074912388934) | > avg_loss_disc_real_5: 0.2682807644208272 (+0.05243042111396787) | > avg_loss_0: 2.525806744893392 (-0.20876367886861136) | > avg_loss_gen: 2.8063105742136636 (+0.5498772859573364) | > avg_loss_kl: 3.186029553413391 (-0.1263808012008667) | > avg_loss_feat: 7.64249833424886 (+2.565030535062154) | > avg_loss_mel: 23.98255666097005 (+6.185071070988972) | > avg_loss_duration: 2.774139483769735 (-0.04716308911641409) | > avg_loss_1: 40.39153544108073 (+9.12643496195475)  > EPOCH: 513/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:18:38)   --> TIME: 2023-10-20 05:18:47 -- STEP: 9/50 -- GLOBAL_STEP: 78660 | > loss_disc: 2.3538544178009033 (2.2041437096065946) | > loss_disc_real_0: 0.12840363383293152 (0.1840607196920448) | > loss_disc_real_1: 0.3342599868774414 (0.22168170164028803) | > loss_disc_real_2: 0.3128417134284973 (0.21467185765504837) | > loss_disc_real_3: 0.33424386382102966 (0.19455183918277422) | > loss_disc_real_4: 0.323661744594574 (0.20391245827906662) | > loss_disc_real_5: 0.291256308555603 (0.22101367554730839) | > loss_0: 2.3538544178009033 (2.2041437096065946) | > grad_norm_0: tensor(435.4250, device='cuda:0') (tensor(518.9965, device='cuda:0')) | > loss_gen: 3.163031578063965 (2.6279655827416315) | > loss_kl: 0.4640783667564392 (0.6809573786126243) | > loss_feat: 4.237093448638916 (6.996850967407227) | > loss_mel: 25.514413833618164 (23.874472935994465) | > loss_duration: 1.446631908416748 (1.494225753678216) | > loss_1: 34.82524871826172 (35.674473444620766) | > grad_norm_1: tensor(7126.0801, device='cuda:0') (tensor(25919.4883, device='cuda:0')) | > current_lr_0: 0.00011973551891954711 | > current_lr_1: 0.00011973551891954711 | > step_time: 0.5835 (0.4891694916619195) | > loader_time: 0.0178 (0.020686652925279405)  --> TIME: 2023-10-20 05:19:03 -- STEP: 39/50 -- GLOBAL_STEP: 78690 | > loss_disc: 1.8969786167144775 (2.5553237444315196) | > loss_disc_real_0: 0.14115530252456665 (0.19635734277275893) | > loss_disc_real_1: 0.22845208644866943 (0.2352320469724826) | > loss_disc_real_2: 0.22248131036758423 (0.22599940288525366) | > loss_disc_real_3: 0.07418174296617508 (0.22861390092816108) | > loss_disc_real_4: 0.11107707023620605 (0.23564107816379812) | > loss_disc_real_5: 0.14611339569091797 (0.22057235871370023) | > loss_0: 1.8969786167144775 (2.5553237444315196) | > grad_norm_0: tensor(832.0984, device='cuda:0') (tensor(854.2965, device='cuda:0')) | > loss_gen: 2.6948282718658447 (2.244364301363628) | > loss_kl: 0.8374756574630737 (0.8393973383383874) | > loss_feat: 8.915910720825195 (4.790579480333971) | > loss_mel: 26.867019653320312 (20.188622713088993) | > loss_duration: 1.5187556743621826 (1.4802943896024654) | > loss_1: 40.83399200439453 (29.543258275741184) | > grad_norm_1: tensor(64564.7891, device='cuda:0') (tensor(21297.2324, device='cuda:0')) | > current_lr_0: 0.00011973551891954711 | > current_lr_1: 0.00011973551891954711 | > step_time: 0.5656 (0.5049719321422088) | > loader_time: 0.025 (0.019529220385429185)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.950620651245117 (2.950620651245117) | > loss_disc_real_0: 0.35290029644966125 (0.35290029644966125) | > loss_disc_real_1: 0.17634859681129456 (0.17634859681129456) | > loss_disc_real_2: 0.22268365323543549 (0.22268365323543549) | > loss_disc_real_3: 0.3080275058746338 (0.3080275058746338) | > loss_disc_real_4: 0.37722086906433105 (0.37722086906433105) | > loss_disc_real_5: 0.33143433928489685 (0.33143433928489685) | > loss_0: 2.950620651245117 (2.950620651245117) | > loss_gen: 2.2748496532440186 (2.2748496532440186) | > loss_kl: 5.194411277770996 (5.194411277770996) | > loss_feat: 4.2549729347229 (4.2549729347229) | > loss_mel: 24.72469711303711 (24.72469711303711) | > loss_duration: 2.7782082557678223 (2.7782082557678223) | > loss_1: 39.22713851928711 (39.22713851928711)  --> STEP: 1 | > loss_disc: 2.8686959743499756 (2.8686959743499756) | > loss_disc_real_0: 0.5733298063278198 (0.5733298063278198) | > loss_disc_real_1: 0.3415457010269165 (0.3415457010269165) | > loss_disc_real_2: 0.22522702813148499 (0.22522702813148499) | > loss_disc_real_3: 0.3013041317462921 (0.3013041317462921) | > loss_disc_real_4: 0.2818349003791809 (0.2818349003791809) | > loss_disc_real_5: 0.3157046437263489 (0.3157046437263489) | > loss_0: 2.8686959743499756 (2.8686959743499756) | > loss_gen: 2.9540388584136963 (2.9540388584136963) | > loss_kl: 4.015338897705078 (4.015338897705078) | > loss_feat: 6.134812355041504 (6.134812355041504) | > loss_mel: 23.97943115234375 (23.97943115234375) | > loss_duration: 2.8916513919830322 (2.8916513919830322) | > loss_1: 39.97527313232422 (39.97527313232422)  --> STEP: 2 | > loss_disc: 2.724043607711792 (2.796369791030884) | > loss_disc_real_0: 0.3616156578063965 (0.46747273206710815) | > loss_disc_real_1: 0.24222606420516968 (0.2918858826160431) | > loss_disc_real_2: 0.17636407911777496 (0.20079555362462997) | > loss_disc_real_3: 0.33872100710868835 (0.32001256942749023) | > loss_disc_real_4: 0.36030179262161255 (0.32106834650039673) | > loss_disc_real_5: 0.2592583894729614 (0.28748151659965515) | > loss_0: 2.724043607711792 (2.796369791030884) | > loss_gen: 3.1861379146575928 (3.0700883865356445) | > loss_kl: 4.07778787612915 (4.046563386917114) | > loss_feat: 8.691191673278809 (7.413002014160156) | > loss_mel: 25.102001190185547 (24.54071617126465) | > loss_duration: 2.9273838996887207 (2.9095176458358765) | > loss_1: 43.984500885009766 (41.97988700866699)  --> STEP: 3 | > loss_disc: 4.669822692871094 (3.420854091644287) | > loss_disc_real_0: 1.434666395187378 (0.7898706197738647) | > loss_disc_real_1: 0.43337491154670715 (0.3390488922595978) | > loss_disc_real_2: 0.561834454536438 (0.321141853928566) | > loss_disc_real_3: 0.4236595332622528 (0.3545615573724111) | > loss_disc_real_4: 0.6650451421737671 (0.4357272783915202) | > loss_disc_real_5: 0.41941818594932556 (0.3314604063828786) | > loss_0: 4.669822692871094 (3.420854091644287) | > loss_gen: 3.7101776599884033 (3.283451477686564) | > loss_kl: 2.026115655899048 (3.3730808099110923) | > loss_feat: 3.3222413063049316 (6.049415111541748) | > loss_mel: 22.765336990356445 (23.948923110961914) | > loss_duration: 2.6619210243225098 (2.8269854386647544) | > loss_1: 34.48579406738281 (39.48185602823893) --> EVAL PERFORMANCE | > avg_loader_time: 0.002805789311726888 (-0.006831566492716471) | > avg_loss_disc: 3.420854091644287 (+0.895047346750895) | > avg_loss_disc_real_0: 0.7898706197738647 (+0.3928271134694417) | > avg_loss_disc_real_1: 0.3390488922595978 (+0.13737363616625467) | > avg_loss_disc_real_2: 0.321141853928566 (+0.1520137389500936) | > avg_loss_disc_real_3: 0.3545615573724111 (+0.18293982247511545) | > avg_loss_disc_real_4: 0.4357272783915202 (+0.21053203940391543) | > avg_loss_disc_real_5: 0.3314604063828786 (+0.06317964196205139) | > avg_loss_0: 3.420854091644287 (+0.895047346750895) | > avg_loss_gen: 3.283451477686564 (+0.4771409034729004) | > avg_loss_kl: 3.3730808099110923 (+0.18705125649770116) | > avg_loss_feat: 6.049415111541748 (-1.5930832227071123) | > avg_loss_mel: 23.948923110961914 (-0.03363355000813684) | > avg_loss_duration: 2.8269854386647544 (+0.05284595489501953) | > avg_loss_1: 39.48185602823893 (-0.9096794128417969)  > EPOCH: 514/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:19:21)   --> TIME: 2023-10-20 05:19:35 -- STEP: 19/50 -- GLOBAL_STEP: 78720 | > loss_disc: 2.771000862121582 (2.7720038514388237) | > loss_disc_real_0: 0.1974080204963684 (0.2000940641584365) | > loss_disc_real_1: 0.3051948845386505 (0.2477662177070191) | > loss_disc_real_2: 0.37212222814559937 (0.2529940287533559) | > loss_disc_real_3: 0.33728235960006714 (0.2533193545317964) | > loss_disc_real_4: 0.32298749685287476 (0.24075085150175982) | > loss_disc_real_5: 0.2958034873008728 (0.18926953357693396) | > loss_0: 2.771000862121582 (2.7720038514388237) | > grad_norm_0: tensor(1019.5129, device='cuda:0') (tensor(757.6774, device='cuda:0')) | > loss_gen: 2.3581254482269287 (2.121876619364086) | > loss_kl: 0.8492725491523743 (0.9728089947449533) | > loss_feat: 2.2603371143341064 (4.439930788388378) | > loss_mel: 22.458633422851562 (20.61367991096095) | > loss_duration: 1.5916857719421387 (1.5139806270599365) | > loss_1: 29.518054962158203 (29.662277522839997) | > grad_norm_1: tensor(8817.8691, device='cuda:0') (tensor(26678.3809, device='cuda:0')) | > current_lr_0: 0.00011961583577182302 | > current_lr_1: 0.00011961583577182302 | > step_time: 0.5907 (0.5012410690909938) | > loader_time: 0.0242 (0.010800160859760485)  --> TIME: 2023-10-20 05:19:51 -- STEP: 49/50 -- GLOBAL_STEP: 78750 | > loss_disc: 2.4205915927886963 (2.596417020778266) | > loss_disc_real_0: 0.13427278399467468 (0.17330951044069864) | > loss_disc_real_1: 0.31636571884155273 (0.22650825285485812) | > loss_disc_real_2: 0.3694482147693634 (0.23092718194333875) | > loss_disc_real_3: 0.28227564692497253 (0.23539432126800633) | > loss_disc_real_4: 0.23354707658290863 (0.23269016276664883) | > loss_disc_real_5: 0.3209095299243927 (0.21756996940441278) | > loss_0: 2.4205915927886963 (2.596417020778266) | > grad_norm_0: tensor(470.8638, device='cuda:0') (tensor(709.0701, device='cuda:0')) | > loss_gen: 3.0196962356567383 (2.1797223346573964) | > loss_kl: 0.4044676423072815 (0.8616847943286506) | > loss_feat: 5.723078727722168 (5.028067283940558) | > loss_mel: 22.74913215637207 (21.565614817093834) | > loss_duration: 1.6368979215621948 (1.4781049416989696) | > loss_1: 33.53327178955078 (31.113194562950913) | > grad_norm_1: tensor(7808.9565, device='cuda:0') (tensor(21806.5859, device='cuda:0')) | > current_lr_0: 0.00011961583577182302 | > current_lr_1: 0.00011961583577182302 | > step_time: 0.6233 (0.5087926290473159) | > loader_time: 0.3699 (0.0219307043114487)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.900510311126709 (2.900510311126709) | > loss_disc_real_0: 0.12893648445606232 (0.12893648445606232) | > loss_disc_real_1: 0.27953264117240906 (0.27953264117240906) | > loss_disc_real_2: 0.37178078293800354 (0.37178078293800354) | > loss_disc_real_3: 0.22854164242744446 (0.22854164242744446) | > loss_disc_real_4: 0.29419368505477905 (0.29419368505477905) | > loss_disc_real_5: 0.1917385458946228 (0.1917385458946228) | > loss_0: 2.900510311126709 (2.900510311126709) | > loss_gen: 1.8889223337173462 (1.8889223337173462) | > loss_kl: 4.857812881469727 (4.857812881469727) | > loss_feat: 6.610724449157715 (6.610724449157715) | > loss_mel: 24.862789154052734 (24.862789154052734) | > loss_duration: 2.666839838027954 (2.666839838027954) | > loss_1: 40.887088775634766 (40.887088775634766)  --> STEP: 1 | > loss_disc: 2.836634874343872 (2.836634874343872) | > loss_disc_real_0: 0.2356821596622467 (0.2356821596622467) | > loss_disc_real_1: 0.30407634377479553 (0.30407634377479553) | > loss_disc_real_2: 0.4032784402370453 (0.4032784402370453) | > loss_disc_real_3: 0.3246271312236786 (0.3246271312236786) | > loss_disc_real_4: 0.2905506193637848 (0.2905506193637848) | > loss_disc_real_5: 0.32252037525177 (0.32252037525177) | > loss_0: 2.836634874343872 (2.836634874343872) | > loss_gen: 2.3209879398345947 (2.3209879398345947) | > loss_kl: 3.4734795093536377 (3.4734795093536377) | > loss_feat: 1.2575608491897583 (1.2575608491897583) | > loss_mel: 19.999258041381836 (19.999258041381836) | > loss_duration: 2.7989859580993652 (2.7989859580993652) | > loss_1: 29.85027313232422 (29.85027313232422)  --> STEP: 2 | > loss_disc: 2.774526596069336 (2.805580735206604) | > loss_disc_real_0: 0.2173272967338562 (0.22650472819805145) | > loss_disc_real_1: 0.34394049644470215 (0.32400842010974884) | > loss_disc_real_2: 0.28620198369026184 (0.34474021196365356) | > loss_disc_real_3: 0.3474198281764984 (0.3360234797000885) | > loss_disc_real_4: 0.298065185546875 (0.2943079024553299) | > loss_disc_real_5: 0.2091703861951828 (0.2658453807234764) | > loss_0: 2.774526596069336 (2.805580735206604) | > loss_gen: 2.648019552230835 (2.484503746032715) | > loss_kl: 4.5547966957092285 (4.014138102531433) | > loss_feat: 5.298401355743408 (3.2779811024665833) | > loss_mel: 24.580429077148438 (22.289843559265137) | > loss_duration: 2.8895013332366943 (2.84424364566803) | > loss_1: 39.97114562988281 (34.910709381103516)  --> STEP: 3 | > loss_disc: 2.8889217376708984 (2.8333610693613687) | > loss_disc_real_0: 0.269880473613739 (0.24096331000328064) | > loss_disc_real_1: 0.3572761118412018 (0.33509765068689984) | > loss_disc_real_2: 0.32114240527153015 (0.3368742763996124) | > loss_disc_real_3: 0.3139570355415344 (0.3286679983139038) | > loss_disc_real_4: 0.325747549533844 (0.3047877848148346) | > loss_disc_real_5: 0.354144424200058 (0.2952783952156703) | > loss_0: 2.8889217376708984 (2.8333610693613687) | > loss_gen: 2.307556390762329 (2.4255212942759194) | > loss_kl: 1.9153176546096802 (3.3145312865575156) | > loss_feat: 1.6877764463424683 (2.747912883758545) | > loss_mel: 20.499156951904297 (21.69294802347819) | > loss_duration: 2.7672064304351807 (2.8185645739237466) | > loss_1: 29.177013397216797 (32.99947738647461) --> EVAL PERFORMANCE | > avg_loader_time: 0.013105551401774088 (+0.0102997620900472) | > avg_loss_disc: 2.8333610693613687 (-0.5874930222829184) | > avg_loss_disc_real_0: 0.24096331000328064 (-0.5489073097705841) | > avg_loss_disc_real_1: 0.33509765068689984 (-0.003951241572697939) | > avg_loss_disc_real_2: 0.3368742763996124 (+0.015732422471046448) | > avg_loss_disc_real_3: 0.3286679983139038 (-0.025893559058507265) | > avg_loss_disc_real_4: 0.3047877848148346 (-0.1309394935766856) | > avg_loss_disc_real_5: 0.2952783952156703 (-0.03618201116720832) | > avg_loss_0: 2.8333610693613687 (-0.5874930222829184) | > avg_loss_gen: 2.4255212942759194 (-0.8579301834106445) | > avg_loss_kl: 3.3145312865575156 (-0.05854952335357666) | > avg_loss_feat: 2.747912883758545 (-3.301502227783203) | > avg_loss_mel: 21.69294802347819 (-2.2559750874837228) | > avg_loss_duration: 2.8185645739237466 (-0.008420864741007783) | > avg_loss_1: 32.99947738647461 (-6.4823786417643205)  > EPOCH: 515/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:20:01)   --> TIME: 2023-10-20 05:20:16 -- STEP: 29/50 -- GLOBAL_STEP: 78780 | > loss_disc: 1.4572148323059082 (2.500863926164035) | > loss_disc_real_0: 0.030842585489153862 (0.16796722847582968) | > loss_disc_real_1: 0.13156065344810486 (0.21762937448661904) | > loss_disc_real_2: 0.18050071597099304 (0.2174473744014214) | > loss_disc_real_3: 0.13533608615398407 (0.23321616964350486) | > loss_disc_real_4: 0.12195652723312378 (0.22332108329082356) | > loss_disc_real_5: 0.04913156479597092 (0.23498102765658807) | > loss_0: 1.4572148323059082 (2.500863926164035) | > grad_norm_0: tensor(505.6586, device='cuda:0') (tensor(762.4190, device='cuda:0')) | > loss_gen: 2.8621878623962402 (2.263436551751761) | > loss_kl: 0.7650773525238037 (0.8705512973768957) | > loss_feat: 9.174570083618164 (5.4788166075816465) | > loss_mel: 24.410926818847656 (21.574530058893664) | > loss_duration: 1.4609302282333374 (1.5086915575224777) | > loss_1: 38.67369079589844 (31.696026012815278) | > grad_norm_1: tensor(5338.2510, device='cuda:0') (tensor(28999.1914, device='cuda:0')) | > current_lr_0: 0.00011949627225489838 | > current_lr_1: 0.00011949627225489838 | > step_time: 0.2709 (0.37194963981365337) | > loader_time: 0.0021 (0.0063042147406216316)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4815802574157715 (2.4815802574157715) | > loss_disc_real_0: 0.20387671887874603 (0.20387671887874603) | > loss_disc_real_1: 0.3441116511821747 (0.3441116511821747) | > loss_disc_real_2: 0.22699058055877686 (0.22699058055877686) | > loss_disc_real_3: 0.29941117763519287 (0.29941117763519287) | > loss_disc_real_4: 0.11657524853944778 (0.11657524853944778) | > loss_disc_real_5: 0.1610044240951538 (0.1610044240951538) | > loss_0: 2.4815802574157715 (2.4815802574157715) | > loss_gen: 2.115522861480713 (2.115522861480713) | > loss_kl: 4.219070911407471 (4.219070911407471) | > loss_feat: 3.605769157409668 (3.605769157409668) | > loss_mel: 20.024169921875 (20.024169921875) | > loss_duration: 2.6882362365722656 (2.6882362365722656) | > loss_1: 32.65277099609375 (32.65277099609375)  --> STEP: 1 | > loss_disc: 2.829936981201172 (2.829936981201172) | > loss_disc_real_0: 0.34988516569137573 (0.34988516569137573) | > loss_disc_real_1: 0.2993108332157135 (0.2993108332157135) | > loss_disc_real_2: 0.284404456615448 (0.284404456615448) | > loss_disc_real_3: 0.3853195309638977 (0.3853195309638977) | > loss_disc_real_4: 0.3171381652355194 (0.3171381652355194) | > loss_disc_real_5: 0.422035813331604 (0.422035813331604) | > loss_0: 2.829936981201172 (2.829936981201172) | > loss_gen: 3.225982666015625 (3.225982666015625) | > loss_kl: 3.949089765548706 (3.949089765548706) | > loss_feat: 4.235294818878174 (4.235294818878174) | > loss_mel: 22.874422073364258 (22.874422073364258) | > loss_duration: 2.8655238151550293 (2.8655238151550293) | > loss_1: 37.15031433105469 (37.15031433105469)  --> STEP: 2 | > loss_disc: 2.8594372272491455 (2.8446871042251587) | > loss_disc_real_0: 0.44151487946510315 (0.39570002257823944) | > loss_disc_real_1: 0.36082378029823303 (0.33006730675697327) | > loss_disc_real_2: 0.35397860407829285 (0.3191915303468704) | > loss_disc_real_3: 0.4169878363609314 (0.40115368366241455) | > loss_disc_real_4: 0.2451995462179184 (0.2811688557267189) | > loss_disc_real_5: 0.24583622813224792 (0.33393602073192596) | > loss_0: 2.8594372272491455 (2.8446871042251587) | > loss_gen: 2.792018413543701 (3.009000539779663) | > loss_kl: 4.323759078979492 (4.136424422264099) | > loss_feat: 3.333589553833008 (3.784442186355591) | > loss_mel: 27.948822021484375 (25.411622047424316) | > loss_duration: 2.789651393890381 (2.827587604522705) | > loss_1: 41.18783950805664 (39.169076919555664)  --> STEP: 3 | > loss_disc: 3.009328842163086 (2.8995676835378013) | > loss_disc_real_0: 0.3633207082748413 (0.38490691781044006) | > loss_disc_real_1: 0.38773542642593384 (0.34929001331329346) | > loss_disc_real_2: 0.2631598114967346 (0.3005142907301585) | > loss_disc_real_3: 0.28259363770484924 (0.36163366834322613) | > loss_disc_real_4: 0.2818496525287628 (0.2813957879940669) | > loss_disc_real_5: 0.2217930108308792 (0.29655501743157703) | > loss_0: 3.009328842163086 (2.8995676835378013) | > loss_gen: 1.912104845046997 (2.643368641535441) | > loss_kl: 2.1635851860046387 (3.478811343510946) | > loss_feat: 0.47506585717201233 (2.681316743294398) | > loss_mel: 13.648895263671875 (21.490713119506836) | > loss_duration: 2.7256672382354736 (2.793614149093628) | > loss_1: 20.92531967163086 (33.08782450358073) --> EVAL PERFORMANCE | > avg_loader_time: 0.006632884343465169 (-0.006472667058308919) | > avg_loss_disc: 2.8995676835378013 (+0.06620661417643259) | > avg_loss_disc_real_0: 0.38490691781044006 (+0.14394360780715942) | > avg_loss_disc_real_1: 0.34929001331329346 (+0.014192362626393618) | > avg_loss_disc_real_2: 0.3005142907301585 (-0.03635998566945392) | > avg_loss_disc_real_3: 0.36163366834322613 (+0.032965670029322325) | > avg_loss_disc_real_4: 0.2813957879940669 (-0.023391996820767702) | > avg_loss_disc_real_5: 0.29655501743157703 (+0.001276622215906742) | > avg_loss_0: 2.8995676835378013 (+0.06620661417643259) | > avg_loss_gen: 2.643368641535441 (+0.21784734725952148) | > avg_loss_kl: 3.478811343510946 (+0.16428005695343018) | > avg_loss_feat: 2.681316743294398 (-0.06659614046414708) | > avg_loss_mel: 21.490713119506836 (-0.20223490397135535) | > avg_loss_duration: 2.793614149093628 (-0.024950424830118667) | > avg_loss_1: 33.08782450358073 (+0.08834711710611742)  > EPOCH: 516/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:20:39)   --> TIME: 2023-10-20 05:20:48 -- STEP: 9/50 -- GLOBAL_STEP: 78810 | > loss_disc: 2.364032506942749 (2.4264049132665) | > loss_disc_real_0: 0.2078738808631897 (0.13401524753620228) | > loss_disc_real_1: 0.20402401685714722 (0.2578124391535918) | > loss_disc_real_2: 0.24663300812244415 (0.2611488745444351) | > loss_disc_real_3: 0.23476926982402802 (0.2742069127659003) | > loss_disc_real_4: 0.18501220643520355 (0.23336690126193893) | > loss_disc_real_5: 0.31002262234687805 (0.2775044323255618) | > loss_0: 2.364032506942749 (2.4264049132665) | > grad_norm_0: tensor(318.2977, device='cuda:0') (tensor(536.4982, device='cuda:0')) | > loss_gen: 2.458688497543335 (2.5447340276506214) | > loss_kl: 0.7513116598129272 (0.7905690338876512) | > loss_feat: 5.6312432289123535 (5.862289985020955) | > loss_mel: 23.22441864013672 (22.452726046244305) | > loss_duration: 1.5061755180358887 (1.5241722928153143) | > loss_1: 33.57183837890625 (33.17449188232422) | > grad_norm_1: tensor(16990.6133, device='cuda:0') (tensor(18256.5000, device='cuda:0')) | > current_lr_0: 0.00011937682824919468 | > current_lr_1: 0.00011937682824919468 | > step_time: 0.2798 (0.5167400572035048) | > loader_time: 0.0144 (0.015390290154351128)  --> TIME: 2023-10-20 05:21:03 -- STEP: 39/50 -- GLOBAL_STEP: 78840 | > loss_disc: 2.6389570236206055 (2.428906339865464) | > loss_disc_real_0: 0.07227927446365356 (0.15377688233573467) | > loss_disc_real_1: 0.41936740279197693 (0.23726432445721748) | > loss_disc_real_2: 0.36332011222839355 (0.23476724880628097) | > loss_disc_real_3: 0.31279900670051575 (0.23144346714401856) | > loss_disc_real_4: 0.3081696331501007 (0.23850445272639775) | > loss_disc_real_5: 0.26835012435913086 (0.2405324367663035) | > loss_0: 2.6389570236206055 (2.428906339865464) | > grad_norm_0: tensor(522.9095, device='cuda:0') (tensor(489.1259, device='cuda:0')) | > loss_gen: 2.4347219467163086 (2.4103687451435962) | > loss_kl: 0.6123891472816467 (0.8312762975692751) | > loss_feat: 3.0001227855682373 (5.691241210708634) | > loss_mel: 24.472753524780273 (21.734669825969597) | > loss_duration: 1.518478512763977 (1.4964212668247712) | > loss_1: 32.03846740722656 (32.16397763521243) | > grad_norm_1: tensor(6920.9883, device='cuda:0') (tensor(21172.1797, device='cuda:0')) | > current_lr_0: 0.00011937682824919468 | > current_lr_1: 0.00011937682824919468 | > step_time: 0.3349 (0.49613326635116184) | > loader_time: 0.0247 (0.019664348700107675)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.937122106552124 (2.937122106552124) | > loss_disc_real_0: 0.3929370045661926 (0.3929370045661926) | > loss_disc_real_1: 0.30545493960380554 (0.30545493960380554) | > loss_disc_real_2: 0.4039815366268158 (0.4039815366268158) | > loss_disc_real_3: 0.32019346952438354 (0.32019346952438354) | > loss_disc_real_4: 0.28103649616241455 (0.28103649616241455) | > loss_disc_real_5: 0.2959343492984772 (0.2959343492984772) | > loss_0: 2.937122106552124 (2.937122106552124) | > loss_gen: 2.354358673095703 (2.354358673095703) | > loss_kl: 3.825502395629883 (3.825502395629883) | > loss_feat: 1.664049744606018 (1.664049744606018) | > loss_mel: 20.91864776611328 (20.91864776611328) | > loss_duration: 2.6209375858306885 (2.6209375858306885) | > loss_1: 31.383495330810547 (31.383495330810547)  --> STEP: 1 | > loss_disc: 2.704803943634033 (2.704803943634033) | > loss_disc_real_0: 0.4778680205345154 (0.4778680205345154) | > loss_disc_real_1: 0.2401510775089264 (0.2401510775089264) | > loss_disc_real_2: 0.19960305094718933 (0.19960305094718933) | > loss_disc_real_3: 0.3175066411495209 (0.3175066411495209) | > loss_disc_real_4: 0.2695438265800476 (0.2695438265800476) | > loss_disc_real_5: 0.16174010932445526 (0.16174010932445526) | > loss_0: 2.704803943634033 (2.704803943634033) | > loss_gen: 2.4685325622558594 (2.4685325622558594) | > loss_kl: 4.49286413192749 (4.49286413192749) | > loss_feat: 5.839724063873291 (5.839724063873291) | > loss_mel: 23.72667694091797 (23.72667694091797) | > loss_duration: 2.8364956378936768 (2.8364956378936768) | > loss_1: 39.36429214477539 (39.36429214477539)  --> STEP: 2 | > loss_disc: 2.5741493701934814 (2.6394766569137573) | > loss_disc_real_0: 0.1774469017982483 (0.32765746116638184) | > loss_disc_real_1: 0.12624061107635498 (0.18319584429264069) | > loss_disc_real_2: 0.09535642713308334 (0.14747973904013634) | > loss_disc_real_3: 0.07887168228626251 (0.1981891617178917) | > loss_disc_real_4: 0.056352682411670685 (0.16294825449585915) | > loss_disc_real_5: 0.05870000645518303 (0.11022005788981915) | > loss_0: 2.5741493701934814 (2.6394766569137573) | > loss_gen: 1.7000916004180908 (2.084312081336975) | > loss_kl: 4.558212757110596 (4.525538444519043) | > loss_feat: 12.136180877685547 (8.987952470779419) | > loss_mel: 24.904802322387695 (24.315739631652832) | > loss_duration: 2.837204694747925 (2.836850166320801) | > loss_1: 46.13649368286133 (42.75039291381836)  --> STEP: 3 | > loss_disc: 2.54770565032959 (2.6088863213857016) | > loss_disc_real_0: 0.16357514262199402 (0.27296335498491925) | > loss_disc_real_1: 0.31409597396850586 (0.22682922085126242) | > loss_disc_real_2: 0.281243234872818 (0.19206757098436356) | > loss_disc_real_3: 0.2304145246744156 (0.20893094937006632) | > loss_disc_real_4: 0.288587749004364 (0.2048280859986941) | > loss_disc_real_5: 0.23617739975452423 (0.1522058385113875) | > loss_0: 2.54770565032959 (2.6088863213857016) | > loss_gen: 2.320847511291504 (2.1631572246551514) | > loss_kl: 1.9660547971725464 (3.6723772287368774) | > loss_feat: 4.898104667663574 (7.624669869740804) | > loss_mel: 27.591596603393555 (25.407691955566406) | > loss_duration: 2.71820330619812 (2.7973012129465737) | > loss_1: 39.494808197021484 (41.6651980082194) --> EVAL PERFORMANCE | > avg_loader_time: 0.001912832260131836 (-0.004720052083333333) | > avg_loss_disc: 2.6088863213857016 (-0.2906813621520996) | > avg_loss_disc_real_0: 0.27296335498491925 (-0.11194356282552081) | > avg_loss_disc_real_1: 0.22682922085126242 (-0.12246079246203104) | > avg_loss_disc_real_2: 0.19206757098436356 (-0.10844671974579495) | > avg_loss_disc_real_3: 0.20893094937006632 (-0.15270271897315982) | > avg_loss_disc_real_4: 0.2048280859986941 (-0.0765677019953728) | > avg_loss_disc_real_5: 0.1522058385113875 (-0.14434917892018953) | > avg_loss_0: 2.6088863213857016 (-0.2906813621520996) | > avg_loss_gen: 2.1631572246551514 (-0.48021141688028957) | > avg_loss_kl: 3.6723772287368774 (+0.19356588522593166) | > avg_loss_feat: 7.624669869740804 (+4.9433531264464055) | > avg_loss_mel: 25.407691955566406 (+3.9169788360595703) | > avg_loss_duration: 2.7973012129465737 (+0.0036870638529458155) | > avg_loss_1: 41.6651980082194 (+8.577373504638672)  > EPOCH: 517/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:21:21)   --> TIME: 2023-10-20 05:21:33 -- STEP: 19/50 -- GLOBAL_STEP: 78870 | > loss_disc: 3.1053519248962402 (2.4273314601496647) | > loss_disc_real_0: 0.36173564195632935 (0.1689626316686994) | > loss_disc_real_1: 0.24824221432209015 (0.239424270038542) | > loss_disc_real_2: 0.34213003516197205 (0.22371677446522212) | > loss_disc_real_3: 0.26623350381851196 (0.2506378419501217) | > loss_disc_real_4: 0.4017847776412964 (0.22336631905483573) | > loss_disc_real_5: 0.366103857755661 (0.2182201939193826) | > loss_0: 3.1053519248962402 (2.4273314601496647) | > grad_norm_0: tensor(782.0474, device='cuda:0') (tensor(557.9282, device='cuda:0')) | > loss_gen: 2.4389286041259766 (2.440656310633609) | > loss_kl: 1.2276325225830078 (0.9690278172492981) | > loss_feat: 4.300811767578125 (6.118244092715414) | > loss_mel: 26.395841598510742 (24.457237494619267) | > loss_duration: 1.6122384071350098 (1.52197822144157) | > loss_1: 35.9754524230957 (35.50714372333727) | > grad_norm_1: tensor(27973.4688, device='cuda:0') (tensor(17043.4551, device='cuda:0')) | > current_lr_0: 0.00011925750363525301 | > current_lr_1: 0.00011925750363525301 | > step_time: 0.57 (0.45143619336579976) | > loader_time: 0.0233 (0.008478591316624692)  --> TIME: 2023-10-20 05:21:50 -- STEP: 49/50 -- GLOBAL_STEP: 78900 | > loss_disc: 3.02634334564209 (2.4659452049099664) | > loss_disc_real_0: 0.208384707570076 (0.16053147549379845) | > loss_disc_real_1: 0.22893868386745453 (0.23359280269669028) | > loss_disc_real_2: 0.23249997198581696 (0.2305288142239561) | > loss_disc_real_3: 0.20117181539535522 (0.23107307362465226) | > loss_disc_real_4: 0.2964414060115814 (0.2258937844284335) | > loss_disc_real_5: 0.2914111614227295 (0.20908683793125105) | > loss_0: 3.02634334564209 (2.4659452049099664) | > grad_norm_0: tensor(845.2545, device='cuda:0') (tensor(520.3430, device='cuda:0')) | > loss_gen: 1.5423390865325928 (2.2835685185023724) | > loss_kl: 0.8476108312606812 (0.9087329424765646) | > loss_feat: 0.08366475254297256 (5.217880283843499) | > loss_mel: 2.040147542953491 (21.237307738284674) | > loss_duration: 1.5927294492721558 (1.481575116819265) | > loss_1: 6.106492042541504 (31.129064793489416) | > grad_norm_1: tensor(21424.8711, device='cuda:0') (tensor(16896.2441, device='cuda:0')) | > current_lr_0: 0.00011925750363525301 | > current_lr_1: 0.00011925750363525301 | > step_time: 0.6158 (0.487008878162929) | > loader_time: 0.4576 (0.023098478511888152)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0462427139282227 (3.0462427139282227) | > loss_disc_real_0: 0.5929179191589355 (0.5929179191589355) | > loss_disc_real_1: 0.30062785744667053 (0.30062785744667053) | > loss_disc_real_2: 0.44426190853118896 (0.44426190853118896) | > loss_disc_real_3: 0.32779818773269653 (0.32779818773269653) | > loss_disc_real_4: 0.33513134717941284 (0.33513134717941284) | > loss_disc_real_5: 0.32645660638809204 (0.32645660638809204) | > loss_0: 3.0462427139282227 (3.0462427139282227) | > loss_gen: 3.2051753997802734 (3.2051753997802734) | > loss_kl: 4.287285327911377 (4.287285327911377) | > loss_feat: 5.990918159484863 (5.990918159484863) | > loss_mel: 24.64035415649414 (24.64035415649414) | > loss_duration: 2.6315388679504395 (2.6315388679504395) | > loss_1: 40.755271911621094 (40.755271911621094)  --> STEP: 1 | > loss_disc: 2.837500810623169 (2.837500810623169) | > loss_disc_real_0: 0.23679420351982117 (0.23679420351982117) | > loss_disc_real_1: 0.23503734171390533 (0.23503734171390533) | > loss_disc_real_2: 0.24013642966747284 (0.24013642966747284) | > loss_disc_real_3: 0.27572330832481384 (0.27572330832481384) | > loss_disc_real_4: 0.3252352774143219 (0.3252352774143219) | > loss_disc_real_5: 0.3608545958995819 (0.3608545958995819) | > loss_0: 2.837500810623169 (2.837500810623169) | > loss_gen: 2.0755109786987305 (2.0755109786987305) | > loss_kl: 4.6335978507995605 (4.6335978507995605) | > loss_feat: 1.9058232307434082 (1.9058232307434082) | > loss_mel: 20.02942657470703 (20.02942657470703) | > loss_duration: 2.963599681854248 (2.963599681854248) | > loss_1: 31.607959747314453 (31.607959747314453)  --> STEP: 2 | > loss_disc: 2.9273712635040283 (2.8824360370635986) | > loss_disc_real_0: 0.4701280891895294 (0.3534611463546753) | > loss_disc_real_1: 0.2641075551509857 (0.24957244843244553) | > loss_disc_real_2: 0.23310621082782745 (0.23662132024765015) | > loss_disc_real_3: 0.2518700063228607 (0.2637966573238373) | > loss_disc_real_4: 0.2833767533302307 (0.3043060153722763) | > loss_disc_real_5: 0.32010844349861145 (0.3404815196990967) | > loss_0: 2.9273712635040283 (2.8824360370635986) | > loss_gen: 2.1449835300445557 (2.110247254371643) | > loss_kl: 4.427480697631836 (4.530539274215698) | > loss_feat: 5.666707515716553 (3.7862653732299805) | > loss_mel: 24.136756896972656 (22.083091735839844) | > loss_duration: 2.8057265281677246 (2.8846631050109863) | > loss_1: 39.18165588378906 (35.39480781555176)  --> STEP: 3 | > loss_disc: 2.889817714691162 (2.8848965962727866) | > loss_disc_real_0: 0.20646929740905762 (0.30446386337280273) | > loss_disc_real_1: 0.2367236614227295 (0.24528951942920685) | > loss_disc_real_2: 0.26064276695251465 (0.24462846914927164) | > loss_disc_real_3: 0.22948101162910461 (0.2523581087589264) | > loss_disc_real_4: 0.31033214926719666 (0.30631472667058307) | > loss_disc_real_5: 0.2952217757701874 (0.32539493838946026) | > loss_0: 2.889817714691162 (2.8848965962727866) | > loss_gen: 1.7187285423278809 (1.9797410170237224) | > loss_kl: 1.934823751449585 (3.6653007666269937) | > loss_feat: 0.7847113609313965 (2.7857473691304526) | > loss_mel: 17.93640899658203 (20.70086415608724) | > loss_duration: 2.686234951019287 (2.8185203870137534) | > loss_1: 25.060909271240234 (31.950174967447918) --> EVAL PERFORMANCE | > avg_loader_time: 0.002999385197957357 (+0.001086552937825521) | > avg_loss_disc: 2.8848965962727866 (+0.27601027488708496) | > avg_loss_disc_real_0: 0.30446386337280273 (+0.031500508387883486) | > avg_loss_disc_real_1: 0.24528951942920685 (+0.01846029857794443) | > avg_loss_disc_real_2: 0.24462846914927164 (+0.05256089816490808) | > avg_loss_disc_real_3: 0.2523581087589264 (+0.043427159388860076) | > avg_loss_disc_real_4: 0.30631472667058307 (+0.10148664067188898) | > avg_loss_disc_real_5: 0.32539493838946026 (+0.17318909987807277) | > avg_loss_0: 2.8848965962727866 (+0.27601027488708496) | > avg_loss_gen: 1.9797410170237224 (-0.18341620763142896) | > avg_loss_kl: 3.6653007666269937 (-0.007076462109883774) | > avg_loss_feat: 2.7857473691304526 (-4.838922500610352) | > avg_loss_mel: 20.70086415608724 (-4.706827799479168) | > avg_loss_duration: 2.8185203870137534 (+0.021219174067179658) | > avg_loss_1: 31.950174967447918 (-9.71502304077148)  > EPOCH: 518/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:22:00)   --> TIME: 2023-10-20 05:22:16 -- STEP: 29/50 -- GLOBAL_STEP: 78930 | > loss_disc: 2.4766201972961426 (2.5754241450079562) | > loss_disc_real_0: 0.08528353273868561 (0.17077338965288524) | > loss_disc_real_1: 0.21658426523208618 (0.22759876785607175) | > loss_disc_real_2: 0.19857485592365265 (0.24998735463054017) | > loss_disc_real_3: 0.1904209703207016 (0.2533828495391484) | > loss_disc_real_4: 0.17136621475219727 (0.23174743559853783) | > loss_disc_real_5: 0.25490108132362366 (0.2518024281438055) | > loss_0: 2.4766201972961426 (2.5754241450079562) | > grad_norm_0: tensor(231.9550, device='cuda:0') (tensor(454.0290, device='cuda:0')) | > loss_gen: 2.187864303588867 (2.2038728450906686) | > loss_kl: 0.8549452424049377 (0.9565476425762834) | > loss_feat: 6.442636966705322 (5.137455786417784) | > loss_mel: 23.54841423034668 (19.677434752727375) | > loss_duration: 1.4615843296051025 (1.490974418048201) | > loss_1: 34.495445251464844 (29.466285360270533) | > grad_norm_1: tensor(3428.6572, device='cuda:0') (tensor(17963.3496, device='cuda:0')) | > current_lr_0: 0.0001191382982937338 | > current_lr_1: 0.0001191382982937338 | > step_time: 0.2463 (0.41188550817555397) | > loader_time: 0.0018 (0.011649370193481445)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8874616622924805 (2.8874616622924805) | > loss_disc_real_0: 0.24822239577770233 (0.24822239577770233) | > loss_disc_real_1: 0.30739110708236694 (0.30739110708236694) | > loss_disc_real_2: 0.2805539667606354 (0.2805539667606354) | > loss_disc_real_3: 0.46621352434158325 (0.46621352434158325) | > loss_disc_real_4: 0.3213634788990021 (0.3213634788990021) | > loss_disc_real_5: 0.33995404839515686 (0.33995404839515686) | > loss_0: 2.8874616622924805 (2.8874616622924805) | > loss_gen: 2.871938705444336 (2.871938705444336) | > loss_kl: 3.857839345932007 (3.857839345932007) | > loss_feat: 6.533140659332275 (6.533140659332275) | > loss_mel: 25.129377365112305 (25.129377365112305) | > loss_duration: 2.68908429145813 (2.68908429145813) | > loss_1: 41.08137893676758 (41.08137893676758)  --> STEP: 1 | > loss_disc: 2.8628432750701904 (2.8628432750701904) | > loss_disc_real_0: 0.22093477845191956 (0.22093477845191956) | > loss_disc_real_1: 0.23598940670490265 (0.23598940670490265) | > loss_disc_real_2: 0.2694670557975769 (0.2694670557975769) | > loss_disc_real_3: 0.2667810022830963 (0.2667810022830963) | > loss_disc_real_4: 0.26809465885162354 (0.26809465885162354) | > loss_disc_real_5: 0.2938007712364197 (0.2938007712364197) | > loss_0: 2.8628432750701904 (2.8628432750701904) | > loss_gen: 1.737125277519226 (1.737125277519226) | > loss_kl: 3.664815664291382 (3.664815664291382) | > loss_feat: 0.59968101978302 (0.59968101978302) | > loss_mel: 17.572126388549805 (17.572126388549805) | > loss_duration: 2.9321396350860596 (2.9321396350860596) | > loss_1: 26.505889892578125 (26.505889892578125)  --> STEP: 2 | > loss_disc: 2.9517898559570312 (2.907316565513611) | > loss_disc_real_0: 0.24128907918930054 (0.23111192882061005) | > loss_disc_real_1: 0.373654842376709 (0.3048221245408058) | > loss_disc_real_2: 0.36348336935043335 (0.3164752125740051) | > loss_disc_real_3: 0.3111637532711029 (0.2889723777770996) | > loss_disc_real_4: 0.23704646527767181 (0.2525705620646477) | > loss_disc_real_5: 0.32504042983055115 (0.3094206005334854) | > loss_0: 2.9517898559570312 (2.907316565513611) | > loss_gen: 2.2026615142822266 (1.9698933959007263) | > loss_kl: 4.421133041381836 (4.042974352836609) | > loss_feat: 3.455272674560547 (2.0274768471717834) | > loss_mel: 26.806533813476562 (22.189330101013184) | > loss_duration: 2.8478150367736816 (2.8899773359298706) | > loss_1: 39.73341369628906 (33.119651794433594)  --> STEP: 3 | > loss_disc: 2.5014941692352295 (2.772042433420817) | > loss_disc_real_0: 0.25992655754089355 (0.24071680506070456) | > loss_disc_real_1: 0.34253448247909546 (0.3173929105202357) | > loss_disc_real_2: 0.32397064566612244 (0.31897369027137756) | > loss_disc_real_3: 0.27477696537971497 (0.28424057364463806) | > loss_disc_real_4: 0.17277993261814117 (0.22597368558247885) | > loss_disc_real_5: 0.3259921669960022 (0.314944456020991) | > loss_0: 2.5014941692352295 (2.772042433420817) | > loss_gen: 2.8962230682373047 (2.2786699533462524) | > loss_kl: 1.7857794761657715 (3.2905760606129966) | > loss_feat: 4.370955944061279 (2.8086365461349487) | > loss_mel: 21.597190856933594 (21.991950352986652) | > loss_duration: 2.71075701713562 (2.8302372296651206) | > loss_1: 33.360904693603516 (33.200069427490234) --> EVAL PERFORMANCE | > avg_loader_time: 0.003688335418701172 (+0.000688950220743815) | > avg_loss_disc: 2.772042433420817 (-0.1128541628519697) | > avg_loss_disc_real_0: 0.24071680506070456 (-0.06374705831209818) | > avg_loss_disc_real_1: 0.3173929105202357 (+0.07210339109102887) | > avg_loss_disc_real_2: 0.31897369027137756 (+0.07434522112210593) | > avg_loss_disc_real_3: 0.28424057364463806 (+0.03188246488571167) | > avg_loss_disc_real_4: 0.22597368558247885 (-0.08034104108810422) | > avg_loss_disc_real_5: 0.314944456020991 (-0.010450482368469238) | > avg_loss_0: 2.772042433420817 (-0.1128541628519697) | > avg_loss_gen: 2.2786699533462524 (+0.29892893632253004) | > avg_loss_kl: 3.2905760606129966 (-0.3747247060139971) | > avg_loss_feat: 2.8086365461349487 (+0.02288917700449611) | > avg_loss_mel: 21.991950352986652 (+1.291086196899414) | > avg_loss_duration: 2.8302372296651206 (+0.011716842651367188) | > avg_loss_1: 33.200069427490234 (+1.2498944600423165)  > EPOCH: 519/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:22:37)   --> TIME: 2023-10-20 05:22:47 -- STEP: 9/50 -- GLOBAL_STEP: 78960 | > loss_disc: 2.231110095977783 (2.302191522386339) | > loss_disc_real_0: 0.20581188797950745 (0.10329303755942318) | > loss_disc_real_1: 0.2145107388496399 (0.22972976085212496) | > loss_disc_real_2: 0.16684097051620483 (0.20998452024327385) | > loss_disc_real_3: 0.2101832628250122 (0.27003323121203315) | > loss_disc_real_4: 0.157328799366951 (0.21803286919991174) | > loss_disc_real_5: 0.09897121787071228 (0.21915700079666245) | > loss_0: 2.231110095977783 (2.302191522386339) | > grad_norm_0: tensor(510.5010, device='cuda:0') (tensor(565.9158, device='cuda:0')) | > loss_gen: 2.0303525924682617 (2.457877662446764) | > loss_kl: 0.7873697876930237 (0.8729864756266276) | > loss_feat: 2.772613286972046 (5.8049500121010675) | > loss_mel: 17.301856994628906 (21.924501948886448) | > loss_duration: 1.396630048751831 (1.5195802185270522) | > loss_1: 24.288822174072266 (32.579895443386505) | > grad_norm_1: tensor(4634.8955, device='cuda:0') (tensor(32726.2500, device='cuda:0')) | > current_lr_0: 0.0001190192121054168 | > current_lr_1: 0.0001190192121054168 | > step_time: 0.5725 (0.52474045753479) | > loader_time: 0.0247 (0.016994025972154405)  --> TIME: 2023-10-20 05:23:02 -- STEP: 39/50 -- GLOBAL_STEP: 78990 | > loss_disc: 1.835302472114563 (2.3230316700079507) | > loss_disc_real_0: 0.09883224964141846 (0.12601838554613864) | > loss_disc_real_1: 0.21690739691257477 (0.21948976155657035) | > loss_disc_real_2: 0.2869303524494171 (0.20477997311032736) | > loss_disc_real_3: 0.178251713514328 (0.25194856801476234) | > loss_disc_real_4: 0.21922960877418518 (0.2166993647145155) | > loss_disc_real_5: 0.1424734741449356 (0.20651732253818175) | > loss_0: 1.835302472114563 (2.3230316700079507) | > grad_norm_0: tensor(337.8811, device='cuda:0') (tensor(615.9492, device='cuda:0')) | > loss_gen: 3.2946009635925293 (2.4551932934002996) | > loss_kl: 0.6081418991088867 (0.8232822380004785) | > loss_feat: 6.651674747467041 (5.75937854183408) | > loss_mel: 23.91332244873047 (21.963103532791138) | > loss_duration: 1.5056679248809814 (1.4776941048793302) | > loss_1: 35.97340774536133 (32.47865114456568) | > grad_norm_1: tensor(18491.1992, device='cuda:0') (tensor(20768.6172, device='cuda:0')) | > current_lr_0: 0.0001190192121054168 | > current_lr_1: 0.0001190192121054168 | > step_time: 0.4626 (0.4913912919851448) | > loader_time: 0.0222 (0.02034279627677722)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8660056591033936 (1.8660056591033936) | > loss_disc_real_0: 0.07000033557415009 (0.07000033557415009) | > loss_disc_real_1: 0.21200858056545258 (0.21200858056545258) | > loss_disc_real_2: 0.1400308907032013 (0.1400308907032013) | > loss_disc_real_3: 0.326011598110199 (0.326011598110199) | > loss_disc_real_4: 0.14010433852672577 (0.14010433852672577) | > loss_disc_real_5: 0.08403018116950989 (0.08403018116950989) | > loss_0: 1.8660056591033936 (1.8660056591033936) | > loss_gen: 2.8340201377868652 (2.8340201377868652) | > loss_kl: 5.9470953941345215 (5.9470953941345215) | > loss_feat: 7.182636260986328 (7.182636260986328) | > loss_mel: 21.214122772216797 (21.214122772216797) | > loss_duration: 2.7508037090301514 (2.7508037090301514) | > loss_1: 39.928680419921875 (39.928680419921875)  --> STEP: 1 | > loss_disc: 1.9281229972839355 (1.9281229972839355) | > loss_disc_real_0: 0.262360155582428 (0.262360155582428) | > loss_disc_real_1: 0.22091592848300934 (0.22091592848300934) | > loss_disc_real_2: 0.22048118710517883 (0.22048118710517883) | > loss_disc_real_3: 0.14949217438697815 (0.14949217438697815) | > loss_disc_real_4: 0.2284717857837677 (0.2284717857837677) | > loss_disc_real_5: 0.18049803376197815 (0.18049803376197815) | > loss_0: 1.9281229972839355 (1.9281229972839355) | > loss_gen: 3.2077949047088623 (3.2077949047088623) | > loss_kl: 4.559267044067383 (4.559267044067383) | > loss_feat: 7.839372634887695 (7.839372634887695) | > loss_mel: 25.32275390625 (25.32275390625) | > loss_duration: 2.9907519817352295 (2.9907519817352295) | > loss_1: 43.91994094848633 (43.91994094848633)  --> STEP: 2 | > loss_disc: 2.781482696533203 (2.3548028469085693) | > loss_disc_real_0: 0.3258320987224579 (0.29409612715244293) | > loss_disc_real_1: 0.2387855350971222 (0.22985073179006577) | > loss_disc_real_2: 0.2502014636993408 (0.23534132540225983) | > loss_disc_real_3: 0.25566837191581726 (0.2025802731513977) | > loss_disc_real_4: 0.3901187777519226 (0.30929528176784515) | > loss_disc_real_5: 0.38503679633140564 (0.2827674150466919) | > loss_0: 2.781482696533203 (2.3548028469085693) | > loss_gen: 2.7912566661834717 (2.999525785446167) | > loss_kl: 4.089460372924805 (4.324363708496094) | > loss_feat: 8.198095321655273 (8.018733978271484) | > loss_mel: 24.80215835571289 (25.062456130981445) | > loss_duration: 2.8857388496398926 (2.938245415687561) | > loss_1: 42.76670837402344 (43.34332466125488)  --> STEP: 3 | > loss_disc: 2.0543954372406006 (2.254667043685913) | > loss_disc_real_0: 0.29995566606521606 (0.296049306790034) | > loss_disc_real_1: 0.21074415743350983 (0.22348187367121378) | > loss_disc_real_2: 0.17164504528045654 (0.2141092320283254) | > loss_disc_real_3: 0.33990538120269775 (0.2483553091684977) | > loss_disc_real_4: 0.06920946389436722 (0.22926667581001917) | > loss_disc_real_5: 0.12087608873844147 (0.22880363961060843) | > loss_0: 2.0543954372406006 (2.254667043685913) | > loss_gen: 2.750535249710083 (2.9165289402008057) | > loss_kl: 1.906772494316101 (3.518499970436096) | > loss_feat: 7.39224910736084 (7.8099056879679365) | > loss_mel: 24.244699478149414 (24.789870580037434) | > loss_duration: 2.89949369430542 (2.925328175226847) | > loss_1: 39.193748474121094 (41.96013259887695) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_79000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1819262504577637 (2.2364818453788757) | > loss_disc_real_0: 0.4073278307914734 (0.32386893779039383) | > loss_disc_real_1: 0.1859852373600006 (0.2141077145934105) | > loss_disc_real_2: 0.09133414179086685 (0.18341545946896076) | > loss_disc_real_3: 0.31887397170066833 (0.2659849748015404) | > loss_disc_real_4: 0.12668898701667786 (0.20362225361168385) | > loss_disc_real_5: 0.2511884272098541 (0.23439983651041985) | > loss_0: 2.1819262504577637 (2.2364818453788757) | > loss_gen: 3.4760236740112305 (3.056402623653412) | > loss_kl: 5.517634868621826 (4.018283694982529) | > loss_feat: 8.753469467163086 (8.045796632766724) | > loss_mel: 26.23129653930664 (25.150227069854736) | > loss_duration: 2.747169256210327 (2.8807884454727173) | > loss_1: 46.7255973815918 (43.151498794555664)  --> STEP: 1 | > loss_disc: 2.399721145629883 (2.2691297054290773) | > loss_disc_real_0: 0.19723044335842133 (0.2985412389039993) | > loss_disc_real_1: 0.23674386739730835 (0.21863494515419007) | > loss_disc_real_2: 0.26400047540664673 (0.19953246265649796) | > loss_disc_real_3: 0.3623959720134735 (0.285267174243927) | > loss_disc_real_4: 0.38973942399024963 (0.240845687687397) | > loss_disc_real_5: 0.3194057047367096 (0.2514010101556778) | > loss_0: 2.399721145629883 (2.2691297054290773) | > loss_gen: 3.79156494140625 (3.2034350872039794) | > loss_kl: 4.589682579040527 (4.132563471794128) | > loss_feat: 7.307883262634277 (7.898213958740234) | > loss_mel: 26.573833465576172 (25.434948348999022) | > loss_duration: 3.046083688735962 (2.913847494125366) | > loss_1: 45.30904769897461 (43.58300857543945)  --> STEP: 2 | > loss_disc: 3.3603622913360596 (2.4510018030802407) | > loss_disc_real_0: 0.2004670798778534 (0.282195545732975) | > loss_disc_real_1: 0.2545149326324463 (0.22461494306723276) | > loss_disc_real_2: 0.32909920811653137 (0.22112692023317018) | > loss_disc_real_3: 0.31853413581848145 (0.2908116678396861) | > loss_disc_real_4: 0.25804927945137024 (0.24371295298139253) | > loss_disc_real_5: 0.3203074336051941 (0.2628854140639305) | > loss_0: 3.3603622913360596 (2.4510018030802407) | > loss_gen: 1.5013436079025269 (2.9197531739870706) | > loss_kl: 4.252732753753662 (4.152591685454051) | > loss_feat: 2.2486562728881836 (6.956621011098226) | > loss_mel: 8.668620109558105 (22.640560309092205) | > loss_duration: 2.9155921936035156 (2.9141382773717246) | > loss_1: 19.586944580078125 (39.58366457621256)  --> STEP: 3 | > loss_disc: 2.9098427295684814 (2.516550506864275) | > loss_disc_real_0: 0.19826054573059082 (0.27020483144692015) | > loss_disc_real_1: 0.33481597900390625 (0.24035794820104325) | > loss_disc_real_2: 0.388104110956192 (0.2449808046221733) | > loss_disc_real_3: 0.34462031722068787 (0.29849861775125774) | > loss_disc_real_4: 0.22625784575939178 (0.24121936623539245) | > loss_disc_real_5: 0.4476040005683899 (0.28927378356456757) | > loss_0: 2.9098427295684814 (2.516550506864275) | > loss_gen: 2.3588080406188965 (2.8396181549344743) | > loss_kl: 2.162658214569092 (3.868315475327628) | > loss_feat: 3.642071485519409 (6.483113936015537) | > loss_mel: 21.930007934570312 (22.53905282701765) | > loss_duration: 2.7601137161254883 (2.8921347686222623) | > loss_1: 32.853660583496094 (38.622235434395925) --> EVAL PERFORMANCE | > avg_loader_time: 0.4220048018864223 (+0.41831646646772114) | > avg_loss_disc: 2.516550506864275 (-0.25549192655654185) | > avg_loss_disc_real_0: 0.27020483144692015 (+0.029488026386215588) | > avg_loss_disc_real_1: 0.24035794820104325 (-0.07703496231919246) | > avg_loss_disc_real_2: 0.2449808046221733 (-0.07399288564920425) | > avg_loss_disc_real_3: 0.29849861775125774 (+0.014258044106619683) | > avg_loss_disc_real_4: 0.24121936623539245 (+0.015245680652913596) | > avg_loss_disc_real_5: 0.28927378356456757 (-0.02567067245642346) | > avg_loss_0: 2.516550506864275 (-0.25549192655654185) | > avg_loss_gen: 2.8396181549344743 (+0.5609482015882219) | > avg_loss_kl: 3.868315475327628 (+0.5777394147146313) | > avg_loss_feat: 6.483113936015537 (+3.6744773898805887) | > avg_loss_mel: 22.53905282701765 (+0.5471024740309964) | > avg_loss_duration: 2.8921347686222623 (+0.06189753895714167) | > avg_loss_1: 38.622235434395925 (+5.422166006905691)  > EPOCH: 520/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:23:26)   --> TIME: 2023-10-20 05:23:42 -- STEP: 19/50 -- GLOBAL_STEP: 79020 | > loss_disc: 2.1960225105285645 (2.4909957961032263) | > loss_disc_real_0: 0.2232290506362915 (0.18529453155535616) | > loss_disc_real_1: 0.1816251128911972 (0.23895854914658948) | > loss_disc_real_2: 0.2661697268486023 (0.24267128639315305) | > loss_disc_real_3: 0.25390154123306274 (0.2361238991449538) | > loss_disc_real_4: 0.17872700095176697 (0.23000049345979565) | > loss_disc_real_5: 0.3345133662223816 (0.2922766685093704) | > loss_0: 2.1960225105285645 (2.4909957961032263) | > grad_norm_0: tensor(628.1089, device='cuda:0') (tensor(544.3324, device='cuda:0')) | > loss_gen: 2.8106777667999268 (2.5053358203486393) | > loss_kl: 1.2126528024673462 (0.9473605438282615) | > loss_feat: 6.615339279174805 (6.281600009600975) | > loss_mel: 26.139047622680664 (22.793346837947244) | > loss_duration: 1.6010539531707764 (1.5164848064121448) | > loss_1: 38.3787727355957 (34.04412821719521) | > grad_norm_1: tensor(8883.5420, device='cuda:0') (tensor(27533.5254, device='cuda:0')) | > current_lr_0: 0.00011890024495120094 | > current_lr_1: 0.00011890024495120094 | > step_time: 0.5614 (0.5165045261383057) | > loader_time: 0.0249 (0.01693324038856908)  --> TIME: 2023-10-20 05:23:58 -- STEP: 49/50 -- GLOBAL_STEP: 79050 | > loss_disc: 2.9515953063964844 (2.4750764053695056) | > loss_disc_real_0: 0.1135692447423935 (0.16736096507698603) | > loss_disc_real_1: 0.25731006264686584 (0.2347882574766266) | > loss_disc_real_2: 0.28028208017349243 (0.23513552922831507) | > loss_disc_real_3: 0.25573885440826416 (0.22955078131766343) | > loss_disc_real_4: 0.2905976176261902 (0.22435400247269746) | > loss_disc_real_5: 0.2786194384098053 (0.2473117449910057) | > loss_0: 2.9515953063964844 (2.4750764053695056) | > grad_norm_0: tensor(454.3524, device='cuda:0') (tensor(502.5988, device='cuda:0')) | > loss_gen: 1.5991076231002808 (2.424816260532457) | > loss_kl: 0.524461030960083 (0.834744145371476) | > loss_feat: 0.4926407039165497 (5.795817479548252) | > loss_mel: 9.442718505859375 (21.11662248689301) | > loss_duration: 1.6215898990631104 (1.474103029893369) | > loss_1: 13.680517196655273 (31.64610344049881) | > grad_norm_1: tensor(8766.0420, device='cuda:0') (tensor(17483.2441, device='cuda:0')) | > current_lr_0: 0.00011890024495120094 | > current_lr_1: 0.00011890024495120094 | > step_time: 0.3999 (0.5023810425583197) | > loader_time: 0.443 (0.025923432136068535)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8838329315185547 (1.8838329315185547) | > loss_disc_real_0: 0.06715820729732513 (0.06715820729732513) | > loss_disc_real_1: 0.3044526278972626 (0.3044526278972626) | > loss_disc_real_2: 0.24060380458831787 (0.24060380458831787) | > loss_disc_real_3: 0.20825167000293732 (0.20825167000293732) | > loss_disc_real_4: 0.13421659171581268 (0.13421659171581268) | > loss_disc_real_5: 0.1570628434419632 (0.1570628434419632) | > loss_0: 1.8838329315185547 (1.8838329315185547) | > loss_gen: 2.9662528038024902 (2.9662528038024902) | > loss_kl: 3.344996929168701 (3.344996929168701) | > loss_feat: 9.272289276123047 (9.272289276123047) | > loss_mel: 24.700481414794922 (24.700481414794922) | > loss_duration: 2.6893110275268555 (2.6893110275268555) | > loss_1: 42.973331451416016 (42.973331451416016)  --> STEP: 1 | > loss_disc: 2.2154412269592285 (2.2154412269592285) | > loss_disc_real_0: 0.25193047523498535 (0.25193047523498535) | > loss_disc_real_1: 0.2652532756328583 (0.2652532756328583) | > loss_disc_real_2: 0.2067316472530365 (0.2067316472530365) | > loss_disc_real_3: 0.1849590539932251 (0.1849590539932251) | > loss_disc_real_4: 0.28104111552238464 (0.28104111552238464) | > loss_disc_real_5: 0.2578728199005127 (0.2578728199005127) | > loss_0: 2.2154412269592285 (2.2154412269592285) | > loss_gen: 2.861009359359741 (2.861009359359741) | > loss_kl: 4.055638790130615 (4.055638790130615) | > loss_feat: 7.293930530548096 (7.293930530548096) | > loss_mel: 22.876480102539062 (22.876480102539062) | > loss_duration: 2.9852070808410645 (2.9852070808410645) | > loss_1: 40.072265625 (40.072265625)  --> STEP: 2 | > loss_disc: 2.3366684913635254 (2.276054859161377) | > loss_disc_real_0: 0.10629204660654068 (0.17911126092076302) | > loss_disc_real_1: 0.3073374629020691 (0.2862953692674637) | > loss_disc_real_2: 0.1921679675579071 (0.1994498074054718) | > loss_disc_real_3: 0.1659245491027832 (0.17544180154800415) | > loss_disc_real_4: 0.21013878285884857 (0.2455899491906166) | > loss_disc_real_5: 0.031180284917354584 (0.14452655240893364) | > loss_0: 2.3366684913635254 (2.276054859161377) | > loss_gen: 2.3094351291656494 (2.5852222442626953) | > loss_kl: 4.382750034332275 (4.219194412231445) | > loss_feat: 7.946102619171143 (7.620016574859619) | > loss_mel: 29.542888641357422 (26.209684371948242) | > loss_duration: 2.870136022567749 (2.9276715517044067) | > loss_1: 47.05131530761719 (43.561790466308594)  --> STEP: 3 | > loss_disc: 2.9615671634674072 (2.5045589605967202) | > loss_disc_real_0: 0.145245760679245 (0.16782276084025702) | > loss_disc_real_1: 0.26059862971305847 (0.2777297894159953) | > loss_disc_real_2: 0.268402099609375 (0.22243390480677286) | > loss_disc_real_3: 0.24193435907363892 (0.19760598738988241) | > loss_disc_real_4: 0.2921607792377472 (0.2611135592063268) | > loss_disc_real_5: 0.2724013030529022 (0.1871514692902565) | > loss_0: 2.9615671634674072 (2.5045589605967202) | > loss_gen: 1.5501065254211426 (2.240183671315511) | > loss_kl: 1.8211482763290405 (3.419845700263977) | > loss_feat: 0.3214796185493469 (5.187170922756195) | > loss_mel: 2.9571478366851807 (18.45883886019389) | > loss_duration: 2.7031712532043457 (2.852838118871053) | > loss_1: 9.35305404663086 (32.158878326416016) --> EVAL PERFORMANCE | > avg_loader_time: 0.01975099245707194 (-0.40225380942935035) | > avg_loss_disc: 2.5045589605967202 (-0.011991546267554831) | > avg_loss_disc_real_0: 0.16782276084025702 (-0.10238207060666313) | > avg_loss_disc_real_1: 0.2777297894159953 (+0.037371841214952045) | > avg_loss_disc_real_2: 0.22243390480677286 (-0.02254689981540045) | > avg_loss_disc_real_3: 0.19760598738988241 (-0.10089263036137533) | > avg_loss_disc_real_4: 0.2611135592063268 (+0.019894192970934338) | > avg_loss_disc_real_5: 0.1871514692902565 (-0.10212231427431107) | > avg_loss_0: 2.5045589605967202 (-0.011991546267554831) | > avg_loss_gen: 2.240183671315511 (-0.5994344836189631) | > avg_loss_kl: 3.419845700263977 (-0.4484697750636508) | > avg_loss_feat: 5.187170922756195 (-1.2959430132593424) | > avg_loss_mel: 18.45883886019389 (-4.080213966823759) | > avg_loss_duration: 2.852838118871053 (-0.039296649751209056) | > avg_loss_1: 32.158878326416016 (-6.46335710797991)  > EPOCH: 521/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:24:09)   --> TIME: 2023-10-20 05:24:26 -- STEP: 29/50 -- GLOBAL_STEP: 79080 | > loss_disc: 2.992340087890625 (2.4215791513179914) | > loss_disc_real_0: 0.05942389369010925 (0.15409315338936344) | > loss_disc_real_1: 0.27518606185913086 (0.21346974893119827) | > loss_disc_real_2: 0.21501792967319489 (0.22626596329541043) | > loss_disc_real_3: 0.205443874001503 (0.22686880724183445) | > loss_disc_real_4: 0.3061509132385254 (0.23827284253362951) | > loss_disc_real_5: 0.27591556310653687 (0.22535130619231997) | > loss_0: 2.992340087890625 (2.4215791513179914) | > grad_norm_0: tensor(1034.5613, device='cuda:0') (tensor(584.8341, device='cuda:0')) | > loss_gen: 1.4845163822174072 (2.3555293247617524) | > loss_kl: 0.8448020815849304 (0.8083434300176029) | > loss_feat: 0.5394195318222046 (5.031639449555298) | > loss_mel: 12.532491683959961 (20.672533413459515) | > loss_duration: 1.4949803352355957 (1.479346226001608) | > loss_1: 16.896209716796875 (30.34739165470518) | > grad_norm_1: tensor(16909.8594, device='cuda:0') (tensor(16944.0664, device='cuda:0')) | > current_lr_0: 0.0001187813967121042 | > current_lr_1: 0.0001187813967121042 | > step_time: 0.3295 (0.4107917095052785) | > loader_time: 0.0022 (0.010200451160299367)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9464306831359863 (2.9464306831359863) | > loss_disc_real_0: 0.3630995750427246 (0.3630995750427246) | > loss_disc_real_1: 0.49362289905548096 (0.49362289905548096) | > loss_disc_real_2: 0.3962309658527374 (0.3962309658527374) | > loss_disc_real_3: 0.2896619141101837 (0.2896619141101837) | > loss_disc_real_4: 0.32626965641975403 (0.32626965641975403) | > loss_disc_real_5: 0.36326250433921814 (0.36326250433921814) | > loss_0: 2.9464306831359863 (2.9464306831359863) | > loss_gen: 3.0582799911499023 (3.0582799911499023) | > loss_kl: 3.5744802951812744 (3.5744802951812744) | > loss_feat: 5.01507043838501 (5.01507043838501) | > loss_mel: 21.849077224731445 (21.849077224731445) | > loss_duration: 2.660395383834839 (2.660395383834839) | > loss_1: 36.15730667114258 (36.15730667114258)  --> STEP: 1 | > loss_disc: 2.8282883167266846 (2.8282883167266846) | > loss_disc_real_0: 0.17072618007659912 (0.17072618007659912) | > loss_disc_real_1: 0.21539995074272156 (0.21539995074272156) | > loss_disc_real_2: 0.3188107907772064 (0.3188107907772064) | > loss_disc_real_3: 0.3859885334968567 (0.3859885334968567) | > loss_disc_real_4: 0.2761118412017822 (0.2761118412017822) | > loss_disc_real_5: 0.2598164677619934 (0.2598164677619934) | > loss_0: 2.8282883167266846 (2.8282883167266846) | > loss_gen: 1.861525058746338 (1.861525058746338) | > loss_kl: 4.031115531921387 (4.031115531921387) | > loss_feat: 0.9124447703361511 (0.9124447703361511) | > loss_mel: 18.9180965423584 (18.9180965423584) | > loss_duration: 2.923668384552002 (2.923668384552002) | > loss_1: 28.646848678588867 (28.646848678588867)  --> STEP: 2 | > loss_disc: 3.0057199001312256 (2.917004108428955) | > loss_disc_real_0: 0.24766820669174194 (0.20919719338417053) | > loss_disc_real_1: 0.2730029225349426 (0.2442014366388321) | > loss_disc_real_2: 0.2738661468029022 (0.2963384687900543) | > loss_disc_real_3: 0.3441753387451172 (0.36508193612098694) | > loss_disc_real_4: 0.2705840468406677 (0.273347944021225) | > loss_disc_real_5: 0.23096127808094025 (0.24538887292146683) | > loss_0: 3.0057199001312256 (2.917004108428955) | > loss_gen: 1.6537253856658936 (1.7576252222061157) | > loss_kl: 4.146935939788818 (4.0890257358551025) | > loss_feat: 0.16035982966423035 (0.5364023000001907) | > loss_mel: 2.1053595542907715 (10.511728048324585) | > loss_duration: 2.821164131164551 (2.8724162578582764) | > loss_1: 10.887544631958008 (19.767196655273438)  --> STEP: 3 | > loss_disc: 2.889146566390991 (2.9077182610829673) | > loss_disc_real_0: 0.23161344230175018 (0.21666927635669708) | > loss_disc_real_1: 0.27759939432144165 (0.25533408919970196) | > loss_disc_real_2: 0.2468375563621521 (0.27983816464742023) | > loss_disc_real_3: 0.3474520146846771 (0.359205295642217) | > loss_disc_real_4: 0.2604842185974121 (0.26906003554662067) | > loss_disc_real_5: 0.2186814844608307 (0.2364864101012548) | > loss_0: 2.889146566390991 (2.9077182610829673) | > loss_gen: 1.7249042987823486 (1.7467182477315266) | > loss_kl: 1.902343988418579 (3.360131820042928) | > loss_feat: 0.5098662376403809 (0.5275569458802541) | > loss_mel: 14.15352725982666 (11.725661118825277) | > loss_duration: 2.7743773460388184 (2.8397366205851235) | > loss_1: 21.065019607543945 (20.199804306030273) --> EVAL PERFORMANCE | > avg_loader_time: 0.009017229080200195 (-0.010733763376871746) | > avg_loss_disc: 2.9077182610829673 (+0.40315930048624704) | > avg_loss_disc_real_0: 0.21666927635669708 (+0.048846515516440064) | > avg_loss_disc_real_1: 0.25533408919970196 (-0.022395700216293335) | > avg_loss_disc_real_2: 0.27983816464742023 (+0.05740425984064737) | > avg_loss_disc_real_3: 0.359205295642217 (+0.16159930825233457) | > avg_loss_disc_real_4: 0.26906003554662067 (+0.007946476340293884) | > avg_loss_disc_real_5: 0.2364864101012548 (+0.04933494081099829) | > avg_loss_0: 2.9077182610829673 (+0.40315930048624704) | > avg_loss_gen: 1.7467182477315266 (-0.4934654235839846) | > avg_loss_kl: 3.360131820042928 (-0.05971388022104884) | > avg_loss_feat: 0.5275569458802541 (-4.659613976875941) | > avg_loss_mel: 11.725661118825277 (-6.733177741368612) | > avg_loss_duration: 2.8397366205851235 (-0.013101498285929658) | > avg_loss_1: 20.199804306030273 (-11.959074020385742)  > EPOCH: 522/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:24:46)   --> TIME: 2023-10-20 05:24:55 -- STEP: 9/50 -- GLOBAL_STEP: 79110 | > loss_disc: 2.542728900909424 (2.5907294750213623) | > loss_disc_real_0: 0.21420994400978088 (0.175103683438566) | > loss_disc_real_1: 0.26135292649269104 (0.2880675370494525) | > loss_disc_real_2: 0.23511935770511627 (0.2418545817749368) | > loss_disc_real_3: 0.2591772973537445 (0.3155563092894024) | > loss_disc_real_4: 0.17900453507900238 (0.25682965935104424) | > loss_disc_real_5: 0.16261233389377594 (0.2728961718579133) | > loss_0: 2.542728900909424 (2.5907294750213623) | > grad_norm_0: tensor(316.0114, device='cuda:0') (tensor(546.7923, device='cuda:0')) | > loss_gen: 2.020111083984375 (2.437335398462084) | > loss_kl: 0.8696600198745728 (0.8165149688720703) | > loss_feat: 3.027480125427246 (4.768070472611321) | > loss_mel: 18.13074493408203 (21.208506690131294) | > loss_duration: 1.3947877883911133 (1.4632817506790161) | > loss_1: 25.44278335571289 (30.693709479437935) | > grad_norm_1: tensor(12161.9482, device='cuda:0') (tensor(15600.6113, device='cuda:0')) | > current_lr_0: 0.00011866266726926343 | > current_lr_1: 0.00011866266726926343 | > step_time: 0.2861 (0.4851340717739529) | > loader_time: 0.0254 (0.021830850177341037)  --> TIME: 2023-10-20 05:25:11 -- STEP: 39/50 -- GLOBAL_STEP: 79140 | > loss_disc: 2.099975347518921 (2.5727984416179166) | > loss_disc_real_0: 0.23157355189323425 (0.1889443253286374) | > loss_disc_real_1: 0.13669905066490173 (0.22939449892594263) | > loss_disc_real_2: 0.28251051902770996 (0.23305130324875697) | > loss_disc_real_3: 0.2655665874481201 (0.26177734862535423) | > loss_disc_real_4: 0.25667595863342285 (0.2540321692537802) | > loss_disc_real_5: 0.086589016020298 (0.24211672397378164) | > loss_0: 2.099975347518921 (2.5727984416179166) | > grad_norm_0: tensor(786.6208, device='cuda:0') (tensor(618.5741, device='cuda:0')) | > loss_gen: 2.857309103012085 (2.293695932779556) | > loss_kl: 0.5772785544395447 (0.8404246133107406) | > loss_feat: 6.021065711975098 (4.620193598314356) | > loss_mel: 24.201976776123047 (20.84620388043232) | > loss_duration: 1.501764178276062 (1.4666231045356164) | > loss_1: 35.159393310546875 (30.067140872661884) | > grad_norm_1: tensor(11509.3496, device='cuda:0') (tensor(19955.3203, device='cuda:0')) | > current_lr_0: 0.00011866266726926343 | > current_lr_1: 0.00011866266726926343 | > step_time: 0.6962 (0.490248991892888) | > loader_time: 0.0226 (0.018999307583539914)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3575353622436523 (2.3575353622436523) | > loss_disc_real_0: 0.10261453688144684 (0.10261453688144684) | > loss_disc_real_1: 0.3870624601840973 (0.3870624601840973) | > loss_disc_real_2: 0.2537452280521393 (0.2537452280521393) | > loss_disc_real_3: 0.3044378459453583 (0.3044378459453583) | > loss_disc_real_4: 0.2933084964752197 (0.2933084964752197) | > loss_disc_real_5: 0.359626829624176 (0.359626829624176) | > loss_0: 2.3575353622436523 (2.3575353622436523) | > loss_gen: 3.0877771377563477 (3.0877771377563477) | > loss_kl: 3.493454694747925 (3.493454694747925) | > loss_feat: 5.509197235107422 (5.509197235107422) | > loss_mel: 20.55400848388672 (20.55400848388672) | > loss_duration: 2.5863449573516846 (2.5863449573516846) | > loss_1: 35.23078155517578 (35.23078155517578)  --> STEP: 1 | > loss_disc: 1.8244550228118896 (1.8244550228118896) | > loss_disc_real_0: 0.0668557807803154 (0.0668557807803154) | > loss_disc_real_1: 0.35769087076187134 (0.35769087076187134) | > loss_disc_real_2: 0.21356689929962158 (0.21356689929962158) | > loss_disc_real_3: 0.2216162234544754 (0.2216162234544754) | > loss_disc_real_4: 0.14451587200164795 (0.14451587200164795) | > loss_disc_real_5: 0.1476602554321289 (0.1476602554321289) | > loss_0: 1.8244550228118896 (1.8244550228118896) | > loss_gen: 3.4087982177734375 (3.4087982177734375) | > loss_kl: 4.328280448913574 (4.328280448913574) | > loss_feat: 8.902068138122559 (8.902068138122559) | > loss_mel: 23.775022506713867 (23.775022506713867) | > loss_duration: 2.9477498531341553 (2.9477498531341553) | > loss_1: 43.36191940307617 (43.36191940307617)  --> STEP: 2 | > loss_disc: 1.8077430725097656 (1.8160990476608276) | > loss_disc_real_0: 0.13164860010147095 (0.09925219044089317) | > loss_disc_real_1: 0.3624436855316162 (0.3600672781467438) | > loss_disc_real_2: 0.28282666206359863 (0.2481967806816101) | > loss_disc_real_3: 0.2627825438976288 (0.2421993836760521) | > loss_disc_real_4: 0.09565512090921402 (0.12008549645543098) | > loss_disc_real_5: 0.10726900398731232 (0.1274646297097206) | > loss_0: 1.8077430725097656 (1.8160990476608276) | > loss_gen: 3.7838120460510254 (3.5963051319122314) | > loss_kl: 4.5387115478515625 (4.433495998382568) | > loss_feat: 12.676823616027832 (10.789445877075195) | > loss_mel: 23.888673782348633 (23.83184814453125) | > loss_duration: 2.8359596729278564 (2.891854763031006) | > loss_1: 47.72398376464844 (45.542951583862305)  --> STEP: 3 | > loss_disc: 2.7748489379882812 (2.1356823444366455) | > loss_disc_real_0: 0.3961469531059265 (0.1982171113292376) | > loss_disc_real_1: 0.5635918378829956 (0.4279087980588277) | > loss_disc_real_2: 0.2656461298465729 (0.25401323040326435) | > loss_disc_real_3: 0.10457024723291397 (0.19632300486167273) | > loss_disc_real_4: 0.20592916011810303 (0.148700051009655) | > loss_disc_real_5: 0.2741701602935791 (0.17636647323767343) | > loss_0: 2.7748489379882812 (2.1356823444366455) | > loss_gen: 2.9781033992767334 (3.390237887700399) | > loss_kl: 1.9080017805099487 (3.5916645924250283) | > loss_feat: 7.294919013977051 (9.624603589375814) | > loss_mel: 24.764232635498047 (24.142642974853516) | > loss_duration: 2.7232725620269775 (2.835660696029663) | > loss_1: 39.66853332519531 (43.58481216430664) --> EVAL PERFORMANCE | > avg_loader_time: 0.002324660619099935 (-0.00669256846110026) | > avg_loss_disc: 2.1356823444366455 (-0.7720359166463218) | > avg_loss_disc_real_0: 0.1982171113292376 (-0.018452165027459472) | > avg_loss_disc_real_1: 0.4279087980588277 (+0.17257470885912574) | > avg_loss_disc_real_2: 0.25401323040326435 (-0.025824934244155884) | > avg_loss_disc_real_3: 0.19632300486167273 (-0.16288229078054425) | > avg_loss_disc_real_4: 0.148700051009655 (-0.12035998453696567) | > avg_loss_disc_real_5: 0.17636647323767343 (-0.06011993686358136) | > avg_loss_0: 2.1356823444366455 (-0.7720359166463218) | > avg_loss_gen: 3.390237887700399 (+1.6435196399688723) | > avg_loss_kl: 3.5916645924250283 (+0.23153277238210013) | > avg_loss_feat: 9.624603589375814 (+9.09704664349556) | > avg_loss_mel: 24.142642974853516 (+12.416981856028238) | > avg_loss_duration: 2.835660696029663 (-0.004075924555460464) | > avg_loss_1: 43.58481216430664 (+23.385007858276367)  > EPOCH: 523/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:25:27)   --> TIME: 2023-10-20 05:25:42 -- STEP: 19/50 -- GLOBAL_STEP: 79170 | > loss_disc: 2.054736375808716 (2.303234489340531) | > loss_disc_real_0: 0.12501725554466248 (0.17652806855346026) | > loss_disc_real_1: 0.172669917345047 (0.24456676978029704) | > loss_disc_real_2: 0.22234466671943665 (0.26009324036146464) | > loss_disc_real_3: 0.3577463924884796 (0.24656045319218384) | > loss_disc_real_4: 0.15174120664596558 (0.19408194661924713) | > loss_disc_real_5: 0.11482086032629013 (0.18117862341827468) | > loss_0: 2.054736375808716 (2.303234489340531) | > grad_norm_0: tensor(393.9372, device='cuda:0') (tensor(582.7958, device='cuda:0')) | > loss_gen: 2.706270933151245 (2.655838941272936) | > loss_kl: 0.9186842441558838 (0.9421094342281944) | > loss_feat: 6.200325965881348 (6.533775292925145) | > loss_mel: 28.79671859741211 (21.528511147750052) | > loss_duration: 1.6007869243621826 (1.5247517447722585) | > loss_1: 40.2227897644043 (33.184986415662266) | > grad_norm_1: tensor(22416.8242, device='cuda:0') (tensor(29435.6777, device='cuda:0')) | > current_lr_0: 0.00011854405650393435 | > current_lr_1: 0.00011854405650393435 | > step_time: 0.6214 (0.530777328892758) | > loader_time: 0.0042 (0.020320340206748562)  --> TIME: 2023-10-20 05:26:00 -- STEP: 49/50 -- GLOBAL_STEP: 79200 | > loss_disc: 2.510241985321045 (2.39395650795528) | > loss_disc_real_0: 0.2592158019542694 (0.1615732240547636) | > loss_disc_real_1: 0.3756082355976105 (0.2370647892583998) | > loss_disc_real_2: 0.39983832836151123 (0.2568197989342165) | > loss_disc_real_3: 0.16318435966968536 (0.24580324509618226) | > loss_disc_real_4: 0.2698460519313812 (0.21142170825326928) | > loss_disc_real_5: 0.32590097188949585 (0.2045124040878549) | > loss_0: 2.510241985321045 (2.39395650795528) | > grad_norm_0: tensor(817.7322, device='cuda:0') (tensor(549.3715, device='cuda:0')) | > loss_gen: 2.8106861114501953 (2.4414073715404583) | > loss_kl: 0.927973747253418 (0.8636700391617357) | > loss_feat: 4.635217189788818 (5.9274485846411205) | > loss_mel: 32.78868103027344 (21.975968068959762) | > loss_duration: 1.6291651725769043 (1.4848074110186833) | > loss_1: 42.791725158691406 (32.69330137603138) | > grad_norm_1: tensor(19411.5000, device='cuda:0') (tensor(25550.9082, device='cuda:0')) | > current_lr_0: 0.00011854405650393435 | > current_lr_1: 0.00011854405650393435 | > step_time: 0.6291 (0.5340347533323326) | > loader_time: 0.4349 (0.026424505272690125)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.836470365524292 (2.836470365524292) | > loss_disc_real_0: 0.2311459481716156 (0.2311459481716156) | > loss_disc_real_1: 0.353921115398407 (0.353921115398407) | > loss_disc_real_2: 0.3684735894203186 (0.3684735894203186) | > loss_disc_real_3: 0.24775667488574982 (0.24775667488574982) | > loss_disc_real_4: 0.3260124623775482 (0.3260124623775482) | > loss_disc_real_5: 0.4237559139728546 (0.4237559139728546) | > loss_0: 2.836470365524292 (2.836470365524292) | > loss_gen: 2.791118621826172 (2.791118621826172) | > loss_kl: 3.711636781692505 (3.711636781692505) | > loss_feat: 3.8279809951782227 (3.8279809951782227) | > loss_mel: 21.796310424804688 (21.796310424804688) | > loss_duration: 2.6160295009613037 (2.6160295009613037) | > loss_1: 34.743072509765625 (34.743072509765625)  --> STEP: 1 | > loss_disc: 2.4920787811279297 (2.4920787811279297) | > loss_disc_real_0: 0.14709734916687012 (0.14709734916687012) | > loss_disc_real_1: 0.21867641806602478 (0.21867641806602478) | > loss_disc_real_2: 0.20996405184268951 (0.20996405184268951) | > loss_disc_real_3: 0.20066888630390167 (0.20066888630390167) | > loss_disc_real_4: 0.19816002249717712 (0.19816002249717712) | > loss_disc_real_5: 0.1876046061515808 (0.1876046061515808) | > loss_0: 2.4920787811279297 (2.4920787811279297) | > loss_gen: 2.0169003009796143 (2.0169003009796143) | > loss_kl: 4.166886806488037 (4.166886806488037) | > loss_feat: 4.091190814971924 (4.091190814971924) | > loss_mel: 21.771408081054688 (21.771408081054688) | > loss_duration: 2.9277141094207764 (2.9277141094207764) | > loss_1: 34.97410202026367 (34.97410202026367)  --> STEP: 2 | > loss_disc: 2.5072693824768066 (2.499674081802368) | > loss_disc_real_0: 0.1448093056678772 (0.14595332741737366) | > loss_disc_real_1: 0.26008060574531555 (0.23937851190567017) | > loss_disc_real_2: 0.22279231250286102 (0.21637818217277527) | > loss_disc_real_3: 0.16686168313026428 (0.18376528471708298) | > loss_disc_real_4: 0.16659927368164062 (0.18237964808940887) | > loss_disc_real_5: 0.14831581711769104 (0.16796021163463593) | > loss_0: 2.5072693824768066 (2.499674081802368) | > loss_gen: 2.0152370929718018 (2.016068696975708) | > loss_kl: 4.239936828613281 (4.203411817550659) | > loss_feat: 3.838787317276001 (3.9649890661239624) | > loss_mel: 13.566471099853516 (17.6689395904541) | > loss_duration: 2.807264566421509 (2.8674893379211426) | > loss_1: 26.467697143554688 (30.72089958190918)  --> STEP: 3 | > loss_disc: 2.918029308319092 (2.6391258239746094) | > loss_disc_real_0: 0.5016051530838013 (0.26450393597284955) | > loss_disc_real_1: 0.2774434983730316 (0.25206684072812396) | > loss_disc_real_2: 0.332880437374115 (0.2552122672398885) | > loss_disc_real_3: 0.2855609953403473 (0.21769718825817108) | > loss_disc_real_4: 0.2596600353717804 (0.20813977718353271) | > loss_disc_real_5: 0.38221657276153564 (0.23937899867693582) | > loss_0: 2.918029308319092 (2.6391258239746094) | > loss_gen: 2.5172715187072754 (2.183136304219564) | > loss_kl: 2.601583957672119 (3.669469197591146) | > loss_feat: 3.5113353729248047 (3.8137711683909097) | > loss_mel: 23.204875946044922 (19.514251708984375) | > loss_duration: 2.727342128753662 (2.8207736015319824) | > loss_1: 34.562408447265625 (32.00140253702799) --> EVAL PERFORMANCE | > avg_loader_time: 0.009021679560343424 (+0.006697018941243488) | > avg_loss_disc: 2.6391258239746094 (+0.5034434795379639) | > avg_loss_disc_real_0: 0.26450393597284955 (+0.06628682464361194) | > avg_loss_disc_real_1: 0.25206684072812396 (-0.17584195733070374) | > avg_loss_disc_real_2: 0.2552122672398885 (+0.0011990368366241455) | > avg_loss_disc_real_3: 0.21769718825817108 (+0.021374183396498353) | > avg_loss_disc_real_4: 0.20813977718353271 (+0.059439726173877716) | > avg_loss_disc_real_5: 0.23937899867693582 (+0.06301252543926239) | > avg_loss_0: 2.6391258239746094 (+0.5034434795379639) | > avg_loss_gen: 2.183136304219564 (-1.207101583480835) | > avg_loss_kl: 3.669469197591146 (+0.07780460516611765) | > avg_loss_feat: 3.8137711683909097 (-5.810832420984905) | > avg_loss_mel: 19.514251708984375 (-4.628391265869141) | > avg_loss_duration: 2.8207736015319824 (-0.014887094497680664) | > avg_loss_1: 32.00140253702799 (-11.583409627278648)  > EPOCH: 524/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:26:09)   --> TIME: 2023-10-20 05:26:24 -- STEP: 29/50 -- GLOBAL_STEP: 79230 | > loss_disc: 2.7838780879974365 (2.5245304354305924) | > loss_disc_real_0: 0.21584981679916382 (0.17199259700960126) | > loss_disc_real_1: 0.5014109015464783 (0.21761298577847152) | > loss_disc_real_2: 0.11761128902435303 (0.21565466579692116) | > loss_disc_real_3: 0.14354608952999115 (0.21448982751061177) | > loss_disc_real_4: 0.47461140155792236 (0.2391729195570123) | > loss_disc_real_5: 0.24845194816589355 (0.2313325690298245) | > loss_0: 2.7838780879974365 (2.5245304354305924) | > grad_norm_0: tensor(504.8110, device='cuda:0') (tensor(749.1493, device='cuda:0')) | > loss_gen: 2.788844108581543 (2.276937221658641) | > loss_kl: 1.0585523843765259 (0.9708466437356226) | > loss_feat: 9.272442817687988 (5.912646363007611) | > loss_mel: 22.64579200744629 (23.380413458265107) | > loss_duration: 1.4765040874481201 (1.477957063707812) | > loss_1: 37.24213790893555 (34.01880071903097) | > grad_norm_1: tensor(3128.6592, device='cuda:0') (tensor(17072.5879, device='cuda:0')) | > current_lr_0: 0.00011842556429749138 | > current_lr_1: 0.00011842556429749138 | > step_time: 0.3552 (0.3849629944768445) | > loader_time: 0.0027 (0.007607131168760103)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.300708055496216 (2.300708055496216) | > loss_disc_real_0: 0.31290966272354126 (0.31290966272354126) | > loss_disc_real_1: 0.2100406438112259 (0.2100406438112259) | > loss_disc_real_2: 0.29504185914993286 (0.29504185914993286) | > loss_disc_real_3: 0.2672375440597534 (0.2672375440597534) | > loss_disc_real_4: 0.2283060997724533 (0.2283060997724533) | > loss_disc_real_5: 0.12286806851625443 (0.12286806851625443) | > loss_0: 2.300708055496216 (2.300708055496216) | > loss_gen: 2.6512060165405273 (2.6512060165405273) | > loss_kl: 3.7245218753814697 (3.7245218753814697) | > loss_feat: 5.528437614440918 (5.528437614440918) | > loss_mel: 23.921520233154297 (23.921520233154297) | > loss_duration: 2.539186716079712 (2.539186716079712) | > loss_1: 38.36487579345703 (38.36487579345703)  --> STEP: 1 | > loss_disc: 2.4413821697235107 (2.4413821697235107) | > loss_disc_real_0: 0.3869573771953583 (0.3869573771953583) | > loss_disc_real_1: 0.16483913362026215 (0.16483913362026215) | > loss_disc_real_2: 0.19855079054832458 (0.19855079054832458) | > loss_disc_real_3: 0.22181256115436554 (0.22181256115436554) | > loss_disc_real_4: 0.2097432017326355 (0.2097432017326355) | > loss_disc_real_5: 0.22160135209560394 (0.22160135209560394) | > loss_0: 2.4413821697235107 (2.4413821697235107) | > loss_gen: 2.330705165863037 (2.330705165863037) | > loss_kl: 4.116361618041992 (4.116361618041992) | > loss_feat: 6.145203113555908 (6.145203113555908) | > loss_mel: 23.551816940307617 (23.551816940307617) | > loss_duration: 3.017733573913574 (3.017733573913574) | > loss_1: 39.16181945800781 (39.16181945800781)  --> STEP: 2 | > loss_disc: 2.9459280967712402 (2.6936551332473755) | > loss_disc_real_0: 0.13771821558475494 (0.2623377963900566) | > loss_disc_real_1: 0.24034979939460754 (0.20259446650743484) | > loss_disc_real_2: 0.5192263722419739 (0.35888858139514923) | > loss_disc_real_3: 0.4450828433036804 (0.333447702229023) | > loss_disc_real_4: 0.444362610578537 (0.32705290615558624) | > loss_disc_real_5: 0.15532779693603516 (0.18846457451581955) | > loss_0: 2.9459280967712402 (2.6936551332473755) | > loss_gen: 2.302739381790161 (2.316722273826599) | > loss_kl: 3.770792007446289 (3.9435768127441406) | > loss_feat: 8.23420524597168 (7.189704179763794) | > loss_mel: 24.858489990234375 (24.205153465270996) | > loss_duration: 2.94404935836792 (2.980891466140747) | > loss_1: 42.11027526855469 (40.63604736328125)  --> STEP: 3 | > loss_disc: 3.1868956089019775 (2.8580686251322427) | > loss_disc_real_0: 0.515261173248291 (0.34664558867613476) | > loss_disc_real_1: 0.2636607885360718 (0.22294990718364716) | > loss_disc_real_2: 0.32472988963127136 (0.34750235080718994) | > loss_disc_real_3: 0.27586615085601807 (0.3142538517713547) | > loss_disc_real_4: 0.4473519027233124 (0.3671525716781616) | > loss_disc_real_5: 0.3409133851528168 (0.23928084472815195) | > loss_0: 3.1868956089019775 (2.8580686251322427) | > loss_gen: 2.195185422897339 (2.276209990183512) | > loss_kl: 1.8814617395401 (3.256205121676127) | > loss_feat: 2.1127803325653076 (5.497396230697632) | > loss_mel: 19.261072158813477 (22.55712636311849) | > loss_duration: 2.769024133682251 (2.910269021987915) | > loss_1: 28.21952247619629 (36.49720573425293) --> EVAL PERFORMANCE | > avg_loader_time: 0.008932908376057943 (-8.877118428548061e-05) | > avg_loss_disc: 2.8580686251322427 (+0.21894280115763332) | > avg_loss_disc_real_0: 0.34664558867613476 (+0.08214165270328522) | > avg_loss_disc_real_1: 0.22294990718364716 (-0.02911693354447681) | > avg_loss_disc_real_2: 0.34750235080718994 (+0.09229008356730145) | > avg_loss_disc_real_3: 0.3142538517713547 (+0.0965566635131836) | > avg_loss_disc_real_4: 0.3671525716781616 (+0.1590127944946289) | > avg_loss_disc_real_5: 0.23928084472815195 (-9.815394878387451e-05) | > avg_loss_0: 2.8580686251322427 (+0.21894280115763332) | > avg_loss_gen: 2.276209990183512 (+0.09307368596394827) | > avg_loss_kl: 3.256205121676127 (-0.413264075915019) | > avg_loss_feat: 5.497396230697632 (+1.6836250623067222) | > avg_loss_mel: 22.55712636311849 (+3.0428746541341134) | > avg_loss_duration: 2.910269021987915 (+0.08949542045593262) | > avg_loss_1: 36.49720573425293 (+4.495803197224937)  > EPOCH: 525/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:26:46)   --> TIME: 2023-10-20 05:26:56 -- STEP: 9/50 -- GLOBAL_STEP: 79260 | > loss_disc: 2.467395782470703 (2.341087924109565) | > loss_disc_real_0: 0.05309421941637993 (0.11613533045682642) | > loss_disc_real_1: 0.2815723121166229 (0.22529959181944528) | > loss_disc_real_2: 0.3016575276851654 (0.23513133720391327) | > loss_disc_real_3: 0.4603903889656067 (0.2221624938150247) | > loss_disc_real_4: 0.2594039738178253 (0.2897542019685109) | > loss_disc_real_5: 0.22933006286621094 (0.27170100311438244) | > loss_0: 2.467395782470703 (2.341087924109565) | > grad_norm_0: tensor(671.0236, device='cuda:0') (tensor(673.9003, device='cuda:0')) | > loss_gen: 2.852163791656494 (2.588839809099833) | > loss_kl: 0.9886888861656189 (0.8478537831041548) | > loss_feat: 5.741986274719238 (7.006924152374268) | > loss_mel: 24.592466354370117 (23.442405276828342) | > loss_duration: 1.4073978662490845 (1.5025469064712524) | > loss_1: 35.58270263671875 (35.3885695139567) | > grad_norm_1: tensor(40161.8242, device='cuda:0') (tensor(27414.4395, device='cuda:0')) | > current_lr_0: 0.00011830719053142743 | > current_lr_1: 0.00011830719053142743 | > step_time: 0.5801 (0.5051891803741455) | > loader_time: 0.0113 (0.02039170265197754)  --> TIME: 2023-10-20 05:27:11 -- STEP: 39/50 -- GLOBAL_STEP: 79290 | > loss_disc: 1.6104704141616821 (2.414778776657887) | > loss_disc_real_0: 0.10217471420764923 (0.1466501674686487) | > loss_disc_real_1: 0.045143380761146545 (0.22022529309376693) | > loss_disc_real_2: 0.0826345905661583 (0.23903819006413984) | > loss_disc_real_3: 0.14375954866409302 (0.24700041884222093) | > loss_disc_real_4: 0.032584529370069504 (0.2314121805919478) | > loss_disc_real_5: 0.01355312392115593 (0.22735321894288063) | > loss_0: 1.6104704141616821 (2.414778776657887) | > grad_norm_0: tensor(837.5195, device='cuda:0') (tensor(771.3870, device='cuda:0')) | > loss_gen: 2.643407106399536 (2.473864809060708) | > loss_kl: 0.500834584236145 (0.878857284784317) | > loss_feat: 8.846000671386719 (5.639265473072346) | > loss_mel: 22.555593490600586 (22.040929149358696) | > loss_duration: 1.5513060092926025 (1.4852664990302844) | > loss_1: 36.09714126586914 (32.518182656703864) | > grad_norm_1: tensor(53285.9023, device='cuda:0') (tensor(23604.5098, device='cuda:0')) | > current_lr_0: 0.00011830719053142743 | > current_lr_1: 0.00011830719053142743 | > step_time: 0.2671 (0.4830846175169333) | > loader_time: 0.0026 (0.01945205223865998)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.015200614929199 (3.015200614929199) | > loss_disc_real_0: 0.32332122325897217 (0.32332122325897217) | > loss_disc_real_1: 0.2851533889770508 (0.2851533889770508) | > loss_disc_real_2: 0.26960262656211853 (0.26960262656211853) | > loss_disc_real_3: 0.28377050161361694 (0.28377050161361694) | > loss_disc_real_4: 0.2742566764354706 (0.2742566764354706) | > loss_disc_real_5: 0.2689228951931 (0.2689228951931) | > loss_0: 3.015200614929199 (3.015200614929199) | > loss_gen: 1.7059372663497925 (1.7059372663497925) | > loss_kl: 3.4221794605255127 (3.4221794605255127) | > loss_feat: 0.21679674088954926 (0.21679674088954926) | > loss_mel: 2.469888925552368 (2.469888925552368) | > loss_duration: 2.6320135593414307 (2.6320135593414307) | > loss_1: 10.446815490722656 (10.446815490722656)  --> STEP: 1 | > loss_disc: 2.8150148391723633 (2.8150148391723633) | > loss_disc_real_0: 0.2129214107990265 (0.2129214107990265) | > loss_disc_real_1: 0.266385018825531 (0.266385018825531) | > loss_disc_real_2: 0.1895367056131363 (0.1895367056131363) | > loss_disc_real_3: 0.3244687020778656 (0.3244687020778656) | > loss_disc_real_4: 0.2622343897819519 (0.2622343897819519) | > loss_disc_real_5: 0.2894374430179596 (0.2894374430179596) | > loss_0: 2.8150148391723633 (2.8150148391723633) | > loss_gen: 1.80213463306427 (1.80213463306427) | > loss_kl: 3.6581289768218994 (3.6581289768218994) | > loss_feat: 1.3814977407455444 (1.3814977407455444) | > loss_mel: 18.79364776611328 (18.79364776611328) | > loss_duration: 2.9957432746887207 (2.9957432746887207) | > loss_1: 28.631153106689453 (28.631153106689453)  --> STEP: 2 | > loss_disc: 2.7432363033294678 (2.7791255712509155) | > loss_disc_real_0: 0.19812947511672974 (0.2055254429578781) | > loss_disc_real_1: 0.3151417374610901 (0.29076337814331055) | > loss_disc_real_2: 0.2663871943950653 (0.2279619500041008) | > loss_disc_real_3: 0.2552472949028015 (0.28985799849033356) | > loss_disc_real_4: 0.38029855489730835 (0.3212664723396301) | > loss_disc_real_5: 0.2394421249628067 (0.26443978399038315) | > loss_0: 2.7432363033294678 (2.7791255712509155) | > loss_gen: 2.723860025405884 (2.262997329235077) | > loss_kl: 4.06649112701416 (3.86231005191803) | > loss_feat: 6.79387903213501 (4.087688386440277) | > loss_mel: 25.60913848876953 (22.201393127441406) | > loss_duration: 2.8378963470458984 (2.9168198108673096) | > loss_1: 42.03126525878906 (35.33120918273926)  --> STEP: 3 | > loss_disc: 2.716735601425171 (2.758328914642334) | > loss_disc_real_0: 0.30783912539482117 (0.23963000377019247) | > loss_disc_real_1: 0.379843145608902 (0.3204566339651744) | > loss_disc_real_2: 0.3553837835788727 (0.2704358945290248) | > loss_disc_real_3: 0.33144599199295044 (0.30372066299120587) | > loss_disc_real_4: 0.2627396881580353 (0.3017575442790985) | > loss_disc_real_5: 0.16179631650447845 (0.23022529482841492) | > loss_0: 2.716735601425171 (2.758328914642334) | > loss_gen: 2.5733232498168945 (2.3664393027623496) | > loss_kl: 1.4982796907424927 (3.074299931526184) | > loss_feat: 3.65964412689209 (3.9450069665908813) | > loss_mel: 21.483551025390625 (21.962112426757812) | > loss_duration: 2.7254297733306885 (2.853023131688436) | > loss_1: 31.940227508544922 (34.20088195800781) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024368762969970703 (-0.006496032079060873) | > avg_loss_disc: 2.758328914642334 (-0.0997397104899087) | > avg_loss_disc_real_0: 0.23963000377019247 (-0.10701558490594229) | > avg_loss_disc_real_1: 0.3204566339651744 (+0.09750672678152722) | > avg_loss_disc_real_2: 0.2704358945290248 (-0.07706645627816516) | > avg_loss_disc_real_3: 0.30372066299120587 (-0.010533188780148806) | > avg_loss_disc_real_4: 0.3017575442790985 (-0.06539502739906311) | > avg_loss_disc_real_5: 0.23022529482841492 (-0.009055549899737031) | > avg_loss_0: 2.758328914642334 (-0.0997397104899087) | > avg_loss_gen: 2.3664393027623496 (+0.09022931257883737) | > avg_loss_kl: 3.074299931526184 (-0.18190519014994289) | > avg_loss_feat: 3.9450069665908813 (-1.5523892641067505) | > avg_loss_mel: 21.962112426757812 (-0.5950139363606759) | > avg_loss_duration: 2.853023131688436 (-0.05724589029947902) | > avg_loss_1: 34.20088195800781 (-2.296323776245117)  > EPOCH: 526/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:27:28)   --> TIME: 2023-10-20 05:27:41 -- STEP: 19/50 -- GLOBAL_STEP: 79320 | > loss_disc: 1.304105281829834 (2.3187770968989323) | > loss_disc_real_0: 0.12330526113510132 (0.18878129506973843) | > loss_disc_real_1: 0.1276441514492035 (0.19824062111346344) | > loss_disc_real_2: 0.1408044546842575 (0.2251586612117918) | > loss_disc_real_3: 0.12669576704502106 (0.24005382704107384) | > loss_disc_real_4: 0.13833799958229065 (0.21618481372532092) | > loss_disc_real_5: 0.06656163185834885 (0.21682695875336466) | > loss_0: 1.304105281829834 (2.3187770968989323) | > grad_norm_0: tensor(352.0975, device='cuda:0') (tensor(814.0753, device='cuda:0')) | > loss_gen: 3.2241339683532715 (2.5542875214626917) | > loss_kl: 1.203243374824524 (0.9104445529611487) | > loss_feat: 10.351794242858887 (6.195266120135784) | > loss_mel: 27.93931007385254 (22.830676819148817) | > loss_duration: 1.5645372867584229 (1.5209940922887701) | > loss_1: 44.283016204833984 (34.01166935970909) | > grad_norm_1: tensor(17954.4551, device='cuda:0') (tensor(18565.5645, device='cuda:0')) | > current_lr_0: 0.00011818893508735398 | > current_lr_1: 0.00011818893508735398 | > step_time: 0.5309 (0.5031798638795552) | > loader_time: 0.0151 (0.017583709014089483)  --> TIME: 2023-10-20 05:27:57 -- STEP: 49/50 -- GLOBAL_STEP: 79350 | > loss_disc: 2.4001710414886475 (2.4226062370806325) | > loss_disc_real_0: 0.06642645597457886 (0.1756573924984859) | > loss_disc_real_1: 0.25300341844558716 (0.21917874795593778) | > loss_disc_real_2: 0.19341017305850983 (0.22717285057415768) | > loss_disc_real_3: 0.28017401695251465 (0.25682330770151957) | > loss_disc_real_4: 0.18639592826366425 (0.24059093690344266) | > loss_disc_real_5: 0.15501300990581512 (0.2136622807486173) | > loss_0: 2.4001710414886475 (2.4226062370806325) | > grad_norm_0: tensor(813.3469, device='cuda:0') (tensor(794.4746, device='cuda:0')) | > loss_gen: 2.099100112915039 (2.425417398919864) | > loss_kl: 0.6629086136817932 (0.9033396309431718) | > loss_feat: 3.0925660133361816 (5.577651401715619) | > loss_mel: 21.912073135375977 (21.413804548127317) | > loss_duration: 1.595595121383667 (1.4740197050328157) | > loss_1: 29.362241744995117 (31.794232981545584) | > grad_norm_1: tensor(17159.4648, device='cuda:0') (tensor(23018.2207, device='cuda:0')) | > current_lr_0: 0.00011818893508735398 | > current_lr_1: 0.00011818893508735398 | > step_time: 0.6098 (0.4979407252097616) | > loader_time: 0.4083 (0.02737269596177705)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.335303783416748 (2.335303783416748) | > loss_disc_real_0: 0.07003476470708847 (0.07003476470708847) | > loss_disc_real_1: 0.26862314343452454 (0.26862314343452454) | > loss_disc_real_2: 0.2770094573497772 (0.2770094573497772) | > loss_disc_real_3: 0.17897020280361176 (0.17897020280361176) | > loss_disc_real_4: 0.4074905514717102 (0.4074905514717102) | > loss_disc_real_5: 0.38843834400177 (0.38843834400177) | > loss_0: 2.335303783416748 (2.335303783416748) | > loss_gen: 3.3665285110473633 (3.3665285110473633) | > loss_kl: 4.3313798904418945 (4.3313798904418945) | > loss_feat: 7.039615631103516 (7.039615631103516) | > loss_mel: 25.777753829956055 (25.777753829956055) | > loss_duration: 2.676192045211792 (2.676192045211792) | > loss_1: 43.191471099853516 (43.191471099853516)  --> STEP: 1 | > loss_disc: 3.0048766136169434 (3.0048766136169434) | > loss_disc_real_0: 0.05110633745789528 (0.05110633745789528) | > loss_disc_real_1: 0.19195707142353058 (0.19195707142353058) | > loss_disc_real_2: 0.2875237464904785 (0.2875237464904785) | > loss_disc_real_3: 0.391520619392395 (0.391520619392395) | > loss_disc_real_4: 0.3487143814563751 (0.3487143814563751) | > loss_disc_real_5: 0.27042335271835327 (0.27042335271835327) | > loss_0: 3.0048766136169434 (3.0048766136169434) | > loss_gen: 1.7275207042694092 (1.7275207042694092) | > loss_kl: 4.477334499359131 (4.477334499359131) | > loss_feat: 3.5411183834075928 (3.5411183834075928) | > loss_mel: 24.727027893066406 (24.727027893066406) | > loss_duration: 3.0289225578308105 (3.0289225578308105) | > loss_1: 37.501922607421875 (37.501922607421875)  --> STEP: 2 | > loss_disc: 3.109189033508301 (3.057032823562622) | > loss_disc_real_0: 0.12479433417320251 (0.0879503358155489) | > loss_disc_real_1: 0.5773775577545166 (0.3846673145890236) | > loss_disc_real_2: 0.24906335771083832 (0.2682935521006584) | > loss_disc_real_3: 0.4959777295589447 (0.44374917447566986) | > loss_disc_real_4: 0.2066699117422104 (0.27769214659929276) | > loss_disc_real_5: 0.3171852231025696 (0.2938042879104614) | > loss_0: 3.109189033508301 (3.057032823562622) | > loss_gen: 2.3544435501098633 (2.0409821271896362) | > loss_kl: 4.120322227478027 (4.298828363418579) | > loss_feat: 6.994683265686035 (5.267900824546814) | > loss_mel: 22.260656356811523 (23.493842124938965) | > loss_duration: 2.911043405532837 (2.9699829816818237) | > loss_1: 38.641151428222656 (38.071537017822266)  --> STEP: 3 | > loss_disc: 2.4283461570739746 (2.8474706013997397) | > loss_disc_real_0: 0.20406180620193481 (0.12665415927767754) | > loss_disc_real_1: 0.1813659369945526 (0.31690018872419995) | > loss_disc_real_2: 0.26478180289268494 (0.2671229690313339) | > loss_disc_real_3: 0.24095946550369263 (0.3761526048183441) | > loss_disc_real_4: 0.23564203083515167 (0.26367544134457904) | > loss_disc_real_5: 0.29026156663894653 (0.2926233808199565) | > loss_0: 2.4283461570739746 (2.8474706013997397) | > loss_gen: 2.4271397590637207 (2.169701337814331) | > loss_kl: 2.04913067817688 (3.548929135004679) | > loss_feat: 3.1850364208221436 (4.573612689971924) | > loss_mel: 25.772249221801758 (24.253311157226562) | > loss_duration: 2.890704870223999 (2.9435569445292153) | > loss_1: 36.32426071166992 (37.48911158243815) --> EVAL PERFORMANCE | > avg_loader_time: 0.009549697240193685 (+0.007112820943196615) | > avg_loss_disc: 2.8474706013997397 (+0.08914168675740575) | > avg_loss_disc_real_0: 0.12665415927767754 (-0.11297584449251494) | > avg_loss_disc_real_1: 0.31690018872419995 (-0.0035564452409744263) | > avg_loss_disc_real_2: 0.2671229690313339 (-0.003312925497690855) | > avg_loss_disc_real_3: 0.3761526048183441 (+0.07243194182713825) | > avg_loss_disc_real_4: 0.26367544134457904 (-0.03808210293451947) | > avg_loss_disc_real_5: 0.2926233808199565 (+0.06239808599154156) | > avg_loss_0: 2.8474706013997397 (+0.08914168675740575) | > avg_loss_gen: 2.169701337814331 (-0.19673796494801854) | > avg_loss_kl: 3.548929135004679 (+0.47462920347849513) | > avg_loss_feat: 4.573612689971924 (+0.6286057233810425) | > avg_loss_mel: 24.253311157226562 (+2.29119873046875) | > avg_loss_duration: 2.9435569445292153 (+0.09053381284077933) | > avg_loss_1: 37.48911158243815 (+3.288229624430336)  > EPOCH: 527/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:28:09)   --> TIME: 2023-10-20 05:28:25 -- STEP: 29/50 -- GLOBAL_STEP: 79380 | > loss_disc: 2.897165298461914 (2.301225580018142) | > loss_disc_real_0: 0.17183327674865723 (0.11860936816685416) | > loss_disc_real_1: 0.2581383287906647 (0.23349875712703014) | > loss_disc_real_2: 0.1963740736246109 (0.19738208219922823) | > loss_disc_real_3: 0.25886908173561096 (0.24395522834925815) | > loss_disc_real_4: 0.2020142525434494 (0.1999119427697412) | > loss_disc_real_5: 0.23244723677635193 (0.20619261598792568) | > loss_0: 2.897165298461914 (2.301225580018142) | > grad_norm_0: tensor(1730.8988, device='cuda:0') (tensor(1173.8273, device='cuda:0')) | > loss_gen: 1.4588465690612793 (2.5044381536286453) | > loss_kl: 0.6772418022155762 (0.8833525622713154) | > loss_feat: 0.3134738802909851 (5.493099503989877) | > loss_mel: 11.856225967407227 (21.78353573536051) | > loss_duration: 1.502406358718872 (1.4891612735287896) | > loss_1: 15.808194160461426 (32.153587127554026) | > grad_norm_1: tensor(37591.9961, device='cuda:0') (tensor(49766.1211, device='cuda:0')) | > current_lr_0: 0.0001180707978470008 | > current_lr_1: 0.0001180707978470008 | > step_time: 0.5586 (0.3674637120345543) | > loader_time: 0.0018 (0.006911294213656722)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.348003387451172 (2.348003387451172) | > loss_disc_real_0: 0.21161270141601562 (0.21161270141601562) | > loss_disc_real_1: 0.30770307779312134 (0.30770307779312134) | > loss_disc_real_2: 0.245836079120636 (0.245836079120636) | > loss_disc_real_3: 0.3046049475669861 (0.3046049475669861) | > loss_disc_real_4: 0.22306370735168457 (0.22306370735168457) | > loss_disc_real_5: 0.2876908779144287 (0.2876908779144287) | > loss_0: 2.348003387451172 (2.348003387451172) | > loss_gen: 2.8637449741363525 (2.8637449741363525) | > loss_kl: 3.50486159324646 (3.50486159324646) | > loss_feat: 5.695388317108154 (5.695388317108154) | > loss_mel: 22.21013832092285 (22.21013832092285) | > loss_duration: 2.6166131496429443 (2.6166131496429443) | > loss_1: 36.8907470703125 (36.8907470703125)  --> STEP: 1 | > loss_disc: 2.7910966873168945 (2.7910966873168945) | > loss_disc_real_0: 0.1562555432319641 (0.1562555432319641) | > loss_disc_real_1: 0.2800220847129822 (0.2800220847129822) | > loss_disc_real_2: 0.3048723638057709 (0.3048723638057709) | > loss_disc_real_3: 0.2298463135957718 (0.2298463135957718) | > loss_disc_real_4: 0.24975170195102692 (0.24975170195102692) | > loss_disc_real_5: 0.22601279616355896 (0.22601279616355896) | > loss_0: 2.7910966873168945 (2.7910966873168945) | > loss_gen: 1.7946792840957642 (1.7946792840957642) | > loss_kl: 4.288299560546875 (4.288299560546875) | > loss_feat: 3.2042160034179688 (3.2042160034179688) | > loss_mel: 22.223573684692383 (22.223573684692383) | > loss_duration: 3.0114195346832275 (3.0114195346832275) | > loss_1: 34.52219009399414 (34.52219009399414)  --> STEP: 2 | > loss_disc: 1.8915677070617676 (2.341332197189331) | > loss_disc_real_0: 0.19226686656475067 (0.1742612048983574) | > loss_disc_real_1: 0.24369432032108307 (0.2618582025170326) | > loss_disc_real_2: 0.12046457827091217 (0.21266847103834152) | > loss_disc_real_3: 0.25373974442481995 (0.24179302901029587) | > loss_disc_real_4: 0.04143296927213669 (0.1455923356115818) | > loss_disc_real_5: 0.059934910386800766 (0.14297385327517986) | > loss_0: 1.8915677070617676 (2.341332197189331) | > loss_gen: 2.5755083560943604 (2.1850938200950623) | > loss_kl: 4.033878326416016 (4.161088943481445) | > loss_feat: 7.430986404418945 (5.317601203918457) | > loss_mel: 29.960983276367188 (26.092278480529785) | > loss_duration: 2.8284497261047363 (2.919934630393982) | > loss_1: 46.82980728149414 (40.67599868774414)  --> STEP: 3 | > loss_disc: 2.0741922855377197 (2.2522855599721274) | > loss_disc_real_0: 0.11395072937011719 (0.15415771305561066) | > loss_disc_real_1: 0.17499344050884247 (0.2329032818476359) | > loss_disc_real_2: 0.12102609127759933 (0.18212101111809412) | > loss_disc_real_3: 0.23269696533679962 (0.23876100778579712) | > loss_disc_real_4: 0.079648956656456 (0.12361120929320653) | > loss_disc_real_5: 0.12248225510120392 (0.13614332055052122) | > loss_0: 2.0741922855377197 (2.2522855599721274) | > loss_gen: 2.025106906890869 (2.131764849026998) | > loss_kl: 2.0336954593658447 (3.4519577821095786) | > loss_feat: 7.119183540344238 (5.918128649393718) | > loss_mel: 21.47229766845703 (24.552284876505535) | > loss_duration: 2.6877996921539307 (2.8425563176472983) | > loss_1: 35.33808517456055 (38.89669418334961) --> EVAL PERFORMANCE | > avg_loader_time: 0.01400430997212728 (+0.004454612731933594) | > avg_loss_disc: 2.2522855599721274 (-0.5951850414276123) | > avg_loss_disc_real_0: 0.15415771305561066 (+0.02750355377793312) | > avg_loss_disc_real_1: 0.2329032818476359 (-0.08399690687656405) | > avg_loss_disc_real_2: 0.18212101111809412 (-0.0850019579132398) | > avg_loss_disc_real_3: 0.23876100778579712 (-0.137391597032547) | > avg_loss_disc_real_4: 0.12361120929320653 (-0.14006423205137253) | > avg_loss_disc_real_5: 0.13614332055052122 (-0.15648006026943526) | > avg_loss_0: 2.2522855599721274 (-0.5951850414276123) | > avg_loss_gen: 2.131764849026998 (-0.03793648878733302) | > avg_loss_kl: 3.4519577821095786 (-0.09697135289510062) | > avg_loss_feat: 5.918128649393718 (+1.344515959421794) | > avg_loss_mel: 24.552284876505535 (+0.29897371927897254) | > avg_loss_duration: 2.8425563176472983 (-0.10100062688191702) | > avg_loss_1: 38.89669418334961 (+1.4075826009114607)  > EPOCH: 528/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:28:46)   --> TIME: 2023-10-20 05:28:55 -- STEP: 9/50 -- GLOBAL_STEP: 79410 | > loss_disc: 2.303929328918457 (2.3549778593911066) | > loss_disc_real_0: 0.06970729678869247 (0.11479478681253062) | > loss_disc_real_1: 0.19609571993350983 (0.22372260441382727) | > loss_disc_real_2: 0.19771021604537964 (0.21938037851618397) | > loss_disc_real_3: 0.22108249366283417 (0.29666828364133835) | > loss_disc_real_4: 0.24254140257835388 (0.25718181476824814) | > loss_disc_real_5: 0.2335919588804245 (0.2251138352892465) | > loss_0: 2.303929328918457 (2.3549778593911066) | > grad_norm_0: tensor(1002.2315, device='cuda:0') (tensor(1036.8298, device='cuda:0')) | > loss_gen: 2.14971923828125 (2.566857020060221) | > loss_kl: 0.8042342066764832 (0.7206136865748299) | > loss_feat: 5.969344139099121 (6.35117687119378) | > loss_mel: 21.807750701904297 (22.242628309461807) | > loss_duration: 1.4150327444076538 (1.4775021473566692) | > loss_1: 32.146080017089844 (33.35877799987793) | > grad_norm_1: tensor(40313.8047, device='cuda:0') (tensor(48254.2812, device='cuda:0')) | > current_lr_0: 0.00011795277869221584 | > current_lr_1: 0.00011795277869221584 | > step_time: 0.6049 (0.5111654069688585) | > loader_time: 0.0135 (0.02071539560953776)  --> TIME: 2023-10-20 05:29:10 -- STEP: 39/50 -- GLOBAL_STEP: 79440 | > loss_disc: 1.9316473007202148 (2.3769525503500915) | > loss_disc_real_0: 0.10341360419988632 (0.14186433038841456) | > loss_disc_real_1: 0.18101505935192108 (0.22493264824151993) | > loss_disc_real_2: 0.23486550152301788 (0.21507844591561037) | > loss_disc_real_3: 0.2564629316329956 (0.24970925265015692) | > loss_disc_real_4: 0.11625407636165619 (0.23277759967515102) | > loss_disc_real_5: 0.13598687946796417 (0.21121014785976747) | > loss_0: 1.9316473007202148 (2.3769525503500915) | > grad_norm_0: tensor(598.6671, device='cuda:0') (tensor(1315.2142, device='cuda:0')) | > loss_gen: 2.7504630088806152 (2.3976847728093458) | > loss_kl: 0.4230991303920746 (0.8197934998151584) | > loss_feat: 5.380579948425293 (5.362673818730773) | > loss_mel: 15.566729545593262 (21.647265956952022) | > loss_duration: 1.5292938947677612 (1.4648321194526477) | > loss_1: 25.650165557861328 (31.692250337356175) | > grad_norm_1: tensor(68587.6172, device='cuda:0') (tensor(46629.2422, device='cuda:0')) | > current_lr_0: 0.00011795277869221584 | > current_lr_1: 0.00011795277869221584 | > step_time: 0.3055 (0.4830635938888939) | > loader_time: 0.0023 (0.01743183991847894)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.574087142944336 (1.574087142944336) | > loss_disc_real_0: 0.18455103039741516 (0.18455103039741516) | > loss_disc_real_1: 0.2036682665348053 (0.2036682665348053) | > loss_disc_real_2: 0.1372872292995453 (0.1372872292995453) | > loss_disc_real_3: 0.22123616933822632 (0.22123616933822632) | > loss_disc_real_4: 0.05204824358224869 (0.05204824358224869) | > loss_disc_real_5: 0.1125393807888031 (0.1125393807888031) | > loss_0: 1.574087142944336 (1.574087142944336) | > loss_gen: 3.313669443130493 (3.313669443130493) | > loss_kl: 3.239955186843872 (3.239955186843872) | > loss_feat: 12.342738151550293 (12.342738151550293) | > loss_mel: 23.049001693725586 (23.049001693725586) | > loss_duration: 2.6872808933258057 (2.6872808933258057) | > loss_1: 44.63264846801758 (44.63264846801758)  --> STEP: 1 | > loss_disc: 2.444164752960205 (2.444164752960205) | > loss_disc_real_0: 0.25107383728027344 (0.25107383728027344) | > loss_disc_real_1: 0.19455914199352264 (0.19455914199352264) | > loss_disc_real_2: 0.2912721633911133 (0.2912721633911133) | > loss_disc_real_3: 0.2856995761394501 (0.2856995761394501) | > loss_disc_real_4: 0.3343523442745209 (0.3343523442745209) | > loss_disc_real_5: 0.2429109662771225 (0.2429109662771225) | > loss_0: 2.444164752960205 (2.444164752960205) | > loss_gen: 2.600053310394287 (2.600053310394287) | > loss_kl: 3.6907224655151367 (3.6907224655151367) | > loss_feat: 4.535163402557373 (4.535163402557373) | > loss_mel: 24.165863037109375 (24.165863037109375) | > loss_duration: 2.956651449203491 (2.956651449203491) | > loss_1: 37.948448181152344 (37.948448181152344)  --> STEP: 2 | > loss_disc: 1.5206236839294434 (1.9823942184448242) | > loss_disc_real_0: 0.075836680829525 (0.16345525905489922) | > loss_disc_real_1: 0.06166457012295723 (0.12811185605823994) | > loss_disc_real_2: 0.10061527788639069 (0.19594372063875198) | > loss_disc_real_3: 0.3152817487716675 (0.3004906624555588) | > loss_disc_real_4: 0.043293751776218414 (0.18882304802536964) | > loss_disc_real_5: 0.0142583679407835 (0.128584667108953) | > loss_0: 1.5206236839294434 (1.9823942184448242) | > loss_gen: 2.8593215942382812 (2.729687452316284) | > loss_kl: 4.3199028968811035 (4.00531268119812) | > loss_feat: 14.138057708740234 (9.336610555648804) | > loss_mel: 23.852493286132812 (24.009178161621094) | > loss_duration: 2.9229862689971924 (2.939818859100342) | > loss_1: 48.0927619934082 (43.02060508728027)  --> STEP: 3 | > loss_disc: 2.3765478134155273 (2.113778750101725) | > loss_disc_real_0: 0.11257106065750122 (0.14649385958909988) | > loss_disc_real_1: 0.33825990557670593 (0.1981612058977286) | > loss_disc_real_2: 0.36035022139549255 (0.2507458875576655) | > loss_disc_real_3: 0.3337699770927429 (0.3115837673346202) | > loss_disc_real_4: 0.28783175349235535 (0.2218259498476982) | > loss_disc_real_5: 0.35682496428489685 (0.20466476616760096) | > loss_0: 2.3765478134155273 (2.113778750101725) | > loss_gen: 3.2412033081054688 (2.9001927375793457) | > loss_kl: 1.934908390045166 (3.3151779174804688) | > loss_feat: 5.491168022155762 (8.05479637781779) | > loss_mel: 20.11344337463379 (22.710599899291992) | > loss_duration: 2.7342886924743652 (2.8713088035583496) | > loss_1: 33.515010833740234 (39.852073669433594) --> EVAL PERFORMANCE | > avg_loader_time: 0.02036563555399577 (+0.00636132558186849) | > avg_loss_disc: 2.113778750101725 (-0.13850680987040231) | > avg_loss_disc_real_0: 0.14649385958909988 (-0.007663853466510773) | > avg_loss_disc_real_1: 0.1981612058977286 (-0.0347420759499073) | > avg_loss_disc_real_2: 0.2507458875576655 (+0.06862487643957141) | > avg_loss_disc_real_3: 0.3115837673346202 (+0.07282275954882306) | > avg_loss_disc_real_4: 0.2218259498476982 (+0.09821474055449168) | > avg_loss_disc_real_5: 0.20466476616760096 (+0.06852144561707973) | > avg_loss_0: 2.113778750101725 (-0.13850680987040231) | > avg_loss_gen: 2.9001927375793457 (+0.7684278885523477) | > avg_loss_kl: 3.3151779174804688 (-0.13677986462910985) | > avg_loss_feat: 8.05479637781779 (+2.1366677284240714) | > avg_loss_mel: 22.710599899291992 (-1.8416849772135429) | > avg_loss_duration: 2.8713088035583496 (+0.028752485911051284) | > avg_loss_1: 39.852073669433594 (+0.9553794860839844)  > EPOCH: 529/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:29:27)   --> TIME: 2023-10-20 05:29:41 -- STEP: 19/50 -- GLOBAL_STEP: 79470 | > loss_disc: 2.9763505458831787 (2.2562214638057503) | > loss_disc_real_0: 0.11607031524181366 (0.14079042602526515) | > loss_disc_real_1: 0.26398423314094543 (0.23574655503034592) | > loss_disc_real_2: 0.2780230939388275 (0.24796916858146065) | > loss_disc_real_3: 0.24055536091327667 (0.23615344447132788) | > loss_disc_real_4: 0.2502067983150482 (0.2229817445929113) | > loss_disc_real_5: 0.18840758502483368 (0.23913906470529342) | > loss_0: 2.9763505458831787 (2.2562214638057503) | > grad_norm_0: tensor(1899.5752, device='cuda:0') (tensor(1087.9741, device='cuda:0')) | > loss_gen: 1.4529260396957397 (2.8124729771363106) | > loss_kl: 1.0386879444122314 (0.9523729815294868) | > loss_feat: 0.3351840376853943 (6.497245237917492) | > loss_mel: 5.6635541915893555 (20.50292725625791) | > loss_duration: 1.5896964073181152 (1.526799339997141) | > loss_1: 10.080047607421875 (32.29181809174387) | > grad_norm_1: tensor(24813.7051, device='cuda:0') (tensor(63106.3633, device='cuda:0')) | > current_lr_0: 0.00011783487750496521 | > current_lr_1: 0.00011783487750496521 | > step_time: 0.6307 (0.5266564519781816) | > loader_time: 0.0115 (0.01685895417865954)  --> TIME: 2023-10-20 05:29:57 -- STEP: 49/50 -- GLOBAL_STEP: 79500 | > loss_disc: 2.1720690727233887 (2.3451322098167573) | > loss_disc_real_0: 0.1621544510126114 (0.15012765367876513) | > loss_disc_real_1: 0.1939220428466797 (0.2212377391299423) | > loss_disc_real_2: 0.3092666566371918 (0.23749726508953134) | > loss_disc_real_3: 0.24881038069725037 (0.23311479689971526) | > loss_disc_real_4: 0.21426188945770264 (0.22079453529904083) | > loss_disc_real_5: 0.3461381196975708 (0.21811236650207821) | > loss_0: 2.1720690727233887 (2.3451322098167573) | > grad_norm_0: tensor(1350.6400, device='cuda:0') (tensor(1166.5594, device='cuda:0')) | > loss_gen: 3.3053669929504395 (2.5608536613230797) | > loss_kl: 0.6508835554122925 (0.885786304364399) | > loss_feat: 8.268817901611328 (6.121535663055826) | > loss_mel: 27.86711311340332 (21.613940580767025) | > loss_duration: 1.6209872961044312 (1.4744108866672128) | > loss_1: 41.71316909790039 (32.65652727594181) | > grad_norm_1: tensor(117104.7188, device='cuda:0') (tensor(48563.9883, device='cuda:0')) | > current_lr_0: 0.00011783487750496521 | > current_lr_1: 0.00011783487750496521 | > step_time: 0.5961 (0.5070377320659404) | > loader_time: 0.3894 (0.024427486925709004)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1646885871887207 (3.1646885871887207) | > loss_disc_real_0: 0.2674282193183899 (0.2674282193183899) | > loss_disc_real_1: 0.29348623752593994 (0.29348623752593994) | > loss_disc_real_2: 0.3260539770126343 (0.3260539770126343) | > loss_disc_real_3: 0.3308406174182892 (0.3308406174182892) | > loss_disc_real_4: 0.2690903842449188 (0.2690903842449188) | > loss_disc_real_5: 0.293531596660614 (0.293531596660614) | > loss_0: 3.1646885871887207 (3.1646885871887207) | > loss_gen: 1.9961351156234741 (1.9961351156234741) | > loss_kl: 3.288857936859131 (3.288857936859131) | > loss_feat: 6.371841907501221 (6.371841907501221) | > loss_mel: 23.445575714111328 (23.445575714111328) | > loss_duration: 2.649881601333618 (2.649881601333618) | > loss_1: 37.752296447753906 (37.752296447753906)  --> STEP: 1 | > loss_disc: 2.4721288681030273 (2.4721288681030273) | > loss_disc_real_0: 0.16926002502441406 (0.16926002502441406) | > loss_disc_real_1: 0.24228034913539886 (0.24228034913539886) | > loss_disc_real_2: 0.2851608097553253 (0.2851608097553253) | > loss_disc_real_3: 0.2534491717815399 (0.2534491717815399) | > loss_disc_real_4: 0.2194087654352188 (0.2194087654352188) | > loss_disc_real_5: 0.2070619761943817 (0.2070619761943817) | > loss_0: 2.4721288681030273 (2.4721288681030273) | > loss_gen: 2.3530380725860596 (2.3530380725860596) | > loss_kl: 4.176427364349365 (4.176427364349365) | > loss_feat: 5.0691728591918945 (5.0691728591918945) | > loss_mel: 23.667139053344727 (23.667139053344727) | > loss_duration: 2.9139134883880615 (2.9139134883880615) | > loss_1: 38.179691314697266 (38.179691314697266)  --> STEP: 2 | > loss_disc: 2.784047842025757 (2.628088355064392) | > loss_disc_real_0: 0.12054666876792908 (0.14490334689617157) | > loss_disc_real_1: 0.26326870918273926 (0.25277452915906906) | > loss_disc_real_2: 0.21952828764915466 (0.25234454870224) | > loss_disc_real_3: 0.2628139853477478 (0.25813157856464386) | > loss_disc_real_4: 0.22691482305526733 (0.22316179424524307) | > loss_disc_real_5: 0.2660674750804901 (0.2365647256374359) | > loss_0: 2.784047842025757 (2.628088355064392) | > loss_gen: 1.7467504739761353 (2.0498942732810974) | > loss_kl: 4.037246227264404 (4.106836795806885) | > loss_feat: 1.3236029148101807 (3.1963878870010376) | > loss_mel: 17.09307098388672 (20.380105018615723) | > loss_duration: 2.8786473274230957 (2.8962804079055786) | > loss_1: 27.079317092895508 (32.62950420379639)  --> STEP: 3 | > loss_disc: 2.844677448272705 (2.700284719467163) | > loss_disc_real_0: 0.27852487564086914 (0.18944385647773743) | > loss_disc_real_1: 0.33734428882598877 (0.2809644490480423) | > loss_disc_real_2: 0.3501582443714142 (0.28494911392529804) | > loss_disc_real_3: 0.2991862893104553 (0.271816482146581) | > loss_disc_real_4: 0.3325124680995941 (0.2596120188633601) | > loss_disc_real_5: 0.2912467122077942 (0.254792054494222) | > loss_0: 2.844677448272705 (2.700284719467163) | > loss_gen: 2.4333653450012207 (2.1777179638544717) | > loss_kl: 1.8841992616653442 (3.3659576177597046) | > loss_feat: 2.1654043197631836 (2.852726697921753) | > loss_mel: 21.945600509643555 (20.901936848958332) | > loss_duration: 2.7483835220336914 (2.8469814459482827) | > loss_1: 31.176952362060547 (32.14532025655111) --> EVAL PERFORMANCE | > avg_loader_time: 0.004759470621744792 (-0.015606164932250977) | > avg_loss_disc: 2.700284719467163 (+0.586505969365438) | > avg_loss_disc_real_0: 0.18944385647773743 (+0.04294999688863754) | > avg_loss_disc_real_1: 0.2809644490480423 (+0.0828032431503137) | > avg_loss_disc_real_2: 0.28494911392529804 (+0.03420322636763251) | > avg_loss_disc_real_3: 0.271816482146581 (-0.03976728518803918) | > avg_loss_disc_real_4: 0.2596120188633601 (+0.037786069015661894) | > avg_loss_disc_real_5: 0.254792054494222 (+0.05012728832662103) | > avg_loss_0: 2.700284719467163 (+0.586505969365438) | > avg_loss_gen: 2.1777179638544717 (-0.722474773724874) | > avg_loss_kl: 3.3659576177597046 (+0.05077970027923584) | > avg_loss_feat: 2.852726697921753 (-5.202069679896036) | > avg_loss_mel: 20.901936848958332 (-1.80866305033366) | > avg_loss_duration: 2.8469814459482827 (-0.02432735761006688) | > avg_loss_1: 32.14532025655111 (-7.706753412882485)  > EPOCH: 530/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:30:08)   --> TIME: 2023-10-20 05:30:25 -- STEP: 29/50 -- GLOBAL_STEP: 79530 | > loss_disc: 2.8456149101257324 (2.394579163913069) | > loss_disc_real_0: 0.22020792961120605 (0.15679779411132996) | > loss_disc_real_1: 0.2203105390071869 (0.22739800553897332) | > loss_disc_real_2: 0.31366363167762756 (0.23832813367761416) | > loss_disc_real_3: 0.2495226263999939 (0.25678756460547447) | > loss_disc_real_4: 0.407029390335083 (0.23395120211202522) | > loss_disc_real_5: 0.39122602343559265 (0.2021582239018432) | > loss_0: 2.8456149101257324 (2.394579163913069) | > grad_norm_0: tensor(559.2817, device='cuda:0') (tensor(1068.1758, device='cuda:0')) | > loss_gen: 2.2534730434417725 (2.4394350092986534) | > loss_kl: 0.5222991108894348 (0.8136031072715233) | > loss_feat: 3.2377912998199463 (5.7867950878009715) | > loss_mel: 24.138534545898438 (22.15686203282455) | > loss_duration: 1.4651851654052734 (1.507987984295549) | > loss_1: 31.61728286743164 (32.70468302430778) | > grad_norm_1: tensor(9473.0059, device='cuda:0') (tensor(39089.7656, device='cuda:0')) | > current_lr_0: 0.00011771709416733295 | > current_lr_1: 0.00011771709416733295 | > step_time: 0.3127 (0.4036766002918112) | > loader_time: 0.0024 (0.008643142108259535)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9848525524139404 (2.9848525524139404) | > loss_disc_real_0: 0.2750388979911804 (0.2750388979911804) | > loss_disc_real_1: 0.41487759351730347 (0.41487759351730347) | > loss_disc_real_2: 0.37164372205734253 (0.37164372205734253) | > loss_disc_real_3: 0.43712878227233887 (0.43712878227233887) | > loss_disc_real_4: 0.3745622932910919 (0.3745622932910919) | > loss_disc_real_5: 0.4272455871105194 (0.4272455871105194) | > loss_0: 2.9848525524139404 (2.9848525524139404) | > loss_gen: 3.2281298637390137 (3.2281298637390137) | > loss_kl: 3.529874801635742 (3.529874801635742) | > loss_feat: 5.910937786102295 (5.910937786102295) | > loss_mel: 23.485008239746094 (23.485008239746094) | > loss_duration: 2.528285026550293 (2.528285026550293) | > loss_1: 38.68223571777344 (38.68223571777344)  --> STEP: 1 | > loss_disc: 2.870948553085327 (2.870948553085327) | > loss_disc_real_0: 0.3295574486255646 (0.3295574486255646) | > loss_disc_real_1: 0.2751244306564331 (0.2751244306564331) | > loss_disc_real_2: 0.2685335874557495 (0.2685335874557495) | > loss_disc_real_3: 0.2821127772331238 (0.2821127772331238) | > loss_disc_real_4: 0.28620389103889465 (0.28620389103889465) | > loss_disc_real_5: 0.2309821993112564 (0.2309821993112564) | > loss_0: 2.870948553085327 (2.870948553085327) | > loss_gen: 1.918426513671875 (1.918426513671875) | > loss_kl: 3.9517147541046143 (3.9517147541046143) | > loss_feat: 0.6183450818061829 (0.6183450818061829) | > loss_mel: 14.716903686523438 (14.716903686523438) | > loss_duration: 2.904939651489258 (2.904939651489258) | > loss_1: 24.11033058166504 (24.11033058166504)  --> STEP: 2 | > loss_disc: 2.3067781925201416 (2.5888633728027344) | > loss_disc_real_0: 0.12826626002788544 (0.228911854326725) | > loss_disc_real_1: 0.2645849287509918 (0.26985467970371246) | > loss_disc_real_2: 0.17659954726696014 (0.22256656736135483) | > loss_disc_real_3: 0.11960574984550476 (0.20085926353931427) | > loss_disc_real_4: 0.22561103105545044 (0.25590746104717255) | > loss_disc_real_5: 0.15043708682060242 (0.1907096430659294) | > loss_0: 2.3067781925201416 (2.5888633728027344) | > loss_gen: 2.5135459899902344 (2.2159862518310547) | > loss_kl: 4.215689659118652 (4.083702206611633) | > loss_feat: 9.064030647277832 (4.8411878645420074) | > loss_mel: 23.65668296813965 (19.186793327331543) | > loss_duration: 2.813159942626953 (2.8590497970581055) | > loss_1: 42.26310729980469 (33.18671894073486)  --> STEP: 3 | > loss_disc: 2.938932418823242 (2.7055530548095703) | > loss_disc_real_0: 0.35450583696365356 (0.2707765152057012) | > loss_disc_real_1: 0.31291940808296204 (0.28420958916346234) | > loss_disc_real_2: 0.2824752628803253 (0.242536132534345) | > loss_disc_real_3: 0.2929455041885376 (0.2315546770890554) | > loss_disc_real_4: 0.27962079644203186 (0.2638119061787923) | > loss_disc_real_5: 0.2233811616897583 (0.20160014927387238) | > loss_0: 2.938932418823242 (2.7055530548095703) | > loss_gen: 1.9389314651489258 (2.123634656270345) | > loss_kl: 1.8501993417739868 (3.339201251665751) | > loss_feat: 0.6634100079536438 (3.4485952456792197) | > loss_mel: 17.588348388671875 (18.65397834777832) | > loss_duration: 2.7700068950653076 (2.829368829727173) | > loss_1: 24.810895919799805 (30.39477793375651) --> EVAL PERFORMANCE | > avg_loader_time: 0.01990930239359538 (+0.015149831771850586) | > avg_loss_disc: 2.7055530548095703 (+0.0052683353424072266) | > avg_loss_disc_real_0: 0.2707765152057012 (+0.08133265872796375) | > avg_loss_disc_real_1: 0.28420958916346234 (+0.003245140115420042) | > avg_loss_disc_real_2: 0.242536132534345 (-0.042412981390953036) | > avg_loss_disc_real_3: 0.2315546770890554 (-0.04026180505752561) | > avg_loss_disc_real_4: 0.2638119061787923 (+0.004199887315432194) | > avg_loss_disc_real_5: 0.20160014927387238 (-0.05319190522034961) | > avg_loss_0: 2.7055530548095703 (+0.0052683353424072266) | > avg_loss_gen: 2.123634656270345 (-0.054083307584126494) | > avg_loss_kl: 3.339201251665751 (-0.0267563660939536) | > avg_loss_feat: 3.4485952456792197 (+0.5958685477574668) | > avg_loss_mel: 18.65397834777832 (-2.247958501180012) | > avg_loss_duration: 2.829368829727173 (-0.017612616221109878) | > avg_loss_1: 30.39477793375651 (-1.7505423227945975)  > EPOCH: 531/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:30:46)   --> TIME: 2023-10-20 05:30:54 -- STEP: 9/50 -- GLOBAL_STEP: 79560 | > loss_disc: 2.6051976680755615 (2.347810745239258) | > loss_disc_real_0: 0.24730068445205688 (0.22799103438026375) | > loss_disc_real_1: 0.362120658159256 (0.26372915589147145) | > loss_disc_real_2: 0.3239067792892456 (0.22639225154287285) | > loss_disc_real_3: 0.36599040031433105 (0.29091501774059403) | > loss_disc_real_4: 0.27807989716529846 (0.22783981139461199) | > loss_disc_real_5: 0.25997570157051086 (0.22485270433955723) | > loss_0: 2.6051976680755615 (2.347810745239258) | > grad_norm_0: tensor(789.4510, device='cuda:0') (tensor(1106.3340, device='cuda:0')) | > loss_gen: 2.8482420444488525 (2.7466199133131237) | > loss_kl: 1.053130030632019 (0.8183171451091766) | > loss_feat: 4.477616786956787 (5.7853410343329115) | > loss_mel: 20.934062957763672 (20.881370968288845) | > loss_duration: 1.4162555932998657 (1.485289282268948) | > loss_1: 30.729307174682617 (31.71693907843696) | > grad_norm_1: tensor(32424.6582, device='cuda:0') (tensor(53491.4844, device='cuda:0')) | > current_lr_0: 0.00011759942856152097 | > current_lr_1: 0.00011759942856152097 | > step_time: 0.3953 (0.5315926869710287) | > loader_time: 0.0024 (0.0144857300652398)  --> TIME: 2023-10-20 05:31:09 -- STEP: 39/50 -- GLOBAL_STEP: 79590 | > loss_disc: 2.8507654666900635 (2.3662988436527743) | > loss_disc_real_0: 0.11140437424182892 (0.17812198161696777) | > loss_disc_real_1: 0.28644266724586487 (0.22559441091158453) | > loss_disc_real_2: 0.26531079411506653 (0.22431132928110087) | > loss_disc_real_3: 0.2902574837207794 (0.24691288994672972) | > loss_disc_real_4: 0.30483776330947876 (0.21459352234617257) | > loss_disc_real_5: 0.3139190673828125 (0.2236384267035203) | > loss_0: 2.8507654666900635 (2.3662988436527743) | > grad_norm_0: tensor(828.0132, device='cuda:0') (tensor(992.5033, device='cuda:0')) | > loss_gen: 1.8290622234344482 (2.4537550730582995) | > loss_kl: 0.7160026431083679 (0.7998677690823873) | > loss_feat: 0.948150634765625 (5.6893192407412405) | > loss_mel: 15.728354454040527 (21.618921448022892) | > loss_duration: 1.5044230222702026 (1.4741693398891356) | > loss_1: 20.72599220275879 (32.036033190213715) | > grad_norm_1: tensor(5328.5869, device='cuda:0') (tensor(39478.4492, device='cuda:0')) | > current_lr_0: 0.00011759942856152097 | > current_lr_1: 0.00011759942856152097 | > step_time: 0.3244 (0.47783789879236466) | > loader_time: 0.0097 (0.013422935436933469)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.3099827766418457 (1.3099827766418457) | > loss_disc_real_0: 0.17195212841033936 (0.17195212841033936) | > loss_disc_real_1: 0.07242521643638611 (0.07242521643638611) | > loss_disc_real_2: 0.12024082988500595 (0.12024082988500595) | > loss_disc_real_3: 0.17384767532348633 (0.17384767532348633) | > loss_disc_real_4: 0.05642908439040184 (0.05642908439040184) | > loss_disc_real_5: 0.08066161721944809 (0.08066161721944809) | > loss_0: 1.3099827766418457 (1.3099827766418457) | > loss_gen: 3.050873279571533 (3.050873279571533) | > loss_kl: 3.6988282203674316 (3.6988282203674316) | > loss_feat: 11.542293548583984 (11.542293548583984) | > loss_mel: 27.883262634277344 (27.883262634277344) | > loss_duration: 2.4886345863342285 (2.4886345863342285) | > loss_1: 48.66389083862305 (48.66389083862305)  --> STEP: 1 | > loss_disc: 2.6628456115722656 (2.6628456115722656) | > loss_disc_real_0: 0.058278270065784454 (0.058278270065784454) | > loss_disc_real_1: 0.29921427369117737 (0.29921427369117737) | > loss_disc_real_2: 0.350899338722229 (0.350899338722229) | > loss_disc_real_3: 0.38474979996681213 (0.38474979996681213) | > loss_disc_real_4: 0.3091510832309723 (0.3091510832309723) | > loss_disc_real_5: 0.21396619081497192 (0.21396619081497192) | > loss_0: 2.6628456115722656 (2.6628456115722656) | > loss_gen: 2.2456133365631104 (2.2456133365631104) | > loss_kl: 4.027663230895996 (4.027663230895996) | > loss_feat: 6.041316986083984 (6.041316986083984) | > loss_mel: 25.133926391601562 (25.133926391601562) | > loss_duration: 2.943547010421753 (2.943547010421753) | > loss_1: 40.392066955566406 (40.392066955566406)  --> STEP: 2 | > loss_disc: 2.8145670890808105 (2.738706350326538) | > loss_disc_real_0: 0.22446389496326447 (0.14137108251452446) | > loss_disc_real_1: 0.243702694773674 (0.2714584842324257) | > loss_disc_real_2: 0.26008057594299316 (0.3054899573326111) | > loss_disc_real_3: 0.21481502056121826 (0.2997824102640152) | > loss_disc_real_4: 0.2801538109779358 (0.29465244710445404) | > loss_disc_real_5: 0.18986313045024872 (0.20191466063261032) | > loss_0: 2.8145670890808105 (2.738706350326538) | > loss_gen: 1.7302827835083008 (1.9879480600357056) | > loss_kl: 4.307009220123291 (4.1673362255096436) | > loss_feat: 2.896904945373535 (4.46911096572876) | > loss_mel: 11.851495742797852 (18.492711067199707) | > loss_duration: 2.759329319000244 (2.8514381647109985) | > loss_1: 23.54502296447754 (31.968544960021973)  --> STEP: 3 | > loss_disc: 2.526638984680176 (2.6680172284444175) | > loss_disc_real_0: 0.17321959137916565 (0.15198725213607153) | > loss_disc_real_1: 0.19402489066123962 (0.24564728637536368) | > loss_disc_real_2: 0.15001742541790009 (0.2536657800277074) | > loss_disc_real_3: 0.46589818596839905 (0.3551543354988098) | > loss_disc_real_4: 0.16207659244537354 (0.2504604955514272) | > loss_disc_real_5: 0.09035711735486984 (0.1647288128733635) | > loss_0: 2.526638984680176 (2.6680172284444175) | > loss_gen: 2.1014578342437744 (2.025784651438395) | > loss_kl: 2.2365620136260986 (3.523744821548462) | > loss_feat: 5.131112098693848 (4.689778010050456) | > loss_mel: 21.554269790649414 (19.51323064168294) | > loss_duration: 2.6866860389709473 (2.796520789464315) | > loss_1: 33.710086822509766 (32.54905891418457) --> EVAL PERFORMANCE | > avg_loader_time: 0.013460238774617514 (-0.006449063618977865) | > avg_loss_disc: 2.6680172284444175 (-0.03753582636515285) | > avg_loss_disc_real_0: 0.15198725213607153 (-0.11878926306962964) | > avg_loss_disc_real_1: 0.24564728637536368 (-0.03856230278809866) | > avg_loss_disc_real_2: 0.2536657800277074 (+0.011129647493362399) | > avg_loss_disc_real_3: 0.3551543354988098 (+0.12359965840975443) | > avg_loss_disc_real_4: 0.2504604955514272 (-0.013351410627365112) | > avg_loss_disc_real_5: 0.1647288128733635 (-0.03687133640050888) | > avg_loss_0: 2.6680172284444175 (-0.03753582636515285) | > avg_loss_gen: 2.025784651438395 (-0.09785000483195017) | > avg_loss_kl: 3.523744821548462 (+0.18454356988271092) | > avg_loss_feat: 4.689778010050456 (+1.2411827643712363) | > avg_loss_mel: 19.51323064168294 (+0.8592522939046212) | > avg_loss_duration: 2.796520789464315 (-0.032848040262857925) | > avg_loss_1: 32.54905891418457 (+2.1542809804280587)  > EPOCH: 532/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:31:26)   --> TIME: 2023-10-20 05:31:40 -- STEP: 19/50 -- GLOBAL_STEP: 79620 | > loss_disc: 2.9044718742370605 (2.591515948897914) | > loss_disc_real_0: 0.21673983335494995 (0.18952514093957448) | > loss_disc_real_1: 0.25467926263809204 (0.22387903203305445) | > loss_disc_real_2: 0.24156486988067627 (0.24730800700030828) | > loss_disc_real_3: 0.24907761812210083 (0.265518467677267) | > loss_disc_real_4: 0.22755122184753418 (0.24413437827637322) | > loss_disc_real_5: 0.25665122270584106 (0.2520399023043482) | > loss_0: 2.9044718742370605 (2.591515948897914) | > grad_norm_0: tensor(1965.2278, device='cuda:0') (tensor(1482.4978, device='cuda:0')) | > loss_gen: 1.5548523664474487 (2.242032264408312) | > loss_kl: 0.5901182293891907 (0.8774543404579163) | > loss_feat: 0.2725926637649536 (4.347746478099572) | > loss_mel: 1.947722315788269 (17.600829613836186) | > loss_duration: 1.5559629201889038 (1.5124308749249107) | > loss_1: 5.921248435974121 (26.580493149004486) | > grad_norm_1: tensor(39290.8359, device='cuda:0') (tensor(34612.1953, device='cuda:0')) | > current_lr_0: 0.00011748188056984897 | > current_lr_1: 0.00011748188056984897 | > step_time: 0.5222 (0.49306947306582805) | > loader_time: 0.0247 (0.01979325947008635)  --> TIME: 2023-10-20 05:31:57 -- STEP: 49/50 -- GLOBAL_STEP: 79650 | > loss_disc: 3.020920753479004 (2.558491974460835) | > loss_disc_real_0: 0.20287510752677917 (0.15954777374103357) | > loss_disc_real_1: 0.23175382614135742 (0.23101056082060142) | > loss_disc_real_2: 0.18692073225975037 (0.23732468406004564) | > loss_disc_real_3: 0.26318588852882385 (0.2453551354000763) | > loss_disc_real_4: 0.36172983050346375 (0.2503111581032982) | > loss_disc_real_5: 0.2860109806060791 (0.23847852339397888) | > loss_0: 3.020920753479004 (2.558491974460835) | > grad_norm_0: tensor(1818.9948, device='cuda:0') (tensor(1229.4432, device='cuda:0')) | > loss_gen: 2.240795612335205 (2.293646364795918) | > loss_kl: 0.7158322930335999 (0.8874757484513887) | > loss_feat: 6.648361682891846 (5.38048408537799) | > loss_mel: 25.43330192565918 (20.0517407144819) | > loss_duration: 1.6513526439666748 (1.4737451806360362) | > loss_1: 36.68964385986328 (30.087091786520823) | > grad_norm_1: tensor(30040.9473, device='cuda:0') (tensor(38262.6992, device='cuda:0')) | > current_lr_0: 0.00011748188056984897 | > current_lr_1: 0.00011748188056984897 | > step_time: 0.5696 (0.5002850513068997) | > loader_time: 0.3815 (0.027208046037323616)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.771822214126587 (2.771822214126587) | > loss_disc_real_0: 0.31586170196533203 (0.31586170196533203) | > loss_disc_real_1: 0.2770186960697174 (0.2770186960697174) | > loss_disc_real_2: 0.26623132824897766 (0.26623132824897766) | > loss_disc_real_3: 0.23210889101028442 (0.23210889101028442) | > loss_disc_real_4: 0.1869998425245285 (0.1869998425245285) | > loss_disc_real_5: 0.15463894605636597 (0.15463894605636597) | > loss_0: 2.771822214126587 (2.771822214126587) | > loss_gen: 1.7821731567382812 (1.7821731567382812) | > loss_kl: 4.157818794250488 (4.157818794250488) | > loss_feat: 1.2696160078048706 (1.2696160078048706) | > loss_mel: 13.93625259399414 (13.93625259399414) | > loss_duration: 2.65354061126709 (2.65354061126709) | > loss_1: 23.799400329589844 (23.799400329589844)  --> STEP: 1 | > loss_disc: 2.5382485389709473 (2.5382485389709473) | > loss_disc_real_0: 0.37637439370155334 (0.37637439370155334) | > loss_disc_real_1: 0.3012401759624481 (0.3012401759624481) | > loss_disc_real_2: 0.17239995300769806 (0.17239995300769806) | > loss_disc_real_3: 0.4001811444759369 (0.4001811444759369) | > loss_disc_real_4: 0.1005990207195282 (0.1005990207195282) | > loss_disc_real_5: 0.1288011074066162 (0.1288011074066162) | > loss_0: 2.5382485389709473 (2.5382485389709473) | > loss_gen: 2.4290270805358887 (2.4290270805358887) | > loss_kl: 4.0665082931518555 (4.0665082931518555) | > loss_feat: 7.85956335067749 (7.85956335067749) | > loss_mel: 25.34267807006836 (25.34267807006836) | > loss_duration: 2.9286017417907715 (2.9286017417907715) | > loss_1: 42.62637710571289 (42.62637710571289)  --> STEP: 2 | > loss_disc: 3.0657706260681152 (2.8020095825195312) | > loss_disc_real_0: 0.47277575731277466 (0.424575075507164) | > loss_disc_real_1: 0.3881564438343048 (0.34469830989837646) | > loss_disc_real_2: 0.29886236786842346 (0.23563116043806076) | > loss_disc_real_3: 0.23995539546012878 (0.32006826996803284) | > loss_disc_real_4: 0.2539345324039459 (0.17726677656173706) | > loss_disc_real_5: 0.34480729699134827 (0.23680420219898224) | > loss_0: 3.0657706260681152 (2.8020095825195312) | > loss_gen: 2.786482810974121 (2.607754945755005) | > loss_kl: 4.380757808685303 (4.223633050918579) | > loss_feat: 5.803194999694824 (6.831379175186157) | > loss_mel: 26.554134368896484 (25.948406219482422) | > loss_duration: 2.906284809112549 (2.91744327545166) | > loss_1: 42.43085479736328 (42.528615951538086)  --> STEP: 3 | > loss_disc: 3.2331314086914062 (2.9457168579101562) | > loss_disc_real_0: 0.6066757440567017 (0.4852752983570099) | > loss_disc_real_1: 0.36868175864219666 (0.3526927928129832) | > loss_disc_real_2: 0.26684898138046265 (0.24603710075219473) | > loss_disc_real_3: 0.2448572814464569 (0.2949979404608409) | > loss_disc_real_4: 0.35943931341171265 (0.2379909555117289) | > loss_disc_real_5: 0.45518049597740173 (0.30959630012512207) | > loss_0: 3.2331314086914062 (2.9457168579101562) | > loss_gen: 2.8308119773864746 (2.6821072896321616) | > loss_kl: 2.2485570907592773 (3.565274397532145) | > loss_feat: 2.7489514350891113 (5.470569928487142) | > loss_mel: 21.302091598510742 (24.399634679158527) | > loss_duration: 2.69885516166687 (2.84458057085673) | > loss_1: 31.829267501831055 (38.96216646830241) --> EVAL PERFORMANCE | > avg_loader_time: 0.010356505711873373 (-0.0031037330627441406) | > avg_loss_disc: 2.9457168579101562 (+0.2776996294657388) | > avg_loss_disc_real_0: 0.4852752983570099 (+0.3332880462209383) | > avg_loss_disc_real_1: 0.3526927928129832 (+0.10704550643761954) | > avg_loss_disc_real_2: 0.24603710075219473 (-0.0076286792755126676) | > avg_loss_disc_real_3: 0.2949979404608409 (-0.060156395037968935) | > avg_loss_disc_real_4: 0.2379909555117289 (-0.012469540039698274) | > avg_loss_disc_real_5: 0.30959630012512207 (+0.14486748725175858) | > avg_loss_0: 2.9457168579101562 (+0.2776996294657388) | > avg_loss_gen: 2.6821072896321616 (+0.6563226381937666) | > avg_loss_kl: 3.565274397532145 (+0.04152957598368312) | > avg_loss_feat: 5.470569928487142 (+0.7807919184366856) | > avg_loss_mel: 24.399634679158527 (+4.886404037475586) | > avg_loss_duration: 2.84458057085673 (+0.04805978139241507) | > avg_loss_1: 38.96216646830241 (+6.413107554117836)  > EPOCH: 533/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:32:08)   --> TIME: 2023-10-20 05:32:26 -- STEP: 29/50 -- GLOBAL_STEP: 79680 | > loss_disc: 1.4515788555145264 (2.321067316778775) | > loss_disc_real_0: 0.04389549046754837 (0.15214669030031255) | > loss_disc_real_1: 0.04375534877181053 (0.21899653200445504) | > loss_disc_real_2: 0.07287369668483734 (0.2164321835955669) | > loss_disc_real_3: 0.10397124290466309 (0.21821262045153256) | > loss_disc_real_4: 0.06794779747724533 (0.22365313074712095) | > loss_disc_real_5: 0.05373254045844078 (0.19223879380472775) | > loss_0: 1.4515788555145264 (2.321067316778775) | > grad_norm_0: tensor(1063.6978, device='cuda:0') (tensor(946.3847, device='cuda:0')) | > loss_gen: 2.497356414794922 (2.4348826531706185) | > loss_kl: 0.7662310004234314 (0.8616517062844902) | > loss_feat: 11.832803726196289 (6.468228468607212) | > loss_mel: 23.063405990600586 (22.47340744528277) | > loss_duration: 1.4487502574920654 (1.4869223833084106) | > loss_1: 39.60854721069336 (33.72509257546786) | > grad_norm_1: tensor(91599.8438, device='cuda:0') (tensor(47146.0195, device='cuda:0')) | > current_lr_0: 0.00011736445007475426 | > current_lr_1: 0.00011736445007475426 | > step_time: 0.2857 (0.43153609078505945) | > loader_time: 0.0241 (0.009510040283203125)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8836669921875 (2.8836669921875) | > loss_disc_real_0: 0.21997764706611633 (0.21997764706611633) | > loss_disc_real_1: 0.22958651185035706 (0.22958651185035706) | > loss_disc_real_2: 0.3319852948188782 (0.3319852948188782) | > loss_disc_real_3: 0.24981370568275452 (0.24981370568275452) | > loss_disc_real_4: 0.3586696982383728 (0.3586696982383728) | > loss_disc_real_5: 0.30593305826187134 (0.30593305826187134) | > loss_0: 2.8836669921875 (2.8836669921875) | > loss_gen: 2.4147768020629883 (2.4147768020629883) | > loss_kl: 4.428181171417236 (4.428181171417236) | > loss_feat: 4.6687703132629395 (4.6687703132629395) | > loss_mel: 23.287628173828125 (23.287628173828125) | > loss_duration: 2.5761306285858154 (2.5761306285858154) | > loss_1: 37.375484466552734 (37.375484466552734)  --> STEP: 1 | > loss_disc: 2.5405936241149902 (2.5405936241149902) | > loss_disc_real_0: 0.16153237223625183 (0.16153237223625183) | > loss_disc_real_1: 0.16291359066963196 (0.16291359066963196) | > loss_disc_real_2: 0.298662930727005 (0.298662930727005) | > loss_disc_real_3: 0.30187109112739563 (0.30187109112739563) | > loss_disc_real_4: 0.298084020614624 (0.298084020614624) | > loss_disc_real_5: 0.5698890686035156 (0.5698890686035156) | > loss_0: 2.5405936241149902 (2.5405936241149902) | > loss_gen: 2.933823585510254 (2.933823585510254) | > loss_kl: 4.336821556091309 (4.336821556091309) | > loss_feat: 7.150105953216553 (7.150105953216553) | > loss_mel: 25.761558532714844 (25.761558532714844) | > loss_duration: 2.940702199935913 (2.940702199935913) | > loss_1: 43.123008728027344 (43.123008728027344)  --> STEP: 2 | > loss_disc: 2.9087934494018555 (2.724693536758423) | > loss_disc_real_0: 0.4520011842250824 (0.3067667782306671) | > loss_disc_real_1: 0.2821546792984009 (0.22253413498401642) | > loss_disc_real_2: 0.2446567416191101 (0.27165983617305756) | > loss_disc_real_3: 0.2601436972618103 (0.28100739419460297) | > loss_disc_real_4: 0.20298807322978973 (0.2505360469222069) | > loss_disc_real_5: 0.2445337325334549 (0.40721140056848526) | > loss_0: 2.9087934494018555 (2.724693536758423) | > loss_gen: 2.1765425205230713 (2.5551830530166626) | > loss_kl: 4.1247758865356445 (4.230798721313477) | > loss_feat: 0.878759503364563 (4.014432728290558) | > loss_mel: 18.487300872802734 (22.12442970275879) | > loss_duration: 2.8865694999694824 (2.9136358499526978) | > loss_1: 28.5539493560791 (35.83847904205322)  --> STEP: 3 | > loss_disc: 3.012899398803711 (2.8207621574401855) | > loss_disc_real_0: 0.6417090892791748 (0.41841421524683636) | > loss_disc_real_1: 0.2123602330684662 (0.21914283434549967) | > loss_disc_real_2: 0.24245457351207733 (0.26192474861939746) | > loss_disc_real_3: 0.2921839654445648 (0.28473291794459027) | > loss_disc_real_4: 0.22676853835582733 (0.24261354406674704) | > loss_disc_real_5: 0.5070947408676147 (0.44050584733486176) | > loss_0: 3.012899398803711 (2.8207621574401855) | > loss_gen: 2.702014207839966 (2.604126771291097) | > loss_kl: 2.0582754611968994 (3.5066243012746177) | > loss_feat: 4.1247735023498535 (4.051212986310323) | > loss_mel: 21.905851364135742 (22.051570256551106) | > loss_duration: 2.643606185913086 (2.8236259619394937) | > loss_1: 33.43452453613281 (35.037160873413086) --> EVAL PERFORMANCE | > avg_loader_time: 0.01015329360961914 (-0.00020321210225423235) | > avg_loss_disc: 2.8207621574401855 (-0.1249547004699707) | > avg_loss_disc_real_0: 0.41841421524683636 (-0.06686108311017352) | > avg_loss_disc_real_1: 0.21914283434549967 (-0.13354995846748355) | > avg_loss_disc_real_2: 0.26192474861939746 (+0.01588764786720273) | > avg_loss_disc_real_3: 0.28473291794459027 (-0.01026502251625061) | > avg_loss_disc_real_4: 0.24261354406674704 (+0.004622588555018126) | > avg_loss_disc_real_5: 0.44050584733486176 (+0.13090954720973969) | > avg_loss_0: 2.8207621574401855 (-0.1249547004699707) | > avg_loss_gen: 2.604126771291097 (-0.07798051834106445) | > avg_loss_kl: 3.5066243012746177 (-0.05865009625752737) | > avg_loss_feat: 4.051212986310323 (-1.4193569421768188) | > avg_loss_mel: 22.051570256551106 (-2.348064422607422) | > avg_loss_duration: 2.8236259619394937 (-0.020954608917236328) | > avg_loss_1: 35.037160873413086 (-3.9250055948893205)  > EPOCH: 534/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:32:47)   --> TIME: 2023-10-20 05:32:55 -- STEP: 9/50 -- GLOBAL_STEP: 79710 | > loss_disc: 2.8193552494049072 (2.24743205971188) | > loss_disc_real_0: 0.14598028361797333 (0.16164045822289255) | > loss_disc_real_1: 0.36364272236824036 (0.24070211003224054) | > loss_disc_real_2: 0.28420954942703247 (0.23501479470481476) | > loss_disc_real_3: 0.2576077878475189 (0.23617263014117876) | > loss_disc_real_4: 0.2780812680721283 (0.22873083874583244) | > loss_disc_real_5: 0.33171066641807556 (0.2640143339004781) | > loss_0: 2.8193552494049072 (2.24743205971188) | > grad_norm_0: tensor(1291.1134, device='cuda:0') (tensor(1189.9548, device='cuda:0')) | > loss_gen: 1.9890974760055542 (2.7625788980060153) | > loss_kl: 0.5531390905380249 (0.8811114761564467) | > loss_feat: 2.039799451828003 (6.905829403135511) | > loss_mel: 23.517728805541992 (23.766405317518448) | > loss_duration: 1.40190589427948 (1.4501862658394709) | > loss_1: 29.501670837402344 (35.76611116197374) | > grad_norm_1: tensor(7494.1943, device='cuda:0') (tensor(31836.1816, device='cuda:0')) | > current_lr_0: 0.00011724713695879165 | > current_lr_1: 0.00011724713695879165 | > step_time: 0.6177 (0.5131393273671468) | > loader_time: 0.018 (0.02027726173400879)  --> TIME: 2023-10-20 05:33:09 -- STEP: 39/50 -- GLOBAL_STEP: 79740 | > loss_disc: 3.070244312286377 (2.4672639278265147) | > loss_disc_real_0: 0.21067768335342407 (0.17338915169239044) | > loss_disc_real_1: 0.28318268060684204 (0.2404236058012033) | > loss_disc_real_2: 0.23243138194084167 (0.2350111880984444) | > loss_disc_real_3: 0.28490710258483887 (0.23759152692479965) | > loss_disc_real_4: 0.24539819359779358 (0.22895520275984055) | > loss_disc_real_5: 0.19616082310676575 (0.24868506584794092) | > loss_0: 3.070244312286377 (2.4672639278265147) | > grad_norm_0: tensor(775.0621, device='cuda:0') (tensor(761.7792, device='cuda:0')) | > loss_gen: 1.406663417816162 (2.3924312408153825) | > loss_kl: 0.35853737592697144 (0.90733885153746) | > loss_feat: 0.11398711055517197 (5.05895802543427) | > loss_mel: 1.9188990592956543 (21.02446886515006) | > loss_duration: 1.520475149154663 (1.4636936890773284) | > loss_1: 5.318562030792236 (30.846890584016457) | > grad_norm_1: tensor(21839.3906, device='cuda:0') (tensor(23117.8984, device='cuda:0')) | > current_lr_0: 0.00011724713695879165 | > current_lr_1: 0.00011724713695879165 | > step_time: 0.4314 (0.4546997363750751) | > loader_time: 0.0035 (0.01564600528814854)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.48811411857605 (2.48811411857605) | > loss_disc_real_0: 0.02978341281414032 (0.02978341281414032) | > loss_disc_real_1: 0.15533751249313354 (0.15533751249313354) | > loss_disc_real_2: 0.2648109793663025 (0.2648109793663025) | > loss_disc_real_3: 0.16405948996543884 (0.16405948996543884) | > loss_disc_real_4: 0.20760488510131836 (0.20760488510131836) | > loss_disc_real_5: 0.16625769436359406 (0.16625769436359406) | > loss_0: 2.48811411857605 (2.48811411857605) | > loss_gen: 1.9965578317642212 (1.9965578317642212) | > loss_kl: 3.8800408840179443 (3.8800408840179443) | > loss_feat: 9.867652893066406 (9.867652893066406) | > loss_mel: 25.916597366333008 (25.916597366333008) | > loss_duration: 2.661639451980591 (2.661639451980591) | > loss_1: 44.32249069213867 (44.32249069213867)  --> STEP: 1 | > loss_disc: 2.8946070671081543 (2.8946070671081543) | > loss_disc_real_0: 0.21733812987804413 (0.21733812987804413) | > loss_disc_real_1: 0.258948415517807 (0.258948415517807) | > loss_disc_real_2: 0.30789265036582947 (0.30789265036582947) | > loss_disc_real_3: 0.25728270411491394 (0.25728270411491394) | > loss_disc_real_4: 0.29956555366516113 (0.29956555366516113) | > loss_disc_real_5: 0.26039645075798035 (0.26039645075798035) | > loss_0: 2.8946070671081543 (2.8946070671081543) | > loss_gen: 1.7485389709472656 (1.7485389709472656) | > loss_kl: 4.766270637512207 (4.766270637512207) | > loss_feat: 0.37338241934776306 (0.37338241934776306) | > loss_mel: 13.018956184387207 (13.018956184387207) | > loss_duration: 2.976699113845825 (2.976699113845825) | > loss_1: 22.883848190307617 (22.883848190307617)  --> STEP: 2 | > loss_disc: 2.6226210594177246 (2.7586140632629395) | > loss_disc_real_0: 0.15811188519001007 (0.1877250075340271) | > loss_disc_real_1: 0.37844473123550415 (0.3186965733766556) | > loss_disc_real_2: 0.22292876243591309 (0.2654107064008713) | > loss_disc_real_3: 0.3891521394252777 (0.3232174217700958) | > loss_disc_real_4: 0.17448553442955017 (0.23702554404735565) | > loss_disc_real_5: 0.25042736530303955 (0.25541190803050995) | > loss_0: 2.6226210594177246 (2.7586140632629395) | > loss_gen: 2.539296865463257 (2.1439179182052612) | > loss_kl: 4.4032416343688965 (4.584756135940552) | > loss_feat: 8.757502555847168 (4.5654424875974655) | > loss_mel: 29.96127700805664 (21.490116596221924) | > loss_duration: 2.8766977787017822 (2.9266984462738037) | > loss_1: 48.53801345825195 (35.710930824279785)  --> STEP: 3 | > loss_disc: 2.9098968505859375 (2.809041659037272) | > loss_disc_real_0: 0.04499703645706177 (0.14014901717503866) | > loss_disc_real_1: 0.20163699984550476 (0.27967671553293866) | > loss_disc_real_2: 0.24291308224201202 (0.2579114983479182) | > loss_disc_real_3: 0.3593878149986267 (0.33527421951293945) | > loss_disc_real_4: 0.22703956067562103 (0.23369688292344412) | > loss_disc_real_5: 0.32563266158103943 (0.27881882588068646) | > loss_0: 2.9098968505859375 (2.809041659037272) | > loss_gen: 1.7120471000671387 (1.999960978825887) | > loss_kl: 2.102057456970215 (3.757189909617106) | > loss_feat: 4.696098327636719 (4.608994434277217) | > loss_mel: 20.98199462890625 (21.3207426071167) | > loss_duration: 2.7512753009796143 (2.8682240645090737) | > loss_1: 32.243473052978516 (34.55511156717936) --> EVAL PERFORMANCE | > avg_loader_time: 0.019962310791015625 (+0.009809017181396484) | > avg_loss_disc: 2.809041659037272 (-0.01172049840291356) | > avg_loss_disc_real_0: 0.14014901717503866 (-0.2782651980717977) | > avg_loss_disc_real_1: 0.27967671553293866 (+0.06053388118743899) | > avg_loss_disc_real_2: 0.2579114983479182 (-0.004013250271479252) | > avg_loss_disc_real_3: 0.33527421951293945 (+0.050541301568349184) | > avg_loss_disc_real_4: 0.23369688292344412 (-0.008916661143302917) | > avg_loss_disc_real_5: 0.27881882588068646 (-0.1616870214541753) | > avg_loss_0: 2.809041659037272 (-0.01172049840291356) | > avg_loss_gen: 1.999960978825887 (-0.6041657924652102) | > avg_loss_kl: 3.757189909617106 (+0.2505656083424883) | > avg_loss_feat: 4.608994434277217 (+0.5577814479668941) | > avg_loss_mel: 21.3207426071167 (-0.7308276494344064) | > avg_loss_duration: 2.8682240645090737 (+0.04459810256958008) | > avg_loss_1: 34.55511156717936 (-0.4820493062337263)  > EPOCH: 535/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:33:27)   --> TIME: 2023-10-20 05:33:42 -- STEP: 19/50 -- GLOBAL_STEP: 79770 | > loss_disc: 2.6953630447387695 (2.4965609876733077) | > loss_disc_real_0: 0.2196119725704193 (0.14698391152839912) | > loss_disc_real_1: 0.2964697778224945 (0.21391617467528895) | > loss_disc_real_2: 0.22238916158676147 (0.21175509642221427) | > loss_disc_real_3: 0.31152454018592834 (0.2353472937094538) | > loss_disc_real_4: 0.258865624666214 (0.23510319778793737) | > loss_disc_real_5: 0.37413737177848816 (0.2590591836916773) | > loss_0: 2.6953630447387695 (2.4965609876733077) | > grad_norm_0: tensor(769.0468, device='cuda:0') (tensor(601.3824, device='cuda:0')) | > loss_gen: 2.407078504562378 (2.2507417013770654) | > loss_kl: 1.3402447700500488 (0.980081497054351) | > loss_feat: 3.09181547164917 (5.5697169194096015) | > loss_mel: 18.580488204956055 (23.968527342143812) | > loss_duration: 1.6388983726501465 (1.495415631093477) | > loss_1: 27.05852508544922 (34.264483301263105) | > grad_norm_1: tensor(6960.0986, device='cuda:0') (tensor(16941.1719, device='cuda:0')) | > current_lr_0: 0.00011712994110463335 | > current_lr_1: 0.00011712994110463335 | > step_time: 0.6375 (0.5251798629760742) | > loader_time: 0.0241 (0.018456270820216128)  --> TIME: 2023-10-20 05:33:58 -- STEP: 49/50 -- GLOBAL_STEP: 79800 | > loss_disc: 2.3345947265625 (2.500564801449679) | > loss_disc_real_0: 0.0800429955124855 (0.15733076962737405) | > loss_disc_real_1: 0.20662985742092133 (0.2149023492725528) | > loss_disc_real_2: 0.213600292801857 (0.21806183560010123) | > loss_disc_real_3: 0.1808282881975174 (0.23638776378059873) | > loss_disc_real_4: 0.47842127084732056 (0.23684577871950305) | > loss_disc_real_5: 0.175065815448761 (0.26072546885329845) | > loss_0: 2.3345947265625 (2.500564801449679) | > grad_norm_0: tensor(431.8764, device='cuda:0') (tensor(513.8519, device='cuda:0')) | > loss_gen: 2.670060873031616 (2.2743755870935867) | > loss_kl: 0.6237700581550598 (0.8986345268025691) | > loss_feat: 8.009740829467773 (5.548902954069936) | > loss_mel: 27.383569717407227 (22.343750593613606) | > loss_duration: 1.5926896333694458 (1.4681094398303909) | > loss_1: 40.27983093261719 (32.53377305244913) | > grad_norm_1: tensor(4328.4048, device='cuda:0') (tensor(17355.2207, device='cuda:0')) | > current_lr_0: 0.00011712994110463335 | > current_lr_1: 0.00011712994110463335 | > step_time: 0.7018 (0.5233866243946309) | > loader_time: 0.3592 (0.025536298751831055)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2000539302825928 (3.2000539302825928) | > loss_disc_real_0: 0.29129600524902344 (0.29129600524902344) | > loss_disc_real_1: 0.2774016261100769 (0.2774016261100769) | > loss_disc_real_2: 0.207095205783844 (0.207095205783844) | > loss_disc_real_3: 0.2665063440799713 (0.2665063440799713) | > loss_disc_real_4: 0.23031656444072723 (0.23031656444072723) | > loss_disc_real_5: 0.3239784836769104 (0.3239784836769104) | > loss_0: 3.2000539302825928 (3.2000539302825928) | > loss_gen: 1.4936376810073853 (1.4936376810073853) | > loss_kl: 4.545163154602051 (4.545163154602051) | > loss_feat: 2.3211002349853516 (2.3211002349853516) | > loss_mel: 22.63702392578125 (22.63702392578125) | > loss_duration: 2.7754693031311035 (2.7754693031311035) | > loss_1: 33.772396087646484 (33.772396087646484)  --> STEP: 1 | > loss_disc: 3.2707016468048096 (3.2707016468048096) | > loss_disc_real_0: 0.45882463455200195 (0.45882463455200195) | > loss_disc_real_1: 0.36026808619499207 (0.36026808619499207) | > loss_disc_real_2: 0.3356024920940399 (0.3356024920940399) | > loss_disc_real_3: 0.2837269604206085 (0.2837269604206085) | > loss_disc_real_4: 0.3708183765411377 (0.3708183765411377) | > loss_disc_real_5: 0.3478500545024872 (0.3478500545024872) | > loss_0: 3.2707016468048096 (3.2707016468048096) | > loss_gen: 2.314627170562744 (2.314627170562744) | > loss_kl: 4.30231237411499 (4.30231237411499) | > loss_feat: 5.723521709442139 (5.723521709442139) | > loss_mel: 23.22982406616211 (23.22982406616211) | > loss_duration: 3.0863823890686035 (3.0863823890686035) | > loss_1: 38.65666961669922 (38.65666961669922)  --> STEP: 2 | > loss_disc: 2.945237398147583 (3.1079695224761963) | > loss_disc_real_0: 0.2911756634712219 (0.37500014901161194) | > loss_disc_real_1: 0.2770785391330719 (0.318673312664032) | > loss_disc_real_2: 0.26912081241607666 (0.3023616522550583) | > loss_disc_real_3: 0.24485155940055847 (0.2642892599105835) | > loss_disc_real_4: 0.3246074318885803 (0.347712904214859) | > loss_disc_real_5: 0.3015788197517395 (0.32471443712711334) | > loss_0: 2.945237398147583 (3.1079695224761963) | > loss_gen: 1.8046326637268066 (2.0596299171447754) | > loss_kl: 4.396097183227539 (4.349204778671265) | > loss_feat: 0.219985693693161 (2.97175370156765) | > loss_mel: 2.4133148193359375 (12.821569442749023) | > loss_duration: 2.8860785961151123 (2.986230492591858) | > loss_1: 11.720108985900879 (25.18838930130005)  --> STEP: 3 | > loss_disc: 2.9455313682556152 (3.053823471069336) | > loss_disc_real_0: 0.2912290394306183 (0.3470764458179474) | > loss_disc_real_1: 0.27709853649139404 (0.30481505393981934) | > loss_disc_real_2: 0.2690971791744232 (0.29127349456151325) | > loss_disc_real_3: 0.24485859274864197 (0.25781237085660297) | > loss_disc_real_4: 0.32466939091682434 (0.3400317331155141) | > loss_disc_real_5: 0.30165550112724304 (0.31702812512715656) | > loss_0: 2.9455313682556152 (3.053823471069336) | > loss_gen: 1.804502248764038 (1.974587361017863) | > loss_kl: 1.97783362865448 (3.55874772866567) | > loss_feat: 0.21925123035907745 (2.054252877831459) | > loss_mel: 2.940603256225586 (9.527914047241211) | > loss_duration: 2.762138843536377 (2.9115332762400308) | > loss_1: 9.704328536987305 (20.0270357131958) --> EVAL PERFORMANCE | > avg_loader_time: 0.007056713104248047 (-0.012905597686767578) | > avg_loss_disc: 3.053823471069336 (+0.24478181203206395) | > avg_loss_disc_real_0: 0.3470764458179474 (+0.20692742864290872) | > avg_loss_disc_real_1: 0.30481505393981934 (+0.025138338406880678) | > avg_loss_disc_real_2: 0.29127349456151325 (+0.033361996213595035) | > avg_loss_disc_real_3: 0.25781237085660297 (-0.07746184865633648) | > avg_loss_disc_real_4: 0.3400317331155141 (+0.10633485019206998) | > avg_loss_disc_real_5: 0.31702812512715656 (+0.038209299246470096) | > avg_loss_0: 3.053823471069336 (+0.24478181203206395) | > avg_loss_gen: 1.974587361017863 (-0.02537361780802394) | > avg_loss_kl: 3.55874772866567 (-0.19844218095143606) | > avg_loss_feat: 2.054252877831459 (-2.554741556445758) | > avg_loss_mel: 9.527914047241211 (-11.792828559875488) | > avg_loss_duration: 2.9115332762400308 (+0.04330921173095703) | > avg_loss_1: 20.0270357131958 (-14.528075853983559)  > EPOCH: 536/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:34:08)   --> TIME: 2023-10-20 05:34:27 -- STEP: 29/50 -- GLOBAL_STEP: 79830 | > loss_disc: 1.7757647037506104 (2.400398792891667) | > loss_disc_real_0: 0.18425318598747253 (0.14631474069480238) | > loss_disc_real_1: 0.2324656993150711 (0.22058716647583862) | > loss_disc_real_2: 0.14759409427642822 (0.2263380408543965) | > loss_disc_real_3: 0.12620912492275238 (0.2337526190897514) | > loss_disc_real_4: 0.09779316186904907 (0.22318573186880555) | > loss_disc_real_5: 0.06251288950443268 (0.243509783473765) | > loss_0: 1.7757647037506104 (2.400398792891667) | > grad_norm_0: tensor(460.8592, device='cuda:0') (tensor(561.9768, device='cuda:0')) | > loss_gen: 2.5806660652160645 (2.412286084273766) | > loss_kl: 0.9675015807151794 (0.9353724728370535) | > loss_feat: 6.8670783042907715 (5.80828384695382) | > loss_mel: 22.425390243530273 (22.760573124063427) | > loss_duration: 1.4891924858093262 (1.483638274258581) | > loss_1: 34.329830169677734 (33.40015371914568) | > grad_norm_1: tensor(9894.4688, device='cuda:0') (tensor(21237.7852, device='cuda:0')) | > current_lr_0: 0.00011701286239506882 | > current_lr_1: 0.00011701286239506882 | > step_time: 0.5867 (0.471597145343649) | > loader_time: 0.0135 (0.012430306138663456)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9398961067199707 (2.9398961067199707) | > loss_disc_real_0: 0.26049208641052246 (0.26049208641052246) | > loss_disc_real_1: 0.27502867579460144 (0.27502867579460144) | > loss_disc_real_2: 0.19963447749614716 (0.19963447749614716) | > loss_disc_real_3: 0.32591649889945984 (0.32591649889945984) | > loss_disc_real_4: 0.24935485422611237 (0.24935485422611237) | > loss_disc_real_5: 0.38700956106185913 (0.38700956106185913) | > loss_0: 2.9398961067199707 (2.9398961067199707) | > loss_gen: 2.0377163887023926 (2.0377163887023926) | > loss_kl: 3.8029978275299072 (3.8029978275299072) | > loss_feat: 6.27731466293335 (6.27731466293335) | > loss_mel: 22.322738647460938 (22.322738647460938) | > loss_duration: 2.5615997314453125 (2.5615997314453125) | > loss_1: 37.00236892700195 (37.00236892700195)  --> STEP: 1 | > loss_disc: 2.6280994415283203 (2.6280994415283203) | > loss_disc_real_0: 0.3765827417373657 (0.3765827417373657) | > loss_disc_real_1: 0.2437916249036789 (0.2437916249036789) | > loss_disc_real_2: 0.16133563220500946 (0.16133563220500946) | > loss_disc_real_3: 0.18603697419166565 (0.18603697419166565) | > loss_disc_real_4: 0.3721599876880646 (0.3721599876880646) | > loss_disc_real_5: 0.41740426421165466 (0.41740426421165466) | > loss_0: 2.6280994415283203 (2.6280994415283203) | > loss_gen: 3.080195903778076 (3.080195903778076) | > loss_kl: 3.6185359954833984 (3.6185359954833984) | > loss_feat: 5.9976115226745605 (5.9976115226745605) | > loss_mel: 25.931636810302734 (25.931636810302734) | > loss_duration: 2.9724035263061523 (2.9724035263061523) | > loss_1: 41.60038375854492 (41.60038375854492)  --> STEP: 2 | > loss_disc: 2.7079203128814697 (2.668009877204895) | > loss_disc_real_0: 0.2697524130344391 (0.3231675773859024) | > loss_disc_real_1: 0.14382979273796082 (0.19381070882081985) | > loss_disc_real_2: 0.09535880386829376 (0.1283472180366516) | > loss_disc_real_3: 0.25576359033584595 (0.2209002822637558) | > loss_disc_real_4: 0.2487480640411377 (0.31045402586460114) | > loss_disc_real_5: 0.3436027467250824 (0.38050350546836853) | > loss_0: 2.7079203128814697 (2.668009877204895) | > loss_gen: 3.0042781829833984 (3.0422370433807373) | > loss_kl: 4.166926860809326 (3.8927314281463623) | > loss_feat: 7.842318058013916 (6.919964790344238) | > loss_mel: 27.51885223388672 (26.725244522094727) | > loss_duration: 2.867180585861206 (2.919792056083679) | > loss_1: 45.399559020996094 (43.49997138977051)  --> STEP: 3 | > loss_disc: 3.047975540161133 (2.7946650981903076) | > loss_disc_real_0: 0.18003210425376892 (0.2754557530085246) | > loss_disc_real_1: 0.27975624799728394 (0.2224592218796412) | > loss_disc_real_2: 0.3080277740955353 (0.18824073672294617) | > loss_disc_real_3: 0.20740847289562225 (0.21640301247437796) | > loss_disc_real_4: 0.3455081880092621 (0.3221387465794881) | > loss_disc_real_5: 0.1653103530406952 (0.3087724546591441) | > loss_0: 3.047975540161133 (2.7946650981903076) | > loss_gen: 1.7265545129776 (2.603676199913025) | > loss_kl: 2.178560733795166 (3.3213411966959634) | > loss_feat: 3.2934188842773438 (5.7111161549886065) | > loss_mel: 21.67037010192871 (25.040286382039387) | > loss_duration: 2.759996175765991 (2.8665267626444497) | > loss_1: 31.6289005279541 (39.54294776916504) --> EVAL PERFORMANCE | > avg_loader_time: 0.011046886444091797 (+0.00399017333984375) | > avg_loss_disc: 2.7946650981903076 (-0.2591583728790283) | > avg_loss_disc_real_0: 0.2754557530085246 (-0.07162069280942279) | > avg_loss_disc_real_1: 0.2224592218796412 (-0.08235583206017813) | > avg_loss_disc_real_2: 0.18824073672294617 (-0.10303275783856708) | > avg_loss_disc_real_3: 0.21640301247437796 (-0.04140935838222501) | > avg_loss_disc_real_4: 0.3221387465794881 (-0.017892986536026) | > avg_loss_disc_real_5: 0.3087724546591441 (-0.008255670468012455) | > avg_loss_0: 2.7946650981903076 (-0.2591583728790283) | > avg_loss_gen: 2.603676199913025 (+0.6290888388951619) | > avg_loss_kl: 3.3213411966959634 (-0.2374065319697065) | > avg_loss_feat: 5.7111161549886065 (+3.6568632771571474) | > avg_loss_mel: 25.040286382039387 (+15.512372334798176) | > avg_loss_duration: 2.8665267626444497 (-0.045006513595581055) | > avg_loss_1: 39.54294776916504 (+19.51591205596924)  > EPOCH: 537/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:34:48)   --> TIME: 2023-10-20 05:34:56 -- STEP: 9/50 -- GLOBAL_STEP: 79860 | > loss_disc: 2.3481345176696777 (2.6519892745547824) | > loss_disc_real_0: 0.036734409630298615 (0.2194887896378835) | > loss_disc_real_1: 0.23217207193374634 (0.23053389456537035) | > loss_disc_real_2: 0.27513110637664795 (0.2219793846209844) | > loss_disc_real_3: 0.21703669428825378 (0.24481016976965797) | > loss_disc_real_4: 0.2628972828388214 (0.27386017909480465) | > loss_disc_real_5: 0.2523667812347412 (0.2530655616687404) | > loss_0: 2.3481345176696777 (2.6519892745547824) | > grad_norm_0: tensor(546.3287, device='cuda:0') (tensor(703.8890, device='cuda:0')) | > loss_gen: 2.2958621978759766 (2.247973402341207) | > loss_kl: 1.0373519659042358 (0.8966763483153449) | > loss_feat: 5.309902191162109 (5.562024172809389) | > loss_mel: 24.085357666015625 (21.797719558080036) | > loss_duration: 1.4411232471466064 (1.4794750875896878) | > loss_1: 34.16959762573242 (31.98386796315511) | > grad_norm_1: tensor(7232.2876, device='cuda:0') (tensor(19505.2637, device='cuda:0')) | > current_lr_0: 0.00011689590071300474 | > current_lr_1: 0.00011689590071300474 | > step_time: 0.5638 (0.5296440919240316) | > loader_time: 0.0248 (0.017844756444295246)  --> TIME: 2023-10-20 05:35:09 -- STEP: 39/50 -- GLOBAL_STEP: 79890 | > loss_disc: 3.0114684104919434 (2.5582210467411923) | > loss_disc_real_0: 0.2641497552394867 (0.18167851831859502) | > loss_disc_real_1: 0.26047757267951965 (0.22268705031810662) | > loss_disc_real_2: 0.22818270325660706 (0.23481862457134786) | > loss_disc_real_3: 0.26836028695106506 (0.24111449240874022) | > loss_disc_real_4: 0.26822173595428467 (0.23623102688445494) | > loss_disc_real_5: 0.2709176540374756 (0.25962897886832553) | > loss_0: 3.0114684104919434 (2.5582210467411923) | > grad_norm_0: tensor(225.1656, device='cuda:0') (tensor(609.3950, device='cuda:0')) | > loss_gen: 1.4851748943328857 (2.266278092677777) | > loss_kl: 0.7179944515228271 (0.8634172708560259) | > loss_feat: 0.03520381450653076 (4.7363286551374655) | > loss_mel: 1.4022728204727173 (21.164046354782887) | > loss_duration: 1.4776453971862793 (1.4639360690728211) | > loss_1: 5.11829137802124 (30.49400607133523) | > grad_norm_1: tensor(38375.6328, device='cuda:0') (tensor(17933.4238, device='cuda:0')) | > current_lr_0: 0.00011689590071300474 | > current_lr_1: 0.00011689590071300474 | > step_time: 0.2544 (0.4373032618791629) | > loader_time: 0.003 (0.013982803393632932)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.830829620361328 (2.830829620361328) | > loss_disc_real_0: 0.19594168663024902 (0.19594168663024902) | > loss_disc_real_1: 0.2638687491416931 (0.2638687491416931) | > loss_disc_real_2: 0.2530081272125244 (0.2530081272125244) | > loss_disc_real_3: 0.2659548819065094 (0.2659548819065094) | > loss_disc_real_4: 0.2754695415496826 (0.2754695415496826) | > loss_disc_real_5: 0.28156954050064087 (0.28156954050064087) | > loss_0: 2.830829620361328 (2.830829620361328) | > loss_gen: 1.7391973733901978 (1.7391973733901978) | > loss_kl: 3.0542831420898438 (3.0542831420898438) | > loss_feat: 0.4202878773212433 (0.4202878773212433) | > loss_mel: 13.548803329467773 (13.548803329467773) | > loss_duration: 2.7008657455444336 (2.7008657455444336) | > loss_1: 21.463436126708984 (21.463436126708984)  --> STEP: 1 | > loss_disc: 3.1633005142211914 (3.1633005142211914) | > loss_disc_real_0: 0.15214605629444122 (0.15214605629444122) | > loss_disc_real_1: 0.2682618498802185 (0.2682618498802185) | > loss_disc_real_2: 0.28098878264427185 (0.28098878264427185) | > loss_disc_real_3: 0.5084332823753357 (0.5084332823753357) | > loss_disc_real_4: 0.2222994565963745 (0.2222994565963745) | > loss_disc_real_5: 0.2963767945766449 (0.2963767945766449) | > loss_0: 3.1633005142211914 (3.1633005142211914) | > loss_gen: 1.8420023918151855 (1.8420023918151855) | > loss_kl: 3.8102850914001465 (3.8102850914001465) | > loss_feat: 6.505276679992676 (6.505276679992676) | > loss_mel: 23.219467163085938 (23.219467163085938) | > loss_duration: 3.02714204788208 (3.02714204788208) | > loss_1: 38.404170989990234 (38.404170989990234)  --> STEP: 2 | > loss_disc: 2.9850337505340576 (3.0741671323776245) | > loss_disc_real_0: 0.2257676124572754 (0.1889568343758583) | > loss_disc_real_1: 0.26279446482658386 (0.2655281573534012) | > loss_disc_real_2: 0.25467649102211 (0.2678326368331909) | > loss_disc_real_3: 0.2655048370361328 (0.38696905970573425) | > loss_disc_real_4: 0.27558156847953796 (0.24894051253795624) | > loss_disc_real_5: 0.28188368678092957 (0.28913024067878723) | > loss_0: 2.9850337505340576 (3.0741671323776245) | > loss_gen: 1.590163230895996 (1.7160828113555908) | > loss_kl: 4.223731994628906 (4.017008543014526) | > loss_feat: 0.06312794983386993 (3.284202314913273) | > loss_mel: 2.4784843921661377 (12.848975777626038) | > loss_duration: 2.8967344760894775 (2.961938261985779) | > loss_1: 11.252242088317871 (24.828206539154053)  --> STEP: 3 | > loss_disc: 2.7637526988983154 (2.970695654551188) | > loss_disc_real_0: 0.2445370852947235 (0.2074835846821467) | > loss_disc_real_1: 0.20406997203826904 (0.24504209558169046) | > loss_disc_real_2: 0.30335602164268494 (0.2796737651030223) | > loss_disc_real_3: 0.21524833142757416 (0.32972881694634754) | > loss_disc_real_4: 0.4399442672729492 (0.3126084307829539) | > loss_disc_real_5: 0.309718519449234 (0.29599300026893616) | > loss_0: 2.7637526988983154 (2.970695654551188) | > loss_gen: 2.327481269836426 (1.9198822975158691) | > loss_kl: 2.0335655212402344 (3.355860869089762) | > loss_feat: 3.6930673122406006 (3.4204906473557153) | > loss_mel: 20.0157413482666 (15.237897634506226) | > loss_duration: 2.822195529937744 (2.9153573513031006) | > loss_1: 30.89204978942871 (26.849487622578938) --> EVAL PERFORMANCE | > avg_loader_time: 0.013913393020629883 (+0.002866506576538086) | > avg_loss_disc: 2.970695654551188 (+0.17603055636088039) | > avg_loss_disc_real_0: 0.2074835846821467 (-0.0679721683263779) | > avg_loss_disc_real_1: 0.24504209558169046 (+0.022582873702049255) | > avg_loss_disc_real_2: 0.2796737651030223 (+0.09143302838007611) | > avg_loss_disc_real_3: 0.32972881694634754 (+0.11332580447196958) | > avg_loss_disc_real_4: 0.3126084307829539 (-0.009530315796534183) | > avg_loss_disc_real_5: 0.29599300026893616 (-0.012779454390207945) | > avg_loss_0: 2.970695654551188 (+0.17603055636088039) | > avg_loss_gen: 1.9198822975158691 (-0.6837939023971558) | > avg_loss_kl: 3.355860869089762 (+0.03451967239379883) | > avg_loss_feat: 3.4204906473557153 (-2.290625507632891) | > avg_loss_mel: 15.237897634506226 (-9.802388747533161) | > avg_loss_duration: 2.9153573513031006 (+0.048830588658650864) | > avg_loss_1: 26.849487622578938 (-12.693460146586101)  > EPOCH: 538/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:35:26)   --> TIME: 2023-10-20 05:35:43 -- STEP: 19/50 -- GLOBAL_STEP: 79920 | > loss_disc: 2.732583999633789 (2.29831464039652) | > loss_disc_real_0: 0.0926360934972763 (0.12427049189021713) | > loss_disc_real_1: 0.29868045449256897 (0.21237678786641673) | > loss_disc_real_2: 0.2382100522518158 (0.21525544516350092) | > loss_disc_real_3: 0.2370327115058899 (0.24794073157796734) | > loss_disc_real_4: 0.266902893781662 (0.20972037521239958) | > loss_disc_real_5: 0.3342305123806 (0.2060353393715463) | > loss_0: 2.732583999633789 (2.29831464039652) | > grad_norm_0: tensor(510.1449, device='cuda:0') (tensor(578.7273, device='cuda:0')) | > loss_gen: 1.9451816082000732 (2.4385439722161544) | > loss_kl: 0.5762919187545776 (0.9941217962064242) | > loss_feat: 1.605341911315918 (5.92230878064507) | > loss_mel: 20.57500648498535 (23.052890564266004) | > loss_duration: 1.6038596630096436 (1.5007395367873342) | > loss_1: 26.305681228637695 (33.908604646983896) | > grad_norm_1: tensor(9622.4492, device='cuda:0') (tensor(27270.6348, device='cuda:0')) | > current_lr_0: 0.00011677905594146475 | > current_lr_1: 0.00011677905594146475 | > step_time: 0.3409 (0.524599414122732) | > loader_time: 0.0247 (0.01631726716694079)  --> TIME: 2023-10-20 05:36:00 -- STEP: 49/50 -- GLOBAL_STEP: 79950 | > loss_disc: 2.3077616691589355 (2.3617886791423883) | > loss_disc_real_0: 0.18353743851184845 (0.13905824774077954) | > loss_disc_real_1: 0.33459559082984924 (0.22605503608985822) | > loss_disc_real_2: 0.2087763547897339 (0.21311133966914245) | > loss_disc_real_3: 0.30698835849761963 (0.23479535761384332) | > loss_disc_real_4: 0.1673603355884552 (0.21800301322827534) | > loss_disc_real_5: 0.2524251937866211 (0.22184913422988387) | > loss_0: 2.3077616691589355 (2.3617886791423883) | > grad_norm_0: tensor(629.6454, device='cuda:0') (tensor(625.9646, device='cuda:0')) | > loss_gen: 2.581909656524658 (2.4156982071545654) | > loss_kl: 0.674694299697876 (0.9292323504175458) | > loss_feat: 3.8107759952545166 (5.614310954564384) | > loss_mel: 23.402788162231445 (21.20485496034428) | > loss_duration: 1.5727894306182861 (1.4604393657372923) | > loss_1: 32.0429573059082 (31.624535998519587) | > grad_norm_1: tensor(5252.6235, device='cuda:0') (tensor(24840.1035, device='cuda:0')) | > current_lr_0: 0.00011677905594146475 | > current_lr_1: 0.00011677905594146475 | > step_time: 0.6791 (0.5139135973794118) | > loader_time: 0.4744 (0.027552998795801288)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8156373500823975 (2.8156373500823975) | > loss_disc_real_0: 0.283605694770813 (0.283605694770813) | > loss_disc_real_1: 0.26278257369995117 (0.26278257369995117) | > loss_disc_real_2: 0.2396681010723114 (0.2396681010723114) | > loss_disc_real_3: 0.36412936449050903 (0.36412936449050903) | > loss_disc_real_4: 0.23869451880455017 (0.23869451880455017) | > loss_disc_real_5: 0.22227135300636292 (0.22227135300636292) | > loss_0: 2.8156373500823975 (2.8156373500823975) | > loss_gen: 2.1611344814300537 (2.1611344814300537) | > loss_kl: 4.012080669403076 (4.012080669403076) | > loss_feat: 2.7770209312438965 (2.7770209312438965) | > loss_mel: 17.93280792236328 (17.93280792236328) | > loss_duration: 2.6528549194335938 (2.6528549194335938) | > loss_1: 29.535898208618164 (29.535898208618164)  --> STEP: 1 | > loss_disc: 2.52486515045166 (2.52486515045166) | > loss_disc_real_0: 0.33963924646377563 (0.33963924646377563) | > loss_disc_real_1: 0.21843057870864868 (0.21843057870864868) | > loss_disc_real_2: 0.3022995889186859 (0.3022995889186859) | > loss_disc_real_3: 0.13391542434692383 (0.13391542434692383) | > loss_disc_real_4: 0.3081274628639221 (0.3081274628639221) | > loss_disc_real_5: 0.29959458112716675 (0.29959458112716675) | > loss_0: 2.52486515045166 (2.52486515045166) | > loss_gen: 2.7630386352539062 (2.7630386352539062) | > loss_kl: 4.393255233764648 (4.393255233764648) | > loss_feat: 6.01893424987793 (6.01893424987793) | > loss_mel: 25.8265380859375 (25.8265380859375) | > loss_duration: 2.9392786026000977 (2.9392786026000977) | > loss_1: 41.941043853759766 (41.941043853759766)  --> STEP: 2 | > loss_disc: 1.8513445854187012 (2.1881048679351807) | > loss_disc_real_0: 0.06406909972429276 (0.2018541730940342) | > loss_disc_real_1: 0.21708916127681732 (0.217759869992733) | > loss_disc_real_2: 0.24775266647338867 (0.2750261276960373) | > loss_disc_real_3: 0.18020181357860565 (0.15705861896276474) | > loss_disc_real_4: 0.04657929763197899 (0.17735338024795055) | > loss_disc_real_5: 0.15838927030563354 (0.22899192571640015) | > loss_0: 1.8513445854187012 (2.1881048679351807) | > loss_gen: 2.681868553161621 (2.7224535942077637) | > loss_kl: 4.322824954986572 (4.35804009437561) | > loss_feat: 7.864679336547852 (6.941806793212891) | > loss_mel: 27.52664566040039 (26.676591873168945) | > loss_duration: 2.94008207321167 (2.939680337905884) | > loss_1: 45.33610153198242 (43.638572692871094)  --> STEP: 3 | > loss_disc: 2.9401469230651855 (2.4387855529785156) | > loss_disc_real_0: 0.2462855726480484 (0.21666463961203894) | > loss_disc_real_1: 0.27814432978630066 (0.23788802325725555) | > loss_disc_real_2: 0.3640950918197632 (0.3047157824039459) | > loss_disc_real_3: 0.28957638144493103 (0.20123120645682016) | > loss_disc_real_4: 0.2466413378715515 (0.2004493661224842) | > loss_disc_real_5: 0.24816341698169708 (0.23538242280483246) | > loss_0: 2.9401469230651855 (2.4387855529785156) | > loss_gen: 1.8903779983520508 (2.4450950622558594) | > loss_kl: 2.08679461479187 (3.600958267847697) | > loss_feat: 2.0880894660949707 (5.323901017506917) | > loss_mel: 17.65322494506836 (23.668802897135418) | > loss_duration: 2.7820816040039062 (2.8871474266052246) | > loss_1: 26.500568389892578 (37.92590459187826) --> EVAL PERFORMANCE | > avg_loader_time: 0.008854548136393229 (-0.005058844884236654) | > avg_loss_disc: 2.4387855529785156 (-0.5319101015726724) | > avg_loss_disc_real_0: 0.21666463961203894 (+0.00918105492989224) | > avg_loss_disc_real_1: 0.23788802325725555 (-0.007154072324434907) | > avg_loss_disc_real_2: 0.3047157824039459 (+0.025042017300923647) | > avg_loss_disc_real_3: 0.20123120645682016 (-0.12849761048952738) | > avg_loss_disc_real_4: 0.2004493661224842 (-0.11215906466046971) | > avg_loss_disc_real_5: 0.23538242280483246 (-0.0606105774641037) | > avg_loss_0: 2.4387855529785156 (-0.5319101015726724) | > avg_loss_gen: 2.4450950622558594 (+0.5252127647399902) | > avg_loss_kl: 3.600958267847697 (+0.24509739875793457) | > avg_loss_feat: 5.323901017506917 (+1.9034103701512017) | > avg_loss_mel: 23.668802897135418 (+8.430905262629192) | > avg_loss_duration: 2.8871474266052246 (-0.028209924697875977) | > avg_loss_1: 37.92590459187826 (+11.07641696929932)  > EPOCH: 539/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:36:11)   --> TIME: 2023-10-20 05:36:29 -- STEP: 29/50 -- GLOBAL_STEP: 79980 | > loss_disc: 2.919271230697632 (2.4127664113866873) | > loss_disc_real_0: 0.2501075863838196 (0.1445965869031076) | > loss_disc_real_1: 0.25325730443000793 (0.24213838898416223) | > loss_disc_real_2: 0.264813631772995 (0.24030248820781708) | > loss_disc_real_3: 0.23919929563999176 (0.2394916977861832) | > loss_disc_real_4: 0.2453123778104782 (0.23195543705389418) | > loss_disc_real_5: 0.23605042695999146 (0.22397976908190498) | > loss_0: 2.919271230697632 (2.4127664113866873) | > grad_norm_0: tensor(498.8725, device='cuda:0') (tensor(506.9159, device='cuda:0')) | > loss_gen: 1.598837971687317 (2.347472367615535) | > loss_kl: 0.9326794147491455 (0.8835967625009602) | > loss_feat: 0.25791603326797485 (5.409973601842749) | > loss_mel: 8.249183654785156 (20.741790360417856) | > loss_duration: 1.428553819656372 (1.4740585417583072) | > loss_1: 12.467170715332031 (30.856891516981452) | > grad_norm_1: tensor(15686.2617, device='cuda:0') (tensor(20766.7715, device='cuda:0')) | > current_lr_0: 0.00011666232796358952 | > current_lr_1: 0.00011666232796358952 | > step_time: 0.2733 (0.41468945864973394) | > loader_time: 0.0021 (0.006858340625105233)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7789721488952637 (2.7789721488952637) | > loss_disc_real_0: 0.3218362033367157 (0.3218362033367157) | > loss_disc_real_1: 0.2564317286014557 (0.2564317286014557) | > loss_disc_real_2: 0.21757690608501434 (0.21757690608501434) | > loss_disc_real_3: 0.2427511364221573 (0.2427511364221573) | > loss_disc_real_4: 0.2989536225795746 (0.2989536225795746) | > loss_disc_real_5: 0.30544179677963257 (0.30544179677963257) | > loss_0: 2.7789721488952637 (2.7789721488952637) | > loss_gen: 2.14900279045105 (2.14900279045105) | > loss_kl: 4.012655735015869 (4.012655735015869) | > loss_feat: 2.775934934616089 (2.775934934616089) | > loss_mel: 21.862340927124023 (21.862340927124023) | > loss_duration: 2.7170333862304688 (2.7170333862304688) | > loss_1: 33.5169677734375 (33.5169677734375)  --> STEP: 1 | > loss_disc: 2.7477355003356934 (2.7477355003356934) | > loss_disc_real_0: 0.29682886600494385 (0.29682886600494385) | > loss_disc_real_1: 0.19653300940990448 (0.19653300940990448) | > loss_disc_real_2: 0.15849512815475464 (0.15849512815475464) | > loss_disc_real_3: 0.2185303121805191 (0.2185303121805191) | > loss_disc_real_4: 0.28013744950294495 (0.28013744950294495) | > loss_disc_real_5: 0.3291521966457367 (0.3291521966457367) | > loss_0: 2.7477355003356934 (2.7477355003356934) | > loss_gen: 1.9951982498168945 (1.9951982498168945) | > loss_kl: 4.064086437225342 (4.064086437225342) | > loss_feat: 3.883444309234619 (3.883444309234619) | > loss_mel: 24.34021759033203 (24.34021759033203) | > loss_duration: 2.9516782760620117 (2.9516782760620117) | > loss_1: 37.23462677001953 (37.23462677001953)  --> STEP: 2 | > loss_disc: 2.851498603820801 (2.799617052078247) | > loss_disc_real_0: 0.3400174379348755 (0.31842315196990967) | > loss_disc_real_1: 0.3860262334346771 (0.2912796214222908) | > loss_disc_real_2: 0.3210194408893585 (0.23975728452205658) | > loss_disc_real_3: 0.333303302526474 (0.27591680735349655) | > loss_disc_real_4: 0.28572431206703186 (0.2829308807849884) | > loss_disc_real_5: 0.3142003118991852 (0.32167625427246094) | > loss_0: 2.851498603820801 (2.799617052078247) | > loss_gen: 2.4648549556732178 (2.230026602745056) | > loss_kl: 4.6131815910339355 (4.338634014129639) | > loss_feat: 2.70910382270813 (3.2962740659713745) | > loss_mel: 26.5963134765625 (25.468265533447266) | > loss_duration: 2.8374719619750977 (2.8945751190185547) | > loss_1: 39.220924377441406 (38.22777557373047)  --> STEP: 3 | > loss_disc: 2.043212413787842 (2.547482172648112) | > loss_disc_real_0: 0.12810784578323364 (0.254984716574351) | > loss_disc_real_1: 0.3456299602985382 (0.3093964010477066) | > loss_disc_real_2: 0.2904822528362274 (0.25666560729344684) | > loss_disc_real_3: 0.16451740264892578 (0.23878367245197296) | > loss_disc_real_4: 0.28153008222579956 (0.2824639479319255) | > loss_disc_real_5: 0.19011035561561584 (0.27782095472017926) | > loss_0: 2.043212413787842 (2.547482172648112) | > loss_gen: 3.1920089721679688 (2.550687392552694) | > loss_kl: 2.1600875854492188 (3.6124518712361655) | > loss_feat: 7.167736053466797 (4.586761395136516) | > loss_mel: 24.261140823364258 (25.065890630086262) | > loss_duration: 2.7266860008239746 (2.8386120796203613) | > loss_1: 39.507659912109375 (38.65440368652344) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_80000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.991330862045288 (2.658444344997406) | > loss_disc_real_0: 0.4346581697463989 (0.299903079867363) | > loss_disc_real_1: 0.16658252477645874 (0.27369293197989464) | > loss_disc_real_2: 0.29450738430023193 (0.2661260515451431) | > loss_disc_real_3: 0.28674790263175964 (0.25077472999691963) | > loss_disc_real_4: 0.4536556601524353 (0.3252618759870529) | > loss_disc_real_5: 0.4552111327648163 (0.3221684992313385) | > loss_0: 2.991330862045288 (2.658444344997406) | > loss_gen: 2.7543253898620605 (2.6015968918800354) | > loss_kl: 4.339730739593506 (3.7942715883255005) | > loss_feat: 5.356755256652832 (4.7792598605155945) | > loss_mel: 25.082592010498047 (25.07006597518921) | > loss_duration: 2.662015914916992 (2.794463038444519) | > loss_1: 40.19541931152344 (39.03965759277344)  --> STEP: 1 | > loss_disc: 2.0662553310394287 (2.5400065422058105) | > loss_disc_real_0: 0.16130976378917694 (0.27218441665172577) | > loss_disc_real_1: 0.08262316882610321 (0.23547897934913636) | > loss_disc_real_2: 0.1754268854856491 (0.24798621833324433) | > loss_disc_real_3: 0.176299050450325 (0.2358795940876007) | > loss_disc_real_4: 0.13324904441833496 (0.2868593096733093) | > loss_disc_real_5: 0.11328015476465225 (0.2803908303380013) | > loss_0: 2.0662553310394287 (2.5400065422058105) | > loss_gen: 2.526383638381958 (2.58655424118042) | > loss_kl: 4.3406877517700195 (3.903554821014404) | > loss_feat: 8.069169998168945 (5.437241888046264) | > loss_mel: 24.9392032623291 (25.04389343261719) | > loss_duration: 2.910511016845703 (2.8176726341247558) | > loss_1: 42.785953521728516 (39.788916778564456)  --> STEP: 2 | > loss_disc: 3.328094244003296 (2.6713544925053916) | > loss_disc_real_0: 0.18803715705871582 (0.2581598733862241) | > loss_disc_real_1: 0.23206576704978943 (0.23491011063257852) | > loss_disc_real_2: 0.22695407271385193 (0.24448086073001227) | > loss_disc_real_3: 0.16754364967346191 (0.22449027001857758) | > loss_disc_real_4: 0.2429642528295517 (0.2795434668660164) | > loss_disc_real_5: 0.20396794378757477 (0.2676536825795968) | > loss_0: 3.328094244003296 (2.6713544925053916) | > loss_gen: 1.3213896751403809 (2.3756934801737466) | > loss_kl: 4.434140205383301 (3.9919857184092202) | > loss_feat: 6.640646457672119 (5.637809316317241) | > loss_mel: 22.36679458618164 (24.597710291544598) | > loss_duration: 2.901653289794922 (2.8316694100697837) | > loss_1: 37.66462326049805 (39.43486785888672)  --> STEP: 3 | > loss_disc: 2.613041877746582 (2.6630241189684187) | > loss_disc_real_0: 0.2893005609512329 (0.2626085430383682) | > loss_disc_real_1: 0.3823018968105316 (0.25596608008657185) | > loss_disc_real_2: 0.2707034945487976 (0.24822695127555303) | > loss_disc_real_3: 0.2266567200422287 (0.22479976287909917) | > loss_disc_real_4: 0.30038750171661377 (0.28252118613038746) | > loss_disc_real_5: 0.3846950829029083 (0.28437388262578417) | > loss_0: 2.613041877746582 (2.6630241189684187) | > loss_gen: 3.116718053817749 (2.4815541335514615) | > loss_kl: 2.2064573764801025 (3.736910240990775) | > loss_feat: 4.7554426193237305 (5.511756931032453) | > loss_mel: 23.239696502685547 (24.40370832170759) | > loss_duration: 2.7753407955169678 (2.823622465133667) | > loss_1: 36.09365463256836 (38.957551683698384) --> EVAL PERFORMANCE | > avg_loader_time: 0.38334931646074566 (+0.3744947683243524) | > avg_loss_disc: 2.6630241189684187 (+0.2242385659899031) | > avg_loss_disc_real_0: 0.2626085430383682 (+0.045943903426329286) | > avg_loss_disc_real_1: 0.25596608008657185 (+0.01807805682931629) | > avg_loss_disc_real_2: 0.24822695127555303 (-0.0564888311283929) | > avg_loss_disc_real_3: 0.22479976287909917 (+0.023568556422279008) | > avg_loss_disc_real_4: 0.28252118613038746 (+0.08207182000790325) | > avg_loss_disc_real_5: 0.28437388262578417 (+0.04899145982095171) | > avg_loss_0: 2.6630241189684187 (+0.2242385659899031) | > avg_loss_gen: 2.4815541335514615 (+0.03645907129560211) | > avg_loss_kl: 3.736910240990775 (+0.13595197314307805) | > avg_loss_feat: 5.511756931032453 (+0.187855913525536) | > avg_loss_mel: 24.40370832170759 (+0.7349054245721724) | > avg_loss_duration: 2.823622465133667 (-0.06352496147155762) | > avg_loss_1: 38.957551683698384 (+1.0316470918201261)  > EPOCH: 540/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:36:56)   --> TIME: 2023-10-20 05:37:06 -- STEP: 9/50 -- GLOBAL_STEP: 80010 | > loss_disc: 1.3615355491638184 (2.1651484304004245) | > loss_disc_real_0: 0.06227811425924301 (0.15237516226867834) | > loss_disc_real_1: 0.24733002483844757 (0.24503349678383934) | > loss_disc_real_2: 0.15777766704559326 (0.2059023098813163) | > loss_disc_real_3: 0.14953148365020752 (0.22419597994950083) | > loss_disc_real_4: 0.06997417658567429 (0.19993465642134348) | > loss_disc_real_5: 0.09018401801586151 (0.20165952315760982) | > loss_0: 1.3615355491638184 (2.1651484304004245) | > grad_norm_0: tensor(261.9620, device='cuda:0') (tensor(462.6145, device='cuda:0')) | > loss_gen: 3.1300196647644043 (2.6955552101135254) | > loss_kl: 1.0822646617889404 (0.7251638637648689) | > loss_feat: 8.073244094848633 (6.67933792538113) | > loss_mel: 21.301502227783203 (22.567235734727646) | > loss_duration: 1.401607632637024 (1.4726927412880793) | > loss_1: 34.98863983154297 (34.139986250135635) | > grad_norm_1: tensor(9602.1719, device='cuda:0') (tensor(17542.5996, device='cuda:0')) | > current_lr_0: 0.00011654571666263642 | > current_lr_1: 0.00011654571666263642 | > step_time: 0.519 (0.4975404739379883) | > loader_time: 0.0247 (0.014886803097195096)  --> TIME: 2023-10-20 05:37:19 -- STEP: 39/50 -- GLOBAL_STEP: 80040 | > loss_disc: 2.993290662765503 (2.4323725394713573) | > loss_disc_real_0: 0.16941669583320618 (0.14804246544073793) | > loss_disc_real_1: 0.23064815998077393 (0.22943707612844613) | > loss_disc_real_2: 0.3184097707271576 (0.22263768105170664) | > loss_disc_real_3: 0.27209246158599854 (0.23959736726604974) | > loss_disc_real_4: 0.23523616790771484 (0.22496561505473578) | > loss_disc_real_5: 0.28637680411338806 (0.22360681431988874) | > loss_0: 2.993290662765503 (2.4323725394713573) | > grad_norm_0: tensor(295.4837, device='cuda:0') (tensor(546.5638, device='cuda:0')) | > loss_gen: 1.5326905250549316 (2.3476024652138734) | > loss_kl: 0.4224317967891693 (0.8893147248488206) | > loss_feat: 0.20938491821289062 (5.209434890021116) | > loss_mel: 2.3366429805755615 (20.967570090905213) | > loss_duration: 1.557509183883667 (1.4671945633032384) | > loss_1: 6.058659553527832 (30.881117038237754) | > grad_norm_1: tensor(18537., device='cuda:0') (tensor(23430.9043, device='cuda:0')) | > current_lr_0: 0.00011654571666263642 | > current_lr_1: 0.00011654571666263642 | > step_time: 0.5195 (0.44542879936022634) | > loader_time: 0.0246 (0.011800704858241936)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.178293228149414 (3.178293228149414) | > loss_disc_real_0: 0.5970627665519714 (0.5970627665519714) | > loss_disc_real_1: 0.2530105412006378 (0.2530105412006378) | > loss_disc_real_2: 0.38178178668022156 (0.38178178668022156) | > loss_disc_real_3: 0.29640480875968933 (0.29640480875968933) | > loss_disc_real_4: 0.5153350234031677 (0.5153350234031677) | > loss_disc_real_5: 0.5586763024330139 (0.5586763024330139) | > loss_0: 3.178293228149414 (3.178293228149414) | > loss_gen: 3.330998420715332 (3.330998420715332) | > loss_kl: 3.139091730117798 (3.139091730117798) | > loss_feat: 5.2219133377075195 (5.2219133377075195) | > loss_mel: 21.253108978271484 (21.253108978271484) | > loss_duration: 2.609934091567993 (2.609934091567993) | > loss_1: 35.55504608154297 (35.55504608154297)  --> STEP: 1 | > loss_disc: 3.041684150695801 (3.041684150695801) | > loss_disc_real_0: 0.21044379472732544 (0.21044379472732544) | > loss_disc_real_1: 0.22660678625106812 (0.22660678625106812) | > loss_disc_real_2: 0.33961644768714905 (0.33961644768714905) | > loss_disc_real_3: 0.4088335335254669 (0.4088335335254669) | > loss_disc_real_4: 0.48878908157348633 (0.48878908157348633) | > loss_disc_real_5: 0.4794946312904358 (0.4794946312904358) | > loss_0: 3.041684150695801 (3.041684150695801) | > loss_gen: 2.588984727859497 (2.588984727859497) | > loss_kl: 4.215916156768799 (4.215916156768799) | > loss_feat: 4.905989170074463 (4.905989170074463) | > loss_mel: 25.212261199951172 (25.212261199951172) | > loss_duration: 2.973106861114502 (2.973106861114502) | > loss_1: 39.89625930786133 (39.89625930786133)  --> STEP: 2 | > loss_disc: 2.582463026046753 (2.812073588371277) | > loss_disc_real_0: 0.36227816343307495 (0.2863609790802002) | > loss_disc_real_1: 0.26706114411354065 (0.24683396518230438) | > loss_disc_real_2: 0.14805954694747925 (0.24383799731731415) | > loss_disc_real_3: 0.40844056010246277 (0.40863704681396484) | > loss_disc_real_4: 0.22733010351657867 (0.3580595925450325) | > loss_disc_real_5: 0.35481974482536316 (0.4171571880578995) | > loss_0: 2.582463026046753 (2.812073588371277) | > loss_gen: 2.9617021083831787 (2.775343418121338) | > loss_kl: 4.732466220855713 (4.474191188812256) | > loss_feat: 7.01214599609375 (5.9590675830841064) | > loss_mel: 30.139339447021484 (27.675800323486328) | > loss_duration: 2.8536581993103027 (2.9133825302124023) | > loss_1: 47.69930648803711 (43.79778289794922)  --> STEP: 3 | > loss_disc: 2.011683464050293 (2.5452768802642822) | > loss_disc_real_0: 0.18223118782043457 (0.2516510486602783) | > loss_disc_real_1: 0.14006716012954712 (0.21124503016471863) | > loss_disc_real_2: 0.11962892860174179 (0.20243497441212335) | > loss_disc_real_3: 0.12344228476285934 (0.31357212613026303) | > loss_disc_real_4: 0.09465774893760681 (0.27025897800922394) | > loss_disc_real_5: 0.30745556950569153 (0.38058998187383014) | > loss_0: 2.011683464050293 (2.5452768802642822) | > loss_gen: 2.272768020629883 (2.607818285624186) | > loss_kl: 2.0579781532287598 (3.6687868436177573) | > loss_feat: 7.087186813354492 (6.335107326507568) | > loss_mel: 24.76227378845215 (26.70462481180827) | > loss_duration: 2.793198347091675 (2.8733211358388266) | > loss_1: 38.97340393066406 (42.189656575520836) --> EVAL PERFORMANCE | > avg_loader_time: 0.013292153676350912 (-0.37005716278439477) | > avg_loss_disc: 2.5452768802642822 (-0.1177472387041365) | > avg_loss_disc_real_0: 0.2516510486602783 (-0.010957494378089905) | > avg_loss_disc_real_1: 0.21124503016471863 (-0.04472104992185322) | > avg_loss_disc_real_2: 0.20243497441212335 (-0.04579197686342967) | > avg_loss_disc_real_3: 0.31357212613026303 (+0.08877236325116386) | > avg_loss_disc_real_4: 0.27025897800922394 (-0.01226220812116352) | > avg_loss_disc_real_5: 0.38058998187383014 (+0.09621609924804597) | > avg_loss_0: 2.5452768802642822 (-0.1177472387041365) | > avg_loss_gen: 2.607818285624186 (+0.12626415207272457) | > avg_loss_kl: 3.6687868436177573 (-0.06812339737301754) | > avg_loss_feat: 6.335107326507568 (+0.8233503954751153) | > avg_loss_mel: 26.70462481180827 (+2.300916490100679) | > avg_loss_duration: 2.8733211358388266 (+0.04969867070515965) | > avg_loss_1: 42.189656575520836 (+3.232104891822452)  > EPOCH: 541/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:37:33)   --> TIME: 2023-10-20 05:37:47 -- STEP: 19/50 -- GLOBAL_STEP: 80070 | > loss_disc: 3.1024370193481445 (2.2195295597377576) | > loss_disc_real_0: 0.3908568024635315 (0.15105653475773964) | > loss_disc_real_1: 0.35608986020088196 (0.21347334422171116) | > loss_disc_real_2: 0.31823301315307617 (0.21532702014634483) | > loss_disc_real_3: 0.24711300432682037 (0.2512421313869326) | > loss_disc_real_4: 0.3809259533882141 (0.2298819861913982) | > loss_disc_real_5: 0.3632625937461853 (0.23670985647722295) | > loss_0: 3.1024370193481445 (2.2195295597377576) | > grad_norm_0: tensor(870.3731, device='cuda:0') (tensor(547.8455, device='cuda:0')) | > loss_gen: 2.0619826316833496 (2.72772847351275) | > loss_kl: 0.8039070963859558 (0.8529459018456308) | > loss_feat: 2.9142422676086426 (6.720257280688537) | > loss_mel: 23.33641815185547 (23.803375219043932) | > loss_duration: 1.5969464778900146 (1.5172502178894847) | > loss_1: 30.713497161865234 (35.62155736120124) | > grad_norm_1: tensor(4456.3584, device='cuda:0') (tensor(19965.3340, device='cuda:0')) | > current_lr_0: 0.00011642922192197958 | > current_lr_1: 0.00011642922192197958 | > step_time: 0.2826 (0.49384770895305435) | > loader_time: 0.0254 (0.019744985981991415)  --> TIME: 2023-10-20 05:38:03 -- STEP: 49/50 -- GLOBAL_STEP: 80100 | > loss_disc: 2.019915819168091 (2.3475283968205356) | > loss_disc_real_0: 0.07013584673404694 (0.14790825838489197) | > loss_disc_real_1: 0.26908162236213684 (0.22114363780283197) | > loss_disc_real_2: 0.25662699341773987 (0.21762298340243952) | > loss_disc_real_3: 0.28810176253318787 (0.2505956092963413) | > loss_disc_real_4: 0.11497616022825241 (0.2322799034264623) | > loss_disc_real_5: 0.15813587605953217 (0.22820320001290162) | > loss_0: 2.019915819168091 (2.3475283968205356) | > grad_norm_0: tensor(237.3144, device='cuda:0') (tensor(566.6559, device='cuda:0')) | > loss_gen: 2.7081243991851807 (2.4772387840309924) | > loss_kl: 0.525330126285553 (0.8629751722423398) | > loss_feat: 6.251323699951172 (5.842411462749753) | > loss_mel: 23.543716430664062 (21.534397504767604) | > loss_duration: 1.5496761798858643 (1.4717792442866735) | > loss_1: 34.57817077636719 (32.18880253422018) | > grad_norm_1: tensor(21329.9629, device='cuda:0') (tensor(18964.4492, device='cuda:0')) | > current_lr_0: 0.00011642922192197958 | > current_lr_1: 0.00011642922192197958 | > step_time: 0.5851 (0.4984478707216224) | > loader_time: 0.3776 (0.026936107752274483)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9190564155578613 (2.9190564155578613) | > loss_disc_real_0: 0.1452992856502533 (0.1452992856502533) | > loss_disc_real_1: 0.2331872135400772 (0.2331872135400772) | > loss_disc_real_2: 0.2397794872522354 (0.2397794872522354) | > loss_disc_real_3: 0.21451009809970856 (0.21451009809970856) | > loss_disc_real_4: 0.28498443961143494 (0.28498443961143494) | > loss_disc_real_5: 0.31297779083251953 (0.31297779083251953) | > loss_0: 2.9190564155578613 (2.9190564155578613) | > loss_gen: 1.5247973203659058 (1.5247973203659058) | > loss_kl: 3.8040668964385986 (3.8040668964385986) | > loss_feat: 0.6253417134284973 (0.6253417134284973) | > loss_mel: 18.044328689575195 (18.044328689575195) | > loss_duration: 2.6448326110839844 (2.6448326110839844) | > loss_1: 26.643367767333984 (26.643367767333984)  --> STEP: 1 | > loss_disc: 1.778831124305725 (1.778831124305725) | > loss_disc_real_0: 0.11024675518274307 (0.11024675518274307) | > loss_disc_real_1: 0.17175915837287903 (0.17175915837287903) | > loss_disc_real_2: 0.1066853329539299 (0.1066853329539299) | > loss_disc_real_3: 0.274598091840744 (0.274598091840744) | > loss_disc_real_4: 0.09314315766096115 (0.09314315766096115) | > loss_disc_real_5: 0.032701198011636734 (0.032701198011636734) | > loss_0: 1.778831124305725 (1.778831124305725) | > loss_gen: 2.5110650062561035 (2.5110650062561035) | > loss_kl: 4.230205059051514 (4.230205059051514) | > loss_feat: 8.889228820800781 (8.889228820800781) | > loss_mel: 22.844051361083984 (22.844051361083984) | > loss_duration: 2.917210578918457 (2.917210578918457) | > loss_1: 41.391761779785156 (41.391761779785156)  --> STEP: 2 | > loss_disc: 2.9373576641082764 (2.3580943942070007) | > loss_disc_real_0: 0.1266734004020691 (0.11846007779240608) | > loss_disc_real_1: 0.23388923704624176 (0.2028241977095604) | > loss_disc_real_2: 0.2514958083629608 (0.17909057065844536) | > loss_disc_real_3: 0.2174280881881714 (0.2460130900144577) | > loss_disc_real_4: 0.27410584688186646 (0.1836245022714138) | > loss_disc_real_5: 0.3081306219100952 (0.17041590996086597) | > loss_0: 2.9373576641082764 (2.3580943942070007) | > loss_gen: 1.483965277671814 (1.9975151419639587) | > loss_kl: 4.728372097015381 (4.479288578033447) | > loss_feat: 0.4818915128707886 (4.685560166835785) | > loss_mel: 16.8156681060791 (19.829859733581543) | > loss_duration: 2.870609998703003 (2.89391028881073) | > loss_1: 26.38050651550293 (33.88613414764404)  --> STEP: 3 | > loss_disc: 3.2070679664611816 (2.6410855849583945) | > loss_disc_real_0: 0.17187455296516418 (0.13626490284999213) | > loss_disc_real_1: 0.30116966366767883 (0.23560601969559988) | > loss_disc_real_2: 0.40565943717956543 (0.2546135261654854) | > loss_disc_real_3: 0.28791671991348267 (0.259980966647466) | > loss_disc_real_4: 0.35774508118629456 (0.2416646952430407) | > loss_disc_real_5: 0.3985300660133362 (0.24645396197835603) | > loss_0: 3.2070679664611816 (2.6410855849583945) | > loss_gen: 1.8660521507263184 (1.9536941448847454) | > loss_kl: 1.8625601530075073 (3.6070457696914673) | > loss_feat: 1.7593599557876587 (3.7101600964864097) | > loss_mel: 19.82223129272461 (19.827316919962566) | > loss_duration: 2.742002487182617 (2.8432743549346924) | > loss_1: 28.05220603942871 (31.941491444905598) --> EVAL PERFORMANCE | > avg_loader_time: 0.005061626434326172 (-0.00823052724202474) | > avg_loss_disc: 2.6410855849583945 (+0.09580870469411229) | > avg_loss_disc_real_0: 0.13626490284999213 (-0.1153861458102862) | > avg_loss_disc_real_1: 0.23560601969559988 (+0.024360989530881255) | > avg_loss_disc_real_2: 0.2546135261654854 (+0.05217855175336203) | > avg_loss_disc_real_3: 0.259980966647466 (-0.053591159482797024) | > avg_loss_disc_real_4: 0.2416646952430407 (-0.028594282766183227) | > avg_loss_disc_real_5: 0.24645396197835603 (-0.1341360198954741) | > avg_loss_0: 2.6410855849583945 (+0.09580870469411229) | > avg_loss_gen: 1.9536941448847454 (-0.6541241407394407) | > avg_loss_kl: 3.6070457696914673 (-0.061741073926290024) | > avg_loss_feat: 3.7101600964864097 (-2.6249472300211587) | > avg_loss_mel: 19.827316919962566 (-6.877307891845703) | > avg_loss_duration: 2.8432743549346924 (-0.030046780904134263) | > avg_loss_1: 31.941491444905598 (-10.248165130615238)  > EPOCH: 542/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:38:15)   --> TIME: 2023-10-20 05:38:34 -- STEP: 29/50 -- GLOBAL_STEP: 80130 | > loss_disc: 2.2249698638916016 (2.330147722671772) | > loss_disc_real_0: 0.3491153419017792 (0.14475363993953014) | > loss_disc_real_1: 0.23033584654331207 (0.21259791956379495) | > loss_disc_real_2: 0.21929413080215454 (0.23328154495564) | > loss_disc_real_3: 0.18127140402793884 (0.24730102435268206) | > loss_disc_real_4: 0.1840512901544571 (0.2186434004969638) | > loss_disc_real_5: 0.11152662336826324 (0.2132957618812035) | > loss_0: 2.2249698638916016 (2.330147722671772) | > grad_norm_0: tensor(582.9000, device='cuda:0') (tensor(781.8190, device='cuda:0')) | > loss_gen: 2.47678279876709 (2.4799082690271836) | > loss_kl: 0.8005098700523376 (0.9194705522265928) | > loss_feat: 3.7390036582946777 (6.280507325098433) | > loss_mel: 22.722036361694336 (23.080323983883037) | > loss_duration: 1.4439252614974976 (1.4761228725827973) | > loss_1: 31.182260513305664 (34.23633263028901) | > grad_norm_1: tensor(6109.4258, device='cuda:0') (tensor(21219.7285, device='cuda:0')) | > current_lr_0: 0.0001163128436251097 | > current_lr_1: 0.0001163128436251097 | > step_time: 0.6536 (0.4862891312303214) | > loader_time: 0.0249 (0.01664032607242979)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.439495801925659 (2.439495801925659) | > loss_disc_real_0: 0.10642063617706299 (0.10642063617706299) | > loss_disc_real_1: 0.40983396768569946 (0.40983396768569946) | > loss_disc_real_2: 0.2880730926990509 (0.2880730926990509) | > loss_disc_real_3: 0.423358678817749 (0.423358678817749) | > loss_disc_real_4: 0.26053863763809204 (0.26053863763809204) | > loss_disc_real_5: 0.20971347391605377 (0.20971347391605377) | > loss_0: 2.439495801925659 (2.439495801925659) | > loss_gen: 2.9478421211242676 (2.9478421211242676) | > loss_kl: 3.860666036605835 (3.860666036605835) | > loss_feat: 6.329074382781982 (6.329074382781982) | > loss_mel: 24.422325134277344 (24.422325134277344) | > loss_duration: 2.6231322288513184 (2.6231322288513184) | > loss_1: 40.18303680419922 (40.18303680419922)  --> STEP: 1 | > loss_disc: 2.7246203422546387 (2.7246203422546387) | > loss_disc_real_0: 0.19270025193691254 (0.19270025193691254) | > loss_disc_real_1: 0.30247217416763306 (0.30247217416763306) | > loss_disc_real_2: 0.28354424238204956 (0.28354424238204956) | > loss_disc_real_3: 0.32037830352783203 (0.32037830352783203) | > loss_disc_real_4: 0.2511600852012634 (0.2511600852012634) | > loss_disc_real_5: 0.24066421389579773 (0.24066421389579773) | > loss_0: 2.7246203422546387 (2.7246203422546387) | > loss_gen: 2.176353693008423 (2.176353693008423) | > loss_kl: 3.8243353366851807 (3.8243353366851807) | > loss_feat: 4.921792030334473 (4.921792030334473) | > loss_mel: 23.841896057128906 (23.841896057128906) | > loss_duration: 2.9515786170959473 (2.9515786170959473) | > loss_1: 37.71595764160156 (37.71595764160156)  --> STEP: 2 | > loss_disc: 1.881129503250122 (2.3028749227523804) | > loss_disc_real_0: 0.08927293121814728 (0.1409865915775299) | > loss_disc_real_1: 0.1562010943889618 (0.22933663427829742) | > loss_disc_real_2: 0.28778567910194397 (0.28566496074199677) | > loss_disc_real_3: 0.1556864231824875 (0.23803236335515976) | > loss_disc_real_4: 0.17512930929660797 (0.2131446972489357) | > loss_disc_real_5: 0.18043842911720276 (0.21055132150650024) | > loss_0: 1.881129503250122 (2.3028749227523804) | > loss_gen: 2.7619502544403076 (2.4691519737243652) | > loss_kl: 4.065525054931641 (3.9449301958084106) | > loss_feat: 8.34334945678711 (6.632570743560791) | > loss_mel: 22.870681762695312 (23.35628890991211) | > loss_duration: 2.835757255554199 (2.8936679363250732) | > loss_1: 40.87726593017578 (39.29661178588867)  --> STEP: 3 | > loss_disc: 2.868025302886963 (2.491258382797241) | > loss_disc_real_0: 0.11343345046043396 (0.13180221120516458) | > loss_disc_real_1: 0.2744227349758148 (0.24436533451080322) | > loss_disc_real_2: 0.2968016564846039 (0.28937719265619916) | > loss_disc_real_3: 0.29544705152511597 (0.25717059274514514) | > loss_disc_real_4: 0.27480000257492065 (0.2336964656909307) | > loss_disc_real_5: 0.20852570235729218 (0.20987611512343088) | > loss_0: 2.868025302886963 (2.491258382797241) | > loss_gen: 1.6335679292678833 (2.190623958905538) | > loss_kl: 1.9259949922561646 (3.2719517946243286) | > loss_feat: 0.5038633346557617 (4.589668273925781) | > loss_mel: 14.237861633300781 (20.316813151041668) | > loss_duration: 2.75526762008667 (2.847534497578939) | > loss_1: 21.056556701660156 (33.216593424479164) --> EVAL PERFORMANCE | > avg_loader_time: 0.0065801143646240234 (+0.0015184879302978516) | > avg_loss_disc: 2.491258382797241 (-0.1498272021611533) | > avg_loss_disc_real_0: 0.13180221120516458 (-0.004462691644827543) | > avg_loss_disc_real_1: 0.24436533451080322 (+0.00875931481520334) | > avg_loss_disc_real_2: 0.28937719265619916 (+0.034763666490713774) | > avg_loss_disc_real_3: 0.25717059274514514 (-0.002810373902320862) | > avg_loss_disc_real_4: 0.2336964656909307 (-0.007968229552110018) | > avg_loss_disc_real_5: 0.20987611512343088 (-0.036577846854925156) | > avg_loss_0: 2.491258382797241 (-0.1498272021611533) | > avg_loss_gen: 2.190623958905538 (+0.23692981402079272) | > avg_loss_kl: 3.2719517946243286 (-0.33509397506713867) | > avg_loss_feat: 4.589668273925781 (+0.8795081774393716) | > avg_loss_mel: 20.316813151041668 (+0.48949623107910156) | > avg_loss_duration: 2.847534497578939 (+0.004260142644246567) | > avg_loss_1: 33.216593424479164 (+1.2751019795735665)  > EPOCH: 543/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:38:54)   --> TIME: 2023-10-20 05:39:03 -- STEP: 9/50 -- GLOBAL_STEP: 80160 | > loss_disc: 1.9838876724243164 (2.1921094391081066) | > loss_disc_real_0: 0.09050896763801575 (0.08684060401800606) | > loss_disc_real_1: 0.23903237283229828 (0.2357860960894161) | > loss_disc_real_2: 0.2966862916946411 (0.22213394277625614) | > loss_disc_real_3: 0.3167549967765808 (0.2273168195452955) | > loss_disc_real_4: 0.12363975495100021 (0.17840765809847248) | > loss_disc_real_5: 0.09186578541994095 (0.16346674640145567) | > loss_0: 1.9838876724243164 (2.1921094391081066) | > grad_norm_0: tensor(248.4317, device='cuda:0') (tensor(438.3593, device='cuda:0')) | > loss_gen: 2.777717351913452 (2.473220878177219) | > loss_kl: 0.7084758877754211 (1.0688111848301358) | > loss_feat: 6.262228488922119 (6.70316503279739) | > loss_mel: 22.775798797607422 (22.595670488145615) | > loss_duration: 1.3907321691513062 (1.45398830042945) | > loss_1: 33.91495132446289 (34.29485591252645) | > grad_norm_1: tensor(3266.6450, device='cuda:0') (tensor(22120.0332, device='cuda:0')) | > current_lr_0: 0.00011619658165563392 | > current_lr_1: 0.00011619658165563392 | > step_time: 0.5291 (0.5467377503712972) | > loader_time: 0.0041 (0.013927009370591905)  --> TIME: 2023-10-20 05:39:14 -- STEP: 39/50 -- GLOBAL_STEP: 80190 | > loss_disc: 2.1369824409484863 (2.471132623843658) | > loss_disc_real_0: 0.1527271568775177 (0.13717996809058464) | > loss_disc_real_1: 0.2412979006767273 (0.2364089045769129) | > loss_disc_real_2: 0.13877403736114502 (0.22351682931184774) | > loss_disc_real_3: 0.2594374418258667 (0.25290041942244923) | > loss_disc_real_4: 0.3367634415626526 (0.22003565762096491) | > loss_disc_real_5: 0.26364514231681824 (0.23168239164619875) | > loss_0: 2.1369824409484863 (2.471132623843658) | > grad_norm_0: tensor(592.0189, device='cuda:0') (tensor(578.6328, device='cuda:0')) | > loss_gen: 3.116955518722534 (2.3325712619683676) | > loss_kl: 0.8405309319496155 (0.9262045010542258) | > loss_feat: 4.476503372192383 (5.527327654071343) | > loss_mel: 16.367584228515625 (22.01158753419534) | > loss_duration: 1.4991822242736816 (1.4583841409438696) | > loss_1: 26.30075454711914 (32.25607523551354) | > grad_norm_1: tensor(34510.9180, device='cuda:0') (tensor(23928.0918, device='cuda:0')) | > current_lr_0: 0.00011619658165563392 | > current_lr_1: 0.00011619658165563392 | > step_time: 0.6757 (0.4074385838630872) | > loader_time: 0.0024 (0.007328418584970327)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3865559101104736 (2.3865559101104736) | > loss_disc_real_0: 0.16003009676933289 (0.16003009676933289) | > loss_disc_real_1: 0.41381946206092834 (0.41381946206092834) | > loss_disc_real_2: 0.19656582176685333 (0.19656582176685333) | > loss_disc_real_3: 0.2231130450963974 (0.2231130450963974) | > loss_disc_real_4: 0.26716122031211853 (0.26716122031211853) | > loss_disc_real_5: 0.2759397625923157 (0.2759397625923157) | > loss_0: 2.3865559101104736 (2.3865559101104736) | > loss_gen: 2.6903576850891113 (2.6903576850891113) | > loss_kl: 3.6954431533813477 (3.6954431533813477) | > loss_feat: 5.464739799499512 (5.464739799499512) | > loss_mel: 22.98638916015625 (22.98638916015625) | > loss_duration: 2.6423685550689697 (2.6423685550689697) | > loss_1: 37.47929763793945 (37.47929763793945)  --> STEP: 1 | > loss_disc: 2.5395283699035645 (2.5395283699035645) | > loss_disc_real_0: 0.33956170082092285 (0.33956170082092285) | > loss_disc_real_1: 0.18769465386867523 (0.18769465386867523) | > loss_disc_real_2: 0.16972127556800842 (0.16972127556800842) | > loss_disc_real_3: 0.14768879115581512 (0.14768879115581512) | > loss_disc_real_4: 0.15150921046733856 (0.15150921046733856) | > loss_disc_real_5: 0.12162475287914276 (0.12162475287914276) | > loss_0: 2.5395283699035645 (2.5395283699035645) | > loss_gen: 1.795974612236023 (1.795974612236023) | > loss_kl: 4.273274898529053 (4.273274898529053) | > loss_feat: 6.372925758361816 (6.372925758361816) | > loss_mel: 23.049436569213867 (23.049436569213867) | > loss_duration: 2.9507341384887695 (2.9507341384887695) | > loss_1: 38.442344665527344 (38.442344665527344)  --> STEP: 2 | > loss_disc: 1.5664349794387817 (2.052981674671173) | > loss_disc_real_0: 0.031727299094200134 (0.1856444999575615) | > loss_disc_real_1: 0.4387076199054718 (0.3132011368870735) | > loss_disc_real_2: 0.042271409183740616 (0.10599634237587452) | > loss_disc_real_3: 0.1876455396413803 (0.16766716539859772) | > loss_disc_real_4: 0.057610467076301575 (0.10455983877182007) | > loss_disc_real_5: 0.12505681812763214 (0.12334078550338745) | > loss_0: 1.5664349794387817 (2.052981674671173) | > loss_gen: 3.641561269760132 (2.7187679409980774) | > loss_kl: 4.291043281555176 (4.282159090042114) | > loss_feat: 10.091760635375977 (8.232343196868896) | > loss_mel: 28.939788818359375 (25.99461269378662) | > loss_duration: 2.9033281803131104 (2.92703115940094) | > loss_1: 49.86748123168945 (44.1549129486084)  --> STEP: 3 | > loss_disc: 2.6161437034606934 (2.2407023509343467) | > loss_disc_real_0: 0.19466304779052734 (0.1886506825685501) | > loss_disc_real_1: 0.35680750012397766 (0.3277365912993749) | > loss_disc_real_2: 0.2795674800872803 (0.16385338827967644) | > loss_disc_real_3: 0.27069199085235596 (0.2020087738831838) | > loss_disc_real_4: 0.12307387590408325 (0.11073118448257446) | > loss_disc_real_5: 0.1498657912015915 (0.13218245406945547) | > loss_0: 2.6161437034606934 (2.2407023509343467) | > loss_gen: 2.410731792449951 (2.6160892248153687) | > loss_kl: 1.5549851655960083 (3.3731011152267456) | > loss_feat: 5.255361557006836 (7.240015983581543) | > loss_mel: 25.53915023803711 (25.84279187520345) | > loss_duration: 2.7540030479431152 (2.8693551222483316) | > loss_1: 37.51422882080078 (41.941351572672524) --> EVAL PERFORMANCE | > avg_loader_time: 0.002498785654703776 (-0.004081328709920248) | > avg_loss_disc: 2.2407023509343467 (-0.25055603186289455) | > avg_loss_disc_real_0: 0.1886506825685501 (+0.05684847136338553) | > avg_loss_disc_real_1: 0.3277365912993749 (+0.08337125678857166) | > avg_loss_disc_real_2: 0.16385338827967644 (-0.12552380437652272) | > avg_loss_disc_real_3: 0.2020087738831838 (-0.05516181886196134) | > avg_loss_disc_real_4: 0.11073118448257446 (-0.12296528120835623) | > avg_loss_disc_real_5: 0.13218245406945547 (-0.0776936610539754) | > avg_loss_0: 2.2407023509343467 (-0.25055603186289455) | > avg_loss_gen: 2.6160892248153687 (+0.4254652659098306) | > avg_loss_kl: 3.3731011152267456 (+0.10114932060241699) | > avg_loss_feat: 7.240015983581543 (+2.6503477096557617) | > avg_loss_mel: 25.84279187520345 (+5.5259787241617815) | > avg_loss_duration: 2.8693551222483316 (+0.021820624669392608) | > avg_loss_1: 41.941351572672524 (+8.72475814819336)  > EPOCH: 544/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:39:31)   --> TIME: 2023-10-20 05:39:46 -- STEP: 19/50 -- GLOBAL_STEP: 80220 | > loss_disc: 2.635786771774292 (2.3824145354722677) | > loss_disc_real_0: 0.268858402967453 (0.17513789501237242) | > loss_disc_real_1: 0.32861408591270447 (0.23495969823316523) | > loss_disc_real_2: 0.18159843981266022 (0.23002816697484568) | > loss_disc_real_3: 0.2891252934932709 (0.223987752571702) | > loss_disc_real_4: 0.30653995275497437 (0.21186045665097863) | > loss_disc_real_5: 0.2744395136833191 (0.20987749609508013) | > loss_0: 2.635786771774292 (2.3824145354722677) | > grad_norm_0: tensor(1316.3639, device='cuda:0') (tensor(605.2697, device='cuda:0')) | > loss_gen: 2.3937292098999023 (2.424172802975303) | > loss_kl: 0.4727116823196411 (0.9995622729000292) | > loss_feat: 5.053849697113037 (5.383933486122834) | > loss_mel: 21.248685836791992 (19.56436814759907) | > loss_duration: 1.59456205368042 (1.498789712002403) | > loss_1: 30.763538360595703 (29.870826470224483) | > grad_norm_1: tensor(26875.9219, device='cuda:0') (tensor(35276.8438, device='cuda:0')) | > current_lr_0: 0.00011608043589727571 | > current_lr_1: 0.00011608043589727571 | > step_time: 0.4622 (0.5098923507489657) | > loader_time: 0.0255 (0.01772905650891755)  --> TIME: 2023-10-20 05:39:57 -- STEP: 49/50 -- GLOBAL_STEP: 80250 | > loss_disc: 2.1368658542633057 (2.4010268376798045) | > loss_disc_real_0: 0.24330788850784302 (0.17253316687990208) | > loss_disc_real_1: 0.17930907011032104 (0.22721026792209975) | > loss_disc_real_2: 0.18295852839946747 (0.217648214565552) | > loss_disc_real_3: 0.3481431007385254 (0.23320544144252733) | > loss_disc_real_4: 0.25331154465675354 (0.21071235991406198) | > loss_disc_real_5: 0.25080543756484985 (0.22037889874939406) | > loss_0: 2.1368658542633057 (2.4010268376798045) | > grad_norm_0: tensor(690.2886, device='cuda:0') (tensor(579.9456, device='cuda:0')) | > loss_gen: 2.9817075729370117 (2.403579668122895) | > loss_kl: 0.88714599609375 (0.8562471313135964) | > loss_feat: 5.048567771911621 (5.409167282017214) | > loss_mel: 25.73011016845703 (20.79090894971575) | > loss_duration: 1.5940057039260864 (1.4651737675374867) | > loss_1: 36.241539001464844 (30.925076572262512) | > grad_norm_1: tensor(29301.9961, device='cuda:0') (tensor(27325.4531, device='cuda:0')) | > current_lr_0: 0.00011608043589727571 | > current_lr_1: 0.00011608043589727571 | > step_time: 0.2527 (0.41033926788641484) | > loader_time: 0.3886 (0.019459203797943733)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6391695737838745 (1.6391695737838745) | > loss_disc_real_0: 0.04954228550195694 (0.04954228550195694) | > loss_disc_real_1: 0.15010353922843933 (0.15010353922843933) | > loss_disc_real_2: 0.42253220081329346 (0.42253220081329346) | > loss_disc_real_3: 0.27853432297706604 (0.27853432297706604) | > loss_disc_real_4: 0.07670648396015167 (0.07670648396015167) | > loss_disc_real_5: 0.06477094441652298 (0.06477094441652298) | > loss_0: 1.6391695737838745 (1.6391695737838745) | > loss_gen: 3.2771763801574707 (3.2771763801574707) | > loss_kl: 3.4880754947662354 (3.4880754947662354) | > loss_feat: 10.413578987121582 (10.413578987121582) | > loss_mel: 22.42762565612793 (22.42762565612793) | > loss_duration: 2.5781495571136475 (2.5781495571136475) | > loss_1: 42.18460464477539 (42.18460464477539)  --> STEP: 1 | > loss_disc: 3.0010430812835693 (3.0010430812835693) | > loss_disc_real_0: 0.4644996225833893 (0.4644996225833893) | > loss_disc_real_1: 0.27636095881462097 (0.27636095881462097) | > loss_disc_real_2: 0.2515495717525482 (0.2515495717525482) | > loss_disc_real_3: 0.30027055740356445 (0.30027055740356445) | > loss_disc_real_4: 0.22139061987400055 (0.22139061987400055) | > loss_disc_real_5: 0.2892308831214905 (0.2892308831214905) | > loss_0: 3.0010430812835693 (3.0010430812835693) | > loss_gen: 2.4279632568359375 (2.4279632568359375) | > loss_kl: 3.629499673843384 (3.629499673843384) | > loss_feat: 1.6323211193084717 (1.6323211193084717) | > loss_mel: 17.944229125976562 (17.944229125976562) | > loss_duration: 2.900751829147339 (2.900751829147339) | > loss_1: 28.534765243530273 (28.534765243530273)  --> STEP: 2 | > loss_disc: 2.448901653289795 (2.724972367286682) | > loss_disc_real_0: 0.22436362504959106 (0.3444316238164902) | > loss_disc_real_1: 0.22214870154857635 (0.24925483018159866) | > loss_disc_real_2: 0.23153814673423767 (0.24154385924339294) | > loss_disc_real_3: 0.3446018099784851 (0.3224361836910248) | > loss_disc_real_4: 0.3216075599193573 (0.2714990898966789) | > loss_disc_real_5: 0.3059639632701874 (0.29759742319583893) | > loss_0: 2.448901653289795 (2.724972367286682) | > loss_gen: 2.6086487770080566 (2.518306016921997) | > loss_kl: 4.225144386291504 (3.927322030067444) | > loss_feat: 2.9922497272491455 (2.3122854232788086) | > loss_mel: 25.04487419128418 (21.49455165863037) | > loss_duration: 2.91825795173645 (2.9095048904418945) | > loss_1: 37.78917694091797 (33.16197109222412)  --> STEP: 3 | > loss_disc: 2.9243297576904297 (2.791424830754598) | > loss_disc_real_0: 0.14814415574073792 (0.27900246779123944) | > loss_disc_real_1: 0.18362492322921753 (0.22737819453080496) | > loss_disc_real_2: 0.24083282053470612 (0.24130684634049734) | > loss_disc_real_3: 0.3482612669467926 (0.3310445447762807) | > loss_disc_real_4: 0.3191050589084625 (0.2873677462339401) | > loss_disc_real_5: 0.28579065203666687 (0.29366183280944824) | > loss_0: 2.9243297576904297 (2.791424830754598) | > loss_gen: 1.9331302642822266 (2.3232474327087402) | > loss_kl: 2.4312326908111572 (3.4286255836486816) | > loss_feat: 4.599827766418457 (3.0747995376586914) | > loss_mel: 20.413692474365234 (21.134265263875324) | > loss_duration: 2.6784956455230713 (2.8325018088022866) | > loss_1: 32.05637741088867 (32.793439865112305) --> EVAL PERFORMANCE | > avg_loader_time: 0.010621468226114908 (+0.008122682571411133) | > avg_loss_disc: 2.791424830754598 (+0.5507224798202515) | > avg_loss_disc_real_0: 0.27900246779123944 (+0.09035178522268933) | > avg_loss_disc_real_1: 0.22737819453080496 (-0.10035839676856992) | > avg_loss_disc_real_2: 0.24130684634049734 (+0.0774534580608209) | > avg_loss_disc_real_3: 0.3310445447762807 (+0.1290357708930969) | > avg_loss_disc_real_4: 0.2873677462339401 (+0.17663656175136566) | > avg_loss_disc_real_5: 0.29366183280944824 (+0.16147937873999277) | > avg_loss_0: 2.791424830754598 (+0.5507224798202515) | > avg_loss_gen: 2.3232474327087402 (-0.2928417921066284) | > avg_loss_kl: 3.4286255836486816 (+0.055524468421936035) | > avg_loss_feat: 3.0747995376586914 (-4.165216445922852) | > avg_loss_mel: 21.134265263875324 (-4.708526611328125) | > avg_loss_duration: 2.8325018088022866 (-0.03685331344604492) | > avg_loss_1: 32.793439865112305 (-9.147911707560219)  > EPOCH: 545/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:40:08)   --> TIME: 2023-10-20 05:40:23 -- STEP: 29/50 -- GLOBAL_STEP: 80280 | > loss_disc: 2.940965175628662 (2.5070112820329338) | > loss_disc_real_0: 0.2168015092611313 (0.17699111111719032) | > loss_disc_real_1: 0.2007005363702774 (0.24412367621372486) | > loss_disc_real_2: 0.21220673620700836 (0.24392517257867188) | > loss_disc_real_3: 0.22829794883728027 (0.25042106333220826) | > loss_disc_real_4: 0.24258817732334137 (0.21647877599401721) | > loss_disc_real_5: 0.3278188705444336 (0.20992589934632697) | > loss_0: 2.940965175628662 (2.5070112820329338) | > grad_norm_0: tensor(394.9368, device='cuda:0') (tensor(529.8773, device='cuda:0')) | > loss_gen: 1.6939728260040283 (2.312426435536351) | > loss_kl: 0.7274500131607056 (0.908606160303642) | > loss_feat: 5.596467971801758 (4.761131299210007) | > loss_mel: 18.07077407836914 (20.213377187991963) | > loss_duration: 1.4662421941757202 (1.4718023990762645) | > loss_1: 27.554906845092773 (29.667343221861742) | > grad_norm_1: tensor(13342.1992, device='cuda:0') (tensor(20732.8691, device='cuda:0')) | > current_lr_0: 0.00011596440623387479 | > current_lr_1: 0.00011596440623387479 | > step_time: 0.3686 (0.33093886539853856) | > loader_time: 0.0021 (0.006351635373871902)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7238073348999023 (2.7238073348999023) | > loss_disc_real_0: 0.2338242530822754 (0.2338242530822754) | > loss_disc_real_1: 0.22950178384780884 (0.22950178384780884) | > loss_disc_real_2: 0.301889032125473 (0.301889032125473) | > loss_disc_real_3: 0.23329821228981018 (0.23329821228981018) | > loss_disc_real_4: 0.32535427808761597 (0.32535427808761597) | > loss_disc_real_5: 0.3898048996925354 (0.3898048996925354) | > loss_0: 2.7238073348999023 (2.7238073348999023) | > loss_gen: 2.4228785037994385 (2.4228785037994385) | > loss_kl: 3.2426564693450928 (3.2426564693450928) | > loss_feat: 4.808172702789307 (4.808172702789307) | > loss_mel: 22.325260162353516 (22.325260162353516) | > loss_duration: 2.5664894580841064 (2.5664894580841064) | > loss_1: 35.36545944213867 (35.36545944213867)  --> STEP: 1 | > loss_disc: 2.933563709259033 (2.933563709259033) | > loss_disc_real_0: 0.24840590357780457 (0.24840590357780457) | > loss_disc_real_1: 0.27675098180770874 (0.27675098180770874) | > loss_disc_real_2: 0.2696394622325897 (0.2696394622325897) | > loss_disc_real_3: 0.283358097076416 (0.283358097076416) | > loss_disc_real_4: 0.3341590166091919 (0.3341590166091919) | > loss_disc_real_5: 0.2471184879541397 (0.2471184879541397) | > loss_0: 2.933563709259033 (2.933563709259033) | > loss_gen: 1.761947751045227 (1.761947751045227) | > loss_kl: 4.144213676452637 (4.144213676452637) | > loss_feat: 0.28502726554870605 (0.28502726554870605) | > loss_mel: 13.582554817199707 (13.582554817199707) | > loss_duration: 2.9159369468688965 (2.9159369468688965) | > loss_1: 22.689680099487305 (22.689680099487305)  --> STEP: 2 | > loss_disc: 2.1504580974578857 (2.5420109033584595) | > loss_disc_real_0: 0.21097832918167114 (0.22969211637973785) | > loss_disc_real_1: 0.18995846807956696 (0.23335472494363785) | > loss_disc_real_2: 0.14398814737796783 (0.20681380480527878) | > loss_disc_real_3: 0.24857407808303833 (0.2659660875797272) | > loss_disc_real_4: 0.05798806995153427 (0.19607354328036308) | > loss_disc_real_5: 0.06308265030384064 (0.15510056912899017) | > loss_0: 2.1504580974578857 (2.5420109033584595) | > loss_gen: 2.0960941314697266 (1.9290209412574768) | > loss_kl: 4.63176965713501 (4.387991666793823) | > loss_feat: 9.308716773986816 (4.796872019767761) | > loss_mel: 26.809215545654297 (20.195885181427002) | > loss_duration: 2.761969566345215 (2.8389532566070557) | > loss_1: 45.607765197753906 (34.148722648620605)  --> STEP: 3 | > loss_disc: 2.9913222789764404 (2.6917813618977866) | > loss_disc_real_0: 0.23682373762130737 (0.23206932346026102) | > loss_disc_real_1: 0.2768208384513855 (0.2478434294462204) | > loss_disc_real_2: 0.2675864100456238 (0.22707133988539377) | > loss_disc_real_3: 0.2831774353981018 (0.27170320351918537) | > loss_disc_real_4: 0.3331652879714966 (0.2417707915107409) | > loss_disc_real_5: 0.24675175547599792 (0.18565096457799277) | > loss_0: 2.9913222789764404 (2.6917813618977866) | > loss_gen: 1.6679770946502686 (1.8420063257217407) | > loss_kl: 2.2882370948791504 (3.688073476155599) | > loss_feat: 0.13759766519069672 (3.243780568242073) | > loss_mel: 3.1449313163757324 (14.512233893076578) | > loss_duration: 2.690715789794922 (2.7895407676696777) | > loss_1: 9.929458618164062 (26.075634638468426) --> EVAL PERFORMANCE | > avg_loader_time: 0.009715557098388672 (-0.0009059111277262364) | > avg_loss_disc: 2.6917813618977866 (-0.09964346885681152) | > avg_loss_disc_real_0: 0.23206932346026102 (-0.04693314433097842) | > avg_loss_disc_real_1: 0.2478434294462204 (+0.020465234915415437) | > avg_loss_disc_real_2: 0.22707133988539377 (-0.014235506455103575) | > avg_loss_disc_real_3: 0.27170320351918537 (-0.05934134125709534) | > avg_loss_disc_real_4: 0.2417707915107409 (-0.04559695472319922) | > avg_loss_disc_real_5: 0.18565096457799277 (-0.10801086823145548) | > avg_loss_0: 2.6917813618977866 (-0.09964346885681152) | > avg_loss_gen: 1.8420063257217407 (-0.4812411069869995) | > avg_loss_kl: 3.688073476155599 (+0.25944789250691747) | > avg_loss_feat: 3.243780568242073 (+0.16898103058338165) | > avg_loss_mel: 14.512233893076578 (-6.622031370798746) | > avg_loss_duration: 2.7895407676696777 (-0.0429610411326089) | > avg_loss_1: 26.075634638468426 (-6.717805226643879)  > EPOCH: 546/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:40:47)   --> TIME: 2023-10-20 05:40:56 -- STEP: 9/50 -- GLOBAL_STEP: 80310 | > loss_disc: 2.70878529548645 (2.344851189189487) | > loss_disc_real_0: 0.16352225840091705 (0.13472265688081583) | > loss_disc_real_1: 0.2919708490371704 (0.22109937171141306) | > loss_disc_real_2: 0.45342180132865906 (0.24837794734372032) | > loss_disc_real_3: 0.3152971565723419 (0.24333571704725424) | > loss_disc_real_4: 0.5414801836013794 (0.2747648217611843) | > loss_disc_real_5: 0.3497825562953949 (0.22745846543047163) | > loss_0: 2.70878529548645 (2.344851189189487) | > grad_norm_0: tensor(689.3075, device='cuda:0') (tensor(488.6669, device='cuda:0')) | > loss_gen: 2.983222246170044 (2.50368070602417) | > loss_kl: 0.7018223404884338 (0.8407780329386393) | > loss_feat: 3.9153332710266113 (6.077199286884731) | > loss_mel: 20.287586212158203 (22.584262635972763) | > loss_duration: 1.3909354209899902 (1.4638033972846136) | > loss_1: 29.278900146484375 (33.46972465515137) | > grad_norm_1: tensor(18725.7246, device='cuda:0') (tensor(15464.7432, device='cuda:0')) | > current_lr_0: 0.00011584849254938697 | > current_lr_1: 0.00011584849254938697 | > step_time: 0.656 (0.5136576493581136) | > loader_time: 0.0055 (0.020001067055596247)  --> TIME: 2023-10-20 05:41:11 -- STEP: 39/50 -- GLOBAL_STEP: 80340 | > loss_disc: 2.9870519638061523 (2.5485569697159987) | > loss_disc_real_0: 0.22571441531181335 (0.1768801733970833) | > loss_disc_real_1: 0.23182900249958038 (0.2313601974493418) | > loss_disc_real_2: 0.27898430824279785 (0.23583993850610194) | > loss_disc_real_3: 0.2638085186481476 (0.23554176039611682) | > loss_disc_real_4: 0.24271182715892792 (0.26780423474235404) | > loss_disc_real_5: 0.2505369186401367 (0.2294311363918659) | > loss_0: 2.9870519638061523 (2.5485569697159987) | > grad_norm_0: tensor(137.2913, device='cuda:0') (tensor(737.7271, device='cuda:0')) | > loss_gen: 1.5566926002502441 (2.2635093010388894) | > loss_kl: 0.6028113961219788 (0.8511232764292986) | > loss_feat: 0.05099264159798622 (4.678835542442707) | > loss_mel: 1.6598000526428223 (20.535007733565113) | > loss_duration: 1.4959638118743896 (1.4599585961072872) | > loss_1: 5.366260528564453 (29.788434493236057) | > grad_norm_1: tensor(41087.0469, device='cuda:0') (tensor(20037.9824, device='cuda:0')) | > current_lr_0: 0.00011584849254938697 | > current_lr_1: 0.00011584849254938697 | > step_time: 0.2644 (0.4981992122454521) | > loader_time: 0.0034 (0.017498267002594776)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.414191484451294 (2.414191484451294) | > loss_disc_real_0: 0.19059327244758606 (0.19059327244758606) | > loss_disc_real_1: 0.1992199569940567 (0.1992199569940567) | > loss_disc_real_2: 0.2633630335330963 (0.2633630335330963) | > loss_disc_real_3: 0.26502615213394165 (0.26502615213394165) | > loss_disc_real_4: 0.1523466259241104 (0.1523466259241104) | > loss_disc_real_5: 0.25717678666114807 (0.25717678666114807) | > loss_0: 2.414191484451294 (2.414191484451294) | > loss_gen: 2.7864229679107666 (2.7864229679107666) | > loss_kl: 4.369936466217041 (4.369936466217041) | > loss_feat: 7.7569451332092285 (7.7569451332092285) | > loss_mel: 22.817962646484375 (22.817962646484375) | > loss_duration: 2.65964937210083 (2.65964937210083) | > loss_1: 40.39091491699219 (40.39091491699219)  --> STEP: 1 | > loss_disc: 2.799659252166748 (2.799659252166748) | > loss_disc_real_0: 0.2798585295677185 (0.2798585295677185) | > loss_disc_real_1: 0.4029431939125061 (0.4029431939125061) | > loss_disc_real_2: 0.313582181930542 (0.313582181930542) | > loss_disc_real_3: 0.31073594093322754 (0.31073594093322754) | > loss_disc_real_4: 0.3983188569545746 (0.3983188569545746) | > loss_disc_real_5: 0.23871992528438568 (0.23871992528438568) | > loss_0: 2.799659252166748 (2.799659252166748) | > loss_gen: 2.72845458984375 (2.72845458984375) | > loss_kl: 4.412713050842285 (4.412713050842285) | > loss_feat: 2.96583890914917 (2.96583890914917) | > loss_mel: 21.609098434448242 (21.609098434448242) | > loss_duration: 3.016040563583374 (3.016040563583374) | > loss_1: 34.73214340209961 (34.73214340209961)  --> STEP: 2 | > loss_disc: 3.374647617340088 (3.087153434753418) | > loss_disc_real_0: 0.3858552873134613 (0.3328569084405899) | > loss_disc_real_1: 0.25425249338150024 (0.3285978436470032) | > loss_disc_real_2: 0.4033811688423157 (0.35848167538642883) | > loss_disc_real_3: 0.45018425583839417 (0.38046009838581085) | > loss_disc_real_4: 0.3983127474784851 (0.39831580221652985) | > loss_disc_real_5: 0.38680049777030945 (0.31276021152734756) | > loss_0: 3.374647617340088 (3.087153434753418) | > loss_gen: 2.723289966583252 (2.725872278213501) | > loss_kl: 4.197887897491455 (4.30530047416687) | > loss_feat: 7.65479850769043 (5.3103187084198) | > loss_mel: 25.542438507080078 (23.57576847076416) | > loss_duration: 2.8660123348236084 (2.941026449203491) | > loss_1: 42.98442840576172 (38.858285903930664)  --> STEP: 3 | > loss_disc: 2.921008348464966 (3.031771739323934) | > loss_disc_real_0: 0.396886944770813 (0.3542002538839976) | > loss_disc_real_1: 0.3233240246772766 (0.32683990399042767) | > loss_disc_real_2: 0.30195939540863037 (0.33964091539382935) | > loss_disc_real_3: 0.2007199078798294 (0.3205467015504837) | > loss_disc_real_4: 0.46068328619003296 (0.4191049635410309) | > loss_disc_real_5: 0.06539308279752731 (0.23030450195074081) | > loss_0: 2.921008348464966 (3.031771739323934) | > loss_gen: 2.3166046142578125 (2.589449723561605) | > loss_kl: 1.8269996643066406 (3.4792002042134604) | > loss_feat: 4.620654582977295 (5.080430666605632) | > loss_mel: 25.410717010498047 (24.18741798400879) | > loss_duration: 2.7120249271392822 (2.8646926085154214) | > loss_1: 36.887001037597656 (38.20119094848633) --> EVAL PERFORMANCE | > avg_loader_time: 0.009949604670206705 (+0.00023404757181803328) | > avg_loss_disc: 3.031771739323934 (+0.33999037742614746) | > avg_loss_disc_real_0: 0.3542002538839976 (+0.1221309304237366) | > avg_loss_disc_real_1: 0.32683990399042767 (+0.07899647454420727) | > avg_loss_disc_real_2: 0.33964091539382935 (+0.11256957550843558) | > avg_loss_disc_real_3: 0.3205467015504837 (+0.04884349803129834) | > avg_loss_disc_real_4: 0.4191049635410309 (+0.17733417203028998) | > avg_loss_disc_real_5: 0.23030450195074081 (+0.04465353737274805) | > avg_loss_0: 3.031771739323934 (+0.33999037742614746) | > avg_loss_gen: 2.589449723561605 (+0.7474433978398642) | > avg_loss_kl: 3.4792002042134604 (-0.20887327194213867) | > avg_loss_feat: 5.080430666605632 (+1.8366500983635587) | > avg_loss_mel: 24.18741798400879 (+9.67518409093221) | > avg_loss_duration: 2.8646926085154214 (+0.07515184084574367) | > avg_loss_1: 38.20119094848633 (+12.125556310017902)  > EPOCH: 547/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:41:26)   --> TIME: 2023-10-20 05:41:43 -- STEP: 19/50 -- GLOBAL_STEP: 80370 | > loss_disc: 1.7328953742980957 (2.4985364361813196) | > loss_disc_real_0: 0.08265051990747452 (0.164971776747782) | > loss_disc_real_1: 0.2125728875398636 (0.2410987854788178) | > loss_disc_real_2: 0.13760481774806976 (0.24857763318639053) | > loss_disc_real_3: 0.10957102477550507 (0.2361184607603048) | > loss_disc_real_4: 0.10477972775697708 (0.2524476606202753) | > loss_disc_real_5: 0.15868069231510162 (0.26396815008238744) | > loss_0: 1.7328953742980957 (2.4985364361813196) | > grad_norm_0: tensor(457.5640, device='cuda:0') (tensor(537.2598, device='cuda:0')) | > loss_gen: 2.553257942199707 (2.4089233749791195) | > loss_kl: 0.8290162086486816 (0.7798097141479191) | > loss_feat: 8.73041820526123 (5.413013114740974) | > loss_mel: 24.869977951049805 (21.378086704956857) | > loss_duration: 1.5745832920074463 (1.5124824988214594) | > loss_1: 38.557254791259766 (31.49231511668155) | > grad_norm_1: tensor(40012.0039, device='cuda:0') (tensor(19997.4316, device='cuda:0')) | > current_lr_0: 0.00011573269472788408 | > current_lr_1: 0.00011573269472788408 | > step_time: 0.5743 (0.5011183337161416) | > loader_time: 0.0116 (0.021004852495695416)  --> TIME: 2023-10-20 05:41:59 -- STEP: 49/50 -- GLOBAL_STEP: 80400 | > loss_disc: 2.9083456993103027 (2.4871324933305083) | > loss_disc_real_0: 0.37702956795692444 (0.15640948764143547) | > loss_disc_real_1: 0.29216280579566956 (0.23143960881446088) | > loss_disc_real_2: 0.23027771711349487 (0.2279703991905767) | > loss_disc_real_3: 0.26382091641426086 (0.2286184236635359) | > loss_disc_real_4: 0.2660069167613983 (0.23620851870094026) | > loss_disc_real_5: 0.27483218908309937 (0.24122041558884838) | > loss_0: 2.9083456993103027 (2.4871324933305083) | > grad_norm_0: tensor(1313.5223, device='cuda:0') (tensor(614.4497, device='cuda:0')) | > loss_gen: 1.9345862865447998 (2.2733501195907593) | > loss_kl: 0.47549596428871155 (0.8180218001409453) | > loss_feat: 0.7883959412574768 (4.947097212684397) | > loss_mel: 16.309432983398438 (20.247922829219274) | > loss_duration: 1.5905708074569702 (1.4684100078076732) | > loss_1: 21.098480224609375 (29.754802071318334) | > grad_norm_1: tensor(4641.7310, device='cuda:0') (tensor(16669.0586, device='cuda:0')) | > current_lr_0: 0.00011573269472788408 | > current_lr_1: 0.00011573269472788408 | > step_time: 0.6346 (0.49687722264503936) | > loader_time: 0.3959 (0.02792232863757075)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.211197853088379 (3.211197853088379) | > loss_disc_real_0: 0.3127209544181824 (0.3127209544181824) | > loss_disc_real_1: 0.275698184967041 (0.275698184967041) | > loss_disc_real_2: 0.48090502619743347 (0.48090502619743347) | > loss_disc_real_3: 0.32534122467041016 (0.32534122467041016) | > loss_disc_real_4: 0.4433062672615051 (0.4433062672615051) | > loss_disc_real_5: 0.4447616636753082 (0.4447616636753082) | > loss_0: 3.211197853088379 (3.211197853088379) | > loss_gen: 2.393948793411255 (2.393948793411255) | > loss_kl: 3.946300745010376 (3.946300745010376) | > loss_feat: 4.975869655609131 (4.975869655609131) | > loss_mel: 21.369190216064453 (21.369190216064453) | > loss_duration: 2.6095829010009766 (2.6095829010009766) | > loss_1: 35.294891357421875 (35.294891357421875)  --> STEP: 1 | > loss_disc: 2.4148600101470947 (2.4148600101470947) | > loss_disc_real_0: 0.2605864405632019 (0.2605864405632019) | > loss_disc_real_1: 0.21145401895046234 (0.21145401895046234) | > loss_disc_real_2: 0.3089665174484253 (0.3089665174484253) | > loss_disc_real_3: 0.0950305238366127 (0.0950305238366127) | > loss_disc_real_4: 0.3619658052921295 (0.3619658052921295) | > loss_disc_real_5: 0.271162211894989 (0.271162211894989) | > loss_0: 2.4148600101470947 (2.4148600101470947) | > loss_gen: 2.6973462104797363 (2.6973462104797363) | > loss_kl: 4.172476291656494 (4.172476291656494) | > loss_feat: 6.651540279388428 (6.651540279388428) | > loss_mel: 22.455406188964844 (22.455406188964844) | > loss_duration: 2.9412448406219482 (2.9412448406219482) | > loss_1: 38.91801452636719 (38.91801452636719)  --> STEP: 2 | > loss_disc: 2.1666269302368164 (2.2907434701919556) | > loss_disc_real_0: 0.41524726152420044 (0.33791685104370117) | > loss_disc_real_1: 0.21322374045848846 (0.2123388797044754) | > loss_disc_real_2: 0.17833516001701355 (0.24365083873271942) | > loss_disc_real_3: 0.18964819610118866 (0.14233935996890068) | > loss_disc_real_4: 0.13150271773338318 (0.24673426151275635) | > loss_disc_real_5: 0.194144144654274 (0.2326531782746315) | > loss_0: 2.1666269302368164 (2.2907434701919556) | > loss_gen: 3.0251872539520264 (2.8612667322158813) | > loss_kl: 4.375247955322266 (4.27386212348938) | > loss_feat: 9.93803882598877 (8.294789552688599) | > loss_mel: 26.243377685546875 (24.34939193725586) | > loss_duration: 2.907892942428589 (2.9245688915252686) | > loss_1: 46.48974609375 (42.703880310058594)  --> STEP: 3 | > loss_disc: 2.9549031257629395 (2.51213002204895) | > loss_disc_real_0: 0.3326772153377533 (0.3361703058083852) | > loss_disc_real_1: 0.2818537652492523 (0.23551050821940103) | > loss_disc_real_2: 0.24397243559360504 (0.24375803768634796) | > loss_disc_real_3: 0.25564301013946533 (0.1801072433590889) | > loss_disc_real_4: 0.2628207206726074 (0.25209641456604004) | > loss_disc_real_5: 0.2681383490562439 (0.24448156853516897) | > loss_0: 2.9549031257629395 (2.51213002204895) | > loss_gen: 1.7441210746765137 (2.4888848463694253) | > loss_kl: 1.9432075023651123 (3.4969772497812905) | > loss_feat: 0.44322460889816284 (5.677601238091786) | > loss_mel: 15.374802589416504 (21.357862154642742) | > loss_duration: 2.7190659046173096 (2.8560678958892822) | > loss_1: 22.224422454833984 (35.877394358317055) --> EVAL PERFORMANCE | > avg_loader_time: 0.0033849080403645835 (-0.006564696629842121) | > avg_loss_disc: 2.51213002204895 (-0.5196417172749839) | > avg_loss_disc_real_0: 0.3361703058083852 (-0.018029948075612423) | > avg_loss_disc_real_1: 0.23551050821940103 (-0.09132939577102664) | > avg_loss_disc_real_2: 0.24375803768634796 (-0.09588287770748138) | > avg_loss_disc_real_3: 0.1801072433590889 (-0.1404394581913948) | > avg_loss_disc_real_4: 0.25209641456604004 (-0.16700854897499084) | > avg_loss_disc_real_5: 0.24448156853516897 (+0.01417706658442816) | > avg_loss_0: 2.51213002204895 (-0.5196417172749839) | > avg_loss_gen: 2.4888848463694253 (-0.10056487719217966) | > avg_loss_kl: 3.4969772497812905 (+0.017777045567830108) | > avg_loss_feat: 5.677601238091786 (+0.5971705714861546) | > avg_loss_mel: 21.357862154642742 (-2.829555829366047) | > avg_loss_duration: 2.8560678958892822 (-0.008624712626139175) | > avg_loss_1: 35.877394358317055 (-2.323796590169273)  > EPOCH: 548/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:42:09)   --> TIME: 2023-10-20 05:42:26 -- STEP: 29/50 -- GLOBAL_STEP: 80430 | > loss_disc: 2.2587168216705322 (2.5020085079916585) | > loss_disc_real_0: 0.2599114775657654 (0.16980958225783607) | > loss_disc_real_1: 0.29407814145088196 (0.23804135427906595) | > loss_disc_real_2: 0.19778785109519958 (0.2465589108138249) | > loss_disc_real_3: 0.13963399827480316 (0.24116655156530184) | > loss_disc_real_4: 0.1968943029642105 (0.2247739421075274) | > loss_disc_real_5: 0.1648508608341217 (0.21715711442560987) | > loss_0: 2.2587168216705322 (2.5020085079916585) | > grad_norm_0: tensor(426.8607, device='cuda:0') (tensor(605.1401, device='cuda:0')) | > loss_gen: 2.2649669647216797 (2.270324271300743) | > loss_kl: 0.7717645168304443 (0.9357899581563884) | > loss_feat: 4.944212436676025 (4.642695961776992) | > loss_mel: 27.68181800842285 (20.338484459909893) | > loss_duration: 1.5072953701019287 (1.4830804857714424) | > loss_1: 37.17005920410156 (29.670375051169565) | > grad_norm_1: tensor(10252.4404, device='cuda:0') (tensor(26149.9434, device='cuda:0')) | > current_lr_0: 0.00011561701265355382 | > current_lr_1: 0.00011561701265355382 | > step_time: 0.3922 (0.41822278910669786) | > loader_time: 0.0022 (0.00859595167225805)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8851561546325684 (2.8851561546325684) | > loss_disc_real_0: 0.17393459379673004 (0.17393459379673004) | > loss_disc_real_1: 0.28933560848236084 (0.28933560848236084) | > loss_disc_real_2: 0.28014272451400757 (0.28014272451400757) | > loss_disc_real_3: 0.24788741767406464 (0.24788741767406464) | > loss_disc_real_4: 0.253070592880249 (0.253070592880249) | > loss_disc_real_5: 0.27160999178886414 (0.27160999178886414) | > loss_0: 2.8851561546325684 (2.8851561546325684) | > loss_gen: 1.643036127090454 (1.643036127090454) | > loss_kl: 3.6205692291259766 (3.6205692291259766) | > loss_feat: 0.34240156412124634 (0.34240156412124634) | > loss_mel: 19.27405548095703 (19.27405548095703) | > loss_duration: 2.6013946533203125 (2.6013946533203125) | > loss_1: 27.481456756591797 (27.481456756591797)  --> STEP: 1 | > loss_disc: 3.034576654434204 (3.034576654434204) | > loss_disc_real_0: 0.33097994327545166 (0.33097994327545166) | > loss_disc_real_1: 0.20773720741271973 (0.20773720741271973) | > loss_disc_real_2: 0.2521303594112396 (0.2521303594112396) | > loss_disc_real_3: 0.3888626992702484 (0.3888626992702484) | > loss_disc_real_4: 0.3442758619785309 (0.3442758619785309) | > loss_disc_real_5: 0.32555869221687317 (0.32555869221687317) | > loss_0: 3.034576654434204 (3.034576654434204) | > loss_gen: 2.198545217514038 (2.198545217514038) | > loss_kl: 4.309826850891113 (4.309826850891113) | > loss_feat: 6.973977088928223 (6.973977088928223) | > loss_mel: 23.136005401611328 (23.136005401611328) | > loss_duration: 2.9799644947052 (2.9799644947052) | > loss_1: 39.59831619262695 (39.59831619262695)  --> STEP: 2 | > loss_disc: 3.2003612518310547 (3.1174689531326294) | > loss_disc_real_0: 0.3646624684333801 (0.3478212058544159) | > loss_disc_real_1: 0.13867807388305664 (0.17320764064788818) | > loss_disc_real_2: 0.2556125223636627 (0.25387144088745117) | > loss_disc_real_3: 0.3015691637992859 (0.34521593153476715) | > loss_disc_real_4: 0.30071812868118286 (0.3224969953298569) | > loss_disc_real_5: 0.23454365134239197 (0.28005117177963257) | > loss_0: 3.2003612518310547 (3.1174689531326294) | > loss_gen: 1.9618873596191406 (2.0802162885665894) | > loss_kl: 4.593402862548828 (4.451614856719971) | > loss_feat: 6.570411682128906 (6.7721943855285645) | > loss_mel: 22.530649185180664 (22.833327293395996) | > loss_duration: 2.86398983001709 (2.921977162361145) | > loss_1: 38.52034378051758 (39.059329986572266)  --> STEP: 3 | > loss_disc: 2.8751630783081055 (3.0367003281911216) | > loss_disc_real_0: 0.39415061473846436 (0.3632643421490987) | > loss_disc_real_1: 0.3397050201892853 (0.22870676716168722) | > loss_disc_real_2: 0.18412071466445923 (0.23062119881312051) | > loss_disc_real_3: 0.2892870604991913 (0.3265729745229085) | > loss_disc_real_4: 0.2349485605955124 (0.29331418375174206) | > loss_disc_real_5: 0.16278418898582458 (0.2409621775150299) | > loss_0: 2.8751630783081055 (3.0367003281911216) | > loss_gen: 2.0345983505249023 (2.0650103092193604) | > loss_kl: 1.823278784751892 (3.5755028327306113) | > loss_feat: 5.27877140045166 (6.274386723836263) | > loss_mel: 27.032394409179688 (24.23301633199056) | > loss_duration: 2.610377788543701 (2.818110704421997) | > loss_1: 38.779422760009766 (38.9660275777181) --> EVAL PERFORMANCE | > avg_loader_time: 0.010667641957600912 (+0.007282733917236328) | > avg_loss_disc: 3.0367003281911216 (+0.5245703061421714) | > avg_loss_disc_real_0: 0.3632643421490987 (+0.0270940363407135) | > avg_loss_disc_real_1: 0.22870676716168722 (-0.006803741057713808) | > avg_loss_disc_real_2: 0.23062119881312051 (-0.013136838873227447) | > avg_loss_disc_real_3: 0.3265729745229085 (+0.1464657311638196) | > avg_loss_disc_real_4: 0.29331418375174206 (+0.041217769185702025) | > avg_loss_disc_real_5: 0.2409621775150299 (-0.0035193910201390677) | > avg_loss_0: 3.0367003281911216 (+0.5245703061421714) | > avg_loss_gen: 2.0650103092193604 (-0.42387453715006496) | > avg_loss_kl: 3.5755028327306113 (+0.07852558294932077) | > avg_loss_feat: 6.274386723836263 (+0.5967854857444763) | > avg_loss_mel: 24.23301633199056 (+2.8751541773478166) | > avg_loss_duration: 2.818110704421997 (-0.037957191467285156) | > avg_loss_1: 38.9660275777181 (+3.0886332194010464)  > EPOCH: 549/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:42:46)   --> TIME: 2023-10-20 05:43:00 -- STEP: 9/50 -- GLOBAL_STEP: 80460 | > loss_disc: 2.136699676513672 (2.548304716746012) | > loss_disc_real_0: 0.11243093013763428 (0.15496198046538565) | > loss_disc_real_1: 0.21336223185062408 (0.24543592002656725) | > loss_disc_real_2: 0.2625240981578827 (0.24815969169139862) | > loss_disc_real_3: 0.3378998339176178 (0.26430296070045894) | > loss_disc_real_4: 0.17011070251464844 (0.20361831080582407) | > loss_disc_real_5: 0.08541861921548843 (0.19764512322015232) | > loss_0: 2.136699676513672 (2.548304716746012) | > grad_norm_0: tensor(362.5670, device='cuda:0') (tensor(478.7785, device='cuda:0')) | > loss_gen: 2.513791084289551 (2.230502578947279) | > loss_kl: 0.7200455665588379 (0.7608809040652381) | > loss_feat: 6.540271759033203 (5.42460438505643) | > loss_mel: 23.177947998046875 (18.462837364938522) | > loss_duration: 1.4289793968200684 (1.4787118832270305) | > loss_1: 34.38103485107422 (28.357536951700848) | > grad_norm_1: tensor(6909.0352, device='cuda:0') (tensor(17041.2168, device='cuda:0')) | > current_lr_0: 0.0001155014462106996 | > current_lr_1: 0.0001155014462106996 | > step_time: 0.7789 (0.6700354152255588) | > loader_time: 0.022 (0.02569617165459527)  --> TIME: 2023-10-20 05:43:18 -- STEP: 39/50 -- GLOBAL_STEP: 80490 | > loss_disc: 3.00732421875 (2.4952051975788216) | > loss_disc_real_0: 0.2932983636856079 (0.1593054226384713) | > loss_disc_real_1: 0.23666144907474518 (0.23669504011288667) | > loss_disc_real_2: 0.24672378599643707 (0.22483388516001213) | > loss_disc_real_3: 0.2207498401403427 (0.22953643965033385) | > loss_disc_real_4: 0.294158011674881 (0.22872653412513244) | > loss_disc_real_5: 0.28243136405944824 (0.23433878062627253) | > loss_0: 3.00732421875 (2.4952051975788216) | > grad_norm_0: tensor(452.7115, device='cuda:0') (tensor(565.4610, device='cuda:0')) | > loss_gen: 1.5345726013183594 (2.339225695683406) | > loss_kl: 0.27856072783470154 (0.8658602841389484) | > loss_feat: 0.1508261114358902 (5.798365318765626) | > loss_mel: 2.0692341327667236 (21.00991267730028) | > loss_duration: 1.5229305028915405 (1.4717132128202) | > loss_1: 5.556124210357666 (31.48507723441491) | > grad_norm_1: tensor(11279.0840, device='cuda:0') (tensor(17531.7383, device='cuda:0')) | > current_lr_0: 0.0001155014462106996 | > current_lr_1: 0.0001155014462106996 | > step_time: 0.2617 (0.586563269297282) | > loader_time: 0.0023 (0.020347020564935148)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8122754096984863 (2.8122754096984863) | > loss_disc_real_0: 0.23065398633480072 (0.23065398633480072) | > loss_disc_real_1: 0.24611853063106537 (0.24611853063106537) | > loss_disc_real_2: 0.11399563401937485 (0.11399563401937485) | > loss_disc_real_3: 0.2767963409423828 (0.2767963409423828) | > loss_disc_real_4: 0.2013680338859558 (0.2013680338859558) | > loss_disc_real_5: 0.1756943315267563 (0.1756943315267563) | > loss_0: 2.8122754096984863 (2.8122754096984863) | > loss_gen: 1.8658679723739624 (1.8658679723739624) | > loss_kl: 3.6541876792907715 (3.6541876792907715) | > loss_feat: 2.4710423946380615 (2.4710423946380615) | > loss_mel: 21.66591453552246 (21.66591453552246) | > loss_duration: 2.6216955184936523 (2.6216955184936523) | > loss_1: 32.278709411621094 (32.278709411621094)  --> STEP: 1 | > loss_disc: 3.0582079887390137 (3.0582079887390137) | > loss_disc_real_0: 0.41996437311172485 (0.41996437311172485) | > loss_disc_real_1: 0.2636490762233734 (0.2636490762233734) | > loss_disc_real_2: 0.24165834486484528 (0.24165834486484528) | > loss_disc_real_3: 0.28394100069999695 (0.28394100069999695) | > loss_disc_real_4: 0.25897011160850525 (0.25897011160850525) | > loss_disc_real_5: 0.2663632333278656 (0.2663632333278656) | > loss_0: 3.0582079887390137 (3.0582079887390137) | > loss_gen: 1.7227325439453125 (1.7227325439453125) | > loss_kl: 3.867513418197632 (3.867513418197632) | > loss_feat: 0.09311650693416595 (0.09311650693416595) | > loss_mel: 4.769445896148682 (4.769445896148682) | > loss_duration: 2.9565436840057373 (2.9565436840057373) | > loss_1: 13.40935230255127 (13.40935230255127)  --> STEP: 2 | > loss_disc: 2.1948776245117188 (2.626542806625366) | > loss_disc_real_0: 0.31252726912498474 (0.3662458211183548) | > loss_disc_real_1: 0.12586098909378052 (0.19475503265857697) | > loss_disc_real_2: 0.2360699325799942 (0.23886413872241974) | > loss_disc_real_3: 0.2911792993545532 (0.2875601500272751) | > loss_disc_real_4: 0.1437276005744934 (0.20134885609149933) | > loss_disc_real_5: 0.05206136032938957 (0.1592122968286276) | > loss_0: 2.1948776245117188 (2.626542806625366) | > loss_gen: 2.797008514404297 (2.2598705291748047) | > loss_kl: 4.02767276763916 (3.947593092918396) | > loss_feat: 12.563955307006836 (6.328535906970501) | > loss_mel: 24.79242706298828 (14.780936479568481) | > loss_duration: 2.948274850845337 (2.952409267425537) | > loss_1: 47.12934112548828 (30.269346714019775)  --> STEP: 3 | > loss_disc: 3.4849045276641846 (2.912663380304972) | > loss_disc_real_0: 0.4092688262462616 (0.38058682282765705) | > loss_disc_real_1: 0.3395138382911682 (0.2430079678694407) | > loss_disc_real_2: 0.3064744770526886 (0.2614009181658427) | > loss_disc_real_3: 0.28314024209976196 (0.2860868473847707) | > loss_disc_real_4: 0.36850735545158386 (0.25706835587819415) | > loss_disc_real_5: 0.359157919883728 (0.2258608378469944) | > loss_0: 3.4849045276641846 (2.912663380304972) | > loss_gen: 1.838873267173767 (2.119538108507792) | > loss_kl: 2.241025686264038 (3.378737290700277) | > loss_feat: 3.4602465629577637 (5.372439458966255) | > loss_mel: 20.445737838745117 (16.669203599294026) | > loss_duration: 2.7733609676361084 (2.892726500829061) | > loss_1: 30.759244918823242 (30.43264611562093) --> EVAL PERFORMANCE | > avg_loader_time: 0.0033344427744547525 (-0.00733319918314616) | > avg_loss_disc: 2.912663380304972 (-0.12403694788614938) | > avg_loss_disc_real_0: 0.38058682282765705 (+0.01732248067855835) | > avg_loss_disc_real_1: 0.2430079678694407 (+0.01430120070775348) | > avg_loss_disc_real_2: 0.2614009181658427 (+0.030779719352722196) | > avg_loss_disc_real_3: 0.2860868473847707 (-0.04048612713813782) | > avg_loss_disc_real_4: 0.25706835587819415 (-0.03624582787354791) | > avg_loss_disc_real_5: 0.2258608378469944 (-0.015101339668035507) | > avg_loss_0: 2.912663380304972 (-0.12403694788614938) | > avg_loss_gen: 2.119538108507792 (+0.054527799288431655) | > avg_loss_kl: 3.378737290700277 (-0.19676554203033447) | > avg_loss_feat: 5.372439458966255 (-0.9019472648700075) | > avg_loss_mel: 16.669203599294026 (-7.563812732696533) | > avg_loss_duration: 2.892726500829061 (+0.07461579640706395) | > avg_loss_1: 30.43264611562093 (-8.533381462097172)  > EPOCH: 550/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:43:37)   --> TIME: 2023-10-20 05:43:54 -- STEP: 19/50 -- GLOBAL_STEP: 80520 | > loss_disc: 1.6778215169906616 (2.4118523848684212) | > loss_disc_real_0: 0.1257508397102356 (0.1641691105538293) | > loss_disc_real_1: 0.22942590713500977 (0.2066234901155296) | > loss_disc_real_2: 0.20181779563426971 (0.23395075100032905) | > loss_disc_real_3: 0.19962871074676514 (0.24598794803023338) | > loss_disc_real_4: 0.15243716537952423 (0.20457562078770838) | > loss_disc_real_5: 0.1546037495136261 (0.22607873331167197) | > loss_0: 1.6778215169906616 (2.4118523848684212) | > grad_norm_0: tensor(550.9758, device='cuda:0') (tensor(476.2670, device='cuda:0')) | > loss_gen: 3.4275426864624023 (2.414212440189562) | > loss_kl: 0.9637575745582581 (0.8522651195526123) | > loss_feat: 8.1765775680542 (5.405437648296356) | > loss_mel: 24.855680465698242 (21.546972271643188) | > loss_duration: 1.5155773162841797 (1.5045180383481478) | > loss_1: 38.93914031982422 (31.723405461562308) | > grad_norm_1: tensor(23865.2520, device='cuda:0') (tensor(21693.3613, device='cuda:0')) | > current_lr_0: 0.00011538599528374059 | > current_lr_1: 0.00011538599528374059 | > step_time: 0.3109 (0.6192918451208818) | > loader_time: 0.0027 (0.023311539700156765)  --> TIME: 2023-10-20 05:44:14 -- STEP: 49/50 -- GLOBAL_STEP: 80550 | > loss_disc: 2.3296070098876953 (2.4177749302922464) | > loss_disc_real_0: 0.09066230058670044 (0.15551293766772264) | > loss_disc_real_1: 0.28595900535583496 (0.22319757755921812) | > loss_disc_real_2: 0.2515001595020294 (0.21995559433589176) | > loss_disc_real_3: 0.28397461771965027 (0.24725733720222295) | > loss_disc_real_4: 0.2355562448501587 (0.2053516333048441) | > loss_disc_real_5: 0.2854352593421936 (0.2156225104949304) | > loss_0: 2.3296070098876953 (2.4177749302922464) | > grad_norm_0: tensor(625.5926, device='cuda:0') (tensor(546.5735, device='cuda:0')) | > loss_gen: 2.3354878425598145 (2.3637335811342512) | > loss_kl: 0.3197054862976074 (0.8249076542501547) | > loss_feat: 3.4017696380615234 (5.285145195771236) | > loss_mel: 20.54871368408203 (22.22796650200474) | > loss_duration: 1.5383937358856201 (1.4645603408618852) | > loss_1: 28.14406967163086 (32.166313103267115) | > grad_norm_1: tensor(5858.6587, device='cuda:0') (tensor(17856.8398, device='cuda:0')) | > current_lr_0: 0.00011538599528374059 | > current_lr_1: 0.00011538599528374059 | > step_time: 0.7422 (0.629930184811962) | > loader_time: 0.4469 (0.031775863803162864)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9882389307022095 (1.9882389307022095) | > loss_disc_real_0: 0.16500873863697052 (0.16500873863697052) | > loss_disc_real_1: 0.14474688470363617 (0.14474688470363617) | > loss_disc_real_2: 0.23634600639343262 (0.23634600639343262) | > loss_disc_real_3: 0.1751854568719864 (0.1751854568719864) | > loss_disc_real_4: 0.1593060940504074 (0.1593060940504074) | > loss_disc_real_5: 0.21092118322849274 (0.21092118322849274) | > loss_0: 1.9882389307022095 (1.9882389307022095) | > loss_gen: 2.6159372329711914 (2.6159372329711914) | > loss_kl: 3.540869951248169 (3.540869951248169) | > loss_feat: 7.463286876678467 (7.463286876678467) | > loss_mel: 23.25711441040039 (23.25711441040039) | > loss_duration: 2.59507417678833 (2.59507417678833) | > loss_1: 39.47228240966797 (39.47228240966797)  --> STEP: 1 | > loss_disc: 1.6377232074737549 (1.6377232074737549) | > loss_disc_real_0: 0.09642428159713745 (0.09642428159713745) | > loss_disc_real_1: 0.1475365310907364 (0.1475365310907364) | > loss_disc_real_2: 0.10331406444311142 (0.10331406444311142) | > loss_disc_real_3: 0.14649130403995514 (0.14649130403995514) | > loss_disc_real_4: 0.07150059193372726 (0.07150059193372726) | > loss_disc_real_5: 0.163409024477005 (0.163409024477005) | > loss_0: 1.6377232074737549 (1.6377232074737549) | > loss_gen: 2.5848352909088135 (2.5848352909088135) | > loss_kl: 4.061383247375488 (4.061383247375488) | > loss_feat: 8.051237106323242 (8.051237106323242) | > loss_mel: 24.528669357299805 (24.528669357299805) | > loss_duration: 2.976505994796753 (2.976505994796753) | > loss_1: 42.20262908935547 (42.20262908935547)  --> STEP: 2 | > loss_disc: 3.177314281463623 (2.407518744468689) | > loss_disc_real_0: 0.1881350576877594 (0.14227966964244843) | > loss_disc_real_1: 0.1027575135231018 (0.1251470223069191) | > loss_disc_real_2: 0.2812255620956421 (0.19226981326937675) | > loss_disc_real_3: 0.3289240300655365 (0.23770766705274582) | > loss_disc_real_4: 0.2598581612110138 (0.16567937657237053) | > loss_disc_real_5: 0.4477183222770691 (0.30556367337703705) | > loss_0: 3.177314281463623 (2.407518744468689) | > loss_gen: 2.0742926597595215 (2.3295639753341675) | > loss_kl: 4.394492149353027 (4.227937698364258) | > loss_feat: 8.47618579864502 (8.26371145248413) | > loss_mel: 26.345014572143555 (25.43684196472168) | > loss_duration: 2.86203670501709 (2.9192713499069214) | > loss_1: 44.15201950073242 (43.177324295043945)  --> STEP: 3 | > loss_disc: 2.500518798828125 (2.438518762588501) | > loss_disc_real_0: 0.08403633534908295 (0.12286522487799327) | > loss_disc_real_1: 0.28554612398147583 (0.17861338953177133) | > loss_disc_real_2: 0.22512559592723846 (0.20322174082199732) | > loss_disc_real_3: 0.3131602704524994 (0.2628585348526637) | > loss_disc_real_4: 0.22516030073165894 (0.18550635129213333) | > loss_disc_real_5: 0.2411981225013733 (0.2841084897518158) | > loss_0: 2.500518798828125 (2.438518762588501) | > loss_gen: 2.242110252380371 (2.300412734349569) | > loss_kl: 2.0446617603302 (3.5001790523529053) | > loss_feat: 4.398678779602051 (6.9753672281901045) | > loss_mel: 22.16783905029297 (24.347174326578777) | > loss_duration: 2.6829020977020264 (2.8404815991719565) | > loss_1: 33.53619384765625 (39.96361414591471) --> EVAL PERFORMANCE | > avg_loader_time: 0.00793147087097168 (+0.004597028096516928) | > avg_loss_disc: 2.438518762588501 (-0.4741446177164712) | > avg_loss_disc_real_0: 0.12286522487799327 (-0.25772159794966376) | > avg_loss_disc_real_1: 0.17861338953177133 (-0.06439457833766937) | > avg_loss_disc_real_2: 0.20322174082199732 (-0.058179177343845395) | > avg_loss_disc_real_3: 0.2628585348526637 (-0.023228312532107) | > avg_loss_disc_real_4: 0.18550635129213333 (-0.07156200458606082) | > avg_loss_disc_real_5: 0.2841084897518158 (+0.058247651904821396) | > avg_loss_0: 2.438518762588501 (-0.4741446177164712) | > avg_loss_gen: 2.300412734349569 (+0.18087462584177683) | > avg_loss_kl: 3.5001790523529053 (+0.12144176165262843) | > avg_loss_feat: 6.9753672281901045 (+1.6029277692238493) | > avg_loss_mel: 24.347174326578777 (+7.677970727284752) | > avg_loss_duration: 2.8404815991719565 (-0.05224490165710449) | > avg_loss_1: 39.96361414591471 (+9.530968030293781)  > EPOCH: 551/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:44:30)   --> TIME: 2023-10-20 05:44:59 -- STEP: 29/50 -- GLOBAL_STEP: 80580 | > loss_disc: 2.5638492107391357 (2.449603952210525) | > loss_disc_real_0: 0.251961886882782 (0.1429838535761268) | > loss_disc_real_1: 0.28243011236190796 (0.21322444132689772) | > loss_disc_real_2: 0.29959744215011597 (0.2209390390921256) | > loss_disc_real_3: 0.3027874231338501 (0.23656665662239337) | > loss_disc_real_4: 0.3129294514656067 (0.17690493143966485) | > loss_disc_real_5: 0.33529427647590637 (0.20157804686961503) | > loss_0: 2.5638492107391357 (2.449603952210525) | > grad_norm_0: tensor(472.4302, device='cuda:0') (tensor(578.1372, device='cuda:0')) | > loss_gen: 2.659120559692383 (2.3787040628235916) | > loss_kl: 0.791434109210968 (0.8649341541117636) | > loss_feat: 3.1250648498535156 (6.676811732094864) | > loss_mel: 24.468870162963867 (22.093542699156135) | > loss_duration: 1.4762961864471436 (1.4897041978507206) | > loss_1: 32.52078628540039 (33.503696836274244) | > grad_norm_1: tensor(3330.9924, device='cuda:0') (tensor(24189.9629, device='cuda:0')) | > current_lr_0: 0.00011527065975721136 | > current_lr_1: 0.00011527065975721136 | > step_time: 0.6249 (0.6417531391669964) | > loader_time: 0.0068 (0.016555473722260575)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9347057342529297 (2.9347057342529297) | > loss_disc_real_0: 0.20526161789894104 (0.20526161789894104) | > loss_disc_real_1: 0.3100008964538574 (0.3100008964538574) | > loss_disc_real_2: 0.29235926270484924 (0.29235926270484924) | > loss_disc_real_3: 0.33520784974098206 (0.33520784974098206) | > loss_disc_real_4: 0.3033449649810791 (0.3033449649810791) | > loss_disc_real_5: 0.3063434064388275 (0.3063434064388275) | > loss_0: 2.9347057342529297 (2.9347057342529297) | > loss_gen: 1.8589202165603638 (1.8589202165603638) | > loss_kl: 3.9479546546936035 (3.9479546546936035) | > loss_feat: 0.2398967146873474 (0.2398967146873474) | > loss_mel: 13.384687423706055 (13.384687423706055) | > loss_duration: 2.702674388885498 (2.702674388885498) | > loss_1: 22.13413429260254 (22.13413429260254)  --> STEP: 1 | > loss_disc: 2.6590824127197266 (2.6590824127197266) | > loss_disc_real_0: 0.36117082834243774 (0.36117082834243774) | > loss_disc_real_1: 0.2626456916332245 (0.2626456916332245) | > loss_disc_real_2: 0.2794416844844818 (0.2794416844844818) | > loss_disc_real_3: 0.3084413409233093 (0.3084413409233093) | > loss_disc_real_4: 0.29850098490715027 (0.29850098490715027) | > loss_disc_real_5: 0.307138592004776 (0.307138592004776) | > loss_0: 2.6590824127197266 (2.6590824127197266) | > loss_gen: 2.723987340927124 (2.723987340927124) | > loss_kl: 4.261289119720459 (4.261289119720459) | > loss_feat: 2.658228874206543 (2.658228874206543) | > loss_mel: 22.23004150390625 (22.23004150390625) | > loss_duration: 2.9053375720977783 (2.9053375720977783) | > loss_1: 34.77888488769531 (34.77888488769531)  --> STEP: 2 | > loss_disc: 1.8805873394012451 (2.269834876060486) | > loss_disc_real_0: 0.17766311764717102 (0.2694169729948044) | > loss_disc_real_1: 0.24892325699329376 (0.2557844743132591) | > loss_disc_real_2: 0.19935716688632965 (0.23939942568540573) | > loss_disc_real_3: 0.3712957501411438 (0.33986854553222656) | > loss_disc_real_4: 0.12216929346323013 (0.2103351391851902) | > loss_disc_real_5: 0.2031453549861908 (0.2551419734954834) | > loss_0: 1.8805873394012451 (2.269834876060486) | > loss_gen: 4.541078567504883 (3.6325329542160034) | > loss_kl: 4.366702556610107 (4.313995838165283) | > loss_feat: 10.857870101928711 (6.758049488067627) | > loss_mel: 25.6239013671875 (23.926971435546875) | > loss_duration: 2.829188108444214 (2.867262840270996) | > loss_1: 48.2187385559082 (41.49881172180176)  --> STEP: 3 | > loss_disc: 2.8780763149261475 (2.4725820223490396) | > loss_disc_real_0: 0.21169599890708923 (0.25017664829889935) | > loss_disc_real_1: 0.4836755692958832 (0.3317481726408005) | > loss_disc_real_2: 0.2788001000881195 (0.2525329838196437) | > loss_disc_real_3: 0.35641756653785706 (0.3453848858674367) | > loss_disc_real_4: 0.2953051030635834 (0.23865846047798792) | > loss_disc_real_5: 0.23310601711273193 (0.2477966547012329) | > loss_0: 2.8780763149261475 (2.4725820223490396) | > loss_gen: 2.4766592979431152 (3.247241735458374) | > loss_kl: 2.121039628982544 (3.58301043510437) | > loss_feat: 3.5184407234191895 (5.678179899851481) | > loss_mel: 20.77730941772461 (22.877084096272785) | > loss_duration: 2.652088165283203 (2.7955379486083984) | > loss_1: 31.5455379486084 (38.18105379740397) --> EVAL PERFORMANCE | > avg_loader_time: 0.017718076705932617 (+0.009786605834960938) | > avg_loss_disc: 2.4725820223490396 (+0.03406325976053859) | > avg_loss_disc_real_0: 0.25017664829889935 (+0.12731142342090607) | > avg_loss_disc_real_1: 0.3317481726408005 (+0.15313478310902914) | > avg_loss_disc_real_2: 0.2525329838196437 (+0.04931124299764636) | > avg_loss_disc_real_3: 0.3453848858674367 (+0.08252635101477301) | > avg_loss_disc_real_4: 0.23865846047798792 (+0.053152109185854585) | > avg_loss_disc_real_5: 0.2477966547012329 (-0.036311835050582886) | > avg_loss_0: 2.4725820223490396 (+0.03406325976053859) | > avg_loss_gen: 3.247241735458374 (+0.9468290011088052) | > avg_loss_kl: 3.58301043510437 (+0.08283138275146484) | > avg_loss_feat: 5.678179899851481 (-1.297187328338623) | > avg_loss_mel: 22.877084096272785 (-1.470090230305992) | > avg_loss_duration: 2.7955379486083984 (-0.04494365056355809) | > avg_loss_1: 38.18105379740397 (-1.7825603485107422)  > EPOCH: 552/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:45:29)   --> TIME: 2023-10-20 05:45:39 -- STEP: 9/50 -- GLOBAL_STEP: 80610 | > loss_disc: 2.724860668182373 (2.5101020601060657) | > loss_disc_real_0: 0.27870815992355347 (0.18709706142544746) | > loss_disc_real_1: 0.34009578824043274 (0.2783917329377598) | > loss_disc_real_2: 0.41628140211105347 (0.2679181396961212) | > loss_disc_real_3: 0.28130462765693665 (0.24077428463432524) | > loss_disc_real_4: 0.3713628351688385 (0.2762198688255416) | > loss_disc_real_5: 0.2859553098678589 (0.22180665201610988) | > loss_0: 2.724860668182373 (2.5101020601060657) | > grad_norm_0: tensor(415.3263, device='cuda:0') (tensor(497.6047, device='cuda:0')) | > loss_gen: 2.6586313247680664 (2.5284854571024575) | > loss_kl: 0.5191301107406616 (1.029054045677185) | > loss_feat: 4.020643711090088 (6.3697098228666515) | > loss_mel: 25.853069305419922 (23.276314629448784) | > loss_duration: 1.4308586120605469 (1.4532321691513062) | > loss_1: 34.48233413696289 (34.65679613749186) | > grad_norm_1: tensor(15986.7422, device='cuda:0') (tensor(17479.8379, device='cuda:0')) | > current_lr_0: 0.000115155439515762 | > current_lr_1: 0.000115155439515762 | > step_time: 0.3365 (0.563767221238878) | > loader_time: 0.002 (0.018737634023030598)  --> TIME: 2023-10-20 05:45:55 -- STEP: 39/50 -- GLOBAL_STEP: 80640 | > loss_disc: 1.2930479049682617 (2.4321774397140894) | > loss_disc_real_0: 0.006526809185743332 (0.1418991425337317) | > loss_disc_real_1: 0.07150068879127502 (0.2312634355173661) | > loss_disc_real_2: 0.05317153409123421 (0.22231631305737373) | > loss_disc_real_3: 0.036511532962322235 (0.23487659620168883) | > loss_disc_real_4: 0.046908799558877945 (0.22168477705846984) | > loss_disc_real_5: 0.011931228451430798 (0.21691880430071017) | > loss_0: 1.2930479049682617 (2.4321774397140894) | > grad_norm_0: tensor(584.2994, device='cuda:0') (tensor(610.0133, device='cuda:0')) | > loss_gen: 3.004849433898926 (2.334419064032726) | > loss_kl: 0.352417528629303 (0.8840299653701293) | > loss_feat: 12.144282341003418 (5.291100398470194) | > loss_mel: 26.935089111328125 (22.670300838274834) | > loss_duration: 1.5191881656646729 (1.4650429364962458) | > loss_1: 43.95582580566406 (32.6448931327233) | > grad_norm_1: tensor(71711.3281, device='cuda:0') (tensor(21161.0605, device='cuda:0')) | > current_lr_0: 0.000115155439515762 | > current_lr_1: 0.000115155439515762 | > step_time: 0.3631 (0.5366566181182861) | > loader_time: 0.0193 (0.01617118028494028)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5429911613464355 (2.5429911613464355) | > loss_disc_real_0: 0.1842919886112213 (0.1842919886112213) | > loss_disc_real_1: 0.32448646426200867 (0.32448646426200867) | > loss_disc_real_2: 0.32832860946655273 (0.32832860946655273) | > loss_disc_real_3: 0.3478944003582001 (0.3478944003582001) | > loss_disc_real_4: 0.2527245879173279 (0.2527245879173279) | > loss_disc_real_5: 0.2940761148929596 (0.2940761148929596) | > loss_0: 2.5429911613464355 (2.5429911613464355) | > loss_gen: 2.832392692565918 (2.832392692565918) | > loss_kl: 3.4379148483276367 (3.4379148483276367) | > loss_feat: 5.7860846519470215 (5.7860846519470215) | > loss_mel: 22.154523849487305 (22.154523849487305) | > loss_duration: 2.6840717792510986 (2.6840717792510986) | > loss_1: 36.89498519897461 (36.89498519897461)  --> STEP: 1 | > loss_disc: 2.0028703212738037 (2.0028703212738037) | > loss_disc_real_0: 0.17323246598243713 (0.17323246598243713) | > loss_disc_real_1: 0.16826456785202026 (0.16826456785202026) | > loss_disc_real_2: 0.13283732533454895 (0.13283732533454895) | > loss_disc_real_3: 0.20802104473114014 (0.20802104473114014) | > loss_disc_real_4: 0.07454482465982437 (0.07454482465982437) | > loss_disc_real_5: 0.04653406888246536 (0.04653406888246536) | > loss_0: 2.0028703212738037 (2.0028703212738037) | > loss_gen: 2.135742425918579 (2.135742425918579) | > loss_kl: 3.861025810241699 (3.861025810241699) | > loss_feat: 10.603867530822754 (10.603867530822754) | > loss_mel: 27.351585388183594 (27.351585388183594) | > loss_duration: 2.967578411102295 (2.967578411102295) | > loss_1: 46.9197998046875 (46.9197998046875)  --> STEP: 2 | > loss_disc: 3.0052618980407715 (2.5040661096572876) | > loss_disc_real_0: 0.2712737023830414 (0.22225308418273926) | > loss_disc_real_1: 0.2519266605377197 (0.21009561419487) | > loss_disc_real_2: 0.15567418932914734 (0.14425575733184814) | > loss_disc_real_3: 0.2454514354467392 (0.22673624008893967) | > loss_disc_real_4: 0.3008566200733185 (0.18770072236657143) | > loss_disc_real_5: 0.31078365445137024 (0.1786588616669178) | > loss_0: 3.0052618980407715 (2.5040661096572876) | > loss_gen: 1.5545181035995483 (1.8451302647590637) | > loss_kl: 4.302645206451416 (4.081835508346558) | > loss_feat: 0.12563860416412354 (5.364753067493439) | > loss_mel: 2.0422253608703613 (14.696905374526978) | > loss_duration: 2.9461119174957275 (2.9568451642990112) | > loss_1: 10.971138954162598 (28.94546937942505)  --> STEP: 3 | > loss_disc: 2.842617988586426 (2.6169167359670005) | > loss_disc_real_0: 0.26253607869148254 (0.23568074901898703) | > loss_disc_real_1: 0.2870752811431885 (0.23575550317764282) | > loss_disc_real_2: 0.21335095167160034 (0.16728748877843222) | > loss_disc_real_3: 0.24778470396995544 (0.23375239471594492) | > loss_disc_real_4: 0.26644980907440186 (0.21395041793584824) | > loss_disc_real_5: 0.2995927929878235 (0.2189701721072197) | > loss_0: 2.842617988586426 (2.6169167359670005) | > loss_gen: 1.8332160711288452 (1.8411588668823242) | > loss_kl: 2.0649189949035645 (3.40953000386556) | > loss_feat: 1.1444286108016968 (3.9579782485961914) | > loss_mel: 18.648193359375 (16.01400136947632) | > loss_duration: 2.698655128479004 (2.8707818190256753) | > loss_1: 26.38941192626953 (28.09345022837321) --> EVAL PERFORMANCE | > avg_loader_time: 0.022612810134887695 (+0.004894733428955078) | > avg_loss_disc: 2.6169167359670005 (+0.1443347136179609) | > avg_loss_disc_real_0: 0.23568074901898703 (-0.014495899279912322) | > avg_loss_disc_real_1: 0.23575550317764282 (-0.09599266946315765) | > avg_loss_disc_real_2: 0.16728748877843222 (-0.08524549504121146) | > avg_loss_disc_real_3: 0.23375239471594492 (-0.11163249115149179) | > avg_loss_disc_real_4: 0.21395041793584824 (-0.02470804254213968) | > avg_loss_disc_real_5: 0.2189701721072197 (-0.028826482594013214) | > avg_loss_0: 2.6169167359670005 (+0.1443347136179609) | > avg_loss_gen: 1.8411588668823242 (-1.4060828685760498) | > avg_loss_kl: 3.40953000386556 (-0.17348043123881007) | > avg_loss_feat: 3.9579782485961914 (-1.72020165125529) | > avg_loss_mel: 16.01400136947632 (-6.863082726796467) | > avg_loss_duration: 2.8707818190256753 (+0.07524387041727687) | > avg_loss_1: 28.09345022837321 (-10.087603569030758)  > EPOCH: 553/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:46:16)   --> TIME: 2023-10-20 05:46:38 -- STEP: 19/50 -- GLOBAL_STEP: 80670 | > loss_disc: 1.7689783573150635 (2.524008719544662) | > loss_disc_real_0: 0.016385285183787346 (0.16233950137699904) | > loss_disc_real_1: 0.21050295233726501 (0.22494199303419968) | > loss_disc_real_2: 0.17606431245803833 (0.2242498464490238) | > loss_disc_real_3: 0.15943844616413116 (0.25016763982804197) | > loss_disc_real_4: 0.21277761459350586 (0.23833598980778142) | > loss_disc_real_5: 0.13405588269233704 (0.22854554751201683) | > loss_0: 1.7689783573150635 (2.524008719544662) | > grad_norm_0: tensor(560.9423, device='cuda:0') (tensor(554.0232, device='cuda:0')) | > loss_gen: 2.797090530395508 (2.24902155524806) | > loss_kl: 0.6721811294555664 (0.8631160431786588) | > loss_feat: 8.234519958496094 (4.671722447597667) | > loss_mel: 21.095638275146484 (19.18790004127904) | > loss_duration: 1.5928958654403687 (1.512070706016139) | > loss_1: 34.39232635498047 (28.48383060254549) | > grad_norm_1: tensor(19876.5410, device='cuda:0') (tensor(23410.5566, device='cuda:0')) | > current_lr_0: 0.00011504033444415783 | > current_lr_1: 0.00011504033444415783 | > step_time: 0.8142 (0.6182310706690738) | > loader_time: 0.0115 (0.02451726009971217)  --> TIME: 2023-10-20 05:46:58 -- STEP: 49/50 -- GLOBAL_STEP: 80700 | > loss_disc: 2.064748764038086 (2.493584915083282) | > loss_disc_real_0: 0.1207185760140419 (0.14577251056931456) | > loss_disc_real_1: 0.13170766830444336 (0.22538085973688535) | > loss_disc_real_2: 0.10836375504732132 (0.22269606575065728) | > loss_disc_real_3: 0.145172119140625 (0.24530304386755641) | > loss_disc_real_4: 0.19422577321529388 (0.24128359860303447) | > loss_disc_real_5: 0.08572022616863251 (0.23730032291377381) | > loss_0: 2.064748764038086 (2.493584915083282) | > grad_norm_0: tensor(507.5471, device='cuda:0') (tensor(533.1751, device='cuda:0')) | > loss_gen: 2.8558287620544434 (2.383428177055047) | > loss_kl: 0.5937891006469727 (0.8523639695984977) | > loss_feat: 10.23581314086914 (5.6220843686285065) | > loss_mel: 37.083534240722656 (21.96942886041135) | > loss_duration: 1.561311960220337 (1.470951790712318) | > loss_1: 52.33027648925781 (32.298257049249145) | > grad_norm_1: tensor(86472.6250, device='cuda:0') (tensor(21362.3242, device='cuda:0')) | > current_lr_0: 0.00011504033444415783 | > current_lr_1: 0.00011504033444415783 | > step_time: 0.8543 (0.6263730963882134) | > loader_time: 0.3971 (0.031535878473398636)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.062608242034912 (3.062608242034912) | > loss_disc_real_0: 0.20317772030830383 (0.20317772030830383) | > loss_disc_real_1: 0.2762628495693207 (0.2762628495693207) | > loss_disc_real_2: 0.34742531180381775 (0.34742531180381775) | > loss_disc_real_3: 0.33085131645202637 (0.33085131645202637) | > loss_disc_real_4: 0.3819410800933838 (0.3819410800933838) | > loss_disc_real_5: 0.48541006445884705 (0.48541006445884705) | > loss_0: 3.062608242034912 (3.062608242034912) | > loss_gen: 2.3559916019439697 (2.3559916019439697) | > loss_kl: 3.80993914604187 (3.80993914604187) | > loss_feat: 4.209560871124268 (4.209560871124268) | > loss_mel: 26.066865921020508 (26.066865921020508) | > loss_duration: 2.6569132804870605 (2.6569132804870605) | > loss_1: 39.09926986694336 (39.09926986694336)  --> STEP: 1 | > loss_disc: 3.053091526031494 (3.053091526031494) | > loss_disc_real_0: 0.0444524921476841 (0.0444524921476841) | > loss_disc_real_1: 0.24231292307376862 (0.24231292307376862) | > loss_disc_real_2: 0.2815323770046234 (0.2815323770046234) | > loss_disc_real_3: 0.4242604672908783 (0.4242604672908783) | > loss_disc_real_4: 0.2387019544839859 (0.2387019544839859) | > loss_disc_real_5: 0.243398517370224 (0.243398517370224) | > loss_0: 3.053091526031494 (3.053091526031494) | > loss_gen: 1.6708874702453613 (1.6708874702453613) | > loss_kl: 4.2314839363098145 (4.2314839363098145) | > loss_feat: 5.27919864654541 (5.27919864654541) | > loss_mel: 22.935867309570312 (22.935867309570312) | > loss_duration: 2.8652193546295166 (2.8652193546295166) | > loss_1: 36.9826545715332 (36.9826545715332)  --> STEP: 2 | > loss_disc: 3.1324892044067383 (3.092790365219116) | > loss_disc_real_0: 0.26505210995674133 (0.15475230105221272) | > loss_disc_real_1: 0.2955934703350067 (0.26895319670438766) | > loss_disc_real_2: 0.3789748251438141 (0.33025360107421875) | > loss_disc_real_3: 0.27575036883354187 (0.3500054180622101) | > loss_disc_real_4: 0.3657187521457672 (0.30221035331487656) | > loss_disc_real_5: 0.5111840963363647 (0.3772913068532944) | > loss_0: 3.1324892044067383 (3.092790365219116) | > loss_gen: 2.465373992919922 (2.0681307315826416) | > loss_kl: 4.557435035705566 (4.39445948600769) | > loss_feat: 4.368162631988525 (4.823680639266968) | > loss_mel: 30.745508193969727 (26.84068775177002) | > loss_duration: 2.8024048805236816 (2.833812117576599) | > loss_1: 44.93888473510742 (40.96076965332031)  --> STEP: 3 | > loss_disc: 3.0192863941192627 (3.068289041519165) | > loss_disc_real_0: 0.2133735716342926 (0.17429272457957268) | > loss_disc_real_1: 0.2651492655277252 (0.2676852196455002) | > loss_disc_real_2: 0.29453423619270325 (0.31834714611371356) | > loss_disc_real_3: 0.2546069324016571 (0.31820592284202576) | > loss_disc_real_4: 0.23318596184253693 (0.2792022228240967) | > loss_disc_real_5: 0.29181110858917236 (0.34879790743192035) | > loss_0: 3.0192863941192627 (3.068289041519165) | > loss_gen: 1.5467798709869385 (1.894347111384074) | > loss_kl: 2.568114995956421 (3.785677989323934) | > loss_feat: 0.02809765189886093 (3.225152976810932) | > loss_mel: 1.8880605697631836 (18.523145357767742) | > loss_duration: 2.647067070007324 (2.771563768386841) | > loss_1: 8.678119659423828 (30.199886322021484) --> EVAL PERFORMANCE | > avg_loader_time: 0.013100306193033854 (-0.009512503941853842) | > avg_loss_disc: 3.068289041519165 (+0.45137230555216457) | > avg_loss_disc_real_0: 0.17429272457957268 (-0.06138802443941435) | > avg_loss_disc_real_1: 0.2676852196455002 (+0.03192971646785736) | > avg_loss_disc_real_2: 0.31834714611371356 (+0.15105965733528134) | > avg_loss_disc_real_3: 0.31820592284202576 (+0.08445352812608084) | > avg_loss_disc_real_4: 0.2792022228240967 (+0.06525180488824844) | > avg_loss_disc_real_5: 0.34879790743192035 (+0.12982773532470065) | > avg_loss_0: 3.068289041519165 (+0.45137230555216457) | > avg_loss_gen: 1.894347111384074 (+0.05318824450174975) | > avg_loss_kl: 3.785677989323934 (+0.376147985458374) | > avg_loss_feat: 3.225152976810932 (-0.7328252717852592) | > avg_loss_mel: 18.523145357767742 (+2.5091439882914237) | > avg_loss_duration: 2.771563768386841 (-0.09921805063883449) | > avg_loss_1: 30.199886322021484 (+2.1064360936482736)  > EPOCH: 554/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:47:14)   --> TIME: 2023-10-20 05:47:39 -- STEP: 29/50 -- GLOBAL_STEP: 80730 | > loss_disc: 2.1356871128082275 (2.464173349840887) | > loss_disc_real_0: 0.127823144197464 (0.1621537833506691) | > loss_disc_real_1: 0.2665875554084778 (0.2405763102759575) | > loss_disc_real_2: 0.4050239324569702 (0.2513388570012718) | > loss_disc_real_3: 0.2742197811603546 (0.24781140505239876) | > loss_disc_real_4: 0.2309969961643219 (0.2190779383326399) | > loss_disc_real_5: 0.12710566818714142 (0.2124029361353866) | > loss_0: 2.1356871128082275 (2.464173349840887) | > grad_norm_0: tensor(1013.2357, device='cuda:0') (tensor(1019.9045, device='cuda:0')) | > loss_gen: 3.0602011680603027 (2.4007602724535713) | > loss_kl: 0.6567962169647217 (0.8703356405784344) | > loss_feat: 7.217565059661865 (5.5952554215388055) | > loss_mel: 25.468881607055664 (21.280383716369496) | > loss_duration: 1.4559776782989502 (1.4809593825504697) | > loss_1: 37.85942077636719 (31.627694064173205) | > grad_norm_1: tensor(46320.5117, device='cuda:0') (tensor(44847.6914, device='cuda:0')) | > current_lr_0: 0.00011492534442727937 | > current_lr_1: 0.00011492534442727937 | > step_time: 0.4933 (0.6226817657207621) | > loader_time: 0.0536 (0.021795412589763773)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8689017295837402 (1.8689017295837402) | > loss_disc_real_0: 0.08214505761861801 (0.08214505761861801) | > loss_disc_real_1: 0.11731322109699249 (0.11731322109699249) | > loss_disc_real_2: 0.2329973727464676 (0.2329973727464676) | > loss_disc_real_3: 0.19555558264255524 (0.19555558264255524) | > loss_disc_real_4: 0.09886397421360016 (0.09886397421360016) | > loss_disc_real_5: 0.10451149940490723 (0.10451149940490723) | > loss_0: 1.8689017295837402 (1.8689017295837402) | > loss_gen: 2.268845319747925 (2.268845319747925) | > loss_kl: 4.938342571258545 (4.938342571258545) | > loss_feat: 10.348587036132812 (10.348587036132812) | > loss_mel: 26.521583557128906 (26.521583557128906) | > loss_duration: 2.6245787143707275 (2.6245787143707275) | > loss_1: 46.70193862915039 (46.70193862915039)  --> STEP: 1 | > loss_disc: 3.054567575454712 (3.054567575454712) | > loss_disc_real_0: 0.41786837577819824 (0.41786837577819824) | > loss_disc_real_1: 0.25661763548851013 (0.25661763548851013) | > loss_disc_real_2: 0.3493642807006836 (0.3493642807006836) | > loss_disc_real_3: 0.310451477766037 (0.310451477766037) | > loss_disc_real_4: 0.34273502230644226 (0.34273502230644226) | > loss_disc_real_5: 0.27033019065856934 (0.27033019065856934) | > loss_0: 3.054567575454712 (3.054567575454712) | > loss_gen: 2.350297451019287 (2.350297451019287) | > loss_kl: 3.9500374794006348 (3.9500374794006348) | > loss_feat: 6.224913597106934 (6.224913597106934) | > loss_mel: 23.42952537536621 (23.42952537536621) | > loss_duration: 2.867771625518799 (2.867771625518799) | > loss_1: 38.82254409790039 (38.82254409790039)  --> STEP: 2 | > loss_disc: 2.9782142639160156 (3.0163909196853638) | > loss_disc_real_0: 0.1636713147163391 (0.2907698452472687) | > loss_disc_real_1: 0.25994038581848145 (0.2582790106534958) | > loss_disc_real_2: 0.23857563734054565 (0.2939699590206146) | > loss_disc_real_3: 0.30099642276763916 (0.3057239502668381) | > loss_disc_real_4: 0.3409501016139984 (0.34184256196022034) | > loss_disc_real_5: 0.2949090301990509 (0.2826196104288101) | > loss_0: 2.9782142639160156 (3.0163909196853638) | > loss_gen: 1.6877973079681396 (2.0190473794937134) | > loss_kl: 4.3729376792907715 (4.161487579345703) | > loss_feat: 1.1734668016433716 (3.6991901993751526) | > loss_mel: 10.390101432800293 (16.909813404083252) | > loss_duration: 2.7204718589782715 (2.794121742248535) | > loss_1: 20.344776153564453 (29.583660125732422)  --> STEP: 3 | > loss_disc: 2.8632616996765137 (2.9653478463490806) | > loss_disc_real_0: 0.1522972285747528 (0.24461230635643005) | > loss_disc_real_1: 0.3159083425998688 (0.27748878796895343) | > loss_disc_real_2: 0.3128100633621216 (0.30024999380111694) | > loss_disc_real_3: 0.30113133788108826 (0.30419307947158813) | > loss_disc_real_4: 0.31691285967826843 (0.3335326611995697) | > loss_disc_real_5: 0.29860615730285645 (0.28794845938682556) | > loss_0: 2.8632616996765137 (2.9653478463490806) | > loss_gen: 1.8935391902923584 (1.977211316426595) | > loss_kl: 1.9369508028030396 (3.4199753204981485) | > loss_feat: 0.858823299407959 (2.7524012327194214) | > loss_mel: 21.318660736083984 (18.37942918141683) | > loss_duration: 2.626147508621216 (2.7381303310394287) | > loss_1: 28.634122848510742 (29.267147699991863) --> EVAL PERFORMANCE | > avg_loader_time: 0.009958823521931967 (-0.003141482671101887) | > avg_loss_disc: 2.9653478463490806 (-0.10294119517008449) | > avg_loss_disc_real_0: 0.24461230635643005 (+0.07031958177685738) | > avg_loss_disc_real_1: 0.27748878796895343 (+0.009803568323453249) | > avg_loss_disc_real_2: 0.30024999380111694 (-0.01809715231259662) | > avg_loss_disc_real_3: 0.30419307947158813 (-0.014012843370437622) | > avg_loss_disc_real_4: 0.3335326611995697 (+0.05433043837547302) | > avg_loss_disc_real_5: 0.28794845938682556 (-0.06084944804509479) | > avg_loss_0: 2.9653478463490806 (-0.10294119517008449) | > avg_loss_gen: 1.977211316426595 (+0.08286420504252101) | > avg_loss_kl: 3.4199753204981485 (-0.3657026688257856) | > avg_loss_feat: 2.7524012327194214 (-0.4727517440915108) | > avg_loss_mel: 18.37942918141683 (-0.14371617635091383) | > avg_loss_duration: 2.7381303310394287 (-0.03343343734741211) | > avg_loss_1: 29.267147699991863 (-0.9327386220296212)  > EPOCH: 555/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:48:01)   --> TIME: 2023-10-20 05:48:12 -- STEP: 9/50 -- GLOBAL_STEP: 80760 | > loss_disc: 3.0976998805999756 (2.5788451035817466) | > loss_disc_real_0: 0.5154548287391663 (0.17226617514259285) | > loss_disc_real_1: 0.2744307518005371 (0.24274959870510632) | > loss_disc_real_2: 0.23030133545398712 (0.2284457099934419) | > loss_disc_real_3: 0.2664765417575836 (0.2620953738482462) | > loss_disc_real_4: 0.2724801003932953 (0.2328963838517666) | > loss_disc_real_5: 0.2563048303127289 (0.24771877378225327) | > loss_0: 3.0976998805999756 (2.5788451035817466) | > grad_norm_0: tensor(2445.2012, device='cuda:0') (tensor(1386.3876, device='cuda:0')) | > loss_gen: 1.7102874517440796 (2.1799274153179593) | > loss_kl: 0.6966035962104797 (0.712556971444024) | > loss_feat: 0.032309338450431824 (4.7891110761298075) | > loss_mel: 2.263913631439209 (19.869629277123344) | > loss_duration: 1.374391794204712 (1.4691117074754503) | > loss_1: 6.077506065368652 (29.020336680942112) | > grad_norm_1: tensor(85258.6641, device='cuda:0') (tensor(45360.3945, device='cuda:0')) | > current_lr_0: 0.00011481046935012224 | > current_lr_1: 0.00011481046935012224 | > step_time: 0.4214 (0.6136845217810737) | > loader_time: 0.0337 (0.0228526857164171)  --> TIME: 2023-10-20 05:48:31 -- STEP: 39/50 -- GLOBAL_STEP: 80790 | > loss_disc: 2.414200782775879 (2.520818147903834) | > loss_disc_real_0: 0.17417514324188232 (0.14967226776748133) | > loss_disc_real_1: 0.20038463175296783 (0.23594908301646894) | > loss_disc_real_2: 0.18712204694747925 (0.22653603138258824) | > loss_disc_real_3: 0.1912979781627655 (0.2696025351253457) | > loss_disc_real_4: 0.21688999235630035 (0.21896044852641913) | > loss_disc_real_5: 0.17660360038280487 (0.24292633501000893) | > loss_0: 2.414200782775879 (2.520818147903834) | > grad_norm_0: tensor(1397.9414, device='cuda:0') (tensor(1262.8638, device='cuda:0')) | > loss_gen: 1.831626057624817 (2.312658597261478) | > loss_kl: 0.4801460802555084 (0.7904866098975525) | > loss_feat: 2.1850337982177734 (5.021685528067442) | > loss_mel: 17.49606704711914 (21.723323406317295) | > loss_duration: 1.508567452430725 (1.4661698127404237) | > loss_1: 23.501441955566406 (31.314324207794964) | > grad_norm_1: tensor(20177.5820, device='cuda:0') (tensor(45822.1211, device='cuda:0')) | > current_lr_0: 0.00011481046935012224 | > current_lr_1: 0.00011481046935012224 | > step_time: 0.5657 (0.6055252918830285) | > loader_time: 0.0139 (0.023322649491138946)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.450939655303955 (2.450939655303955) | > loss_disc_real_0: 0.05787642300128937 (0.05787642300128937) | > loss_disc_real_1: 0.23544250428676605 (0.23544250428676605) | > loss_disc_real_2: 0.27244627475738525 (0.27244627475738525) | > loss_disc_real_3: 0.19459545612335205 (0.19459545612335205) | > loss_disc_real_4: 0.20092174410820007 (0.20092174410820007) | > loss_disc_real_5: 0.21264050900936127 (0.21264050900936127) | > loss_0: 2.450939655303955 (2.450939655303955) | > loss_gen: 1.887696385383606 (1.887696385383606) | > loss_kl: 3.825166702270508 (3.825166702270508) | > loss_feat: 3.5965752601623535 (3.5965752601623535) | > loss_mel: 23.742525100708008 (23.742525100708008) | > loss_duration: 2.6510255336761475 (2.6510255336761475) | > loss_1: 35.70298767089844 (35.70298767089844)  --> STEP: 1 | > loss_disc: 2.720093250274658 (2.720093250274658) | > loss_disc_real_0: 0.04851643741130829 (0.04851643741130829) | > loss_disc_real_1: 0.1804029792547226 (0.1804029792547226) | > loss_disc_real_2: 0.19021905958652496 (0.19021905958652496) | > loss_disc_real_3: 0.27284905314445496 (0.27284905314445496) | > loss_disc_real_4: 0.24066628515720367 (0.24066628515720367) | > loss_disc_real_5: 0.20062753558158875 (0.20062753558158875) | > loss_0: 2.720093250274658 (2.720093250274658) | > loss_gen: 1.5266190767288208 (1.5266190767288208) | > loss_kl: 4.671175479888916 (4.671175479888916) | > loss_feat: 3.544748544692993 (3.544748544692993) | > loss_mel: 24.37615203857422 (24.37615203857422) | > loss_duration: 3.113271713256836 (3.113271713256836) | > loss_1: 37.231964111328125 (37.231964111328125)  --> STEP: 2 | > loss_disc: 3.2416152954101562 (2.9808542728424072) | > loss_disc_real_0: 0.2130938619375229 (0.1308051496744156) | > loss_disc_real_1: 0.2534897029399872 (0.2169463410973549) | > loss_disc_real_2: 0.3800828456878662 (0.2851509526371956) | > loss_disc_real_3: 0.285415381193161 (0.279132217168808) | > loss_disc_real_4: 0.25110378861427307 (0.24588503688573837) | > loss_disc_real_5: 0.33503445982933044 (0.2678309977054596) | > loss_0: 3.2416152954101562 (2.9808542728424072) | > loss_gen: 1.545248031616211 (1.5359335541725159) | > loss_kl: 4.536898136138916 (4.604036808013916) | > loss_feat: 2.0274674892425537 (2.7861080169677734) | > loss_mel: 23.73468017578125 (24.055416107177734) | > loss_duration: 2.9160244464874268 (3.0146480798721313) | > loss_1: 34.760318756103516 (35.99614143371582)  --> STEP: 3 | > loss_disc: 2.9671249389648438 (2.9762778282165527) | > loss_disc_real_0: 0.045572832226753235 (0.10239437719186147) | > loss_disc_real_1: 0.29408374428749084 (0.2426588088274002) | > loss_disc_real_2: 0.3860331177711487 (0.31877834101517993) | > loss_disc_real_3: 0.2905846834182739 (0.28294970591862995) | > loss_disc_real_4: 0.3007994592189789 (0.26418984433015186) | > loss_disc_real_5: 0.2922056019306183 (0.2759558657805125) | > loss_0: 2.9671249389648438 (2.9762778282165527) | > loss_gen: 1.840195655822754 (1.6373542547225952) | > loss_kl: 2.3423614501953125 (3.8501450220743814) | > loss_feat: 2.2407257556915283 (2.604313929875692) | > loss_mel: 19.32023048400879 (22.477020899454754) | > loss_duration: 2.794942617416382 (2.941412925720215) | > loss_1: 28.538454055786133 (33.51024564107259) --> EVAL PERFORMANCE | > avg_loader_time: 0.005850394566853841 (-0.004108428955078126) | > avg_loss_disc: 2.9762778282165527 (+0.010929981867472183) | > avg_loss_disc_real_0: 0.10239437719186147 (-0.1422179291645686) | > avg_loss_disc_real_1: 0.2426588088274002 (-0.034829979141553224) | > avg_loss_disc_real_2: 0.31877834101517993 (+0.01852834721406299) | > avg_loss_disc_real_3: 0.28294970591862995 (-0.02124337355295819) | > avg_loss_disc_real_4: 0.26418984433015186 (-0.06934281686941784) | > avg_loss_disc_real_5: 0.2759558657805125 (-0.011992593606313051) | > avg_loss_0: 2.9762778282165527 (+0.010929981867472183) | > avg_loss_gen: 1.6373542547225952 (-0.33985706170399976) | > avg_loss_kl: 3.8501450220743814 (+0.4301697015762329) | > avg_loss_feat: 2.604313929875692 (-0.1480873028437295) | > avg_loss_mel: 22.477020899454754 (+4.0975917180379255) | > avg_loss_duration: 2.941412925720215 (+0.20328259468078613) | > avg_loss_1: 33.51024564107259 (+4.24309794108073)  > EPOCH: 556/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:48:53)   --> TIME: 2023-10-20 05:49:14 -- STEP: 19/50 -- GLOBAL_STEP: 80820 | > loss_disc: 1.8788059949874878 (2.4998766497561804) | > loss_disc_real_0: 0.06651968508958817 (0.1660677329882195) | > loss_disc_real_1: 0.08513268828392029 (0.21808484196662903) | > loss_disc_real_2: 0.2711254954338074 (0.23775099511993558) | > loss_disc_real_3: 0.16066981852054596 (0.22648090084916667) | > loss_disc_real_4: 0.3366200029850006 (0.20850298141962603) | > loss_disc_real_5: 0.2057151049375534 (0.2383028231561184) | > loss_0: 1.8788059949874878 (2.4998766497561804) | > grad_norm_0: tensor(1102.5304, device='cuda:0') (tensor(1424.2001, device='cuda:0')) | > loss_gen: 3.3564720153808594 (2.296165397292689) | > loss_kl: 0.9074728488922119 (0.8494780095000016) | > loss_feat: 8.403059959411621 (4.588928231675374) | > loss_mel: 23.325382232666016 (18.708812650881317) | > loss_duration: 1.6232469081878662 (1.4886114660062288) | > loss_1: 37.615631103515625 (27.93199546713578) | > grad_norm_1: tensor(10859.1475, device='cuda:0') (tensor(44602.6680, device='cuda:0')) | > current_lr_0: 0.000114695709097797 | > current_lr_1: 0.000114695709097797 | > step_time: 0.4725 (0.5727644468608656) | > loader_time: 0.0414 (0.021109179446571757)  --> TIME: 2023-10-20 05:49:34 -- STEP: 49/50 -- GLOBAL_STEP: 80850 | > loss_disc: 3.0017123222351074 (2.4415784490351773) | > loss_disc_real_0: 0.27932995557785034 (0.14392510818659648) | > loss_disc_real_1: 0.3151308000087738 (0.21819692705662883) | > loss_disc_real_2: 0.19093433022499084 (0.22056830993720464) | > loss_disc_real_3: 0.3666699528694153 (0.24419744168313182) | > loss_disc_real_4: 0.3852599263191223 (0.2181691623539949) | > loss_disc_real_5: 0.3501545488834381 (0.2296821944111464) | > loss_0: 3.0017123222351074 (2.4415784490351773) | > grad_norm_0: tensor(1596.8767, device='cuda:0') (tensor(1182.8107, device='cuda:0')) | > loss_gen: 2.455777883529663 (2.3829957222451976) | > loss_kl: 0.5101712942123413 (0.7791454292909832) | > loss_feat: 4.441838264465332 (5.547689646482468) | > loss_mel: 24.914648056030273 (20.87540960798459) | > loss_duration: 1.564176082611084 (1.4575739369100453) | > loss_1: 33.8866081237793 (31.04281407959607) | > grad_norm_1: tensor(30257.1973, device='cuda:0') (tensor(48341.9727, device='cuda:0')) | > current_lr_0: 0.000114695709097797 | > current_lr_1: 0.000114695709097797 | > step_time: 0.5289 (0.6126879769928602) | > loader_time: 0.4191 (0.03150772075263821)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.683985948562622 (2.683985948562622) | > loss_disc_real_0: 0.11820250749588013 (0.11820250749588013) | > loss_disc_real_1: 0.35847899317741394 (0.35847899317741394) | > loss_disc_real_2: 0.38600289821624756 (0.38600289821624756) | > loss_disc_real_3: 0.29759955406188965 (0.29759955406188965) | > loss_disc_real_4: 0.25697842240333557 (0.25697842240333557) | > loss_disc_real_5: 0.3216671347618103 (0.3216671347618103) | > loss_0: 2.683985948562622 (2.683985948562622) | > loss_gen: 2.617849349975586 (2.617849349975586) | > loss_kl: 4.8442511558532715 (4.8442511558532715) | > loss_feat: 6.057344913482666 (6.057344913482666) | > loss_mel: 22.56683349609375 (22.56683349609375) | > loss_duration: 2.6749558448791504 (2.6749558448791504) | > loss_1: 38.76123809814453 (38.76123809814453)  --> STEP: 1 | > loss_disc: 3.1808817386627197 (3.1808817386627197) | > loss_disc_real_0: 0.07826393097639084 (0.07826393097639084) | > loss_disc_real_1: 0.3583909571170807 (0.3583909571170807) | > loss_disc_real_2: 0.4185175597667694 (0.4185175597667694) | > loss_disc_real_3: 0.190574511885643 (0.190574511885643) | > loss_disc_real_4: 0.32726550102233887 (0.32726550102233887) | > loss_disc_real_5: 0.29800641536712646 (0.29800641536712646) | > loss_0: 3.1808817386627197 (3.1808817386627197) | > loss_gen: 1.835886001586914 (1.835886001586914) | > loss_kl: 4.325878143310547 (4.325878143310547) | > loss_feat: 6.883689880371094 (6.883689880371094) | > loss_mel: 22.861045837402344 (22.861045837402344) | > loss_duration: 3.023909091949463 (3.023909091949463) | > loss_1: 38.93041229248047 (38.93041229248047)  --> STEP: 2 | > loss_disc: 2.0877931118011475 (2.6343374252319336) | > loss_disc_real_0: 0.17710350453853607 (0.12768371775746346) | > loss_disc_real_1: 0.22897040843963623 (0.29368068277835846) | > loss_disc_real_2: 0.09665851294994354 (0.2575880363583565) | > loss_disc_real_3: 0.06500912457704544 (0.12779181823134422) | > loss_disc_real_4: 0.039400793612003326 (0.1833331473171711) | > loss_disc_real_5: 0.07074000686407089 (0.18437321111559868) | > loss_0: 2.0877931118011475 (2.6343374252319336) | > loss_gen: 1.9220519065856934 (1.8789689540863037) | > loss_kl: 4.4231648445129395 (4.374521493911743) | > loss_feat: 11.166971206665039 (9.025330543518066) | > loss_mel: 32.28498458862305 (27.573015213012695) | > loss_duration: 2.822600841522217 (2.92325496673584) | > loss_1: 52.619773864746094 (45.77509307861328)  --> STEP: 3 | > loss_disc: 2.968057155609131 (2.745577335357666) | > loss_disc_real_0: 0.27972412109375 (0.1783638522028923) | > loss_disc_real_1: 0.28478196263313293 (0.29071444272994995) | > loss_disc_real_2: 0.15117108821868896 (0.22211572031180063) | > loss_disc_real_3: 0.3370435833930969 (0.19754240661859512) | > loss_disc_real_4: 0.233341783285141 (0.20000269263982773) | > loss_disc_real_5: 0.3520599901676178 (0.24026880413293839) | > loss_0: 2.968057155609131 (2.745577335357666) | > loss_gen: 2.0154876708984375 (1.9244751930236816) | > loss_kl: 2.3187880516052246 (3.689277013142904) | > loss_feat: 3.7396416664123535 (7.263434251149495) | > loss_mel: 22.42030143737793 (25.855443954467773) | > loss_duration: 2.7002670764923096 (2.8489256699879966) | > loss_1: 33.19448471069336 (41.581556955973305) --> EVAL PERFORMANCE | > avg_loader_time: 0.006557385126749675 (+0.0007069905598958339) | > avg_loss_disc: 2.745577335357666 (-0.23070049285888672) | > avg_loss_disc_real_0: 0.1783638522028923 (+0.07596947501103084) | > avg_loss_disc_real_1: 0.29071444272994995 (+0.048055633902549744) | > avg_loss_disc_real_2: 0.22211572031180063 (-0.0966626207033793) | > avg_loss_disc_real_3: 0.19754240661859512 (-0.08540729930003482) | > avg_loss_disc_real_4: 0.20000269263982773 (-0.06418715169032413) | > avg_loss_disc_real_5: 0.24026880413293839 (-0.035687061647574125) | > avg_loss_0: 2.745577335357666 (-0.23070049285888672) | > avg_loss_gen: 1.9244751930236816 (+0.2871209383010864) | > avg_loss_kl: 3.689277013142904 (-0.16086800893147757) | > avg_loss_feat: 7.263434251149495 (+4.659120321273804) | > avg_loss_mel: 25.855443954467773 (+3.3784230550130196) | > avg_loss_duration: 2.8489256699879966 (-0.09248725573221828) | > avg_loss_1: 41.581556955973305 (+8.071311314900711)  > EPOCH: 557/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:49:53)   --> TIME: 2023-10-20 05:50:15 -- STEP: 29/50 -- GLOBAL_STEP: 80880 | > loss_disc: 3.012308120727539 (2.4461703177156124) | > loss_disc_real_0: 0.2489602416753769 (0.1643154185008386) | > loss_disc_real_1: 0.2555326223373413 (0.23771471530199056) | > loss_disc_real_2: 0.2646695077419281 (0.22842965050247208) | > loss_disc_real_3: 0.2763904929161072 (0.23157688512884336) | > loss_disc_real_4: 0.2377777248620987 (0.22217442763262782) | > loss_disc_real_5: 0.27936863899230957 (0.2508616530946617) | > loss_0: 3.012308120727539 (2.4461703177156124) | > grad_norm_0: tensor(493.4754, device='cuda:0') (tensor(1225.9574, device='cuda:0')) | > loss_gen: 1.5128719806671143 (2.4155945202399947) | > loss_kl: 0.5122243762016296 (0.8025548715015938) | > loss_feat: 0.017669642344117165 (5.747287627759165) | > loss_mel: 3.001305103302002 (21.89954613817149) | > loss_duration: 1.405743956565857 (1.4751833101798748) | > loss_1: 6.449815273284912 (32.3401663550015) | > grad_norm_1: tensor(175293.5156, device='cuda:0') (tensor(58004.5625, device='cuda:0')) | > current_lr_0: 0.000114581063555529 | > current_lr_1: 0.000114581063555529 | > step_time: 0.7068 (0.5323808604273302) | > loader_time: 0.0019 (0.01918775459815716)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2856900691986084 (2.2856900691986084) | > loss_disc_real_0: 0.05420977622270584 (0.05420977622270584) | > loss_disc_real_1: 0.2551593482494354 (0.2551593482494354) | > loss_disc_real_2: 0.2893408238887787 (0.2893408238887787) | > loss_disc_real_3: 0.26622214913368225 (0.26622214913368225) | > loss_disc_real_4: 0.28437232971191406 (0.28437232971191406) | > loss_disc_real_5: 0.29077640175819397 (0.29077640175819397) | > loss_0: 2.2856900691986084 (2.2856900691986084) | > loss_gen: 2.8438754081726074 (2.8438754081726074) | > loss_kl: 3.496553659439087 (3.496553659439087) | > loss_feat: 4.722832679748535 (4.722832679748535) | > loss_mel: 27.336864471435547 (27.336864471435547) | > loss_duration: 2.697474718093872 (2.697474718093872) | > loss_1: 41.09760284423828 (41.09760284423828)  --> STEP: 1 | > loss_disc: 2.7808194160461426 (2.7808194160461426) | > loss_disc_real_0: 0.21267855167388916 (0.21267855167388916) | > loss_disc_real_1: 0.3457941710948944 (0.3457941710948944) | > loss_disc_real_2: 0.23902568221092224 (0.23902568221092224) | > loss_disc_real_3: 0.34773486852645874 (0.34773486852645874) | > loss_disc_real_4: 0.24995474517345428 (0.24995474517345428) | > loss_disc_real_5: 0.29656440019607544 (0.29656440019607544) | > loss_0: 2.7808194160461426 (2.7808194160461426) | > loss_gen: 2.233029365539551 (2.233029365539551) | > loss_kl: 3.9654674530029297 (3.9654674530029297) | > loss_feat: 4.013071537017822 (4.013071537017822) | > loss_mel: 25.007762908935547 (25.007762908935547) | > loss_duration: 2.9851295948028564 (2.9851295948028564) | > loss_1: 38.20446014404297 (38.20446014404297)  --> STEP: 2 | > loss_disc: 2.7499964237213135 (2.765407919883728) | > loss_disc_real_0: 0.3887876570224762 (0.3007331043481827) | > loss_disc_real_1: 0.31289565563201904 (0.3293449133634567) | > loss_disc_real_2: 0.262426495552063 (0.2507260888814926) | > loss_disc_real_3: 0.3049451410770416 (0.3263400048017502) | > loss_disc_real_4: 0.35088059306144714 (0.3004176691174507) | > loss_disc_real_5: 0.21854327619075775 (0.2575538381934166) | > loss_0: 2.7499964237213135 (2.765407919883728) | > loss_gen: 2.676224946975708 (2.4546271562576294) | > loss_kl: 4.7148213386535645 (4.340144395828247) | > loss_feat: 3.09169602394104 (3.552383780479431) | > loss_mel: 26.78546142578125 (25.8966121673584) | > loss_duration: 2.8262455463409424 (2.9056875705718994) | > loss_1: 40.09444808959961 (39.14945411682129)  --> STEP: 3 | > loss_disc: 3.1864466667175293 (2.9057541688283286) | > loss_disc_real_0: 0.4145156741142273 (0.3386606276035309) | > loss_disc_real_1: 0.3926958739757538 (0.3504619002342224) | > loss_disc_real_2: 0.22784492373466492 (0.24309903383255005) | > loss_disc_real_3: 0.2891887128353119 (0.31395624081293744) | > loss_disc_real_4: 0.4342156946659088 (0.34501701096693677) | > loss_disc_real_5: 0.3323776125907898 (0.28249509632587433) | > loss_0: 3.1864466667175293 (2.9057541688283286) | > loss_gen: 2.7247776985168457 (2.5446773370107016) | > loss_kl: 2.363126516342163 (3.6811384359995523) | > loss_feat: 3.5355277061462402 (3.546765089035034) | > loss_mel: 23.75611114501953 (25.183111826578777) | > loss_duration: 2.7610278129577637 (2.8574676513671875) | > loss_1: 35.14057159423828 (37.81315994262695) --> EVAL PERFORMANCE | > avg_loader_time: 0.033806165059407554 (+0.02724877993265788) | > avg_loss_disc: 2.9057541688283286 (+0.16017683347066258) | > avg_loss_disc_real_0: 0.3386606276035309 (+0.16029677540063858) | > avg_loss_disc_real_1: 0.3504619002342224 (+0.05974745750427246) | > avg_loss_disc_real_2: 0.24309903383255005 (+0.02098331352074942) | > avg_loss_disc_real_3: 0.31395624081293744 (+0.11641383419434231) | > avg_loss_disc_real_4: 0.34501701096693677 (+0.14501431832710904) | > avg_loss_disc_real_5: 0.28249509632587433 (+0.042226292192935944) | > avg_loss_0: 2.9057541688283286 (+0.16017683347066258) | > avg_loss_gen: 2.5446773370107016 (+0.62020214398702) | > avg_loss_kl: 3.6811384359995523 (-0.008138577143351533) | > avg_loss_feat: 3.546765089035034 (-3.716669162114461) | > avg_loss_mel: 25.183111826578777 (-0.6723321278889962) | > avg_loss_duration: 2.8574676513671875 (+0.008541981379190933) | > avg_loss_1: 37.81315994262695 (-3.768397013346352)  > EPOCH: 558/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:50:41)   --> TIME: 2023-10-20 05:50:53 -- STEP: 9/50 -- GLOBAL_STEP: 80910 | > loss_disc: 3.0507984161376953 (2.3618299431271024) | > loss_disc_real_0: 0.12672540545463562 (0.1545110936794016) | > loss_disc_real_1: 0.29801279306411743 (0.22547952168517643) | > loss_disc_real_2: 0.21835678815841675 (0.1644564378592703) | > loss_disc_real_3: 0.2579164206981659 (0.24036541167232725) | > loss_disc_real_4: 0.2464531511068344 (0.21724268794059753) | > loss_disc_real_5: 0.24846716225147247 (0.209602863010433) | > loss_0: 3.0507984161376953 (2.3618299431271024) | > grad_norm_0: tensor(1195.1052, device='cuda:0') (tensor(1179.1782, device='cuda:0')) | > loss_gen: 1.4017868041992188 (2.3551739586724176) | > loss_kl: 0.7002807259559631 (0.7950196199946933) | > loss_feat: 0.043558381497859955 (5.7454931942953005) | > loss_mel: 1.7250226736068726 (18.685504754384358) | > loss_duration: 1.4132332801818848 (1.4528454409705267) | > loss_1: 5.283882141113281 (29.034036530388725) | > grad_norm_1: tensor(43980.7969, device='cuda:0') (tensor(65790.1719, device='cuda:0')) | > current_lr_0: 0.0001144665326086584 | > current_lr_1: 0.0001144665326086584 | > step_time: 0.4124 (0.5812462435828315) | > loader_time: 0.0338 (0.024748484293619793)  --> TIME: 2023-10-20 05:51:15 -- STEP: 39/50 -- GLOBAL_STEP: 80940 | > loss_disc: 2.7292494773864746 (2.5077526110869184) | > loss_disc_real_0: 0.13339710235595703 (0.18832085740107757) | > loss_disc_real_1: 0.3360142111778259 (0.2278324917722971) | > loss_disc_real_2: 0.20746269822120667 (0.2251666234089778) | > loss_disc_real_3: 0.3005612790584564 (0.23261902424005362) | > loss_disc_real_4: 0.3415663242340088 (0.2330702149715179) | > loss_disc_real_5: 0.3188314437866211 (0.2257740273594092) | > loss_0: 2.7292494773864746 (2.5077526110869184) | > grad_norm_0: tensor(974.9278, device='cuda:0') (tensor(1241.6840, device='cuda:0')) | > loss_gen: 2.100599765777588 (2.2925416017190003) | > loss_kl: 0.4466063380241394 (0.8111360596540647) | > loss_feat: 2.09521746635437 (5.182684960655676) | > loss_mel: 23.478960037231445 (21.326480480340813) | > loss_duration: 1.4875648021697998 (1.4537458266967382) | > loss_1: 29.60894775390625 (31.066589184296436) | > grad_norm_1: tensor(24057.3086, device='cuda:0') (tensor(43049.6992, device='cuda:0')) | > current_lr_0: 0.0001144665326086584 | > current_lr_1: 0.0001144665326086584 | > step_time: 1.139 (0.670553947106386) | > loader_time: 0.0385 (0.023281225791344277)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6390321254730225 (2.6390321254730225) | > loss_disc_real_0: 0.27263084053993225 (0.27263084053993225) | > loss_disc_real_1: 0.2337922751903534 (0.2337922751903534) | > loss_disc_real_2: 0.2754826843738556 (0.2754826843738556) | > loss_disc_real_3: 0.3357903063297272 (0.3357903063297272) | > loss_disc_real_4: 0.30373579263687134 (0.30373579263687134) | > loss_disc_real_5: 0.20377600193023682 (0.20377600193023682) | > loss_0: 2.6390321254730225 (2.6390321254730225) | > loss_gen: 2.417879104614258 (2.417879104614258) | > loss_kl: 3.8303284645080566 (3.8303284645080566) | > loss_feat: 9.8514986038208 (9.8514986038208) | > loss_mel: 22.90205955505371 (22.90205955505371) | > loss_duration: 2.56974720954895 (2.56974720954895) | > loss_1: 41.571510314941406 (41.571510314941406)  --> STEP: 1 | > loss_disc: 1.949068307876587 (1.949068307876587) | > loss_disc_real_0: 0.16966795921325684 (0.16966795921325684) | > loss_disc_real_1: 0.2197580188512802 (0.2197580188512802) | > loss_disc_real_2: 0.2324010729789734 (0.2324010729789734) | > loss_disc_real_3: 0.16564011573791504 (0.16564011573791504) | > loss_disc_real_4: 0.19011957943439484 (0.19011957943439484) | > loss_disc_real_5: 0.1868649572134018 (0.1868649572134018) | > loss_0: 1.949068307876587 (1.949068307876587) | > loss_gen: 3.071047782897949 (3.071047782897949) | > loss_kl: 4.015008449554443 (4.015008449554443) | > loss_feat: 9.887115478515625 (9.887115478515625) | > loss_mel: 25.24491310119629 (25.24491310119629) | > loss_duration: 2.9618728160858154 (2.9618728160858154) | > loss_1: 45.17995834350586 (45.17995834350586)  --> STEP: 2 | > loss_disc: 1.680898666381836 (1.8149834871292114) | > loss_disc_real_0: 0.0709230825304985 (0.12029552087187767) | > loss_disc_real_1: 0.17415669560432434 (0.19695735722780228) | > loss_disc_real_2: 0.20520800352096558 (0.21880453824996948) | > loss_disc_real_3: 0.3419185280799866 (0.2537793219089508) | > loss_disc_real_4: 0.27001991868019104 (0.23006974905729294) | > loss_disc_real_5: 0.2352374941110611 (0.21105122566223145) | > loss_0: 1.680898666381836 (1.8149834871292114) | > loss_gen: 4.38447904586792 (3.7277634143829346) | > loss_kl: 3.9445369243621826 (3.979772686958313) | > loss_feat: 9.91091251373291 (9.899013996124268) | > loss_mel: 22.558979034423828 (23.90194606781006) | > loss_duration: 2.9313085079193115 (2.9465906620025635) | > loss_1: 43.73021697998047 (44.455087661743164)  --> STEP: 3 | > loss_disc: 1.7371286153793335 (1.7890318632125854) | > loss_disc_real_0: 0.06974606961011887 (0.10344570378462474) | > loss_disc_real_1: 0.23628920316696167 (0.2100679725408554) | > loss_disc_real_2: 0.09809466451406479 (0.1785679136713346) | > loss_disc_real_3: 0.15039527416229248 (0.2193179726600647) | > loss_disc_real_4: 0.12720537185668945 (0.19578162332375845) | > loss_disc_real_5: 0.07858038693666458 (0.16689427942037582) | > loss_0: 1.7371286153793335 (1.7890318632125854) | > loss_gen: 2.3039252758026123 (3.253150701522827) | > loss_kl: 2.118478536605835 (3.359341303507487) | > loss_feat: 5.604951858520508 (8.467659950256348) | > loss_mel: 25.184783935546875 (24.329558690388996) | > loss_duration: 2.7393765449523926 (2.8775192896525064) | > loss_1: 37.951515197753906 (42.28723017374674) --> EVAL PERFORMANCE | > avg_loader_time: 0.02082085609436035 (-0.012985308965047203) | > avg_loss_disc: 1.7890318632125854 (-1.1167223056157431) | > avg_loss_disc_real_0: 0.10344570378462474 (-0.23521492381890613) | > avg_loss_disc_real_1: 0.2100679725408554 (-0.140393927693367) | > avg_loss_disc_real_2: 0.1785679136713346 (-0.06453112016121546) | > avg_loss_disc_real_3: 0.2193179726600647 (-0.09463826815287274) | > avg_loss_disc_real_4: 0.19578162332375845 (-0.1492353876431783) | > avg_loss_disc_real_5: 0.16689427942037582 (-0.1156008169054985) | > avg_loss_0: 1.7890318632125854 (-1.1167223056157431) | > avg_loss_gen: 3.253150701522827 (+0.7084733645121255) | > avg_loss_kl: 3.359341303507487 (-0.32179713249206543) | > avg_loss_feat: 8.467659950256348 (+4.9208948612213135) | > avg_loss_mel: 24.329558690388996 (-0.853553136189781) | > avg_loss_duration: 2.8775192896525064 (+0.020051638285318862) | > avg_loss_1: 42.28723017374674 (+4.474070231119789)  > EPOCH: 559/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:51:34)   --> TIME: 2023-10-20 05:51:51 -- STEP: 19/50 -- GLOBAL_STEP: 80970 | > loss_disc: 1.4493895769119263 (2.541376747583088) | > loss_disc_real_0: 0.020744964480400085 (0.19080138833899246) | > loss_disc_real_1: 0.2016783356666565 (0.20442850319178482) | > loss_disc_real_2: 0.23014260828495026 (0.24883958795352987) | > loss_disc_real_3: 0.18147750198841095 (0.25077229042194393) | > loss_disc_real_4: 0.10418890416622162 (0.2271298644574065) | > loss_disc_real_5: 0.14867819845676422 (0.2065993534695161) | > loss_0: 1.4493895769119263 (2.541376747583088) | > grad_norm_0: tensor(606.0799, device='cuda:0') (tensor(1177.9711, device='cuda:0')) | > loss_gen: 3.9178617000579834 (2.3840652265046773) | > loss_kl: 0.9376199245452881 (0.9788147697323247) | > loss_feat: 10.9378023147583 (5.87207557457058) | > loss_mel: 26.12444305419922 (23.39075665724905) | > loss_duration: 1.6292237043380737 (1.5068978008471037) | > loss_1: 43.54695129394531 (34.13261032104492) | > grad_norm_1: tensor(101774.6641, device='cuda:0') (tensor(52868.6992, device='cuda:0')) | > current_lr_0: 0.00011435211614263989 | > current_lr_1: 0.00011435211614263989 | > step_time: 0.5414 (0.595006641588713) | > loader_time: 0.0082 (0.021467221410650956)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.695918321609497 (2.695918321609497) | > loss_disc_real_0: 0.2855980396270752 (0.2855980396270752) | > loss_disc_real_1: 0.2534205913543701 (0.2534205913543701) | > loss_disc_real_2: 0.3011782765388489 (0.3011782765388489) | > loss_disc_real_3: 0.3124985992908478 (0.3124985992908478) | > loss_disc_real_4: 0.3506809175014496 (0.3506809175014496) | > loss_disc_real_5: 0.25414347648620605 (0.25414347648620605) | > loss_0: 2.695918321609497 (2.695918321609497) | > loss_gen: 2.6413323879241943 (2.6413323879241943) | > loss_kl: 3.0552802085876465 (3.0552802085876465) | > loss_feat: 6.109553337097168 (6.109553337097168) | > loss_mel: 22.8697452545166 (22.8697452545166) | > loss_duration: 2.564751625061035 (2.564751625061035) | > loss_1: 37.240657806396484 (37.240657806396484)  --> STEP: 1 | > loss_disc: 2.643418073654175 (2.643418073654175) | > loss_disc_real_0: 0.17448444664478302 (0.17448444664478302) | > loss_disc_real_1: 0.23699495196342468 (0.23699495196342468) | > loss_disc_real_2: 0.2405649572610855 (0.2405649572610855) | > loss_disc_real_3: 0.35589078068733215 (0.35589078068733215) | > loss_disc_real_4: 0.14398494362831116 (0.14398494362831116) | > loss_disc_real_5: 0.1928817331790924 (0.1928817331790924) | > loss_0: 2.643418073654175 (2.643418073654175) | > loss_gen: 1.9348955154418945 (1.9348955154418945) | > loss_kl: 4.241034507751465 (4.241034507751465) | > loss_feat: 4.276993751525879 (4.276993751525879) | > loss_mel: 24.758813858032227 (24.758813858032227) | > loss_duration: 2.923685312271118 (2.923685312271118) | > loss_1: 38.13542175292969 (38.13542175292969)  --> STEP: 2 | > loss_disc: 3.028316020965576 (2.8358670473098755) | > loss_disc_real_0: 0.16043920814990997 (0.1674618273973465) | > loss_disc_real_1: 0.24858228862285614 (0.2427886202931404) | > loss_disc_real_2: 0.2651676535606384 (0.25286630541086197) | > loss_disc_real_3: 0.28731974959373474 (0.32160526514053345) | > loss_disc_real_4: 0.23196491599082947 (0.1879749298095703) | > loss_disc_real_5: 0.2453932911157608 (0.2191375121474266) | > loss_0: 3.028316020965576 (2.8358670473098755) | > loss_gen: 1.4382930994033813 (1.686594307422638) | > loss_kl: 4.591805458068848 (4.416419982910156) | > loss_feat: 0.030081728473305702 (2.1535377399995923) | > loss_mel: 1.9035613536834717 (13.33118760585785) | > loss_duration: 2.7475528717041016 (2.83561909198761) | > loss_1: 10.711294174194336 (24.42335796356201)  --> STEP: 3 | > loss_disc: 2.755728244781494 (2.8091541131337485) | > loss_disc_real_0: 0.0908646211028099 (0.14192942529916763) | > loss_disc_real_1: 0.2575205862522125 (0.24769927561283112) | > loss_disc_real_2: 0.26657310128211975 (0.2574352373679479) | > loss_disc_real_3: 0.38571807742118835 (0.3429762025674184) | > loss_disc_real_4: 0.3409832715988159 (0.2389777104059855) | > loss_disc_real_5: 0.3004033863544464 (0.24622613688309988) | > loss_0: 2.755728244781494 (2.8091541131337485) | > loss_gen: 2.175057888031006 (1.8494155009587605) | > loss_kl: 2.0766124725341797 (3.636484146118164) | > loss_feat: 3.830697536468506 (2.71259100548923) | > loss_mel: 19.238540649414062 (15.300305287043253) | > loss_duration: 2.750399112701416 (2.8072124322255454) | > loss_1: 30.071308135986328 (26.306008021036785)  --> TIME: 2023-10-20 05:52:19 -- STEP: 49/50 -- GLOBAL_STEP: 81000 | > loss_disc: 1.4582033157348633 (2.4494730939670486) | > loss_disc_real_0: 0.03949977457523346 (0.15794678815469454) | > loss_disc_real_1: 0.08319658786058426 (0.22613057190058183) | > loss_disc_real_2: 0.12385553866624832 (0.23180142356729022) | > loss_disc_real_3: 0.03865659609436989 (0.233415397967459) | > loss_disc_real_4: 0.1570158451795578 (0.2152288963219949) | > loss_disc_real_5: 0.1402028501033783 (0.21237919452999318) | > loss_0: 1.4582033157348633 (2.4494730939670486) | > grad_norm_0: tensor(1198.1626, device='cuda:0') (tensor(1328.1984, device='cuda:0')) | > loss_gen: 2.94732403755188 (2.3021169219698225) | > loss_kl: 0.9267892837524414 (0.9222221362347506) | > loss_feat: 10.652772903442383 (5.070820017584734) | > loss_mel: 35.77080154418945 (21.985219128277848) | > loss_duration: 1.6043145656585693 (1.470290507589068) | > loss_1: 51.902000427246094 (31.750668837099663) | > grad_norm_1: tensor(206586.0469, device='cuda:0') (tensor(41924.2031, device='cuda:0')) | > current_lr_0: 0.00011435211614263989 | > current_lr_1: 0.00011435211614263989 | > step_time: 2.2881 (0.6108578613826207) | > loader_time: 7.9236 (0.18204116334720533) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_81000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8693723678588867 (2.824208676815033) | > loss_disc_real_0: 0.20618149638175964 (0.15799244306981564) | > loss_disc_real_1: 0.2642952799797058 (0.2518482767045498) | > loss_disc_real_2: 0.271940141916275 (0.2610614635050297) | > loss_disc_real_3: 0.350745290517807 (0.34491847455501556) | > loss_disc_real_4: 0.3486904501914978 (0.2664058953523636) | > loss_disc_real_5: 0.43738895654678345 (0.29401684179902077) | > loss_0: 2.8693723678588867 (2.824208676815033) | > loss_gen: 2.2517759799957275 (1.9500056207180023) | > loss_kl: 3.660407304763794 (3.6424649357795715) | > loss_feat: 4.1111063957214355 (3.0622198530472815) | > loss_mel: 22.919111251831055 (17.205006778240204) | > loss_duration: 2.634181022644043 (2.7639545798301697) | > loss_1: 35.57658386230469 (28.62365198135376)  --> STEP: 1 | > loss_disc: 2.54484486579895 (2.7683359146118165) | > loss_disc_real_0: 0.1893424391746521 (0.16426244229078293) | > loss_disc_real_1: 0.202920064330101 (0.24206263422966004) | > loss_disc_real_2: 0.21015077829360962 (0.2508793264627457) | > loss_disc_real_3: 0.3405071496963501 (0.34403620958328246) | > loss_disc_real_4: 0.20350155234336853 (0.25382502675056456) | > loss_disc_real_5: 0.2621026039123535 (0.28763399422168734) | > loss_0: 2.54484486579895 (2.7683359146118165) | > loss_gen: 2.095019817352295 (1.9790084600448608) | > loss_kl: 4.20280647277832 (3.7545332431793215) | > loss_feat: 2.835840940475464 (3.016944070532918) | > loss_mel: 22.148029327392578 (18.193611288070677) | > loss_duration: 2.9943315982818604 (2.810029983520508) | > loss_1: 34.27602767944336 (29.75412712097168)  --> STEP: 2 | > loss_disc: 3.3625247478485107 (2.867367386817932) | > loss_disc_real_0: 0.35469239950180054 (0.1960007684926192) | > loss_disc_real_1: 0.36887219548225403 (0.26319756110509235) | > loss_disc_real_2: 0.4297560155391693 (0.28069210797548294) | > loss_disc_real_3: 0.32240086793899536 (0.3404303193092346) | > loss_disc_real_4: 0.35117170214653015 (0.27004947264989215) | > loss_disc_real_5: 0.4193144142627716 (0.3095807308952014) | > loss_0: 3.3625247478485107 (2.867367386817932) | > loss_gen: 2.1675052642822266 (2.0104245940844216) | > loss_kl: 4.547393798828125 (3.8866766691207886) | > loss_feat: 4.237483501434326 (3.220367309016486) | > loss_mel: 27.314958572387695 (19.713835835456848) | > loss_duration: 2.861642599105835 (2.8186320861180625) | > loss_1: 41.12898254394531 (31.649936358133953)  --> STEP: 3 | > loss_disc: 3.028247356414795 (2.890350239617484) | > loss_disc_real_0: 0.1853315681219101 (0.19447659701108932) | > loss_disc_real_1: 0.2505711019039154 (0.2613937812192099) | > loss_disc_real_2: 0.2593331038951874 (0.27764082167829784) | > loss_disc_real_3: 0.3025572896003723 (0.33501988649368286) | > loss_disc_real_4: 0.22975744307041168 (0.2642934684242521) | > loss_disc_real_5: 0.2480630725622177 (0.3007924939904894) | > loss_0: 3.028247356414795 (2.890350239617484) | > loss_gen: 1.4687211513519287 (1.93303838797978) | > loss_kl: 2.3548052310943604 (3.6678378922598704) | > loss_feat: 0.059250980615615845 (2.768779262102076) | > loss_mel: 2.245229959487915 (17.21832071031843) | > loss_duration: 2.722137212753296 (2.80484710420881) | > loss_1: 8.85014533996582 (28.392823355538503) --> EVAL PERFORMANCE | > avg_loader_time: 0.4353463649749756 (+0.41452550888061523) | > avg_loss_disc: 2.890350239617484 (+1.1013183764048984) | > avg_loss_disc_real_0: 0.19447659701108932 (+0.09103089322646458) | > avg_loss_disc_real_1: 0.2613937812192099 (+0.05132580867835451) | > avg_loss_disc_real_2: 0.27764082167829784 (+0.09907290800696325) | > avg_loss_disc_real_3: 0.33501988649368286 (+0.11570191383361816) | > avg_loss_disc_real_4: 0.2642934684242521 (+0.06851184510049366) | > avg_loss_disc_real_5: 0.3007924939904894 (+0.13389821457011358) | > avg_loss_0: 2.890350239617484 (+1.1013183764048984) | > avg_loss_gen: 1.93303838797978 (-1.3201123135430473) | > avg_loss_kl: 3.6678378922598704 (+0.3084965887523836) | > avg_loss_feat: 2.768779262102076 (-5.698880688154272) | > avg_loss_mel: 17.21832071031843 (-7.111237980070566) | > avg_loss_duration: 2.80484710420881 (-0.07267218544369625) | > avg_loss_1: 28.392823355538503 (-13.894406818208239)  > EPOCH: 560/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:52:35)   --> TIME: 2023-10-20 05:52:57 -- STEP: 29/50 -- GLOBAL_STEP: 81030 | > loss_disc: 2.1712422370910645 (2.4329648634483085) | > loss_disc_real_0: 0.07613382488489151 (0.14651429499017782) | > loss_disc_real_1: 0.23167121410369873 (0.23018468839341197) | > loss_disc_real_2: 0.17804153263568878 (0.24216152676220598) | > loss_disc_real_3: 0.35464996099472046 (0.2515655170226919) | > loss_disc_real_4: 0.25309354066848755 (0.20610037002840947) | > loss_disc_real_5: 0.2215886414051056 (0.22252093695489497) | > loss_0: 2.1712422370910645 (2.4329648634483085) | > grad_norm_0: tensor(540.0482, device='cuda:0') (tensor(1031.6365, device='cuda:0')) | > loss_gen: 2.720461368560791 (2.404368022392536) | > loss_kl: 0.9084691405296326 (0.9235556177024183) | > loss_feat: 5.502227306365967 (6.554978258137045) | > loss_mel: 21.90032196044922 (23.524992437198243) | > loss_duration: 1.4511616230010986 (1.4651317719755501) | > loss_1: 32.48263931274414 (34.87302610791963) | > grad_norm_1: tensor(48912.9648, device='cuda:0') (tensor(64759.7695, device='cuda:0')) | > current_lr_0: 0.0001142378140430427 | > current_lr_1: 0.0001142378140430427 | > step_time: 1.0595 (0.5241194429068731) | > loader_time: 0.0367 (0.01564921181777428)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3233180046081543 (2.3233180046081543) | > loss_disc_real_0: 0.3015712797641754 (0.3015712797641754) | > loss_disc_real_1: 0.09869938343763351 (0.09869938343763351) | > loss_disc_real_2: 0.21609513461589813 (0.21609513461589813) | > loss_disc_real_3: 0.07835374772548676 (0.07835374772548676) | > loss_disc_real_4: 0.2295779138803482 (0.2295779138803482) | > loss_disc_real_5: 0.10808354616165161 (0.10808354616165161) | > loss_0: 2.3233180046081543 (2.3233180046081543) | > loss_gen: 2.187793493270874 (2.187793493270874) | > loss_kl: 3.4269449710845947 (3.4269449710845947) | > loss_feat: 9.839250564575195 (9.839250564575195) | > loss_mel: 26.769731521606445 (26.769731521606445) | > loss_duration: 2.683534860610962 (2.683534860610962) | > loss_1: 44.907257080078125 (44.907257080078125)  --> STEP: 1 | > loss_disc: 2.4506595134735107 (2.4506595134735107) | > loss_disc_real_0: 0.16197647154331207 (0.16197647154331207) | > loss_disc_real_1: 0.22825360298156738 (0.22825360298156738) | > loss_disc_real_2: 0.15995396673679352 (0.15995396673679352) | > loss_disc_real_3: 0.2577569782733917 (0.2577569782733917) | > loss_disc_real_4: 0.21403856575489044 (0.21403856575489044) | > loss_disc_real_5: 0.1896076202392578 (0.1896076202392578) | > loss_0: 2.4506595134735107 (2.4506595134735107) | > loss_gen: 2.0584826469421387 (2.0584826469421387) | > loss_kl: 4.31787109375 (4.31787109375) | > loss_feat: 4.740248680114746 (4.740248680114746) | > loss_mel: 23.801494598388672 (23.801494598388672) | > loss_duration: 3.072103261947632 (3.072103261947632) | > loss_1: 37.99020004272461 (37.99020004272461)  --> STEP: 2 | > loss_disc: 3.0288829803466797 (2.739771246910095) | > loss_disc_real_0: 0.230692058801651 (0.19633426517248154) | > loss_disc_real_1: 0.2548410892486572 (0.2415473461151123) | > loss_disc_real_2: 0.28432729840278625 (0.2221406325697899) | > loss_disc_real_3: 0.26955652236938477 (0.26365675032138824) | > loss_disc_real_4: 0.2934197783470154 (0.2537291720509529) | > loss_disc_real_5: 0.3210669755935669 (0.25533729791641235) | > loss_0: 3.0288829803466797 (2.739771246910095) | > loss_gen: 1.6356704235076904 (1.8470765352249146) | > loss_kl: 4.76685094833374 (4.54236102104187) | > loss_feat: 0.15480650961399078 (2.4475275948643684) | > loss_mel: 7.981581687927246 (15.891538143157959) | > loss_duration: 2.960355281829834 (3.016229271888733) | > loss_1: 17.499265670776367 (27.74473285675049)  --> STEP: 3 | > loss_disc: 3.1388468742370605 (2.8727964560190835) | > loss_disc_real_0: 0.3341764807701111 (0.24228167037169138) | > loss_disc_real_1: 0.23979264497756958 (0.2409624457359314) | > loss_disc_real_2: 0.2822933793067932 (0.24219154814879099) | > loss_disc_real_3: 0.18364262580871582 (0.23698537548383078) | > loss_disc_real_4: 0.3435972034931183 (0.2836851825316747) | > loss_disc_real_5: 0.15996471047401428 (0.223546435435613) | > loss_0: 3.1388468742370605 (2.8727964560190835) | > loss_gen: 1.9409593343734741 (1.8783708016077678) | > loss_kl: 2.1117029190063477 (3.732141653696696) | > loss_feat: 5.100067615509033 (3.3317076017459235) | > loss_mel: 27.424678802490234 (19.735918362935383) | > loss_duration: 2.7630388736724854 (2.931832472483317) | > loss_1: 39.34044647216797 (31.609970728556316) --> EVAL PERFORMANCE | > avg_loader_time: 0.009841283162434896 (-0.4255050818125407) | > avg_loss_disc: 2.8727964560190835 (-0.01755378359840032) | > avg_loss_disc_real_0: 0.24228167037169138 (+0.04780507336060205) | > avg_loss_disc_real_1: 0.2409624457359314 (-0.020431335483278523) | > avg_loss_disc_real_2: 0.24219154814879099 (-0.03544927352950686) | > avg_loss_disc_real_3: 0.23698537548383078 (-0.09803451100985208) | > avg_loss_disc_real_4: 0.2836851825316747 (+0.019391714107422575) | > avg_loss_disc_real_5: 0.223546435435613 (-0.0772460585548764) | > avg_loss_0: 2.8727964560190835 (-0.01755378359840032) | > avg_loss_gen: 1.8783708016077678 (-0.05466758637201208) | > avg_loss_kl: 3.732141653696696 (+0.06430376143682537) | > avg_loss_feat: 3.3317076017459235 (+0.5629283396438476) | > avg_loss_mel: 19.735918362935383 (+2.517597652616953) | > avg_loss_duration: 2.931832472483317 (+0.1269853682745068) | > avg_loss_1: 31.609970728556316 (+3.217147373017813)  > EPOCH: 561/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:53:26)   --> TIME: 2023-10-20 05:53:39 -- STEP: 9/50 -- GLOBAL_STEP: 81060 | > loss_disc: 2.878349542617798 (2.286951462427775) | > loss_disc_real_0: 0.1739341914653778 (0.13503730421264967) | > loss_disc_real_1: 0.28437748551368713 (0.18942464453478655) | > loss_disc_real_2: 0.2813400328159332 (0.18330187847216925) | > loss_disc_real_3: 0.3323490023612976 (0.19449424226250914) | > loss_disc_real_4: 0.27629992365837097 (0.17580652485291162) | > loss_disc_real_5: 0.2585150897502899 (0.15932327467534277) | > loss_0: 2.878349542617798 (2.286951462427775) | > grad_norm_0: tensor(776.4669, device='cuda:0') (tensor(897.1014, device='cuda:0')) | > loss_gen: 1.7512247562408447 (2.268114765485128) | > loss_kl: 0.5632281303405762 (0.8732152581214905) | > loss_feat: 0.4219653904438019 (6.384092519680658) | > loss_mel: 18.70136833190918 (22.25514136420356) | > loss_duration: 1.4376188516616821 (1.4565867318047419) | > loss_1: 22.875404357910156 (33.237149980333115) | > grad_norm_1: tensor(35137.9414, device='cuda:0') (tensor(44927.9023, device='cuda:0')) | > current_lr_0: 0.00011412362619555044 | > current_lr_1: 0.00011412362619555044 | > step_time: 0.6428 (0.6207926008436415) | > loader_time: 0.0482 (0.026977274152967665)  --> TIME: 2023-10-20 05:53:56 -- STEP: 39/50 -- GLOBAL_STEP: 81090 | > loss_disc: 2.269829273223877 (2.392033949876444) | > loss_disc_real_0: 0.012877522967755795 (0.14418573479335278) | > loss_disc_real_1: 0.27467817068099976 (0.22857920037439236) | > loss_disc_real_2: 0.2391951084136963 (0.2141754462932929) | > loss_disc_real_3: 0.30386796593666077 (0.23282042312889528) | > loss_disc_real_4: 0.2572343945503235 (0.2253355524287774) | > loss_disc_real_5: 0.21062113344669342 (0.22383642249191418) | > loss_0: 2.269829273223877 (2.392033949876444) | > grad_norm_0: tensor(1188.9219, device='cuda:0') (tensor(1192.7185, device='cuda:0')) | > loss_gen: 2.4932949542999268 (2.40004912400857) | > loss_kl: 0.5293630361557007 (0.9117966221215633) | > loss_feat: 4.236476421356201 (5.610972532286093) | > loss_mel: 23.28528594970703 (22.90113405080942) | > loss_duration: 1.464611291885376 (1.4609699524365938) | > loss_1: 32.009033203125 (33.28492255088611) | > grad_norm_1: tensor(16327.1885, device='cuda:0') (tensor(38529.2969, device='cuda:0')) | > current_lr_0: 0.00011412362619555044 | > current_lr_1: 0.00011412362619555044 | > step_time: 0.4691 (0.5510972952231383) | > loader_time: 0.0144 (0.018191380378527515)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8196568489074707 (2.8196568489074707) | > loss_disc_real_0: 0.13319933414459229 (0.13319933414459229) | > loss_disc_real_1: 0.16669489443302155 (0.16669489443302155) | > loss_disc_real_2: 0.18843689560890198 (0.18843689560890198) | > loss_disc_real_3: 0.2067079097032547 (0.2067079097032547) | > loss_disc_real_4: 0.3519783616065979 (0.3519783616065979) | > loss_disc_real_5: 0.33733102679252625 (0.33733102679252625) | > loss_0: 2.8196568489074707 (2.8196568489074707) | > loss_gen: 1.9355111122131348 (1.9355111122131348) | > loss_kl: 4.233767032623291 (4.233767032623291) | > loss_feat: 7.775525093078613 (7.775525093078613) | > loss_mel: 23.420143127441406 (23.420143127441406) | > loss_duration: 2.704953670501709 (2.704953670501709) | > loss_1: 40.06990051269531 (40.06990051269531)  --> STEP: 1 | > loss_disc: 3.0399036407470703 (3.0399036407470703) | > loss_disc_real_0: 0.4116400480270386 (0.4116400480270386) | > loss_disc_real_1: 0.22433389723300934 (0.22433389723300934) | > loss_disc_real_2: 0.3529939353466034 (0.3529939353466034) | > loss_disc_real_3: 0.24953268468379974 (0.24953268468379974) | > loss_disc_real_4: 0.4050412178039551 (0.4050412178039551) | > loss_disc_real_5: 0.317726194858551 (0.317726194858551) | > loss_0: 3.0399036407470703 (3.0399036407470703) | > loss_gen: 2.2891435623168945 (2.2891435623168945) | > loss_kl: 4.332714557647705 (4.332714557647705) | > loss_feat: 4.291316986083984 (4.291316986083984) | > loss_mel: 24.71198272705078 (24.71198272705078) | > loss_duration: 3.0883419513702393 (3.0883419513702393) | > loss_1: 38.713497161865234 (38.713497161865234)  --> STEP: 2 | > loss_disc: 2.811687707901001 (2.9257956743240356) | > loss_disc_real_0: 0.15404155850410461 (0.2828408032655716) | > loss_disc_real_1: 0.26879188418388367 (0.2465628907084465) | > loss_disc_real_2: 0.15682436525821686 (0.2549091503024101) | > loss_disc_real_3: 0.27789396047592163 (0.2637133225798607) | > loss_disc_real_4: 0.22148551046848297 (0.313263364136219) | > loss_disc_real_5: 0.23062491416931152 (0.2741755545139313) | > loss_0: 2.811687707901001 (2.9257956743240356) | > loss_gen: 1.5257691144943237 (1.9074563384056091) | > loss_kl: 4.254756927490234 (4.29373574256897) | > loss_feat: 0.7495157718658447 (2.5204163789749146) | > loss_mel: 22.964075088500977 (23.83802890777588) | > loss_duration: 2.859395742416382 (2.9738688468933105) | > loss_1: 32.353511810302734 (35.533504486083984)  --> STEP: 3 | > loss_disc: 2.9577674865722656 (2.936452945073446) | > loss_disc_real_0: 0.17644432187080383 (0.24737530946731567) | > loss_disc_real_1: 0.27581778168678284 (0.2563145210345586) | > loss_disc_real_2: 0.1885332614183426 (0.23278385400772095) | > loss_disc_real_3: 0.2663254737854004 (0.2645840396483739) | > loss_disc_real_4: 0.2196209877729416 (0.2820492386817932) | > loss_disc_real_5: 0.23282107710838318 (0.2603907287120819) | > loss_0: 2.9577674865722656 (2.936452945073446) | > loss_gen: 1.434537410736084 (1.7498166958491008) | > loss_kl: 2.0318405628204346 (3.5397706826527915) | > loss_feat: 0.41950759291648865 (1.8201134502887726) | > loss_mel: 18.021343231201172 (21.899133682250977) | > loss_duration: 2.69350266456604 (2.8804134527842202) | > loss_1: 24.600730895996094 (31.889246622721355) --> EVAL PERFORMANCE | > avg_loader_time: 0.018650293350219727 (+0.00880901018778483) | > avg_loss_disc: 2.936452945073446 (+0.06365648905436228) | > avg_loss_disc_real_0: 0.24737530946731567 (+0.005093639095624297) | > avg_loss_disc_real_1: 0.2563145210345586 (+0.015352075298627199) | > avg_loss_disc_real_2: 0.23278385400772095 (-0.009407694141070039) | > avg_loss_disc_real_3: 0.2645840396483739 (+0.027598664164543124) | > avg_loss_disc_real_4: 0.2820492386817932 (-0.0016359438498814716) | > avg_loss_disc_real_5: 0.2603907287120819 (+0.036844293276468904) | > avg_loss_0: 2.936452945073446 (+0.06365648905436228) | > avg_loss_gen: 1.7498166958491008 (-0.128554105758667) | > avg_loss_kl: 3.5397706826527915 (-0.19237097104390433) | > avg_loss_feat: 1.8201134502887726 (-1.511594151457151) | > avg_loss_mel: 21.899133682250977 (+2.1632153193155936) | > avg_loss_duration: 2.8804134527842202 (-0.05141901969909668) | > avg_loss_1: 31.889246622721355 (+0.27927589416503906)  > EPOCH: 562/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:54:18)   --> TIME: 2023-10-20 05:54:36 -- STEP: 19/50 -- GLOBAL_STEP: 81120 | > loss_disc: 2.2542901039123535 (2.541842630034999) | > loss_disc_real_0: 0.11273802816867828 (0.16900224924871796) | > loss_disc_real_1: 0.17800085246562958 (0.23690000646992734) | > loss_disc_real_2: 0.22460995614528656 (0.2470538445601338) | > loss_disc_real_3: 0.14238879084587097 (0.2484132623986194) | > loss_disc_real_4: 0.21105074882507324 (0.2831659373876296) | > loss_disc_real_5: 0.1422511786222458 (0.2114655388225066) | > loss_0: 2.2542901039123535 (2.541842630034999) | > grad_norm_0: tensor(1791.5631, device='cuda:0') (tensor(1480.8533, device='cuda:0')) | > loss_gen: 2.026848793029785 (2.328075308548777) | > loss_kl: 1.16757333278656 (0.768645399495175) | > loss_feat: 3.830308198928833 (5.00615987985542) | > loss_mel: 25.426950454711914 (21.097937665487592) | > loss_duration: 1.5927238464355469 (1.4943974080838656) | > loss_1: 34.044403076171875 (30.69521582754035) | > grad_norm_1: tensor(23517.1836, device='cuda:0') (tensor(52542.2070, device='cuda:0')) | > current_lr_0: 0.00011400955248596099 | > current_lr_1: 0.00011400955248596099 | > step_time: 0.515 (0.6399502126794113) | > loader_time: 0.0297 (0.022992272126047236)  --> TIME: 2023-10-20 05:54:55 -- STEP: 49/50 -- GLOBAL_STEP: 81150 | > loss_disc: 2.8702311515808105 (2.504219198713497) | > loss_disc_real_0: 0.03696741908788681 (0.1633583678274739) | > loss_disc_real_1: 0.2963971197605133 (0.2349161352886229) | > loss_disc_real_2: 0.2714058756828308 (0.22426404727964985) | > loss_disc_real_3: 0.07626134157180786 (0.23427385950879176) | > loss_disc_real_4: 0.3882107138633728 (0.24568938205436788) | > loss_disc_real_5: 0.2935456335544586 (0.22077868684974253) | > loss_0: 2.8702311515808105 (2.504219198713497) | > grad_norm_0: tensor(2687.9006, device='cuda:0') (tensor(1644.8835, device='cuda:0')) | > loss_gen: 2.2484946250915527 (2.330030832971846) | > loss_kl: 0.8072618842124939 (0.7478836197025922) | > loss_feat: 7.2615065574646 (4.942358068133495) | > loss_mel: 30.205429077148438 (20.931549478550348) | > loss_duration: 1.5443637371063232 (1.4539289863742129) | > loss_1: 42.067054748535156 (30.405751169944295) | > grad_norm_1: tensor(21969.5039, device='cuda:0') (tensor(42622.4531, device='cuda:0')) | > current_lr_0: 0.00011400955248596099 | > current_lr_1: 0.00011400955248596099 | > step_time: 0.5119 (0.6035821681119956) | > loader_time: 0.4312 (0.03178403815444635)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0953149795532227 (2.0953149795532227) | > loss_disc_real_0: 0.14203321933746338 (0.14203321933746338) | > loss_disc_real_1: 0.2650982141494751 (0.2650982141494751) | > loss_disc_real_2: 0.16507850587368011 (0.16507850587368011) | > loss_disc_real_3: 0.2298896759748459 (0.2298896759748459) | > loss_disc_real_4: 0.2988869249820709 (0.2988869249820709) | > loss_disc_real_5: 0.12307211756706238 (0.12307211756706238) | > loss_0: 2.0953149795532227 (2.0953149795532227) | > loss_gen: 3.046239137649536 (3.046239137649536) | > loss_kl: 4.453327178955078 (4.453327178955078) | > loss_feat: 9.301362037658691 (9.301362037658691) | > loss_mel: 22.214624404907227 (22.214624404907227) | > loss_duration: 2.7341063022613525 (2.7341063022613525) | > loss_1: 41.74966049194336 (41.74966049194336)  --> STEP: 1 | > loss_disc: 2.7681632041931152 (2.7681632041931152) | > loss_disc_real_0: 0.2387126386165619 (0.2387126386165619) | > loss_disc_real_1: 0.2632933557033539 (0.2632933557033539) | > loss_disc_real_2: 0.29275307059288025 (0.29275307059288025) | > loss_disc_real_3: 0.3055609464645386 (0.3055609464645386) | > loss_disc_real_4: 0.2772844433784485 (0.2772844433784485) | > loss_disc_real_5: 0.2877574861049652 (0.2877574861049652) | > loss_0: 2.7681632041931152 (2.7681632041931152) | > loss_gen: 2.100330114364624 (2.100330114364624) | > loss_kl: 4.507763862609863 (4.507763862609863) | > loss_feat: 2.484187364578247 (2.484187364578247) | > loss_mel: 21.471506118774414 (21.471506118774414) | > loss_duration: 3.1183724403381348 (3.1183724403381348) | > loss_1: 33.682159423828125 (33.682159423828125)  --> STEP: 2 | > loss_disc: 3.021543502807617 (2.894853353500366) | > loss_disc_real_0: 0.35742828249931335 (0.2980704605579376) | > loss_disc_real_1: 0.278292715549469 (0.27079303562641144) | > loss_disc_real_2: 0.26739180088043213 (0.2800724357366562) | > loss_disc_real_3: 0.2806139588356018 (0.2930874526500702) | > loss_disc_real_4: 0.254987895488739 (0.26613616943359375) | > loss_disc_real_5: 0.2841291129589081 (0.28594329953193665) | > loss_0: 3.021543502807617 (2.894853353500366) | > loss_gen: 1.7357730865478516 (1.9180516004562378) | > loss_kl: 4.362877368927002 (4.435320615768433) | > loss_feat: 0.08737987279891968 (1.2857836186885834) | > loss_mel: 1.6938520669937134 (11.582679092884064) | > loss_duration: 2.9882214069366455 (3.05329692363739) | > loss_1: 10.868103981018066 (22.275131702423096)  --> STEP: 3 | > loss_disc: 2.8864355087280273 (2.89204740524292) | > loss_disc_real_0: 0.22028499841690063 (0.272141973177592) | > loss_disc_real_1: 0.32574838399887085 (0.2891114850838979) | > loss_disc_real_2: 0.29394587874412537 (0.28469691673914593) | > loss_disc_real_3: 0.2962516248226166 (0.29414217670758563) | > loss_disc_real_4: 0.2733513414859772 (0.26854122678438824) | > loss_disc_real_5: 0.27181944251060486 (0.28123534719149273) | > loss_0: 2.8864355087280273 (2.89204740524292) | > loss_gen: 1.8661503791809082 (1.9007511933644612) | > loss_kl: 1.8053476810455322 (3.5586629708607993) | > loss_feat: 1.029633641242981 (1.2004002928733826) | > loss_mel: 17.238561630249023 (13.467973272005716) | > loss_duration: 2.8809852600097656 (2.995859702428182) | > loss_1: 24.8206787109375 (23.1236473719279) --> EVAL PERFORMANCE | > avg_loader_time: 0.002683401107788086 (-0.01596689224243164) | > avg_loss_disc: 2.89204740524292 (-0.044405539830525864) | > avg_loss_disc_real_0: 0.272141973177592 (+0.024766663710276304) | > avg_loss_disc_real_1: 0.2891114850838979 (+0.032796964049339294) | > avg_loss_disc_real_2: 0.28469691673914593 (+0.051913062731424986) | > avg_loss_disc_real_3: 0.29414217670758563 (+0.02955813705921173) | > avg_loss_disc_real_4: 0.26854122678438824 (-0.01350801189740497) | > avg_loss_disc_real_5: 0.28123534719149273 (+0.020844618479410826) | > avg_loss_0: 2.89204740524292 (-0.044405539830525864) | > avg_loss_gen: 1.9007511933644612 (+0.15093449751536037) | > avg_loss_kl: 3.5586629708607993 (+0.018892288208007812) | > avg_loss_feat: 1.2004002928733826 (-0.61971315741539) | > avg_loss_mel: 13.467973272005716 (-8.43116041024526) | > avg_loss_duration: 2.995859702428182 (+0.11544624964396188) | > avg_loss_1: 23.1236473719279 (-8.765599250793457)  > EPOCH: 563/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:55:11)   --> TIME: 2023-10-20 05:55:36 -- STEP: 29/50 -- GLOBAL_STEP: 81180 | > loss_disc: 3.0137078762054443 (2.286403413476615) | > loss_disc_real_0: 0.4570474326610565 (0.13445122392270076) | > loss_disc_real_1: 0.2549395263195038 (0.2152638106510557) | > loss_disc_real_2: 0.27772948145866394 (0.2228434746121538) | > loss_disc_real_3: 0.2785491347312927 (0.23161617868804726) | > loss_disc_real_4: 0.25695669651031494 (0.20424580795626188) | > loss_disc_real_5: 0.2661206126213074 (0.19053050361830612) | > loss_0: 3.0137078762054443 (2.286403413476615) | > grad_norm_0: tensor(2904.1592, device='cuda:0') (tensor(1715.3933, device='cuda:0')) | > loss_gen: 1.8268041610717773 (2.51969195645431) | > loss_kl: 0.7673189043998718 (0.9362987022975395) | > loss_feat: 0.528679370880127 (5.976982356145464) | > loss_mel: 16.197071075439453 (22.5273264194357) | > loss_duration: 1.4532020092010498 (1.4696122531233162) | > loss_1: 20.773075103759766 (33.42991181077628) | > grad_norm_1: tensor(6350.3765, device='cuda:0') (tensor(48159.1602, device='cuda:0')) | > current_lr_0: 0.00011389559280018636 | > current_lr_1: 0.00011389559280018636 | > step_time: 0.6095 (0.6179543445850241) | > loader_time: 0.0299 (0.023982516650495857)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8145785331726074 (2.8145785331726074) | > loss_disc_real_0: 0.15504670143127441 (0.15504670143127441) | > loss_disc_real_1: 0.16629356145858765 (0.16629356145858765) | > loss_disc_real_2: 0.13687336444854736 (0.13687336444854736) | > loss_disc_real_3: 0.23441611230373383 (0.23441611230373383) | > loss_disc_real_4: 0.15901577472686768 (0.15901577472686768) | > loss_disc_real_5: 0.09626151621341705 (0.09626151621341705) | > loss_0: 2.8145785331726074 (2.8145785331726074) | > loss_gen: 1.5723989009857178 (1.5723989009857178) | > loss_kl: 3.7579445838928223 (3.7579445838928223) | > loss_feat: 3.672315835952759 (3.672315835952759) | > loss_mel: 23.781909942626953 (23.781909942626953) | > loss_duration: 2.6642563343048096 (2.6642563343048096) | > loss_1: 35.44882583618164 (35.44882583618164)  --> STEP: 1 | > loss_disc: 2.725053071975708 (2.725053071975708) | > loss_disc_real_0: 0.2239256203174591 (0.2239256203174591) | > loss_disc_real_1: 0.2158520519733429 (0.2158520519733429) | > loss_disc_real_2: 0.2051970660686493 (0.2051970660686493) | > loss_disc_real_3: 0.2570558190345764 (0.2570558190345764) | > loss_disc_real_4: 0.2885206639766693 (0.2885206639766693) | > loss_disc_real_5: 0.2495383471250534 (0.2495383471250534) | > loss_0: 2.725053071975708 (2.725053071975708) | > loss_gen: 1.8649494647979736 (1.8649494647979736) | > loss_kl: 4.624510765075684 (4.624510765075684) | > loss_feat: 1.5043225288391113 (1.5043225288391113) | > loss_mel: 20.657052993774414 (20.657052993774414) | > loss_duration: 2.986435651779175 (2.986435651779175) | > loss_1: 31.637271881103516 (31.637271881103516)  --> STEP: 2 | > loss_disc: 2.3229503631591797 (2.524001717567444) | > loss_disc_real_0: 0.15061435103416443 (0.18726998567581177) | > loss_disc_real_1: 0.2051861435174942 (0.21051909774541855) | > loss_disc_real_2: 0.2761705219745636 (0.24068379402160645) | > loss_disc_real_3: 0.12408667802810669 (0.19057124853134155) | > loss_disc_real_4: 0.18753299117088318 (0.23802682757377625) | > loss_disc_real_5: 0.26574432849884033 (0.25764133781194687) | > loss_0: 2.3229503631591797 (2.524001717567444) | > loss_gen: 2.2200875282287598 (2.0425184965133667) | > loss_kl: 4.710912704467773 (4.6677117347717285) | > loss_feat: 8.08172607421875 (4.793024301528931) | > loss_mel: 29.898908615112305 (25.27798080444336) | > loss_duration: 2.8599154949188232 (2.923175573348999) | > loss_1: 47.77155303955078 (39.70441246032715)  --> STEP: 3 | > loss_disc: 2.6537673473358154 (2.5672569274902344) | > loss_disc_real_0: 0.21208791434764862 (0.19554262856642404) | > loss_disc_real_1: 0.2574523687362671 (0.22616352140903473) | > loss_disc_real_2: 0.24052263796329498 (0.24063007533550262) | > loss_disc_real_3: 0.2624856233596802 (0.21454270680745444) | > loss_disc_real_4: 0.27781131863594055 (0.2512883245944977) | > loss_disc_real_5: 0.2743539810180664 (0.2632122188806534) | > loss_0: 2.6537673473358154 (2.5672569274902344) | > loss_gen: 1.9789063930511475 (2.0213144620259604) | > loss_kl: 2.376253604888916 (3.9038923581441245) | > loss_feat: 1.1157729625701904 (3.5672738552093506) | > loss_mel: 15.868295669555664 (22.14141909281413) | > loss_duration: 2.7624332904815674 (2.8695948123931885) | > loss_1: 24.10166358947754 (34.503496170043945) --> EVAL PERFORMANCE | > avg_loader_time: 0.003213961919148763 (+0.0005305608113606772) | > avg_loss_disc: 2.5672569274902344 (-0.32479047775268555) | > avg_loss_disc_real_0: 0.19554262856642404 (-0.07659934461116794) | > avg_loss_disc_real_1: 0.22616352140903473 (-0.06294796367486316) | > avg_loss_disc_real_2: 0.24063007533550262 (-0.04406684140364331) | > avg_loss_disc_real_3: 0.21454270680745444 (-0.0795994699001312) | > avg_loss_disc_real_4: 0.2512883245944977 (-0.017252902189890562) | > avg_loss_disc_real_5: 0.2632122188806534 (-0.018023128310839354) | > avg_loss_0: 2.5672569274902344 (-0.32479047775268555) | > avg_loss_gen: 2.0213144620259604 (+0.12056326866149925) | > avg_loss_kl: 3.9038923581441245 (+0.3452293872833252) | > avg_loss_feat: 3.5672738552093506 (+2.366873562335968) | > avg_loss_mel: 22.14141909281413 (+8.673445820808412) | > avg_loss_duration: 2.8695948123931885 (-0.12626489003499364) | > avg_loss_1: 34.503496170043945 (+11.379848798116047)  > EPOCH: 564/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:56:02)   --> TIME: 2023-10-20 05:56:15 -- STEP: 9/50 -- GLOBAL_STEP: 81210 | > loss_disc: 2.743100166320801 (2.3887696266174316) | > loss_disc_real_0: 0.09168612957000732 (0.14092471160822445) | > loss_disc_real_1: 0.2810904383659363 (0.21427982010775143) | > loss_disc_real_2: 0.2658153772354126 (0.21684037976794773) | > loss_disc_real_3: 0.30575236678123474 (0.22934059276142055) | > loss_disc_real_4: 0.24073046445846558 (0.18414568942454126) | > loss_disc_real_5: 0.3000980615615845 (0.22520211359692943) | > loss_0: 2.743100166320801 (2.3887696266174316) | > grad_norm_0: tensor(589.2742, device='cuda:0') (tensor(838.9294, device='cuda:0')) | > loss_gen: 2.051131248474121 (2.2153079244825573) | > loss_kl: 0.7501500844955444 (0.7948073993126551) | > loss_feat: 3.0479166507720947 (5.249016503906912) | > loss_mel: 13.758147239685059 (18.348306894302368) | > loss_duration: 1.4165884256362915 (1.4196930593914456) | > loss_1: 21.02393341064453 (28.02713129255507) | > grad_norm_1: tensor(32301.9062, device='cuda:0') (tensor(45496.0195, device='cuda:0')) | > current_lr_0: 0.0001137817470242526 | > current_lr_1: 0.0001137817470242526 | > step_time: 0.8055 (0.6135124630398221) | > loader_time: 0.0113 (0.028467178344726562)  --> TIME: 2023-10-20 05:56:29 -- STEP: 39/50 -- GLOBAL_STEP: 81240 | > loss_disc: 1.8693041801452637 (2.4242200331810193) | > loss_disc_real_0: 0.015340929850935936 (0.14799853808318186) | > loss_disc_real_1: 0.183047354221344 (0.22150506165165168) | > loss_disc_real_2: 0.15978802740573883 (0.21800363656037894) | > loss_disc_real_3: 0.2884819209575653 (0.24433419350773478) | > loss_disc_real_4: 0.07459849864244461 (0.22096282210296544) | > loss_disc_real_5: 0.07221545279026031 (0.223023050202009) | > loss_0: 1.8693041801452637 (2.4242200331810193) | > grad_norm_0: tensor(1901.3868, device='cuda:0') (tensor(1053.2007, device='cuda:0')) | > loss_gen: 2.4065101146698 (2.3060722840137973) | > loss_kl: 0.48887184262275696 (0.8236368248860041) | > loss_feat: 7.148849964141846 (5.114987129679856) | > loss_mel: 25.120458602905273 (20.409140434020603) | > loss_duration: 1.456577181816101 (1.4434514412513149) | > loss_1: 36.62126541137695 (30.097287777142647) | > grad_norm_1: tensor(15869.2363, device='cuda:0') (tensor(42057.8008, device='cuda:0')) | > current_lr_0: 0.0001137817470242526 | > current_lr_1: 0.0001137817470242526 | > step_time: 0.4486 (0.4888005195519863) | > loader_time: 0.0042 (0.01708786304180439)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4218099117279053 (2.4218099117279053) | > loss_disc_real_0: 0.15550726652145386 (0.15550726652145386) | > loss_disc_real_1: 0.2941688895225525 (0.2941688895225525) | > loss_disc_real_2: 0.27045974135398865 (0.27045974135398865) | > loss_disc_real_3: 0.2017660290002823 (0.2017660290002823) | > loss_disc_real_4: 0.10259262472391129 (0.10259262472391129) | > loss_disc_real_5: 0.1501310169696808 (0.1501310169696808) | > loss_0: 2.4218099117279053 (2.4218099117279053) | > loss_gen: 2.0352282524108887 (2.0352282524108887) | > loss_kl: 3.421694755554199 (3.421694755554199) | > loss_feat: 6.3953423500061035 (6.3953423500061035) | > loss_mel: 22.921733856201172 (22.921733856201172) | > loss_duration: 2.677194833755493 (2.677194833755493) | > loss_1: 37.451194763183594 (37.451194763183594)  --> STEP: 1 | > loss_disc: 2.7191452980041504 (2.7191452980041504) | > loss_disc_real_0: 0.08372755348682404 (0.08372755348682404) | > loss_disc_real_1: 0.22592373192310333 (0.22592373192310333) | > loss_disc_real_2: 0.2000049203634262 (0.2000049203634262) | > loss_disc_real_3: 0.15309099853038788 (0.15309099853038788) | > loss_disc_real_4: 0.10987789183855057 (0.10987789183855057) | > loss_disc_real_5: 0.15214256942272186 (0.15214256942272186) | > loss_0: 2.7191452980041504 (2.7191452980041504) | > loss_gen: 1.5334882736206055 (1.5334882736206055) | > loss_kl: 4.2806806564331055 (4.2806806564331055) | > loss_feat: 6.493104457855225 (6.493104457855225) | > loss_mel: 23.436717987060547 (23.436717987060547) | > loss_duration: 3.023019552230835 (3.023019552230835) | > loss_1: 38.76700973510742 (38.76700973510742)  --> STEP: 2 | > loss_disc: 2.7066125869750977 (2.712878942489624) | > loss_disc_real_0: 0.2246696799993515 (0.15419861674308777) | > loss_disc_real_1: 0.28971347212791443 (0.2578186020255089) | > loss_disc_real_2: 0.1812717616558075 (0.19063834100961685) | > loss_disc_real_3: 0.2976558804512024 (0.22537343949079514) | > loss_disc_real_4: 0.32055455446243286 (0.21521622315049171) | > loss_disc_real_5: 0.32517877221107483 (0.23866067081689835) | > loss_0: 2.7066125869750977 (2.712878942489624) | > loss_gen: 2.1769585609436035 (1.8552234172821045) | > loss_kl: 4.624888896942139 (4.452784776687622) | > loss_feat: 2.402968168258667 (4.448036313056946) | > loss_mel: 24.20365333557129 (23.820185661315918) | > loss_duration: 2.9185304641723633 (2.970775008201599) | > loss_1: 36.32699966430664 (37.54700469970703)  --> STEP: 3 | > loss_disc: 3.1412909030914307 (2.855682929356893) | > loss_disc_real_0: 0.20982222259044647 (0.17273981869220734) | > loss_disc_real_1: 0.5433859825134277 (0.3530077288548152) | > loss_disc_real_2: 0.3318306803703308 (0.23770245412985483) | > loss_disc_real_3: 0.4836648404598236 (0.31147057314713794) | > loss_disc_real_4: 0.4224230945110321 (0.28428518027067184) | > loss_disc_real_5: 0.328033447265625 (0.26845159629980725) | > loss_0: 3.1412909030914307 (2.855682929356893) | > loss_gen: 2.8745946884155273 (2.1950138409932456) | > loss_kl: 2.123758316040039 (3.6764426231384277) | > loss_feat: 5.322976112365723 (4.739682912826538) | > loss_mel: 23.789684295654297 (23.81001853942871) | > loss_duration: 2.7765696048736572 (2.9060398737589517) | > loss_1: 36.8875846862793 (37.32719802856445) --> EVAL PERFORMANCE | > avg_loader_time: 0.019097169240315754 (+0.015883207321166992) | > avg_loss_disc: 2.855682929356893 (+0.2884260018666587) | > avg_loss_disc_real_0: 0.17273981869220734 (-0.022802809874216706) | > avg_loss_disc_real_1: 0.3530077288548152 (+0.12684420744578045) | > avg_loss_disc_real_2: 0.23770245412985483 (-0.0029276212056477957) | > avg_loss_disc_real_3: 0.31147057314713794 (+0.0969278663396835) | > avg_loss_disc_real_4: 0.28428518027067184 (+0.032996855676174164) | > avg_loss_disc_real_5: 0.26845159629980725 (+0.005239377419153868) | > avg_loss_0: 2.855682929356893 (+0.2884260018666587) | > avg_loss_gen: 2.1950138409932456 (+0.17369937896728516) | > avg_loss_kl: 3.6764426231384277 (-0.22744973500569676) | > avg_loss_feat: 4.739682912826538 (+1.1724090576171875) | > avg_loss_mel: 23.81001853942871 (+1.6685994466145821) | > avg_loss_duration: 2.9060398737589517 (+0.0364450613657632) | > avg_loss_1: 37.32719802856445 (+2.823701858520508)  > EPOCH: 565/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:56:57)   --> TIME: 2023-10-20 05:57:18 -- STEP: 19/50 -- GLOBAL_STEP: 81270 | > loss_disc: 2.876850128173828 (2.359018269338106) | > loss_disc_real_0: 0.191497340798378 (0.14167345383841737) | > loss_disc_real_1: 0.262419193983078 (0.21545774386705538) | > loss_disc_real_2: 0.23465794324874878 (0.22276209363419758) | > loss_disc_real_3: 0.30980661511421204 (0.24220680621893784) | > loss_disc_real_4: 0.3029541075229645 (0.19289258249888294) | > loss_disc_real_5: 0.2919357120990753 (0.1911850821618971) | > loss_0: 2.876850128173828 (2.359018269338106) | > grad_norm_0: tensor(290.4565, device='cuda:0') (tensor(1378.9034, device='cuda:0')) | > loss_gen: 1.787195086479187 (2.334429621696472) | > loss_kl: 0.5396401882171631 (0.8377611856711539) | > loss_feat: 1.321277141571045 (5.884470346726869) | > loss_mel: 20.874465942382812 (21.338256070488377) | > loss_duration: 1.5956919193267822 (1.4965530759409855) | > loss_1: 26.118270874023438 (31.891470658151732) | > grad_norm_1: tensor(6013.4697, device='cuda:0') (tensor(34676.1211, device='cuda:0')) | > current_lr_0: 0.0001136680150442997 | > current_lr_1: 0.0001136680150442997 | > step_time: 0.7928 (0.6017147490852758) | > loader_time: 0.0435 (0.024337090943989)  --> TIME: 2023-10-20 05:57:39 -- STEP: 49/50 -- GLOBAL_STEP: 81300 | > loss_disc: 2.484433174133301 (2.449564809701881) | > loss_disc_real_0: 0.17504839599132538 (0.14676510774511467) | > loss_disc_real_1: 0.2693154215812683 (0.22568651853243307) | > loss_disc_real_2: 0.1168295368552208 (0.22745418483961602) | > loss_disc_real_3: 0.3251681625843048 (0.23549459106764015) | > loss_disc_real_4: 0.24368876218795776 (0.2142608018630013) | > loss_disc_real_5: 0.34446603059768677 (0.216884420500422) | > loss_0: 2.484433174133301 (2.449564809701881) | > grad_norm_0: tensor(1206.1331, device='cuda:0') (tensor(834.0513, device='cuda:0')) | > loss_gen: 2.2964227199554443 (2.230782632925072) | > loss_kl: 0.5789563059806824 (0.8019749114708025) | > loss_feat: 2.2657549381256104 (4.948857750819655) | > loss_mel: 21.61752700805664 (20.377733933682343) | > loss_duration: 1.6251161098480225 (1.4599237831271425) | > loss_1: 28.383777618408203 (29.819273179891162) | > grad_norm_1: tensor(5417.1968, device='cuda:0') (tensor(20400.1621, device='cuda:0')) | > current_lr_0: 0.0001136680150442997 | > current_lr_1: 0.0001136680150442997 | > step_time: 0.8718 (0.639667408806937) | > loader_time: 0.4326 (0.03300485805589325)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.719595432281494 (2.719595432281494) | > loss_disc_real_0: 0.21634267270565033 (0.21634267270565033) | > loss_disc_real_1: 0.24256883561611176 (0.24256883561611176) | > loss_disc_real_2: 0.2719941735267639 (0.2719941735267639) | > loss_disc_real_3: 0.30623888969421387 (0.30623888969421387) | > loss_disc_real_4: 0.5406678915023804 (0.5406678915023804) | > loss_disc_real_5: 0.3089965283870697 (0.3089965283870697) | > loss_0: 2.719595432281494 (2.719595432281494) | > loss_gen: 2.976339101791382 (2.976339101791382) | > loss_kl: 3.547278642654419 (3.547278642654419) | > loss_feat: 6.652358055114746 (6.652358055114746) | > loss_mel: 24.940702438354492 (24.940702438354492) | > loss_duration: 2.6277663707733154 (2.6277663707733154) | > loss_1: 40.744441986083984 (40.744441986083984)  --> STEP: 1 | > loss_disc: 1.8213880062103271 (1.8213880062103271) | > loss_disc_real_0: 0.10559694468975067 (0.10559694468975067) | > loss_disc_real_1: 0.1687764972448349 (0.1687764972448349) | > loss_disc_real_2: 0.16002191603183746 (0.16002191603183746) | > loss_disc_real_3: 0.11387069523334503 (0.11387069523334503) | > loss_disc_real_4: 0.2444213628768921 (0.2444213628768921) | > loss_disc_real_5: 0.07585451006889343 (0.07585451006889343) | > loss_0: 1.8213880062103271 (1.8213880062103271) | > loss_gen: 2.836662769317627 (2.836662769317627) | > loss_kl: 4.485713481903076 (4.485713481903076) | > loss_feat: 12.981744766235352 (12.981744766235352) | > loss_mel: 26.339611053466797 (26.339611053466797) | > loss_duration: 3.0143730640411377 (3.0143730640411377) | > loss_1: 49.658103942871094 (49.658103942871094)  --> STEP: 2 | > loss_disc: 1.5151126384735107 (1.668250322341919) | > loss_disc_real_0: 0.0169969592243433 (0.061296951957046986) | > loss_disc_real_1: 0.03271568566560745 (0.10074609145522118) | > loss_disc_real_2: 0.0778036117553711 (0.11891276389360428) | > loss_disc_real_3: 0.06572824716567993 (0.08979947119951248) | > loss_disc_real_4: 0.0659257024526596 (0.15517353266477585) | > loss_disc_real_5: 0.10387474298477173 (0.08986462652683258) | > loss_0: 1.5151126384735107 (1.668250322341919) | > loss_gen: 2.516526699066162 (2.6765947341918945) | > loss_kl: 4.108770847320557 (4.297242164611816) | > loss_feat: 10.6041841506958 (11.792964458465576) | > loss_mel: 27.11766242980957 (26.728636741638184) | > loss_duration: 2.9096405506134033 (2.9620068073272705) | > loss_1: 47.25678634643555 (48.45744514465332)  --> STEP: 3 | > loss_disc: 2.876227855682373 (2.0709095001220703) | > loss_disc_real_0: 0.2814541161060333 (0.13468267334004244) | > loss_disc_real_1: 0.36711785197257996 (0.18953667829434076) | > loss_disc_real_2: 0.2823067605495453 (0.17337742944558462) | > loss_disc_real_3: 0.291025310754776 (0.156874751051267) | > loss_disc_real_4: 0.2858794927597046 (0.1987421860297521) | > loss_disc_real_5: 0.4402134418487549 (0.20664756496747336) | > loss_0: 2.876227855682373 (2.0709095001220703) | > loss_gen: 2.3634140491485596 (2.5722011725107827) | > loss_kl: 2.140359878540039 (3.5782814025878906) | > loss_feat: 2.573084592819214 (8.719671169916788) | > loss_mel: 20.439090728759766 (24.632121404012043) | > loss_duration: 2.806943893432617 (2.910319169362386) | > loss_1: 30.322893142700195 (42.41259447733561) --> EVAL PERFORMANCE | > avg_loader_time: 0.006336132685343425 (-0.012761036554972328) | > avg_loss_disc: 2.0709095001220703 (-0.7847734292348227) | > avg_loss_disc_real_0: 0.13468267334004244 (-0.038057145352164895) | > avg_loss_disc_real_1: 0.18953667829434076 (-0.16347105056047442) | > avg_loss_disc_real_2: 0.17337742944558462 (-0.0643250246842702) | > avg_loss_disc_real_3: 0.156874751051267 (-0.15459582209587094) | > avg_loss_disc_real_4: 0.1987421860297521 (-0.08554299424091974) | > avg_loss_disc_real_5: 0.20664756496747336 (-0.06180403133233389) | > avg_loss_0: 2.0709095001220703 (-0.7847734292348227) | > avg_loss_gen: 2.5722011725107827 (+0.37718733151753714) | > avg_loss_kl: 3.5782814025878906 (-0.09816122055053711) | > avg_loss_feat: 8.719671169916788 (+3.97998825709025) | > avg_loss_mel: 24.632121404012043 (+0.8221028645833321) | > avg_loss_duration: 2.910319169362386 (+0.004279295603434541) | > avg_loss_1: 42.41259447733561 (+5.0853964487711565)  > EPOCH: 566/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:57:57)   --> TIME: 2023-10-20 05:58:19 -- STEP: 29/50 -- GLOBAL_STEP: 81330 | > loss_disc: 2.9010164737701416 (2.3267730392258743) | > loss_disc_real_0: 0.2147436887025833 (0.11591268671226912) | > loss_disc_real_1: 0.23580245673656464 (0.2285461685266988) | > loss_disc_real_2: 0.21287503838539124 (0.235188870465961) | > loss_disc_real_3: 0.26859867572784424 (0.2335073096228057) | > loss_disc_real_4: 0.2890869975090027 (0.21452198203267722) | > loss_disc_real_5: 0.3572206199169159 (0.20873306203505088) | > loss_0: 2.9010164737701416 (2.3267730392258743) | > grad_norm_0: tensor(695.5779, device='cuda:0') (tensor(566.1491, device='cuda:0')) | > loss_gen: 1.9229754209518433 (2.539663553237915) | > loss_kl: 0.9426040053367615 (0.8866491173875743) | > loss_feat: 2.208524227142334 (6.401212300719886) | > loss_mel: 14.745742797851562 (23.18866958289311) | > loss_duration: 1.4644228219985962 (1.4783769147149448) | > loss_1: 21.284269332885742 (34.49457115962587) | > grad_norm_1: tensor(8715.1621, device='cuda:0') (tensor(31105.9395, device='cuda:0')) | > current_lr_0: 0.00011355439674658143 | > current_lr_1: 0.00011355439674658143 | > step_time: 0.5461 (0.5807542060983593) | > loader_time: 0.0249 (0.021672462594920193)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.047072172164917 (3.047072172164917) | > loss_disc_real_0: 0.3601754307746887 (0.3601754307746887) | > loss_disc_real_1: 0.30415067076683044 (0.30415067076683044) | > loss_disc_real_2: 0.3621433675289154 (0.3621433675289154) | > loss_disc_real_3: 0.3030630946159363 (0.3030630946159363) | > loss_disc_real_4: 0.32054203748703003 (0.32054203748703003) | > loss_disc_real_5: 0.32344022393226624 (0.32344022393226624) | > loss_0: 3.047072172164917 (3.047072172164917) | > loss_gen: 2.1459131240844727 (2.1459131240844727) | > loss_kl: 3.9989075660705566 (3.9989075660705566) | > loss_feat: 1.780552625656128 (1.780552625656128) | > loss_mel: 20.428939819335938 (20.428939819335938) | > loss_duration: 2.5930521488189697 (2.5930521488189697) | > loss_1: 30.947364807128906 (30.947364807128906)  --> STEP: 1 | > loss_disc: 2.592451572418213 (2.592451572418213) | > loss_disc_real_0: 0.12234761565923691 (0.12234761565923691) | > loss_disc_real_1: 0.3289693295955658 (0.3289693295955658) | > loss_disc_real_2: 0.23018524050712585 (0.23018524050712585) | > loss_disc_real_3: 0.23406067490577698 (0.23406067490577698) | > loss_disc_real_4: 0.315833181142807 (0.315833181142807) | > loss_disc_real_5: 0.3596625030040741 (0.3596625030040741) | > loss_0: 2.592451572418213 (2.592451572418213) | > loss_gen: 2.3121230602264404 (2.3121230602264404) | > loss_kl: 4.748330116271973 (4.748330116271973) | > loss_feat: 3.5391886234283447 (3.5391886234283447) | > loss_mel: 23.40947723388672 (23.40947723388672) | > loss_duration: 2.871918201446533 (2.871918201446533) | > loss_1: 36.88103485107422 (36.88103485107422)  --> STEP: 2 | > loss_disc: 2.886563301086426 (2.7395074367523193) | > loss_disc_real_0: 0.21217933297157288 (0.1672634743154049) | > loss_disc_real_1: 0.32541391253471375 (0.32719162106513977) | > loss_disc_real_2: 0.2638273537158966 (0.24700629711151123) | > loss_disc_real_3: 0.3174172043800354 (0.2757389396429062) | > loss_disc_real_4: 0.25064119696617126 (0.28323718905448914) | > loss_disc_real_5: 0.27485769987106323 (0.31726010143756866) | > loss_0: 2.886563301086426 (2.7395074367523193) | > loss_gen: 1.795804500579834 (2.053963780403137) | > loss_kl: 4.312897205352783 (4.530613660812378) | > loss_feat: 0.45375344157218933 (1.996471032500267) | > loss_mel: 22.34059715270996 (22.87503719329834) | > loss_duration: 2.8436455726623535 (2.8577818870544434) | > loss_1: 31.7466983795166 (34.31386661529541)  --> STEP: 3 | > loss_disc: 2.864813804626465 (2.781276226043701) | > loss_disc_real_0: 0.18283042311668396 (0.17245245724916458) | > loss_disc_real_1: 0.3033317029476166 (0.3192383150259654) | > loss_disc_real_2: 0.21541084349155426 (0.23647447923819223) | > loss_disc_real_3: 0.30731216073036194 (0.2862633466720581) | > loss_disc_real_4: 0.2813052833080292 (0.2825932204723358) | > loss_disc_real_5: 0.28962987661361694 (0.3080500264962514) | > loss_0: 2.864813804626465 (2.781276226043701) | > loss_gen: 1.7458679676055908 (1.9512651761372883) | > loss_kl: 2.0849716663360596 (3.715399662653605) | > loss_feat: 0.7504128217697144 (1.5811182955900829) | > loss_mel: 16.061307907104492 (20.60379409790039) | > loss_duration: 2.6235270500183105 (2.7796969413757324) | > loss_1: 23.266088485717773 (30.6312739054362) --> EVAL PERFORMANCE | > avg_loader_time: 0.016460736592610676 (+0.01012460390726725) | > avg_loss_disc: 2.781276226043701 (+0.7103667259216309) | > avg_loss_disc_real_0: 0.17245245724916458 (+0.03776978390912214) | > avg_loss_disc_real_1: 0.3192383150259654 (+0.12970163673162463) | > avg_loss_disc_real_2: 0.23647447923819223 (+0.0630970497926076) | > avg_loss_disc_real_3: 0.2862633466720581 (+0.1293885956207911) | > avg_loss_disc_real_4: 0.2825932204723358 (+0.08385103444258371) | > avg_loss_disc_real_5: 0.3080500264962514 (+0.10140246152877805) | > avg_loss_0: 2.781276226043701 (+0.7103667259216309) | > avg_loss_gen: 1.9512651761372883 (-0.6209359963734944) | > avg_loss_kl: 3.715399662653605 (+0.13711826006571437) | > avg_loss_feat: 1.5811182955900829 (-7.138552874326705) | > avg_loss_mel: 20.60379409790039 (-4.0283273061116525) | > avg_loss_duration: 2.7796969413757324 (-0.1306222279866538) | > avg_loss_1: 30.6312739054362 (-11.78132057189941)  > EPOCH: 567/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:58:47)   --> TIME: 2023-10-20 05:58:59 -- STEP: 9/50 -- GLOBAL_STEP: 81360 | > loss_disc: 3.072016716003418 (2.3117826779683432) | > loss_disc_real_0: 0.2255137860774994 (0.21352967785464394) | > loss_disc_real_1: 0.29679471254348755 (0.2296795468363497) | > loss_disc_real_2: 0.3628121316432953 (0.20959709129399723) | > loss_disc_real_3: 0.35858091711997986 (0.2267145775258541) | > loss_disc_real_4: 0.44091007113456726 (0.19488228215939468) | > loss_disc_real_5: 0.37242645025253296 (0.19457146918608081) | > loss_0: 3.072016716003418 (2.3117826779683432) | > grad_norm_0: tensor(304.4198, device='cuda:0') (tensor(506.7263, device='cuda:0')) | > loss_gen: 2.3214170932769775 (2.5135784016715155) | > loss_kl: 0.7179656624794006 (0.7132180796729194) | > loss_feat: 3.8943817615509033 (6.908871374196476) | > loss_mel: 21.54903793334961 (21.07087122069465) | > loss_duration: 1.4001569747924805 (1.4795760313669841) | > loss_1: 29.882957458496094 (32.68611473507352) | > grad_norm_1: tensor(4479.2988, device='cuda:0') (tensor(25721.4199, device='cuda:0')) | > current_lr_0: 0.00011344089201746529 | > current_lr_1: 0.00011344089201746529 | > step_time: 0.5757 (0.5854303307003446) | > loader_time: 0.0223 (0.021704912185668945)  --> TIME: 2023-10-20 05:59:12 -- STEP: 39/50 -- GLOBAL_STEP: 81390 | > loss_disc: 2.2767152786254883 (2.44177123827812) | > loss_disc_real_0: 0.15752243995666504 (0.1628795884645138) | > loss_disc_real_1: 0.3190203905105591 (0.22265944391106948) | > loss_disc_real_2: 0.15472741425037384 (0.20206251138677964) | > loss_disc_real_3: 0.22563210129737854 (0.25331674277400357) | > loss_disc_real_4: 0.20288920402526855 (0.22088210246501824) | > loss_disc_real_5: 0.3190534710884094 (0.22651040635238856) | > loss_0: 2.2767152786254883 (2.44177123827812) | > grad_norm_0: tensor(1222.4279, device='cuda:0') (tensor(683.0198, device='cuda:0')) | > loss_gen: 2.9718096256256104 (2.3482070733339357) | > loss_kl: 0.3638599216938019 (0.8378450398643812) | > loss_feat: 4.995254993438721 (5.5535234822294655) | > loss_mel: 21.90770721435547 (20.759220667374443) | > loss_duration: 1.5648255348205566 (1.4614030856352587) | > loss_1: 31.803457260131836 (30.96019914822701) | > grad_norm_1: tensor(13927.0762, device='cuda:0') (tensor(24143.3691, device='cuda:0')) | > current_lr_0: 0.00011344089201746529 | > current_lr_1: 0.00011344089201746529 | > step_time: 0.3024 (0.46190710556812775) | > loader_time: 0.0025 (0.012452675746037414)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4286022186279297 (2.4286022186279297) | > loss_disc_real_0: 0.2238338589668274 (0.2238338589668274) | > loss_disc_real_1: 0.1730193793773651 (0.1730193793773651) | > loss_disc_real_2: 0.2620238661766052 (0.2620238661766052) | > loss_disc_real_3: 0.2585058808326721 (0.2585058808326721) | > loss_disc_real_4: 0.22419899702072144 (0.22419899702072144) | > loss_disc_real_5: 0.17032863199710846 (0.17032863199710846) | > loss_0: 2.4286022186279297 (2.4286022186279297) | > loss_gen: 2.1166160106658936 (2.1166160106658936) | > loss_kl: 3.6232290267944336 (3.6232290267944336) | > loss_feat: 4.896487712860107 (4.896487712860107) | > loss_mel: 22.642425537109375 (22.642425537109375) | > loss_duration: 2.5587148666381836 (2.5587148666381836) | > loss_1: 35.83747482299805 (35.83747482299805)  --> STEP: 1 | > loss_disc: 2.2413253784179688 (2.2413253784179688) | > loss_disc_real_0: 0.08361213654279709 (0.08361213654279709) | > loss_disc_real_1: 0.13616029918193817 (0.13616029918193817) | > loss_disc_real_2: 0.07710877060890198 (0.07710877060890198) | > loss_disc_real_3: 0.21758043766021729 (0.21758043766021729) | > loss_disc_real_4: 0.13562588393688202 (0.13562588393688202) | > loss_disc_real_5: 0.13179782032966614 (0.13179782032966614) | > loss_0: 2.2413253784179688 (2.2413253784179688) | > loss_gen: 1.8199362754821777 (1.8199362754821777) | > loss_kl: 4.260847568511963 (4.260847568511963) | > loss_feat: 6.191674709320068 (6.191674709320068) | > loss_mel: 25.117406845092773 (25.117406845092773) | > loss_duration: 2.938438892364502 (2.938438892364502) | > loss_1: 40.328304290771484 (40.328304290771484)  --> STEP: 2 | > loss_disc: 2.0766398906707764 (2.1589826345443726) | > loss_disc_real_0: 0.12737981975078583 (0.10549597814679146) | > loss_disc_real_1: 0.10601749271154404 (0.1210888959467411) | > loss_disc_real_2: 0.20180818438529968 (0.13945847749710083) | > loss_disc_real_3: 0.09329158812761307 (0.15543601289391518) | > loss_disc_real_4: 0.17271099984645844 (0.15416844189167023) | > loss_disc_real_5: 0.16562268137931824 (0.1487102508544922) | > loss_0: 2.0766398906707764 (2.1589826345443726) | > loss_gen: 2.3223137855529785 (2.071125030517578) | > loss_kl: 4.213810920715332 (4.2373292446136475) | > loss_feat: 10.65151596069336 (8.421595335006714) | > loss_mel: 26.946975708007812 (26.032191276550293) | > loss_duration: 2.941920280456543 (2.9401795864105225) | > loss_1: 47.0765380859375 (43.70242118835449)  --> STEP: 3 | > loss_disc: 2.7027969360351562 (2.340254068374634) | > loss_disc_real_0: 0.3087412118911743 (0.17324438939491907) | > loss_disc_real_1: 0.17959745228290558 (0.14059174805879593) | > loss_disc_real_2: 0.0949825793504715 (0.12463317811489105) | > loss_disc_real_3: 0.21845734119415283 (0.17644312232732773) | > loss_disc_real_4: 0.25559189915657043 (0.1879762609799703) | > loss_disc_real_5: 0.23542921245098114 (0.17761657138665518) | > loss_0: 2.7027969360351562 (2.340254068374634) | > loss_gen: 1.6608459949493408 (1.9343653519948323) | > loss_kl: 1.9999608993530273 (3.491539796193441) | > loss_feat: 1.7031499147415161 (6.182113528251648) | > loss_mel: 20.438432693481445 (24.16760508219401) | > loss_duration: 2.6936190128326416 (2.857992728551229) | > loss_1: 28.496009826660156 (38.63361740112305) --> EVAL PERFORMANCE | > avg_loader_time: 0.0030437310536702475 (-0.013417005538940428) | > avg_loss_disc: 2.340254068374634 (-0.4410221576690674) | > avg_loss_disc_real_0: 0.17324438939491907 (+0.000791932145754487) | > avg_loss_disc_real_1: 0.14059174805879593 (-0.17864656696716946) | > avg_loss_disc_real_2: 0.12463317811489105 (-0.11184130112330118) | > avg_loss_disc_real_3: 0.17644312232732773 (-0.10982022434473038) | > avg_loss_disc_real_4: 0.1879762609799703 (-0.09461695949236551) | > avg_loss_disc_real_5: 0.17761657138665518 (-0.13043345510959622) | > avg_loss_0: 2.340254068374634 (-0.4410221576690674) | > avg_loss_gen: 1.9343653519948323 (-0.016899824142456055) | > avg_loss_kl: 3.491539796193441 (-0.2238598664601641) | > avg_loss_feat: 6.182113528251648 (+4.600995232661565) | > avg_loss_mel: 24.16760508219401 (+3.563810984293621) | > avg_loss_duration: 2.857992728551229 (+0.07829578717549657) | > avg_loss_1: 38.63361740112305 (+8.002343495686848)  > EPOCH: 568/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 05:59:36)   --> TIME: 2023-10-20 05:59:53 -- STEP: 19/50 -- GLOBAL_STEP: 81420 | > loss_disc: 2.7599644660949707 (2.510164743975589) | > loss_disc_real_0: 0.25315019488334656 (0.16358352756421818) | > loss_disc_real_1: 0.2270725965499878 (0.22738506919459292) | > loss_disc_real_2: 0.22207053005695343 (0.23688376224354693) | > loss_disc_real_3: 0.24128305912017822 (0.2187318827368711) | > loss_disc_real_4: 0.2743988633155823 (0.23204223674378896) | > loss_disc_real_5: 0.22286942601203918 (0.18497021613936676) | > loss_0: 2.7599644660949707 (2.510164743975589) | > grad_norm_0: tensor(272.0708, device='cuda:0') (tensor(671.4953, device='cuda:0')) | > loss_gen: 1.7445706129074097 (2.1192731606332877) | > loss_kl: 0.9001855254173279 (0.7323562267579531) | > loss_feat: 0.8791288137435913 (4.45222796323268) | > loss_mel: 6.7226176261901855 (18.52546107141595) | > loss_duration: 1.6163270473480225 (1.4809206410458213) | > loss_1: 11.86283016204834 (27.310239114259417) | > grad_norm_1: tensor(17450.5723, device='cuda:0') (tensor(19000.8242, device='cuda:0')) | > current_lr_0: 0.00011332750074343238 | > current_lr_1: 0.00011332750074343238 | > step_time: 0.5773 (0.6170042188544023) | > loader_time: 0.0405 (0.025878542347958212)  --> TIME: 2023-10-20 06:00:11 -- STEP: 49/50 -- GLOBAL_STEP: 81450 | > loss_disc: 2.9107110500335693 (2.4664684558401304) | > loss_disc_real_0: 0.3700887858867645 (0.1539782041835846) | > loss_disc_real_1: 0.2627769708633423 (0.2211584942985554) | > loss_disc_real_2: 0.3067784011363983 (0.23203093531940663) | > loss_disc_real_3: 0.27617278695106506 (0.22430955078832956) | > loss_disc_real_4: 0.2711726725101471 (0.20818028522997487) | > loss_disc_real_5: 0.2656276822090149 (0.20024225769602522) | > loss_0: 2.9107110500335693 (2.4664684558401304) | > grad_norm_0: tensor(1145.5214, device='cuda:0') (tensor(638.9155, device='cuda:0')) | > loss_gen: 2.161904811859131 (2.220201419324291) | > loss_kl: 0.39690038561820984 (0.7836308886810226) | > loss_feat: 0.754302442073822 (4.9543196336195185) | > loss_mel: 16.103515625 (20.923835472184784) | > loss_duration: 1.5435844659805298 (1.4534322072048576) | > loss_1: 20.960208892822266 (30.335419411561926) | > grad_norm_1: tensor(3113.9736, device='cuda:0') (tensor(21405.6777, device='cuda:0')) | > current_lr_0: 0.00011332750074343238 | > current_lr_1: 0.00011332750074343238 | > step_time: 1.0628 (0.5792690685817173) | > loader_time: 0.4367 (0.029494168807049186)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0592727661132812 (3.0592727661132812) | > loss_disc_real_0: 0.6594522595405579 (0.6594522595405579) | > loss_disc_real_1: 0.2782464325428009 (0.2782464325428009) | > loss_disc_real_2: 0.14472408592700958 (0.14472408592700958) | > loss_disc_real_3: 0.28281351923942566 (0.28281351923942566) | > loss_disc_real_4: 0.1857525110244751 (0.1857525110244751) | > loss_disc_real_5: 0.21629762649536133 (0.21629762649536133) | > loss_0: 3.0592727661132812 (3.0592727661132812) | > loss_gen: 2.1337382793426514 (2.1337382793426514) | > loss_kl: 3.4327902793884277 (3.4327902793884277) | > loss_feat: 2.6574907302856445 (2.6574907302856445) | > loss_mel: 24.711814880371094 (24.711814880371094) | > loss_duration: 2.6219048500061035 (2.6219048500061035) | > loss_1: 35.5577392578125 (35.5577392578125)  --> STEP: 1 | > loss_disc: 3.4514260292053223 (3.4514260292053223) | > loss_disc_real_0: 0.5489624738693237 (0.5489624738693237) | > loss_disc_real_1: 0.2271375209093094 (0.2271375209093094) | > loss_disc_real_2: 0.16731315851211548 (0.16731315851211548) | > loss_disc_real_3: 0.24328039586544037 (0.24328039586544037) | > loss_disc_real_4: 0.2981986403465271 (0.2981986403465271) | > loss_disc_real_5: 0.2752421200275421 (0.2752421200275421) | > loss_0: 3.4514260292053223 (3.4514260292053223) | > loss_gen: 1.6336127519607544 (1.6336127519607544) | > loss_kl: 4.643206596374512 (4.643206596374512) | > loss_feat: 2.215089797973633 (2.215089797973633) | > loss_mel: 18.507863998413086 (18.507863998413086) | > loss_duration: 2.9628210067749023 (2.9628210067749023) | > loss_1: 29.962596893310547 (29.962596893310547)  --> STEP: 2 | > loss_disc: 2.516308307647705 (2.9838671684265137) | > loss_disc_real_0: 0.30542534589767456 (0.42719390988349915) | > loss_disc_real_1: 0.22962719202041626 (0.22838235646486282) | > loss_disc_real_2: 0.3196451663970947 (0.2434791624546051) | > loss_disc_real_3: 0.24903561174869537 (0.24615800380706787) | > loss_disc_real_4: 0.2761429250240326 (0.28717078268527985) | > loss_disc_real_5: 0.2629116177558899 (0.269076868891716) | > loss_0: 2.516308307647705 (2.9838671684265137) | > loss_gen: 2.8048229217529297 (2.219217836856842) | > loss_kl: 4.409475803375244 (4.526341199874878) | > loss_feat: 3.8000144958496094 (3.007552146911621) | > loss_mel: 26.806983947753906 (22.657423973083496) | > loss_duration: 2.8646082878112793 (2.913714647293091) | > loss_1: 40.68590545654297 (35.32425117492676)  --> STEP: 3 | > loss_disc: 2.7587809562683105 (2.908838431040446) | > loss_disc_real_0: 0.33972597122192383 (0.3980379303296407) | > loss_disc_real_1: 0.2930116653442383 (0.24992545942465463) | > loss_disc_real_2: 0.3127855062484741 (0.26658127705256146) | > loss_disc_real_3: 0.2725483477115631 (0.2549547851085663) | > loss_disc_real_4: 0.22487498819828033 (0.26640551785628) | > loss_disc_real_5: 0.2865152359008789 (0.2748896578947703) | > loss_0: 2.7587809562683105 (2.908838431040446) | > loss_gen: 2.2185182571411133 (2.2189846436182656) | > loss_kl: 1.9843889474868774 (3.679023782412211) | > loss_feat: 1.9983923435211182 (2.6711655457814536) | > loss_mel: 20.26344108581543 (21.859429677327473) | > loss_duration: 2.790215253829956 (2.8725481828053794) | > loss_1: 29.254955291748047 (33.30115254720052) --> EVAL PERFORMANCE | > avg_loader_time: 0.015654563903808594 (+0.012610832850138346) | > avg_loss_disc: 2.908838431040446 (+0.568584362665812) | > avg_loss_disc_real_0: 0.3980379303296407 (+0.22479354093472162) | > avg_loss_disc_real_1: 0.24992545942465463 (+0.1093337113658587) | > avg_loss_disc_real_2: 0.26658127705256146 (+0.1419480989376704) | > avg_loss_disc_real_3: 0.2549547851085663 (+0.07851166278123856) | > avg_loss_disc_real_4: 0.26640551785628 (+0.07842925687630972) | > avg_loss_disc_real_5: 0.2748896578947703 (+0.09727308650811514) | > avg_loss_0: 2.908838431040446 (+0.568584362665812) | > avg_loss_gen: 2.2189846436182656 (+0.28461929162343336) | > avg_loss_kl: 3.679023782412211 (+0.18748398621877005) | > avg_loss_feat: 2.6711655457814536 (-3.5109479824701944) | > avg_loss_mel: 21.859429677327473 (-2.308175404866539) | > avg_loss_duration: 2.8725481828053794 (+0.01455545425415039) | > avg_loss_1: 33.30115254720052 (-5.332464853922524)  > EPOCH: 569/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:00:28)   --> TIME: 2023-10-20 06:00:53 -- STEP: 29/50 -- GLOBAL_STEP: 81480 | > loss_disc: 2.6578516960144043 (2.3721689705190987) | > loss_disc_real_0: 0.1715947836637497 (0.1657345607106028) | > loss_disc_real_1: 0.2275465577840805 (0.2453949628718968) | > loss_disc_real_2: 0.1878862828016281 (0.23065949578223557) | > loss_disc_real_3: 0.1716710776090622 (0.237856885482525) | > loss_disc_real_4: 0.1825345903635025 (0.22015336419230905) | > loss_disc_real_5: 0.2797558903694153 (0.21904108660488292) | > loss_0: 2.6578516960144043 (2.3721689705190987) | > grad_norm_0: tensor(848.7563, device='cuda:0') (tensor(546.7209, device='cuda:0')) | > loss_gen: 1.8061327934265137 (2.488627080259652) | > loss_kl: 0.693495512008667 (0.8722728100316278) | > loss_feat: 4.236351490020752 (5.701945267135984) | > loss_mel: 14.994872093200684 (20.94238266657139) | > loss_duration: 1.4637036323547363 (1.4647829902583156) | > loss_1: 23.194555282592773 (31.470010905430236) | > grad_norm_1: tensor(7054.6162, device='cuda:0') (tensor(29757.6484, device='cuda:0')) | > current_lr_0: 0.00011321422281107724 | > current_lr_1: 0.00011321422281107724 | > step_time: 0.2581 (0.6138686393869331) | > loader_time: 0.0018 (0.01361846923828125)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.085348606109619 (3.085348606109619) | > loss_disc_real_0: 0.23493264615535736 (0.23493264615535736) | > loss_disc_real_1: 0.3025858402252197 (0.3025858402252197) | > loss_disc_real_2: 0.3528091013431549 (0.3528091013431549) | > loss_disc_real_3: 0.29292070865631104 (0.29292070865631104) | > loss_disc_real_4: 0.3779732882976532 (0.3779732882976532) | > loss_disc_real_5: 0.2932000756263733 (0.2932000756263733) | > loss_0: 3.085348606109619 (3.085348606109619) | > loss_gen: 1.8525655269622803 (1.8525655269622803) | > loss_kl: 3.710385799407959 (3.710385799407959) | > loss_feat: 1.9964238405227661 (1.9964238405227661) | > loss_mel: 21.155677795410156 (21.155677795410156) | > loss_duration: 2.6481268405914307 (2.6481268405914307) | > loss_1: 31.36318016052246 (31.36318016052246)  --> STEP: 1 | > loss_disc: 3.0205087661743164 (3.0205087661743164) | > loss_disc_real_0: 0.3277437388896942 (0.3277437388896942) | > loss_disc_real_1: 0.28350478410720825 (0.28350478410720825) | > loss_disc_real_2: 0.25718778371810913 (0.25718778371810913) | > loss_disc_real_3: 0.291181743144989 (0.291181743144989) | > loss_disc_real_4: 0.29613903164863586 (0.29613903164863586) | > loss_disc_real_5: 0.26879754662513733 (0.26879754662513733) | > loss_0: 3.0205087661743164 (3.0205087661743164) | > loss_gen: 1.729480504989624 (1.729480504989624) | > loss_kl: 4.417013645172119 (4.417013645172119) | > loss_feat: 0.08870586007833481 (0.08870586007833481) | > loss_mel: 12.727102279663086 (12.727102279663086) | > loss_duration: 2.9304046630859375 (2.9304046630859375) | > loss_1: 21.89270782470703 (21.89270782470703)  --> STEP: 2 | > loss_disc: 1.2429617643356323 (2.1317352652549744) | > loss_disc_real_0: 0.054705455899238586 (0.1912245973944664) | > loss_disc_real_1: 0.05863028019666672 (0.17106753215193748) | > loss_disc_real_2: 0.11396580189466476 (0.18557679280638695) | > loss_disc_real_3: 0.08758816123008728 (0.18938495218753815) | > loss_disc_real_4: 0.08890309184789658 (0.19252106174826622) | > loss_disc_real_5: 0.03166797012090683 (0.15023275837302208) | > loss_0: 1.2429617643356323 (2.1317352652549744) | > loss_gen: 3.2069952487945557 (2.46823787689209) | > loss_kl: 4.2134785652160645 (4.315246105194092) | > loss_feat: 12.882999420166016 (6.485852640122175) | > loss_mel: 25.17290496826172 (18.950003623962402) | > loss_duration: 2.8944053649902344 (2.912405014038086) | > loss_1: 48.370784759521484 (35.13174629211426)  --> STEP: 3 | > loss_disc: 2.9711644649505615 (2.411544998486837) | > loss_disc_real_0: 0.27182263135910034 (0.21809060871601105) | > loss_disc_real_1: 0.3027404248714447 (0.21495849639177322) | > loss_disc_real_2: 0.2662087082862854 (0.2124540979663531) | > loss_disc_real_3: 0.2991546094417572 (0.2259748379389445) | > loss_disc_real_4: 0.2970428168773651 (0.2273616467912992) | > loss_disc_real_5: 0.2704668343067169 (0.1903107836842537) | > loss_0: 2.9711644649505615 (2.411544998486837) | > loss_gen: 1.7666306495666504 (2.2343688011169434) | > loss_kl: 1.9869940280914307 (3.5391620794932046) | > loss_feat: 0.38755905628204346 (4.453088112175465) | > loss_mel: 18.05780029296875 (18.652602513631184) | > loss_duration: 2.753185272216797 (2.8593317667643228) | > loss_1: 24.95216941833496 (31.738554000854492) --> EVAL PERFORMANCE | > avg_loader_time: 0.019652128219604492 (+0.0039975643157958984) | > avg_loss_disc: 2.411544998486837 (-0.4972934325536089) | > avg_loss_disc_real_0: 0.21809060871601105 (-0.17994732161362964) | > avg_loss_disc_real_1: 0.21495849639177322 (-0.03496696303288141) | > avg_loss_disc_real_2: 0.2124540979663531 (-0.05412717908620837) | > avg_loss_disc_real_3: 0.2259748379389445 (-0.028979947169621795) | > avg_loss_disc_real_4: 0.2273616467912992 (-0.039043871064980834) | > avg_loss_disc_real_5: 0.1903107836842537 (-0.08457887421051663) | > avg_loss_0: 2.411544998486837 (-0.4972934325536089) | > avg_loss_gen: 2.2343688011169434 (+0.01538415749867772) | > avg_loss_kl: 3.5391620794932046 (-0.13986170291900635) | > avg_loss_feat: 4.453088112175465 (+1.781922566394011) | > avg_loss_mel: 18.652602513631184 (-3.206827163696289) | > avg_loss_duration: 2.8593317667643228 (-0.013216416041056611) | > avg_loss_1: 31.738554000854492 (-1.562598546346031)  > EPOCH: 570/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:01:17)   --> TIME: 2023-10-20 06:01:28 -- STEP: 9/50 -- GLOBAL_STEP: 81510 | > loss_disc: 2.61830997467041 (2.3040192657046847) | > loss_disc_real_0: 0.19625341892242432 (0.14287353493273258) | > loss_disc_real_1: 0.2671204209327698 (0.22822171884278455) | > loss_disc_real_2: 0.4278649091720581 (0.25087259916795623) | > loss_disc_real_3: 0.29837119579315186 (0.21776860310799545) | > loss_disc_real_4: 0.3306068181991577 (0.21704443047444025) | > loss_disc_real_5: 0.21161366999149323 (0.15103989425632688) | > loss_0: 2.61830997467041 (2.3040192657046847) | > grad_norm_0: tensor(392.2019, device='cuda:0') (tensor(515.1863, device='cuda:0')) | > loss_gen: 2.6823220252990723 (2.474391976992289) | > loss_kl: 0.6734038591384888 (1.0493335988786485) | > loss_feat: 5.202653408050537 (6.75158707300822) | > loss_mel: 21.487083435058594 (23.779819700453018) | > loss_duration: 1.3764926195144653 (1.449256870481703) | > loss_1: 31.421955108642578 (35.50438838534885) | > grad_norm_1: tensor(7570.7212, device='cuda:0') (tensor(20997.9238, device='cuda:0')) | > current_lr_0: 0.00011310105810710774 | > current_lr_1: 0.00011310105810710774 | > step_time: 0.63 (0.6602581077151828) | > loader_time: 0.0071 (0.02388930320739746)  --> TIME: 2023-10-20 06:01:49 -- STEP: 39/50 -- GLOBAL_STEP: 81540 | > loss_disc: 2.155891180038452 (2.2813219535045133) | > loss_disc_real_0: 0.0431731715798378 (0.12468193824856709) | > loss_disc_real_1: 0.2762232720851898 (0.21009649341114056) | > loss_disc_real_2: 0.26601937413215637 (0.2189850339618249) | > loss_disc_real_3: 0.21158801019191742 (0.23677510868471402) | > loss_disc_real_4: 0.15036731958389282 (0.19882088584395555) | > loss_disc_real_5: 0.1847231090068817 (0.2016721436371788) | > loss_0: 2.155891180038452 (2.2813219535045133) | > grad_norm_0: tensor(1608.8196, device='cuda:0') (tensor(594.3124, device='cuda:0')) | > loss_gen: 2.430867910385132 (2.4277778405409585) | > loss_kl: 0.5783975720405579 (0.8395869869452256) | > loss_feat: 4.253974437713623 (6.31488073330659) | > loss_mel: 22.840940475463867 (24.28492362682636) | > loss_duration: 1.5366013050079346 (1.4558291312975762) | > loss_1: 31.640783309936523 (35.322998193594124) | > grad_norm_1: tensor(25612.5273, device='cuda:0') (tensor(23640.8047, device='cuda:0')) | > current_lr_0: 0.00011310105810710774 | > current_lr_1: 0.00011310105810710774 | > step_time: 0.3819 (0.6531663674574631) | > loader_time: 0.0521 (0.024947062516823795)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7733092308044434 (2.7733092308044434) | > loss_disc_real_0: 0.1593538373708725 (0.1593538373708725) | > loss_disc_real_1: 0.11760388314723969 (0.11760388314723969) | > loss_disc_real_2: 0.10565146803855896 (0.10565146803855896) | > loss_disc_real_3: 0.08895373344421387 (0.08895373344421387) | > loss_disc_real_4: 0.06561356037855148 (0.06561356037855148) | > loss_disc_real_5: 0.14844481647014618 (0.14844481647014618) | > loss_0: 2.7733092308044434 (2.7733092308044434) | > loss_gen: 1.3742090463638306 (1.3742090463638306) | > loss_kl: 3.9796886444091797 (3.9796886444091797) | > loss_feat: 9.356106758117676 (9.356106758117676) | > loss_mel: 22.534618377685547 (22.534618377685547) | > loss_duration: 2.587618589401245 (2.587618589401245) | > loss_1: 39.832244873046875 (39.832244873046875)  --> STEP: 1 | > loss_disc: 2.343345880508423 (2.343345880508423) | > loss_disc_real_0: 0.17323778569698334 (0.17323778569698334) | > loss_disc_real_1: 0.30788788199424744 (0.30788788199424744) | > loss_disc_real_2: 0.3266596496105194 (0.3266596496105194) | > loss_disc_real_3: 0.21778494119644165 (0.21778494119644165) | > loss_disc_real_4: 0.11086893081665039 (0.11086893081665039) | > loss_disc_real_5: 0.07114866375923157 (0.07114866375923157) | > loss_0: 2.343345880508423 (2.343345880508423) | > loss_gen: 2.3233087062835693 (2.3233087062835693) | > loss_kl: 4.3568010330200195 (4.3568010330200195) | > loss_feat: 6.948636054992676 (6.948636054992676) | > loss_mel: 21.97024917602539 (21.97024917602539) | > loss_duration: 2.955329418182373 (2.955329418182373) | > loss_1: 38.554325103759766 (38.554325103759766)  --> STEP: 2 | > loss_disc: 2.3402175903320312 (2.341781735420227) | > loss_disc_real_0: 0.1454094499349594 (0.15932361781597137) | > loss_disc_real_1: 0.16248588263988495 (0.2351868823170662) | > loss_disc_real_2: 0.17335186898708344 (0.2500057592988014) | > loss_disc_real_3: 0.2562714219093323 (0.23702818155288696) | > loss_disc_real_4: 0.03637365996837616 (0.07362129539251328) | > loss_disc_real_5: 0.057496897876262665 (0.06432278081774712) | > loss_0: 2.3402175903320312 (2.341781735420227) | > loss_gen: 2.145049571990967 (2.234179139137268) | > loss_kl: 4.361928939819336 (4.359364986419678) | > loss_feat: 8.950881004333496 (7.949758529663086) | > loss_mel: 28.77910804748535 (25.37467861175537) | > loss_duration: 2.8940987586975098 (2.9247140884399414) | > loss_1: 47.13106918334961 (42.84269714355469)  --> STEP: 3 | > loss_disc: 2.582170009613037 (2.4219111601511636) | > loss_disc_real_0: 0.2489168345928192 (0.189188023408254) | > loss_disc_real_1: 0.29174426198005676 (0.25403934220472973) | > loss_disc_real_2: 0.16317565739154816 (0.22106239199638367) | > loss_disc_real_3: 0.24636630713939667 (0.24014089008172354) | > loss_disc_real_4: 0.36854976415634155 (0.17193078498045603) | > loss_disc_real_5: 0.32044580578804016 (0.14969712247451147) | > loss_0: 2.582170009613037 (2.4219111601511636) | > loss_gen: 2.4249441623687744 (2.297767480214437) | > loss_kl: 2.2400622367858887 (3.652930736541748) | > loss_feat: 1.9346137046813965 (5.9447102546691895) | > loss_mel: 20.210887908935547 (23.653415044148762) | > loss_duration: 2.7610137462615967 (2.8701473077138266) | > loss_1: 29.57151985168457 (38.418971379597984) --> EVAL PERFORMANCE | > avg_loader_time: 0.011224905649820963 (-0.00842722256978353) | > avg_loss_disc: 2.4219111601511636 (+0.01036616166432669) | > avg_loss_disc_real_0: 0.189188023408254 (-0.02890258530775705) | > avg_loss_disc_real_1: 0.25403934220472973 (+0.03908084581295651) | > avg_loss_disc_real_2: 0.22106239199638367 (+0.008608294030030578) | > avg_loss_disc_real_3: 0.24014089008172354 (+0.014166052142779051) | > avg_loss_disc_real_4: 0.17193078498045603 (-0.05543086181084317) | > avg_loss_disc_real_5: 0.14969712247451147 (-0.04061366120974222) | > avg_loss_0: 2.4219111601511636 (+0.01036616166432669) | > avg_loss_gen: 2.297767480214437 (+0.06339867909749364) | > avg_loss_kl: 3.652930736541748 (+0.11376865704854344) | > avg_loss_feat: 5.9447102546691895 (+1.4916221424937248) | > avg_loss_mel: 23.653415044148762 (+5.000812530517578) | > avg_loss_duration: 2.8701473077138266 (+0.010815540949503877) | > avg_loss_1: 38.418971379597984 (+6.680417378743492)  > EPOCH: 571/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:02:06)   --> TIME: 2023-10-20 06:02:30 -- STEP: 19/50 -- GLOBAL_STEP: 81570 | > loss_disc: 2.5632147789001465 (2.3569329788810327) | > loss_disc_real_0: 0.0459558479487896 (0.1607142467737982) | > loss_disc_real_1: 0.284379243850708 (0.2201737263485005) | > loss_disc_real_2: 0.10521388053894043 (0.21495611495093295) | > loss_disc_real_3: 0.21117286384105682 (0.22281275454320407) | > loss_disc_real_4: 0.06329412013292313 (0.19526679617793938) | > loss_disc_real_5: 0.04165641590952873 (0.19851903342886976) | > loss_0: 2.5632147789001465 (2.3569329788810327) | > grad_norm_0: tensor(991.2539, device='cuda:0') (tensor(732.8055, device='cuda:0')) | > loss_gen: 1.7466182708740234 (2.416753982242785) | > loss_kl: 0.6339368224143982 (0.9041728534196553) | > loss_feat: 6.1638970375061035 (6.125104882607334) | > loss_mel: 21.9582462310791 (22.017622847306104) | > loss_duration: 1.5660367012023926 (1.4956167497132953) | > loss_1: 32.0687370300293 (32.95927128038908) | > grad_norm_1: tensor(39228.6133, device='cuda:0') (tensor(21855.0273, device='cuda:0')) | > current_lr_0: 0.00011298800651834501 | > current_lr_1: 0.00011298800651834501 | > step_time: 0.6879 (0.6488244533538818) | > loader_time: 0.0264 (0.026938752124184055)  --> TIME: 2023-10-20 06:02:49 -- STEP: 49/50 -- GLOBAL_STEP: 81600 | > loss_disc: 2.9511256217956543 (2.489746049958831) | > loss_disc_real_0: 0.13022024929523468 (0.15435245813687842) | > loss_disc_real_1: 0.21523354947566986 (0.22388870877270795) | > loss_disc_real_2: 0.235503688454628 (0.22545008133260572) | > loss_disc_real_3: 0.20262190699577332 (0.24064003311249674) | > loss_disc_real_4: 0.3025207221508026 (0.24438114525104054) | > loss_disc_real_5: 0.3139182925224304 (0.2373498693412664) | > loss_0: 2.9511256217956543 (2.489746049958831) | > grad_norm_0: tensor(954.5760, device='cuda:0') (tensor(618.4103, device='cuda:0')) | > loss_gen: 1.9310824871063232 (2.3255995001111707) | > loss_kl: 0.28864678740501404 (0.808958254678517) | > loss_feat: 5.376527786254883 (5.499420865609938) | > loss_mel: 25.73671531677246 (21.85096968436728) | > loss_duration: 1.590682029724121 (1.45701214731956) | > loss_1: 34.92365646362305 (31.94196045155428) | > grad_norm_1: tensor(28474.5723, device='cuda:0') (tensor(16989.3184, device='cuda:0')) | > current_lr_0: 0.00011298800651834501 | > current_lr_1: 0.00011298800651834501 | > step_time: 0.6444 (0.6165848946084782) | > loader_time: 0.4615 (0.0312588847413355)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7594313621520996 (2.7594313621520996) | > loss_disc_real_0: 0.31521931290626526 (0.31521931290626526) | > loss_disc_real_1: 0.28725725412368774 (0.28725725412368774) | > loss_disc_real_2: 0.15903794765472412 (0.15903794765472412) | > loss_disc_real_3: 0.2649901807308197 (0.2649901807308197) | > loss_disc_real_4: 0.34954050183296204 (0.34954050183296204) | > loss_disc_real_5: 0.25384074449539185 (0.25384074449539185) | > loss_0: 2.7594313621520996 (2.7594313621520996) | > loss_gen: 2.1709342002868652 (2.1709342002868652) | > loss_kl: 4.208266258239746 (4.208266258239746) | > loss_feat: 3.2320566177368164 (3.2320566177368164) | > loss_mel: 21.647260665893555 (21.647260665893555) | > loss_duration: 2.6020121574401855 (2.6020121574401855) | > loss_1: 33.860530853271484 (33.860530853271484)  --> STEP: 1 | > loss_disc: 3.0270566940307617 (3.0270566940307617) | > loss_disc_real_0: 0.2744153141975403 (0.2744153141975403) | > loss_disc_real_1: 0.35498860478401184 (0.35498860478401184) | > loss_disc_real_2: 0.3196183741092682 (0.3196183741092682) | > loss_disc_real_3: 0.29940205812454224 (0.29940205812454224) | > loss_disc_real_4: 0.2999436557292938 (0.2999436557292938) | > loss_disc_real_5: 0.30865469574928284 (0.30865469574928284) | > loss_0: 3.0270566940307617 (3.0270566940307617) | > loss_gen: 1.9565465450286865 (1.9565465450286865) | > loss_kl: 4.1701579093933105 (4.1701579093933105) | > loss_feat: 1.4643640518188477 (1.4643640518188477) | > loss_mel: 19.90369987487793 (19.90369987487793) | > loss_duration: 2.9534363746643066 (2.9534363746643066) | > loss_1: 30.448204040527344 (30.448204040527344)  --> STEP: 2 | > loss_disc: 3.017476797103882 (3.0222667455673218) | > loss_disc_real_0: 0.15580806136131287 (0.21511168777942657) | > loss_disc_real_1: 0.30247053503990173 (0.3287295699119568) | > loss_disc_real_2: 0.25062525272369385 (0.285121813416481) | > loss_disc_real_3: 0.2556838393211365 (0.27754294872283936) | > loss_disc_real_4: 0.26555848121643066 (0.28275106847286224) | > loss_disc_real_5: 0.2969561517238617 (0.30280542373657227) | > loss_0: 3.017476797103882 (3.0222667455673218) | > loss_gen: 1.5422823429107666 (1.7494144439697266) | > loss_kl: 4.183379173278809 (4.17676854133606) | > loss_feat: 0.07089884579181671 (0.7676314488053322) | > loss_mel: 1.909397006034851 (10.90654844045639) | > loss_duration: 2.937013626098633 (2.9452250003814697) | > loss_1: 10.64297103881836 (20.54558753967285)  --> STEP: 3 | > loss_disc: 2.1826529502868652 (2.7423954804738364) | > loss_disc_real_0: 0.11889417469501495 (0.18303918341795603) | > loss_disc_real_1: 0.19410957396030426 (0.28385623792807263) | > loss_disc_real_2: 0.19188281893730164 (0.2540421485900879) | > loss_disc_real_3: 0.2097598910331726 (0.2549485961596171) | > loss_disc_real_4: 0.1857677847146988 (0.2504233072201411) | > loss_disc_real_5: 0.271453320980072 (0.29235472281773883) | > loss_0: 2.1826529502868652 (2.7423954804738364) | > loss_gen: 2.2933197021484375 (1.9307161966959636) | > loss_kl: 1.9205890893936157 (3.4247087240219116) | > loss_feat: 5.705896377563477 (2.4137197583913803) | > loss_mel: 21.988479614257812 (14.600525498390198) | > loss_duration: 2.763981580734253 (2.884810527165731) | > loss_1: 34.67226791381836 (25.254480997721355) --> EVAL PERFORMANCE | > avg_loader_time: 0.013041257858276367 (+0.0018163522084554042) | > avg_loss_disc: 2.7423954804738364 (+0.3204843203226728) | > avg_loss_disc_real_0: 0.18303918341795603 (-0.006148839990297972) | > avg_loss_disc_real_1: 0.28385623792807263 (+0.029816895723342896) | > avg_loss_disc_real_2: 0.2540421485900879 (+0.032979756593704224) | > avg_loss_disc_real_3: 0.2549485961596171 (+0.014807706077893584) | > avg_loss_disc_real_4: 0.2504233072201411 (+0.07849252223968509) | > avg_loss_disc_real_5: 0.29235472281773883 (+0.14265760034322736) | > avg_loss_0: 2.7423954804738364 (+0.3204843203226728) | > avg_loss_gen: 1.9307161966959636 (-0.3670512835184734) | > avg_loss_kl: 3.4247087240219116 (-0.22822201251983643) | > avg_loss_feat: 2.4137197583913803 (-3.530990496277809) | > avg_loss_mel: 14.600525498390198 (-9.052889545758564) | > avg_loss_duration: 2.884810527165731 (+0.014663219451904297) | > avg_loss_1: 25.254480997721355 (-13.164490381876629)  > EPOCH: 572/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:03:08)   --> TIME: 2023-10-20 06:03:31 -- STEP: 29/50 -- GLOBAL_STEP: 81630 | > loss_disc: 2.9566056728363037 (2.441468123731942) | > loss_disc_real_0: 0.4106387794017792 (0.15828719035047908) | > loss_disc_real_1: 0.2712457776069641 (0.2317766277440663) | > loss_disc_real_2: 0.29737117886543274 (0.2282337005539187) | > loss_disc_real_3: 0.2528945803642273 (0.22624746632987056) | > loss_disc_real_4: 0.25970715284347534 (0.22309953899219118) | > loss_disc_real_5: 0.25665056705474854 (0.20688268966202078) | > loss_0: 2.9566056728363037 (2.441468123731942) | > grad_norm_0: tensor(1675.4287, device='cuda:0') (tensor(609.2837, device='cuda:0')) | > loss_gen: 1.8000071048736572 (2.3630588876790015) | > loss_kl: 0.7887054085731506 (0.8633077031579511) | > loss_feat: 0.5388162732124329 (5.62378267282299) | > loss_mel: 15.193033218383789 (21.818211339671038) | > loss_duration: 1.4025142192840576 (1.4628939053107952) | > loss_1: 19.72307586669922 (32.1312545250202) | > grad_norm_1: tensor(6667.3281, device='cuda:0') (tensor(29809.3633, device='cuda:0')) | > current_lr_0: 0.00011287506793172335 | > current_lr_1: 0.00011287506793172335 | > step_time: 0.7489 (0.5597241746968237) | > loader_time: 0.0075 (0.01844605084123283)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.322053909301758 (3.322053909301758) | > loss_disc_real_0: 0.34561505913734436 (0.34561505913734436) | > loss_disc_real_1: 0.30831554532051086 (0.30831554532051086) | > loss_disc_real_2: 0.2023070901632309 (0.2023070901632309) | > loss_disc_real_3: 0.2342156320810318 (0.2342156320810318) | > loss_disc_real_4: 0.13207928836345673 (0.13207928836345673) | > loss_disc_real_5: 0.19149519503116608 (0.19149519503116608) | > loss_0: 3.322053909301758 (3.322053909301758) | > loss_gen: 1.5126887559890747 (1.5126887559890747) | > loss_kl: 4.360333442687988 (4.360333442687988) | > loss_feat: 2.71671462059021 (2.71671462059021) | > loss_mel: 23.146345138549805 (23.146345138549805) | > loss_duration: 2.7196860313415527 (2.7196860313415527) | > loss_1: 34.45576858520508 (34.45576858520508)  --> STEP: 1 | > loss_disc: 2.20939302444458 (2.20939302444458) | > loss_disc_real_0: 0.06006861850619316 (0.06006861850619316) | > loss_disc_real_1: 0.29597207903862 (0.29597207903862) | > loss_disc_real_2: 0.28981685638427734 (0.28981685638427734) | > loss_disc_real_3: 0.24623046815395355 (0.24623046815395355) | > loss_disc_real_4: 0.2006123960018158 (0.2006123960018158) | > loss_disc_real_5: 0.07667569071054459 (0.07667569071054459) | > loss_0: 2.20939302444458 (2.20939302444458) | > loss_gen: 3.1637496948242188 (3.1637496948242188) | > loss_kl: 4.592739582061768 (4.592739582061768) | > loss_feat: 7.189126491546631 (7.189126491546631) | > loss_mel: 29.22858238220215 (29.22858238220215) | > loss_duration: 3.1243178844451904 (3.1243178844451904) | > loss_1: 47.29851531982422 (47.29851531982422)  --> STEP: 2 | > loss_disc: 1.7614518404006958 (1.985422432422638) | > loss_disc_real_0: 0.10841663181781769 (0.08424262516200542) | > loss_disc_real_1: 0.2637764513492584 (0.2798742651939392) | > loss_disc_real_2: 0.24497754871845245 (0.2673972025513649) | > loss_disc_real_3: 0.19573649764060974 (0.22098348289728165) | > loss_disc_real_4: 0.09095223993062973 (0.14578231796622276) | > loss_disc_real_5: 0.1543421745300293 (0.11550893262028694) | > loss_0: 1.7614518404006958 (1.985422432422638) | > loss_gen: 3.7655067443847656 (3.464628219604492) | > loss_kl: 3.977492570877075 (4.285116076469421) | > loss_feat: 9.101943016052246 (8.145534753799438) | > loss_mel: 25.25925636291504 (27.243919372558594) | > loss_duration: 2.944166898727417 (3.0342423915863037) | > loss_1: 45.04836654663086 (46.17344093322754)  --> STEP: 3 | > loss_disc: 2.4773941040039062 (2.149412989616394) | > loss_disc_real_0: 0.13429149985313416 (0.10092558339238167) | > loss_disc_real_1: 0.24659161269664764 (0.26878004769484204) | > loss_disc_real_2: 0.25466179847717285 (0.26315206785996753) | > loss_disc_real_3: 0.24967361986637115 (0.23054686188697815) | > loss_disc_real_4: 0.26694580912590027 (0.18617014835278192) | > loss_disc_real_5: 0.3041086494922638 (0.1783755049109459) | > loss_0: 2.4773941040039062 (2.149412989616394) | > loss_gen: 2.3511104583740234 (3.0934556325276694) | > loss_kl: 1.9210257530212402 (3.497085968653361) | > loss_feat: 4.304105758666992 (6.865058422088623) | > loss_mel: 23.271074295043945 (25.91963768005371) | > loss_duration: 2.7078347206115723 (2.9254398345947266) | > loss_1: 34.555152893066406 (42.30067825317383) --> EVAL PERFORMANCE | > avg_loader_time: 0.012151241302490234 (-0.0008900165557861328) | > avg_loss_disc: 2.149412989616394 (-0.5929824908574424) | > avg_loss_disc_real_0: 0.10092558339238167 (-0.08211360002557436) | > avg_loss_disc_real_1: 0.26878004769484204 (-0.01507619023323059) | > avg_loss_disc_real_2: 0.26315206785996753 (+0.00910991926987964) | > avg_loss_disc_real_3: 0.23054686188697815 (-0.024401734272638975) | > avg_loss_disc_real_4: 0.18617014835278192 (-0.06425315886735919) | > avg_loss_disc_real_5: 0.1783755049109459 (-0.11397921790679294) | > avg_loss_0: 2.149412989616394 (-0.5929824908574424) | > avg_loss_gen: 3.0934556325276694 (+1.1627394358317058) | > avg_loss_kl: 3.497085968653361 (+0.07237724463144923) | > avg_loss_feat: 6.865058422088623 (+4.451338663697243) | > avg_loss_mel: 25.91963768005371 (+11.319112181663513) | > avg_loss_duration: 2.9254398345947266 (+0.04062930742899562) | > avg_loss_1: 42.30067825317383 (+17.046197255452473)  > EPOCH: 573/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:04:03)   --> TIME: 2023-10-20 06:04:15 -- STEP: 9/50 -- GLOBAL_STEP: 81660 | > loss_disc: 2.8865809440612793 (2.4517838425106473) | > loss_disc_real_0: 0.24084337055683136 (0.14758889480597442) | > loss_disc_real_1: 0.28124967217445374 (0.23277101003461415) | > loss_disc_real_2: 0.38144490122795105 (0.27590558181206387) | > loss_disc_real_3: 0.27948835492134094 (0.23541685028208625) | > loss_disc_real_4: 0.255427747964859 (0.17254969146516588) | > loss_disc_real_5: 0.31053173542022705 (0.1691206292145782) | > loss_0: 2.8865809440612793 (2.4517838425106473) | > grad_norm_0: tensor(777.7617, device='cuda:0') (tensor(1162.2667, device='cuda:0')) | > loss_gen: 1.9411602020263672 (2.418720086415609) | > loss_kl: 0.7929331660270691 (0.9866449766688876) | > loss_feat: 0.46937569975852966 (5.180520448419783) | > loss_mel: 15.702417373657227 (20.773880110846626) | > loss_duration: 1.370233178138733 (1.4531136221355863) | > loss_1: 20.276119232177734 (30.812879774305557) | > grad_norm_1: tensor(9018.6904, device='cuda:0') (tensor(16865.2578, device='cuda:0')) | > current_lr_0: 0.00011276224223429003 | > current_lr_1: 0.00011276224223429003 | > step_time: 0.4945 (0.6785328918033176) | > loader_time: 0.0054 (0.01400568750169542)  --> TIME: 2023-10-20 06:04:31 -- STEP: 39/50 -- GLOBAL_STEP: 81690 | > loss_disc: 3.08504056930542 (2.4076390327551422) | > loss_disc_real_0: 0.10383833944797516 (0.15525093058554026) | > loss_disc_real_1: 0.22540341317653656 (0.22258875939326409) | > loss_disc_real_2: 0.23313561081886292 (0.25258870231799596) | > loss_disc_real_3: 0.18728142976760864 (0.2502070640524228) | > loss_disc_real_4: 0.2613062858581543 (0.2008653825674301) | > loss_disc_real_5: 0.2889976501464844 (0.19802933367781153) | > loss_0: 3.08504056930542 (2.4076390327551422) | > grad_norm_0: tensor(862.4196, device='cuda:0') (tensor(858.2423, device='cuda:0')) | > loss_gen: 1.4088480472564697 (2.6071134958511752) | > loss_kl: 0.6436379551887512 (0.86454083216496) | > loss_feat: 0.1415219008922577 (6.086733296131476) | > loss_mel: 1.8182947635650635 (20.431937022086903) | > loss_duration: 1.5128717422485352 (1.4562426866629183) | > loss_1: 5.525174140930176 (31.446567254188732) | > grad_norm_1: tensor(19336.2617, device='cuda:0') (tensor(30504.7402, device='cuda:0')) | > current_lr_0: 0.00011276224223429003 | > current_lr_1: 0.00011276224223429003 | > step_time: 0.3522 (0.5479850524511093) | > loader_time: 0.0089 (0.016745652907933943)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.843553066253662 (2.843553066253662) | > loss_disc_real_0: 0.09332679212093353 (0.09332679212093353) | > loss_disc_real_1: 0.18644975125789642 (0.18644975125789642) | > loss_disc_real_2: 0.29697373509407043 (0.29697373509407043) | > loss_disc_real_3: 0.24018926918506622 (0.24018926918506622) | > loss_disc_real_4: 0.4047655463218689 (0.4047655463218689) | > loss_disc_real_5: 0.3142419159412384 (0.3142419159412384) | > loss_0: 2.843553066253662 (2.843553066253662) | > loss_gen: 2.0079185962677 (2.0079185962677) | > loss_kl: 4.136303424835205 (4.136303424835205) | > loss_feat: 4.464885234832764 (4.464885234832764) | > loss_mel: 22.95888328552246 (22.95888328552246) | > loss_duration: 2.529938220977783 (2.529938220977783) | > loss_1: 36.09792709350586 (36.09792709350586)  --> STEP: 1 | > loss_disc: 2.4028303623199463 (2.4028303623199463) | > loss_disc_real_0: 0.09742580354213715 (0.09742580354213715) | > loss_disc_real_1: 0.27330732345581055 (0.27330732345581055) | > loss_disc_real_2: 0.12007509917020798 (0.12007509917020798) | > loss_disc_real_3: 0.17594194412231445 (0.17594194412231445) | > loss_disc_real_4: 0.22224150598049164 (0.22224150598049164) | > loss_disc_real_5: 0.09087076038122177 (0.09087076038122177) | > loss_0: 2.4028303623199463 (2.4028303623199463) | > loss_gen: 1.8248263597488403 (1.8248263597488403) | > loss_kl: 4.181257247924805 (4.181257247924805) | > loss_feat: 4.927795886993408 (4.927795886993408) | > loss_mel: 20.80838394165039 (20.80838394165039) | > loss_duration: 2.972621202468872 (2.972621202468872) | > loss_1: 34.71488571166992 (34.71488571166992)  --> STEP: 2 | > loss_disc: 3.022090435028076 (2.7124603986740112) | > loss_disc_real_0: 0.35422253608703613 (0.22582416981458664) | > loss_disc_real_1: 0.28374767303466797 (0.27852749824523926) | > loss_disc_real_2: 0.3040161728858948 (0.21204563602805138) | > loss_disc_real_3: 0.30268898606300354 (0.239315465092659) | > loss_disc_real_4: 0.2737317979335785 (0.24798665195703506) | > loss_disc_real_5: 0.22745448350906372 (0.15916262194514275) | > loss_0: 3.022090435028076 (2.7124603986740112) | > loss_gen: 1.7540103197097778 (1.789418339729309) | > loss_kl: 4.43975830078125 (4.310507774353027) | > loss_feat: 0.11764415353536606 (2.522720020264387) | > loss_mel: 4.599892616271973 (12.704138278961182) | > loss_duration: 2.7057900428771973 (2.8392056226730347) | > loss_1: 13.617095947265625 (24.165990829467773)  --> STEP: 3 | > loss_disc: 2.7848637104034424 (2.736594835917155) | > loss_disc_real_0: 0.12326677143573761 (0.1916383703549703) | > loss_disc_real_1: 0.28768491744995117 (0.28157997131347656) | > loss_disc_real_2: 0.21878628432750702 (0.2142925187945366) | > loss_disc_real_3: 0.3191770315170288 (0.2659359872341156) | > loss_disc_real_4: 0.306318461894989 (0.2674305886030197) | > loss_disc_real_5: 0.2594723105430603 (0.19259918481111526) | > loss_0: 2.7848637104034424 (2.736594835917155) | > loss_gen: 1.7627729177474976 (1.7805365324020386) | > loss_kl: 2.3827552795410156 (3.66792360941569) | > loss_feat: 1.038638949394226 (2.0280263299743333) | > loss_mel: 14.765153884887695 (13.391143480936686) | > loss_duration: 2.608358860015869 (2.762256701787313) | > loss_1: 22.557680130004883 (23.629887262980144) --> EVAL PERFORMANCE | > avg_loader_time: 0.02416539192199707 (+0.012014150619506836) | > avg_loss_disc: 2.736594835917155 (+0.5871818463007608) | > avg_loss_disc_real_0: 0.1916383703549703 (+0.09071278696258864) | > avg_loss_disc_real_1: 0.28157997131347656 (+0.012799923618634523) | > avg_loss_disc_real_2: 0.2142925187945366 (-0.04885954906543094) | > avg_loss_disc_real_3: 0.2659359872341156 (+0.03538912534713745) | > avg_loss_disc_real_4: 0.2674305886030197 (+0.08126044025023779) | > avg_loss_disc_real_5: 0.19259918481111526 (+0.014223679900169373) | > avg_loss_0: 2.736594835917155 (+0.5871818463007608) | > avg_loss_gen: 1.7805365324020386 (-1.3129191001256308) | > avg_loss_kl: 3.66792360941569 (+0.1708376407623291) | > avg_loss_feat: 2.0280263299743333 (-4.83703209211429) | > avg_loss_mel: 13.391143480936686 (-12.528494199117025) | > avg_loss_duration: 2.762256701787313 (-0.1631831328074136) | > avg_loss_1: 23.629887262980144 (-18.670790990193684)  > EPOCH: 574/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:04:52)   --> TIME: 2023-10-20 06:05:12 -- STEP: 19/50 -- GLOBAL_STEP: 81720 | > loss_disc: 2.352614641189575 (2.3457994147350916) | > loss_disc_real_0: 0.19036096334457397 (0.1442568488419056) | > loss_disc_real_1: 0.22920295596122742 (0.21468025132229454) | > loss_disc_real_2: 0.19233287870883942 (0.21887577991736562) | > loss_disc_real_3: 0.2960764765739441 (0.21884629287217794) | > loss_disc_real_4: 0.15386120975017548 (0.19457437617606238) | > loss_disc_real_5: 0.2518981993198395 (0.19762802766145846) | > loss_0: 2.352614641189575 (2.3457994147350916) | > grad_norm_0: tensor(339.4469, device='cuda:0') (tensor(487.8890, device='cuda:0')) | > loss_gen: 2.3013110160827637 (2.3347705790871074) | > loss_kl: 0.9515376091003418 (0.8781334193129289) | > loss_feat: 5.990768909454346 (5.378830672094696) | > loss_mel: 21.866283416748047 (20.967103054648952) | > loss_duration: 1.6144682168960571 (1.4949044742082294) | > loss_1: 32.724369049072266 (31.05374173114174) | > grad_norm_1: tensor(9994.8721, device='cuda:0') (tensor(23260.5000, device='cuda:0')) | > current_lr_0: 0.00011264952931320524 | > current_lr_1: 0.00011264952931320524 | > step_time: 0.4825 (0.6143210812618858) | > loader_time: 0.0024 (0.020135603452983656)  --> TIME: 2023-10-20 06:05:33 -- STEP: 49/50 -- GLOBAL_STEP: 81750 | > loss_disc: 1.886674404144287 (2.3561514640341) | > loss_disc_real_0: 0.03821976110339165 (0.12937072265361035) | > loss_disc_real_1: 0.1397329568862915 (0.21519630478352916) | > loss_disc_real_2: 0.08429710566997528 (0.21325154062740656) | > loss_disc_real_3: 0.21322917938232422 (0.2253917992419126) | > loss_disc_real_4: 0.08633389323949814 (0.2180759835494112) | > loss_disc_real_5: 0.16000963747501373 (0.21716238678033858) | > loss_0: 1.886674404144287 (2.3561514640341) | > grad_norm_0: tensor(1596.6062, device='cuda:0') (tensor(619.1767, device='cuda:0')) | > loss_gen: 2.2737696170806885 (2.4108484667174666) | > loss_kl: 0.7125879526138306 (0.8560471674617456) | > loss_feat: 5.631114959716797 (5.683339132034049) | > loss_mel: 25.340723037719727 (21.691199701659535) | > loss_duration: 1.5833780765533447 (1.4668535359051762) | > loss_1: 35.54157257080078 (32.10828770423422) | > grad_norm_1: tensor(18541.2871, device='cuda:0') (tensor(22765.0449, device='cuda:0')) | > current_lr_0: 0.00011264952931320524 | > current_lr_1: 0.00011264952931320524 | > step_time: 0.6148 (0.625516940136345) | > loader_time: 0.5181 (0.031439630352720925)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9285473823547363 (2.9285473823547363) | > loss_disc_real_0: 0.33616697788238525 (0.33616697788238525) | > loss_disc_real_1: 0.25661417841911316 (0.25661417841911316) | > loss_disc_real_2: 0.22404320538043976 (0.22404320538043976) | > loss_disc_real_3: 0.22166560590267181 (0.22166560590267181) | > loss_disc_real_4: 0.26720550656318665 (0.26720550656318665) | > loss_disc_real_5: 0.26792240142822266 (0.26792240142822266) | > loss_0: 2.9285473823547363 (2.9285473823547363) | > loss_gen: 1.697652816772461 (1.697652816772461) | > loss_kl: 3.7222440242767334 (3.7222440242767334) | > loss_feat: 0.27159056067466736 (0.27159056067466736) | > loss_mel: 5.423747539520264 (5.423747539520264) | > loss_duration: 2.69386887550354 (2.69386887550354) | > loss_1: 13.809103012084961 (13.809103012084961)  --> STEP: 1 | > loss_disc: 2.0639286041259766 (2.0639286041259766) | > loss_disc_real_0: 0.07043635845184326 (0.07043635845184326) | > loss_disc_real_1: 0.21827997267246246 (0.21827997267246246) | > loss_disc_real_2: 0.164706289768219 (0.164706289768219) | > loss_disc_real_3: 0.2893572151660919 (0.2893572151660919) | > loss_disc_real_4: 0.25666818022727966 (0.25666818022727966) | > loss_disc_real_5: 0.20257660746574402 (0.20257660746574402) | > loss_0: 2.0639286041259766 (2.0639286041259766) | > loss_gen: 3.6163079738616943 (3.6163079738616943) | > loss_kl: 4.46745491027832 (4.46745491027832) | > loss_feat: 9.3596773147583 (9.3596773147583) | > loss_mel: 26.145313262939453 (26.145313262939453) | > loss_duration: 3.148282766342163 (3.148282766342163) | > loss_1: 46.73703384399414 (46.73703384399414)  --> STEP: 2 | > loss_disc: 1.7512890100479126 (1.9076088070869446) | > loss_disc_real_0: 0.1974094659090042 (0.13392291218042374) | > loss_disc_real_1: 0.11023538559675217 (0.16425767913460732) | > loss_disc_real_2: 0.10892288386821747 (0.13681458681821823) | > loss_disc_real_3: 0.1012733206152916 (0.19531526789069176) | > loss_disc_real_4: 0.10465606302022934 (0.1806621216237545) | > loss_disc_real_5: 0.15458224713802338 (0.1785794273018837) | > loss_0: 1.7512890100479126 (1.9076088070869446) | > loss_gen: 3.5249404907226562 (3.5706242322921753) | > loss_kl: 4.750065326690674 (4.608760118484497) | > loss_feat: 12.193953514099121 (10.776815414428711) | > loss_mel: 24.790904998779297 (25.468109130859375) | > loss_duration: 2.8727002143859863 (3.0104914903640747) | > loss_1: 48.132564544677734 (47.43479919433594)  --> STEP: 3 | > loss_disc: 2.717186450958252 (2.177468021710714) | > loss_disc_real_0: 0.17699921131134033 (0.14828167855739594) | > loss_disc_real_1: 0.2722443640232086 (0.20025324076414108) | > loss_disc_real_2: 0.20668047666549683 (0.1601032167673111) | > loss_disc_real_3: 0.23711459338665009 (0.20924837638934454) | > loss_disc_real_4: 0.23911099135875702 (0.20014507820208868) | > loss_disc_real_5: 0.2767676115036011 (0.2113088220357895) | > loss_0: 2.717186450958252 (2.177468021710714) | > loss_gen: 1.8200936317443848 (2.9871140321095786) | > loss_kl: 1.7921078205108643 (3.6698760191599527) | > loss_feat: 1.5046262741088867 (7.6860857009887695) | > loss_mel: 17.006906509399414 (22.647708257039387) | > loss_duration: 2.6874818801879883 (2.9028216203053794) | > loss_1: 24.811214447021484 (39.89360427856445) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024939378102620444 (-0.021671454111735027) | > avg_loss_disc: 2.177468021710714 (-0.559126814206441) | > avg_loss_disc_real_0: 0.14828167855739594 (-0.04335669179757437) | > avg_loss_disc_real_1: 0.20025324076414108 (-0.08132673054933548) | > avg_loss_disc_real_2: 0.1601032167673111 (-0.054189302027225494) | > avg_loss_disc_real_3: 0.20924837638934454 (-0.05668761084477106) | > avg_loss_disc_real_4: 0.20014507820208868 (-0.06728551040093103) | > avg_loss_disc_real_5: 0.2113088220357895 (+0.018709637224674225) | > avg_loss_0: 2.177468021710714 (-0.559126814206441) | > avg_loss_gen: 2.9871140321095786 (+1.20657749970754) | > avg_loss_kl: 3.6698760191599527 (+0.0019524097442626953) | > avg_loss_feat: 7.6860857009887695 (+5.658059371014437) | > avg_loss_mel: 22.647708257039387 (+9.256564776102701) | > avg_loss_duration: 2.9028216203053794 (+0.1405649185180664) | > avg_loss_1: 39.89360427856445 (+16.26371701558431)  > EPOCH: 575/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:05:45)   --> TIME: 2023-10-20 06:06:08 -- STEP: 29/50 -- GLOBAL_STEP: 81780 | > loss_disc: 1.6527881622314453 (2.4936923487433074) | > loss_disc_real_0: 0.1310383826494217 (0.1606456790247868) | > loss_disc_real_1: 0.12738025188446045 (0.2343297125450496) | > loss_disc_real_2: 0.14144742488861084 (0.2604526453490915) | > loss_disc_real_3: 0.07667302340269089 (0.231953424497925) | > loss_disc_real_4: 0.1482502669095993 (0.23889903017672995) | > loss_disc_real_5: 0.20322802662849426 (0.21880795132240344) | > loss_0: 1.6527881622314453 (2.4936923487433074) | > grad_norm_0: tensor(281.3590, device='cuda:0') (tensor(643.5565, device='cuda:0')) | > loss_gen: 2.9287772178649902 (2.3963784842655578) | > loss_kl: 1.2132426500320435 (0.9632901991235798) | > loss_feat: 8.775468826293945 (5.270505466080945) | > loss_mel: 25.70677375793457 (21.20434886833717) | > loss_duration: 1.499428629875183 (1.4829632084945152) | > loss_1: 40.123687744140625 (31.317486467032595) | > grad_norm_1: tensor(3333.1267, device='cuda:0') (tensor(23030.2441, device='cuda:0')) | > current_lr_0: 0.00011253692905574196 | > current_lr_1: 0.00011253692905574196 | > step_time: 0.8213 (0.6018120091536949) | > loader_time: 0.0417 (0.02068326391022781)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.43613600730896 (2.43613600730896) | > loss_disc_real_0: 0.2775323987007141 (0.2775323987007141) | > loss_disc_real_1: 0.30217015743255615 (0.30217015743255615) | > loss_disc_real_2: 0.19321386516094208 (0.19321386516094208) | > loss_disc_real_3: 0.16805101931095123 (0.16805101931095123) | > loss_disc_real_4: 0.15381579101085663 (0.15381579101085663) | > loss_disc_real_5: 0.24920044839382172 (0.24920044839382172) | > loss_0: 2.43613600730896 (2.43613600730896) | > loss_gen: 2.7930946350097656 (2.7930946350097656) | > loss_kl: 3.5005228519439697 (3.5005228519439697) | > loss_feat: 5.315084934234619 (5.315084934234619) | > loss_mel: 26.424177169799805 (26.424177169799805) | > loss_duration: 2.6308469772338867 (2.6308469772338867) | > loss_1: 40.663726806640625 (40.663726806640625)  --> STEP: 1 | > loss_disc: 2.2127740383148193 (2.2127740383148193) | > loss_disc_real_0: 0.07537432014942169 (0.07537432014942169) | > loss_disc_real_1: 0.2962401211261749 (0.2962401211261749) | > loss_disc_real_2: 0.3200077712535858 (0.3200077712535858) | > loss_disc_real_3: 0.23925979435443878 (0.23925979435443878) | > loss_disc_real_4: 0.16066354513168335 (0.16066354513168335) | > loss_disc_real_5: 0.09981673210859299 (0.09981673210859299) | > loss_0: 2.2127740383148193 (2.2127740383148193) | > loss_gen: 2.5685834884643555 (2.5685834884643555) | > loss_kl: 4.487669467926025 (4.487669467926025) | > loss_feat: 4.75058126449585 (4.75058126449585) | > loss_mel: 20.872249603271484 (20.872249603271484) | > loss_duration: 3.059804677963257 (3.059804677963257) | > loss_1: 35.738887786865234 (35.738887786865234)  --> STEP: 2 | > loss_disc: 2.3458425998687744 (2.279308319091797) | > loss_disc_real_0: 0.357390820980072 (0.21638257056474686) | > loss_disc_real_1: 0.2756495773792267 (0.2859448492527008) | > loss_disc_real_2: 0.17828881740570068 (0.24914829432964325) | > loss_disc_real_3: 0.19866950809955597 (0.21896465122699738) | > loss_disc_real_4: 0.2897478938102722 (0.22520571947097778) | > loss_disc_real_5: 0.2485748529434204 (0.1741957925260067) | > loss_0: 2.3458425998687744 (2.279308319091797) | > loss_gen: 3.1341044902801514 (2.8513439893722534) | > loss_kl: 4.341036319732666 (4.414352893829346) | > loss_feat: 9.635860443115234 (7.193220853805542) | > loss_mel: 25.390018463134766 (23.131134033203125) | > loss_duration: 3.023404359817505 (3.041604518890381) | > loss_1: 45.52442169189453 (40.63165473937988)  --> STEP: 3 | > loss_disc: 2.9599688053131104 (2.506195147832235) | > loss_disc_real_0: 0.2262800931930542 (0.21968174477418265) | > loss_disc_real_1: 0.2579647898674011 (0.27661816279093426) | > loss_disc_real_2: 0.288262277841568 (0.26218628883361816) | > loss_disc_real_3: 0.27153608202934265 (0.2364884614944458) | > loss_disc_real_4: 0.24457958340644836 (0.23166367411613464) | > loss_disc_real_5: 0.21939757466316223 (0.18926305323839188) | > loss_0: 2.9599688053131104 (2.506195147832235) | > loss_gen: 1.558760643005371 (2.420482873916626) | > loss_kl: 2.265455722808838 (3.6980538368225098) | > loss_feat: 0.13650277256965637 (4.84098149339358) | > loss_mel: 2.6423873901367188 (16.301551818847656) | > loss_duration: 2.6616153717041016 (2.9149414698282876) | > loss_1: 9.264721870422363 (30.176010449727375) --> EVAL PERFORMANCE | > avg_loader_time: 0.01621405283610026 (+0.013720115025838217) | > avg_loss_disc: 2.506195147832235 (+0.328727126121521) | > avg_loss_disc_real_0: 0.21968174477418265 (+0.07140006621678671) | > avg_loss_disc_real_1: 0.27661816279093426 (+0.07636492202679318) | > avg_loss_disc_real_2: 0.26218628883361816 (+0.10208307206630707) | > avg_loss_disc_real_3: 0.2364884614944458 (+0.027240085105101258) | > avg_loss_disc_real_4: 0.23166367411613464 (+0.03151859591404596) | > avg_loss_disc_real_5: 0.18926305323839188 (-0.022045768797397614) | > avg_loss_0: 2.506195147832235 (+0.328727126121521) | > avg_loss_gen: 2.420482873916626 (-0.5666311581929526) | > avg_loss_kl: 3.6980538368225098 (+0.028177817662557114) | > avg_loss_feat: 4.84098149339358 (-2.845104207595189) | > avg_loss_mel: 16.301551818847656 (-6.346156438191731) | > avg_loss_duration: 2.9149414698282876 (+0.012119849522908233) | > avg_loss_1: 30.176010449727375 (-9.717593828837078)  > EPOCH: 576/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:06:31)   --> TIME: 2023-10-20 06:06:42 -- STEP: 9/50 -- GLOBAL_STEP: 81810 | > loss_disc: 1.4523307085037231 (2.1660731699731617) | > loss_disc_real_0: 0.03631815314292908 (0.11358837731596497) | > loss_disc_real_1: 0.18322013318538666 (0.23343325571881401) | > loss_disc_real_2: 0.12411080300807953 (0.18961594336562687) | > loss_disc_real_3: 0.17321020364761353 (0.22437619831826952) | > loss_disc_real_4: 0.07490360736846924 (0.18090995401144028) | > loss_disc_real_5: 0.01808319240808487 (0.16365919593307707) | > loss_0: 1.4523307085037231 (2.1660731699731617) | > grad_norm_0: tensor(285.3404, device='cuda:0') (tensor(720.6959, device='cuda:0')) | > loss_gen: 2.9410951137542725 (2.7096542252434626) | > loss_kl: 0.44902852177619934 (0.8804593781630198) | > loss_feat: 10.974177360534668 (7.262633264064789) | > loss_mel: 24.139293670654297 (22.874285803900825) | > loss_duration: 1.4460480213165283 (1.4896313614315457) | > loss_1: 39.949642181396484 (35.21666357252333) | > grad_norm_1: tensor(9187.4707, device='cuda:0') (tensor(38148.2734, device='cuda:0')) | > current_lr_0: 0.00011242444134928582 | > current_lr_1: 0.00011242444134928582 | > step_time: 0.5848 (0.6462979316711426) | > loader_time: 0.0335 (0.02859065267774794)  --> TIME: 2023-10-20 06:07:02 -- STEP: 39/50 -- GLOBAL_STEP: 81840 | > loss_disc: 2.867576837539673 (2.390006320598798) | > loss_disc_real_0: 0.11740018427371979 (0.1374667730803291) | > loss_disc_real_1: 0.2320193350315094 (0.23414639249826089) | > loss_disc_real_2: 0.27235597372055054 (0.23547133784263563) | > loss_disc_real_3: 0.39323511719703674 (0.2505210366768715) | > loss_disc_real_4: 0.37554264068603516 (0.21225736586329264) | > loss_disc_real_5: 0.42704832553863525 (0.19111404348260316) | > loss_0: 2.867576837539673 (2.390006320598798) | > grad_norm_0: tensor(1261.2087, device='cuda:0') (tensor(624.0268, device='cuda:0')) | > loss_gen: 2.1846234798431396 (2.5423567845271178) | > loss_kl: 0.43560609221458435 (0.833854364278989) | > loss_feat: 2.6765456199645996 (6.560258683294822) | > loss_mel: 20.55518341064453 (23.0538136775677) | > loss_duration: 1.5714731216430664 (1.4612413889322526) | > loss_1: 27.423431396484375 (34.45152452664498) | > grad_norm_1: tensor(5166.3340, device='cuda:0') (tensor(29301.4590, device='cuda:0')) | > current_lr_0: 0.00011242444134928582 | > current_lr_1: 0.00011242444134928582 | > step_time: 0.4887 (0.6290637285281451) | > loader_time: 0.0027 (0.025012670419155024)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.968210220336914 (2.968210220336914) | > loss_disc_real_0: 0.3710983991622925 (0.3710983991622925) | > loss_disc_real_1: 0.20420606434345245 (0.20420606434345245) | > loss_disc_real_2: 0.3385820686817169 (0.3385820686817169) | > loss_disc_real_3: 0.34845292568206787 (0.34845292568206787) | > loss_disc_real_4: 0.48733365535736084 (0.48733365535736084) | > loss_disc_real_5: 0.33117732405662537 (0.33117732405662537) | > loss_0: 2.968210220336914 (2.968210220336914) | > loss_gen: 3.19732666015625 (3.19732666015625) | > loss_kl: 4.076269626617432 (4.076269626617432) | > loss_feat: 5.2103447914123535 (5.2103447914123535) | > loss_mel: 24.094554901123047 (24.094554901123047) | > loss_duration: 2.681471347808838 (2.681471347808838) | > loss_1: 39.25996780395508 (39.25996780395508)  --> STEP: 1 | > loss_disc: 2.3294267654418945 (2.3294267654418945) | > loss_disc_real_0: 0.23452013731002808 (0.23452013731002808) | > loss_disc_real_1: 0.25531476736068726 (0.25531476736068726) | > loss_disc_real_2: 0.16769708693027496 (0.16769708693027496) | > loss_disc_real_3: 0.2280266284942627 (0.2280266284942627) | > loss_disc_real_4: 0.12535744905471802 (0.12535744905471802) | > loss_disc_real_5: 0.12290080636739731 (0.12290080636739731) | > loss_0: 2.3294267654418945 (2.3294267654418945) | > loss_gen: 2.244274616241455 (2.244274616241455) | > loss_kl: 4.407663345336914 (4.407663345336914) | > loss_feat: 4.54334831237793 (4.54334831237793) | > loss_mel: 19.57345199584961 (19.57345199584961) | > loss_duration: 2.9926085472106934 (2.9926085472106934) | > loss_1: 33.76134490966797 (33.76134490966797)  --> STEP: 2 | > loss_disc: 2.4129512310028076 (2.371188998222351) | > loss_disc_real_0: 0.37416476011276245 (0.30434244871139526) | > loss_disc_real_1: 0.1428735852241516 (0.19909417629241943) | > loss_disc_real_2: 0.1631929725408554 (0.16544502973556519) | > loss_disc_real_3: 0.28581997752189636 (0.25692330300807953) | > loss_disc_real_4: 0.11353843659162521 (0.11944794282317162) | > loss_disc_real_5: 0.2293948233127594 (0.17614781484007835) | > loss_0: 2.4129512310028076 (2.371188998222351) | > loss_gen: 2.3632090091705322 (2.3037418127059937) | > loss_kl: 4.878899574279785 (4.64328145980835) | > loss_feat: 7.360874652862549 (5.952111482620239) | > loss_mel: 24.243467330932617 (21.908459663391113) | > loss_duration: 3.0018069744110107 (2.997207760810852) | > loss_1: 41.84825897216797 (37.80480194091797)  --> STEP: 3 | > loss_disc: 2.92956280708313 (2.557313601175944) | > loss_disc_real_0: 0.30605337023735046 (0.3049127558867137) | > loss_disc_real_1: 0.2851921319961548 (0.2277934948603312) | > loss_disc_real_2: 0.26046180725097656 (0.197117288907369) | > loss_disc_real_3: 0.1902201771736145 (0.23468892772992453) | > loss_disc_real_4: 0.19025956094264984 (0.14305181552966437) | > loss_disc_real_5: 0.24205072224140167 (0.19811545064051947) | > loss_0: 2.92956280708313 (2.557313601175944) | > loss_gen: 1.7387869358062744 (2.1154235204060874) | > loss_kl: 2.1877663135528564 (3.8247764110565186) | > loss_feat: 2.311314821243286 (4.738512595494588) | > loss_mel: 10.485640525817871 (18.10085328420003) | > loss_duration: 2.6211488246917725 (2.871854782104492) | > loss_1: 19.34465789794922 (31.65142059326172) --> EVAL PERFORMANCE | > avg_loader_time: 0.030279000600179035 (+0.014064947764078774) | > avg_loss_disc: 2.557313601175944 (+0.051118453343709014) | > avg_loss_disc_real_0: 0.3049127558867137 (+0.08523101111253104) | > avg_loss_disc_real_1: 0.2277934948603312 (-0.048824667930603055) | > avg_loss_disc_real_2: 0.197117288907369 (-0.06506899992624918) | > avg_loss_disc_real_3: 0.23468892772992453 (-0.0017995337645212717) | > avg_loss_disc_real_4: 0.14305181552966437 (-0.08861185858647028) | > avg_loss_disc_real_5: 0.19811545064051947 (+0.008852397402127593) | > avg_loss_0: 2.557313601175944 (+0.051118453343709014) | > avg_loss_gen: 2.1154235204060874 (-0.3050593535105386) | > avg_loss_kl: 3.8247764110565186 (+0.1267225742340088) | > avg_loss_feat: 4.738512595494588 (-0.1024688978989925) | > avg_loss_mel: 18.10085328420003 (+1.7993014653523751) | > avg_loss_duration: 2.871854782104492 (-0.043086687723795425) | > avg_loss_1: 31.65142059326172 (+1.4754101435343436)  > EPOCH: 577/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:07:22)   --> TIME: 2023-10-20 06:07:41 -- STEP: 19/50 -- GLOBAL_STEP: 81870 | > loss_disc: 2.910498857498169 (2.6214447084226107) | > loss_disc_real_0: 0.22286123037338257 (0.14194433018565175) | > loss_disc_real_1: 0.336995005607605 (0.25124512769674) | > loss_disc_real_2: 0.2936479151248932 (0.2212161708034967) | > loss_disc_real_3: 0.3028978109359741 (0.23189759411309896) | > loss_disc_real_4: 0.3673858046531677 (0.25468225532064315) | > loss_disc_real_5: 0.30206239223480225 (0.2491459599451015) | > loss_0: 2.910498857498169 (2.6214447084226107) | > grad_norm_0: tensor(670.1879, device='cuda:0') (tensor(657.9622, device='cuda:0')) | > loss_gen: 2.104576349258423 (2.221424178073281) | > loss_kl: 0.8068200349807739 (0.9712561964988706) | > loss_feat: 1.7621712684631348 (5.709036914925826) | > loss_mel: 22.105411529541016 (23.433974830727827) | > loss_duration: 1.5672122240066528 (1.504051729252464) | > loss_1: 28.34619140625 (33.83974404084055) | > grad_norm_1: tensor(1975.2300, device='cuda:0') (tensor(16515.3594, device='cuda:0')) | > current_lr_0: 0.00011231206608133512 | > current_lr_1: 0.00011231206608133512 | > step_time: 0.6922 (0.5053496611745733) | > loader_time: 0.0016 (0.015684817966661956)  --> TIME: 2023-10-20 06:08:00 -- STEP: 49/50 -- GLOBAL_STEP: 81900 | > loss_disc: 3.0303244590759277 (2.5583856811328802) | > loss_disc_real_0: 0.3472425937652588 (0.14562675569738656) | > loss_disc_real_1: 0.27168574929237366 (0.23453891193684268) | > loss_disc_real_2: 0.2685753405094147 (0.2262863691668121) | > loss_disc_real_3: 0.24841132760047913 (0.23560508226557653) | > loss_disc_real_4: 0.2577815651893616 (0.24121390872311835) | > loss_disc_real_5: 0.24271664023399353 (0.2439728767744133) | > loss_0: 3.0303244590759277 (2.5583856811328802) | > grad_norm_0: tensor(431.5957, device='cuda:0') (tensor(756.1086, device='cuda:0')) | > loss_gen: 1.6696233749389648 (2.220258269991193) | > loss_kl: 0.7218492031097412 (0.8506449938048513) | > loss_feat: 0.20710569620132446 (5.12271441215155) | > loss_mel: 15.855020523071289 (21.252981424331665) | > loss_duration: 1.637625813484192 (1.4735759496688843) | > loss_1: 20.091224670410156 (30.92017505606827) | > grad_norm_1: tensor(6265.6157, device='cuda:0') (tensor(15942.0010, device='cuda:0')) | > current_lr_0: 0.00011231206608133512 | > current_lr_1: 0.00011231206608133512 | > step_time: 0.5539 (0.550711865327796) | > loader_time: 0.5204 (0.0299216046625254)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4617862701416016 (3.4617862701416016) | > loss_disc_real_0: 0.2543513774871826 (0.2543513774871826) | > loss_disc_real_1: 0.3739067614078522 (0.3739067614078522) | > loss_disc_real_2: 0.2686740458011627 (0.2686740458011627) | > loss_disc_real_3: 0.3373090326786041 (0.3373090326786041) | > loss_disc_real_4: 0.5027385354042053 (0.5027385354042053) | > loss_disc_real_5: 0.2569451332092285 (0.2569451332092285) | > loss_0: 3.4617862701416016 (3.4617862701416016) | > loss_gen: 2.1307549476623535 (2.1307549476623535) | > loss_kl: 4.248396873474121 (4.248396873474121) | > loss_feat: 7.061046123504639 (7.061046123504639) | > loss_mel: 23.564979553222656 (23.564979553222656) | > loss_duration: 2.6260433197021484 (2.6260433197021484) | > loss_1: 39.63121795654297 (39.63121795654297)  --> STEP: 1 | > loss_disc: 2.5042667388916016 (2.5042667388916016) | > loss_disc_real_0: 0.08950558304786682 (0.08950558304786682) | > loss_disc_real_1: 0.2561677098274231 (0.2561677098274231) | > loss_disc_real_2: 0.21473923325538635 (0.21473923325538635) | > loss_disc_real_3: 0.26222774386405945 (0.26222774386405945) | > loss_disc_real_4: 0.21022509038448334 (0.21022509038448334) | > loss_disc_real_5: 0.12257871776819229 (0.12257871776819229) | > loss_0: 2.5042667388916016 (2.5042667388916016) | > loss_gen: 1.8046969175338745 (1.8046969175338745) | > loss_kl: 4.202083587646484 (4.202083587646484) | > loss_feat: 4.450560092926025 (4.450560092926025) | > loss_mel: 22.86058235168457 (22.86058235168457) | > loss_duration: 3.0445432662963867 (3.0445432662963867) | > loss_1: 36.362464904785156 (36.362464904785156)  --> STEP: 2 | > loss_disc: 1.8865538835525513 (2.1954103112220764) | > loss_disc_real_0: 0.3340551257133484 (0.2117803543806076) | > loss_disc_real_1: 0.15385060012340546 (0.20500915497541428) | > loss_disc_real_2: 0.11804722994565964 (0.166393231600523) | > loss_disc_real_3: 0.23940417170524597 (0.2508159577846527) | > loss_disc_real_4: 0.11624021828174591 (0.16323265433311462) | > loss_disc_real_5: 0.12725092470645905 (0.12491482123732567) | > loss_0: 1.8865538835525513 (2.1954103112220764) | > loss_gen: 3.0450870990753174 (2.424892008304596) | > loss_kl: 4.790106773376465 (4.496095180511475) | > loss_feat: 10.577345848083496 (7.513952970504761) | > loss_mel: 24.057191848754883 (23.458887100219727) | > loss_duration: 2.8960461616516113 (2.970294713973999) | > loss_1: 45.36577606201172 (40.86412048339844)  --> STEP: 3 | > loss_disc: 2.6320033073425293 (2.340941309928894) | > loss_disc_real_0: 0.24972054362297058 (0.22442708412806192) | > loss_disc_real_1: 0.25393441319465637 (0.2213175743818283) | > loss_disc_real_2: 0.23221822082996368 (0.18833489467700323) | > loss_disc_real_3: 0.21923719346523285 (0.24028970301151276) | > loss_disc_real_4: 0.2538864314556122 (0.1934505800406138) | > loss_disc_real_5: 0.1615723967552185 (0.1371340130766233) | > loss_0: 2.6320033073425293 (2.340941309928894) | > loss_gen: 1.8512036800384521 (2.233662565549215) | > loss_kl: 1.8860942125320435 (3.626094857851664) | > loss_feat: 2.1267106533050537 (5.718205531438191) | > loss_mel: 19.41376304626465 (22.110512415568035) | > loss_duration: 2.6511027812957764 (2.8638974030812583) | > loss_1: 27.92887306213379 (36.55237134297689) --> EVAL PERFORMANCE | > avg_loader_time: 0.00792241096496582 (-0.022356589635213215) | > avg_loss_disc: 2.340941309928894 (-0.21637229124704982) | > avg_loss_disc_real_0: 0.22442708412806192 (-0.08048567175865176) | > avg_loss_disc_real_1: 0.2213175743818283 (-0.0064759204785029) | > avg_loss_disc_real_2: 0.18833489467700323 (-0.008782394230365753) | > avg_loss_disc_real_3: 0.24028970301151276 (+0.005600775281588227) | > avg_loss_disc_real_4: 0.1934505800406138 (+0.050398764510949434) | > avg_loss_disc_real_5: 0.1371340130766233 (-0.06098143756389618) | > avg_loss_0: 2.340941309928894 (-0.21637229124704982) | > avg_loss_gen: 2.233662565549215 (+0.11823904514312744) | > avg_loss_kl: 3.626094857851664 (-0.19868155320485448) | > avg_loss_feat: 5.718205531438191 (+0.9796929359436035) | > avg_loss_mel: 22.110512415568035 (+4.009659131368004) | > avg_loss_duration: 2.8638974030812583 (-0.007957379023233901) | > avg_loss_1: 36.55237134297689 (+4.900950749715172)  > EPOCH: 578/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:08:14)   --> TIME: 2023-10-20 06:08:35 -- STEP: 29/50 -- GLOBAL_STEP: 81930 | > loss_disc: 1.9656537771224976 (2.362051010131836) | > loss_disc_real_0: 0.13322937488555908 (0.14657464032543116) | > loss_disc_real_1: 0.24123607575893402 (0.20108165245117812) | > loss_disc_real_2: 0.3168754279613495 (0.20739166220200472) | > loss_disc_real_3: 0.21657207608222961 (0.22073394548276376) | > loss_disc_real_4: 0.07758192718029022 (0.2233379920623426) | > loss_disc_real_5: 0.13328348100185394 (0.21975156716231642) | > loss_0: 1.9656537771224976 (2.362051010131836) | > grad_norm_0: tensor(353.3806, device='cuda:0') (tensor(568.7842, device='cuda:0')) | > loss_gen: 3.7856040000915527 (2.424678013242524) | > loss_kl: 0.7777755856513977 (0.9153800688940903) | > loss_feat: 8.33389663696289 (6.019355880289243) | > loss_mel: 25.82042121887207 (23.711116264606343) | > loss_duration: 1.4741522073745728 (1.4854274659321225) | > loss_1: 40.19184875488281 (34.555957695533486) | > grad_norm_1: tensor(28862.9395, device='cuda:0') (tensor(20112.2949, device='cuda:0')) | > current_lr_0: 0.00011219980313950045 | > current_lr_1: 0.00011219980313950045 | > step_time: 0.3421 (0.547693630744671) | > loader_time: 0.0047 (0.020206040349499934)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6619529724121094 (2.6619529724121094) | > loss_disc_real_0: 0.40400880575180054 (0.40400880575180054) | > loss_disc_real_1: 0.32401853799819946 (0.32401853799819946) | > loss_disc_real_2: 0.3165862262248993 (0.3165862262248993) | > loss_disc_real_3: 0.3458312153816223 (0.3458312153816223) | > loss_disc_real_4: 0.3154579997062683 (0.3154579997062683) | > loss_disc_real_5: 0.3443639576435089 (0.3443639576435089) | > loss_0: 2.6619529724121094 (2.6619529724121094) | > loss_gen: 3.390599250793457 (3.390599250793457) | > loss_kl: 3.708815813064575 (3.708815813064575) | > loss_feat: 6.483975887298584 (6.483975887298584) | > loss_mel: 24.740264892578125 (24.740264892578125) | > loss_duration: 2.604095458984375 (2.604095458984375) | > loss_1: 40.92774963378906 (40.92774963378906)  --> STEP: 1 | > loss_disc: 3.2007899284362793 (3.2007899284362793) | > loss_disc_real_0: 0.23357991874217987 (0.23357991874217987) | > loss_disc_real_1: 0.32300785183906555 (0.32300785183906555) | > loss_disc_real_2: 0.3972989320755005 (0.3972989320755005) | > loss_disc_real_3: 0.3004676103591919 (0.3004676103591919) | > loss_disc_real_4: 0.32808077335357666 (0.32808077335357666) | > loss_disc_real_5: 0.31589221954345703 (0.31589221954345703) | > loss_0: 3.2007899284362793 (3.2007899284362793) | > loss_gen: 1.9733161926269531 (1.9733161926269531) | > loss_kl: 3.9245059490203857 (3.9245059490203857) | > loss_feat: 4.9898681640625 (4.9898681640625) | > loss_mel: 25.033353805541992 (25.033353805541992) | > loss_duration: 3.0258493423461914 (3.0258493423461914) | > loss_1: 38.94689178466797 (38.94689178466797)  --> STEP: 2 | > loss_disc: 3.0160603523254395 (3.1084251403808594) | > loss_disc_real_0: 0.21434541046619415 (0.223962664604187) | > loss_disc_real_1: 0.2869619131088257 (0.3049848824739456) | > loss_disc_real_2: 0.2534206807613373 (0.3253598064184189) | > loss_disc_real_3: 0.21705184876918793 (0.2587597295641899) | > loss_disc_real_4: 0.2946053147315979 (0.3113430440425873) | > loss_disc_real_5: 0.24124623835086823 (0.27856922894716263) | > loss_0: 3.0160603523254395 (3.1084251403808594) | > loss_gen: 1.5033433437347412 (1.7383297681808472) | > loss_kl: 4.601996421813965 (4.263251185417175) | > loss_feat: 0.026073990389704704 (2.5079710772261024) | > loss_mel: 1.484012484550476 (13.258683145046234) | > loss_duration: 2.8326635360717773 (2.9292564392089844) | > loss_1: 10.448089599609375 (24.697490692138672)  --> STEP: 3 | > loss_disc: 2.99172306060791 (3.0695244471232095) | > loss_disc_real_0: 0.210323303937912 (0.219416211048762) | > loss_disc_real_1: 0.2746041715145111 (0.2948579788208008) | > loss_disc_real_2: 0.2540694773197174 (0.3015963633855184) | > loss_disc_real_3: 0.22581544518470764 (0.24777830143769583) | > loss_disc_real_4: 0.31480929255485535 (0.3124984602133433) | > loss_disc_real_5: 0.2564094066619873 (0.27118262151877087) | > loss_0: 2.99172306060791 (3.0695244471232095) | > loss_gen: 1.5669578313827515 (1.6812057892481487) | > loss_kl: 1.8823387622833252 (3.469613711039225) | > loss_feat: 0.2496723234653473 (1.7552048259725173) | > loss_mel: 9.120990753173828 (11.879452347755432) | > loss_duration: 2.62255859375 (2.8270238240559897) | > loss_1: 15.44251823425293 (21.612499872843426) --> EVAL PERFORMANCE | > avg_loader_time: 0.01578211784362793 (+0.00785970687866211) | > avg_loss_disc: 3.0695244471232095 (+0.7285831371943154) | > avg_loss_disc_real_0: 0.219416211048762 (-0.005010873079299927) | > avg_loss_disc_real_1: 0.2948579788208008 (+0.07354040443897247) | > avg_loss_disc_real_2: 0.3015963633855184 (+0.11326146870851514) | > avg_loss_disc_real_3: 0.24777830143769583 (+0.007488598426183074) | > avg_loss_disc_real_4: 0.3124984602133433 (+0.11904788017272952) | > avg_loss_disc_real_5: 0.27118262151877087 (+0.13404860844214758) | > avg_loss_0: 3.0695244471232095 (+0.7285831371943154) | > avg_loss_gen: 1.6812057892481487 (-0.5524567763010662) | > avg_loss_kl: 3.469613711039225 (-0.15648114681243896) | > avg_loss_feat: 1.7552048259725173 (-3.9630007054656744) | > avg_loss_mel: 11.879452347755432 (-10.231060067812603) | > avg_loss_duration: 2.8270238240559897 (-0.036873579025268555) | > avg_loss_1: 21.612499872843426 (-14.939871470133465)  > EPOCH: 579/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:09:06)   --> TIME: 2023-10-20 06:09:20 -- STEP: 9/50 -- GLOBAL_STEP: 81960 | > loss_disc: 3.255235433578491 (2.7172798580593533) | > loss_disc_real_0: 0.3483121991157532 (0.17640601926379734) | > loss_disc_real_1: 0.3400374948978424 (0.24422340177827412) | > loss_disc_real_2: 0.4486873745918274 (0.29664597908655804) | > loss_disc_real_3: 0.4680531919002533 (0.25673337860239875) | > loss_disc_real_4: 0.35473424196243286 (0.32227807409233517) | > loss_disc_real_5: 0.41215837001800537 (0.26662849966022706) | > loss_0: 3.255235433578491 (2.7172798580593533) | > grad_norm_0: tensor(497.0024, device='cuda:0') (tensor(608.8918, device='cuda:0')) | > loss_gen: 2.417764186859131 (2.314936399459839) | > loss_kl: 0.5909087061882019 (0.6759071018960741) | > loss_feat: 3.216299057006836 (3.829054332441754) | > loss_mel: 25.77249526977539 (20.291430791219074) | > loss_duration: 1.415493369102478 (1.4697115421295166) | > loss_1: 33.412960052490234 (28.581040382385254) | > grad_norm_1: tensor(2474.3738, device='cuda:0') (tensor(12134.5596, device='cuda:0')) | > current_lr_0: 0.00011208765241150484 | > current_lr_1: 0.00011208765241150484 | > step_time: 0.6153 (0.6408838166130914) | > loader_time: 0.0139 (0.025716198815239802)  --> TIME: 2023-10-20 06:09:39 -- STEP: 39/50 -- GLOBAL_STEP: 81990 | > loss_disc: 3.033384323120117 (2.484775048035842) | > loss_disc_real_0: 0.3086089491844177 (0.15000769639244446) | > loss_disc_real_1: 0.20422376692295074 (0.235454628100762) | > loss_disc_real_2: 0.32422950863838196 (0.2502902652590703) | > loss_disc_real_3: 0.24596905708312988 (0.2395274170125142) | > loss_disc_real_4: 0.22783270478248596 (0.24912985567099008) | > loss_disc_real_5: 0.2503287196159363 (0.23873612351524523) | > loss_0: 3.033384323120117 (2.484775048035842) | > grad_norm_0: tensor(609.7861, device='cuda:0') (tensor(700.6927, device='cuda:0')) | > loss_gen: 1.4527970552444458 (2.3514186174441605) | > loss_kl: 0.734649121761322 (0.8706963841731732) | > loss_feat: 0.024423878639936447 (4.750983556971336) | > loss_mel: 1.0612131357192993 (20.774622302788956) | > loss_duration: 1.5224403142929077 (1.474216424501859) | > loss_1: 4.795523643493652 (30.221937473003692) | > grad_norm_1: tensor(101781.7812, device='cuda:0') (tensor(21350.8105, device='cuda:0')) | > current_lr_0: 0.00011208765241150484 | > current_lr_1: 0.00011208765241150484 | > step_time: 0.6281 (0.6186980956639999) | > loader_time: 0.0419 (0.024959252430842477)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.840975761413574 (2.840975761413574) | > loss_disc_real_0: 0.16699624061584473 (0.16699624061584473) | > loss_disc_real_1: 0.2865135371685028 (0.2865135371685028) | > loss_disc_real_2: 0.2166202813386917 (0.2166202813386917) | > loss_disc_real_3: 0.2430860698223114 (0.2430860698223114) | > loss_disc_real_4: 0.22801309823989868 (0.22801309823989868) | > loss_disc_real_5: 0.21217390894889832 (0.21217390894889832) | > loss_0: 2.840975761413574 (2.840975761413574) | > loss_gen: 1.6088080406188965 (1.6088080406188965) | > loss_kl: 4.197690963745117 (4.197690963745117) | > loss_feat: 1.5758661031723022 (1.5758661031723022) | > loss_mel: 19.354219436645508 (19.354219436645508) | > loss_duration: 2.6970183849334717 (2.6970183849334717) | > loss_1: 29.433603286743164 (29.433603286743164)  --> STEP: 1 | > loss_disc: 2.7913975715637207 (2.7913975715637207) | > loss_disc_real_0: 0.24830321967601776 (0.24830321967601776) | > loss_disc_real_1: 0.2455277293920517 (0.2455277293920517) | > loss_disc_real_2: 0.25211137533187866 (0.25211137533187866) | > loss_disc_real_3: 0.1452447921037674 (0.1452447921037674) | > loss_disc_real_4: 0.3274356424808502 (0.3274356424808502) | > loss_disc_real_5: 0.3728712499141693 (0.3728712499141693) | > loss_0: 2.7913975715637207 (2.7913975715637207) | > loss_gen: 2.312878131866455 (2.312878131866455) | > loss_kl: 4.4188151359558105 (4.4188151359558105) | > loss_feat: 7.244621753692627 (7.244621753692627) | > loss_mel: 24.277421951293945 (24.277421951293945) | > loss_duration: 3.0849404335021973 (3.0849404335021973) | > loss_1: 41.33867645263672 (41.33867645263672)  --> STEP: 2 | > loss_disc: 1.555912733078003 (2.173655152320862) | > loss_disc_real_0: 0.3482339084148407 (0.29826856404542923) | > loss_disc_real_1: 0.13164691627025604 (0.18858732283115387) | > loss_disc_real_2: 0.15183913707733154 (0.2019752562046051) | > loss_disc_real_3: 0.1513465940952301 (0.14829569309949875) | > loss_disc_real_4: 0.03526057302951813 (0.18134810775518417) | > loss_disc_real_5: 0.03132728859782219 (0.20209926925599575) | > loss_0: 1.555912733078003 (2.173655152320862) | > loss_gen: 3.064150094985962 (2.6885141134262085) | > loss_kl: 4.5634894371032715 (4.491152286529541) | > loss_feat: 10.404637336730957 (8.824629545211792) | > loss_mel: 24.228858947753906 (24.253140449523926) | > loss_duration: 2.9118385314941406 (2.998389482498169) | > loss_1: 45.1729736328125 (43.25582504272461)  --> STEP: 3 | > loss_disc: 2.705561876296997 (2.3509573936462402) | > loss_disc_real_0: 0.1468961238861084 (0.2478110839923223) | > loss_disc_real_1: 0.36885198950767517 (0.24867554505666098) | > loss_disc_real_2: 0.4368537664413452 (0.2802680929501851) | > loss_disc_real_3: 0.2951751947402954 (0.1972555269797643) | > loss_disc_real_4: 0.28391504287719727 (0.21553708612918854) | > loss_disc_real_5: 0.2709836959838867 (0.2250607448319594) | > loss_0: 2.705561876296997 (2.3509573936462402) | > loss_gen: 2.711394786834717 (2.696141004562378) | > loss_kl: 2.1123206615448 (3.6982084115346274) | > loss_feat: 5.202996253967285 (7.61741844813029) | > loss_mel: 24.13375473022461 (24.213345209757488) | > loss_duration: 2.718745231628418 (2.905174732208252) | > loss_1: 36.87921142578125 (41.130287170410156) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_82000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.056318759918213 (2.5272977352142334) | > loss_disc_real_0: 0.18241018056869507 (0.23146085813641548) | > loss_disc_real_1: 0.2730899751186371 (0.254779152572155) | > loss_disc_real_2: 0.24055348336696625 (0.2703394405543804) | > loss_disc_real_3: 0.22523953020572662 (0.20425152778625488) | > loss_disc_real_4: 0.2352302074432373 (0.22046036645770073) | > loss_disc_real_5: 0.238387331366539 (0.2283923914656043) | > loss_0: 3.056318759918213 (2.5272977352142334) | > loss_gen: 1.3685228824615479 (2.3642364740371704) | > loss_kl: 4.319062232971191 (3.8534218668937683) | > loss_feat: 0.23684090375900269 (5.772274062037468) | > loss_mel: 2.147550344467163 (18.696896493434906) | > loss_duration: 2.6166131496429443 (2.833034336566925) | > loss_1: 10.688589096069336 (33.51986265182495)  --> STEP: 1 | > loss_disc: 2.8526663780212402 (2.5923714637756348) | > loss_disc_real_0: 0.42355877161026 (0.2698804408311844) | > loss_disc_real_1: 0.1943616420030594 (0.24269565045833588) | > loss_disc_real_2: 0.2943875789642334 (0.275149068236351) | > loss_disc_real_3: 0.4034964442253113 (0.24410051107406616) | > loss_disc_real_4: 0.20247313380241394 (0.21686291992664336) | > loss_disc_real_5: 0.40761613845825195 (0.26423714086413386) | > loss_0: 2.8526663780212402 (2.5923714637756348) | > loss_gen: 2.4792962074279785 (2.387248420715332) | > loss_kl: 4.844504356384277 (4.05163836479187) | > loss_feat: 5.202330589294434 (5.658285367488861) | > loss_mel: 25.353069305419922 (20.02813105583191) | > loss_duration: 3.054719924926758 (2.8773714542388915) | > loss_1: 40.933921813964844 (35.00267448425293)  --> STEP: 2 | > loss_disc: 3.0553221702575684 (2.669529914855957) | > loss_disc_real_0: 0.18297132849693298 (0.2553955887754758) | > loss_disc_real_1: 0.2731053829193115 (0.24776393920183182) | > loss_disc_real_2: 0.24034370481967926 (0.2693481743335724) | > loss_disc_real_3: 0.22536973655223846 (0.24097871532042822) | > loss_disc_real_4: 0.23517471551895142 (0.2199148858586947) | > loss_disc_real_5: 0.23839150369167328 (0.25992953466872376) | > loss_0: 3.0553221702575684 (2.669529914855957) | > loss_gen: 1.3695770502090454 (2.217636525630951) | > loss_kl: 4.639285564422607 (4.149579564730327) | > loss_feat: 0.23589718341827393 (4.754554003477097) | > loss_mel: 3.6144840717315674 (17.292523225148518) | > loss_duration: 2.800931215286255 (2.864631414413452) | > loss_1: 12.660175323486328 (31.278924624125164)  --> STEP: 3 | > loss_disc: 3.086189031600952 (2.729052645819528) | > loss_disc_real_0: 0.12980835139751434 (0.23745455486433847) | > loss_disc_real_1: 0.32671278715133667 (0.2590423460517611) | > loss_disc_real_2: 0.42129260301589966 (0.2910545212881906) | > loss_disc_real_3: 0.30836549401283264 (0.2506053979907717) | > loss_disc_real_4: 0.3386499583721161 (0.23687703907489777) | > loss_disc_real_5: 0.40418532490730286 (0.2805375047028065) | > loss_0: 3.086189031600952 (2.729052645819528) | > loss_gen: 1.9824905395507812 (2.1840442419052124) | > loss_kl: 2.186821699142456 (3.869185583932059) | > loss_feat: 2.8431453704833984 (4.48149562733514) | > loss_mel: 19.56259536743164 (17.61681924547468) | > loss_duration: 2.6979455947875977 (2.8408191544669017) | > loss_1: 29.272998809814453 (30.992363793509348) --> EVAL PERFORMANCE | > avg_loader_time: 0.46127166066850933 (+0.4454895428248814) | > avg_loss_disc: 2.729052645819528 (-0.3404718013036816) | > avg_loss_disc_real_0: 0.23745455486433847 (+0.01803834381557648) | > avg_loss_disc_real_1: 0.2590423460517611 (-0.03581563276903971) | > avg_loss_disc_real_2: 0.2910545212881906 (-0.01054184209732778) | > avg_loss_disc_real_3: 0.2506053979907717 (+0.002827096553075864) | > avg_loss_disc_real_4: 0.23687703907489777 (-0.07562142113844555) | > avg_loss_disc_real_5: 0.2805375047028065 (+0.0093548831840356) | > avg_loss_0: 2.729052645819528 (-0.3404718013036816) | > avg_loss_gen: 2.1840442419052124 (+0.5028384526570637) | > avg_loss_kl: 3.869185583932059 (+0.3995718728928339) | > avg_loss_feat: 4.48149562733514 (+2.726290801362623) | > avg_loss_mel: 17.61681924547468 (+5.737366897719248) | > avg_loss_duration: 2.8408191544669017 (+0.013795330410911966) | > avg_loss_1: 30.992363793509348 (+9.379863920665922)  > EPOCH: 580/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:10:10)   --> TIME: 2023-10-20 06:10:25 -- STEP: 19/50 -- GLOBAL_STEP: 82020 | > loss_disc: 2.296264886856079 (2.5134956962183903) | > loss_disc_real_0: 0.010301047004759312 (0.15624050330370665) | > loss_disc_real_1: 0.24597737193107605 (0.23434578352852872) | > loss_disc_real_2: 0.20052923262119293 (0.2389676176795834) | > loss_disc_real_3: 0.17557582259178162 (0.23887279492459798) | > loss_disc_real_4: 0.08376166969537735 (0.23990864777251295) | > loss_disc_real_5: 0.04871679097414017 (0.2415898524616894) | > loss_0: 2.296264886856079 (2.5134956962183903) | > grad_norm_0: tensor(1316.5822, device='cuda:0') (tensor(870.4315, device='cuda:0')) | > loss_gen: 1.9665675163269043 (2.370922690943668) | > loss_kl: 0.9103818535804749 (0.8350841450063806) | > loss_feat: 6.614409446716309 (5.13407082149857) | > loss_mel: 24.13555145263672 (22.180859001059282) | > loss_duration: 1.6043572425842285 (1.4746005284158807) | > loss_1: 35.23126983642578 (31.995537356326455) | > grad_norm_1: tensor(4442.9888, device='cuda:0') (tensor(21478.9570, device='cuda:0')) | > current_lr_0: 0.00011197561378518356 | > current_lr_1: 0.00011197561378518356 | > step_time: 0.4675 (0.5436101587195146) | > loader_time: 0.0017 (0.0207344230852629)  --> TIME: 2023-10-20 06:10:40 -- STEP: 49/50 -- GLOBAL_STEP: 82050 | > loss_disc: 2.37251353263855 (2.554832319824063) | > loss_disc_real_0: 0.11652244627475739 (0.17262296886088288) | > loss_disc_real_1: 0.2185421586036682 (0.2359023212778325) | > loss_disc_real_2: 0.2765774428844452 (0.23635288806898253) | > loss_disc_real_3: 0.22590933740139008 (0.24243975483945437) | > loss_disc_real_4: 0.2669326066970825 (0.23499738702512518) | > loss_disc_real_5: 0.4200727641582489 (0.24222682454452224) | > loss_0: 2.37251353263855 (2.554832319824063) | > grad_norm_0: tensor(825.8540, device='cuda:0') (tensor(716.4164, device='cuda:0')) | > loss_gen: 2.8222203254699707 (2.294759988784791) | > loss_kl: 0.733761727809906 (0.864677114754307) | > loss_feat: 5.994570255279541 (4.9949371007328125) | > loss_mel: 22.659191131591797 (21.009935432550858) | > loss_duration: 1.5981090068817139 (1.451669235618747) | > loss_1: 33.80785369873047 (30.615978922162736) | > grad_norm_1: tensor(33483.3438, device='cuda:0') (tensor(18271.3867, device='cuda:0')) | > current_lr_0: 0.00011197561378518356 | > current_lr_1: 0.00011197561378518356 | > step_time: 0.8137 (0.4975280372463927) | > loader_time: 0.6434 (0.02784574761682627)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.741109848022461 (2.741109848022461) | > loss_disc_real_0: 0.13778147101402283 (0.13778147101402283) | > loss_disc_real_1: 0.3015995919704437 (0.3015995919704437) | > loss_disc_real_2: 0.23476377129554749 (0.23476377129554749) | > loss_disc_real_3: 0.29699188470840454 (0.29699188470840454) | > loss_disc_real_4: 0.2877929210662842 (0.2877929210662842) | > loss_disc_real_5: 0.34520646929740906 (0.34520646929740906) | > loss_0: 2.741109848022461 (2.741109848022461) | > loss_gen: 2.117154598236084 (2.117154598236084) | > loss_kl: 3.823669910430908 (3.823669910430908) | > loss_feat: 2.6310620307922363 (2.6310620307922363) | > loss_mel: 22.856731414794922 (22.856731414794922) | > loss_duration: 2.5767436027526855 (2.5767436027526855) | > loss_1: 34.0053596496582 (34.0053596496582)  --> STEP: 1 | > loss_disc: 2.6116902828216553 (2.6116902828216553) | > loss_disc_real_0: 0.05084037780761719 (0.05084037780761719) | > loss_disc_real_1: 0.18961091339588165 (0.18961091339588165) | > loss_disc_real_2: 0.22398711740970612 (0.22398711740970612) | > loss_disc_real_3: 0.20444227755069733 (0.20444227755069733) | > loss_disc_real_4: 0.2213391661643982 (0.2213391661643982) | > loss_disc_real_5: 0.1353554129600525 (0.1353554129600525) | > loss_0: 2.6116902828216553 (2.6116902828216553) | > loss_gen: 1.6213535070419312 (1.6213535070419312) | > loss_kl: 4.31778621673584 (4.31778621673584) | > loss_feat: 8.810179710388184 (8.810179710388184) | > loss_mel: 25.350051879882812 (25.350051879882812) | > loss_duration: 3.0159084796905518 (3.0159084796905518) | > loss_1: 43.11528015136719 (43.11528015136719)  --> STEP: 2 | > loss_disc: 2.0495407581329346 (2.330615520477295) | > loss_disc_real_0: 0.0650632381439209 (0.05795180797576904) | > loss_disc_real_1: 0.2660563588142395 (0.22783363610506058) | > loss_disc_real_2: 0.22764796018600464 (0.22581753879785538) | > loss_disc_real_3: 0.37249845266342163 (0.2884703651070595) | > loss_disc_real_4: 0.165672168135643 (0.1935056671500206) | > loss_disc_real_5: 0.18088920414447784 (0.15812230855226517) | > loss_0: 2.0495407581329346 (2.330615520477295) | > loss_gen: 3.4979965686798096 (2.5596750378608704) | > loss_kl: 4.8374152183532715 (4.577600717544556) | > loss_feat: 10.218690872192383 (9.514435291290283) | > loss_mel: 23.699674606323242 (24.524863243103027) | > loss_duration: 2.8929951190948486 (2.9544517993927) | > loss_1: 45.14677429199219 (44.13102722167969)  --> STEP: 3 | > loss_disc: 1.7779039144515991 (2.1463783184687295) | > loss_disc_real_0: 0.1411270648241043 (0.0856768935918808) | > loss_disc_real_1: 0.18617980182170868 (0.2139490246772766) | > loss_disc_real_2: 0.14344775676727295 (0.19836094478766123) | > loss_disc_real_3: 0.12425976246595383 (0.23373349756002426) | > loss_disc_real_4: 0.1466057151556015 (0.17787234981854758) | > loss_disc_real_5: 0.17215724289417267 (0.16280061999956766) | > loss_0: 1.7779039144515991 (2.1463783184687295) | > loss_gen: 2.598473072052002 (2.572607715924581) | > loss_kl: 1.9056860208511353 (3.6869624853134155) | > loss_feat: 7.0919060707092285 (8.706925551096598) | > loss_mel: 23.042078018188477 (24.030601501464844) | > loss_duration: 2.715700626373291 (2.874868075052897) | > loss_1: 37.353843688964844 (41.87196604410807) --> EVAL PERFORMANCE | > avg_loader_time: 0.031653245290120445 (-0.4296184153783889) | > avg_loss_disc: 2.1463783184687295 (-0.5826743273507984) | > avg_loss_disc_real_0: 0.0856768935918808 (-0.15177766127245768) | > avg_loss_disc_real_1: 0.2139490246772766 (-0.04509332137448446) | > avg_loss_disc_real_2: 0.19836094478766123 (-0.09269357650052937) | > avg_loss_disc_real_3: 0.23373349756002426 (-0.016871900430747433) | > avg_loss_disc_real_4: 0.17787234981854758 (-0.05900468925635019) | > avg_loss_disc_real_5: 0.16280061999956766 (-0.11773688470323881) | > avg_loss_0: 2.1463783184687295 (-0.5826743273507984) | > avg_loss_gen: 2.572607715924581 (+0.38856347401936864) | > avg_loss_kl: 3.6869624853134155 (-0.1822230986186435) | > avg_loss_feat: 8.706925551096598 (+4.225429923761458) | > avg_loss_mel: 24.030601501464844 (+6.413782255990164) | > avg_loss_duration: 2.874868075052897 (+0.03404892058599529) | > avg_loss_1: 41.87196604410807 (+10.879602250598722)  > EPOCH: 581/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:10:57)   --> TIME: 2023-10-20 06:11:20 -- STEP: 29/50 -- GLOBAL_STEP: 82080 | > loss_disc: 1.194141149520874 (2.411800639382724) | > loss_disc_real_0: 0.049840621650218964 (0.14309940923904552) | > loss_disc_real_1: 0.06717035919427872 (0.21854702614504715) | > loss_disc_real_2: 0.09802626073360443 (0.22125434477267594) | > loss_disc_real_3: 0.12362386286258698 (0.23351193643335638) | > loss_disc_real_4: 0.05629148334264755 (0.21036744307212787) | > loss_disc_real_5: 0.029886610805988312 (0.23511407293122394) | > loss_0: 1.194141149520874 (2.411800639382724) | > grad_norm_0: tensor(299.2682, device='cuda:0') (tensor(704.8364, device='cuda:0')) | > loss_gen: 3.0290415287017822 (2.3518050580189147) | > loss_kl: 0.8883932828903198 (0.8395212575279433) | > loss_feat: 9.431374549865723 (5.606643436797734) | > loss_mel: 26.213985443115234 (22.122637091011832) | > loss_duration: 1.5056157112121582 (1.4713110307167316) | > loss_1: 41.06840896606445 (32.39191745889598) | > grad_norm_1: tensor(22806.8066, device='cuda:0') (tensor(20605.5352, device='cuda:0')) | > current_lr_0: 0.00011186368714848397 | > current_lr_1: 0.00011186368714848397 | > step_time: 0.571 (0.592576289999074) | > loader_time: 0.0328 (0.026424111991093076)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.175664186477661 (2.175664186477661) | > loss_disc_real_0: 0.07476100325584412 (0.07476100325584412) | > loss_disc_real_1: 0.3565090596675873 (0.3565090596675873) | > loss_disc_real_2: 0.2455190122127533 (0.2455190122127533) | > loss_disc_real_3: 0.22395846247673035 (0.22395846247673035) | > loss_disc_real_4: 0.20292119681835175 (0.20292119681835175) | > loss_disc_real_5: 0.19416117668151855 (0.19416117668151855) | > loss_0: 2.175664186477661 (2.175664186477661) | > loss_gen: 2.463123083114624 (2.463123083114624) | > loss_kl: 4.073340892791748 (4.073340892791748) | > loss_feat: 5.698445796966553 (5.698445796966553) | > loss_mel: 24.335369110107422 (24.335369110107422) | > loss_duration: 2.7049636840820312 (2.7049636840820312) | > loss_1: 39.27524185180664 (39.27524185180664)  --> STEP: 1 | > loss_disc: 2.663513422012329 (2.663513422012329) | > loss_disc_real_0: 0.04960612580180168 (0.04960612580180168) | > loss_disc_real_1: 0.3548552691936493 (0.3548552691936493) | > loss_disc_real_2: 0.3350827991962433 (0.3350827991962433) | > loss_disc_real_3: 0.3748561441898346 (0.3748561441898346) | > loss_disc_real_4: 0.41275039315223694 (0.41275039315223694) | > loss_disc_real_5: 0.3478011190891266 (0.3478011190891266) | > loss_0: 2.663513422012329 (2.663513422012329) | > loss_gen: 2.7152700424194336 (2.7152700424194336) | > loss_kl: 4.554752826690674 (4.554752826690674) | > loss_feat: 4.510302543640137 (4.510302543640137) | > loss_mel: 24.89931869506836 (24.89931869506836) | > loss_duration: 2.942410469055176 (2.942410469055176) | > loss_1: 39.62205505371094 (39.62205505371094)  --> STEP: 2 | > loss_disc: 2.644648551940918 (2.6540809869766235) | > loss_disc_real_0: 0.10013234615325928 (0.07486923597753048) | > loss_disc_real_1: 0.3101290762424469 (0.3324921727180481) | > loss_disc_real_2: 0.20295631885528564 (0.26901955902576447) | > loss_disc_real_3: 0.3376079201698303 (0.35623203217983246) | > loss_disc_real_4: 0.2877348065376282 (0.35024259984493256) | > loss_disc_real_5: 0.397532194852829 (0.3726666569709778) | > loss_0: 2.644648551940918 (2.6540809869766235) | > loss_gen: 2.9967527389526367 (2.856011390686035) | > loss_kl: 4.465453624725342 (4.510103225708008) | > loss_feat: 6.953342437744141 (5.731822490692139) | > loss_mel: 24.039945602416992 (24.469632148742676) | > loss_duration: 2.879413366317749 (2.9109119176864624) | > loss_1: 41.33490753173828 (40.47848129272461)  --> STEP: 3 | > loss_disc: 2.2138233184814453 (2.507328430811564) | > loss_disc_real_0: 0.1339428573846817 (0.09456044311324756) | > loss_disc_real_1: 0.26637333631515503 (0.3104525605837504) | > loss_disc_real_2: 0.2934878468513489 (0.2771756549676259) | > loss_disc_real_3: 0.32229378819465637 (0.34491928418477374) | > loss_disc_real_4: 0.1647229939699173 (0.2884027312199275) | > loss_disc_real_5: 0.12421534955501556 (0.28984955449899036) | > loss_0: 2.2138233184814453 (2.507328430811564) | > loss_gen: 2.400728225708008 (2.7042503356933594) | > loss_kl: 1.8733807802200317 (3.6311957438786826) | > loss_feat: 4.141711711883545 (5.201785564422607) | > loss_mel: 21.820783615112305 (23.58668263753255) | > loss_duration: 2.7080538272857666 (2.843292554219564) | > loss_1: 32.94466018676758 (37.96720759073893) --> EVAL PERFORMANCE | > avg_loader_time: 0.006485462188720703 (-0.025167783101399742) | > avg_loss_disc: 2.507328430811564 (+0.3609501123428345) | > avg_loss_disc_real_0: 0.09456044311324756 (+0.00888354952136676) | > avg_loss_disc_real_1: 0.3104525605837504 (+0.09650353590647381) | > avg_loss_disc_real_2: 0.2771756549676259 (+0.07881471017996469) | > avg_loss_disc_real_3: 0.34491928418477374 (+0.11118578662474948) | > avg_loss_disc_real_4: 0.2884027312199275 (+0.11053038140137991) | > avg_loss_disc_real_5: 0.28984955449899036 (+0.1270489344994227) | > avg_loss_0: 2.507328430811564 (+0.3609501123428345) | > avg_loss_gen: 2.7042503356933594 (+0.13164261976877834) | > avg_loss_kl: 3.6311957438786826 (-0.055766741434732925) | > avg_loss_feat: 5.201785564422607 (-3.5051399866739903) | > avg_loss_mel: 23.58668263753255 (-0.44391886393229285) | > avg_loss_duration: 2.843292554219564 (-0.03157552083333304) | > avg_loss_1: 37.96720759073893 (-3.9047584533691406)  > EPOCH: 582/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:11:49)   --> TIME: 2023-10-20 06:12:00 -- STEP: 9/50 -- GLOBAL_STEP: 82110 | > loss_disc: 2.9160163402557373 (2.399249169561598) | > loss_disc_real_0: 0.35029059648513794 (0.134965680539608) | > loss_disc_real_1: 0.2624489665031433 (0.23160310089588165) | > loss_disc_real_2: 0.24330098927021027 (0.22020814940333366) | > loss_disc_real_3: 0.28335610032081604 (0.25762659973568386) | > loss_disc_real_4: 0.27099668979644775 (0.2505395921568076) | > loss_disc_real_5: 0.27436524629592896 (0.2836320974553625) | > loss_0: 2.9160163402557373 (2.399249169561598) | > grad_norm_0: tensor(540.4641, device='cuda:0') (tensor(440.7741, device='cuda:0')) | > loss_gen: 1.771101474761963 (2.5216582351260715) | > loss_kl: 0.8326506614685059 (0.7321511805057526) | > loss_feat: 0.3455721437931061 (5.726141336891386) | > loss_mel: 10.654609680175781 (20.27742820315891) | > loss_duration: 1.4578046798706055 (1.4536004463831584) | > loss_1: 15.061738014221191 (30.710979355706108) | > grad_norm_1: tensor(15126.7744, device='cuda:0') (tensor(28752.7461, device='cuda:0')) | > current_lr_0: 0.00011175187238946539 | > current_lr_1: 0.00011175187238946539 | > step_time: 0.4912 (0.6377003987630209) | > loader_time: 0.002 (0.017358647452460393)  --> TIME: 2023-10-20 06:12:19 -- STEP: 39/50 -- GLOBAL_STEP: 82140 | > loss_disc: 2.940446615219116 (2.4527646853373595) | > loss_disc_real_0: 0.18305954337120056 (0.14305084088865) | > loss_disc_real_1: 0.2116456776857376 (0.23229755117343023) | > loss_disc_real_2: 0.27919623255729675 (0.24128534606634042) | > loss_disc_real_3: 0.2504981756210327 (0.25660843478563505) | > loss_disc_real_4: 0.27843964099884033 (0.22459585023805118) | > loss_disc_real_5: 0.25691306591033936 (0.23519924280639642) | > loss_0: 2.940446615219116 (2.4527646853373595) | > grad_norm_0: tensor(232.3521, device='cuda:0') (tensor(508.5251, device='cuda:0')) | > loss_gen: 1.5564755201339722 (2.348657757808001) | > loss_kl: 0.46750378608703613 (0.8094448538926932) | > loss_feat: 0.17485983669757843 (4.932484290920771) | > loss_mel: 8.534948348999023 (19.892081541892814) | > loss_duration: 1.5351576805114746 (1.4575069286884406) | > loss_1: 12.268945693969727 (29.440175521068085) | > grad_norm_1: tensor(44403.8281, device='cuda:0') (tensor(21898.8281, device='cuda:0')) | > current_lr_0: 0.00011175187238946539 | > current_lr_1: 0.00011175187238946539 | > step_time: 0.5902 (0.609563668568929) | > loader_time: 0.0411 (0.020087248239761744)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.741936445236206 (2.741936445236206) | > loss_disc_real_0: 0.4316200613975525 (0.4316200613975525) | > loss_disc_real_1: 0.24466130137443542 (0.24466130137443542) | > loss_disc_real_2: 0.288028359413147 (0.288028359413147) | > loss_disc_real_3: 0.23179085552692413 (0.23179085552692413) | > loss_disc_real_4: 0.37746569514274597 (0.37746569514274597) | > loss_disc_real_5: 0.408054918050766 (0.408054918050766) | > loss_0: 2.741936445236206 (2.741936445236206) | > loss_gen: 3.1469764709472656 (3.1469764709472656) | > loss_kl: 4.285029888153076 (4.285029888153076) | > loss_feat: 4.650060653686523 (4.650060653686523) | > loss_mel: 23.78911018371582 (23.78911018371582) | > loss_duration: 2.5778214931488037 (2.5778214931488037) | > loss_1: 38.448997497558594 (38.448997497558594)  --> STEP: 1 | > loss_disc: 2.813291311264038 (2.813291311264038) | > loss_disc_real_0: 0.4011844992637634 (0.4011844992637634) | > loss_disc_real_1: 0.30691826343536377 (0.30691826343536377) | > loss_disc_real_2: 0.3620235323905945 (0.3620235323905945) | > loss_disc_real_3: 0.32214051485061646 (0.32214051485061646) | > loss_disc_real_4: 0.2400549054145813 (0.2400549054145813) | > loss_disc_real_5: 0.22197261452674866 (0.22197261452674866) | > loss_0: 2.813291311264038 (2.813291311264038) | > loss_gen: 2.4032020568847656 (2.4032020568847656) | > loss_kl: 4.552107334136963 (4.552107334136963) | > loss_feat: 2.3890554904937744 (2.3890554904937744) | > loss_mel: 22.129756927490234 (22.129756927490234) | > loss_duration: 2.974494218826294 (2.974494218826294) | > loss_1: 34.44861602783203 (34.44861602783203)  --> STEP: 2 | > loss_disc: 3.0926995277404785 (2.9529954195022583) | > loss_disc_real_0: 0.5085534453392029 (0.45486897230148315) | > loss_disc_real_1: 0.2778010070323944 (0.2923596352338791) | > loss_disc_real_2: 0.28419041633605957 (0.323106974363327) | > loss_disc_real_3: 0.2677106261253357 (0.2949255704879761) | > loss_disc_real_4: 0.3011713922023773 (0.2706131488084793) | > loss_disc_real_5: 0.23689569532871246 (0.22943415492773056) | > loss_0: 3.0926995277404785 (2.9529954195022583) | > loss_gen: 1.8993096351623535 (2.1512558460235596) | > loss_kl: 4.741273403167725 (4.646690368652344) | > loss_feat: 0.05723140388727188 (1.2231434471905231) | > loss_mel: 6.463876247406006 (14.29681658744812) | > loss_duration: 2.92252779006958 (2.948511004447937) | > loss_1: 16.084217071533203 (25.266416549682617)  --> STEP: 3 | > loss_disc: 3.050609827041626 (2.9855335553487143) | > loss_disc_real_0: 0.4617457687854767 (0.45716123779614765) | > loss_disc_real_1: 0.2785690128803253 (0.28776276111602783) | > loss_disc_real_2: 0.27690771222114563 (0.3077072203159332) | > loss_disc_real_3: 0.2731328308582306 (0.2876613239447276) | > loss_disc_real_4: 0.3204522728919983 (0.2872261901696523) | > loss_disc_real_5: 0.24267861247062683 (0.23384897410869598) | > loss_0: 3.050609827041626 (2.9855335553487143) | > loss_gen: 1.9420890808105469 (2.081533590952555) | > loss_kl: 2.076683282852173 (3.7900213400522866) | > loss_feat: 0.3089807629585266 (0.9184225524465243) | > loss_mel: 8.82898998260498 (12.474207719167074) | > loss_duration: 2.686378240585327 (2.861133416493734) | > loss_1: 15.843121528625488 (22.125318209330242) --> EVAL PERFORMANCE | > avg_loader_time: 0.03337359428405762 (+0.026888132095336914) | > avg_loss_disc: 2.9855335553487143 (+0.47820512453715036) | > avg_loss_disc_real_0: 0.45716123779614765 (+0.3626007946829001) | > avg_loss_disc_real_1: 0.28776276111602783 (-0.022689799467722593) | > avg_loss_disc_real_2: 0.3077072203159332 (+0.03053156534830731) | > avg_loss_disc_real_3: 0.2876613239447276 (-0.057257960240046146) | > avg_loss_disc_real_4: 0.2872261901696523 (-0.0011765410502752038) | > avg_loss_disc_real_5: 0.23384897410869598 (-0.056000580390294374) | > avg_loss_0: 2.9855335553487143 (+0.47820512453715036) | > avg_loss_gen: 2.081533590952555 (-0.6227167447408042) | > avg_loss_kl: 3.7900213400522866 (+0.15882559617360403) | > avg_loss_feat: 0.9184225524465243 (-4.283363011976083) | > avg_loss_mel: 12.474207719167074 (-11.112474918365477) | > avg_loss_duration: 2.861133416493734 (+0.017840862274169922) | > avg_loss_1: 22.125318209330242 (-15.841889381408688)  > EPOCH: 583/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:12:40)   --> TIME: 2023-10-20 06:12:58 -- STEP: 19/50 -- GLOBAL_STEP: 82170 | > loss_disc: 2.7288668155670166 (2.5237180622000444) | > loss_disc_real_0: 0.22484827041625977 (0.16197367188961884) | > loss_disc_real_1: 0.2927578389644623 (0.26248808734511075) | > loss_disc_real_2: 0.33582377433776855 (0.25428195415358795) | > loss_disc_real_3: 0.23468519747257233 (0.2664225623011589) | > loss_disc_real_4: 0.25455808639526367 (0.27428749693851723) | > loss_disc_real_5: 0.34062132239341736 (0.23205959620444397) | > loss_0: 2.7288668155670166 (2.5237180622000444) | > grad_norm_0: tensor(1279.2999, device='cuda:0') (tensor(662.1693, device='cuda:0')) | > loss_gen: 2.2169108390808105 (2.439864171178717) | > loss_kl: 0.6891809105873108 (0.933592604963403) | > loss_feat: 2.719648838043213 (5.298759542013469) | > loss_mel: 21.988000869750977 (21.019811498491386) | > loss_duration: 1.5336600542068481 (1.5122462322837429) | > loss_1: 29.147403717041016 (31.204275055935508) | > grad_norm_1: tensor(10764.2939, device='cuda:0') (tensor(31296.5527, device='cuda:0')) | > current_lr_0: 0.0001116401693962991 | > current_lr_1: 0.0001116401693962991 | > step_time: 0.3923 (0.41779100267510666) | > loader_time: 0.0051 (0.008145658593428763)  --> TIME: 2023-10-20 06:13:17 -- STEP: 49/50 -- GLOBAL_STEP: 82200 | > loss_disc: 3.019657850265503 (2.4959265504564554) | > loss_disc_real_0: 0.24802684783935547 (0.15802160483233776) | > loss_disc_real_1: 0.2474176436662674 (0.23905323141691642) | > loss_disc_real_2: 0.2778584957122803 (0.236442360266739) | > loss_disc_real_3: 0.24167846143245697 (0.23512635623313943) | > loss_disc_real_4: 0.26394909620285034 (0.23659456896652684) | > loss_disc_real_5: 0.2244388908147812 (0.21735547929622082) | > loss_0: 3.019657850265503 (2.4959265504564554) | > grad_norm_0: tensor(139.3378, device='cuda:0') (tensor(626.7629, device='cuda:0')) | > loss_gen: 1.5138158798217773 (2.2828249834021745) | > loss_kl: 0.6358041763305664 (0.9086225592360204) | > loss_feat: 0.04649420082569122 (5.073571261398646) | > loss_mel: 2.3613171577453613 (19.97730768700035) | > loss_duration: 1.5787804126739502 (1.475867585260041) | > loss_1: 6.136211395263672 (29.718194348471506) | > grad_norm_1: tensor(33003.1953, device='cuda:0') (tensor(23219.3262, device='cuda:0')) | > current_lr_0: 0.0001116401693962991 | > current_lr_1: 0.0001116401693962991 | > step_time: 0.932 (0.5250392398055719) | > loader_time: 0.492 (0.020987680980137417)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8928747177124023 (2.8928747177124023) | > loss_disc_real_0: 0.2404380440711975 (0.2404380440711975) | > loss_disc_real_1: 0.2813792824745178 (0.2813792824745178) | > loss_disc_real_2: 0.3177613615989685 (0.3177613615989685) | > loss_disc_real_3: 0.12874184548854828 (0.12874184548854828) | > loss_disc_real_4: 0.1571619212627411 (0.1571619212627411) | > loss_disc_real_5: 0.17331628501415253 (0.17331628501415253) | > loss_0: 2.8928747177124023 (2.8928747177124023) | > loss_gen: 1.9823983907699585 (1.9823983907699585) | > loss_kl: 4.180321216583252 (4.180321216583252) | > loss_feat: 5.923551082611084 (5.923551082611084) | > loss_mel: 25.23937225341797 (25.23937225341797) | > loss_duration: 2.539766788482666 (2.539766788482666) | > loss_1: 39.865413665771484 (39.865413665771484)  --> STEP: 1 | > loss_disc: 2.8677868843078613 (2.8677868843078613) | > loss_disc_real_0: 0.17471015453338623 (0.17471015453338623) | > loss_disc_real_1: 0.23122160136699677 (0.23122160136699677) | > loss_disc_real_2: 0.22781327366828918 (0.22781327366828918) | > loss_disc_real_3: 0.257023423910141 (0.257023423910141) | > loss_disc_real_4: 0.2982480227947235 (0.2982480227947235) | > loss_disc_real_5: 0.25304749608039856 (0.25304749608039856) | > loss_0: 2.8677868843078613 (2.8677868843078613) | > loss_gen: 1.6123230457305908 (1.6123230457305908) | > loss_kl: 4.329455852508545 (4.329455852508545) | > loss_feat: 0.8018944263458252 (0.8018944263458252) | > loss_mel: 15.301636695861816 (15.301636695861816) | > loss_duration: 2.9434850215911865 (2.9434850215911865) | > loss_1: 24.98879623413086 (24.98879623413086)  --> STEP: 2 | > loss_disc: 2.469136953353882 (2.6684619188308716) | > loss_disc_real_0: 0.3380177915096283 (0.25636397302150726) | > loss_disc_real_1: 0.09583976864814758 (0.16353068500757217) | > loss_disc_real_2: 0.21415720880031586 (0.22098524123430252) | > loss_disc_real_3: 0.14333687722682953 (0.20018015056848526) | > loss_disc_real_4: 0.11576563864946365 (0.20700683072209358) | > loss_disc_real_5: 0.08012191951274872 (0.16658470779657364) | > loss_0: 2.469136953353882 (2.6684619188308716) | > loss_gen: 2.9195525646209717 (2.2659378051757812) | > loss_kl: 4.498934268951416 (4.4141950607299805) | > loss_feat: 9.469833374023438 (5.135863900184631) | > loss_mel: 26.16573715209961 (20.733686923980713) | > loss_duration: 2.7835724353790283 (2.8635287284851074) | > loss_1: 45.83763122558594 (35.4132137298584)  --> STEP: 3 | > loss_disc: 3.2221484184265137 (2.8530240853627524) | > loss_disc_real_0: 0.37937355041503906 (0.2973671654860179) | > loss_disc_real_1: 0.342375785112381 (0.22314571837584177) | > loss_disc_real_2: 0.32234495878219604 (0.25477181375026703) | > loss_disc_real_3: 0.3698479235172272 (0.25673607488473255) | > loss_disc_real_4: 0.3355860412120819 (0.2498665675520897) | > loss_disc_real_5: 0.2742142081260681 (0.20246120790640512) | > loss_0: 3.2221484184265137 (2.8530240853627524) | > loss_gen: 2.0655131340026855 (2.199129581451416) | > loss_kl: 2.273939609527588 (3.7007765769958496) | > loss_feat: 3.9048993587493896 (4.725542386372884) | > loss_mel: 22.89110565185547 (21.452826499938965) | > loss_duration: 2.675506114959717 (2.800854523976644) | > loss_1: 33.81096267700195 (34.879130045572914) --> EVAL PERFORMANCE | > avg_loader_time: 0.012505292892456055 (-0.020868301391601562) | > avg_loss_disc: 2.8530240853627524 (-0.13250946998596191) | > avg_loss_disc_real_0: 0.2973671654860179 (-0.15979407231012976) | > avg_loss_disc_real_1: 0.22314571837584177 (-0.06461704274018606) | > avg_loss_disc_real_2: 0.25477181375026703 (-0.0529354065656662) | > avg_loss_disc_real_3: 0.25673607488473255 (-0.030925249059995052) | > avg_loss_disc_real_4: 0.2498665675520897 (-0.03735962261756259) | > avg_loss_disc_real_5: 0.20246120790640512 (-0.03138776620229086) | > avg_loss_0: 2.8530240853627524 (-0.13250946998596191) | > avg_loss_gen: 2.199129581451416 (+0.11759599049886083) | > avg_loss_kl: 3.7007765769958496 (-0.08924476305643703) | > avg_loss_feat: 4.725542386372884 (+3.8071198339263597) | > avg_loss_mel: 21.452826499938965 (+8.97861878077189) | > avg_loss_duration: 2.800854523976644 (-0.060278892517089844) | > avg_loss_1: 34.879130045572914 (+12.753811836242672)  > EPOCH: 584/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:13:34)   --> TIME: 2023-10-20 06:14:03 -- STEP: 29/50 -- GLOBAL_STEP: 82230 | > loss_disc: 2.903402805328369 (2.427793182175735) | > loss_disc_real_0: 0.164584219455719 (0.14648505722590047) | > loss_disc_real_1: 0.26169243454933167 (0.21168255581167236) | > loss_disc_real_2: 0.23471969366073608 (0.22046327462484097) | > loss_disc_real_3: 0.2986944913864136 (0.2350970339672319) | > loss_disc_real_4: 0.30830538272857666 (0.21904823440929938) | > loss_disc_real_5: 0.3101232647895813 (0.23821094381655084) | > loss_0: 2.903402805328369 (2.427793182175735) | > grad_norm_0: tensor(562.5782, device='cuda:0') (tensor(491.4877, device='cuda:0')) | > loss_gen: 1.762217402458191 (2.4057797563487084) | > loss_kl: 0.9113956093788147 (0.8861597036493236) | > loss_feat: 0.4487130045890808 (5.9762322799591665) | > loss_mel: 4.909368515014648 (21.96114242899007) | > loss_duration: 1.492611289024353 (1.475265412495054) | > loss_1: 9.52430534362793 (32.704578942266) | > grad_norm_1: tensor(11467.4150, device='cuda:0') (tensor(21895.7285, device='cuda:0')) | > current_lr_0: 0.00011152857805726812 | > current_lr_1: 0.00011152857805726812 | > step_time: 0.5112 (0.6514727164959084) | > loader_time: 0.0486 (0.023522771638015222)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.049233913421631 (3.049233913421631) | > loss_disc_real_0: 0.13597512245178223 (0.13597512245178223) | > loss_disc_real_1: 0.2590903341770172 (0.2590903341770172) | > loss_disc_real_2: 0.30643606185913086 (0.30643606185913086) | > loss_disc_real_3: 0.23345835506916046 (0.23345835506916046) | > loss_disc_real_4: 0.2699015438556671 (0.2699015438556671) | > loss_disc_real_5: 0.323387086391449 (0.323387086391449) | > loss_0: 3.049233913421631 (3.049233913421631) | > loss_gen: 1.5212047100067139 (1.5212047100067139) | > loss_kl: 4.432542324066162 (4.432542324066162) | > loss_feat: 0.11267507076263428 (0.11267507076263428) | > loss_mel: 1.912621259689331 (1.912621259689331) | > loss_duration: 2.7177629470825195 (2.7177629470825195) | > loss_1: 10.696806907653809 (10.696806907653809)  --> STEP: 1 | > loss_disc: 3.040886878967285 (3.040886878967285) | > loss_disc_real_0: 0.35017359256744385 (0.35017359256744385) | > loss_disc_real_1: 0.34547799825668335 (0.34547799825668335) | > loss_disc_real_2: 0.2607201933860779 (0.2607201933860779) | > loss_disc_real_3: 0.2630787491798401 (0.2630787491798401) | > loss_disc_real_4: 0.3779251277446747 (0.3779251277446747) | > loss_disc_real_5: 0.5450729727745056 (0.5450729727745056) | > loss_0: 3.040886878967285 (3.040886878967285) | > loss_gen: 2.5554676055908203 (2.5554676055908203) | > loss_kl: 4.56706428527832 (4.56706428527832) | > loss_feat: 4.663939952850342 (4.663939952850342) | > loss_mel: 26.450984954833984 (26.450984954833984) | > loss_duration: 2.9818761348724365 (2.9818761348724365) | > loss_1: 41.21933364868164 (41.21933364868164)  --> STEP: 2 | > loss_disc: 2.0702147483825684 (2.5555508136749268) | > loss_disc_real_0: 0.12627440690994263 (0.23822399973869324) | > loss_disc_real_1: 0.1879989206790924 (0.2667384594678879) | > loss_disc_real_2: 0.23941422998905182 (0.25006721168756485) | > loss_disc_real_3: 0.38975319266319275 (0.3264159709215164) | > loss_disc_real_4: 0.14479294419288635 (0.2613590359687805) | > loss_disc_real_5: 0.1540922224521637 (0.34958259761333466) | > loss_0: 2.0702147483825684 (2.5555508136749268) | > loss_gen: 2.647777557373047 (2.6016225814819336) | > loss_kl: 4.400134086608887 (4.4835991859436035) | > loss_feat: 7.204302787780762 (5.934121370315552) | > loss_mel: 25.866350173950195 (26.15866756439209) | > loss_duration: 2.870668649673462 (2.926272392272949) | > loss_1: 42.989234924316406 (42.10428428649902)  --> STEP: 3 | > loss_disc: 2.857635021209717 (2.656245549519857) | > loss_disc_real_0: 0.21500399708747864 (0.23048399885495505) | > loss_disc_real_1: 0.254573255777359 (0.2626833915710449) | > loss_disc_real_2: 0.28266599774360657 (0.2609334737062454) | > loss_disc_real_3: 0.2403029203414917 (0.29771162072817486) | > loss_disc_real_4: 0.27695780992507935 (0.2665586272875468) | > loss_disc_real_5: 0.317828893661499 (0.33899802962938946) | > loss_0: 2.857635021209717 (2.656245549519857) | > loss_gen: 1.776573657989502 (2.326606273651123) | > loss_kl: 2.198765277862549 (3.7219878832499185) | > loss_feat: 0.6350996494293213 (4.167780796686809) | > loss_mel: 16.82006072998047 (23.045798619588215) | > loss_duration: 2.6634323596954346 (2.8386590480804443) | > loss_1: 24.093931198120117 (36.10083325703939) --> EVAL PERFORMANCE | > avg_loader_time: 0.024836301803588867 (+0.012331008911132812) | > avg_loss_disc: 2.656245549519857 (-0.1967785358428955) | > avg_loss_disc_real_0: 0.23048399885495505 (-0.06688316663106283) | > avg_loss_disc_real_1: 0.2626833915710449 (+0.039537673195203155) | > avg_loss_disc_real_2: 0.2609334737062454 (+0.0061616599559783936) | > avg_loss_disc_real_3: 0.29771162072817486 (+0.04097554584344232) | > avg_loss_disc_real_4: 0.2665586272875468 (+0.01669205973545712) | > avg_loss_disc_real_5: 0.33899802962938946 (+0.13653682172298434) | > avg_loss_0: 2.656245549519857 (-0.1967785358428955) | > avg_loss_gen: 2.326606273651123 (+0.12747669219970703) | > avg_loss_kl: 3.7219878832499185 (+0.021211306254068862) | > avg_loss_feat: 4.167780796686809 (-0.5577615896860753) | > avg_loss_mel: 23.045798619588215 (+1.5929721196492501) | > avg_loss_duration: 2.8386590480804443 (+0.03780452410380031) | > avg_loss_1: 36.10083325703939 (+1.221703211466476)  > EPOCH: 585/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:14:30)   --> TIME: 2023-10-20 06:14:48 -- STEP: 9/50 -- GLOBAL_STEP: 82260 | > loss_disc: 2.391526460647583 (2.392276710934109) | > loss_disc_real_0: 0.05727824941277504 (0.15666578627294964) | > loss_disc_real_1: 0.34323471784591675 (0.2622576918866899) | > loss_disc_real_2: 0.4927000403404236 (0.262993648648262) | > loss_disc_real_3: 0.3382949233055115 (0.24575276755624348) | > loss_disc_real_4: 0.24782539904117584 (0.2136109417511357) | > loss_disc_real_5: 0.3155800700187683 (0.23114339976261059) | > loss_0: 2.391526460647583 (2.392276710934109) | > grad_norm_0: tensor(286.3555, device='cuda:0') (tensor(564.9682, device='cuda:0')) | > loss_gen: 3.217755079269409 (2.4938893847995334) | > loss_kl: 0.4248291850090027 (1.00480137930976) | > loss_feat: 5.474606513977051 (5.26333130730523) | > loss_mel: 21.9438533782959 (21.599883821275498) | > loss_duration: 1.3991011381149292 (1.4628606504864163) | > loss_1: 32.46014404296875 (31.82476594712999) | > grad_norm_1: tensor(21097.8828, device='cuda:0') (tensor(17195.0898, device='cuda:0')) | > current_lr_0: 0.00011141709826076717 | > current_lr_1: 0.00011141709826076717 | > step_time: 0.6889 (0.6210337744818794) | > loader_time: 0.0232 (0.019178681903415255)  --> TIME: 2023-10-20 06:15:06 -- STEP: 39/50 -- GLOBAL_STEP: 82290 | > loss_disc: 1.8395177125930786 (2.362133126992446) | > loss_disc_real_0: 0.21833479404449463 (0.15259801672819334) | > loss_disc_real_1: 0.2278837263584137 (0.22859588112586585) | > loss_disc_real_2: 0.1167132630944252 (0.2233693527105527) | > loss_disc_real_3: 0.22391478717327118 (0.2343542471719094) | > loss_disc_real_4: 0.14121834933757782 (0.21546220755538875) | > loss_disc_real_5: 0.18982428312301636 (0.21775758058692402) | > loss_0: 1.8395177125930786 (2.362133126992446) | > grad_norm_0: tensor(2297.8352, device='cuda:0') (tensor(1136.2393, device='cuda:0')) | > loss_gen: 3.3263163566589355 (2.4244759602424426) | > loss_kl: 0.6889809370040894 (0.9246714275616866) | > loss_feat: 8.703454971313477 (5.492185815022542) | > loss_mel: 26.8703670501709 (21.677461966490135) | > loss_duration: 1.5723482370376587 (1.4647879417125995) | > loss_1: 41.161468505859375 (31.98358258222922) | > grad_norm_1: tensor(63221.7930, device='cuda:0') (tensor(28344.8340, device='cuda:0')) | > current_lr_0: 0.00011141709826076717 | > current_lr_1: 0.00011141709826076717 | > step_time: 0.3819 (0.5856236739036365) | > loader_time: 0.034 (0.023202981704320662)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.904240131378174 (2.904240131378174) | > loss_disc_real_0: 0.5474812388420105 (0.5474812388420105) | > loss_disc_real_1: 0.28069913387298584 (0.28069913387298584) | > loss_disc_real_2: 0.4770253002643585 (0.4770253002643585) | > loss_disc_real_3: 0.29949668049812317 (0.29949668049812317) | > loss_disc_real_4: 0.3540661036968231 (0.3540661036968231) | > loss_disc_real_5: 0.3034127652645111 (0.3034127652645111) | > loss_0: 2.904240131378174 (2.904240131378174) | > loss_gen: 3.4119420051574707 (3.4119420051574707) | > loss_kl: 4.309325695037842 (4.309325695037842) | > loss_feat: 6.60100793838501 (6.60100793838501) | > loss_mel: 25.654682159423828 (25.654682159423828) | > loss_duration: 2.7071943283081055 (2.7071943283081055) | > loss_1: 42.68415451049805 (42.68415451049805)  --> STEP: 1 | > loss_disc: 2.8925299644470215 (2.8925299644470215) | > loss_disc_real_0: 0.11698456108570099 (0.11698456108570099) | > loss_disc_real_1: 0.2441718876361847 (0.2441718876361847) | > loss_disc_real_2: 0.2701665163040161 (0.2701665163040161) | > loss_disc_real_3: 0.3100492060184479 (0.3100492060184479) | > loss_disc_real_4: 0.36938202381134033 (0.36938202381134033) | > loss_disc_real_5: 0.3307933807373047 (0.3307933807373047) | > loss_0: 2.8925299644470215 (2.8925299644470215) | > loss_gen: 1.8437912464141846 (1.8437912464141846) | > loss_kl: 4.47645902633667 (4.47645902633667) | > loss_feat: 1.7433550357818604 (1.7433550357818604) | > loss_mel: 21.479331970214844 (21.479331970214844) | > loss_duration: 3.0395116806030273 (3.0395116806030273) | > loss_1: 32.58245086669922 (32.58245086669922)  --> STEP: 2 | > loss_disc: 2.6589412689208984 (2.77573561668396) | > loss_disc_real_0: 0.11195747554302216 (0.11447101831436157) | > loss_disc_real_1: 0.19466149806976318 (0.21941669285297394) | > loss_disc_real_2: 0.22510895133018494 (0.24763773381710052) | > loss_disc_real_3: 0.34514474868774414 (0.327596977353096) | > loss_disc_real_4: 0.21880212426185608 (0.2940920740365982) | > loss_disc_real_5: 0.3516743779182434 (0.34123387932777405) | > loss_0: 2.6589412689208984 (2.77573561668396) | > loss_gen: 2.0298283100128174 (1.936809778213501) | > loss_kl: 4.7110795974731445 (4.593769311904907) | > loss_feat: 3.0081429481506348 (2.3757489919662476) | > loss_mel: 24.99347496032715 (23.236403465270996) | > loss_duration: 2.7647955417633057 (2.9021536111831665) | > loss_1: 37.507320404052734 (35.04488563537598)  --> STEP: 3 | > loss_disc: 1.9717915058135986 (2.5077542463938394) | > loss_disc_real_0: 0.11086657643318176 (0.11326953768730164) | > loss_disc_real_1: 0.2359188050031662 (0.22491739690303802) | > loss_disc_real_2: 0.13809847831726074 (0.21112464865048727) | > loss_disc_real_3: 0.3007901608943939 (0.318661371866862) | > loss_disc_real_4: 0.15374505519866943 (0.2473097344239553) | > loss_disc_real_5: 0.026677308604121208 (0.23638168908655643) | > loss_0: 1.9717915058135986 (2.5077542463938394) | > loss_gen: 2.8504397869110107 (2.2413531144460044) | > loss_kl: 2.043272018432617 (3.743603547414144) | > loss_feat: 7.441364288330078 (4.064287424087524) | > loss_mel: 24.00136947631836 (23.491392135620117) | > loss_duration: 2.699017286300659 (2.8344415028889975) | > loss_1: 39.035465240478516 (36.37507883707682) --> EVAL PERFORMANCE | > avg_loader_time: 0.02327283223470052 (-0.0015634695688883475) | > avg_loss_disc: 2.5077542463938394 (-0.14849130312601755) | > avg_loss_disc_real_0: 0.11326953768730164 (-0.11721446116765341) | > avg_loss_disc_real_1: 0.22491739690303802 (-0.0377659946680069) | > avg_loss_disc_real_2: 0.21112464865048727 (-0.04980882505575815) | > avg_loss_disc_real_3: 0.318661371866862 (+0.020949751138687134) | > avg_loss_disc_real_4: 0.2473097344239553 (-0.01924889286359152) | > avg_loss_disc_real_5: 0.23638168908655643 (-0.10261634054283303) | > avg_loss_0: 2.5077542463938394 (-0.14849130312601755) | > avg_loss_gen: 2.2413531144460044 (-0.08525315920511867) | > avg_loss_kl: 3.743603547414144 (+0.021615664164225556) | > avg_loss_feat: 4.064287424087524 (-0.10349337259928415) | > avg_loss_mel: 23.491392135620117 (+0.4455935160319022) | > avg_loss_duration: 2.8344415028889975 (-0.004217545191446792) | > avg_loss_1: 36.37507883707682 (+0.27424558003743016)  > EPOCH: 586/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:15:29)   --> TIME: 2023-10-20 06:15:44 -- STEP: 19/50 -- GLOBAL_STEP: 82320 | > loss_disc: 2.834989547729492 (2.440198252075597) | > loss_disc_real_0: 0.24973267316818237 (0.14436292952220692) | > loss_disc_real_1: 0.2896588444709778 (0.2193660936073253) | > loss_disc_real_2: 0.21758972108364105 (0.23441132628603986) | > loss_disc_real_3: 0.37227514386177063 (0.23046174067023553) | > loss_disc_real_4: 0.16493569314479828 (0.2373220016689677) | > loss_disc_real_5: 0.31502607464790344 (0.2201995398653181) | > loss_0: 2.834989547729492 (2.440198252075597) | > grad_norm_0: tensor(796.2950, device='cuda:0') (tensor(1246.5470, device='cuda:0')) | > loss_gen: 2.130139112472534 (2.4380447174373425) | > loss_kl: 0.8478530645370483 (0.7980001529580668) | > loss_feat: 3.353408098220825 (5.463177059433963) | > loss_mel: 13.380294799804688 (19.12475902155826) | > loss_duration: 1.5632960796356201 (1.5005444476478977) | > loss_1: 21.27499008178711 (29.324525381389417) | > grad_norm_1: tensor(41292.8867, device='cuda:0') (tensor(49445.3867, device='cuda:0')) | > current_lr_0: 0.00011130572989530252 | > current_lr_1: 0.00011130572989530252 | > step_time: 0.4216 (0.4981625331075568) | > loader_time: 0.0051 (0.01773155362982499)  --> TIME: 2023-10-20 06:16:00 -- STEP: 49/50 -- GLOBAL_STEP: 82350 | > loss_disc: 2.7998170852661133 (2.4349458071650285) | > loss_disc_real_0: 0.2288699746131897 (0.14495554885693962) | > loss_disc_real_1: 0.37559956312179565 (0.2252669767761717) | > loss_disc_real_2: 0.21643556654453278 (0.22257867972461545) | > loss_disc_real_3: 0.3084944486618042 (0.22807151995295163) | > loss_disc_real_4: 0.36740642786026 (0.21806481402671454) | > loss_disc_real_5: 0.3709772825241089 (0.21118149229762506) | > loss_0: 2.7998170852661133 (2.4349458071650285) | > grad_norm_0: tensor(871.0632, device='cuda:0') (tensor(1058.5471, device='cuda:0')) | > loss_gen: 2.4378154277801514 (2.2983678603658877) | > loss_kl: 0.9758167266845703 (0.7902843608539931) | > loss_feat: 3.282186508178711 (5.093238351220378) | > loss_mel: 22.06377410888672 (19.42032319915537) | > loss_duration: 1.6069939136505127 (1.4708631281950035) | > loss_1: 30.366586685180664 (29.073077425664785) | > grad_norm_1: tensor(9236.8066, device='cuda:0') (tensor(45169.9219, device='cuda:0')) | > current_lr_0: 0.00011130572989530252 | > current_lr_1: 0.00011130572989530252 | > step_time: 0.3348 (0.5087807324467872) | > loader_time: 0.3848 (0.02377097947256906)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2213916778564453 (2.2213916778564453) | > loss_disc_real_0: 0.12628954648971558 (0.12628954648971558) | > loss_disc_real_1: 0.23149089515209198 (0.23149089515209198) | > loss_disc_real_2: 0.19225731492042542 (0.19225731492042542) | > loss_disc_real_3: 0.18046243488788605 (0.18046243488788605) | > loss_disc_real_4: 0.09805300086736679 (0.09805300086736679) | > loss_disc_real_5: 0.18242046236991882 (0.18242046236991882) | > loss_0: 2.2213916778564453 (2.2213916778564453) | > loss_gen: 2.2703309059143066 (2.2703309059143066) | > loss_kl: 3.6728758811950684 (3.6728758811950684) | > loss_feat: 5.6080217361450195 (5.6080217361450195) | > loss_mel: 25.22829818725586 (25.22829818725586) | > loss_duration: 2.6873674392700195 (2.6873674392700195) | > loss_1: 39.46689224243164 (39.46689224243164)  --> STEP: 1 | > loss_disc: 2.6385114192962646 (2.6385114192962646) | > loss_disc_real_0: 0.18463653326034546 (0.18463653326034546) | > loss_disc_real_1: 0.270920991897583 (0.270920991897583) | > loss_disc_real_2: 0.38339728116989136 (0.38339728116989136) | > loss_disc_real_3: 0.2807273864746094 (0.2807273864746094) | > loss_disc_real_4: 0.35231781005859375 (0.35231781005859375) | > loss_disc_real_5: 0.2588944137096405 (0.2588944137096405) | > loss_0: 2.6385114192962646 (2.6385114192962646) | > loss_gen: 2.420335292816162 (2.420335292816162) | > loss_kl: 4.590959548950195 (4.590959548950195) | > loss_feat: 4.957396030426025 (4.957396030426025) | > loss_mel: 25.289945602416992 (25.289945602416992) | > loss_duration: 2.9049110412597656 (2.9049110412597656) | > loss_1: 40.16354751586914 (40.16354751586914)  --> STEP: 2 | > loss_disc: 2.4424386024475098 (2.540475010871887) | > loss_disc_real_0: 0.05706499516963959 (0.12085076421499252) | > loss_disc_real_1: 0.038850609213113785 (0.1548858005553484) | > loss_disc_real_2: 0.08107883483171463 (0.232238058000803) | > loss_disc_real_3: 0.06917183846235275 (0.17494961246848106) | > loss_disc_real_4: 0.14243431389331818 (0.24737606197595596) | > loss_disc_real_5: 0.22450751066207886 (0.24170096218585968) | > loss_0: 2.4424386024475098 (2.540475010871887) | > loss_gen: 2.002394676208496 (2.211364984512329) | > loss_kl: 4.9305219650268555 (4.760740756988525) | > loss_feat: 15.326075553894043 (10.141735792160034) | > loss_mel: 24.89619255065918 (25.093069076538086) | > loss_duration: 2.7484893798828125 (2.826700210571289) | > loss_1: 49.9036750793457 (45.03361129760742)  --> STEP: 3 | > loss_disc: 2.309705972671509 (2.4635519981384277) | > loss_disc_real_0: 0.03630249202251434 (0.0926680068174998) | > loss_disc_real_1: 0.5486074686050415 (0.28612635657191277) | > loss_disc_real_2: 0.23023632168769836 (0.23157081256310144) | > loss_disc_real_3: 0.25551360845565796 (0.20180427779754004) | > loss_disc_real_4: 0.15362215042114258 (0.2161247581243515) | > loss_disc_real_5: 0.11521267890930176 (0.1995382010936737) | > loss_0: 2.309705972671509 (2.4635519981384277) | > loss_gen: 2.4826085567474365 (2.3017795085906982) | > loss_kl: 2.029289960861206 (3.850257158279419) | > loss_feat: 5.855400085449219 (8.71295722325643) | > loss_mel: 22.535694122314453 (24.240610758463543) | > loss_duration: 2.665431022644043 (2.7729438145955405) | > loss_1: 35.568424224853516 (41.87854894002279) --> EVAL PERFORMANCE | > avg_loader_time: 0.017191648483276367 (-0.0060811837514241525) | > avg_loss_disc: 2.4635519981384277 (-0.044202248255411636) | > avg_loss_disc_real_0: 0.0926680068174998 (-0.020601530869801835) | > avg_loss_disc_real_1: 0.28612635657191277 (+0.06120895966887474) | > avg_loss_disc_real_2: 0.23157081256310144 (+0.020446163912614168) | > avg_loss_disc_real_3: 0.20180427779754004 (-0.11685709406932196) | > avg_loss_disc_real_4: 0.2161247581243515 (-0.03118497629960379) | > avg_loss_disc_real_5: 0.1995382010936737 (-0.03684348799288273) | > avg_loss_0: 2.4635519981384277 (-0.044202248255411636) | > avg_loss_gen: 2.3017795085906982 (+0.06042639414469386) | > avg_loss_kl: 3.850257158279419 (+0.10665361086527492) | > avg_loss_feat: 8.71295722325643 (+4.648669799168905) | > avg_loss_mel: 24.240610758463543 (+0.7492186228434257) | > avg_loss_duration: 2.7729438145955405 (-0.06149768829345703) | > avg_loss_1: 41.87854894002279 (+5.503470102945968)  > EPOCH: 587/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:16:14)   --> TIME: 2023-10-20 06:16:39 -- STEP: 29/50 -- GLOBAL_STEP: 82380 | > loss_disc: 2.962721824645996 (2.4562959588807196) | > loss_disc_real_0: 0.31020522117614746 (0.13782946229109477) | > loss_disc_real_1: 0.23960569500923157 (0.23145378650776272) | > loss_disc_real_2: 0.22890661656856537 (0.23461193822581192) | > loss_disc_real_3: 0.19319593906402588 (0.24063918957936353) | > loss_disc_real_4: 0.241989403963089 (0.24889133279693537) | > loss_disc_real_5: 0.24676863849163055 (0.24781777581264233) | > loss_0: 2.962721824645996 (2.4562959588807196) | > grad_norm_0: tensor(1033.0006, device='cuda:0') (tensor(1412.2080, device='cuda:0')) | > loss_gen: 1.571497917175293 (2.4502904908410432) | > loss_kl: 0.9608172178268433 (0.8642355532481752) | > loss_feat: 0.19292320311069489 (6.091580630890254) | > loss_mel: 5.840053558349609 (22.66517920329653) | > loss_duration: 1.4485950469970703 (1.481955125414092) | > loss_1: 10.013887405395508 (33.55324133511247) | > grad_norm_1: tensor(41675.1211, device='cuda:0') (tensor(51208.0547, device='cuda:0')) | > current_lr_0: 0.00011119447284949185 | > current_lr_1: 0.00011119447284949185 | > step_time: 0.517 (0.6484063164941196) | > loader_time: 0.0267 (0.02225631680981866)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0190930366516113 (3.0190930366516113) | > loss_disc_real_0: 0.5126858949661255 (0.5126858949661255) | > loss_disc_real_1: 0.3283650875091553 (0.3283650875091553) | > loss_disc_real_2: 0.28817567229270935 (0.28817567229270935) | > loss_disc_real_3: 0.255959689617157 (0.255959689617157) | > loss_disc_real_4: 0.2754882276058197 (0.2754882276058197) | > loss_disc_real_5: 0.23401032388210297 (0.23401032388210297) | > loss_0: 3.0190930366516113 (3.0190930366516113) | > loss_gen: 2.3468081951141357 (2.3468081951141357) | > loss_kl: 4.974294185638428 (4.974294185638428) | > loss_feat: 2.1465914249420166 (2.1465914249420166) | > loss_mel: 20.720951080322266 (20.720951080322266) | > loss_duration: 2.7039899826049805 (2.7039899826049805) | > loss_1: 32.892635345458984 (32.892635345458984)  --> STEP: 1 | > loss_disc: 1.855594277381897 (1.855594277381897) | > loss_disc_real_0: 0.033100567758083344 (0.033100567758083344) | > loss_disc_real_1: 0.05559718608856201 (0.05559718608856201) | > loss_disc_real_2: 0.06648341566324234 (0.06648341566324234) | > loss_disc_real_3: 0.07454559206962585 (0.07454559206962585) | > loss_disc_real_4: 0.03863443434238434 (0.03863443434238434) | > loss_disc_real_5: 0.02259635366499424 (0.02259635366499424) | > loss_0: 1.855594277381897 (1.855594277381897) | > loss_gen: 1.7799866199493408 (1.7799866199493408) | > loss_kl: 4.185605525970459 (4.185605525970459) | > loss_feat: 10.976397514343262 (10.976397514343262) | > loss_mel: 27.746448516845703 (27.746448516845703) | > loss_duration: 2.981755018234253 (2.981755018234253) | > loss_1: 47.67019271850586 (47.67019271850586)  --> STEP: 2 | > loss_disc: 3.0780749320983887 (2.466834604740143) | > loss_disc_real_0: 0.3840320110321045 (0.20856628939509392) | > loss_disc_real_1: 0.30059322714805603 (0.17809520661830902) | > loss_disc_real_2: 0.2953036427497864 (0.18089352920651436) | > loss_disc_real_3: 0.28429725766181946 (0.17942142486572266) | > loss_disc_real_4: 0.22873246669769287 (0.1336834505200386) | > loss_disc_real_5: 0.21671973168849945 (0.11965804267674685) | > loss_0: 3.0780749320983887 (2.466834604740143) | > loss_gen: 1.6640456914901733 (1.722016155719757) | > loss_kl: 4.866950035095215 (4.526277780532837) | > loss_feat: 0.10630213469266891 (5.541349824517965) | > loss_mel: 1.902662992477417 (14.82455575466156) | > loss_duration: 2.846034049987793 (2.913894534111023) | > loss_1: 11.385994911193848 (29.528093814849854)  --> STEP: 3 | > loss_disc: 1.8598072528839111 (2.264492154121399) | > loss_disc_real_0: 0.16593825817108154 (0.19435694565375647) | > loss_disc_real_1: 0.16415338218212128 (0.17344793180624643) | > loss_disc_real_2: 0.2082621306180954 (0.19001639634370804) | > loss_disc_real_3: 0.13387161493301392 (0.16423815488815308) | > loss_disc_real_4: 0.09126069396734238 (0.11954253166913986) | > loss_disc_real_5: 0.03817952796816826 (0.09249853777388732) | > loss_0: 1.8598072528839111 (2.264492154121399) | > loss_gen: 2.8059072494506836 (2.0833131869633994) | > loss_kl: 1.8268358707427979 (3.6264638106028237) | > loss_feat: 6.822859287261963 (5.9685196454326315) | > loss_mel: 26.046213150024414 (18.565108219782513) | > loss_duration: 2.75504994392395 (2.8609463373819985) | > loss_1: 40.256866455078125 (33.10435136159261) --> EVAL PERFORMANCE | > avg_loader_time: 0.0034439563751220703 (-0.013747692108154297) | > avg_loss_disc: 2.264492154121399 (-0.1990598440170288) | > avg_loss_disc_real_0: 0.19435694565375647 (+0.10168893883625667) | > avg_loss_disc_real_1: 0.17344793180624643 (-0.11267842476566634) | > avg_loss_disc_real_2: 0.19001639634370804 (-0.0415544162193934) | > avg_loss_disc_real_3: 0.16423815488815308 (-0.03756612290938696) | > avg_loss_disc_real_4: 0.11954253166913986 (-0.09658222645521164) | > avg_loss_disc_real_5: 0.09249853777388732 (-0.10703966331978639) | > avg_loss_0: 2.264492154121399 (-0.1990598440170288) | > avg_loss_gen: 2.0833131869633994 (-0.21846632162729884) | > avg_loss_kl: 3.6264638106028237 (-0.2237933476765952) | > avg_loss_feat: 5.9685196454326315 (-2.744437577823798) | > avg_loss_mel: 18.565108219782513 (-5.67550253868103) | > avg_loss_duration: 2.8609463373819985 (+0.08800252278645804) | > avg_loss_1: 33.10435136159261 (-8.774197578430176)  > EPOCH: 588/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:17:08)   --> TIME: 2023-10-20 06:17:20 -- STEP: 9/50 -- GLOBAL_STEP: 82410 | > loss_disc: 2.292969226837158 (2.3418589697943792) | > loss_disc_real_0: 0.16989287734031677 (0.1249977479585343) | > loss_disc_real_1: 0.2672330439090729 (0.2566944791211022) | > loss_disc_real_2: 0.18808917701244354 (0.2527020159694884) | > loss_disc_real_3: 0.1572991907596588 (0.2411475069820881) | > loss_disc_real_4: 0.2555897831916809 (0.1926695845193333) | > loss_disc_real_5: 0.2345024198293686 (0.16587439365684986) | > loss_0: 2.292969226837158 (2.3418589697943792) | > grad_norm_0: tensor(963.1244, device='cuda:0') (tensor(1343.5469, device='cuda:0')) | > loss_gen: 2.4953463077545166 (2.3979567686716714) | > loss_kl: 1.214032769203186 (0.7852042814095815) | > loss_feat: 6.578746795654297 (6.904532591501872) | > loss_mel: 24.07383918762207 (24.589448504977756) | > loss_duration: 1.3799124956130981 (1.4887836774190266) | > loss_1: 35.741878509521484 (36.16592576768663) | > grad_norm_1: tensor(24218.7871, device='cuda:0') (tensor(46660.3008, device='cuda:0')) | > current_lr_0: 0.00011108332701206419 | > current_lr_1: 0.00011108332701206419 | > step_time: 0.3372 (0.5841528309716119) | > loader_time: 0.0078 (0.014842033386230469)  --> TIME: 2023-10-20 06:17:36 -- STEP: 39/50 -- GLOBAL_STEP: 82440 | > loss_disc: 2.94992995262146 (2.326728203357794) | > loss_disc_real_0: 0.3898346722126007 (0.14830443487526512) | > loss_disc_real_1: 0.27870938181877136 (0.225699661920468) | > loss_disc_real_2: 0.3570263683795929 (0.22921915715321517) | > loss_disc_real_3: 0.2460145205259323 (0.21972058512843573) | > loss_disc_real_4: 0.2539430260658264 (0.20443038040628803) | > loss_disc_real_5: 0.30534806847572327 (0.1774535838705607) | > loss_0: 2.94992995262146 (2.326728203357794) | > grad_norm_0: tensor(3062.1897, device='cuda:0') (tensor(1458.1172, device='cuda:0')) | > loss_gen: 2.1388373374938965 (2.487331705215649) | > loss_kl: 0.47626006603240967 (0.8269985172993097) | > loss_feat: 1.4067684412002563 (6.419924918466654) | > loss_mel: 19.148496627807617 (23.445910291794018) | > loss_duration: 1.4878672361373901 (1.4777699586672661) | > loss_1: 24.65822982788086 (34.657935142517076) | > grad_norm_1: tensor(11326.7627, device='cuda:0') (tensor(56596.8984, device='cuda:0')) | > current_lr_0: 0.00011108332701206419 | > current_lr_1: 0.00011108332701206419 | > step_time: 0.5742 (0.53758866359026) | > loader_time: 0.0242 (0.018567653802724984)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.386704206466675 (2.386704206466675) | > loss_disc_real_0: 0.3550909161567688 (0.3550909161567688) | > loss_disc_real_1: 0.15245258808135986 (0.15245258808135986) | > loss_disc_real_2: 0.1899675577878952 (0.1899675577878952) | > loss_disc_real_3: 0.21970771253108978 (0.21970771253108978) | > loss_disc_real_4: 0.3334382176399231 (0.3334382176399231) | > loss_disc_real_5: 0.26516368985176086 (0.26516368985176086) | > loss_0: 2.386704206466675 (2.386704206466675) | > loss_gen: 2.747251510620117 (2.747251510620117) | > loss_kl: 4.109403610229492 (4.109403610229492) | > loss_feat: 8.126361846923828 (8.126361846923828) | > loss_mel: 23.699390411376953 (23.699390411376953) | > loss_duration: 2.71028470993042 (2.71028470993042) | > loss_1: 41.392696380615234 (41.392696380615234)  --> STEP: 1 | > loss_disc: 1.9610117673873901 (1.9610117673873901) | > loss_disc_real_0: 0.09164366126060486 (0.09164366126060486) | > loss_disc_real_1: 0.18889568746089935 (0.18889568746089935) | > loss_disc_real_2: 0.14929592609405518 (0.14929592609405518) | > loss_disc_real_3: 0.1504591852426529 (0.1504591852426529) | > loss_disc_real_4: 0.2509988844394684 (0.2509988844394684) | > loss_disc_real_5: 0.35896119475364685 (0.35896119475364685) | > loss_0: 1.9610117673873901 (1.9610117673873901) | > loss_gen: 3.0805206298828125 (3.0805206298828125) | > loss_kl: 4.029305458068848 (4.029305458068848) | > loss_feat: 7.771456718444824 (7.771456718444824) | > loss_mel: 24.707914352416992 (24.707914352416992) | > loss_duration: 3.041533946990967 (3.041533946990967) | > loss_1: 42.63072967529297 (42.63072967529297)  --> STEP: 2 | > loss_disc: 2.9984607696533203 (2.4797362685203552) | > loss_disc_real_0: 0.23869143426418304 (0.16516754776239395) | > loss_disc_real_1: 0.2971150279045105 (0.24300535768270493) | > loss_disc_real_2: 0.2517629861831665 (0.20052945613861084) | > loss_disc_real_3: 0.2700096666812897 (0.21023442596197128) | > loss_disc_real_4: 0.2925181984901428 (0.2717585414648056) | > loss_disc_real_5: 0.25787776708602905 (0.30841948091983795) | > loss_0: 2.9984607696533203 (2.4797362685203552) | > loss_gen: 1.6263108253479004 (2.3534157276153564) | > loss_kl: 4.6459760665893555 (4.337640762329102) | > loss_feat: 0.12465626001358032 (3.9480564892292023) | > loss_mel: 2.6050355434417725 (13.656474947929382) | > loss_duration: 2.86696457862854 (2.9542492628097534) | > loss_1: 11.868942260742188 (27.249835968017578)  --> STEP: 3 | > loss_disc: 2.9988479614257812 (2.6527734994888306) | > loss_disc_real_0: 0.23958371579647064 (0.18997293710708618) | > loss_disc_real_1: 0.2971002757549286 (0.2610369970401128) | > loss_disc_real_2: 0.2517108917236328 (0.2175899346669515) | > loss_disc_real_3: 0.269911527633667 (0.23012679318586984) | > loss_disc_real_4: 0.29257598519325256 (0.2786976893742879) | > loss_disc_real_5: 0.25786975026130676 (0.2915695707003276) | > loss_0: 2.9988479614257812 (2.6527734994888306) | > loss_gen: 1.6265697479248047 (2.1111337343851724) | > loss_kl: 2.0520520210266113 (3.575777848561605) | > loss_feat: 0.12588676810264587 (2.67399991552035) | > loss_mel: 2.8249521255493164 (10.04596734046936) | > loss_duration: 2.798649549484253 (2.9023826917012534) | > loss_1: 9.428110122680664 (21.309260686238606) --> EVAL PERFORMANCE | > avg_loader_time: 0.003392299016316732 (-5.16573588053384e-05) | > avg_loss_disc: 2.6527734994888306 (+0.38828134536743164) | > avg_loss_disc_real_0: 0.18997293710708618 (-0.004384008546670287) | > avg_loss_disc_real_1: 0.2610369970401128 (+0.08758906523386636) | > avg_loss_disc_real_2: 0.2175899346669515 (+0.02757353832324347) | > avg_loss_disc_real_3: 0.23012679318586984 (+0.06588863829771677) | > avg_loss_disc_real_4: 0.2786976893742879 (+0.15915515770514804) | > avg_loss_disc_real_5: 0.2915695707003276 (+0.19907103292644024) | > avg_loss_0: 2.6527734994888306 (+0.38828134536743164) | > avg_loss_gen: 2.1111337343851724 (+0.02782054742177298) | > avg_loss_kl: 3.575777848561605 (-0.05068596204121878) | > avg_loss_feat: 2.67399991552035 (-3.2945197299122815) | > avg_loss_mel: 10.04596734046936 (-8.519140879313152) | > avg_loss_duration: 2.9023826917012534 (+0.04143635431925485) | > avg_loss_1: 21.309260686238606 (-11.795090675354007)  > EPOCH: 589/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:17:58)   --> TIME: 2023-10-20 06:18:15 -- STEP: 19/50 -- GLOBAL_STEP: 82470 | > loss_disc: 1.9231643676757812 (2.5093418547981665) | > loss_disc_real_0: 0.07322382181882858 (0.16014744949183965) | > loss_disc_real_1: 0.1512908935546875 (0.22585391625761986) | > loss_disc_real_2: 0.13297496736049652 (0.2412333940400889) | > loss_disc_real_3: 0.12319574505090714 (0.23473299069232062) | > loss_disc_real_4: 0.1238938719034195 (0.22582379037416295) | > loss_disc_real_5: 0.06445129215717316 (0.22412111884669253) | > loss_0: 1.9231643676757812 (2.5093418547981665) | > grad_norm_0: tensor(1089.1606, device='cuda:0') (tensor(1229.0336, device='cuda:0')) | > loss_gen: 2.283971071243286 (2.268984361698753) | > loss_kl: 0.9641664624214172 (0.7442227637297228) | > loss_feat: 8.927059173583984 (5.663023334290636) | > loss_mel: 26.012178421020508 (23.81365698889682) | > loss_duration: 1.5414396524429321 (1.5087315973482633) | > loss_1: 39.72881317138672 (33.99861882862292) | > grad_norm_1: tensor(68613.9141, device='cuda:0') (tensor(37650.9297, device='cuda:0')) | > current_lr_0: 0.00011097229227185981 | > current_lr_1: 0.00011097229227185981 | > step_time: 0.3601 (0.6140711683976022) | > loader_time: 0.0064 (0.027483287610505756)  --> TIME: 2023-10-20 06:18:30 -- STEP: 49/50 -- GLOBAL_STEP: 82500 | > loss_disc: 2.7011256217956543 (2.518621743941793) | > loss_disc_real_0: 0.16203057765960693 (0.15008135890702207) | > loss_disc_real_1: 0.2788345515727997 (0.22606088509973216) | > loss_disc_real_2: 0.2734556496143341 (0.22138321836840133) | > loss_disc_real_3: 0.31261327862739563 (0.23683175383781901) | > loss_disc_real_4: 0.3198492228984833 (0.25003392407100417) | > loss_disc_real_5: 0.26085364818573 (0.25774247898739217) | > loss_0: 2.7011256217956543 (2.518621743941793) | > grad_norm_0: tensor(909.6432, device='cuda:0') (tensor(1087.9174, device='cuda:0')) | > loss_gen: 2.245266914367676 (2.2631703055634773) | > loss_kl: 0.42089909315109253 (0.8174150453842416) | > loss_feat: 2.477724552154541 (5.1045433987236155) | > loss_mel: 19.020471572875977 (21.629883228516093) | > loss_duration: 1.527869462966919 (1.467060568381329) | > loss_1: 25.69223403930664 (31.282072563560657) | > grad_norm_1: tensor(12824.0898, device='cuda:0') (tensor(32461.2676, device='cuda:0')) | > current_lr_0: 0.00011097229227185981 | > current_lr_1: 0.00011097229227185981 | > step_time: 0.6737 (0.5270346232822967) | > loader_time: 0.4186 (0.025427711253263513)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4821481704711914 (2.4821481704711914) | > loss_disc_real_0: 0.16668689250946045 (0.16668689250946045) | > loss_disc_real_1: 0.1803252398967743 (0.1803252398967743) | > loss_disc_real_2: 0.3265531361103058 (0.3265531361103058) | > loss_disc_real_3: 0.15882466733455658 (0.15882466733455658) | > loss_disc_real_4: 0.24411381781101227 (0.24411381781101227) | > loss_disc_real_5: 0.3173248767852783 (0.3173248767852783) | > loss_0: 2.4821481704711914 (2.4821481704711914) | > loss_gen: 2.3322014808654785 (2.3322014808654785) | > loss_kl: 3.161214590072632 (3.161214590072632) | > loss_feat: 6.6952080726623535 (6.6952080726623535) | > loss_mel: 23.226028442382812 (23.226028442382812) | > loss_duration: 2.6519315242767334 (2.6519315242767334) | > loss_1: 38.066585540771484 (38.066585540771484)  --> STEP: 1 | > loss_disc: 3.033386707305908 (3.033386707305908) | > loss_disc_real_0: 0.08577635884284973 (0.08577635884284973) | > loss_disc_real_1: 0.32454395294189453 (0.32454395294189453) | > loss_disc_real_2: 0.18392948806285858 (0.18392948806285858) | > loss_disc_real_3: 0.3359203040599823 (0.3359203040599823) | > loss_disc_real_4: 0.3662748336791992 (0.3662748336791992) | > loss_disc_real_5: 0.2947218716144562 (0.2947218716144562) | > loss_0: 3.033386707305908 (3.033386707305908) | > loss_gen: 1.8076939582824707 (1.8076939582824707) | > loss_kl: 3.884213924407959 (3.884213924407959) | > loss_feat: 3.693203926086426 (3.693203926086426) | > loss_mel: 24.11594581604004 (24.11594581604004) | > loss_duration: 2.9796042442321777 (2.9796042442321777) | > loss_1: 36.48065948486328 (36.48065948486328)  --> STEP: 2 | > loss_disc: 2.977261543273926 (3.005324125289917) | > loss_disc_real_0: 0.2416459321975708 (0.16371114552021027) | > loss_disc_real_1: 0.2675630748271942 (0.2960535138845444) | > loss_disc_real_2: 0.2826731204986572 (0.2333013042807579) | > loss_disc_real_3: 0.29532596468925476 (0.31562313437461853) | > loss_disc_real_4: 0.24971602857112885 (0.30799543112516403) | > loss_disc_real_5: 0.22399736940860748 (0.25935962051153183) | > loss_0: 2.977261543273926 (3.005324125289917) | > loss_gen: 1.5973396301269531 (1.702516794204712) | > loss_kl: 4.350481033325195 (4.117347478866577) | > loss_feat: 0.1627195179462433 (1.9279617220163345) | > loss_mel: 11.2815523147583 (17.69874906539917) | > loss_duration: 2.89646053314209 (2.938032388687134) | > loss_1: 20.288555145263672 (28.384607315063477)  --> STEP: 3 | > loss_disc: 2.4540581703186035 (2.821568806966146) | > loss_disc_real_0: 0.1564951241016388 (0.16130580504735312) | > loss_disc_real_1: 0.21492630243301392 (0.26901111006736755) | > loss_disc_real_2: 0.2631673216819763 (0.24325664341449738) | > loss_disc_real_3: 0.12271556258201599 (0.25132061044375104) | > loss_disc_real_4: 0.3617391884326935 (0.3259100168943405) | > loss_disc_real_5: 0.368501752614975 (0.29574033121267956) | > loss_0: 2.4540581703186035 (2.821568806966146) | > loss_gen: 2.371795177459717 (1.9256095886230469) | > loss_kl: 2.0941519737243652 (3.4429489771525064) | > loss_feat: 4.915335178375244 (2.923752874135971) | > loss_mel: 23.994298934936523 (19.79726568857829) | > loss_duration: 2.746364116668701 (2.8741429646809897) | > loss_1: 36.121944427490234 (30.963719685872395) --> EVAL PERFORMANCE | > avg_loader_time: 0.018065690994262695 (+0.014673391977945963) | > avg_loss_disc: 2.821568806966146 (+0.16879530747731541) | > avg_loss_disc_real_0: 0.16130580504735312 (-0.028667132059733064) | > avg_loss_disc_real_1: 0.26901111006736755 (+0.007974113027254759) | > avg_loss_disc_real_2: 0.24325664341449738 (+0.02566670874754587) | > avg_loss_disc_real_3: 0.25132061044375104 (+0.021193817257881192) | > avg_loss_disc_real_4: 0.3259100168943405 (+0.04721232752005261) | > avg_loss_disc_real_5: 0.29574033121267956 (+0.00417076051235199) | > avg_loss_0: 2.821568806966146 (+0.16879530747731541) | > avg_loss_gen: 1.9256095886230469 (-0.1855241457621255) | > avg_loss_kl: 3.4429489771525064 (-0.1328288714090986) | > avg_loss_feat: 2.923752874135971 (+0.24975295861562108) | > avg_loss_mel: 19.79726568857829 (+9.751298348108929) | > avg_loss_duration: 2.8741429646809897 (-0.028239727020263672) | > avg_loss_1: 30.963719685872395 (+9.654458999633789)  > EPOCH: 590/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:18:50)   --> TIME: 2023-10-20 06:19:15 -- STEP: 29/50 -- GLOBAL_STEP: 82530 | > loss_disc: 2.9266278743743896 (2.4299184042831947) | > loss_disc_real_0: 0.33799704909324646 (0.1499383828185242) | > loss_disc_real_1: 0.23095834255218506 (0.21740474487686978) | > loss_disc_real_2: 0.26577094197273254 (0.21609226691311803) | > loss_disc_real_3: 0.2188800573348999 (0.2194585586287852) | > loss_disc_real_4: 0.2542940676212311 (0.2179404390526229) | > loss_disc_real_5: 0.22399088740348816 (0.2274288640132752) | > loss_0: 2.9266278743743896 (2.4299184042831947) | > grad_norm_0: tensor(2964.5144, device='cuda:0') (tensor(1008.9006, device='cuda:0')) | > loss_gen: 1.6230922937393188 (2.2929702298394563) | > loss_kl: 0.767031729221344 (0.8787063999936499) | > loss_feat: 0.36557087302207947 (5.530381558655665) | > loss_mel: 18.927608489990234 (21.510354202369165) | > loss_duration: 1.490060567855835 (1.477574636196268) | > loss_1: 23.173364639282227 (31.68998672222269) | > grad_norm_1: tensor(39400.6484, device='cuda:0') (tensor(38592.2422, device='cuda:0')) | > current_lr_0: 0.0001108613685178301 | > current_lr_1: 0.0001108613685178301 | > step_time: 0.5933 (0.6037923631996944) | > loader_time: 0.0279 (0.01976869024079422)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8047809600830078 (1.8047809600830078) | > loss_disc_real_0: 0.09934397786855698 (0.09934397786855698) | > loss_disc_real_1: 0.17479272186756134 (0.17479272186756134) | > loss_disc_real_2: 0.13538779318332672 (0.13538779318332672) | > loss_disc_real_3: 0.23956002295017242 (0.23956002295017242) | > loss_disc_real_4: 0.12379757314920425 (0.12379757314920425) | > loss_disc_real_5: 0.08814029395580292 (0.08814029395580292) | > loss_0: 1.8047809600830078 (1.8047809600830078) | > loss_gen: 2.6508774757385254 (2.6508774757385254) | > loss_kl: 3.593297243118286 (3.593297243118286) | > loss_feat: 7.080093860626221 (7.080093860626221) | > loss_mel: 24.714717864990234 (24.714717864990234) | > loss_duration: 2.6077356338500977 (2.6077356338500977) | > loss_1: 40.64672088623047 (40.64672088623047)  --> STEP: 1 | > loss_disc: 2.301828384399414 (2.301828384399414) | > loss_disc_real_0: 0.1990731954574585 (0.1990731954574585) | > loss_disc_real_1: 0.19254913926124573 (0.19254913926124573) | > loss_disc_real_2: 0.29491525888442993 (0.29491525888442993) | > loss_disc_real_3: 0.16008636355400085 (0.16008636355400085) | > loss_disc_real_4: 0.12602612376213074 (0.12602612376213074) | > loss_disc_real_5: 0.07112456858158112 (0.07112456858158112) | > loss_0: 2.301828384399414 (2.301828384399414) | > loss_gen: 2.2736575603485107 (2.2736575603485107) | > loss_kl: 4.087510108947754 (4.087510108947754) | > loss_feat: 7.1617960929870605 (7.1617960929870605) | > loss_mel: 22.959001541137695 (22.959001541137695) | > loss_duration: 2.957498788833618 (2.957498788833618) | > loss_1: 39.4394645690918 (39.4394645690918)  --> STEP: 2 | > loss_disc: 2.1653988361358643 (2.233613610267639) | > loss_disc_real_0: 0.38307273387908936 (0.2910729646682739) | > loss_disc_real_1: 0.19539278745651245 (0.1939709633588791) | > loss_disc_real_2: 0.2048587054014206 (0.24988698214292526) | > loss_disc_real_3: 0.13479426503181458 (0.14744031429290771) | > loss_disc_real_4: 0.06868714839220047 (0.0973566360771656) | > loss_disc_real_5: 0.11241300404071808 (0.0917687863111496) | > loss_0: 2.1653988361358643 (2.233613610267639) | > loss_gen: 2.965984582901001 (2.619821071624756) | > loss_kl: 4.800827980041504 (4.444169044494629) | > loss_feat: 8.405336380004883 (7.783566236495972) | > loss_mel: 29.29802703857422 (26.128514289855957) | > loss_duration: 2.906763792037964 (2.932131290435791) | > loss_1: 48.3769416809082 (43.908203125)  --> STEP: 3 | > loss_disc: 3.8008437156677246 (2.756023645401001) | > loss_disc_real_0: 1.0428593158721924 (0.5416684150695801) | > loss_disc_real_1: 0.40457865595817566 (0.2641735275586446) | > loss_disc_real_2: 0.5712052583694458 (0.3569930742184321) | > loss_disc_real_3: 0.22396887838840485 (0.17294983565807343) | > loss_disc_real_4: 0.42297619581222534 (0.20589648932218552) | > loss_disc_real_5: 0.3535468280315399 (0.1790281335512797) | > loss_0: 3.8008437156677246 (2.756023645401001) | > loss_gen: 3.2598421573638916 (2.8331614335378013) | > loss_kl: 2.1428921222686768 (3.677076737085978) | > loss_feat: 3.644209623336792 (6.403780698776245) | > loss_mel: 20.526920318603516 (24.261316299438477) | > loss_duration: 2.7786710262298584 (2.8809778690338135) | > loss_1: 32.352535247802734 (40.056313832600914) --> EVAL PERFORMANCE | > avg_loader_time: 0.010889212290445963 (-0.007176478703816732) | > avg_loss_disc: 2.756023645401001 (-0.065545161565145) | > avg_loss_disc_real_0: 0.5416684150695801 (+0.38036261002222693) | > avg_loss_disc_real_1: 0.2641735275586446 (-0.00483758250872296) | > avg_loss_disc_real_2: 0.3569930742184321 (+0.11373643080393475) | > avg_loss_disc_real_3: 0.17294983565807343 (-0.07837077478567761) | > avg_loss_disc_real_4: 0.20589648932218552 (-0.120013527572155) | > avg_loss_disc_real_5: 0.1790281335512797 (-0.11671219766139987) | > avg_loss_0: 2.756023645401001 (-0.065545161565145) | > avg_loss_gen: 2.8331614335378013 (+0.9075518449147544) | > avg_loss_kl: 3.677076737085978 (+0.23412775993347168) | > avg_loss_feat: 6.403780698776245 (+3.480027824640274) | > avg_loss_mel: 24.261316299438477 (+4.464050610860188) | > avg_loss_duration: 2.8809778690338135 (+0.006834904352823745) | > avg_loss_1: 40.056313832600914 (+9.09259414672852)  > EPOCH: 591/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:19:43)   --> TIME: 2023-10-20 06:19:55 -- STEP: 9/50 -- GLOBAL_STEP: 82560 | > loss_disc: 2.9690887928009033 (2.7330349021487765) | > loss_disc_real_0: 0.07031674683094025 (0.26740005736549693) | > loss_disc_real_1: 0.29480114579200745 (0.30734597974353367) | > loss_disc_real_2: 0.21779267489910126 (0.3047854643728998) | > loss_disc_real_3: 0.2623223066329956 (0.3003858948747317) | > loss_disc_real_4: 0.21289347112178802 (0.23014815751877096) | > loss_disc_real_5: 0.2366563230752945 (0.25893308346470195) | > loss_0: 2.9690887928009033 (2.7330349021487765) | > grad_norm_0: tensor(7294.4272, device='cuda:0') (tensor(1943.1626, device='cuda:0')) | > loss_gen: 1.520570158958435 (2.4458849694993763) | > loss_kl: 0.9581526517868042 (0.7077512774202559) | > loss_feat: 0.41001906991004944 (5.278189142545064) | > loss_mel: 12.967399597167969 (19.33690827422672) | > loss_duration: 1.4044595956802368 (1.438196923997667) | > loss_1: 17.260601043701172 (29.206930266486275) | > grad_norm_1: tensor(31074.4180, device='cuda:0') (tensor(52308.5898, device='cuda:0')) | > current_lr_0: 0.0001107505556390374 | > current_lr_1: 0.0001107505556390374 | > step_time: 1.1275 (0.5510376029544406) | > loader_time: 0.0317 (0.013864888085259331)  --> TIME: 2023-10-20 06:20:09 -- STEP: 39/50 -- GLOBAL_STEP: 82590 | > loss_disc: 2.700594663619995 (2.472536120659266) | > loss_disc_real_0: 0.18268895149230957 (0.18081756299122786) | > loss_disc_real_1: 0.40655016899108887 (0.24087596379029444) | > loss_disc_real_2: 0.28493204712867737 (0.24349786283878183) | > loss_disc_real_3: 0.2991665303707123 (0.25172480768882305) | > loss_disc_real_4: 0.274004191160202 (0.2112888007496412) | > loss_disc_real_5: 0.2912341058254242 (0.21162371046076983) | > loss_0: 2.700594663619995 (2.472536120659266) | > grad_norm_0: tensor(1375.9570, device='cuda:0') (tensor(1222.8894, device='cuda:0')) | > loss_gen: 2.3091816902160645 (2.3720967708489833) | > loss_kl: 0.44222986698150635 (0.7501782499826871) | > loss_feat: 2.261183023452759 (5.723232805346833) | > loss_mel: 20.368144989013672 (21.04180821088644) | > loss_duration: 1.4451290369033813 (1.4507894149193399) | > loss_1: 26.825868606567383 (31.338105629651974) | > grad_norm_1: tensor(7348.3379, device='cuda:0') (tensor(45924.2812, device='cuda:0')) | > current_lr_0: 0.0001107505556390374 | > current_lr_1: 0.0001107505556390374 | > step_time: 0.4786 (0.4806684714097243) | > loader_time: 0.0254 (0.014930346073248448)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4029605388641357 (2.4029605388641357) | > loss_disc_real_0: 0.04359510913491249 (0.04359510913491249) | > loss_disc_real_1: 0.15110541880130768 (0.15110541880130768) | > loss_disc_real_2: 0.12379097193479538 (0.12379097193479538) | > loss_disc_real_3: 0.1270846724510193 (0.1270846724510193) | > loss_disc_real_4: 0.02098565362393856 (0.02098565362393856) | > loss_disc_real_5: 0.1827687919139862 (0.1827687919139862) | > loss_0: 2.4029605388641357 (2.4029605388641357) | > loss_gen: 1.4611889123916626 (1.4611889123916626) | > loss_kl: 4.151256084442139 (4.151256084442139) | > loss_feat: 9.160335540771484 (9.160335540771484) | > loss_mel: 24.65532875061035 (24.65532875061035) | > loss_duration: 2.6629841327667236 (2.6629841327667236) | > loss_1: 42.09109115600586 (42.09109115600586)  --> STEP: 1 | > loss_disc: 2.838305950164795 (2.838305950164795) | > loss_disc_real_0: 0.21803802251815796 (0.21803802251815796) | > loss_disc_real_1: 0.39324304461479187 (0.39324304461479187) | > loss_disc_real_2: 0.209783673286438 (0.209783673286438) | > loss_disc_real_3: 0.2904084324836731 (0.2904084324836731) | > loss_disc_real_4: 0.44131267070770264 (0.44131267070770264) | > loss_disc_real_5: 0.3253767490386963 (0.3253767490386963) | > loss_0: 2.838305950164795 (2.838305950164795) | > loss_gen: 2.474524736404419 (2.474524736404419) | > loss_kl: 4.307738304138184 (4.307738304138184) | > loss_feat: 4.820586681365967 (4.820586681365967) | > loss_mel: 25.25079345703125 (25.25079345703125) | > loss_duration: 2.9868061542510986 (2.9868061542510986) | > loss_1: 39.840450286865234 (39.840450286865234)  --> STEP: 2 | > loss_disc: 2.587059497833252 (2.7126827239990234) | > loss_disc_real_0: 0.1337698996067047 (0.17590396106243134) | > loss_disc_real_1: 0.3433662950992584 (0.36830466985702515) | > loss_disc_real_2: 0.15675199031829834 (0.18326783180236816) | > loss_disc_real_3: 0.26862791180610657 (0.27951817214488983) | > loss_disc_real_4: 0.3490336835384369 (0.39517317712306976) | > loss_disc_real_5: 0.3390038013458252 (0.33219027519226074) | > loss_0: 2.587059497833252 (2.7126827239990234) | > loss_gen: 2.405606269836426 (2.4400655031204224) | > loss_kl: 4.272430419921875 (4.290084362030029) | > loss_feat: 4.950647830963135 (4.885617256164551) | > loss_mel: 27.55047035217285 (26.40063190460205) | > loss_duration: 2.8157119750976562 (2.9012590646743774) | > loss_1: 41.99486541748047 (40.91765785217285)  --> STEP: 3 | > loss_disc: 2.5901756286621094 (2.6718470255533853) | > loss_disc_real_0: 0.0635766014456749 (0.13846150785684586) | > loss_disc_real_1: 0.138601154088974 (0.29173683126767475) | > loss_disc_real_2: 0.0853624939918518 (0.1506327191988627) | > loss_disc_real_3: 0.1550493985414505 (0.23802858094374338) | > loss_disc_real_4: 0.017599036917090416 (0.2693151303877433) | > loss_disc_real_5: 0.191859632730484 (0.2854133943716685) | > loss_0: 2.5901756286621094 (2.6718470255533853) | > loss_gen: 1.561009168624878 (2.1470467249552407) | > loss_kl: 2.369251012802124 (3.649806578954061) | > loss_feat: 7.196536064147949 (5.655923525492351) | > loss_mel: 24.1961727142334 (25.665812174479168) | > loss_duration: 2.801737070083618 (2.8680850664774575) | > loss_1: 38.12470626831055 (39.986673990885414) --> EVAL PERFORMANCE | > avg_loader_time: 0.004083792368570964 (-0.006805419921874999) | > avg_loss_disc: 2.6718470255533853 (-0.08417661984761571) | > avg_loss_disc_real_0: 0.13846150785684586 (-0.4032069072127342) | > avg_loss_disc_real_1: 0.29173683126767475 (+0.02756330370903015) | > avg_loss_disc_real_2: 0.1506327191988627 (-0.20636035501956942) | > avg_loss_disc_real_3: 0.23802858094374338 (+0.06507874528566995) | > avg_loss_disc_real_4: 0.2693151303877433 (+0.06341864106555778) | > avg_loss_disc_real_5: 0.2854133943716685 (+0.10638526082038882) | > avg_loss_0: 2.6718470255533853 (-0.08417661984761571) | > avg_loss_gen: 2.1470467249552407 (-0.6861147085825605) | > avg_loss_kl: 3.649806578954061 (-0.02727015813191702) | > avg_loss_feat: 5.655923525492351 (-0.7478571732838946) | > avg_loss_mel: 25.665812174479168 (+1.4044958750406913) | > avg_loss_duration: 2.8680850664774575 (-0.012892802556355942) | > avg_loss_1: 39.986673990885414 (-0.06963984171549953)  > EPOCH: 592/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:20:35)   --> TIME: 2023-10-20 06:20:51 -- STEP: 19/50 -- GLOBAL_STEP: 82620 | > loss_disc: 1.7350428104400635 (2.5739502844057585) | > loss_disc_real_0: 0.06713166832923889 (0.17928341383996763) | > loss_disc_real_1: 0.0795389860868454 (0.2246563560084293) | > loss_disc_real_2: 0.1253330260515213 (0.23283252669008156) | > loss_disc_real_3: 0.22839440405368805 (0.2723223951302077) | > loss_disc_real_4: 0.03547641262412071 (0.23426725538937668) | > loss_disc_real_5: 0.04732593894004822 (0.2352572222681422) | > loss_0: 1.7350428104400635 (2.5739502844057585) | > grad_norm_0: tensor(253.7121, device='cuda:0') (tensor(1632.9210, device='cuda:0')) | > loss_gen: 2.494598388671875 (2.1584639298288444) | > loss_kl: 1.0698590278625488 (0.8834324526159387) | > loss_feat: 10.22822093963623 (4.064359275624156) | > loss_mel: 26.166362762451172 (19.00720604156193) | > loss_duration: 1.5509322881698608 (1.499741228003251) | > loss_1: 41.50997543334961 (27.613203149092826) | > grad_norm_1: tensor(16123.2070, device='cuda:0') (tensor(27060.4023, device='cuda:0')) | > current_lr_0: 0.00011063985352465495 | > current_lr_1: 0.00011063985352465495 | > step_time: 0.5457 (0.6286375522613525) | > loader_time: 0.0064 (0.023318253065410414)  --> TIME: 2023-10-20 06:21:10 -- STEP: 49/50 -- GLOBAL_STEP: 82650 | > loss_disc: 2.931657314300537 (2.433568565212951) | > loss_disc_real_0: 0.255181223154068 (0.1601206423068533) | > loss_disc_real_1: 0.2751743495464325 (0.21673693131579427) | > loss_disc_real_2: 0.2980354130268097 (0.2096740351039536) | > loss_disc_real_3: 0.2654286026954651 (0.233853850589723) | > loss_disc_real_4: 0.2377004623413086 (0.23026874098850755) | > loss_disc_real_5: 0.2677335739135742 (0.22953633270321452) | > loss_0: 2.931657314300537 (2.433568565212951) | > grad_norm_0: tensor(1117.5115, device='cuda:0') (tensor(979.7673, device='cuda:0')) | > loss_gen: 1.6777446269989014 (2.3164557169894775) | > loss_kl: 0.3484187126159668 (0.8419983283597596) | > loss_feat: 0.5619214177131653 (5.17846768566084) | > loss_mel: 19.16299057006836 (20.885017262429603) | > loss_duration: 1.5318918228149414 (1.4569824471765636) | > loss_1: 23.28296661376953 (30.678921855225855) | > grad_norm_1: tensor(9675.1045, device='cuda:0') (tensor(22336.7363, device='cuda:0')) | > current_lr_0: 0.00011063985352465495 | > current_lr_1: 0.00011063985352465495 | > step_time: 0.2547 (0.6123649782064008) | > loader_time: 0.3434 (0.028319237183551393)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.019355535507202 (2.019355535507202) | > loss_disc_real_0: 0.06177879497408867 (0.06177879497408867) | > loss_disc_real_1: 0.22665220499038696 (0.22665220499038696) | > loss_disc_real_2: 0.22558347880840302 (0.22558347880840302) | > loss_disc_real_3: 0.2350439727306366 (0.2350439727306366) | > loss_disc_real_4: 0.1141936406493187 (0.1141936406493187) | > loss_disc_real_5: 0.22533845901489258 (0.22533845901489258) | > loss_0: 2.019355535507202 (2.019355535507202) | > loss_gen: 2.477651834487915 (2.477651834487915) | > loss_kl: 4.076602458953857 (4.076602458953857) | > loss_feat: 9.312501907348633 (9.312501907348633) | > loss_mel: 26.196392059326172 (26.196392059326172) | > loss_duration: 2.7018682956695557 (2.7018682956695557) | > loss_1: 44.765018463134766 (44.765018463134766)  --> STEP: 1 | > loss_disc: 2.9520397186279297 (2.9520397186279297) | > loss_disc_real_0: 0.34896862506866455 (0.34896862506866455) | > loss_disc_real_1: 0.2625407874584198 (0.2625407874584198) | > loss_disc_real_2: 0.2504117488861084 (0.2504117488861084) | > loss_disc_real_3: 0.2561226487159729 (0.2561226487159729) | > loss_disc_real_4: 0.23610083758831024 (0.23610083758831024) | > loss_disc_real_5: 0.26371529698371887 (0.26371529698371887) | > loss_0: 2.9520397186279297 (2.9520397186279297) | > loss_gen: 1.7102099657058716 (1.7102099657058716) | > loss_kl: 3.649794101715088 (3.649794101715088) | > loss_feat: 0.23693478107452393 (0.23693478107452393) | > loss_mel: 13.030693054199219 (13.030693054199219) | > loss_duration: 3.0470709800720215 (3.0470709800720215) | > loss_1: 21.67470359802246 (21.67470359802246)  --> STEP: 2 | > loss_disc: 2.2431013584136963 (2.597570538520813) | > loss_disc_real_0: 0.15433469414710999 (0.25165165960788727) | > loss_disc_real_1: 0.1712263524532318 (0.2168835699558258) | > loss_disc_real_2: 0.3311710059642792 (0.2907913774251938) | > loss_disc_real_3: 0.2613023519515991 (0.258712500333786) | > loss_disc_real_4: 0.21527785062789917 (0.2256893441081047) | > loss_disc_real_5: 0.23452477157115936 (0.24912003427743912) | > loss_0: 2.2431013584136963 (2.597570538520813) | > loss_gen: 2.7581658363342285 (2.23418790102005) | > loss_kl: 4.0514326095581055 (3.8506133556365967) | > loss_feat: 8.87157154083252 (4.554253160953522) | > loss_mel: 24.254413604736328 (18.642553329467773) | > loss_duration: 2.95994234085083 (3.003506660461426) | > loss_1: 42.89552688598633 (32.285115242004395)  --> STEP: 3 | > loss_disc: 2.889378070831299 (2.6948397159576416) | > loss_disc_real_0: 0.11589847505092621 (0.20640059808890024) | > loss_disc_real_1: 0.42162710428237915 (0.28513141473134357) | > loss_disc_real_2: 0.44447776675224304 (0.3420201738675435) | > loss_disc_real_3: 0.2712400555610657 (0.2628883520762126) | > loss_disc_real_4: 0.4128541350364685 (0.28807760775089264) | > loss_disc_real_5: 0.5038185715675354 (0.3340195467074712) | > loss_0: 2.889378070831299 (2.6948397159576416) | > loss_gen: 2.8473587036132812 (2.438578168551127) | > loss_kl: 1.837945580482483 (3.179724097251892) | > loss_feat: 4.393340110778809 (4.500615477561951) | > loss_mel: 20.628986358642578 (19.304697672526043) | > loss_duration: 2.819328546524048 (2.9421139558156333) | > loss_1: 32.52695846557617 (32.365729649861656) --> EVAL PERFORMANCE | > avg_loader_time: 0.0032195250193277993 (-0.0008642673492431645) | > avg_loss_disc: 2.6948397159576416 (+0.022992690404256333) | > avg_loss_disc_real_0: 0.20640059808890024 (+0.06793909023205438) | > avg_loss_disc_real_1: 0.28513141473134357 (-0.006605416536331177) | > avg_loss_disc_real_2: 0.3420201738675435 (+0.19138745466868082) | > avg_loss_disc_real_3: 0.2628883520762126 (+0.024859771132469205) | > avg_loss_disc_real_4: 0.28807760775089264 (+0.018762477363149344) | > avg_loss_disc_real_5: 0.3340195467074712 (+0.04860615233580268) | > avg_loss_0: 2.6948397159576416 (+0.022992690404256333) | > avg_loss_gen: 2.438578168551127 (+0.29153144359588623) | > avg_loss_kl: 3.179724097251892 (-0.47008248170216893) | > avg_loss_feat: 4.500615477561951 (-1.1553080479303999) | > avg_loss_mel: 19.304697672526043 (-6.361114501953125) | > avg_loss_duration: 2.9421139558156333 (+0.07402888933817575) | > avg_loss_1: 32.365729649861656 (-7.620944341023758)  > EPOCH: 593/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:21:24)   --> TIME: 2023-10-20 06:21:52 -- STEP: 29/50 -- GLOBAL_STEP: 82680 | > loss_disc: 3.0029711723327637 (2.312932232330585) | > loss_disc_real_0: 0.39491549134254456 (0.14763164266558557) | > loss_disc_real_1: 0.3133833706378937 (0.22979993334618107) | > loss_disc_real_2: 0.30177226662635803 (0.23772313741260562) | > loss_disc_real_3: 0.23908942937850952 (0.23584745297658033) | > loss_disc_real_4: 0.1738918572664261 (0.19151823813545293) | > loss_disc_real_5: 0.2014826238155365 (0.20791739964022718) | > loss_0: 3.0029711723327637 (2.312932232330585) | > grad_norm_0: tensor(971.3939, device='cuda:0') (tensor(660.1980, device='cuda:0')) | > loss_gen: 1.6587830781936646 (2.6009596750654023) | > loss_kl: 1.075075626373291 (0.8509628043092531) | > loss_feat: 0.3507158160209656 (6.526864228577449) | > loss_mel: 15.743837356567383 (23.17682591800032) | > loss_duration: 1.4670363664627075 (1.4648130145566216) | > loss_1: 20.295448303222656 (34.62042565181336) | > grad_norm_1: tensor(7569.1465, device='cuda:0') (tensor(25248.1660, device='cuda:0')) | > current_lr_0: 0.00011052926206396685 | > current_lr_1: 0.00011052926206396685 | > step_time: 0.5575 (0.6085518804089777) | > loader_time: 0.0045 (0.02292562353199926)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8943912982940674 (2.8943912982940674) | > loss_disc_real_0: 0.3339865505695343 (0.3339865505695343) | > loss_disc_real_1: 0.27720773220062256 (0.27720773220062256) | > loss_disc_real_2: 0.2683481276035309 (0.2683481276035309) | > loss_disc_real_3: 0.2809518575668335 (0.2809518575668335) | > loss_disc_real_4: 0.23362718522548676 (0.23362718522548676) | > loss_disc_real_5: 0.24736706912517548 (0.24736706912517548) | > loss_0: 2.8943912982940674 (2.8943912982940674) | > loss_gen: 1.9437867403030396 (1.9437867403030396) | > loss_kl: 3.9577572345733643 (3.9577572345733643) | > loss_feat: 2.2093944549560547 (2.2093944549560547) | > loss_mel: 15.268747329711914 (15.268747329711914) | > loss_duration: 2.6750781536102295 (2.6750781536102295) | > loss_1: 26.05476188659668 (26.05476188659668)  --> STEP: 1 | > loss_disc: 2.6793673038482666 (2.6793673038482666) | > loss_disc_real_0: 0.3281708359718323 (0.3281708359718323) | > loss_disc_real_1: 0.39322102069854736 (0.39322102069854736) | > loss_disc_real_2: 0.3194318413734436 (0.3194318413734436) | > loss_disc_real_3: 0.44388070702552795 (0.44388070702552795) | > loss_disc_real_4: 0.338142067193985 (0.338142067193985) | > loss_disc_real_5: 0.28530558943748474 (0.28530558943748474) | > loss_0: 2.6793673038482666 (2.6793673038482666) | > loss_gen: 3.546367645263672 (3.546367645263672) | > loss_kl: 4.694427490234375 (4.694427490234375) | > loss_feat: 7.582440376281738 (7.582440376281738) | > loss_mel: 23.98470687866211 (23.98470687866211) | > loss_duration: 2.932011842727661 (2.932011842727661) | > loss_1: 42.739952087402344 (42.739952087402344)  --> STEP: 2 | > loss_disc: 1.9954217672348022 (2.3373945355415344) | > loss_disc_real_0: 0.23533335328102112 (0.2817520946264267) | > loss_disc_real_1: 0.2814989387989044 (0.3373599797487259) | > loss_disc_real_2: 0.21454010903835297 (0.2669859752058983) | > loss_disc_real_3: 0.21580778062343597 (0.32984424382448196) | > loss_disc_real_4: 0.10215545445680618 (0.22014876082539558) | > loss_disc_real_5: 0.20228485763072968 (0.2437952235341072) | > loss_0: 1.9954217672348022 (2.3373945355415344) | > loss_gen: 3.2430105209350586 (3.3946890830993652) | > loss_kl: 4.669077396392822 (4.681752443313599) | > loss_feat: 8.99351978302002 (8.287980079650879) | > loss_mel: 23.836685180664062 (23.910696029663086) | > loss_duration: 2.8288016319274902 (2.8804067373275757) | > loss_1: 43.57109451293945 (43.1555233001709)  --> STEP: 3 | > loss_disc: 2.985901355743408 (2.5535634756088257) | > loss_disc_real_0: 0.4149794578552246 (0.3261612157026927) | > loss_disc_real_1: 0.3735171854496002 (0.34941238164901733) | > loss_disc_real_2: 0.333283394575119 (0.28908511499563855) | > loss_disc_real_3: 0.3200976252555847 (0.32659537096818286) | > loss_disc_real_4: 0.30008307099342346 (0.24679353088140488) | > loss_disc_real_5: 0.292261004447937 (0.25995048383871716) | > loss_0: 2.985901355743408 (2.5535634756088257) | > loss_gen: 2.8076248168945312 (3.1990009943644204) | > loss_kl: 2.0405995845794678 (3.801368157068888) | > loss_feat: 3.41756010055542 (6.664506753285726) | > loss_mel: 25.311866760253906 (24.377752939860027) | > loss_duration: 2.7958738803863525 (2.852229118347168) | > loss_1: 36.37352752685547 (40.894858042399086) --> EVAL PERFORMANCE | > avg_loader_time: 0.011772235234578451 (+0.008552710215250652) | > avg_loss_disc: 2.5535634756088257 (-0.14127624034881592) | > avg_loss_disc_real_0: 0.3261612157026927 (+0.11976061761379245) | > avg_loss_disc_real_1: 0.34941238164901733 (+0.06428096691767377) | > avg_loss_disc_real_2: 0.28908511499563855 (-0.05293505887190497) | > avg_loss_disc_real_3: 0.32659537096818286 (+0.06370701889197028) | > avg_loss_disc_real_4: 0.24679353088140488 (-0.04128407686948776) | > avg_loss_disc_real_5: 0.25995048383871716 (-0.07406906286875403) | > avg_loss_0: 2.5535634756088257 (-0.14127624034881592) | > avg_loss_gen: 3.1990009943644204 (+0.7604228258132935) | > avg_loss_kl: 3.801368157068888 (+0.6216440598169961) | > avg_loss_feat: 6.664506753285726 (+2.163891275723775) | > avg_loss_mel: 24.377752939860027 (+5.073055267333984) | > avg_loss_duration: 2.852229118347168 (-0.08988483746846532) | > avg_loss_1: 40.894858042399086 (+8.52912839253743)  > EPOCH: 594/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:22:22)   --> TIME: 2023-10-20 06:22:31 -- STEP: 9/50 -- GLOBAL_STEP: 82710 | > loss_disc: 2.8276655673980713 (2.4378373755349054) | > loss_disc_real_0: 0.1976335346698761 (0.14659343494309318) | > loss_disc_real_1: 0.18835151195526123 (0.23052941097153556) | > loss_disc_real_2: 0.23179608583450317 (0.25537282476822537) | > loss_disc_real_3: 0.3435954749584198 (0.24786556719077957) | > loss_disc_real_4: 0.2108987420797348 (0.24938364616698688) | > loss_disc_real_5: 0.3633728623390198 (0.2698245048522949) | > loss_0: 2.8276655673980713 (2.4378373755349054) | > grad_norm_0: tensor(383.7104, device='cuda:0') (tensor(655.3950, device='cuda:0')) | > loss_gen: 2.0119404792785645 (2.578593452771505) | > loss_kl: 0.9652639627456665 (0.8889365759160783) | > loss_feat: 3.3651926517486572 (5.297123214436902) | > loss_mel: 11.90410327911377 (17.915884733200073) | > loss_duration: 1.3886981010437012 (1.4535472922854953) | > loss_1: 19.63519859313965 (28.13408523135715) | > grad_norm_1: tensor(39529.2930, device='cuda:0') (tensor(31388.9824, device='cuda:0')) | > current_lr_0: 0.00011041878114636775 | > current_lr_1: 0.00011041878114636775 | > step_time: 0.4557 (0.47653235329522026) | > loader_time: 0.0031 (0.01172743903266059)  --> TIME: 2023-10-20 06:22:51 -- STEP: 39/50 -- GLOBAL_STEP: 82740 | > loss_disc: 2.1616363525390625 (2.533206603465936) | > loss_disc_real_0: 0.10166619718074799 (0.1644659808430916) | > loss_disc_real_1: 0.18688257038593292 (0.244645482645585) | > loss_disc_real_2: 0.22708868980407715 (0.2525861830665515) | > loss_disc_real_3: 0.1372741460800171 (0.24508242452373866) | > loss_disc_real_4: 0.11385767161846161 (0.23324758387528932) | > loss_disc_real_5: 0.07043255865573883 (0.21886692931636786) | > loss_0: 2.1616363525390625 (2.533206603465936) | > grad_norm_0: tensor(744.6342, device='cuda:0') (tensor(594.0186, device='cuda:0')) | > loss_gen: 2.329228162765503 (2.36826222982162) | > loss_kl: 0.8787599802017212 (0.8444773096304673) | > loss_feat: 7.611941337585449 (5.392598093606723) | > loss_mel: 20.832807540893555 (20.107161888709424) | > loss_duration: 1.5042798519134521 (1.4532768328984578) | > loss_1: 33.15701675415039 (30.1657760204413) | > grad_norm_1: tensor(49414.3867, device='cuda:0') (tensor(28735.0938, device='cuda:0')) | > current_lr_0: 0.00011041878114636775 | > current_lr_1: 0.00011041878114636775 | > step_time: 0.7011 (0.6116790832617345) | > loader_time: 0.0384 (0.018449013049785905)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.902859687805176 (2.902859687805176) | > loss_disc_real_0: 0.47888466715812683 (0.47888466715812683) | > loss_disc_real_1: 0.2696044445037842 (0.2696044445037842) | > loss_disc_real_2: 0.28315818309783936 (0.28315818309783936) | > loss_disc_real_3: 0.2491167038679123 (0.2491167038679123) | > loss_disc_real_4: 0.2603033483028412 (0.2603033483028412) | > loss_disc_real_5: 0.37156835198402405 (0.37156835198402405) | > loss_0: 2.902859687805176 (2.902859687805176) | > loss_gen: 2.570312023162842 (2.570312023162842) | > loss_kl: 4.419078826904297 (4.419078826904297) | > loss_feat: 3.652374029159546 (3.652374029159546) | > loss_mel: 23.345733642578125 (23.345733642578125) | > loss_duration: 2.6303648948669434 (2.6303648948669434) | > loss_1: 36.617862701416016 (36.617862701416016)  --> STEP: 1 | > loss_disc: 2.61197566986084 (2.61197566986084) | > loss_disc_real_0: 0.21220403909683228 (0.21220403909683228) | > loss_disc_real_1: 0.32302558422088623 (0.32302558422088623) | > loss_disc_real_2: 0.2730361819267273 (0.2730361819267273) | > loss_disc_real_3: 0.25762826204299927 (0.25762826204299927) | > loss_disc_real_4: 0.2758791744709015 (0.2758791744709015) | > loss_disc_real_5: 0.38438931107521057 (0.38438931107521057) | > loss_0: 2.61197566986084 (2.61197566986084) | > loss_gen: 2.6884171962738037 (2.6884171962738037) | > loss_kl: 4.973915100097656 (4.973915100097656) | > loss_feat: 5.917357921600342 (5.917357921600342) | > loss_mel: 27.841100692749023 (27.841100692749023) | > loss_duration: 3.046485424041748 (3.046485424041748) | > loss_1: 44.46727752685547 (44.46727752685547)  --> STEP: 2 | > loss_disc: 2.4557671546936035 (2.5338714122772217) | > loss_disc_real_0: 0.5536999702453613 (0.3829520046710968) | > loss_disc_real_1: 0.17591451108455658 (0.2494700476527214) | > loss_disc_real_2: 0.16863495111465454 (0.22083556652069092) | > loss_disc_real_3: 0.1615234911441803 (0.20957587659358978) | > loss_disc_real_4: 0.15836437046527863 (0.21712177246809006) | > loss_disc_real_5: 0.23342421650886536 (0.30890676379203796) | > loss_0: 2.4557671546936035 (2.5338714122772217) | > loss_gen: 3.3806962966918945 (3.034556746482849) | > loss_kl: 4.458484172821045 (4.716199636459351) | > loss_feat: 9.820123672485352 (7.868740797042847) | > loss_mel: 25.713031768798828 (26.777066230773926) | > loss_duration: 2.9162826538085938 (2.981384038925171) | > loss_1: 46.28861618041992 (45.377946853637695)  --> STEP: 3 | > loss_disc: 1.9646779298782349 (2.3441402514775596) | > loss_disc_real_0: 0.5014551281929016 (0.42245304584503174) | > loss_disc_real_1: 0.34742027521133423 (0.28212012350559235) | > loss_disc_real_2: 0.08377346396446228 (0.17514819900194803) | > loss_disc_real_3: 0.09788208454847336 (0.17234461257855097) | > loss_disc_real_4: 0.11884931474924088 (0.184364286561807) | > loss_disc_real_5: 0.18962769210338593 (0.26914707322915393) | > loss_0: 1.9646779298782349 (2.3441402514775596) | > loss_gen: 3.6065239906311035 (3.225212494532267) | > loss_kl: 2.037553548812866 (3.823317607243856) | > loss_feat: 8.296250343322754 (8.011243979136148) | > loss_mel: 24.409725189208984 (25.987952550252277) | > loss_duration: 2.8139331340789795 (2.925567070643107) | > loss_1: 41.16399002075195 (43.97329457600912) --> EVAL PERFORMANCE | > avg_loader_time: 0.009492715199788412 (-0.002279520034790039) | > avg_loss_disc: 2.3441402514775596 (-0.20942322413126613) | > avg_loss_disc_real_0: 0.42245304584503174 (+0.09629183014233905) | > avg_loss_disc_real_1: 0.28212012350559235 (-0.06729225814342499) | > avg_loss_disc_real_2: 0.17514819900194803 (-0.11393691599369052) | > avg_loss_disc_real_3: 0.17234461257855097 (-0.1542507583896319) | > avg_loss_disc_real_4: 0.184364286561807 (-0.06242924431959787) | > avg_loss_disc_real_5: 0.26914707322915393 (+0.009196589390436771) | > avg_loss_0: 2.3441402514775596 (-0.20942322413126613) | > avg_loss_gen: 3.225212494532267 (+0.02621150016784668) | > avg_loss_kl: 3.823317607243856 (+0.021949450174967744) | > avg_loss_feat: 8.011243979136148 (+1.3467372258504229) | > avg_loss_mel: 25.987952550252277 (+1.6101996103922502) | > avg_loss_duration: 2.925567070643107 (+0.07333795229593898) | > avg_loss_1: 43.97329457600912 (+3.078436533610031)  > EPOCH: 595/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:23:10)   --> TIME: 2023-10-20 06:23:27 -- STEP: 19/50 -- GLOBAL_STEP: 82770 | > loss_disc: 2.855264186859131 (2.4560681205046806) | > loss_disc_real_0: 0.22391651570796967 (0.14641845814491572) | > loss_disc_real_1: 0.24057385325431824 (0.2157172701860729) | > loss_disc_real_2: 0.22087933123111725 (0.22702530046042643) | > loss_disc_real_3: 0.33858034014701843 (0.23641896326290934) | > loss_disc_real_4: 0.23801986873149872 (0.22401113264066608) | > loss_disc_real_5: 0.2915283441543579 (0.25551680848002434) | > loss_0: 2.855264186859131 (2.4560681205046806) | > grad_norm_0: tensor(560.4931, device='cuda:0') (tensor(576.2011, device='cuda:0')) | > loss_gen: 1.885260820388794 (2.428029725426122) | > loss_kl: 1.2379056215286255 (0.7869468268595243) | > loss_feat: 2.533088207244873 (6.191360730089639) | > loss_mel: 22.180545806884766 (23.12241102519788) | > loss_duration: 1.5602561235427856 (1.478459866423356) | > loss_1: 29.397058486938477 (34.00720897473787) | > grad_norm_1: tensor(2282.5576, device='cuda:0') (tensor(22361.7637, device='cuda:0')) | > current_lr_0: 0.00011030841066136294 | > current_lr_1: 0.00011030841066136294 | > step_time: 0.7885 (0.5761708836806448) | > loader_time: 0.0044 (0.02385376629076506)  --> TIME: 2023-10-20 06:23:48 -- STEP: 49/50 -- GLOBAL_STEP: 82800 | > loss_disc: 2.5123324394226074 (2.4496335277752013) | > loss_disc_real_0: 0.16127605736255646 (0.15002708692027594) | > loss_disc_real_1: 0.19426679611206055 (0.22215472420259397) | > loss_disc_real_2: 0.18169157207012177 (0.22640132067763075) | > loss_disc_real_3: 0.19987249374389648 (0.23204077065599207) | > loss_disc_real_4: 0.17775125801563263 (0.23591550000544106) | > loss_disc_real_5: 0.19843026995658875 (0.2601378373801708) | > loss_0: 2.5123324394226074 (2.4496335277752013) | > grad_norm_0: tensor(367.6506, device='cuda:0') (tensor(566.6410, device='cuda:0')) | > loss_gen: 1.8886194229125977 (2.389227256482962) | > loss_kl: 0.3813569247722626 (0.8076346486198659) | > loss_feat: 3.074772357940674 (5.575932390531715) | > loss_mel: 19.003408432006836 (21.23841160170886) | > loss_duration: 1.6014970541000366 (1.4465087676534847) | > loss_1: 25.94965362548828 (31.457714781469228) | > grad_norm_1: tensor(7908.8521, device='cuda:0') (tensor(19509.1367, device='cuda:0')) | > current_lr_0: 0.00011030841066136294 | > current_lr_1: 0.00011030841066136294 | > step_time: 1.071 (0.6235337160071548) | > loader_time: 0.4649 (0.02932451209243463)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.837130069732666 (2.837130069732666) | > loss_disc_real_0: 0.11653085052967072 (0.11653085052967072) | > loss_disc_real_1: 0.2580348253250122 (0.2580348253250122) | > loss_disc_real_2: 0.25484511256217957 (0.25484511256217957) | > loss_disc_real_3: 0.12733657658100128 (0.12733657658100128) | > loss_disc_real_4: 0.39880383014678955 (0.39880383014678955) | > loss_disc_real_5: 0.36591365933418274 (0.36591365933418274) | > loss_0: 2.837130069732666 (2.837130069732666) | > loss_gen: 2.361769676208496 (2.361769676208496) | > loss_kl: 3.935549259185791 (3.935549259185791) | > loss_feat: 7.593146800994873 (7.593146800994873) | > loss_mel: 24.84831428527832 (24.84831428527832) | > loss_duration: 2.693610906600952 (2.693610906600952) | > loss_1: 41.43239212036133 (41.43239212036133)  --> STEP: 1 | > loss_disc: 2.3728904724121094 (2.3728904724121094) | > loss_disc_real_0: 0.10856442898511887 (0.10856442898511887) | > loss_disc_real_1: 0.2535167932510376 (0.2535167932510376) | > loss_disc_real_2: 0.35683029890060425 (0.35683029890060425) | > loss_disc_real_3: 0.1378185898065567 (0.1378185898065567) | > loss_disc_real_4: 0.2828221321105957 (0.2828221321105957) | > loss_disc_real_5: 0.2060943841934204 (0.2060943841934204) | > loss_0: 2.3728904724121094 (2.3728904724121094) | > loss_gen: 2.69893741607666 (2.69893741607666) | > loss_kl: 4.439346790313721 (4.439346790313721) | > loss_feat: 6.155039310455322 (6.155039310455322) | > loss_mel: 27.41721534729004 (27.41721534729004) | > loss_duration: 2.9770970344543457 (2.9770970344543457) | > loss_1: 43.6876335144043 (43.6876335144043)  --> STEP: 2 | > loss_disc: 2.828852891921997 (2.6008716821670532) | > loss_disc_real_0: 0.1973305642604828 (0.15294749662280083) | > loss_disc_real_1: 0.3217182755470276 (0.2876175343990326) | > loss_disc_real_2: 0.31730571389198303 (0.33706800639629364) | > loss_disc_real_3: 0.13242308795452118 (0.13512083888053894) | > loss_disc_real_4: 0.22815126180648804 (0.25548669695854187) | > loss_disc_real_5: 0.23202694952487946 (0.21906066685914993) | > loss_0: 2.828852891921997 (2.6008716821670532) | > loss_gen: 2.2525627613067627 (2.4757500886917114) | > loss_kl: 4.5052361488342285 (4.472291469573975) | > loss_feat: 9.750138282775879 (7.952588796615601) | > loss_mel: 24.62805938720703 (26.022637367248535) | > loss_duration: 2.9542369842529297 (2.9656670093536377) | > loss_1: 44.090232849121094 (43.888933181762695)  --> STEP: 3 | > loss_disc: 2.8887689113616943 (2.6968374252319336) | > loss_disc_real_0: 0.10999851673841476 (0.13863116999467215) | > loss_disc_real_1: 0.43500953912734985 (0.336748202641805) | > loss_disc_real_2: 0.24760882556438446 (0.3072482794523239) | > loss_disc_real_3: 0.32529789209365845 (0.19851318995157877) | > loss_disc_real_4: 0.4205546975135803 (0.3105093638102214) | > loss_disc_real_5: 0.3534374535083771 (0.26385292907555896) | > loss_0: 2.8887689113616943 (2.6968374252319336) | > loss_gen: 2.5200910568237305 (2.4905304114023843) | > loss_kl: 1.8924106359481812 (3.61233119169871) | > loss_feat: 3.095350742340088 (6.33350944519043) | > loss_mel: 18.759700775146484 (23.60165850321452) | > loss_duration: 2.8219943046569824 (2.917776107788086) | > loss_1: 29.089550018310547 (38.95580546061198) --> EVAL PERFORMANCE | > avg_loader_time: 0.021230459213256836 (+0.011737744013468424) | > avg_loss_disc: 2.6968374252319336 (+0.35269717375437404) | > avg_loss_disc_real_0: 0.13863116999467215 (-0.28382187585035956) | > avg_loss_disc_real_1: 0.336748202641805 (+0.05462807913621265) | > avg_loss_disc_real_2: 0.3072482794523239 (+0.13210008045037588) | > avg_loss_disc_real_3: 0.19851318995157877 (+0.0261685773730278) | > avg_loss_disc_real_4: 0.3105093638102214 (+0.12614507724841437) | > avg_loss_disc_real_5: 0.26385292907555896 (-0.005294144153594971) | > avg_loss_0: 2.6968374252319336 (+0.35269717375437404) | > avg_loss_gen: 2.4905304114023843 (-0.7346820831298828) | > avg_loss_kl: 3.61233119169871 (-0.21098641554514597) | > avg_loss_feat: 6.33350944519043 (-1.6777345339457188) | > avg_loss_mel: 23.60165850321452 (-2.386294047037758) | > avg_loss_duration: 2.917776107788086 (-0.007790962855021011) | > avg_loss_1: 38.95580546061198 (-5.01748911539714)  > EPOCH: 596/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:23:59)   --> TIME: 2023-10-20 06:24:29 -- STEP: 29/50 -- GLOBAL_STEP: 82830 | > loss_disc: 1.736950397491455 (2.3463784045186538) | > loss_disc_real_0: 0.0436030812561512 (0.16084749469983167) | > loss_disc_real_1: 0.07861059159040451 (0.20900152321776438) | > loss_disc_real_2: 0.059145040810108185 (0.22701995485815504) | > loss_disc_real_3: 0.3224978744983673 (0.20551264697107777) | > loss_disc_real_4: 0.16736258566379547 (0.2021033866652127) | > loss_disc_real_5: 0.11172422021627426 (0.21675622090697289) | > loss_0: 1.736950397491455 (2.3463784045186538) | > grad_norm_0: tensor(265.1449, device='cuda:0') (tensor(554.5367, device='cuda:0')) | > loss_gen: 2.8831398487091064 (2.398140516774408) | > loss_kl: 0.8523223400115967 (0.9220786485178717) | > loss_feat: 9.089640617370605 (5.429070768171344) | > loss_mel: 22.296430587768555 (19.853637925509755) | > loss_duration: 1.4337633848190308 (1.453825173706844) | > loss_1: 36.5552978515625 (30.05675304347071) | > grad_norm_1: tensor(15669.8604, device='cuda:0') (tensor(18691.4082, device='cuda:0')) | > current_lr_0: 0.0001101981504985681 | > current_lr_1: 0.0001101981504985681 | > step_time: 0.4448 (0.5969779080358045) | > loader_time: 0.0058 (0.02312191601457267)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7952868938446045 (2.7952868938446045) | > loss_disc_real_0: 0.12480796873569489 (0.12480796873569489) | > loss_disc_real_1: 0.17765766382217407 (0.17765766382217407) | > loss_disc_real_2: 0.2314632087945938 (0.2314632087945938) | > loss_disc_real_3: 0.3116341829299927 (0.3116341829299927) | > loss_disc_real_4: 0.26076844334602356 (0.26076844334602356) | > loss_disc_real_5: 0.2319481521844864 (0.2319481521844864) | > loss_0: 2.7952868938446045 (2.7952868938446045) | > loss_gen: 1.746209740638733 (1.746209740638733) | > loss_kl: 3.063296318054199 (3.063296318054199) | > loss_feat: 4.620275497436523 (4.620275497436523) | > loss_mel: 23.346811294555664 (23.346811294555664) | > loss_duration: 2.642564535140991 (2.642564535140991) | > loss_1: 35.41915512084961 (35.41915512084961)  --> STEP: 1 | > loss_disc: 2.343719720840454 (2.343719720840454) | > loss_disc_real_0: 0.12657508254051208 (0.12657508254051208) | > loss_disc_real_1: 0.058559246361255646 (0.058559246361255646) | > loss_disc_real_2: 0.13114748895168304 (0.13114748895168304) | > loss_disc_real_3: 0.14821182191371918 (0.14821182191371918) | > loss_disc_real_4: 0.2911722660064697 (0.2911722660064697) | > loss_disc_real_5: 0.15254847705364227 (0.15254847705364227) | > loss_0: 2.343719720840454 (2.343719720840454) | > loss_gen: 1.8115390539169312 (1.8115390539169312) | > loss_kl: 4.642445087432861 (4.642445087432861) | > loss_feat: 7.47799825668335 (7.47799825668335) | > loss_mel: 25.059913635253906 (25.059913635253906) | > loss_duration: 2.982990026473999 (2.982990026473999) | > loss_1: 41.97488784790039 (41.97488784790039)  --> STEP: 2 | > loss_disc: 2.5490782260894775 (2.446398973464966) | > loss_disc_real_0: 0.055711593478918076 (0.09114333800971508) | > loss_disc_real_1: 0.2594907581806183 (0.15902500227093697) | > loss_disc_real_2: 0.15518569946289062 (0.14316659420728683) | > loss_disc_real_3: 0.17650902271270752 (0.16236042231321335) | > loss_disc_real_4: 0.25051507353782654 (0.27084366977214813) | > loss_disc_real_5: 0.1994250863790512 (0.17598678171634674) | > loss_0: 2.5490782260894775 (2.446398973464966) | > loss_gen: 2.0244176387786865 (1.9179783463478088) | > loss_kl: 4.370323657989502 (4.506384372711182) | > loss_feat: 7.024451732635498 (7.251224994659424) | > loss_mel: 23.579071044921875 (24.31949234008789) | > loss_duration: 2.8719027042388916 (2.9274463653564453) | > loss_1: 39.87016677856445 (40.92252731323242)  --> STEP: 3 | > loss_disc: 1.4620269536972046 (2.118274966875712) | > loss_disc_real_0: 0.006598982959985733 (0.06296188632647197) | > loss_disc_real_1: 0.14613556861877441 (0.15472852438688278) | > loss_disc_real_2: 0.06964535266160965 (0.11865951369206111) | > loss_disc_real_3: 0.3744274973869324 (0.23304944733778635) | > loss_disc_real_4: 0.06753935664892197 (0.2030755653977394) | > loss_disc_real_5: 0.11152583360671997 (0.15449979901313782) | > loss_0: 1.4620269536972046 (2.118274966875712) | > loss_gen: 3.546384334564209 (2.4607803424199424) | > loss_kl: 2.031332492828369 (3.6813670794169107) | > loss_feat: 12.20909595489502 (8.903848648071289) | > loss_mel: 26.865983963012695 (25.168322881062824) | > loss_duration: 2.7123003005981445 (2.8557310104370117) | > loss_1: 47.36509704589844 (43.07005055745443) --> EVAL PERFORMANCE | > avg_loader_time: 0.011541604995727539 (-0.009688854217529297) | > avg_loss_disc: 2.118274966875712 (-0.5785624583562217) | > avg_loss_disc_real_0: 0.06296188632647197 (-0.07566928366820018) | > avg_loss_disc_real_1: 0.15472852438688278 (-0.1820196782549222) | > avg_loss_disc_real_2: 0.11865951369206111 (-0.1885887657602628) | > avg_loss_disc_real_3: 0.23304944733778635 (+0.03453625738620758) | > avg_loss_disc_real_4: 0.2030755653977394 (-0.10743379841248196) | > avg_loss_disc_real_5: 0.15449979901313782 (-0.10935313006242114) | > avg_loss_0: 2.118274966875712 (-0.5785624583562217) | > avg_loss_gen: 2.4607803424199424 (-0.029750068982441924) | > avg_loss_kl: 3.6813670794169107 (+0.06903588771820068) | > avg_loss_feat: 8.903848648071289 (+2.5703392028808594) | > avg_loss_mel: 25.168322881062824 (+1.566664377848305) | > avg_loss_duration: 2.8557310104370117 (-0.06204509735107422) | > avg_loss_1: 43.07005055745443 (+4.114245096842453)  > EPOCH: 597/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:25:02)   --> TIME: 2023-10-20 06:25:14 -- STEP: 9/50 -- GLOBAL_STEP: 82860 | > loss_disc: 2.6352620124816895 (2.45027854707506) | > loss_disc_real_0: 0.22414152324199677 (0.1458763281504313) | > loss_disc_real_1: 0.3271014094352722 (0.2247260862754451) | > loss_disc_real_2: 0.3758467733860016 (0.23125616957743964) | > loss_disc_real_3: 0.3501020669937134 (0.2605981644656923) | > loss_disc_real_4: 0.3405681252479553 (0.23433351185586718) | > loss_disc_real_5: 0.3786460757255554 (0.2026472876055373) | > loss_0: 2.6352620124816895 (2.45027854707506) | > grad_norm_0: tensor(469.4328, device='cuda:0') (tensor(519.4012, device='cuda:0')) | > loss_gen: 2.8338463306427 (2.3869724008772106) | > loss_kl: 0.6395504474639893 (0.785673075252109) | > loss_feat: 4.139596939086914 (5.490498703387049) | > loss_mel: 24.28369140625 (20.227129565344917) | > loss_duration: 1.3794878721237183 (1.4481646882163153) | > loss_1: 33.27617263793945 (30.338438775804306) | > grad_norm_1: tensor(11743.9316, device='cuda:0') (tensor(29328.0879, device='cuda:0')) | > current_lr_0: 0.0001100880005477093 | > current_lr_1: 0.0001100880005477093 | > step_time: 0.6057 (0.46642163064744735) | > loader_time: 0.0063 (0.014428827497694228)  --> TIME: 2023-10-20 06:25:29 -- STEP: 39/50 -- GLOBAL_STEP: 82890 | > loss_disc: 1.343438744544983 (2.4451974019026146) | > loss_disc_real_0: 0.06701833009719849 (0.1471327542303464) | > loss_disc_real_1: 0.3095492720603943 (0.23728604452350202) | > loss_disc_real_2: 0.1504460573196411 (0.21919934012186834) | > loss_disc_real_3: 0.23945362865924835 (0.2535510668769861) | > loss_disc_real_4: 0.05140337347984314 (0.21780614144144914) | > loss_disc_real_5: 0.0504850335419178 (0.23467580353220305) | > loss_0: 1.343438744544983 (2.4451974019026146) | > grad_norm_0: tensor(626.2275, device='cuda:0') (tensor(614.8948, device='cuda:0')) | > loss_gen: 3.706958770751953 (2.3734695452910204) | > loss_kl: 0.6431311964988708 (0.8128223594946739) | > loss_feat: 10.815133094787598 (5.213972381674327) | > loss_mel: 26.97024154663086 (21.43533998880631) | > loss_duration: 1.5010954141616821 (1.4376482719030135) | > loss_1: 43.636558532714844 (31.27325278062087) | > grad_norm_1: tensor(89293.9375, device='cuda:0') (tensor(23213.8125, device='cuda:0')) | > current_lr_0: 0.0001100880005477093 | > current_lr_1: 0.0001100880005477093 | > step_time: 0.5815 (0.48702517533913636) | > loader_time: 0.0096 (0.013831554315029046)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3421523571014404 (2.3421523571014404) | > loss_disc_real_0: 0.12243518978357315 (0.12243518978357315) | > loss_disc_real_1: 0.23503857851028442 (0.23503857851028442) | > loss_disc_real_2: 0.3072255551815033 (0.3072255551815033) | > loss_disc_real_3: 0.26592743396759033 (0.26592743396759033) | > loss_disc_real_4: 0.17115260660648346 (0.17115260660648346) | > loss_disc_real_5: 0.09845201671123505 (0.09845201671123505) | > loss_0: 2.3421523571014404 (2.3421523571014404) | > loss_gen: 2.280622959136963 (2.280622959136963) | > loss_kl: 3.478761911392212 (3.478761911392212) | > loss_feat: 6.20970344543457 (6.20970344543457) | > loss_mel: 21.920974731445312 (21.920974731445312) | > loss_duration: 2.649672269821167 (2.649672269821167) | > loss_1: 36.539737701416016 (36.539737701416016)  --> STEP: 1 | > loss_disc: 2.7517247200012207 (2.7517247200012207) | > loss_disc_real_0: 0.22498007118701935 (0.22498007118701935) | > loss_disc_real_1: 0.19362658262252808 (0.19362658262252808) | > loss_disc_real_2: 0.18646188080310822 (0.18646188080310822) | > loss_disc_real_3: 0.43531128764152527 (0.43531128764152527) | > loss_disc_real_4: 0.40077871084213257 (0.40077871084213257) | > loss_disc_real_5: 0.3507773280143738 (0.3507773280143738) | > loss_0: 2.7517247200012207 (2.7517247200012207) | > loss_gen: 2.479604721069336 (2.479604721069336) | > loss_kl: 4.29158878326416 (4.29158878326416) | > loss_feat: 4.396807670593262 (4.396807670593262) | > loss_mel: 24.839242935180664 (24.839242935180664) | > loss_duration: 2.927628755569458 (2.927628755569458) | > loss_1: 38.93487548828125 (38.93487548828125)  --> STEP: 2 | > loss_disc: 3.003765106201172 (2.8777449131011963) | > loss_disc_real_0: 0.2729920744895935 (0.24898607283830643) | > loss_disc_real_1: 0.2599096894264221 (0.2267681360244751) | > loss_disc_real_2: 0.3454434275627136 (0.2659526541829109) | > loss_disc_real_3: 0.2816881537437439 (0.3584997206926346) | > loss_disc_real_4: 0.2830822765827179 (0.34193049371242523) | > loss_disc_real_5: 0.27229246497154236 (0.31153489649295807) | > loss_0: 3.003765106201172 (2.8777449131011963) | > loss_gen: 1.7371004819869995 (2.1083526015281677) | > loss_kl: 4.63505744934082 (4.46332311630249) | > loss_feat: 0.1435508131980896 (2.2701792418956757) | > loss_mel: 4.17356014251709 (14.506401538848877) | > loss_duration: 2.8251984119415283 (2.876413583755493) | > loss_1: 13.514467239379883 (26.224671363830566)  --> STEP: 3 | > loss_disc: 2.6080374717712402 (2.7878424326578775) | > loss_disc_real_0: 0.14266009628772736 (0.21354408065478006) | > loss_disc_real_1: 0.26726034283638 (0.24026553829511008) | > loss_disc_real_2: 0.33641645312309265 (0.2894405871629715) | > loss_disc_real_3: 0.297504186630249 (0.33816787600517273) | > loss_disc_real_4: 0.23770573735237122 (0.3071889082590739) | > loss_disc_real_5: 0.34885653853416443 (0.32397544384002686) | > loss_0: 2.6080374717712402 (2.7878424326578775) | > loss_gen: 2.2492291927337646 (2.1553114652633667) | > loss_kl: 1.9786232709884644 (3.6350898345311484) | > loss_feat: 2.4582695960998535 (2.3328760266304016) | > loss_mel: 19.707225799560547 (16.240009625752766) | > loss_duration: 2.729626178741455 (2.827484448750814) | > loss_1: 29.122974395751953 (27.190772374471027) --> EVAL PERFORMANCE | > avg_loader_time: 0.014204025268554688 (+0.0026624202728271484) | > avg_loss_disc: 2.7878424326578775 (+0.6695674657821655) | > avg_loss_disc_real_0: 0.21354408065478006 (+0.1505821943283081) | > avg_loss_disc_real_1: 0.24026553829511008 (+0.0855370139082273) | > avg_loss_disc_real_2: 0.2894405871629715 (+0.17078107347091037) | > avg_loss_disc_real_3: 0.33816787600517273 (+0.10511842866738638) | > avg_loss_disc_real_4: 0.3071889082590739 (+0.1041133428613345) | > avg_loss_disc_real_5: 0.32397544384002686 (+0.16947564482688904) | > avg_loss_0: 2.7878424326578775 (+0.6695674657821655) | > avg_loss_gen: 2.1553114652633667 (-0.30546887715657567) | > avg_loss_kl: 3.6350898345311484 (-0.046277244885762236) | > avg_loss_feat: 2.3328760266304016 (-6.5709726214408875) | > avg_loss_mel: 16.240009625752766 (-8.928313255310059) | > avg_loss_duration: 2.827484448750814 (-0.02824656168619777) | > avg_loss_1: 27.190772374471027 (-15.879278182983402)  > EPOCH: 598/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:25:50)   --> TIME: 2023-10-20 06:26:09 -- STEP: 19/50 -- GLOBAL_STEP: 82920 | > loss_disc: 2.245948076248169 (2.4778004821978117) | > loss_disc_real_0: 0.032569121569395065 (0.1685381817974542) | > loss_disc_real_1: 0.29035529494285583 (0.21603108354304967) | > loss_disc_real_2: 0.19865883886814117 (0.2463204429337853) | > loss_disc_real_3: 0.3305351138114929 (0.24465218549104115) | > loss_disc_real_4: 0.1774098128080368 (0.22994427539800344) | > loss_disc_real_5: 0.1301594376564026 (0.22001750982905688) | > loss_0: 2.245948076248169 (2.4778004821978117) | > grad_norm_0: tensor(646.6232, device='cuda:0') (tensor(819.4576, device='cuda:0')) | > loss_gen: 2.3486599922180176 (2.235571076995448) | > loss_kl: 0.8939154744148254 (0.8010047674179077) | > loss_feat: 6.686108589172363 (4.581477577749052) | > loss_mel: 20.80013656616211 (20.067025812048662) | > loss_duration: 1.5820188522338867 (1.4781838843696995) | > loss_1: 32.31084060668945 (29.163263069955928) | > grad_norm_1: tensor(18276.4551, device='cuda:0') (tensor(22252.5566, device='cuda:0')) | > current_lr_0: 0.0001099779606986228 | > current_lr_1: 0.0001099779606986228 | > step_time: 0.8613 (0.6294356019873368) | > loader_time: 0.0421 (0.02147631896169562)  --> TIME: 2023-10-20 06:26:27 -- STEP: 49/50 -- GLOBAL_STEP: 82950 | > loss_disc: 1.611412525177002 (2.4916266324568768) | > loss_disc_real_0: 0.05909290164709091 (0.1608477269337342) | > loss_disc_real_1: 0.16112713515758514 (0.2194953805253822) | > loss_disc_real_2: 0.10379251837730408 (0.22706899522062468) | > loss_disc_real_3: 0.1540098339319229 (0.23216875524697256) | > loss_disc_real_4: 0.17730851471424103 (0.22275404483840175) | > loss_disc_real_5: 0.1878122091293335 (0.2280496865586967) | > loss_0: 1.611412525177002 (2.4916266324568768) | > grad_norm_0: tensor(536.7438, device='cuda:0') (tensor(745.1274, device='cuda:0')) | > loss_gen: 3.5384159088134766 (2.2647316285542085) | > loss_kl: 0.898244321346283 (0.8399366316746693) | > loss_feat: 9.571601867675781 (5.0832992054674095) | > loss_mel: 29.206512451171875 (21.451029242301473) | > loss_duration: 1.5688904523849487 (1.4447742481620944) | > loss_1: 44.78366470336914 (31.083770742221756) | > grad_norm_1: tensor(74341.4219, device='cuda:0') (tensor(21847.5430, device='cuda:0')) | > current_lr_0: 0.0001099779606986228 | > current_lr_1: 0.0001099779606986228 | > step_time: 0.3418 (0.5770269170099375) | > loader_time: 0.439 (0.029021350704893773)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7912068367004395 (2.7912068367004395) | > loss_disc_real_0: 0.3878867030143738 (0.3878867030143738) | > loss_disc_real_1: 0.23187598586082458 (0.23187598586082458) | > loss_disc_real_2: 0.30852067470550537 (0.30852067470550537) | > loss_disc_real_3: 0.3576693832874298 (0.3576693832874298) | > loss_disc_real_4: 0.2902625501155853 (0.2902625501155853) | > loss_disc_real_5: 0.33297616243362427 (0.33297616243362427) | > loss_0: 2.7912068367004395 (2.7912068367004395) | > loss_gen: 2.4577856063842773 (2.4577856063842773) | > loss_kl: 4.036954402923584 (4.036954402923584) | > loss_feat: 4.673807144165039 (4.673807144165039) | > loss_mel: 23.473833084106445 (23.473833084106445) | > loss_duration: 2.705099582672119 (2.705099582672119) | > loss_1: 37.34748077392578 (37.34748077392578)  --> STEP: 1 | > loss_disc: 2.7260961532592773 (2.7260961532592773) | > loss_disc_real_0: 0.07484303414821625 (0.07484303414821625) | > loss_disc_real_1: 0.17808479070663452 (0.17808479070663452) | > loss_disc_real_2: 0.47030213475227356 (0.47030213475227356) | > loss_disc_real_3: 0.12041459232568741 (0.12041459232568741) | > loss_disc_real_4: 0.3138717710971832 (0.3138717710971832) | > loss_disc_real_5: 0.10945964604616165 (0.10945964604616165) | > loss_0: 2.7260961532592773 (2.7260961532592773) | > loss_gen: 2.03818678855896 (2.03818678855896) | > loss_kl: 4.548160076141357 (4.548160076141357) | > loss_feat: 9.751321792602539 (9.751321792602539) | > loss_mel: 27.074434280395508 (27.074434280395508) | > loss_duration: 2.9629364013671875 (2.9629364013671875) | > loss_1: 46.375038146972656 (46.375038146972656)  --> STEP: 2 | > loss_disc: 2.3628416061401367 (2.544468879699707) | > loss_disc_real_0: 0.11874472349882126 (0.09679387882351875) | > loss_disc_real_1: 0.35250070691108704 (0.2652927488088608) | > loss_disc_real_2: 0.29190781712532043 (0.381104975938797) | > loss_disc_real_3: 0.3197703957557678 (0.22009249404072762) | > loss_disc_real_4: 0.14893057942390442 (0.23140117526054382) | > loss_disc_real_5: 0.14854568243026733 (0.1290026642382145) | > loss_0: 2.3628416061401367 (2.544468879699707) | > loss_gen: 2.517047882080078 (2.277617335319519) | > loss_kl: 4.363170146942139 (4.455665111541748) | > loss_feat: 3.667510747909546 (6.7094162702560425) | > loss_mel: 22.460285186767578 (24.767359733581543) | > loss_duration: 2.972191572189331 (2.9675639867782593) | > loss_1: 35.98020553588867 (41.177621841430664)  --> STEP: 3 | > loss_disc: 2.07313871383667 (2.387358824412028) | > loss_disc_real_0: 0.08442355692386627 (0.09267043819030125) | > loss_disc_real_1: 0.15433913469314575 (0.2283082107702891) | > loss_disc_real_2: 0.25316303968429565 (0.3384576638539632) | > loss_disc_real_3: 0.22059527039527893 (0.22026008615891138) | > loss_disc_real_4: 0.1274861991405487 (0.19676284988721213) | > loss_disc_real_5: 0.07607636600732803 (0.111360564827919) | > loss_0: 2.07313871383667 (2.387358824412028) | > loss_gen: 2.767949104309082 (2.44106125831604) | > loss_kl: 2.431612253189087 (3.7809808254241943) | > loss_feat: 9.356561660766602 (7.5917980670928955) | > loss_mel: 24.26878547668457 (24.601168314615887) | > loss_duration: 2.9387624263763428 (2.957963466644287) | > loss_1: 41.763671875 (41.372971852620445) --> EVAL PERFORMANCE | > avg_loader_time: 0.005608558654785156 (-0.008595466613769531) | > avg_loss_disc: 2.387358824412028 (-0.4004836082458496) | > avg_loss_disc_real_0: 0.09267043819030125 (-0.1208736424644788) | > avg_loss_disc_real_1: 0.2283082107702891 (-0.011957327524820982) | > avg_loss_disc_real_2: 0.3384576638539632 (+0.0490170766909917) | > avg_loss_disc_real_3: 0.22026008615891138 (-0.11790778984626135) | > avg_loss_disc_real_4: 0.19676284988721213 (-0.11042605837186178) | > avg_loss_disc_real_5: 0.111360564827919 (-0.21261487901210785) | > avg_loss_0: 2.387358824412028 (-0.4004836082458496) | > avg_loss_gen: 2.44106125831604 (+0.28574979305267334) | > avg_loss_kl: 3.7809808254241943 (+0.1458909908930459) | > avg_loss_feat: 7.5917980670928955 (+5.258922040462494) | > avg_loss_mel: 24.601168314615887 (+8.36115868886312) | > avg_loss_duration: 2.957963466644287 (+0.13047901789347316) | > avg_loss_1: 41.372971852620445 (+14.182199478149418)  > EPOCH: 599/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:26:42)   --> TIME: 2023-10-20 06:27:14 -- STEP: 29/50 -- GLOBAL_STEP: 82980 | > loss_disc: 2.672884702682495 (2.386536224135037) | > loss_disc_real_0: 0.07486003637313843 (0.13344489102219706) | > loss_disc_real_1: 0.28613197803497314 (0.21631036364826664) | > loss_disc_real_2: 0.14438694715499878 (0.2227172481602636) | > loss_disc_real_3: 0.25742489099502563 (0.2531202780403967) | > loss_disc_real_4: 0.3187825381755829 (0.22189002060170832) | > loss_disc_real_5: 0.28195714950561523 (0.2117502598156189) | > loss_0: 2.672884702682495 (2.386536224135037) | > grad_norm_0: tensor(617.1060, device='cuda:0') (tensor(679.0715, device='cuda:0')) | > loss_gen: 2.091954469680786 (2.536034843017315) | > loss_kl: 0.9602198004722595 (0.874555574408893) | > loss_feat: 3.685755968093872 (5.964557686756397) | > loss_mel: 25.34613800048828 (22.374811550666546) | > loss_duration: 1.419080138206482 (1.4686501848286595) | > loss_1: 33.50314712524414 (33.21860971121952) | > grad_norm_1: tensor(5029.7871, device='cuda:0') (tensor(29792.1641, device='cuda:0')) | > current_lr_0: 0.00010986803084125498 | > current_lr_1: 0.00010986803084125498 | > step_time: 0.8305 (0.7221665546811861) | > loader_time: 0.0264 (0.02472451637531149)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.661332845687866 (2.661332845687866) | > loss_disc_real_0: 0.27753570675849915 (0.27753570675849915) | > loss_disc_real_1: 0.27546426653862 (0.27546426653862) | > loss_disc_real_2: 0.45094969868659973 (0.45094969868659973) | > loss_disc_real_3: 0.21091504395008087 (0.21091504395008087) | > loss_disc_real_4: 0.34656986594200134 (0.34656986594200134) | > loss_disc_real_5: 0.30879464745521545 (0.30879464745521545) | > loss_0: 2.661332845687866 (2.661332845687866) | > loss_gen: 2.9505321979522705 (2.9505321979522705) | > loss_kl: 3.452232599258423 (3.452232599258423) | > loss_feat: 6.409710884094238 (6.409710884094238) | > loss_mel: 21.539976119995117 (21.539976119995117) | > loss_duration: 2.665573835372925 (2.665573835372925) | > loss_1: 37.01802444458008 (37.01802444458008)  --> STEP: 1 | > loss_disc: 2.6564979553222656 (2.6564979553222656) | > loss_disc_real_0: 0.09161446988582611 (0.09161446988582611) | > loss_disc_real_1: 0.259239137172699 (0.259239137172699) | > loss_disc_real_2: 0.18621942400932312 (0.18621942400932312) | > loss_disc_real_3: 0.37584391236305237 (0.37584391236305237) | > loss_disc_real_4: 0.1397704780101776 (0.1397704780101776) | > loss_disc_real_5: 0.12613840401172638 (0.12613840401172638) | > loss_0: 2.6564979553222656 (2.6564979553222656) | > loss_gen: 2.4781694412231445 (2.4781694412231445) | > loss_kl: 3.9809212684631348 (3.9809212684631348) | > loss_feat: 9.236200332641602 (9.236200332641602) | > loss_mel: 23.61686134338379 (23.61686134338379) | > loss_duration: 2.920541763305664 (2.920541763305664) | > loss_1: 42.232696533203125 (42.232696533203125)  --> STEP: 2 | > loss_disc: 2.2260119915008545 (2.44125497341156) | > loss_disc_real_0: 0.07542025297880173 (0.08351736143231392) | > loss_disc_real_1: 0.08218793570995331 (0.17071353644132614) | > loss_disc_real_2: 0.146799698472023 (0.16650956124067307) | > loss_disc_real_3: 0.08241680264472961 (0.229130357503891) | > loss_disc_real_4: 0.2566927969455719 (0.19823163747787476) | > loss_disc_real_5: 0.402565062046051 (0.2643517330288887) | > loss_0: 2.2260119915008545 (2.44125497341156) | > loss_gen: 2.7132725715637207 (2.5957210063934326) | > loss_kl: 4.7650885581970215 (4.373004913330078) | > loss_feat: 9.613077163696289 (9.424638748168945) | > loss_mel: 23.291152954101562 (23.454007148742676) | > loss_duration: 2.927283525466919 (2.9239126443862915) | > loss_1: 43.30987548828125 (42.77128601074219)  --> STEP: 3 | > loss_disc: 3.134209156036377 (2.6722397009531655) | > loss_disc_real_0: 0.28281721472740173 (0.14995064586400986) | > loss_disc_real_1: 0.3404524624347687 (0.22729317843914032) | > loss_disc_real_2: 0.4549340009689331 (0.2626510411500931) | > loss_disc_real_3: 0.2697784900665283 (0.2426797350247701) | > loss_disc_real_4: 0.5213696360588074 (0.305944303671519) | > loss_disc_real_5: 0.40505218505859375 (0.31125188370545703) | > loss_0: 3.134209156036377 (2.6722397009531655) | > loss_gen: 2.8140599727630615 (2.6685006618499756) | > loss_kl: 2.179048538208008 (3.641686121622721) | > loss_feat: 4.6761698722839355 (7.841815789540608) | > loss_mel: 23.442691802978516 (23.45023536682129) | > loss_duration: 2.664658784866333 (2.837494691212972) | > loss_1: 35.77662658691406 (40.43973286946615) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_83000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2055535316467285 (2.5555681586265564) | > loss_disc_real_0: 0.07178998738527298 (0.13041048124432564) | > loss_disc_real_1: 0.23017987608909607 (0.22801485285162926) | > loss_disc_real_2: 0.2534671127796173 (0.26035505905747414) | > loss_disc_real_3: 0.2831003963947296 (0.25278490036726) | > loss_disc_real_4: 0.18590494990348816 (0.27593446522951126) | > loss_disc_real_5: 0.17271758615970612 (0.2766183093190193) | > loss_0: 2.2055535316467285 (2.5555681586265564) | > loss_gen: 2.6330199241638184 (2.6596304774284363) | > loss_kl: 3.678232431411743 (3.650822699069977) | > loss_feat: 4.887861251831055 (7.10332715511322) | > loss_mel: 26.12479019165039 (24.118874073028564) | > loss_duration: 2.743541717529297 (2.8140064477920532) | > loss_1: 40.06744384765625 (40.34666061401367)  --> STEP: 1 | > loss_disc: 2.443108081817627 (2.5330761432647706) | > loss_disc_real_0: 0.2504163086414337 (0.15441164672374724) | > loss_disc_real_1: 0.24586690962314606 (0.23158526420593262) | > loss_disc_real_2: 0.2987167537212372 (0.26802739799022673) | > loss_disc_real_3: 0.15514355897903442 (0.23325663208961486) | > loss_disc_real_4: 0.2929021716117859 (0.2793280065059662) | > loss_disc_real_5: 0.18763485550880432 (0.25882161855697633) | > loss_0: 2.443108081817627 (2.5330761432647706) | > loss_gen: 3.4522621631622314 (2.8181568145751954) | > loss_kl: 3.7540571689605713 (3.6714695930480956) | > loss_feat: 6.891127109527588 (7.060887145996094) | > loss_mel: 24.629379272460938 (24.22097511291504) | > loss_duration: 2.8281302452087402 (2.8168312072753907) | > loss_1: 41.554954528808594 (40.58831939697266)  --> STEP: 2 | > loss_disc: 1.9726158380508423 (2.4396660923957825) | > loss_disc_real_0: 0.1660660356283188 (0.15635404487450918) | > loss_disc_real_1: 0.26137393712997437 (0.23655004302660623) | > loss_disc_real_2: 0.24220514297485352 (0.2637236888209979) | > loss_disc_real_3: 0.25214582681655884 (0.2364048312107722) | > loss_disc_real_4: 0.2560662627220154 (0.27545104920864105) | > loss_disc_real_5: 0.13811014592647552 (0.2387030397852262) | > loss_0: 1.9726158380508423 (2.4396660923957825) | > loss_gen: 3.759540319442749 (2.975054065386454) | > loss_kl: 4.703760623931885 (3.843518098195394) | > loss_feat: 10.128127098083496 (7.572093804677327) | > loss_mel: 21.613935470581055 (23.786468505859375) | > loss_duration: 2.9133310317993164 (2.8329145113627114) | > loss_1: 43.11869430541992 (41.01004854838053)  --> STEP: 3 | > loss_disc: 2.8317689895629883 (2.4956807919910977) | > loss_disc_real_0: 0.45592859387397766 (0.1991504090172904) | > loss_disc_real_1: 0.25871211290359497 (0.2397160530090332) | > loss_disc_real_2: 0.21598808467388153 (0.25690431679998127) | > loss_disc_real_3: 0.2527010440826416 (0.23873286162103927) | > loss_disc_real_4: 0.2666932940483093 (0.27419994132859365) | > loss_disc_real_5: 0.2556595206260681 (0.24112539419106074) | > loss_0: 2.8317689895629883 (2.4956807919910977) | > loss_gen: 2.1787853240966797 (2.8613013880593434) | > loss_kl: 2.2500970363616943 (3.6158865179334367) | > loss_feat: 1.244293451309204 (6.668122325624738) | > loss_mel: 18.675716400146484 (23.056361062186106) | > loss_duration: 2.646651029586792 (2.8063054425375804) | > loss_1: 26.995542526245117 (39.00797625950405) --> EVAL PERFORMANCE | > avg_loader_time: 0.29508376121520996 (+0.2894752025604248) | > avg_loss_disc: 2.4956807919910977 (+0.10832196757906987) | > avg_loss_disc_real_0: 0.1991504090172904 (+0.10647997082698914) | > avg_loss_disc_real_1: 0.2397160530090332 (+0.01140784223874411) | > avg_loss_disc_real_2: 0.25690431679998127 (-0.08155334705398193) | > avg_loss_disc_real_3: 0.23873286162103927 (+0.01847277546212789) | > avg_loss_disc_real_4: 0.27419994132859365 (+0.07743709144138153) | > avg_loss_disc_real_5: 0.24112539419106074 (+0.12976482936314174) | > avg_loss_0: 2.4956807919910977 (+0.10832196757906987) | > avg_loss_gen: 2.8613013880593434 (+0.4202401297433034) | > avg_loss_kl: 3.6158865179334367 (-0.1650943074907576) | > avg_loss_feat: 6.668122325624738 (-0.9236757414681573) | > avg_loss_mel: 23.056361062186106 (-1.5448072524297807) | > avg_loss_duration: 2.8063054425375804 (-0.1516580241067067) | > avg_loss_1: 39.00797625950405 (-2.3649955931163973)  > EPOCH: 600/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:27:45)   --> TIME: 2023-10-20 06:27:56 -- STEP: 9/50 -- GLOBAL_STEP: 83010 | > loss_disc: 2.974931240081787 (2.484194901254442) | > loss_disc_real_0: 0.16075824201107025 (0.12709775577402777) | > loss_disc_real_1: 0.3329369127750397 (0.25442695803940296) | > loss_disc_real_2: 0.36896058917045593 (0.264740667409367) | > loss_disc_real_3: 0.30810338258743286 (0.26697952548662823) | > loss_disc_real_4: 0.3701581358909607 (0.2798349836634265) | > loss_disc_real_5: 0.2989407479763031 (0.20185437198314402) | > loss_0: 2.974931240081787 (2.484194901254442) | > grad_norm_0: tensor(814.8842, device='cuda:0') (tensor(731.0487, device='cuda:0')) | > loss_gen: 2.0537006855010986 (2.384991420639886) | > loss_kl: 0.7163953185081482 (0.9784112175305685) | > loss_feat: 2.6621243953704834 (4.680739811725086) | > loss_mel: 21.06626319885254 (18.886313041051228) | > loss_duration: 1.3981560468673706 (1.4391475650999281) | > loss_1: 27.896638870239258 (28.369602415296768) | > grad_norm_1: tensor(7171.7114, device='cuda:0') (tensor(23418.4023, device='cuda:0')) | > current_lr_0: 0.00010975821086566224 | > current_lr_1: 0.00010975821086566224 | > step_time: 0.5127 (0.6456129021114774) | > loader_time: 0.006 (0.02309740914238824)  --> TIME: 2023-10-20 06:28:13 -- STEP: 39/50 -- GLOBAL_STEP: 83040 | > loss_disc: 2.58656644821167 (2.5333921634233914) | > loss_disc_real_0: 0.08493855595588684 (0.15977272813996438) | > loss_disc_real_1: 0.3153584599494934 (0.2331105125351594) | > loss_disc_real_2: 0.24325361847877502 (0.23416371748615533) | > loss_disc_real_3: 0.32515794038772583 (0.2550270697818352) | > loss_disc_real_4: 0.32302945852279663 (0.23570663663439262) | > loss_disc_real_5: 0.31908106803894043 (0.22255772653107458) | > loss_0: 2.58656644821167 (2.5333921634233914) | > grad_norm_0: tensor(942.3755, device='cuda:0') (tensor(705.0631, device='cuda:0')) | > loss_gen: 2.448246479034424 (2.315844239332737) | > loss_kl: 0.7137269377708435 (0.8454776591597459) | > loss_feat: 3.5201926231384277 (4.996258700887362) | > loss_mel: 24.795120239257812 (18.59268860022227) | > loss_duration: 1.5303655862808228 (1.4442070019550812) | > loss_1: 33.007652282714844 (28.19447611539792) | > grad_norm_1: tensor(4388.9888, device='cuda:0') (tensor(19966.7441, device='cuda:0')) | > current_lr_0: 0.00010975821086566224 | > current_lr_1: 0.00010975821086566224 | > step_time: 0.3697 (0.5615477500817715) | > loader_time: 0.002 (0.018863445673233423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1403262615203857 (2.1403262615203857) | > loss_disc_real_0: 0.15105918049812317 (0.15105918049812317) | > loss_disc_real_1: 0.221690371632576 (0.221690371632576) | > loss_disc_real_2: 0.20481504499912262 (0.20481504499912262) | > loss_disc_real_3: 0.2260395884513855 (0.2260395884513855) | > loss_disc_real_4: 0.23610785603523254 (0.23610785603523254) | > loss_disc_real_5: 0.18443447351455688 (0.18443447351455688) | > loss_0: 2.1403262615203857 (2.1403262615203857) | > loss_gen: 2.48984432220459 (2.48984432220459) | > loss_kl: 3.9851784706115723 (3.9851784706115723) | > loss_feat: 6.7725982666015625 (6.7725982666015625) | > loss_mel: 23.520036697387695 (23.520036697387695) | > loss_duration: 2.707988977432251 (2.707988977432251) | > loss_1: 39.47564697265625 (39.47564697265625)  --> STEP: 1 | > loss_disc: 2.3680036067962646 (2.3680036067962646) | > loss_disc_real_0: 0.2327442616224289 (0.2327442616224289) | > loss_disc_real_1: 0.20991525053977966 (0.20991525053977966) | > loss_disc_real_2: 0.10790892690420151 (0.10790892690420151) | > loss_disc_real_3: 0.05267319083213806 (0.05267319083213806) | > loss_disc_real_4: 0.24274910986423492 (0.24274910986423492) | > loss_disc_real_5: 0.35072657465934753 (0.35072657465934753) | > loss_0: 2.3680036067962646 (2.3680036067962646) | > loss_gen: 2.557847023010254 (2.557847023010254) | > loss_kl: 4.243415832519531 (4.243415832519531) | > loss_feat: 6.336526870727539 (6.336526870727539) | > loss_mel: 24.885242462158203 (24.885242462158203) | > loss_duration: 3.0547425746917725 (3.0547425746917725) | > loss_1: 41.07777404785156 (41.07777404785156)  --> STEP: 2 | > loss_disc: 2.0793566703796387 (2.2236801385879517) | > loss_disc_real_0: 0.2591133415699005 (0.2459288015961647) | > loss_disc_real_1: 0.13442915678024292 (0.1721722036600113) | > loss_disc_real_2: 0.12442202866077423 (0.11616547778248787) | > loss_disc_real_3: 0.1439887136220932 (0.09833095222711563) | > loss_disc_real_4: 0.07948826998472214 (0.16111868992447853) | > loss_disc_real_5: 0.03617502748966217 (0.19345080107450485) | > loss_0: 2.0793566703796387 (2.2236801385879517) | > loss_gen: 2.2122507095336914 (2.3850488662719727) | > loss_kl: 4.579270362854004 (4.411343097686768) | > loss_feat: 12.196174621582031 (9.266350746154785) | > loss_mel: 30.395248413085938 (27.64024543762207) | > loss_duration: 2.8975775241851807 (2.9761600494384766) | > loss_1: 52.280521392822266 (46.679147720336914)  --> STEP: 3 | > loss_disc: 2.42471981048584 (2.2906933625539145) | > loss_disc_real_0: 0.16343539953231812 (0.21843100090821585) | > loss_disc_real_1: 0.17736110091209412 (0.17390183607737222) | > loss_disc_real_2: 0.3099140226840973 (0.18074832608302435) | > loss_disc_real_3: 0.20669101178646088 (0.1344509720802307) | > loss_disc_real_4: 0.20277154445648193 (0.17500297476847967) | > loss_disc_real_5: 0.2075374722480774 (0.19814635813236237) | > loss_0: 2.42471981048584 (2.2906933625539145) | > loss_gen: 2.1596710681915283 (2.309922933578491) | > loss_kl: 2.0438461303710938 (3.6221774419148765) | > loss_feat: 4.084061145782471 (7.538920879364014) | > loss_mel: 20.938688278198242 (25.40639305114746) | > loss_duration: 2.7449917793273926 (2.8991039594014487) | > loss_1: 31.97125816345215 (41.77651786804199) --> EVAL PERFORMANCE | > avg_loader_time: 0.0062859853108723955 (-0.2887977759043376) | > avg_loss_disc: 2.2906933625539145 (-0.20498742943718318) | > avg_loss_disc_real_0: 0.21843100090821585 (+0.019280591890925458) | > avg_loss_disc_real_1: 0.17390183607737222 (-0.06581421693166098) | > avg_loss_disc_real_2: 0.18074832608302435 (-0.07615599071695692) | > avg_loss_disc_real_3: 0.1344509720802307 (-0.10428188954080855) | > avg_loss_disc_real_4: 0.17500297476847967 (-0.09919696656011398) | > avg_loss_disc_real_5: 0.19814635813236237 (-0.04297903605869838) | > avg_loss_0: 2.2906933625539145 (-0.20498742943718318) | > avg_loss_gen: 2.309922933578491 (-0.5513784544808522) | > avg_loss_kl: 3.6221774419148765 (+0.006290923981439711) | > avg_loss_feat: 7.538920879364014 (+0.8707985537392755) | > avg_loss_mel: 25.40639305114746 (+2.350031988961355) | > avg_loss_duration: 2.8991039594014487 (+0.09279851686386831) | > avg_loss_1: 41.77651786804199 (+2.7685416085379444)  > EPOCH: 601/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:28:36)   --> TIME: 2023-10-20 06:28:52 -- STEP: 19/50 -- GLOBAL_STEP: 83070 | > loss_disc: 3.0744128227233887 (2.358171908478988) | > loss_disc_real_0: 0.06959927082061768 (0.1470685618880548) | > loss_disc_real_1: 0.20212779939174652 (0.2309111088122192) | > loss_disc_real_2: 0.18966592848300934 (0.23888832399327503) | > loss_disc_real_3: 0.30445918440818787 (0.22449545944599728) | > loss_disc_real_4: 0.09949395060539246 (0.21514677138705002) | > loss_disc_real_5: 0.061731889843940735 (0.20197065507895068) | > loss_0: 3.0744128227233887 (2.358171908478988) | > grad_norm_0: tensor(457.8647, device='cuda:0') (tensor(745.7319, device='cuda:0')) | > loss_gen: 1.5174505710601807 (2.527590218343233) | > loss_kl: 1.0611915588378906 (0.8181556447556144) | > loss_feat: 8.008918762207031 (5.998283792483179) | > loss_mel: 24.851234436035156 (23.394435681794818) | > loss_duration: 1.5810297727584839 (1.4811217094722546) | > loss_1: 37.01982498168945 (34.21958682411596) | > grad_norm_1: tensor(34721.4219, device='cuda:0') (tensor(34196.0547, device='cuda:0')) | > current_lr_0: 0.00010964850066201088 | > current_lr_1: 0.00010964850066201088 | > step_time: 0.5815 (0.6298266210054096) | > loader_time: 0.0252 (0.020727333269621197)  --> TIME: 2023-10-20 06:29:13 -- STEP: 49/50 -- GLOBAL_STEP: 83100 | > loss_disc: 1.6465988159179688 (2.4302547586207495) | > loss_disc_real_0: 0.03979179635643959 (0.14368890066232004) | > loss_disc_real_1: 0.13983306288719177 (0.22790919776473725) | > loss_disc_real_2: 0.2007189840078354 (0.23645876100933066) | > loss_disc_real_3: 0.09364619106054306 (0.22464445001464717) | > loss_disc_real_4: 0.09922536462545395 (0.22472044171727434) | > loss_disc_real_5: 0.06155470758676529 (0.21115895330297704) | > loss_0: 1.6465988159179688 (2.4302547586207495) | > grad_norm_0: tensor(673.5872, device='cuda:0') (tensor(606.9484, device='cuda:0')) | > loss_gen: 2.8520708084106445 (2.3498968518510157) | > loss_kl: 0.83186936378479 (0.8102262105260577) | > loss_feat: 8.919408798217773 (5.295085628117834) | > loss_mel: 33.12398910522461 (20.921373175114997) | > loss_duration: 1.5878525972366333 (1.4509705037486798) | > loss_1: 47.315189361572266 (30.827552055825993) | > grad_norm_1: tensor(106462.3438, device='cuda:0') (tensor(26353.9453, device='cuda:0')) | > current_lr_0: 0.00010964850066201088 | > current_lr_1: 0.00010964850066201088 | > step_time: 0.9569 (0.6384197643824986) | > loader_time: 0.528 (0.031832631753415476)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.693840980529785 (2.693840980529785) | > loss_disc_real_0: 0.3519822359085083 (0.3519822359085083) | > loss_disc_real_1: 0.2956360876560211 (0.2956360876560211) | > loss_disc_real_2: 0.24200354516506195 (0.24200354516506195) | > loss_disc_real_3: 0.223293736577034 (0.223293736577034) | > loss_disc_real_4: 0.31961390376091003 (0.31961390376091003) | > loss_disc_real_5: 0.3265388607978821 (0.3265388607978821) | > loss_0: 2.693840980529785 (2.693840980529785) | > loss_gen: 2.617410182952881 (2.617410182952881) | > loss_kl: 3.75714111328125 (3.75714111328125) | > loss_feat: 4.9861321449279785 (4.9861321449279785) | > loss_mel: 25.0966739654541 (25.0966739654541) | > loss_duration: 2.67586612701416 (2.67586612701416) | > loss_1: 39.13322067260742 (39.13322067260742)  --> STEP: 1 | > loss_disc: 2.8730850219726562 (2.8730850219726562) | > loss_disc_real_0: 0.2793399691581726 (0.2793399691581726) | > loss_disc_real_1: 0.22210440039634705 (0.22210440039634705) | > loss_disc_real_2: 0.24106067419052124 (0.24106067419052124) | > loss_disc_real_3: 0.2442738562822342 (0.2442738562822342) | > loss_disc_real_4: 0.21795810759067535 (0.21795810759067535) | > loss_disc_real_5: 0.1743866205215454 (0.1743866205215454) | > loss_0: 2.8730850219726562 (2.8730850219726562) | > loss_gen: 1.6191056966781616 (1.6191056966781616) | > loss_kl: 4.466366767883301 (4.466366767883301) | > loss_feat: 1.0408611297607422 (1.0408611297607422) | > loss_mel: 12.670174598693848 (12.670174598693848) | > loss_duration: 2.9262850284576416 (2.9262850284576416) | > loss_1: 22.722793579101562 (22.722793579101562)  --> STEP: 2 | > loss_disc: 3.0204415321350098 (2.946763277053833) | > loss_disc_real_0: 0.32015329599380493 (0.29974663257598877) | > loss_disc_real_1: 0.2507005035877228 (0.2364024519920349) | > loss_disc_real_2: 0.23461301624774933 (0.23783684521913528) | > loss_disc_real_3: 0.27931782603263855 (0.26179584115743637) | > loss_disc_real_4: 0.24577191472053528 (0.23186501115560532) | > loss_disc_real_5: 0.23075024783611298 (0.2025684341788292) | > loss_0: 3.0204415321350098 (2.946763277053833) | > loss_gen: 1.554966926574707 (1.5870363116264343) | > loss_kl: 4.729816913604736 (4.5980918407440186) | > loss_feat: 0.06168699264526367 (0.5512740612030029) | > loss_mel: 2.255542755126953 (7.4628586769104) | > loss_duration: 2.9340569972991943 (2.930171012878418) | > loss_1: 11.536070823669434 (17.129432201385498)  --> STEP: 3 | > loss_disc: 2.412578582763672 (2.768701712290446) | > loss_disc_real_0: 0.25347691774368286 (0.28432339429855347) | > loss_disc_real_1: 0.12411919981241226 (0.19897470126549402) | > loss_disc_real_2: 0.1170513704419136 (0.19757502029339472) | > loss_disc_real_3: 0.21347396075725555 (0.24568854769070944) | > loss_disc_real_4: 0.09551119804382324 (0.18641374011834463) | > loss_disc_real_5: 0.036559805274009705 (0.14723222454388937) | > loss_0: 2.412578582763672 (2.768701712290446) | > loss_gen: 1.8221049308776855 (1.665392518043518) | > loss_kl: 2.3395705223083496 (3.8452514012654624) | > loss_feat: 7.146317958831787 (2.749622027079264) | > loss_mel: 26.01412010192871 (13.646612485249838) | > loss_duration: 2.6662018299102783 (2.8421812852223716) | > loss_1: 39.98831558227539 (24.74905999501546) --> EVAL PERFORMANCE | > avg_loader_time: 0.009439786275227865 (+0.0031538009643554696) | > avg_loss_disc: 2.768701712290446 (+0.4780083497365313) | > avg_loss_disc_real_0: 0.28432339429855347 (+0.06589239339033762) | > avg_loss_disc_real_1: 0.19897470126549402 (+0.025072865188121796) | > avg_loss_disc_real_2: 0.19757502029339472 (+0.016826694210370363) | > avg_loss_disc_real_3: 0.24568854769070944 (+0.11123757561047873) | > avg_loss_disc_real_4: 0.18641374011834463 (+0.01141076534986496) | > avg_loss_disc_real_5: 0.14723222454388937 (-0.05091413358847299) | > avg_loss_0: 2.768701712290446 (+0.4780083497365313) | > avg_loss_gen: 1.665392518043518 (-0.6445304155349731) | > avg_loss_kl: 3.8452514012654624 (+0.22307395935058594) | > avg_loss_feat: 2.749622027079264 (-4.78929885228475) | > avg_loss_mel: 13.646612485249838 (-11.759780565897623) | > avg_loss_duration: 2.8421812852223716 (-0.05692267417907715) | > avg_loss_1: 24.74905999501546 (-17.02745787302653)  > EPOCH: 602/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:29:34)   --> TIME: 2023-10-20 06:29:57 -- STEP: 29/50 -- GLOBAL_STEP: 83130 | > loss_disc: 1.7945393323898315 (2.4806563772004226) | > loss_disc_real_0: 0.162525475025177 (0.1522562342760121) | > loss_disc_real_1: 0.156668558716774 (0.21941938020032029) | > loss_disc_real_2: 0.19899870455265045 (0.23094578832387924) | > loss_disc_real_3: 0.09244387596845627 (0.22893672423629924) | > loss_disc_real_4: 0.09871882945299149 (0.2047850289863759) | > loss_disc_real_5: 0.16054455935955048 (0.19323472453859344) | > loss_0: 1.7945393323898315 (2.4806563772004226) | > grad_norm_0: tensor(400.2817, device='cuda:0') (tensor(603.3144, device='cuda:0')) | > loss_gen: 2.96445631980896 (2.3751761050059885) | > loss_kl: 0.8731065988540649 (0.9681189774439253) | > loss_feat: 9.596548080444336 (5.305596957175896) | > loss_mel: 24.075971603393555 (20.305786453444384) | > loss_duration: 1.496679425239563 (1.4602325168149224) | > loss_1: 39.00676345825195 (30.414911516781512) | > grad_norm_1: tensor(7374.0200, device='cuda:0') (tensor(25235.6973, device='cuda:0')) | > current_lr_0: 0.00010953890012057695 | > current_lr_1: 0.00010953890012057695 | > step_time: 0.3839 (0.5779638619258486) | > loader_time: 0.0116 (0.01733220856765221)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3931593894958496 (2.3931593894958496) | > loss_disc_real_0: 0.14596958458423615 (0.14596958458423615) | > loss_disc_real_1: 0.27610406279563904 (0.27610406279563904) | > loss_disc_real_2: 0.21821054816246033 (0.21821054816246033) | > loss_disc_real_3: 0.1553044319152832 (0.1553044319152832) | > loss_disc_real_4: 0.21602410078048706 (0.21602410078048706) | > loss_disc_real_5: 0.22038184106349945 (0.22038184106349945) | > loss_0: 2.3931593894958496 (2.3931593894958496) | > loss_gen: 2.290435314178467 (2.290435314178467) | > loss_kl: 3.779794216156006 (3.779794216156006) | > loss_feat: 7.914838790893555 (7.914838790893555) | > loss_mel: 26.973581314086914 (26.973581314086914) | > loss_duration: 2.6709134578704834 (2.6709134578704834) | > loss_1: 43.62956237792969 (43.62956237792969)  --> STEP: 1 | > loss_disc: 2.5470595359802246 (2.5470595359802246) | > loss_disc_real_0: 0.1141432672739029 (0.1141432672739029) | > loss_disc_real_1: 0.39284390211105347 (0.39284390211105347) | > loss_disc_real_2: 0.28070464730262756 (0.28070464730262756) | > loss_disc_real_3: 0.2680077850818634 (0.2680077850818634) | > loss_disc_real_4: 0.16496387124061584 (0.16496387124061584) | > loss_disc_real_5: 0.22804594039916992 (0.22804594039916992) | > loss_0: 2.5470595359802246 (2.5470595359802246) | > loss_gen: 2.171945571899414 (2.171945571899414) | > loss_kl: 4.126621723175049 (4.126621723175049) | > loss_feat: 2.2473909854888916 (2.2473909854888916) | > loss_mel: 18.955659866333008 (18.955659866333008) | > loss_duration: 2.981703996658325 (2.981703996658325) | > loss_1: 30.48332405090332 (30.48332405090332)  --> STEP: 2 | > loss_disc: 2.925523281097412 (2.7362914085388184) | > loss_disc_real_0: 0.18171781301498413 (0.1479305401444435) | > loss_disc_real_1: 0.3333854079246521 (0.3631146550178528) | > loss_disc_real_2: 0.30078667402267456 (0.29074566066265106) | > loss_disc_real_3: 0.2645759582519531 (0.26629187166690826) | > loss_disc_real_4: 0.2936558723449707 (0.22930987179279327) | > loss_disc_real_5: 0.25731360912323 (0.24267977476119995) | > loss_0: 2.925523281097412 (2.7362914085388184) | > loss_gen: 1.736248254776001 (1.9540969133377075) | > loss_kl: 4.716784954071045 (4.421703338623047) | > loss_feat: 0.4135224223136902 (1.330456703901291) | > loss_mel: 23.3259220123291 (21.140790939331055) | > loss_duration: 2.8271069526672363 (2.9044054746627808) | > loss_1: 33.01958465576172 (31.75145435333252)  --> STEP: 3 | > loss_disc: 1.5911074876785278 (2.3545634349187217) | > loss_disc_real_0: 0.13445772230625153 (0.14343960086504617) | > loss_disc_real_1: 0.2655021548271179 (0.3305771549542745) | > loss_disc_real_2: 0.14464224874973297 (0.24204452335834503) | > loss_disc_real_3: 0.12556380033493042 (0.219382514556249) | > loss_disc_real_4: 0.13058413565158844 (0.19640129307905832) | > loss_disc_real_5: 0.08840812742710114 (0.19125589231650034) | > loss_0: 1.5911074876785278 (2.3545634349187217) | > loss_gen: 3.052422046661377 (2.320205291112264) | > loss_kl: 2.288775682449341 (3.7107274532318115) | > loss_feat: 6.948981285095215 (3.2032982309659324) | > loss_mel: 23.15148162841797 (21.81102116902669) | > loss_duration: 2.694481611251831 (2.8344308535257974) | > loss_1: 38.136138916015625 (33.879682540893555) --> EVAL PERFORMANCE | > avg_loader_time: 0.011379559834798178 (+0.0019397735595703125) | > avg_loss_disc: 2.3545634349187217 (-0.41413827737172415) | > avg_loss_disc_real_0: 0.14343960086504617 (-0.1408837934335073) | > avg_loss_disc_real_1: 0.3305771549542745 (+0.13160245368878046) | > avg_loss_disc_real_2: 0.24204452335834503 (+0.044469503064950316) | > avg_loss_disc_real_3: 0.219382514556249 (-0.02630603313446045) | > avg_loss_disc_real_4: 0.19640129307905832 (+0.009987552960713686) | > avg_loss_disc_real_5: 0.19125589231650034 (+0.044023667772610964) | > avg_loss_0: 2.3545634349187217 (-0.41413827737172415) | > avg_loss_gen: 2.320205291112264 (+0.6548127730687461) | > avg_loss_kl: 3.7107274532318115 (-0.13452394803365086) | > avg_loss_feat: 3.2032982309659324 (+0.4536762038866682) | > avg_loss_mel: 21.81102116902669 (+8.164408683776854) | > avg_loss_duration: 2.8344308535257974 (-0.007750431696574189) | > avg_loss_1: 33.879682540893555 (+9.130622545878094)  > EPOCH: 603/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:30:21)   --> TIME: 2023-10-20 06:30:31 -- STEP: 9/50 -- GLOBAL_STEP: 83160 | > loss_disc: 2.612886667251587 (2.4834183322058783) | > loss_disc_real_0: 0.09891565889120102 (0.1458288472559717) | > loss_disc_real_1: 0.24977600574493408 (0.2845935763584243) | > loss_disc_real_2: 0.3064083456993103 (0.26017416185802883) | > loss_disc_real_3: 0.26828059554100037 (0.26617127656936646) | > loss_disc_real_4: 0.20988304913043976 (0.23483389450444114) | > loss_disc_real_5: 0.3742932975292206 (0.24407006220685112) | > loss_0: 2.612886667251587 (2.4834183322058783) | > grad_norm_0: tensor(572.5258, device='cuda:0') (tensor(439.5164, device='cuda:0')) | > loss_gen: 2.1857542991638184 (2.5077108807033963) | > loss_kl: 0.610684871673584 (0.8171678864293628) | > loss_feat: 3.9701149463653564 (6.293623208999634) | > loss_mel: 22.305789947509766 (22.239106708102756) | > loss_duration: 1.3799114227294922 (1.4591810173458524) | > loss_1: 30.452255249023438 (33.31678920321994) | > grad_norm_1: tensor(3166.7046, device='cuda:0') (tensor(22608.5781, device='cuda:0')) | > current_lr_0: 0.0001094294091317462 | > current_lr_1: 0.0001094294091317462 | > step_time: 0.8372 (0.6390391455756294) | > loader_time: 0.0364 (0.025880098342895508)  --> TIME: 2023-10-20 06:30:50 -- STEP: 39/50 -- GLOBAL_STEP: 83190 | > loss_disc: 2.1107351779937744 (2.440215853544382) | > loss_disc_real_0: 0.1012512668967247 (0.16010970073059583) | > loss_disc_real_1: 0.2893315851688385 (0.23546632656302208) | > loss_disc_real_2: 0.21683911979198456 (0.2234068172864425) | > loss_disc_real_3: 0.1766565591096878 (0.23120562139994058) | > loss_disc_real_4: 0.12637418508529663 (0.2076798418106941) | > loss_disc_real_5: 0.13927620649337769 (0.240091206267094) | > loss_0: 2.1107351779937744 (2.440215853544382) | > grad_norm_0: tensor(900.5267, device='cuda:0') (tensor(604.2264, device='cuda:0')) | > loss_gen: 2.527101516723633 (2.3938938470987177) | > loss_kl: 0.7895678877830505 (0.8650375818594908) | > loss_feat: 5.165525436401367 (5.906748855534273) | > loss_mel: 15.15027904510498 (22.5829527928279) | > loss_duration: 1.4914300441741943 (1.450646935365139) | > loss_1: 25.123905181884766 (33.19927961398394) | > grad_norm_1: tensor(33104.9023, device='cuda:0') (tensor(23343.3379, device='cuda:0')) | > current_lr_0: 0.0001094294091317462 | > current_lr_1: 0.0001094294091317462 | > step_time: 0.5146 (0.6105114741203113) | > loader_time: 0.0025 (0.01825741621164175)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.736578941345215 (2.736578941345215) | > loss_disc_real_0: 0.35871297121047974 (0.35871297121047974) | > loss_disc_real_1: 0.39319342374801636 (0.39319342374801636) | > loss_disc_real_2: 0.3437976539134979 (0.3437976539134979) | > loss_disc_real_3: 0.3381403982639313 (0.3381403982639313) | > loss_disc_real_4: 0.24222733080387115 (0.24222733080387115) | > loss_disc_real_5: 0.19517828524112701 (0.19517828524112701) | > loss_0: 2.736578941345215 (2.736578941345215) | > loss_gen: 2.605224370956421 (2.605224370956421) | > loss_kl: 4.254281997680664 (4.254281997680664) | > loss_feat: 3.6693382263183594 (3.6693382263183594) | > loss_mel: 26.975584030151367 (26.975584030151367) | > loss_duration: 2.8072633743286133 (2.8072633743286133) | > loss_1: 40.31169128417969 (40.31169128417969)  --> STEP: 1 | > loss_disc: 3.3041815757751465 (3.3041815757751465) | > loss_disc_real_0: 0.30897802114486694 (0.30897802114486694) | > loss_disc_real_1: 0.374834269285202 (0.374834269285202) | > loss_disc_real_2: 0.38585686683654785 (0.38585686683654785) | > loss_disc_real_3: 0.3028217554092407 (0.3028217554092407) | > loss_disc_real_4: 0.29968979954719543 (0.29968979954719543) | > loss_disc_real_5: 0.4390668272972107 (0.4390668272972107) | > loss_0: 3.3041815757751465 (3.3041815757751465) | > loss_gen: 2.1299939155578613 (2.1299939155578613) | > loss_kl: 4.147398948669434 (4.147398948669434) | > loss_feat: 2.9198315143585205 (2.9198315143585205) | > loss_mel: 19.816566467285156 (19.816566467285156) | > loss_duration: 3.0767264366149902 (3.0767264366149902) | > loss_1: 32.09051513671875 (32.09051513671875)  --> STEP: 2 | > loss_disc: 1.6243926286697388 (2.4642871022224426) | > loss_disc_real_0: 0.09593012183904648 (0.2024540714919567) | > loss_disc_real_1: 0.3169240951538086 (0.3458791822195053) | > loss_disc_real_2: 0.23670558631420135 (0.3112812265753746) | > loss_disc_real_3: 0.12393666058778763 (0.21337920799851418) | > loss_disc_real_4: 0.08830775320529938 (0.1939987763762474) | > loss_disc_real_5: 0.18564410507678986 (0.3123554661870003) | > loss_0: 1.6243926286697388 (2.4642871022224426) | > loss_gen: 4.02228307723999 (3.076138496398926) | > loss_kl: 4.923013687133789 (4.535206317901611) | > loss_feat: 11.58242130279541 (7.251126408576965) | > loss_mel: 26.180824279785156 (22.998695373535156) | > loss_duration: 3.0107758045196533 (3.0437511205673218) | > loss_1: 49.71931838989258 (40.904916763305664)  --> STEP: 3 | > loss_disc: 2.6821906566619873 (2.5369216203689575) | > loss_disc_real_0: 0.15546739101409912 (0.18679184466600418) | > loss_disc_real_1: 0.3343392014503479 (0.3420325219631195) | > loss_disc_real_2: 0.32715457677841187 (0.31657234330972034) | > loss_disc_real_3: 0.3185272216796875 (0.24842854589223862) | > loss_disc_real_4: 0.2878778576850891 (0.22529180347919464) | > loss_disc_real_5: 0.26144739985466003 (0.29538611074288684) | > loss_0: 2.6821906566619873 (2.5369216203689575) | > loss_gen: 2.2176480293273926 (2.7899750073750815) | > loss_kl: 1.8927944898605347 (3.6544023752212524) | > loss_feat: 1.3439373970031738 (5.282063404719035) | > loss_mel: 15.231937408447266 (20.40977605183919) | > loss_duration: 2.7820496559143066 (2.956517299016317) | > loss_1: 23.468366622924805 (35.09273338317871) --> EVAL PERFORMANCE | > avg_loader_time: 0.0352171262105306 (+0.023837566375732422) | > avg_loss_disc: 2.5369216203689575 (+0.18235818545023585) | > avg_loss_disc_real_0: 0.18679184466600418 (+0.04335224380095801) | > avg_loss_disc_real_1: 0.3420325219631195 (+0.01145536700884503) | > avg_loss_disc_real_2: 0.31657234330972034 (+0.07452781995137531) | > avg_loss_disc_real_3: 0.24842854589223862 (+0.029046031335989625) | > avg_loss_disc_real_4: 0.22529180347919464 (+0.02889051040013632) | > avg_loss_disc_real_5: 0.29538611074288684 (+0.1041302184263865) | > avg_loss_0: 2.5369216203689575 (+0.18235818545023585) | > avg_loss_gen: 2.7899750073750815 (+0.4697697162628174) | > avg_loss_kl: 3.6544023752212524 (-0.05632507801055908) | > avg_loss_feat: 5.282063404719035 (+2.0787651737531028) | > avg_loss_mel: 20.40977605183919 (-1.4012451171875) | > avg_loss_duration: 2.956517299016317 (+0.1220864454905195) | > avg_loss_1: 35.09273338317871 (+1.2130508422851562)  > EPOCH: 604/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:31:15)   --> TIME: 2023-10-20 06:31:34 -- STEP: 19/50 -- GLOBAL_STEP: 83220 | > loss_disc: 2.1358659267425537 (2.4465078366430184) | > loss_disc_real_0: 0.035246916115283966 (0.13597775691826092) | > loss_disc_real_1: 0.119331493973732 (0.23552393677987551) | > loss_disc_real_2: 0.10980377346277237 (0.21694922211923098) | > loss_disc_real_3: 0.25645163655281067 (0.26354144356752696) | > loss_disc_real_4: 0.11173312366008759 (0.2415796147757455) | > loss_disc_real_5: 0.06121470406651497 (0.24295139783307126) | > loss_0: 2.1358659267425537 (2.4465078366430184) | > grad_norm_0: tensor(893.3692, device='cuda:0') (tensor(644.3908, device='cuda:0')) | > loss_gen: 2.1211934089660645 (2.345750432265432) | > loss_kl: 1.073781967163086 (0.8320241787127758) | > loss_feat: 6.661802291870117 (5.640624793932626) | > loss_mel: 24.256071090698242 (22.265722406537908) | > loss_duration: 1.5790445804595947 (1.485041712459765) | > loss_1: 35.69189453125 (32.56916332244873) | > grad_norm_1: tensor(28732.5156, device='cuda:0') (tensor(33749.5586, device='cuda:0')) | > current_lr_0: 0.00010932002758601392 | > current_lr_1: 0.00010932002758601392 | > step_time: 0.8167 (0.6357758798097309) | > loader_time: 0.0434 (0.02437759700574373)  --> TIME: 2023-10-20 06:31:53 -- STEP: 49/50 -- GLOBAL_STEP: 83250 | > loss_disc: 2.145038366317749 (2.3556575994102316) | > loss_disc_real_0: 0.14002938568592072 (0.14761639291382564) | > loss_disc_real_1: 0.2358672022819519 (0.22299879937603764) | > loss_disc_real_2: 0.08044443279504776 (0.21263875447365702) | > loss_disc_real_3: 0.20073918998241425 (0.2373634286376895) | > loss_disc_real_4: 0.2805292010307312 (0.21481942423448272) | > loss_disc_real_5: 0.26028716564178467 (0.2224106337799102) | > loss_0: 2.145038366317749 (2.3556575994102316) | > grad_norm_0: tensor(563.5376, device='cuda:0') (tensor(653.0725, device='cuda:0')) | > loss_gen: 2.478353500366211 (2.342521871839252) | > loss_kl: 0.5865491628646851 (0.8689007700173831) | > loss_feat: 5.239738941192627 (5.401640409641729) | > loss_mel: 24.47747230529785 (21.67077283226714) | > loss_duration: 1.5737682580947876 (1.4544138859729374) | > loss_1: 34.35588073730469 (31.73824981767304) | > grad_norm_1: tensor(17453.9512, device='cuda:0') (tensor(24642.0586, device='cuda:0')) | > current_lr_0: 0.00010932002758601392 | > current_lr_1: 0.00010932002758601392 | > step_time: 0.575 (0.604904539731084) | > loader_time: 0.4978 (0.03268705095563616)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6526739597320557 (2.6526739597320557) | > loss_disc_real_0: 0.20563049614429474 (0.20563049614429474) | > loss_disc_real_1: 0.17125390470027924 (0.17125390470027924) | > loss_disc_real_2: 0.23440323770046234 (0.23440323770046234) | > loss_disc_real_3: 0.2687525153160095 (0.2687525153160095) | > loss_disc_real_4: 0.20242510735988617 (0.20242510735988617) | > loss_disc_real_5: 0.27066847681999207 (0.27066847681999207) | > loss_0: 2.6526739597320557 (2.6526739597320557) | > loss_gen: 2.0053551197052 (2.0053551197052) | > loss_kl: 3.931878089904785 (3.931878089904785) | > loss_feat: 4.0125274658203125 (4.0125274658203125) | > loss_mel: 23.237621307373047 (23.237621307373047) | > loss_duration: 2.6870028972625732 (2.6870028972625732) | > loss_1: 35.874385833740234 (35.874385833740234)  --> STEP: 1 | > loss_disc: 1.9240275621414185 (1.9240275621414185) | > loss_disc_real_0: 0.08241306990385056 (0.08241306990385056) | > loss_disc_real_1: 0.22990302741527557 (0.22990302741527557) | > loss_disc_real_2: 0.1924160271883011 (0.1924160271883011) | > loss_disc_real_3: 0.25784289836883545 (0.25784289836883545) | > loss_disc_real_4: 0.20560550689697266 (0.20560550689697266) | > loss_disc_real_5: 0.18393738567829132 (0.18393738567829132) | > loss_0: 1.9240275621414185 (1.9240275621414185) | > loss_gen: 3.0072946548461914 (3.0072946548461914) | > loss_kl: 4.543455600738525 (4.543455600738525) | > loss_feat: 7.923220634460449 (7.923220634460449) | > loss_mel: 26.928010940551758 (26.928010940551758) | > loss_duration: 3.131397247314453 (3.131397247314453) | > loss_1: 45.53337860107422 (45.53337860107422)  --> STEP: 2 | > loss_disc: 1.4025250673294067 (1.6632763147354126) | > loss_disc_real_0: 0.03948386013507843 (0.06094846501946449) | > loss_disc_real_1: 0.13343171775341034 (0.18166737258434296) | > loss_disc_real_2: 0.06772179901599884 (0.13006891310214996) | > loss_disc_real_3: 0.22707879543304443 (0.24246084690093994) | > loss_disc_real_4: 0.08265837281942368 (0.14413193985819817) | > loss_disc_real_5: 0.05533597990870476 (0.11963668279349804) | > loss_0: 1.4025250673294067 (1.6632763147354126) | > loss_gen: 3.1037495136260986 (3.055522084236145) | > loss_kl: 4.943344593048096 (4.7434000968933105) | > loss_feat: 9.832931518554688 (8.878076076507568) | > loss_mel: 26.640378952026367 (26.784194946289062) | > loss_duration: 2.945143699645996 (3.0382704734802246) | > loss_1: 47.46554946899414 (46.49946403503418)  --> STEP: 3 | > loss_disc: 2.7675819396972656 (2.031378189722697) | > loss_disc_real_0: 0.11282601207494736 (0.07824098070462544) | > loss_disc_real_1: 0.3063220679759979 (0.22321893771489462) | > loss_disc_real_2: 0.2982158660888672 (0.1861178974310557) | > loss_disc_real_3: 0.2170623540878296 (0.23399468262990317) | > loss_disc_real_4: 0.18956877291202545 (0.1592775508761406) | > loss_disc_real_5: 0.4143712818622589 (0.21788154914975166) | > loss_0: 2.7675819396972656 (2.031378189722697) | > loss_gen: 1.9628313779830933 (2.691291848818461) | > loss_kl: 1.8334366083145142 (3.773412267367045) | > loss_feat: 4.680700778961182 (7.4789509773254395) | > loss_mel: 23.80141258239746 (25.789934158325195) | > loss_duration: 2.8286757469177246 (2.968405564626058) | > loss_1: 35.1070556640625 (42.70199457804362) --> EVAL PERFORMANCE | > avg_loader_time: 0.004106442133585612 (-0.031110684076944988) | > avg_loss_disc: 2.031378189722697 (-0.5055434306462607) | > avg_loss_disc_real_0: 0.07824098070462544 (-0.10855086396137874) | > avg_loss_disc_real_1: 0.22321893771489462 (-0.11881358424822488) | > avg_loss_disc_real_2: 0.1861178974310557 (-0.13045444587866464) | > avg_loss_disc_real_3: 0.23399468262990317 (-0.01443386326233545) | > avg_loss_disc_real_4: 0.1592775508761406 (-0.06601425260305405) | > avg_loss_disc_real_5: 0.21788154914975166 (-0.07750456159313518) | > avg_loss_0: 2.031378189722697 (-0.5055434306462607) | > avg_loss_gen: 2.691291848818461 (-0.09868315855662058) | > avg_loss_kl: 3.773412267367045 (+0.1190098921457925) | > avg_loss_feat: 7.4789509773254395 (+2.1968875726064043) | > avg_loss_mel: 25.789934158325195 (+5.380158106486004) | > avg_loss_duration: 2.968405564626058 (+0.011888265609741211) | > avg_loss_1: 42.70199457804362 (+7.6092611948649065)  > EPOCH: 605/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:32:08)   --> TIME: 2023-10-20 06:32:31 -- STEP: 29/50 -- GLOBAL_STEP: 83280 | > loss_disc: 2.7779245376586914 (2.417163302158486) | > loss_disc_real_0: 0.20428180694580078 (0.13868287334154392) | > loss_disc_real_1: 0.236722931265831 (0.22792545885875307) | > loss_disc_real_2: 0.12700751423835754 (0.24112585341108256) | > loss_disc_real_3: 0.24098654091358185 (0.23545230064412642) | > loss_disc_real_4: 0.24034352600574493 (0.21128440545550708) | > loss_disc_real_5: 0.33931320905685425 (0.22438316766558022) | > loss_0: 2.7779245376586914 (2.417163302158486) | > grad_norm_0: tensor(357.8656, device='cuda:0') (tensor(681.4943, device='cuda:0')) | > loss_gen: 1.6785012483596802 (2.4314073077563583) | > loss_kl: 1.0330559015274048 (0.8934068720916222) | > loss_feat: 1.3667863607406616 (5.907496447707045) | > loss_mel: 16.88469886779785 (22.395034921580347) | > loss_duration: 1.4445708990097046 (1.4684378936372955) | > loss_1: 22.40761375427246 (33.0957834309545) | > grad_norm_1: tensor(4004.9250, device='cuda:0') (tensor(31093.6484, device='cuda:0')) | > current_lr_0: 0.00010921075537398493 | > current_lr_1: 0.00010921075537398493 | > step_time: 0.4846 (0.47281090144453375) | > loader_time: 0.0021 (0.011825117571600555)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.767848253250122 (2.767848253250122) | > loss_disc_real_0: 0.3341906666755676 (0.3341906666755676) | > loss_disc_real_1: 0.15977385640144348 (0.15977385640144348) | > loss_disc_real_2: 0.23673027753829956 (0.23673027753829956) | > loss_disc_real_3: 0.2908737361431122 (0.2908737361431122) | > loss_disc_real_4: 0.27594006061553955 (0.27594006061553955) | > loss_disc_real_5: 0.2855617105960846 (0.2855617105960846) | > loss_0: 2.767848253250122 (2.767848253250122) | > loss_gen: 2.0592644214630127 (2.0592644214630127) | > loss_kl: 4.84929895401001 (4.84929895401001) | > loss_feat: 3.881032943725586 (3.881032943725586) | > loss_mel: 22.96795082092285 (22.96795082092285) | > loss_duration: 2.668109178543091 (2.668109178543091) | > loss_1: 36.425655364990234 (36.425655364990234)  --> STEP: 1 | > loss_disc: 2.475475311279297 (2.475475311279297) | > loss_disc_real_0: 0.42421090602874756 (0.42421090602874756) | > loss_disc_real_1: 0.2565917372703552 (0.2565917372703552) | > loss_disc_real_2: 0.20045095682144165 (0.20045095682144165) | > loss_disc_real_3: 0.28486260771751404 (0.28486260771751404) | > loss_disc_real_4: 0.1884327232837677 (0.1884327232837677) | > loss_disc_real_5: 0.22771015763282776 (0.22771015763282776) | > loss_0: 2.475475311279297 (2.475475311279297) | > loss_gen: 2.565882682800293 (2.565882682800293) | > loss_kl: 4.97927713394165 (4.97927713394165) | > loss_feat: 6.788891792297363 (6.788891792297363) | > loss_mel: 21.752538681030273 (21.752538681030273) | > loss_duration: 3.0175349712371826 (3.0175349712371826) | > loss_1: 39.1041259765625 (39.1041259765625)  --> STEP: 2 | > loss_disc: 2.944939374923706 (2.7102073431015015) | > loss_disc_real_0: 0.36949658393859863 (0.3968537449836731) | > loss_disc_real_1: 0.21301157772541046 (0.23480165749788284) | > loss_disc_real_2: 0.2595292031764984 (0.22999007999897003) | > loss_disc_real_3: 0.21753406524658203 (0.25119833648204803) | > loss_disc_real_4: 0.25102028250694275 (0.21972650289535522) | > loss_disc_real_5: 0.22817257046699524 (0.2279413640499115) | > loss_0: 2.944939374923706 (2.7102073431015015) | > loss_gen: 1.7226741313934326 (2.144278407096863) | > loss_kl: 4.529764652252197 (4.754520893096924) | > loss_feat: 2.583285093307495 (4.686088442802429) | > loss_mel: 12.7592134475708 (17.255876064300537) | > loss_duration: 2.8436198234558105 (2.9305773973464966) | > loss_1: 24.438556671142578 (31.77134132385254)  --> STEP: 3 | > loss_disc: 2.839514970779419 (2.753309885660807) | > loss_disc_real_0: 0.24110481142997742 (0.34493743379910785) | > loss_disc_real_1: 0.24254342913627625 (0.23738224804401398) | > loss_disc_real_2: 0.2093338966369629 (0.22310468554496765) | > loss_disc_real_3: 0.2568606436252594 (0.25308577219645184) | > loss_disc_real_4: 0.3011244535446167 (0.24685915311177573) | > loss_disc_real_5: 0.3083273768424988 (0.2547367016474406) | > loss_0: 2.839514970779419 (2.753309885660807) | > loss_gen: 1.7664926052093506 (2.018349806467692) | > loss_kl: 2.0728490352630615 (3.8606302738189697) | > loss_feat: 0.7726921439170837 (3.3816230098406472) | > loss_mel: 11.788151741027832 (15.433301289876303) | > loss_duration: 2.7635529041290283 (2.8749025662740073) | > loss_1: 19.163738250732422 (27.568806966145832) --> EVAL PERFORMANCE | > avg_loader_time: 0.012851556142171225 (+0.008745114008585613) | > avg_loss_disc: 2.753309885660807 (+0.7219316959381104) | > avg_loss_disc_real_0: 0.34493743379910785 (+0.2666964530944824) | > avg_loss_disc_real_1: 0.23738224804401398 (+0.014163310329119355) | > avg_loss_disc_real_2: 0.22310468554496765 (+0.036986788113911956) | > avg_loss_disc_real_3: 0.25308577219645184 (+0.019091089566548675) | > avg_loss_disc_real_4: 0.24685915311177573 (+0.08758160223563513) | > avg_loss_disc_real_5: 0.2547367016474406 (+0.03685515249768895) | > avg_loss_0: 2.753309885660807 (+0.7219316959381104) | > avg_loss_gen: 2.018349806467692 (-0.672942042350769) | > avg_loss_kl: 3.8606302738189697 (+0.08721800645192479) | > avg_loss_feat: 3.3816230098406472 (-4.097327967484793) | > avg_loss_mel: 15.433301289876303 (-10.356632868448893) | > avg_loss_duration: 2.8749025662740073 (-0.09350299835205078) | > avg_loss_1: 27.568806966145832 (-15.133187611897785)  > EPOCH: 606/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:32:59)   --> TIME: 2023-10-20 06:33:10 -- STEP: 9/50 -- GLOBAL_STEP: 83310 | > loss_disc: 2.792114734649658 (2.308306203948127) | > loss_disc_real_0: 0.3501772880554199 (0.13919433930681813) | > loss_disc_real_1: 0.2896377742290497 (0.22832304073704612) | > loss_disc_real_2: 0.22898408770561218 (0.192103809159663) | > loss_disc_real_3: 0.41337689757347107 (0.2511468682852056) | > loss_disc_real_4: 0.23893803358078003 (0.23913982945183912) | > loss_disc_real_5: 0.23684047162532806 (0.20259139676474863) | > loss_0: 2.792114734649658 (2.308306203948127) | > grad_norm_0: tensor(446.5410, device='cuda:0') (tensor(459.3079, device='cuda:0')) | > loss_gen: 2.3424832820892334 (2.4772008525000677) | > loss_kl: 0.33247339725494385 (0.8385123809178671) | > loss_feat: 4.7208476066589355 (6.63345628645685) | > loss_mel: 20.0044002532959 (22.17328911357456) | > loss_duration: 1.4730747938156128 (1.4560280243555705) | > loss_1: 28.87327766418457 (33.57848723729452) | > grad_norm_1: tensor(2254.5632, device='cuda:0') (tensor(18665.3125, device='cuda:0')) | > current_lr_0: 0.00010910159238637331 | > current_lr_1: 0.00010910159238637331 | > step_time: 0.5094 (0.6348895231882731) | > loader_time: 0.0193 (0.024544265535142686)  --> TIME: 2023-10-20 06:33:29 -- STEP: 39/50 -- GLOBAL_STEP: 83340 | > loss_disc: 3.028475522994995 (2.49792218208313) | > loss_disc_real_0: 0.16096699237823486 (0.15260033502888218) | > loss_disc_real_1: 0.25881174206733704 (0.22855699549500758) | > loss_disc_real_2: 0.2204129844903946 (0.22207354701673374) | > loss_disc_real_3: 0.25123852491378784 (0.24094495989191225) | > loss_disc_real_4: 0.23894010484218597 (0.23052676619054416) | > loss_disc_real_5: 0.25836095213890076 (0.23255278502041712) | > loss_0: 3.028475522994995 (2.49792218208313) | > grad_norm_0: tensor(544.5695, device='cuda:0') (tensor(570.9301, device='cuda:0')) | > loss_gen: 1.3746843338012695 (2.230882513217437) | > loss_kl: 0.6767739653587341 (0.8182206681141486) | > loss_feat: 0.09091080725193024 (4.923791525360102) | > loss_mel: 4.574029922485352 (21.244214171018356) | > loss_duration: 1.4694288969039917 (1.4464015379930153) | > loss_1: 8.18582820892334 (30.663510689368614) | > grad_norm_1: tensor(56038.0195, device='cuda:0') (tensor(17748.2227, device='cuda:0')) | > current_lr_0: 0.00010910159238637331 | > current_lr_1: 0.00010910159238637331 | > step_time: 0.4142 (0.6212882995605468) | > loader_time: 0.0173 (0.021862592452611677)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.928421974182129 (2.928421974182129) | > loss_disc_real_0: 0.2866204082965851 (0.2866204082965851) | > loss_disc_real_1: 0.26786479353904724 (0.26786479353904724) | > loss_disc_real_2: 0.25748252868652344 (0.25748252868652344) | > loss_disc_real_3: 0.24844300746917725 (0.24844300746917725) | > loss_disc_real_4: 0.270508348941803 (0.270508348941803) | > loss_disc_real_5: 0.265235036611557 (0.265235036611557) | > loss_0: 2.928421974182129 (2.928421974182129) | > loss_gen: 1.706352710723877 (1.706352710723877) | > loss_kl: 4.339552402496338 (4.339552402496338) | > loss_feat: 0.22937802970409393 (0.22937802970409393) | > loss_mel: 15.835454940795898 (15.835454940795898) | > loss_duration: 2.842237949371338 (2.842237949371338) | > loss_1: 24.952974319458008 (24.952974319458008)  --> STEP: 1 | > loss_disc: 1.2406845092773438 (1.2406845092773438) | > loss_disc_real_0: 0.04989103600382805 (0.04989103600382805) | > loss_disc_real_1: 0.09391665458679199 (0.09391665458679199) | > loss_disc_real_2: 0.10538724064826965 (0.10538724064826965) | > loss_disc_real_3: 0.11371853947639465 (0.11371853947639465) | > loss_disc_real_4: 0.10712551325559616 (0.10712551325559616) | > loss_disc_real_5: 0.04921267181634903 (0.04921267181634903) | > loss_0: 1.2406845092773438 (1.2406845092773438) | > loss_gen: 3.205303192138672 (3.205303192138672) | > loss_kl: 4.609451770782471 (4.609451770782471) | > loss_feat: 12.131901741027832 (12.131901741027832) | > loss_mel: 25.35049819946289 (25.35049819946289) | > loss_duration: 3.10124135017395 (3.10124135017395) | > loss_1: 48.39839553833008 (48.39839553833008)  --> STEP: 2 | > loss_disc: 2.8933491706848145 (2.067016839981079) | > loss_disc_real_0: 0.23677769303321838 (0.14333436451852322) | > loss_disc_real_1: 0.2547711730003357 (0.17434391379356384) | > loss_disc_real_2: 0.21923738718032837 (0.162312313914299) | > loss_disc_real_3: 0.2598111033439636 (0.18676482141017914) | > loss_disc_real_4: 0.27816087007522583 (0.192643191665411) | > loss_disc_real_5: 0.2681398093700409 (0.15867624059319496) | > loss_0: 2.8933491706848145 (2.067016839981079) | > loss_gen: 1.682250738143921 (2.4437769651412964) | > loss_kl: 4.47858190536499 (4.5440168380737305) | > loss_feat: 0.632841944694519 (6.3823718428611755) | > loss_mel: 14.928415298461914 (20.139456748962402) | > loss_duration: 2.8933908939361572 (2.9973161220550537) | > loss_1: 24.615480422973633 (36.506937980651855)  --> STEP: 3 | > loss_disc: 2.998931407928467 (2.377655029296875) | > loss_disc_real_0: 0.2770284414291382 (0.18789905682206154) | > loss_disc_real_1: 0.26579833030700684 (0.20482871929804483) | > loss_disc_real_2: 0.2594343423843384 (0.19468632340431213) | > loss_disc_real_3: 0.2476024180650711 (0.20704402029514313) | > loss_disc_real_4: 0.2706206738948822 (0.2186356857419014) | > loss_disc_real_5: 0.26539820432662964 (0.19425022850433984) | > loss_0: 2.998931407928467 (2.377655029296875) | > loss_gen: 1.5928568840026855 (2.1601369380950928) | > loss_kl: 2.1491384506225586 (3.7457240422566733) | > loss_feat: 0.05536655709147453 (4.273370080937942) | > loss_mel: 2.431260585784912 (14.236724694569906) | > loss_duration: 2.801506280899048 (2.9320461750030518) | > loss_1: 9.030128479003906 (27.34800148010254) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026788711547851562 (-0.010172684987386068) | > avg_loss_disc: 2.377655029296875 (-0.37565485636393214) | > avg_loss_disc_real_0: 0.18789905682206154 (-0.1570383769770463) | > avg_loss_disc_real_1: 0.20482871929804483 (-0.032553528745969146) | > avg_loss_disc_real_2: 0.19468632340431213 (-0.028418362140655518) | > avg_loss_disc_real_3: 0.20704402029514313 (-0.046041751901308714) | > avg_loss_disc_real_4: 0.2186356857419014 (-0.028223467369874328) | > avg_loss_disc_real_5: 0.19425022850433984 (-0.060486473143100766) | > avg_loss_0: 2.377655029296875 (-0.37565485636393214) | > avg_loss_gen: 2.1601369380950928 (+0.14178713162740086) | > avg_loss_kl: 3.7457240422566733 (-0.1149062315622964) | > avg_loss_feat: 4.273370080937942 (+0.8917470710972943) | > avg_loss_mel: 14.236724694569906 (-1.1965765953063965) | > avg_loss_duration: 2.9320461750030518 (+0.05714360872904445) | > avg_loss_1: 27.34800148010254 (-0.2208054860432931)  > EPOCH: 607/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:33:50)   --> TIME: 2023-10-20 06:34:08 -- STEP: 19/50 -- GLOBAL_STEP: 83370 | > loss_disc: 2.3035130500793457 (2.356089240626285) | > loss_disc_real_0: 0.23648135364055634 (0.14437801214425186) | > loss_disc_real_1: 0.1938484162092209 (0.22757276049570033) | > loss_disc_real_2: 0.1683734506368637 (0.2499467530532887) | > loss_disc_real_3: 0.2089795470237732 (0.23474925599600138) | > loss_disc_real_4: 0.28292134404182434 (0.20661733260280207) | > loss_disc_real_5: 0.2974194884300232 (0.2227274755898275) | > loss_0: 2.3035130500793457 (2.356089240626285) | > grad_norm_0: tensor(411.4203, device='cuda:0') (tensor(533.4088, device='cuda:0')) | > loss_gen: 2.669607162475586 (2.419501405013235) | > loss_kl: 0.8241370320320129 (0.8827741616650632) | > loss_feat: 6.913649559020996 (5.371549748864613) | > loss_mel: 24.06113624572754 (21.084097090520356) | > loss_duration: 1.5610600709915161 (1.4821326732635498) | > loss_1: 36.02959060668945 (31.240054883454974) | > grad_norm_1: tensor(19072.3398, device='cuda:0') (tensor(22827.0117, device='cuda:0')) | > current_lr_0: 0.00010899253851400246 | > current_lr_1: 0.00010899253851400246 | > step_time: 0.4919 (0.6040104188417134) | > loader_time: 0.0307 (0.02626421577052066)  --> TIME: 2023-10-20 06:34:28 -- STEP: 49/50 -- GLOBAL_STEP: 83400 | > loss_disc: 2.543120861053467 (2.3160558865994814) | > loss_disc_real_0: 0.3099273443222046 (0.13522980061872877) | > loss_disc_real_1: 0.2730863094329834 (0.22109911324722425) | > loss_disc_real_2: 0.16964450478553772 (0.21697446681102928) | > loss_disc_real_3: 0.3382709324359894 (0.22423606183455916) | > loss_disc_real_4: 0.21668390929698944 (0.20756611385743837) | > loss_disc_real_5: 0.24680490791797638 (0.21319437219894358) | > loss_0: 2.543120861053467 (2.3160558865994814) | > grad_norm_0: tensor(1634.3705, device='cuda:0') (tensor(577.0248, device='cuda:0')) | > loss_gen: 2.538386583328247 (2.4674306280758915) | > loss_kl: 1.0643419027328491 (0.8552988101633228) | > loss_feat: 3.1968507766723633 (6.143475404731473) | > loss_mel: 21.21398162841797 (21.997612473916035) | > loss_duration: 1.5696395635604858 (1.4467419361581608) | > loss_1: 29.583200454711914 (32.91055888545756) | > grad_norm_1: tensor(16216.6299, device='cuda:0') (tensor(20737.9434, device='cuda:0')) | > current_lr_0: 0.00010899253851400246 | > current_lr_1: 0.00010899253851400246 | > step_time: 0.735 (0.6186729450615086) | > loader_time: 0.4785 (0.03322080690033582)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.85988712310791 (2.85988712310791) | > loss_disc_real_0: 0.3763236105442047 (0.3763236105442047) | > loss_disc_real_1: 0.27587980031967163 (0.27587980031967163) | > loss_disc_real_2: 0.23375780880451202 (0.23375780880451202) | > loss_disc_real_3: 0.29985758662223816 (0.29985758662223816) | > loss_disc_real_4: 0.22279377281665802 (0.22279377281665802) | > loss_disc_real_5: 0.22245487570762634 (0.22245487570762634) | > loss_0: 2.85988712310791 (2.85988712310791) | > loss_gen: 2.0146636962890625 (2.0146636962890625) | > loss_kl: 4.073222637176514 (4.073222637176514) | > loss_feat: 0.831972599029541 (0.831972599029541) | > loss_mel: 18.792144775390625 (18.792144775390625) | > loss_duration: 2.675659656524658 (2.675659656524658) | > loss_1: 28.387662887573242 (28.387662887573242)  --> STEP: 1 | > loss_disc: 3.2060275077819824 (3.2060275077819824) | > loss_disc_real_0: 0.30291518568992615 (0.30291518568992615) | > loss_disc_real_1: 0.2997012436389923 (0.2997012436389923) | > loss_disc_real_2: 0.3007676601409912 (0.3007676601409912) | > loss_disc_real_3: 0.3453517556190491 (0.3453517556190491) | > loss_disc_real_4: 0.3549001216888428 (0.3549001216888428) | > loss_disc_real_5: 0.3460868299007416 (0.3460868299007416) | > loss_0: 3.2060275077819824 (3.2060275077819824) | > loss_gen: 2.5384888648986816 (2.5384888648986816) | > loss_kl: 4.464153289794922 (4.464153289794922) | > loss_feat: 4.50409460067749 (4.50409460067749) | > loss_mel: 23.849992752075195 (23.849992752075195) | > loss_duration: 3.0277836322784424 (3.0277836322784424) | > loss_1: 38.38451385498047 (38.38451385498047)  --> STEP: 2 | > loss_disc: 2.261565685272217 (2.7337965965270996) | > loss_disc_real_0: 0.37696975469589233 (0.33994247019290924) | > loss_disc_real_1: 0.3342249095439911 (0.3169630765914917) | > loss_disc_real_2: 0.4012707769870758 (0.3510192185640335) | > loss_disc_real_3: 0.28524407744407654 (0.3152979165315628) | > loss_disc_real_4: 0.14259716868400574 (0.24874864518642426) | > loss_disc_real_5: 0.1469365358352661 (0.24651168286800385) | > loss_0: 2.261565685272217 (2.7337965965270996) | > loss_gen: 3.5270183086395264 (3.032753586769104) | > loss_kl: 4.6210198402404785 (4.5425865650177) | > loss_feat: 6.286670684814453 (5.395382642745972) | > loss_mel: 22.785415649414062 (23.31770420074463) | > loss_duration: 2.877140998840332 (2.952462315559387) | > loss_1: 40.097267150878906 (39.24089050292969)  --> STEP: 3 | > loss_disc: 2.553524971008301 (2.6737060546875) | > loss_disc_real_0: 0.2503814697265625 (0.31008880337079364) | > loss_disc_real_1: 0.2912088632583618 (0.30837833881378174) | > loss_disc_real_2: 0.2057672142982483 (0.3026018838087718) | > loss_disc_real_3: 0.2226593792438507 (0.28441840410232544) | > loss_disc_real_4: 0.2410796880722046 (0.24619232614835104) | > loss_disc_real_5: 0.21009184420108795 (0.23437173664569855) | > loss_0: 2.553524971008301 (2.6737060546875) | > loss_gen: 2.1294121742248535 (2.731639782587687) | > loss_kl: 2.1281557083129883 (3.737776279449463) | > loss_feat: 2.1053335666656494 (4.298699617385864) | > loss_mel: 18.59104347229004 (21.742150624593098) | > loss_duration: 2.7048182487487793 (2.8699142932891846) | > loss_1: 27.658761978149414 (35.380180994669594) --> EVAL PERFORMANCE | > avg_loader_time: 0.011284192403157553 (+0.008605321248372396) | > avg_loss_disc: 2.6737060546875 (+0.296051025390625) | > avg_loss_disc_real_0: 0.31008880337079364 (+0.1221897465487321) | > avg_loss_disc_real_1: 0.30837833881378174 (+0.10354961951573691) | > avg_loss_disc_real_2: 0.3026018838087718 (+0.10791556040445965) | > avg_loss_disc_real_3: 0.28441840410232544 (+0.07737438380718231) | > avg_loss_disc_real_4: 0.24619232614835104 (+0.027556640406449645) | > avg_loss_disc_real_5: 0.23437173664569855 (+0.0401215081413587) | > avg_loss_0: 2.6737060546875 (+0.296051025390625) | > avg_loss_gen: 2.731639782587687 (+0.5715028444925943) | > avg_loss_kl: 3.737776279449463 (-0.007947762807210434) | > avg_loss_feat: 4.298699617385864 (+0.025329536447922685) | > avg_loss_mel: 21.742150624593098 (+7.505425930023192) | > avg_loss_duration: 2.8699142932891846 (-0.06213188171386719) | > avg_loss_1: 35.380180994669594 (+8.032179514567055)  > EPOCH: 608/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:34:42)   --> TIME: 2023-10-20 06:35:01 -- STEP: 29/50 -- GLOBAL_STEP: 83430 | > loss_disc: 2.9796535968780518 (2.4246915619948806) | > loss_disc_real_0: 0.3266634941101074 (0.15231914426489127) | > loss_disc_real_1: 0.3685472309589386 (0.22562878052222318) | > loss_disc_real_2: 0.36863425374031067 (0.23221874005835635) | > loss_disc_real_3: 0.353645384311676 (0.2453487431951638) | > loss_disc_real_4: 0.3553294837474823 (0.21625322848558426) | > loss_disc_real_5: 0.39711329340934753 (0.23572828562865997) | > loss_0: 2.9796535968780518 (2.4246915619948806) | > grad_norm_0: tensor(447.0515, device='cuda:0') (tensor(561.3408, device='cuda:0')) | > loss_gen: 2.762754201889038 (2.443626584677861) | > loss_kl: 0.9562129378318787 (0.8279329281428764) | > loss_feat: 4.7199788093566895 (5.930761591627679) | > loss_mel: 21.435457229614258 (22.94131778026449) | > loss_duration: 1.470542073249817 (1.462858010982645) | > loss_1: 31.344945907592773 (33.606496761585106) | > grad_norm_1: tensor(5318.8018, device='cuda:0') (tensor(25595.3340, device='cuda:0')) | > current_lr_0: 0.00010888359364780483 | > current_lr_1: 0.00010888359364780483 | > step_time: 0.9451 (0.4821775946123847) | > loader_time: 0.0275 (0.014865480620285561)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.982109546661377 (2.982109546661377) | > loss_disc_real_0: 0.2811511754989624 (0.2811511754989624) | > loss_disc_real_1: 0.2788093388080597 (0.2788093388080597) | > loss_disc_real_2: 0.27240490913391113 (0.27240490913391113) | > loss_disc_real_3: 0.2519693374633789 (0.2519693374633789) | > loss_disc_real_4: 0.27918821573257446 (0.27918821573257446) | > loss_disc_real_5: 0.28269845247268677 (0.28269845247268677) | > loss_0: 2.982109546661377 (2.982109546661377) | > loss_gen: 1.6821202039718628 (1.6821202039718628) | > loss_kl: 3.71400785446167 (3.71400785446167) | > loss_feat: 0.20081506669521332 (0.20081506669521332) | > loss_mel: 5.929538726806641 (5.929538726806641) | > loss_duration: 2.7080321311950684 (2.7080321311950684) | > loss_1: 14.234514236450195 (14.234514236450195)  --> STEP: 1 | > loss_disc: 2.2676033973693848 (2.2676033973693848) | > loss_disc_real_0: 0.2874889075756073 (0.2874889075756073) | > loss_disc_real_1: 0.27048105001449585 (0.27048105001449585) | > loss_disc_real_2: 0.25047674775123596 (0.25047674775123596) | > loss_disc_real_3: 0.2230912446975708 (0.2230912446975708) | > loss_disc_real_4: 0.12112239748239517 (0.12112239748239517) | > loss_disc_real_5: 0.10546974092721939 (0.10546974092721939) | > loss_0: 2.2676033973693848 (2.2676033973693848) | > loss_gen: 2.5759785175323486 (2.5759785175323486) | > loss_kl: 4.009027481079102 (4.009027481079102) | > loss_feat: 7.616041660308838 (7.616041660308838) | > loss_mel: 21.921733856201172 (21.921733856201172) | > loss_duration: 3.0529236793518066 (3.0529236793518066) | > loss_1: 39.17570495605469 (39.17570495605469)  --> STEP: 2 | > loss_disc: 1.8660948276519775 (2.066849112510681) | > loss_disc_real_0: 0.08120425790548325 (0.18434658274054527) | > loss_disc_real_1: 0.14066433906555176 (0.2055726945400238) | > loss_disc_real_2: 0.1256258636713028 (0.18805130571126938) | > loss_disc_real_3: 0.24376779794692993 (0.23342952132225037) | > loss_disc_real_4: 0.07108525931835175 (0.09610382840037346) | > loss_disc_real_5: 0.06649786233901978 (0.08598380163311958) | > loss_0: 1.8660948276519775 (2.066849112510681) | > loss_gen: 2.2895467281341553 (2.432762622833252) | > loss_kl: 4.540098667144775 (4.2745630741119385) | > loss_feat: 7.438360691070557 (7.527201175689697) | > loss_mel: 26.164539337158203 (24.043136596679688) | > loss_duration: 2.9763572216033936 (3.0146404504776) | > loss_1: 43.40890121459961 (41.29230308532715)  --> STEP: 3 | > loss_disc: 1.1068708896636963 (1.7468563715616863) | > loss_disc_real_0: 0.02793148159980774 (0.13220821569363275) | > loss_disc_real_1: 0.09279390424489975 (0.1679797644416491) | > loss_disc_real_2: 0.01906202919781208 (0.13172154687345028) | > loss_disc_real_3: 0.033791959285736084 (0.16688366731007895) | > loss_disc_real_4: 0.012810745276510715 (0.06833946735908587) | > loss_disc_real_5: 0.015144020318984985 (0.062370541195074715) | > loss_0: 1.1068708896636963 (1.7468563715616863) | > loss_gen: 2.481387138366699 (2.4489707946777344) | > loss_kl: 1.7802441120147705 (3.4431234200795493) | > loss_feat: 10.66680908203125 (8.573737144470215) | > loss_mel: 28.702411651611328 (25.596228281656902) | > loss_duration: 2.822671413421631 (2.950650771458944) | > loss_1: 46.453521728515625 (43.012709299723305) --> EVAL PERFORMANCE | > avg_loader_time: 0.01453701655069987 (+0.0032528241475423166) | > avg_loss_disc: 1.7468563715616863 (-0.9268496831258137) | > avg_loss_disc_real_0: 0.13220821569363275 (-0.1778805876771609) | > avg_loss_disc_real_1: 0.1679797644416491 (-0.14039857437213263) | > avg_loss_disc_real_2: 0.13172154687345028 (-0.1708803369353215) | > avg_loss_disc_real_3: 0.16688366731007895 (-0.11753473679224649) | > avg_loss_disc_real_4: 0.06833946735908587 (-0.17785285878926516) | > avg_loss_disc_real_5: 0.062370541195074715 (-0.17200119545062384) | > avg_loss_0: 1.7468563715616863 (-0.9268496831258137) | > avg_loss_gen: 2.4489707946777344 (-0.28266898790995265) | > avg_loss_kl: 3.4431234200795493 (-0.2946528593699136) | > avg_loss_feat: 8.573737144470215 (+4.275037527084351) | > avg_loss_mel: 25.596228281656902 (+3.8540776570638045) | > avg_loss_duration: 2.950650771458944 (+0.08073647816975926) | > avg_loss_1: 43.012709299723305 (+7.632528305053711)  > EPOCH: 609/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:35:33)   --> TIME: 2023-10-20 06:35:47 -- STEP: 9/50 -- GLOBAL_STEP: 83460 | > loss_disc: 2.9985995292663574 (2.237455381287469) | > loss_disc_real_0: 0.2850258946418762 (0.1709229037579563) | > loss_disc_real_1: 0.26505130529403687 (0.22060393749011886) | > loss_disc_real_2: 0.2746463716030121 (0.22281797519988483) | > loss_disc_real_3: 0.28096869587898254 (0.17833334538671705) | > loss_disc_real_4: 0.3013007342815399 (0.20715396975477537) | > loss_disc_real_5: 0.28720638155937195 (0.19411088774601618) | > loss_0: 2.9985995292663574 (2.237455381287469) | > grad_norm_0: tensor(676.9661, device='cuda:0') (tensor(565.7667, device='cuda:0')) | > loss_gen: 1.6824657917022705 (2.5381846163007946) | > loss_kl: 0.8425454497337341 (0.8378138939539591) | > loss_feat: 0.19454005360603333 (6.406849308146371) | > loss_mel: 2.0598859786987305 (21.09159564971924) | > loss_duration: 1.4223493337631226 (1.450127402941386) | > loss_1: 6.201786518096924 (32.324571238623726) | > grad_norm_1: tensor(16580.3652, device='cuda:0') (tensor(17689.0273, device='cuda:0')) | > current_lr_0: 0.00010877475767882193 | > current_lr_1: 0.00010877475767882193 | > step_time: 0.5873 (0.6617506080203586) | > loader_time: 0.0072 (0.01356652047899034)  --> TIME: 2023-10-20 06:36:05 -- STEP: 39/50 -- GLOBAL_STEP: 83490 | > loss_disc: 2.305006504058838 (2.365422031818292) | > loss_disc_real_0: 0.12314003705978394 (0.14942113837848106) | > loss_disc_real_1: 0.30738842487335205 (0.230032278272586) | > loss_disc_real_2: 0.17343585193157196 (0.21955918883666015) | > loss_disc_real_3: 0.31468653678894043 (0.22738227095359412) | > loss_disc_real_4: 0.19313137233257294 (0.22732109972872797) | > loss_disc_real_5: 0.3737765848636627 (0.21432203063980126) | > loss_0: 2.305006504058838 (2.365422031818292) | > grad_norm_0: tensor(1014.2639, device='cuda:0') (tensor(575.7512, device='cuda:0')) | > loss_gen: 2.7981834411621094 (2.4411244117296653) | > loss_kl: 0.37908118963241577 (0.836795490521651) | > loss_feat: 4.110476016998291 (5.821117056963535) | > loss_mel: 20.39908790588379 (20.827044383073464) | > loss_duration: 1.4857088327407837 (1.4393137112641945) | > loss_1: 29.172536849975586 (31.365395484826504) | > grad_norm_1: tensor(30909.0820, device='cuda:0') (tensor(23401.1191, device='cuda:0')) | > current_lr_0: 0.00010877475767882193 | > current_lr_1: 0.00010877475767882193 | > step_time: 0.3473 (0.5766105285057654) | > loader_time: 0.0026 (0.013680030138064653)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.886474609375 (2.886474609375) | > loss_disc_real_0: 0.253834992647171 (0.253834992647171) | > loss_disc_real_1: 0.31214484572410583 (0.31214484572410583) | > loss_disc_real_2: 0.2764473557472229 (0.2764473557472229) | > loss_disc_real_3: 0.26941847801208496 (0.26941847801208496) | > loss_disc_real_4: 0.2801632881164551 (0.2801632881164551) | > loss_disc_real_5: 0.24834305047988892 (0.24834305047988892) | > loss_0: 2.886474609375 (2.886474609375) | > loss_gen: 1.8179218769073486 (1.8179218769073486) | > loss_kl: 4.058254241943359 (4.058254241943359) | > loss_feat: 0.40251824259757996 (0.40251824259757996) | > loss_mel: 14.344892501831055 (14.344892501831055) | > loss_duration: 2.5574140548706055 (2.5574140548706055) | > loss_1: 23.180999755859375 (23.180999755859375)  --> STEP: 1 | > loss_disc: 2.912505626678467 (2.912505626678467) | > loss_disc_real_0: 0.14303135871887207 (0.14303135871887207) | > loss_disc_real_1: 0.22431662678718567 (0.22431662678718567) | > loss_disc_real_2: 0.24302415549755096 (0.24302415549755096) | > loss_disc_real_3: 0.20845352113246918 (0.20845352113246918) | > loss_disc_real_4: 0.2032371163368225 (0.2032371163368225) | > loss_disc_real_5: 0.0736781433224678 (0.0736781433224678) | > loss_0: 2.912505626678467 (2.912505626678467) | > loss_gen: 1.411246657371521 (1.411246657371521) | > loss_kl: 4.169652938842773 (4.169652938842773) | > loss_feat: 6.019031047821045 (6.019031047821045) | > loss_mel: 26.75002670288086 (26.75002670288086) | > loss_duration: 2.990007162094116 (2.990007162094116) | > loss_1: 41.3399658203125 (41.3399658203125)  --> STEP: 2 | > loss_disc: 2.6623916625976562 (2.7874486446380615) | > loss_disc_real_0: 0.2424311339855194 (0.19273124635219574) | > loss_disc_real_1: 0.29096999764442444 (0.25764331221580505) | > loss_disc_real_2: 0.25664255023002625 (0.2498333528637886) | > loss_disc_real_3: 0.16781085729599 (0.18813218921422958) | > loss_disc_real_4: 0.17720907926559448 (0.1902230978012085) | > loss_disc_real_5: 0.33814433217048645 (0.20591123774647713) | > loss_0: 2.6623916625976562 (2.7874486446380615) | > loss_gen: 2.183332920074463 (1.797289788722992) | > loss_kl: 4.752723217010498 (4.461188077926636) | > loss_feat: 5.036787986755371 (5.527909517288208) | > loss_mel: 28.98427963256836 (27.86715316772461) | > loss_duration: 2.9269134998321533 (2.9584603309631348) | > loss_1: 43.884037017822266 (42.61200141906738)  --> STEP: 3 | > loss_disc: 2.1744418144226074 (2.5831130345662436) | > loss_disc_real_0: 0.24942614138126373 (0.2116295446952184) | > loss_disc_real_1: 0.2664838135242462 (0.26059014598528546) | > loss_disc_real_2: 0.2657366693019867 (0.255134458343188) | > loss_disc_real_3: 0.20798072218894958 (0.19474836687246957) | > loss_disc_real_4: 0.1622444987297058 (0.1808968981107076) | > loss_disc_real_5: 0.057014137506484985 (0.15627887099981308) | > loss_0: 2.1744418144226074 (2.5831130345662436) | > loss_gen: 2.3552165031433105 (1.9832653601964314) | > loss_kl: 1.830729603767395 (3.584368586540222) | > loss_feat: 4.681631088256836 (5.245816707611084) | > loss_mel: 23.18260955810547 (26.305638631184895) | > loss_duration: 2.7179887294769287 (2.878303130467733) | > loss_1: 34.76817321777344 (39.99739201863607) --> EVAL PERFORMANCE | > avg_loader_time: 0.011774222056070963 (-0.0027627944946289062) | > avg_loss_disc: 2.5831130345662436 (+0.8362566630045574) | > avg_loss_disc_real_0: 0.2116295446952184 (+0.07942132900158566) | > avg_loss_disc_real_1: 0.26059014598528546 (+0.09261038154363635) | > avg_loss_disc_real_2: 0.255134458343188 (+0.12341291146973771) | > avg_loss_disc_real_3: 0.19474836687246957 (+0.027864699562390627) | > avg_loss_disc_real_4: 0.1808968981107076 (+0.11255743075162174) | > avg_loss_disc_real_5: 0.15627887099981308 (+0.09390832980473837) | > avg_loss_0: 2.5831130345662436 (+0.8362566630045574) | > avg_loss_gen: 1.9832653601964314 (-0.46570543448130297) | > avg_loss_kl: 3.584368586540222 (+0.14124516646067287) | > avg_loss_feat: 5.245816707611084 (-3.327920436859131) | > avg_loss_mel: 26.305638631184895 (+0.7094103495279924) | > avg_loss_duration: 2.878303130467733 (-0.07234764099121094) | > avg_loss_1: 39.99739201863607 (-3.015317281087235)  > EPOCH: 610/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:36:26)   --> TIME: 2023-10-20 06:36:46 -- STEP: 19/50 -- GLOBAL_STEP: 83520 | > loss_disc: 2.714453935623169 (2.287851904567919) | > loss_disc_real_0: 0.34758010506629944 (0.15601000140764212) | > loss_disc_real_1: 0.2905789017677307 (0.22189075264491534) | > loss_disc_real_2: 0.21335534751415253 (0.20890922118958674) | > loss_disc_real_3: 0.3675251007080078 (0.22497771974456937) | > loss_disc_real_4: 0.25359731912612915 (0.18581317198511801) | > loss_disc_real_5: 0.350847452878952 (0.18251034803688526) | > loss_0: 2.714453935623169 (2.287851904567919) | > grad_norm_0: tensor(934.5048, device='cuda:0') (tensor(557.8820, device='cuda:0')) | > loss_gen: 2.621962070465088 (2.483883280503123) | > loss_kl: 0.5618096590042114 (0.7815675186483484) | > loss_feat: 5.586883068084717 (6.770524183778386) | > loss_mel: 20.32254409790039 (21.17437187621468) | > loss_duration: 1.5469712018966675 (1.4736990050265664) | > loss_1: 30.640169143676758 (32.68404591710944) | > grad_norm_1: tensor(15041.4590, device='cuda:0') (tensor(37659.7500, device='cuda:0')) | > current_lr_0: 0.00010866603049820419 | > current_lr_1: 0.00010866603049820419 | > step_time: 0.638 (0.6229588358025802) | > loader_time: 0.025 (0.02416909368414628)  --> TIME: 2023-10-20 06:37:04 -- STEP: 49/50 -- GLOBAL_STEP: 83550 | > loss_disc: 2.485504627227783 (2.3452259277810854) | > loss_disc_real_0: 0.10857610404491425 (0.14113892569225658) | > loss_disc_real_1: 0.2691361904144287 (0.2172573380248279) | > loss_disc_real_2: 0.19172649085521698 (0.21081244998744555) | > loss_disc_real_3: 0.2261275202035904 (0.23114070201254622) | > loss_disc_real_4: 0.21207915246486664 (0.20235079568715728) | > loss_disc_real_5: 0.3303144872188568 (0.22700497200142364) | > loss_0: 2.485504627227783 (2.3452259277810854) | > grad_norm_0: tensor(416.9407, device='cuda:0') (tensor(696.4474, device='cuda:0')) | > loss_gen: 2.2301461696624756 (2.399046457543665) | > loss_kl: 0.6004009246826172 (0.7826985984432454) | > loss_feat: 4.4355244636535645 (5.905008482993866) | > loss_mel: 28.9069881439209 (21.26904754735986) | > loss_duration: 1.6168078184127808 (1.443939851254833) | > loss_1: 37.78986358642578 (31.799740820514913) | > grad_norm_1: tensor(5469.1157, device='cuda:0') (tensor(25646.5410, device='cuda:0')) | > current_lr_0: 0.00010866603049820419 | > current_lr_1: 0.00010866603049820419 | > step_time: 0.3353 (0.5992290195153681) | > loader_time: 0.3745 (0.02717944067351672)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7343950271606445 (2.7343950271606445) | > loss_disc_real_0: 0.2196941375732422 (0.2196941375732422) | > loss_disc_real_1: 0.26375582814216614 (0.26375582814216614) | > loss_disc_real_2: 0.22560730576515198 (0.22560730576515198) | > loss_disc_real_3: 0.19834086298942566 (0.19834086298942566) | > loss_disc_real_4: 0.2624758780002594 (0.2624758780002594) | > loss_disc_real_5: 0.41912490129470825 (0.41912490129470825) | > loss_0: 2.7343950271606445 (2.7343950271606445) | > loss_gen: 2.171426773071289 (2.171426773071289) | > loss_kl: 4.599937915802002 (4.599937915802002) | > loss_feat: 8.814132690429688 (8.814132690429688) | > loss_mel: 27.235383987426758 (27.235383987426758) | > loss_duration: 2.669095516204834 (2.669095516204834) | > loss_1: 45.48997116088867 (45.48997116088867)  --> STEP: 1 | > loss_disc: 1.877349853515625 (1.877349853515625) | > loss_disc_real_0: 0.07226371765136719 (0.07226371765136719) | > loss_disc_real_1: 0.22239907085895538 (0.22239907085895538) | > loss_disc_real_2: 0.16808311641216278 (0.16808311641216278) | > loss_disc_real_3: 0.19836175441741943 (0.19836175441741943) | > loss_disc_real_4: 0.07259822636842728 (0.07259822636842728) | > loss_disc_real_5: 0.12180540710687637 (0.12180540710687637) | > loss_0: 1.877349853515625 (1.877349853515625) | > loss_gen: 2.481487512588501 (2.481487512588501) | > loss_kl: 4.116302013397217 (4.116302013397217) | > loss_feat: 6.895468235015869 (6.895468235015869) | > loss_mel: 27.6517276763916 (27.6517276763916) | > loss_duration: 3.15401029586792 (3.15401029586792) | > loss_1: 44.29899597167969 (44.29899597167969)  --> STEP: 2 | > loss_disc: 2.1535606384277344 (2.0154552459716797) | > loss_disc_real_0: 0.3612988293170929 (0.21678127348423004) | > loss_disc_real_1: 0.19653232395648956 (0.20946569740772247) | > loss_disc_real_2: 0.2274666726589203 (0.19777489453554153) | > loss_disc_real_3: 0.1597917526960373 (0.17907675355672836) | > loss_disc_real_4: 0.17513370513916016 (0.12386596575379372) | > loss_disc_real_5: 0.2489643543958664 (0.18538488075137138) | > loss_0: 2.1535606384277344 (2.0154552459716797) | > loss_gen: 3.0553503036499023 (2.7684189081192017) | > loss_kl: 4.129642486572266 (4.122972249984741) | > loss_feat: 7.4569573402404785 (7.176212787628174) | > loss_mel: 23.471643447875977 (25.56168556213379) | > loss_duration: 3.0195095539093018 (3.086759924888611) | > loss_1: 41.13310241699219 (42.71604919433594)  --> STEP: 3 | > loss_disc: 2.8592326641082764 (2.2967143853505454) | > loss_disc_real_0: 0.48930636048316956 (0.3076229691505432) | > loss_disc_real_1: 0.3039604425430298 (0.24096394578615823) | > loss_disc_real_2: 0.2756984531879425 (0.22374941408634186) | > loss_disc_real_3: 0.2654566466808319 (0.20787005126476288) | > loss_disc_real_4: 0.23097887635231018 (0.15957026928663254) | > loss_disc_real_5: 0.3073858320713043 (0.22605186452468237) | > loss_0: 2.8592326641082764 (2.2967143853505454) | > loss_gen: 2.419431209564209 (2.6520896752675376) | > loss_kl: 2.1930620670318604 (3.4796688556671143) | > loss_feat: 2.040611982345581 (5.4643458525339765) | > loss_mel: 21.196674346923828 (24.10668182373047) | > loss_duration: 2.760880947113037 (2.9781335989634194) | > loss_1: 30.610660552978516 (38.6809196472168) --> EVAL PERFORMANCE | > avg_loader_time: 0.0042603810628255205 (-0.007513840993245442) | > avg_loss_disc: 2.2967143853505454 (-0.28639864921569824) | > avg_loss_disc_real_0: 0.3076229691505432 (+0.0959934244553248) | > avg_loss_disc_real_1: 0.24096394578615823 (-0.019626200199127225) | > avg_loss_disc_real_2: 0.22374941408634186 (-0.03138504425684613) | > avg_loss_disc_real_3: 0.20787005126476288 (+0.013121684392293304) | > avg_loss_disc_real_4: 0.15957026928663254 (-0.021326628824075072) | > avg_loss_disc_real_5: 0.22605186452468237 (+0.06977299352486929) | > avg_loss_0: 2.2967143853505454 (-0.28639864921569824) | > avg_loss_gen: 2.6520896752675376 (+0.6688243150711062) | > avg_loss_kl: 3.4796688556671143 (-0.10469973087310791) | > avg_loss_feat: 5.4643458525339765 (+0.21852914492289255) | > avg_loss_mel: 24.10668182373047 (-2.198956807454426) | > avg_loss_duration: 2.9781335989634194 (+0.09983046849568655) | > avg_loss_1: 38.6809196472168 (-1.3164723714192732)  > EPOCH: 611/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:37:19)   --> TIME: 2023-10-20 06:37:45 -- STEP: 29/50 -- GLOBAL_STEP: 83580 | > loss_disc: 2.8323850631713867 (2.488478923666066) | > loss_disc_real_0: 0.14169403910636902 (0.18871605091182322) | > loss_disc_real_1: 0.2614016830921173 (0.22713142106759138) | > loss_disc_real_2: 0.2516093850135803 (0.22766157188292208) | > loss_disc_real_3: 0.2899702787399292 (0.21892693324078774) | > loss_disc_real_4: 0.23869702219963074 (0.22805753642500476) | > loss_disc_real_5: 0.2721334397792816 (0.22821937674849196) | > loss_0: 2.8323850631713867 (2.488478923666066) | > grad_norm_0: tensor(734.6799, device='cuda:0') (tensor(585.2610, device='cuda:0')) | > loss_gen: 1.7226728200912476 (2.271381378173828) | > loss_kl: 0.5725995302200317 (0.7767692115800134) | > loss_feat: 0.6171668171882629 (5.252708296323644) | > loss_mel: 18.767139434814453 (18.694111256763854) | > loss_duration: 1.442499041557312 (1.4498287809306178) | > loss_1: 23.12207794189453 (28.444799160135204) | > grad_norm_1: tensor(37088.5078, device='cuda:0') (tensor(23399.5684, device='cuda:0')) | > current_lr_0: 0.00010855741199721081 | > current_lr_1: 0.00010855741199721081 | > step_time: 0.5155 (0.6081325350136593) | > loader_time: 0.003 (0.015682680853481953)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9070217609405518 (2.9070217609405518) | > loss_disc_real_0: 0.40396997332572937 (0.40396997332572937) | > loss_disc_real_1: 0.25317978858947754 (0.25317978858947754) | > loss_disc_real_2: 0.21863912045955658 (0.21863912045955658) | > loss_disc_real_3: 0.2488797903060913 (0.2488797903060913) | > loss_disc_real_4: 0.23195701837539673 (0.23195701837539673) | > loss_disc_real_5: 0.22098028659820557 (0.22098028659820557) | > loss_0: 2.9070217609405518 (2.9070217609405518) | > loss_gen: 2.071225643157959 (2.071225643157959) | > loss_kl: 4.690530776977539 (4.690530776977539) | > loss_feat: 2.4885857105255127 (2.4885857105255127) | > loss_mel: 22.67995834350586 (22.67995834350586) | > loss_duration: 2.7483441829681396 (2.7483441829681396) | > loss_1: 34.67864227294922 (34.67864227294922)  --> STEP: 1 | > loss_disc: 2.4831414222717285 (2.4831414222717285) | > loss_disc_real_0: 0.1969410628080368 (0.1969410628080368) | > loss_disc_real_1: 0.17168307304382324 (0.17168307304382324) | > loss_disc_real_2: 0.15670543909072876 (0.15670543909072876) | > loss_disc_real_3: 0.36507001519203186 (0.36507001519203186) | > loss_disc_real_4: 0.1460806429386139 (0.1460806429386139) | > loss_disc_real_5: 0.16294139623641968 (0.16294139623641968) | > loss_0: 2.4831414222717285 (2.4831414222717285) | > loss_gen: 2.0451626777648926 (2.0451626777648926) | > loss_kl: 5.016018390655518 (5.016018390655518) | > loss_feat: 5.961768627166748 (5.961768627166748) | > loss_mel: 23.767745971679688 (23.767745971679688) | > loss_duration: 3.0800082683563232 (3.0800082683563232) | > loss_1: 39.870704650878906 (39.870704650878906)  --> STEP: 2 | > loss_disc: 2.970310688018799 (2.7267260551452637) | > loss_disc_real_0: 0.40459251403808594 (0.30076678842306137) | > loss_disc_real_1: 0.27421072125434875 (0.222946897149086) | > loss_disc_real_2: 0.2771367132663727 (0.21692107617855072) | > loss_disc_real_3: 0.25532349944114685 (0.31019675731658936) | > loss_disc_real_4: 0.23987236618995667 (0.19297650456428528) | > loss_disc_real_5: 0.22608119249343872 (0.1945112943649292) | > loss_0: 2.970310688018799 (2.7267260551452637) | > loss_gen: 1.848604679107666 (1.9468836784362793) | > loss_kl: 4.548620700836182 (4.78231954574585) | > loss_feat: 0.29264453053474426 (3.127206578850746) | > loss_mel: 23.935800552368164 (23.851773262023926) | > loss_duration: 3.0404469966888428 (3.060227632522583) | > loss_1: 33.666114807128906 (36.768409729003906)  --> STEP: 3 | > loss_disc: 2.1041882038116455 (2.5192134380340576) | > loss_disc_real_0: 0.1282019019126892 (0.24324515958627066) | > loss_disc_real_1: 0.14748699963092804 (0.19779359797636667) | > loss_disc_real_2: 0.14940671622753143 (0.19441628952821097) | > loss_disc_real_3: 0.17074346542358398 (0.2637123266855876) | > loss_disc_real_4: 0.0507633313536644 (0.1455721134940783) | > loss_disc_real_5: 0.06470295041799545 (0.15124184638261795) | > loss_0: 2.1041882038116455 (2.5192134380340576) | > loss_gen: 1.9891153573989868 (1.9609609047571819) | > loss_kl: 2.0939369201660156 (3.886192003885905) | > loss_feat: 7.844394207000732 (4.699602454900742) | > loss_mel: 22.482006072998047 (23.3951841990153) | > loss_duration: 2.7393546104431152 (2.9532699584960938) | > loss_1: 37.148807525634766 (36.895208994547524) --> EVAL PERFORMANCE | > avg_loader_time: 0.00967733065287272 (+0.0054169495900472) | > avg_loss_disc: 2.5192134380340576 (+0.22249905268351222) | > avg_loss_disc_real_0: 0.24324515958627066 (-0.06437780956427255) | > avg_loss_disc_real_1: 0.19779359797636667 (-0.043170347809791565) | > avg_loss_disc_real_2: 0.19441628952821097 (-0.02933312455813089) | > avg_loss_disc_real_3: 0.2637123266855876 (+0.055842275420824705) | > avg_loss_disc_real_4: 0.1455721134940783 (-0.013998155792554229) | > avg_loss_disc_real_5: 0.15124184638261795 (-0.07481001814206442) | > avg_loss_0: 2.5192134380340576 (+0.22249905268351222) | > avg_loss_gen: 1.9609609047571819 (-0.6911287705103557) | > avg_loss_kl: 3.886192003885905 (+0.40652314821879054) | > avg_loss_feat: 4.699602454900742 (-0.764743397633235) | > avg_loss_mel: 23.3951841990153 (-0.7114976247151681) | > avg_loss_duration: 2.9532699584960938 (-0.0248636404673257) | > avg_loss_1: 36.895208994547524 (-1.7857106526692732)  > EPOCH: 612/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:38:08)   --> TIME: 2023-10-20 06:38:20 -- STEP: 9/50 -- GLOBAL_STEP: 83610 | > loss_disc: 2.881606101989746 (2.616720928086175) | > loss_disc_real_0: 0.3284088969230652 (0.19224699752198326) | > loss_disc_real_1: 0.26663702726364136 (0.238252988912993) | > loss_disc_real_2: 0.4342171251773834 (0.27146854831112754) | > loss_disc_real_3: 0.31783202290534973 (0.24541256742344963) | > loss_disc_real_4: 0.6161275506019592 (0.27414826013975674) | > loss_disc_real_5: 0.45903241634368896 (0.22831150392691293) | > loss_0: 2.881606101989746 (2.616720928086175) | > grad_norm_0: tensor(664.9982, device='cuda:0') (tensor(780.5852, device='cuda:0')) | > loss_gen: 3.520629405975342 (2.4388117525312634) | > loss_kl: 0.7163825035095215 (0.9323693646325005) | > loss_feat: 4.856145858764648 (5.962771945529514) | > loss_mel: 22.956823348999023 (23.03130425347222) | > loss_duration: 1.3596242666244507 (1.4588470723893907) | > loss_1: 33.409603118896484 (33.824105156792534) | > grad_norm_1: tensor(27155.6484, device='cuda:0') (tensor(38940.6641, device='cuda:0')) | > current_lr_0: 0.0001084489020672097 | > current_lr_1: 0.0001084489020672097 | > step_time: 0.6303 (0.618319590886434) | > loader_time: 0.0132 (0.021751244862874348)  --> TIME: 2023-10-20 06:38:38 -- STEP: 39/50 -- GLOBAL_STEP: 83640 | > loss_disc: 3.069519281387329 (2.4601496962400584) | > loss_disc_real_0: 0.04456043988466263 (0.1506402386018099) | > loss_disc_real_1: 0.2602960169315338 (0.22151450206262943) | > loss_disc_real_2: 0.2851240038871765 (0.2296328109044295) | > loss_disc_real_3: 0.2806263267993927 (0.2473988501020731) | > loss_disc_real_4: 0.23531387746334076 (0.2501431270383107) | > loss_disc_real_5: 0.23819111287593842 (0.24110784271779734) | > loss_0: 3.069519281387329 (2.4601496962400584) | > grad_norm_0: tensor(3241.4302, device='cuda:0') (tensor(1196.0745, device='cuda:0')) | > loss_gen: 1.5358694791793823 (2.404558716676174) | > loss_kl: 0.3055046498775482 (0.8495700580951495) | > loss_feat: 0.8473159074783325 (5.570270337439022) | > loss_mel: 16.03620719909668 (22.77339634528527) | > loss_duration: 1.5082083940505981 (1.439903201201023) | > loss_1: 20.23310661315918 (33.03769872127434) | > grad_norm_1: tensor(8576.8779, device='cuda:0') (tensor(42466.3555, device='cuda:0')) | > current_lr_0: 0.0001084489020672097 | > current_lr_1: 0.0001084489020672097 | > step_time: 0.3855 (0.5769973718203031) | > loader_time: 0.0043 (0.019143446897849057)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9706095457077026 (1.9706095457077026) | > loss_disc_real_0: 0.15294934809207916 (0.15294934809207916) | > loss_disc_real_1: 0.2521115243434906 (0.2521115243434906) | > loss_disc_real_2: 0.21241989731788635 (0.21241989731788635) | > loss_disc_real_3: 0.21527518332004547 (0.21527518332004547) | > loss_disc_real_4: 0.15069811046123505 (0.15069811046123505) | > loss_disc_real_5: 0.06349771469831467 (0.06349771469831467) | > loss_0: 1.9706095457077026 (1.9706095457077026) | > loss_gen: 2.5343990325927734 (2.5343990325927734) | > loss_kl: 4.759948253631592 (4.759948253631592) | > loss_feat: 6.601322174072266 (6.601322174072266) | > loss_mel: 24.476892471313477 (24.476892471313477) | > loss_duration: 2.7948946952819824 (2.7948946952819824) | > loss_1: 41.16746139526367 (41.16746139526367)  --> STEP: 1 | > loss_disc: 1.947918176651001 (1.947918176651001) | > loss_disc_real_0: 0.11851708590984344 (0.11851708590984344) | > loss_disc_real_1: 0.19496473670005798 (0.19496473670005798) | > loss_disc_real_2: 0.10179980099201202 (0.10179980099201202) | > loss_disc_real_3: 0.16523434221744537 (0.16523434221744537) | > loss_disc_real_4: 0.11793391406536102 (0.11793391406536102) | > loss_disc_real_5: 0.20365145802497864 (0.20365145802497864) | > loss_0: 1.947918176651001 (1.947918176651001) | > loss_gen: 2.846619129180908 (2.846619129180908) | > loss_kl: 4.426386833190918 (4.426386833190918) | > loss_feat: 7.300832748413086 (7.300832748413086) | > loss_mel: 23.02953338623047 (23.02953338623047) | > loss_duration: 3.094611883163452 (3.094611883163452) | > loss_1: 40.69798278808594 (40.69798278808594)  --> STEP: 2 | > loss_disc: 2.849658489227295 (2.398788332939148) | > loss_disc_real_0: 0.308267742395401 (0.21339241415262222) | > loss_disc_real_1: 0.23060859739780426 (0.21278666704893112) | > loss_disc_real_2: 0.3616383969783783 (0.23171909898519516) | > loss_disc_real_3: 0.25960615277290344 (0.2124202474951744) | > loss_disc_real_4: 0.2165343165397644 (0.1672341153025627) | > loss_disc_real_5: 0.3571809232234955 (0.28041619062423706) | > loss_0: 2.849658489227295 (2.398788332939148) | > loss_gen: 2.614226818084717 (2.7304229736328125) | > loss_kl: 4.378117561340332 (4.402252197265625) | > loss_feat: 6.84749698638916 (7.074164867401123) | > loss_mel: 25.145307540893555 (24.08742046356201) | > loss_duration: 2.9545347690582275 (3.02457332611084) | > loss_1: 41.9396858215332 (41.31883430480957)  --> STEP: 3 | > loss_disc: 2.1171679496765137 (2.304914871851603) | > loss_disc_real_0: 0.06641203910112381 (0.16439895580212274) | > loss_disc_real_1: 0.29326343536376953 (0.2396122564872106) | > loss_disc_real_2: 0.25364112854003906 (0.23902644217014313) | > loss_disc_real_3: 0.25443893671035767 (0.22642647723356882) | > loss_disc_real_4: 0.1213812530040741 (0.15194982786973318) | > loss_disc_real_5: 0.24098323285579681 (0.26727187136809033) | > loss_0: 2.1171679496765137 (2.304914871851603) | > loss_gen: 2.4460673332214355 (2.6356377601623535) | > loss_kl: 2.020249366760254 (3.6082512537638345) | > loss_feat: 4.682066917419434 (6.2767988840738935) | > loss_mel: 21.921485900878906 (23.365442276000977) | > loss_duration: 2.7238264083862305 (2.92432435353597) | > loss_1: 33.793697357177734 (38.810455322265625) --> EVAL PERFORMANCE | > avg_loader_time: 0.03285622596740723 (+0.023178895314534508) | > avg_loss_disc: 2.304914871851603 (-0.21429856618245458) | > avg_loss_disc_real_0: 0.16439895580212274 (-0.07884620378414792) | > avg_loss_disc_real_1: 0.2396122564872106 (+0.04181865851084393) | > avg_loss_disc_real_2: 0.23902644217014313 (+0.04461015264193216) | > avg_loss_disc_real_3: 0.22642647723356882 (-0.037285849452018766) | > avg_loss_disc_real_4: 0.15194982786973318 (+0.006377714375654875) | > avg_loss_disc_real_5: 0.26727187136809033 (+0.11603002498547238) | > avg_loss_0: 2.304914871851603 (-0.21429856618245458) | > avg_loss_gen: 2.6356377601623535 (+0.6746768554051716) | > avg_loss_kl: 3.6082512537638345 (-0.2779407501220703) | > avg_loss_feat: 6.2767988840738935 (+1.577196429173152) | > avg_loss_mel: 23.365442276000977 (-0.0297419230143241) | > avg_loss_duration: 2.92432435353597 (-0.02894560496012355) | > avg_loss_1: 38.810455322265625 (+1.9152463277181013)  > EPOCH: 613/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:39:01)   --> TIME: 2023-10-20 06:39:20 -- STEP: 19/50 -- GLOBAL_STEP: 83670 | > loss_disc: 2.486351728439331 (2.322089433670044) | > loss_disc_real_0: 0.06754147261381149 (0.11545209694457684) | > loss_disc_real_1: 0.15758216381072998 (0.22483164464172564) | > loss_disc_real_2: 0.15890228748321533 (0.22483391697077373) | > loss_disc_real_3: 0.28357064723968506 (0.2350497294805552) | > loss_disc_real_4: 0.3022790253162384 (0.22544861535884833) | > loss_disc_real_5: 0.3832431435585022 (0.22307653725147247) | > loss_0: 2.486351728439331 (2.322089433670044) | > grad_norm_0: tensor(924.1484, device='cuda:0') (tensor(1266.0088, device='cuda:0')) | > loss_gen: 2.347870349884033 (2.519865864201596) | > loss_kl: 1.1202099323272705 (0.8687086073975814) | > loss_feat: 3.104919910430908 (6.520675668590947) | > loss_mel: 24.58316993713379 (23.37990160992271) | > loss_duration: 1.5173861980438232 (1.4824107697135525) | > loss_1: 32.67355728149414 (34.77156287745426) | > grad_norm_1: tensor(7660.0684, device='cuda:0') (tensor(56877.9336, device='cuda:0')) | > current_lr_0: 0.00010834050059967735 | > current_lr_1: 0.00010834050059967735 | > step_time: 0.8372 (0.6537721533524362) | > loader_time: 0.0404 (0.02348538448936061)  --> TIME: 2023-10-20 06:39:41 -- STEP: 49/50 -- GLOBAL_STEP: 83700 | > loss_disc: 3.0146946907043457 (2.4747140553532816) | > loss_disc_real_0: 0.17615707218647003 (0.15668599820714832) | > loss_disc_real_1: 0.27690619230270386 (0.22471731368984496) | > loss_disc_real_2: 0.30455538630485535 (0.22374598336006915) | > loss_disc_real_3: 0.24243956804275513 (0.2348014302931878) | > loss_disc_real_4: 0.25137650966644287 (0.22253754381470534) | > loss_disc_real_5: 0.28985244035720825 (0.2470520836662273) | > loss_0: 3.0146946907043457 (2.4747140553532816) | > grad_norm_0: tensor(804.5663, device='cuda:0') (tensor(1108.8964, device='cuda:0')) | > loss_gen: 1.5831727981567383 (2.305204625032385) | > loss_kl: 0.8011943697929382 (0.8543638918472796) | > loss_feat: 0.08336984366178513 (5.363186645568632) | > loss_mel: 2.123849391937256 (20.866976767170186) | > loss_duration: 1.5515589714050293 (1.4425938275395607) | > loss_1: 6.1431450843811035 (30.832326129991184) | > grad_norm_1: tensor(41716.1367, device='cuda:0') (tensor(42529.7812, device='cuda:0')) | > current_lr_0: 0.00010834050059967735 | > current_lr_1: 0.00010834050059967735 | > step_time: 0.5966 (0.6525671725370444) | > loader_time: 0.436 (0.03305997653883331)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.004190444946289 (3.004190444946289) | > loss_disc_real_0: 0.20988258719444275 (0.20988258719444275) | > loss_disc_real_1: 0.27567538619041443 (0.27567538619041443) | > loss_disc_real_2: 0.3046208620071411 (0.3046208620071411) | > loss_disc_real_3: 0.24254515767097473 (0.24254515767097473) | > loss_disc_real_4: 0.247475728392601 (0.247475728392601) | > loss_disc_real_5: 0.2864571213722229 (0.2864571213722229) | > loss_0: 3.004190444946289 (3.004190444946289) | > loss_gen: 1.577565312385559 (1.577565312385559) | > loss_kl: 4.033967971801758 (4.033967971801758) | > loss_feat: 0.05282190442085266 (0.05282190442085266) | > loss_mel: 1.5766050815582275 (1.5766050815582275) | > loss_duration: 2.631352186203003 (2.631352186203003) | > loss_1: 9.872312545776367 (9.872312545776367)  --> STEP: 1 | > loss_disc: 2.0874125957489014 (2.0874125957489014) | > loss_disc_real_0: 0.11273807287216187 (0.11273807287216187) | > loss_disc_real_1: 0.26222485303878784 (0.26222485303878784) | > loss_disc_real_2: 0.18709442019462585 (0.18709442019462585) | > loss_disc_real_3: 0.2704201340675354 (0.2704201340675354) | > loss_disc_real_4: 0.20898863673210144 (0.20898863673210144) | > loss_disc_real_5: 0.14904148876667023 (0.14904148876667023) | > loss_0: 2.0874125957489014 (2.0874125957489014) | > loss_gen: 2.7870357036590576 (2.7870357036590576) | > loss_kl: 4.3702473640441895 (4.3702473640441895) | > loss_feat: 8.28738021850586 (8.28738021850586) | > loss_mel: 22.548330307006836 (22.548330307006836) | > loss_duration: 3.163717031478882 (3.163717031478882) | > loss_1: 41.156707763671875 (41.156707763671875)  --> STEP: 2 | > loss_disc: 2.0794081687927246 (2.083410382270813) | > loss_disc_real_0: 0.05129174143075943 (0.08201490715146065) | > loss_disc_real_1: 0.30127009749412537 (0.2817474752664566) | > loss_disc_real_2: 0.2004694789648056 (0.19378194957971573) | > loss_disc_real_3: 0.3273283541202545 (0.29887424409389496) | > loss_disc_real_4: 0.25070831179618835 (0.2298484742641449) | > loss_disc_real_5: 0.09393016248941422 (0.12148582562804222) | > loss_0: 2.0794081687927246 (2.083410382270813) | > loss_gen: 2.6042277812957764 (2.695631742477417) | > loss_kl: 4.489473819732666 (4.429860591888428) | > loss_feat: 5.221186637878418 (6.754283428192139) | > loss_mel: 24.83115005493164 (23.68974018096924) | > loss_duration: 2.87062406539917 (3.017170548439026) | > loss_1: 40.01666259765625 (40.58668518066406)  --> STEP: 3 | > loss_disc: 2.679263114929199 (2.2820279598236084) | > loss_disc_real_0: 0.08631881326436996 (0.08344954252243042) | > loss_disc_real_1: 0.2660009562969208 (0.27649863560994464) | > loss_disc_real_2: 0.27563390135765076 (0.22106593350569406) | > loss_disc_real_3: 0.26400890946388245 (0.2872524658838908) | > loss_disc_real_4: 0.20517194271087646 (0.22162296374638876) | > loss_disc_real_5: 0.2810452878475189 (0.17467231303453445) | > loss_0: 2.679263114929199 (2.2820279598236084) | > loss_gen: 1.7720685005187988 (2.387777328491211) | > loss_kl: 2.166743755340576 (3.675488313039144) | > loss_feat: 1.3200178146362305 (4.942861557006836) | > loss_mel: 18.021509170532227 (21.800329844156902) | > loss_duration: 2.728114366531372 (2.920818487803141) | > loss_1: 26.008453369140625 (35.727274576822914) --> EVAL PERFORMANCE | > avg_loader_time: 0.018040180206298828 (-0.014816045761108398) | > avg_loss_disc: 2.2820279598236084 (-0.022886912027994644) | > avg_loss_disc_real_0: 0.08344954252243042 (-0.08094941327969232) | > avg_loss_disc_real_1: 0.27649863560994464 (+0.03688637912273404) | > avg_loss_disc_real_2: 0.22106593350569406 (-0.017960508664449065) | > avg_loss_disc_real_3: 0.2872524658838908 (+0.06082598865032199) | > avg_loss_disc_real_4: 0.22162296374638876 (+0.06967313587665558) | > avg_loss_disc_real_5: 0.17467231303453445 (-0.09259955833355588) | > avg_loss_0: 2.2820279598236084 (-0.022886912027994644) | > avg_loss_gen: 2.387777328491211 (-0.24786043167114258) | > avg_loss_kl: 3.675488313039144 (+0.06723705927530954) | > avg_loss_feat: 4.942861557006836 (-1.3339373270670576) | > avg_loss_mel: 21.800329844156902 (-1.5651124318440743) | > avg_loss_duration: 2.920818487803141 (-0.003505865732829072) | > avg_loss_1: 35.727274576822914 (-3.0831807454427107)  > EPOCH: 614/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:40:02)   --> TIME: 2023-10-20 06:40:24 -- STEP: 29/50 -- GLOBAL_STEP: 83730 | > loss_disc: 2.9761767387390137 (2.5826924915971428) | > loss_disc_real_0: 0.2562587261199951 (0.1601157114230867) | > loss_disc_real_1: 0.28775355219841003 (0.22226024945748263) | > loss_disc_real_2: 0.2841756343841553 (0.23495736872327738) | > loss_disc_real_3: 0.2806311249732971 (0.22552575363681235) | > loss_disc_real_4: 0.29389384388923645 (0.254033520047007) | > loss_disc_real_5: 0.2691052556037903 (0.23583839493321962) | > loss_0: 2.9761767387390137 (2.5826924915971428) | > grad_norm_0: tensor(567.3810, device='cuda:0') (tensor(1017.0834, device='cuda:0')) | > loss_gen: 1.67958664894104 (2.0801136411469563) | > loss_kl: 0.9650178551673889 (0.8616598197098436) | > loss_feat: 0.10245909541845322 (4.04589484580632) | > loss_mel: 7.761200428009033 (17.396362600655387) | > loss_duration: 1.4421244859695435 (1.4477696377655556) | > loss_1: 11.950387954711914 (25.831800526586072) | > grad_norm_1: tensor(155098.9375, device='cuda:0') (tensor(49727.2344, device='cuda:0')) | > current_lr_0: 0.00010823220748619876 | > current_lr_1: 0.00010823220748619876 | > step_time: 0.541 (0.5884857671014193) | > loader_time: 0.0251 (0.014854036528488686)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.563931703567505 (2.563931703567505) | > loss_disc_real_0: 0.27642500400543213 (0.27642500400543213) | > loss_disc_real_1: 0.2767302989959717 (0.2767302989959717) | > loss_disc_real_2: 0.20032119750976562 (0.20032119750976562) | > loss_disc_real_3: 0.2717042565345764 (0.2717042565345764) | > loss_disc_real_4: 0.199051171541214 (0.199051171541214) | > loss_disc_real_5: 0.22245021164417267 (0.22245021164417267) | > loss_0: 2.563931703567505 (2.563931703567505) | > loss_gen: 2.1159205436706543 (2.1159205436706543) | > loss_kl: 3.99051833152771 (3.99051833152771) | > loss_feat: 1.9182642698287964 (1.9182642698287964) | > loss_mel: 22.919435501098633 (22.919435501098633) | > loss_duration: 2.7544591426849365 (2.7544591426849365) | > loss_1: 33.6985969543457 (33.6985969543457)  --> STEP: 1 | > loss_disc: 2.264406204223633 (2.264406204223633) | > loss_disc_real_0: 0.1375647634267807 (0.1375647634267807) | > loss_disc_real_1: 0.23939885199069977 (0.23939885199069977) | > loss_disc_real_2: 0.2039625197649002 (0.2039625197649002) | > loss_disc_real_3: 0.29051899909973145 (0.29051899909973145) | > loss_disc_real_4: 0.2174534946680069 (0.2174534946680069) | > loss_disc_real_5: 0.18666796386241913 (0.18666796386241913) | > loss_0: 2.264406204223633 (2.264406204223633) | > loss_gen: 2.3969430923461914 (2.3969430923461914) | > loss_kl: 4.5865397453308105 (4.5865397453308105) | > loss_feat: 4.639962196350098 (4.639962196350098) | > loss_mel: 24.432748794555664 (24.432748794555664) | > loss_duration: 3.0149736404418945 (3.0149736404418945) | > loss_1: 39.071163177490234 (39.071163177490234)  --> STEP: 2 | > loss_disc: 2.8154468536376953 (2.539926528930664) | > loss_disc_real_0: 0.19461795687675476 (0.16609136015176773) | > loss_disc_real_1: 0.32644811272621155 (0.28292348235845566) | > loss_disc_real_2: 0.3245621621608734 (0.2642623409628868) | > loss_disc_real_3: 0.2917400002479553 (0.2911294996738434) | > loss_disc_real_4: 0.2835165858268738 (0.25048504024744034) | > loss_disc_real_5: 0.27435925602912903 (0.23051360994577408) | > loss_0: 2.8154468536376953 (2.539926528930664) | > loss_gen: 2.204123020172119 (2.3005330562591553) | > loss_kl: 4.312883377075195 (4.449711561203003) | > loss_feat: 4.48372220993042 (4.561842203140259) | > loss_mel: 28.627595901489258 (26.53017234802246) | > loss_duration: 2.9544334411621094 (2.984703540802002) | > loss_1: 42.582759857177734 (40.826961517333984)  --> STEP: 3 | > loss_disc: 2.9554786682128906 (2.6784439086914062) | > loss_disc_real_0: 0.26603424549102783 (0.19940565526485443) | > loss_disc_real_1: 0.3760448396205902 (0.3139639347791672) | > loss_disc_real_2: 0.39945220947265625 (0.3093256304661433) | > loss_disc_real_3: 0.21284615993499756 (0.2650350530942281) | > loss_disc_real_4: 0.36193040013313293 (0.2876334935426712) | > loss_disc_real_5: 0.3383978605270386 (0.26647502680619556) | > loss_0: 2.9554786682128906 (2.6784439086914062) | > loss_gen: 2.4141581058502197 (2.3384080727895102) | > loss_kl: 2.0016367435455322 (3.633686621983846) | > loss_feat: 3.5439131259918213 (4.222532510757446) | > loss_mel: 25.2340030670166 (26.098115921020508) | > loss_duration: 2.7212977409362793 (2.8969016075134277) | > loss_1: 35.915008544921875 (39.18964385986328) --> EVAL PERFORMANCE | > avg_loader_time: 0.010845820109049479 (-0.0071943600972493495) | > avg_loss_disc: 2.6784439086914062 (+0.39641594886779785) | > avg_loss_disc_real_0: 0.19940565526485443 (+0.11595611274242401) | > avg_loss_disc_real_1: 0.3139639347791672 (+0.03746529916922253) | > avg_loss_disc_real_2: 0.3093256304661433 (+0.08825969696044925) | > avg_loss_disc_real_3: 0.2650350530942281 (-0.022217412789662716) | > avg_loss_disc_real_4: 0.2876334935426712 (+0.06601052979628244) | > avg_loss_disc_real_5: 0.26647502680619556 (+0.0918027137716611) | > avg_loss_0: 2.6784439086914062 (+0.39641594886779785) | > avg_loss_gen: 2.3384080727895102 (-0.0493692557017007) | > avg_loss_kl: 3.633686621983846 (-0.04180169105529785) | > avg_loss_feat: 4.222532510757446 (-0.7203290462493896) | > avg_loss_mel: 26.098115921020508 (+4.297786076863606) | > avg_loss_duration: 2.8969016075134277 (-0.023916880289713394) | > avg_loss_1: 39.18964385986328 (+3.462369283040367)  > EPOCH: 615/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:40:53)   --> TIME: 2023-10-20 06:41:09 -- STEP: 9/50 -- GLOBAL_STEP: 83760 | > loss_disc: 2.5018038749694824 (2.2050196329752603) | > loss_disc_real_0: 0.10531251132488251 (0.1835568147814936) | > loss_disc_real_1: 0.12116952240467072 (0.2322847834891743) | > loss_disc_real_2: 0.21699100732803345 (0.24772968288097116) | > loss_disc_real_3: 0.20556925237178802 (0.21787754446268082) | > loss_disc_real_4: 0.11025604605674744 (0.17948436509403917) | > loss_disc_real_5: 0.10890039801597595 (0.21642132931285435) | > loss_0: 2.5018038749694824 (2.2050196329752603) | > grad_norm_0: tensor(3231.4021, device='cuda:0') (tensor(1416.5488, device='cuda:0')) | > loss_gen: 1.5847405195236206 (2.8414907587899103) | > loss_kl: 0.6202787756919861 (0.9207947982682122) | > loss_feat: 4.649289131164551 (7.562532133526272) | > loss_mel: 20.36753273010254 (23.489294687906902) | > loss_duration: 1.4033538103103638 (1.4567927651935153) | > loss_1: 28.625194549560547 (36.27090496487088) | > grad_norm_1: tensor(13455.2168, device='cuda:0') (tensor(55243.1406, device='cuda:0')) | > current_lr_0: 0.00010812402261846724 | > current_lr_1: 0.00010812402261846724 | > step_time: 0.7763 (0.5793048010932075) | > loader_time: 0.0313 (0.017641093995836046)  --> TIME: 2023-10-20 06:41:30 -- STEP: 39/50 -- GLOBAL_STEP: 83790 | > loss_disc: 3.1851954460144043 (2.2753896590990896) | > loss_disc_real_0: 0.036753732711076736 (0.15361155669849652) | > loss_disc_real_1: 0.26280197501182556 (0.23021031973453668) | > loss_disc_real_2: 0.27281609177589417 (0.23353358754553857) | > loss_disc_real_3: 0.26911020278930664 (0.23528543773751992) | > loss_disc_real_4: 0.2579633891582489 (0.20957771024833888) | > loss_disc_real_5: 0.24366962909698486 (0.20939776487648487) | > loss_0: 3.1851954460144043 (2.2753896590990896) | > grad_norm_0: tensor(4866.3701, device='cuda:0') (tensor(1411.2472, device='cuda:0')) | > loss_gen: 1.390119194984436 (2.6987921671989636) | > loss_kl: 0.5396628379821777 (0.8463343733396286) | > loss_feat: 0.029838040471076965 (6.87735125155021) | > loss_mel: 1.1427985429763794 (22.530780379588787) | > loss_duration: 1.4570529460906982 (1.4448966460350232) | > loss_1: 4.559471130371094 (34.39815435654077) | > grad_norm_1: tensor(129844.4219, device='cuda:0') (tensor(45038.5117, device='cuda:0')) | > current_lr_0: 0.00010812402261846724 | > current_lr_1: 0.00010812402261846724 | > step_time: 0.7176 (0.6655393502651118) | > loader_time: 0.0145 (0.02084261331802759)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.835876703262329 (2.835876703262329) | > loss_disc_real_0: 0.22051800787448883 (0.22051800787448883) | > loss_disc_real_1: 0.2574843466281891 (0.2574843466281891) | > loss_disc_real_2: 0.36105382442474365 (0.36105382442474365) | > loss_disc_real_3: 0.21516405045986176 (0.21516405045986176) | > loss_disc_real_4: 0.2775833308696747 (0.2775833308696747) | > loss_disc_real_5: 0.4060935378074646 (0.4060935378074646) | > loss_0: 2.835876703262329 (2.835876703262329) | > loss_gen: 2.1360254287719727 (2.1360254287719727) | > loss_kl: 4.490740776062012 (4.490740776062012) | > loss_feat: 4.716675758361816 (4.716675758361816) | > loss_mel: 17.932825088500977 (17.932825088500977) | > loss_duration: 2.7435238361358643 (2.7435238361358643) | > loss_1: 32.01979064941406 (32.01979064941406)  --> STEP: 1 | > loss_disc: 2.989016056060791 (2.989016056060791) | > loss_disc_real_0: 0.43038254976272583 (0.43038254976272583) | > loss_disc_real_1: 0.2776404917240143 (0.2776404917240143) | > loss_disc_real_2: 0.26627036929130554 (0.26627036929130554) | > loss_disc_real_3: 0.23365524411201477 (0.23365524411201477) | > loss_disc_real_4: 0.266414999961853 (0.266414999961853) | > loss_disc_real_5: 0.2505938410758972 (0.2505938410758972) | > loss_0: 2.989016056060791 (2.989016056060791) | > loss_gen: 1.8321418762207031 (1.8321418762207031) | > loss_kl: 4.415098190307617 (4.415098190307617) | > loss_feat: 0.1952843964099884 (0.1952843964099884) | > loss_mel: 12.87562084197998 (12.87562084197998) | > loss_duration: 3.153196096420288 (3.153196096420288) | > loss_1: 22.471342086791992 (22.471342086791992)  --> STEP: 2 | > loss_disc: 2.8693580627441406 (2.929187059402466) | > loss_disc_real_0: 0.30036601424217224 (0.36537428200244904) | > loss_disc_real_1: 0.29893165826797485 (0.28828607499599457) | > loss_disc_real_2: 0.3913935124874115 (0.3288319408893585) | > loss_disc_real_3: 0.30441105365753174 (0.26903314888477325) | > loss_disc_real_4: 0.26375314593315125 (0.26508407294750214) | > loss_disc_real_5: 0.39839181303977966 (0.32449282705783844) | > loss_0: 2.8693580627441406 (2.929187059402466) | > loss_gen: 3.1968960762023926 (2.514518976211548) | > loss_kl: 4.219618320465088 (4.3173582553863525) | > loss_feat: 5.422515869140625 (2.8089001327753067) | > loss_mel: 25.566566467285156 (19.22109365463257) | > loss_duration: 2.9278404712677 (3.040518283843994) | > loss_1: 41.333438873291016 (31.902390480041504)  --> STEP: 3 | > loss_disc: 2.303373336791992 (2.7205824851989746) | > loss_disc_real_0: 0.19760477542877197 (0.3094511131445567) | > loss_disc_real_1: 0.4317722022533417 (0.3361147840817769) | > loss_disc_real_2: 0.34143388271331787 (0.33303258816401166) | > loss_disc_real_3: 0.3749777674674988 (0.30434802174568176) | > loss_disc_real_4: 0.23904496431350708 (0.2564043700695038) | > loss_disc_real_5: 0.22372502088546753 (0.2909035583337148) | > loss_0: 2.303373336791992 (2.7205824851989746) | > loss_gen: 3.5011684894561768 (2.843402147293091) | > loss_kl: 2.2251431941986084 (3.619953234990438) | > loss_feat: 6.529745578765869 (4.0491819481054945) | > loss_mel: 23.1225643157959 (20.521583875020344) | > loss_duration: 2.7213408946990967 (2.934125820795695) | > loss_1: 38.09996032714844 (33.96824709574381) --> EVAL PERFORMANCE | > avg_loader_time: 0.018492619196573894 (+0.007646799087524416) | > avg_loss_disc: 2.7205824851989746 (+0.04213857650756836) | > avg_loss_disc_real_0: 0.3094511131445567 (+0.11004545787970227) | > avg_loss_disc_real_1: 0.3361147840817769 (+0.022150849302609743) | > avg_loss_disc_real_2: 0.33303258816401166 (+0.023706957697868347) | > avg_loss_disc_real_3: 0.30434802174568176 (+0.03931296865145367) | > avg_loss_disc_real_4: 0.2564043700695038 (-0.03122912347316742) | > avg_loss_disc_real_5: 0.2909035583337148 (+0.024428531527519226) | > avg_loss_0: 2.7205824851989746 (+0.04213857650756836) | > avg_loss_gen: 2.843402147293091 (+0.5049940745035806) | > avg_loss_kl: 3.619953234990438 (-0.013733386993408203) | > avg_loss_feat: 4.0491819481054945 (-0.1733505626519518) | > avg_loss_mel: 20.521583875020344 (-5.576532046000164) | > avg_loss_duration: 2.934125820795695 (+0.037224213282267105) | > avg_loss_1: 33.96824709574381 (-5.2213967641194685)  > EPOCH: 616/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:41:51)   --> TIME: 2023-10-20 06:42:08 -- STEP: 19/50 -- GLOBAL_STEP: 83820 | > loss_disc: 1.7670376300811768 (2.4579921647122034) | > loss_disc_real_0: 0.01605578139424324 (0.14699554747264637) | > loss_disc_real_1: 0.2677336037158966 (0.24285727484445824) | > loss_disc_real_2: 0.19074773788452148 (0.24159225546999982) | > loss_disc_real_3: 0.15576139092445374 (0.23226120773898928) | > loss_disc_real_4: 0.15052928030490875 (0.23526093285334737) | > loss_disc_real_5: 0.03711921349167824 (0.21735757687374166) | > loss_0: 1.7670376300811768 (2.4579921647122034) | > grad_norm_0: tensor(1812.5416, device='cuda:0') (tensor(1208.9786, device='cuda:0')) | > loss_gen: 2.580836296081543 (2.3772319680766056) | > loss_kl: 0.7936997413635254 (0.8074340835997933) | > loss_feat: 7.848904132843018 (5.239429848366662) | > loss_mel: 22.588451385498047 (20.422976217771833) | > loss_duration: 1.5749874114990234 (1.469304831404435) | > loss_1: 35.386878967285156 (30.31637625945242) | > grad_norm_1: tensor(19421.4141, device='cuda:0') (tensor(61822.8086, device='cuda:0')) | > current_lr_0: 0.00010801594588828443 | > current_lr_1: 0.00010801594588828443 | > step_time: 0.6312 (0.6260660447572407) | > loader_time: 0.002 (0.02216238724557977)  --> TIME: 2023-10-20 06:42:30 -- STEP: 49/50 -- GLOBAL_STEP: 83850 | > loss_disc: 2.0435643196105957 (2.4817938074773673) | > loss_disc_real_0: 0.027684560045599937 (0.1656239931376613) | > loss_disc_real_1: 0.2594907879829407 (0.23064385111234625) | > loss_disc_real_2: 0.17664724588394165 (0.22774567622311262) | > loss_disc_real_3: 0.19061635434627533 (0.22931047414942662) | > loss_disc_real_4: 0.20209351181983948 (0.217552121576606) | > loss_disc_real_5: 0.13967472314834595 (0.22194496690466695) | > loss_0: 2.0435643196105957 (2.4817938074773673) | > grad_norm_0: tensor(1100.7338, device='cuda:0') (tensor(1175.5306, device='cuda:0')) | > loss_gen: 2.432978630065918 (2.23592048761796) | > loss_kl: 0.37803301215171814 (0.76697289882874) | > loss_feat: 4.110236644744873 (4.888720495816396) | > loss_mel: 22.189897537231445 (20.473690670363755) | > loss_duration: 1.581615924835205 (1.4440555767137178) | > loss_1: 30.692760467529297 (29.809360066238714) | > grad_norm_1: tensor(5640.0015, device='cuda:0') (tensor(39334.2930, device='cuda:0')) | > current_lr_0: 0.00010801594588828443 | > current_lr_1: 0.00010801594588828443 | > step_time: 0.8473 (0.6767355179300114) | > loader_time: 0.4584 (0.03332260190224161)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5271170139312744 (2.5271170139312744) | > loss_disc_real_0: 0.19222894310951233 (0.19222894310951233) | > loss_disc_real_1: 0.2878771424293518 (0.2878771424293518) | > loss_disc_real_2: 0.3193354904651642 (0.3193354904651642) | > loss_disc_real_3: 0.3232361078262329 (0.3232361078262329) | > loss_disc_real_4: 0.329081654548645 (0.329081654548645) | > loss_disc_real_5: 0.2399643361568451 (0.2399643361568451) | > loss_0: 2.5271170139312744 (2.5271170139312744) | > loss_gen: 2.845329999923706 (2.845329999923706) | > loss_kl: 4.371889591217041 (4.371889591217041) | > loss_feat: 5.5494866371154785 (5.5494866371154785) | > loss_mel: 20.474498748779297 (20.474498748779297) | > loss_duration: 2.7167160511016846 (2.7167160511016846) | > loss_1: 35.95792007446289 (35.95792007446289)  --> STEP: 1 | > loss_disc: 3.119365692138672 (3.119365692138672) | > loss_disc_real_0: 0.2982909083366394 (0.2982909083366394) | > loss_disc_real_1: 0.19574207067489624 (0.19574207067489624) | > loss_disc_real_2: 0.39862871170043945 (0.39862871170043945) | > loss_disc_real_3: 0.21318791806697845 (0.21318791806697845) | > loss_disc_real_4: 0.427127867937088 (0.427127867937088) | > loss_disc_real_5: 0.5337214469909668 (0.5337214469909668) | > loss_0: 3.119365692138672 (3.119365692138672) | > loss_gen: 2.2343544960021973 (2.2343544960021973) | > loss_kl: 4.271977424621582 (4.271977424621582) | > loss_feat: 6.032907962799072 (6.032907962799072) | > loss_mel: 24.46278953552246 (24.46278953552246) | > loss_duration: 3.117147922515869 (3.117147922515869) | > loss_1: 40.11918258666992 (40.11918258666992)  --> STEP: 2 | > loss_disc: 2.66169810295105 (2.890531897544861) | > loss_disc_real_0: 0.30772775411605835 (0.3030093312263489) | > loss_disc_real_1: 0.22458665072917938 (0.2101643607020378) | > loss_disc_real_2: 0.2792588472366333 (0.3389437794685364) | > loss_disc_real_3: 0.2695218324661255 (0.24135487526655197) | > loss_disc_real_4: 0.1933162361383438 (0.3102220520377159) | > loss_disc_real_5: 0.19020448625087738 (0.3619629666209221) | > loss_0: 2.66169810295105 (2.890531897544861) | > loss_gen: 2.088254451751709 (2.161304473876953) | > loss_kl: 4.46353816986084 (4.367757797241211) | > loss_feat: 3.3067681789398193 (4.669838070869446) | > loss_mel: 27.721332550048828 (26.092061042785645) | > loss_duration: 2.893831968307495 (3.005489945411682) | > loss_1: 40.473724365234375 (40.29645347595215)  --> STEP: 3 | > loss_disc: 3.1778929233551025 (2.986318906148275) | > loss_disc_real_0: 0.48696082830429077 (0.36432649691899616) | > loss_disc_real_1: 0.36648499965667725 (0.2622712403535843) | > loss_disc_real_2: 0.35915395617485046 (0.34568050503730774) | > loss_disc_real_3: 0.2286509871482849 (0.2371202458937963) | > loss_disc_real_4: 0.39934447407722473 (0.3399295260508855) | > loss_disc_real_5: 0.3802238404750824 (0.36804992457230884) | > loss_0: 3.1778929233551025 (2.986318906148275) | > loss_gen: 2.4593918323516846 (2.2606669267018638) | > loss_kl: 2.344057321548462 (3.6931909720102944) | > loss_feat: 3.368041515350342 (4.235905885696411) | > loss_mel: 20.374406814575195 (24.186176300048828) | > loss_duration: 2.8083736896514893 (2.939784526824951) | > loss_1: 31.354272842407227 (37.31572659810384) --> EVAL PERFORMANCE | > avg_loader_time: 0.011095046997070312 (-0.007397572199503582) | > avg_loss_disc: 2.986318906148275 (+0.2657364209493003) | > avg_loss_disc_real_0: 0.36432649691899616 (+0.05487538377443946) | > avg_loss_disc_real_1: 0.2622712403535843 (-0.07384354372819263) | > avg_loss_disc_real_2: 0.34568050503730774 (+0.012647916873296083) | > avg_loss_disc_real_3: 0.2371202458937963 (-0.06722777585188547) | > avg_loss_disc_real_4: 0.3399295260508855 (+0.08352515598138172) | > avg_loss_disc_real_5: 0.36804992457230884 (+0.07714636623859406) | > avg_loss_0: 2.986318906148275 (+0.2657364209493003) | > avg_loss_gen: 2.2606669267018638 (-0.5827352205912271) | > avg_loss_kl: 3.6931909720102944 (+0.07323773701985647) | > avg_loss_feat: 4.235905885696411 (+0.18672393759091666) | > avg_loss_mel: 24.186176300048828 (+3.6645924250284843) | > avg_loss_duration: 2.939784526824951 (+0.005658706029256333) | > avg_loss_1: 37.31572659810384 (+3.347479502360031)  > EPOCH: 617/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:42:43)   --> TIME: 2023-10-20 06:43:07 -- STEP: 29/50 -- GLOBAL_STEP: 83880 | > loss_disc: 3.032222270965576 (2.3878661784632453) | > loss_disc_real_0: 0.3585186302661896 (0.1589542938524793) | > loss_disc_real_1: 0.2694060504436493 (0.2067581770363553) | > loss_disc_real_2: 0.376884400844574 (0.2271539179672455) | > loss_disc_real_3: 0.30059024691581726 (0.23312784493740263) | > loss_disc_real_4: 0.24723845720291138 (0.21749206747988176) | > loss_disc_real_5: 0.26343950629234314 (0.1946019129506473) | > loss_0: 3.032222270965576 (2.3878661784632453) | > grad_norm_0: tensor(1117.6407, device='cuda:0') (tensor(1049.6234, device='cuda:0')) | > loss_gen: 1.837565541267395 (2.4204241078475426) | > loss_kl: 0.9996358156204224 (0.8701159070278036) | > loss_feat: 0.20992988348007202 (5.92792280968921) | > loss_mel: 6.489070415496826 (20.91311279247547) | > loss_duration: 1.4426047801971436 (1.455717580071811) | > loss_1: 10.978806495666504 (31.587293427566003) | > grad_norm_1: tensor(23764.1523, device='cuda:0') (tensor(65205.4688, device='cuda:0')) | > current_lr_0: 0.00010790797718756005 | > current_lr_1: 0.00010790797718756005 | > step_time: 0.9145 (0.5964390162763924) | > loader_time: 0.0257 (0.014255556566961881)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4231488704681396 (2.4231488704681396) | > loss_disc_real_0: 0.12452322989702225 (0.12452322989702225) | > loss_disc_real_1: 0.2206190973520279 (0.2206190973520279) | > loss_disc_real_2: 0.3075544834136963 (0.3075544834136963) | > loss_disc_real_3: 0.28696000576019287 (0.28696000576019287) | > loss_disc_real_4: 0.33133465051651 (0.33133465051651) | > loss_disc_real_5: 0.30566030740737915 (0.30566030740737915) | > loss_0: 2.4231488704681396 (2.4231488704681396) | > loss_gen: 2.690032482147217 (2.690032482147217) | > loss_kl: 4.547718524932861 (4.547718524932861) | > loss_feat: 5.046316146850586 (5.046316146850586) | > loss_mel: 22.551570892333984 (22.551570892333984) | > loss_duration: 2.73280930519104 (2.73280930519104) | > loss_1: 37.568450927734375 (37.568450927734375)  --> STEP: 1 | > loss_disc: 2.2777113914489746 (2.2777113914489746) | > loss_disc_real_0: 0.11961673200130463 (0.11961673200130463) | > loss_disc_real_1: 0.2214827537536621 (0.2214827537536621) | > loss_disc_real_2: 0.31923907995224 (0.31923907995224) | > loss_disc_real_3: 0.1753794103860855 (0.1753794103860855) | > loss_disc_real_4: 0.1605653315782547 (0.1605653315782547) | > loss_disc_real_5: 0.16549523174762726 (0.16549523174762726) | > loss_0: 2.2777113914489746 (2.2777113914489746) | > loss_gen: 2.097970485687256 (2.097970485687256) | > loss_kl: 4.158069610595703 (4.158069610595703) | > loss_feat: 5.749077796936035 (5.749077796936035) | > loss_mel: 22.936532974243164 (22.936532974243164) | > loss_duration: 3.007816791534424 (3.007816791534424) | > loss_1: 37.949466705322266 (37.949466705322266)  --> STEP: 2 | > loss_disc: 1.7781919240951538 (2.027951657772064) | > loss_disc_real_0: 0.06160235032439232 (0.09060954116284847) | > loss_disc_real_1: 0.28124457597732544 (0.2513636648654938) | > loss_disc_real_2: 0.14094696938991547 (0.23009302467107773) | > loss_disc_real_3: 0.15916632115840912 (0.16727286577224731) | > loss_disc_real_4: 0.16159386932849884 (0.16107960045337677) | > loss_disc_real_5: 0.2333926409482956 (0.19944393634796143) | > loss_0: 1.7781919240951538 (2.027951657772064) | > loss_gen: 2.947404146194458 (2.522687315940857) | > loss_kl: 4.5358452796936035 (4.346957445144653) | > loss_feat: 10.964621543884277 (8.356849670410156) | > loss_mel: 27.549318313598633 (25.2429256439209) | > loss_duration: 2.989882469177246 (2.998849630355835) | > loss_1: 48.9870719909668 (43.46826934814453)  --> STEP: 3 | > loss_disc: 2.716567039489746 (2.257490118344625) | > loss_disc_real_0: 0.10846425592899323 (0.09656111275156339) | > loss_disc_real_1: 0.293080598115921 (0.26526930928230286) | > loss_disc_real_2: 0.2055295705795288 (0.22190520664056143) | > loss_disc_real_3: 0.29764142632484436 (0.210729052623113) | > loss_disc_real_4: 0.2918532192707062 (0.20467080672581991) | > loss_disc_real_5: 0.2657267451286316 (0.22153820594151816) | > loss_0: 2.716567039489746 (2.257490118344625) | > loss_gen: 1.8073205947875977 (2.284231742223104) | > loss_kl: 2.0303196907043457 (3.5747448603312173) | > loss_feat: 1.601161003112793 (6.104953447977702) | > loss_mel: 19.729137420654297 (23.404996236165363) | > loss_duration: 2.8057546615600586 (2.9344846407572427) | > loss_1: 27.97369384765625 (38.30341084798177) --> EVAL PERFORMANCE | > avg_loader_time: 0.012232542037963867 (+0.0011374950408935547) | > avg_loss_disc: 2.257490118344625 (-0.7288287878036499) | > avg_loss_disc_real_0: 0.09656111275156339 (-0.2677653841674328) | > avg_loss_disc_real_1: 0.26526930928230286 (+0.002998068928718567) | > avg_loss_disc_real_2: 0.22190520664056143 (-0.12377529839674631) | > avg_loss_disc_real_3: 0.210729052623113 (-0.02639119327068329) | > avg_loss_disc_real_4: 0.20467080672581991 (-0.13525871932506559) | > avg_loss_disc_real_5: 0.22153820594151816 (-0.14651171863079068) | > avg_loss_0: 2.257490118344625 (-0.7288287878036499) | > avg_loss_gen: 2.284231742223104 (+0.023564815521240234) | > avg_loss_kl: 3.5747448603312173 (-0.11844611167907715) | > avg_loss_feat: 6.104953447977702 (+1.869047562281291) | > avg_loss_mel: 23.404996236165363 (-0.7811800638834647) | > avg_loss_duration: 2.9344846407572427 (-0.005299886067708481) | > avg_loss_1: 38.30341084798177 (+0.9876842498779297)  > EPOCH: 618/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:43:31)   --> TIME: 2023-10-20 06:43:43 -- STEP: 9/50 -- GLOBAL_STEP: 83910 | > loss_disc: 1.0322178602218628 (2.306903349028693) | > loss_disc_real_0: 0.0463164821267128 (0.17171330625812212) | > loss_disc_real_1: 0.15906070172786713 (0.2511644967728191) | > loss_disc_real_2: 0.12373292446136475 (0.25732743077807957) | > loss_disc_real_3: 0.14521385729312897 (0.24443325400352478) | > loss_disc_real_4: 0.04735775291919708 (0.24075321356455484) | > loss_disc_real_5: 0.006924484856426716 (0.18351847564594614) | > loss_0: 1.0322178602218628 (2.306903349028693) | > grad_norm_0: tensor(569.3073, device='cuda:0') (tensor(1287.8621, device='cuda:0')) | > loss_gen: 3.587735652923584 (2.6877178483539157) | > loss_kl: 0.6281786561012268 (0.8257027500205569) | > loss_feat: 11.361837387084961 (6.545329492953089) | > loss_mel: 24.874439239501953 (21.368606037563747) | > loss_duration: 1.4029216766357422 (1.46387959851159) | > loss_1: 41.85511016845703 (32.89123482174344) | > grad_norm_1: tensor(68685.6797, device='cuda:0') (tensor(78452.9688, device='cuda:0')) | > current_lr_0: 0.00010780011640831188 | > current_lr_1: 0.00010780011640831188 | > step_time: 0.5342 (0.6413448916541206) | > loader_time: 0.0193 (0.023025857077704534)  --> TIME: 2023-10-20 06:44:00 -- STEP: 39/50 -- GLOBAL_STEP: 83940 | > loss_disc: 2.348977565765381 (2.4978105655083285) | > loss_disc_real_0: 0.0731382891535759 (0.16654427249271128) | > loss_disc_real_1: 0.3372957408428192 (0.23233395642959154) | > loss_disc_real_2: 0.23181569576263428 (0.23234326430620292) | > loss_disc_real_3: 0.2900063991546631 (0.24611332019170126) | > loss_disc_real_4: 0.20534639060497284 (0.23752945919449514) | > loss_disc_real_5: 0.2054925560951233 (0.22398196631230605) | > loss_0: 2.348977565765381 (2.4978105655083285) | > grad_norm_0: tensor(788.2733, device='cuda:0') (tensor(1108.7686, device='cuda:0')) | > loss_gen: 2.1730799674987793 (2.348844662690774) | > loss_kl: 0.42177248001098633 (0.8212256438266008) | > loss_feat: 3.726989507675171 (5.263630340114618) | > loss_mel: 24.268245697021484 (19.775767769569008) | > loss_duration: 1.51076340675354 (1.4466629120019765) | > loss_1: 32.100852966308594 (29.656131096375294) | > grad_norm_1: tensor(6916.7871, device='cuda:0') (tensor(52016.9219, device='cuda:0')) | > current_lr_0: 0.00010780011640831188 | > current_lr_1: 0.00010780011640831188 | > step_time: 0.2615 (0.5667843207334861) | > loader_time: 0.0055 (0.01657567268762833)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.794921398162842 (2.794921398162842) | > loss_disc_real_0: 0.29818588495254517 (0.29818588495254517) | > loss_disc_real_1: 0.28430089354515076 (0.28430089354515076) | > loss_disc_real_2: 0.1890639215707779 (0.1890639215707779) | > loss_disc_real_3: 0.2782568037509918 (0.2782568037509918) | > loss_disc_real_4: 0.25990352034568787 (0.25990352034568787) | > loss_disc_real_5: 0.27954617142677307 (0.27954617142677307) | > loss_0: 2.794921398162842 (2.794921398162842) | > loss_gen: 2.0667784214019775 (2.0667784214019775) | > loss_kl: 4.588825702667236 (4.588825702667236) | > loss_feat: 1.5884456634521484 (1.5884456634521484) | > loss_mel: 20.103246688842773 (20.103246688842773) | > loss_duration: 2.7923758029937744 (2.7923758029937744) | > loss_1: 31.139671325683594 (31.139671325683594)  --> STEP: 1 | > loss_disc: 2.8223679065704346 (2.8223679065704346) | > loss_disc_real_0: 0.2890721559524536 (0.2890721559524536) | > loss_disc_real_1: 0.2493056058883667 (0.2493056058883667) | > loss_disc_real_2: 0.26005154848098755 (0.26005154848098755) | > loss_disc_real_3: 0.31252986192703247 (0.31252986192703247) | > loss_disc_real_4: 0.21694712340831757 (0.21694712340831757) | > loss_disc_real_5: 0.21807420253753662 (0.21807420253753662) | > loss_0: 2.8223679065704346 (2.8223679065704346) | > loss_gen: 2.017042636871338 (2.017042636871338) | > loss_kl: 4.575583457946777 (4.575583457946777) | > loss_feat: 2.737804651260376 (2.737804651260376) | > loss_mel: 21.556123733520508 (21.556123733520508) | > loss_duration: 3.0595085620880127 (3.0595085620880127) | > loss_1: 33.94606018066406 (33.94606018066406)  --> STEP: 2 | > loss_disc: 2.307790994644165 (2.5650794506073) | > loss_disc_real_0: 0.09803055971860886 (0.19355135783553123) | > loss_disc_real_1: 0.33002668619155884 (0.28966614603996277) | > loss_disc_real_2: 0.19085244834423065 (0.2254519984126091) | > loss_disc_real_3: 0.29280251264572144 (0.30266618728637695) | > loss_disc_real_4: 0.19454455375671387 (0.20574583858251572) | > loss_disc_real_5: 0.38038599491119385 (0.29923009872436523) | > loss_0: 2.307790994644165 (2.5650794506073) | > loss_gen: 3.666543960571289 (2.8417932987213135) | > loss_kl: 4.2848429679870605 (4.430213212966919) | > loss_feat: 9.834919929504395 (6.286362290382385) | > loss_mel: 29.770055770874023 (25.663089752197266) | > loss_duration: 2.944176435470581 (3.001842498779297) | > loss_1: 50.50053405761719 (42.223297119140625)  --> STEP: 3 | > loss_disc: 1.6960053443908691 (2.2753880818684897) | > loss_disc_real_0: 0.16581293940544128 (0.1843052183588346) | > loss_disc_real_1: 0.15833593904972076 (0.24588941037654877) | > loss_disc_real_2: 0.19938461482524872 (0.21676287055015564) | > loss_disc_real_3: 0.22071097791194916 (0.2753477841615677) | > loss_disc_real_4: 0.14156381785869598 (0.1843518316745758) | > loss_disc_real_5: 0.05606391653418541 (0.21817470466097197) | > loss_0: 1.6960053443908691 (2.2753880818684897) | > loss_gen: 2.8208281993865967 (2.8348049322764077) | > loss_kl: 2.3994836807250977 (3.753303368886312) | > loss_feat: 7.854517936706543 (6.8090808391571045) | > loss_mel: 22.686267852783203 (24.67081578572591) | > loss_duration: 2.810037851333618 (2.937907616297404) | > loss_1: 38.571136474609375 (41.00591023763021) --> EVAL PERFORMANCE | > avg_loader_time: 0.033850669860839844 (+0.021618127822875977) | > avg_loss_disc: 2.2753880818684897 (+0.017897963523864746) | > avg_loss_disc_real_0: 0.1843052183588346 (+0.08774410560727121) | > avg_loss_disc_real_1: 0.24588941037654877 (-0.01937989890575409) | > avg_loss_disc_real_2: 0.21676287055015564 (-0.005142336090405791) | > avg_loss_disc_real_3: 0.2753477841615677 (+0.06461873153845468) | > avg_loss_disc_real_4: 0.1843518316745758 (-0.02031897505124411) | > avg_loss_disc_real_5: 0.21817470466097197 (-0.0033635012805461884) | > avg_loss_0: 2.2753880818684897 (+0.017897963523864746) | > avg_loss_gen: 2.8348049322764077 (+0.5505731900533037) | > avg_loss_kl: 3.753303368886312 (+0.1785585085550947) | > avg_loss_feat: 6.8090808391571045 (+0.7041273911794024) | > avg_loss_mel: 24.67081578572591 (+1.2658195495605469) | > avg_loss_duration: 2.937907616297404 (+0.003422975540161133) | > avg_loss_1: 41.00591023763021 (+2.7024993896484375)  > EPOCH: 619/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:44:16)   --> TIME: 2023-10-20 06:44:37 -- STEP: 19/50 -- GLOBAL_STEP: 83970 | > loss_disc: 2.8860278129577637 (2.5015928306077657) | > loss_disc_real_0: 0.1872766613960266 (0.146922779195991) | > loss_disc_real_1: 0.30365094542503357 (0.24633894135293208) | > loss_disc_real_2: 0.29142695665359497 (0.2223570527214753) | > loss_disc_real_3: 0.37840038537979126 (0.26154241838345405) | > loss_disc_real_4: 0.3369138836860657 (0.2155517229908391) | > loss_disc_real_5: 0.41422006487846375 (0.2277064586156293) | > loss_0: 2.8860278129577637 (2.5015928306077657) | > grad_norm_0: tensor(963.4314, device='cuda:0') (tensor(1166.9823, device='cuda:0')) | > loss_gen: 2.2205700874328613 (2.392965191288998) | > loss_kl: 0.8187472224235535 (0.7671203409370623) | > loss_feat: 2.352804183959961 (5.695915893504494) | > loss_mel: 19.44845962524414 (22.395729265714948) | > loss_duration: 1.534071445465088 (1.4684355070716457) | > loss_1: 26.374650955200195 (32.72016565423263) | > grad_norm_1: tensor(9032.4912, device='cuda:0') (tensor(52198.3320, device='cuda:0')) | > current_lr_0: 0.00010769236344266568 | > current_lr_1: 0.00010769236344266568 | > step_time: 1.0641 (0.668766272695441) | > loader_time: 0.0347 (0.02831287133066278)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.5311012268066406 (1.5311012268066406) | > loss_disc_real_0: 0.013178182765841484 (0.013178182765841484) | > loss_disc_real_1: 0.0668114647269249 (0.0668114647269249) | > loss_disc_real_2: 0.07195180654525757 (0.07195180654525757) | > loss_disc_real_3: 0.04411143437027931 (0.04411143437027931) | > loss_disc_real_4: 0.08571906387805939 (0.08571906387805939) | > loss_disc_real_5: 0.052951324731111526 (0.052951324731111526) | > loss_0: 1.5311012268066406 (1.5311012268066406) | > loss_gen: 2.2881264686584473 (2.2881264686584473) | > loss_kl: 3.6386849880218506 (3.6386849880218506) | > loss_feat: 12.540932655334473 (12.540932655334473) | > loss_mel: 26.416982650756836 (26.416982650756836) | > loss_duration: 2.7051327228546143 (2.7051327228546143) | > loss_1: 47.58985900878906 (47.58985900878906)  --> STEP: 1 | > loss_disc: 2.784198045730591 (2.784198045730591) | > loss_disc_real_0: 0.10288859158754349 (0.10288859158754349) | > loss_disc_real_1: 0.2394927591085434 (0.2394927591085434) | > loss_disc_real_2: 0.2541569471359253 (0.2541569471359253) | > loss_disc_real_3: 0.20411264896392822 (0.20411264896392822) | > loss_disc_real_4: 0.27489280700683594 (0.27489280700683594) | > loss_disc_real_5: 0.22463402152061462 (0.22463402152061462) | > loss_0: 2.784198045730591 (2.784198045730591) | > loss_gen: 1.6458073854446411 (1.6458073854446411) | > loss_kl: 4.570530891418457 (4.570530891418457) | > loss_feat: 4.470805644989014 (4.470805644989014) | > loss_mel: 22.91486358642578 (22.91486358642578) | > loss_duration: 3.063112258911133 (3.063112258911133) | > loss_1: 36.665122985839844 (36.665122985839844)  --> STEP: 2 | > loss_disc: 1.781552791595459 (2.282875418663025) | > loss_disc_real_0: 0.03843115270137787 (0.07065987214446068) | > loss_disc_real_1: 0.11521229147911072 (0.17735252529382706) | > loss_disc_real_2: 0.21537987887859344 (0.23476841300725937) | > loss_disc_real_3: 0.11276225745677948 (0.15843745321035385) | > loss_disc_real_4: 0.09750447422266006 (0.186198640614748) | > loss_disc_real_5: 0.06415440142154694 (0.14439421147108078) | > loss_0: 1.781552791595459 (2.282875418663025) | > loss_gen: 2.2171578407287598 (1.9314826130867004) | > loss_kl: 4.844002723693848 (4.707266807556152) | > loss_feat: 10.356404304504395 (7.413604974746704) | > loss_mel: 22.753541946411133 (22.834202766418457) | > loss_duration: 2.901240587234497 (2.982176423072815) | > loss_1: 43.072349548339844 (39.868736267089844)  --> STEP: 3 | > loss_disc: 2.431286096572876 (2.332345644632975) | > loss_disc_real_0: 0.05281338095664978 (0.06471104174852371) | > loss_disc_real_1: 0.21521435678005219 (0.18997313578923544) | > loss_disc_real_2: 0.1158115565776825 (0.19511612753073374) | > loss_disc_real_3: 0.2813975214958191 (0.19942414263884226) | > loss_disc_real_4: 0.19562557339668274 (0.18934095154205957) | > loss_disc_real_5: 0.4283738434314728 (0.23905408879121146) | > loss_0: 2.431286096572876 (2.332345644632975) | > loss_gen: 2.198856830596924 (2.020607352256775) | > loss_kl: 1.9080684185028076 (3.774200677871704) | > loss_feat: 4.871209144592285 (6.5661396980285645) | > loss_mel: 19.683874130249023 (21.784093221028645) | > loss_duration: 2.7191686630249023 (2.8945071697235107) | > loss_1: 31.381175994873047 (37.03954950968424)  --> TIME: 2023-10-20 06:45:03 -- STEP: 49/50 -- GLOBAL_STEP: 84000 | > loss_disc: 2.3625659942626953 (2.464774165834698) | > loss_disc_real_0: 0.03505387529730797 (0.1384903285937498) | > loss_disc_real_1: 0.30251798033714294 (0.23521364567687317) | > loss_disc_real_2: 0.1465814709663391 (0.2141105755403334) | > loss_disc_real_3: 0.23851117491722107 (0.24315683684330813) | > loss_disc_real_4: 0.18821988999843597 (0.21925661712884903) | > loss_disc_real_5: 0.25871968269348145 (0.23287466616958988) | > loss_0: 2.3625659942626953 (2.464774165834698) | > grad_norm_0: tensor(2258.9924, device='cuda:0') (tensor(1185.1235, device='cuda:0')) | > loss_gen: 2.37107253074646 (2.3343240679526818) | > loss_kl: 0.4764135181903839 (0.8219612471911372) | > loss_feat: 3.830780029296875 (5.315087567786781) | > loss_mel: 20.04082679748535 (21.884423119681216) | > loss_duration: 1.5525966882705688 (1.4391574300065333) | > loss_1: 28.271690368652344 (31.794953190550512) | > grad_norm_1: tensor(10016.4971, device='cuda:0') (tensor(42366.6719, device='cuda:0')) | > current_lr_0: 0.00010769236344266568 | > current_lr_1: 0.00010769236344266568 | > step_time: 1.4964 (0.6412438957058654) | > loader_time: 7.0414 (0.16595095517684003) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_84000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8635189533233643 (2.4651389718055725) | > loss_disc_real_0: 0.17657417058944702 (0.09267682395875454) | > loss_disc_real_1: 0.2939797639846802 (0.21597479283809662) | > loss_disc_real_2: 0.2964929938316345 (0.22046034410595894) | > loss_disc_real_3: 0.2711637020111084 (0.2173590324819088) | > loss_disc_real_4: 0.2714356780052185 (0.2098646331578493) | > loss_disc_real_5: 0.2723877429962158 (0.24738750234246254) | > loss_0: 2.8635189533233643 (2.4651389718055725) | > loss_gen: 1.7410600185394287 (1.9507205188274384) | > loss_kl: 3.6329565048217773 (3.7388896346092224) | > loss_feat: 0.38777896761894226 (5.021549515426159) | > loss_mel: 11.790624618530273 (19.285726070404053) | > loss_duration: 2.756030321121216 (2.859887957572937) | > loss_1: 20.30845069885254 (32.85677480697632)  --> STEP: 1 | > loss_disc: 2.3683900833129883 (2.4457891941070558) | > loss_disc_real_0: 0.16743411123752594 (0.10762828141450882) | > loss_disc_real_1: 0.18731577694416046 (0.21024298965930938) | > loss_disc_real_2: 0.1958693265914917 (0.21554214060306548) | > loss_disc_real_3: 0.20967507362365723 (0.2158222407102585) | > loss_disc_real_4: 0.1754130870103836 (0.20297432392835618) | > loss_disc_real_5: 0.24475409090518951 (0.24686082005500792) | > loss_0: 2.3683900833129883 (2.4457891941070558) | > loss_gen: 2.3330166339874268 (2.027179741859436) | > loss_kl: 4.292628288269043 (3.8496373653411866) | > loss_feat: 6.776918411254883 (5.372623294591904) | > loss_mel: 23.03064727783203 (20.034710311889647) | > loss_duration: 3.056732177734375 (2.8992568016052247) | > loss_1: 39.48994064331055 (34.18340797424317)  --> STEP: 2 | > loss_disc: 1.6028252840042114 (2.305295209089915) | > loss_disc_real_0: 0.14493811130523682 (0.11384658639629681) | > loss_disc_real_1: 0.09335502982139587 (0.19076166301965714) | > loss_disc_real_2: 0.12941378355026245 (0.20118741442759833) | > loss_disc_real_3: 0.15496334433555603 (0.20567909131447473) | > loss_disc_real_4: 0.09887868165969849 (0.18562505021691322) | > loss_disc_real_5: 0.10559476912021637 (0.22331647823254266) | > loss_0: 1.6028252840042114 (2.305295209089915) | > loss_gen: 2.896775960922241 (2.17211244503657) | > loss_kl: 4.990128993988037 (4.039719303448995) | > loss_feat: 10.4129638671875 (6.21268005669117) | > loss_mel: 24.675134658813477 (20.808114369710285) | > loss_duration: 2.904878616333008 (2.900193770726522) | > loss_1: 45.8798828125 (36.13282044728597)  --> STEP: 3 | > loss_disc: 3.023010015487671 (2.4078258957181657) | > loss_disc_real_0: 0.17281432449817657 (0.12227054898227964) | > loss_disc_real_1: 0.2918604016304016 (0.20520433996404921) | > loss_disc_real_2: 0.3095676302909851 (0.21667030240808213) | > loss_disc_real_3: 0.27178722620010376 (0.2151231105838503) | > loss_disc_real_4: 0.27558761835098267 (0.19847684566463744) | > loss_disc_real_5: 0.27779319882392883 (0.231098866888455) | > loss_0: 3.023010015487671 (2.4078258957181657) | > loss_gen: 1.604081630706787 (2.0909651858466014) | > loss_kl: 2.386441230773926 (3.8035367216382707) | > loss_feat: 0.03285549581050873 (5.329847976565361) | > loss_mel: 2.329132318496704 (18.16825979096549) | > loss_duration: 2.77768611907959 (2.882692677634103) | > loss_1: 9.130197525024414 (32.27530288696289) --> EVAL PERFORMANCE | > avg_loader_time: 0.35719612666538786 (+0.323345456804548) | > avg_loss_disc: 2.4078258957181657 (+0.132437813849676) | > avg_loss_disc_real_0: 0.12227054898227964 (-0.062034669376554955) | > avg_loss_disc_real_1: 0.20520433996404921 (-0.04068507041249955) | > avg_loss_disc_real_2: 0.21667030240808213 (-9.256814207350694e-05) | > avg_loss_disc_real_3: 0.2151231105838503 (-0.06022467357771738) | > avg_loss_disc_real_4: 0.19847684566463744 (+0.014125013990061636) | > avg_loss_disc_real_5: 0.231098866888455 (+0.012924162227483021) | > avg_loss_0: 2.4078258957181657 (+0.132437813849676) | > avg_loss_gen: 2.0909651858466014 (-0.7438397464298063) | > avg_loss_kl: 3.8035367216382707 (+0.050233352751958726) | > avg_loss_feat: 5.329847976565361 (-1.4792328625917435) | > avg_loss_mel: 18.16825979096549 (-6.502555994760421) | > avg_loss_duration: 2.882692677634103 (-0.05521493866330074) | > avg_loss_1: 32.27530288696289 (-8.73060735066732)  > EPOCH: 620/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:45:20)   --> TIME: 2023-10-20 06:45:50 -- STEP: 29/50 -- GLOBAL_STEP: 84030 | > loss_disc: 1.6375881433486938 (2.374204491746837) | > loss_disc_real_0: 0.025405697524547577 (0.1278333996647391) | > loss_disc_real_1: 0.14670735597610474 (0.22635109311547771) | > loss_disc_real_2: 0.10476195812225342 (0.23442561693232636) | > loss_disc_real_3: 0.13786745071411133 (0.2405044965702912) | > loss_disc_real_4: 0.097446009516716 (0.2274690599919393) | > loss_disc_real_5: 0.056054044514894485 (0.20658811021210818) | > loss_0: 1.6375881433486938 (2.374204491746837) | > grad_norm_0: tensor(773.5661, device='cuda:0') (tensor(1108.7153, device='cuda:0')) | > loss_gen: 2.3831589221954346 (2.4342129723779085) | > loss_kl: 1.1019412279129028 (0.8047103933219252) | > loss_feat: 7.812648296356201 (5.790904713088069) | > loss_mel: 24.444894790649414 (21.469144706068366) | > loss_duration: 1.4257436990737915 (1.452165361108451) | > loss_1: 37.16838836669922 (31.951138299087) | > grad_norm_1: tensor(4819.5596, device='cuda:0') (tensor(47121.7852, device='cuda:0')) | > current_lr_0: 0.00010758471818285496 | > current_lr_1: 0.00010758471818285496 | > step_time: 0.7667 (0.7918717778962233) | > loader_time: 0.0447 (0.024113860623589882)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.76369309425354 (2.76369309425354) | > loss_disc_real_0: 0.1096775084733963 (0.1096775084733963) | > loss_disc_real_1: 0.2510947585105896 (0.2510947585105896) | > loss_disc_real_2: 0.33295270800590515 (0.33295270800590515) | > loss_disc_real_3: 0.3077949583530426 (0.3077949583530426) | > loss_disc_real_4: 0.14093928039073944 (0.14093928039073944) | > loss_disc_real_5: 0.20485013723373413 (0.20485013723373413) | > loss_0: 2.76369309425354 (2.76369309425354) | > loss_gen: 1.6577574014663696 (1.6577574014663696) | > loss_kl: 3.9767379760742188 (3.9767379760742188) | > loss_feat: 2.0947089195251465 (2.0947089195251465) | > loss_mel: 6.346968173980713 (6.346968173980713) | > loss_duration: 2.654773712158203 (2.654773712158203) | > loss_1: 16.730945587158203 (16.730945587158203)  --> STEP: 1 | > loss_disc: 2.7389888763427734 (2.7389888763427734) | > loss_disc_real_0: 0.25408753752708435 (0.25408753752708435) | > loss_disc_real_1: 0.30447709560394287 (0.30447709560394287) | > loss_disc_real_2: 0.3750483989715576 (0.3750483989715576) | > loss_disc_real_3: 0.2866523861885071 (0.2866523861885071) | > loss_disc_real_4: 0.2819582521915436 (0.2819582521915436) | > loss_disc_real_5: 0.23097862303256989 (0.23097862303256989) | > loss_0: 2.7389888763427734 (2.7389888763427734) | > loss_gen: 2.7946314811706543 (2.7946314811706543) | > loss_kl: 4.2410125732421875 (4.2410125732421875) | > loss_feat: 5.7441582679748535 (5.7441582679748535) | > loss_mel: 24.276222229003906 (24.276222229003906) | > loss_duration: 3.0101866722106934 (3.0101866722106934) | > loss_1: 40.06620788574219 (40.06620788574219)  --> STEP: 2 | > loss_disc: 2.719395875930786 (2.72919237613678) | > loss_disc_real_0: 0.1696232259273529 (0.21185538172721863) | > loss_disc_real_1: 0.2972719967365265 (0.3008745461702347) | > loss_disc_real_2: 0.2655167579650879 (0.32028257846832275) | > loss_disc_real_3: 0.3159012794494629 (0.301276832818985) | > loss_disc_real_4: 0.2124221920967102 (0.2471902221441269) | > loss_disc_real_5: 0.27222102880477905 (0.25159982591867447) | > loss_0: 2.719395875930786 (2.72919237613678) | > loss_gen: 1.9859352111816406 (2.3902833461761475) | > loss_kl: 4.407761096954346 (4.324386835098267) | > loss_feat: 1.9079478979110718 (3.8260530829429626) | > loss_mel: 25.188602447509766 (24.732412338256836) | > loss_duration: 2.9088380336761475 (2.9595123529434204) | > loss_1: 36.39908218383789 (38.23264503479004)  --> STEP: 3 | > loss_disc: 3.1537351608276367 (2.870706637700399) | > loss_disc_real_0: 0.6652692556381226 (0.36299333969751996) | > loss_disc_real_1: 0.2652023434638977 (0.288983811934789) | > loss_disc_real_2: 0.35914602875709534 (0.33323706189791363) | > loss_disc_real_3: 0.33151814341545105 (0.3113572696844737) | > loss_disc_real_4: 0.3253598213195801 (0.27324675520261127) | > loss_disc_real_5: 0.2899011969566345 (0.2643669495979945) | > loss_0: 3.1537351608276367 (2.870706637700399) | > loss_gen: 2.622469186782837 (2.4676786263783774) | > loss_kl: 2.321244478225708 (3.656672716140747) | > loss_feat: 2.459440231323242 (3.370515465736389) | > loss_mel: 19.409576416015625 (22.958133697509766) | > loss_duration: 2.7892749309539795 (2.902766545613607) | > loss_1: 29.602005004882812 (35.35576502482096) --> EVAL PERFORMANCE | > avg_loader_time: 0.026821374893188477 (-0.3303747517721994) | > avg_loss_disc: 2.870706637700399 (+0.46288074198223317) | > avg_loss_disc_real_0: 0.36299333969751996 (+0.24072279071524033) | > avg_loss_disc_real_1: 0.288983811934789 (+0.08377947197073979) | > avg_loss_disc_real_2: 0.33323706189791363 (+0.1165667594898315) | > avg_loss_disc_real_3: 0.3113572696844737 (+0.09623415910062338) | > avg_loss_disc_real_4: 0.27324675520261127 (+0.07476990953797383) | > avg_loss_disc_real_5: 0.2643669495979945 (+0.033268082709539515) | > avg_loss_0: 2.870706637700399 (+0.46288074198223317) | > avg_loss_gen: 2.4676786263783774 (+0.376713440531776) | > avg_loss_kl: 3.656672716140747 (-0.14686400549752365) | > avg_loss_feat: 3.370515465736389 (-1.9593325108289719) | > avg_loss_mel: 22.958133697509766 (+4.789873906544276) | > avg_loss_duration: 2.902766545613607 (+0.020073867979503834) | > avg_loss_1: 35.35576502482096 (+3.0804621378580705)  > EPOCH: 621/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:46:13)   --> TIME: 2023-10-20 06:46:31 -- STEP: 9/50 -- GLOBAL_STEP: 84060 | > loss_disc: 1.7299466133117676 (2.3727486398484974) | > loss_disc_real_0: 0.08324805647134781 (0.19082240015268326) | > loss_disc_real_1: 0.15415100753307343 (0.22737160325050354) | > loss_disc_real_2: 0.09453988820314407 (0.2167518304453956) | > loss_disc_real_3: 0.10856112837791443 (0.22127887917061648) | > loss_disc_real_4: 0.14769233763217926 (0.1919959286848704) | > loss_disc_real_5: 0.02389974147081375 (0.1967354060875045) | > loss_0: 1.7299466133117676 (2.3727486398484974) | > grad_norm_0: tensor(738.6548, device='cuda:0') (tensor(1234.7413, device='cuda:0')) | > loss_gen: 2.454704999923706 (2.3501263327068753) | > loss_kl: 0.9662008881568909 (0.9329115417268541) | > loss_feat: 7.231400966644287 (5.330267682671547) | > loss_mel: 23.283567428588867 (20.280843628777397) | > loss_duration: 1.38127601146698 (1.449062214957343) | > loss_1: 35.3171501159668 (30.343211597866482) | > grad_norm_1: tensor(20618.0410, device='cuda:0') (tensor(45357.4141, device='cuda:0')) | > current_lr_0: 0.00010747718052122105 | > current_lr_1: 0.00010747718052122105 | > step_time: 0.5621 (0.8288608127170138) | > loader_time: 0.0152 (0.027399301528930664)  --> TIME: 2023-10-20 06:46:49 -- STEP: 39/50 -- GLOBAL_STEP: 84090 | > loss_disc: 1.4230960607528687 (2.548810578309573) | > loss_disc_real_0: 0.022291123867034912 (0.18102886718817246) | > loss_disc_real_1: 0.06703301519155502 (0.23723996597795916) | > loss_disc_real_2: 0.13210994005203247 (0.23624949577527168) | > loss_disc_real_3: 0.052676811814308167 (0.24368794181216985) | > loss_disc_real_4: 0.06897146999835968 (0.23021549091507226) | > loss_disc_real_5: 0.0595853254199028 (0.25884419283232635) | > loss_0: 1.4230960607528687 (2.548810578309573) | > grad_norm_0: tensor(1173.3735, device='cuda:0') (tensor(1442.0425, device='cuda:0')) | > loss_gen: 2.844315528869629 (2.2585146732819386) | > loss_kl: 0.6455785036087036 (0.8964891747022287) | > loss_feat: 11.096335411071777 (4.564479745924473) | > loss_mel: 30.474748611450195 (20.62377491975442) | > loss_duration: 1.5194162130355835 (1.441387304892907) | > loss_1: 46.58039474487305 (29.7846458875216) | > grad_norm_1: tensor(122441.9844, device='cuda:0') (tensor(38388.6133, device='cuda:0')) | > current_lr_0: 0.00010747718052122105 | > current_lr_1: 0.00010747718052122105 | > step_time: 0.8136 (0.6212947246355888) | > loader_time: 0.0387 (0.021944357798649713)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.640375852584839 (2.640375852584839) | > loss_disc_real_0: 0.22543813288211823 (0.22543813288211823) | > loss_disc_real_1: 0.1994105726480484 (0.1994105726480484) | > loss_disc_real_2: 0.3335516154766083 (0.3335516154766083) | > loss_disc_real_3: 0.25369080901145935 (0.25369080901145935) | > loss_disc_real_4: 0.4255821108818054 (0.4255821108818054) | > loss_disc_real_5: 0.33226752281188965 (0.33226752281188965) | > loss_0: 2.640375852584839 (2.640375852584839) | > loss_gen: 2.5655083656311035 (2.5655083656311035) | > loss_kl: 3.973726272583008 (3.973726272583008) | > loss_feat: 4.791821479797363 (4.791821479797363) | > loss_mel: 22.187023162841797 (22.187023162841797) | > loss_duration: 2.6558921337127686 (2.6558921337127686) | > loss_1: 36.173973083496094 (36.173973083496094)  --> STEP: 1 | > loss_disc: 2.153249502182007 (2.153249502182007) | > loss_disc_real_0: 0.059038396924734116 (0.059038396924734116) | > loss_disc_real_1: 0.15358133614063263 (0.15358133614063263) | > loss_disc_real_2: 0.11426938325166702 (0.11426938325166702) | > loss_disc_real_3: 0.2918904423713684 (0.2918904423713684) | > loss_disc_real_4: 0.23472508788108826 (0.23472508788108826) | > loss_disc_real_5: 0.21694014966487885 (0.21694014966487885) | > loss_0: 2.153249502182007 (2.153249502182007) | > loss_gen: 2.2302207946777344 (2.2302207946777344) | > loss_kl: 3.8833529949188232 (3.8833529949188232) | > loss_feat: 8.525534629821777 (8.525534629821777) | > loss_mel: 25.148941040039062 (25.148941040039062) | > loss_duration: 3.084273099899292 (3.084273099899292) | > loss_1: 42.8723258972168 (42.8723258972168)  --> STEP: 2 | > loss_disc: 2.072777509689331 (2.113013505935669) | > loss_disc_real_0: 0.12125078588724136 (0.09014459140598774) | > loss_disc_real_1: 0.3310813903808594 (0.242331363260746) | > loss_disc_real_2: 0.12539756298065186 (0.11983347311615944) | > loss_disc_real_3: 0.20608405768871307 (0.24898725003004074) | > loss_disc_real_4: 0.163971409201622 (0.19934824854135513) | > loss_disc_real_5: 0.2599852383136749 (0.23846269398927689) | > loss_0: 2.072777509689331 (2.113013505935669) | > loss_gen: 3.2540862560272217 (2.742153525352478) | > loss_kl: 4.724452495574951 (4.303902745246887) | > loss_feat: 9.360457420349121 (8.94299602508545) | > loss_mel: 24.192665100097656 (24.67080307006836) | > loss_duration: 2.955310106277466 (3.019791603088379) | > loss_1: 44.486968994140625 (43.67964744567871)  --> STEP: 3 | > loss_disc: 2.294443130493164 (2.173490047454834) | > loss_disc_real_0: 0.10451401770114899 (0.09493440017104149) | > loss_disc_real_1: 0.3319704532623291 (0.27221105992794037) | > loss_disc_real_2: 0.17867407202720642 (0.13944700608650842) | > loss_disc_real_3: 0.22741642594337463 (0.24179697533448538) | > loss_disc_real_4: 0.1272699385881424 (0.17532214522361755) | > loss_disc_real_5: 0.05297018960118294 (0.17663185919324556) | > loss_0: 2.294443130493164 (2.173490047454834) | > loss_gen: 2.260176420211792 (2.5814944903055825) | > loss_kl: 2.246706247329712 (3.6181705792744956) | > loss_feat: 6.140327453613281 (8.00877316792806) | > loss_mel: 24.977825164794922 (24.773143768310547) | > loss_duration: 2.795149564743042 (2.944910923639933) | > loss_1: 38.420188903808594 (41.92649459838867) --> EVAL PERFORMANCE | > avg_loader_time: 0.003931363423665364 (-0.022890011469523113) | > avg_loss_disc: 2.173490047454834 (-0.6972165902455649) | > avg_loss_disc_real_0: 0.09493440017104149 (-0.26805893952647847) | > avg_loss_disc_real_1: 0.27221105992794037 (-0.016772752006848635) | > avg_loss_disc_real_2: 0.13944700608650842 (-0.1937900558114052) | > avg_loss_disc_real_3: 0.24179697533448538 (-0.06956029434998831) | > avg_loss_disc_real_4: 0.17532214522361755 (-0.09792460997899372) | > avg_loss_disc_real_5: 0.17663185919324556 (-0.08773509040474894) | > avg_loss_0: 2.173490047454834 (-0.6972165902455649) | > avg_loss_gen: 2.5814944903055825 (+0.11381586392720511) | > avg_loss_kl: 3.6181705792744956 (-0.03850213686625148) | > avg_loss_feat: 8.00877316792806 (+4.638257702191671) | > avg_loss_mel: 24.773143768310547 (+1.8150100708007812) | > avg_loss_duration: 2.944910923639933 (+0.0421443780263262) | > avg_loss_1: 41.92649459838867 (+6.570729573567711)  > EPOCH: 622/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:47:10)   --> TIME: 2023-10-20 06:47:27 -- STEP: 19/50 -- GLOBAL_STEP: 84120 | > loss_disc: 3.102266550064087 (2.4781070696680167) | > loss_disc_real_0: 0.5105322599411011 (0.13968461609788632) | > loss_disc_real_1: 0.32806989550590515 (0.2142491548469192) | > loss_disc_real_2: 0.32305771112442017 (0.22698096813339935) | > loss_disc_real_3: 0.2951214015483856 (0.22695030605322436) | > loss_disc_real_4: 0.25287604331970215 (0.22880098008011518) | > loss_disc_real_5: 0.25650766491889954 (0.2449568126742777) | > loss_0: 3.102266550064087 (2.4781070696680167) | > grad_norm_0: tensor(3124.1831, device='cuda:0') (tensor(1245.7969, device='cuda:0')) | > loss_gen: 1.9494736194610596 (2.30818047648982) | > loss_kl: 1.2372592687606812 (0.8584462749330621) | > loss_feat: 0.8070727586746216 (5.0080464323247345) | > loss_mel: 16.265697479248047 (20.68062217925724) | > loss_duration: 1.5270875692367554 (1.5028424953159534) | > loss_1: 21.786592483520508 (30.358138310281856) | > grad_norm_1: tensor(10891.5576, device='cuda:0') (tensor(49274.0117, device='cuda:0')) | > current_lr_0: 0.0001073697503502128 | > current_lr_1: 0.0001073697503502128 | > step_time: 0.4288 (0.6144863680789345) | > loader_time: 0.0292 (0.017610549926757812)  --> TIME: 2023-10-20 06:47:47 -- STEP: 49/50 -- GLOBAL_STEP: 84150 | > loss_disc: 2.6130940914154053 (2.587257290373043) | > loss_disc_real_0: 0.19008362293243408 (0.15448820995813117) | > loss_disc_real_1: 0.20044930279254913 (0.22369124253793637) | > loss_disc_real_2: 0.211083322763443 (0.22532062985155046) | > loss_disc_real_3: 0.3048084080219269 (0.2298682093316195) | > loss_disc_real_4: 0.29108744859695435 (0.22751268976349004) | > loss_disc_real_5: 0.2558743357658386 (0.2398232870868274) | > loss_0: 2.6130940914154053 (2.587257290373043) | > grad_norm_0: tensor(1396.2468, device='cuda:0') (tensor(1318.5017, device='cuda:0')) | > loss_gen: 2.0135157108306885 (2.163832080607511) | > loss_kl: 0.33952829241752625 (0.7917166057289863) | > loss_feat: 1.5062462091445923 (4.8476812493493195) | > loss_mel: 21.085695266723633 (20.534617357108054) | > loss_duration: 1.571266770362854 (1.4531219857079642) | > loss_1: 26.516250610351562 (29.790969576154435) | > grad_norm_1: tensor(8952.8301, device='cuda:0') (tensor(40287.5586, device='cuda:0')) | > current_lr_0: 0.0001073697503502128 | > current_lr_1: 0.0001073697503502128 | > step_time: 0.8043 (0.6342476241442624) | > loader_time: 0.4018 (0.029161428918643872)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.959024429321289 (2.959024429321289) | > loss_disc_real_0: 0.4000585377216339 (0.4000585377216339) | > loss_disc_real_1: 0.2528212368488312 (0.2528212368488312) | > loss_disc_real_2: 0.28205370903015137 (0.28205370903015137) | > loss_disc_real_3: 0.2741406261920929 (0.2741406261920929) | > loss_disc_real_4: 0.33313098549842834 (0.33313098549842834) | > loss_disc_real_5: 0.2828828692436218 (0.2828828692436218) | > loss_0: 2.959024429321289 (2.959024429321289) | > loss_gen: 2.030862808227539 (2.030862808227539) | > loss_kl: 3.277458429336548 (3.277458429336548) | > loss_feat: 0.6113010048866272 (0.6113010048866272) | > loss_mel: 17.985240936279297 (17.985240936279297) | > loss_duration: 2.66241455078125 (2.66241455078125) | > loss_1: 26.567277908325195 (26.567277908325195)  --> STEP: 1 | > loss_disc: 2.609339952468872 (2.609339952468872) | > loss_disc_real_0: 0.6123666763305664 (0.6123666763305664) | > loss_disc_real_1: 0.3456825315952301 (0.3456825315952301) | > loss_disc_real_2: 0.2956080138683319 (0.2956080138683319) | > loss_disc_real_3: 0.26492682099342346 (0.26492682099342346) | > loss_disc_real_4: 0.3727671504020691 (0.3727671504020691) | > loss_disc_real_5: 0.17199170589447021 (0.17199170589447021) | > loss_0: 2.609339952468872 (2.609339952468872) | > loss_gen: 3.6869277954101562 (3.6869277954101562) | > loss_kl: 4.127297401428223 (4.127297401428223) | > loss_feat: 6.943602561950684 (6.943602561950684) | > loss_mel: 22.87702751159668 (22.87702751159668) | > loss_duration: 3.061880111694336 (3.061880111694336) | > loss_1: 40.696739196777344 (40.696739196777344)  --> STEP: 2 | > loss_disc: 2.836296558380127 (2.7228182554244995) | > loss_disc_real_0: 0.27334830164909363 (0.44285748898983) | > loss_disc_real_1: 0.2826010584831238 (0.31414179503917694) | > loss_disc_real_2: 0.21207959949970245 (0.2538438066840172) | > loss_disc_real_3: 0.3732419013977051 (0.31908436119556427) | > loss_disc_real_4: 0.2789951264858246 (0.32588113844394684) | > loss_disc_real_5: 0.364380419254303 (0.2681860625743866) | > loss_0: 2.836296558380127 (2.7228182554244995) | > loss_gen: 2.408536434173584 (3.04773211479187) | > loss_kl: 4.210503578186035 (4.168900489807129) | > loss_feat: 2.921175241470337 (4.93238890171051) | > loss_mel: 26.001819610595703 (24.43942356109619) | > loss_duration: 2.9737255573272705 (3.0178028345108032) | > loss_1: 38.5157585144043 (39.60624885559082)  --> STEP: 3 | > loss_disc: 2.8425562381744385 (2.762730916341146) | > loss_disc_real_0: 0.3780730962753296 (0.4212626914183299) | > loss_disc_real_1: 0.3695232570171356 (0.33260228236516315) | > loss_disc_real_2: 0.33239662647247314 (0.2800280799468358) | > loss_disc_real_3: 0.40070539712905884 (0.3462913731733958) | > loss_disc_real_4: 0.33831000328063965 (0.3300240933895111) | > loss_disc_real_5: 0.2768422067165375 (0.2710714439551036) | > loss_0: 2.8425562381744385 (2.762730916341146) | > loss_gen: 3.1209864616394043 (3.072150230407715) | > loss_kl: 1.96360182762146 (3.4338009357452393) | > loss_feat: 3.76973295211792 (4.54483691851298) | > loss_mel: 19.96555519104004 (22.94813410441081) | > loss_duration: 2.7780938148498535 (2.9378998279571533) | > loss_1: 31.597970962524414 (36.93682289123535) --> EVAL PERFORMANCE | > avg_loader_time: 0.012067476908365885 (+0.00813611348470052) | > avg_loss_disc: 2.762730916341146 (+0.589240868886312) | > avg_loss_disc_real_0: 0.4212626914183299 (+0.3263282912472884) | > avg_loss_disc_real_1: 0.33260228236516315 (+0.06039122243722278) | > avg_loss_disc_real_2: 0.2800280799468358 (+0.1405810738603274) | > avg_loss_disc_real_3: 0.3462913731733958 (+0.10449439783891043) | > avg_loss_disc_real_4: 0.3300240933895111 (+0.15470194816589355) | > avg_loss_disc_real_5: 0.2710714439551036 (+0.09443958476185801) | > avg_loss_0: 2.762730916341146 (+0.589240868886312) | > avg_loss_gen: 3.072150230407715 (+0.4906557401021323) | > avg_loss_kl: 3.4338009357452393 (-0.18436964352925633) | > avg_loss_feat: 4.54483691851298 (-3.46393624941508) | > avg_loss_mel: 22.94813410441081 (-1.8250096638997384) | > avg_loss_duration: 2.9378998279571533 (-0.0070110956827798) | > avg_loss_1: 36.93682289123535 (-4.98967170715332)  > EPOCH: 623/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:48:04)   --> TIME: 2023-10-20 06:48:31 -- STEP: 29/50 -- GLOBAL_STEP: 84180 | > loss_disc: 2.4599087238311768 (2.2429467891824655) | > loss_disc_real_0: 0.027608830481767654 (0.11929871806682184) | > loss_disc_real_1: 0.30997419357299805 (0.21562838991140498) | > loss_disc_real_2: 0.23202642798423767 (0.19493722889957757) | > loss_disc_real_3: 0.26855990290641785 (0.2282043762248138) | > loss_disc_real_4: 0.19581818580627441 (0.23749970336412562) | > loss_disc_real_5: 0.19450412690639496 (0.2341777655649288) | > loss_0: 2.4599087238311768 (2.2429467891824655) | > grad_norm_0: tensor(3942.1121, device='cuda:0') (tensor(1205.6151, device='cuda:0')) | > loss_gen: 2.0197811126708984 (2.5990611808053385) | > loss_kl: 0.7588894367218018 (0.8528869912542146) | > loss_feat: 2.0209875106811523 (6.470959947027009) | > loss_mel: 16.927980422973633 (23.4396553368404) | > loss_duration: 1.4757241010665894 (1.454345649686353) | > loss_1: 23.20336151123047 (34.816909066562) | > grad_norm_1: tensor(19155.6406, device='cuda:0') (tensor(42347.4883, device='cuda:0')) | > current_lr_0: 0.0001072624275623866 | > current_lr_1: 0.0001072624275623866 | > step_time: 0.4824 (0.6797277516332166) | > loader_time: 0.0047 (0.02581308627950734)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0976035594940186 (3.0976035594940186) | > loss_disc_real_0: 0.06588179618120193 (0.06588179618120193) | > loss_disc_real_1: 0.3278561234474182 (0.3278561234474182) | > loss_disc_real_2: 0.18610794842243195 (0.18610794842243195) | > loss_disc_real_3: 0.3212410807609558 (0.3212410807609558) | > loss_disc_real_4: 0.27519917488098145 (0.27519917488098145) | > loss_disc_real_5: 0.3506156802177429 (0.3506156802177429) | > loss_0: 3.0976035594940186 (3.0976035594940186) | > loss_gen: 1.558639645576477 (1.558639645576477) | > loss_kl: 3.8129360675811768 (3.8129360675811768) | > loss_feat: 1.657280445098877 (1.657280445098877) | > loss_mel: 20.278615951538086 (20.278615951538086) | > loss_duration: 2.65993070602417 (2.65993070602417) | > loss_1: 29.967403411865234 (29.967403411865234)  --> STEP: 1 | > loss_disc: 2.2718985080718994 (2.2718985080718994) | > loss_disc_real_0: 0.17413440346717834 (0.17413440346717834) | > loss_disc_real_1: 0.361550897359848 (0.361550897359848) | > loss_disc_real_2: 0.2677266597747803 (0.2677266597747803) | > loss_disc_real_3: 0.2460843175649643 (0.2460843175649643) | > loss_disc_real_4: 0.21346044540405273 (0.21346044540405273) | > loss_disc_real_5: 0.23892919719219208 (0.23892919719219208) | > loss_0: 2.2718985080718994 (2.2718985080718994) | > loss_gen: 2.7091453075408936 (2.7091453075408936) | > loss_kl: 4.01171350479126 (4.01171350479126) | > loss_feat: 5.417187690734863 (5.417187690734863) | > loss_mel: 22.117572784423828 (22.117572784423828) | > loss_duration: 2.9265079498291016 (2.9265079498291016) | > loss_1: 37.18212890625 (37.18212890625)  --> STEP: 2 | > loss_disc: 3.0492842197418213 (2.6605913639068604) | > loss_disc_real_0: 0.17863106727600098 (0.17638273537158966) | > loss_disc_real_1: 0.29492825269699097 (0.3282395750284195) | > loss_disc_real_2: 0.21497319638729095 (0.24134992808103561) | > loss_disc_real_3: 0.2912938594818115 (0.2686890885233879) | > loss_disc_real_4: 0.3091026544570923 (0.2612815499305725) | > loss_disc_real_5: 0.33960992097854614 (0.2892695590853691) | > loss_0: 3.0492842197418213 (2.6605913639068604) | > loss_gen: 1.6203503608703613 (2.1647478342056274) | > loss_kl: 4.6906819343566895 (4.351197719573975) | > loss_feat: 0.5216933488845825 (2.969440519809723) | > loss_mel: 13.448068618774414 (17.78282070159912) | > loss_duration: 2.762512445449829 (2.8445101976394653) | > loss_1: 23.043306350708008 (30.112717628479004)  --> STEP: 3 | > loss_disc: 3.303595542907715 (2.8749260902404785) | > loss_disc_real_0: 0.245935320854187 (0.19956693053245544) | > loss_disc_real_1: 0.36195647716522217 (0.3394785424073537) | > loss_disc_real_2: 0.36536744236946106 (0.28268909951051074) | > loss_disc_real_3: 0.37241891026496887 (0.30326569577058154) | > loss_disc_real_4: 0.4805721938610077 (0.3343784312407176) | > loss_disc_real_5: 0.5981536507606506 (0.39223092297712964) | > loss_0: 3.303595542907715 (2.8749260902404785) | > loss_gen: 2.536144256591797 (2.288546641667684) | > loss_kl: 2.3101186752319336 (3.6708380381266275) | > loss_feat: 3.3851215839385986 (3.108000874519348) | > loss_mel: 25.5076847076416 (20.35777537027995) | > loss_duration: 2.8013696670532227 (2.8301300207773843) | > loss_1: 36.540435791015625 (32.25529034932455) --> EVAL PERFORMANCE | > avg_loader_time: 0.006497303644816081 (-0.005570173263549804) | > avg_loss_disc: 2.8749260902404785 (+0.11219517389933253) | > avg_loss_disc_real_0: 0.19956693053245544 (-0.22169576088587445) | > avg_loss_disc_real_1: 0.3394785424073537 (+0.006876260042190552) | > avg_loss_disc_real_2: 0.28268909951051074 (+0.0026610195636749268) | > avg_loss_disc_real_3: 0.30326569577058154 (-0.043025677402814266) | > avg_loss_disc_real_4: 0.3343784312407176 (+0.00435433785120648) | > avg_loss_disc_real_5: 0.39223092297712964 (+0.12115947902202606) | > avg_loss_0: 2.8749260902404785 (+0.11219517389933253) | > avg_loss_gen: 2.288546641667684 (-0.7836035887400308) | > avg_loss_kl: 3.6708380381266275 (+0.2370371023813882) | > avg_loss_feat: 3.108000874519348 (-1.4368360439936323) | > avg_loss_mel: 20.35777537027995 (-2.5903587341308594) | > avg_loss_duration: 2.8301300207773843 (-0.10776980717976903) | > avg_loss_1: 32.25529034932455 (-4.681532541910805)  > EPOCH: 624/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:48:56)   --> TIME: 2023-10-20 06:49:12 -- STEP: 9/50 -- GLOBAL_STEP: 84210 | > loss_disc: 2.8156421184539795 (2.283602131737603) | > loss_disc_real_0: 0.21831297874450684 (0.1509664607130819) | > loss_disc_real_1: 0.24013173580169678 (0.27174024615022874) | > loss_disc_real_2: 0.23973794281482697 (0.23822170082065794) | > loss_disc_real_3: 0.26197871565818787 (0.28039244810740155) | > loss_disc_real_4: 0.24576421082019806 (0.21074029720491833) | > loss_disc_real_5: 0.27626749873161316 (0.20693075822459328) | > loss_0: 2.8156421184539795 (2.283602131737603) | > grad_norm_0: tensor(605.8708, device='cuda:0') (tensor(817.1639, device='cuda:0')) | > loss_gen: 1.6745678186416626 (2.6632916000154285) | > loss_kl: 0.8351620435714722 (0.9815940856933594) | > loss_feat: 0.708550751209259 (5.970011881242196) | > loss_mel: 16.00826644897461 (19.942402018441094) | > loss_duration: 1.3963673114776611 (1.4492119550704956) | > loss_1: 20.622915267944336 (31.006511582268608) | > grad_norm_1: tensor(15020.8232, device='cuda:0') (tensor(49811.9297, device='cuda:0')) | > current_lr_0: 0.00010715521205040623 | > current_lr_1: 0.00010715521205040623 | > step_time: 0.3603 (0.5677465862698026) | > loader_time: 0.0151 (0.021505249871148005)  --> TIME: 2023-10-20 06:49:30 -- STEP: 39/50 -- GLOBAL_STEP: 84240 | > loss_disc: 2.000185012817383 (2.4702524772057166) | > loss_disc_real_0: 0.019123008474707603 (0.15500395788023105) | > loss_disc_real_1: 0.16034114360809326 (0.24739419291607845) | > loss_disc_real_2: 0.19118459522724152 (0.24290491313410875) | > loss_disc_real_3: 0.17188593745231628 (0.2382138388661238) | > loss_disc_real_4: 0.0875588059425354 (0.22352756724621242) | > loss_disc_real_5: 0.11388308554887772 (0.22013100570975205) | > loss_0: 2.000185012817383 (2.4702524772057166) | > grad_norm_0: tensor(715.9904, device='cuda:0') (tensor(676.2990, device='cuda:0')) | > loss_gen: 2.1421761512756348 (2.3144503373366137) | > loss_kl: 0.7391098737716675 (0.8456653379476987) | > loss_feat: 6.314183235168457 (5.108074813603591) | > loss_mel: 22.512737274169922 (20.40707754783141) | > loss_duration: 1.469447135925293 (1.4350218344957402) | > loss_1: 33.17765426635742 (30.11028995269384) | > grad_norm_1: tensor(20859.3613, device='cuda:0') (tensor(25809.8555, device='cuda:0')) | > current_lr_0: 0.00010715521205040623 | > current_lr_1: 0.00010715521205040623 | > step_time: 0.9271 (0.5722297705136813) | > loader_time: 0.0244 (0.01907206192994729)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9166460037231445 (2.9166460037231445) | > loss_disc_real_0: 0.25574561953544617 (0.25574561953544617) | > loss_disc_real_1: 0.2794688045978546 (0.2794688045978546) | > loss_disc_real_2: 0.2801186144351959 (0.2801186144351959) | > loss_disc_real_3: 0.2918130159378052 (0.2918130159378052) | > loss_disc_real_4: 0.22867494821548462 (0.22867494821548462) | > loss_disc_real_5: 0.2184160053730011 (0.2184160053730011) | > loss_0: 2.9166460037231445 (2.9166460037231445) | > loss_gen: 1.672275185585022 (1.672275185585022) | > loss_kl: 4.581247329711914 (4.581247329711914) | > loss_feat: 0.2676836848258972 (0.2676836848258972) | > loss_mel: 13.32020378112793 (13.32020378112793) | > loss_duration: 2.782945394515991 (2.782945394515991) | > loss_1: 22.62435531616211 (22.62435531616211)  --> STEP: 1 | > loss_disc: 2.52900767326355 (2.52900767326355) | > loss_disc_real_0: 0.0962713360786438 (0.0962713360786438) | > loss_disc_real_1: 0.31428244709968567 (0.31428244709968567) | > loss_disc_real_2: 0.2234066277742386 (0.2234066277742386) | > loss_disc_real_3: 0.30047065019607544 (0.30047065019607544) | > loss_disc_real_4: 0.1975363790988922 (0.1975363790988922) | > loss_disc_real_5: 0.2014750987291336 (0.2014750987291336) | > loss_0: 2.52900767326355 (2.52900767326355) | > loss_gen: 2.026172637939453 (2.026172637939453) | > loss_kl: 4.404441833496094 (4.404441833496094) | > loss_feat: 2.453403949737549 (2.453403949737549) | > loss_mel: 20.36890983581543 (20.36890983581543) | > loss_duration: 3.0386126041412354 (3.0386126041412354) | > loss_1: 32.291542053222656 (32.291542053222656)  --> STEP: 2 | > loss_disc: 1.5302095413208008 (2.0296086072921753) | > loss_disc_real_0: 0.060202255845069885 (0.07823679596185684) | > loss_disc_real_1: 0.1003480851650238 (0.20731526613235474) | > loss_disc_real_2: 0.04372436925768852 (0.13356549851596355) | > loss_disc_real_3: 0.07620901614427567 (0.18833983317017555) | > loss_disc_real_4: 0.21429719030857086 (0.20591678470373154) | > loss_disc_real_5: 0.20022214949131012 (0.20084862411022186) | > loss_0: 1.5302095413208008 (2.0296086072921753) | > loss_gen: 3.957070827484131 (2.991621732711792) | > loss_kl: 4.601369380950928 (4.502905607223511) | > loss_feat: 17.775142669677734 (10.114273309707642) | > loss_mel: 26.114185333251953 (23.24154758453369) | > loss_duration: 2.92720103263855 (2.9829068183898926) | > loss_1: 55.374969482421875 (43.833255767822266)  --> STEP: 3 | > loss_disc: 2.9937610626220703 (2.350992759068807) | > loss_disc_real_0: 0.22994042932987213 (0.12880467375119528) | > loss_disc_real_1: 0.3071657121181488 (0.24059874812761942) | > loss_disc_real_2: 0.32617202401161194 (0.19776767368117967) | > loss_disc_real_3: 0.30104878544807434 (0.22590948392947516) | > loss_disc_real_4: 0.2374875843524933 (0.21644038458665213) | > loss_disc_real_5: 0.22147341072559357 (0.20772355298201242) | > loss_0: 2.9937610626220703 (2.350992759068807) | > loss_gen: 1.6700290441513062 (2.5510908365249634) | > loss_kl: 2.2114508152008057 (3.7390873432159424) | > loss_feat: 0.7911283373832703 (7.006558318932851) | > loss_mel: 18.204870223999023 (21.562655131022137) | > loss_duration: 2.740114688873291 (2.9019761085510254) | > loss_1: 25.617591857910156 (37.76136779785156) --> EVAL PERFORMANCE | > avg_loader_time: 0.007759968439737956 (+0.001262664794921875) | > avg_loss_disc: 2.350992759068807 (-0.5239333311716714) | > avg_loss_disc_real_0: 0.12880467375119528 (-0.07076225678126016) | > avg_loss_disc_real_1: 0.24059874812761942 (-0.09887979427973428) | > avg_loss_disc_real_2: 0.19776767368117967 (-0.08492142582933107) | > avg_loss_disc_real_3: 0.22590948392947516 (-0.07735621184110639) | > avg_loss_disc_real_4: 0.21644038458665213 (-0.11793804665406546) | > avg_loss_disc_real_5: 0.20772355298201242 (-0.18450736999511722) | > avg_loss_0: 2.350992759068807 (-0.5239333311716714) | > avg_loss_gen: 2.5510908365249634 (+0.2625441948572793) | > avg_loss_kl: 3.7390873432159424 (+0.06824930508931493) | > avg_loss_feat: 7.006558318932851 (+3.8985574444135027) | > avg_loss_mel: 21.562655131022137 (+1.2048797607421875) | > avg_loss_duration: 2.9019761085510254 (+0.0718460877736411) | > avg_loss_1: 37.76136779785156 (+5.506077448527016)  > EPOCH: 625/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:49:52)   --> TIME: 2023-10-20 06:50:10 -- STEP: 19/50 -- GLOBAL_STEP: 84270 | > loss_disc: 3.028972625732422 (2.405656017755207) | > loss_disc_real_0: 0.167691171169281 (0.14311189415227427) | > loss_disc_real_1: 0.27362769842147827 (0.23331071377584808) | > loss_disc_real_2: 0.21206359565258026 (0.21071212385830126) | > loss_disc_real_3: 0.2739444971084595 (0.2252071762555524) | > loss_disc_real_4: 0.27978938817977905 (0.2028990783973744) | > loss_disc_real_5: 0.2981041967868805 (0.2104253425802055) | > loss_0: 3.028972625732422 (2.405656017755207) | > grad_norm_0: tensor(3720.0879, device='cuda:0') (tensor(794.7846, device='cuda:0')) | > loss_gen: 1.5788216590881348 (2.242336542982804) | > loss_kl: 0.566787838935852 (0.7769224533909246) | > loss_feat: 0.23185831308364868 (4.719478186514032) | > loss_mel: 2.6878840923309326 (18.937221552196302) | > loss_duration: 1.5199803113937378 (1.4800067073420475) | > loss_1: 6.58533239364624 (28.15596530311986) | > grad_norm_1: tensor(21150.9863, device='cuda:0') (tensor(31526.2793, device='cuda:0')) | > current_lr_0: 0.0001070481037070428 | > current_lr_1: 0.0001070481037070428 | > step_time: 0.5654 (0.6255016201420834) | > loader_time: 0.0439 (0.022375219746639852)  --> TIME: 2023-10-20 06:50:29 -- STEP: 49/50 -- GLOBAL_STEP: 84300 | > loss_disc: 1.5703063011169434 (2.3423575454828685) | > loss_disc_real_0: 0.08479081094264984 (0.13691379205912962) | > loss_disc_real_1: 0.16313014924526215 (0.22196743549893097) | > loss_disc_real_2: 0.1582467406988144 (0.21962626430453086) | > loss_disc_real_3: 0.1138315498828888 (0.2278399513464193) | > loss_disc_real_4: 0.2256045639514923 (0.204872965156956) | > loss_disc_real_5: 0.06761477142572403 (0.19533341765707854) | > loss_0: 1.5703063011169434 (2.3423575454828685) | > grad_norm_0: tensor(797.4264, device='cuda:0') (tensor(750.7012, device='cuda:0')) | > loss_gen: 3.2931301593780518 (2.4315901362166117) | > loss_kl: 0.4343409538269043 (0.7411544450691768) | > loss_feat: 7.811982154846191 (5.611574840066689) | > loss_mel: 23.351037979125977 (20.84978829597941) | > loss_duration: 1.5790212154388428 (1.4419277906417847) | > loss_1: 36.469512939453125 (31.076035363333567) | > grad_norm_1: tensor(37777.1250, device='cuda:0') (tensor(26911.3848, device='cuda:0')) | > current_lr_0: 0.0001070481037070428 | > current_lr_1: 0.0001070481037070428 | > step_time: 0.5262 (0.6212468049964127) | > loader_time: 0.4348 (0.031108262587566764)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9186766147613525 (2.9186766147613525) | > loss_disc_real_0: 0.400023490190506 (0.400023490190506) | > loss_disc_real_1: 0.41383829712867737 (0.41383829712867737) | > loss_disc_real_2: 0.4395613670349121 (0.4395613670349121) | > loss_disc_real_3: 0.364027202129364 (0.364027202129364) | > loss_disc_real_4: 0.4082622230052948 (0.4082622230052948) | > loss_disc_real_5: 0.30400368571281433 (0.30400368571281433) | > loss_0: 2.9186766147613525 (2.9186766147613525) | > loss_gen: 3.4595534801483154 (3.4595534801483154) | > loss_kl: 3.7919399738311768 (3.7919399738311768) | > loss_feat: 5.224361896514893 (5.224361896514893) | > loss_mel: 22.41093635559082 (22.41093635559082) | > loss_duration: 2.8394081592559814 (2.8394081592559814) | > loss_1: 37.726200103759766 (37.726200103759766)  --> STEP: 1 | > loss_disc: 2.9724042415618896 (2.9724042415618896) | > loss_disc_real_0: 0.5344091653823853 (0.5344091653823853) | > loss_disc_real_1: 0.30887168645858765 (0.30887168645858765) | > loss_disc_real_2: 0.37334275245666504 (0.37334275245666504) | > loss_disc_real_3: 0.29302722215652466 (0.29302722215652466) | > loss_disc_real_4: 0.38722139596939087 (0.38722139596939087) | > loss_disc_real_5: 0.4772627353668213 (0.4772627353668213) | > loss_0: 2.9724042415618896 (2.9724042415618896) | > loss_gen: 3.488374948501587 (3.488374948501587) | > loss_kl: 4.505486011505127 (4.505486011505127) | > loss_feat: 5.782052516937256 (5.782052516937256) | > loss_mel: 21.714670181274414 (21.714670181274414) | > loss_duration: 3.1591970920562744 (3.1591970920562744) | > loss_1: 38.649784088134766 (38.649784088134766)  --> STEP: 2 | > loss_disc: 3.0125112533569336 (2.9924577474594116) | > loss_disc_real_0: 0.3056368827819824 (0.42002302408218384) | > loss_disc_real_1: 0.29062598943710327 (0.29974883794784546) | > loss_disc_real_2: 0.30056774616241455 (0.3369552493095398) | > loss_disc_real_3: 0.30566561222076416 (0.2993464171886444) | > loss_disc_real_4: 0.2758558392524719 (0.3315386176109314) | > loss_disc_real_5: 0.2190646231174469 (0.3481636792421341) | > loss_0: 3.0125112533569336 (2.9924577474594116) | > loss_gen: 1.711906909942627 (2.600140929222107) | > loss_kl: 4.213429927825928 (4.359457969665527) | > loss_feat: 0.09127859771251678 (2.9366655573248863) | > loss_mel: 1.9680886268615723 (11.841379404067993) | > loss_duration: 2.9598050117492676 (3.059501051902771) | > loss_1: 10.944509506225586 (24.797146797180176)  --> STEP: 3 | > loss_disc: 2.850311517715454 (2.9450756708780923) | > loss_disc_real_0: 0.7357150912284851 (0.5252537131309509) | > loss_disc_real_1: 0.3698159158229828 (0.32310453057289124) | > loss_disc_real_2: 0.34656113386154175 (0.3401572108268738) | > loss_disc_real_3: 0.20410622656345367 (0.2675996869802475) | > loss_disc_real_4: 0.26954370737075806 (0.3108736475308736) | > loss_disc_real_5: 0.16732925176620483 (0.28788553675015766) | > loss_0: 2.850311517715454 (2.9450756708780923) | > loss_gen: 3.3440792560577393 (2.848120371500651) | > loss_kl: 2.181417465209961 (3.6334444681803384) | > loss_feat: 3.835548162460327 (3.2362930923700333) | > loss_mel: 22.365413665771484 (15.349390824635824) | > loss_duration: 2.9619622230529785 (3.0269881089528403) | > loss_1: 34.68842315673828 (28.09423891703288) --> EVAL PERFORMANCE | > avg_loader_time: 0.002480189005533854 (-0.0052797794342041016) | > avg_loss_disc: 2.9450756708780923 (+0.5940829118092852) | > avg_loss_disc_real_0: 0.5252537131309509 (+0.3964490393797556) | > avg_loss_disc_real_1: 0.32310453057289124 (+0.08250578244527182) | > avg_loss_disc_real_2: 0.3401572108268738 (+0.1423895371456941) | > avg_loss_disc_real_3: 0.2675996869802475 (+0.04169020305077234) | > avg_loss_disc_real_4: 0.3108736475308736 (+0.09443326294422147) | > avg_loss_disc_real_5: 0.28788553675015766 (+0.08016198376814523) | > avg_loss_0: 2.9450756708780923 (+0.5940829118092852) | > avg_loss_gen: 2.848120371500651 (+0.2970295349756875) | > avg_loss_kl: 3.6334444681803384 (-0.10564287503560399) | > avg_loss_feat: 3.2362930923700333 (-3.7702652265628176) | > avg_loss_mel: 15.349390824635824 (-6.213264306386312) | > avg_loss_duration: 3.0269881089528403 (+0.12501200040181493) | > avg_loss_1: 28.09423891703288 (-9.667128880818684)  > EPOCH: 626/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:50:46)   --> TIME: 2023-10-20 06:51:11 -- STEP: 29/50 -- GLOBAL_STEP: 84330 | > loss_disc: 2.984595775604248 (2.1725952419741406) | > loss_disc_real_0: 0.2843919098377228 (0.1254283405904626) | > loss_disc_real_1: 0.25888603925704956 (0.21503566770718016) | > loss_disc_real_2: 0.2650890350341797 (0.22450444089441463) | > loss_disc_real_3: 0.23154319822788239 (0.23687489728989272) | > loss_disc_real_4: 0.31939613819122314 (0.21940045411987552) | > loss_disc_real_5: 0.2732976973056793 (0.2183917972805171) | > loss_0: 2.984595775604248 (2.1725952419741406) | > grad_norm_0: tensor(1687.0482, device='cuda:0') (tensor(556.5939, device='cuda:0')) | > loss_gen: 1.6917169094085693 (2.792348734263716) | > loss_kl: 0.8520756959915161 (0.8472122231434132) | > loss_feat: 0.18958307802677155 (7.5485846184451) | > loss_mel: 9.77486515045166 (22.202359836677026) | > loss_duration: 1.4538493156433105 (1.462696753699204) | > loss_1: 13.962089538574219 (34.853202227888445) | > grad_norm_1: tensor(22809.8047, device='cuda:0') (tensor(27211.1406, device='cuda:0')) | > current_lr_0: 0.00010694110242517452 | > current_lr_1: 0.00010694110242517452 | > step_time: 0.5219 (0.5618885550005682) | > loader_time: 0.002 (0.018588666258187128)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9874460697174072 (2.9874460697174072) | > loss_disc_real_0: 0.3166629374027252 (0.3166629374027252) | > loss_disc_real_1: 0.26749926805496216 (0.26749926805496216) | > loss_disc_real_2: 0.2805761694908142 (0.2805761694908142) | > loss_disc_real_3: 0.3015705347061157 (0.3015705347061157) | > loss_disc_real_4: 0.2504565417766571 (0.2504565417766571) | > loss_disc_real_5: 0.27348843216896057 (0.27348843216896057) | > loss_0: 2.9874460697174072 (2.9874460697174072) | > loss_gen: 1.7385603189468384 (1.7385603189468384) | > loss_kl: 4.667693138122559 (4.667693138122559) | > loss_feat: 0.1514081358909607 (0.1514081358909607) | > loss_mel: 10.359760284423828 (10.359760284423828) | > loss_duration: 2.774113178253174 (2.774113178253174) | > loss_1: 19.6915340423584 (19.6915340423584)  --> STEP: 1 | > loss_disc: 2.4835822582244873 (2.4835822582244873) | > loss_disc_real_0: 0.10890226811170578 (0.10890226811170578) | > loss_disc_real_1: 0.2156473845243454 (0.2156473845243454) | > loss_disc_real_2: 0.25276005268096924 (0.25276005268096924) | > loss_disc_real_3: 0.33072754740715027 (0.33072754740715027) | > loss_disc_real_4: 0.12856295704841614 (0.12856295704841614) | > loss_disc_real_5: 0.18841825425624847 (0.18841825425624847) | > loss_0: 2.4835822582244873 (2.4835822582244873) | > loss_gen: 2.262399673461914 (2.262399673461914) | > loss_kl: 4.37684440612793 (4.37684440612793) | > loss_feat: 4.7896647453308105 (4.7896647453308105) | > loss_mel: 23.380008697509766 (23.380008697509766) | > loss_duration: 2.9993231296539307 (2.9993231296539307) | > loss_1: 37.8082389831543 (37.8082389831543)  --> STEP: 2 | > loss_disc: 2.9743881225585938 (2.7289851903915405) | > loss_disc_real_0: 0.24950462579727173 (0.17920344695448875) | > loss_disc_real_1: 0.17047041654586792 (0.19305890053510666) | > loss_disc_real_2: 0.18288449943065643 (0.21782227605581284) | > loss_disc_real_3: 0.40062475204467773 (0.365676149725914) | > loss_disc_real_4: 0.27432554960250854 (0.20144425332546234) | > loss_disc_real_5: 0.4267159104347229 (0.3075670823454857) | > loss_0: 2.9743881225585938 (2.7289851903915405) | > loss_gen: 2.308117151260376 (2.285258412361145) | > loss_kl: 4.532721042633057 (4.454782724380493) | > loss_feat: 7.088180065155029 (5.93892240524292) | > loss_mel: 26.735572814941406 (25.057790756225586) | > loss_duration: 2.993034839630127 (2.996178984642029) | > loss_1: 43.65762710571289 (40.732933044433594)  --> STEP: 3 | > loss_disc: 3.110682249069214 (2.856217543284098) | > loss_disc_real_0: 0.08724638819694519 (0.14855109403530756) | > loss_disc_real_1: 0.2816430330276489 (0.22258694469928741) | > loss_disc_real_2: 0.3487294018268585 (0.2614579846461614) | > loss_disc_real_3: 0.3194565176963806 (0.3502696057160695) | > loss_disc_real_4: 0.3879443407058716 (0.26361094911893207) | > loss_disc_real_5: 0.44503554701805115 (0.3533899039030075) | > loss_0: 3.110682249069214 (2.856217543284098) | > loss_gen: 1.9519129991531372 (2.1741432746251426) | > loss_kl: 2.1776487827301025 (3.6957380771636963) | > loss_feat: 3.6426262855529785 (5.1734903653462725) | > loss_mel: 19.82921600341797 (23.314932505289715) | > loss_duration: 2.814652442932129 (2.9356701374053955) | > loss_1: 30.416057586669922 (37.29397455851237) --> EVAL PERFORMANCE | > avg_loader_time: 0.004065036773681641 (+0.0015848477681477866) | > avg_loss_disc: 2.856217543284098 (-0.08885812759399414) | > avg_loss_disc_real_0: 0.14855109403530756 (-0.3767026190956434) | > avg_loss_disc_real_1: 0.22258694469928741 (-0.10051758587360382) | > avg_loss_disc_real_2: 0.2614579846461614 (-0.0786992261807124) | > avg_loss_disc_real_3: 0.3502696057160695 (+0.08266991873582202) | > avg_loss_disc_real_4: 0.26361094911893207 (-0.04726269841194153) | > avg_loss_disc_real_5: 0.3533899039030075 (+0.06550436715284985) | > avg_loss_0: 2.856217543284098 (-0.08885812759399414) | > avg_loss_gen: 2.1741432746251426 (-0.6739770968755083) | > avg_loss_kl: 3.6957380771636963 (+0.062293608983357895) | > avg_loss_feat: 5.1734903653462725 (+1.9371972729762392) | > avg_loss_mel: 23.314932505289715 (+7.965541680653891) | > avg_loss_duration: 2.9356701374053955 (-0.09131797154744481) | > avg_loss_1: 37.29397455851237 (+9.199735641479489)  > EPOCH: 627/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:51:39)   --> TIME: 2023-10-20 06:51:50 -- STEP: 9/50 -- GLOBAL_STEP: 84360 | > loss_disc: 2.5335750579833984 (2.254089845551385) | > loss_disc_real_0: 0.08149737119674683 (0.142001303533713) | > loss_disc_real_1: 0.2673493027687073 (0.20699365519815022) | > loss_disc_real_2: 0.29226037859916687 (0.1982328709628847) | > loss_disc_real_3: 0.4495774209499359 (0.25310755603843266) | > loss_disc_real_4: 0.31337568163871765 (0.1671875894276632) | > loss_disc_real_5: 0.24154745042324066 (0.15406705314914385) | > loss_0: 2.5335750579833984 (2.254089845551385) | > grad_norm_0: tensor(340.0630, device='cuda:0') (tensor(467.8699, device='cuda:0')) | > loss_gen: 2.4732704162597656 (2.474808202849494) | > loss_kl: 0.7947507500648499 (0.9025131927596198) | > loss_feat: 3.7402045726776123 (6.549446807967292) | > loss_mel: 21.41740608215332 (21.478065755632187) | > loss_duration: 1.3613262176513672 (1.44686492284139) | > loss_1: 29.786958694458008 (32.851699617173935) | > grad_norm_1: tensor(3003.0286, device='cuda:0') (tensor(14146.7324, device='cuda:0')) | > current_lr_0: 0.00010683420809778675 | > current_lr_1: 0.00010683420809778675 | > step_time: 0.4211 (0.6096153259277344) | > loader_time: 0.0185 (0.021254645453559026)  --> TIME: 2023-10-20 06:52:03 -- STEP: 39/50 -- GLOBAL_STEP: 84390 | > loss_disc: 1.7221524715423584 (2.4431162751637974) | > loss_disc_real_0: 0.05678989738225937 (0.1288990530018241) | > loss_disc_real_1: 0.19463814795017242 (0.21996380515301076) | > loss_disc_real_2: 0.16267336905002594 (0.2335419300943613) | > loss_disc_real_3: 0.11361592262983322 (0.24407592454017732) | > loss_disc_real_4: 0.10022886842489243 (0.22554887308237645) | > loss_disc_real_5: 0.05783803015947342 (0.24555959650434744) | > loss_0: 1.7221524715423584 (2.4431162751637974) | > grad_norm_0: tensor(686.2680, device='cuda:0') (tensor(506.7889, device='cuda:0')) | > loss_gen: 2.6218466758728027 (2.440457964554811) | > loss_kl: 0.552300214767456 (0.8251691483534299) | > loss_feat: 9.447683334350586 (5.739284162529004) | > loss_mel: 26.295303344726562 (22.313483253503456) | > loss_duration: 1.4963109493255615 (1.4387828967510126) | > loss_1: 40.41344451904297 (32.75717746294461) | > grad_norm_1: tensor(69947.5703, device='cuda:0') (tensor(20496.2031, device='cuda:0')) | > current_lr_0: 0.00010683420809778675 | > current_lr_1: 0.00010683420809778675 | > step_time: 0.3398 (0.46126544169890576) | > loader_time: 0.0041 (0.011504283318152795)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8161892890930176 (2.8161892890930176) | > loss_disc_real_0: 0.39252984523773193 (0.39252984523773193) | > loss_disc_real_1: 0.2681516408920288 (0.2681516408920288) | > loss_disc_real_2: 0.23407956957817078 (0.23407956957817078) | > loss_disc_real_3: 0.3506409525871277 (0.3506409525871277) | > loss_disc_real_4: 0.2844083905220032 (0.2844083905220032) | > loss_disc_real_5: 0.376056045293808 (0.376056045293808) | > loss_0: 2.8161892890930176 (2.8161892890930176) | > loss_gen: 2.5678558349609375 (2.5678558349609375) | > loss_kl: 4.3449177742004395 (4.3449177742004395) | > loss_feat: 6.30409049987793 (6.30409049987793) | > loss_mel: 22.263254165649414 (22.263254165649414) | > loss_duration: 2.7715063095092773 (2.7715063095092773) | > loss_1: 38.251625061035156 (38.251625061035156)  --> STEP: 1 | > loss_disc: 3.274387836456299 (3.274387836456299) | > loss_disc_real_0: 0.26350724697113037 (0.26350724697113037) | > loss_disc_real_1: 0.48091673851013184 (0.48091673851013184) | > loss_disc_real_2: 0.2405463606119156 (0.2405463606119156) | > loss_disc_real_3: 0.4441746473312378 (0.4441746473312378) | > loss_disc_real_4: 0.2709624171257019 (0.2709624171257019) | > loss_disc_real_5: 0.44061699509620667 (0.44061699509620667) | > loss_0: 3.274387836456299 (3.274387836456299) | > loss_gen: 2.3018550872802734 (2.3018550872802734) | > loss_kl: 5.018500804901123 (5.018500804901123) | > loss_feat: 6.6161789894104 (6.6161789894104) | > loss_mel: 22.9451847076416 (22.9451847076416) | > loss_duration: 3.1181788444519043 (3.1181788444519043) | > loss_1: 39.999900817871094 (39.999900817871094)  --> STEP: 2 | > loss_disc: 2.250596284866333 (2.762492060661316) | > loss_disc_real_0: 0.2428891956806183 (0.25319822132587433) | > loss_disc_real_1: 0.21871818602085114 (0.3498174622654915) | > loss_disc_real_2: 0.13941973447799683 (0.1899830475449562) | > loss_disc_real_3: 0.23885756731033325 (0.3415161073207855) | > loss_disc_real_4: 0.19380250573158264 (0.23238246142864227) | > loss_disc_real_5: 0.2822074890136719 (0.36141224205493927) | > loss_0: 2.250596284866333 (2.762492060661316) | > loss_gen: 2.7607409954071045 (2.531298041343689) | > loss_kl: 4.850130081176758 (4.93431544303894) | > loss_feat: 8.712433815002441 (7.664306402206421) | > loss_mel: 22.447561264038086 (22.696372985839844) | > loss_duration: 2.937756061553955 (3.0279674530029297) | > loss_1: 41.708621978759766 (40.85426139831543)  --> STEP: 3 | > loss_disc: 2.9784555435180664 (2.834479888280233) | > loss_disc_real_0: 0.3628368377685547 (0.28974442680676776) | > loss_disc_real_1: 0.30066409707069397 (0.33343300720055896) | > loss_disc_real_2: 0.2762511074542999 (0.21873906751473746) | > loss_disc_real_3: 0.26639682054519653 (0.31647634506225586) | > loss_disc_real_4: 0.3099622130393982 (0.2582423786322276) | > loss_disc_real_5: 0.3100610673427582 (0.3442951838175456) | > loss_0: 2.9784555435180664 (2.834479888280233) | > loss_gen: 2.0497331619262695 (2.370776414871216) | > loss_kl: 2.1452620029449463 (4.004630963007609) | > loss_feat: 1.568693995475769 (5.632435599962871) | > loss_mel: 19.382234573364258 (21.591660181681316) | > loss_duration: 2.7538492679595947 (2.9365947246551514) | > loss_1: 27.89977264404297 (36.53609848022461) --> EVAL PERFORMANCE | > avg_loader_time: 0.0240933895111084 (+0.020028352737426758) | > avg_loss_disc: 2.834479888280233 (-0.021737655003865264) | > avg_loss_disc_real_0: 0.28974442680676776 (+0.1411933327714602) | > avg_loss_disc_real_1: 0.33343300720055896 (+0.11084606250127155) | > avg_loss_disc_real_2: 0.21873906751473746 (-0.04271891713142392) | > avg_loss_disc_real_3: 0.31647634506225586 (-0.03379326065381366) | > avg_loss_disc_real_4: 0.2582423786322276 (-0.0053685704867044715) | > avg_loss_disc_real_5: 0.3442951838175456 (-0.009094720085461916) | > avg_loss_0: 2.834479888280233 (-0.021737655003865264) | > avg_loss_gen: 2.370776414871216 (+0.19663314024607326) | > avg_loss_kl: 4.004630963007609 (+0.30889288584391306) | > avg_loss_feat: 5.632435599962871 (+0.4589452346165981) | > avg_loss_mel: 21.591660181681316 (-1.7232723236083984) | > avg_loss_duration: 2.9365947246551514 (+0.0009245872497558594) | > avg_loss_1: 36.53609848022461 (-0.757876078287758)  > EPOCH: 628/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:52:27)   --> TIME: 2023-10-20 06:52:43 -- STEP: 19/50 -- GLOBAL_STEP: 84420 | > loss_disc: 2.8086366653442383 (2.493998088334736) | > loss_disc_real_0: 0.16760659217834473 (0.1669670036552768) | > loss_disc_real_1: 0.2439168393611908 (0.22128336366854215) | > loss_disc_real_2: 0.2518145442008972 (0.2384883165359497) | > loss_disc_real_3: 0.24214845895767212 (0.2485373467206955) | > loss_disc_real_4: 0.25747939944267273 (0.21959106251597404) | > loss_disc_real_5: 0.26907879114151 (0.2629439052390425) | > loss_0: 2.8086366653442383 (2.493998088334736) | > grad_norm_0: tensor(272.4278, device='cuda:0') (tensor(709.1339, device='cuda:0')) | > loss_gen: 1.6251859664916992 (2.3725492577803764) | > loss_kl: 0.6020705699920654 (0.8280930299507944) | > loss_feat: 0.7248373031616211 (4.781607451407533) | > loss_mel: 12.465004920959473 (19.714954953444632) | > loss_duration: 1.545366883277893 (1.4796836878124036) | > loss_1: 16.962465286254883 (29.176888014140882) | > grad_norm_1: tensor(10366.1650, device='cuda:0') (tensor(17950.7305, device='cuda:0')) | > current_lr_0: 0.0001067274206179718 | > current_lr_1: 0.0001067274206179718 | > step_time: 0.5833 (0.6290711101732755) | > loader_time: 0.0055 (0.020066788322047183)  --> TIME: 2023-10-20 06:53:00 -- STEP: 49/50 -- GLOBAL_STEP: 84450 | > loss_disc: 2.4634270668029785 (2.570372744482391) | > loss_disc_real_0: 0.0713660717010498 (0.16832282753395184) | > loss_disc_real_1: 0.1664554476737976 (0.23042216410442273) | > loss_disc_real_2: 0.24882741272449493 (0.23351245723208602) | > loss_disc_real_3: 0.19698867201805115 (0.2449538984469005) | > loss_disc_real_4: 0.2928442060947418 (0.22327821032733333) | > loss_disc_real_5: 0.23101744055747986 (0.2572882609555916) | > loss_0: 2.4634270668029785 (2.570372744482391) | > grad_norm_0: tensor(950.7432, device='cuda:0') (tensor(602.5181, device='cuda:0')) | > loss_gen: 2.028897523880005 (2.216784197456982) | > loss_kl: 0.9514239430427551 (0.7819431266006157) | > loss_feat: 3.968731641769409 (4.682464161203528) | > loss_mel: 22.26988410949707 (20.3849044794939) | > loss_duration: 1.545387864112854 (1.4455029283251084) | > loss_1: 30.764326095581055 (29.511598927634104) | > grad_norm_1: tensor(12370.2646, device='cuda:0') (tensor(15570.7168, device='cuda:0')) | > current_lr_0: 0.0001067274206179718 | > current_lr_1: 0.0001067274206179718 | > step_time: 0.4075 (0.5740202154432025) | > loader_time: 0.4546 (0.027747402385789516)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4172778129577637 (2.4172778129577637) | > loss_disc_real_0: 0.1716337651014328 (0.1716337651014328) | > loss_disc_real_1: 0.24324452877044678 (0.24324452877044678) | > loss_disc_real_2: 0.31189802289009094 (0.31189802289009094) | > loss_disc_real_3: 0.4487403631210327 (0.4487403631210327) | > loss_disc_real_4: 0.2773818075656891 (0.2773818075656891) | > loss_disc_real_5: 0.3134848177433014 (0.3134848177433014) | > loss_0: 2.4172778129577637 (2.4172778129577637) | > loss_gen: 2.9772064685821533 (2.9772064685821533) | > loss_kl: 4.277467727661133 (4.277467727661133) | > loss_feat: 6.259131908416748 (6.259131908416748) | > loss_mel: 24.949132919311523 (24.949132919311523) | > loss_duration: 2.7556281089782715 (2.7556281089782715) | > loss_1: 41.21856689453125 (41.21856689453125)  --> STEP: 1 | > loss_disc: 2.4369990825653076 (2.4369990825653076) | > loss_disc_real_0: 0.1622052788734436 (0.1622052788734436) | > loss_disc_real_1: 0.27265664935112 (0.27265664935112) | > loss_disc_real_2: 0.2902204096317291 (0.2902204096317291) | > loss_disc_real_3: 0.2063542753458023 (0.2063542753458023) | > loss_disc_real_4: 0.27671706676483154 (0.27671706676483154) | > loss_disc_real_5: 0.39645707607269287 (0.39645707607269287) | > loss_0: 2.4369990825653076 (2.4369990825653076) | > loss_gen: 2.549373149871826 (2.549373149871826) | > loss_kl: 4.753913402557373 (4.753913402557373) | > loss_feat: 5.2557525634765625 (5.2557525634765625) | > loss_mel: 20.76448631286621 (20.76448631286621) | > loss_duration: 3.1465368270874023 (3.1465368270874023) | > loss_1: 36.470062255859375 (36.470062255859375)  --> STEP: 2 | > loss_disc: 3.001437187194824 (2.719218134880066) | > loss_disc_real_0: 0.17555546760559082 (0.1688803732395172) | > loss_disc_real_1: 0.24484317004680634 (0.25874990969896317) | > loss_disc_real_2: 0.2828654646873474 (0.28654293715953827) | > loss_disc_real_3: 0.2672739326953888 (0.23681410402059555) | > loss_disc_real_4: 0.2540784180164337 (0.26539774239063263) | > loss_disc_real_5: 0.24870097637176514 (0.322579026222229) | > loss_0: 3.001437187194824 (2.719218134880066) | > loss_gen: 1.4891586303710938 (2.01926589012146) | > loss_kl: 4.364539623260498 (4.5592265129089355) | > loss_feat: 0.058777038007974625 (2.6572648007422686) | > loss_mel: 1.7367182970046997 (11.250602304935455) | > loss_duration: 3.0110268592834473 (3.078781843185425) | > loss_1: 10.6602201461792 (23.565141201019287)  --> STEP: 3 | > loss_disc: 3.024168014526367 (2.8208680947621665) | > loss_disc_real_0: 0.17357772588729858 (0.17044615745544434) | > loss_disc_real_1: 0.24207544326782227 (0.2531917542219162) | > loss_disc_real_2: 0.2737259268760681 (0.28227060039838153) | > loss_disc_real_3: 0.2615121901035309 (0.245046799381574) | > loss_disc_real_4: 0.2984359562397003 (0.27641048034032184) | > loss_disc_real_5: 0.237222358584404 (0.29412680367628735) | > loss_0: 3.024168014526367 (2.8208680947621665) | > loss_gen: 1.529030442237854 (1.855854074160258) | > loss_kl: 2.138995885848999 (3.7524829705556235) | > loss_feat: 0.704775869846344 (2.006435157110294) | > loss_mel: 7.3566107749938965 (9.952605128288269) | > loss_duration: 2.7978365421295166 (2.985133409500122) | > loss_1: 14.527249336242676 (20.552510579427082) --> EVAL PERFORMANCE | > avg_loader_time: 0.010663588841756185 (-0.013429800669352213) | > avg_loss_disc: 2.8208680947621665 (-0.013611793518066406) | > avg_loss_disc_real_0: 0.17044615745544434 (-0.11929826935132343) | > avg_loss_disc_real_1: 0.2531917542219162 (-0.08024125297864276) | > avg_loss_disc_real_2: 0.28227060039838153 (+0.06353153288364408) | > avg_loss_disc_real_3: 0.245046799381574 (-0.07142954568068186) | > avg_loss_disc_real_4: 0.27641048034032184 (+0.018168101708094242) | > avg_loss_disc_real_5: 0.29412680367628735 (-0.05016838014125824) | > avg_loss_0: 2.8208680947621665 (-0.013611793518066406) | > avg_loss_gen: 1.855854074160258 (-0.5149223407109578) | > avg_loss_kl: 3.7524829705556235 (-0.2521479924519858) | > avg_loss_feat: 2.006435157110294 (-3.6260004428525767) | > avg_loss_mel: 9.952605128288269 (-11.639055053393047) | > avg_loss_duration: 2.985133409500122 (+0.0485386848449707) | > avg_loss_1: 20.552510579427082 (-15.983587900797527)  > EPOCH: 629/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:53:19)   --> TIME: 2023-10-20 06:53:39 -- STEP: 29/50 -- GLOBAL_STEP: 84480 | > loss_disc: 3.404496192932129 (2.472981025432718) | > loss_disc_real_0: 0.2874920070171356 (0.18761670165534677) | > loss_disc_real_1: 0.25887414813041687 (0.24440031318828978) | > loss_disc_real_2: 0.3298686146736145 (0.22660879020033212) | > loss_disc_real_3: 0.2044931799173355 (0.24370883687816816) | > loss_disc_real_4: 0.3483026921749115 (0.2437452915413626) | > loss_disc_real_5: 0.37860217690467834 (0.23842220907581263) | > loss_0: 3.404496192932129 (2.472981025432718) | > grad_norm_0: tensor(791.6154, device='cuda:0') (tensor(539.5185, device='cuda:0')) | > loss_gen: 1.569331169128418 (2.2965523497811677) | > loss_kl: 0.6182250380516052 (0.8962518624190626) | > loss_feat: 2.1723289489746094 (4.316836768953965) | > loss_mel: 20.658254623413086 (20.675024941049774) | > loss_duration: 1.4089211225509644 (1.4535938871317897) | > loss_1: 26.427059173583984 (29.638259904137975) | > grad_norm_1: tensor(3544.3833, device='cuda:0') (tensor(16341.2930, device='cuda:0')) | > current_lr_0: 0.00010662073987892883 | > current_lr_1: 0.00010662073987892883 | > step_time: 0.5348 (0.40935351108682566) | > loader_time: 0.0017 (0.009832053348935884)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8384299278259277 (2.8384299278259277) | > loss_disc_real_0: 0.18401999771595 (0.18401999771595) | > loss_disc_real_1: 0.25278225541114807 (0.25278225541114807) | > loss_disc_real_2: 0.2710397243499756 (0.2710397243499756) | > loss_disc_real_3: 0.3809818625450134 (0.3809818625450134) | > loss_disc_real_4: 0.2599264085292816 (0.2599264085292816) | > loss_disc_real_5: 0.21608063578605652 (0.21608063578605652) | > loss_0: 2.8384299278259277 (2.8384299278259277) | > loss_gen: 1.9365767240524292 (1.9365767240524292) | > loss_kl: 4.171884059906006 (4.171884059906006) | > loss_feat: 5.138019561767578 (5.138019561767578) | > loss_mel: 23.759057998657227 (23.759057998657227) | > loss_duration: 2.773998260498047 (2.773998260498047) | > loss_1: 37.779537200927734 (37.779537200927734)  --> STEP: 1 | > loss_disc: 2.372049331665039 (2.372049331665039) | > loss_disc_real_0: 0.2966448664665222 (0.2966448664665222) | > loss_disc_real_1: 0.30180636048316956 (0.30180636048316956) | > loss_disc_real_2: 0.2369343489408493 (0.2369343489408493) | > loss_disc_real_3: 0.1461457759141922 (0.1461457759141922) | > loss_disc_real_4: 0.14477655291557312 (0.14477655291557312) | > loss_disc_real_5: 0.1524886041879654 (0.1524886041879654) | > loss_0: 2.372049331665039 (2.372049331665039) | > loss_gen: 2.192030429840088 (2.192030429840088) | > loss_kl: 4.582152843475342 (4.582152843475342) | > loss_feat: 4.312126636505127 (4.312126636505127) | > loss_mel: 24.321889877319336 (24.321889877319336) | > loss_duration: 3.2375051975250244 (3.2375051975250244) | > loss_1: 38.64570999145508 (38.64570999145508)  --> STEP: 2 | > loss_disc: 2.086440086364746 (2.2292447090148926) | > loss_disc_real_0: 0.2265053540468216 (0.2615751102566719) | > loss_disc_real_1: 0.14566010236740112 (0.22373323142528534) | > loss_disc_real_2: 0.11742966622114182 (0.17718200758099556) | > loss_disc_real_3: 0.17931628227233887 (0.16273102909326553) | > loss_disc_real_4: 0.12195306271314621 (0.13336480781435966) | > loss_disc_real_5: 0.1592664122581482 (0.1558775082230568) | > loss_0: 2.086440086364746 (2.2292447090148926) | > loss_gen: 2.7507033348083496 (2.4713668823242188) | > loss_kl: 4.595429420471191 (4.588791131973267) | > loss_feat: 10.586421966552734 (7.449274301528931) | > loss_mel: 25.888755798339844 (25.10532283782959) | > loss_duration: 2.8323376178741455 (3.034921407699585) | > loss_1: 46.65364456176758 (42.64967727661133)  --> STEP: 3 | > loss_disc: 2.7579503059387207 (2.405479907989502) | > loss_disc_real_0: 0.17638079822063446 (0.23317700624465942) | > loss_disc_real_1: 0.36231493949890137 (0.26992713411649066) | > loss_disc_real_2: 0.3510647416114807 (0.2351429189244906) | > loss_disc_real_3: 0.37971970438957214 (0.23506058752536774) | > loss_disc_real_4: 0.23173977434635162 (0.16615646332502365) | > loss_disc_real_5: 0.3066508173942566 (0.20613527794679007) | > loss_0: 2.7579503059387207 (2.405479907989502) | > loss_gen: 2.6657161712646484 (2.5361499786376953) | > loss_kl: 2.291821002960205 (3.823134422302246) | > loss_feat: 4.28505277633667 (6.394533793131511) | > loss_mel: 22.249963760375977 (24.153536478678387) | > loss_duration: 2.765615463256836 (2.945152759552002) | > loss_1: 34.25817108154297 (39.852508544921875) --> EVAL PERFORMANCE | > avg_loader_time: 0.023754040400187176 (+0.01309045155843099) | > avg_loss_disc: 2.405479907989502 (-0.41538818677266454) | > avg_loss_disc_real_0: 0.23317700624465942 (+0.06273084878921509) | > avg_loss_disc_real_1: 0.26992713411649066 (+0.016735379894574465) | > avg_loss_disc_real_2: 0.2351429189244906 (-0.04712768147389093) | > avg_loss_disc_real_3: 0.23506058752536774 (-0.009986211856206267) | > avg_loss_disc_real_4: 0.16615646332502365 (-0.11025401701529819) | > avg_loss_disc_real_5: 0.20613527794679007 (-0.08799152572949728) | > avg_loss_0: 2.405479907989502 (-0.41538818677266454) | > avg_loss_gen: 2.5361499786376953 (+0.6802959044774373) | > avg_loss_kl: 3.823134422302246 (+0.07065145174662257) | > avg_loss_feat: 6.394533793131511 (+4.388098636021217) | > avg_loss_mel: 24.153536478678387 (+14.200931350390118) | > avg_loss_duration: 2.945152759552002 (-0.03998064994812012) | > avg_loss_1: 39.852508544921875 (+19.299997965494793)  > EPOCH: 630/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:54:12)   --> TIME: 2023-10-20 06:54:27 -- STEP: 9/50 -- GLOBAL_STEP: 84510 | > loss_disc: 1.679744005203247 (2.4693548414442272) | > loss_disc_real_0: 0.028041165322065353 (0.15370471444394854) | > loss_disc_real_1: 0.15334807336330414 (0.22424477545751464) | > loss_disc_real_2: 0.1003696620464325 (0.2360605084233814) | > loss_disc_real_3: 0.37278106808662415 (0.26405964481333893) | > loss_disc_real_4: 0.07877500355243683 (0.2235641007622083) | > loss_disc_real_5: 0.10353762656450272 (0.19704478782498175) | > loss_0: 1.679744005203247 (2.4693548414442272) | > grad_norm_0: tensor(352.0155, device='cuda:0') (tensor(506.8553, device='cuda:0')) | > loss_gen: 2.800334930419922 (2.2840310864978366) | > loss_kl: 0.9467898011207581 (0.9452580875820584) | > loss_feat: 8.27540397644043 (5.079243236117893) | > loss_mel: 21.701383590698242 (18.723927126990425) | > loss_duration: 1.3694264888763428 (1.4550765487882826) | > loss_1: 35.09333801269531 (28.487535847557915) | > grad_norm_1: tensor(5252.4507, device='cuda:0') (tensor(26027.1172, device='cuda:0')) | > current_lr_0: 0.00010651416577396375 | > current_lr_1: 0.00010651416577396375 | > step_time: 0.6032 (0.6384932994842529) | > loader_time: 0.0113 (0.02056839731004503)  --> TIME: 2023-10-20 06:54:45 -- STEP: 39/50 -- GLOBAL_STEP: 84540 | > loss_disc: 0.8176090121269226 (2.3958290830636635) | > loss_disc_real_0: 0.026955170556902885 (0.1460373550534058) | > loss_disc_real_1: 0.10134226828813553 (0.2261004518622007) | > loss_disc_real_2: 0.012122951447963715 (0.23193218014561212) | > loss_disc_real_3: 0.023073431104421616 (0.23206465562375697) | > loss_disc_real_4: 0.012193543836474419 (0.23255660146092758) | > loss_disc_real_5: 0.015901830047369003 (0.2146437501009458) | > loss_0: 0.8176090121269226 (2.3958290830636635) | > grad_norm_0: tensor(389.1085, device='cuda:0') (tensor(519.8225, device='cuda:0')) | > loss_gen: 3.3909740447998047 (2.385028533446483) | > loss_kl: 0.426972895860672 (0.8166415347502782) | > loss_feat: 11.716619491577148 (5.337899579451634) | > loss_mel: 25.543832778930664 (20.810911166362274) | > loss_duration: 1.4263896942138672 (1.4420274710043883) | > loss_1: 42.504791259765625 (30.79250843097001) | > grad_norm_1: tensor(35400.5938, device='cuda:0') (tensor(21729.5391, device='cuda:0')) | > current_lr_0: 0.00010651416577396375 | > current_lr_1: 0.00010651416577396375 | > step_time: 0.6981 (0.5926076020949926) | > loader_time: 0.011 (0.019242372268285506)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.72878360748291 (2.72878360748291) | > loss_disc_real_0: 0.11705079674720764 (0.11705079674720764) | > loss_disc_real_1: 0.2560771405696869 (0.2560771405696869) | > loss_disc_real_2: 0.20744340121746063 (0.20744340121746063) | > loss_disc_real_3: 0.3621891736984253 (0.3621891736984253) | > loss_disc_real_4: 0.19742479920387268 (0.19742479920387268) | > loss_disc_real_5: 0.37895575165748596 (0.37895575165748596) | > loss_0: 2.72878360748291 (2.72878360748291) | > loss_gen: 2.013468027114868 (2.013468027114868) | > loss_kl: 4.9430952072143555 (4.9430952072143555) | > loss_feat: 5.678135395050049 (5.678135395050049) | > loss_mel: 21.97737693786621 (21.97737693786621) | > loss_duration: 2.76692271232605 (2.76692271232605) | > loss_1: 37.37900161743164 (37.37900161743164)  --> STEP: 1 | > loss_disc: 2.635514974594116 (2.635514974594116) | > loss_disc_real_0: 0.2515394687652588 (0.2515394687652588) | > loss_disc_real_1: 0.24460317194461823 (0.24460317194461823) | > loss_disc_real_2: 0.19132305681705475 (0.19132305681705475) | > loss_disc_real_3: 0.2603687345981598 (0.2603687345981598) | > loss_disc_real_4: 0.2287927120923996 (0.2287927120923996) | > loss_disc_real_5: 0.1145022064447403 (0.1145022064447403) | > loss_0: 2.635514974594116 (2.635514974594116) | > loss_gen: 1.7564009428024292 (1.7564009428024292) | > loss_kl: 4.685853004455566 (4.685853004455566) | > loss_feat: 2.76312518119812 (2.76312518119812) | > loss_mel: 19.739944458007812 (19.739944458007812) | > loss_duration: 3.0216643810272217 (3.0216643810272217) | > loss_1: 31.96698760986328 (31.96698760986328)  --> STEP: 2 | > loss_disc: 1.8323172330856323 (2.2339161038398743) | > loss_disc_real_0: 0.2723134756088257 (0.26192647218704224) | > loss_disc_real_1: 0.115753673017025 (0.1801784224808216) | > loss_disc_real_2: 0.15316341817378998 (0.17224323749542236) | > loss_disc_real_3: 0.1180187463760376 (0.1891937404870987) | > loss_disc_real_4: 0.08915232867002487 (0.15897252038121223) | > loss_disc_real_5: 0.1546640843153 (0.13458314538002014) | > loss_0: 1.8323172330856323 (2.2339161038398743) | > loss_gen: 2.412766695022583 (2.084583818912506) | > loss_kl: 4.174347400665283 (4.430100202560425) | > loss_feat: 9.136170387268066 (5.949647784233093) | > loss_mel: 25.07082748413086 (22.405385971069336) | > loss_duration: 2.8537540435791016 (2.9377092123031616) | > loss_1: 43.647865295410156 (37.80742645263672)  --> STEP: 3 | > loss_disc: 2.8176002502441406 (2.42847748597463) | > loss_disc_real_0: 0.16523541510105133 (0.22969611982504526) | > loss_disc_real_1: 0.2891019582748413 (0.21648626774549484) | > loss_disc_real_2: 0.3007957935333252 (0.21509408950805664) | > loss_disc_real_3: 0.3519563376903534 (0.24344793955485025) | > loss_disc_real_4: 0.34900572896003723 (0.22231692324082056) | > loss_disc_real_5: 0.2903432548046112 (0.18650318185488382) | > loss_0: 2.8176002502441406 (2.42847748597463) | > loss_gen: 2.0945396423339844 (2.0879024267196655) | > loss_kl: 1.8310716152191162 (3.563757340113322) | > loss_feat: 2.4444363117218018 (4.781243960062663) | > loss_mel: 22.781631469726562 (22.53080113728841) | > loss_duration: 2.825690746307373 (2.900369723637899) | > loss_1: 31.977371215820312 (35.86407470703125) --> EVAL PERFORMANCE | > avg_loader_time: 0.029965798060099285 (+0.006211757659912109) | > avg_loss_disc: 2.42847748597463 (+0.022997577985127915) | > avg_loss_disc_real_0: 0.22969611982504526 (-0.0034808864196141653) | > avg_loss_disc_real_1: 0.21648626774549484 (-0.05344086637099582) | > avg_loss_disc_real_2: 0.21509408950805664 (-0.02004882941643396) | > avg_loss_disc_real_3: 0.24344793955485025 (+0.008387352029482514) | > avg_loss_disc_real_4: 0.22231692324082056 (+0.056160459915796906) | > avg_loss_disc_real_5: 0.18650318185488382 (-0.019632096091906248) | > avg_loss_0: 2.42847748597463 (+0.022997577985127915) | > avg_loss_gen: 2.0879024267196655 (-0.4482475519180298) | > avg_loss_kl: 3.563757340113322 (-0.2593770821889243) | > avg_loss_feat: 4.781243960062663 (-1.6132898330688477) | > avg_loss_mel: 22.53080113728841 (-1.6227353413899763) | > avg_loss_duration: 2.900369723637899 (-0.04478303591410304) | > avg_loss_1: 35.86407470703125 (-3.988433837890625)  > EPOCH: 631/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:55:07)   --> TIME: 2023-10-20 06:55:25 -- STEP: 19/50 -- GLOBAL_STEP: 84570 | > loss_disc: 1.8080872297286987 (2.396843753362957) | > loss_disc_real_0: 0.1718549132347107 (0.1887373975233028) | > loss_disc_real_1: 0.2180275022983551 (0.2143297956178063) | > loss_disc_real_2: 0.21865414083003998 (0.21442016861156413) | > loss_disc_real_3: 0.1630999892950058 (0.2743979308166002) | > loss_disc_real_4: 0.20201486349105835 (0.2218536738502352) | > loss_disc_real_5: 0.13646163046360016 (0.2177646356193643) | > loss_0: 1.8080872297286987 (2.396843753362957) | > grad_norm_0: tensor(409.5798, device='cuda:0') (tensor(743.1134, device='cuda:0')) | > loss_gen: 3.0760364532470703 (2.5361747929924414) | > loss_kl: 0.9610307216644287 (0.8544680578143973) | > loss_feat: 6.940844535827637 (6.244546206373918) | > loss_mel: 17.114681243896484 (23.047990497789886) | > loss_duration: 1.4832606315612793 (1.4534547830882825) | > loss_1: 29.57585334777832 (34.136634324726316) | > grad_norm_1: tensor(24333.2656, device='cuda:0') (tensor(27516.7012, device='cuda:0')) | > current_lr_0: 0.00010640769819648911 | > current_lr_1: 0.00010640769819648911 | > step_time: 0.8397 (0.6372194917578446) | > loader_time: 0.0258 (0.018250628521567898)  --> TIME: 2023-10-20 06:55:45 -- STEP: 49/50 -- GLOBAL_STEP: 84600 | > loss_disc: 1.395336627960205 (2.4825698550866573) | > loss_disc_real_0: 0.08954572677612305 (0.17309944126374868) | > loss_disc_real_1: 0.23311246931552887 (0.2258737616393031) | > loss_disc_real_2: 0.14285063743591309 (0.2223313957908932) | > loss_disc_real_3: 0.17382127046585083 (0.2540236647639955) | > loss_disc_real_4: 0.12037162482738495 (0.2292420839776798) | > loss_disc_real_5: 0.12753507494926453 (0.23471367746895674) | > loss_0: 1.395336627960205 (2.4825698550866573) | > grad_norm_0: tensor(287.1803, device='cuda:0') (tensor(601.1967, device='cuda:0')) | > loss_gen: 3.8772027492523193 (2.3230294986646998) | > loss_kl: 0.6064268350601196 (0.8257797944302462) | > loss_feat: 8.850746154785156 (5.2072016700189945) | > loss_mel: 22.020288467407227 (21.976856718257974) | > loss_duration: 1.5773857831954956 (1.4339709744161488) | > loss_1: 36.93204879760742 (31.766838618687224) | > grad_norm_1: tensor(36970.5977, device='cuda:0') (tensor(18259.2227, device='cuda:0')) | > current_lr_0: 0.00010640769819648911 | > current_lr_1: 0.00010640769819648911 | > step_time: 0.482 (0.6201686421219184) | > loader_time: 0.6519 (0.036491647058603714)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.803924798965454 (1.803924798965454) | > loss_disc_real_0: 0.0790204107761383 (0.0790204107761383) | > loss_disc_real_1: 0.14402179419994354 (0.14402179419994354) | > loss_disc_real_2: 0.22634409368038177 (0.22634409368038177) | > loss_disc_real_3: 0.14609269797801971 (0.14609269797801971) | > loss_disc_real_4: 0.11795146763324738 (0.11795146763324738) | > loss_disc_real_5: 0.03139109164476395 (0.03139109164476395) | > loss_0: 1.803924798965454 (1.803924798965454) | > loss_gen: 2.534168243408203 (2.534168243408203) | > loss_kl: 5.080621242523193 (5.080621242523193) | > loss_feat: 9.52719497680664 (9.52719497680664) | > loss_mel: 26.09754180908203 (26.09754180908203) | > loss_duration: 2.7901577949523926 (2.7901577949523926) | > loss_1: 46.029685974121094 (46.029685974121094)  --> STEP: 1 | > loss_disc: 2.790440559387207 (2.790440559387207) | > loss_disc_real_0: 0.35068607330322266 (0.35068607330322266) | > loss_disc_real_1: 0.2879272401332855 (0.2879272401332855) | > loss_disc_real_2: 0.2380252629518509 (0.2380252629518509) | > loss_disc_real_3: 0.3724353015422821 (0.3724353015422821) | > loss_disc_real_4: 0.31229838728904724 (0.31229838728904724) | > loss_disc_real_5: 0.35187309980392456 (0.35187309980392456) | > loss_0: 2.790440559387207 (2.790440559387207) | > loss_gen: 2.5489494800567627 (2.5489494800567627) | > loss_kl: 4.6797308921813965 (4.6797308921813965) | > loss_feat: 4.467221260070801 (4.467221260070801) | > loss_mel: 23.670610427856445 (23.670610427856445) | > loss_duration: 3.070478916168213 (3.070478916168213) | > loss_1: 38.43699264526367 (38.43699264526367)  --> STEP: 2 | > loss_disc: 0.9248767495155334 (1.8576586544513702) | > loss_disc_real_0: 0.025033410638570786 (0.18785974197089672) | > loss_disc_real_1: 0.08662211149930954 (0.18727467581629753) | > loss_disc_real_2: 0.03663188964128494 (0.13732857629656792) | > loss_disc_real_3: 0.09589362889528275 (0.23416446521878242) | > loss_disc_real_4: 0.060463979840278625 (0.18638118356466293) | > loss_disc_real_5: 0.02231953851878643 (0.1870963191613555) | > loss_0: 0.9248767495155334 (1.8576586544513702) | > loss_gen: 4.405235290527344 (3.4770923852920532) | > loss_kl: 4.450376510620117 (4.565053701400757) | > loss_feat: 15.380895614624023 (9.924058437347412) | > loss_mel: 26.86679458618164 (25.268702507019043) | > loss_duration: 2.933443069458008 (3.0019609928131104) | > loss_1: 54.0367431640625 (46.236867904663086)  --> STEP: 3 | > loss_disc: 3.0246551036834717 (2.2466574708620706) | > loss_disc_real_0: 0.15038786828517914 (0.17536911740899086) | > loss_disc_real_1: 0.47519442439079285 (0.2832479253411293) | > loss_disc_real_2: 0.39990586042404175 (0.22485433767239252) | > loss_disc_real_3: 0.343883752822876 (0.2707375610868136) | > loss_disc_real_4: 0.3560005724430084 (0.24292097985744476) | > loss_disc_real_5: 0.3225886821746826 (0.23226044016579786) | > loss_0: 3.0246551036834717 (2.2466574708620706) | > loss_gen: 2.306265354156494 (3.0868167082468667) | > loss_kl: 1.9829462766647339 (3.704351226488749) | > loss_feat: 2.5072898864746094 (7.4518022537231445) | > loss_mel: 21.810081481933594 (24.11582883199056) | > loss_duration: 2.7732155323028564 (2.925712505976359) | > loss_1: 31.379798889160156 (41.28451156616211) --> EVAL PERFORMANCE | > avg_loader_time: 0.010627826054890951 (-0.019337972005208336) | > avg_loss_disc: 2.2466574708620706 (-0.1818200151125593) | > avg_loss_disc_real_0: 0.17536911740899086 (-0.0543270024160544) | > avg_loss_disc_real_1: 0.2832479253411293 (+0.06676165759563446) | > avg_loss_disc_real_2: 0.22485433767239252 (+0.009760248164335877) | > avg_loss_disc_real_3: 0.2707375610868136 (+0.027289621531963376) | > avg_loss_disc_real_4: 0.24292097985744476 (+0.020604056616624206) | > avg_loss_disc_real_5: 0.23226044016579786 (+0.04575725831091404) | > avg_loss_0: 2.2466574708620706 (-0.1818200151125593) | > avg_loss_gen: 3.0868167082468667 (+0.9989142815272012) | > avg_loss_kl: 3.704351226488749 (+0.14059388637542725) | > avg_loss_feat: 7.4518022537231445 (+2.6705582936604815) | > avg_loss_mel: 24.11582883199056 (+1.5850276947021484) | > avg_loss_duration: 2.925712505976359 (+0.02534278233845999) | > avg_loss_1: 41.28451156616211 (+5.420436859130859)  > EPOCH: 632/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:55:59)   --> TIME: 2023-10-20 06:56:22 -- STEP: 29/50 -- GLOBAL_STEP: 84630 | > loss_disc: 2.6534059047698975 (2.339895190863774) | > loss_disc_real_0: 0.16785410046577454 (0.161035868307126) | > loss_disc_real_1: 0.2511507272720337 (0.2122018714917117) | > loss_disc_real_2: 0.21464602649211884 (0.20019925848163408) | > loss_disc_real_3: 0.2854541540145874 (0.23694451256044977) | > loss_disc_real_4: 0.2679694592952728 (0.21090760159081426) | > loss_disc_real_5: 0.24962365627288818 (0.21136377668329354) | > loss_0: 2.6534059047698975 (2.339895190863774) | > grad_norm_0: tensor(291.9538, device='cuda:0') (tensor(615.0540, device='cuda:0')) | > loss_gen: 1.8990156650543213 (2.453391408098155) | > loss_kl: 0.42512086033821106 (0.8492883413002409) | > loss_feat: 1.7840368747711182 (6.284689681283359) | > loss_mel: 16.431684494018555 (21.98873206664776) | > loss_duration: 1.4459292888641357 (1.4339231458203545) | > loss_1: 21.98578643798828 (33.01002477777416) | > grad_norm_1: tensor(3920.5547, device='cuda:0') (tensor(25021.6660, device='cuda:0')) | > current_lr_0: 0.00010630133704002402 | > current_lr_1: 0.00010630133704002402 | > step_time: 0.8459 (0.6008810174876246) | > loader_time: 0.0039 (0.01526919726667733)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.536700963973999 (2.536700963973999) | > loss_disc_real_0: 0.31772756576538086 (0.31772756576538086) | > loss_disc_real_1: 0.3033463656902313 (0.3033463656902313) | > loss_disc_real_2: 0.40518099069595337 (0.40518099069595337) | > loss_disc_real_3: 0.34291452169418335 (0.34291452169418335) | > loss_disc_real_4: 0.17848028242588043 (0.17848028242588043) | > loss_disc_real_5: 0.17848770320415497 (0.17848770320415497) | > loss_0: 2.536700963973999 (2.536700963973999) | > loss_gen: 2.695277690887451 (2.695277690887451) | > loss_kl: 5.303506851196289 (5.303506851196289) | > loss_feat: 8.67939281463623 (8.67939281463623) | > loss_mel: 22.547313690185547 (22.547313690185547) | > loss_duration: 2.9019970893859863 (2.9019970893859863) | > loss_1: 42.12748718261719 (42.12748718261719)  --> STEP: 1 | > loss_disc: 2.340592384338379 (2.340592384338379) | > loss_disc_real_0: 0.07166436314582825 (0.07166436314582825) | > loss_disc_real_1: 0.15095429122447968 (0.15095429122447968) | > loss_disc_real_2: 0.21246355772018433 (0.21246355772018433) | > loss_disc_real_3: 0.2614319920539856 (0.2614319920539856) | > loss_disc_real_4: 0.24259814620018005 (0.24259814620018005) | > loss_disc_real_5: 0.2090030312538147 (0.2090030312538147) | > loss_0: 2.340592384338379 (2.340592384338379) | > loss_gen: 2.119323253631592 (2.119323253631592) | > loss_kl: 4.224565505981445 (4.224565505981445) | > loss_feat: 5.491493225097656 (5.491493225097656) | > loss_mel: 25.68268585205078 (25.68268585205078) | > loss_duration: 3.034541130065918 (3.034541130065918) | > loss_1: 40.552608489990234 (40.552608489990234)  --> STEP: 2 | > loss_disc: 1.4351158142089844 (1.8878540992736816) | > loss_disc_real_0: 0.019025243818759918 (0.04534480348229408) | > loss_disc_real_1: 0.02312668412923813 (0.0870404876768589) | > loss_disc_real_2: 0.06561007350683212 (0.13903681561350822) | > loss_disc_real_3: 0.033610060811042786 (0.1475210264325142) | > loss_disc_real_4: 0.06404916197061539 (0.15332365408539772) | > loss_disc_real_5: 0.05882486701011658 (0.13391394913196564) | > loss_0: 1.4351158142089844 (1.8878540992736816) | > loss_gen: 2.565567970275879 (2.3424456119537354) | > loss_kl: 4.970739841461182 (4.5976526737213135) | > loss_feat: 16.013835906982422 (10.752664566040039) | > loss_mel: 24.80584144592285 (25.244263648986816) | > loss_duration: 2.96146821975708 (2.998004674911499) | > loss_1: 51.31745147705078 (45.93502998352051)  --> STEP: 3 | > loss_disc: 2.8088033199310303 (2.1948371728261313) | > loss_disc_real_0: 0.08415307849645615 (0.058280895153681435) | > loss_disc_real_1: 0.39477279782295227 (0.18961792439222336) | > loss_disc_real_2: 0.44268718361854553 (0.24025360494852066) | > loss_disc_real_3: 0.21726734936237335 (0.17076980074246725) | > loss_disc_real_4: 0.35892078280448914 (0.22185603032509485) | > loss_disc_real_5: 0.3395443856716156 (0.20245742797851562) | > loss_0: 2.8088033199310303 (2.1948371728261313) | > loss_gen: 2.6971874237060547 (2.460692882537842) | > loss_kl: 1.9608570337295532 (3.71872079372406) | > loss_feat: 4.429075241088867 (8.644801457722982) | > loss_mel: 22.08649253845215 (24.191673278808594) | > loss_duration: 2.871523857116699 (2.9558444023132324) | > loss_1: 34.045135498046875 (41.97173182169596) --> EVAL PERFORMANCE | > avg_loader_time: 0.00942667325337728 (-0.0012011528015136719) | > avg_loss_disc: 2.1948371728261313 (-0.05182029803593924) | > avg_loss_disc_real_0: 0.058280895153681435 (-0.11708822225530943) | > avg_loss_disc_real_1: 0.18961792439222336 (-0.09363000094890594) | > avg_loss_disc_real_2: 0.24025360494852066 (+0.015399267276128142) | > avg_loss_disc_real_3: 0.17076980074246725 (-0.09996776034434637) | > avg_loss_disc_real_4: 0.22185603032509485 (-0.021064949532349914) | > avg_loss_disc_real_5: 0.20245742797851562 (-0.029803012187282235) | > avg_loss_0: 2.1948371728261313 (-0.05182029803593924) | > avg_loss_gen: 2.460692882537842 (-0.6261238257090249) | > avg_loss_kl: 3.71872079372406 (+0.01436956723531102) | > avg_loss_feat: 8.644801457722982 (+1.1929992039998378) | > avg_loss_mel: 24.191673278808594 (+0.07584444681803504) | > avg_loss_duration: 2.9558444023132324 (+0.03013189633687352) | > avg_loss_1: 41.97173182169596 (+0.6872202555338518)  > EPOCH: 633/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:56:56)   --> TIME: 2023-10-20 06:57:08 -- STEP: 9/50 -- GLOBAL_STEP: 84660 | > loss_disc: 3.0480282306671143 (2.5423156685299344) | > loss_disc_real_0: 0.26208144426345825 (0.17146089797218642) | > loss_disc_real_1: 0.3022577166557312 (0.22408358421590593) | > loss_disc_real_2: 0.15765421092510223 (0.22409879002306196) | > loss_disc_real_3: 0.2635691463947296 (0.24053979913393655) | > loss_disc_real_4: 0.2647578716278076 (0.2354714787668652) | > loss_disc_real_5: 0.3177974820137024 (0.2402013163599703) | > loss_0: 3.0480282306671143 (2.5423156685299344) | > grad_norm_0: tensor(734.8210, device='cuda:0') (tensor(504.6563, device='cuda:0')) | > loss_gen: 1.590308427810669 (2.18579802248213) | > loss_kl: 0.6180738806724548 (0.9149646162986755) | > loss_feat: 0.18705767393112183 (5.254790021313561) | > loss_mel: 12.72229290008545 (22.07302973005507) | > loss_duration: 1.3954687118530273 (1.4253156317604914) | > loss_1: 16.513202667236328 (31.853898366292317) | > grad_norm_1: tensor(21095.2188, device='cuda:0') (tensor(15871.4111, device='cuda:0')) | > current_lr_0: 0.00010619508219819402 | > current_lr_1: 0.00010619508219819402 | > step_time: 0.8337 (0.6574645307328966) | > loader_time: 0.0247 (0.030390924877590604)  --> TIME: 2023-10-20 06:57:21 -- STEP: 39/50 -- GLOBAL_STEP: 84690 | > loss_disc: 2.760880947113037 (2.5009911304865122) | > loss_disc_real_0: 0.26431477069854736 (0.16562011613486669) | > loss_disc_real_1: 0.24402174353599548 (0.23782855100356615) | > loss_disc_real_2: 0.0993066132068634 (0.22156912814348173) | > loss_disc_real_3: 0.21552462875843048 (0.23862929900105184) | > loss_disc_real_4: 0.25781509280204773 (0.23003981090508974) | > loss_disc_real_5: 0.38951408863067627 (0.27126443376525855) | > loss_0: 2.760880947113037 (2.5009911304865122) | > grad_norm_0: tensor(827.6680, device='cuda:0') (tensor(577.3191, device='cuda:0')) | > loss_gen: 1.8682477474212646 (2.2678834841801567) | > loss_kl: 0.6912595629692078 (0.845152042615108) | > loss_feat: 3.0635106563568115 (4.864345999864431) | > loss_mel: 23.43282127380371 (20.2057532622264) | > loss_duration: 1.5024913549423218 (1.4298694011492608) | > loss_1: 30.558330535888672 (29.613004354330208) | > grad_norm_1: tensor(9698.0742, device='cuda:0') (tensor(19485.1621, device='cuda:0')) | > current_lr_0: 0.00010619508219819402 | > current_lr_1: 0.00010619508219819402 | > step_time: 0.2893 (0.4770430662693123) | > loader_time: 0.0027 (0.014567411862886868)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.998490571975708 (2.998490571975708) | > loss_disc_real_0: 0.35687240958213806 (0.35687240958213806) | > loss_disc_real_1: 0.3011918067932129 (0.3011918067932129) | > loss_disc_real_2: 0.2409152388572693 (0.2409152388572693) | > loss_disc_real_3: 0.23585738241672516 (0.23585738241672516) | > loss_disc_real_4: 0.16271555423736572 (0.16271555423736572) | > loss_disc_real_5: 0.17381611466407776 (0.17381611466407776) | > loss_0: 2.998490571975708 (2.998490571975708) | > loss_gen: 1.5492360591888428 (1.5492360591888428) | > loss_kl: 4.245465278625488 (4.245465278625488) | > loss_feat: 0.6804325580596924 (0.6804325580596924) | > loss_mel: 9.128973007202148 (9.128973007202148) | > loss_duration: 2.844181776046753 (2.844181776046753) | > loss_1: 18.448287963867188 (18.448287963867188)  --> STEP: 1 | > loss_disc: 3.033618927001953 (3.033618927001953) | > loss_disc_real_0: 0.47815418243408203 (0.47815418243408203) | > loss_disc_real_1: 0.3040243089199066 (0.3040243089199066) | > loss_disc_real_2: 0.29376888275146484 (0.29376888275146484) | > loss_disc_real_3: 0.28281450271606445 (0.28281450271606445) | > loss_disc_real_4: 0.23807573318481445 (0.23807573318481445) | > loss_disc_real_5: 0.2811748683452606 (0.2811748683452606) | > loss_0: 3.033618927001953 (3.033618927001953) | > loss_gen: 2.653637409210205 (2.653637409210205) | > loss_kl: 4.435130596160889 (4.435130596160889) | > loss_feat: 3.5919008255004883 (3.5919008255004883) | > loss_mel: 21.251192092895508 (21.251192092895508) | > loss_duration: 3.0816268920898438 (3.0816268920898438) | > loss_1: 35.01348876953125 (35.01348876953125)  --> STEP: 2 | > loss_disc: 3.130100965499878 (3.0818599462509155) | > loss_disc_real_0: 0.3979184031486511 (0.4380362927913666) | > loss_disc_real_1: 0.3244035243988037 (0.31421391665935516) | > loss_disc_real_2: 0.26827767491340637 (0.2810232788324356) | > loss_disc_real_3: 0.26817357540130615 (0.2754940390586853) | > loss_disc_real_4: 0.19067667424678802 (0.21437620371580124) | > loss_disc_real_5: 0.18739864230155945 (0.23428675532341003) | > loss_0: 3.130100965499878 (3.0818599462509155) | > loss_gen: 1.55581796169281 (2.1047276854515076) | > loss_kl: 4.915173530578613 (4.675152063369751) | > loss_feat: 0.2526267170906067 (1.9222637712955475) | > loss_mel: 5.833055019378662 (13.542123556137085) | > loss_duration: 2.903850555419922 (2.992738723754883) | > loss_1: 15.46052360534668 (25.237006187438965)  --> STEP: 3 | > loss_disc: 2.9063329696655273 (3.023350954055786) | > loss_disc_real_0: 0.3818393349647522 (0.41930397351582843) | > loss_disc_real_1: 0.31939181685447693 (0.31593988339106244) | > loss_disc_real_2: 0.2687596380710602 (0.2769353985786438) | > loss_disc_real_3: 0.31569090485572815 (0.28889299432436627) | > loss_disc_real_4: 0.2234477549791336 (0.21740005413691202) | > loss_disc_real_5: 0.3302476406097412 (0.26627371708552044) | > loss_0: 2.9063329696655273 (3.023350954055786) | > loss_gen: 2.428741693496704 (2.2127323547999063) | > loss_kl: 2.1231961250305176 (3.82450008392334) | > loss_feat: 2.687101364135742 (2.1772096355756125) | > loss_mel: 19.796751022338867 (15.626999378204346) | > loss_duration: 2.813525915145874 (2.9330011208852134) | > loss_1: 29.849315643310547 (26.774442672729492) --> EVAL PERFORMANCE | > avg_loader_time: 0.0158535639444987 (+0.00642689069112142) | > avg_loss_disc: 3.023350954055786 (+0.8285137812296548) | > avg_loss_disc_real_0: 0.41930397351582843 (+0.361023078362147) | > avg_loss_disc_real_1: 0.31593988339106244 (+0.12632195899883908) | > avg_loss_disc_real_2: 0.2769353985786438 (+0.03668179363012314) | > avg_loss_disc_real_3: 0.28889299432436627 (+0.11812319358189902) | > avg_loss_disc_real_4: 0.21740005413691202 (-0.004455976188182831) | > avg_loss_disc_real_5: 0.26627371708552044 (+0.06381628910700482) | > avg_loss_0: 3.023350954055786 (+0.8285137812296548) | > avg_loss_gen: 2.2127323547999063 (-0.24796052773793553) | > avg_loss_kl: 3.82450008392334 (+0.10577929019927979) | > avg_loss_feat: 2.1772096355756125 (-6.467591822147369) | > avg_loss_mel: 15.626999378204346 (-8.564673900604248) | > avg_loss_duration: 2.9330011208852134 (-0.022843281428019058) | > avg_loss_1: 26.774442672729492 (-15.197289148966469)  > EPOCH: 634/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:57:46)   --> TIME: 2023-10-20 06:58:04 -- STEP: 19/50 -- GLOBAL_STEP: 84720 | > loss_disc: 2.5323097705841064 (2.4976606431760286) | > loss_disc_real_0: 0.20800985395908356 (0.19386298866256288) | > loss_disc_real_1: 0.22357077896595 (0.2353489910693545) | > loss_disc_real_2: 0.2712290585041046 (0.2178196852144442) | > loss_disc_real_3: 0.1687004715204239 (0.2452792317459458) | > loss_disc_real_4: 0.37117740511894226 (0.24998528686793228) | > loss_disc_real_5: 0.17038217186927795 (0.21526517444535306) | > loss_0: 2.5323097705841064 (2.4976606431760286) | > grad_norm_0: tensor(512.0202, device='cuda:0') (tensor(626.2113, device='cuda:0')) | > loss_gen: 2.3464388847351074 (2.4277290419528357) | > loss_kl: 1.095314383506775 (0.8531752307164041) | > loss_feat: 6.214717388153076 (5.027069759996314) | > loss_mel: 22.475391387939453 (18.75362119549199) | > loss_duration: 1.546717882156372 (1.4934380430924266) | > loss_1: 33.67858123779297 (28.555033508100006) | > grad_norm_1: tensor(3085.2805, device='cuda:0') (tensor(26108.1211, device='cuda:0')) | > current_lr_0: 0.00010608893356473096 | > current_lr_1: 0.00010608893356473096 | > step_time: 0.5497 (0.5801210528925845) | > loader_time: 0.0352 (0.02304277921977796)  --> TIME: 2023-10-20 06:58:24 -- STEP: 49/50 -- GLOBAL_STEP: 84750 | > loss_disc: 2.943816661834717 (2.479516564583291) | > loss_disc_real_0: 0.24107959866523743 (0.1690264519075958) | > loss_disc_real_1: 0.2630667984485626 (0.21765697815892648) | > loss_disc_real_2: 0.3483808934688568 (0.21340924980384962) | > loss_disc_real_3: 0.25119733810424805 (0.23681094406210645) | > loss_disc_real_4: 0.27597716450691223 (0.2335056168768479) | > loss_disc_real_5: 0.26022225618362427 (0.22076926095297142) | > loss_0: 2.943816661834717 (2.479516564583291) | > grad_norm_0: tensor(1988.4738, device='cuda:0') (tensor(659.2359, device='cuda:0')) | > loss_gen: 1.7140204906463623 (2.299409939318288) | > loss_kl: 0.5996995568275452 (0.8593776858582789) | > loss_feat: 0.47430315613746643 (4.959528149124614) | > loss_mel: 10.5160493850708 (19.29088841409099) | > loss_duration: 1.5143687725067139 (1.4378336351744982) | > loss_1: 14.818441390991211 (28.847037831131292) | > grad_norm_1: tensor(10528.2471, device='cuda:0') (tensor(20883.6797, device='cuda:0')) | > current_lr_0: 0.00010608893356473096 | > current_lr_1: 0.00010608893356473096 | > step_time: 0.5815 (0.6164821410665708) | > loader_time: 0.4141 (0.03336809605968242)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9604971408843994 (2.9604971408843994) | > loss_disc_real_0: 0.1511068493127823 (0.1511068493127823) | > loss_disc_real_1: 0.2739551067352295 (0.2739551067352295) | > loss_disc_real_2: 0.35956865549087524 (0.35956865549087524) | > loss_disc_real_3: 0.27209171652793884 (0.27209171652793884) | > loss_disc_real_4: 0.29557740688323975 (0.29557740688323975) | > loss_disc_real_5: 0.2707531154155731 (0.2707531154155731) | > loss_0: 2.9604971408843994 (2.9604971408843994) | > loss_gen: 1.7045981884002686 (1.7045981884002686) | > loss_kl: 4.2271199226379395 (4.2271199226379395) | > loss_feat: 0.7918320894241333 (0.7918320894241333) | > loss_mel: 19.79468536376953 (19.79468536376953) | > loss_duration: 2.8069443702697754 (2.8069443702697754) | > loss_1: 29.325178146362305 (29.325178146362305)  --> STEP: 1 | > loss_disc: 2.5193634033203125 (2.5193634033203125) | > loss_disc_real_0: 0.35241231322288513 (0.35241231322288513) | > loss_disc_real_1: 0.21034877002239227 (0.21034877002239227) | > loss_disc_real_2: 0.276535302400589 (0.276535302400589) | > loss_disc_real_3: 0.33912986516952515 (0.33912986516952515) | > loss_disc_real_4: 0.3036878705024719 (0.3036878705024719) | > loss_disc_real_5: 0.2194240540266037 (0.2194240540266037) | > loss_0: 2.5193634033203125 (2.5193634033203125) | > loss_gen: 2.7717278003692627 (2.7717278003692627) | > loss_kl: 4.500824928283691 (4.500824928283691) | > loss_feat: 5.659785747528076 (5.659785747528076) | > loss_mel: 25.118377685546875 (25.118377685546875) | > loss_duration: 3.169265031814575 (3.169265031814575) | > loss_1: 41.2199821472168 (41.2199821472168)  --> STEP: 2 | > loss_disc: 2.8612725734710693 (2.690317988395691) | > loss_disc_real_0: 0.14618730545043945 (0.2492998093366623) | > loss_disc_real_1: 0.275983989238739 (0.24316637963056564) | > loss_disc_real_2: 0.3353460729122162 (0.3059406876564026) | > loss_disc_real_3: 0.2747855484485626 (0.3069577068090439) | > loss_disc_real_4: 0.27581891417503357 (0.28975339233875275) | > loss_disc_real_5: 0.2599591016769409 (0.2396915778517723) | > loss_0: 2.8612725734710693 (2.690317988395691) | > loss_gen: 1.7530858516693115 (2.262406826019287) | > loss_kl: 3.9528825283050537 (4.226853728294373) | > loss_feat: 0.607612133026123 (3.1336989402770996) | > loss_mel: 21.53632354736328 (23.327350616455078) | > loss_duration: 3.0332717895507812 (3.1012684106826782) | > loss_1: 30.883174896240234 (36.051578521728516)  --> STEP: 3 | > loss_disc: 2.104175567626953 (2.4949371814727783) | > loss_disc_real_0: 0.1252727508544922 (0.20795745650927225) | > loss_disc_real_1: 0.134280264377594 (0.2068710078795751) | > loss_disc_real_2: 0.12505066394805908 (0.24564401308695474) | > loss_disc_real_3: 0.09622767567634583 (0.23671436309814453) | > loss_disc_real_4: 0.10475949198007584 (0.22808875888586044) | > loss_disc_real_5: 0.10609893500804901 (0.19516069690386453) | > loss_0: 2.104175567626953 (2.4949371814727783) | > loss_gen: 1.833857774734497 (2.1195571422576904) | > loss_kl: 2.297208070755005 (3.5836385091145835) | > loss_feat: 7.117990970611572 (4.461796283721924) | > loss_mel: 21.85670280456543 (22.837134679158527) | > loss_duration: 2.887002468109131 (3.029846429824829) | > loss_1: 35.992759704589844 (36.03197224934896) --> EVAL PERFORMANCE | > avg_loader_time: 0.006731112798055013 (-0.009122451146443687) | > avg_loss_disc: 2.4949371814727783 (-0.5284137725830078) | > avg_loss_disc_real_0: 0.20795745650927225 (-0.21134651700655618) | > avg_loss_disc_real_1: 0.2068710078795751 (-0.10906887551148733) | > avg_loss_disc_real_2: 0.24564401308695474 (-0.031291385491689055) | > avg_loss_disc_real_3: 0.23671436309814453 (-0.05217863122622174) | > avg_loss_disc_real_4: 0.22808875888586044 (+0.010688704748948424) | > avg_loss_disc_real_5: 0.19516069690386453 (-0.07111302018165591) | > avg_loss_0: 2.4949371814727783 (-0.5284137725830078) | > avg_loss_gen: 2.1195571422576904 (-0.09317521254221584) | > avg_loss_kl: 3.5836385091145835 (-0.24086157480875636) | > avg_loss_feat: 4.461796283721924 (+2.2845866481463113) | > avg_loss_mel: 22.837134679158527 (+7.210135300954182) | > avg_loss_duration: 3.029846429824829 (+0.09684530893961574) | > avg_loss_1: 36.03197224934896 (+9.257529576619469)  > EPOCH: 635/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:58:44)   --> TIME: 2023-10-20 06:59:11 -- STEP: 29/50 -- GLOBAL_STEP: 84780 | > loss_disc: 1.7005534172058105 (2.451567584070666) | > loss_disc_real_0: 0.09118138253688812 (0.15784041198163196) | > loss_disc_real_1: 0.09468302130699158 (0.2176866783150311) | > loss_disc_real_2: 0.18238264322280884 (0.22657547698452554) | > loss_disc_real_3: 0.19857048988342285 (0.24377242649166747) | > loss_disc_real_4: 0.16412724554538727 (0.2511076363253182) | > loss_disc_real_5: 0.2287750244140625 (0.24007718425629468) | > loss_0: 1.7005534172058105 (2.451567584070666) | > grad_norm_0: tensor(303.9052, device='cuda:0') (tensor(722.0711, device='cuda:0')) | > loss_gen: 3.0010788440704346 (2.403194004091723) | > loss_kl: 0.7537158727645874 (0.7887179060228939) | > loss_feat: 7.369089126586914 (5.540584722341134) | > loss_mel: 24.90721321105957 (21.244546997136087) | > loss_duration: 1.4470398426055908 (1.4505155209837288) | > loss_1: 37.4781379699707 (31.427559556632207) | > grad_norm_1: tensor(27405.3887, device='cuda:0') (tensor(27324.7031, device='cuda:0')) | > current_lr_0: 0.00010598289103347297 | > current_lr_1: 0.00010598289103347297 | > step_time: 0.7139 (0.6318429585160881) | > loader_time: 0.0366 (0.02104593145436254)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9688559770584106 (1.9688559770584106) | > loss_disc_real_0: 0.12854711711406708 (0.12854711711406708) | > loss_disc_real_1: 0.21125811338424683 (0.21125811338424683) | > loss_disc_real_2: 0.13402773439884186 (0.13402773439884186) | > loss_disc_real_3: 0.3096175193786621 (0.3096175193786621) | > loss_disc_real_4: 0.09715338796377182 (0.09715338796377182) | > loss_disc_real_5: 0.23466813564300537 (0.23466813564300537) | > loss_0: 1.9688559770584106 (1.9688559770584106) | > loss_gen: 2.8618414402008057 (2.8618414402008057) | > loss_kl: 4.922947883605957 (4.922947883605957) | > loss_feat: 8.192230224609375 (8.192230224609375) | > loss_mel: 24.288524627685547 (24.288524627685547) | > loss_duration: 2.8688924312591553 (2.8688924312591553) | > loss_1: 43.134437561035156 (43.134437561035156)  --> STEP: 1 | > loss_disc: 1.4566307067871094 (1.4566307067871094) | > loss_disc_real_0: 0.01671484299004078 (0.01671484299004078) | > loss_disc_real_1: 0.04108414053916931 (0.04108414053916931) | > loss_disc_real_2: 0.09918082505464554 (0.09918082505464554) | > loss_disc_real_3: 0.09004819393157959 (0.09004819393157959) | > loss_disc_real_4: 0.02637038566172123 (0.02637038566172123) | > loss_disc_real_5: 0.16545331478118896 (0.16545331478118896) | > loss_0: 1.4566307067871094 (1.4566307067871094) | > loss_gen: 2.3817169666290283 (2.3817169666290283) | > loss_kl: 5.361753940582275 (5.361753940582275) | > loss_feat: 11.552335739135742 (11.552335739135742) | > loss_mel: 27.32105827331543 (27.32105827331543) | > loss_duration: 3.106900215148926 (3.106900215148926) | > loss_1: 49.72376251220703 (49.72376251220703)  --> STEP: 2 | > loss_disc: 1.9535619020462036 (1.7050963044166565) | > loss_disc_real_0: 0.08802367746829987 (0.05236926022917032) | > loss_disc_real_1: 0.22969821095466614 (0.13539117574691772) | > loss_disc_real_2: 0.16984738409519196 (0.13451410457491875) | > loss_disc_real_3: 0.28775307536125183 (0.1889006346464157) | > loss_disc_real_4: 0.1984948217868805 (0.11243260372430086) | > loss_disc_real_5: 0.22971917688846588 (0.19758624583482742) | > loss_0: 1.9535619020462036 (1.7050963044166565) | > loss_gen: 2.9477832317352295 (2.664750099182129) | > loss_kl: 4.462388038635254 (4.912070989608765) | > loss_feat: 7.38277006149292 (9.467552900314331) | > loss_mel: 24.439735412597656 (25.880396842956543) | > loss_duration: 2.9199061393737793 (3.0134031772613525) | > loss_1: 42.152584075927734 (45.93817329406738)  --> STEP: 3 | > loss_disc: 2.92364501953125 (2.1112792094548545) | > loss_disc_real_0: 0.2787475883960724 (0.127828702951471) | > loss_disc_real_1: 0.2575392425060272 (0.17610719799995422) | > loss_disc_real_2: 0.21156364679336548 (0.160197285314401) | > loss_disc_real_3: 0.2266487181186676 (0.20148332913716635) | > loss_disc_real_4: 0.346912145614624 (0.19059245102107525) | > loss_disc_real_5: 0.35583287477493286 (0.2503351221481959) | > loss_0: 2.92364501953125 (2.1112792094548545) | > loss_gen: 1.8515764474868774 (2.393692215283712) | > loss_kl: 2.1077382564544678 (3.9772934118906655) | > loss_feat: 1.64837646484375 (6.861160755157471) | > loss_mel: 20.91476821899414 (24.225187301635742) | > loss_duration: 2.8710734844207764 (2.9659599463144937) | > loss_1: 29.393531799316406 (40.423292795817055) --> EVAL PERFORMANCE | > avg_loader_time: 0.015930016835530598 (+0.009198904037475586) | > avg_loss_disc: 2.1112792094548545 (-0.38365797201792384) | > avg_loss_disc_real_0: 0.127828702951471 (-0.08012875355780125) | > avg_loss_disc_real_1: 0.17610719799995422 (-0.03076380987962088) | > avg_loss_disc_real_2: 0.160197285314401 (-0.08544672777255374) | > avg_loss_disc_real_3: 0.20148332913716635 (-0.03523103396097818) | > avg_loss_disc_real_4: 0.19059245102107525 (-0.037496307864785194) | > avg_loss_disc_real_5: 0.2503351221481959 (+0.05517442524433139) | > avg_loss_0: 2.1112792094548545 (-0.38365797201792384) | > avg_loss_gen: 2.393692215283712 (+0.27413507302602147) | > avg_loss_kl: 3.9772934118906655 (+0.39365490277608206) | > avg_loss_feat: 6.861160755157471 (+2.399364471435547) | > avg_loss_mel: 24.225187301635742 (+1.3880526224772147) | > avg_loss_duration: 2.9659599463144937 (-0.06388648351033543) | > avg_loss_1: 40.423292795817055 (+4.391320546468094)  > EPOCH: 636/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 06:59:39)   --> TIME: 2023-10-20 06:59:48 -- STEP: 9/50 -- GLOBAL_STEP: 84810 | > loss_disc: 2.95890474319458 (2.718937555948893) | > loss_disc_real_0: 0.2847280502319336 (0.17396355668703714) | > loss_disc_real_1: 0.22358910739421844 (0.20937675589488614) | > loss_disc_real_2: 0.25821906328201294 (0.21044492017891672) | > loss_disc_real_3: 0.24100326001644135 (0.22375747561454773) | > loss_disc_real_4: 0.2558143734931946 (0.23534130222267574) | > loss_disc_real_5: 0.24425619840621948 (0.24324858436981836) | > loss_0: 2.95890474319458 (2.718937555948893) | > grad_norm_0: tensor(366.6276, device='cuda:0') (tensor(484.1295, device='cuda:0')) | > loss_gen: 1.577679991722107 (1.866800414191352) | > loss_kl: 0.7722786664962769 (0.7608007945948176) | > loss_feat: 0.13402551412582397 (3.5361390287677446) | > loss_mel: 5.983935356140137 (16.62493133544922) | > loss_duration: 1.372050404548645 (1.4234697686301336) | > loss_1: 9.839969635009766 (24.212141354878742) | > grad_norm_1: tensor(44868.3789, device='cuda:0') (tensor(22499.3711, device='cuda:0')) | > current_lr_0: 0.00010587695449836423 | > current_lr_1: 0.00010587695449836423 | > step_time: 0.391 (0.45090746879577637) | > loader_time: 0.0066 (0.010294304953681098)  --> TIME: 2023-10-20 07:00:02 -- STEP: 39/50 -- GLOBAL_STEP: 84840 | > loss_disc: 2.6763432025909424 (2.3077121575673414) | > loss_disc_real_0: 0.1581166535615921 (0.12525373155203384) | > loss_disc_real_1: 0.2963649332523346 (0.2060412121936679) | > loss_disc_real_2: 0.29238376021385193 (0.19611051487617) | > loss_disc_real_3: 0.1667146235704422 (0.23781302919945654) | > loss_disc_real_4: 0.18004854023456573 (0.21122092486192018) | > loss_disc_real_5: 0.2687748968601227 (0.21025540889837804) | > loss_0: 2.6763432025909424 (2.3077121575673414) | > grad_norm_0: tensor(814.3314, device='cuda:0') (tensor(547.9254, device='cuda:0')) | > loss_gen: 2.185749053955078 (2.407383790382972) | > loss_kl: 0.44232890009880066 (0.8096078483340068) | > loss_feat: 4.780052185058594 (5.799978928879285) | > loss_mel: 23.013715744018555 (21.479746146079815) | > loss_duration: 1.5554031133651733 (1.4328755598801832) | > loss_1: 31.977249145507812 (31.92959262163211) | > grad_norm_1: tensor(26490.6172, device='cuda:0') (tensor(25959.5547, device='cuda:0')) | > current_lr_0: 0.00010587695449836423 | > current_lr_1: 0.00010587695449836423 | > step_time: 1.0234 (0.4555972845126421) | > loader_time: 0.0363 (0.01049959965241261)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1691946983337402 (2.1691946983337402) | > loss_disc_real_0: 0.22192935645580292 (0.22192935645580292) | > loss_disc_real_1: 0.19696033000946045 (0.19696033000946045) | > loss_disc_real_2: 0.226873978972435 (0.226873978972435) | > loss_disc_real_3: 0.1419677436351776 (0.1419677436351776) | > loss_disc_real_4: 0.1727009117603302 (0.1727009117603302) | > loss_disc_real_5: 0.061229269951581955 (0.061229269951581955) | > loss_0: 2.1691946983337402 (2.1691946983337402) | > loss_gen: 2.2123208045959473 (2.2123208045959473) | > loss_kl: 4.693971633911133 (4.693971633911133) | > loss_feat: 6.843218803405762 (6.843218803405762) | > loss_mel: 15.824828147888184 (15.824828147888184) | > loss_duration: 2.799614429473877 (2.799614429473877) | > loss_1: 32.37395477294922 (32.37395477294922)  --> STEP: 1 | > loss_disc: 2.3476645946502686 (2.3476645946502686) | > loss_disc_real_0: 0.18863323330879211 (0.18863323330879211) | > loss_disc_real_1: 0.3692611753940582 (0.3692611753940582) | > loss_disc_real_2: 0.2065364122390747 (0.2065364122390747) | > loss_disc_real_3: 0.2352212518453598 (0.2352212518453598) | > loss_disc_real_4: 0.24061846733093262 (0.24061846733093262) | > loss_disc_real_5: 0.10969754308462143 (0.10969754308462143) | > loss_0: 2.3476645946502686 (2.3476645946502686) | > loss_gen: 2.391094207763672 (2.391094207763672) | > loss_kl: 5.303462982177734 (5.303462982177734) | > loss_feat: 5.379817008972168 (5.379817008972168) | > loss_mel: 22.407978057861328 (22.407978057861328) | > loss_duration: 3.274310350418091 (3.274310350418091) | > loss_1: 38.75666427612305 (38.75666427612305)  --> STEP: 2 | > loss_disc: 2.48345685005188 (2.415560722351074) | > loss_disc_real_0: 0.08817324042320251 (0.13840323686599731) | > loss_disc_real_1: 0.16873233020305634 (0.2689967527985573) | > loss_disc_real_2: 0.1751025915145874 (0.19081950187683105) | > loss_disc_real_3: 0.1731692999601364 (0.2041952759027481) | > loss_disc_real_4: 0.17378881573677063 (0.20720364153385162) | > loss_disc_real_5: 0.2392863929271698 (0.17449196800589561) | > loss_0: 2.48345685005188 (2.415560722351074) | > loss_gen: 1.9827086925506592 (2.1869014501571655) | > loss_kl: 4.481473922729492 (4.892468452453613) | > loss_feat: 8.535981178283691 (6.95789909362793) | > loss_mel: 22.863142013549805 (22.635560035705566) | > loss_duration: 3.00059175491333 (3.1374510526657104) | > loss_1: 40.863895416259766 (39.810279846191406)  --> STEP: 3 | > loss_disc: 3.0757079124450684 (2.635609785715739) | > loss_disc_real_0: 0.5115906596183777 (0.2627990444501241) | > loss_disc_real_1: 0.3013908565044403 (0.27979478736718494) | > loss_disc_real_2: 0.30043691396713257 (0.2273586392402649) | > loss_disc_real_3: 0.25424790382385254 (0.22087948520978293) | > loss_disc_real_4: 0.27329134941101074 (0.22923287749290466) | > loss_disc_real_5: 0.25888559222221375 (0.20262317607800165) | > loss_0: 3.0757079124450684 (2.635609785715739) | > loss_gen: 1.9217607975006104 (2.0985212326049805) | > loss_kl: 1.8792951107025146 (3.8880773385365806) | > loss_feat: 0.19900521636009216 (4.7049344678719835) | > loss_mel: 4.024412155151367 (16.431844075520832) | > loss_duration: 2.8300700187683105 (3.0349907080332437) | > loss_1: 10.854543685913086 (30.1583677927653) --> EVAL PERFORMANCE | > avg_loader_time: 0.010627428690592447 (-0.0053025881449381505) | > avg_loss_disc: 2.635609785715739 (+0.5243305762608843) | > avg_loss_disc_real_0: 0.2627990444501241 (+0.13497034149865308) | > avg_loss_disc_real_1: 0.27979478736718494 (+0.10368758936723071) | > avg_loss_disc_real_2: 0.2273586392402649 (+0.06716135392586389) | > avg_loss_disc_real_3: 0.22087948520978293 (+0.019396156072616577) | > avg_loss_disc_real_4: 0.22923287749290466 (+0.038640426471829414) | > avg_loss_disc_real_5: 0.20262317607800165 (-0.04771194607019427) | > avg_loss_0: 2.635609785715739 (+0.5243305762608843) | > avg_loss_gen: 2.0985212326049805 (-0.29517098267873143) | > avg_loss_kl: 3.8880773385365806 (-0.08921607335408499) | > avg_loss_feat: 4.7049344678719835 (-2.156226287285487) | > avg_loss_mel: 16.431844075520832 (-7.79334322611491) | > avg_loss_duration: 3.0349907080332437 (+0.06903076171875) | > avg_loss_1: 30.1583677927653 (-10.264925003051754)  > EPOCH: 637/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:00:27)   --> TIME: 2023-10-20 07:00:43 -- STEP: 19/50 -- GLOBAL_STEP: 84870 | > loss_disc: 2.648294448852539 (2.5017295636628805) | > loss_disc_real_0: 0.10153762251138687 (0.14821714084399373) | > loss_disc_real_1: 0.16582848131656647 (0.21929614677240974) | > loss_disc_real_2: 0.2192210555076599 (0.26416464502874176) | > loss_disc_real_3: 0.11591530591249466 (0.232302939813388) | > loss_disc_real_4: 0.23402580618858337 (0.24172576124730863) | > loss_disc_real_5: 0.23217245936393738 (0.2574001075209756) | > loss_0: 2.648294448852539 (2.5017295636628805) | > grad_norm_0: tensor(548.7419, device='cuda:0') (tensor(619.3480, device='cuda:0')) | > loss_gen: 1.8644002676010132 (2.2734721146131824) | > loss_kl: 0.9152965545654297 (0.8912781382861891) | > loss_feat: 4.865607738494873 (5.205366838919489) | > loss_mel: 23.508869171142578 (21.131174112621107) | > loss_duration: 1.580459475517273 (1.482072811377676) | > loss_1: 32.73463439941406 (30.983363954644453) | > grad_norm_1: tensor(4778.6968, device='cuda:0') (tensor(14244.9541, device='cuda:0')) | > current_lr_0: 0.00010577112385345496 | > current_lr_1: 0.00010577112385345496 | > step_time: 0.8221 (0.6240878105163574) | > loader_time: 0.0248 (0.021103545239097195)  --> TIME: 2023-10-20 07:01:03 -- STEP: 49/50 -- GLOBAL_STEP: 84900 | > loss_disc: 2.0114526748657227 (2.375659769895125) | > loss_disc_real_0: 0.020227503031492233 (0.12505212122080278) | > loss_disc_real_1: 0.08485826104879379 (0.2330484527866451) | > loss_disc_real_2: 0.2213728427886963 (0.23179140162407136) | > loss_disc_real_3: 0.19709976017475128 (0.21832398887799712) | > loss_disc_real_4: 0.2718316912651062 (0.22312758079901032) | > loss_disc_real_5: 0.2610955834388733 (0.2170408880148007) | > loss_0: 2.0114526748657227 (2.375659769895125) | > grad_norm_0: tensor(1997.1671, device='cuda:0') (tensor(612.2079, device='cuda:0')) | > loss_gen: 2.684600353240967 (2.4180832128135528) | > loss_kl: 0.5940486788749695 (0.8385829897027235) | > loss_feat: 4.458044528961182 (5.948076009446261) | > loss_mel: 26.53318977355957 (22.125887588578827) | > loss_duration: 1.5268832445144653 (1.441049836119827) | > loss_1: 35.7967643737793 (32.771679391666325) | > grad_norm_1: tensor(4191.8628, device='cuda:0') (tensor(17769.7148, device='cuda:0')) | > current_lr_0: 0.00010577112385345496 | > current_lr_1: 0.00010577112385345496 | > step_time: 0.42 (0.5989773370781722) | > loader_time: 0.7027 (0.038323626226308395)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9266157150268555 (2.9266157150268555) | > loss_disc_real_0: 0.26447436213493347 (0.26447436213493347) | > loss_disc_real_1: 0.285507470369339 (0.285507470369339) | > loss_disc_real_2: 0.23140060901641846 (0.23140060901641846) | > loss_disc_real_3: 0.2688080668449402 (0.2688080668449402) | > loss_disc_real_4: 0.2323213368654251 (0.2323213368654251) | > loss_disc_real_5: 0.33135756850242615 (0.33135756850242615) | > loss_0: 2.9266157150268555 (2.9266157150268555) | > loss_gen: 1.729122281074524 (1.729122281074524) | > loss_kl: 4.245121479034424 (4.245121479034424) | > loss_feat: 0.5569968223571777 (0.5569968223571777) | > loss_mel: 8.362214088439941 (8.362214088439941) | > loss_duration: 2.7828822135925293 (2.7828822135925293) | > loss_1: 17.67633628845215 (17.67633628845215)  --> STEP: 1 | > loss_disc: 2.41977596282959 (2.41977596282959) | > loss_disc_real_0: 0.33216947317123413 (0.33216947317123413) | > loss_disc_real_1: 0.25528261065483093 (0.25528261065483093) | > loss_disc_real_2: 0.11501634120941162 (0.11501634120941162) | > loss_disc_real_3: 0.1141008660197258 (0.1141008660197258) | > loss_disc_real_4: 0.24325965344905853 (0.24325965344905853) | > loss_disc_real_5: 0.3535187840461731 (0.3535187840461731) | > loss_0: 2.41977596282959 (2.41977596282959) | > loss_gen: 2.508709192276001 (2.508709192276001) | > loss_kl: 4.485898494720459 (4.485898494720459) | > loss_feat: 5.007453441619873 (5.007453441619873) | > loss_mel: 25.240474700927734 (25.240474700927734) | > loss_duration: 3.2268848419189453 (3.2268848419189453) | > loss_1: 40.46942138671875 (40.46942138671875)  --> STEP: 2 | > loss_disc: 3.3904662132263184 (2.905121088027954) | > loss_disc_real_0: 0.6685397028923035 (0.5003545880317688) | > loss_disc_real_1: 0.40956783294677734 (0.33242522180080414) | > loss_disc_real_2: 0.2595367729663849 (0.18727655708789825) | > loss_disc_real_3: 0.19935399293899536 (0.15672742947936058) | > loss_disc_real_4: 0.1932898759841919 (0.2182747647166252) | > loss_disc_real_5: 0.46238625049591064 (0.40795251727104187) | > loss_0: 3.3904662132263184 (2.905121088027954) | > loss_gen: 2.673316240310669 (2.591012716293335) | > loss_kl: 4.866876125335693 (4.676387310028076) | > loss_feat: 5.1445136070251465 (5.07598352432251) | > loss_mel: 29.685718536376953 (27.463096618652344) | > loss_duration: 2.9413933753967285 (3.084139108657837) | > loss_1: 45.31182098388672 (42.890621185302734)  --> STEP: 3 | > loss_disc: 2.7164573669433594 (2.842233180999756) | > loss_disc_real_0: 0.1264084279537201 (0.37570586800575256) | > loss_disc_real_1: 0.2884688675403595 (0.31777310371398926) | > loss_disc_real_2: 0.3116164803504944 (0.2287231981754303) | > loss_disc_real_3: 0.17394857108592987 (0.16246781001488367) | > loss_disc_real_4: 0.27795884013175964 (0.23816945652167001) | > loss_disc_real_5: 0.269086092710495 (0.36166370908419293) | > loss_0: 2.7164573669433594 (2.842233180999756) | > loss_gen: 2.0865657329559326 (2.422863721847534) | > loss_kl: 2.2422709465026855 (3.865015188852946) | > loss_feat: 4.679238319396973 (4.943735122680664) | > loss_mel: 21.25369644165039 (25.39329655965169) | > loss_duration: 2.8526229858398438 (3.006967067718506) | > loss_1: 33.11439514160156 (39.63187917073568) --> EVAL PERFORMANCE | > avg_loader_time: 0.025541226069132488 (+0.01491379737854004) | > avg_loss_disc: 2.842233180999756 (+0.20662339528401708) | > avg_loss_disc_real_0: 0.37570586800575256 (+0.11290682355562848) | > avg_loss_disc_real_1: 0.31777310371398926 (+0.03797831634680432) | > avg_loss_disc_real_2: 0.2287231981754303 (+0.0013645589351654053) | > avg_loss_disc_real_3: 0.16246781001488367 (-0.05841167519489926) | > avg_loss_disc_real_4: 0.23816945652167001 (+0.008936579028765351) | > avg_loss_disc_real_5: 0.36166370908419293 (+0.15904053300619128) | > avg_loss_0: 2.842233180999756 (+0.20662339528401708) | > avg_loss_gen: 2.422863721847534 (+0.3243424892425537) | > avg_loss_kl: 3.865015188852946 (-0.023062149683634736) | > avg_loss_feat: 4.943735122680664 (+0.2388006548086805) | > avg_loss_mel: 25.39329655965169 (+8.96145248413086) | > avg_loss_duration: 3.006967067718506 (-0.028023640314737808) | > avg_loss_1: 39.63187917073568 (+9.473511377970379)  > EPOCH: 638/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:01:19)   --> TIME: 2023-10-20 07:01:42 -- STEP: 29/50 -- GLOBAL_STEP: 84930 | > loss_disc: 2.6495206356048584 (2.333685196679214) | > loss_disc_real_0: 0.23824939131736755 (0.14233798482294743) | > loss_disc_real_1: 0.29502201080322266 (0.23149212141489162) | > loss_disc_real_2: 0.22931721806526184 (0.2039454000006462) | > loss_disc_real_3: 0.2820196747779846 (0.2259061977524182) | > loss_disc_real_4: 0.26502493023872375 (0.20498185707577343) | > loss_disc_real_5: 0.3332052230834961 (0.20537943187458763) | > loss_0: 2.6495206356048584 (2.333685196679214) | > grad_norm_0: tensor(564.5920, device='cuda:0') (tensor(702.7212, device='cuda:0')) | > loss_gen: 2.5063819885253906 (2.414427189991392) | > loss_kl: 0.7084330320358276 (0.9649653907479911) | > loss_feat: 3.093081474304199 (6.162039476478922) | > loss_mel: 15.860437393188477 (23.1887147097752) | > loss_duration: 1.415602207183838 (1.4503607051125889) | > loss_1: 23.58393669128418 (34.18050729817357) | > grad_norm_1: tensor(9887.3682, device='cuda:0') (tensor(25592.1602, device='cuda:0')) | > current_lr_0: 0.00010566539899290123 | > current_lr_1: 0.00010566539899290123 | > step_time: 0.8225 (0.5764094961100613) | > loader_time: 0.0235 (0.018326504477139176)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4073596000671387 (2.4073596000671387) | > loss_disc_real_0: 0.2347244918346405 (0.2347244918346405) | > loss_disc_real_1: 0.25498494505882263 (0.25498494505882263) | > loss_disc_real_2: 0.23249463737010956 (0.23249463737010956) | > loss_disc_real_3: 0.3576594293117523 (0.3576594293117523) | > loss_disc_real_4: 0.1500377655029297 (0.1500377655029297) | > loss_disc_real_5: 0.18254831433296204 (0.18254831433296204) | > loss_0: 2.4073596000671387 (2.4073596000671387) | > loss_gen: 2.5092341899871826 (2.5092341899871826) | > loss_kl: 3.4903106689453125 (3.4903106689453125) | > loss_feat: 5.506222248077393 (5.506222248077393) | > loss_mel: 21.967191696166992 (21.967191696166992) | > loss_duration: 2.738738536834717 (2.738738536834717) | > loss_1: 36.21169662475586 (36.21169662475586)  --> STEP: 1 | > loss_disc: 2.03709077835083 (2.03709077835083) | > loss_disc_real_0: 0.1351131796836853 (0.1351131796836853) | > loss_disc_real_1: 0.26824018359184265 (0.26824018359184265) | > loss_disc_real_2: 0.18932273983955383 (0.18932273983955383) | > loss_disc_real_3: 0.28007766604423523 (0.28007766604423523) | > loss_disc_real_4: 0.11759493499994278 (0.11759493499994278) | > loss_disc_real_5: 0.20735862851142883 (0.20735862851142883) | > loss_0: 2.03709077835083 (2.03709077835083) | > loss_gen: 2.675550699234009 (2.675550699234009) | > loss_kl: 4.759078025817871 (4.759078025817871) | > loss_feat: 5.6839680671691895 (5.6839680671691895) | > loss_mel: 23.700908660888672 (23.700908660888672) | > loss_duration: 2.9664931297302246 (2.9664931297302246) | > loss_1: 39.7859992980957 (39.7859992980957)  --> STEP: 2 | > loss_disc: 2.4485960006713867 (2.2428433895111084) | > loss_disc_real_0: 0.1739654839038849 (0.1545393317937851) | > loss_disc_real_1: 0.19974857568740845 (0.23399437963962555) | > loss_disc_real_2: 0.2517257630825043 (0.22052425146102905) | > loss_disc_real_3: 0.20242157578468323 (0.24124962091445923) | > loss_disc_real_4: 0.1877981275320053 (0.15269653126597404) | > loss_disc_real_5: 0.27434709668159485 (0.24085286259651184) | > loss_0: 2.4485960006713867 (2.2428433895111084) | > loss_gen: 2.216597557067871 (2.44607412815094) | > loss_kl: 4.589344501495361 (4.674211263656616) | > loss_feat: 6.291815280914307 (5.987891674041748) | > loss_mel: 23.54986572265625 (23.62538719177246) | > loss_duration: 2.9793379306793213 (2.972915530204773) | > loss_1: 39.6269645690918 (39.70648193359375)  --> STEP: 3 | > loss_disc: 2.50081729888916 (2.3288346926371255) | > loss_disc_real_0: 0.4384063482284546 (0.24916167060534158) | > loss_disc_real_1: 0.3433709740638733 (0.27045324444770813) | > loss_disc_real_2: 0.23293091356754303 (0.22465980549653372) | > loss_disc_real_3: 0.2595455050468445 (0.24734824895858765) | > loss_disc_real_4: 0.14636066555976868 (0.15058457603057226) | > loss_disc_real_5: 0.29158854484558105 (0.2577647566795349) | > loss_0: 2.50081729888916 (2.3288346926371255) | > loss_gen: 2.7279398441314697 (2.5400293668111167) | > loss_kl: 2.217111825942993 (3.855178117752075) | > loss_feat: 4.8903045654296875 (5.6220293045043945) | > loss_mel: 24.636138916015625 (23.962304433186848) | > loss_duration: 2.7797493934631348 (2.90852681795756) | > loss_1: 37.25124740600586 (38.88807042439779) --> EVAL PERFORMANCE | > avg_loader_time: 0.017434040705362957 (-0.008107185363769531) | > avg_loss_disc: 2.3288346926371255 (-0.5133984883626304) | > avg_loss_disc_real_0: 0.24916167060534158 (-0.12654419740041098) | > avg_loss_disc_real_1: 0.27045324444770813 (-0.04731985926628113) | > avg_loss_disc_real_2: 0.22465980549653372 (-0.004063392678896577) | > avg_loss_disc_real_3: 0.24734824895858765 (+0.08488043894370398) | > avg_loss_disc_real_4: 0.15058457603057226 (-0.08758488049109775) | > avg_loss_disc_real_5: 0.2577647566795349 (-0.10389895240465802) | > avg_loss_0: 2.3288346926371255 (-0.5133984883626304) | > avg_loss_gen: 2.5400293668111167 (+0.1171656449635825) | > avg_loss_kl: 3.855178117752075 (-0.00983707110087062) | > avg_loss_feat: 5.6220293045043945 (+0.6782941818237305) | > avg_loss_mel: 23.962304433186848 (-1.4309921264648438) | > avg_loss_duration: 2.90852681795756 (-0.09844024976094579) | > avg_loss_1: 38.88807042439779 (-0.7438087463378906)  > EPOCH: 639/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:02:10)   --> TIME: 2023-10-20 07:02:25 -- STEP: 9/50 -- GLOBAL_STEP: 84960 | > loss_disc: 2.7975246906280518 (2.1937428183025784) | > loss_disc_real_0: 0.14293140172958374 (0.1600316311750147) | > loss_disc_real_1: 0.2586963474750519 (0.21210675769382054) | > loss_disc_real_2: 0.18429246544837952 (0.19308924592203563) | > loss_disc_real_3: 0.4268113672733307 (0.2577507802181774) | > loss_disc_real_4: 0.2529044449329376 (0.16733559634950426) | > loss_disc_real_5: 0.3379707336425781 (0.1840882994648483) | > loss_0: 2.7975246906280518 (2.1937428183025784) | > grad_norm_0: tensor(340.9695, device='cuda:0') (tensor(570.8279, device='cuda:0')) | > loss_gen: 2.0447733402252197 (2.796540935834249) | > loss_kl: 1.099282145500183 (1.0296444164382086) | > loss_feat: 3.5312554836273193 (7.454796062575446) | > loss_mel: 22.00299072265625 (23.574508984883625) | > loss_duration: 1.3551366329193115 (1.4578205347061157) | > loss_1: 30.033437728881836 (36.31331147087945) | > grad_norm_1: tensor(4856.0249, device='cuda:0') (tensor(36547.1250, device='cuda:0')) | > current_lr_0: 0.000105559779810965 | > current_lr_1: 0.000105559779810965 | > step_time: 0.7758 (0.6147736973232694) | > loader_time: 0.027 (0.027493529849582247)  --> TIME: 2023-10-20 07:02:39 -- STEP: 39/50 -- GLOBAL_STEP: 84990 | > loss_disc: 2.96769380569458 (2.4479743517362156) | > loss_disc_real_0: 0.23389136791229248 (0.15366258266835645) | > loss_disc_real_1: 0.2724692225456238 (0.21292459936096117) | > loss_disc_real_2: 0.25943318009376526 (0.21423079278797674) | > loss_disc_real_3: 0.26052260398864746 (0.24800395991844246) | > loss_disc_real_4: 0.2299284189939499 (0.2043766951522766) | > loss_disc_real_5: 0.2825964093208313 (0.20477471390786844) | > loss_0: 2.96769380569458 (2.4479743517362156) | > grad_norm_0: tensor(285.0425, device='cuda:0') (tensor(704.3613, device='cuda:0')) | > loss_gen: 1.5955389738082886 (2.3122054185622782) | > loss_kl: 0.7864384055137634 (0.9092448781698178) | > loss_feat: 0.22500520944595337 (5.280353932808607) | > loss_mel: 12.216205596923828 (21.054946917753956) | > loss_duration: 1.5274076461791992 (1.4360456558374257) | > loss_1: 16.350597381591797 (30.992797117966884) | > grad_norm_1: tensor(14993.1436, device='cuda:0') (tensor(24802.1914, device='cuda:0')) | > current_lr_0: 0.000105559779810965 | > current_lr_1: 0.000105559779810965 | > step_time: 0.3401 (0.4797778863173265) | > loader_time: 0.0115 (0.013009535960662065)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9165377616882324 (2.9165377616882324) | > loss_disc_real_0: 0.21206532418727875 (0.21206532418727875) | > loss_disc_real_1: 0.25982531905174255 (0.25982531905174255) | > loss_disc_real_2: 0.234040766954422 (0.234040766954422) | > loss_disc_real_3: 0.26201438903808594 (0.26201438903808594) | > loss_disc_real_4: 0.3277670443058014 (0.3277670443058014) | > loss_disc_real_5: 0.36093467473983765 (0.36093467473983765) | > loss_0: 2.9165377616882324 (2.9165377616882324) | > loss_gen: 1.7909213304519653 (1.7909213304519653) | > loss_kl: 3.589839220046997 (3.589839220046997) | > loss_feat: 0.36981791257858276 (0.36981791257858276) | > loss_mel: 14.158323287963867 (14.158323287963867) | > loss_duration: 2.6838290691375732 (2.6838290691375732) | > loss_1: 22.592731475830078 (22.592731475830078)  --> STEP: 1 | > loss_disc: 2.802030086517334 (2.802030086517334) | > loss_disc_real_0: 0.09883695095777512 (0.09883695095777512) | > loss_disc_real_1: 0.22921200096607208 (0.22921200096607208) | > loss_disc_real_2: 0.32761067152023315 (0.32761067152023315) | > loss_disc_real_3: 0.28400713205337524 (0.28400713205337524) | > loss_disc_real_4: 0.32835254073143005 (0.32835254073143005) | > loss_disc_real_5: 0.3687165677547455 (0.3687165677547455) | > loss_0: 2.802030086517334 (2.802030086517334) | > loss_gen: 1.903354525566101 (1.903354525566101) | > loss_kl: 4.273891448974609 (4.273891448974609) | > loss_feat: 1.2814016342163086 (1.2814016342163086) | > loss_mel: 19.472185134887695 (19.472185134887695) | > loss_duration: 3.032100200653076 (3.032100200653076) | > loss_1: 29.962932586669922 (29.962932586669922)  --> STEP: 2 | > loss_disc: 2.212578296661377 (2.5073041915893555) | > loss_disc_real_0: 0.16360171139240265 (0.13121933117508888) | > loss_disc_real_1: 0.09671163558959961 (0.16296181827783585) | > loss_disc_real_2: 0.24894139170646667 (0.2882760316133499) | > loss_disc_real_3: 0.33839473128318787 (0.31120093166828156) | > loss_disc_real_4: 0.23766742646694183 (0.28300998359918594) | > loss_disc_real_5: 0.21484971046447754 (0.2917831391096115) | > loss_0: 2.212578296661377 (2.5073041915893555) | > loss_gen: 2.6470887660980225 (2.2752216458320618) | > loss_kl: 4.695059776306152 (4.484475612640381) | > loss_feat: 7.045367240905762 (4.163384437561035) | > loss_mel: 23.232364654541016 (21.352274894714355) | > loss_duration: 2.9573814868927 (2.994740843772888) | > loss_1: 40.57726287841797 (35.270097732543945)  --> STEP: 3 | > loss_disc: 2.902139186859131 (2.6389158566792807) | > loss_disc_real_0: 0.37702831625938416 (0.21315565953652063) | > loss_disc_real_1: 0.32148468494415283 (0.21580277383327484) | > loss_disc_real_2: 0.2309572696685791 (0.26916977763175964) | > loss_disc_real_3: 0.24675115942955017 (0.2897176742553711) | > loss_disc_real_4: 0.2984674572944641 (0.2881624748309453) | > loss_disc_real_5: 0.24736428260803223 (0.2769768536090851) | > loss_0: 2.902139186859131 (2.6389158566792807) | > loss_gen: 2.3308403491973877 (2.293761213620504) | > loss_kl: 1.859216570854187 (3.6093892653783164) | > loss_feat: 5.786142349243164 (4.704303741455078) | > loss_mel: 26.80660629272461 (23.170385360717773) | > loss_duration: 2.76250958442688 (2.9173304239908853) | > loss_1: 39.54531478881836 (36.695170084635414) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_85000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.057870864868164 (2.7436546087265015) | > loss_disc_real_0: 0.28791216015815735 (0.23184478469192982) | > loss_disc_real_1: 0.25326859951019287 (0.22516923025250435) | > loss_disc_real_2: 0.2434448003768921 (0.26273853331804276) | > loss_disc_real_3: 0.2658309042453766 (0.28374598175287247) | > loss_disc_real_4: 0.3366778790950775 (0.3002913258969784) | > loss_disc_real_5: 0.3749177157878876 (0.3014620691537857) | > loss_0: 3.057870864868164 (2.7436546087265015) | > loss_gen: 1.7381010055541992 (2.1548461616039276) | > loss_kl: 3.9472055435180664 (3.693843334913254) | > loss_feat: 0.08752921223640442 (3.5501101091504097) | > loss_mel: 1.8246569633483887 (17.833953261375427) | > loss_duration: 2.6319022178649902 (2.8459733724594116) | > loss_1: 10.229394912719727 (30.078726291656494)  --> STEP: 1 | > loss_disc: 2.847580909729004 (2.7644398689270018) | > loss_disc_real_0: 0.19661013782024384 (0.2247978553175926) | > loss_disc_real_1: 0.2544073760509491 (0.2310168594121933) | > loss_disc_real_2: 0.42100587487220764 (0.29439200162887574) | > loss_disc_real_3: 0.4819386303424835 (0.32338451147079467) | > loss_disc_real_4: 0.45579853653907776 (0.33139276802539824) | > loss_disc_real_5: 0.384712278842926 (0.31811211109161375) | > loss_0: 2.847580909729004 (2.7644398689270018) | > loss_gen: 3.098034143447876 (2.3434837579727175) | > loss_kl: 4.202988147735596 (3.795672297477722) | > loss_feat: 6.965728759765625 (4.233233839273453) | > loss_mel: 22.92416000366211 (18.851994609832765) | > loss_duration: 3.1022722721099854 (2.8972331523895263) | > loss_1: 40.293182373046875 (32.12161750793457)  --> STEP: 2 | > loss_disc: 2.4636425971984863 (2.7143069903055825) | > loss_disc_real_0: 0.1084652841091156 (0.2054090934495131) | > loss_disc_real_1: 0.12437790632247925 (0.21324370056390762) | > loss_disc_real_2: 0.1161220520734787 (0.2646803433696429) | > loss_disc_real_3: 0.1654130071401596 (0.2970559274156888) | > loss_disc_real_4: 0.09905549138784409 (0.2926698885858059) | > loss_disc_real_5: 0.057575393468141556 (0.2746893248210351) | > loss_0: 2.4636425971984863 (2.7143069903055825) | > loss_gen: 1.61281156539917 (2.2217050592104592) | > loss_kl: 4.468787670135498 (3.907858192920685) | > loss_feat: 10.675077438354492 (5.306874439120293) | > loss_mel: 24.653553009033203 (19.818921009699505) | > loss_duration: 3.0264437198638916 (2.9187682469685874) | > loss_1: 44.43667221069336 (34.174126625061035)  --> STEP: 3 | > loss_disc: 3.0036509037017822 (2.755641835076468) | > loss_disc_real_0: 0.2791123390197754 (0.21593812853097916) | > loss_disc_real_1: 0.16533982753753662 (0.2064002901315689) | > loss_disc_real_2: 0.1818666309118271 (0.2528498130185263) | > loss_disc_real_3: 0.17427600920200348 (0.27951593909944805) | > loss_disc_real_4: 0.5342304110527039 (0.3271785346525056) | > loss_disc_real_5: 0.5264487266540527 (0.31065495365432333) | > loss_0: 3.0036509037017822 (2.755641835076468) | > loss_gen: 2.2034358978271484 (2.2190951790128435) | > loss_kl: 2.1653342247009277 (3.6589261974607195) | > loss_feat: 5.207707405090332 (5.292707719973156) | > loss_mel: 22.498443603515625 (20.201709951673234) | > loss_duration: 2.8288323879241943 (2.9059202671051025) | > loss_1: 34.903751373291016 (34.27835873195103) --> EVAL PERFORMANCE | > avg_loader_time: 0.43062945774623324 (+0.41319541704087026) | > avg_loss_disc: 2.755641835076468 (+0.4268071424393427) | > avg_loss_disc_real_0: 0.21593812853097916 (-0.03322354207436243) | > avg_loss_disc_real_1: 0.2064002901315689 (-0.06405295431613922) | > avg_loss_disc_real_2: 0.2528498130185263 (+0.028190007521992605) | > avg_loss_disc_real_3: 0.27951593909944805 (+0.032167690140860405) | > avg_loss_disc_real_4: 0.3271785346525056 (+0.17659395862193336) | > avg_loss_disc_real_5: 0.31065495365432333 (+0.05289019697478842) | > avg_loss_0: 2.755641835076468 (+0.4268071424393427) | > avg_loss_gen: 2.2190951790128435 (-0.3209341877982732) | > avg_loss_kl: 3.6589261974607195 (-0.19625192029135574) | > avg_loss_feat: 5.292707719973156 (-0.3293215845312387) | > avg_loss_mel: 20.201709951673234 (-3.760594481513614) | > avg_loss_duration: 2.9059202671051025 (-0.0026065508524575343) | > avg_loss_1: 34.27835873195103 (-4.6097116924467585)  > EPOCH: 640/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:03:14)   --> TIME: 2023-10-20 07:03:33 -- STEP: 19/50 -- GLOBAL_STEP: 85020 | > loss_disc: 2.9929423332214355 (2.2983375348542867) | > loss_disc_real_0: 0.2708882689476013 (0.159347857103536) | > loss_disc_real_1: 0.23428355157375336 (0.21253010689427979) | > loss_disc_real_2: 0.2323993742465973 (0.19557541726451172) | > loss_disc_real_3: 0.236890971660614 (0.25271265081277017) | > loss_disc_real_4: 0.28242090344429016 (0.19520641461406885) | > loss_disc_real_5: 0.2949083149433136 (0.1896553399335397) | > loss_0: 2.9929423332214355 (2.2983375348542867) | > grad_norm_0: tensor(1033.6432, device='cuda:0') (tensor(651.4681, device='cuda:0')) | > loss_gen: 1.6001211404800415 (2.516322286505448) | > loss_kl: 0.6321281790733337 (0.7885395555119765) | > loss_feat: 0.07687337696552277 (6.631515437835141) | > loss_mel: 1.5743237733840942 (21.839817661988107) | > loss_duration: 1.5720726251602173 (1.4728448830152814) | > loss_1: 5.45551872253418 (33.24903959976999) | > grad_norm_1: tensor(34038.9414, device='cuda:0') (tensor(27151.4551, device='cuda:0')) | > current_lr_0: 0.00010545426620201387 | > current_lr_1: 0.00010545426620201387 | > step_time: 0.9162 (0.6626896481764945) | > loader_time: 0.0357 (0.023092884766428096)  --> TIME: 2023-10-20 07:03:50 -- STEP: 49/50 -- GLOBAL_STEP: 85050 | > loss_disc: 2.321566581726074 (2.425133746497485) | > loss_disc_real_0: 0.13079938292503357 (0.1566423356761129) | > loss_disc_real_1: 0.22751396894454956 (0.21572480730864466) | > loss_disc_real_2: 0.3779780864715576 (0.21380665286311082) | > loss_disc_real_3: 0.21654260158538818 (0.244479379331579) | > loss_disc_real_4: 0.38866233825683594 (0.21846874214100595) | > loss_disc_real_5: 0.14737580716609955 (0.21513780215945172) | > loss_0: 2.321566581726074 (2.425133746497485) | > grad_norm_0: tensor(415.3144, device='cuda:0') (tensor(617.5995, device='cuda:0')) | > loss_gen: 2.8607687950134277 (2.4081711501491307) | > loss_kl: 0.7708731293678284 (0.7549374508006232) | > loss_feat: 5.819436550140381 (5.884020183311434) | > loss_mel: 27.092594146728516 (21.119942465607) | > loss_duration: 1.6111817359924316 (1.4411182014309634) | > loss_1: 38.15485382080078 (31.60818944658552) | > grad_norm_1: tensor(17249.7617, device='cuda:0') (tensor(26987.5742, device='cuda:0')) | > current_lr_0: 0.00010545426620201387 | > current_lr_1: 0.00010545426620201387 | > step_time: 0.2611 (0.5924949840623506) | > loader_time: 0.4241 (0.026892851810066072)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.748018264770508 (2.748018264770508) | > loss_disc_real_0: 0.2210097461938858 (0.2210097461938858) | > loss_disc_real_1: 0.26382336020469666 (0.26382336020469666) | > loss_disc_real_2: 0.20874731242656708 (0.20874731242656708) | > loss_disc_real_3: 0.4628039002418518 (0.4628039002418518) | > loss_disc_real_4: 0.3281075060367584 (0.3281075060367584) | > loss_disc_real_5: 0.44940024614334106 (0.44940024614334106) | > loss_0: 2.748018264770508 (2.748018264770508) | > loss_gen: 3.344442844390869 (3.344442844390869) | > loss_kl: 3.496736764907837 (3.496736764907837) | > loss_feat: 6.099158763885498 (6.099158763885498) | > loss_mel: 21.602914810180664 (21.602914810180664) | > loss_duration: 2.6100001335144043 (2.6100001335144043) | > loss_1: 37.153255462646484 (37.153255462646484)  --> STEP: 1 | > loss_disc: 3.1556427478790283 (3.1556427478790283) | > loss_disc_real_0: 0.4718806743621826 (0.4718806743621826) | > loss_disc_real_1: 0.2663489282131195 (0.2663489282131195) | > loss_disc_real_2: 0.2770317792892456 (0.2770317792892456) | > loss_disc_real_3: 0.257009893655777 (0.257009893655777) | > loss_disc_real_4: 0.5701697468757629 (0.5701697468757629) | > loss_disc_real_5: 0.19587866961956024 (0.19587866961956024) | > loss_0: 3.1556427478790283 (3.1556427478790283) | > loss_gen: 2.2780749797821045 (2.2780749797821045) | > loss_kl: 4.331357955932617 (4.331357955932617) | > loss_feat: 6.843815803527832 (6.843815803527832) | > loss_mel: 23.210189819335938 (23.210189819335938) | > loss_duration: 3.0691213607788086 (3.0691213607788086) | > loss_1: 39.73256301879883 (39.73256301879883)  --> STEP: 2 | > loss_disc: 2.6209075450897217 (2.888275146484375) | > loss_disc_real_0: 0.1962767243385315 (0.33407869935035706) | > loss_disc_real_1: 0.20674744248390198 (0.23654818534851074) | > loss_disc_real_2: 0.16395743191242218 (0.2204946056008339) | > loss_disc_real_3: 0.20530495047569275 (0.23115742206573486) | > loss_disc_real_4: 0.15575110912322998 (0.36296042799949646) | > loss_disc_real_5: 0.19381360709667206 (0.19484613835811615) | > loss_0: 2.6209075450897217 (2.888275146484375) | > loss_gen: 1.7236607074737549 (2.0008678436279297) | > loss_kl: 4.801632404327393 (4.566495180130005) | > loss_feat: 6.630947113037109 (6.737381458282471) | > loss_mel: 17.49579429626465 (20.352992057800293) | > loss_duration: 2.9516427516937256 (3.010382056236267) | > loss_1: 33.603675842285156 (36.66811943054199)  --> STEP: 3 | > loss_disc: 2.936044454574585 (2.904198249181112) | > loss_disc_real_0: 0.44023147225379944 (0.36946295698483783) | > loss_disc_real_1: 0.2145756483078003 (0.22922400633494058) | > loss_disc_real_2: 0.2554989755153656 (0.2321627289056778) | > loss_disc_real_3: 0.3043631315231323 (0.2555593252182007) | > loss_disc_real_4: 0.19456584751605988 (0.30682890117168427) | > loss_disc_real_5: 0.2888023257255554 (0.22616486748059592) | > loss_0: 2.936044454574585 (2.904198249181112) | > loss_gen: 1.9947611093521118 (1.9988322655359905) | > loss_kl: 2.3943347930908203 (3.84244171778361) | > loss_feat: 1.0073424577713013 (4.827368458112081) | > loss_mel: 17.829408645629883 (19.511797587076824) | > loss_duration: 2.8494582176208496 (2.9567407766977944) | > loss_1: 26.075305938720703 (33.1371815999349) --> EVAL PERFORMANCE | > avg_loader_time: 0.0290679931640625 (-0.40156146458217074) | > avg_loss_disc: 2.904198249181112 (+0.1485564141046436) | > avg_loss_disc_real_0: 0.36946295698483783 (+0.15352482845385867) | > avg_loss_disc_real_1: 0.22922400633494058 (+0.022823716203371675) | > avg_loss_disc_real_2: 0.2321627289056778 (-0.02068708411284853) | > avg_loss_disc_real_3: 0.2555593252182007 (-0.02395661388124737) | > avg_loss_disc_real_4: 0.30682890117168427 (-0.02034963348082136) | > avg_loss_disc_real_5: 0.22616486748059592 (-0.08449008617372741) | > avg_loss_0: 2.904198249181112 (+0.1485564141046436) | > avg_loss_gen: 1.9988322655359905 (-0.220262913476853) | > avg_loss_kl: 3.84244171778361 (+0.18351552032289042) | > avg_loss_feat: 4.827368458112081 (-0.4653392618610752) | > avg_loss_mel: 19.511797587076824 (-0.6899123645964096) | > avg_loss_duration: 2.9567407766977944 (+0.05082050959269191) | > avg_loss_1: 33.1371815999349 (-1.1411771320161321)  > EPOCH: 641/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:04:02)   --> TIME: 2023-10-20 07:04:26 -- STEP: 29/50 -- GLOBAL_STEP: 85080 | > loss_disc: 2.888768196105957 (2.3241850302137177) | > loss_disc_real_0: 0.15395712852478027 (0.13376913534413126) | > loss_disc_real_1: 0.23641496896743774 (0.21221121053757339) | > loss_disc_real_2: 0.3091493844985962 (0.19876091785985847) | > loss_disc_real_3: 0.2737428843975067 (0.23622941778137768) | > loss_disc_real_4: 0.28396347165107727 (0.20335086284141088) | > loss_disc_real_5: 0.2709851861000061 (0.19885546514957114) | > loss_0: 2.888768196105957 (2.3241850302137177) | > grad_norm_0: tensor(320.9520, device='cuda:0') (tensor(573.9597, device='cuda:0')) | > loss_gen: 1.6909635066986084 (2.522924217684515) | > loss_kl: 0.2783396244049072 (0.9386197883507301) | > loss_feat: 0.46391719579696655 (6.1111356534449195) | > loss_mel: 17.97425651550293 (21.43992927362179) | > loss_duration: 1.3581167459487915 (1.4445712278629173) | > loss_1: 21.765592575073242 (32.45717997386538) | > grad_norm_1: tensor(11655.2334, device='cuda:0') (tensor(28873.3633, device='cuda:0')) | > current_lr_0: 0.00010534885806052101 | > current_lr_1: 0.00010534885806052101 | > step_time: 0.7776 (0.5778793055435707) | > loader_time: 0.0241 (0.018556594848632812)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7264699935913086 (2.7264699935913086) | > loss_disc_real_0: 0.20329426229000092 (0.20329426229000092) | > loss_disc_real_1: 0.2024957537651062 (0.2024957537651062) | > loss_disc_real_2: 0.26356807351112366 (0.26356807351112366) | > loss_disc_real_3: 0.16619892418384552 (0.16619892418384552) | > loss_disc_real_4: 0.19789138436317444 (0.19789138436317444) | > loss_disc_real_5: 0.33075186610221863 (0.33075186610221863) | > loss_0: 2.7264699935913086 (2.7264699935913086) | > loss_gen: 1.7340964078903198 (1.7340964078903198) | > loss_kl: 4.07014799118042 (4.07014799118042) | > loss_feat: 3.1700632572174072 (3.1700632572174072) | > loss_mel: 21.763795852661133 (21.763795852661133) | > loss_duration: 2.7430832386016846 (2.7430832386016846) | > loss_1: 33.48118591308594 (33.48118591308594)  --> STEP: 1 | > loss_disc: 3.091965436935425 (3.091965436935425) | > loss_disc_real_0: 0.30004310607910156 (0.30004310607910156) | > loss_disc_real_1: 0.1416294127702713 (0.1416294127702713) | > loss_disc_real_2: 0.2520093321800232 (0.2520093321800232) | > loss_disc_real_3: 0.2857803702354431 (0.2857803702354431) | > loss_disc_real_4: 0.4194900393486023 (0.4194900393486023) | > loss_disc_real_5: 0.4091515839099884 (0.4091515839099884) | > loss_0: 3.091965436935425 (3.091965436935425) | > loss_gen: 2.0469069480895996 (2.0469069480895996) | > loss_kl: 4.590054512023926 (4.590054512023926) | > loss_feat: 4.621145248413086 (4.621145248413086) | > loss_mel: 23.480628967285156 (23.480628967285156) | > loss_duration: 3.08736515045166 (3.08736515045166) | > loss_1: 37.82609939575195 (37.82609939575195)  --> STEP: 2 | > loss_disc: 2.481829881668091 (2.786897659301758) | > loss_disc_real_0: 0.5201040506362915 (0.41007357835769653) | > loss_disc_real_1: 0.08525767922401428 (0.11344354599714279) | > loss_disc_real_2: 0.15617956221103668 (0.20409444719552994) | > loss_disc_real_3: 0.16929380595684052 (0.22753708809614182) | > loss_disc_real_4: 0.2786322236061096 (0.34906113147735596) | > loss_disc_real_5: 0.238756000995636 (0.3239537924528122) | > loss_0: 2.481829881668091 (2.786897659301758) | > loss_gen: 2.4950709342956543 (2.270988941192627) | > loss_kl: 4.47251033782959 (4.531282424926758) | > loss_feat: 6.502538681030273 (5.56184196472168) | > loss_mel: 25.23029327392578 (24.35546112060547) | > loss_duration: 2.9959046840667725 (3.0416349172592163) | > loss_1: 41.69631576538086 (39.761207580566406)  --> STEP: 3 | > loss_disc: 3.132617712020874 (2.9021376768747964) | > loss_disc_real_0: 0.3401414752006531 (0.3867628773053487) | > loss_disc_real_1: 0.2030409276485443 (0.1433093398809433) | > loss_disc_real_2: 0.33457210659980774 (0.24758700033028921) | > loss_disc_real_3: 0.2301405519247055 (0.2284049093723297) | > loss_disc_real_4: 0.45553362369537354 (0.38455196221669513) | > loss_disc_real_5: 0.2821427285671234 (0.3100167711575826) | > loss_0: 3.132617712020874 (2.9021376768747964) | > loss_gen: 1.9830087423324585 (2.174995541572571) | > loss_kl: 2.4722063541412354 (3.844923734664917) | > loss_feat: 4.907718181610107 (5.343800703684489) | > loss_mel: 23.423255920410156 (24.0447260538737) | > loss_duration: 2.756382703781128 (2.9465508460998535) | > loss_1: 35.542572021484375 (38.35499572753906) --> EVAL PERFORMANCE | > avg_loader_time: 0.006724913914998372 (-0.02234307924906413) | > avg_loss_disc: 2.9021376768747964 (-0.0020605723063154002) | > avg_loss_disc_real_0: 0.3867628773053487 (+0.017299920320510864) | > avg_loss_disc_real_1: 0.1433093398809433 (-0.08591466645399728) | > avg_loss_disc_real_2: 0.24758700033028921 (+0.015424271424611419) | > avg_loss_disc_real_3: 0.2284049093723297 (-0.02715441584587097) | > avg_loss_disc_real_4: 0.38455196221669513 (+0.07772306104501087) | > avg_loss_disc_real_5: 0.3100167711575826 (+0.08385190367698667) | > avg_loss_0: 2.9021376768747964 (-0.0020605723063154002) | > avg_loss_gen: 2.174995541572571 (+0.17616327603658033) | > avg_loss_kl: 3.844923734664917 (+0.002482016881307114) | > avg_loss_feat: 5.343800703684489 (+0.5164322455724086) | > avg_loss_mel: 24.0447260538737 (+4.532928466796875) | > avg_loss_duration: 2.9465508460998535 (-0.010189930597940933) | > avg_loss_1: 38.35499572753906 (+5.217814127604164)  > EPOCH: 642/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:04:55)   --> TIME: 2023-10-20 07:05:08 -- STEP: 9/50 -- GLOBAL_STEP: 85110 | > loss_disc: 2.9306583404541016 (2.44842881626553) | > loss_disc_real_0: 0.09945081174373627 (0.17350077794657814) | > loss_disc_real_1: 0.23464199900627136 (0.20432406746678883) | > loss_disc_real_2: 0.22715887427330017 (0.21070334439476332) | > loss_disc_real_3: 0.2973138988018036 (0.2571459706458781) | > loss_disc_real_4: 0.29041627049446106 (0.20467893655101457) | > loss_disc_real_5: 0.30012649297714233 (0.1937129402326213) | > loss_0: 2.9306583404541016 (2.44842881626553) | > grad_norm_0: tensor(1027.4037, device='cuda:0') (tensor(650.9405, device='cuda:0')) | > loss_gen: 1.691129446029663 (2.172243674596151) | > loss_kl: 0.969744086265564 (0.8485399559140205) | > loss_feat: 2.196563482284546 (4.925278994772169) | > loss_mel: 18.517919540405273 (17.208444992701214) | > loss_duration: 1.3927967548370361 (1.4517308738496568) | > loss_1: 24.76815414428711 (26.606238471137154) | > grad_norm_1: tensor(6860.0464, device='cuda:0') (tensor(24854.2754, device='cuda:0')) | > current_lr_0: 0.00010524355528106514 | > current_lr_1: 0.00010524355528106514 | > step_time: 0.3445 (0.4507915708753798) | > loader_time: 0.0193 (0.02067708969116211)  --> TIME: 2023-10-20 07:05:32 -- STEP: 39/50 -- GLOBAL_STEP: 85140 | > loss_disc: 2.0566351413726807 (2.456006860121702) | > loss_disc_real_0: 0.05620332062244415 (0.16418599103314752) | > loss_disc_real_1: 0.16262750327587128 (0.22403468182071662) | > loss_disc_real_2: 0.14227019250392914 (0.21405524254227296) | > loss_disc_real_3: 0.15151892602443695 (0.22949879568738815) | > loss_disc_real_4: 0.1774941086769104 (0.23683942820972356) | > loss_disc_real_5: 0.11294572800397873 (0.2576851351903035) | > loss_0: 2.0566351413726807 (2.456006860121702) | > grad_norm_0: tensor(450.9025, device='cuda:0') (tensor(577.8206, device='cuda:0')) | > loss_gen: 1.9531362056732178 (2.3722873284266544) | > loss_kl: 0.593284010887146 (0.8023500559039605) | > loss_feat: 4.244627475738525 (5.306769725054694) | > loss_mel: 20.428308486938477 (20.00056471580114) | > loss_duration: 1.4886605739593506 (1.4228350352018309) | > loss_1: 28.708017349243164 (29.904806638375305) | > grad_norm_1: tensor(5413.3384, device='cuda:0') (tensor(20352.3027, device='cuda:0')) | > current_lr_0: 0.00010524355528106514 | > current_lr_1: 0.00010524355528106514 | > step_time: 0.3783 (0.7028946387462127) | > loader_time: 0.0337 (0.026538500419029824)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6406826972961426 (2.6406826972961426) | > loss_disc_real_0: 0.27677953243255615 (0.27677953243255615) | > loss_disc_real_1: 0.24433282017707825 (0.24433282017707825) | > loss_disc_real_2: 0.2481248676776886 (0.2481248676776886) | > loss_disc_real_3: 0.31558045744895935 (0.31558045744895935) | > loss_disc_real_4: 0.27687743306159973 (0.27687743306159973) | > loss_disc_real_5: 0.24999625980854034 (0.24999625980854034) | > loss_0: 2.6406826972961426 (2.6406826972961426) | > loss_gen: 2.6229336261749268 (2.6229336261749268) | > loss_kl: 4.176863670349121 (4.176863670349121) | > loss_feat: 4.397678852081299 (4.397678852081299) | > loss_mel: 13.097407341003418 (13.097407341003418) | > loss_duration: 2.7372796535491943 (2.7372796535491943) | > loss_1: 27.03216552734375 (27.03216552734375)  --> STEP: 1 | > loss_disc: 2.9447507858276367 (2.9447507858276367) | > loss_disc_real_0: 0.22149227559566498 (0.22149227559566498) | > loss_disc_real_1: 0.27433687448501587 (0.27433687448501587) | > loss_disc_real_2: 0.28116241097450256 (0.28116241097450256) | > loss_disc_real_3: 0.2944648265838623 (0.2944648265838623) | > loss_disc_real_4: 0.3088988661766052 (0.3088988661766052) | > loss_disc_real_5: 0.253135621547699 (0.253135621547699) | > loss_0: 2.9447507858276367 (2.9447507858276367) | > loss_gen: 1.7073049545288086 (1.7073049545288086) | > loss_kl: 5.119178295135498 (5.119178295135498) | > loss_feat: 0.18320180475711823 (0.18320180475711823) | > loss_mel: 11.1348237991333 (11.1348237991333) | > loss_duration: 3.165999174118042 (3.165999174118042) | > loss_1: 21.31050682067871 (21.31050682067871)  --> STEP: 2 | > loss_disc: 1.4954819679260254 (2.220116376876831) | > loss_disc_real_0: 0.06181906908750534 (0.14165567234158516) | > loss_disc_real_1: 0.11903993040323257 (0.19668840244412422) | > loss_disc_real_2: 0.14914347231388092 (0.21515294164419174) | > loss_disc_real_3: 0.21564443409442902 (0.25505463033914566) | > loss_disc_real_4: 0.11715437471866608 (0.21302662044763565) | > loss_disc_real_5: 0.06117899343371391 (0.15715730749070644) | > loss_0: 1.4954819679260254 (2.220116376876831) | > loss_gen: 3.222776174545288 (2.4650405645370483) | > loss_kl: 5.0900774002075195 (5.104627847671509) | > loss_feat: 9.459486961364746 (4.821344383060932) | > loss_mel: 26.472230911254883 (18.803527355194092) | > loss_duration: 3.0515224933624268 (3.1087608337402344) | > loss_1: 47.29609298706055 (34.30329990386963)  --> STEP: 3 | > loss_disc: 3.018968105316162 (2.486400286356608) | > loss_disc_real_0: 0.22343163192272186 (0.1689143255352974) | > loss_disc_real_1: 0.2736387252807617 (0.22233851005633673) | > loss_disc_real_2: 0.28038838505744934 (0.23689808944861093) | > loss_disc_real_3: 0.29433441162109375 (0.26814789076646167) | > loss_disc_real_4: 0.3085457384586334 (0.24486632645130157) | > loss_disc_real_5: 0.2531348466873169 (0.18914982055624327) | > loss_0: 3.018968105316162 (2.486400286356608) | > loss_gen: 1.6293251514434814 (2.186468760172526) | > loss_kl: 2.2183921337127686 (4.142549276351929) | > loss_feat: 0.022111324593424797 (3.2216000302384296) | > loss_mel: 1.808746337890625 (13.13860034942627) | > loss_duration: 2.76867413520813 (2.9953986008961997) | > loss_1: 8.447248458862305 (25.684616088867188) --> EVAL PERFORMANCE | > avg_loader_time: 0.012663841247558594 (+0.005938927332560222) | > avg_loss_disc: 2.486400286356608 (-0.4157373905181885) | > avg_loss_disc_real_0: 0.1689143255352974 (-0.2178485517700513) | > avg_loss_disc_real_1: 0.22233851005633673 (+0.07902917017539343) | > avg_loss_disc_real_2: 0.23689808944861093 (-0.010688910881678282) | > avg_loss_disc_real_3: 0.26814789076646167 (+0.03974298139413196) | > avg_loss_disc_real_4: 0.24486632645130157 (-0.13968563576539356) | > avg_loss_disc_real_5: 0.18914982055624327 (-0.12086695060133931) | > avg_loss_0: 2.486400286356608 (-0.4157373905181885) | > avg_loss_gen: 2.186468760172526 (+0.011473218599955093) | > avg_loss_kl: 4.142549276351929 (+0.2976255416870117) | > avg_loss_feat: 3.2216000302384296 (-2.1222006734460597) | > avg_loss_mel: 13.13860034942627 (-10.90612570444743) | > avg_loss_duration: 2.9953986008961997 (+0.04884775479634618) | > avg_loss_1: 25.684616088867188 (-12.670379638671875)  > EPOCH: 643/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:05:53)   --> TIME: 2023-10-20 07:06:09 -- STEP: 19/50 -- GLOBAL_STEP: 85170 | > loss_disc: 2.6427059173583984 (2.3173907932482267) | > loss_disc_real_0: 0.2432359904050827 (0.1458753887073774) | > loss_disc_real_1: 0.1978922188282013 (0.22746278992608973) | > loss_disc_real_2: 0.20527002215385437 (0.22629005814853467) | > loss_disc_real_3: 0.22428284585475922 (0.23099778886688382) | > loss_disc_real_4: 0.2602030038833618 (0.2087405069584125) | > loss_disc_real_5: 0.2565135061740875 (0.1946613521952378) | > loss_0: 2.6427059173583984 (2.3173907932482267) | > grad_norm_0: tensor(608.2676, device='cuda:0') (tensor(505.7901, device='cuda:0')) | > loss_gen: 2.0988729000091553 (2.444944331520482) | > loss_kl: 1.0220664739608765 (0.8001774800451178) | > loss_feat: 3.60524845123291 (6.017640678506148) | > loss_mel: 22.275218963623047 (20.86201572418213) | > loss_duration: 1.563501000404358 (1.468336073975814) | > loss_1: 30.564908981323242 (31.59311482780858) | > grad_norm_1: tensor(6334.0986, device='cuda:0') (tensor(31325.9082, device='cuda:0')) | > current_lr_0: 0.00010513835775833027 | > current_lr_1: 0.00010513835775833027 | > step_time: 0.7643 (0.625761772456922) | > loader_time: 0.0265 (0.02144069420663934)  --> TIME: 2023-10-20 07:06:30 -- STEP: 49/50 -- GLOBAL_STEP: 85200 | > loss_disc: 3.0116894245147705 (2.435534384785865) | > loss_disc_real_0: 0.3323797285556793 (0.15456075924543702) | > loss_disc_real_1: 0.3085014522075653 (0.22220442828019055) | > loss_disc_real_2: 0.2661181390285492 (0.2252258307167462) | > loss_disc_real_3: 0.3168877363204956 (0.23387360177478012) | > loss_disc_real_4: 0.2314765602350235 (0.22018739841498283) | > loss_disc_real_5: 0.2413586676120758 (0.23207851446100644) | > loss_0: 3.0116894245147705 (2.435534384785865) | > grad_norm_0: tensor(690.8331, device='cuda:0') (tensor(541.9260, device='cuda:0')) | > loss_gen: 1.69255530834198 (2.341076077247152) | > loss_kl: 0.6767433285713196 (0.7763321454427681) | > loss_feat: 0.11435266584157944 (5.421991458922928) | > loss_mel: 6.320772171020508 (20.372743803627642) | > loss_duration: 1.5878649950027466 (1.4239382159953216) | > loss_1: 10.392288208007812 (30.336081874613868) | > grad_norm_1: tensor(14630.6982, device='cuda:0') (tensor(21734.2832, device='cuda:0')) | > current_lr_0: 0.00010513835775833027 | > current_lr_1: 0.00010513835775833027 | > step_time: 0.3294 (0.6351485884919457) | > loader_time: 0.379 (0.029830772049573007)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.193619728088379 (2.193619728088379) | > loss_disc_real_0: 0.12417654693126678 (0.12417654693126678) | > loss_disc_real_1: 0.1786351352930069 (0.1786351352930069) | > loss_disc_real_2: 0.1544322967529297 (0.1544322967529297) | > loss_disc_real_3: 0.2544846832752228 (0.2544846832752228) | > loss_disc_real_4: 0.08620736747980118 (0.08620736747980118) | > loss_disc_real_5: 0.28693118691444397 (0.28693118691444397) | > loss_0: 2.193619728088379 (2.193619728088379) | > loss_gen: 2.1611196994781494 (2.1611196994781494) | > loss_kl: 4.448479652404785 (4.448479652404785) | > loss_feat: 5.826661109924316 (5.826661109924316) | > loss_mel: 22.7072696685791 (22.7072696685791) | > loss_duration: 2.7841405868530273 (2.7841405868530273) | > loss_1: 37.92767333984375 (37.92767333984375)  --> STEP: 1 | > loss_disc: 2.6676535606384277 (2.6676535606384277) | > loss_disc_real_0: 0.14813540875911713 (0.14813540875911713) | > loss_disc_real_1: 0.31901901960372925 (0.31901901960372925) | > loss_disc_real_2: 0.21014603972434998 (0.21014603972434998) | > loss_disc_real_3: 0.2585367262363434 (0.2585367262363434) | > loss_disc_real_4: 0.2378673106431961 (0.2378673106431961) | > loss_disc_real_5: 0.3585089147090912 (0.3585089147090912) | > loss_0: 2.6676535606384277 (2.6676535606384277) | > loss_gen: 2.2884349822998047 (2.2884349822998047) | > loss_kl: 4.81714391708374 (4.81714391708374) | > loss_feat: 3.9530675411224365 (3.9530675411224365) | > loss_mel: 23.512826919555664 (23.512826919555664) | > loss_duration: 3.111708879470825 (3.111708879470825) | > loss_1: 37.68318176269531 (37.68318176269531)  --> STEP: 2 | > loss_disc: 2.787675380706787 (2.7276644706726074) | > loss_disc_real_0: 0.29172468185424805 (0.2199300453066826) | > loss_disc_real_1: 0.27055636048316956 (0.2947876900434494) | > loss_disc_real_2: 0.23844507336616516 (0.22429555654525757) | > loss_disc_real_3: 0.30138492584228516 (0.27996082603931427) | > loss_disc_real_4: 0.24177275598049164 (0.23982003331184387) | > loss_disc_real_5: 0.2086251974105835 (0.28356705605983734) | > loss_0: 2.787675380706787 (2.7276644706726074) | > loss_gen: 1.8716400861740112 (2.080037534236908) | > loss_kl: 4.472116947174072 (4.644630432128906) | > loss_feat: 1.2192668914794922 (2.5861672163009644) | > loss_mel: 9.051480293273926 (16.282153606414795) | > loss_duration: 3.0758700370788574 (3.0937894582748413) | > loss_1: 19.69037437438965 (28.68677806854248)  --> STEP: 3 | > loss_disc: 2.9147305488586426 (2.7900198300679526) | > loss_disc_real_0: 0.4850842356681824 (0.3083147754271825) | > loss_disc_real_1: 0.3447472155094147 (0.3114408651987712) | > loss_disc_real_2: 0.1912039965391159 (0.21326503654321036) | > loss_disc_real_3: 0.3976096510887146 (0.31917710105578107) | > loss_disc_real_4: 0.32409051060676575 (0.2679101924101512) | > loss_disc_real_5: 0.30908095836639404 (0.2920716901620229) | > loss_0: 2.9147305488586426 (2.7900198300679526) | > loss_gen: 2.505338430404663 (2.2218044996261597) | > loss_kl: 2.1082165241241455 (3.799159129460653) | > loss_feat: 3.591245651245117 (2.9211933612823486) | > loss_mel: 22.81487274169922 (18.4597266515096) | > loss_duration: 2.800184726715088 (2.9959212144215903) | > loss_1: 33.81985855102539 (30.397804896036785) --> EVAL PERFORMANCE | > avg_loader_time: 0.005739688873291016 (-0.006924152374267578) | > avg_loss_disc: 2.7900198300679526 (+0.3036195437113447) | > avg_loss_disc_real_0: 0.3083147754271825 (+0.1394004498918851) | > avg_loss_disc_real_1: 0.3114408651987712 (+0.08910235514243445) | > avg_loss_disc_real_2: 0.21326503654321036 (-0.023633052905400576) | > avg_loss_disc_real_3: 0.31917710105578107 (+0.05102921028931939) | > avg_loss_disc_real_4: 0.2679101924101512 (+0.023043865958849608) | > avg_loss_disc_real_5: 0.2920716901620229 (+0.10292186960577962) | > avg_loss_0: 2.7900198300679526 (+0.3036195437113447) | > avg_loss_gen: 2.2218044996261597 (+0.035335739453633774) | > avg_loss_kl: 3.799159129460653 (-0.3433901468912759) | > avg_loss_feat: 2.9211933612823486 (-0.3004066689560809) | > avg_loss_mel: 18.4597266515096 (+5.321126302083332) | > avg_loss_duration: 2.9959212144215903 (+0.000522613525390625) | > avg_loss_1: 30.397804896036785 (+4.7131888071695975)  > EPOCH: 644/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:06:42)   --> TIME: 2023-10-20 07:07:09 -- STEP: 29/50 -- GLOBAL_STEP: 85230 | > loss_disc: 2.24873685836792 (2.5768802083771805) | > loss_disc_real_0: 0.09486527740955353 (0.15969367184001823) | > loss_disc_real_1: 0.25436219573020935 (0.2186111606143672) | > loss_disc_real_2: 0.2871801257133484 (0.21685244399925757) | > loss_disc_real_3: 0.19648633897304535 (0.24527847921026164) | > loss_disc_real_4: 0.17989186942577362 (0.2245748070036543) | > loss_disc_real_5: 0.089246466755867 (0.27300246156238284) | > loss_0: 2.24873685836792 (2.5768802083771805) | > grad_norm_0: tensor(1024.2802, device='cuda:0') (tensor(1129.7765, device='cuda:0')) | > loss_gen: 2.429607629776001 (2.200198749016071) | > loss_kl: 0.9044227600097656 (0.8754672253953999) | > loss_feat: 6.432961940765381 (5.139803932851245) | > loss_mel: 24.343320846557617 (21.61151657227812) | > loss_duration: 1.3902946710586548 (1.4354547426618378) | > loss_1: 35.500606536865234 (31.26244071434284) | > grad_norm_1: tensor(70021.4609, device='cuda:0') (tensor(37600.4336, device='cuda:0')) | > current_lr_0: 0.00010503326538710572 | > current_lr_1: 0.00010503326538710572 | > step_time: 1.2168 (0.7148563615207014) | > loader_time: 0.0449 (0.02409347994574185)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2213521003723145 (3.2213521003723145) | > loss_disc_real_0: 0.12151826918125153 (0.12151826918125153) | > loss_disc_real_1: 0.21976514160633087 (0.21976514160633087) | > loss_disc_real_2: 0.3467019200325012 (0.3467019200325012) | > loss_disc_real_3: 0.37706953287124634 (0.37706953287124634) | > loss_disc_real_4: 0.26261115074157715 (0.26261115074157715) | > loss_disc_real_5: 0.5766066908836365 (0.5766066908836365) | > loss_0: 3.2213521003723145 (3.2213521003723145) | > loss_gen: 1.9302643537521362 (1.9302643537521362) | > loss_kl: 4.692582130432129 (4.692582130432129) | > loss_feat: 5.460413455963135 (5.460413455963135) | > loss_mel: 25.88576889038086 (25.88576889038086) | > loss_duration: 2.7849297523498535 (2.7849297523498535) | > loss_1: 40.75395965576172 (40.75395965576172)  --> STEP: 1 | > loss_disc: 2.240177869796753 (2.240177869796753) | > loss_disc_real_0: 0.1335814744234085 (0.1335814744234085) | > loss_disc_real_1: 0.28712043166160583 (0.28712043166160583) | > loss_disc_real_2: 0.13968266546726227 (0.13968266546726227) | > loss_disc_real_3: 0.23992158472537994 (0.23992158472537994) | > loss_disc_real_4: 0.214515820145607 (0.214515820145607) | > loss_disc_real_5: 0.22146248817443848 (0.22146248817443848) | > loss_0: 2.240177869796753 (2.240177869796753) | > loss_gen: 2.2988412380218506 (2.2988412380218506) | > loss_kl: 4.885503768920898 (4.885503768920898) | > loss_feat: 7.339433193206787 (7.339433193206787) | > loss_mel: 22.048368453979492 (22.048368453979492) | > loss_duration: 3.081326961517334 (3.081326961517334) | > loss_1: 39.653472900390625 (39.653472900390625)  --> STEP: 2 | > loss_disc: 2.4779834747314453 (2.359080672264099) | > loss_disc_real_0: 0.10297859460115433 (0.11828003451228142) | > loss_disc_real_1: 0.31030961871147156 (0.2987150251865387) | > loss_disc_real_2: 0.24640147387981415 (0.1930420696735382) | > loss_disc_real_3: 0.3438551425933838 (0.29188836365938187) | > loss_disc_real_4: 0.45139822363853455 (0.33295702189207077) | > loss_disc_real_5: 0.37491101026535034 (0.2981867492198944) | > loss_0: 2.4779834747314453 (2.359080672264099) | > loss_gen: 3.4149997234344482 (2.8569204807281494) | > loss_kl: 4.76733922958374 (4.826421499252319) | > loss_feat: 8.27700424194336 (7.808218717575073) | > loss_mel: 25.84552764892578 (23.946948051452637) | > loss_duration: 3.029890775680542 (3.055608868598938) | > loss_1: 45.33476257324219 (42.494117736816406)  --> STEP: 3 | > loss_disc: 2.8742477893829346 (2.5308030446370444) | > loss_disc_real_0: 0.11788024008274078 (0.11814676970243454) | > loss_disc_real_1: 0.1480940878391266 (0.24850804607073465) | > loss_disc_real_2: 0.12337517738342285 (0.16981977224349976) | > loss_disc_real_3: 0.15646561980247498 (0.2467474490404129) | > loss_disc_real_4: 0.06031566485762596 (0.24207656954725584) | > loss_disc_real_5: 0.07750339806079865 (0.2246256321668625) | > loss_0: 2.8742477893829346 (2.5308030446370444) | > loss_gen: 1.3641715049743652 (2.359337488810221) | > loss_kl: 2.382927417755127 (4.011923472086589) | > loss_feat: 4.549068450927734 (6.721835295359294) | > loss_mel: 20.979351043701172 (22.957749048868816) | > loss_duration: 2.830657958984375 (2.9806252320607505) | > loss_1: 32.106178283691406 (39.031471252441406) --> EVAL PERFORMANCE | > avg_loader_time: 0.00816043217976888 (+0.002420743306477865) | > avg_loss_disc: 2.5308030446370444 (-0.2592167854309082) | > avg_loss_disc_real_0: 0.11814676970243454 (-0.19016800572474796) | > avg_loss_disc_real_1: 0.24850804607073465 (-0.06293281912803653) | > avg_loss_disc_real_2: 0.16981977224349976 (-0.0434452642997106) | > avg_loss_disc_real_3: 0.2467474490404129 (-0.07242965201536816) | > avg_loss_disc_real_4: 0.24207656954725584 (-0.02583362286289534) | > avg_loss_disc_real_5: 0.2246256321668625 (-0.0674460579951604) | > avg_loss_0: 2.5308030446370444 (-0.2592167854309082) | > avg_loss_gen: 2.359337488810221 (+0.13753298918406154) | > avg_loss_kl: 4.011923472086589 (+0.21276434262593602) | > avg_loss_feat: 6.721835295359294 (+3.8006419340769453) | > avg_loss_mel: 22.957749048868816 (+4.498022397359215) | > avg_loss_duration: 2.9806252320607505 (-0.015295982360839844) | > avg_loss_1: 39.031471252441406 (+8.633666356404621)  > EPOCH: 645/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:07:33)   --> TIME: 2023-10-20 07:07:47 -- STEP: 9/50 -- GLOBAL_STEP: 85260 | > loss_disc: 2.9653844833374023 (2.5475074847539267) | > loss_disc_real_0: 0.2052549123764038 (0.16095579726000628) | > loss_disc_real_1: 0.297190397977829 (0.2521979527340995) | > loss_disc_real_2: 0.25731411576271057 (0.2598237925105625) | > loss_disc_real_3: 0.2611768841743469 (0.24770558542675442) | > loss_disc_real_4: 0.29819899797439575 (0.23855280296670067) | > loss_disc_real_5: 0.2338971197605133 (0.219953500562244) | > loss_0: 2.9653844833374023 (2.5475074847539267) | > grad_norm_0: tensor(636.1708, device='cuda:0') (tensor(800.8572, device='cuda:0')) | > loss_gen: 1.5654867887496948 (2.3496015071868896) | > loss_kl: 0.7215709090232849 (0.787127392159568) | > loss_feat: 0.2604933977127075 (4.376017736064063) | > loss_mel: 7.071263313293457 (14.874215179019505) | > loss_duration: 1.4619951248168945 (1.4472461541493733) | > loss_1: 11.080809593200684 (23.834207852681477) | > grad_norm_1: tensor(13105.4180, device='cuda:0') (tensor(44684.5977, device='cuda:0')) | > current_lr_0: 0.00010492827806228597 | > current_lr_1: 0.00010492827806228597 | > step_time: 0.7514 (0.6245902379353842) | > loader_time: 0.0269 (0.021256897184583876)  --> TIME: 2023-10-20 07:08:00 -- STEP: 39/50 -- GLOBAL_STEP: 85290 | > loss_disc: 3.0362672805786133 (2.4978508674181423) | > loss_disc_real_0: 0.1914362907409668 (0.14489936045347115) | > loss_disc_real_1: 0.24471871554851532 (0.24287008322202241) | > loss_disc_real_2: 0.2655881345272064 (0.23236504989938858) | > loss_disc_real_3: 0.24299350380897522 (0.23186276528315666) | > loss_disc_real_4: 0.2616412341594696 (0.2472082277139028) | > loss_disc_real_5: 0.22524301707744598 (0.23587885537208655) | > loss_0: 3.0362672805786133 (2.4978508674181423) | > grad_norm_0: tensor(739.6095, device='cuda:0') (tensor(1193.0908, device='cuda:0')) | > loss_gen: 1.3966234922409058 (2.330042328590002) | > loss_kl: 0.5815302133560181 (0.7488412360350291) | > loss_feat: 0.056955065578222275 (5.031163216305849) | > loss_mel: 2.3759355545043945 (19.499163835476605) | > loss_duration: 1.489510178565979 (1.4334945709277422) | > loss_1: 5.900554180145264 (29.042705193544045) | > grad_norm_1: tensor(42956.8242, device='cuda:0') (tensor(35609.1172, device='cuda:0')) | > current_lr_0: 0.00010492827806228597 | > current_lr_1: 0.00010492827806228597 | > step_time: 0.4242 (0.485546350479126) | > loader_time: 0.0026 (0.013463032551300835)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2108306884765625 (2.2108306884765625) | > loss_disc_real_0: 0.22262829542160034 (0.22262829542160034) | > loss_disc_real_1: 0.30229002237319946 (0.30229002237319946) | > loss_disc_real_2: 0.28799447417259216 (0.28799447417259216) | > loss_disc_real_3: 0.22403252124786377 (0.22403252124786377) | > loss_disc_real_4: 0.2805842161178589 (0.2805842161178589) | > loss_disc_real_5: 0.15600687265396118 (0.15600687265396118) | > loss_0: 2.2108306884765625 (2.2108306884765625) | > loss_gen: 2.8208696842193604 (2.8208696842193604) | > loss_kl: 4.202752113342285 (4.202752113342285) | > loss_feat: 6.2768731117248535 (6.2768731117248535) | > loss_mel: 21.248462677001953 (21.248462677001953) | > loss_duration: 2.7980234622955322 (2.7980234622955322) | > loss_1: 37.346981048583984 (37.346981048583984)  --> STEP: 1 | > loss_disc: 1.7949120998382568 (1.7949120998382568) | > loss_disc_real_0: 0.15756499767303467 (0.15756499767303467) | > loss_disc_real_1: 0.18294642865657806 (0.18294642865657806) | > loss_disc_real_2: 0.11186191439628601 (0.11186191439628601) | > loss_disc_real_3: 0.2018401324748993 (0.2018401324748993) | > loss_disc_real_4: 0.09867864102125168 (0.09867864102125168) | > loss_disc_real_5: 0.09337723255157471 (0.09337723255157471) | > loss_0: 1.7949120998382568 (1.7949120998382568) | > loss_gen: 2.488062858581543 (2.488062858581543) | > loss_kl: 4.4713335037231445 (4.4713335037231445) | > loss_feat: 8.270565032958984 (8.270565032958984) | > loss_mel: 22.005495071411133 (22.005495071411133) | > loss_duration: 3.1496968269348145 (3.1496968269348145) | > loss_1: 40.385154724121094 (40.385154724121094)  --> STEP: 2 | > loss_disc: 1.6980971097946167 (1.7465046048164368) | > loss_disc_real_0: 0.4630773067474365 (0.3103211522102356) | > loss_disc_real_1: 0.11904256790876389 (0.15099449828267097) | > loss_disc_real_2: 0.14170975983142853 (0.12678583711385727) | > loss_disc_real_3: 0.1046367809176445 (0.1532384566962719) | > loss_disc_real_4: 0.04796977341175079 (0.07332420721650124) | > loss_disc_real_5: 0.037377648055553436 (0.06537744030356407) | > loss_0: 1.6980971097946167 (1.7465046048164368) | > loss_gen: 3.079601287841797 (2.78383207321167) | > loss_kl: 4.4580230712890625 (4.4646782875061035) | > loss_feat: 12.083109855651855 (10.17683744430542) | > loss_mel: 23.48862648010254 (22.747060775756836) | > loss_duration: 3.010246515274048 (3.079971671104431) | > loss_1: 46.11960983276367 (43.25238227844238)  --> STEP: 3 | > loss_disc: 3.2279560565948486 (2.2403217554092407) | > loss_disc_real_0: 0.3143596053123474 (0.3116673032442729) | > loss_disc_real_1: 0.35817569494247437 (0.2200548971692721) | > loss_disc_real_2: 0.38378795981407166 (0.21245321134726206) | > loss_disc_real_3: 0.38630539178848267 (0.23092743506034216) | > loss_disc_real_4: 0.3350112736225128 (0.16055322935183844) | > loss_disc_real_5: 0.5213744044303894 (0.21737642834583917) | > loss_0: 3.2279560565948486 (2.2403217554092407) | > loss_gen: 2.819162607192993 (2.795608917872111) | > loss_kl: 2.1717417240142822 (3.7003660996754966) | > loss_feat: 4.024758338928223 (8.126144409179688) | > loss_mel: 19.55304718017578 (21.682389577229817) | > loss_duration: 2.8181393146514893 (2.9926942189534507) | > loss_1: 31.38684844970703 (39.2972043355306) --> EVAL PERFORMANCE | > avg_loader_time: 0.007260243097941081 (-0.0009001890818277998) | > avg_loss_disc: 2.2403217554092407 (-0.2904812892278037) | > avg_loss_disc_real_0: 0.3116673032442729 (+0.19352053354183835) | > avg_loss_disc_real_1: 0.2200548971692721 (-0.028453148901462555) | > avg_loss_disc_real_2: 0.21245321134726206 (+0.0426334391037623) | > avg_loss_disc_real_3: 0.23092743506034216 (-0.01582001398007074) | > avg_loss_disc_real_4: 0.16055322935183844 (-0.0815233401954174) | > avg_loss_disc_real_5: 0.21737642834583917 (-0.0072492038210233145) | > avg_loss_0: 2.2403217554092407 (-0.2904812892278037) | > avg_loss_gen: 2.795608917872111 (+0.43627142906188965) | > avg_loss_kl: 3.7003660996754966 (-0.31155737241109227) | > avg_loss_feat: 8.126144409179688 (+1.4043091138203936) | > avg_loss_mel: 21.682389577229817 (-1.2753594716389998) | > avg_loss_duration: 2.9926942189534507 (+0.012068986892700195) | > avg_loss_1: 39.2972043355306 (+0.2657330830891951)  > EPOCH: 646/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:08:26)   --> TIME: 2023-10-20 07:08:43 -- STEP: 19/50 -- GLOBAL_STEP: 85320 | > loss_disc: 1.4490326642990112 (2.1682682100095247) | > loss_disc_real_0: 0.03853733837604523 (0.09925928839335316) | > loss_disc_real_1: 0.13553188741207123 (0.22964001172467283) | > loss_disc_real_2: 0.13352499902248383 (0.2249803143112283) | > loss_disc_real_3: 0.1064717099070549 (0.23820961227542475) | > loss_disc_real_4: 0.0445498451590538 (0.18138883419727025) | > loss_disc_real_5: 0.056629959493875504 (0.18888465172954297) | > loss_0: 1.4490326642990112 (2.1682682100095247) | > grad_norm_0: tensor(755.0942, device='cuda:0') (tensor(1092.8689, device='cuda:0')) | > loss_gen: 2.5935683250427246 (2.623783977408158) | > loss_kl: 0.8098781704902649 (0.8516741830267405) | > loss_feat: 11.00351619720459 (6.5601385870066125) | > loss_mel: 25.35248374938965 (23.040800966714556) | > loss_duration: 1.5836302042007446 (1.4679433421084755) | > loss_1: 41.343074798583984 (34.54434048502069) | > grad_norm_1: tensor(89299.8203, device='cuda:0') (tensor(72170.5703, device='cuda:0')) | > current_lr_0: 0.00010482339567887056 | > current_lr_1: 0.00010482339567887056 | > step_time: 0.7776 (0.6635437388169138) | > loader_time: 0.029 (0.023867230666311162)  --> TIME: 2023-10-20 07:09:05 -- STEP: 49/50 -- GLOBAL_STEP: 85350 | > loss_disc: 2.480564594268799 (2.3094597057420367) | > loss_disc_real_0: 0.058133166283369064 (0.12336628363296695) | > loss_disc_real_1: 0.3180276155471802 (0.2273195336515806) | > loss_disc_real_2: 0.19558604061603546 (0.21494460942185656) | > loss_disc_real_3: 0.29612278938293457 (0.2419046611354059) | > loss_disc_real_4: 0.28891000151634216 (0.20714773595028993) | > loss_disc_real_5: 0.19889673590660095 (0.20184110830138838) | > loss_0: 2.480564594268799 (2.3094597057420367) | > grad_norm_0: tensor(1765.4431, device='cuda:0') (tensor(1204.8679, device='cuda:0')) | > loss_gen: 2.040422201156616 (2.457133952452212) | > loss_kl: 0.5436680912971497 (0.7779284522545581) | > loss_feat: 3.561535596847534 (5.677615844131427) | > loss_mel: 23.849971771240234 (21.331717707672894) | > loss_duration: 1.5352095365524292 (1.431969975938602) | > loss_1: 31.530807495117188 (31.67636570638539) | > grad_norm_1: tensor(24096.8398, device='cuda:0') (tensor(49220.8906, device='cuda:0')) | > current_lr_0: 0.00010482339567887056 | > current_lr_1: 0.00010482339567887056 | > step_time: 0.7059 (0.6792954863334192) | > loader_time: 0.3699 (0.030287173329567423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.635129690170288 (2.635129690170288) | > loss_disc_real_0: 0.26764145493507385 (0.26764145493507385) | > loss_disc_real_1: 0.31835490465164185 (0.31835490465164185) | > loss_disc_real_2: 0.377672404050827 (0.377672404050827) | > loss_disc_real_3: 0.4068109691143036 (0.4068109691143036) | > loss_disc_real_4: 0.2669808566570282 (0.2669808566570282) | > loss_disc_real_5: 0.25446203351020813 (0.25446203351020813) | > loss_0: 2.635129690170288 (2.635129690170288) | > loss_gen: 2.921452760696411 (2.921452760696411) | > loss_kl: 3.7789981365203857 (3.7789981365203857) | > loss_feat: 7.831605434417725 (7.831605434417725) | > loss_mel: 24.988285064697266 (24.988285064697266) | > loss_duration: 2.7782857418060303 (2.7782857418060303) | > loss_1: 42.29862594604492 (42.29862594604492)  --> STEP: 1 | > loss_disc: 2.7099738121032715 (2.7099738121032715) | > loss_disc_real_0: 0.14747191965579987 (0.14747191965579987) | > loss_disc_real_1: 0.272987425327301 (0.272987425327301) | > loss_disc_real_2: 0.3306046724319458 (0.3306046724319458) | > loss_disc_real_3: 0.1838151514530182 (0.1838151514530182) | > loss_disc_real_4: 0.278914213180542 (0.278914213180542) | > loss_disc_real_5: 0.13467997312545776 (0.13467997312545776) | > loss_0: 2.7099738121032715 (2.7099738121032715) | > loss_gen: 2.105036973953247 (2.105036973953247) | > loss_kl: 4.660642147064209 (4.660642147064209) | > loss_feat: 3.8671019077301025 (3.8671019077301025) | > loss_mel: 21.105724334716797 (21.105724334716797) | > loss_duration: 3.1431124210357666 (3.1431124210357666) | > loss_1: 34.88161849975586 (34.88161849975586)  --> STEP: 2 | > loss_disc: 2.8921492099761963 (2.801061511039734) | > loss_disc_real_0: 0.0530826598405838 (0.10027728974819183) | > loss_disc_real_1: 0.12067093700170517 (0.1968291811645031) | > loss_disc_real_2: 0.19329684972763062 (0.2619507610797882) | > loss_disc_real_3: 0.246507927775383 (0.2151615396142006) | > loss_disc_real_4: 0.3624192774295807 (0.32066674530506134) | > loss_disc_real_5: 0.3561389446258545 (0.24540945887565613) | > loss_0: 2.8921492099761963 (2.801061511039734) | > loss_gen: 2.0887210369110107 (2.096879005432129) | > loss_kl: 4.72227144241333 (4.6914567947387695) | > loss_feat: 8.844134330749512 (6.355618119239807) | > loss_mel: 28.712247848510742 (24.90898609161377) | > loss_duration: 2.9973690509796143 (3.0702407360076904) | > loss_1: 47.36474609375 (41.12318229675293)  --> STEP: 3 | > loss_disc: 3.058661699295044 (2.8869282404581704) | > loss_disc_real_0: 0.14536479115486145 (0.11530645688374837) | > loss_disc_real_1: 0.26957133412361145 (0.22107656548420587) | > loss_disc_real_2: 0.17655156552791595 (0.23348436256249747) | > loss_disc_real_3: 0.2731892764568329 (0.2345041185617447) | > loss_disc_real_4: 0.22473199665546417 (0.2886884957551956) | > loss_disc_real_5: 0.2370046079158783 (0.2426078418890635) | > loss_0: 3.058661699295044 (2.8869282404581704) | > loss_gen: 1.3188530206680298 (1.8375370105107625) | > loss_kl: 1.969800591468811 (3.78423806031545) | > loss_feat: 0.032032422721385956 (4.247756220400333) | > loss_mel: 2.076464891433716 (17.298145691553753) | > loss_duration: 2.8687822818756104 (3.0030879179636636) | > loss_1: 8.2659330368042 (30.17076587677002) --> EVAL PERFORMANCE | > avg_loader_time: 0.01833955446879069 (+0.01107931137084961) | > avg_loss_disc: 2.8869282404581704 (+0.6466064850489297) | > avg_loss_disc_real_0: 0.11530645688374837 (-0.19636084636052453) | > avg_loss_disc_real_1: 0.22107656548420587 (+0.0010216683149337769) | > avg_loss_disc_real_2: 0.23348436256249747 (+0.02103115121523541) | > avg_loss_disc_real_3: 0.2345041185617447 (+0.0035766835014025278) | > avg_loss_disc_real_4: 0.2886884957551956 (+0.12813526640335718) | > avg_loss_disc_real_5: 0.2426078418890635 (+0.025231413543224335) | > avg_loss_0: 2.8869282404581704 (+0.6466064850489297) | > avg_loss_gen: 1.8375370105107625 (-0.9580719073613484) | > avg_loss_kl: 3.78423806031545 (+0.08387196063995361) | > avg_loss_feat: 4.247756220400333 (-3.878388188779354) | > avg_loss_mel: 17.298145691553753 (-4.384243885676064) | > avg_loss_duration: 3.0030879179636636 (+0.01039369901021292) | > avg_loss_1: 30.17076587677002 (-9.126438458760582)  > EPOCH: 647/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:09:22)   --> TIME: 2023-10-20 07:09:39 -- STEP: 29/50 -- GLOBAL_STEP: 85380 | > loss_disc: 2.687774658203125 (2.463144832643969) | > loss_disc_real_0: 0.2018454372882843 (0.15857942787737683) | > loss_disc_real_1: 0.23455864191055298 (0.21433378036679893) | > loss_disc_real_2: 0.30959346890449524 (0.2523080994342936) | > loss_disc_real_3: 0.32588401436805725 (0.25053532026579667) | > loss_disc_real_4: 0.3958856165409088 (0.22073589836985902) | > loss_disc_real_5: 0.2931451201438904 (0.2308363452039916) | > loss_0: 2.687774658203125 (2.463144832643969) | > grad_norm_0: tensor(1145.6409, device='cuda:0') (tensor(1100.9811, device='cuda:0')) | > loss_gen: 2.3850767612457275 (2.424653546563511) | > loss_kl: 0.4355822801589966 (0.8841005173222772) | > loss_feat: 2.764413595199585 (5.846976497499593) | > loss_mel: 23.07097816467285 (21.045807493144068) | > loss_duration: 1.4409596920013428 (1.4387194329294666) | > loss_1: 30.097009658813477 (31.640257029697814) | > grad_norm_1: tensor(10116.6631, device='cuda:0') (tensor(42645.8789, device='cuda:0')) | > current_lr_0: 0.00010471861813196401 | > current_lr_1: 0.00010471861813196401 | > step_time: 0.5818 (0.3999011105504529) | > loader_time: 0.0025 (0.007359422486403893)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2639811038970947 (2.2639811038970947) | > loss_disc_real_0: 0.27154403924942017 (0.27154403924942017) | > loss_disc_real_1: 0.4029071033000946 (0.4029071033000946) | > loss_disc_real_2: 0.20736339688301086 (0.20736339688301086) | > loss_disc_real_3: 0.346054345369339 (0.346054345369339) | > loss_disc_real_4: 0.16153782606124878 (0.16153782606124878) | > loss_disc_real_5: 0.20348380506038666 (0.20348380506038666) | > loss_0: 2.2639811038970947 (2.2639811038970947) | > loss_gen: 3.698277473449707 (3.698277473449707) | > loss_kl: 4.131624221801758 (4.131624221801758) | > loss_feat: 9.058156967163086 (9.058156967163086) | > loss_mel: 23.75753402709961 (23.75753402709961) | > loss_duration: 2.8450703620910645 (2.8450703620910645) | > loss_1: 43.49066162109375 (43.49066162109375)  --> STEP: 1 | > loss_disc: 2.460434675216675 (2.460434675216675) | > loss_disc_real_0: 0.13121230900287628 (0.13121230900287628) | > loss_disc_real_1: 0.14061012864112854 (0.14061012864112854) | > loss_disc_real_2: 0.30575302243232727 (0.30575302243232727) | > loss_disc_real_3: 0.2963823080062866 (0.2963823080062866) | > loss_disc_real_4: 0.3168887197971344 (0.3168887197971344) | > loss_disc_real_5: 0.35273680090904236 (0.35273680090904236) | > loss_0: 2.460434675216675 (2.460434675216675) | > loss_gen: 2.683788776397705 (2.683788776397705) | > loss_kl: 4.300752639770508 (4.300752639770508) | > loss_feat: 5.785722732543945 (5.785722732543945) | > loss_mel: 26.225202560424805 (26.225202560424805) | > loss_duration: 3.0498526096343994 (3.0498526096343994) | > loss_1: 42.045318603515625 (42.045318603515625)  --> STEP: 2 | > loss_disc: 3.0249197483062744 (2.7426772117614746) | > loss_disc_real_0: 0.2486594021320343 (0.1899358555674553) | > loss_disc_real_1: 0.26499542593955994 (0.20280277729034424) | > loss_disc_real_2: 0.27778804302215576 (0.2917705327272415) | > loss_disc_real_3: 0.26962190866470337 (0.283002108335495) | > loss_disc_real_4: 0.22579236328601837 (0.2713405415415764) | > loss_disc_real_5: 0.33765414357185364 (0.345195472240448) | > loss_0: 3.0249197483062744 (2.7426772117614746) | > loss_gen: 1.6176159381866455 (2.1507023572921753) | > loss_kl: 4.472691059112549 (4.386721849441528) | > loss_feat: 0.01685905084013939 (2.9012908916920424) | > loss_mel: 0.9394912123680115 (13.582346886396408) | > loss_duration: 2.941779851913452 (2.995816230773926) | > loss_1: 9.98843765258789 (26.016878128051758)  --> STEP: 3 | > loss_disc: 2.2203176021575928 (2.568557341893514) | > loss_disc_real_0: 0.1546151340007782 (0.17816228171189627) | > loss_disc_real_1: 0.13654205203056335 (0.18071586887041727) | > loss_disc_real_2: 0.16325202584266663 (0.2489310304323832) | > loss_disc_real_3: 0.1871790587902069 (0.251061091820399) | > loss_disc_real_4: 0.20821627974510193 (0.2502991209427516) | > loss_disc_real_5: 0.12877139449119568 (0.2730541129906972) | > loss_0: 2.2203176021575928 (2.568557341893514) | > loss_gen: 2.334164619445801 (2.2118564446767173) | > loss_kl: 2.201961040496826 (3.658468246459961) | > loss_feat: 6.784812927246094 (4.195798236876726) | > loss_mel: 23.86899185180664 (17.011228541533153) | > loss_duration: 2.8080403804779053 (2.9332242806752524) | > loss_1: 37.99797058105469 (30.010575612386067) --> EVAL PERFORMANCE | > avg_loader_time: 0.017954031626383465 (-0.00038552284240722656) | > avg_loss_disc: 2.568557341893514 (-0.3183708985646563) | > avg_loss_disc_real_0: 0.17816228171189627 (+0.0628558248281479) | > avg_loss_disc_real_1: 0.18071586887041727 (-0.040360696613788605) | > avg_loss_disc_real_2: 0.2489310304323832 (+0.015446667869885744) | > avg_loss_disc_real_3: 0.251061091820399 (+0.016556973258654295) | > avg_loss_disc_real_4: 0.2502991209427516 (-0.03838937481244403) | > avg_loss_disc_real_5: 0.2730541129906972 (+0.0304462711016337) | > avg_loss_0: 2.568557341893514 (-0.3183708985646563) | > avg_loss_gen: 2.2118564446767173 (+0.3743194341659548) | > avg_loss_kl: 3.658468246459961 (-0.12576981385548924) | > avg_loss_feat: 4.195798236876726 (-0.051957983523607254) | > avg_loss_mel: 17.011228541533153 (-0.28691715002059937) | > avg_loss_duration: 2.9332242806752524 (-0.06986363728841116) | > avg_loss_1: 30.010575612386067 (-0.160190264383953)  > EPOCH: 648/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:10:10)   --> TIME: 2023-10-20 07:10:21 -- STEP: 9/50 -- GLOBAL_STEP: 85410 | > loss_disc: 2.0771141052246094 (2.2468915118111505) | > loss_disc_real_0: 0.029997579753398895 (0.11417701053950521) | > loss_disc_real_1: 0.13071517646312714 (0.17890459961361355) | > loss_disc_real_2: 0.18060988187789917 (0.17954065816269982) | > loss_disc_real_3: 0.2567062973976135 (0.2133193233360847) | > loss_disc_real_4: 0.10211122035980225 (0.15592796810799175) | > loss_disc_real_5: 0.20378246903419495 (0.17636390589177608) | > loss_0: 2.0771141052246094 (2.2468915118111505) | > grad_norm_0: tensor(759.5787, device='cuda:0') (tensor(929.9037, device='cuda:0')) | > loss_gen: 2.191437005996704 (2.4192039436764188) | > loss_kl: 0.5275810956954956 (0.8905098405149248) | > loss_feat: 4.989936351776123 (7.1736228995853) | > loss_mel: 19.254228591918945 (21.690127266777885) | > loss_duration: 1.4129598140716553 (1.450717528661092) | > loss_1: 28.376142501831055 (33.62418195936415) | > grad_norm_1: tensor(7726.8071, device='cuda:0') (tensor(53259.1016, device='cuda:0')) | > current_lr_0: 0.00010461394531677563 | > current_lr_1: 0.00010461394531677563 | > step_time: 0.5759 (0.6585057576497396) | > loader_time: 0.0151 (0.023962444729275174)  --> TIME: 2023-10-20 07:10:39 -- STEP: 39/50 -- GLOBAL_STEP: 85440 | > loss_disc: 2.725611686706543 (2.3146681357652708) | > loss_disc_real_0: 0.03364383429288864 (0.128225182589048) | > loss_disc_real_1: 0.33871954679489136 (0.21047620694988814) | > loss_disc_real_2: 0.3246029317378998 (0.20931402632059196) | > loss_disc_real_3: 0.2752991318702698 (0.2171284687729218) | > loss_disc_real_4: 0.31018969416618347 (0.19928428693077502) | > loss_disc_real_5: 0.5224809646606445 (0.2162726340481104) | > loss_0: 2.725611686706543 (2.3146681357652708) | > grad_norm_0: tensor(1265.7725, device='cuda:0') (tensor(1030.4169, device='cuda:0')) | > loss_gen: 2.330949306488037 (2.4390066128510695) | > loss_kl: 0.4163656234741211 (0.8174743958008595) | > loss_feat: 3.8067078590393066 (6.248513083045297) | > loss_mel: 18.63838005065918 (22.233875506963486) | > loss_duration: 1.5113587379455566 (1.4394290355535655) | > loss_1: 26.70376205444336 (33.178298852382554) | > grad_norm_1: tensor(13410.4932, device='cuda:0') (tensor(43867.9844, device='cuda:0')) | > current_lr_0: 0.00010461394531677563 | > current_lr_1: 0.00010461394531677563 | > step_time: 0.3249 (0.6035305842375144) | > loader_time: 0.0028 (0.019595812528561324)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8211376667022705 (2.8211376667022705) | > loss_disc_real_0: 0.21950092911720276 (0.21950092911720276) | > loss_disc_real_1: 0.2747792899608612 (0.2747792899608612) | > loss_disc_real_2: 0.35688087344169617 (0.35688087344169617) | > loss_disc_real_3: 0.3313894271850586 (0.3313894271850586) | > loss_disc_real_4: 0.38381779193878174 (0.38381779193878174) | > loss_disc_real_5: 0.3000774681568146 (0.3000774681568146) | > loss_0: 2.8211376667022705 (2.8211376667022705) | > loss_gen: 2.4916458129882812 (2.4916458129882812) | > loss_kl: 4.013260841369629 (4.013260841369629) | > loss_feat: 6.41658878326416 (6.41658878326416) | > loss_mel: 22.16008949279785 (22.16008949279785) | > loss_duration: 2.720684051513672 (2.720684051513672) | > loss_1: 37.802268981933594 (37.802268981933594)  --> STEP: 1 | > loss_disc: 2.9120748043060303 (2.9120748043060303) | > loss_disc_real_0: 0.29916781187057495 (0.29916781187057495) | > loss_disc_real_1: 0.2935360372066498 (0.2935360372066498) | > loss_disc_real_2: 0.2985250949859619 (0.2985250949859619) | > loss_disc_real_3: 0.3036702275276184 (0.3036702275276184) | > loss_disc_real_4: 0.3040004074573517 (0.3040004074573517) | > loss_disc_real_5: 0.362579882144928 (0.362579882144928) | > loss_0: 2.9120748043060303 (2.9120748043060303) | > loss_gen: 2.28084659576416 (2.28084659576416) | > loss_kl: 3.915496349334717 (3.915496349334717) | > loss_feat: 1.2972230911254883 (1.2972230911254883) | > loss_mel: 20.402156829833984 (20.402156829833984) | > loss_duration: 3.034160614013672 (3.034160614013672) | > loss_1: 30.929882049560547 (30.929882049560547)  --> STEP: 2 | > loss_disc: 2.977478504180908 (2.9447766542434692) | > loss_disc_real_0: 0.29676854610443115 (0.29796817898750305) | > loss_disc_real_1: 0.28129813075065613 (0.28741708397865295) | > loss_disc_real_2: 0.3249070644378662 (0.31171607971191406) | > loss_disc_real_3: 0.2690105736255646 (0.2863404005765915) | > loss_disc_real_4: 0.2751444876194 (0.28957244753837585) | > loss_disc_real_5: 0.3406153619289398 (0.3515976220369339) | > loss_0: 2.977478504180908 (2.9447766542434692) | > loss_gen: 1.9771987199783325 (2.1290226578712463) | > loss_kl: 4.516149997711182 (4.215823173522949) | > loss_feat: 0.6033095121383667 (0.9502663016319275) | > loss_mel: 16.28976821899414 (18.345962524414062) | > loss_duration: 2.973271608352661 (3.0037161111831665) | > loss_1: 26.359699249267578 (28.644790649414062)  --> STEP: 3 | > loss_disc: 3.0498898029327393 (2.979814370473226) | > loss_disc_real_0: 0.3905907869338989 (0.3288423816363017) | > loss_disc_real_1: 0.27160361409187317 (0.2821459273497264) | > loss_disc_real_2: 0.2741079330444336 (0.2991800308227539) | > loss_disc_real_3: 0.26013079285621643 (0.2776038646697998) | > loss_disc_real_4: 0.27092090249061584 (0.2833552658557892) | > loss_disc_real_5: 0.33740565180778503 (0.3468669652938843) | > loss_0: 3.0498898029327393 (2.979814370473226) | > loss_gen: 1.8049370050430298 (2.0209941069285073) | > loss_kl: 2.1902599334716797 (3.540635426839193) | > loss_feat: 0.007591585163027048 (0.636041396142294) | > loss_mel: 2.2107505798339844 (12.96755854288737) | > loss_duration: 2.74528431892395 (2.9175721804300943) | > loss_1: 8.958823204040527 (22.08280150095622) --> EVAL PERFORMANCE | > avg_loader_time: 0.025313297907511394 (+0.00735926628112793) | > avg_loss_disc: 2.979814370473226 (+0.4112570285797119) | > avg_loss_disc_real_0: 0.3288423816363017 (+0.15068009992440543) | > avg_loss_disc_real_1: 0.2821459273497264 (+0.10143005847930911) | > avg_loss_disc_real_2: 0.2991800308227539 (+0.050249000390370696) | > avg_loss_disc_real_3: 0.2776038646697998 (+0.02654277284940082) | > avg_loss_disc_real_4: 0.2833552658557892 (+0.0330561449130376) | > avg_loss_disc_real_5: 0.3468669652938843 (+0.07381285230318707) | > avg_loss_0: 2.979814370473226 (+0.4112570285797119) | > avg_loss_gen: 2.0209941069285073 (-0.19086233774820993) | > avg_loss_kl: 3.540635426839193 (-0.11783281962076808) | > avg_loss_feat: 0.636041396142294 (-3.559756840734432) | > avg_loss_mel: 12.96755854288737 (-4.043669998645784) | > avg_loss_duration: 2.9175721804300943 (-0.015652100245158174) | > avg_loss_1: 22.08280150095622 (-7.927774111429848)  > EPOCH: 649/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:10:57)   --> TIME: 2023-10-20 07:11:22 -- STEP: 19/50 -- GLOBAL_STEP: 85470 | > loss_disc: 1.6149181127548218 (2.273227964576922) | > loss_disc_real_0: 0.012901632115244865 (0.11952041633623212) | > loss_disc_real_1: 0.1494743973016739 (0.2020461382834535) | > loss_disc_real_2: 0.238418847322464 (0.21951891119150738) | > loss_disc_real_3: 0.27777138352394104 (0.22704603091666573) | > loss_disc_real_4: 0.08051378279924393 (0.21042346875918538) | > loss_disc_real_5: 0.029479511082172394 (0.208122557176179) | > loss_0: 1.6149181127548218 (2.273227964576922) | > grad_norm_0: tensor(882.9255, device='cuda:0') (tensor(1311.6758, device='cuda:0')) | > loss_gen: 2.9710702896118164 (2.5441595504158423) | > loss_kl: 0.7986993193626404 (0.8455791598872134) | > loss_feat: 9.619622230529785 (6.136829032709724) | > loss_mel: 23.58963966369629 (21.1645985402559) | > loss_duration: 1.5232290029525757 (1.5134174886502718) | > loss_1: 38.50225830078125 (32.20458354448017) | > grad_norm_1: tensor(78109.0547, device='cuda:0') (tensor(67552.1797, device='cuda:0')) | > current_lr_0: 0.00010450937712861954 | > current_lr_1: 0.00010450937712861954 | > step_time: 0.7892 (0.6545385686974776) | > loader_time: 0.035 (0.025093630740517063)  --> TIME: 2023-10-20 07:11:40 -- STEP: 49/50 -- GLOBAL_STEP: 85500 | > loss_disc: 2.5131449699401855 (2.40536683554552) | > loss_disc_real_0: 0.016704779118299484 (0.1338342894819014) | > loss_disc_real_1: 0.2542473077774048 (0.2187986176232902) | > loss_disc_real_2: 0.07040689885616302 (0.21652672470224146) | > loss_disc_real_3: 0.27836501598358154 (0.23455521179249092) | > loss_disc_real_4: 0.27548104524612427 (0.22303191519209317) | > loss_disc_real_5: 0.2721097469329834 (0.23142588760095592) | > loss_0: 2.5131449699401855 (2.40536683554552) | > grad_norm_0: tensor(2315.9417, device='cuda:0') (tensor(1233.1841, device='cuda:0')) | > loss_gen: 1.9129397869110107 (2.3365344417338467) | > loss_kl: 0.6115821599960327 (0.7862189272228552) | > loss_feat: 2.1773998737335205 (5.351091081390575) | > loss_mel: 22.08993911743164 (21.33951886819333) | > loss_duration: 1.5568017959594727 (1.4528523513248988) | > loss_1: 28.348663330078125 (31.26621556768612) | > grad_norm_1: tensor(7969.9780, device='cuda:0') (tensor(40887.7383, device='cuda:0')) | > current_lr_0: 0.00010450937712861954 | > current_lr_1: 0.00010450937712861954 | > step_time: 0.6212 (0.6060721630952797) | > loader_time: 0.4252 (0.02966398608927824)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.598776340484619 (2.598776340484619) | > loss_disc_real_0: 0.2649885416030884 (0.2649885416030884) | > loss_disc_real_1: 0.19690819084644318 (0.19690819084644318) | > loss_disc_real_2: 0.3010497987270355 (0.3010497987270355) | > loss_disc_real_3: 0.294437050819397 (0.294437050819397) | > loss_disc_real_4: 0.34724947810173035 (0.34724947810173035) | > loss_disc_real_5: 0.2535635232925415 (0.2535635232925415) | > loss_0: 2.598776340484619 (2.598776340484619) | > loss_gen: 2.628833532333374 (2.628833532333374) | > loss_kl: 3.954724073410034 (3.954724073410034) | > loss_feat: 6.839717864990234 (6.839717864990234) | > loss_mel: 24.06650733947754 (24.06650733947754) | > loss_duration: 2.8119192123413086 (2.8119192123413086) | > loss_1: 40.30170440673828 (40.30170440673828)  --> STEP: 1 | > loss_disc: 2.6244993209838867 (2.6244993209838867) | > loss_disc_real_0: 0.09809386730194092 (0.09809386730194092) | > loss_disc_real_1: 0.1924760937690735 (0.1924760937690735) | > loss_disc_real_2: 0.29310086369514465 (0.29310086369514465) | > loss_disc_real_3: 0.3834017217159271 (0.3834017217159271) | > loss_disc_real_4: 0.27201783657073975 (0.27201783657073975) | > loss_disc_real_5: 0.42647016048431396 (0.42647016048431396) | > loss_0: 2.6244993209838867 (2.6244993209838867) | > loss_gen: 2.4099342823028564 (2.4099342823028564) | > loss_kl: 4.860745906829834 (4.860745906829834) | > loss_feat: 5.431807994842529 (5.431807994842529) | > loss_mel: 21.991247177124023 (21.991247177124023) | > loss_duration: 3.0206730365753174 (3.0206730365753174) | > loss_1: 37.71440887451172 (37.71440887451172)  --> STEP: 2 | > loss_disc: 2.5570125579833984 (2.5907559394836426) | > loss_disc_real_0: 0.15627145767211914 (0.12718266248703003) | > loss_disc_real_1: 0.23008540272712708 (0.21128074824810028) | > loss_disc_real_2: 0.23323823511600494 (0.2631695494055748) | > loss_disc_real_3: 0.2975882887840271 (0.3404950052499771) | > loss_disc_real_4: 0.34164008498191833 (0.30682896077632904) | > loss_disc_real_5: 0.36772140860557556 (0.39709578454494476) | > loss_0: 2.5570125579833984 (2.5907559394836426) | > loss_gen: 2.2988579273223877 (2.354396104812622) | > loss_kl: 4.636866092681885 (4.748805999755859) | > loss_feat: 2.7296106815338135 (4.080709338188171) | > loss_mel: 24.95762825012207 (23.474437713623047) | > loss_duration: 2.918097972869873 (2.969385504722595) | > loss_1: 37.54106140136719 (37.62773513793945)  --> STEP: 3 | > loss_disc: 2.906033754348755 (2.69584854443868) | > loss_disc_real_0: 0.48558080196380615 (0.24664870897928873) | > loss_disc_real_1: 0.22058206796646118 (0.21438118815422058) | > loss_disc_real_2: 0.23087716102600098 (0.25240541994571686) | > loss_disc_real_3: 0.21663857996463776 (0.299209530154864) | > loss_disc_real_4: 0.34549960494041443 (0.31971917549769086) | > loss_disc_real_5: 0.32860061526298523 (0.37426406145095825) | > loss_0: 2.906033754348755 (2.69584854443868) | > loss_gen: 2.174022674560547 (2.29427162806193) | > loss_kl: 1.884289026260376 (3.7939670085906982) | > loss_feat: 2.2360663414001465 (3.4658283392588296) | > loss_mel: 19.33664894104004 (22.09517478942871) | > loss_duration: 2.816746711730957 (2.918505907058716) | > loss_1: 28.447772979736328 (34.56774775187174) --> EVAL PERFORMANCE | > avg_loader_time: 0.016442298889160156 (-0.008870999018351238) | > avg_loss_disc: 2.69584854443868 (-0.2839658260345459) | > avg_loss_disc_real_0: 0.24664870897928873 (-0.08219367265701297) | > avg_loss_disc_real_1: 0.21438118815422058 (-0.0677647391955058) | > avg_loss_disc_real_2: 0.25240541994571686 (-0.04677461087703705) | > avg_loss_disc_real_3: 0.299209530154864 (+0.021605665485064207) | > avg_loss_disc_real_4: 0.31971917549769086 (+0.03636390964190167) | > avg_loss_disc_real_5: 0.37426406145095825 (+0.027397096157073975) | > avg_loss_0: 2.69584854443868 (-0.2839658260345459) | > avg_loss_gen: 2.29427162806193 (+0.27327752113342285) | > avg_loss_kl: 3.7939670085906982 (+0.2533315817515054) | > avg_loss_feat: 3.4658283392588296 (+2.8297869431165354) | > avg_loss_mel: 22.09517478942871 (+9.127616246541342) | > avg_loss_duration: 2.918505907058716 (+0.0009337266286215673) | > avg_loss_1: 34.56774775187174 (+12.484946250915524)  > EPOCH: 650/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:11:57)   --> TIME: 2023-10-20 07:12:20 -- STEP: 29/50 -- GLOBAL_STEP: 85530 | > loss_disc: 2.3887546062469482 (2.443950114579036) | > loss_disc_real_0: 0.23203720152378082 (0.16319542153385186) | > loss_disc_real_1: 0.07580843567848206 (0.21073302254080772) | > loss_disc_real_2: 0.10834764689207077 (0.21698413513086992) | > loss_disc_real_3: 0.24495191872119904 (0.24119287639342504) | > loss_disc_real_4: 0.30997660756111145 (0.21748400879381546) | > loss_disc_real_5: 0.1952958106994629 (0.22346202630935044) | > loss_0: 2.3887546062469482 (2.443950114579036) | > grad_norm_0: tensor(815.1923, device='cuda:0') (tensor(1195.1967, device='cuda:0')) | > loss_gen: 2.15040922164917 (2.283851142587333) | > loss_kl: 0.7932502627372742 (0.8714147333441109) | > loss_feat: 6.6379547119140625 (5.310983891502537) | > loss_mel: 24.52362823486328 (18.987010347432104) | > loss_duration: 1.4680100679397583 (1.4627094762078647) | > loss_1: 35.5732536315918 (28.91596981574749) | > grad_norm_1: tensor(12677.0596, device='cuda:0') (tensor(49956.3633, device='cuda:0')) | > current_lr_0: 0.00010440491346291444 | > current_lr_1: 0.00010440491346291444 | > step_time: 0.381 (0.604103162370879) | > loader_time: 0.002 (0.01821918323122222)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3285040855407715 (2.3285040855407715) | > loss_disc_real_0: 0.1236560270190239 (0.1236560270190239) | > loss_disc_real_1: 0.19167526066303253 (0.19167526066303253) | > loss_disc_real_2: 0.3823389410972595 (0.3823389410972595) | > loss_disc_real_3: 0.26316070556640625 (0.26316070556640625) | > loss_disc_real_4: 0.3294743299484253 (0.3294743299484253) | > loss_disc_real_5: 0.34548360109329224 (0.34548360109329224) | > loss_0: 2.3285040855407715 (2.3285040855407715) | > loss_gen: 3.2070446014404297 (3.2070446014404297) | > loss_kl: 4.244858264923096 (4.244858264923096) | > loss_feat: 5.044264316558838 (5.044264316558838) | > loss_mel: 26.688241958618164 (26.688241958618164) | > loss_duration: 2.7402448654174805 (2.7402448654174805) | > loss_1: 41.92465591430664 (41.92465591430664)  --> STEP: 1 | > loss_disc: 3.0072429180145264 (3.0072429180145264) | > loss_disc_real_0: 0.3179340362548828 (0.3179340362548828) | > loss_disc_real_1: 0.2637159526348114 (0.2637159526348114) | > loss_disc_real_2: 0.262559175491333 (0.262559175491333) | > loss_disc_real_3: 0.28259459137916565 (0.28259459137916565) | > loss_disc_real_4: 0.25725889205932617 (0.25725889205932617) | > loss_disc_real_5: 0.2518852949142456 (0.2518852949142456) | > loss_0: 3.0072429180145264 (3.0072429180145264) | > loss_gen: 1.6428059339523315 (1.6428059339523315) | > loss_kl: 4.0820770263671875 (4.0820770263671875) | > loss_feat: 0.13551951944828033 (0.13551951944828033) | > loss_mel: 4.6048583984375 (4.6048583984375) | > loss_duration: 3.0507683753967285 (3.0507683753967285) | > loss_1: 13.516029357910156 (13.516029357910156)  --> STEP: 2 | > loss_disc: 2.5004987716674805 (2.7538708448410034) | > loss_disc_real_0: 0.08495670557022095 (0.20144537091255188) | > loss_disc_real_1: 0.27321669459342957 (0.2684663236141205) | > loss_disc_real_2: 0.27124348282814026 (0.26690132915973663) | > loss_disc_real_3: 0.2892492711544037 (0.28592193126678467) | > loss_disc_real_4: 0.2460593581199646 (0.2516591250896454) | > loss_disc_real_5: 0.279994398355484 (0.2659398466348648) | > loss_0: 2.5004987716674805 (2.7538708448410034) | > loss_gen: 2.1695597171783447 (1.9061828255653381) | > loss_kl: 4.827141761779785 (4.454609394073486) | > loss_feat: 3.789506435394287 (1.9625129774212837) | > loss_mel: 27.118745803833008 (15.861802101135254) | > loss_duration: 2.9280927181243896 (2.989430546760559) | > loss_1: 40.833045959472656 (27.174537658691406)  --> STEP: 3 | > loss_disc: 2.5950815677642822 (2.7009410858154297) | > loss_disc_real_0: 0.14872150123119354 (0.18387074768543243) | > loss_disc_real_1: 0.3408616781234741 (0.2925981084505717) | > loss_disc_real_2: 0.2884482443332672 (0.27408363421758014) | > loss_disc_real_3: 0.4020446240901947 (0.3246294955412547) | > loss_disc_real_4: 0.20818732678890228 (0.23716852565606436) | > loss_disc_real_5: 0.2739419639110565 (0.268607219060262) | > loss_0: 2.5950815677642822 (2.7009410858154297) | > loss_gen: 2.442878484725952 (2.085081378618876) | > loss_kl: 2.061037302017212 (3.656752030054728) | > loss_feat: 4.427600860595703 (2.7842089384794235) | > loss_mel: 23.751211166381836 (18.491605122884113) | > loss_duration: 2.818868398666382 (2.9325764973958335) | > loss_1: 35.50159454345703 (29.950223286946613) --> EVAL PERFORMANCE | > avg_loader_time: 0.014351685841878256 (-0.0020906130472819005) | > avg_loss_disc: 2.7009410858154297 (+0.0050925413767495264) | > avg_loss_disc_real_0: 0.18387074768543243 (-0.0627779612938563) | > avg_loss_disc_real_1: 0.2925981084505717 (+0.07821692029635113) | > avg_loss_disc_real_2: 0.27408363421758014 (+0.021678214271863283) | > avg_loss_disc_real_3: 0.3246294955412547 (+0.025419965386390686) | > avg_loss_disc_real_4: 0.23716852565606436 (-0.0825506498416265) | > avg_loss_disc_real_5: 0.268607219060262 (-0.10565684239069623) | > avg_loss_0: 2.7009410858154297 (+0.0050925413767495264) | > avg_loss_gen: 2.085081378618876 (-0.2091902494430542) | > avg_loss_kl: 3.656752030054728 (-0.1372149785359702) | > avg_loss_feat: 2.7842089384794235 (-0.6816194007794061) | > avg_loss_mel: 18.491605122884113 (-3.6035696665445975) | > avg_loss_duration: 2.9325764973958335 (+0.014070590337117661) | > avg_loss_1: 29.950223286946613 (-4.617524464925129)  > EPOCH: 651/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:12:47)   --> TIME: 2023-10-20 07:12:56 -- STEP: 9/50 -- GLOBAL_STEP: 85560 | > loss_disc: 2.5719974040985107 (2.620979282591078) | > loss_disc_real_0: 0.07019934058189392 (0.22680229644498062) | > loss_disc_real_1: 0.25606462359428406 (0.2276613658501042) | > loss_disc_real_2: 0.2846519351005554 (0.286797442783912) | > loss_disc_real_3: 0.3470624089241028 (0.24564648750755522) | > loss_disc_real_4: 0.3274780809879303 (0.24747088158296215) | > loss_disc_real_5: 0.3376502990722656 (0.22809195021788278) | > loss_0: 2.5719974040985107 (2.620979282591078) | > grad_norm_0: tensor(454.7869, device='cuda:0') (tensor(1107.7156, device='cuda:0')) | > loss_gen: 2.3990960121154785 (2.230264915360345) | > loss_kl: 0.8738420605659485 (0.945617847972446) | > loss_feat: 3.857478141784668 (4.993814065224594) | > loss_mel: 18.443941116333008 (19.020896328820122) | > loss_duration: 1.4078933000564575 (1.4376393291685317) | > loss_1: 26.98225212097168 (28.62823247909546) | > grad_norm_1: tensor(6342.7427, device='cuda:0') (tensor(40477.7500, device='cuda:0')) | > current_lr_0: 0.00010430055421518365 | > current_lr_1: 0.00010430055421518365 | > step_time: 0.5214 (0.6076768239339193) | > loader_time: 0.0095 (0.024216519461737737)  --> TIME: 2023-10-20 07:13:17 -- STEP: 39/50 -- GLOBAL_STEP: 85590 | > loss_disc: 2.245640993118286 (2.525027079459948) | > loss_disc_real_0: 0.09022778272628784 (0.17079854049146748) | > loss_disc_real_1: 0.2681300640106201 (0.2230347425509722) | > loss_disc_real_2: 0.2201913595199585 (0.2392224647486821) | > loss_disc_real_3: 0.19606339931488037 (0.2331147965712425) | > loss_disc_real_4: 0.2992921471595764 (0.24676212157385471) | > loss_disc_real_5: 0.1861310452222824 (0.23754159743205094) | > loss_0: 2.245640993118286 (2.525027079459948) | > grad_norm_0: tensor(2121.1494, device='cuda:0') (tensor(1154.9401, device='cuda:0')) | > loss_gen: 2.426084041595459 (2.233096663768475) | > loss_kl: 0.5229825377464294 (0.8440267139902482) | > loss_feat: 5.282649517059326 (5.0534173271212826) | > loss_mel: 22.135116577148438 (21.34781767771794) | > loss_duration: 1.4601619243621826 (1.435631058154962) | > loss_1: 31.826993942260742 (30.913989837353046) | > grad_norm_1: tensor(47888., device='cuda:0') (tensor(40336.1719, device='cuda:0')) | > current_lr_0: 0.00010430055421518365 | > current_lr_1: 0.00010430055421518365 | > step_time: 0.3729 (0.6563822795183231) | > loader_time: 0.0034 (0.024392458108755257)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9125800132751465 (2.9125800132751465) | > loss_disc_real_0: 0.22760507464408875 (0.22760507464408875) | > loss_disc_real_1: 0.3104374408721924 (0.3104374408721924) | > loss_disc_real_2: 0.22322455048561096 (0.22322455048561096) | > loss_disc_real_3: 0.27683377265930176 (0.27683377265930176) | > loss_disc_real_4: 0.29434359073638916 (0.29434359073638916) | > loss_disc_real_5: 0.29132023453712463 (0.29132023453712463) | > loss_0: 2.9125800132751465 (2.9125800132751465) | > loss_gen: 1.7437626123428345 (1.7437626123428345) | > loss_kl: 3.8178231716156006 (3.8178231716156006) | > loss_feat: 0.2749616503715515 (0.2749616503715515) | > loss_mel: 13.630785942077637 (13.630785942077637) | > loss_duration: 2.8171305656433105 (2.8171305656433105) | > loss_1: 22.284465789794922 (22.284465789794922)  --> STEP: 1 | > loss_disc: 2.4636993408203125 (2.4636993408203125) | > loss_disc_real_0: 0.11476312577724457 (0.11476312577724457) | > loss_disc_real_1: 0.15572912991046906 (0.15572912991046906) | > loss_disc_real_2: 0.3477240204811096 (0.3477240204811096) | > loss_disc_real_3: 0.2336479276418686 (0.2336479276418686) | > loss_disc_real_4: 0.32381221652030945 (0.32381221652030945) | > loss_disc_real_5: 0.28347915410995483 (0.28347915410995483) | > loss_0: 2.4636993408203125 (2.4636993408203125) | > loss_gen: 2.408604860305786 (2.408604860305786) | > loss_kl: 4.540985107421875 (4.540985107421875) | > loss_feat: 7.3271331787109375 (7.3271331787109375) | > loss_mel: 24.634300231933594 (24.634300231933594) | > loss_duration: 3.1842496395111084 (3.1842496395111084) | > loss_1: 42.095272064208984 (42.095272064208984)  --> STEP: 2 | > loss_disc: 2.316227912902832 (2.3899636268615723) | > loss_disc_real_0: 0.2068663239479065 (0.16081472486257553) | > loss_disc_real_1: 0.2353910654783249 (0.19556009769439697) | > loss_disc_real_2: 0.1534234881401062 (0.2505737543106079) | > loss_disc_real_3: 0.2281876802444458 (0.2309178039431572) | > loss_disc_real_4: 0.22077061235904694 (0.2722914144396782) | > loss_disc_real_5: 0.19252321124076843 (0.23800118267536163) | > loss_0: 2.316227912902832 (2.3899636268615723) | > loss_gen: 2.723165988922119 (2.5658854246139526) | > loss_kl: 4.542082786560059 (4.541533946990967) | > loss_feat: 9.151562690734863 (8.2393479347229) | > loss_mel: 25.471439361572266 (25.05286979675293) | > loss_duration: 2.9376420974731445 (3.0609458684921265) | > loss_1: 44.82589340209961 (43.4605827331543)  --> STEP: 3 | > loss_disc: 2.9698050022125244 (2.5832440853118896) | > loss_disc_real_0: 0.3265400230884552 (0.21605649093786874) | > loss_disc_real_1: 0.33882811665534973 (0.24331610401471457) | > loss_disc_real_2: 0.5001397132873535 (0.33376240730285645) | > loss_disc_real_3: 0.32647213339805603 (0.26276924709479016) | > loss_disc_real_4: 0.35355713963508606 (0.29937998950481415) | > loss_disc_real_5: 0.35707348585128784 (0.27769195040067035) | > loss_0: 2.9698050022125244 (2.5832440853118896) | > loss_gen: 2.8671116828918457 (2.6662941773732505) | > loss_kl: 2.3759677410125732 (3.819678544998169) | > loss_feat: 3.6428158283233643 (6.707170565923055) | > loss_mel: 22.231327056884766 (24.112355550130207) | > loss_duration: 2.8203301429748535 (2.9807406266530356) | > loss_1: 33.93755340576172 (40.28623962402344) --> EVAL PERFORMANCE | > avg_loader_time: 0.007817904154459635 (-0.006533781687418621) | > avg_loss_disc: 2.5832440853118896 (-0.11769700050354004) | > avg_loss_disc_real_0: 0.21605649093786874 (+0.03218574325243631) | > avg_loss_disc_real_1: 0.24331610401471457 (-0.049282004435857146) | > avg_loss_disc_real_2: 0.33376240730285645 (+0.059678773085276304) | > avg_loss_disc_real_3: 0.26276924709479016 (-0.06186024844646454) | > avg_loss_disc_real_4: 0.29937998950481415 (+0.06221146384874979) | > avg_loss_disc_real_5: 0.27769195040067035 (+0.009084731340408325) | > avg_loss_0: 2.5832440853118896 (-0.11769700050354004) | > avg_loss_gen: 2.6662941773732505 (+0.5812127987543745) | > avg_loss_kl: 3.819678544998169 (+0.1629265149434409) | > avg_loss_feat: 6.707170565923055 (+3.922961627443631) | > avg_loss_mel: 24.112355550130207 (+5.620750427246094) | > avg_loss_duration: 2.9807406266530356 (+0.04816412925720215) | > avg_loss_1: 40.28623962402344 (+10.336016337076824)  > EPOCH: 652/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:13:37)   --> TIME: 2023-10-20 07:13:58 -- STEP: 19/50 -- GLOBAL_STEP: 85620 | > loss_disc: 3.003734827041626 (2.4622085910094413) | > loss_disc_real_0: 0.25795167684555054 (0.1322690587686865) | > loss_disc_real_1: 0.2388131469488144 (0.22162638173291557) | > loss_disc_real_2: 0.2923514246940613 (0.22497587994133172) | > loss_disc_real_3: 0.2578611671924591 (0.2386677312223535) | > loss_disc_real_4: 0.28769996762275696 (0.21535382008081988) | > loss_disc_real_5: 0.2575532793998718 (0.2154301343191611) | > loss_0: 3.003734827041626 (2.4622085910094413) | > grad_norm_0: tensor(232.2319, device='cuda:0') (tensor(553.4800, device='cuda:0')) | > loss_gen: 1.6062523126602173 (2.2462396307995447) | > loss_kl: 0.7822538614273071 (0.870206502707381) | > loss_feat: 0.15773801505565643 (5.030455789185669) | > loss_mel: 2.0596275329589844 (18.590690060665732) | > loss_duration: 1.5415235757827759 (1.4770203828811646) | > loss_1: 6.147395133972168 (28.21461228320473) | > grad_norm_1: tensor(13080.4102, device='cuda:0') (tensor(20267.4453, device='cuda:0')) | > current_lr_0: 0.0001041962992810548 | > current_lr_1: 0.0001041962992810548 | > step_time: 1.1012 (0.6237203321958843) | > loader_time: 0.0449 (0.022674221741525752)  --> TIME: 2023-10-20 07:14:19 -- STEP: 49/50 -- GLOBAL_STEP: 85650 | > loss_disc: 2.665963649749756 (2.504200614228542) | > loss_disc_real_0: 0.07214642316102982 (0.13862682557759842) | > loss_disc_real_1: 0.2790927588939667 (0.2270919729252251) | > loss_disc_real_2: 0.20264248549938202 (0.22527984427098108) | > loss_disc_real_3: 0.26852816343307495 (0.23567573520906118) | > loss_disc_real_4: 0.22561682760715485 (0.20892332836377378) | > loss_disc_real_5: 0.24191567301750183 (0.21799366119108637) | > loss_0: 2.665963649749756 (2.504200614228542) | > grad_norm_0: tensor(781.5579, device='cuda:0') (tensor(636.9495, device='cuda:0')) | > loss_gen: 1.7879376411437988 (2.226989695004054) | > loss_kl: 0.7773448824882507 (0.8518145646975965) | > loss_feat: 1.355465054512024 (4.95993348366904) | > loss_mel: 16.830324172973633 (19.383048579400896) | > loss_duration: 1.5271731615066528 (1.4467373429512491) | > loss_1: 22.27824592590332 (28.86852349067221) | > grad_norm_1: tensor(4473.6353, device='cuda:0') (tensor(19381.0488, device='cuda:0')) | > current_lr_0: 0.0001041962992810548 | > current_lr_1: 0.0001041962992810548 | > step_time: 0.7272 (0.6386584554399761) | > loader_time: 0.4358 (0.029637049655525056)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0174834728240967 (3.0174834728240967) | > loss_disc_real_0: 0.19686287641525269 (0.19686287641525269) | > loss_disc_real_1: 0.2781641185283661 (0.2781641185283661) | > loss_disc_real_2: 0.28953927755355835 (0.28953927755355835) | > loss_disc_real_3: 0.2625817060470581 (0.2625817060470581) | > loss_disc_real_4: 0.30109626054763794 (0.30109626054763794) | > loss_disc_real_5: 0.2534859776496887 (0.2534859776496887) | > loss_0: 3.0174834728240967 (3.0174834728240967) | > loss_gen: 1.5891284942626953 (1.5891284942626953) | > loss_kl: 4.497408390045166 (4.497408390045166) | > loss_feat: 0.09063110500574112 (0.09063110500574112) | > loss_mel: 1.8859928846359253 (1.8859928846359253) | > loss_duration: 2.788867712020874 (2.788867712020874) | > loss_1: 10.852028846740723 (10.852028846740723)  --> STEP: 1 | > loss_disc: 2.5304832458496094 (2.5304832458496094) | > loss_disc_real_0: 0.20023983716964722 (0.20023983716964722) | > loss_disc_real_1: 0.28735610842704773 (0.28735610842704773) | > loss_disc_real_2: 0.31613796949386597 (0.31613796949386597) | > loss_disc_real_3: 0.29294347763061523 (0.29294347763061523) | > loss_disc_real_4: 0.4073047339916229 (0.4073047339916229) | > loss_disc_real_5: 0.3087226152420044 (0.3087226152420044) | > loss_0: 2.5304832458496094 (2.5304832458496094) | > loss_gen: 3.0651111602783203 (3.0651111602783203) | > loss_kl: 3.885869026184082 (3.885869026184082) | > loss_feat: 6.334549903869629 (6.334549903869629) | > loss_mel: 22.36599349975586 (22.36599349975586) | > loss_duration: 3.030888795852661 (3.030888795852661) | > loss_1: 38.68240737915039 (38.68240737915039)  --> STEP: 2 | > loss_disc: 3.017310380935669 (2.773896813392639) | > loss_disc_real_0: 0.1969415694475174 (0.1985907033085823) | > loss_disc_real_1: 0.2780989408493042 (0.28272752463817596) | > loss_disc_real_2: 0.2894410192966461 (0.30278949439525604) | > loss_disc_real_3: 0.26253849267959595 (0.2777409851551056) | > loss_disc_real_4: 0.3010885417461395 (0.3541966378688812) | > loss_disc_real_5: 0.2534862160682678 (0.2811044156551361) | > loss_0: 3.017310380935669 (2.773896813392639) | > loss_gen: 1.589165210723877 (2.3271381855010986) | > loss_kl: 4.475782871246338 (4.18082594871521) | > loss_feat: 0.09146410971879959 (3.2130070067942142) | > loss_mel: 2.5298635959625244 (12.447928547859192) | > loss_duration: 2.9058523178100586 (2.96837055683136) | > loss_1: 11.592127799987793 (25.137267589569092)  --> STEP: 3 | > loss_disc: 2.86793851852417 (2.805244048436483) | > loss_disc_real_0: 0.19981566071510315 (0.19899902244408926) | > loss_disc_real_1: 0.2775024175643921 (0.280985822280248) | > loss_disc_real_2: 0.29850250482559204 (0.3013604978720347) | > loss_disc_real_3: 0.2784886360168457 (0.277990202109019) | > loss_disc_real_4: 0.2904762923717499 (0.3329565227031708) | > loss_disc_real_5: 0.26962581276893616 (0.27727821469306946) | > loss_0: 2.86793851852417 (2.805244048436483) | > loss_gen: 1.7817236185073853 (2.1453333298365274) | > loss_kl: 2.1915442943573 (3.5177320639292398) | > loss_feat: 0.5446169972419739 (2.3235436702768006) | > loss_mel: 15.528101921081543 (13.474653005599976) | > loss_duration: 2.789296865463257 (2.9086793263753257) | > loss_1: 22.835283279418945 (24.36993948618571) --> EVAL PERFORMANCE | > avg_loader_time: 0.016688187917073567 (+0.008870283762613932) | > avg_loss_disc: 2.805244048436483 (+0.22199996312459325) | > avg_loss_disc_real_0: 0.19899902244408926 (-0.017057468493779482) | > avg_loss_disc_real_1: 0.280985822280248 (+0.03766971826553342) | > avg_loss_disc_real_2: 0.3013604978720347 (-0.03240190943082172) | > avg_loss_disc_real_3: 0.277990202109019 (+0.01522095501422882) | > avg_loss_disc_real_4: 0.3329565227031708 (+0.03357653319835663) | > avg_loss_disc_real_5: 0.27727821469306946 (-0.00041373570760089295) | > avg_loss_0: 2.805244048436483 (+0.22199996312459325) | > avg_loss_gen: 2.1453333298365274 (-0.5209608475367231) | > avg_loss_kl: 3.5177320639292398 (-0.3019464810689292) | > avg_loss_feat: 2.3235436702768006 (-4.383626895646254) | > avg_loss_mel: 13.474653005599976 (-10.637702544530232) | > avg_loss_duration: 2.9086793263753257 (-0.07206130027770996) | > avg_loss_1: 24.36993948618571 (-15.916300137837727)  > EPOCH: 653/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:14:33)   --> TIME: 2023-10-20 07:14:54 -- STEP: 29/50 -- GLOBAL_STEP: 85680 | > loss_disc: 2.2895069122314453 (2.3003117339364407) | > loss_disc_real_0: 0.05521731078624725 (0.12979323905089807) | > loss_disc_real_1: 0.36144575476646423 (0.21797762040434213) | > loss_disc_real_2: 0.22091332077980042 (0.22424604287692185) | > loss_disc_real_3: 0.4948437809944153 (0.24104338010837292) | > loss_disc_real_4: 0.30582356452941895 (0.2220468400367375) | > loss_disc_real_5: 0.19904692471027374 (0.20004231328594274) | > loss_0: 2.2895069122314453 (2.3003117339364407) | > grad_norm_0: tensor(405.9079, device='cuda:0') (tensor(500.3761, device='cuda:0')) | > loss_gen: 3.342090129852295 (2.504959118777308) | > loss_kl: 0.5156404972076416 (0.8646057330328842) | > loss_feat: 7.090324878692627 (6.646022790914466) | > loss_mel: 22.374303817749023 (22.251932464796923) | > loss_duration: 1.4467236995697021 (1.457058076200814) | > loss_1: 34.76908493041992 (33.72457829837141) | > grad_norm_1: tensor(19021.3711, device='cuda:0') (tensor(28911.4238, device='cuda:0')) | > current_lr_0: 0.00010409214855625996 | > current_lr_1: 0.00010409214855625996 | > step_time: 0.2471 (0.40838899283573543) | > loader_time: 0.0018 (0.00796023730573983)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7339415550231934 (2.7339415550231934) | > loss_disc_real_0: 0.42606568336486816 (0.42606568336486816) | > loss_disc_real_1: 0.2994096279144287 (0.2994096279144287) | > loss_disc_real_2: 0.3436411917209625 (0.3436411917209625) | > loss_disc_real_3: 0.2267741709947586 (0.2267741709947586) | > loss_disc_real_4: 0.19078995287418365 (0.19078995287418365) | > loss_disc_real_5: 0.1725347489118576 (0.1725347489118576) | > loss_0: 2.7339415550231934 (2.7339415550231934) | > loss_gen: 2.2196240425109863 (2.2196240425109863) | > loss_kl: 4.220815658569336 (4.220815658569336) | > loss_feat: 2.9831299781799316 (2.9831299781799316) | > loss_mel: 24.690643310546875 (24.690643310546875) | > loss_duration: 2.63720965385437 (2.63720965385437) | > loss_1: 36.75142288208008 (36.75142288208008)  --> STEP: 1 | > loss_disc: 2.990619421005249 (2.990619421005249) | > loss_disc_real_0: 0.2913236618041992 (0.2913236618041992) | > loss_disc_real_1: 0.289110392332077 (0.289110392332077) | > loss_disc_real_2: 0.27400684356689453 (0.27400684356689453) | > loss_disc_real_3: 0.23462963104248047 (0.23462963104248047) | > loss_disc_real_4: 0.238843634724617 (0.238843634724617) | > loss_disc_real_5: 0.3202906548976898 (0.3202906548976898) | > loss_0: 2.990619421005249 (2.990619421005249) | > loss_gen: 1.6850018501281738 (1.6850018501281738) | > loss_kl: 4.406411170959473 (4.406411170959473) | > loss_feat: 0.14858174324035645 (0.14858174324035645) | > loss_mel: 10.906587600708008 (10.906587600708008) | > loss_duration: 2.9814629554748535 (2.9814629554748535) | > loss_1: 20.12804412841797 (20.12804412841797)  --> STEP: 2 | > loss_disc: 2.7774817943573 (2.8840506076812744) | > loss_disc_real_0: 0.17975609004497528 (0.23553987592458725) | > loss_disc_real_1: 0.23510919511318207 (0.26210979372262955) | > loss_disc_real_2: 0.25524207949638367 (0.2646244615316391) | > loss_disc_real_3: 0.30796441435813904 (0.27129702270030975) | > loss_disc_real_4: 0.28829219937324524 (0.2635679170489311) | > loss_disc_real_5: 0.2670646011829376 (0.2936776280403137) | > loss_0: 2.7774817943573 (2.8840506076812744) | > loss_gen: 1.9645694494247437 (1.8247856497764587) | > loss_kl: 4.596434593200684 (4.501422882080078) | > loss_feat: 3.3750104904174805 (1.7617961168289185) | > loss_mel: 26.55069351196289 (18.72864055633545) | > loss_duration: 3.0476222038269043 (3.014542579650879) | > loss_1: 39.534332275390625 (29.831188201904297)  --> STEP: 3 | > loss_disc: 2.696354627609253 (2.8214852809906006) | > loss_disc_real_0: 0.19327056407928467 (0.2214501053094864) | > loss_disc_real_1: 0.16561689972877502 (0.22994549572467804) | > loss_disc_real_2: 0.42022761702537537 (0.3164921800295512) | > loss_disc_real_3: 0.09726034104824066 (0.2132847954829534) | > loss_disc_real_4: 0.3513091206550598 (0.2928149849176407) | > loss_disc_real_5: 0.5662950277328491 (0.3845500946044922) | > loss_0: 2.696354627609253 (2.8214852809906006) | > loss_gen: 2.6949303150177 (2.114833871523539) | > loss_kl: 2.201990842819214 (3.73494553565979) | > loss_feat: 6.061393737792969 (3.194995323816935) | > loss_mel: 24.58888053894043 (20.68205388387044) | > loss_duration: 2.703517436981201 (2.91086753209432) | > loss_1: 38.25071334838867 (32.63769658406576) --> EVAL PERFORMANCE | > avg_loader_time: 0.004131476084391276 (-0.01255671183268229) | > avg_loss_disc: 2.8214852809906006 (+0.01624123255411769) | > avg_loss_disc_real_0: 0.2214501053094864 (+0.022451082865397126) | > avg_loss_disc_real_1: 0.22994549572467804 (-0.05104032655556995) | > avg_loss_disc_real_2: 0.3164921800295512 (+0.01513168215751648) | > avg_loss_disc_real_3: 0.2132847954829534 (-0.06470540662606558) | > avg_loss_disc_real_4: 0.2928149849176407 (-0.04014153778553009) | > avg_loss_disc_real_5: 0.3845500946044922 (+0.10727187991142273) | > avg_loss_0: 2.8214852809906006 (+0.01624123255411769) | > avg_loss_gen: 2.114833871523539 (-0.03049945831298828) | > avg_loss_kl: 3.73494553565979 (+0.21721347173055028) | > avg_loss_feat: 3.194995323816935 (+0.8714516535401344) | > avg_loss_mel: 20.68205388387044 (+7.207400878270466) | > avg_loss_duration: 2.91086753209432 (+0.0021882057189941406) | > avg_loss_1: 32.63769658406576 (+8.267757097880047)  > EPOCH: 654/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:15:20)   --> TIME: 2023-10-20 07:15:34 -- STEP: 9/50 -- GLOBAL_STEP: 85710 | > loss_disc: 2.2273166179656982 (2.3400171862708197) | > loss_disc_real_0: 0.1554851084947586 (0.1253561850430237) | > loss_disc_real_1: 0.21508939564228058 (0.23443053248855802) | > loss_disc_real_2: 0.17961308360099792 (0.22691761288377973) | > loss_disc_real_3: 0.2316221445798874 (0.23078066110610962) | > loss_disc_real_4: 0.2353890985250473 (0.18049350215329063) | > loss_disc_real_5: 0.217527836561203 (0.16285401127404636) | > loss_0: 2.2273166179656982 (2.3400171862708197) | > grad_norm_0: tensor(203.2162, device='cuda:0') (tensor(546.6427, device='cuda:0')) | > loss_gen: 2.6873326301574707 (2.308844420644972) | > loss_kl: 0.7029543519020081 (0.7543932663069831) | > loss_feat: 4.8957839012146 (5.345153411229451) | > loss_mel: 13.114241600036621 (19.238091044955784) | > loss_duration: 1.4124910831451416 (1.4441959725485907) | > loss_1: 22.812803268432617 (29.09067768520779) | > grad_norm_1: tensor(15590.8506, device='cuda:0') (tensor(19146.0684, device='cuda:0')) | > current_lr_0: 0.00010398810193663538 | > current_lr_1: 0.00010398810193663538 | > step_time: 0.5607 (0.5665976206461588) | > loader_time: 0.0243 (0.022705422507392034)  --> TIME: 2023-10-20 07:15:52 -- STEP: 39/50 -- GLOBAL_STEP: 85740 | > loss_disc: 2.181583881378174 (2.32608758791899) | > loss_disc_real_0: 0.10374680906534195 (0.15307894590286875) | > loss_disc_real_1: 0.39244920015335083 (0.22488230266250098) | > loss_disc_real_2: 0.2548685073852539 (0.20822077750777587) | > loss_disc_real_3: 0.23229560256004333 (0.22428001869374362) | > loss_disc_real_4: 0.28422966599464417 (0.2167190213042956) | > loss_disc_real_5: 0.13850301504135132 (0.20609515212858334) | > loss_0: 2.181583881378174 (2.32608758791899) | > grad_norm_0: tensor(1533.8414, device='cuda:0') (tensor(581.7170, device='cuda:0')) | > loss_gen: 2.8733713626861572 (2.420929254629674) | > loss_kl: 0.506868839263916 (0.8337907912448431) | > loss_feat: 5.896277904510498 (5.906004554186112) | > loss_mel: 23.230419158935547 (22.475789369680943) | > loss_duration: 1.491389513015747 (1.4367465453270154) | > loss_1: 33.998329162597656 (33.07326044180454) | > grad_norm_1: tensor(30262.5137, device='cuda:0') (tensor(20405.7461, device='cuda:0')) | > current_lr_0: 0.00010398810193663538 | > current_lr_1: 0.00010398810193663538 | > step_time: 0.9692 (0.5761446158091227) | > loader_time: 0.0437 (0.024174457941299833)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6922364234924316 (2.6922364234924316) | > loss_disc_real_0: 0.21870166063308716 (0.21870166063308716) | > loss_disc_real_1: 0.497109979391098 (0.497109979391098) | > loss_disc_real_2: 0.33126533031463623 (0.33126533031463623) | > loss_disc_real_3: 0.2194926142692566 (0.2194926142692566) | > loss_disc_real_4: 0.16478104889392853 (0.16478104889392853) | > loss_disc_real_5: 0.206542506814003 (0.206542506814003) | > loss_0: 2.6922364234924316 (2.6922364234924316) | > loss_gen: 2.7433032989501953 (2.7433032989501953) | > loss_kl: 4.374066352844238 (4.374066352844238) | > loss_feat: 8.968388557434082 (8.968388557434082) | > loss_mel: 25.5723819732666 (25.5723819732666) | > loss_duration: 2.747695207595825 (2.747695207595825) | > loss_1: 44.40583801269531 (44.40583801269531)  --> STEP: 1 | > loss_disc: 2.665802001953125 (2.665802001953125) | > loss_disc_real_0: 0.3023657202720642 (0.3023657202720642) | > loss_disc_real_1: 0.3042844831943512 (0.3042844831943512) | > loss_disc_real_2: 0.3574773967266083 (0.3574773967266083) | > loss_disc_real_3: 0.27020999789237976 (0.27020999789237976) | > loss_disc_real_4: 0.2737482786178589 (0.2737482786178589) | > loss_disc_real_5: 0.2565852105617523 (0.2565852105617523) | > loss_0: 2.665802001953125 (2.665802001953125) | > loss_gen: 2.7198824882507324 (2.7198824882507324) | > loss_kl: 4.087813854217529 (4.087813854217529) | > loss_feat: 6.320538520812988 (6.320538520812988) | > loss_mel: 23.17256736755371 (23.17256736755371) | > loss_duration: 3.0308752059936523 (3.0308752059936523) | > loss_1: 39.3316764831543 (39.3316764831543)  --> STEP: 2 | > loss_disc: 2.256586790084839 (2.461194396018982) | > loss_disc_real_0: 0.1495705246925354 (0.2259681224822998) | > loss_disc_real_1: 0.1848401576280594 (0.2445623204112053) | > loss_disc_real_2: 0.2064564973115921 (0.2819669470191002) | > loss_disc_real_3: 0.3625466227531433 (0.31637831032276154) | > loss_disc_real_4: 0.30628424882888794 (0.2900162637233734) | > loss_disc_real_5: 0.3077510595321655 (0.2821681350469589) | > loss_0: 2.256586790084839 (2.461194396018982) | > loss_gen: 2.956002950668335 (2.8379427194595337) | > loss_kl: 4.5313873291015625 (4.309600591659546) | > loss_feat: 7.5517191886901855 (6.936128854751587) | > loss_mel: 25.029191970825195 (24.100879669189453) | > loss_duration: 2.8730483055114746 (2.9519617557525635) | > loss_1: 42.94134521484375 (41.13651084899902)  --> STEP: 3 | > loss_disc: 3.0226047039031982 (2.6483311653137207) | > loss_disc_real_0: 0.18461653590202332 (0.2121842602888743) | > loss_disc_real_1: 0.2930675745010376 (0.2607307384411494) | > loss_disc_real_2: 0.3128502666950226 (0.29226138691107434) | > loss_disc_real_3: 0.25352564454078674 (0.29542742172876996) | > loss_disc_real_4: 0.30628684163093567 (0.29543978969256085) | > loss_disc_real_5: 0.29723358154296875 (0.28718995054562885) | > loss_0: 3.0226047039031982 (2.6483311653137207) | > loss_gen: 1.7551236152648926 (2.47700301806132) | > loss_kl: 2.1163699626922607 (3.5785237153371177) | > loss_feat: 2.3985297679901123 (5.423595825831096) | > loss_mel: 20.58353042602539 (22.928429921468098) | > loss_duration: 2.777332067489624 (2.893751859664917) | > loss_1: 29.63088607788086 (37.30130259195963) --> EVAL PERFORMANCE | > avg_loader_time: 0.007681926091512044 (+0.0035504500071207677) | > avg_loss_disc: 2.6483311653137207 (-0.17315411567687988) | > avg_loss_disc_real_0: 0.2121842602888743 (-0.00926584502061209) | > avg_loss_disc_real_1: 0.2607307384411494 (+0.030785242716471373) | > avg_loss_disc_real_2: 0.29226138691107434 (-0.024230793118476868) | > avg_loss_disc_real_3: 0.29542742172876996 (+0.08214262624581656) | > avg_loss_disc_real_4: 0.29543978969256085 (+0.002624804774920164) | > avg_loss_disc_real_5: 0.28718995054562885 (-0.09736014405886334) | > avg_loss_0: 2.6483311653137207 (-0.17315411567687988) | > avg_loss_gen: 2.47700301806132 (+0.36216914653778076) | > avg_loss_kl: 3.5785237153371177 (-0.15642182032267238) | > avg_loss_feat: 5.423595825831096 (+2.2286005020141606) | > avg_loss_mel: 22.928429921468098 (+2.2463760375976562) | > avg_loss_duration: 2.893751859664917 (-0.017115672429402817) | > avg_loss_1: 37.30130259195963 (+4.6636060078938755)  > EPOCH: 655/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:16:16)   --> TIME: 2023-10-20 07:16:32 -- STEP: 19/50 -- GLOBAL_STEP: 85770 | > loss_disc: 2.0974085330963135 (2.376885257269207) | > loss_disc_real_0: 0.021814988926053047 (0.1265136685810591) | > loss_disc_real_1: 0.2267656922340393 (0.23362875474910988) | > loss_disc_real_2: 0.2485603392124176 (0.24463842142569392) | > loss_disc_real_3: 0.19205889105796814 (0.23164870844859825) | > loss_disc_real_4: 0.19436609745025635 (0.2654885390871449) | > loss_disc_real_5: 0.19403499364852905 (0.22984805320830723) | > loss_0: 2.0974085330963135 (2.376885257269207) | > grad_norm_0: tensor(396.0055, device='cuda:0') (tensor(509.6260, device='cuda:0')) | > loss_gen: 2.3302245140075684 (2.4591267359884164) | > loss_kl: 1.0724310874938965 (0.8118055525578951) | > loss_feat: 5.703702449798584 (5.533587648680336) | > loss_mel: 21.383625030517578 (22.64015524010909) | > loss_duration: 1.5536645650863647 (1.4749787606691058) | > loss_1: 32.04364776611328 (32.919653942710475) | > grad_norm_1: tensor(9670.1113, device='cuda:0') (tensor(18750.4961, device='cuda:0')) | > current_lr_0: 0.0001038841593181214 | > current_lr_1: 0.0001038841593181214 | > step_time: 1.1561 (0.5679810549083509) | > loader_time: 0.0022 (0.016220682545712118)  --> TIME: 2023-10-20 07:16:53 -- STEP: 49/50 -- GLOBAL_STEP: 85800 | > loss_disc: 2.2702748775482178 (2.4190467450083517) | > loss_disc_real_0: 0.16303472220897675 (0.14913058337964574) | > loss_disc_real_1: 0.2143835425376892 (0.22530839257702537) | > loss_disc_real_2: 0.1909240335226059 (0.21478815749287605) | > loss_disc_real_3: 0.2551237940788269 (0.23958484311493075) | > loss_disc_real_4: 0.15568828582763672 (0.22959547216186718) | > loss_disc_real_5: 0.25504031777381897 (0.2397068587644976) | > loss_0: 2.2702748775482178 (2.4190467450083517) | > grad_norm_0: tensor(512.9832, device='cuda:0') (tensor(564.6503, device='cuda:0')) | > loss_gen: 2.3305110931396484 (2.3481747009316267) | > loss_kl: 0.9125495553016663 (0.7959719759469129) | > loss_feat: 3.73014235496521 (5.550231101257463) | > loss_mel: 21.842910766601562 (21.378959219066463) | > loss_duration: 1.5418087244033813 (1.4354204742275938) | > loss_1: 30.35792350769043 (31.50875731876918) | > grad_norm_1: tensor(13474.1484, device='cuda:0') (tensor(20085.6777, device='cuda:0')) | > current_lr_0: 0.0001038841593181214 | > current_lr_1: 0.0001038841593181214 | > step_time: 0.8066 (0.6261469004105549) | > loader_time: 0.4343 (0.025756689966941356)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.77333402633667 (2.77333402633667) | > loss_disc_real_0: 0.38657689094543457 (0.38657689094543457) | > loss_disc_real_1: 0.4357742369174957 (0.4357742369174957) | > loss_disc_real_2: 0.4643172323703766 (0.4643172323703766) | > loss_disc_real_3: 0.4402090311050415 (0.4402090311050415) | > loss_disc_real_4: 0.52461177110672 (0.52461177110672) | > loss_disc_real_5: 0.21118298172950745 (0.21118298172950745) | > loss_0: 2.77333402633667 (2.77333402633667) | > loss_gen: 4.893033027648926 (4.893033027648926) | > loss_kl: 3.9615657329559326 (3.9615657329559326) | > loss_feat: 10.024271965026855 (10.024271965026855) | > loss_mel: 22.439043045043945 (22.439043045043945) | > loss_duration: 2.732178211212158 (2.732178211212158) | > loss_1: 44.05009078979492 (44.05009078979492)  --> STEP: 1 | > loss_disc: 2.4735779762268066 (2.4735779762268066) | > loss_disc_real_0: 0.22457671165466309 (0.22457671165466309) | > loss_disc_real_1: 0.26168885827064514 (0.26168885827064514) | > loss_disc_real_2: 0.31125137209892273 (0.31125137209892273) | > loss_disc_real_3: 0.24226202070713043 (0.24226202070713043) | > loss_disc_real_4: 0.25908538699150085 (0.25908538699150085) | > loss_disc_real_5: 0.14375393092632294 (0.14375393092632294) | > loss_0: 2.4735779762268066 (2.4735779762268066) | > loss_gen: 2.572312116622925 (2.572312116622925) | > loss_kl: 4.451815128326416 (4.451815128326416) | > loss_feat: 5.6391921043396 (5.6391921043396) | > loss_mel: 22.29045867919922 (22.29045867919922) | > loss_duration: 3.0090975761413574 (3.0090975761413574) | > loss_1: 37.96287536621094 (37.96287536621094)  --> STEP: 2 | > loss_disc: 0.8634240627288818 (1.6685010194778442) | > loss_disc_real_0: 0.017591437324881554 (0.12108407448977232) | > loss_disc_real_1: 0.092641681432724 (0.17716526985168457) | > loss_disc_real_2: 0.11867357045412064 (0.21496247127652168) | > loss_disc_real_3: 0.1410961002111435 (0.19167906045913696) | > loss_disc_real_4: 0.020760146901011467 (0.13992276694625616) | > loss_disc_real_5: 0.025205042213201523 (0.08447948656976223) | > loss_0: 0.8634240627288818 (1.6685010194778442) | > loss_gen: 4.245214462280273 (3.408763289451599) | > loss_kl: 4.6458845138549805 (4.548849821090698) | > loss_feat: 17.056333541870117 (11.347762823104858) | > loss_mel: 27.339719772338867 (24.815089225769043) | > loss_duration: 2.9005656242370605 (2.954831600189209) | > loss_1: 56.187721252441406 (47.07529830932617)  --> STEP: 3 | > loss_disc: 3.152747631072998 (2.163249890009562) | > loss_disc_real_0: 0.72484290599823 (0.3223370183259249) | > loss_disc_real_1: 0.38599202036857605 (0.2467741866906484) | > loss_disc_real_2: 0.416979044675827 (0.28230132907629013) | > loss_disc_real_3: 0.36155831813812256 (0.24830547968546549) | > loss_disc_real_4: 0.3086718022823334 (0.19617244539161524) | > loss_disc_real_5: 0.26271194219589233 (0.1438903051118056) | > loss_0: 3.152747631072998 (2.163249890009562) | > loss_gen: 3.314781427383423 (3.3774360020955405) | > loss_kl: 2.1774511337280273 (3.758383591969808) | > loss_feat: 4.755795955657959 (9.150440533955893) | > loss_mel: 20.94373893737793 (23.524639129638672) | > loss_duration: 2.787285804748535 (2.8989830017089844) | > loss_1: 33.97905349731445 (42.70988337198893) --> EVAL PERFORMANCE | > avg_loader_time: 0.023185888926188152 (+0.015503962834676109) | > avg_loss_disc: 2.163249890009562 (-0.4850812753041587) | > avg_loss_disc_real_0: 0.3223370183259249 (+0.11015275803705057) | > avg_loss_disc_real_1: 0.2467741866906484 (-0.013956551750501006) | > avg_loss_disc_real_2: 0.28230132907629013 (-0.009960057834784208) | > avg_loss_disc_real_3: 0.24830547968546549 (-0.04712194204330447) | > avg_loss_disc_real_4: 0.19617244539161524 (-0.09926734430094561) | > avg_loss_disc_real_5: 0.1438903051118056 (-0.14329964543382326) | > avg_loss_0: 2.163249890009562 (-0.4850812753041587) | > avg_loss_gen: 3.3774360020955405 (+0.9004329840342207) | > avg_loss_kl: 3.758383591969808 (+0.17985987663269043) | > avg_loss_feat: 9.150440533955893 (+3.726844708124797) | > avg_loss_mel: 23.524639129638672 (+0.5962092081705741) | > avg_loss_duration: 2.8989830017089844 (+0.005231142044067383) | > avg_loss_1: 42.70988337198893 (+5.408580780029297)  > EPOCH: 656/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:17:12)   --> TIME: 2023-10-20 07:17:33 -- STEP: 29/50 -- GLOBAL_STEP: 85830 | > loss_disc: 1.6681489944458008 (2.3944871178988754) | > loss_disc_real_0: 0.1244005411863327 (0.15643599831723962) | > loss_disc_real_1: 0.18044380843639374 (0.22967466429389757) | > loss_disc_real_2: 0.10853365808725357 (0.2508009422955842) | > loss_disc_real_3: 0.13529600203037262 (0.23925857361534547) | > loss_disc_real_4: 0.23872490227222443 (0.23608655944980425) | > loss_disc_real_5: 0.051322028040885925 (0.22392988551793427) | > loss_0: 1.6681489944458008 (2.3944871178988754) | > grad_norm_0: tensor(448.1190, device='cuda:0') (tensor(707.1500, device='cuda:0')) | > loss_gen: 2.9588866233825684 (2.4876750255453177) | > loss_kl: 0.7599044442176819 (0.8670307757525608) | > loss_feat: 8.680341720581055 (5.889299746217398) | > loss_mel: 24.460786819458008 (22.663398882438397) | > loss_duration: 1.3783615827560425 (1.4568090151096214) | > loss_1: 38.238277435302734 (33.364213335103) | > grad_norm_1: tensor(49625.0781, device='cuda:0') (tensor(21539.9102, device='cuda:0')) | > current_lr_0: 0.0001037803205967624 | > current_lr_1: 0.0001037803205967624 | > step_time: 0.3488 (0.5266708505564722) | > loader_time: 0.0126 (0.016153787744456326)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4411346912384033 (2.4411346912384033) | > loss_disc_real_0: 0.09487634152173996 (0.09487634152173996) | > loss_disc_real_1: 0.10303626954555511 (0.10303626954555511) | > loss_disc_real_2: 0.2864828109741211 (0.2864828109741211) | > loss_disc_real_3: 0.395210325717926 (0.395210325717926) | > loss_disc_real_4: 0.3269209563732147 (0.3269209563732147) | > loss_disc_real_5: 0.2502439320087433 (0.2502439320087433) | > loss_0: 2.4411346912384033 (2.4411346912384033) | > loss_gen: 2.669119119644165 (2.669119119644165) | > loss_kl: 3.5462303161621094 (3.5462303161621094) | > loss_feat: 7.040607452392578 (7.040607452392578) | > loss_mel: 24.12670135498047 (24.12670135498047) | > loss_duration: 2.691004991531372 (2.691004991531372) | > loss_1: 40.073665618896484 (40.073665618896484)  --> STEP: 1 | > loss_disc: 2.245483875274658 (2.245483875274658) | > loss_disc_real_0: 0.04317827522754669 (0.04317827522754669) | > loss_disc_real_1: 0.1575407236814499 (0.1575407236814499) | > loss_disc_real_2: 0.1587890386581421 (0.1587890386581421) | > loss_disc_real_3: 0.1731719672679901 (0.1731719672679901) | > loss_disc_real_4: 0.12895095348358154 (0.12895095348358154) | > loss_disc_real_5: 0.2201206535100937 (0.2201206535100937) | > loss_0: 2.245483875274658 (2.245483875274658) | > loss_gen: 1.8221839666366577 (1.8221839666366577) | > loss_kl: 4.3932600021362305 (4.3932600021362305) | > loss_feat: 5.406007289886475 (5.406007289886475) | > loss_mel: 24.250795364379883 (24.250795364379883) | > loss_duration: 3.175044536590576 (3.175044536590576) | > loss_1: 39.04729461669922 (39.04729461669922)  --> STEP: 2 | > loss_disc: 2.8871326446533203 (2.5663082599639893) | > loss_disc_real_0: 0.21557742357254028 (0.1293778494000435) | > loss_disc_real_1: 0.2652151584625244 (0.21137794107198715) | > loss_disc_real_2: 0.3417685031890869 (0.2502787709236145) | > loss_disc_real_3: 0.31397339701652527 (0.2435726821422577) | > loss_disc_real_4: 0.21436801552772522 (0.17165948450565338) | > loss_disc_real_5: 0.2949674427509308 (0.25754404813051224) | > loss_0: 2.8871326446533203 (2.5663082599639893) | > loss_gen: 2.2901763916015625 (2.05618017911911) | > loss_kl: 4.567001819610596 (4.480130910873413) | > loss_feat: 6.646760940551758 (6.026384115219116) | > loss_mel: 24.477365493774414 (24.36408042907715) | > loss_duration: 2.944753646850586 (3.059899091720581) | > loss_1: 40.926055908203125 (39.98667526245117)  --> STEP: 3 | > loss_disc: 2.5112600326538086 (2.5479588508605957) | > loss_disc_real_0: 0.28045135736465454 (0.17973568538824716) | > loss_disc_real_1: 0.3569844663143158 (0.2599134494860967) | > loss_disc_real_2: 0.31291571259498596 (0.27115775148073834) | > loss_disc_real_3: 0.30190157890319824 (0.26301564772923786) | > loss_disc_real_4: 0.28230300545692444 (0.20854065815607706) | > loss_disc_real_5: 0.309311181306839 (0.27479975918928784) | > loss_0: 2.5112600326538086 (2.5479588508605957) | > loss_gen: 3.189579963684082 (2.433980107307434) | > loss_kl: 2.052442789077759 (3.6709015369415283) | > loss_feat: 6.276669025421143 (6.109812418619792) | > loss_mel: 25.227493286132812 (24.65188471476237) | > loss_duration: 2.84826397895813 (2.989354054133097) | > loss_1: 39.59444808959961 (39.85593287150065) --> EVAL PERFORMANCE | > avg_loader_time: 0.002701918284098307 (-0.020483970642089844) | > avg_loss_disc: 2.5479588508605957 (+0.3847089608510337) | > avg_loss_disc_real_0: 0.17973568538824716 (-0.1426013329376777) | > avg_loss_disc_real_1: 0.2599134494860967 (+0.013139262795448275) | > avg_loss_disc_real_2: 0.27115775148073834 (-0.01114357759555179) | > avg_loss_disc_real_3: 0.26301564772923786 (+0.01471016804377237) | > avg_loss_disc_real_4: 0.20854065815607706 (+0.012368212764461817) | > avg_loss_disc_real_5: 0.27479975918928784 (+0.13090945407748225) | > avg_loss_0: 2.5479588508605957 (+0.3847089608510337) | > avg_loss_gen: 2.433980107307434 (-0.9434558947881064) | > avg_loss_kl: 3.6709015369415283 (-0.08748205502827977) | > avg_loss_feat: 6.109812418619792 (-3.0406281153361006) | > avg_loss_mel: 24.65188471476237 (+1.127245585123699) | > avg_loss_duration: 2.989354054133097 (+0.09037105242411281) | > avg_loss_1: 39.85593287150065 (-2.8539505004882812)  > EPOCH: 657/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:17:59)   --> TIME: 2023-10-20 07:18:10 -- STEP: 9/50 -- GLOBAL_STEP: 85860 | > loss_disc: 2.7017569541931152 (2.280928293863932) | > loss_disc_real_0: 0.41168099641799927 (0.19517343491315842) | > loss_disc_real_1: 0.23879697918891907 (0.1939806176556481) | > loss_disc_real_2: 0.17927707731723785 (0.19425427003039253) | > loss_disc_real_3: 0.2853672504425049 (0.24922174463669458) | > loss_disc_real_4: 0.20730091631412506 (0.1828524007772406) | > loss_disc_real_5: 0.2568199634552002 (0.18085062255462012) | > loss_0: 2.7017569541931152 (2.280928293863932) | > grad_norm_0: tensor(750.1448, device='cuda:0') (tensor(649.8508, device='cuda:0')) | > loss_gen: 2.056457757949829 (2.450355701976352) | > loss_kl: 0.9595696330070496 (0.9243246648046706) | > loss_feat: 2.1231250762939453 (6.013260499470764) | > loss_mel: 21.452930450439453 (18.778207845158047) | > loss_duration: 1.413010597229004 (1.460141075981988) | > loss_1: 28.00509262084961 (29.626289155748154) | > grad_norm_1: tensor(3129.8633, device='cuda:0') (tensor(22612.6973, device='cuda:0')) | > current_lr_0: 0.00010367658566870666 | > current_lr_1: 0.00010367658566870666 | > step_time: 0.8263 (0.6260973347557915) | > loader_time: 0.0266 (0.025117794672648113)  --> TIME: 2023-10-20 07:18:27 -- STEP: 39/50 -- GLOBAL_STEP: 85890 | > loss_disc: 2.680041790008545 (2.418266510352111) | > loss_disc_real_0: 0.20107775926589966 (0.17637435547434366) | > loss_disc_real_1: 0.2855715751647949 (0.21969539041702563) | > loss_disc_real_2: 0.2642101049423218 (0.22856087304460695) | > loss_disc_real_3: 0.17908351123332977 (0.23116486481367013) | > loss_disc_real_4: 0.3095966875553131 (0.228480842227164) | > loss_disc_real_5: 0.32826584577560425 (0.2165759917205343) | > loss_0: 2.680041790008545 (2.418266510352111) | > grad_norm_0: tensor(695.3082, device='cuda:0') (tensor(564.4260, device='cuda:0')) | > loss_gen: 2.12599515914917 (2.3522066305845217) | > loss_kl: 0.956445574760437 (0.8429542237367386) | > loss_feat: 2.61252498626709 (5.207557145601664) | > loss_mel: 13.630105018615723 (20.052746476271217) | > loss_duration: 1.4916502237319946 (1.4388500849405925) | > loss_1: 20.816720962524414 (29.894314570304676) | > grad_norm_1: tensor(19573.7031, device='cuda:0') (tensor(20001.8809, device='cuda:0')) | > current_lr_0: 0.00010367658566870666 | > current_lr_1: 0.00010367658566870666 | > step_time: 0.3885 (0.5655450820922852) | > loader_time: 0.0246 (0.022284691150371846)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9536194801330566 (2.9536194801330566) | > loss_disc_real_0: 0.379658043384552 (0.379658043384552) | > loss_disc_real_1: 0.21728914976119995 (0.21728914976119995) | > loss_disc_real_2: 0.23349466919898987 (0.23349466919898987) | > loss_disc_real_3: 0.27581095695495605 (0.27581095695495605) | > loss_disc_real_4: 0.2897771894931793 (0.2897771894931793) | > loss_disc_real_5: 0.33353033661842346 (0.33353033661842346) | > loss_0: 2.9536194801330566 (2.9536194801330566) | > loss_gen: 2.1564059257507324 (2.1564059257507324) | > loss_kl: 4.3882575035095215 (4.3882575035095215) | > loss_feat: 5.958760738372803 (5.958760738372803) | > loss_mel: 24.141775131225586 (24.141775131225586) | > loss_duration: 2.6997900009155273 (2.6997900009155273) | > loss_1: 39.34498977661133 (39.34498977661133)  --> STEP: 1 | > loss_disc: 2.763352632522583 (2.763352632522583) | > loss_disc_real_0: 0.34434762597084045 (0.34434762597084045) | > loss_disc_real_1: 0.3669328987598419 (0.3669328987598419) | > loss_disc_real_2: 0.3046180307865143 (0.3046180307865143) | > loss_disc_real_3: 0.3262038230895996 (0.3262038230895996) | > loss_disc_real_4: 0.2950958013534546 (0.2950958013534546) | > loss_disc_real_5: 0.2868758738040924 (0.2868758738040924) | > loss_0: 2.763352632522583 (2.763352632522583) | > loss_gen: 2.8119986057281494 (2.8119986057281494) | > loss_kl: 4.372584819793701 (4.372584819793701) | > loss_feat: 3.9467480182647705 (3.9467480182647705) | > loss_mel: 21.555458068847656 (21.555458068847656) | > loss_duration: 3.0015366077423096 (3.0015366077423096) | > loss_1: 35.68832778930664 (35.68832778930664)  --> STEP: 2 | > loss_disc: 2.521080493927002 (2.6422165632247925) | > loss_disc_real_0: 0.30481383204460144 (0.32458072900772095) | > loss_disc_real_1: 0.22315996885299683 (0.2950464338064194) | > loss_disc_real_2: 0.1261817216873169 (0.2153998762369156) | > loss_disc_real_3: 0.18337595462799072 (0.25478988885879517) | > loss_disc_real_4: 0.17215889692306519 (0.2336273491382599) | > loss_disc_real_5: 0.2865442931652069 (0.28671008348464966) | > loss_0: 2.521080493927002 (2.6422165632247925) | > loss_gen: 2.3599095344543457 (2.5859540700912476) | > loss_kl: 5.216394901275635 (4.794489860534668) | > loss_feat: 6.754116058349609 (5.35043203830719) | > loss_mel: 22.05567169189453 (21.805564880371094) | > loss_duration: 2.811551332473755 (2.9065439701080322) | > loss_1: 39.1976432800293 (37.44298553466797)  --> STEP: 3 | > loss_disc: 2.761324405670166 (2.6819191773732505) | > loss_disc_real_0: 0.3856154680252075 (0.3449256420135498) | > loss_disc_real_1: 0.4146217703819275 (0.33490487933158875) | > loss_disc_real_2: 0.22835245728492737 (0.21971740325291952) | > loss_disc_real_3: 0.2908032238483429 (0.2667943338553111) | > loss_disc_real_4: 0.25962233543395996 (0.2422923445701599) | > loss_disc_real_5: 0.25690019130706787 (0.27677345275878906) | > loss_0: 2.761324405670166 (2.6819191773732505) | > loss_gen: 2.5263402462005615 (2.566082795461019) | > loss_kl: 2.115964412689209 (3.9016480445861816) | > loss_feat: 3.47048020362854 (4.72378142674764) | > loss_mel: 24.490081787109375 (22.700403849283855) | > loss_duration: 2.7914414405822754 (2.8681764602661133) | > loss_1: 35.394309997558594 (36.760093688964844) --> EVAL PERFORMANCE | > avg_loader_time: 0.010298411051432291 (+0.007596492767333984) | > avg_loss_disc: 2.6819191773732505 (+0.13396032651265477) | > avg_loss_disc_real_0: 0.3449256420135498 (+0.16518995662530264) | > avg_loss_disc_real_1: 0.33490487933158875 (+0.07499142984549206) | > avg_loss_disc_real_2: 0.21971740325291952 (-0.051440348227818816) | > avg_loss_disc_real_3: 0.2667943338553111 (+0.0037786861260732385) | > avg_loss_disc_real_4: 0.2422923445701599 (+0.033751686414082854) | > avg_loss_disc_real_5: 0.27677345275878906 (+0.0019736935695012225) | > avg_loss_0: 2.6819191773732505 (+0.13396032651265477) | > avg_loss_gen: 2.566082795461019 (+0.13210268815358495) | > avg_loss_kl: 3.9016480445861816 (+0.23074650764465332) | > avg_loss_feat: 4.72378142674764 (-1.3860309918721523) | > avg_loss_mel: 22.700403849283855 (-1.9514808654785156) | > avg_loss_duration: 2.8681764602661133 (-0.1211775938669839) | > avg_loss_1: 36.760093688964844 (-3.095839182535805)  > EPOCH: 658/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:18:51)   --> TIME: 2023-10-20 07:19:09 -- STEP: 19/50 -- GLOBAL_STEP: 85920 | > loss_disc: 1.3988292217254639 (2.4111196430105912) | > loss_disc_real_0: 0.010027796030044556 (0.1418211706178753) | > loss_disc_real_1: 0.0761428102850914 (0.21449335448836027) | > loss_disc_real_2: 0.04026878625154495 (0.23399185055964872) | > loss_disc_real_3: 0.07539337128400803 (0.2443667397295174) | > loss_disc_real_4: 0.03653061389923096 (0.21885132162194504) | > loss_disc_real_5: 0.021417556330561638 (0.21532600088731238) | > loss_0: 1.3988292217254639 (2.4111196430105912) | > grad_norm_0: tensor(608.9301, device='cuda:0') (tensor(674.8601, device='cuda:0')) | > loss_gen: 2.7284109592437744 (2.2948069635190462) | > loss_kl: 0.8254087567329407 (0.8457849182580647) | > loss_feat: 14.587919235229492 (5.046661731836043) | > loss_mel: 28.502038955688477 (17.797648241645412) | > loss_duration: 1.5562264919281006 (1.4846807028117932) | > loss_1: 48.20000457763672 (27.46958313490215) | > grad_norm_1: tensor(72971.4922, device='cuda:0') (tensor(21058.3613, device='cuda:0')) | > current_lr_0: 0.00010357295443020629 | > current_lr_1: 0.00010357295443020629 | > step_time: 0.7695 (0.6400638881482577) | > loader_time: 0.0028 (0.012108564376831055)  --> TIME: 2023-10-20 07:19:24 -- STEP: 49/50 -- GLOBAL_STEP: 85950 | > loss_disc: 2.6941287517547607 (2.3644546659625303) | > loss_disc_real_0: 0.12373509258031845 (0.14039748602983898) | > loss_disc_real_1: 0.3045933246612549 (0.21883749133166003) | > loss_disc_real_2: 0.31522512435913086 (0.21549808325207964) | > loss_disc_real_3: 0.26647114753723145 (0.23287799946811735) | > loss_disc_real_4: 0.3071882426738739 (0.20879668689199857) | > loss_disc_real_5: 0.3362519145011902 (0.2130276625405769) | > loss_0: 2.6941287517547607 (2.3644546659625303) | > grad_norm_0: tensor(1309.4474, device='cuda:0') (tensor(705.1957, device='cuda:0')) | > loss_gen: 2.426321029663086 (2.349129662221793) | > loss_kl: 0.6415634751319885 (0.8215015220398806) | > loss_feat: 2.9281585216522217 (5.638338198923335) | > loss_mel: 22.454557418823242 (19.183165800814727) | > loss_duration: 1.58626389503479 (1.453081802446015) | > loss_1: 30.036863327026367 (29.44521716176247) | > grad_norm_1: tensor(5098.7632, device='cuda:0') (tensor(20549.9238, device='cuda:0')) | > current_lr_0: 0.00010357295443020629 | > current_lr_1: 0.00010357295443020629 | > step_time: 0.6434 (0.5366210256304058) | > loader_time: 0.46 (0.02153901178009656)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.737290143966675 (2.737290143966675) | > loss_disc_real_0: 0.12535884976387024 (0.12535884976387024) | > loss_disc_real_1: 0.3064757287502289 (0.3064757287502289) | > loss_disc_real_2: 0.21809948980808258 (0.21809948980808258) | > loss_disc_real_3: 0.33773449063301086 (0.33773449063301086) | > loss_disc_real_4: 0.20140522718429565 (0.20140522718429565) | > loss_disc_real_5: 0.37571096420288086 (0.37571096420288086) | > loss_0: 2.737290143966675 (2.737290143966675) | > loss_gen: 2.200042486190796 (2.200042486190796) | > loss_kl: 3.7650516033172607 (3.7650516033172607) | > loss_feat: 6.9027485847473145 (6.9027485847473145) | > loss_mel: 23.30632209777832 (23.30632209777832) | > loss_duration: 2.772245407104492 (2.772245407104492) | > loss_1: 38.9464111328125 (38.9464111328125)  --> STEP: 1 | > loss_disc: 3.202387809753418 (3.202387809753418) | > loss_disc_real_0: 0.31062716245651245 (0.31062716245651245) | > loss_disc_real_1: 0.3146030604839325 (0.3146030604839325) | > loss_disc_real_2: 0.47042468190193176 (0.47042468190193176) | > loss_disc_real_3: 0.4228212833404541 (0.4228212833404541) | > loss_disc_real_4: 0.45387428998947144 (0.45387428998947144) | > loss_disc_real_5: 0.48918816447257996 (0.48918816447257996) | > loss_0: 3.202387809753418 (3.202387809753418) | > loss_gen: 2.730894088745117 (2.730894088745117) | > loss_kl: 4.106881141662598 (4.106881141662598) | > loss_feat: 4.149641990661621 (4.149641990661621) | > loss_mel: 24.053316116333008 (24.053316116333008) | > loss_duration: 3.008010149002075 (3.008010149002075) | > loss_1: 38.048744201660156 (38.048744201660156)  --> STEP: 2 | > loss_disc: 2.621115207672119 (2.9117515087127686) | > loss_disc_real_0: 0.07417406141757965 (0.19240061193704605) | > loss_disc_real_1: 0.08684177696704865 (0.20072241872549057) | > loss_disc_real_2: 0.30782148241996765 (0.3891230821609497) | > loss_disc_real_3: 0.35697880387306213 (0.3899000436067581) | > loss_disc_real_4: 0.4725363850593567 (0.46320533752441406) | > loss_disc_real_5: 0.4325229227542877 (0.46085554361343384) | > loss_0: 2.621115207672119 (2.9117515087127686) | > loss_gen: 2.9288547039031982 (2.8298743963241577) | > loss_kl: 4.93109655380249 (4.518988847732544) | > loss_feat: 8.858118057250977 (6.503880023956299) | > loss_mel: 27.023771286010742 (25.538543701171875) | > loss_duration: 2.8500912189483643 (2.9290506839752197) | > loss_1: 46.59193420410156 (42.32033920288086)  --> STEP: 3 | > loss_disc: 2.9735684394836426 (2.93235715230306) | > loss_disc_real_0: 0.22358335554599762 (0.20279485980669656) | > loss_disc_real_1: 0.2824878394603729 (0.22797755897045135) | > loss_disc_real_2: 0.29669755697250366 (0.358314573764801) | > loss_disc_real_3: 0.27527496218681335 (0.3516916831334432) | > loss_disc_real_4: 0.2803635895252228 (0.4022580881913503) | > loss_disc_real_5: 0.2708156108856201 (0.3975088993708293) | > loss_0: 2.9735684394836426 (2.93235715230306) | > loss_gen: 1.667175531387329 (2.4423081080118814) | > loss_kl: 2.025580883026123 (3.6878528594970703) | > loss_feat: 0.21008090674877167 (4.405946984887123) | > loss_mel: 2.6337294578552246 (17.903605620066326) | > loss_duration: 2.6463849544525146 (2.834828774134318) | > loss_1: 9.182951927185059 (31.274543444315594) --> EVAL PERFORMANCE | > avg_loader_time: 0.01438291867574056 (+0.004084507624308269) | > avg_loss_disc: 2.93235715230306 (+0.25043797492980957) | > avg_loss_disc_real_0: 0.20279485980669656 (-0.14213078220685324) | > avg_loss_disc_real_1: 0.22797755897045135 (-0.10692732036113739) | > avg_loss_disc_real_2: 0.358314573764801 (+0.1385971705118815) | > avg_loss_disc_real_3: 0.3516916831334432 (+0.08489734927813208) | > avg_loss_disc_real_4: 0.4022580881913503 (+0.15996574362119037) | > avg_loss_disc_real_5: 0.3975088993708293 (+0.12073544661204022) | > avg_loss_0: 2.93235715230306 (+0.25043797492980957) | > avg_loss_gen: 2.4423081080118814 (-0.12377468744913767) | > avg_loss_kl: 3.6878528594970703 (-0.21379518508911133) | > avg_loss_feat: 4.405946984887123 (-0.31783444186051657) | > avg_loss_mel: 17.903605620066326 (-4.796798229217529) | > avg_loss_duration: 2.834828774134318 (-0.033347686131795395) | > avg_loss_1: 31.274543444315594 (-5.48555024464925)  > EPOCH: 659/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:19:39)   --> TIME: 2023-10-20 07:20:02 -- STEP: 29/50 -- GLOBAL_STEP: 85980 | > loss_disc: 2.4380764961242676 (2.5282386870219784) | > loss_disc_real_0: 0.13161692023277283 (0.18763060883843694) | > loss_disc_real_1: 0.2231689840555191 (0.25732796716279) | > loss_disc_real_2: 0.12454979866743088 (0.24789544888611498) | > loss_disc_real_3: 0.28325265645980835 (0.24682870455856987) | > loss_disc_real_4: 0.0824473425745964 (0.23503220839233235) | > loss_disc_real_5: 0.1660137176513672 (0.23310009936063453) | > loss_0: 2.4380764961242676 (2.5282386870219784) | > grad_norm_0: tensor(679.7692, device='cuda:0') (tensor(704.8556, device='cuda:0')) | > loss_gen: 1.8300856351852417 (2.3229240343488495) | > loss_kl: 0.7012650966644287 (0.7921721996932194) | > loss_feat: 2.744730234146118 (5.323999851171314) | > loss_mel: 20.67451286315918 (20.66296103082854) | > loss_duration: 1.4332901239395142 (1.4623368156367336) | > loss_1: 27.38388442993164 (30.56439396430706) | > grad_norm_1: tensor(3967.8403, device='cuda:0') (tensor(24009.9609, device='cuda:0')) | > current_lr_0: 0.00010346942677761708 | > current_lr_1: 0.00010346942677761708 | > step_time: 0.768 (0.5813334317042912) | > loader_time: 0.0329 (0.021646680503055966)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9582319259643555 (2.9582319259643555) | > loss_disc_real_0: 0.4291750490665436 (0.4291750490665436) | > loss_disc_real_1: 0.30263739824295044 (0.30263739824295044) | > loss_disc_real_2: 0.4001127779483795 (0.4001127779483795) | > loss_disc_real_3: 0.3992588520050049 (0.3992588520050049) | > loss_disc_real_4: 0.2836417257785797 (0.2836417257785797) | > loss_disc_real_5: 0.33115866780281067 (0.33115866780281067) | > loss_0: 2.9582319259643555 (2.9582319259643555) | > loss_gen: 2.858637809753418 (2.858637809753418) | > loss_kl: 4.77441930770874 (4.77441930770874) | > loss_feat: 6.317203521728516 (6.317203521728516) | > loss_mel: 23.62635040283203 (23.62635040283203) | > loss_duration: 2.7560994625091553 (2.7560994625091553) | > loss_1: 40.33271026611328 (40.33271026611328)  --> STEP: 1 | > loss_disc: 2.7388417720794678 (2.7388417720794678) | > loss_disc_real_0: 0.3229861855506897 (0.3229861855506897) | > loss_disc_real_1: 0.346432089805603 (0.346432089805603) | > loss_disc_real_2: 0.24585428833961487 (0.24585428833961487) | > loss_disc_real_3: 0.25260692834854126 (0.25260692834854126) | > loss_disc_real_4: 0.3547334372997284 (0.3547334372997284) | > loss_disc_real_5: 0.5122395157814026 (0.5122395157814026) | > loss_0: 2.7388417720794678 (2.7388417720794678) | > loss_gen: 3.9500274658203125 (3.9500274658203125) | > loss_kl: 4.211242198944092 (4.211242198944092) | > loss_feat: 6.930164813995361 (6.930164813995361) | > loss_mel: 23.440092086791992 (23.440092086791992) | > loss_duration: 3.070652961730957 (3.070652961730957) | > loss_1: 41.602176666259766 (41.602176666259766)  --> STEP: 2 | > loss_disc: 3.0156025886535645 (2.877222180366516) | > loss_disc_real_0: 0.1867939978837967 (0.2548900917172432) | > loss_disc_real_1: 0.26282161474227905 (0.30462685227394104) | > loss_disc_real_2: 0.25345882773399353 (0.2496565580368042) | > loss_disc_real_3: 0.28874170780181885 (0.27067431807518005) | > loss_disc_real_4: 0.3269367218017578 (0.3408350795507431) | > loss_disc_real_5: 0.26196521520614624 (0.3871023654937744) | > loss_0: 3.0156025886535645 (2.877222180366516) | > loss_gen: 1.5840296745300293 (2.767028570175171) | > loss_kl: 4.528616905212402 (4.369929552078247) | > loss_feat: 0.08049969375133514 (3.5053322538733482) | > loss_mel: 1.767920732498169 (12.60400640964508) | > loss_duration: 2.962477922439575 (3.016565442085266) | > loss_1: 10.923544883728027 (26.262860774993896)  --> STEP: 3 | > loss_disc: 3.1063637733459473 (2.9536027113596597) | > loss_disc_real_0: 0.18580347299575806 (0.23186121881008148) | > loss_disc_real_1: 0.3724597990512848 (0.3272378345330556) | > loss_disc_real_2: 0.3443603217601776 (0.28122447927792865) | > loss_disc_real_3: 0.412993460893631 (0.318114032347997) | > loss_disc_real_4: 0.30902382731437683 (0.33023132880528766) | > loss_disc_real_5: 0.4685961604118347 (0.4142669637997945) | > loss_0: 3.1063637733459473 (2.9536027113596597) | > loss_gen: 2.8065781593322754 (2.7802117665608725) | > loss_kl: 1.9456294775009155 (3.5618295272191367) | > loss_feat: 4.725489139556885 (3.9120512157678604) | > loss_mel: 20.504718780517578 (15.237577199935913) | > loss_duration: 2.761261463165283 (2.931464115778605) | > loss_1: 32.74367904663086 (28.42313353220622) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_86000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8789329528808594 (2.9349352717399597) | > loss_disc_real_0: 0.18029992282390594 (0.2189708948135376) | > loss_disc_real_1: 0.26222074031829834 (0.3109835609793663) | > loss_disc_real_2: 0.25214600563049316 (0.2739548608660698) | > loss_disc_real_3: 0.293449729681015 (0.3119479566812515) | > loss_disc_real_4: 0.3309507966041565 (0.3304111957550049) | > loss_disc_real_5: 0.2652450203895569 (0.3770114779472351) | > loss_0: 2.8789329528808594 (2.9349352717399597) | > loss_gen: 1.7394202947616577 (2.5200138986110687) | > loss_kl: 4.613447666168213 (3.8247340619564056) | > loss_feat: 0.4420064687728882 (3.0445400290191174) | > loss_mel: 14.971381187438965 (15.171028196811676) | > loss_duration: 2.887864589691162 (2.9205642342567444) | > loss_1: 24.65412139892578 (27.48088049888611)  --> STEP: 1 | > loss_disc: 2.16182017326355 (2.780312252044678) | > loss_disc_real_0: 0.1940039098262787 (0.21397749781608583) | > loss_disc_real_1: 0.2670183479785919 (0.3021905183792114) | > loss_disc_real_2: 0.27853912115097046 (0.2748717129230499) | > loss_disc_real_3: 0.24052156507968903 (0.297662678360939) | > loss_disc_real_4: 0.22909845411777496 (0.3101486474275589) | > loss_disc_real_5: 0.07739265263080597 (0.31708771288394927) | > loss_0: 2.16182017326355 (2.780312252044678) | > loss_gen: 2.961760997772217 (2.608363318443298) | > loss_kl: 4.600841999053955 (3.9799556493759156) | > loss_feat: 8.273114204406738 (4.090254864096641) | > loss_mel: 26.106412887573242 (17.35810513496399) | > loss_duration: 3.072208881378174 (2.9508931636810303) | > loss_1: 45.014339447021484 (30.987572288513185)  --> STEP: 2 | > loss_disc: 2.847095251083374 (2.7914427518844604) | > loss_disc_real_0: 0.05257254093885422 (0.18707667166988054) | > loss_disc_real_1: 0.14883260428905487 (0.276630866030852) | > loss_disc_real_2: 0.15949469804763794 (0.2556422104438146) | > loss_disc_real_3: 0.1923201084136963 (0.2801055833697319) | > loss_disc_real_4: 0.15078915655612946 (0.2835887322823207) | > loss_disc_real_5: 0.06905557960271835 (0.2757490240037441) | > loss_0: 2.847095251083374 (2.7914427518844604) | > loss_gen: 1.8813555240631104 (2.487195352713267) | > loss_kl: 4.568604946136475 (4.078063865502675) | > loss_feat: 10.793460845947266 (5.207455861071746) | > loss_mel: 24.17398452758789 (18.49408503373464) | > loss_duration: 2.9895498752593994 (2.957335948944092) | > loss_1: 44.40695571899414 (33.224136193593345)  --> STEP: 3 | > loss_disc: 3.0116677284240723 (2.8229034628186906) | > loss_disc_real_0: 0.1746852546930313 (0.18530646924461638) | > loss_disc_real_1: 0.2607935070991516 (0.2743683861834662) | > loss_disc_real_2: 0.25698187947273254 (0.25583359173366) | > loss_disc_real_3: 0.2931744158267975 (0.28197255943502697) | > loss_disc_real_4: 0.3279190957546234 (0.2899216413497925) | > loss_disc_real_5: 0.2618640065193176 (0.2737654500773975) | > loss_0: 3.0116677284240723 (2.8229034628186906) | > loss_gen: 1.5849673748016357 (2.358305641583034) | > loss_kl: 2.5286829471588135 (3.856723734310695) | > loss_feat: 0.10476933419704437 (4.478500642946789) | > loss_mel: 2.271758556365967 (16.17660982268197) | > loss_duration: 2.8008015155792236 (2.934973887034825) | > loss_1: 9.290979385375977 (29.805113792419434) --> EVAL PERFORMANCE | > avg_loader_time: 0.4717897687639509 (+0.45740685008821036) | > avg_loss_disc: 2.8229034628186906 (-0.1094536894843694) | > avg_loss_disc_real_0: 0.18530646924461638 (-0.01748839056208018) | > avg_loss_disc_real_1: 0.2743683861834662 (+0.04639082721301485) | > avg_loss_disc_real_2: 0.25583359173366 (-0.10248098203114103) | > avg_loss_disc_real_3: 0.28197255943502697 (-0.06971912369841621) | > avg_loss_disc_real_4: 0.2899216413497925 (-0.1123364468415578) | > avg_loss_disc_real_5: 0.2737654500773975 (-0.12374344929343178) | > avg_loss_0: 2.8229034628186906 (-0.1094536894843694) | > avg_loss_gen: 2.358305641583034 (-0.08400246642884746) | > avg_loss_kl: 3.856723734310695 (+0.16887087481362473) | > avg_loss_feat: 4.478500642946789 (+0.07255365805966552) | > avg_loss_mel: 16.17660982268197 (-1.7269957973843546) | > avg_loss_duration: 2.934973887034825 (+0.1001451129005071) | > avg_loss_1: 29.805113792419434 (-1.46942965189616)  > EPOCH: 660/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:20:34)   --> TIME: 2023-10-20 07:20:48 -- STEP: 9/50 -- GLOBAL_STEP: 86010 | > loss_disc: 1.9772419929504395 (2.5239580472310386) | > loss_disc_real_0: 0.2074892222881317 (0.1276138878117005) | > loss_disc_real_1: 0.20063164830207825 (0.254358749008841) | > loss_disc_real_2: 0.244947150349617 (0.2601165953609679) | > loss_disc_real_3: 0.21815091371536255 (0.26641812299688655) | > loss_disc_real_4: 0.1879708170890808 (0.2432471083270179) | > loss_disc_real_5: 0.15544363856315613 (0.21366824292474323) | > loss_0: 1.9772419929504395 (2.5239580472310386) | > grad_norm_0: tensor(533.7531, device='cuda:0') (tensor(494.0743, device='cuda:0')) | > loss_gen: 3.19529390335083 (2.342699408531189) | > loss_kl: 0.8042776584625244 (0.7431587709320916) | > loss_feat: 6.248367786407471 (5.475570695267783) | > loss_mel: 23.519268035888672 (18.823762642012703) | > loss_duration: 1.3968063592910767 (1.4559416638480291) | > loss_1: 35.16401290893555 (28.8411316341824) | > grad_norm_1: tensor(6628.9854, device='cuda:0') (tensor(26259.5352, device='cuda:0')) | > current_lr_0: 0.00010336600260739845 | > current_lr_1: 0.00010336600260739845 | > step_time: 0.5712 (0.6262322531806098) | > loader_time: 0.0294 (0.025470601187811956)  --> TIME: 2023-10-20 07:21:08 -- STEP: 39/50 -- GLOBAL_STEP: 86040 | > loss_disc: 2.7067196369171143 (2.427242101767125) | > loss_disc_real_0: 0.2377786636352539 (0.13959628644470984) | > loss_disc_real_1: 0.2500796616077423 (0.2252170552427952) | > loss_disc_real_2: 0.14650197327136993 (0.2216178501645724) | > loss_disc_real_3: 0.09523282945156097 (0.2432944564483104) | > loss_disc_real_4: 0.19909831881523132 (0.2205088537855026) | > loss_disc_real_5: 0.030338104814291 (0.2023195909957091) | > loss_0: 2.7067196369171143 (2.427242101767125) | > grad_norm_0: tensor(1097.0792, device='cuda:0') (tensor(721.5439, device='cuda:0')) | > loss_gen: 2.2870140075683594 (2.3444527662717385) | > loss_kl: 0.9946928024291992 (0.7808083937718318) | > loss_feat: 6.9055070877075195 (5.442968260974455) | > loss_mel: 27.06015968322754 (21.489532082508774) | > loss_duration: 1.5354020595550537 (1.4448153972625732) | > loss_1: 38.782772064208984 (31.502576363392365) | > grad_norm_1: tensor(48057.0781, device='cuda:0') (tensor(22839.0859, device='cuda:0')) | > current_lr_0: 0.00010336600260739845 | > current_lr_1: 0.00010336600260739845 | > step_time: 0.796 (0.6138805487217047) | > loader_time: 0.0291 (0.0266572145315317)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8268985748291016 (2.8268985748291016) | > loss_disc_real_0: 0.07367271184921265 (0.07367271184921265) | > loss_disc_real_1: 0.297615647315979 (0.297615647315979) | > loss_disc_real_2: 0.2727232873439789 (0.2727232873439789) | > loss_disc_real_3: 0.30849799513816833 (0.30849799513816833) | > loss_disc_real_4: 0.3515353500843048 (0.3515353500843048) | > loss_disc_real_5: 0.3135637938976288 (0.3135637938976288) | > loss_0: 2.8268985748291016 (2.8268985748291016) | > loss_gen: 1.9833470582962036 (1.9833470582962036) | > loss_kl: 3.9261860847473145 (3.9261860847473145) | > loss_feat: 1.8769065141677856 (1.8769065141677856) | > loss_mel: 20.427778244018555 (20.427778244018555) | > loss_duration: 2.678875684738159 (2.678875684738159) | > loss_1: 30.89309310913086 (30.89309310913086)  --> STEP: 1 | > loss_disc: 1.9205853939056396 (1.9205853939056396) | > loss_disc_real_0: 0.033625900745391846 (0.033625900745391846) | > loss_disc_real_1: 0.1218835860490799 (0.1218835860490799) | > loss_disc_real_2: 0.18381796777248383 (0.18381796777248383) | > loss_disc_real_3: 0.1343613862991333 (0.1343613862991333) | > loss_disc_real_4: 0.07099279761314392 (0.07099279761314392) | > loss_disc_real_5: 0.031176405027508736 (0.031176405027508736) | > loss_0: 1.9205853939056396 (1.9205853939056396) | > loss_gen: 2.0415523052215576 (2.0415523052215576) | > loss_kl: 4.7952117919921875 (4.7952117919921875) | > loss_feat: 10.555571556091309 (10.555571556091309) | > loss_mel: 26.434907913208008 (26.434907913208008) | > loss_duration: 3.007699489593506 (3.007699489593506) | > loss_1: 46.83494186401367 (46.83494186401367)  --> STEP: 2 | > loss_disc: 2.1228463649749756 (2.0217158794403076) | > loss_disc_real_0: 0.14901885390281677 (0.09132237732410431) | > loss_disc_real_1: 0.2958270013332367 (0.2088552936911583) | > loss_disc_real_2: 0.27727487683296204 (0.23054642230272293) | > loss_disc_real_3: 0.29301413893699646 (0.21368776261806488) | > loss_disc_real_4: 0.2558806836605072 (0.16343674063682556) | > loss_disc_real_5: 0.1701599657535553 (0.10066818539053202) | > loss_0: 2.1228463649749756 (2.0217158794403076) | > loss_gen: 3.1965365409851074 (2.6190444231033325) | > loss_kl: 5.176390647888184 (4.9858012199401855) | > loss_feat: 7.75256872177124 (9.154070138931274) | > loss_mel: 26.425180435180664 (26.430044174194336) | > loss_duration: 2.8789350986480713 (2.9433172941207886) | > loss_1: 45.42961502075195 (46.13227844238281)  --> STEP: 3 | > loss_disc: 2.521638870239258 (2.188356876373291) | > loss_disc_real_0: 0.0767180323600769 (0.08645426233609517) | > loss_disc_real_1: 0.1840471476316452 (0.2005859116713206) | > loss_disc_real_2: 0.1886400729417801 (0.21657763918240866) | > loss_disc_real_3: 0.24398191273212433 (0.2237858126560847) | > loss_disc_real_4: 0.40009257197380066 (0.2423220177491506) | > loss_disc_real_5: 0.37942707538604736 (0.19358781538903713) | > loss_0: 2.521638870239258 (2.188356876373291) | > loss_gen: 2.1063027381896973 (2.4481305281321206) | > loss_kl: 2.367926836013794 (4.113176425298055) | > loss_feat: 3.1438469886779785 (7.150662422180176) | > loss_mel: 20.763919830322266 (24.541336059570312) | > loss_duration: 2.722705125808716 (2.869779904683431) | > loss_1: 31.10470199584961 (41.123086293538414) --> EVAL PERFORMANCE | > avg_loader_time: 0.006788969039916992 (-0.4650007997240339) | > avg_loss_disc: 2.188356876373291 (-0.6345465864453996) | > avg_loss_disc_real_0: 0.08645426233609517 (-0.09885220690852121) | > avg_loss_disc_real_1: 0.2005859116713206 (-0.07378247451214562) | > avg_loss_disc_real_2: 0.21657763918240866 (-0.03925595255125133) | > avg_loss_disc_real_3: 0.2237858126560847 (-0.05818674677894228) | > avg_loss_disc_real_4: 0.2423220177491506 (-0.04759962360064188) | > avg_loss_disc_real_5: 0.19358781538903713 (-0.08017763468836037) | > avg_loss_0: 2.188356876373291 (-0.6345465864453996) | > avg_loss_gen: 2.4481305281321206 (+0.08982488654908671) | > avg_loss_kl: 4.113176425298055 (+0.2564526909873597) | > avg_loss_feat: 7.150662422180176 (+2.672161779233387) | > avg_loss_mel: 24.541336059570312 (+8.364726236888341) | > avg_loss_duration: 2.869779904683431 (-0.06519398235139384) | > avg_loss_1: 41.123086293538414 (+11.31797250111898)  > EPOCH: 661/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:21:34)   --> TIME: 2023-10-20 07:21:50 -- STEP: 19/50 -- GLOBAL_STEP: 86070 | > loss_disc: 3.0114455223083496 (2.613092824032432) | > loss_disc_real_0: 0.2802279591560364 (0.1689626792151677) | > loss_disc_real_1: 0.2446223646402359 (0.23213658540656693) | > loss_disc_real_2: 0.27428609132766724 (0.2666759083145543) | > loss_disc_real_3: 0.24974198639392853 (0.22837046906352043) | > loss_disc_real_4: 0.2841942608356476 (0.24978340338719518) | > loss_disc_real_5: 0.27834606170654297 (0.22313695440166875) | > loss_0: 3.0114455223083496 (2.613092824032432) | > grad_norm_0: tensor(346.2224, device='cuda:0') (tensor(692.0793, device='cuda:0')) | > loss_gen: 1.5627007484436035 (2.19103993867573) | > loss_kl: 0.7688806056976318 (0.8653215832616153) | > loss_feat: 0.03830435872077942 (4.9355186800423425) | > loss_mel: 2.5544867515563965 (20.350200502496016) | > loss_duration: 1.540615200996399 (1.4781475255363865) | > loss_1: 6.464987754821777 (29.82022862685354) | > grad_norm_1: tensor(16924.0137, device='cuda:0') (tensor(22118.9902, device='cuda:0')) | > current_lr_0: 0.00010326268181611327 | > current_lr_1: 0.00010326268181611327 | > step_time: 0.3159 (0.549323659194143) | > loader_time: 0.0022 (0.01410104099072908)  --> TIME: 2023-10-20 07:22:09 -- STEP: 49/50 -- GLOBAL_STEP: 86100 | > loss_disc: 1.7136038541793823 (2.624599811982135) | > loss_disc_real_0: 0.014614035375416279 (0.16330616166625103) | > loss_disc_real_1: 0.14673590660095215 (0.23701457321947936) | > loss_disc_real_2: 0.09724077582359314 (0.24658799141037224) | > loss_disc_real_3: 0.24468477070331573 (0.23485627276252727) | > loss_disc_real_4: 0.09972157329320908 (0.2468975218659153) | > loss_disc_real_5: 0.0864492803812027 (0.2484108956188571) | > loss_0: 1.7136038541793823 (2.624599811982135) | > grad_norm_0: tensor(977.1214, device='cuda:0') (tensor(628.4510, device='cuda:0')) | > loss_gen: 2.6816816329956055 (2.099773105309934) | > loss_kl: 0.6691427826881409 (0.7828675744560908) | > loss_feat: 8.399235725402832 (3.967361363107149) | > loss_mel: 24.577579498291016 (17.97800038663709) | > loss_duration: 1.6065175533294678 (1.452719192115628) | > loss_1: 37.93415832519531 (26.280721839593383) | > grad_norm_1: tensor(59836.8633, device='cuda:0') (tensor(21609.0020, device='cuda:0')) | > current_lr_0: 0.00010326268181611327 | > current_lr_1: 0.00010326268181611327 | > step_time: 0.8347 (0.5797452440067214) | > loader_time: 0.4673 (0.027500473723119617)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.800534725189209 (2.800534725189209) | > loss_disc_real_0: 0.4051039516925812 (0.4051039516925812) | > loss_disc_real_1: 0.31704750657081604 (0.31704750657081604) | > loss_disc_real_2: 0.28981533646583557 (0.28981533646583557) | > loss_disc_real_3: 0.2379143089056015 (0.2379143089056015) | > loss_disc_real_4: 0.3985813856124878 (0.3985813856124878) | > loss_disc_real_5: 0.25338584184646606 (0.25338584184646606) | > loss_0: 2.800534725189209 (2.800534725189209) | > loss_gen: 2.6951000690460205 (2.6951000690460205) | > loss_kl: 3.630920648574829 (3.630920648574829) | > loss_feat: 6.214865684509277 (6.214865684509277) | > loss_mel: 22.456798553466797 (22.456798553466797) | > loss_duration: 2.6272895336151123 (2.6272895336151123) | > loss_1: 37.62497329711914 (37.62497329711914)  --> STEP: 1 | > loss_disc: 2.624053716659546 (2.624053716659546) | > loss_disc_real_0: 0.1414552927017212 (0.1414552927017212) | > loss_disc_real_1: 0.22424115240573883 (0.22424115240573883) | > loss_disc_real_2: 0.14003914594650269 (0.14003914594650269) | > loss_disc_real_3: 0.25104549527168274 (0.25104549527168274) | > loss_disc_real_4: 0.2550593614578247 (0.2550593614578247) | > loss_disc_real_5: 0.2433701753616333 (0.2433701753616333) | > loss_0: 2.624053716659546 (2.624053716659546) | > loss_gen: 1.8087306022644043 (1.8087306022644043) | > loss_kl: 4.208128929138184 (4.208128929138184) | > loss_feat: 1.807386040687561 (1.807386040687561) | > loss_mel: 18.935880661010742 (18.935880661010742) | > loss_duration: 3.022137403488159 (3.022137403488159) | > loss_1: 29.782262802124023 (29.782262802124023)  --> STEP: 2 | > loss_disc: 2.483365297317505 (2.5537095069885254) | > loss_disc_real_0: 0.23678815364837646 (0.18912172317504883) | > loss_disc_real_1: 0.349408358335495 (0.2868247553706169) | > loss_disc_real_2: 0.15022017061710358 (0.14512965828180313) | > loss_disc_real_3: 0.1764182597398758 (0.21373187750577927) | > loss_disc_real_4: 0.2510397434234619 (0.2530495524406433) | > loss_disc_real_5: 0.2382914423942566 (0.24083080887794495) | > loss_0: 2.483365297317505 (2.5537095069885254) | > loss_gen: 2.3280043601989746 (2.0683674812316895) | > loss_kl: 4.719900131225586 (4.464014530181885) | > loss_feat: 6.017710208892822 (3.9125481247901917) | > loss_mel: 25.6702880859375 (22.30308437347412) | > loss_duration: 2.900067090988159 (2.961102247238159) | > loss_1: 41.63596725463867 (35.70911502838135)  --> STEP: 3 | > loss_disc: 2.96590256690979 (2.691107193628947) | > loss_disc_real_0: 0.25096577405929565 (0.2097364068031311) | > loss_disc_real_1: 0.2645987272262573 (0.27941607932249707) | > loss_disc_real_2: 0.25586122274398804 (0.1820401797691981) | > loss_disc_real_3: 0.25728124380111694 (0.2282483329375585) | > loss_disc_real_4: 0.2812196612358093 (0.26243958870569867) | > loss_disc_real_5: 0.24430140852928162 (0.2419876754283905) | > loss_0: 2.96590256690979 (2.691107193628947) | > loss_gen: 1.5964076519012451 (1.9110475381215413) | > loss_kl: 2.3500256538391113 (3.7593515714009604) | > loss_feat: 0.1921459138393402 (2.6724140544732413) | > loss_mel: 5.234976291656494 (16.613715012868244) | > loss_duration: 2.7214910984039307 (2.8812318642934165) | > loss_1: 12.095046043395996 (27.8377587000529) --> EVAL PERFORMANCE | > avg_loader_time: 0.021679401397705078 (+0.014890432357788086) | > avg_loss_disc: 2.691107193628947 (+0.5027503172556558) | > avg_loss_disc_real_0: 0.2097364068031311 (+0.12328214446703593) | > avg_loss_disc_real_1: 0.27941607932249707 (+0.07883016765117648) | > avg_loss_disc_real_2: 0.1820401797691981 (-0.03453745941321057) | > avg_loss_disc_real_3: 0.2282483329375585 (+0.004462520281473814) | > avg_loss_disc_real_4: 0.26243958870569867 (+0.020117570956548064) | > avg_loss_disc_real_5: 0.2419876754283905 (+0.04839986003935337) | > avg_loss_0: 2.691107193628947 (+0.5027503172556558) | > avg_loss_gen: 1.9110475381215413 (-0.5370829900105794) | > avg_loss_kl: 3.7593515714009604 (-0.3538248538970943) | > avg_loss_feat: 2.6724140544732413 (-4.478248367706934) | > avg_loss_mel: 16.613715012868244 (-7.927621046702068) | > avg_loss_duration: 2.8812318642934165 (+0.011451959609985352) | > avg_loss_1: 27.8377587000529 (-13.285327593485516)  > EPOCH: 662/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:22:25)   --> TIME: 2023-10-20 07:22:50 -- STEP: 29/50 -- GLOBAL_STEP: 86130 | > loss_disc: 1.8632878065109253 (2.4068967021744827) | > loss_disc_real_0: 0.09051000326871872 (0.14194413380504683) | > loss_disc_real_1: 0.25551077723503113 (0.23086595625199122) | > loss_disc_real_2: 0.20878490805625916 (0.22201821381418868) | > loss_disc_real_3: 0.15203511714935303 (0.24060167452513148) | > loss_disc_real_4: 0.2234228253364563 (0.2090651922827137) | > loss_disc_real_5: 0.1075548455119133 (0.22380408028076434) | > loss_0: 1.8632878065109253 (2.4068967021744827) | > grad_norm_0: tensor(568.5627, device='cuda:0') (tensor(627.8936, device='cuda:0')) | > loss_gen: 2.907320976257324 (2.4084816513390366) | > loss_kl: 0.8677501082420349 (0.8560403739583904) | > loss_feat: 7.762406349182129 (6.057500447692542) | > loss_mel: 24.46896743774414 (21.763107357354) | > loss_duration: 1.409988284111023 (1.4655840437987755) | > loss_1: 37.41643524169922 (32.55071358845152) | > grad_norm_1: tensor(32180.7148, device='cuda:0') (tensor(26999.9961, device='cuda:0')) | > current_lr_0: 0.00010315946430042782 | > current_lr_1: 0.00010315946430042782 | > step_time: 0.5487 (0.4901890590273101) | > loader_time: 0.0073 (0.014133280721204034)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9670300483703613 (2.9670300483703613) | > loss_disc_real_0: 0.2008759081363678 (0.2008759081363678) | > loss_disc_real_1: 0.30518603324890137 (0.30518603324890137) | > loss_disc_real_2: 0.28158238530158997 (0.28158238530158997) | > loss_disc_real_3: 0.2927045524120331 (0.2927045524120331) | > loss_disc_real_4: 0.2973994016647339 (0.2973994016647339) | > loss_disc_real_5: 0.3562658727169037 (0.3562658727169037) | > loss_0: 2.9670300483703613 (2.9670300483703613) | > loss_gen: 1.8012938499450684 (1.8012938499450684) | > loss_kl: 3.5142250061035156 (3.5142250061035156) | > loss_feat: 0.4815691411495209 (0.4815691411495209) | > loss_mel: 8.258140563964844 (8.258140563964844) | > loss_duration: 2.7675349712371826 (2.7675349712371826) | > loss_1: 16.822763442993164 (16.822763442993164)  --> STEP: 1 | > loss_disc: 2.280169725418091 (2.280169725418091) | > loss_disc_real_0: 0.15802402794361115 (0.15802402794361115) | > loss_disc_real_1: 0.27888694405555725 (0.27888694405555725) | > loss_disc_real_2: 0.2579064965248108 (0.2579064965248108) | > loss_disc_real_3: 0.34882569313049316 (0.34882569313049316) | > loss_disc_real_4: 0.24391824007034302 (0.24391824007034302) | > loss_disc_real_5: 0.3514458239078522 (0.3514458239078522) | > loss_0: 2.280169725418091 (2.280169725418091) | > loss_gen: 3.4046437740325928 (3.4046437740325928) | > loss_kl: 4.225215435028076 (4.225215435028076) | > loss_feat: 5.99462890625 (5.99462890625) | > loss_mel: 26.792465209960938 (26.792465209960938) | > loss_duration: 3.024578332901001 (3.024578332901001) | > loss_1: 43.441532135009766 (43.441532135009766)  --> STEP: 2 | > loss_disc: 2.7476842403411865 (2.5139269828796387) | > loss_disc_real_0: 0.26227426528930664 (0.2101491466164589) | > loss_disc_real_1: 0.3563600480556488 (0.317623496055603) | > loss_disc_real_2: 0.2179965078830719 (0.23795150220394135) | > loss_disc_real_3: 0.3970765173435211 (0.37295110523700714) | > loss_disc_real_4: 0.22384333610534668 (0.23388078808784485) | > loss_disc_real_5: 0.3834642469882965 (0.36745503544807434) | > loss_0: 2.7476842403411865 (2.5139269828796387) | > loss_gen: 3.031874656677246 (3.2182592153549194) | > loss_kl: 5.186183929443359 (4.705699682235718) | > loss_feat: 4.233013153076172 (5.113821029663086) | > loss_mel: 25.67529296875 (26.23387908935547) | > loss_duration: 2.9431726932525635 (2.9838755130767822) | > loss_1: 41.06953811645508 (42.25553512573242)  --> STEP: 3 | > loss_disc: 2.334834337234497 (2.4542294343312583) | > loss_disc_real_0: 0.20562808215618134 (0.2086421251296997) | > loss_disc_real_1: 0.3205697536468506 (0.31860558191935223) | > loss_disc_real_2: 0.35088348388671875 (0.2755954960982005) | > loss_disc_real_3: 0.3546602725982666 (0.36685416102409363) | > loss_disc_real_4: 0.34044700860977173 (0.2694028615951538) | > loss_disc_real_5: 0.3254280090332031 (0.35344602664311725) | > loss_0: 2.334834337234497 (2.4542294343312583) | > loss_gen: 4.388996124267578 (3.608504851659139) | > loss_kl: 1.9637680053710938 (3.7917224566141763) | > loss_feat: 6.617464542388916 (5.615035533905029) | > loss_mel: 22.20843505859375 (24.892064412434895) | > loss_duration: 2.6768758296966553 (2.8815422852834067) | > loss_1: 37.85554122924805 (40.78887049357096) --> EVAL PERFORMANCE | > avg_loader_time: 0.007822354634602865 (-0.013857046763102213) | > avg_loss_disc: 2.4542294343312583 (-0.2368777592976885) | > avg_loss_disc_real_0: 0.2086421251296997 (-0.0010942816734313965) | > avg_loss_disc_real_1: 0.31860558191935223 (+0.039189502596855164) | > avg_loss_disc_real_2: 0.2755954960982005 (+0.09355531632900241) | > avg_loss_disc_real_3: 0.36685416102409363 (+0.13860582808653513) | > avg_loss_disc_real_4: 0.2694028615951538 (+0.006963272889455141) | > avg_loss_disc_real_5: 0.35344602664311725 (+0.11145835121472675) | > avg_loss_0: 2.4542294343312583 (-0.2368777592976885) | > avg_loss_gen: 3.608504851659139 (+1.6974573135375979) | > avg_loss_kl: 3.7917224566141763 (+0.03237088521321585) | > avg_loss_feat: 5.615035533905029 (+2.942621479431788) | > avg_loss_mel: 24.892064412434895 (+8.27834939956665) | > avg_loss_duration: 2.8815422852834067 (+0.0003104209899902344) | > avg_loss_1: 40.78887049357096 (+12.951111793518063)  > EPOCH: 663/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:23:18)   --> TIME: 2023-10-20 07:23:30 -- STEP: 9/50 -- GLOBAL_STEP: 86160 | > loss_disc: 2.7311129570007324 (2.3821507891019187) | > loss_disc_real_0: 0.0870099663734436 (0.09392572918699847) | > loss_disc_real_1: 0.36581841111183167 (0.23864979876412284) | > loss_disc_real_2: 0.3319283425807953 (0.2246878705918789) | > loss_disc_real_3: 0.30675771832466125 (0.2385072453568379) | > loss_disc_real_4: 0.3148956894874573 (0.2071034475747082) | > loss_disc_real_5: 0.38823598623275757 (0.22818463719967338) | > loss_0: 2.7311129570007324 (2.3821507891019187) | > grad_norm_0: tensor(394.3292, device='cuda:0') (tensor(929.3365, device='cuda:0')) | > loss_gen: 2.4924380779266357 (2.542211174964905) | > loss_kl: 0.5874500870704651 (0.7640195687611898) | > loss_feat: 3.914243459701538 (6.1462404529253645) | > loss_mel: 24.935110092163086 (20.901560253567165) | > loss_duration: 1.4016015529632568 (1.4740739663441975) | > loss_1: 33.330841064453125 (31.828105608622234) | > grad_norm_1: tensor(2890.6624, device='cuda:0') (tensor(30717.9961, device='cuda:0')) | > current_lr_0: 0.00010305634995711168 | > current_lr_1: 0.00010305634995711168 | > step_time: 0.3973 (0.5828251308865018) | > loader_time: 0.014 (0.017969502343071833)  --> TIME: 2023-10-20 07:23:50 -- STEP: 39/50 -- GLOBAL_STEP: 86190 | > loss_disc: 2.7918519973754883 (2.4461207940028262) | > loss_disc_real_0: 0.09763452410697937 (0.13074748557156476) | > loss_disc_real_1: 0.30300211906433105 (0.23169338416594726) | > loss_disc_real_2: 0.2941873073577881 (0.2233111991141087) | > loss_disc_real_3: 0.18712502717971802 (0.2615299542458393) | > loss_disc_real_4: 0.28258877992630005 (0.21521658572153404) | > loss_disc_real_5: 0.2957128882408142 (0.22959769677179745) | > loss_0: 2.7918519973754883 (2.4461207940028262) | > grad_norm_0: tensor(423.9601, device='cuda:0') (tensor(804.0117, device='cuda:0')) | > loss_gen: 1.7700825929641724 (2.3967104447193637) | > loss_kl: 0.7835706472396851 (0.8292666811209458) | > loss_feat: 1.4119794368743896 (5.929717242717743) | > loss_mel: 19.789369583129883 (22.12297321588565) | > loss_duration: 1.5386697053909302 (1.448951984063173) | > loss_1: 25.293672561645508 (32.72761970911271) | > grad_norm_1: tensor(4727.9360, device='cuda:0') (tensor(29247.8496, device='cuda:0')) | > current_lr_0: 0.00010305634995711168 | > current_lr_1: 0.00010305634995711168 | > step_time: 0.6471 (0.6311494815043914) | > loader_time: 0.0378 (0.020879476498334836)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6350178718566895 (2.6350178718566895) | > loss_disc_real_0: 0.17761468887329102 (0.17761468887329102) | > loss_disc_real_1: 0.27898141741752625 (0.27898141741752625) | > loss_disc_real_2: 0.20119759440422058 (0.20119759440422058) | > loss_disc_real_3: 0.2550453543663025 (0.2550453543663025) | > loss_disc_real_4: 0.2554725110530853 (0.2554725110530853) | > loss_disc_real_5: 0.24064628779888153 (0.24064628779888153) | > loss_0: 2.6350178718566895 (2.6350178718566895) | > loss_gen: 2.0028553009033203 (2.0028553009033203) | > loss_kl: 4.169663906097412 (4.169663906097412) | > loss_feat: 3.0403013229370117 (3.0403013229370117) | > loss_mel: 21.23712921142578 (21.23712921142578) | > loss_duration: 2.7175588607788086 (2.7175588607788086) | > loss_1: 33.16750717163086 (33.16750717163086)  --> STEP: 1 | > loss_disc: 3.3653571605682373 (3.3653571605682373) | > loss_disc_real_0: 0.6848437786102295 (0.6848437786102295) | > loss_disc_real_1: 0.38719895482063293 (0.38719895482063293) | > loss_disc_real_2: 0.4603874981403351 (0.4603874981403351) | > loss_disc_real_3: 0.30980610847473145 (0.30980610847473145) | > loss_disc_real_4: 0.2512853741645813 (0.2512853741645813) | > loss_disc_real_5: 0.2631593346595764 (0.2631593346595764) | > loss_0: 3.3653571605682373 (3.3653571605682373) | > loss_gen: 3.120652198791504 (3.120652198791504) | > loss_kl: 4.814506530761719 (4.814506530761719) | > loss_feat: 6.625548839569092 (6.625548839569092) | > loss_mel: 22.921205520629883 (22.921205520629883) | > loss_duration: 3.0401768684387207 (3.0401768684387207) | > loss_1: 40.52208709716797 (40.52208709716797)  --> STEP: 2 | > loss_disc: 1.7324821949005127 (2.548919677734375) | > loss_disc_real_0: 0.02876470610499382 (0.35680424235761166) | > loss_disc_real_1: 0.1633889526128769 (0.2752939537167549) | > loss_disc_real_2: 0.20640656352043152 (0.3333970308303833) | > loss_disc_real_3: 0.18188200891017914 (0.2458440586924553) | > loss_disc_real_4: 0.21506810188293457 (0.23317673802375793) | > loss_disc_real_5: 0.0976315587759018 (0.1803954467177391) | > loss_0: 1.7324821949005127 (2.548919677734375) | > loss_gen: 2.7479615211486816 (2.9343068599700928) | > loss_kl: 4.34945011138916 (4.5819783210754395) | > loss_feat: 11.069217681884766 (8.847383260726929) | > loss_mel: 23.58110809326172 (23.2511568069458) | > loss_duration: 2.9249236583709717 (2.982550263404846) | > loss_1: 44.67266082763672 (42.597373962402344)  --> STEP: 3 | > loss_disc: 2.9236865043640137 (2.673841953277588) | > loss_disc_real_0: 0.30104219913482666 (0.3382168946166833) | > loss_disc_real_1: 0.2983589768409729 (0.2829822947581609) | > loss_disc_real_2: 0.2990829050540924 (0.321958988904953) | > loss_disc_real_3: 0.295379102230072 (0.2623557398716609) | > loss_disc_real_4: 0.25372952222824097 (0.24002766609191895) | > loss_disc_real_5: 0.1940447986125946 (0.18494523068269095) | > loss_0: 2.9236865043640137 (2.673841953277588) | > loss_gen: 1.7842806577682495 (2.5509647925694785) | > loss_kl: 2.3330538272857666 (3.8323368231455484) | > loss_feat: 0.890013575553894 (6.1949266990025835) | > loss_mel: 16.527061462402344 (21.00979169209798) | > loss_duration: 2.7570741176605225 (2.9073915481567383) | > loss_1: 24.291484832763672 (36.49541091918945) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024434725443522134 (-0.005378882090250652) | > avg_loss_disc: 2.673841953277588 (+0.2196125189463296) | > avg_loss_disc_real_0: 0.3382168946166833 (+0.1295747694869836) | > avg_loss_disc_real_1: 0.2829822947581609 (-0.03562328716119134) | > avg_loss_disc_real_2: 0.321958988904953 (+0.046363492806752504) | > avg_loss_disc_real_3: 0.2623557398716609 (-0.10449842115243274) | > avg_loss_disc_real_4: 0.24002766609191895 (-0.029375195503234863) | > avg_loss_disc_real_5: 0.18494523068269095 (-0.1685007959604263) | > avg_loss_0: 2.673841953277588 (+0.2196125189463296) | > avg_loss_gen: 2.5509647925694785 (-1.0575400590896606) | > avg_loss_kl: 3.8323368231455484 (+0.04061436653137207) | > avg_loss_feat: 6.1949266990025835 (+0.5798911650975542) | > avg_loss_mel: 21.00979169209798 (-3.882272720336914) | > avg_loss_duration: 2.9073915481567383 (+0.025849262873331558) | > avg_loss_1: 36.49541091918945 (-4.293459574381508)  > EPOCH: 664/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:24:15)   --> TIME: 2023-10-20 07:24:29 -- STEP: 19/50 -- GLOBAL_STEP: 86220 | > loss_disc: 3.0013585090637207 (2.408331362824691) | > loss_disc_real_0: 0.13123124837875366 (0.14118888238935093) | > loss_disc_real_1: 0.32369449734687805 (0.22713307899079824) | > loss_disc_real_2: 0.25095173716545105 (0.2263358372606729) | > loss_disc_real_3: 0.2697857916355133 (0.25146429495591865) | > loss_disc_real_4: 0.28933992981910706 (0.2367757786261408) | > loss_disc_real_5: 0.24952159821987152 (0.22832254087552428) | > loss_0: 3.0013585090637207 (2.408331362824691) | > grad_norm_0: tensor(805.1446, device='cuda:0') (tensor(704.4001, device='cuda:0')) | > loss_gen: 1.7115328311920166 (2.4353837527726827) | > loss_kl: 0.7631786465644836 (0.7836952170259074) | > loss_feat: 2.456686019897461 (5.835227008712919) | > loss_mel: 20.958480834960938 (22.371846700969495) | > loss_duration: 1.522632360458374 (1.470645691219129) | > loss_1: 27.41250991821289 (32.89679818404348) | > grad_norm_1: tensor(2102.0859, device='cuda:0') (tensor(28452.5371, device='cuda:0')) | > current_lr_0: 0.00010295333868303763 | > current_lr_1: 0.00010295333868303763 | > step_time: 0.3921 (0.48686664982845906) | > loader_time: 0.0031 (0.014391397175035979)  --> TIME: 2023-10-20 07:24:49 -- STEP: 49/50 -- GLOBAL_STEP: 86250 | > loss_disc: 2.9171833992004395 (2.482729670952777) | > loss_disc_real_0: 0.016637472435832024 (0.15678175189057172) | > loss_disc_real_1: 0.19696491956710815 (0.2329632840594467) | > loss_disc_real_2: 0.22617250680923462 (0.22882612707207398) | > loss_disc_real_3: 0.30302777886390686 (0.24199879298708876) | > loss_disc_real_4: 0.27775031328201294 (0.22400913336219228) | > loss_disc_real_5: 0.27131205797195435 (0.22034147230680196) | > loss_0: 2.9171833992004395 (2.482729670952777) | > grad_norm_0: tensor(2632.3108, device='cuda:0') (tensor(772.8795, device='cuda:0')) | > loss_gen: 1.7230502367019653 (2.3140689377882047) | > loss_kl: 0.5893447995185852 (0.8190178782964239) | > loss_feat: 1.6540569067001343 (5.385421503563319) | > loss_mel: 23.744041442871094 (21.43917331890184) | > loss_duration: 1.5689306259155273 (1.4342155383557689) | > loss_1: 29.27942657470703 (31.39189761998702) | > grad_norm_1: tensor(3793.2161, device='cuda:0') (tensor(22433.4434, device='cuda:0')) | > current_lr_0: 0.00010295333868303763 | > current_lr_1: 0.00010295333868303763 | > step_time: 0.5631 (0.5599950576315122) | > loader_time: 0.4241 (0.028184126834480124)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8167734146118164 (2.8167734146118164) | > loss_disc_real_0: 0.08196963369846344 (0.08196963369846344) | > loss_disc_real_1: 0.25024324655532837 (0.25024324655532837) | > loss_disc_real_2: 0.29192522168159485 (0.29192522168159485) | > loss_disc_real_3: 0.306392639875412 (0.306392639875412) | > loss_disc_real_4: 0.24925191700458527 (0.24925191700458527) | > loss_disc_real_5: 0.22636651992797852 (0.22636651992797852) | > loss_0: 2.8167734146118164 (2.8167734146118164) | > loss_gen: 1.6609774827957153 (1.6609774827957153) | > loss_kl: 4.531304359436035 (4.531304359436035) | > loss_feat: 1.357749342918396 (1.357749342918396) | > loss_mel: 20.561077117919922 (20.561077117919922) | > loss_duration: 2.6699445247650146 (2.6699445247650146) | > loss_1: 30.78105354309082 (30.78105354309082)  --> STEP: 1 | > loss_disc: 2.3828072547912598 (2.3828072547912598) | > loss_disc_real_0: 0.18359726667404175 (0.18359726667404175) | > loss_disc_real_1: 0.3120279014110565 (0.3120279014110565) | > loss_disc_real_2: 0.20561279356479645 (0.20561279356479645) | > loss_disc_real_3: 0.2843189835548401 (0.2843189835548401) | > loss_disc_real_4: 0.27663320302963257 (0.27663320302963257) | > loss_disc_real_5: 0.2524228096008301 (0.2524228096008301) | > loss_0: 2.3828072547912598 (2.3828072547912598) | > loss_gen: 2.582202911376953 (2.582202911376953) | > loss_kl: 4.562285423278809 (4.562285423278809) | > loss_feat: 7.434199333190918 (7.434199333190918) | > loss_mel: 24.015724182128906 (24.015724182128906) | > loss_duration: 3.1020667552948 (3.1020667552948) | > loss_1: 41.696475982666016 (41.696475982666016)  --> STEP: 2 | > loss_disc: 3.044407367706299 (2.7136073112487793) | > loss_disc_real_0: 0.1110120415687561 (0.14730465412139893) | > loss_disc_real_1: 0.27115222811698914 (0.2915900647640228) | > loss_disc_real_2: 0.2608222961425781 (0.2332175448536873) | > loss_disc_real_3: 0.2934216856956482 (0.28887033462524414) | > loss_disc_real_4: 0.27506670355796814 (0.27584995329380035) | > loss_disc_real_5: 0.27359092235565186 (0.26300686597824097) | > loss_0: 3.044407367706299 (2.7136073112487793) | > loss_gen: 1.4926042556762695 (2.0374035835266113) | > loss_kl: 4.5439276695251465 (4.5531065464019775) | > loss_feat: 0.3540104627609253 (3.8941048979759216) | > loss_mel: 10.158004760742188 (17.086864471435547) | > loss_duration: 3.0348668098449707 (3.0684667825698853) | > loss_1: 19.583412170410156 (30.639944076538086)  --> STEP: 3 | > loss_disc: 3.0820059776306152 (2.836406866709391) | > loss_disc_real_0: 0.14896169304847717 (0.14785700043042502) | > loss_disc_real_1: 0.26415547728538513 (0.2824452022711436) | > loss_disc_real_2: 0.3251357078552246 (0.2638569325208664) | > loss_disc_real_3: 0.29406794905662537 (0.2906028727690379) | > loss_disc_real_4: 0.296732097864151 (0.2828106681505839) | > loss_disc_real_5: 0.2817220985889435 (0.26924527684847516) | > loss_0: 3.0820059776306152 (2.836406866709391) | > loss_gen: 1.6324262619018555 (1.9024111429850261) | > loss_kl: 2.011756420135498 (3.7059898376464844) | > loss_feat: 0.6842251420021057 (2.824144979317983) | > loss_mel: 16.09552001953125 (16.75641632080078) | > loss_duration: 2.960435152053833 (3.0324562390645347) | > loss_1: 23.384363174438477 (28.22141710917155) --> EVAL PERFORMANCE | > avg_loader_time: 0.013782898585001627 (+0.011339426040649414) | > avg_loss_disc: 2.836406866709391 (+0.16256491343180324) | > avg_loss_disc_real_0: 0.14785700043042502 (-0.1903598941862583) | > avg_loss_disc_real_1: 0.2824452022711436 (-0.0005370924870172766) | > avg_loss_disc_real_2: 0.2638569325208664 (-0.05810205638408661) | > avg_loss_disc_real_3: 0.2906028727690379 (+0.028247132897377014) | > avg_loss_disc_real_4: 0.2828106681505839 (+0.042783002058664976) | > avg_loss_disc_real_5: 0.26924527684847516 (+0.08430004616578421) | > avg_loss_0: 2.836406866709391 (+0.16256491343180324) | > avg_loss_gen: 1.9024111429850261 (-0.6485536495844524) | > avg_loss_kl: 3.7059898376464844 (-0.12634698549906398) | > avg_loss_feat: 2.824144979317983 (-3.3707817196846004) | > avg_loss_mel: 16.75641632080078 (-4.253375371297199) | > avg_loss_duration: 3.0324562390645347 (+0.12506469090779637) | > avg_loss_1: 28.22141710917155 (-8.273993810017902)  > EPOCH: 665/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:25:02)   --> TIME: 2023-10-20 07:25:25 -- STEP: 29/50 -- GLOBAL_STEP: 86280 | > loss_disc: 2.2315621376037598 (2.545685648918152) | > loss_disc_real_0: 0.12935234606266022 (0.17216119677599134) | > loss_disc_real_1: 0.21328358352184296 (0.2357551554410622) | > loss_disc_real_2: 0.1852998584508896 (0.22785690311214019) | > loss_disc_real_3: 0.21339274942874908 (0.2398816610461679) | > loss_disc_real_4: 0.16171228885650635 (0.2446469756421344) | > loss_disc_real_5: 0.11969765275716782 (0.2373367858857944) | > loss_0: 2.2315621376037598 (2.545685648918152) | > grad_norm_0: tensor(297.8083, device='cuda:0') (tensor(674.0811, device='cuda:0')) | > loss_gen: 2.099177122116089 (2.2580109135857938) | > loss_kl: 0.9186562895774841 (0.8642084773244529) | > loss_feat: 3.4278547763824463 (4.9320652312759705) | > loss_mel: 19.388444900512695 (20.465661390074366) | > loss_duration: 1.4442691802978516 (1.4549916694904197) | > loss_1: 27.278400421142578 (29.97493766916209) | > grad_norm_1: tensor(4036.9619, device='cuda:0') (tensor(23284.2578, device='cuda:0')) | > current_lr_0: 0.0001028504303751815 | > current_lr_1: 0.0001028504303751815 | > step_time: 0.3152 (0.5623277302446037) | > loader_time: 0.0062 (0.0223787653035131)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8568572998046875 (2.8568572998046875) | > loss_disc_real_0: 0.3273274898529053 (0.3273274898529053) | > loss_disc_real_1: 0.2434433102607727 (0.2434433102607727) | > loss_disc_real_2: 0.14273782074451447 (0.14273782074451447) | > loss_disc_real_3: 0.3212333023548126 (0.3212333023548126) | > loss_disc_real_4: 0.1385413259267807 (0.1385413259267807) | > loss_disc_real_5: 0.4116193354129791 (0.4116193354129791) | > loss_0: 2.8568572998046875 (2.8568572998046875) | > loss_gen: 1.901383638381958 (1.901383638381958) | > loss_kl: 3.783008575439453 (3.783008575439453) | > loss_feat: 5.486708164215088 (5.486708164215088) | > loss_mel: 22.034908294677734 (22.034908294677734) | > loss_duration: 2.7345681190490723 (2.7345681190490723) | > loss_1: 35.94057846069336 (35.94057846069336)  --> STEP: 1 | > loss_disc: 3.341806173324585 (3.341806173324585) | > loss_disc_real_0: 0.8776343464851379 (0.8776343464851379) | > loss_disc_real_1: 0.37551337480545044 (0.37551337480545044) | > loss_disc_real_2: 0.30550822615623474 (0.30550822615623474) | > loss_disc_real_3: 0.36297017335891724 (0.36297017335891724) | > loss_disc_real_4: 0.29759350419044495 (0.29759350419044495) | > loss_disc_real_5: 0.21521815657615662 (0.21521815657615662) | > loss_0: 3.341806173324585 (3.341806173324585) | > loss_gen: 3.1724629402160645 (3.1724629402160645) | > loss_kl: 4.199382305145264 (4.199382305145264) | > loss_feat: 4.569066524505615 (4.569066524505615) | > loss_mel: 21.753528594970703 (21.753528594970703) | > loss_duration: 3.0633554458618164 (3.0633554458618164) | > loss_1: 36.75779342651367 (36.75779342651367)  --> STEP: 2 | > loss_disc: 2.2308971881866455 (2.7863516807556152) | > loss_disc_real_0: 0.10548913478851318 (0.49156174063682556) | > loss_disc_real_1: 0.21692103147506714 (0.2962172031402588) | > loss_disc_real_2: 0.2022019624710083 (0.2538550943136215) | > loss_disc_real_3: 0.3171030580997467 (0.34003661572933197) | > loss_disc_real_4: 0.179129496216774 (0.23836150020360947) | > loss_disc_real_5: 0.20564661920070648 (0.21043238788843155) | > loss_0: 2.2308971881866455 (2.7863516807556152) | > loss_gen: 2.455873727798462 (2.814168334007263) | > loss_kl: 4.312373638153076 (4.25587797164917) | > loss_feat: 4.499771595001221 (4.534419059753418) | > loss_mel: 24.345489501953125 (23.049509048461914) | > loss_duration: 3.030308723449707 (3.0468320846557617) | > loss_1: 38.64381790161133 (37.7008056640625)  --> STEP: 3 | > loss_disc: 2.3334338665008545 (2.6353790760040283) | > loss_disc_real_0: 0.37521177530288696 (0.452778418858846) | > loss_disc_real_1: 0.28746113181114197 (0.29329851269721985) | > loss_disc_real_2: 0.36557912826538086 (0.29109643896420795) | > loss_disc_real_3: 0.288825124502182 (0.3229661186536153) | > loss_disc_real_4: 0.0987691655755043 (0.1918307219942411) | > loss_disc_real_5: 0.08974745869636536 (0.17020407815774283) | > loss_0: 2.3334338665008545 (2.6353790760040283) | > loss_gen: 2.970857620239258 (2.8663980960845947) | > loss_kl: 1.9039112329483032 (3.471889058748881) | > loss_feat: 7.4691572189331055 (5.5126651128133135) | > loss_mel: 24.779926300048828 (23.626314798990887) | > loss_duration: 2.762289047241211 (2.951984405517578) | > loss_1: 39.886146545410156 (38.42925262451172) --> EVAL PERFORMANCE | > avg_loader_time: 0.023823340733846027 (+0.0100404421488444) | > avg_loss_disc: 2.6353790760040283 (-0.2010277907053628) | > avg_loss_disc_real_0: 0.452778418858846 (+0.304921418428421) | > avg_loss_disc_real_1: 0.29329851269721985 (+0.010853310426076235) | > avg_loss_disc_real_2: 0.29109643896420795 (+0.027239506443341555) | > avg_loss_disc_real_3: 0.3229661186536153 (+0.032363245884577396) | > avg_loss_disc_real_4: 0.1918307219942411 (-0.09097994615634283) | > avg_loss_disc_real_5: 0.17020407815774283 (-0.09904119869073233) | > avg_loss_0: 2.6353790760040283 (-0.2010277907053628) | > avg_loss_gen: 2.8663980960845947 (+0.9639869530995686) | > avg_loss_kl: 3.471889058748881 (-0.2341007788976035) | > avg_loss_feat: 5.5126651128133135 (+2.6885201334953304) | > avg_loss_mel: 23.626314798990887 (+6.869898478190105) | > avg_loss_duration: 2.951984405517578 (-0.08047183354695653) | > avg_loss_1: 38.42925262451172 (+10.207835515340168)  > EPOCH: 666/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:25:53)   --> TIME: 2023-10-20 07:26:07 -- STEP: 9/50 -- GLOBAL_STEP: 86310 | > loss_disc: 3.0639147758483887 (2.574552377065023) | > loss_disc_real_0: 0.05726255476474762 (0.12752517312765121) | > loss_disc_real_1: 0.22241473197937012 (0.23943619223104584) | > loss_disc_real_2: 0.3093266189098358 (0.2698674152294795) | > loss_disc_real_3: 0.2279588282108307 (0.28996932837698197) | > loss_disc_real_4: 0.2855677902698517 (0.24497287389304903) | > loss_disc_real_5: 0.28715336322784424 (0.20492549157804912) | > loss_0: 3.0639147758483887 (2.574552377065023) | > grad_norm_0: tensor(1404.4362, device='cuda:0') (tensor(919.7106, device='cuda:0')) | > loss_gen: 1.543297290802002 (2.2537581390804715) | > loss_kl: 0.794972836971283 (0.843575065334638) | > loss_feat: 0.158616840839386 (5.172085305054982) | > loss_mel: 7.53069543838501 (21.87491528193156) | > loss_duration: 1.381457805633545 (1.4512970315085516) | > loss_1: 11.409040451049805 (31.59562979804145) | > grad_norm_1: tensor(19417.6680, device='cuda:0') (tensor(26919.6914, device='cuda:0')) | > current_lr_0: 0.00010274762493062207 | > current_lr_1: 0.00010274762493062207 | > step_time: 0.6903 (0.6065354877048068) | > loader_time: 0.0252 (0.027826017803615995)  --> TIME: 2023-10-20 07:26:26 -- STEP: 39/50 -- GLOBAL_STEP: 86340 | > loss_disc: 2.274855852127075 (2.560087372095157) | > loss_disc_real_0: 0.13510391116142273 (0.17086606405866453) | > loss_disc_real_1: 0.2670857310295105 (0.23411660622327757) | > loss_disc_real_2: 0.23659542202949524 (0.21469899190542024) | > loss_disc_real_3: 0.2462373524904251 (0.25530882561818147) | > loss_disc_real_4: 0.23843443393707275 (0.22811218694998667) | > loss_disc_real_5: 0.1691158413887024 (0.22609349772429618) | > loss_0: 2.274855852127075 (2.560087372095157) | > grad_norm_0: tensor(385.7180, device='cuda:0') (tensor(631.0756, device='cuda:0')) | > loss_gen: 2.44881010055542 (2.232502484932924) | > loss_kl: 0.789132297039032 (0.8549782033914175) | > loss_feat: 3.9269230365753174 (5.1128096084994) | > loss_mel: 21.85399627685547 (20.449724982946346) | > loss_duration: 1.4621940851211548 (1.4353471046839006) | > loss_1: 30.481056213378906 (30.085361847510704) | > grad_norm_1: tensor(4879.1987, device='cuda:0') (tensor(19632.2285, device='cuda:0')) | > current_lr_0: 0.00010274762493062207 | > current_lr_1: 0.00010274762493062207 | > step_time: 0.6476 (0.6131839996729141) | > loader_time: 0.0116 (0.021591394375532102)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9788503646850586 (2.9788503646850586) | > loss_disc_real_0: 0.30054810643196106 (0.30054810643196106) | > loss_disc_real_1: 0.23313191533088684 (0.23313191533088684) | > loss_disc_real_2: 0.26346608996391296 (0.26346608996391296) | > loss_disc_real_3: 0.23455028235912323 (0.23455028235912323) | > loss_disc_real_4: 0.2613913118839264 (0.2613913118839264) | > loss_disc_real_5: 0.2559848725795746 (0.2559848725795746) | > loss_0: 2.9788503646850586 (2.9788503646850586) | > loss_gen: 1.593468427658081 (1.593468427658081) | > loss_kl: 4.211236000061035 (4.211236000061035) | > loss_feat: 0.16502705216407776 (0.16502705216407776) | > loss_mel: 7.543109893798828 (7.543109893798828) | > loss_duration: 2.831052541732788 (2.831052541732788) | > loss_1: 16.34389305114746 (16.34389305114746)  --> STEP: 1 | > loss_disc: 2.6683828830718994 (2.6683828830718994) | > loss_disc_real_0: 0.18415407836437225 (0.18415407836437225) | > loss_disc_real_1: 0.22534742951393127 (0.22534742951393127) | > loss_disc_real_2: 0.22401903569698334 (0.22401903569698334) | > loss_disc_real_3: 0.2641325294971466 (0.2641325294971466) | > loss_disc_real_4: 0.26701727509498596 (0.26701727509498596) | > loss_disc_real_5: 0.256509393453598 (0.256509393453598) | > loss_0: 2.6683828830718994 (2.6683828830718994) | > loss_gen: 1.9790425300598145 (1.9790425300598145) | > loss_kl: 4.057740688323975 (4.057740688323975) | > loss_feat: 1.1890159845352173 (1.1890159845352173) | > loss_mel: 19.46090316772461 (19.46090316772461) | > loss_duration: 3.15315580368042 (3.15315580368042) | > loss_1: 29.839859008789062 (29.839859008789062)  --> STEP: 2 | > loss_disc: 1.7849245071411133 (2.2266536951065063) | > loss_disc_real_0: 0.06387275457382202 (0.12401341646909714) | > loss_disc_real_1: 0.21190297603607178 (0.21862520277500153) | > loss_disc_real_2: 0.1481764018535614 (0.18609771877527237) | > loss_disc_real_3: 0.05725035071372986 (0.16069144010543823) | > loss_disc_real_4: 0.12174025177955627 (0.19437876343727112) | > loss_disc_real_5: 0.10045775026082993 (0.17848357185721397) | > loss_0: 1.7849245071411133 (2.2266536951065063) | > loss_gen: 2.644991874694824 (2.3120172023773193) | > loss_kl: 4.542889595031738 (4.3003151416778564) | > loss_feat: 10.342182159423828 (5.765599071979523) | > loss_mel: 27.078229904174805 (23.269566535949707) | > loss_duration: 2.931589365005493 (3.0423725843429565) | > loss_1: 47.539886474609375 (38.68987274169922)  --> STEP: 3 | > loss_disc: 3.0072085857391357 (2.4868386586507163) | > loss_disc_real_0: 0.30462390184402466 (0.18421691159407297) | > loss_disc_real_1: 0.23299095034599304 (0.22341378529866537) | > loss_disc_real_2: 0.2622593641281128 (0.21148493389288583) | > loss_disc_real_3: 0.2349333018064499 (0.1854387273391088) | > loss_disc_real_4: 0.26233673095703125 (0.21703141927719116) | > loss_disc_real_5: 0.2574295103549957 (0.2047988846898079) | > loss_0: 3.0072085857391357 (2.4868386586507163) | > loss_gen: 1.5604095458984375 (2.061481316884359) | > loss_kl: 2.455731153488159 (3.6854538122812905) | > loss_feat: 0.10851454734802246 (3.8799042304356894) | > loss_mel: 4.462804317474365 (17.000645796457928) | > loss_duration: 2.900282144546509 (2.995009104410807) | > loss_1: 11.487741470336914 (29.622495651245117) --> EVAL PERFORMANCE | > avg_loader_time: 0.019033034642537434 (-0.004790306091308594) | > avg_loss_disc: 2.4868386586507163 (-0.14854041735331203) | > avg_loss_disc_real_0: 0.18421691159407297 (-0.268561507264773) | > avg_loss_disc_real_1: 0.22341378529866537 (-0.06988472739855447) | > avg_loss_disc_real_2: 0.21148493389288583 (-0.07961150507132211) | > avg_loss_disc_real_3: 0.1854387273391088 (-0.1375273913145065) | > avg_loss_disc_real_4: 0.21703141927719116 (+0.025200697282950074) | > avg_loss_disc_real_5: 0.2047988846898079 (+0.034594806532065064) | > avg_loss_0: 2.4868386586507163 (-0.14854041735331203) | > avg_loss_gen: 2.061481316884359 (-0.8049167792002359) | > avg_loss_kl: 3.6854538122812905 (+0.21356475353240967) | > avg_loss_feat: 3.8799042304356894 (-1.632760882377624) | > avg_loss_mel: 17.000645796457928 (-6.625669002532959) | > avg_loss_duration: 2.995009104410807 (+0.04302469889322902) | > avg_loss_1: 29.622495651245117 (-8.806756973266602)  > EPOCH: 667/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:26:47)   --> TIME: 2023-10-20 07:27:09 -- STEP: 19/50 -- GLOBAL_STEP: 86370 | > loss_disc: 1.5838934183120728 (2.334870783906234) | > loss_disc_real_0: 0.10308253765106201 (0.1581465278899199) | > loss_disc_real_1: 0.0969473198056221 (0.2219015638294973) | > loss_disc_real_2: 0.07840856164693832 (0.20073537548121653) | > loss_disc_real_3: 0.08204089850187302 (0.23575508731760478) | > loss_disc_real_4: 0.05936747416853905 (0.22025278230246745) | > loss_disc_real_5: 0.04396006837487221 (0.22955659482824176) | > loss_0: 1.5838934183120728 (2.334870783906234) | > grad_norm_0: tensor(365.8632, device='cuda:0') (tensor(621.4403, device='cuda:0')) | > loss_gen: 2.3899238109588623 (2.507839146413301) | > loss_kl: 1.0461366176605225 (0.8443345537311152) | > loss_feat: 10.335287094116211 (5.9439680897875835) | > loss_mel: 26.23087501525879 (22.550623554932443) | > loss_duration: 1.5184133052825928 (1.4675666470276683) | > loss_1: 41.520633697509766 (33.314331807588275) | > grad_norm_1: tensor(21957.7949, device='cuda:0') (tensor(25960.2344, device='cuda:0')) | > current_lr_0: 0.00010264492224654107 | > current_lr_1: 0.00010264492224654107 | > step_time: 0.3355 (0.7086453939739027) | > loader_time: 0.005 (0.019560964483963817)  --> TIME: 2023-10-20 07:27:28 -- STEP: 49/50 -- GLOBAL_STEP: 86400 | > loss_disc: 1.749590277671814 (2.3576818874904086) | > loss_disc_real_0: 0.06711607426404953 (0.14363101632239259) | > loss_disc_real_1: 0.22288788855075836 (0.22086041797028513) | > loss_disc_real_2: 0.08983179181814194 (0.19895744129863321) | > loss_disc_real_3: 0.20179805159568787 (0.23324057530155595) | > loss_disc_real_4: 0.05149098485708237 (0.2063344272271711) | > loss_disc_real_5: 0.11287980526685715 (0.22405194840869125) | > loss_0: 1.749590277671814 (2.3576818874904086) | > grad_norm_0: tensor(452.3691, device='cuda:0') (tensor(563.3914, device='cuda:0')) | > loss_gen: 2.81225323677063 (2.392237816538129) | > loss_kl: 0.618526816368103 (0.7532617741701554) | > loss_feat: 8.371991157531738 (6.095415630358824) | > loss_mel: 28.03722381591797 (22.171404040589625) | > loss_duration: 1.550641655921936 (1.4333652282247737) | > loss_1: 41.39063262939453 (32.845684314260694) | > grad_norm_1: tensor(47997.5742, device='cuda:0') (tensor(20782.7812, device='cuda:0')) | > current_lr_0: 0.00010264492224654107 | > current_lr_1: 0.00010264492224654107 | > step_time: 0.9972 (0.6395078873147768) | > loader_time: 0.6671 (0.03273453031267439)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9993224143981934 (2.9993224143981934) | > loss_disc_real_0: 0.4072872996330261 (0.4072872996330261) | > loss_disc_real_1: 0.24691791832447052 (0.24691791832447052) | > loss_disc_real_2: 0.2901918590068817 (0.2901918590068817) | > loss_disc_real_3: 0.24904373288154602 (0.24904373288154602) | > loss_disc_real_4: 0.2602950632572174 (0.2602950632572174) | > loss_disc_real_5: 0.2824953496456146 (0.2824953496456146) | > loss_0: 2.9993224143981934 (2.9993224143981934) | > loss_gen: 1.8308727741241455 (1.8308727741241455) | > loss_kl: 4.531360626220703 (4.531360626220703) | > loss_feat: 0.2023647576570511 (0.2023647576570511) | > loss_mel: 15.554970741271973 (15.554970741271973) | > loss_duration: 2.8834152221679688 (2.8834152221679688) | > loss_1: 25.00298500061035 (25.00298500061035)  --> STEP: 1 | > loss_disc: 3.019160032272339 (3.019160032272339) | > loss_disc_real_0: 0.34918326139450073 (0.34918326139450073) | > loss_disc_real_1: 0.30705052614212036 (0.30705052614212036) | > loss_disc_real_2: 0.4744061529636383 (0.4744061529636383) | > loss_disc_real_3: 0.422374427318573 (0.422374427318573) | > loss_disc_real_4: 0.2854500710964203 (0.2854500710964203) | > loss_disc_real_5: 0.16988278925418854 (0.16988278925418854) | > loss_0: 3.019160032272339 (3.019160032272339) | > loss_gen: 2.9693853855133057 (2.9693853855133057) | > loss_kl: 4.113495826721191 (4.113495826721191) | > loss_feat: 6.220736503601074 (6.220736503601074) | > loss_mel: 25.002214431762695 (25.002214431762695) | > loss_duration: 3.0919206142425537 (3.0919206142425537) | > loss_1: 41.39775466918945 (41.39775466918945)  --> STEP: 2 | > loss_disc: 3.0440404415130615 (3.0316002368927) | > loss_disc_real_0: 0.40614789724349976 (0.37766557931900024) | > loss_disc_real_1: 0.24707330763339996 (0.27706191688776016) | > loss_disc_real_2: 0.2925139367580414 (0.38346004486083984) | > loss_disc_real_3: 0.2488282024860382 (0.3356013149023056) | > loss_disc_real_4: 0.2608893811702728 (0.27316972613334656) | > loss_disc_real_5: 0.28272300958633423 (0.22630289942026138) | > loss_0: 3.0440404415130615 (3.0316002368927) | > loss_gen: 1.7401384115219116 (2.3547618985176086) | > loss_kl: 4.551523208618164 (4.332509517669678) | > loss_feat: 0.04565447196364403 (3.133195487782359) | > loss_mel: 1.4705805778503418 (13.236397504806519) | > loss_duration: 2.8937954902648926 (2.992858052253723) | > loss_1: 10.701692581176758 (26.049723625183105)  --> STEP: 3 | > loss_disc: 2.6821727752685547 (2.9151244163513184) | > loss_disc_real_0: 0.42068538069725037 (0.3920055131117503) | > loss_disc_real_1: 0.20440895855426788 (0.2528442641099294) | > loss_disc_real_2: 0.21976658701896667 (0.32889555891354877) | > loss_disc_real_3: 0.2845591604709625 (0.3185872634251912) | > loss_disc_real_4: 0.35503917932510376 (0.3004595438639323) | > loss_disc_real_5: 0.3392104208469391 (0.2639387398958206) | > loss_0: 2.6821727752685547 (2.9151244163513184) | > loss_gen: 3.4133496284484863 (2.7076244751612344) | > loss_kl: 1.8487151861190796 (3.5045780738194785) | > loss_feat: 4.796219348907471 (3.687536774824063) | > loss_mel: 21.74306869506836 (16.07195456822713) | > loss_duration: 2.8765053749084473 (2.9540738264719644) | > loss_1: 34.677860260009766 (28.925769170125324) --> EVAL PERFORMANCE | > avg_loader_time: 0.01924896240234375 (+0.00021592775980631626) | > avg_loss_disc: 2.9151244163513184 (+0.42828575770060207) | > avg_loss_disc_real_0: 0.3920055131117503 (+0.20778860151767733) | > avg_loss_disc_real_1: 0.2528442641099294 (+0.02943047881126401) | > avg_loss_disc_real_2: 0.32889555891354877 (+0.11741062502066293) | > avg_loss_disc_real_3: 0.3185872634251912 (+0.13314853608608243) | > avg_loss_disc_real_4: 0.3004595438639323 (+0.08342812458674115) | > avg_loss_disc_real_5: 0.2639387398958206 (+0.059139855206012726) | > avg_loss_0: 2.9151244163513184 (+0.42828575770060207) | > avg_loss_gen: 2.7076244751612344 (+0.6461431582768755) | > avg_loss_kl: 3.5045780738194785 (-0.18087573846181204) | > avg_loss_feat: 3.687536774824063 (-0.1923674556116266) | > avg_loss_mel: 16.07195456822713 (-0.9286912282307966) | > avg_loss_duration: 2.9540738264719644 (-0.04093527793884277) | > avg_loss_1: 28.925769170125324 (-0.6967264811197929)  > EPOCH: 668/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:27:41)   --> TIME: 2023-10-20 07:28:04 -- STEP: 29/50 -- GLOBAL_STEP: 86430 | > loss_disc: 3.0045809745788574 (2.512380793176849) | > loss_disc_real_0: 0.1525319218635559 (0.16076641600450564) | > loss_disc_real_1: 0.24841006100177765 (0.21183140492387886) | > loss_disc_real_2: 0.2641759514808655 (0.2283725449494247) | > loss_disc_real_3: 0.21301910281181335 (0.2561513132833201) | > loss_disc_real_4: 0.27031591534614563 (0.23464036257616405) | > loss_disc_real_5: 0.2873483896255493 (0.23821451778298822) | > loss_0: 3.0045809745788574 (2.512380793176849) | > grad_norm_0: tensor(1206.0209, device='cuda:0') (tensor(561.0914, device='cuda:0')) | > loss_gen: 1.5109869241714478 (2.2785802175258767) | > loss_kl: 0.8070717453956604 (0.8572051792309202) | > loss_feat: 0.0816744938492775 (5.595989133391915) | > loss_mel: 5.731404781341553 (21.046492313516556) | > loss_duration: 1.4673469066619873 (1.4407039346366093) | > loss_1: 9.598484992980957 (31.21897079204691) | > grad_norm_1: tensor(23571.6172, device='cuda:0') (tensor(24510.5820, device='cuda:0')) | > current_lr_0: 0.00010254232222022295 | > current_lr_1: 0.00010254232222022295 | > step_time: 0.4924 (0.5691594995301346) | > loader_time: 0.0151 (0.022616633053483635)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.150691270828247 (2.150691270828247) | > loss_disc_real_0: 0.03166896849870682 (0.03166896849870682) | > loss_disc_real_1: 0.10879257321357727 (0.10879257321357727) | > loss_disc_real_2: 0.0684874951839447 (0.0684874951839447) | > loss_disc_real_3: 0.2836388051509857 (0.2836388051509857) | > loss_disc_real_4: 0.09811171144247055 (0.09811171144247055) | > loss_disc_real_5: 0.1080903634428978 (0.1080903634428978) | > loss_0: 2.150691270828247 (2.150691270828247) | > loss_gen: 1.7440834045410156 (1.7440834045410156) | > loss_kl: 3.976044178009033 (3.976044178009033) | > loss_feat: 4.395210266113281 (4.395210266113281) | > loss_mel: 21.737659454345703 (21.737659454345703) | > loss_duration: 2.68536639213562 (2.68536639213562) | > loss_1: 34.53836441040039 (34.53836441040039)  --> STEP: 1 | > loss_disc: 2.4370405673980713 (2.4370405673980713) | > loss_disc_real_0: 0.06067591533064842 (0.06067591533064842) | > loss_disc_real_1: 0.15949520468711853 (0.15949520468711853) | > loss_disc_real_2: 0.18935810029506683 (0.18935810029506683) | > loss_disc_real_3: 0.27370741963386536 (0.27370741963386536) | > loss_disc_real_4: 0.2241765856742859 (0.2241765856742859) | > loss_disc_real_5: 0.24556151032447815 (0.24556151032447815) | > loss_0: 2.4370405673980713 (2.4370405673980713) | > loss_gen: 2.081007242202759 (2.081007242202759) | > loss_kl: 4.135237216949463 (4.135237216949463) | > loss_feat: 5.665403842926025 (5.665403842926025) | > loss_mel: 26.27399444580078 (26.27399444580078) | > loss_duration: 3.1334950923919678 (3.1334950923919678) | > loss_1: 41.28913879394531 (41.28913879394531)  --> STEP: 2 | > loss_disc: 2.392613649368286 (2.4148271083831787) | > loss_disc_real_0: 0.5858666896820068 (0.32327130250632763) | > loss_disc_real_1: 0.13808031380176544 (0.14878775924444199) | > loss_disc_real_2: 0.19527298212051392 (0.19231554120779037) | > loss_disc_real_3: 0.22790658473968506 (0.2508070021867752) | > loss_disc_real_4: 0.11729419231414795 (0.17073538899421692) | > loss_disc_real_5: 0.1683962643146515 (0.20697888731956482) | > loss_0: 2.392613649368286 (2.4148271083831787) | > loss_gen: 2.817962646484375 (2.449484944343567) | > loss_kl: 5.377340316772461 (4.756288766860962) | > loss_feat: 7.942338466644287 (6.803871154785156) | > loss_mel: 24.42120933532715 (25.347601890563965) | > loss_duration: 2.9276020526885986 (3.030548572540283) | > loss_1: 43.486454010009766 (42.38779640197754)  --> STEP: 3 | > loss_disc: 3.0553483963012695 (2.6283342043558755) | > loss_disc_real_0: 0.18530336022377014 (0.2772819884121418) | > loss_disc_real_1: 0.218058243393898 (0.171877920627594) | > loss_disc_real_2: 0.2232007086277008 (0.20261059701442719) | > loss_disc_real_3: 0.1316368132829666 (0.21108360588550568) | > loss_disc_real_4: 0.35397017002105713 (0.23181364933649698) | > loss_disc_real_5: 0.42049309611320496 (0.2781502902507782) | > loss_0: 3.0553483963012695 (2.6283342043558755) | > loss_gen: 2.3532280921936035 (2.4173993269602456) | > loss_kl: 2.468090295791626 (3.993555943171183) | > loss_feat: 5.134153366088867 (6.24729855855306) | > loss_mel: 19.754253387451172 (23.483152389526367) | > loss_duration: 2.7962517738342285 (2.952449639638265) | > loss_1: 32.505977630615234 (39.09385681152344) --> EVAL PERFORMANCE | > avg_loader_time: 0.02263784408569336 (+0.0033888816833496094) | > avg_loss_disc: 2.6283342043558755 (-0.28679021199544286) | > avg_loss_disc_real_0: 0.2772819884121418 (-0.1147235246996085) | > avg_loss_disc_real_1: 0.171877920627594 (-0.08096634348233539) | > avg_loss_disc_real_2: 0.20261059701442719 (-0.12628496189912158) | > avg_loss_disc_real_3: 0.21108360588550568 (-0.10750365753968555) | > avg_loss_disc_real_4: 0.23181364933649698 (-0.06864589452743533) | > avg_loss_disc_real_5: 0.2781502902507782 (+0.01421155035495758) | > avg_loss_0: 2.6283342043558755 (-0.28679021199544286) | > avg_loss_gen: 2.4173993269602456 (-0.29022514820098877) | > avg_loss_kl: 3.993555943171183 (+0.4889778693517046) | > avg_loss_feat: 6.24729855855306 (+2.5597617837289968) | > avg_loss_mel: 23.483152389526367 (+7.411197821299236) | > avg_loss_duration: 2.952449639638265 (-0.0016241868336992482) | > avg_loss_1: 39.09385681152344 (+10.168087641398113)  > EPOCH: 669/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:28:29)   --> TIME: 2023-10-20 07:28:47 -- STEP: 9/50 -- GLOBAL_STEP: 86460 | > loss_disc: 2.3472189903259277 (2.061437209447225) | > loss_disc_real_0: 0.2486768662929535 (0.11521437350246641) | > loss_disc_real_1: 0.38680294156074524 (0.22411003957192102) | > loss_disc_real_2: 0.20044191181659698 (0.1813703121410476) | > loss_disc_real_3: 0.3038721978664398 (0.22521863194803396) | > loss_disc_real_4: 0.08618196845054626 (0.13150901243918472) | > loss_disc_real_5: 0.16453205049037933 (0.11405495906041728) | > loss_0: 2.3472189903259277 (2.061437209447225) | > grad_norm_0: tensor(612.9292, device='cuda:0') (tensor(443.2988, device='cuda:0')) | > loss_gen: 2.493541717529297 (2.6043568982018366) | > loss_kl: 0.3632911741733551 (0.7494471594691277) | > loss_feat: 3.719635009765625 (7.942060099707709) | > loss_mel: 23.596900939941406 (24.534054014417862) | > loss_duration: 1.4463542699813843 (1.4391032192442152) | > loss_1: 31.619722366333008 (37.269021140204536) | > grad_norm_1: tensor(6526.3057, device='cuda:0') (tensor(26672.6426, device='cuda:0')) | > current_lr_0: 0.00010243982474905484 | > current_lr_1: 0.00010243982474905484 | > step_time: 0.489 (0.658473014831543) | > loader_time: 0.0028 (0.021486679712931316)  --> TIME: 2023-10-20 07:29:06 -- STEP: 39/50 -- GLOBAL_STEP: 86490 | > loss_disc: 2.1667819023132324 (2.4377225301204577) | > loss_disc_real_0: 0.03946712985634804 (0.1506554278998803) | > loss_disc_real_1: 0.1921870857477188 (0.2276880145072937) | > loss_disc_real_2: 0.17281118035316467 (0.22653948391477266) | > loss_disc_real_3: 0.18256834149360657 (0.23686475244661173) | > loss_disc_real_4: 0.31888049840927124 (0.21659645318793944) | > loss_disc_real_5: 0.24157166481018066 (0.21437538644442192) | > loss_0: 2.1667819023132324 (2.4377225301204577) | > grad_norm_0: tensor(825.1091, device='cuda:0') (tensor(539.0811, device='cuda:0')) | > loss_gen: 2.413557529449463 (2.3394805865410047) | > loss_kl: 0.41531166434288025 (0.797332800924778) | > loss_feat: 5.431037902832031 (6.105102597138821) | > loss_mel: 24.90380859375 (22.737072941584465) | > loss_duration: 1.5007721185684204 (1.4346350339742804) | > loss_1: 34.664485931396484 (33.41362387094741) | > grad_norm_1: tensor(29365.5703, device='cuda:0') (tensor(20253.4824, device='cuda:0')) | > current_lr_0: 0.00010243982474905484 | > current_lr_1: 0.00010243982474905484 | > step_time: 0.4933 (0.6161178686679939) | > loader_time: 0.0228 (0.018550823896359175)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4040215015411377 (2.4040215015411377) | > loss_disc_real_0: 0.14820504188537598 (0.14820504188537598) | > loss_disc_real_1: 0.1890704333782196 (0.1890704333782196) | > loss_disc_real_2: 0.30472394824028015 (0.30472394824028015) | > loss_disc_real_3: 0.3065706789493561 (0.3065706789493561) | > loss_disc_real_4: 0.29062187671661377 (0.29062187671661377) | > loss_disc_real_5: 0.40304991602897644 (0.40304991602897644) | > loss_0: 2.4040215015411377 (2.4040215015411377) | > loss_gen: 2.741424798965454 (2.741424798965454) | > loss_kl: 3.539461851119995 (3.539461851119995) | > loss_feat: 5.588308811187744 (5.588308811187744) | > loss_mel: 22.135812759399414 (22.135812759399414) | > loss_duration: 2.7125320434570312 (2.7125320434570312) | > loss_1: 36.7175407409668 (36.7175407409668)  --> STEP: 1 | > loss_disc: 1.2385095357894897 (1.2385095357894897) | > loss_disc_real_0: 0.017843972891569138 (0.017843972891569138) | > loss_disc_real_1: 0.14362697303295135 (0.14362697303295135) | > loss_disc_real_2: 0.07324767112731934 (0.07324767112731934) | > loss_disc_real_3: 0.12212755531072617 (0.12212755531072617) | > loss_disc_real_4: 0.11601138114929199 (0.11601138114929199) | > loss_disc_real_5: 0.041424982249736786 (0.041424982249736786) | > loss_0: 1.2385095357894897 (1.2385095357894897) | > loss_gen: 3.135209798812866 (3.135209798812866) | > loss_kl: 4.422351837158203 (4.422351837158203) | > loss_feat: 12.229226112365723 (12.229226112365723) | > loss_mel: 26.88616180419922 (26.88616180419922) | > loss_duration: 3.1901955604553223 (3.1901955604553223) | > loss_1: 49.86314392089844 (49.86314392089844)  --> STEP: 2 | > loss_disc: 2.7408998012542725 (1.989704668521881) | > loss_disc_real_0: 0.2368980348110199 (0.12737100385129452) | > loss_disc_real_1: 0.33341148495674133 (0.23851922899484634) | > loss_disc_real_2: 0.29774197936058044 (0.1854948252439499) | > loss_disc_real_3: 0.1431998461484909 (0.13266370072960854) | > loss_disc_real_4: 0.4775691628456116 (0.2967902719974518) | > loss_disc_real_5: 0.44673287868499756 (0.24407893046736717) | > loss_0: 2.7408998012542725 (1.989704668521881) | > loss_gen: 3.0772647857666016 (3.106237292289734) | > loss_kl: 5.913650035858154 (5.168000936508179) | > loss_feat: 7.015606880187988 (9.622416496276855) | > loss_mel: 24.438961029052734 (25.662561416625977) | > loss_duration: 3.087193250656128 (3.138694405555725) | > loss_1: 43.53267288208008 (46.69790840148926)  --> STEP: 3 | > loss_disc: 2.343785047531128 (2.1077314615249634) | > loss_disc_real_0: 0.26068922877311707 (0.1718104121585687) | > loss_disc_real_1: 0.36457952857017517 (0.2805393288532893) | > loss_disc_real_2: 0.1765744835138321 (0.1825213780005773) | > loss_disc_real_3: 0.24249520897865295 (0.16927420347929) | > loss_disc_real_4: 0.31373849511146545 (0.302439679702123) | > loss_disc_real_5: 0.28927329182624817 (0.25914371758699417) | > loss_0: 2.343785047531128 (2.1077314615249634) | > loss_gen: 3.4795398712158203 (3.230671485265096) | > loss_kl: 2.2946419715881348 (4.210214614868164) | > loss_feat: 6.993904113769531 (8.746245702107748) | > loss_mel: 23.72527313232422 (25.01679865519206) | > loss_duration: 2.7268989086151123 (3.001429239908854) | > loss_1: 39.220252990722656 (44.20535659790039) --> EVAL PERFORMANCE | > avg_loader_time: 0.012043952941894531 (-0.010593891143798828) | > avg_loss_disc: 2.1077314615249634 (-0.5206027428309121) | > avg_loss_disc_real_0: 0.1718104121585687 (-0.10547157625357309) | > avg_loss_disc_real_1: 0.2805393288532893 (+0.10866140822569531) | > avg_loss_disc_real_2: 0.1825213780005773 (-0.020089219013849885) | > avg_loss_disc_real_3: 0.16927420347929 (-0.04180940240621567) | > avg_loss_disc_real_4: 0.302439679702123 (+0.07062603036562601) | > avg_loss_disc_real_5: 0.25914371758699417 (-0.019006572663784027) | > avg_loss_0: 2.1077314615249634 (-0.5206027428309121) | > avg_loss_gen: 3.230671485265096 (+0.8132721583048506) | > avg_loss_kl: 4.210214614868164 (+0.21665867169698094) | > avg_loss_feat: 8.746245702107748 (+2.4989471435546884) | > avg_loss_mel: 25.01679865519206 (+1.5336462656656913) | > avg_loss_duration: 3.001429239908854 (+0.0489796002705889) | > avg_loss_1: 44.20535659790039 (+5.111499786376953)  > EPOCH: 670/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:29:34)   --> TIME: 2023-10-20 07:29:53 -- STEP: 19/50 -- GLOBAL_STEP: 86520 | > loss_disc: 2.4293272495269775 (2.5771632759194625) | > loss_disc_real_0: 0.15815968811511993 (0.15253566622145867) | > loss_disc_real_1: 0.2856714427471161 (0.23323428228889642) | > loss_disc_real_2: 0.35081177949905396 (0.2540002314275817) | > loss_disc_real_3: 0.2853938639163971 (0.24382767855728926) | > loss_disc_real_4: 0.3453299403190613 (0.2821926421632892) | > loss_disc_real_5: 0.29281628131866455 (0.2799382995029813) | > loss_0: 2.4293272495269775 (2.5771632759194625) | > grad_norm_0: tensor(436.4259, device='cuda:0') (tensor(910.5112, device='cuda:0')) | > loss_gen: 3.1155619621276855 (2.3950752396332597) | > loss_kl: 1.023223638534546 (0.8527497696249109) | > loss_feat: 5.824108123779297 (4.7342168190761615) | > loss_mel: 23.58991241455078 (19.00239849090576) | > loss_duration: 1.516538143157959 (1.4876398287321393) | > loss_1: 35.06934356689453 (28.472080833033512) | > grad_norm_1: tensor(32491.3242, device='cuda:0') (tensor(27268.9766, device='cuda:0')) | > current_lr_0: 0.00010233742973052648 | > current_lr_1: 0.00010233742973052648 | > step_time: 0.3592 (0.6219449043273926) | > loader_time: 0.0036 (0.01689073913975766)  --> TIME: 2023-10-20 07:30:09 -- STEP: 49/50 -- GLOBAL_STEP: 86550 | > loss_disc: 3.0751733779907227 (2.4752577202660695) | > loss_disc_real_0: 0.25654473900794983 (0.14303867254710315) | > loss_disc_real_1: 0.24129535257816315 (0.21957698924352928) | > loss_disc_real_2: 0.2529418468475342 (0.23292023574515264) | > loss_disc_real_3: 0.283875972032547 (0.2299799650375332) | > loss_disc_real_4: 0.2464825063943863 (0.22923400747228642) | > loss_disc_real_5: 0.25937169790267944 (0.2332277723340964) | > loss_0: 3.0751733779907227 (2.4752577202660695) | > grad_norm_0: tensor(469.6108, device='cuda:0') (tensor(741.2878, device='cuda:0')) | > loss_gen: 1.5155181884765625 (2.3184818442986934) | > loss_kl: 0.7016534209251404 (0.8415377631175275) | > loss_feat: 0.17366105318069458 (5.382645716624601) | > loss_mel: 2.4751925468444824 (20.529045328801992) | > loss_duration: 1.5433106422424316 (1.4452383785831688) | > loss_1: 6.409335613250732 (30.51694917678833) | > grad_norm_1: tensor(15052.8789, device='cuda:0') (tensor(23365.6035, device='cuda:0')) | > current_lr_0: 0.00010233742973052648 | > current_lr_1: 0.00010233742973052648 | > step_time: 0.7096 (0.5563773379033926) | > loader_time: 0.4043 (0.024319011337903085)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9569199085235596 (2.9569199085235596) | > loss_disc_real_0: 0.2582087218761444 (0.2582087218761444) | > loss_disc_real_1: 0.2506365180015564 (0.2506365180015564) | > loss_disc_real_2: 0.24858923256397247 (0.24858923256397247) | > loss_disc_real_3: 0.290050745010376 (0.290050745010376) | > loss_disc_real_4: 0.23849791288375854 (0.23849791288375854) | > loss_disc_real_5: 0.25784173607826233 (0.25784173607826233) | > loss_0: 2.9569199085235596 (2.9569199085235596) | > loss_gen: 1.601086974143982 (1.601086974143982) | > loss_kl: 4.344857215881348 (4.344857215881348) | > loss_feat: 0.1641160249710083 (0.1641160249710083) | > loss_mel: 11.496922492980957 (11.496922492980957) | > loss_duration: 2.669201135635376 (2.669201135635376) | > loss_1: 20.27618408203125 (20.27618408203125)  --> STEP: 1 | > loss_disc: 2.7614004611968994 (2.7614004611968994) | > loss_disc_real_0: 0.3771670460700989 (0.3771670460700989) | > loss_disc_real_1: 0.20241032540798187 (0.20241032540798187) | > loss_disc_real_2: 0.38031312823295593 (0.38031312823295593) | > loss_disc_real_3: 0.2928096354007721 (0.2928096354007721) | > loss_disc_real_4: 0.23465104401111603 (0.23465104401111603) | > loss_disc_real_5: 0.24328699707984924 (0.24328699707984924) | > loss_0: 2.7614004611968994 (2.7614004611968994) | > loss_gen: 2.2343897819519043 (2.2343897819519043) | > loss_kl: 4.4592695236206055 (4.4592695236206055) | > loss_feat: 3.7652199268341064 (3.7652199268341064) | > loss_mel: 23.697795867919922 (23.697795867919922) | > loss_duration: 3.0027506351470947 (3.0027506351470947) | > loss_1: 37.159423828125 (37.159423828125)  --> STEP: 2 | > loss_disc: 2.540945291519165 (2.6511728763580322) | > loss_disc_real_0: 0.1326851099729538 (0.25492607802152634) | > loss_disc_real_1: 0.2581057846546173 (0.2302580550312996) | > loss_disc_real_2: 0.1983374059200287 (0.2893252670764923) | > loss_disc_real_3: 0.2382938712835312 (0.26555175334215164) | > loss_disc_real_4: 0.17520354688167572 (0.20492729544639587) | > loss_disc_real_5: 0.20835202932357788 (0.22581951320171356) | > loss_0: 2.540945291519165 (2.6511728763580322) | > loss_gen: 1.8536465167999268 (2.0440181493759155) | > loss_kl: 4.953335762023926 (4.706302642822266) | > loss_feat: 3.7526803016662598 (3.758950114250183) | > loss_mel: 24.35186195373535 (24.024828910827637) | > loss_duration: 2.9206347465515137 (2.961692690849304) | > loss_1: 37.832157135009766 (37.49579048156738)  --> STEP: 3 | > loss_disc: 2.18182110786438 (2.494722286860148) | > loss_disc_real_0: 0.18463793396949768 (0.23149669667085013) | > loss_disc_real_1: 0.3014453053474426 (0.2539871384700139) | > loss_disc_real_2: 0.2514741122722626 (0.2767082154750824) | > loss_disc_real_3: 0.2320031076669693 (0.2543688714504242) | > loss_disc_real_4: 0.17897219955921173 (0.1962755968173345) | > loss_disc_real_5: 0.0853353887796402 (0.17899147172768912) | > loss_0: 2.18182110786438 (2.494722286860148) | > loss_gen: 3.0840797424316406 (2.3907053470611572) | > loss_kl: 2.3722198009490967 (3.9282750288645425) | > loss_feat: 8.167418479919434 (5.228439569473267) | > loss_mel: 26.272226333618164 (24.773961385091145) | > loss_duration: 2.7740306854248047 (2.8991386890411377) | > loss_1: 42.66997528076172 (39.22051874796549) --> EVAL PERFORMANCE | > avg_loader_time: 0.011249542236328125 (-0.0007944107055664062) | > avg_loss_disc: 2.494722286860148 (+0.3869908253351846) | > avg_loss_disc_real_0: 0.23149669667085013 (+0.05968628451228142) | > avg_loss_disc_real_1: 0.2539871384700139 (-0.026552190383275387) | > avg_loss_disc_real_2: 0.2767082154750824 (+0.0941868374745051) | > avg_loss_disc_real_3: 0.2543688714504242 (+0.08509466797113419) | > avg_loss_disc_real_4: 0.1962755968173345 (-0.10616408288478849) | > avg_loss_disc_real_5: 0.17899147172768912 (-0.08015224585930505) | > avg_loss_0: 2.494722286860148 (+0.3869908253351846) | > avg_loss_gen: 2.3907053470611572 (-0.839966138203939) | > avg_loss_kl: 3.9282750288645425 (-0.28193958600362157) | > avg_loss_feat: 5.228439569473267 (-3.5178061326344814) | > avg_loss_mel: 24.773961385091145 (-0.24283727010091383) | > avg_loss_duration: 2.8991386890411377 (-0.10229055086771632) | > avg_loss_1: 39.22051874796549 (-4.984837849934898)  > EPOCH: 671/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:30:22)   --> TIME: 2023-10-20 07:30:48 -- STEP: 29/50 -- GLOBAL_STEP: 86580 | > loss_disc: 2.1593637466430664 (2.549583003438752) | > loss_disc_real_0: 0.2074805498123169 (0.1637611697460043) | > loss_disc_real_1: 0.19747422635555267 (0.23247529103838163) | > loss_disc_real_2: 0.3600659966468811 (0.23474831082697573) | > loss_disc_real_3: 0.11240570992231369 (0.23923262491308409) | > loss_disc_real_4: 0.23655113577842712 (0.2444304605496341) | > loss_disc_real_5: 0.1044951006770134 (0.25477496033598646) | > loss_0: 2.1593637466430664 (2.549583003438752) | > grad_norm_0: tensor(418.4658, device='cuda:0') (tensor(667.4272, device='cuda:0')) | > loss_gen: 2.933199167251587 (2.3037431240081787) | > loss_kl: 0.7271637916564941 (0.8607636649033119) | > loss_feat: 6.692839622497559 (5.461306738956221) | > loss_mel: 22.59939956665039 (21.7546085406994) | > loss_duration: 1.445613145828247 (1.4523632444184402) | > loss_1: 34.398216247558594 (31.832785853024188) | > grad_norm_1: tensor(10449.6006, device='cuda:0') (tensor(22137.3359, device='cuda:0')) | > current_lr_0: 0.00010223513706223004 | > current_lr_1: 0.00010223513706223004 | > step_time: 0.5034 (0.5734424591064452) | > loader_time: 0.014 (0.02295114254129344)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.753283739089966 (2.753283739089966) | > loss_disc_real_0: 0.19481313228607178 (0.19481313228607178) | > loss_disc_real_1: 0.2739614248275757 (0.2739614248275757) | > loss_disc_real_2: 0.22764843702316284 (0.22764843702316284) | > loss_disc_real_3: 0.2374761700630188 (0.2374761700630188) | > loss_disc_real_4: 0.24358688294887543 (0.24358688294887543) | > loss_disc_real_5: 0.21915282309055328 (0.21915282309055328) | > loss_0: 2.753283739089966 (2.753283739089966) | > loss_gen: 1.845454216003418 (1.845454216003418) | > loss_kl: 4.144559860229492 (4.144559860229492) | > loss_feat: 2.943155288696289 (2.943155288696289) | > loss_mel: 16.53603172302246 (16.53603172302246) | > loss_duration: 2.756815195083618 (2.756815195083618) | > loss_1: 28.226015090942383 (28.226015090942383)  --> STEP: 1 | > loss_disc: 3.441338062286377 (3.441338062286377) | > loss_disc_real_0: 0.6316705942153931 (0.6316705942153931) | > loss_disc_real_1: 0.28508472442626953 (0.28508472442626953) | > loss_disc_real_2: 0.409346342086792 (0.409346342086792) | > loss_disc_real_3: 0.3774411976337433 (0.3774411976337433) | > loss_disc_real_4: 0.45752885937690735 (0.45752885937690735) | > loss_disc_real_5: 0.3789213001728058 (0.3789213001728058) | > loss_0: 3.441338062286377 (3.441338062286377) | > loss_gen: 2.976975917816162 (2.976975917816162) | > loss_kl: 4.514400482177734 (4.514400482177734) | > loss_feat: 6.744971752166748 (6.744971752166748) | > loss_mel: 23.110389709472656 (23.110389709472656) | > loss_duration: 3.1652159690856934 (3.1652159690856934) | > loss_1: 40.5119514465332 (40.5119514465332)  --> STEP: 2 | > loss_disc: 2.2943079471588135 (2.867823004722595) | > loss_disc_real_0: 0.20493464171886444 (0.41830261796712875) | > loss_disc_real_1: 0.357922226190567 (0.3215034753084183) | > loss_disc_real_2: 0.28994134068489075 (0.34964384138584137) | > loss_disc_real_3: 0.4157797694206238 (0.39661048352718353) | > loss_disc_real_4: 0.19297949969768524 (0.3252541795372963) | > loss_disc_real_5: 0.26053470373153687 (0.3197280019521713) | > loss_0: 2.2943079471588135 (2.867823004722595) | > loss_gen: 3.5396385192871094 (3.2583072185516357) | > loss_kl: 4.845936298370361 (4.680168390274048) | > loss_feat: 7.91160249710083 (7.328287124633789) | > loss_mel: 28.083484649658203 (25.59693717956543) | > loss_duration: 2.941720485687256 (3.0534682273864746) | > loss_1: 47.32238006591797 (43.917165756225586)  --> STEP: 3 | > loss_disc: 2.948089361190796 (2.894578456878662) | > loss_disc_real_0: 0.22825291752815247 (0.35495271782080334) | > loss_disc_real_1: 0.2738833725452423 (0.30563010772069293) | > loss_disc_real_2: 0.2188994288444519 (0.30606237053871155) | > loss_disc_real_3: 0.24253976345062256 (0.3452535768349965) | > loss_disc_real_4: 0.26954251527786255 (0.30668362478415173) | > loss_disc_real_5: 0.2526540458202362 (0.2973700165748596) | > loss_0: 2.948089361190796 (2.894578456878662) | > loss_gen: 1.5794670581817627 (2.698693831761678) | > loss_kl: 2.4835455417633057 (3.9479607741038003) | > loss_feat: 0.482899010181427 (5.046491086483002) | > loss_mel: 15.804636001586914 (22.332836786905926) | > loss_duration: 2.7422943115234375 (2.9497435887654624) | > loss_1: 23.09284210205078 (36.97572453816732) --> EVAL PERFORMANCE | > avg_loader_time: 0.00977476437886556 (-0.0014747778574625645) | > avg_loss_disc: 2.894578456878662 (+0.39985617001851415) | > avg_loss_disc_real_0: 0.35495271782080334 (+0.12345602114995322) | > avg_loss_disc_real_1: 0.30563010772069293 (+0.051642969250679016) | > avg_loss_disc_real_2: 0.30606237053871155 (+0.02935415506362915) | > avg_loss_disc_real_3: 0.3452535768349965 (+0.09088470538457233) | > avg_loss_disc_real_4: 0.30668362478415173 (+0.11040802796681723) | > avg_loss_disc_real_5: 0.2973700165748596 (+0.1183785448471705) | > avg_loss_0: 2.894578456878662 (+0.39985617001851415) | > avg_loss_gen: 2.698693831761678 (+0.307988484700521) | > avg_loss_kl: 3.9479607741038003 (+0.019685745239257812) | > avg_loss_feat: 5.046491086483002 (-0.1819484829902649) | > avg_loss_mel: 22.332836786905926 (-2.441124598185219) | > avg_loss_duration: 2.9497435887654624 (+0.05060489972432469) | > avg_loss_1: 36.97572453816732 (-2.2447942097981723)  > EPOCH: 672/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:31:15)   --> TIME: 2023-10-20 07:31:25 -- STEP: 9/50 -- GLOBAL_STEP: 86610 | > loss_disc: 2.899470806121826 (2.3487490283118353) | > loss_disc_real_0: 0.1297970414161682 (0.15331450829075444) | > loss_disc_real_1: 0.23302778601646423 (0.2125485549784369) | > loss_disc_real_2: 0.26350080966949463 (0.23142866790294647) | > loss_disc_real_3: 0.34589898586273193 (0.25128300653563607) | > loss_disc_real_4: 0.3800157904624939 (0.25427503262956935) | > loss_disc_real_5: 0.3227202296257019 (0.26993055641651154) | > loss_0: 2.899470806121826 (2.3487490283118353) | > grad_norm_0: tensor(942.2849, device='cuda:0') (tensor(887.2785, device='cuda:0')) | > loss_gen: 2.057933807373047 (2.5728004508548312) | > loss_kl: 0.3717176914215088 (0.936383863290151) | > loss_feat: 4.316929340362549 (5.44053200715118) | > loss_mel: 22.98264503479004 (21.305806901719833) | > loss_duration: 1.4350225925445557 (1.4394258260726929) | > loss_1: 31.164247512817383 (31.694949044121635) | > grad_norm_1: tensor(17094.6582, device='cuda:0') (tensor(24294.9863, device='cuda:0')) | > current_lr_0: 0.00010213294664186001 | > current_lr_1: 0.00010213294664186001 | > step_time: 0.6408 (0.6455195215013292) | > loader_time: 0.0141 (0.025009764565361872)  --> TIME: 2023-10-20 07:31:43 -- STEP: 39/50 -- GLOBAL_STEP: 86640 | > loss_disc: 3.0696537494659424 (2.44503538730817) | > loss_disc_real_0: 0.2041855752468109 (0.1623565573245287) | > loss_disc_real_1: 0.30137965083122253 (0.2187017440700378) | > loss_disc_real_2: 0.24893581867218018 (0.2234994261406171) | > loss_disc_real_3: 0.26165661215782166 (0.23133368933430085) | > loss_disc_real_4: 0.2178308516740799 (0.21964145437456095) | > loss_disc_real_5: 0.27317917346954346 (0.2476265522149893) | > loss_0: 3.0696537494659424 (2.44503538730817) | > grad_norm_0: tensor(732.7684, device='cuda:0') (tensor(1126.4915, device='cuda:0')) | > loss_gen: 1.4486806392669678 (2.3897341275826474) | > loss_kl: 0.5966916680335999 (0.8408969029402121) | > loss_feat: 0.13620761036872864 (5.706121296168138) | > loss_mel: 2.100315570831299 (20.942766975133846) | > loss_duration: 1.4943300485610962 (1.426984952046321) | > loss_1: 5.776225566864014 (31.306504322932316) | > grad_norm_1: tensor(31089.7852, device='cuda:0') (tensor(36305.6484, device='cuda:0')) | > current_lr_0: 0.00010213294664186001 | > current_lr_1: 0.00010213294664186001 | > step_time: 0.5947 (0.5944944039369241) | > loader_time: 0.0139 (0.021538453224377755)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9194421768188477 (2.9194421768188477) | > loss_disc_real_0: 0.22007650136947632 (0.22007650136947632) | > loss_disc_real_1: 0.21330830454826355 (0.21330830454826355) | > loss_disc_real_2: 0.1898181438446045 (0.1898181438446045) | > loss_disc_real_3: 0.30758848786354065 (0.30758848786354065) | > loss_disc_real_4: 0.2444138526916504 (0.2444138526916504) | > loss_disc_real_5: 0.18315178155899048 (0.18315178155899048) | > loss_0: 2.9194421768188477 (2.9194421768188477) | > loss_gen: 1.6397862434387207 (1.6397862434387207) | > loss_kl: 3.7970659732818604 (3.7970659732818604) | > loss_feat: 3.9850945472717285 (3.9850945472717285) | > loss_mel: 23.162342071533203 (23.162342071533203) | > loss_duration: 2.6499290466308594 (2.6499290466308594) | > loss_1: 35.23421859741211 (35.23421859741211)  --> STEP: 1 | > loss_disc: 2.7365360260009766 (2.7365360260009766) | > loss_disc_real_0: 0.33587807416915894 (0.33587807416915894) | > loss_disc_real_1: 0.2559725046157837 (0.2559725046157837) | > loss_disc_real_2: 0.35020896792411804 (0.35020896792411804) | > loss_disc_real_3: 0.2215345948934555 (0.2215345948934555) | > loss_disc_real_4: 0.18397286534309387 (0.18397286534309387) | > loss_disc_real_5: 0.33847182989120483 (0.33847182989120483) | > loss_0: 2.7365360260009766 (2.7365360260009766) | > loss_gen: 2.37967848777771 (2.37967848777771) | > loss_kl: 3.9366326332092285 (3.9366326332092285) | > loss_feat: 6.521655559539795 (6.521655559539795) | > loss_mel: 25.365827560424805 (25.365827560424805) | > loss_duration: 3.064659357070923 (3.064659357070923) | > loss_1: 41.26845169067383 (41.26845169067383)  --> STEP: 2 | > loss_disc: 2.2921886444091797 (2.514362335205078) | > loss_disc_real_0: 0.1801605224609375 (0.2580192983150482) | > loss_disc_real_1: 0.11574563384056091 (0.1858590692281723) | > loss_disc_real_2: 0.2138603925704956 (0.2820346802473068) | > loss_disc_real_3: 0.3822801411151886 (0.30190736800432205) | > loss_disc_real_4: 0.1658116728067398 (0.17489226907491684) | > loss_disc_real_5: 0.2893131375312805 (0.3138924837112427) | > loss_0: 2.2921886444091797 (2.514362335205078) | > loss_gen: 2.5758891105651855 (2.4777837991714478) | > loss_kl: 4.837359428405762 (4.386996030807495) | > loss_feat: 6.934149742126465 (6.72790265083313) | > loss_mel: 22.0091495513916 (23.687488555908203) | > loss_duration: 2.9716293811798096 (3.018144369125366) | > loss_1: 39.32817840576172 (40.29831504821777)  --> STEP: 3 | > loss_disc: 2.5812511444091797 (2.536658604939779) | > loss_disc_real_0: 0.34286272525787354 (0.2863004406293233) | > loss_disc_real_1: 0.31272315979003906 (0.2281470994154612) | > loss_disc_real_2: 0.204888254404068 (0.25631920496622723) | > loss_disc_real_3: 0.24646854400634766 (0.28342776000499725) | > loss_disc_real_4: 0.16440792381763458 (0.1713974873224894) | > loss_disc_real_5: 0.18013742566108704 (0.2693074643611908) | > loss_0: 2.5812511444091797 (2.536658604939779) | > loss_gen: 2.0671651363372803 (2.3409109115600586) | > loss_kl: 2.564884662628174 (3.779625574747721) | > loss_feat: 3.197403907775879 (5.551069736480713) | > loss_mel: 17.321155548095703 (21.565377553304035) | > loss_duration: 2.741344451904297 (2.9258777300516763) | > loss_1: 27.89195442199707 (36.1628615061442) --> EVAL PERFORMANCE | > avg_loader_time: 0.021073102951049805 (+0.011298338572184244) | > avg_loss_disc: 2.536658604939779 (-0.3579198519388833) | > avg_loss_disc_real_0: 0.2863004406293233 (-0.06865227719148004) | > avg_loss_disc_real_1: 0.2281470994154612 (-0.07748300830523172) | > avg_loss_disc_real_2: 0.25631920496622723 (-0.049743165572484316) | > avg_loss_disc_real_3: 0.28342776000499725 (-0.06182581682999927) | > avg_loss_disc_real_4: 0.1713974873224894 (-0.13528613746166232) | > avg_loss_disc_real_5: 0.2693074643611908 (-0.028062552213668823) | > avg_loss_0: 2.536658604939779 (-0.3579198519388833) | > avg_loss_gen: 2.3409109115600586 (-0.3577829202016196) | > avg_loss_kl: 3.779625574747721 (-0.1683351993560791) | > avg_loss_feat: 5.551069736480713 (+0.5045786499977112) | > avg_loss_mel: 21.565377553304035 (-0.7674592336018904) | > avg_loss_duration: 2.9258777300516763 (-0.023865858713786103) | > avg_loss_1: 36.1628615061442 (-0.8128630320231167)  > EPOCH: 673/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:32:05)   --> TIME: 2023-10-20 07:32:23 -- STEP: 19/50 -- GLOBAL_STEP: 86670 | > loss_disc: 2.9075117111206055 (2.457946363248323) | > loss_disc_real_0: 0.1875789761543274 (0.13438539187374868) | > loss_disc_real_1: 0.2649700343608856 (0.2551243951250064) | > loss_disc_real_2: 0.446025013923645 (0.2373818639469774) | > loss_disc_real_3: 0.4035598039627075 (0.2387468936411958) | > loss_disc_real_4: 0.41461968421936035 (0.20056126305931493) | > loss_disc_real_5: 0.17667201161384583 (0.22123671519128899) | > loss_0: 2.9075117111206055 (2.457946363248323) | > grad_norm_0: tensor(2341.8735, device='cuda:0') (tensor(1030.3408, device='cuda:0')) | > loss_gen: 2.4561562538146973 (2.46142009684914) | > loss_kl: 0.7285457849502563 (0.8723287927476984) | > loss_feat: 6.653554916381836 (6.732765540480614) | > loss_mel: 23.54193687438965 (22.762649548681157) | > loss_duration: 1.4781575202941895 (1.4784266446766101) | > loss_1: 34.85835266113281 (34.307591137133144) | > grad_norm_1: tensor(83739.2500, device='cuda:0') (tensor(49047.2422, device='cuda:0')) | > current_lr_0: 0.00010203085836721323 | > current_lr_1: 0.00010203085836721323 | > step_time: 0.283 (0.4759040631745991) | > loader_time: 0.0018 (0.01302706567864669)  --> TIME: 2023-10-20 07:32:37 -- STEP: 49/50 -- GLOBAL_STEP: 86700 | > loss_disc: 2.8176188468933105 (2.5049004019523156) | > loss_disc_real_0: 0.22512465715408325 (0.14661912863351861) | > loss_disc_real_1: 0.24051816761493683 (0.2312077050838543) | > loss_disc_real_2: 0.27007097005844116 (0.2314792545322253) | > loss_disc_real_3: 0.32138535380363464 (0.24992927110620908) | > loss_disc_real_4: 0.3563805818557739 (0.23079140986106833) | > loss_disc_real_5: 0.2960060238838196 (0.21729727165431392) | > loss_0: 2.8176188468933105 (2.5049004019523156) | > grad_norm_0: tensor(620.2004, device='cuda:0') (tensor(744.5511, device='cuda:0')) | > loss_gen: 2.2567317485809326 (2.307198081697737) | > loss_kl: 0.8297294974327087 (0.8255808243946153) | > loss_feat: 4.017480373382568 (5.642039808843817) | > loss_mel: 22.302221298217773 (21.617105226127464) | > loss_duration: 1.5291495323181152 (1.4364580889137424) | > loss_1: 30.935312271118164 (31.828381917914566) | > grad_norm_1: tensor(16237.3506, device='cuda:0') (tensor(28803.1133, device='cuda:0')) | > current_lr_0: 0.00010203085836721323 | > current_lr_1: 0.00010203085836721323 | > step_time: 0.8442 (0.4693093981061663) | > loader_time: 0.4435 (0.019442169033751195)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.180094003677368 (3.180094003677368) | > loss_disc_real_0: 0.5588942170143127 (0.5588942170143127) | > loss_disc_real_1: 0.34732699394226074 (0.34732699394226074) | > loss_disc_real_2: 0.3400366008281708 (0.3400366008281708) | > loss_disc_real_3: 0.3728199601173401 (0.3728199601173401) | > loss_disc_real_4: 0.2529062330722809 (0.2529062330722809) | > loss_disc_real_5: 0.17721043527126312 (0.17721043527126312) | > loss_0: 3.180094003677368 (3.180094003677368) | > loss_gen: 2.220641613006592 (2.220641613006592) | > loss_kl: 6.551342010498047 (6.551342010498047) | > loss_feat: 4.357840538024902 (4.357840538024902) | > loss_mel: 21.878582000732422 (21.878582000732422) | > loss_duration: 2.8812108039855957 (2.8812108039855957) | > loss_1: 37.889617919921875 (37.889617919921875)  --> STEP: 1 | > loss_disc: 2.538053512573242 (2.538053512573242) | > loss_disc_real_0: 0.29292139410972595 (0.29292139410972595) | > loss_disc_real_1: 0.24982842803001404 (0.24982842803001404) | > loss_disc_real_2: 0.18723514676094055 (0.18723514676094055) | > loss_disc_real_3: 0.3083045780658722 (0.3083045780658722) | > loss_disc_real_4: 0.24137435853481293 (0.24137435853481293) | > loss_disc_real_5: 0.293315052986145 (0.293315052986145) | > loss_0: 2.538053512573242 (2.538053512573242) | > loss_gen: 2.7479560375213623 (2.7479560375213623) | > loss_kl: 4.7187395095825195 (4.7187395095825195) | > loss_feat: 8.160684585571289 (8.160684585571289) | > loss_mel: 24.549043655395508 (24.549043655395508) | > loss_duration: 3.0870821475982666 (3.0870821475982666) | > loss_1: 43.26350402832031 (43.26350402832031)  --> STEP: 2 | > loss_disc: 2.108642101287842 (2.323347806930542) | > loss_disc_real_0: 0.11315648257732391 (0.20303893834352493) | > loss_disc_real_1: 0.1829693466424942 (0.21639888733625412) | > loss_disc_real_2: 0.2059381604194641 (0.19658665359020233) | > loss_disc_real_3: 0.277461439371109 (0.2928830087184906) | > loss_disc_real_4: 0.20196489989757538 (0.22166962921619415) | > loss_disc_real_5: 0.1716165691614151 (0.23246581107378006) | > loss_0: 2.108642101287842 (2.323347806930542) | > loss_gen: 2.5843069553375244 (2.6661314964294434) | > loss_kl: 4.598623752593994 (4.658681631088257) | > loss_feat: 9.388642311096191 (8.77466344833374) | > loss_mel: 23.699073791503906 (24.124058723449707) | > loss_duration: 3.0074758529663086 (3.0472790002822876) | > loss_1: 43.27812576293945 (43.27081489562988)  --> STEP: 3 | > loss_disc: 2.601860523223877 (2.4161853790283203) | > loss_disc_real_0: 0.16381330788135529 (0.18996372818946838) | > loss_disc_real_1: 0.22508813440799713 (0.21929530302683511) | > loss_disc_real_2: 0.32390475273132324 (0.23902601997057596) | > loss_disc_real_3: 0.36408212780952454 (0.3166160484155019) | > loss_disc_real_4: 0.0909985676407814 (0.17811260869105658) | > loss_disc_real_5: 0.06455116719007492 (0.176494263112545) | > loss_0: 2.601860523223877 (2.4161853790283203) | > loss_gen: 2.291626214981079 (2.541296402613322) | > loss_kl: 2.772932529449463 (4.030098597208659) | > loss_feat: 7.1698760986328125 (8.239734331766764) | > loss_mel: 24.06608772277832 (24.104735056559246) | > loss_duration: 2.8341376781463623 (2.976231892903646) | > loss_1: 39.13465881347656 (41.892096201578774) --> EVAL PERFORMANCE | > avg_loader_time: 0.032356977462768555 (+0.01128387451171875) | > avg_loss_disc: 2.4161853790283203 (-0.12047322591145848) | > avg_loss_disc_real_0: 0.18996372818946838 (-0.09633671243985492) | > avg_loss_disc_real_1: 0.21929530302683511 (-0.008851796388626099) | > avg_loss_disc_real_2: 0.23902601997057596 (-0.017293184995651273) | > avg_loss_disc_real_3: 0.3166160484155019 (+0.03318828841050464) | > avg_loss_disc_real_4: 0.17811260869105658 (+0.006715121368567167) | > avg_loss_disc_real_5: 0.176494263112545 (-0.09281320124864578) | > avg_loss_0: 2.4161853790283203 (-0.12047322591145848) | > avg_loss_gen: 2.541296402613322 (+0.2003854910532632) | > avg_loss_kl: 4.030098597208659 (+0.25047302246093794) | > avg_loss_feat: 8.239734331766764 (+2.688664595286051) | > avg_loss_mel: 24.104735056559246 (+2.5393575032552107) | > avg_loss_duration: 2.976231892903646 (+0.0503541628519697) | > avg_loss_1: 41.892096201578774 (+5.72923469543457)  > EPOCH: 674/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:32:55)   --> TIME: 2023-10-20 07:33:18 -- STEP: 29/50 -- GLOBAL_STEP: 86730 | > loss_disc: 2.1284780502319336 (2.4520202792924026) | > loss_disc_real_0: 0.20791147649288177 (0.14488237123165662) | > loss_disc_real_1: 0.1420501470565796 (0.21032326373046842) | > loss_disc_real_2: 0.1768636554479599 (0.2361047184415933) | > loss_disc_real_3: 0.12188716977834702 (0.23693138739929118) | > loss_disc_real_4: 0.17723600566387177 (0.22749685765854244) | > loss_disc_real_5: 0.18968041241168976 (0.216429663886284) | > loss_0: 2.1284780502319336 (2.4520202792924026) | > grad_norm_0: tensor(462.0049, device='cuda:0') (tensor(589.4675, device='cuda:0')) | > loss_gen: 2.5058646202087402 (2.3387781381607056) | > loss_kl: 0.9437785744667053 (0.852762829640816) | > loss_feat: 5.412604331970215 (6.213662587363144) | > loss_mel: 21.71670913696289 (22.879871664376093) | > loss_duration: 1.3988351821899414 (1.446397904692025) | > loss_1: 31.97779083251953 (33.731472738857924) | > grad_norm_1: tensor(3313.5247, device='cuda:0') (tensor(24108.9258, device='cuda:0')) | > current_lr_0: 0.00010192887213618864 | > current_lr_1: 0.00010192887213618864 | > step_time: 0.8065 (0.6054505315320245) | > loader_time: 0.0065 (0.023679749719027816)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0181021690368652 (3.0181021690368652) | > loss_disc_real_0: 0.22424080967903137 (0.22424080967903137) | > loss_disc_real_1: 0.24764323234558105 (0.24764323234558105) | > loss_disc_real_2: 0.2338895946741104 (0.2338895946741104) | > loss_disc_real_3: 0.17761634290218353 (0.17761634290218353) | > loss_disc_real_4: 0.26627466082572937 (0.26627466082572937) | > loss_disc_real_5: 0.32663798332214355 (0.32663798332214355) | > loss_0: 3.0181021690368652 (3.0181021690368652) | > loss_gen: 1.4835706949234009 (1.4835706949234009) | > loss_kl: 4.904707431793213 (4.904707431793213) | > loss_feat: 0.03830866888165474 (0.03830866888165474) | > loss_mel: 1.328804612159729 (1.328804612159729) | > loss_duration: 2.8430063724517822 (2.8430063724517822) | > loss_1: 10.598397254943848 (10.598397254943848)  --> STEP: 1 | > loss_disc: 2.8802359104156494 (2.8802359104156494) | > loss_disc_real_0: 0.37022560834884644 (0.37022560834884644) | > loss_disc_real_1: 0.24253886938095093 (0.24253886938095093) | > loss_disc_real_2: 0.08988398313522339 (0.08988398313522339) | > loss_disc_real_3: 0.24569940567016602 (0.24569940567016602) | > loss_disc_real_4: 0.2865276336669922 (0.2865276336669922) | > loss_disc_real_5: 0.2636643648147583 (0.2636643648147583) | > loss_0: 2.8802359104156494 (2.8802359104156494) | > loss_gen: 1.9717587232589722 (1.9717587232589722) | > loss_kl: 4.697668552398682 (4.697668552398682) | > loss_feat: 5.852601051330566 (5.852601051330566) | > loss_mel: 24.76727867126465 (24.76727867126465) | > loss_duration: 3.024437665939331 (3.024437665939331) | > loss_1: 40.31374740600586 (40.31374740600586)  --> STEP: 2 | > loss_disc: 2.7567026615142822 (2.818469285964966) | > loss_disc_real_0: 0.3047710061073303 (0.3374983072280884) | > loss_disc_real_1: 0.2092350274324417 (0.22588694840669632) | > loss_disc_real_2: 0.3013538718223572 (0.19561892747879028) | > loss_disc_real_3: 0.4185449779033661 (0.33212219178676605) | > loss_disc_real_4: 0.14486201107501984 (0.215694822371006) | > loss_disc_real_5: 0.1939818114042282 (0.22882308810949326) | > loss_0: 2.7567026615142822 (2.818469285964966) | > loss_gen: 2.23091459274292 (2.101336658000946) | > loss_kl: 4.966000556945801 (4.831834554672241) | > loss_feat: 8.346345901489258 (7.099473476409912) | > loss_mel: 26.257028579711914 (25.51215362548828) | > loss_duration: 2.968573570251465 (2.996505618095398) | > loss_1: 44.768863677978516 (42.54130554199219)  --> STEP: 3 | > loss_disc: 1.6826800107955933 (2.4398728609085083) | > loss_disc_real_0: 0.042551007121801376 (0.23918254052599272) | > loss_disc_real_1: 0.18291553854942322 (0.21156314512093863) | > loss_disc_real_2: 0.19166550040245056 (0.19430111845334372) | > loss_disc_real_3: 0.2084968537092209 (0.29091374576091766) | > loss_disc_real_4: 0.06760063767433167 (0.16633009413878122) | > loss_disc_real_5: 0.09987539798021317 (0.18584052473306656) | > loss_0: 1.6826800107955933 (2.4398728609085083) | > loss_gen: 2.503472328186035 (2.2353818813959756) | > loss_kl: 2.349952459335327 (4.00454052289327) | > loss_feat: 6.050347328186035 (6.749764760335286) | > loss_mel: 22.99335479736328 (24.67255401611328) | > loss_duration: 2.7975986003875732 (2.9302032788594565) | > loss_1: 36.694725036621094 (40.592445373535156) --> EVAL PERFORMANCE | > avg_loader_time: 0.013106346130371094 (-0.01925063133239746) | > avg_loss_disc: 2.4398728609085083 (+0.02368748188018799) | > avg_loss_disc_real_0: 0.23918254052599272 (+0.04921881233652434) | > avg_loss_disc_real_1: 0.21156314512093863 (-0.007732157905896486) | > avg_loss_disc_real_2: 0.19430111845334372 (-0.04472490151723224) | > avg_loss_disc_real_3: 0.29091374576091766 (-0.02570230265458423) | > avg_loss_disc_real_4: 0.16633009413878122 (-0.011782514552275358) | > avg_loss_disc_real_5: 0.18584052473306656 (+0.009346261620521545) | > avg_loss_0: 2.4398728609085083 (+0.02368748188018799) | > avg_loss_gen: 2.2353818813959756 (-0.3059145212173462) | > avg_loss_kl: 4.00454052289327 (-0.02555807431538959) | > avg_loss_feat: 6.749764760335286 (-1.4899695714314776) | > avg_loss_mel: 24.67255401611328 (+0.5678189595540353) | > avg_loss_duration: 2.9302032788594565 (-0.04602861404418945) | > avg_loss_1: 40.592445373535156 (-1.2996508280436174)  > EPOCH: 675/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:33:48)   --> TIME: 2023-10-20 07:34:01 -- STEP: 9/50 -- GLOBAL_STEP: 86760 | > loss_disc: 1.5038343667984009 (2.1970464653438992) | > loss_disc_real_0: 0.08108808845281601 (0.1482456512749195) | > loss_disc_real_1: 0.22907239198684692 (0.19676082622673777) | > loss_disc_real_2: 0.20105309784412384 (0.18986297109060818) | > loss_disc_real_3: 0.22526031732559204 (0.2121394785741965) | > loss_disc_real_4: 0.05889495089650154 (0.15358671049276987) | > loss_disc_real_5: 0.03760984539985657 (0.20466015529301432) | > loss_0: 1.5038343667984009 (2.1970464653438992) | > grad_norm_0: tensor(233.4591, device='cuda:0') (tensor(417.4083, device='cuda:0')) | > loss_gen: 3.1116766929626465 (2.454923815197415) | > loss_kl: 0.7019586563110352 (0.8609409464730157) | > loss_feat: 8.079090118408203 (5.298904786610769) | > loss_mel: 20.42213249206543 (18.189615699979996) | > loss_duration: 1.387213945388794 (1.4337223238415189) | > loss_1: 33.70207214355469 (28.238107257419163) | > grad_norm_1: tensor(16781.6055, device='cuda:0') (tensor(24859.2910, device='cuda:0')) | > current_lr_0: 0.00010182698784678725 | > current_lr_1: 0.00010182698784678725 | > step_time: 0.2915 (0.7161256207360162) | > loader_time: 0.027 (0.01734516355726454)  --> TIME: 2023-10-20 07:34:20 -- STEP: 39/50 -- GLOBAL_STEP: 86790 | > loss_disc: 1.789705753326416 (2.3503847122192383) | > loss_disc_real_0: 0.02201787754893303 (0.1435640334414366) | > loss_disc_real_1: 0.20576466619968414 (0.21756214638933158) | > loss_disc_real_2: 0.14665019512176514 (0.2068861196629512) | > loss_disc_real_3: 0.13458500802516937 (0.22710460510391456) | > loss_disc_real_4: 0.1687893122434616 (0.2290589669958139) | > loss_disc_real_5: 0.06812091916799545 (0.20400994232831857) | > loss_0: 1.789705753326416 (2.3503847122192383) | > grad_norm_0: tensor(379.9396, device='cuda:0') (tensor(542.3534, device='cuda:0')) | > loss_gen: 2.6516647338867188 (2.3576699434182578) | > loss_kl: 0.5052956342697144 (0.8764227674557612) | > loss_feat: 7.848029613494873 (4.985337984079543) | > loss_mel: 24.5150203704834 (20.256001577927517) | > loss_duration: 1.424072027206421 (1.4276875318625035) | > loss_1: 36.94408416748047 (29.90311964964255) | > grad_norm_1: tensor(14590.4590, device='cuda:0') (tensor(24961.2520, device='cuda:0')) | > current_lr_0: 0.00010182698784678725 | > current_lr_1: 0.00010182698784678725 | > step_time: 0.3387 (0.6370076399583083) | > loader_time: 0.0181 (0.019422231576381583)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9710440635681152 (2.9710440635681152) | > loss_disc_real_0: 0.15033915638923645 (0.15033915638923645) | > loss_disc_real_1: 0.2563279867172241 (0.2563279867172241) | > loss_disc_real_2: 0.3362502455711365 (0.3362502455711365) | > loss_disc_real_3: 0.422325074672699 (0.422325074672699) | > loss_disc_real_4: 0.2594960033893585 (0.2594960033893585) | > loss_disc_real_5: 0.3177861273288727 (0.3177861273288727) | > loss_0: 2.9710440635681152 (2.9710440635681152) | > loss_gen: 1.9653663635253906 (1.9653663635253906) | > loss_kl: 3.995435953140259 (3.995435953140259) | > loss_feat: 3.997375726699829 (3.997375726699829) | > loss_mel: 24.946044921875 (24.946044921875) | > loss_duration: 2.8725783824920654 (2.8725783824920654) | > loss_1: 37.77680206298828 (37.77680206298828)  --> STEP: 1 | > loss_disc: 2.0082268714904785 (2.0082268714904785) | > loss_disc_real_0: 0.05714904144406319 (0.05714904144406319) | > loss_disc_real_1: 0.1815481036901474 (0.1815481036901474) | > loss_disc_real_2: 0.1721230298280716 (0.1721230298280716) | > loss_disc_real_3: 0.28346481919288635 (0.28346481919288635) | > loss_disc_real_4: 0.14345337450504303 (0.14345337450504303) | > loss_disc_real_5: 0.25202620029449463 (0.25202620029449463) | > loss_0: 2.0082268714904785 (2.0082268714904785) | > loss_gen: 2.3909101486206055 (2.3909101486206055) | > loss_kl: 4.384476661682129 (4.384476661682129) | > loss_feat: 6.772761344909668 (6.772761344909668) | > loss_mel: 22.290796279907227 (22.290796279907227) | > loss_duration: 3.2628509998321533 (3.2628509998321533) | > loss_1: 39.10179901123047 (39.10179901123047)  --> STEP: 2 | > loss_disc: 2.075329065322876 (2.0417779684066772) | > loss_disc_real_0: 0.28712522983551025 (0.17213713563978672) | > loss_disc_real_1: 0.171624094247818 (0.1765860989689827) | > loss_disc_real_2: 0.27087709307670593 (0.22150006145238876) | > loss_disc_real_3: 0.25996315479278564 (0.271713986992836) | > loss_disc_real_4: 0.06369060277938843 (0.10357198864221573) | > loss_disc_real_5: 0.12392648309469223 (0.18797634169459343) | > loss_0: 2.075329065322876 (2.0417779684066772) | > loss_gen: 3.076550006866455 (2.7337300777435303) | > loss_kl: 4.323632717132568 (4.354054689407349) | > loss_feat: 12.51801586151123 (9.64538860321045) | > loss_mel: 25.709009170532227 (23.999902725219727) | > loss_duration: 3.0650768280029297 (3.1639639139175415) | > loss_1: 48.692283630371094 (43.89704132080078)  --> STEP: 3 | > loss_disc: 2.87001895904541 (2.3178582986195884) | > loss_disc_real_0: 0.05081921070814133 (0.13169782732923827) | > loss_disc_real_1: 0.24309948086738586 (0.1987572262684504) | > loss_disc_real_2: 0.2251342386007309 (0.22271145383516947) | > loss_disc_real_3: 0.35575294494628906 (0.29972697297732037) | > loss_disc_real_4: 0.2974295914173126 (0.16819118956724802) | > loss_disc_real_5: 0.3832310438156128 (0.2530612424015999) | > loss_0: 2.87001895904541 (2.3178582986195884) | > loss_gen: 2.037788152694702 (2.5017494360605874) | > loss_kl: 2.098512887954712 (3.6022074222564697) | > loss_feat: 5.90930700302124 (8.400028069814047) | > loss_mel: 24.034767150878906 (24.011524200439453) | > loss_duration: 2.8092994689941406 (3.0457424322764077) | > loss_1: 36.88967514038086 (41.56125259399414) --> EVAL PERFORMANCE | > avg_loader_time: 0.021895488103230793 (+0.0087891419728597) | > avg_loss_disc: 2.3178582986195884 (-0.12201456228891994) | > avg_loss_disc_real_0: 0.13169782732923827 (-0.10748471319675446) | > avg_loss_disc_real_1: 0.1987572262684504 (-0.012805918852488218) | > avg_loss_disc_real_2: 0.22271145383516947 (+0.028410335381825746) | > avg_loss_disc_real_3: 0.29972697297732037 (+0.008813227216402708) | > avg_loss_disc_real_4: 0.16819118956724802 (+0.0018610954284667969) | > avg_loss_disc_real_5: 0.2530612424015999 (+0.06722071766853333) | > avg_loss_0: 2.3178582986195884 (-0.12201456228891994) | > avg_loss_gen: 2.5017494360605874 (+0.2663675546646118) | > avg_loss_kl: 3.6022074222564697 (-0.40233310063679983) | > avg_loss_feat: 8.400028069814047 (+1.6502633094787607) | > avg_loss_mel: 24.011524200439453 (-0.6610298156738281) | > avg_loss_duration: 3.0457424322764077 (+0.1155391534169512) | > avg_loss_1: 41.56125259399414 (+0.9688072204589844)  > EPOCH: 676/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:34:41)   --> TIME: 2023-10-20 07:34:55 -- STEP: 19/50 -- GLOBAL_STEP: 86820 | > loss_disc: 2.5738704204559326 (2.5632588486922416) | > loss_disc_real_0: 0.03717070445418358 (0.15749980014209686) | > loss_disc_real_1: 0.12414974719285965 (0.21434058876414047) | > loss_disc_real_2: 0.4225137233734131 (0.2762534022331238) | > loss_disc_real_3: 0.2027038335800171 (0.2673481875344327) | > loss_disc_real_4: 0.21142219007015228 (0.25254875960710804) | > loss_disc_real_5: 0.22495976090431213 (0.2622788783751036) | > loss_0: 2.5738704204559326 (2.5632588486922416) | > grad_norm_0: tensor(420.2545, device='cuda:0') (tensor(685.1984, device='cuda:0')) | > loss_gen: 2.0976109504699707 (2.384387882132279) | > loss_kl: 0.7828875184059143 (0.9272824070955578) | > loss_feat: 8.68366813659668 (5.073401646786614) | > loss_mel: 27.021265029907227 (21.308924856938813) | > loss_duration: 1.5605305433273315 (1.4904342262368453) | > loss_1: 40.14596176147461 (31.184430975663034) | > grad_norm_1: tensor(20790.0195, device='cuda:0') (tensor(18344.4062, device='cuda:0')) | > current_lr_0: 0.00010172520539711203 | > current_lr_1: 0.00010172520539711203 | > step_time: 0.3185 (0.4157258334912752) | > loader_time: 0.0049 (0.011367948431717722)  --> TIME: 2023-10-20 07:35:20 -- STEP: 49/50 -- GLOBAL_STEP: 86850 | > loss_disc: 2.460726261138916 (2.3425685203805267) | > loss_disc_real_0: 0.04846321791410446 (0.14375283092032282) | > loss_disc_real_1: 0.1921546459197998 (0.20885031274995025) | > loss_disc_real_2: 0.2461492419242859 (0.23881468207252268) | > loss_disc_real_3: 0.26899418234825134 (0.23788682333364777) | > loss_disc_real_4: 0.20406785607337952 (0.2173306588843769) | > loss_disc_real_5: 0.2707782983779907 (0.22353124794341167) | > loss_0: 2.460726261138916 (2.3425685203805267) | > grad_norm_0: tensor(1106.4053, device='cuda:0') (tensor(726.3093, device='cuda:0')) | > loss_gen: 2.0773677825927734 (2.504914176707365) | > loss_kl: 0.5671123266220093 (0.8220213584753931) | > loss_feat: 3.3134515285491943 (6.205026928563507) | > loss_mel: 22.83519744873047 (22.050739212911957) | > loss_duration: 1.5669387578964233 (1.433053731918335) | > loss_1: 30.36006736755371 (33.01575514735008) | > grad_norm_1: tensor(7080.2329, device='cuda:0') (tensor(23296.5508, device='cuda:0')) | > current_lr_0: 0.00010172520539711203 | > current_lr_1: 0.00010172520539711203 | > step_time: 0.6113 (0.633563654763358) | > loader_time: 0.5496 (0.030573475117586093)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6110148429870605 (2.6110148429870605) | > loss_disc_real_0: 0.36384284496307373 (0.36384284496307373) | > loss_disc_real_1: 0.18004630506038666 (0.18004630506038666) | > loss_disc_real_2: 0.29297587275505066 (0.29297587275505066) | > loss_disc_real_3: 0.3196941614151001 (0.3196941614151001) | > loss_disc_real_4: 0.22833481431007385 (0.22833481431007385) | > loss_disc_real_5: 0.23132850229740143 (0.23132850229740143) | > loss_0: 2.6110148429870605 (2.6110148429870605) | > loss_gen: 2.578397512435913 (2.578397512435913) | > loss_kl: 4.169618129730225 (4.169618129730225) | > loss_feat: 5.929929256439209 (5.929929256439209) | > loss_mel: 21.968502044677734 (21.968502044677734) | > loss_duration: 2.851423978805542 (2.851423978805542) | > loss_1: 37.49787139892578 (37.49787139892578)  --> STEP: 1 | > loss_disc: 2.5417091846466064 (2.5417091846466064) | > loss_disc_real_0: 0.21150735020637512 (0.21150735020637512) | > loss_disc_real_1: 0.3134929835796356 (0.3134929835796356) | > loss_disc_real_2: 0.31094223260879517 (0.31094223260879517) | > loss_disc_real_3: 0.16335460543632507 (0.16335460543632507) | > loss_disc_real_4: 0.29859650135040283 (0.29859650135040283) | > loss_disc_real_5: 0.1799662858247757 (0.1799662858247757) | > loss_0: 2.5417091846466064 (2.5417091846466064) | > loss_gen: 2.4306256771087646 (2.4306256771087646) | > loss_kl: 4.4029107093811035 (4.4029107093811035) | > loss_feat: 4.502810478210449 (4.502810478210449) | > loss_mel: 22.286813735961914 (22.286813735961914) | > loss_duration: 3.1067957878112793 (3.1067957878112793) | > loss_1: 36.729957580566406 (36.729957580566406)  --> STEP: 2 | > loss_disc: 2.313627004623413 (2.4276680946350098) | > loss_disc_real_0: 0.13368992507457733 (0.17259863764047623) | > loss_disc_real_1: 0.147993266582489 (0.23074312508106232) | > loss_disc_real_2: 0.28154081106185913 (0.29624152183532715) | > loss_disc_real_3: 0.34143054485321045 (0.25239257514476776) | > loss_disc_real_4: 0.1719788759946823 (0.23528768867254257) | > loss_disc_real_5: 0.39664480090141296 (0.28830554336309433) | > loss_0: 2.313627004623413 (2.4276680946350098) | > loss_gen: 2.843400478363037 (2.637013077735901) | > loss_kl: 5.131161212921143 (4.767035961151123) | > loss_feat: 7.580194473266602 (6.041502475738525) | > loss_mel: 24.03153419494629 (23.1591739654541) | > loss_duration: 2.9768826961517334 (3.0418392419815063) | > loss_1: 42.56317138671875 (39.64656448364258)  --> STEP: 3 | > loss_disc: 3.299971580505371 (2.7184359232584634) | > loss_disc_real_0: 0.18395505845546722 (0.17638411124547324) | > loss_disc_real_1: 0.2676697373390198 (0.2430519958337148) | > loss_disc_real_2: 0.3182065486907959 (0.3035631974538167) | > loss_disc_real_3: 0.26649466156959534 (0.25709327061971027) | > loss_disc_real_4: 0.38340651988983154 (0.2846606324116389) | > loss_disc_real_5: 0.36585599184036255 (0.3141556928555171) | > loss_0: 3.299971580505371 (2.7184359232584634) | > loss_gen: 1.74607253074646 (2.3400328954060874) | > loss_kl: 1.9953887462615967 (3.8431535561879477) | > loss_feat: 5.025743007659912 (5.702915986378987) | > loss_mel: 23.566335678100586 (23.294894536336262) | > loss_duration: 2.82450008392334 (2.9693928559621177) | > loss_1: 35.15803909301758 (38.15038935343424) --> EVAL PERFORMANCE | > avg_loader_time: 0.005956411361694336 (-0.015939076741536457) | > avg_loss_disc: 2.7184359232584634 (+0.40057762463887503) | > avg_loss_disc_real_0: 0.17638411124547324 (+0.04468628391623497) | > avg_loss_disc_real_1: 0.2430519958337148 (+0.0442947695652644) | > avg_loss_disc_real_2: 0.3035631974538167 (+0.08085174361864725) | > avg_loss_disc_real_3: 0.25709327061971027 (-0.042633702357610104) | > avg_loss_disc_real_4: 0.2846606324116389 (+0.1164694428443909) | > avg_loss_disc_real_5: 0.3141556928555171 (+0.061094450453917204) | > avg_loss_0: 2.7184359232584634 (+0.40057762463887503) | > avg_loss_gen: 2.3400328954060874 (-0.16171654065450003) | > avg_loss_kl: 3.8431535561879477 (+0.240946133931478) | > avg_loss_feat: 5.702915986378987 (-2.6971120834350595) | > avg_loss_mel: 23.294894536336262 (-0.7166296641031913) | > avg_loss_duration: 2.9693928559621177 (-0.07634957631429007) | > avg_loss_1: 38.15038935343424 (-3.410863240559898)  > EPOCH: 677/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:35:32)   --> TIME: 2023-10-20 07:35:56 -- STEP: 29/50 -- GLOBAL_STEP: 86880 | > loss_disc: 2.788918972015381 (2.3039539106960962) | > loss_disc_real_0: 0.20748093724250793 (0.15077442181264533) | > loss_disc_real_1: 0.20644420385360718 (0.21858173660163221) | > loss_disc_real_2: 0.19790314137935638 (0.22824071617475872) | > loss_disc_real_3: 0.24045643210411072 (0.23270401024612888) | > loss_disc_real_4: 0.21651576459407806 (0.2186574610913622) | > loss_disc_real_5: 0.26184773445129395 (0.21212410962144876) | > loss_0: 2.788918972015381 (2.3039539106960962) | > grad_norm_0: tensor(511.3033, device='cuda:0') (tensor(512.7377, device='cuda:0')) | > loss_gen: 1.6941814422607422 (2.552030082406669) | > loss_kl: 0.9302759766578674 (0.9355384984920765) | > loss_feat: 1.3841431140899658 (6.337769520179979) | > loss_mel: 17.450464248657227 (22.704031594868365) | > loss_duration: 1.454915165901184 (1.442893044701938) | > loss_1: 22.91398048400879 (33.972262579819244) | > grad_norm_1: tensor(3764.0261, device='cuda:0') (tensor(22841.6602, device='cuda:0')) | > current_lr_0: 0.00010162352468536781 | > current_lr_1: 0.00010162352468536781 | > step_time: 0.8246 (0.6296780931538549) | > loader_time: 0.0452 (0.022121191024780273)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.519493579864502 (2.519493579864502) | > loss_disc_real_0: 0.11402525007724762 (0.11402525007724762) | > loss_disc_real_1: 0.28819265961647034 (0.28819265961647034) | > loss_disc_real_2: 0.27063116431236267 (0.27063116431236267) | > loss_disc_real_3: 0.347255676984787 (0.347255676984787) | > loss_disc_real_4: 0.366318017244339 (0.366318017244339) | > loss_disc_real_5: 0.3510802984237671 (0.3510802984237671) | > loss_0: 2.519493579864502 (2.519493579864502) | > loss_gen: 3.0830814838409424 (3.0830814838409424) | > loss_kl: 4.6409807205200195 (4.6409807205200195) | > loss_feat: 4.504251480102539 (4.504251480102539) | > loss_mel: 22.960580825805664 (22.960580825805664) | > loss_duration: 2.7664711475372314 (2.7664711475372314) | > loss_1: 37.95536422729492 (37.95536422729492)  --> STEP: 1 | > loss_disc: 3.123289108276367 (3.123289108276367) | > loss_disc_real_0: 0.16116070747375488 (0.16116070747375488) | > loss_disc_real_1: 0.22053398191928864 (0.22053398191928864) | > loss_disc_real_2: 0.25453445315361023 (0.25453445315361023) | > loss_disc_real_3: 0.3485196828842163 (0.3485196828842163) | > loss_disc_real_4: 0.4066940248012543 (0.4066940248012543) | > loss_disc_real_5: 0.23486389219760895 (0.23486389219760895) | > loss_0: 3.123289108276367 (3.123289108276367) | > loss_gen: 1.8818976879119873 (1.8818976879119873) | > loss_kl: 4.241304874420166 (4.241304874420166) | > loss_feat: 7.241554260253906 (7.241554260253906) | > loss_mel: 23.189958572387695 (23.189958572387695) | > loss_duration: 3.1429598331451416 (3.1429598331451416) | > loss_1: 39.69767379760742 (39.69767379760742)  --> STEP: 2 | > loss_disc: 2.359840154647827 (2.741564631462097) | > loss_disc_real_0: 0.06029127910733223 (0.11072599329054356) | > loss_disc_real_1: 0.2584395408630371 (0.23948676139116287) | > loss_disc_real_2: 0.2499026209115982 (0.2522185370326042) | > loss_disc_real_3: 0.2824541926383972 (0.31548693776130676) | > loss_disc_real_4: 0.08576436340808868 (0.24622919410467148) | > loss_disc_real_5: 0.07121167331933975 (0.15303778275847435) | > loss_0: 2.359840154647827 (2.741564631462097) | > loss_gen: 2.15616512298584 (2.0190314054489136) | > loss_kl: 5.071809768676758 (4.656557321548462) | > loss_feat: 8.550162315368652 (7.895858287811279) | > loss_mel: 25.585927963256836 (24.387943267822266) | > loss_duration: 2.9716808795928955 (3.0573203563690186) | > loss_1: 44.33574676513672 (42.01671028137207)  --> STEP: 3 | > loss_disc: 2.110217571258545 (2.5311156113942466) | > loss_disc_real_0: 0.10700897872447968 (0.10948698843518893) | > loss_disc_real_1: 0.17722994089126587 (0.2187344878911972) | > loss_disc_real_2: 0.14131388068199158 (0.21525031824906668) | > loss_disc_real_3: 0.1902768462896347 (0.27375024060408276) | > loss_disc_real_4: 0.14672809839248657 (0.21306216220060983) | > loss_disc_real_5: 0.08800928294658661 (0.13136161615451178) | > loss_0: 2.110217571258545 (2.5311156113942466) | > loss_gen: 2.322563409805298 (2.120208740234375) | > loss_kl: 2.3725814819335938 (3.8952320416768393) | > loss_feat: 5.649644374847412 (7.147120316823323) | > loss_mel: 21.972698211669922 (23.582861582438152) | > loss_duration: 2.9312803745269775 (3.0153070290883384) | > loss_1: 35.24877166748047 (39.7607307434082) --> EVAL PERFORMANCE | > avg_loader_time: 0.005572160085042317 (-0.0003842512766520185) | > avg_loss_disc: 2.5311156113942466 (-0.18732031186421683) | > avg_loss_disc_real_0: 0.10948698843518893 (-0.0668971228102843) | > avg_loss_disc_real_1: 0.2187344878911972 (-0.024317507942517608) | > avg_loss_disc_real_2: 0.21525031824906668 (-0.08831287920475003) | > avg_loss_disc_real_3: 0.27375024060408276 (+0.016656969984372494) | > avg_loss_disc_real_4: 0.21306216220060983 (-0.07159847021102908) | > avg_loss_disc_real_5: 0.13136161615451178 (-0.1827940767010053) | > avg_loss_0: 2.5311156113942466 (-0.18732031186421683) | > avg_loss_gen: 2.120208740234375 (-0.2198241551717124) | > avg_loss_kl: 3.8952320416768393 (+0.0520784854888916) | > avg_loss_feat: 7.147120316823323 (+1.444204330444336) | > avg_loss_mel: 23.582861582438152 (+0.2879670461018904) | > avg_loss_duration: 3.0153070290883384 (+0.0459141731262207) | > avg_loss_1: 39.7607307434082 (+1.6103413899739607)  > EPOCH: 678/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:36:25)   --> TIME: 2023-10-20 07:36:36 -- STEP: 9/50 -- GLOBAL_STEP: 86910 | > loss_disc: 2.5384531021118164 (2.463303804397583) | > loss_disc_real_0: 0.14443418383598328 (0.12183068692684174) | > loss_disc_real_1: 0.24388818442821503 (0.23540854454040527) | > loss_disc_real_2: 0.13709081709384918 (0.2049347327815162) | > loss_disc_real_3: 0.28443533182144165 (0.23915838657153976) | > loss_disc_real_4: 0.29886943101882935 (0.26612501757012474) | > loss_disc_real_5: 0.24363522231578827 (0.21727960225608614) | > loss_0: 2.5384531021118164 (2.463303804397583) | > grad_norm_0: tensor(446.4864, device='cuda:0') (tensor(537.6667, device='cuda:0')) | > loss_gen: 1.9526879787445068 (2.3147650162378945) | > loss_kl: 0.592621922492981 (0.8474087847603692) | > loss_feat: 1.8087373971939087 (5.600817567772335) | > loss_mel: 19.82912826538086 (21.64588917626275) | > loss_duration: 1.4192651510238647 (1.4647296799553766) | > loss_1: 25.602441787719727 (31.873610496520996) | > grad_norm_1: tensor(3259.3137, device='cuda:0') (tensor(24299.9414, device='cuda:0')) | > current_lr_0: 0.00010152194560986112 | > current_lr_1: 0.00010152194560986112 | > step_time: 0.4783 (0.6904025077819824) | > loader_time: 0.0347 (0.03930221663581)  --> TIME: 2023-10-20 07:36:55 -- STEP: 39/50 -- GLOBAL_STEP: 86940 | > loss_disc: 2.223475217819214 (2.518456975618998) | > loss_disc_real_0: 0.06810083240270615 (0.18423957048127287) | > loss_disc_real_1: 0.1409599930047989 (0.22554721415807039) | > loss_disc_real_2: 0.21687382459640503 (0.2185018479059904) | > loss_disc_real_3: 0.2212587147951126 (0.23098274196187654) | > loss_disc_real_4: 0.3810047209262848 (0.25360353319690776) | > loss_disc_real_5: 0.29677075147628784 (0.2423502674851661) | > loss_0: 2.223475217819214 (2.518456975618998) | > grad_norm_0: tensor(1204.3044, device='cuda:0') (tensor(840.4101, device='cuda:0')) | > loss_gen: 2.758253812789917 (2.3012538445301547) | > loss_kl: 0.41037657856941223 (0.8508016224472951) | > loss_feat: 5.457479953765869 (4.994457673567992) | > loss_mel: 20.204862594604492 (20.229871444213085) | > loss_duration: 1.4491537809371948 (1.4249996833312206) | > loss_1: 30.280126571655273 (29.80138419224666) | > grad_norm_1: tensor(25978.7246, device='cuda:0') (tensor(22809.4688, device='cuda:0')) | > current_lr_0: 0.00010152194560986112 | > current_lr_1: 0.00010152194560986112 | > step_time: 0.835 (0.6240851756853935) | > loader_time: 0.0089 (0.024951910361265518)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.467679500579834 (2.467679500579834) | > loss_disc_real_0: 0.18967010080814362 (0.18967010080814362) | > loss_disc_real_1: 0.2828543186187744 (0.2828543186187744) | > loss_disc_real_2: 0.23213425278663635 (0.23213425278663635) | > loss_disc_real_3: 0.23191772401332855 (0.23191772401332855) | > loss_disc_real_4: 0.18725430965423584 (0.18725430965423584) | > loss_disc_real_5: 0.19698414206504822 (0.19698414206504822) | > loss_0: 2.467679500579834 (2.467679500579834) | > loss_gen: 2.2246174812316895 (2.2246174812316895) | > loss_kl: 3.6760904788970947 (3.6760904788970947) | > loss_feat: 8.181600570678711 (8.181600570678711) | > loss_mel: 24.166568756103516 (24.166568756103516) | > loss_duration: 2.8508589267730713 (2.8508589267730713) | > loss_1: 41.09973907470703 (41.09973907470703)  --> STEP: 1 | > loss_disc: 2.3307151794433594 (2.3307151794433594) | > loss_disc_real_0: 0.30110299587249756 (0.30110299587249756) | > loss_disc_real_1: 0.2569633722305298 (0.2569633722305298) | > loss_disc_real_2: 0.14020515978336334 (0.14020515978336334) | > loss_disc_real_3: 0.266216903924942 (0.266216903924942) | > loss_disc_real_4: 0.3062499165534973 (0.3062499165534973) | > loss_disc_real_5: 0.26987743377685547 (0.26987743377685547) | > loss_0: 2.3307151794433594 (2.3307151794433594) | > loss_gen: 3.0386762619018555 (3.0386762619018555) | > loss_kl: 4.572616100311279 (4.572616100311279) | > loss_feat: 7.4586591720581055 (7.4586591720581055) | > loss_mel: 24.386735916137695 (24.386735916137695) | > loss_duration: 3.1104753017425537 (3.1104753017425537) | > loss_1: 42.567161560058594 (42.567161560058594)  --> STEP: 2 | > loss_disc: 2.214275360107422 (2.2724952697753906) | > loss_disc_real_0: 0.24108244478702545 (0.2710927203297615) | > loss_disc_real_1: 0.15778478980064392 (0.20737408101558685) | > loss_disc_real_2: 0.17756740748882294 (0.15888628363609314) | > loss_disc_real_3: 0.33807462453842163 (0.3021457642316818) | > loss_disc_real_4: 0.2252596914768219 (0.2657548040151596) | > loss_disc_real_5: 0.22729040682315826 (0.24858392030000687) | > loss_0: 2.214275360107422 (2.2724952697753906) | > loss_gen: 2.56062912940979 (2.7996526956558228) | > loss_kl: 4.665492534637451 (4.619054317474365) | > loss_feat: 6.205781936645508 (6.832220554351807) | > loss_mel: 24.41869354248047 (24.402714729309082) | > loss_duration: 2.996055841445923 (3.0532655715942383) | > loss_1: 40.846656799316406 (41.7069091796875)  --> STEP: 3 | > loss_disc: 3.031703233718872 (2.5255645910898843) | > loss_disc_real_0: 0.4073675870895386 (0.3165176759163539) | > loss_disc_real_1: 0.2516295909881592 (0.22212591767311096) | > loss_disc_real_2: 0.2546426057815552 (0.19080505768458048) | > loss_disc_real_3: 0.27050474286079407 (0.29159875710805255) | > loss_disc_real_4: 0.24440313875675201 (0.25863758226235706) | > loss_disc_real_5: 0.23623155057430267 (0.24446646372477213) | > loss_0: 3.031703233718872 (2.5255645910898843) | > loss_gen: 1.6711336374282837 (2.423479676246643) | > loss_kl: 2.437593698501587 (3.8919007778167725) | > loss_feat: 0.09234239906072617 (4.585594502588113) | > loss_mel: 5.061037540435791 (17.95548899968465) | > loss_duration: 2.8041067123413086 (2.9702126185099282) | > loss_1: 12.066214561462402 (31.826677640279133) --> EVAL PERFORMANCE | > avg_loader_time: 0.012436628341674805 (+0.006864468256632487) | > avg_loss_disc: 2.5255645910898843 (-0.005551020304362275) | > avg_loss_disc_real_0: 0.3165176759163539 (+0.20703068748116493) | > avg_loss_disc_real_1: 0.22212591767311096 (+0.0033914297819137573) | > avg_loss_disc_real_2: 0.19080505768458048 (-0.024445260564486204) | > avg_loss_disc_real_3: 0.29159875710805255 (+0.01784851650396979) | > avg_loss_disc_real_4: 0.25863758226235706 (+0.045575420061747224) | > avg_loss_disc_real_5: 0.24446646372477213 (+0.11310484757026035) | > avg_loss_0: 2.5255645910898843 (-0.005551020304362275) | > avg_loss_gen: 2.423479676246643 (+0.30327093601226807) | > avg_loss_kl: 3.8919007778167725 (-0.00333126386006688) | > avg_loss_feat: 4.585594502588113 (-2.5615258142352104) | > avg_loss_mel: 17.95548899968465 (-5.627372582753502) | > avg_loss_duration: 2.9702126185099282 (-0.04509441057841013) | > avg_loss_1: 31.826677640279133 (-7.93405310312907)  > EPOCH: 679/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:37:15)   --> TIME: 2023-10-20 07:37:31 -- STEP: 19/50 -- GLOBAL_STEP: 86970 | > loss_disc: 2.264854907989502 (2.2098904785357023) | > loss_disc_real_0: 0.08132033050060272 (0.11860687383695652) | > loss_disc_real_1: 0.11916963011026382 (0.19743389675491735) | > loss_disc_real_2: 0.3778664171695709 (0.1920338837723983) | > loss_disc_real_3: 0.19040368497371674 (0.24509595510990997) | > loss_disc_real_4: 0.11987828463315964 (0.18235316225572637) | > loss_disc_real_5: 0.1285945475101471 (0.2080989093764832) | > loss_0: 2.264854907989502 (2.2098904785357023) | > grad_norm_0: tensor(466.3398, device='cuda:0') (tensor(498.0287, device='cuda:0')) | > loss_gen: 2.770021915435791 (2.559428102091739) | > loss_kl: 0.9610610008239746 (0.8371652647068626) | > loss_feat: 10.579985618591309 (6.7142652084952905) | > loss_mel: 32.710060119628906 (24.032378146522923) | > loss_duration: 1.555118203163147 (1.4703132102363987) | > loss_1: 48.57624816894531 (35.61355018615723) | > grad_norm_1: tensor(40015.8398, device='cuda:0') (tensor(20892.0684, device='cuda:0')) | > current_lr_0: 0.00010142046806900021 | > current_lr_1: 0.00010142046806900021 | > step_time: 0.3773 (0.5733506679534912) | > loader_time: 0.0054 (0.018288888429340563)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9945664405822754 (2.9945664405822754) | > loss_disc_real_0: 0.3186104893684387 (0.3186104893684387) | > loss_disc_real_1: 0.2940792739391327 (0.2940792739391327) | > loss_disc_real_2: 0.26402151584625244 (0.26402151584625244) | > loss_disc_real_3: 0.2765498757362366 (0.2765498757362366) | > loss_disc_real_4: 0.2572510838508606 (0.2572510838508606) | > loss_disc_real_5: 0.25334280729293823 (0.25334280729293823) | > loss_0: 2.9945664405822754 (2.9945664405822754) | > loss_gen: 1.6928369998931885 (1.6928369998931885) | > loss_kl: 3.882392644882202 (3.882392644882202) | > loss_feat: 0.12136644870042801 (0.12136644870042801) | > loss_mel: 2.093449354171753 (2.093449354171753) | > loss_duration: 2.73958158493042 (2.73958158493042) | > loss_1: 10.529626846313477 (10.529626846313477)  --> STEP: 1 | > loss_disc: 1.9319255352020264 (1.9319255352020264) | > loss_disc_real_0: 0.04468096047639847 (0.04468096047639847) | > loss_disc_real_1: 0.10663143545389175 (0.10663143545389175) | > loss_disc_real_2: 0.1413431465625763 (0.1413431465625763) | > loss_disc_real_3: 0.05788397416472435 (0.05788397416472435) | > loss_disc_real_4: 0.12975001335144043 (0.12975001335144043) | > loss_disc_real_5: 0.05687594413757324 (0.05687594413757324) | > loss_0: 1.9319255352020264 (1.9319255352020264) | > loss_gen: 2.1173391342163086 (2.1173391342163086) | > loss_kl: 4.198986530303955 (4.198986530303955) | > loss_feat: 11.756416320800781 (11.756416320800781) | > loss_mel: 25.67156410217285 (25.67156410217285) | > loss_duration: 2.912607192993164 (2.912607192993164) | > loss_1: 46.65691375732422 (46.65691375732422)  --> STEP: 2 | > loss_disc: 1.945565938949585 (1.9387457370758057) | > loss_disc_real_0: 0.13352452218532562 (0.08910274133086205) | > loss_disc_real_1: 0.1944642961025238 (0.15054786577820778) | > loss_disc_real_2: 0.21373780071735382 (0.17754047363996506) | > loss_disc_real_3: 0.18472819030284882 (0.12130608223378658) | > loss_disc_real_4: 0.14252164959907532 (0.13613583147525787) | > loss_disc_real_5: 0.10623188316822052 (0.08155391365289688) | > loss_0: 1.945565938949585 (1.9387457370758057) | > loss_gen: 2.295311450958252 (2.2063252925872803) | > loss_kl: 5.262654781341553 (4.730820655822754) | > loss_feat: 7.056501388549805 (9.406458854675293) | > loss_mel: 26.754283905029297 (26.212924003601074) | > loss_duration: 3.0108256340026855 (2.961716413497925) | > loss_1: 44.37957763671875 (45.518245697021484)  --> STEP: 3 | > loss_disc: 1.9601149559020996 (1.9458688100179036) | > loss_disc_real_0: 0.05860354006290436 (0.07893634090820949) | > loss_disc_real_1: 0.2812917232513428 (0.19412915160258612) | > loss_disc_real_2: 0.12243477255105972 (0.15917190661032996) | > loss_disc_real_3: 0.1938731074333191 (0.14549509063363075) | > loss_disc_real_4: 0.2063484936952591 (0.15954005221525827) | > loss_disc_real_5: 0.17245285212993622 (0.11185355981190999) | > loss_0: 1.9601149559020996 (1.9458688100179036) | > loss_gen: 2.5666284561157227 (2.326426347096761) | > loss_kl: 2.400322198867798 (3.9539878368377686) | > loss_feat: 6.019254684448242 (8.277390797932943) | > loss_mel: 24.527864456176758 (25.65123748779297) | > loss_duration: 2.7349348068237305 (2.886122544606527) | > loss_1: 38.24900436401367 (43.09516525268555)  --> TIME: 2023-10-20 07:37:59 -- STEP: 49/50 -- GLOBAL_STEP: 87000 | > loss_disc: 2.7633605003356934 (2.3969838071842577) | > loss_disc_real_0: 0.24619749188423157 (0.1436591351366773) | > loss_disc_real_1: 0.30473974347114563 (0.21966199956986368) | > loss_disc_real_2: 0.2754865288734436 (0.21962047161116283) | > loss_disc_real_3: 0.2923336625099182 (0.23579985842260778) | > loss_disc_real_4: 0.2687397599220276 (0.2121284019240007) | > loss_disc_real_5: 0.256629079580307 (0.23931790962435154) | > loss_0: 2.7633605003356934 (2.3969838071842577) | > grad_norm_0: tensor(927.0181, device='cuda:0') (tensor(535.8290, device='cuda:0')) | > loss_gen: 2.0207977294921875 (2.3744544009773105) | > loss_kl: 0.7543053030967712 (0.824390631245107) | > loss_feat: 1.15512216091156 (5.654897637209115) | > loss_mel: 18.488235473632812 (22.557161915058998) | > loss_duration: 1.5269988775253296 (1.4297345974007432) | > loss_1: 23.945459365844727 (32.840639542560176) | > grad_norm_1: tensor(5393.7456, device='cuda:0') (tensor(16788.4648, device='cuda:0')) | > current_lr_0: 0.00010142046806900021 | > current_lr_1: 0.00010142046806900021 | > step_time: 3.2029 (0.5910050041821537) | > loader_time: 9.0512 (0.20081385787652464) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_87000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.428062915802002 (2.0664173364639282) | > loss_disc_real_0: 0.2621041536331177 (0.12472829408943653) | > loss_disc_real_1: 0.26709333062171936 (0.21237019635736942) | > loss_disc_real_2: 0.24581536650657654 (0.1808327715843916) | > loss_disc_real_3: 0.25023922324180603 (0.17168112378567457) | > loss_disc_real_4: 0.36781564354896545 (0.21160895004868507) | > loss_disc_real_5: 0.3525872826576233 (0.17203699052333832) | > loss_0: 2.428062915802002 (2.0664173364639282) | > loss_gen: 2.8898098468780518 (2.4672722220420837) | > loss_kl: 3.526662826538086 (3.847156584262848) | > loss_feat: 5.041900634765625 (7.468518257141113) | > loss_mel: 21.548919677734375 (24.62565803527832) | > loss_duration: 2.762357473373413 (2.8551812767982483) | > loss_1: 35.769649505615234 (41.26378631591797)  --> STEP: 1 | > loss_disc: 2.7836809158325195 (2.2098700523376467) | > loss_disc_real_0: 0.17807413637638092 (0.13539746254682541) | > loss_disc_real_1: 0.25425320863723755 (0.22074679881334305) | > loss_disc_real_2: 0.27618032693862915 (0.1999022826552391) | > loss_disc_real_3: 0.3247404098510742 (0.2022929809987545) | > loss_disc_real_4: 0.27433064579963684 (0.22415328919887542) | > loss_disc_real_5: 0.2725070118904114 (0.19213099479675294) | > loss_0: 2.7836809158325195 (2.2098700523376467) | > loss_gen: 2.0266809463500977 (2.3791539669036865) | > loss_kl: 4.120371341705322 (3.901799535751343) | > loss_feat: 1.4999922513961792 (6.2748130559921265) | > loss_mel: 18.895357131958008 (23.47959785461426) | > loss_duration: 3.00292706489563 (2.8847304344177247) | > loss_1: 29.54532814025879 (38.920094680786136)  --> STEP: 2 | > loss_disc: 1.4989594221115112 (2.0913849472999573) | > loss_disc_real_0: 0.07178549468517303 (0.12479546790321668) | > loss_disc_real_1: 0.07497359812259674 (0.19645126536488533) | > loss_disc_real_2: 0.07746140658855438 (0.17949546997745833) | > loss_disc_real_3: 0.12487076967954636 (0.1893892791122198) | > loss_disc_real_4: 0.10929929465055466 (0.2050109567741553) | > loss_disc_real_5: 0.12382615357637405 (0.18074685459335646) | > loss_0: 1.4989594221115112 (2.0913849472999573) | > loss_gen: 2.4689416885375977 (2.394118587176005) | > loss_kl: 4.820357322692871 (4.054892500241597) | > loss_feat: 9.71788215637207 (6.84865790605545) | > loss_mel: 23.264135360717773 (23.443687438964844) | > loss_duration: 2.9645724296569824 (2.8980374336242676) | > loss_1: 43.23588943481445 (39.63939380645752)  --> STEP: 3 | > loss_disc: 2.6873185634613037 (2.1765183210372925) | > loss_disc_real_0: 0.18465378880500793 (0.13334665660347259) | > loss_disc_real_1: 0.3721645474433899 (0.2215531628046717) | > loss_disc_real_2: 0.306871622800827 (0.19769206323793956) | > loss_disc_real_3: 0.40964755415916443 (0.22085474697606905) | > loss_disc_real_4: 0.38632240891456604 (0.23091259279421397) | > loss_disc_real_5: 0.22910308837890625 (0.18765488799129212) | > loss_0: 2.6873185634613037 (2.1765183210372925) | > loss_gen: 2.9235711097717285 (2.469754661832537) | > loss_kl: 1.9590927362442017 (3.755492533956255) | > loss_feat: 4.493056774139404 (6.512143458638873) | > loss_mel: 22.82367515563965 (23.355114255632675) | > loss_duration: 2.7853140830993652 (2.881934097834996) | > loss_1: 34.984710693359375 (38.974439076014924) --> EVAL PERFORMANCE | > avg_loader_time: 0.42644003459385466 (+0.41400340625217985) | > avg_loss_disc: 2.1765183210372925 (-0.3490462700525918) | > avg_loss_disc_real_0: 0.13334665660347259 (-0.1831710193128813) | > avg_loss_disc_real_1: 0.2215531628046717 (-0.0005727548684392736) | > avg_loss_disc_real_2: 0.19769206323793956 (+0.006887005553359082) | > avg_loss_disc_real_3: 0.22085474697606905 (-0.0707440101319835) | > avg_loss_disc_real_4: 0.23091259279421397 (-0.027724989468143085) | > avg_loss_disc_real_5: 0.18765488799129212 (-0.05681157573348) | > avg_loss_0: 2.1765183210372925 (-0.3490462700525918) | > avg_loss_gen: 2.469754661832537 (+0.04627498558589371) | > avg_loss_kl: 3.755492533956255 (-0.13640824386051742) | > avg_loss_feat: 6.512143458638873 (+1.9265489560507598) | > avg_loss_mel: 23.355114255632675 (+5.399625255948024) | > avg_loss_duration: 2.881934097834996 (-0.08827852067493236) | > avg_loss_1: 38.974439076014924 (+7.1477614357357915)  > EPOCH: 680/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:38:12)   --> TIME: 2023-10-20 07:38:36 -- STEP: 29/50 -- GLOBAL_STEP: 87030 | > loss_disc: 2.8821468353271484 (2.2636526411977314) | > loss_disc_real_0: 0.1500699669122696 (0.15212109627137924) | > loss_disc_real_1: 0.29301923513412476 (0.2031555574001937) | > loss_disc_real_2: 0.25859495997428894 (0.19468318799446369) | > loss_disc_real_3: 0.24481956660747528 (0.21712007148769394) | > loss_disc_real_4: 0.27054736018180847 (0.20554552612633542) | > loss_disc_real_5: 0.2722229063510895 (0.2012194856230555) | > loss_0: 2.8821468353271484 (2.2636526411977314) | > grad_norm_0: tensor(337.4939, device='cuda:0') (tensor(681.0460, device='cuda:0')) | > loss_gen: 1.7238810062408447 (2.5823256640598693) | > loss_kl: 0.9398874640464783 (0.8218451676697567) | > loss_feat: 0.4680604934692383 (6.946082534461186) | > loss_mel: 15.29634952545166 (24.16370566137906) | > loss_duration: 1.4181509017944336 (1.4427467255756772) | > loss_1: 19.846328735351562 (35.95670568531957) | > grad_norm_1: tensor(3832.0251, device='cuda:0') (tensor(24600.4629, device='cuda:0')) | > current_lr_0: 0.00010131909196129482 | > current_lr_1: 0.00010131909196129482 | > step_time: 0.4837 (0.6124208384546739) | > loader_time: 0.0281 (0.02442762769501785)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3172390460968018 (2.3172390460968018) | > loss_disc_real_0: 0.401614785194397 (0.401614785194397) | > loss_disc_real_1: 0.2868273854255676 (0.2868273854255676) | > loss_disc_real_2: 0.39225083589553833 (0.39225083589553833) | > loss_disc_real_3: 0.2990072965621948 (0.2990072965621948) | > loss_disc_real_4: 0.2851382791996002 (0.2851382791996002) | > loss_disc_real_5: 0.19249293208122253 (0.19249293208122253) | > loss_0: 2.3172390460968018 (2.3172390460968018) | > loss_gen: 3.7740490436553955 (3.7740490436553955) | > loss_kl: 4.257900714874268 (4.257900714874268) | > loss_feat: 6.401628494262695 (6.401628494262695) | > loss_mel: 24.145877838134766 (24.145877838134766) | > loss_duration: 2.788365602493286 (2.788365602493286) | > loss_1: 41.36781692504883 (41.36781692504883)  --> STEP: 1 | > loss_disc: 2.672518253326416 (2.672518253326416) | > loss_disc_real_0: 0.2800499200820923 (0.2800499200820923) | > loss_disc_real_1: 0.1954052895307541 (0.1954052895307541) | > loss_disc_real_2: 0.3376188576221466 (0.3376188576221466) | > loss_disc_real_3: 0.30521392822265625 (0.30521392822265625) | > loss_disc_real_4: 0.4258595108985901 (0.4258595108985901) | > loss_disc_real_5: 0.49237725138664246 (0.49237725138664246) | > loss_0: 2.672518253326416 (2.672518253326416) | > loss_gen: 3.2097296714782715 (3.2097296714782715) | > loss_kl: 4.381770610809326 (4.381770610809326) | > loss_feat: 5.51494836807251 (5.51494836807251) | > loss_mel: 26.918121337890625 (26.918121337890625) | > loss_duration: 3.15859317779541 (3.15859317779541) | > loss_1: 43.183162689208984 (43.183162689208984)  --> STEP: 2 | > loss_disc: 3.1663856506347656 (2.919451951980591) | > loss_disc_real_0: 0.5428076982498169 (0.4114288091659546) | > loss_disc_real_1: 0.25591379404067993 (0.225659541785717) | > loss_disc_real_2: 0.34607967734336853 (0.34184926748275757) | > loss_disc_real_3: 0.37681955099105835 (0.3410167396068573) | > loss_disc_real_4: 0.27857986092567444 (0.35221968591213226) | > loss_disc_real_5: 0.26539507508277893 (0.3788861632347107) | > loss_0: 3.1663856506347656 (2.919451951980591) | > loss_gen: 2.048523426055908 (2.62912654876709) | > loss_kl: 5.106725215911865 (4.744247913360596) | > loss_feat: 0.047779954969882965 (2.7813641615211964) | > loss_mel: 3.5325963497161865 (15.225358843803406) | > loss_duration: 3.007452964782715 (3.0830230712890625) | > loss_1: 13.743077278137207 (28.463119983673096)  --> STEP: 3 | > loss_disc: 3.170581340789795 (3.0031617482503257) | > loss_disc_real_0: 0.5456529855728149 (0.4561702013015747) | > loss_disc_real_1: 0.2558392584323883 (0.23571944733460745) | > loss_disc_real_2: 0.34634026885032654 (0.3433462679386139) | > loss_disc_real_3: 0.3765708804130554 (0.35286811987559) | > loss_disc_real_4: 0.27842575311660767 (0.3276217083136241) | > loss_disc_real_5: 0.2654781937599182 (0.3410835067431132) | > loss_0: 3.170581340789795 (3.0031617482503257) | > loss_gen: 2.0449001789093018 (2.4343844254811606) | > loss_kl: 2.1416661739349365 (3.876720666885376) | > loss_feat: 0.04827742651104927 (1.8703352498511474) | > loss_mel: 2.3952219486236572 (10.948646545410156) | > loss_duration: 2.8840456008911133 (3.0166972478230796) | > loss_1: 9.514111518859863 (22.14678382873535) --> EVAL PERFORMANCE | > avg_loader_time: 0.00734559694925944 (-0.4190944376445952) | > avg_loss_disc: 3.0031617482503257 (+0.8266434272130332) | > avg_loss_disc_real_0: 0.4561702013015747 (+0.32282354469810215) | > avg_loss_disc_real_1: 0.23571944733460745 (+0.014166284529935763) | > avg_loss_disc_real_2: 0.3433462679386139 (+0.14565420470067433) | > avg_loss_disc_real_3: 0.35286811987559 (+0.13201337289952098) | > avg_loss_disc_real_4: 0.3276217083136241 (+0.09670911551941011) | > avg_loss_disc_real_5: 0.3410835067431132 (+0.1534286187518211) | > avg_loss_0: 3.0031617482503257 (+0.8266434272130332) | > avg_loss_gen: 2.4343844254811606 (-0.03537023635137615) | > avg_loss_kl: 3.876720666885376 (+0.12122813292912094) | > avg_loss_feat: 1.8703352498511474 (-4.641808208787725) | > avg_loss_mel: 10.948646545410156 (-12.406467710222518) | > avg_loss_duration: 3.0166972478230796 (+0.1347631499880837) | > avg_loss_1: 22.14678382873535 (-16.827655247279573)  > EPOCH: 681/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:39:06)   --> TIME: 2023-10-20 07:39:16 -- STEP: 9/50 -- GLOBAL_STEP: 87060 | > loss_disc: 2.0488505363464355 (2.5273176630338035) | > loss_disc_real_0: 0.053525373339653015 (0.1431462106605371) | > loss_disc_real_1: 0.28080636262893677 (0.22160223250587782) | > loss_disc_real_2: 0.2894143760204315 (0.26899956953194404) | > loss_disc_real_3: 0.1647624522447586 (0.24229515944090155) | > loss_disc_real_4: 0.21188853681087494 (0.23912316353784668) | > loss_disc_real_5: 0.19151800870895386 (0.2354515404957864) | > loss_0: 2.0488505363464355 (2.5273176630338035) | > grad_norm_0: tensor(308.0522, device='cuda:0') (tensor(532.7057, device='cuda:0')) | > loss_gen: 2.608975648880005 (2.2431764205296836) | > loss_kl: 0.5663857460021973 (0.799780872133043) | > loss_feat: 5.583448886871338 (6.0131496004760265) | > loss_mel: 22.72486114501953 (21.0279680358039) | > loss_duration: 1.390881061553955 (1.4531017806794908) | > loss_1: 32.87455368041992 (31.537177509731716) | > grad_norm_1: tensor(4060.7537, device='cuda:0') (tensor(8975.6650, device='cuda:0')) | > current_lr_0: 0.00010121781718535617 | > current_lr_1: 0.00010121781718535617 | > step_time: 0.356 (0.6076984140608046) | > loader_time: 0.0052 (0.014317380057440864)  --> TIME: 2023-10-20 07:39:35 -- STEP: 39/50 -- GLOBAL_STEP: 87090 | > loss_disc: 1.667279839515686 (2.5173627275687) | > loss_disc_real_0: 0.14903083443641663 (0.15341456138934845) | > loss_disc_real_1: 0.17294460535049438 (0.22605976204459483) | > loss_disc_real_2: 0.09202086180448532 (0.24669608063040627) | > loss_disc_real_3: 0.2586071789264679 (0.25050881318748) | > loss_disc_real_4: 0.1263342946767807 (0.24251008931642923) | > loss_disc_real_5: 0.058459460735321045 (0.25381025886879516) | > loss_0: 1.667279839515686 (2.5173627275687) | > grad_norm_0: tensor(911.1486, device='cuda:0') (tensor(680.8129, device='cuda:0')) | > loss_gen: 2.8761324882507324 (2.371260548249269) | > loss_kl: 0.18807098269462585 (0.7934090365201999) | > loss_feat: 8.049639701843262 (5.4851694373557205) | > loss_mel: 20.50666046142578 (20.784533769656452) | > loss_duration: 1.4909260272979736 (1.4462542992371779) | > loss_1: 33.11143112182617 (30.880627571008144) | > grad_norm_1: tensor(40141.5547, device='cuda:0') (tensor(20811.2129, device='cuda:0')) | > current_lr_0: 0.00010121781718535617 | > current_lr_1: 0.00010121781718535617 | > step_time: 0.6191 (0.6040862340193528) | > loader_time: 0.006 (0.020286181034185946)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.943727493286133 (2.943727493286133) | > loss_disc_real_0: 0.1562979519367218 (0.1562979519367218) | > loss_disc_real_1: 0.23865020275115967 (0.23865020275115967) | > loss_disc_real_2: 0.29984304308891296 (0.29984304308891296) | > loss_disc_real_3: 0.28309276700019836 (0.28309276700019836) | > loss_disc_real_4: 0.10465364158153534 (0.10465364158153534) | > loss_disc_real_5: 0.23816440999507904 (0.23816440999507904) | > loss_0: 2.943727493286133 (2.943727493286133) | > loss_gen: 1.8353861570358276 (1.8353861570358276) | > loss_kl: 4.9130353927612305 (4.9130353927612305) | > loss_feat: 5.7646942138671875 (5.7646942138671875) | > loss_mel: 24.468975067138672 (24.468975067138672) | > loss_duration: 2.681535243988037 (2.681535243988037) | > loss_1: 39.66362380981445 (39.66362380981445)  --> STEP: 1 | > loss_disc: 2.9589622020721436 (2.9589622020721436) | > loss_disc_real_0: 0.2787349224090576 (0.2787349224090576) | > loss_disc_real_1: 0.2742481827735901 (0.2742481827735901) | > loss_disc_real_2: 0.2659245729446411 (0.2659245729446411) | > loss_disc_real_3: 0.28085216879844666 (0.28085216879844666) | > loss_disc_real_4: 0.2772842049598694 (0.2772842049598694) | > loss_disc_real_5: 0.2577894926071167 (0.2577894926071167) | > loss_0: 2.9589622020721436 (2.9589622020721436) | > loss_gen: 1.6946228742599487 (1.6946228742599487) | > loss_kl: 4.1283488273620605 (4.1283488273620605) | > loss_feat: 0.1319536417722702 (0.1319536417722702) | > loss_mel: 12.463454246520996 (12.463454246520996) | > loss_duration: 3.0200908184051514 (3.0200908184051514) | > loss_1: 21.43846893310547 (21.43846893310547)  --> STEP: 2 | > loss_disc: 3.0538923740386963 (3.00642728805542) | > loss_disc_real_0: 0.15704581141471863 (0.21789036691188812) | > loss_disc_real_1: 0.2556230127811432 (0.26493559777736664) | > loss_disc_real_2: 0.23479428887367249 (0.2503594309091568) | > loss_disc_real_3: 0.219255730509758 (0.2500539496541023) | > loss_disc_real_4: 0.2684256136417389 (0.27285490930080414) | > loss_disc_real_5: 0.3971312940120697 (0.3274603933095932) | > loss_0: 3.0538923740386963 (3.00642728805542) | > loss_gen: 1.826181173324585 (1.7604020237922668) | > loss_kl: 4.7964768409729 (4.4624128341674805) | > loss_feat: 4.481109142303467 (2.3065313920378685) | > loss_mel: 27.01856803894043 (19.741011142730713) | > loss_duration: 2.973038673400879 (2.996564745903015) | > loss_1: 41.09537124633789 (31.26692008972168)  --> STEP: 3 | > loss_disc: 2.488521099090576 (2.833791891733805) | > loss_disc_real_0: 0.2943654954433441 (0.24338207642237344) | > loss_disc_real_1: 0.15845385193824768 (0.2294416824976603) | > loss_disc_real_2: 0.2236657291650772 (0.24146153032779694) | > loss_disc_real_3: 0.2500607967376709 (0.25005623201529187) | > loss_disc_real_4: 0.3110613524913788 (0.28559039036432904) | > loss_disc_real_5: 0.33728456497192383 (0.33073511719703674) | > loss_0: 2.488521099090576 (2.833791891733805) | > loss_gen: 2.7590956687927246 (2.093299905459086) | > loss_kl: 2.4498777389526367 (3.791567802429199) | > loss_feat: 5.882095813751221 (3.4983861992756524) | > loss_mel: 21.39655303955078 (20.292858441670734) | > loss_duration: 2.8286473751068115 (2.9405922889709473) | > loss_1: 35.31626892089844 (32.616703033447266) --> EVAL PERFORMANCE | > avg_loader_time: 0.011356035868326822 (+0.004010438919067382) | > avg_loss_disc: 2.833791891733805 (-0.16936985651652048) | > avg_loss_disc_real_0: 0.24338207642237344 (-0.21278812487920126) | > avg_loss_disc_real_1: 0.2294416824976603 (-0.006277764836947142) | > avg_loss_disc_real_2: 0.24146153032779694 (-0.10188473761081696) | > avg_loss_disc_real_3: 0.25005623201529187 (-0.10281188786029816) | > avg_loss_disc_real_4: 0.28559039036432904 (-0.042031317949295044) | > avg_loss_disc_real_5: 0.33073511719703674 (-0.010348389546076475) | > avg_loss_0: 2.833791891733805 (-0.16936985651652048) | > avg_loss_gen: 2.093299905459086 (-0.3410845200220747) | > avg_loss_kl: 3.791567802429199 (-0.08515286445617676) | > avg_loss_feat: 3.4983861992756524 (+1.628050949424505) | > avg_loss_mel: 20.292858441670734 (+9.344211896260578) | > avg_loss_duration: 2.9405922889709473 (-0.07610495885213231) | > avg_loss_1: 32.616703033447266 (+10.469919204711914)  > EPOCH: 682/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:39:56)   --> TIME: 2023-10-20 07:40:12 -- STEP: 19/50 -- GLOBAL_STEP: 87120 | > loss_disc: 3.375192403793335 (2.369813555165341) | > loss_disc_real_0: 0.2516997754573822 (0.16051875486185677) | > loss_disc_real_1: 0.2431410700082779 (0.2178025943668265) | > loss_disc_real_2: 0.32165446877479553 (0.2141583546211845) | > loss_disc_real_3: 0.31888464093208313 (0.23037696316053993) | > loss_disc_real_4: 0.3325594961643219 (0.2057050621431125) | > loss_disc_real_5: 0.41738229990005493 (0.19876448216995127) | > loss_0: 3.375192403793335 (2.369813555165341) | > grad_norm_0: tensor(603.1810, device='cuda:0') (tensor(566.7982, device='cuda:0')) | > loss_gen: 1.8908684253692627 (2.360311514452884) | > loss_kl: 0.9646326303482056 (0.7463645448810176) | > loss_feat: 4.34351921081543 (5.526865303124252) | > loss_mel: 22.3266544342041 (19.452740863749856) | > loss_duration: 1.5559595823287964 (1.4676489579050165) | > loss_1: 31.081634521484375 (29.553931336653854) | > grad_norm_1: tensor(7674.4004, device='cuda:0') (tensor(30321.8086, device='cuda:0')) | > current_lr_0: 0.00010111664363989683 | > current_lr_1: 0.00010111664363989683 | > step_time: 0.5119 (0.5497211155138517) | > loader_time: 0.0054 (0.016767577121132297)  --> TIME: 2023-10-20 07:40:33 -- STEP: 49/50 -- GLOBAL_STEP: 87150 | > loss_disc: 2.5001282691955566 (2.3752216465619145) | > loss_disc_real_0: 0.14351175725460052 (0.13989379492645357) | > loss_disc_real_1: 0.28394708037376404 (0.2183896341190046) | > loss_disc_real_2: 0.31947824358940125 (0.21539526067826212) | > loss_disc_real_3: 0.23751294612884521 (0.22638448669898267) | > loss_disc_real_4: 0.37809067964553833 (0.2129720306137995) | > loss_disc_real_5: 0.3271436393260956 (0.22012274155431255) | > loss_0: 2.5001282691955566 (2.3752216465619145) | > grad_norm_0: tensor(572.5662, device='cuda:0') (tensor(570.8548, device='cuda:0')) | > loss_gen: 3.0427939891815186 (2.3580352140932668) | > loss_kl: 0.4339669644832611 (0.825999061672055) | > loss_feat: 5.55976676940918 (5.743915020051051) | > loss_mel: 22.710840225219727 (21.204667458728863) | > loss_duration: 1.551438808441162 (1.4321924375028026) | > loss_1: 33.298805236816406 (31.56480919584936) | > grad_norm_1: tensor(17311.2344, device='cuda:0') (tensor(23295.1523, device='cuda:0')) | > current_lr_0: 0.00010111664363989683 | > current_lr_1: 0.00010111664363989683 | > step_time: 0.3065 (0.5966560256724454) | > loader_time: 1.0978 (0.040316917458359074)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.984708786010742 (2.984708786010742) | > loss_disc_real_0: 0.20704808831214905 (0.20704808831214905) | > loss_disc_real_1: 0.2221340537071228 (0.2221340537071228) | > loss_disc_real_2: 0.4895901679992676 (0.4895901679992676) | > loss_disc_real_3: 0.48505473136901855 (0.48505473136901855) | > loss_disc_real_4: 0.42544907331466675 (0.42544907331466675) | > loss_disc_real_5: 0.5585724115371704 (0.5585724115371704) | > loss_0: 2.984708786010742 (2.984708786010742) | > loss_gen: 3.9675827026367188 (3.9675827026367188) | > loss_kl: 4.062802791595459 (4.062802791595459) | > loss_feat: 8.193520545959473 (8.193520545959473) | > loss_mel: 24.917757034301758 (24.917757034301758) | > loss_duration: 2.792182207107544 (2.792182207107544) | > loss_1: 43.93384552001953 (43.93384552001953)  --> STEP: 1 | > loss_disc: 3.2288811206817627 (3.2288811206817627) | > loss_disc_real_0: 0.20477166771888733 (0.20477166771888733) | > loss_disc_real_1: 0.400449275970459 (0.400449275970459) | > loss_disc_real_2: 0.5496438145637512 (0.5496438145637512) | > loss_disc_real_3: 0.5595628619194031 (0.5595628619194031) | > loss_disc_real_4: 0.49709823727607727 (0.49709823727607727) | > loss_disc_real_5: 0.4604259431362152 (0.4604259431362152) | > loss_0: 3.2288811206817627 (3.2288811206817627) | > loss_gen: 4.492401123046875 (4.492401123046875) | > loss_kl: 4.402298927307129 (4.402298927307129) | > loss_feat: 7.282342433929443 (7.282342433929443) | > loss_mel: 21.502744674682617 (21.502744674682617) | > loss_duration: 3.151782512664795 (3.151782512664795) | > loss_1: 40.83156967163086 (40.83156967163086)  --> STEP: 2 | > loss_disc: 2.839463472366333 (3.034172296524048) | > loss_disc_real_0: 0.29854723811149597 (0.25165945291519165) | > loss_disc_real_1: 0.328664094209671 (0.364556685090065) | > loss_disc_real_2: 0.3274058401584625 (0.4385248273611069) | > loss_disc_real_3: 0.3342796862125397 (0.4469212740659714) | > loss_disc_real_4: 0.3343465328216553 (0.41572238504886627) | > loss_disc_real_5: 0.5208159685134888 (0.490620955824852) | > loss_0: 2.839463472366333 (3.034172296524048) | > loss_gen: 3.0575497150421143 (3.7749754190444946) | > loss_kl: 4.713828086853027 (4.558063507080078) | > loss_feat: 5.269134521484375 (6.275738477706909) | > loss_mel: 25.689626693725586 (23.5961856842041) | > loss_duration: 3.061427116394043 (3.106604814529419) | > loss_1: 41.79156494140625 (41.311567306518555)  --> STEP: 3 | > loss_disc: 3.229130744934082 (3.099158445994059) | > loss_disc_real_0: 0.10190299153327942 (0.20174063245455423) | > loss_disc_real_1: 0.2680458426475525 (0.33238640427589417) | > loss_disc_real_2: 0.31269827485084534 (0.3965826431910197) | > loss_disc_real_3: 0.4009843170642853 (0.43160895506540936) | > loss_disc_real_4: 0.5844603180885315 (0.4719683627287547) | > loss_disc_real_5: 0.44985148310661316 (0.477031131585439) | > loss_0: 3.229130744934082 (3.099158445994059) | > loss_gen: 2.395963668823242 (3.3153048356374106) | > loss_kl: 2.1570587158203125 (3.7577285766601562) | > loss_feat: 6.662717819213867 (6.4047315915425616) | > loss_mel: 24.05038833618164 (23.747586568196613) | > loss_duration: 2.844327449798584 (3.019179026285807) | > loss_1: 38.11045455932617 (40.244529724121094) --> EVAL PERFORMANCE | > avg_loader_time: 0.016448577245076496 (+0.005092541376749674) | > avg_loss_disc: 3.099158445994059 (+0.2653665542602539) | > avg_loss_disc_real_0: 0.20174063245455423 (-0.041641443967819214) | > avg_loss_disc_real_1: 0.33238640427589417 (+0.10294472177823386) | > avg_loss_disc_real_2: 0.3965826431910197 (+0.15512111286322278) | > avg_loss_disc_real_3: 0.43160895506540936 (+0.1815527230501175) | > avg_loss_disc_real_4: 0.4719683627287547 (+0.18637797236442566) | > avg_loss_disc_real_5: 0.477031131585439 (+0.14629601438840228) | > avg_loss_0: 3.099158445994059 (+0.2653665542602539) | > avg_loss_gen: 3.3153048356374106 (+1.2220049301783247) | > avg_loss_kl: 3.7577285766601562 (-0.03383922576904297) | > avg_loss_feat: 6.4047315915425616 (+2.906345392266909) | > avg_loss_mel: 23.747586568196613 (+3.454728126525879) | > avg_loss_duration: 3.019179026285807 (+0.07858673731485988) | > avg_loss_1: 40.244529724121094 (+7.627826690673828)  > EPOCH: 683/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:40:44)   --> TIME: 2023-10-20 07:41:08 -- STEP: 29/50 -- GLOBAL_STEP: 87180 | > loss_disc: 2.9709863662719727 (2.5231418732939095) | > loss_disc_real_0: 0.208786278963089 (0.14472865167170249) | > loss_disc_real_1: 0.26880213618278503 (0.23309023562690306) | > loss_disc_real_2: 0.28298085927963257 (0.23912313708971286) | > loss_disc_real_3: 0.2606346309185028 (0.2468812848473418) | > loss_disc_real_4: 0.26703810691833496 (0.22620457346583234) | > loss_disc_real_5: 0.25118619203567505 (0.2337478705649746) | > loss_0: 2.9709863662719727 (2.5231418732939095) | > grad_norm_0: tensor(692.4603, device='cuda:0') (tensor(579.6474, device='cuda:0')) | > loss_gen: 1.588213562965393 (2.2715408267646002) | > loss_kl: 0.9505532383918762 (0.8541643691473993) | > loss_feat: 0.16308240592479706 (5.536084233173009) | > loss_mel: 10.481972694396973 (21.419117968657922) | > loss_duration: 1.4200572967529297 (1.4578681444299633) | > loss_1: 14.603879928588867 (31.53877555912939) | > grad_norm_1: tensor(6753.2886, device='cuda:0') (tensor(24126.7949, device='cuda:0')) | > current_lr_0: 0.00010101557122373058 | > current_lr_1: 0.00010101557122373058 | > step_time: 0.5158 (0.6019913821384825) | > loader_time: 0.0072 (0.026458320946528995)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7994303703308105 (2.7994303703308105) | > loss_disc_real_0: 0.18240651488304138 (0.18240651488304138) | > loss_disc_real_1: 0.2825494110584259 (0.2825494110584259) | > loss_disc_real_2: 0.27974212169647217 (0.27974212169647217) | > loss_disc_real_3: 0.26217347383499146 (0.26217347383499146) | > loss_disc_real_4: 0.2790440320968628 (0.2790440320968628) | > loss_disc_real_5: 0.29027873277664185 (0.29027873277664185) | > loss_0: 2.7994303703308105 (2.7994303703308105) | > loss_gen: 1.8522642850875854 (1.8522642850875854) | > loss_kl: 4.076529026031494 (4.076529026031494) | > loss_feat: 0.861152172088623 (0.861152172088623) | > loss_mel: 15.336713790893555 (15.336713790893555) | > loss_duration: 2.749833822250366 (2.749833822250366) | > loss_1: 24.876493453979492 (24.876493453979492)  --> STEP: 1 | > loss_disc: 2.9505057334899902 (2.9505057334899902) | > loss_disc_real_0: 0.3483450412750244 (0.3483450412750244) | > loss_disc_real_1: 0.2559932470321655 (0.2559932470321655) | > loss_disc_real_2: 0.3701082766056061 (0.3701082766056061) | > loss_disc_real_3: 0.27743950486183167 (0.27743950486183167) | > loss_disc_real_4: 0.343929260969162 (0.343929260969162) | > loss_disc_real_5: 0.4225510060787201 (0.4225510060787201) | > loss_0: 2.9505057334899902 (2.9505057334899902) | > loss_gen: 2.5134201049804688 (2.5134201049804688) | > loss_kl: 4.818337917327881 (4.818337917327881) | > loss_feat: 3.8947997093200684 (3.8947997093200684) | > loss_mel: 22.970016479492188 (22.970016479492188) | > loss_duration: 3.067676544189453 (3.067676544189453) | > loss_1: 37.264251708984375 (37.264251708984375)  --> STEP: 2 | > loss_disc: 2.874480724334717 (2.9124932289123535) | > loss_disc_real_0: 0.18882644176483154 (0.268585741519928) | > loss_disc_real_1: 0.24194712936878204 (0.24897018820047379) | > loss_disc_real_2: 0.26972484588623047 (0.3199165612459183) | > loss_disc_real_3: 0.2830066680908203 (0.280223086476326) | > loss_disc_real_4: 0.28741157054901123 (0.3156704157590866) | > loss_disc_real_5: 0.28950947523117065 (0.3560302406549454) | > loss_0: 2.874480724334717 (2.9124932289123535) | > loss_gen: 1.7298029661178589 (2.121611535549164) | > loss_kl: 4.49072790145874 (4.6545329093933105) | > loss_feat: 0.9389920234680176 (2.416895866394043) | > loss_mel: 20.204938888549805 (21.587477684020996) | > loss_duration: 2.9461302757263184 (3.0069034099578857) | > loss_1: 30.310592651367188 (33.78742218017578)  --> STEP: 3 | > loss_disc: 2.7760448455810547 (2.8670104344685874) | > loss_disc_real_0: 0.20791728794574738 (0.24836292366186777) | > loss_disc_real_1: 0.27513381838798523 (0.2576913982629776) | > loss_disc_real_2: 0.2697886526584625 (0.30320725838343304) | > loss_disc_real_3: 0.2639387547969818 (0.2747949759165446) | > loss_disc_real_4: 0.24981483817100525 (0.2937185565630595) | > loss_disc_real_5: 0.27908018231391907 (0.3303802212079366) | > loss_0: 2.7760448455810547 (2.8670104344685874) | > loss_gen: 1.843582272529602 (2.028935114542643) | > loss_kl: 2.18976092338562 (3.832942247390747) | > loss_feat: 0.9578913450241089 (1.9305610259373982) | > loss_mel: 12.953058242797852 (18.70933787027995) | > loss_duration: 2.717651605606079 (2.9104861418406167) | > loss_1: 20.661943435668945 (29.412262598673504) --> EVAL PERFORMANCE | > avg_loader_time: 0.003222386042277018 (-0.013226191202799479) | > avg_loss_disc: 2.8670104344685874 (-0.2321480115254717) | > avg_loss_disc_real_0: 0.24836292366186777 (+0.04662229120731354) | > avg_loss_disc_real_1: 0.2576913982629776 (-0.07469500601291656) | > avg_loss_disc_real_2: 0.30320725838343304 (-0.09337538480758667) | > avg_loss_disc_real_3: 0.2747949759165446 (-0.15681397914886475) | > avg_loss_disc_real_4: 0.2937185565630595 (-0.1782498061656952) | > avg_loss_disc_real_5: 0.3303802212079366 (-0.14665091037750244) | > avg_loss_0: 2.8670104344685874 (-0.2321480115254717) | > avg_loss_gen: 2.028935114542643 (-1.2863697210947675) | > avg_loss_kl: 3.832942247390747 (+0.07521367073059082) | > avg_loss_feat: 1.9305610259373982 (-4.474170565605164) | > avg_loss_mel: 18.70933787027995 (-5.038248697916664) | > avg_loss_duration: 2.9104861418406167 (-0.10869288444519043) | > avg_loss_1: 29.412262598673504 (-10.83226712544759)  > EPOCH: 684/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:41:36)   --> TIME: 2023-10-20 07:41:50 -- STEP: 9/50 -- GLOBAL_STEP: 87210 | > loss_disc: 2.190772533416748 (2.202795240614149) | > loss_disc_real_0: 0.09060192853212357 (0.10942347182167901) | > loss_disc_real_1: 0.25349873304367065 (0.17084158667259747) | > loss_disc_real_2: 0.23600369691848755 (0.20275132523642647) | > loss_disc_real_3: 0.2110147476196289 (0.1961924127406544) | > loss_disc_real_4: 0.1806013137102127 (0.17974475274483362) | > loss_disc_real_5: 0.14351962506771088 (0.1647426254219479) | > loss_0: 2.190772533416748 (2.202795240614149) | > grad_norm_0: tensor(396.3736, device='cuda:0') (tensor(505.2271, device='cuda:0')) | > loss_gen: 2.2174429893493652 (2.453605890274048) | > loss_kl: 0.8625777363777161 (0.8223011493682861) | > loss_feat: 4.848325252532959 (7.846869495179918) | > loss_mel: 22.44782829284668 (22.769129011366104) | > loss_duration: 1.3833563327789307 (1.4575124979019165) | > loss_1: 31.759531021118164 (35.349418216281464) | > grad_norm_1: tensor(9883.2646, device='cuda:0') (tensor(22914.1777, device='cuda:0')) | > current_lr_0: 0.00010091459983577238 | > current_lr_1: 0.00010091459983577238 | > step_time: 0.3891 (0.652737643983629) | > loader_time: 0.0078 (0.015980429119533963)  --> TIME: 2023-10-20 07:42:06 -- STEP: 39/50 -- GLOBAL_STEP: 87240 | > loss_disc: 3.036308765411377 (2.459222423724639) | > loss_disc_real_0: 0.24826180934906006 (0.14258849723503375) | > loss_disc_real_1: 0.3019718825817108 (0.22037901968145981) | > loss_disc_real_2: 0.27205610275268555 (0.2286031139202607) | > loss_disc_real_3: 0.2582016587257385 (0.22783024952961847) | > loss_disc_real_4: 0.27908235788345337 (0.23011492441097894) | > loss_disc_real_5: 0.26608362793922424 (0.2176444098735467) | > loss_0: 3.036308765411377 (2.459222423724639) | > grad_norm_0: tensor(228.2790, device='cuda:0') (tensor(616.4380, device='cuda:0')) | > loss_gen: 1.5590912103652954 (2.303216903637617) | > loss_kl: 0.5633797645568848 (0.8416009163245176) | > loss_feat: 0.06381867825984955 (5.497875552528944) | > loss_mel: 1.8599460124969482 (21.57481444798983) | > loss_duration: 1.4456433057785034 (1.4406991677406504) | > loss_1: 5.491878986358643 (31.658207245362117) | > grad_norm_1: tensor(27750.0527, device='cuda:0') (tensor(18179.0586, device='cuda:0')) | > current_lr_0: 0.00010091459983577238 | > current_lr_1: 0.00010091459983577238 | > step_time: 0.3155 (0.5571315044011825) | > loader_time: 0.0246 (0.019425508303520005)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.320225238800049 (2.320225238800049) | > loss_disc_real_0: 0.22916796803474426 (0.22916796803474426) | > loss_disc_real_1: 0.3135993778705597 (0.3135993778705597) | > loss_disc_real_2: 0.22942368686199188 (0.22942368686199188) | > loss_disc_real_3: 0.26290470361709595 (0.26290470361709595) | > loss_disc_real_4: 0.11588070541620255 (0.11588070541620255) | > loss_disc_real_5: 0.08591298013925552 (0.08591298013925552) | > loss_0: 2.320225238800049 (2.320225238800049) | > loss_gen: 2.4049172401428223 (2.4049172401428223) | > loss_kl: 4.642198085784912 (4.642198085784912) | > loss_feat: 4.742830276489258 (4.742830276489258) | > loss_mel: 21.64447021484375 (21.64447021484375) | > loss_duration: 2.7205677032470703 (2.7205677032470703) | > loss_1: 36.15498352050781 (36.15498352050781)  --> STEP: 1 | > loss_disc: 2.6513283252716064 (2.6513283252716064) | > loss_disc_real_0: 0.08559820801019669 (0.08559820801019669) | > loss_disc_real_1: 0.30128660798072815 (0.30128660798072815) | > loss_disc_real_2: 0.263526052236557 (0.263526052236557) | > loss_disc_real_3: 0.2459479421377182 (0.2459479421377182) | > loss_disc_real_4: 0.32626816630363464 (0.32626816630363464) | > loss_disc_real_5: 0.28330135345458984 (0.28330135345458984) | > loss_0: 2.6513283252716064 (2.6513283252716064) | > loss_gen: 2.093301773071289 (2.093301773071289) | > loss_kl: 4.615896224975586 (4.615896224975586) | > loss_feat: 7.032476902008057 (7.032476902008057) | > loss_mel: 22.936166763305664 (22.936166763305664) | > loss_duration: 3.058925151824951 (3.058925151824951) | > loss_1: 39.73676681518555 (39.73676681518555)  --> STEP: 2 | > loss_disc: 2.59706449508667 (2.624196410179138) | > loss_disc_real_0: 0.0834960788488388 (0.08454714342951775) | > loss_disc_real_1: 0.3006680905818939 (0.30097734928131104) | > loss_disc_real_2: 0.214674711227417 (0.239100381731987) | > loss_disc_real_3: 0.30907154083251953 (0.27750974148511887) | > loss_disc_real_4: 0.30534428358078003 (0.31580622494220734) | > loss_disc_real_5: 0.23367926478385925 (0.25849030911922455) | > loss_0: 2.59706449508667 (2.624196410179138) | > loss_gen: 2.2352724075317383 (2.1642870903015137) | > loss_kl: 5.3998236656188965 (5.007859945297241) | > loss_feat: 7.9749250411987305 (7.5037009716033936) | > loss_mel: 22.156694412231445 (22.546430587768555) | > loss_duration: 2.954946756362915 (3.006935954093933) | > loss_1: 40.72166061401367 (40.22921371459961)  --> STEP: 3 | > loss_disc: 2.917006492614746 (2.7217997709910073) | > loss_disc_real_0: 0.300129234790802 (0.15640784054994583) | > loss_disc_real_1: 0.2402864247560501 (0.28074704110622406) | > loss_disc_real_2: 0.30931663513183594 (0.26250579953193665) | > loss_disc_real_3: 0.3043997883796692 (0.286473090449969) | > loss_disc_real_4: 0.252817302942276 (0.2948099176088969) | > loss_disc_real_5: 0.2639164924621582 (0.26029903690020245) | > loss_0: 2.917006492614746 (2.7217997709910073) | > loss_gen: 1.8366612195968628 (2.055078466733297) | > loss_kl: 2.3936069011688232 (4.136442263921102) | > loss_feat: 0.44908857345581055 (5.152163505554199) | > loss_mel: 12.712285041809082 (19.26838207244873) | > loss_duration: 2.786839485168457 (2.933570464452108) | > loss_1: 20.178482055664062 (33.54563649495443) --> EVAL PERFORMANCE | > avg_loader_time: 0.020500342051188152 (+0.017277956008911133) | > avg_loss_disc: 2.7217997709910073 (-0.14521066347758005) | > avg_loss_disc_real_0: 0.15640784054994583 (-0.09195508311192194) | > avg_loss_disc_real_1: 0.28074704110622406 (+0.02305564284324646) | > avg_loss_disc_real_2: 0.26250579953193665 (-0.0407014588514964) | > avg_loss_disc_real_3: 0.286473090449969 (+0.011678114533424377) | > avg_loss_disc_real_4: 0.2948099176088969 (+0.0010913610458374023) | > avg_loss_disc_real_5: 0.26029903690020245 (-0.07008118430773413) | > avg_loss_0: 2.7217997709910073 (-0.14521066347758005) | > avg_loss_gen: 2.055078466733297 (+0.02614335219065378) | > avg_loss_kl: 4.136442263921102 (+0.3035000165303545) | > avg_loss_feat: 5.152163505554199 (+3.2216024796168012) | > avg_loss_mel: 19.26838207244873 (+0.5590442021687814) | > avg_loss_duration: 2.933570464452108 (+0.02308432261149118) | > avg_loss_1: 33.54563649495443 (+4.133373896280926)  > EPOCH: 685/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:42:25)   --> TIME: 2023-10-20 07:42:42 -- STEP: 19/50 -- GLOBAL_STEP: 87270 | > loss_disc: 2.6453213691711426 (2.6437279048718905) | > loss_disc_real_0: 0.4072924256324768 (0.20797765848079794) | > loss_disc_real_1: 0.2150893211364746 (0.23403353832269969) | > loss_disc_real_2: 0.2130751609802246 (0.24235473004610916) | > loss_disc_real_3: 0.3731929361820221 (0.2650910338484927) | > loss_disc_real_4: 0.3608492314815521 (0.23677984350606016) | > loss_disc_real_5: 0.3152788281440735 (0.2582228203353129) | > loss_0: 2.6453213691711426 (2.6437279048718905) | > grad_norm_0: tensor(1014.6891, device='cuda:0') (tensor(759.7104, device='cuda:0')) | > loss_gen: 2.8361916542053223 (2.213153023468821) | > loss_kl: 1.1215827465057373 (0.833155211649443) | > loss_feat: 4.69633150100708 (4.887435630748146) | > loss_mel: 20.82340431213379 (18.41839403855173) | > loss_duration: 1.5508710145950317 (1.4588945351148908) | > loss_1: 31.02838134765625 (27.81103269677413) | > grad_norm_1: tensor(7157.8232, device='cuda:0') (tensor(23250.7598, device='cuda:0')) | > current_lr_0: 0.00010081372937503818 | > current_lr_1: 0.00010081372937503818 | > step_time: 0.3355 (0.6170805504447535) | > loader_time: 0.0092 (0.019127858312506425)  --> TIME: 2023-10-20 07:42:57 -- STEP: 49/50 -- GLOBAL_STEP: 87300 | > loss_disc: 2.508302688598633 (2.617596762520927) | > loss_disc_real_0: 0.2693895697593689 (0.19406552975807262) | > loss_disc_real_1: 0.17920468747615814 (0.22697368081735106) | > loss_disc_real_2: 0.21082061529159546 (0.22541845677306457) | > loss_disc_real_3: 0.25181686878204346 (0.24502784732197005) | > loss_disc_real_4: 0.20661817491054535 (0.25169191691948445) | > loss_disc_real_5: 0.33814990520477295 (0.2530769604657376) | > loss_0: 2.508302688598633 (2.617596762520927) | > grad_norm_0: tensor(1263.1498, device='cuda:0') (tensor(692.6113, device='cuda:0')) | > loss_gen: 2.460646867752075 (2.202123055652697) | > loss_kl: 0.23564213514328003 (0.7767319156199085) | > loss_feat: 5.331149101257324 (4.842698314664315) | > loss_mel: 24.927520751953125 (19.805870241048375) | > loss_duration: 1.5518546104431152 (1.4301252924666112) | > loss_1: 34.506813049316406 (29.057549126294195) | > grad_norm_1: tensor(46539.8516, device='cuda:0') (tensor(18221.4375, device='cuda:0')) | > current_lr_0: 0.00010081372937503818 | > current_lr_1: 0.00010081372937503818 | > step_time: 1.2157 (0.5259969088495996) | > loader_time: 0.4815 (0.023447917432201152)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7383618354797363 (2.7383618354797363) | > loss_disc_real_0: 0.23172082006931305 (0.23172082006931305) | > loss_disc_real_1: 0.2002035230398178 (0.2002035230398178) | > loss_disc_real_2: 0.2761542499065399 (0.2761542499065399) | > loss_disc_real_3: 0.21362127363681793 (0.21362127363681793) | > loss_disc_real_4: 0.37608498334884644 (0.37608498334884644) | > loss_disc_real_5: 0.4677859842777252 (0.4677859842777252) | > loss_0: 2.7383618354797363 (2.7383618354797363) | > loss_gen: 2.5020458698272705 (2.5020458698272705) | > loss_kl: 4.3163909912109375 (4.3163909912109375) | > loss_feat: 7.129065990447998 (7.129065990447998) | > loss_mel: 25.291126251220703 (25.291126251220703) | > loss_duration: 2.810382843017578 (2.810382843017578) | > loss_1: 42.04901123046875 (42.04901123046875)  --> STEP: 1 | > loss_disc: 2.122030258178711 (2.122030258178711) | > loss_disc_real_0: 0.05756749212741852 (0.05756749212741852) | > loss_disc_real_1: 0.19998227059841156 (0.19998227059841156) | > loss_disc_real_2: 0.20398768782615662 (0.20398768782615662) | > loss_disc_real_3: 0.24074846506118774 (0.24074846506118774) | > loss_disc_real_4: 0.20362229645252228 (0.20362229645252228) | > loss_disc_real_5: 0.12714232504367828 (0.12714232504367828) | > loss_0: 2.122030258178711 (2.122030258178711) | > loss_gen: 2.4200520515441895 (2.4200520515441895) | > loss_kl: 4.6053924560546875 (4.6053924560546875) | > loss_feat: 8.661514282226562 (8.661514282226562) | > loss_mel: 26.217260360717773 (26.217260360717773) | > loss_duration: 3.0008223056793213 (3.0008223056793213) | > loss_1: 44.90504455566406 (44.90504455566406)  --> STEP: 2 | > loss_disc: 3.0544066429138184 (2.5882184505462646) | > loss_disc_real_0: 0.4404571056365967 (0.2490122988820076) | > loss_disc_real_1: 0.2813887894153595 (0.24068553000688553) | > loss_disc_real_2: 0.22353558242321014 (0.21376163512468338) | > loss_disc_real_3: 0.2736913859844208 (0.25721992552280426) | > loss_disc_real_4: 0.2518073320388794 (0.22771481424570084) | > loss_disc_real_5: 0.3279217481613159 (0.2275320366024971) | > loss_0: 3.0544066429138184 (2.5882184505462646) | > loss_gen: 1.965124487876892 (2.1925882697105408) | > loss_kl: 5.076436519622803 (4.840914487838745) | > loss_feat: 0.6609616279602051 (4.661237955093384) | > loss_mel: 22.520586013793945 (24.36892318725586) | > loss_duration: 2.9815499782562256 (2.9911861419677734) | > loss_1: 33.20465850830078 (39.05485153198242)  --> STEP: 3 | > loss_disc: 2.872960090637207 (2.6831323305765786) | > loss_disc_real_0: 0.13767871260643005 (0.2119011034568151) | > loss_disc_real_1: 0.29542022943496704 (0.25893042981624603) | > loss_disc_real_2: 0.2916719615459442 (0.23973174393177032) | > loss_disc_real_3: 0.4016958773136139 (0.3053785761197408) | > loss_disc_real_4: 0.3931545913219452 (0.282861406604449) | > loss_disc_real_5: 0.2925511598587036 (0.24920507768789926) | > loss_0: 2.872960090637207 (2.6831323305765786) | > loss_gen: 2.316913366317749 (2.2340299685796103) | > loss_kl: 2.1876494884490967 (3.956492821375529) | > loss_feat: 4.5256733894348145 (4.616049766540527) | > loss_mel: 22.72748565673828 (23.82177734375) | > loss_duration: 2.924055337905884 (2.968809207280477) | > loss_1: 34.68177795410156 (37.59716033935547) --> EVAL PERFORMANCE | > avg_loader_time: 0.016386985778808594 (-0.0041133562723795584) | > avg_loss_disc: 2.6831323305765786 (-0.03866744041442871) | > avg_loss_disc_real_0: 0.2119011034568151 (+0.05549326290686926) | > avg_loss_disc_real_1: 0.25893042981624603 (-0.021816611289978027) | > avg_loss_disc_real_2: 0.23973174393177032 (-0.02277405560016632) | > avg_loss_disc_real_3: 0.3053785761197408 (+0.018905485669771793) | > avg_loss_disc_real_4: 0.282861406604449 (-0.011948511004447937) | > avg_loss_disc_real_5: 0.24920507768789926 (-0.01109395921230319) | > avg_loss_0: 2.6831323305765786 (-0.03866744041442871) | > avg_loss_gen: 2.2340299685796103 (+0.17895150184631348) | > avg_loss_kl: 3.956492821375529 (-0.17994944254557277) | > avg_loss_feat: 4.616049766540527 (-0.5361137390136719) | > avg_loss_mel: 23.82177734375 (+4.5533952713012695) | > avg_loss_duration: 2.968809207280477 (+0.03523874282836914) | > avg_loss_1: 37.59716033935547 (+4.051523844401039)  > EPOCH: 686/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:43:16)   --> TIME: 2023-10-20 07:43:41 -- STEP: 29/50 -- GLOBAL_STEP: 87330 | > loss_disc: 2.4451587200164795 (2.3729933746929825) | > loss_disc_real_0: 0.20718452334403992 (0.14018164825593604) | > loss_disc_real_1: 0.2119346559047699 (0.196112591516355) | > loss_disc_real_2: 0.17616575956344604 (0.20106541262618427) | > loss_disc_real_3: 0.18522979319095612 (0.23374025587891717) | > loss_disc_real_4: 0.1124766618013382 (0.19959033280611038) | > loss_disc_real_5: 0.13615235686302185 (0.192488847621556) | > loss_0: 2.4451587200164795 (2.3729933746929825) | > grad_norm_0: tensor(569.5622, device='cuda:0') (tensor(679.4998, device='cuda:0')) | > loss_gen: 2.238849639892578 (2.3961843992101737) | > loss_kl: 1.0671037435531616 (0.9774248075896296) | > loss_feat: 8.376579284667969 (6.268688352971242) | > loss_mel: 23.60142707824707 (21.598846928826696) | > loss_duration: 1.4235748052597046 (1.4455474738417) | > loss_1: 36.70753479003906 (32.68669154726226) | > grad_norm_1: tensor(35903.4375, device='cuda:0') (tensor(29030.0762, device='cuda:0')) | > current_lr_0: 0.00010071295974064493 | > current_lr_1: 0.00010071295974064493 | > step_time: 0.8438 (0.6055660412229341) | > loader_time: 0.0264 (0.022063575941940833)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.455500602722168 (3.455500602722168) | > loss_disc_real_0: 0.6103277802467346 (0.6103277802467346) | > loss_disc_real_1: 0.2342902272939682 (0.2342902272939682) | > loss_disc_real_2: 0.4272114038467407 (0.4272114038467407) | > loss_disc_real_3: 0.28083184361457825 (0.28083184361457825) | > loss_disc_real_4: 0.3984079658985138 (0.3984079658985138) | > loss_disc_real_5: 0.5148256421089172 (0.5148256421089172) | > loss_0: 3.455500602722168 (3.455500602722168) | > loss_gen: 2.681859016418457 (2.681859016418457) | > loss_kl: 4.530383110046387 (4.530383110046387) | > loss_feat: 4.152223587036133 (4.152223587036133) | > loss_mel: 23.260751724243164 (23.260751724243164) | > loss_duration: 2.810520887374878 (2.810520887374878) | > loss_1: 37.43573760986328 (37.43573760986328)  --> STEP: 1 | > loss_disc: 2.433537483215332 (2.433537483215332) | > loss_disc_real_0: 0.32116246223449707 (0.32116246223449707) | > loss_disc_real_1: 0.2411317378282547 (0.2411317378282547) | > loss_disc_real_2: 0.27043938636779785 (0.27043938636779785) | > loss_disc_real_3: 0.37109968066215515 (0.37109968066215515) | > loss_disc_real_4: 0.2440301924943924 (0.2440301924943924) | > loss_disc_real_5: 0.2661985158920288 (0.2661985158920288) | > loss_0: 2.433537483215332 (2.433537483215332) | > loss_gen: 3.4727370738983154 (3.4727370738983154) | > loss_kl: 4.751057147979736 (4.751057147979736) | > loss_feat: 7.725896835327148 (7.725896835327148) | > loss_mel: 23.012428283691406 (23.012428283691406) | > loss_duration: 3.1259355545043945 (3.1259355545043945) | > loss_1: 42.088050842285156 (42.088050842285156)  --> STEP: 2 | > loss_disc: 2.4491662979125977 (2.441351890563965) | > loss_disc_real_0: 0.13416782021522522 (0.22766514122486115) | > loss_disc_real_1: 0.20557603240013123 (0.22335388511419296) | > loss_disc_real_2: 0.2940131723880768 (0.2822262793779373) | > loss_disc_real_3: 0.3431095778942108 (0.357104629278183) | > loss_disc_real_4: 0.3582569658756256 (0.301143579185009) | > loss_disc_real_5: 0.4992026090621948 (0.3827005624771118) | > loss_0: 2.4491662979125977 (2.441351890563965) | > loss_gen: 3.1831111907958984 (3.327924132347107) | > loss_kl: 4.863335609436035 (4.807196378707886) | > loss_feat: 6.8205246925354 (7.273210763931274) | > loss_mel: 25.239486694335938 (24.125957489013672) | > loss_duration: 3.0695948600769043 (3.0977652072906494) | > loss_1: 43.176055908203125 (42.63205337524414)  --> STEP: 3 | > loss_disc: 3.2972640991210938 (2.726655960083008) | > loss_disc_real_0: 0.4365473985671997 (0.297292560338974) | > loss_disc_real_1: 0.3132888078689575 (0.2533321926991145) | > loss_disc_real_2: 0.3061884343624115 (0.290213664372762) | > loss_disc_real_3: 0.29710152745246887 (0.33710359533627826) | > loss_disc_real_4: 0.41726067662239075 (0.3398492783308029) | > loss_disc_real_5: 0.4362516701221466 (0.4005509316921234) | > loss_0: 3.2972640991210938 (2.726655960083008) | > loss_gen: 2.3991639614105225 (3.0183374087015786) | > loss_kl: 2.403848886489868 (4.006080547968547) | > loss_feat: 3.6153359413146973 (6.053919156392415) | > loss_mel: 24.132177352905273 (24.12803077697754) | > loss_duration: 2.7658541202545166 (2.987128178278605) | > loss_1: 35.31637954711914 (40.193495432535805) --> EVAL PERFORMANCE | > avg_loader_time: 0.006282885869344075 (-0.01010409990946452) | > avg_loss_disc: 2.726655960083008 (+0.043523629506429184) | > avg_loss_disc_real_0: 0.297292560338974 (+0.0853914568821589) | > avg_loss_disc_real_1: 0.2533321926991145 (-0.005598237117131533) | > avg_loss_disc_real_2: 0.290213664372762 (+0.0504819204409917) | > avg_loss_disc_real_3: 0.33710359533627826 (+0.031725019216537476) | > avg_loss_disc_real_4: 0.3398492783308029 (+0.056987871726353945) | > avg_loss_disc_real_5: 0.4005509316921234 (+0.15134585400422415) | > avg_loss_0: 2.726655960083008 (+0.043523629506429184) | > avg_loss_gen: 3.0183374087015786 (+0.7843074401219683) | > avg_loss_kl: 4.006080547968547 (+0.04958772659301802) | > avg_loss_feat: 6.053919156392415 (+1.4378693898518877) | > avg_loss_mel: 24.12803077697754 (+0.30625343322753906) | > avg_loss_duration: 2.987128178278605 (+0.01831897099812796) | > avg_loss_1: 40.193495432535805 (+2.596335093180336)  > EPOCH: 687/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:44:10)   --> TIME: 2023-10-20 07:44:23 -- STEP: 9/50 -- GLOBAL_STEP: 87360 | > loss_disc: 2.9487781524658203 (2.463111890686883) | > loss_disc_real_0: 0.4157258868217468 (0.15172835253179073) | > loss_disc_real_1: 0.2866012752056122 (0.23346871551540163) | > loss_disc_real_2: 0.3315182626247406 (0.20641062988175285) | > loss_disc_real_3: 0.269439160823822 (0.26158130168914795) | > loss_disc_real_4: 0.2899235188961029 (0.2385054843293296) | > loss_disc_real_5: 0.268037348985672 (0.22924376196331447) | > loss_0: 2.9487781524658203 (2.463111890686883) | > grad_norm_0: tensor(1482.8192, device='cuda:0') (tensor(712.3718, device='cuda:0')) | > loss_gen: 1.991424322128296 (2.3196942276424832) | > loss_kl: 0.7205536365509033 (0.7879694857531123) | > loss_feat: 0.5572333931922913 (4.193290534532732) | > loss_mel: 17.15340232849121 (17.837703069051106) | > loss_duration: 1.3125249147415161 (1.4331114159690008) | > loss_1: 21.735137939453125 (26.571769290500217) | > grad_norm_1: tensor(12467.2002, device='cuda:0') (tensor(27415.3574, device='cuda:0')) | > current_lr_0: 0.00010061229083181038 | > current_lr_1: 0.00010061229083181038 | > step_time: 0.8248 (0.653513060675727) | > loader_time: 0.0328 (0.0207470522986518)  --> TIME: 2023-10-20 07:44:44 -- STEP: 39/50 -- GLOBAL_STEP: 87390 | > loss_disc: 2.8282155990600586 (2.495434592931699) | > loss_disc_real_0: 0.05726443603634834 (0.14368895307565346) | > loss_disc_real_1: 0.15642663836479187 (0.2296088893826191) | > loss_disc_real_2: 0.17197781801223755 (0.22123584323204482) | > loss_disc_real_3: 0.11788000166416168 (0.24820184440184861) | > loss_disc_real_4: 0.2367647886276245 (0.22033915563653678) | > loss_disc_real_5: 0.3600459098815918 (0.2431345923970907) | > loss_0: 2.8282155990600586 (2.495434592931699) | > grad_norm_0: tensor(724.0222, device='cuda:0') (tensor(689.7814, device='cuda:0')) | > loss_gen: 1.7393032312393188 (2.2684234839219313) | > loss_kl: 0.2779727876186371 (0.8190902511660869) | > loss_feat: 7.062988758087158 (4.631788631757865) | > loss_mel: 24.462373733520508 (19.99424106646806) | > loss_duration: 1.4606871604919434 (1.4284477050487812) | > loss_1: 35.00332260131836 (29.141991272950783) | > grad_norm_1: tensor(17763.4336, device='cuda:0') (tensor(20900.9258, device='cuda:0')) | > current_lr_0: 0.00010061229083181038 | > current_lr_1: 0.00010061229083181038 | > step_time: 0.7559 (0.6818609298803868) | > loader_time: 0.0272 (0.025388369193443887)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.77783203125 (2.77783203125) | > loss_disc_real_0: 0.25452935695648193 (0.25452935695648193) | > loss_disc_real_1: 0.2289656549692154 (0.2289656549692154) | > loss_disc_real_2: 0.1557987779378891 (0.1557987779378891) | > loss_disc_real_3: 0.2498069852590561 (0.2498069852590561) | > loss_disc_real_4: 0.13349583745002747 (0.13349583745002747) | > loss_disc_real_5: 0.2650582194328308 (0.2650582194328308) | > loss_0: 2.77783203125 (2.77783203125) | > loss_gen: 2.0594632625579834 (2.0594632625579834) | > loss_kl: 5.242447853088379 (5.242447853088379) | > loss_feat: 8.495821952819824 (8.495821952819824) | > loss_mel: 24.816143035888672 (24.816143035888672) | > loss_duration: 2.736906051635742 (2.736906051635742) | > loss_1: 43.35078430175781 (43.35078430175781)  --> STEP: 1 | > loss_disc: 2.944014310836792 (2.944014310836792) | > loss_disc_real_0: 0.166518896818161 (0.166518896818161) | > loss_disc_real_1: 0.30652916431427 (0.30652916431427) | > loss_disc_real_2: 0.27914565801620483 (0.27914565801620483) | > loss_disc_real_3: 0.21273042261600494 (0.21273042261600494) | > loss_disc_real_4: 0.3351198732852936 (0.3351198732852936) | > loss_disc_real_5: 0.3287052810192108 (0.3287052810192108) | > loss_0: 2.944014310836792 (2.944014310836792) | > loss_gen: 2.1241323947906494 (2.1241323947906494) | > loss_kl: 4.717484951019287 (4.717484951019287) | > loss_feat: 7.143197536468506 (7.143197536468506) | > loss_mel: 24.773799896240234 (24.773799896240234) | > loss_duration: 3.114086151123047 (3.114086151123047) | > loss_1: 41.872703552246094 (41.872703552246094)  --> STEP: 2 | > loss_disc: 1.7299532890319824 (2.336983799934387) | > loss_disc_real_0: 0.033388879150152206 (0.09995388798415661) | > loss_disc_real_1: 0.18788281083106995 (0.24720598757266998) | > loss_disc_real_2: 0.08391771465539932 (0.18153168633580208) | > loss_disc_real_3: 0.047778598964214325 (0.13025451079010963) | > loss_disc_real_4: 0.04141724109649658 (0.18826855719089508) | > loss_disc_real_5: 0.029090983793139458 (0.17889813240617514) | > loss_0: 1.7299532890319824 (2.336983799934387) | > loss_gen: 2.3628110885620117 (2.2434717416763306) | > loss_kl: 4.979445457458496 (4.848465204238892) | > loss_feat: 14.552560806274414 (10.84787917137146) | > loss_mel: 25.640939712524414 (25.207369804382324) | > loss_duration: 2.886082172393799 (3.000084161758423) | > loss_1: 50.421836853027344 (46.14727020263672)  --> STEP: 3 | > loss_disc: 2.5165882110595703 (2.3968519369761148) | > loss_disc_real_0: 0.27902767062187195 (0.15964514886339506) | > loss_disc_real_1: 0.4247712790966034 (0.30639441808064777) | > loss_disc_real_2: 0.23602980375289917 (0.19969772547483444) | > loss_disc_real_3: 0.28701135516166687 (0.18250679224729538) | > loss_disc_real_4: 0.16874012351036072 (0.18175907929738364) | > loss_disc_real_5: 0.1400901824235916 (0.1659621490786473) | > loss_0: 2.5165882110595703 (2.3968519369761148) | > loss_gen: 2.9780097007751465 (2.4883177280426025) | > loss_kl: 2.135913610458374 (3.9442813396453857) | > loss_feat: 6.786126136779785 (9.493961493174234) | > loss_mel: 22.606781005859375 (24.34050687154134) | > loss_duration: 2.893420696258545 (2.9645296732584634) | > loss_1: 37.40024948120117 (43.23159662882487) --> EVAL PERFORMANCE | > avg_loader_time: 0.011152823766072592 (+0.0048699378967285165) | > avg_loss_disc: 2.3968519369761148 (-0.32980402310689305) | > avg_loss_disc_real_0: 0.15964514886339506 (-0.13764741147557893) | > avg_loss_disc_real_1: 0.30639441808064777 (+0.05306222538153327) | > avg_loss_disc_real_2: 0.19969772547483444 (-0.09051593889792758) | > avg_loss_disc_real_3: 0.18250679224729538 (-0.15459680308898288) | > avg_loss_disc_real_4: 0.18175907929738364 (-0.15809019903341928) | > avg_loss_disc_real_5: 0.1659621490786473 (-0.23458878261347613) | > avg_loss_0: 2.3968519369761148 (-0.32980402310689305) | > avg_loss_gen: 2.4883177280426025 (-0.5300196806589761) | > avg_loss_kl: 3.9442813396453857 (-0.0617992083231611) | > avg_loss_feat: 9.493961493174234 (+3.4400423367818194) | > avg_loss_mel: 24.34050687154134 (+0.2124760945638009) | > avg_loss_duration: 2.9645296732584634 (-0.0225985050201416) | > avg_loss_1: 43.23159662882487 (+3.0381011962890625)  > EPOCH: 688/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:45:08)   --> TIME: 2023-10-20 07:45:26 -- STEP: 19/50 -- GLOBAL_STEP: 87420 | > loss_disc: 1.8535478115081787 (2.178247696474979) | > loss_disc_real_0: 0.06360235810279846 (0.12334510755087984) | > loss_disc_real_1: 0.1034645065665245 (0.2176321254749047) | > loss_disc_real_2: 0.25865674018859863 (0.201176334760691) | > loss_disc_real_3: 0.19895656406879425 (0.19675731129552188) | > loss_disc_real_4: 0.4058855473995209 (0.21305972416149943) | > loss_disc_real_5: 0.11054272204637527 (0.16866088408584656) | > loss_0: 1.8535478115081787 (2.178247696474979) | > grad_norm_0: tensor(691.8730, device='cuda:0') (tensor(498.5170, device='cuda:0')) | > loss_gen: 2.944627285003662 (2.5801956716336703) | > loss_kl: 0.8535542488098145 (0.9273991553406966) | > loss_feat: 6.884747505187988 (7.33633634957828) | > loss_mel: 26.862953186035156 (24.302199225676688) | > loss_duration: 1.5604262351989746 (1.4609884588341964) | > loss_1: 39.10630416870117 (36.60711908340454) | > grad_norm_1: tensor(16323.9248, device='cuda:0') (tensor(23426.5527, device='cuda:0')) | > current_lr_0: 0.00010051172254785301 | > current_lr_1: 0.00010051172254785301 | > step_time: 0.6608 (0.621180672394602) | > loader_time: 0.0287 (0.025756973969308955)  --> TIME: 2023-10-20 07:45:40 -- STEP: 49/50 -- GLOBAL_STEP: 87450 | > loss_disc: 2.67069149017334 (2.39989032550734) | > loss_disc_real_0: 0.3336808681488037 (0.14617693976366092) | > loss_disc_real_1: 0.2453763782978058 (0.22071177025838773) | > loss_disc_real_2: 0.18604840338230133 (0.21717811147777402) | > loss_disc_real_3: 0.22359006106853485 (0.21396797693961736) | > loss_disc_real_4: 0.2905906140804291 (0.23054163735740038) | > loss_disc_real_5: 0.38624995946884155 (0.21233859812194594) | > loss_0: 2.67069149017334 (2.39989032550734) | > grad_norm_0: tensor(726.6322, device='cuda:0') (tensor(610.4056, device='cuda:0')) | > loss_gen: 2.159928798675537 (2.382740731142004) | > loss_kl: 0.2698657512664795 (0.861671327480248) | > loss_feat: 2.322129726409912 (5.730709905070918) | > loss_mel: 20.101993560791016 (21.53879298725906) | > loss_duration: 1.511909008026123 (1.4137113483584658) | > loss_1: 26.365827560424805 (31.927626463831697) | > grad_norm_1: tensor(4608.4717, device='cuda:0') (tensor(19927.6094, device='cuda:0')) | > current_lr_0: 0.00010051172254785301 | > current_lr_1: 0.00010051172254785301 | > step_time: 0.3057 (0.5193769055969858) | > loader_time: 0.5654 (0.028052198643587073)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.829306125640869 (2.829306125640869) | > loss_disc_real_0: 0.14486515522003174 (0.14486515522003174) | > loss_disc_real_1: 0.28062930703163147 (0.28062930703163147) | > loss_disc_real_2: 0.2717200219631195 (0.2717200219631195) | > loss_disc_real_3: 0.3038080632686615 (0.3038080632686615) | > loss_disc_real_4: 0.06342343986034393 (0.06342343986034393) | > loss_disc_real_5: 0.08956073224544525 (0.08956073224544525) | > loss_0: 2.829306125640869 (2.829306125640869) | > loss_gen: 1.730895757675171 (1.730895757675171) | > loss_kl: 5.007007598876953 (5.007007598876953) | > loss_feat: 4.403441429138184 (4.403441429138184) | > loss_mel: 22.348230361938477 (22.348230361938477) | > loss_duration: 2.8851630687713623 (2.8851630687713623) | > loss_1: 36.37473678588867 (36.37473678588867)  --> STEP: 1 | > loss_disc: 2.744231700897217 (2.744231700897217) | > loss_disc_real_0: 0.3340250551700592 (0.3340250551700592) | > loss_disc_real_1: 0.4400021433830261 (0.4400021433830261) | > loss_disc_real_2: 0.4217741787433624 (0.4217741787433624) | > loss_disc_real_3: 0.1994059681892395 (0.1994059681892395) | > loss_disc_real_4: 0.2565520703792572 (0.2565520703792572) | > loss_disc_real_5: 0.2992386519908905 (0.2992386519908905) | > loss_0: 2.744231700897217 (2.744231700897217) | > loss_gen: 2.7593588829040527 (2.7593588829040527) | > loss_kl: 4.730565071105957 (4.730565071105957) | > loss_feat: 7.317179203033447 (7.317179203033447) | > loss_mel: 22.77364158630371 (22.77364158630371) | > loss_duration: 3.228489398956299 (3.228489398956299) | > loss_1: 40.809234619140625 (40.809234619140625)  --> STEP: 2 | > loss_disc: 1.6891071796417236 (2.21666944026947) | > loss_disc_real_0: 0.055118296295404434 (0.19457167573273182) | > loss_disc_real_1: 0.27709251642227173 (0.3585473299026489) | > loss_disc_real_2: 0.23391962051391602 (0.3278468996286392) | > loss_disc_real_3: 0.04934443533420563 (0.12437520176172256) | > loss_disc_real_4: 0.1154591366648674 (0.1860056035220623) | > loss_disc_real_5: 0.03393047675490379 (0.16658456437289715) | > loss_0: 1.6891071796417236 (2.21666944026947) | > loss_gen: 3.306095838546753 (3.032727360725403) | > loss_kl: 5.055698871612549 (4.893131971359253) | > loss_feat: 11.974370002746582 (9.645774602890015) | > loss_mel: 23.913043975830078 (23.343342781066895) | > loss_duration: 3.063108444213867 (3.145798921585083) | > loss_1: 47.31231689453125 (44.06077575683594)  --> STEP: 3 | > loss_disc: 3.6512582302093506 (2.6948657035827637) | > loss_disc_real_0: 0.33280515670776367 (0.2406495027244091) | > loss_disc_real_1: 0.420917272567749 (0.3793373107910156) | > loss_disc_real_2: 0.45631304383277893 (0.3706689476966858) | > loss_disc_real_3: 0.4198969304561615 (0.22288244465986887) | > loss_disc_real_4: 0.4099055826663971 (0.26063892990350723) | > loss_disc_real_5: 0.4496261477470398 (0.2609317588309447) | > loss_0: 3.6512582302093506 (2.6948657035827637) | > loss_gen: 2.1804449558258057 (2.7486332257588706) | > loss_kl: 2.180088996887207 (3.9887843132019043) | > loss_feat: 3.798367977142334 (7.696639060974121) | > loss_mel: 20.285388946533203 (22.324024836222332) | > loss_duration: 2.788486957550049 (3.026694933573405) | > loss_1: 31.232776641845703 (39.784776051839195) --> EVAL PERFORMANCE | > avg_loader_time: 0.023975292841593426 (+0.012822469075520834) | > avg_loss_disc: 2.6948657035827637 (+0.2980137666066489) | > avg_loss_disc_real_0: 0.2406495027244091 (+0.08100435386101404) | > avg_loss_disc_real_1: 0.3793373107910156 (+0.07294289271036786) | > avg_loss_disc_real_2: 0.3706689476966858 (+0.17097122222185135) | > avg_loss_disc_real_3: 0.22288244465986887 (+0.04037565241257349) | > avg_loss_disc_real_4: 0.26063892990350723 (+0.0788798506061236) | > avg_loss_disc_real_5: 0.2609317588309447 (+0.09496960975229743) | > avg_loss_0: 2.6948657035827637 (+0.2980137666066489) | > avg_loss_gen: 2.7486332257588706 (+0.26031549771626805) | > avg_loss_kl: 3.9887843132019043 (+0.044502973556518555) | > avg_loss_feat: 7.696639060974121 (-1.7973224322001133) | > avg_loss_mel: 22.324024836222332 (-2.016482035319008) | > avg_loss_duration: 3.026694933573405 (+0.062165260314941406) | > avg_loss_1: 39.784776051839195 (-3.4468205769856723)  > EPOCH: 689/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:46:00)   --> TIME: 2023-10-20 07:46:24 -- STEP: 29/50 -- GLOBAL_STEP: 87480 | > loss_disc: 2.244598865509033 (2.6010802532064505) | > loss_disc_real_0: 0.10920416563749313 (0.17123160973705095) | > loss_disc_real_1: 0.14784014225006104 (0.23522911991538673) | > loss_disc_real_2: 0.2277294099330902 (0.25145203440353786) | > loss_disc_real_3: 0.33007362484931946 (0.2454491981529984) | > loss_disc_real_4: 0.25115448236465454 (0.23299505561590195) | > loss_disc_real_5: 0.1964413970708847 (0.24966437009901843) | > loss_0: 2.244598865509033 (2.6010802532064505) | > grad_norm_0: tensor(298.5402, device='cuda:0') (tensor(540.3307, device='cuda:0')) | > loss_gen: 2.7276158332824707 (2.249792986902698) | > loss_kl: 0.8704389929771423 (0.8349403831465491) | > loss_feat: 6.5304718017578125 (5.837322335433344) | > loss_mel: 24.516281127929688 (21.581099892484733) | > loss_duration: 1.3976637125015259 (1.4384880888051) | > loss_1: 36.04247283935547 (31.941643862888732) | > grad_norm_1: tensor(4611.1724, device='cuda:0') (tensor(18168.9707, device='cuda:0')) | > current_lr_0: 0.00010041125478819198 | > current_lr_1: 0.00010041125478819198 | > step_time: 0.5138 (0.6164872235265271) | > loader_time: 0.0056 (0.025062791232405037)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9963374137878418 (1.9963374137878418) | > loss_disc_real_0: 0.280636727809906 (0.280636727809906) | > loss_disc_real_1: 0.19840247929096222 (0.19840247929096222) | > loss_disc_real_2: 0.14500701427459717 (0.14500701427459717) | > loss_disc_real_3: 0.22356495261192322 (0.22356495261192322) | > loss_disc_real_4: 0.09209085255861282 (0.09209085255861282) | > loss_disc_real_5: 0.10566265136003494 (0.10566265136003494) | > loss_0: 1.9963374137878418 (1.9963374137878418) | > loss_gen: 2.4947142601013184 (2.4947142601013184) | > loss_kl: 4.369631290435791 (4.369631290435791) | > loss_feat: 8.859896659851074 (8.859896659851074) | > loss_mel: 23.04513931274414 (23.04513931274414) | > loss_duration: 2.875995635986328 (2.875995635986328) | > loss_1: 41.6453742980957 (41.6453742980957)  --> STEP: 1 | > loss_disc: 2.6695027351379395 (2.6695027351379395) | > loss_disc_real_0: 0.41641515493392944 (0.41641515493392944) | > loss_disc_real_1: 0.35118401050567627 (0.35118401050567627) | > loss_disc_real_2: 0.2033247947692871 (0.2033247947692871) | > loss_disc_real_3: 0.3027522563934326 (0.3027522563934326) | > loss_disc_real_4: 0.3435373306274414 (0.3435373306274414) | > loss_disc_real_5: 0.2334514707326889 (0.2334514707326889) | > loss_0: 2.6695027351379395 (2.6695027351379395) | > loss_gen: 2.749191999435425 (2.749191999435425) | > loss_kl: 4.77747917175293 (4.77747917175293) | > loss_feat: 5.848280906677246 (5.848280906677246) | > loss_mel: 25.83009147644043 (25.83009147644043) | > loss_duration: 3.1679320335388184 (3.1679320335388184) | > loss_1: 42.37297439575195 (42.37297439575195)  --> STEP: 2 | > loss_disc: 3.025312900543213 (2.847407817840576) | > loss_disc_real_0: 0.13653598725795746 (0.27647557109594345) | > loss_disc_real_1: 0.2603995203971863 (0.3057917654514313) | > loss_disc_real_2: 0.2105293571949005 (0.2069270759820938) | > loss_disc_real_3: 0.30999648571014404 (0.30637437105178833) | > loss_disc_real_4: 0.31120479106903076 (0.3273710608482361) | > loss_disc_real_5: 0.263293594121933 (0.24837253242731094) | > loss_0: 3.025312900543213 (2.847407817840576) | > loss_gen: 1.5094558000564575 (2.129323899745941) | > loss_kl: 4.8853864669799805 (4.831432819366455) | > loss_feat: 0.0849086120724678 (2.966594759374857) | > loss_mel: 1.8628623485565186 (13.846476912498474) | > loss_duration: 3.0868020057678223 (3.1273670196533203) | > loss_1: 11.429414749145508 (26.90119457244873)  --> STEP: 3 | > loss_disc: 2.6798996925354004 (2.791571776072184) | > loss_disc_real_0: 0.08351833373308182 (0.21215649197498956) | > loss_disc_real_1: 0.28823933005332947 (0.299940953652064) | > loss_disc_real_2: 0.38482826948165894 (0.26622747381528217) | > loss_disc_real_3: 0.43146660923957825 (0.34807178378105164) | > loss_disc_real_4: 0.27742525935173035 (0.3107224603494008) | > loss_disc_real_5: 0.32519933581352234 (0.2739814668893814) | > loss_0: 2.6798996925354004 (2.791571776072184) | > loss_gen: 2.4913721084594727 (2.250006635983785) | > loss_kl: 2.3993988037109375 (4.020754814147949) | > loss_feat: 4.451453685760498 (3.461547734836737) | > loss_mel: 22.35540771484375 (16.6827871799469) | > loss_duration: 2.9527461528778076 (3.069160064061483) | > loss_1: 34.6503791809082 (29.484256108601887) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028088887532552085 (-0.02116640408833822) | > avg_loss_disc: 2.791571776072184 (+0.09670607248942042) | > avg_loss_disc_real_0: 0.21215649197498956 (-0.02849301074941954) | > avg_loss_disc_real_1: 0.299940953652064 (-0.0793963571389516) | > avg_loss_disc_real_2: 0.26622747381528217 (-0.10444147388140362) | > avg_loss_disc_real_3: 0.34807178378105164 (+0.12518933912118277) | > avg_loss_disc_real_4: 0.3107224603494008 (+0.05008353044589359) | > avg_loss_disc_real_5: 0.2739814668893814 (+0.013049708058436693) | > avg_loss_0: 2.791571776072184 (+0.09670607248942042) | > avg_loss_gen: 2.250006635983785 (-0.49862658977508545) | > avg_loss_kl: 4.020754814147949 (+0.03197050094604492) | > avg_loss_feat: 3.461547734836737 (-4.235091326137384) | > avg_loss_mel: 16.6827871799469 (-5.6412376562754325) | > avg_loss_duration: 3.069160064061483 (+0.042465130488078096) | > avg_loss_1: 29.484256108601887 (-10.300519943237308)  > EPOCH: 690/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:46:52)   --> TIME: 2023-10-20 07:47:06 -- STEP: 9/50 -- GLOBAL_STEP: 87510 | > loss_disc: 2.1735846996307373 (2.234486712349786) | > loss_disc_real_0: 0.10138806700706482 (0.13735714223649767) | > loss_disc_real_1: 0.26936912536621094 (0.20037256181240082) | > loss_disc_real_2: 0.25070396065711975 (0.19251416292455462) | > loss_disc_real_3: 0.2570743262767792 (0.22898529552751118) | > loss_disc_real_4: 0.2375066578388214 (0.21020661925690043) | > loss_disc_real_5: 0.19986790418624878 (0.22068949912985167) | > loss_0: 2.1735846996307373 (2.234486712349786) | > grad_norm_0: tensor(269.0071, device='cuda:0') (tensor(561.4073, device='cuda:0')) | > loss_gen: 2.544271945953369 (2.5022678905063205) | > loss_kl: 0.7191524505615234 (0.9725676112704806) | > loss_feat: 4.879421234130859 (5.862664870917797) | > loss_mel: 22.252254486083984 (20.085641940434773) | > loss_duration: 1.3890252113342285 (1.42346543735928) | > loss_1: 31.78412437438965 (30.846607738071018) | > grad_norm_1: tensor(2030.5852, device='cuda:0') (tensor(24540.8223, device='cuda:0')) | > current_lr_0: 0.00010031088745234697 | > current_lr_1: 0.00010031088745234697 | > step_time: 0.7955 (0.7148084375593398) | > loader_time: 0.046 (0.027422136730617948)  --> TIME: 2023-10-20 07:47:20 -- STEP: 39/50 -- GLOBAL_STEP: 87540 | > loss_disc: 2.5134944915771484 (2.293289459668673) | > loss_disc_real_0: 0.08147609233856201 (0.12624176441190335) | > loss_disc_real_1: 0.20708420872688293 (0.20628386926956666) | > loss_disc_real_2: 0.12849852442741394 (0.21112551358647835) | > loss_disc_real_3: 0.1663782149553299 (0.22899630054449424) | > loss_disc_real_4: 0.12702132761478424 (0.20857124257450685) | > loss_disc_real_5: 0.17239296436309814 (0.2274597660662272) | > loss_0: 2.5134944915771484 (2.293289459668673) | > grad_norm_0: tensor(1248.7059, device='cuda:0') (tensor(619.0744, device='cuda:0')) | > loss_gen: 2.4113667011260986 (2.454841522070078) | > loss_kl: 0.19224309921264648 (0.9525955090155969) | > loss_feat: 6.696381568908691 (5.787564028341037) | > loss_mel: 23.514068603515625 (22.28501311937968) | > loss_duration: 1.5019476413726807 (1.4134204723896124) | > loss_1: 34.316009521484375 (32.893434842427574) | > grad_norm_1: tensor(28191.0547, device='cuda:0') (tensor(20583.5059, device='cuda:0')) | > current_lr_0: 0.00010031088745234697 | > current_lr_1: 0.00010031088745234697 | > step_time: 0.3201 (0.5065601422236516) | > loader_time: 0.0223 (0.014682292938232422)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3777995109558105 (2.3777995109558105) | > loss_disc_real_0: 0.04722803831100464 (0.04722803831100464) | > loss_disc_real_1: 0.2528153359889984 (0.2528153359889984) | > loss_disc_real_2: 0.302474707365036 (0.302474707365036) | > loss_disc_real_3: 0.31394442915916443 (0.31394442915916443) | > loss_disc_real_4: 0.26549437642097473 (0.26549437642097473) | > loss_disc_real_5: 0.20395047962665558 (0.20395047962665558) | > loss_0: 2.3777995109558105 (2.3777995109558105) | > loss_gen: 2.31707501411438 (2.31707501411438) | > loss_kl: 4.234304904937744 (4.234304904937744) | > loss_feat: 6.249527454376221 (6.249527454376221) | > loss_mel: 21.285018920898438 (21.285018920898438) | > loss_duration: 2.783301591873169 (2.783301591873169) | > loss_1: 36.86922836303711 (36.86922836303711)  --> STEP: 1 | > loss_disc: 3.035994052886963 (3.035994052886963) | > loss_disc_real_0: 0.16292324662208557 (0.16292324662208557) | > loss_disc_real_1: 0.34130337834358215 (0.34130337834358215) | > loss_disc_real_2: 0.33302825689315796 (0.33302825689315796) | > loss_disc_real_3: 0.3655987083911896 (0.3655987083911896) | > loss_disc_real_4: 0.3593401312828064 (0.3593401312828064) | > loss_disc_real_5: 0.33194777369499207 (0.33194777369499207) | > loss_0: 3.035994052886963 (3.035994052886963) | > loss_gen: 2.0774714946746826 (2.0774714946746826) | > loss_kl: 4.840182304382324 (4.840182304382324) | > loss_feat: 1.9356586933135986 (1.9356586933135986) | > loss_mel: 19.957366943359375 (19.957366943359375) | > loss_duration: 3.0905404090881348 (3.0905404090881348) | > loss_1: 31.90121841430664 (31.90121841430664)  --> STEP: 2 | > loss_disc: 2.9812302589416504 (3.0086121559143066) | > loss_disc_real_0: 0.5167831182479858 (0.3398531824350357) | > loss_disc_real_1: 0.30092012882232666 (0.3211117535829544) | > loss_disc_real_2: 0.4672573506832123 (0.4001428037881851) | > loss_disc_real_3: 0.33047980070114136 (0.34803925454616547) | > loss_disc_real_4: 0.48510265350341797 (0.4222213923931122) | > loss_disc_real_5: 0.29067063331604004 (0.31130920350551605) | > loss_0: 2.9812302589416504 (3.0086121559143066) | > loss_gen: 3.598240375518799 (2.8378559350967407) | > loss_kl: 5.363142967224121 (5.101662635803223) | > loss_feat: 6.907036781311035 (4.421347737312317) | > loss_mel: 22.436424255371094 (21.196895599365234) | > loss_duration: 3.096609115600586 (3.0935747623443604) | > loss_1: 41.401451110839844 (36.65133476257324)  --> STEP: 3 | > loss_disc: 2.9676449298858643 (2.9949564139048257) | > loss_disc_real_0: 0.053881410509347916 (0.24452925845980644) | > loss_disc_real_1: 0.3804033100605011 (0.34087560574213666) | > loss_disc_real_2: 0.3459165394306183 (0.38206738233566284) | > loss_disc_real_3: 0.3643325865268707 (0.35347036520640057) | > loss_disc_real_4: 0.2222485989332199 (0.3555637945731481) | > loss_disc_real_5: 0.3433952331542969 (0.3220045467217763) | > loss_0: 2.9676449298858643 (2.9949564139048257) | > loss_gen: 2.0687882900238037 (2.5815000534057617) | > loss_kl: 2.0703251361846924 (4.091216802597046) | > loss_feat: 3.764336585998535 (4.202344020207723) | > loss_mel: 25.229955673217773 (22.541248957316082) | > loss_duration: 2.895024061203003 (3.027391195297241) | > loss_1: 36.02842712402344 (36.44369888305664) --> EVAL PERFORMANCE | > avg_loader_time: 0.007824977238972982 (+0.0050160884857177734) | > avg_loss_disc: 2.9949564139048257 (+0.2033846378326416) | > avg_loss_disc_real_0: 0.24452925845980644 (+0.03237276648481688) | > avg_loss_disc_real_1: 0.34087560574213666 (+0.04093465209007263) | > avg_loss_disc_real_2: 0.38206738233566284 (+0.11583990852038067) | > avg_loss_disc_real_3: 0.35347036520640057 (+0.005398581425348936) | > avg_loss_disc_real_4: 0.3555637945731481 (+0.04484133422374725) | > avg_loss_disc_real_5: 0.3220045467217763 (+0.0480230798323949) | > avg_loss_0: 2.9949564139048257 (+0.2033846378326416) | > avg_loss_gen: 2.5815000534057617 (+0.3314934174219766) | > avg_loss_kl: 4.091216802597046 (+0.07046198844909668) | > avg_loss_feat: 4.202344020207723 (+0.7407962853709855) | > avg_loss_mel: 22.541248957316082 (+5.8584617773691825) | > avg_loss_duration: 3.027391195297241 (-0.041768868764241684) | > avg_loss_1: 36.44369888305664 (+6.959442774454754)  > EPOCH: 691/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:47:35)   --> TIME: 2023-10-20 07:47:55 -- STEP: 19/50 -- GLOBAL_STEP: 87570 | > loss_disc: 2.7658348083496094 (2.566249972895572) | > loss_disc_real_0: 0.1917421519756317 (0.184135230650243) | > loss_disc_real_1: 0.2673622667789459 (0.23519263867484896) | > loss_disc_real_2: 0.23304963111877441 (0.2363259929575418) | > loss_disc_real_3: 0.28531453013420105 (0.26074362114856114) | > loss_disc_real_4: 0.3075026273727417 (0.2641707648964305) | > loss_disc_real_5: 0.30109941959381104 (0.27453538069599553) | > loss_0: 2.7658348083496094 (2.566249972895572) | > grad_norm_0: tensor(820.4307, device='cuda:0') (tensor(723.5170, device='cuda:0')) | > loss_gen: 1.806559681892395 (2.239942343611466) | > loss_kl: 1.0809534788131714 (0.8372554826109033) | > loss_feat: 0.9709668755531311 (4.04329524071593) | > loss_mel: 11.970407485961914 (20.404196739196777) | > loss_duration: 1.5052276849746704 (1.4604598911185014) | > loss_1: 17.33411407470703 (28.985149383544922) | > grad_norm_1: tensor(4625.0049, device='cuda:0') (tensor(13654.8506, device='cuda:0')) | > current_lr_0: 0.00010021062043993806 | > current_lr_1: 0.00010021062043993806 | > step_time: 0.8364 (0.6350583779184442) | > loader_time: 0.025 (0.022006988525390625)  --> TIME: 2023-10-20 07:48:15 -- STEP: 49/50 -- GLOBAL_STEP: 87600 | > loss_disc: 2.4619202613830566 (2.4956586920485204) | > loss_disc_real_0: 0.12279003113508224 (0.15819715258038172) | > loss_disc_real_1: 0.19561053812503815 (0.21994749152538728) | > loss_disc_real_2: 0.2212567925453186 (0.22466466169120097) | > loss_disc_real_3: 0.3550056219100952 (0.24439536890357125) | > loss_disc_real_4: 0.31058982014656067 (0.25485699395744166) | > loss_disc_real_5: 0.33931484818458557 (0.2506337230454903) | > loss_0: 2.4619202613830566 (2.4956586920485204) | > grad_norm_0: tensor(1251.4813, device='cuda:0') (tensor(784.4818, device='cuda:0')) | > loss_gen: 2.585392713546753 (2.2752210461363513) | > loss_kl: 0.5549288988113403 (0.8183891998261822) | > loss_feat: 5.110126972198486 (4.846646363447819) | > loss_mel: 23.532283782958984 (20.305430018171975) | > loss_duration: 1.6022374629974365 (1.427514404666667) | > loss_1: 33.38496780395508 (29.673201084136963) | > grad_norm_1: tensor(8903.0977, device='cuda:0') (tensor(19676.6406, device='cuda:0')) | > current_lr_0: 0.00010021062043993806 | > current_lr_1: 0.00010021062043993806 | > step_time: 0.3105 (0.6085683277675082) | > loader_time: 0.6135 (0.034819948429964026)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5460166931152344 (2.5460166931152344) | > loss_disc_real_0: 0.10556158423423767 (0.10556158423423767) | > loss_disc_real_1: 0.3551352620124817 (0.3551352620124817) | > loss_disc_real_2: 0.3481212556362152 (0.3481212556362152) | > loss_disc_real_3: 0.37914711236953735 (0.37914711236953735) | > loss_disc_real_4: 0.2517494559288025 (0.2517494559288025) | > loss_disc_real_5: 0.2571117579936981 (0.2571117579936981) | > loss_0: 2.5460166931152344 (2.5460166931152344) | > loss_gen: 2.957576274871826 (2.957576274871826) | > loss_kl: 4.028400421142578 (4.028400421142578) | > loss_feat: 6.696440696716309 (6.696440696716309) | > loss_mel: 21.8034610748291 (21.8034610748291) | > loss_duration: 2.7731053829193115 (2.7731053829193115) | > loss_1: 38.25898361206055 (38.25898361206055)  --> STEP: 1 | > loss_disc: 2.265171766281128 (2.265171766281128) | > loss_disc_real_0: 0.19561558961868286 (0.19561558961868286) | > loss_disc_real_1: 0.3662036955356598 (0.3662036955356598) | > loss_disc_real_2: 0.22778765857219696 (0.22778765857219696) | > loss_disc_real_3: 0.19270913302898407 (0.19270913302898407) | > loss_disc_real_4: 0.2317909300327301 (0.2317909300327301) | > loss_disc_real_5: 0.16630685329437256 (0.16630685329437256) | > loss_0: 2.265171766281128 (2.265171766281128) | > loss_gen: 2.768465518951416 (2.768465518951416) | > loss_kl: 4.515399932861328 (4.515399932861328) | > loss_feat: 6.420952796936035 (6.420952796936035) | > loss_mel: 22.95058250427246 (22.95058250427246) | > loss_duration: 3.196629524230957 (3.196629524230957) | > loss_1: 39.85203170776367 (39.85203170776367)  --> STEP: 2 | > loss_disc: 3.5226030349731445 (2.8938874006271362) | > loss_disc_real_0: 0.48861294984817505 (0.34211426973342896) | > loss_disc_real_1: 0.5026039481163025 (0.43440382182598114) | > loss_disc_real_2: 0.5407549142837524 (0.3842712864279747) | > loss_disc_real_3: 0.36845919489860535 (0.2805841639637947) | > loss_disc_real_4: 0.4344489574432373 (0.3331199437379837) | > loss_disc_real_5: 0.32796671986579895 (0.24713678658008575) | > loss_0: 3.5226030349731445 (2.8938874006271362) | > loss_gen: 2.598515748977661 (2.6834906339645386) | > loss_kl: 4.926532745361328 (4.720966339111328) | > loss_feat: 5.981014728546143 (6.200983762741089) | > loss_mel: 24.07979965209961 (23.515191078186035) | > loss_duration: 3.0399162769317627 (3.11827290058136) | > loss_1: 40.62577819824219 (40.23890495300293)  --> STEP: 3 | > loss_disc: 3.049912929534912 (2.9458959102630615) | > loss_disc_real_0: 0.15889376401901245 (0.2810407678286235) | > loss_disc_real_1: 0.2809842824935913 (0.3832639753818512) | > loss_disc_real_2: 0.25423571467399597 (0.3409260958433151) | > loss_disc_real_3: 0.2819337248802185 (0.28103401760260266) | > loss_disc_real_4: 0.2285841405391693 (0.2982746760050456) | > loss_disc_real_5: 0.27714622020721436 (0.257139931122462) | > loss_0: 3.049912929534912 (2.9458959102630615) | > loss_gen: 1.4682852029800415 (2.278422156969706) | > loss_kl: 2.305635690689087 (3.915856122970581) | > loss_feat: 0.04736919701099396 (4.149778907497724) | > loss_mel: 2.1575403213500977 (16.395974159240723) | > loss_duration: 2.7376482486724854 (2.991398016611735) | > loss_1: 8.71647834777832 (29.73142941792806) --> EVAL PERFORMANCE | > avg_loader_time: 0.021664539972941082 (+0.0138395627339681) | > avg_loss_disc: 2.9458959102630615 (-0.049060503641764175) | > avg_loss_disc_real_0: 0.2810407678286235 (+0.03651150936881703) | > avg_loss_disc_real_1: 0.3832639753818512 (+0.04238836963971454) | > avg_loss_disc_real_2: 0.3409260958433151 (-0.04114128649234772) | > avg_loss_disc_real_3: 0.28103401760260266 (-0.07243634760379791) | > avg_loss_disc_real_4: 0.2982746760050456 (-0.05728911856810248) | > avg_loss_disc_real_5: 0.257139931122462 (-0.06486461559931433) | > avg_loss_0: 2.9458959102630615 (-0.049060503641764175) | > avg_loss_gen: 2.278422156969706 (-0.30307789643605565) | > avg_loss_kl: 3.915856122970581 (-0.17536067962646484) | > avg_loss_feat: 4.149778907497724 (-0.052565112709999084) | > avg_loss_mel: 16.395974159240723 (-6.145274798075359) | > avg_loss_duration: 2.991398016611735 (-0.03599317868550633) | > avg_loss_1: 29.73142941792806 (-6.712269465128582)  > EPOCH: 692/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:48:31)   --> TIME: 2023-10-20 07:48:57 -- STEP: 29/50 -- GLOBAL_STEP: 87630 | > loss_disc: 2.4710910320281982 (2.3490526573411348) | > loss_disc_real_0: 0.10815870761871338 (0.12262691078900265) | > loss_disc_real_1: 0.0980808436870575 (0.21439548132234607) | > loss_disc_real_2: 0.1633623093366623 (0.2296000567489657) | > loss_disc_real_3: 0.1557779461145401 (0.22746845720143155) | > loss_disc_real_4: 0.38153374195098877 (0.22559984323793444) | > loss_disc_real_5: 0.3055787980556488 (0.20844253049842243) | > loss_0: 2.4710910320281982 (2.3490526573411348) | > grad_norm_0: tensor(930.0128, device='cuda:0') (tensor(603.6245, device='cuda:0')) | > loss_gen: 2.384831428527832 (2.446736685160933) | > loss_kl: 0.7142844200134277 (0.9191279729892468) | > loss_feat: 8.639901161193848 (6.596029807781351) | > loss_mel: 23.2451171875 (24.717890377702386) | > loss_duration: 1.3849257230758667 (1.4286594596402398) | > loss_1: 36.36906051635742 (36.108443753472685) | > grad_norm_1: tensor(49485.7188, device='cuda:0') (tensor(23786.4824, device='cuda:0')) | > current_lr_0: 0.0001001104536506857 | > current_lr_1: 0.0001001104536506857 | > step_time: 0.5956 (0.5946492819950497) | > loader_time: 0.0265 (0.025171945834981984)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.968911647796631 (2.968911647796631) | > loss_disc_real_0: 0.14537681639194489 (0.14537681639194489) | > loss_disc_real_1: 0.2650916576385498 (0.2650916576385498) | > loss_disc_real_2: 0.3075123429298401 (0.3075123429298401) | > loss_disc_real_3: 0.2589268684387207 (0.2589268684387207) | > loss_disc_real_4: 0.2455517053604126 (0.2455517053604126) | > loss_disc_real_5: 0.2546333968639374 (0.2546333968639374) | > loss_0: 2.968911647796631 (2.968911647796631) | > loss_gen: 1.534814476966858 (1.534814476966858) | > loss_kl: 4.728147506713867 (4.728147506713867) | > loss_feat: 0.7560234069824219 (0.7560234069824219) | > loss_mel: 18.522565841674805 (18.522565841674805) | > loss_duration: 2.7882957458496094 (2.7882957458496094) | > loss_1: 28.32984733581543 (28.32984733581543)  --> STEP: 1 | > loss_disc: 2.6741878986358643 (2.6741878986358643) | > loss_disc_real_0: 0.08606875687837601 (0.08606875687837601) | > loss_disc_real_1: 0.25949719548225403 (0.25949719548225403) | > loss_disc_real_2: 0.2053372859954834 (0.2053372859954834) | > loss_disc_real_3: 0.1671552211046219 (0.1671552211046219) | > loss_disc_real_4: 0.07330600172281265 (0.07330600172281265) | > loss_disc_real_5: 0.10856539756059647 (0.10856539756059647) | > loss_0: 2.6741878986358643 (2.6741878986358643) | > loss_gen: 1.608466386795044 (1.608466386795044) | > loss_kl: 4.731828689575195 (4.731828689575195) | > loss_feat: 6.428519248962402 (6.428519248962402) | > loss_mel: 25.903301239013672 (25.903301239013672) | > loss_duration: 3.120528221130371 (3.120528221130371) | > loss_1: 41.79264450073242 (41.79264450073242)  --> STEP: 2 | > loss_disc: 1.8786110877990723 (2.2763994932174683) | > loss_disc_real_0: 0.03544691950082779 (0.0607578381896019) | > loss_disc_real_1: 0.20783790946006775 (0.2336675524711609) | > loss_disc_real_2: 0.12921352684497833 (0.16727540642023087) | > loss_disc_real_3: 0.3779238164424896 (0.27253951877355576) | > loss_disc_real_4: 0.18168096244335175 (0.1274934820830822) | > loss_disc_real_5: 0.09466691315174103 (0.10161615535616875) | > loss_0: 1.8786110877990723 (2.2763994932174683) | > loss_gen: 2.65610933303833 (2.132287859916687) | > loss_kl: 5.466090679168701 (5.098959684371948) | > loss_feat: 9.72952938079834 (8.079024314880371) | > loss_mel: 23.605539321899414 (24.754420280456543) | > loss_duration: 2.9496512413024902 (3.0350897312164307) | > loss_1: 44.406917572021484 (43.09978103637695)  --> STEP: 3 | > loss_disc: 3.041621685028076 (2.5314735571543374) | > loss_disc_real_0: 0.16119909286499023 (0.09423825641473134) | > loss_disc_real_1: 0.2563694417476654 (0.24123484889666238) | > loss_disc_real_2: 0.32326987385749817 (0.2192735622326533) | > loss_disc_real_3: 0.2628253102302551 (0.2693014492591222) | > loss_disc_real_4: 0.2516293227672577 (0.16887209564447403) | > loss_disc_real_5: 0.25535106658935547 (0.152861125767231) | > loss_0: 3.041621685028076 (2.5314735571543374) | > loss_gen: 1.508642554283142 (1.9244060913721721) | > loss_kl: 2.300581932067871 (4.166167100270589) | > loss_feat: 0.10328194499015808 (5.4204435249169665) | > loss_mel: 2.9523890018463135 (17.4870765209198) | > loss_duration: 2.9248623847961426 (2.998347282409668) | > loss_1: 9.78975772857666 (31.996439933776855) --> EVAL PERFORMANCE | > avg_loader_time: 0.004884640375773112 (-0.01677989959716797) | > avg_loss_disc: 2.5314735571543374 (-0.4144223531087241) | > avg_loss_disc_real_0: 0.09423825641473134 (-0.18680251141389215) | > avg_loss_disc_real_1: 0.24123484889666238 (-0.1420291264851888) | > avg_loss_disc_real_2: 0.2192735622326533 (-0.12165253361066183) | > avg_loss_disc_real_3: 0.2693014492591222 (-0.011732568343480465) | > avg_loss_disc_real_4: 0.16887209564447403 (-0.12940258036057156) | > avg_loss_disc_real_5: 0.152861125767231 (-0.10427880535523099) | > avg_loss_0: 2.5314735571543374 (-0.4144223531087241) | > avg_loss_gen: 1.9244060913721721 (-0.35401606559753396) | > avg_loss_kl: 4.166167100270589 (+0.25031097730000784) | > avg_loss_feat: 5.4204435249169665 (+1.2706646174192429) | > avg_loss_mel: 17.4870765209198 (+1.0911023616790771) | > avg_loss_duration: 2.998347282409668 (+0.006949265797933091) | > avg_loss_1: 31.996439933776855 (+2.2650105158487968)  > EPOCH: 693/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:49:25)   --> TIME: 2023-10-20 07:49:35 -- STEP: 9/50 -- GLOBAL_STEP: 87660 | > loss_disc: 3.165489673614502 (2.6965722772810192) | > loss_disc_real_0: 0.3707740306854248 (0.19831974763009283) | > loss_disc_real_1: 0.19972704350948334 (0.21831187730034193) | > loss_disc_real_2: 0.2780504822731018 (0.24572289321157667) | > loss_disc_real_3: 0.2794893682003021 (0.27266790221134823) | > loss_disc_real_4: 0.31881868839263916 (0.22304177035888037) | > loss_disc_real_5: 0.29523202776908875 (0.20725064957514405) | > loss_0: 3.165489673614502 (2.6965722772810192) | > grad_norm_0: tensor(616.7700, device='cuda:0') (tensor(547.4032, device='cuda:0')) | > loss_gen: 2.0765464305877686 (2.032386369175381) | > loss_kl: 0.9216064810752869 (0.8055839422676299) | > loss_feat: 4.854357719421387 (4.516384742740128) | > loss_mel: 23.109996795654297 (17.487908548778957) | > loss_duration: 1.3834221363067627 (1.433350404103597) | > loss_1: 32.34592819213867 (26.27561357286241) | > grad_norm_1: tensor(10168.0303, device='cuda:0') (tensor(17446.2578, device='cuda:0')) | > current_lr_0: 0.00010001038698441058 | > current_lr_1: 0.00010001038698441058 | > step_time: 0.5353 (0.46006051699320477) | > loader_time: 0.0268 (0.015035576290554471)  --> TIME: 2023-10-20 07:49:52 -- STEP: 39/50 -- GLOBAL_STEP: 87690 | > loss_disc: 2.5426511764526367 (2.5799842064197245) | > loss_disc_real_0: 0.09093938022851944 (0.16042852416061437) | > loss_disc_real_1: 0.2564729154109955 (0.22083395595351854) | > loss_disc_real_2: 0.22503550350666046 (0.23695830981700844) | > loss_disc_real_3: 0.311271995306015 (0.24382395335496995) | > loss_disc_real_4: 0.21561287343502045 (0.23899738987286887) | > loss_disc_real_5: 0.20812682807445526 (0.23964328372564453) | > loss_0: 2.5426511764526367 (2.5799842064197245) | > grad_norm_0: tensor(1254.5533, device='cuda:0') (tensor(809.5497, device='cuda:0')) | > loss_gen: 1.960524559020996 (2.155030235266074) | > loss_kl: 0.5046420097351074 (0.8229539520465411) | > loss_feat: 2.5196774005889893 (4.665809593617152) | > loss_mel: 10.680013656616211 (19.868008656379505) | > loss_duration: 1.4448997974395752 (1.4213675229977338) | > loss_1: 17.109758377075195 (28.933169695047233) | > grad_norm_1: tensor(71281.8984, device='cuda:0') (tensor(23869.8633, device='cuda:0')) | > current_lr_0: 0.00010001038698441058 | > current_lr_1: 0.00010001038698441058 | > step_time: 0.4632 (0.5231171021094689) | > loader_time: 0.0022 (0.016670361543313052)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.577500343322754 (2.577500343322754) | > loss_disc_real_0: 0.24648115038871765 (0.24648115038871765) | > loss_disc_real_1: 0.25187310576438904 (0.25187310576438904) | > loss_disc_real_2: 0.2620883285999298 (0.2620883285999298) | > loss_disc_real_3: 0.2520381808280945 (0.2520381808280945) | > loss_disc_real_4: 0.24291422963142395 (0.24291422963142395) | > loss_disc_real_5: 0.3007112145423889 (0.3007112145423889) | > loss_0: 2.577500343322754 (2.577500343322754) | > loss_gen: 2.1950838565826416 (2.1950838565826416) | > loss_kl: 4.870267868041992 (4.870267868041992) | > loss_feat: 2.5673818588256836 (2.5673818588256836) | > loss_mel: 20.888145446777344 (20.888145446777344) | > loss_duration: 2.8460981845855713 (2.8460981845855713) | > loss_1: 33.36697769165039 (33.36697769165039)  --> STEP: 1 | > loss_disc: 2.957669734954834 (2.957669734954834) | > loss_disc_real_0: 0.4101373553276062 (0.4101373553276062) | > loss_disc_real_1: 0.275044709444046 (0.275044709444046) | > loss_disc_real_2: 0.2728762924671173 (0.2728762924671173) | > loss_disc_real_3: 0.2226363718509674 (0.2226363718509674) | > loss_disc_real_4: 0.17122222483158112 (0.17122222483158112) | > loss_disc_real_5: 0.21073603630065918 (0.21073603630065918) | > loss_0: 2.957669734954834 (2.957669734954834) | > loss_gen: 2.0920183658599854 (2.0920183658599854) | > loss_kl: 4.247776985168457 (4.247776985168457) | > loss_feat: 3.1629951000213623 (3.1629951000213623) | > loss_mel: 16.29640769958496 (16.29640769958496) | > loss_duration: 3.024277687072754 (3.024277687072754) | > loss_1: 28.823474884033203 (28.823474884033203)  --> STEP: 2 | > loss_disc: 2.9725260734558105 (2.9650979042053223) | > loss_disc_real_0: 0.3913606107234955 (0.40074898302555084) | > loss_disc_real_1: 0.28129997849464417 (0.2781723439693451) | > loss_disc_real_2: 0.2957935631275177 (0.2843349277973175) | > loss_disc_real_3: 0.2585820257663727 (0.24060919880867004) | > loss_disc_real_4: 0.2749137878417969 (0.223068006336689) | > loss_disc_real_5: 0.25830039381980896 (0.23451821506023407) | > loss_0: 2.9725260734558105 (2.9650979042053223) | > loss_gen: 1.923361897468567 (2.007690131664276) | > loss_kl: 5.065919399261475 (4.656848192214966) | > loss_feat: 0.5466389656066895 (1.8548170328140259) | > loss_mel: 16.800920486450195 (16.548664093017578) | > loss_duration: 3.1172916889190674 (3.0707846879959106) | > loss_1: 27.454133987426758 (28.13880443572998)  --> STEP: 3 | > loss_disc: 2.5382208824157715 (2.822805563608805) | > loss_disc_real_0: 0.3532319664955139 (0.3849099775155385) | > loss_disc_real_1: 0.38374942541122437 (0.3133647044499715) | > loss_disc_real_2: 0.2579854130744934 (0.2755517562230428) | > loss_disc_real_3: 0.31088876724243164 (0.2640357216199239) | > loss_disc_real_4: 0.17682014405727386 (0.20765205224355063) | > loss_disc_real_5: 0.18118631839752197 (0.21674091617266336) | > loss_0: 2.5382208824157715 (2.822805563608805) | > loss_gen: 2.7797908782958984 (2.2650570472081504) | > loss_kl: 2.156967878341675 (3.823554754257202) | > loss_feat: 4.079428195953369 (2.596354087193807) | > loss_mel: 21.737171173095703 (18.27816645304362) | > loss_duration: 2.8479561805725098 (2.996508518854777) | > loss_1: 33.601314544677734 (29.959641138712566) --> EVAL PERFORMANCE | > avg_loader_time: 0.002639214197794596 (-0.002245426177978516) | > avg_loss_disc: 2.822805563608805 (+0.2913320064544678) | > avg_loss_disc_real_0: 0.3849099775155385 (+0.2906717211008072) | > avg_loss_disc_real_1: 0.3133647044499715 (+0.07212985555330911) | > avg_loss_disc_real_2: 0.2755517562230428 (+0.0562781939903895) | > avg_loss_disc_real_3: 0.2640357216199239 (-0.005265727639198303) | > avg_loss_disc_real_4: 0.20765205224355063 (+0.0387799565990766) | > avg_loss_disc_real_5: 0.21674091617266336 (+0.06387979040543237) | > avg_loss_0: 2.822805563608805 (+0.2913320064544678) | > avg_loss_gen: 2.2650570472081504 (+0.34065095583597826) | > avg_loss_kl: 3.823554754257202 (-0.34261234601338675) | > avg_loss_feat: 2.596354087193807 (-2.8240894377231593) | > avg_loss_mel: 18.27816645304362 (+0.7910899321238212) | > avg_loss_duration: 2.996508518854777 (-0.0018387635548910986) | > avg_loss_1: 29.959641138712566 (-2.036798795064289)  > EPOCH: 694/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:50:12)   --> TIME: 2023-10-20 07:50:29 -- STEP: 19/50 -- GLOBAL_STEP: 87720 | > loss_disc: 3.003049612045288 (2.254559062029186) | > loss_disc_real_0: 0.3369070291519165 (0.14093285500022926) | > loss_disc_real_1: 0.2985422909259796 (0.2290393268983615) | > loss_disc_real_2: 0.2502969205379486 (0.2336794608517697) | > loss_disc_real_3: 0.288337767124176 (0.24035200241364932) | > loss_disc_real_4: 0.2335130125284195 (0.19999957672859492) | > loss_disc_real_5: 0.2614060640335083 (0.20667139886829414) | > loss_0: 3.003049612045288 (2.254559062029186) | > grad_norm_0: tensor(1062.4384, device='cuda:0') (tensor(1378.4873, device='cuda:0')) | > loss_gen: 1.6530098915100098 (2.7123929324902987) | > loss_kl: 1.117570161819458 (0.9331621276704889) | > loss_feat: 0.06767560541629791 (6.591493814595435) | > loss_mel: 1.7103192806243896 (22.094840338355617) | > loss_duration: 1.588706374168396 (1.4870288372039795) | > loss_1: 6.13728141784668 (33.818918203052725) | > grad_norm_1: tensor(45315.7500, device='cuda:0') (tensor(78209.1406, device='cuda:0')) | > current_lr_0: 9.99104203410335e-05 | > current_lr_1: 9.99104203410335e-05 | > step_time: 0.757 (0.6443604419105932) | > loader_time: 0.0279 (0.023599122699938323)  --> TIME: 2023-10-20 07:50:49 -- STEP: 49/50 -- GLOBAL_STEP: 87750 | > loss_disc: 2.35343074798584 (2.4244474938937604) | > loss_disc_real_0: 0.16373668611049652 (0.15209165453074538) | > loss_disc_real_1: 0.17050357162952423 (0.2303789990136818) | > loss_disc_real_2: 0.09104706346988678 (0.22069021405614153) | > loss_disc_real_3: 0.28347745537757874 (0.22669216237810194) | > loss_disc_real_4: 0.16366563737392426 (0.20673358660875535) | > loss_disc_real_5: 0.35867148637771606 (0.22386234540644348) | > loss_0: 2.35343074798584 (2.4244474938937604) | > grad_norm_0: tensor(1092.7716, device='cuda:0') (tensor(1078.0793, device='cuda:0')) | > loss_gen: 2.3302319049835205 (2.3613071052395567) | > loss_kl: 0.48202651739120483 (0.8810385888328358) | > loss_feat: 5.299016952514648 (5.438488421429482) | > loss_mel: 25.53115463256836 (20.743933307881264) | > loss_duration: 1.4866514205932617 (1.4333372359373135) | > loss_1: 35.12908172607422 (30.85810455010862) | > grad_norm_1: tensor(15362.4922, device='cuda:0') (tensor(46765.1836, device='cuda:0')) | > current_lr_0: 9.99104203410335e-05 | > current_lr_1: 9.99104203410335e-05 | > step_time: 0.8452 (0.6334638109012525) | > loader_time: 0.5107 (0.03446948285005531)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.596773386001587 (2.596773386001587) | > loss_disc_real_0: 0.3967416286468506 (0.3967416286468506) | > loss_disc_real_1: 0.1991157978773117 (0.1991157978773117) | > loss_disc_real_2: 0.22613492608070374 (0.22613492608070374) | > loss_disc_real_3: 0.35861968994140625 (0.35861968994140625) | > loss_disc_real_4: 0.3143124580383301 (0.3143124580383301) | > loss_disc_real_5: 0.2185591161251068 (0.2185591161251068) | > loss_0: 2.596773386001587 (2.596773386001587) | > loss_gen: 2.5998313426971436 (2.5998313426971436) | > loss_kl: 4.330990314483643 (4.330990314483643) | > loss_feat: 5.498029708862305 (5.498029708862305) | > loss_mel: 23.25035285949707 (23.25035285949707) | > loss_duration: 2.7255234718322754 (2.7255234718322754) | > loss_1: 38.404727935791016 (38.404727935791016)  --> STEP: 1 | > loss_disc: 3.0996875762939453 (3.0996875762939453) | > loss_disc_real_0: 0.40363752841949463 (0.40363752841949463) | > loss_disc_real_1: 0.30440160632133484 (0.30440160632133484) | > loss_disc_real_2: 0.3050600588321686 (0.3050600588321686) | > loss_disc_real_3: 0.33528444170951843 (0.33528444170951843) | > loss_disc_real_4: 0.2343270182609558 (0.2343270182609558) | > loss_disc_real_5: 0.2714040279388428 (0.2714040279388428) | > loss_0: 3.0996875762939453 (3.0996875762939453) | > loss_gen: 2.289358139038086 (2.289358139038086) | > loss_kl: 5.087520599365234 (5.087520599365234) | > loss_feat: 2.604020118713379 (2.604020118713379) | > loss_mel: 21.035598754882812 (21.035598754882812) | > loss_duration: 3.0235116481781006 (3.0235116481781006) | > loss_1: 34.040008544921875 (34.040008544921875)  --> STEP: 2 | > loss_disc: 1.8854706287384033 (2.4925791025161743) | > loss_disc_real_0: 0.1409572958946228 (0.2722974121570587) | > loss_disc_real_1: 0.15473045408725739 (0.2295660302042961) | > loss_disc_real_2: 0.12092327326536179 (0.21299166604876518) | > loss_disc_real_3: 0.16371990740299225 (0.24950217455625534) | > loss_disc_real_4: 0.09632261097431183 (0.16532481461763382) | > loss_disc_real_5: 0.054810505360364914 (0.16310726664960384) | > loss_0: 1.8854706287384033 (2.4925791025161743) | > loss_gen: 2.384862184524536 (2.337110161781311) | > loss_kl: 5.310349464416504 (5.198935031890869) | > loss_feat: 9.749922752380371 (6.176971435546875) | > loss_mel: 22.460308074951172 (21.747953414916992) | > loss_duration: 2.9289591312408447 (2.9762353897094727) | > loss_1: 42.83440017700195 (38.437204360961914)  --> STEP: 3 | > loss_disc: 2.982362747192383 (2.6558403174082437) | > loss_disc_real_0: 0.2498181164264679 (0.2648043135801951) | > loss_disc_real_1: 0.2959018647670746 (0.2516779750585556) | > loss_disc_real_2: 0.20868432521820068 (0.21155588577191034) | > loss_disc_real_3: 0.2818455696105957 (0.26028330624103546) | > loss_disc_real_4: 0.22725936770439148 (0.18596966564655304) | > loss_disc_real_5: 0.24738949537277222 (0.19120134289065996) | > loss_0: 2.982362747192383 (2.6558403174082437) | > loss_gen: 1.5438729524612427 (2.0726977586746216) | > loss_kl: 2.4118025302886963 (4.269890864690145) | > loss_feat: 0.12126052379608154 (4.158401131629944) | > loss_mel: 2.407189130783081 (15.301031986872355) | > loss_duration: 2.8240602016448975 (2.9255103270212808) | > loss_1: 9.308185577392578 (28.72753143310547) --> EVAL PERFORMANCE | > avg_loader_time: 0.0035965442657470703 (+0.0009573300679524741) | > avg_loss_disc: 2.6558403174082437 (-0.16696524620056152) | > avg_loss_disc_real_0: 0.2648043135801951 (-0.12010566393534339) | > avg_loss_disc_real_1: 0.2516779750585556 (-0.061686729391415895) | > avg_loss_disc_real_2: 0.21155588577191034 (-0.06399587045113245) | > avg_loss_disc_real_3: 0.26028330624103546 (-0.0037524153788884296) | > avg_loss_disc_real_4: 0.18596966564655304 (-0.021682386596997588) | > avg_loss_disc_real_5: 0.19120134289065996 (-0.025539573282003403) | > avg_loss_0: 2.6558403174082437 (-0.16696524620056152) | > avg_loss_gen: 2.0726977586746216 (-0.1923592885335288) | > avg_loss_kl: 4.269890864690145 (+0.4463361104329424) | > avg_loss_feat: 4.158401131629944 (+1.5620470444361367) | > avg_loss_mel: 15.301031986872355 (-2.9771344661712664) | > avg_loss_duration: 2.9255103270212808 (-0.0709981918334961) | > avg_loss_1: 28.72753143310547 (-1.2321097056070975)  > EPOCH: 695/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:51:03)   --> TIME: 2023-10-20 07:51:31 -- STEP: 29/50 -- GLOBAL_STEP: 87780 | > loss_disc: 3.0186104774475098 (2.4631227665934072) | > loss_disc_real_0: 0.22463299334049225 (0.17368943006570997) | > loss_disc_real_1: 0.4208614230155945 (0.23229755563982601) | > loss_disc_real_2: 0.37715256214141846 (0.22325414907315683) | > loss_disc_real_3: 0.24246250092983246 (0.23898970644021855) | > loss_disc_real_4: 0.39218446612358093 (0.23310589070977836) | > loss_disc_real_5: 0.3823552429676056 (0.22612627993883758) | > loss_0: 3.0186104774475098 (2.4631227665934072) | > grad_norm_0: tensor(501.1002, device='cuda:0') (tensor(517.8295, device='cuda:0')) | > loss_gen: 2.5289244651794434 (2.286120570939162) | > loss_kl: 0.8715239763259888 (0.929639583003932) | > loss_feat: 3.3641433715820312 (4.951004289861383) | > loss_mel: 23.104652404785156 (20.68701796696104) | > loss_duration: 1.4150958061218262 (1.4445571365027592) | > loss_1: 31.28434181213379 (30.298339712208715) | > grad_norm_1: tensor(2825.6370, device='cuda:0') (tensor(19840.8828, device='cuda:0')) | > current_lr_0: 9.981055362057534e-05 | > current_lr_1: 9.981055362057534e-05 | > step_time: 0.9588 (0.5929643943391997) | > loader_time: 0.0387 (0.019033777302709127)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4918525218963623 (2.4918525218963623) | > loss_disc_real_0: 0.15234872698783875 (0.15234872698783875) | > loss_disc_real_1: 0.2710951268672943 (0.2710951268672943) | > loss_disc_real_2: 0.23866097629070282 (0.23866097629070282) | > loss_disc_real_3: 0.38065245747566223 (0.38065245747566223) | > loss_disc_real_4: 0.24284325540065765 (0.24284325540065765) | > loss_disc_real_5: 0.24673667550086975 (0.24673667550086975) | > loss_0: 2.4918525218963623 (2.4918525218963623) | > loss_gen: 2.3985369205474854 (2.3985369205474854) | > loss_kl: 4.242758750915527 (4.242758750915527) | > loss_feat: 5.881781578063965 (5.881781578063965) | > loss_mel: 22.501005172729492 (22.501005172729492) | > loss_duration: 2.6852855682373047 (2.6852855682373047) | > loss_1: 37.70936584472656 (37.70936584472656)  --> STEP: 1 | > loss_disc: 3.3326869010925293 (3.3326869010925293) | > loss_disc_real_0: 0.09055911749601364 (0.09055911749601364) | > loss_disc_real_1: 0.18685588240623474 (0.18685588240623474) | > loss_disc_real_2: 0.11008106917142868 (0.11008106917142868) | > loss_disc_real_3: 0.1929982453584671 (0.1929982453584671) | > loss_disc_real_4: 0.13411645591259003 (0.13411645591259003) | > loss_disc_real_5: 0.12799911201000214 (0.12799911201000214) | > loss_0: 3.3326869010925293 (3.3326869010925293) | > loss_gen: 1.1827481985092163 (1.1827481985092163) | > loss_kl: 4.178553104400635 (4.178553104400635) | > loss_feat: 5.396254062652588 (5.396254062652588) | > loss_mel: 24.570480346679688 (24.570480346679688) | > loss_duration: 2.947486400604248 (2.947486400604248) | > loss_1: 38.27552032470703 (38.27552032470703)  --> STEP: 2 | > loss_disc: 2.887028694152832 (3.1098577976226807) | > loss_disc_real_0: 0.27414315938949585 (0.18235113844275475) | > loss_disc_real_1: 0.26764926314353943 (0.22725257277488708) | > loss_disc_real_2: 0.2571328282356262 (0.18360694870352745) | > loss_disc_real_3: 0.28689175844192505 (0.23994500190019608) | > loss_disc_real_4: 0.22365723550319672 (0.17888684570789337) | > loss_disc_real_5: 0.23672005534172058 (0.18235958367586136) | > loss_0: 2.887028694152832 (3.1098577976226807) | > loss_gen: 1.703472375869751 (1.4431102871894836) | > loss_kl: 4.657593727111816 (4.418073415756226) | > loss_feat: 1.092390537261963 (3.2443222999572754) | > loss_mel: 9.909911155700684 (17.240195751190186) | > loss_duration: 2.9786152839660645 (2.9630508422851562) | > loss_1: 20.341981887817383 (29.308751106262207)  --> STEP: 3 | > loss_disc: 2.7819037437438965 (3.000539779663086) | > loss_disc_real_0: 0.2109205424785614 (0.19187427312135696) | > loss_disc_real_1: 0.2968970835208893 (0.25046740969022113) | > loss_disc_real_2: 0.2358204424381256 (0.20101144661506018) | > loss_disc_real_3: 0.27761226892471313 (0.2525007575750351) | > loss_disc_real_4: 0.2612655460834503 (0.2063464124997457) | > loss_disc_real_5: 0.2685248851776123 (0.21108135084311166) | > loss_0: 2.7819037437438965 (3.000539779663086) | > loss_gen: 1.8746047019958496 (1.5869417587916057) | > loss_kl: 2.5527210235595703 (3.7962892850240073) | > loss_feat: 0.978567361831665 (2.4890706539154053) | > loss_mel: 14.49932861328125 (16.326573371887207) | > loss_duration: 2.790473222732544 (2.905524969100952) | > loss_1: 22.695695877075195 (27.10439936319987) --> EVAL PERFORMANCE | > avg_loader_time: 0.012000083923339844 (+0.008403539657592773) | > avg_loss_disc: 3.000539779663086 (+0.34469946225484227) | > avg_loss_disc_real_0: 0.19187427312135696 (-0.07293004045883816) | > avg_loss_disc_real_1: 0.25046740969022113 (-0.0012105653683344708) | > avg_loss_disc_real_2: 0.20101144661506018 (-0.01054443915685016) | > avg_loss_disc_real_3: 0.2525007575750351 (-0.007782548666000366) | > avg_loss_disc_real_4: 0.2063464124997457 (+0.020376746853192657) | > avg_loss_disc_real_5: 0.21108135084311166 (+0.019880007952451706) | > avg_loss_0: 3.000539779663086 (+0.34469946225484227) | > avg_loss_gen: 1.5869417587916057 (-0.4857559998830159) | > avg_loss_kl: 3.7962892850240073 (-0.47360157966613725) | > avg_loss_feat: 2.4890706539154053 (-1.6693304777145386) | > avg_loss_mel: 16.326573371887207 (+1.0255413850148525) | > avg_loss_duration: 2.905524969100952 (-0.019985357920328628) | > avg_loss_1: 27.10439936319987 (-1.6231320699055978)  > EPOCH: 696/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:52:07)   --> TIME: 2023-10-20 07:52:17 -- STEP: 9/50 -- GLOBAL_STEP: 87810 | > loss_disc: 3.117039918899536 (2.479098267025418) | > loss_disc_real_0: 0.11135024577379227 (0.1551893831541141) | > loss_disc_real_1: 0.34577158093452454 (0.24077648421128592) | > loss_disc_real_2: 0.270678848028183 (0.200153026315901) | > loss_disc_real_3: 0.28196099400520325 (0.22066799592640665) | > loss_disc_real_4: 0.24273812770843506 (0.1997161116451025) | > loss_disc_real_5: 0.27568352222442627 (0.22060660438405144) | > loss_0: 3.117039918899536 (2.479098267025418) | > grad_norm_0: tensor(575.1824, device='cuda:0') (tensor(656.9794, device='cuda:0')) | > loss_gen: 2.1045379638671875 (2.212160348892212) | > loss_kl: 0.700882077217102 (0.9459493822521634) | > loss_feat: 4.95542573928833 (6.20787250995636) | > loss_mel: 23.645065307617188 (23.834777408176) | > loss_duration: 1.411625862121582 (1.4231785933176677) | > loss_1: 32.817535400390625 (34.6239382425944) | > grad_norm_1: tensor(7703.7603, device='cuda:0') (tensor(11990.0811, device='cuda:0')) | > current_lr_0: 9.971078672315687e-05 | > current_lr_1: 9.971078672315687e-05 | > step_time: 0.5633 (0.4750690195295546) | > loader_time: 0.0302 (0.015302552117241753)  --> TIME: 2023-10-20 07:52:35 -- STEP: 39/50 -- GLOBAL_STEP: 87840 | > loss_disc: 3.0416436195373535 (2.493057192900242) | > loss_disc_real_0: 0.13605739176273346 (0.1769490081530351) | > loss_disc_real_1: 0.27123627066612244 (0.22847639845731932) | > loss_disc_real_2: 0.2954750955104828 (0.21581808133767202) | > loss_disc_real_3: 0.27724379301071167 (0.2360635100839994) | > loss_disc_real_4: 0.24374382197856903 (0.22635324409183782) | > loss_disc_real_5: 0.27269086241722107 (0.2269190831635243) | > loss_0: 3.0416436195373535 (2.493057192900242) | > grad_norm_0: tensor(556.4944, device='cuda:0') (tensor(689.2088, device='cuda:0')) | > loss_gen: 1.5134292840957642 (2.2805615021632266) | > loss_kl: 0.5144057869911194 (0.891438073072678) | > loss_feat: 0.012637909501791 (5.175478397749173) | > loss_mel: 0.9241439700126648 (20.349723404798752) | > loss_duration: 1.4626445770263672 (1.413518596918155) | > loss_1: 4.4272613525390625 (30.11071970523932) | > grad_norm_1: tensor(75681.6172, device='cuda:0') (tensor(15505.5215, device='cuda:0')) | > current_lr_0: 9.971078672315687e-05 | > current_lr_1: 9.971078672315687e-05 | > step_time: 1.4241 (0.5616412346179667) | > loader_time: 0.0369 (0.01436322774642553)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.006232738494873 (3.006232738494873) | > loss_disc_real_0: 0.38223788142204285 (0.38223788142204285) | > loss_disc_real_1: 0.2881283462047577 (0.2881283462047577) | > loss_disc_real_2: 0.2884032726287842 (0.2884032726287842) | > loss_disc_real_3: 0.276132732629776 (0.276132732629776) | > loss_disc_real_4: 0.2755782902240753 (0.2755782902240753) | > loss_disc_real_5: 0.26329296827316284 (0.26329296827316284) | > loss_0: 3.006232738494873 (3.006232738494873) | > loss_gen: 1.9145777225494385 (1.9145777225494385) | > loss_kl: 4.611875057220459 (4.611875057220459) | > loss_feat: 2.014106035232544 (2.014106035232544) | > loss_mel: 23.461891174316406 (23.461891174316406) | > loss_duration: 2.8112761974334717 (2.8112761974334717) | > loss_1: 34.813724517822266 (34.813724517822266)  --> STEP: 1 | > loss_disc: 2.1609816551208496 (2.1609816551208496) | > loss_disc_real_0: 0.0960937887430191 (0.0960937887430191) | > loss_disc_real_1: 0.1868453025817871 (0.1868453025817871) | > loss_disc_real_2: 0.22375687956809998 (0.22375687956809998) | > loss_disc_real_3: 0.1850326955318451 (0.1850326955318451) | > loss_disc_real_4: 0.17739401757717133 (0.17739401757717133) | > loss_disc_real_5: 0.22834090888500214 (0.22834090888500214) | > loss_0: 2.1609816551208496 (2.1609816551208496) | > loss_gen: 2.2023606300354004 (2.2023606300354004) | > loss_kl: 4.655257701873779 (4.655257701873779) | > loss_feat: 7.213849067687988 (7.213849067687988) | > loss_mel: 26.22400665283203 (26.22400665283203) | > loss_duration: 3.170504331588745 (3.170504331588745) | > loss_1: 43.465980529785156 (43.465980529785156)  --> STEP: 2 | > loss_disc: 1.7695844173431396 (1.9652830362319946) | > loss_disc_real_0: 0.041486456990242004 (0.06879012286663055) | > loss_disc_real_1: 0.09909122437238693 (0.14296826347708702) | > loss_disc_real_2: 0.1431974321603775 (0.18347715586423874) | > loss_disc_real_3: 0.1710888147354126 (0.17806075513362885) | > loss_disc_real_4: 0.057423438876867294 (0.11740872822701931) | > loss_disc_real_5: 0.1093582808971405 (0.16884959489107132) | > loss_0: 1.7695844173431396 (1.9652830362319946) | > loss_gen: 2.441192150115967 (2.3217763900756836) | > loss_kl: 4.928644180297852 (4.791950941085815) | > loss_feat: 10.91060733795166 (9.062228202819824) | > loss_mel: 24.19247055053711 (25.20823860168457) | > loss_duration: 2.960113286972046 (3.0653088092803955) | > loss_1: 45.43302917480469 (44.44950485229492)  --> STEP: 3 | > loss_disc: 2.350775957107544 (2.0937806765238443) | > loss_disc_real_0: 0.2233133614063263 (0.12029786904652913) | > loss_disc_real_1: 0.38410404324531555 (0.2233468567331632) | > loss_disc_real_2: 0.23083600401878357 (0.19926343858242035) | > loss_disc_real_3: 0.2025422602891922 (0.18622125685214996) | > loss_disc_real_4: 0.17348898947238922 (0.13610214864214262) | > loss_disc_real_5: 0.3415478467941284 (0.22641567885875702) | > loss_0: 2.350775957107544 (2.0937806765238443) | > loss_gen: 2.7851295471191406 (2.4762274424235025) | > loss_kl: 2.0381762981414795 (3.87402606010437) | > loss_feat: 4.91800594329834 (7.680820782979329) | > loss_mel: 24.796646118164062 (25.071041107177734) | > loss_duration: 2.778027296066284 (2.969548304875692) | > loss_1: 37.315982818603516 (42.07166417439779) --> EVAL PERFORMANCE | > avg_loader_time: 0.015391270319620768 (+0.003391186396280924) | > avg_loss_disc: 2.0937806765238443 (-0.9067591031392417) | > avg_loss_disc_real_0: 0.12029786904652913 (-0.07157640407482783) | > avg_loss_disc_real_1: 0.2233468567331632 (-0.027120552957057925) | > avg_loss_disc_real_2: 0.19926343858242035 (-0.0017480080326398306) | > avg_loss_disc_real_3: 0.18622125685214996 (-0.06627950072288513) | > avg_loss_disc_real_4: 0.13610214864214262 (-0.07024426385760307) | > avg_loss_disc_real_5: 0.22641567885875702 (+0.015334328015645354) | > avg_loss_0: 2.0937806765238443 (-0.9067591031392417) | > avg_loss_gen: 2.4762274424235025 (+0.8892856836318968) | > avg_loss_kl: 3.87402606010437 (+0.07773677508036281) | > avg_loss_feat: 7.680820782979329 (+5.191750129063924) | > avg_loss_mel: 25.071041107177734 (+8.744467735290527) | > avg_loss_duration: 2.969548304875692 (+0.06402333577473973) | > avg_loss_1: 42.07166417439779 (+14.967264811197918)  > EPOCH: 697/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:52:53)   --> TIME: 2023-10-20 07:53:10 -- STEP: 19/50 -- GLOBAL_STEP: 87870 | > loss_disc: 1.7727117538452148 (2.237948213752947) | > loss_disc_real_0: 0.0911601111292839 (0.1528392357163523) | > loss_disc_real_1: 0.1023654192686081 (0.21467905217095426) | > loss_disc_real_2: 0.22869428992271423 (0.21558672013251404) | > loss_disc_real_3: 0.11928743869066238 (0.1981975824425095) | > loss_disc_real_4: 0.2493807077407837 (0.2138809399973405) | > loss_disc_real_5: 0.1601470410823822 (0.19848020463005492) | > loss_0: 1.7727117538452148 (2.237948213752947) | > grad_norm_0: tensor(812.1611, device='cuda:0') (tensor(557.0203, device='cuda:0')) | > loss_gen: 3.2304272651672363 (2.5610435009002686) | > loss_kl: 1.0591462850570679 (0.8980827802105954) | > loss_feat: 8.401951789855957 (6.299350997138965) | > loss_mel: 26.415325164794922 (21.259003520011902) | > loss_duration: 1.5386881828308105 (1.4498151917206614) | > loss_1: 40.645538330078125 (32.467296274084795) | > grad_norm_1: tensor(44525.6445, device='cuda:0') (tensor(27988.6426, device='cuda:0')) | > current_lr_0: 9.961111954899872e-05 | > current_lr_1: 9.961111954899872e-05 | > step_time: 0.6906 (0.5996432806316175) | > loader_time: 0.0229 (0.022229859703465513)  --> TIME: 2023-10-20 07:53:40 -- STEP: 49/50 -- GLOBAL_STEP: 87900 | > loss_disc: 2.6077523231506348 (2.319773974467298) | > loss_disc_real_0: 0.17041996121406555 (0.13424460850275902) | > loss_disc_real_1: 0.31161990761756897 (0.2159794520548716) | > loss_disc_real_2: 0.20899353921413422 (0.2114616113201696) | > loss_disc_real_3: 0.3009597957134247 (0.21953745581665818) | > loss_disc_real_4: 0.20896436274051666 (0.23370112155621148) | > loss_disc_real_5: 0.22216548025608063 (0.2179353446604646) | > loss_0: 2.6077523231506348 (2.319773974467298) | > grad_norm_0: tensor(371.5064, device='cuda:0') (tensor(600.1733, device='cuda:0')) | > loss_gen: 1.922810673713684 (2.514834661873019) | > loss_kl: 0.22969797253608704 (0.7610801878024119) | > loss_feat: 1.4925631284713745 (6.1879282185465705) | > loss_mel: 17.700153350830078 (21.443779548820185) | > loss_duration: 1.5175058841705322 (1.4199346255282963) | > loss_1: 22.86273193359375 (32.32755716479556) | > grad_norm_1: tensor(4147.2671, device='cuda:0') (tensor(23996.9609, device='cuda:0')) | > current_lr_0: 9.961111954899872e-05 | > current_lr_1: 9.961111954899872e-05 | > step_time: 1.1223 (0.8001325957629145) | > loader_time: 0.6943 (0.042174222517986686)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4362854957580566 (2.4362854957580566) | > loss_disc_real_0: 0.1002616286277771 (0.1002616286277771) | > loss_disc_real_1: 0.26905107498168945 (0.26905107498168945) | > loss_disc_real_2: 0.22590488195419312 (0.22590488195419312) | > loss_disc_real_3: 0.23809517920017242 (0.23809517920017242) | > loss_disc_real_4: 0.34400424361228943 (0.34400424361228943) | > loss_disc_real_5: 0.3702496588230133 (0.3702496588230133) | > loss_0: 2.4362854957580566 (2.4362854957580566) | > loss_gen: 2.5843935012817383 (2.5843935012817383) | > loss_kl: 4.519400119781494 (4.519400119781494) | > loss_feat: 6.319955825805664 (6.319955825805664) | > loss_mel: 21.821500778198242 (21.821500778198242) | > loss_duration: 2.779513120651245 (2.779513120651245) | > loss_1: 38.02476501464844 (38.02476501464844)  --> STEP: 1 | > loss_disc: 1.6930291652679443 (1.6930291652679443) | > loss_disc_real_0: 0.1008903980255127 (0.1008903980255127) | > loss_disc_real_1: 0.268867552280426 (0.268867552280426) | > loss_disc_real_2: 0.15013764798641205 (0.15013764798641205) | > loss_disc_real_3: 0.19554626941680908 (0.19554626941680908) | > loss_disc_real_4: 0.1306280791759491 (0.1306280791759491) | > loss_disc_real_5: 0.12336737662553787 (0.12336737662553787) | > loss_0: 1.6930291652679443 (1.6930291652679443) | > loss_gen: 2.8773193359375 (2.8773193359375) | > loss_kl: 4.239839553833008 (4.239839553833008) | > loss_feat: 8.471579551696777 (8.471579551696777) | > loss_mel: 21.888519287109375 (21.888519287109375) | > loss_duration: 3.0656096935272217 (3.0656096935272217) | > loss_1: 40.54286575317383 (40.54286575317383)  --> STEP: 2 | > loss_disc: 2.2222142219543457 (1.957621693611145) | > loss_disc_real_0: 0.1844566911458969 (0.1426735445857048) | > loss_disc_real_1: 0.2457110583782196 (0.2572893053293228) | > loss_disc_real_2: 0.21009822189807892 (0.18011793494224548) | > loss_disc_real_3: 0.2501876652240753 (0.2228669673204422) | > loss_disc_real_4: 0.20876862108707428 (0.1696983501315117) | > loss_disc_real_5: 0.17251525819301605 (0.14794131740927696) | > loss_0: 2.2222142219543457 (1.957621693611145) | > loss_gen: 2.817477226257324 (2.847398281097412) | > loss_kl: 4.837186813354492 (4.53851318359375) | > loss_feat: 10.71667194366455 (9.594125747680664) | > loss_mel: 19.73512077331543 (20.811820030212402) | > loss_duration: 2.909579038619995 (2.9875943660736084) | > loss_1: 41.01603698730469 (40.77945137023926)  --> STEP: 3 | > loss_disc: 3.2809500694274902 (2.3987311522165933) | > loss_disc_real_0: 0.46312475204467773 (0.24949061373869577) | > loss_disc_real_1: 0.4697876274585724 (0.328122079372406) | > loss_disc_real_2: 0.3735560476779938 (0.2445973058541616) | > loss_disc_real_3: 0.316853791475296 (0.2541959087053935) | > loss_disc_real_4: 0.14890240132808685 (0.16276636719703674) | > loss_disc_real_5: 0.203331857919693 (0.16640483091274896) | > loss_0: 3.2809500694274902 (2.3987311522165933) | > loss_gen: 2.2912068367004395 (2.662001132965088) | > loss_kl: 1.9190834760665894 (3.6653699477513633) | > loss_feat: 4.314634799957275 (7.834295431772868) | > loss_mel: 24.45822525024414 (22.02728843688965) | > loss_duration: 2.776374340057373 (2.9171876907348633) | > loss_1: 35.759525299072266 (39.10614267985026) --> EVAL PERFORMANCE | > avg_loader_time: 0.006622155507405599 (-0.008769114812215168) | > avg_loss_disc: 2.3987311522165933 (+0.304950475692749) | > avg_loss_disc_real_0: 0.24949061373869577 (+0.12919274469216663) | > avg_loss_disc_real_1: 0.328122079372406 (+0.1047752226392428) | > avg_loss_disc_real_2: 0.2445973058541616 (+0.04533386727174124) | > avg_loss_disc_real_3: 0.2541959087053935 (+0.06797465185324353) | > avg_loss_disc_real_4: 0.16276636719703674 (+0.02666421855489412) | > avg_loss_disc_real_5: 0.16640483091274896 (-0.060010847946008056) | > avg_loss_0: 2.3987311522165933 (+0.304950475692749) | > avg_loss_gen: 2.662001132965088 (+0.18577369054158543) | > avg_loss_kl: 3.6653699477513633 (-0.20865611235300685) | > avg_loss_feat: 7.834295431772868 (+0.153474648793539) | > avg_loss_mel: 22.02728843688965 (-3.043752670288086) | > avg_loss_duration: 2.9171876907348633 (-0.0523606141408286) | > avg_loss_1: 39.10614267985026 (-2.965521494547531)  > EPOCH: 698/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:53:47)   --> TIME: 2023-10-20 07:54:12 -- STEP: 29/50 -- GLOBAL_STEP: 87930 | > loss_disc: 2.8850204944610596 (2.393693369010399) | > loss_disc_real_0: 0.21007861196994781 (0.13286448356791816) | > loss_disc_real_1: 0.3417399525642395 (0.23031649867008472) | > loss_disc_real_2: 0.3525843322277069 (0.22718635278529134) | > loss_disc_real_3: 0.34982556104660034 (0.22854226037603) | > loss_disc_real_4: 0.24783478677272797 (0.20590073448316804) | > loss_disc_real_5: 0.2514103949069977 (0.20435593823163672) | > loss_0: 2.8850204944610596 (2.393693369010399) | > grad_norm_0: tensor(472.3447, device='cuda:0') (tensor(806.8722, device='cuda:0')) | > loss_gen: 2.414731025695801 (2.356214560311416) | > loss_kl: 0.5677527189254761 (0.7814344851107433) | > loss_feat: 4.613312244415283 (5.740428373731416) | > loss_mel: 23.638399124145508 (22.24662612224447) | > loss_duration: 1.405110239982605 (1.445862313796734) | > loss_1: 32.639305114746094 (32.570566407565416) | > grad_norm_1: tensor(4065.1934, device='cuda:0') (tensor(21818.8145, device='cuda:0')) | > current_lr_0: 9.951155199842122e-05 | > current_lr_1: 9.951155199842122e-05 | > step_time: 0.3123 (0.6333113621021139) | > loader_time: 0.0251 (0.0244654786997828)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.616086006164551 (2.616086006164551) | > loss_disc_real_0: 0.12707914412021637 (0.12707914412021637) | > loss_disc_real_1: 0.28087669610977173 (0.28087669610977173) | > loss_disc_real_2: 0.26139986515045166 (0.26139986515045166) | > loss_disc_real_3: 0.10423289984464645 (0.10423289984464645) | > loss_disc_real_4: 0.19183164834976196 (0.19183164834976196) | > loss_disc_real_5: 0.17598311603069305 (0.17598311603069305) | > loss_0: 2.616086006164551 (2.616086006164551) | > loss_gen: 1.7909879684448242 (1.7909879684448242) | > loss_kl: 5.0101213455200195 (5.0101213455200195) | > loss_feat: 9.600439071655273 (9.600439071655273) | > loss_mel: 25.441425323486328 (25.441425323486328) | > loss_duration: 2.893691301345825 (2.893691301345825) | > loss_1: 44.73666763305664 (44.73666763305664)  --> STEP: 1 | > loss_disc: 1.7726552486419678 (1.7726552486419678) | > loss_disc_real_0: 0.058723896741867065 (0.058723896741867065) | > loss_disc_real_1: 0.2606518864631653 (0.2606518864631653) | > loss_disc_real_2: 0.16770054399967194 (0.16770054399967194) | > loss_disc_real_3: 0.1848413050174713 (0.1848413050174713) | > loss_disc_real_4: 0.14411050081253052 (0.14411050081253052) | > loss_disc_real_5: 0.09128928929567337 (0.09128928929567337) | > loss_0: 1.7726552486419678 (1.7726552486419678) | > loss_gen: 2.7176692485809326 (2.7176692485809326) | > loss_kl: 4.747368812561035 (4.747368812561035) | > loss_feat: 8.088855743408203 (8.088855743408203) | > loss_mel: 21.305225372314453 (21.305225372314453) | > loss_duration: 3.1114039421081543 (3.1114039421081543) | > loss_1: 39.970523834228516 (39.970523834228516)  --> STEP: 2 | > loss_disc: 2.0426180362701416 (1.9076366424560547) | > loss_disc_real_0: 0.034414827823638916 (0.04656936228275299) | > loss_disc_real_1: 0.20702987909317017 (0.23384088277816772) | > loss_disc_real_2: 0.17084649205207825 (0.1692735180258751) | > loss_disc_real_3: 0.30393996834754944 (0.24439063668251038) | > loss_disc_real_4: 0.3268973231315613 (0.2355039119720459) | > loss_disc_real_5: 0.3053126633167267 (0.19830097630620003) | > loss_0: 2.0426180362701416 (1.9076366424560547) | > loss_gen: 3.0887231826782227 (2.9031962156295776) | > loss_kl: 4.878754138946533 (4.813061475753784) | > loss_feat: 7.952887058258057 (8.02087140083313) | > loss_mel: 23.9993896484375 (22.652307510375977) | > loss_duration: 3.0106096267700195 (3.061006784439087) | > loss_1: 42.930362701416016 (41.450443267822266)  --> STEP: 3 | > loss_disc: 2.9270832538604736 (2.247452179590861) | > loss_disc_real_0: 0.20655420422554016 (0.09989764293034871) | > loss_disc_real_1: 0.27537405490875244 (0.24768527348836264) | > loss_disc_real_2: 0.32935917377471924 (0.2226354032754898) | > loss_disc_real_3: 0.2902366816997528 (0.25967265168825787) | > loss_disc_real_4: 0.2898547947406769 (0.2536208728949229) | > loss_disc_real_5: 0.2644479274749756 (0.2203499600291252) | > loss_0: 2.9270832538604736 (2.247452179590861) | > loss_gen: 1.7602472305297852 (2.5222132205963135) | > loss_kl: 2.3746917247772217 (4.000271558761597) | > loss_feat: 0.48269349336624146 (5.508145431677501) | > loss_mel: 17.254098892211914 (20.85290463765462) | > loss_duration: 2.8064820766448975 (2.976165215174357) | > loss_1: 24.678213119506836 (35.85969988505045) --> EVAL PERFORMANCE | > avg_loader_time: 0.007585604985555013 (+0.0009634494781494141) | > avg_loss_disc: 2.247452179590861 (-0.15127897262573242) | > avg_loss_disc_real_0: 0.09989764293034871 (-0.14959297080834705) | > avg_loss_disc_real_1: 0.24768527348836264 (-0.08043680588404337) | > avg_loss_disc_real_2: 0.2226354032754898 (-0.021961902578671783) | > avg_loss_disc_real_3: 0.25967265168825787 (+0.00547674298286438) | > avg_loss_disc_real_4: 0.2536208728949229 (+0.09085450569788617) | > avg_loss_disc_real_5: 0.2203499600291252 (+0.05394512911637625) | > avg_loss_0: 2.247452179590861 (-0.15127897262573242) | > avg_loss_gen: 2.5222132205963135 (-0.13978791236877441) | > avg_loss_kl: 4.000271558761597 (+0.3349016110102334) | > avg_loss_feat: 5.508145431677501 (-2.3261500000953674) | > avg_loss_mel: 20.85290463765462 (-1.1743837992350272) | > avg_loss_duration: 2.976165215174357 (+0.05897752443949367) | > avg_loss_1: 35.85969988505045 (-3.2464427947998047)  > EPOCH: 699/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:54:37)   --> TIME: 2023-10-20 07:54:50 -- STEP: 9/50 -- GLOBAL_STEP: 87960 | > loss_disc: 2.8438005447387695 (2.6511204507615833) | > loss_disc_real_0: 0.4190247654914856 (0.17947914906673962) | > loss_disc_real_1: 0.16728892922401428 (0.2085235859784815) | > loss_disc_real_2: 0.3098023533821106 (0.2680397422777282) | > loss_disc_real_3: 0.25120559334754944 (0.24256452338563073) | > loss_disc_real_4: 0.37483346462249756 (0.28923117866118747) | > loss_disc_real_5: 0.5258415341377258 (0.258044071495533) | > loss_0: 2.8438005447387695 (2.6511204507615833) | > grad_norm_0: tensor(673.4642, device='cuda:0') (tensor(759.0156, device='cuda:0')) | > loss_gen: 3.071958541870117 (2.1984211206436157) | > loss_kl: 0.4594287574291229 (0.6400441457000043) | > loss_feat: 5.066833972930908 (4.368917985094918) | > loss_mel: 21.798669815063477 (18.13816735479567) | > loss_duration: 1.3502991199493408 (1.4182271692487929) | > loss_1: 31.747190475463867 (26.763778262668186) | > grad_norm_1: tensor(3422.9890, device='cuda:0') (tensor(18196.6445, device='cuda:0')) | > current_lr_0: 9.941208397184439e-05 | > current_lr_1: 9.941208397184439e-05 | > step_time: 0.3156 (0.5953459739685059) | > loader_time: 0.0041 (0.023902071846856013)  --> TIME: 2023-10-20 07:55:03 -- STEP: 39/50 -- GLOBAL_STEP: 87990 | > loss_disc: 2.7748184204101562 (2.5749891048822646) | > loss_disc_real_0: 0.12711071968078613 (0.16245174369750878) | > loss_disc_real_1: 0.39193645119667053 (0.22286824581141657) | > loss_disc_real_2: 0.22663061320781708 (0.22986145269794342) | > loss_disc_real_3: 0.3086285889148712 (0.2421083614612237) | > loss_disc_real_4: 0.30355313420295715 (0.2443275546702819) | > loss_disc_real_5: 0.2863372564315796 (0.24653937643728194) | > loss_0: 2.7748184204101562 (2.5749891048822646) | > grad_norm_0: tensor(448.8356, device='cuda:0') (tensor(698.5154, device='cuda:0')) | > loss_gen: 2.354151725769043 (2.165704461244438) | > loss_kl: 0.5386060476303101 (0.765403914814576) | > loss_feat: 3.5400917530059814 (4.664783106639217) | > loss_mel: 22.422229766845703 (20.136621820621002) | > loss_duration: 1.471337914466858 (1.413775893358084) | > loss_1: 30.326417922973633 (29.14628907961723) | > grad_norm_1: tensor(13499.9141, device='cuda:0') (tensor(21751.7734, device='cuda:0')) | > current_lr_0: 9.941208397184439e-05 | > current_lr_1: 9.941208397184439e-05 | > step_time: 0.8684 (0.4513757962446947) | > loader_time: 0.022 (0.01134042862134102)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9729809761047363 (2.9729809761047363) | > loss_disc_real_0: 0.17445871233940125 (0.17445871233940125) | > loss_disc_real_1: 0.24385015666484833 (0.24385015666484833) | > loss_disc_real_2: 0.3116947412490845 (0.3116947412490845) | > loss_disc_real_3: 0.38519832491874695 (0.38519832491874695) | > loss_disc_real_4: 0.2511180341243744 (0.2511180341243744) | > loss_disc_real_5: 0.20442968606948853 (0.20442968606948853) | > loss_0: 2.9729809761047363 (2.9729809761047363) | > loss_gen: 1.8506609201431274 (1.8506609201431274) | > loss_kl: 4.562558174133301 (4.562558174133301) | > loss_feat: 5.6216630935668945 (5.6216630935668945) | > loss_mel: 21.393312454223633 (21.393312454223633) | > loss_duration: 2.7623443603515625 (2.7623443603515625) | > loss_1: 36.1905403137207 (36.1905403137207)  --> STEP: 1 | > loss_disc: 2.6431119441986084 (2.6431119441986084) | > loss_disc_real_0: 0.11244382709264755 (0.11244382709264755) | > loss_disc_real_1: 0.23108090460300446 (0.23108090460300446) | > loss_disc_real_2: 0.1921980381011963 (0.1921980381011963) | > loss_disc_real_3: 0.2615288197994232 (0.2615288197994232) | > loss_disc_real_4: 0.1413818895816803 (0.1413818895816803) | > loss_disc_real_5: 0.21784451603889465 (0.21784451603889465) | > loss_0: 2.6431119441986084 (2.6431119441986084) | > loss_gen: 1.8313159942626953 (1.8313159942626953) | > loss_kl: 4.649003028869629 (4.649003028869629) | > loss_feat: 5.255777835845947 (5.255777835845947) | > loss_mel: 23.43240737915039 (23.43240737915039) | > loss_duration: 3.023210287094116 (3.023210287094116) | > loss_1: 38.19171142578125 (38.19171142578125)  --> STEP: 2 | > loss_disc: 2.687206268310547 (2.6651591062545776) | > loss_disc_real_0: 0.20729419589042664 (0.1598690114915371) | > loss_disc_real_1: 0.23451371490955353 (0.232797309756279) | > loss_disc_real_2: 0.20136310160160065 (0.19678056985139847) | > loss_disc_real_3: 0.3367196321487427 (0.29912422597408295) | > loss_disc_real_4: 0.1734202355146408 (0.15740106254816055) | > loss_disc_real_5: 0.17497475445270538 (0.19640963524580002) | > loss_0: 2.687206268310547 (2.6651591062545776) | > loss_gen: 1.881751298904419 (1.8565336465835571) | > loss_kl: 5.515219211578369 (5.082111120223999) | > loss_feat: 6.263659477233887 (5.759718656539917) | > loss_mel: 22.813081741333008 (23.1227445602417) | > loss_duration: 3.0279700756073 (3.025590181350708) | > loss_1: 39.50168228149414 (38.846696853637695)  --> STEP: 3 | > loss_disc: 2.0428667068481445 (2.457728306452433) | > loss_disc_real_0: 0.04693484306335449 (0.1222242886821429) | > loss_disc_real_1: 0.21347202360630035 (0.2263555477062861) | > loss_disc_real_2: 0.16050803661346436 (0.18468972543875375) | > loss_disc_real_3: 0.09255638718605042 (0.23026827971140543) | > loss_disc_real_4: 0.12363864481449127 (0.14614692330360413) | > loss_disc_real_5: 0.06525236368179321 (0.15269054472446442) | > loss_0: 2.0428667068481445 (2.457728306452433) | > loss_gen: 1.9470881223678589 (1.886718471844991) | > loss_kl: 2.2871742248535156 (4.150465488433838) | > loss_feat: 6.09304666519165 (5.870827992757161) | > loss_mel: 22.052799224853516 (22.766096115112305) | > loss_duration: 2.868424654006958 (2.9732016722361245) | > loss_1: 35.248531341552734 (37.647308349609375) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_88000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.999631404876709 (2.593204081058502) | > loss_disc_real_0: 0.0819423645734787 (0.11215380765497684) | > loss_disc_real_1: 0.20350369811058044 (0.2206425853073597) | > loss_disc_real_2: 0.11988139152526855 (0.16848764196038246) | > loss_disc_real_3: 0.1503705382347107 (0.21029384434223175) | > loss_disc_real_4: 0.06900662183761597 (0.1268618479371071) | > loss_disc_real_5: 0.0520627424120903 (0.1275335941463709) | > loss_0: 2.999631404876709 (2.593204081058502) | > loss_gen: 1.22865629196167 (1.7222029268741608) | > loss_kl: 4.282613754272461 (4.183502554893494) | > loss_feat: 8.785324096679688 (6.599452018737793) | > loss_mel: 22.636754989624023 (22.733760833740234) | > loss_duration: 2.725229024887085 (2.9112085103988647) | > loss_1: 39.65857696533203 (38.15012550354004)  --> STEP: 1 | > loss_disc: 3.0824532508850098 (2.6910539150238035) | > loss_disc_real_0: 0.3024057149887085 (0.15020418912172318) | > loss_disc_real_1: 0.2908188998699188 (0.23467784821987153) | > loss_disc_real_2: 0.3283432722091675 (0.20045876801013945) | > loss_disc_real_3: 0.2867891490459442 (0.22559290528297424) | > loss_disc_real_4: 0.3077217936515808 (0.16303383708000183) | > loss_disc_real_5: 0.35139527916908264 (0.17230593115091325) | > loss_0: 3.0824532508850098 (2.6910539150238035) | > loss_gen: 1.9759275913238525 (1.772947859764099) | > loss_kl: 4.094500541687012 (4.165702152252197) | > loss_feat: 1.6820898056030273 (5.61597957611084) | > loss_mel: 20.426130294799805 (22.27223472595215) | > loss_duration: 2.9810268878936768 (2.9251721858978272) | > loss_1: 31.15967559814453 (36.752035522460936)  --> STEP: 2 | > loss_disc: 2.998213291168213 (2.742247144381205) | > loss_disc_real_0: 0.3220515549182892 (0.17884541675448418) | > loss_disc_real_1: 0.28204047679901123 (0.24257161964972815) | > loss_disc_real_2: 0.259922593832016 (0.2103694056471189) | > loss_disc_real_3: 0.27834567427635193 (0.2343850334485372) | > loss_disc_real_4: 0.23103976249694824 (0.17436815798282623) | > loss_disc_real_5: 0.33247748017311096 (0.19900118932127953) | > loss_0: 2.998213291168213 (2.742247144381205) | > loss_gen: 1.7408584356307983 (1.767599622408549) | > loss_kl: 5.14847469329834 (4.329497575759888) | > loss_feat: 0.08594408631324768 (4.694306994477908) | > loss_mel: 1.8935648202896118 (18.87578974167506) | > loss_duration: 3.084451675415039 (2.9517187674840293) | > loss_1: 11.953293800354004 (32.61891190210978)  --> STEP: 3 | > loss_disc: 2.7153074741363525 (2.738398620060512) | > loss_disc_real_0: 0.22257818281650543 (0.18509295476334436) | > loss_disc_real_1: 0.30629920959472656 (0.2516755610704422) | > loss_disc_real_2: 0.3829401135444641 (0.2350223639181682) | > loss_disc_real_3: 0.30387917160987854 (0.24431276747158595) | > loss_disc_real_4: 0.2142648994922638 (0.18006769248417445) | > loss_disc_real_5: 0.24749942123889923 (0.20592950816665376) | > loss_0: 2.7153074741363525 (2.738398620060512) | > loss_gen: 2.334028959274292 (1.8485180991036552) | > loss_kl: 2.583076238632202 (4.080008813313076) | > loss_feat: 3.500718116760254 (4.5237942976611) | > loss_mel: 17.307954788208008 (18.651813319751195) | > loss_duration: 2.763129234313965 (2.9247774056025913) | > loss_1: 28.488906860351562 (32.02891118185861) --> EVAL PERFORMANCE | > avg_loader_time: 0.42218382017953054 (+0.41459821519397555) | > avg_loss_disc: 2.738398620060512 (+0.4909464404696511) | > avg_loss_disc_real_0: 0.18509295476334436 (+0.08519531183299565) | > avg_loss_disc_real_1: 0.2516755610704422 (+0.00399028758207956) | > avg_loss_disc_real_2: 0.2350223639181682 (+0.012386960642678385) | > avg_loss_disc_real_3: 0.24431276747158595 (-0.01535988421667192) | > avg_loss_disc_real_4: 0.18006769248417445 (-0.07355318041074846) | > avg_loss_disc_real_5: 0.20592950816665376 (-0.014420451862471456) | > avg_loss_0: 2.738398620060512 (+0.4909464404696511) | > avg_loss_gen: 1.8485180991036552 (-0.6736951214926583) | > avg_loss_kl: 4.080008813313076 (+0.07973725455147918) | > avg_loss_feat: 4.5237942976611 (-0.9843511340164008) | > avg_loss_mel: 18.651813319751195 (-2.201091317903426) | > avg_loss_duration: 2.9247774056025913 (-0.0513878095717657) | > avg_loss_1: 32.02891118185861 (-3.8307887031918426)  > EPOCH: 700/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:55:36)   --> TIME: 2023-10-20 07:56:02 -- STEP: 19/50 -- GLOBAL_STEP: 88020 | > loss_disc: 1.7791924476623535 (2.3794742007004586) | > loss_disc_real_0: 0.06055395305156708 (0.16123494917624875) | > loss_disc_real_1: 0.10962305963039398 (0.22716957467951274) | > loss_disc_real_2: 0.12220531702041626 (0.2213670698631751) | > loss_disc_real_3: 0.07336757332086563 (0.2319299745324411) | > loss_disc_real_4: 0.23442204296588898 (0.2207260574949415) | > loss_disc_real_5: 0.18504415452480316 (0.21272728092184193) | > loss_0: 1.7791924476623535 (2.3794742007004586) | > grad_norm_0: tensor(478.6033, device='cuda:0') (tensor(575.6534, device='cuda:0')) | > loss_gen: 2.5361268520355225 (2.440464051146256) | > loss_kl: 0.9282519221305847 (0.8421123937556618) | > loss_feat: 8.019410133361816 (5.475514900527503) | > loss_mel: 22.428388595581055 (19.3715080462004) | > loss_duration: 1.5256389379501343 (1.4628066263700787) | > loss_1: 35.43781661987305 (29.592405871341104) | > grad_norm_1: tensor(23284.7539, device='cuda:0') (tensor(25133.3594, device='cuda:0')) | > current_lr_0: 9.931271536978773e-05 | > current_lr_1: 9.931271536978773e-05 | > step_time: 0.7682 (0.7001893018421373) | > loader_time: 0.0254 (0.024505414460834703)  --> TIME: 2023-10-20 07:56:19 -- STEP: 49/50 -- GLOBAL_STEP: 88050 | > loss_disc: 2.2141451835632324 (2.46322193437693) | > loss_disc_real_0: 0.010496722534298897 (0.14088368267581172) | > loss_disc_real_1: 0.20900188386440277 (0.23752607587648897) | > loss_disc_real_2: 0.15918634831905365 (0.2385030778467047) | > loss_disc_real_3: 0.21587321162223816 (0.2384930410403378) | > loss_disc_real_4: 0.2535415291786194 (0.2271852057655247) | > loss_disc_real_5: 0.2668667733669281 (0.23986952976152606) | > loss_0: 2.2141451835632324 (2.46322193437693) | > grad_norm_0: tensor(569.6473, device='cuda:0') (tensor(637.7291, device='cuda:0')) | > loss_gen: 2.3718032836914062 (2.3566554273877824) | > loss_kl: 0.4625628590583801 (0.7900754724230085) | > loss_feat: 3.0069663524627686 (5.076237230580679) | > loss_mel: 23.801950454711914 (20.440645568224845) | > loss_duration: 1.507015347480774 (1.4229008008022697) | > loss_1: 31.150299072265625 (30.086514648126098) | > grad_norm_1: tensor(7233.0718, device='cuda:0') (tensor(21541.1836, device='cuda:0')) | > current_lr_0: 9.931271536978773e-05 | > current_lr_1: 9.931271536978773e-05 | > step_time: 0.3488 (0.5917594335517103) | > loader_time: 0.3969 (0.027756978054435884)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.880945920944214 (2.880945920944214) | > loss_disc_real_0: 0.2058674842119217 (0.2058674842119217) | > loss_disc_real_1: 0.31639549136161804 (0.31639549136161804) | > loss_disc_real_2: 0.4081151783466339 (0.4081151783466339) | > loss_disc_real_3: 0.3510657548904419 (0.3510657548904419) | > loss_disc_real_4: 0.2514883875846863 (0.2514883875846863) | > loss_disc_real_5: 0.19025066494941711 (0.19025066494941711) | > loss_0: 2.880945920944214 (2.880945920944214) | > loss_gen: 2.099414825439453 (2.099414825439453) | > loss_kl: 4.560174465179443 (4.560174465179443) | > loss_feat: 6.4356160163879395 (6.4356160163879395) | > loss_mel: 27.862428665161133 (27.862428665161133) | > loss_duration: 2.8599250316619873 (2.8599250316619873) | > loss_1: 43.81755828857422 (43.81755828857422)  --> STEP: 1 | > loss_disc: 2.802849769592285 (2.802849769592285) | > loss_disc_real_0: 0.30939820408821106 (0.30939820408821106) | > loss_disc_real_1: 0.27710503339767456 (0.27710503339767456) | > loss_disc_real_2: 0.30842259526252747 (0.30842259526252747) | > loss_disc_real_3: 0.27071529626846313 (0.27071529626846313) | > loss_disc_real_4: 0.29567378759384155 (0.29567378759384155) | > loss_disc_real_5: 0.3240664303302765 (0.3240664303302765) | > loss_0: 2.802849769592285 (2.802849769592285) | > loss_gen: 2.475027084350586 (2.475027084350586) | > loss_kl: 4.28861665725708 (4.28861665725708) | > loss_feat: 2.0832860469818115 (2.0832860469818115) | > loss_mel: 23.49935531616211 (23.49935531616211) | > loss_duration: 2.9520928859710693 (2.9520928859710693) | > loss_1: 35.29837417602539 (35.29837417602539)  --> STEP: 2 | > loss_disc: 2.934579372406006 (2.8687145709991455) | > loss_disc_real_0: 0.3907947838306427 (0.3500964939594269) | > loss_disc_real_1: 0.2578766345977783 (0.26749083399772644) | > loss_disc_real_2: 0.2749079763889313 (0.29166528582572937) | > loss_disc_real_3: 0.30210238695144653 (0.28640884160995483) | > loss_disc_real_4: 0.3143729567527771 (0.3050233721733093) | > loss_disc_real_5: 0.33984988927841187 (0.3319581598043442) | > loss_0: 2.934579372406006 (2.8687145709991455) | > loss_gen: 2.7981293201446533 (2.6365782022476196) | > loss_kl: 5.356436252593994 (4.822526454925537) | > loss_feat: 3.7529184818267822 (2.918102264404297) | > loss_mel: 25.126115798950195 (24.312735557556152) | > loss_duration: 2.8860607147216797 (2.9190768003463745) | > loss_1: 39.91966247558594 (37.609018325805664)  --> STEP: 3 | > loss_disc: 2.7213146686553955 (2.8195812702178955) | > loss_disc_real_0: 0.4309388995170593 (0.3770439624786377) | > loss_disc_real_1: 0.30026090145111084 (0.27841418981552124) | > loss_disc_real_2: 0.16478359699249268 (0.2493713895479838) | > loss_disc_real_3: 0.22505512833595276 (0.26595760385195416) | > loss_disc_real_4: 0.23910261690616608 (0.2830497870842616) | > loss_disc_real_5: 0.14996574819087982 (0.2712940225998561) | > loss_0: 2.7213146686553955 (2.8195812702178955) | > loss_gen: 2.393660545349121 (2.55560564994812) | > loss_kl: 2.3712079524993896 (4.005420287450154) | > loss_feat: 4.440187931060791 (3.425464153289795) | > loss_mel: 24.980911254882812 (24.53546078999837) | > loss_duration: 2.8994669914245605 (2.9125401973724365) | > loss_1: 37.08543395996094 (37.43449020385742) --> EVAL PERFORMANCE | > avg_loader_time: 0.011910756429036459 (-0.4102730637504941) | > avg_loss_disc: 2.8195812702178955 (+0.08118265015738357) | > avg_loss_disc_real_0: 0.3770439624786377 (+0.19195100771529333) | > avg_loss_disc_real_1: 0.27841418981552124 (+0.02673862874507904) | > avg_loss_disc_real_2: 0.2493713895479838 (+0.014349025629815604) | > avg_loss_disc_real_3: 0.26595760385195416 (+0.02164483638036821) | > avg_loss_disc_real_4: 0.2830497870842616 (+0.10298209460008714) | > avg_loss_disc_real_5: 0.2712940225998561 (+0.06536451443320232) | > avg_loss_0: 2.8195812702178955 (+0.08118265015738357) | > avg_loss_gen: 2.55560564994812 (+0.707087550844465) | > avg_loss_kl: 4.005420287450154 (-0.07458852586292153) | > avg_loss_feat: 3.425464153289795 (-1.098330144371305) | > avg_loss_mel: 24.53546078999837 (+5.883647470247176) | > avg_loss_duration: 2.9125401973724365 (-0.012237208230154728) | > avg_loss_1: 37.43449020385742 (+5.405579021998811)  > EPOCH: 701/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:56:36)   --> TIME: 2023-10-20 07:57:01 -- STEP: 29/50 -- GLOBAL_STEP: 88080 | > loss_disc: 2.2461299896240234 (2.2907209971855433) | > loss_disc_real_0: 0.08052004873752594 (0.1308946725109528) | > loss_disc_real_1: 0.3566911220550537 (0.2116071779666276) | > loss_disc_real_2: 0.4213053584098816 (0.21512269408538423) | > loss_disc_real_3: 0.17555443942546844 (0.2321116623693499) | > loss_disc_real_4: 0.17814190685749054 (0.20693879394695677) | > loss_disc_real_5: 0.06298350542783737 (0.1966561520921773) | > loss_0: 2.2461299896240234 (2.2907209971855433) | > grad_norm_0: tensor(251.7711, device='cuda:0') (tensor(529.1561, device='cuda:0')) | > loss_gen: 2.6654887199401855 (2.4293949891780984) | > loss_kl: 0.8684616684913635 (0.8462379993549709) | > loss_feat: 5.657223224639893 (6.170613546309801) | > loss_mel: 22.706806182861328 (22.124530923777613) | > loss_duration: 1.3995025157928467 (1.4304025419827164) | > loss_1: 33.297481536865234 (33.001180418606474) | > grad_norm_1: tensor(3558.0515, device='cuda:0') (tensor(16329.5586, device='cuda:0')) | > current_lr_0: 9.921344609287024e-05 | > current_lr_1: 9.921344609287024e-05 | > step_time: 0.7615 (0.6032754717202022) | > loader_time: 0.0067 (0.022042126491152007)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.615828275680542 (2.615828275680542) | > loss_disc_real_0: 0.14586278796195984 (0.14586278796195984) | > loss_disc_real_1: 0.3484239876270294 (0.3484239876270294) | > loss_disc_real_2: 0.2783850133419037 (0.2783850133419037) | > loss_disc_real_3: 0.33396679162979126 (0.33396679162979126) | > loss_disc_real_4: 0.2721423804759979 (0.2721423804759979) | > loss_disc_real_5: 0.25001388788223267 (0.25001388788223267) | > loss_0: 2.615828275680542 (2.615828275680542) | > loss_gen: 2.486999750137329 (2.486999750137329) | > loss_kl: 4.920799732208252 (4.920799732208252) | > loss_feat: 3.9788360595703125 (3.9788360595703125) | > loss_mel: 23.310590744018555 (23.310590744018555) | > loss_duration: 2.820047616958618 (2.820047616958618) | > loss_1: 37.517276763916016 (37.517276763916016)  --> STEP: 1 | > loss_disc: 3.2044973373413086 (3.2044973373413086) | > loss_disc_real_0: 0.5810867547988892 (0.5810867547988892) | > loss_disc_real_1: 0.30165085196495056 (0.30165085196495056) | > loss_disc_real_2: 0.4070306718349457 (0.4070306718349457) | > loss_disc_real_3: 0.2955120801925659 (0.2955120801925659) | > loss_disc_real_4: 0.2921066880226135 (0.2921066880226135) | > loss_disc_real_5: 0.2807381749153137 (0.2807381749153137) | > loss_0: 3.2044973373413086 (3.2044973373413086) | > loss_gen: 2.1359333992004395 (2.1359333992004395) | > loss_kl: 4.830571174621582 (4.830571174621582) | > loss_feat: 0.28747859597206116 (0.28747859597206116) | > loss_mel: 13.992461204528809 (13.992461204528809) | > loss_duration: 3.0676815509796143 (3.0676815509796143) | > loss_1: 24.31412696838379 (24.31412696838379)  --> STEP: 2 | > loss_disc: 3.2288966178894043 (3.2166969776153564) | > loss_disc_real_0: 0.5881515741348267 (0.5846191644668579) | > loss_disc_real_1: 0.30069777369499207 (0.3011743128299713) | > loss_disc_real_2: 0.40790557861328125 (0.40746812522411346) | > loss_disc_real_3: 0.2951686382293701 (0.295340359210968) | > loss_disc_real_4: 0.2923031747341156 (0.29220493137836456) | > loss_disc_real_5: 0.28064095973968506 (0.2806895673274994) | > loss_0: 3.2288966178894043 (3.2166969776153564) | > loss_gen: 2.084726333618164 (2.1103298664093018) | > loss_kl: 4.7564826011657715 (4.793526887893677) | > loss_feat: 0.3258683681488037 (0.30667348206043243) | > loss_mel: 4.489198684692383 (9.240829944610596) | > loss_duration: 3.033318519592285 (3.0505000352859497) | > loss_1: 14.689594268798828 (19.50186061859131)  --> STEP: 3 | > loss_disc: 3.2298154830932617 (3.221069812774658) | > loss_disc_real_0: 0.5895799398422241 (0.5862727562586466) | > loss_disc_real_1: 0.3006860017776489 (0.3010115424791972) | > loss_disc_real_2: 0.40709590911865234 (0.4073440531889598) | > loss_disc_real_3: 0.29511088132858276 (0.2952638665835063) | > loss_disc_real_4: 0.29221755266189575 (0.29220913847287494) | > loss_disc_real_5: 0.2806984782218933 (0.2806925376256307) | > loss_0: 3.2298154830932617 (3.221069812774658) | > loss_gen: 2.083451986312866 (2.1013705730438232) | > loss_kl: 2.2090227603912354 (3.9320255120595298) | > loss_feat: 0.3260927200317383 (0.31314656138420105) | > loss_mel: 3.6671078205108643 (7.3829225699106855) | > loss_duration: 2.889418363571167 (2.9968061447143555) | > loss_1: 11.175093650817871 (16.726271629333496) --> EVAL PERFORMANCE | > avg_loader_time: 0.014909505844116211 (+0.002998749415079752) | > avg_loss_disc: 3.221069812774658 (+0.4014885425567627) | > avg_loss_disc_real_0: 0.5862727562586466 (+0.20922879378000891) | > avg_loss_disc_real_1: 0.3010115424791972 (+0.022597352663675963) | > avg_loss_disc_real_2: 0.4073440531889598 (+0.15797266364097598) | > avg_loss_disc_real_3: 0.2952638665835063 (+0.029306262731552124) | > avg_loss_disc_real_4: 0.29220913847287494 (+0.009159351388613346) | > avg_loss_disc_real_5: 0.2806925376256307 (+0.0093985150257746) | > avg_loss_0: 3.221069812774658 (+0.4014885425567627) | > avg_loss_gen: 2.1013705730438232 (-0.4542350769042969) | > avg_loss_kl: 3.9320255120595298 (-0.07339477539062456) | > avg_loss_feat: 0.31314656138420105 (-3.112317591905594) | > avg_loss_mel: 7.3829225699106855 (-17.152538220087685) | > avg_loss_duration: 2.9968061447143555 (+0.08426594734191895) | > avg_loss_1: 16.726271629333496 (-20.708218574523926)  > EPOCH: 702/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:57:30)   --> TIME: 2023-10-20 07:57:40 -- STEP: 9/50 -- GLOBAL_STEP: 88110 | > loss_disc: 2.9009647369384766 (2.539076460732354) | > loss_disc_real_0: 0.2315410077571869 (0.18235666015081936) | > loss_disc_real_1: 0.260768860578537 (0.23057020290030372) | > loss_disc_real_2: 0.565929651260376 (0.3233884357743793) | > loss_disc_real_3: 0.3686761260032654 (0.30359144591622883) | > loss_disc_real_4: 0.33698782324790955 (0.24230171367526054) | > loss_disc_real_5: 0.35336801409721375 (0.2221159024371041) | > loss_0: 2.9009647369384766 (2.539076460732354) | > grad_norm_0: tensor(451.4978, device='cuda:0') (tensor(687.4501, device='cuda:0')) | > loss_gen: 2.5434300899505615 (2.553509142663744) | > loss_kl: 0.4741114675998688 (0.765212721294827) | > loss_feat: 3.363922357559204 (6.481070035033756) | > loss_mel: 24.701332092285156 (22.54826381471422) | > loss_duration: 1.3450031280517578 (1.4324731164508395) | > loss_1: 32.427799224853516 (33.78052859836154) | > grad_norm_1: tensor(2084.1943, device='cuda:0') (tensor(19868.3887, device='cuda:0')) | > current_lr_0: 9.911427604181025e-05 | > current_lr_1: 9.911427604181025e-05 | > step_time: 1.2852 (0.5292865965101454) | > loader_time: 0.0222 (0.012926499048868815)  --> TIME: 2023-10-20 07:58:02 -- STEP: 39/50 -- GLOBAL_STEP: 88140 | > loss_disc: 2.5493392944335938 (2.5684957657104874) | > loss_disc_real_0: 0.24628539383411407 (0.1526565456237548) | > loss_disc_real_1: 0.23010548949241638 (0.23441429130541971) | > loss_disc_real_2: 0.19367846846580505 (0.25157734274100024) | > loss_disc_real_3: 0.21317322552204132 (0.25970387172240483) | > loss_disc_real_4: 0.1840398609638214 (0.2514559736427589) | > loss_disc_real_5: 0.20547710359096527 (0.2632814669169677) | > loss_0: 2.5493392944335938 (2.5684957657104874) | > grad_norm_0: tensor(616.5259, device='cuda:0') (tensor(708.5679, device='cuda:0')) | > loss_gen: 1.860901117324829 (2.2696010241141686) | > loss_kl: 0.7379265427589417 (0.8010149200757345) | > loss_feat: 2.3353028297424316 (5.057945329027301) | > loss_mel: 17.992862701416016 (20.692950224265072) | > loss_duration: 1.44642174243927 (1.419381655179537) | > loss_1: 24.373414993286133 (30.240893363952637) | > grad_norm_1: tensor(7400.2471, device='cuda:0') (tensor(17585.6055, device='cuda:0')) | > current_lr_0: 9.911427604181025e-05 | > current_lr_1: 9.911427604181025e-05 | > step_time: 0.8305 (0.6532298112526919) | > loader_time: 0.0264 (0.018497039110232625)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8350019454956055 (2.8350019454956055) | > loss_disc_real_0: 0.16250202059745789 (0.16250202059745789) | > loss_disc_real_1: 0.26219066977500916 (0.26219066977500916) | > loss_disc_real_2: 0.2834774851799011 (0.2834774851799011) | > loss_disc_real_3: 0.2928116023540497 (0.2928116023540497) | > loss_disc_real_4: 0.3469235599040985 (0.3469235599040985) | > loss_disc_real_5: 0.40617167949676514 (0.40617167949676514) | > loss_0: 2.8350019454956055 (2.8350019454956055) | > loss_gen: 2.2997355461120605 (2.2997355461120605) | > loss_kl: 4.393042087554932 (4.393042087554932) | > loss_feat: 4.806453704833984 (4.806453704833984) | > loss_mel: 23.78143882751465 (23.78143882751465) | > loss_duration: 2.8177952766418457 (2.8177952766418457) | > loss_1: 38.09846496582031 (38.09846496582031)  --> STEP: 1 | > loss_disc: 3.1862614154815674 (3.1862614154815674) | > loss_disc_real_0: 0.3426438570022583 (0.3426438570022583) | > loss_disc_real_1: 0.30764204263687134 (0.30764204263687134) | > loss_disc_real_2: 0.20652857422828674 (0.20652857422828674) | > loss_disc_real_3: 0.25923359394073486 (0.25923359394073486) | > loss_disc_real_4: 0.3721889555454254 (0.3721889555454254) | > loss_disc_real_5: 0.25242453813552856 (0.25242453813552856) | > loss_0: 3.1862614154815674 (3.1862614154815674) | > loss_gen: 1.8442051410675049 (1.8442051410675049) | > loss_kl: 4.279141426086426 (4.279141426086426) | > loss_feat: 4.390866756439209 (4.390866756439209) | > loss_mel: 23.84132194519043 (23.84132194519043) | > loss_duration: 3.102161407470703 (3.102161407470703) | > loss_1: 37.45769500732422 (37.45769500732422)  --> STEP: 2 | > loss_disc: 3.0318541526794434 (3.1090577840805054) | > loss_disc_real_0: 0.1306341290473938 (0.23663899302482605) | > loss_disc_real_1: 0.24093064665794373 (0.27428634464740753) | > loss_disc_real_2: 0.2731601595878601 (0.23984436690807343) | > loss_disc_real_3: 0.253145694732666 (0.25618964433670044) | > loss_disc_real_4: 0.307593435049057 (0.3398911952972412) | > loss_disc_real_5: 0.29005488753318787 (0.2712397128343582) | > loss_0: 3.0318541526794434 (3.1090577840805054) | > loss_gen: 1.5093939304351807 (1.6767995357513428) | > loss_kl: 4.842005729675293 (4.560573577880859) | > loss_feat: 0.057031966745853424 (2.223949361592531) | > loss_mel: 2.171734571456909 (13.00652825832367) | > loss_duration: 3.0323472023010254 (3.0672543048858643) | > loss_1: 11.612512588500977 (24.535103797912598)  --> STEP: 3 | > loss_disc: 1.5248632431030273 (2.5809929370880127) | > loss_disc_real_0: 0.15671586990356445 (0.20999795198440552) | > loss_disc_real_1: 0.16306914389133453 (0.2372139443953832) | > loss_disc_real_2: 0.1717381328344345 (0.21714228888352713) | > loss_disc_real_3: 0.1766359657049179 (0.2296717514594396) | > loss_disc_real_4: 0.14257551729679108 (0.2741193026304245) | > loss_disc_real_5: 0.0932282879948616 (0.2119025712211927) | > loss_0: 1.5248632431030273 (2.5809929370880127) | > loss_gen: 3.9485042095184326 (2.4340344270070395) | > loss_kl: 2.0408732891082764 (3.7206734816233316) | > loss_feat: 9.045653343200684 (4.497850688795249) | > loss_mel: 23.911270141601562 (16.6414422194163) | > loss_duration: 2.8418595790863037 (2.9921227296193442) | > loss_1: 41.78815841674805 (30.286122004191082) --> EVAL PERFORMANCE | > avg_loader_time: 0.01183160146077474 (-0.0030779043833414708) | > avg_loss_disc: 2.5809929370880127 (-0.6400768756866455) | > avg_loss_disc_real_0: 0.20999795198440552 (-0.3762748042742411) | > avg_loss_disc_real_1: 0.2372139443953832 (-0.063797598083814) | > avg_loss_disc_real_2: 0.21714228888352713 (-0.19020176430543265) | > avg_loss_disc_real_3: 0.2296717514594396 (-0.06559211512406668) | > avg_loss_disc_real_4: 0.2741193026304245 (-0.01808983584245044) | > avg_loss_disc_real_5: 0.2119025712211927 (-0.06878996640443799) | > avg_loss_0: 2.5809929370880127 (-0.6400768756866455) | > avg_loss_gen: 2.4340344270070395 (+0.3326638539632163) | > avg_loss_kl: 3.7206734816233316 (-0.2113520304361982) | > avg_loss_feat: 4.497850688795249 (+4.184704127411048) | > avg_loss_mel: 16.6414422194163 (+9.258519649505615) | > avg_loss_duration: 2.9921227296193442 (-0.004683415095011245) | > avg_loss_1: 30.286122004191082 (+13.559850374857586)  > EPOCH: 703/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:58:22)   --> TIME: 2023-10-20 07:58:43 -- STEP: 19/50 -- GLOBAL_STEP: 88170 | > loss_disc: 2.8979742527008057 (2.4449640198757776) | > loss_disc_real_0: 0.12763139605522156 (0.14115308460436368) | > loss_disc_real_1: 0.34646356105804443 (0.2178634024764362) | > loss_disc_real_2: 0.4578825533390045 (0.2322832189108196) | > loss_disc_real_3: 0.30273866653442383 (0.25802785471866) | > loss_disc_real_4: 0.3082970380783081 (0.23858990716306785) | > loss_disc_real_5: 0.3412964344024658 (0.23926906542558418) | > loss_0: 2.8979742527008057 (2.4449640198757776) | > grad_norm_0: tensor(461.0746, device='cuda:0') (tensor(517.3503, device='cuda:0')) | > loss_gen: 2.334392547607422 (2.3615860311608565) | > loss_kl: 1.1726100444793701 (0.7760188861897117) | > loss_feat: 3.900102376937866 (5.534026652770607) | > loss_mel: 27.071746826171875 (21.964647374655073) | > loss_duration: 1.5492933988571167 (1.4493486191097058) | > loss_1: 36.02814483642578 (32.0856274554604) | > grad_norm_1: tensor(6681.5659, device='cuda:0') (tensor(22802.2773, device='cuda:0')) | > current_lr_0: 9.901520511742527e-05 | > current_lr_1: 9.901520511742527e-05 | > step_time: 0.4562 (0.6916289956946122) | > loader_time: 0.0021 (0.021255618647525187)  --> TIME: 2023-10-20 07:58:56 -- STEP: 49/50 -- GLOBAL_STEP: 88200 | > loss_disc: 2.770037889480591 (2.481897504962221) | > loss_disc_real_0: 0.2311573177576065 (0.15206522722633517) | > loss_disc_real_1: 0.30520251393318176 (0.22309557310476594) | > loss_disc_real_2: 0.22545087337493896 (0.22871537696646185) | > loss_disc_real_3: 0.21395722031593323 (0.23497003575368802) | > loss_disc_real_4: 0.288844496011734 (0.23860465069966658) | > loss_disc_real_5: 0.2941262125968933 (0.24167789167211373) | > loss_0: 2.770037889480591 (2.481897504962221) | > grad_norm_0: tensor(1013.9329, device='cuda:0') (tensor(671.5368, device='cuda:0')) | > loss_gen: 2.145933151245117 (2.2738503728594095) | > loss_kl: 0.6386076807975769 (0.8188438369911544) | > loss_feat: 2.580158233642578 (5.126664506917704) | > loss_mel: 18.72410774230957 (20.24243168806543) | > loss_duration: 1.5508981943130493 (1.4282289427153918) | > loss_1: 25.63970375061035 (29.890019300032634) | > grad_norm_1: tensor(14311.7832, device='cuda:0') (tensor(22457.8789, device='cuda:0')) | > current_lr_0: 9.901520511742527e-05 | > current_lr_1: 9.901520511742527e-05 | > step_time: 0.5263 (0.515669958932059) | > loader_time: 0.3979 (0.02226455357609963)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8662813901901245 (1.8662813901901245) | > loss_disc_real_0: 0.13424640893936157 (0.13424640893936157) | > loss_disc_real_1: 0.2758012115955353 (0.2758012115955353) | > loss_disc_real_2: 0.11392427235841751 (0.11392427235841751) | > loss_disc_real_3: 0.19181470572948456 (0.19181470572948456) | > loss_disc_real_4: 0.1663026064634323 (0.1663026064634323) | > loss_disc_real_5: 0.11762955039739609 (0.11762955039739609) | > loss_0: 1.8662813901901245 (1.8662813901901245) | > loss_gen: 2.741086483001709 (2.741086483001709) | > loss_kl: 4.191962718963623 (4.191962718963623) | > loss_feat: 8.958343505859375 (8.958343505859375) | > loss_mel: 22.866668701171875 (22.866668701171875) | > loss_duration: 2.776106119155884 (2.776106119155884) | > loss_1: 41.5341682434082 (41.5341682434082)  --> STEP: 1 | > loss_disc: 2.901634693145752 (2.901634693145752) | > loss_disc_real_0: 0.2873959541320801 (0.2873959541320801) | > loss_disc_real_1: 0.2733595669269562 (0.2733595669269562) | > loss_disc_real_2: 0.2350005805492401 (0.2350005805492401) | > loss_disc_real_3: 0.3215816020965576 (0.3215816020965576) | > loss_disc_real_4: 0.25848743319511414 (0.25848743319511414) | > loss_disc_real_5: 0.30261877179145813 (0.30261877179145813) | > loss_0: 2.901634693145752 (2.901634693145752) | > loss_gen: 1.9216928482055664 (1.9216928482055664) | > loss_kl: 4.563559055328369 (4.563559055328369) | > loss_feat: 1.5553703308105469 (1.5553703308105469) | > loss_mel: 19.22064971923828 (19.22064971923828) | > loss_duration: 3.0696561336517334 (3.0696561336517334) | > loss_1: 30.330928802490234 (30.330928802490234)  --> STEP: 2 | > loss_disc: 2.8855466842651367 (2.8935906887054443) | > loss_disc_real_0: 0.15538311004638672 (0.2213895320892334) | > loss_disc_real_1: 0.2506488859653473 (0.26200422644615173) | > loss_disc_real_2: 0.2622319161891937 (0.24861624836921692) | > loss_disc_real_3: 0.23878799378871918 (0.2801847979426384) | > loss_disc_real_4: 0.2450876086950302 (0.2517875209450722) | > loss_disc_real_5: 0.24259331822395325 (0.2726060450077057) | > loss_0: 2.8855466842651367 (2.8935906887054443) | > loss_gen: 1.5358552932739258 (1.728774070739746) | > loss_kl: 4.629012107849121 (4.596285581588745) | > loss_feat: 0.9479405879974365 (1.2516554594039917) | > loss_mel: 18.474849700927734 (18.847749710083008) | > loss_duration: 2.9562532901763916 (3.0129547119140625) | > loss_1: 28.54391098022461 (29.437419891357422)  --> STEP: 3 | > loss_disc: 3.0062129497528076 (2.931131442387899) | > loss_disc_real_0: 0.10575906932353973 (0.18284604450066885) | > loss_disc_real_1: 0.41737183928489685 (0.31379343072573346) | > loss_disc_real_2: 0.338584303855896 (0.2786056001981099) | > loss_disc_real_3: 0.34815460443496704 (0.3028414001067479) | > loss_disc_real_4: 0.1913243681192398 (0.2316331366697947) | > loss_disc_real_5: 0.2609855830669403 (0.26873255769411725) | > loss_0: 3.0062129497528076 (2.931131442387899) | > loss_gen: 1.8189082145690918 (1.758818785349528) | > loss_kl: 2.1736626625061035 (3.7887446085611978) | > loss_feat: 4.39699649810791 (2.300102472305298) | > loss_mel: 23.20235824584961 (20.299285888671875) | > loss_duration: 2.8343513011932373 (2.9534202416737876) | > loss_1: 34.42627716064453 (31.100372314453125) --> EVAL PERFORMANCE | > avg_loader_time: 0.0034323533376057944 (-0.008399248123168945) | > avg_loss_disc: 2.931131442387899 (+0.3501385052998862) | > avg_loss_disc_real_0: 0.18284604450066885 (-0.027151907483736665) | > avg_loss_disc_real_1: 0.31379343072573346 (+0.07657948633035025) | > avg_loss_disc_real_2: 0.2786056001981099 (+0.0614633113145828) | > avg_loss_disc_real_3: 0.3028414001067479 (+0.07316964864730832) | > avg_loss_disc_real_4: 0.2316331366697947 (-0.04248616596062979) | > avg_loss_disc_real_5: 0.26873255769411725 (+0.05682998647292456) | > avg_loss_0: 2.931131442387899 (+0.3501385052998862) | > avg_loss_gen: 1.758818785349528 (-0.6752156416575115) | > avg_loss_kl: 3.7887446085611978 (+0.06807112693786621) | > avg_loss_feat: 2.300102472305298 (-2.197748216489951) | > avg_loss_mel: 20.299285888671875 (+3.6578436692555734) | > avg_loss_duration: 2.9534202416737876 (-0.03870248794555664) | > avg_loss_1: 31.100372314453125 (+0.8142503102620431)  > EPOCH: 704/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 07:59:14)   --> TIME: 2023-10-20 07:59:38 -- STEP: 29/50 -- GLOBAL_STEP: 88230 | > loss_disc: 2.174258232116699 (2.4095975119492103) | > loss_disc_real_0: 0.11013130098581314 (0.1423826588895814) | > loss_disc_real_1: 0.13459233939647675 (0.21107797388886584) | > loss_disc_real_2: 0.1798688918352127 (0.2200871428539013) | > loss_disc_real_3: 0.12514133751392365 (0.23467172412522908) | > loss_disc_real_4: 0.23241528868675232 (0.22933881627074604) | > loss_disc_real_5: 0.24782246351242065 (0.23276378513024798) | > loss_0: 2.174258232116699 (2.4095975119492103) | > grad_norm_0: tensor(348.2861, device='cuda:0') (tensor(613.1042, device='cuda:0')) | > loss_gen: 2.4538073539733887 (2.3340490933122306) | > loss_kl: 1.1893322467803955 (0.8784034642679938) | > loss_feat: 6.363633155822754 (5.4736322246748825) | > loss_mel: 22.335201263427734 (22.54896611180799) | > loss_duration: 1.39414644241333 (1.4265431576761707) | > loss_1: 33.73611831665039 (32.66159439086913) | > grad_norm_1: tensor(20659.2715, device='cuda:0') (tensor(20880.7559, device='cuda:0')) | > current_lr_0: 9.891623322063195e-05 | > current_lr_1: 9.891623322063195e-05 | > step_time: 0.314 (0.610935638690817) | > loader_time: 0.0026 (0.025981409796353043)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.320023536682129 (2.320023536682129) | > loss_disc_real_0: 0.10001332312822342 (0.10001332312822342) | > loss_disc_real_1: 0.22537176311016083 (0.22537176311016083) | > loss_disc_real_2: 0.30155453085899353 (0.30155453085899353) | > loss_disc_real_3: 0.31893953680992126 (0.31893953680992126) | > loss_disc_real_4: 0.28283268213272095 (0.28283268213272095) | > loss_disc_real_5: 0.2693304717540741 (0.2693304717540741) | > loss_0: 2.320023536682129 (2.320023536682129) | > loss_gen: 2.793715000152588 (2.793715000152588) | > loss_kl: 4.341446876525879 (4.341446876525879) | > loss_feat: 6.521190643310547 (6.521190643310547) | > loss_mel: 21.580692291259766 (21.580692291259766) | > loss_duration: 2.7947916984558105 (2.7947916984558105) | > loss_1: 38.031837463378906 (38.031837463378906)  --> STEP: 1 | > loss_disc: 3.278224468231201 (3.278224468231201) | > loss_disc_real_0: 0.2713249623775482 (0.2713249623775482) | > loss_disc_real_1: 0.2767506241798401 (0.2767506241798401) | > loss_disc_real_2: 0.29678618907928467 (0.29678618907928467) | > loss_disc_real_3: 0.378378301858902 (0.378378301858902) | > loss_disc_real_4: 0.6593244075775146 (0.6593244075775146) | > loss_disc_real_5: 0.37976136803627014 (0.37976136803627014) | > loss_0: 3.278224468231201 (3.278224468231201) | > loss_gen: 2.4597551822662354 (2.4597551822662354) | > loss_kl: 4.497944355010986 (4.497944355010986) | > loss_feat: 6.970604419708252 (6.970604419708252) | > loss_mel: 23.18041229248047 (23.18041229248047) | > loss_duration: 3.0314712524414062 (3.0314712524414062) | > loss_1: 40.14018630981445 (40.14018630981445)  --> STEP: 2 | > loss_disc: 2.6423707008361816 (2.9602975845336914) | > loss_disc_real_0: 0.09185504168272018 (0.1815900020301342) | > loss_disc_real_1: 0.29892611503601074 (0.2878383696079254) | > loss_disc_real_2: 0.2780093550682068 (0.2873977720737457) | > loss_disc_real_3: 0.34102022647857666 (0.3596992641687393) | > loss_disc_real_4: 0.34824278950691223 (0.5037835985422134) | > loss_disc_real_5: 0.36188632249832153 (0.37082384526729584) | > loss_0: 2.6423707008361816 (2.9602975845336914) | > loss_gen: 2.3557119369506836 (2.4077335596084595) | > loss_kl: 5.241677284240723 (4.8698108196258545) | > loss_feat: 3.0663869380950928 (5.018495678901672) | > loss_mel: 24.87804412841797 (24.02922821044922) | > loss_duration: 2.8999838829040527 (2.9657275676727295) | > loss_1: 38.441802978515625 (39.29099464416504)  --> STEP: 3 | > loss_disc: 3.491478204727173 (3.137357791264852) | > loss_disc_real_0: 0.15799885988235474 (0.1737262879808744) | > loss_disc_real_1: 0.16327956318855286 (0.24631876746813455) | > loss_disc_real_2: 0.19599853456020355 (0.2569313595692317) | > loss_disc_real_3: 0.23590971529483795 (0.3184360812107722) | > loss_disc_real_4: 0.19966596364974976 (0.4024110535780589) | > loss_disc_real_5: 0.1250268667936325 (0.2888915191094081) | > loss_0: 3.491478204727173 (3.137357791264852) | > loss_gen: 1.0902585983276367 (1.9685752391815186) | > loss_kl: 2.15609073638916 (3.9652374585469565) | > loss_feat: 5.783791542053223 (5.273594299952189) | > loss_mel: 19.038414001464844 (22.365623474121094) | > loss_duration: 2.806058406829834 (2.912504514058431) | > loss_1: 30.87461280822754 (36.485534032185875) --> EVAL PERFORMANCE | > avg_loader_time: 0.006891489028930664 (+0.0034591356913248696) | > avg_loss_disc: 3.137357791264852 (+0.20622634887695312) | > avg_loss_disc_real_0: 0.1737262879808744 (-0.009119756519794464) | > avg_loss_disc_real_1: 0.24631876746813455 (-0.0674746632575989) | > avg_loss_disc_real_2: 0.2569313595692317 (-0.02167424062887824) | > avg_loss_disc_real_3: 0.3184360812107722 (+0.015594681104024288) | > avg_loss_disc_real_4: 0.4024110535780589 (+0.1707779169082642) | > avg_loss_disc_real_5: 0.2888915191094081 (+0.020158961415290833) | > avg_loss_0: 3.137357791264852 (+0.20622634887695312) | > avg_loss_gen: 1.9685752391815186 (+0.20975645383199049) | > avg_loss_kl: 3.9652374585469565 (+0.17649284998575876) | > avg_loss_feat: 5.273594299952189 (+2.9734918276468916) | > avg_loss_mel: 22.365623474121094 (+2.0663375854492188) | > avg_loss_duration: 2.912504514058431 (-0.040915727615356445) | > avg_loss_1: 36.485534032185875 (+5.38516171773275)  > EPOCH: 705/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:00:10)   --> TIME: 2023-10-20 08:00:20 -- STEP: 9/50 -- GLOBAL_STEP: 88260 | > loss_disc: 2.9766976833343506 (2.214539839161767) | > loss_disc_real_0: 0.27484995126724243 (0.15124454256147146) | > loss_disc_real_1: 0.3295437693595886 (0.226508852508333) | > loss_disc_real_2: 0.3399755656719208 (0.21602839355667433) | > loss_disc_real_3: 0.4139723777770996 (0.22712566082676253) | > loss_disc_real_4: 0.3285919427871704 (0.21797499909169143) | > loss_disc_real_5: 0.3731086850166321 (0.2206039767091473) | > loss_0: 2.9766976833343506 (2.214539839161767) | > grad_norm_0: tensor(377.3272, device='cuda:0') (tensor(533.2346, device='cuda:0')) | > loss_gen: 2.295074701309204 (2.582096987300449) | > loss_kl: 0.5092720985412598 (0.8284612695376078) | > loss_feat: 2.2264275550842285 (6.631628195444743) | > loss_mel: 22.269479751586914 (21.353003819783527) | > loss_duration: 1.3402818441390991 (1.4220613638559978) | > loss_1: 28.64053726196289 (32.81725184122721) | > grad_norm_1: tensor(4241.9155, device='cuda:0') (tensor(12932.1104, device='cuda:0')) | > current_lr_0: 9.881736025244605e-05 | > current_lr_1: 9.881736025244605e-05 | > step_time: 0.2615 (0.3388190269470215) | > loader_time: 0.0019 (0.0027818414900037977)  --> TIME: 2023-10-20 08:00:36 -- STEP: 39/50 -- GLOBAL_STEP: 88290 | > loss_disc: 2.2183101177215576 (2.461699664592743) | > loss_disc_real_0: 0.1497526615858078 (0.14737131926589286) | > loss_disc_real_1: 0.19213761389255524 (0.22358048411133963) | > loss_disc_real_2: 0.22264625132083893 (0.22130652125447225) | > loss_disc_real_3: 0.18380901217460632 (0.23737431078767166) | > loss_disc_real_4: 0.221316859126091 (0.22968226733307043) | > loss_disc_real_5: 0.19947393238544464 (0.23229670378928766) | > loss_0: 2.2183101177215576 (2.461699664592743) | > grad_norm_0: tensor(842.4895, device='cuda:0') (tensor(627.4517, device='cuda:0')) | > loss_gen: 2.4332571029663086 (2.2263823594802474) | > loss_kl: 0.6430438160896301 (0.9124699319020296) | > loss_feat: 5.311347007751465 (4.74001035380822) | > loss_mel: 22.967288970947266 (19.1184869882388) | > loss_duration: 1.46067214012146 (1.4134460259706547) | > loss_1: 32.815608978271484 (28.410795737535526) | > grad_norm_1: tensor(21593.0469, device='cuda:0') (tensor(16263.2871, device='cuda:0')) | > current_lr_0: 9.881736025244605e-05 | > current_lr_1: 9.881736025244605e-05 | > step_time: 0.5313 (0.48703831892747146) | > loader_time: 0.018 (0.012901874688955454)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0463461875915527 (3.0463461875915527) | > loss_disc_real_0: 0.42620301246643066 (0.42620301246643066) | > loss_disc_real_1: 0.27743324637413025 (0.27743324637413025) | > loss_disc_real_2: 0.3542179763317108 (0.3542179763317108) | > loss_disc_real_3: 0.28838834166526794 (0.28838834166526794) | > loss_disc_real_4: 0.36694401502609253 (0.36694401502609253) | > loss_disc_real_5: 0.5037562847137451 (0.5037562847137451) | > loss_0: 3.0463461875915527 (3.0463461875915527) | > loss_gen: 2.6181583404541016 (2.6181583404541016) | > loss_kl: 4.06236457824707 (4.06236457824707) | > loss_feat: 3.8371870517730713 (3.8371870517730713) | > loss_mel: 22.5338191986084 (22.5338191986084) | > loss_duration: 2.728358507156372 (2.728358507156372) | > loss_1: 35.77988815307617 (35.77988815307617)  --> STEP: 1 | > loss_disc: 2.6257858276367188 (2.6257858276367188) | > loss_disc_real_0: 0.08738130331039429 (0.08738130331039429) | > loss_disc_real_1: 0.3166118860244751 (0.3166118860244751) | > loss_disc_real_2: 0.2580581605434418 (0.2580581605434418) | > loss_disc_real_3: 0.28295010328292847 (0.28295010328292847) | > loss_disc_real_4: 0.2782689929008484 (0.2782689929008484) | > loss_disc_real_5: 0.3091598451137543 (0.3091598451137543) | > loss_0: 2.6257858276367188 (2.6257858276367188) | > loss_gen: 2.0351600646972656 (2.0351600646972656) | > loss_kl: 4.684495449066162 (4.684495449066162) | > loss_feat: 1.285980463027954 (1.285980463027954) | > loss_mel: 22.31593132019043 (22.31593132019043) | > loss_duration: 3.0033469200134277 (3.0033469200134277) | > loss_1: 33.324913024902344 (33.324913024902344)  --> STEP: 2 | > loss_disc: 1.8162485361099243 (2.2210171818733215) | > loss_disc_real_0: 0.16493573784828186 (0.12615852057933807) | > loss_disc_real_1: 0.1279435157775879 (0.2222777009010315) | > loss_disc_real_2: 0.264361709356308 (0.2612099349498749) | > loss_disc_real_3: 0.17155355215072632 (0.2272518277168274) | > loss_disc_real_4: 0.1722705066204071 (0.22526974976062775) | > loss_disc_real_5: 0.061454806476831436 (0.18530732579529285) | > loss_0: 1.8162485361099243 (2.2210171818733215) | > loss_gen: 3.2604148387908936 (2.6477874517440796) | > loss_kl: 5.05446195602417 (4.869478702545166) | > loss_feat: 14.01838207244873 (7.652181267738342) | > loss_mel: 27.073368072509766 (24.694649696350098) | > loss_duration: 2.925166368484497 (2.9642566442489624) | > loss_1: 52.331790924072266 (42.828351974487305)  --> STEP: 3 | > loss_disc: 2.799166202545166 (2.4137335220972695) | > loss_disc_real_0: 0.207290917634964 (0.15320265293121338) | > loss_disc_real_1: 0.2975175678730011 (0.2473576565583547) | > loss_disc_real_2: 0.2755262553691864 (0.26598204175631207) | > loss_disc_real_3: 0.27087706327438354 (0.24179357290267944) | > loss_disc_real_4: 0.28871607780456543 (0.24641852577527365) | > loss_disc_real_5: 0.2884027063846588 (0.21967245265841484) | > loss_0: 2.799166202545166 (2.4137335220972695) | > loss_gen: 1.9218456745147705 (2.40580685933431) | > loss_kl: 2.1223905086517334 (3.953782637914022) | > loss_feat: 1.011388897895813 (5.438583811124166) | > loss_mel: 17.947542190551758 (22.445613861083984) | > loss_duration: 2.7772083282470703 (2.901907205581665) | > loss_1: 25.780376434326172 (37.14569346110026) --> EVAL PERFORMANCE | > avg_loader_time: 0.013695319493611654 (+0.00680383046468099) | > avg_loss_disc: 2.4137335220972695 (-0.7236242691675825) | > avg_loss_disc_real_0: 0.15320265293121338 (-0.02052363504966101) | > avg_loss_disc_real_1: 0.2473576565583547 (+0.001038889090220152) | > avg_loss_disc_real_2: 0.26598204175631207 (+0.009050682187080383) | > avg_loss_disc_real_3: 0.24179357290267944 (-0.07664250830809277) | > avg_loss_disc_real_4: 0.24641852577527365 (-0.15599252780278525) | > avg_loss_disc_real_5: 0.21967245265841484 (-0.06921906645099324) | > avg_loss_0: 2.4137335220972695 (-0.7236242691675825) | > avg_loss_gen: 2.40580685933431 (+0.4372316201527915) | > avg_loss_kl: 3.953782637914022 (-0.01145482063293457) | > avg_loss_feat: 5.438583811124166 (+0.16498951117197613) | > avg_loss_mel: 22.445613861083984 (+0.07999038696289062) | > avg_loss_duration: 2.901907205581665 (-0.010597308476766099) | > avg_loss_1: 37.14569346110026 (+0.6601594289143833)  > EPOCH: 706/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:01:08)   --> TIME: 2023-10-20 08:01:26 -- STEP: 19/50 -- GLOBAL_STEP: 88320 | > loss_disc: 2.8786911964416504 (2.292950096883272) | > loss_disc_real_0: 0.17670869827270508 (0.13899546547939903) | > loss_disc_real_1: 0.34672966599464417 (0.21621926599427274) | > loss_disc_real_2: 0.2335304319858551 (0.23587052651533955) | > loss_disc_real_3: 0.30956217646598816 (0.2164438311010599) | > loss_disc_real_4: 0.257828027009964 (0.2278842918672844) | > loss_disc_real_5: 0.3300851285457611 (0.22776083579581036) | > loss_0: 2.8786911964416504 (2.292950096883272) | > grad_norm_0: tensor(542.9102, device='cuda:0') (tensor(552.8572, device='cuda:0')) | > loss_gen: 2.221571683883667 (2.6726123910201225) | > loss_kl: 0.6317059397697449 (0.9620705372408817) | > loss_feat: 3.4039089679718018 (7.1688883900642395) | > loss_mel: 12.06918716430664 (21.911668827659206) | > loss_duration: 1.5462924242019653 (1.4448931342677067) | > loss_1: 19.872665405273438 (34.160133261429635) | > grad_norm_1: tensor(17295.9238, device='cuda:0') (tensor(28042.6016, device='cuda:0')) | > current_lr_0: 9.871858611398223e-05 | > current_lr_1: 9.871858611398223e-05 | > step_time: 0.6788 (0.6282184625926771) | > loader_time: 0.0335 (0.027186945865028782)  --> TIME: 2023-10-20 08:01:42 -- STEP: 49/50 -- GLOBAL_STEP: 88350 | > loss_disc: 1.9445605278015137 (2.3885912968187912) | > loss_disc_real_0: 0.07943771779537201 (0.13931836598381706) | > loss_disc_real_1: 0.3327576220035553 (0.2261156936233141) | > loss_disc_real_2: 0.12197522073984146 (0.2282796248565523) | > loss_disc_real_3: 0.2037935107946396 (0.23043052179320733) | > loss_disc_real_4: 0.14155593514442444 (0.21539969820225116) | > loss_disc_real_5: 0.1874740570783615 (0.22123959725152473) | > loss_0: 1.9445605278015137 (2.3885912968187912) | > grad_norm_0: tensor(459.8951, device='cuda:0') (tensor(547.6526, device='cuda:0')) | > loss_gen: 2.6200389862060547 (2.430811972034222) | > loss_kl: 0.5802655220031738 (0.8594632027100544) | > loss_feat: 6.203853607177734 (6.230225479876508) | > loss_mel: 24.963783264160156 (21.62580543634843) | > loss_duration: 1.6126779317855835 (1.4105496844466852) | > loss_1: 35.980621337890625 (32.556855590976) | > grad_norm_1: tensor(22552.8398, device='cuda:0') (tensor(20968.1348, device='cuda:0')) | > current_lr_0: 9.871858611398223e-05 | > current_lr_1: 9.871858611398223e-05 | > step_time: 0.3651 (0.5631671681696054) | > loader_time: 0.3858 (0.029663134594352873)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.518427848815918 (3.518427848815918) | > loss_disc_real_0: 0.0746522769331932 (0.0746522769331932) | > loss_disc_real_1: 0.23726868629455566 (0.23726868629455566) | > loss_disc_real_2: 0.3244808614253998 (0.3244808614253998) | > loss_disc_real_3: 0.3481476604938507 (0.3481476604938507) | > loss_disc_real_4: 0.4453493058681488 (0.4453493058681488) | > loss_disc_real_5: 0.47835323214530945 (0.47835323214530945) | > loss_0: 3.518427848815918 (3.518427848815918) | > loss_gen: 1.6021976470947266 (1.6021976470947266) | > loss_kl: 4.627135276794434 (4.627135276794434) | > loss_feat: 5.378353118896484 (5.378353118896484) | > loss_mel: 22.751508712768555 (22.751508712768555) | > loss_duration: 2.824413299560547 (2.824413299560547) | > loss_1: 37.1836051940918 (37.1836051940918)  --> STEP: 1 | > loss_disc: 2.9181811809539795 (2.9181811809539795) | > loss_disc_real_0: 0.2785041630268097 (0.2785041630268097) | > loss_disc_real_1: 0.19687630236148834 (0.19687630236148834) | > loss_disc_real_2: 0.20870471000671387 (0.20870471000671387) | > loss_disc_real_3: 0.2631100118160248 (0.2631100118160248) | > loss_disc_real_4: 0.37624451518058777 (0.37624451518058777) | > loss_disc_real_5: 0.42639702558517456 (0.42639702558517456) | > loss_0: 2.9181811809539795 (2.9181811809539795) | > loss_gen: 2.089860439300537 (2.089860439300537) | > loss_kl: 4.421948432922363 (4.421948432922363) | > loss_feat: 6.496228218078613 (6.496228218078613) | > loss_mel: 25.705883026123047 (25.705883026123047) | > loss_duration: 3.0541863441467285 (3.0541863441467285) | > loss_1: 41.76810836791992 (41.76810836791992)  --> STEP: 2 | > loss_disc: 2.2890257835388184 (2.603603482246399) | > loss_disc_real_0: 0.02076667547225952 (0.1496354192495346) | > loss_disc_real_1: 0.059147510677576065 (0.1280119065195322) | > loss_disc_real_2: 0.036963801831007004 (0.12283425591886044) | > loss_disc_real_3: 0.18036861717700958 (0.22173931449651718) | > loss_disc_real_4: 0.058081112802028656 (0.2171628139913082) | > loss_disc_real_5: 0.017084341496229172 (0.22174068354070187) | > loss_0: 2.2890257835388184 (2.603603482246399) | > loss_gen: 1.3604376316070557 (1.7251490354537964) | > loss_kl: 5.139396667480469 (4.780672550201416) | > loss_feat: 10.230766296386719 (8.363497257232666) | > loss_mel: 25.96519660949707 (25.83553981781006) | > loss_duration: 2.952519655227661 (3.003352999687195) | > loss_1: 45.6483154296875 (43.70821189880371)  --> STEP: 3 | > loss_disc: 2.209684371948242 (2.472297112147013) | > loss_disc_real_0: 0.18919208645820618 (0.16282097498575845) | > loss_disc_real_1: 0.25484612584114075 (0.17028997962673506) | > loss_disc_real_2: 0.2221135050058365 (0.15592733894785246) | > loss_disc_real_3: 0.3076156675815582 (0.2503647655248642) | > loss_disc_real_4: 0.045063700526952744 (0.15979644283652306) | > loss_disc_real_5: 0.13079488277435303 (0.1914254166185856) | > loss_0: 2.209684371948242 (2.472297112147013) | > loss_gen: 2.595911979675293 (2.0154033501942954) | > loss_kl: 2.4634013175964355 (4.008248805999756) | > loss_feat: 8.127267837524414 (8.284754117329916) | > loss_mel: 23.87340545654297 (25.181495030721027) | > loss_duration: 2.7178537845611572 (2.908186594645182) | > loss_1: 39.77783966064453 (42.39808781941732) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025974909464518228 (-0.011097828547159832) | > avg_loss_disc: 2.472297112147013 (+0.05856359004974365) | > avg_loss_disc_real_0: 0.16282097498575845 (+0.009618322054545075) | > avg_loss_disc_real_1: 0.17028997962673506 (-0.07706767693161964) | > avg_loss_disc_real_2: 0.15592733894785246 (-0.11005470280845961) | > avg_loss_disc_real_3: 0.2503647655248642 (+0.008571192622184753) | > avg_loss_disc_real_4: 0.15979644283652306 (-0.0866220829387506) | > avg_loss_disc_real_5: 0.1914254166185856 (-0.028247036039829254) | > avg_loss_0: 2.472297112147013 (+0.05856359004974365) | > avg_loss_gen: 2.0154033501942954 (-0.39040350914001465) | > avg_loss_kl: 4.008248805999756 (+0.0544661680857339) | > avg_loss_feat: 8.284754117329916 (+2.8461703062057504) | > avg_loss_mel: 25.181495030721027 (+2.735881169637043) | > avg_loss_duration: 2.908186594645182 (+0.006279389063517105) | > avg_loss_1: 42.39808781941732 (+5.252394358317062)  > EPOCH: 707/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:01:59)   --> TIME: 2023-10-20 08:02:18 -- STEP: 29/50 -- GLOBAL_STEP: 88380 | > loss_disc: 2.995820999145508 (2.442070225189472) | > loss_disc_real_0: 0.21905893087387085 (0.15206196936297006) | > loss_disc_real_1: 0.25984930992126465 (0.2256120528126585) | > loss_disc_real_2: 0.27024930715560913 (0.22174328552751704) | > loss_disc_real_3: 0.2132907658815384 (0.24103695642331552) | > loss_disc_real_4: 0.27661192417144775 (0.22867392172137724) | > loss_disc_real_5: 0.2723410725593567 (0.2157789677509974) | > loss_0: 2.995820999145508 (2.442070225189472) | > grad_norm_0: tensor(935.8596, device='cuda:0') (tensor(806.3143, device='cuda:0')) | > loss_gen: 1.552140235900879 (2.3685910290685204) | > loss_kl: 0.7756022810935974 (0.8271782994270325) | > loss_feat: 0.13718698918819427 (5.059140463841373) | > loss_mel: 13.285177230834961 (20.96617472582849) | > loss_duration: 1.4139823913574219 (1.4283616049536343) | > loss_1: 17.16408920288086 (30.649446142130877) | > grad_norm_1: tensor(13168.7588, device='cuda:0') (tensor(30092.8555, device='cuda:0')) | > current_lr_0: 9.861991070645399e-05 | > current_lr_1: 9.861991070645399e-05 | > step_time: 0.8221 (0.43233062481058054) | > loader_time: 0.0311 (0.011726995994304788)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.074920415878296 (3.074920415878296) | > loss_disc_real_0: 0.1405864953994751 (0.1405864953994751) | > loss_disc_real_1: 0.2741912007331848 (0.2741912007331848) | > loss_disc_real_2: 0.2682725489139557 (0.2682725489139557) | > loss_disc_real_3: 0.3147263526916504 (0.3147263526916504) | > loss_disc_real_4: 0.25258612632751465 (0.25258612632751465) | > loss_disc_real_5: 0.16377167403697968 (0.16377167403697968) | > loss_0: 3.074920415878296 (3.074920415878296) | > loss_gen: 1.4023340940475464 (1.4023340940475464) | > loss_kl: 4.317619323730469 (4.317619323730469) | > loss_feat: 0.11909060180187225 (0.11909060180187225) | > loss_mel: 2.0984601974487305 (2.0984601974487305) | > loss_duration: 2.7430527210235596 (2.7430527210235596) | > loss_1: 10.680557250976562 (10.680557250976562)  --> STEP: 1 | > loss_disc: 2.2284677028656006 (2.2284677028656006) | > loss_disc_real_0: 0.1733700931072235 (0.1733700931072235) | > loss_disc_real_1: 0.22296592593193054 (0.22296592593193054) | > loss_disc_real_2: 0.34670960903167725 (0.34670960903167725) | > loss_disc_real_3: 0.24147944152355194 (0.24147944152355194) | > loss_disc_real_4: 0.09528287500143051 (0.09528287500143051) | > loss_disc_real_5: 0.10555507987737656 (0.10555507987737656) | > loss_0: 2.2284677028656006 (2.2284677028656006) | > loss_gen: 2.4517879486083984 (2.4517879486083984) | > loss_kl: 4.710530757904053 (4.710530757904053) | > loss_feat: 6.623834133148193 (6.623834133148193) | > loss_mel: 23.394052505493164 (23.394052505493164) | > loss_duration: 3.1014933586120605 (3.1014933586120605) | > loss_1: 40.281700134277344 (40.281700134277344)  --> STEP: 2 | > loss_disc: 2.337130546569824 (2.2827991247177124) | > loss_disc_real_0: 0.2630624771118164 (0.21821628510951996) | > loss_disc_real_1: 0.2428632378578186 (0.23291458189487457) | > loss_disc_real_2: 0.2762303650379181 (0.31146998703479767) | > loss_disc_real_3: 0.4357728660106659 (0.3386261537671089) | > loss_disc_real_4: 0.1848416030406952 (0.14006223902106285) | > loss_disc_real_5: 0.1846817582845688 (0.14511841908097267) | > loss_0: 2.337130546569824 (2.2827991247177124) | > loss_gen: 2.7010955810546875 (2.576441764831543) | > loss_kl: 5.2174296379089355 (4.963980197906494) | > loss_feat: 4.09751033782959 (5.360672235488892) | > loss_mel: 23.78040885925293 (23.587230682373047) | > loss_duration: 2.966121196746826 (3.0338072776794434) | > loss_1: 38.76256561279297 (39.522132873535156)  --> STEP: 3 | > loss_disc: 2.897360324859619 (2.487652858098348) | > loss_disc_real_0: 0.15615686774253845 (0.19752981265385947) | > loss_disc_real_1: 0.2965380847454071 (0.25412241617838544) | > loss_disc_real_2: 0.2617526948451996 (0.29489755630493164) | > loss_disc_real_3: 0.33790138363838196 (0.33838456372419995) | > loss_disc_real_4: 0.2752799987792969 (0.18513482560714087) | > loss_disc_real_5: 0.19496244192123413 (0.16173309336105982) | > loss_0: 2.897360324859619 (2.487652858098348) | > loss_gen: 1.6752760410308838 (2.2760531902313232) | > loss_kl: 2.338737726211548 (4.088899374008179) | > loss_feat: 0.9491125345230103 (3.890152335166931) | > loss_mel: 16.161781311035156 (21.112080891927082) | > loss_duration: 2.7776358127593994 (2.948416789372762) | > loss_1: 23.902542114257812 (34.31560262044271) --> EVAL PERFORMANCE | > avg_loader_time: 0.01131733258565267 (+0.008719841639200848) | > avg_loss_disc: 2.487652858098348 (+0.015355745951334931) | > avg_loss_disc_real_0: 0.19752981265385947 (+0.03470883766810101) | > avg_loss_disc_real_1: 0.25412241617838544 (+0.08383243655165037) | > avg_loss_disc_real_2: 0.29489755630493164 (+0.13897021735707918) | > avg_loss_disc_real_3: 0.33838456372419995 (+0.08801979819933575) | > avg_loss_disc_real_4: 0.18513482560714087 (+0.025338382770617812) | > avg_loss_disc_real_5: 0.16173309336105982 (-0.02969232325752577) | > avg_loss_0: 2.487652858098348 (+0.015355745951334931) | > avg_loss_gen: 2.2760531902313232 (+0.26064984003702785) | > avg_loss_kl: 4.088899374008179 (+0.08065056800842285) | > avg_loss_feat: 3.890152335166931 (-4.394601782162985) | > avg_loss_mel: 21.112080891927082 (-4.069414138793945) | > avg_loss_duration: 2.948416789372762 (+0.04023019472758005) | > avg_loss_1: 34.31560262044271 (-8.08248519897461)  > EPOCH: 708/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:02:46)   --> TIME: 2023-10-20 08:02:58 -- STEP: 9/50 -- GLOBAL_STEP: 88410 | > loss_disc: 3.0506675243377686 (2.41444014178382) | > loss_disc_real_0: 0.2118988037109375 (0.15763073248995674) | > loss_disc_real_1: 0.22098617255687714 (0.19492603465914726) | > loss_disc_real_2: 0.35820338129997253 (0.2501819853981336) | > loss_disc_real_3: 0.43318861722946167 (0.264617667429977) | > loss_disc_real_4: 0.37375420331954956 (0.25523722999625736) | > loss_disc_real_5: 0.5774989724159241 (0.26369521270195645) | > loss_0: 3.0506675243377686 (2.41444014178382) | > grad_norm_0: tensor(566.3153, device='cuda:0') (tensor(499.4066, device='cuda:0')) | > loss_gen: 2.618645191192627 (2.561838600370619) | > loss_kl: 0.6198858022689819 (0.9193510810534159) | > loss_feat: 4.5276031494140625 (5.72642715771993) | > loss_mel: 20.502901077270508 (21.51048533121745) | > loss_duration: 1.3348757028579712 (1.4388480054007635) | > loss_1: 29.603910446166992 (32.15694936116537) | > grad_norm_1: tensor(13968.0947, device='cuda:0') (tensor(15029.7471, device='cuda:0')) | > current_lr_0: 9.852133393117358e-05 | > current_lr_1: 9.852133393117358e-05 | > step_time: 0.6729 (0.7629985014597574) | > loader_time: 0.0244 (0.027635653813680012)  --> TIME: 2023-10-20 08:03:14 -- STEP: 39/50 -- GLOBAL_STEP: 88440 | > loss_disc: 2.95517635345459 (2.513299449896201) | > loss_disc_real_0: 0.113685742020607 (0.1533032885919779) | > loss_disc_real_1: 0.27999114990234375 (0.2262153317913031) | > loss_disc_real_2: 0.25966042280197144 (0.23593990170420745) | > loss_disc_real_3: 0.2672370374202728 (0.24146819219757348) | > loss_disc_real_4: 0.24567340314388275 (0.24493911422980139) | > loss_disc_real_5: 0.23482780158519745 (0.2580972735602887) | > loss_0: 2.95517635345459 (2.513299449896201) | > grad_norm_0: tensor(1041.5151, device='cuda:0') (tensor(641.9363, device='cuda:0')) | > loss_gen: 1.5253969430923462 (2.3292972307938795) | > loss_kl: 0.7875751256942749 (0.8672169019014407) | > loss_feat: 0.21016155183315277 (4.9911795283357305) | > loss_mel: 7.934218883514404 (19.47769990639809) | > loss_duration: 1.4372626543045044 (1.4201328723858564) | > loss_1: 11.894615173339844 (29.08552624629094) | > grad_norm_1: tensor(28122.9688, device='cuda:0') (tensor(22171.6953, device='cuda:0')) | > current_lr_0: 9.852133393117358e-05 | > current_lr_1: 9.852133393117358e-05 | > step_time: 0.5741 (0.5727269649505613) | > loader_time: 0.0337 (0.017875041717138045)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.835434675216675 (2.835434675216675) | > loss_disc_real_0: 0.17180892825126648 (0.17180892825126648) | > loss_disc_real_1: 0.24516741931438446 (0.24516741931438446) | > loss_disc_real_2: 0.1639276146888733 (0.1639276146888733) | > loss_disc_real_3: 0.33007514476776123 (0.33007514476776123) | > loss_disc_real_4: 0.2227421998977661 (0.2227421998977661) | > loss_disc_real_5: 0.226128488779068 (0.226128488779068) | > loss_0: 2.835434675216675 (2.835434675216675) | > loss_gen: 1.6063653230667114 (1.6063653230667114) | > loss_kl: 3.884629726409912 (3.884629726409912) | > loss_feat: 2.3244247436523438 (2.3244247436523438) | > loss_mel: 21.01387596130371 (21.01387596130371) | > loss_duration: 2.769028902053833 (2.769028902053833) | > loss_1: 31.598325729370117 (31.598325729370117)  --> STEP: 1 | > loss_disc: 2.0907340049743652 (2.0907340049743652) | > loss_disc_real_0: 0.10320568084716797 (0.10320568084716797) | > loss_disc_real_1: 0.2265969216823578 (0.2265969216823578) | > loss_disc_real_2: 0.09412401169538498 (0.09412401169538498) | > loss_disc_real_3: 0.21021071076393127 (0.21021071076393127) | > loss_disc_real_4: 0.2664351165294647 (0.2664351165294647) | > loss_disc_real_5: 0.13792423903942108 (0.13792423903942108) | > loss_0: 2.0907340049743652 (2.0907340049743652) | > loss_gen: 2.3674075603485107 (2.3674075603485107) | > loss_kl: 4.447299480438232 (4.447299480438232) | > loss_feat: 6.9298930168151855 (6.9298930168151855) | > loss_mel: 24.387197494506836 (24.387197494506836) | > loss_duration: 2.983647346496582 (2.983647346496582) | > loss_1: 41.11544418334961 (41.11544418334961)  --> STEP: 2 | > loss_disc: 2.965421676635742 (2.5280778408050537) | > loss_disc_real_0: 0.17665575444698334 (0.13993071764707565) | > loss_disc_real_1: 0.24242398142814636 (0.23451045155525208) | > loss_disc_real_2: 0.20728649199008942 (0.1507052518427372) | > loss_disc_real_3: 0.40737995505332947 (0.30879533290863037) | > loss_disc_real_4: 0.5578681230545044 (0.41215161979198456) | > loss_disc_real_5: 0.4439392685890198 (0.29093175381422043) | > loss_0: 2.965421676635742 (2.5280778408050537) | > loss_gen: 2.599949598312378 (2.4836785793304443) | > loss_kl: 5.287067890167236 (4.867183685302734) | > loss_feat: 7.106253623962402 (7.018073320388794) | > loss_mel: 25.470170974731445 (24.92868423461914) | > loss_duration: 2.927532911300659 (2.9555901288986206) | > loss_1: 43.39097595214844 (42.25321006774902)  --> STEP: 3 | > loss_disc: 2.948603630065918 (2.6682531038920083) | > loss_disc_real_0: 0.35667237639427185 (0.2121779372294744) | > loss_disc_real_1: 0.27008378505706787 (0.24636822938919067) | > loss_disc_real_2: 0.2466960996389389 (0.18270220110813776) | > loss_disc_real_3: 0.2569241523742676 (0.2915049393971761) | > loss_disc_real_4: 0.3034830093383789 (0.37592874964078266) | > loss_disc_real_5: 0.2668910324573517 (0.28291818002859753) | > loss_0: 2.948603630065918 (2.6682531038920083) | > loss_gen: 1.8385660648345947 (2.2686410744984946) | > loss_kl: 2.570885419845581 (4.10175093015035) | > loss_feat: 1.4873690605163574 (5.174505233764648) | > loss_mel: 19.9393367767334 (23.265568415323894) | > loss_duration: 2.896622657775879 (2.93593430519104) | > loss_1: 28.73278045654297 (37.74640019734701) --> EVAL PERFORMANCE | > avg_loader_time: 0.004739046096801758 (-0.006578286488850912) | > avg_loss_disc: 2.6682531038920083 (+0.18060024579366019) | > avg_loss_disc_real_0: 0.2121779372294744 (+0.01464812457561493) | > avg_loss_disc_real_1: 0.24636822938919067 (-0.007754186789194761) | > avg_loss_disc_real_2: 0.18270220110813776 (-0.11219535519679388) | > avg_loss_disc_real_3: 0.2915049393971761 (-0.04687962432702386) | > avg_loss_disc_real_4: 0.37592874964078266 (+0.1907939240336418) | > avg_loss_disc_real_5: 0.28291818002859753 (+0.12118508666753772) | > avg_loss_0: 2.6682531038920083 (+0.18060024579366019) | > avg_loss_gen: 2.2686410744984946 (-0.007412115732828628) | > avg_loss_kl: 4.10175093015035 (+0.012851556142170928) | > avg_loss_feat: 5.174505233764648 (+1.2843528985977173) | > avg_loss_mel: 23.265568415323894 (+2.1534875233968123) | > avg_loss_duration: 2.93593430519104 (-0.012482484181722153) | > avg_loss_1: 37.74640019734701 (+3.430797576904297)  > EPOCH: 709/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:03:35)   --> TIME: 2023-10-20 08:03:55 -- STEP: 19/50 -- GLOBAL_STEP: 88470 | > loss_disc: 2.8782382011413574 (2.51638841001611) | > loss_disc_real_0: 0.3807426691055298 (0.19124735078137173) | > loss_disc_real_1: 0.2549525201320648 (0.22031303808877342) | > loss_disc_real_2: 0.24029481410980225 (0.23274685442447662) | > loss_disc_real_3: 0.268435537815094 (0.24713315069675446) | > loss_disc_real_4: 0.20083437860012054 (0.24128272854968122) | > loss_disc_real_5: 0.38559412956237793 (0.22947398073187) | > loss_0: 2.8782382011413574 (2.51638841001611) | > grad_norm_0: tensor(894.4818, device='cuda:0') (tensor(627.4044, device='cuda:0')) | > loss_gen: 2.3251967430114746 (2.239167012666401) | > loss_kl: 0.6623750329017639 (0.7460434687765021) | > loss_feat: 3.2157487869262695 (4.807476528381047) | > loss_mel: 12.01054573059082 (20.35938383403577) | > loss_duration: 1.5376670360565186 (1.4596470155214007) | > loss_1: 19.75153350830078 (29.611717625668174) | > grad_norm_1: tensor(11101.4346, device='cuda:0') (tensor(14660.3105, device='cuda:0')) | > current_lr_0: 9.842285568955188e-05 | > current_lr_1: 9.842285568955188e-05 | > step_time: 0.8061 (0.6213830772199129) | > loader_time: 0.0273 (0.015123015955874794)  --> TIME: 2023-10-20 08:04:15 -- STEP: 49/50 -- GLOBAL_STEP: 88500 | > loss_disc: 2.6480765342712402 (2.515397714108836) | > loss_disc_real_0: 0.21111002564430237 (0.17800960243128391) | > loss_disc_real_1: 0.2248680293560028 (0.22752008727770678) | > loss_disc_real_2: 0.20266938209533691 (0.22986855551752508) | > loss_disc_real_3: 0.20657402276992798 (0.23373811737615235) | > loss_disc_real_4: 0.19668805599212646 (0.225858332209137) | > loss_disc_real_5: 0.22622491419315338 (0.22279770577288405) | > loss_0: 2.6480765342712402 (2.515397714108836) | > grad_norm_0: tensor(769.4151, device='cuda:0') (tensor(686.4719, device='cuda:0')) | > loss_gen: 2.3260207176208496 (2.253663376886018) | > loss_kl: 0.8898069858551025 (0.7849181689778153) | > loss_feat: 5.041715621948242 (4.8537093839817205) | > loss_mel: 21.578054428100586 (19.48943450377912) | > loss_duration: 1.5509787797927856 (1.4150311022388686) | > loss_1: 31.386577606201172 (28.796756705459284) | > grad_norm_1: tensor(21786.2793, device='cuda:0') (tensor(19940.2031, device='cuda:0')) | > current_lr_0: 9.842285568955188e-05 | > current_lr_1: 9.842285568955188e-05 | > step_time: 0.9956 (0.6261712969565877) | > loader_time: 0.447 (0.026497865209774103)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5720129013061523 (2.5720129013061523) | > loss_disc_real_0: 0.32144737243652344 (0.32144737243652344) | > loss_disc_real_1: 0.26061946153640747 (0.26061946153640747) | > loss_disc_real_2: 0.17243023216724396 (0.17243023216724396) | > loss_disc_real_3: 0.3237874507904053 (0.3237874507904053) | > loss_disc_real_4: 0.2322341352701187 (0.2322341352701187) | > loss_disc_real_5: 0.22264361381530762 (0.22264361381530762) | > loss_0: 2.5720129013061523 (2.5720129013061523) | > loss_gen: 2.5468907356262207 (2.5468907356262207) | > loss_kl: 4.128686904907227 (4.128686904907227) | > loss_feat: 5.532568454742432 (5.532568454742432) | > loss_mel: 21.60842514038086 (21.60842514038086) | > loss_duration: 2.83158802986145 (2.83158802986145) | > loss_1: 36.64815902709961 (36.64815902709961)  --> STEP: 1 | > loss_disc: 2.0342702865600586 (2.0342702865600586) | > loss_disc_real_0: 0.12508755922317505 (0.12508755922317505) | > loss_disc_real_1: 0.20488029718399048 (0.20488029718399048) | > loss_disc_real_2: 0.19848917424678802 (0.19848917424678802) | > loss_disc_real_3: 0.17702630162239075 (0.17702630162239075) | > loss_disc_real_4: 0.2153153419494629 (0.2153153419494629) | > loss_disc_real_5: 0.16091743111610413 (0.16091743111610413) | > loss_0: 2.0342702865600586 (2.0342702865600586) | > loss_gen: 3.0440874099731445 (3.0440874099731445) | > loss_kl: 4.272326469421387 (4.272326469421387) | > loss_feat: 8.389358520507812 (8.389358520507812) | > loss_mel: 23.135238647460938 (23.135238647460938) | > loss_duration: 3.1150248050689697 (3.1150248050689697) | > loss_1: 41.95603561401367 (41.95603561401367)  --> STEP: 2 | > loss_disc: 2.7101311683654785 (2.3722007274627686) | > loss_disc_real_0: 0.13826632499694824 (0.13167694211006165) | > loss_disc_real_1: 0.25190266966819763 (0.22839148342609406) | > loss_disc_real_2: 0.2747768759727478 (0.2366330251097679) | > loss_disc_real_3: 0.3112179934978485 (0.24412214756011963) | > loss_disc_real_4: 0.2908954322338104 (0.25310538709163666) | > loss_disc_real_5: 0.23564785718917847 (0.1982826441526413) | > loss_0: 2.7101311683654785 (2.3722007274627686) | > loss_gen: 2.105415105819702 (2.5747512578964233) | > loss_kl: 5.630391597747803 (4.951359033584595) | > loss_feat: 3.2057528495788574 (5.797555685043335) | > loss_mel: 11.02529525756836 (17.08026695251465) | > loss_duration: 2.9757375717163086 (3.045381188392639) | > loss_1: 24.94259262084961 (33.44931411743164)  --> STEP: 3 | > loss_disc: 1.882814884185791 (2.2090721130371094) | > loss_disc_real_0: 0.0244692862033844 (0.09594105680783589) | > loss_disc_real_1: 0.12729427218437195 (0.19469241301218668) | > loss_disc_real_2: 0.10690820962190628 (0.19339141994714737) | > loss_disc_real_3: 0.14382141828536987 (0.21068857113520303) | > loss_disc_real_4: 0.09787251055240631 (0.20136109491189322) | > loss_disc_real_5: 0.08847653865814209 (0.16168060898780823) | > loss_0: 1.882814884185791 (2.2090721130371094) | > loss_gen: 1.9946038722991943 (2.38136879603068) | > loss_kl: 2.102356433868408 (4.001691500345866) | > loss_feat: 5.961467742919922 (5.852193037668864) | > loss_mel: 24.00179100036621 (19.387441635131836) | > loss_duration: 2.7985575199127197 (2.963106632232666) | > loss_1: 36.85877227783203 (34.58580017089844) --> EVAL PERFORMANCE | > avg_loader_time: 0.008186737696329752 (+0.003447691599527994) | > avg_loss_disc: 2.2090721130371094 (-0.45918099085489894) | > avg_loss_disc_real_0: 0.09594105680783589 (-0.1162368804216385) | > avg_loss_disc_real_1: 0.19469241301218668 (-0.051675816377004) | > avg_loss_disc_real_2: 0.19339141994714737 (+0.010689218839009612) | > avg_loss_disc_real_3: 0.21068857113520303 (-0.08081636826197305) | > avg_loss_disc_real_4: 0.20136109491189322 (-0.17456765472888944) | > avg_loss_disc_real_5: 0.16168060898780823 (-0.1212375710407893) | > avg_loss_0: 2.2090721130371094 (-0.45918099085489894) | > avg_loss_gen: 2.38136879603068 (+0.11272772153218558) | > avg_loss_kl: 4.001691500345866 (-0.10005942980448346) | > avg_loss_feat: 5.852193037668864 (+0.6776878039042158) | > avg_loss_mel: 19.387441635131836 (-3.8781267801920585) | > avg_loss_duration: 2.963106632232666 (+0.027172327041625977) | > avg_loss_1: 34.58580017089844 (-3.16060002644857)  > EPOCH: 710/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:04:26)   --> TIME: 2023-10-20 08:04:52 -- STEP: 29/50 -- GLOBAL_STEP: 88530 | > loss_disc: 3.0212392807006836 (2.3469436127564003) | > loss_disc_real_0: 0.22254708409309387 (0.13647242340034452) | > loss_disc_real_1: 0.27656304836273193 (0.2159518850003851) | > loss_disc_real_2: 0.2679692506790161 (0.21981512446855678) | > loss_disc_real_3: 0.279744416475296 (0.22485019574905263) | > loss_disc_real_4: 0.289326548576355 (0.1988654588830882) | > loss_disc_real_5: 0.3487381339073181 (0.21110000422802463) | > loss_0: 3.0212392807006836 (2.3469436127564003) | > grad_norm_0: tensor(2418.4709, device='cuda:0') (tensor(814.4992, device='cuda:0')) | > loss_gen: 1.729394555091858 (2.3703258325313694) | > loss_kl: 0.755285918712616 (0.7820653504338758) | > loss_feat: 0.5160663723945618 (5.923944319116658) | > loss_mel: 10.343599319458008 (22.219197437681) | > loss_duration: 1.414637565612793 (1.4387051319253856) | > loss_1: 14.758984565734863 (32.734237901095675) | > grad_norm_1: tensor(7826.3330, device='cuda:0') (tensor(26063.6035, device='cuda:0')) | > current_lr_0: 9.832447588309834e-05 | > current_lr_1: 9.832447588309834e-05 | > step_time: 0.6736 (0.5583197166179789) | > loader_time: 0.0099 (0.014271448398458546)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3192946910858154 (2.3192946910858154) | > loss_disc_real_0: 0.07947781682014465 (0.07947781682014465) | > loss_disc_real_1: 0.14796744287014008 (0.14796744287014008) | > loss_disc_real_2: 0.2085450142621994 (0.2085450142621994) | > loss_disc_real_3: 0.3014429807662964 (0.3014429807662964) | > loss_disc_real_4: 0.19200028479099274 (0.19200028479099274) | > loss_disc_real_5: 0.21877004206180573 (0.21877004206180573) | > loss_0: 2.3192946910858154 (2.3192946910858154) | > loss_gen: 2.951348304748535 (2.951348304748535) | > loss_kl: 4.418467044830322 (4.418467044830322) | > loss_feat: 8.731151580810547 (8.731151580810547) | > loss_mel: 24.24265480041504 (24.24265480041504) | > loss_duration: 2.732884168624878 (2.732884168624878) | > loss_1: 43.07650375366211 (43.07650375366211)  --> STEP: 1 | > loss_disc: 2.1521008014678955 (2.1521008014678955) | > loss_disc_real_0: 0.1923789381980896 (0.1923789381980896) | > loss_disc_real_1: 0.3325004279613495 (0.3325004279613495) | > loss_disc_real_2: 0.2826414704322815 (0.2826414704322815) | > loss_disc_real_3: 0.19574156403541565 (0.19574156403541565) | > loss_disc_real_4: 0.2999902069568634 (0.2999902069568634) | > loss_disc_real_5: 0.13148371875286102 (0.13148371875286102) | > loss_0: 2.1521008014678955 (2.1521008014678955) | > loss_gen: 3.4841465950012207 (3.4841465950012207) | > loss_kl: 4.475335597991943 (4.475335597991943) | > loss_feat: 9.486429214477539 (9.486429214477539) | > loss_mel: 26.05460548400879 (26.05460548400879) | > loss_duration: 3.1042068004608154 (3.1042068004608154) | > loss_1: 46.6047248840332 (46.6047248840332)  --> STEP: 2 | > loss_disc: 3.0180504322052 (2.585075616836548) | > loss_disc_real_0: 0.28537899255752563 (0.23887896537780762) | > loss_disc_real_1: 0.2766791880130768 (0.30458980798721313) | > loss_disc_real_2: 0.2149980068206787 (0.2488197386264801) | > loss_disc_real_3: 0.2527231276035309 (0.22423234581947327) | > loss_disc_real_4: 0.29293057322502136 (0.2964603900909424) | > loss_disc_real_5: 0.29582318663597107 (0.21365345269441605) | > loss_0: 3.0180504322052 (2.585075616836548) | > loss_gen: 1.6132478713989258 (2.5486972332000732) | > loss_kl: 4.958765983581543 (4.717050790786743) | > loss_feat: 0.0265999436378479 (4.7565145790576935) | > loss_mel: 1.306498646736145 (13.680552065372467) | > loss_duration: 3.1240053176879883 (3.114106059074402) | > loss_1: 11.029117584228516 (28.81692123413086)  --> STEP: 3 | > loss_disc: 2.9669995307922363 (2.712383588155111) | > loss_disc_real_0: 0.3102867603302002 (0.2626815636952718) | > loss_disc_real_1: 0.2875290513038635 (0.29890288909276325) | > loss_disc_real_2: 0.2379390150308609 (0.2451928307612737) | > loss_disc_real_3: 0.25940826535224915 (0.23595765233039856) | > loss_disc_real_4: 0.29232388734817505 (0.29508155584335327) | > loss_disc_real_5: 0.2990078330039978 (0.24210491279760996) | > loss_0: 2.9669995307922363 (2.712383588155111) | > loss_gen: 1.7787619829177856 (2.292052149772644) | > loss_kl: 2.2797634601593018 (3.904621680577596) | > loss_feat: 0.40866297483444214 (3.3072307109832764) | > loss_mel: 13.737792015075684 (13.699632048606873) | > loss_duration: 2.765735626220703 (2.9979825814565024) | > loss_1: 20.97071647644043 (26.20151964823405) --> EVAL PERFORMANCE | > avg_loader_time: 0.014183123906453451 (+0.005996386210123699) | > avg_loss_disc: 2.712383588155111 (+0.5033114751180015) | > avg_loss_disc_real_0: 0.2626815636952718 (+0.1667405068874359) | > avg_loss_disc_real_1: 0.29890288909276325 (+0.10421047608057657) | > avg_loss_disc_real_2: 0.2451928307612737 (+0.05180141081412634) | > avg_loss_disc_real_3: 0.23595765233039856 (+0.025269081195195525) | > avg_loss_disc_real_4: 0.29508155584335327 (+0.09372046093146005) | > avg_loss_disc_real_5: 0.24210491279760996 (+0.08042430380980173) | > avg_loss_0: 2.712383588155111 (+0.5033114751180015) | > avg_loss_gen: 2.292052149772644 (-0.08931664625803615) | > avg_loss_kl: 3.904621680577596 (-0.09706981976827) | > avg_loss_feat: 3.3072307109832764 (-2.544962326685588) | > avg_loss_mel: 13.699632048606873 (-5.687809586524963) | > avg_loss_duration: 2.9979825814565024 (+0.03487594922383641) | > avg_loss_1: 26.20151964823405 (-8.384280522664387)  > EPOCH: 711/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:05:19)   --> TIME: 2023-10-20 08:05:31 -- STEP: 9/50 -- GLOBAL_STEP: 88560 | > loss_disc: 2.7181568145751953 (2.3442592355940075) | > loss_disc_real_0: 0.06431600451469421 (0.1605267028013865) | > loss_disc_real_1: 0.2947928309440613 (0.2157669866250621) | > loss_disc_real_2: 0.2616869807243347 (0.19645481432477632) | > loss_disc_real_3: 0.29188835620880127 (0.1943228907055325) | > loss_disc_real_4: 0.27168527245521545 (0.22561390915264687) | > loss_disc_real_5: 0.2637552320957184 (0.22204672545194626) | > loss_0: 2.7181568145751953 (2.3442592355940075) | > grad_norm_0: tensor(637.1387, device='cuda:0') (tensor(483.4884, device='cuda:0')) | > loss_gen: 1.9866307973861694 (2.3712324566311307) | > loss_kl: 0.6897420287132263 (0.9042466812663608) | > loss_feat: 3.0079169273376465 (6.639940469629234) | > loss_mel: 23.77959632873535 (22.721203909979927) | > loss_duration: 1.3909896612167358 (1.3891204198201497) | > loss_1: 30.854875564575195 (34.025743908352325) | > grad_norm_1: tensor(3823.7407, device='cuda:0') (tensor(21368.3262, device='cuda:0')) | > current_lr_0: 9.822619441342086e-05 | > current_lr_1: 9.822619441342086e-05 | > step_time: 0.5918 (0.645288176006741) | > loader_time: 0.0043 (0.02830118603176541)  --> TIME: 2023-10-20 08:05:50 -- STEP: 39/50 -- GLOBAL_STEP: 88590 | > loss_disc: 1.6579917669296265 (2.5731819592989407) | > loss_disc_real_0: 0.03958304971456528 (0.17635384789453104) | > loss_disc_real_1: 0.15671828389167786 (0.22182496035328278) | > loss_disc_real_2: 0.12602366507053375 (0.21897385192987245) | > loss_disc_real_3: 0.08008719235658646 (0.2393106830616792) | > loss_disc_real_4: 0.0839269757270813 (0.2340865649808294) | > loss_disc_real_5: 0.1805725395679474 (0.24849253367537108) | > loss_0: 1.6579917669296265 (2.5731819592989407) | > grad_norm_0: tensor(683.2651, device='cuda:0') (tensor(669.0789, device='cuda:0')) | > loss_gen: 3.145977735519409 (2.2596589907621727) | > loss_kl: -0.00446327542886138 (0.8928644514451616) | > loss_feat: 9.563314437866211 (5.132704806633485) | > loss_mel: 26.157291412353516 (20.50275977146931) | > loss_duration: 1.4601227045059204 (1.4153162332681508) | > loss_1: 40.32223892211914 (30.203304058466202) | > grad_norm_1: tensor(67416.0234, device='cuda:0') (tensor(19442.8496, device='cuda:0')) | > current_lr_0: 9.822619441342086e-05 | > current_lr_1: 9.822619441342086e-05 | > step_time: 0.5567 (0.6368084870851957) | > loader_time: 0.0254 (0.023261198630699746)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1765239238739014 (2.1765239238739014) | > loss_disc_real_0: 0.08059938251972198 (0.08059938251972198) | > loss_disc_real_1: 0.1540067344903946 (0.1540067344903946) | > loss_disc_real_2: 0.11277101933956146 (0.11277101933956146) | > loss_disc_real_3: 0.20494243502616882 (0.20494243502616882) | > loss_disc_real_4: 0.1831469088792801 (0.1831469088792801) | > loss_disc_real_5: 0.22006855905056 (0.22006855905056) | > loss_0: 2.1765239238739014 (2.1765239238739014) | > loss_gen: 1.9780993461608887 (1.9780993461608887) | > loss_kl: 4.280760288238525 (4.280760288238525) | > loss_feat: 4.382194519042969 (4.382194519042969) | > loss_mel: 23.07623863220215 (23.07623863220215) | > loss_duration: 2.8432610034942627 (2.8432610034942627) | > loss_1: 36.56055450439453 (36.56055450439453)  --> STEP: 1 | > loss_disc: 1.9156310558319092 (1.9156310558319092) | > loss_disc_real_0: 0.19056999683380127 (0.19056999683380127) | > loss_disc_real_1: 0.29924124479293823 (0.29924124479293823) | > loss_disc_real_2: 0.23192940652370453 (0.23192940652370453) | > loss_disc_real_3: 0.22475820779800415 (0.22475820779800415) | > loss_disc_real_4: 0.16901753842830658 (0.16901753842830658) | > loss_disc_real_5: 0.2533727288246155 (0.2533727288246155) | > loss_0: 1.9156310558319092 (1.9156310558319092) | > loss_gen: 3.688444137573242 (3.688444137573242) | > loss_kl: 4.7463483810424805 (4.7463483810424805) | > loss_feat: 7.053915023803711 (7.053915023803711) | > loss_mel: 24.967281341552734 (24.967281341552734) | > loss_duration: 3.096689462661743 (3.096689462661743) | > loss_1: 43.552677154541016 (43.552677154541016)  --> STEP: 2 | > loss_disc: 2.342184543609619 (2.128907799720764) | > loss_disc_real_0: 0.24616149067878723 (0.21836574375629425) | > loss_disc_real_1: 0.20658598840236664 (0.25291361659765244) | > loss_disc_real_2: 0.16442781686782837 (0.19817861169576645) | > loss_disc_real_3: 0.1928081065416336 (0.20878315716981888) | > loss_disc_real_4: 0.12554924190044403 (0.1472833901643753) | > loss_disc_real_5: 0.30773237347602844 (0.28055255115032196) | > loss_0: 2.342184543609619 (2.128907799720764) | > loss_gen: 2.5813357830047607 (3.1348899602890015) | > loss_kl: 4.8812994956970215 (4.813823938369751) | > loss_feat: 7.030784606933594 (7.042349815368652) | > loss_mel: 24.651546478271484 (24.80941390991211) | > loss_duration: 2.99345064163208 (3.0450700521469116) | > loss_1: 42.1384162902832 (42.84554672241211)  --> STEP: 3 | > loss_disc: 1.4275614023208618 (1.8951256672541301) | > loss_disc_real_0: 0.038009241223335266 (0.15824690957864126) | > loss_disc_real_1: 0.07007409632205963 (0.1919671098391215) | > loss_disc_real_2: 0.11043164879083633 (0.16892962406078973) | > loss_disc_real_3: 0.07107855379581451 (0.16288162271181741) | > loss_disc_real_4: 0.1554333120584488 (0.15000003079573312) | > loss_disc_real_5: 0.12687653303146362 (0.22932721177736917) | > loss_0: 1.4275614023208618 (1.8951256672541301) | > loss_gen: 3.8310368061065674 (3.366938908894857) | > loss_kl: 2.0907039642333984 (3.9061172803243003) | > loss_feat: 10.98526668548584 (8.356655438741049) | > loss_mel: 23.810771942138672 (24.47653325398763) | > loss_duration: 2.761812925338745 (2.950651009877523) | > loss_1: 43.479591369628906 (43.05689493815104) --> EVAL PERFORMANCE | > avg_loader_time: 0.00623011589050293 (-0.007953008015950521) | > avg_loss_disc: 1.8951256672541301 (-0.8172579209009807) | > avg_loss_disc_real_0: 0.15824690957864126 (-0.10443465411663053) | > avg_loss_disc_real_1: 0.1919671098391215 (-0.10693577925364176) | > avg_loss_disc_real_2: 0.16892962406078973 (-0.07626320670048398) | > avg_loss_disc_real_3: 0.16288162271181741 (-0.07307602961858115) | > avg_loss_disc_real_4: 0.15000003079573312 (-0.14508152504762015) | > avg_loss_disc_real_5: 0.22932721177736917 (-0.012777701020240784) | > avg_loss_0: 1.8951256672541301 (-0.8172579209009807) | > avg_loss_gen: 3.366938908894857 (+1.0748867591222129) | > avg_loss_kl: 3.9061172803243003 (+0.0014955997467041016) | > avg_loss_feat: 8.356655438741049 (+5.049424727757772) | > avg_loss_mel: 24.47653325398763 (+10.776901205380756) | > avg_loss_duration: 2.950651009877523 (-0.04733157157897949) | > avg_loss_1: 43.05689493815104 (+16.85537528991699)  > EPOCH: 712/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:06:15)   --> TIME: 2023-10-20 08:06:29 -- STEP: 19/50 -- GLOBAL_STEP: 88620 | > loss_disc: 2.087357759475708 (2.6047215838181343) | > loss_disc_real_0: 0.13747625052928925 (0.17228263518527934) | > loss_disc_real_1: 0.2585291564464569 (0.2381788045167923) | > loss_disc_real_2: 0.2618984580039978 (0.23566505097244916) | > loss_disc_real_3: 0.23120088875293732 (0.23611525210895037) | > loss_disc_real_4: 0.11755042523145676 (0.24880344067749224) | > loss_disc_real_5: 0.08476696908473969 (0.2561031927011515) | > loss_0: 2.087357759475708 (2.6047215838181343) | > grad_norm_0: tensor(397.6399, device='cuda:0') (tensor(699.6877, device='cuda:0')) | > loss_gen: 2.507586717605591 (2.2140381022503504) | > loss_kl: 0.945354700088501 (0.880090804476487) | > loss_feat: 5.394455909729004 (4.660056994149559) | > loss_mel: 22.1499080657959 (17.79009255610014) | > loss_duration: 1.4866976737976074 (1.4441475178066052) | > loss_1: 32.484004974365234 (26.988426233592786) | > grad_norm_1: tensor(3901.5337, device='cuda:0') (tensor(28673.9375, device='cuda:0')) | > current_lr_0: 9.812801118222564e-05 | > current_lr_1: 9.812801118222564e-05 | > step_time: 0.2511 (0.47114568007619767) | > loader_time: 0.0018 (0.008359231446918688)  --> TIME: 2023-10-20 08:06:47 -- STEP: 49/50 -- GLOBAL_STEP: 88650 | > loss_disc: 2.8730154037475586 (2.5098893934366653) | > loss_disc_real_0: 0.05738397687673569 (0.1626544756700798) | > loss_disc_real_1: 0.21284784376621246 (0.21965185948172394) | > loss_disc_real_2: 0.18140871822834015 (0.22514085091498434) | > loss_disc_real_3: 0.22541722655296326 (0.23082056656783942) | > loss_disc_real_4: 0.5071275234222412 (0.23383411715681457) | > loss_disc_real_5: 0.284466952085495 (0.23102282785943576) | > loss_0: 2.8730154037475586 (2.5098893934366653) | > grad_norm_0: tensor(697.2979, device='cuda:0') (tensor(626.4496, device='cuda:0')) | > loss_gen: 1.9621851444244385 (2.2217318817060825) | > loss_kl: 0.7301018238067627 (0.8196674214333904) | > loss_feat: 6.504249095916748 (5.213040994138133) | > loss_mel: 27.921566009521484 (19.496442828859603) | > loss_duration: 1.5498889684677124 (1.4095784985289281) | > loss_1: 38.667991638183594 (29.16046159121455) | > grad_norm_1: tensor(6080.0649, device='cuda:0') (tensor(22542.9844, device='cuda:0')) | > current_lr_0: 9.812801118222564e-05 | > current_lr_1: 9.812801118222564e-05 | > step_time: 0.7569 (0.5047874499340447) | > loader_time: 0.6341 (0.027374608176095144)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.739215612411499 (2.739215612411499) | > loss_disc_real_0: 0.2207867056131363 (0.2207867056131363) | > loss_disc_real_1: 0.3190414011478424 (0.3190414011478424) | > loss_disc_real_2: 0.321626216173172 (0.321626216173172) | > loss_disc_real_3: 0.2289082258939743 (0.2289082258939743) | > loss_disc_real_4: 0.32672762870788574 (0.32672762870788574) | > loss_disc_real_5: 0.5454420447349548 (0.5454420447349548) | > loss_0: 2.739215612411499 (2.739215612411499) | > loss_gen: 2.8790218830108643 (2.8790218830108643) | > loss_kl: 4.1669135093688965 (4.1669135093688965) | > loss_feat: 5.298798084259033 (5.298798084259033) | > loss_mel: 26.8204345703125 (26.8204345703125) | > loss_duration: 2.904038906097412 (2.904038906097412) | > loss_1: 42.06920623779297 (42.06920623779297)  --> STEP: 1 | > loss_disc: 1.2120840549468994 (1.2120840549468994) | > loss_disc_real_0: 0.2294827252626419 (0.2294827252626419) | > loss_disc_real_1: 0.08048669248819351 (0.08048669248819351) | > loss_disc_real_2: 0.07931385189294815 (0.07931385189294815) | > loss_disc_real_3: 0.05504831671714783 (0.05504831671714783) | > loss_disc_real_4: 0.05508294701576233 (0.05508294701576233) | > loss_disc_real_5: 0.06769046932458878 (0.06769046932458878) | > loss_0: 1.2120840549468994 (1.2120840549468994) | > loss_gen: 3.0445775985717773 (3.0445775985717773) | > loss_kl: 4.859971523284912 (4.859971523284912) | > loss_feat: 15.790252685546875 (15.790252685546875) | > loss_mel: 26.526260375976562 (26.526260375976562) | > loss_duration: 3.0764801502227783 (3.0764801502227783) | > loss_1: 53.297542572021484 (53.297542572021484)  --> STEP: 2 | > loss_disc: 2.6068332195281982 (1.9094586372375488) | > loss_disc_real_0: 0.05984063446521759 (0.14466167986392975) | > loss_disc_real_1: 0.25000983476638794 (0.16524826362729073) | > loss_disc_real_2: 0.302126944065094 (0.19072039797902107) | > loss_disc_real_3: 0.3036074936389923 (0.17932790517807007) | > loss_disc_real_4: 0.30951762199401855 (0.18230028450489044) | > loss_disc_real_5: 0.32412204146385193 (0.19590625539422035) | > loss_0: 2.6068332195281982 (1.9094586372375488) | > loss_gen: 2.325009346008301 (2.684793472290039) | > loss_kl: 4.719221115112305 (4.789596319198608) | > loss_feat: 5.991011619567871 (10.890632152557373) | > loss_mel: 23.007728576660156 (24.76699447631836) | > loss_duration: 3.028151273727417 (3.0523157119750977) | > loss_1: 39.07112121582031 (46.1843318939209)  --> STEP: 3 | > loss_disc: 2.9219202995300293 (2.246945858001709) | > loss_disc_real_0: 0.27276432514190674 (0.1873625616232554) | > loss_disc_real_1: 0.26531314849853516 (0.19860322525103888) | > loss_disc_real_2: 0.3167554438114166 (0.23273207992315292) | > loss_disc_real_3: 0.2369997352361679 (0.19855184853076935) | > loss_disc_real_4: 0.2737809121608734 (0.21279382705688477) | > loss_disc_real_5: 0.2515239715576172 (0.21444549411535263) | > loss_0: 2.9219202995300293 (2.246945858001709) | > loss_gen: 1.7220289707183838 (2.363871971766154) | > loss_kl: 2.1145451068878174 (3.897912581761678) | > loss_feat: 0.4892190992832184 (7.423494468132655) | > loss_mel: 5.734260559082031 (18.422749837239582) | > loss_duration: 2.792205572128296 (2.9656123320261636) | > loss_1: 12.852259635925293 (35.0736411412557) --> EVAL PERFORMANCE | > avg_loader_time: 0.004102547963460286 (-0.0021275679270426435) | > avg_loss_disc: 2.246945858001709 (+0.35182019074757886) | > avg_loss_disc_real_0: 0.1873625616232554 (+0.029115652044614138) | > avg_loss_disc_real_1: 0.19860322525103888 (+0.006636115411917387) | > avg_loss_disc_real_2: 0.23273207992315292 (+0.06380245586236319) | > avg_loss_disc_real_3: 0.19855184853076935 (+0.035670225818951934) | > avg_loss_disc_real_4: 0.21279382705688477 (+0.06279379626115164) | > avg_loss_disc_real_5: 0.21444549411535263 (-0.014881717662016541) | > avg_loss_0: 2.246945858001709 (+0.35182019074757886) | > avg_loss_gen: 2.363871971766154 (-1.003066937128703) | > avg_loss_kl: 3.897912581761678 (-0.00820469856262207) | > avg_loss_feat: 7.423494468132655 (-0.9331609706083936) | > avg_loss_mel: 18.422749837239582 (-6.053783416748047) | > avg_loss_duration: 2.9656123320261636 (+0.014961322148640654) | > avg_loss_1: 35.0736411412557 (-7.98325379689534)  > EPOCH: 713/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:07:01)   --> TIME: 2023-10-20 08:07:25 -- STEP: 29/50 -- GLOBAL_STEP: 88680 | > loss_disc: 3.1000330448150635 (2.456841933316198) | > loss_disc_real_0: 0.12784409523010254 (0.14896196210435753) | > loss_disc_real_1: 0.27021312713623047 (0.22750348424346284) | > loss_disc_real_2: 0.3093436360359192 (0.23006499622916354) | > loss_disc_real_3: 0.23224186897277832 (0.2559552001927433) | > loss_disc_real_4: 0.24790625274181366 (0.21773013215640497) | > loss_disc_real_5: 0.23413754999637604 (0.2151679559610784) | > loss_0: 3.1000330448150635 (2.456841933316198) | > grad_norm_0: tensor(1711.9883, device='cuda:0') (tensor(630.0712, device='cuda:0')) | > loss_gen: 1.485967755317688 (2.433624004495555) | > loss_kl: 0.9125708341598511 (0.9097019218165299) | > loss_feat: 0.16137340664863586 (5.911400238758531) | > loss_mel: 6.230601787567139 (21.67594678648587) | > loss_duration: 1.3939300775527954 (1.437386915601533) | > loss_1: 10.184444427490234 (32.368059700933) | > grad_norm_1: tensor(11784.9561, device='cuda:0') (tensor(27083.7656, device='cuda:0')) | > current_lr_0: 9.802992609131719e-05 | > current_lr_1: 9.802992609131719e-05 | > step_time: 0.3413 (0.6359485511122078) | > loader_time: 0.0035 (0.021531943617195917)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.94966459274292 (2.94966459274292) | > loss_disc_real_0: 0.028423722833395004 (0.028423722833395004) | > loss_disc_real_1: 0.2217472493648529 (0.2217472493648529) | > loss_disc_real_2: 0.2524428069591522 (0.2524428069591522) | > loss_disc_real_3: 0.4111020267009735 (0.4111020267009735) | > loss_disc_real_4: 0.2688579559326172 (0.2688579559326172) | > loss_disc_real_5: 0.371170312166214 (0.371170312166214) | > loss_0: 2.94966459274292 (2.94966459274292) | > loss_gen: 1.8042231798171997 (1.8042231798171997) | > loss_kl: 4.695802688598633 (4.695802688598633) | > loss_feat: 5.680325031280518 (5.680325031280518) | > loss_mel: 22.364837646484375 (22.364837646484375) | > loss_duration: 2.830817699432373 (2.830817699432373) | > loss_1: 37.376007080078125 (37.376007080078125)  --> STEP: 1 | > loss_disc: 1.254988193511963 (1.254988193511963) | > loss_disc_real_0: 0.17068088054656982 (0.17068088054656982) | > loss_disc_real_1: 0.10634418576955795 (0.10634418576955795) | > loss_disc_real_2: 0.052385374903678894 (0.052385374903678894) | > loss_disc_real_3: 0.11025548726320267 (0.11025548726320267) | > loss_disc_real_4: 0.11830875277519226 (0.11830875277519226) | > loss_disc_real_5: 0.0328790657222271 (0.0328790657222271) | > loss_0: 1.254988193511963 (1.254988193511963) | > loss_gen: 3.370601177215576 (3.370601177215576) | > loss_kl: 4.632859230041504 (4.632859230041504) | > loss_feat: 14.300604820251465 (14.300604820251465) | > loss_mel: 25.427736282348633 (25.427736282348633) | > loss_duration: 3.2362756729125977 (3.2362756729125977) | > loss_1: 50.968074798583984 (50.968074798583984)  --> STEP: 2 | > loss_disc: 2.0337038040161133 (1.644345998764038) | > loss_disc_real_0: 0.21591350436210632 (0.19329719245433807) | > loss_disc_real_1: 0.21286974847316742 (0.1596069671213627) | > loss_disc_real_2: 0.19086995720863342 (0.12162766605615616) | > loss_disc_real_3: 0.16826172173023224 (0.13925860449671745) | > loss_disc_real_4: 0.14784350991249084 (0.13307613134384155) | > loss_disc_real_5: 0.23645171523094177 (0.13466539047658443) | > loss_0: 2.0337038040161133 (1.644345998764038) | > loss_gen: 2.903643846511841 (3.1371225118637085) | > loss_kl: 4.732386589050293 (4.682622909545898) | > loss_feat: 10.750664710998535 (12.525634765625) | > loss_mel: 22.882190704345703 (24.154963493347168) | > loss_duration: 3.0575008392333984 (3.146888256072998) | > loss_1: 44.326385498046875 (47.64723014831543)  --> STEP: 3 | > loss_disc: 2.914278507232666 (2.0676568349202475) | > loss_disc_real_0: 0.10902158170938492 (0.16520532220602036) | > loss_disc_real_1: 0.28575676679611206 (0.20165690034627914) | > loss_disc_real_2: 0.2970457971096039 (0.1801003764073054) | > loss_disc_real_3: 0.2509808838367462 (0.17649936427672705) | > loss_disc_real_4: 0.28521066904067993 (0.18378764390945435) | > loss_disc_real_5: 0.36089372634887695 (0.21007483576734862) | > loss_0: 2.914278507232666 (2.0676568349202475) | > loss_gen: 1.9339762926101685 (2.7360737721125283) | > loss_kl: 2.3518927097320557 (3.905712842941284) | > loss_feat: 5.077304363250732 (10.042857964833578) | > loss_mel: 21.790193557739258 (23.36670684814453) | > loss_duration: 2.8546040058135986 (3.0494601726531982) | > loss_1: 34.007972717285156 (43.10081100463867) --> EVAL PERFORMANCE | > avg_loader_time: 0.00994261105855306 (+0.005840063095092774) | > avg_loss_disc: 2.0676568349202475 (-0.17928902308146144) | > avg_loss_disc_real_0: 0.16520532220602036 (-0.022157239417235047) | > avg_loss_disc_real_1: 0.20165690034627914 (+0.003053675095240266) | > avg_loss_disc_real_2: 0.1801003764073054 (-0.05263170351584753) | > avg_loss_disc_real_3: 0.17649936427672705 (-0.0220524842540423) | > avg_loss_disc_real_4: 0.18378764390945435 (-0.02900618314743042) | > avg_loss_disc_real_5: 0.21007483576734862 (-0.004370658348004014) | > avg_loss_0: 2.0676568349202475 (-0.17928902308146144) | > avg_loss_gen: 2.7360737721125283 (+0.3722018003463745) | > avg_loss_kl: 3.905712842941284 (+0.007800261179605972) | > avg_loss_feat: 10.042857964833578 (+2.619363496700923) | > avg_loss_mel: 23.36670684814453 (+4.943957010904949) | > avg_loss_duration: 3.0494601726531982 (+0.08384784062703465) | > avg_loss_1: 43.10081100463867 (+8.027169863382973)  > EPOCH: 714/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:07:50)   --> TIME: 2023-10-20 08:08:01 -- STEP: 9/50 -- GLOBAL_STEP: 88710 | > loss_disc: 2.548496961593628 (2.314706219567193) | > loss_disc_real_0: 0.09666602313518524 (0.14029992992679277) | > loss_disc_real_1: 0.2075633704662323 (0.23073782523473105) | > loss_disc_real_2: 0.34722092747688293 (0.2465557406346003) | > loss_disc_real_3: 0.254607617855072 (0.28315110421843) | > loss_disc_real_4: 0.1865817904472351 (0.18306166016393238) | > loss_disc_real_5: 0.19943739473819733 (0.1662169893582662) | > loss_0: 2.548496961593628 (2.314706219567193) | > grad_norm_0: tensor(472.6466, device='cuda:0') (tensor(635.8832, device='cuda:0')) | > loss_gen: 2.1787526607513428 (2.5558678574032254) | > loss_kl: 0.8469001650810242 (0.7539990958240297) | > loss_feat: 4.401776313781738 (6.383932855394152) | > loss_mel: 15.67563247680664 (22.817688835991753) | > loss_duration: 1.3936872482299805 (1.4199728038575914) | > loss_1: 24.496749877929688 (33.93146154615614) | > grad_norm_1: tensor(33259.3203, device='cuda:0') (tensor(25255.5410, device='cuda:0')) | > current_lr_0: 9.793193904259815e-05 | > current_lr_1: 9.793193904259815e-05 | > step_time: 0.7083 (0.6333838568793403) | > loader_time: 0.031 (0.023737298117743597)  --> TIME: 2023-10-20 08:08:22 -- STEP: 39/50 -- GLOBAL_STEP: 88740 | > loss_disc: 3.00917911529541 (2.5565434327492347) | > loss_disc_real_0: 0.1854839026927948 (0.16800433745942053) | > loss_disc_real_1: 0.22770971059799194 (0.2243745161745793) | > loss_disc_real_2: 0.27012136578559875 (0.22802035434123796) | > loss_disc_real_3: 0.23877695202827454 (0.2518329185744126) | > loss_disc_real_4: 0.2652018070220947 (0.2260908014499224) | > loss_disc_real_5: 0.26190075278282166 (0.23230828058261138) | > loss_0: 3.00917911529541 (2.5565434327492347) | > grad_norm_0: tensor(455.5537, device='cuda:0') (tensor(708.1194, device='cuda:0')) | > loss_gen: 1.4570785760879517 (2.2499802876741466) | > loss_kl: 0.44076013565063477 (0.7595594372504797) | > loss_feat: 0.03468676656484604 (4.824235021685943) | > loss_mel: 1.716474175453186 (19.269500038562676) | > loss_duration: 1.4703131914138794 (1.4183747951801007) | > loss_1: 5.119312763214111 (28.52164959296202) | > grad_norm_1: tensor(69994.8203, device='cuda:0') (tensor(22682.6777, device='cuda:0')) | > current_lr_0: 9.793193904259815e-05 | > current_lr_1: 9.793193904259815e-05 | > step_time: 0.7995 (0.6642584311656463) | > loader_time: 0.0128 (0.024386491530980818)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9629406929016113 (2.9629406929016113) | > loss_disc_real_0: 0.060972101986408234 (0.060972101986408234) | > loss_disc_real_1: 0.20949208736419678 (0.20949208736419678) | > loss_disc_real_2: 0.29928839206695557 (0.29928839206695557) | > loss_disc_real_3: 0.2292863130569458 (0.2292863130569458) | > loss_disc_real_4: 0.28396105766296387 (0.28396105766296387) | > loss_disc_real_5: 0.47007620334625244 (0.47007620334625244) | > loss_0: 2.9629406929016113 (2.9629406929016113) | > loss_gen: 1.9008163213729858 (1.9008163213729858) | > loss_kl: 4.2179388999938965 (4.2179388999938965) | > loss_feat: 4.575329780578613 (4.575329780578613) | > loss_mel: 22.983095169067383 (22.983095169067383) | > loss_duration: 2.7470216751098633 (2.7470216751098633) | > loss_1: 36.42420196533203 (36.42420196533203)  --> STEP: 1 | > loss_disc: 2.9641013145446777 (2.9641013145446777) | > loss_disc_real_0: 0.25342345237731934 (0.25342345237731934) | > loss_disc_real_1: 0.26699432730674744 (0.26699432730674744) | > loss_disc_real_2: 0.23013292253017426 (0.23013292253017426) | > loss_disc_real_3: 0.15395145118236542 (0.15395145118236542) | > loss_disc_real_4: 0.3434949517250061 (0.3434949517250061) | > loss_disc_real_5: 0.2678925693035126 (0.2678925693035126) | > loss_0: 2.9641013145446777 (2.9641013145446777) | > loss_gen: 1.8608368635177612 (1.8608368635177612) | > loss_kl: 4.225536346435547 (4.225536346435547) | > loss_feat: 5.6059346199035645 (5.6059346199035645) | > loss_mel: 24.71929931640625 (24.71929931640625) | > loss_duration: 3.1607329845428467 (3.1607329845428467) | > loss_1: 39.57233810424805 (39.57233810424805)  --> STEP: 2 | > loss_disc: 3.21920108795166 (3.091651201248169) | > loss_disc_real_0: 0.14920303225517273 (0.20131324231624603) | > loss_disc_real_1: 0.3242497146129608 (0.2956220209598541) | > loss_disc_real_2: 0.2993234694004059 (0.26472819596529007) | > loss_disc_real_3: 0.40005508065223694 (0.2770032659173012) | > loss_disc_real_4: 0.370598703622818 (0.35704682767391205) | > loss_disc_real_5: 0.3028110861778259 (0.28535182774066925) | > loss_0: 3.21920108795166 (3.091651201248169) | > loss_gen: 1.9248603582382202 (1.8928486108779907) | > loss_kl: 4.615047454833984 (4.420291900634766) | > loss_feat: 3.866051435470581 (4.735993027687073) | > loss_mel: 27.92595672607422 (26.322628021240234) | > loss_duration: 3.006876230239868 (3.0838046073913574) | > loss_1: 41.33879470825195 (40.45556640625)  --> STEP: 3 | > loss_disc: 1.7509684562683105 (2.6447569529215493) | > loss_disc_real_0: 0.08743120729923248 (0.16335256397724152) | > loss_disc_real_1: 0.191392719745636 (0.26087892055511475) | > loss_disc_real_2: 0.10145778954029083 (0.210304727156957) | > loss_disc_real_3: 0.062049999833106995 (0.2053521772225698) | > loss_disc_real_4: 0.05827060714364052 (0.2574547541638215) | > loss_disc_real_5: 0.041867323219776154 (0.2041903262337049) | > loss_0: 1.7509684562683105 (2.6447569529215493) | > loss_gen: 2.5695745944976807 (2.1184239387512207) | > loss_kl: 2.5204250812530518 (3.787002960840861) | > loss_feat: 7.732651233673096 (5.73487909634908) | > loss_mel: 24.721012115478516 (25.788756052652996) | > loss_duration: 2.7000296115875244 (2.9558796087900796) | > loss_1: 40.24369812011719 (40.38494364420573) --> EVAL PERFORMANCE | > avg_loader_time: 0.015626986821492512 (+0.005684375762939451) | > avg_loss_disc: 2.6447569529215493 (+0.5771001180013018) | > avg_loss_disc_real_0: 0.16335256397724152 (-0.0018527582287788391) | > avg_loss_disc_real_1: 0.26087892055511475 (+0.0592220202088356) | > avg_loss_disc_real_2: 0.210304727156957 (+0.03020435074965161) | > avg_loss_disc_real_3: 0.2053521772225698 (+0.028852812945842743) | > avg_loss_disc_real_4: 0.2574547541638215 (+0.07366711025436717) | > avg_loss_disc_real_5: 0.2041903262337049 (-0.0058845095336437225) | > avg_loss_0: 2.6447569529215493 (+0.5771001180013018) | > avg_loss_gen: 2.1184239387512207 (-0.6176498333613076) | > avg_loss_kl: 3.787002960840861 (-0.11870988210042333) | > avg_loss_feat: 5.73487909634908 (-4.307978868484498) | > avg_loss_mel: 25.788756052652996 (+2.4220492045084647) | > avg_loss_duration: 2.9558796087900796 (-0.09358056386311864) | > avg_loss_1: 40.38494364420573 (-2.715867360432945)  > EPOCH: 715/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:08:43)   --> TIME: 2023-10-20 08:09:06 -- STEP: 19/50 -- GLOBAL_STEP: 88770 | > loss_disc: 2.502617835998535 (2.429377926023383) | > loss_disc_real_0: 0.17668038606643677 (0.15807218683001242) | > loss_disc_real_1: 0.4053867757320404 (0.23962969176079096) | > loss_disc_real_2: 0.18261973559856415 (0.20942850940321622) | > loss_disc_real_3: 0.40944433212280273 (0.2349882857187798) | > loss_disc_real_4: 0.227648064494133 (0.230002005535521) | > loss_disc_real_5: 0.15002655982971191 (0.23066929257229754) | > loss_0: 2.502617835998535 (2.429377926023383) | > grad_norm_0: tensor(1104.8292, device='cuda:0') (tensor(981.6794, device='cuda:0')) | > loss_gen: 2.4410033226013184 (2.259630661261709) | > loss_kl: 0.8885865807533264 (0.7482808232307434) | > loss_feat: 6.8135881423950195 (5.341146722828087) | > loss_mel: 22.218135833740234 (21.324832502164337) | > loss_duration: 1.4985301494598389 (1.439179163230093) | > loss_1: 33.85984420776367 (31.113069835462067) | > grad_norm_1: tensor(56302.7148, device='cuda:0') (tensor(44683.1250, device='cuda:0')) | > current_lr_0: 9.783404993806921e-05 | > current_lr_1: 9.783404993806921e-05 | > step_time: 0.2668 (0.7065397312766627) | > loader_time: 0.0018 (0.024597142872057463)  --> TIME: 2023-10-20 08:09:20 -- STEP: 49/50 -- GLOBAL_STEP: 88800 | > loss_disc: 2.2597055435180664 (2.4626887525830954) | > loss_disc_real_0: 0.1187848225235939 (0.15015319637878213) | > loss_disc_real_1: 0.18091729283332825 (0.2293579139727719) | > loss_disc_real_2: 0.21852242946624756 (0.21519099928590715) | > loss_disc_real_3: 0.26765188574790955 (0.23787805962623382) | > loss_disc_real_4: 0.21263116598129272 (0.2258230982614415) | > loss_disc_real_5: 0.252191960811615 (0.23189773064638888) | > loss_0: 2.2597055435180664 (2.4626887525830954) | > grad_norm_0: tensor(1208.3503, device='cuda:0') (tensor(1193.7145, device='cuda:0')) | > loss_gen: 2.501512289047241 (2.21628231418376) | > loss_kl: 0.5235647559165955 (0.7448901062717244) | > loss_feat: 5.99374532699585 (5.062622455309849) | > loss_mel: 24.70174217224121 (20.742512428030672) | > loss_duration: 1.5417253971099854 (1.4135800064826498) | > loss_1: 35.26228713989258 (30.17988731423203) | > grad_norm_1: tensor(64347.9062, device='cuda:0') (tensor(36653.8398, device='cuda:0')) | > current_lr_0: 9.783404993806921e-05 | > current_lr_1: 9.783404993806921e-05 | > step_time: 0.7947 (0.5354265826089043) | > loader_time: 0.4455 (0.022432468375381157)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5270614624023438 (2.5270614624023438) | > loss_disc_real_0: 0.042490262538194656 (0.042490262538194656) | > loss_disc_real_1: 0.15235523879528046 (0.15235523879528046) | > loss_disc_real_2: 0.1495702862739563 (0.1495702862739563) | > loss_disc_real_3: 0.18493565917015076 (0.18493565917015076) | > loss_disc_real_4: 0.21446391940116882 (0.21446391940116882) | > loss_disc_real_5: 0.24373455345630646 (0.24373455345630646) | > loss_0: 2.5270614624023438 (2.5270614624023438) | > loss_gen: 1.923396348953247 (1.923396348953247) | > loss_kl: 4.119500160217285 (4.119500160217285) | > loss_feat: 4.23333215713501 (4.23333215713501) | > loss_mel: 28.75592613220215 (28.75592613220215) | > loss_duration: 2.7910239696502686 (2.7910239696502686) | > loss_1: 41.823177337646484 (41.823177337646484)  --> STEP: 1 | > loss_disc: 2.0304837226867676 (2.0304837226867676) | > loss_disc_real_0: 0.17722484469413757 (0.17722484469413757) | > loss_disc_real_1: 0.1252630352973938 (0.1252630352973938) | > loss_disc_real_2: 0.16082054376602173 (0.16082054376602173) | > loss_disc_real_3: 0.14275401830673218 (0.14275401830673218) | > loss_disc_real_4: 0.14827337861061096 (0.14827337861061096) | > loss_disc_real_5: 0.09949681907892227 (0.09949681907892227) | > loss_0: 2.0304837226867676 (2.0304837226867676) | > loss_gen: 2.29744029045105 (2.29744029045105) | > loss_kl: 4.585126876831055 (4.585126876831055) | > loss_feat: 8.292450904846191 (8.292450904846191) | > loss_mel: 25.554655075073242 (25.554655075073242) | > loss_duration: 3.266298532485962 (3.266298532485962) | > loss_1: 43.9959716796875 (43.9959716796875)  --> STEP: 2 | > loss_disc: 3.0113887786865234 (2.5209362506866455) | > loss_disc_real_0: 0.17769533395767212 (0.17746008932590485) | > loss_disc_real_1: 0.2621680498123169 (0.19371554255485535) | > loss_disc_real_2: 0.25679275393486023 (0.20880664885044098) | > loss_disc_real_3: 0.2766198515892029 (0.20968693494796753) | > loss_disc_real_4: 0.3114188611507416 (0.22984611988067627) | > loss_disc_real_5: 0.26222720742225647 (0.18086201325058937) | > loss_0: 3.0113887786865234 (2.5209362506866455) | > loss_gen: 1.5510233640670776 (1.9242318272590637) | > loss_kl: 4.61545467376709 (4.600290775299072) | > loss_feat: 0.07675915956497192 (4.184605032205582) | > loss_mel: 1.8875465393066406 (13.721100807189941) | > loss_duration: 2.9688808917999268 (3.1175897121429443) | > loss_1: 11.099664688110352 (27.547818183898926)  --> STEP: 3 | > loss_disc: 2.9334053993225098 (2.6584259668986) | > loss_disc_real_0: 0.14291390776634216 (0.16594469547271729) | > loss_disc_real_1: 0.25074899196624756 (0.21272669235865274) | > loss_disc_real_2: 0.4106035530567169 (0.2760722835858663) | > loss_disc_real_3: 0.3944479525089264 (0.2712739408016205) | > loss_disc_real_4: 0.33058658242225647 (0.263426274061203) | > loss_disc_real_5: 0.29448941349983215 (0.2187378133336703) | > loss_0: 2.9334053993225098 (2.6584259668986) | > loss_gen: 2.1542985439300537 (2.0009207328160605) | > loss_kl: 2.1824615001678467 (3.7943476835886636) | > loss_feat: 4.052850246429443 (4.140686770280202) | > loss_mel: 25.79334259033203 (17.745181401570637) | > loss_duration: 2.8928873538970947 (3.0426889260609946) | > loss_1: 37.07583999633789 (30.723825454711914) --> EVAL PERFORMANCE | > avg_loader_time: 0.019617478052775066 (+0.003990491231282554) | > avg_loss_disc: 2.6584259668986 (+0.013669013977050781) | > avg_loss_disc_real_0: 0.16594469547271729 (+0.002592131495475769) | > avg_loss_disc_real_1: 0.21272669235865274 (-0.048152228196462005) | > avg_loss_disc_real_2: 0.2760722835858663 (+0.06576755642890927) | > avg_loss_disc_real_3: 0.2712739408016205 (+0.06592176357905069) | > avg_loss_disc_real_4: 0.263426274061203 (+0.005971519897381483) | > avg_loss_disc_real_5: 0.2187378133336703 (+0.014547487099965395) | > avg_loss_0: 2.6584259668986 (+0.013669013977050781) | > avg_loss_gen: 2.0009207328160605 (-0.11750320593516017) | > avg_loss_kl: 3.7943476835886636 (+0.007344722747802734) | > avg_loss_feat: 4.140686770280202 (-1.5941923260688782) | > avg_loss_mel: 17.745181401570637 (-8.04357465108236) | > avg_loss_duration: 3.0426889260609946 (+0.08680931727091501) | > avg_loss_1: 30.723825454711914 (-9.661118189493813)  > EPOCH: 716/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:09:38)   --> TIME: 2023-10-20 08:10:00 -- STEP: 29/50 -- GLOBAL_STEP: 88830 | > loss_disc: 2.9284656047821045 (2.406979305990811) | > loss_disc_real_0: 0.6418311595916748 (0.15197740655777786) | > loss_disc_real_1: 0.2677954137325287 (0.2149974138572298) | > loss_disc_real_2: 0.3124251067638397 (0.21678086986829495) | > loss_disc_real_3: 0.30868953466415405 (0.22248561025179667) | > loss_disc_real_4: 0.24704501032829285 (0.20941332856128955) | > loss_disc_real_5: 0.20648162066936493 (0.2271944214429321) | > loss_0: 2.9284656047821045 (2.406979305990811) | > grad_norm_0: tensor(3143.4290, device='cuda:0') (tensor(1164.8372, device='cuda:0')) | > loss_gen: 2.535278558731079 (2.3519652218654237) | > loss_kl: 0.8207621574401855 (0.8767172673652912) | > loss_feat: 2.487689256668091 (6.083657482317809) | > loss_mel: 19.508508682250977 (22.197670739272546) | > loss_duration: 1.38880455493927 (1.4205006278794388) | > loss_1: 26.741043090820312 (32.93051073468965) | > grad_norm_1: tensor(7397.3091, device='cuda:0') (tensor(34568.3164, device='cuda:0')) | > current_lr_0: 9.773625867982904e-05 | > current_lr_1: 9.773625867982904e-05 | > step_time: 0.7448 (0.5916460300314015) | > loader_time: 0.0046 (0.021380580704787683)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7212533950805664 (2.7212533950805664) | > loss_disc_real_0: 0.012431303970515728 (0.012431303970515728) | > loss_disc_real_1: 0.27955713868141174 (0.27955713868141174) | > loss_disc_real_2: 0.2689667046070099 (0.2689667046070099) | > loss_disc_real_3: 0.23871369659900665 (0.23871369659900665) | > loss_disc_real_4: 0.17569488286972046 (0.17569488286972046) | > loss_disc_real_5: 0.23197360336780548 (0.23197360336780548) | > loss_0: 2.7212533950805664 (2.7212533950805664) | > loss_gen: 1.8332384824752808 (1.8332384824752808) | > loss_kl: 4.116036415100098 (4.116036415100098) | > loss_feat: 7.026777267456055 (7.026777267456055) | > loss_mel: 25.133956909179688 (25.133956909179688) | > loss_duration: 2.662728786468506 (2.662728786468506) | > loss_1: 40.772735595703125 (40.772735595703125)  --> STEP: 1 | > loss_disc: 2.915952205657959 (2.915952205657959) | > loss_disc_real_0: 0.25616079568862915 (0.25616079568862915) | > loss_disc_real_1: 0.2806655764579773 (0.2806655764579773) | > loss_disc_real_2: 0.2902507781982422 (0.2902507781982422) | > loss_disc_real_3: 0.22521604597568512 (0.22521604597568512) | > loss_disc_real_4: 0.29100313782691956 (0.29100313782691956) | > loss_disc_real_5: 0.07845386862754822 (0.07845386862754822) | > loss_0: 2.915952205657959 (2.915952205657959) | > loss_gen: 1.7290738821029663 (1.7290738821029663) | > loss_kl: 5.19166898727417 (5.19166898727417) | > loss_feat: 5.818838596343994 (5.818838596343994) | > loss_mel: 26.703994750976562 (26.703994750976562) | > loss_duration: 3.175347328186035 (3.175347328186035) | > loss_1: 42.618919372558594 (42.618919372558594)  --> STEP: 2 | > loss_disc: 3.046034336090088 (2.9809932708740234) | > loss_disc_real_0: 0.26616594195365906 (0.2611633688211441) | > loss_disc_real_1: 0.25464317202568054 (0.2676543742418289) | > loss_disc_real_2: 0.24079443514347076 (0.2655226066708565) | > loss_disc_real_3: 0.248545303940773 (0.23688067495822906) | > loss_disc_real_4: 0.2628149688243866 (0.2769090533256531) | > loss_disc_real_5: 0.25714045763015747 (0.16779716312885284) | > loss_0: 3.046034336090088 (2.9809932708740234) | > loss_gen: 1.4898558855056763 (1.6094648838043213) | > loss_kl: 4.828822135925293 (5.0102455615997314) | > loss_feat: 0.18972410261631012 (3.004281349480152) | > loss_mel: 4.746621131896973 (15.725307941436768) | > loss_duration: 3.0250113010406494 (3.1001793146133423) | > loss_1: 14.280034065246582 (28.449476718902588)  --> STEP: 3 | > loss_disc: 2.429981231689453 (2.7973225911458335) | > loss_disc_real_0: 0.3365480601787567 (0.28629159927368164) | > loss_disc_real_1: 0.3234708607196808 (0.2862598697344462) | > loss_disc_real_2: 0.24242110550403595 (0.2578221062819163) | > loss_disc_real_3: 0.275057315826416 (0.24960622191429138) | > loss_disc_real_4: 0.24198174476623535 (0.2652666171391805) | > loss_disc_real_5: 0.26376989483833313 (0.1997880736986796) | > loss_0: 2.429981231689453 (2.7973225911458335) | > loss_gen: 2.9512739181518555 (2.056734561920166) | > loss_kl: 2.1797358989715576 (4.066742340723674) | > loss_feat: 4.793962478637695 (3.6008417258659997) | > loss_mel: 22.934772491455078 (18.12846279144287) | > loss_duration: 2.7218382358551025 (2.974065621693929) | > loss_1: 35.58158493041992 (30.8268461227417) --> EVAL PERFORMANCE | > avg_loader_time: 0.020567973454793293 (+0.0009504954020182269) | > avg_loss_disc: 2.7973225911458335 (+0.13889662424723337) | > avg_loss_disc_real_0: 0.28629159927368164 (+0.12034690380096436) | > avg_loss_disc_real_1: 0.2862598697344462 (+0.07353317737579348) | > avg_loss_disc_real_2: 0.2578221062819163 (-0.018250177303949955) | > avg_loss_disc_real_3: 0.24960622191429138 (-0.0216677188873291) | > avg_loss_disc_real_4: 0.2652666171391805 (+0.0018403430779774799) | > avg_loss_disc_real_5: 0.1997880736986796 (-0.018949739634990692) | > avg_loss_0: 2.7973225911458335 (+0.13889662424723337) | > avg_loss_gen: 2.056734561920166 (+0.055813829104105483) | > avg_loss_kl: 4.066742340723674 (+0.2723946571350102) | > avg_loss_feat: 3.6008417258659997 (-0.5398450444142022) | > avg_loss_mel: 18.12846279144287 (+0.38328138987223426) | > avg_loss_duration: 2.974065621693929 (-0.06862330436706543) | > avg_loss_1: 30.8268461227417 (+0.10302066802978516)  > EPOCH: 717/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:10:30)   --> TIME: 2023-10-20 08:10:41 -- STEP: 9/50 -- GLOBAL_STEP: 88860 | > loss_disc: 2.869594097137451 (2.474395857916938) | > loss_disc_real_0: 0.30923646688461304 (0.14020446356799868) | > loss_disc_real_1: 0.33747589588165283 (0.21844932436943054) | > loss_disc_real_2: 0.2953173518180847 (0.20201237396233612) | > loss_disc_real_3: 0.2595047056674957 (0.21413390897214413) | > loss_disc_real_4: 0.3294108211994171 (0.23913714372449452) | > loss_disc_real_5: 0.3547791838645935 (0.21410180586907598) | > loss_0: 2.869594097137451 (2.474395857916938) | > grad_norm_0: tensor(1408.0396, device='cuda:0') (tensor(1146.9534, device='cuda:0')) | > loss_gen: 2.4186792373657227 (2.1504957411024304) | > loss_kl: 0.7577883005142212 (0.7941373685995737) | > loss_feat: 2.5726096630096436 (5.376654791335265) | > loss_mel: 22.043394088745117 (20.70214409298367) | > loss_duration: 1.3819035291671753 (1.4148323006100125) | > loss_1: 29.174375534057617 (30.438264687856037) | > grad_norm_1: tensor(12820.7285, device='cuda:0') (tensor(34070.6523, device='cuda:0')) | > current_lr_0: 9.763856517007411e-05 | > current_lr_1: 9.763856517007411e-05 | > step_time: 0.2878 (0.38871921433342826) | > loader_time: 0.003 (0.012469000286526151)  --> TIME: 2023-10-20 08:10:55 -- STEP: 39/50 -- GLOBAL_STEP: 88890 | > loss_disc: 1.0657026767730713 (2.3600326104041858) | > loss_disc_real_0: 0.010593527927994728 (0.1421703251126485) | > loss_disc_real_1: 0.1091771051287651 (0.22843937327464423) | > loss_disc_real_2: 0.1626138985157013 (0.22245747357224807) | > loss_disc_real_3: 0.0157655980437994 (0.2340442778972479) | > loss_disc_real_4: 0.06371253728866577 (0.21898103729845622) | > loss_disc_real_5: 0.052778616547584534 (0.21865708294969338) | > loss_0: 1.0657026767730713 (2.3600326104041858) | > grad_norm_0: tensor(1049.6281, device='cuda:0') (tensor(1196.0907, device='cuda:0')) | > loss_gen: 3.2007291316986084 (2.394760633126283) | > loss_kl: 0.6889195442199707 (0.823069826914714) | > loss_feat: 10.845691680908203 (5.431234032106706) | > loss_mel: 25.678573608398438 (21.319156023172233) | > loss_duration: 1.4367705583572388 (1.4190407257813673) | > loss_1: 41.850685119628906 (31.387261133927566) | > grad_norm_1: tensor(107934.6328, device='cuda:0') (tensor(47326.5430, device='cuda:0')) | > current_lr_0: 9.763856517007411e-05 | > current_lr_1: 9.763856517007411e-05 | > step_time: 0.7671 (0.4312682763124124) | > loader_time: 0.0452 (0.011726623926407253)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.630882501602173 (2.630882501602173) | > loss_disc_real_0: 0.2510453462600708 (0.2510453462600708) | > loss_disc_real_1: 0.1997075080871582 (0.1997075080871582) | > loss_disc_real_2: 0.13792170584201813 (0.13792170584201813) | > loss_disc_real_3: 0.34047919511795044 (0.34047919511795044) | > loss_disc_real_4: 0.20132134854793549 (0.20132134854793549) | > loss_disc_real_5: 0.3926156759262085 (0.3926156759262085) | > loss_0: 2.630882501602173 (2.630882501602173) | > loss_gen: 2.6759560108184814 (2.6759560108184814) | > loss_kl: 4.297863006591797 (4.297863006591797) | > loss_feat: 6.234859943389893 (6.234859943389893) | > loss_mel: 22.547828674316406 (22.547828674316406) | > loss_duration: 2.7610979080200195 (2.7610979080200195) | > loss_1: 38.51760482788086 (38.51760482788086)  --> STEP: 1 | > loss_disc: 2.0125980377197266 (2.0125980377197266) | > loss_disc_real_0: 0.19643305242061615 (0.19643305242061615) | > loss_disc_real_1: 0.16829527914524078 (0.16829527914524078) | > loss_disc_real_2: 0.20292134582996368 (0.20292134582996368) | > loss_disc_real_3: 0.24494650959968567 (0.24494650959968567) | > loss_disc_real_4: 0.16361162066459656 (0.16361162066459656) | > loss_disc_real_5: 0.27532243728637695 (0.27532243728637695) | > loss_0: 2.0125980377197266 (2.0125980377197266) | > loss_gen: 3.1494431495666504 (3.1494431495666504) | > loss_kl: 4.78166389465332 (4.78166389465332) | > loss_feat: 8.37653923034668 (8.37653923034668) | > loss_mel: 24.6748046875 (24.6748046875) | > loss_duration: 3.167550563812256 (3.167550563812256) | > loss_1: 44.150001525878906 (44.150001525878906)  --> STEP: 2 | > loss_disc: 1.6479227542877197 (1.8302603960037231) | > loss_disc_real_0: 0.08791927993297577 (0.14217616617679596) | > loss_disc_real_1: 0.05173693597316742 (0.1100161075592041) | > loss_disc_real_2: 0.03913329169154167 (0.12102731876075268) | > loss_disc_real_3: 0.09851904958486557 (0.17173277959227562) | > loss_disc_real_4: 0.027988269925117493 (0.09579994529485703) | > loss_disc_real_5: 0.03856241703033447 (0.1569424271583557) | > loss_0: 1.6479227542877197 (1.8302603960037231) | > loss_gen: 2.092881917953491 (2.621162533760071) | > loss_kl: 4.930059432983398 (4.855861663818359) | > loss_feat: 10.337440490722656 (9.356989860534668) | > loss_mel: 22.241697311401367 (23.458250999450684) | > loss_duration: 2.995483636856079 (3.0815171003341675) | > loss_1: 42.59756088256836 (43.37378120422363)  --> STEP: 3 | > loss_disc: 2.2468526363372803 (1.969124476114909) | > loss_disc_real_0: 0.3952082395553589 (0.22652019063631693) | > loss_disc_real_1: 0.1968519240617752 (0.1389613797267278) | > loss_disc_real_2: 0.2131795734167099 (0.15174473697940508) | > loss_disc_real_3: 0.2611134648323059 (0.2015263413389524) | > loss_disc_real_4: 0.13285014033317566 (0.1081500103076299) | > loss_disc_real_5: 0.07801102846860886 (0.1306319609284401) | > loss_0: 2.2468526363372803 (1.969124476114909) | > loss_gen: 3.6072516441345215 (2.9498589038848877) | > loss_kl: 2.3805015087127686 (4.030741612116496) | > loss_feat: 6.423544883728027 (8.379174868265787) | > loss_mel: 24.932605743408203 (23.949702580769856) | > loss_duration: 2.8336362838745117 (2.9988901615142822) | > loss_1: 40.17753982543945 (42.30836741129557) --> EVAL PERFORMANCE | > avg_loader_time: 0.01338497797648112 (-0.007182995478312174) | > avg_loss_disc: 1.969124476114909 (-0.8281981150309246) | > avg_loss_disc_real_0: 0.22652019063631693 (-0.059771408637364715) | > avg_loss_disc_real_1: 0.1389613797267278 (-0.1472984900077184) | > avg_loss_disc_real_2: 0.15174473697940508 (-0.10607736930251124) | > avg_loss_disc_real_3: 0.2015263413389524 (-0.04807988057533899) | > avg_loss_disc_real_4: 0.1081500103076299 (-0.1571166068315506) | > avg_loss_disc_real_5: 0.1306319609284401 (-0.0691561127702395) | > avg_loss_0: 1.969124476114909 (-0.8281981150309246) | > avg_loss_gen: 2.9498589038848877 (+0.8931243419647217) | > avg_loss_kl: 4.030741612116496 (-0.036000728607177734) | > avg_loss_feat: 8.379174868265787 (+4.778333142399788) | > avg_loss_mel: 23.949702580769856 (+5.8212397893269845) | > avg_loss_duration: 2.9988901615142822 (+0.024824539820353042) | > avg_loss_1: 42.30836741129557 (+11.481521288553871)  > EPOCH: 718/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:11:32)   --> TIME: 2023-10-20 08:11:50 -- STEP: 19/50 -- GLOBAL_STEP: 88920 | > loss_disc: 1.3846311569213867 (2.322088887816981) | > loss_disc_real_0: 0.06429833173751831 (0.1503723880374118) | > loss_disc_real_1: 0.06766456365585327 (0.20580162853002548) | > loss_disc_real_2: 0.0952979326248169 (0.22566551322999753) | > loss_disc_real_3: 0.24610581994056702 (0.2231727662055116) | > loss_disc_real_4: 0.13115903735160828 (0.22570466583496646) | > loss_disc_real_5: 0.11469195783138275 (0.21014300988692985) | > loss_0: 1.3846311569213867 (2.322088887816981) | > grad_norm_0: tensor(630.4335, device='cuda:0') (tensor(1748.2211, device='cuda:0')) | > loss_gen: 3.3911263942718506 (2.492068328355488) | > loss_kl: 0.8772677779197693 (0.7723343388030404) | > loss_feat: 9.35054874420166 (6.1569175265337295) | > loss_mel: 28.66965675354004 (22.34376443059821) | > loss_duration: 1.5093492269515991 (1.4447493302194696) | > loss_1: 43.79794692993164 (33.209833546688685) | > grad_norm_1: tensor(94258.3125, device='cuda:0') (tensor(54005.9570, device='cuda:0')) | > current_lr_0: 9.75409693110987e-05 | > current_lr_1: 9.75409693110987e-05 | > step_time: 0.3833 (0.6466685847232216) | > loader_time: 0.0166 (0.023917775405080693)  --> TIME: 2023-10-20 08:12:06 -- STEP: 49/50 -- GLOBAL_STEP: 88950 | > loss_disc: 2.5533671379089355 (2.380668545255855) | > loss_disc_real_0: 0.15821972489356995 (0.13837986393850676) | > loss_disc_real_1: 0.26331397891044617 (0.20881511985647436) | > loss_disc_real_2: 0.18506653606891632 (0.21677717764158638) | > loss_disc_real_3: 0.22318704426288605 (0.22691565364295121) | > loss_disc_real_4: 0.2740064561367035 (0.24012788320530434) | > loss_disc_real_5: 0.3219064176082611 (0.21054124725716455) | > loss_0: 2.5533671379089355 (2.380668545255855) | > grad_norm_0: tensor(939.8621, device='cuda:0') (tensor(1612.7225, device='cuda:0')) | > loss_gen: 2.3311045169830322 (2.380401837582491) | > loss_kl: 0.41031599044799805 (0.69793608237286) | > loss_feat: 4.431341171264648 (5.771721202500013) | > loss_mel: 25.620447158813477 (21.61630559940727) | > loss_duration: 1.4954551458358765 (1.4171590318485183) | > loss_1: 34.288665771484375 (31.883523619904814) | > grad_norm_1: tensor(14058.4893, device='cuda:0') (tensor(48581.0898, device='cuda:0')) | > current_lr_0: 9.75409693110987e-05 | > current_lr_1: 9.75409693110987e-05 | > step_time: 0.4451 (0.5480187620435443) | > loader_time: 0.6034 (0.028759654687375437)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.303168773651123 (2.303168773651123) | > loss_disc_real_0: 0.20738673210144043 (0.20738673210144043) | > loss_disc_real_1: 0.2382691353559494 (0.2382691353559494) | > loss_disc_real_2: 0.26685693860054016 (0.26685693860054016) | > loss_disc_real_3: 0.22573553025722504 (0.22573553025722504) | > loss_disc_real_4: 0.3072534501552582 (0.3072534501552582) | > loss_disc_real_5: 0.28945350646972656 (0.28945350646972656) | > loss_0: 2.303168773651123 (2.303168773651123) | > loss_gen: 2.9980273246765137 (2.9980273246765137) | > loss_kl: 4.091809272766113 (4.091809272766113) | > loss_feat: 9.332074165344238 (9.332074165344238) | > loss_mel: 21.402246475219727 (21.402246475219727) | > loss_duration: 2.8672916889190674 (2.8672916889190674) | > loss_1: 40.69144821166992 (40.69144821166992)  --> STEP: 1 | > loss_disc: 3.67329740524292 (3.67329740524292) | > loss_disc_real_0: 0.21383725106716156 (0.21383725106716156) | > loss_disc_real_1: 0.1606183648109436 (0.1606183648109436) | > loss_disc_real_2: 0.25047850608825684 (0.25047850608825684) | > loss_disc_real_3: 0.23686328530311584 (0.23686328530311584) | > loss_disc_real_4: 0.25789734721183777 (0.25789734721183777) | > loss_disc_real_5: 0.22772233188152313 (0.22772233188152313) | > loss_0: 3.67329740524292 (3.67329740524292) | > loss_gen: 1.1957839727401733 (1.1957839727401733) | > loss_kl: 4.833583831787109 (4.833583831787109) | > loss_feat: 7.085153579711914 (7.085153579711914) | > loss_mel: 25.45466423034668 (25.45466423034668) | > loss_duration: 3.2477831840515137 (3.2477831840515137) | > loss_1: 41.81697082519531 (41.81697082519531)  --> STEP: 2 | > loss_disc: 3.074317216873169 (3.3738073110580444) | > loss_disc_real_0: 0.29900312423706055 (0.25642018765211105) | > loss_disc_real_1: 0.2663758099079132 (0.2134970873594284) | > loss_disc_real_2: 0.284918874502182 (0.2676986902952194) | > loss_disc_real_3: 0.22601039707660675 (0.2314368411898613) | > loss_disc_real_4: 0.24403822422027588 (0.2509677857160568) | > loss_disc_real_5: 0.29505592584609985 (0.2613891288638115) | > loss_0: 3.074317216873169 (3.3738073110580444) | > loss_gen: 1.5491708517074585 (1.372477412223816) | > loss_kl: 4.955917835235596 (4.8947508335113525) | > loss_feat: 0.17222769558429718 (3.6286906376481056) | > loss_mel: 2.5597004890441895 (14.007182359695435) | > loss_duration: 3.1438918113708496 (3.1958374977111816) | > loss_1: 12.380908966064453 (27.098939895629883)  --> STEP: 3 | > loss_disc: 3.075747013092041 (3.27445387840271) | > loss_disc_real_0: 0.3004344701766968 (0.2710916151603063) | > loss_disc_real_1: 0.26634350419044495 (0.23111255963643393) | > loss_disc_real_2: 0.28503331542015076 (0.27347689867019653) | > loss_disc_real_3: 0.22600868344306946 (0.229627455274264) | > loss_disc_real_4: 0.24401339888572693 (0.24864965677261353) | > loss_disc_real_5: 0.29506731033325195 (0.272615189353625) | > loss_0: 3.075747013092041 (3.27445387840271) | > loss_gen: 1.5492470264434814 (1.4314006169637044) | > loss_kl: 2.2875661849975586 (4.025689284006755) | > loss_feat: 0.1749001443386078 (2.477427139878273) | > loss_mel: 3.1391384601593018 (10.384501059850058) | > loss_duration: 2.9195263385772705 (3.103733777999878) | > loss_1: 10.070377349853516 (21.422752380371094) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025914510091145835 (-0.010793526967366535) | > avg_loss_disc: 3.27445387840271 (+1.305329402287801) | > avg_loss_disc_real_0: 0.2710916151603063 (+0.04457142452398935) | > avg_loss_disc_real_1: 0.23111255963643393 (+0.09215117990970612) | > avg_loss_disc_real_2: 0.27347689867019653 (+0.12173216169079146) | > avg_loss_disc_real_3: 0.229627455274264 (+0.028101113935311617) | > avg_loss_disc_real_4: 0.24864965677261353 (+0.14049964646498364) | > avg_loss_disc_real_5: 0.272615189353625 (+0.1419832284251849) | > avg_loss_0: 3.27445387840271 (+1.305329402287801) | > avg_loss_gen: 1.4314006169637044 (-1.5184582869211833) | > avg_loss_kl: 4.025689284006755 (-0.005052328109741211) | > avg_loss_feat: 2.477427139878273 (-5.901747728387514) | > avg_loss_mel: 10.384501059850058 (-13.565201520919798) | > avg_loss_duration: 3.103733777999878 (+0.1048436164855957) | > avg_loss_1: 21.422752380371094 (-20.885615030924477)  > EPOCH: 719/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:12:23)   --> TIME: 2023-10-20 08:12:49 -- STEP: 29/50 -- GLOBAL_STEP: 88980 | > loss_disc: 2.642486810684204 (2.5845627496982444) | > loss_disc_real_0: 0.1294783651828766 (0.14625776135202112) | > loss_disc_real_1: 0.2909941077232361 (0.23957055832805305) | > loss_disc_real_2: 0.21351100504398346 (0.24206958659763994) | > loss_disc_real_3: 0.25629758834838867 (0.26094422566479647) | > loss_disc_real_4: 0.23891933262348175 (0.2397111470586267) | > loss_disc_real_5: 0.2689216732978821 (0.2435161655704523) | > loss_0: 2.642486810684204 (2.5845627496982444) | > grad_norm_0: tensor(2535.5381, device='cuda:0') (tensor(1624.8955, device='cuda:0')) | > loss_gen: 1.8774051666259766 (2.1810098434316707) | > loss_kl: 0.7173104882240295 (0.869960982224037) | > loss_feat: 1.1341195106506348 (4.604800543908415) | > loss_mel: 15.525206565856934 (19.726330847575746) | > loss_duration: 1.3701322078704834 (1.4113184994664685) | > loss_1: 20.624174118041992 (28.79342080806864) | > grad_norm_1: tensor(17760.5117, device='cuda:0') (tensor(40023.1758, device='cuda:0')) | > current_lr_0: 9.744347100529478e-05 | > current_lr_1: 9.744347100529478e-05 | > step_time: 0.7958 (0.6877803226997112) | > loader_time: 0.0137 (0.027392148971557617)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.007032871246338 (3.007032871246338) | > loss_disc_real_0: 0.2727999687194824 (0.2727999687194824) | > loss_disc_real_1: 0.2020713984966278 (0.2020713984966278) | > loss_disc_real_2: 0.31433120369911194 (0.31433120369911194) | > loss_disc_real_3: 0.27361419796943665 (0.27361419796943665) | > loss_disc_real_4: 0.29545050859451294 (0.29545050859451294) | > loss_disc_real_5: 0.21269240975379944 (0.21269240975379944) | > loss_0: 3.007032871246338 (3.007032871246338) | > loss_gen: 1.9242655038833618 (1.9242655038833618) | > loss_kl: 4.106975078582764 (4.106975078582764) | > loss_feat: 4.575270175933838 (4.575270175933838) | > loss_mel: 22.565959930419922 (22.565959930419922) | > loss_duration: 2.6967129707336426 (2.6967129707336426) | > loss_1: 35.86918258666992 (35.86918258666992)  --> STEP: 1 | > loss_disc: 2.2289671897888184 (2.2289671897888184) | > loss_disc_real_0: 0.168247789144516 (0.168247789144516) | > loss_disc_real_1: 0.3205069899559021 (0.3205069899559021) | > loss_disc_real_2: 0.23423196375370026 (0.23423196375370026) | > loss_disc_real_3: 0.19840148091316223 (0.19840148091316223) | > loss_disc_real_4: 0.2682194411754608 (0.2682194411754608) | > loss_disc_real_5: 0.20467965304851532 (0.20467965304851532) | > loss_0: 2.2289671897888184 (2.2289671897888184) | > loss_gen: 2.639598846435547 (2.639598846435547) | > loss_kl: 5.14272928237915 (5.14272928237915) | > loss_feat: 7.5710530281066895 (7.5710530281066895) | > loss_mel: 22.98790168762207 (22.98790168762207) | > loss_duration: 3.0701510906219482 (3.0701510906219482) | > loss_1: 41.411434173583984 (41.411434173583984)  --> STEP: 2 | > loss_disc: 2.7663185596466064 (2.4976428747177124) | > loss_disc_real_0: 0.22430431842803955 (0.19627605378627777) | > loss_disc_real_1: 0.11269207298755646 (0.21659953147172928) | > loss_disc_real_2: 0.08984517306089401 (0.16203856840729713) | > loss_disc_real_3: 0.10812100768089294 (0.1532612442970276) | > loss_disc_real_4: 0.19119365513324738 (0.2297065481543541) | > loss_disc_real_5: 0.11288458853960037 (0.15878212079405785) | > loss_0: 2.7663185596466064 (2.4976428747177124) | > loss_gen: 1.744074821472168 (2.1918368339538574) | > loss_kl: 4.615300178527832 (4.879014730453491) | > loss_feat: 9.596576690673828 (8.583814859390259) | > loss_mel: 22.594284057617188 (22.79109287261963) | > loss_duration: 2.9704644680023193 (3.020307779312134) | > loss_1: 41.52069854736328 (41.46606636047363)  --> STEP: 3 | > loss_disc: 2.603004217147827 (2.5327633221944175) | > loss_disc_real_0: 0.1489046812057495 (0.18048559625943503) | > loss_disc_real_1: 0.3124987781047821 (0.24856594701608023) | > loss_disc_real_2: 0.11269979923963547 (0.14559231201807657) | > loss_disc_real_3: 0.3410263657569885 (0.21584961811701456) | > loss_disc_real_4: 0.1155109703540802 (0.1916413555542628) | > loss_disc_real_5: 0.18291819095611572 (0.1668274775147438) | > loss_0: 2.603004217147827 (2.5327633221944175) | > loss_gen: 1.8555530309677124 (2.0797422329584756) | > loss_kl: 2.247084856033325 (4.001704772313436) | > loss_feat: 4.260644912719727 (7.142758210500081) | > loss_mel: 22.292604446411133 (22.624930063883465) | > loss_duration: 2.770730495452881 (2.9371153513590493) | > loss_1: 33.42661666870117 (38.78624979654948) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_89000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.672084331512451 (2.567593574523926) | > loss_disc_real_0: 0.08740238845348358 (0.15721479430794716) | > loss_disc_real_1: 0.20809227228164673 (0.23844752833247185) | > loss_disc_real_2: 0.23443858325481415 (0.16780387982726097) | > loss_disc_real_3: 0.2785705626010895 (0.2315298542380333) | > loss_disc_real_4: 0.22747547924518585 (0.20059988647699356) | > loss_disc_real_5: 0.35314062237739563 (0.21340576373040676) | > loss_0: 2.672084331512451 (2.567593574523926) | > loss_gen: 2.085949420928955 (2.0812940299510956) | > loss_kl: 4.226817607879639 (4.057982981204987) | > loss_feat: 5.668426036834717 (6.77417516708374) | > loss_mel: 23.55193328857422 (22.856680870056152) | > loss_duration: 2.655740261077881 (2.8667715787887573) | > loss_1: 38.188865661621094 (38.63690376281738)  --> STEP: 1 | > loss_disc: 2.3755271434783936 (2.5291802883148193) | > loss_disc_real_0: 0.11841410398483276 (0.14945465624332427) | > loss_disc_real_1: 0.32359421253204346 (0.25547686517238616) | > loss_disc_real_2: 0.273804247379303 (0.18900395333766937) | > loss_disc_real_3: 0.2624063193798065 (0.23770514726638795) | > loss_disc_real_4: 0.18414169549942017 (0.1973082482814789) | > loss_disc_real_5: 0.22867198288440704 (0.2164590075612068) | > loss_0: 2.3755271434783936 (2.5291802883148193) | > loss_gen: 2.4116361141204834 (2.1473624467849732) | > loss_kl: 4.697268486022949 (4.185840082168579) | > loss_feat: 5.724499702453613 (6.5642400741577145) | > loss_mel: 23.751188278198242 (23.03558235168457) | > loss_duration: 3.0774619579315186 (2.9089096546173097) | > loss_1: 39.66205596923828 (38.84193420410156)  --> STEP: 2 | > loss_disc: 2.697699546813965 (2.5572668313980103) | > loss_disc_real_0: 0.09800241887569427 (0.14087928334871927) | > loss_disc_real_1: 0.17764846980571747 (0.24250546594460806) | > loss_disc_real_2: 0.21407966315746307 (0.19318323830763498) | > loss_disc_real_3: 0.3429884612560272 (0.25525236626466113) | > loss_disc_real_4: 0.26202186942100525 (0.20809385180473328) | > loss_disc_real_5: 0.2672388553619385 (0.22492231552799544) | > loss_0: 2.697699546813965 (2.5572668313980103) | > loss_gen: 1.9929487705230713 (2.121626834074656) | > loss_kl: 4.877858638763428 (4.30117650826772) | > loss_feat: 7.638627529144287 (6.7433046499888105) | > loss_mel: 21.57852554321289 (22.792739550272625) | > loss_duration: 2.965999126434326 (2.9184245665868125) | > loss_1: 39.05396270751953 (38.877272288004555)  --> STEP: 3 | > loss_disc: 2.4888575077056885 (2.5474940708705356) | > loss_disc_real_0: 0.10861539840698242 (0.13627015692847116) | > loss_disc_real_1: 0.30377689003944397 (0.25125852652958464) | > loss_disc_real_2: 0.25956636667251587 (0.20266654235976084) | > loss_disc_real_3: 0.2678951919078827 (0.2570584842136928) | > loss_disc_real_4: 0.2225647270679474 (0.21016111969947815) | > loss_disc_real_5: 0.2497926503419876 (0.22847522050142288) | > loss_0: 2.4888575077056885 (2.5474940708705356) | > loss_gen: 2.264181613922119 (2.1419918026242937) | > loss_kl: 2.136819839477539 (3.9919826984405518) | > loss_feat: 4.029751777648926 (6.355654239654541) | > loss_mel: 24.32493782043457 (23.011625017438615) | > loss_duration: 2.7959487438201904 (2.900928020477295) | > loss_1: 35.551639556884766 (38.402181897844585) --> EVAL PERFORMANCE | > avg_loader_time: 0.4659036908830915 (+0.46331223987397696) | > avg_loss_disc: 2.5474940708705356 (-0.7269598075321744) | > avg_loss_disc_real_0: 0.13627015692847116 (-0.1348214582318351) | > avg_loss_disc_real_1: 0.25125852652958464 (+0.020145966893150707) | > avg_loss_disc_real_2: 0.20266654235976084 (-0.0708103563104357) | > avg_loss_disc_real_3: 0.2570584842136928 (+0.02743102893942881) | > avg_loss_disc_real_4: 0.21016111969947815 (-0.038488537073135376) | > avg_loss_disc_real_5: 0.22847522050142288 (-0.044139968852202116) | > avg_loss_0: 2.5474940708705356 (-0.7269598075321744) | > avg_loss_gen: 2.1419918026242937 (+0.7105911856605893) | > avg_loss_kl: 3.9919826984405518 (-0.033706585566203096) | > avg_loss_feat: 6.355654239654541 (+3.878227099776268) | > avg_loss_mel: 23.011625017438615 (+12.627123957588557) | > avg_loss_duration: 2.900928020477295 (-0.202805757522583) | > avg_loss_1: 38.402181897844585 (+16.97942951747349)  > EPOCH: 720/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:13:27)   --> TIME: 2023-10-20 08:13:39 -- STEP: 9/50 -- GLOBAL_STEP: 89010 | > loss_disc: 2.472489833831787 (2.260869820912679) | > loss_disc_real_0: 0.10490063577890396 (0.1880292942126592) | > loss_disc_real_1: 0.41895899176597595 (0.2464008844561047) | > loss_disc_real_2: 0.35383084416389465 (0.2163068631456958) | > loss_disc_real_3: 0.2690810561180115 (0.20480842971139485) | > loss_disc_real_4: 0.13083505630493164 (0.1642764632900556) | > loss_disc_real_5: 0.11379922181367874 (0.1548483572486374) | > loss_0: 2.472489833831787 (2.260869820912679) | > grad_norm_0: tensor(874.2444, device='cuda:0') (tensor(1058.5244, device='cuda:0')) | > loss_gen: 2.111496686935425 (2.4308753410975137) | > loss_kl: 0.7190924882888794 (0.8097429300347964) | > loss_feat: 2.827113628387451 (6.8060670958624945) | > loss_mel: 22.40630340576172 (23.032470703125) | > loss_duration: 1.3407846689224243 (1.391223046514723) | > loss_1: 29.404788970947266 (34.470377392239044) | > grad_norm_1: tensor(6623.5146, device='cuda:0') (tensor(46342.6055, device='cuda:0')) | > current_lr_0: 9.73460701551518e-05 | > current_lr_1: 9.73460701551518e-05 | > step_time: 0.4887 (0.6140367454952664) | > loader_time: 0.0157 (0.010317616992526583)  --> TIME: 2023-10-20 08:13:53 -- STEP: 39/50 -- GLOBAL_STEP: 89040 | > loss_disc: 3.14859676361084 (2.5795746399806103) | > loss_disc_real_0: 0.11236916482448578 (0.18711376259437737) | > loss_disc_real_1: 0.23587122559547424 (0.23982537690645608) | > loss_disc_real_2: 0.23289698362350464 (0.21370033012368742) | > loss_disc_real_3: 0.25022798776626587 (0.2396016308130362) | > loss_disc_real_4: 0.2560405135154724 (0.22483009367417067) | > loss_disc_real_5: 0.2744491994380951 (0.2137950075408205) | > loss_0: 3.14859676361084 (2.5795746399806103) | > grad_norm_0: tensor(1741.9042, device='cuda:0') (tensor(1270.0657, device='cuda:0')) | > loss_gen: 1.416640043258667 (2.1226439384313736) | > loss_kl: 0.7313861846923828 (0.7901199503968923) | > loss_feat: 0.15989087522029877 (4.5482613382717725) | > loss_mel: 2.033127546310425 (19.391371335738743) | > loss_duration: 1.4585975408554077 (1.4137544295726678) | > loss_1: 5.799642086029053 (28.26615034005581) | > grad_norm_1: tensor(14699.1602, device='cuda:0') (tensor(34567.5625, device='cuda:0')) | > current_lr_0: 9.73460701551518e-05 | > current_lr_1: 9.73460701551518e-05 | > step_time: 0.7663 (0.48929014572730434) | > loader_time: 0.0084 (0.012862939100999098)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.915186882019043 (2.915186882019043) | > loss_disc_real_0: 0.2020767629146576 (0.2020767629146576) | > loss_disc_real_1: 0.26875340938568115 (0.26875340938568115) | > loss_disc_real_2: 0.24110451340675354 (0.24110451340675354) | > loss_disc_real_3: 0.313079833984375 (0.313079833984375) | > loss_disc_real_4: 0.4533008635044098 (0.4533008635044098) | > loss_disc_real_5: 0.43445780873298645 (0.43445780873298645) | > loss_0: 2.915186882019043 (2.915186882019043) | > loss_gen: 2.3341872692108154 (2.3341872692108154) | > loss_kl: 4.133157253265381 (4.133157253265381) | > loss_feat: 4.673878192901611 (4.673878192901611) | > loss_mel: 22.26462745666504 (22.26462745666504) | > loss_duration: 2.7225821018218994 (2.7225821018218994) | > loss_1: 36.12843322753906 (36.12843322753906)  --> STEP: 1 | > loss_disc: 2.882507562637329 (2.882507562637329) | > loss_disc_real_0: 0.4462127089500427 (0.4462127089500427) | > loss_disc_real_1: 0.2753757834434509 (0.2753757834434509) | > loss_disc_real_2: 0.2048140913248062 (0.2048140913248062) | > loss_disc_real_3: 0.39806804060935974 (0.39806804060935974) | > loss_disc_real_4: 0.3550446033477783 (0.3550446033477783) | > loss_disc_real_5: 0.40093445777893066 (0.40093445777893066) | > loss_0: 2.882507562637329 (2.882507562637329) | > loss_gen: 2.671886444091797 (2.671886444091797) | > loss_kl: 4.568695068359375 (4.568695068359375) | > loss_feat: 7.289329528808594 (7.289329528808594) | > loss_mel: 24.09280014038086 (24.09280014038086) | > loss_duration: 3.1213905811309814 (3.1213905811309814) | > loss_1: 41.744102478027344 (41.744102478027344)  --> STEP: 2 | > loss_disc: 2.937080144882202 (2.9097938537597656) | > loss_disc_real_0: 0.32865574955940247 (0.3874342292547226) | > loss_disc_real_1: 0.37118080258369446 (0.3232782930135727) | > loss_disc_real_2: 0.2590864896774292 (0.2319502905011177) | > loss_disc_real_3: 0.32257843017578125 (0.3603232353925705) | > loss_disc_real_4: 0.27512669563293457 (0.31508564949035645) | > loss_disc_real_5: 0.3107813000679016 (0.35585787892341614) | > loss_0: 2.937080144882202 (2.9097938537597656) | > loss_gen: 2.1766083240509033 (2.42424738407135) | > loss_kl: 4.593044281005859 (4.580869674682617) | > loss_feat: 2.3626527786254883 (4.825991153717041) | > loss_mel: 24.796194076538086 (24.444497108459473) | > loss_duration: 3.009934663772583 (3.0656626224517822) | > loss_1: 36.93843460083008 (39.34126853942871)  --> STEP: 3 | > loss_disc: 2.2389016151428223 (2.6861631075541177) | > loss_disc_real_0: 0.18867069482803345 (0.32117971777915955) | > loss_disc_real_1: 0.2051052451133728 (0.2838872770468394) | > loss_disc_real_2: 0.21598944067955017 (0.22663000722726187) | > loss_disc_real_3: 0.33204740285873413 (0.3508979578812917) | > loss_disc_real_4: 0.17163075506687164 (0.2672673513491948) | > loss_disc_real_5: 0.09123175591230392 (0.2676491712530454) | > loss_0: 2.2389016151428223 (2.6861631075541177) | > loss_gen: 2.2781243324279785 (2.375539700190226) | > loss_kl: 2.313511371612549 (3.825083573659261) | > loss_feat: 5.469656944274902 (5.040546417236328) | > loss_mel: 25.57643699645996 (24.821810404459637) | > loss_duration: 2.8220865726470947 (2.9844706058502197) | > loss_1: 38.459815979003906 (39.04745101928711) --> EVAL PERFORMANCE | > avg_loader_time: 0.019067684809366863 (-0.44683600607372465) | > avg_loss_disc: 2.6861631075541177 (+0.1386690366835821) | > avg_loss_disc_real_0: 0.32117971777915955 (+0.18490956085068838) | > avg_loss_disc_real_1: 0.2838872770468394 (+0.03262875051725478) | > avg_loss_disc_real_2: 0.22663000722726187 (+0.023963464867501033) | > avg_loss_disc_real_3: 0.3508979578812917 (+0.09383947366759887) | > avg_loss_disc_real_4: 0.2672673513491948 (+0.05710623164971668) | > avg_loss_disc_real_5: 0.2676491712530454 (+0.0391739507516225) | > avg_loss_0: 2.6861631075541177 (+0.1386690366835821) | > avg_loss_gen: 2.375539700190226 (+0.23354789756593242) | > avg_loss_kl: 3.825083573659261 (-0.16689912478129054) | > avg_loss_feat: 5.040546417236328 (-1.315107822418213) | > avg_loss_mel: 24.821810404459637 (+1.810185387021022) | > avg_loss_duration: 2.9844706058502197 (+0.0835425853729248) | > avg_loss_1: 39.04745101928711 (+0.6452691214425244)  > EPOCH: 721/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:14:14)   --> TIME: 2023-10-20 08:14:32 -- STEP: 19/50 -- GLOBAL_STEP: 89070 | > loss_disc: 2.919658660888672 (2.5012268455404985) | > loss_disc_real_0: 0.22434358298778534 (0.18204713181445473) | > loss_disc_real_1: 0.4318077266216278 (0.23301558206348041) | > loss_disc_real_2: 0.3917015492916107 (0.23224137272489698) | > loss_disc_real_3: 0.34491822123527527 (0.22854537399191605) | > loss_disc_real_4: 0.21090996265411377 (0.2173869628949385) | > loss_disc_real_5: 0.13670602440834045 (0.2303688969267042) | > loss_0: 2.919658660888672 (2.5012268455404985) | > grad_norm_0: tensor(969.8713, device='cuda:0') (tensor(493.9734, device='cuda:0')) | > loss_gen: 2.712810516357422 (2.284014708117435) | > loss_kl: 0.9077073335647583 (0.8032376672092237) | > loss_feat: 5.484031677246094 (5.454663461564403) | > loss_mel: 22.424108505249023 (18.821308882612932) | > loss_duration: 1.4730280637741089 (1.4370403540761847) | > loss_1: 33.001686096191406 (28.800264910647744) | > grad_norm_1: tensor(24767.5547, device='cuda:0') (tensor(22558.8164, device='cuda:0')) | > current_lr_0: 9.724876666325674e-05 | > current_lr_1: 9.724876666325674e-05 | > step_time: 0.4291 (0.6369518480802837) | > loader_time: 0.0278 (0.024414652272274618)  --> TIME: 2023-10-20 08:14:48 -- STEP: 49/50 -- GLOBAL_STEP: 89100 | > loss_disc: 2.4699206352233887 (2.542678314812329) | > loss_disc_real_0: 0.3086361587047577 (0.16436320166958837) | > loss_disc_real_1: 0.28845325112342834 (0.23679374025336333) | > loss_disc_real_2: 0.26949846744537354 (0.2392579606753223) | > loss_disc_real_3: 0.3338897228240967 (0.22945195238809196) | > loss_disc_real_4: 0.36579522490501404 (0.22915606746183975) | > loss_disc_real_5: 0.18778277933597565 (0.23964881281159361) | > loss_0: 2.4699206352233887 (2.542678314812329) | > grad_norm_0: tensor(934.8530, device='cuda:0') (tensor(590.9941, device='cuda:0')) | > loss_gen: 3.4823250770568848 (2.2354661907468523) | > loss_kl: 0.8102524280548096 (0.8202995657920837) | > loss_feat: 8.910298347473145 (5.071302399647481) | > loss_mel: 30.094871520996094 (19.856903613830102) | > loss_duration: 1.5591410398483276 (1.4071593819832315) | > loss_1: 44.85688781738281 (29.391130943687596) | > grad_norm_1: tensor(18858.9609, device='cuda:0') (tensor(19435.9941, device='cuda:0')) | > current_lr_0: 9.724876666325674e-05 | > current_lr_1: 9.724876666325674e-05 | > step_time: 0.376 (0.5547746833489864) | > loader_time: 0.4393 (0.02666893297312212)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.156761646270752 (3.156761646270752) | > loss_disc_real_0: 0.2780036926269531 (0.2780036926269531) | > loss_disc_real_1: 0.3279663622379303 (0.3279663622379303) | > loss_disc_real_2: 0.2863484025001526 (0.2863484025001526) | > loss_disc_real_3: 0.22596928477287292 (0.22596928477287292) | > loss_disc_real_4: 0.2914232611656189 (0.2914232611656189) | > loss_disc_real_5: 0.22838689386844635 (0.22838689386844635) | > loss_0: 3.156761646270752 (3.156761646270752) | > loss_gen: 1.7771613597869873 (1.7771613597869873) | > loss_kl: 4.53460168838501 (4.53460168838501) | > loss_feat: 8.11292552947998 (8.11292552947998) | > loss_mel: 23.15491485595703 (23.15491485595703) | > loss_duration: 2.7740705013275146 (2.7740705013275146) | > loss_1: 40.353675842285156 (40.353675842285156)  --> STEP: 1 | > loss_disc: 2.9269039630889893 (2.9269039630889893) | > loss_disc_real_0: 0.13086137175559998 (0.13086137175559998) | > loss_disc_real_1: 0.25918251276016235 (0.25918251276016235) | > loss_disc_real_2: 0.322208046913147 (0.322208046913147) | > loss_disc_real_3: 0.2519581615924835 (0.2519581615924835) | > loss_disc_real_4: 0.3010852336883545 (0.3010852336883545) | > loss_disc_real_5: 0.3309231698513031 (0.3309231698513031) | > loss_0: 2.9269039630889893 (2.9269039630889893) | > loss_gen: 1.9768561124801636 (1.9768561124801636) | > loss_kl: 4.310215950012207 (4.310215950012207) | > loss_feat: 6.809666633605957 (6.809666633605957) | > loss_mel: 22.758071899414062 (22.758071899414062) | > loss_duration: 3.0649654865264893 (3.0649654865264893) | > loss_1: 38.91977310180664 (38.91977310180664)  --> STEP: 2 | > loss_disc: 2.8074228763580322 (2.8671634197235107) | > loss_disc_real_0: 0.3676237165927887 (0.24924254417419434) | > loss_disc_real_1: 0.19651776552200317 (0.22785013914108276) | > loss_disc_real_2: 0.3437175452709198 (0.3329627960920334) | > loss_disc_real_3: 0.3162387013435364 (0.28409843146800995) | > loss_disc_real_4: 0.3199891746044159 (0.3105372041463852) | > loss_disc_real_5: 0.3274385929107666 (0.32918088138103485) | > loss_0: 2.8074228763580322 (2.8671634197235107) | > loss_gen: 2.7244441509246826 (2.350650131702423) | > loss_kl: 4.530341625213623 (4.420278787612915) | > loss_feat: 3.8082942962646484 (5.308980464935303) | > loss_mel: 11.613245010375977 (17.18565845489502) | > loss_duration: 2.915534019470215 (2.990249752998352) | > loss_1: 25.59185791015625 (32.255815505981445)  --> STEP: 3 | > loss_disc: 2.8577420711517334 (2.864022970199585) | > loss_disc_real_0: 0.25093767046928406 (0.24980758627255759) | > loss_disc_real_1: 0.2583475708961487 (0.23801594972610474) | > loss_disc_real_2: 0.27153709530830383 (0.31248756249745685) | > loss_disc_real_3: 0.2779318690299988 (0.28204291065533954) | > loss_disc_real_4: 0.22150808572769165 (0.280860831340154) | > loss_disc_real_5: 0.2523813247680664 (0.30358102917671204) | > loss_0: 2.8577420711517334 (2.864022970199585) | > loss_gen: 1.721798062324524 (2.1410327752431235) | > loss_kl: 1.9707225561141968 (3.603760043780009) | > loss_feat: 0.558914303779602 (3.7256250778834024) | > loss_mel: 16.08346939086914 (16.818262100219727) | > loss_duration: 2.8314483165740967 (2.9373159408569336) | > loss_1: 23.166351318359375 (29.225994110107422) --> EVAL PERFORMANCE | > avg_loader_time: 0.028649409612019856 (+0.009581724802652992) | > avg_loss_disc: 2.864022970199585 (+0.17785986264546727) | > avg_loss_disc_real_0: 0.24980758627255759 (-0.07137213150660196) | > avg_loss_disc_real_1: 0.23801594972610474 (-0.04587132732073468) | > avg_loss_disc_real_2: 0.31248756249745685 (+0.08585755527019498) | > avg_loss_disc_real_3: 0.28204291065533954 (-0.06885504722595215) | > avg_loss_disc_real_4: 0.280860831340154 (+0.013593479990959167) | > avg_loss_disc_real_5: 0.30358102917671204 (+0.035931857923666655) | > avg_loss_0: 2.864022970199585 (+0.17785986264546727) | > avg_loss_gen: 2.1410327752431235 (-0.23450692494710257) | > avg_loss_kl: 3.603760043780009 (-0.2213235298792524) | > avg_loss_feat: 3.7256250778834024 (-1.3149213393529258) | > avg_loss_mel: 16.818262100219727 (-8.00354830423991) | > avg_loss_duration: 2.9373159408569336 (-0.04715466499328613) | > avg_loss_1: 29.225994110107422 (-9.821456909179688)  > EPOCH: 722/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:15:08)   --> TIME: 2023-10-20 08:15:23 -- STEP: 29/50 -- GLOBAL_STEP: 89130 | > loss_disc: 2.9614760875701904 (2.5454170333928077) | > loss_disc_real_0: 0.35996824502944946 (0.17551472506903368) | > loss_disc_real_1: 0.2531706690788269 (0.22225519064171562) | > loss_disc_real_2: 0.24741365015506744 (0.23212210178889078) | > loss_disc_real_3: 0.26719367504119873 (0.24718816995877643) | > loss_disc_real_4: 0.26732122898101807 (0.23499080153374835) | > loss_disc_real_5: 0.2607266306877136 (0.23553052788664555) | > loss_0: 2.9614760875701904 (2.5454170333928077) | > grad_norm_0: tensor(436.1302, device='cuda:0') (tensor(534.7656, device='cuda:0')) | > loss_gen: 1.737865924835205 (2.1609340125116807) | > loss_kl: 0.9414003491401672 (0.8956933997828385) | > loss_feat: 0.20318694412708282 (4.550767389094007) | > loss_mel: 9.4317626953125 (18.552170691819025) | > loss_duration: 1.3768982887268066 (1.4227060408427799) | > loss_1: 13.69111442565918 (27.582271543042413) | > grad_norm_1: tensor(26617.1680, device='cuda:0') (tensor(23424.3340, device='cuda:0')) | > current_lr_0: 9.715156043229395e-05 | > current_lr_1: 9.715156043229395e-05 | > step_time: 0.2784 (0.3594444126918398) | > loader_time: 0.0028 (0.004246662402975149)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.806812286376953 (2.806812286376953) | > loss_disc_real_0: 0.13773059844970703 (0.13773059844970703) | > loss_disc_real_1: 0.33750101923942566 (0.33750101923942566) | > loss_disc_real_2: 0.2789255380630493 (0.2789255380630493) | > loss_disc_real_3: 0.286893755197525 (0.286893755197525) | > loss_disc_real_4: 0.26750606298446655 (0.26750606298446655) | > loss_disc_real_5: 0.17381024360656738 (0.17381024360656738) | > loss_0: 2.806812286376953 (2.806812286376953) | > loss_gen: 1.8551064729690552 (1.8551064729690552) | > loss_kl: 4.110599994659424 (4.110599994659424) | > loss_feat: 3.9680674076080322 (3.9680674076080322) | > loss_mel: 23.79303741455078 (23.79303741455078) | > loss_duration: 2.690263509750366 (2.690263509750366) | > loss_1: 36.41707229614258 (36.41707229614258)  --> STEP: 1 | > loss_disc: 3.6110925674438477 (3.6110925674438477) | > loss_disc_real_0: 0.37757569551467896 (0.37757569551467896) | > loss_disc_real_1: 0.36366894841194153 (0.36366894841194153) | > loss_disc_real_2: 0.28361618518829346 (0.28361618518829346) | > loss_disc_real_3: 0.3231000006198883 (0.3231000006198883) | > loss_disc_real_4: 0.3509941101074219 (0.3509941101074219) | > loss_disc_real_5: 0.3012288510799408 (0.3012288510799408) | > loss_0: 3.6110925674438477 (3.6110925674438477) | > loss_gen: 1.7345815896987915 (1.7345815896987915) | > loss_kl: 4.096146106719971 (4.096146106719971) | > loss_feat: 7.583352088928223 (7.583352088928223) | > loss_mel: 21.93984603881836 (21.93984603881836) | > loss_duration: 3.147425651550293 (3.147425651550293) | > loss_1: 38.5013542175293 (38.5013542175293)  --> STEP: 2 | > loss_disc: 3.037975311279297 (3.3245339393615723) | > loss_disc_real_0: 0.1593208760023117 (0.26844828575849533) | > loss_disc_real_1: 0.2850117087364197 (0.3243403285741806) | > loss_disc_real_2: 0.31423309445381165 (0.29892463982105255) | > loss_disc_real_3: 0.2551761269569397 (0.289138063788414) | > loss_disc_real_4: 0.2484520822763443 (0.2997230961918831) | > loss_disc_real_5: 0.27996110916137695 (0.2905949801206589) | > loss_0: 3.037975311279297 (3.3245339393615723) | > loss_gen: 1.5327768325805664 (1.633679211139679) | > loss_kl: 4.910279750823975 (4.503212928771973) | > loss_feat: 0.10012557357549667 (3.8417388312518597) | > loss_mel: 2.0241570472717285 (11.982001543045044) | > loss_duration: 3.109113931655884 (3.1282697916030884) | > loss_1: 11.67645263671875 (25.088903427124023)  --> STEP: 3 | > loss_disc: 3.0381956100463867 (3.2290878295898438) | > loss_disc_real_0: 0.15859338641166687 (0.23182998597621918) | > loss_disc_real_1: 0.2850038707256317 (0.3112281759579976) | > loss_disc_real_2: 0.31420859694480896 (0.304019292195638) | > loss_disc_real_3: 0.2552078068256378 (0.2778279781341553) | > loss_disc_real_4: 0.24845154583454132 (0.2826325794061025) | > loss_disc_real_5: 0.27996325492858887 (0.2870510717233022) | > loss_0: 3.0381956100463867 (3.2290878295898438) | > loss_gen: 1.5320253372192383 (1.599794586499532) | > loss_kl: 2.1498630046844482 (3.7187629540761313) | > loss_feat: 0.10091067850589752 (2.5947961136698723) | > loss_mel: 2.786668062210083 (8.916890382766724) | > loss_duration: 2.8929154872894287 (3.0498183568318686) | > loss_1: 9.462382316589355 (19.8800630569458) --> EVAL PERFORMANCE | > avg_loader_time: 0.010325034459431967 (-0.01832437515258789) | > avg_loss_disc: 3.2290878295898438 (+0.3650648593902588) | > avg_loss_disc_real_0: 0.23182998597621918 (-0.01797760029633841) | > avg_loss_disc_real_1: 0.3112281759579976 (+0.07321222623189289) | > avg_loss_disc_real_2: 0.304019292195638 (-0.008468270301818848) | > avg_loss_disc_real_3: 0.2778279781341553 (-0.004214932521184267) | > avg_loss_disc_real_4: 0.2826325794061025 (+0.0017717480659484863) | > avg_loss_disc_real_5: 0.2870510717233022 (-0.01652995745340985) | > avg_loss_0: 3.2290878295898438 (+0.3650648593902588) | > avg_loss_gen: 1.599794586499532 (-0.5412381887435915) | > avg_loss_kl: 3.7187629540761313 (+0.11500291029612253) | > avg_loss_feat: 2.5947961136698723 (-1.13082896421353) | > avg_loss_mel: 8.916890382766724 (-7.901371717453003) | > avg_loss_duration: 3.0498183568318686 (+0.11250241597493504) | > avg_loss_1: 19.8800630569458 (-9.345931053161621)  > EPOCH: 723/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:15:54)   --> TIME: 2023-10-20 08:16:05 -- STEP: 9/50 -- GLOBAL_STEP: 89160 | > loss_disc: 2.332900047302246 (2.4031235112084284) | > loss_disc_real_0: 0.22280564904212952 (0.16489921220474774) | > loss_disc_real_1: 0.24933359026908875 (0.2594766856895553) | > loss_disc_real_2: 0.1773630827665329 (0.23828777919212976) | > loss_disc_real_3: 0.2698138654232025 (0.23049380919999546) | > loss_disc_real_4: 0.12715508043766022 (0.2055113169675072) | > loss_disc_real_5: 0.12498292326927185 (0.17913955822587013) | > loss_0: 2.332900047302246 (2.4031235112084284) | > grad_norm_0: tensor(464.1765, device='cuda:0') (tensor(505.9844, device='cuda:0')) | > loss_gen: 2.0449981689453125 (2.315065609084235) | > loss_kl: 0.7277122139930725 (0.7246975666946835) | > loss_feat: 2.864408493041992 (5.618490060170491) | > loss_mel: 18.8509521484375 (21.09426890479194) | > loss_duration: 1.371498703956604 (1.424724088774787) | > loss_1: 25.859569549560547 (31.177246305677627) | > grad_norm_1: tensor(2553.3828, device='cuda:0') (tensor(15952.9863, device='cuda:0')) | > current_lr_0: 9.705445136504501e-05 | > current_lr_1: 9.705445136504501e-05 | > step_time: 0.5947 (0.6133987108866373) | > loader_time: 0.0113 (0.029801024330986872)  --> TIME: 2023-10-20 08:16:24 -- STEP: 39/50 -- GLOBAL_STEP: 89190 | > loss_disc: 1.8134177923202515 (2.4538891483575864) | > loss_disc_real_0: 0.091916024684906 (0.1772082075476647) | > loss_disc_real_1: 0.06650102138519287 (0.23183187670432603) | > loss_disc_real_2: 0.12397028505802155 (0.23500133425188371) | > loss_disc_real_3: 0.12226048856973648 (0.2385005842989836) | > loss_disc_real_4: 0.26530957221984863 (0.24636768805197415) | > loss_disc_real_5: 0.284416139125824 (0.22557775466105875) | > loss_0: 1.8134177923202515 (2.4538891483575864) | > grad_norm_0: tensor(847.4130, device='cuda:0') (tensor(588.6324, device='cuda:0')) | > loss_gen: 3.5789527893066406 (2.444062119875199) | > loss_kl: 0.3645356595516205 (0.7925190512950604) | > loss_feat: 7.93880558013916 (6.030352664920382) | > loss_mel: 21.940834045410156 (21.526758848092502) | > loss_duration: 1.4315927028656006 (1.419735067929977) | > loss_1: 35.25471878051758 (32.21342751918694) | > grad_norm_1: tensor(8945.3496, device='cuda:0') (tensor(21353.0859, device='cuda:0')) | > current_lr_0: 9.705445136504501e-05 | > current_lr_1: 9.705445136504501e-05 | > step_time: 0.4103 (0.6052044599484174) | > loader_time: 0.0155 (0.021967111489711668)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9629006385803223 (2.9629006385803223) | > loss_disc_real_0: 0.23585157096385956 (0.23585157096385956) | > loss_disc_real_1: 0.19446898996829987 (0.19446898996829987) | > loss_disc_real_2: 0.29038676619529724 (0.29038676619529724) | > loss_disc_real_3: 0.3759526014328003 (0.3759526014328003) | > loss_disc_real_4: 0.3831370174884796 (0.3831370174884796) | > loss_disc_real_5: 0.5661072134971619 (0.5661072134971619) | > loss_0: 2.9629006385803223 (2.9629006385803223) | > loss_gen: 2.583503484725952 (2.583503484725952) | > loss_kl: 3.318648338317871 (3.318648338317871) | > loss_feat: 5.429564476013184 (5.429564476013184) | > loss_mel: 24.951719284057617 (24.951719284057617) | > loss_duration: 2.7701120376586914 (2.7701120376586914) | > loss_1: 39.05354690551758 (39.05354690551758)  --> STEP: 1 | > loss_disc: 2.9583187103271484 (2.9583187103271484) | > loss_disc_real_0: 0.3246571123600006 (0.3246571123600006) | > loss_disc_real_1: 0.28697484731674194 (0.28697484731674194) | > loss_disc_real_2: 0.27667051553726196 (0.27667051553726196) | > loss_disc_real_3: 0.27777811884880066 (0.27777811884880066) | > loss_disc_real_4: 0.2388152778148651 (0.2388152778148651) | > loss_disc_real_5: 0.2366224080324173 (0.2366224080324173) | > loss_0: 2.9583187103271484 (2.9583187103271484) | > loss_gen: 1.727675437927246 (1.727675437927246) | > loss_kl: 3.892598867416382 (3.892598867416382) | > loss_feat: 0.1819562464952469 (0.1819562464952469) | > loss_mel: 10.439423561096191 (10.439423561096191) | > loss_duration: 3.150502920150757 (3.150502920150757) | > loss_1: 19.39215660095215 (19.39215660095215)  --> STEP: 2 | > loss_disc: 3.0122244358062744 (2.9852715730667114) | > loss_disc_real_0: 0.3284422755241394 (0.32654969394207) | > loss_disc_real_1: 0.2854117453098297 (0.2861932963132858) | > loss_disc_real_2: 0.27482467889785767 (0.2757475972175598) | > loss_disc_real_3: 0.2777533233165741 (0.2777657210826874) | > loss_disc_real_4: 0.23941799998283386 (0.2391166388988495) | > loss_disc_real_5: 0.23613376915454865 (0.23637808859348297) | > loss_0: 3.0122244358062744 (2.9852715730667114) | > loss_gen: 1.6476352214813232 (1.6876553297042847) | > loss_kl: 4.836278438568115 (4.3644386529922485) | > loss_feat: 0.01554490439593792 (0.0987505754455924) | > loss_mel: 2.100808620452881 (6.270116090774536) | > loss_duration: 3.0433433055877686 (3.0969231128692627) | > loss_1: 11.643610954284668 (15.517883777618408)  --> STEP: 3 | > loss_disc: 2.9536352157592773 (2.9747261206309) | > loss_disc_real_0: 0.36953306198120117 (0.3408774832884471) | > loss_disc_real_1: 0.30505451560020447 (0.29248036940892536) | > loss_disc_real_2: 0.3234434723854065 (0.2916462222735087) | > loss_disc_real_3: 0.3316885232925415 (0.2957399884859721) | > loss_disc_real_4: 0.2710416615009308 (0.24975831309954324) | > loss_disc_real_5: 0.23393148183822632 (0.23556255300839743) | > loss_0: 2.9536352157592773 (2.9747261206309) | > loss_gen: 2.046847343444824 (1.807386000951131) | > loss_kl: 2.6145856380462646 (3.7811543146769204) | > loss_feat: 1.564845323562622 (0.5874488248179356) | > loss_mel: 16.86132049560547 (9.800517559051514) | > loss_duration: 2.8648836612701416 (3.019576629002889) | > loss_1: 25.952484130859375 (18.9960838953654) --> EVAL PERFORMANCE | > avg_loader_time: 0.008483330408732096 (-0.001841704050699871) | > avg_loss_disc: 2.9747261206309 (-0.25436170895894383) | > avg_loss_disc_real_0: 0.3408774832884471 (+0.1090474973122279) | > avg_loss_disc_real_1: 0.29248036940892536 (-0.018747806549072266) | > avg_loss_disc_real_2: 0.2916462222735087 (-0.012373069922129276) | > avg_loss_disc_real_3: 0.2957399884859721 (+0.01791201035181683) | > avg_loss_disc_real_4: 0.24975831309954324 (-0.032874266306559236) | > avg_loss_disc_real_5: 0.23556255300839743 (-0.05148851871490476) | > avg_loss_0: 2.9747261206309 (-0.25436170895894383) | > avg_loss_gen: 1.807386000951131 (+0.20759141445159912) | > avg_loss_kl: 3.7811543146769204 (+0.06239136060078909) | > avg_loss_feat: 0.5874488248179356 (-2.007347288851937) | > avg_loss_mel: 9.800517559051514 (+0.88362717628479) | > avg_loss_duration: 3.019576629002889 (-0.030241727828979492) | > avg_loss_1: 18.9960838953654 (-0.8839791615804025)  > EPOCH: 724/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:16:44)   --> TIME: 2023-10-20 08:17:04 -- STEP: 19/50 -- GLOBAL_STEP: 89220 | > loss_disc: 2.346569061279297 (2.46412339963411) | > loss_disc_real_0: 0.024872804060578346 (0.146715799787719) | > loss_disc_real_1: 0.2400561273097992 (0.22912963832679548) | > loss_disc_real_2: 0.2689632475376129 (0.22752432505551137) | > loss_disc_real_3: 0.27852240204811096 (0.2647317579310191) | > loss_disc_real_4: 0.19563934206962585 (0.1974011369441685) | > loss_disc_real_5: 0.19455693662166595 (0.20360323982803444) | > loss_0: 2.346569061279297 (2.46412339963411) | > grad_norm_0: tensor(857.2177, device='cuda:0') (tensor(501.6001, device='cuda:0')) | > loss_gen: 2.315309524536133 (2.2894882214696786) | > loss_kl: 0.8892564177513123 (0.8838394503844412) | > loss_feat: 6.1103434562683105 (5.346755868902332) | > loss_mel: 25.99213409423828 (19.80906401182476) | > loss_duration: 1.5960218906402588 (1.4553751506303485) | > loss_1: 36.90306854248047 (29.784522934963828) | > grad_norm_1: tensor(39192.1602, device='cuda:0') (tensor(28030.4902, device='cuda:0')) | > current_lr_0: 9.695743936438872e-05 | > current_lr_1: 9.695743936438872e-05 | > step_time: 0.7108 (0.6955613588031969) | > loader_time: 0.0241 (0.025089439592863385)  --> TIME: 2023-10-20 08:17:24 -- STEP: 49/50 -- GLOBAL_STEP: 89250 | > loss_disc: 2.4801928997039795 (2.506806200864363) | > loss_disc_real_0: 0.16817712783813477 (0.14856789097646061) | > loss_disc_real_1: 0.17579782009124756 (0.2291563279470619) | > loss_disc_real_2: 0.1481713056564331 (0.22506316409123187) | > loss_disc_real_3: 0.25311344861984253 (0.24823610750692232) | > loss_disc_real_4: 0.23727382719516754 (0.22333613402989447) | > loss_disc_real_5: 0.27644094824790955 (0.20602738792646905) | > loss_0: 2.4801928997039795 (2.506806200864363) | > grad_norm_0: tensor(460.8179, device='cuda:0') (tensor(681.9776, device='cuda:0')) | > loss_gen: 2.094743251800537 (2.2496119567326143) | > loss_kl: 0.7999688386917114 (0.8097191547252693) | > loss_feat: 4.633917331695557 (5.282939592946549) | > loss_mel: 22.384395599365234 (20.973111892233085) | > loss_duration: 1.4950355291366577 (1.4122518811907092) | > loss_1: 31.40806007385254 (30.727634614827682) | > grad_norm_1: tensor(7547.0601, device='cuda:0') (tensor(19784.0391, device='cuda:0')) | > current_lr_0: 9.695743936438872e-05 | > current_lr_1: 9.695743936438872e-05 | > step_time: 0.4474 (0.6526930186213281) | > loader_time: 0.3985 (0.03309129695503079)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3597898483276367 (2.3597898483276367) | > loss_disc_real_0: 0.25060954689979553 (0.25060954689979553) | > loss_disc_real_1: 0.20919650793075562 (0.20919650793075562) | > loss_disc_real_2: 0.29307040572166443 (0.29307040572166443) | > loss_disc_real_3: 0.26944395899772644 (0.26944395899772644) | > loss_disc_real_4: 0.2905611991882324 (0.2905611991882324) | > loss_disc_real_5: 0.19613642990589142 (0.19613642990589142) | > loss_0: 2.3597898483276367 (2.3597898483276367) | > loss_gen: 3.2647705078125 (3.2647705078125) | > loss_kl: 3.7806813716888428 (3.7806813716888428) | > loss_feat: 8.079645156860352 (8.079645156860352) | > loss_mel: 25.061506271362305 (25.061506271362305) | > loss_duration: 2.698835611343384 (2.698835611343384) | > loss_1: 42.885440826416016 (42.885440826416016)  --> STEP: 1 | > loss_disc: 2.3500680923461914 (2.3500680923461914) | > loss_disc_real_0: 0.20103637874126434 (0.20103637874126434) | > loss_disc_real_1: 0.3219192326068878 (0.3219192326068878) | > loss_disc_real_2: 0.17041219770908356 (0.17041219770908356) | > loss_disc_real_3: 0.06531771272420883 (0.06531771272420883) | > loss_disc_real_4: 0.36810964345932007 (0.36810964345932007) | > loss_disc_real_5: 0.031128743663430214 (0.031128743663430214) | > loss_0: 2.3500680923461914 (2.3500680923461914) | > loss_gen: 2.492903232574463 (2.492903232574463) | > loss_kl: 4.822469711303711 (4.822469711303711) | > loss_feat: 9.84140682220459 (9.84140682220459) | > loss_mel: 27.102731704711914 (27.102731704711914) | > loss_duration: 3.088381290435791 (3.088381290435791) | > loss_1: 47.347896575927734 (47.347896575927734)  --> STEP: 2 | > loss_disc: 2.839722156524658 (2.594895124435425) | > loss_disc_real_0: 0.1664646863937378 (0.18375053256750107) | > loss_disc_real_1: 0.2582227289676666 (0.2900709807872772) | > loss_disc_real_2: 0.2692188322544098 (0.21981551498174667) | > loss_disc_real_3: 0.21738263964653015 (0.1413501761853695) | > loss_disc_real_4: 0.19243906438350677 (0.2802743539214134) | > loss_disc_real_5: 0.23640967905521393 (0.13376921135932207) | > loss_0: 2.839722156524658 (2.594895124435425) | > loss_gen: 1.5814576148986816 (2.0371804237365723) | > loss_kl: 5.193331718444824 (5.007900714874268) | > loss_feat: 1.4161252975463867 (5.628766059875488) | > loss_mel: 6.813683986663818 (16.958207845687866) | > loss_duration: 2.927999258041382 (3.0081902742385864) | > loss_1: 17.932598114013672 (32.6402473449707)  --> STEP: 3 | > loss_disc: 2.9525973796844482 (2.7141292095184326) | > loss_disc_real_0: 0.37159186601638794 (0.2463643103837967) | > loss_disc_real_1: 0.300531268119812 (0.2935577432314555) | > loss_disc_real_2: 0.26672205328941345 (0.23545102775096893) | > loss_disc_real_3: 0.2608146369457245 (0.18117166310548782) | > loss_disc_real_4: 0.22636079788208008 (0.262303168574969) | > loss_disc_real_5: 0.19052888453006744 (0.1526891024162372) | > loss_0: 2.9525973796844482 (2.7141292095184326) | > loss_gen: 1.9501442909240723 (2.008168379465739) | > loss_kl: 2.1444180011749268 (4.053406476974487) | > loss_feat: 2.420682430267334 (4.5594048500061035) | > loss_mel: 19.15334701538086 (17.689920902252197) | > loss_duration: 2.83209228515625 (2.949490944544474) | > loss_1: 28.50068473815918 (31.260393142700195) --> EVAL PERFORMANCE | > avg_loader_time: 0.005384365717569987 (-0.0030989646911621085) | > avg_loss_disc: 2.7141292095184326 (-0.2605969111124673) | > avg_loss_disc_real_0: 0.2463643103837967 (-0.09451317290465039) | > avg_loss_disc_real_1: 0.2935577432314555 (+0.0010773738225301477) | > avg_loss_disc_real_2: 0.23545102775096893 (-0.05619519452253979) | > avg_loss_disc_real_3: 0.18117166310548782 (-0.11456832538048428) | > avg_loss_disc_real_4: 0.262303168574969 (+0.012544855475425748) | > avg_loss_disc_real_5: 0.1526891024162372 (-0.08287345059216022) | > avg_loss_0: 2.7141292095184326 (-0.2605969111124673) | > avg_loss_gen: 2.008168379465739 (+0.20078237851460767) | > avg_loss_kl: 4.053406476974487 (+0.2722521622975669) | > avg_loss_feat: 4.5594048500061035 (+3.971956025188168) | > avg_loss_mel: 17.689920902252197 (+7.889403343200684) | > avg_loss_duration: 2.949490944544474 (-0.07008568445841501) | > avg_loss_1: 31.260393142700195 (+12.264309247334797)  > EPOCH: 725/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:17:44)   --> TIME: 2023-10-20 08:18:03 -- STEP: 29/50 -- GLOBAL_STEP: 89280 | > loss_disc: 2.7803988456726074 (2.4499831240752648) | > loss_disc_real_0: 0.21115583181381226 (0.1406369959485942) | > loss_disc_real_1: 0.24662594497203827 (0.23452522091824432) | > loss_disc_real_2: 0.26025718450546265 (0.22388532346692577) | > loss_disc_real_3: 0.2184295952320099 (0.2511677034199237) | > loss_disc_real_4: 0.2484895884990692 (0.22901851516859284) | > loss_disc_real_5: 0.2688182592391968 (0.24327698285723554) | > loss_0: 2.7803988456726074 (2.4499831240752648) | > grad_norm_0: tensor(942.4167, device='cuda:0') (tensor(833.1068, device='cuda:0')) | > loss_gen: 1.7906570434570312 (2.3414486564438923) | > loss_kl: 0.7085301280021667 (0.8379095032297331) | > loss_feat: 0.6718479990959167 (5.576112115948365) | > loss_mel: 15.463899612426758 (21.934243555726677) | > loss_duration: 1.412367343902588 (1.4158716653955394) | > loss_1: 20.04730224609375 (32.105585295578514) | > grad_norm_1: tensor(12644.5098, device='cuda:0') (tensor(19191.7559, device='cuda:0')) | > current_lr_0: 9.686052433330096e-05 | > current_lr_1: 9.686052433330096e-05 | > step_time: 0.3751 (0.42739711958786536) | > loader_time: 0.0019 (0.010291041999027646)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7669613361358643 (2.7669613361358643) | > loss_disc_real_0: 0.21494540572166443 (0.21494540572166443) | > loss_disc_real_1: 0.28000009059906006 (0.28000009059906006) | > loss_disc_real_2: 0.38832733035087585 (0.38832733035087585) | > loss_disc_real_3: 0.34363651275634766 (0.34363651275634766) | > loss_disc_real_4: 0.33595961332321167 (0.33595961332321167) | > loss_disc_real_5: 0.34221112728118896 (0.34221112728118896) | > loss_0: 2.7669613361358643 (2.7669613361358643) | > loss_gen: 2.467771530151367 (2.467771530151367) | > loss_kl: 4.226998329162598 (4.226998329162598) | > loss_feat: 2.8674087524414062 (2.8674087524414062) | > loss_mel: 23.539295196533203 (23.539295196533203) | > loss_duration: 2.7090768814086914 (2.7090768814086914) | > loss_1: 35.810546875 (35.810546875)  --> STEP: 1 | > loss_disc: 3.1396002769470215 (3.1396002769470215) | > loss_disc_real_0: 0.3003419041633606 (0.3003419041633606) | > loss_disc_real_1: 0.39604607224464417 (0.39604607224464417) | > loss_disc_real_2: 0.3340185582637787 (0.3340185582637787) | > loss_disc_real_3: 0.3451794981956482 (0.3451794981956482) | > loss_disc_real_4: 0.31238412857055664 (0.31238412857055664) | > loss_disc_real_5: 0.14277705550193787 (0.14277705550193787) | > loss_0: 3.1396002769470215 (3.1396002769470215) | > loss_gen: 2.1174254417419434 (2.1174254417419434) | > loss_kl: 4.402227401733398 (4.402227401733398) | > loss_feat: 4.8111443519592285 (4.8111443519592285) | > loss_mel: 24.81066131591797 (24.81066131591797) | > loss_duration: 3.1768174171447754 (3.1768174171447754) | > loss_1: 39.318275451660156 (39.318275451660156)  --> STEP: 2 | > loss_disc: 2.725900411605835 (2.9327503442764282) | > loss_disc_real_0: 0.23972496390342712 (0.27003343403339386) | > loss_disc_real_1: 0.3074270486831665 (0.35173656046390533) | > loss_disc_real_2: 0.31419774889945984 (0.32410815358161926) | > loss_disc_real_3: 0.2543768882751465 (0.29977819323539734) | > loss_disc_real_4: 0.548844575881958 (0.4306143522262573) | > loss_disc_real_5: 0.13262423872947693 (0.1377006471157074) | > loss_0: 2.725900411605835 (2.9327503442764282) | > loss_gen: 2.8008575439453125 (2.459141492843628) | > loss_kl: 4.764731407165527 (4.583479404449463) | > loss_feat: 7.009086608886719 (5.910115480422974) | > loss_mel: 22.46843910217285 (23.63955020904541) | > loss_duration: 2.96291184425354 (3.0698646306991577) | > loss_1: 40.00602722167969 (39.66215133666992)  --> STEP: 3 | > loss_disc: 2.3515820503234863 (2.7390275796254477) | > loss_disc_real_0: 0.22732312977313995 (0.2557966659466426) | > loss_disc_real_1: 0.2958003878593445 (0.3330911695957184) | > loss_disc_real_2: 0.27891600131988525 (0.30904410282770794) | > loss_disc_real_3: 0.29542702436447144 (0.29832780361175537) | > loss_disc_real_4: 0.1430959701538086 (0.3347748915354411) | > loss_disc_real_5: 0.16547074913978577 (0.14695734779040018) | > loss_0: 2.3515820503234863 (2.7390275796254477) | > loss_gen: 2.4944798946380615 (2.470920960108439) | > loss_kl: 2.4395997524261475 (3.8688528537750244) | > loss_feat: 5.678804397583008 (5.833011786142985) | > loss_mel: 24.30454444885254 (23.861214955647785) | > loss_duration: 2.852895498275757 (2.997541586558024) | > loss_1: 37.77032470703125 (39.031542460123696) --> EVAL PERFORMANCE | > avg_loader_time: 0.011539777119954428 (+0.00615541140238444) | > avg_loss_disc: 2.7390275796254477 (+0.024898370107015122) | > avg_loss_disc_real_0: 0.2557966659466426 (+0.009432355562845884) | > avg_loss_disc_real_1: 0.3330911695957184 (+0.03953342636426288) | > avg_loss_disc_real_2: 0.30904410282770794 (+0.07359307507673901) | > avg_loss_disc_real_3: 0.29832780361175537 (+0.11715614050626755) | > avg_loss_disc_real_4: 0.3347748915354411 (+0.0724717229604721) | > avg_loss_disc_real_5: 0.14695734779040018 (-0.005731754625837027) | > avg_loss_0: 2.7390275796254477 (+0.024898370107015122) | > avg_loss_gen: 2.470920960108439 (+0.4627525806427002) | > avg_loss_kl: 3.8688528537750244 (-0.1845536231994629) | > avg_loss_feat: 5.833011786142985 (+1.2736069361368818) | > avg_loss_mel: 23.861214955647785 (+6.171294053395588) | > avg_loss_duration: 2.997541586558024 (+0.048050642013549805) | > avg_loss_1: 39.031542460123696 (+7.7711493174235)  > EPOCH: 726/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:18:29)   --> TIME: 2023-10-20 08:18:40 -- STEP: 9/50 -- GLOBAL_STEP: 89310 | > loss_disc: 1.796215534210205 (2.23572756184472) | > loss_disc_real_0: 0.055095069110393524 (0.11736734708150227) | > loss_disc_real_1: 0.2531765103340149 (0.22874976694583893) | > loss_disc_real_2: 0.3147129416465759 (0.2722412761714723) | > loss_disc_real_3: 0.33356940746307373 (0.2553033646610048) | > loss_disc_real_4: 0.09670959413051605 (0.19363319439192614) | > loss_disc_real_5: 0.06219806894659996 (0.112663885888954) | > loss_0: 1.796215534210205 (2.23572756184472) | > grad_norm_0: tensor(258.3784, device='cuda:0') (tensor(508.6913, device='cuda:0')) | > loss_gen: 3.1799490451812744 (2.701277401712206) | > loss_kl: 0.6833110451698303 (0.5628158549467722) | > loss_feat: 8.085848808288574 (8.209349115689596) | > loss_mel: 22.470766067504883 (23.715319951375324) | > loss_duration: 1.3359352350234985 (1.425573812590705) | > loss_1: 35.75580978393555 (36.61433558993869) | > grad_norm_1: tensor(7570.5786, device='cuda:0') (tensor(24876.7363, device='cuda:0')) | > current_lr_0: 9.676370617485456e-05 | > current_lr_1: 9.676370617485456e-05 | > step_time: 0.5601 (0.5793585777282715) | > loader_time: 0.0349 (0.020144753985934787)  --> TIME: 2023-10-20 08:19:02 -- STEP: 39/50 -- GLOBAL_STEP: 89340 | > loss_disc: 2.9901106357574463 (2.4468876398526707) | > loss_disc_real_0: 0.2677673101425171 (0.15319395819917703) | > loss_disc_real_1: 0.23354673385620117 (0.23913704374661812) | > loss_disc_real_2: 0.25300711393356323 (0.23278057154936668) | > loss_disc_real_3: 0.2407686412334442 (0.2387366526019879) | > loss_disc_real_4: 0.24396029114723206 (0.2313587581500029) | > loss_disc_real_5: 0.2612408399581909 (0.23050064786982077) | > loss_0: 2.9901106357574463 (2.4468876398526707) | > grad_norm_0: tensor(763.0707, device='cuda:0') (tensor(621.4621, device='cuda:0')) | > loss_gen: 1.476324200630188 (2.4115913005975576) | > loss_kl: 0.2740027904510498 (0.775567481915156) | > loss_feat: 0.10023397952318192 (5.771319068777255) | > loss_mel: 1.9877010583877563 (21.357272304021397) | > loss_duration: 1.4698015451431274 (1.421295465567173) | > loss_1: 5.308063507080078 (31.73704538589869) | > grad_norm_1: tensor(16690.7266, device='cuda:0') (tensor(20923.6152, device='cuda:0')) | > current_lr_0: 9.676370617485456e-05 | > current_lr_1: 9.676370617485456e-05 | > step_time: 0.3644 (0.6744552820156782) | > loader_time: 0.0025 (0.024716230539175186)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.871612071990967 (2.871612071990967) | > loss_disc_real_0: 0.20750221610069275 (0.20750221610069275) | > loss_disc_real_1: 0.2603521943092346 (0.2603521943092346) | > loss_disc_real_2: 0.27573534846305847 (0.27573534846305847) | > loss_disc_real_3: 0.29040396213531494 (0.29040396213531494) | > loss_disc_real_4: 0.2373984307050705 (0.2373984307050705) | > loss_disc_real_5: 0.2712897062301636 (0.2712897062301636) | > loss_0: 2.871612071990967 (2.871612071990967) | > loss_gen: 1.697617530822754 (1.697617530822754) | > loss_kl: 5.279417514801025 (5.279417514801025) | > loss_feat: 0.33979493379592896 (0.33979493379592896) | > loss_mel: 12.548968315124512 (12.548968315124512) | > loss_duration: 2.8524105548858643 (2.8524105548858643) | > loss_1: 22.718210220336914 (22.718210220336914)  --> STEP: 1 | > loss_disc: 2.5088703632354736 (2.5088703632354736) | > loss_disc_real_0: 0.18422828614711761 (0.18422828614711761) | > loss_disc_real_1: 0.3228520452976227 (0.3228520452976227) | > loss_disc_real_2: 0.28426340222358704 (0.28426340222358704) | > loss_disc_real_3: 0.30731648206710815 (0.30731648206710815) | > loss_disc_real_4: 0.20051103830337524 (0.20051103830337524) | > loss_disc_real_5: 0.2214551717042923 (0.2214551717042923) | > loss_0: 2.5088703632354736 (2.5088703632354736) | > loss_gen: 2.6142473220825195 (2.6142473220825195) | > loss_kl: 4.615102291107178 (4.615102291107178) | > loss_feat: 4.520667552947998 (4.520667552947998) | > loss_mel: 26.15984535217285 (26.15984535217285) | > loss_duration: 3.1641929149627686 (3.1641929149627686) | > loss_1: 41.07405471801758 (41.07405471801758)  --> STEP: 2 | > loss_disc: 2.6657283306121826 (2.587299346923828) | > loss_disc_real_0: 0.17412051558494568 (0.17917440086603165) | > loss_disc_real_1: 0.42692551016807556 (0.3748887777328491) | > loss_disc_real_2: 0.36067721247673035 (0.3224703073501587) | > loss_disc_real_3: 0.2252517193555832 (0.2662841007113457) | > loss_disc_real_4: 0.40022963285446167 (0.30037033557891846) | > loss_disc_real_5: 0.4387088418006897 (0.330082006752491) | > loss_0: 2.6657283306121826 (2.587299346923828) | > loss_gen: 3.2155978679656982 (2.914922595024109) | > loss_kl: 5.017795562744141 (4.816448926925659) | > loss_feat: 6.752243995666504 (5.636455774307251) | > loss_mel: 29.982433319091797 (28.071139335632324) | > loss_duration: 3.0354959964752197 (3.099844455718994) | > loss_1: 48.00356674194336 (44.53881072998047)  --> STEP: 3 | > loss_disc: 3.1181437969207764 (2.764247496922811) | > loss_disc_real_0: 0.2722761034965515 (0.2102083017428716) | > loss_disc_real_1: 0.26154911518096924 (0.33710889021555585) | > loss_disc_real_2: 0.2445240169763565 (0.2964882105588913) | > loss_disc_real_3: 0.2986116409301758 (0.2770599474509557) | > loss_disc_real_4: 0.2075149565935135 (0.26941854258378345) | > loss_disc_real_5: 0.2865426540374756 (0.3155688891808192) | > loss_0: 3.1181437969207764 (2.764247496922811) | > loss_gen: 1.623937964439392 (2.484594384829203) | > loss_kl: 2.55466365814209 (4.062520503997803) | > loss_feat: 1.8010414838790894 (4.357984344164531) | > loss_mel: 19.113473892211914 (25.085250854492188) | > loss_duration: 2.8440096378326416 (3.01456618309021) | > loss_1: 27.93712615966797 (39.00491587320963) --> EVAL PERFORMANCE | > avg_loader_time: 0.027849674224853516 (+0.016309897104899086) | > avg_loss_disc: 2.764247496922811 (+0.02521991729736328) | > avg_loss_disc_real_0: 0.2102083017428716 (-0.045588364203770965) | > avg_loss_disc_real_1: 0.33710889021555585 (+0.0040177206198374615) | > avg_loss_disc_real_2: 0.2964882105588913 (-0.012555892268816649) | > avg_loss_disc_real_3: 0.2770599474509557 (-0.02126785616079968) | > avg_loss_disc_real_4: 0.26941854258378345 (-0.06535634895165765) | > avg_loss_disc_real_5: 0.3155688891808192 (+0.16861154139041903) | > avg_loss_0: 2.764247496922811 (+0.02521991729736328) | > avg_loss_gen: 2.484594384829203 (+0.01367342472076416) | > avg_loss_kl: 4.062520503997803 (+0.19366765022277832) | > avg_loss_feat: 4.357984344164531 (-1.4750274419784546) | > avg_loss_mel: 25.085250854492188 (+1.2240358988444022) | > avg_loss_duration: 3.01456618309021 (+0.01702459653218602) | > avg_loss_1: 39.00491587320963 (-0.0266265869140625)  > EPOCH: 727/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:19:21)   --> TIME: 2023-10-20 08:19:35 -- STEP: 19/50 -- GLOBAL_STEP: 89370 | > loss_disc: 3.004023551940918 (2.4294844175639905) | > loss_disc_real_0: 0.3260939121246338 (0.14045461997585862) | > loss_disc_real_1: 0.27655279636383057 (0.2212111173491729) | > loss_disc_real_2: 0.2549707591533661 (0.22755475950084234) | > loss_disc_real_3: 0.2599804699420929 (0.26057055974869353) | > loss_disc_real_4: 0.2599247395992279 (0.22545357401433744) | > loss_disc_real_5: 0.2536132037639618 (0.23274096081915654) | > loss_0: 3.004023551940918 (2.4294844175639905) | > grad_norm_0: tensor(951.1012, device='cuda:0') (tensor(692.4479, device='cuda:0')) | > loss_gen: 1.5808563232421875 (2.3937720374057165) | > loss_kl: 0.5315353870391846 (0.7861407603088179) | > loss_feat: 0.049065932631492615 (6.056467917012541) | > loss_mel: 1.3447448015213013 (23.547435396596004) | > loss_duration: 1.5292418003082275 (1.441790969748246) | > loss_1: 5.035444259643555 (34.22560681794819) | > grad_norm_1: tensor(45907.7500, device='cuda:0') (tensor(25190.9883, device='cuda:0')) | > current_lr_0: 9.666698479221925e-05 | > current_lr_1: 9.666698479221925e-05 | > step_time: 0.3789 (0.39802851175007065) | > loader_time: 0.0146 (0.009053820057919151)  --> TIME: 2023-10-20 08:19:51 -- STEP: 49/50 -- GLOBAL_STEP: 89400 | > loss_disc: 2.9828476905822754 (2.456328368916804) | > loss_disc_real_0: 0.40489888191223145 (0.158240206444598) | > loss_disc_real_1: 0.23894232511520386 (0.22789848105487776) | > loss_disc_real_2: 0.17137472331523895 (0.22627903528663576) | > loss_disc_real_3: 0.23214711248874664 (0.2473264999915751) | > loss_disc_real_4: 0.25376442074775696 (0.23691148668223497) | > loss_disc_real_5: 0.24455317854881287 (0.23024895965900957) | > loss_0: 2.9828476905822754 (2.456328368916804) | > grad_norm_0: tensor(735.7287, device='cuda:0') (tensor(635.4888, device='cuda:0')) | > loss_gen: 1.5967059135437012 (2.3458109412874495) | > loss_kl: 0.6309414505958557 (0.8007805237964708) | > loss_feat: 0.3085858225822449 (5.601421327767324) | > loss_mel: 14.649449348449707 (21.90936344010489) | > loss_duration: 1.5018723011016846 (1.4075831661418992) | > loss_1: 18.68755531311035 (32.06495899083662) | > grad_norm_1: tensor(8883.6777, device='cuda:0') (tensor(21020.8496, device='cuda:0')) | > current_lr_0: 9.666698479221925e-05 | > current_lr_1: 9.666698479221925e-05 | > step_time: 0.6044 (0.457408856372444) | > loader_time: 0.496 (0.021705009499374702)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2614309787750244 (2.2614309787750244) | > loss_disc_real_0: 0.20594607293605804 (0.20594607293605804) | > loss_disc_real_1: 0.19954773783683777 (0.19954773783683777) | > loss_disc_real_2: 0.2261146605014801 (0.2261146605014801) | > loss_disc_real_3: 0.23507651686668396 (0.23507651686668396) | > loss_disc_real_4: 0.12911108136177063 (0.12911108136177063) | > loss_disc_real_5: 0.11597679555416107 (0.11597679555416107) | > loss_0: 2.2614309787750244 (2.2614309787750244) | > loss_gen: 2.3194756507873535 (2.3194756507873535) | > loss_kl: 3.863089084625244 (3.863089084625244) | > loss_feat: 6.842600345611572 (6.842600345611572) | > loss_mel: 20.296640396118164 (20.296640396118164) | > loss_duration: 2.7183287143707275 (2.7183287143707275) | > loss_1: 36.040138244628906 (36.040138244628906)  --> STEP: 1 | > loss_disc: 1.8316009044647217 (1.8316009044647217) | > loss_disc_real_0: 0.1348600685596466 (0.1348600685596466) | > loss_disc_real_1: 0.2632140517234802 (0.2632140517234802) | > loss_disc_real_2: 0.1725292056798935 (0.1725292056798935) | > loss_disc_real_3: 0.2542586624622345 (0.2542586624622345) | > loss_disc_real_4: 0.12119249254465103 (0.12119249254465103) | > loss_disc_real_5: 0.2085869312286377 (0.2085869312286377) | > loss_0: 1.8316009044647217 (1.8316009044647217) | > loss_gen: 2.943246603012085 (2.943246603012085) | > loss_kl: 4.306237697601318 (4.306237697601318) | > loss_feat: 9.09911823272705 (9.09911823272705) | > loss_mel: 23.862415313720703 (23.862415313720703) | > loss_duration: 3.058936595916748 (3.058936595916748) | > loss_1: 43.26995086669922 (43.26995086669922)  --> STEP: 2 | > loss_disc: 3.0365781784057617 (2.4340895414352417) | > loss_disc_real_0: 0.3356260657310486 (0.2352430671453476) | > loss_disc_real_1: 0.24086670577526093 (0.2520403787493706) | > loss_disc_real_2: 0.16838088631629944 (0.17045504599809647) | > loss_disc_real_3: 0.23549753427505493 (0.24487809836864471) | > loss_disc_real_4: 0.2523635923862457 (0.18677804246544838) | > loss_disc_real_5: 0.2488403469324112 (0.22871363908052444) | > loss_0: 3.0365781784057617 (2.4340895414352417) | > loss_gen: 1.4738259315490723 (2.2085362672805786) | > loss_kl: 4.852292537689209 (4.579265117645264) | > loss_feat: 0.0686362236738205 (4.583877228200436) | > loss_mel: 1.7595493793487549 (12.810982346534729) | > loss_duration: 2.9988434314727783 (3.028890013694763) | > loss_1: 11.15314769744873 (27.211549282073975)  --> STEP: 3 | > loss_disc: 3.126373767852783 (2.664850950241089) | > loss_disc_real_0: 0.20264402031898499 (0.22437671820322672) | > loss_disc_real_1: 0.3523276448249817 (0.28546946744124096) | > loss_disc_real_2: 0.32161572575569153 (0.22084193925062814) | > loss_disc_real_3: 0.26660817861557007 (0.2521214584509532) | > loss_disc_real_4: 0.1919761747121811 (0.18851075321435928) | > loss_disc_real_5: 0.277810275554657 (0.24507918457190195) | > loss_0: 3.126373767852783 (2.664850950241089) | > loss_gen: 2.0517184734344482 (2.1562636693318686) | > loss_kl: 1.9213215112686157 (3.6932839155197144) | > loss_feat: 5.035147666931152 (4.734300707777341) | > loss_mel: 23.43963623046875 (16.353866974512737) | > loss_duration: 2.7131378650665283 (2.9236392974853516) | > loss_1: 35.16096115112305 (29.861353238423664) --> EVAL PERFORMANCE | > avg_loader_time: 0.008763472239176432 (-0.019086201985677086) | > avg_loss_disc: 2.664850950241089 (-0.09939654668172215) | > avg_loss_disc_real_0: 0.22437671820322672 (+0.014168416460355104) | > avg_loss_disc_real_1: 0.28546946744124096 (-0.05163942277431488) | > avg_loss_disc_real_2: 0.22084193925062814 (-0.07564627130826315) | > avg_loss_disc_real_3: 0.2521214584509532 (-0.024938489000002506) | > avg_loss_disc_real_4: 0.18851075321435928 (-0.08090778936942417) | > avg_loss_disc_real_5: 0.24507918457190195 (-0.07048970460891726) | > avg_loss_0: 2.664850950241089 (-0.09939654668172215) | > avg_loss_gen: 2.1562636693318686 (-0.3283307154973345) | > avg_loss_kl: 3.6932839155197144 (-0.3692365884780884) | > avg_loss_feat: 4.734300707777341 (+0.3763163636128102) | > avg_loss_mel: 16.353866974512737 (-8.73138387997945) | > avg_loss_duration: 2.9236392974853516 (-0.0909268856048584) | > avg_loss_1: 29.861353238423664 (-9.143562634785969)  > EPOCH: 728/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:20:09)   --> TIME: 2023-10-20 08:20:32 -- STEP: 29/50 -- GLOBAL_STEP: 89430 | > loss_disc: 2.4496779441833496 (2.304561156651069) | > loss_disc_real_0: 0.05064656212925911 (0.14538212724286934) | > loss_disc_real_1: 0.3566371202468872 (0.2133981316382515) | > loss_disc_real_2: 0.4422439634799957 (0.21748209847458477) | > loss_disc_real_3: 0.20968465507030487 (0.22691158985654855) | > loss_disc_real_4: 0.07159989327192307 (0.1889561006221278) | > loss_disc_real_5: 0.11591456830501556 (0.2099265172949125) | > loss_0: 2.4496779441833496 (2.304561156651069) | > grad_norm_0: tensor(439.2678, device='cuda:0') (tensor(492.6872, device='cuda:0')) | > loss_gen: 2.4001481533050537 (2.448253935781019) | > loss_kl: 0.8498268723487854 (0.8574900041366446) | > loss_feat: 7.552065372467041 (5.774224863162842) | > loss_mel: 25.27100944519043 (18.99281608236247) | > loss_duration: 1.3718159198760986 (1.42294848376307) | > loss_1: 37.444862365722656 (29.495733376207024) | > grad_norm_1: tensor(5731.8975, device='cuda:0') (tensor(31030.1328, device='cuda:0')) | > current_lr_0: 9.657036008866154e-05 | > current_lr_1: 9.657036008866154e-05 | > step_time: 0.6757 (0.5919330942219703) | > loader_time: 0.0083 (0.01521206724232641)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6062569618225098 (2.6062569618225098) | > loss_disc_real_0: 0.11421176791191101 (0.11421176791191101) | > loss_disc_real_1: 0.36304938793182373 (0.36304938793182373) | > loss_disc_real_2: 0.25292661786079407 (0.25292661786079407) | > loss_disc_real_3: 0.28381502628326416 (0.28381502628326416) | > loss_disc_real_4: 0.24321889877319336 (0.24321889877319336) | > loss_disc_real_5: 0.19848060607910156 (0.19848060607910156) | > loss_0: 2.6062569618225098 (2.6062569618225098) | > loss_gen: 2.1821861267089844 (2.1821861267089844) | > loss_kl: 4.45658016204834 (4.45658016204834) | > loss_feat: 4.313954830169678 (4.313954830169678) | > loss_mel: 17.30021858215332 (17.30021858215332) | > loss_duration: 2.7653045654296875 (2.7653045654296875) | > loss_1: 31.01824378967285 (31.01824378967285)  --> STEP: 1 | > loss_disc: 2.817962884902954 (2.817962884902954) | > loss_disc_real_0: 0.41143324971199036 (0.41143324971199036) | > loss_disc_real_1: 0.2243235856294632 (0.2243235856294632) | > loss_disc_real_2: 0.31532177329063416 (0.31532177329063416) | > loss_disc_real_3: 0.29901546239852905 (0.29901546239852905) | > loss_disc_real_4: 0.48260006308555603 (0.48260006308555603) | > loss_disc_real_5: 0.3720765709877014 (0.3720765709877014) | > loss_0: 2.817962884902954 (2.817962884902954) | > loss_gen: 3.0865797996520996 (3.0865797996520996) | > loss_kl: 4.35703182220459 (4.35703182220459) | > loss_feat: 7.007174015045166 (7.007174015045166) | > loss_mel: 27.392152786254883 (27.392152786254883) | > loss_duration: 3.2080562114715576 (3.2080562114715576) | > loss_1: 45.050994873046875 (45.050994873046875)  --> STEP: 2 | > loss_disc: 3.8244619369506836 (3.321212410926819) | > loss_disc_real_0: 0.44766706228256226 (0.4295501559972763) | > loss_disc_real_1: 0.41822800040245056 (0.3212757930159569) | > loss_disc_real_2: 0.5335912108421326 (0.42445649206638336) | > loss_disc_real_3: 0.5411152839660645 (0.42006537318229675) | > loss_disc_real_4: 0.4168284237384796 (0.4497142434120178) | > loss_disc_real_5: 0.4320615530014038 (0.4020690619945526) | > loss_0: 3.8244619369506836 (3.321212410926819) | > loss_gen: 2.483118772506714 (2.7848492860794067) | > loss_kl: 5.435854911804199 (4.8964433670043945) | > loss_feat: 5.3595356941223145 (6.18335485458374) | > loss_mel: 25.47088623046875 (26.431519508361816) | > loss_duration: 3.0307087898254395 (3.1193825006484985) | > loss_1: 41.78010559082031 (43.415550231933594)  --> STEP: 3 | > loss_disc: 2.0352025032043457 (2.8925424416859946) | > loss_disc_real_0: 0.16718100011348724 (0.34209377070267993) | > loss_disc_real_1: 0.25793737173080444 (0.30016298592090607) | > loss_disc_real_2: 0.19501036405563354 (0.3479744493961334) | > loss_disc_real_3: 0.28000834584236145 (0.3733796974023183) | > loss_disc_real_4: 0.225943461060524 (0.3751239826281865) | > loss_disc_real_5: 0.09208481013774872 (0.29874097804228467) | > loss_0: 2.0352025032043457 (2.8925424416859946) | > loss_gen: 2.784302234649658 (2.7846669356028237) | > loss_kl: 2.108766555786133 (3.967217763264974) | > loss_feat: 6.436016082763672 (6.267575263977051) | > loss_mel: 22.635513305664062 (25.166184107462566) | > loss_duration: 2.9132368564605713 (3.0506672859191895) | > loss_1: 36.877838134765625 (41.23631286621094) --> EVAL PERFORMANCE | > avg_loader_time: 0.0041993459065755205 (-0.004564126332600911) | > avg_loss_disc: 2.8925424416859946 (+0.22769149144490575) | > avg_loss_disc_real_0: 0.34209377070267993 (+0.11771705249945322) | > avg_loss_disc_real_1: 0.30016298592090607 (+0.014693518479665102) | > avg_loss_disc_real_2: 0.3479744493961334 (+0.12713251014550528) | > avg_loss_disc_real_3: 0.3733796974023183 (+0.12125823895136512) | > avg_loss_disc_real_4: 0.3751239826281865 (+0.18661322941382724) | > avg_loss_disc_real_5: 0.29874097804228467 (+0.05366179347038272) | > avg_loss_0: 2.8925424416859946 (+0.22769149144490575) | > avg_loss_gen: 2.7846669356028237 (+0.6284032662709551) | > avg_loss_kl: 3.967217763264974 (+0.27393384774525975) | > avg_loss_feat: 6.267575263977051 (+1.5332745561997099) | > avg_loss_mel: 25.166184107462566 (+8.812317132949829) | > avg_loss_duration: 3.0506672859191895 (+0.1270279884338379) | > avg_loss_1: 41.23631286621094 (+11.374959627787273)  > EPOCH: 729/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:21:00)   --> TIME: 2023-10-20 08:21:12 -- STEP: 9/50 -- GLOBAL_STEP: 89460 | > loss_disc: 2.587801456451416 (1.8452394869592454) | > loss_disc_real_0: 0.19708171486854553 (0.1385199184426003) | > loss_disc_real_1: 0.2749488651752472 (0.19273761618468496) | > loss_disc_real_2: 0.358993798494339 (0.1811378454375598) | > loss_disc_real_3: 0.3850123882293701 (0.2372302044596937) | > loss_disc_real_4: 0.22760900855064392 (0.16157175145215458) | > loss_disc_real_5: 0.26499903202056885 (0.17785373392204443) | > loss_0: 2.587801456451416 (1.8452394869592454) | > grad_norm_0: tensor(320.2071, device='cuda:0') (tensor(529.5070, device='cuda:0')) | > loss_gen: 2.5770716667175293 (2.9859893057081432) | > loss_kl: 0.6225797533988953 (0.7040565825170941) | > loss_feat: 4.137976169586182 (8.121008995506498) | > loss_mel: 17.617481231689453 (20.34926739003923) | > loss_duration: 1.312868356704712 (1.414661208788554) | > loss_1: 26.267976760864258 (33.57498402065701) | > grad_norm_1: tensor(3087.7251, device='cuda:0') (tensor(23859.0625, device='cuda:0')) | > current_lr_0: 9.647383196754464e-05 | > current_lr_1: 9.647383196754464e-05 | > step_time: 0.436 (0.7054275671641032) | > loader_time: 0.0069 (0.02637661827935113)  --> TIME: 2023-10-20 08:21:35 -- STEP: 39/50 -- GLOBAL_STEP: 89490 | > loss_disc: 2.9633994102478027 (2.410802185535431) | > loss_disc_real_0: 0.3026958405971527 (0.14542068075388676) | > loss_disc_real_1: 0.4870733618736267 (0.23377575524724448) | > loss_disc_real_2: 0.20282426476478577 (0.2268601488799621) | > loss_disc_real_3: 0.27704742550849915 (0.27002538836155177) | > loss_disc_real_4: 0.42428210377693176 (0.24694163734332109) | > loss_disc_real_5: 0.31067097187042236 (0.24428150650018302) | > loss_0: 2.9633994102478027 (2.410802185535431) | > grad_norm_0: tensor(1651.7634, device='cuda:0') (tensor(594.7811, device='cuda:0')) | > loss_gen: 2.3434810638427734 (2.560750848207718) | > loss_kl: 0.3793582320213318 (0.8356806334012594) | > loss_feat: 3.375032424926758 (6.676439360930369) | > loss_mel: 20.131114959716797 (22.905425355984615) | > loss_duration: 1.437411904335022 (1.404507478078206) | > loss_1: 27.666399002075195 (34.38280369685246) | > grad_norm_1: tensor(23267.8633, device='cuda:0') (tensor(20150.9102, device='cuda:0')) | > current_lr_0: 9.647383196754464e-05 | > current_lr_1: 9.647383196754464e-05 | > step_time: 0.5282 (0.7225715502714499) | > loader_time: 0.0456 (0.02621620740645971)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9521514177322388 (1.9521514177322388) | > loss_disc_real_0: 0.21147038042545319 (0.21147038042545319) | > loss_disc_real_1: 0.1505359262228012 (0.1505359262228012) | > loss_disc_real_2: 0.19923095405101776 (0.19923095405101776) | > loss_disc_real_3: 0.13512784242630005 (0.13512784242630005) | > loss_disc_real_4: 0.16961325705051422 (0.16961325705051422) | > loss_disc_real_5: 0.2901514768600464 (0.2901514768600464) | > loss_0: 1.9521514177322388 (1.9521514177322388) | > loss_gen: 2.991356134414673 (2.991356134414673) | > loss_kl: 4.946454048156738 (4.946454048156738) | > loss_feat: 8.873940467834473 (8.873940467834473) | > loss_mel: 24.086952209472656 (24.086952209472656) | > loss_duration: 2.881474494934082 (2.881474494934082) | > loss_1: 43.78017807006836 (43.78017807006836)  --> STEP: 1 | > loss_disc: 2.688955545425415 (2.688955545425415) | > loss_disc_real_0: 0.48052388429641724 (0.48052388429641724) | > loss_disc_real_1: 0.20357993245124817 (0.20357993245124817) | > loss_disc_real_2: 0.2630670666694641 (0.2630670666694641) | > loss_disc_real_3: 0.24081675708293915 (0.24081675708293915) | > loss_disc_real_4: 0.1369607150554657 (0.1369607150554657) | > loss_disc_real_5: 0.16550827026367188 (0.16550827026367188) | > loss_0: 2.688955545425415 (2.688955545425415) | > loss_gen: 2.0300333499908447 (2.0300333499908447) | > loss_kl: 4.541589736938477 (4.541589736938477) | > loss_feat: 6.594468116760254 (6.594468116760254) | > loss_mel: 21.914234161376953 (21.914234161376953) | > loss_duration: 3.1890625953674316 (3.1890625953674316) | > loss_1: 38.26939010620117 (38.26939010620117)  --> STEP: 2 | > loss_disc: 1.4514803886413574 (2.0702179670333862) | > loss_disc_real_0: 0.04632323607802391 (0.2634235601872206) | > loss_disc_real_1: 0.09971941262483597 (0.15164967253804207) | > loss_disc_real_2: 0.029341133311390877 (0.1462040999904275) | > loss_disc_real_3: 0.05547326058149338 (0.14814500883221626) | > loss_disc_real_4: 0.03997683897614479 (0.08846877701580524) | > loss_disc_real_5: 0.021339507773518562 (0.09342388901859522) | > loss_0: 1.4514803886413574 (2.0702179670333862) | > loss_gen: 2.5552432537078857 (2.2926383018493652) | > loss_kl: 4.886855602264404 (4.71422266960144) | > loss_feat: 15.63214111328125 (11.113304615020752) | > loss_mel: 26.782243728637695 (24.348238945007324) | > loss_duration: 2.9842941761016846 (3.086678385734558) | > loss_1: 52.84077835083008 (45.555084228515625)  --> STEP: 3 | > loss_disc: 2.8048079013824463 (2.3150812784830728) | > loss_disc_real_0: 0.3202632665634155 (0.28237012897928554) | > loss_disc_real_1: 0.262422114610672 (0.1885738198955854) | > loss_disc_real_2: 0.17204061150550842 (0.15481627049545446) | > loss_disc_real_3: 0.256663054227829 (0.18431769063075384) | > loss_disc_real_4: 0.22712527215480804 (0.13468760872880617) | > loss_disc_real_5: 0.18527723848819733 (0.12404167217512925) | > loss_0: 2.8048079013824463 (2.3150812784830728) | > loss_gen: 1.6464030742645264 (2.0772265593210855) | > loss_kl: 2.1566333770751953 (3.8616929054260254) | > loss_feat: 0.8121073246002197 (7.679572184880574) | > loss_mel: 16.2119197845459 (21.636132558186848) | > loss_duration: 2.8317105770111084 (3.0016891161600747) | > loss_1: 23.65877342224121 (38.256313959757485) --> EVAL PERFORMANCE | > avg_loader_time: 0.017956654230753582 (+0.013757308324178062) | > avg_loss_disc: 2.3150812784830728 (-0.5774611632029218) | > avg_loss_disc_real_0: 0.28237012897928554 (-0.059723641723394394) | > avg_loss_disc_real_1: 0.1885738198955854 (-0.11158916602532068) | > avg_loss_disc_real_2: 0.15481627049545446 (-0.19315817890067896) | > avg_loss_disc_real_3: 0.18431769063075384 (-0.18906200677156446) | > avg_loss_disc_real_4: 0.13468760872880617 (-0.24043637389938036) | > avg_loss_disc_real_5: 0.12404167217512925 (-0.17469930586715543) | > avg_loss_0: 2.3150812784830728 (-0.5774611632029218) | > avg_loss_gen: 2.0772265593210855 (-0.7074403762817383) | > avg_loss_kl: 3.8616929054260254 (-0.10552485783894872) | > avg_loss_feat: 7.679572184880574 (+1.4119969209035235) | > avg_loss_mel: 21.636132558186848 (-3.5300515492757185) | > avg_loss_duration: 3.0016891161600747 (-0.04897816975911473) | > avg_loss_1: 38.256313959757485 (-2.979998906453453)  > EPOCH: 730/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:22:06)   --> TIME: 2023-10-20 08:22:20 -- STEP: 19/50 -- GLOBAL_STEP: 89520 | > loss_disc: 2.6982603073120117 (2.2982046666898226) | > loss_disc_real_0: 0.20361483097076416 (0.14845329160360912) | > loss_disc_real_1: 0.238072007894516 (0.22579205173410868) | > loss_disc_real_2: 0.23528604209423065 (0.20405582495425878) | > loss_disc_real_3: 0.27263930439949036 (0.23215629121190623) | > loss_disc_real_4: 0.25716808438301086 (0.19744179113522956) | > loss_disc_real_5: 0.264617383480072 (0.18913998307758256) | > loss_0: 2.6982603073120117 (2.2982046666898226) | > grad_norm_0: tensor(657.2528, device='cuda:0') (tensor(490.9712, device='cuda:0')) | > loss_gen: 1.9231700897216797 (2.4923918435448096) | > loss_kl: 0.8633826375007629 (0.8040481507778168) | > loss_feat: 2.0571162700653076 (5.975182518362999) | > loss_mel: 24.110374450683594 (21.538271376961156) | > loss_duration: 1.5231050252914429 (1.4463572627619694) | > loss_1: 30.477148056030273 (32.256250682630046) | > grad_norm_1: tensor(4541.4116, device='cuda:0') (tensor(23321.8477, device='cuda:0')) | > current_lr_0: 9.637740033232838e-05 | > current_lr_1: 9.637740033232838e-05 | > step_time: 0.2496 (0.4814567942368357) | > loader_time: 0.0018 (0.012949717672247636)  --> TIME: 2023-10-20 08:22:38 -- STEP: 49/50 -- GLOBAL_STEP: 89550 | > loss_disc: 2.126201629638672 (2.4044872546682554) | > loss_disc_real_0: 0.13006341457366943 (0.1389540939838911) | > loss_disc_real_1: 0.23072151839733124 (0.2232427714886714) | > loss_disc_real_2: 0.11952876299619675 (0.21226668890033448) | > loss_disc_real_3: 0.2814059555530548 (0.23163005314311202) | > loss_disc_real_4: 0.19920194149017334 (0.22536468486852793) | > loss_disc_real_5: 0.17401762306690216 (0.20952998865775915) | > loss_0: 2.126201629638672 (2.4044872546682554) | > grad_norm_0: tensor(561.5933, device='cuda:0') (tensor(525.2335, device='cuda:0')) | > loss_gen: 2.5378148555755615 (2.3540151751771266) | > loss_kl: 0.5615109205245972 (0.7607652069525604) | > loss_feat: 6.327905178070068 (5.737985321149534) | > loss_mel: 22.412796020507812 (21.496193486817027) | > loss_duration: 1.566162109375 (1.4202443263968643) | > loss_1: 33.40618896484375 (31.76920336119983) | > grad_norm_1: tensor(30268.3887, device='cuda:0') (tensor(19335.9570, device='cuda:0')) | > current_lr_0: 9.637740033232838e-05 | > current_lr_1: 9.637740033232838e-05 | > step_time: 0.6508 (0.5259655349108637) | > loader_time: 0.4292 (0.024656159537179128)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.942869186401367 (2.942869186401367) | > loss_disc_real_0: 0.346010684967041 (0.346010684967041) | > loss_disc_real_1: 0.22503265738487244 (0.22503265738487244) | > loss_disc_real_2: 0.3585871756076813 (0.3585871756076813) | > loss_disc_real_3: 0.2463584989309311 (0.2463584989309311) | > loss_disc_real_4: 0.43986955285072327 (0.43986955285072327) | > loss_disc_real_5: 0.41610294580459595 (0.41610294580459595) | > loss_0: 2.942869186401367 (2.942869186401367) | > loss_gen: 2.4947712421417236 (2.4947712421417236) | > loss_kl: 4.26563835144043 (4.26563835144043) | > loss_feat: 4.6634087562561035 (4.6634087562561035) | > loss_mel: 23.00759506225586 (23.00759506225586) | > loss_duration: 2.766810178756714 (2.766810178756714) | > loss_1: 37.19822311401367 (37.19822311401367)  --> STEP: 1 | > loss_disc: 1.1409251689910889 (1.1409251689910889) | > loss_disc_real_0: 0.016758054494857788 (0.016758054494857788) | > loss_disc_real_1: 0.06194751709699631 (0.06194751709699631) | > loss_disc_real_2: 0.0457296185195446 (0.0457296185195446) | > loss_disc_real_3: 0.04052320867776871 (0.04052320867776871) | > loss_disc_real_4: 0.04239548370242119 (0.04239548370242119) | > loss_disc_real_5: 0.12450578808784485 (0.12450578808784485) | > loss_0: 1.1409251689910889 (1.1409251689910889) | > loss_gen: 2.90494704246521 (2.90494704246521) | > loss_kl: 4.618093490600586 (4.618093490600586) | > loss_feat: 16.48729133605957 (16.48729133605957) | > loss_mel: 27.172386169433594 (27.172386169433594) | > loss_duration: 2.9832191467285156 (2.9832191467285156) | > loss_1: 54.16593551635742 (54.16593551635742)  --> STEP: 2 | > loss_disc: 2.57397198677063 (1.8574485778808594) | > loss_disc_real_0: 0.21299783885478973 (0.11487794667482376) | > loss_disc_real_1: 0.3099965751171112 (0.18597204610705376) | > loss_disc_real_2: 0.21904665231704712 (0.13238813541829586) | > loss_disc_real_3: 0.31908324360847473 (0.17980322614312172) | > loss_disc_real_4: 0.2540942430496216 (0.14824486337602139) | > loss_disc_real_5: 0.06847228109836578 (0.09648903459310532) | > loss_0: 2.57397198677063 (1.8574485778808594) | > loss_gen: 2.2005228996276855 (2.5527349710464478) | > loss_kl: 5.030776023864746 (4.824434757232666) | > loss_feat: 8.41656494140625 (12.45192813873291) | > loss_mel: 23.856182098388672 (25.514284133911133) | > loss_duration: 2.9039676189422607 (2.943593382835388) | > loss_1: 42.408016204833984 (48.2869758605957)  --> STEP: 3 | > loss_disc: 2.757392406463623 (2.157429854075114) | > loss_disc_real_0: 0.4808290898799896 (0.23686166107654572) | > loss_disc_real_1: 0.239030659198761 (0.20365825047095618) | > loss_disc_real_2: 0.21708104014396667 (0.16061910366018614) | > loss_disc_real_3: 0.39968958497047424 (0.25309867908557254) | > loss_disc_real_4: 0.33989182114601135 (0.2121271826326847) | > loss_disc_real_5: 0.37415778636932373 (0.18904528518517813) | > loss_0: 2.757392406463623 (2.157429854075114) | > loss_gen: 2.7740750312805176 (2.626514991124471) | > loss_kl: 2.2608141899108887 (3.9698945681254068) | > loss_feat: 4.191944599151611 (9.69860029220581) | > loss_mel: 25.258563995361328 (25.429044087727863) | > loss_duration: 2.895110607147217 (2.9274324576059976) | > loss_1: 37.38050842285156 (44.65148671468099) --> EVAL PERFORMANCE | > avg_loader_time: 0.007383267084757487 (-0.010573387145996094) | > avg_loss_disc: 2.157429854075114 (-0.15765142440795898) | > avg_loss_disc_real_0: 0.23686166107654572 (-0.045508467902739824) | > avg_loss_disc_real_1: 0.20365825047095618 (+0.015084430575370789) | > avg_loss_disc_real_2: 0.16061910366018614 (+0.00580283316473168) | > avg_loss_disc_real_3: 0.25309867908557254 (+0.0687809884548187) | > avg_loss_disc_real_4: 0.2121271826326847 (+0.07743957390387854) | > avg_loss_disc_real_5: 0.18904528518517813 (+0.06500361301004888) | > avg_loss_0: 2.157429854075114 (-0.15765142440795898) | > avg_loss_gen: 2.626514991124471 (+0.5492884318033857) | > avg_loss_kl: 3.9698945681254068 (+0.10820166269938136) | > avg_loss_feat: 9.69860029220581 (+2.0190281073252363) | > avg_loss_mel: 25.429044087727863 (+3.7929115295410156) | > avg_loss_duration: 2.9274324576059976 (-0.07425665855407715) | > avg_loss_1: 44.65148671468099 (+6.395172754923507)  > EPOCH: 731/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:22:56)   --> TIME: 2023-10-20 08:23:18 -- STEP: 29/50 -- GLOBAL_STEP: 89580 | > loss_disc: 2.750112771987915 (2.4640568618116716) | > loss_disc_real_0: 0.07751151919364929 (0.1342288752825096) | > loss_disc_real_1: 0.2427552193403244 (0.24016389456288567) | > loss_disc_real_2: 0.25842607021331787 (0.21403082357398395) | > loss_disc_real_3: 0.2834594249725342 (0.23455445802417293) | > loss_disc_real_4: 0.2961168587207794 (0.24372422489626655) | > loss_disc_real_5: 0.32888486981391907 (0.22061467189984074) | > loss_0: 2.750112771987915 (2.4640568618116716) | > grad_norm_0: tensor(418.6629, device='cuda:0') (tensor(611.7698, device='cuda:0')) | > loss_gen: 1.9570969343185425 (2.345612616374575) | > loss_kl: 0.5661401152610779 (0.74106114948618) | > loss_feat: 2.975675344467163 (5.176807585943105) | > loss_mel: 23.03335189819336 (20.08406252491063) | > loss_duration: 1.4108633995056152 (1.425689643826978) | > loss_1: 29.943126678466797 (29.7732337425495) | > grad_norm_1: tensor(6244.7407, device='cuda:0') (tensor(23627.0508, device='cuda:0')) | > current_lr_0: 9.628106508656904e-05 | > current_lr_1: 9.628106508656904e-05 | > step_time: 0.903 (0.5978103341727421) | > loader_time: 0.0417 (0.015950589344419282)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3913707733154297 (2.3913707733154297) | > loss_disc_real_0: 0.33811527490615845 (0.33811527490615845) | > loss_disc_real_1: 0.23283347487449646 (0.23283347487449646) | > loss_disc_real_2: 0.3491377830505371 (0.3491377830505371) | > loss_disc_real_3: 0.2924099862575531 (0.2924099862575531) | > loss_disc_real_4: 0.3837490379810333 (0.3837490379810333) | > loss_disc_real_5: 0.16761790215969086 (0.16761790215969086) | > loss_0: 2.3913707733154297 (2.3913707733154297) | > loss_gen: 3.2356514930725098 (3.2356514930725098) | > loss_kl: 4.539633274078369 (4.539633274078369) | > loss_feat: 7.780811309814453 (7.780811309814453) | > loss_mel: 22.640247344970703 (22.640247344970703) | > loss_duration: 2.8913094997406006 (2.8913094997406006) | > loss_1: 41.08765411376953 (41.08765411376953)  --> STEP: 1 | > loss_disc: 2.559591293334961 (2.559591293334961) | > loss_disc_real_0: 0.311300128698349 (0.311300128698349) | > loss_disc_real_1: 0.20419181883335114 (0.20419181883335114) | > loss_disc_real_2: 0.1715208739042282 (0.1715208739042282) | > loss_disc_real_3: 0.1591990888118744 (0.1591990888118744) | > loss_disc_real_4: 0.2946765422821045 (0.2946765422821045) | > loss_disc_real_5: 0.40926575660705566 (0.40926575660705566) | > loss_0: 2.559591293334961 (2.559591293334961) | > loss_gen: 2.580528736114502 (2.580528736114502) | > loss_kl: 4.583276271820068 (4.583276271820068) | > loss_feat: 7.308932304382324 (7.308932304382324) | > loss_mel: 25.06279754638672 (25.06279754638672) | > loss_duration: 3.178936004638672 (3.178936004638672) | > loss_1: 42.71446990966797 (42.71446990966797)  --> STEP: 2 | > loss_disc: 3.031594753265381 (2.795593023300171) | > loss_disc_real_0: 0.2409377098083496 (0.2761189192533493) | > loss_disc_real_1: 0.2639453113079071 (0.23406856507062912) | > loss_disc_real_2: 0.2601121664047241 (0.21581652015447617) | > loss_disc_real_3: 0.2623695433139801 (0.21078431606292725) | > loss_disc_real_4: 0.2582951486110687 (0.2764858454465866) | > loss_disc_real_5: 0.24237704277038574 (0.3258213996887207) | > loss_0: 3.031594753265381 (2.795593023300171) | > loss_gen: 1.5030362606048584 (2.04178249835968) | > loss_kl: 5.204061031341553 (4.8936686515808105) | > loss_feat: 0.1428958922624588 (3.7259140983223915) | > loss_mel: 1.9503467082977295 (13.506572127342224) | > loss_duration: 2.9619534015655518 (3.070444703102112) | > loss_1: 11.762292861938477 (27.238381385803223)  --> STEP: 3 | > loss_disc: 2.3879754543304443 (2.659720500310262) | > loss_disc_real_0: 0.2481135129928589 (0.26678378383318585) | > loss_disc_real_1: 0.2807800769805908 (0.24963906904061636) | > loss_disc_real_2: 0.35996443033218384 (0.2638658235470454) | > loss_disc_real_3: 0.34395378828048706 (0.2551741401354472) | > loss_disc_real_4: 0.2287488430738449 (0.26057351132233936) | > loss_disc_real_5: 0.19612789154052734 (0.28259023030598956) | > loss_0: 2.3879754543304443 (2.659720500310262) | > loss_gen: 3.198596239089966 (2.427387078603109) | > loss_kl: 2.332744598388672 (4.040027300516765) | > loss_feat: 4.529078483581543 (3.993635560075442) | > loss_mel: 24.846057891845703 (17.28640071551005) | > loss_duration: 2.951795816421509 (3.0308950742085776) | > loss_1: 37.8582763671875 (30.77834637959798) --> EVAL PERFORMANCE | > avg_loader_time: 0.00659481684366862 (-0.0007884502410888672) | > avg_loss_disc: 2.659720500310262 (+0.5022906462351484) | > avg_loss_disc_real_0: 0.26678378383318585 (+0.029922122756640135) | > avg_loss_disc_real_1: 0.24963906904061636 (+0.04598081856966019) | > avg_loss_disc_real_2: 0.2638658235470454 (+0.10324671988685927) | > avg_loss_disc_real_3: 0.2551741401354472 (+0.0020754610498746606) | > avg_loss_disc_real_4: 0.26057351132233936 (+0.04844632868965465) | > avg_loss_disc_real_5: 0.28259023030598956 (+0.09354494512081143) | > avg_loss_0: 2.659720500310262 (+0.5022906462351484) | > avg_loss_gen: 2.427387078603109 (-0.1991279125213623) | > avg_loss_kl: 4.040027300516765 (+0.07013273239135787) | > avg_loss_feat: 3.993635560075442 (-5.704964732130369) | > avg_loss_mel: 17.28640071551005 (-8.142643372217812) | > avg_loss_duration: 3.0308950742085776 (+0.10346261660258005) | > avg_loss_1: 30.77834637959798 (-13.873140335083011)  > EPOCH: 732/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:23:48)   --> TIME: 2023-10-20 08:24:05 -- STEP: 9/50 -- GLOBAL_STEP: 89610 | > loss_disc: 2.0071120262145996 (1.9809258778889973) | > loss_disc_real_0: 0.04512609541416168 (0.1383960166325172) | > loss_disc_real_1: 0.2212943434715271 (0.1743645572827922) | > loss_disc_real_2: 0.25394049286842346 (0.18907514959573746) | > loss_disc_real_3: 0.2914796471595764 (0.19613253635664782) | > loss_disc_real_4: 0.20895090699195862 (0.16642536719640097) | > loss_disc_real_5: 0.18899136781692505 (0.14341399632394314) | > loss_0: 2.0071120262145996 (1.9809258778889973) | > grad_norm_0: tensor(268.3887, device='cuda:0') (tensor(530.8489, device='cuda:0')) | > loss_gen: 2.8548474311828613 (2.7483739852905273) | > loss_kl: 0.8167209029197693 (0.9459883636898465) | > loss_feat: 6.240625381469727 (8.409805443551805) | > loss_mel: 22.7813663482666 (23.232795503404404) | > loss_duration: 1.3924453258514404 (1.4314254654778376) | > loss_1: 34.08600616455078 (36.76838853624132) | > grad_norm_1: tensor(8156.5181, device='cuda:0') (tensor(32074.7441, device='cuda:0')) | > current_lr_0: 9.61848261339193e-05 | > current_lr_1: 9.61848261339193e-05 | > step_time: 0.6655 (0.6732479201422797) | > loader_time: 0.0285 (0.031003157297770183)  --> TIME: 2023-10-20 08:24:25 -- STEP: 39/50 -- GLOBAL_STEP: 89640 | > loss_disc: 2.9501476287841797 (2.385468302628933) | > loss_disc_real_0: 0.2474030703306198 (0.15093874520598313) | > loss_disc_real_1: 0.2580965757369995 (0.21582591524108863) | > loss_disc_real_2: 0.26553311944007874 (0.20749778873645341) | > loss_disc_real_3: 0.26020732522010803 (0.22614572077798537) | > loss_disc_real_4: 0.31695058941841125 (0.22469447982998994) | > loss_disc_real_5: 0.28858324885368347 (0.22596351589816502) | > loss_0: 2.9501476287841797 (2.385468302628933) | > grad_norm_0: tensor(938.7622, device='cuda:0') (tensor(553.7572, device='cuda:0')) | > loss_gen: 1.7282158136367798 (2.361708124478658) | > loss_kl: 0.8048841953277588 (0.8293397082732274) | > loss_feat: 0.4002215266227722 (5.723308304945628) | > loss_mel: 13.323269844055176 (21.36540817297422) | > loss_duration: 1.4847406148910522 (1.4099050424037836) | > loss_1: 17.7413330078125 (31.68966930340498) | > grad_norm_1: tensor(5970.1670, device='cuda:0') (tensor(21914.7734, device='cuda:0')) | > current_lr_0: 9.61848261339193e-05 | > current_lr_1: 9.61848261339193e-05 | > step_time: 0.7695 (0.6449560996813651) | > loader_time: 0.0262 (0.02438773864354843)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3817243576049805 (2.3817243576049805) | > loss_disc_real_0: 0.030058521777391434 (0.030058521777391434) | > loss_disc_real_1: 0.1497264802455902 (0.1497264802455902) | > loss_disc_real_2: 0.233888640999794 (0.233888640999794) | > loss_disc_real_3: 0.28125447034835815 (0.28125447034835815) | > loss_disc_real_4: 0.1284378319978714 (0.1284378319978714) | > loss_disc_real_5: 0.12853404879570007 (0.12853404879570007) | > loss_0: 2.3817243576049805 (2.3817243576049805) | > loss_gen: 1.8352590799331665 (1.8352590799331665) | > loss_kl: 4.641392230987549 (4.641392230987549) | > loss_feat: 7.468567371368408 (7.468567371368408) | > loss_mel: 26.170330047607422 (26.170330047607422) | > loss_duration: 2.8506689071655273 (2.8506689071655273) | > loss_1: 42.966217041015625 (42.966217041015625)  --> STEP: 1 | > loss_disc: 2.7853593826293945 (2.7853593826293945) | > loss_disc_real_0: 0.19518963992595673 (0.19518963992595673) | > loss_disc_real_1: 0.291210412979126 (0.291210412979126) | > loss_disc_real_2: 0.35184329748153687 (0.35184329748153687) | > loss_disc_real_3: 0.270579993724823 (0.270579993724823) | > loss_disc_real_4: 0.30914223194122314 (0.30914223194122314) | > loss_disc_real_5: 0.33785051107406616 (0.33785051107406616) | > loss_0: 2.7853593826293945 (2.7853593826293945) | > loss_gen: 2.298029899597168 (2.298029899597168) | > loss_kl: 4.824057579040527 (4.824057579040527) | > loss_feat: 5.341927528381348 (5.341927528381348) | > loss_mel: 21.732051849365234 (21.732051849365234) | > loss_duration: 3.1705472469329834 (3.1705472469329834) | > loss_1: 37.366615295410156 (37.366615295410156)  --> STEP: 2 | > loss_disc: 2.2716121673583984 (2.5284857749938965) | > loss_disc_real_0: 0.08791050314903259 (0.14155007153749466) | > loss_disc_real_1: 0.21079513430595398 (0.25100277364254) | > loss_disc_real_2: 0.22012849152088165 (0.28598589450120926) | > loss_disc_real_3: 0.2049086093902588 (0.2377443015575409) | > loss_disc_real_4: 0.22914734482765198 (0.26914478838443756) | > loss_disc_real_5: 0.0936289131641388 (0.21573971211910248) | > loss_0: 2.2716121673583984 (2.5284857749938965) | > loss_gen: 2.1661529541015625 (2.2320914268493652) | > loss_kl: 5.036752700805664 (4.930405139923096) | > loss_feat: 7.266815185546875 (6.304371356964111) | > loss_mel: 22.788026809692383 (22.26003932952881) | > loss_duration: 3.014944553375244 (3.0927459001541138) | > loss_1: 40.2726936340332 (38.81965446472168)  --> STEP: 3 | > loss_disc: 2.6468729972839355 (2.5679481824239097) | > loss_disc_real_0: 0.2042379081249237 (0.16244601706663767) | > loss_disc_real_1: 0.3849869668483734 (0.2956641713778178) | > loss_disc_real_2: 0.2649035155773163 (0.2789584348599116) | > loss_disc_real_3: 0.40680229663848877 (0.2940969665845235) | > loss_disc_real_4: 0.30614614486694336 (0.28147857387860614) | > loss_disc_real_5: 0.19629280269145966 (0.20925740897655487) | > loss_0: 2.6468729972839355 (2.5679481824239097) | > loss_gen: 2.577249050140381 (2.3471439679463706) | > loss_kl: 2.3829617500305176 (4.081257343292236) | > loss_feat: 5.037428855895996 (5.882057189941406) | > loss_mel: 22.713809967041016 (22.411296208699543) | > loss_duration: 2.8098044395446777 (2.9984320799509683) | > loss_1: 35.5212516784668 (37.72018686930338) --> EVAL PERFORMANCE | > avg_loader_time: 0.007440328598022461 (+0.0008455117543538409) | > avg_loss_disc: 2.5679481824239097 (-0.09177231788635254) | > avg_loss_disc_real_0: 0.16244601706663767 (-0.10433776676654818) | > avg_loss_disc_real_1: 0.2956641713778178 (+0.046025102337201446) | > avg_loss_disc_real_2: 0.2789584348599116 (+0.015092611312866211) | > avg_loss_disc_real_3: 0.2940969665845235 (+0.0389228264490763) | > avg_loss_disc_real_4: 0.28147857387860614 (+0.020905062556266785) | > avg_loss_disc_real_5: 0.20925740897655487 (-0.0733328213294347) | > avg_loss_0: 2.5679481824239097 (-0.09177231788635254) | > avg_loss_gen: 2.3471439679463706 (-0.08024311065673828) | > avg_loss_kl: 4.081257343292236 (+0.04123004277547171) | > avg_loss_feat: 5.882057189941406 (+1.8884216298659644) | > avg_loss_mel: 22.411296208699543 (+5.1248954931894914) | > avg_loss_duration: 2.9984320799509683 (-0.032462994257609346) | > avg_loss_1: 37.72018686930338 (+6.9418404897054025)  > EPOCH: 733/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:24:46)   --> TIME: 2023-10-20 08:25:04 -- STEP: 19/50 -- GLOBAL_STEP: 89670 | > loss_disc: 2.269080400466919 (2.528538365113108) | > loss_disc_real_0: 0.083759605884552 (0.1572846330114101) | > loss_disc_real_1: 0.27699410915374756 (0.2542335745927535) | > loss_disc_real_2: 0.39505356550216675 (0.2264740218065287) | > loss_disc_real_3: 0.4838193356990814 (0.23600112960526817) | > loss_disc_real_4: 0.27227509021759033 (0.21316077128836983) | > loss_disc_real_5: 0.25226718187332153 (0.21457134397994534) | > loss_0: 2.269080400466919 (2.528538365113108) | > grad_norm_0: tensor(674.6956, device='cuda:0') (tensor(587.9341, device='cuda:0')) | > loss_gen: 3.4489905834198 (2.278532906582481) | > loss_kl: 0.7121871709823608 (0.7643468207434604) | > loss_feat: 8.103041648864746 (5.21966507325047) | > loss_mel: 24.65576934814453 (19.415686005040218) | > loss_duration: 1.5940898656845093 (1.4722998330467625) | > loss_1: 38.514076232910156 (29.150530463770817) | > grad_norm_1: tensor(24070.8457, device='cuda:0') (tensor(11925.4199, device='cuda:0')) | > current_lr_0: 9.608868337812821e-05 | > current_lr_1: 9.608868337812821e-05 | > step_time: 0.7623 (0.6452304940474661) | > loader_time: 0.0257 (0.020249103244982268)  --> TIME: 2023-10-20 08:25:23 -- STEP: 49/50 -- GLOBAL_STEP: 89700 | > loss_disc: 2.2208285331726074 (2.5208259869594962) | > loss_disc_real_0: 0.022964851930737495 (0.16560001587685275) | > loss_disc_real_1: 0.1814877986907959 (0.2416289408444142) | > loss_disc_real_2: 0.30665919184684753 (0.22024345390346586) | > loss_disc_real_3: 0.46122273802757263 (0.24237967533420543) | > loss_disc_real_4: 0.22222685813903809 (0.22636010383768956) | > loss_disc_real_5: 0.13896778225898743 (0.2195998897623955) | > loss_0: 2.2208285331726074 (2.5208259869594962) | > grad_norm_0: tensor(841.4169, device='cuda:0') (tensor(672.1940, device='cuda:0')) | > loss_gen: 2.975691080093384 (2.2610141817404306) | > loss_kl: 0.7803676724433899 (0.7981468679345384) | > loss_feat: 8.109281539916992 (5.003068296580898) | > loss_mel: 25.46159553527832 (20.10316673590213) | > loss_duration: 1.5858224630355835 (1.424088825984877) | > loss_1: 38.91276168823242 (29.58948497382962) | > grad_norm_1: tensor(64350.7148, device='cuda:0') (tensor(18809.0723, device='cuda:0')) | > current_lr_0: 9.608868337812821e-05 | > current_lr_1: 9.608868337812821e-05 | > step_time: 0.8247 (0.6282973240832892) | > loader_time: 0.4258 (0.030613855439789433)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6719565391540527 (2.6719565391540527) | > loss_disc_real_0: 0.09385494887828827 (0.09385494887828827) | > loss_disc_real_1: 0.2345481663942337 (0.2345481663942337) | > loss_disc_real_2: 0.29469481110572815 (0.29469481110572815) | > loss_disc_real_3: 0.20974041521549225 (0.20974041521549225) | > loss_disc_real_4: 0.1725451648235321 (0.1725451648235321) | > loss_disc_real_5: 0.20355360209941864 (0.20355360209941864) | > loss_0: 2.6719565391540527 (2.6719565391540527) | > loss_gen: 1.5705538988113403 (1.5705538988113403) | > loss_kl: 5.143510818481445 (5.143510818481445) | > loss_feat: 1.192636251449585 (1.192636251449585) | > loss_mel: 18.014726638793945 (18.014726638793945) | > loss_duration: 2.7837791442871094 (2.7837791442871094) | > loss_1: 28.70520782470703 (28.70520782470703)  --> STEP: 1 | > loss_disc: 1.922333836555481 (1.922333836555481) | > loss_disc_real_0: 0.10513675212860107 (0.10513675212860107) | > loss_disc_real_1: 0.16572950780391693 (0.16572950780391693) | > loss_disc_real_2: 0.17964735627174377 (0.17964735627174377) | > loss_disc_real_3: 0.15319649875164032 (0.15319649875164032) | > loss_disc_real_4: 0.28022992610931396 (0.28022992610931396) | > loss_disc_real_5: 0.5172173380851746 (0.5172173380851746) | > loss_0: 1.922333836555481 (1.922333836555481) | > loss_gen: 3.564587116241455 (3.564587116241455) | > loss_kl: 4.117496490478516 (4.117496490478516) | > loss_feat: 7.395989418029785 (7.395989418029785) | > loss_mel: 25.05849266052246 (25.05849266052246) | > loss_duration: 3.212839365005493 (3.212839365005493) | > loss_1: 43.34940719604492 (43.34940719604492)  --> STEP: 2 | > loss_disc: 2.1596860885620117 (2.0410099625587463) | > loss_disc_real_0: 0.21635273098945618 (0.16074474155902863) | > loss_disc_real_1: 0.25319576263427734 (0.20946263521909714) | > loss_disc_real_2: 0.14910297095775604 (0.1643751636147499) | > loss_disc_real_3: 0.20791827142238617 (0.18055738508701324) | > loss_disc_real_4: 0.24459193646907806 (0.262410931289196) | > loss_disc_real_5: 0.2639632821083069 (0.3905903100967407) | > loss_0: 2.1596860885620117 (2.0410099625587463) | > loss_gen: 2.977712631225586 (3.2711498737335205) | > loss_kl: 5.165797233581543 (4.641646862030029) | > loss_feat: 8.00528621673584 (7.7006378173828125) | > loss_mel: 25.78866195678711 (25.423577308654785) | > loss_duration: 2.972609043121338 (3.0927242040634155) | > loss_1: 44.910072326660156 (44.12973976135254)  --> STEP: 3 | > loss_disc: 2.6324429512023926 (2.2381542921066284) | > loss_disc_real_0: 0.20901484787464142 (0.17683477699756622) | > loss_disc_real_1: 0.3694664239883423 (0.2627972314755122) | > loss_disc_real_2: 0.23385484516620636 (0.18753505746523538) | > loss_disc_real_3: 0.23008666932582855 (0.1970671464999517) | > loss_disc_real_4: 0.29147833585739136 (0.2721000661452611) | > loss_disc_real_5: 0.15779349207878113 (0.31299137075742084) | > loss_0: 2.6324429512023926 (2.2381542921066284) | > loss_gen: 2.361600637435913 (2.9679667949676514) | > loss_kl: 2.314802408218384 (3.866032044092814) | > loss_feat: 5.730780124664307 (7.044018586476644) | > loss_mel: 23.125337600708008 (24.65749740600586) | > loss_duration: 2.8752760887145996 (3.0202414989471436) | > loss_1: 36.40779495239258 (41.55575815836588) --> EVAL PERFORMANCE | > avg_loader_time: 0.008102496465047201 (+0.0006621678670247402) | > avg_loss_disc: 2.2381542921066284 (-0.32979389031728124) | > avg_loss_disc_real_0: 0.17683477699756622 (+0.014388759930928557) | > avg_loss_disc_real_1: 0.2627972314755122 (-0.0328669399023056) | > avg_loss_disc_real_2: 0.18753505746523538 (-0.09142337739467624) | > avg_loss_disc_real_3: 0.1970671464999517 (-0.09702982008457181) | > avg_loss_disc_real_4: 0.2721000661452611 (-0.009378507733345032) | > avg_loss_disc_real_5: 0.31299137075742084 (+0.10373396178086597) | > avg_loss_0: 2.2381542921066284 (-0.32979389031728124) | > avg_loss_gen: 2.9679667949676514 (+0.6208228270212808) | > avg_loss_kl: 3.866032044092814 (-0.21522529919942235) | > avg_loss_feat: 7.044018586476644 (+1.1619613965352373) | > avg_loss_mel: 24.65749740600586 (+2.2462011973063163) | > avg_loss_duration: 3.0202414989471436 (+0.021809418996175278) | > avg_loss_1: 41.55575815836588 (+3.8355712890625)  > EPOCH: 734/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:25:39)   --> TIME: 2023-10-20 08:25:55 -- STEP: 29/50 -- GLOBAL_STEP: 89730 | > loss_disc: 2.031864881515503 (2.3211686816708794) | > loss_disc_real_0: 0.2711388170719147 (0.1555837939075869) | > loss_disc_real_1: 0.21102853119373322 (0.21636378649493743) | > loss_disc_real_2: 0.0798669382929802 (0.20072425850506487) | > loss_disc_real_3: 0.23913691937923431 (0.2271864922909901) | > loss_disc_real_4: 0.0901513397693634 (0.20891080051660538) | > loss_disc_real_5: 0.09727606177330017 (0.19941354125481228) | > loss_0: 2.031864881515503 (2.3211686816708794) | > grad_norm_0: tensor(459.4582, device='cuda:0') (tensor(646.8869, device='cuda:0')) | > loss_gen: 2.284803628921509 (2.4642969575421563) | > loss_kl: 1.0213990211486816 (0.8801936959398204) | > loss_feat: 5.7302751541137695 (5.84705276136961) | > loss_mel: 21.308212280273438 (22.21598702052544) | > loss_duration: 1.4013177156448364 (1.4266152957390092) | > loss_1: 31.746007919311523 (32.83414580904204) | > grad_norm_1: tensor(12593.3135, device='cuda:0') (tensor(25922.8047, device='cuda:0')) | > current_lr_0: 9.599263672304098e-05 | > current_lr_1: 9.599263672304098e-05 | > step_time: 0.439 (0.37523979154126397) | > loader_time: 0.0066 (0.006972469132522057)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8499255180358887 (2.8499255180358887) | > loss_disc_real_0: 0.2907198667526245 (0.2907198667526245) | > loss_disc_real_1: 0.2908307611942291 (0.2908307611942291) | > loss_disc_real_2: 0.29322123527526855 (0.29322123527526855) | > loss_disc_real_3: 0.29506585001945496 (0.29506585001945496) | > loss_disc_real_4: 0.3961077630519867 (0.3961077630519867) | > loss_disc_real_5: 0.37830641865730286 (0.37830641865730286) | > loss_0: 2.8499255180358887 (2.8499255180358887) | > loss_gen: 2.721118450164795 (2.721118450164795) | > loss_kl: 4.709935188293457 (4.709935188293457) | > loss_feat: 4.86646032333374 (4.86646032333374) | > loss_mel: 22.306926727294922 (22.306926727294922) | > loss_duration: 2.8219103813171387 (2.8219103813171387) | > loss_1: 37.42634963989258 (37.42634963989258)  --> STEP: 1 | > loss_disc: 2.3210396766662598 (2.3210396766662598) | > loss_disc_real_0: 0.15410107374191284 (0.15410107374191284) | > loss_disc_real_1: 0.16343116760253906 (0.16343116760253906) | > loss_disc_real_2: 0.17487597465515137 (0.17487597465515137) | > loss_disc_real_3: 0.340523362159729 (0.340523362159729) | > loss_disc_real_4: 0.1657957285642624 (0.1657957285642624) | > loss_disc_real_5: 0.3487608730792999 (0.3487608730792999) | > loss_0: 2.3210396766662598 (2.3210396766662598) | > loss_gen: 2.5990970134735107 (2.5990970134735107) | > loss_kl: 4.599071979522705 (4.599071979522705) | > loss_feat: 6.777081489562988 (6.777081489562988) | > loss_mel: 22.11168670654297 (22.11168670654297) | > loss_duration: 3.1156532764434814 (3.1156532764434814) | > loss_1: 39.20259094238281 (39.20259094238281)  --> STEP: 2 | > loss_disc: 3.0957694053649902 (2.708404541015625) | > loss_disc_real_0: 0.26386579871177673 (0.2089834362268448) | > loss_disc_real_1: 0.25966882705688477 (0.21154999732971191) | > loss_disc_real_2: 0.24339063465595245 (0.2091333046555519) | > loss_disc_real_3: 0.26655974984169006 (0.30354155600070953) | > loss_disc_real_4: 0.2453012764453888 (0.2055485025048256) | > loss_disc_real_5: 0.25552746653556824 (0.3021441698074341) | > loss_0: 3.0957694053649902 (2.708404541015625) | > loss_gen: 1.4455909729003906 (2.0223439931869507) | > loss_kl: 5.132826328277588 (4.8659491539001465) | > loss_feat: 0.22204571962356567 (3.499563604593277) | > loss_mel: 2.6704094409942627 (12.391048073768616) | > loss_duration: 3.0001840591430664 (3.057918667793274) | > loss_1: 12.471056938171387 (25.8368239402771)  --> STEP: 3 | > loss_disc: 2.680475950241089 (2.6990950107574463) | > loss_disc_real_0: 0.14566923677921295 (0.18787870307763418) | > loss_disc_real_1: 0.29063746333122253 (0.2379124859968821) | > loss_disc_real_2: 0.2347700148820877 (0.21767887473106384) | > loss_disc_real_3: 0.3715587854385376 (0.3262139658133189) | > loss_disc_real_4: 0.294884592294693 (0.23532719910144806) | > loss_disc_real_5: 0.3505150377750397 (0.3182677924633026) | > loss_0: 2.680475950241089 (2.6990950107574463) | > loss_gen: 2.201416254043579 (2.0820347468058267) | > loss_kl: 2.058020830154419 (3.929973045984904) | > loss_feat: 2.427706480026245 (3.1422778964042664) | > loss_mel: 19.089529037475586 (14.623875061670939) | > loss_duration: 2.8850276470184326 (3.0002883275349936) | > loss_1: 28.661699295043945 (26.778449058532715) --> EVAL PERFORMANCE | > avg_loader_time: 0.007363319396972656 (-0.0007391770680745448) | > avg_loss_disc: 2.6990950107574463 (+0.46094071865081787) | > avg_loss_disc_real_0: 0.18787870307763418 (+0.011043926080067962) | > avg_loss_disc_real_1: 0.2379124859968821 (-0.024884745478630094) | > avg_loss_disc_real_2: 0.21767887473106384 (+0.03014381726582846) | > avg_loss_disc_real_3: 0.3262139658133189 (+0.12914681931336722) | > avg_loss_disc_real_4: 0.23532719910144806 (-0.03677286704381305) | > avg_loss_disc_real_5: 0.3182677924633026 (+0.005276421705881773) | > avg_loss_0: 2.6990950107574463 (+0.46094071865081787) | > avg_loss_gen: 2.0820347468058267 (-0.8859320481618247) | > avg_loss_kl: 3.929973045984904 (+0.06394100189208984) | > avg_loss_feat: 3.1422778964042664 (-3.9017406900723772) | > avg_loss_mel: 14.623875061670939 (-10.03362234433492) | > avg_loss_duration: 3.0002883275349936 (-0.019953171412149917) | > avg_loss_1: 26.778449058532715 (-14.777309099833168)  > EPOCH: 735/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:26:27)   --> TIME: 2023-10-20 08:26:37 -- STEP: 9/50 -- GLOBAL_STEP: 89760 | > loss_disc: 2.630077362060547 (1.8853843477037218) | > loss_disc_real_0: 0.1792665421962738 (0.10507311216659015) | > loss_disc_real_1: 0.2870156168937683 (0.1551051332304875) | > loss_disc_real_2: 0.22888322174549103 (0.15784341841936111) | > loss_disc_real_3: 0.2736453711986542 (0.17467499358786476) | > loss_disc_real_4: 0.23986384272575378 (0.16191108442015117) | > loss_disc_real_5: 0.2352314293384552 (0.12151230944113599) | > loss_0: 2.630077362060547 (1.8853843477037218) | > grad_norm_0: tensor(1036.0988, device='cuda:0') (tensor(622.4422, device='cuda:0')) | > loss_gen: 2.0082294940948486 (2.7342259089152017) | > loss_kl: 0.5818684101104736 (0.8813134266270531) | > loss_feat: 1.6639922857284546 (8.588284108373854) | > loss_mel: 20.860572814941406 (24.84734556410048) | > loss_duration: 1.3827342987060547 (1.4056578079859416) | > loss_1: 26.497398376464844 (38.456826739841034) | > grad_norm_1: tensor(6738.6602, device='cuda:0') (tensor(31842.5898, device='cuda:0')) | > current_lr_0: 9.589668607259892e-05 | > current_lr_1: 9.589668607259892e-05 | > step_time: 0.6532 (0.5578699111938477) | > loader_time: 0.0044 (0.014274411731296115)  --> TIME: 2023-10-20 08:26:58 -- STEP: 39/50 -- GLOBAL_STEP: 89790 | > loss_disc: 1.980841875076294 (2.402714035449884) | > loss_disc_real_0: 0.034161295741796494 (0.15030671684787825) | > loss_disc_real_1: 0.2069813311100006 (0.21351345212986836) | > loss_disc_real_2: 0.09421258419752121 (0.21306883400449386) | > loss_disc_real_3: 0.2709481418132782 (0.22465108592922872) | > loss_disc_real_4: 0.12898121774196625 (0.23538213653060105) | > loss_disc_real_5: 0.16132530570030212 (0.22324183843552303) | > loss_0: 1.980841875076294 (2.402714035449884) | > grad_norm_0: tensor(1075.1379, device='cuda:0') (tensor(658.6331, device='cuda:0')) | > loss_gen: 2.6003925800323486 (2.385314137507708) | > loss_kl: 0.35512781143188477 (0.830895117460153) | > loss_feat: 7.892727851867676 (5.3009697410922785) | > loss_mel: 23.08827781677246 (20.312463622826797) | > loss_duration: 1.442894697189331 (1.4002581651394181) | > loss_1: 35.37942123413086 (30.229900531279736) | > grad_norm_1: tensor(65490.3359, device='cuda:0') (tensor(26205.8867, device='cuda:0')) | > current_lr_0: 9.589668607259892e-05 | > current_lr_1: 9.589668607259892e-05 | > step_time: 0.4628 (0.6448443547273294) | > loader_time: 0.0302 (0.02161814004946978)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0054385662078857 (3.0054385662078857) | > loss_disc_real_0: 0.1906825602054596 (0.1906825602054596) | > loss_disc_real_1: 0.3126318156719208 (0.3126318156719208) | > loss_disc_real_2: 0.29269322752952576 (0.29269322752952576) | > loss_disc_real_3: 0.27703604102134705 (0.27703604102134705) | > loss_disc_real_4: 0.25331777334213257 (0.25331777334213257) | > loss_disc_real_5: 0.3139473497867584 (0.3139473497867584) | > loss_0: 3.0054385662078857 (3.0054385662078857) | > loss_gen: 1.6558459997177124 (1.6558459997177124) | > loss_kl: 4.040061950683594 (4.040061950683594) | > loss_feat: 0.12290170788764954 (0.12290170788764954) | > loss_mel: 1.97063148021698 (1.97063148021698) | > loss_duration: 2.890900135040283 (2.890900135040283) | > loss_1: 10.680341720581055 (10.680341720581055)  --> STEP: 1 | > loss_disc: 1.796823263168335 (1.796823263168335) | > loss_disc_real_0: 0.10395670682191849 (0.10395670682191849) | > loss_disc_real_1: 0.1750979721546173 (0.1750979721546173) | > loss_disc_real_2: 0.187505841255188 (0.187505841255188) | > loss_disc_real_3: 0.08591203391551971 (0.08591203391551971) | > loss_disc_real_4: 0.15741361677646637 (0.15741361677646637) | > loss_disc_real_5: 0.11793467402458191 (0.11793467402458191) | > loss_0: 1.796823263168335 (1.796823263168335) | > loss_gen: 4.5006327629089355 (4.5006327629089355) | > loss_kl: 4.696765899658203 (4.696765899658203) | > loss_feat: 13.644158363342285 (13.644158363342285) | > loss_mel: 27.16522789001465 (27.16522789001465) | > loss_duration: 3.128272533416748 (3.128272533416748) | > loss_1: 53.13505554199219 (53.13505554199219)  --> STEP: 2 | > loss_disc: 3.0051612854003906 (2.400992274284363) | > loss_disc_real_0: 0.18883734941482544 (0.14639702811837196) | > loss_disc_real_1: 0.31265315413475037 (0.24387556314468384) | > loss_disc_real_2: 0.2926523983478546 (0.2400791198015213) | > loss_disc_real_3: 0.2770536541938782 (0.18148284405469894) | > loss_disc_real_4: 0.2533126473426819 (0.20536313205957413) | > loss_disc_real_5: 0.31395387649536133 (0.21594427525997162) | > loss_0: 3.0051612854003906 (2.400992274284363) | > loss_gen: 1.6544969081878662 (3.077564835548401) | > loss_kl: 5.224425792694092 (4.9605958461761475) | > loss_feat: 0.12445639073848724 (6.884307377040386) | > loss_mel: 1.9570014476776123 (14.56111466884613) | > loss_duration: 3.0016844272613525 (3.0649784803390503) | > loss_1: 11.962064743041992 (32.54856014251709)  --> STEP: 3 | > loss_disc: 2.229757785797119 (2.3439141114552817) | > loss_disc_real_0: 0.21430683135986328 (0.16903362919886908) | > loss_disc_real_1: 0.33852627873420715 (0.27542580167452496) | > loss_disc_real_2: 0.15444856882095337 (0.21153560280799866) | > loss_disc_real_3: 0.32373106479644775 (0.2288989176352819) | > loss_disc_real_4: 0.3004412353038788 (0.237055833141009) | > loss_disc_real_5: 0.1823863536119461 (0.20475830137729645) | > loss_0: 2.229757785797119 (2.3439141114552817) | > loss_gen: 3.6595277786254883 (3.271552483240763) | > loss_kl: 1.9155572652816772 (3.9455829858779907) | > loss_feat: 7.016518592834473 (6.928377782305081) | > loss_mel: 22.663793563842773 (17.262007633845013) | > loss_duration: 2.810736656188965 (2.980231205622355) | > loss_1: 38.06613540649414 (34.38775189717611) --> EVAL PERFORMANCE | > avg_loader_time: 0.0036329428354899087 (-0.0037303765614827475) | > avg_loss_disc: 2.3439141114552817 (-0.35518089930216457) | > avg_loss_disc_real_0: 0.16903362919886908 (-0.018845073878765106) | > avg_loss_disc_real_1: 0.27542580167452496 (+0.03751331567764285) | > avg_loss_disc_real_2: 0.21153560280799866 (-0.0061432719230651855) | > avg_loss_disc_real_3: 0.2288989176352819 (-0.09731504817803702) | > avg_loss_disc_real_4: 0.237055833141009 (+0.0017286340395609445) | > avg_loss_disc_real_5: 0.20475830137729645 (-0.11350949108600616) | > avg_loss_0: 2.3439141114552817 (-0.35518089930216457) | > avg_loss_gen: 3.271552483240763 (+1.1895177364349365) | > avg_loss_kl: 3.9455829858779907 (+0.0156099398930869) | > avg_loss_feat: 6.928377782305081 (+3.786099885900815) | > avg_loss_mel: 17.262007633845013 (+2.638132572174074) | > avg_loss_duration: 2.980231205622355 (-0.020057121912638642) | > avg_loss_1: 34.38775189717611 (+7.609302838643394)  > EPOCH: 736/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:27:19)   --> TIME: 2023-10-20 08:27:42 -- STEP: 19/50 -- GLOBAL_STEP: 89820 | > loss_disc: 2.5323314666748047 (2.3792175180033635) | > loss_disc_real_0: 0.10426260530948639 (0.15311728966863533) | > loss_disc_real_1: 0.23731090128421783 (0.2171557325085527) | > loss_disc_real_2: 0.2836730182170868 (0.208272706129049) | > loss_disc_real_3: 0.4158579409122467 (0.22660071442001745) | > loss_disc_real_4: 0.10623248666524887 (0.19440786511098085) | > loss_disc_real_5: 0.24209660291671753 (0.2341190831931798) | > loss_0: 2.5323314666748047 (2.3792175180033635) | > grad_norm_0: tensor(660.4324, device='cuda:0') (tensor(526.1660, device='cuda:0')) | > loss_gen: 2.6584153175354004 (2.3560649219312166) | > loss_kl: 1.1978706121444702 (0.8556074504005281) | > loss_feat: 7.2314958572387695 (5.214402361135733) | > loss_mel: 24.097414016723633 (18.90922821195502) | > loss_duration: 1.5562928915023804 (1.4361003762797306) | > loss_1: 36.74148941040039 (28.7714036640368) | > grad_norm_1: tensor(31820.8730, device='cuda:0') (tensor(23992.3320, device='cuda:0')) | > current_lr_0: 9.58008313308394e-05 | > current_lr_1: 9.58008313308394e-05 | > step_time: 0.5545 (0.634354503531205) | > loader_time: 0.0247 (0.01892131253292686)  --> TIME: 2023-10-20 08:28:01 -- STEP: 49/50 -- GLOBAL_STEP: 89850 | > loss_disc: 3.0804262161254883 (2.452830290307804) | > loss_disc_real_0: 0.12166118621826172 (0.14669093227356061) | > loss_disc_real_1: 0.25673046708106995 (0.2173901556477863) | > loss_disc_real_2: 0.2693815231323242 (0.21575051226786204) | > loss_disc_real_3: 0.26021072268486023 (0.22483110564703845) | > loss_disc_real_4: 0.2595447301864624 (0.2186095243966093) | > loss_disc_real_5: 0.22409150004386902 (0.2299787416027821) | > loss_0: 3.0804262161254883 (2.452830290307804) | > grad_norm_0: tensor(715.6205, device='cuda:0') (tensor(596.5516, device='cuda:0')) | > loss_gen: 1.4416840076446533 (2.328821552043058) | > loss_kl: 0.5450045466423035 (0.7830298711754837) | > loss_feat: 0.06671561300754547 (5.358152868948419) | > loss_mel: 2.359403610229492 (19.395785390114288) | > loss_duration: 1.5248452425003052 (1.4050304841022103) | > loss_1: 5.937652587890625 (29.27082012137588) | > grad_norm_1: tensor(26543.8633, device='cuda:0') (tensor(21451.5742, device='cuda:0')) | > current_lr_0: 9.58008313308394e-05 | > current_lr_1: 9.58008313308394e-05 | > step_time: 0.8176 (0.6221558950385269) | > loader_time: 0.4639 (0.0301882198878697)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.759780168533325 (2.759780168533325) | > loss_disc_real_0: 0.06114649027585983 (0.06114649027585983) | > loss_disc_real_1: 0.20187652111053467 (0.20187652111053467) | > loss_disc_real_2: 0.3154800832271576 (0.3154800832271576) | > loss_disc_real_3: 0.3719427287578583 (0.3719427287578583) | > loss_disc_real_4: 0.33611106872558594 (0.33611106872558594) | > loss_disc_real_5: 0.3814992606639862 (0.3814992606639862) | > loss_0: 2.759780168533325 (2.759780168533325) | > loss_gen: 2.1999995708465576 (2.1999995708465576) | > loss_kl: 4.189689636230469 (4.189689636230469) | > loss_feat: 5.218184471130371 (5.218184471130371) | > loss_mel: 22.888092041015625 (22.888092041015625) | > loss_duration: 2.788511276245117 (2.788511276245117) | > loss_1: 37.28447723388672 (37.28447723388672)  --> STEP: 1 | > loss_disc: 2.5541603565216064 (2.5541603565216064) | > loss_disc_real_0: 0.1445581316947937 (0.1445581316947937) | > loss_disc_real_1: 0.23918817937374115 (0.23918817937374115) | > loss_disc_real_2: 0.26934248208999634 (0.26934248208999634) | > loss_disc_real_3: 0.23669034242630005 (0.23669034242630005) | > loss_disc_real_4: 0.23046088218688965 (0.23046088218688965) | > loss_disc_real_5: 0.2489313930273056 (0.2489313930273056) | > loss_0: 2.5541603565216064 (2.5541603565216064) | > loss_gen: 2.0780527591705322 (2.0780527591705322) | > loss_kl: 4.315852165222168 (4.315852165222168) | > loss_feat: 4.5819478034973145 (4.5819478034973145) | > loss_mel: 24.106111526489258 (24.106111526489258) | > loss_duration: 3.192284107208252 (3.192284107208252) | > loss_1: 38.27425003051758 (38.27425003051758)  --> STEP: 2 | > loss_disc: 1.8512645959854126 (2.2027124762535095) | > loss_disc_real_0: 0.019034061580896378 (0.08179609663784504) | > loss_disc_real_1: 0.2279418259859085 (0.23356500267982483) | > loss_disc_real_2: 0.1735168993473053 (0.22142969071865082) | > loss_disc_real_3: 0.2274663746356964 (0.23207835853099823) | > loss_disc_real_4: 0.09481717646121979 (0.16263902932405472) | > loss_disc_real_5: 0.2203744798898697 (0.23465293645858765) | > loss_0: 1.8512645959854126 (2.2027124762535095) | > loss_gen: 2.9097278118133545 (2.4938902854919434) | > loss_kl: 5.266953945159912 (4.79140305519104) | > loss_feat: 10.452272415161133 (7.517110109329224) | > loss_mel: 24.575721740722656 (24.340916633605957) | > loss_duration: 3.009654998779297 (3.1009695529937744) | > loss_1: 46.214332580566406 (42.24429130554199)  --> STEP: 3 | > loss_disc: 2.7838594913482666 (2.3964281479517617) | > loss_disc_real_0: 0.09542950987815857 (0.08634056771794955) | > loss_disc_real_1: 0.2666182816028595 (0.2445827623208364) | > loss_disc_real_2: 0.2208324521780014 (0.221230611205101) | > loss_disc_real_3: 0.2978958487510681 (0.2540175219376882) | > loss_disc_real_4: 0.28366851806640625 (0.2029821922381719) | > loss_disc_real_5: 0.23748792707920074 (0.23559793333212534) | > loss_0: 2.7838594913482666 (2.3964281479517617) | > loss_gen: 1.6770286560058594 (2.2216030756632485) | > loss_kl: 2.0457420349121094 (3.876182715098063) | > loss_feat: 1.1112080812454224 (5.38180943330129) | > loss_mel: 19.515193939208984 (22.7323424021403) | > loss_duration: 2.945181369781494 (3.049040158589681) | > loss_1: 27.294353485107422 (37.26097869873047) --> EVAL PERFORMANCE | > avg_loader_time: 0.008376042048136393 (+0.004743099212646484) | > avg_loss_disc: 2.3964281479517617 (+0.05251403649648001) | > avg_loss_disc_real_0: 0.08634056771794955 (-0.08269306148091952) | > avg_loss_disc_real_1: 0.2445827623208364 (-0.030843039353688567) | > avg_loss_disc_real_2: 0.221230611205101 (+0.009695008397102356) | > avg_loss_disc_real_3: 0.2540175219376882 (+0.025118604302406283) | > avg_loss_disc_real_4: 0.2029821922381719 (-0.0340736409028371) | > avg_loss_disc_real_5: 0.23559793333212534 (+0.03083963195482889) | > avg_loss_0: 2.3964281479517617 (+0.05251403649648001) | > avg_loss_gen: 2.2216030756632485 (-1.0499494075775146) | > avg_loss_kl: 3.876182715098063 (-0.06940027077992772) | > avg_loss_feat: 5.38180943330129 (-1.5465683490037918) | > avg_loss_mel: 22.7323424021403 (+5.470334768295288) | > avg_loss_duration: 3.049040158589681 (+0.06880895296732614) | > avg_loss_1: 37.26097869873047 (+2.8732268015543596)  > EPOCH: 737/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:28:15)   --> TIME: 2023-10-20 08:28:33 -- STEP: 29/50 -- GLOBAL_STEP: 89880 | > loss_disc: 2.805309772491455 (2.5357768823360574) | > loss_disc_real_0: 0.16003842651844025 (0.15868131809964262) | > loss_disc_real_1: 0.19997426867485046 (0.21661342140929452) | > loss_disc_real_2: 0.12795238196849823 (0.24035084909149285) | > loss_disc_real_3: 0.22183097898960114 (0.25589788165585753) | > loss_disc_real_4: 0.3359537124633789 (0.25010501028134907) | > loss_disc_real_5: 0.23320548236370087 (0.24467060149743639) | > loss_0: 2.805309772491455 (2.5357768823360574) | > grad_norm_0: tensor(467.6878, device='cuda:0') (tensor(544.5395, device='cuda:0')) | > loss_gen: 1.7564512491226196 (2.3505023717880253) | > loss_kl: 0.6528995633125305 (0.8472323628335163) | > loss_feat: 4.22723913192749 (5.909859082822142) | > loss_mel: 17.556547164916992 (21.677507038774163) | > loss_duration: 1.3774361610412598 (1.4031025541239772) | > loss_1: 25.570571899414062 (32.18820315393908) | > grad_norm_1: tensor(16336.2256, device='cuda:0') (tensor(19935.2246, device='cuda:0')) | > current_lr_0: 9.570507240189566e-05 | > current_lr_1: 9.570507240189566e-05 | > step_time: 0.4672 (0.452505637859476) | > loader_time: 0.0021 (0.009046727213366279)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.750913619995117 (2.750913619995117) | > loss_disc_real_0: 0.6613056659698486 (0.6613056659698486) | > loss_disc_real_1: 0.26400092244148254 (0.26400092244148254) | > loss_disc_real_2: 0.3446146845817566 (0.3446146845817566) | > loss_disc_real_3: 0.3200893700122833 (0.3200893700122833) | > loss_disc_real_4: 0.34175270795822144 (0.34175270795822144) | > loss_disc_real_5: 0.04090617597103119 (0.04090617597103119) | > loss_0: 2.750913619995117 (2.750913619995117) | > loss_gen: 3.616640329360962 (3.616640329360962) | > loss_kl: 5.126176357269287 (5.126176357269287) | > loss_feat: 9.742325782775879 (9.742325782775879) | > loss_mel: 23.24775505065918 (23.24775505065918) | > loss_duration: 2.8244709968566895 (2.8244709968566895) | > loss_1: 44.557369232177734 (44.557369232177734)  --> STEP: 1 | > loss_disc: 2.4912919998168945 (2.4912919998168945) | > loss_disc_real_0: 0.20399972796440125 (0.20399972796440125) | > loss_disc_real_1: 0.28086331486701965 (0.28086331486701965) | > loss_disc_real_2: 0.2681746780872345 (0.2681746780872345) | > loss_disc_real_3: 0.3427911102771759 (0.3427911102771759) | > loss_disc_real_4: 0.30132824182510376 (0.30132824182510376) | > loss_disc_real_5: 0.3602202236652374 (0.3602202236652374) | > loss_0: 2.4912919998168945 (2.4912919998168945) | > loss_gen: 2.7876713275909424 (2.7876713275909424) | > loss_kl: 4.60989236831665 (4.60989236831665) | > loss_feat: 5.3162150382995605 (5.3162150382995605) | > loss_mel: 24.901411056518555 (24.901411056518555) | > loss_duration: 3.091623544692993 (3.091623544692993) | > loss_1: 40.70681381225586 (40.70681381225586)  --> STEP: 2 | > loss_disc: 2.535832166671753 (2.5135620832443237) | > loss_disc_real_0: 0.27990108728408813 (0.2419504076242447) | > loss_disc_real_1: 0.35579028725624084 (0.31832680106163025) | > loss_disc_real_2: 0.2770691215991974 (0.27262189984321594) | > loss_disc_real_3: 0.33131811022758484 (0.33705461025238037) | > loss_disc_real_4: 0.23490208387374878 (0.26811516284942627) | > loss_disc_real_5: 0.3096594512462616 (0.3349398374557495) | > loss_0: 2.535832166671753 (2.5135620832443237) | > loss_gen: 3.572293519973755 (3.1799824237823486) | > loss_kl: 5.179776668548584 (4.894834518432617) | > loss_feat: 8.923742294311523 (7.119978666305542) | > loss_mel: 23.647703170776367 (24.27455711364746) | > loss_duration: 2.9916882514953613 (3.0416558980941772) | > loss_1: 44.31520080566406 (42.51100730895996)  --> STEP: 3 | > loss_disc: 2.8962130546569824 (2.6411124070485434) | > loss_disc_real_0: 0.5984453558921814 (0.36078205704689026) | > loss_disc_real_1: 0.3130829632282257 (0.31657885511716205) | > loss_disc_real_2: 0.3478146195411682 (0.2976861397425334) | > loss_disc_real_3: 0.15381459891796112 (0.2759746064742406) | > loss_disc_real_4: 0.3887289762496948 (0.30831976731618244) | > loss_disc_real_5: 0.3324180245399475 (0.3340992331504822) | > loss_0: 2.8962130546569824 (2.6411124070485434) | > loss_gen: 4.134673595428467 (3.4982128143310547) | > loss_kl: 1.9911105632781982 (3.926926533381144) | > loss_feat: 7.997409343719482 (7.4124555587768555) | > loss_mel: 24.768768310546875 (24.439294179280598) | > loss_duration: 2.853041648864746 (2.9787844816843667) | > loss_1: 41.74500274658203 (42.255672454833984) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031891663869222007 (-0.0051868756612141916) | > avg_loss_disc: 2.6411124070485434 (+0.2446842590967817) | > avg_loss_disc_real_0: 0.36078205704689026 (+0.2744414893289407) | > avg_loss_disc_real_1: 0.31657885511716205 (+0.07199609279632566) | > avg_loss_disc_real_2: 0.2976861397425334 (+0.07645552853743237) | > avg_loss_disc_real_3: 0.2759746064742406 (+0.02195708453655243) | > avg_loss_disc_real_4: 0.30831976731618244 (+0.10533757507801053) | > avg_loss_disc_real_5: 0.3340992331504822 (+0.09850129981835684) | > avg_loss_0: 2.6411124070485434 (+0.2446842590967817) | > avg_loss_gen: 3.4982128143310547 (+1.2766097386678061) | > avg_loss_kl: 3.926926533381144 (+0.050743818283081055) | > avg_loss_feat: 7.4124555587768555 (+2.030646125475566) | > avg_loss_mel: 24.439294179280598 (+1.706951777140297) | > avg_loss_duration: 2.9787844816843667 (-0.07025567690531442) | > avg_loss_1: 42.255672454833984 (+4.994693756103516)  > EPOCH: 738/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:29:07)   --> TIME: 2023-10-20 08:29:18 -- STEP: 9/50 -- GLOBAL_STEP: 89910 | > loss_disc: 3.0511350631713867 (2.1902039845784507) | > loss_disc_real_0: 0.37556523084640503 (0.1340983555548721) | > loss_disc_real_1: 0.26075056195259094 (0.21473983923594156) | > loss_disc_real_2: 0.2555234432220459 (0.2186870218978988) | > loss_disc_real_3: 0.2585694491863251 (0.200032700267103) | > loss_disc_real_4: 0.29350653290748596 (0.19636942197879156) | > loss_disc_real_5: 0.32535821199417114 (0.23414661900864708) | > loss_0: 3.0511350631713867 (2.1902039845784507) | > grad_norm_0: tensor(506.6610, device='cuda:0') (tensor(486.9083, device='cuda:0')) | > loss_gen: 1.6959490776062012 (2.7543009916941323) | > loss_kl: 0.7036667466163635 (0.8054846392737495) | > loss_feat: 0.061549145728349686 (6.736070654872391) | > loss_mel: 1.578234076499939 (20.380447215504116) | > loss_duration: 1.3576219081878662 (1.411232550938924) | > loss_1: 5.397021293640137 (32.08753596411811) | > grad_norm_1: tensor(27377.8945, device='cuda:0') (tensor(26310.9707, device='cuda:0')) | > current_lr_0: 9.560940918999679e-05 | > current_lr_1: 9.560940918999679e-05 | > step_time: 0.8129 (0.6612882084316678) | > loader_time: 0.0789 (0.024586624569363065)  --> TIME: 2023-10-20 08:29:36 -- STEP: 39/50 -- GLOBAL_STEP: 89940 | > loss_disc: 1.0423860549926758 (2.334022665635133) | > loss_disc_real_0: 0.0292048342525959 (0.1347326828310123) | > loss_disc_real_1: 0.05203825980424881 (0.21653416791023353) | > loss_disc_real_2: 0.01570940390229225 (0.21964368501152748) | > loss_disc_real_3: 0.05231110751628876 (0.224228302637736) | > loss_disc_real_4: 0.030269987881183624 (0.2105258388970143) | > loss_disc_real_5: 0.04456267133355141 (0.22950173140718386) | > loss_0: 1.0423860549926758 (2.334022665635133) | > grad_norm_0: tensor(389.6176, device='cuda:0') (tensor(530.2873, device='cuda:0')) | > loss_gen: 3.279637575149536 (2.442001737081088) | > loss_kl: 0.3497373163700104 (0.8177267817350534) | > loss_feat: 10.323740005493164 (5.781300646754412) | > loss_mel: 22.459144592285156 (20.199683388074234) | > loss_duration: 1.4650700092315674 (1.4102203356914034) | > loss_1: 37.87732696533203 (30.650932813302063) | > grad_norm_1: tensor(38676.3555, device='cuda:0') (tensor(24052.6758, device='cuda:0')) | > current_lr_0: 9.560940918999679e-05 | > current_lr_1: 9.560940918999679e-05 | > step_time: 0.5622 (0.6013209025065104) | > loader_time: 0.0275 (0.023204846259875175)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.056891918182373 (3.056891918182373) | > loss_disc_real_0: 0.28717514872550964 (0.28717514872550964) | > loss_disc_real_1: 0.2787737250328064 (0.2787737250328064) | > loss_disc_real_2: 0.18014606833457947 (0.18014606833457947) | > loss_disc_real_3: 0.35932254791259766 (0.35932254791259766) | > loss_disc_real_4: 0.31374913454055786 (0.31374913454055786) | > loss_disc_real_5: 0.29932284355163574 (0.29932284355163574) | > loss_0: 3.056891918182373 (3.056891918182373) | > loss_gen: 1.922632098197937 (1.922632098197937) | > loss_kl: 4.569364070892334 (4.569364070892334) | > loss_feat: 3.8918001651763916 (3.8918001651763916) | > loss_mel: 21.763431549072266 (21.763431549072266) | > loss_duration: 2.7923309803009033 (2.7923309803009033) | > loss_1: 34.93955993652344 (34.93955993652344)  --> STEP: 1 | > loss_disc: 2.850142478942871 (2.850142478942871) | > loss_disc_real_0: 0.33627092838287354 (0.33627092838287354) | > loss_disc_real_1: 0.2557448148727417 (0.2557448148727417) | > loss_disc_real_2: 0.22334866225719452 (0.22334866225719452) | > loss_disc_real_3: 0.30639931559562683 (0.30639931559562683) | > loss_disc_real_4: 0.2215210348367691 (0.2215210348367691) | > loss_disc_real_5: 0.2012639045715332 (0.2012639045715332) | > loss_0: 2.850142478942871 (2.850142478942871) | > loss_gen: 1.8185420036315918 (1.8185420036315918) | > loss_kl: 4.5921173095703125 (4.5921173095703125) | > loss_feat: 1.4922548532485962 (1.4922548532485962) | > loss_mel: 19.856531143188477 (19.856531143188477) | > loss_duration: 3.2188539505004883 (3.2188539505004883) | > loss_1: 30.97829818725586 (30.97829818725586)  --> STEP: 2 | > loss_disc: 3.044902801513672 (2.9475226402282715) | > loss_disc_real_0: 0.2727682590484619 (0.3045195937156677) | > loss_disc_real_1: 0.3550744354724884 (0.30540962517261505) | > loss_disc_real_2: 0.15183070302009583 (0.18758968263864517) | > loss_disc_real_3: 0.4824584424495697 (0.39442887902259827) | > loss_disc_real_4: 0.4195668697357178 (0.32054395228624344) | > loss_disc_real_5: 0.3123735785484314 (0.2568187415599823) | > loss_0: 3.044902801513672 (2.9475226402282715) | > loss_gen: 2.355562925338745 (2.0870524644851685) | > loss_kl: 5.4219818115234375 (5.007049560546875) | > loss_feat: 7.463963985443115 (4.478109419345856) | > loss_mel: 23.513830184936523 (21.6851806640625) | > loss_duration: 3.011712074279785 (3.1152830123901367) | > loss_1: 41.767051696777344 (36.3726749420166)  --> STEP: 3 | > loss_disc: 2.643071174621582 (2.846038818359375) | > loss_disc_real_0: 0.2987700402736664 (0.3026030759016673) | > loss_disc_real_1: 0.2908868193626404 (0.3005686899026235) | > loss_disc_real_2: 0.23488739132881165 (0.20335558553536734) | > loss_disc_real_3: 0.3057655692100525 (0.3648744424184163) | > loss_disc_real_4: 0.3053185045719147 (0.31546880304813385) | > loss_disc_real_5: 0.2907019555568695 (0.2681131462256114) | > loss_0: 2.643071174621582 (2.846038818359375) | > loss_gen: 2.4737563133239746 (2.215953747431437) | > loss_kl: 2.134089708328247 (4.049396276473999) | > loss_feat: 2.6408145427703857 (3.865677793820699) | > loss_mel: 19.242610931396484 (20.870990753173828) | > loss_duration: 2.7949016094207764 (3.00848921140035) | > loss_1: 29.28617286682129 (34.010507583618164) --> EVAL PERFORMANCE | > avg_loader_time: 0.018809715906778973 (+0.015620549519856771) | > avg_loss_disc: 2.846038818359375 (+0.20492641131083156) | > avg_loss_disc_real_0: 0.3026030759016673 (-0.05817898114522296) | > avg_loss_disc_real_1: 0.3005686899026235 (-0.016010165214538574) | > avg_loss_disc_real_2: 0.20335558553536734 (-0.09433055420716605) | > avg_loss_disc_real_3: 0.3648744424184163 (+0.08889983594417572) | > avg_loss_disc_real_4: 0.31546880304813385 (+0.007149035731951414) | > avg_loss_disc_real_5: 0.2681131462256114 (-0.06598608692487079) | > avg_loss_0: 2.846038818359375 (+0.20492641131083156) | > avg_loss_gen: 2.215953747431437 (-1.2822590668996177) | > avg_loss_kl: 4.049396276473999 (+0.12246974309285497) | > avg_loss_feat: 3.865677793820699 (-3.5467777649561563) | > avg_loss_mel: 20.870990753173828 (-3.5683034261067696) | > avg_loss_duration: 3.00848921140035 (+0.02970472971598337) | > avg_loss_1: 34.010507583618164 (-8.24516487121582)  > EPOCH: 739/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:29:58)   --> TIME: 2023-10-20 08:30:17 -- STEP: 19/50 -- GLOBAL_STEP: 89970 | > loss_disc: 2.207885503768921 (2.497842311859131) | > loss_disc_real_0: 0.09021516144275665 (0.16020510345697403) | > loss_disc_real_1: 0.16628733277320862 (0.24221308607804148) | > loss_disc_real_2: 0.1846872717142105 (0.2486298439141951) | > loss_disc_real_3: 0.1788126826286316 (0.22439011421642804) | > loss_disc_real_4: 0.14765794575214386 (0.24570563494374878) | > loss_disc_real_5: 0.11937984824180603 (0.19777399242708557) | > loss_0: 2.207885503768921 (2.497842311859131) | > grad_norm_0: tensor(415.4674, device='cuda:0') (tensor(557.3405, device='cuda:0')) | > loss_gen: 2.4871554374694824 (2.240603861055876) | > loss_kl: 0.6553452610969543 (0.7760161412389655) | > loss_feat: 6.771690845489502 (4.795124030819065) | > loss_mel: 23.245147705078125 (18.182855254725407) | > loss_duration: 1.5205644369125366 (1.4432950584512008) | > loss_1: 34.67990493774414 (27.43789449490999) | > grad_norm_1: tensor(9905.6523, device='cuda:0') (tensor(21782.7246, device='cuda:0')) | > current_lr_0: 9.551384159946764e-05 | > current_lr_1: 9.551384159946764e-05 | > step_time: 1.0486 (0.5972440242767334) | > loader_time: 0.0179 (0.016672284979569286)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9147905111312866 (1.9147905111312866) | > loss_disc_real_0: 0.0257758516818285 (0.0257758516818285) | > loss_disc_real_1: 0.1879618912935257 (0.1879618912935257) | > loss_disc_real_2: 0.09420514851808548 (0.09420514851808548) | > loss_disc_real_3: 0.10195443779230118 (0.10195443779230118) | > loss_disc_real_4: 0.049103446304798126 (0.049103446304798126) | > loss_disc_real_5: 0.012554291635751724 (0.012554291635751724) | > loss_0: 1.9147905111312866 (1.9147905111312866) | > loss_gen: 1.9410536289215088 (1.9410536289215088) | > loss_kl: 3.895514726638794 (3.895514726638794) | > loss_feat: 12.368351936340332 (12.368351936340332) | > loss_mel: 25.889659881591797 (25.889659881591797) | > loss_duration: 2.9290313720703125 (2.9290313720703125) | > loss_1: 47.02361297607422 (47.02361297607422)  --> STEP: 1 | > loss_disc: 2.299586057662964 (2.299586057662964) | > loss_disc_real_0: 0.3333498239517212 (0.3333498239517212) | > loss_disc_real_1: 0.14169670641422272 (0.14169670641422272) | > loss_disc_real_2: 0.17683085799217224 (0.17683085799217224) | > loss_disc_real_3: 0.12761643528938293 (0.12761643528938293) | > loss_disc_real_4: 0.14809994399547577 (0.14809994399547577) | > loss_disc_real_5: 0.08948001265525818 (0.08948001265525818) | > loss_0: 2.299586057662964 (2.299586057662964) | > loss_gen: 1.8665270805358887 (1.8665270805358887) | > loss_kl: 4.6339216232299805 (4.6339216232299805) | > loss_feat: 6.967766284942627 (6.967766284942627) | > loss_mel: 23.88723373413086 (23.88723373413086) | > loss_duration: 3.2483084201812744 (3.2483084201812744) | > loss_1: 40.603759765625 (40.603759765625)  --> STEP: 2 | > loss_disc: 3.0203003883361816 (2.6599432229995728) | > loss_disc_real_0: 0.19288894534111023 (0.2631193846464157) | > loss_disc_real_1: 0.2968769073486328 (0.21928680688142776) | > loss_disc_real_2: 0.3217621445655823 (0.24929650127887726) | > loss_disc_real_3: 0.2974119484424591 (0.21251419186592102) | > loss_disc_real_4: 0.25171470642089844 (0.1999073252081871) | > loss_disc_real_5: 0.23300804197788239 (0.16124402731657028) | > loss_0: 3.0203003883361816 (2.6599432229995728) | > loss_gen: 1.598188877105713 (1.7323579788208008) | > loss_kl: 5.43478536605835 (5.034353494644165) | > loss_feat: 0.022752705961465836 (3.4952594954520464) | > loss_mel: 1.0799907445907593 (12.48361223936081) | > loss_duration: 3.0212817192077637 (3.134795069694519) | > loss_1: 11.156999588012695 (25.880379676818848)  --> STEP: 3 | > loss_disc: 2.7472565174102783 (2.689047654469808) | > loss_disc_real_0: 0.09586770832538605 (0.20736882587273917) | > loss_disc_real_1: 0.31749337911605835 (0.25202233095963794) | > loss_disc_real_2: 0.38303443789482117 (0.2938758134841919) | > loss_disc_real_3: 0.3361177146434784 (0.2537153661251068) | > loss_disc_real_4: 0.19750544428825378 (0.199106698234876) | > loss_disc_real_5: 0.382217139005661 (0.23490173121293387) | > loss_0: 2.7472565174102783 (2.689047654469808) | > loss_gen: 2.4411540031433105 (1.9686233202616374) | > loss_kl: 2.0180716514587402 (4.0289262135823565) | > loss_feat: 6.205488204956055 (4.3986690652867155) | > loss_mel: 24.30499839782715 (16.424074292182922) | > loss_duration: 3.051724910736084 (3.107105016708374) | > loss_1: 38.02143478393555 (29.927398045857746)  --> TIME: 2023-10-20 08:30:41 -- STEP: 49/50 -- GLOBAL_STEP: 90000 | > loss_disc: 1.5368503332138062 (2.55998184243027) | > loss_disc_real_0: 0.03752671554684639 (0.16750285955031916) | > loss_disc_real_1: 0.18200799822807312 (0.2342572856922539) | > loss_disc_real_2: 0.09323207288980484 (0.23526260796554238) | > loss_disc_real_3: 0.14845913648605347 (0.23865744159842023) | > loss_disc_real_4: 0.01493473444133997 (0.24208657681105694) | > loss_disc_real_5: 0.01615477167069912 (0.2151311541698417) | > loss_0: 1.5368503332138062 (2.55998184243027) | > grad_norm_0: tensor(500.5190, device='cuda:0') (tensor(515.3604, device='cuda:0')) | > loss_gen: 2.57365345954895 (2.1538622087361854) | > loss_kl: 0.774130642414093 (0.7860549893610332) | > loss_feat: 9.630846977233887 (4.71161674434433) | > loss_mel: 25.622657775878906 (19.213335718427384) | > loss_duration: 1.5494874715805054 (1.402830221215073) | > loss_1: 40.15077590942383 (28.267699796326305) | > grad_norm_1: tensor(17228.1680, device='cuda:0') (tensor(15969.2812, device='cuda:0')) | > current_lr_0: 9.551384159946764e-05 | > current_lr_1: 9.551384159946764e-05 | > step_time: 1.7137 (0.6027172098354417) | > loader_time: 5.0045 (0.12090935999033403) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_90000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3401951789855957 (2.601834535598755) | > loss_disc_real_0: 0.08671753853559494 (0.1772060040384531) | > loss_disc_real_1: 0.19341683387756348 (0.23737095668911934) | > loss_disc_real_2: 0.2455480843782425 (0.28179388120770454) | > loss_disc_real_3: 0.25499358773231506 (0.2540349215269089) | > loss_disc_real_4: 0.17619115114212036 (0.1933778114616871) | > loss_disc_real_5: 0.12946106493473053 (0.20854156464338303) | > loss_0: 2.3401951789855957 (2.601834535598755) | > loss_gen: 2.004150390625 (1.977505087852478) | > loss_kl: 4.258599758148193 (4.086344599723816) | > loss_feat: 3.7333552837371826 (4.2323406198993325) | > loss_mel: 26.078275680541992 (18.83762463927269) | > loss_duration: 2.8485352993011475 (3.0424625873565674) | > loss_1: 38.92291259765625 (32.17627668380737)  --> STEP: 1 | > loss_disc: 2.880326986312866 (2.6575330257415772) | > loss_disc_real_0: 0.16748391091823578 (0.17526158541440964) | > loss_disc_real_1: 0.30327609181404114 (0.2505519837141037) | > loss_disc_real_2: 0.3658389449119568 (0.298602893948555) | > loss_disc_real_3: 0.30699267983436584 (0.26462647318840027) | > loss_disc_real_4: 0.25519970059394836 (0.20574218928813934) | > loss_disc_real_5: 0.23572410643100739 (0.2139780730009079) | > loss_0: 2.880326986312866 (2.6575330257415772) | > loss_gen: 1.802701711654663 (1.942544412612915) | > loss_kl: 4.57722806930542 (4.184521293640136) | > loss_feat: 0.4463931620121002 (3.475151128321886) | > loss_mel: 16.872499465942383 (18.44459960460663) | > loss_duration: 3.3151535987854004 (3.097000789642334) | > loss_1: 27.013975143432617 (31.14381637573242)  --> STEP: 2 | > loss_disc: 2.4181318283081055 (2.617632826169332) | > loss_disc_real_0: 0.17203806340694427 (0.17472433174649873) | > loss_disc_real_1: 0.19881798326969147 (0.24192965030670166) | > loss_disc_real_2: 0.288449764251709 (0.29691070566574734) | > loss_disc_real_3: 0.5044121742248535 (0.30459075669447583) | > loss_disc_real_4: 0.1406630277633667 (0.1948956623673439) | > loss_disc_real_5: 0.06970010697841644 (0.18993174533049265) | > loss_0: 2.4181318283081055 (2.617632826169332) | > loss_gen: 2.688582420349121 (2.0668840805689492) | > loss_kl: 5.3967366218566895 (4.3865571816762285) | > loss_feat: 11.0125732421875 (4.731388147299488) | > loss_mel: 26.649988174438477 (19.81216436624527) | > loss_duration: 3.129413366317749 (3.1024028857549033) | > loss_1: 48.87729263305664 (34.099395751953125)  --> STEP: 3 | > loss_disc: 2.8340260982513428 (2.6485461507524763) | > loss_disc_real_0: 0.23716628551483154 (0.18364461085626058) | > loss_disc_real_1: 0.29712891578674316 (0.2498152596609933) | > loss_disc_real_2: 0.3415798842906952 (0.3032920168978827) | > loss_disc_real_3: 0.2978847324848175 (0.3036327532359532) | > loss_disc_real_4: 0.25894707441329956 (0.20404586408819472) | > loss_disc_real_5: 0.24032270908355713 (0.19713045443807328) | > loss_0: 2.8340260982513428 (2.6485461507524763) | > loss_gen: 1.9533913135528564 (2.0506708281380788) | > loss_kl: 2.467951536178589 (4.1124706608908514) | > loss_feat: 0.8032575845718384 (4.170226638338396) | > loss_mel: 16.49883270263672 (19.338831271444047) | > loss_duration: 2.9683895111083984 (3.0832581179482594) | > loss_1: 24.691823959350586 (32.75545692443848) --> EVAL PERFORMANCE | > avg_loader_time: 0.407085725239345 (+0.388276009332566) | > avg_loss_disc: 2.6485461507524763 (-0.19749266760689865) | > avg_loss_disc_real_0: 0.18364461085626058 (-0.11895846504540672) | > avg_loss_disc_real_1: 0.2498152596609933 (-0.050753430241630176) | > avg_loss_disc_real_2: 0.3032920168978827 (+0.09993643136251537) | > avg_loss_disc_real_3: 0.3036327532359532 (-0.061241689182463144) | > avg_loss_disc_real_4: 0.20404586408819472 (-0.11142293895993913) | > avg_loss_disc_real_5: 0.19713045443807328 (-0.0709826917875381) | > avg_loss_0: 2.6485461507524763 (-0.19749266760689865) | > avg_loss_gen: 2.0506708281380788 (-0.16528291929335825) | > avg_loss_kl: 4.1124706608908514 (+0.06307438441685242) | > avg_loss_feat: 4.170226638338396 (+0.3045488445176967) | > avg_loss_mel: 19.338831271444047 (-1.5321594817297814) | > avg_loss_duration: 3.0832581179482594 (+0.07476890654790935) | > avg_loss_1: 32.75545692443848 (-1.2550506591796875)  > EPOCH: 740/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:31:08)   --> TIME: 2023-10-20 08:31:22 -- STEP: 29/50 -- GLOBAL_STEP: 90030 | > loss_disc: 2.768556833267212 (2.3360464326266577) | > loss_disc_real_0: 0.09792905300855637 (0.14678764921324006) | > loss_disc_real_1: 0.28000500798225403 (0.21965570773543983) | > loss_disc_real_2: 0.3307488262653351 (0.24598027174842768) | > loss_disc_real_3: 0.28848597407341003 (0.24442475263414712) | > loss_disc_real_4: 0.24533848464488983 (0.20020820701430583) | > loss_disc_real_5: 0.27894535660743713 (0.1992192057378847) | > loss_0: 2.768556833267212 (2.3360464326266577) | > grad_norm_0: tensor(1441.4438, device='cuda:0') (tensor(740.5853, device='cuda:0')) | > loss_gen: 1.9186455011367798 (2.542198653878837) | > loss_kl: 0.9628997445106506 (0.9136349599936913) | > loss_feat: 1.313463807106018 (6.729668399575969) | > loss_mel: 16.450334548950195 (22.137119511078144) | > loss_duration: 1.3780148029327393 (1.4320349323338475) | > loss_1: 22.023359298706055 (33.75465639706315) | > grad_norm_1: tensor(9283.6553, device='cuda:0') (tensor(29611.8672, device='cuda:0')) | > current_lr_0: 9.541836953472866e-05 | > current_lr_1: 9.541836953472866e-05 | > step_time: 0.4377 (0.28102688953794286) | > loader_time: 0.008 (0.004257810526880725)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7177231311798096 (2.7177231311798096) | > loss_disc_real_0: 0.28007030487060547 (0.28007030487060547) | > loss_disc_real_1: 0.3409804701805115 (0.3409804701805115) | > loss_disc_real_2: 0.24263839423656464 (0.24263839423656464) | > loss_disc_real_3: 0.3911277949810028 (0.3911277949810028) | > loss_disc_real_4: 0.27261242270469666 (0.27261242270469666) | > loss_disc_real_5: 0.27519500255584717 (0.27519500255584717) | > loss_0: 2.7177231311798096 (2.7177231311798096) | > loss_gen: 2.524146795272827 (2.524146795272827) | > loss_kl: 4.743093967437744 (4.743093967437744) | > loss_feat: 8.148143768310547 (8.148143768310547) | > loss_mel: 23.60332489013672 (23.60332489013672) | > loss_duration: 2.826364755630493 (2.826364755630493) | > loss_1: 41.84507369995117 (41.84507369995117)  --> STEP: 1 | > loss_disc: 2.5020294189453125 (2.5020294189453125) | > loss_disc_real_0: 0.24201694130897522 (0.24201694130897522) | > loss_disc_real_1: 0.12095478177070618 (0.12095478177070618) | > loss_disc_real_2: 0.22350755333900452 (0.22350755333900452) | > loss_disc_real_3: 0.293293297290802 (0.293293297290802) | > loss_disc_real_4: 0.35769814252853394 (0.35769814252853394) | > loss_disc_real_5: 0.35590407252311707 (0.35590407252311707) | > loss_0: 2.5020294189453125 (2.5020294189453125) | > loss_gen: 2.6749556064605713 (2.6749556064605713) | > loss_kl: 4.964763641357422 (4.964763641357422) | > loss_feat: 7.525479316711426 (7.525479316711426) | > loss_mel: 23.08161735534668 (23.08161735534668) | > loss_duration: 3.220273971557617 (3.220273971557617) | > loss_1: 41.46709442138672 (41.46709442138672)  --> STEP: 2 | > loss_disc: 2.6940956115722656 (2.598062515258789) | > loss_disc_real_0: 0.15130458772182465 (0.19666076451539993) | > loss_disc_real_1: 0.2630979120731354 (0.19202634692192078) | > loss_disc_real_2: 0.3484487533569336 (0.28597815334796906) | > loss_disc_real_3: 0.25305405259132385 (0.2731736749410629) | > loss_disc_real_4: 0.3150474727153778 (0.33637280762195587) | > loss_disc_real_5: 0.3159302771091461 (0.3359171748161316) | > loss_0: 2.6940956115722656 (2.598062515258789) | > loss_gen: 2.123075008392334 (2.3990153074264526) | > loss_kl: 5.377647876739502 (5.171205759048462) | > loss_feat: 1.9336638450622559 (4.729571580886841) | > loss_mel: 22.26657485961914 (22.67409610748291) | > loss_duration: 2.9768824577331543 (3.0985782146453857) | > loss_1: 34.6778450012207 (38.07246971130371)  --> STEP: 3 | > loss_disc: 2.917388677597046 (2.7045045693715415) | > loss_disc_real_0: 0.24954982101917267 (0.2142904500166575) | > loss_disc_real_1: 0.25493741035461426 (0.21299670139948526) | > loss_disc_real_2: 0.3394290506839752 (0.30379511912663776) | > loss_disc_real_3: 0.33608704805374146 (0.29414479931195575) | > loss_disc_real_4: 0.316255122423172 (0.3296669125556946) | > loss_disc_real_5: 0.3172885477542877 (0.32970763246218365) | > loss_0: 2.917388677597046 (2.7045045693715415) | > loss_gen: 2.0332090854644775 (2.2770799001057944) | > loss_kl: 2.120908498764038 (4.15444000562032) | > loss_feat: 1.7291932106018066 (3.729445457458496) | > loss_mel: 20.73092269897461 (22.026371637980144) | > loss_duration: 2.7754461765289307 (2.990867535273234) | > loss_1: 29.389678955078125 (35.17820612589518) --> EVAL PERFORMANCE | > avg_loader_time: 0.002742767333984375 (-0.4043429579053606) | > avg_loss_disc: 2.7045045693715415 (+0.05595841861906514) | > avg_loss_disc_real_0: 0.2142904500166575 (+0.030645839160396926) | > avg_loss_disc_real_1: 0.21299670139948526 (-0.03681855826150804) | > avg_loss_disc_real_2: 0.30379511912663776 (+0.000503102228755048) | > avg_loss_disc_real_3: 0.29414479931195575 (-0.009487953923997428) | > avg_loss_disc_real_4: 0.3296669125556946 (+0.12562104846749986) | > avg_loss_disc_real_5: 0.32970763246218365 (+0.13257717802411037) | > avg_loss_0: 2.7045045693715415 (+0.05595841861906514) | > avg_loss_gen: 2.2770799001057944 (+0.22640907196771565) | > avg_loss_kl: 4.15444000562032 (+0.041969344729468894) | > avg_loss_feat: 3.729445457458496 (-0.4407811808798998) | > avg_loss_mel: 22.026371637980144 (+2.6875403665360977) | > avg_loss_duration: 2.990867535273234 (-0.09239058267502553) | > avg_loss_1: 35.17820612589518 (+2.4227492014567034)  > EPOCH: 741/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:32:05)   --> TIME: 2023-10-20 08:32:17 -- STEP: 9/50 -- GLOBAL_STEP: 90060 | > loss_disc: 2.6934003829956055 (2.3041368855370417) | > loss_disc_real_0: 0.10538922250270844 (0.10081309494045046) | > loss_disc_real_1: 0.23201271891593933 (0.2231948756509357) | > loss_disc_real_2: 0.3142390549182892 (0.19183937749928898) | > loss_disc_real_3: 0.23070229589939117 (0.22656415734026167) | > loss_disc_real_4: 0.27016302943229675 (0.22844154843025738) | > loss_disc_real_5: 0.2680288553237915 (0.18978570111923748) | > loss_0: 2.6934003829956055 (2.3041368855370417) | > grad_norm_0: tensor(926.5083, device='cuda:0') (tensor(957.0831, device='cuda:0')) | > loss_gen: 1.9749212265014648 (2.360169384214613) | > loss_kl: 0.9885157346725464 (0.7785339752833048) | > loss_feat: 2.796466827392578 (6.76647068394555) | > loss_mel: 20.26569366455078 (21.799075444539387) | > loss_duration: 1.3636493682861328 (1.372961507903205) | > loss_1: 27.389245986938477 (33.077211168077255) | > grad_norm_1: tensor(8317.6846, device='cuda:0') (tensor(51458.0195, device='cuda:0')) | > current_lr_0: 9.532299290029582e-05 | > current_lr_1: 9.532299290029582e-05 | > step_time: 0.8135 (0.6402505238850912) | > loader_time: 0.029 (0.025374359554714628)  --> TIME: 2023-10-20 08:32:36 -- STEP: 39/50 -- GLOBAL_STEP: 90090 | > loss_disc: 2.1574289798736572 (2.4083976776171947) | > loss_disc_real_0: 0.07491227239370346 (0.14389785257383034) | > loss_disc_real_1: 0.1977241486310959 (0.22352187502651644) | > loss_disc_real_2: 0.1329474002122879 (0.21537877972691488) | > loss_disc_real_3: 0.25655239820480347 (0.23713442100546298) | > loss_disc_real_4: 0.15857337415218353 (0.2212999616868985) | > loss_disc_real_5: 0.14377827942371368 (0.20918489323976713) | > loss_0: 2.1574289798736572 (2.4083976776171947) | > grad_norm_0: tensor(544.2139, device='cuda:0') (tensor(715.2008, device='cuda:0')) | > loss_gen: 2.2168378829956055 (2.290895241957444) | > loss_kl: 0.8343716263771057 (0.7954311133959354) | > loss_feat: 4.3191070556640625 (5.253157258224793) | > loss_mel: 20.053571701049805 (19.246051070017693) | > loss_duration: 1.5170857906341553 (1.3976463415683844) | > loss_1: 28.940975189208984 (28.983180950849484) | > grad_norm_1: tensor(13378.6338, device='cuda:0') (tensor(31924.4941, device='cuda:0')) | > current_lr_0: 9.532299290029582e-05 | > current_lr_1: 9.532299290029582e-05 | > step_time: 0.5028 (0.6180956608209854) | > loader_time: 0.0041 (0.021344570013192985)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.376944065093994 (3.376944065093994) | > loss_disc_real_0: 0.6690253019332886 (0.6690253019332886) | > loss_disc_real_1: 0.3405134379863739 (0.3405134379863739) | > loss_disc_real_2: 0.37040120363235474 (0.37040120363235474) | > loss_disc_real_3: 0.3626871109008789 (0.3626871109008789) | > loss_disc_real_4: 0.3508373498916626 (0.3508373498916626) | > loss_disc_real_5: 0.27393704652786255 (0.27393704652786255) | > loss_0: 3.376944065093994 (3.376944065093994) | > loss_gen: 2.405989170074463 (2.405989170074463) | > loss_kl: 3.7971842288970947 (3.7971842288970947) | > loss_feat: 5.469653129577637 (5.469653129577637) | > loss_mel: 24.9838809967041 (24.9838809967041) | > loss_duration: 2.695742607116699 (2.695742607116699) | > loss_1: 39.35245132446289 (39.35245132446289)  --> STEP: 1 | > loss_disc: 2.8757784366607666 (2.8757784366607666) | > loss_disc_real_0: 0.4772959053516388 (0.4772959053516388) | > loss_disc_real_1: 0.23214520514011383 (0.23214520514011383) | > loss_disc_real_2: 0.26947128772735596 (0.26947128772735596) | > loss_disc_real_3: 0.3169102668762207 (0.3169102668762207) | > loss_disc_real_4: 0.2828955352306366 (0.2828955352306366) | > loss_disc_real_5: 0.2587782144546509 (0.2587782144546509) | > loss_0: 2.8757784366607666 (2.8757784366607666) | > loss_gen: 2.39752197265625 (2.39752197265625) | > loss_kl: 4.4534807205200195 (4.4534807205200195) | > loss_feat: 1.4307535886764526 (1.4307535886764526) | > loss_mel: 20.109142303466797 (20.109142303466797) | > loss_duration: 3.053872585296631 (3.053872585296631) | > loss_1: 31.444772720336914 (31.444772720336914)  --> STEP: 2 | > loss_disc: 2.963346004486084 (2.9195622205734253) | > loss_disc_real_0: 0.2728109657764435 (0.37505343556404114) | > loss_disc_real_1: 0.22131122648715973 (0.22672821581363678) | > loss_disc_real_2: 0.2557283639907837 (0.2625998258590698) | > loss_disc_real_3: 0.19771042466163635 (0.25731034576892853) | > loss_disc_real_4: 0.4156346321105957 (0.34926508367061615) | > loss_disc_real_5: 0.46242836117744446 (0.36060328781604767) | > loss_0: 2.963346004486084 (2.9195622205734253) | > loss_gen: 2.505531072616577 (2.4515265226364136) | > loss_kl: 5.238816261291504 (4.846148490905762) | > loss_feat: 8.514630317687988 (4.9726919531822205) | > loss_mel: 24.445531845092773 (22.277337074279785) | > loss_duration: 3.0077719688415527 (3.030822277069092) | > loss_1: 43.7122802734375 (37.57852649688721)  --> STEP: 3 | > loss_disc: 2.8536810874938965 (2.897601842880249) | > loss_disc_real_0: 0.2868210971355438 (0.34564265608787537) | > loss_disc_real_1: 0.28832337260246277 (0.24725993474324545) | > loss_disc_real_2: 0.2592247426509857 (0.2614747981230418) | > loss_disc_real_3: 0.25753769278526306 (0.2573861281077067) | > loss_disc_real_4: 0.3468474745750427 (0.3484592139720917) | > loss_disc_real_5: 0.38774800300598145 (0.36965152621269226) | > loss_0: 2.8536810874938965 (2.897601842880249) | > loss_gen: 2.3428993225097656 (2.4153174559275308) | > loss_kl: 2.304076910018921 (3.998791297276815) | > loss_feat: 2.747751235961914 (4.231045047442119) | > loss_mel: 19.934263229370117 (21.496312459309895) | > loss_duration: 2.8800745010375977 (2.9805730183919272) | > loss_1: 30.209064483642578 (35.122039159139) --> EVAL PERFORMANCE | > avg_loader_time: 0.01133871078491211 (+0.008595943450927734) | > avg_loss_disc: 2.897601842880249 (+0.19309727350870753) | > avg_loss_disc_real_0: 0.34564265608787537 (+0.13135220607121786) | > avg_loss_disc_real_1: 0.24725993474324545 (+0.03426323334376019) | > avg_loss_disc_real_2: 0.2614747981230418 (-0.04232032100359595) | > avg_loss_disc_real_3: 0.2573861281077067 (-0.03675867120424903) | > avg_loss_disc_real_4: 0.3484592139720917 (+0.018792301416397095) | > avg_loss_disc_real_5: 0.36965152621269226 (+0.03994389375050861) | > avg_loss_0: 2.897601842880249 (+0.19309727350870753) | > avg_loss_gen: 2.4153174559275308 (+0.13823755582173636) | > avg_loss_kl: 3.998791297276815 (-0.15564870834350542) | > avg_loss_feat: 4.231045047442119 (+0.5015995899836225) | > avg_loss_mel: 21.496312459309895 (-0.5300591786702498) | > avg_loss_duration: 2.9805730183919272 (-0.01029451688130667) | > avg_loss_1: 35.122039159139 (-0.05616696675618016)  > EPOCH: 742/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:32:59)   --> TIME: 2023-10-20 08:33:17 -- STEP: 19/50 -- GLOBAL_STEP: 90120 | > loss_disc: 2.8855011463165283 (2.3403302619331763) | > loss_disc_real_0: 0.19029395282268524 (0.1600364896615869) | > loss_disc_real_1: 0.24132584035396576 (0.2089729058115106) | > loss_disc_real_2: 0.217014878988266 (0.22616534042907388) | > loss_disc_real_3: 0.18318511545658112 (0.2400430254638195) | > loss_disc_real_4: 0.2567048966884613 (0.22641225139561452) | > loss_disc_real_5: 0.2980321943759918 (0.22124312210239863) | > loss_0: 2.8855011463165283 (2.3403302619331763) | > grad_norm_0: tensor(323.5349, device='cuda:0') (tensor(575.8375, device='cuda:0')) | > loss_gen: 1.5850715637207031 (2.6025231762936243) | > loss_kl: 0.8285104036331177 (0.8109273392903177) | > loss_feat: 0.9933469295501709 (6.317123985114066) | > loss_mel: 18.150066375732422 (21.417656641257437) | > loss_duration: 1.5323314666748047 (1.4458823580490916) | > loss_1: 23.089326858520508 (32.5941135004947) | > grad_norm_1: tensor(2914.6646, device='cuda:0') (tensor(32972.1289, device='cuda:0')) | > current_lr_0: 9.522771160078054e-05 | > current_lr_1: 9.522771160078054e-05 | > step_time: 0.8183 (0.5003105715701455) | > loader_time: 0.0274 (0.009541386052181846)  --> TIME: 2023-10-20 08:33:35 -- STEP: 49/50 -- GLOBAL_STEP: 90150 | > loss_disc: 3.0257656574249268 (2.432307019525645) | > loss_disc_real_0: 0.20617955923080444 (0.1607960121592089) | > loss_disc_real_1: 0.2683696150779724 (0.22168054416471597) | > loss_disc_real_2: 0.21540366113185883 (0.21632994791226728) | > loss_disc_real_3: 0.30141350626945496 (0.23063160038116026) | > loss_disc_real_4: 0.2808791399002075 (0.21998661946581335) | > loss_disc_real_5: 0.25308290123939514 (0.22342174853749422) | > loss_0: 3.0257656574249268 (2.432307019525645) | > grad_norm_0: tensor(249.3129, device='cuda:0') (tensor(498.0226, device='cuda:0')) | > loss_gen: 1.5133967399597168 (2.3695674477791298) | > loss_kl: 0.5279245972633362 (0.7917858949881427) | > loss_feat: 0.02926812693476677 (5.464977328304428) | > loss_mel: 3.0922772884368896 (20.081061166159966) | > loss_duration: 1.5260426998138428 (1.4014360126183956) | > loss_1: 6.688909530639648 (30.10882819428736) | > grad_norm_1: tensor(48752.3516, device='cuda:0') (tensor(23157.8828, device='cuda:0')) | > current_lr_0: 9.522771160078054e-05 | > current_lr_1: 9.522771160078054e-05 | > step_time: 0.6166 (0.5552704723513856) | > loader_time: 0.372 (0.023731655004073163)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.483013391494751 (2.483013391494751) | > loss_disc_real_0: 0.24913492798805237 (0.24913492798805237) | > loss_disc_real_1: 0.30132654309272766 (0.30132654309272766) | > loss_disc_real_2: 0.30210575461387634 (0.30210575461387634) | > loss_disc_real_3: 0.2570509910583496 (0.2570509910583496) | > loss_disc_real_4: 0.2816486656665802 (0.2816486656665802) | > loss_disc_real_5: 0.14665737748146057 (0.14665737748146057) | > loss_0: 2.483013391494751 (2.483013391494751) | > loss_gen: 2.7176976203918457 (2.7176976203918457) | > loss_kl: 4.962022304534912 (4.962022304534912) | > loss_feat: 8.287505149841309 (8.287505149841309) | > loss_mel: 22.410734176635742 (22.410734176635742) | > loss_duration: 2.7666401863098145 (2.7666401863098145) | > loss_1: 41.14459991455078 (41.14459991455078)  --> STEP: 1 | > loss_disc: 2.865342617034912 (2.865342617034912) | > loss_disc_real_0: 0.20170417428016663 (0.20170417428016663) | > loss_disc_real_1: 0.43503451347351074 (0.43503451347351074) | > loss_disc_real_2: 0.24050773680210114 (0.24050773680210114) | > loss_disc_real_3: 0.4565182030200958 (0.4565182030200958) | > loss_disc_real_4: 0.2944742739200592 (0.2944742739200592) | > loss_disc_real_5: 0.33030200004577637 (0.33030200004577637) | > loss_0: 2.865342617034912 (2.865342617034912) | > loss_gen: 2.465691089630127 (2.465691089630127) | > loss_kl: 4.371779918670654 (4.371779918670654) | > loss_feat: 3.9508721828460693 (3.9508721828460693) | > loss_mel: 24.313323974609375 (24.313323974609375) | > loss_duration: 3.114846706390381 (3.114846706390381) | > loss_1: 38.21651077270508 (38.21651077270508)  --> STEP: 2 | > loss_disc: 3.313497543334961 (3.0894200801849365) | > loss_disc_real_0: 0.4913749694824219 (0.34653957188129425) | > loss_disc_real_1: 0.4164726436138153 (0.425753578543663) | > loss_disc_real_2: 0.5630971193313599 (0.4018024280667305) | > loss_disc_real_3: 0.32209742069244385 (0.38930781185626984) | > loss_disc_real_4: 0.43824756145477295 (0.3663609176874161) | > loss_disc_real_5: 0.3937447965145111 (0.36202339828014374) | > loss_0: 3.313497543334961 (3.0894200801849365) | > loss_gen: 3.0709915161132812 (2.768341302871704) | > loss_kl: 5.526818752288818 (4.949299335479736) | > loss_feat: 7.530840873718262 (5.7408565282821655) | > loss_mel: 23.5025634765625 (23.907943725585938) | > loss_duration: 3.051521062850952 (3.0831838846206665) | > loss_1: 42.682735443115234 (40.449623107910156)  --> STEP: 3 | > loss_disc: 2.920710563659668 (3.0331835746765137) | > loss_disc_real_0: 0.4774523675441742 (0.3901771704355876) | > loss_disc_real_1: 0.31696462631225586 (0.3894905944665273) | > loss_disc_real_2: 0.44881051778793335 (0.41747179130713147) | > loss_disc_real_3: 0.26150062680244446 (0.34670541683832806) | > loss_disc_real_4: 0.32968664169311523 (0.3541361590226491) | > loss_disc_real_5: 0.19729068875312805 (0.30711249510447186) | > loss_0: 2.920710563659668 (3.0331835746765137) | > loss_gen: 2.7366299629211426 (2.757770856221517) | > loss_kl: 2.2934165000915527 (4.064005057017009) | > loss_feat: 6.25113582611084 (5.910949627558391) | > loss_mel: 25.711685180664062 (24.509190877278645) | > loss_duration: 2.910884380340576 (3.025750716527303) | > loss_1: 39.903751373291016 (40.26766586303711) --> EVAL PERFORMANCE | > avg_loader_time: 0.011966228485107422 (+0.0006275177001953125) | > avg_loss_disc: 3.0331835746765137 (+0.13558173179626465) | > avg_loss_disc_real_0: 0.3901771704355876 (+0.04453451434771222) | > avg_loss_disc_real_1: 0.3894905944665273 (+0.14223065972328183) | > avg_loss_disc_real_2: 0.41747179130713147 (+0.15599699318408966) | > avg_loss_disc_real_3: 0.34670541683832806 (+0.08931928873062134) | > avg_loss_disc_real_4: 0.3541361590226491 (+0.005676945050557436) | > avg_loss_disc_real_5: 0.30711249510447186 (-0.0625390311082204) | > avg_loss_0: 3.0331835746765137 (+0.13558173179626465) | > avg_loss_gen: 2.757770856221517 (+0.3424534002939863) | > avg_loss_kl: 4.064005057017009 (+0.06521375974019383) | > avg_loss_feat: 5.910949627558391 (+1.679904580116272) | > avg_loss_mel: 24.509190877278645 (+3.01287841796875) | > avg_loss_duration: 3.025750716527303 (+0.04517769813537598) | > avg_loss_1: 40.26766586303711 (+5.14562670389811)  > EPOCH: 743/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:33:59)   --> TIME: 2023-10-20 08:34:20 -- STEP: 29/50 -- GLOBAL_STEP: 90180 | > loss_disc: 2.776275634765625 (2.4812994948748894) | > loss_disc_real_0: 0.19164174795150757 (0.17487374266031488) | > loss_disc_real_1: 0.2426198571920395 (0.22673639924875622) | > loss_disc_real_2: 0.15044300258159637 (0.22434133805077652) | > loss_disc_real_3: 0.24659453332424164 (0.24109816641129297) | > loss_disc_real_4: 0.19838762283325195 (0.24244313205367526) | > loss_disc_real_5: 0.20306898653507233 (0.22422034648279177) | > loss_0: 2.776275634765625 (2.4812994948748894) | > grad_norm_0: tensor(543.2993, device='cuda:0') (tensor(619.2133, device='cuda:0')) | > loss_gen: 2.113131523132324 (2.3448105557211525) | > loss_kl: 1.0164556503295898 (0.8203137321718807) | > loss_feat: 5.502193450927734 (6.117613994098943) | > loss_mel: 20.721656799316406 (21.05894441029121) | > loss_duration: 1.429970622062683 (1.431955333413749) | > loss_1: 30.783409118652344 (31.77363787026241) | > grad_norm_1: tensor(22226.9941, device='cuda:0') (tensor(26424.0566, device='cuda:0')) | > current_lr_0: 9.513252554088965e-05 | > current_lr_1: 9.513252554088965e-05 | > step_time: 0.6817 (0.4606361389160156) | > loader_time: 0.0104 (0.013648863496451542)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.120544910430908 (3.120544910430908) | > loss_disc_real_0: 0.5739340782165527 (0.5739340782165527) | > loss_disc_real_1: 0.2631995379924774 (0.2631995379924774) | > loss_disc_real_2: 0.4233560562133789 (0.4233560562133789) | > loss_disc_real_3: 0.41114088892936707 (0.41114088892936707) | > loss_disc_real_4: 0.3348216712474823 (0.3348216712474823) | > loss_disc_real_5: 0.3840162754058838 (0.3840162754058838) | > loss_0: 3.120544910430908 (3.120544910430908) | > loss_gen: 2.886887550354004 (2.886887550354004) | > loss_kl: 4.017890453338623 (4.017890453338623) | > loss_feat: 5.2404069900512695 (5.2404069900512695) | > loss_mel: 23.684053421020508 (23.684053421020508) | > loss_duration: 2.778216600418091 (2.778216600418091) | > loss_1: 38.60745620727539 (38.60745620727539)  --> STEP: 1 | > loss_disc: 2.5709404945373535 (2.5709404945373535) | > loss_disc_real_0: 0.389859139919281 (0.389859139919281) | > loss_disc_real_1: 0.34275123476982117 (0.34275123476982117) | > loss_disc_real_2: 0.3438703715801239 (0.3438703715801239) | > loss_disc_real_3: 0.3926974833011627 (0.3926974833011627) | > loss_disc_real_4: 0.30485817790031433 (0.30485817790031433) | > loss_disc_real_5: 0.20169611275196075 (0.20169611275196075) | > loss_0: 2.5709404945373535 (2.5709404945373535) | > loss_gen: 3.2496700286865234 (3.2496700286865234) | > loss_kl: 5.007129192352295 (5.007129192352295) | > loss_feat: 5.613434791564941 (5.613434791564941) | > loss_mel: 24.714981079101562 (24.714981079101562) | > loss_duration: 3.1956233978271484 (3.1956233978271484) | > loss_1: 41.78083801269531 (41.78083801269531)  --> STEP: 2 | > loss_disc: 3.0737967491149902 (2.822368621826172) | > loss_disc_real_0: 0.23678819835186005 (0.3133236691355705) | > loss_disc_real_1: 0.14793621003627777 (0.24534372240304947) | > loss_disc_real_2: 0.23679111897945404 (0.29033074527978897) | > loss_disc_real_3: 0.13920731842517853 (0.2659524008631706) | > loss_disc_real_4: 0.3245598375797272 (0.31470900774002075) | > loss_disc_real_5: 0.36717158555984497 (0.28443384915590286) | > loss_0: 3.0737967491149902 (2.822368621826172) | > loss_gen: 1.8913506269454956 (2.5705103278160095) | > loss_kl: 4.988554954528809 (4.997842073440552) | > loss_feat: 8.542937278747559 (7.07818603515625) | > loss_mel: 22.616437911987305 (23.665709495544434) | > loss_duration: 3.060150623321533 (3.127887010574341) | > loss_1: 41.099430084228516 (41.440134048461914)  --> STEP: 3 | > loss_disc: 2.820436477661133 (2.8217245737711587) | > loss_disc_real_0: 0.17781159281730652 (0.26815297702948254) | > loss_disc_real_1: 0.2602338194847107 (0.2503070880969365) | > loss_disc_real_2: 0.238548144698143 (0.2730698784192403) | > loss_disc_real_3: 0.2491188496351242 (0.26034121712048847) | > loss_disc_real_4: 0.25303834676742554 (0.2941521207491557) | > loss_disc_real_5: 0.3093698024749756 (0.29274583359559375) | > loss_0: 2.820436477661133 (2.8217245737711587) | > loss_gen: 1.6904853582382202 (2.2771686712900796) | > loss_kl: 2.4633820056915283 (4.153022050857544) | > loss_feat: 0.671137273311615 (4.942503114541371) | > loss_mel: 15.030808448791504 (20.78740914662679) | > loss_duration: 2.881398916244507 (3.045724312464396) | > loss_1: 22.737211227416992 (35.20582644144694) --> EVAL PERFORMANCE | > avg_loader_time: 0.002056757609049479 (-0.009909470876057943) | > avg_loss_disc: 2.8217245737711587 (-0.21145900090535497) | > avg_loss_disc_real_0: 0.26815297702948254 (-0.12202419340610504) | > avg_loss_disc_real_1: 0.2503070880969365 (-0.13918350636959076) | > avg_loss_disc_real_2: 0.2730698784192403 (-0.14440191288789117) | > avg_loss_disc_real_3: 0.26034121712048847 (-0.0863641997178396) | > avg_loss_disc_real_4: 0.2941521207491557 (-0.05998403827349341) | > avg_loss_disc_real_5: 0.29274583359559375 (-0.014366661508878109) | > avg_loss_0: 2.8217245737711587 (-0.21145900090535497) | > avg_loss_gen: 2.2771686712900796 (-0.48060218493143747) | > avg_loss_kl: 4.153022050857544 (+0.08901699384053519) | > avg_loss_feat: 4.942503114541371 (-0.9684465130170192) | > avg_loss_mel: 20.78740914662679 (-3.7217817306518555) | > avg_loss_duration: 3.045724312464396 (+0.019973595937092803) | > avg_loss_1: 35.20582644144694 (-5.061839421590172)  > EPOCH: 744/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:34:51)   --> TIME: 2023-10-20 08:35:03 -- STEP: 9/50 -- GLOBAL_STEP: 90210 | > loss_disc: 2.965306282043457 (2.332524405585395) | > loss_disc_real_0: 0.26575005054473877 (0.13122958017306197) | > loss_disc_real_1: 0.244384303689003 (0.18877893603510326) | > loss_disc_real_2: 0.2810676097869873 (0.23200460771719614) | > loss_disc_real_3: 0.26103559136390686 (0.22810449533992344) | > loss_disc_real_4: 0.21834242343902588 (0.22110173561506802) | > loss_disc_real_5: 0.272421270608902 (0.22123843172772062) | > loss_0: 2.965306282043457 (2.332524405585395) | > grad_norm_0: tensor(447.6839, device='cuda:0') (tensor(499.0144, device='cuda:0')) | > loss_gen: 1.5776090621948242 (2.5044104788038464) | > loss_kl: 0.6482853293418884 (0.9203787114885118) | > loss_feat: 0.13832882046699524 (6.700903630918926) | > loss_mel: 5.182061195373535 (21.47435124715169) | > loss_duration: 1.3881322145462036 (1.421264410018921) | > loss_1: 8.934416770935059 (33.02130858103434) | > grad_norm_1: tensor(18116.2324, device='cuda:0') (tensor(21115.4492, device='cuda:0')) | > current_lr_0: 9.503743462542516e-05 | > current_lr_1: 9.503743462542516e-05 | > step_time: 0.5585 (0.6222973134782579) | > loader_time: 0.0278 (0.022253327899509005)  --> TIME: 2023-10-20 08:35:19 -- STEP: 39/50 -- GLOBAL_STEP: 90240 | > loss_disc: 3.01167368888855 (2.4402911082292214) | > loss_disc_real_0: 0.3122800588607788 (0.1470788574108902) | > loss_disc_real_1: 0.2589581310749054 (0.21947708496680626) | > loss_disc_real_2: 0.26799023151397705 (0.23118107875761312) | > loss_disc_real_3: 0.2439385950565338 (0.2404766409442975) | > loss_disc_real_4: 0.26474761962890625 (0.23704523297074515) | > loss_disc_real_5: 0.22672899067401886 (0.21642021899326488) | > loss_0: 3.01167368888855 (2.4402911082292214) | > grad_norm_0: tensor(330.0132, device='cuda:0') (tensor(613.7086, device='cuda:0')) | > loss_gen: 1.5871586799621582 (2.3994036179322458) | > loss_kl: 0.7138744592666626 (0.8691006020093576) | > loss_feat: 0.2567465901374817 (5.557419932244393) | > loss_mel: 10.663418769836426 (20.9534283051124) | > loss_duration: 1.4325783252716064 (1.4135428636501997) | > loss_1: 14.653777122497559 (31.19289520459298) | > grad_norm_1: tensor(6254.0986, device='cuda:0') (tensor(18123.4141, device='cuda:0')) | > current_lr_0: 9.503743462542516e-05 | > current_lr_1: 9.503743462542516e-05 | > step_time: 0.8153 (0.5490882763495812) | > loader_time: 0.0253 (0.019148728786370688)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.719576835632324 (2.719576835632324) | > loss_disc_real_0: 0.12260130792856216 (0.12260130792856216) | > loss_disc_real_1: 0.26201942563056946 (0.26201942563056946) | > loss_disc_real_2: 0.3368719518184662 (0.3368719518184662) | > loss_disc_real_3: 0.2030666619539261 (0.2030666619539261) | > loss_disc_real_4: 0.30782756209373474 (0.30782756209373474) | > loss_disc_real_5: 0.16040584444999695 (0.16040584444999695) | > loss_0: 2.719576835632324 (2.719576835632324) | > loss_gen: 1.9450664520263672 (1.9450664520263672) | > loss_kl: 4.76850700378418 (4.76850700378418) | > loss_feat: 4.597428798675537 (4.597428798675537) | > loss_mel: 12.61774730682373 (12.61774730682373) | > loss_duration: 2.7336535453796387 (2.7336535453796387) | > loss_1: 26.662405014038086 (26.662405014038086)  --> STEP: 1 | > loss_disc: 3.0747017860412598 (3.0747017860412598) | > loss_disc_real_0: 0.057349175214767456 (0.057349175214767456) | > loss_disc_real_1: 0.19327521324157715 (0.19327521324157715) | > loss_disc_real_2: 0.2591679096221924 (0.2591679096221924) | > loss_disc_real_3: 0.28230565786361694 (0.28230565786361694) | > loss_disc_real_4: 0.37383517622947693 (0.37383517622947693) | > loss_disc_real_5: 0.6595605611801147 (0.6595605611801147) | > loss_0: 3.0747017860412598 (3.0747017860412598) | > loss_gen: 1.9622128009796143 (1.9622128009796143) | > loss_kl: 4.435172080993652 (4.435172080993652) | > loss_feat: 6.063758850097656 (6.063758850097656) | > loss_mel: 26.723007202148438 (26.723007202148438) | > loss_duration: 3.035529375076294 (3.035529375076294) | > loss_1: 42.21968078613281 (42.21968078613281)  --> STEP: 2 | > loss_disc: 2.3182053565979004 (2.69645357131958) | > loss_disc_real_0: 0.06314394623041153 (0.06024656072258949) | > loss_disc_real_1: 0.1449831873178482 (0.16912920027971268) | > loss_disc_real_2: 0.15969306230545044 (0.2094304859638214) | > loss_disc_real_3: 0.2548154890537262 (0.26856057345867157) | > loss_disc_real_4: 0.23735031485557556 (0.30559274554252625) | > loss_disc_real_5: 0.21779653429985046 (0.4386785477399826) | > loss_0: 2.3182053565979004 (2.69645357131958) | > loss_gen: 2.305983543395996 (2.134098172187805) | > loss_kl: 4.793570518493652 (4.614371299743652) | > loss_feat: 4.803414344787598 (5.433586597442627) | > loss_mel: 23.75497055053711 (25.238988876342773) | > loss_duration: 3.0146262645721436 (3.0250778198242188) | > loss_1: 38.67256546020508 (40.446123123168945)  --> STEP: 3 | > loss_disc: 2.972379684448242 (2.7884289423624673) | > loss_disc_real_0: 0.1240779459476471 (0.08152368913094203) | > loss_disc_real_1: 0.39407405257225037 (0.24411081771055856) | > loss_disc_real_2: 0.3909963071346283 (0.2699524263540904) | > loss_disc_real_3: 0.2907823324203491 (0.2759678264458974) | > loss_disc_real_4: 0.31036126613616943 (0.307182252407074) | > loss_disc_real_5: 0.32208195328712463 (0.3998130162556966) | > loss_0: 2.972379684448242 (2.7884289423624673) | > loss_gen: 2.1450541019439697 (2.1377501487731934) | > loss_kl: 2.6662538051605225 (3.964998801549276) | > loss_feat: 2.8744144439697266 (4.58052921295166) | > loss_mel: 19.57927703857422 (23.352418263753254) | > loss_duration: 2.847709894180298 (2.9659551779429116) | > loss_1: 30.112709045410156 (37.001651763916016) --> EVAL PERFORMANCE | > avg_loader_time: 0.016153335571289062 (+0.014096577962239584) | > avg_loss_disc: 2.7884289423624673 (-0.033295631408691406) | > avg_loss_disc_real_0: 0.08152368913094203 (-0.1866292878985405) | > avg_loss_disc_real_1: 0.24411081771055856 (-0.006196270386377961) | > avg_loss_disc_real_2: 0.2699524263540904 (-0.003117452065149906) | > avg_loss_disc_real_3: 0.2759678264458974 (+0.015626609325408936) | > avg_loss_disc_real_4: 0.307182252407074 (+0.013030131657918276) | > avg_loss_disc_real_5: 0.3998130162556966 (+0.10706718266010284) | > avg_loss_0: 2.7884289423624673 (-0.033295631408691406) | > avg_loss_gen: 2.1377501487731934 (-0.13941852251688625) | > avg_loss_kl: 3.964998801549276 (-0.18802324930826808) | > avg_loss_feat: 4.58052921295166 (-0.3619739015897112) | > avg_loss_mel: 23.352418263753254 (+2.565009117126465) | > avg_loss_duration: 2.9659551779429116 (-0.07976913452148438) | > avg_loss_1: 37.001651763916016 (+1.795825322469078)  > EPOCH: 745/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:35:45)   --> TIME: 2023-10-20 08:36:07 -- STEP: 19/50 -- GLOBAL_STEP: 90270 | > loss_disc: 1.8681118488311768 (2.438819966818157) | > loss_disc_real_0: 0.15674999356269836 (0.1396281586861924) | > loss_disc_real_1: 0.23445990681648254 (0.23237507947181402) | > loss_disc_real_2: 0.22226876020431519 (0.241215057867138) | > loss_disc_real_3: 0.11401836574077606 (0.23358293171775973) | > loss_disc_real_4: 0.08152882009744644 (0.2271473655771268) | > loss_disc_real_5: 0.020669659599661827 (0.18845889393828416) | > loss_0: 1.8681118488311768 (2.438819966818157) | > grad_norm_0: tensor(271.0604, device='cuda:0') (tensor(559.1099, device='cuda:0')) | > loss_gen: 2.5253729820251465 (2.4630328730532995) | > loss_kl: 1.0393692255020142 (0.8934390654689387) | > loss_feat: 8.340590476989746 (6.8928091843661505) | > loss_mel: 25.369834899902344 (23.326566006007948) | > loss_duration: 1.5190348625183105 (1.4281427985743473) | > loss_1: 38.7942008972168 (35.00399019843653) | > grad_norm_1: tensor(5366.0488, device='cuda:0') (tensor(19620.3184, device='cuda:0')) | > current_lr_0: 9.494243875928425e-05 | > current_lr_1: 9.494243875928425e-05 | > step_time: 0.814 (0.6027077499188875) | > loader_time: 0.0261 (0.018542653635928507)  --> TIME: 2023-10-20 08:36:27 -- STEP: 49/50 -- GLOBAL_STEP: 90300 | > loss_disc: 2.8370201587677 (2.339054925101144) | > loss_disc_real_0: 0.1828821897506714 (0.14190210702315886) | > loss_disc_real_1: 0.29443228244781494 (0.22031758527974693) | > loss_disc_real_2: 0.3638249635696411 (0.22141023379351413) | > loss_disc_real_3: 0.30151015520095825 (0.23496263512239166) | > loss_disc_real_4: 0.2507890462875366 (0.2289030626796338) | > loss_disc_real_5: 0.22897616028785706 (0.2136200548206665) | > loss_0: 2.8370201587677 (2.339054925101144) | > grad_norm_0: tensor(760.3049, device='cuda:0') (tensor(529.6721, device='cuda:0')) | > loss_gen: 1.889949083328247 (2.4574434830217933) | > loss_kl: 0.4580066204071045 (0.7805442685375408) | > loss_feat: 0.9256751537322998 (6.386302591966731) | > loss_mel: 18.222856521606445 (22.024829450918702) | > loss_duration: 1.6134577989578247 (1.4056299730223052) | > loss_1: 23.109947204589844 (33.05474998513045) | > grad_norm_1: tensor(3650.2109, device='cuda:0') (tensor(18970.2109, device='cuda:0')) | > current_lr_0: 9.494243875928425e-05 | > current_lr_1: 9.494243875928425e-05 | > step_time: 0.5399 (0.6070288638679349) | > loader_time: 0.7497 (0.03870651186728964)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.707890510559082 (2.707890510559082) | > loss_disc_real_0: 0.2736892104148865 (0.2736892104148865) | > loss_disc_real_1: 0.31685012578964233 (0.31685012578964233) | > loss_disc_real_2: 0.12506775557994843 (0.12506775557994843) | > loss_disc_real_3: 0.17854860424995422 (0.17854860424995422) | > loss_disc_real_4: 0.22576498985290527 (0.22576498985290527) | > loss_disc_real_5: 0.260501891374588 (0.260501891374588) | > loss_0: 2.707890510559082 (2.707890510559082) | > loss_gen: 2.6648411750793457 (2.6648411750793457) | > loss_kl: 4.154046058654785 (4.154046058654785) | > loss_feat: 8.592073440551758 (8.592073440551758) | > loss_mel: 26.202550888061523 (26.202550888061523) | > loss_duration: 2.739631414413452 (2.739631414413452) | > loss_1: 44.35314178466797 (44.35314178466797)  --> STEP: 1 | > loss_disc: 2.700784206390381 (2.700784206390381) | > loss_disc_real_0: 0.15879733860492706 (0.15879733860492706) | > loss_disc_real_1: 0.3364856541156769 (0.3364856541156769) | > loss_disc_real_2: 0.31097447872161865 (0.31097447872161865) | > loss_disc_real_3: 0.3264579772949219 (0.3264579772949219) | > loss_disc_real_4: 0.16016043722629547 (0.16016043722629547) | > loss_disc_real_5: 0.3152313530445099 (0.3152313530445099) | > loss_0: 2.700784206390381 (2.700784206390381) | > loss_gen: 2.438443899154663 (2.438443899154663) | > loss_kl: 4.3850202560424805 (4.3850202560424805) | > loss_feat: 4.337383270263672 (4.337383270263672) | > loss_mel: 22.25057601928711 (22.25057601928711) | > loss_duration: 3.1376514434814453 (3.1376514434814453) | > loss_1: 36.549072265625 (36.549072265625)  --> STEP: 2 | > loss_disc: 2.7321369647979736 (2.7164605855941772) | > loss_disc_real_0: 0.3489166796207428 (0.25385700911283493) | > loss_disc_real_1: 0.35630401968955994 (0.3463948369026184) | > loss_disc_real_2: 0.28851377964019775 (0.2997441291809082) | > loss_disc_real_3: 0.2634952664375305 (0.2949766218662262) | > loss_disc_real_4: 0.147506445646286 (0.15383344143629074) | > loss_disc_real_5: 0.15223242342472076 (0.23373188823461533) | > loss_0: 2.7321369647979736 (2.7164605855941772) | > loss_gen: 2.2137863636016846 (2.326115131378174) | > loss_kl: 5.678956508636475 (5.0319883823394775) | > loss_feat: 5.908199310302734 (5.122791290283203) | > loss_mel: 23.962299346923828 (23.10643768310547) | > loss_duration: 3.028672456741333 (3.083161950111389) | > loss_1: 40.79191207885742 (38.67049217224121)  --> STEP: 3 | > loss_disc: 3.1737678050994873 (2.8688963254292807) | > loss_disc_real_0: 0.19593539834022522 (0.23454980552196503) | > loss_disc_real_1: 0.32327350974082947 (0.3386877278486888) | > loss_disc_real_2: 0.2651061415672302 (0.2881981333096822) | > loss_disc_real_3: 0.32345232367515564 (0.3044685224692027) | > loss_disc_real_4: 0.28054600954055786 (0.1960709641377131) | > loss_disc_real_5: 0.32022279500961304 (0.2625621904929479) | > loss_0: 3.1737678050994873 (2.8688963254292807) | > loss_gen: 1.9248870611190796 (2.192372441291809) | > loss_kl: 2.1231443881988525 (4.062373717625936) | > loss_feat: 2.7921109199523926 (4.345897833506267) | > loss_mel: 17.840312957763672 (21.351062774658203) | > loss_duration: 2.903158664703369 (3.0231608549753823) | > loss_1: 27.583614349365234 (34.974866231282554) --> EVAL PERFORMANCE | > avg_loader_time: 0.0076465606689453125 (-0.00850677490234375) | > avg_loss_disc: 2.8688963254292807 (+0.08046738306681345) | > avg_loss_disc_real_0: 0.23454980552196503 (+0.15302611639102298) | > avg_loss_disc_real_1: 0.3386877278486888 (+0.09457691013813022) | > avg_loss_disc_real_2: 0.2881981333096822 (+0.0182457069555918) | > avg_loss_disc_real_3: 0.3044685224692027 (+0.028500696023305294) | > avg_loss_disc_real_4: 0.1960709641377131 (-0.11111128826936087) | > avg_loss_disc_real_5: 0.2625621904929479 (-0.13725082576274872) | > avg_loss_0: 2.8688963254292807 (+0.08046738306681345) | > avg_loss_gen: 2.192372441291809 (+0.05462229251861572) | > avg_loss_kl: 4.062373717625936 (+0.09737491607665971) | > avg_loss_feat: 4.345897833506267 (-0.23463137944539358) | > avg_loss_mel: 21.351062774658203 (-2.001355489095051) | > avg_loss_duration: 3.0231608549753823 (+0.0572056770324707) | > avg_loss_1: 34.974866231282554 (-2.026785532633461)  > EPOCH: 746/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:36:42)   --> TIME: 2023-10-20 08:37:02 -- STEP: 29/50 -- GLOBAL_STEP: 90330 | > loss_disc: 2.9723877906799316 (2.543604517805165) | > loss_disc_real_0: 0.3869057893753052 (0.18005256412615037) | > loss_disc_real_1: 0.26241493225097656 (0.2341056949105756) | > loss_disc_real_2: 0.24609914422035217 (0.2323750058381722) | > loss_disc_real_3: 0.2335612028837204 (0.2369495297557321) | > loss_disc_real_4: 0.2606288194656372 (0.26006853220791654) | > loss_disc_real_5: 0.254379540681839 (0.24898631716596675) | > loss_0: 2.9723877906799316 (2.543604517805165) | > grad_norm_0: tensor(970.4868, device='cuda:0') (tensor(654.0926, device='cuda:0')) | > loss_gen: 1.658050775527954 (2.2331706573223244) | > loss_kl: 0.6758297681808472 (0.8750672545926325) | > loss_feat: 0.3301081955432892 (5.1375030808407685) | > loss_mel: 16.4764404296875 (20.239090907162634) | > loss_duration: 1.4343584775924683 (1.4292075798429291) | > loss_1: 20.574787139892578 (29.914039332291175) | > grad_norm_1: tensor(22365.9844, device='cuda:0') (tensor(19544.9785, device='cuda:0')) | > current_lr_0: 9.484753784745919e-05 | > current_lr_1: 9.484753784745919e-05 | > step_time: 0.8437 (0.4733158966590618) | > loader_time: 0.0378 (0.012445301845155915)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0017077922821045 (3.0017077922821045) | > loss_disc_real_0: 0.16432148218154907 (0.16432148218154907) | > loss_disc_real_1: 0.26818549633026123 (0.26818549633026123) | > loss_disc_real_2: 0.2439580112695694 (0.2439580112695694) | > loss_disc_real_3: 0.26503780484199524 (0.26503780484199524) | > loss_disc_real_4: 0.2638821303844452 (0.2638821303844452) | > loss_disc_real_5: 0.2836131155490875 (0.2836131155490875) | > loss_0: 3.0017077922821045 (3.0017077922821045) | > loss_gen: 1.4991390705108643 (1.4991390705108643) | > loss_kl: 4.397569179534912 (4.397569179534912) | > loss_feat: 0.16669580340385437 (0.16669580340385437) | > loss_mel: 6.444319725036621 (6.444319725036621) | > loss_duration: 2.747248888015747 (2.747248888015747) | > loss_1: 15.254972457885742 (15.254972457885742)  --> STEP: 1 | > loss_disc: 3.1047279834747314 (3.1047279834747314) | > loss_disc_real_0: 0.21386028826236725 (0.21386028826236725) | > loss_disc_real_1: 0.39933809638023376 (0.39933809638023376) | > loss_disc_real_2: 0.32608848810195923 (0.32608848810195923) | > loss_disc_real_3: 0.26981213688850403 (0.26981213688850403) | > loss_disc_real_4: 0.43361926078796387 (0.43361926078796387) | > loss_disc_real_5: 0.2714454233646393 (0.2714454233646393) | > loss_0: 3.1047279834747314 (3.1047279834747314) | > loss_gen: 2.096914768218994 (2.096914768218994) | > loss_kl: 4.6160736083984375 (4.6160736083984375) | > loss_feat: 3.972386121749878 (3.972386121749878) | > loss_mel: 22.6173038482666 (22.6173038482666) | > loss_duration: 3.3027729988098145 (3.3027729988098145) | > loss_1: 36.60545349121094 (36.60545349121094)  --> STEP: 2 | > loss_disc: 3.2660632133483887 (3.18539559841156) | > loss_disc_real_0: 0.47353261709213257 (0.3436964526772499) | > loss_disc_real_1: 0.3185550570487976 (0.3589465767145157) | > loss_disc_real_2: 0.3791925013065338 (0.3526404947042465) | > loss_disc_real_3: 0.3960290849208832 (0.3329206109046936) | > loss_disc_real_4: 0.4358510375022888 (0.43473514914512634) | > loss_disc_real_5: 0.44571441411972046 (0.35857991874217987) | > loss_0: 3.2660632133483887 (3.18539559841156) | > loss_gen: 2.741661310195923 (2.4192880392074585) | > loss_kl: 5.17883825302124 (4.897455930709839) | > loss_feat: 3.487442970275879 (3.7299145460128784) | > loss_mel: 28.916017532348633 (25.766660690307617) | > loss_duration: 2.9807960987091064 (3.1417845487594604) | > loss_1: 43.30475616455078 (39.95510482788086)  --> STEP: 3 | > loss_disc: 3.3991827964782715 (3.2566579977671304) | > loss_disc_real_0: 0.2668853998184204 (0.3180927683909734) | > loss_disc_real_1: 0.395060658454895 (0.3709846039613088) | > loss_disc_real_2: 0.339938223361969 (0.3484064042568207) | > loss_disc_real_3: 0.387987345457077 (0.3512761890888214) | > loss_disc_real_4: 0.40474623441696167 (0.4247388442357381) | > loss_disc_real_5: 0.423977792263031 (0.38037920991579693) | > loss_0: 3.3991827964782715 (3.2566579977671304) | > loss_gen: 2.450145721435547 (2.429573933283488) | > loss_kl: 2.1367955207824707 (3.977235794067383) | > loss_feat: 6.6221699714660645 (4.693999687830607) | > loss_mel: 25.29578399658203 (25.60970179239909) | > loss_duration: 2.9376065731048584 (3.0737252235412598) | > loss_1: 39.442501068115234 (39.784236907958984) --> EVAL PERFORMANCE | > avg_loader_time: 0.0020186901092529297 (-0.005627870559692383) | > avg_loss_disc: 3.2566579977671304 (+0.38776167233784964) | > avg_loss_disc_real_0: 0.3180927683909734 (+0.08354296286900836) | > avg_loss_disc_real_1: 0.3709846039613088 (+0.03229687611262) | > avg_loss_disc_real_2: 0.3484064042568207 (+0.06020827094713849) | > avg_loss_disc_real_3: 0.3512761890888214 (+0.046807666619618715) | > avg_loss_disc_real_4: 0.4247388442357381 (+0.228667880098025) | > avg_loss_disc_real_5: 0.38037920991579693 (+0.11781701942284906) | > avg_loss_0: 3.2566579977671304 (+0.38776167233784964) | > avg_loss_gen: 2.429573933283488 (+0.23720149199167873) | > avg_loss_kl: 3.977235794067383 (-0.08513792355855276) | > avg_loss_feat: 4.693999687830607 (+0.3481018543243408) | > avg_loss_mel: 25.60970179239909 (+4.258639017740887) | > avg_loss_duration: 3.0737252235412598 (+0.05056436856587743) | > avg_loss_1: 39.784236907958984 (+4.80937067667643)  > EPOCH: 747/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:37:29)   --> TIME: 2023-10-20 08:37:41 -- STEP: 9/50 -- GLOBAL_STEP: 90360 | > loss_disc: 1.7374274730682373 (2.33770849969652) | > loss_disc_real_0: 0.10882630944252014 (0.09461291258533795) | > loss_disc_real_1: 0.11733415722846985 (0.22017152773009407) | > loss_disc_real_2: 0.0715920701622963 (0.20971347805526522) | > loss_disc_real_3: 0.18195512890815735 (0.2304976979891459) | > loss_disc_real_4: 0.05610949546098709 (0.26226597858799827) | > loss_disc_real_5: 0.07244063168764114 (0.30020880326628685) | > loss_0: 1.7374274730682373 (2.33770849969652) | > grad_norm_0: tensor(425.1953, device='cuda:0') (tensor(489.3226, device='cuda:0')) | > loss_gen: 2.693965196609497 (2.544115675820245) | > loss_kl: 0.8610770106315613 (0.8989919821421305) | > loss_feat: 9.15487289428711 (6.897978764441278) | > loss_mel: 22.169612884521484 (22.388314300113255) | > loss_duration: 1.3859397172927856 (1.4198708534240723) | > loss_1: 36.26546859741211 (34.1492715411716) | > grad_norm_1: tensor(26647.8711, device='cuda:0') (tensor(30922.0449, device='cuda:0')) | > current_lr_0: 9.47527317950372e-05 | > current_lr_1: 9.47527317950372e-05 | > step_time: 0.483 (0.6408765580919054) | > loader_time: 0.0322 (0.018378867043389216)  --> TIME: 2023-10-20 08:37:59 -- STEP: 39/50 -- GLOBAL_STEP: 90390 | > loss_disc: 3.0199766159057617 (2.495776647176498) | > loss_disc_real_0: 0.18187911808490753 (0.1555238911547722) | > loss_disc_real_1: 0.25088998675346375 (0.2394060043570323) | > loss_disc_real_2: 0.26366886496543884 (0.22895148893197378) | > loss_disc_real_3: 0.25334039330482483 (0.23271288913794053) | > loss_disc_real_4: 0.27682405710220337 (0.24025265347117034) | > loss_disc_real_5: 0.28298768401145935 (0.2580973017865267) | > loss_0: 3.0199766159057617 (2.495776647176498) | > grad_norm_0: tensor(696.7026, device='cuda:0') (tensor(507.4839, device='cuda:0')) | > loss_gen: 1.4925894737243652 (2.3105591015938) | > loss_kl: 0.6166741251945496 (0.8335076073805491) | > loss_feat: 0.033907558768987656 (5.556937545490189) | > loss_mel: 1.337253451347351 (20.19426847115541) | > loss_duration: 1.4487049579620361 (1.4153513755553808) | > loss_1: 4.929129600524902 (30.31062398812709) | > grad_norm_1: tensor(35591.5078, device='cuda:0') (tensor(22441.9082, device='cuda:0')) | > current_lr_0: 9.47527317950372e-05 | > current_lr_1: 9.47527317950372e-05 | > step_time: 0.4964 (0.5896089749458507) | > loader_time: 0.0333 (0.021163408572857197)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.954368829727173 (2.954368829727173) | > loss_disc_real_0: 0.25519317388534546 (0.25519317388534546) | > loss_disc_real_1: 0.2621387839317322 (0.2621387839317322) | > loss_disc_real_2: 0.3410874605178833 (0.3410874605178833) | > loss_disc_real_3: 0.30447179079055786 (0.30447179079055786) | > loss_disc_real_4: 0.3671683967113495 (0.3671683967113495) | > loss_disc_real_5: 0.45468947291374207 (0.45468947291374207) | > loss_0: 2.954368829727173 (2.954368829727173) | > loss_gen: 2.365445852279663 (2.365445852279663) | > loss_kl: 4.502039909362793 (4.502039909362793) | > loss_feat: 6.117589950561523 (6.117589950561523) | > loss_mel: 22.94989585876465 (22.94989585876465) | > loss_duration: 2.779942274093628 (2.779942274093628) | > loss_1: 38.71491241455078 (38.71491241455078)  --> STEP: 1 | > loss_disc: 2.82383131980896 (2.82383131980896) | > loss_disc_real_0: 0.20590461790561676 (0.20590461790561676) | > loss_disc_real_1: 0.13433606922626495 (0.13433606922626495) | > loss_disc_real_2: 0.19258694350719452 (0.19258694350719452) | > loss_disc_real_3: 0.2806136906147003 (0.2806136906147003) | > loss_disc_real_4: 0.32626762986183167 (0.32626762986183167) | > loss_disc_real_5: 0.5135478377342224 (0.5135478377342224) | > loss_0: 2.82383131980896 (2.82383131980896) | > loss_gen: 2.103691339492798 (2.103691339492798) | > loss_kl: 4.495938301086426 (4.495938301086426) | > loss_feat: 9.063713073730469 (9.063713073730469) | > loss_mel: 27.112598419189453 (27.112598419189453) | > loss_duration: 3.2232906818389893 (3.2232906818389893) | > loss_1: 45.999229431152344 (45.999229431152344)  --> STEP: 2 | > loss_disc: 2.485384702682495 (2.6546080112457275) | > loss_disc_real_0: 0.1784336268901825 (0.19216912239789963) | > loss_disc_real_1: 0.20897428691387177 (0.17165517807006836) | > loss_disc_real_2: 0.2358187586069107 (0.2142028510570526) | > loss_disc_real_3: 0.2575395107269287 (0.2690766006708145) | > loss_disc_real_4: 0.19060908257961273 (0.2584383562207222) | > loss_disc_real_5: 0.2545892596244812 (0.3840685486793518) | > loss_0: 2.485384702682495 (2.6546080112457275) | > loss_gen: 2.1985037326812744 (2.151097536087036) | > loss_kl: 5.310666561126709 (4.903302431106567) | > loss_feat: 6.795332431793213 (7.929522752761841) | > loss_mel: 23.69569969177246 (25.404149055480957) | > loss_duration: 2.967094659805298 (3.0951926708221436) | > loss_1: 40.9672966003418 (43.48326301574707)  --> STEP: 3 | > loss_disc: 2.757359743118286 (2.6888585885365806) | > loss_disc_real_0: 0.47670578956604004 (0.2870146781206131) | > loss_disc_real_1: 0.2662442624568939 (0.20318487286567688) | > loss_disc_real_2: 0.20987696945667267 (0.21276089052359262) | > loss_disc_real_3: 0.261177659034729 (0.2664436201254527) | > loss_disc_real_4: 0.2891225516796112 (0.2686664213736852) | > loss_disc_real_5: 0.23375438153743744 (0.3339638262987137) | > loss_0: 2.757359743118286 (2.6888585885365806) | > loss_gen: 2.5114328861236572 (2.2712093194325766) | > loss_kl: 2.410005807876587 (4.072203556696574) | > loss_feat: 3.75114107131958 (6.536728858947754) | > loss_mel: 21.147762298583984 (23.985353469848633) | > loss_duration: 2.9136123657226562 (3.034665902455648) | > loss_1: 32.73395538330078 (39.900160471598305) --> EVAL PERFORMANCE | > avg_loader_time: 0.002315680185953776 (+0.0002969900767008462) | > avg_loss_disc: 2.6888585885365806 (-0.5677994092305498) | > avg_loss_disc_real_0: 0.2870146781206131 (-0.031078090270360292) | > avg_loss_disc_real_1: 0.20318487286567688 (-0.1677997310956319) | > avg_loss_disc_real_2: 0.21276089052359262 (-0.13564551373322806) | > avg_loss_disc_real_3: 0.2664436201254527 (-0.08483256896336872) | > avg_loss_disc_real_4: 0.2686664213736852 (-0.15607242286205292) | > avg_loss_disc_real_5: 0.3339638262987137 (-0.04641538361708325) | > avg_loss_0: 2.6888585885365806 (-0.5677994092305498) | > avg_loss_gen: 2.2712093194325766 (-0.15836461385091116) | > avg_loss_kl: 4.072203556696574 (+0.09496776262919138) | > avg_loss_feat: 6.536728858947754 (+1.8427291711171465) | > avg_loss_mel: 23.985353469848633 (-1.624348322550457) | > avg_loss_duration: 3.034665902455648 (-0.03905932108561183) | > avg_loss_1: 39.900160471598305 (+0.11592356363932055)  > EPOCH: 748/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:38:24)   --> TIME: 2023-10-20 08:38:44 -- STEP: 19/50 -- GLOBAL_STEP: 90420 | > loss_disc: 2.5651493072509766 (2.5418076421085156) | > loss_disc_real_0: 0.008914841338992119 (0.17822489505143543) | > loss_disc_real_1: 0.2666639983654022 (0.23271765285416654) | > loss_disc_real_2: 0.2617795765399933 (0.23938018907057612) | > loss_disc_real_3: 0.259919673204422 (0.24895965837334333) | > loss_disc_real_4: 0.31480997800827026 (0.22574883596481463) | > loss_disc_real_5: 0.38506677746772766 (0.21128402424878195) | > loss_0: 2.5651493072509766 (2.5418076421085156) | > grad_norm_0: tensor(660.6372, device='cuda:0') (tensor(463.0995, device='cuda:0')) | > loss_gen: 2.639087200164795 (2.26450650942953) | > loss_kl: 1.033630609512329 (0.7715745176139631) | > loss_feat: 7.700500965118408 (5.020354187802265) | > loss_mel: 24.435285568237305 (17.873263158296282) | > loss_duration: 1.479896068572998 (1.4519207414827848) | > loss_1: 37.28840255737305 (27.38161957891364) | > grad_norm_1: tensor(21484.4336, device='cuda:0') (tensor(19697.8438, device='cuda:0')) | > current_lr_0: 9.465802050720034e-05 | > current_lr_1: 9.465802050720034e-05 | > step_time: 0.4629 (0.6303461476376182) | > loader_time: 0.0372 (0.02231162472775108)  --> TIME: 2023-10-20 08:39:04 -- STEP: 49/50 -- GLOBAL_STEP: 90450 | > loss_disc: 2.503594398498535 (2.4873006064064653) | > loss_disc_real_0: 0.08642483502626419 (0.15037597881211917) | > loss_disc_real_1: 0.1836138218641281 (0.22639132184641703) | > loss_disc_real_2: 0.3241558074951172 (0.2229305411479911) | > loss_disc_real_3: 0.11555911600589752 (0.2406134189923807) | > loss_disc_real_4: 0.5011532306671143 (0.22871086850990446) | > loss_disc_real_5: 0.31170326471328735 (0.22708392063421862) | > loss_0: 2.503594398498535 (2.4873006064064653) | > grad_norm_0: tensor(655.1902, device='cuda:0') (tensor(507.7959, device='cuda:0')) | > loss_gen: 2.5107977390289307 (2.289339846494246) | > loss_kl: 0.5589234232902527 (0.7405527211269554) | > loss_feat: 6.7580461502075195 (5.368550879310589) | > loss_mel: 24.331527709960938 (20.472240735073473) | > loss_duration: 1.5337852239608765 (1.4105574208862928) | > loss_1: 35.69308090209961 (30.28124174779775) | > grad_norm_1: tensor(14327.2334, device='cuda:0') (tensor(19314.9336, device='cuda:0')) | > current_lr_0: 9.465802050720034e-05 | > current_lr_1: 9.465802050720034e-05 | > step_time: 0.6159 (0.6224558548051484) | > loader_time: 0.6336 (0.03302319195805764)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9393763542175293 (2.9393763542175293) | > loss_disc_real_0: 0.15591855347156525 (0.15591855347156525) | > loss_disc_real_1: 0.28903383016586304 (0.28903383016586304) | > loss_disc_real_2: 0.3538098633289337 (0.3538098633289337) | > loss_disc_real_3: 0.2902463674545288 (0.2902463674545288) | > loss_disc_real_4: 0.25393179059028625 (0.25393179059028625) | > loss_disc_real_5: 0.252875417470932 (0.252875417470932) | > loss_0: 2.9393763542175293 (2.9393763542175293) | > loss_gen: 1.6872055530548096 (1.6872055530548096) | > loss_kl: 3.6386208534240723 (3.6386208534240723) | > loss_feat: 0.23960056900978088 (0.23960056900978088) | > loss_mel: 14.484790802001953 (14.484790802001953) | > loss_duration: 2.811069965362549 (2.811069965362549) | > loss_1: 22.86128807067871 (22.86128807067871)  --> STEP: 1 | > loss_disc: 2.2529137134552 (2.2529137134552) | > loss_disc_real_0: 0.23842820525169373 (0.23842820525169373) | > loss_disc_real_1: 0.2154633104801178 (0.2154633104801178) | > loss_disc_real_2: 0.27421054244041443 (0.27421054244041443) | > loss_disc_real_3: 0.24524594843387604 (0.24524594843387604) | > loss_disc_real_4: 0.16924269497394562 (0.16924269497394562) | > loss_disc_real_5: 0.30746471881866455 (0.30746471881866455) | > loss_0: 2.2529137134552 (2.2529137134552) | > loss_gen: 2.818856716156006 (2.818856716156006) | > loss_kl: 4.423398494720459 (4.423398494720459) | > loss_feat: 7.726535320281982 (7.726535320281982) | > loss_mel: 22.59932518005371 (22.59932518005371) | > loss_duration: 3.271718978881836 (3.271718978881836) | > loss_1: 40.83983612060547 (40.83983612060547)  --> STEP: 2 | > loss_disc: 2.5717220306396484 (2.4123178720474243) | > loss_disc_real_0: 0.0976601094007492 (0.16804415732622147) | > loss_disc_real_1: 0.1054697260260582 (0.160466518253088) | > loss_disc_real_2: 0.286518394947052 (0.2803644686937332) | > loss_disc_real_3: 0.1669321358203888 (0.20608904212713242) | > loss_disc_real_4: 0.34239211678504944 (0.25581740587949753) | > loss_disc_real_5: 0.2104179561138153 (0.25894133746623993) | > loss_0: 2.5717220306396484 (2.4123178720474243) | > loss_gen: 1.9690128564834595 (2.3939347863197327) | > loss_kl: 5.923073768615723 (5.173236131668091) | > loss_feat: 7.907846927642822 (7.817191123962402) | > loss_mel: 23.753040313720703 (23.176182746887207) | > loss_duration: 3.0922951698303223 (3.182007074356079) | > loss_1: 42.64527130126953 (41.7425537109375)  --> STEP: 3 | > loss_disc: 2.6476595401763916 (2.49076509475708) | > loss_disc_real_0: 0.18799781799316406 (0.17469537754853567) | > loss_disc_real_1: 0.3471541404724121 (0.22269572565952936) | > loss_disc_real_2: 0.39452213048934937 (0.3184170226256053) | > loss_disc_real_3: 0.18803782761096954 (0.20007197062174478) | > loss_disc_real_4: 0.45174670219421387 (0.3211271713177363) | > loss_disc_real_5: 0.30766573548316956 (0.2751828034718831) | > loss_0: 2.6476595401763916 (2.49076509475708) | > loss_gen: 2.9392848014831543 (2.57571812470754) | > loss_kl: 2.0408244132995605 (4.129098892211914) | > loss_feat: 4.16650915145874 (6.600297133127849) | > loss_mel: 20.335176467895508 (22.229180653889973) | > loss_duration: 3.0007638931274414 (3.1215926806131997) | > loss_1: 32.48255920410156 (38.65588887532552) --> EVAL PERFORMANCE | > avg_loader_time: 0.010136286417643229 (+0.007820606231689453) | > avg_loss_disc: 2.49076509475708 (-0.19809349377950047) | > avg_loss_disc_real_0: 0.17469537754853567 (-0.11231930057207742) | > avg_loss_disc_real_1: 0.22269572565952936 (+0.01951085279385248) | > avg_loss_disc_real_2: 0.3184170226256053 (+0.10565613210201266) | > avg_loss_disc_real_3: 0.20007197062174478 (-0.06637164950370791) | > avg_loss_disc_real_4: 0.3211271713177363 (+0.052460749944051144) | > avg_loss_disc_real_5: 0.2751828034718831 (-0.058781022826830565) | > avg_loss_0: 2.49076509475708 (-0.19809349377950047) | > avg_loss_gen: 2.57571812470754 (+0.3045088052749634) | > avg_loss_kl: 4.129098892211914 (+0.05689533551533987) | > avg_loss_feat: 6.600297133127849 (+0.0635682741800947) | > avg_loss_mel: 22.229180653889973 (-1.75617281595866) | > avg_loss_duration: 3.1215926806131997 (+0.08692677815755179) | > avg_loss_1: 38.65588887532552 (-1.2442715962727817)  > EPOCH: 749/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:39:25)   --> TIME: 2023-10-20 08:39:44 -- STEP: 29/50 -- GLOBAL_STEP: 90480 | > loss_disc: 2.17400860786438 (2.4806057420270196) | > loss_disc_real_0: 0.20145490765571594 (0.15502035566445055) | > loss_disc_real_1: 0.3273634612560272 (0.21995404092916127) | > loss_disc_real_2: 0.18148167431354523 (0.22409063153739633) | > loss_disc_real_3: 0.24832065403461456 (0.24939656219091907) | > loss_disc_real_4: 0.19935756921768188 (0.21995617693354344) | > loss_disc_real_5: 0.14665019512176514 (0.24716148557591033) | > loss_0: 2.17400860786438 (2.4806057420270196) | > grad_norm_0: tensor(384.8955, device='cuda:0') (tensor(514.2408, device='cuda:0')) | > loss_gen: 2.784166097640991 (2.354004925694959) | > loss_kl: 0.5055255889892578 (0.7350286764317546) | > loss_feat: 6.1300153732299805 (5.120437116843873) | > loss_mel: 20.558639526367188 (19.680307211547063) | > loss_duration: 1.4451751708984375 (1.426251271675373) | > loss_1: 31.423521041870117 (29.31602936777575) | > grad_norm_1: tensor(7272.5942, device='cuda:0') (tensor(24790.6309, device='cuda:0')) | > current_lr_0: 9.456340388922547e-05 | > current_lr_1: 9.456340388922547e-05 | > step_time: 0.3818 (0.4889840093152277) | > loader_time: 0.0099 (0.020340763289352942)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0161795616149902 (3.0161795616149902) | > loss_disc_real_0: 0.4961118698120117 (0.4961118698120117) | > loss_disc_real_1: 0.3002210557460785 (0.3002210557460785) | > loss_disc_real_2: 0.28766053915023804 (0.28766053915023804) | > loss_disc_real_3: 0.39237627387046814 (0.39237627387046814) | > loss_disc_real_4: 0.266886442899704 (0.266886442899704) | > loss_disc_real_5: 0.42391204833984375 (0.42391204833984375) | > loss_0: 3.0161795616149902 (3.0161795616149902) | > loss_gen: 2.671313524246216 (2.671313524246216) | > loss_kl: 4.3213725090026855 (4.3213725090026855) | > loss_feat: 5.359057426452637 (5.359057426452637) | > loss_mel: 22.739601135253906 (22.739601135253906) | > loss_duration: 2.8750405311584473 (2.8750405311584473) | > loss_1: 37.96638488769531 (37.96638488769531)  --> STEP: 1 | > loss_disc: 2.3267574310302734 (2.3267574310302734) | > loss_disc_real_0: 0.10616578906774521 (0.10616578906774521) | > loss_disc_real_1: 0.2926099896430969 (0.2926099896430969) | > loss_disc_real_2: 0.16806577146053314 (0.16806577146053314) | > loss_disc_real_3: 0.1614731401205063 (0.1614731401205063) | > loss_disc_real_4: 0.09271233528852463 (0.09271233528852463) | > loss_disc_real_5: 0.12634481489658356 (0.12634481489658356) | > loss_0: 2.3267574310302734 (2.3267574310302734) | > loss_gen: 2.2090401649475098 (2.2090401649475098) | > loss_kl: 4.677557468414307 (4.677557468414307) | > loss_feat: 7.090968132019043 (7.090968132019043) | > loss_mel: 25.09109115600586 (25.09109115600586) | > loss_duration: 3.196378469467163 (3.196378469467163) | > loss_1: 42.265037536621094 (42.265037536621094)  --> STEP: 2 | > loss_disc: 3.0489501953125 (2.6878538131713867) | > loss_disc_real_0: 0.38644319772720337 (0.2463044933974743) | > loss_disc_real_1: 0.2719797194004059 (0.2822948545217514) | > loss_disc_real_2: 0.2688320279121399 (0.21844889968633652) | > loss_disc_real_3: 0.2386258840560913 (0.2000495120882988) | > loss_disc_real_4: 0.27528661489486694 (0.18399947509169579) | > loss_disc_real_5: 0.2597830891609192 (0.19306395202875137) | > loss_0: 3.0489501953125 (2.6878538131713867) | > loss_gen: 1.6800063848495483 (1.944523274898529) | > loss_kl: 5.299281120300293 (4.9884192943573) | > loss_feat: 0.1684705764055252 (3.629719354212284) | > loss_mel: 2.010948419570923 (13.551019787788391) | > loss_duration: 3.03363037109375 (3.1150044202804565) | > loss_1: 12.192336082458496 (27.228686809539795)  --> STEP: 3 | > loss_disc: 2.982219934463501 (2.7859758536020913) | > loss_disc_real_0: 0.3550528287887573 (0.28255393852790195) | > loss_disc_real_1: 0.2867783308029175 (0.28378934661547345) | > loss_disc_real_2: 0.2944893538951874 (0.24379571775595346) | > loss_disc_real_3: 0.2507184147834778 (0.21693914632002512) | > loss_disc_real_4: 0.27540141344070435 (0.21446678787469864) | > loss_disc_real_5: 0.2611222565174103 (0.215750053524971) | > loss_0: 2.982219934463501 (2.7859758536020913) | > loss_gen: 1.8210604190826416 (1.9033689896265666) | > loss_kl: 2.36093807220459 (4.1125922203063965) | > loss_feat: 0.42567121982574463 (2.561703309416771) | > loss_mel: 15.012696266174316 (14.0382452805837) | > loss_duration: 2.986819267272949 (3.0722760359446206) | > loss_1: 22.60718536376953 (25.688186327616375) --> EVAL PERFORMANCE | > avg_loader_time: 0.022959470748901367 (+0.012823184331258139) | > avg_loss_disc: 2.7859758536020913 (+0.29521075884501125) | > avg_loss_disc_real_0: 0.28255393852790195 (+0.10785856097936627) | > avg_loss_disc_real_1: 0.28378934661547345 (+0.06109362095594409) | > avg_loss_disc_real_2: 0.24379571775595346 (-0.07462130486965182) | > avg_loss_disc_real_3: 0.21693914632002512 (+0.016867175698280334) | > avg_loss_disc_real_4: 0.21446678787469864 (-0.10666038344303769) | > avg_loss_disc_real_5: 0.215750053524971 (-0.05943274994691211) | > avg_loss_0: 2.7859758536020913 (+0.29521075884501125) | > avg_loss_gen: 1.9033689896265666 (-0.6723491350809734) | > avg_loss_kl: 4.1125922203063965 (-0.016506671905517578) | > avg_loss_feat: 2.561703309416771 (-4.038593823711078) | > avg_loss_mel: 14.0382452805837 (-8.190935373306273) | > avg_loss_duration: 3.0722760359446206 (-0.0493166446685791) | > avg_loss_1: 25.688186327616375 (-12.967702547709148)  > EPOCH: 750/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:40:15)   --> TIME: 2023-10-20 08:40:26 -- STEP: 9/50 -- GLOBAL_STEP: 90510 | > loss_disc: 2.3872857093811035 (2.588368919160631) | > loss_disc_real_0: 0.07869447022676468 (0.19258571788668633) | > loss_disc_real_1: 0.26230254769325256 (0.2387349439991845) | > loss_disc_real_2: 0.18167410790920258 (0.20750067714187834) | > loss_disc_real_3: 0.23374778032302856 (0.2333245442973243) | > loss_disc_real_4: 0.1865350902080536 (0.20944763140545952) | > loss_disc_real_5: 0.17148509621620178 (0.19080856690804163) | > loss_0: 2.3872857093811035 (2.588368919160631) | > grad_norm_0: tensor(614.4210, device='cuda:0') (tensor(723.7112, device='cuda:0')) | > loss_gen: 1.8544491529464722 (1.9771240684721205) | > loss_kl: 0.5714225172996521 (0.8439879483646817) | > loss_feat: 2.156595230102539 (3.3442351619402566) | > loss_mel: 13.43192195892334 (17.466075976689655) | > loss_duration: 1.3365544080734253 (1.4059949186113145) | > loss_1: 19.350940704345703 (25.037418100568985) | > grad_norm_1: tensor(3445.5601, device='cuda:0') (tensor(11363.3242, device='cuda:0')) | > current_lr_0: 9.446888184648415e-05 | > current_lr_1: 9.446888184648415e-05 | > step_time: 0.6167 (0.5927347607082791) | > loader_time: 0.0258 (0.024468872282240126)  --> TIME: 2023-10-20 08:40:44 -- STEP: 39/50 -- GLOBAL_STEP: 90540 | > loss_disc: 1.1380866765975952 (2.457959208732996) | > loss_disc_real_0: 0.02405344322323799 (0.16107966722204134) | > loss_disc_real_1: 0.06977663934230804 (0.23387346388055727) | > loss_disc_real_2: 0.09841924160718918 (0.2291906082477325) | > loss_disc_real_3: 0.09686670452356339 (0.23284613651533922) | > loss_disc_real_4: 0.05884447693824768 (0.21205557376528397) | > loss_disc_real_5: 0.04816509038209915 (0.1993340806892285) | > loss_0: 1.1380866765975952 (2.457959208732996) | > grad_norm_0: tensor(482.0265, device='cuda:0') (tensor(632.7554, device='cuda:0')) | > loss_gen: 3.2189364433288574 (2.25078381330539) | > loss_kl: 0.47896742820739746 (0.812210894547976) | > loss_feat: 13.118183135986328 (4.713637091123906) | > loss_mel: 30.273466110229492 (19.425987708262902) | > loss_duration: 1.4588737487792969 (1.4069588306622625) | > loss_1: 48.54842758178711 (28.609578352708084) | > grad_norm_1: tensor(7018.2646, device='cuda:0') (tensor(18929.3516, device='cuda:0')) | > current_lr_0: 9.446888184648415e-05 | > current_lr_1: 9.446888184648415e-05 | > step_time: 0.5187 (0.5875174082242527) | > loader_time: 0.0318 (0.022777673525687974)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.64111590385437 (2.64111590385437) | > loss_disc_real_0: 0.10977041721343994 (0.10977041721343994) | > loss_disc_real_1: 0.18569335341453552 (0.18569335341453552) | > loss_disc_real_2: 0.2879807949066162 (0.2879807949066162) | > loss_disc_real_3: 0.3214210867881775 (0.3214210867881775) | > loss_disc_real_4: 0.4714423716068268 (0.4714423716068268) | > loss_disc_real_5: 0.37272435426712036 (0.37272435426712036) | > loss_0: 2.64111590385437 (2.64111590385437) | > loss_gen: 2.7285985946655273 (2.7285985946655273) | > loss_kl: 4.2222185134887695 (4.2222185134887695) | > loss_feat: 5.328458786010742 (5.328458786010742) | > loss_mel: 22.30371856689453 (22.30371856689453) | > loss_duration: 2.782179355621338 (2.782179355621338) | > loss_1: 37.365177154541016 (37.365177154541016)  --> STEP: 1 | > loss_disc: 2.9362897872924805 (2.9362897872924805) | > loss_disc_real_0: 0.30976685881614685 (0.30976685881614685) | > loss_disc_real_1: 0.34129297733306885 (0.34129297733306885) | > loss_disc_real_2: 0.41695791482925415 (0.41695791482925415) | > loss_disc_real_3: 0.2818247675895691 (0.2818247675895691) | > loss_disc_real_4: 0.3484831154346466 (0.3484831154346466) | > loss_disc_real_5: 0.25361502170562744 (0.25361502170562744) | > loss_0: 2.9362897872924805 (2.9362897872924805) | > loss_gen: 2.2780449390411377 (2.2780449390411377) | > loss_kl: 4.9188103675842285 (4.9188103675842285) | > loss_feat: 3.0683772563934326 (3.0683772563934326) | > loss_mel: 21.105451583862305 (21.105451583862305) | > loss_duration: 3.1410744190216064 (3.1410744190216064) | > loss_1: 34.51176071166992 (34.51176071166992)  --> STEP: 2 | > loss_disc: 2.9951419830322266 (2.9657158851623535) | > loss_disc_real_0: 0.21734318137168884 (0.26355502009391785) | > loss_disc_real_1: 0.2888418436050415 (0.3150674104690552) | > loss_disc_real_2: 0.25986412167549133 (0.33841101825237274) | > loss_disc_real_3: 0.2780435085296631 (0.2799341380596161) | > loss_disc_real_4: 0.2845825254917145 (0.31653282046318054) | > loss_disc_real_5: 0.28092461824417114 (0.2672698199748993) | > loss_0: 2.9951419830322266 (2.9657158851623535) | > loss_gen: 1.6255216598510742 (1.951783299446106) | > loss_kl: 5.370192527770996 (5.144501447677612) | > loss_feat: 0.05954306572675705 (1.5639601610600948) | > loss_mel: 2.219338893890381 (11.662395238876343) | > loss_duration: 2.968649387359619 (3.054861903190613) | > loss_1: 12.243246078491211 (23.377503395080566)  --> STEP: 3 | > loss_disc: 2.7049214839935303 (2.878784418106079) | > loss_disc_real_0: 0.33137136697769165 (0.2861604690551758) | > loss_disc_real_1: 0.26414042711257935 (0.2980917493502299) | > loss_disc_real_2: 0.29382938146591187 (0.3235504726568858) | > loss_disc_real_3: 0.21964971721172333 (0.2598393311103185) | > loss_disc_real_4: 0.4090450704097748 (0.3473702371120453) | > loss_disc_real_5: 0.3482527434825897 (0.2942641278107961) | > loss_0: 2.7049214839935303 (2.878784418106079) | > loss_gen: 2.5761916637420654 (2.1599194208780923) | > loss_kl: 2.1045873165130615 (4.131196737289429) | > loss_feat: 2.4157371520996094 (1.847885824739933) | > loss_mel: 18.520313262939453 (13.948367913564047) | > loss_duration: 2.8703062534332275 (2.9933433532714844) | > loss_1: 28.48713493347168 (25.080713907877605) --> EVAL PERFORMANCE | > avg_loader_time: 0.015374581019083658 (-0.007584889729817709) | > avg_loss_disc: 2.878784418106079 (+0.09280856450398778) | > avg_loss_disc_real_0: 0.2861604690551758 (+0.0036065305272738324) | > avg_loss_disc_real_1: 0.2980917493502299 (+0.01430240273475647) | > avg_loss_disc_real_2: 0.3235504726568858 (+0.07975475490093234) | > avg_loss_disc_real_3: 0.2598393311103185 (+0.042900184790293366) | > avg_loss_disc_real_4: 0.3473702371120453 (+0.13290344923734665) | > avg_loss_disc_real_5: 0.2942641278107961 (+0.07851407428582508) | > avg_loss_0: 2.878784418106079 (+0.09280856450398778) | > avg_loss_gen: 2.1599194208780923 (+0.25655043125152566) | > avg_loss_kl: 4.131196737289429 (+0.018604516983032227) | > avg_loss_feat: 1.847885824739933 (-0.7138174846768379) | > avg_loss_mel: 13.948367913564047 (-0.08987736701965332) | > avg_loss_duration: 2.9933433532714844 (-0.07893268267313625) | > avg_loss_1: 25.080713907877605 (-0.6074724197387695)  > EPOCH: 751/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:41:08)   --> TIME: 2023-10-20 08:41:28 -- STEP: 19/50 -- GLOBAL_STEP: 90570 | > loss_disc: 2.072664737701416 (2.3256699662459526) | > loss_disc_real_0: 0.08700744807720184 (0.14121643395016067) | > loss_disc_real_1: 0.20846480131149292 (0.21862846063940147) | > loss_disc_real_2: 0.173441082239151 (0.23792361272008797) | > loss_disc_real_3: 0.1156507357954979 (0.23689069265597745) | > loss_disc_real_4: 0.21834973990917206 (0.22548756826865046) | > loss_disc_real_5: 0.24879257380962372 (0.22950588598063118) | > loss_0: 2.072664737701416 (2.3256699662459526) | > grad_norm_0: tensor(580.7173, device='cuda:0') (tensor(603.6584, device='cuda:0')) | > loss_gen: 2.344197988510132 (2.6100505653180575) | > loss_kl: 1.0564826726913452 (0.8168455644657737) | > loss_feat: 5.295290470123291 (5.513046920936751) | > loss_mel: 22.215255737304688 (18.58250948002464) | > loss_duration: 1.543418288230896 (1.4483283946388645) | > loss_1: 32.45464324951172 (28.97078097494025) | > grad_norm_1: tensor(36604.0156, device='cuda:0') (tensor(36800.2969, device='cuda:0')) | > current_lr_0: 9.437445428444252e-05 | > current_lr_1: 9.437445428444252e-05 | > step_time: 0.4527 (0.7702341330678839) | > loader_time: 0.0018 (0.027462520097431376)  --> TIME: 2023-10-20 08:41:48 -- STEP: 49/50 -- GLOBAL_STEP: 90600 | > loss_disc: 3.1122970581054688 (2.4142204012189588) | > loss_disc_real_0: 0.1156340092420578 (0.15139533212522455) | > loss_disc_real_1: 0.263353556394577 (0.22260184129890132) | > loss_disc_real_2: 0.2656114399433136 (0.2260753996670246) | > loss_disc_real_3: 0.2873794436454773 (0.23051443977319463) | > loss_disc_real_4: 0.25558236241340637 (0.21064562658418198) | > loss_disc_real_5: 0.3094201982021332 (0.19921770817315093) | > loss_0: 3.1122970581054688 (2.4142204012189588) | > grad_norm_0: tensor(614.6423, device='cuda:0') (tensor(614.6613, device='cuda:0')) | > loss_gen: 1.4747254848480225 (2.3420606219038675) | > loss_kl: 0.4105556607246399 (0.7974475616095017) | > loss_feat: 0.08948303014039993 (5.060062009860209) | > loss_mel: 2.267599582672119 (18.859516056216492) | > loss_duration: 1.525596022605896 (1.4221027189371533) | > loss_1: 5.767960071563721 (28.481189066050003) | > grad_norm_1: tensor(28988.8945, device='cuda:0') (tensor(24812.6699, device='cuda:0')) | > current_lr_0: 9.437445428444252e-05 | > current_lr_1: 9.437445428444252e-05 | > step_time: 0.925 (0.6739869993560169) | > loader_time: 0.7029 (0.03478488143609495)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8320131301879883 (2.8320131301879883) | > loss_disc_real_0: 0.5112565755844116 (0.5112565755844116) | > loss_disc_real_1: 0.16801588237285614 (0.16801588237285614) | > loss_disc_real_2: 0.21033328771591187 (0.21033328771591187) | > loss_disc_real_3: 0.3055470585823059 (0.3055470585823059) | > loss_disc_real_4: 0.40613389015197754 (0.40613389015197754) | > loss_disc_real_5: 0.4580098092556 (0.4580098092556) | > loss_0: 2.8320131301879883 (2.8320131301879883) | > loss_gen: 2.659773111343384 (2.659773111343384) | > loss_kl: 4.224092483520508 (4.224092483520508) | > loss_feat: 4.819851875305176 (4.819851875305176) | > loss_mel: 25.35692596435547 (25.35692596435547) | > loss_duration: 2.688690662384033 (2.688690662384033) | > loss_1: 39.74933624267578 (39.74933624267578)  --> STEP: 1 | > loss_disc: 2.9960899353027344 (2.9960899353027344) | > loss_disc_real_0: 0.08488013595342636 (0.08488013595342636) | > loss_disc_real_1: 0.263584703207016 (0.263584703207016) | > loss_disc_real_2: 0.21584275364875793 (0.21584275364875793) | > loss_disc_real_3: 0.27874577045440674 (0.27874577045440674) | > loss_disc_real_4: 0.30289843678474426 (0.30289843678474426) | > loss_disc_real_5: 0.29394495487213135 (0.29394495487213135) | > loss_0: 2.9960899353027344 (2.9960899353027344) | > loss_gen: 1.5116883516311646 (1.5116883516311646) | > loss_kl: 4.301724433898926 (4.301724433898926) | > loss_feat: 1.387012243270874 (1.387012243270874) | > loss_mel: 19.21546745300293 (19.21546745300293) | > loss_duration: 3.0739948749542236 (3.0739948749542236) | > loss_1: 29.48988914489746 (29.48988914489746)  --> STEP: 2 | > loss_disc: 2.930704116821289 (2.9633970260620117) | > loss_disc_real_0: 0.09370076656341553 (0.08929045125842094) | > loss_disc_real_1: 0.2759268879890442 (0.2697557955980301) | > loss_disc_real_2: 0.2659907639026642 (0.24091675877571106) | > loss_disc_real_3: 0.296773761510849 (0.28775976598262787) | > loss_disc_real_4: 0.2572157680988312 (0.2800571024417877) | > loss_disc_real_5: 0.30680760741233826 (0.3003762811422348) | > loss_0: 2.930704116821289 (2.9633970260620117) | > loss_gen: 1.5943293571472168 (1.5530088543891907) | > loss_kl: 5.257277011871338 (4.779500722885132) | > loss_feat: 0.6118211150169373 (0.9994166791439056) | > loss_mel: 20.420654296875 (19.818060874938965) | > loss_duration: 3.0018911361694336 (3.0379430055618286) | > loss_1: 30.885974884033203 (30.187932014465332)  --> STEP: 3 | > loss_disc: 3.4454054832458496 (3.1240665117899575) | > loss_disc_real_0: 0.14791487157344818 (0.10883192469676335) | > loss_disc_real_1: 0.37716153264045715 (0.3055577079455058) | > loss_disc_real_2: 0.31407636404037476 (0.2653032938639323) | > loss_disc_real_3: 0.4401683509349823 (0.33856262763341266) | > loss_disc_real_4: 0.30690693855285645 (0.289007047812144) | > loss_disc_real_5: 0.22981588542461395 (0.2768561492363612) | > loss_0: 3.4454054832458496 (3.1240665117899575) | > loss_gen: 1.9928675889968872 (1.699628432591756) | > loss_kl: 2.566983699798584 (4.041995048522949) | > loss_feat: 5.79374361038208 (2.597525656223297) | > loss_mel: 21.053817749023438 (20.22997983296712) | > loss_duration: 2.814927339553833 (2.96360445022583) | > loss_1: 34.22233963012695 (31.532734553019207) --> EVAL PERFORMANCE | > avg_loader_time: 0.014827251434326172 (-0.0005473295847574864) | > avg_loss_disc: 3.1240665117899575 (+0.24528209368387843) | > avg_loss_disc_real_0: 0.10883192469676335 (-0.17732854435841244) | > avg_loss_disc_real_1: 0.3055577079455058 (+0.007465958595275879) | > avg_loss_disc_real_2: 0.2653032938639323 (-0.05824717879295349) | > avg_loss_disc_real_3: 0.33856262763341266 (+0.07872329652309418) | > avg_loss_disc_real_4: 0.289007047812144 (-0.05836318929990131) | > avg_loss_disc_real_5: 0.2768561492363612 (-0.01740797857443488) | > avg_loss_0: 3.1240665117899575 (+0.24528209368387843) | > avg_loss_gen: 1.699628432591756 (-0.4602909882863362) | > avg_loss_kl: 4.041995048522949 (-0.08920168876647949) | > avg_loss_feat: 2.597525656223297 (+0.7496398314833641) | > avg_loss_mel: 20.22997983296712 (+6.281611919403074) | > avg_loss_duration: 2.96360445022583 (-0.029738903045654297) | > avg_loss_1: 31.532734553019207 (+6.452020645141602)  > EPOCH: 752/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:42:06)   --> TIME: 2023-10-20 08:42:26 -- STEP: 29/50 -- GLOBAL_STEP: 90630 | > loss_disc: 2.423139810562134 (2.3746590614318843) | > loss_disc_real_0: 0.10817801207304001 (0.12376391357774365) | > loss_disc_real_1: 0.1539667248725891 (0.20971336305655283) | > loss_disc_real_2: 0.22087439894676208 (0.22917640234889655) | > loss_disc_real_3: 0.21204635500907898 (0.23280425241281247) | > loss_disc_real_4: 0.27507346868515015 (0.21800401228769073) | > loss_disc_real_5: 0.1947498619556427 (0.21867649822399535) | > loss_0: 2.423139810562134 (2.3746590614318843) | > grad_norm_0: tensor(303.9977, device='cuda:0') (tensor(469.5412, device='cuda:0')) | > loss_gen: 2.2267632484436035 (2.4225204977495918) | > loss_kl: 0.9375086426734924 (0.8119271150950728) | > loss_feat: 5.286384105682373 (6.599618633502517) | > loss_mel: 21.49401092529297 (22.072320831233057) | > loss_duration: 1.4357103109359741 (1.421260825518904) | > loss_1: 31.3803768157959 (33.32764780110326) | > grad_norm_1: tensor(4429.7573, device='cuda:0') (tensor(22080.2266, device='cuda:0')) | > current_lr_0: 9.42801211086612e-05 | > current_lr_1: 9.42801211086612e-05 | > step_time: 0.3125 (0.5088475983718345) | > loader_time: 0.0148 (0.015760964360730406)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9416067600250244 (2.9416067600250244) | > loss_disc_real_0: 0.23960472643375397 (0.23960472643375397) | > loss_disc_real_1: 0.3002733588218689 (0.3002733588218689) | > loss_disc_real_2: 0.29306966066360474 (0.29306966066360474) | > loss_disc_real_3: 0.2547850012779236 (0.2547850012779236) | > loss_disc_real_4: 0.3525524437427521 (0.3525524437427521) | > loss_disc_real_5: 0.2687341570854187 (0.2687341570854187) | > loss_0: 2.9416067600250244 (2.9416067600250244) | > loss_gen: 2.014723539352417 (2.014723539352417) | > loss_kl: 4.066493988037109 (4.066493988037109) | > loss_feat: 4.384787082672119 (4.384787082672119) | > loss_mel: 24.296648025512695 (24.296648025512695) | > loss_duration: 2.801792860031128 (2.801792860031128) | > loss_1: 37.56444549560547 (37.56444549560547)  --> STEP: 1 | > loss_disc: 2.303706407546997 (2.303706407546997) | > loss_disc_real_0: 0.0471595898270607 (0.0471595898270607) | > loss_disc_real_1: 0.14445289969444275 (0.14445289969444275) | > loss_disc_real_2: 0.15833403170108795 (0.15833403170108795) | > loss_disc_real_3: 0.21143992245197296 (0.21143992245197296) | > loss_disc_real_4: 0.26866060495376587 (0.26866060495376587) | > loss_disc_real_5: 0.35458365082740784 (0.35458365082740784) | > loss_0: 2.303706407546997 (2.303706407546997) | > loss_gen: 2.1388185024261475 (2.1388185024261475) | > loss_kl: 4.70132303237915 (4.70132303237915) | > loss_feat: 5.785946369171143 (5.785946369171143) | > loss_mel: 25.937191009521484 (25.937191009521484) | > loss_duration: 3.062326192855835 (3.062326192855835) | > loss_1: 41.62560272216797 (41.62560272216797)  --> STEP: 2 | > loss_disc: 2.6215782165527344 (2.4626423120498657) | > loss_disc_real_0: 0.21067936718463898 (0.12891947850584984) | > loss_disc_real_1: 0.19618763029575348 (0.17032026499509811) | > loss_disc_real_2: 0.1784466654062271 (0.16839034855365753) | > loss_disc_real_3: 0.14868071675300598 (0.18006031960248947) | > loss_disc_real_4: 0.5001686811447144 (0.3844146430492401) | > loss_disc_real_5: 0.35408496856689453 (0.3543343096971512) | > loss_0: 2.6215782165527344 (2.4626423120498657) | > loss_gen: 3.1553843021392822 (2.647101402282715) | > loss_kl: 5.965437889099121 (5.333380460739136) | > loss_feat: 7.880404949188232 (6.8331756591796875) | > loss_mel: 23.134078979492188 (24.535634994506836) | > loss_duration: 2.9975125789642334 (3.029919385910034) | > loss_1: 43.132816314697266 (42.37920951843262)  --> STEP: 3 | > loss_disc: 3.0038580894470215 (2.643047571182251) | > loss_disc_real_0: 0.3115500211715698 (0.18979632606108984) | > loss_disc_real_1: 0.2502734959125519 (0.1969713419675827) | > loss_disc_real_2: 0.2895062267780304 (0.20876230796178183) | > loss_disc_real_3: 0.3100208640098572 (0.22338050107161203) | > loss_disc_real_4: 0.2922021150588989 (0.3536771337191264) | > loss_disc_real_5: 0.2757631242275238 (0.3281439145406087) | > loss_0: 3.0038580894470215 (2.643047571182251) | > loss_gen: 1.7608312368392944 (2.3516780138015747) | > loss_kl: 2.4310944080352783 (4.365951776504517) | > loss_feat: 0.25559738278388977 (4.640649567047755) | > loss_mel: 7.756274700164795 (18.942514896392822) | > loss_duration: 2.8681864738464355 (2.976008415222168) | > loss_1: 15.071983337402344 (33.276800791422524) --> EVAL PERFORMANCE | > avg_loader_time: 0.011194626490275065 (-0.0036326249440511073) | > avg_loss_disc: 2.643047571182251 (-0.48101894060770656) | > avg_loss_disc_real_0: 0.18979632606108984 (+0.08096440136432649) | > avg_loss_disc_real_1: 0.1969713419675827 (-0.1085863659779231) | > avg_loss_disc_real_2: 0.20876230796178183 (-0.05654098590215048) | > avg_loss_disc_real_3: 0.22338050107161203 (-0.11518212656180063) | > avg_loss_disc_real_4: 0.3536771337191264 (+0.06467008590698242) | > avg_loss_disc_real_5: 0.3281439145406087 (+0.0512877653042475) | > avg_loss_0: 2.643047571182251 (-0.48101894060770656) | > avg_loss_gen: 2.3516780138015747 (+0.6520495812098186) | > avg_loss_kl: 4.365951776504517 (+0.3239567279815674) | > avg_loss_feat: 4.640649567047755 (+2.043123910824458) | > avg_loss_mel: 18.942514896392822 (-1.287464936574299) | > avg_loss_duration: 2.976008415222168 (+0.01240396499633789) | > avg_loss_1: 33.276800791422524 (+1.7440662384033168)  > EPOCH: 753/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:42:58)   --> TIME: 2023-10-20 08:43:11 -- STEP: 9/50 -- GLOBAL_STEP: 90660 | > loss_disc: 2.1193230152130127 (2.5808149178822837) | > loss_disc_real_0: 0.2789848744869232 (0.12923091443048584) | > loss_disc_real_1: 0.2361556440591812 (0.22121628580821884) | > loss_disc_real_2: 0.34912529587745667 (0.2287845036221875) | > loss_disc_real_3: 0.27567243576049805 (0.22267390549596813) | > loss_disc_real_4: 0.20919567346572876 (0.2078064607663287) | > loss_disc_real_5: 0.24060221016407013 (0.21548888749546474) | > loss_0: 2.1193230152130127 (2.5808149178822837) | > grad_norm_0: tensor(586.8304, device='cuda:0') (tensor(615.9167, device='cuda:0')) | > loss_gen: 3.529228687286377 (2.3548322783576117) | > loss_kl: 0.8773068189620972 (0.9422656430138482) | > loss_feat: 6.446058750152588 (6.875846862792969) | > loss_mel: 20.979633331298828 (22.87526724073622) | > loss_duration: 1.3755544424057007 (1.407459815343221) | > loss_1: 33.20778274536133 (34.45567152235243) | > grad_norm_1: tensor(15468.4434, device='cuda:0') (tensor(19061.1504, device='cuda:0')) | > current_lr_0: 9.418588222479522e-05 | > current_lr_1: 9.418588222479522e-05 | > step_time: 0.561 (0.6915889316134982) | > loader_time: 0.0132 (0.02756341298421224)  --> TIME: 2023-10-20 08:43:28 -- STEP: 39/50 -- GLOBAL_STEP: 90690 | > loss_disc: 3.03466534614563 (2.5047043837033787) | > loss_disc_real_0: 0.2792466878890991 (0.15031480182630896) | > loss_disc_real_1: 0.23995661735534668 (0.22657367123816258) | > loss_disc_real_2: 0.26164522767066956 (0.23153602933654419) | > loss_disc_real_3: 0.21264900267124176 (0.23662314642793858) | > loss_disc_real_4: 0.27758708596229553 (0.23205493421604237) | > loss_disc_real_5: 0.27557992935180664 (0.25299351394940645) | > loss_0: 3.03466534614563 (2.5047043837033787) | > grad_norm_0: tensor(857.4027, device='cuda:0') (tensor(597.7233, device='cuda:0')) | > loss_gen: 1.5347387790679932 (2.3245275417963662) | > loss_kl: 0.5719810128211975 (0.8631123785789196) | > loss_feat: 0.08816616982221603 (5.646686244087342) | > loss_mel: 1.9447087049484253 (21.607172553355877) | > loss_duration: 1.4662468433380127 (1.4061289903445122) | > loss_1: 5.605841636657715 (31.84762756641094) | > grad_norm_1: tensor(15739.2891, device='cuda:0') (tensor(21022.5078, device='cuda:0')) | > current_lr_0: 9.418588222479522e-05 | > current_lr_1: 9.418588222479522e-05 | > step_time: 0.5929 (0.5882319914988983) | > loader_time: 0.0264 (0.023609259189703528)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.381107807159424 (2.381107807159424) | > loss_disc_real_0: 0.30695587396621704 (0.30695587396621704) | > loss_disc_real_1: 0.23827621340751648 (0.23827621340751648) | > loss_disc_real_2: 0.16524943709373474 (0.16524943709373474) | > loss_disc_real_3: 0.1830977201461792 (0.1830977201461792) | > loss_disc_real_4: 0.21483704447746277 (0.21483704447746277) | > loss_disc_real_5: 0.30547699332237244 (0.30547699332237244) | > loss_0: 2.381107807159424 (2.381107807159424) | > loss_gen: 2.6652421951293945 (2.6652421951293945) | > loss_kl: 4.252577304840088 (4.252577304840088) | > loss_feat: 5.089017391204834 (5.089017391204834) | > loss_mel: 25.98386573791504 (25.98386573791504) | > loss_duration: 2.7846264839172363 (2.7846264839172363) | > loss_1: 40.77532958984375 (40.77532958984375)  --> STEP: 1 | > loss_disc: 2.7378764152526855 (2.7378764152526855) | > loss_disc_real_0: 0.264542818069458 (0.264542818069458) | > loss_disc_real_1: 0.23764541745185852 (0.23764541745185852) | > loss_disc_real_2: 0.17431305348873138 (0.17431305348873138) | > loss_disc_real_3: 0.2974197566509247 (0.2974197566509247) | > loss_disc_real_4: 0.4091265797615051 (0.4091265797615051) | > loss_disc_real_5: 0.27940699458122253 (0.27940699458122253) | > loss_0: 2.7378764152526855 (2.7378764152526855) | > loss_gen: 2.3927268981933594 (2.3927268981933594) | > loss_kl: 4.70233154296875 (4.70233154296875) | > loss_feat: 6.063689708709717 (6.063689708709717) | > loss_mel: 25.93105697631836 (25.93105697631836) | > loss_duration: 3.1631884574890137 (3.1631884574890137) | > loss_1: 42.252994537353516 (42.252994537353516)  --> STEP: 2 | > loss_disc: 1.5229923725128174 (2.1304343938827515) | > loss_disc_real_0: 0.042076077312231064 (0.15330944769084454) | > loss_disc_real_1: 0.154062882065773 (0.19585414975881577) | > loss_disc_real_2: 0.07597760111093521 (0.1251453272998333) | > loss_disc_real_3: 0.015632182359695435 (0.15652596950531006) | > loss_disc_real_4: 0.08820211887359619 (0.24866434931755066) | > loss_disc_real_5: 0.09597238898277283 (0.18768969178199768) | > loss_0: 1.5229923725128174 (2.1304343938827515) | > loss_gen: 4.831642150878906 (3.612184524536133) | > loss_kl: 6.409210681915283 (5.555771112442017) | > loss_feat: 18.513078689575195 (12.288384199142456) | > loss_mel: 24.659765243530273 (25.295411109924316) | > loss_duration: 3.029827117919922 (3.0965077877044678) | > loss_1: 57.44352340698242 (49.84825897216797)  --> STEP: 3 | > loss_disc: 3.072148561477661 (2.444339116414388) | > loss_disc_real_0: 0.24701905250549316 (0.18454598262906075) | > loss_disc_real_1: 0.62579745054245 (0.3391685833533605) | > loss_disc_real_2: 0.4035296142101288 (0.21794008960326514) | > loss_disc_real_3: 0.32368776202201843 (0.21224656701087952) | > loss_disc_real_4: 0.36144620180130005 (0.2862583001454671) | > loss_disc_real_5: 0.32685407996177673 (0.23407782117525736) | > loss_0: 3.072148561477661 (2.444339116414388) | > loss_gen: 3.5796990394592285 (3.601356029510498) | > loss_kl: 2.3287241458892822 (4.4800887902577715) | > loss_feat: 6.4324951171875 (10.336421171824137) | > loss_mel: 24.138038635253906 (24.90962028503418) | > loss_duration: 2.835707426071167 (3.0095743338267007) | > loss_1: 39.314666748046875 (46.3370615641276) --> EVAL PERFORMANCE | > avg_loader_time: 0.013135592142740885 (+0.0019409656524658203) | > avg_loss_disc: 2.444339116414388 (-0.1987084547678628) | > avg_loss_disc_real_0: 0.18454598262906075 (-0.005250343432029098) | > avg_loss_disc_real_1: 0.3391685833533605 (+0.14219724138577777) | > avg_loss_disc_real_2: 0.21794008960326514 (+0.009177781641483307) | > avg_loss_disc_real_3: 0.21224656701087952 (-0.011133934060732514) | > avg_loss_disc_real_4: 0.2862583001454671 (-0.0674188335736593) | > avg_loss_disc_real_5: 0.23407782117525736 (-0.09406609336535135) | > avg_loss_0: 2.444339116414388 (-0.1987084547678628) | > avg_loss_gen: 3.601356029510498 (+1.2496780157089233) | > avg_loss_kl: 4.4800887902577715 (+0.11413701375325491) | > avg_loss_feat: 10.336421171824137 (+5.695771604776382) | > avg_loss_mel: 24.90962028503418 (+5.967105388641357) | > avg_loss_duration: 3.0095743338267007 (+0.03356591860453273) | > avg_loss_1: 46.3370615641276 (+13.060260772705078)  > EPOCH: 754/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:43:48)   --> TIME: 2023-10-20 08:44:02 -- STEP: 19/50 -- GLOBAL_STEP: 90720 | > loss_disc: 1.7379436492919922 (2.2889312568463778) | > loss_disc_real_0: 0.07054375112056732 (0.12651679811901168) | > loss_disc_real_1: 0.0733000710606575 (0.2344028426236228) | > loss_disc_real_2: 0.1347675919532776 (0.2150691179068465) | > loss_disc_real_3: 0.12041433900594711 (0.2099225289727512) | > loss_disc_real_4: 0.06266139447689056 (0.21078041470364517) | > loss_disc_real_5: 0.03705983608961105 (0.21137476712465286) | > loss_0: 1.7379436492919922 (2.2889312568463778) | > grad_norm_0: tensor(702.4543, device='cuda:0') (tensor(626.7063, device='cuda:0')) | > loss_gen: 2.6237690448760986 (2.5001507934771086) | > loss_kl: 1.124261736869812 (0.8634987661713048) | > loss_feat: 12.149535179138184 (6.636055103258083) | > loss_mel: 25.921863555908203 (23.156867504119873) | > loss_duration: 1.467657208442688 (1.44503054493352) | > loss_1: 43.287086486816406 (34.601603056255136) | > grad_norm_1: tensor(56721.4688, device='cuda:0') (tensor(28657.1250, device='cuda:0')) | > current_lr_0: 9.40917375385939e-05 | > current_lr_1: 9.40917375385939e-05 | > step_time: 0.2678 (0.4238465083272834) | > loader_time: 0.0034 (0.011556537527787056)  --> TIME: 2023-10-20 08:44:20 -- STEP: 49/50 -- GLOBAL_STEP: 90750 | > loss_disc: 2.792344808578491 (2.468379173960004) | > loss_disc_real_0: 0.15279161930084229 (0.14865552672013946) | > loss_disc_real_1: 0.3102649748325348 (0.23686398976311393) | > loss_disc_real_2: 0.21009360253810883 (0.22606617774890395) | > loss_disc_real_3: 0.20782510936260223 (0.23447739435549902) | > loss_disc_real_4: 0.16681835055351257 (0.22654909001929419) | > loss_disc_real_5: 0.15354284644126892 (0.23323540568199694) | > loss_0: 2.792344808578491 (2.468379173960004) | > grad_norm_0: tensor(757.6117, device='cuda:0') (tensor(774.9806, device='cuda:0')) | > loss_gen: 1.9535138607025146 (2.3458539515125514) | > loss_kl: 0.6017774343490601 (0.7986887054783958) | > loss_feat: 5.814306259155273 (5.480222808463233) | > loss_mel: 23.442729949951172 (21.049338189923034) | > loss_duration: 1.5428566932678223 (1.4032169069562639) | > loss_1: 33.355186462402344 (31.077320799535638) | > grad_norm_1: tensor(15937.0352, device='cuda:0') (tensor(21191.8613, device='cuda:0')) | > current_lr_0: 9.40917375385939e-05 | > current_lr_1: 9.40917375385939e-05 | > step_time: 0.7756 (0.52936171025646) | > loader_time: 0.3965 (0.020569027686605647)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4704654216766357 (2.4704654216766357) | > loss_disc_real_0: 0.22191335260868073 (0.22191335260868073) | > loss_disc_real_1: 0.18780747056007385 (0.18780747056007385) | > loss_disc_real_2: 0.3519854247570038 (0.3519854247570038) | > loss_disc_real_3: 0.25626447796821594 (0.25626447796821594) | > loss_disc_real_4: 0.30392545461654663 (0.30392545461654663) | > loss_disc_real_5: 0.30241480469703674 (0.30241480469703674) | > loss_0: 2.4704654216766357 (2.4704654216766357) | > loss_gen: 2.98531174659729 (2.98531174659729) | > loss_kl: 7.4599432945251465 (7.4599432945251465) | > loss_feat: 7.582539081573486 (7.582539081573486) | > loss_mel: 22.147708892822266 (22.147708892822266) | > loss_duration: 3.0791215896606445 (3.0791215896606445) | > loss_1: 43.2546272277832 (43.2546272277832)  --> STEP: 1 | > loss_disc: 1.9037840366363525 (1.9037840366363525) | > loss_disc_real_0: 0.06972634047269821 (0.06972634047269821) | > loss_disc_real_1: 0.21856723725795746 (0.21856723725795746) | > loss_disc_real_2: 0.17912068963050842 (0.17912068963050842) | > loss_disc_real_3: 0.17724110186100006 (0.17724110186100006) | > loss_disc_real_4: 0.13153105974197388 (0.13153105974197388) | > loss_disc_real_5: 0.1988895833492279 (0.1988895833492279) | > loss_0: 1.9037840366363525 (1.9037840366363525) | > loss_gen: 2.4668312072753906 (2.4668312072753906) | > loss_kl: 4.776434898376465 (4.776434898376465) | > loss_feat: 7.767764091491699 (7.767764091491699) | > loss_mel: 21.96302604675293 (21.96302604675293) | > loss_duration: 3.148611068725586 (3.148611068725586) | > loss_1: 40.12266540527344 (40.12266540527344)  --> STEP: 2 | > loss_disc: 2.7165377140045166 (2.3101608753204346) | > loss_disc_real_0: 0.2971477508544922 (0.1834370456635952) | > loss_disc_real_1: 0.1918983906507492 (0.20523281395435333) | > loss_disc_real_2: 0.34819748997688293 (0.2636590898036957) | > loss_disc_real_3: 0.3484587073326111 (0.2628499045968056) | > loss_disc_real_4: 0.28126251697540283 (0.20639678835868835) | > loss_disc_real_5: 0.18096022307872772 (0.1899249032139778) | > loss_0: 2.7165377140045166 (2.3101608753204346) | > loss_gen: 2.657050132751465 (2.5619406700134277) | > loss_kl: 5.057339191436768 (4.916887044906616) | > loss_feat: 5.513774394989014 (6.6407692432403564) | > loss_mel: 26.892780303955078 (24.427903175354004) | > loss_duration: 3.143104314804077 (3.1458576917648315) | > loss_1: 43.2640495300293 (41.69335746765137)  --> STEP: 3 | > loss_disc: 2.8698360919952393 (2.4967192808787027) | > loss_disc_real_0: 0.24769523739814758 (0.20485644290844598) | > loss_disc_real_1: 0.29591405391693115 (0.23545989394187927) | > loss_disc_real_2: 0.3916845917701721 (0.3063342571258545) | > loss_disc_real_3: 0.303164005279541 (0.2762879381577174) | > loss_disc_real_4: 0.38117730617523193 (0.2646569609642029) | > loss_disc_real_5: 0.3464755415916443 (0.24210844933986664) | > loss_0: 2.8698360919952393 (2.4967192808787027) | > loss_gen: 2.5605993270874023 (2.5614935557047525) | > loss_kl: 2.450126886367798 (4.09463365872701) | > loss_feat: 3.2472667694091797 (5.509601751963298) | > loss_mel: 21.648517608642578 (23.501441319783527) | > loss_duration: 2.938826560974121 (3.0768473148345947) | > loss_1: 32.8453369140625 (38.74401728312174) --> EVAL PERFORMANCE | > avg_loader_time: 0.024208943049112957 (+0.011073350906372072) | > avg_loss_disc: 2.4967192808787027 (+0.05238016446431448) | > avg_loss_disc_real_0: 0.20485644290844598 (+0.02031046027938524) | > avg_loss_disc_real_1: 0.23545989394187927 (-0.1037086894114812) | > avg_loss_disc_real_2: 0.3063342571258545 (+0.08839416752258936) | > avg_loss_disc_real_3: 0.2762879381577174 (+0.06404137114683789) | > avg_loss_disc_real_4: 0.2646569609642029 (-0.021601339181264223) | > avg_loss_disc_real_5: 0.24210844933986664 (+0.008030628164609283) | > avg_loss_0: 2.4967192808787027 (+0.05238016446431448) | > avg_loss_gen: 2.5614935557047525 (-1.0398624738057456) | > avg_loss_kl: 4.09463365872701 (-0.3854551315307617) | > avg_loss_feat: 5.509601751963298 (-4.826819419860839) | > avg_loss_mel: 23.501441319783527 (-1.4081789652506522) | > avg_loss_duration: 3.0768473148345947 (+0.06727298100789403) | > avg_loss_1: 38.74401728312174 (-7.593044281005859)  > EPOCH: 755/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:44:36)   --> TIME: 2023-10-20 08:45:00 -- STEP: 29/50 -- GLOBAL_STEP: 90780 | > loss_disc: 2.9509217739105225 (2.4084106190451267) | > loss_disc_real_0: 0.17785300314426422 (0.14193062041083288) | > loss_disc_real_1: 0.24711164832115173 (0.226393043737987) | > loss_disc_real_2: 0.2674074172973633 (0.22893417498161053) | > loss_disc_real_3: 0.2519630789756775 (0.2565995757949762) | > loss_disc_real_4: 0.27940982580184937 (0.22455795918559207) | > loss_disc_real_5: 0.2643529176712036 (0.21845078853697614) | > loss_0: 2.9509217739105225 (2.4084106190451267) | > grad_norm_0: tensor(454.5370, device='cuda:0') (tensor(538.7696, device='cuda:0')) | > loss_gen: 1.5782612562179565 (2.380519542200812) | > loss_kl: 0.5207812786102295 (0.8904363173862984) | > loss_feat: 0.21265245974063873 (5.898470977770871) | > loss_mel: 10.590272903442383 (22.470238521181304) | > loss_duration: 1.384881615638733 (1.4096615602230202) | > loss_1: 14.286849975585938 (33.049327126864725) | > grad_norm_1: tensor(7520.1064, device='cuda:0') (tensor(22129.1973, device='cuda:0')) | > current_lr_0: 9.399768695590078e-05 | > current_lr_1: 9.399768695590078e-05 | > step_time: 0.725 (0.6322371795259671) | > loader_time: 0.0359 (0.02459262157308644)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6161322593688965 (2.6161322593688965) | > loss_disc_real_0: 0.14812856912612915 (0.14812856912612915) | > loss_disc_real_1: 0.1539529412984848 (0.1539529412984848) | > loss_disc_real_2: 0.22796531021595 (0.22796531021595) | > loss_disc_real_3: 0.25507596135139465 (0.25507596135139465) | > loss_disc_real_4: 0.23601391911506653 (0.23601391911506653) | > loss_disc_real_5: 0.2557102143764496 (0.2557102143764496) | > loss_0: 2.6161322593688965 (2.6161322593688965) | > loss_gen: 1.779430866241455 (1.779430866241455) | > loss_kl: 5.416021823883057 (5.416021823883057) | > loss_feat: 5.044075965881348 (5.044075965881348) | > loss_mel: 17.212053298950195 (17.212053298950195) | > loss_duration: 2.8708877563476562 (2.8708877563476562) | > loss_1: 32.322471618652344 (32.322471618652344)  --> STEP: 1 | > loss_disc: 2.2660930156707764 (2.2660930156707764) | > loss_disc_real_0: 0.15101419389247894 (0.15101419389247894) | > loss_disc_real_1: 0.17224662005901337 (0.17224662005901337) | > loss_disc_real_2: 0.22541020810604095 (0.22541020810604095) | > loss_disc_real_3: 0.17789486050605774 (0.17789486050605774) | > loss_disc_real_4: 0.2888895273208618 (0.2888895273208618) | > loss_disc_real_5: 0.2085265815258026 (0.2085265815258026) | > loss_0: 2.2660930156707764 (2.2660930156707764) | > loss_gen: 2.2480738162994385 (2.2480738162994385) | > loss_kl: 4.98002290725708 (4.98002290725708) | > loss_feat: 5.303019046783447 (5.303019046783447) | > loss_mel: 19.165985107421875 (19.165985107421875) | > loss_duration: 3.1834352016448975 (3.1834352016448975) | > loss_1: 34.88053512573242 (34.88053512573242)  --> STEP: 2 | > loss_disc: 3.095977306365967 (2.6810351610183716) | > loss_disc_real_0: 0.25987252593040466 (0.2054433599114418) | > loss_disc_real_1: 0.26836904883384705 (0.2203078344464302) | > loss_disc_real_2: 0.3287973701953888 (0.2771037891507149) | > loss_disc_real_3: 0.2714160084724426 (0.22465543448925018) | > loss_disc_real_4: 0.3796027600765228 (0.3342461436986923) | > loss_disc_real_5: 0.42111772298812866 (0.31482215225696564) | > loss_0: 3.095977306365967 (2.6810351610183716) | > loss_gen: 2.062974691390991 (2.155524253845215) | > loss_kl: 5.501650333404541 (5.2408366203308105) | > loss_feat: 2.8768792152404785 (4.089949131011963) | > loss_mel: 25.55693817138672 (22.361461639404297) | > loss_duration: 3.0556631088256836 (3.1195491552352905) | > loss_1: 39.05410385131836 (36.96731948852539)  --> STEP: 3 | > loss_disc: 2.9588255882263184 (2.773631970087687) | > loss_disc_real_0: 0.2961060404777527 (0.23566425343354544) | > loss_disc_real_1: 0.23467722535133362 (0.22509763141473135) | > loss_disc_real_2: 0.2795833647251129 (0.2779303143421809) | > loss_disc_real_3: 0.24906162917613983 (0.2327908327182134) | > loss_disc_real_4: 0.2780003547668457 (0.3154975473880768) | > loss_disc_real_5: 0.287406861782074 (0.3056837220986684) | > loss_0: 2.9588255882263184 (2.773631970087687) | > loss_gen: 1.688703179359436 (1.9999172290166218) | > loss_kl: 2.496368169784546 (4.326013803482056) | > loss_feat: 0.14773176610469818 (2.775876676042875) | > loss_mel: 2.544637680053711 (15.755853652954102) | > loss_duration: 3.007112503051758 (3.082070271174113) | > loss_1: 9.884553909301758 (27.939730962117512) --> EVAL PERFORMANCE | > avg_loader_time: 0.01880621910095215 (-0.0054027239481608084) | > avg_loss_disc: 2.773631970087687 (+0.2769126892089844) | > avg_loss_disc_real_0: 0.23566425343354544 (+0.030807810525099455) | > avg_loss_disc_real_1: 0.22509763141473135 (-0.01036226252714792) | > avg_loss_disc_real_2: 0.2779303143421809 (-0.028403942783673586) | > avg_loss_disc_real_3: 0.2327908327182134 (-0.043497105439504) | > avg_loss_disc_real_4: 0.3154975473880768 (+0.0508405864238739) | > avg_loss_disc_real_5: 0.3056837220986684 (+0.06357527275880176) | > avg_loss_0: 2.773631970087687 (+0.2769126892089844) | > avg_loss_gen: 1.9999172290166218 (-0.5615763266881306) | > avg_loss_kl: 4.326013803482056 (+0.23138014475504587) | > avg_loss_feat: 2.775876676042875 (-2.733725075920423) | > avg_loss_mel: 15.755853652954102 (-7.745587666829426) | > avg_loss_duration: 3.082070271174113 (+0.005222956339518081) | > avg_loss_1: 27.939730962117512 (-10.80428632100423)  > EPOCH: 756/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:45:26)   --> TIME: 2023-10-20 08:45:47 -- STEP: 9/50 -- GLOBAL_STEP: 90810 | > loss_disc: 1.885472059249878 (2.2309615744484796) | > loss_disc_real_0: 0.030193151906132698 (0.12210418801340792) | > loss_disc_real_1: 0.20481285452842712 (0.1640160261756844) | > loss_disc_real_2: 0.23747216165065765 (0.19905609140793482) | > loss_disc_real_3: 0.24003176391124725 (0.23105054017570284) | > loss_disc_real_4: 0.21569055318832397 (0.20570927589303917) | > loss_disc_real_5: 0.19112756848335266 (0.2227107762462563) | > loss_0: 1.885472059249878 (2.2309615744484796) | > grad_norm_0: tensor(220.5970, device='cuda:0') (tensor(428.7243, device='cuda:0')) | > loss_gen: 2.8412022590637207 (2.5117682351006403) | > loss_kl: 0.9793208837509155 (1.0064841939343347) | > loss_feat: 6.745238304138184 (7.485406769646539) | > loss_mel: 19.923473358154297 (23.246049245198567) | > loss_duration: 1.304244041442871 (1.400807499885559) | > loss_1: 31.793479919433594 (35.65051523844401) | > grad_norm_1: tensor(5149.1963, device='cuda:0') (tensor(21010.4434, device='cuda:0')) | > current_lr_0: 9.390373038265349e-05 | > current_lr_1: 9.390373038265349e-05 | > step_time: 0.6022 (0.7128578027089437) | > loader_time: 0.0023 (0.02271376715766059)  --> TIME: 2023-10-20 08:46:07 -- STEP: 39/50 -- GLOBAL_STEP: 90840 | > loss_disc: 2.457935333251953 (2.375366492149158) | > loss_disc_real_0: 0.09920713305473328 (0.1364034414768983) | > loss_disc_real_1: 0.18944773077964783 (0.2195163786602326) | > loss_disc_real_2: 0.22543612122535706 (0.23379764056358582) | > loss_disc_real_3: 0.2121979147195816 (0.22479275575815102) | > loss_disc_real_4: 0.30705684423446655 (0.22398285044787022) | > loss_disc_real_5: 0.33044350147247314 (0.22073553001078275) | > loss_0: 2.457935333251953 (2.375366492149158) | > grad_norm_0: tensor(605.6614, device='cuda:0') (tensor(559.0931, device='cuda:0')) | > loss_gen: 2.156031608581543 (2.412616717509735) | > loss_kl: 0.6288806200027466 (0.9052073917327783) | > loss_feat: 2.5959572792053223 (6.391666939052252) | > loss_mel: 21.888967514038086 (22.775081096551354) | > loss_duration: 1.4080631732940674 (1.4016929712050998) | > loss_1: 28.677900314331055 (33.88626455649353) | > grad_norm_1: tensor(8249.6973, device='cuda:0') (tensor(18329.4180, device='cuda:0')) | > current_lr_0: 9.390373038265349e-05 | > current_lr_1: 9.390373038265349e-05 | > step_time: 0.6683 (0.6390848771119729) | > loader_time: 0.0354 (0.022078538552308694)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0525074005126953 (3.0525074005126953) | > loss_disc_real_0: 0.4137343764305115 (0.4137343764305115) | > loss_disc_real_1: 0.2750888168811798 (0.2750888168811798) | > loss_disc_real_2: 0.2739374339580536 (0.2739374339580536) | > loss_disc_real_3: 0.24967771768569946 (0.24967771768569946) | > loss_disc_real_4: 0.2397388070821762 (0.2397388070821762) | > loss_disc_real_5: 0.2537916898727417 (0.2537916898727417) | > loss_0: 3.0525074005126953 (3.0525074005126953) | > loss_gen: 1.6954336166381836 (1.6954336166381836) | > loss_kl: 5.14102840423584 (5.14102840423584) | > loss_feat: 0.1833612471818924 (0.1833612471818924) | > loss_mel: 2.401460886001587 (2.401460886001587) | > loss_duration: 2.9264748096466064 (2.9264748096466064) | > loss_1: 12.347758293151855 (12.347758293151855)  --> STEP: 1 | > loss_disc: 2.7326934337615967 (2.7326934337615967) | > loss_disc_real_0: 0.12734614312648773 (0.12734614312648773) | > loss_disc_real_1: 0.3485221266746521 (0.3485221266746521) | > loss_disc_real_2: 0.19136710464954376 (0.19136710464954376) | > loss_disc_real_3: 0.2995714247226715 (0.2995714247226715) | > loss_disc_real_4: 0.32950881123542786 (0.32950881123542786) | > loss_disc_real_5: 0.4368172287940979 (0.4368172287940979) | > loss_0: 2.7326934337615967 (2.7326934337615967) | > loss_gen: 2.4380922317504883 (2.4380922317504883) | > loss_kl: 5.2418084144592285 (5.2418084144592285) | > loss_feat: 5.674365520477295 (5.674365520477295) | > loss_mel: 26.71449089050293 (26.71449089050293) | > loss_duration: 3.2440619468688965 (3.2440619468688965) | > loss_1: 43.31281661987305 (43.31281661987305)  --> STEP: 2 | > loss_disc: 2.733863353729248 (2.7332783937454224) | > loss_disc_real_0: 0.15642093122005463 (0.14188353717327118) | > loss_disc_real_1: 0.46933627128601074 (0.4089291989803314) | > loss_disc_real_2: 0.32988160848617554 (0.26062435656785965) | > loss_disc_real_3: 0.278469979763031 (0.28902070224285126) | > loss_disc_real_4: 0.3455151617527008 (0.33751198649406433) | > loss_disc_real_5: 0.370002806186676 (0.40341001749038696) | > loss_0: 2.733863353729248 (2.7332783937454224) | > loss_gen: 3.3457956314086914 (2.89194393157959) | > loss_kl: 4.831279277801514 (5.036543846130371) | > loss_feat: 6.203890800476074 (5.939128160476685) | > loss_mel: 27.408170700073242 (27.061330795288086) | > loss_duration: 2.9573240280151367 (3.1006929874420166) | > loss_1: 44.7464599609375 (44.02963829040527)  --> STEP: 3 | > loss_disc: 2.9220829010009766 (2.796213229497274) | > loss_disc_real_0: 0.27270421385765076 (0.1854904294013977) | > loss_disc_real_1: 0.275854229927063 (0.36457087596257526) | > loss_disc_real_2: 0.2844853699207306 (0.2685780276854833) | > loss_disc_real_3: 0.2591588795185089 (0.2790667613347371) | > loss_disc_real_4: 0.23157821595668793 (0.3022007296482722) | > loss_disc_real_5: 0.25992339849472046 (0.3555811444918315) | > loss_0: 2.9220829010009766 (2.796213229497274) | > loss_gen: 1.736873984336853 (2.5069206158320108) | > loss_kl: 2.2976455688476562 (4.1235777537028) | > loss_feat: 0.5914316773414612 (4.156562666098277) | > loss_mel: 12.853541374206543 (22.325400988260906) | > loss_duration: 3.003729820251465 (3.0683719317118325) | > loss_1: 20.48322296142578 (36.180833180745445) --> EVAL PERFORMANCE | > avg_loader_time: 0.03393220901489258 (+0.01512598991394043) | > avg_loss_disc: 2.796213229497274 (+0.022581259409586885) | > avg_loss_disc_real_0: 0.1854904294013977 (-0.050173824032147735) | > avg_loss_disc_real_1: 0.36457087596257526 (+0.1394732445478439) | > avg_loss_disc_real_2: 0.2685780276854833 (-0.009352286656697628) | > avg_loss_disc_real_3: 0.2790667613347371 (+0.046275928616523715) | > avg_loss_disc_real_4: 0.3022007296482722 (-0.013296817739804567) | > avg_loss_disc_real_5: 0.3555811444918315 (+0.04989742239316308) | > avg_loss_0: 2.796213229497274 (+0.022581259409586885) | > avg_loss_gen: 2.5069206158320108 (+0.5070033868153889) | > avg_loss_kl: 4.1235777537028 (-0.2024360497792559) | > avg_loss_feat: 4.156562666098277 (+1.3806859900554023) | > avg_loss_mel: 22.325400988260906 (+6.569547335306805) | > avg_loss_duration: 3.0683719317118325 (-0.013698339462280273) | > avg_loss_1: 36.180833180745445 (+8.241102218627933)  > EPOCH: 757/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:46:32)   --> TIME: 2023-10-20 08:46:48 -- STEP: 19/50 -- GLOBAL_STEP: 90870 | > loss_disc: 2.703850030899048 (2.3509113286670886) | > loss_disc_real_0: 0.1569819450378418 (0.17888366372177475) | > loss_disc_real_1: 0.27172064781188965 (0.24668756421459348) | > loss_disc_real_2: 0.23432092368602753 (0.22675532181012004) | > loss_disc_real_3: 0.24250827729701996 (0.23596406669208878) | > loss_disc_real_4: 0.23634974658489227 (0.19717937134402364) | > loss_disc_real_5: 0.2564230263233185 (0.23646296227448865) | > loss_0: 2.703850030899048 (2.3509113286670886) | > grad_norm_0: tensor(1591.1031, device='cuda:0') (tensor(747.4081, device='cuda:0')) | > loss_gen: 1.9183197021484375 (2.4560051717256246) | > loss_kl: 0.898941695690155 (0.9302858051500822) | > loss_feat: 1.3678357601165771 (6.112330467293137) | > loss_mel: 19.000858306884766 (20.49722068560751) | > loss_duration: 1.5372878313064575 (1.4466181868001033) | > loss_1: 24.723243713378906 (31.4424604867634) | > grad_norm_1: tensor(3392.4548, device='cuda:0') (tensor(23298.9941, device='cuda:0')) | > current_lr_0: 9.380986772488372e-05 | > current_lr_1: 9.380986772488372e-05 | > step_time: 0.796 (0.5139295176455849) | > loader_time: 0.0336 (0.0124810118424265)  --> TIME: 2023-10-20 08:47:08 -- STEP: 49/50 -- GLOBAL_STEP: 90900 | > loss_disc: 2.210439443588257 (2.311287751003188) | > loss_disc_real_0: 0.044430047273635864 (0.14576133012733597) | > loss_disc_real_1: 0.1593531370162964 (0.23035218228338936) | > loss_disc_real_2: 0.1347971260547638 (0.22134955466857978) | > loss_disc_real_3: 0.20820197463035583 (0.21217935106584004) | > loss_disc_real_4: 0.12500056624412537 (0.2044173256893243) | > loss_disc_real_5: 0.3554656207561493 (0.22281935757824353) | > loss_0: 2.210439443588257 (2.311287751003188) | > grad_norm_0: tensor(721.3372, device='cuda:0') (tensor(649.4983, device='cuda:0')) | > loss_gen: 2.339179277420044 (2.4215076067009744) | > loss_kl: 0.9568530321121216 (0.8777969175455521) | > loss_feat: 5.28797721862793 (6.308654322003831) | > loss_mel: 25.211549758911133 (21.01601710368177) | > loss_duration: 1.5545932054519653 (1.4024198444522158) | > loss_1: 35.35015106201172 (32.02639557390796) | > grad_norm_1: tensor(20571.1895, device='cuda:0') (tensor(20555.8926, device='cuda:0')) | > current_lr_0: 9.380986772488372e-05 | > current_lr_1: 9.380986772488372e-05 | > step_time: 0.6978 (0.5821502208709717) | > loader_time: 0.4206 (0.024813107081821988)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.794631242752075 (2.794631242752075) | > loss_disc_real_0: 0.3025569021701813 (0.3025569021701813) | > loss_disc_real_1: 0.27283328771591187 (0.27283328771591187) | > loss_disc_real_2: 0.2811164855957031 (0.2811164855957031) | > loss_disc_real_3: 0.34109261631965637 (0.34109261631965637) | > loss_disc_real_4: 0.34227120876312256 (0.34227120876312256) | > loss_disc_real_5: 0.2732786238193512 (0.2732786238193512) | > loss_0: 2.794631242752075 (2.794631242752075) | > loss_gen: 2.5946028232574463 (2.5946028232574463) | > loss_kl: 5.450952529907227 (5.450952529907227) | > loss_feat: 4.820714950561523 (4.820714950561523) | > loss_mel: 22.73444366455078 (22.73444366455078) | > loss_duration: 2.8733832836151123 (2.8733832836151123) | > loss_1: 38.474098205566406 (38.474098205566406)  --> STEP: 1 | > loss_disc: 2.3622379302978516 (2.3622379302978516) | > loss_disc_real_0: 0.1229204386472702 (0.1229204386472702) | > loss_disc_real_1: 0.1709355115890503 (0.1709355115890503) | > loss_disc_real_2: 0.14453719556331635 (0.14453719556331635) | > loss_disc_real_3: 0.3343939185142517 (0.3343939185142517) | > loss_disc_real_4: 0.11836190521717072 (0.11836190521717072) | > loss_disc_real_5: 0.36981645226478577 (0.36981645226478577) | > loss_0: 2.3622379302978516 (2.3622379302978516) | > loss_gen: 2.5872464179992676 (2.5872464179992676) | > loss_kl: 4.896303176879883 (4.896303176879883) | > loss_feat: 7.316525936126709 (7.316525936126709) | > loss_mel: 26.088804244995117 (26.088804244995117) | > loss_duration: 3.1875977516174316 (3.1875977516174316) | > loss_1: 44.076480865478516 (44.076480865478516)  --> STEP: 2 | > loss_disc: 2.9911892414093018 (2.6767135858535767) | > loss_disc_real_0: 0.29905739426612854 (0.21098891645669937) | > loss_disc_real_1: 0.2741912603378296 (0.22256338596343994) | > loss_disc_real_2: 0.23038972914218903 (0.18746346235275269) | > loss_disc_real_3: 0.2573454678058624 (0.29586969316005707) | > loss_disc_real_4: 0.2878800332546234 (0.20312096923589706) | > loss_disc_real_5: 0.2735753655433655 (0.3216959089040756) | > loss_0: 2.9911892414093018 (2.6767135858535767) | > loss_gen: 1.6467177867889404 (2.116982102394104) | > loss_kl: 5.2723212242126465 (5.084312200546265) | > loss_feat: 0.058284953236579895 (3.6874054446816444) | > loss_mel: 6.531162738800049 (16.309983491897583) | > loss_duration: 2.9559717178344727 (3.071784734725952) | > loss_1: 16.464458465576172 (30.270469665527344)  --> STEP: 3 | > loss_disc: 2.907559394836426 (2.75366218884786) | > loss_disc_real_0: 0.18925420939922333 (0.20374401410420737) | > loss_disc_real_1: 0.2989358901977539 (0.24802088737487793) | > loss_disc_real_2: 0.23673555254936218 (0.20388749241828918) | > loss_disc_real_3: 0.26442164182662964 (0.2853870093822479) | > loss_disc_real_4: 0.2875995635986328 (0.2312805006901423) | > loss_disc_real_5: 0.2743522524833679 (0.30591469009717304) | > loss_0: 2.907559394836426 (2.75366218884786) | > loss_gen: 1.6673530340194702 (1.967105746269226) | > loss_kl: 2.1544394493103027 (4.107687950134277) | > loss_feat: 0.44247475266456604 (2.6057618806759515) | > loss_mel: 15.691240310668945 (16.10373576482137) | > loss_duration: 2.9120566844940186 (3.0185420513153076) | > loss_1: 22.867563247680664 (27.802834192911785) --> EVAL PERFORMANCE | > avg_loader_time: 0.00973836580912272 (-0.02419384320576986) | > avg_loss_disc: 2.75366218884786 (-0.04255104064941406) | > avg_loss_disc_real_0: 0.20374401410420737 (+0.01825358470280966) | > avg_loss_disc_real_1: 0.24802088737487793 (-0.11654998858769733) | > avg_loss_disc_real_2: 0.20388749241828918 (-0.0646905352671941) | > avg_loss_disc_real_3: 0.2853870093822479 (+0.006320248047510801) | > avg_loss_disc_real_4: 0.2312805006901423 (-0.07092022895812991) | > avg_loss_disc_real_5: 0.30591469009717304 (-0.049666454394658444) | > avg_loss_0: 2.75366218884786 (-0.04255104064941406) | > avg_loss_gen: 1.967105746269226 (-0.5398148695627847) | > avg_loss_kl: 4.107687950134277 (-0.01588980356852243) | > avg_loss_feat: 2.6057618806759515 (-1.5508007854223256) | > avg_loss_mel: 16.10373576482137 (-6.221665223439537) | > avg_loss_duration: 3.0185420513153076 (-0.04982988039652492) | > avg_loss_1: 27.802834192911785 (-8.37799898783366)  > EPOCH: 758/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:47:26)   --> TIME: 2023-10-20 08:47:52 -- STEP: 29/50 -- GLOBAL_STEP: 90930 | > loss_disc: 3.092736005783081 (2.3742486567332826) | > loss_disc_real_0: 0.1618930995464325 (0.16165082490649715) | > loss_disc_real_1: 0.24394731223583221 (0.20876993881217365) | > loss_disc_real_2: 0.2698390781879425 (0.2140781190888635) | > loss_disc_real_3: 0.293375164270401 (0.2401546517322804) | > loss_disc_real_4: 0.30447566509246826 (0.22117860223455676) | > loss_disc_real_5: 0.25663861632347107 (0.2307332774367312) | > loss_0: 3.092736005783081 (2.3742486567332826) | > grad_norm_0: tensor(4839.2295, device='cuda:0') (tensor(866.5679, device='cuda:0')) | > loss_gen: 1.529961347579956 (2.4651723812366355) | > loss_kl: 0.8321922421455383 (0.7819225420725757) | > loss_feat: 0.16456422209739685 (6.781412145957865) | > loss_mel: 11.152584075927734 (21.807725014357732) | > loss_duration: 1.3756458759307861 (1.4039441182695587) | > loss_1: 15.054947853088379 (33.2401762008667) | > grad_norm_1: tensor(11960.4219, device='cuda:0') (tensor(24976.7461, device='cuda:0')) | > current_lr_0: 9.371609888871709e-05 | > current_lr_1: 9.371609888871709e-05 | > step_time: 0.8012 (0.4919298846146156) | > loader_time: 0.0334 (0.01832268155854324)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.235290050506592 (3.235290050506592) | > loss_disc_real_0: 0.4586421251296997 (0.4586421251296997) | > loss_disc_real_1: 0.34664231538772583 (0.34664231538772583) | > loss_disc_real_2: 0.36659812927246094 (0.36659812927246094) | > loss_disc_real_3: 0.29787203669548035 (0.29787203669548035) | > loss_disc_real_4: 0.28363075852394104 (0.28363075852394104) | > loss_disc_real_5: 0.3135533332824707 (0.3135533332824707) | > loss_0: 3.235290050506592 (3.235290050506592) | > loss_gen: 2.2159359455108643 (2.2159359455108643) | > loss_kl: 5.394889831542969 (5.394889831542969) | > loss_feat: 4.202780723571777 (4.202780723571777) | > loss_mel: 21.261728286743164 (21.261728286743164) | > loss_duration: 3.020937204360962 (3.020937204360962) | > loss_1: 36.09627151489258 (36.09627151489258)  --> STEP: 1 | > loss_disc: 2.8424386978149414 (2.8424386978149414) | > loss_disc_real_0: 0.2100462168455124 (0.2100462168455124) | > loss_disc_real_1: 0.31055039167404175 (0.31055039167404175) | > loss_disc_real_2: 0.22819171845912933 (0.22819171845912933) | > loss_disc_real_3: 0.32501062750816345 (0.32501062750816345) | > loss_disc_real_4: 0.3374408781528473 (0.3374408781528473) | > loss_disc_real_5: 0.34779560565948486 (0.34779560565948486) | > loss_0: 2.8424386978149414 (2.8424386978149414) | > loss_gen: 2.413031578063965 (2.413031578063965) | > loss_kl: 4.818292140960693 (4.818292140960693) | > loss_feat: 5.8620991706848145 (5.8620991706848145) | > loss_mel: 23.268190383911133 (23.268190383911133) | > loss_duration: 3.17918062210083 (3.17918062210083) | > loss_1: 39.540794372558594 (39.540794372558594)  --> STEP: 2 | > loss_disc: 3.033457040786743 (2.9379478693008423) | > loss_disc_real_0: 0.25611358880996704 (0.23307990282773972) | > loss_disc_real_1: 0.28979960083961487 (0.3001749962568283) | > loss_disc_real_2: 0.27913424372673035 (0.25366298109292984) | > loss_disc_real_3: 0.26014941930770874 (0.2925800234079361) | > loss_disc_real_4: 0.24243055284023285 (0.28993571549654007) | > loss_disc_real_5: 0.2355761080980301 (0.2916858568787575) | > loss_0: 3.033457040786743 (2.9379478693008423) | > loss_gen: 1.5354632139205933 (1.974247395992279) | > loss_kl: 4.801191329956055 (4.809741735458374) | > loss_feat: 0.06560923904180527 (2.96385420486331) | > loss_mel: 2.1163604259490967 (12.692275404930115) | > loss_duration: 3.091381549835205 (3.1352810859680176) | > loss_1: 11.610006332397461 (25.575400352478027)  --> STEP: 3 | > loss_disc: 2.2739741802215576 (2.716623306274414) | > loss_disc_real_0: 0.10066445171833038 (0.18894141912460327) | > loss_disc_real_1: 0.1483294665813446 (0.24955981969833374) | > loss_disc_real_2: 0.21133942902088165 (0.2395551304022471) | > loss_disc_real_3: 0.21305610239505768 (0.2660720497369766) | > loss_disc_real_4: 0.23718127608299255 (0.2723509023586909) | > loss_disc_real_5: 0.22031818330287933 (0.2678966323534648) | > loss_0: 2.2739741802215576 (2.716623306274414) | > loss_gen: 2.0938541889190674 (2.014116326967875) | > loss_kl: 2.1074790954589844 (3.908987522125244) | > loss_feat: 4.385987758636475 (3.4378987227876983) | > loss_mel: 19.76215171813965 (15.048900842666626) | > loss_duration: 2.9585986137390137 (3.0763869285583496) | > loss_1: 31.308073043823242 (27.486291249593098) --> EVAL PERFORMANCE | > avg_loader_time: 0.008772770563761393 (-0.0009655952453613281) | > avg_loss_disc: 2.716623306274414 (-0.037038882573445786) | > avg_loss_disc_real_0: 0.18894141912460327 (-0.014802594979604095) | > avg_loss_disc_real_1: 0.24955981969833374 (+0.0015389323234558105) | > avg_loss_disc_real_2: 0.2395551304022471 (+0.03566763798395792) | > avg_loss_disc_real_3: 0.2660720497369766 (-0.0193149596452713) | > avg_loss_disc_real_4: 0.2723509023586909 (+0.04107040166854861) | > avg_loss_disc_real_5: 0.2678966323534648 (-0.038018057743708256) | > avg_loss_0: 2.716623306274414 (-0.037038882573445786) | > avg_loss_gen: 2.014116326967875 (+0.04701058069864894) | > avg_loss_kl: 3.908987522125244 (-0.1987004280090332) | > avg_loss_feat: 3.4378987227876983 (+0.8321368421117468) | > avg_loss_mel: 15.048900842666626 (-1.0548349221547433) | > avg_loss_duration: 3.0763869285583496 (+0.05784487724304199) | > avg_loss_1: 27.486291249593098 (-0.31654294331868726)  > EPOCH: 759/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:48:16)   --> TIME: 2023-10-20 08:48:32 -- STEP: 9/50 -- GLOBAL_STEP: 90960 | > loss_disc: 2.6177284717559814 (2.5281021462546454) | > loss_disc_real_0: 0.053724758327007294 (0.14043577387928963) | > loss_disc_real_1: 0.2733667194843292 (0.22713164819611442) | > loss_disc_real_2: 0.3458658456802368 (0.243614309363895) | > loss_disc_real_3: 0.3187847435474396 (0.24792691568533579) | > loss_disc_real_4: 0.30108603835105896 (0.2275119630826844) | > loss_disc_real_5: 0.27626997232437134 (0.2019597300224834) | > loss_0: 2.6177284717559814 (2.5281021462546454) | > grad_norm_0: tensor(369.8700, device='cuda:0') (tensor(426.2223, device='cuda:0')) | > loss_gen: 2.356088638305664 (2.226606912083096) | > loss_kl: 0.37362056970596313 (0.7984972298145294) | > loss_feat: 4.270263671875 (5.39156490067641) | > loss_mel: 23.768714904785156 (16.41684679190318) | > loss_duration: 1.3465386629104614 (1.3767972787221272) | > loss_1: 32.11522674560547 (26.210313108232285) | > grad_norm_1: tensor(3881.5083, device='cuda:0') (tensor(29874.9961, device='cuda:0')) | > current_lr_0: 9.362242378037301e-05 | > current_lr_1: 9.362242378037301e-05 | > step_time: 0.5229 (0.6465907361772325) | > loader_time: 0.0156 (0.018459929360283747)  --> TIME: 2023-10-20 08:48:52 -- STEP: 39/50 -- GLOBAL_STEP: 90990 | > loss_disc: 3.1042513847351074 (2.4870196122389574) | > loss_disc_real_0: 0.43557974696159363 (0.14242248437725583) | > loss_disc_real_1: 0.24708382785320282 (0.23733683589559335) | > loss_disc_real_2: 0.26541879773139954 (0.2239383130501478) | > loss_disc_real_3: 0.30521607398986816 (0.2406832782121805) | > loss_disc_real_4: 0.30076515674591064 (0.22130397067238122) | > loss_disc_real_5: 0.3166895806789398 (0.21563370592701128) | > loss_0: 3.1042513847351074 (2.4870196122389574) | > grad_norm_0: tensor(1507.3773, device='cuda:0') (tensor(652.0767, device='cuda:0')) | > loss_gen: 1.7353417873382568 (2.2827608799323054) | > loss_kl: 0.4017125070095062 (0.7987594359960312) | > loss_feat: 0.8174417614936829 (5.146634046848003) | > loss_mel: 16.858129501342773 (19.43235879372328) | > loss_duration: 1.4832706451416016 (1.3949066278262017) | > loss_1: 21.295896530151367 (29.055419738476093) | > grad_norm_1: tensor(3114.1345, device='cuda:0') (tensor(22884.2754, device='cuda:0')) | > current_lr_0: 9.362242378037301e-05 | > current_lr_1: 9.362242378037301e-05 | > step_time: 0.6295 (0.6292040348052977) | > loader_time: 0.0274 (0.022963768396622095)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4758458137512207 (2.4758458137512207) | > loss_disc_real_0: 0.1811731904745102 (0.1811731904745102) | > loss_disc_real_1: 0.19734951853752136 (0.19734951853752136) | > loss_disc_real_2: 0.3694995641708374 (0.3694995641708374) | > loss_disc_real_3: 0.3305613696575165 (0.3305613696575165) | > loss_disc_real_4: 0.24185407161712646 (0.24185407161712646) | > loss_disc_real_5: 0.23919542133808136 (0.23919542133808136) | > loss_0: 2.4758458137512207 (2.4758458137512207) | > loss_gen: 2.481480836868286 (2.481480836868286) | > loss_kl: 4.607832431793213 (4.607832431793213) | > loss_feat: 5.50699520111084 (5.50699520111084) | > loss_mel: 22.01128387451172 (22.01128387451172) | > loss_duration: 2.837120532989502 (2.837120532989502) | > loss_1: 37.4447135925293 (37.4447135925293)  --> STEP: 1 | > loss_disc: 2.8953969478607178 (2.8953969478607178) | > loss_disc_real_0: 0.21871867775917053 (0.21871867775917053) | > loss_disc_real_1: 0.2646859288215637 (0.2646859288215637) | > loss_disc_real_2: 0.23697473108768463 (0.23697473108768463) | > loss_disc_real_3: 0.25726380944252014 (0.25726380944252014) | > loss_disc_real_4: 0.2218753695487976 (0.2218753695487976) | > loss_disc_real_5: 0.26331594586372375 (0.26331594586372375) | > loss_0: 2.8953969478607178 (2.8953969478607178) | > loss_gen: 1.6203562021255493 (1.6203562021255493) | > loss_kl: 5.018155574798584 (5.018155574798584) | > loss_feat: 0.7554171681404114 (0.7554171681404114) | > loss_mel: 17.05577278137207 (17.05577278137207) | > loss_duration: 3.158841848373413 (3.158841848373413) | > loss_1: 27.608543395996094 (27.608543395996094)  --> STEP: 2 | > loss_disc: 2.8375167846679688 (2.8664568662643433) | > loss_disc_real_0: 0.10618174076080322 (0.16245020925998688) | > loss_disc_real_1: 0.28159773349761963 (0.2731418311595917) | > loss_disc_real_2: 0.24168115854263306 (0.23932794481515884) | > loss_disc_real_3: 0.27446937561035156 (0.26586659252643585) | > loss_disc_real_4: 0.2599109709262848 (0.2408931702375412) | > loss_disc_real_5: 0.2457113415002823 (0.254513643682003) | > loss_0: 2.8375167846679688 (2.8664568662643433) | > loss_gen: 1.5920281410217285 (1.606192171573639) | > loss_kl: 4.942862510681152 (4.980509042739868) | > loss_feat: 0.8355013132095337 (0.7954592406749725) | > loss_mel: 20.647756576538086 (18.851764678955078) | > loss_duration: 3.0330381393432617 (3.0959399938583374) | > loss_1: 31.051185607910156 (29.329864501953125)  --> STEP: 3 | > loss_disc: 2.283111810684204 (2.672008514404297) | > loss_disc_real_0: 0.14869774878025055 (0.15786605576674143) | > loss_disc_real_1: 0.21706153452396393 (0.25444839894771576) | > loss_disc_real_2: 0.1835305541753769 (0.2207288146018982) | > loss_disc_real_3: 0.315319299697876 (0.2823508282502492) | > loss_disc_real_4: 0.08636336773633957 (0.189383236070474) | > loss_disc_real_5: 0.2949274778366089 (0.26798492173353833) | > loss_0: 2.283111810684204 (2.672008514404297) | > loss_gen: 2.80663800239563 (2.0063407818476358) | > loss_kl: 2.348893880844116 (4.103303988774617) | > loss_feat: 6.933900356292725 (2.8416062792142234) | > loss_mel: 22.81309700012207 (20.172208786010742) | > loss_duration: 2.894462823867798 (3.028780937194824) | > loss_1: 37.79698944091797 (32.15223948160807) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_91000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9281771183013916 (2.7360506653785706) | > loss_disc_real_0: 0.20466549694538116 (0.16956591606140137) | > loss_disc_real_1: 0.28791484236717224 (0.2628150098025799) | > loss_disc_real_2: 0.23877111077308655 (0.22523938864469528) | > loss_disc_real_3: 0.2526542544364929 (0.27492668479681015) | > loss_disc_real_4: 0.25848519802093506 (0.20665872655808926) | > loss_disc_real_5: 0.24302318692207336 (0.2617444880306721) | > loss_0: 2.9281771183013916 (2.7360506653785706) | > loss_gen: 1.562120795249939 (1.8952857851982117) | > loss_kl: 4.640499591827393 (4.237602889537811) | > loss_feat: 0.20564332604408264 (2.182615540921688) | > loss_mel: 2.891049385070801 (15.851918935775757) | > loss_duration: 2.794196844100952 (2.970134913921356) | > loss_1: 12.093509674072266 (27.13755702972412)  --> STEP: 1 | > loss_disc: 2.168076992034912 (2.622455930709839) | > loss_disc_real_0: 0.16552814841270447 (0.168758362531662) | > loss_disc_real_1: 0.25010237097740173 (0.2602724820375443) | > loss_disc_real_2: 0.2578914761543274 (0.2317698061466217) | > loss_disc_real_3: 0.30835968255996704 (0.28161328434944155) | > loss_disc_real_4: 0.1899767965078354 (0.2033223405480385) | > loss_disc_real_5: 0.2072308361530304 (0.2508417576551437) | > loss_0: 2.168076992034912 (2.622455930709839) | > loss_gen: 2.9157514572143555 (2.0993789196014405) | > loss_kl: 4.773745059967041 (4.344831323623657) | > loss_feat: 9.16795825958252 (3.5796840846538545) | > loss_mel: 28.766761779785156 (18.434887504577638) | > loss_duration: 3.1670634746551514 (3.0095206260681153) | > loss_1: 48.791282653808594 (31.468302154541014)  --> STEP: 2 | > loss_disc: 2.2522101402282715 (2.560748298962911) | > loss_disc_real_0: 0.15094855427742004 (0.165790061155955) | > loss_disc_real_1: 0.3593192994594574 (0.27678028494119644) | > loss_disc_real_2: 0.26139238476753235 (0.23670690258344015) | > loss_disc_real_3: 0.4850219190120697 (0.3155147234598796) | > loss_disc_real_4: 0.18559683859348297 (0.20036809022227922) | > loss_disc_real_5: 0.14846496284008026 (0.23377895851929983) | > loss_0: 2.2522101402282715 (2.560748298962911) | > loss_gen: 3.385096311569214 (2.3136651515960693) | > loss_kl: 5.252844333648682 (4.496166825294495) | > loss_feat: 6.626474380493164 (4.087482467293739) | > loss_mel: 23.74171257019043 (19.319358348846436) | > loss_duration: 3.0375919342041016 (3.014199177424113) | > loss_1: 42.043724060058594 (33.23087247212728)  --> STEP: 3 | > loss_disc: 1.805434226989746 (2.4528462886810303) | > loss_disc_real_0: 0.056164875626564026 (0.150129320366042) | > loss_disc_real_1: 0.16570335626602173 (0.2609121522733143) | > loss_disc_real_2: 0.12571166455745697 (0.2208504400082997) | > loss_disc_real_3: 0.15075470507144928 (0.2919775779758181) | > loss_disc_real_4: 0.05576329305768013 (0.17971026205590793) | > loss_disc_real_5: 0.03754333034157753 (0.2057452973510538) | > loss_0: 1.805434226989746 (2.4528462886810303) | > loss_gen: 2.3619842529296875 (2.320567880358015) | > loss_kl: 2.43410587310791 (4.20158668926784) | > loss_feat: 7.974518299102783 (4.642773300409317) | > loss_mel: 23.330352783203125 (19.892357553754533) | > loss_duration: 2.966963768005371 (3.007451261792864) | > loss_1: 39.06792449951172 (34.064737047467915) --> EVAL PERFORMANCE | > avg_loader_time: 0.6952882494245257 (+0.6865154788607644) | > avg_loss_disc: 2.4528462886810303 (-0.2637770175933838) | > avg_loss_disc_real_0: 0.150129320366042 (-0.03881209875856126) | > avg_loss_disc_real_1: 0.2609121522733143 (+0.011352332574980584) | > avg_loss_disc_real_2: 0.2208504400082997 (-0.0187046903939474) | > avg_loss_disc_real_3: 0.2919775779758181 (+0.025905528238841458) | > avg_loss_disc_real_4: 0.17971026205590793 (-0.09264064030278299) | > avg_loss_disc_real_5: 0.2057452973510538 (-0.06215133500241099) | > avg_loss_0: 2.4528462886810303 (-0.2637770175933838) | > avg_loss_gen: 2.320567880358015 (+0.30645155339013996) | > avg_loss_kl: 4.20158668926784 (+0.2925991671425958) | > avg_loss_feat: 4.642773300409317 (+1.2048745776216188) | > avg_loss_mel: 19.892357553754533 (+4.8434567110879065) | > avg_loss_duration: 3.007451261792864 (-0.06893566676548568) | > avg_loss_1: 34.064737047467915 (+6.578445797874817)  > EPOCH: 760/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:49:25)   --> TIME: 2023-10-20 08:49:48 -- STEP: 19/50 -- GLOBAL_STEP: 91020 | > loss_disc: 2.854466438293457 (2.405710245433607) | > loss_disc_real_0: 0.21495971083641052 (0.13191901931637212) | > loss_disc_real_1: 0.257393479347229 (0.2253861823364308) | > loss_disc_real_2: 0.24212366342544556 (0.21778902254606547) | > loss_disc_real_3: 0.31621748208999634 (0.2538082156526415) | > loss_disc_real_4: 0.322403222322464 (0.19659502196468806) | > loss_disc_real_5: 0.3654728829860687 (0.17469472438097) | > loss_0: 2.854466438293457 (2.405710245433607) | > grad_norm_0: tensor(602.0766, device='cuda:0') (tensor(593.6128, device='cuda:0')) | > loss_gen: 1.997520923614502 (2.349141108362298) | > loss_kl: 1.1838668584823608 (0.8518825079265394) | > loss_feat: 1.5754890441894531 (5.383219144846263) | > loss_mel: 18.80832862854004 (20.825725618161652) | > loss_duration: 1.5549262762069702 (1.424867128071032) | > loss_1: 25.12013053894043 (30.8348355042307) | > grad_norm_1: tensor(5485.5854, device='cuda:0') (tensor(19968.9609, device='cuda:0')) | > current_lr_0: 9.352884230616464e-05 | > current_lr_1: 9.352884230616464e-05 | > step_time: 0.5446 (0.598735909712942) | > loader_time: 0.0195 (0.02799450723748458)  --> TIME: 2023-10-20 08:50:09 -- STEP: 49/50 -- GLOBAL_STEP: 91050 | > loss_disc: 2.4180350303649902 (2.45955427568786) | > loss_disc_real_0: 0.017087772488594055 (0.14169383972731173) | > loss_disc_real_1: 0.1826878935098648 (0.2258617817139139) | > loss_disc_real_2: 0.2114754021167755 (0.21754037284729433) | > loss_disc_real_3: 0.22549083828926086 (0.24343751005980432) | > loss_disc_real_4: 0.20641785860061646 (0.21004713874082176) | > loss_disc_real_5: 0.28435206413269043 (0.2196710208164794) | > loss_0: 2.4180350303649902 (2.45955427568786) | > grad_norm_0: tensor(867.7230, device='cuda:0') (tensor(793.8354, device='cuda:0')) | > loss_gen: 2.1897053718566895 (2.3220428447334136) | > loss_kl: 0.5840101838111877 (0.81629080492623) | > loss_feat: 4.174937725067139 (5.148683445186031) | > loss_mel: 25.45357322692871 (19.831299665022875) | > loss_duration: 1.5126163959503174 (1.3992457292517837) | > loss_1: 33.91484069824219 (29.517562467224742) | > grad_norm_1: tensor(12823.1055, device='cuda:0') (tensor(20416.2246, device='cuda:0')) | > current_lr_0: 9.352884230616464e-05 | > current_lr_1: 9.352884230616464e-05 | > step_time: 0.8163 (0.6327027593340194) | > loader_time: 0.3873 (0.03293231068825235)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7028419971466064 (2.7028419971466064) | > loss_disc_real_0: 0.36848413944244385 (0.36848413944244385) | > loss_disc_real_1: 0.24982011318206787 (0.24982011318206787) | > loss_disc_real_2: 0.2645927369594574 (0.2645927369594574) | > loss_disc_real_3: 0.34236007928848267 (0.34236007928848267) | > loss_disc_real_4: 0.27602413296699524 (0.27602413296699524) | > loss_disc_real_5: 0.36548376083374023 (0.36548376083374023) | > loss_0: 2.7028419971466064 (2.7028419971466064) | > loss_gen: 2.633143186569214 (2.633143186569214) | > loss_kl: 7.171985149383545 (7.171985149383545) | > loss_feat: 4.615785121917725 (4.615785121917725) | > loss_mel: 25.596263885498047 (25.596263885498047) | > loss_duration: 3.0918407440185547 (3.0918407440185547) | > loss_1: 43.10901641845703 (43.10901641845703)  --> STEP: 1 | > loss_disc: 2.84683895111084 (2.84683895111084) | > loss_disc_real_0: 0.2599949836730957 (0.2599949836730957) | > loss_disc_real_1: 0.24736909568309784 (0.24736909568309784) | > loss_disc_real_2: 0.233553946018219 (0.233553946018219) | > loss_disc_real_3: 0.32462450861930847 (0.32462450861930847) | > loss_disc_real_4: 0.3277354836463928 (0.3277354836463928) | > loss_disc_real_5: 0.3569067418575287 (0.3569067418575287) | > loss_0: 2.84683895111084 (2.84683895111084) | > loss_gen: 2.6153178215026855 (2.6153178215026855) | > loss_kl: 4.748497486114502 (4.748497486114502) | > loss_feat: 5.553492069244385 (5.553492069244385) | > loss_mel: 24.61786460876465 (24.61786460876465) | > loss_duration: 3.2145917415618896 (3.2145917415618896) | > loss_1: 40.74976348876953 (40.74976348876953)  --> STEP: 2 | > loss_disc: 2.8299624919891357 (2.838400721549988) | > loss_disc_real_0: 0.15261951088905334 (0.20630724728107452) | > loss_disc_real_1: 0.28122177720069885 (0.26429543644189835) | > loss_disc_real_2: 0.24675419926643372 (0.24015407264232635) | > loss_disc_real_3: 0.24620045721530914 (0.2854124829173088) | > loss_disc_real_4: 0.2648911774158478 (0.2963133305311203) | > loss_disc_real_5: 0.2732475996017456 (0.31507717072963715) | > loss_0: 2.8299624919891357 (2.838400721549988) | > loss_gen: 1.7478358745574951 (2.1815768480300903) | > loss_kl: 5.103447914123535 (4.9259727001190186) | > loss_feat: 1.4090576171875 (3.4812748432159424) | > loss_mel: 19.526796340942383 (22.072330474853516) | > loss_duration: 3.0707755088806152 (3.1426836252212524) | > loss_1: 30.857913970947266 (35.8038387298584)  --> STEP: 3 | > loss_disc: 2.9475011825561523 (2.874767541885376) | > loss_disc_real_0: 0.23615673184394836 (0.21625707546869913) | > loss_disc_real_1: 0.24151276051998138 (0.2567012111345927) | > loss_disc_real_2: 0.25814691185951233 (0.24615168571472168) | > loss_disc_real_3: 0.2528303265571594 (0.27455176413059235) | > loss_disc_real_4: 0.2665577828884125 (0.2863948146502177) | > loss_disc_real_5: 0.29740050435066223 (0.3091849486033122) | > loss_0: 2.9475011825561523 (2.874767541885376) | > loss_gen: 1.6280633211135864 (1.9970723390579224) | > loss_kl: 2.4250411987304688 (4.092328866322835) | > loss_feat: 0.28285840153694153 (2.4151360293229422) | > loss_mel: 7.535617351531982 (17.226759433746338) | > loss_duration: 2.956251859664917 (3.0805397033691406) | > loss_1: 14.827832221984863 (28.81183656056722) --> EVAL PERFORMANCE | > avg_loader_time: 0.008214632670084635 (-0.6870736167544411) | > avg_loss_disc: 2.874767541885376 (+0.4219212532043457) | > avg_loss_disc_real_0: 0.21625707546869913 (+0.06612775510265712) | > avg_loss_disc_real_1: 0.2567012111345927 (-0.004210941138721613) | > avg_loss_disc_real_2: 0.24615168571472168 (+0.025301245706421976) | > avg_loss_disc_real_3: 0.27455176413059235 (-0.017425813845225735) | > avg_loss_disc_real_4: 0.2863948146502177 (+0.10668455259430978) | > avg_loss_disc_real_5: 0.3091849486033122 (+0.1034396512522584) | > avg_loss_0: 2.874767541885376 (+0.4219212532043457) | > avg_loss_gen: 1.9970723390579224 (-0.3234955413000926) | > avg_loss_kl: 4.092328866322835 (-0.10925782294500497) | > avg_loss_feat: 2.4151360293229422 (-2.2276372710863748) | > avg_loss_mel: 17.226759433746338 (-2.6655981200081946) | > avg_loss_duration: 3.0805397033691406 (+0.0730884415762767) | > avg_loss_1: 28.81183656056722 (-5.252900486900696)  > EPOCH: 761/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:50:25)   --> TIME: 2023-10-20 08:50:44 -- STEP: 29/50 -- GLOBAL_STEP: 91080 | > loss_disc: 2.589956521987915 (2.4195703226944496) | > loss_disc_real_0: 0.09938821941614151 (0.13533254211832738) | > loss_disc_real_1: 0.30672135949134827 (0.229705894044761) | > loss_disc_real_2: 0.31541991233825684 (0.2278397517471478) | > loss_disc_real_3: 0.2918546497821808 (0.234407643177386) | > loss_disc_real_4: 0.20715293288230896 (0.21712778521509007) | > loss_disc_real_5: 0.2289205938577652 (0.21794278492573008) | > loss_0: 2.589956521987915 (2.4195703226944496) | > grad_norm_0: tensor(791.5389, device='cuda:0') (tensor(1008.6346, device='cuda:0')) | > loss_gen: 2.173363447189331 (2.4266672011079455) | > loss_kl: 0.367255300283432 (0.8119176618497947) | > loss_feat: 3.1940760612487793 (6.223926212253241) | > loss_mel: 22.369747161865234 (22.954494607859644) | > loss_duration: 1.3882631063461304 (1.4285304875209415) | > loss_1: 29.492704391479492 (33.84553639642124) | > grad_norm_1: tensor(6371.3696, device='cuda:0') (tensor(33140.8750, device='cuda:0')) | > current_lr_0: 9.343535437249882e-05 | > current_lr_1: 9.343535437249882e-05 | > step_time: 0.3134 (0.49266069510887395) | > loader_time: 0.0034 (0.011103646508578596)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7443835735321045 (2.7443835735321045) | > loss_disc_real_0: 0.2930476665496826 (0.2930476665496826) | > loss_disc_real_1: 0.2628714442253113 (0.2628714442253113) | > loss_disc_real_2: 0.2592776119709015 (0.2592776119709015) | > loss_disc_real_3: 0.2302766740322113 (0.2302766740322113) | > loss_disc_real_4: 0.1704205870628357 (0.1704205870628357) | > loss_disc_real_5: 0.18091557919979095 (0.18091557919979095) | > loss_0: 2.7443835735321045 (2.7443835735321045) | > loss_gen: 1.9071998596191406 (1.9071998596191406) | > loss_kl: 4.920864105224609 (4.920864105224609) | > loss_feat: 1.688435673713684 (1.688435673713684) | > loss_mel: 18.545385360717773 (18.545385360717773) | > loss_duration: 2.8098273277282715 (2.8098273277282715) | > loss_1: 29.871713638305664 (29.871713638305664)  --> STEP: 1 | > loss_disc: 2.6852142810821533 (2.6852142810821533) | > loss_disc_real_0: 0.3154475688934326 (0.3154475688934326) | > loss_disc_real_1: 0.24623261392116547 (0.24623261392116547) | > loss_disc_real_2: 0.21512283384799957 (0.21512283384799957) | > loss_disc_real_3: 0.26729607582092285 (0.26729607582092285) | > loss_disc_real_4: 0.29646816849708557 (0.29646816849708557) | > loss_disc_real_5: 0.32052043080329895 (0.32052043080329895) | > loss_0: 2.6852142810821533 (2.6852142810821533) | > loss_gen: 2.408111572265625 (2.408111572265625) | > loss_kl: 5.003249645233154 (5.003249645233154) | > loss_feat: 4.58195686340332 (4.58195686340332) | > loss_mel: 22.908857345581055 (22.908857345581055) | > loss_duration: 3.1957831382751465 (3.1957831382751465) | > loss_1: 38.097957611083984 (38.097957611083984)  --> STEP: 2 | > loss_disc: 2.8944172859191895 (2.7898157835006714) | > loss_disc_real_0: 0.2403595745563507 (0.27790357172489166) | > loss_disc_real_1: 0.263924777507782 (0.2550786957144737) | > loss_disc_real_2: 0.2131153792142868 (0.2141191065311432) | > loss_disc_real_3: 0.23759159445762634 (0.2524438351392746) | > loss_disc_real_4: 0.25421297550201416 (0.27534057199954987) | > loss_disc_real_5: 0.27610188722610474 (0.29831115901470184) | > loss_0: 2.8944172859191895 (2.7898157835006714) | > loss_gen: 1.6582729816436768 (2.033192276954651) | > loss_kl: 5.070389270782471 (5.0368194580078125) | > loss_feat: 0.5332691669464111 (2.5576130151748657) | > loss_mel: 12.892749786376953 (17.900803565979004) | > loss_duration: 3.0011961460113525 (3.0984896421432495) | > loss_1: 23.1558780670166 (30.626917839050293)  --> STEP: 3 | > loss_disc: 3.0249269008636475 (2.8681861559549966) | > loss_disc_real_0: 0.19673793017864227 (0.25084835787614185) | > loss_disc_real_1: 0.26982712745666504 (0.2599948396285375) | > loss_disc_real_2: 0.23783078789710999 (0.2220230003197988) | > loss_disc_real_3: 0.22964951395988464 (0.24484572807947794) | > loss_disc_real_4: 0.24867725372314453 (0.2664527992407481) | > loss_disc_real_5: 0.27519288659095764 (0.2906050682067871) | > loss_0: 3.0249269008636475 (2.8681861559549966) | > loss_gen: 1.4487069845199585 (1.8383638461430867) | > loss_kl: 2.499345541000366 (4.19099481900533) | > loss_feat: 0.03583744913339615 (1.7170211598277092) | > loss_mel: 2.068608045578003 (12.62340505917867) | > loss_duration: 2.8774688243865967 (3.0248160362243652) | > loss_1: 8.929966926574707 (23.394600868225098) --> EVAL PERFORMANCE | > avg_loader_time: 0.03378462791442871 (+0.025569995244344078) | > avg_loss_disc: 2.8681861559549966 (-0.00658138593037938) | > avg_loss_disc_real_0: 0.25084835787614185 (+0.03459128240744272) | > avg_loss_disc_real_1: 0.2599948396285375 (+0.003293628493944767) | > avg_loss_disc_real_2: 0.2220230003197988 (-0.024128685394922883) | > avg_loss_disc_real_3: 0.24484572807947794 (-0.02970603605111441) | > avg_loss_disc_real_4: 0.2664527992407481 (-0.019942015409469604) | > avg_loss_disc_real_5: 0.2906050682067871 (-0.018579880396525084) | > avg_loss_0: 2.8681861559549966 (-0.00658138593037938) | > avg_loss_gen: 1.8383638461430867 (-0.15870849291483569) | > avg_loss_kl: 4.19099481900533 (+0.09866595268249512) | > avg_loss_feat: 1.7170211598277092 (-0.698114869495233) | > avg_loss_mel: 12.62340505917867 (-4.603354374567667) | > avg_loss_duration: 3.0248160362243652 (-0.05572366714477539) | > avg_loss_1: 23.394600868225098 (-5.417235692342121)  > EPOCH: 762/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:51:17)   --> TIME: 2023-10-20 08:51:27 -- STEP: 9/50 -- GLOBAL_STEP: 91110 | > loss_disc: 2.2627644538879395 (2.2876034577687583) | > loss_disc_real_0: 0.19175952672958374 (0.1599855799641874) | > loss_disc_real_1: 0.25091516971588135 (0.22419717576768664) | > loss_disc_real_2: 0.2660987675189972 (0.21489743971162373) | > loss_disc_real_3: 0.21097014844417572 (0.20331550969017875) | > loss_disc_real_4: 0.17850807309150696 (0.21580913952655262) | > loss_disc_real_5: 0.18324096500873566 (0.2277610624829928) | > loss_0: 2.2627644538879395 (2.2876034577687583) | > grad_norm_0: tensor(1360.8949, device='cuda:0') (tensor(1551.1813, device='cuda:0')) | > loss_gen: 2.6684844493865967 (2.5611537297566733) | > loss_kl: 0.8148133158683777 (0.8606174422634972) | > loss_feat: 5.087587356567383 (6.832716412014431) | > loss_mel: 23.637235641479492 (21.911238776312935) | > loss_duration: 1.3221794366836548 (1.4201093117396038) | > loss_1: 33.53030014038086 (33.585835774739586) | > grad_norm_1: tensor(21866.1895, device='cuda:0') (tensor(50622.1602, device='cuda:0')) | > current_lr_0: 9.334195988587594e-05 | > current_lr_1: 9.334195988587594e-05 | > step_time: 0.457 (0.6595544550153944) | > loader_time: 0.016 (0.01952966054280599)  --> TIME: 2023-10-20 08:51:46 -- STEP: 39/50 -- GLOBAL_STEP: 91140 | > loss_disc: 1.985093116760254 (2.342467607595981) | > loss_disc_real_0: 0.22022797167301178 (0.12030173907390772) | > loss_disc_real_1: 0.22283071279525757 (0.23414903458876488) | > loss_disc_real_2: 0.2789125442504883 (0.2183662139547941) | > loss_disc_real_3: 0.16896219551563263 (0.2281057364665545) | > loss_disc_real_4: 0.3125351667404175 (0.21782037157278794) | > loss_disc_real_5: 0.26209166646003723 (0.20960192262935332) | > loss_0: 1.985093116760254 (2.342467607595981) | > grad_norm_0: tensor(2190.7312, device='cuda:0') (tensor(1263.0120, device='cuda:0')) | > loss_gen: 3.511356830596924 (2.4520961107351846) | > loss_kl: 0.5029828548431396 (0.8601505588262509) | > loss_feat: 7.022049427032471 (6.74870180319517) | > loss_mel: 20.66775131225586 (22.922511467566856) | > loss_duration: 1.497991919517517 (1.410049475156344) | > loss_1: 33.20213317871094 (34.3935095224625) | > grad_norm_1: tensor(68655.5234, device='cuda:0') (tensor(47873.1094, device='cuda:0')) | > current_lr_0: 9.334195988587594e-05 | > current_lr_1: 9.334195988587594e-05 | > step_time: 1.0342 (0.6135691985105857) | > loader_time: 0.0348 (0.018778421939947665)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.042771816253662 (2.042771816253662) | > loss_disc_real_0: 0.03129184991121292 (0.03129184991121292) | > loss_disc_real_1: 0.0575682707130909 (0.0575682707130909) | > loss_disc_real_2: 0.25524693727493286 (0.25524693727493286) | > loss_disc_real_3: 0.27597180008888245 (0.27597180008888245) | > loss_disc_real_4: 0.1003125011920929 (0.1003125011920929) | > loss_disc_real_5: 0.19826948642730713 (0.19826948642730713) | > loss_0: 2.042771816253662 (2.042771816253662) | > loss_gen: 2.330991268157959 (2.330991268157959) | > loss_kl: 4.8262248039245605 (4.8262248039245605) | > loss_feat: 8.853981018066406 (8.853981018066406) | > loss_mel: 24.489402770996094 (24.489402770996094) | > loss_duration: 2.901557207107544 (2.901557207107544) | > loss_1: 43.402156829833984 (43.402156829833984)  --> STEP: 1 | > loss_disc: 2.5033328533172607 (2.5033328533172607) | > loss_disc_real_0: 0.15666931867599487 (0.15666931867599487) | > loss_disc_real_1: 0.1447591334581375 (0.1447591334581375) | > loss_disc_real_2: 0.22573833167552948 (0.22573833167552948) | > loss_disc_real_3: 0.15347744524478912 (0.15347744524478912) | > loss_disc_real_4: 0.1924431473016739 (0.1924431473016739) | > loss_disc_real_5: 0.10242298990488052 (0.10242298990488052) | > loss_0: 2.5033328533172607 (2.5033328533172607) | > loss_gen: 1.8240686655044556 (1.8240686655044556) | > loss_kl: 4.483028411865234 (4.483028411865234) | > loss_feat: 6.506211280822754 (6.506211280822754) | > loss_mel: 25.793949127197266 (25.793949127197266) | > loss_duration: 3.0454771518707275 (3.0454771518707275) | > loss_1: 41.65273666381836 (41.65273666381836)  --> STEP: 2 | > loss_disc: 2.539046049118042 (2.5211894512176514) | > loss_disc_real_0: 0.12310360372066498 (0.13988646119832993) | > loss_disc_real_1: 0.2598332166671753 (0.2022961750626564) | > loss_disc_real_2: 0.19586795568466187 (0.21080314368009567) | > loss_disc_real_3: 0.27990204095840454 (0.21668974310159683) | > loss_disc_real_4: 0.241280198097229 (0.21686167269945145) | > loss_disc_real_5: 0.2623259425163269 (0.18237446621060371) | > loss_0: 2.539046049118042 (2.5211894512176514) | > loss_gen: 1.981550931930542 (1.9028097987174988) | > loss_kl: 4.972983360290527 (4.728005886077881) | > loss_feat: 1.8640888929367065 (4.18515008687973) | > loss_mel: 16.828107833862305 (21.311028480529785) | > loss_duration: 2.9574639797210693 (3.0014705657958984) | > loss_1: 28.60419464111328 (35.12846565246582)  --> STEP: 3 | > loss_disc: 2.9988279342651367 (2.6804022789001465) | > loss_disc_real_0: 0.23586952686309814 (0.17188081641991934) | > loss_disc_real_1: 0.26484158635139465 (0.2231446454922358) | > loss_disc_real_2: 0.23122559487819672 (0.21761062741279602) | > loss_disc_real_3: 0.2587786912918091 (0.23071939249833426) | > loss_disc_real_4: 0.23671811819076538 (0.22348048786322275) | > loss_disc_real_5: 0.25584134459495544 (0.2068634256720543) | > loss_0: 2.9988279342651367 (2.6804022789001465) | > loss_gen: 1.487605094909668 (1.7644082307815552) | > loss_kl: 2.081563711166382 (3.8458584944407144) | > loss_feat: 0.02142731100320816 (2.7972424949208894) | > loss_mel: 2.5262341499328613 (15.04943037033081) | > loss_duration: 2.866563320159912 (2.9565014839172363) | > loss_1: 8.983393669128418 (26.41344165802002) --> EVAL PERFORMANCE | > avg_loader_time: 0.004442373911539714 (-0.029342254002888996) | > avg_loss_disc: 2.6804022789001465 (-0.1877838770548501) | > avg_loss_disc_real_0: 0.17188081641991934 (-0.0789675414562225) | > avg_loss_disc_real_1: 0.2231446454922358 (-0.03685019413630167) | > avg_loss_disc_real_2: 0.21761062741279602 (-0.004412372907002776) | > avg_loss_disc_real_3: 0.23071939249833426 (-0.014126335581143679) | > avg_loss_disc_real_4: 0.22348048786322275 (-0.04297231137752536) | > avg_loss_disc_real_5: 0.2068634256720543 (-0.08374164253473282) | > avg_loss_0: 2.6804022789001465 (-0.1877838770548501) | > avg_loss_gen: 1.7644082307815552 (-0.0739556153615315) | > avg_loss_kl: 3.8458584944407144 (-0.34513632456461574) | > avg_loss_feat: 2.7972424949208894 (+1.0802213350931802) | > avg_loss_mel: 15.04943037033081 (+2.4260253111521397) | > avg_loss_duration: 2.9565014839172363 (-0.0683145523071289) | > avg_loss_1: 26.41344165802002 (+3.018840789794922)  > EPOCH: 763/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:52:08)   --> TIME: 2023-10-20 08:52:29 -- STEP: 19/50 -- GLOBAL_STEP: 91170 | > loss_disc: 2.676389217376709 (2.449587345123291) | > loss_disc_real_0: 0.3147498369216919 (0.15747462860063502) | > loss_disc_real_1: 0.13227812945842743 (0.21708898952132777) | > loss_disc_real_2: 0.2758151888847351 (0.23666825478798464) | > loss_disc_real_3: 0.2898608148097992 (0.2502826809098846) | > loss_disc_real_4: 0.2699655294418335 (0.21328374880709147) | > loss_disc_real_5: 0.2920205593109131 (0.22022912719924198) | > loss_0: 2.676389217376709 (2.449587345123291) | > grad_norm_0: tensor(1216.4910, device='cuda:0') (tensor(1332.7068, device='cuda:0')) | > loss_gen: 2.046847105026245 (2.2190950105064795) | > loss_kl: 0.9645541310310364 (0.8169432407931277) | > loss_feat: 2.314236879348755 (4.799295748534956) | > loss_mel: 23.26707649230957 (20.260901250337298) | > loss_duration: 1.5258618593215942 (1.445392175724632) | > loss_1: 30.118576049804688 (29.541627733330976) | > grad_norm_1: tensor(12557.7100, device='cuda:0') (tensor(36028.5117, device='cuda:0')) | > current_lr_0: 9.32486587528898e-05 | > current_lr_1: 9.32486587528898e-05 | > step_time: 0.3784 (0.46612344290080826) | > loader_time: 0.002 (0.011327266693115234)  --> TIME: 2023-10-20 08:52:52 -- STEP: 49/50 -- GLOBAL_STEP: 91200 | > loss_disc: 2.691755533218384 (2.424301636462309) | > loss_disc_real_0: 0.19709379971027374 (0.1429384897406004) | > loss_disc_real_1: 0.33261436223983765 (0.2129629357736938) | > loss_disc_real_2: 0.3871753215789795 (0.21823840877231288) | > loss_disc_real_3: 0.3164733946323395 (0.24248563619900723) | > loss_disc_real_4: 0.2813616096973419 (0.203905637395017) | > loss_disc_real_5: 0.30083486437797546 (0.20798123487252362) | > loss_0: 2.691755533218384 (2.424301636462309) | > grad_norm_0: tensor(1842.9586, device='cuda:0') (tensor(1447.6921, device='cuda:0')) | > loss_gen: 2.6863489151000977 (2.2748792949987924) | > loss_kl: 0.5346054434776306 (0.7259614978517804) | > loss_feat: 3.32444167137146 (5.47648771745818) | > loss_mel: 23.854909896850586 (21.22808864651894) | > loss_duration: 1.4765148162841797 (1.4132586644620309) | > loss_1: 31.876821517944336 (31.11867602017461) | > grad_norm_1: tensor(16010.2480, device='cuda:0') (tensor(34123.7812, device='cuda:0')) | > current_lr_0: 9.32486587528898e-05 | > current_lr_1: 9.32486587528898e-05 | > step_time: 0.8903 (0.6303869753467792) | > loader_time: 0.4245 (0.028079451346883968)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.163315773010254 (3.163315773010254) | > loss_disc_real_0: 0.588302731513977 (0.588302731513977) | > loss_disc_real_1: 0.2507368326187134 (0.2507368326187134) | > loss_disc_real_2: 0.29493632912635803 (0.29493632912635803) | > loss_disc_real_3: 0.28053122758865356 (0.28053122758865356) | > loss_disc_real_4: 0.2961633801460266 (0.2961633801460266) | > loss_disc_real_5: 0.28193002939224243 (0.28193002939224243) | > loss_0: 3.163315773010254 (3.163315773010254) | > loss_gen: 2.0133142471313477 (2.0133142471313477) | > loss_kl: 4.996105670928955 (4.996105670928955) | > loss_feat: 0.09141290187835693 (0.09141290187835693) | > loss_mel: 1.9784468412399292 (1.9784468412399292) | > loss_duration: 2.9228310585021973 (2.9228310585021973) | > loss_1: 12.002111434936523 (12.002111434936523)  --> STEP: 1 | > loss_disc: 2.9367012977600098 (2.9367012977600098) | > loss_disc_real_0: 0.4853017032146454 (0.4853017032146454) | > loss_disc_real_1: 0.2360449731349945 (0.2360449731349945) | > loss_disc_real_2: 0.26814931631088257 (0.26814931631088257) | > loss_disc_real_3: 0.2735637426376343 (0.2735637426376343) | > loss_disc_real_4: 0.27205023169517517 (0.27205023169517517) | > loss_disc_real_5: 0.2928977906703949 (0.2928977906703949) | > loss_0: 2.9367012977600098 (2.9367012977600098) | > loss_gen: 2.1392688751220703 (2.1392688751220703) | > loss_kl: 5.235389232635498 (5.235389232635498) | > loss_feat: 0.8369178175926208 (0.8369178175926208) | > loss_mel: 15.637063980102539 (15.637063980102539) | > loss_duration: 3.1859652996063232 (3.1859652996063232) | > loss_1: 27.034605026245117 (27.034605026245117)  --> STEP: 2 | > loss_disc: 2.9703898429870605 (2.953545570373535) | > loss_disc_real_0: 0.3015768527984619 (0.39343927800655365) | > loss_disc_real_1: 0.2627999186515808 (0.24942244589328766) | > loss_disc_real_2: 0.3052777349948883 (0.28671352565288544) | > loss_disc_real_3: 0.30140864849090576 (0.28748619556427) | > loss_disc_real_4: 0.2975793778896332 (0.2848148047924042) | > loss_disc_real_5: 0.28321388363838196 (0.2880558371543884) | > loss_0: 2.9703898429870605 (2.953545570373535) | > loss_gen: 1.9203860759735107 (2.0298274755477905) | > loss_kl: 5.119771480560303 (5.1775803565979) | > loss_feat: 0.6087547540664673 (0.7228362858295441) | > loss_mel: 20.874998092651367 (18.256031036376953) | > loss_duration: 3.018627882003784 (3.1022965908050537) | > loss_1: 31.54253578186035 (29.288570404052734)  --> STEP: 3 | > loss_disc: 3.082149028778076 (2.9964133898417153) | > loss_disc_real_0: 0.426569402217865 (0.4044826527436574) | > loss_disc_real_1: 0.3487361967563629 (0.28252702951431274) | > loss_disc_real_2: 0.2936548888683319 (0.2890273133913676) | > loss_disc_real_3: 0.24422186613082886 (0.2730647524197896) | > loss_disc_real_4: 0.463419646024704 (0.34434975186983746) | > loss_disc_real_5: 0.3619662821292877 (0.31269265214602154) | > loss_0: 3.082149028778076 (2.9964133898417153) | > loss_gen: 2.3544578552246094 (2.13803760210673) | > loss_kl: 2.3718249797821045 (4.242328564325969) | > loss_feat: 3.7272822856903076 (1.7243182857831318) | > loss_mel: 24.408920288085938 (20.30699412027995) | > loss_duration: 2.8330931663513184 (3.012562115987142) | > loss_1: 35.695579528808594 (31.424240112304688) --> EVAL PERFORMANCE | > avg_loader_time: 0.0098878542582194 (+0.005445480346679687) | > avg_loss_disc: 2.9964133898417153 (+0.31601111094156886) | > avg_loss_disc_real_0: 0.4044826527436574 (+0.23260183632373807) | > avg_loss_disc_real_1: 0.28252702951431274 (+0.059382384022076934) | > avg_loss_disc_real_2: 0.2890273133913676 (+0.07141668597857159) | > avg_loss_disc_real_3: 0.2730647524197896 (+0.042345359921455356) | > avg_loss_disc_real_4: 0.34434975186983746 (+0.12086926400661471) | > avg_loss_disc_real_5: 0.31269265214602154 (+0.10582922647396725) | > avg_loss_0: 2.9964133898417153 (+0.31601111094156886) | > avg_loss_gen: 2.13803760210673 (+0.3736293713251748) | > avg_loss_kl: 4.242328564325969 (+0.39647006988525435) | > avg_loss_feat: 1.7243182857831318 (-1.0729242091377575) | > avg_loss_mel: 20.30699412027995 (+5.2575637499491386) | > avg_loss_duration: 3.012562115987142 (+0.05606063206990575) | > avg_loss_1: 31.424240112304688 (+5.010798454284668)  > EPOCH: 764/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:53:04)   --> TIME: 2023-10-20 08:53:25 -- STEP: 29/50 -- GLOBAL_STEP: 91230 | > loss_disc: 2.4085605144500732 (2.4509450032793243) | > loss_disc_real_0: 0.041420821100473404 (0.1376786394494361) | > loss_disc_real_1: 0.23779982328414917 (0.2188897730204566) | > loss_disc_real_2: 0.21330814063549042 (0.2355710305273533) | > loss_disc_real_3: 0.29019442200660706 (0.25206132400138626) | > loss_disc_real_4: 0.22046451270580292 (0.22239158826013067) | > loss_disc_real_5: 0.24744419753551483 (0.23239783255447602) | > loss_0: 2.4085605144500732 (2.4509450032793243) | > grad_norm_0: tensor(881.7612, device='cuda:0') (tensor(1383.4556, device='cuda:0')) | > loss_gen: 2.099074125289917 (2.3749376823162205) | > loss_kl: 0.5775992274284363 (0.86773288661036) | > loss_feat: 2.784722328186035 (5.7057117094639045) | > loss_mel: 21.583311080932617 (19.49599119712566) | > loss_duration: 1.4011002779006958 (1.412557573154055) | > loss_1: 28.4458065032959 (29.85693124244953) | > grad_norm_1: tensor(4446.1616, device='cuda:0') (tensor(64270.3789, device='cuda:0')) | > current_lr_0: 9.315545088022759e-05 | > current_lr_1: 9.315545088022759e-05 | > step_time: 1.1649 (0.5695952135941078) | > loader_time: 0.0531 (0.015101868530799605)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.766639471054077 (2.766639471054077) | > loss_disc_real_0: 0.10686925798654556 (0.10686925798654556) | > loss_disc_real_1: 0.18224726617336273 (0.18224726617336273) | > loss_disc_real_2: 0.16221599280834198 (0.16221599280834198) | > loss_disc_real_3: 0.21200525760650635 (0.21200525760650635) | > loss_disc_real_4: 0.11100335419178009 (0.11100335419178009) | > loss_disc_real_5: 0.2581506371498108 (0.2581506371498108) | > loss_0: 2.766639471054077 (2.766639471054077) | > loss_gen: 1.549619436264038 (1.549619436264038) | > loss_kl: 5.583826541900635 (5.583826541900635) | > loss_feat: 4.59805154800415 (4.59805154800415) | > loss_mel: 22.90323257446289 (22.90323257446289) | > loss_duration: 2.93090558052063 (2.93090558052063) | > loss_1: 37.56563186645508 (37.56563186645508)  --> STEP: 1 | > loss_disc: 2.2361319065093994 (2.2361319065093994) | > loss_disc_real_0: 0.03681080788373947 (0.03681080788373947) | > loss_disc_real_1: 0.1272910237312317 (0.1272910237312317) | > loss_disc_real_2: 0.05049555003643036 (0.05049555003643036) | > loss_disc_real_3: 0.2720499038696289 (0.2720499038696289) | > loss_disc_real_4: 0.07339655607938766 (0.07339655607938766) | > loss_disc_real_5: 0.16040585935115814 (0.16040585935115814) | > loss_0: 2.2361319065093994 (2.2361319065093994) | > loss_gen: 2.0845251083374023 (2.0845251083374023) | > loss_kl: 5.220478057861328 (5.220478057861328) | > loss_feat: 7.2155256271362305 (7.2155256271362305) | > loss_mel: 27.498764038085938 (27.498764038085938) | > loss_duration: 3.1346607208251953 (3.1346607208251953) | > loss_1: 45.153953552246094 (45.153953552246094)  --> STEP: 2 | > loss_disc: 1.7239148616790771 (1.9800233840942383) | > loss_disc_real_0: 0.15305274724960327 (0.09493177756667137) | > loss_disc_real_1: 0.11769581586122513 (0.12249341979622841) | > loss_disc_real_2: 0.09213612228631973 (0.07131583616137505) | > loss_disc_real_3: 0.18344810605049133 (0.22774900496006012) | > loss_disc_real_4: 0.1212991252541542 (0.09734784066677094) | > loss_disc_real_5: 0.1016755998134613 (0.13104072958230972) | > loss_0: 1.7239148616790771 (1.9800233840942383) | > loss_gen: 3.1431264877319336 (2.613825798034668) | > loss_kl: 5.208364009857178 (5.214421033859253) | > loss_feat: 10.68066692352295 (8.94809627532959) | > loss_mel: 24.45182991027832 (25.97529697418213) | > loss_duration: 2.998417377471924 (3.0665390491485596) | > loss_1: 46.48240280151367 (45.81817817687988)  --> STEP: 3 | > loss_disc: 1.923661470413208 (1.9612360795338948) | > loss_disc_real_0: 0.10787927359342575 (0.0992476095755895) | > loss_disc_real_1: 0.21130158007144928 (0.1520961398879687) | > loss_disc_real_2: 0.05509726703166962 (0.06590964645147324) | > loss_disc_real_3: 0.2468298077583313 (0.23410927255948386) | > loss_disc_real_4: 0.14333149790763855 (0.1126757264137268) | > loss_disc_real_5: 0.20751425623893738 (0.15653190513451895) | > loss_0: 1.923661470413208 (1.9612360795338948) | > loss_gen: 2.496490716934204 (2.574714104334513) | > loss_kl: 2.4878504276275635 (4.3055641651153564) | > loss_feat: 6.124464511871338 (8.006885687510172) | > loss_mel: 22.881603240966797 (24.94406572977702) | > loss_duration: 2.8803436756134033 (3.004473924636841) | > loss_1: 36.87075424194336 (42.83570353190104) --> EVAL PERFORMANCE | > avg_loader_time: 0.012474298477172852 (+0.002586444218953451) | > avg_loss_disc: 1.9612360795338948 (-1.0351773103078206) | > avg_loss_disc_real_0: 0.0992476095755895 (-0.30523504316806793) | > avg_loss_disc_real_1: 0.1520961398879687 (-0.13043088962634405) | > avg_loss_disc_real_2: 0.06590964645147324 (-0.22311766693989438) | > avg_loss_disc_real_3: 0.23410927255948386 (-0.03895547986030576) | > avg_loss_disc_real_4: 0.1126757264137268 (-0.23167402545611065) | > avg_loss_disc_real_5: 0.15653190513451895 (-0.1561607470115026) | > avg_loss_0: 1.9612360795338948 (-1.0351773103078206) | > avg_loss_gen: 2.574714104334513 (+0.4366765022277832) | > avg_loss_kl: 4.3055641651153564 (+0.06323560078938772) | > avg_loss_feat: 8.006885687510172 (+6.28256740172704) | > avg_loss_mel: 24.94406572977702 (+4.63707160949707) | > avg_loss_duration: 3.004473924636841 (-0.008088191350301255) | > avg_loss_1: 42.83570353190104 (+11.411463419596352)  > EPOCH: 765/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:53:58)   --> TIME: 2023-10-20 08:54:08 -- STEP: 9/50 -- GLOBAL_STEP: 91260 | > loss_disc: 2.860856771469116 (2.600491682688395) | > loss_disc_real_0: 0.22037866711616516 (0.16740638990369108) | > loss_disc_real_1: 0.33876296877861023 (0.19677612019909752) | > loss_disc_real_2: 0.45543739199638367 (0.2296061540643374) | > loss_disc_real_3: 0.3738180994987488 (0.2103932872414589) | > loss_disc_real_4: 0.30734363198280334 (0.2342055653118425) | > loss_disc_real_5: 0.28864848613739014 (0.2000094223767519) | > loss_0: 2.860856771469116 (2.600491682688395) | > grad_norm_0: tensor(1636.8292, device='cuda:0') (tensor(1150.3311, device='cuda:0')) | > loss_gen: 2.3453569412231445 (2.2313322093751697) | > loss_kl: 0.8621003031730652 (0.9030991593996683) | > loss_feat: 2.4944076538085938 (5.863729106055366) | > loss_mel: 22.2833251953125 (23.256372663709854) | > loss_duration: 1.3594576120376587 (1.404725604587131) | > loss_1: 29.344648361206055 (33.65925937228732) | > grad_norm_1: tensor(12840.0439, device='cuda:0') (tensor(24683.8223, device='cuda:0')) | > current_lr_0: 9.30623361746698e-05 | > current_lr_1: 9.30623361746698e-05 | > step_time: 0.5222 (0.5612225267622206) | > loader_time: 0.0065 (0.021096097098456487)  --> TIME: 2023-10-20 08:54:28 -- STEP: 39/50 -- GLOBAL_STEP: 91290 | > loss_disc: 1.4104180335998535 (2.4933890226559763) | > loss_disc_real_0: 0.018641425296664238 (0.16684386143699667) | > loss_disc_real_1: 0.10261369496583939 (0.20352784257668716) | > loss_disc_real_2: 0.06554539501667023 (0.23486782572208312) | > loss_disc_real_3: 0.03695368394255638 (0.23655875189564166) | > loss_disc_real_4: 0.02948296070098877 (0.22949999623382702) | > loss_disc_real_5: 0.025223232805728912 (0.21930126993893048) | > loss_0: 1.4104180335998535 (2.4933890226559763) | > grad_norm_0: tensor(1070.5304, device='cuda:0') (tensor(1209.0295, device='cuda:0')) | > loss_gen: 2.8363072872161865 (2.3617749489270725) | > loss_kl: 0.38148441910743713 (0.8503828537769806) | > loss_feat: 12.661822319030762 (5.77549143574941) | > loss_mel: 29.40969467163086 (22.247453799614544) | > loss_duration: 1.4565134048461914 (1.399770507445702) | > loss_1: 46.74582290649414 (32.634873561370085) | > grad_norm_1: tensor(143638.3281, device='cuda:0') (tensor(39028.7539, device='cuda:0')) | > current_lr_0: 9.30623361746698e-05 | > current_lr_1: 9.30623361746698e-05 | > step_time: 0.8582 (0.6285119301233534) | > loader_time: 0.0234 (0.01947608972207094)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3937103748321533 (2.3937103748321533) | > loss_disc_real_0: 0.4518866539001465 (0.4518866539001465) | > loss_disc_real_1: 0.1981566846370697 (0.1981566846370697) | > loss_disc_real_2: 0.2846432626247406 (0.2846432626247406) | > loss_disc_real_3: 0.2390199601650238 (0.2390199601650238) | > loss_disc_real_4: 0.16188237071037292 (0.16188237071037292) | > loss_disc_real_5: 0.2526639997959137 (0.2526639997959137) | > loss_0: 2.3937103748321533 (2.3937103748321533) | > loss_gen: 2.9241204261779785 (2.9241204261779785) | > loss_kl: 4.618340492248535 (4.618340492248535) | > loss_feat: 6.985729694366455 (6.985729694366455) | > loss_mel: 22.448347091674805 (22.448347091674805) | > loss_duration: 2.773012399673462 (2.773012399673462) | > loss_1: 39.74955368041992 (39.74955368041992)  --> STEP: 1 | > loss_disc: 2.2613296508789062 (2.2613296508789062) | > loss_disc_real_0: 0.23600971698760986 (0.23600971698760986) | > loss_disc_real_1: 0.2160649448633194 (0.2160649448633194) | > loss_disc_real_2: 0.17121315002441406 (0.17121315002441406) | > loss_disc_real_3: 0.18548358976840973 (0.18548358976840973) | > loss_disc_real_4: 0.2041209638118744 (0.2041209638118744) | > loss_disc_real_5: 0.07468670606613159 (0.07468670606613159) | > loss_0: 2.2613296508789062 (2.2613296508789062) | > loss_gen: 2.399552345275879 (2.399552345275879) | > loss_kl: 4.444360256195068 (4.444360256195068) | > loss_feat: 8.328451156616211 (8.328451156616211) | > loss_mel: 24.669841766357422 (24.669841766357422) | > loss_duration: 3.064711809158325 (3.064711809158325) | > loss_1: 42.906917572021484 (42.906917572021484)  --> STEP: 2 | > loss_disc: 3.0203726291656494 (2.640851140022278) | > loss_disc_real_0: 0.4160717725753784 (0.32604074478149414) | > loss_disc_real_1: 0.29365289211273193 (0.25485891848802567) | > loss_disc_real_2: 0.3370909094810486 (0.2541520297527313) | > loss_disc_real_3: 0.2816509008407593 (0.2335672453045845) | > loss_disc_real_4: 0.266589879989624 (0.2353554219007492) | > loss_disc_real_5: 0.2642301321029663 (0.16945841908454895) | > loss_0: 3.0203726291656494 (2.640851140022278) | > loss_gen: 1.9208121299743652 (2.160182237625122) | > loss_kl: 5.27124547958374 (4.857802867889404) | > loss_feat: 0.1988316774368286 (4.26364141702652) | > loss_mel: 2.7920122146606445 (13.730926990509033) | > loss_duration: 2.9914212226867676 (3.0280665159225464) | > loss_1: 13.174322128295898 (28.04061985015869)  --> STEP: 3 | > loss_disc: 2.661203622817993 (2.647635300954183) | > loss_disc_real_0: 0.3747641444206238 (0.34228187799453735) | > loss_disc_real_1: 0.25481805205345154 (0.2548452963431676) | > loss_disc_real_2: 0.28202593326568604 (0.26344333092371625) | > loss_disc_real_3: 0.26583439111709595 (0.24432296057542166) | > loss_disc_real_4: 0.25588294863700867 (0.2421979308128357) | > loss_disc_real_5: 0.17513243854045868 (0.17134975890318552) | > loss_0: 2.661203622817993 (2.647635300954183) | > loss_gen: 2.580859899520874 (2.300408124923706) | > loss_kl: 2.399251937866211 (4.038285891215007) | > loss_feat: 4.266526699066162 (4.264603177706401) | > loss_mel: 19.38675880432129 (15.616204261779785) | > loss_duration: 2.8413021564483643 (2.9658117294311523) | > loss_1: 31.474700927734375 (29.185313542683918) --> EVAL PERFORMANCE | > avg_loader_time: 0.008653402328491211 (-0.0038208961486816406) | > avg_loss_disc: 2.647635300954183 (+0.6863992214202883) | > avg_loss_disc_real_0: 0.34228187799453735 (+0.24303426841894787) | > avg_loss_disc_real_1: 0.2548452963431676 (+0.10274915645519891) | > avg_loss_disc_real_2: 0.26344333092371625 (+0.197533684472243) | > avg_loss_disc_real_3: 0.24432296057542166 (+0.010213688015937805) | > avg_loss_disc_real_4: 0.2421979308128357 (+0.1295222043991089) | > avg_loss_disc_real_5: 0.17134975890318552 (+0.014817853768666567) | > avg_loss_0: 2.647635300954183 (+0.6863992214202883) | > avg_loss_gen: 2.300408124923706 (-0.27430597941080714) | > avg_loss_kl: 4.038285891215007 (-0.26727827390034964) | > avg_loss_feat: 4.264603177706401 (-3.742282509803771) | > avg_loss_mel: 15.616204261779785 (-9.327861467997234) | > avg_loss_duration: 2.9658117294311523 (-0.03866219520568848) | > avg_loss_1: 29.185313542683918 (-13.650389989217121)  > EPOCH: 766/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:54:49)   --> TIME: 2023-10-20 08:55:09 -- STEP: 19/50 -- GLOBAL_STEP: 91320 | > loss_disc: 1.3974006175994873 (2.4764069067804435) | > loss_disc_real_0: 0.06764581054449081 (0.15408085365044444) | > loss_disc_real_1: 0.09043534845113754 (0.21863797856004616) | > loss_disc_real_2: 0.04316583648324013 (0.21810673618395077) | > loss_disc_real_3: 0.08044248819351196 (0.22751613255394132) | > loss_disc_real_4: 0.073649562895298 (0.26297281172714737) | > loss_disc_real_5: 0.04213915765285492 (0.2494302189075633) | > loss_0: 1.3974006175994873 (2.4764069067804435) | > grad_norm_0: tensor(506.6495, device='cuda:0') (tensor(1591.6853, device='cuda:0')) | > loss_gen: 2.6193337440490723 (2.269034059424149) | > loss_kl: 0.8733727931976318 (0.8867080956697464) | > loss_feat: 9.501909255981445 (5.168150042232714) | > loss_mel: 28.236757278442383 (20.97524240769838) | > loss_duration: 1.4957691431045532 (1.4206978270882054) | > loss_1: 42.727142333984375 (30.7198324956392) | > grad_norm_1: tensor(22770.0801, device='cuda:0') (tensor(33590.3945, device='cuda:0')) | > current_lr_0: 9.296931454309007e-05 | > current_lr_1: 9.296931454309007e-05 | > step_time: 0.6127 (0.7529728412628174) | > loader_time: 0.0026 (0.025037778051275956)  --> TIME: 2023-10-20 08:55:29 -- STEP: 49/50 -- GLOBAL_STEP: 91350 | > loss_disc: 2.737504005432129 (2.4675362499392763) | > loss_disc_real_0: 0.845154881477356 (0.1677453570752119) | > loss_disc_real_1: 0.19860637187957764 (0.22048083571146945) | > loss_disc_real_2: 0.12907417118549347 (0.22191594271179366) | > loss_disc_real_3: 0.28431540727615356 (0.2373141285260113) | > loss_disc_real_4: 0.1759832352399826 (0.23629278727636047) | > loss_disc_real_5: 0.3284982144832611 (0.23411344246444654) | > loss_0: 2.737504005432129 (2.4675362499392763) | > grad_norm_0: tensor(3717.8840, device='cuda:0') (tensor(1563.6865, device='cuda:0')) | > loss_gen: 3.6054728031158447 (2.3140108658342946) | > loss_kl: 0.572891891002655 (0.8312394506469065) | > loss_feat: 5.911510467529297 (5.289498408838195) | > loss_mel: 24.797229766845703 (21.243073227454204) | > loss_duration: 1.5588406324386597 (1.4051363322199608) | > loss_1: 36.445945739746094 (31.082958309017883) | > grad_norm_1: tensor(44856.2891, device='cuda:0') (tensor(33956.2070, device='cuda:0')) | > current_lr_0: 9.296931454309007e-05 | > current_lr_1: 9.296931454309007e-05 | > step_time: 0.7014 (0.6601166481874428) | > loader_time: 0.4108 (0.032223356013395356)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5256567001342773 (2.5256567001342773) | > loss_disc_real_0: 0.5412875413894653 (0.5412875413894653) | > loss_disc_real_1: 0.2217426747083664 (0.2217426747083664) | > loss_disc_real_2: 0.26107969880104065 (0.26107969880104065) | > loss_disc_real_3: 0.2598609924316406 (0.2598609924316406) | > loss_disc_real_4: 0.16955697536468506 (0.16955697536468506) | > loss_disc_real_5: 0.06071045249700546 (0.06071045249700546) | > loss_0: 2.5256567001342773 (2.5256567001342773) | > loss_gen: 2.7257142066955566 (2.7257142066955566) | > loss_kl: 5.247685432434082 (5.247685432434082) | > loss_feat: 8.612887382507324 (8.612887382507324) | > loss_mel: 23.356279373168945 (23.356279373168945) | > loss_duration: 3.0007996559143066 (3.0007996559143066) | > loss_1: 42.94336700439453 (42.94336700439453)  --> STEP: 1 | > loss_disc: 2.252554178237915 (2.252554178237915) | > loss_disc_real_0: 0.23619621992111206 (0.23619621992111206) | > loss_disc_real_1: 0.24791879951953888 (0.24791879951953888) | > loss_disc_real_2: 0.21361143887043 (0.21361143887043) | > loss_disc_real_3: 0.15008094906806946 (0.15008094906806946) | > loss_disc_real_4: 0.35114768147468567 (0.35114768147468567) | > loss_disc_real_5: 0.2175397127866745 (0.2175397127866745) | > loss_0: 2.252554178237915 (2.252554178237915) | > loss_gen: 3.237967014312744 (3.237967014312744) | > loss_kl: 4.730788230895996 (4.730788230895996) | > loss_feat: 8.405624389648438 (8.405624389648438) | > loss_mel: 26.021263122558594 (26.021263122558594) | > loss_duration: 3.155811309814453 (3.155811309814453) | > loss_1: 45.551456451416016 (45.551456451416016)  --> STEP: 2 | > loss_disc: 2.4760406017303467 (2.364297389984131) | > loss_disc_real_0: 0.28356659412384033 (0.2598814070224762) | > loss_disc_real_1: 0.2085825800895691 (0.22825068980455399) | > loss_disc_real_2: 0.10803651064634323 (0.1608239747583866) | > loss_disc_real_3: 0.29435205459594727 (0.22221650183200836) | > loss_disc_real_4: 0.2632378935813904 (0.307192787528038) | > loss_disc_real_5: 0.31437569856643677 (0.26595770567655563) | > loss_0: 2.4760406017303467 (2.364297389984131) | > loss_gen: 2.7054970264434814 (2.971732020378113) | > loss_kl: 5.562336444854736 (5.146562337875366) | > loss_feat: 3.1865596771240234 (5.7960920333862305) | > loss_mel: 22.940589904785156 (24.480926513671875) | > loss_duration: 3.102790355682373 (3.129300832748413) | > loss_1: 37.497772216796875 (41.524614334106445)  --> STEP: 3 | > loss_disc: 2.621114492416382 (2.4499030907948813) | > loss_disc_real_0: 0.3701692819595337 (0.29664403200149536) | > loss_disc_real_1: 0.26548123359680176 (0.24066087106863657) | > loss_disc_real_2: 0.22870157659053802 (0.18344984203577042) | > loss_disc_real_3: 0.27377334237098694 (0.23940211534500122) | > loss_disc_real_4: 0.33874061703681946 (0.31770873069763184) | > loss_disc_real_5: 0.4056035578250885 (0.3125063230593999) | > loss_0: 2.621114492416382 (2.4499030907948813) | > loss_gen: 3.5416083335876465 (3.1616907914479575) | > loss_kl: 2.5660693645477295 (4.28639801343282) | > loss_feat: 4.315756320953369 (5.30264679590861) | > loss_mel: 19.616497039794922 (22.85945002237956) | > loss_duration: 2.8155405521392822 (3.0247140725453696) | > loss_1: 32.855472564697266 (38.634900410970054) --> EVAL PERFORMANCE | > avg_loader_time: 0.0035212834676106772 (-0.005132118860880533) | > avg_loss_disc: 2.4499030907948813 (-0.19773221015930176) | > avg_loss_disc_real_0: 0.29664403200149536 (-0.04563784599304199) | > avg_loss_disc_real_1: 0.24066087106863657 (-0.014184425274531037) | > avg_loss_disc_real_2: 0.18344984203577042 (-0.07999348888794583) | > avg_loss_disc_real_3: 0.23940211534500122 (-0.00492084523042044) | > avg_loss_disc_real_4: 0.31770873069763184 (+0.07551079988479614) | > avg_loss_disc_real_5: 0.3125063230593999 (+0.1411565641562144) | > avg_loss_0: 2.4499030907948813 (-0.19773221015930176) | > avg_loss_gen: 3.1616907914479575 (+0.8612826665242515) | > avg_loss_kl: 4.28639801343282 (+0.24811212221781354) | > avg_loss_feat: 5.30264679590861 (+1.0380436182022095) | > avg_loss_mel: 22.85945002237956 (+7.243245760599773) | > avg_loss_duration: 3.0247140725453696 (+0.05890234311421727) | > avg_loss_1: 38.634900410970054 (+9.449586868286136)  > EPOCH: 767/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:55:53)   --> TIME: 2023-10-20 08:56:11 -- STEP: 29/50 -- GLOBAL_STEP: 91380 | > loss_disc: 2.2021265029907227 (2.396740596869896) | > loss_disc_real_0: 0.2302728295326233 (0.15391285248614592) | > loss_disc_real_1: 0.2499672919511795 (0.21823995843015867) | > loss_disc_real_2: 0.16793732345104218 (0.22778091920090132) | > loss_disc_real_3: 0.20108991861343384 (0.23144046050207367) | > loss_disc_real_4: 0.259015291929245 (0.23134985823055793) | > loss_disc_real_5: 0.14042901992797852 (0.22654327499712335) | > loss_0: 2.2021265029907227 (2.396740596869896) | > grad_norm_0: tensor(809.2224, device='cuda:0') (tensor(1253.1342, device='cuda:0')) | > loss_gen: 2.4777050018310547 (2.3697283309081505) | > loss_kl: 0.9492037296295166 (0.8696645025549263) | > loss_feat: 5.636484622955322 (5.684141654392769) | > loss_mel: 21.27067756652832 (20.530995508720135) | > loss_duration: 1.4054386615753174 (1.4137543111011899) | > loss_1: 31.73950958251953 (30.86828425834919) | > grad_norm_1: tensor(7401.9092, device='cuda:0') (tensor(46456.9688, device='cuda:0')) | > current_lr_0: 9.287638589245511e-05 | > current_lr_1: 9.287638589245511e-05 | > step_time: 0.4731 (0.46936048310378503) | > loader_time: 0.0019 (0.011977943880804654)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.834648370742798 (2.834648370742798) | > loss_disc_real_0: 0.3575195372104645 (0.3575195372104645) | > loss_disc_real_1: 0.10662613809108734 (0.10662613809108734) | > loss_disc_real_2: 0.25277474522590637 (0.25277474522590637) | > loss_disc_real_3: 0.1387510597705841 (0.1387510597705841) | > loss_disc_real_4: 0.31788796186447144 (0.31788796186447144) | > loss_disc_real_5: 0.3091045022010803 (0.3091045022010803) | > loss_0: 2.834648370742798 (2.834648370742798) | > loss_gen: 2.078220844268799 (2.078220844268799) | > loss_kl: 5.361659526824951 (5.361659526824951) | > loss_feat: 9.474064826965332 (9.474064826965332) | > loss_mel: 26.497142791748047 (26.497142791748047) | > loss_duration: 2.9743127822875977 (2.9743127822875977) | > loss_1: 46.385398864746094 (46.385398864746094)  --> STEP: 1 | > loss_disc: 2.9938371181488037 (2.9938371181488037) | > loss_disc_real_0: 0.24102646112442017 (0.24102646112442017) | > loss_disc_real_1: 0.31400415301322937 (0.31400415301322937) | > loss_disc_real_2: 0.27243679761886597 (0.27243679761886597) | > loss_disc_real_3: 0.26154783368110657 (0.26154783368110657) | > loss_disc_real_4: 0.22940728068351746 (0.22940728068351746) | > loss_disc_real_5: 0.29870277643203735 (0.29870277643203735) | > loss_0: 2.9938371181488037 (2.9938371181488037) | > loss_gen: 1.6408847570419312 (1.6408847570419312) | > loss_kl: 5.183864593505859 (5.183864593505859) | > loss_feat: 0.05526040494441986 (0.05526040494441986) | > loss_mel: 5.264223575592041 (5.264223575592041) | > loss_duration: 3.2373015880584717 (3.2373015880584717) | > loss_1: 15.381534576416016 (15.381534576416016)  --> STEP: 2 | > loss_disc: 2.6923837661743164 (2.84311044216156) | > loss_disc_real_0: 0.39726197719573975 (0.31914421916007996) | > loss_disc_real_1: 0.25950226187705994 (0.28675320744514465) | > loss_disc_real_2: 0.3168281316757202 (0.2946324646472931) | > loss_disc_real_3: 0.4354341924190521 (0.34849101305007935) | > loss_disc_real_4: 0.29544806480407715 (0.2624276727437973) | > loss_disc_real_5: 0.3685871362686157 (0.33364495635032654) | > loss_0: 2.6923837661743164 (2.84311044216156) | > loss_gen: 3.1763205528259277 (2.4086026549339294) | > loss_kl: 5.183297157287598 (5.1835808753967285) | > loss_feat: 6.45482063293457 (3.255040518939495) | > loss_mel: 21.7907772064209 (13.52750039100647) | > loss_duration: 3.0688436031341553 (3.1530725955963135) | > loss_1: 39.67405700683594 (27.527795791625977)  --> STEP: 3 | > loss_disc: 2.988743782043457 (2.891654888788859) | > loss_disc_real_0: 0.24069055914878845 (0.2929929991563161) | > loss_disc_real_1: 0.3137854039669037 (0.29576393961906433) | > loss_disc_real_2: 0.27259790897369385 (0.2872876127560933) | > loss_disc_real_3: 0.2610166668891907 (0.31933289766311646) | > loss_disc_real_4: 0.22899673879146576 (0.25128402809302014) | > loss_disc_real_5: 0.29863646626472473 (0.3219754596551259) | > loss_0: 2.988743782043457 (2.891654888788859) | > loss_gen: 1.644976258277893 (2.1540605227152505) | > loss_kl: 2.6242141723632812 (4.330458641052246) | > loss_feat: 0.06508159637451172 (2.191720878084501) | > loss_mel: 3.571415662765503 (10.208805481592814) | > loss_duration: 2.8745241165161133 (3.06022310256958) | > loss_1: 10.78021240234375 (21.945267995198567) --> EVAL PERFORMANCE | > avg_loader_time: 0.011431455612182617 (+0.00791017214457194) | > avg_loss_disc: 2.891654888788859 (+0.44175179799397757) | > avg_loss_disc_real_0: 0.2929929991563161 (-0.0036510328451792584) | > avg_loss_disc_real_1: 0.29576393961906433 (+0.055103068550427764) | > avg_loss_disc_real_2: 0.2872876127560933 (+0.10383777072032291) | > avg_loss_disc_real_3: 0.31933289766311646 (+0.07993078231811523) | > avg_loss_disc_real_4: 0.25128402809302014 (-0.0664247026046117) | > avg_loss_disc_real_5: 0.3219754596551259 (+0.009469136595726013) | > avg_loss_0: 2.891654888788859 (+0.44175179799397757) | > avg_loss_gen: 2.1540605227152505 (-1.007630268732707) | > avg_loss_kl: 4.330458641052246 (+0.04406062761942575) | > avg_loss_feat: 2.191720878084501 (-3.1109259178241095) | > avg_loss_mel: 10.208805481592814 (-12.650644540786745) | > avg_loss_duration: 3.06022310256958 (+0.035509030024210464) | > avg_loss_1: 21.945267995198567 (-16.689632415771488)  > EPOCH: 768/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:56:41)   --> TIME: 2023-10-20 08:56:51 -- STEP: 9/50 -- GLOBAL_STEP: 91410 | > loss_disc: 2.316314220428467 (2.369602017932468) | > loss_disc_real_0: 0.1357574164867401 (0.14971141330897808) | > loss_disc_real_1: 0.3074618875980377 (0.22004669863316748) | > loss_disc_real_2: 0.27932190895080566 (0.2728081817428271) | > loss_disc_real_3: 0.2598855197429657 (0.2351510158429543) | > loss_disc_real_4: 0.11732207983732224 (0.24847262766626146) | > loss_disc_real_5: 0.1934303194284439 (0.2757524827288257) | > loss_0: 2.316314220428467 (2.369602017932468) | > grad_norm_0: tensor(753.0712, device='cuda:0') (tensor(890.1074, device='cuda:0')) | > loss_gen: 2.3022801876068115 (2.702457322014703) | > loss_kl: 0.8263562321662903 (0.6988316906823052) | > loss_feat: 6.992946624755859 (7.032266934712728) | > loss_mel: 21.752225875854492 (24.122775395711262) | > loss_duration: 1.35665762424469 (1.4253593418333266) | > loss_1: 33.23046875 (35.981689453125) | > grad_norm_1: tensor(5473.7778, device='cuda:0') (tensor(43209.2305, device='cuda:0')) | > current_lr_0: 9.278355012982469e-05 | > current_lr_1: 9.278355012982469e-05 | > step_time: 0.6236 (0.6449148654937744) | > loader_time: 0.0249 (0.018705500496758357)  --> TIME: 2023-10-20 08:57:08 -- STEP: 39/50 -- GLOBAL_STEP: 91440 | > loss_disc: 2.6958649158477783 (2.383255836291191) | > loss_disc_real_0: 0.08201801031827927 (0.13058650660782292) | > loss_disc_real_1: 0.17453795671463013 (0.22650846304037633) | > loss_disc_real_2: 0.22396765649318695 (0.22503451869273797) | > loss_disc_real_3: 0.2537573575973511 (0.23032117343674868) | > loss_disc_real_4: 0.1428776979446411 (0.24037961002725822) | > loss_disc_real_5: 0.10245165973901749 (0.25015084646069086) | > loss_0: 2.6958649158477783 (2.383255836291191) | > grad_norm_0: tensor(804.1545, device='cuda:0') (tensor(1145.3527, device='cuda:0')) | > loss_gen: 1.6443700790405273 (2.500043260745513) | > loss_kl: 0.7126790285110474 (0.8040073926632222) | > loss_feat: 6.048600196838379 (6.340088554968438) | > loss_mel: 23.641202926635742 (22.19757131429819) | > loss_duration: 1.544645071029663 (1.4066072335610023) | > loss_1: 33.591495513916016 (33.24831785299838) | > grad_norm_1: tensor(25218.2754, device='cuda:0') (tensor(40745.6094, device='cuda:0')) | > current_lr_0: 9.278355012982469e-05 | > current_lr_1: 9.278355012982469e-05 | > step_time: 0.3295 (0.5596495286012306) | > loader_time: 0.0259 (0.020005342287895005)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5889766216278076 (2.5889766216278076) | > loss_disc_real_0: 0.3151700794696808 (0.3151700794696808) | > loss_disc_real_1: 0.22487196326255798 (0.22487196326255798) | > loss_disc_real_2: 0.3002176284790039 (0.3002176284790039) | > loss_disc_real_3: 0.2060423493385315 (0.2060423493385315) | > loss_disc_real_4: 0.296842485666275 (0.296842485666275) | > loss_disc_real_5: 0.37404853105545044 (0.37404853105545044) | > loss_0: 2.5889766216278076 (2.5889766216278076) | > loss_gen: 2.79903507232666 (2.79903507232666) | > loss_kl: 5.543095588684082 (5.543095588684082) | > loss_feat: 5.281890869140625 (5.281890869140625) | > loss_mel: 21.19440460205078 (21.19440460205078) | > loss_duration: 2.913217782974243 (2.913217782974243) | > loss_1: 37.73164367675781 (37.73164367675781)  --> STEP: 1 | > loss_disc: 2.613607406616211 (2.613607406616211) | > loss_disc_real_0: 0.3711804747581482 (0.3711804747581482) | > loss_disc_real_1: 0.31621405482292175 (0.31621405482292175) | > loss_disc_real_2: 0.5073993802070618 (0.5073993802070618) | > loss_disc_real_3: 0.2830871343612671 (0.2830871343612671) | > loss_disc_real_4: 0.3240252733230591 (0.3240252733230591) | > loss_disc_real_5: 0.16384439170360565 (0.16384439170360565) | > loss_0: 2.613607406616211 (2.613607406616211) | > loss_gen: 3.255807399749756 (3.255807399749756) | > loss_kl: 5.006400108337402 (5.006400108337402) | > loss_feat: 6.387765407562256 (6.387765407562256) | > loss_mel: 23.099905014038086 (23.099905014038086) | > loss_duration: 3.0516016483306885 (3.0516016483306885) | > loss_1: 40.80147933959961 (40.80147933959961)  --> STEP: 2 | > loss_disc: 3.2232425212860107 (2.918424963951111) | > loss_disc_real_0: 0.4516853094100952 (0.4114328920841217) | > loss_disc_real_1: 0.23035897314548492 (0.27328651398420334) | > loss_disc_real_2: 0.37462159991264343 (0.4410104900598526) | > loss_disc_real_3: 0.24376121163368225 (0.26342417299747467) | > loss_disc_real_4: 0.2582917809486389 (0.291158527135849) | > loss_disc_real_5: 0.39349856972694397 (0.2786714807152748) | > loss_0: 3.2232425212860107 (2.918424963951111) | > loss_gen: 2.2223453521728516 (2.7390763759613037) | > loss_kl: 5.133415699005127 (5.069907903671265) | > loss_feat: 4.688503265380859 (5.538134336471558) | > loss_mel: 28.312158584594727 (25.706031799316406) | > loss_duration: 2.9130516052246094 (2.982326626777649) | > loss_1: 43.269474029541016 (42.03547668457031)  --> STEP: 3 | > loss_disc: 2.985344171524048 (2.9407313664754233) | > loss_disc_real_0: 0.4774399995803833 (0.43343526124954224) | > loss_disc_real_1: 0.3948655426502228 (0.31381285687287647) | > loss_disc_real_2: 0.3458726406097412 (0.4092978735764821) | > loss_disc_real_3: 0.5223826169967651 (0.3497436543305715) | > loss_disc_real_4: 0.29247644543647766 (0.29159783323605853) | > loss_disc_real_5: 0.2886512577533722 (0.28199807306130725) | > loss_0: 2.985344171524048 (2.9407313664754233) | > loss_gen: 2.884671688079834 (2.7876081466674805) | > loss_kl: 2.3919923305511475 (4.1772693792978925) | > loss_feat: 4.168342590332031 (5.081537087758382) | > loss_mel: 21.30286407470703 (24.238309224446613) | > loss_duration: 2.921884298324585 (2.962179183959961) | > loss_1: 33.66975402832031 (39.24690246582031) --> EVAL PERFORMANCE | > avg_loader_time: 0.008074124654134115 (-0.003357330958048502) | > avg_loss_disc: 2.9407313664754233 (+0.049076477686564424) | > avg_loss_disc_real_0: 0.43343526124954224 (+0.14044226209322613) | > avg_loss_disc_real_1: 0.31381285687287647 (+0.018048917253812136) | > avg_loss_disc_real_2: 0.4092978735764821 (+0.1220102608203888) | > avg_loss_disc_real_3: 0.3497436543305715 (+0.03041075666745502) | > avg_loss_disc_real_4: 0.29159783323605853 (+0.040313805143038395) | > avg_loss_disc_real_5: 0.28199807306130725 (-0.039977386593818665) | > avg_loss_0: 2.9407313664754233 (+0.049076477686564424) | > avg_loss_gen: 2.7876081466674805 (+0.63354762395223) | > avg_loss_kl: 4.1772693792978925 (-0.15318926175435355) | > avg_loss_feat: 5.081537087758382 (+2.889816209673881) | > avg_loss_mel: 24.238309224446613 (+14.0295037428538) | > avg_loss_duration: 2.962179183959961 (-0.09804391860961914) | > avg_loss_1: 39.24690246582031 (+17.301634470621746)  > EPOCH: 769/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:57:31)   --> TIME: 2023-10-20 08:57:55 -- STEP: 19/50 -- GLOBAL_STEP: 91470 | > loss_disc: 2.4572665691375732 (2.4863921090176233) | > loss_disc_real_0: 0.16808761656284332 (0.15238476740686516) | > loss_disc_real_1: 0.24958981573581696 (0.23836206997695722) | > loss_disc_real_2: 0.2534569799900055 (0.23943538904974335) | > loss_disc_real_3: 0.2433578073978424 (0.24304394933738208) | > loss_disc_real_4: 0.11952569335699081 (0.2293255077184815) | > loss_disc_real_5: 0.06614585220813751 (0.23135993864975476) | > loss_0: 2.4572665691375732 (2.4863921090176233) | > grad_norm_0: tensor(1329.7743, device='cuda:0') (tensor(893.3508, device='cuda:0')) | > loss_gen: 2.3405914306640625 (2.287137922487761) | > loss_kl: 1.2125458717346191 (0.9948812707474357) | > loss_feat: 6.605215549468994 (5.166968230354159) | > loss_mel: 25.066652297973633 (22.149978220462803) | > loss_duration: 1.5202199220657349 (1.429773631848787) | > loss_1: 36.7452278137207 (32.028739402168675) | > grad_norm_1: tensor(56777.3906, device='cuda:0') (tensor(44126.7500, device='cuda:0')) | > current_lr_0: 9.26908071623514e-05 | > current_lr_1: 9.26908071623514e-05 | > step_time: 0.6144 (0.615694660889475) | > loader_time: 0.0024 (0.015361610211824117)  --> TIME: 2023-10-20 08:58:15 -- STEP: 49/50 -- GLOBAL_STEP: 91500 | > loss_disc: 2.1039018630981445 (2.4977387287178816) | > loss_disc_real_0: 0.1619390845298767 (0.14468463272692594) | > loss_disc_real_1: 0.16006270051002502 (0.22509542829832252) | > loss_disc_real_2: 0.2027343213558197 (0.2199704840171094) | > loss_disc_real_3: 0.27675503492355347 (0.2488618740925983) | > loss_disc_real_4: 0.21051636338233948 (0.22790027710095961) | > loss_disc_real_5: 0.2074742317199707 (0.22910247028482203) | > loss_0: 2.1039018630981445 (2.4977387287178816) | > grad_norm_0: tensor(1577.3851, device='cuda:0') (tensor(1244.6266, device='cuda:0')) | > loss_gen: 2.6396443843841553 (2.214384662861727) | > loss_kl: 0.6815019249916077 (0.9093814924055216) | > loss_feat: 5.004976272583008 (4.843778938511196) | > loss_mel: 23.208969116210938 (20.800612343817342) | > loss_duration: 1.559671401977539 (1.4103128910064695) | > loss_1: 33.094764709472656 (30.17847050452719) | > grad_norm_1: tensor(86915.4375, device='cuda:0') (tensor(36222.0820, device='cuda:0')) | > current_lr_0: 9.26908071623514e-05 | > current_lr_1: 9.26908071623514e-05 | > step_time: 0.65 (0.6155138405001893) | > loader_time: 0.549 (0.03325646264212472)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8064544200897217 (2.8064544200897217) | > loss_disc_real_0: 0.17760488390922546 (0.17760488390922546) | > loss_disc_real_1: 0.24241343140602112 (0.24241343140602112) | > loss_disc_real_2: 0.3571900427341461 (0.3571900427341461) | > loss_disc_real_3: 0.2875498831272125 (0.2875498831272125) | > loss_disc_real_4: 0.3480032980442047 (0.3480032980442047) | > loss_disc_real_5: 0.29158809781074524 (0.29158809781074524) | > loss_0: 2.8064544200897217 (2.8064544200897217) | > loss_gen: 2.264557123184204 (2.264557123184204) | > loss_kl: 4.385602951049805 (4.385602951049805) | > loss_feat: 5.554968357086182 (5.554968357086182) | > loss_mel: 20.2877140045166 (20.2877140045166) | > loss_duration: 2.8515267372131348 (2.8515267372131348) | > loss_1: 35.3443717956543 (35.3443717956543)  --> STEP: 1 | > loss_disc: 2.592824935913086 (2.592824935913086) | > loss_disc_real_0: 0.23150953650474548 (0.23150953650474548) | > loss_disc_real_1: 0.2674693167209625 (0.2674693167209625) | > loss_disc_real_2: 0.215361550450325 (0.215361550450325) | > loss_disc_real_3: 0.1768719106912613 (0.1768719106912613) | > loss_disc_real_4: 0.2974306046962738 (0.2974306046962738) | > loss_disc_real_5: 0.2022380828857422 (0.2022380828857422) | > loss_0: 2.592824935913086 (2.592824935913086) | > loss_gen: 2.090372085571289 (2.090372085571289) | > loss_kl: 4.276076316833496 (4.276076316833496) | > loss_feat: 5.002696514129639 (5.002696514129639) | > loss_mel: 21.130706787109375 (21.130706787109375) | > loss_duration: 3.0265657901763916 (3.0265657901763916) | > loss_1: 35.52641677856445 (35.52641677856445)  --> STEP: 2 | > loss_disc: 2.5686044692993164 (2.580714702606201) | > loss_disc_real_0: 0.08812247216701508 (0.15981600433588028) | > loss_disc_real_1: 0.17449209094047546 (0.220980703830719) | > loss_disc_real_2: 0.27807825803756714 (0.24671990424394608) | > loss_disc_real_3: 0.3879060447216034 (0.28238897770643234) | > loss_disc_real_4: 0.14778994023799896 (0.22261027246713638) | > loss_disc_real_5: 0.3097931444644928 (0.2560156136751175) | > loss_0: 2.5686044692993164 (2.580714702606201) | > loss_gen: 2.146549701690674 (2.1184608936309814) | > loss_kl: 5.7629075050354 (5.019491910934448) | > loss_feat: 8.001758575439453 (6.502227544784546) | > loss_mel: 25.58776092529297 (23.359233856201172) | > loss_duration: 3.0852816104888916 (3.0559237003326416) | > loss_1: 44.58425521850586 (40.055335998535156)  --> STEP: 3 | > loss_disc: 2.3810977935791016 (2.5141757329305015) | > loss_disc_real_0: 0.19224384427070618 (0.17062528431415558) | > loss_disc_real_1: 0.23240453004837036 (0.22478864590326944) | > loss_disc_real_2: 0.22130075097084045 (0.23824685315291086) | > loss_disc_real_3: 0.26137009263038635 (0.2753826826810837) | > loss_disc_real_4: 0.3001987040042877 (0.24847308297952017) | > loss_disc_real_5: 0.28027209639549255 (0.2641011079152425) | > loss_0: 2.3810977935791016 (2.5141757329305015) | > loss_gen: 2.6232283115386963 (2.2867166996002197) | > loss_kl: 2.553107738494873 (4.19736385345459) | > loss_feat: 4.025938987731934 (5.676798025767009) | > loss_mel: 20.98682975769043 (22.568432490030926) | > loss_duration: 2.848644256591797 (2.986830552419027) | > loss_1: 33.037750244140625 (37.71614074707031) --> EVAL PERFORMANCE | > avg_loader_time: 0.011528809865315756 (+0.0034546852111816406) | > avg_loss_disc: 2.5141757329305015 (-0.4265556335449219) | > avg_loss_disc_real_0: 0.17062528431415558 (-0.26280997693538666) | > avg_loss_disc_real_1: 0.22478864590326944 (-0.08902421096960703) | > avg_loss_disc_real_2: 0.23824685315291086 (-0.17105102042357126) | > avg_loss_disc_real_3: 0.2753826826810837 (-0.0743609716494878) | > avg_loss_disc_real_4: 0.24847308297952017 (-0.04312475025653836) | > avg_loss_disc_real_5: 0.2641011079152425 (-0.01789696514606476) | > avg_loss_0: 2.5141757329305015 (-0.4265556335449219) | > avg_loss_gen: 2.2867166996002197 (-0.5008914470672607) | > avg_loss_kl: 4.19736385345459 (+0.020094474156697295) | > avg_loss_feat: 5.676798025767009 (+0.5952609380086269) | > avg_loss_mel: 22.568432490030926 (-1.6698767344156877) | > avg_loss_duration: 2.986830552419027 (+0.024651368459065903) | > avg_loss_1: 37.71614074707031 (-1.53076171875)  > EPOCH: 770/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:58:30)   --> TIME: 2023-10-20 08:58:52 -- STEP: 29/50 -- GLOBAL_STEP: 91530 | > loss_disc: 3.0041799545288086 (2.550628970409262) | > loss_disc_real_0: 0.1941206157207489 (0.15122749531191998) | > loss_disc_real_1: 0.2635522484779358 (0.23307019279434762) | > loss_disc_real_2: 0.21204504370689392 (0.24067322974061145) | > loss_disc_real_3: 0.2539142966270447 (0.24694354266955934) | > loss_disc_real_4: 0.2599371373653412 (0.243829894361311) | > loss_disc_real_5: 0.2751338481903076 (0.2488954220737876) | > loss_0: 3.0041799545288086 (2.550628970409262) | > grad_norm_0: tensor(2039.8669, device='cuda:0') (tensor(1290.9092, device='cuda:0')) | > loss_gen: 1.507606029510498 (2.2395963874356495) | > loss_kl: 0.7076762318611145 (0.8685861229896545) | > loss_feat: 0.07695142924785614 (5.291144588319906) | > loss_mel: 5.715085983276367 (20.733728832211987) | > loss_duration: 1.414488434791565 (1.418726189383145) | > loss_1: 9.421809196472168 (30.55178198321112) | > grad_norm_1: tensor(70739.1172, device='cuda:0') (tensor(44621.0508, device='cuda:0')) | > current_lr_0: 9.259815689728067e-05 | > current_lr_1: 9.259815689728067e-05 | > step_time: 0.2566 (0.5408801128124368) | > loader_time: 0.0019 (0.0168706959691541)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.031818389892578 (3.031818389892578) | > loss_disc_real_0: 0.39302295446395874 (0.39302295446395874) | > loss_disc_real_1: 0.28997012972831726 (0.28997012972831726) | > loss_disc_real_2: 0.2732761800289154 (0.2732761800289154) | > loss_disc_real_3: 0.2872505187988281 (0.2872505187988281) | > loss_disc_real_4: 0.25113144516944885 (0.25113144516944885) | > loss_disc_real_5: 0.24739715456962585 (0.24739715456962585) | > loss_0: 3.031818389892578 (3.031818389892578) | > loss_gen: 1.7782073020935059 (1.7782073020935059) | > loss_kl: 4.765559673309326 (4.765559673309326) | > loss_feat: 0.1516389548778534 (0.1516389548778534) | > loss_mel: 12.53311538696289 (12.53311538696289) | > loss_duration: 2.862199068069458 (2.862199068069458) | > loss_1: 22.090721130371094 (22.090721130371094)  --> STEP: 1 | > loss_disc: 2.2478084564208984 (2.2478084564208984) | > loss_disc_real_0: 0.21419763565063477 (0.21419763565063477) | > loss_disc_real_1: 0.2720142602920532 (0.2720142602920532) | > loss_disc_real_2: 0.3091253638267517 (0.3091253638267517) | > loss_disc_real_3: 0.28129974007606506 (0.28129974007606506) | > loss_disc_real_4: 0.21426567435264587 (0.21426567435264587) | > loss_disc_real_5: 0.2600346803665161 (0.2600346803665161) | > loss_0: 2.2478084564208984 (2.2478084564208984) | > loss_gen: 3.138338804244995 (3.138338804244995) | > loss_kl: 4.462372779846191 (4.462372779846191) | > loss_feat: 6.247971534729004 (6.247971534729004) | > loss_mel: 23.2403621673584 (23.2403621673584) | > loss_duration: 3.1302449703216553 (3.1302449703216553) | > loss_1: 40.21929168701172 (40.21929168701172)  --> STEP: 2 | > loss_disc: 2.8409719467163086 (2.5443902015686035) | > loss_disc_real_0: 0.21005494892597198 (0.21212629228830338) | > loss_disc_real_1: 0.24729497730731964 (0.25965461879968643) | > loss_disc_real_2: 0.18205435574054718 (0.24558985978364944) | > loss_disc_real_3: 0.14314991235733032 (0.2122248262166977) | > loss_disc_real_4: 0.41378650069236755 (0.3140260875225067) | > loss_disc_real_5: 0.4386071562767029 (0.3493209183216095) | > loss_0: 2.8409719467163086 (2.5443902015686035) | > loss_gen: 2.252372980117798 (2.6953558921813965) | > loss_kl: 5.56364631652832 (5.013009548187256) | > loss_feat: 6.755197048187256 (6.50158429145813) | > loss_mel: 23.681982040405273 (23.461172103881836) | > loss_duration: 2.9297995567321777 (3.0300222635269165) | > loss_1: 41.1829948425293 (40.70114326477051)  --> STEP: 3 | > loss_disc: 2.800899028778076 (2.629893143971761) | > loss_disc_real_0: 0.2052832841873169 (0.20984528958797455) | > loss_disc_real_1: 0.3633883595466614 (0.2942325323820114) | > loss_disc_real_2: 0.3766302764415741 (0.28926999866962433) | > loss_disc_real_3: 0.40036770701408386 (0.2749391198158264) | > loss_disc_real_4: 0.40998464822769165 (0.34601227442423504) | > loss_disc_real_5: 0.37518396973609924 (0.35794193545977276) | > loss_0: 2.800899028778076 (2.629893143971761) | > loss_gen: 3.2657737731933594 (2.885495185852051) | > loss_kl: 2.8102431297302246 (4.278754075368245) | > loss_feat: 4.342266082763672 (5.781811555226644) | > loss_mel: 22.069623947143555 (22.99732271830241) | > loss_duration: 2.7707154750823975 (2.9435866673787436) | > loss_1: 35.25862121582031 (38.886969248453774) --> EVAL PERFORMANCE | > avg_loader_time: 0.013081868489583334 (+0.0015530586242675781) | > avg_loss_disc: 2.629893143971761 (+0.11571741104125977) | > avg_loss_disc_real_0: 0.20984528958797455 (+0.03922000527381897) | > avg_loss_disc_real_1: 0.2942325323820114 (+0.06944388647874197) | > avg_loss_disc_real_2: 0.28926999866962433 (+0.05102314551671347) | > avg_loss_disc_real_3: 0.2749391198158264 (-0.0004435628652572632) | > avg_loss_disc_real_4: 0.34601227442423504 (+0.09753919144471487) | > avg_loss_disc_real_5: 0.35794193545977276 (+0.09384082754453027) | > avg_loss_0: 2.629893143971761 (+0.11571741104125977) | > avg_loss_gen: 2.885495185852051 (+0.598778486251831) | > avg_loss_kl: 4.278754075368245 (+0.0813902219136553) | > avg_loss_feat: 5.781811555226644 (+0.10501352945963482) | > avg_loss_mel: 22.99732271830241 (+0.4288902282714844) | > avg_loss_duration: 2.9435866673787436 (-0.0432438850402832) | > avg_loss_1: 38.886969248453774 (+1.1708285013834612)  > EPOCH: 771/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 08:59:16)   --> TIME: 2023-10-20 08:59:26 -- STEP: 9/50 -- GLOBAL_STEP: 91560 | > loss_disc: 2.536844253540039 (2.090974979930454) | > loss_disc_real_0: 0.08959916979074478 (0.08899975878496964) | > loss_disc_real_1: 0.1456000655889511 (0.2106813204785188) | > loss_disc_real_2: 0.16795605421066284 (0.21524654659960005) | > loss_disc_real_3: 0.3473251461982727 (0.22135413500169912) | > loss_disc_real_4: 0.1387307047843933 (0.20196404887570274) | > loss_disc_real_5: 0.3227575719356537 (0.22124459573792088) | > loss_0: 2.536844253540039 (2.090974979930454) | > grad_norm_0: tensor(1169.7480, device='cuda:0') (tensor(999.0933, device='cuda:0')) | > loss_gen: 2.192678451538086 (2.7874702612559) | > loss_kl: 0.6677573323249817 (0.9200348953406016) | > loss_feat: 6.925490379333496 (7.982050630781385) | > loss_mel: 20.923147201538086 (22.991414388020832) | > loss_duration: 1.368431568145752 (1.400577598147922) | > loss_1: 32.07750701904297 (36.08154805501302) | > grad_norm_1: tensor(74600.8828, device='cuda:0') (tensor(73850.7500, device='cuda:0')) | > current_lr_0: 9.250559924195065e-05 | > current_lr_1: 9.250559924195065e-05 | > step_time: 0.5162 (0.6151652071211073) | > loader_time: 0.0284 (0.026512728797064886)  --> TIME: 2023-10-20 08:59:43 -- STEP: 39/50 -- GLOBAL_STEP: 91590 | > loss_disc: 2.3461155891418457 (2.3103414254310803) | > loss_disc_real_0: 0.3368046283721924 (0.15811944518906948) | > loss_disc_real_1: 0.28004416823387146 (0.21798775832240397) | > loss_disc_real_2: 0.1869814693927765 (0.21093217847056878) | > loss_disc_real_3: 0.25199317932128906 (0.22778248973190784) | > loss_disc_real_4: 0.40384313464164734 (0.19969097181008413) | > loss_disc_real_5: 0.3141052722930908 (0.20150421192057622) | > loss_0: 2.3461155891418457 (2.3103414254310803) | > grad_norm_0: tensor(1574.0430, device='cuda:0') (tensor(1034.1608, device='cuda:0')) | > loss_gen: 3.802104949951172 (2.501359545267545) | > loss_kl: 0.7427682876586914 (0.909405278853881) | > loss_feat: 6.678685188293457 (6.603234788271575) | > loss_mel: 24.303171157836914 (20.791618762872158) | > loss_duration: 1.538726806640625 (1.399283644480583) | > loss_1: 37.06545639038086 (32.204902025369485) | > grad_norm_1: tensor(47373.6562, device='cuda:0') (tensor(54678.1484, device='cuda:0')) | > current_lr_0: 9.250559924195065e-05 | > current_lr_1: 9.250559924195065e-05 | > step_time: 0.8514 (0.5592604417067308) | > loader_time: 0.0049 (0.018080766384418193)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.599710702896118 (2.599710702896118) | > loss_disc_real_0: 0.20587465167045593 (0.20587465167045593) | > loss_disc_real_1: 0.3190069794654846 (0.3190069794654846) | > loss_disc_real_2: 0.27808478474617004 (0.27808478474617004) | > loss_disc_real_3: 0.21732968091964722 (0.21732968091964722) | > loss_disc_real_4: 0.327176570892334 (0.327176570892334) | > loss_disc_real_5: 0.3068716526031494 (0.3068716526031494) | > loss_0: 2.599710702896118 (2.599710702896118) | > loss_gen: 2.4574475288391113 (2.4574475288391113) | > loss_kl: 4.131349086761475 (4.131349086761475) | > loss_feat: 3.8115639686584473 (3.8115639686584473) | > loss_mel: 23.427976608276367 (23.427976608276367) | > loss_duration: 2.8457117080688477 (2.8457117080688477) | > loss_1: 36.674049377441406 (36.674049377441406)  --> STEP: 1 | > loss_disc: 1.2891268730163574 (1.2891268730163574) | > loss_disc_real_0: 0.03340902924537659 (0.03340902924537659) | > loss_disc_real_1: 0.05459165945649147 (0.05459165945649147) | > loss_disc_real_2: 0.12624886631965637 (0.12624886631965637) | > loss_disc_real_3: 0.04010344296693802 (0.04010344296693802) | > loss_disc_real_4: 0.07440071552991867 (0.07440071552991867) | > loss_disc_real_5: 0.03529372438788414 (0.03529372438788414) | > loss_0: 1.2891268730163574 (1.2891268730163574) | > loss_gen: 2.586544990539551 (2.586544990539551) | > loss_kl: 4.484707355499268 (4.484707355499268) | > loss_feat: 12.788127899169922 (12.788127899169922) | > loss_mel: 24.72389793395996 (24.72389793395996) | > loss_duration: 3.0840375423431396 (3.0840375423431396) | > loss_1: 47.66731643676758 (47.66731643676758)  --> STEP: 2 | > loss_disc: 3.0335540771484375 (2.1613404750823975) | > loss_disc_real_0: 0.15806646645069122 (0.0957377478480339) | > loss_disc_real_1: 0.2966078221797943 (0.1755997408181429) | > loss_disc_real_2: 0.29229670763015747 (0.20927278697490692) | > loss_disc_real_3: 0.3421061038970947 (0.19110477343201637) | > loss_disc_real_4: 0.23888859152793884 (0.15664465352892876) | > loss_disc_real_5: 0.2987006902694702 (0.16699720732867718) | > loss_0: 3.0335540771484375 (2.1613404750823975) | > loss_gen: 1.7621080875396729 (2.174326539039612) | > loss_kl: 5.371584415435791 (4.928145885467529) | > loss_feat: 2.399519920349121 (7.5938239097595215) | > loss_mel: 23.543264389038086 (24.133581161499023) | > loss_duration: 2.904402256011963 (2.9942198991775513) | > loss_1: 35.98088073730469 (41.82409858703613)  --> STEP: 3 | > loss_disc: 2.3242886066436768 (2.2156565189361572) | > loss_disc_real_0: 0.22283783555030823 (0.13810444374879202) | > loss_disc_real_1: 0.23594392836093903 (0.19571446999907494) | > loss_disc_real_2: 0.1663815826177597 (0.19497571885585785) | > loss_disc_real_3: 0.18635691702365875 (0.1895221546292305) | > loss_disc_real_4: 0.18771088123321533 (0.16700006276369095) | > loss_disc_real_5: 0.2518972158432007 (0.19529721016685167) | > loss_0: 2.3242886066436768 (2.2156565189361572) | > loss_gen: 2.6986238956451416 (2.3490923245747886) | > loss_kl: 2.2670655250549316 (4.04111909866333) | > loss_feat: 7.111289978027344 (7.432979265848796) | > loss_mel: 23.077001571655273 (23.78138796488444) | > loss_duration: 2.881493330001831 (2.956644376118978) | > loss_1: 38.03547286987305 (40.56122334798177) --> EVAL PERFORMANCE | > avg_loader_time: 0.009856541951497396 (-0.0032253265380859375) | > avg_loss_disc: 2.2156565189361572 (-0.414236625035604) | > avg_loss_disc_real_0: 0.13810444374879202 (-0.07174084583918253) | > avg_loss_disc_real_1: 0.19571446999907494 (-0.09851806238293648) | > avg_loss_disc_real_2: 0.19497571885585785 (-0.09429427981376648) | > avg_loss_disc_real_3: 0.1895221546292305 (-0.08541696518659592) | > avg_loss_disc_real_4: 0.16700006276369095 (-0.1790122116605441) | > avg_loss_disc_real_5: 0.19529721016685167 (-0.1626447252929211) | > avg_loss_0: 2.2156565189361572 (-0.414236625035604) | > avg_loss_gen: 2.3490923245747886 (-0.5364028612772622) | > avg_loss_kl: 4.04111909866333 (-0.23763497670491507) | > avg_loss_feat: 7.432979265848796 (+1.6511677106221523) | > avg_loss_mel: 23.78138796488444 (+0.7840652465820312) | > avg_loss_duration: 2.956644376118978 (+0.013057708740234375) | > avg_loss_1: 40.56122334798177 (+1.6742540995279995)  > EPOCH: 772/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:00:11)   --> TIME: 2023-10-20 09:00:29 -- STEP: 19/50 -- GLOBAL_STEP: 91620 | > loss_disc: 2.7911643981933594 (2.64213962931382) | > loss_disc_real_0: 0.29109257459640503 (0.17510905126599888) | > loss_disc_real_1: 0.3218575417995453 (0.24804280698299408) | > loss_disc_real_2: 0.41043248772621155 (0.25592480364598724) | > loss_disc_real_3: 0.31081628799438477 (0.26002468070701545) | > loss_disc_real_4: 0.32410162687301636 (0.219224394054005) | > loss_disc_real_5: 0.36024487018585205 (0.22016505544122897) | > loss_0: 2.7911643981933594 (2.64213962931382) | > grad_norm_0: tensor(714.9720, device='cuda:0') (tensor(495.0426, device='cuda:0')) | > loss_gen: 2.7933335304260254 (2.0712378150538395) | > loss_kl: 0.8166899681091309 (0.8609655044580761) | > loss_feat: 2.9835879802703857 (4.115143478112786) | > loss_mel: 22.178466796875 (16.687848781284533) | > loss_duration: 1.4931613206863403 (1.4329650841261212) | > loss_1: 30.265239715576172 (25.16816053892437) | > grad_norm_1: tensor(4130.6860, device='cuda:0') (tensor(21806.0078, device='cuda:0')) | > current_lr_0: 9.241313410379211e-05 | > current_lr_1: 9.241313410379211e-05 | > step_time: 0.7033 (0.6505437775662071) | > loader_time: 0.0021 (0.02424925252010948)  --> TIME: 2023-10-20 09:00:48 -- STEP: 49/50 -- GLOBAL_STEP: 91650 | > loss_disc: 2.1942148208618164 (2.4086490334296715) | > loss_disc_real_0: 0.06361941248178482 (0.13797713605192855) | > loss_disc_real_1: 0.18915946781635284 (0.21931380185545707) | > loss_disc_real_2: 0.13644114136695862 (0.22795057654076692) | > loss_disc_real_3: 0.16120831668376923 (0.23866829507965207) | > loss_disc_real_4: 0.2902456820011139 (0.2182011528662881) | > loss_disc_real_5: 0.37819385528564453 (0.23236351186523632) | > loss_0: 2.1942148208618164 (2.4086490334296715) | > grad_norm_0: tensor(771.0018, device='cuda:0') (tensor(553.8401, device='cuda:0')) | > loss_gen: 2.4965360164642334 (2.3474856104169564) | > loss_kl: 0.28808528184890747 (0.8267022204034182) | > loss_feat: 5.658458709716797 (5.399947079544773) | > loss_mel: 23.60495948791504 (19.690675847384394) | > loss_duration: 1.5538440942764282 (1.4100375151147648) | > loss_1: 33.60188293457031 (29.674848322965662) | > grad_norm_1: tensor(16137.0732, device='cuda:0') (tensor(21474.1016, device='cuda:0')) | > current_lr_0: 9.241313410379211e-05 | > current_lr_1: 9.241313410379211e-05 | > step_time: 0.6207 (0.6174803996572691) | > loader_time: 0.3706 (0.025302307946341373)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9131617546081543 (2.9131617546081543) | > loss_disc_real_0: 0.2285694181919098 (0.2285694181919098) | > loss_disc_real_1: 0.20521214604377747 (0.20521214604377747) | > loss_disc_real_2: 0.24359415471553802 (0.24359415471553802) | > loss_disc_real_3: 0.3066939115524292 (0.3066939115524292) | > loss_disc_real_4: 0.2607279419898987 (0.2607279419898987) | > loss_disc_real_5: 0.26793530583381653 (0.26793530583381653) | > loss_0: 2.9131617546081543 (2.9131617546081543) | > loss_gen: 1.6307215690612793 (1.6307215690612793) | > loss_kl: 4.808054447174072 (4.808054447174072) | > loss_feat: 0.6589890718460083 (0.6589890718460083) | > loss_mel: 9.429084777832031 (9.429084777832031) | > loss_duration: 2.848562717437744 (2.848562717437744) | > loss_1: 19.375411987304688 (19.375411987304688)  --> STEP: 1 | > loss_disc: 2.2174673080444336 (2.2174673080444336) | > loss_disc_real_0: 0.16361604630947113 (0.16361604630947113) | > loss_disc_real_1: 0.15460990369319916 (0.15460990369319916) | > loss_disc_real_2: 0.21179473400115967 (0.21179473400115967) | > loss_disc_real_3: 0.22077880799770355 (0.22077880799770355) | > loss_disc_real_4: 0.2217179387807846 (0.2217179387807846) | > loss_disc_real_5: 0.15013855695724487 (0.15013855695724487) | > loss_0: 2.2174673080444336 (2.2174673080444336) | > loss_gen: 2.295766592025757 (2.295766592025757) | > loss_kl: 4.909466743469238 (4.909466743469238) | > loss_feat: 6.170862197875977 (6.170862197875977) | > loss_mel: 24.578609466552734 (24.578609466552734) | > loss_duration: 3.266270637512207 (3.266270637512207) | > loss_1: 41.22097396850586 (41.22097396850586)  --> STEP: 2 | > loss_disc: 2.9886746406555176 (2.6030709743499756) | > loss_disc_real_0: 0.282527893781662 (0.22307197004556656) | > loss_disc_real_1: 0.22715696692466736 (0.19088343530893326) | > loss_disc_real_2: 0.25730618834495544 (0.23455046117305756) | > loss_disc_real_3: 0.27316656708717346 (0.2469726875424385) | > loss_disc_real_4: 0.2852794826030731 (0.25349871069192886) | > loss_disc_real_5: 0.23927687108516693 (0.1947077140212059) | > loss_0: 2.9886746406555176 (2.6030709743499756) | > loss_gen: 1.5845105648040771 (1.940138578414917) | > loss_kl: 5.315993309020996 (5.112730026245117) | > loss_feat: 0.053088728338479996 (3.1119754631072283) | > loss_mel: 3.050100803375244 (13.81435513496399) | > loss_duration: 3.032686233520508 (3.1494784355163574) | > loss_1: 13.03637981414795 (27.128676891326904)  --> STEP: 3 | > loss_disc: 2.773090124130249 (2.6597440242767334) | > loss_disc_real_0: 0.2913684546947479 (0.24583746492862701) | > loss_disc_real_1: 0.40713322162628174 (0.26296669741471607) | > loss_disc_real_2: 0.33978697657585144 (0.2696292996406555) | > loss_disc_real_3: 0.23665736615657806 (0.24353424708048502) | > loss_disc_real_4: 0.2786036431789398 (0.2618670215209325) | > loss_disc_real_5: 0.30505868792533875 (0.23149137198925018) | > loss_0: 2.773090124130249 (2.6597440242767334) | > loss_gen: 2.7184863090515137 (2.199587821960449) | > loss_kl: 2.1246767044067383 (4.116712252298991) | > loss_feat: 4.787484169006348 (3.6704783650736013) | > loss_mel: 26.49018096923828 (18.03963041305542) | > loss_duration: 2.765629768371582 (3.021528879801432) | > loss_1: 38.88645935058594 (31.047937711079914) --> EVAL PERFORMANCE | > avg_loader_time: 0.0051195621490478516 (-0.004736979802449545) | > avg_loss_disc: 2.6597440242767334 (+0.44408750534057617) | > avg_loss_disc_real_0: 0.24583746492862701 (+0.10773302117983499) | > avg_loss_disc_real_1: 0.26296669741471607 (+0.06725222741564113) | > avg_loss_disc_real_2: 0.2696292996406555 (+0.07465358078479767) | > avg_loss_disc_real_3: 0.24353424708048502 (+0.05401209245125452) | > avg_loss_disc_real_4: 0.2618670215209325 (+0.09486695875724155) | > avg_loss_disc_real_5: 0.23149137198925018 (+0.03619416182239851) | > avg_loss_0: 2.6597440242767334 (+0.44408750534057617) | > avg_loss_gen: 2.199587821960449 (-0.14950450261433934) | > avg_loss_kl: 4.116712252298991 (+0.0755931536356611) | > avg_loss_feat: 3.6704783650736013 (-3.7625009007751946) | > avg_loss_mel: 18.03963041305542 (-5.741757551829021) | > avg_loss_duration: 3.021528879801432 (+0.06488450368245413) | > avg_loss_1: 31.047937711079914 (-9.513285636901859)  > EPOCH: 773/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:00:58)   --> TIME: 2023-10-20 09:01:21 -- STEP: 29/50 -- GLOBAL_STEP: 91680 | > loss_disc: 1.500163197517395 (2.4015293573511056) | > loss_disc_real_0: 0.11220943182706833 (0.17156833410263062) | > loss_disc_real_1: 0.19067040085792542 (0.2324343050091431) | > loss_disc_real_2: 0.10375842452049255 (0.2232663816419141) | > loss_disc_real_3: 0.1498340368270874 (0.23841428962247124) | > loss_disc_real_4: 0.08262696117162704 (0.22524618517992825) | > loss_disc_real_5: 0.038179751485586166 (0.210495343913549) | > loss_0: 1.500163197517395 (2.4015293573511056) | > grad_norm_0: tensor(341.7499, device='cuda:0') (tensor(632.8250, device='cuda:0')) | > loss_gen: 2.943763017654419 (2.500911075493385) | > loss_kl: 0.9135590195655823 (0.8670608298531894) | > loss_feat: 9.466954231262207 (6.148967697766834) | > loss_mel: 23.141550064086914 (20.070035761800302) | > loss_duration: 1.392223834991455 (1.4158450323959875) | > loss_1: 37.85805130004883 (31.002820278036182) | > grad_norm_1: tensor(5187.4829, device='cuda:0') (tensor(30019.3164, device='cuda:0')) | > current_lr_0: 9.232076139032836e-05 | > current_lr_1: 9.232076139032836e-05 | > step_time: 0.4145 (0.6078213247759588) | > loader_time: 0.0146 (0.02405569471161941)  > EVALUATION   --> STEP: 0 | > loss_disc: 4.268461227416992 (4.268461227416992) | > loss_disc_real_0: 0.35960593819618225 (0.35960593819618225) | > loss_disc_real_1: 0.5094053149223328 (0.5094053149223328) | > loss_disc_real_2: 0.5276919603347778 (0.5276919603347778) | > loss_disc_real_3: 0.36963576078414917 (0.36963576078414917) | > loss_disc_real_4: 0.5566044449806213 (0.5566044449806213) | > loss_disc_real_5: 0.7518091201782227 (0.7518091201782227) | > loss_0: 4.268461227416992 (4.268461227416992) | > loss_gen: 2.1127071380615234 (2.1127071380615234) | > loss_kl: 5.364445209503174 (5.364445209503174) | > loss_feat: 7.5447235107421875 (7.5447235107421875) | > loss_mel: 23.72351837158203 (23.72351837158203) | > loss_duration: 2.869837999343872 (2.869837999343872) | > loss_1: 41.615230560302734 (41.615230560302734)  --> STEP: 1 | > loss_disc: 2.813471794128418 (2.813471794128418) | > loss_disc_real_0: 0.3671092689037323 (0.3671092689037323) | > loss_disc_real_1: 0.38472670316696167 (0.38472670316696167) | > loss_disc_real_2: 0.4022974669933319 (0.4022974669933319) | > loss_disc_real_3: 0.32893750071525574 (0.32893750071525574) | > loss_disc_real_4: 0.2468470185995102 (0.2468470185995102) | > loss_disc_real_5: 0.2208927720785141 (0.2208927720785141) | > loss_0: 2.813471794128418 (2.813471794128418) | > loss_gen: 2.5747153759002686 (2.5747153759002686) | > loss_kl: 4.652660369873047 (4.652660369873047) | > loss_feat: 5.727860927581787 (5.727860927581787) | > loss_mel: 23.163471221923828 (23.163471221923828) | > loss_duration: 3.1396586894989014 (3.1396586894989014) | > loss_1: 39.258365631103516 (39.258365631103516)  --> STEP: 2 | > loss_disc: 3.2080941200256348 (3.0107829570770264) | > loss_disc_real_0: 0.13013117015361786 (0.24862021952867508) | > loss_disc_real_1: 0.2748374044895172 (0.32978205382823944) | > loss_disc_real_2: 0.34986555576324463 (0.37608151137828827) | > loss_disc_real_3: 0.3189176321029663 (0.323927566409111) | > loss_disc_real_4: 0.4153250455856323 (0.33108603209257126) | > loss_disc_real_5: 0.3523483872413635 (0.2866205796599388) | > loss_0: 3.2080941200256348 (3.0107829570770264) | > loss_gen: 2.0550458431243896 (2.314880609512329) | > loss_kl: 5.077726364135742 (4.8651933670043945) | > loss_feat: 6.916623115539551 (6.322242021560669) | > loss_mel: 25.577163696289062 (24.370317459106445) | > loss_duration: 3.0007834434509277 (3.0702210664749146) | > loss_1: 42.627342224121094 (40.942853927612305)  --> STEP: 3 | > loss_disc: 3.0036239624023438 (3.008396625518799) | > loss_disc_real_0: 0.35878852009773254 (0.2853429863850276) | > loss_disc_real_1: 0.28059691190719604 (0.313387006521225) | > loss_disc_real_2: 0.3345393240451813 (0.36223411560058594) | > loss_disc_real_3: 0.348619669675827 (0.33215826749801636) | > loss_disc_real_4: 0.2914556860923767 (0.3178759167591731) | > loss_disc_real_5: 0.2969447076320648 (0.29006195565064746) | > loss_0: 3.0036239624023438 (3.008396625518799) | > loss_gen: 2.1105711460113525 (2.2467774550120034) | > loss_kl: 2.6289916038513184 (4.119792779286702) | > loss_feat: 3.372882127761841 (5.33912205696106) | > loss_mel: 24.74648666381836 (24.495707194010418) | > loss_duration: 2.8688080310821533 (3.0030833880106607) | > loss_1: 35.72774124145508 (39.20448303222656) --> EVAL PERFORMANCE | > avg_loader_time: 0.028838316599527996 (+0.023718754450480144) | > avg_loss_disc: 3.008396625518799 (+0.34865260124206543) | > avg_loss_disc_real_0: 0.2853429863850276 (+0.03950552145640057) | > avg_loss_disc_real_1: 0.313387006521225 (+0.05042030910650891) | > avg_loss_disc_real_2: 0.36223411560058594 (+0.09260481595993042) | > avg_loss_disc_real_3: 0.33215826749801636 (+0.08862402041753134) | > avg_loss_disc_real_4: 0.3178759167591731 (+0.0560088952382406) | > avg_loss_disc_real_5: 0.29006195565064746 (+0.05857058366139728) | > avg_loss_0: 3.008396625518799 (+0.34865260124206543) | > avg_loss_gen: 2.2467774550120034 (+0.047189633051554214) | > avg_loss_kl: 4.119792779286702 (+0.0030805269877109964) | > avg_loss_feat: 5.33912205696106 (+1.6686436918874583) | > avg_loss_mel: 24.495707194010418 (+6.456076780954998) | > avg_loss_duration: 3.0030833880106607 (-0.018445491790771484) | > avg_loss_1: 39.20448303222656 (+8.156545321146648)  > EPOCH: 774/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:01:48)   --> TIME: 2023-10-20 09:02:06 -- STEP: 9/50 -- GLOBAL_STEP: 91710 | > loss_disc: 2.935753345489502 (2.8771382437811956) | > loss_disc_real_0: 0.1739603728055954 (0.22552338615059853) | > loss_disc_real_1: 0.2575768828392029 (0.24904704176717335) | > loss_disc_real_2: 0.22082243859767914 (0.28516340172953075) | > loss_disc_real_3: 0.24709677696228027 (0.26677677573429215) | > loss_disc_real_4: 0.2604857385158539 (0.30627669725153184) | > loss_disc_real_5: 0.25810158252716064 (0.3172229950626691) | > loss_0: 2.935753345489502 (2.8771382437811956) | > grad_norm_0: tensor(435.2679, device='cuda:0') (tensor(911.9375, device='cuda:0')) | > loss_gen: 1.4838413000106812 (2.070759760008918) | > loss_kl: 0.7449806332588196 (0.8169719808631473) | > loss_feat: 0.34858691692352295 (3.378001261088583) | > loss_mel: 10.95349407196045 (17.54297373029921) | > loss_duration: 1.3958194255828857 (1.413843313852946) | > loss_1: 14.926722526550293 (25.222550021277534) | > grad_norm_1: tensor(7975.8037, device='cuda:0') (tensor(16247.8008, device='cuda:0')) | > current_lr_0: 9.22284810091751e-05 | > current_lr_1: 9.22284810091751e-05 | > step_time: 0.5791 (0.6105002032385932) | > loader_time: 0.0122 (0.02392464213901096)  --> TIME: 2023-10-20 09:02:26 -- STEP: 39/50 -- GLOBAL_STEP: 91740 | > loss_disc: 2.2872984409332275 (2.4796036970921054) | > loss_disc_real_0: 0.1185416504740715 (0.1468062105899056) | > loss_disc_real_1: 0.23597609996795654 (0.23142682350216767) | > loss_disc_real_2: 0.3019300103187561 (0.23612897728498167) | > loss_disc_real_3: 0.18679946660995483 (0.24093340853085884) | > loss_disc_real_4: 0.24611985683441162 (0.2501753715750499) | > loss_disc_real_5: 0.34460341930389404 (0.2508671747472805) | > loss_0: 2.2872984409332275 (2.4796036970921054) | > grad_norm_0: tensor(811.0835, device='cuda:0') (tensor(622.9643, device='cuda:0')) | > loss_gen: 2.561807632446289 (2.336254226855743) | > loss_kl: 0.7759653925895691 (0.8334029744832944) | > loss_feat: 3.4579849243164062 (4.977632961785181) | > loss_mel: 20.233142852783203 (19.919759730497997) | > loss_duration: 1.4914501905441284 (1.408347527186076) | > loss_1: 28.520349502563477 (29.475397574595917) | > grad_norm_1: tensor(4435.0542, device='cuda:0') (tensor(19344.2363, device='cuda:0')) | > current_lr_0: 9.22284810091751e-05 | > current_lr_1: 9.22284810091751e-05 | > step_time: 0.9297 (0.6330975141280737) | > loader_time: 0.0253 (0.020278362127450798)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5988950729370117 (2.5988950729370117) | > loss_disc_real_0: 0.17692464590072632 (0.17692464590072632) | > loss_disc_real_1: 0.3106239140033722 (0.3106239140033722) | > loss_disc_real_2: 0.31949084997177124 (0.31949084997177124) | > loss_disc_real_3: 0.30088722705841064 (0.30088722705841064) | > loss_disc_real_4: 0.2911246716976166 (0.2911246716976166) | > loss_disc_real_5: 0.22796741127967834 (0.22796741127967834) | > loss_0: 2.5988950729370117 (2.5988950729370117) | > loss_gen: 2.5135204792022705 (2.5135204792022705) | > loss_kl: 5.118402481079102 (5.118402481079102) | > loss_feat: 5.526108741760254 (5.526108741760254) | > loss_mel: 22.36098861694336 (22.36098861694336) | > loss_duration: 2.8636763095855713 (2.8636763095855713) | > loss_1: 38.38269805908203 (38.38269805908203)  --> STEP: 1 | > loss_disc: 2.868239641189575 (2.868239641189575) | > loss_disc_real_0: 0.1957322508096695 (0.1957322508096695) | > loss_disc_real_1: 0.26351240277290344 (0.26351240277290344) | > loss_disc_real_2: 0.2602401673793793 (0.2602401673793793) | > loss_disc_real_3: 0.23621107637882233 (0.23621107637882233) | > loss_disc_real_4: 0.24718371033668518 (0.24718371033668518) | > loss_disc_real_5: 0.2315625250339508 (0.2315625250339508) | > loss_0: 2.868239641189575 (2.868239641189575) | > loss_gen: 1.5840277671813965 (1.5840277671813965) | > loss_kl: 4.852513790130615 (4.852513790130615) | > loss_feat: 0.3217160999774933 (0.3217160999774933) | > loss_mel: 12.14120864868164 (12.14120864868164) | > loss_duration: 3.0989580154418945 (3.0989580154418945) | > loss_1: 21.998424530029297 (21.998424530029297)  --> STEP: 2 | > loss_disc: 2.428010940551758 (2.6481252908706665) | > loss_disc_real_0: 0.2323950082063675 (0.2140636295080185) | > loss_disc_real_1: 0.2963007986545563 (0.27990660071372986) | > loss_disc_real_2: 0.23112431168556213 (0.2456822395324707) | > loss_disc_real_3: 0.26622772216796875 (0.25121939927339554) | > loss_disc_real_4: 0.22979284822940826 (0.23848827928304672) | > loss_disc_real_5: 0.2057781219482422 (0.2186703234910965) | > loss_0: 2.428010940551758 (2.6481252908706665) | > loss_gen: 2.5157604217529297 (2.049894094467163) | > loss_kl: 5.104039669036865 (4.97827672958374) | > loss_feat: 4.529019832611084 (2.4253679662942886) | > loss_mel: 23.06230926513672 (17.60175895690918) | > loss_duration: 3.085444211959839 (3.0922011137008667) | > loss_1: 38.296573638916016 (30.147499084472656)  --> STEP: 3 | > loss_disc: 2.8293099403381348 (2.7085201740264893) | > loss_disc_real_0: 0.12211281061172485 (0.18341335654258728) | > loss_disc_real_1: 0.30290549993515015 (0.2875729004542033) | > loss_disc_real_2: 0.297902911901474 (0.2630891303221385) | > loss_disc_real_3: 0.24742040038108826 (0.24995306630929312) | > loss_disc_real_4: 0.27075472474098206 (0.2492437611023585) | > loss_disc_real_5: 0.2544328570365906 (0.2305911680062612) | > loss_0: 2.8293099403381348 (2.7085201740264893) | > loss_gen: 1.6902122497558594 (1.9300001462300618) | > loss_kl: 2.456366539001465 (4.137639999389648) | > loss_feat: 1.0734807252883911 (1.9747388859589894) | > loss_mel: 14.093379974365234 (16.4322992960612) | > loss_duration: 2.8589508533477783 (3.014451026916504) | > loss_1: 22.17238998413086 (27.489129384358723) --> EVAL PERFORMANCE | > avg_loader_time: 0.007267872492472331 (-0.021570444107055664) | > avg_loss_disc: 2.7085201740264893 (-0.29987645149230957) | > avg_loss_disc_real_0: 0.18341335654258728 (-0.1019296298424403) | > avg_loss_disc_real_1: 0.2875729004542033 (-0.02581410606702167) | > avg_loss_disc_real_2: 0.2630891303221385 (-0.09914498527844745) | > avg_loss_disc_real_3: 0.24995306630929312 (-0.08220520118872324) | > avg_loss_disc_real_4: 0.2492437611023585 (-0.0686321556568146) | > avg_loss_disc_real_5: 0.2305911680062612 (-0.059470787644386264) | > avg_loss_0: 2.7085201740264893 (-0.29987645149230957) | > avg_loss_gen: 1.9300001462300618 (-0.31677730878194166) | > avg_loss_kl: 4.137639999389648 (+0.01784722010294626) | > avg_loss_feat: 1.9747388859589894 (-3.3643831710020704) | > avg_loss_mel: 16.4322992960612 (-8.063407897949219) | > avg_loss_duration: 3.014451026916504 (+0.011367638905843247) | > avg_loss_1: 27.489129384358723 (-11.71535364786784)  > EPOCH: 775/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:02:49)   --> TIME: 2023-10-20 09:03:02 -- STEP: 19/50 -- GLOBAL_STEP: 91770 | > loss_disc: 2.597813367843628 (2.4640686825702063) | > loss_disc_real_0: 0.2857128977775574 (0.15073707768399464) | > loss_disc_real_1: 0.36085808277130127 (0.26505242915529953) | > loss_disc_real_2: 0.20146282017230988 (0.2208232560047978) | > loss_disc_real_3: 0.4068160355091095 (0.2724860549757355) | > loss_disc_real_4: 0.278705358505249 (0.2432682853388159) | > loss_disc_real_5: 0.13784630596637726 (0.24001169474305292) | > loss_0: 2.597813367843628 (2.4640686825702063) | > grad_norm_0: tensor(1221.7638, device='cuda:0') (tensor(731.2948, device='cuda:0')) | > loss_gen: 2.555124282836914 (2.391507625579834) | > loss_kl: 0.9848452210426331 (0.8368063420057297) | > loss_feat: 4.651079177856445 (5.245992925606276) | > loss_mel: 19.597158432006836 (22.290222920869525) | > loss_duration: 1.464633822441101 (1.4350164062098454) | > loss_1: 29.252840042114258 (32.19954560932361) | > grad_norm_1: tensor(19704.6328, device='cuda:0') (tensor(15995.0957, device='cuda:0')) | > current_lr_0: 9.213629286804042e-05 | > current_lr_1: 9.213629286804042e-05 | > step_time: 0.2534 (0.44856702653985275) | > loader_time: 0.0018 (0.011166221217105263)  --> TIME: 2023-10-20 09:03:17 -- STEP: 49/50 -- GLOBAL_STEP: 91800 | > loss_disc: 1.6117916107177734 (2.511995901866834) | > loss_disc_real_0: 0.12597286701202393 (0.1551312082732211) | > loss_disc_real_1: 0.16366678476333618 (0.24098684212991173) | > loss_disc_real_2: 0.1427738517522812 (0.222713440428583) | > loss_disc_real_3: 0.19548046588897705 (0.24068668522700973) | > loss_disc_real_4: 0.17221185564994812 (0.24330967793963393) | > loss_disc_real_5: 0.11130642890930176 (0.23742159216531686) | > loss_0: 1.6117916107177734 (2.511995901866834) | > grad_norm_0: tensor(316.2082, device='cuda:0') (tensor(696.5497, device='cuda:0')) | > loss_gen: 3.3882322311401367 (2.265772607861732) | > loss_kl: 0.38023948669433594 (0.8118642307057673) | > loss_feat: 9.477438926696777 (4.686629744512694) | > loss_mel: 24.334070205688477 (20.39354978288923) | > loss_duration: 1.524253249168396 (1.4101098678549941) | > loss_1: 39.1042366027832 (29.567925813246745) | > grad_norm_1: tensor(47774.1719, device='cuda:0') (tensor(15997.3057, device='cuda:0')) | > current_lr_0: 9.213629286804042e-05 | > current_lr_1: 9.213629286804042e-05 | > step_time: 0.8928 (0.4648123906583202) | > loader_time: 0.449 (0.016756996816518356)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0021700859069824 (3.0021700859069824) | > loss_disc_real_0: 0.17746135592460632 (0.17746135592460632) | > loss_disc_real_1: 0.2803005874156952 (0.2803005874156952) | > loss_disc_real_2: 0.28433889150619507 (0.28433889150619507) | > loss_disc_real_3: 0.273137629032135 (0.273137629032135) | > loss_disc_real_4: 0.23660878837108612 (0.23660878837108612) | > loss_disc_real_5: 0.2654440999031067 (0.2654440999031067) | > loss_0: 3.0021700859069824 (3.0021700859069824) | > loss_gen: 1.5334104299545288 (1.5334104299545288) | > loss_kl: 4.4644646644592285 (4.4644646644592285) | > loss_feat: 0.04321175813674927 (0.04321175813674927) | > loss_mel: 1.2959201335906982 (1.2959201335906982) | > loss_duration: 2.8408420085906982 (2.8408420085906982) | > loss_1: 10.177848815917969 (10.177848815917969)  --> STEP: 1 | > loss_disc: 2.776921510696411 (2.776921510696411) | > loss_disc_real_0: 0.16663968563079834 (0.16663968563079834) | > loss_disc_real_1: 0.2679372727870941 (0.2679372727870941) | > loss_disc_real_2: 0.30221763253211975 (0.30221763253211975) | > loss_disc_real_3: 0.22719982266426086 (0.22719982266426086) | > loss_disc_real_4: 0.3055625557899475 (0.3055625557899475) | > loss_disc_real_5: 0.20357558131217957 (0.20357558131217957) | > loss_0: 2.776921510696411 (2.776921510696411) | > loss_gen: 2.0533580780029297 (2.0533580780029297) | > loss_kl: 4.614251136779785 (4.614251136779785) | > loss_feat: 4.9319610595703125 (4.9319610595703125) | > loss_mel: 24.088733673095703 (24.088733673095703) | > loss_duration: 3.1867995262145996 (3.1867995262145996) | > loss_1: 38.875099182128906 (38.875099182128906)  --> STEP: 2 | > loss_disc: 1.8315019607543945 (2.304211735725403) | > loss_disc_real_0: 0.09891436994075775 (0.13277702778577805) | > loss_disc_real_1: 0.22061596810817719 (0.24427662044763565) | > loss_disc_real_2: 0.17288680374622345 (0.2375522181391716) | > loss_disc_real_3: 0.24658168852329254 (0.2368907555937767) | > loss_disc_real_4: 0.1742333024740219 (0.2398979291319847) | > loss_disc_real_5: 0.08507481962442398 (0.14432520046830177) | > loss_0: 1.8315019607543945 (2.304211735725403) | > loss_gen: 2.636366128921509 (2.3448621034622192) | > loss_kl: 4.666459560394287 (4.640355348587036) | > loss_feat: 11.152118682861328 (8.04203987121582) | > loss_mel: 21.91561508178711 (23.002174377441406) | > loss_duration: 3.0236968994140625 (3.105248212814331) | > loss_1: 43.394256591796875 (41.13467788696289)  --> STEP: 3 | > loss_disc: 3.411646842956543 (2.673356771469116) | > loss_disc_real_0: 0.1653534471988678 (0.14363583425680795) | > loss_disc_real_1: 0.4074128270149231 (0.2986553559700648) | > loss_disc_real_2: 0.46688440442085266 (0.3139962802330653) | > loss_disc_real_3: 0.43012097477912903 (0.3013008286555608) | > loss_disc_real_4: 0.33811327815055847 (0.27263637880484265) | > loss_disc_real_5: 0.37261632084846497 (0.22042224059502283) | > loss_0: 3.411646842956543 (2.673356771469116) | > loss_gen: 1.979716181755066 (2.2231467962265015) | > loss_kl: 2.8882904052734375 (4.056333700815837) | > loss_feat: 3.9695870876312256 (6.684555610020955) | > loss_mel: 23.92876625061035 (23.311038335164387) | > loss_duration: 2.8184568881988525 (3.0096511046091714) | > loss_1: 35.58481979370117 (39.284725189208984) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028640429178873696 (-0.004403829574584961) | > avg_loss_disc: 2.673356771469116 (-0.03516340255737305) | > avg_loss_disc_real_0: 0.14363583425680795 (-0.039777522285779326) | > avg_loss_disc_real_1: 0.2986553559700648 (+0.011082455515861511) | > avg_loss_disc_real_2: 0.3139962802330653 (+0.05090714991092682) | > avg_loss_disc_real_3: 0.3013008286555608 (+0.05134776234626767) | > avg_loss_disc_real_4: 0.27263637880484265 (+0.02339261770248416) | > avg_loss_disc_real_5: 0.22042224059502283 (-0.010168927411238371) | > avg_loss_0: 2.673356771469116 (-0.03516340255737305) | > avg_loss_gen: 2.2231467962265015 (+0.2931466499964397) | > avg_loss_kl: 4.056333700815837 (-0.08130629857381155) | > avg_loss_feat: 6.684555610020955 (+4.709816724061966) | > avg_loss_mel: 23.311038335164387 (+6.878739039103188) | > avg_loss_duration: 3.0096511046091714 (-0.004799922307332505) | > avg_loss_1: 39.284725189208984 (+11.795595804850262)  > EPOCH: 776/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:03:38)   --> TIME: 2023-10-20 09:04:02 -- STEP: 29/50 -- GLOBAL_STEP: 91830 | > loss_disc: 2.056741237640381 (2.3260836786237267) | > loss_disc_real_0: 0.13509289920330048 (0.14217945172226631) | > loss_disc_real_1: 0.10539870709180832 (0.19899272732436657) | > loss_disc_real_2: 0.1572684943675995 (0.21159515048152414) | > loss_disc_real_3: 0.2773289084434509 (0.2332897861006445) | > loss_disc_real_4: 0.3214746117591858 (0.23160909803519988) | > loss_disc_real_5: 0.22563600540161133 (0.22091094532917285) | > loss_0: 2.056741237640381 (2.3260836786237267) | > grad_norm_0: tensor(540.2408, device='cuda:0') (tensor(582.6863, device='cuda:0')) | > loss_gen: 2.8589022159576416 (2.5457055692015023) | > loss_kl: 0.926412045955658 (0.8789090524459707) | > loss_feat: 6.253024578094482 (6.783083180415219) | > loss_mel: 22.109947204589844 (21.664218684722645) | > loss_duration: 1.3557460308074951 (1.4060837770330494) | > loss_1: 33.504032135009766 (33.27800058496409) | > grad_norm_1: tensor(36576.7383, device='cuda:0') (tensor(26728.0156, device='cuda:0')) | > current_lr_0: 9.204419687472464e-05 | > current_lr_1: 9.204419687472464e-05 | > step_time: 0.8689 (0.625910972726756) | > loader_time: 0.0251 (0.025075994688889075)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.546347141265869 (2.546347141265869) | > loss_disc_real_0: 0.31205546855926514 (0.31205546855926514) | > loss_disc_real_1: 0.2661508321762085 (0.2661508321762085) | > loss_disc_real_2: 0.166151762008667 (0.166151762008667) | > loss_disc_real_3: 0.21238099038600922 (0.21238099038600922) | > loss_disc_real_4: 0.3020040988922119 (0.3020040988922119) | > loss_disc_real_5: 0.3429073691368103 (0.3429073691368103) | > loss_0: 2.546347141265869 (2.546347141265869) | > loss_gen: 2.533705949783325 (2.533705949783325) | > loss_kl: 4.667078018188477 (4.667078018188477) | > loss_feat: 7.062175750732422 (7.062175750732422) | > loss_mel: 26.85741424560547 (26.85741424560547) | > loss_duration: 2.9546103477478027 (2.9546103477478027) | > loss_1: 44.07498550415039 (44.07498550415039)  --> STEP: 1 | > loss_disc: 2.9242606163024902 (2.9242606163024902) | > loss_disc_real_0: 0.37322986125946045 (0.37322986125946045) | > loss_disc_real_1: 0.20683521032333374 (0.20683521032333374) | > loss_disc_real_2: 0.2452811598777771 (0.2452811598777771) | > loss_disc_real_3: 0.1941775381565094 (0.1941775381565094) | > loss_disc_real_4: 0.3355420231819153 (0.3355420231819153) | > loss_disc_real_5: 0.4096280038356781 (0.4096280038356781) | > loss_0: 2.9242606163024902 (2.9242606163024902) | > loss_gen: 2.204202651977539 (2.204202651977539) | > loss_kl: 4.536313533782959 (4.536313533782959) | > loss_feat: 6.301924705505371 (6.301924705505371) | > loss_mel: 25.165193557739258 (25.165193557739258) | > loss_duration: 3.2007949352264404 (3.2007949352264404) | > loss_1: 41.40842819213867 (41.40842819213867)  --> STEP: 2 | > loss_disc: 2.796691417694092 (2.860476016998291) | > loss_disc_real_0: 0.042750440537929535 (0.207990150898695) | > loss_disc_real_1: 0.19135135412216187 (0.1990932822227478) | > loss_disc_real_2: 0.32911235094070435 (0.2871967554092407) | > loss_disc_real_3: 0.1282488852739334 (0.1612132117152214) | > loss_disc_real_4: 0.31488877534866333 (0.3252153992652893) | > loss_disc_real_5: 0.3246210515499115 (0.3671245276927948) | > loss_0: 2.796691417694092 (2.860476016998291) | > loss_gen: 2.0915942192077637 (2.1478984355926514) | > loss_kl: 4.897393226623535 (4.716853380203247) | > loss_feat: 6.613851070404053 (6.457887887954712) | > loss_mel: 28.691896438598633 (26.928544998168945) | > loss_duration: 3.132594585418701 (3.166694760322571) | > loss_1: 45.427330017089844 (43.41787910461426)  --> STEP: 3 | > loss_disc: 2.861010789871216 (2.860654274622599) | > loss_disc_real_0: 0.4331437349319458 (0.2830413455764453) | > loss_disc_real_1: 0.1984540969133377 (0.19888022045294443) | > loss_disc_real_2: 0.3646542429924011 (0.3130159179369609) | > loss_disc_real_3: 0.23395659029483795 (0.1854610045750936) | > loss_disc_real_4: 0.364925354719162 (0.3384520510832469) | > loss_disc_real_5: 0.39424070715904236 (0.376163254181544) | > loss_0: 2.861010789871216 (2.860654274622599) | > loss_gen: 2.6376352310180664 (2.3111440340677896) | > loss_kl: 2.252685308456421 (3.895464022954305) | > loss_feat: 3.223045587539673 (5.379607121149699) | > loss_mel: 22.926549911499023 (25.594546635945637) | > loss_duration: 2.8803255558013916 (3.071238358815511) | > loss_1: 33.92024230957031 (40.252000172932945) --> EVAL PERFORMANCE | > avg_loader_time: 0.03346880276997884 (+0.030604759852091473) | > avg_loss_disc: 2.860654274622599 (+0.18729750315348292) | > avg_loss_disc_real_0: 0.2830413455764453 (+0.13940551131963733) | > avg_loss_disc_real_1: 0.19888022045294443 (-0.09977513551712039) | > avg_loss_disc_real_2: 0.3130159179369609 (-0.0009803622961044312) | > avg_loss_disc_real_3: 0.1854610045750936 (-0.1158398240804672) | > avg_loss_disc_real_4: 0.3384520510832469 (+0.06581567227840424) | > avg_loss_disc_real_5: 0.376163254181544 (+0.15574101358652118) | > avg_loss_0: 2.860654274622599 (+0.18729750315348292) | > avg_loss_gen: 2.3111440340677896 (+0.0879972378412881) | > avg_loss_kl: 3.895464022954305 (-0.16086967786153172) | > avg_loss_feat: 5.379607121149699 (-1.304948488871256) | > avg_loss_mel: 25.594546635945637 (+2.28350830078125) | > avg_loss_duration: 3.071238358815511 (+0.061587254206339814) | > avg_loss_1: 40.252000172932945 (+0.9672749837239607)  > EPOCH: 777/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:04:29)   --> TIME: 2023-10-20 09:04:40 -- STEP: 9/50 -- GLOBAL_STEP: 91860 | > loss_disc: 2.5638675689697266 (2.4145110845565796) | > loss_disc_real_0: 0.2821701169013977 (0.18401728736029732) | > loss_disc_real_1: 0.30562955141067505 (0.21542641975813442) | > loss_disc_real_2: 0.23089462518692017 (0.2136495378282335) | > loss_disc_real_3: 0.2818862199783325 (0.2193804888261689) | > loss_disc_real_4: 0.23576195538043976 (0.21432691895299488) | > loss_disc_real_5: 0.27578240633010864 (0.2488730162796047) | > loss_0: 2.5638675689697266 (2.4145110845565796) | > grad_norm_0: tensor(609.3353, device='cuda:0') (tensor(688.8205, device='cuda:0')) | > loss_gen: 2.5399391651153564 (2.4332440031899347) | > loss_kl: 0.49250927567481995 (0.7507610668738683) | > loss_feat: 3.9582700729370117 (5.717671222156948) | > loss_mel: 22.30953025817871 (22.619874000549316) | > loss_duration: 1.4251989126205444 (1.4014962249332004) | > loss_1: 30.725448608398438 (32.923046323988174) | > grad_norm_1: tensor(7403.2168, device='cuda:0') (tensor(12639.3770, device='cuda:0')) | > current_lr_0: 9.195219293712026e-05 | > current_lr_1: 9.195219293712026e-05 | > step_time: 0.3305 (0.3847038480970595) | > loader_time: 0.0025 (0.0054518381754557295)  --> TIME: 2023-10-20 09:04:57 -- STEP: 39/50 -- GLOBAL_STEP: 91890 | > loss_disc: 2.3408989906311035 (2.45251456896464) | > loss_disc_real_0: 0.2437799870967865 (0.15905967798943701) | > loss_disc_real_1: 0.18726080656051636 (0.2146099923321834) | > loss_disc_real_2: 0.24631930887699127 (0.21287290207468545) | > loss_disc_real_3: 0.30255481600761414 (0.22720545377486792) | > loss_disc_real_4: 0.1725710928440094 (0.2305817924057826) | > loss_disc_real_5: 0.10138920694589615 (0.2306551294735609) | > loss_0: 2.3408989906311035 (2.45251456896464) | > grad_norm_0: tensor(595.0644, device='cuda:0') (tensor(717.2809, device='cuda:0')) | > loss_gen: 2.3798956871032715 (2.230623914645268) | > loss_kl: 0.30026912689208984 (0.786396215741451) | > loss_feat: 4.110757827758789 (4.62820999763715) | > loss_mel: 19.889263153076172 (19.862200504694233) | > loss_duration: 1.4241083860397339 (1.390216017380739) | > loss_1: 28.104293823242188 (28.897646451607727) | > grad_norm_1: tensor(4595.1572, device='cuda:0') (tensor(17160.3535, device='cuda:0')) | > current_lr_0: 9.195219293712026e-05 | > current_lr_1: 9.195219293712026e-05 | > step_time: 0.5495 (0.5191470537430201) | > loader_time: 0.0082 (0.015468890850360576)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7776598930358887 (2.7776598930358887) | > loss_disc_real_0: 0.3568990230560303 (0.3568990230560303) | > loss_disc_real_1: 0.2895522117614746 (0.2895522117614746) | > loss_disc_real_2: 0.17990140616893768 (0.17990140616893768) | > loss_disc_real_3: 0.31511467695236206 (0.31511467695236206) | > loss_disc_real_4: 0.26283806562423706 (0.26283806562423706) | > loss_disc_real_5: 0.2348150759935379 (0.2348150759935379) | > loss_0: 2.7776598930358887 (2.7776598930358887) | > loss_gen: 2.0895395278930664 (2.0895395278930664) | > loss_kl: 4.5878448486328125 (4.5878448486328125) | > loss_feat: 1.1126564741134644 (1.1126564741134644) | > loss_mel: 17.702800750732422 (17.702800750732422) | > loss_duration: 2.925767421722412 (2.925767421722412) | > loss_1: 28.418607711791992 (28.418607711791992)  --> STEP: 1 | > loss_disc: 2.9629297256469727 (2.9629297256469727) | > loss_disc_real_0: 0.37312382459640503 (0.37312382459640503) | > loss_disc_real_1: 0.27629581093788147 (0.27629581093788147) | > loss_disc_real_2: 0.22792461514472961 (0.22792461514472961) | > loss_disc_real_3: 0.3167347013950348 (0.3167347013950348) | > loss_disc_real_4: 0.2524527907371521 (0.2524527907371521) | > loss_disc_real_5: 0.2396702617406845 (0.2396702617406845) | > loss_0: 2.9629297256469727 (2.9629297256469727) | > loss_gen: 1.8268799781799316 (1.8268799781799316) | > loss_kl: 4.856956958770752 (4.856956958770752) | > loss_feat: 0.3334089517593384 (0.3334089517593384) | > loss_mel: 13.186418533325195 (13.186418533325195) | > loss_duration: 3.2206382751464844 (3.2206382751464844) | > loss_1: 23.42430305480957 (23.42430305480957)  --> STEP: 2 | > loss_disc: 2.0817720890045166 (2.5223509073257446) | > loss_disc_real_0: 0.2537021040916443 (0.31341296434402466) | > loss_disc_real_1: 0.1400006115436554 (0.20814821124076843) | > loss_disc_real_2: 0.13768218457698822 (0.18280339986085892) | > loss_disc_real_3: 0.23678168654441833 (0.27675819396972656) | > loss_disc_real_4: 0.2482782006263733 (0.2503654956817627) | > loss_disc_real_5: 0.23921433091163635 (0.23944229632616043) | > loss_0: 2.0817720890045166 (2.5223509073257446) | > loss_gen: 3.1396350860595703 (2.483257532119751) | > loss_kl: 5.698190689086914 (5.277573823928833) | > loss_feat: 8.369932174682617 (4.351670563220978) | > loss_mel: 21.50547981262207 (17.345949172973633) | > loss_duration: 2.9563941955566406 (3.0885162353515625) | > loss_1: 41.66962814331055 (32.54696559906006)  --> STEP: 3 | > loss_disc: 2.5805041790008545 (2.5417353312174478) | > loss_disc_real_0: 0.4135735034942627 (0.3467998107274373) | > loss_disc_real_1: 0.2965223789215088 (0.23760626713434854) | > loss_disc_real_2: 0.3040400743484497 (0.22321562469005585) | > loss_disc_real_3: 0.32295534014701843 (0.29215724269549054) | > loss_disc_real_4: 0.29476025700569153 (0.26516374945640564) | > loss_disc_real_5: 0.2836201786994934 (0.2541682571172714) | > loss_0: 2.5805041790008545 (2.5417353312174478) | > loss_gen: 3.1082024574279785 (2.6915725072224936) | > loss_kl: 2.3941495418548584 (4.316432396570842) | > loss_feat: 3.054551124572754 (3.9192974170049033) | > loss_mel: 19.553646087646484 (18.08184814453125) | > loss_duration: 2.9836971759796143 (3.0535765488942466) | > loss_1: 31.09424591064453 (32.06272570292155) --> EVAL PERFORMANCE | > avg_loader_time: 0.005110581715901692 (-0.028358221054077152) | > avg_loss_disc: 2.5417353312174478 (-0.31891894340515137) | > avg_loss_disc_real_0: 0.3467998107274373 (+0.06375846515099204) | > avg_loss_disc_real_1: 0.23760626713434854 (+0.038726046681404114) | > avg_loss_disc_real_2: 0.22321562469005585 (-0.08980029324690503) | > avg_loss_disc_real_3: 0.29215724269549054 (+0.10669623812039694) | > avg_loss_disc_real_4: 0.26516374945640564 (-0.07328830162684125) | > avg_loss_disc_real_5: 0.2541682571172714 (-0.12199499706427258) | > avg_loss_0: 2.5417353312174478 (-0.31891894340515137) | > avg_loss_gen: 2.6915725072224936 (+0.38042847315470407) | > avg_loss_kl: 4.316432396570842 (+0.4209683736165366) | > avg_loss_feat: 3.9192974170049033 (-1.4603097041447959) | > avg_loss_mel: 18.08184814453125 (-7.512698491414387) | > avg_loss_duration: 3.0535765488942466 (-0.01766180992126465) | > avg_loss_1: 32.06272570292155 (-8.189274470011398)  > EPOCH: 778/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:05:33)   --> TIME: 2023-10-20 09:05:48 -- STEP: 19/50 -- GLOBAL_STEP: 91920 | > loss_disc: 2.8912856578826904 (2.479464098026878) | > loss_disc_real_0: 0.2797155976295471 (0.15700223875281058) | > loss_disc_real_1: 0.2674884796142578 (0.22705485779596002) | > loss_disc_real_2: 0.17643386125564575 (0.21809133514761925) | > loss_disc_real_3: 0.2783444821834564 (0.24041600407738434) | > loss_disc_real_4: 0.26011836528778076 (0.20662398038333968) | > loss_disc_real_5: 0.2727679908275604 (0.22322600138814827) | > loss_0: 2.8912856578826904 (2.479464098026878) | > grad_norm_0: tensor(649.5671, device='cuda:0') (tensor(879.1425, device='cuda:0')) | > loss_gen: 1.664035677909851 (2.2343821776540658) | > loss_kl: 0.7039419412612915 (0.9139765250055414) | > loss_feat: 0.783287525177002 (5.023335534098901) | > loss_mel: 19.93260955810547 (20.198926549208792) | > loss_duration: 1.4852555990219116 (1.4239119479530735) | > loss_1: 24.56913185119629 (29.79453300174914) | > grad_norm_1: tensor(8953.6699, device='cuda:0') (tensor(20202.6445, device='cuda:0')) | > current_lr_0: 9.186028096321183e-05 | > current_lr_1: 9.186028096321183e-05 | > step_time: 0.3155 (0.5328111523076108) | > loader_time: 0.002 (0.014521950169613487)  --> TIME: 2023-10-20 09:06:04 -- STEP: 49/50 -- GLOBAL_STEP: 91950 | > loss_disc: 1.7075910568237305 (2.452792048454285) | > loss_disc_real_0: 0.1497458517551422 (0.14508769623174958) | > loss_disc_real_1: 0.09719880670309067 (0.22470646910369396) | > loss_disc_real_2: 0.12160813063383102 (0.2175829160426344) | > loss_disc_real_3: 0.096430703997612 (0.2323545822303514) | > loss_disc_real_4: 0.4195792078971863 (0.21110959792015505) | > loss_disc_real_5: 0.05756218358874321 (0.23264250714255838) | > loss_0: 1.7075910568237305 (2.452792048454285) | > grad_norm_0: tensor(669.1500, device='cuda:0') (tensor(805.2269, device='cuda:0')) | > loss_gen: 3.9398653507232666 (2.288583563298596) | > loss_kl: 0.7497796416282654 (0.8332829834247122) | > loss_feat: 11.051470756530762 (5.216305443370829) | > loss_mel: 25.16717529296875 (20.774216428094984) | > loss_duration: 1.4928767681121826 (1.397737897172266) | > loss_1: 42.40116882324219 (30.510126571266017) | > grad_norm_1: tensor(41228.0273, device='cuda:0') (tensor(20756.7871, device='cuda:0')) | > current_lr_0: 9.186028096321183e-05 | > current_lr_1: 9.186028096321183e-05 | > step_time: 0.3636 (0.5234554689757678) | > loader_time: 0.4352 (0.020084955254379585)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.913766860961914 (2.913766860961914) | > loss_disc_real_0: 0.31283822655677795 (0.31283822655677795) | > loss_disc_real_1: 0.25041139125823975 (0.25041139125823975) | > loss_disc_real_2: 0.28158220648765564 (0.28158220648765564) | > loss_disc_real_3: 0.26377683877944946 (0.26377683877944946) | > loss_disc_real_4: 0.2639821767807007 (0.2639821767807007) | > loss_disc_real_5: 0.31442099809646606 (0.31442099809646606) | > loss_0: 2.913766860961914 (2.913766860961914) | > loss_gen: 1.841133713722229 (1.841133713722229) | > loss_kl: 4.561246395111084 (4.561246395111084) | > loss_feat: 0.29187771677970886 (0.29187771677970886) | > loss_mel: 10.922296524047852 (10.922296524047852) | > loss_duration: 2.8960318565368652 (2.8960318565368652) | > loss_1: 20.51258659362793 (20.51258659362793)  --> STEP: 1 | > loss_disc: 1.8363338708877563 (1.8363338708877563) | > loss_disc_real_0: 0.2038181722164154 (0.2038181722164154) | > loss_disc_real_1: 0.2655821740627289 (0.2655821740627289) | > loss_disc_real_2: 0.22590379416942596 (0.22590379416942596) | > loss_disc_real_3: 0.17252710461616516 (0.17252710461616516) | > loss_disc_real_4: 0.09552948921918869 (0.09552948921918869) | > loss_disc_real_5: 0.0531863197684288 (0.0531863197684288) | > loss_0: 1.8363338708877563 (1.8363338708877563) | > loss_gen: 3.6173195838928223 (3.6173195838928223) | > loss_kl: 4.921323299407959 (4.921323299407959) | > loss_feat: 9.928305625915527 (9.928305625915527) | > loss_mel: 25.68784523010254 (25.68784523010254) | > loss_duration: 3.2475337982177734 (3.2475337982177734) | > loss_1: 47.40232849121094 (47.40232849121094)  --> STEP: 2 | > loss_disc: 2.4712817668914795 (2.153807818889618) | > loss_disc_real_0: 0.24244186282157898 (0.2231300175189972) | > loss_disc_real_1: 0.26514002680778503 (0.26536110043525696) | > loss_disc_real_2: 0.09222017973661423 (0.1590619869530201) | > loss_disc_real_3: 0.3040803074836731 (0.23830370604991913) | > loss_disc_real_4: 0.24156367778778076 (0.16854658350348473) | > loss_disc_real_5: 0.3156953454017639 (0.18444083258509636) | > loss_0: 2.4712817668914795 (2.153807818889618) | > loss_gen: 2.541309118270874 (3.079314351081848) | > loss_kl: 5.0833420753479 (5.00233268737793) | > loss_feat: 2.9055376052856445 (6.416921615600586) | > loss_mel: 22.578805923461914 (24.133325576782227) | > loss_duration: 3.0557971000671387 (3.151665449142456) | > loss_1: 36.164791107177734 (41.783559799194336)  --> STEP: 3 | > loss_disc: 3.2420156002044678 (2.516543745994568) | > loss_disc_real_0: 0.2656053602695465 (0.23728846510251364) | > loss_disc_real_1: 0.30388909578323364 (0.2782037655512492) | > loss_disc_real_2: 0.3419979512691498 (0.22004064172506332) | > loss_disc_real_3: 0.25244465470314026 (0.24301735560099283) | > loss_disc_real_4: 0.24585314095020294 (0.19431543598572412) | > loss_disc_real_5: 0.20891030132770538 (0.19259732216596603) | > loss_0: 3.2420156002044678 (2.516543745994568) | > loss_gen: 1.8130533695220947 (2.657227357228597) | > loss_kl: 2.702016592025757 (4.235560655593872) | > loss_feat: 4.523874759674072 (5.785905996958415) | > loss_mel: 26.0709285736084 (24.77919324239095) | > loss_duration: 2.8243215084075928 (3.042550802230835) | > loss_1: 37.93419647216797 (40.50043869018555) --> EVAL PERFORMANCE | > avg_loader_time: 0.005141496658325195 (+3.091494242350289e-05) | > avg_loss_disc: 2.516543745994568 (-0.025191585222879898) | > avg_loss_disc_real_0: 0.23728846510251364 (-0.10951134562492368) | > avg_loss_disc_real_1: 0.2782037655512492 (+0.04059749841690066) | > avg_loss_disc_real_2: 0.22004064172506332 (-0.003174982964992523) | > avg_loss_disc_real_3: 0.24301735560099283 (-0.04913988709449771) | > avg_loss_disc_real_4: 0.19431543598572412 (-0.07084831347068152) | > avg_loss_disc_real_5: 0.19259732216596603 (-0.06157093495130539) | > avg_loss_0: 2.516543745994568 (-0.025191585222879898) | > avg_loss_gen: 2.657227357228597 (-0.034345149993896484) | > avg_loss_kl: 4.235560655593872 (-0.0808717409769697) | > avg_loss_feat: 5.785905996958415 (+1.8666085799535117) | > avg_loss_mel: 24.77919324239095 (+6.697345097859699) | > avg_loss_duration: 3.042550802230835 (-0.011025746663411606) | > avg_loss_1: 40.50043869018555 (+8.437712987264)  > EPOCH: 779/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:06:23)   --> TIME: 2023-10-20 09:06:46 -- STEP: 29/50 -- GLOBAL_STEP: 91980 | > loss_disc: 2.9077486991882324 (2.3848794082115434) | > loss_disc_real_0: 0.2057325541973114 (0.16613775254066648) | > loss_disc_real_1: 0.28429463505744934 (0.21499181744353524) | > loss_disc_real_2: 0.275276780128479 (0.23051546539725928) | > loss_disc_real_3: 0.25514131784439087 (0.24683238630150928) | > loss_disc_real_4: 0.26790285110473633 (0.22398912277201127) | > loss_disc_real_5: 0.22630761563777924 (0.2140554039385812) | > loss_0: 2.9077486991882324 (2.3848794082115434) | > grad_norm_0: tensor(641.4357, device='cuda:0') (tensor(674.7812, device='cuda:0')) | > loss_gen: 1.609768271446228 (2.4328828351251) | > loss_kl: 0.8884598016738892 (0.954689085483551) | > loss_feat: 0.42249977588653564 (5.8945806088118715) | > loss_mel: 7.614429950714111 (20.878280557435133) | > loss_duration: 1.4098113775253296 (1.393170295090511) | > loss_1: 11.944968223571777 (31.553603205187567) | > grad_norm_1: tensor(12632.8232, device='cuda:0') (tensor(23630.3477, device='cuda:0')) | > current_lr_0: 9.176846086107586e-05 | > current_lr_1: 9.176846086107586e-05 | > step_time: 0.5205 (0.6255997213824045) | > loader_time: 0.0089 (0.024444086798306168)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3600611686706543 (2.3600611686706543) | > loss_disc_real_0: 0.1165030226111412 (0.1165030226111412) | > loss_disc_real_1: 0.24575361609458923 (0.24575361609458923) | > loss_disc_real_2: 0.19159306585788727 (0.19159306585788727) | > loss_disc_real_3: 0.2946964204311371 (0.2946964204311371) | > loss_disc_real_4: 0.35417240858078003 (0.35417240858078003) | > loss_disc_real_5: 0.3379376530647278 (0.3379376530647278) | > loss_0: 2.3600611686706543 (2.3600611686706543) | > loss_gen: 2.7711143493652344 (2.7711143493652344) | > loss_kl: 4.217278957366943 (4.217278957366943) | > loss_feat: 6.748904228210449 (6.748904228210449) | > loss_mel: 24.26772689819336 (24.26772689819336) | > loss_duration: 2.790217876434326 (2.790217876434326) | > loss_1: 40.79524230957031 (40.79524230957031)  --> STEP: 1 | > loss_disc: 1.8399699926376343 (1.8399699926376343) | > loss_disc_real_0: 0.06024565547704697 (0.06024565547704697) | > loss_disc_real_1: 0.13614165782928467 (0.13614165782928467) | > loss_disc_real_2: 0.1822030246257782 (0.1822030246257782) | > loss_disc_real_3: 0.1223679929971695 (0.1223679929971695) | > loss_disc_real_4: 0.2447332739830017 (0.2447332739830017) | > loss_disc_real_5: 0.07316811382770538 (0.07316811382770538) | > loss_0: 1.8399699926376343 (1.8399699926376343) | > loss_gen: 2.3421549797058105 (2.3421549797058105) | > loss_kl: 4.965320110321045 (4.965320110321045) | > loss_feat: 10.748578071594238 (10.748578071594238) | > loss_mel: 26.99199676513672 (26.99199676513672) | > loss_duration: 3.226407527923584 (3.226407527923584) | > loss_1: 48.27445602416992 (48.27445602416992)  --> STEP: 2 | > loss_disc: 2.8588058948516846 (2.3493879437446594) | > loss_disc_real_0: 0.24669812619686127 (0.15347189083695412) | > loss_disc_real_1: 0.25655096769332886 (0.19634631276130676) | > loss_disc_real_2: 0.2413640320301056 (0.2117835283279419) | > loss_disc_real_3: 0.25993314385414124 (0.19115056842565536) | > loss_disc_real_4: 0.26313143968582153 (0.2539323568344116) | > loss_disc_real_5: 0.28061413764953613 (0.17689112573862076) | > loss_0: 2.8588058948516846 (2.3493879437446594) | > loss_gen: 1.7610552310943604 (2.0516051054000854) | > loss_kl: 5.184704780578613 (5.075012445449829) | > loss_feat: 0.6374062895774841 (5.692992180585861) | > loss_mel: 22.588380813598633 (24.790188789367676) | > loss_duration: 3.0565178394317627 (3.1414626836776733) | > loss_1: 33.228065490722656 (40.75126075744629)  --> STEP: 3 | > loss_disc: 2.572932243347168 (2.423902710278829) | > loss_disc_real_0: 0.29633626341819763 (0.20109334836403528) | > loss_disc_real_1: 0.10563024133443832 (0.16610762228568396) | > loss_disc_real_2: 0.18688274919986725 (0.20348326861858368) | > loss_disc_real_3: 0.31522494554519653 (0.2325086941321691) | > loss_disc_real_4: 0.17364932596683502 (0.22717134654521942) | > loss_disc_real_5: 0.4176660478115082 (0.2571494330962499) | > loss_0: 2.572932243347168 (2.423902710278829) | > loss_gen: 2.41996431350708 (2.174391508102417) | > loss_kl: 2.427098512649536 (4.1923744678497314) | > loss_feat: 5.6651225090026855 (5.683702290058136) | > loss_mel: 20.925277709960938 (23.501885096232098) | > loss_duration: 2.916409492492676 (3.0664449532826743) | > loss_1: 34.3538703918457 (38.618797302246094) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_92000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9627649784088135 (2.558618277311325) | > loss_disc_real_0: 0.14423057436943054 (0.1868776548653841) | > loss_disc_real_1: 0.16281269490718842 (0.16528389044106007) | > loss_disc_real_2: 0.24065566062927246 (0.21277636662125587) | > loss_disc_real_3: 0.3009168803691864 (0.24961074069142342) | > loss_disc_real_4: 0.2549566924571991 (0.23411768302321434) | > loss_disc_real_5: 0.5176740288734436 (0.3222805820405483) | > loss_0: 2.9627649784088135 (2.558618277311325) | > loss_gen: 1.9323534965515137 (2.113882005214691) | > loss_kl: 4.800654411315918 (4.344444453716278) | > loss_feat: 5.273660182952881 (5.581191763281822) | > loss_mel: 23.43906593322754 (23.486180305480957) | > loss_duration: 2.970337390899658 (3.04241806268692) | > loss_1: 38.416072845458984 (38.568116188049316)  --> STEP: 1 | > loss_disc: 2.272449493408203 (2.5013845205307006) | > loss_disc_real_0: 0.15389078855514526 (0.18028028160333634) | > loss_disc_real_1: 0.2587408125400543 (0.1839752748608589) | > loss_disc_real_2: 0.2327452152967453 (0.21677013635635375) | > loss_disc_real_3: 0.25124236941337585 (0.2499370664358139) | > loss_disc_real_4: 0.2001078575849533 (0.22731571793556213) | > loss_disc_real_5: 0.17859748005867004 (0.2935439616441727) | > loss_0: 2.272449493408203 (2.5013845205307006) | > loss_gen: 2.4312422275543213 (2.1773540496826174) | > loss_kl: 4.97117805480957 (4.4697911739349365) | > loss_feat: 4.637497901916504 (5.392452991008758) | > loss_mel: 20.5302734375 (22.894998931884764) | > loss_duration: 3.240037202835083 (3.0819418907165526) | > loss_1: 35.81023025512695 (38.01653900146484)  --> STEP: 2 | > loss_disc: 1.9123412370681763 (2.4032106399536133) | > loss_disc_real_0: 0.10690775513648987 (0.16805152719219527) | > loss_disc_real_1: 0.21959851682186127 (0.1899124818543593) | > loss_disc_real_2: 0.2663329839706421 (0.22503061095873514) | > loss_disc_real_3: 0.16079293191432953 (0.23507971068223318) | > loss_disc_real_4: 0.1744736135005951 (0.21850870052973428) | > loss_disc_real_5: 0.11834980547428131 (0.2643449356158574) | > loss_0: 1.9123412370681763 (2.4032106399536133) | > loss_gen: 2.7985384464263916 (2.280884782473246) | > loss_kl: 5.485665798187256 (4.639103611310323) | > loss_feat: 9.519789695739746 (6.0803424417972565) | > loss_mel: 29.918617248535156 (24.065601984659832) | > loss_duration: 3.111257791519165 (3.086827874183655) | > loss_1: 50.83386993408203 (40.15276082356771)  --> STEP: 3 | > loss_disc: 2.002591133117676 (2.3459792818341936) | > loss_disc_real_0: 0.4159950613975525 (0.20347203207867487) | > loss_disc_real_1: 0.18446730077266693 (0.18913459884268896) | > loss_disc_real_2: 0.1355287730693817 (0.21224463411739894) | > loss_disc_real_3: 0.24924148619174957 (0.23710282146930695) | > loss_disc_real_4: 0.1667937934398651 (0.21112085665975297) | > loss_disc_real_5: 0.11370126157999039 (0.2428244107535907) | > loss_0: 2.002591133117676 (2.3459792818341936) | > loss_gen: 2.887331008911133 (2.3675199576786587) | > loss_kl: 2.1766180992126465 (4.287319966724941) | > loss_feat: 5.794821262359619 (6.039553701877594) | > loss_mel: 24.13851547241211 (24.07601819719587) | > loss_duration: 2.8740384578704834 (3.056429386138916) | > loss_1: 37.87132263183594 (39.82684108189174) --> EVAL PERFORMANCE | > avg_loader_time: 0.4066686970846994 (+0.4015272004263742) | > avg_loss_disc: 2.3459792818341936 (-0.1705644641603743) | > avg_loss_disc_real_0: 0.20347203207867487 (-0.03381643302383877) | > avg_loss_disc_real_1: 0.18913459884268896 (-0.08906916670856024) | > avg_loss_disc_real_2: 0.21224463411739894 (-0.007796007607664385) | > avg_loss_disc_real_3: 0.23710282146930695 (-0.0059145341316858835) | > avg_loss_disc_real_4: 0.21112085665975297 (+0.016805420674028848) | > avg_loss_disc_real_5: 0.2428244107535907 (+0.050227088587624674) | > avg_loss_0: 2.3459792818341936 (-0.1705644641603743) | > avg_loss_gen: 2.3675199576786587 (-0.2897073995499384) | > avg_loss_kl: 4.287319966724941 (+0.05175931113106902) | > avg_loss_feat: 6.039553701877594 (+0.253647704919179) | > avg_loss_mel: 24.07601819719587 (-0.7031750451950778) | > avg_loss_duration: 3.056429386138916 (+0.013878583908081055) | > avg_loss_1: 39.82684108189174 (-0.6735976082938038)  > EPOCH: 780/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:07:19)   --> TIME: 2023-10-20 09:07:35 -- STEP: 9/50 -- GLOBAL_STEP: 92010 | > loss_disc: 2.3741676807403564 (2.2364373207092285) | > loss_disc_real_0: 0.09983137249946594 (0.14212226619323096) | > loss_disc_real_1: 0.2763582170009613 (0.2282002725534969) | > loss_disc_real_2: 0.20745128393173218 (0.24299920433097416) | > loss_disc_real_3: 0.2502165138721466 (0.22292733482188648) | > loss_disc_real_4: 0.2721824645996094 (0.22685894380427069) | > loss_disc_real_5: 0.29040297865867615 (0.23059139876729912) | > loss_0: 2.3741676807403564 (2.2364373207092285) | > grad_norm_0: tensor(257.7267, device='cuda:0') (tensor(576.7328, device='cuda:0')) | > loss_gen: 2.4493775367736816 (2.674235370424059) | > loss_kl: 1.0877325534820557 (0.8437638696697023) | > loss_feat: 5.542501449584961 (6.814344671037462) | > loss_mel: 20.784133911132812 (22.321164660983616) | > loss_duration: 1.3520381450653076 (1.3954941431681316) | > loss_1: 31.215782165527344 (34.04900360107422) | > grad_norm_1: tensor(6897.9106, device='cuda:0') (tensor(25882.4453, device='cuda:0')) | > current_lr_0: 9.167673253888076e-05 | > current_lr_1: 9.167673253888076e-05 | > step_time: 0.5601 (0.5899276468488905) | > loader_time: 0.0066 (0.023984273274739582)  --> TIME: 2023-10-20 09:07:55 -- STEP: 39/50 -- GLOBAL_STEP: 92040 | > loss_disc: 1.5771377086639404 (2.548765096908961) | > loss_disc_real_0: 0.03025127202272415 (0.16891670236602807) | > loss_disc_real_1: 0.13342347741127014 (0.23157046143061075) | > loss_disc_real_2: 0.1410340815782547 (0.24303352574889475) | > loss_disc_real_3: 0.17564646899700165 (0.2310433391099557) | > loss_disc_real_4: 0.141041100025177 (0.25162231370520133) | > loss_disc_real_5: 0.06362306326627731 (0.24830182178471327) | > loss_0: 1.5771377086639404 (2.548765096908961) | > grad_norm_0: tensor(879.3358, device='cuda:0') (tensor(618.0131, device='cuda:0')) | > loss_gen: 2.673433303833008 (2.200182187251556) | > loss_kl: 0.6088138222694397 (0.8151487157895014) | > loss_feat: 8.212030410766602 (4.689679151735245) | > loss_mel: 26.080955505371094 (19.065040313280544) | > loss_duration: 1.5095726251602173 (1.38976500584529) | > loss_1: 39.08480453491211 (28.15981564154992) | > grad_norm_1: tensor(61420.3359, device='cuda:0') (tensor(18453.4434, device='cuda:0')) | > current_lr_0: 9.167673253888076e-05 | > current_lr_1: 9.167673253888076e-05 | > step_time: 0.8151 (0.6196765104929606) | > loader_time: 0.0181 (0.0261227778899364)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.629793882369995 (2.629793882369995) | > loss_disc_real_0: 0.2837318778038025 (0.2837318778038025) | > loss_disc_real_1: 0.23746070265769958 (0.23746070265769958) | > loss_disc_real_2: 0.20450176298618317 (0.20450176298618317) | > loss_disc_real_3: 0.1490940898656845 (0.1490940898656845) | > loss_disc_real_4: 0.2256578505039215 (0.2256578505039215) | > loss_disc_real_5: 0.2389402687549591 (0.2389402687549591) | > loss_0: 2.629793882369995 (2.629793882369995) | > loss_gen: 2.1681604385375977 (2.1681604385375977) | > loss_kl: 4.831137180328369 (4.831137180328369) | > loss_feat: 9.143284797668457 (9.143284797668457) | > loss_mel: 22.549081802368164 (22.549081802368164) | > loss_duration: 2.74922251701355 (2.74922251701355) | > loss_1: 41.440887451171875 (41.440887451171875)  --> STEP: 1 | > loss_disc: 2.9628238677978516 (2.9628238677978516) | > loss_disc_real_0: 0.2873688340187073 (0.2873688340187073) | > loss_disc_real_1: 0.3449881672859192 (0.3449881672859192) | > loss_disc_real_2: 0.2315872460603714 (0.2315872460603714) | > loss_disc_real_3: 0.23229098320007324 (0.23229098320007324) | > loss_disc_real_4: 0.2855294346809387 (0.2855294346809387) | > loss_disc_real_5: 0.2929469048976898 (0.2929469048976898) | > loss_0: 2.9628238677978516 (2.9628238677978516) | > loss_gen: 2.123521089553833 (2.123521089553833) | > loss_kl: 4.553003311157227 (4.553003311157227) | > loss_feat: 2.2697174549102783 (2.2697174549102783) | > loss_mel: 19.548307418823242 (19.548307418823242) | > loss_duration: 3.111950159072876 (3.111950159072876) | > loss_1: 31.60650062561035 (31.60650062561035)  --> STEP: 2 | > loss_disc: 2.336656093597412 (2.649739980697632) | > loss_disc_real_0: 0.31473055481910706 (0.30104969441890717) | > loss_disc_real_1: 0.14807966351509094 (0.24653391540050507) | > loss_disc_real_2: 0.19942055642604828 (0.21550390124320984) | > loss_disc_real_3: 0.19282005727291107 (0.21255552023649216) | > loss_disc_real_4: 0.18555082380771637 (0.23554012924432755) | > loss_disc_real_5: 0.2502339482307434 (0.2715904265642166) | > loss_0: 2.336656093597412 (2.649739980697632) | > loss_gen: 2.543654203414917 (2.333587646484375) | > loss_kl: 4.992843151092529 (4.772923231124878) | > loss_feat: 9.670268058776855 (5.969992756843567) | > loss_mel: 24.2326717376709 (21.89048957824707) | > loss_duration: 2.9630417823791504 (3.037495970726013) | > loss_1: 44.40248107910156 (38.00449085235596)  --> STEP: 3 | > loss_disc: 2.320504903793335 (2.539994955062866) | > loss_disc_real_0: 0.17296907305717468 (0.25835615396499634) | > loss_disc_real_1: 0.13340596854686737 (0.20882459978262582) | > loss_disc_real_2: 0.12596701085567474 (0.18565827111403146) | > loss_disc_real_3: 0.12138079851865768 (0.18216394633054733) | > loss_disc_real_4: 0.05830517038702965 (0.17646180962522826) | > loss_disc_real_5: 0.07070287317037582 (0.20462790876626968) | > loss_0: 2.320504903793335 (2.539994955062866) | > loss_gen: 2.0301902294158936 (2.2324551741282144) | > loss_kl: 2.6277692317962646 (4.05787189801534) | > loss_feat: 7.254855632781982 (6.398280382156372) | > loss_mel: 22.30006217956543 (22.027013778686523) | > loss_duration: 2.7820444107055664 (2.9523454507191977) | > loss_1: 36.99491882324219 (37.66796684265137) --> EVAL PERFORMANCE | > avg_loader_time: 0.009412924448649088 (-0.3972557726360503) | > avg_loss_disc: 2.539994955062866 (+0.19401567322867264) | > avg_loss_disc_real_0: 0.25835615396499634 (+0.05488412188632147) | > avg_loss_disc_real_1: 0.20882459978262582 (+0.019690000939936864) | > avg_loss_disc_real_2: 0.18565827111403146 (-0.026586363003367475) | > avg_loss_disc_real_3: 0.18216394633054733 (-0.05493887513875961) | > avg_loss_disc_real_4: 0.17646180962522826 (-0.034659047034524715) | > avg_loss_disc_real_5: 0.20462790876626968 (-0.038196501987321024) | > avg_loss_0: 2.539994955062866 (+0.19401567322867264) | > avg_loss_gen: 2.2324551741282144 (-0.13506478355044438) | > avg_loss_kl: 4.05787189801534 (-0.22944806870960122) | > avg_loss_feat: 6.398280382156372 (+0.3587266802787781) | > avg_loss_mel: 22.027013778686523 (-2.049004418509348) | > avg_loss_duration: 2.9523454507191977 (-0.10408393541971828) | > avg_loss_1: 37.66796684265137 (-2.158874239240376)  > EPOCH: 781/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:08:22)   --> TIME: 2023-10-20 09:08:43 -- STEP: 19/50 -- GLOBAL_STEP: 92070 | > loss_disc: 2.333390712738037 (2.1761115601188257) | > loss_disc_real_0: 0.1340753734111786 (0.10544107668101788) | > loss_disc_real_1: 0.3134722113609314 (0.20657777315691897) | > loss_disc_real_2: 0.19770143926143646 (0.2142790750061211) | > loss_disc_real_3: 0.30165380239486694 (0.21671464490263084) | > loss_disc_real_4: 0.29987862706184387 (0.2066274769604206) | > loss_disc_real_5: 0.27890828251838684 (0.2090097754017303) | > loss_0: 2.333390712738037 (2.1761115601188257) | > grad_norm_0: tensor(432.0992, device='cuda:0') (tensor(561.0396, device='cuda:0')) | > loss_gen: 2.739678144454956 (2.5140644751097025) | > loss_kl: 0.6731520295143127 (0.8402537828997562) | > loss_feat: 4.253532886505127 (6.444939299633629) | > loss_mel: 21.97038459777832 (22.8211088180542) | > loss_duration: 1.4703437089920044 (1.4243286722584774) | > loss_1: 31.107091903686523 (34.044695126382926) | > grad_norm_1: tensor(4378.6870, device='cuda:0') (tensor(14953.0645, device='cuda:0')) | > current_lr_0: 9.158509590488676e-05 | > current_lr_1: 9.158509590488676e-05 | > step_time: 0.2923 (0.7404547114121286) | > loader_time: 0.0019 (0.022618331407245836)  --> TIME: 2023-10-20 09:09:03 -- STEP: 49/50 -- GLOBAL_STEP: 92100 | > loss_disc: 2.9870738983154297 (2.442917286133279) | > loss_disc_real_0: 0.1620074361562729 (0.1506590433038619) | > loss_disc_real_1: 0.24191930890083313 (0.22687944275688152) | > loss_disc_real_2: 0.2651788890361786 (0.22311795795602457) | > loss_disc_real_3: 0.25609728693962097 (0.22647058104678075) | > loss_disc_real_4: 0.24539294838905334 (0.2203389489072926) | > loss_disc_real_5: 0.2619466483592987 (0.2212133796087333) | > loss_0: 2.9870738983154297 (2.442917286133279) | > grad_norm_0: tensor(594.4016, device='cuda:0') (tensor(669.2416, device='cuda:0')) | > loss_gen: 1.532157063484192 (2.2702287338217912) | > loss_kl: 0.7657603025436401 (0.8407516686283812) | > loss_feat: 0.08555412292480469 (5.405540440383614) | > loss_mel: 1.9195224046707153 (20.307703059546803) | > loss_duration: 1.5170962810516357 (1.3966907262802124) | > loss_1: 5.820090293884277 (30.220914714190425) | > grad_norm_1: tensor(32228.7363, device='cuda:0') (tensor(15096.7979, device='cuda:0')) | > current_lr_0: 9.158509590488676e-05 | > current_lr_1: 9.158509590488676e-05 | > step_time: 0.6913 (0.673336783233954) | > loader_time: 0.4884 (0.03298763352997449)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3526546955108643 (2.3526546955108643) | > loss_disc_real_0: 0.15785682201385498 (0.15785682201385498) | > loss_disc_real_1: 0.28271621465682983 (0.28271621465682983) | > loss_disc_real_2: 0.1955682784318924 (0.1955682784318924) | > loss_disc_real_3: 0.4168873429298401 (0.4168873429298401) | > loss_disc_real_4: 0.20301353931427002 (0.20301353931427002) | > loss_disc_real_5: 0.2056369036436081 (0.2056369036436081) | > loss_0: 2.3526546955108643 (2.3526546955108643) | > loss_gen: 2.8009204864501953 (2.8009204864501953) | > loss_kl: 5.141293048858643 (5.141293048858643) | > loss_feat: 7.999929428100586 (7.999929428100586) | > loss_mel: 22.023534774780273 (22.023534774780273) | > loss_duration: 2.8876028060913086 (2.8876028060913086) | > loss_1: 40.85327911376953 (40.85327911376953)  --> STEP: 1 | > loss_disc: 2.5300581455230713 (2.5300581455230713) | > loss_disc_real_0: 0.07913175225257874 (0.07913175225257874) | > loss_disc_real_1: 0.17447857558727264 (0.17447857558727264) | > loss_disc_real_2: 0.1741236448287964 (0.1741236448287964) | > loss_disc_real_3: 0.39510101079940796 (0.39510101079940796) | > loss_disc_real_4: 0.2882860600948334 (0.2882860600948334) | > loss_disc_real_5: 0.29561474919319153 (0.29561474919319153) | > loss_0: 2.5300581455230713 (2.5300581455230713) | > loss_gen: 2.177741527557373 (2.177741527557373) | > loss_kl: 4.554409503936768 (4.554409503936768) | > loss_feat: 6.6457672119140625 (6.6457672119140625) | > loss_mel: 23.317502975463867 (23.317502975463867) | > loss_duration: 3.239175319671631 (3.239175319671631) | > loss_1: 39.934593200683594 (39.934593200683594)  --> STEP: 2 | > loss_disc: 2.355663776397705 (2.442860960960388) | > loss_disc_real_0: 0.24705390632152557 (0.16309282928705215) | > loss_disc_real_1: 0.15814194083213806 (0.16631025820970535) | > loss_disc_real_2: 0.18546001613140106 (0.17979183048009872) | > loss_disc_real_3: 0.2844669222831726 (0.3397839665412903) | > loss_disc_real_4: 0.19418789446353912 (0.24123697727918625) | > loss_disc_real_5: 0.10257577896118164 (0.19909526407718658) | > loss_0: 2.355663776397705 (2.442860960960388) | > loss_gen: 2.1099281311035156 (2.1438348293304443) | > loss_kl: 4.8942694664001465 (4.724339485168457) | > loss_feat: 5.7118730545043945 (6.1788201332092285) | > loss_mel: 27.01251983642578 (25.165011405944824) | > loss_duration: 2.995126962661743 (3.117151141166687) | > loss_1: 42.723716735839844 (41.32915496826172)  --> STEP: 3 | > loss_disc: 2.4711215496063232 (2.4522811571756997) | > loss_disc_real_0: 0.31345897912979126 (0.21321487923463187) | > loss_disc_real_1: 0.1812198907136917 (0.17128013571103415) | > loss_disc_real_2: 0.16739703714847565 (0.17566023270289102) | > loss_disc_real_3: 0.2252180129289627 (0.3015953153371811) | > loss_disc_real_4: 0.2603771686553955 (0.247617041071256) | > loss_disc_real_5: 0.4077429175376892 (0.2686444818973541) | > loss_0: 2.4711215496063232 (2.4522811571756997) | > loss_gen: 2.8560333251953125 (2.381234327952067) | > loss_kl: 2.736844301223755 (4.061841090520223) | > loss_feat: 5.800581455230713 (6.052740573883057) | > loss_mel: 22.6420841217041 (24.32403564453125) | > loss_duration: 2.850903034210205 (3.028401772181193) | > loss_1: 36.88644790649414 (39.848252614339195) --> EVAL PERFORMANCE | > avg_loader_time: 0.010155836741129557 (+0.0007429122924804688) | > avg_loss_disc: 2.4522811571756997 (-0.08771379788716649) | > avg_loss_disc_real_0: 0.21321487923463187 (-0.04514127473036447) | > avg_loss_disc_real_1: 0.17128013571103415 (-0.03754446407159168) | > avg_loss_disc_real_2: 0.17566023270289102 (-0.009998038411140442) | > avg_loss_disc_real_3: 0.3015953153371811 (+0.11943136900663376) | > avg_loss_disc_real_4: 0.247617041071256 (+0.07115523144602776) | > avg_loss_disc_real_5: 0.2686444818973541 (+0.06401657313108444) | > avg_loss_0: 2.4522811571756997 (-0.08771379788716649) | > avg_loss_gen: 2.381234327952067 (+0.14877915382385254) | > avg_loss_kl: 4.061841090520223 (+0.0039691925048828125) | > avg_loss_feat: 6.052740573883057 (-0.34553980827331543) | > avg_loss_mel: 24.32403564453125 (+2.2970218658447266) | > avg_loss_duration: 3.028401772181193 (+0.07605632146199515) | > avg_loss_1: 39.848252614339195 (+2.180285771687828)  > EPOCH: 782/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:09:14)   --> TIME: 2023-10-20 09:09:37 -- STEP: 29/50 -- GLOBAL_STEP: 92130 | > loss_disc: 2.8495190143585205 (2.5029317099472577) | > loss_disc_real_0: 0.08274739980697632 (0.15807070865713316) | > loss_disc_real_1: 0.21608863770961761 (0.22385891115870968) | > loss_disc_real_2: 0.21337662637233734 (0.2415796626230766) | > loss_disc_real_3: 0.19287222623825073 (0.26142966772975595) | > loss_disc_real_4: 0.2229921668767929 (0.2443768262606243) | > loss_disc_real_5: 0.2306286096572876 (0.24249684951942543) | > loss_0: 2.8495190143585205 (2.5029317099472577) | > grad_norm_0: tensor(689.5886, device='cuda:0') (tensor(632.4785, device='cuda:0')) | > loss_gen: 1.503808617591858 (2.3089285842303573) | > loss_kl: 1.0628944635391235 (0.8511184536177536) | > loss_feat: 1.2903329133987427 (4.842725418764968) | > loss_mel: 17.152307510375977 (20.75880178911932) | > loss_duration: 1.420642614364624 (1.4005085270980309) | > loss_1: 22.42998695373535 (30.162082441921893) | > grad_norm_1: tensor(3712.6978, device='cuda:0') (tensor(18475.3164, device='cuda:0')) | > current_lr_0: 9.149355086744573e-05 | > current_lr_1: 9.149355086744573e-05 | > step_time: 0.4041 (0.4681787984124545) | > loader_time: 0.0077 (0.015009501884723534)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5773801803588867 (2.5773801803588867) | > loss_disc_real_0: 0.24306994676589966 (0.24306994676589966) | > loss_disc_real_1: 0.23995012044906616 (0.23995012044906616) | > loss_disc_real_2: 0.38929256796836853 (0.38929256796836853) | > loss_disc_real_3: 0.3345434367656708 (0.3345434367656708) | > loss_disc_real_4: 0.2002846598625183 (0.2002846598625183) | > loss_disc_real_5: 0.047181908041238785 (0.047181908041238785) | > loss_0: 2.5773801803588867 (2.5773801803588867) | > loss_gen: 2.278831958770752 (2.278831958770752) | > loss_kl: 3.991858959197998 (3.991858959197998) | > loss_feat: 6.3214802742004395 (6.3214802742004395) | > loss_mel: 23.098596572875977 (23.098596572875977) | > loss_duration: 2.8703205585479736 (2.8703205585479736) | > loss_1: 38.56108474731445 (38.56108474731445)  --> STEP: 1 | > loss_disc: 2.4342079162597656 (2.4342079162597656) | > loss_disc_real_0: 0.18003599345684052 (0.18003599345684052) | > loss_disc_real_1: 0.173466756939888 (0.173466756939888) | > loss_disc_real_2: 0.21431656181812286 (0.21431656181812286) | > loss_disc_real_3: 0.24354852735996246 (0.24354852735996246) | > loss_disc_real_4: 0.249966099858284 (0.249966099858284) | > loss_disc_real_5: 0.2538239359855652 (0.2538239359855652) | > loss_0: 2.4342079162597656 (2.4342079162597656) | > loss_gen: 2.4637959003448486 (2.4637959003448486) | > loss_kl: 4.38314962387085 (4.38314962387085) | > loss_feat: 5.342237949371338 (5.342237949371338) | > loss_mel: 25.405275344848633 (25.405275344848633) | > loss_duration: 3.3337459564208984 (3.3337459564208984) | > loss_1: 40.928199768066406 (40.928199768066406)  --> STEP: 2 | > loss_disc: 2.9750869274139404 (2.704647421836853) | > loss_disc_real_0: 0.20032013952732086 (0.1901780664920807) | > loss_disc_real_1: 0.2701761722564697 (0.22182146459817886) | > loss_disc_real_2: 0.25728246569633484 (0.23579951375722885) | > loss_disc_real_3: 0.2691071033477783 (0.2563278153538704) | > loss_disc_real_4: 0.31214845180511475 (0.28105727583169937) | > loss_disc_real_5: 0.2660670578479767 (0.25994549691677094) | > loss_0: 2.9750869274139404 (2.704647421836853) | > loss_gen: 1.7701687812805176 (2.116982340812683) | > loss_kl: 5.134163856506348 (4.758656740188599) | > loss_feat: 1.899928092956543 (3.6210830211639404) | > loss_mel: 25.21468734741211 (25.30998134613037) | > loss_duration: 3.1565780639648438 (3.245162010192871) | > loss_1: 37.1755256652832 (39.051862716674805)  --> STEP: 3 | > loss_disc: 2.4439711570739746 (2.61775533358256) | > loss_disc_real_0: 0.03593507409095764 (0.13876373569170633) | > loss_disc_real_1: 0.19739946722984314 (0.2136807988087336) | > loss_disc_real_2: 0.08564159274101257 (0.18574687341849008) | > loss_disc_real_3: 0.11821866035461426 (0.21029143035411835) | > loss_disc_real_4: 0.11033166944980621 (0.22414874037106833) | > loss_disc_real_5: 0.0788804292678833 (0.19959047436714172) | > loss_0: 2.4439711570739746 (2.61775533358256) | > loss_gen: 1.353898525238037 (1.8626210689544678) | > loss_kl: 2.5424764156341553 (4.019929965337117) | > loss_feat: 3.928981065750122 (3.7237157026926675) | > loss_mel: 23.180477142333984 (24.600146611531574) | > loss_duration: 2.900747299194336 (3.130357106526693) | > loss_1: 33.90658187866211 (37.336769104003906) --> EVAL PERFORMANCE | > avg_loader_time: 0.00809494654337565 (-0.0020608901977539062) | > avg_loss_disc: 2.61775533358256 (+0.16547417640686035) | > avg_loss_disc_real_0: 0.13876373569170633 (-0.07445114354292554) | > avg_loss_disc_real_1: 0.2136807988087336 (+0.042400663097699465) | > avg_loss_disc_real_2: 0.18574687341849008 (+0.01008664071559906) | > avg_loss_disc_real_3: 0.21029143035411835 (-0.09130388498306274) | > avg_loss_disc_real_4: 0.22414874037106833 (-0.023468300700187683) | > avg_loss_disc_real_5: 0.19959047436714172 (-0.0690540075302124) | > avg_loss_0: 2.61775533358256 (+0.16547417640686035) | > avg_loss_gen: 1.8626210689544678 (-0.5186132589975991) | > avg_loss_kl: 4.019929965337117 (-0.04191112518310547) | > avg_loss_feat: 3.7237157026926675 (-2.329024871190389) | > avg_loss_mel: 24.600146611531574 (+0.27611096700032434) | > avg_loss_duration: 3.130357106526693 (+0.10195533434549997) | > avg_loss_1: 37.336769104003906 (-2.511483510335289)  > EPOCH: 783/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:10:09)   --> TIME: 2023-10-20 09:10:20 -- STEP: 9/50 -- GLOBAL_STEP: 92160 | > loss_disc: 2.865654945373535 (2.2719551192389593) | > loss_disc_real_0: 0.23571690917015076 (0.1625185799267557) | > loss_disc_real_1: 0.25347238779067993 (0.17859659592310587) | > loss_disc_real_2: 0.22795364260673523 (0.20947380281156963) | > loss_disc_real_3: 0.2429141402244568 (0.20412223289410272) | > loss_disc_real_4: 0.262976735830307 (0.18366656162672573) | > loss_disc_real_5: 0.24473856389522552 (0.22663102133406532) | > loss_0: 2.865654945373535 (2.2719551192389593) | > grad_norm_0: tensor(820.8823, device='cuda:0') (tensor(589.4026, device='cuda:0')) | > loss_gen: 1.6298542022705078 (2.526425414615207) | > loss_kl: 0.5901799201965332 (0.764902349975374) | > loss_feat: 0.41777515411376953 (6.708393083678351) | > loss_mel: 16.543731689453125 (17.850689278708565) | > loss_duration: 1.3212414979934692 (1.461348056793213) | > loss_1: 20.502782821655273 (29.311758200327557) | > grad_norm_1: tensor(17527.1172, device='cuda:0') (tensor(34673.3828, device='cuda:0')) | > current_lr_0: 9.140209733500121e-05 | > current_lr_1: 9.140209733500121e-05 | > step_time: 0.904 (0.6155953407287598) | > loader_time: 0.0055 (0.018499294916788738)  --> TIME: 2023-10-20 09:10:39 -- STEP: 39/50 -- GLOBAL_STEP: 92190 | > loss_disc: 2.4717814922332764 (2.382590275544387) | > loss_disc_real_0: 0.02939804270863533 (0.15688473067413533) | > loss_disc_real_1: 0.2542848587036133 (0.22151063611874214) | > loss_disc_real_2: 0.18912696838378906 (0.23035800222976086) | > loss_disc_real_3: 0.1589440107345581 (0.2355607036405649) | > loss_disc_real_4: 0.07493581622838974 (0.23031826102389738) | > loss_disc_real_5: 0.22258999943733215 (0.23307992900029206) | > loss_0: 2.4717814922332764 (2.382590275544387) | > grad_norm_0: tensor(935.2336, device='cuda:0') (tensor(661.7204, device='cuda:0')) | > loss_gen: 1.9712802171707153 (2.440195291470259) | > loss_kl: 0.9121103286743164 (0.886955622679148) | > loss_feat: 5.678763389587402 (5.606540869348324) | > loss_mel: 19.50279998779297 (19.690729077045734) | > loss_duration: 1.498988151550293 (1.4118936428656945) | > loss_1: 29.563941955566406 (30.03631431628496) | > grad_norm_1: tensor(58374.7031, device='cuda:0') (tensor(26086.5684, device='cuda:0')) | > current_lr_0: 9.140209733500121e-05 | > current_lr_1: 9.140209733500121e-05 | > step_time: 0.5781 (0.6150121505443866) | > loader_time: 0.0273 (0.021646988697541066)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4948325157165527 (2.4948325157165527) | > loss_disc_real_0: 0.19294682145118713 (0.19294682145118713) | > loss_disc_real_1: 0.25081801414489746 (0.25081801414489746) | > loss_disc_real_2: 0.20990148186683655 (0.20990148186683655) | > loss_disc_real_3: 0.2641318738460541 (0.2641318738460541) | > loss_disc_real_4: 0.3938077688217163 (0.3938077688217163) | > loss_disc_real_5: 0.26096564531326294 (0.26096564531326294) | > loss_0: 2.4948325157165527 (2.4948325157165527) | > loss_gen: 2.4994077682495117 (2.4994077682495117) | > loss_kl: 5.0205254554748535 (5.0205254554748535) | > loss_feat: 4.282252788543701 (4.282252788543701) | > loss_mel: 23.69161605834961 (23.69161605834961) | > loss_duration: 2.879246950149536 (2.879246950149536) | > loss_1: 38.373046875 (38.373046875)  --> STEP: 1 | > loss_disc: 2.7347378730773926 (2.7347378730773926) | > loss_disc_real_0: 0.2272801399230957 (0.2272801399230957) | > loss_disc_real_1: 0.2912764251232147 (0.2912764251232147) | > loss_disc_real_2: 0.22936995327472687 (0.22936995327472687) | > loss_disc_real_3: 0.30971798300743103 (0.30971798300743103) | > loss_disc_real_4: 0.2864009737968445 (0.2864009737968445) | > loss_disc_real_5: 0.2588852047920227 (0.2588852047920227) | > loss_0: 2.7347378730773926 (2.7347378730773926) | > loss_gen: 2.1099603176116943 (2.1099603176116943) | > loss_kl: 4.288372993469238 (4.288372993469238) | > loss_feat: 4.090057373046875 (4.090057373046875) | > loss_mel: 23.412464141845703 (23.412464141845703) | > loss_duration: 3.1362411975860596 (3.1362411975860596) | > loss_1: 37.03709411621094 (37.03709411621094)  --> STEP: 2 | > loss_disc: 3.0184457302093506 (2.8765918016433716) | > loss_disc_real_0: 0.2704218327999115 (0.2488509863615036) | > loss_disc_real_1: 0.2556734085083008 (0.27347491681575775) | > loss_disc_real_2: 0.27450838685035706 (0.25193917006254196) | > loss_disc_real_3: 0.2736676037311554 (0.2916927933692932) | > loss_disc_real_4: 0.2474203109741211 (0.2669106423854828) | > loss_disc_real_5: 0.24927236139774323 (0.25407878309488297) | > loss_0: 3.0184457302093506 (2.8765918016433716) | > loss_gen: 1.5554922819137573 (1.8327262997627258) | > loss_kl: 5.013124465942383 (4.6507487297058105) | > loss_feat: 0.043219901621341705 (2.0666386373341084) | > loss_mel: 1.4033457040786743 (12.407904922962189) | > loss_duration: 3.050017833709717 (3.093129515647888) | > loss_1: 11.065200805664062 (24.0511474609375)  --> STEP: 3 | > loss_disc: 2.408208131790161 (2.7204639116923013) | > loss_disc_real_0: 0.4767122268676758 (0.32480473319689435) | > loss_disc_real_1: 0.2554331421852112 (0.2674609919389089) | > loss_disc_real_2: 0.26673081517219543 (0.25686971843242645) | > loss_disc_real_3: 0.16777785122394562 (0.25038781265417737) | > loss_disc_real_4: 0.08972398936748505 (0.20784842471281686) | > loss_disc_real_5: 0.18081170320510864 (0.22965642313162485) | > loss_0: 2.408208131790161 (2.7204639116923013) | > loss_gen: 3.062912940979004 (2.2427885135014853) | > loss_kl: 2.6831960678100586 (3.9948978424072266) | > loss_feat: 7.7058491706848145 (3.9463754817843437) | > loss_mel: 24.169368743896484 (16.32839286327362) | > loss_duration: 2.8740603923797607 (3.020106474558512) | > loss_1: 40.49538803100586 (29.53256098429362) --> EVAL PERFORMANCE | > avg_loader_time: 0.007727861404418945 (-0.00036708513895670515) | > avg_loss_disc: 2.7204639116923013 (+0.10270857810974121) | > avg_loss_disc_real_0: 0.32480473319689435 (+0.18604099750518802) | > avg_loss_disc_real_1: 0.2674609919389089 (+0.05378019313017526) | > avg_loss_disc_real_2: 0.25686971843242645 (+0.07112284501393637) | > avg_loss_disc_real_3: 0.25038781265417737 (+0.04009638230005902) | > avg_loss_disc_real_4: 0.20784842471281686 (-0.016300315658251463) | > avg_loss_disc_real_5: 0.22965642313162485 (+0.030065948764483125) | > avg_loss_0: 2.7204639116923013 (+0.10270857810974121) | > avg_loss_gen: 2.2427885135014853 (+0.38016744454701756) | > avg_loss_kl: 3.9948978424072266 (-0.025032122929890654) | > avg_loss_feat: 3.9463754817843437 (+0.22265977909167622) | > avg_loss_mel: 16.32839286327362 (-8.271753748257954) | > avg_loss_duration: 3.020106474558512 (-0.11025063196818063) | > avg_loss_1: 29.53256098429362 (-7.804208119710285)  > EPOCH: 784/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:11:06)   --> TIME: 2023-10-20 09:11:22 -- STEP: 19/50 -- GLOBAL_STEP: 92220 | > loss_disc: 2.2387900352478027 (2.4518553520503796) | > loss_disc_real_0: 0.13958147168159485 (0.13712595207126518) | > loss_disc_real_1: 0.2535175085067749 (0.24937901528258072) | > loss_disc_real_2: 0.16280171275138855 (0.23917060815974286) | > loss_disc_real_3: 0.2549242675304413 (0.21852829420056782) | > loss_disc_real_4: 0.2599172294139862 (0.25380902776592656) | > loss_disc_real_5: 0.214191734790802 (0.2516690858296658) | > loss_0: 2.2387900352478027 (2.4518553520503796) | > grad_norm_0: tensor(391.2771, device='cuda:0') (tensor(587.3973, device='cuda:0')) | > loss_gen: 2.35721755027771 (2.3615150953594006) | > loss_kl: 0.8990502953529358 (0.8933529289145219) | > loss_feat: 5.274035930633545 (5.424793761027487) | > loss_mel: 23.630062103271484 (23.305237293243408) | > loss_duration: 1.4595887660980225 (1.4132610747688694) | > loss_1: 33.61995315551758 (33.39816023174085) | > grad_norm_1: tensor(7813.6665, device='cuda:0') (tensor(14887.8438, device='cuda:0')) | > current_lr_0: 9.131073521608822e-05 | > current_lr_1: 9.131073521608822e-05 | > step_time: 0.3565 (0.5407961669721102) | > loader_time: 0.0154 (0.018243463415848583)  --> TIME: 2023-10-20 09:11:41 -- STEP: 49/50 -- GLOBAL_STEP: 92250 | > loss_disc: 2.282583236694336 (2.4686775183191103) | > loss_disc_real_0: 0.09117083251476288 (0.13707030096984646) | > loss_disc_real_1: 0.16917815804481506 (0.2328610054540391) | > loss_disc_real_2: 0.11699292063713074 (0.22867117388820163) | > loss_disc_real_3: 0.19153043627738953 (0.2467890548120652) | > loss_disc_real_4: 0.3515559136867523 (0.23389580541727495) | > loss_disc_real_5: 0.32130905985832214 (0.2314240080209411) | > loss_0: 2.282583236694336 (2.4686775183191103) | > grad_norm_0: tensor(502.7692, device='cuda:0') (tensor(607.7259, device='cuda:0')) | > loss_gen: 2.4919931888580322 (2.2876027457568116) | > loss_kl: 0.9956973195075989 (0.8438088568497677) | > loss_feat: 4.880086421966553 (5.540581780580842) | > loss_mel: 24.322805404663086 (21.49271477728474) | > loss_duration: 1.5409075021743774 (1.3866707451489506) | > loss_1: 34.23149108886719 (31.551379057825827) | > grad_norm_1: tensor(13988.5957, device='cuda:0') (tensor(16213.7412, device='cuda:0')) | > current_lr_0: 9.131073521608822e-05 | > current_lr_1: 9.131073521608822e-05 | > step_time: 0.6041 (0.5653060698995787) | > loader_time: 0.6203 (0.03201732830125458)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.151197910308838 (3.151197910308838) | > loss_disc_real_0: 0.511667788028717 (0.511667788028717) | > loss_disc_real_1: 0.2713945806026459 (0.2713945806026459) | > loss_disc_real_2: 0.3782653212547302 (0.3782653212547302) | > loss_disc_real_3: 0.2620019018650055 (0.2620019018650055) | > loss_disc_real_4: 0.418777197599411 (0.418777197599411) | > loss_disc_real_5: 0.43519121408462524 (0.43519121408462524) | > loss_0: 3.151197910308838 (3.151197910308838) | > loss_gen: 2.791222095489502 (2.791222095489502) | > loss_kl: 4.0715413093566895 (4.0715413093566895) | > loss_feat: 4.4959211349487305 (4.4959211349487305) | > loss_mel: 22.679458618164062 (22.679458618164062) | > loss_duration: 2.8860678672790527 (2.8860678672790527) | > loss_1: 36.92420959472656 (36.92420959472656)  --> STEP: 1 | > loss_disc: 3.240717887878418 (3.240717887878418) | > loss_disc_real_0: 0.680781364440918 (0.680781364440918) | > loss_disc_real_1: 0.2394290566444397 (0.2394290566444397) | > loss_disc_real_2: 0.29096707701683044 (0.29096707701683044) | > loss_disc_real_3: 0.2836454510688782 (0.2836454510688782) | > loss_disc_real_4: 0.29604753851890564 (0.29604753851890564) | > loss_disc_real_5: 0.3498769700527191 (0.3498769700527191) | > loss_0: 3.240717887878418 (3.240717887878418) | > loss_gen: 2.428555727005005 (2.428555727005005) | > loss_kl: 4.62598180770874 (4.62598180770874) | > loss_feat: 2.773704767227173 (2.773704767227173) | > loss_mel: 22.274776458740234 (22.274776458740234) | > loss_duration: 3.150883197784424 (3.150883197784424) | > loss_1: 35.253902435302734 (35.253902435302734)  --> STEP: 2 | > loss_disc: 3.117363452911377 (3.1790406703948975) | > loss_disc_real_0: 0.4699212312698364 (0.5753512978553772) | > loss_disc_real_1: 0.19288069009780884 (0.21615487337112427) | > loss_disc_real_2: 0.2097037136554718 (0.2503353953361511) | > loss_disc_real_3: 0.2714361250400543 (0.27754078805446625) | > loss_disc_real_4: 0.2814605236053467 (0.28875403106212616) | > loss_disc_real_5: 0.24228346347808838 (0.29608021676540375) | > loss_0: 3.117363452911377 (3.1790406703948975) | > loss_gen: 1.6122130155563354 (2.02038437128067) | > loss_kl: 5.343085289001465 (4.9845335483551025) | > loss_feat: 0.14355728030204773 (1.4586310237646103) | > loss_mel: 2.1818809509277344 (12.228328704833984) | > loss_duration: 3.101961374282837 (3.1264222860336304) | > loss_1: 12.382697105407715 (23.818299770355225)  --> STEP: 3 | > loss_disc: 2.949619770050049 (3.1025670369466147) | > loss_disc_real_0: 0.4023315906524658 (0.5176780621210734) | > loss_disc_real_1: 0.19886228442192078 (0.2103906770547231) | > loss_disc_real_2: 0.20150020718574524 (0.23405699928601584) | > loss_disc_real_3: 0.29408252239227295 (0.2830546995004018) | > loss_disc_real_4: 0.28739798069000244 (0.28830201427141827) | > loss_disc_real_5: 0.24621722102165222 (0.27945921818415326) | > loss_0: 2.949619770050049 (3.1025670369466147) | > loss_gen: 2.102128744125366 (2.0476324955622354) | > loss_kl: 2.5590600967407227 (4.176042397816976) | > loss_feat: 1.1546767950057983 (1.357312947511673) | > loss_mel: 15.567153930664062 (13.341270446777344) | > loss_duration: 2.8701090812683105 (3.040984551111857) | > loss_1: 24.253129959106445 (23.963243166605633) --> EVAL PERFORMANCE | > avg_loader_time: 0.010847727457682291 (+0.0031198660532633458) | > avg_loss_disc: 3.1025670369466147 (+0.38210312525431345) | > avg_loss_disc_real_0: 0.5176780621210734 (+0.19287332892417902) | > avg_loss_disc_real_1: 0.2103906770547231 (-0.05707031488418576) | > avg_loss_disc_real_2: 0.23405699928601584 (-0.022812719146410615) | > avg_loss_disc_real_3: 0.2830546995004018 (+0.03266688684622443) | > avg_loss_disc_real_4: 0.28830201427141827 (+0.08045358955860141) | > avg_loss_disc_real_5: 0.27945921818415326 (+0.04980279505252841) | > avg_loss_0: 3.1025670369466147 (+0.38210312525431345) | > avg_loss_gen: 2.0476324955622354 (-0.19515601793924997) | > avg_loss_kl: 4.176042397816976 (+0.18114455540974905) | > avg_loss_feat: 1.357312947511673 (-2.5890625342726707) | > avg_loss_mel: 13.341270446777344 (-2.987122416496277) | > avg_loss_duration: 3.040984551111857 (+0.020878076553344727) | > avg_loss_1: 23.963243166605633 (-5.569317817687988)  > EPOCH: 785/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:11:55)   --> TIME: 2023-10-20 09:12:22 -- STEP: 29/50 -- GLOBAL_STEP: 92280 | > loss_disc: 2.7209701538085938 (2.4932849982689165) | > loss_disc_real_0: 0.2951323986053467 (0.19914357287102732) | > loss_disc_real_1: 0.20451416075229645 (0.22739927406454907) | > loss_disc_real_2: 0.12745043635368347 (0.21655821851615248) | > loss_disc_real_3: 0.26873281598091125 (0.23691854523173694) | > loss_disc_real_4: 0.4170791506767273 (0.2151491606029971) | > loss_disc_real_5: 0.29915913939476013 (0.20586794030306668) | > loss_0: 2.7209701538085938 (2.4932849982689165) | > grad_norm_0: tensor(450.6606, device='cuda:0') (tensor(684.6315, device='cuda:0')) | > loss_gen: 2.2007691860198975 (2.1939318508937444) | > loss_kl: 0.9018164873123169 (0.895430813575613) | > loss_feat: 5.224559783935547 (4.8603527715493895) | > loss_mel: 22.933385848999023 (21.137433907081345) | > loss_duration: 1.375307559967041 (1.3916598763959158) | > loss_1: 32.63583755493164 (30.478809060721563) | > grad_norm_1: tensor(8164.9829, device='cuda:0') (tensor(19971.5645, device='cuda:0')) | > current_lr_0: 9.121946441933321e-05 | > current_lr_1: 9.121946441933321e-05 | > step_time: 0.7418 (0.6725873125010523) | > loader_time: 0.0064 (0.02673918625404095)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5902299880981445 (2.5902299880981445) | > loss_disc_real_0: 0.1662922501564026 (0.1662922501564026) | > loss_disc_real_1: 0.29787206649780273 (0.29787206649780273) | > loss_disc_real_2: 0.30907952785491943 (0.30907952785491943) | > loss_disc_real_3: 0.34513235092163086 (0.34513235092163086) | > loss_disc_real_4: 0.33093276619911194 (0.33093276619911194) | > loss_disc_real_5: 0.341749906539917 (0.341749906539917) | > loss_0: 2.5902299880981445 (2.5902299880981445) | > loss_gen: 2.6684813499450684 (2.6684813499450684) | > loss_kl: 4.409677028656006 (4.409677028656006) | > loss_feat: 7.130359649658203 (7.130359649658203) | > loss_mel: 25.22882080078125 (25.22882080078125) | > loss_duration: 2.803356409072876 (2.803356409072876) | > loss_1: 42.24069595336914 (42.24069595336914)  --> STEP: 1 | > loss_disc: 3.0101637840270996 (3.0101637840270996) | > loss_disc_real_0: 0.13661038875579834 (0.13661038875579834) | > loss_disc_real_1: 0.2175927758216858 (0.2175927758216858) | > loss_disc_real_2: 0.1835402399301529 (0.1835402399301529) | > loss_disc_real_3: 0.22705286741256714 (0.22705286741256714) | > loss_disc_real_4: 0.2926172614097595 (0.2926172614097595) | > loss_disc_real_5: 0.2885363698005676 (0.2885363698005676) | > loss_0: 3.0101637840270996 (3.0101637840270996) | > loss_gen: 1.4129054546356201 (1.4129054546356201) | > loss_kl: 4.875445365905762 (4.875445365905762) | > loss_feat: 1.2142729759216309 (1.2142729759216309) | > loss_mel: 17.30581283569336 (17.30581283569336) | > loss_duration: 3.1751058101654053 (3.1751058101654053) | > loss_1: 27.98354148864746 (27.98354148864746)  --> STEP: 2 | > loss_disc: 2.2976629734039307 (2.653913378715515) | > loss_disc_real_0: 0.049425750970840454 (0.0930180698633194) | > loss_disc_real_1: 0.05130307003855705 (0.13444792293012142) | > loss_disc_real_2: 0.16832615435123444 (0.17593319714069366) | > loss_disc_real_3: 0.2009108066558838 (0.21398183703422546) | > loss_disc_real_4: 0.15039584040641785 (0.22150655090808868) | > loss_disc_real_5: 0.07256495952606201 (0.18055066466331482) | > loss_0: 2.2976629734039307 (2.653913378715515) | > loss_gen: 1.6929306983947754 (1.5529180765151978) | > loss_kl: 5.158045291900635 (5.016745328903198) | > loss_feat: 10.912044525146484 (6.063158750534058) | > loss_mel: 24.101598739624023 (20.70370578765869) | > loss_duration: 3.0313899517059326 (3.103247880935669) | > loss_1: 44.89601135253906 (36.43977642059326)  --> STEP: 3 | > loss_disc: 2.4308903217315674 (2.5795723597208657) | > loss_disc_real_0: 0.1905638724565506 (0.12553333739439645) | > loss_disc_real_1: 0.2419336438179016 (0.17027649655938148) | > loss_disc_real_2: 0.26038968563079834 (0.20408535997072855) | > loss_disc_real_3: 0.2989445626735687 (0.24230274558067322) | > loss_disc_real_4: 0.27135348320007324 (0.23812219500541687) | > loss_disc_real_5: 0.2358252853155136 (0.19897553821404776) | > loss_0: 2.4308903217315674 (2.5795723597208657) | > loss_gen: 2.9646453857421875 (2.023493846257528) | > loss_kl: 2.443288564682007 (4.158926407496135) | > loss_feat: 6.925021648406982 (6.350446383158366) | > loss_mel: 21.06309700012207 (20.823502858479817) | > loss_duration: 2.8755860328674316 (3.0273605982462564) | > loss_1: 36.27164077758789 (36.38373120625814) --> EVAL PERFORMANCE | > avg_loader_time: 0.04436651865641276 (+0.03351879119873047) | > avg_loss_disc: 2.5795723597208657 (-0.522994677225749) | > avg_loss_disc_real_0: 0.12553333739439645 (-0.39214472472667694) | > avg_loss_disc_real_1: 0.17027649655938148 (-0.04011418049534163) | > avg_loss_disc_real_2: 0.20408535997072855 (-0.02997163931528729) | > avg_loss_disc_real_3: 0.24230274558067322 (-0.04075195391972858) | > avg_loss_disc_real_4: 0.23812219500541687 (-0.0501798192660014) | > avg_loss_disc_real_5: 0.19897553821404776 (-0.0804836799701055) | > avg_loss_0: 2.5795723597208657 (-0.522994677225749) | > avg_loss_gen: 2.023493846257528 (-0.02413864930470755) | > avg_loss_kl: 4.158926407496135 (-0.01711599032084088) | > avg_loss_feat: 6.350446383158366 (+4.993133435646693) | > avg_loss_mel: 20.823502858479817 (+7.482232411702473) | > avg_loss_duration: 3.0273605982462564 (-0.013623952865600586) | > avg_loss_1: 36.38373120625814 (+12.420488039652508)  > EPOCH: 786/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:12:44)   --> TIME: 2023-10-20 09:13:00 -- STEP: 9/50 -- GLOBAL_STEP: 92310 | > loss_disc: 2.5307016372680664 (2.0757349332173667) | > loss_disc_real_0: 0.17853382229804993 (0.08684228339956866) | > loss_disc_real_1: 0.30126744508743286 (0.18572505936026573) | > loss_disc_real_2: 0.2541201412677765 (0.17265335304869545) | > loss_disc_real_3: 0.2397555112838745 (0.16843291537629235) | > loss_disc_real_4: 0.2777687609195709 (0.1793910881711377) | > loss_disc_real_5: 0.29827797412872314 (0.16096756979823112) | > loss_0: 2.5307016372680664 (2.0757349332173667) | > grad_norm_0: tensor(626.8091, device='cuda:0') (tensor(482.9538, device='cuda:0')) | > loss_gen: 2.418548583984375 (2.4620303312937417) | > loss_kl: 0.960879385471344 (0.8951959013938904) | > loss_feat: 2.2484912872314453 (6.944294638103909) | > loss_mel: 22.283432006835938 (22.822039710150825) | > loss_duration: 1.3711391687393188 (1.406817634900411) | > loss_1: 29.282489776611328 (34.53037791781955) | > grad_norm_1: tensor(5948.7554, device='cuda:0') (tensor(12844.1611, device='cuda:0')) | > current_lr_0: 9.112828485345397e-05 | > current_lr_1: 9.112828485345397e-05 | > step_time: 0.4931 (0.6532590654161241) | > loader_time: 0.0073 (0.02212434344821506)  --> TIME: 2023-10-20 09:13:19 -- STEP: 39/50 -- GLOBAL_STEP: 92340 | > loss_disc: 1.5922068357467651 (2.453287702340346) | > loss_disc_real_0: 0.01983591727912426 (0.1435646656423043) | > loss_disc_real_1: 0.1260051280260086 (0.22024681237645638) | > loss_disc_real_2: 0.06467630714178085 (0.21567999466489524) | > loss_disc_real_3: 0.04710746183991432 (0.22584278298876223) | > loss_disc_real_4: 0.04994237422943115 (0.23554635224625087) | > loss_disc_real_5: 0.02362176589667797 (0.2278477634088351) | > loss_0: 1.5922068357467651 (2.453287702340346) | > grad_norm_0: tensor(526.7979, device='cuda:0') (tensor(586.5513, device='cuda:0')) | > loss_gen: 2.7588586807250977 (2.229114798399118) | > loss_kl: 0.6566485166549683 (0.8516536068457824) | > loss_feat: 11.301176071166992 (4.637698854391392) | > loss_mel: 27.929109573364258 (20.140386437758423) | > loss_duration: 1.4400681257247925 (1.3897354358281844) | > loss_1: 44.08585739135742 (29.248588904356346) | > grad_norm_1: tensor(97407.1719, device='cuda:0') (tensor(16999.0605, device='cuda:0')) | > current_lr_0: 9.112828485345397e-05 | > current_lr_1: 9.112828485345397e-05 | > step_time: 0.4528 (0.6261376784398005) | > loader_time: 0.043 (0.020723251196054313)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6386163234710693 (2.6386163234710693) | > loss_disc_real_0: 0.29606151580810547 (0.29606151580810547) | > loss_disc_real_1: 0.24971508979797363 (0.24971508979797363) | > loss_disc_real_2: 0.32461825013160706 (0.32461825013160706) | > loss_disc_real_3: 0.3266545832157135 (0.3266545832157135) | > loss_disc_real_4: 0.2925495207309723 (0.2925495207309723) | > loss_disc_real_5: 0.29181405901908875 (0.29181405901908875) | > loss_0: 2.6386163234710693 (2.6386163234710693) | > loss_gen: 2.7978363037109375 (2.7978363037109375) | > loss_kl: 4.711010932922363 (4.711010932922363) | > loss_feat: 6.256465911865234 (6.256465911865234) | > loss_mel: 19.993976593017578 (19.993976593017578) | > loss_duration: 2.959287643432617 (2.959287643432617) | > loss_1: 36.71857452392578 (36.71857452392578)  --> STEP: 1 | > loss_disc: 2.7155709266662598 (2.7155709266662598) | > loss_disc_real_0: 0.14578765630722046 (0.14578765630722046) | > loss_disc_real_1: 0.3321428894996643 (0.3321428894996643) | > loss_disc_real_2: 0.3967059850692749 (0.3967059850692749) | > loss_disc_real_3: 0.3569663465023041 (0.3569663465023041) | > loss_disc_real_4: 0.3583655059337616 (0.3583655059337616) | > loss_disc_real_5: 0.3830135464668274 (0.3830135464668274) | > loss_0: 2.7155709266662598 (2.7155709266662598) | > loss_gen: 2.9763574600219727 (2.9763574600219727) | > loss_kl: 4.910394191741943 (4.910394191741943) | > loss_feat: 7.3994140625 (7.3994140625) | > loss_mel: 23.177494049072266 (23.177494049072266) | > loss_duration: 3.2212271690368652 (3.2212271690368652) | > loss_1: 41.68488693237305 (41.68488693237305)  --> STEP: 2 | > loss_disc: 2.7502710819244385 (2.732921004295349) | > loss_disc_real_0: 0.2618202865123749 (0.20380397140979767) | > loss_disc_real_1: 0.2859635651111603 (0.3090532273054123) | > loss_disc_real_2: 0.305315226316452 (0.35101060569286346) | > loss_disc_real_3: 0.37584415078163147 (0.3664052486419678) | > loss_disc_real_4: 0.28556495904922485 (0.3219652324914932) | > loss_disc_real_5: 0.3964118957519531 (0.38971272110939026) | > loss_0: 2.7502710819244385 (2.732921004295349) | > loss_gen: 2.661339521408081 (2.818848490715027) | > loss_kl: 4.907313823699951 (4.908854007720947) | > loss_feat: 6.995355606079102 (7.197384834289551) | > loss_mel: 24.482080459594727 (23.829787254333496) | > loss_duration: 3.093968629837036 (3.1575978994369507) | > loss_1: 42.14005661010742 (41.912471771240234)  --> STEP: 3 | > loss_disc: 2.7606444358825684 (2.7421621481577554) | > loss_disc_real_0: 0.13616032898426056 (0.1812560906012853) | > loss_disc_real_1: 0.37799859046936035 (0.33203501502672833) | > loss_disc_real_2: 0.28953805565834045 (0.3305197556813558) | > loss_disc_real_3: 0.29307448863983154 (0.34196166197458905) | > loss_disc_real_4: 0.13450944423675537 (0.25947996973991394) | > loss_disc_real_5: 0.17200909554958344 (0.31714484592278797) | > loss_0: 2.7606444358825684 (2.7421621481577554) | > loss_gen: 2.0678439140319824 (2.5685136318206787) | > loss_kl: 2.5462987422943115 (4.121335585912068) | > loss_feat: 6.318789005279541 (6.904519557952881) | > loss_mel: 21.997282028198242 (23.218952178955078) | > loss_duration: 2.9962005615234375 (3.103798786799113) | > loss_1: 35.926414489746094 (39.91711934407552) --> EVAL PERFORMANCE | > avg_loader_time: 0.028740803400675457 (-0.0156257152557373) | > avg_loss_disc: 2.7421621481577554 (+0.16258978843688965) | > avg_loss_disc_real_0: 0.1812560906012853 (+0.05572275320688885) | > avg_loss_disc_real_1: 0.33203501502672833 (+0.16175851846734685) | > avg_loss_disc_real_2: 0.3305197556813558 (+0.12643439571062723) | > avg_loss_disc_real_3: 0.34196166197458905 (+0.09965891639391583) | > avg_loss_disc_real_4: 0.25947996973991394 (+0.02135777473449707) | > avg_loss_disc_real_5: 0.31714484592278797 (+0.1181693077087402) | > avg_loss_0: 2.7421621481577554 (+0.16258978843688965) | > avg_loss_gen: 2.5685136318206787 (+0.5450197855631509) | > avg_loss_kl: 4.121335585912068 (-0.03759082158406635) | > avg_loss_feat: 6.904519557952881 (+0.5540731747945147) | > avg_loss_mel: 23.218952178955078 (+2.3954493204752616) | > avg_loss_duration: 3.103798786799113 (+0.07643818855285645) | > avg_loss_1: 39.91711934407552 (+3.533388137817383)  > EPOCH: 787/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:13:45)   --> TIME: 2023-10-20 09:13:59 -- STEP: 19/50 -- GLOBAL_STEP: 92370 | > loss_disc: 3.150426149368286 (2.5410762146899573) | > loss_disc_real_0: 0.5333039164543152 (0.20789030993259267) | > loss_disc_real_1: 0.2978648543357849 (0.22993551037813487) | > loss_disc_real_2: 0.31619027256965637 (0.2405545076257304) | > loss_disc_real_3: 0.3312702775001526 (0.247877337038517) | > loss_disc_real_4: 0.249531090259552 (0.20588375461336814) | > loss_disc_real_5: 0.27386555075645447 (0.23293526210871182) | > loss_0: 3.150426149368286 (2.5410762146899573) | > grad_norm_0: tensor(1245.4346, device='cuda:0') (tensor(565.4119, device='cuda:0')) | > loss_gen: 1.9577970504760742 (2.26110219328027) | > loss_kl: 1.2575528621673584 (0.8763717240408847) | > loss_feat: 0.4894535541534424 (4.92575286387613) | > loss_mel: 16.375274658203125 (18.45986580848694) | > loss_duration: 1.5354708433151245 (1.4400193691253662) | > loss_1: 21.615549087524414 (27.963112555052106) | > grad_norm_1: tensor(7798.8472, device='cuda:0') (tensor(22143.2773, device='cuda:0')) | > current_lr_0: 9.103719642725951e-05 | > current_lr_1: 9.103719642725951e-05 | > step_time: 0.3405 (0.43249450231853287) | > loader_time: 0.0053 (0.011340756165353875)  --> TIME: 2023-10-20 09:14:17 -- STEP: 49/50 -- GLOBAL_STEP: 92400 | > loss_disc: 3.4509689807891846 (2.536487229016362) | > loss_disc_real_0: 0.24545665085315704 (0.16488536046247704) | > loss_disc_real_1: 0.20428141951560974 (0.22728900930711202) | > loss_disc_real_2: 0.3252752423286438 (0.23667517600923169) | > loss_disc_real_3: 0.2918350398540497 (0.2494879631819773) | > loss_disc_real_4: 0.45043420791625977 (0.24167794757047478) | > loss_disc_real_5: 0.474490761756897 (0.24948430846312214) | > loss_0: 3.4509689807891846 (2.536487229016362) | > grad_norm_0: tensor(1537.5094, device='cuda:0') (tensor(617.4825, device='cuda:0')) | > loss_gen: 2.040369749069214 (2.3057332087536255) | > loss_kl: 0.6270602941513062 (0.8366625150855707) | > loss_feat: 4.976933479309082 (5.158660544348614) | > loss_mel: 27.38845443725586 (20.113898805209573) | > loss_duration: 1.4899123907089233 (1.398338123243682) | > loss_1: 36.52273178100586 (29.813293398643026) | > grad_norm_1: tensor(15963.4883, device='cuda:0') (tensor(19280.9141, device='cuda:0')) | > current_lr_0: 9.103719642725951e-05 | > current_lr_1: 9.103719642725951e-05 | > step_time: 0.8253 (0.5084052329160729) | > loader_time: 0.4815 (0.0253206661769322)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.178781270980835 (3.178781270980835) | > loss_disc_real_0: 0.5758786201477051 (0.5758786201477051) | > loss_disc_real_1: 0.4510502815246582 (0.4510502815246582) | > loss_disc_real_2: 0.3775545656681061 (0.3775545656681061) | > loss_disc_real_3: 0.31514301896095276 (0.31514301896095276) | > loss_disc_real_4: 0.35773447155952454 (0.35773447155952454) | > loss_disc_real_5: 0.34951668977737427 (0.34951668977737427) | > loss_0: 3.178781270980835 (3.178781270980835) | > loss_gen: 2.9159040451049805 (2.9159040451049805) | > loss_kl: 4.44603157043457 (4.44603157043457) | > loss_feat: 3.9437665939331055 (3.9437665939331055) | > loss_mel: 23.8332462310791 (23.8332462310791) | > loss_duration: 2.833324670791626 (2.833324670791626) | > loss_1: 37.97227478027344 (37.97227478027344)  --> STEP: 1 | > loss_disc: 2.8564586639404297 (2.8564586639404297) | > loss_disc_real_0: 0.1666315346956253 (0.1666315346956253) | > loss_disc_real_1: 0.23721478879451752 (0.23721478879451752) | > loss_disc_real_2: 0.16190631687641144 (0.16190631687641144) | > loss_disc_real_3: 0.27765893936157227 (0.27765893936157227) | > loss_disc_real_4: 0.2728120684623718 (0.2728120684623718) | > loss_disc_real_5: 0.3329414129257202 (0.3329414129257202) | > loss_0: 2.8564586639404297 (2.8564586639404297) | > loss_gen: 1.6317403316497803 (1.6317403316497803) | > loss_kl: 4.936656951904297 (4.936656951904297) | > loss_feat: 0.8880285024642944 (0.8880285024642944) | > loss_mel: 15.614570617675781 (15.614570617675781) | > loss_duration: 3.184612274169922 (3.184612274169922) | > loss_1: 26.2556095123291 (26.2556095123291)  --> STEP: 2 | > loss_disc: 1.9375227689743042 (2.396990716457367) | > loss_disc_real_0: 0.05525711178779602 (0.11094432324171066) | > loss_disc_real_1: 0.42512771487236023 (0.3311712518334389) | > loss_disc_real_2: 0.2333509474992752 (0.19762863218784332) | > loss_disc_real_3: 0.21805702149868011 (0.2478579804301262) | > loss_disc_real_4: 0.16084842383861542 (0.21683024615049362) | > loss_disc_real_5: 0.15422450006008148 (0.24358295649290085) | > loss_0: 1.9375227689743042 (2.396990716457367) | > loss_gen: 4.173819541931152 (2.9027799367904663) | > loss_kl: 5.539616584777832 (5.2381367683410645) | > loss_feat: 10.713396072387695 (5.800712287425995) | > loss_mel: 29.95775604248047 (22.786163330078125) | > loss_duration: 3.1252048015594482 (3.154908537864685) | > loss_1: 53.509796142578125 (39.88270282745361)  --> STEP: 3 | > loss_disc: 3.0704615116119385 (2.6214809815088906) | > loss_disc_real_0: 0.24227949976921082 (0.15472271541754404) | > loss_disc_real_1: 0.25363752245903015 (0.3053266753753026) | > loss_disc_real_2: 0.19748631119728088 (0.19758119185765585) | > loss_disc_real_3: 0.26137253642082214 (0.25236283242702484) | > loss_disc_real_4: 0.30161914229393005 (0.2450932115316391) | > loss_disc_real_5: 0.31728312373161316 (0.26814967890580493) | > loss_0: 3.0704615116119385 (2.6214809815088906) | > loss_gen: 1.5457963943481445 (2.4504520893096924) | > loss_kl: 2.4751811027526855 (4.3171515464782715) | > loss_feat: 0.39497438073158264 (3.998799651861191) | > loss_mel: 4.890804290771484 (16.821043650309246) | > loss_duration: 3.0121450424194336 (3.107320706049601) | > loss_1: 12.318901062011719 (30.69476890563965) --> EVAL PERFORMANCE | > avg_loader_time: 0.005035003026326497 (-0.02370580037434896) | > avg_loss_disc: 2.6214809815088906 (-0.12068116664886475) | > avg_loss_disc_real_0: 0.15472271541754404 (-0.02653337518374127) | > avg_loss_disc_real_1: 0.3053266753753026 (-0.026708339651425717) | > avg_loss_disc_real_2: 0.19758119185765585 (-0.13293856382369992) | > avg_loss_disc_real_3: 0.25236283242702484 (-0.08959882954756421) | > avg_loss_disc_real_4: 0.2450932115316391 (-0.014386758208274841) | > avg_loss_disc_real_5: 0.26814967890580493 (-0.04899516701698303) | > avg_loss_0: 2.6214809815088906 (-0.12068116664886475) | > avg_loss_gen: 2.4504520893096924 (-0.11806154251098633) | > avg_loss_kl: 4.3171515464782715 (+0.1958159605662031) | > avg_loss_feat: 3.998799651861191 (-2.90571990609169) | > avg_loss_mel: 16.821043650309246 (-6.397908528645832) | > avg_loss_duration: 3.107320706049601 (+0.0035219192504882812) | > avg_loss_1: 30.69476890563965 (-9.222350438435875)  > EPOCH: 788/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:14:36)   --> TIME: 2023-10-20 09:14:59 -- STEP: 29/50 -- GLOBAL_STEP: 92430 | > loss_disc: 2.4270055294036865 (2.342395342629531) | > loss_disc_real_0: 0.013050532899796963 (0.1368595875863885) | > loss_disc_real_1: 0.31662169098854065 (0.22334888641690387) | > loss_disc_real_2: 0.2377636730670929 (0.21695287204508124) | > loss_disc_real_3: 0.3339281380176544 (0.241831901386894) | > loss_disc_real_4: 0.297883003950119 (0.20839263723585114) | > loss_disc_real_5: 0.2372407764196396 (0.2048471106922832) | > loss_0: 2.4270055294036865 (2.342395342629531) | > grad_norm_0: tensor(314.7715, device='cuda:0') (tensor(544.7957, device='cuda:0')) | > loss_gen: 2.3647727966308594 (2.3179016976520934) | > loss_kl: 1.0619124174118042 (0.8664508585272164) | > loss_feat: 4.0265793800354 (5.38577085489343) | > loss_mel: 24.043222427368164 (21.946622943056042) | > loss_duration: 1.4165990352630615 (1.4142012966090236) | > loss_1: 32.9130859375 (31.930948027249038) | > grad_norm_1: tensor(5514.2783, device='cuda:0') (tensor(16517.5176, device='cuda:0')) | > current_lr_0: 9.094619904965e-05 | > current_lr_1: 9.094619904965e-05 | > step_time: 0.5074 (0.5819449424743653) | > loader_time: 0.0093 (0.018582228956551386)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.962928533554077 (2.962928533554077) | > loss_disc_real_0: 0.31217437982559204 (0.31217437982559204) | > loss_disc_real_1: 0.2982381582260132 (0.2982381582260132) | > loss_disc_real_2: 0.3131401836872101 (0.3131401836872101) | > loss_disc_real_3: 0.32363882660865784 (0.32363882660865784) | > loss_disc_real_4: 0.4469911754131317 (0.4469911754131317) | > loss_disc_real_5: 0.3496288061141968 (0.3496288061141968) | > loss_0: 2.962928533554077 (2.962928533554077) | > loss_gen: 2.5419836044311523 (2.5419836044311523) | > loss_kl: 5.212425231933594 (5.212425231933594) | > loss_feat: 5.679659366607666 (5.679659366607666) | > loss_mel: 22.623950958251953 (22.623950958251953) | > loss_duration: 2.8312785625457764 (2.8312785625457764) | > loss_1: 38.88930130004883 (38.88930130004883)  --> STEP: 1 | > loss_disc: 2.805488348007202 (2.805488348007202) | > loss_disc_real_0: 0.2559935450553894 (0.2559935450553894) | > loss_disc_real_1: 0.3861561417579651 (0.3861561417579651) | > loss_disc_real_2: 0.30543550848960876 (0.30543550848960876) | > loss_disc_real_3: 0.3390236496925354 (0.3390236496925354) | > loss_disc_real_4: 0.36241504549980164 (0.36241504549980164) | > loss_disc_real_5: 0.3613657057285309 (0.3613657057285309) | > loss_0: 2.805488348007202 (2.805488348007202) | > loss_gen: 3.032886266708374 (3.032886266708374) | > loss_kl: 5.098167419433594 (5.098167419433594) | > loss_feat: 5.80845308303833 (5.80845308303833) | > loss_mel: 23.747482299804688 (23.747482299804688) | > loss_duration: 3.0588207244873047 (3.0588207244873047) | > loss_1: 40.745811462402344 (40.745811462402344)  --> STEP: 2 | > loss_disc: 2.6468348503112793 (2.7261615991592407) | > loss_disc_real_0: 0.26798015832901 (0.2619868516921997) | > loss_disc_real_1: 0.23654070496559143 (0.31134842336177826) | > loss_disc_real_2: 0.2175459861755371 (0.26149074733257294) | > loss_disc_real_3: 0.1746704876422882 (0.2568470686674118) | > loss_disc_real_4: 0.15191316604614258 (0.2571641057729721) | > loss_disc_real_5: 0.09862606972455978 (0.22999588772654533) | > loss_0: 2.6468348503112793 (2.7261615991592407) | > loss_gen: 1.9054204225540161 (2.469153344631195) | > loss_kl: 5.121467113494873 (5.109817266464233) | > loss_feat: 7.335628032684326 (6.572040557861328) | > loss_mel: 24.00989532470703 (23.87868881225586) | > loss_duration: 2.992633581161499 (3.025727152824402) | > loss_1: 41.365047454833984 (41.055429458618164)  --> STEP: 3 | > loss_disc: 2.9488883018493652 (2.8004038333892822) | > loss_disc_real_0: 0.3712220788002014 (0.29839859406153363) | > loss_disc_real_1: 0.33662450313568115 (0.31977378328641254) | > loss_disc_real_2: 0.3863304853439331 (0.3031039933363597) | > loss_disc_real_3: 0.3015907108783722 (0.27176161607106525) | > loss_disc_real_4: 0.3230658769607544 (0.2791313628355662) | > loss_disc_real_5: 0.2754666209220886 (0.24515279879172644) | > loss_0: 2.9488883018493652 (2.8004038333892822) | > loss_gen: 2.342522382736206 (2.426943023999532) | > loss_kl: 2.361036539077759 (4.193557024002075) | > loss_feat: 2.588770627975464 (5.24428391456604) | > loss_mel: 18.832901000976562 (22.196759541829426) | > loss_duration: 2.88199782371521 (2.9778173764546714) | > loss_1: 29.007226943969727 (37.03936195373535) --> EVAL PERFORMANCE | > avg_loader_time: 0.007238467534383138 (+0.0022034645080566406) | > avg_loss_disc: 2.8004038333892822 (+0.1789228518803916) | > avg_loss_disc_real_0: 0.29839859406153363 (+0.1436758786439896) | > avg_loss_disc_real_1: 0.31977378328641254 (+0.014447107911109924) | > avg_loss_disc_real_2: 0.3031039933363597 (+0.10552280147870383) | > avg_loss_disc_real_3: 0.27176161607106525 (+0.019398783644040407) | > avg_loss_disc_real_4: 0.2791313628355662 (+0.03403815130392712) | > avg_loss_disc_real_5: 0.24515279879172644 (-0.022996880114078494) | > avg_loss_0: 2.8004038333892822 (+0.1789228518803916) | > avg_loss_gen: 2.426943023999532 (-0.02350906531016017) | > avg_loss_kl: 4.193557024002075 (-0.12359452247619629) | > avg_loss_feat: 5.24428391456604 (+1.2454842627048492) | > avg_loss_mel: 22.196759541829426 (+5.37571589152018) | > avg_loss_duration: 2.9778173764546714 (-0.12950332959492972) | > avg_loss_1: 37.03936195373535 (+6.344593048095703)  > EPOCH: 789/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:15:26)   --> TIME: 2023-10-20 09:15:42 -- STEP: 9/50 -- GLOBAL_STEP: 92460 | > loss_disc: 2.66896653175354 (2.432449354065789) | > loss_disc_real_0: 0.3476189374923706 (0.16496362081832355) | > loss_disc_real_1: 0.2621127665042877 (0.243984648750888) | > loss_disc_real_2: 0.1777472048997879 (0.21574904272953668) | > loss_disc_real_3: 0.3027057647705078 (0.2428265396091673) | > loss_disc_real_4: 0.22607170045375824 (0.2082523306210836) | > loss_disc_real_5: 0.2836616039276123 (0.26633925384117496) | > loss_0: 2.66896653175354 (2.432449354065789) | > grad_norm_0: tensor(702.8638, device='cuda:0') (tensor(667.9362, device='cuda:0')) | > loss_gen: 2.031100034713745 (2.4108923408720226) | > loss_kl: 0.7087201476097107 (0.8840780523088243) | > loss_feat: 2.1044859886169434 (5.4072023125158415) | > loss_mel: 19.61322784423828 (19.938802268770004) | > loss_duration: 1.353208065032959 (1.4333794911702473) | > loss_1: 25.810741424560547 (30.07435459560818) | > grad_norm_1: tensor(2250.1292, device='cuda:0') (tensor(24589.2578, device='cuda:0')) | > current_lr_0: 9.085529262961674e-05 | > current_lr_1: 9.085529262961674e-05 | > step_time: 0.7903 (0.5994713836246066) | > loader_time: 0.0247 (0.026601711908976238)  --> TIME: 2023-10-20 09:16:02 -- STEP: 39/50 -- GLOBAL_STEP: 92490 | > loss_disc: 2.628357410430908 (2.5766572921704025) | > loss_disc_real_0: 0.05289195850491524 (0.14578294837608552) | > loss_disc_real_1: 0.23704828321933746 (0.2414747138436024) | > loss_disc_real_2: 0.2650977075099945 (0.23635438860704502) | > loss_disc_real_3: 0.31784605979919434 (0.2509954938521752) | > loss_disc_real_4: 0.23418129980564117 (0.25120913304197484) | > loss_disc_real_5: 0.2655477523803711 (0.26193649555819154) | > loss_0: 2.628357410430908 (2.5766572921704025) | > grad_norm_0: tensor(985.1724, device='cuda:0') (tensor(640.2256, device='cuda:0')) | > loss_gen: 2.1350886821746826 (2.253644573382843) | > loss_kl: 0.6741248369216919 (0.8964217809530405) | > loss_feat: 4.420342922210693 (5.009137912319066) | > loss_mel: 22.31024932861328 (19.760148421311996) | > loss_duration: 1.4860495328903198 (1.3978653993362034) | > loss_1: 31.025854110717773 (29.317218377039982) | > grad_norm_1: tensor(18944.5430, device='cuda:0') (tensor(17998.4375, device='cuda:0')) | > current_lr_0: 9.085529262961674e-05 | > current_lr_1: 9.085529262961674e-05 | > step_time: 0.6032 (0.644220333832961) | > loader_time: 0.0112 (0.02294194392668895)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.258977174758911 (3.258977174758911) | > loss_disc_real_0: 0.4481971859931946 (0.4481971859931946) | > loss_disc_real_1: 0.3043268620967865 (0.3043268620967865) | > loss_disc_real_2: 0.31081876158714294 (0.31081876158714294) | > loss_disc_real_3: 0.34608060121536255 (0.34608060121536255) | > loss_disc_real_4: 0.2754382789134979 (0.2754382789134979) | > loss_disc_real_5: 0.21105460822582245 (0.21105460822582245) | > loss_0: 3.258977174758911 (3.258977174758911) | > loss_gen: 1.831106185913086 (1.831106185913086) | > loss_kl: 4.9249677658081055 (4.9249677658081055) | > loss_feat: 4.208462238311768 (4.208462238311768) | > loss_mel: 21.421783447265625 (21.421783447265625) | > loss_duration: 2.88075852394104 (2.88075852394104) | > loss_1: 35.26708221435547 (35.26708221435547)  --> STEP: 1 | > loss_disc: 2.833561420440674 (2.833561420440674) | > loss_disc_real_0: 0.2028830498456955 (0.2028830498456955) | > loss_disc_real_1: 0.2808867394924164 (0.2808867394924164) | > loss_disc_real_2: 0.24066327512264252 (0.24066327512264252) | > loss_disc_real_3: 0.3524910509586334 (0.3524910509586334) | > loss_disc_real_4: 0.21200048923492432 (0.21200048923492432) | > loss_disc_real_5: 0.31506845355033875 (0.31506845355033875) | > loss_0: 2.833561420440674 (2.833561420440674) | > loss_gen: 1.963768482208252 (1.963768482208252) | > loss_kl: 4.942393779754639 (4.942393779754639) | > loss_feat: 4.2358479499816895 (4.2358479499816895) | > loss_mel: 24.595661163330078 (24.595661163330078) | > loss_duration: 3.3014512062072754 (3.3014512062072754) | > loss_1: 39.03912353515625 (39.03912353515625)  --> STEP: 2 | > loss_disc: 1.807687759399414 (2.320624589920044) | > loss_disc_real_0: 0.0860511064529419 (0.1444670781493187) | > loss_disc_real_1: 0.10262954980134964 (0.191758144646883) | > loss_disc_real_2: 0.12415800243616104 (0.18241063877940178) | > loss_disc_real_3: 0.2632750868797302 (0.3078830689191818) | > loss_disc_real_4: 0.20260955393314362 (0.20730502158403397) | > loss_disc_real_5: 0.25331974029541016 (0.28419409692287445) | > loss_0: 1.807687759399414 (2.320624589920044) | > loss_gen: 2.8591980934143066 (2.4114832878112793) | > loss_kl: 5.076413154602051 (5.009403467178345) | > loss_feat: 8.214344024658203 (6.225095987319946) | > loss_mel: 24.24229621887207 (24.418978691101074) | > loss_duration: 2.999579668045044 (3.1505154371261597) | > loss_1: 43.3918342590332 (41.21547889709473)  --> STEP: 3 | > loss_disc: 2.502857208251953 (2.38136879603068) | > loss_disc_real_0: 0.1492781937122345 (0.1460707833369573) | > loss_disc_real_1: 0.1842227727174759 (0.1892463540037473) | > loss_disc_real_2: 0.22232717275619507 (0.19571615010499954) | > loss_disc_real_3: 0.19822654128074646 (0.27133089303970337) | > loss_disc_real_4: 0.3020772337913513 (0.23889575898647308) | > loss_disc_real_5: 0.26823538541793823 (0.27887452642122906) | > loss_0: 2.502857208251953 (2.38136879603068) | > loss_gen: 2.2055459022521973 (2.3428374926249185) | > loss_kl: 2.332770347595215 (4.117192427317302) | > loss_feat: 2.7653074264526367 (5.07183313369751) | > loss_mel: 19.549571990966797 (22.79584312438965) | > loss_duration: 2.945019483566284 (3.0820167859395347) | > loss_1: 29.798213958740234 (37.40972391764323) --> EVAL PERFORMANCE | > avg_loader_time: 0.022060553232828777 (+0.01482208569844564) | > avg_loss_disc: 2.38136879603068 (-0.41903503735860204) | > avg_loss_disc_real_0: 0.1460707833369573 (-0.15232781072457632) | > avg_loss_disc_real_1: 0.1892463540037473 (-0.13052742928266522) | > avg_loss_disc_real_2: 0.19571615010499954 (-0.10738784323136014) | > avg_loss_disc_real_3: 0.27133089303970337 (-0.0004307230313618793) | > avg_loss_disc_real_4: 0.23889575898647308 (-0.04023560384909314) | > avg_loss_disc_real_5: 0.27887452642122906 (+0.033721727629502624) | > avg_loss_0: 2.38136879603068 (-0.41903503735860204) | > avg_loss_gen: 2.3428374926249185 (-0.08410553137461374) | > avg_loss_kl: 4.117192427317302 (-0.07636459668477347) | > avg_loss_feat: 5.07183313369751 (-0.17245078086853027) | > avg_loss_mel: 22.79584312438965 (+0.5990835825602225) | > avg_loss_duration: 3.0820167859395347 (+0.10419940948486328) | > avg_loss_1: 37.40972391764323 (+0.37036196390787524)  > EPOCH: 790/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:16:23)   --> TIME: 2023-10-20 09:16:37 -- STEP: 19/50 -- GLOBAL_STEP: 92520 | > loss_disc: 2.431084394454956 (2.5763623024287976) | > loss_disc_real_0: 0.07642863690853119 (0.15659841262784444) | > loss_disc_real_1: 0.26297369599342346 (0.22594309843292362) | > loss_disc_real_2: 0.35012346506118774 (0.23620568804050746) | > loss_disc_real_3: 0.2908286452293396 (0.23851603367610982) | > loss_disc_real_4: 0.1539030522108078 (0.23928662830669628) | > loss_disc_real_5: 0.16015949845314026 (0.2385926296640383) | > loss_0: 2.431084394454956 (2.5763623024287976) | > grad_norm_0: tensor(588.2977, device='cuda:0') (tensor(584.6558, device='cuda:0')) | > loss_gen: 2.163702964782715 (2.1361657820249857) | > loss_kl: 1.0855566263198853 (0.8150055753557306) | > loss_feat: 3.5293097496032715 (4.609060162384259) | > loss_mel: 21.798110961914062 (21.063751459121704) | > loss_duration: 1.469560146331787 (1.40756777085756) | > loss_1: 30.046239852905273 (30.031550683473284) | > grad_norm_1: tensor(8322.0254, device='cuda:0') (tensor(18654.3242, device='cuda:0')) | > current_lr_0: 9.076447707624186e-05 | > current_lr_1: 9.076447707624186e-05 | > step_time: 0.3778 (0.4191340898212634) | > loader_time: 0.0074 (0.009590349699321547)  --> TIME: 2023-10-20 09:16:52 -- STEP: 49/50 -- GLOBAL_STEP: 92550 | > loss_disc: 2.6121296882629395 (2.5819070801442985) | > loss_disc_real_0: 0.21117009222507477 (0.16467973816075487) | > loss_disc_real_1: 0.32656458020210266 (0.2347192752498145) | > loss_disc_real_2: 0.16396182775497437 (0.23177561315954948) | > loss_disc_real_3: 0.2771196961402893 (0.233881414392773) | > loss_disc_real_4: 0.3879750072956085 (0.24727510641880182) | > loss_disc_real_5: 0.23439212143421173 (0.24064441253336108) | > loss_0: 2.6121296882629395 (2.5819070801442985) | > grad_norm_0: tensor(697.6100, device='cuda:0') (tensor(641.5555, device='cuda:0')) | > loss_gen: 2.512620449066162 (2.1389266520130383) | > loss_kl: 0.5267776250839233 (0.7950177867801822) | > loss_feat: 3.572702169418335 (4.397724385468328) | > loss_mel: 21.03726577758789 (19.799098248384432) | > loss_duration: 1.5030126571655273 (1.3869636740003313) | > loss_1: 29.15237808227539 (28.51773080047296) | > grad_norm_1: tensor(4198.1685, device='cuda:0') (tensor(18097.4277, device='cuda:0')) | > current_lr_0: 9.076447707624186e-05 | > current_lr_1: 9.076447707624186e-05 | > step_time: 0.7625 (0.4418001418211022) | > loader_time: 0.4176 (0.017220399817641903)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.898892402648926 (2.898892402648926) | > loss_disc_real_0: 0.2713996171951294 (0.2713996171951294) | > loss_disc_real_1: 0.2685938775539398 (0.2685938775539398) | > loss_disc_real_2: 0.38033363223075867 (0.38033363223075867) | > loss_disc_real_3: 0.2519226670265198 (0.2519226670265198) | > loss_disc_real_4: 0.31344953179359436 (0.31344953179359436) | > loss_disc_real_5: 0.30140379071235657 (0.30140379071235657) | > loss_0: 2.898892402648926 (2.898892402648926) | > loss_gen: 2.2673256397247314 (2.2673256397247314) | > loss_kl: 4.722379684448242 (4.722379684448242) | > loss_feat: 3.3227553367614746 (3.3227553367614746) | > loss_mel: 22.891447067260742 (22.891447067260742) | > loss_duration: 2.9520766735076904 (2.9520766735076904) | > loss_1: 36.155982971191406 (36.155982971191406)  --> STEP: 1 | > loss_disc: 1.8455289602279663 (1.8455289602279663) | > loss_disc_real_0: 0.29464444518089294 (0.29464444518089294) | > loss_disc_real_1: 0.1663588434457779 (0.1663588434457779) | > loss_disc_real_2: 0.07753138989210129 (0.07753138989210129) | > loss_disc_real_3: 0.07304155826568604 (0.07304155826568604) | > loss_disc_real_4: 0.17047300934791565 (0.17047300934791565) | > loss_disc_real_5: 0.0920293852686882 (0.0920293852686882) | > loss_0: 1.8455289602279663 (1.8455289602279663) | > loss_gen: 2.7608537673950195 (2.7608537673950195) | > loss_kl: 5.082722187042236 (5.082722187042236) | > loss_feat: 7.2193450927734375 (7.2193450927734375) | > loss_mel: 22.37057113647461 (22.37057113647461) | > loss_duration: 3.2540910243988037 (3.2540910243988037) | > loss_1: 40.68758010864258 (40.68758010864258)  --> STEP: 2 | > loss_disc: 1.3240917921066284 (1.5848103761672974) | > loss_disc_real_0: 0.11662042140960693 (0.20563243329524994) | > loss_disc_real_1: 0.10023193806409836 (0.13329539075493813) | > loss_disc_real_2: 0.05591950565576553 (0.06672544777393341) | > loss_disc_real_3: 0.07803347706794739 (0.07553751766681671) | > loss_disc_real_4: 0.1167612373828888 (0.14361712336540222) | > loss_disc_real_5: 0.10062859207391739 (0.0963289886713028) | > loss_0: 1.3240917921066284 (1.5848103761672974) | > loss_gen: 3.6102938652038574 (3.1855738162994385) | > loss_kl: 5.403481960296631 (5.243102073669434) | > loss_feat: 12.2592134475708 (9.73927927017212) | > loss_mel: 26.836078643798828 (24.60332489013672) | > loss_duration: 3.04379940032959 (3.1489452123641968) | > loss_1: 51.15286636352539 (45.920223236083984)  --> STEP: 3 | > loss_disc: 2.6041526794433594 (1.9245911439259846) | > loss_disc_real_0: 0.1249624565243721 (0.17874244103829065) | > loss_disc_real_1: 0.31938374042510986 (0.19532484064499536) | > loss_disc_real_2: 0.2732137143611908 (0.13555486996968588) | > loss_disc_real_3: 0.3067153990268707 (0.15259681145350137) | > loss_disc_real_4: 0.27175578474998474 (0.1863300104935964) | > loss_disc_real_5: 0.2509295344352722 (0.14786250392595926) | > loss_0: 2.6041526794433594 (1.9245911439259846) | > loss_gen: 2.30910062789917 (2.893416086832682) | > loss_kl: 2.432652711868286 (4.306285619735718) | > loss_feat: 4.381241798400879 (7.953266779581706) | > loss_mel: 23.879169464111328 (24.361939748128254) | > loss_duration: 2.894649028778076 (3.0641798178354898) | > loss_1: 35.896812438964844 (42.57908630371094) --> EVAL PERFORMANCE | > avg_loader_time: 0.007264455159505208 (-0.01479609807332357) | > avg_loss_disc: 1.9245911439259846 (-0.45677765210469556) | > avg_loss_disc_real_0: 0.17874244103829065 (+0.032671657701333345) | > avg_loss_disc_real_1: 0.19532484064499536 (+0.006078486641248049) | > avg_loss_disc_real_2: 0.13555486996968588 (-0.06016128013531366) | > avg_loss_disc_real_3: 0.15259681145350137 (-0.118734081586202) | > avg_loss_disc_real_4: 0.1863300104935964 (-0.05256574849287668) | > avg_loss_disc_real_5: 0.14786250392595926 (-0.1310120224952698) | > avg_loss_0: 1.9245911439259846 (-0.45677765210469556) | > avg_loss_gen: 2.893416086832682 (+0.5505785942077637) | > avg_loss_kl: 4.306285619735718 (+0.18909319241841605) | > avg_loss_feat: 7.953266779581706 (+2.8814336458841963) | > avg_loss_mel: 24.361939748128254 (+1.5660966237386056) | > avg_loss_duration: 3.0641798178354898 (-0.017836968104044892) | > avg_loss_1: 42.57908630371094 (+5.169362386067711)  > EPOCH: 791/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:17:11)   --> TIME: 2023-10-20 09:17:35 -- STEP: 29/50 -- GLOBAL_STEP: 92580 | > loss_disc: 2.8714728355407715 (2.380145284636267) | > loss_disc_real_0: 0.30422309041023254 (0.15234403967343524) | > loss_disc_real_1: 0.20036400854587555 (0.22641707776949324) | > loss_disc_real_2: 0.3096465468406677 (0.22346044627243075) | > loss_disc_real_3: 0.2961198091506958 (0.22376647180524364) | > loss_disc_real_4: 0.20539256930351257 (0.2116412040295786) | > loss_disc_real_5: 0.3011220693588257 (0.23389684441017694) | > loss_0: 2.8714728355407715 (2.380145284636267) | > grad_norm_0: tensor(489.6447, device='cuda:0') (tensor(572.2778, device='cuda:0')) | > loss_gen: 2.0821330547332764 (2.3888353520426255) | > loss_kl: 0.9892776012420654 (0.9165896336580145) | > loss_feat: 2.9754559993743896 (5.94740423149076) | > loss_mel: 22.927078247070312 (22.10800997142134) | > loss_duration: 1.4019283056259155 (1.418166308567442) | > loss_1: 30.375871658325195 (32.77900557682432) | > grad_norm_1: tensor(3487.0825, device='cuda:0') (tensor(15853.3730, device='cuda:0')) | > current_lr_0: 9.067375229869847e-05 | > current_lr_1: 9.067375229869847e-05 | > step_time: 0.4262 (0.6190709574469204) | > loader_time: 0.0571 (0.025756696174884665)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.674532175064087 (2.674532175064087) | > loss_disc_real_0: 0.19654324650764465 (0.19654324650764465) | > loss_disc_real_1: 0.3125190734863281 (0.3125190734863281) | > loss_disc_real_2: 0.20261183381080627 (0.20261183381080627) | > loss_disc_real_3: 0.29131031036376953 (0.29131031036376953) | > loss_disc_real_4: 0.21593841910362244 (0.21593841910362244) | > loss_disc_real_5: 0.2740163505077362 (0.2740163505077362) | > loss_0: 2.674532175064087 (2.674532175064087) | > loss_gen: 1.957911729812622 (1.957911729812622) | > loss_kl: 4.499402046203613 (4.499402046203613) | > loss_feat: 1.6428735256195068 (1.6428735256195068) | > loss_mel: 18.10601806640625 (18.10601806640625) | > loss_duration: 2.972156524658203 (2.972156524658203) | > loss_1: 29.178363800048828 (29.178363800048828)  --> STEP: 1 | > loss_disc: 2.983889579772949 (2.983889579772949) | > loss_disc_real_0: 0.26427021622657776 (0.26427021622657776) | > loss_disc_real_1: 0.26034319400787354 (0.26034319400787354) | > loss_disc_real_2: 0.24136973917484283 (0.24136973917484283) | > loss_disc_real_3: 0.2697736620903015 (0.2697736620903015) | > loss_disc_real_4: 0.26791781187057495 (0.26791781187057495) | > loss_disc_real_5: 0.2941966652870178 (0.2941966652870178) | > loss_0: 2.983889579772949 (2.983889579772949) | > loss_gen: 1.6240527629852295 (1.6240527629852295) | > loss_kl: 5.239049434661865 (5.239049434661865) | > loss_feat: 0.07171987742185593 (0.07171987742185593) | > loss_mel: 10.77734661102295 (10.77734661102295) | > loss_duration: 3.2469213008880615 (3.2469213008880615) | > loss_1: 20.959089279174805 (20.959089279174805)  --> STEP: 2 | > loss_disc: 2.744434118270874 (2.8641618490219116) | > loss_disc_real_0: 0.3083155155181885 (0.2862928658723831) | > loss_disc_real_1: 0.25523698329925537 (0.25779008865356445) | > loss_disc_real_2: 0.30511176586151123 (0.27324075251817703) | > loss_disc_real_3: 0.13215607404708862 (0.20096486806869507) | > loss_disc_real_4: 0.26903149485588074 (0.26847465336322784) | > loss_disc_real_5: 0.27620771527290344 (0.28520219027996063) | > loss_0: 2.744434118270874 (2.8641618490219116) | > loss_gen: 2.3526856899261475 (1.9883692264556885) | > loss_kl: 4.999602794647217 (5.119326114654541) | > loss_feat: 8.798722267150879 (4.435221072286367) | > loss_mel: 19.784282684326172 (15.28081464767456) | > loss_duration: 2.984790086746216 (3.1158556938171387) | > loss_1: 38.920082092285156 (29.93958568572998)  --> STEP: 3 | > loss_disc: 2.857884407043457 (2.8620693683624268) | > loss_disc_real_0: 0.2080807387828827 (0.2602221568425496) | > loss_disc_real_1: 0.25611430406570435 (0.2572314937909444) | > loss_disc_real_2: 0.2215646356344223 (0.2560153802235921) | > loss_disc_real_3: 0.26844677329063416 (0.2234588364760081) | > loss_disc_real_4: 0.2666025757789612 (0.2678506275018056) | > loss_disc_real_5: 0.2976430058479309 (0.2893491288026174) | > loss_0: 2.857884407043457 (2.8620693683624268) | > loss_gen: 1.6801570653915405 (1.885631839434306) | > loss_kl: 2.439908027648926 (4.226186752319336) | > loss_feat: 0.42530474066734314 (3.098582295080026) | > loss_mel: 8.136552810668945 (12.899394035339355) | > loss_duration: 2.8625807762145996 (3.031430721282959) | > loss_1: 15.544502258300781 (25.141224543253582) --> EVAL PERFORMANCE | > avg_loader_time: 0.006659110387166341 (-0.0006053447723388672) | > avg_loss_disc: 2.8620693683624268 (+0.9374782244364421) | > avg_loss_disc_real_0: 0.2602221568425496 (+0.08147971580425897) | > avg_loss_disc_real_1: 0.2572314937909444 (+0.06190665314594904) | > avg_loss_disc_real_2: 0.2560153802235921 (+0.12046051025390622) | > avg_loss_disc_real_3: 0.2234588364760081 (+0.07086202502250671) | > avg_loss_disc_real_4: 0.2678506275018056 (+0.0815206170082092) | > avg_loss_disc_real_5: 0.2893491288026174 (+0.1414866248766581) | > avg_loss_0: 2.8620693683624268 (+0.9374782244364421) | > avg_loss_gen: 1.885631839434306 (-1.0077842473983762) | > avg_loss_kl: 4.226186752319336 (-0.08009886741638184) | > avg_loss_feat: 3.098582295080026 (-4.85468448450168) | > avg_loss_mel: 12.899394035339355 (-11.462545712788899) | > avg_loss_duration: 3.031430721282959 (-0.032749096552530776) | > avg_loss_1: 25.141224543253582 (-17.437861760457356)  > EPOCH: 792/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:18:03)   --> TIME: 2023-10-20 09:18:17 -- STEP: 9/50 -- GLOBAL_STEP: 92610 | > loss_disc: 2.469517469406128 (2.4722262488471136) | > loss_disc_real_0: 0.050273597240448 (0.15002284405959976) | > loss_disc_real_1: 0.42382940649986267 (0.24928909664352736) | > loss_disc_real_2: 0.47097933292388916 (0.255545486178663) | > loss_disc_real_3: 0.3844314217567444 (0.21230076543158954) | > loss_disc_real_4: 0.14017264544963837 (0.21198405822118124) | > loss_disc_real_5: 0.2592830955982208 (0.2472176675995191) | > loss_0: 2.469517469406128 (2.4722262488471136) | > grad_norm_0: tensor(702.5530, device='cuda:0') (tensor(1177.9506, device='cuda:0')) | > loss_gen: 2.895827054977417 (2.304042114151849) | > loss_kl: 0.6329861283302307 (0.8175892697440253) | > loss_feat: 6.1104021072387695 (6.150700754589504) | > loss_mel: 20.99435806274414 (18.105185720655655) | > loss_duration: 1.3245183229446411 (1.4249372614754572) | > loss_1: 31.958091735839844 (28.802454789479572) | > grad_norm_1: tensor(63542.1836, device='cuda:0') (tensor(51293.7773, device='cuda:0')) | > current_lr_0: 9.058311820625048e-05 | > current_lr_1: 9.058311820625048e-05 | > step_time: 0.604 (0.8037518660227457) | > loader_time: 0.0247 (0.027661482493082683)  --> TIME: 2023-10-20 09:18:35 -- STEP: 39/50 -- GLOBAL_STEP: 92640 | > loss_disc: 1.8641437292099 (2.4991513139162307) | > loss_disc_real_0: 0.01290901005268097 (0.13776699491800407) | > loss_disc_real_1: 0.11896814405918121 (0.23225749761630327) | > loss_disc_real_2: 0.04050297662615776 (0.23215380024451476) | > loss_disc_real_3: 0.07283220440149307 (0.24217056578550583) | > loss_disc_real_4: 0.053125061094760895 (0.24112612610826126) | > loss_disc_real_5: 0.09935574978590012 (0.2604838019857804) | > loss_0: 1.8641437292099 (2.4991513139162307) | > grad_norm_0: tensor(1260.9885, device='cuda:0') (tensor(1264.5505, device='cuda:0')) | > loss_gen: 2.1396329402923584 (2.319463570912679) | > loss_kl: 0.5251120924949646 (0.8338235727487466) | > loss_feat: 7.023184776306152 (5.3655099128014765) | > loss_mel: 26.122867584228516 (20.26354577908149) | > loss_duration: 1.4599391222000122 (1.3952106665342283) | > loss_1: 37.27073669433594 (30.177553262466038) | > grad_norm_1: tensor(36765.1836, device='cuda:0') (tensor(46165.8750, device='cuda:0')) | > current_lr_0: 9.058311820625048e-05 | > current_lr_1: 9.058311820625048e-05 | > step_time: 0.6114 (0.6377117817218487) | > loader_time: 0.007 (0.022517815614357967)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7999444007873535 (2.7999444007873535) | > loss_disc_real_0: 0.2787070870399475 (0.2787070870399475) | > loss_disc_real_1: 0.3121291697025299 (0.3121291697025299) | > loss_disc_real_2: 0.2983357906341553 (0.2983357906341553) | > loss_disc_real_3: 0.3407652974128723 (0.3407652974128723) | > loss_disc_real_4: 0.2235998660326004 (0.2235998660326004) | > loss_disc_real_5: 0.22205272316932678 (0.22205272316932678) | > loss_0: 2.7999444007873535 (2.7999444007873535) | > loss_gen: 2.1062471866607666 (2.1062471866607666) | > loss_kl: 4.02816104888916 (4.02816104888916) | > loss_feat: 1.1304020881652832 (1.1304020881652832) | > loss_mel: 19.522052764892578 (19.522052764892578) | > loss_duration: 2.8374886512756348 (2.8374886512756348) | > loss_1: 29.624351501464844 (29.624351501464844)  --> STEP: 1 | > loss_disc: 1.6901357173919678 (1.6901357173919678) | > loss_disc_real_0: 0.09647288173437119 (0.09647288173437119) | > loss_disc_real_1: 0.2607642710208893 (0.2607642710208893) | > loss_disc_real_2: 0.1182747334241867 (0.1182747334241867) | > loss_disc_real_3: 0.07628485560417175 (0.07628485560417175) | > loss_disc_real_4: 0.0878930613398552 (0.0878930613398552) | > loss_disc_real_5: 0.07627633213996887 (0.07627633213996887) | > loss_0: 1.6901357173919678 (1.6901357173919678) | > loss_gen: 2.8389790058135986 (2.8389790058135986) | > loss_kl: 5.463749885559082 (5.463749885559082) | > loss_feat: 12.122332572937012 (12.122332572937012) | > loss_mel: 28.352792739868164 (28.352792739868164) | > loss_duration: 3.2290706634521484 (3.2290706634521484) | > loss_1: 52.006919860839844 (52.006919860839844)  --> STEP: 2 | > loss_disc: 2.95483136177063 (2.322483539581299) | > loss_disc_real_0: 0.28650882840156555 (0.19149085506796837) | > loss_disc_real_1: 0.2939504086971283 (0.2773573398590088) | > loss_disc_real_2: 0.28028979897499084 (0.19928226619958878) | > loss_disc_real_3: 0.34897735714912415 (0.21263110637664795) | > loss_disc_real_4: 0.25531986355781555 (0.17160646244883537) | > loss_disc_real_5: 0.23309363424777985 (0.15468498319387436) | > loss_0: 2.95483136177063 (2.322483539581299) | > loss_gen: 1.8011744022369385 (2.3200767040252686) | > loss_kl: 4.963644981384277 (5.21369743347168) | > loss_feat: 0.31109774112701416 (6.216715157032013) | > loss_mel: 20.720687866210938 (24.53674030303955) | > loss_duration: 2.9517359733581543 (3.0904033184051514) | > loss_1: 30.748340606689453 (41.37763023376465)  --> STEP: 3 | > loss_disc: 2.8882341384887695 (2.5110670725504556) | > loss_disc_real_0: 0.26844465732574463 (0.2171421224872271) | > loss_disc_real_1: 0.36082157492637634 (0.3051787515481313) | > loss_disc_real_2: 0.36852124333381653 (0.2556952585776647) | > loss_disc_real_3: 0.4596843719482422 (0.2949821949005127) | > loss_disc_real_4: 0.3360026180744171 (0.22640518099069595) | > loss_disc_real_5: 0.20530076324939728 (0.17155690987904867) | > loss_0: 2.8882341384887695 (2.5110670725504556) | > loss_gen: 2.4655580520629883 (2.3685704867045083) | > loss_kl: 2.238085985183716 (4.221826950709025) | > loss_feat: 3.132760763168335 (5.188730359077454) | > loss_mel: 19.17206382751465 (22.748514811197918) | > loss_duration: 2.8551528453826904 (3.011986494064331) | > loss_1: 29.86362075805664 (37.53962707519531) --> EVAL PERFORMANCE | > avg_loader_time: 0.010676701863606771 (+0.0040175914764404306) | > avg_loss_disc: 2.5110670725504556 (-0.3510022958119712) | > avg_loss_disc_real_0: 0.2171421224872271 (-0.04308003435532251) | > avg_loss_disc_real_1: 0.3051787515481313 (+0.04794725775718689) | > avg_loss_disc_real_2: 0.2556952585776647 (-0.0003201216459274292) | > avg_loss_disc_real_3: 0.2949821949005127 (+0.07152335842450461) | > avg_loss_disc_real_4: 0.22640518099069595 (-0.04144544651110965) | > avg_loss_disc_real_5: 0.17155690987904867 (-0.1177922189235687) | > avg_loss_0: 2.5110670725504556 (-0.3510022958119712) | > avg_loss_gen: 2.3685704867045083 (+0.4829386472702024) | > avg_loss_kl: 4.221826950709025 (-0.004359801610310576) | > avg_loss_feat: 5.188730359077454 (+2.0901480639974275) | > avg_loss_mel: 22.748514811197918 (+9.849120775858562) | > avg_loss_duration: 3.011986494064331 (-0.01944422721862793) | > avg_loss_1: 37.53962707519531 (+12.39840253194173)  > EPOCH: 793/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:18:54)   --> TIME: 2023-10-20 09:19:08 -- STEP: 19/50 -- GLOBAL_STEP: 92670 | > loss_disc: 2.7074813842773438 (2.3960616714075993) | > loss_disc_real_0: 0.11946392804384232 (0.17007046937942505) | > loss_disc_real_1: 0.43499886989593506 (0.22373376825922414) | > loss_disc_real_2: 0.33999553322792053 (0.2216263782036932) | > loss_disc_real_3: 0.30764779448509216 (0.256550076368608) | > loss_disc_real_4: 0.28454944491386414 (0.21772224995258607) | > loss_disc_real_5: 0.03895121440291405 (0.1797759742721131) | > loss_0: 2.7074813842773438 (2.3960616714075993) | > grad_norm_0: tensor(1401.6714, device='cuda:0') (tensor(1392.8198, device='cuda:0')) | > loss_gen: 2.2200539112091064 (2.4083744852166427) | > loss_kl: 0.8377112150192261 (0.8225020138840926) | > loss_feat: 5.343870639801025 (6.678871545940638) | > loss_mel: 21.404924392700195 (21.823442697525024) | > loss_duration: 1.465770959854126 (1.422870165423343) | > loss_1: 31.27233123779297 (33.15606072074488) | > grad_norm_1: tensor(29410.0469, device='cuda:0') (tensor(45208.2539, device='cuda:0')) | > current_lr_0: 9.049257470825242e-05 | > current_lr_1: 9.049257470825242e-05 | > step_time: 0.379 (0.41908333176060725) | > loader_time: 0.0019 (0.01214689957468133)  --> TIME: 2023-10-20 09:19:22 -- STEP: 49/50 -- GLOBAL_STEP: 92700 | > loss_disc: 3.0231950283050537 (2.46007311587431) | > loss_disc_real_0: 0.006564312614500523 (0.15611019964348902) | > loss_disc_real_1: 0.27932628989219666 (0.23521550151766563) | > loss_disc_real_2: 0.26711228489875793 (0.22985829245679232) | > loss_disc_real_3: 0.2551131844520569 (0.24717552655813646) | > loss_disc_real_4: 0.2464127391576767 (0.22828318798268327) | > loss_disc_real_5: 0.3119681775569916 (0.21527405075576841) | > loss_0: 3.0231950283050537 (2.46007311587431) | > grad_norm_0: tensor(3442.6528, device='cuda:0') (tensor(1348.0771, device='cuda:0')) | > loss_gen: 1.5681971311569214 (2.3325138408310555) | > loss_kl: 0.5864829421043396 (0.7870333784697007) | > loss_feat: 0.8401210308074951 (5.636862049829595) | > loss_mel: 17.901796340942383 (21.069376828719157) | > loss_duration: 1.5180507898330688 (1.3998738259685277) | > loss_1: 22.414648056030273 (31.22566009054379) | > grad_norm_1: tensor(21947.4336, device='cuda:0') (tensor(35779.9961, device='cuda:0')) | > current_lr_0: 9.049257470825242e-05 | > current_lr_1: 9.049257470825242e-05 | > step_time: 0.4683 (0.4483634598401128) | > loader_time: 0.3886 (0.018479254780983438)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2597432136535645 (2.2597432136535645) | > loss_disc_real_0: 0.22604109346866608 (0.22604109346866608) | > loss_disc_real_1: 0.21818995475769043 (0.21818995475769043) | > loss_disc_real_2: 0.13815908133983612 (0.13815908133983612) | > loss_disc_real_3: 0.18170519173145294 (0.18170519173145294) | > loss_disc_real_4: 0.1229996308684349 (0.1229996308684349) | > loss_disc_real_5: 0.17690235376358032 (0.17690235376358032) | > loss_0: 2.2597432136535645 (2.2597432136535645) | > loss_gen: 2.0903866291046143 (2.0903866291046143) | > loss_kl: 4.47476863861084 (4.47476863861084) | > loss_feat: 8.624319076538086 (8.624319076538086) | > loss_mel: 22.39983367919922 (22.39983367919922) | > loss_duration: 2.7956111431121826 (2.7956111431121826) | > loss_1: 40.384918212890625 (40.384918212890625)  --> STEP: 1 | > loss_disc: 2.9155049324035645 (2.9155049324035645) | > loss_disc_real_0: 0.1577654331922531 (0.1577654331922531) | > loss_disc_real_1: 0.3204067647457123 (0.3204067647457123) | > loss_disc_real_2: 0.25599512457847595 (0.25599512457847595) | > loss_disc_real_3: 0.23071208596229553 (0.23071208596229553) | > loss_disc_real_4: 0.29810646176338196 (0.29810646176338196) | > loss_disc_real_5: 0.22744044661521912 (0.22744044661521912) | > loss_0: 2.9155049324035645 (2.9155049324035645) | > loss_gen: 1.6461949348449707 (1.6461949348449707) | > loss_kl: 5.200694561004639 (5.200694561004639) | > loss_feat: 2.140937328338623 (2.140937328338623) | > loss_mel: 20.59386444091797 (20.59386444091797) | > loss_duration: 3.1901638507843018 (3.1901638507843018) | > loss_1: 32.771854400634766 (32.771854400634766)  --> STEP: 2 | > loss_disc: 2.3401100635528564 (2.6278074979782104) | > loss_disc_real_0: 0.1742946058511734 (0.16603001952171326) | > loss_disc_real_1: 0.19123436510562897 (0.2558205649256706) | > loss_disc_real_2: 0.18663090467453003 (0.221313014626503) | > loss_disc_real_3: 0.15773563086986542 (0.19422385841608047) | > loss_disc_real_4: 0.23082701861858368 (0.2644667401909828) | > loss_disc_real_5: 0.17571933567523956 (0.20157989114522934) | > loss_0: 2.3401100635528564 (2.6278074979782104) | > loss_gen: 2.3480730056762695 (1.9971339702606201) | > loss_kl: 5.145782947540283 (5.173238754272461) | > loss_feat: 7.34695291519165 (4.743945121765137) | > loss_mel: 17.790306091308594 (19.19208526611328) | > loss_duration: 2.966581344604492 (3.078372597694397) | > loss_1: 35.597694396972656 (34.18477439880371)  --> STEP: 3 | > loss_disc: 1.0500447750091553 (2.101886590321859) | > loss_disc_real_0: 0.009671738371253014 (0.11391059247155984) | > loss_disc_real_1: 0.08060102164745331 (0.19741405049959818) | > loss_disc_real_2: 0.053178559988737106 (0.16526819641391435) | > loss_disc_real_3: 0.035852521657943726 (0.14143341283003488) | > loss_disc_real_4: 0.04152281954884529 (0.19015209997693697) | > loss_disc_real_5: 0.024049224331974983 (0.1424030022074779) | > loss_0: 1.0500447750091553 (2.101886590321859) | > loss_gen: 2.9753353595733643 (2.3232011000315347) | > loss_kl: 2.5275824069976807 (4.291353305180867) | > loss_feat: 10.737706184387207 (6.741865475972493) | > loss_mel: 25.38713836669922 (21.257102966308594) | > loss_duration: 2.9253485202789307 (3.0273645718892417) | > loss_1: 44.5531120300293 (37.64088694254557) --> EVAL PERFORMANCE | > avg_loader_time: 0.00745089848836263 (-0.0032258033752441415) | > avg_loss_disc: 2.101886590321859 (-0.4091804822285967) | > avg_loss_disc_real_0: 0.11391059247155984 (-0.10323153001566727) | > avg_loss_disc_real_1: 0.19741405049959818 (-0.10776470104853311) | > avg_loss_disc_real_2: 0.16526819641391435 (-0.09042706216375032) | > avg_loss_disc_real_3: 0.14143341283003488 (-0.1535487820704778) | > avg_loss_disc_real_4: 0.19015209997693697 (-0.036253081013758987) | > avg_loss_disc_real_5: 0.1424030022074779 (-0.029153907671570778) | > avg_loss_0: 2.101886590321859 (-0.4091804822285967) | > avg_loss_gen: 2.3232011000315347 (-0.04536938667297363) | > avg_loss_kl: 4.291353305180867 (+0.06952635447184186) | > avg_loss_feat: 6.741865475972493 (+1.5531351168950396) | > avg_loss_mel: 21.257102966308594 (-1.491411844889324) | > avg_loss_duration: 3.0273645718892417 (+0.01537807782491063) | > avg_loss_1: 37.64088694254557 (+0.10125986735025805)  > EPOCH: 794/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:19:41)   --> TIME: 2023-10-20 09:20:02 -- STEP: 29/50 -- GLOBAL_STEP: 92730 | > loss_disc: 2.3316237926483154 (2.3598469249133402) | > loss_disc_real_0: 0.054400235414505005 (0.14391168113797903) | > loss_disc_real_1: 0.22357997298240662 (0.21256780174785647) | > loss_disc_real_2: 0.35750946402549744 (0.2164943590760231) | > loss_disc_real_3: 0.09193959087133408 (0.23541449203059592) | > loss_disc_real_4: 0.6769284605979919 (0.22326952283238544) | > loss_disc_real_5: 0.25805264711380005 (0.20881735783969535) | > loss_0: 2.3316237926483154 (2.3598469249133402) | > grad_norm_0: tensor(1382.9634, device='cuda:0') (tensor(1280.8363, device='cuda:0')) | > loss_gen: 3.651552677154541 (2.417438486526752) | > loss_kl: 0.9926904439926147 (0.8435684332046015) | > loss_feat: 10.01908016204834 (6.127589416529598) | > loss_mel: 24.496639251708984 (21.50728968916268) | > loss_duration: 1.3857417106628418 (1.4120901576403915) | > loss_1: 40.54570388793945 (32.30797609789618) | > grad_norm_1: tensor(121021.7734, device='cuda:0') (tensor(54330.4844, device='cuda:0')) | > current_lr_0: 9.04021217141495e-05 | > current_lr_1: 9.04021217141495e-05 | > step_time: 0.6692 (0.5400657982661807) | > loader_time: 0.0048 (0.01871944295948949)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9751251935958862 (1.9751251935958862) | > loss_disc_real_0: 0.19513341784477234 (0.19513341784477234) | > loss_disc_real_1: 0.17721733450889587 (0.17721733450889587) | > loss_disc_real_2: 0.12257048487663269 (0.12257048487663269) | > loss_disc_real_3: 0.10382287204265594 (0.10382287204265594) | > loss_disc_real_4: 0.06236390024423599 (0.06236390024423599) | > loss_disc_real_5: 0.01946871727705002 (0.01946871727705002) | > loss_0: 1.9751251935958862 (1.9751251935958862) | > loss_gen: 2.4036409854888916 (2.4036409854888916) | > loss_kl: 4.07353401184082 (4.07353401184082) | > loss_feat: 10.480856895446777 (10.480856895446777) | > loss_mel: 25.024959564208984 (25.024959564208984) | > loss_duration: 2.8161768913269043 (2.8161768913269043) | > loss_1: 44.79916763305664 (44.79916763305664)  --> STEP: 1 | > loss_disc: 2.1146132946014404 (2.1146132946014404) | > loss_disc_real_0: 0.15070152282714844 (0.15070152282714844) | > loss_disc_real_1: 0.19784824550151825 (0.19784824550151825) | > loss_disc_real_2: 0.15592263638973236 (0.15592263638973236) | > loss_disc_real_3: 0.1828400045633316 (0.1828400045633316) | > loss_disc_real_4: 0.1155736967921257 (0.1155736967921257) | > loss_disc_real_5: 0.07326362282037735 (0.07326362282037735) | > loss_0: 2.1146132946014404 (2.1146132946014404) | > loss_gen: 2.136484146118164 (2.136484146118164) | > loss_kl: 4.898026466369629 (4.898026466369629) | > loss_feat: 8.333025932312012 (8.333025932312012) | > loss_mel: 22.636926651000977 (22.636926651000977) | > loss_duration: 3.1721725463867188 (3.1721725463867188) | > loss_1: 41.1766357421875 (41.1766357421875)  --> STEP: 2 | > loss_disc: 2.3982467651367188 (2.2564300298690796) | > loss_disc_real_0: 0.4436027407646179 (0.2971521317958832) | > loss_disc_real_1: 0.2838241159915924 (0.24083618074655533) | > loss_disc_real_2: 0.15052519738674164 (0.153223916888237) | > loss_disc_real_3: 0.125942200422287 (0.1543911024928093) | > loss_disc_real_4: 0.07219110429286957 (0.09388240054249763) | > loss_disc_real_5: 0.10901666432619095 (0.09114014357328415) | > loss_0: 2.3982467651367188 (2.2564300298690796) | > loss_gen: 2.6993722915649414 (2.4179282188415527) | > loss_kl: 4.995853424072266 (4.946939945220947) | > loss_feat: 11.241246223449707 (9.78713607788086) | > loss_mel: 22.674049377441406 (22.65548801422119) | > loss_duration: 3.037304162979126 (3.1047383546829224) | > loss_1: 44.647823333740234 (42.91222953796387)  --> STEP: 3 | > loss_disc: 3.009223699569702 (2.5073612531026206) | > loss_disc_real_0: 0.258516788482666 (0.2842736840248108) | > loss_disc_real_1: 0.37450918555259705 (0.2853938490152359) | > loss_disc_real_2: 0.4498707056045532 (0.2521061797936757) | > loss_disc_real_3: 0.36430779099464417 (0.22436333199342093) | > loss_disc_real_4: 0.20364341139793396 (0.1304694041609764) | > loss_disc_real_5: 0.32869088649749756 (0.17032372454802194) | > loss_0: 3.009223699569702 (2.5073612531026206) | > loss_gen: 2.2950570583343506 (2.376971165339152) | > loss_kl: 2.235015630722046 (4.0429651737213135) | > loss_feat: 4.520918846130371 (8.03173033396403) | > loss_mel: 22.783292770385742 (22.698089599609375) | > loss_duration: 2.8786535263061523 (3.029376745223999) | > loss_1: 34.71293640136719 (40.179131825764976) --> EVAL PERFORMANCE | > avg_loader_time: 0.008335431416829428 (+0.0008845329284667977) | > avg_loss_disc: 2.5073612531026206 (+0.4054746627807617) | > avg_loss_disc_real_0: 0.2842736840248108 (+0.17036309155325097) | > avg_loss_disc_real_1: 0.2853938490152359 (+0.08797979851563772) | > avg_loss_disc_real_2: 0.2521061797936757 (+0.08683798337976137) | > avg_loss_disc_real_3: 0.22436333199342093 (+0.08292991916338605) | > avg_loss_disc_real_4: 0.1304694041609764 (-0.05968269581596056) | > avg_loss_disc_real_5: 0.17032372454802194 (+0.027920722340544046) | > avg_loss_0: 2.5073612531026206 (+0.4054746627807617) | > avg_loss_gen: 2.376971165339152 (+0.05377006530761719) | > avg_loss_kl: 4.0429651737213135 (-0.24838813145955374) | > avg_loss_feat: 8.03173033396403 (+1.2898648579915362) | > avg_loss_mel: 22.698089599609375 (+1.4409866333007812) | > avg_loss_duration: 3.029376745223999 (+0.002012173334757339) | > avg_loss_1: 40.179131825764976 (+2.538244883219406)  > EPOCH: 795/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:20:29)   --> TIME: 2023-10-20 09:20:39 -- STEP: 9/50 -- GLOBAL_STEP: 92760 | > loss_disc: 3.075546979904175 (2.3345761564042835) | > loss_disc_real_0: 0.3733140230178833 (0.2124317375322183) | > loss_disc_real_1: 0.28887319564819336 (0.24512360162205166) | > loss_disc_real_2: 0.24168018996715546 (0.21183773047394222) | > loss_disc_real_3: 0.2873152196407318 (0.19540341488189167) | > loss_disc_real_4: 0.28710880875587463 (0.16524229447046915) | > loss_disc_real_5: 0.32189902663230896 (0.1460714170502292) | > loss_0: 3.075546979904175 (2.3345761564042835) | > grad_norm_0: tensor(994.5859, device='cuda:0') (tensor(1337.3005, device='cuda:0')) | > loss_gen: 1.7255576848983765 (2.313006533516778) | > loss_kl: 0.8098138570785522 (0.7151974207825131) | > loss_feat: 0.10241647809743881 (6.2454505662123365) | > loss_mel: 2.556790828704834 (19.03630468580458) | > loss_duration: 1.3907543420791626 (1.4187010659111872) | > loss_1: 6.585332870483398 (29.72866005367703) | > grad_norm_1: tensor(46503.0156, device='cuda:0') (tensor(54473.9883, device='cuda:0')) | > current_lr_0: 9.031175913347736e-05 | > current_lr_1: 9.031175913347736e-05 | > step_time: 0.8129 (0.5097911622789171) | > loader_time: 0.0613 (0.03041659461127387)  --> TIME: 2023-10-20 09:20:53 -- STEP: 39/50 -- GLOBAL_STEP: 92790 | > loss_disc: 2.997514486312866 (2.372635288116261) | > loss_disc_real_0: 0.2768363356590271 (0.1568082339870624) | > loss_disc_real_1: 0.25529882311820984 (0.22210821442497083) | > loss_disc_real_2: 0.25246062874794006 (0.21272739383559197) | > loss_disc_real_3: 0.24242627620697021 (0.2298304681212474) | > loss_disc_real_4: 0.2764388918876648 (0.22660144494894224) | > loss_disc_real_5: 0.2414368838071823 (0.20511307323781344) | > loss_0: 2.997514486312866 (2.372635288116261) | > grad_norm_0: tensor(1109.0199, device='cuda:0') (tensor(1228.1908, device='cuda:0')) | > loss_gen: 1.5570698976516724 (2.4359754813023105) | > loss_kl: 0.3545639216899872 (0.8544248862144275) | > loss_feat: 0.1015469878911972 (6.130964497725169) | > loss_mel: 2.106128692626953 (20.475450405707726) | > loss_duration: 1.4477035999298096 (1.3956735470356085) | > loss_1: 5.567012786865234 (31.292488782833797) | > grad_norm_1: tensor(24962.0469, device='cuda:0') (tensor(60590.6758, device='cuda:0')) | > current_lr_0: 9.031175913347736e-05 | > current_lr_1: 9.031175913347736e-05 | > step_time: 0.5359 (0.45340538024902344) | > loader_time: 0.0122 (0.014743450360420423)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0266926288604736 (3.0266926288604736) | > loss_disc_real_0: 0.14649957418441772 (0.14649957418441772) | > loss_disc_real_1: 0.24777300655841827 (0.24777300655841827) | > loss_disc_real_2: 0.23903395235538483 (0.23903395235538483) | > loss_disc_real_3: 0.27013376355171204 (0.27013376355171204) | > loss_disc_real_4: 0.2574250400066376 (0.2574250400066376) | > loss_disc_real_5: 0.28116434812545776 (0.28116434812545776) | > loss_0: 3.0266926288604736 (3.0266926288604736) | > loss_gen: 1.4482091665267944 (1.4482091665267944) | > loss_kl: 4.403072834014893 (4.403072834014893) | > loss_feat: 0.03405221924185753 (0.03405221924185753) | > loss_mel: 1.493613600730896 (1.493613600730896) | > loss_duration: 2.740175724029541 (2.740175724029541) | > loss_1: 10.119123458862305 (10.119123458862305)  --> STEP: 1 | > loss_disc: 2.785768985748291 (2.785768985748291) | > loss_disc_real_0: 0.1469261646270752 (0.1469261646270752) | > loss_disc_real_1: 0.2591169774532318 (0.2591169774532318) | > loss_disc_real_2: 0.26489266753196716 (0.26489266753196716) | > loss_disc_real_3: 0.3399084806442261 (0.3399084806442261) | > loss_disc_real_4: 0.2829938232898712 (0.2829938232898712) | > loss_disc_real_5: 0.277692973613739 (0.277692973613739) | > loss_0: 2.785768985748291 (2.785768985748291) | > loss_gen: 1.9996148347854614 (1.9996148347854614) | > loss_kl: 4.728817462921143 (4.728817462921143) | > loss_feat: 2.1042377948760986 (2.1042377948760986) | > loss_mel: 20.810007095336914 (20.810007095336914) | > loss_duration: 3.190739154815674 (3.190739154815674) | > loss_1: 32.83341598510742 (32.83341598510742)  --> STEP: 2 | > loss_disc: 2.8203301429748535 (2.8030495643615723) | > loss_disc_real_0: 0.07849312573671341 (0.1127096451818943) | > loss_disc_real_1: 0.2619231939315796 (0.2605200856924057) | > loss_disc_real_2: 0.2378924936056137 (0.25139258056879044) | > loss_disc_real_3: 0.31497126817703247 (0.3274398744106293) | > loss_disc_real_4: 0.28277289867401123 (0.2828833609819412) | > loss_disc_real_5: 0.3021109700202942 (0.2899019718170166) | > loss_0: 2.8203301429748535 (2.8030495643615723) | > loss_gen: 1.7377243041992188 (1.86866956949234) | > loss_kl: 5.390903949737549 (5.059860706329346) | > loss_feat: 1.703020453453064 (1.9036291241645813) | > loss_mel: 20.0983829498291 (20.454195022583008) | > loss_duration: 2.999263048171997 (3.0950011014938354) | > loss_1: 31.92929458618164 (32.38135528564453)  --> STEP: 3 | > loss_disc: 2.5948326587677 (2.7336439291636148) | > loss_disc_real_0: 0.41307535767555237 (0.212831549346447) | > loss_disc_real_1: 0.4237922430038452 (0.3149441381295522) | > loss_disc_real_2: 0.36755111813545227 (0.29011209309101105) | > loss_disc_real_3: 0.20338375866413116 (0.28608783582846325) | > loss_disc_real_4: 0.2572995126247406 (0.274355411529541) | > loss_disc_real_5: 0.23232108354568481 (0.2707083423932393) | > loss_0: 2.5948326587677 (2.7336439291636148) | > loss_gen: 3.178436517715454 (2.305258552233378) | > loss_kl: 2.4958267211914062 (4.205182711283366) | > loss_feat: 4.866400241851807 (2.8912194967269897) | > loss_mel: 22.9232177734375 (21.277202606201172) | > loss_duration: 2.85667085647583 (3.0155576864878335) | > loss_1: 36.320552825927734 (33.6944211324056) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024413267771402993 (-0.005894104639689129) | > avg_loss_disc: 2.7336439291636148 (+0.22628267606099417) | > avg_loss_disc_real_0: 0.212831549346447 (-0.0714421346783638) | > avg_loss_disc_real_1: 0.3149441381295522 (+0.029550289114316286) | > avg_loss_disc_real_2: 0.29011209309101105 (+0.038005913297335325) | > avg_loss_disc_real_3: 0.28608783582846325 (+0.06172450383504233) | > avg_loss_disc_real_4: 0.274355411529541 (+0.1438860073685646) | > avg_loss_disc_real_5: 0.2707083423932393 (+0.10038461784521738) | > avg_loss_0: 2.7336439291636148 (+0.22628267606099417) | > avg_loss_gen: 2.305258552233378 (-0.07171261310577393) | > avg_loss_kl: 4.205182711283366 (+0.1622175375620527) | > avg_loss_feat: 2.8912194967269897 (-5.14051083723704) | > avg_loss_mel: 21.277202606201172 (-1.4208869934082031) | > avg_loss_duration: 3.0155576864878335 (-0.013819058736165513) | > avg_loss_1: 33.6944211324056 (-6.484710693359375)  > EPOCH: 796/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:21:15)   --> TIME: 2023-10-20 09:21:31 -- STEP: 19/50 -- GLOBAL_STEP: 92820 | > loss_disc: 1.8544293642044067 (2.3065480558495772) | > loss_disc_real_0: 0.08573782444000244 (0.15021731400568233) | > loss_disc_real_1: 0.22738629579544067 (0.22036320833783402) | > loss_disc_real_2: 0.18949493765830994 (0.19816034738170474) | > loss_disc_real_3: 0.2709841728210449 (0.21556039762340093) | > loss_disc_real_4: 0.1429532766342163 (0.19648442750698641) | > loss_disc_real_5: 0.10595789551734924 (0.1972830529863897) | > loss_0: 1.8544293642044067 (2.3065480558495772) | > grad_norm_0: tensor(631.0945, device='cuda:0') (tensor(1169.4237, device='cuda:0')) | > loss_gen: 2.924605369567871 (2.543047697920548) | > loss_kl: 1.1742647886276245 (0.8663260509309015) | > loss_feat: 7.844318866729736 (7.0689363040422135) | > loss_mel: 21.204078674316406 (21.856304319281328) | > loss_duration: 1.5108205080032349 (1.4292728022525185) | > loss_1: 34.65808868408203 (33.76388738029882) | > grad_norm_1: tensor(32383.4922, device='cuda:0') (tensor(64990.2852, device='cuda:0')) | > current_lr_0: 9.022148687586215e-05 | > current_lr_1: 9.022148687586215e-05 | > step_time: 0.7901 (0.6235213907141435) | > loader_time: 0.0088 (0.0219503452903346)  --> TIME: 2023-10-20 09:21:48 -- STEP: 49/50 -- GLOBAL_STEP: 92850 | > loss_disc: 2.277496814727783 (2.2913131640881907) | > loss_disc_real_0: 0.06266427785158157 (0.1567407706942486) | > loss_disc_real_1: 0.17401383817195892 (0.2062467138225935) | > loss_disc_real_2: 0.0922982320189476 (0.19612757481482565) | > loss_disc_real_3: 0.31212887167930603 (0.23472370541825585) | > loss_disc_real_4: 0.17365452647209167 (0.19969710175480163) | > loss_disc_real_5: 0.37096744775772095 (0.21290068020473937) | > loss_0: 2.277496814727783 (2.2913131640881907) | > grad_norm_0: tensor(1224.1943, device='cuda:0') (tensor(1139.5627, device='cuda:0')) | > loss_gen: 2.35847806930542 (2.495010434364785) | > loss_kl: 0.50296950340271 (0.8053628885168203) | > loss_feat: 5.174327373504639 (6.71466574711459) | > loss_mel: 23.750883102416992 (21.487171474768186) | > loss_duration: 1.4645204544067383 (1.3955190498001722) | > loss_1: 33.25117874145508 (32.89772963037295) | > grad_norm_1: tensor(13851.2676, device='cuda:0') (tensor(53928.6484, device='cuda:0')) | > current_lr_0: 9.022148687586215e-05 | > current_lr_1: 9.022148687586215e-05 | > step_time: 0.2636 (0.5659906620881996) | > loader_time: 0.4904 (0.026112468875184355)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.521085023880005 (2.521085023880005) | > loss_disc_real_0: 0.1947469413280487 (0.1947469413280487) | > loss_disc_real_1: 0.3823087811470032 (0.3823087811470032) | > loss_disc_real_2: 0.28632697463035583 (0.28632697463035583) | > loss_disc_real_3: 0.3934025764465332 (0.3934025764465332) | > loss_disc_real_4: 0.37657108902931213 (0.37657108902931213) | > loss_disc_real_5: 0.2936207354068756 (0.2936207354068756) | > loss_0: 2.521085023880005 (2.521085023880005) | > loss_gen: 3.425149440765381 (3.425149440765381) | > loss_kl: 4.6913886070251465 (4.6913886070251465) | > loss_feat: 6.594427585601807 (6.594427585601807) | > loss_mel: 23.17041015625 (23.17041015625) | > loss_duration: 2.834287405014038 (2.834287405014038) | > loss_1: 40.715660095214844 (40.715660095214844)  --> STEP: 1 | > loss_disc: 2.1590144634246826 (2.1590144634246826) | > loss_disc_real_0: 0.053659480065107346 (0.053659480065107346) | > loss_disc_real_1: 0.19597260653972626 (0.19597260653972626) | > loss_disc_real_2: 0.23292003571987152 (0.23292003571987152) | > loss_disc_real_3: 0.2337183654308319 (0.2337183654308319) | > loss_disc_real_4: 0.134751558303833 (0.134751558303833) | > loss_disc_real_5: 0.2865934669971466 (0.2865934669971466) | > loss_0: 2.1590144634246826 (2.1590144634246826) | > loss_gen: 2.4795475006103516 (2.4795475006103516) | > loss_kl: 5.551304340362549 (5.551304340362549) | > loss_feat: 9.066974639892578 (9.066974639892578) | > loss_mel: 25.4560489654541 (25.4560489654541) | > loss_duration: 3.2242298126220703 (3.2242298126220703) | > loss_1: 45.778099060058594 (45.778099060058594)  --> STEP: 2 | > loss_disc: 2.4646987915039062 (2.3118566274642944) | > loss_disc_real_0: 0.23814237117767334 (0.14590092562139034) | > loss_disc_real_1: 0.21937426924705505 (0.20767343789339066) | > loss_disc_real_2: 0.2719587981700897 (0.2524394169449806) | > loss_disc_real_3: 0.1915103644132614 (0.21261436492204666) | > loss_disc_real_4: 0.18142196536064148 (0.15808676183223724) | > loss_disc_real_5: 0.15804128348827362 (0.2223173752427101) | > loss_0: 2.4646987915039062 (2.3118566274642944) | > loss_gen: 2.514064073562622 (2.496805787086487) | > loss_kl: 5.064513683319092 (5.30790901184082) | > loss_feat: 9.261371612548828 (9.164173126220703) | > loss_mel: 24.298933029174805 (24.877490997314453) | > loss_duration: 3.032318115234375 (3.1282739639282227) | > loss_1: 44.171199798583984 (44.97464942932129)  --> STEP: 3 | > loss_disc: 2.5761094093322754 (2.3999408880869546) | > loss_disc_real_0: 0.16870859265327454 (0.15350348129868507) | > loss_disc_real_1: 0.25301602482795715 (0.22278763353824615) | > loss_disc_real_2: 0.28611937165260315 (0.2636660685141881) | > loss_disc_real_3: 0.1836521327495575 (0.20296028753121695) | > loss_disc_real_4: 0.26679545640945435 (0.1943229933579763) | > loss_disc_real_5: 0.16782356798648834 (0.2041527728239695) | > loss_0: 2.5761094093322754 (2.3999408880869546) | > loss_gen: 1.897788166999817 (2.2971332470575967) | > loss_kl: 2.36942458152771 (4.32841420173645) | > loss_feat: 3.5942068099975586 (7.307517687479655) | > loss_mel: 25.871065139770508 (25.208682378133137) | > loss_duration: 2.867244005203247 (3.041263977686564) | > loss_1: 36.5997314453125 (42.18301010131836) --> EVAL PERFORMANCE | > avg_loader_time: 0.004590590794881185 (+0.0021492640177408853) | > avg_loss_disc: 2.3999408880869546 (-0.33370304107666016) | > avg_loss_disc_real_0: 0.15350348129868507 (-0.05932806804776192) | > avg_loss_disc_real_1: 0.22278763353824615 (-0.09215650459130603) | > avg_loss_disc_real_2: 0.2636660685141881 (-0.026446024576822935) | > avg_loss_disc_real_3: 0.20296028753121695 (-0.0831275482972463) | > avg_loss_disc_real_4: 0.1943229933579763 (-0.08003241817156473) | > avg_loss_disc_real_5: 0.2041527728239695 (-0.0665555695692698) | > avg_loss_0: 2.3999408880869546 (-0.33370304107666016) | > avg_loss_gen: 2.2971332470575967 (-0.00812530517578125) | > avg_loss_kl: 4.32841420173645 (+0.12323149045308401) | > avg_loss_feat: 7.307517687479655 (+4.4162981907526655) | > avg_loss_mel: 25.208682378133137 (+3.931479771931965) | > avg_loss_duration: 3.041263977686564 (+0.02570629119873047) | > avg_loss_1: 42.18301010131836 (+8.488588968912758)  > EPOCH: 797/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:22:06)   --> TIME: 2023-10-20 09:22:28 -- STEP: 29/50 -- GLOBAL_STEP: 92880 | > loss_disc: 2.5735442638397217 (2.390264926285579) | > loss_disc_real_0: 0.3662780523300171 (0.16793384300223713) | > loss_disc_real_1: 0.25173893570899963 (0.21290827105785237) | > loss_disc_real_2: 0.31969138979911804 (0.2275269298075602) | > loss_disc_real_3: 0.2686651647090912 (0.22391155965883155) | > loss_disc_real_4: 0.2581060528755188 (0.2008290538435866) | > loss_disc_real_5: 0.22378259897232056 (0.20852898613646112) | > loss_0: 2.5735442638397217 (2.390264926285579) | > grad_norm_0: tensor(1458.0813, device='cuda:0') (tensor(1144.7743, device='cuda:0')) | > loss_gen: 2.3796677589416504 (2.35128771847692) | > loss_kl: 0.9679853916168213 (0.7852121303821432) | > loss_feat: 2.6045339107513428 (5.991027724640123) | > loss_mel: 21.692028045654297 (20.297145835284528) | > loss_duration: 1.3773398399353027 (1.3969274224906132) | > loss_1: 29.021554946899414 (30.82160079890284) | > grad_norm_1: tensor(6508.1670, device='cuda:0') (tensor(63798.2070, device='cuda:0')) | > current_lr_0: 9.013130485102033e-05 | > current_lr_1: 9.013130485102033e-05 | > step_time: 0.7205 (0.5951843919425175) | > loader_time: 0.0379 (0.02173452541745942)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.262605905532837 (2.262605905532837) | > loss_disc_real_0: 0.05541514605283737 (0.05541514605283737) | > loss_disc_real_1: 0.3402550518512726 (0.3402550518512726) | > loss_disc_real_2: 0.316762775182724 (0.316762775182724) | > loss_disc_real_3: 0.28621888160705566 (0.28621888160705566) | > loss_disc_real_4: 0.229886993765831 (0.229886993765831) | > loss_disc_real_5: 0.1893756091594696 (0.1893756091594696) | > loss_0: 2.262605905532837 (2.262605905532837) | > loss_gen: 2.537912130355835 (2.537912130355835) | > loss_kl: 5.091928005218506 (5.091928005218506) | > loss_feat: 7.567095756530762 (7.567095756530762) | > loss_mel: 23.962675094604492 (23.962675094604492) | > loss_duration: 2.9719979763031006 (2.9719979763031006) | > loss_1: 42.1316032409668 (42.1316032409668)  --> STEP: 1 | > loss_disc: 3.1114048957824707 (3.1114048957824707) | > loss_disc_real_0: 0.4122849404811859 (0.4122849404811859) | > loss_disc_real_1: 0.3730871379375458 (0.3730871379375458) | > loss_disc_real_2: 0.36845895648002625 (0.36845895648002625) | > loss_disc_real_3: 0.34302014112472534 (0.34302014112472534) | > loss_disc_real_4: 0.4235486090183258 (0.4235486090183258) | > loss_disc_real_5: 0.39011049270629883 (0.39011049270629883) | > loss_0: 3.1114048957824707 (3.1114048957824707) | > loss_gen: 3.3590729236602783 (3.3590729236602783) | > loss_kl: 4.704094409942627 (4.704094409942627) | > loss_feat: 8.018181800842285 (8.018181800842285) | > loss_mel: 27.061729431152344 (27.061729431152344) | > loss_duration: 3.3067102432250977 (3.3067102432250977) | > loss_1: 46.44978713989258 (46.44978713989258)  --> STEP: 2 | > loss_disc: 2.213336706161499 (2.662370800971985) | > loss_disc_real_0: 0.28234124183654785 (0.3473130911588669) | > loss_disc_real_1: 0.12389510124921799 (0.24849111959338188) | > loss_disc_real_2: 0.16043470799922943 (0.26444683223962784) | > loss_disc_real_3: 0.10366132110357285 (0.2233407311141491) | > loss_disc_real_4: 0.35381805896759033 (0.38868333399295807) | > loss_disc_real_5: 0.30284762382507324 (0.34647905826568604) | > loss_0: 2.213336706161499 (2.662370800971985) | > loss_gen: 3.020205497741699 (3.1896392107009888) | > loss_kl: 4.72413969039917 (4.714117050170898) | > loss_feat: 7.716270923614502 (7.8672263622283936) | > loss_mel: 24.699291229248047 (25.880510330200195) | > loss_duration: 3.1305198669433594 (3.2186150550842285) | > loss_1: 43.290428161621094 (44.870107650756836)  --> STEP: 3 | > loss_disc: 2.78800892829895 (2.70425017674764) | > loss_disc_real_0: 0.2525050640106201 (0.3157104154427846) | > loss_disc_real_1: 0.3026961088180542 (0.2665594493349393) | > loss_disc_real_2: 0.3246282935142517 (0.28450731933116913) | > loss_disc_real_3: 0.31109464168548584 (0.252592034637928) | > loss_disc_real_4: 0.38234537839889526 (0.38657068212827045) | > loss_disc_real_5: 0.3413500487804413 (0.3447693884372711) | > loss_0: 2.78800892829895 (2.70425017674764) | > loss_gen: 2.5580084323883057 (2.9790956179300943) | > loss_kl: 2.2199549674987793 (3.882729689280192) | > loss_feat: 3.7932851314544678 (6.509245951970418) | > loss_mel: 22.243183135986328 (24.668067932128906) | > loss_duration: 2.992304563522339 (3.1431782245635986) | > loss_1: 33.80673599243164 (41.18231709798177) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027315616607666016 (-0.001859029134114583) | > avg_loss_disc: 2.70425017674764 (+0.3043092886606855) | > avg_loss_disc_real_0: 0.3157104154427846 (+0.16220693414409953) | > avg_loss_disc_real_1: 0.2665594493349393 (+0.04377181579669315) | > avg_loss_disc_real_2: 0.28450731933116913 (+0.020841250816981016) | > avg_loss_disc_real_3: 0.252592034637928 (+0.04963174710671106) | > avg_loss_disc_real_4: 0.38657068212827045 (+0.19224768877029416) | > avg_loss_disc_real_5: 0.3447693884372711 (+0.1406166156133016) | > avg_loss_0: 2.70425017674764 (+0.3043092886606855) | > avg_loss_gen: 2.9790956179300943 (+0.6819623708724976) | > avg_loss_kl: 3.882729689280192 (-0.4456845124562583) | > avg_loss_feat: 6.509245951970418 (-0.7982717355092372) | > avg_loss_mel: 24.668067932128906 (-0.5406144460042306) | > avg_loss_duration: 3.1431782245635986 (+0.10191424687703465) | > avg_loss_1: 41.18231709798177 (-1.0006930033365862)  > EPOCH: 798/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:22:56)   --> TIME: 2023-10-20 09:23:06 -- STEP: 9/50 -- GLOBAL_STEP: 92910 | > loss_disc: 2.8121726512908936 (2.3963403701782227) | > loss_disc_real_0: 0.09588387608528137 (0.14340715441438887) | > loss_disc_real_1: 0.22782482206821442 (0.23167875533302626) | > loss_disc_real_2: 0.22793179750442505 (0.237362007300059) | > loss_disc_real_3: 0.2751002609729767 (0.2426550719473097) | > loss_disc_real_4: 0.18624933063983917 (0.19815182727244166) | > loss_disc_real_5: 0.13791312277317047 (0.2832866335908572) | > loss_0: 2.8121726512908936 (2.3963403701782227) | > grad_norm_0: tensor(1221.6766, device='cuda:0') (tensor(947.9354, device='cuda:0')) | > loss_gen: 1.6342871189117432 (2.4383526113298206) | > loss_kl: 1.0126521587371826 (0.9522162874539694) | > loss_feat: 4.799649715423584 (6.026663170920478) | > loss_mel: 24.043378829956055 (22.23858070373535) | > loss_duration: 1.3674019575119019 (1.3941543632083468) | > loss_1: 32.85736846923828 (33.049966388278534) | > grad_norm_1: tensor(12282.4658, device='cuda:0') (tensor(24246.4004, device='cuda:0')) | > current_lr_0: 9.00412129687586e-05 | > current_lr_1: 9.00412129687586e-05 | > step_time: 0.8327 (0.5357413556840684) | > loader_time: 0.0317 (0.016678704155815974)  --> TIME: 2023-10-20 09:23:27 -- STEP: 39/50 -- GLOBAL_STEP: 92940 | > loss_disc: 1.2269611358642578 (2.4467858993090115) | > loss_disc_real_0: 0.039361223578453064 (0.16408660258047092) | > loss_disc_real_1: 0.05285940319299698 (0.23552098650580797) | > loss_disc_real_2: 0.10414082556962967 (0.22519149139332464) | > loss_disc_real_3: 0.09564024209976196 (0.23213293336522886) | > loss_disc_real_4: 0.09934710711240768 (0.21502536759735683) | > loss_disc_real_5: 0.037142008543014526 (0.23422568305753735) | > loss_0: 1.2269611358642578 (2.4467858993090115) | > grad_norm_0: tensor(1241.6348, device='cuda:0') (tensor(1055.6641, device='cuda:0')) | > loss_gen: 3.25634765625 (2.2777610100232635) | > loss_kl: 0.5684579610824585 (0.8483499364975171) | > loss_feat: 9.96131706237793 (5.15873898126376) | > loss_mel: 27.215408325195312 (19.84150524628468) | > loss_duration: 1.4217225313186646 (1.3916489313810299) | > loss_1: 42.42325210571289 (29.518004013941837) | > grad_norm_1: tensor(121369.4062, device='cuda:0') (tensor(46941.1016, device='cuda:0')) | > current_lr_0: 9.00412129687586e-05 | > current_lr_1: 9.00412129687586e-05 | > step_time: 0.2595 (0.6480021599011544) | > loader_time: 0.0024 (0.021234885240212466)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.84944486618042 (2.84944486618042) | > loss_disc_real_0: 0.17123442888259888 (0.17123442888259888) | > loss_disc_real_1: 0.28148576617240906 (0.28148576617240906) | > loss_disc_real_2: 0.167536661028862 (0.167536661028862) | > loss_disc_real_3: 0.2922191321849823 (0.2922191321849823) | > loss_disc_real_4: 0.2633027732372284 (0.2633027732372284) | > loss_disc_real_5: 0.2427244335412979 (0.2427244335412979) | > loss_0: 2.84944486618042 (2.84944486618042) | > loss_gen: 1.5963071584701538 (1.5963071584701538) | > loss_kl: 3.9062139987945557 (3.9062139987945557) | > loss_feat: 0.5435943603515625 (0.5435943603515625) | > loss_mel: 14.93475341796875 (14.93475341796875) | > loss_duration: 2.827111005783081 (2.827111005783081) | > loss_1: 23.807979583740234 (23.807979583740234)  --> STEP: 1 | > loss_disc: 2.2952024936676025 (2.2952024936676025) | > loss_disc_real_0: 0.13626569509506226 (0.13626569509506226) | > loss_disc_real_1: 0.30917108058929443 (0.30917108058929443) | > loss_disc_real_2: 0.1850747913122177 (0.1850747913122177) | > loss_disc_real_3: 0.21802864968776703 (0.21802864968776703) | > loss_disc_real_4: 0.18989120423793793 (0.18989120423793793) | > loss_disc_real_5: 0.22075538337230682 (0.22075538337230682) | > loss_0: 2.2952024936676025 (2.2952024936676025) | > loss_gen: 2.241554021835327 (2.241554021835327) | > loss_kl: 4.756982803344727 (4.756982803344727) | > loss_feat: 5.501069068908691 (5.501069068908691) | > loss_mel: 23.32152557373047 (23.32152557373047) | > loss_duration: 3.3483126163482666 (3.3483126163482666) | > loss_1: 39.1694450378418 (39.1694450378418)  --> STEP: 2 | > loss_disc: 3.023407459259033 (2.659304976463318) | > loss_disc_real_0: 0.22086358070373535 (0.1785646378993988) | > loss_disc_real_1: 0.28160199522972107 (0.29538653790950775) | > loss_disc_real_2: 0.17434446513652802 (0.17970962822437286) | > loss_disc_real_3: 0.30245187878608704 (0.26024026423692703) | > loss_disc_real_4: 0.2500373125076294 (0.21996425837278366) | > loss_disc_real_5: 0.2641730010509491 (0.24246419221162796) | > loss_0: 3.023407459259033 (2.659304976463318) | > loss_gen: 1.4948539733886719 (1.8682039976119995) | > loss_kl: 5.320695877075195 (5.038839340209961) | > loss_feat: 0.020398054271936417 (2.760733561590314) | > loss_mel: 1.1622925996780396 (12.241909086704254) | > loss_duration: 3.1415741443634033 (3.244943380355835) | > loss_1: 11.139814376831055 (25.154629707336426)  --> STEP: 3 | > loss_disc: 3.0218493938446045 (2.7801531155904136) | > loss_disc_real_0: 0.22121909260749817 (0.19278278946876526) | > loss_disc_real_1: 0.281713604927063 (0.2908288935820262) | > loss_disc_real_2: 0.17417865991592407 (0.1778659721215566) | > loss_disc_real_3: 0.30265042185783386 (0.274376983443896) | > loss_disc_real_4: 0.24850095808506012 (0.22947649161020914) | > loss_disc_real_5: 0.26551052927970886 (0.2501463045676549) | > loss_0: 3.0218493938446045 (2.7801531155904136) | > loss_gen: 1.4963778257369995 (1.7442619403203328) | > loss_kl: 2.0703933238983154 (4.049357334772746) | > loss_feat: 0.024638906121253967 (1.848702009767294) | > loss_mel: 3.474038600921631 (9.31928559144338) | > loss_duration: 3.025672435760498 (3.1718530654907227) | > loss_1: 10.091121673583984 (20.133460362752277) --> EVAL PERFORMANCE | > avg_loader_time: 0.0157015323638916 (+0.012969970703125) | > avg_loss_disc: 2.7801531155904136 (+0.07590293884277344) | > avg_loss_disc_real_0: 0.19278278946876526 (-0.12292762597401935) | > avg_loss_disc_real_1: 0.2908288935820262 (+0.02426944424708688) | > avg_loss_disc_real_2: 0.1778659721215566 (-0.10664134720961252) | > avg_loss_disc_real_3: 0.274376983443896 (+0.021784948805967985) | > avg_loss_disc_real_4: 0.22947649161020914 (-0.1570941905180613) | > avg_loss_disc_real_5: 0.2501463045676549 (-0.09462308386961621) | > avg_loss_0: 2.7801531155904136 (+0.07590293884277344) | > avg_loss_gen: 1.7442619403203328 (-1.2348336776097615) | > avg_loss_kl: 4.049357334772746 (+0.16662764549255416) | > avg_loss_feat: 1.848702009767294 (-4.660543942203124) | > avg_loss_mel: 9.31928559144338 (-15.348782340685526) | > avg_loss_duration: 3.1718530654907227 (+0.028674840927124023) | > avg_loss_1: 20.133460362752277 (-21.048856735229496)  > EPOCH: 799/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:23:41)   --> TIME: 2023-10-20 09:23:59 -- STEP: 19/50 -- GLOBAL_STEP: 92970 | > loss_disc: 3.5746588706970215 (2.4663791405527213) | > loss_disc_real_0: 0.38528454303741455 (0.14671939699665495) | > loss_disc_real_1: 0.3047056496143341 (0.23207840950865494) | > loss_disc_real_2: 0.31391194462776184 (0.22870131778089622) | > loss_disc_real_3: 0.39298462867736816 (0.2705464314081167) | > loss_disc_real_4: 0.3979046642780304 (0.23224206621709623) | > loss_disc_real_5: 0.5155561566352844 (0.26484184687663065) | > loss_0: 3.5746588706970215 (2.4663791405527213) | > grad_norm_0: tensor(1325.0160, device='cuda:0') (tensor(1294.8481, device='cuda:0')) | > loss_gen: 2.140824317932129 (2.391865667543913) | > loss_kl: 0.7049210667610168 (0.8418598261318708) | > loss_feat: 5.875628471374512 (5.241708106900516) | > loss_mel: 24.830482482910156 (20.42526524317892) | > loss_duration: 1.4336212873458862 (1.430362299868935) | > loss_1: 34.985477447509766 (30.331060760899593) | > grad_norm_1: tensor(18962.4844, device='cuda:0') (tensor(57425.1992, device='cuda:0')) | > current_lr_0: 8.995121113897376e-05 | > current_lr_1: 8.995121113897376e-05 | > step_time: 0.7009 (0.6221202298214561) | > loader_time: 0.0367 (0.022412024046245375)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5311543941497803 (2.5311543941497803) | > loss_disc_real_0: 0.30766743421554565 (0.30766743421554565) | > loss_disc_real_1: 0.24849623441696167 (0.24849623441696167) | > loss_disc_real_2: 0.2761649787425995 (0.2761649787425995) | > loss_disc_real_3: 0.21345838904380798 (0.21345838904380798) | > loss_disc_real_4: 0.17271578311920166 (0.17271578311920166) | > loss_disc_real_5: 0.12744355201721191 (0.12744355201721191) | > loss_0: 2.5311543941497803 (2.5311543941497803) | > loss_gen: 2.6139793395996094 (2.6139793395996094) | > loss_kl: 3.9710898399353027 (3.9710898399353027) | > loss_feat: 7.199069976806641 (7.199069976806641) | > loss_mel: 24.181060791015625 (24.181060791015625) | > loss_duration: 2.8016417026519775 (2.8016417026519775) | > loss_1: 40.766841888427734 (40.766841888427734)  --> STEP: 1 | > loss_disc: 2.547011613845825 (2.547011613845825) | > loss_disc_real_0: 0.2236722707748413 (0.2236722707748413) | > loss_disc_real_1: 0.18799236416816711 (0.18799236416816711) | > loss_disc_real_2: 0.15463173389434814 (0.15463173389434814) | > loss_disc_real_3: 0.2334458976984024 (0.2334458976984024) | > loss_disc_real_4: 0.2351192682981491 (0.2351192682981491) | > loss_disc_real_5: 0.27247583866119385 (0.27247583866119385) | > loss_0: 2.547011613845825 (2.547011613845825) | > loss_gen: 2.2847561836242676 (2.2847561836242676) | > loss_kl: 4.256201267242432 (4.256201267242432) | > loss_feat: 5.485910415649414 (5.485910415649414) | > loss_mel: 25.395170211791992 (25.395170211791992) | > loss_duration: 3.1993367671966553 (3.1993367671966553) | > loss_1: 40.621376037597656 (40.621376037597656)  --> STEP: 2 | > loss_disc: 2.176767349243164 (2.3618894815444946) | > loss_disc_real_0: 0.3314492106437683 (0.2775607407093048) | > loss_disc_real_1: 0.309479296207428 (0.24873583018779755) | > loss_disc_real_2: 0.16439567506313324 (0.1595137044787407) | > loss_disc_real_3: 0.06540605425834656 (0.14942597597837448) | > loss_disc_real_4: 0.08270099759101868 (0.1589101329445839) | > loss_disc_real_5: 0.13249212503433228 (0.20248398184776306) | > loss_0: 2.176767349243164 (2.3618894815444946) | > loss_gen: 2.626718044281006 (2.4557371139526367) | > loss_kl: 5.149896144866943 (4.7030487060546875) | > loss_feat: 12.090412139892578 (8.788161277770996) | > loss_mel: 24.681121826171875 (25.038146018981934) | > loss_duration: 2.964984893798828 (3.0821608304977417) | > loss_1: 47.51313400268555 (44.0672550201416)  --> STEP: 3 | > loss_disc: 2.5975658893585205 (2.44044828414917) | > loss_disc_real_0: 0.13705985248088837 (0.23072711129983267) | > loss_disc_real_1: 0.2187318056821823 (0.2387344886859258) | > loss_disc_real_2: 0.16422781348228455 (0.16108507414658865) | > loss_disc_real_3: 0.17215536534786224 (0.15700243910153708) | > loss_disc_real_4: 0.3337133228778839 (0.21717786292235056) | > loss_disc_real_5: 0.3204645812511444 (0.24181084831555685) | > loss_0: 2.5975658893585205 (2.44044828414917) | > loss_gen: 2.0554351806640625 (2.322303136189779) | > loss_kl: 1.9990853071212769 (3.801727573076884) | > loss_feat: 3.204366683959961 (6.926896413167317) | > loss_mel: 21.206226348876953 (23.760839462280273) | > loss_duration: 2.89292573928833 (3.019082466761271) | > loss_1: 31.35803985595703 (39.830849965413414)  --> TIME: 2023-10-20 09:24:27 -- STEP: 49/50 -- GLOBAL_STEP: 93000 | > loss_disc: 2.3509151935577393 (2.521371058055333) | > loss_disc_real_0: 0.07657250761985779 (0.15479975585274555) | > loss_disc_real_1: 0.1734287142753601 (0.22523263644198982) | > loss_disc_real_2: 0.23124291002750397 (0.2243659871877456) | > loss_disc_real_3: 0.20656365156173706 (0.24269346026133518) | > loss_disc_real_4: 0.20193074643611908 (0.2289863257687919) | > loss_disc_real_5: 0.21511049568653107 (0.24129476898102736) | > loss_0: 2.3509151935577393 (2.521371058055333) | > grad_norm_0: tensor(978.8806, device='cuda:0') (tensor(1275.5640, device='cuda:0')) | > loss_gen: 2.6005470752716064 (2.2029935827060623) | > loss_kl: 0.45234009623527527 (0.7602944742051922) | > loss_feat: 6.470795154571533 (4.7819552174294175) | > loss_mel: 26.359554290771484 (19.25799356188093) | > loss_duration: 1.5120424032211304 (1.3954743414509052) | > loss_1: 37.39527893066406 (28.398710912587692) | > grad_norm_1: tensor(66879.1328, device='cuda:0') (tensor(44481.6250, device='cuda:0')) | > current_lr_0: 8.995121113897376e-05 | > current_lr_1: 8.995121113897376e-05 | > step_time: 1.7072 (0.6454100560168831) | > loader_time: 7.9524 (0.1833323605206548) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_93000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7913904190063477 (2.5281838178634644) | > loss_disc_real_0: 0.27810537815093994 (0.24257167801260948) | > loss_disc_real_1: 0.25000205636024475 (0.24155138060450554) | > loss_disc_real_2: 0.20668195188045502 (0.17248429358005524) | > loss_disc_real_3: 0.2699052095413208 (0.185228131711483) | > loss_disc_real_4: 0.19553712010383606 (0.21176767721772194) | > loss_disc_real_5: 0.23509344458580017 (0.24013149738311768) | > loss_0: 2.7913904190063477 (2.5281838178634644) | > loss_gen: 1.7456613779067993 (2.178142696619034) | > loss_kl: 4.114109516143799 (3.8798230588436127) | > loss_feat: 1.9981696605682373 (5.694714725017548) | > loss_mel: 20.056167602539062 (22.83467149734497) | > loss_duration: 2.737722396850586 (2.9487424492836) | > loss_1: 30.65182876586914 (37.536094665527344)  --> STEP: 1 | > loss_disc: 2.9980216026306152 (2.6221513748168945) | > loss_disc_real_0: 0.3377884030342102 (0.2616150230169296) | > loss_disc_real_1: 0.2723589539527893 (0.2477128952741623) | > loss_disc_real_2: 0.2787092328071594 (0.19372928142547607) | > loss_disc_real_3: 0.26677536964416504 (0.2015375792980194) | > loss_disc_real_4: 0.3202997148036957 (0.23347408473491668) | > loss_disc_real_5: 0.27338704466819763 (0.24678260684013367) | > loss_0: 2.9980216026306152 (2.6221513748168945) | > loss_gen: 1.8047834634780884 (2.1034708499908445) | > loss_kl: 4.5525054931640625 (4.014359545707703) | > loss_feat: 0.17995451390743256 (4.591762682795524) | > loss_mel: 14.648776054382324 (21.197492408752442) | > loss_duration: 3.1945884227752686 (2.9979116439819338) | > loss_1: 24.38060760498047 (34.90499725341797)  --> STEP: 2 | > loss_disc: 2.4518375396728516 (2.5937657356262207) | > loss_disc_real_0: 0.10617858171463013 (0.23570894946654639) | > loss_disc_real_1: 0.26103124022483826 (0.24993261943260828) | > loss_disc_real_2: 0.1764582097530365 (0.1908507694800695) | > loss_disc_real_3: 0.2929292321205139 (0.21676952143510184) | > loss_disc_real_4: 0.3375188410282135 (0.25081487745046616) | > loss_disc_real_5: 0.2886064350605011 (0.2537532448768616) | > loss_0: 2.4518375396728516 (2.5937657356262207) | > loss_gen: 2.4051878452301025 (2.153757015864054) | > loss_kl: 5.317925453186035 (4.231620530287425) | > loss_feat: 2.700756311416626 (4.276594954232375) | > loss_mel: 22.225093841552734 (21.368759314219158) | > loss_duration: 3.008613348007202 (2.9996952613194785) | > loss_1: 35.65757751464844 (35.03042729695638)  --> STEP: 3 | > loss_disc: 2.825258255004883 (2.6268360955374583) | > loss_disc_real_0: 0.3123970031738281 (0.24666438571044377) | > loss_disc_real_1: 0.3092867136001587 (0.2584117757422583) | > loss_disc_real_2: 0.2804262340068817 (0.20364726441247122) | > loss_disc_real_3: 0.2283039391040802 (0.21841729538781302) | > loss_disc_real_4: 0.31232067942619324 (0.25960142058985575) | > loss_disc_real_5: 0.3151710629463196 (0.26252721888678415) | > loss_0: 2.825258255004883 (2.6268360955374583) | > loss_gen: 2.2335140705108643 (2.1651508808135986) | > loss_kl: 2.601064443588257 (3.9986839464732578) | > loss_feat: 1.6548545360565186 (3.902060608778681) | > loss_mel: 16.600780487060547 (20.68761948176793) | > loss_duration: 2.8172709941864014 (2.973634651729039) | > loss_1: 25.90748405456543 (33.72714969090053) --> EVAL PERFORMANCE | > avg_loader_time: 0.6474456105913434 (+0.6317440782274518) | > avg_loss_disc: 2.6268360955374583 (-0.15331702005295522) | > avg_loss_disc_real_0: 0.24666438571044377 (+0.053881596241678514) | > avg_loss_disc_real_1: 0.2584117757422583 (-0.03241711783976786) | > avg_loss_disc_real_2: 0.20364726441247122 (+0.02578129229091461) | > avg_loss_disc_real_3: 0.21841729538781302 (-0.05595968805608298) | > avg_loss_disc_real_4: 0.25960142058985575 (+0.03012492897964661) | > avg_loss_disc_real_5: 0.26252721888678415 (+0.012380914319129244) | > avg_loss_0: 2.6268360955374583 (-0.15331702005295522) | > avg_loss_gen: 2.1651508808135986 (+0.42088894049326586) | > avg_loss_kl: 3.9986839464732578 (-0.05067338829948831) | > avg_loss_feat: 3.902060608778681 (+2.053358599011387) | > avg_loss_mel: 20.68761948176793 (+11.368333890324548) | > avg_loss_duration: 2.973634651729039 (-0.1982184137616838) | > avg_loss_1: 33.72714969090053 (+13.593689328148255)  > EPOCH: 800/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:24:45)   --> TIME: 2023-10-20 09:25:08 -- STEP: 29/50 -- GLOBAL_STEP: 93030 | > loss_disc: 2.078890562057495 (2.4242774782509637) | > loss_disc_real_0: 0.22949349880218506 (0.15544999911096588) | > loss_disc_real_1: 0.19449979066848755 (0.2169303614003905) | > loss_disc_real_2: 0.16596877574920654 (0.21080792168604917) | > loss_disc_real_3: 0.2352033406496048 (0.2235562197607139) | > loss_disc_real_4: 0.21587443351745605 (0.1939164510574834) | > loss_disc_real_5: 0.110626719892025 (0.20498906464540753) | > loss_0: 2.078890562057495 (2.4242774782509637) | > grad_norm_0: tensor(744.5262, device='cuda:0') (tensor(1159.6145, device='cuda:0')) | > loss_gen: 2.690203905105591 (2.243319264773665) | > loss_kl: 1.0758329629898071 (0.8179308576830502) | > loss_feat: 6.525678634643555 (5.080563731427336) | > loss_mel: 24.15837287902832 (17.725941033198914) | > loss_duration: 1.3662242889404297 (1.3987273553322102) | > loss_1: 35.816314697265625 (27.266482484751734) | > grad_norm_1: tensor(8693.0488, device='cuda:0') (tensor(50233.3633, device='cuda:0')) | > current_lr_0: 8.986129927165276e-05 | > current_lr_1: 8.986129927165276e-05 | > step_time: 0.7346 (0.617577577459401) | > loader_time: 0.0226 (0.021075306267573916)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2167088985443115 (2.2167088985443115) | > loss_disc_real_0: 0.11623471975326538 (0.11623471975326538) | > loss_disc_real_1: 0.16638782620429993 (0.16638782620429993) | > loss_disc_real_2: 0.2018725872039795 (0.2018725872039795) | > loss_disc_real_3: 0.27270635962486267 (0.27270635962486267) | > loss_disc_real_4: 0.22403259575366974 (0.22403259575366974) | > loss_disc_real_5: 0.24373507499694824 (0.24373507499694824) | > loss_0: 2.2167088985443115 (2.2167088985443115) | > loss_gen: 2.7699661254882812 (2.7699661254882812) | > loss_kl: 4.786391258239746 (4.786391258239746) | > loss_feat: 5.152065277099609 (5.152065277099609) | > loss_mel: 28.183670043945312 (28.183670043945312) | > loss_duration: 2.9394900798797607 (2.9394900798797607) | > loss_1: 43.83158493041992 (43.83158493041992)  --> STEP: 1 | > loss_disc: 2.5589733123779297 (2.5589733123779297) | > loss_disc_real_0: 0.19656160473823547 (0.19656160473823547) | > loss_disc_real_1: 0.2796330153942108 (0.2796330153942108) | > loss_disc_real_2: 0.17792795598506927 (0.17792795598506927) | > loss_disc_real_3: 0.32242366671562195 (0.32242366671562195) | > loss_disc_real_4: 0.12706135213375092 (0.12706135213375092) | > loss_disc_real_5: 0.13711054623126984 (0.13711054623126984) | > loss_0: 2.5589733123779297 (2.5589733123779297) | > loss_gen: 1.862178087234497 (1.862178087234497) | > loss_kl: 4.925045967102051 (4.925045967102051) | > loss_feat: 5.219736099243164 (5.219736099243164) | > loss_mel: 23.533519744873047 (23.533519744873047) | > loss_duration: 3.271008014678955 (3.271008014678955) | > loss_1: 38.81148910522461 (38.81148910522461)  --> STEP: 2 | > loss_disc: 2.575740337371826 (2.567356824874878) | > loss_disc_real_0: 0.397849977016449 (0.2972057908773422) | > loss_disc_real_1: 0.20004674792289734 (0.23983988165855408) | > loss_disc_real_2: 0.3352223336696625 (0.2565751448273659) | > loss_disc_real_3: 0.08138449490070343 (0.2019040808081627) | > loss_disc_real_4: 0.2148260772228241 (0.1709437146782875) | > loss_disc_real_5: 0.27218398451805115 (0.2046472653746605) | > loss_0: 2.575740337371826 (2.567356824874878) | > loss_gen: 2.6656506061553955 (2.2639143466949463) | > loss_kl: 5.345716953277588 (5.135381460189819) | > loss_feat: 8.627056121826172 (6.923396110534668) | > loss_mel: 25.520164489746094 (24.52684211730957) | > loss_duration: 2.9560868740081787 (3.113547444343567) | > loss_1: 45.11466979980469 (41.96307945251465)  --> STEP: 3 | > loss_disc: 3.340405225753784 (2.8250396251678467) | > loss_disc_real_0: 0.6414461135864258 (0.41195256511370343) | > loss_disc_real_1: 0.27314773201942444 (0.25094249844551086) | > loss_disc_real_2: 0.29169777035713196 (0.2682826866706212) | > loss_disc_real_3: 0.32195138931274414 (0.24191985030968985) | > loss_disc_real_4: 0.2507401704788208 (0.19754253327846527) | > loss_disc_real_5: 0.27161192893981934 (0.2269688198963801) | > loss_0: 3.340405225753784 (2.8250396251678467) | > loss_gen: 1.9505690336227417 (2.1594659090042114) | > loss_kl: 2.385114908218384 (4.218625942866008) | > loss_feat: 2.4289183616638184 (5.425236860911052) | > loss_mel: 21.279300689697266 (23.44432830810547) | > loss_duration: 2.978181838989258 (3.0684255758921304) | > loss_1: 31.022085189819336 (38.31608136494955) --> EVAL PERFORMANCE | > avg_loader_time: 0.021865447362263996 (-0.6255801632290794) | > avg_loss_disc: 2.8250396251678467 (+0.19820352963038834) | > avg_loss_disc_real_0: 0.41195256511370343 (+0.16528817940325966) | > avg_loss_disc_real_1: 0.25094249844551086 (-0.007469277296747456) | > avg_loss_disc_real_2: 0.2682826866706212 (+0.06463542225815) | > avg_loss_disc_real_3: 0.24191985030968985 (+0.023502554921876834) | > avg_loss_disc_real_4: 0.19754253327846527 (-0.062058887311390476) | > avg_loss_disc_real_5: 0.2269688198963801 (-0.035558398990404055) | > avg_loss_0: 2.8250396251678467 (+0.19820352963038834) | > avg_loss_gen: 2.1594659090042114 (-0.005684971809387207) | > avg_loss_kl: 4.218625942866008 (+0.21994199639275003) | > avg_loss_feat: 5.425236860911052 (+1.5231762521323708) | > avg_loss_mel: 23.44432830810547 (+2.7567088263375403) | > avg_loss_duration: 3.0684255758921304 (+0.09479092416309154) | > avg_loss_1: 38.31608136494955 (+4.5889316740490145)  > EPOCH: 801/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:25:42)   --> TIME: 2023-10-20 09:26:01 -- STEP: 9/50 -- GLOBAL_STEP: 93060 | > loss_disc: 2.91611909866333 (2.2980873187383017) | > loss_disc_real_0: 0.27525579929351807 (0.17950853125916588) | > loss_disc_real_1: 0.25791221857070923 (0.22395949727959102) | > loss_disc_real_2: 0.2437477558851242 (0.24580346710152096) | > loss_disc_real_3: 0.2623678147792816 (0.2122238501906395) | > loss_disc_real_4: 0.2562238276004791 (0.18020247626635763) | > loss_disc_real_5: 0.2578783333301544 (0.17184795211586687) | > loss_0: 2.91611909866333 (2.2980873187383017) | > grad_norm_0: tensor(2036.5940, device='cuda:0') (tensor(1158.6432, device='cuda:0')) | > loss_gen: 1.633021593093872 (2.6188822852240667) | > loss_kl: 0.4796173572540283 (0.8462051153182983) | > loss_feat: 0.3333241045475006 (7.202789243724611) | > loss_mel: 16.71294593811035 (23.09079212612576) | > loss_duration: 1.3666847944259644 (1.428379840321011) | > loss_1: 20.525592803955078 (35.187049018012154) | > grad_norm_1: tensor(41839.7578, device='cuda:0') (tensor(51133.5508, device='cuda:0')) | > current_lr_0: 8.977147727687245e-05 | > current_lr_1: 8.977147727687245e-05 | > step_time: 0.6638 (0.8259125815497504) | > loader_time: 0.0562 (0.03856036398145887)  --> TIME: 2023-10-20 09:26:27 -- STEP: 39/50 -- GLOBAL_STEP: 93090 | > loss_disc: 2.937481641769409 (2.464894954974835) | > loss_disc_real_0: 0.20237234234809875 (0.18307657530292487) | > loss_disc_real_1: 0.2220245897769928 (0.22427315685229424) | > loss_disc_real_2: 0.2583863139152527 (0.2377860406652475) | > loss_disc_real_3: 0.22497521340847015 (0.2281035202053877) | > loss_disc_real_4: 0.24272456765174866 (0.2215821940738421) | > loss_disc_real_5: 0.23235274851322174 (0.21518131063725704) | > loss_0: 2.937481641769409 (2.464894954974835) | > grad_norm_0: tensor(1387.6058, device='cuda:0') (tensor(1421.7600, device='cuda:0')) | > loss_gen: 1.4912182092666626 (2.3770676056543985) | > loss_kl: 0.649168074131012 (0.7975656919849988) | > loss_feat: 0.1858229786157608 (5.856572001790389) | > loss_mel: 3.9332408905029297 (22.542218746283115) | > loss_duration: 1.4287291765213013 (1.3949030118110852) | > loss_1: 7.688179016113281 (32.96832726551936) | > grad_norm_1: tensor(33073.2773, device='cuda:0') (tensor(47261.2070, device='cuda:0')) | > current_lr_0: 8.977147727687245e-05 | > current_lr_1: 8.977147727687245e-05 | > step_time: 0.6471 (0.8287955369704809) | > loader_time: 0.033 (0.035853606003981374)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9887826442718506 (2.9887826442718506) | > loss_disc_real_0: 0.18413163721561432 (0.18413163721561432) | > loss_disc_real_1: 0.29803231358528137 (0.29803231358528137) | > loss_disc_real_2: 0.21467022597789764 (0.21467022597789764) | > loss_disc_real_3: 0.2741236388683319 (0.2741236388683319) | > loss_disc_real_4: 0.25005844235420227 (0.25005844235420227) | > loss_disc_real_5: 0.36883461475372314 (0.36883461475372314) | > loss_0: 2.9887826442718506 (2.9887826442718506) | > loss_gen: 1.643390417098999 (1.643390417098999) | > loss_kl: 3.6942384243011475 (3.6942384243011475) | > loss_feat: 0.1507686823606491 (0.1507686823606491) | > loss_mel: 11.05833911895752 (11.05833911895752) | > loss_duration: 2.892241954803467 (2.892241954803467) | > loss_1: 19.43897819519043 (19.43897819519043)  --> STEP: 1 | > loss_disc: 3.339181900024414 (3.339181900024414) | > loss_disc_real_0: 0.7133646011352539 (0.7133646011352539) | > loss_disc_real_1: 0.36733388900756836 (0.36733388900756836) | > loss_disc_real_2: 0.35828471183776855 (0.35828471183776855) | > loss_disc_real_3: 0.28753820061683655 (0.28753820061683655) | > loss_disc_real_4: 0.5084558725357056 (0.5084558725357056) | > loss_disc_real_5: 0.31484749913215637 (0.31484749913215637) | > loss_0: 3.339181900024414 (3.339181900024414) | > loss_gen: 3.1281685829162598 (3.1281685829162598) | > loss_kl: 4.702231407165527 (4.702231407165527) | > loss_feat: 6.0428900718688965 (6.0428900718688965) | > loss_mel: 24.108680725097656 (24.108680725097656) | > loss_duration: 3.3269200325012207 (3.3269200325012207) | > loss_1: 41.30889129638672 (41.30889129638672)  --> STEP: 2 | > loss_disc: 3.335813283920288 (3.337497591972351) | > loss_disc_real_0: 0.23342998325824738 (0.47339729219675064) | > loss_disc_real_1: 0.2832682430744171 (0.32530106604099274) | > loss_disc_real_2: 0.2539890706539154 (0.306136891245842) | > loss_disc_real_3: 0.3337051272392273 (0.3106216639280319) | > loss_disc_real_4: 0.28874731063842773 (0.39860159158706665) | > loss_disc_real_5: 0.5535686612129211 (0.43420808017253876) | > loss_0: 3.335813283920288 (3.337497591972351) | > loss_gen: 1.962255835533142 (2.545212209224701) | > loss_kl: 5.458669185638428 (5.0804502964019775) | > loss_feat: 6.923498153686523 (6.48319411277771) | > loss_mel: 24.893115997314453 (24.500898361206055) | > loss_duration: 3.078489303588867 (3.202704668045044) | > loss_1: 42.31603240966797 (41.812461853027344)  --> STEP: 3 | > loss_disc: 2.9098434448242188 (3.19494620958964) | > loss_disc_real_0: 0.20346881449222565 (0.383421132961909) | > loss_disc_real_1: 0.2680005729198456 (0.30620090166727704) | > loss_disc_real_2: 0.18821750581264496 (0.2668304294347763) | > loss_disc_real_3: 0.2639015018939972 (0.2950482765833537) | > loss_disc_real_4: 0.23936790227890015 (0.34552369515101117) | > loss_disc_real_5: 0.3485282063484192 (0.4056481222311656) | > loss_0: 2.9098434448242188 (3.19494620958964) | > loss_gen: 1.6519123315811157 (2.247445583343506) | > loss_kl: 2.4490244388580322 (4.203308343887329) | > loss_feat: 0.8099331855773926 (4.5921071370442705) | > loss_mel: 6.780916213989258 (18.59423764546712) | > loss_duration: 2.8542206287384033 (3.086543321609497) | > loss_1: 14.54600715637207 (32.72364362080892) --> EVAL PERFORMANCE | > avg_loader_time: 0.010994434356689453 (-0.010871013005574543) | > avg_loss_disc: 3.19494620958964 (+0.36990658442179347) | > avg_loss_disc_real_0: 0.383421132961909 (-0.028531432151794434) | > avg_loss_disc_real_1: 0.30620090166727704 (+0.05525840322176617) | > avg_loss_disc_real_2: 0.2668304294347763 (-0.0014522572358449115) | > avg_loss_disc_real_3: 0.2950482765833537 (+0.05312842627366385) | > avg_loss_disc_real_4: 0.34552369515101117 (+0.1479811618725459) | > avg_loss_disc_real_5: 0.4056481222311656 (+0.1786793023347855) | > avg_loss_0: 3.19494620958964 (+0.36990658442179347) | > avg_loss_gen: 2.247445583343506 (+0.08797967433929443) | > avg_loss_kl: 4.203308343887329 (-0.015317598978678681) | > avg_loss_feat: 4.5921071370442705 (-0.8331297238667812) | > avg_loss_mel: 18.59423764546712 (-4.8500906626383475) | > avg_loss_duration: 3.086543321609497 (+0.018117745717366684) | > avg_loss_1: 32.72364362080892 (-5.592437744140625)  > EPOCH: 802/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:26:46)   --> TIME: 2023-10-20 09:27:03 -- STEP: 19/50 -- GLOBAL_STEP: 93120 | > loss_disc: 2.0492820739746094 (2.4169497113478813) | > loss_disc_real_0: 0.20139704644680023 (0.13917829027693523) | > loss_disc_real_1: 0.22609244287014008 (0.24305345235686554) | > loss_disc_real_2: 0.16542360186576843 (0.2100401199177692) | > loss_disc_real_3: 0.1706269532442093 (0.26830895205861643) | > loss_disc_real_4: 0.07924873381853104 (0.24353857808991483) | > loss_disc_real_5: 0.09495529532432556 (0.2345308520291981) | > loss_0: 2.0492820739746094 (2.4169497113478813) | > grad_norm_0: tensor(1125.5577, device='cuda:0') (tensor(1337.9247, device='cuda:0')) | > loss_gen: 2.6479616165161133 (2.499410491240652) | > loss_kl: 1.1029506921768188 (0.9019915273315028) | > loss_feat: 9.427608489990234 (5.843977190063972) | > loss_mel: 26.591094970703125 (20.83724721168217) | > loss_duration: 1.4885432720184326 (1.4472206893720125) | > loss_1: 41.25815963745117 (31.52984706979049) | > grad_norm_1: tensor(98503.7500, device='cuda:0') (tensor(68987.4375, device='cuda:0')) | > current_lr_0: 8.968174506479964e-05 | > current_lr_1: 8.968174506479964e-05 | > step_time: 0.5655 (0.6011171340942383) | > loader_time: 0.0103 (0.016841574719077664)  --> TIME: 2023-10-20 09:27:20 -- STEP: 49/50 -- GLOBAL_STEP: 93150 | > loss_disc: 2.654672145843506 (2.394158348745229) | > loss_disc_real_0: 0.0653533861041069 (0.1402831049826072) | > loss_disc_real_1: 0.21201707422733307 (0.22633580650602067) | > loss_disc_real_2: 0.1494087129831314 (0.20581058675081146) | > loss_disc_real_3: 0.26044243574142456 (0.23897491410678748) | > loss_disc_real_4: 0.2905323803424835 (0.23063778398292406) | > loss_disc_real_5: 0.3447176516056061 (0.2350721063130364) | > loss_0: 2.654672145843506 (2.394158348745229) | > grad_norm_0: tensor(1405.8174, device='cuda:0') (tensor(1244.8599, device='cuda:0')) | > loss_gen: 1.9517264366149902 (2.377678107242195) | > loss_kl: 0.6292943358421326 (0.8742374090515838) | > loss_feat: 2.5522477626800537 (5.745137197668759) | > loss_mel: 18.827743530273438 (20.71722760614084) | > loss_duration: 1.5417289733886719 (1.3969261792241314) | > loss_1: 25.50274085998535 (31.11120656071877) | > grad_norm_1: tensor(26846.1055, device='cuda:0') (tensor(52296.7695, device='cuda:0')) | > current_lr_0: 8.968174506479964e-05 | > current_lr_1: 8.968174506479964e-05 | > step_time: 0.3361 (0.5568622861589703) | > loader_time: 0.4147 (0.022246088300432478)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.793379783630371 (2.793379783630371) | > loss_disc_real_0: 0.15773195028305054 (0.15773195028305054) | > loss_disc_real_1: 0.1729053556919098 (0.1729053556919098) | > loss_disc_real_2: 0.132393479347229 (0.132393479347229) | > loss_disc_real_3: 0.18731087446212769 (0.18731087446212769) | > loss_disc_real_4: 0.23799842596054077 (0.23799842596054077) | > loss_disc_real_5: 0.3324545621871948 (0.3324545621871948) | > loss_0: 2.793379783630371 (2.793379783630371) | > loss_gen: 1.7029964923858643 (1.7029964923858643) | > loss_kl: 4.649280548095703 (4.649280548095703) | > loss_feat: 9.247563362121582 (9.247563362121582) | > loss_mel: 23.440196990966797 (23.440196990966797) | > loss_duration: 2.9347407817840576 (2.9347407817840576) | > loss_1: 41.97477722167969 (41.97477722167969)  --> STEP: 1 | > loss_disc: 2.247738838195801 (2.247738838195801) | > loss_disc_real_0: 0.09750883281230927 (0.09750883281230927) | > loss_disc_real_1: 0.20493799448013306 (0.20493799448013306) | > loss_disc_real_2: 0.05585991218686104 (0.05585991218686104) | > loss_disc_real_3: 0.2522880733013153 (0.2522880733013153) | > loss_disc_real_4: 0.2030056267976761 (0.2030056267976761) | > loss_disc_real_5: 0.2893120348453522 (0.2893120348453522) | > loss_0: 2.247738838195801 (2.247738838195801) | > loss_gen: 2.295623779296875 (2.295623779296875) | > loss_kl: 4.876489639282227 (4.876489639282227) | > loss_feat: 6.842757701873779 (6.842757701873779) | > loss_mel: 20.36849021911621 (20.36849021911621) | > loss_duration: 3.2103211879730225 (3.2103211879730225) | > loss_1: 37.59368133544922 (37.59368133544922)  --> STEP: 2 | > loss_disc: 3.10679292678833 (2.6772658824920654) | > loss_disc_real_0: 0.5151112675666809 (0.3063100501894951) | > loss_disc_real_1: 0.20919585227966309 (0.20706692337989807) | > loss_disc_real_2: 0.34911757707595825 (0.20248874463140965) | > loss_disc_real_3: 0.39030787348747253 (0.3212979733943939) | > loss_disc_real_4: 0.393195241689682 (0.29810043424367905) | > loss_disc_real_5: 0.33793747425079346 (0.3136247545480728) | > loss_0: 3.10679292678833 (2.6772658824920654) | > loss_gen: 2.3951668739318848 (2.34539532661438) | > loss_kl: 5.466543674468994 (5.17151665687561) | > loss_feat: 3.4301023483276367 (5.136430025100708) | > loss_mel: 25.959564208984375 (23.164027214050293) | > loss_duration: 3.15012788772583 (3.1802245378494263) | > loss_1: 40.40150451660156 (38.99759292602539)  --> STEP: 3 | > loss_disc: 2.982987403869629 (2.7791730562845864) | > loss_disc_real_0: 0.09830032289028168 (0.2369734744230906) | > loss_disc_real_1: 0.25595930218696594 (0.22336438298225403) | > loss_disc_real_2: 0.26183629035949707 (0.22227125987410545) | > loss_disc_real_3: 0.2783937156200409 (0.30699655413627625) | > loss_disc_real_4: 0.26456984877586365 (0.2869235724210739) | > loss_disc_real_5: 0.3059544563293457 (0.31106798847516376) | > loss_0: 2.982987403869629 (2.7791730562845864) | > loss_gen: 1.5143535137176514 (2.068381388982137) | > loss_kl: 2.477290153503418 (4.273441155751546) | > loss_feat: 0.32107508182525635 (3.5313117106755576) | > loss_mel: 16.498485565185547 (20.942179997762043) | > loss_duration: 2.7693674564361572 (3.0432721773783364) | > loss_1: 23.580570220947266 (33.858585357666016) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031697750091552734 (-0.00782465934753418) | > avg_loss_disc: 2.7791730562845864 (-0.4157731533050537) | > avg_loss_disc_real_0: 0.2369734744230906 (-0.1464476585388184) | > avg_loss_disc_real_1: 0.22336438298225403 (-0.08283651868502301) | > avg_loss_disc_real_2: 0.22227125987410545 (-0.04455916956067085) | > avg_loss_disc_real_3: 0.30699655413627625 (+0.011948277552922548) | > avg_loss_disc_real_4: 0.2869235724210739 (-0.058600122729937254) | > avg_loss_disc_real_5: 0.31106798847516376 (-0.09458013375600183) | > avg_loss_0: 2.7791730562845864 (-0.4157731533050537) | > avg_loss_gen: 2.068381388982137 (-0.17906419436136867) | > avg_loss_kl: 4.273441155751546 (+0.07013281186421683) | > avg_loss_feat: 3.5313117106755576 (-1.060795426368713) | > avg_loss_mel: 20.942179997762043 (+2.347942352294922) | > avg_loss_duration: 3.0432721773783364 (-0.04327114423116063) | > avg_loss_1: 33.858585357666016 (+1.134941736857094)  > EPOCH: 803/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:27:34)   --> TIME: 2023-10-20 09:27:56 -- STEP: 29/50 -- GLOBAL_STEP: 93180 | > loss_disc: 1.6570225954055786 (2.5056059730464013) | > loss_disc_real_0: 0.04348894953727722 (0.1457021271103415) | > loss_disc_real_1: 0.22157996892929077 (0.2049082314017518) | > loss_disc_real_2: 0.20703832805156708 (0.22007117189210038) | > loss_disc_real_3: 0.23190665245056152 (0.2125330857675651) | > loss_disc_real_4: 0.08623480796813965 (0.22905364581223192) | > loss_disc_real_5: 0.16609038412570953 (0.24557941464771488) | > loss_0: 1.6570225954055786 (2.5056059730464013) | > grad_norm_0: tensor(325.6481, device='cuda:0') (tensor(969.7421, device='cuda:0')) | > loss_gen: 3.146573543548584 (2.2724217834143805) | > loss_kl: 0.6285786628723145 (0.8262135016507116) | > loss_feat: 9.542622566223145 (5.488112223495183) | > loss_mel: 22.004119873046875 (18.788842739730047) | > loss_duration: 1.3850078582763672 (1.3932899195572424) | > loss_1: 36.70690155029297 (28.768879906884557) | > grad_norm_1: tensor(6502.4844, device='cuda:0') (tensor(42793.3789, device='cuda:0')) | > current_lr_0: 8.959210254569086e-05 | > current_lr_1: 8.959210254569086e-05 | > step_time: 0.6899 (0.5910977166274498) | > loader_time: 0.0285 (0.025720160582969928)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8321738243103027 (2.8321738243103027) | > loss_disc_real_0: 0.1445172131061554 (0.1445172131061554) | > loss_disc_real_1: 0.2123042494058609 (0.2123042494058609) | > loss_disc_real_2: 0.256556898355484 (0.256556898355484) | > loss_disc_real_3: 0.2726178765296936 (0.2726178765296936) | > loss_disc_real_4: 0.3636341691017151 (0.3636341691017151) | > loss_disc_real_5: 0.45419955253601074 (0.45419955253601074) | > loss_0: 2.8321738243103027 (2.8321738243103027) | > loss_gen: 2.066690683364868 (2.066690683364868) | > loss_kl: 4.799941539764404 (4.799941539764404) | > loss_feat: 4.911865234375 (4.911865234375) | > loss_mel: 23.519001007080078 (23.519001007080078) | > loss_duration: 2.7932326793670654 (2.7932326793670654) | > loss_1: 38.09073257446289 (38.09073257446289)  --> STEP: 1 | > loss_disc: 2.7520554065704346 (2.7520554065704346) | > loss_disc_real_0: 0.05854696035385132 (0.05854696035385132) | > loss_disc_real_1: 0.35881489515304565 (0.35881489515304565) | > loss_disc_real_2: 0.31531408429145813 (0.31531408429145813) | > loss_disc_real_3: 0.32329651713371277 (0.32329651713371277) | > loss_disc_real_4: 0.41798853874206543 (0.41798853874206543) | > loss_disc_real_5: 0.3829188048839569 (0.3829188048839569) | > loss_0: 2.7520554065704346 (2.7520554065704346) | > loss_gen: 2.4794459342956543 (2.4794459342956543) | > loss_kl: 5.020762920379639 (5.020762920379639) | > loss_feat: 3.8359320163726807 (3.8359320163726807) | > loss_mel: 24.30990982055664 (24.30990982055664) | > loss_duration: 3.186525821685791 (3.186525821685791) | > loss_1: 38.832576751708984 (38.832576751708984)  --> STEP: 2 | > loss_disc: 3.390748977661133 (3.0714021921157837) | > loss_disc_real_0: 0.44249284267425537 (0.25051990151405334) | > loss_disc_real_1: 0.33681514859199524 (0.34781502187252045) | > loss_disc_real_2: 0.2697708308696747 (0.2925424575805664) | > loss_disc_real_3: 0.3911711573600769 (0.35723383724689484) | > loss_disc_real_4: 0.23747161030769348 (0.32773007452487946) | > loss_disc_real_5: 0.3129465878009796 (0.34793269634246826) | > loss_0: 3.390748977661133 (3.0714021921157837) | > loss_gen: 2.270723581314087 (2.3750847578048706) | > loss_kl: 5.385783672332764 (5.203273296356201) | > loss_feat: 5.421050548553467 (4.628491282463074) | > loss_mel: 29.00242805480957 (26.656168937683105) | > loss_duration: 3.049278497695923 (3.117902159690857) | > loss_1: 45.12926483154297 (41.98092079162598)  --> STEP: 3 | > loss_disc: 3.1449248790740967 (3.095909754435221) | > loss_disc_real_0: 0.2556627690792084 (0.25223419070243835) | > loss_disc_real_1: 0.36861488223075867 (0.35474830865859985) | > loss_disc_real_2: 0.35812604427337646 (0.3144036531448364) | > loss_disc_real_3: 0.32267308235168457 (0.3457135856151581) | > loss_disc_real_4: 0.31744086742401123 (0.32430033882459003) | > loss_disc_real_5: 0.31357213854789734 (0.33647917707761127) | > loss_0: 3.1449248790740967 (3.095909754435221) | > loss_gen: 2.171846866607666 (2.3073387940724692) | > loss_kl: 2.5954949855804443 (4.334013859430949) | > loss_feat: 3.1004984378814697 (4.119160334269206) | > loss_mel: 19.377321243286133 (24.229886372884113) | > loss_duration: 2.8852322101593018 (3.0403455098470054) | > loss_1: 30.130393981933594 (38.03074518839518) --> EVAL PERFORMANCE | > avg_loader_time: 0.018002669016520183 (+0.01483289400736491) | > avg_loss_disc: 3.095909754435221 (+0.31673669815063477) | > avg_loss_disc_real_0: 0.25223419070243835 (+0.015260716279347747) | > avg_loss_disc_real_1: 0.35474830865859985 (+0.13138392567634583) | > avg_loss_disc_real_2: 0.3144036531448364 (+0.09213239327073097) | > avg_loss_disc_real_3: 0.3457135856151581 (+0.038717031478881836) | > avg_loss_disc_real_4: 0.32430033882459003 (+0.037376766403516115) | > avg_loss_disc_real_5: 0.33647917707761127 (+0.02541118860244751) | > avg_loss_0: 3.095909754435221 (+0.31673669815063477) | > avg_loss_gen: 2.3073387940724692 (+0.23895740509033203) | > avg_loss_kl: 4.334013859430949 (+0.06057270367940326) | > avg_loss_feat: 4.119160334269206 (+0.5878486235936484) | > avg_loss_mel: 24.229886372884113 (+3.2877063751220703) | > avg_loss_duration: 3.0403455098470054 (-0.002926667531331084) | > avg_loss_1: 38.03074518839518 (+4.172159830729164)  > EPOCH: 804/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:28:26)   --> TIME: 2023-10-20 09:28:46 -- STEP: 9/50 -- GLOBAL_STEP: 93210 | > loss_disc: 2.7204551696777344 (2.5945673253801136) | > loss_disc_real_0: 0.16948217153549194 (0.19578944312201607) | > loss_disc_real_1: 0.24884513020515442 (0.2322428859770298) | > loss_disc_real_2: 0.33416008949279785 (0.22900554786125818) | > loss_disc_real_3: 0.2660972476005554 (0.2247961060040527) | > loss_disc_real_4: 0.3011084198951721 (0.21833941443926758) | > loss_disc_real_5: 0.2807047367095947 (0.21195138545913828) | > loss_0: 2.7204551696777344 (2.5945673253801136) | > grad_norm_0: tensor(770.1942, device='cuda:0') (tensor(1325.1061, device='cuda:0')) | > loss_gen: 2.2759387493133545 (2.2314212057325573) | > loss_kl: 0.6789175271987915 (0.7843886084026761) | > loss_feat: 4.483937740325928 (6.001522309250301) | > loss_mel: 22.246938705444336 (21.38834614223904) | > loss_duration: 1.34144926071167 (1.3968591425153944) | > loss_1: 31.02718162536621 (31.80253834194607) | > grad_norm_1: tensor(5549.5425, device='cuda:0') (tensor(25925.2051, device='cuda:0')) | > current_lr_0: 8.950254962989239e-05 | > current_lr_1: 8.950254962989239e-05 | > step_time: 0.5641 (0.815410402086046) | > loader_time: 0.0028 (0.03777413898044162)  --> TIME: 2023-10-20 09:29:05 -- STEP: 39/50 -- GLOBAL_STEP: 93240 | > loss_disc: 2.9046034812927246 (2.462449880746694) | > loss_disc_real_0: 0.13287372887134552 (0.17032157429135764) | > loss_disc_real_1: 0.24542611837387085 (0.2215814698392) | > loss_disc_real_2: 0.24277018010616302 (0.216302056152087) | > loss_disc_real_3: 0.2893991470336914 (0.23490585568241584) | > loss_disc_real_4: 0.20627620816230774 (0.22153982582191625) | > loss_disc_real_5: 0.22538720071315765 (0.23047748401474494) | > loss_0: 2.9046034812927246 (2.462449880746694) | > grad_norm_0: tensor(1660.1036, device='cuda:0') (tensor(1292.3676, device='cuda:0')) | > loss_gen: 1.5491886138916016 (2.345363057576693) | > loss_kl: 0.38209328055381775 (0.8035109707942376) | > loss_feat: 0.848921537399292 (5.594260687629382) | > loss_mel: 7.380110740661621 (20.905190302775456) | > loss_duration: 1.4300053119659424 (1.387290615301866) | > loss_1: 11.590319633483887 (31.035615762074787) | > grad_norm_1: tensor(35824.0742, device='cuda:0') (tensor(42551.7031, device='cuda:0')) | > current_lr_0: 8.950254962989239e-05 | > current_lr_1: 8.950254962989239e-05 | > step_time: 0.8841 (0.649158110985389) | > loader_time: 0.005 (0.023062608180901945)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7444899082183838 (1.7444899082183838) | > loss_disc_real_0: 0.02642599120736122 (0.02642599120736122) | > loss_disc_real_1: 0.19221924245357513 (0.19221924245357513) | > loss_disc_real_2: 0.13913464546203613 (0.13913464546203613) | > loss_disc_real_3: 0.15608321130275726 (0.15608321130275726) | > loss_disc_real_4: 0.18931318819522858 (0.18931318819522858) | > loss_disc_real_5: 0.13179665803909302 (0.13179665803909302) | > loss_0: 1.7444899082183838 (1.7444899082183838) | > loss_gen: 2.5307345390319824 (2.5307345390319824) | > loss_kl: 4.839552879333496 (4.839552879333496) | > loss_feat: 11.006255149841309 (11.006255149841309) | > loss_mel: 21.515689849853516 (21.515689849853516) | > loss_duration: 2.827751636505127 (2.827751636505127) | > loss_1: 42.7199821472168 (42.7199821472168)  --> STEP: 1 | > loss_disc: 2.117868661880493 (2.117868661880493) | > loss_disc_real_0: 0.17282547056674957 (0.17282547056674957) | > loss_disc_real_1: 0.2035384178161621 (0.2035384178161621) | > loss_disc_real_2: 0.18949797749519348 (0.18949797749519348) | > loss_disc_real_3: 0.22620348632335663 (0.22620348632335663) | > loss_disc_real_4: 0.23277683556079865 (0.23277683556079865) | > loss_disc_real_5: 0.146257221698761 (0.146257221698761) | > loss_0: 2.117868661880493 (2.117868661880493) | > loss_gen: 2.424637794494629 (2.424637794494629) | > loss_kl: 4.821430206298828 (4.821430206298828) | > loss_feat: 7.253946304321289 (7.253946304321289) | > loss_mel: 22.567575454711914 (22.567575454711914) | > loss_duration: 3.3100860118865967 (3.3100860118865967) | > loss_1: 40.3776741027832 (40.3776741027832)  --> STEP: 2 | > loss_disc: 2.6286511421203613 (2.3732599020004272) | > loss_disc_real_0: 0.16870249807834625 (0.1707639843225479) | > loss_disc_real_1: 0.14807537198066711 (0.1758068948984146) | > loss_disc_real_2: 0.19741424918174744 (0.19345611333847046) | > loss_disc_real_3: 0.3019421398639679 (0.26407281309366226) | > loss_disc_real_4: 0.20521622896194458 (0.2189965322613716) | > loss_disc_real_5: 0.2137310951948166 (0.1799941584467888) | > loss_0: 2.6286511421203613 (2.3732599020004272) | > loss_gen: 1.9364056587219238 (2.1805217266082764) | > loss_kl: 5.646496772766113 (5.233963489532471) | > loss_feat: 6.475496292114258 (6.864721298217773) | > loss_mel: 22.980798721313477 (22.774187088012695) | > loss_duration: 3.0283162593841553 (3.169201135635376) | > loss_1: 40.06751251220703 (40.22259330749512)  --> STEP: 3 | > loss_disc: 2.709099769592285 (2.4852065245310464) | > loss_disc_real_0: 0.2507624626159668 (0.19743014375368753) | > loss_disc_real_1: 0.24432063102722168 (0.1986448069413503) | > loss_disc_real_2: 0.27608752250671387 (0.2209999163945516) | > loss_disc_real_3: 0.16627191007137299 (0.2314725120862325) | > loss_disc_real_4: 0.17300061881542206 (0.20366456111272177) | > loss_disc_real_5: 0.14633680880069733 (0.16877504189809164) | > loss_0: 2.709099769592285 (2.4852065245310464) | > loss_gen: 1.7136908769607544 (2.0249114433924356) | > loss_kl: 2.4882917404174805 (4.318739573160808) | > loss_feat: 2.2545130252838135 (5.327985207239787) | > loss_mel: 16.882740020751953 (20.81037139892578) | > loss_duration: 2.837150812149048 (3.0585176944732666) | > loss_1: 26.176387786865234 (35.54052480061849) --> EVAL PERFORMANCE | > avg_loader_time: 0.007642904917399089 (-0.010359764099121094) | > avg_loss_disc: 2.4852065245310464 (-0.6107032299041748) | > avg_loss_disc_real_0: 0.19743014375368753 (-0.05480404694875082) | > avg_loss_disc_real_1: 0.1986448069413503 (-0.15610350171724954) | > avg_loss_disc_real_2: 0.2209999163945516 (-0.09340373675028482) | > avg_loss_disc_real_3: 0.2314725120862325 (-0.11424107352892557) | > avg_loss_disc_real_4: 0.20366456111272177 (-0.12063577771186826) | > avg_loss_disc_real_5: 0.16877504189809164 (-0.16770413517951963) | > avg_loss_0: 2.4852065245310464 (-0.6107032299041748) | > avg_loss_gen: 2.0249114433924356 (-0.28242735068003366) | > avg_loss_kl: 4.318739573160808 (-0.015274286270141602) | > avg_loss_feat: 5.327985207239787 (+1.208824872970581) | > avg_loss_mel: 20.81037139892578 (-3.419514973958332) | > avg_loss_duration: 3.0585176944732666 (+0.018172184626261245) | > avg_loss_1: 35.54052480061849 (-2.490220387776688)  > EPOCH: 805/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:29:31)   --> TIME: 2023-10-20 09:29:50 -- STEP: 19/50 -- GLOBAL_STEP: 93270 | > loss_disc: 1.5726567506790161 (2.4460496588757166) | > loss_disc_real_0: 0.10563838481903076 (0.15539383152989963) | > loss_disc_real_1: 0.2053373008966446 (0.21932376979997284) | > loss_disc_real_2: 0.13276688754558563 (0.21297232179265274) | > loss_disc_real_3: 0.22987088561058044 (0.22776671087271289) | > loss_disc_real_4: 0.07952935993671417 (0.2138404717766925) | > loss_disc_real_5: 0.15703129768371582 (0.23579783953334155) | > loss_0: 1.5726567506790161 (2.4460496588757166) | > grad_norm_0: tensor(1152.4023, device='cuda:0') (tensor(1383.3097, device='cuda:0')) | > loss_gen: 3.127460241317749 (2.406947870003549) | > loss_kl: 1.1286269426345825 (0.8513266381464506) | > loss_feat: 9.714534759521484 (5.667536189681606) | > loss_mel: 25.7992000579834 (22.347988592950923) | > loss_duration: 1.4502500295639038 (1.42428814110003) | > loss_1: 41.220069885253906 (32.698087340907044) | > grad_norm_1: tensor(99707.8984, device='cuda:0') (tensor(35228.3516, device='cuda:0')) | > current_lr_0: 8.94130862278401e-05 | > current_lr_1: 8.94130862278401e-05 | > step_time: 0.4422 (0.5840697664963571) | > loader_time: 0.0028 (0.020746896141453794)  --> TIME: 2023-10-20 09:30:09 -- STEP: 49/50 -- GLOBAL_STEP: 93300 | > loss_disc: 2.5025017261505127 (2.4654873439243863) | > loss_disc_real_0: 0.08664483577013016 (0.15171599587691678) | > loss_disc_real_1: 0.3587457239627838 (0.22486071220161963) | > loss_disc_real_2: 0.07641782611608505 (0.21585040653542598) | > loss_disc_real_3: 0.32118743658065796 (0.226005100322013) | > loss_disc_real_4: 0.2784099578857422 (0.22543996979235387) | > loss_disc_real_5: 0.3078005909919739 (0.227835158000187) | > loss_0: 2.5025017261505127 (2.4654873439243863) | > grad_norm_0: tensor(1330.6202, device='cuda:0') (tensor(1219.8054, device='cuda:0')) | > loss_gen: 2.2665998935699463 (2.263494233695827) | > loss_kl: 1.1141196489334106 (0.8165585076322361) | > loss_feat: 2.41463041305542 (5.1620019916064885) | > loss_mel: 21.01429557800293 (21.39263977809828) | > loss_duration: 1.5252326726913452 (1.3919590857564186) | > loss_1: 28.334877014160156 (31.026653523347807) | > grad_norm_1: tensor(10991.2832, device='cuda:0') (tensor(30679.1680, device='cuda:0')) | > current_lr_0: 8.94130862278401e-05 | > current_lr_1: 8.94130862278401e-05 | > step_time: 0.4901 (0.5641347242861378) | > loader_time: 1.8223 (0.05242944250301439)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.073955774307251 (3.073955774307251) | > loss_disc_real_0: 0.401683509349823 (0.401683509349823) | > loss_disc_real_1: 0.30158644914627075 (0.30158644914627075) | > loss_disc_real_2: 0.3114464581012726 (0.3114464581012726) | > loss_disc_real_3: 0.25580304861068726 (0.25580304861068726) | > loss_disc_real_4: 0.26694256067276 (0.26694256067276) | > loss_disc_real_5: 0.29961809515953064 (0.29961809515953064) | > loss_0: 3.073955774307251 (3.073955774307251) | > loss_gen: 1.8127613067626953 (1.8127613067626953) | > loss_kl: 4.776473522186279 (4.776473522186279) | > loss_feat: 0.05973350256681442 (0.05973350256681442) | > loss_mel: 1.6570535898208618 (1.6570535898208618) | > loss_duration: 2.8879594802856445 (2.8879594802856445) | > loss_1: 11.193981170654297 (11.193981170654297)  --> STEP: 1 | > loss_disc: 2.642500400543213 (2.642500400543213) | > loss_disc_real_0: 0.20300798118114471 (0.20300798118114471) | > loss_disc_real_1: 0.181460440158844 (0.181460440158844) | > loss_disc_real_2: 0.15004666149616241 (0.15004666149616241) | > loss_disc_real_3: 0.23455382883548737 (0.23455382883548737) | > loss_disc_real_4: 0.14434967935085297 (0.14434967935085297) | > loss_disc_real_5: 0.3389255702495575 (0.3389255702495575) | > loss_0: 2.642500400543213 (2.642500400543213) | > loss_gen: 1.969500184059143 (1.969500184059143) | > loss_kl: 5.063358306884766 (5.063358306884766) | > loss_feat: 6.351047039031982 (6.351047039031982) | > loss_mel: 22.90089988708496 (22.90089988708496) | > loss_duration: 3.1423697471618652 (3.1423697471618652) | > loss_1: 39.42717742919922 (39.42717742919922)  --> STEP: 2 | > loss_disc: 2.847168207168579 (2.744834303855896) | > loss_disc_real_0: 0.3662850260734558 (0.28464650362730026) | > loss_disc_real_1: 0.2339271903038025 (0.20769381523132324) | > loss_disc_real_2: 0.3428967595100403 (0.24647171050310135) | > loss_disc_real_3: 0.33431416749954224 (0.2844339981675148) | > loss_disc_real_4: 0.20884735882282257 (0.17659851908683777) | > loss_disc_real_5: 0.41410908102989197 (0.37651732563972473) | > loss_0: 2.847168207168579 (2.744834303855896) | > loss_gen: 2.4453446865081787 (2.207422435283661) | > loss_kl: 5.213436126708984 (5.138397216796875) | > loss_feat: 5.173081398010254 (5.762064218521118) | > loss_mel: 28.761491775512695 (25.831195831298828) | > loss_duration: 2.9745049476623535 (3.0584373474121094) | > loss_1: 44.5678596496582 (41.99751853942871)  --> STEP: 3 | > loss_disc: 2.44791316986084 (2.6458605925242105) | > loss_disc_real_0: 0.0658571794629097 (0.21171672890583673) | > loss_disc_real_1: 0.17891521751880646 (0.19810094932715097) | > loss_disc_real_2: 0.09177849441766739 (0.19490730514129004) | > loss_disc_real_3: 0.14517129957675934 (0.23801309863726297) | > loss_disc_real_4: 0.09753458946943283 (0.15024387588103613) | > loss_disc_real_5: 0.06621809303760529 (0.27308424810568493) | > loss_0: 2.44791316986084 (2.6458605925242105) | > loss_gen: 1.4482744932174683 (1.9543731212615967) | > loss_kl: 2.3734889030456543 (4.216761112213135) | > loss_feat: 4.62489652633667 (5.383008321126302) | > loss_mel: 22.808731079101562 (24.823707580566406) | > loss_duration: 2.8738720417022705 (2.996915578842163) | > loss_1: 34.12926483154297 (39.3747673034668) --> EVAL PERFORMANCE | > avg_loader_time: 0.0037964979807535806 (-0.0038464069366455082) | > avg_loss_disc: 2.6458605925242105 (+0.16065406799316406) | > avg_loss_disc_real_0: 0.21171672890583673 (+0.0142865851521492) | > avg_loss_disc_real_1: 0.19810094932715097 (-0.000543857614199339) | > avg_loss_disc_real_2: 0.19490730514129004 (-0.026092611253261566) | > avg_loss_disc_real_3: 0.23801309863726297 (+0.006540586551030458) | > avg_loss_disc_real_4: 0.15024387588103613 (-0.05342068523168564) | > avg_loss_disc_real_5: 0.27308424810568493 (+0.10430920620759329) | > avg_loss_0: 2.6458605925242105 (+0.16065406799316406) | > avg_loss_gen: 1.9543731212615967 (-0.07053832213083888) | > avg_loss_kl: 4.216761112213135 (-0.10197846094767282) | > avg_loss_feat: 5.383008321126302 (+0.05502311388651471) | > avg_loss_mel: 24.823707580566406 (+4.013336181640625) | > avg_loss_duration: 2.996915578842163 (-0.061602115631103516) | > avg_loss_1: 39.3747673034668 (+3.834242502848305)  > EPOCH: 806/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:30:21)   --> TIME: 2023-10-20 09:30:51 -- STEP: 29/50 -- GLOBAL_STEP: 93330 | > loss_disc: 3.013948440551758 (2.4663080264782082) | > loss_disc_real_0: 0.11046172678470612 (0.16043184999504995) | > loss_disc_real_1: 0.30668896436691284 (0.2079385120807023) | > loss_disc_real_2: 0.3020733892917633 (0.19504220674520936) | > loss_disc_real_3: 0.2836020290851593 (0.2440462158671741) | > loss_disc_real_4: 0.27422770857810974 (0.21954353031670226) | > loss_disc_real_5: 0.24818167090415955 (0.22170553182990388) | > loss_0: 3.013948440551758 (2.4663080264782082) | > grad_norm_0: tensor(1876.7719, device='cuda:0') (tensor(1325.0807, device='cuda:0')) | > loss_gen: 1.600582480430603 (2.285765134055039) | > loss_kl: 0.7242641448974609 (0.8611980767856384) | > loss_feat: 0.1741267442703247 (5.023313192714905) | > loss_mel: 11.509198188781738 (19.210342275685278) | > loss_duration: 1.3689048290252686 (1.3941117895060573) | > loss_1: 15.377076148986816 (28.774730468618458) | > grad_norm_1: tensor(23222.3320, device='cuda:0') (tensor(38436.1719, device='cuda:0')) | > current_lr_0: 8.932371225005943e-05 | > current_lr_1: 8.932371225005943e-05 | > step_time: 0.3995 (0.6820674600272343) | > loader_time: 0.0337 (0.026523548981239056)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9157519340515137 (2.9157519340515137) | > loss_disc_real_0: 0.195043683052063 (0.195043683052063) | > loss_disc_real_1: 0.1923564374446869 (0.1923564374446869) | > loss_disc_real_2: 0.2637113034725189 (0.2637113034725189) | > loss_disc_real_3: 0.23161397874355316 (0.23161397874355316) | > loss_disc_real_4: 0.1661481261253357 (0.1661481261253357) | > loss_disc_real_5: 0.27582573890686035 (0.27582573890686035) | > loss_0: 2.9157519340515137 (2.9157519340515137) | > loss_gen: 1.6265063285827637 (1.6265063285827637) | > loss_kl: 4.1085710525512695 (4.1085710525512695) | > loss_feat: 4.327978134155273 (4.327978134155273) | > loss_mel: 23.690994262695312 (23.690994262695312) | > loss_duration: 2.7362568378448486 (2.7362568378448486) | > loss_1: 36.49030685424805 (36.49030685424805)  --> STEP: 1 | > loss_disc: 2.6903226375579834 (2.6903226375579834) | > loss_disc_real_0: 0.2913721203804016 (0.2913721203804016) | > loss_disc_real_1: 0.267688512802124 (0.267688512802124) | > loss_disc_real_2: 0.20288045704364777 (0.20288045704364777) | > loss_disc_real_3: 0.28060653805732727 (0.28060653805732727) | > loss_disc_real_4: 0.18600036203861237 (0.18600036203861237) | > loss_disc_real_5: 0.32508134841918945 (0.32508134841918945) | > loss_0: 2.6903226375579834 (2.6903226375579834) | > loss_gen: 2.2905571460723877 (2.2905571460723877) | > loss_kl: 4.99128532409668 (4.99128532409668) | > loss_feat: 5.551471710205078 (5.551471710205078) | > loss_mel: 23.87558937072754 (23.87558937072754) | > loss_duration: 3.093278169631958 (3.093278169631958) | > loss_1: 39.802181243896484 (39.802181243896484)  --> STEP: 2 | > loss_disc: 2.363494396209717 (2.52690851688385) | > loss_disc_real_0: 0.18499383330345154 (0.23818297684192657) | > loss_disc_real_1: 0.2020268589258194 (0.2348576858639717) | > loss_disc_real_2: 0.2534414231777191 (0.22816094011068344) | > loss_disc_real_3: 0.30895349383354187 (0.29478001594543457) | > loss_disc_real_4: 0.18726977705955505 (0.1866350695490837) | > loss_disc_real_5: 0.2534337043762207 (0.2892575263977051) | > loss_0: 2.363494396209717 (2.52690851688385) | > loss_gen: 2.6169424057006836 (2.4537497758865356) | > loss_kl: 5.021803379058838 (5.006544351577759) | > loss_feat: 7.900454998016357 (6.725963354110718) | > loss_mel: 22.615097045898438 (23.24534320831299) | > loss_duration: 2.9852583408355713 (3.0392682552337646) | > loss_1: 41.139556884765625 (40.470869064331055)  --> STEP: 3 | > loss_disc: 1.9973310232162476 (2.350382685661316) | > loss_disc_real_0: 0.09390239417552948 (0.19008944928646088) | > loss_disc_real_1: 0.12173140794038773 (0.19714892655611038) | > loss_disc_real_2: 0.07897302508354187 (0.17843163510163626) | > loss_disc_real_3: 0.0729595348238945 (0.2208398555715879) | > loss_disc_real_4: 0.029868172481656075 (0.1343794371932745) | > loss_disc_real_5: 0.09088551253080368 (0.2231335217754046) | > loss_0: 1.9973310232162476 (2.350382685661316) | > loss_gen: 2.2294235229492188 (2.378974358240763) | > loss_kl: 2.381277322769165 (4.1314553419748945) | > loss_feat: 7.7418718338012695 (7.064599514007568) | > loss_mel: 25.19573211669922 (23.89547284444173) | > loss_duration: 2.849630832672119 (2.9760557810465493) | > loss_1: 40.3979377746582 (40.4465586344401) --> EVAL PERFORMANCE | > avg_loader_time: 0.017746369043986004 (+0.013949871063232424) | > avg_loss_disc: 2.350382685661316 (-0.29547790686289455) | > avg_loss_disc_real_0: 0.19008944928646088 (-0.021627279619375855) | > avg_loss_disc_real_1: 0.19714892655611038 (-0.0009520227710405893) | > avg_loss_disc_real_2: 0.17843163510163626 (-0.016475670039653778) | > avg_loss_disc_real_3: 0.2208398555715879 (-0.01717324306567508) | > avg_loss_disc_real_4: 0.1343794371932745 (-0.015864438687761634) | > avg_loss_disc_real_5: 0.2231335217754046 (-0.04995072633028033) | > avg_loss_0: 2.350382685661316 (-0.29547790686289455) | > avg_loss_gen: 2.378974358240763 (+0.4246012369791665) | > avg_loss_kl: 4.1314553419748945 (-0.08530577023824026) | > avg_loss_feat: 7.064599514007568 (+1.6815911928812666) | > avg_loss_mel: 23.89547284444173 (-0.9282347361246757) | > avg_loss_duration: 2.9760557810465493 (-0.020859797795613755) | > avg_loss_1: 40.4465586344401 (+1.071791330973305)  > EPOCH: 807/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:31:17)   --> TIME: 2023-10-20 09:31:29 -- STEP: 9/50 -- GLOBAL_STEP: 93360 | > loss_disc: 2.6204142570495605 (2.5025786426332264) | > loss_disc_real_0: 0.2203553020954132 (0.13691323581669065) | > loss_disc_real_1: 0.3286503851413727 (0.22543069016602305) | > loss_disc_real_2: 0.27862563729286194 (0.24041898879739973) | > loss_disc_real_3: 0.22952646017074585 (0.23576486027903026) | > loss_disc_real_4: 0.30974552035331726 (0.23529325011703703) | > loss_disc_real_5: 0.36784765124320984 (0.25233930928839576) | > loss_0: 2.6204142570495605 (2.5025786426332264) | > grad_norm_0: tensor(688.2036, device='cuda:0') (tensor(963.8804, device='cuda:0')) | > loss_gen: 2.734600067138672 (2.3322252962324352) | > loss_kl: 0.7253691554069519 (0.8682197663519118) | > loss_feat: 5.433358669281006 (6.633771207597521) | > loss_mel: 20.530935287475586 (22.78420787387424) | > loss_duration: 1.3483835458755493 (1.3903238773345947) | > loss_1: 30.772645950317383 (34.00874710083008) | > grad_norm_1: tensor(11285.5820, device='cuda:0') (tensor(54583.5625, device='cuda:0')) | > current_lr_0: 8.923442760716518e-05 | > current_lr_1: 8.923442760716518e-05 | > step_time: 1.3308 (0.6396190590328641) | > loader_time: 0.0107 (0.01802219284905328)  --> TIME: 2023-10-20 09:31:49 -- STEP: 39/50 -- GLOBAL_STEP: 93390 | > loss_disc: 2.985180377960205 (2.463396139633961) | > loss_disc_real_0: 0.20947256684303284 (0.1449113218830182) | > loss_disc_real_1: 0.2589198052883148 (0.23599825823345247) | > loss_disc_real_2: 0.2741323411464691 (0.22404282372922468) | > loss_disc_real_3: 0.24176454544067383 (0.22727500322537544) | > loss_disc_real_4: 0.2515679597854614 (0.22299896343014178) | > loss_disc_real_5: 0.2778652310371399 (0.22470795086179024) | > loss_0: 2.985180377960205 (2.463396139633961) | > grad_norm_0: tensor(1219.3796, device='cuda:0') (tensor(1139.7727, device='cuda:0')) | > loss_gen: 1.5765783786773682 (2.2590481501359205) | > loss_kl: 0.739421546459198 (0.8355565768403884) | > loss_feat: 0.0999923124909401 (5.225535288715782) | > loss_mel: 4.834158897399902 (19.464858599198166) | > loss_duration: 1.4129220247268677 (1.3781528442333906) | > loss_1: 8.66307258605957 (29.163150921846047) | > grad_norm_1: tensor(38178.5547, device='cuda:0') (tensor(47765.6250, device='cuda:0')) | > current_lr_0: 8.923442760716518e-05 | > current_lr_1: 8.923442760716518e-05 | > step_time: 0.8378 (0.6380149034353403) | > loader_time: 0.0271 (0.020343951689891327)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6762168407440186 (2.6762168407440186) | > loss_disc_real_0: 0.07226471602916718 (0.07226471602916718) | > loss_disc_real_1: 0.18296922743320465 (0.18296922743320465) | > loss_disc_real_2: 0.09838958084583282 (0.09838958084583282) | > loss_disc_real_3: 0.24248190224170685 (0.24248190224170685) | > loss_disc_real_4: 0.173141747713089 (0.173141747713089) | > loss_disc_real_5: 0.14424704015254974 (0.14424704015254974) | > loss_0: 2.6762168407440186 (2.6762168407440186) | > loss_gen: 1.4113348722457886 (1.4113348722457886) | > loss_kl: 4.790337562561035 (4.790337562561035) | > loss_feat: 2.7340497970581055 (2.7340497970581055) | > loss_mel: 22.081857681274414 (22.081857681274414) | > loss_duration: 2.831916093826294 (2.831916093826294) | > loss_1: 33.84949493408203 (33.84949493408203)  --> STEP: 1 | > loss_disc: 2.5104987621307373 (2.5104987621307373) | > loss_disc_real_0: 0.06832591444253922 (0.06832591444253922) | > loss_disc_real_1: 0.19900614023208618 (0.19900614023208618) | > loss_disc_real_2: 0.2750406265258789 (0.2750406265258789) | > loss_disc_real_3: 0.2752303183078766 (0.2752303183078766) | > loss_disc_real_4: 0.15547773241996765 (0.15547773241996765) | > loss_disc_real_5: 0.1033640131354332 (0.1033640131354332) | > loss_0: 2.5104987621307373 (2.5104987621307373) | > loss_gen: 1.6760917901992798 (1.6760917901992798) | > loss_kl: 4.0582990646362305 (4.0582990646362305) | > loss_feat: 4.220364570617676 (4.220364570617676) | > loss_mel: 25.996627807617188 (25.996627807617188) | > loss_duration: 3.175032138824463 (3.175032138824463) | > loss_1: 39.12641525268555 (39.12641525268555)  --> STEP: 2 | > loss_disc: 1.8554385900497437 (2.1829686760902405) | > loss_disc_real_0: 0.17394870519638062 (0.12113730981945992) | > loss_disc_real_1: 0.10164674371480942 (0.1503264419734478) | > loss_disc_real_2: 0.19708210229873657 (0.23606136441230774) | > loss_disc_real_3: 0.19514833390712738 (0.23518932610750198) | > loss_disc_real_4: 0.0913357213139534 (0.12340672686696053) | > loss_disc_real_5: 0.030964000150561333 (0.06716400664299726) | > loss_0: 1.8554385900497437 (2.1829686760902405) | > loss_gen: 2.814542770385742 (2.245317280292511) | > loss_kl: 5.146881580352783 (4.602590322494507) | > loss_feat: 13.854888916015625 (9.03762674331665) | > loss_mel: 25.501314163208008 (25.748970985412598) | > loss_duration: 3.1448042392730713 (3.159918189048767) | > loss_1: 50.462432861328125 (44.794424057006836)  --> STEP: 3 | > loss_disc: 2.797971248626709 (2.3879695336023965) | > loss_disc_real_0: 0.1282368153333664 (0.12350381165742874) | > loss_disc_real_1: 0.32780805230140686 (0.20948697874943414) | > loss_disc_real_2: 0.3807971477508545 (0.2843066255251567) | > loss_disc_real_3: 0.3824693262577057 (0.2842826594909032) | > loss_disc_real_4: 0.28887566924095154 (0.1785630409916242) | > loss_disc_real_5: 0.2955661118030548 (0.14329804169634977) | > loss_0: 2.797971248626709 (2.3879695336023965) | > loss_gen: 2.295198917388916 (2.2619444926579795) | > loss_kl: 2.6787781715393066 (3.96131960550944) | > loss_feat: 3.6083555221557617 (7.2278696695963545) | > loss_mel: 19.942155838012695 (23.813365936279297) | > loss_duration: 2.8895211219787598 (3.0697858333587646) | > loss_1: 31.41400909423828 (40.334285736083984) --> EVAL PERFORMANCE | > avg_loader_time: 0.01198903719584147 (-0.005757331848144533) | > avg_loss_disc: 2.3879695336023965 (+0.03758684794108058) | > avg_loss_disc_real_0: 0.12350381165742874 (-0.06658563762903214) | > avg_loss_disc_real_1: 0.20948697874943414 (+0.012338052193323762) | > avg_loss_disc_real_2: 0.2843066255251567 (+0.10587499042352042) | > avg_loss_disc_real_3: 0.2842826594909032 (+0.06344280391931531) | > avg_loss_disc_real_4: 0.1785630409916242 (+0.04418360379834971) | > avg_loss_disc_real_5: 0.14329804169634977 (-0.07983548007905483) | > avg_loss_0: 2.3879695336023965 (+0.03758684794108058) | > avg_loss_gen: 2.2619444926579795 (-0.11702986558278372) | > avg_loss_kl: 3.96131960550944 (-0.17013573646545455) | > avg_loss_feat: 7.2278696695963545 (+0.1632701555887861) | > avg_loss_mel: 23.813365936279297 (-0.08210690816243371) | > avg_loss_duration: 3.0697858333587646 (+0.09373005231221532) | > avg_loss_1: 40.334285736083984 (-0.11227289835611742)  > EPOCH: 808/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:32:13)   --> TIME: 2023-10-20 09:32:28 -- STEP: 19/50 -- GLOBAL_STEP: 93420 | > loss_disc: 2.2584493160247803 (2.441333438220777) | > loss_disc_real_0: 0.15583917498588562 (0.13676702221365353) | > loss_disc_real_1: 0.21682476997375488 (0.2306256045244242) | > loss_disc_real_2: 0.20395784080028534 (0.25666284894472674) | > loss_disc_real_3: 0.13278812170028687 (0.2548813049338366) | > loss_disc_real_4: 0.1280958354473114 (0.20700352776207423) | > loss_disc_real_5: 0.16531631350517273 (0.19932067526602432) | > loss_0: 2.2584493160247803 (2.441333438220777) | > grad_norm_0: tensor(966.3237, device='cuda:0') (tensor(1057.5802, device='cuda:0')) | > loss_gen: 1.9788904190063477 (2.316585114127711) | > loss_kl: 1.0595471858978271 (0.8256640497006869) | > loss_feat: 4.105973720550537 (5.112115278643997) | > loss_mel: 16.9395809173584 (19.612756923625344) | > loss_duration: 1.473228931427002 (1.4314171326787848) | > loss_1: 25.557220458984375 (29.298538308394583) | > grad_norm_1: tensor(6769.4058, device='cuda:0') (tensor(44129.2344, device='cuda:0')) | > current_lr_0: 8.914523220986156e-05 | > current_lr_1: 8.914523220986156e-05 | > step_time: 0.4659 (0.4971906636890611) | > loader_time: 0.0144 (0.01966180299457751)  --> TIME: 2023-10-20 09:32:47 -- STEP: 49/50 -- GLOBAL_STEP: 93450 | > loss_disc: 2.5800464153289795 (2.4938911296883406) | > loss_disc_real_0: 0.24130608141422272 (0.1326695714450005) | > loss_disc_real_1: 0.378399521112442 (0.22866891499380676) | > loss_disc_real_2: 0.22769695520401 (0.2318293143595968) | > loss_disc_real_3: 0.3103613555431366 (0.24587956382607928) | > loss_disc_real_4: 0.3290278911590576 (0.2286421753162024) | > loss_disc_real_5: 0.3184669613838196 (0.24003306268809402) | > loss_0: 2.5800464153289795 (2.4938911296883406) | > grad_norm_0: tensor(1163.5005, device='cuda:0') (tensor(1081.2188, device='cuda:0')) | > loss_gen: 3.0395398139953613 (2.309603034233561) | > loss_kl: 0.7145045399665833 (0.7922199639130612) | > loss_feat: 6.762490272521973 (5.203763178036525) | > loss_mel: 26.63580322265625 (20.7752449244869) | > loss_duration: 1.5204455852508545 (1.3872952680198514) | > loss_1: 38.67278289794922 (30.468126394310776) | > grad_norm_1: tensor(92233.0938, device='cuda:0') (tensor(33640.3047, device='cuda:0')) | > current_lr_0: 8.914523220986156e-05 | > current_lr_1: 8.914523220986156e-05 | > step_time: 1.0429 (0.5461631259139703) | > loader_time: 0.5894 (0.030918573846622388)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7257080078125 (2.7257080078125) | > loss_disc_real_0: 0.1904449164867401 (0.1904449164867401) | > loss_disc_real_1: 0.16969487071037292 (0.16969487071037292) | > loss_disc_real_2: 0.18316294252872467 (0.18316294252872467) | > loss_disc_real_3: 0.2671317458152771 (0.2671317458152771) | > loss_disc_real_4: 0.24955113232135773 (0.24955113232135773) | > loss_disc_real_5: 0.15399505198001862 (0.15399505198001862) | > loss_0: 2.7257080078125 (2.7257080078125) | > loss_gen: 1.68035089969635 (1.68035089969635) | > loss_kl: 4.762688636779785 (4.762688636779785) | > loss_feat: 4.123515605926514 (4.123515605926514) | > loss_mel: 23.65380859375 (23.65380859375) | > loss_duration: 2.800105571746826 (2.800105571746826) | > loss_1: 37.020469665527344 (37.020469665527344)  --> STEP: 1 | > loss_disc: 2.5745015144348145 (2.5745015144348145) | > loss_disc_real_0: 0.2155439257621765 (0.2155439257621765) | > loss_disc_real_1: 0.25433483719825745 (0.25433483719825745) | > loss_disc_real_2: 0.19986702501773834 (0.19986702501773834) | > loss_disc_real_3: 0.21096797287464142 (0.21096797287464142) | > loss_disc_real_4: 0.2053331881761551 (0.2053331881761551) | > loss_disc_real_5: 0.23343044519424438 (0.23343044519424438) | > loss_0: 2.5745015144348145 (2.5745015144348145) | > loss_gen: 2.034559488296509 (2.034559488296509) | > loss_kl: 5.0714192390441895 (5.0714192390441895) | > loss_feat: 5.30458402633667 (5.30458402633667) | > loss_mel: 22.944631576538086 (22.944631576538086) | > loss_duration: 3.1563916206359863 (3.1563916206359863) | > loss_1: 38.5115852355957 (38.5115852355957)  --> STEP: 2 | > loss_disc: 2.0605554580688477 (2.317528486251831) | > loss_disc_real_0: 0.27676209807395935 (0.24615301191806793) | > loss_disc_real_1: 0.26997557282447815 (0.2621552050113678) | > loss_disc_real_2: 0.0820825845003128 (0.14097480475902557) | > loss_disc_real_3: 0.20139232277870178 (0.2061801478266716) | > loss_disc_real_4: 0.11601490527391434 (0.1606740467250347) | > loss_disc_real_5: 0.07024367153644562 (0.151837058365345) | > loss_0: 2.0605554580688477 (2.317528486251831) | > loss_gen: 2.7126855850219727 (2.3736225366592407) | > loss_kl: 5.017237186431885 (5.044328212738037) | > loss_feat: 8.123589515686035 (6.7140867710113525) | > loss_mel: 27.006433486938477 (24.97553253173828) | > loss_duration: 3.1067914962768555 (3.131591558456421) | > loss_1: 45.966739654541016 (42.23916244506836)  --> STEP: 3 | > loss_disc: 2.7970197200775146 (2.477358897527059) | > loss_disc_real_0: 0.21958498656749725 (0.23729700346787772) | > loss_disc_real_1: 0.2681743800640106 (0.2641615966955821) | > loss_disc_real_2: 0.2639196515083313 (0.18195642034212747) | > loss_disc_real_3: 0.28026604652404785 (0.23087544739246368) | > loss_disc_real_4: 0.25417330861091614 (0.19184046735366186) | > loss_disc_real_5: 0.23852790892124176 (0.18073400855064392) | > loss_0: 2.7970197200775146 (2.477358897527059) | > loss_gen: 1.7926372289657593 (2.17996076742808) | > loss_kl: 2.3932979106903076 (4.160651445388794) | > loss_feat: 0.9647085070610046 (4.79762734969457) | > loss_mel: 15.51259708404541 (21.821220715840656) | > loss_duration: 2.8226888179779053 (3.0286239782969155) | > loss_1: 23.485929489135742 (35.98808479309082) --> EVAL PERFORMANCE | > avg_loader_time: 0.011450052261352539 (-0.0005389849344889317) | > avg_loss_disc: 2.477358897527059 (+0.08938936392466257) | > avg_loss_disc_real_0: 0.23729700346787772 (+0.11379319181044897) | > avg_loss_disc_real_1: 0.2641615966955821 (+0.054674617946147946) | > avg_loss_disc_real_2: 0.18195642034212747 (-0.1023502051830292) | > avg_loss_disc_real_3: 0.23087544739246368 (-0.053407212098439516) | > avg_loss_disc_real_4: 0.19184046735366186 (+0.013277426362037659) | > avg_loss_disc_real_5: 0.18073400855064392 (+0.03743596685429415) | > avg_loss_0: 2.477358897527059 (+0.08938936392466257) | > avg_loss_gen: 2.17996076742808 (-0.08198372522989938) | > avg_loss_kl: 4.160651445388794 (+0.199331839879354) | > avg_loss_feat: 4.79762734969457 (-2.430242319901785) | > avg_loss_mel: 21.821220715840656 (-1.9921452204386405) | > avg_loss_duration: 3.0286239782969155 (-0.041161855061849106) | > avg_loss_1: 35.98808479309082 (-4.346200942993164)  > EPOCH: 809/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:33:02)   --> TIME: 2023-10-20 09:33:26 -- STEP: 29/50 -- GLOBAL_STEP: 93480 | > loss_disc: 1.9693719148635864 (2.474502612804544) | > loss_disc_real_0: 0.036613188683986664 (0.14463075346730905) | > loss_disc_real_1: 0.18303635716438293 (0.216995887715241) | > loss_disc_real_2: 0.13869720697402954 (0.23810216379833632) | > loss_disc_real_3: 0.14191418886184692 (0.2398048059950615) | > loss_disc_real_4: 0.2837021052837372 (0.24439910054206848) | > loss_disc_real_5: 0.2758886218070984 (0.2578093980535351) | > loss_0: 1.9693719148635864 (2.474502612804544) | > grad_norm_0: tensor(709.2031, device='cuda:0') (tensor(1018.2915, device='cuda:0')) | > loss_gen: 2.606478691101074 (2.2621242136790833) | > loss_kl: 1.0540286302566528 (0.8784099642572731) | > loss_feat: 6.503307342529297 (5.17039857001911) | > loss_mel: 24.147876739501953 (20.432039782918732) | > loss_duration: 1.3909409046173096 (1.4173365214775349) | > loss_1: 35.702632904052734 (30.160309035202552) | > grad_norm_1: tensor(16777.5703, device='cuda:0') (tensor(27690.4336, device='cuda:0')) | > current_lr_0: 8.905612596894202e-05 | > current_lr_1: 8.905612596894202e-05 | > step_time: 0.7287 (0.6002106830991549) | > loader_time: 0.0386 (0.023732284019733298)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.450322151184082 (2.450322151184082) | > loss_disc_real_0: 0.15301990509033203 (0.15301990509033203) | > loss_disc_real_1: 0.23540063202381134 (0.23540063202381134) | > loss_disc_real_2: 0.19427688419818878 (0.19427688419818878) | > loss_disc_real_3: 0.1483432501554489 (0.1483432501554489) | > loss_disc_real_4: 0.2122570276260376 (0.2122570276260376) | > loss_disc_real_5: 0.30893051624298096 (0.30893051624298096) | > loss_0: 2.450322151184082 (2.450322151184082) | > loss_gen: 2.5473225116729736 (2.5473225116729736) | > loss_kl: 5.202273368835449 (5.202273368835449) | > loss_feat: 7.738208770751953 (7.738208770751953) | > loss_mel: 27.590076446533203 (27.590076446533203) | > loss_duration: 2.9033048152923584 (2.9033048152923584) | > loss_1: 45.98118591308594 (45.98118591308594)  --> STEP: 1 | > loss_disc: 3.0171961784362793 (3.0171961784362793) | > loss_disc_real_0: 0.2670328617095947 (0.2670328617095947) | > loss_disc_real_1: 0.3048779368400574 (0.3048779368400574) | > loss_disc_real_2: 0.27753132581710815 (0.27753132581710815) | > loss_disc_real_3: 0.30343377590179443 (0.30343377590179443) | > loss_disc_real_4: 0.24181675910949707 (0.24181675910949707) | > loss_disc_real_5: 0.25122737884521484 (0.25122737884521484) | > loss_0: 3.0171961784362793 (3.0171961784362793) | > loss_gen: 1.6443208456039429 (1.6443208456039429) | > loss_kl: 5.213520526885986 (5.213520526885986) | > loss_feat: 0.11162368953227997 (0.11162368953227997) | > loss_mel: 7.8842010498046875 (7.8842010498046875) | > loss_duration: 3.1781280040740967 (3.1781280040740967) | > loss_1: 18.03179359436035 (18.03179359436035)  --> STEP: 2 | > loss_disc: 2.5194318294525146 (2.768314003944397) | > loss_disc_real_0: 0.4658629298210144 (0.36644789576530457) | > loss_disc_real_1: 0.23300373554229736 (0.26894083619117737) | > loss_disc_real_2: 0.25531697273254395 (0.26642414927482605) | > loss_disc_real_3: 0.1936568170785904 (0.2485452964901924) | > loss_disc_real_4: 0.1594422608613968 (0.20062950998544693) | > loss_disc_real_5: 0.2991846203804016 (0.2752059996128082) | > loss_0: 2.5194318294525146 (2.768314003944397) | > loss_gen: 2.766928195953369 (2.205624520778656) | > loss_kl: 5.377161502838135 (5.2953410148620605) | > loss_feat: 7.360545635223389 (3.7360846623778343) | > loss_mel: 25.656635284423828 (16.770418167114258) | > loss_duration: 3.1932547092437744 (3.1856913566589355) | > loss_1: 44.35452651977539 (31.19316005706787)  --> STEP: 3 | > loss_disc: 2.6905980110168457 (2.7424086729685464) | > loss_disc_real_0: 0.2460993528366089 (0.3263317147890727) | > loss_disc_real_1: 0.22297511994838715 (0.25361893077691394) | > loss_disc_real_2: 0.22509415447711945 (0.2526474843422572) | > loss_disc_real_3: 0.220658078789711 (0.2392495572566986) | > loss_disc_real_4: 0.23839642107486725 (0.21321848034858704) | > loss_disc_real_5: 0.1890624314546585 (0.246491476893425) | > loss_0: 2.6905980110168457 (2.7424086729685464) | > loss_gen: 2.0586166381835938 (2.1566218932469687) | > loss_kl: 2.3090364933013916 (4.299906174341838) | > loss_feat: 4.548104763031006 (4.006758029262225) | > loss_mel: 19.97952651977539 (17.840120951334637) | > loss_duration: 2.9837493896484375 (3.118377367655436) | > loss_1: 31.8790340423584 (31.42178471883138) --> EVAL PERFORMANCE | > avg_loader_time: 0.0067437489827473955 (-0.0047063032786051435) | > avg_loss_disc: 2.7424086729685464 (+0.26504977544148733) | > avg_loss_disc_real_0: 0.3263317147890727 (+0.08903471132119498) | > avg_loss_disc_real_1: 0.25361893077691394 (-0.010542665918668148) | > avg_loss_disc_real_2: 0.2526474843422572 (+0.07069106400012973) | > avg_loss_disc_real_3: 0.2392495572566986 (+0.008374109864234924) | > avg_loss_disc_real_4: 0.21321848034858704 (+0.021378012994925172) | > avg_loss_disc_real_5: 0.246491476893425 (+0.06575746834278107) | > avg_loss_0: 2.7424086729685464 (+0.26504977544148733) | > avg_loss_gen: 2.1566218932469687 (-0.023338874181111358) | > avg_loss_kl: 4.299906174341838 (+0.13925472895304392) | > avg_loss_feat: 4.006758029262225 (-0.7908693204323445) | > avg_loss_mel: 17.840120951334637 (-3.9810997645060198) | > avg_loss_duration: 3.118377367655436 (+0.08975338935852051) | > avg_loss_1: 31.42178471883138 (-4.566300074259441)  > EPOCH: 810/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:33:55)   --> TIME: 2023-10-20 09:34:08 -- STEP: 9/50 -- GLOBAL_STEP: 93510 | > loss_disc: 2.4310805797576904 (2.4286098215315075) | > loss_disc_real_0: 0.06525932997465134 (0.12197014109955893) | > loss_disc_real_1: 0.36789071559906006 (0.2600581530067656) | > loss_disc_real_2: 0.23760153353214264 (0.20666702257262337) | > loss_disc_real_3: 0.28953278064727783 (0.24638259907563528) | > loss_disc_real_4: 0.23112186789512634 (0.21088477306895786) | > loss_disc_real_5: 0.25622817873954773 (0.23931494831211036) | > loss_0: 2.4310805797576904 (2.4286098215315075) | > grad_norm_0: tensor(959.8355, device='cuda:0') (tensor(911.3263, device='cuda:0')) | > loss_gen: 2.3469126224517822 (2.383675906393263) | > loss_kl: 0.8255206942558289 (0.978409641318851) | > loss_feat: 2.6579208374023438 (6.3104951116773815) | > loss_mel: 22.01067543029785 (22.771562364366318) | > loss_duration: 1.3500909805297852 (1.3944137493769329) | > loss_1: 29.191120147705078 (33.83855671352811) | > grad_norm_1: tensor(10514.1572, device='cuda:0') (tensor(29130.2461, device='cuda:0')) | > current_lr_0: 8.896710879528917e-05 | > current_lr_1: 8.896710879528917e-05 | > step_time: 0.5753 (0.6983502176072862) | > loader_time: 0.0393 (0.02528744273715549)  --> TIME: 2023-10-20 09:34:25 -- STEP: 39/50 -- GLOBAL_STEP: 93540 | > loss_disc: 2.973919630050659 (2.341088487551763) | > loss_disc_real_0: 0.12510910630226135 (0.1456463174560131) | > loss_disc_real_1: 0.25196361541748047 (0.22195392297819638) | > loss_disc_real_2: 0.2382746934890747 (0.21979894527258018) | > loss_disc_real_3: 0.28479838371276855 (0.2366324650744597) | > loss_disc_real_4: 0.23928703367710114 (0.2184507321470823) | > loss_disc_real_5: 0.2600175142288208 (0.20086083308053324) | > loss_0: 2.973919630050659 (2.341088487551763) | > grad_norm_0: tensor(2745.0259, device='cuda:0') (tensor(1131.3208, device='cuda:0')) | > loss_gen: 1.4713383913040161 (2.362657116009639) | > loss_kl: 0.6310922503471375 (0.8469307231597412) | > loss_feat: 0.19558191299438477 (5.578226764614765) | > loss_mel: 2.032677173614502 (19.814229824604137) | > loss_duration: 1.4070004224777222 (1.3934045327015412) | > loss_1: 5.737690448760986 (29.995448797177044) | > grad_norm_1: tensor(32195.5703, device='cuda:0') (tensor(39310.1367, device='cuda:0')) | > current_lr_0: 8.896710879528917e-05 | > current_lr_1: 8.896710879528917e-05 | > step_time: 0.5824 (0.5839317211737999) | > loader_time: 0.0131 (0.019259226627838917)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4286997318267822 (2.4286997318267822) | > loss_disc_real_0: 0.1973046064376831 (0.1973046064376831) | > loss_disc_real_1: 0.30760815739631653 (0.30760815739631653) | > loss_disc_real_2: 0.18590925633907318 (0.18590925633907318) | > loss_disc_real_3: 0.2100372165441513 (0.2100372165441513) | > loss_disc_real_4: 0.23133152723312378 (0.23133152723312378) | > loss_disc_real_5: 0.13531239330768585 (0.13531239330768585) | > loss_0: 2.4286997318267822 (2.4286997318267822) | > loss_gen: 2.426290273666382 (2.426290273666382) | > loss_kl: 4.888662815093994 (4.888662815093994) | > loss_feat: 5.538562774658203 (5.538562774658203) | > loss_mel: 17.420818328857422 (17.420818328857422) | > loss_duration: 2.9040098190307617 (2.9040098190307617) | > loss_1: 33.1783447265625 (33.1783447265625)  --> STEP: 1 | > loss_disc: 2.7933897972106934 (2.7933897972106934) | > loss_disc_real_0: 0.3427278995513916 (0.3427278995513916) | > loss_disc_real_1: 0.2021723836660385 (0.2021723836660385) | > loss_disc_real_2: 0.2279871106147766 (0.2279871106147766) | > loss_disc_real_3: 0.2170354425907135 (0.2170354425907135) | > loss_disc_real_4: 0.18403084576129913 (0.18403084576129913) | > loss_disc_real_5: 0.1796538233757019 (0.1796538233757019) | > loss_0: 2.7933897972106934 (2.7933897972106934) | > loss_gen: 1.6713905334472656 (1.6713905334472656) | > loss_kl: 5.088974475860596 (5.088974475860596) | > loss_feat: 2.1658554077148438 (2.1658554077148438) | > loss_mel: 9.260910987854004 (9.260910987854004) | > loss_duration: 3.3224360942840576 (3.3224360942840576) | > loss_1: 21.509567260742188 (21.509567260742188)  --> STEP: 2 | > loss_disc: 1.9832448959350586 (2.388317346572876) | > loss_disc_real_0: 0.20308789610862732 (0.27290789783000946) | > loss_disc_real_1: 0.29930052161216736 (0.25073645263910294) | > loss_disc_real_2: 0.19827577471733093 (0.21313144266605377) | > loss_disc_real_3: 0.13130119442939758 (0.17416831851005554) | > loss_disc_real_4: 0.09759929031133652 (0.14081506803631783) | > loss_disc_real_5: 0.2324276864528656 (0.20604075491428375) | > loss_0: 1.9832448959350586 (2.388317346572876) | > loss_gen: 2.9259631633758545 (2.29867684841156) | > loss_kl: 5.5445990562438965 (5.316786766052246) | > loss_feat: 10.30301284790039 (6.234434127807617) | > loss_mel: 26.14692497253418 (17.703917980194092) | > loss_duration: 3.1783251762390137 (3.2503806352615356) | > loss_1: 48.09882736206055 (34.80419731140137)  --> STEP: 3 | > loss_disc: 3.083639144897461 (2.620091279347738) | > loss_disc_real_0: 0.4156891703605652 (0.3205016553401947) | > loss_disc_real_1: 0.2266085296869278 (0.24269381165504456) | > loss_disc_real_2: 0.21363557875156403 (0.21329948802789053) | > loss_disc_real_3: 0.2504650354385376 (0.19960055748621622) | > loss_disc_real_4: 0.2409781813621521 (0.17420277247826257) | > loss_disc_real_5: 0.3176855444908142 (0.24325568477312723) | > loss_0: 3.083639144897461 (2.620091279347738) | > loss_gen: 1.6226909160614014 (2.0733482042948403) | > loss_kl: 2.5410265922546387 (4.391533374786377) | > loss_feat: 0.08667753636837006 (4.1851819306612015) | > loss_mel: 2.0675747394561768 (12.491803566614786) | > loss_duration: 2.8706982135772705 (3.1238198280334473) | > loss_1: 9.188668251037598 (26.265687624613445) --> EVAL PERFORMANCE | > avg_loader_time: 0.014644781748453775 (+0.007901032765706379) | > avg_loss_disc: 2.620091279347738 (-0.12231739362080862) | > avg_loss_disc_real_0: 0.3205016553401947 (-0.005830059448877989) | > avg_loss_disc_real_1: 0.24269381165504456 (-0.010925119121869387) | > avg_loss_disc_real_2: 0.21329948802789053 (-0.03934799631436667) | > avg_loss_disc_real_3: 0.19960055748621622 (-0.03964899977048239) | > avg_loss_disc_real_4: 0.17420277247826257 (-0.03901570787032446) | > avg_loss_disc_real_5: 0.24325568477312723 (-0.003235792120297759) | > avg_loss_0: 2.620091279347738 (-0.12231739362080862) | > avg_loss_gen: 2.0733482042948403 (-0.08327368895212839) | > avg_loss_kl: 4.391533374786377 (+0.09162720044453909) | > avg_loss_feat: 4.1851819306612015 (+0.17842390139897635) | > avg_loss_mel: 12.491803566614786 (-5.34831738471985) | > avg_loss_duration: 3.1238198280334473 (+0.005442460378011216) | > avg_loss_1: 26.265687624613445 (-5.156097094217934)  > EPOCH: 811/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:34:43)   --> TIME: 2023-10-20 09:35:01 -- STEP: 19/50 -- GLOBAL_STEP: 93570 | > loss_disc: 2.131451368331909 (2.3011508803618583) | > loss_disc_real_0: 0.06146324425935745 (0.14447548544328462) | > loss_disc_real_1: 0.24768321216106415 (0.20689008090841143) | > loss_disc_real_2: 0.19552306830883026 (0.18227801226863735) | > loss_disc_real_3: 0.268481969833374 (0.21532559375229635) | > loss_disc_real_4: 0.08293246477842331 (0.19418032516382241) | > loss_disc_real_5: 0.13791093230247498 (0.21656707588485197) | > loss_0: 2.131451368331909 (2.3011508803618583) | > grad_norm_0: tensor(779.8779, device='cuda:0') (tensor(1104.1345, device='cuda:0')) | > loss_gen: 2.856654644012451 (2.488763602156388) | > loss_kl: 0.9045448899269104 (0.9624310888742146) | > loss_feat: 7.8779425621032715 (6.439236946698082) | > loss_mel: 25.63578987121582 (20.480977547796147) | > loss_duration: 1.4335384368896484 (1.4357728017003912) | > loss_1: 38.708473205566406 (31.807181684594404) | > grad_norm_1: tensor(16795.7695, device='cuda:0') (tensor(41090.0742, device='cuda:0')) | > current_lr_0: 8.887818059987468e-05 | > current_lr_1: 8.887818059987468e-05 | > step_time: 0.7424 (0.6349070072174073) | > loader_time: 0.0352 (0.024705058649966593)  --> TIME: 2023-10-20 09:35:14 -- STEP: 49/50 -- GLOBAL_STEP: 93600 | > loss_disc: 2.123859405517578 (2.4470865093931855) | > loss_disc_real_0: 0.16370044648647308 (0.16809493565589798) | > loss_disc_real_1: 0.18250447511672974 (0.21671937968657942) | > loss_disc_real_2: 0.24470743536949158 (0.20783203775633355) | > loss_disc_real_3: 0.26506727933883667 (0.23464022398147047) | > loss_disc_real_4: 0.25825709104537964 (0.21539031067977146) | > loss_disc_real_5: 0.22461089491844177 (0.24164613234639473) | > loss_0: 2.123859405517578 (2.4470865093931855) | > grad_norm_0: tensor(1752.2605, device='cuda:0') (tensor(1967.5264, device='cuda:0')) | > loss_gen: 2.9139575958251953 (2.4007108260174186) | > loss_kl: 0.6659051179885864 (0.8809243343314346) | > loss_feat: 7.488468647003174 (5.716777277958332) | > loss_mel: 32.69373321533203 (20.502045461109702) | > loss_duration: 1.4953839778900146 (1.3923132273615624) | > loss_1: 45.2574462890625 (30.892770932645213) | > grad_norm_1: tensor(149208.6875, device='cuda:0') (tensor(57195.8008, device='cuda:0')) | > current_lr_0: 8.887818059987468e-05 | > current_lr_1: 8.887818059987468e-05 | > step_time: 0.3139 (0.5026836151979408) | > loader_time: 0.3889 (0.023920448458924586)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4826061725616455 (2.4826061725616455) | > loss_disc_real_0: 0.11629154533147812 (0.11629154533147812) | > loss_disc_real_1: 0.26082706451416016 (0.26082706451416016) | > loss_disc_real_2: 0.1877383142709732 (0.1877383142709732) | > loss_disc_real_3: 0.27688175439834595 (0.27688175439834595) | > loss_disc_real_4: 0.19224676489830017 (0.19224676489830017) | > loss_disc_real_5: 0.2116011530160904 (0.2116011530160904) | > loss_0: 2.4826061725616455 (2.4826061725616455) | > loss_gen: 1.9350911378860474 (1.9350911378860474) | > loss_kl: 4.0361480712890625 (4.0361480712890625) | > loss_feat: 2.417494058609009 (2.417494058609009) | > loss_mel: 20.006053924560547 (20.006053924560547) | > loss_duration: 2.7758052349090576 (2.7758052349090576) | > loss_1: 31.170591354370117 (31.170591354370117)  --> STEP: 1 | > loss_disc: 2.42777681350708 (2.42777681350708) | > loss_disc_real_0: 0.1443181335926056 (0.1443181335926056) | > loss_disc_real_1: 0.20104847848415375 (0.20104847848415375) | > loss_disc_real_2: 0.19137294590473175 (0.19137294590473175) | > loss_disc_real_3: 0.2386978268623352 (0.2386978268623352) | > loss_disc_real_4: 0.1903933882713318 (0.1903933882713318) | > loss_disc_real_5: 0.19969426095485687 (0.19969426095485687) | > loss_0: 2.42777681350708 (2.42777681350708) | > loss_gen: 1.8559324741363525 (1.8559324741363525) | > loss_kl: 5.376756191253662 (5.376756191253662) | > loss_feat: 3.272507429122925 (3.272507429122925) | > loss_mel: 14.443498611450195 (14.443498611450195) | > loss_duration: 3.2733662128448486 (3.2733662128448486) | > loss_1: 28.222061157226562 (28.222061157226562)  --> STEP: 2 | > loss_disc: 2.7341995239257812 (2.5809881687164307) | > loss_disc_real_0: 0.07435308396816254 (0.10933560878038406) | > loss_disc_real_1: 0.09231625497341156 (0.14668236672878265) | > loss_disc_real_2: 0.17609702050685883 (0.1837349832057953) | > loss_disc_real_3: 0.06724927574396133 (0.15297355130314827) | > loss_disc_real_4: 0.17591290175914764 (0.18315314501523972) | > loss_disc_real_5: 0.1337241530418396 (0.16670920699834824) | > loss_0: 2.7341995239257812 (2.5809881687164307) | > loss_gen: 1.5388214588165283 (1.6973769664764404) | > loss_kl: 4.978404998779297 (5.1775805950164795) | > loss_feat: 8.736456871032715 (6.00448215007782) | > loss_mel: 23.564306259155273 (19.003902435302734) | > loss_duration: 3.1614012718200684 (3.2173837423324585) | > loss_1: 41.97938919067383 (35.100725173950195)  --> STEP: 3 | > loss_disc: 2.506387948989868 (2.5561214288075766) | > loss_disc_real_0: 0.08960939943790436 (0.10276020566622417) | > loss_disc_real_1: 0.2794886529445648 (0.19095112880071005) | > loss_disc_real_2: 0.26084068417549133 (0.2094368835290273) | > loss_disc_real_3: 0.2761914134025574 (0.1940461720029513) | > loss_disc_real_4: 0.21175876259803772 (0.1926883508761724) | > loss_disc_real_5: 0.1735159009695053 (0.16897810498873392) | > loss_0: 2.506387948989868 (2.5561214288075766) | > loss_gen: 1.8654756546020508 (1.7534098625183105) | > loss_kl: 2.546243906021118 (4.300468365351359) | > loss_feat: 1.845334768295288 (4.618099689483643) | > loss_mel: 18.767305374145508 (18.925036748250324) | > loss_duration: 2.8050360679626465 (3.079934517542521) | > loss_1: 27.829397201538086 (32.67694918314616) --> EVAL PERFORMANCE | > avg_loader_time: 0.02606940269470215 (+0.011424620946248373) | > avg_loss_disc: 2.5561214288075766 (-0.06396985054016113) | > avg_loss_disc_real_0: 0.10276020566622417 (-0.21774144967397052) | > avg_loss_disc_real_1: 0.19095112880071005 (-0.051742682854334504) | > avg_loss_disc_real_2: 0.2094368835290273 (-0.00386260449886322) | > avg_loss_disc_real_3: 0.1940461720029513 (-0.005554385483264923) | > avg_loss_disc_real_4: 0.1926883508761724 (+0.01848557839790982) | > avg_loss_disc_real_5: 0.16897810498873392 (-0.07427757978439331) | > avg_loss_0: 2.5561214288075766 (-0.06396985054016113) | > avg_loss_gen: 1.7534098625183105 (-0.3199383417765298) | > avg_loss_kl: 4.300468365351359 (-0.09106500943501761) | > avg_loss_feat: 4.618099689483643 (+0.4329177588224411) | > avg_loss_mel: 18.925036748250324 (+6.433233181635538) | > avg_loss_duration: 3.079934517542521 (-0.043885310490926255) | > avg_loss_1: 32.67694918314616 (+6.411261558532711)  > EPOCH: 812/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:35:26)   --> TIME: 2023-10-20 09:35:52 -- STEP: 29/50 -- GLOBAL_STEP: 93630 | > loss_disc: 2.8662149906158447 (2.453578759884012) | > loss_disc_real_0: 0.19831892848014832 (0.1781211495399475) | > loss_disc_real_1: 0.24441342055797577 (0.2291210206418202) | > loss_disc_real_2: 0.2253643125295639 (0.2237020723264793) | > loss_disc_real_3: 0.22770297527313232 (0.23378685283763656) | > loss_disc_real_4: 0.2066379189491272 (0.2207299761217216) | > loss_disc_real_5: 0.2476613074541092 (0.21495726800941187) | > loss_0: 2.8662149906158447 (2.453578759884012) | > grad_norm_0: tensor(1822.1985, device='cuda:0') (tensor(1681.7393, device='cuda:0')) | > loss_gen: 1.4932368993759155 (2.324065866141484) | > loss_kl: 0.6997148990631104 (0.8233432384400532) | > loss_feat: 0.49374496936798096 (5.349325563565924) | > loss_mel: 16.00598907470703 (20.676599819084693) | > loss_duration: 1.37349534034729 (1.388660295256253) | > loss_1: 20.066181182861328 (30.5619943881857) | > grad_norm_1: tensor(19055.0254, device='cuda:0') (tensor(44806.1562, device='cuda:0')) | > current_lr_0: 8.878934129375925e-05 | > current_lr_1: 8.878934129375925e-05 | > step_time: 0.5963 (0.607708585673365) | > loader_time: 0.0067 (0.02375314975606984)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0204527378082275 (3.0204527378082275) | > loss_disc_real_0: 0.21363452076911926 (0.21363452076911926) | > loss_disc_real_1: 0.261391818523407 (0.261391818523407) | > loss_disc_real_2: 0.23904019594192505 (0.23904019594192505) | > loss_disc_real_3: 0.2502991557121277 (0.2502991557121277) | > loss_disc_real_4: 0.21042224764823914 (0.21042224764823914) | > loss_disc_real_5: 0.25024092197418213 (0.25024092197418213) | > loss_0: 3.0204527378082275 (3.0204527378082275) | > loss_gen: 1.41298508644104 (1.41298508644104) | > loss_kl: 4.7649712562561035 (4.7649712562561035) | > loss_feat: 0.08824527263641357 (0.08824527263641357) | > loss_mel: 2.190232276916504 (2.190232276916504) | > loss_duration: 3.006659507751465 (3.006659507751465) | > loss_1: 11.463093757629395 (11.463093757629395)  --> STEP: 1 | > loss_disc: 2.2619917392730713 (2.2619917392730713) | > loss_disc_real_0: 0.056405629962682724 (0.056405629962682724) | > loss_disc_real_1: 0.13230586051940918 (0.13230586051940918) | > loss_disc_real_2: 0.1438690721988678 (0.1438690721988678) | > loss_disc_real_3: 0.2936694025993347 (0.2936694025993347) | > loss_disc_real_4: 0.4143485128879547 (0.4143485128879547) | > loss_disc_real_5: 0.3168352544307709 (0.3168352544307709) | > loss_0: 2.2619917392730713 (2.2619917392730713) | > loss_gen: 2.6119213104248047 (2.6119213104248047) | > loss_kl: 5.416322231292725 (5.416322231292725) | > loss_feat: 8.954582214355469 (8.954582214355469) | > loss_mel: 29.176523208618164 (29.176523208618164) | > loss_duration: 3.2780442237854004 (3.2780442237854004) | > loss_1: 49.43739318847656 (49.43739318847656)  --> STEP: 2 | > loss_disc: 2.8039793968200684 (2.53298556804657) | > loss_disc_real_0: 0.19617587327957153 (0.12629075162112713) | > loss_disc_real_1: 0.2839377522468567 (0.20812180638313293) | > loss_disc_real_2: 0.2514386475086212 (0.1976538598537445) | > loss_disc_real_3: 0.2545689046382904 (0.27411915361881256) | > loss_disc_real_4: 0.2428705394268036 (0.32860952615737915) | > loss_disc_real_5: 0.3021128475666046 (0.30947405099868774) | > loss_0: 2.8039793968200684 (2.53298556804657) | > loss_gen: 2.2521543502807617 (2.432037830352783) | > loss_kl: 5.420888900756836 (5.41860556602478) | > loss_feat: 5.531393527984619 (7.242987871170044) | > loss_mel: 24.94133949279785 (27.058931350708008) | > loss_duration: 3.2210276126861572 (3.249535918235779) | > loss_1: 41.36680603027344 (45.402099609375)  --> STEP: 3 | > loss_disc: 3.13295841217041 (2.73297651608785) | > loss_disc_real_0: 0.31470105051994324 (0.18909418458739916) | > loss_disc_real_1: 0.3853655457496643 (0.2672030528386434) | > loss_disc_real_2: 0.4825705885887146 (0.2926261027654012) | > loss_disc_real_3: 0.3766116201877594 (0.30828330914179486) | > loss_disc_real_4: 0.22990772128105164 (0.29570892453193665) | > loss_disc_real_5: 0.42955705523490906 (0.34950171907742816) | > loss_0: 3.13295841217041 (2.73297651608785) | > loss_gen: 2.6216015815734863 (2.495225747426351) | > loss_kl: 2.0738890171051025 (4.303700049718221) | > loss_feat: 4.855666637420654 (6.447214126586914) | > loss_mel: 25.718505859375 (26.612122853597004) | > loss_duration: 3.0584404468536377 (3.185837427775065) | > loss_1: 38.32810592651367 (43.04410171508789) --> EVAL PERFORMANCE | > avg_loader_time: 0.023662408192952473 (-0.0024069945017496756) | > avg_loss_disc: 2.73297651608785 (+0.17685508728027344) | > avg_loss_disc_real_0: 0.18909418458739916 (+0.08633397892117499) | > avg_loss_disc_real_1: 0.2672030528386434 (+0.07625192403793332) | > avg_loss_disc_real_2: 0.2926261027654012 (+0.08318921923637387) | > avg_loss_disc_real_3: 0.30828330914179486 (+0.11423713713884356) | > avg_loss_disc_real_4: 0.29570892453193665 (+0.10302057365576425) | > avg_loss_disc_real_5: 0.34950171907742816 (+0.18052361408869425) | > avg_loss_0: 2.73297651608785 (+0.17685508728027344) | > avg_loss_gen: 2.495225747426351 (+0.7418158849080405) | > avg_loss_kl: 4.303700049718221 (+0.003231684366861387) | > avg_loss_feat: 6.447214126586914 (+1.8291144371032715) | > avg_loss_mel: 26.612122853597004 (+7.68708610534668) | > avg_loss_duration: 3.185837427775065 (+0.10590291023254395) | > avg_loss_1: 43.04410171508789 (+10.367152531941734)  > EPOCH: 813/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:36:19)   --> TIME: 2023-10-20 09:36:29 -- STEP: 9/50 -- GLOBAL_STEP: 93660 | > loss_disc: 2.8432018756866455 (2.4078693919711642) | > loss_disc_real_0: 0.06899581849575043 (0.1580317693038119) | > loss_disc_real_1: 0.2890873849391937 (0.20723925448126262) | > loss_disc_real_2: 0.27388593554496765 (0.21755635407235888) | > loss_disc_real_3: 0.26179239153862 (0.22032898767954773) | > loss_disc_real_4: 0.3071677088737488 (0.23277403145200676) | > loss_disc_real_5: 0.266048401594162 (0.23229541898601586) | > loss_0: 2.8432018756866455 (2.4078693919711642) | > grad_norm_0: tensor(1060.6196, device='cuda:0') (tensor(1240.7869, device='cuda:0')) | > loss_gen: 1.7438571453094482 (2.268934885660807) | > loss_kl: 1.017075777053833 (0.873537282148997) | > loss_feat: 1.4185775518417358 (5.594079984558953) | > loss_mel: 16.54784393310547 (20.075713899400498) | > loss_duration: 1.2957903146743774 (1.3724467489454482) | > loss_1: 22.023143768310547 (30.184712621900772) | > grad_norm_1: tensor(5259.2148, device='cuda:0') (tensor(21428.2715, device='cuda:0')) | > current_lr_0: 8.870059078809245e-05 | > current_lr_1: 8.870059078809245e-05 | > step_time: 0.3424 (0.4972634580400255) | > loader_time: 0.0079 (0.01219230228000217)  --> TIME: 2023-10-20 09:36:51 -- STEP: 39/50 -- GLOBAL_STEP: 93690 | > loss_disc: 2.526505708694458 (2.4754170943529172) | > loss_disc_real_0: 0.06741483509540558 (0.15335140257882765) | > loss_disc_real_1: 0.1817348599433899 (0.22545741508022332) | > loss_disc_real_2: 0.2560020685195923 (0.238577201962471) | > loss_disc_real_3: 0.21425418555736542 (0.24443407218234667) | > loss_disc_real_4: 0.2371920794248581 (0.22941665585415486) | > loss_disc_real_5: 0.23817144334316254 (0.22439912453484842) | > loss_0: 2.526505708694458 (2.4754170943529172) | > grad_norm_0: tensor(1234.3070, device='cuda:0') (tensor(1163.2125, device='cuda:0')) | > loss_gen: 1.824663758277893 (2.2533219074591613) | > loss_kl: 0.7947279810905457 (0.8737448209371322) | > loss_feat: 2.525583028793335 (5.097308895335748) | > loss_mel: 21.687471389770508 (20.863000781108173) | > loss_duration: 1.4382152557373047 (1.370354380363073) | > loss_1: 28.270660400390625 (30.457730806790867) | > grad_norm_1: tensor(3972.2400, device='cuda:0') (tensor(33872.7227, device='cuda:0')) | > current_lr_0: 8.870059078809245e-05 | > current_lr_1: 8.870059078809245e-05 | > step_time: 0.4734 (0.6540519946660751) | > loader_time: 0.0043 (0.018275291491777475)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9562785625457764 (2.9562785625457764) | > loss_disc_real_0: 0.3094710409641266 (0.3094710409641266) | > loss_disc_real_1: 0.2181939333677292 (0.2181939333677292) | > loss_disc_real_2: 0.3189609944820404 (0.3189609944820404) | > loss_disc_real_3: 0.25396987795829773 (0.25396987795829773) | > loss_disc_real_4: 0.37206172943115234 (0.37206172943115234) | > loss_disc_real_5: 0.47810909152030945 (0.47810909152030945) | > loss_0: 2.9562785625457764 (2.9562785625457764) | > loss_gen: 2.260648488998413 (2.260648488998413) | > loss_kl: 4.534177303314209 (4.534177303314209) | > loss_feat: 4.784462928771973 (4.784462928771973) | > loss_mel: 22.980260848999023 (22.980260848999023) | > loss_duration: 2.835524797439575 (2.835524797439575) | > loss_1: 37.39507293701172 (37.39507293701172)  --> STEP: 1 | > loss_disc: 2.6994075775146484 (2.6994075775146484) | > loss_disc_real_0: 0.06744566559791565 (0.06744566559791565) | > loss_disc_real_1: 0.2358693927526474 (0.2358693927526474) | > loss_disc_real_2: 0.262104332447052 (0.262104332447052) | > loss_disc_real_3: 0.33938947319984436 (0.33938947319984436) | > loss_disc_real_4: 0.3343837261199951 (0.3343837261199951) | > loss_disc_real_5: 0.3434971570968628 (0.3434971570968628) | > loss_0: 2.6994075775146484 (2.6994075775146484) | > loss_gen: 2.280869483947754 (2.280869483947754) | > loss_kl: 4.86126184463501 (4.86126184463501) | > loss_feat: 8.005138397216797 (8.005138397216797) | > loss_mel: 22.889352798461914 (22.889352798461914) | > loss_duration: 3.1416726112365723 (3.1416726112365723) | > loss_1: 41.17829513549805 (41.17829513549805)  --> STEP: 2 | > loss_disc: 2.9864766597747803 (2.8429421186447144) | > loss_disc_real_0: 0.21221230924129486 (0.13982898741960526) | > loss_disc_real_1: 0.25406506657600403 (0.24496722966432571) | > loss_disc_real_2: 0.2510075569152832 (0.2565559446811676) | > loss_disc_real_3: 0.2620196044445038 (0.3007045388221741) | > loss_disc_real_4: 0.2679799497127533 (0.3011818379163742) | > loss_disc_real_5: 0.2684002220630646 (0.3059486895799637) | > loss_0: 2.9864766597747803 (2.8429421186447144) | > loss_gen: 1.5343284606933594 (1.9075989723205566) | > loss_kl: 5.922865390777588 (5.392063617706299) | > loss_feat: 0.05324968695640564 (4.029194042086601) | > loss_mel: 2.454355239868164 (12.671854019165039) | > loss_duration: 3.1162657737731934 (3.128969192504883) | > loss_1: 13.081064224243164 (27.129679679870605)  --> STEP: 3 | > loss_disc: 3.4988389015197754 (3.061574379603068) | > loss_disc_real_0: 0.3263567388057709 (0.20200490454832712) | > loss_disc_real_1: 0.2811572849750519 (0.25703058143456775) | > loss_disc_real_2: 0.23920801281929016 (0.25077330072720844) | > loss_disc_real_3: 0.2717697322368622 (0.29105960329373676) | > loss_disc_real_4: 0.3127519488334656 (0.30503854155540466) | > loss_disc_real_5: 0.21199671924114227 (0.2746313661336899) | > loss_0: 3.4988389015197754 (3.061574379603068) | > loss_gen: 1.3581019639968872 (1.7244333028793335) | > loss_kl: 2.435859441757202 (4.406662225723267) | > loss_feat: 2.4232332706451416 (3.493873784939448) | > loss_mel: 16.96591567993164 (14.10320790608724) | > loss_duration: 2.910698175430298 (3.0562121868133545) | > loss_1: 26.093809127807617 (26.78438949584961) --> EVAL PERFORMANCE | > avg_loader_time: 0.009655396143595377 (-0.014007012049357096) | > avg_loss_disc: 3.061574379603068 (+0.3285978635152178) | > avg_loss_disc_real_0: 0.20200490454832712 (+0.012910719960927963) | > avg_loss_disc_real_1: 0.25703058143456775 (-0.010172471404075623) | > avg_loss_disc_real_2: 0.25077330072720844 (-0.04185280203819275) | > avg_loss_disc_real_3: 0.29105960329373676 (-0.017223705848058102) | > avg_loss_disc_real_4: 0.30503854155540466 (+0.009329617023468018) | > avg_loss_disc_real_5: 0.2746313661336899 (-0.07487035294373828) | > avg_loss_0: 3.061574379603068 (+0.3285978635152178) | > avg_loss_gen: 1.7244333028793335 (-0.7707924445470176) | > avg_loss_kl: 4.406662225723267 (+0.10296217600504587) | > avg_loss_feat: 3.493873784939448 (-2.953340341647466) | > avg_loss_mel: 14.10320790608724 (-12.508914947509764) | > avg_loss_duration: 3.0562121868133545 (-0.12962524096171046) | > avg_loss_1: 26.78438949584961 (-16.25971221923828)  > EPOCH: 814/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:37:08)   --> TIME: 2023-10-20 09:37:27 -- STEP: 19/50 -- GLOBAL_STEP: 93720 | > loss_disc: 2.0049655437469482 (2.2967778632515357) | > loss_disc_real_0: 0.18985775113105774 (0.1556399704790429) | > loss_disc_real_1: 0.15302106738090515 (0.202622520688333) | > loss_disc_real_2: 0.20517006516456604 (0.20045996673013033) | > loss_disc_real_3: 0.38686662912368774 (0.22606924548745155) | > loss_disc_real_4: 0.31897038221359253 (0.20225906097575239) | > loss_disc_real_5: 0.26795694231987 (0.19316704453606354) | > loss_0: 2.0049655437469482 (2.2967778632515357) | > grad_norm_0: tensor(951.6460, device='cuda:0') (tensor(1334.5924, device='cuda:0')) | > loss_gen: 3.875535488128662 (2.4956031473059404) | > loss_kl: 0.8485940098762512 (0.9647769959349379) | > loss_feat: 9.834555625915527 (5.964868352013199) | > loss_mel: 26.924110412597656 (20.551160981780605) | > loss_duration: 1.5114638805389404 (1.4311666676872654) | > loss_1: 42.994258880615234 (31.407575983750192) | > grad_norm_1: tensor(190964.1250, device='cuda:0') (tensor(67523.5625, device='cuda:0')) | > current_lr_0: 8.861192899411266e-05 | > current_lr_1: 8.861192899411266e-05 | > step_time: 0.7112 (0.6489481424030504) | > loader_time: 0.0127 (0.020622592223317998)  --> TIME: 2023-10-20 09:37:47 -- STEP: 49/50 -- GLOBAL_STEP: 93750 | > loss_disc: 2.7211270332336426 (2.4221503199363243) | > loss_disc_real_0: 0.021551653742790222 (0.14300030829118832) | > loss_disc_real_1: 0.16741420328617096 (0.2256676753868862) | > loss_disc_real_2: 0.140188068151474 (0.21920860018961283) | > loss_disc_real_3: 0.20661157369613647 (0.24488020726308524) | > loss_disc_real_4: 0.13064321875572205 (0.225543650095256) | > loss_disc_real_5: 0.22293807566165924 (0.22460078959334262) | > loss_0: 2.7211270332336426 (2.4221503199363243) | > grad_norm_0: tensor(2224.0627, device='cuda:0') (tensor(1295.1830, device='cuda:0')) | > loss_gen: 1.5287888050079346 (2.3778800891370193) | > loss_kl: 0.7152593731880188 (0.8430028493915284) | > loss_feat: 3.4902262687683105 (5.5272198542192275) | > loss_mel: 22.041141510009766 (21.38603689962504) | > loss_duration: 1.510554313659668 (1.39394055337322) | > loss_1: 29.285972595214844 (31.52808024931927) | > grad_norm_1: tensor(15086.7852, device='cuda:0') (tensor(43426.3086, device='cuda:0')) | > current_lr_0: 8.861192899411266e-05 | > current_lr_1: 8.861192899411266e-05 | > step_time: 0.3792 (0.6455253241013502) | > loader_time: 0.4011 (0.028594279775814142)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4791245460510254 (2.4791245460510254) | > loss_disc_real_0: 0.16459548473358154 (0.16459548473358154) | > loss_disc_real_1: 0.2363031506538391 (0.2363031506538391) | > loss_disc_real_2: 0.26484107971191406 (0.26484107971191406) | > loss_disc_real_3: 0.27469733357429504 (0.27469733357429504) | > loss_disc_real_4: 0.14258280396461487 (0.14258280396461487) | > loss_disc_real_5: 0.16732577979564667 (0.16732577979564667) | > loss_0: 2.4791245460510254 (2.4791245460510254) | > loss_gen: 2.0696938037872314 (2.0696938037872314) | > loss_kl: 5.588009357452393 (5.588009357452393) | > loss_feat: 4.366319179534912 (4.366319179534912) | > loss_mel: 15.444766998291016 (15.444766998291016) | > loss_duration: 2.915942907333374 (2.915942907333374) | > loss_1: 30.384733200073242 (30.384733200073242)  --> STEP: 1 | > loss_disc: 2.275650978088379 (2.275650978088379) | > loss_disc_real_0: 0.08716662228107452 (0.08716662228107452) | > loss_disc_real_1: 0.1402827799320221 (0.1402827799320221) | > loss_disc_real_2: 0.24860289692878723 (0.24860289692878723) | > loss_disc_real_3: 0.12574119865894318 (0.12574119865894318) | > loss_disc_real_4: 0.3230649530887604 (0.3230649530887604) | > loss_disc_real_5: 0.11677070707082748 (0.11677070707082748) | > loss_0: 2.275650978088379 (2.275650978088379) | > loss_gen: 2.2081620693206787 (2.2081620693206787) | > loss_kl: 4.8930888175964355 (4.8930888175964355) | > loss_feat: 8.744173049926758 (8.744173049926758) | > loss_mel: 28.99044418334961 (28.99044418334961) | > loss_duration: 3.24249267578125 (3.24249267578125) | > loss_1: 48.07836151123047 (48.07836151123047)  --> STEP: 2 | > loss_disc: 2.942352771759033 (2.609001874923706) | > loss_disc_real_0: 0.3319278061389923 (0.20954721421003342) | > loss_disc_real_1: 0.272590309381485 (0.20643654465675354) | > loss_disc_real_2: 0.3049040138721466 (0.2767534554004669) | > loss_disc_real_3: 0.31134843826293945 (0.21854481846094131) | > loss_disc_real_4: 0.3109736740589142 (0.3170193135738373) | > loss_disc_real_5: 0.33121395111083984 (0.22399232909083366) | > loss_0: 2.942352771759033 (2.609001874923706) | > loss_gen: 2.2233753204345703 (2.2157686948776245) | > loss_kl: 5.809815406799316 (5.351452112197876) | > loss_feat: 2.4806771278381348 (5.612425088882446) | > loss_mel: 24.795427322387695 (26.892935752868652) | > loss_duration: 3.1218814849853516 (3.182187080383301) | > loss_1: 38.431175231933594 (43.25476837158203)  --> STEP: 3 | > loss_disc: 3.17728590965271 (2.7984298865000405) | > loss_disc_real_0: 0.2894326448440552 (0.23617569108804068) | > loss_disc_real_1: 0.2062438726425171 (0.20637232065200806) | > loss_disc_real_2: 0.20206508040428162 (0.25185733040173847) | > loss_disc_real_3: 0.26556307077407837 (0.234217569231987) | > loss_disc_real_4: 0.2161673903465271 (0.28340200583140057) | > loss_disc_real_5: 0.32609841227531433 (0.25802769015232724) | > loss_0: 3.17728590965271 (2.7984298865000405) | > loss_gen: 1.5651137828826904 (1.9988837242126465) | > loss_kl: 2.4019105434417725 (4.368271589279175) | > loss_feat: 3.3161299228668213 (4.846993366877238) | > loss_mel: 17.359996795654297 (23.7152894337972) | > loss_duration: 2.8596479892730713 (3.074674050013224) | > loss_1: 27.502798080444336 (38.00411160786947) --> EVAL PERFORMANCE | > avg_loader_time: 0.005921363830566406 (-0.0037340323130289708) | > avg_loss_disc: 2.7984298865000405 (-0.26314449310302734) | > avg_loss_disc_real_0: 0.23617569108804068 (+0.03417078653971356) | > avg_loss_disc_real_1: 0.20637232065200806 (-0.050658260782559694) | > avg_loss_disc_real_2: 0.25185733040173847 (+0.0010840296745300293) | > avg_loss_disc_real_3: 0.234217569231987 (-0.05684203406174976) | > avg_loss_disc_real_4: 0.28340200583140057 (-0.02163653572400409) | > avg_loss_disc_real_5: 0.25802769015232724 (-0.016603675981362642) | > avg_loss_0: 2.7984298865000405 (-0.26314449310302734) | > avg_loss_gen: 1.9988837242126465 (+0.274450421333313) | > avg_loss_kl: 4.368271589279175 (-0.0383906364440918) | > avg_loss_feat: 4.846993366877238 (+1.3531195819377904) | > avg_loss_mel: 23.7152894337972 (+9.61208152770996) | > avg_loss_duration: 3.074674050013224 (+0.018461863199869644) | > avg_loss_1: 38.00411160786947 (+11.21972211201986)  > EPOCH: 815/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:38:07)   --> TIME: 2023-10-20 09:38:39 -- STEP: 29/50 -- GLOBAL_STEP: 93780 | > loss_disc: 2.901064872741699 (2.403786971651275) | > loss_disc_real_0: 0.2563168406486511 (0.13965644109351885) | > loss_disc_real_1: 0.2610870599746704 (0.2129641736632791) | > loss_disc_real_2: 0.2544625699520111 (0.2303761406962214) | > loss_disc_real_3: 0.2433258444070816 (0.22245059984511342) | > loss_disc_real_4: 0.3066198527812958 (0.23515674330551048) | > loss_disc_real_5: 0.321826696395874 (0.21821221054114145) | > loss_0: 2.901064872741699 (2.403786971651275) | > grad_norm_0: tensor(931.5551, device='cuda:0') (tensor(1150.5507, device='cuda:0')) | > loss_gen: 1.7468284368515015 (2.2995784570430886) | > loss_kl: 0.9822961688041687 (0.8340296719608635) | > loss_feat: 0.37111184000968933 (5.318582759848956) | > loss_mel: 13.840041160583496 (21.711899296990758) | > loss_duration: 1.3295685052871704 (1.3922816884928737) | > loss_1: 18.269845962524414 (31.556371721728087) | > grad_norm_1: tensor(16302.4717, device='cuda:0') (tensor(38663.5586, device='cuda:0')) | > current_lr_0: 8.852335582314704e-05 | > current_lr_1: 8.852335582314704e-05 | > step_time: 0.8286 (0.6209390492274843) | > loader_time: 0.0268 (0.02418804168701172)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4923434257507324 (2.4923434257507324) | > loss_disc_real_0: 0.33554941415786743 (0.33554941415786743) | > loss_disc_real_1: 0.21627484261989594 (0.21627484261989594) | > loss_disc_real_2: 0.2774493396282196 (0.2774493396282196) | > loss_disc_real_3: 0.2894655168056488 (0.2894655168056488) | > loss_disc_real_4: 0.3001062273979187 (0.3001062273979187) | > loss_disc_real_5: 0.1822240948677063 (0.1822240948677063) | > loss_0: 2.4923434257507324 (2.4923434257507324) | > loss_gen: 2.946763753890991 (2.946763753890991) | > loss_kl: 5.495190143585205 (5.495190143585205) | > loss_feat: 5.797414302825928 (5.797414302825928) | > loss_mel: 21.043052673339844 (21.043052673339844) | > loss_duration: 2.865330696105957 (2.865330696105957) | > loss_1: 38.14774703979492 (38.14774703979492)  --> STEP: 1 | > loss_disc: 3.242654323577881 (3.242654323577881) | > loss_disc_real_0: 0.6323952674865723 (0.6323952674865723) | > loss_disc_real_1: 0.24961504340171814 (0.24961504340171814) | > loss_disc_real_2: 0.35152384638786316 (0.35152384638786316) | > loss_disc_real_3: 0.3574393391609192 (0.3574393391609192) | > loss_disc_real_4: 0.26584592461586 (0.26584592461586) | > loss_disc_real_5: 0.2902538776397705 (0.2902538776397705) | > loss_0: 3.242654323577881 (3.242654323577881) | > loss_gen: 2.4139761924743652 (2.4139761924743652) | > loss_kl: 5.5142621994018555 (5.5142621994018555) | > loss_feat: 2.690603494644165 (2.690603494644165) | > loss_mel: 20.768627166748047 (20.768627166748047) | > loss_duration: 3.314194440841675 (3.314194440841675) | > loss_1: 34.701663970947266 (34.701663970947266)  --> STEP: 2 | > loss_disc: 3.091921329498291 (3.167287826538086) | > loss_disc_real_0: 0.4225205183029175 (0.5274578928947449) | > loss_disc_real_1: 0.2879820168018341 (0.2687985301017761) | > loss_disc_real_2: 0.29681703448295593 (0.32417044043540955) | > loss_disc_real_3: 0.26308009028434753 (0.31025971472263336) | > loss_disc_real_4: 0.24641023576259613 (0.25612808018922806) | > loss_disc_real_5: 0.28955209255218506 (0.2899029850959778) | > loss_0: 3.091921329498291 (3.167287826538086) | > loss_gen: 1.7593591213226318 (2.0866676568984985) | > loss_kl: 5.715310096740723 (5.614786148071289) | > loss_feat: 0.12844353914260864 (1.4095235168933868) | > loss_mel: 1.8859809637069702 (11.327304065227509) | > loss_duration: 3.0665080547332764 (3.1903512477874756) | > loss_1: 12.555602073669434 (23.62863302230835)  --> STEP: 3 | > loss_disc: 3.1421773433685303 (3.1589176654815674) | > loss_disc_real_0: 0.6881749629974365 (0.5810302495956421) | > loss_disc_real_1: 0.268781453371048 (0.2687928378582001) | > loss_disc_real_2: 0.22399713099002838 (0.29077933728694916) | > loss_disc_real_3: 0.2824712097644806 (0.30099687973658246) | > loss_disc_real_4: 0.2500149607658386 (0.2540903737147649) | > loss_disc_real_5: 0.2534569799900055 (0.27775431672732037) | > loss_0: 3.1421773433685303 (3.1589176654815674) | > loss_gen: 2.0952036380767822 (2.0895129839579263) | > loss_kl: 2.2336220741271973 (4.487731456756592) | > loss_feat: 1.1203354597091675 (1.3131274978319805) | > loss_mel: 18.852388381958008 (13.835665504137674) | > loss_duration: 2.9616878032684326 (3.1141300996144614) | > loss_1: 27.26323699951172 (24.84016768137614) --> EVAL PERFORMANCE | > avg_loader_time: 0.00427548090616862 (-0.0016458829243977862) | > avg_loss_disc: 3.1589176654815674 (+0.36048777898152684) | > avg_loss_disc_real_0: 0.5810302495956421 (+0.3448545585076014) | > avg_loss_disc_real_1: 0.2687928378582001 (+0.06242051720619202) | > avg_loss_disc_real_2: 0.29077933728694916 (+0.03892200688521069) | > avg_loss_disc_real_3: 0.30099687973658246 (+0.06677931050459546) | > avg_loss_disc_real_4: 0.2540903737147649 (-0.029311632116635677) | > avg_loss_disc_real_5: 0.27775431672732037 (+0.019726626574993134) | > avg_loss_0: 3.1589176654815674 (+0.36048777898152684) | > avg_loss_gen: 2.0895129839579263 (+0.0906292597452798) | > avg_loss_kl: 4.487731456756592 (+0.11945986747741699) | > avg_loss_feat: 1.3131274978319805 (-3.5338658690452576) | > avg_loss_mel: 13.835665504137674 (-9.879623929659525) | > avg_loss_duration: 3.1141300996144614 (+0.039456049601237275) | > avg_loss_1: 24.84016768137614 (-13.163943926493328)  > EPOCH: 816/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:39:08)   --> TIME: 2023-10-20 09:39:20 -- STEP: 9/50 -- GLOBAL_STEP: 93810 | > loss_disc: 2.2246901988983154 (2.386243542035421) | > loss_disc_real_0: 0.3041066527366638 (0.15574327835606205) | > loss_disc_real_1: 0.20479656755924225 (0.21934062242507935) | > loss_disc_real_2: 0.26446452736854553 (0.20319929056697422) | > loss_disc_real_3: 0.25826165080070496 (0.21214677145083746) | > loss_disc_real_4: 0.08553141355514526 (0.18000136936704317) | > loss_disc_real_5: 0.17932532727718353 (0.19386433851387766) | > loss_0: 2.2246901988983154 (2.386243542035421) | > grad_norm_0: tensor(1299.6039, device='cuda:0') (tensor(955.7531, device='cuda:0')) | > loss_gen: 2.6063623428344727 (2.369865722126431) | > loss_kl: 0.7710433602333069 (0.9498021602630615) | > loss_feat: 5.515454292297363 (6.368667125701904) | > loss_mel: 23.962087631225586 (22.967782550387913) | > loss_duration: 1.3655459880828857 (1.3904521862665813) | > loss_1: 34.22049331665039 (34.04657003614638) | > grad_norm_1: tensor(11554.5879, device='cuda:0') (tensor(43180.8047, device='cuda:0')) | > current_lr_0: 8.843487118661131e-05 | > current_lr_1: 8.843487118661131e-05 | > step_time: 0.9785 (0.6797236601511637) | > loader_time: 0.0478 (0.020201259189181857)  --> TIME: 2023-10-20 09:39:40 -- STEP: 39/50 -- GLOBAL_STEP: 93840 | > loss_disc: 3.0161705017089844 (2.4954693928743024) | > loss_disc_real_0: 0.3347046673297882 (0.15362949373248297) | > loss_disc_real_1: 0.24779824912548065 (0.2291316025150128) | > loss_disc_real_2: 0.27711862325668335 (0.21499972542126974) | > loss_disc_real_3: 0.2601829171180725 (0.23691794180717224) | > loss_disc_real_4: 0.29940634965896606 (0.21046859245651808) | > loss_disc_real_5: 0.29443052411079407 (0.21701195902931383) | > loss_0: 3.0161705017089844 (2.4954693928743024) | > grad_norm_0: tensor(1093.9192, device='cuda:0') (tensor(1229.5481, device='cuda:0')) | > loss_gen: 1.716550588607788 (2.23229120633541) | > loss_kl: 0.6909155249595642 (0.8742293883592654) | > loss_feat: 0.04304450750350952 (5.39847718217434) | > loss_mel: 3.850916624069214 (20.91903486618629) | > loss_duration: 1.4437366724014282 (1.3835620238230781) | > loss_1: 7.745163440704346 (30.807594494941906) | > grad_norm_1: tensor(114340.6250, device='cuda:0') (tensor(38731.5820, device='cuda:0')) | > current_lr_0: 8.843487118661131e-05 | > current_lr_1: 8.843487118661131e-05 | > step_time: 0.3824 (0.6539538823641264) | > loader_time: 0.0279 (0.019480307896931965)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.539414167404175 (2.539414167404175) | > loss_disc_real_0: 0.4513661861419678 (0.4513661861419678) | > loss_disc_real_1: 0.32238441705703735 (0.32238441705703735) | > loss_disc_real_2: 0.27125483751296997 (0.27125483751296997) | > loss_disc_real_3: 0.16951513290405273 (0.16951513290405273) | > loss_disc_real_4: 0.2658509612083435 (0.2658509612083435) | > loss_disc_real_5: 0.18901458382606506 (0.18901458382606506) | > loss_0: 2.539414167404175 (2.539414167404175) | > loss_gen: 2.967698097229004 (2.967698097229004) | > loss_kl: 5.487038612365723 (5.487038612365723) | > loss_feat: 9.363261222839355 (9.363261222839355) | > loss_mel: 26.09705352783203 (26.09705352783203) | > loss_duration: 2.839442253112793 (2.839442253112793) | > loss_1: 46.754493713378906 (46.754493713378906)  --> STEP: 1 | > loss_disc: 2.874885082244873 (2.874885082244873) | > loss_disc_real_0: 0.37832021713256836 (0.37832021713256836) | > loss_disc_real_1: 0.3168274760246277 (0.3168274760246277) | > loss_disc_real_2: 0.31445541977882385 (0.31445541977882385) | > loss_disc_real_3: 0.353833943605423 (0.353833943605423) | > loss_disc_real_4: 0.22125855088233948 (0.22125855088233948) | > loss_disc_real_5: 0.34979045391082764 (0.34979045391082764) | > loss_0: 2.874885082244873 (2.874885082244873) | > loss_gen: 2.5047109127044678 (2.5047109127044678) | > loss_kl: 4.5702009201049805 (4.5702009201049805) | > loss_feat: 6.7180256843566895 (6.7180256843566895) | > loss_mel: 22.648759841918945 (22.648759841918945) | > loss_duration: 3.146637439727783 (3.146637439727783) | > loss_1: 39.58833694458008 (39.58833694458008)  --> STEP: 2 | > loss_disc: 2.8806352615356445 (2.877760171890259) | > loss_disc_real_0: 0.2741686999797821 (0.32624445855617523) | > loss_disc_real_1: 0.3077625036239624 (0.31229498982429504) | > loss_disc_real_2: 0.26917824149131775 (0.2918168306350708) | > loss_disc_real_3: 0.2670223116874695 (0.31042812764644623) | > loss_disc_real_4: 0.2399877905845642 (0.23062317073345184) | > loss_disc_real_5: 0.3132970929145813 (0.33154377341270447) | > loss_0: 2.8806352615356445 (2.877760171890259) | > loss_gen: 1.9582799673080444 (2.231495440006256) | > loss_kl: 5.483607292175293 (5.026904106140137) | > loss_feat: 2.10589599609375 (4.41196084022522) | > loss_mel: 23.596553802490234 (23.12265682220459) | > loss_duration: 2.986694812774658 (3.0666661262512207) | > loss_1: 36.13103103637695 (37.859683990478516)  --> STEP: 3 | > loss_disc: 3.0142085552215576 (2.923242966334025) | > loss_disc_real_0: 0.3232361674308777 (0.32524169484774273) | > loss_disc_real_1: 0.27073442935943604 (0.29844146966934204) | > loss_disc_real_2: 0.2691378593444824 (0.284257173538208) | > loss_disc_real_3: 0.23647846281528473 (0.2857782393693924) | > loss_disc_real_4: 0.28905269503593445 (0.25009967883427936) | > loss_disc_real_5: 0.3321501612663269 (0.3317459026972453) | > loss_0: 3.0142085552215576 (2.923242966334025) | > loss_gen: 1.7370576858520508 (2.0666828552881875) | > loss_kl: 2.6934704780578613 (4.249092896779378) | > loss_feat: 0.04348469525575638 (2.9558021252353988) | > loss_mel: 3.51778244972229 (16.587698698043823) | > loss_duration: 2.8765687942504883 (3.003300348917643) | > loss_1: 10.868364334106445 (28.862577438354492) --> EVAL PERFORMANCE | > avg_loader_time: 0.014440059661865234 (+0.010164578755696613) | > avg_loss_disc: 2.923242966334025 (-0.23567469914754247) | > avg_loss_disc_real_0: 0.32524169484774273 (-0.25578855474789935) | > avg_loss_disc_real_1: 0.29844146966934204 (+0.029648631811141968) | > avg_loss_disc_real_2: 0.284257173538208 (-0.00652216374874115) | > avg_loss_disc_real_3: 0.2857782393693924 (-0.015218640367190062) | > avg_loss_disc_real_4: 0.25009967883427936 (-0.003990694880485535) | > avg_loss_disc_real_5: 0.3317459026972453 (+0.05399158596992493) | > avg_loss_0: 2.923242966334025 (-0.23567469914754247) | > avg_loss_gen: 2.0666828552881875 (-0.02283012866973877) | > avg_loss_kl: 4.249092896779378 (-0.23863855997721384) | > avg_loss_feat: 2.9558021252353988 (+1.6426746274034183) | > avg_loss_mel: 16.587698698043823 (+2.752033193906149) | > avg_loss_duration: 3.003300348917643 (-0.11082975069681833) | > avg_loss_1: 28.862577438354492 (+4.022409756978352)  > EPOCH: 817/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:40:01)   --> TIME: 2023-10-20 09:40:19 -- STEP: 19/50 -- GLOBAL_STEP: 93870 | > loss_disc: 1.3910040855407715 (2.593139159051996) | > loss_disc_real_0: 0.0629878044128418 (0.1892020011712846) | > loss_disc_real_1: 0.11966124176979065 (0.24795940067423017) | > loss_disc_real_2: 0.08928350359201431 (0.24390407573235662) | > loss_disc_real_3: 0.3102514445781708 (0.2546256784545748) | > loss_disc_real_4: 0.09324230253696442 (0.2349541995086168) | > loss_disc_real_5: 0.14104367792606354 (0.2510277934764561) | > loss_0: 1.3910040855407715 (2.593139159051996) | > grad_norm_0: tensor(1427.7809, device='cuda:0') (tensor(1559.6516, device='cuda:0')) | > loss_gen: 3.5476603507995605 (2.2331145437140214) | > loss_kl: 0.9068634510040283 (0.8949335029250697) | > loss_feat: 9.6470365524292 (4.163147476942916) | > loss_mel: 23.140594482421875 (18.029047464069567) | > loss_duration: 1.5385282039642334 (1.4076229271135832) | > loss_1: 38.78068542480469 (26.727865846533525) | > grad_norm_1: tensor(108175.8203, device='cuda:0') (tensor(36667.2891, device='cuda:0')) | > current_lr_0: 8.834647499600977e-05 | > current_lr_1: 8.834647499600977e-05 | > step_time: 0.5721 (0.608388110211021) | > loader_time: 0.0162 (0.02122723428826583)  --> TIME: 2023-10-20 09:40:32 -- STEP: 49/50 -- GLOBAL_STEP: 93900 | > loss_disc: 2.724682092666626 (2.5685953947962545) | > loss_disc_real_0: 0.16827672719955444 (0.17697564560007684) | > loss_disc_real_1: 0.2175552248954773 (0.23091779375562863) | > loss_disc_real_2: 0.19978830218315125 (0.23696638096352013) | > loss_disc_real_3: 0.1616963893175125 (0.24586290318746956) | > loss_disc_real_4: 0.2335612177848816 (0.23150211310356247) | > loss_disc_real_5: 0.23371168971061707 (0.2305993227934351) | > loss_0: 2.724682092666626 (2.5685953947962545) | > grad_norm_0: tensor(1133.4554, device='cuda:0') (tensor(1472.6304, device='cuda:0')) | > loss_gen: 1.604561686515808 (2.207367619689631) | > loss_kl: 0.4771313965320587 (0.8650703840717977) | > loss_feat: 2.4217727184295654 (4.654826243769148) | > loss_mel: 9.415582656860352 (18.46494356466799) | > loss_duration: 1.4901338815689087 (1.3724114797553237) | > loss_1: 15.40918254852295 (27.56461920057024) | > grad_norm_1: tensor(32501.5762, device='cuda:0') (tensor(36516.9766, device='cuda:0')) | > current_lr_0: 8.834647499600977e-05 | > current_lr_1: 8.834647499600977e-05 | > step_time: 0.3139 (0.48682346149366756) | > loader_time: 0.3886 (0.022357167029867366)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.575350046157837 (2.575350046157837) | > loss_disc_real_0: 0.2953755855560303 (0.2953755855560303) | > loss_disc_real_1: 0.2773767411708832 (0.2773767411708832) | > loss_disc_real_2: 0.20394659042358398 (0.20394659042358398) | > loss_disc_real_3: 0.22772155702114105 (0.22772155702114105) | > loss_disc_real_4: 0.12061063945293427 (0.12061063945293427) | > loss_disc_real_5: 0.23611590266227722 (0.23611590266227722) | > loss_0: 2.575350046157837 (2.575350046157837) | > loss_gen: 2.326395034790039 (2.326395034790039) | > loss_kl: 4.814153671264648 (4.814153671264648) | > loss_feat: 5.120474815368652 (5.120474815368652) | > loss_mel: 26.1607723236084 (26.1607723236084) | > loss_duration: 2.885322332382202 (2.885322332382202) | > loss_1: 41.30712127685547 (41.30712127685547)  --> STEP: 1 | > loss_disc: 2.5349574089050293 (2.5349574089050293) | > loss_disc_real_0: 0.03833130747079849 (0.03833130747079849) | > loss_disc_real_1: 0.2438398003578186 (0.2438398003578186) | > loss_disc_real_2: 0.2533765137195587 (0.2533765137195587) | > loss_disc_real_3: 0.2656818926334381 (0.2656818926334381) | > loss_disc_real_4: 0.36480429768562317 (0.36480429768562317) | > loss_disc_real_5: 0.3781743049621582 (0.3781743049621582) | > loss_0: 2.5349574089050293 (2.5349574089050293) | > loss_gen: 2.2499077320098877 (2.2499077320098877) | > loss_kl: 4.641462802886963 (4.641462802886963) | > loss_feat: 3.873775005340576 (3.873775005340576) | > loss_mel: 24.22725486755371 (24.22725486755371) | > loss_duration: 3.2656326293945312 (3.2656326293945312) | > loss_1: 38.258033752441406 (38.258033752441406)  --> STEP: 2 | > loss_disc: 2.854703664779663 (2.694830536842346) | > loss_disc_real_0: 0.2155112773180008 (0.12692129239439964) | > loss_disc_real_1: 0.3248824179172516 (0.2843611091375351) | > loss_disc_real_2: 0.33356979489326477 (0.29347315430641174) | > loss_disc_real_3: 0.36538559198379517 (0.31553374230861664) | > loss_disc_real_4: 0.1262669563293457 (0.24553562700748444) | > loss_disc_real_5: 0.1481606513261795 (0.26316747814416885) | > loss_0: 2.854703664779663 (2.694830536842346) | > loss_gen: 2.5975446701049805 (2.423726201057434) | > loss_kl: 5.758268356323242 (5.1998655796051025) | > loss_feat: 8.966083526611328 (6.419929265975952) | > loss_mel: 22.842485427856445 (23.534870147705078) | > loss_duration: 3.1086227893829346 (3.187127709388733) | > loss_1: 43.273006439208984 (40.765520095825195)  --> STEP: 3 | > loss_disc: 2.7913284301757812 (2.7269965012868247) | > loss_disc_real_0: 0.5171610116958618 (0.25700119882822037) | > loss_disc_real_1: 0.20151543617248535 (0.25674588481585187) | > loss_disc_real_2: 0.17992880940437317 (0.25562503933906555) | > loss_disc_real_3: 0.16205444931983948 (0.26437397797902423) | > loss_disc_real_4: 0.22602830827236176 (0.2390331874291102) | > loss_disc_real_5: 0.24562200903892517 (0.25731898844242096) | > loss_0: 2.7913284301757812 (2.7269965012868247) | > loss_gen: 3.1317496299743652 (2.659734010696411) | > loss_kl: 2.3804285526275635 (4.260053237279256) | > loss_feat: 7.931077480316162 (6.9236453374226885) | > loss_mel: 24.591304779052734 (23.887015024820965) | > loss_duration: 2.909167766571045 (3.0944743951161704) | > loss_1: 40.9437255859375 (40.82492192586263) --> EVAL PERFORMANCE | > avg_loader_time: 0.019635518391927082 (+0.005195458730061848) | > avg_loss_disc: 2.7269965012868247 (-0.19624646504720022) | > avg_loss_disc_real_0: 0.25700119882822037 (-0.06824049601952237) | > avg_loss_disc_real_1: 0.25674588481585187 (-0.041695584853490175) | > avg_loss_disc_real_2: 0.25562503933906555 (-0.028632134199142456) | > avg_loss_disc_real_3: 0.26437397797902423 (-0.021404261390368162) | > avg_loss_disc_real_4: 0.2390331874291102 (-0.01106649140516916) | > avg_loss_disc_real_5: 0.25731898844242096 (-0.07442691425482434) | > avg_loss_0: 2.7269965012868247 (-0.19624646504720022) | > avg_loss_gen: 2.659734010696411 (+0.5930511554082236) | > avg_loss_kl: 4.260053237279256 (+0.01096034049987793) | > avg_loss_feat: 6.9236453374226885 (+3.9678432121872897) | > avg_loss_mel: 23.887015024820965 (+7.2993163267771415) | > avg_loss_duration: 3.0944743951161704 (+0.09117404619852731) | > avg_loss_1: 40.82492192586263 (+11.96234448750814)  > EPOCH: 818/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:40:52)   --> TIME: 2023-10-20 09:41:15 -- STEP: 29/50 -- GLOBAL_STEP: 93930 | > loss_disc: 2.762463092803955 (2.563680389831806) | > loss_disc_real_0: 0.30279451608657837 (0.16106981222100297) | > loss_disc_real_1: 0.21488606929779053 (0.23250355314591836) | > loss_disc_real_2: 0.1728115826845169 (0.22105039270787402) | > loss_disc_real_3: 0.2094130516052246 (0.25228308873443767) | > loss_disc_real_4: 0.2462262213230133 (0.2264111079275608) | > loss_disc_real_5: 0.23640379309654236 (0.22688784103455215) | > loss_0: 2.762463092803955 (2.563680389831806) | > grad_norm_0: tensor(1408.5214, device='cuda:0') (tensor(1198.9432, device='cuda:0')) | > loss_gen: 1.669356107711792 (2.179567546680056) | > loss_kl: 0.8543515801429749 (0.9537040293216705) | > loss_feat: 1.4023255109786987 (4.309159764185034) | > loss_mel: 15.152909278869629 (17.805053147776373) | > loss_duration: 1.3515700101852417 (1.3898171186447144) | > loss_1: 20.430511474609375 (26.637301428564662) | > grad_norm_1: tensor(10386.4160, device='cuda:0') (tensor(40694.1367, device='cuda:0')) | > current_lr_0: 8.825816716293515e-05 | > current_lr_1: 8.825816716293515e-05 | > step_time: 0.3325 (0.4894794760079217) | > loader_time: 0.0064 (0.013656065381806472)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.622495174407959 (2.622495174407959) | > loss_disc_real_0: 0.1486443132162094 (0.1486443132162094) | > loss_disc_real_1: 0.2986834645271301 (0.2986834645271301) | > loss_disc_real_2: 0.34440210461616516 (0.34440210461616516) | > loss_disc_real_3: 0.30725517868995667 (0.30725517868995667) | > loss_disc_real_4: 0.29825547337532043 (0.29825547337532043) | > loss_disc_real_5: 0.44255203008651733 (0.44255203008651733) | > loss_0: 2.622495174407959 (2.622495174407959) | > loss_gen: 2.898383140563965 (2.898383140563965) | > loss_kl: 4.509763717651367 (4.509763717651367) | > loss_feat: 5.779646396636963 (5.779646396636963) | > loss_mel: 22.50106430053711 (22.50106430053711) | > loss_duration: 2.963535785675049 (2.963535785675049) | > loss_1: 38.65239334106445 (38.65239334106445)  --> STEP: 1 | > loss_disc: 2.792555093765259 (2.792555093765259) | > loss_disc_real_0: 0.17585302889347076 (0.17585302889347076) | > loss_disc_real_1: 0.23344628512859344 (0.23344628512859344) | > loss_disc_real_2: 0.3859829008579254 (0.3859829008579254) | > loss_disc_real_3: 0.22756390273571014 (0.22756390273571014) | > loss_disc_real_4: 0.2790535092353821 (0.2790535092353821) | > loss_disc_real_5: 0.325270414352417 (0.325270414352417) | > loss_0: 2.792555093765259 (2.792555093765259) | > loss_gen: 2.134441375732422 (2.134441375732422) | > loss_kl: 5.147301197052002 (5.147301197052002) | > loss_feat: 2.956892728805542 (2.956892728805542) | > loss_mel: 19.43545150756836 (19.43545150756836) | > loss_duration: 3.1510090827941895 (3.1510090827941895) | > loss_1: 32.825096130371094 (32.825096130371094)  --> STEP: 2 | > loss_disc: 2.9886388778686523 (2.8905969858169556) | > loss_disc_real_0: 0.45954248309135437 (0.31769775599241257) | > loss_disc_real_1: 0.2700345516204834 (0.2517404183745384) | > loss_disc_real_2: 0.2584357261657715 (0.32220931351184845) | > loss_disc_real_3: 0.40782204270362854 (0.31769297271966934) | > loss_disc_real_4: 0.2911023795604706 (0.28507794439792633) | > loss_disc_real_5: 0.25846579670906067 (0.29186810553073883) | > loss_0: 2.9886388778686523 (2.8905969858169556) | > loss_gen: 2.263298511505127 (2.1988699436187744) | > loss_kl: 5.649363994598389 (5.398332595825195) | > loss_feat: 5.494482517242432 (4.225687623023987) | > loss_mel: 23.76746940612793 (21.601460456848145) | > loss_duration: 3.1399996280670166 (3.145504355430603) | > loss_1: 40.314613342285156 (36.569854736328125)  --> STEP: 3 | > loss_disc: 3.549286127090454 (3.1101600329081216) | > loss_disc_real_0: 0.35731345415115356 (0.3309029887119929) | > loss_disc_real_1: 0.3803918957710266 (0.2946242441733678) | > loss_disc_real_2: 0.2558775544166565 (0.3000987271467845) | > loss_disc_real_3: 0.2988700270652771 (0.3114186575015386) | > loss_disc_real_4: 0.3610430955886841 (0.31039966146151227) | > loss_disc_real_5: 0.4167023003101349 (0.33347950379053753) | > loss_0: 3.549286127090454 (3.1101600329081216) | > loss_gen: 1.8257393836975098 (2.074493090311686) | > loss_kl: 2.4328246116638184 (4.409829934438069) | > loss_feat: 3.372610092163086 (3.941328446070353) | > loss_mel: 18.882905960083008 (20.695275624593098) | > loss_duration: 2.9430909156799316 (3.078033208847046) | > loss_1: 29.457170486450195 (34.19895998636881) --> EVAL PERFORMANCE | > avg_loader_time: 0.007692495981852214 (-0.011943022410074867) | > avg_loss_disc: 3.1101600329081216 (+0.3831635316212969) | > avg_loss_disc_real_0: 0.3309029887119929 (+0.07390178988377255) | > avg_loss_disc_real_1: 0.2946242441733678 (+0.037878359357515934) | > avg_loss_disc_real_2: 0.3000987271467845 (+0.04447368780771893) | > avg_loss_disc_real_3: 0.3114186575015386 (+0.04704467952251434) | > avg_loss_disc_real_4: 0.31039966146151227 (+0.07136647403240207) | > avg_loss_disc_real_5: 0.33347950379053753 (+0.07616051534811658) | > avg_loss_0: 3.1101600329081216 (+0.3831635316212969) | > avg_loss_gen: 2.074493090311686 (-0.5852409203847251) | > avg_loss_kl: 4.409829934438069 (+0.14977669715881348) | > avg_loss_feat: 3.941328446070353 (-2.9823168913523355) | > avg_loss_mel: 20.695275624593098 (-3.191739400227867) | > avg_loss_duration: 3.078033208847046 (-0.016441186269124497) | > avg_loss_1: 34.19895998636881 (-6.62596193949382)  > EPOCH: 819/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:41:41)   --> TIME: 2023-10-20 09:41:53 -- STEP: 9/50 -- GLOBAL_STEP: 93960 | > loss_disc: 2.8774325847625732 (2.361631605360243) | > loss_disc_real_0: 0.16240765154361725 (0.16100992676284578) | > loss_disc_real_1: 0.2285747230052948 (0.2299524980286757) | > loss_disc_real_2: 0.24980278313159943 (0.24059872867332566) | > loss_disc_real_3: 0.25495609641075134 (0.22649402833647198) | > loss_disc_real_4: 0.28211838006973267 (0.20982748311426905) | > loss_disc_real_5: 0.2776571810245514 (0.20044520290361512) | > loss_0: 2.8774325847625732 (2.361631605360243) | > grad_norm_0: tensor(824.1595, device='cuda:0') (tensor(826.4046, device='cuda:0')) | > loss_gen: 1.6310176849365234 (2.3407039244969687) | > loss_kl: 0.7991535663604736 (0.6719855931070116) | > loss_feat: 0.8353490829467773 (5.003335733380583) | > loss_mel: 18.264297485351562 (16.97025916311476) | > loss_duration: 1.3718081712722778 (1.406605111228095) | > loss_1: 22.901626586914062 (26.392889552646214) | > grad_norm_1: tensor(10961.0859, device='cuda:0') (tensor(35192.7695, device='cuda:0')) | > current_lr_0: 8.816994759906859e-05 | > current_lr_1: 8.816994759906859e-05 | > step_time: 0.83 (0.6638713147905138) | > loader_time: 0.0303 (0.02300254503885905)  --> TIME: 2023-10-20 09:42:14 -- STEP: 39/50 -- GLOBAL_STEP: 93990 | > loss_disc: 1.7983558177947998 (2.480157130803817) | > loss_disc_real_0: 0.025330252945423126 (0.15599763044753134) | > loss_disc_real_1: 0.12319900095462799 (0.22777225583409652) | > loss_disc_real_2: 0.03126918897032738 (0.22809129370710787) | > loss_disc_real_3: 0.09133998304605484 (0.22039043807830566) | > loss_disc_real_4: 0.05848221480846405 (0.22871736527826542) | > loss_disc_real_5: 0.01675054244697094 (0.24292553956500995) | > loss_0: 1.7983558177947998 (2.480157130803817) | > grad_norm_0: tensor(539.4424, device='cuda:0') (tensor(1087.8961, device='cuda:0')) | > loss_gen: 2.501595973968506 (2.318238524290231) | > loss_kl: 0.4810495674610138 (0.7868411197112156) | > loss_feat: 10.20063591003418 (5.504093657892484) | > loss_mel: 30.469078063964844 (20.65376513737898) | > loss_duration: 1.3846516609191895 (1.3734344427402203) | > loss_1: 45.037010192871094 (30.636372725168865) | > grad_norm_1: tensor(41269.8945, device='cuda:0') (tensor(33791.2969, device='cuda:0')) | > current_lr_0: 8.816994759906859e-05 | > current_lr_1: 8.816994759906859e-05 | > step_time: 0.3457 (0.6574291388193768) | > loader_time: 0.0057 (0.02397631987547263)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9086854457855225 (2.9086854457855225) | > loss_disc_real_0: 0.14605610072612762 (0.14605610072612762) | > loss_disc_real_1: 0.34531688690185547 (0.34531688690185547) | > loss_disc_real_2: 0.2285601794719696 (0.2285601794719696) | > loss_disc_real_3: 0.25681430101394653 (0.25681430101394653) | > loss_disc_real_4: 0.23401159048080444 (0.23401159048080444) | > loss_disc_real_5: 0.25671565532684326 (0.25671565532684326) | > loss_0: 2.9086854457855225 (2.9086854457855225) | > loss_gen: 1.6241309642791748 (1.6241309642791748) | > loss_kl: 4.680260181427002 (4.680260181427002) | > loss_feat: 2.1528236865997314 (2.1528236865997314) | > loss_mel: 19.50452995300293 (19.50452995300293) | > loss_duration: 2.859199285507202 (2.859199285507202) | > loss_1: 30.82094383239746 (30.82094383239746)  --> STEP: 1 | > loss_disc: 2.7100563049316406 (2.7100563049316406) | > loss_disc_real_0: 0.06765855848789215 (0.06765855848789215) | > loss_disc_real_1: 0.2669502794742584 (0.2669502794742584) | > loss_disc_real_2: 0.20437319576740265 (0.20437319576740265) | > loss_disc_real_3: 0.31195980310440063 (0.31195980310440063) | > loss_disc_real_4: 0.23796798288822174 (0.23796798288822174) | > loss_disc_real_5: 0.2997947037220001 (0.2997947037220001) | > loss_0: 2.7100563049316406 (2.7100563049316406) | > loss_gen: 1.7927988767623901 (1.7927988767623901) | > loss_kl: 4.922009468078613 (4.922009468078613) | > loss_feat: 2.293811321258545 (2.293811321258545) | > loss_mel: 21.049592971801758 (21.049592971801758) | > loss_duration: 3.404550313949585 (3.404550313949585) | > loss_1: 33.46276092529297 (33.46276092529297)  --> STEP: 2 | > loss_disc: 3.88261079788208 (3.2963335514068604) | > loss_disc_real_0: 0.36279040575027466 (0.2152244821190834) | > loss_disc_real_1: 0.4050719141960144 (0.3360110968351364) | > loss_disc_real_2: 0.4486428499221802 (0.3265080228447914) | > loss_disc_real_3: 0.2813567817211151 (0.2966582924127579) | > loss_disc_real_4: 0.29500705003738403 (0.2664875164628029) | > loss_disc_real_5: 0.4477404057979584 (0.37376755475997925) | > loss_0: 3.88261079788208 (3.2963335514068604) | > loss_gen: 1.617154598236084 (1.704976737499237) | > loss_kl: 5.129322052001953 (5.025665760040283) | > loss_feat: 6.315634250640869 (4.304722785949707) | > loss_mel: 26.09876823425293 (23.574180603027344) | > loss_duration: 3.1253585815429688 (3.264954447746277) | > loss_1: 42.28623580932617 (37.87449836730957)  --> STEP: 3 | > loss_disc: 2.8252928256988525 (3.139319976170858) | > loss_disc_real_0: 0.22079098224639893 (0.2170799821615219) | > loss_disc_real_1: 0.3282281458377838 (0.33341677983601886) | > loss_disc_real_2: 0.23359476029872894 (0.29553693532943726) | > loss_disc_real_3: 0.35596510767936707 (0.31642723083496094) | > loss_disc_real_4: 0.3182665705680847 (0.2837472011645635) | > loss_disc_real_5: 0.36147013306617737 (0.3696684141953786) | > loss_0: 2.8252928256988525 (3.139319976170858) | > loss_gen: 2.4315712451934814 (1.9471749067306519) | > loss_kl: 2.2937705516815186 (4.115034023920695) | > loss_feat: 4.244140625 (4.284528732299805) | > loss_mel: 22.573259353637695 (23.24054018656413) | > loss_duration: 2.8266799449920654 (3.1188629468282065) | > loss_1: 34.369422912597656 (36.7061398824056) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_94000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2945713996887207 (2.9281328320503235) | > loss_disc_real_0: 0.11656828969717026 (0.191952059045434) | > loss_disc_real_1: 0.2507849931716919 (0.31275883316993713) | > loss_disc_real_2: 0.1956300437450409 (0.27056021243333817) | > loss_disc_real_3: 0.2592344582080841 (0.30212903767824173) | > loss_disc_real_4: 0.1892753541469574 (0.26012923941016197) | > loss_disc_real_5: 0.17781567573547363 (0.3217052295804024) | > loss_0: 2.2945713996887207 (2.9281328320503235) | > loss_gen: 2.2335002422332764 (2.018756240606308) | > loss_kl: 4.263399600982666 (4.152125418186188) | > loss_feat: 7.388633728027344 (5.0605549812316895) | > loss_mel: 24.58258819580078 (23.57605218887329) | > loss_duration: 2.9033942222595215 (3.064995765686035) | > loss_1: 41.37151336669922 (37.872483253479004)  --> STEP: 1 | > loss_disc: 2.298034429550171 (2.802113151550293) | > loss_disc_real_0: 0.05909620225429535 (0.16538088768720627) | > loss_disc_real_1: 0.1845339983701706 (0.2871138662099838) | > loss_disc_real_2: 0.19741523265838623 (0.25593121647834777) | > loss_disc_real_3: 0.3884987533092499 (0.31940298080444335) | > loss_disc_real_4: 0.3317641317844391 (0.2744562178850174) | > loss_disc_real_5: 0.17000935971736908 (0.2913660556077957) | > loss_0: 2.298034429550171 (2.802113151550293) | > loss_gen: 2.62231707572937 (2.1394684076309205) | > loss_kl: 4.926011085510254 (4.306902551651001) | > loss_feat: 7.280727863311768 (5.504589557647705) | > loss_mel: 24.048664093017578 (23.670574569702147) | > loss_duration: 3.3894190788269043 (3.129880428314209) | > loss_1: 42.26713943481445 (38.7514144897461)  --> STEP: 2 | > loss_disc: 2.2316036224365234 (2.7070282300313315) | > loss_disc_real_0: 0.24179378151893616 (0.17811636999249458) | > loss_disc_real_1: 0.25351178646087646 (0.2815135195851326) | > loss_disc_real_2: 0.2033292055130005 (0.2471642146507899) | > loss_disc_real_3: 0.36974623799324036 (0.32779352366924286) | > loss_disc_real_4: 0.19348707795143127 (0.2609613612294197) | > loss_disc_real_5: 0.15019018948078156 (0.2678367445866267) | > loss_0: 2.2316036224365234 (2.7070282300313315) | > loss_gen: 2.837759017944336 (2.2558501760164895) | > loss_kl: 5.072613716125488 (4.4345210790634155) | > loss_feat: 8.30029582977295 (5.970540603001912) | > loss_mel: 22.135114669799805 (23.41466458638509) | > loss_duration: 3.0430009365081787 (3.115400513013204) | > loss_1: 41.38878631591797 (39.19097646077474)  --> STEP: 3 | > loss_disc: 2.952770709991455 (2.742134298597063) | > loss_disc_real_0: 0.36494576930999756 (0.20480628418070929) | > loss_disc_real_1: 0.2409738302230835 (0.2757221353905542) | > loss_disc_real_2: 0.16285426914691925 (0.2351199367216655) | > loss_disc_real_3: 0.3273009657859802 (0.3277231582573482) | > loss_disc_real_4: 0.2805643677711487 (0.263761790735381) | > loss_disc_real_5: 0.47912895679473877 (0.2980213463306427) | > loss_0: 2.952770709991455 (2.742134298597063) | > loss_gen: 2.184863805770874 (2.2457092659814015) | > loss_kl: 2.1973793506622314 (4.114929403577532) | > loss_feat: 4.063917636871338 (5.6981658935546875) | > loss_mel: 20.924468994140625 (23.058922358921595) | > loss_duration: 2.923679828643799 (3.0880118438175748) | > loss_1: 32.2943115234375 (38.20573861258371) --> EVAL PERFORMANCE | > avg_loader_time: 0.7551295757293701 (+0.7474370797475179) | > avg_loss_disc: 2.742134298597063 (-0.36802573431105845) | > avg_loss_disc_real_0: 0.20480628418070929 (-0.12609670453128363) | > avg_loss_disc_real_1: 0.2757221353905542 (-0.01890210878281362) | > avg_loss_disc_real_2: 0.2351199367216655 (-0.06497879042511898) | > avg_loss_disc_real_3: 0.3277231582573482 (+0.016304500755809637) | > avg_loss_disc_real_4: 0.263761790735381 (-0.04663787072613129) | > avg_loss_disc_real_5: 0.2980213463306427 (-0.035458157459894835) | > avg_loss_0: 2.742134298597063 (-0.36802573431105845) | > avg_loss_gen: 2.2457092659814015 (+0.17121617566971548) | > avg_loss_kl: 4.114929403577532 (-0.294900530860537) | > avg_loss_feat: 5.6981658935546875 (+1.7568374474843345) | > avg_loss_mel: 23.058922358921595 (+2.3636467343284977) | > avg_loss_duration: 3.0880118438175748 (+0.009978634970528866) | > avg_loss_1: 38.20573861258371 (+4.006778626214896)  > EPOCH: 820/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:42:41)   --> TIME: 2023-10-20 09:42:58 -- STEP: 19/50 -- GLOBAL_STEP: 94020 | > loss_disc: 3.1096670627593994 (2.368622064590454) | > loss_disc_real_0: 0.6382346153259277 (0.17093127103228317) | > loss_disc_real_1: 0.35745444893836975 (0.21391410625686771) | > loss_disc_real_2: 0.1949329376220703 (0.20410894720177902) | > loss_disc_real_3: 0.47535809874534607 (0.23075890139137445) | > loss_disc_real_4: 0.4237535893917084 (0.19438597618749268) | > loss_disc_real_5: 0.4905136227607727 (0.19551258563603224) | > loss_0: 3.1096670627593994 (2.368622064590454) | > grad_norm_0: tensor(2057.6172, device='cuda:0') (tensor(1074.1007, device='cuda:0')) | > loss_gen: 3.288966417312622 (2.458288418619256) | > loss_kl: 0.5506666302680969 (0.7944042698333138) | > loss_feat: 4.018531799316406 (6.814727484493663) | > loss_mel: 19.97808074951172 (19.648444784315007) | > loss_duration: 1.4675191640853882 (1.41795635850806) | > loss_1: 29.30376625061035 (31.133821462330065) | > grad_norm_1: tensor(44194.0625, device='cuda:0') (tensor(54471.4922, device='cuda:0')) | > current_lr_0: 8.808181621617948e-05 | > current_lr_1: 8.808181621617948e-05 | > step_time: 0.5444 (0.5817966712148566) | > loader_time: 0.007 (0.02475384662025853)  --> TIME: 2023-10-20 09:43:17 -- STEP: 49/50 -- GLOBAL_STEP: 94050 | > loss_disc: 2.742072105407715 (2.363265414627231) | > loss_disc_real_0: 0.15202882885932922 (0.15003183527792596) | > loss_disc_real_1: 0.21803030371665955 (0.22289126461409792) | > loss_disc_real_2: 0.23284047842025757 (0.2166720856057138) | > loss_disc_real_3: 0.26306721568107605 (0.22924958553393276) | > loss_disc_real_4: 0.3132206201553345 (0.20952538264041043) | > loss_disc_real_5: 0.40882712602615356 (0.19327036637280667) | > loss_0: 2.742072105407715 (2.363265414627231) | > grad_norm_0: tensor(1251.9366, device='cuda:0') (tensor(1069.3551, device='cuda:0')) | > loss_gen: 2.104581594467163 (2.4174719659649604) | > loss_kl: 0.6613919734954834 (0.8211139543932311) | > loss_feat: 2.309230089187622 (6.093339326088222) | > loss_mel: 12.384414672851562 (19.825203966121293) | > loss_duration: 1.4631465673446655 (1.3802228947075046) | > loss_1: 18.92276382446289 (30.537352124039007) | > grad_norm_1: tensor(65765.3984, device='cuda:0') (tensor(53331.1016, device='cuda:0')) | > current_lr_0: 8.808181621617948e-05 | > current_lr_1: 8.808181621617948e-05 | > step_time: 0.4396 (0.5911997970269649) | > loader_time: 0.5416 (0.032972914831978936)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8328399658203125 (2.8328399658203125) | > loss_disc_real_0: 0.19117328524589539 (0.19117328524589539) | > loss_disc_real_1: 0.24805645644664764 (0.24805645644664764) | > loss_disc_real_2: 0.2701011002063751 (0.2701011002063751) | > loss_disc_real_3: 0.28711625933647156 (0.28711625933647156) | > loss_disc_real_4: 0.4258421063423157 (0.4258421063423157) | > loss_disc_real_5: 0.4220539927482605 (0.4220539927482605) | > loss_0: 2.8328399658203125 (2.8328399658203125) | > loss_gen: 2.318723201751709 (2.318723201751709) | > loss_kl: 5.11962890625 (5.11962890625) | > loss_feat: 4.655680179595947 (4.655680179595947) | > loss_mel: 22.589649200439453 (22.589649200439453) | > loss_duration: 2.873725652694702 (2.873725652694702) | > loss_1: 37.55740737915039 (37.55740737915039)  --> STEP: 1 | > loss_disc: 2.2078676223754883 (2.2078676223754883) | > loss_disc_real_0: 0.15844613313674927 (0.15844613313674927) | > loss_disc_real_1: 0.08706428855657578 (0.08706428855657578) | > loss_disc_real_2: 0.07199567556381226 (0.07199567556381226) | > loss_disc_real_3: 0.11400792002677917 (0.11400792002677917) | > loss_disc_real_4: 0.08170104026794434 (0.08170104026794434) | > loss_disc_real_5: 0.05105262249708176 (0.05105262249708176) | > loss_0: 2.2078676223754883 (2.2078676223754883) | > loss_gen: 1.5707049369812012 (1.5707049369812012) | > loss_kl: 5.096230983734131 (5.096230983734131) | > loss_feat: 10.766542434692383 (10.766542434692383) | > loss_mel: 27.0151309967041 (27.0151309967041) | > loss_duration: 3.1848626136779785 (3.1848626136779785) | > loss_1: 47.63347625732422 (47.63347625732422)  --> STEP: 2 | > loss_disc: 2.167008399963379 (2.1874380111694336) | > loss_disc_real_0: 0.2819633185863495 (0.22020472586154938) | > loss_disc_real_1: 0.24296653270721436 (0.16501541063189507) | > loss_disc_real_2: 0.2256491333246231 (0.14882240444421768) | > loss_disc_real_3: 0.2931055724620819 (0.20355674624443054) | > loss_disc_real_4: 0.169230654835701 (0.12546584755182266) | > loss_disc_real_5: 0.26046162843704224 (0.155757125467062) | > loss_0: 2.167008399963379 (2.1874380111694336) | > loss_gen: 3.1138863563537598 (2.3422956466674805) | > loss_kl: 5.4022440910339355 (5.249237537384033) | > loss_feat: 8.639260292053223 (9.702901363372803) | > loss_mel: 23.870344161987305 (25.442737579345703) | > loss_duration: 3.105497121810913 (3.145179867744446) | > loss_1: 44.13123321533203 (45.882354736328125)  --> STEP: 3 | > loss_disc: 2.490915298461914 (2.2885971069335938) | > loss_disc_real_0: 0.28926795721054077 (0.24322580297787985) | > loss_disc_real_1: 0.09825848042964935 (0.14276310056447983) | > loss_disc_real_2: 0.21435487270355225 (0.17066656053066254) | > loss_disc_real_3: 0.2747020423412323 (0.22727184494336447) | > loss_disc_real_4: 0.24860379099845886 (0.1665118287007014) | > loss_disc_real_5: 0.30606895685195923 (0.20586106926202774) | > loss_0: 2.490915298461914 (2.2885971069335938) | > loss_gen: 2.4961798191070557 (2.3935903708140054) | > loss_kl: 2.550412893295288 (4.349629322687785) | > loss_feat: 6.336463928222656 (8.580755551656088) | > loss_mel: 24.405155181884766 (25.09687678019206) | > loss_duration: 2.933210849761963 (3.0745235284169516) | > loss_1: 38.7214241027832 (43.49537785847982) --> EVAL PERFORMANCE | > avg_loader_time: 0.023590882619222004 (-0.7315386931101481) | > avg_loss_disc: 2.2885971069335938 (-0.4535371916634694) | > avg_loss_disc_real_0: 0.24322580297787985 (+0.038419518797170565) | > avg_loss_disc_real_1: 0.14276310056447983 (-0.13295903482607435) | > avg_loss_disc_real_2: 0.17066656053066254 (-0.06445337619100297) | > avg_loss_disc_real_3: 0.22727184494336447 (-0.10045131331398374) | > avg_loss_disc_real_4: 0.1665118287007014 (-0.09724996203467959) | > avg_loss_disc_real_5: 0.20586106926202774 (-0.09216027706861496) | > avg_loss_0: 2.2885971069335938 (-0.4535371916634694) | > avg_loss_gen: 2.3935903708140054 (+0.14788110483260386) | > avg_loss_kl: 4.349629322687785 (+0.23469991911025279) | > avg_loss_feat: 8.580755551656088 (+2.8825896581014003) | > avg_loss_mel: 25.09687678019206 (+2.037954421270463) | > avg_loss_duration: 3.0745235284169516 (-0.013488315400623119) | > avg_loss_1: 43.49537785847982 (+5.289639245896112)  > EPOCH: 821/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:43:33)   --> TIME: 2023-10-20 09:44:05 -- STEP: 29/50 -- GLOBAL_STEP: 94080 | > loss_disc: 2.756917715072632 (2.542125905382222) | > loss_disc_real_0: 0.12515994906425476 (0.16459479754597978) | > loss_disc_real_1: 0.29971370100975037 (0.22649378509357057) | > loss_disc_real_2: 0.2051653414964676 (0.23650503672402481) | > loss_disc_real_3: 0.26938286423683167 (0.2360910297981624) | > loss_disc_real_4: 0.4320116937160492 (0.24260224164303004) | > loss_disc_real_5: 0.2817952632904053 (0.2167184859321549) | > loss_0: 2.756917715072632 (2.542125905382222) | > grad_norm_0: tensor(1183.4530, device='cuda:0') (tensor(1005.8013, device='cuda:0')) | > loss_gen: 2.2883963584899902 (2.152547815750385) | > loss_kl: 0.9652551412582397 (0.9636202105160417) | > loss_feat: 4.628782749176025 (4.760289719906346) | > loss_mel: 20.91195297241211 (19.521727413966733) | > loss_duration: 1.3768657445907593 (1.380767875704272) | > loss_1: 30.171253204345703 (28.77895312473692) | > grad_norm_1: tensor(32097.0039, device='cuda:0') (tensor(35688.2773, device='cuda:0')) | > current_lr_0: 8.799377292612542e-05 | > current_lr_1: 8.799377292612542e-05 | > step_time: 0.4549 (0.6998971659561684) | > loader_time: 0.0036 (0.020275477705330683)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.60516357421875 (2.60516357421875) | > loss_disc_real_0: 0.1629980206489563 (0.1629980206489563) | > loss_disc_real_1: 0.30762603878974915 (0.30762603878974915) | > loss_disc_real_2: 0.2648032307624817 (0.2648032307624817) | > loss_disc_real_3: 0.21106702089309692 (0.21106702089309692) | > loss_disc_real_4: 0.15328708291053772 (0.15328708291053772) | > loss_disc_real_5: 0.1911693513393402 (0.1911693513393402) | > loss_0: 2.60516357421875 (2.60516357421875) | > loss_gen: 1.7860848903656006 (1.7860848903656006) | > loss_kl: 4.6070637702941895 (4.6070637702941895) | > loss_feat: 2.791280508041382 (2.791280508041382) | > loss_mel: 23.269187927246094 (23.269187927246094) | > loss_duration: 2.9175198078155518 (2.9175198078155518) | > loss_1: 35.37113571166992 (35.37113571166992)  --> STEP: 1 | > loss_disc: 2.874770164489746 (2.874770164489746) | > loss_disc_real_0: 0.19810569286346436 (0.19810569286346436) | > loss_disc_real_1: 0.2859551012516022 (0.2859551012516022) | > loss_disc_real_2: 0.22978509962558746 (0.22978509962558746) | > loss_disc_real_3: 0.21730710566043854 (0.21730710566043854) | > loss_disc_real_4: 0.2054520696401596 (0.2054520696401596) | > loss_disc_real_5: 0.3288230001926422 (0.3288230001926422) | > loss_0: 2.874770164489746 (2.874770164489746) | > loss_gen: 1.8225059509277344 (1.8225059509277344) | > loss_kl: 4.904361248016357 (4.904361248016357) | > loss_feat: 6.763745307922363 (6.763745307922363) | > loss_mel: 22.901325225830078 (22.901325225830078) | > loss_duration: 3.3013617992401123 (3.3013617992401123) | > loss_1: 39.69329833984375 (39.69329833984375)  --> STEP: 2 | > loss_disc: 1.9854007959365845 (2.4300854802131653) | > loss_disc_real_0: 0.0825701355934143 (0.14033791422843933) | > loss_disc_real_1: 0.14368394017219543 (0.2148195207118988) | > loss_disc_real_2: 0.19866223633289337 (0.21422366797924042) | > loss_disc_real_3: 0.23980365693569183 (0.22855538129806519) | > loss_disc_real_4: 0.2045889049768448 (0.2050204873085022) | > loss_disc_real_5: 0.14876268804073334 (0.23879284411668777) | > loss_0: 1.9854007959365845 (2.4300854802131653) | > loss_gen: 2.66261887550354 (2.242562413215637) | > loss_kl: 5.592444896697998 (5.248403072357178) | > loss_feat: 8.793752670288086 (7.778748989105225) | > loss_mel: 25.96364974975586 (24.43248748779297) | > loss_duration: 3.116257905960083 (3.2088098526000977) | > loss_1: 46.12872314453125 (42.9110107421875)  --> STEP: 3 | > loss_disc: 2.7943427562713623 (2.5515045722325644) | > loss_disc_real_0: 0.10956472158432007 (0.13008018334706625) | > loss_disc_real_1: 0.3671347200870514 (0.26559125383694965) | > loss_disc_real_2: 0.2762772738933563 (0.2349082032839457) | > loss_disc_real_3: 0.3019949495792389 (0.25303523739178974) | > loss_disc_real_4: 0.3410182297229767 (0.250353068113327) | > loss_disc_real_5: 0.44570961594581604 (0.30776510139306384) | > loss_0: 2.7943427562713623 (2.5515045722325644) | > loss_gen: 2.7163784503936768 (2.400501092274984) | > loss_kl: 2.7600159645080566 (4.418940703074138) | > loss_feat: 4.764581203460693 (6.774026393890381) | > loss_mel: 20.932126998901367 (23.265700658162434) | > loss_duration: 3.026278495788574 (3.1479660669962564) | > loss_1: 34.19938278198242 (40.007134755452476) --> EVAL PERFORMANCE | > avg_loader_time: 0.012766758600870768 (-0.010824124018351236) | > avg_loss_disc: 2.5515045722325644 (+0.2629074652989707) | > avg_loss_disc_real_0: 0.13008018334706625 (-0.1131456196308136) | > avg_loss_disc_real_1: 0.26559125383694965 (+0.12282815327246982) | > avg_loss_disc_real_2: 0.2349082032839457 (+0.06424164275328317) | > avg_loss_disc_real_3: 0.25303523739178974 (+0.025763392448425265) | > avg_loss_disc_real_4: 0.250353068113327 (+0.08384123941262564) | > avg_loss_disc_real_5: 0.30776510139306384 (+0.1019040321310361) | > avg_loss_0: 2.5515045722325644 (+0.2629074652989707) | > avg_loss_gen: 2.400501092274984 (+0.006910721460978486) | > avg_loss_kl: 4.418940703074138 (+0.06931138038635254) | > avg_loss_feat: 6.774026393890381 (-1.806729157765707) | > avg_loss_mel: 23.265700658162434 (-1.8311761220296248) | > avg_loss_duration: 3.1479660669962564 (+0.07344253857930472) | > avg_loss_1: 40.007134755452476 (-3.4882431030273438)  > EPOCH: 822/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:44:31)   --> TIME: 2023-10-20 09:44:45 -- STEP: 9/50 -- GLOBAL_STEP: 94110 | > loss_disc: 3.0324654579162598 (2.2833182944191828) | > loss_disc_real_0: 0.37974193692207336 (0.20176722233494124) | > loss_disc_real_1: 0.2924424707889557 (0.23651333111855719) | > loss_disc_real_2: 0.307331383228302 (0.24332844797107908) | > loss_disc_real_3: 0.2604058086872101 (0.19736824888322088) | > loss_disc_real_4: 0.21439401805400848 (0.16543410884009468) | > loss_disc_real_5: 0.21782885491847992 (0.214904532664352) | > loss_0: 3.0324654579162598 (2.2833182944191828) | > grad_norm_0: tensor(1081.5780, device='cuda:0') (tensor(891.3868, device='cuda:0')) | > loss_gen: 1.6076040267944336 (2.6645307143529258) | > loss_kl: 0.7874763011932373 (0.9515702260865105) | > loss_feat: 0.04051860049366951 (7.7899652409056825) | > loss_mel: 1.4948301315307617 (20.759623739454483) | > loss_duration: 1.3356378078460693 (1.3898292382558186) | > loss_1: 5.266066551208496 (33.55551899804009) | > grad_norm_1: tensor(95504.9922, device='cuda:0') (tensor(64515.1602, device='cuda:0')) | > current_lr_0: 8.790581764085211e-05 | > current_lr_1: 8.790581764085211e-05 | > step_time: 0.7937 (0.639015621609158) | > loader_time: 0.0183 (0.01958089404635959)  --> TIME: 2023-10-20 09:45:07 -- STEP: 39/50 -- GLOBAL_STEP: 94140 | > loss_disc: 2.658278465270996 (2.499657866282341) | > loss_disc_real_0: 0.04036721587181091 (0.16114814918583784) | > loss_disc_real_1: 0.0409744456410408 (0.23226821795105934) | > loss_disc_real_2: 0.04074850305914879 (0.23123007172193283) | > loss_disc_real_3: 0.05298271402716637 (0.23298927893241247) | > loss_disc_real_4: 0.04135407134890556 (0.19720913154574543) | > loss_disc_real_5: 0.019134309142827988 (0.22007351559706223) | > loss_0: 2.658278465270996 (2.499657866282341) | > grad_norm_0: tensor(1608.5575, device='cuda:0') (tensor(1287.9812, device='cuda:0')) | > loss_gen: 1.8229994773864746 (2.2756223434056992) | > loss_kl: 0.40385448932647705 (0.8705458855017637) | > loss_feat: 10.591872215270996 (5.335763529802745) | > loss_mel: 29.459999084472656 (19.72740519963778) | > loss_duration: 1.4309821128845215 (1.3795073796541264) | > loss_1: 43.7097053527832 (29.588844494941906) | > grad_norm_1: tensor(179955.1875, device='cuda:0') (tensor(42692.7070, device='cuda:0')) | > current_lr_0: 8.790581764085211e-05 | > current_lr_1: 8.790581764085211e-05 | > step_time: 0.8617 (0.681118402725611) | > loader_time: 0.048 (0.02247032752403846)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.6268529891967773 (3.6268529891967773) | > loss_disc_real_0: 0.6836127042770386 (0.6836127042770386) | > loss_disc_real_1: 0.3364822566509247 (0.3364822566509247) | > loss_disc_real_2: 0.5517119765281677 (0.5517119765281677) | > loss_disc_real_3: 0.39809760451316833 (0.39809760451316833) | > loss_disc_real_4: 0.5428345203399658 (0.5428345203399658) | > loss_disc_real_5: 0.561600387096405 (0.561600387096405) | > loss_0: 3.6268529891967773 (3.6268529891967773) | > loss_gen: 3.388370990753174 (3.388370990753174) | > loss_kl: 4.981815814971924 (4.981815814971924) | > loss_feat: 4.65570592880249 (4.65570592880249) | > loss_mel: 20.13823127746582 (20.13823127746582) | > loss_duration: 2.88826060295105 (2.88826060295105) | > loss_1: 36.05238342285156 (36.05238342285156)  --> STEP: 1 | > loss_disc: 3.2712864875793457 (3.2712864875793457) | > loss_disc_real_0: 0.3589072823524475 (0.3589072823524475) | > loss_disc_real_1: 0.4333479702472687 (0.4333479702472687) | > loss_disc_real_2: 0.4328804910182953 (0.4328804910182953) | > loss_disc_real_3: 0.41068893671035767 (0.41068893671035767) | > loss_disc_real_4: 0.4393863081932068 (0.4393863081932068) | > loss_disc_real_5: 0.6514177322387695 (0.6514177322387695) | > loss_0: 3.2712864875793457 (3.2712864875793457) | > loss_gen: 3.773423433303833 (3.773423433303833) | > loss_kl: 4.187276363372803 (4.187276363372803) | > loss_feat: 5.866120338439941 (5.866120338439941) | > loss_mel: 25.827054977416992 (25.827054977416992) | > loss_duration: 3.187427520751953 (3.187427520751953) | > loss_1: 42.84130096435547 (42.84130096435547)  --> STEP: 2 | > loss_disc: 2.4185309410095215 (2.8449087142944336) | > loss_disc_real_0: 0.05564703047275543 (0.20727715641260147) | > loss_disc_real_1: 0.20299358665943146 (0.31817077845335007) | > loss_disc_real_2: 0.3364991247653961 (0.3846898078918457) | > loss_disc_real_3: 0.13374286890029907 (0.27221590280532837) | > loss_disc_real_4: 0.31471413373947144 (0.3770502209663391) | > loss_disc_real_5: 0.3045221269130707 (0.4779699295759201) | > loss_0: 2.4185309410095215 (2.8449087142944336) | > loss_gen: 2.3447632789611816 (3.0590933561325073) | > loss_kl: 4.8594560623168945 (4.523366212844849) | > loss_feat: 10.48754596710205 (8.176833152770996) | > loss_mel: 26.824716567993164 (26.325885772705078) | > loss_duration: 3.0393359661102295 (3.1133817434310913) | > loss_1: 47.55582046508789 (45.19856071472168)  --> STEP: 3 | > loss_disc: 2.9585819244384766 (2.8827997843424478) | > loss_disc_real_0: 0.17056207358837128 (0.1950387954711914) | > loss_disc_real_1: 0.341562956571579 (0.3259681711594264) | > loss_disc_real_2: 0.3520907461643219 (0.3738234539826711) | > loss_disc_real_3: 0.36984074115753174 (0.3047575155893962) | > loss_disc_real_4: 0.32436320185661316 (0.3594878812630971) | > loss_disc_real_5: 0.2708989977836609 (0.40894628564516705) | > loss_0: 2.9585819244384766 (2.8827997843424478) | > loss_gen: 2.447838306427002 (2.855341672897339) | > loss_kl: 2.4764299392700195 (3.841054121653239) | > loss_feat: 5.109445571899414 (7.154370625813802) | > loss_mel: 21.58369255065918 (24.745154698689777) | > loss_duration: 3.007861614227295 (3.0782083670298257) | > loss_1: 34.625267028808594 (41.674129486083984) --> EVAL PERFORMANCE | > avg_loader_time: 0.003887812296549479 (-0.008878946304321289) | > avg_loss_disc: 2.8827997843424478 (+0.33129521210988333) | > avg_loss_disc_real_0: 0.1950387954711914 (+0.06495861212412515) | > avg_loss_disc_real_1: 0.3259681711594264 (+0.06037691732247674) | > avg_loss_disc_real_2: 0.3738234539826711 (+0.13891525069872537) | > avg_loss_disc_real_3: 0.3047575155893962 (+0.05172227819760644) | > avg_loss_disc_real_4: 0.3594878812630971 (+0.10913481314977008) | > avg_loss_disc_real_5: 0.40894628564516705 (+0.1011811842521032) | > avg_loss_0: 2.8827997843424478 (+0.33129521210988333) | > avg_loss_gen: 2.855341672897339 (+0.454840580622355) | > avg_loss_kl: 3.841054121653239 (-0.5778865814208989) | > avg_loss_feat: 7.154370625813802 (+0.38034423192342093) | > avg_loss_mel: 24.745154698689777 (+1.4794540405273438) | > avg_loss_duration: 3.0782083670298257 (-0.06975769996643066) | > avg_loss_1: 41.674129486083984 (+1.666994730631508)  > EPOCH: 823/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:45:26)   --> TIME: 2023-10-20 09:45:43 -- STEP: 19/50 -- GLOBAL_STEP: 94170 | > loss_disc: 2.073897361755371 (2.6338751567037484) | > loss_disc_real_0: 0.09367606043815613 (0.1725198634360966) | > loss_disc_real_1: 0.16204537451267242 (0.2691152142850976) | > loss_disc_real_2: 0.13466285169124603 (0.267207570374012) | > loss_disc_real_3: 0.12899568676948547 (0.2688736350912797) | > loss_disc_real_4: 0.09363040328025818 (0.2769160733411187) | > loss_disc_real_5: 0.0792454183101654 (0.28074378010473755) | > loss_0: 2.073897361755371 (2.6338751567037484) | > grad_norm_0: tensor(1050.8997, device='cuda:0') (tensor(1214.5844, device='cuda:0')) | > loss_gen: 1.748434066772461 (2.3070786501231946) | > loss_kl: 0.7709775567054749 (0.8162417411804199) | > loss_feat: 4.4972825050354 (4.526020016717284) | > loss_mel: 17.207109451293945 (18.717035538271855) | > loss_duration: 1.5118441581726074 (1.4236067031559192) | > loss_1: 25.735647201538086 (27.789982318878174) | > grad_norm_1: tensor(25245.0234, device='cuda:0') (tensor(29601.3516, device='cuda:0')) | > current_lr_0: 8.781795027239326e-05 | > current_lr_1: 8.781795027239326e-05 | > step_time: 0.3895 (0.5887519560362163) | > loader_time: 0.0018 (0.02144398187336169)  --> TIME: 2023-10-20 09:46:03 -- STEP: 49/50 -- GLOBAL_STEP: 94200 | > loss_disc: 1.9549983739852905 (2.4709030949339574) | > loss_disc_real_0: 0.03312424570322037 (0.1382894810403184) | > loss_disc_real_1: 0.20066840946674347 (0.23679319814759858) | > loss_disc_real_2: 0.15837310254573822 (0.23198922799558064) | > loss_disc_real_3: 0.2337198257446289 (0.23281392097777245) | > loss_disc_real_4: 0.0868445485830307 (0.24823463229196419) | > loss_disc_real_5: 0.2286117821931839 (0.2476386551802256) | > loss_0: 1.9549983739852905 (2.4709030949339574) | > grad_norm_0: tensor(609.3241, device='cuda:0') (tensor(1013.3357, device='cuda:0')) | > loss_gen: 2.5853030681610107 (2.3247614271786747) | > loss_kl: 0.8536332845687866 (0.8185518140695534) | > loss_feat: 6.696063995361328 (5.0333758101475485) | > loss_mel: 27.234766006469727 (20.593445249966212) | > loss_duration: 1.4688661098480225 (1.3822765763925047) | > loss_1: 38.83863067626953 (30.152410555859003) | > grad_norm_1: tensor(9212.9619, device='cuda:0') (tensor(28126.9180, device='cuda:0')) | > current_lr_0: 8.781795027239326e-05 | > current_lr_1: 8.781795027239326e-05 | > step_time: 0.5871 (0.6118778111983318) | > loader_time: 0.4236 (0.029854662564336037)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5695838928222656 (2.5695838928222656) | > loss_disc_real_0: 0.32129859924316406 (0.32129859924316406) | > loss_disc_real_1: 0.2546882629394531 (0.2546882629394531) | > loss_disc_real_2: 0.30592477321624756 (0.30592477321624756) | > loss_disc_real_3: 0.1879357546567917 (0.1879357546567917) | > loss_disc_real_4: 0.3909773528575897 (0.3909773528575897) | > loss_disc_real_5: 0.31514644622802734 (0.31514644622802734) | > loss_0: 2.5695838928222656 (2.5695838928222656) | > loss_gen: 3.0454044342041016 (3.0454044342041016) | > loss_kl: 5.510558605194092 (5.510558605194092) | > loss_feat: 6.707363605499268 (6.707363605499268) | > loss_mel: 21.087343215942383 (21.087343215942383) | > loss_duration: 2.956418752670288 (2.956418752670288) | > loss_1: 39.30708694458008 (39.30708694458008)  --> STEP: 1 | > loss_disc: 3.197613000869751 (3.197613000869751) | > loss_disc_real_0: 0.6098983883857727 (0.6098983883857727) | > loss_disc_real_1: 0.3148961663246155 (0.3148961663246155) | > loss_disc_real_2: 0.4278162121772766 (0.4278162121772766) | > loss_disc_real_3: 0.3331999182701111 (0.3331999182701111) | > loss_disc_real_4: 0.2966170310974121 (0.2966170310974121) | > loss_disc_real_5: 0.33167392015457153 (0.33167392015457153) | > loss_0: 3.197613000869751 (3.197613000869751) | > loss_gen: 2.8676257133483887 (2.8676257133483887) | > loss_kl: 4.77282190322876 (4.77282190322876) | > loss_feat: 1.1812959909439087 (1.1812959909439087) | > loss_mel: 19.96922492980957 (19.96922492980957) | > loss_duration: 3.396782159805298 (3.396782159805298) | > loss_1: 32.18775177001953 (32.18775177001953)  --> STEP: 2 | > loss_disc: 3.0297746658325195 (3.1136938333511353) | > loss_disc_real_0: 0.24270908534526825 (0.4263037368655205) | > loss_disc_real_1: 0.29324668645858765 (0.30407142639160156) | > loss_disc_real_2: 0.3098353147506714 (0.368825763463974) | > loss_disc_real_3: 0.2917284369468689 (0.31246417760849) | > loss_disc_real_4: 0.2943000793457031 (0.2954585552215576) | > loss_disc_real_5: 0.3340839743614197 (0.3328789472579956) | > loss_0: 3.0297746658325195 (3.1136938333511353) | > loss_gen: 1.7607249021530151 (2.314175307750702) | > loss_kl: 5.317483425140381 (5.04515266418457) | > loss_feat: 0.19113773107528687 (0.6862168610095978) | > loss_mel: 4.916408538818359 (12.442816734313965) | > loss_duration: 3.1291587352752686 (3.262970447540283) | > loss_1: 15.314913749694824 (23.751332759857178)  --> STEP: 3 | > loss_disc: 2.8413143157958984 (3.022900660832723) | > loss_disc_real_0: 0.15973034501075745 (0.3374459395805995) | > loss_disc_real_1: 0.22821782529354095 (0.27878689269224805) | > loss_disc_real_2: 0.2807886302471161 (0.33948005239168805) | > loss_disc_real_3: 0.3339342176914215 (0.31962085763613385) | > loss_disc_real_4: 0.30040037631988525 (0.2971058289210002) | > loss_disc_real_5: 0.33255746960639954 (0.33277178804079693) | > loss_0: 2.8413143157958984 (3.022900660832723) | > loss_gen: 2.098053216934204 (2.242134610811869) | > loss_kl: 2.44759464263916 (4.179299990336101) | > loss_feat: 4.823312759399414 (2.0652488271395364) | > loss_mel: 19.95888900756836 (14.948174158732096) | > loss_duration: 3.0528337955474854 (3.192924896876017) | > loss_1: 32.38068389892578 (26.62778313954671) --> EVAL PERFORMANCE | > avg_loader_time: 0.003705739974975586 (-0.00018207232157389308) | > avg_loss_disc: 3.022900660832723 (+0.14010087649027536) | > avg_loss_disc_real_0: 0.3374459395805995 (+0.14240714410940808) | > avg_loss_disc_real_1: 0.27878689269224805 (-0.047181278467178345) | > avg_loss_disc_real_2: 0.33948005239168805 (-0.034343401590983036) | > avg_loss_disc_real_3: 0.31962085763613385 (+0.014863342046737671) | > avg_loss_disc_real_4: 0.2971058289210002 (-0.06238205234209693) | > avg_loss_disc_real_5: 0.33277178804079693 (-0.07617449760437012) | > avg_loss_0: 3.022900660832723 (+0.14010087649027536) | > avg_loss_gen: 2.242134610811869 (-0.6132070620854697) | > avg_loss_kl: 4.179299990336101 (+0.33824586868286177) | > avg_loss_feat: 2.0652488271395364 (-5.089121798674265) | > avg_loss_mel: 14.948174158732096 (-9.796980539957682) | > avg_loss_duration: 3.192924896876017 (+0.1147165298461914) | > avg_loss_1: 26.62778313954671 (-15.046346346537273)  > EPOCH: 824/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:46:22)   --> TIME: 2023-10-20 09:46:47 -- STEP: 29/50 -- GLOBAL_STEP: 94230 | > loss_disc: 2.9897050857543945 (2.351686009045305) | > loss_disc_real_0: 0.2079268991947174 (0.12509447972065416) | > loss_disc_real_1: 0.24447205662727356 (0.22321780282875586) | > loss_disc_real_2: 0.2339763343334198 (0.21855805968416148) | > loss_disc_real_3: 0.3008674383163452 (0.2270492597900588) | > loss_disc_real_4: 0.3071303367614746 (0.22523775593987827) | > loss_disc_real_5: 0.3012005686759949 (0.19664056939554625) | > loss_0: 2.9897050857543945 (2.351686009045305) | > grad_norm_0: tensor(921.0263, device='cuda:0') (tensor(1010.1248, device='cuda:0')) | > loss_gen: 1.6531751155853271 (2.3387782450379997) | > loss_kl: 0.7627832293510437 (0.8487339451395232) | > loss_feat: 0.17513252794742584 (5.861066744245332) | > loss_mel: 3.932840585708618 (21.837684195617154) | > loss_duration: 1.40239679813385 (1.3866011233165347) | > loss_1: 7.926328182220459 (32.27286476924502) | > grad_norm_1: tensor(22891.1914, device='cuda:0') (tensor(34473.4531, device='cuda:0')) | > current_lr_0: 8.773017073287048e-05 | > current_lr_1: 8.773017073287048e-05 | > step_time: 0.7109 (0.6459020170672186) | > loader_time: 0.0335 (0.024122090175234038)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4693443775177 (2.4693443775177) | > loss_disc_real_0: 0.32013627886772156 (0.32013627886772156) | > loss_disc_real_1: 0.3987371623516083 (0.3987371623516083) | > loss_disc_real_2: 0.1843826323747635 (0.1843826323747635) | > loss_disc_real_3: 0.22603543102741241 (0.22603543102741241) | > loss_disc_real_4: 0.15109191834926605 (0.15109191834926605) | > loss_disc_real_5: 0.19709794223308563 (0.19709794223308563) | > loss_0: 2.4693443775177 (2.4693443775177) | > loss_gen: 2.5755116939544678 (2.5755116939544678) | > loss_kl: 4.98026180267334 (4.98026180267334) | > loss_feat: 4.951376914978027 (4.951376914978027) | > loss_mel: 17.100658416748047 (17.100658416748047) | > loss_duration: 2.912191390991211 (2.912191390991211) | > loss_1: 32.52000045776367 (32.52000045776367)  --> STEP: 1 | > loss_disc: 2.9466753005981445 (2.9466753005981445) | > loss_disc_real_0: 0.5237007141113281 (0.5237007141113281) | > loss_disc_real_1: 0.24488261342048645 (0.24488261342048645) | > loss_disc_real_2: 0.1319885551929474 (0.1319885551929474) | > loss_disc_real_3: 0.12972621619701385 (0.12972621619701385) | > loss_disc_real_4: 0.3381243050098419 (0.3381243050098419) | > loss_disc_real_5: 0.23467044532299042 (0.23467044532299042) | > loss_0: 2.9466753005981445 (2.9466753005981445) | > loss_gen: 2.0001418590545654 (2.0001418590545654) | > loss_kl: 4.5613322257995605 (4.5613322257995605) | > loss_feat: 4.68745756149292 (4.68745756149292) | > loss_mel: 24.01239776611328 (24.01239776611328) | > loss_duration: 3.324185371398926 (3.324185371398926) | > loss_1: 38.585514068603516 (38.585514068603516)  --> STEP: 2 | > loss_disc: 3.2447891235351562 (3.0957322120666504) | > loss_disc_real_0: 0.6165722608566284 (0.5701364874839783) | > loss_disc_real_1: 0.282871276140213 (0.26387694478034973) | > loss_disc_real_2: 0.258645623922348 (0.1953170895576477) | > loss_disc_real_3: 0.27464595437049866 (0.20218608528375626) | > loss_disc_real_4: 0.29116201400756836 (0.31464315950870514) | > loss_disc_real_5: 0.31482207775115967 (0.27474626153707504) | > loss_0: 3.2447891235351562 (3.0957322120666504) | > loss_gen: 1.9477243423461914 (1.9739331007003784) | > loss_kl: 5.335480690002441 (4.948406457901001) | > loss_feat: 0.20109476149082184 (2.444276161491871) | > loss_mel: 4.422303676605225 (14.217350721359253) | > loss_duration: 3.094717264175415 (3.2094513177871704) | > loss_1: 15.001320838928223 (26.79341745376587)  --> STEP: 3 | > loss_disc: 3.2513315677642822 (3.147598663965861) | > loss_disc_real_0: 0.6105508208274841 (0.5836079319318136) | > loss_disc_real_1: 0.3634433448314667 (0.29706574479738873) | > loss_disc_real_2: 0.3349492847919464 (0.24186115463574728) | > loss_disc_real_3: 0.27943283319473267 (0.22793500125408173) | > loss_disc_real_4: 0.2707340717315674 (0.30000679691632587) | > loss_disc_real_5: 0.2765539884567261 (0.27534883717695874) | > loss_0: 3.2513315677642822 (3.147598663965861) | > loss_gen: 2.8569748401641846 (2.268280347188314) | > loss_kl: 2.2424986362457275 (4.04643718401591) | > loss_feat: 3.006795883178711 (2.631782735387484) | > loss_mel: 22.528825759887695 (16.987842400868733) | > loss_duration: 2.907066583633423 (3.108656406402588) | > loss_1: 33.54216384887695 (29.042999585469563) --> EVAL PERFORMANCE | > avg_loader_time: 0.01126845677693685 (+0.007562716801961264) | > avg_loss_disc: 3.147598663965861 (+0.12469800313313772) | > avg_loss_disc_real_0: 0.5836079319318136 (+0.2461619923512141) | > avg_loss_disc_real_1: 0.29706574479738873 (+0.018278852105140686) | > avg_loss_disc_real_2: 0.24186115463574728 (-0.09761889775594076) | > avg_loss_disc_real_3: 0.22793500125408173 (-0.09168585638205212) | > avg_loss_disc_real_4: 0.30000679691632587 (+0.0029009679953256873) | > avg_loss_disc_real_5: 0.27534883717695874 (-0.057422950863838196) | > avg_loss_0: 3.147598663965861 (+0.12469800313313772) | > avg_loss_gen: 2.268280347188314 (+0.026145736376444795) | > avg_loss_kl: 4.04643718401591 (-0.13286280632019043) | > avg_loss_feat: 2.631782735387484 (+0.5665339082479477) | > avg_loss_mel: 16.987842400868733 (+2.0396682421366368) | > avg_loss_duration: 3.108656406402588 (-0.08426849047342921) | > avg_loss_1: 29.042999585469563 (+2.4152164459228516)  > EPOCH: 825/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:47:11)   --> TIME: 2023-10-20 09:47:22 -- STEP: 9/50 -- GLOBAL_STEP: 94260 | > loss_disc: 2.2679603099823 (2.417516072591146) | > loss_disc_real_0: 0.054390110075473785 (0.15728899919324452) | > loss_disc_real_1: 0.3736492991447449 (0.25925350975659156) | > loss_disc_real_2: 0.3313441574573517 (0.20684466676579583) | > loss_disc_real_3: 0.24165411293506622 (0.2176405034131474) | > loss_disc_real_4: 0.22896519303321838 (0.21145719331171778) | > loss_disc_real_5: 0.2557535469532013 (0.18904480565753248) | > loss_0: 2.2679603099823 (2.417516072591146) | > grad_norm_0: tensor(992.0217, device='cuda:0') (tensor(1445.6481, device='cuda:0')) | > loss_gen: 2.731735944747925 (2.1839151117536755) | > loss_kl: 0.7229959964752197 (0.8526768684387207) | > loss_feat: 4.6064019203186035 (4.719487817751037) | > loss_mel: 23.436603546142578 (18.436198658413357) | > loss_duration: 1.281062364578247 (1.3740574651294284) | > loss_1: 32.77880096435547 (27.56633647282918) | > grad_norm_1: tensor(35932.2812, device='cuda:0') (tensor(33267.7891, device='cuda:0')) | > current_lr_0: 8.764247893449329e-05 | > current_lr_1: 8.764247893449329e-05 | > step_time: 0.5446 (0.6815702650282118) | > loader_time: 0.0429 (0.02717892328898112)  --> TIME: 2023-10-20 09:47:37 -- STEP: 39/50 -- GLOBAL_STEP: 94290 | > loss_disc: 1.402921199798584 (2.40102249231094) | > loss_disc_real_0: 0.012822511605918407 (0.14778896523878365) | > loss_disc_real_1: 0.15607154369354248 (0.2488656367820043) | > loss_disc_real_2: 0.04197688028216362 (0.23490422820815673) | > loss_disc_real_3: 0.14618413150310516 (0.23473093505853262) | > loss_disc_real_4: 0.035198573023080826 (0.22000960824199212) | > loss_disc_real_5: 0.04389065504074097 (0.21287592113591158) | > loss_0: 1.402921199798584 (2.40102249231094) | > grad_norm_0: tensor(613.7012, device='cuda:0') (tensor(1214.2809, device='cuda:0')) | > loss_gen: 2.790417194366455 (2.360603928565979) | > loss_kl: 0.7473598718643188 (0.8545889525841444) | > loss_feat: 11.74588680267334 (5.572045571528948) | > loss_mel: 28.895357131958008 (21.11231720753205) | > loss_duration: 1.447467565536499 (1.3768309996678278) | > loss_1: 45.626487731933594 (31.276386248759728) | > grad_norm_1: tensor(81987.9375, device='cuda:0') (tensor(32873.4023, device='cuda:0')) | > current_lr_0: 8.764247893449329e-05 | > current_lr_1: 8.764247893449329e-05 | > step_time: 0.3733 (0.5372416239518386) | > loader_time: 0.0073 (0.01685760571406438)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2793679237365723 (3.2793679237365723) | > loss_disc_real_0: 0.3443593382835388 (0.3443593382835388) | > loss_disc_real_1: 0.26795631647109985 (0.26795631647109985) | > loss_disc_real_2: 0.4596816897392273 (0.4596816897392273) | > loss_disc_real_3: 0.3192904591560364 (0.3192904591560364) | > loss_disc_real_4: 0.33085542917251587 (0.33085542917251587) | > loss_disc_real_5: 0.38307222723960876 (0.38307222723960876) | > loss_0: 3.2793679237365723 (3.2793679237365723) | > loss_gen: 2.045243978500366 (2.045243978500366) | > loss_kl: 5.779531002044678 (5.779531002044678) | > loss_feat: 4.220350742340088 (4.220350742340088) | > loss_mel: 23.975404739379883 (23.975404739379883) | > loss_duration: 2.9890379905700684 (2.9890379905700684) | > loss_1: 39.00956726074219 (39.00956726074219)  --> STEP: 1 | > loss_disc: 2.9585464000701904 (2.9585464000701904) | > loss_disc_real_0: 0.18402668833732605 (0.18402668833732605) | > loss_disc_real_1: 0.28041982650756836 (0.28041982650756836) | > loss_disc_real_2: 0.35348260402679443 (0.35348260402679443) | > loss_disc_real_3: 0.3657863438129425 (0.3657863438129425) | > loss_disc_real_4: 0.4268591105937958 (0.4268591105937958) | > loss_disc_real_5: 0.22801287472248077 (0.22801287472248077) | > loss_0: 2.9585464000701904 (2.9585464000701904) | > loss_gen: 2.1038291454315186 (2.1038291454315186) | > loss_kl: 4.793237686157227 (4.793237686157227) | > loss_feat: 4.031004905700684 (4.031004905700684) | > loss_mel: 22.33626937866211 (22.33626937866211) | > loss_duration: 3.214879035949707 (3.214879035949707) | > loss_1: 36.479217529296875 (36.479217529296875)  --> STEP: 2 | > loss_disc: 2.7716434001922607 (2.8650949001312256) | > loss_disc_real_0: 0.26647621393203735 (0.2252514511346817) | > loss_disc_real_1: 0.17586565017700195 (0.22814273834228516) | > loss_disc_real_2: 0.27195116877555847 (0.31271688640117645) | > loss_disc_real_3: 0.25849953293800354 (0.312142938375473) | > loss_disc_real_4: 0.3586333394050598 (0.3927462249994278) | > loss_disc_real_5: 0.22412899136543274 (0.22607093304395676) | > loss_0: 2.7716434001922607 (2.8650949001312256) | > loss_gen: 2.512455940246582 (2.3081425428390503) | > loss_kl: 5.409927845001221 (5.101582765579224) | > loss_feat: 7.905449867248535 (5.968227386474609) | > loss_mel: 23.256689071655273 (22.79647922515869) | > loss_duration: 3.1858572959899902 (3.2003681659698486) | > loss_1: 42.27037811279297 (39.37479782104492)  --> STEP: 3 | > loss_disc: 2.329246759414673 (2.686478853225708) | > loss_disc_real_0: 0.3689819574356079 (0.2731616199016571) | > loss_disc_real_1: 0.1582040637731552 (0.20482984681924185) | > loss_disc_real_2: 0.1962314397096634 (0.2738884041706721) | > loss_disc_real_3: 0.13191787898540497 (0.2520679185787837) | > loss_disc_real_4: 0.18180729448795319 (0.3224332481622696) | > loss_disc_real_5: 0.21484051644802094 (0.2223274608453115) | > loss_0: 2.329246759414673 (2.686478853225708) | > loss_gen: 2.165757417678833 (2.260680834452311) | > loss_kl: 2.6465401649475098 (4.283235232035319) | > loss_feat: 5.723211288452148 (5.886555353800456) | > loss_mel: 24.889467239379883 (23.494141896565754) | > loss_duration: 2.9833648204803467 (3.128033717473348) | > loss_1: 38.4083366394043 (39.05264409383138) --> EVAL PERFORMANCE | > avg_loader_time: 0.021904945373535156 (+0.010636488596598307) | > avg_loss_disc: 2.686478853225708 (-0.46111981074015285) | > avg_loss_disc_real_0: 0.2731616199016571 (-0.3104463120301565) | > avg_loss_disc_real_1: 0.20482984681924185 (-0.09223589797814688) | > avg_loss_disc_real_2: 0.2738884041706721 (+0.032027249534924834) | > avg_loss_disc_real_3: 0.2520679185787837 (+0.024132917324701963) | > avg_loss_disc_real_4: 0.3224332481622696 (+0.022426451245943724) | > avg_loss_disc_real_5: 0.2223274608453115 (-0.053021376331647246) | > avg_loss_0: 2.686478853225708 (-0.46111981074015285) | > avg_loss_gen: 2.260680834452311 (-0.0075995127360029) | > avg_loss_kl: 4.283235232035319 (+0.23679804801940918) | > avg_loss_feat: 5.886555353800456 (+3.254772618412972) | > avg_loss_mel: 23.494141896565754 (+6.5062994956970215) | > avg_loss_duration: 3.128033717473348 (+0.01937731107076024) | > avg_loss_1: 39.05264409383138 (+10.00964450836182)  > EPOCH: 826/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:47:59)   --> TIME: 2023-10-20 09:48:20 -- STEP: 19/50 -- GLOBAL_STEP: 94320 | > loss_disc: 2.50067138671875 (2.461904437918412) | > loss_disc_real_0: 0.11550097912549973 (0.12124072292231415) | > loss_disc_real_1: 0.2813427150249481 (0.22417430667892882) | > loss_disc_real_2: 0.31293433904647827 (0.22863649988645002) | > loss_disc_real_3: 0.3305555284023285 (0.24461891286467252) | > loss_disc_real_4: 0.22195903956890106 (0.21014053266691535) | > loss_disc_real_5: 0.3048849403858185 (0.257975642814448) | > loss_0: 2.50067138671875 (2.461904437918412) | > grad_norm_0: tensor(811.6783, device='cuda:0') (tensor(834.6329, device='cuda:0')) | > loss_gen: 2.50881290435791 (2.4142699304379915) | > loss_kl: 0.680310070514679 (0.8737671249791196) | > loss_feat: 3.9777207374572754 (6.477740486593623) | > loss_mel: 25.055551528930664 (24.35351345099901) | > loss_duration: 1.4830693006515503 (1.4279487760443437) | > loss_1: 33.705467224121094 (35.54724028235987) | > grad_norm_1: tensor(21299.4551, device='cuda:0') (tensor(50734.6133, device='cuda:0')) | > current_lr_0: 8.755487478955889e-05 | > current_lr_1: 8.755487478955889e-05 | > step_time: 0.4298 (0.767660002959402) | > loader_time: 0.03 (0.03430473177056564)  --> TIME: 2023-10-20 09:48:40 -- STEP: 49/50 -- GLOBAL_STEP: 94350 | > loss_disc: 3.0498573780059814 (2.459304410584118) | > loss_disc_real_0: 0.3822692334651947 (0.14633273041560022) | > loss_disc_real_1: 0.2943289279937744 (0.23011248030376677) | > loss_disc_real_2: 0.35529494285583496 (0.22278029292973936) | > loss_disc_real_3: 0.28789475560188293 (0.22898410937311697) | > loss_disc_real_4: 0.2947026193141937 (0.23292638684565925) | > loss_disc_real_5: 0.2807433307170868 (0.2379859911696035) | > loss_0: 3.0498573780059814 (2.459304410584118) | > grad_norm_0: tensor(1439.5930, device='cuda:0') (tensor(1106.0697, device='cuda:0')) | > loss_gen: 2.0129611492156982 (2.3823569769762) | > loss_kl: 0.5485659241676331 (0.8491944549035053) | > loss_feat: 2.2876243591308594 (5.899220596922904) | > loss_mel: 23.434167861938477 (22.379545745800947) | > loss_duration: 1.4971904754638672 (1.3920353091492945) | > loss_1: 29.78050994873047 (32.9023533743255) | > grad_norm_1: tensor(6117.6226, device='cuda:0') (tensor(41583.1133, device='cuda:0')) | > current_lr_0: 8.755487478955889e-05 | > current_lr_1: 8.755487478955889e-05 | > step_time: 0.4674 (0.6806626027944135) | > loader_time: 0.5957 (0.03807333050941934)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8794188499450684 (2.8794188499450684) | > loss_disc_real_0: 0.22009582817554474 (0.22009582817554474) | > loss_disc_real_1: 0.17500926554203033 (0.17500926554203033) | > loss_disc_real_2: 0.34130269289016724 (0.34130269289016724) | > loss_disc_real_3: 0.3476620018482208 (0.3476620018482208) | > loss_disc_real_4: 0.33305105566978455 (0.33305105566978455) | > loss_disc_real_5: 0.38702815771102905 (0.38702815771102905) | > loss_0: 2.8794188499450684 (2.8794188499450684) | > loss_gen: 2.3541572093963623 (2.3541572093963623) | > loss_kl: 5.248839378356934 (5.248839378356934) | > loss_feat: 5.491330146789551 (5.491330146789551) | > loss_mel: 23.722049713134766 (23.722049713134766) | > loss_duration: 2.8880927562713623 (2.8880927562713623) | > loss_1: 39.7044677734375 (39.7044677734375)  --> STEP: 1 | > loss_disc: 2.7487411499023438 (2.7487411499023438) | > loss_disc_real_0: 0.3346629738807678 (0.3346629738807678) | > loss_disc_real_1: 0.1608053743839264 (0.1608053743839264) | > loss_disc_real_2: 0.2092238813638687 (0.2092238813638687) | > loss_disc_real_3: 0.3014143705368042 (0.3014143705368042) | > loss_disc_real_4: 0.34951791167259216 (0.34951791167259216) | > loss_disc_real_5: 0.3269760012626648 (0.3269760012626648) | > loss_0: 2.7487411499023438 (2.7487411499023438) | > loss_gen: 2.338775634765625 (2.338775634765625) | > loss_kl: 4.98845911026001 (4.98845911026001) | > loss_feat: 6.087003707885742 (6.087003707885742) | > loss_mel: 23.582866668701172 (23.582866668701172) | > loss_duration: 3.1473143100738525 (3.1473143100738525) | > loss_1: 40.1444206237793 (40.1444206237793)  --> STEP: 2 | > loss_disc: 2.337822914123535 (2.5432820320129395) | > loss_disc_real_0: 0.2827444076538086 (0.3087036907672882) | > loss_disc_real_1: 0.13760431110858917 (0.14920484274625778) | > loss_disc_real_2: 0.21746031939983368 (0.2133421003818512) | > loss_disc_real_3: 0.34663406014442444 (0.3240242153406143) | > loss_disc_real_4: 0.19538989663124084 (0.2724539041519165) | > loss_disc_real_5: 0.29507210850715637 (0.3110240548849106) | > loss_0: 2.337822914123535 (2.5432820320129395) | > loss_gen: 2.621368169784546 (2.4800719022750854) | > loss_kl: 5.402930736541748 (5.195694923400879) | > loss_feat: 7.051887512207031 (6.569445610046387) | > loss_mel: 22.868492126464844 (23.225679397583008) | > loss_duration: 3.1449086666107178 (3.146111488342285) | > loss_1: 41.0895881652832 (40.61700439453125)  --> STEP: 3 | > loss_disc: 2.959726333618164 (2.682096799214681) | > loss_disc_real_0: 0.17505145072937012 (0.2641529440879822) | > loss_disc_real_1: 0.2656741440296173 (0.18802794317404428) | > loss_disc_real_2: 0.2665606439113617 (0.23108161489168802) | > loss_disc_real_3: 0.24615995585918427 (0.29806946218013763) | > loss_disc_real_4: 0.24456609785556793 (0.2631579687198003) | > loss_disc_real_5: 0.2779761850833893 (0.3000080982844035) | > loss_0: 2.959726333618164 (2.682096799214681) | > loss_gen: 1.5237901210784912 (2.161311308542887) | > loss_kl: 2.137807607650757 (4.176399151484172) | > loss_feat: 0.18713559210300446 (4.442008937398593) | > loss_mel: 3.4871397018432617 (16.646166165669758) | > loss_duration: 3.0025949478149414 (3.0982726414998374) | > loss_1: 10.338468551635742 (30.524159113566082) --> EVAL PERFORMANCE | > avg_loader_time: 0.01615428924560547 (-0.0057506561279296875) | > avg_loss_disc: 2.682096799214681 (-0.00438205401102687) | > avg_loss_disc_real_0: 0.2641529440879822 (-0.009008675813674927) | > avg_loss_disc_real_1: 0.18802794317404428 (-0.01680190364519757) | > avg_loss_disc_real_2: 0.23108161489168802 (-0.0428067892789841) | > avg_loss_disc_real_3: 0.29806946218013763 (+0.046001543601353945) | > avg_loss_disc_real_4: 0.2631579687198003 (-0.0592752794424693) | > avg_loss_disc_real_5: 0.3000080982844035 (+0.07768063743909201) | > avg_loss_0: 2.682096799214681 (-0.00438205401102687) | > avg_loss_gen: 2.161311308542887 (-0.09936952590942383) | > avg_loss_kl: 4.176399151484172 (-0.10683608055114746) | > avg_loss_feat: 4.442008937398593 (-1.444546416401863) | > avg_loss_mel: 16.646166165669758 (-6.847975730895996) | > avg_loss_duration: 3.0982726414998374 (-0.029761075973510742) | > avg_loss_1: 30.524159113566082 (-8.5284849802653)  > EPOCH: 827/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:48:52)   --> TIME: 2023-10-20 09:49:12 -- STEP: 29/50 -- GLOBAL_STEP: 94380 | > loss_disc: 2.428473711013794 (2.406817341672963) | > loss_disc_real_0: 0.12763293087482452 (0.14911307821628347) | > loss_disc_real_1: 0.34930044412612915 (0.21206327013928314) | > loss_disc_real_2: 0.3030625581741333 (0.22922091719148488) | > loss_disc_real_3: 0.3446879982948303 (0.24229583336875357) | > loss_disc_real_4: 0.20538268983364105 (0.21612925660507432) | > loss_disc_real_5: 0.2873779535293579 (0.22579300557744914) | > loss_0: 2.428473711013794 (2.406817341672963) | > grad_norm_0: tensor(841.4816, device='cuda:0') (tensor(947.2620, device='cuda:0')) | > loss_gen: 2.7472188472747803 (2.366050707882848) | > loss_kl: 0.9526427984237671 (0.8756880349126356) | > loss_feat: 5.803880214691162 (5.433700039019358) | > loss_mel: 21.77409553527832 (20.810246418262356) | > loss_duration: 1.4131865501403809 (1.4050065114580352) | > loss_1: 32.69102478027344 (30.89069211894068) | > grad_norm_1: tensor(63210.9727, device='cuda:0') (tensor(45385.2773, device='cuda:0')) | > current_lr_0: 8.74673582104522e-05 | > current_lr_1: 8.74673582104522e-05 | > step_time: 0.2777 (0.4808967606774692) | > loader_time: 0.0025 (0.0122817220359013)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9291059970855713 (2.9291059970855713) | > loss_disc_real_0: 0.309587299823761 (0.309587299823761) | > loss_disc_real_1: 0.207691952586174 (0.207691952586174) | > loss_disc_real_2: 0.21585503220558167 (0.21585503220558167) | > loss_disc_real_3: 0.15280364453792572 (0.15280364453792572) | > loss_disc_real_4: 0.4194832742214203 (0.4194832742214203) | > loss_disc_real_5: 0.33394065499305725 (0.33394065499305725) | > loss_0: 2.9291059970855713 (2.9291059970855713) | > loss_gen: 2.1790966987609863 (2.1790966987609863) | > loss_kl: 4.383980751037598 (4.383980751037598) | > loss_feat: 5.6554999351501465 (5.6554999351501465) | > loss_mel: 21.873985290527344 (21.873985290527344) | > loss_duration: 2.82257080078125 (2.82257080078125) | > loss_1: 36.91513442993164 (36.91513442993164)  --> STEP: 1 | > loss_disc: 1.8941254615783691 (1.8941254615783691) | > loss_disc_real_0: 0.13788487017154694 (0.13788487017154694) | > loss_disc_real_1: 0.1848505139350891 (0.1848505139350891) | > loss_disc_real_2: 0.14178690314292908 (0.14178690314292908) | > loss_disc_real_3: 0.1515926569700241 (0.1515926569700241) | > loss_disc_real_4: 0.07876218110322952 (0.07876218110322952) | > loss_disc_real_5: 0.23298588395118713 (0.23298588395118713) | > loss_0: 1.8941254615783691 (1.8941254615783691) | > loss_gen: 2.609231948852539 (2.609231948852539) | > loss_kl: 5.6236252784729 (5.6236252784729) | > loss_feat: 6.841200351715088 (6.841200351715088) | > loss_mel: 26.5064697265625 (26.5064697265625) | > loss_duration: 3.267062187194824 (3.267062187194824) | > loss_1: 44.847591400146484 (44.847591400146484)  --> STEP: 2 | > loss_disc: 2.0607080459594727 (1.977416753768921) | > loss_disc_real_0: 0.11410141736268997 (0.12599314376711845) | > loss_disc_real_1: 0.13958007097244263 (0.16221529245376587) | > loss_disc_real_2: 0.13330866396427155 (0.1375477835536003) | > loss_disc_real_3: 0.1893284171819687 (0.1704605370759964) | > loss_disc_real_4: 0.22510755062103271 (0.15193486586213112) | > loss_disc_real_5: 0.2220839560031891 (0.2275349199771881) | > loss_0: 2.0607080459594727 (1.977416753768921) | > loss_gen: 2.4590940475463867 (2.534162998199463) | > loss_kl: 5.704061031341553 (5.663843154907227) | > loss_feat: 8.661206245422363 (7.751203298568726) | > loss_mel: 24.21538734436035 (25.360928535461426) | > loss_duration: 3.1219918727874756 (3.19452702999115) | > loss_1: 44.161739349365234 (44.50466537475586)  --> STEP: 3 | > loss_disc: 3.402193546295166 (2.4523423512776694) | > loss_disc_real_0: 0.6015331745147705 (0.28450648734966916) | > loss_disc_real_1: 0.315895140171051 (0.2134419083595276) | > loss_disc_real_2: 0.3328447639942169 (0.20264677703380585) | > loss_disc_real_3: 0.3984225392341614 (0.24644787112871805) | > loss_disc_real_4: 0.41039955615997314 (0.23808976262807846) | > loss_disc_real_5: 0.40834182500839233 (0.28780388832092285) | > loss_0: 3.402193546295166 (2.4523423512776694) | > loss_gen: 2.4365553855895996 (2.5016271273295083) | > loss_kl: 2.5997226238250732 (4.642469644546509) | > loss_feat: 3.0707497596740723 (6.191052118937175) | > loss_mel: 23.9112491607666 (24.877702077229817) | > loss_duration: 2.9196090698242188 (3.1028877099355063) | > loss_1: 34.93788528442383 (41.315738677978516) --> EVAL PERFORMANCE | > avg_loader_time: 0.006570895512898763 (-0.009583393732706707) | > avg_loss_disc: 2.4523423512776694 (-0.22975444793701172) | > avg_loss_disc_real_0: 0.28450648734966916 (+0.02035354326168698) | > avg_loss_disc_real_1: 0.2134419083595276 (+0.025413965185483306) | > avg_loss_disc_real_2: 0.20264677703380585 (-0.028434837857882173) | > avg_loss_disc_real_3: 0.24644787112871805 (-0.051621591051419585) | > avg_loss_disc_real_4: 0.23808976262807846 (-0.025068206091721834) | > avg_loss_disc_real_5: 0.28780388832092285 (-0.01220420996348065) | > avg_loss_0: 2.4523423512776694 (-0.22975444793701172) | > avg_loss_gen: 2.5016271273295083 (+0.3403158187866211) | > avg_loss_kl: 4.642469644546509 (+0.46607049306233694) | > avg_loss_feat: 6.191052118937175 (+1.7490431815385818) | > avg_loss_mel: 24.877702077229817 (+8.231535911560059) | > avg_loss_duration: 3.1028877099355063 (+0.004615068435668945) | > avg_loss_1: 41.315738677978516 (+10.791579564412434)  > EPOCH: 828/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:49:36)   --> TIME: 2023-10-20 09:49:49 -- STEP: 9/50 -- GLOBAL_STEP: 94410 | > loss_disc: 2.4060308933258057 (2.3366634051005044) | > loss_disc_real_0: 0.1508127599954605 (0.11286886884934372) | > loss_disc_real_1: 0.28819540143013 (0.2322343753443824) | > loss_disc_real_2: 0.2142632156610489 (0.2211094150940577) | > loss_disc_real_3: 0.5167063474655151 (0.26180363032552934) | > loss_disc_real_4: 0.15174633264541626 (0.20464491699304846) | > loss_disc_real_5: 0.32668089866638184 (0.18187867663800716) | > loss_0: 2.4060308933258057 (2.3366634051005044) | > grad_norm_0: tensor(592.5859, device='cuda:0') (tensor(1096.7581, device='cuda:0')) | > loss_gen: 2.938603639602661 (2.4031912088394165) | > loss_kl: 0.890945315361023 (0.7943323387040032) | > loss_feat: 5.480018615722656 (5.9118280369374485) | > loss_mel: 20.76682472229004 (19.061489635043674) | > loss_duration: 1.365821123123169 (1.412660002708435) | > loss_1: 31.442214965820312 (29.583501285976833) | > grad_norm_1: tensor(22724.5645, device='cuda:0') (tensor(59524.0547, device='cuda:0')) | > current_lr_0: 8.737992910964568e-05 | > current_lr_1: 8.737992910964568e-05 | > step_time: 0.8778 (0.7698268625471327) | > loader_time: 0.0265 (0.029711167017618816)  --> TIME: 2023-10-20 09:50:07 -- STEP: 39/50 -- GLOBAL_STEP: 94440 | > loss_disc: 2.3844895362854004 (2.4018854911510763) | > loss_disc_real_0: 0.20022344589233398 (0.14074083575262472) | > loss_disc_real_1: 0.2439446598291397 (0.21748969436455995) | > loss_disc_real_2: 0.23541413247585297 (0.20472097540130982) | > loss_disc_real_3: 0.40800172090530396 (0.23905371301449263) | > loss_disc_real_4: 0.2549959421157837 (0.22126103674945158) | > loss_disc_real_5: 0.15992720425128937 (0.21246843102077642) | > loss_0: 2.3844895362854004 (2.4018854911510763) | > grad_norm_0: tensor(1973.6768, device='cuda:0') (tensor(1075.6010, device='cuda:0')) | > loss_gen: 2.961002826690674 (2.312570547446227) | > loss_kl: 0.2694362998008728 (0.7882660489815932) | > loss_feat: 5.236515998840332 (5.659187152026555) | > loss_mel: 21.133346557617188 (20.964655014184807) | > loss_duration: 1.3906848430633545 (1.3898168221498146) | > loss_1: 30.990985870361328 (31.1144954485771) | > grad_norm_1: tensor(33053.7852, device='cuda:0') (tensor(38036.8594, device='cuda:0')) | > current_lr_0: 8.737992910964568e-05 | > current_lr_1: 8.737992910964568e-05 | > step_time: 0.5819 (0.6165041373326227) | > loader_time: 0.0248 (0.023185033064622145)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4572372436523438 (2.4572372436523438) | > loss_disc_real_0: 0.12887701392173767 (0.12887701392173767) | > loss_disc_real_1: 0.19391030073165894 (0.19391030073165894) | > loss_disc_real_2: 0.2315860092639923 (0.2315860092639923) | > loss_disc_real_3: 0.15521757304668427 (0.15521757304668427) | > loss_disc_real_4: 0.16479264199733734 (0.16479264199733734) | > loss_disc_real_5: 0.23232008516788483 (0.23232008516788483) | > loss_0: 2.4572372436523438 (2.4572372436523438) | > loss_gen: 2.0261831283569336 (2.0261831283569336) | > loss_kl: 6.107294082641602 (6.107294082641602) | > loss_feat: 7.376401901245117 (7.376401901245117) | > loss_mel: 23.365509033203125 (23.365509033203125) | > loss_duration: 2.8881022930145264 (2.8881022930145264) | > loss_1: 41.763492584228516 (41.763492584228516)  --> STEP: 1 | > loss_disc: 2.5923919677734375 (2.5923919677734375) | > loss_disc_real_0: 0.10772018879652023 (0.10772018879652023) | > loss_disc_real_1: 0.282385915517807 (0.282385915517807) | > loss_disc_real_2: 0.18144457042217255 (0.18144457042217255) | > loss_disc_real_3: 0.2451520413160324 (0.2451520413160324) | > loss_disc_real_4: 0.26620233058929443 (0.26620233058929443) | > loss_disc_real_5: 0.2594810426235199 (0.2594810426235199) | > loss_0: 2.5923919677734375 (2.5923919677734375) | > loss_gen: 2.1138994693756104 (2.1138994693756104) | > loss_kl: 4.973097324371338 (4.973097324371338) | > loss_feat: 4.025583267211914 (4.025583267211914) | > loss_mel: 24.12623405456543 (24.12623405456543) | > loss_duration: 3.2145872116088867 (3.2145872116088867) | > loss_1: 38.45340347290039 (38.45340347290039)  --> STEP: 2 | > loss_disc: 2.512557029724121 (2.5524744987487793) | > loss_disc_real_0: 0.18797726929187775 (0.147848729044199) | > loss_disc_real_1: 0.21674789488315582 (0.24956690520048141) | > loss_disc_real_2: 0.19159556925296783 (0.1865200698375702) | > loss_disc_real_3: 0.27255162596702576 (0.2588518336415291) | > loss_disc_real_4: 0.2731868326663971 (0.26969458162784576) | > loss_disc_real_5: 0.22803784906864166 (0.24375944584608078) | > loss_0: 2.512557029724121 (2.5524744987487793) | > loss_gen: 2.3499038219451904 (2.2319016456604004) | > loss_kl: 5.242030143737793 (5.107563734054565) | > loss_feat: 6.793883323669434 (5.409733295440674) | > loss_mel: 22.604454040527344 (23.365344047546387) | > loss_duration: 3.1275954246520996 (3.171091318130493) | > loss_1: 40.117862701416016 (39.2856330871582)  --> STEP: 3 | > loss_disc: 3.499277353286743 (2.868075450261434) | > loss_disc_real_0: 0.15136879682540894 (0.14902208497126898) | > loss_disc_real_1: 0.3108316659927368 (0.2699884921312332) | > loss_disc_real_2: 0.23229356110095978 (0.20177790025870004) | > loss_disc_real_3: 0.6186052560806274 (0.3787696411212285) | > loss_disc_real_4: 0.49217087030410767 (0.34385334451993305) | > loss_disc_real_5: 0.497793972492218 (0.3284376213947932) | > loss_0: 3.499277353286743 (2.868075450261434) | > loss_gen: 2.004007577896118 (2.1559369564056396) | > loss_kl: 2.44222092628479 (4.219116131464641) | > loss_feat: 4.856005668640137 (5.225157419840495) | > loss_mel: 22.43330192565918 (23.054663340250652) | > loss_duration: 2.943885087966919 (3.0953559080759683) | > loss_1: 34.679420471191406 (37.75022888183594) --> EVAL PERFORMANCE | > avg_loader_time: 0.015689373016357422 (+0.00911847750345866) | > avg_loss_disc: 2.868075450261434 (+0.41573309898376465) | > avg_loss_disc_real_0: 0.14902208497126898 (-0.13548440237840018) | > avg_loss_disc_real_1: 0.2699884921312332 (+0.05654658377170563) | > avg_loss_disc_real_2: 0.20177790025870004 (-0.0008688767751058035) | > avg_loss_disc_real_3: 0.3787696411212285 (+0.13232176999251047) | > avg_loss_disc_real_4: 0.34385334451993305 (+0.10576358189185459) | > avg_loss_disc_real_5: 0.3284376213947932 (+0.04063373307387036) | > avg_loss_0: 2.868075450261434 (+0.41573309898376465) | > avg_loss_gen: 2.1559369564056396 (-0.34569017092386867) | > avg_loss_kl: 4.219116131464641 (-0.4233535130818682) | > avg_loss_feat: 5.225157419840495 (-0.9658946990966797) | > avg_loss_mel: 23.054663340250652 (-1.8230387369791643) | > avg_loss_duration: 3.0953559080759683 (-0.0075318018595380565) | > avg_loss_1: 37.75022888183594 (-3.565509796142578)  > EPOCH: 829/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:50:30)   --> TIME: 2023-10-20 09:50:55 -- STEP: 19/50 -- GLOBAL_STEP: 94470 | > loss_disc: 2.168769121170044 (2.2725326450247514) | > loss_disc_real_0: 0.26323631405830383 (0.1348835504368732) | > loss_disc_real_1: 0.24650989472866058 (0.23344707018450686) | > loss_disc_real_2: 0.17336419224739075 (0.22295702680161125) | > loss_disc_real_3: 0.0844632163643837 (0.2409177602905976) | > loss_disc_real_4: 0.11450840532779694 (0.21123182695162923) | > loss_disc_real_5: 0.1629466414451599 (0.20799440223919718) | > loss_0: 2.168769121170044 (2.2725326450247514) | > grad_norm_0: tensor(1454.0995, device='cuda:0') (tensor(983.4803, device='cuda:0')) | > loss_gen: 2.2032644748687744 (2.5722472291243705) | > loss_kl: 0.8067706227302551 (0.8329397565440128) | > loss_feat: 5.987414836883545 (6.180335703452951) | > loss_mel: 24.931793212890625 (21.668777616400465) | > loss_duration: 1.4861650466918945 (1.4139026591652317) | > loss_1: 35.415409088134766 (32.66820305272152) | > grad_norm_1: tensor(36571.4219, device='cuda:0') (tensor(51746.8828, device='cuda:0')) | > current_lr_0: 8.729258739969929e-05 | > current_lr_1: 8.729258739969929e-05 | > step_time: 0.3714 (0.6954527654145893) | > loader_time: 0.0019 (0.02260043746546695)  --> TIME: 2023-10-20 09:51:15 -- STEP: 49/50 -- GLOBAL_STEP: 94500 | > loss_disc: 2.785719871520996 (2.34733831152624) | > loss_disc_real_0: 0.16581034660339355 (0.13783966909561837) | > loss_disc_real_1: 0.264362096786499 (0.22559679778558867) | > loss_disc_real_2: 0.30115360021591187 (0.21938874823402385) | > loss_disc_real_3: 0.2341710329055786 (0.2327707123999693) | > loss_disc_real_4: 0.2540709376335144 (0.22625806562754572) | > loss_disc_real_5: 0.2896259129047394 (0.22913899707931037) | > loss_0: 2.785719871520996 (2.34733831152624) | > grad_norm_0: tensor(1027.3414, device='cuda:0') (tensor(1113.3870, device='cuda:0')) | > loss_gen: 1.8333909511566162 (2.464123443681367) | > loss_kl: 0.5696895122528076 (0.8217682795865195) | > loss_feat: 0.8869110941886902 (6.028478941519041) | > loss_mel: 18.35384178161621 (21.11794944198764) | > loss_duration: 1.5051045417785645 (1.3838451808812666) | > loss_1: 23.148937225341797 (31.816165310995913) | > grad_norm_1: tensor(8261.4990, device='cuda:0') (tensor(39230.0625, device='cuda:0')) | > current_lr_0: 8.729258739969929e-05 | > current_lr_1: 8.729258739969929e-05 | > step_time: 0.7463 (0.6611265795571464) | > loader_time: 0.443 (0.027299919906927615)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3699779510498047 (2.3699779510498047) | > loss_disc_real_0: 0.14480379223823547 (0.14480379223823547) | > loss_disc_real_1: 0.175594300031662 (0.175594300031662) | > loss_disc_real_2: 0.17511439323425293 (0.17511439323425293) | > loss_disc_real_3: 0.28891727328300476 (0.28891727328300476) | > loss_disc_real_4: 0.10994917154312134 (0.10994917154312134) | > loss_disc_real_5: 0.290953665971756 (0.290953665971756) | > loss_0: 2.3699779510498047 (2.3699779510498047) | > loss_gen: 2.0596022605895996 (2.0596022605895996) | > loss_kl: 4.6371989250183105 (4.6371989250183105) | > loss_feat: 5.854550838470459 (5.854550838470459) | > loss_mel: 21.91465950012207 (21.91465950012207) | > loss_duration: 2.8551223278045654 (2.8551223278045654) | > loss_1: 37.32113265991211 (37.32113265991211)  --> STEP: 1 | > loss_disc: 2.970337390899658 (2.970337390899658) | > loss_disc_real_0: 0.19145037233829498 (0.19145037233829498) | > loss_disc_real_1: 0.28575265407562256 (0.28575265407562256) | > loss_disc_real_2: 0.20715497434139252 (0.20715497434139252) | > loss_disc_real_3: 0.3047776222229004 (0.3047776222229004) | > loss_disc_real_4: 0.2767443060874939 (0.2767443060874939) | > loss_disc_real_5: 0.35731983184814453 (0.35731983184814453) | > loss_0: 2.970337390899658 (2.970337390899658) | > loss_gen: 1.9793176651000977 (1.9793176651000977) | > loss_kl: 4.660560131072998 (4.660560131072998) | > loss_feat: 6.5036845207214355 (6.5036845207214355) | > loss_mel: 24.74795150756836 (24.74795150756836) | > loss_duration: 3.236293315887451 (3.236293315887451) | > loss_1: 41.1278076171875 (41.1278076171875)  --> STEP: 2 | > loss_disc: 3.016002655029297 (2.9931700229644775) | > loss_disc_real_0: 0.3081215023994446 (0.24978593736886978) | > loss_disc_real_1: 0.2770187258720398 (0.2813856899738312) | > loss_disc_real_2: 0.26512616872787476 (0.23614057153463364) | > loss_disc_real_3: 0.23064906895160675 (0.26771334558725357) | > loss_disc_real_4: 0.25901126861572266 (0.2678777873516083) | > loss_disc_real_5: 0.29614460468292236 (0.32673221826553345) | > loss_0: 3.016002655029297 (2.9931700229644775) | > loss_gen: 1.6348962783813477 (1.8071069717407227) | > loss_kl: 5.4030561447143555 (5.031808137893677) | > loss_feat: 0.12138891965150833 (3.312536720186472) | > loss_mel: 4.7482523918151855 (14.748101949691772) | > loss_duration: 3.0528488159179688 (3.14457106590271) | > loss_1: 14.960442543029785 (28.044125080108643)  --> STEP: 3 | > loss_disc: 3.01647686958313 (3.000938971837362) | > loss_disc_real_0: 0.353696346282959 (0.28442274034023285) | > loss_disc_real_1: 0.2821171283721924 (0.2816295027732849) | > loss_disc_real_2: 0.24596695601940155 (0.23941603302955627) | > loss_disc_real_3: 0.24018104374408722 (0.25853591163953143) | > loss_disc_real_4: 0.2876264750957489 (0.27446068326632184) | > loss_disc_real_5: 0.28428196907043457 (0.3125821352005005) | > loss_0: 3.01647686958313 (3.000938971837362) | > loss_gen: 1.707376480102539 (1.7738634745279949) | > loss_kl: 2.4707581996917725 (4.178124825159709) | > loss_feat: 0.3892068564891815 (2.338093432287375) | > loss_mel: 4.835590839385986 (11.443931579589844) | > loss_duration: 2.865696430206299 (3.0516128540039062) | > loss_1: 12.26862907409668 (22.78562641143799) --> EVAL PERFORMANCE | > avg_loader_time: 0.011403322219848633 (-0.004286050796508789) | > avg_loss_disc: 3.000938971837362 (+0.13286352157592773) | > avg_loss_disc_real_0: 0.28442274034023285 (+0.13540065536896387) | > avg_loss_disc_real_1: 0.2816295027732849 (+0.011641010642051697) | > avg_loss_disc_real_2: 0.23941603302955627 (+0.03763813277085623) | > avg_loss_disc_real_3: 0.25853591163953143 (-0.12023372948169708) | > avg_loss_disc_real_4: 0.27446068326632184 (-0.06939266125361121) | > avg_loss_disc_real_5: 0.3125821352005005 (-0.015855486194292723) | > avg_loss_0: 3.000938971837362 (+0.13286352157592773) | > avg_loss_gen: 1.7738634745279949 (-0.3820734818776448) | > avg_loss_kl: 4.178124825159709 (-0.04099130630493164) | > avg_loss_feat: 2.338093432287375 (-2.88706398755312) | > avg_loss_mel: 11.443931579589844 (-11.610731760660808) | > avg_loss_duration: 3.0516128540039062 (-0.043743054072062026) | > avg_loss_1: 22.78562641143799 (-14.96460247039795)  > EPOCH: 830/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:51:40)   --> TIME: 2023-10-20 09:52:03 -- STEP: 29/50 -- GLOBAL_STEP: 94530 | > loss_disc: 2.5961084365844727 (2.4065374547037583) | > loss_disc_real_0: 0.2573922872543335 (0.15962536456384535) | > loss_disc_real_1: 0.23120135068893433 (0.22978069915853697) | > loss_disc_real_2: 0.28198790550231934 (0.21812988252475343) | > loss_disc_real_3: 0.3760763704776764 (0.242256596299081) | > loss_disc_real_4: 0.41621193289756775 (0.20978268287305174) | > loss_disc_real_5: 0.25354254245758057 (0.20731925617518096) | > loss_0: 2.5961084365844727 (2.4065374547037583) | > grad_norm_0: tensor(763.7286, device='cuda:0') (tensor(1445.9569, device='cuda:0')) | > loss_gen: 2.7581281661987305 (2.431411069014976) | > loss_kl: 0.9030953049659729 (0.85934936075375) | > loss_feat: 5.23552942276001 (5.6052372498951595) | > loss_mel: 22.002361297607422 (19.627381250776093) | > loss_duration: 1.3251664638519287 (1.3962055650250664) | > loss_1: 32.22427749633789 (29.919584159193366) | > grad_norm_1: tensor(31769.1758, device='cuda:0') (tensor(57345.4492, device='cuda:0')) | > current_lr_0: 8.720533299326044e-05 | > current_lr_1: 8.720533299326044e-05 | > step_time: 0.367 (0.5601376911689495) | > loader_time: 0.0021 (0.01674109491808661)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.245166540145874 (2.245166540145874) | > loss_disc_real_0: 0.14436672627925873 (0.14436672627925873) | > loss_disc_real_1: 0.16455061733722687 (0.16455061733722687) | > loss_disc_real_2: 0.0966525748372078 (0.0966525748372078) | > loss_disc_real_3: 0.05661880224943161 (0.05661880224943161) | > loss_disc_real_4: 0.029399340972304344 (0.029399340972304344) | > loss_disc_real_5: 0.14631493389606476 (0.14631493389606476) | > loss_0: 2.245166540145874 (2.245166540145874) | > loss_gen: 1.6803882122039795 (1.6803882122039795) | > loss_kl: 5.2147746086120605 (5.2147746086120605) | > loss_feat: 10.408202171325684 (10.408202171325684) | > loss_mel: 24.386886596679688 (24.386886596679688) | > loss_duration: 2.894627332687378 (2.894627332687378) | > loss_1: 44.58488082885742 (44.58488082885742)  --> STEP: 1 | > loss_disc: 2.599465847015381 (2.599465847015381) | > loss_disc_real_0: 0.17306455969810486 (0.17306455969810486) | > loss_disc_real_1: 0.20424765348434448 (0.20424765348434448) | > loss_disc_real_2: 0.1707797646522522 (0.1707797646522522) | > loss_disc_real_3: 0.17192226648330688 (0.17192226648330688) | > loss_disc_real_4: 0.35052645206451416 (0.35052645206451416) | > loss_disc_real_5: 0.340909868478775 (0.340909868478775) | > loss_0: 2.599465847015381 (2.599465847015381) | > loss_gen: 2.5731115341186523 (2.5731115341186523) | > loss_kl: 4.594671726226807 (4.594671726226807) | > loss_feat: 8.059755325317383 (8.059755325317383) | > loss_mel: 24.204057693481445 (24.204057693481445) | > loss_duration: 3.200543165206909 (3.200543165206909) | > loss_1: 42.632137298583984 (42.632137298583984)  --> STEP: 2 | > loss_disc: 2.170984983444214 (2.3852254152297974) | > loss_disc_real_0: 0.23273856937885284 (0.20290156453847885) | > loss_disc_real_1: 0.24702371656894684 (0.22563568502664566) | > loss_disc_real_2: 0.030878378078341484 (0.10082907136529684) | > loss_disc_real_3: 0.18370194733142853 (0.1778121069073677) | > loss_disc_real_4: 0.24363546073436737 (0.29708095639944077) | > loss_disc_real_5: 0.17782828211784363 (0.2593690752983093) | > loss_0: 2.170984983444214 (2.3852254152297974) | > loss_gen: 2.744439125061035 (2.6587753295898438) | > loss_kl: 5.3896355628967285 (4.992153644561768) | > loss_feat: 8.382708549499512 (8.221231937408447) | > loss_mel: 28.048683166503906 (26.126370429992676) | > loss_duration: 3.1146090030670166 (3.157576084136963) | > loss_1: 47.680076599121094 (45.15610694885254)  --> STEP: 3 | > loss_disc: 3.3617730140686035 (2.7107412815093994) | > loss_disc_real_0: 0.23206105828285217 (0.2126213957866033) | > loss_disc_real_1: 0.4111591577529907 (0.287476842602094) | > loss_disc_real_2: 0.3513983190059662 (0.18435215391218662) | > loss_disc_real_3: 0.31879928708076477 (0.2248078336318334) | > loss_disc_real_4: 0.507088840007782 (0.3670835842688878) | > loss_disc_real_5: 0.4122467637062073 (0.31032830476760864) | > loss_0: 3.3617730140686035 (2.7107412815093994) | > loss_gen: 2.1162235736846924 (2.4779247442881265) | > loss_kl: 1.9843813180923462 (3.9895628690719604) | > loss_feat: 4.179494857788086 (6.87398624420166) | > loss_mel: 21.882247924804688 (24.711662928263348) | > loss_duration: 2.958207368850708 (3.0911198457082114) | > loss_1: 33.12055587768555 (41.144256591796875) --> EVAL PERFORMANCE | > avg_loader_time: 0.00698399543762207 (-0.0044193267822265625) | > avg_loss_disc: 2.7107412815093994 (-0.2901976903279624) | > avg_loss_disc_real_0: 0.2126213957866033 (-0.07180134455362955) | > avg_loss_disc_real_1: 0.287476842602094 (+0.005847339828809084) | > avg_loss_disc_real_2: 0.18435215391218662 (-0.05506387911736965) | > avg_loss_disc_real_3: 0.2248078336318334 (-0.03372807800769803) | > avg_loss_disc_real_4: 0.3670835842688878 (+0.09262290100256598) | > avg_loss_disc_real_5: 0.31032830476760864 (-0.0022538304328918457) | > avg_loss_0: 2.7107412815093994 (-0.2901976903279624) | > avg_loss_gen: 2.4779247442881265 (+0.7040612697601316) | > avg_loss_kl: 3.9895628690719604 (-0.1885619560877485) | > avg_loss_feat: 6.87398624420166 (+4.535892811914286) | > avg_loss_mel: 24.711662928263348 (+13.267731348673504) | > avg_loss_duration: 3.0911198457082114 (+0.03950699170430516) | > avg_loss_1: 41.144256591796875 (+18.358630180358887)  > EPOCH: 831/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:52:34)   --> TIME: 2023-10-20 09:52:46 -- STEP: 9/50 -- GLOBAL_STEP: 94560 | > loss_disc: 2.721158981323242 (2.4258273310131497) | > loss_disc_real_0: 0.21538087725639343 (0.13609974458813667) | > loss_disc_real_1: 0.24695417284965515 (0.22019640646047062) | > loss_disc_real_2: 0.2720058262348175 (0.2013964085943169) | > loss_disc_real_3: 0.2559111416339874 (0.20629428658220503) | > loss_disc_real_4: 0.12198497354984283 (0.2099564452138212) | > loss_disc_real_5: 0.26034510135650635 (0.2261738989295231) | > loss_0: 2.721158981323242 (2.4258273310131497) | > grad_norm_0: tensor(536.3008, device='cuda:0') (tensor(550.5829, device='cuda:0')) | > loss_gen: 2.257740020751953 (2.2871181435055203) | > loss_kl: 0.7025279998779297 (0.49237896336449516) | > loss_feat: 5.8180670738220215 (6.38366421063741) | > loss_mel: 20.676969528198242 (21.691257688734268) | > loss_duration: 1.327492594718933 (1.3820358647240534) | > loss_1: 30.78279685974121 (32.23645528157552) | > grad_norm_1: tensor(4307.3750, device='cuda:0') (tensor(17920.6484, device='cuda:0')) | > current_lr_0: 8.711816580306374e-05 | > current_lr_1: 8.711816580306374e-05 | > step_time: 0.5108 (0.5856614377763536) | > loader_time: 0.0255 (0.025535424550374348)  --> TIME: 2023-10-20 09:53:08 -- STEP: 39/50 -- GLOBAL_STEP: 94590 | > loss_disc: 2.464331865310669 (2.3365266231390143) | > loss_disc_real_0: 0.03734232857823372 (0.15096995492394158) | > loss_disc_real_1: 0.07541253417730331 (0.21353727894333693) | > loss_disc_real_2: 0.13943594694137573 (0.2022976882946797) | > loss_disc_real_3: 0.08892704546451569 (0.23367259508142105) | > loss_disc_real_4: 0.13705937564373016 (0.18896650990996608) | > loss_disc_real_5: 0.23719853162765503 (0.20843412428616714) | > loss_0: 2.464331865310669 (2.3365266231390143) | > grad_norm_0: tensor(675.0952, device='cuda:0') (tensor(629.7646, device='cuda:0')) | > loss_gen: 1.7939578294754028 (2.3384047685525355) | > loss_kl: 0.5147762298583984 (0.7783788962241931) | > loss_feat: 8.907977104187012 (5.928844741235177) | > loss_mel: 25.771093368530273 (21.024019473638294) | > loss_duration: 1.4404813051223755 (1.3767836858064701) | > loss_1: 38.428287506103516 (31.44643168571668) | > grad_norm_1: tensor(9534.9336, device='cuda:0') (tensor(22247.1270, device='cuda:0')) | > current_lr_0: 8.711816580306374e-05 | > current_lr_1: 8.711816580306374e-05 | > step_time: 0.5985 (0.6933979193369547) | > loader_time: 0.0247 (0.025900724606636245)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6656930446624756 (2.6656930446624756) | > loss_disc_real_0: 0.09610456228256226 (0.09610456228256226) | > loss_disc_real_1: 0.13998226821422577 (0.13998226821422577) | > loss_disc_real_2: 0.19386699795722961 (0.19386699795722961) | > loss_disc_real_3: 0.2560584545135498 (0.2560584545135498) | > loss_disc_real_4: 0.20010265707969666 (0.20010265707969666) | > loss_disc_real_5: 0.20690754055976868 (0.20690754055976868) | > loss_0: 2.6656930446624756 (2.6656930446624756) | > loss_gen: 1.5657896995544434 (1.5657896995544434) | > loss_kl: 4.659125804901123 (4.659125804901123) | > loss_feat: 3.3037009239196777 (3.3037009239196777) | > loss_mel: 22.632034301757812 (22.632034301757812) | > loss_duration: 2.9002280235290527 (2.9002280235290527) | > loss_1: 35.060874938964844 (35.060874938964844)  --> STEP: 1 | > loss_disc: 2.323293447494507 (2.323293447494507) | > loss_disc_real_0: 0.09520994126796722 (0.09520994126796722) | > loss_disc_real_1: 0.23068371415138245 (0.23068371415138245) | > loss_disc_real_2: 0.2218085378408432 (0.2218085378408432) | > loss_disc_real_3: 0.19715780019760132 (0.19715780019760132) | > loss_disc_real_4: 0.27987369894981384 (0.27987369894981384) | > loss_disc_real_5: 0.17895328998565674 (0.17895328998565674) | > loss_0: 2.323293447494507 (2.323293447494507) | > loss_gen: 2.1728031635284424 (2.1728031635284424) | > loss_kl: 5.10673713684082 (5.10673713684082) | > loss_feat: 5.040286064147949 (5.040286064147949) | > loss_mel: 24.413366317749023 (24.413366317749023) | > loss_duration: 3.382253646850586 (3.382253646850586) | > loss_1: 40.115447998046875 (40.115447998046875)  --> STEP: 2 | > loss_disc: 2.939556121826172 (2.6314247846603394) | > loss_disc_real_0: 0.03527810424566269 (0.06524402275681496) | > loss_disc_real_1: 0.20652540028095245 (0.21860455721616745) | > loss_disc_real_2: 0.23155663907527924 (0.22668258845806122) | > loss_disc_real_3: 0.27493733167648315 (0.23604756593704224) | > loss_disc_real_4: 0.23662365972995758 (0.2582486793398857) | > loss_disc_real_5: 0.27297720313072205 (0.2259652465581894) | > loss_0: 2.939556121826172 (2.6314247846603394) | > loss_gen: 1.381420612335205 (1.7771118879318237) | > loss_kl: 5.120887756347656 (5.113812446594238) | > loss_feat: 0.5714371800422668 (2.805861622095108) | > loss_mel: 22.21440315246582 (23.313884735107422) | > loss_duration: 3.147714614868164 (3.264984130859375) | > loss_1: 32.43586349487305 (36.27565574645996)  --> STEP: 3 | > loss_disc: 2.9535999298095703 (2.738816499710083) | > loss_disc_real_0: 0.10725449025630951 (0.07924751192331314) | > loss_disc_real_1: 0.22307467460632324 (0.2200945963462194) | > loss_disc_real_2: 0.27973616123199463 (0.24436711271603903) | > loss_disc_real_3: 0.2941698729991913 (0.2554216682910919) | > loss_disc_real_4: 0.2761293053627014 (0.2642088880141576) | > loss_disc_real_5: 0.2748221158981323 (0.2422508696715037) | > loss_0: 2.9535999298095703 (2.738816499710083) | > loss_gen: 1.5584036111831665 (1.7042091290156047) | > loss_kl: 2.6808111667633057 (4.302812019983928) | > loss_feat: 0.7933355569839478 (2.135019600391388) | > loss_mel: 16.10842514038086 (20.912064870198567) | > loss_duration: 2.9676597118377686 (3.1658759911855063) | > loss_1: 24.10863494873047 (32.2199821472168) --> EVAL PERFORMANCE | > avg_loader_time: 0.012306451797485352 (+0.005322456359863281) | > avg_loss_disc: 2.738816499710083 (+0.028075218200683594) | > avg_loss_disc_real_0: 0.07924751192331314 (-0.13337388386329016) | > avg_loss_disc_real_1: 0.2200945963462194 (-0.0673822462558746) | > avg_loss_disc_real_2: 0.24436711271603903 (+0.06001495880385241) | > avg_loss_disc_real_3: 0.2554216682910919 (+0.030613834659258515) | > avg_loss_disc_real_4: 0.2642088880141576 (-0.10287469625473022) | > avg_loss_disc_real_5: 0.2422508696715037 (-0.06807743509610495) | > avg_loss_0: 2.738816499710083 (+0.028075218200683594) | > avg_loss_gen: 1.7042091290156047 (-0.7737156152725218) | > avg_loss_kl: 4.302812019983928 (+0.31324915091196726) | > avg_loss_feat: 2.135019600391388 (-4.738966643810272) | > avg_loss_mel: 20.912064870198567 (-3.799598058064781) | > avg_loss_duration: 3.1658759911855063 (+0.07475614547729492) | > avg_loss_1: 32.2199821472168 (-8.924274444580078)  > EPOCH: 832/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:53:30)   --> TIME: 2023-10-20 09:53:50 -- STEP: 19/50 -- GLOBAL_STEP: 94620 | > loss_disc: 3.053605794906616 (2.3056973720851697) | > loss_disc_real_0: 0.299242228269577 (0.13366654877992054) | > loss_disc_real_1: 0.2507893145084381 (0.19035672592489342) | > loss_disc_real_2: 0.25036561489105225 (0.2235286478933535) | > loss_disc_real_3: 0.2717837989330292 (0.21949150550522303) | > loss_disc_real_4: 0.25724390149116516 (0.20764203448044627) | > loss_disc_real_5: 0.27304741740226746 (0.21648321751701205) | > loss_0: 3.053605794906616 (2.3056973720851697) | > grad_norm_0: tensor(537.6561, device='cuda:0') (tensor(559.1089, device='cuda:0')) | > loss_gen: 1.5448211431503296 (2.4771758129722192) | > loss_kl: 0.9680739641189575 (0.8146822515286898) | > loss_feat: 0.36201655864715576 (6.103522578744512) | > loss_mel: 2.6414761543273926 (20.31507962628415) | > loss_duration: 1.486543893814087 (1.4080119446704262) | > loss_1: 7.002931594848633 (31.11847230007774) | > grad_norm_1: tensor(11570.4062, device='cuda:0') (tensor(25679.5293, device='cuda:0')) | > current_lr_0: 8.703108574193112e-05 | > current_lr_1: 8.703108574193112e-05 | > step_time: 0.7823 (0.7792112952784488) | > loader_time: 0.0366 (0.029319148314626592)  --> TIME: 2023-10-20 09:54:09 -- STEP: 49/50 -- GLOBAL_STEP: 94650 | > loss_disc: 2.6155948638916016 (2.36489379162691) | > loss_disc_real_0: 0.13059312105178833 (0.14751848551843852) | > loss_disc_real_1: 0.2747642993927002 (0.2162801765893795) | > loss_disc_real_2: 0.31323182582855225 (0.22480575086510912) | > loss_disc_real_3: 0.36116087436676025 (0.2420246854272424) | > loss_disc_real_4: 0.2583235204219818 (0.2150624000600406) | > loss_disc_real_5: 0.30652812123298645 (0.2116389521872815) | > loss_0: 2.6155948638916016 (2.36489379162691) | > grad_norm_0: tensor(442.1895, device='cuda:0') (tensor(671.1769, device='cuda:0')) | > loss_gen: 2.521674871444702 (2.438028505870274) | > loss_kl: 0.882289707660675 (0.8129710999070382) | > loss_feat: 4.508417129516602 (5.978182984554038) | > loss_mel: 21.907278060913086 (21.023091055908992) | > loss_duration: 1.5011839866638184 (1.3739754448131638) | > loss_1: 31.320844650268555 (31.62624915765256) | > grad_norm_1: tensor(10091.0879, device='cuda:0') (tensor(20766.4961, device='cuda:0')) | > current_lr_0: 8.703108574193112e-05 | > current_lr_1: 8.703108574193112e-05 | > step_time: 0.8487 (0.6768888697332266) | > loader_time: 0.3972 (0.0288456848689488)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0030465126037598 (3.0030465126037598) | > loss_disc_real_0: 0.26740917563438416 (0.26740917563438416) | > loss_disc_real_1: 0.3275185227394104 (0.3275185227394104) | > loss_disc_real_2: 0.36243700981140137 (0.36243700981140137) | > loss_disc_real_3: 0.2332243174314499 (0.2332243174314499) | > loss_disc_real_4: 0.47088631987571716 (0.47088631987571716) | > loss_disc_real_5: 0.3422769010066986 (0.3422769010066986) | > loss_0: 3.0030465126037598 (3.0030465126037598) | > loss_gen: 2.4314322471618652 (2.4314322471618652) | > loss_kl: 4.417874336242676 (4.417874336242676) | > loss_feat: 6.388454914093018 (6.388454914093018) | > loss_mel: 23.138307571411133 (23.138307571411133) | > loss_duration: 2.874554395675659 (2.874554395675659) | > loss_1: 39.2506217956543 (39.2506217956543)  --> STEP: 1 | > loss_disc: 2.710653305053711 (2.710653305053711) | > loss_disc_real_0: 0.29979729652404785 (0.29979729652404785) | > loss_disc_real_1: 0.3605601489543915 (0.3605601489543915) | > loss_disc_real_2: 0.2430848628282547 (0.2430848628282547) | > loss_disc_real_3: 0.31185412406921387 (0.31185412406921387) | > loss_disc_real_4: 0.3337894678115845 (0.3337894678115845) | > loss_disc_real_5: 0.3268195688724518 (0.3268195688724518) | > loss_0: 2.710653305053711 (2.710653305053711) | > loss_gen: 2.74454927444458 (2.74454927444458) | > loss_kl: 4.812838077545166 (4.812838077545166) | > loss_feat: 6.867702007293701 (6.867702007293701) | > loss_mel: 22.57680320739746 (22.57680320739746) | > loss_duration: 3.3035340309143066 (3.3035340309143066) | > loss_1: 40.30542755126953 (40.30542755126953)  --> STEP: 2 | > loss_disc: 2.833132028579712 (2.7718926668167114) | > loss_disc_real_0: 0.13531851768493652 (0.2175579071044922) | > loss_disc_real_1: 0.21782444417476654 (0.289192296564579) | > loss_disc_real_2: 0.23686738312244415 (0.23997612297534943) | > loss_disc_real_3: 0.20614075660705566 (0.25899744033813477) | > loss_disc_real_4: 0.31629517674446106 (0.32504232227802277) | > loss_disc_real_5: 0.30256280303001404 (0.3146911859512329) | > loss_0: 2.833132028579712 (2.7718926668167114) | > loss_gen: 1.7092382907867432 (2.2268937826156616) | > loss_kl: 5.371417045593262 (5.092127561569214) | > loss_feat: 3.8954107761383057 (5.381556391716003) | > loss_mel: 23.70616340637207 (23.141483306884766) | > loss_duration: 3.091066360473633 (3.1973001956939697) | > loss_1: 37.77330017089844 (39.039363861083984)  --> STEP: 3 | > loss_disc: 2.262282371520996 (2.602022568384806) | > loss_disc_real_0: 0.031166642904281616 (0.155427485704422) | > loss_disc_real_1: 0.27043402194976807 (0.28293953835964203) | > loss_disc_real_2: 0.21050648391246796 (0.23015290995438895) | > loss_disc_real_3: 0.22306762635707855 (0.24702083567778269) | > loss_disc_real_4: 0.15319354832172394 (0.26775939762592316) | > loss_disc_real_5: 0.11270809918642044 (0.2473634903629621) | > loss_0: 2.262282371520996 (2.602022568384806) | > loss_gen: 1.8815770149230957 (2.111788193384806) | > loss_kl: 2.6920573711395264 (4.292104164759318) | > loss_feat: 3.341071367263794 (4.701394716898601) | > loss_mel: 20.075519561767578 (22.119495391845703) | > loss_duration: 2.921649694442749 (3.105416695276896) | > loss_1: 30.911874771118164 (36.330200831095375) --> EVAL PERFORMANCE | > avg_loader_time: 0.013775984446207682 (+0.0014695326487223302) | > avg_loss_disc: 2.602022568384806 (-0.13679393132527684) | > avg_loss_disc_real_0: 0.155427485704422 (+0.07617997378110886) | > avg_loss_disc_real_1: 0.28293953835964203 (+0.06284494201342264) | > avg_loss_disc_real_2: 0.23015290995438895 (-0.014214202761650085) | > avg_loss_disc_real_3: 0.24702083567778269 (-0.008400832613309234) | > avg_loss_disc_real_4: 0.26775939762592316 (+0.003550509611765562) | > avg_loss_disc_real_5: 0.2473634903629621 (+0.005112620691458403) | > avg_loss_0: 2.602022568384806 (-0.13679393132527684) | > avg_loss_gen: 2.111788193384806 (+0.40757906436920144) | > avg_loss_kl: 4.292104164759318 (-0.010707855224609375) | > avg_loss_feat: 4.701394716898601 (+2.5663751165072126) | > avg_loss_mel: 22.119495391845703 (+1.2074305216471366) | > avg_loss_duration: 3.105416695276896 (-0.06045929590861032) | > avg_loss_1: 36.330200831095375 (+4.110218683878578)  > EPOCH: 833/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:54:27)   --> TIME: 2023-10-20 09:54:51 -- STEP: 29/50 -- GLOBAL_STEP: 94680 | > loss_disc: 2.5257973670959473 (2.387868858616928) | > loss_disc_real_0: 0.16976210474967957 (0.1576851405974092) | > loss_disc_real_1: 0.23175187408924103 (0.24280107882002308) | > loss_disc_real_2: 0.22964979708194733 (0.2046007570521585) | > loss_disc_real_3: 0.23119349777698517 (0.2190614110180016) | > loss_disc_real_4: 0.1869509071111679 (0.22733630496880103) | > loss_disc_real_5: 0.2270890176296234 (0.19563516100932812) | > loss_0: 2.5257973670959473 (2.387868858616928) | > grad_norm_0: tensor(605.2604, device='cuda:0') (tensor(493.3729, device='cuda:0')) | > loss_gen: 2.081899642944336 (2.3658908071189093) | > loss_kl: 0.7275357842445374 (0.7264575051336453) | > loss_feat: 4.252937316894531 (5.740506011671547) | > loss_mel: 20.640838623046875 (18.413199831699504) | > loss_duration: 1.3405438661575317 (1.3971797104539543) | > loss_1: 29.04375457763672 (28.643233924076476) | > grad_norm_1: tensor(10156.1230, device='cuda:0') (tensor(26197.3770, device='cuda:0')) | > current_lr_0: 8.694409272277164e-05 | > current_lr_1: 8.694409272277164e-05 | > step_time: 0.4076 (0.6380985440879032) | > loader_time: 0.0023 (0.02098803684629243)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7498691082000732 (2.7498691082000732) | > loss_disc_real_0: 0.24211686849594116 (0.24211686849594116) | > loss_disc_real_1: 0.25232967734336853 (0.25232967734336853) | > loss_disc_real_2: 0.22088214755058289 (0.22088214755058289) | > loss_disc_real_3: 0.24185606837272644 (0.24185606837272644) | > loss_disc_real_4: 0.31095361709594727 (0.31095361709594727) | > loss_disc_real_5: 0.46623125672340393 (0.46623125672340393) | > loss_0: 2.7498691082000732 (2.7498691082000732) | > loss_gen: 2.48699951171875 (2.48699951171875) | > loss_kl: 4.482816219329834 (4.482816219329834) | > loss_feat: 5.448843955993652 (5.448843955993652) | > loss_mel: 22.68911361694336 (22.68911361694336) | > loss_duration: 2.9293391704559326 (2.9293391704559326) | > loss_1: 38.037113189697266 (38.037113189697266)  --> STEP: 1 | > loss_disc: 3.3148903846740723 (3.3148903846740723) | > loss_disc_real_0: 0.35306698083877563 (0.35306698083877563) | > loss_disc_real_1: 0.34116730093955994 (0.34116730093955994) | > loss_disc_real_2: 0.18574142456054688 (0.18574142456054688) | > loss_disc_real_3: 0.19012582302093506 (0.19012582302093506) | > loss_disc_real_4: 0.5190137028694153 (0.5190137028694153) | > loss_disc_real_5: 0.4790082275867462 (0.4790082275867462) | > loss_0: 3.3148903846740723 (3.3148903846740723) | > loss_gen: 2.3164005279541016 (2.3164005279541016) | > loss_kl: 4.702098369598389 (4.702098369598389) | > loss_feat: 8.346439361572266 (8.346439361572266) | > loss_mel: 24.233976364135742 (24.233976364135742) | > loss_duration: 3.223390579223633 (3.223390579223633) | > loss_1: 42.822303771972656 (42.822303771972656)  --> STEP: 2 | > loss_disc: 2.940089225769043 (3.1274898052215576) | > loss_disc_real_0: 0.4368271231651306 (0.3949470520019531) | > loss_disc_real_1: 0.3270292282104492 (0.3340982645750046) | > loss_disc_real_2: 0.20238390564918518 (0.19406266510486603) | > loss_disc_real_3: 0.34982046484947205 (0.26997314393520355) | > loss_disc_real_4: 0.3012631833553314 (0.41013844311237335) | > loss_disc_real_5: 0.43076759576797485 (0.45488791167736053) | > loss_0: 2.940089225769043 (3.1274898052215576) | > loss_gen: 3.2664473056793213 (2.7914239168167114) | > loss_kl: 5.3465423583984375 (5.024320363998413) | > loss_feat: 5.941801071166992 (7.144120216369629) | > loss_mel: 27.402748107910156 (25.81836223602295) | > loss_duration: 3.2033581733703613 (3.213374376296997) | > loss_1: 45.1609001159668 (43.99160194396973)  --> STEP: 3 | > loss_disc: 3.1509909629821777 (3.1353235244750977) | > loss_disc_real_0: 0.6350639462471008 (0.4749860167503357) | > loss_disc_real_1: 0.31302177906036377 (0.32707276940345764) | > loss_disc_real_2: 0.3040429353713989 (0.23072275519371033) | > loss_disc_real_3: 0.2819252908229828 (0.27395719289779663) | > loss_disc_real_4: 0.18733318150043488 (0.33587002257506055) | > loss_disc_real_5: 0.20688125491142273 (0.3722190260887146) | > loss_0: 3.1509909629821777 (3.1353235244750977) | > loss_gen: 2.1454668045043945 (2.5761048793792725) | > loss_kl: 2.2044479846954346 (4.084362904230754) | > loss_feat: 0.86153644323349 (5.049925625324249) | > loss_mel: 15.452630996704102 (22.363118489583332) | > loss_duration: 2.9719018936157227 (3.1328835487365723) | > loss_1: 23.635982513427734 (37.2063954671224) --> EVAL PERFORMANCE | > avg_loader_time: 0.019643624623616535 (+0.005867640177408854) | > avg_loss_disc: 3.1353235244750977 (+0.5333009560902915) | > avg_loss_disc_real_0: 0.4749860167503357 (+0.3195585310459137) | > avg_loss_disc_real_1: 0.32707276940345764 (+0.04413323104381561) | > avg_loss_disc_real_2: 0.23072275519371033 (+0.0005698452393213815) | > avg_loss_disc_real_3: 0.27395719289779663 (+0.026936357220013946) | > avg_loss_disc_real_4: 0.33587002257506055 (+0.06811062494913739) | > avg_loss_disc_real_5: 0.3722190260887146 (+0.1248555357257525) | > avg_loss_0: 3.1353235244750977 (+0.5333009560902915) | > avg_loss_gen: 2.5761048793792725 (+0.4643166859944663) | > avg_loss_kl: 4.084362904230754 (-0.20774126052856445) | > avg_loss_feat: 5.049925625324249 (+0.3485309084256487) | > avg_loss_mel: 22.363118489583332 (+0.24362309773762902) | > avg_loss_duration: 3.1328835487365723 (+0.027466853459676255) | > avg_loss_1: 37.2063954671224 (+0.876194636027023)  > EPOCH: 834/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:55:25)   --> TIME: 2023-10-20 09:55:37 -- STEP: 9/50 -- GLOBAL_STEP: 94710 | > loss_disc: 2.50026535987854 (2.515219357278612) | > loss_disc_real_0: 0.0468064546585083 (0.13542529795732763) | > loss_disc_real_1: 0.25401365756988525 (0.20528952735993597) | > loss_disc_real_2: 0.3028952479362488 (0.27196716765562695) | > loss_disc_real_3: 0.4842485189437866 (0.23454966396093369) | > loss_disc_real_4: 0.17065562307834625 (0.23735944678386053) | > loss_disc_real_5: 0.19127286970615387 (0.2157099623647001) | > loss_0: 2.50026535987854 (2.515219357278612) | > grad_norm_0: tensor(628.0829, device='cuda:0') (tensor(724.8426, device='cuda:0')) | > loss_gen: 2.403684616088867 (2.2756598128212824) | > loss_kl: 0.6152861714363098 (0.7943736248546176) | > loss_feat: 4.741766452789307 (6.207862297693889) | > loss_mel: 24.37687873840332 (23.713095982869465) | > loss_duration: 1.3471626043319702 (1.3805065155029297) | > loss_1: 33.48478317260742 (34.371499379475914) | > grad_norm_1: tensor(6566.4150, device='cuda:0') (tensor(11305.6689, device='cuda:0')) | > current_lr_0: 8.685718665858139e-05 | > current_lr_1: 8.685718665858139e-05 | > step_time: 0.3627 (0.6284321149190267) | > loader_time: 0.0244 (0.02193495962354872)  --> TIME: 2023-10-20 09:55:57 -- STEP: 39/50 -- GLOBAL_STEP: 94740 | > loss_disc: 2.8919010162353516 (2.6127043779079733) | > loss_disc_real_0: 0.12692809104919434 (0.17314409201916975) | > loss_disc_real_1: 0.24859900772571564 (0.22684286257777458) | > loss_disc_real_2: 0.29027658700942993 (0.23322845852145782) | > loss_disc_real_3: 0.27347323298454285 (0.24219293682238993) | > loss_disc_real_4: 0.21065114438533783 (0.2285711533175065) | > loss_disc_real_5: 0.3438464105129242 (0.21449995580583048) | > loss_0: 2.8919010162353516 (2.6127043779079733) | > grad_norm_0: tensor(507.0222, device='cuda:0') (tensor(596.7012, device='cuda:0')) | > loss_gen: 1.7044689655303955 (2.086513363398038) | > loss_kl: 0.7434016466140747 (0.8332886825769376) | > loss_feat: 0.6972697377204895 (4.242995681862037) | > loss_mel: 15.085738182067871 (18.573107734704628) | > loss_duration: 1.403154730796814 (1.3723311943885605) | > loss_1: 19.634033203125 (27.108237095368214) | > grad_norm_1: tensor(6153.4331, device='cuda:0') (tensor(15549.9678, device='cuda:0')) | > current_lr_0: 8.685718665858139e-05 | > current_lr_1: 8.685718665858139e-05 | > step_time: 0.7216 (0.6375707051692863) | > loader_time: 0.0297 (0.02288576884147448)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.763836622238159 (2.763836622238159) | > loss_disc_real_0: 0.2756611704826355 (0.2756611704826355) | > loss_disc_real_1: 0.32201042771339417 (0.32201042771339417) | > loss_disc_real_2: 0.18809066712856293 (0.18809066712856293) | > loss_disc_real_3: 0.33390650153160095 (0.33390650153160095) | > loss_disc_real_4: 0.33491379022598267 (0.33491379022598267) | > loss_disc_real_5: 0.38527533411979675 (0.38527533411979675) | > loss_0: 2.763836622238159 (2.763836622238159) | > loss_gen: 2.5891385078430176 (2.5891385078430176) | > loss_kl: 4.466903209686279 (4.466903209686279) | > loss_feat: 4.098423480987549 (4.098423480987549) | > loss_mel: 24.589223861694336 (24.589223861694336) | > loss_duration: 2.889956474304199 (2.889956474304199) | > loss_1: 38.633644104003906 (38.633644104003906)  --> STEP: 1 | > loss_disc: 3.2847728729248047 (3.2847728729248047) | > loss_disc_real_0: 0.4083455801010132 (0.4083455801010132) | > loss_disc_real_1: 0.3648238182067871 (0.3648238182067871) | > loss_disc_real_2: 0.18205736577510834 (0.18205736577510834) | > loss_disc_real_3: 0.28299903869628906 (0.28299903869628906) | > loss_disc_real_4: 0.28229978680610657 (0.28229978680610657) | > loss_disc_real_5: 0.47882890701293945 (0.47882890701293945) | > loss_0: 3.2847728729248047 (3.2847728729248047) | > loss_gen: 1.8686630725860596 (1.8686630725860596) | > loss_kl: 4.573952674865723 (4.573952674865723) | > loss_feat: 3.5223937034606934 (3.5223937034606934) | > loss_mel: 20.867778778076172 (20.867778778076172) | > loss_duration: 3.1263821125030518 (3.1263821125030518) | > loss_1: 33.959171295166016 (33.959171295166016)  --> STEP: 2 | > loss_disc: 3.061234951019287 (3.173003911972046) | > loss_disc_real_0: 0.3318302631378174 (0.3700879216194153) | > loss_disc_real_1: 0.2507306635379791 (0.3077772408723831) | > loss_disc_real_2: 0.25426843762397766 (0.218162901699543) | > loss_disc_real_3: 0.2504775822162628 (0.26673831045627594) | > loss_disc_real_4: 0.24561452865600586 (0.2639571577310562) | > loss_disc_real_5: 0.2734316885471344 (0.3761302977800369) | > loss_0: 3.061234951019287 (3.173003911972046) | > loss_gen: 1.5543732643127441 (1.7115181684494019) | > loss_kl: 5.603755950927734 (5.0888543128967285) | > loss_feat: 0.12384864687919617 (1.8231211751699448) | > loss_mel: 1.919552206993103 (11.393665492534637) | > loss_duration: 3.0687966346740723 (3.097589373588562) | > loss_1: 12.270326614379883 (23.11474895477295)  --> STEP: 3 | > loss_disc: 2.2590219974517822 (2.8683432737986245) | > loss_disc_real_0: 0.1300329566001892 (0.2900695999463399) | > loss_disc_real_1: 0.49101483821868896 (0.3688564399878184) | > loss_disc_real_2: 0.3272565007209778 (0.2545274347066879) | > loss_disc_real_3: 0.44636690616607666 (0.32661450902620953) | > loss_disc_real_4: 0.12499744445085526 (0.21763725330432257) | > loss_disc_real_5: 0.15390180051326752 (0.30205413202444714) | > loss_0: 2.2590219974517822 (2.8683432737986245) | > loss_gen: 3.238049030303955 (2.2203617890675864) | > loss_kl: 2.9072299003601074 (4.3616461753845215) | > loss_feat: 6.808877468109131 (3.485039939483007) | > loss_mel: 25.057357788085938 (15.948229591051737) | > loss_duration: 2.803009271621704 (2.999396006266276) | > loss_1: 40.81452178955078 (29.014673233032227) --> EVAL PERFORMANCE | > avg_loader_time: 0.011337041854858398 (-0.008306582768758137) | > avg_loss_disc: 2.8683432737986245 (-0.26698025067647313) | > avg_loss_disc_real_0: 0.2900695999463399 (-0.1849164168039958) | > avg_loss_disc_real_1: 0.3688564399878184 (+0.04178367058436078) | > avg_loss_disc_real_2: 0.2545274347066879 (+0.0238046795129776) | > avg_loss_disc_real_3: 0.32661450902620953 (+0.0526573161284129) | > avg_loss_disc_real_4: 0.21763725330432257 (-0.11823276927073798) | > avg_loss_disc_real_5: 0.30205413202444714 (-0.07016489406426746) | > avg_loss_0: 2.8683432737986245 (-0.26698025067647313) | > avg_loss_gen: 2.2203617890675864 (-0.35574309031168605) | > avg_loss_kl: 4.3616461753845215 (+0.2772832711537676) | > avg_loss_feat: 3.485039939483007 (-1.5648856858412423) | > avg_loss_mel: 15.948229591051737 (-6.414888898531595) | > avg_loss_duration: 2.999396006266276 (-0.13348754247029637) | > avg_loss_1: 29.014673233032227 (-8.191722234090172)  > EPOCH: 835/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:56:23)   --> TIME: 2023-10-20 09:56:41 -- STEP: 19/50 -- GLOBAL_STEP: 94770 | > loss_disc: 2.9344491958618164 (2.3594905138015747) | > loss_disc_real_0: 0.32459354400634766 (0.15023004126391912) | > loss_disc_real_1: 0.3183210790157318 (0.21244932573876882) | > loss_disc_real_2: 0.26156318187713623 (0.19469621463825829) | > loss_disc_real_3: 0.3173068165779114 (0.22808056501181503) | > loss_disc_real_4: 0.30748865008354187 (0.23336329105261125) | > loss_disc_real_5: 0.30537426471710205 (0.2273893176921104) | > loss_0: 2.9344491958618164 (2.3594905138015747) | > grad_norm_0: tensor(702.5311, device='cuda:0') (tensor(572.1935, device='cuda:0')) | > loss_gen: 2.07909893989563 (2.5313112923973486) | > loss_kl: 0.8481789231300354 (0.9665748194644326) | > loss_feat: 1.7579715251922607 (6.573745185607358) | > loss_mel: 21.848758697509766 (23.723767581738922) | > loss_duration: 1.472573161125183 (1.402769829097547) | > loss_1: 28.006580352783203 (35.19816825264379) | > grad_norm_1: tensor(3704.4553, device='cuda:0') (tensor(30340.3652, device='cuda:0')) | > current_lr_0: 8.67703674624434e-05 | > current_lr_1: 8.67703674624434e-05 | > step_time: 0.332 (0.6411947200172826) | > loader_time: 0.0133 (0.023408350191618268)  --> TIME: 2023-10-20 09:56:55 -- STEP: 49/50 -- GLOBAL_STEP: 94800 | > loss_disc: 3.2089273929595947 (2.4655971308143765) | > loss_disc_real_0: 0.24054908752441406 (0.14634103746134405) | > loss_disc_real_1: 0.3114430904388428 (0.22974223993262466) | > loss_disc_real_2: 0.35995274782180786 (0.2190178956608383) | > loss_disc_real_3: 0.3986533284187317 (0.23922358476081673) | > loss_disc_real_4: 0.34118780493736267 (0.23373671784540828) | > loss_disc_real_5: 0.33264511823654175 (0.2281925006560525) | > loss_0: 3.2089273929595947 (2.4655971308143765) | > grad_norm_0: tensor(514.3601, device='cuda:0') (tensor(533.7927, device='cuda:0')) | > loss_gen: 2.0794999599456787 (2.351275716509137) | > loss_kl: 0.8836420178413391 (0.826460392803562) | > loss_feat: 4.036981105804443 (5.617884038662424) | > loss_mel: 21.716503143310547 (21.80828553803113) | > loss_duration: 1.4762847423553467 (1.379672026147648) | > loss_1: 30.19291114807129 (31.983577592032304) | > grad_norm_1: tensor(5209.9824, device='cuda:0') (tensor(22103.7773, device='cuda:0')) | > current_lr_0: 8.67703674624434e-05 | > current_lr_1: 8.67703674624434e-05 | > step_time: 0.6825 (0.5167152054455817) | > loader_time: 0.5932 (0.027457568110251913)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.463942050933838 (2.463942050933838) | > loss_disc_real_0: 0.46977776288986206 (0.46977776288986206) | > loss_disc_real_1: 0.21439725160598755 (0.21439725160598755) | > loss_disc_real_2: 0.24562746286392212 (0.24562746286392212) | > loss_disc_real_3: 0.2312210202217102 (0.2312210202217102) | > loss_disc_real_4: 0.07629972696304321 (0.07629972696304321) | > loss_disc_real_5: 0.22146491706371307 (0.22146491706371307) | > loss_0: 2.463942050933838 (2.463942050933838) | > loss_gen: 2.354584217071533 (2.354584217071533) | > loss_kl: 4.972902774810791 (4.972902774810791) | > loss_feat: 9.073978424072266 (9.073978424072266) | > loss_mel: 26.22707748413086 (26.22707748413086) | > loss_duration: 2.9277029037475586 (2.9277029037475586) | > loss_1: 45.556243896484375 (45.556243896484375)  --> STEP: 1 | > loss_disc: 3.4343488216400146 (3.4343488216400146) | > loss_disc_real_0: 0.32180386781692505 (0.32180386781692505) | > loss_disc_real_1: 0.2760649025440216 (0.2760649025440216) | > loss_disc_real_2: 0.3536398708820343 (0.3536398708820343) | > loss_disc_real_3: 0.4282784163951874 (0.4282784163951874) | > loss_disc_real_4: 0.2509317696094513 (0.2509317696094513) | > loss_disc_real_5: 0.39227086305618286 (0.39227086305618286) | > loss_0: 3.4343488216400146 (3.4343488216400146) | > loss_gen: 1.7850751876831055 (1.7850751876831055) | > loss_kl: 4.595617294311523 (4.595617294311523) | > loss_feat: 4.455373764038086 (4.455373764038086) | > loss_mel: 24.932533264160156 (24.932533264160156) | > loss_duration: 3.167036533355713 (3.167036533355713) | > loss_1: 38.935638427734375 (38.935638427734375)  --> STEP: 2 | > loss_disc: 3.692416191101074 (3.5633825063705444) | > loss_disc_real_0: 0.2902185320854187 (0.3060111999511719) | > loss_disc_real_1: 0.15692336857318878 (0.2164941355586052) | > loss_disc_real_2: 0.24773967266082764 (0.30068977177143097) | > loss_disc_real_3: 0.42501938343048096 (0.42664889991283417) | > loss_disc_real_4: 0.2825527489185333 (0.2667422592639923) | > loss_disc_real_5: 0.4027189612388611 (0.397494912147522) | > loss_0: 3.692416191101074 (3.5633825063705444) | > loss_gen: 1.7008649110794067 (1.742970049381256) | > loss_kl: 4.984067440032959 (4.789842367172241) | > loss_feat: 9.229809761047363 (6.842591762542725) | > loss_mel: 21.734737396240234 (23.333635330200195) | > loss_duration: 3.0863547325134277 (3.1266956329345703) | > loss_1: 40.735836029052734 (39.835737228393555)  --> STEP: 3 | > loss_disc: 2.8508777618408203 (3.3258809248606362) | > loss_disc_real_0: 0.31740960478782654 (0.30981066823005676) | > loss_disc_real_1: 0.31074845790863037 (0.2479122430086136) | > loss_disc_real_2: 0.25289469957351685 (0.2847580810387929) | > loss_disc_real_3: 0.32713523507118225 (0.3934776782989502) | > loss_disc_real_4: 0.2911570370197296 (0.2748805185159047) | > loss_disc_real_5: 0.476737916469574 (0.4239092469215393) | > loss_0: 2.8508777618408203 (3.3258809248606362) | > loss_gen: 2.9124252796173096 (2.1327884594599404) | > loss_kl: 2.786027193069458 (4.1219039758046465) | > loss_feat: 5.140415191650391 (6.27519957224528) | > loss_mel: 20.12428092956543 (22.263850529988606) | > loss_duration: 2.9420926570892334 (3.0651613076527915) | > loss_1: 33.905242919921875 (37.85890579223633) --> EVAL PERFORMANCE | > avg_loader_time: 0.01927773157755534 (+0.007940689722696941) | > avg_loss_disc: 3.3258809248606362 (+0.4575376510620117) | > avg_loss_disc_real_0: 0.30981066823005676 (+0.019741068283716856) | > avg_loss_disc_real_1: 0.2479122430086136 (-0.12094419697920483) | > avg_loss_disc_real_2: 0.2847580810387929 (+0.030230646332104982) | > avg_loss_disc_real_3: 0.3934776782989502 (+0.06686316927274066) | > avg_loss_disc_real_4: 0.2748805185159047 (+0.057243265211582156) | > avg_loss_disc_real_5: 0.4239092469215393 (+0.12185511489709216) | > avg_loss_0: 3.3258809248606362 (+0.4575376510620117) | > avg_loss_gen: 2.1327884594599404 (-0.08757332960764597) | > avg_loss_kl: 4.1219039758046465 (-0.23974219957987497) | > avg_loss_feat: 6.27519957224528 (+2.7901596327622733) | > avg_loss_mel: 22.263850529988606 (+6.315620938936869) | > avg_loss_duration: 3.0651613076527915 (+0.0657653013865156) | > avg_loss_1: 37.85890579223633 (+8.844232559204102)  > EPOCH: 836/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:57:10)   --> TIME: 2023-10-20 09:57:35 -- STEP: 29/50 -- GLOBAL_STEP: 94830 | > loss_disc: 2.6486520767211914 (2.443010691938729) | > loss_disc_real_0: 0.05687851458787918 (0.15759706625650668) | > loss_disc_real_1: 0.37464427947998047 (0.22246115641861125) | > loss_disc_real_2: 0.1990175098180771 (0.21954987088924852) | > loss_disc_real_3: 0.333558589220047 (0.24908265137466892) | > loss_disc_real_4: 0.1318592131137848 (0.22168361469460973) | > loss_disc_real_5: 0.05452701076865196 (0.22083979787240768) | > loss_0: 2.6486520767211914 (2.443010691938729) | > grad_norm_0: tensor(517.4232, device='cuda:0') (tensor(573.2609, device='cuda:0')) | > loss_gen: 2.090240478515625 (2.345895191718792) | > loss_kl: 0.7533929944038391 (0.878709365581644) | > loss_feat: 9.75427532196045 (6.404081275493934) | > loss_mel: 22.48621368408203 (22.83667947917149) | > loss_duration: 1.3843777179718018 (1.384316822578167) | > loss_1: 36.46849822998047 (33.84968178847741) | > grad_norm_1: tensor(16611.2207, device='cuda:0') (tensor(19388.7695, device='cuda:0')) | > current_lr_0: 8.668363504752768e-05 | > current_lr_1: 8.668363504752768e-05 | > step_time: 0.8103 (0.6212642028413968) | > loader_time: 0.0356 (0.02235101009237355)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6153030395507812 (2.6153030395507812) | > loss_disc_real_0: 0.07315758615732193 (0.07315758615732193) | > loss_disc_real_1: 0.16770486533641815 (0.16770486533641815) | > loss_disc_real_2: 0.17264722287654877 (0.17264722287654877) | > loss_disc_real_3: 0.3133113384246826 (0.3133113384246826) | > loss_disc_real_4: 0.36723241209983826 (0.36723241209983826) | > loss_disc_real_5: 0.4479463994503021 (0.4479463994503021) | > loss_0: 2.6153030395507812 (2.6153030395507812) | > loss_gen: 2.163465976715088 (2.163465976715088) | > loss_kl: 4.306046485900879 (4.306046485900879) | > loss_feat: 5.029017448425293 (5.029017448425293) | > loss_mel: 23.81581687927246 (23.81581687927246) | > loss_duration: 2.818026304244995 (2.818026304244995) | > loss_1: 38.13237380981445 (38.13237380981445)  --> STEP: 1 | > loss_disc: 2.9789891242980957 (2.9789891242980957) | > loss_disc_real_0: 0.32650190591812134 (0.32650190591812134) | > loss_disc_real_1: 0.2737658619880676 (0.2737658619880676) | > loss_disc_real_2: 0.30054280161857605 (0.30054280161857605) | > loss_disc_real_3: 0.27129247784614563 (0.27129247784614563) | > loss_disc_real_4: 0.23402394354343414 (0.23402394354343414) | > loss_disc_real_5: 0.27042874693870544 (0.27042874693870544) | > loss_0: 2.9789891242980957 (2.9789891242980957) | > loss_gen: 1.7674484252929688 (1.7674484252929688) | > loss_kl: 4.589190483093262 (4.589190483093262) | > loss_feat: 0.35289493203163147 (0.35289493203163147) | > loss_mel: 16.977249145507812 (16.977249145507812) | > loss_duration: 3.315659284591675 (3.315659284591675) | > loss_1: 27.00244140625 (27.00244140625)  --> STEP: 2 | > loss_disc: 1.9762153625488281 (2.477602243423462) | > loss_disc_real_0: 0.08956840634346008 (0.2080351561307907) | > loss_disc_real_1: 0.17512314021587372 (0.22444450110197067) | > loss_disc_real_2: 0.14457903802394867 (0.22256091982126236) | > loss_disc_real_3: 0.301082581281662 (0.2861875295639038) | > loss_disc_real_4: 0.12920649349689484 (0.1816152185201645) | > loss_disc_real_5: 0.14697910845279694 (0.2087039276957512) | > loss_0: 1.9762153625488281 (2.477602243423462) | > loss_gen: 2.347625732421875 (2.057537078857422) | > loss_kl: 5.49549674987793 (5.042343616485596) | > loss_feat: 7.570546627044678 (3.9617207795381546) | > loss_mel: 22.827184677124023 (19.902216911315918) | > loss_duration: 3.247488498687744 (3.2815738916397095) | > loss_1: 41.48834228515625 (34.245391845703125)  --> STEP: 3 | > loss_disc: 2.434722423553467 (2.4633089701334634) | > loss_disc_real_0: 0.09855654835700989 (0.17154228687286377) | > loss_disc_real_1: 0.23945745825767517 (0.22944882015387216) | > loss_disc_real_2: 0.27304530143737793 (0.23938904702663422) | > loss_disc_real_3: 0.2197762280702591 (0.2640504290660222) | > loss_disc_real_4: 0.26917609572410583 (0.21080217758814493) | > loss_disc_real_5: 0.2997353971004486 (0.23904775083065033) | > loss_0: 2.434722423553467 (2.4633089701334634) | > loss_gen: 2.3110244274139404 (2.1420328617095947) | > loss_kl: 2.78859543800354 (4.291094223658244) | > loss_feat: 3.5874812602996826 (3.8369742731253305) | > loss_mel: 24.9991512298584 (21.601195017496746) | > loss_duration: 2.868720293045044 (3.143956025441488) | > loss_1: 36.55497360229492 (35.015252431233726) --> EVAL PERFORMANCE | > avg_loader_time: 0.033650716145833336 (+0.014372984568277996) | > avg_loss_disc: 2.4633089701334634 (-0.8625719547271729) | > avg_loss_disc_real_0: 0.17154228687286377 (-0.138268381357193) | > avg_loss_disc_real_1: 0.22944882015387216 (-0.018463422854741424) | > avg_loss_disc_real_2: 0.23938904702663422 (-0.04536903401215869) | > avg_loss_disc_real_3: 0.2640504290660222 (-0.12942724923292798) | > avg_loss_disc_real_4: 0.21080217758814493 (-0.0640783409277598) | > avg_loss_disc_real_5: 0.23904775083065033 (-0.18486149609088898) | > avg_loss_0: 2.4633089701334634 (-0.8625719547271729) | > avg_loss_gen: 2.1420328617095947 (+0.009244402249654282) | > avg_loss_kl: 4.291094223658244 (+0.1691902478535976) | > avg_loss_feat: 3.8369742731253305 (-2.43822529911995) | > avg_loss_mel: 21.601195017496746 (-0.6626555124918596) | > avg_loss_duration: 3.143956025441488 (+0.07879471778869629) | > avg_loss_1: 35.015252431233726 (-2.843653361002602)  > EPOCH: 837/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:58:02)   --> TIME: 2023-10-20 09:58:13 -- STEP: 9/50 -- GLOBAL_STEP: 94860 | > loss_disc: 2.423161745071411 (2.5870243973202176) | > loss_disc_real_0: 0.05210898816585541 (0.19756888680987889) | > loss_disc_real_1: 0.33388403058052063 (0.21533754509356287) | > loss_disc_real_2: 0.26057684421539307 (0.24078318580157226) | > loss_disc_real_3: 0.2747478187084198 (0.2866840205258793) | > loss_disc_real_4: 0.20656968653202057 (0.23037640833192402) | > loss_disc_real_5: 0.2055535614490509 (0.2499098995079597) | > loss_0: 2.423161745071411 (2.5870243973202176) | > grad_norm_0: tensor(581.0596, device='cuda:0') (tensor(678.4846, device='cuda:0')) | > loss_gen: 2.1254584789276123 (2.281678650114271) | > loss_kl: 0.9889464974403381 (0.8672059211466048) | > loss_feat: 3.5581212043762207 (5.655461909042464) | > loss_mel: 25.18840789794922 (20.873969395955402) | > loss_duration: 1.2891161441802979 (1.3901866277058919) | > loss_1: 33.15005111694336 (31.068502320183647) | > grad_norm_1: tensor(7470.1416, device='cuda:0') (tensor(19843.6953, device='cuda:0')) | > current_lr_0: 8.659698932709091e-05 | > current_lr_1: 8.659698932709091e-05 | > step_time: 0.5199 (0.45781445503234863) | > loader_time: 0.0201 (0.010989639494154189)  --> TIME: 2023-10-20 09:58:33 -- STEP: 39/50 -- GLOBAL_STEP: 94890 | > loss_disc: 2.1348958015441895 (2.405499733411349) | > loss_disc_real_0: 0.12864375114440918 (0.16104481049264086) | > loss_disc_real_1: 0.1271691471338272 (0.23141117823811677) | > loss_disc_real_2: 0.2308768332004547 (0.21724933381072986) | > loss_disc_real_3: 0.23169927299022675 (0.24014316852658224) | > loss_disc_real_4: 0.10978870093822479 (0.1982945740605012) | > loss_disc_real_5: 0.2420998364686966 (0.21472266727151015) | > loss_0: 2.1348958015441895 (2.405499733411349) | > grad_norm_0: tensor(1602.4240, device='cuda:0') (tensor(586.0175, device='cuda:0')) | > loss_gen: 2.505983352661133 (2.2832519029959664) | > loss_kl: 0.7012424468994141 (0.8075696084743891) | > loss_feat: 6.274033069610596 (5.231473182829527) | > loss_mel: 22.302719116210938 (20.632233937581383) | > loss_duration: 1.4148558378219604 (1.3776336724941547) | > loss_1: 33.19883346557617 (30.332161854474972) | > grad_norm_1: tensor(63649.6016, device='cuda:0') (tensor(21370.0879, device='cuda:0')) | > current_lr_0: 8.659698932709091e-05 | > current_lr_1: 8.659698932709091e-05 | > step_time: 0.5836 (0.5928311714759241) | > loader_time: 0.0282 (0.019114965047591772)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.078469753265381 (2.078469753265381) | > loss_disc_real_0: 0.25290995836257935 (0.25290995836257935) | > loss_disc_real_1: 0.34070754051208496 (0.34070754051208496) | > loss_disc_real_2: 0.21881556510925293 (0.21881556510925293) | > loss_disc_real_3: 0.1821065992116928 (0.1821065992116928) | > loss_disc_real_4: 0.26687076687812805 (0.26687076687812805) | > loss_disc_real_5: 0.1452113389968872 (0.1452113389968872) | > loss_0: 2.078469753265381 (2.078469753265381) | > loss_gen: 3.0543854236602783 (3.0543854236602783) | > loss_kl: 4.072242259979248 (4.072242259979248) | > loss_feat: 8.246758460998535 (8.246758460998535) | > loss_mel: 22.238367080688477 (22.238367080688477) | > loss_duration: 2.864496946334839 (2.864496946334839) | > loss_1: 40.47624969482422 (40.47624969482422)  --> STEP: 1 | > loss_disc: 2.91174578666687 (2.91174578666687) | > loss_disc_real_0: 0.4351973533630371 (0.4351973533630371) | > loss_disc_real_1: 0.23835912346839905 (0.23835912346839905) | > loss_disc_real_2: 0.2682327628135681 (0.2682327628135681) | > loss_disc_real_3: 0.29522207379341125 (0.29522207379341125) | > loss_disc_real_4: 0.2851127088069916 (0.2851127088069916) | > loss_disc_real_5: 0.3164452910423279 (0.3164452910423279) | > loss_0: 2.91174578666687 (2.91174578666687) | > loss_gen: 2.4234635829925537 (2.4234635829925537) | > loss_kl: 5.104406833648682 (5.104406833648682) | > loss_feat: 1.8718806505203247 (1.8718806505203247) | > loss_mel: 19.61132049560547 (19.61132049560547) | > loss_duration: 3.2196857929229736 (3.2196857929229736) | > loss_1: 32.23075866699219 (32.23075866699219)  --> STEP: 2 | > loss_disc: 2.9520750045776367 (2.9319103956222534) | > loss_disc_real_0: 0.345406174659729 (0.39030176401138306) | > loss_disc_real_1: 0.2915407121181488 (0.2649499177932739) | > loss_disc_real_2: 0.27276238799095154 (0.2704975754022598) | > loss_disc_real_3: 0.2945277988910675 (0.2948749363422394) | > loss_disc_real_4: 0.27206963300704956 (0.27859117090702057) | > loss_disc_real_5: 0.2625662088394165 (0.2895057499408722) | > loss_0: 2.9520750045776367 (2.9319103956222534) | > loss_gen: 1.880332350730896 (2.151897966861725) | > loss_kl: 5.46364688873291 (5.284026861190796) | > loss_feat: 0.34065940976142883 (1.1062700301408768) | > loss_mel: 15.578633308410645 (17.594976902008057) | > loss_duration: 3.122655153274536 (3.171170473098755) | > loss_1: 26.385929107666016 (29.3083438873291)  --> STEP: 3 | > loss_disc: 3.075437068939209 (2.9797526200612388) | > loss_disc_real_0: 0.49211952090263367 (0.4242410163084666) | > loss_disc_real_1: 0.2835429608821869 (0.27114759882291156) | > loss_disc_real_2: 0.2632952332496643 (0.26809679468472797) | > loss_disc_real_3: 0.29546138644218445 (0.29507041970888775) | > loss_disc_real_4: 0.2721408009529114 (0.2764410475889842) | > loss_disc_real_5: 0.2630511224269867 (0.280687540769577) | > loss_0: 3.075437068939209 (2.9797526200612388) | > loss_gen: 1.9509209394454956 (2.0849056243896484) | > loss_kl: 2.1511785984039307 (4.239744106928508) | > loss_feat: 0.25459128618240356 (0.8223771154880524) | > loss_mel: 8.0920991897583 (14.427350997924805) | > loss_duration: 2.9318532943725586 (3.091398080190023) | > loss_1: 15.380643844604492 (24.6657772064209) --> EVAL PERFORMANCE | > avg_loader_time: 0.009037335713704428 (-0.024613380432128906) | > avg_loss_disc: 2.9797526200612388 (+0.5164436499277754) | > avg_loss_disc_real_0: 0.4242410163084666 (+0.25269872943560284) | > avg_loss_disc_real_1: 0.27114759882291156 (+0.0416987786690394) | > avg_loss_disc_real_2: 0.26809679468472797 (+0.028707747658093752) | > avg_loss_disc_real_3: 0.29507041970888775 (+0.031019990642865536) | > avg_loss_disc_real_4: 0.2764410475889842 (+0.06563887000083926) | > avg_loss_disc_real_5: 0.280687540769577 (+0.0416397899389267) | > avg_loss_0: 2.9797526200612388 (+0.5164436499277754) | > avg_loss_gen: 2.0849056243896484 (-0.05712723731994629) | > avg_loss_kl: 4.239744106928508 (-0.05135011672973633) | > avg_loss_feat: 0.8223771154880524 (-3.014597157637278) | > avg_loss_mel: 14.427350997924805 (-7.173844019571941) | > avg_loss_duration: 3.091398080190023 (-0.052557945251464844) | > avg_loss_1: 24.6657772064209 (-10.349475224812828)  > EPOCH: 838/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:58:57)   --> TIME: 2023-10-20 09:59:12 -- STEP: 19/50 -- GLOBAL_STEP: 94920 | > loss_disc: 1.4958972930908203 (2.1847990123849166) | > loss_disc_real_0: 0.05753523111343384 (0.10892291082755516) | > loss_disc_real_1: 0.1572774350643158 (0.19982323893590978) | > loss_disc_real_2: 0.22070027887821198 (0.23572785015168943) | > loss_disc_real_3: 0.1119498759508133 (0.21470896115428523) | > loss_disc_real_4: 0.16793076694011688 (0.2365529079382357) | > loss_disc_real_5: 0.14681656658649445 (0.21671407650175847) | > loss_0: 1.4958972930908203 (2.1847990123849166) | > grad_norm_0: tensor(213.9267, device='cuda:0') (tensor(574.4883, device='cuda:0')) | > loss_gen: 3.2484121322631836 (2.6990093871166834) | > loss_kl: 1.0892187356948853 (0.9348483744420504) | > loss_feat: 8.224617958068848 (7.092347207038026) | > loss_mel: 21.55348014831543 (21.426278390382464) | > loss_duration: 1.4422587156295776 (1.3859803676605225) | > loss_1: 35.557987213134766 (33.538463492142526) | > grad_norm_1: tensor(10649.4111, device='cuda:0') (tensor(24302.1426, device='cuda:0')) | > current_lr_0: 8.651043021447656e-05 | > current_lr_1: 8.651043021447656e-05 | > step_time: 0.3552 (0.4626553937008506) | > loader_time: 0.0027 (0.011809600026983964)  --> TIME: 2023-10-20 09:59:32 -- STEP: 49/50 -- GLOBAL_STEP: 94950 | > loss_disc: 3.225162982940674 (2.3782710493827355) | > loss_disc_real_0: 0.28751829266548157 (0.13233448639131937) | > loss_disc_real_1: 0.572685182094574 (0.21168713279220522) | > loss_disc_real_2: 0.4404865503311157 (0.2220390917619272) | > loss_disc_real_3: 0.3313996195793152 (0.2160643769466147) | > loss_disc_real_4: 0.5454967617988586 (0.2249237301626376) | > loss_disc_real_5: 0.5060291886329651 (0.22227256112180802) | > loss_0: 3.225162982940674 (2.3782710493827355) | > grad_norm_0: tensor(931.9825, device='cuda:0') (tensor(591.7703, device='cuda:0')) | > loss_gen: 3.339247465133667 (2.447023107081045) | > loss_kl: 0.49730023741722107 (0.8524576553276607) | > loss_feat: 4.173693656921387 (6.2772048024498694) | > loss_mel: 21.266386032104492 (20.36963175267589) | > loss_duration: 1.4744702577590942 (1.3684222819853802) | > loss_1: 30.751096725463867 (31.31473954843015) | > grad_norm_1: tensor(8348.0059, device='cuda:0') (tensor(20103.9238, device='cuda:0')) | > current_lr_0: 8.651043021447656e-05 | > current_lr_1: 8.651043021447656e-05 | > step_time: 0.7042 (0.5672635740163374) | > loader_time: 0.5763 (0.028503700178496693)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8117774724960327 (1.8117774724960327) | > loss_disc_real_0: 0.12160453200340271 (0.12160453200340271) | > loss_disc_real_1: 0.2741769552230835 (0.2741769552230835) | > loss_disc_real_2: 0.22195695340633392 (0.22195695340633392) | > loss_disc_real_3: 0.37599900364875793 (0.37599900364875793) | > loss_disc_real_4: 0.13921082019805908 (0.13921082019805908) | > loss_disc_real_5: 0.16931623220443726 (0.16931623220443726) | > loss_0: 1.8117774724960327 (1.8117774724960327) | > loss_gen: 3.466615676879883 (3.466615676879883) | > loss_kl: 4.266027927398682 (4.266027927398682) | > loss_feat: 9.460389137268066 (9.460389137268066) | > loss_mel: 23.714101791381836 (23.714101791381836) | > loss_duration: 2.8182930946350098 (2.8182930946350098) | > loss_1: 43.72542953491211 (43.72542953491211)  --> STEP: 1 | > loss_disc: 2.4948153495788574 (2.4948153495788574) | > loss_disc_real_0: 0.19825102388858795 (0.19825102388858795) | > loss_disc_real_1: 0.45031067728996277 (0.45031067728996277) | > loss_disc_real_2: 0.37515223026275635 (0.37515223026275635) | > loss_disc_real_3: 0.3903005123138428 (0.3903005123138428) | > loss_disc_real_4: 0.30631759762763977 (0.30631759762763977) | > loss_disc_real_5: 0.29676610231399536 (0.29676610231399536) | > loss_0: 2.4948153495788574 (2.4948153495788574) | > loss_gen: 3.490175724029541 (3.490175724029541) | > loss_kl: 4.914883136749268 (4.914883136749268) | > loss_feat: 5.520051002502441 (5.520051002502441) | > loss_mel: 25.496807098388672 (25.496807098388672) | > loss_duration: 3.255157947540283 (3.255157947540283) | > loss_1: 42.67707443237305 (42.67707443237305)  --> STEP: 2 | > loss_disc: 2.813096523284912 (2.6539559364318848) | > loss_disc_real_0: 0.1437167525291443 (0.17098388820886612) | > loss_disc_real_1: 0.6224780678749084 (0.5363943725824356) | > loss_disc_real_2: 0.4651552140712738 (0.4201537221670151) | > loss_disc_real_3: 0.30483055114746094 (0.34756553173065186) | > loss_disc_real_4: 0.34559640288352966 (0.3259570002555847) | > loss_disc_real_5: 0.3778632879257202 (0.3373146951198578) | > loss_0: 2.813096523284912 (2.6539559364318848) | > loss_gen: 3.3963983058929443 (3.4432870149612427) | > loss_kl: 5.494479656219482 (5.204681396484375) | > loss_feat: 6.751637935638428 (6.135844469070435) | > loss_mel: 22.9193172454834 (24.208062171936035) | > loss_duration: 3.178903818130493 (3.217030882835388) | > loss_1: 41.74073791503906 (42.208906173706055)  --> STEP: 3 | > loss_disc: 3.1153531074523926 (2.8077549934387207) | > loss_disc_real_0: 0.26234135031700134 (0.20143637557824454) | > loss_disc_real_1: 0.2698266804218292 (0.44753847519556683) | > loss_disc_real_2: 0.2575792670249939 (0.3659622371196747) | > loss_disc_real_3: 0.3351534903049469 (0.3434281845887502) | > loss_disc_real_4: 0.25893643498420715 (0.3036168118317922) | > loss_disc_real_5: 0.3540754020214081 (0.34290159742037457) | > loss_0: 3.1153531074523926 (2.8077549934387207) | > loss_gen: 1.6670351028442383 (2.8512030442555747) | > loss_kl: 2.330221652984619 (4.246528148651123) | > loss_feat: 1.1899515390396118 (4.487213492393494) | > loss_mel: 8.117497444152832 (18.8445405960083) | > loss_duration: 2.903541088104248 (3.112534284591675) | > loss_1: 16.2082462310791 (33.542019526163735) --> EVAL PERFORMANCE | > avg_loader_time: 0.007420698801676433 (-0.001616636912027995) | > avg_loss_disc: 2.8077549934387207 (-0.17199762662251805) | > avg_loss_disc_real_0: 0.20143637557824454 (-0.22280464073022208) | > avg_loss_disc_real_1: 0.44753847519556683 (+0.17639087637265527) | > avg_loss_disc_real_2: 0.3659622371196747 (+0.09786544243494671) | > avg_loss_disc_real_3: 0.3434281845887502 (+0.04835776487986243) | > avg_loss_disc_real_4: 0.3036168118317922 (+0.027175764242807987) | > avg_loss_disc_real_5: 0.34290159742037457 (+0.062214056650797545) | > avg_loss_0: 2.8077549934387207 (-0.17199762662251805) | > avg_loss_gen: 2.8512030442555747 (+0.7662974198659263) | > avg_loss_kl: 4.246528148651123 (+0.006784041722615264) | > avg_loss_feat: 4.487213492393494 (+3.6648363769054413) | > avg_loss_mel: 18.8445405960083 (+4.417189598083496) | > avg_loss_duration: 3.112534284591675 (+0.02113620440165187) | > avg_loss_1: 33.542019526163735 (+8.876242319742836)  > EPOCH: 839/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 09:59:44)   --> TIME: 2023-10-20 10:00:08 -- STEP: 29/50 -- GLOBAL_STEP: 94980 | > loss_disc: 2.944936752319336 (2.4959459387022873) | > loss_disc_real_0: 0.11790898442268372 (0.13614495618846909) | > loss_disc_real_1: 0.27934491634368896 (0.23083939384026775) | > loss_disc_real_2: 0.17195118963718414 (0.2366935102076366) | > loss_disc_real_3: 0.18654179573059082 (0.24595023177821063) | > loss_disc_real_4: 0.28450727462768555 (0.24265778379450584) | > loss_disc_real_5: 0.3663182258605957 (0.25307457942258693) | > loss_0: 2.944936752319336 (2.4959459387022873) | > grad_norm_0: tensor(418.6223, device='cuda:0') (tensor(620.1760, device='cuda:0')) | > loss_gen: 1.7008159160614014 (2.4264506800421355) | > loss_kl: 0.9741553664207458 (0.7800188753111609) | > loss_feat: 5.481898307800293 (6.580866620972238) | > loss_mel: 19.420852661132812 (21.86051315274732) | > loss_duration: 1.3407847881317139 (1.3905365960351352) | > loss_1: 28.918506622314453 (33.03838593384316) | > grad_norm_1: tensor(15497.9668, device='cuda:0') (tensor(25118.7422, device='cuda:0')) | > current_lr_0: 8.64239576231147e-05 | > current_lr_1: 8.64239576231147e-05 | > step_time: 0.8252 (0.6097525892586544) | > loader_time: 0.0296 (0.021158374589065027)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2589774131774902 (3.2589774131774902) | > loss_disc_real_0: 0.4335241913795471 (0.4335241913795471) | > loss_disc_real_1: 0.2647568881511688 (0.2647568881511688) | > loss_disc_real_2: 0.41991183161735535 (0.41991183161735535) | > loss_disc_real_3: 0.374886155128479 (0.374886155128479) | > loss_disc_real_4: 0.4162997305393219 (0.4162997305393219) | > loss_disc_real_5: 0.42463335394859314 (0.42463335394859314) | > loss_0: 3.2589774131774902 (3.2589774131774902) | > loss_gen: 2.4184587001800537 (2.4184587001800537) | > loss_kl: 4.547252178192139 (4.547252178192139) | > loss_feat: 3.4950640201568604 (3.4950640201568604) | > loss_mel: 24.744287490844727 (24.744287490844727) | > loss_duration: 2.8768773078918457 (2.8768773078918457) | > loss_1: 38.081939697265625 (38.081939697265625)  --> STEP: 1 | > loss_disc: 2.9047622680664062 (2.9047622680664062) | > loss_disc_real_0: 0.22572638094425201 (0.22572638094425201) | > loss_disc_real_1: 0.4267595410346985 (0.4267595410346985) | > loss_disc_real_2: 0.3478940427303314 (0.3478940427303314) | > loss_disc_real_3: 0.4240270256996155 (0.4240270256996155) | > loss_disc_real_4: 0.3682330250740051 (0.3682330250740051) | > loss_disc_real_5: 0.23764383792877197 (0.23764383792877197) | > loss_0: 2.9047622680664062 (2.9047622680664062) | > loss_gen: 2.6270673274993896 (2.6270673274993896) | > loss_kl: 4.729769706726074 (4.729769706726074) | > loss_feat: 6.605051040649414 (6.605051040649414) | > loss_mel: 21.218246459960938 (21.218246459960938) | > loss_duration: 3.197913408279419 (3.197913408279419) | > loss_1: 38.378047943115234 (38.378047943115234)  --> STEP: 2 | > loss_disc: 2.9422085285186768 (2.9234853982925415) | > loss_disc_real_0: 0.168265700340271 (0.1969960406422615) | > loss_disc_real_1: 0.26437118649482727 (0.3455653637647629) | > loss_disc_real_2: 0.2908002436161041 (0.3193471431732178) | > loss_disc_real_3: 0.297053724527359 (0.36054037511348724) | > loss_disc_real_4: 0.28870704770088196 (0.32847003638744354) | > loss_disc_real_5: 0.31536048650741577 (0.27650216221809387) | > loss_0: 2.9422085285186768 (2.9234853982925415) | > loss_gen: 1.7915592193603516 (2.2093132734298706) | > loss_kl: 5.094095706939697 (4.911932706832886) | > loss_feat: 1.394253134727478 (3.999652087688446) | > loss_mel: 22.58768081665039 (21.902963638305664) | > loss_duration: 3.1314637660980225 (3.1646885871887207) | > loss_1: 33.999053955078125 (36.18855094909668)  --> STEP: 3 | > loss_disc: 3.6137499809265137 (3.1535735925038657) | > loss_disc_real_0: 0.10548809915781021 (0.16649339348077774) | > loss_disc_real_1: 0.5955970883369446 (0.4289092719554901) | > loss_disc_real_2: 0.3714686632156372 (0.3367209831873576) | > loss_disc_real_3: 0.2361098974943161 (0.3190635492404302) | > loss_disc_real_4: 0.3282967507839203 (0.3284122745196025) | > loss_disc_real_5: 0.35343116521835327 (0.30214516321818036) | > loss_0: 3.6137499809265137 (3.1535735925038657) | > loss_gen: 1.5835024118423462 (2.000709652900696) | > loss_kl: 2.16326904296875 (3.9957114855448403) | > loss_feat: 5.754179000854492 (4.584494392077128) | > loss_mel: 23.370513916015625 (22.392147064208984) | > loss_duration: 2.9534921646118164 (3.094289779663086) | > loss_1: 35.824954986572266 (36.067352294921875) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_95000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5773468017578125 (3.0095168948173523) | > loss_disc_real_0: 0.2093457281589508 (0.177206477150321) | > loss_disc_real_1: 0.2551789879798889 (0.3854767009615898) | > loss_disc_real_2: 0.2903652787208557 (0.3251320570707321) | > loss_disc_real_3: 0.35701069235801697 (0.3285503350198269) | > loss_disc_real_4: 0.35420286655426025 (0.3348599225282669) | > loss_disc_real_5: 0.36700645089149475 (0.31836048513650894) | > loss_0: 2.5773468017578125 (3.0095168948173523) | > loss_gen: 2.8163986206054688 (2.204631894826889) | > loss_kl: 4.389370441436768 (4.094126224517822) | > loss_feat: 4.206388473510742 (4.489967912435532) | > loss_mel: 21.551000595092773 (22.18186044692993) | > loss_duration: 2.849348545074463 (3.03305447101593) | > loss_1: 35.81250762939453 (36.00364112854004)  --> STEP: 1 | > loss_disc: 2.9457151889801025 (2.9967565536499023) | > loss_disc_real_0: 0.04135219752788544 (0.1500356212258339) | > loss_disc_real_1: 0.2518758773803711 (0.3587565362453461) | > loss_disc_real_2: 0.32322829961776733 (0.32475130558013915) | > loss_disc_real_3: 0.24074050784111023 (0.31098836958408355) | > loss_disc_real_4: 0.2564793527126312 (0.3191838085651398) | > loss_disc_real_5: 0.2988680601119995 (0.3144620001316071) | > loss_0: 2.9457151889801025 (2.9967565536499023) | > loss_gen: 1.5240743160247803 (2.0685203790664675) | > loss_kl: 4.575262069702148 (4.1903533935546875) | > loss_feat: 0.46208834648132324 (3.68439199924469) | > loss_mel: 17.571428298950195 (21.259774017333985) | > loss_duration: 3.2911808490753174 (3.0846797466278075) | > loss_1: 27.424036026000977 (34.287720108032225)  --> STEP: 2 | > loss_disc: 3.109103202819824 (3.0154809951782227) | > loss_disc_real_0: 0.06735542416572571 (0.13625558838248253) | > loss_disc_real_1: 0.2490895837545395 (0.34047871083021164) | > loss_disc_real_2: 0.31984299421310425 (0.32393325368563336) | > loss_disc_real_3: 0.2382441908121109 (0.29886433978875476) | > loss_disc_real_4: 0.25485244393348694 (0.3084619144598643) | > loss_disc_real_5: 0.30000853538513184 (0.31205308934052783) | > loss_0: 3.109103202819824 (3.0154809951782227) | > loss_gen: 1.4473530054092407 (1.9649924834569295) | > loss_kl: 5.897439956665039 (4.474867820739746) | > loss_feat: 0.05755830556154251 (3.079919716964165) | > loss_mel: 1.4129358530044556 (17.951967656612396) | > loss_duration: 3.0954275131225586 (3.0864710410435996) | > loss_1: 11.910715103149414 (30.55821927388509)  --> STEP: 3 | > loss_disc: 1.6683021783828735 (2.823026878493173) | > loss_disc_real_0: 0.015372948721051216 (0.11898663985942091) | > loss_disc_real_1: 0.1435209959745407 (0.3123418944222586) | > loss_disc_real_2: 0.09569022804498672 (0.29132710716554094) | > loss_disc_real_3: 0.14681749045848846 (0.27714336131300243) | > loss_disc_real_4: 0.07504698634147644 (0.27511692472866606) | > loss_disc_real_5: 0.11672908812761307 (0.28414966059582575) | > loss_0: 1.6683021783828735 (2.823026878493173) | > loss_gen: 2.272644519805908 (2.0089427743639265) | > loss_kl: 2.664083242416382 (4.216184309550694) | > loss_feat: 6.844832420349121 (3.617764388876302) | > loss_mel: 23.38294219970703 (18.727821162768773) | > loss_duration: 2.8349804878234863 (3.050543819155012) | > loss_1: 37.999481201171875 (31.62125669206892) --> EVAL PERFORMANCE | > avg_loader_time: 0.4304539476122175 (+0.42303324881054105) | > avg_loss_disc: 2.823026878493173 (+0.015271885054452206) | > avg_loss_disc_real_0: 0.11898663985942091 (-0.08244973571882362) | > avg_loss_disc_real_1: 0.3123418944222586 (-0.1351965807733082) | > avg_loss_disc_real_2: 0.29132710716554094 (-0.07463512995413374) | > avg_loss_disc_real_3: 0.27714336131300243 (-0.06628482327574775) | > avg_loss_disc_real_4: 0.27511692472866606 (-0.02849988710312612) | > avg_loss_disc_real_5: 0.28414966059582575 (-0.05875193682454882) | > avg_loss_0: 2.823026878493173 (+0.015271885054452206) | > avg_loss_gen: 2.0089427743639265 (-0.8422602698916482) | > avg_loss_kl: 4.216184309550694 (-0.03034383910042937) | > avg_loss_feat: 3.617764388876302 (-0.8694491035171916) | > avg_loss_mel: 18.727821162768773 (-0.1167194332395276) | > avg_loss_duration: 3.050543819155012 (-0.061990465436662756) | > avg_loss_1: 31.62125669206892 (-1.9207628340948162)  > EPOCH: 840/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:00:44)   --> TIME: 2023-10-20 10:01:02 -- STEP: 9/50 -- GLOBAL_STEP: 95010 | > loss_disc: 2.720072031021118 (2.3739221890767417) | > loss_disc_real_0: 0.12019243091344833 (0.14533911852373016) | > loss_disc_real_1: 0.3796897232532501 (0.2294625002476904) | > loss_disc_real_2: 0.21670690178871155 (0.22053719808657965) | > loss_disc_real_3: 0.290537029504776 (0.23684186653958428) | > loss_disc_real_4: 0.2550402879714966 (0.18839995976951388) | > loss_disc_real_5: 0.20189300179481506 (0.18524751382776433) | > loss_0: 2.720072031021118 (2.3739221890767417) | > grad_norm_0: tensor(354.3452, device='cuda:0') (tensor(686.9960, device='cuda:0')) | > loss_gen: 2.1432735919952393 (2.394313414891561) | > loss_kl: 0.59702467918396 (0.7821058498488532) | > loss_feat: 4.634817600250244 (6.310964054531521) | > loss_mel: 24.29155921936035 (18.581051958931816) | > loss_duration: 1.349134922027588 (1.3879391882154677) | > loss_1: 33.015811920166016 (29.45637411541409) | > grad_norm_1: tensor(5544.8384, device='cuda:0') (tensor(41651.4375, device='cuda:0')) | > current_lr_0: 8.633757146652189e-05 | > current_lr_1: 8.633757146652189e-05 | > step_time: 0.8486 (0.6455406877729628) | > loader_time: 0.0315 (0.01644791497124566)  --> TIME: 2023-10-20 10:01:22 -- STEP: 39/50 -- GLOBAL_STEP: 95040 | > loss_disc: 3.3947126865386963 (2.4291259142068715) | > loss_disc_real_0: 0.09824115037918091 (0.12583376163951096) | > loss_disc_real_1: 0.19961678981781006 (0.22578473159900078) | > loss_disc_real_2: 0.25015789270401 (0.23469914206996179) | > loss_disc_real_3: 0.22524578869342804 (0.2330506077179542) | > loss_disc_real_4: 0.41482484340667725 (0.22662397751059288) | > loss_disc_real_5: 0.2281639575958252 (0.2234922297513829) | > loss_0: 3.3947126865386963 (2.4291259142068715) | > grad_norm_0: tensor(1378.2672, device='cuda:0') (tensor(672.3594, device='cuda:0')) | > loss_gen: 1.5610427856445312 (2.3506864676108727) | > loss_kl: 0.7035576701164246 (0.8253157429206066) | > loss_feat: 4.959936618804932 (6.000911468878771) | > loss_mel: 27.278200149536133 (21.58227718182099) | > loss_duration: 1.4397823810577393 (1.3693754031107976) | > loss_1: 35.94252014160156 (32.12856597166796) | > grad_norm_1: tensor(10562.5039, device='cuda:0') (tensor(28677.7344, device='cuda:0')) | > current_lr_0: 8.633757146652189e-05 | > current_lr_1: 8.633757146652189e-05 | > step_time: 0.7798 (0.6545323102902144) | > loader_time: 0.0241 (0.0227200557024051)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.518498420715332 (2.518498420715332) | > loss_disc_real_0: 0.20177656412124634 (0.20177656412124634) | > loss_disc_real_1: 0.18909884989261627 (0.18909884989261627) | > loss_disc_real_2: 0.22334443032741547 (0.22334443032741547) | > loss_disc_real_3: 0.3227201998233795 (0.3227201998233795) | > loss_disc_real_4: 0.2346748411655426 (0.2346748411655426) | > loss_disc_real_5: 0.3479686975479126 (0.3479686975479126) | > loss_0: 2.518498420715332 (2.518498420715332) | > loss_gen: 2.4320640563964844 (2.4320640563964844) | > loss_kl: 5.476068019866943 (5.476068019866943) | > loss_feat: 5.154613494873047 (5.154613494873047) | > loss_mel: 22.92990493774414 (22.92990493774414) | > loss_duration: 2.936185359954834 (2.936185359954834) | > loss_1: 38.9288330078125 (38.9288330078125)  --> STEP: 1 | > loss_disc: 2.8181800842285156 (2.8181800842285156) | > loss_disc_real_0: 0.07282138615846634 (0.07282138615846634) | > loss_disc_real_1: 0.2226303368806839 (0.2226303368806839) | > loss_disc_real_2: 0.25108838081359863 (0.25108838081359863) | > loss_disc_real_3: 0.35182976722717285 (0.35182976722717285) | > loss_disc_real_4: 0.2437312752008438 (0.2437312752008438) | > loss_disc_real_5: 0.25163477659225464 (0.25163477659225464) | > loss_0: 2.8181800842285156 (2.8181800842285156) | > loss_gen: 1.671795129776001 (1.671795129776001) | > loss_kl: 5.082098960876465 (5.082098960876465) | > loss_feat: 1.817241907119751 (1.817241907119751) | > loss_mel: 22.36302375793457 (22.36302375793457) | > loss_duration: 3.3526790142059326 (3.3526790142059326) | > loss_1: 34.28683853149414 (34.28683853149414)  --> STEP: 2 | > loss_disc: 3.0116753578186035 (2.9149277210235596) | > loss_disc_real_0: 0.23908662796020508 (0.1559540070593357) | > loss_disc_real_1: 0.2638359069824219 (0.2432331219315529) | > loss_disc_real_2: 0.26978737115859985 (0.26043787598609924) | > loss_disc_real_3: 0.28427600860595703 (0.31805288791656494) | > loss_disc_real_4: 0.23902568221092224 (0.24137847870588303) | > loss_disc_real_5: 0.29708167910575867 (0.27435822784900665) | > loss_0: 3.0116753578186035 (2.9149277210235596) | > loss_gen: 1.5920161008834839 (1.6319056153297424) | > loss_kl: 5.720534324645996 (5.4013166427612305) | > loss_feat: 0.023198002949357033 (0.920219955034554) | > loss_mel: 0.9352499842643738 (11.649136871099472) | > loss_duration: 3.1609444618225098 (3.256811738014221) | > loss_1: 11.431941986083984 (22.859390258789062)  --> STEP: 3 | > loss_disc: 2.905071973800659 (2.9116424719492593) | > loss_disc_real_0: 0.04753143712878227 (0.1198131504158179) | > loss_disc_real_1: 0.36110612750053406 (0.28252412378787994) | > loss_disc_real_2: 0.3119351863861084 (0.2776036461194356) | > loss_disc_real_3: 0.26839709281921387 (0.30150095621744794) | > loss_disc_real_4: 0.30730751156806946 (0.2633548229932785) | > loss_disc_real_5: 0.3515370786190033 (0.30008451143900555) | > loss_0: 2.905071973800659 (2.9116424719492593) | > loss_gen: 1.887220025062561 (1.7170104185740154) | > loss_kl: 2.1533539295196533 (4.318662405014038) | > loss_feat: 2.928959608078003 (1.5897998393823702) | > loss_mel: 23.210491180419922 (15.502921640872955) | > loss_duration: 2.880244016647339 (3.1312891642252603) | > loss_1: 33.06026840209961 (26.25968297322591) --> EVAL PERFORMANCE | > avg_loader_time: 0.010358810424804688 (-0.4200951371874128) | > avg_loss_disc: 2.9116424719492593 (+0.08861559345608638) | > avg_loss_disc_real_0: 0.1198131504158179 (+0.0008265105563969866) | > avg_loss_disc_real_1: 0.28252412378787994 (-0.029817770634378682) | > avg_loss_disc_real_2: 0.2776036461194356 (-0.013723461046105334) | > avg_loss_disc_real_3: 0.30150095621744794 (+0.0243575949044455) | > avg_loss_disc_real_4: 0.2633548229932785 (-0.011762101735387553) | > avg_loss_disc_real_5: 0.30008451143900555 (+0.015934850843179804) | > avg_loss_0: 2.9116424719492593 (+0.08861559345608638) | > avg_loss_gen: 1.7170104185740154 (-0.29193235578991117) | > avg_loss_kl: 4.318662405014038 (+0.10247809546334441) | > avg_loss_feat: 1.5897998393823702 (-2.027964549493932) | > avg_loss_mel: 15.502921640872955 (-3.224899521895818) | > avg_loss_duration: 3.1312891642252603 (+0.08074534507024822) | > avg_loss_1: 26.25968297322591 (-5.361573718843008)  > EPOCH: 841/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:01:48)   --> TIME: 2023-10-20 10:02:04 -- STEP: 19/50 -- GLOBAL_STEP: 95070 | > loss_disc: 2.7784276008605957 (2.321571525774504) | > loss_disc_real_0: 0.19275140762329102 (0.12264510175507319) | > loss_disc_real_1: 0.4236779510974884 (0.21289122300712685) | > loss_disc_real_2: 0.37726151943206787 (0.21225066286952873) | > loss_disc_real_3: 0.2971295416355133 (0.2283781610037151) | > loss_disc_real_4: 0.20271679759025574 (0.17479385641452513) | > loss_disc_real_5: 0.2747631371021271 (0.19541466500806182) | > loss_0: 2.7784276008605957 (2.321571525774504) | > grad_norm_0: tensor(762.5471, device='cuda:0') (tensor(529.3073, device='cuda:0')) | > loss_gen: 2.3477721214294434 (2.339141004963925) | > loss_kl: 0.8909972906112671 (0.749843963666966) | > loss_feat: 3.6053812503814697 (6.334926389942043) | > loss_mel: 24.140697479248047 (23.03827356664758) | > loss_duration: 1.4843547344207764 (1.432005016427291) | > loss_1: 32.46920394897461 (33.89418978440134) | > grad_norm_1: tensor(3653.7605, device='cuda:0') (tensor(22876.1426, device='cuda:0')) | > current_lr_0: 8.625127165830116e-05 | > current_lr_1: 8.625127165830116e-05 | > step_time: 0.6751 (0.4711418904756245) | > loader_time: 0.0023 (0.015266820004111845)  --> TIME: 2023-10-20 10:02:28 -- STEP: 49/50 -- GLOBAL_STEP: 95100 | > loss_disc: 3.023411273956299 (2.4020442427421096) | > loss_disc_real_0: 0.3427956700325012 (0.13173651476675757) | > loss_disc_real_1: 0.257960706949234 (0.21491672212676127) | > loss_disc_real_2: 0.2861613929271698 (0.2213338963231262) | > loss_disc_real_3: 0.2630797028541565 (0.23544140327341703) | > loss_disc_real_4: 0.24440857768058777 (0.2205903509213608) | > loss_disc_real_5: 0.2680962085723877 (0.22595850458102568) | > loss_0: 3.023411273956299 (2.4020442427421096) | > grad_norm_0: tensor(401.0701, device='cuda:0') (tensor(651.1707, device='cuda:0')) | > loss_gen: 1.7494754791259766 (2.313421760286604) | > loss_kl: 0.5220315456390381 (0.7547462433576584) | > loss_feat: 0.09452009946107864 (6.033416234717079) | > loss_mel: 2.7003321647644043 (21.91350402880688) | > loss_duration: 1.4573171138763428 (1.3904099294117518) | > loss_1: 6.523676872253418 (32.40549809592112) | > grad_norm_1: tensor(24818.1191, device='cuda:0') (tensor(18934.5078, device='cuda:0')) | > current_lr_0: 8.625127165830116e-05 | > current_lr_1: 8.625127165830116e-05 | > step_time: 0.5934 (0.6422280048837469) | > loader_time: 0.4479 (0.0314220700945173)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8221194744110107 (2.8221194744110107) | > loss_disc_real_0: 0.3036251366138458 (0.3036251366138458) | > loss_disc_real_1: 0.25452950596809387 (0.25452950596809387) | > loss_disc_real_2: 0.2537509500980377 (0.2537509500980377) | > loss_disc_real_3: 0.26152148842811584 (0.26152148842811584) | > loss_disc_real_4: 0.23733878135681152 (0.23733878135681152) | > loss_disc_real_5: 0.26539546251296997 (0.26539546251296997) | > loss_0: 2.8221194744110107 (2.8221194744110107) | > loss_gen: 1.8408509492874146 (1.8408509492874146) | > loss_kl: 4.743432521820068 (4.743432521820068) | > loss_feat: 0.7062139511108398 (0.7062139511108398) | > loss_mel: 14.519186019897461 (14.519186019897461) | > loss_duration: 2.9060916900634766 (2.9060916900634766) | > loss_1: 24.715774536132812 (24.715774536132812)  --> STEP: 1 | > loss_disc: 2.902658700942993 (2.902658700942993) | > loss_disc_real_0: 0.29810261726379395 (0.29810261726379395) | > loss_disc_real_1: 0.3295237421989441 (0.3295237421989441) | > loss_disc_real_2: 0.2439533770084381 (0.2439533770084381) | > loss_disc_real_3: 0.2966790795326233 (0.2966790795326233) | > loss_disc_real_4: 0.29741767048835754 (0.29741767048835754) | > loss_disc_real_5: 0.19283859431743622 (0.19283859431743622) | > loss_0: 2.902658700942993 (2.902658700942993) | > loss_gen: 1.8515664339065552 (1.8515664339065552) | > loss_kl: 5.083386421203613 (5.083386421203613) | > loss_feat: 2.549875020980835 (2.549875020980835) | > loss_mel: 21.957408905029297 (21.957408905029297) | > loss_duration: 3.3030688762664795 (3.3030688762664795) | > loss_1: 34.74530792236328 (34.74530792236328)  --> STEP: 2 | > loss_disc: 2.6281025409698486 (2.765380620956421) | > loss_disc_real_0: 0.1423240602016449 (0.22021333873271942) | > loss_disc_real_1: 0.2281510829925537 (0.2788374125957489) | > loss_disc_real_2: 0.3119103014469147 (0.2779318392276764) | > loss_disc_real_3: 0.29874545335769653 (0.2977122664451599) | > loss_disc_real_4: 0.19456882774829865 (0.2459932491183281) | > loss_disc_real_5: 0.2756144404411316 (0.2342265173792839) | > loss_0: 2.6281025409698486 (2.765380620956421) | > loss_gen: 2.1903164386749268 (2.020941436290741) | > loss_kl: 5.703173637390137 (5.393280029296875) | > loss_feat: 3.307762384414673 (2.928818702697754) | > loss_mel: 22.64391326904297 (22.300661087036133) | > loss_duration: 3.1930360794067383 (3.248052477836609) | > loss_1: 37.03820037841797 (35.891754150390625)  --> STEP: 3 | > loss_disc: 2.858684539794922 (2.7964819272359214) | > loss_disc_real_0: 0.20991621911525726 (0.2167809655268987) | > loss_disc_real_1: 0.20878201723098755 (0.25548561414082843) | > loss_disc_real_2: 0.2607993185520172 (0.27222099900245667) | > loss_disc_real_3: 0.19846707582473755 (0.2646305362383525) | > loss_disc_real_4: 0.2783586382865906 (0.2567817121744156) | > loss_disc_real_5: 0.32606154680252075 (0.26483819385369617) | > loss_0: 2.858684539794922 (2.7964819272359214) | > loss_gen: 1.8151130676269531 (1.9523319800694783) | > loss_kl: 2.303680896759033 (4.363413651784261) | > loss_feat: 1.8719134330749512 (2.57651694615682) | > loss_mel: 19.49654769897461 (21.365956624348957) | > loss_duration: 2.980123281478882 (3.1587427457173667) | > loss_1: 28.467378616333008 (33.41696230570475) --> EVAL PERFORMANCE | > avg_loader_time: 0.018916765848795574 (+0.008557955423990887) | > avg_loss_disc: 2.7964819272359214 (-0.11516054471333792) | > avg_loss_disc_real_0: 0.2167809655268987 (+0.09696781511108081) | > avg_loss_disc_real_1: 0.25548561414082843 (-0.027038509647051512) | > avg_loss_disc_real_2: 0.27222099900245667 (-0.005382647116978945) | > avg_loss_disc_real_3: 0.2646305362383525 (-0.03687041997909546) | > avg_loss_disc_real_4: 0.2567817121744156 (-0.006573110818862915) | > avg_loss_disc_real_5: 0.26483819385369617 (-0.035246317585309384) | > avg_loss_0: 2.7964819272359214 (-0.11516054471333792) | > avg_loss_gen: 1.9523319800694783 (+0.2353215614954629) | > avg_loss_kl: 4.363413651784261 (+0.044751246770222686) | > avg_loss_feat: 2.57651694615682 (+0.9867171067744496) | > avg_loss_mel: 21.365956624348957 (+5.863034983476002) | > avg_loss_duration: 3.1587427457173667 (+0.027453581492106416) | > avg_loss_1: 33.41696230570475 (+7.15727933247884)  > EPOCH: 842/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:02:44)   --> TIME: 2023-10-20 10:03:07 -- STEP: 29/50 -- GLOBAL_STEP: 95130 | > loss_disc: 2.9603028297424316 (2.4112179361540695) | > loss_disc_real_0: 0.3501872718334198 (0.14677572783468099) | > loss_disc_real_1: 0.27156123518943787 (0.21122870754835935) | > loss_disc_real_2: 0.25932130217552185 (0.2058189922365649) | > loss_disc_real_3: 0.21483714878559113 (0.230828152262959) | > loss_disc_real_4: 0.26012536883354187 (0.20868306851078725) | > loss_disc_real_5: 0.2621086835861206 (0.2341456027251893) | > loss_0: 2.9603028297424316 (2.4112179361540695) | > grad_norm_0: tensor(1376.6332, device='cuda:0') (tensor(630.8521, device='cuda:0')) | > loss_gen: 1.7089170217514038 (2.345662569177562) | > loss_kl: 0.7020448446273804 (0.784983896489801) | > loss_feat: 0.31628021597862244 (5.810863684124217) | > loss_mel: 10.713479995727539 (22.015342101968567) | > loss_duration: 1.371918797492981 (1.3901612059823398) | > loss_1: 14.812640190124512 (32.34701399967588) | > grad_norm_1: tensor(13220.2842, device='cuda:0') (tensor(20393.7363, device='cuda:0')) | > current_lr_0: 8.61650581121419e-05 | > current_lr_1: 8.61650581121419e-05 | > step_time: 0.6015 (0.6298203879389269) | > loader_time: 0.0024 (0.022403527950418407)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.121631145477295 (2.121631145477295) | > loss_disc_real_0: 0.17399296164512634 (0.17399296164512634) | > loss_disc_real_1: 0.2561008036136627 (0.2561008036136627) | > loss_disc_real_2: 0.2740020155906677 (0.2740020155906677) | > loss_disc_real_3: 0.2606099843978882 (0.2606099843978882) | > loss_disc_real_4: 0.24807953834533691 (0.24807953834533691) | > loss_disc_real_5: 0.3982062339782715 (0.3982062339782715) | > loss_0: 2.121631145477295 (2.121631145477295) | > loss_gen: 3.6255311965942383 (3.6255311965942383) | > loss_kl: 4.594696521759033 (4.594696521759033) | > loss_feat: 7.989406108856201 (7.989406108856201) | > loss_mel: 21.951894760131836 (21.951894760131836) | > loss_duration: 2.8841466903686523 (2.8841466903686523) | > loss_1: 41.04567337036133 (41.04567337036133)  --> STEP: 1 | > loss_disc: 2.7242612838745117 (2.7242612838745117) | > loss_disc_real_0: 0.2152547389268875 (0.2152547389268875) | > loss_disc_real_1: 0.3097592890262604 (0.3097592890262604) | > loss_disc_real_2: 0.3066331446170807 (0.3066331446170807) | > loss_disc_real_3: 0.3935694396495819 (0.3935694396495819) | > loss_disc_real_4: 0.4334199130535126 (0.4334199130535126) | > loss_disc_real_5: 0.5911286473274231 (0.5911286473274231) | > loss_0: 2.7242612838745117 (2.7242612838745117) | > loss_gen: 4.607609748840332 (4.607609748840332) | > loss_kl: 4.428646564483643 (4.428646564483643) | > loss_feat: 9.740069389343262 (9.740069389343262) | > loss_mel: 27.105966567993164 (27.105966567993164) | > loss_duration: 3.2313222885131836 (3.2313222885131836) | > loss_1: 49.11361312866211 (49.11361312866211)  --> STEP: 2 | > loss_disc: 1.1390401124954224 (1.931650698184967) | > loss_disc_real_0: 0.025566836819052696 (0.1204107878729701) | > loss_disc_real_1: 0.12076497822999954 (0.21526213362812996) | > loss_disc_real_2: 0.12236066162586212 (0.2144969031214714) | > loss_disc_real_3: 0.06104268878698349 (0.2273060642182827) | > loss_disc_real_4: 0.026296859607100487 (0.22985838633030653) | > loss_disc_real_5: 0.08244699984788895 (0.336787823587656) | > loss_0: 1.1390401124954224 (1.931650698184967) | > loss_gen: 3.4742064476013184 (4.040908098220825) | > loss_kl: 5.373127460479736 (4.9008870124816895) | > loss_feat: 15.033347129821777 (12.38670825958252) | > loss_mel: 30.03386688232422 (28.56991672515869) | > loss_duration: 3.120159387588501 (3.1757408380508423) | > loss_1: 57.034706115722656 (53.07415962219238)  --> STEP: 3 | > loss_disc: 2.1595308780670166 (2.0076107581456504) | > loss_disc_real_0: 0.38228392601013184 (0.20770183391869068) | > loss_disc_real_1: 0.15852373838424683 (0.19634933521350226) | > loss_disc_real_2: 0.1362287402153015 (0.18840751548608145) | > loss_disc_real_3: 0.13864105939865112 (0.19775106261173883) | > loss_disc_real_4: 0.0678342878818512 (0.17585035351415476) | > loss_disc_real_5: 0.20230844616889954 (0.2919613644480705) | > loss_0: 2.1595308780670166 (2.0076107581456504) | > loss_gen: 2.6901936531066895 (3.5906699498494468) | > loss_kl: 2.122140645980835 (3.9746382236480713) | > loss_feat: 6.733148574829102 (10.502188364664713) | > loss_mel: 25.58587646484375 (27.575236638387043) | > loss_duration: 3.043865203857422 (3.131782293319702) | > loss_1: 40.17522430419922 (48.774514516194664) --> EVAL PERFORMANCE | > avg_loader_time: 0.02451976140340169 (+0.0056029955546061175) | > avg_loss_disc: 2.0076107581456504 (-0.788871169090271) | > avg_loss_disc_real_0: 0.20770183391869068 (-0.00907913160820803) | > avg_loss_disc_real_1: 0.19634933521350226 (-0.059136278927326175) | > avg_loss_disc_real_2: 0.18840751548608145 (-0.08381348351637521) | > avg_loss_disc_real_3: 0.19775106261173883 (-0.06687947362661364) | > avg_loss_disc_real_4: 0.17585035351415476 (-0.08093135866026083) | > avg_loss_disc_real_5: 0.2919613644480705 (+0.027123170594374357) | > avg_loss_0: 2.0076107581456504 (-0.788871169090271) | > avg_loss_gen: 3.5906699498494468 (+1.6383379697799685) | > avg_loss_kl: 3.9746382236480713 (-0.3887754281361895) | > avg_loss_feat: 10.502188364664713 (+7.925671418507893) | > avg_loss_mel: 27.575236638387043 (+6.209280014038086) | > avg_loss_duration: 3.131782293319702 (-0.026960452397664536) | > avg_loss_1: 48.774514516194664 (+15.357552210489914)  > EPOCH: 843/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:03:31)   --> TIME: 2023-10-20 10:03:43 -- STEP: 9/50 -- GLOBAL_STEP: 95160 | > loss_disc: 2.709567070007324 (2.317862139807807) | > loss_disc_real_0: 0.19326138496398926 (0.11061619449820784) | > loss_disc_real_1: 0.24428679049015045 (0.22138357824749416) | > loss_disc_real_2: 0.282166063785553 (0.24758832818932003) | > loss_disc_real_3: 0.30976295471191406 (0.24163634247250027) | > loss_disc_real_4: 0.12034045904874802 (0.23012025902668634) | > loss_disc_real_5: 0.09666147828102112 (0.2429744510187043) | > loss_0: 2.709567070007324 (2.317862139807807) | > grad_norm_0: tensor(538.8671, device='cuda:0') (tensor(656.0102, device='cuda:0')) | > loss_gen: 2.003192901611328 (2.614736715952555) | > loss_kl: 0.8045260310173035 (0.7926321956846449) | > loss_feat: 5.363666534423828 (5.842609935336643) | > loss_mel: 20.784318923950195 (22.354134877522785) | > loss_duration: 1.364073634147644 (1.3816134929656982) | > loss_1: 30.31977653503418 (32.98572752210829) | > grad_norm_1: tensor(7340.8530, device='cuda:0') (tensor(25913.7500, device='cuda:0')) | > current_lr_0: 8.607893074181982e-05 | > current_lr_1: 8.607893074181982e-05 | > step_time: 0.4062 (0.4880741702185737) | > loader_time: 0.0114 (0.014364533954196505)  --> TIME: 2023-10-20 10:04:01 -- STEP: 39/50 -- GLOBAL_STEP: 95190 | > loss_disc: 1.778347373008728 (2.4805436867934008) | > loss_disc_real_0: 0.08593326807022095 (0.16379167182514298) | > loss_disc_real_1: 0.13599641621112823 (0.21825614934548349) | > loss_disc_real_2: 0.08960765600204468 (0.22737610607575148) | > loss_disc_real_3: 0.2057814598083496 (0.23763617830207714) | > loss_disc_real_4: 0.13250884413719177 (0.23000713227651057) | > loss_disc_real_5: 0.09221953898668289 (0.23895261298196438) | > loss_0: 1.778347373008728 (2.4805436867934008) | > grad_norm_0: tensor(734.3602, device='cuda:0') (tensor(707.5953, device='cuda:0')) | > loss_gen: 2.579423427581787 (2.312836466691432) | > loss_kl: 0.6805904507637024 (0.8641842435567807) | > loss_feat: 8.176189422607422 (5.454257648629256) | > loss_mel: 23.373004913330078 (20.401969056863045) | > loss_duration: 1.3954793214797974 (1.3749593557455602) | > loss_1: 36.204689025878906 (30.40820656067286) | > grad_norm_1: tensor(29430.3047, device='cuda:0') (tensor(24720.5117, device='cuda:0')) | > current_lr_0: 8.607893074181982e-05 | > current_lr_1: 8.607893074181982e-05 | > step_time: 0.4589 (0.5647463248326228) | > loader_time: 0.0048 (0.018366055610852364)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8836941719055176 (2.8836941719055176) | > loss_disc_real_0: 0.39803346991539 (0.39803346991539) | > loss_disc_real_1: 0.3393435478210449 (0.3393435478210449) | > loss_disc_real_2: 0.36539265513420105 (0.36539265513420105) | > loss_disc_real_3: 0.26901450753211975 (0.26901450753211975) | > loss_disc_real_4: 0.2537948191165924 (0.2537948191165924) | > loss_disc_real_5: 0.3664303123950958 (0.3664303123950958) | > loss_0: 2.8836941719055176 (2.8836941719055176) | > loss_gen: 2.548549175262451 (2.548549175262451) | > loss_kl: 4.531551361083984 (4.531551361083984) | > loss_feat: 4.9379401206970215 (4.9379401206970215) | > loss_mel: 21.787673950195312 (21.787673950195312) | > loss_duration: 2.905869483947754 (2.905869483947754) | > loss_1: 36.71158218383789 (36.71158218383789)  --> STEP: 1 | > loss_disc: 2.911510944366455 (2.911510944366455) | > loss_disc_real_0: 0.1736852526664734 (0.1736852526664734) | > loss_disc_real_1: 0.3459835648536682 (0.3459835648536682) | > loss_disc_real_2: 0.3300657272338867 (0.3300657272338867) | > loss_disc_real_3: 0.2637260854244232 (0.2637260854244232) | > loss_disc_real_4: 0.27467095851898193 (0.27467095851898193) | > loss_disc_real_5: 0.38799506425857544 (0.38799506425857544) | > loss_0: 2.911510944366455 (2.911510944366455) | > loss_gen: 2.3196845054626465 (2.3196845054626465) | > loss_kl: 5.263563632965088 (5.263563632965088) | > loss_feat: 4.749152183532715 (4.749152183532715) | > loss_mel: 23.983715057373047 (23.983715057373047) | > loss_duration: 3.2507565021514893 (3.2507565021514893) | > loss_1: 39.56686782836914 (39.56686782836914)  --> STEP: 2 | > loss_disc: 1.4890658855438232 (2.200288414955139) | > loss_disc_real_0: 0.045777827501297 (0.10973154008388519) | > loss_disc_real_1: 0.043261781334877014 (0.1946226730942726) | > loss_disc_real_2: 0.05302618071436882 (0.19154595397412777) | > loss_disc_real_3: 0.039301950484514236 (0.15151401795446873) | > loss_disc_real_4: 0.03390612453222275 (0.15428854152560234) | > loss_disc_real_5: 0.07657091319561005 (0.23228298872709274) | > loss_0: 1.4890658855438232 (2.200288414955139) | > loss_gen: 2.364881753921509 (2.3422831296920776) | > loss_kl: 5.688414096832275 (5.475988864898682) | > loss_feat: 11.17001724243164 (7.959584712982178) | > loss_mel: 23.47562599182129 (23.729670524597168) | > loss_duration: 3.1383936405181885 (3.194575071334839) | > loss_1: 45.83733367919922 (42.70210075378418)  --> STEP: 3 | > loss_disc: 3.012592315673828 (2.4710563818613687) | > loss_disc_real_0: 0.2673281729221344 (0.16226375102996826) | > loss_disc_real_1: 0.2953495383262634 (0.22819829483826956) | > loss_disc_real_2: 0.33229777216911316 (0.23846322670578957) | > loss_disc_real_3: 0.28325650095939636 (0.19542817895611128) | > loss_disc_real_4: 0.2791430652141571 (0.19590671608845392) | > loss_disc_real_5: 0.24633613228797913 (0.23696736991405487) | > loss_0: 3.012592315673828 (2.4710563818613687) | > loss_gen: 1.7378042936325073 (2.1407901843388877) | > loss_kl: 2.5386667251586914 (4.496881484985352) | > loss_feat: 0.9803926944732666 (5.633187373479207) | > loss_mel: 15.895395278930664 (21.118245442708332) | > loss_duration: 3.0690295696258545 (3.1527265707651773) | > loss_1: 24.221288681030273 (36.54183006286621) --> EVAL PERFORMANCE | > avg_loader_time: 0.0053297678629557295 (-0.01918999354044596) | > avg_loss_disc: 2.4710563818613687 (+0.4634456237157183) | > avg_loss_disc_real_0: 0.16226375102996826 (-0.04543808288872242) | > avg_loss_disc_real_1: 0.22819829483826956 (+0.0318489596247673) | > avg_loss_disc_real_2: 0.23846322670578957 (+0.050055711219708116) | > avg_loss_disc_real_3: 0.19542817895611128 (-0.00232288365562755) | > avg_loss_disc_real_4: 0.19590671608845392 (+0.020056362574299158) | > avg_loss_disc_real_5: 0.23696736991405487 (-0.054993994534015656) | > avg_loss_0: 2.4710563818613687 (+0.4634456237157183) | > avg_loss_gen: 2.1407901843388877 (-1.449879765510559) | > avg_loss_kl: 4.496881484985352 (+0.5222432613372803) | > avg_loss_feat: 5.633187373479207 (-4.869000991185506) | > avg_loss_mel: 21.118245442708332 (-6.456991195678711) | > avg_loss_duration: 3.1527265707651773 (+0.020944277445475112) | > avg_loss_1: 36.54183006286621 (-12.232684453328453)  > EPOCH: 844/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:04:26)   --> TIME: 2023-10-20 10:04:44 -- STEP: 19/50 -- GLOBAL_STEP: 95220 | > loss_disc: 2.8145530223846436 (2.459645541090714) | > loss_disc_real_0: 0.15560340881347656 (0.1377205226178232) | > loss_disc_real_1: 0.2709348201751709 (0.22174795246437976) | > loss_disc_real_2: 0.27555254101753235 (0.22867550838150477) | > loss_disc_real_3: 0.27038127183914185 (0.24388677195498817) | > loss_disc_real_4: 0.3224206864833832 (0.21263805874868444) | > loss_disc_real_5: 0.29339590668678284 (0.22960409953405983) | > loss_0: 2.8145530223846436 (2.459645541090714) | > grad_norm_0: tensor(441.3500, device='cuda:0') (tensor(593.3766, device='cuda:0')) | > loss_gen: 1.8827564716339111 (2.2822795478921187) | > loss_kl: 0.9303542375564575 (0.8462409502581546) | > loss_feat: 2.049490213394165 (5.34834327666383) | > loss_mel: 20.028594970703125 (23.113090414749948) | > loss_duration: 1.5061049461364746 (1.4174953259919818) | > loss_1: 26.397302627563477 (33.00744955163253) | > grad_norm_1: tensor(8696.9893, device='cuda:0') (tensor(20655.3457, device='cuda:0')) | > current_lr_0: 8.599288946119677e-05 | > current_lr_1: 8.599288946119677e-05 | > step_time: 0.3796 (0.6111863161388197) | > loader_time: 0.0018 (0.020618990847938938)  --> TIME: 2023-10-20 10:05:03 -- STEP: 49/50 -- GLOBAL_STEP: 95250 | > loss_disc: 2.023395538330078 (2.5081294239783776) | > loss_disc_real_0: 0.19972515106201172 (0.16261924343297673) | > loss_disc_real_1: 0.1716335415840149 (0.23084876564692478) | > loss_disc_real_2: 0.14109565317630768 (0.2261783173877974) | > loss_disc_real_3: 0.286702960729599 (0.2416074945002186) | > loss_disc_real_4: 0.13915909826755524 (0.23707101053121138) | > loss_disc_real_5: 0.17587696015834808 (0.23211085978819399) | > loss_0: 2.023395538330078 (2.5081294239783776) | > grad_norm_0: tensor(940.5903, device='cuda:0') (tensor(632.6217, device='cuda:0')) | > loss_gen: 2.826110601425171 (2.260481092394614) | > loss_kl: 0.8666698336601257 (0.7888221439658379) | > loss_feat: 4.832229137420654 (5.342363123382841) | > loss_mel: 25.593137741088867 (22.037902649568053) | > loss_duration: 1.4732197523117065 (1.3786250036589953) | > loss_1: 35.591365814208984 (31.808193975565388) | > grad_norm_1: tensor(4427.8750, device='cuda:0') (tensor(18186.8496, device='cuda:0')) | > current_lr_0: 8.599288946119677e-05 | > current_lr_1: 8.599288946119677e-05 | > step_time: 0.4069 (0.5978405378302749) | > loader_time: 0.4901 (0.027557825555606763)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.235668182373047 (2.235668182373047) | > loss_disc_real_0: 0.11663629859685898 (0.11663629859685898) | > loss_disc_real_1: 0.2243756353855133 (0.2243756353855133) | > loss_disc_real_2: 0.1905534863471985 (0.1905534863471985) | > loss_disc_real_3: 0.284662663936615 (0.284662663936615) | > loss_disc_real_4: 0.2955131232738495 (0.2955131232738495) | > loss_disc_real_5: 0.36725616455078125 (0.36725616455078125) | > loss_0: 2.235668182373047 (2.235668182373047) | > loss_gen: 2.7453598976135254 (2.7453598976135254) | > loss_kl: 4.508896350860596 (4.508896350860596) | > loss_feat: 8.05074691772461 (8.05074691772461) | > loss_mel: 24.373897552490234 (24.373897552490234) | > loss_duration: 2.9578311443328857 (2.9578311443328857) | > loss_1: 42.63673400878906 (42.63673400878906)  --> STEP: 1 | > loss_disc: 2.9224636554718018 (2.9224636554718018) | > loss_disc_real_0: 0.46463072299957275 (0.46463072299957275) | > loss_disc_real_1: 0.29317209124565125 (0.29317209124565125) | > loss_disc_real_2: 0.27664220333099365 (0.27664220333099365) | > loss_disc_real_3: 0.33691543340682983 (0.33691543340682983) | > loss_disc_real_4: 0.24085243046283722 (0.24085243046283722) | > loss_disc_real_5: 0.3162383735179901 (0.3162383735179901) | > loss_0: 2.9224636554718018 (2.9224636554718018) | > loss_gen: 2.3879716396331787 (2.3879716396331787) | > loss_kl: 5.220780849456787 (5.220780849456787) | > loss_feat: 6.313457012176514 (6.313457012176514) | > loss_mel: 22.54302978515625 (22.54302978515625) | > loss_duration: 3.3709654808044434 (3.3709654808044434) | > loss_1: 39.83620071411133 (39.83620071411133)  --> STEP: 2 | > loss_disc: 3.258288621902466 (3.090376138687134) | > loss_disc_real_0: 0.23836258053779602 (0.3514966517686844) | > loss_disc_real_1: 0.3503859341144562 (0.3217790126800537) | > loss_disc_real_2: 0.24235157668590546 (0.25949689000844955) | > loss_disc_real_3: 0.44377443194389343 (0.39034493267536163) | > loss_disc_real_4: 0.36753642559051514 (0.3041944280266762) | > loss_disc_real_5: 0.24945150315761566 (0.2828449383378029) | > loss_0: 3.258288621902466 (3.090376138687134) | > loss_gen: 1.9974409341812134 (2.192706286907196) | > loss_kl: 5.488513946533203 (5.354647397994995) | > loss_feat: 6.044696807861328 (6.179076910018921) | > loss_mel: 22.071468353271484 (22.307249069213867) | > loss_duration: 3.1953439712524414 (3.2831547260284424) | > loss_1: 38.797462463378906 (39.31683158874512)  --> STEP: 3 | > loss_disc: 2.366340160369873 (2.8490308125813804) | > loss_disc_real_0: 0.41828370094299316 (0.373759001493454) | > loss_disc_real_1: 0.2976365387439728 (0.31373152136802673) | > loss_disc_real_2: 0.20022869110107422 (0.23974082370599112) | > loss_disc_real_3: 0.24393318593502045 (0.3415410170952479) | > loss_disc_real_4: 0.22618474066257477 (0.278191198905309) | > loss_disc_real_5: 0.2696860432624817 (0.2784586399793625) | > loss_0: 2.366340160369873 (2.8490308125813804) | > loss_gen: 3.3101110458374023 (2.5651745398839316) | > loss_kl: 2.433987617492676 (4.381094137827556) | > loss_feat: 7.1744866371154785 (6.51088015238444) | > loss_mel: 22.59889793395996 (22.404465357462566) | > loss_duration: 2.9205050468444824 (3.162271499633789) | > loss_1: 38.437992095947266 (39.023885091145836) --> EVAL PERFORMANCE | > avg_loader_time: 0.01840806007385254 (+0.013078292210896809) | > avg_loss_disc: 2.8490308125813804 (+0.3779744307200117) | > avg_loss_disc_real_0: 0.373759001493454 (+0.21149525046348572) | > avg_loss_disc_real_1: 0.31373152136802673 (+0.08553322652975717) | > avg_loss_disc_real_2: 0.23974082370599112 (+0.0012775970002015524) | > avg_loss_disc_real_3: 0.3415410170952479 (+0.14611283813913664) | > avg_loss_disc_real_4: 0.278191198905309 (+0.0822844828168551) | > avg_loss_disc_real_5: 0.2784586399793625 (+0.04149127006530762) | > avg_loss_0: 2.8490308125813804 (+0.3779744307200117) | > avg_loss_gen: 2.5651745398839316 (+0.42438435554504395) | > avg_loss_kl: 4.381094137827556 (-0.11578734715779593) | > avg_loss_feat: 6.51088015238444 (+0.8776927789052333) | > avg_loss_mel: 22.404465357462566 (+1.2862199147542341) | > avg_loss_duration: 3.162271499633789 (+0.009544928868611802) | > avg_loss_1: 39.023885091145836 (+2.4820550282796248)  > EPOCH: 845/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:05:14)   --> TIME: 2023-10-20 10:05:41 -- STEP: 29/50 -- GLOBAL_STEP: 95280 | > loss_disc: 3.0272648334503174 (2.4717010012988387) | > loss_disc_real_0: 0.24514417350292206 (0.16615161524507507) | > loss_disc_real_1: 0.24489933252334595 (0.22282808299722343) | > loss_disc_real_2: 0.2534342408180237 (0.22446503316790894) | > loss_disc_real_3: 0.23104147613048553 (0.2403595875306376) | > loss_disc_real_4: 0.24780164659023285 (0.21187460403247127) | > loss_disc_real_5: 0.24746541678905487 (0.26104945554558573) | > loss_0: 3.0272648334503174 (2.4717010012988387) | > grad_norm_0: tensor(402.2786, device='cuda:0') (tensor(704.4154, device='cuda:0')) | > loss_gen: 1.4579219818115234 (2.267389424915972) | > loss_kl: 0.9646329283714294 (0.7776946151821778) | > loss_feat: 0.0763215571641922 (5.012381467069018) | > loss_mel: 5.675314903259277 (20.088084303099535) | > loss_duration: 1.4418976306915283 (1.3940912361802726) | > loss_1: 9.6160888671875 (29.53964108434217) | > grad_norm_1: tensor(17263.1445, device='cuda:0') (tensor(22274.1211, device='cuda:0')) | > current_lr_0: 8.590693418422066e-05 | > current_lr_1: 8.590693418422066e-05 | > step_time: 0.723 (0.6921378250779777) | > loader_time: 0.0249 (0.024626641437925142)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5670175552368164 (2.5670175552368164) | > loss_disc_real_0: 0.1752786785364151 (0.1752786785364151) | > loss_disc_real_1: 0.21629230678081512 (0.21629230678081512) | > loss_disc_real_2: 0.24336501955986023 (0.24336501955986023) | > loss_disc_real_3: 0.32868871092796326 (0.32868871092796326) | > loss_disc_real_4: 0.2790275812149048 (0.2790275812149048) | > loss_disc_real_5: 0.2212049812078476 (0.2212049812078476) | > loss_0: 2.5670175552368164 (2.5670175552368164) | > loss_gen: 2.2145445346832275 (2.2145445346832275) | > loss_kl: 4.785795211791992 (4.785795211791992) | > loss_feat: 3.9598286151885986 (3.9598286151885986) | > loss_mel: 25.5251407623291 (25.5251407623291) | > loss_duration: 2.8622264862060547 (2.8622264862060547) | > loss_1: 39.3475341796875 (39.3475341796875)  --> STEP: 1 | > loss_disc: 2.4726004600524902 (2.4726004600524902) | > loss_disc_real_0: 0.20329707860946655 (0.20329707860946655) | > loss_disc_real_1: 0.183756485581398 (0.183756485581398) | > loss_disc_real_2: 0.26195672154426575 (0.26195672154426575) | > loss_disc_real_3: 0.34191861748695374 (0.34191861748695374) | > loss_disc_real_4: 0.3272644877433777 (0.3272644877433777) | > loss_disc_real_5: 0.19023244082927704 (0.19023244082927704) | > loss_0: 2.4726004600524902 (2.4726004600524902) | > loss_gen: 2.805879592895508 (2.805879592895508) | > loss_kl: 5.167505264282227 (5.167505264282227) | > loss_feat: 6.478554725646973 (6.478554725646973) | > loss_mel: 22.539138793945312 (22.539138793945312) | > loss_duration: 3.238344192504883 (3.238344192504883) | > loss_1: 40.22942352294922 (40.22942352294922)  --> STEP: 2 | > loss_disc: 2.962333917617798 (2.717467188835144) | > loss_disc_real_0: 0.23416419327259064 (0.2187306359410286) | > loss_disc_real_1: 0.30267906188964844 (0.24321777373552322) | > loss_disc_real_2: 0.3025904595851898 (0.2822735905647278) | > loss_disc_real_3: 0.3029386103153229 (0.3224286139011383) | > loss_disc_real_4: 0.2626585066318512 (0.29496149718761444) | > loss_disc_real_5: 0.2524893283843994 (0.22136088460683823) | > loss_0: 2.962333917617798 (2.717467188835144) | > loss_gen: 1.7139928340911865 (2.259936213493347) | > loss_kl: 5.757889270782471 (5.462697267532349) | > loss_feat: 0.14843860268592834 (3.3134966641664505) | > loss_mel: 3.1077237129211426 (12.823431253433228) | > loss_duration: 3.182321071624756 (3.2103326320648193) | > loss_1: 13.91036605834961 (27.069894790649414)  --> STEP: 3 | > loss_disc: 2.65358304977417 (2.6961724758148193) | > loss_disc_real_0: 0.14877669513225555 (0.1954126556714376) | > loss_disc_real_1: 0.37104398012161255 (0.285826509197553) | > loss_disc_real_2: 0.25965386629104614 (0.27473368247350055) | > loss_disc_real_3: 0.35269129276275635 (0.33251617352167767) | > loss_disc_real_4: 0.29006120562553406 (0.29332806666692096) | > loss_disc_real_5: 0.39493879675865173 (0.27922018865744275) | > loss_0: 2.65358304977417 (2.6961724758148193) | > loss_gen: 2.704105854034424 (2.4079927603403726) | > loss_kl: 2.1579275131225586 (4.361107349395752) | > loss_feat: 3.622931957244873 (3.416641761859258) | > loss_mel: 25.1451358795166 (16.930666128794353) | > loss_duration: 2.927807331085205 (3.1161575317382812) | > loss_1: 36.55790710449219 (30.23256556193034) --> EVAL PERFORMANCE | > avg_loader_time: 0.0072316328684488935 (-0.011176427205403645) | > avg_loss_disc: 2.6961724758148193 (-0.15285833676656102) | > avg_loss_disc_real_0: 0.1954126556714376 (-0.1783463458220164) | > avg_loss_disc_real_1: 0.285826509197553 (-0.027905012170473753) | > avg_loss_disc_real_2: 0.27473368247350055 (+0.03499285876750943) | > avg_loss_disc_real_3: 0.33251617352167767 (-0.009024843573570251) | > avg_loss_disc_real_4: 0.29332806666692096 (+0.015136867761611938) | > avg_loss_disc_real_5: 0.27922018865744275 (+0.0007615486780802594) | > avg_loss_0: 2.6961724758148193 (-0.15285833676656102) | > avg_loss_gen: 2.4079927603403726 (-0.15718177954355905) | > avg_loss_kl: 4.361107349395752 (-0.01998678843180368) | > avg_loss_feat: 3.416641761859258 (-3.0942383905251822) | > avg_loss_mel: 16.930666128794353 (-5.473799228668213) | > avg_loss_duration: 3.1161575317382812 (-0.04611396789550781) | > avg_loss_1: 30.23256556193034 (-8.791319529215496)  > EPOCH: 846/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:06:08)   --> TIME: 2023-10-20 10:06:20 -- STEP: 9/50 -- GLOBAL_STEP: 95310 | > loss_disc: 2.882833480834961 (2.5171300570170083) | > loss_disc_real_0: 0.1610492765903473 (0.15056667394108242) | > loss_disc_real_1: 0.30095717310905457 (0.2739923240409957) | > loss_disc_real_2: 0.2514815628528595 (0.25928524798817104) | > loss_disc_real_3: 0.3123745322227478 (0.23442451366119915) | > loss_disc_real_4: 0.26892802119255066 (0.23125945983661544) | > loss_disc_real_5: 0.2673604488372803 (0.23833193878332773) | > loss_0: 2.882833480834961 (2.5171300570170083) | > grad_norm_0: tensor(719.1471, device='cuda:0') (tensor(522.0071, device='cuda:0')) | > loss_gen: 1.7231130599975586 (2.2607562806871204) | > loss_kl: 0.8656793236732483 (0.7607429689831204) | > loss_feat: 0.4947471022605896 (4.4575026697582665) | > loss_mel: 19.149913787841797 (19.520848804050022) | > loss_duration: 1.3561794757843018 (1.386620495054457) | > loss_1: 23.589632034301758 (28.386471218532986) | > grad_norm_1: tensor(14355.2676, device='cuda:0') (tensor(21423.4805, device='cuda:0')) | > current_lr_0: 8.582106482492554e-05 | > current_lr_1: 8.582106482492554e-05 | > step_time: 0.4078 (0.5857875612046983) | > loader_time: 0.0023 (0.021290275785658095)  --> TIME: 2023-10-20 10:06:33 -- STEP: 39/50 -- GLOBAL_STEP: 95340 | > loss_disc: 2.9791951179504395 (2.5434217086205115) | > loss_disc_real_0: 0.10481739044189453 (0.14955293014645576) | > loss_disc_real_1: 0.27216821908950806 (0.243756569062288) | > loss_disc_real_2: 0.22605665028095245 (0.2452481418656997) | > loss_disc_real_3: 0.28378528356552124 (0.24785986666878065) | > loss_disc_real_4: 0.279173880815506 (0.25301360358030367) | > loss_disc_real_5: 0.2660972774028778 (0.24539185162538138) | > loss_0: 2.9791951179504395 (2.5434217086205115) | > grad_norm_0: tensor(800.9366, device='cuda:0') (tensor(574.5710, device='cuda:0')) | > loss_gen: 1.593301773071289 (2.2659963766733804) | > loss_kl: 0.4130620062351227 (0.7574076621960371) | > loss_feat: 0.6795675158500671 (5.27816630135744) | > loss_mel: 11.62117862701416 (20.98082304000855) | > loss_duration: 1.4048314094543457 (1.3752711766805403) | > loss_1: 15.71194076538086 (30.657664250104855) | > grad_norm_1: tensor(10552.7217, device='cuda:0') (tensor(19736.2852, device='cuda:0')) | > current_lr_0: 8.582106482492554e-05 | > current_lr_1: 8.582106482492554e-05 | > step_time: 0.666 (0.46717001230288785) | > loader_time: 0.0272 (0.014079063366620969)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.987462043762207 (2.987462043762207) | > loss_disc_real_0: 0.17870497703552246 (0.17870497703552246) | > loss_disc_real_1: 0.24807529151439667 (0.24807529151439667) | > loss_disc_real_2: 0.29536208510398865 (0.29536208510398865) | > loss_disc_real_3: 0.2580523192882538 (0.2580523192882538) | > loss_disc_real_4: 0.25443267822265625 (0.25443267822265625) | > loss_disc_real_5: 0.24439112842082977 (0.24439112842082977) | > loss_0: 2.987462043762207 (2.987462043762207) | > loss_gen: 1.504218339920044 (1.504218339920044) | > loss_kl: 5.220826625823975 (5.220826625823975) | > loss_feat: 0.06488137692213058 (0.06488137692213058) | > loss_mel: 6.177751541137695 (6.177751541137695) | > loss_duration: 3.06549072265625 (3.06549072265625) | > loss_1: 16.03316879272461 (16.03316879272461)  --> STEP: 1 | > loss_disc: 2.924044132232666 (2.924044132232666) | > loss_disc_real_0: 0.13595351576805115 (0.13595351576805115) | > loss_disc_real_1: 0.3084508180618286 (0.3084508180618286) | > loss_disc_real_2: 0.2755105495452881 (0.2755105495452881) | > loss_disc_real_3: 0.47952526807785034 (0.47952526807785034) | > loss_disc_real_4: 0.28881657123565674 (0.28881657123565674) | > loss_disc_real_5: 0.36320602893829346 (0.36320602893829346) | > loss_0: 2.924044132232666 (2.924044132232666) | > loss_gen: 2.232103109359741 (2.232103109359741) | > loss_kl: 5.150937557220459 (5.150937557220459) | > loss_feat: 5.456971645355225 (5.456971645355225) | > loss_mel: 25.244421005249023 (25.244421005249023) | > loss_duration: 3.2968013286590576 (3.2968013286590576) | > loss_1: 41.38123321533203 (41.38123321533203)  --> STEP: 2 | > loss_disc: 2.735952138900757 (2.8299981355667114) | > loss_disc_real_0: 0.16207483410835266 (0.1490141749382019) | > loss_disc_real_1: 0.21413321793079376 (0.2612920179963112) | > loss_disc_real_2: 0.3030302822589874 (0.28927041590213776) | > loss_disc_real_3: 0.26102694869041443 (0.3702761083841324) | > loss_disc_real_4: 0.2093108594417572 (0.24906371533870697) | > loss_disc_real_5: 0.21048833429813385 (0.28684718161821365) | > loss_0: 2.735952138900757 (2.8299981355667114) | > loss_gen: 1.7202603816986084 (1.9761817455291748) | > loss_kl: 5.386170387268066 (5.268553972244263) | > loss_feat: 2.077918291091919 (3.7674449682235718) | > loss_mel: 8.296980857849121 (16.770700931549072) | > loss_duration: 3.2080483436584473 (3.2524248361587524) | > loss_1: 20.689376831054688 (31.03530502319336)  --> STEP: 3 | > loss_disc: 1.304623007774353 (2.3215397596359253) | > loss_disc_real_0: 0.02353789284825325 (0.10718874757488568) | > loss_disc_real_1: 0.01531238667666912 (0.1792988075564305) | > loss_disc_real_2: 0.012913666665554047 (0.19715149948994318) | > loss_disc_real_3: 0.06892937421798706 (0.2698271969954173) | > loss_disc_real_4: 0.047306615859270096 (0.18181134884556135) | > loss_disc_real_5: 0.035909850150346756 (0.203201404462258) | > loss_0: 1.304623007774353 (2.3215397596359253) | > loss_gen: 2.1868462562561035 (2.046403249104818) | > loss_kl: 2.521240234375 (4.352782726287842) | > loss_feat: 11.268726348876953 (6.267872095108032) | > loss_mel: 28.892658233642578 (20.811353365580242) | > loss_duration: 2.900416612625122 (3.1350887616475425) | > loss_1: 47.76988983154297 (36.6134999593099) --> EVAL PERFORMANCE | > avg_loader_time: 0.005126078923543294 (-0.0021055539449055995) | > avg_loss_disc: 2.3215397596359253 (-0.37463271617889404) | > avg_loss_disc_real_0: 0.10718874757488568 (-0.08822390809655191) | > avg_loss_disc_real_1: 0.1792988075564305 (-0.10652770164112249) | > avg_loss_disc_real_2: 0.19715149948994318 (-0.07758218298355737) | > avg_loss_disc_real_3: 0.2698271969954173 (-0.06268897652626038) | > avg_loss_disc_real_4: 0.18181134884556135 (-0.1115167178213596) | > avg_loss_disc_real_5: 0.203201404462258 (-0.07601878419518474) | > avg_loss_0: 2.3215397596359253 (-0.37463271617889404) | > avg_loss_gen: 2.046403249104818 (-0.3615895112355547) | > avg_loss_kl: 4.352782726287842 (-0.008324623107910156) | > avg_loss_feat: 6.267872095108032 (+2.851230333248774) | > avg_loss_mel: 20.811353365580242 (+3.8806872367858887) | > avg_loss_duration: 3.1350887616475425 (+0.018931229909261216) | > avg_loss_1: 36.6134999593099 (+6.3809343973795585)  > EPOCH: 847/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:06:52)   --> TIME: 2023-10-20 10:07:11 -- STEP: 19/50 -- GLOBAL_STEP: 95370 | > loss_disc: 2.896085739135742 (2.368617139364544) | > loss_disc_real_0: 0.39294251799583435 (0.1590979357102984) | > loss_disc_real_1: 0.26816925406455994 (0.22026009857654572) | > loss_disc_real_2: 0.263406902551651 (0.22842385070888618) | > loss_disc_real_3: 0.24737036228179932 (0.21636237302108816) | > loss_disc_real_4: 0.33750393986701965 (0.22456840533567102) | > loss_disc_real_5: 0.30881252884864807 (0.2134476878533238) | > loss_0: 2.896085739135742 (2.368617139364544) | > grad_norm_0: tensor(1345.4592, device='cuda:0') (tensor(645.0029, device='cuda:0')) | > loss_gen: 2.2380330562591553 (2.4045241130025765) | > loss_kl: 0.5800605416297913 (0.9172332506430777) | > loss_feat: 1.8126705884933472 (5.821493818571693) | > loss_mel: 19.335216522216797 (20.456867029792384) | > loss_duration: 1.4346530437469482 (1.4212795872437327) | > loss_1: 25.400632858276367 (31.02139779141075) | > grad_norm_1: tensor(9714.8105, device='cuda:0') (tensor(19378.6094, device='cuda:0')) | > current_lr_0: 8.573528129743125e-05 | > current_lr_1: 8.573528129743125e-05 | > step_time: 0.3201 (0.683065226203517) | > loader_time: 0.0257 (0.029837445208900852)  --> TIME: 2023-10-20 10:07:28 -- STEP: 49/50 -- GLOBAL_STEP: 95400 | > loss_disc: 1.5443434715270996 (2.4205819684631966) | > loss_disc_real_0: 0.11956432461738586 (0.1467095197995706) | > loss_disc_real_1: 0.11876484751701355 (0.21693735166775938) | > loss_disc_real_2: 0.1491996794939041 (0.2325307798324799) | > loss_disc_real_3: 0.0869697779417038 (0.2200374865562332) | > loss_disc_real_4: 0.12805257737636566 (0.23490154830624863) | > loss_disc_real_5: 0.05258225277066231 (0.2214706392616642) | > loss_0: 1.5443434715270996 (2.4205819684631966) | > grad_norm_0: tensor(407.2965, device='cuda:0') (tensor(625.4803, device='cuda:0')) | > loss_gen: 2.8726699352264404 (2.2890968444396034) | > loss_kl: 0.7501789331436157 (0.8612693735227293) | > loss_feat: 7.724964141845703 (4.980657948333086) | > loss_mel: 22.302406311035156 (20.09820520391269) | > loss_duration: 1.5111873149871826 (1.3814244878535369) | > loss_1: 35.161407470703125 (29.61065356585444) | > grad_norm_1: tensor(13012.3643, device='cuda:0') (tensor(15030.0342, device='cuda:0')) | > current_lr_0: 8.573528129743125e-05 | > current_lr_1: 8.573528129743125e-05 | > step_time: 0.3507 (0.6040993758610318) | > loader_time: 0.4184 (0.030795155739297673)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9414114952087402 (2.9414114952087402) | > loss_disc_real_0: 0.428703248500824 (0.428703248500824) | > loss_disc_real_1: 0.2726605534553528 (0.2726605534553528) | > loss_disc_real_2: 0.32646024227142334 (0.32646024227142334) | > loss_disc_real_3: 0.23716861009597778 (0.23716861009597778) | > loss_disc_real_4: 0.24242892861366272 (0.24242892861366272) | > loss_disc_real_5: 0.33851006627082825 (0.33851006627082825) | > loss_0: 2.9414114952087402 (2.9414114952087402) | > loss_gen: 2.321646213531494 (2.321646213531494) | > loss_kl: 4.96898078918457 (4.96898078918457) | > loss_feat: 4.615165710449219 (4.615165710449219) | > loss_mel: 19.712488174438477 (19.712488174438477) | > loss_duration: 2.9778237342834473 (2.9778237342834473) | > loss_1: 34.59610366821289 (34.59610366821289)  --> STEP: 1 | > loss_disc: 2.8252835273742676 (2.8252835273742676) | > loss_disc_real_0: 0.26846978068351746 (0.26846978068351746) | > loss_disc_real_1: 0.3111450970172882 (0.3111450970172882) | > loss_disc_real_2: 0.21705837547779083 (0.21705837547779083) | > loss_disc_real_3: 0.2718772292137146 (0.2718772292137146) | > loss_disc_real_4: 0.26134324073791504 (0.26134324073791504) | > loss_disc_real_5: 0.29784607887268066 (0.29784607887268066) | > loss_0: 2.8252835273742676 (2.8252835273742676) | > loss_gen: 1.9914377927780151 (1.9914377927780151) | > loss_kl: 5.707841873168945 (5.707841873168945) | > loss_feat: 1.4382827281951904 (1.4382827281951904) | > loss_mel: 17.54033660888672 (17.54033660888672) | > loss_duration: 3.281250476837158 (3.281250476837158) | > loss_1: 29.959150314331055 (29.959150314331055)  --> STEP: 2 | > loss_disc: 2.861910581588745 (2.8435970544815063) | > loss_disc_real_0: 0.20689837634563446 (0.23768407851457596) | > loss_disc_real_1: 0.2092708796262741 (0.26020798832178116) | > loss_disc_real_2: 0.22560542821884155 (0.2213319018483162) | > loss_disc_real_3: 0.27599772810935974 (0.27393747866153717) | > loss_disc_real_4: 0.24794147908687592 (0.2546423599123955) | > loss_disc_real_5: 0.3569064736366272 (0.32737627625465393) | > loss_0: 2.861910581588745 (2.8435970544815063) | > loss_gen: 1.9419459104537964 (1.9666918516159058) | > loss_kl: 5.445369243621826 (5.576605558395386) | > loss_feat: 6.098102569580078 (3.7681926488876343) | > loss_mel: 22.53699493408203 (20.038665771484375) | > loss_duration: 3.1855719089508057 (3.233411192893982) | > loss_1: 39.207984924316406 (34.58356761932373)  --> STEP: 3 | > loss_disc: 3.092705011367798 (2.92663304011027) | > loss_disc_real_0: 0.4862213134765625 (0.3205298235019048) | > loss_disc_real_1: 0.3054296374320984 (0.2752818713585536) | > loss_disc_real_2: 0.28824031352996826 (0.24363470574220022) | > loss_disc_real_3: 0.27178603410720825 (0.27322033047676086) | > loss_disc_real_4: 0.27359944581985474 (0.2609613885482152) | > loss_disc_real_5: 0.2885649800300598 (0.31443917751312256) | > loss_0: 3.092705011367798 (2.92663304011027) | > loss_gen: 1.9553251266479492 (1.9629029432932537) | > loss_kl: 2.1343679428100586 (4.429193019866943) | > loss_feat: 0.27650758624076843 (2.604297628005346) | > loss_mel: 8.542868614196777 (16.206733385721844) | > loss_duration: 2.975407123565674 (3.1474098364512124) | > loss_1: 15.884475708007812 (28.350536982218426) --> EVAL PERFORMANCE | > avg_loader_time: 0.02233544985453288 (+0.017209370930989586) | > avg_loss_disc: 2.92663304011027 (+0.6050932804743447) | > avg_loss_disc_real_0: 0.3205298235019048 (+0.21334107592701912) | > avg_loss_disc_real_1: 0.2752818713585536 (+0.0959830638021231) | > avg_loss_disc_real_2: 0.24363470574220022 (+0.04648320625225705) | > avg_loss_disc_real_3: 0.27322033047676086 (+0.0033931334813435687) | > avg_loss_disc_real_4: 0.2609613885482152 (+0.07915003970265386) | > avg_loss_disc_real_5: 0.31443917751312256 (+0.11123777305086455) | > avg_loss_0: 2.92663304011027 (+0.6050932804743447) | > avg_loss_gen: 1.9629029432932537 (-0.0835003058115642) | > avg_loss_kl: 4.429193019866943 (+0.07641029357910156) | > avg_loss_feat: 2.604297628005346 (-3.6635744671026864) | > avg_loss_mel: 16.206733385721844 (-4.604619979858398) | > avg_loss_duration: 3.1474098364512124 (+0.012321074803669951) | > avg_loss_1: 28.350536982218426 (-8.262962977091473)  > EPOCH: 848/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:07:43)   --> TIME: 2023-10-20 10:08:08 -- STEP: 29/50 -- GLOBAL_STEP: 95430 | > loss_disc: 3.0737805366516113 (2.495052798040981) | > loss_disc_real_0: 0.26711732149124146 (0.15319329378162994) | > loss_disc_real_1: 0.2542913854122162 (0.22914833100191478) | > loss_disc_real_2: 0.23805151879787445 (0.22091223928948928) | > loss_disc_real_3: 0.29361236095428467 (0.2426321285551992) | > loss_disc_real_4: 0.2780185043811798 (0.24994180852483058) | > loss_disc_real_5: 0.34039899706840515 (0.23025717236230087) | > loss_0: 3.0737805366516113 (2.495052798040981) | > grad_norm_0: tensor(536.4255, device='cuda:0') (tensor(680.4551, device='cuda:0')) | > loss_gen: 1.7126716375350952 (2.2885860122483357) | > loss_kl: 0.7339985966682434 (0.8115881260099083) | > loss_feat: 0.1616140604019165 (5.487176404045574) | > loss_mel: 12.083626747131348 (21.138930328961077) | > loss_duration: 1.3983930349349976 (1.381198237682211) | > loss_1: 16.090303421020508 (31.107479194114948) | > grad_norm_1: tensor(11458.1719, device='cuda:0') (tensor(15622.3086, device='cuda:0')) | > current_lr_0: 8.564958351594354e-05 | > current_lr_1: 8.564958351594354e-05 | > step_time: 0.7059 (0.6370831851301522) | > loader_time: 0.0203 (0.020368962452329442)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1405701637268066 (3.1405701637268066) | > loss_disc_real_0: 0.35010987520217896 (0.35010987520217896) | > loss_disc_real_1: 0.22009852528572083 (0.22009852528572083) | > loss_disc_real_2: 0.24048744142055511 (0.24048744142055511) | > loss_disc_real_3: 0.27945053577423096 (0.27945053577423096) | > loss_disc_real_4: 0.5222101211547852 (0.5222101211547852) | > loss_disc_real_5: 0.4031437933444977 (0.4031437933444977) | > loss_0: 3.1405701637268066 (3.1405701637268066) | > loss_gen: 2.4796364307403564 (2.4796364307403564) | > loss_kl: 5.139908313751221 (5.139908313751221) | > loss_feat: 6.864206790924072 (6.864206790924072) | > loss_mel: 23.41250991821289 (23.41250991821289) | > loss_duration: 2.8908188343048096 (2.8908188343048096) | > loss_1: 40.78708267211914 (40.78708267211914)  --> STEP: 1 | > loss_disc: 2.382423162460327 (2.382423162460327) | > loss_disc_real_0: 0.11239179223775864 (0.11239179223775864) | > loss_disc_real_1: 0.253813773393631 (0.253813773393631) | > loss_disc_real_2: 0.226303830742836 (0.226303830742836) | > loss_disc_real_3: 0.29922953248023987 (0.29922953248023987) | > loss_disc_real_4: 0.21699272096157074 (0.21699272096157074) | > loss_disc_real_5: 0.24859847128391266 (0.24859847128391266) | > loss_0: 2.382423162460327 (2.382423162460327) | > loss_gen: 2.340893268585205 (2.340893268585205) | > loss_kl: 5.107757091522217 (5.107757091522217) | > loss_feat: 6.696191787719727 (6.696191787719727) | > loss_mel: 27.470069885253906 (27.470069885253906) | > loss_duration: 3.2706663608551025 (3.2706663608551025) | > loss_1: 44.88557815551758 (44.88557815551758)  --> STEP: 2 | > loss_disc: 2.950044631958008 (2.6662338972091675) | > loss_disc_real_0: 0.209080308675766 (0.1607360504567623) | > loss_disc_real_1: 0.2797832787036896 (0.2667985260486603) | > loss_disc_real_2: 0.23598051071166992 (0.23114217072725296) | > loss_disc_real_3: 0.2470548450946808 (0.2731421887874603) | > loss_disc_real_4: 0.2567324638366699 (0.23686259239912033) | > loss_disc_real_5: 0.23645545542240143 (0.24252696335315704) | > loss_0: 2.950044631958008 (2.6662338972091675) | > loss_gen: 1.5317997932434082 (1.9363465309143066) | > loss_kl: 5.879128932952881 (5.493443012237549) | > loss_feat: 0.29255613684654236 (3.4943739622831345) | > loss_mel: 9.448941230773926 (18.459505558013916) | > loss_duration: 3.108760118484497 (3.1897132396698) | > loss_1: 20.261186599731445 (32.57338237762451)  --> STEP: 3 | > loss_disc: 2.8622207641601562 (2.731562852859497) | > loss_disc_real_0: 0.22297577559947968 (0.18148262550433478) | > loss_disc_real_1: 0.2943778932094574 (0.27599164843559265) | > loss_disc_real_2: 0.23712405562400818 (0.2331361323595047) | > loss_disc_real_3: 0.25648927688598633 (0.2675912181536357) | > loss_disc_real_4: 0.26255208253860474 (0.24542575577894846) | > loss_disc_real_5: 0.2402157038450241 (0.24175654351711273) | > loss_0: 2.8622207641601562 (2.731562852859497) | > loss_gen: 1.7216719388961792 (1.864788333574931) | > loss_kl: 2.5349814891815186 (4.507289171218872) | > loss_feat: 0.6038867831230164 (2.5308782358964286) | > loss_mel: 15.553511619567871 (17.490840911865234) | > loss_duration: 2.9639506340026855 (3.1144590377807617) | > loss_1: 23.378002166748047 (29.50825564066569) --> EVAL PERFORMANCE | > avg_loader_time: 0.014500935872395834 (-0.007834513982137045) | > avg_loss_disc: 2.731562852859497 (-0.19507018725077296) | > avg_loss_disc_real_0: 0.18148262550433478 (-0.13904719799757) | > avg_loss_disc_real_1: 0.27599164843559265 (+0.0007097770770390643) | > avg_loss_disc_real_2: 0.2331361323595047 (-0.010498573382695525) | > avg_loss_disc_real_3: 0.2675912181536357 (-0.005629112323125185) | > avg_loss_disc_real_4: 0.24542575577894846 (-0.015535632769266755) | > avg_loss_disc_real_5: 0.24175654351711273 (-0.07268263399600983) | > avg_loss_0: 2.731562852859497 (-0.19507018725077296) | > avg_loss_gen: 1.864788333574931 (-0.09811460971832275) | > avg_loss_kl: 4.507289171218872 (+0.07809615135192871) | > avg_loss_feat: 2.5308782358964286 (-0.07341939210891724) | > avg_loss_mel: 17.490840911865234 (+1.2841075261433907) | > avg_loss_duration: 3.1144590377807617 (-0.0329507986704507) | > avg_loss_1: 29.50825564066569 (+1.1577186584472656)  > EPOCH: 849/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:08:31)   --> TIME: 2023-10-20 10:08:44 -- STEP: 9/50 -- GLOBAL_STEP: 95460 | > loss_disc: 3.0126073360443115 (2.1851444840431213) | > loss_disc_real_0: 0.10703407227993011 (0.1433452518346409) | > loss_disc_real_1: 0.3079618513584137 (0.22525426579846275) | > loss_disc_real_2: 0.1679547131061554 (0.20501395356323984) | > loss_disc_real_3: 0.29155296087265015 (0.20932548700107467) | > loss_disc_real_4: 0.2667289078235626 (0.18434057757258415) | > loss_disc_real_5: 0.22879132628440857 (0.16462513100769785) | > loss_0: 3.0126073360443115 (2.1851444840431213) | > grad_norm_0: tensor(1535.9960, device='cuda:0') (tensor(671.6662, device='cuda:0')) | > loss_gen: 1.5517746210098267 (2.529104643397861) | > loss_kl: 0.5593728423118591 (0.8458766341209412) | > loss_feat: 0.38600850105285645 (7.021768808364868) | > loss_mel: 5.131972312927246 (20.72942002614339) | > loss_duration: 1.3486855030059814 (1.3765219449996948) | > loss_1: 8.977813720703125 (32.502692540486656) | > grad_norm_1: tensor(60961.3945, device='cuda:0') (tensor(35308.1914, device='cuda:0')) | > current_lr_0: 8.55639713947539e-05 | > current_lr_1: 8.55639713947539e-05 | > step_time: 1.0313 (0.757732523812188) | > loader_time: 0.0237 (0.025359100765652128)  --> TIME: 2023-10-20 10:08:54 -- STEP: 39/50 -- GLOBAL_STEP: 95490 | > loss_disc: 1.6302011013031006 (2.429710545600989) | > loss_disc_real_0: 0.1159249022603035 (0.15581237226247024) | > loss_disc_real_1: 0.19663575291633606 (0.2267937543682563) | > loss_disc_real_2: 0.16982370615005493 (0.2089384274604993) | > loss_disc_real_3: 0.18305343389511108 (0.2340890689729116) | > loss_disc_real_4: 0.11080794036388397 (0.22834087144105863) | > loss_disc_real_5: 0.07019785791635513 (0.22057801418197462) | > loss_0: 1.6302011013031006 (2.429710545600989) | > grad_norm_0: tensor(832.8146, device='cuda:0') (tensor(589.0457, device='cuda:0')) | > loss_gen: 3.3431472778320312 (2.2911900923802304) | > loss_kl: 0.6190035939216614 (0.8046346644942578) | > loss_feat: 9.390727043151855 (5.023235092870891) | > loss_mel: 20.75581169128418 (19.21125205969199) | > loss_duration: 1.4314221143722534 (1.373611413515531) | > loss_1: 35.54011154174805 (28.703923396575146) | > grad_norm_1: tensor(48448.7305, device='cuda:0') (tensor(25900.2559, device='cuda:0')) | > current_lr_0: 8.55639713947539e-05 | > current_lr_1: 8.55639713947539e-05 | > step_time: 0.337 (0.43665480002378804) | > loader_time: 0.003 (0.010051415516779972)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.64237642288208 (2.64237642288208) | > loss_disc_real_0: 0.33734458684921265 (0.33734458684921265) | > loss_disc_real_1: 0.28032517433166504 (0.28032517433166504) | > loss_disc_real_2: 0.2982144057750702 (0.2982144057750702) | > loss_disc_real_3: 0.22551831603050232 (0.22551831603050232) | > loss_disc_real_4: 0.246450275182724 (0.246450275182724) | > loss_disc_real_5: 0.28425073623657227 (0.28425073623657227) | > loss_0: 2.64237642288208 (2.64237642288208) | > loss_gen: 2.577226161956787 (2.577226161956787) | > loss_kl: 5.365318775177002 (5.365318775177002) | > loss_feat: 5.623791694641113 (5.623791694641113) | > loss_mel: 21.242773056030273 (21.242773056030273) | > loss_duration: 2.924957752227783 (2.924957752227783) | > loss_1: 37.734066009521484 (37.734066009521484)  --> STEP: 1 | > loss_disc: 2.959012031555176 (2.959012031555176) | > loss_disc_real_0: 0.3730212450027466 (0.3730212450027466) | > loss_disc_real_1: 0.2594245970249176 (0.2594245970249176) | > loss_disc_real_2: 0.26262494921684265 (0.26262494921684265) | > loss_disc_real_3: 0.2642024755477905 (0.2642024755477905) | > loss_disc_real_4: 0.2675107419490814 (0.2675107419490814) | > loss_disc_real_5: 0.25680968165397644 (0.25680968165397644) | > loss_0: 2.959012031555176 (2.959012031555176) | > loss_gen: 1.8206676244735718 (1.8206676244735718) | > loss_kl: 4.376515865325928 (4.376515865325928) | > loss_feat: 0.2796086072921753 (0.2796086072921753) | > loss_mel: 12.167601585388184 (12.167601585388184) | > loss_duration: 3.2976577281951904 (3.2976577281951904) | > loss_1: 21.94205093383789 (21.94205093383789)  --> STEP: 2 | > loss_disc: 3.1000516414642334 (3.0295318365097046) | > loss_disc_real_0: 0.21038499474525452 (0.29170311987400055) | > loss_disc_real_1: 0.20989105105400085 (0.23465782403945923) | > loss_disc_real_2: 0.23576462268829346 (0.24919478595256805) | > loss_disc_real_3: 0.2174687385559082 (0.24083560705184937) | > loss_disc_real_4: 0.3065979480743408 (0.2870543450117111) | > loss_disc_real_5: 0.45589131116867065 (0.35635049641132355) | > loss_0: 3.1000516414642334 (3.0295318365097046) | > loss_gen: 2.2953011989593506 (2.057984411716461) | > loss_kl: 5.55455207824707 (4.965533971786499) | > loss_feat: 9.95984935760498 (5.119728982448578) | > loss_mel: 23.022029876708984 (17.594815731048584) | > loss_duration: 3.0659267902374268 (3.1817922592163086) | > loss_1: 43.89765548706055 (32.91985321044922)  --> STEP: 3 | > loss_disc: 3.553922653198242 (3.204328775405884) | > loss_disc_real_0: 0.47699686884880066 (0.3534677028656006) | > loss_disc_real_1: 0.4362892508506775 (0.30186829964319867) | > loss_disc_real_2: 0.3749658763408661 (0.2911184827486674) | > loss_disc_real_3: 0.3262313902378082 (0.26930086811383563) | > loss_disc_real_4: 0.4387435019016266 (0.3376173973083496) | > loss_disc_real_5: 0.31557801365852356 (0.3427596688270569) | > loss_0: 3.553922653198242 (3.204328775405884) | > loss_gen: 2.5003013610839844 (2.2054233948389688) | > loss_kl: 2.4191129207611084 (4.116726954778035) | > loss_feat: 5.391520977020264 (5.210326313972473) | > loss_mel: 23.846454620361328 (19.6786953608195) | > loss_duration: 2.9774136543273926 (3.11366605758667) | > loss_1: 37.134803771972656 (34.32483673095703) --> EVAL PERFORMANCE | > avg_loader_time: 0.007807095845540364 (-0.00669384002685547) | > avg_loss_disc: 3.204328775405884 (+0.4727659225463867) | > avg_loss_disc_real_0: 0.3534677028656006 (+0.1719850773612658) | > avg_loss_disc_real_1: 0.30186829964319867 (+0.025876651207606016) | > avg_loss_disc_real_2: 0.2911184827486674 (+0.05798235038916272) | > avg_loss_disc_real_3: 0.26930086811383563 (+0.0017096499601999549) | > avg_loss_disc_real_4: 0.3376173973083496 (+0.09219164152940115) | > avg_loss_disc_real_5: 0.3427596688270569 (+0.10100312530994415) | > avg_loss_0: 3.204328775405884 (+0.4727659225463867) | > avg_loss_gen: 2.2054233948389688 (+0.34063506126403786) | > avg_loss_kl: 4.116726954778035 (-0.3905622164408369) | > avg_loss_feat: 5.210326313972473 (+2.6794480780760446) | > avg_loss_mel: 19.6786953608195 (+2.1878544489542655) | > avg_loss_duration: 3.11366605758667 (-0.0007929801940917969) | > avg_loss_1: 34.32483673095703 (+4.81658109029134)  > EPOCH: 850/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:09:18)   --> TIME: 2023-10-20 10:09:38 -- STEP: 19/50 -- GLOBAL_STEP: 95520 | > loss_disc: 1.8918967247009277 (2.3442714277066683) | > loss_disc_real_0: 0.1581493467092514 (0.13568306792723508) | > loss_disc_real_1: 0.1550006866455078 (0.21060435405295147) | > loss_disc_real_2: 0.15177495777606964 (0.22856595014270983) | > loss_disc_real_3: 0.14932264387607574 (0.2409003143639941) | > loss_disc_real_4: 0.20839452743530273 (0.24356382487243727) | > loss_disc_real_5: 0.17275653779506683 (0.23545401087520937) | > loss_0: 1.8918967247009277 (2.3442714277066683) | > grad_norm_0: tensor(324.0408, device='cuda:0') (tensor(537.4819, device='cuda:0')) | > loss_gen: 2.756023645401001 (2.5570168244211295) | > loss_kl: 0.7103553414344788 (0.8167334293064318) | > loss_feat: 6.946066856384277 (6.547770971138227) | > loss_mel: 22.49847984313965 (22.372877434680337) | > loss_duration: 1.4319753646850586 (1.4128953845877397) | > loss_1: 34.34290313720703 (33.70729436372456) | > grad_norm_1: tensor(5074.3286, device='cuda:0') (tensor(19036.7031, device='cuda:0')) | > current_lr_0: 8.547844484823949e-05 | > current_lr_1: 8.547844484823949e-05 | > step_time: 0.5764 (0.6343182388104891) | > loader_time: 0.0048 (0.02395293587132504)  --> TIME: 2023-10-20 10:09:54 -- STEP: 49/50 -- GLOBAL_STEP: 95550 | > loss_disc: 2.107728958129883 (2.525908426362641) | > loss_disc_real_0: 0.10381860285997391 (0.13831686597241433) | > loss_disc_real_1: 0.19901515543460846 (0.21880370496335078) | > loss_disc_real_2: 0.1292518526315689 (0.2331720973764147) | > loss_disc_real_3: 0.21104976534843445 (0.23378166898476835) | > loss_disc_real_4: 0.15480093657970428 (0.26084349080159946) | > loss_disc_real_5: 0.23219305276870728 (0.29651522554685267) | > loss_0: 2.107728958129883 (2.525908426362641) | > grad_norm_0: tensor(340.1906, device='cuda:0') (tensor(553.9582, device='cuda:0')) | > loss_gen: 2.258974313735962 (2.3600470338548933) | > loss_kl: 0.9238607287406921 (0.8007676510178313) | > loss_feat: 3.9218833446502686 (5.861047808004885) | > loss_mel: 20.119352340698242 (21.078482501360835) | > loss_duration: 1.4709395170211792 (1.3762387207576208) | > loss_1: 28.695009231567383 (31.476583899283888) | > grad_norm_1: tensor(14386.4043, device='cuda:0') (tensor(15698.4336, device='cuda:0')) | > current_lr_0: 8.547844484823949e-05 | > current_lr_1: 8.547844484823949e-05 | > step_time: 0.6076 (0.5656093577949368) | > loader_time: 0.4015 (0.02528229538275271)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6077311038970947 (2.6077311038970947) | > loss_disc_real_0: 0.10830232501029968 (0.10830232501029968) | > loss_disc_real_1: 0.23746618628501892 (0.23746618628501892) | > loss_disc_real_2: 0.33416110277175903 (0.33416110277175903) | > loss_disc_real_3: 0.43882665038108826 (0.43882665038108826) | > loss_disc_real_4: 0.27916666865348816 (0.27916666865348816) | > loss_disc_real_5: 0.25337710976600647 (0.25337710976600647) | > loss_0: 2.6077311038970947 (2.6077311038970947) | > loss_gen: 2.4606237411499023 (2.4606237411499023) | > loss_kl: 5.1200408935546875 (5.1200408935546875) | > loss_feat: 6.153387546539307 (6.153387546539307) | > loss_mel: 21.762174606323242 (21.762174606323242) | > loss_duration: 2.951854705810547 (2.951854705810547) | > loss_1: 38.448081970214844 (38.448081970214844)  --> STEP: 1 | > loss_disc: 1.901498794555664 (1.901498794555664) | > loss_disc_real_0: 0.21606585383415222 (0.21606585383415222) | > loss_disc_real_1: 0.13208873569965363 (0.13208873569965363) | > loss_disc_real_2: 0.22408296167850494 (0.22408296167850494) | > loss_disc_real_3: 0.0953020378947258 (0.0953020378947258) | > loss_disc_real_4: 0.15836447477340698 (0.15836447477340698) | > loss_disc_real_5: 0.1263529658317566 (0.1263529658317566) | > loss_0: 1.901498794555664 (1.901498794555664) | > loss_gen: 2.5666251182556152 (2.5666251182556152) | > loss_kl: 5.0009355545043945 (5.0009355545043945) | > loss_feat: 8.192228317260742 (8.192228317260742) | > loss_mel: 22.7437801361084 (22.7437801361084) | > loss_duration: 3.3638594150543213 (3.3638594150543213) | > loss_1: 41.867427825927734 (41.867427825927734)  --> STEP: 2 | > loss_disc: 1.7529183626174927 (1.8272085785865784) | > loss_disc_real_0: 0.05926022306084633 (0.13766303844749928) | > loss_disc_real_1: 0.084986612200737 (0.10853767395019531) | > loss_disc_real_2: 0.08078376203775406 (0.1524333618581295) | > loss_disc_real_3: 0.3113933205604553 (0.20334767922759056) | > loss_disc_real_4: 0.042307864874601364 (0.10033616982400417) | > loss_disc_real_5: 0.02176032029092312 (0.07405664306133986) | > loss_0: 1.7529183626174927 (1.8272085785865784) | > loss_gen: 2.2712011337280273 (2.4189131259918213) | > loss_kl: 5.401027679443359 (5.200981616973877) | > loss_feat: 13.829423904418945 (11.010826110839844) | > loss_mel: 24.498321533203125 (23.62105083465576) | > loss_duration: 3.005354881286621 (3.184607148170471) | > loss_1: 49.005332946777344 (45.43638038635254)  --> STEP: 3 | > loss_disc: 3.153388738632202 (2.2692686319351196) | > loss_disc_real_0: 0.38671520352363586 (0.22068042680621147) | > loss_disc_real_1: 0.2361418604850769 (0.15107240279515585) | > loss_disc_real_2: 0.25447720289230347 (0.1864479755361875) | > loss_disc_real_3: 0.2731664180755615 (0.22662059217691422) | > loss_disc_real_4: 0.30490681529045105 (0.16852638497948647) | > loss_disc_real_5: 0.3756817877292633 (0.17459835795064768) | > loss_0: 3.153388738632202 (2.2692686319351196) | > loss_gen: 1.8358865976333618 (2.224570949872335) | > loss_kl: 2.2720024585723877 (4.224655230840047) | > loss_feat: 2.3061647415161133 (8.109272321065268) | > loss_mel: 18.68044090270996 (21.974180857340496) | > loss_duration: 3.012422800064087 (3.1272123654683432) | > loss_1: 28.106916427612305 (39.6598924001058) --> EVAL PERFORMANCE | > avg_loader_time: 0.012172857920328775 (+0.004365762074788411) | > avg_loss_disc: 2.2692686319351196 (-0.9350601434707642) | > avg_loss_disc_real_0: 0.22068042680621147 (-0.13278727605938911) | > avg_loss_disc_real_1: 0.15107240279515585 (-0.15079589684804282) | > avg_loss_disc_real_2: 0.1864479755361875 (-0.10467050721247992) | > avg_loss_disc_real_3: 0.22662059217691422 (-0.04268027593692142) | > avg_loss_disc_real_4: 0.16852638497948647 (-0.16909101232886314) | > avg_loss_disc_real_5: 0.17459835795064768 (-0.1681613108764092) | > avg_loss_0: 2.2692686319351196 (-0.9350601434707642) | > avg_loss_gen: 2.224570949872335 (+0.01914755503336618) | > avg_loss_kl: 4.224655230840047 (+0.10792827606201172) | > avg_loss_feat: 8.109272321065268 (+2.8989460070927944) | > avg_loss_mel: 21.974180857340496 (+2.295485496520996) | > avg_loss_duration: 3.1272123654683432 (+0.013546307881673325) | > avg_loss_1: 39.6598924001058 (+5.335055669148765)  > EPOCH: 851/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:10:09)   --> TIME: 2023-10-20 10:10:27 -- STEP: 29/50 -- GLOBAL_STEP: 95580 | > loss_disc: 2.9620351791381836 (2.2813618717522455) | > loss_disc_real_0: 0.37873488664627075 (0.15283096514256866) | > loss_disc_real_1: 0.2708837687969208 (0.21913017191249748) | > loss_disc_real_2: 0.2793436348438263 (0.22537592695704822) | > loss_disc_real_3: 0.2640519440174103 (0.22031223799647956) | > loss_disc_real_4: 0.3038327395915985 (0.2100632270348483) | > loss_disc_real_5: 0.2385414093732834 (0.2020979104563594) | > loss_0: 2.9620351791381836 (2.2813618717522455) | > grad_norm_0: tensor(998.5104, device='cuda:0') (tensor(565.2532, device='cuda:0')) | > loss_gen: 1.7941815853118896 (2.5365709066390987) | > loss_kl: 0.6374938488006592 (0.8893150276151197) | > loss_feat: 0.36464405059814453 (6.615826342383335) | > loss_mel: 13.902986526489258 (21.336255842241748) | > loss_duration: 1.3670862913131714 (1.3823774888597686) | > loss_1: 18.06639289855957 (32.76034568918162) | > grad_norm_1: tensor(20079.4102, device='cuda:0') (tensor(28240.5273, device='cuda:0')) | > current_lr_0: 8.53930037908631e-05 | > current_lr_1: 8.53930037908631e-05 | > step_time: 0.2513 (0.4209246799863618) | > loader_time: 0.0019 (0.01232924954644565)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7232847213745117 (2.7232847213745117) | > loss_disc_real_0: 0.09075146913528442 (0.09075146913528442) | > loss_disc_real_1: 0.2245641052722931 (0.2245641052722931) | > loss_disc_real_2: 0.21461541950702667 (0.21461541950702667) | > loss_disc_real_3: 0.23106034100055695 (0.23106034100055695) | > loss_disc_real_4: 0.20727045834064484 (0.20727045834064484) | > loss_disc_real_5: 0.22141362726688385 (0.22141362726688385) | > loss_0: 2.7232847213745117 (2.7232847213745117) | > loss_gen: 1.4859488010406494 (1.4859488010406494) | > loss_kl: 4.963485240936279 (4.963485240936279) | > loss_feat: 1.106181025505066 (1.106181025505066) | > loss_mel: 17.012693405151367 (17.012693405151367) | > loss_duration: 2.97304630279541 (2.97304630279541) | > loss_1: 27.54135513305664 (27.54135513305664)  --> STEP: 1 | > loss_disc: 2.762782096862793 (2.762782096862793) | > loss_disc_real_0: 0.2394619882106781 (0.2394619882106781) | > loss_disc_real_1: 0.3841502070426941 (0.3841502070426941) | > loss_disc_real_2: 0.44829365611076355 (0.44829365611076355) | > loss_disc_real_3: 0.4388699233531952 (0.4388699233531952) | > loss_disc_real_4: 0.18811354041099548 (0.18811354041099548) | > loss_disc_real_5: 0.34465715289115906 (0.34465715289115906) | > loss_0: 2.762782096862793 (2.762782096862793) | > loss_gen: 2.889331102371216 (2.889331102371216) | > loss_kl: 5.023626327514648 (5.023626327514648) | > loss_feat: 6.424175262451172 (6.424175262451172) | > loss_mel: 22.374618530273438 (22.374618530273438) | > loss_duration: 3.1946115493774414 (3.1946115493774414) | > loss_1: 39.9063606262207 (39.9063606262207)  --> STEP: 2 | > loss_disc: 2.1359434127807617 (2.4493627548217773) | > loss_disc_real_0: 0.05025816708803177 (0.14486007764935493) | > loss_disc_real_1: 0.16455867886543274 (0.2743544429540634) | > loss_disc_real_2: 0.23204807937145233 (0.34017086774110794) | > loss_disc_real_3: 0.17906901240348816 (0.3089694678783417) | > loss_disc_real_4: 0.20050856471061707 (0.19431105256080627) | > loss_disc_real_5: 0.25625622272491455 (0.3004566878080368) | > loss_0: 2.1359434127807617 (2.4493627548217773) | > loss_gen: 2.3159127235412598 (2.602621912956238) | > loss_kl: 5.916474342346191 (5.47005033493042) | > loss_feat: 9.464930534362793 (7.944552898406982) | > loss_mel: 24.292871475219727 (23.333745002746582) | > loss_duration: 3.0969433784484863 (3.145777463912964) | > loss_1: 45.087135314941406 (42.496747970581055)  --> STEP: 3 | > loss_disc: 2.20721435546875 (2.3686466217041016) | > loss_disc_real_0: 0.1040496751666069 (0.1312566101551056) | > loss_disc_real_1: 0.2102348506450653 (0.2529812455177307) | > loss_disc_real_2: 0.29175427556037903 (0.324032003680865) | > loss_disc_real_3: 0.22256487607955933 (0.28016793727874756) | > loss_disc_real_4: 0.10837437212467194 (0.16566549241542816) | > loss_disc_real_5: 0.056472472846508026 (0.21912861615419388) | > loss_0: 2.20721435546875 (2.3686466217041016) | > loss_gen: 2.0260627269744873 (2.410435517628988) | > loss_kl: 2.4196457862854004 (4.453248818715413) | > loss_feat: 5.325927257537842 (7.0716776847839355) | > loss_mel: 22.827167510986328 (23.164885838826496) | > loss_duration: 2.8710391521453857 (3.0541980266571045) | > loss_1: 35.469844818115234 (40.15444691975912) --> EVAL PERFORMANCE | > avg_loader_time: 0.014526128768920898 (+0.002353270848592123) | > avg_loss_disc: 2.3686466217041016 (+0.09937798976898193) | > avg_loss_disc_real_0: 0.1312566101551056 (-0.08942381665110588) | > avg_loss_disc_real_1: 0.2529812455177307 (+0.10190884272257486) | > avg_loss_disc_real_2: 0.324032003680865 (+0.1375840281446775) | > avg_loss_disc_real_3: 0.28016793727874756 (+0.053547345101833344) | > avg_loss_disc_real_4: 0.16566549241542816 (-0.002860892564058304) | > avg_loss_disc_real_5: 0.21912861615419388 (+0.0445302582035462) | > avg_loss_0: 2.3686466217041016 (+0.09937798976898193) | > avg_loss_gen: 2.410435517628988 (+0.18586456775665283) | > avg_loss_kl: 4.453248818715413 (+0.2285935878753662) | > avg_loss_feat: 7.0716776847839355 (-1.037594636281332) | > avg_loss_mel: 23.164885838826496 (+1.1907049814860002) | > avg_loss_duration: 3.0541980266571045 (-0.07301433881123875) | > avg_loss_1: 40.15444691975912 (+0.4945545196533203)  > EPOCH: 852/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:10:53)   --> TIME: 2023-10-20 10:11:03 -- STEP: 9/50 -- GLOBAL_STEP: 95610 | > loss_disc: 2.5327703952789307 (2.4207632541656494) | > loss_disc_real_0: 0.020282499492168427 (0.1223816613977154) | > loss_disc_real_1: 0.233422189950943 (0.2302102032634947) | > loss_disc_real_2: 0.15030939877033234 (0.26268000735176933) | > loss_disc_real_3: 0.22271358966827393 (0.24602067387766308) | > loss_disc_real_4: 0.18486575782299042 (0.21722017601132393) | > loss_disc_real_5: 0.17350418865680695 (0.26698767724964356) | > loss_0: 2.5327703952789307 (2.4207632541656494) | > grad_norm_0: tensor(876.5193, device='cuda:0') (tensor(517.1694, device='cuda:0')) | > loss_gen: 1.5582313537597656 (2.410720454321967) | > loss_kl: 1.0455031394958496 (0.8317720095316569) | > loss_feat: 1.735515832901001 (6.342615789837307) | > loss_mel: 12.437252044677734 (20.96235677931044) | > loss_duration: 1.3205087184906006 (1.3771959940592449) | > loss_1: 18.09701156616211 (31.92466100056966) | > grad_norm_1: tensor(7998.8096, device='cuda:0') (tensor(19347.2266, device='cuda:0')) | > current_lr_0: 8.530764813717296e-05 | > current_lr_1: 8.530764813717296e-05 | > step_time: 0.5986 (0.601688437991672) | > loader_time: 0.0321 (0.02575805452134874)  --> TIME: 2023-10-20 10:11:23 -- STEP: 39/50 -- GLOBAL_STEP: 95640 | > loss_disc: 1.3214049339294434 (2.3249945151500215) | > loss_disc_real_0: 0.0673622339963913 (0.12599099721186435) | > loss_disc_real_1: 0.070991650223732 (0.21672310087925348) | > loss_disc_real_2: 0.050230491906404495 (0.22544267343787047) | > loss_disc_real_3: 0.12577170133590698 (0.23792969316053084) | > loss_disc_real_4: 0.011640925891697407 (0.2043469301544321) | > loss_disc_real_5: 0.010622933506965637 (0.2016924361531169) | > loss_0: 1.3214049339294434 (2.3249945151500215) | > grad_norm_0: tensor(445.1299, device='cuda:0') (tensor(499.8741, device='cuda:0')) | > loss_gen: 2.788221597671509 (2.4222408624795766) | > loss_kl: 0.2752935588359833 (0.8286025997919914) | > loss_feat: 11.748237609863281 (6.519947745670111) | > loss_mel: 24.773168563842773 (20.0510147412618) | > loss_duration: 1.414416790008545 (1.3747747830855541) | > loss_1: 40.99934005737305 (31.196580617855762) | > grad_norm_1: tensor(28618.1621, device='cuda:0') (tensor(22523.8281, device='cuda:0')) | > current_lr_0: 8.530764813717296e-05 | > current_lr_1: 8.530764813717296e-05 | > step_time: 0.6939 (0.6147826390388687) | > loader_time: 0.0333 (0.023781574689424954)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.934396982192993 (2.934396982192993) | > loss_disc_real_0: 0.15347373485565186 (0.15347373485565186) | > loss_disc_real_1: 0.24091683328151703 (0.24091683328151703) | > loss_disc_real_2: 0.23279324173927307 (0.23279324173927307) | > loss_disc_real_3: 0.24657118320465088 (0.24657118320465088) | > loss_disc_real_4: 0.26068395376205444 (0.26068395376205444) | > loss_disc_real_5: 0.2590382397174835 (0.2590382397174835) | > loss_0: 2.934396982192993 (2.934396982192993) | > loss_gen: 1.4628337621688843 (1.4628337621688843) | > loss_kl: 4.294212818145752 (4.294212818145752) | > loss_feat: 0.19003692269325256 (0.19003692269325256) | > loss_mel: 12.219823837280273 (12.219823837280273) | > loss_duration: 2.8503100872039795 (2.8503100872039795) | > loss_1: 21.017215728759766 (21.017215728759766)  --> STEP: 1 | > loss_disc: 2.701550245285034 (2.701550245285034) | > loss_disc_real_0: 0.1670185625553131 (0.1670185625553131) | > loss_disc_real_1: 0.2833731174468994 (0.2833731174468994) | > loss_disc_real_2: 0.21219125390052795 (0.21219125390052795) | > loss_disc_real_3: 0.19594021141529083 (0.19594021141529083) | > loss_disc_real_4: 0.2254669964313507 (0.2254669964313507) | > loss_disc_real_5: 0.24422889947891235 (0.24422889947891235) | > loss_0: 2.701550245285034 (2.701550245285034) | > loss_gen: 1.9396311044692993 (1.9396311044692993) | > loss_kl: 5.495368003845215 (5.495368003845215) | > loss_feat: 3.8907840251922607 (3.8907840251922607) | > loss_mel: 23.121116638183594 (23.121116638183594) | > loss_duration: 3.241166353225708 (3.241166353225708) | > loss_1: 37.68806838989258 (37.68806838989258)  --> STEP: 2 | > loss_disc: 1.4432406425476074 (2.072395443916321) | > loss_disc_real_0: 0.01702439785003662 (0.09202148020267487) | > loss_disc_real_1: 0.09728308767080307 (0.19032810255885124) | > loss_disc_real_2: 0.05516551434993744 (0.1336783841252327) | > loss_disc_real_3: 0.047316018491983414 (0.12162811495363712) | > loss_disc_real_4: 0.021712716668844223 (0.12358985655009747) | > loss_disc_real_5: 0.02027500607073307 (0.1322519527748227) | > loss_0: 1.4432406425476074 (2.072395443916321) | > loss_gen: 2.222550868988037 (2.081090986728668) | > loss_kl: 6.084280967712402 (5.789824485778809) | > loss_feat: 15.52137565612793 (9.706079840660095) | > loss_mel: 27.132343292236328 (25.12672996520996) | > loss_duration: 3.139784574508667 (3.1904754638671875) | > loss_1: 54.10033416748047 (45.89420127868652)  --> STEP: 3 | > loss_disc: 2.022862672805786 (2.055884520212809) | > loss_disc_real_0: 0.35675275325775146 (0.1802652378877004) | > loss_disc_real_1: 0.23305481672286987 (0.2045703406135241) | > loss_disc_real_2: 0.2290399670600891 (0.1654655784368515) | > loss_disc_real_3: 0.22221143543720245 (0.1551558884481589) | > loss_disc_real_4: 0.1357468217611313 (0.12764217828710875) | > loss_disc_real_5: 0.0790039449930191 (0.11450261684755485) | > loss_0: 2.022862672805786 (2.055884520212809) | > loss_gen: 2.809940814971924 (2.32404092947642) | > loss_kl: 2.5867369174957275 (4.722128629684448) | > loss_feat: 6.049659252166748 (8.48727297782898) | > loss_mel: 23.07520294189453 (24.442887624104817) | > loss_duration: 2.916496992111206 (3.099149306615194) | > loss_1: 37.43803787231445 (43.075480143229164) --> EVAL PERFORMANCE | > avg_loader_time: 0.012319644292195639 (-0.00220648447672526) | > avg_loss_disc: 2.055884520212809 (-0.31276210149129247) | > avg_loss_disc_real_0: 0.1802652378877004 (+0.04900862773259482) | > avg_loss_disc_real_1: 0.2045703406135241 (-0.0484109049042066) | > avg_loss_disc_real_2: 0.1654655784368515 (-0.1585664252440135) | > avg_loss_disc_real_3: 0.1551558884481589 (-0.12501204883058867) | > avg_loss_disc_real_4: 0.12764217828710875 (-0.03802331412831941) | > avg_loss_disc_real_5: 0.11450261684755485 (-0.10462599930663903) | > avg_loss_0: 2.055884520212809 (-0.31276210149129247) | > avg_loss_gen: 2.32404092947642 (-0.08639458815256784) | > avg_loss_kl: 4.722128629684448 (+0.2688798109690351) | > avg_loss_feat: 8.48727297782898 (+1.415595293045044) | > avg_loss_mel: 24.442887624104817 (+1.2780017852783203) | > avg_loss_duration: 3.099149306615194 (+0.04495127995808934) | > avg_loss_1: 43.075480143229164 (+2.9210332234700473)  > EPOCH: 853/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:11:45)   --> TIME: 2023-10-20 10:12:01 -- STEP: 19/50 -- GLOBAL_STEP: 95670 | > loss_disc: 1.6914602518081665 (2.3299307948664616) | > loss_disc_real_0: 0.022458577528595924 (0.12204179304995035) | > loss_disc_real_1: 0.165835440158844 (0.21727105004614905) | > loss_disc_real_2: 0.21860451996326447 (0.2305667978760443) | > loss_disc_real_3: 0.21547862887382507 (0.22555135288520864) | > loss_disc_real_4: 0.15724366903305054 (0.22337680192370163) | > loss_disc_real_5: 0.13436003029346466 (0.22397650386157789) | > loss_0: 1.6914602518081665 (2.3299307948664616) | > grad_norm_0: tensor(201.4903, device='cuda:0') (tensor(620.0754, device='cuda:0')) | > loss_gen: 2.8467440605163574 (2.378237429418062) | > loss_kl: 0.7419762015342712 (0.706249392346332) | > loss_feat: 6.176393985748291 (5.7195780128240585) | > loss_mel: 22.499391555786133 (20.51794857727854) | > loss_duration: 1.469442367553711 (1.3900992682105617) | > loss_1: 33.73394775390625 (30.71211270282143) | > grad_norm_1: tensor(5107.4517, device='cuda:0') (tensor(20884.7598, device='cuda:0')) | > current_lr_0: 8.522237780180276e-05 | > current_lr_1: 8.522237780180276e-05 | > step_time: 0.3269 (0.5748028629704526) | > loader_time: 0.0088 (0.01903861447384483)  --> TIME: 2023-10-20 10:12:22 -- STEP: 49/50 -- GLOBAL_STEP: 95700 | > loss_disc: 2.040496349334717 (2.4030869518007547) | > loss_disc_real_0: 0.18852579593658447 (0.14088784298878546) | > loss_disc_real_1: 0.3903520107269287 (0.23034782076672633) | > loss_disc_real_2: 0.19275134801864624 (0.2174346729048661) | > loss_disc_real_3: 0.5437896847724915 (0.23574874778183139) | > loss_disc_real_4: 0.10082223266363144 (0.21922858663815625) | > loss_disc_real_5: 0.10517234355211258 (0.22404791762558174) | > loss_0: 2.040496349334717 (2.4030869518007547) | > grad_norm_0: tensor(647.1593, device='cuda:0') (tensor(655.2458, device='cuda:0')) | > loss_gen: 3.7142505645751953 (2.2934434000326664) | > loss_kl: 0.8156018853187561 (0.781989321416738) | > loss_feat: 9.188154220581055 (5.0957672749551) | > loss_mel: 24.33154296875 (19.477322388668444) | > loss_duration: 1.5558319091796875 (1.3695839156909866) | > loss_1: 39.605384826660156 (29.018106587079107) | > grad_norm_1: tensor(39611.2695, device='cuda:0') (tensor(18347.8516, device='cuda:0')) | > current_lr_0: 8.522237780180276e-05 | > current_lr_1: 8.522237780180276e-05 | > step_time: 0.5565 (0.6302199217737935) | > loader_time: 0.5301 (0.03251905830539003)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0460686683654785 (3.0460686683654785) | > loss_disc_real_0: 0.1835634410381317 (0.1835634410381317) | > loss_disc_real_1: 0.2370533049106598 (0.2370533049106598) | > loss_disc_real_2: 0.2231759876012802 (0.2231759876012802) | > loss_disc_real_3: 0.25583142042160034 (0.25583142042160034) | > loss_disc_real_4: 0.24964237213134766 (0.24964237213134766) | > loss_disc_real_5: 0.2701161503791809 (0.2701161503791809) | > loss_0: 3.0460686683654785 (3.0460686683654785) | > loss_gen: 1.3933513164520264 (1.3933513164520264) | > loss_kl: 4.303623199462891 (4.303623199462891) | > loss_feat: 0.06658775359392166 (0.06658775359392166) | > loss_mel: 3.059608221054077 (3.059608221054077) | > loss_duration: 2.8662660121917725 (2.8662660121917725) | > loss_1: 11.689436912536621 (11.689436912536621)  --> STEP: 1 | > loss_disc: 2.1618449687957764 (2.1618449687957764) | > loss_disc_real_0: 0.04085875675082207 (0.04085875675082207) | > loss_disc_real_1: 0.30372342467308044 (0.30372342467308044) | > loss_disc_real_2: 0.2208036184310913 (0.2208036184310913) | > loss_disc_real_3: 0.2853325307369232 (0.2853325307369232) | > loss_disc_real_4: 0.1869579255580902 (0.1869579255580902) | > loss_disc_real_5: 0.16980192065238953 (0.16980192065238953) | > loss_0: 2.1618449687957764 (2.1618449687957764) | > loss_gen: 2.4858450889587402 (2.4858450889587402) | > loss_kl: 5.420976161956787 (5.420976161956787) | > loss_feat: 5.863502025604248 (5.863502025604248) | > loss_mel: 25.377395629882812 (25.377395629882812) | > loss_duration: 3.157789707183838 (3.157789707183838) | > loss_1: 42.30550765991211 (42.30550765991211)  --> STEP: 2 | > loss_disc: 2.6278553009033203 (2.3948501348495483) | > loss_disc_real_0: 0.13190314173698425 (0.08638094924390316) | > loss_disc_real_1: 0.21214981377124786 (0.25793661922216415) | > loss_disc_real_2: 0.23892922699451447 (0.2298664227128029) | > loss_disc_real_3: 0.2436370998620987 (0.26448481529951096) | > loss_disc_real_4: 0.3370140790939331 (0.26198600232601166) | > loss_disc_real_5: 0.27372032403945923 (0.22176112234592438) | > loss_0: 2.6278553009033203 (2.3948501348495483) | > loss_gen: 2.2593746185302734 (2.372609853744507) | > loss_kl: 5.665530204772949 (5.543253183364868) | > loss_feat: 7.089210510253906 (6.476356267929077) | > loss_mel: 24.086488723754883 (24.731942176818848) | > loss_duration: 3.074430465698242 (3.11611008644104) | > loss_1: 42.17503356933594 (42.24027061462402)  --> STEP: 3 | > loss_disc: 2.207749128341675 (2.3324831326802573) | > loss_disc_real_0: 0.04170367121696472 (0.07148852323492368) | > loss_disc_real_1: 0.21673090755939484 (0.24420138200124106) | > loss_disc_real_2: 0.1442130208015442 (0.20131528874238333) | > loss_disc_real_3: 0.20469045639038086 (0.24455336232980093) | > loss_disc_real_4: 0.141169011592865 (0.22171367208162943) | > loss_disc_real_5: 0.12270056456327438 (0.1887409364183744) | > loss_0: 2.207749128341675 (2.3324831326802573) | > loss_gen: 1.769438624382019 (2.1715527772903442) | > loss_kl: 2.5682976245880127 (4.55160133043925) | > loss_feat: 3.7808725833892822 (5.5778617064158125) | > loss_mel: 20.492652893066406 (23.318845748901367) | > loss_duration: 2.86553955078125 (3.0325865745544434) | > loss_1: 31.4768009185791 (38.65244738260905) --> EVAL PERFORMANCE | > avg_loader_time: 0.010327974955240885 (-0.0019916693369547538) | > avg_loss_disc: 2.3324831326802573 (+0.2765986124674482) | > avg_loss_disc_real_0: 0.07148852323492368 (-0.10877671465277673) | > avg_loss_disc_real_1: 0.24420138200124106 (+0.03963104138771695) | > avg_loss_disc_real_2: 0.20131528874238333 (+0.03584971030553183) | > avg_loss_disc_real_3: 0.24455336232980093 (+0.08939747388164204) | > avg_loss_disc_real_4: 0.22171367208162943 (+0.09407149379452068) | > avg_loss_disc_real_5: 0.1887409364183744 (+0.07423831957081954) | > avg_loss_0: 2.3324831326802573 (+0.2765986124674482) | > avg_loss_gen: 2.1715527772903442 (-0.1524881521860757) | > avg_loss_kl: 4.55160133043925 (-0.17052729924519827) | > avg_loss_feat: 5.5778617064158125 (-2.909411271413167) | > avg_loss_mel: 23.318845748901367 (-1.1240418752034493) | > avg_loss_duration: 3.0325865745544434 (-0.06656273206075047) | > avg_loss_1: 38.65244738260905 (-4.423032760620117)  > EPOCH: 854/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:12:33)   --> TIME: 2023-10-20 10:12:54 -- STEP: 29/50 -- GLOBAL_STEP: 95730 | > loss_disc: 1.9747034311294556 (2.5190900235340514) | > loss_disc_real_0: 0.16114279627799988 (0.14434417671170727) | > loss_disc_real_1: 0.19834820926189423 (0.22047231500518732) | > loss_disc_real_2: 0.24009667336940765 (0.2364907966091715) | > loss_disc_real_3: 0.17663545906543732 (0.2425482675176242) | > loss_disc_real_4: 0.1501334309577942 (0.24238516438495497) | > loss_disc_real_5: 0.12320796400308609 (0.2619090629099258) | > loss_0: 1.9747034311294556 (2.5190900235340514) | > grad_norm_0: tensor(474.0777, device='cuda:0') (tensor(727.0197, device='cuda:0')) | > loss_gen: 2.4849934577941895 (2.2646251875778725) | > loss_kl: 1.1637407541275024 (0.935681526517046) | > loss_feat: 5.369496822357178 (5.261801453756877) | > loss_mel: 22.514188766479492 (22.23459176359505) | > loss_duration: 1.3971529006958008 (1.3923714243132495) | > loss_1: 32.92957305908203 (32.08907179996885) | > grad_norm_1: tensor(8398.8672, device='cuda:0') (tensor(15201.2715, device='cuda:0')) | > current_lr_0: 8.513719269947147e-05 | > current_lr_1: 8.513719269947147e-05 | > step_time: 0.3732 (0.5445071417709876) | > loader_time: 0.0019 (0.018434672520078462)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1347501277923584 (2.1347501277923584) | > loss_disc_real_0: 0.21394918859004974 (0.21394918859004974) | > loss_disc_real_1: 0.2257322072982788 (0.2257322072982788) | > loss_disc_real_2: 0.24087999761104584 (0.24087999761104584) | > loss_disc_real_3: 0.2223849594593048 (0.2223849594593048) | > loss_disc_real_4: 0.14962917566299438 (0.14962917566299438) | > loss_disc_real_5: 0.13086368143558502 (0.13086368143558502) | > loss_0: 2.1347501277923584 (2.1347501277923584) | > loss_gen: 2.4739198684692383 (2.4739198684692383) | > loss_kl: 4.682854652404785 (4.682854652404785) | > loss_feat: 4.355339527130127 (4.355339527130127) | > loss_mel: 19.56633758544922 (19.56633758544922) | > loss_duration: 2.893915891647339 (2.893915891647339) | > loss_1: 33.97237014770508 (33.97237014770508)  --> STEP: 1 | > loss_disc: 3.032355308532715 (3.032355308532715) | > loss_disc_real_0: 0.14872479438781738 (0.14872479438781738) | > loss_disc_real_1: 0.2622106075286865 (0.2622106075286865) | > loss_disc_real_2: 0.3687222898006439 (0.3687222898006439) | > loss_disc_real_3: 0.4064810872077942 (0.4064810872077942) | > loss_disc_real_4: 0.4554024338722229 (0.4554024338722229) | > loss_disc_real_5: 0.560175359249115 (0.560175359249115) | > loss_0: 3.032355308532715 (3.032355308532715) | > loss_gen: 2.6810033321380615 (2.6810033321380615) | > loss_kl: 4.904769420623779 (4.904769420623779) | > loss_feat: 5.759635925292969 (5.759635925292969) | > loss_mel: 25.281831741333008 (25.281831741333008) | > loss_duration: 3.234433174133301 (3.234433174133301) | > loss_1: 41.861671447753906 (41.861671447753906)  --> STEP: 2 | > loss_disc: 1.6621872186660767 (2.3472712635993958) | > loss_disc_real_0: 0.10722385346889496 (0.12797432392835617) | > loss_disc_real_1: 0.12652741372585297 (0.19436901062726974) | > loss_disc_real_2: 0.23938791453838348 (0.3040551021695137) | > loss_disc_real_3: 0.14016494154930115 (0.27332301437854767) | > loss_disc_real_4: 0.19845736026763916 (0.32692989706993103) | > loss_disc_real_5: 0.22369641065597534 (0.39193588495254517) | > loss_0: 1.6621872186660767 (2.3472712635993958) | > loss_gen: 4.060667991638184 (3.3708356618881226) | > loss_kl: 5.2567596435546875 (5.080764532089233) | > loss_feat: 11.366363525390625 (8.562999725341797) | > loss_mel: 23.02255630493164 (24.152194023132324) | > loss_duration: 3.136345863342285 (3.185389518737793) | > loss_1: 46.84269332885742 (44.352182388305664)  --> STEP: 3 | > loss_disc: 2.859168767929077 (2.517903765042623) | > loss_disc_real_0: 0.26309433579444885 (0.1730143278837204) | > loss_disc_real_1: 0.27391570806503296 (0.22088457643985748) | > loss_disc_real_2: 0.3173830509185791 (0.3084977517525355) | > loss_disc_real_3: 0.23057886958122253 (0.25907496611277264) | > loss_disc_real_4: 0.2635945975780487 (0.3058181305726369) | > loss_disc_real_5: 0.27168652415275574 (0.35185276468594867) | > loss_0: 2.859168767929077 (2.517903765042623) | > loss_gen: 1.859620451927185 (2.86709725856781) | > loss_kl: 2.4820871353149414 (4.21453873316447) | > loss_feat: 1.3009920120239258 (6.142330487569173) | > loss_mel: 18.962631225585938 (22.422339757283527) | > loss_duration: 3.0238330364227295 (3.131537357966105) | > loss_1: 27.62916374206543 (38.77784283955892) --> EVAL PERFORMANCE | > avg_loader_time: 0.025070985158284504 (+0.01474301020304362) | > avg_loss_disc: 2.517903765042623 (+0.18542063236236572) | > avg_loss_disc_real_0: 0.1730143278837204 (+0.10152580464879672) | > avg_loss_disc_real_1: 0.22088457643985748 (-0.023316805561383575) | > avg_loss_disc_real_2: 0.3084977517525355 (+0.10718246301015219) | > avg_loss_disc_real_3: 0.25907496611277264 (+0.01452160378297171) | > avg_loss_disc_real_4: 0.3058181305726369 (+0.08410445849100748) | > avg_loss_disc_real_5: 0.35185276468594867 (+0.16311182826757428) | > avg_loss_0: 2.517903765042623 (+0.18542063236236572) | > avg_loss_gen: 2.86709725856781 (+0.6955444812774658) | > avg_loss_kl: 4.21453873316447 (-0.3370625972747803) | > avg_loss_feat: 6.142330487569173 (+0.5644687811533604) | > avg_loss_mel: 22.422339757283527 (-0.8965059916178397) | > avg_loss_duration: 3.131537357966105 (+0.09895078341166164) | > avg_loss_1: 38.77784283955892 (+0.12539545694987453)  > EPOCH: 855/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:13:22)   --> TIME: 2023-10-20 10:13:35 -- STEP: 9/50 -- GLOBAL_STEP: 95760 | > loss_disc: 2.444380044937134 (2.1828087435828314) | > loss_disc_real_0: 0.10647427290678024 (0.16389339272346762) | > loss_disc_real_1: 0.32493457198143005 (0.24809770286083221) | > loss_disc_real_2: 0.306204617023468 (0.2899820531407992) | > loss_disc_real_3: 0.26921355724334717 (0.21294033692942727) | > loss_disc_real_4: 0.1847326010465622 (0.20190323682294953) | > loss_disc_real_5: 0.20252303779125214 (0.18035537294215626) | > loss_0: 2.444380044937134 (2.1828087435828314) | > grad_norm_0: tensor(402.7280, device='cuda:0') (tensor(516.7371, device='cuda:0')) | > loss_gen: 2.2198486328125 (2.793359955151876) | > loss_kl: 0.930286705493927 (0.7961431774828169) | > loss_feat: 3.0675296783447266 (7.765553666485681) | > loss_mel: 24.376903533935547 (22.224188963572185) | > loss_duration: 1.3125277757644653 (1.3881837394502428) | > loss_1: 31.90709686279297 (34.96743075052897) | > grad_norm_1: tensor(5202.1050, device='cuda:0') (tensor(37924.3633, device='cuda:0')) | > current_lr_0: 8.505209274498334e-05 | > current_lr_1: 8.505209274498334e-05 | > step_time: 0.5674 (0.6183248096042209) | > loader_time: 0.025 (0.02311902576022678)  --> TIME: 2023-10-20 10:13:54 -- STEP: 39/50 -- GLOBAL_STEP: 95790 | > loss_disc: 1.6022989749908447 (2.3303917997922654) | > loss_disc_real_0: 0.07219181954860687 (0.14768752336311033) | > loss_disc_real_1: 0.22627659142017365 (0.24248818967204827) | > loss_disc_real_2: 0.07721582055091858 (0.2504710097056932) | > loss_disc_real_3: 0.16244681179523468 (0.22526914979784918) | > loss_disc_real_4: 0.08117879182100296 (0.23112262818866816) | > loss_disc_real_5: 0.13928185403347015 (0.21605453938723373) | > loss_0: 1.6022989749908447 (2.3303917997922654) | > grad_norm_0: tensor(387.6882, device='cuda:0') (tensor(581.2478, device='cuda:0')) | > loss_gen: 2.6322076320648193 (2.544150431950887) | > loss_kl: 0.5916810035705566 (0.9068119533551044) | > loss_feat: 7.885762691497803 (6.133458903154883) | > loss_mel: 24.55379867553711 (21.340824461900272) | > loss_duration: 1.4225448369979858 (1.3717080721488366) | > loss_1: 37.085994720458984 (32.296953849303414) | > grad_norm_1: tensor(10495.8506, device='cuda:0') (tensor(27324.6738, device='cuda:0')) | > current_lr_0: 8.505209274498334e-05 | > current_lr_1: 8.505209274498334e-05 | > step_time: 0.8574 (0.6110504896212847) | > loader_time: 0.0342 (0.02346191650781876)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.005516767501831 (3.005516767501831) | > loss_disc_real_0: 0.1955399513244629 (0.1955399513244629) | > loss_disc_real_1: 0.2525462508201599 (0.2525462508201599) | > loss_disc_real_2: 0.32724401354789734 (0.32724401354789734) | > loss_disc_real_3: 0.33871257305145264 (0.33871257305145264) | > loss_disc_real_4: 0.37439343333244324 (0.37439343333244324) | > loss_disc_real_5: 0.5281431674957275 (0.5281431674957275) | > loss_0: 3.005516767501831 (3.005516767501831) | > loss_gen: 2.423170804977417 (2.423170804977417) | > loss_kl: 5.468255519866943 (5.468255519866943) | > loss_feat: 4.436617851257324 (4.436617851257324) | > loss_mel: 22.153446197509766 (22.153446197509766) | > loss_duration: 2.9835314750671387 (2.9835314750671387) | > loss_1: 37.465023040771484 (37.465023040771484)  --> STEP: 1 | > loss_disc: 2.399534225463867 (2.399534225463867) | > loss_disc_real_0: 0.18906491994857788 (0.18906491994857788) | > loss_disc_real_1: 0.13261350989341736 (0.13261350989341736) | > loss_disc_real_2: 0.10614484548568726 (0.10614484548568726) | > loss_disc_real_3: 0.07035279273986816 (0.07035279273986816) | > loss_disc_real_4: 0.12404834479093552 (0.12404834479093552) | > loss_disc_real_5: 0.054395128041505814 (0.054395128041505814) | > loss_0: 2.399534225463867 (2.399534225463867) | > loss_gen: 1.6664817333221436 (1.6664817333221436) | > loss_kl: 5.023446083068848 (5.023446083068848) | > loss_feat: 7.936670780181885 (7.936670780181885) | > loss_mel: 26.30141258239746 (26.30141258239746) | > loss_duration: 3.2781522274017334 (3.2781522274017334) | > loss_1: 44.20616149902344 (44.20616149902344)  --> STEP: 2 | > loss_disc: 2.3814237117767334 (2.3904789686203003) | > loss_disc_real_0: 0.08324271440505981 (0.13615381717681885) | > loss_disc_real_1: 0.20714646577835083 (0.1698799878358841) | > loss_disc_real_2: 0.19038498401641846 (0.14826491475105286) | > loss_disc_real_3: 0.28900137543678284 (0.1796770840883255) | > loss_disc_real_4: 0.33703893423080444 (0.23054363951086998) | > loss_disc_real_5: 0.25926390290260315 (0.15682951547205448) | > loss_0: 2.3814237117767334 (2.3904789686203003) | > loss_gen: 2.220076084136963 (1.9432789087295532) | > loss_kl: 4.962291240692139 (4.992868661880493) | > loss_feat: 4.01323127746582 (5.9749510288238525) | > loss_mel: 24.91867446899414 (25.6100435256958) | > loss_duration: 3.191082239151001 (3.234617233276367) | > loss_1: 39.305355072021484 (41.75575828552246)  --> STEP: 3 | > loss_disc: 2.719269037246704 (2.500075658162435) | > loss_disc_real_0: 0.39039069414138794 (0.2208994428316752) | > loss_disc_real_1: 0.46992915868759155 (0.26989637811978656) | > loss_disc_real_2: 0.32748788595199585 (0.2080059051513672) | > loss_disc_real_3: 0.24747326970100403 (0.202275812625885) | > loss_disc_real_4: 0.38072341680526733 (0.2806035652756691) | > loss_disc_real_5: 0.3288979232311249 (0.2141856513917446) | > loss_0: 2.719269037246704 (2.500075658162435) | > loss_gen: 3.2125866413116455 (2.3663814862569175) | > loss_kl: 2.7759711742401123 (4.253902832667033) | > loss_feat: 4.762090682983398 (5.570664246877034) | > loss_mel: 20.878156661987305 (24.032747904459637) | > loss_duration: 2.9627270698547363 (3.1439871788024902) | > loss_1: 34.59153366088867 (39.36768341064453) --> EVAL PERFORMANCE | > avg_loader_time: 0.0064427852630615234 (-0.01862819989522298) | > avg_loss_disc: 2.500075658162435 (-0.01782810688018799) | > avg_loss_disc_real_0: 0.2208994428316752 (+0.047885114947954804) | > avg_loss_disc_real_1: 0.26989637811978656 (+0.04901180167992908) | > avg_loss_disc_real_2: 0.2080059051513672 (-0.10049184660116833) | > avg_loss_disc_real_3: 0.202275812625885 (-0.05679915348688763) | > avg_loss_disc_real_4: 0.2806035652756691 (-0.025214565296967806) | > avg_loss_disc_real_5: 0.2141856513917446 (-0.13766711329420406) | > avg_loss_0: 2.500075658162435 (-0.01782810688018799) | > avg_loss_gen: 2.3663814862569175 (-0.5007157723108926) | > avg_loss_kl: 4.253902832667033 (+0.03936409950256348) | > avg_loss_feat: 5.570664246877034 (-0.5716662406921387) | > avg_loss_mel: 24.032747904459637 (+1.6104081471761091) | > avg_loss_duration: 3.1439871788024902 (+0.01244982083638524) | > avg_loss_1: 39.36768341064453 (+0.5898405710856096)  > EPOCH: 856/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:14:15)   --> TIME: 2023-10-20 10:14:29 -- STEP: 19/50 -- GLOBAL_STEP: 95820 | > loss_disc: 1.1946885585784912 (2.266388541773746) | > loss_disc_real_0: 0.03582628816366196 (0.13534368496192128) | > loss_disc_real_1: 0.11636751145124435 (0.22175853954334007) | > loss_disc_real_2: 0.15840528905391693 (0.2001939036540295) | > loss_disc_real_3: 0.08123011142015457 (0.21525309117216812) | > loss_disc_real_4: 0.12243155390024185 (0.20607762930816725) | > loss_disc_real_5: 0.008234544657170773 (0.18401012557411664) | > loss_0: 1.1946885585784912 (2.266388541773746) | > grad_norm_0: tensor(342.0157, device='cuda:0') (tensor(612.7286, device='cuda:0')) | > loss_gen: 3.687628746032715 (2.4761073338358024) | > loss_kl: 0.820719301700592 (0.9072341856203581) | > loss_feat: 12.809393882751465 (6.515338535567648) | > loss_mel: 24.770822525024414 (20.44728478632475) | > loss_duration: 1.5050160884857178 (1.3900057579341687) | > loss_1: 43.59358215332031 (31.735970446937962) | > grad_norm_1: tensor(71763.7891, device='cuda:0') (tensor(26238.0801, device='cuda:0')) | > current_lr_0: 8.496707785322779e-05 | > current_lr_1: 8.496707785322779e-05 | > step_time: 0.3495 (0.4284315360219855) | > loader_time: 0.0139 (0.01613716075294896)  --> TIME: 2023-10-20 10:14:54 -- STEP: 49/50 -- GLOBAL_STEP: 95850 | > loss_disc: 2.128988265991211 (2.392532071288751) | > loss_disc_real_0: 0.11104875802993774 (0.14023352752686763) | > loss_disc_real_1: 0.21005554497241974 (0.22563948778777707) | > loss_disc_real_2: 0.2515201270580292 (0.23047581858628866) | > loss_disc_real_3: 0.30526676774024963 (0.22814443798697726) | > loss_disc_real_4: 0.1611587554216385 (0.2169350948260755) | > loss_disc_real_5: 0.18245479464530945 (0.20558490006405175) | > loss_0: 2.128988265991211 (2.392532071288751) | > grad_norm_0: tensor(874.2789, device='cuda:0') (tensor(587.2652, device='cuda:0')) | > loss_gen: 2.8154988288879395 (2.338470828776457) | > loss_kl: 0.8290998339653015 (0.8247778408077299) | > loss_feat: 4.502548694610596 (5.845456505460399) | > loss_mel: 26.425342559814453 (20.355583353918426) | > loss_duration: 1.495727777481079 (1.375576294198328) | > loss_1: 36.06821823120117 (30.739864865127874) | > grad_norm_1: tensor(12242.4609, device='cuda:0') (tensor(20715.8047, device='cuda:0')) | > current_lr_0: 8.496707785322779e-05 | > current_lr_1: 8.496707785322779e-05 | > step_time: 0.6266 (0.6372119407264554) | > loader_time: 0.6321 (0.0358007051506821)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.859254837036133 (2.859254837036133) | > loss_disc_real_0: 0.5023635625839233 (0.5023635625839233) | > loss_disc_real_1: 0.322432279586792 (0.322432279586792) | > loss_disc_real_2: 0.24339474737644196 (0.24339474737644196) | > loss_disc_real_3: 0.2666715979576111 (0.2666715979576111) | > loss_disc_real_4: 0.2471204549074173 (0.2471204549074173) | > loss_disc_real_5: 0.26802554726600647 (0.26802554726600647) | > loss_0: 2.859254837036133 (2.859254837036133) | > loss_gen: 2.487682819366455 (2.487682819366455) | > loss_kl: 5.4528374671936035 (5.4528374671936035) | > loss_feat: 3.444472551345825 (3.444472551345825) | > loss_mel: 23.613693237304688 (23.613693237304688) | > loss_duration: 3.01916241645813 (3.01916241645813) | > loss_1: 38.017845153808594 (38.017845153808594)  --> STEP: 1 | > loss_disc: 2.3429794311523438 (2.3429794311523438) | > loss_disc_real_0: 0.1478751301765442 (0.1478751301765442) | > loss_disc_real_1: 0.20253561437129974 (0.20253561437129974) | > loss_disc_real_2: 0.3453446328639984 (0.3453446328639984) | > loss_disc_real_3: 0.2752276360988617 (0.2752276360988617) | > loss_disc_real_4: 0.2653334140777588 (0.2653334140777588) | > loss_disc_real_5: 0.21860933303833008 (0.21860933303833008) | > loss_0: 2.3429794311523438 (2.3429794311523438) | > loss_gen: 2.6173386573791504 (2.6173386573791504) | > loss_kl: 5.195701599121094 (5.195701599121094) | > loss_feat: 7.868898391723633 (7.868898391723633) | > loss_mel: 25.548124313354492 (25.548124313354492) | > loss_duration: 3.2091798782348633 (3.2091798782348633) | > loss_1: 44.43924331665039 (44.43924331665039)  --> STEP: 2 | > loss_disc: 2.7992188930511475 (2.5710991621017456) | > loss_disc_real_0: 0.15817296504974365 (0.15302404761314392) | > loss_disc_real_1: 0.2866520285606384 (0.24459382146596909) | > loss_disc_real_2: 0.2827395796775818 (0.3140421062707901) | > loss_disc_real_3: 0.283424437046051 (0.27932603657245636) | > loss_disc_real_4: 0.2859097719192505 (0.27562159299850464) | > loss_disc_real_5: 0.3141368329524994 (0.26637308299541473) | > loss_0: 2.7992188930511475 (2.5710991621017456) | > loss_gen: 1.9144983291625977 (2.265918493270874) | > loss_kl: 5.280768871307373 (5.238235235214233) | > loss_feat: 1.2343838214874268 (4.55164110660553) | > loss_mel: 19.59949493408203 (22.57380962371826) | > loss_duration: 3.231205940246582 (3.2201929092407227) | > loss_1: 31.26034927368164 (37.849796295166016)  --> STEP: 3 | > loss_disc: 2.5764732360839844 (2.572890520095825) | > loss_disc_real_0: 0.4961141049861908 (0.26738740007082623) | > loss_disc_real_1: 0.2621004283428192 (0.2504293570915858) | > loss_disc_real_2: 0.22053490579128265 (0.2828730394442876) | > loss_disc_real_3: 0.2224922925233841 (0.2603814552227656) | > loss_disc_real_4: 0.2932058870792389 (0.2814830243587494) | > loss_disc_real_5: 0.17154747247695923 (0.23476454615592957) | > loss_0: 2.5764732360839844 (2.572890520095825) | > loss_gen: 2.5524704456329346 (2.361435810724894) | > loss_kl: 2.1834006309509277 (4.219957033793132) | > loss_feat: 3.6543657779693604 (4.252549330393474) | > loss_mel: 20.95414924621582 (22.03392283121745) | > loss_duration: 2.8854305744171143 (3.10860546429952) | > loss_1: 32.22981643676758 (35.97646967569987) --> EVAL PERFORMANCE | > avg_loader_time: 0.010330677032470703 (+0.0038878917694091797) | > avg_loss_disc: 2.572890520095825 (+0.07281486193339015) | > avg_loss_disc_real_0: 0.26738740007082623 (+0.04648795723915103) | > avg_loss_disc_real_1: 0.2504293570915858 (-0.01946702102820075) | > avg_loss_disc_real_2: 0.2828730394442876 (+0.07486713429292041) | > avg_loss_disc_real_3: 0.2603814552227656 (+0.05810564259688061) | > avg_loss_disc_real_4: 0.2814830243587494 (+0.0008794590830802917) | > avg_loss_disc_real_5: 0.23476454615592957 (+0.020578894764184952) | > avg_loss_0: 2.572890520095825 (+0.07281486193339015) | > avg_loss_gen: 2.361435810724894 (-0.004945675532023408) | > avg_loss_kl: 4.219957033793132 (-0.03394579887390137) | > avg_loss_feat: 4.252549330393474 (-1.3181149164835606) | > avg_loss_mel: 22.03392283121745 (-1.9988250732421875) | > avg_loss_duration: 3.10860546429952 (-0.03538171450297023) | > avg_loss_1: 35.97646967569987 (-3.391213734944664)  > EPOCH: 857/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:15:05)   --> TIME: 2023-10-20 10:15:29 -- STEP: 29/50 -- GLOBAL_STEP: 95880 | > loss_disc: 3.2660117149353027 (2.3860859583164085) | > loss_disc_real_0: 0.1217421293258667 (0.1488565523498531) | > loss_disc_real_1: 0.22890599071979523 (0.237504989936434) | > loss_disc_real_2: 0.21657143533229828 (0.22685324053826003) | > loss_disc_real_3: 0.2389490157365799 (0.2374773390334228) | > loss_disc_real_4: 0.1688612550497055 (0.22898909128431616) | > loss_disc_real_5: 0.18282641470432281 (0.2329836223146011) | > loss_0: 3.2660117149353027 (2.3860859583164085) | > grad_norm_0: tensor(1004.8646, device='cuda:0') (tensor(516.4274, device='cuda:0')) | > loss_gen: 1.1971230506896973 (2.475148533952648) | > loss_kl: 1.150495171546936 (0.9159709687890678) | > loss_feat: 1.9003942012786865 (6.082549182794474) | > loss_mel: 11.174312591552734 (19.764713044824273) | > loss_duration: 1.363389492034912 (1.394325955160733) | > loss_1: 16.785715103149414 (30.63270771092382) | > grad_norm_1: tensor(13393.4961, device='cuda:0') (tensor(20089.8301, device='cuda:0')) | > current_lr_0: 8.488214793917925e-05 | > current_lr_1: 8.488214793917925e-05 | > step_time: 0.5652 (0.6199676332802608) | > loader_time: 0.0287 (0.02555100671176253)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6100802421569824 (2.6100802421569824) | > loss_disc_real_0: 0.2703516185283661 (0.2703516185283661) | > loss_disc_real_1: 0.24153250455856323 (0.24153250455856323) | > loss_disc_real_2: 0.21458540856838226 (0.21458540856838226) | > loss_disc_real_3: 0.18914592266082764 (0.18914592266082764) | > loss_disc_real_4: 0.3280930519104004 (0.3280930519104004) | > loss_disc_real_5: 0.45438840985298157 (0.45438840985298157) | > loss_0: 2.6100802421569824 (2.6100802421569824) | > loss_gen: 2.7466213703155518 (2.7466213703155518) | > loss_kl: 5.64499044418335 (5.64499044418335) | > loss_feat: 5.199802875518799 (5.199802875518799) | > loss_mel: 22.602388381958008 (22.602388381958008) | > loss_duration: 2.9885263442993164 (2.9885263442993164) | > loss_1: 39.18232727050781 (39.18232727050781)  --> STEP: 1 | > loss_disc: 3.011561393737793 (3.011561393737793) | > loss_disc_real_0: 0.17621058225631714 (0.17621058225631714) | > loss_disc_real_1: 0.3623999059200287 (0.3623999059200287) | > loss_disc_real_2: 0.31129467487335205 (0.31129467487335205) | > loss_disc_real_3: 0.2777705192565918 (0.2777705192565918) | > loss_disc_real_4: 0.40965700149536133 (0.40965700149536133) | > loss_disc_real_5: 0.44668352603912354 (0.44668352603912354) | > loss_0: 3.011561393737793 (3.011561393737793) | > loss_gen: 2.1660430431365967 (2.1660430431365967) | > loss_kl: 5.863958835601807 (5.863958835601807) | > loss_feat: 3.6759819984436035 (3.6759819984436035) | > loss_mel: 20.871482849121094 (20.871482849121094) | > loss_duration: 3.257295846939087 (3.257295846939087) | > loss_1: 35.83476257324219 (35.83476257324219)  --> STEP: 2 | > loss_disc: 2.035795211791992 (2.5236783027648926) | > loss_disc_real_0: 0.050816524773836136 (0.11351355351507664) | > loss_disc_real_1: 0.06576088070869446 (0.21408039331436157) | > loss_disc_real_2: 0.19775421917438507 (0.25452444702386856) | > loss_disc_real_3: 0.0525800921022892 (0.1651753056794405) | > loss_disc_real_4: 0.20006932318210602 (0.3048631623387337) | > loss_disc_real_5: 0.06713519990444183 (0.2569093629717827) | > loss_0: 2.035795211791992 (2.5236783027648926) | > loss_gen: 2.332242488861084 (2.2491427659988403) | > loss_kl: 5.5134358406066895 (5.688697338104248) | > loss_feat: 12.514660835266113 (8.095321416854858) | > loss_mel: 23.291568756103516 (22.081525802612305) | > loss_duration: 3.2215375900268555 (3.239416718482971) | > loss_1: 46.873443603515625 (41.354103088378906)  --> STEP: 3 | > loss_disc: 2.7658398151397705 (2.604398806889852) | > loss_disc_real_0: 0.16659390926361084 (0.13120700543125471) | > loss_disc_real_1: 0.28237923979759216 (0.23684667547543845) | > loss_disc_real_2: 0.31883856654167175 (0.2759624868631363) | > loss_disc_real_3: 0.203593447804451 (0.17798135305444399) | > loss_disc_real_4: 0.32304006814956665 (0.31092213094234467) | > loss_disc_real_5: 0.3011907637119293 (0.2716698298851649) | > loss_0: 2.7658398151397705 (2.604398806889852) | > loss_gen: 1.9795751571655273 (2.159286896387736) | > loss_kl: 1.9093512296676636 (4.42891530195872) | > loss_feat: 1.7389020919799805 (5.976514975229899) | > loss_mel: 19.376728057861328 (21.17992655436198) | > loss_duration: 2.9798641204833984 (3.152899185816447) | > loss_1: 27.98442268371582 (36.89754295349121) --> EVAL PERFORMANCE | > avg_loader_time: 0.005856513977050781 (-0.004474163055419922) | > avg_loss_disc: 2.604398806889852 (+0.03150828679402684) | > avg_loss_disc_real_0: 0.13120700543125471 (-0.13618039463957152) | > avg_loss_disc_real_1: 0.23684667547543845 (-0.013582681616147368) | > avg_loss_disc_real_2: 0.2759624868631363 (-0.006910552581151308) | > avg_loss_disc_real_3: 0.17798135305444399 (-0.08240010216832164) | > avg_loss_disc_real_4: 0.31092213094234467 (+0.029439106583595276) | > avg_loss_disc_real_5: 0.2716698298851649 (+0.03690528372923535) | > avg_loss_0: 2.604398806889852 (+0.03150828679402684) | > avg_loss_gen: 2.159286896387736 (-0.2021489143371582) | > avg_loss_kl: 4.42891530195872 (+0.20895826816558838) | > avg_loss_feat: 5.976514975229899 (+1.7239656448364258) | > avg_loss_mel: 21.17992655436198 (-0.8539962768554688) | > avg_loss_duration: 3.152899185816447 (+0.04429372151692679) | > avg_loss_1: 36.89754295349121 (+0.9210732777913435)  > EPOCH: 858/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:15:56)   --> TIME: 2023-10-20 10:16:11 -- STEP: 9/50 -- GLOBAL_STEP: 95910 | > loss_disc: 3.0098564624786377 (2.613301912943522) | > loss_disc_real_0: 0.3123958110809326 (0.18665140743056932) | > loss_disc_real_1: 0.2568242847919464 (0.21245225022236505) | > loss_disc_real_2: 0.26669979095458984 (0.2209386353691419) | > loss_disc_real_3: 0.28876498341560364 (0.2126758082045449) | > loss_disc_real_4: 0.2690631151199341 (0.23125515712632072) | > loss_disc_real_5: 0.28552067279815674 (0.22133520990610123) | > loss_0: 3.0098564624786377 (2.613301912943522) | > grad_norm_0: tensor(411.5458, device='cuda:0') (tensor(624.9547, device='cuda:0')) | > loss_gen: 1.6613824367523193 (2.06924299399058) | > loss_kl: 0.5101292133331299 (0.7970404624938965) | > loss_feat: 0.062134649604558945 (4.605836595512098) | > loss_mel: 1.4422554969787598 (16.612538006570603) | > loss_duration: 1.3505868911743164 (1.4132863018247817) | > loss_1: 5.026488304138184 (25.497943931155735) | > grad_norm_1: tensor(32827.1289, device='cuda:0') (tensor(30619.0938, device='cuda:0')) | > current_lr_0: 8.479730291789722e-05 | > current_lr_1: 8.479730291789722e-05 | > step_time: 0.8405 (0.8500694168938531) | > loader_time: 0.0318 (0.03029089503818088)  --> TIME: 2023-10-20 10:16:31 -- STEP: 39/50 -- GLOBAL_STEP: 95940 | > loss_disc: 2.9202165603637695 (2.4723306252406196) | > loss_disc_real_0: 0.20001918077468872 (0.15819701222846141) | > loss_disc_real_1: 0.2530764937400818 (0.22899196344690445) | > loss_disc_real_2: 0.24182754755020142 (0.21767817112879875) | > loss_disc_real_3: 0.28653356432914734 (0.22956461316117874) | > loss_disc_real_4: 0.2408333569765091 (0.221115788564277) | > loss_disc_real_5: 0.25772663950920105 (0.2275485576918492) | > loss_0: 2.9202165603637695 (2.4723306252406196) | > grad_norm_0: tensor(404.5961, device='cuda:0') (tensor(654.4485, device='cuda:0')) | > loss_gen: 1.5661473274230957 (2.228794091787093) | > loss_kl: 0.5372538566589355 (0.8196942729827685) | > loss_feat: 0.26279327273368835 (4.824239446280094) | > loss_mel: 6.695584774017334 (19.21172909247569) | > loss_duration: 1.4196500778198242 (1.3795948334229298) | > loss_1: 10.481429100036621 (28.46405132000263) | > grad_norm_1: tensor(25303.5508, device='cuda:0') (tensor(19219.0566, device='cuda:0')) | > current_lr_0: 8.479730291789722e-05 | > current_lr_1: 8.479730291789722e-05 | > step_time: 0.6546 (0.693107470487937) | > loader_time: 0.0154 (0.025440387236766327)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.872678518295288 (2.872678518295288) | > loss_disc_real_0: 0.513919472694397 (0.513919472694397) | > loss_disc_real_1: 0.2568622827529907 (0.2568622827529907) | > loss_disc_real_2: 0.29472610354423523 (0.29472610354423523) | > loss_disc_real_3: 0.307781845331192 (0.307781845331192) | > loss_disc_real_4: 0.256593257188797 (0.256593257188797) | > loss_disc_real_5: 0.20952916145324707 (0.20952916145324707) | > loss_0: 2.872678518295288 (2.872678518295288) | > loss_gen: 2.4373607635498047 (2.4373607635498047) | > loss_kl: 6.136744499206543 (6.136744499206543) | > loss_feat: 4.749780654907227 (4.749780654907227) | > loss_mel: 22.103321075439453 (22.103321075439453) | > loss_duration: 3.051381826400757 (3.051381826400757) | > loss_1: 38.47858810424805 (38.47858810424805)  --> STEP: 1 | > loss_disc: 2.862950325012207 (2.862950325012207) | > loss_disc_real_0: 0.49776601791381836 (0.49776601791381836) | > loss_disc_real_1: 0.33895793557167053 (0.33895793557167053) | > loss_disc_real_2: 0.40315473079681396 (0.40315473079681396) | > loss_disc_real_3: 0.2567979693412781 (0.2567979693412781) | > loss_disc_real_4: 0.35685738921165466 (0.35685738921165466) | > loss_disc_real_5: 0.34551241993904114 (0.34551241993904114) | > loss_0: 2.862950325012207 (2.862950325012207) | > loss_gen: 3.1672327518463135 (3.1672327518463135) | > loss_kl: 5.12017297744751 (5.12017297744751) | > loss_feat: 8.032563209533691 (8.032563209533691) | > loss_mel: 26.248075485229492 (26.248075485229492) | > loss_duration: 3.298851728439331 (3.298851728439331) | > loss_1: 45.86689376831055 (45.86689376831055)  --> STEP: 2 | > loss_disc: 3.3650307655334473 (3.113990545272827) | > loss_disc_real_0: 0.46173763275146484 (0.4797518253326416) | > loss_disc_real_1: 0.4470422565937042 (0.3930000960826874) | > loss_disc_real_2: 0.2503427565097809 (0.3267487436532974) | > loss_disc_real_3: 0.42012062668800354 (0.3384592980146408) | > loss_disc_real_4: 0.2394486963748932 (0.2981530427932739) | > loss_disc_real_5: 0.5051714777946472 (0.4253419488668442) | > loss_0: 3.3650307655334473 (3.113990545272827) | > loss_gen: 3.140591859817505 (3.153912305831909) | > loss_kl: 5.398171424865723 (5.259172201156616) | > loss_feat: 8.65546989440918 (8.344016551971436) | > loss_mel: 28.985137939453125 (27.61660671234131) | > loss_duration: 3.1538898944854736 (3.2263708114624023) | > loss_1: 49.33325958251953 (47.60007667541504)  --> STEP: 3 | > loss_disc: 2.1658236980438232 (2.7979349295298257) | > loss_disc_real_0: 0.4033634662628174 (0.4542890389760335) | > loss_disc_real_1: 0.29191964864730835 (0.3593066136042277) | > loss_disc_real_2: 0.19165630638599396 (0.2817179312308629) | > loss_disc_real_3: 0.22055204212665558 (0.2991568793853124) | > loss_disc_real_4: 0.09804331511259079 (0.2314498002330462) | > loss_disc_real_5: 0.09760358929634094 (0.31609582901000977) | > loss_0: 2.1658236980438232 (2.7979349295298257) | > loss_gen: 2.730494499206543 (3.012773036956787) | > loss_kl: 2.3485982418060303 (4.288980881373088) | > loss_feat: 5.783945560455322 (7.4906595547993975) | > loss_mel: 18.935504913330078 (24.7229061126709) | > loss_duration: 3.0182294845581055 (3.15699036916097) | > loss_1: 32.8167724609375 (42.672308603922524) --> EVAL PERFORMANCE | > avg_loader_time: 0.012805302937825521 (+0.00694878896077474) | > avg_loss_disc: 2.7979349295298257 (+0.19353612263997366) | > avg_loss_disc_real_0: 0.4542890389760335 (+0.3230820335447788) | > avg_loss_disc_real_1: 0.3593066136042277 (+0.12245993812878928) | > avg_loss_disc_real_2: 0.2817179312308629 (+0.005755444367726625) | > avg_loss_disc_real_3: 0.2991568793853124 (+0.1211755263308684) | > avg_loss_disc_real_4: 0.2314498002330462 (-0.07947233070929846) | > avg_loss_disc_real_5: 0.31609582901000977 (+0.04442599912484485) | > avg_loss_0: 2.7979349295298257 (+0.19353612263997366) | > avg_loss_gen: 3.012773036956787 (+0.8534861405690513) | > avg_loss_kl: 4.288980881373088 (-0.13993442058563232) | > avg_loss_feat: 7.4906595547993975 (+1.514144579569498) | > avg_loss_mel: 24.7229061126709 (+3.542979558308918) | > avg_loss_duration: 3.15699036916097 (+0.004091183344523408) | > avg_loss_1: 42.672308603922524 (+5.774765650431313)  > EPOCH: 859/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:16:48)   --> TIME: 2023-10-20 10:17:06 -- STEP: 19/50 -- GLOBAL_STEP: 95970 | > loss_disc: 3.155893325805664 (2.436469705481278) | > loss_disc_real_0: 0.09325430542230606 (0.16790899467703543) | > loss_disc_real_1: 0.3464866578578949 (0.23460827885489716) | > loss_disc_real_2: 0.34661465883255005 (0.2528403555288127) | > loss_disc_real_3: 0.336123526096344 (0.2637434423361954) | > loss_disc_real_4: 0.3634682297706604 (0.2276151331239625) | > loss_disc_real_5: 0.4827912747859955 (0.24561504975549484) | > loss_0: 3.155893325805664 (2.436469705481278) | > grad_norm_0: tensor(749.2856, device='cuda:0') (tensor(688.2411, device='cuda:0')) | > loss_gen: 1.9410054683685303 (2.51416824365917) | > loss_kl: 0.8815762400627136 (0.9014469730226617) | > loss_feat: 2.934823989868164 (6.063307984879143) | > loss_mel: 22.374752044677734 (23.12806676563464) | > loss_duration: 1.4953621625900269 (1.4254626788591083) | > loss_1: 29.627519607543945 (34.03245233234606) | > grad_norm_1: tensor(3844.1782, device='cuda:0') (tensor(19317.4961, device='cuda:0')) | > current_lr_0: 8.471254270452606e-05 | > current_lr_1: 8.471254270452606e-05 | > step_time: 0.5144 (0.6530268945192036) | > loader_time: 0.0042 (0.024170888097662675)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.752680778503418 (2.752680778503418) | > loss_disc_real_0: 0.3072274327278137 (0.3072274327278137) | > loss_disc_real_1: 0.24361109733581543 (0.24361109733581543) | > loss_disc_real_2: 0.18804889917373657 (0.18804889917373657) | > loss_disc_real_3: 0.2494061142206192 (0.2494061142206192) | > loss_disc_real_4: 0.21683275699615479 (0.21683275699615479) | > loss_disc_real_5: 0.24596244096755981 (0.24596244096755981) | > loss_0: 2.752680778503418 (2.752680778503418) | > loss_gen: 1.917029857635498 (1.917029857635498) | > loss_kl: 4.996109485626221 (4.996109485626221) | > loss_feat: 3.5553553104400635 (3.5553553104400635) | > loss_mel: 26.004709243774414 (26.004709243774414) | > loss_duration: 2.976720094680786 (2.976720094680786) | > loss_1: 39.44992446899414 (39.44992446899414)  --> STEP: 1 | > loss_disc: 3.009950637817383 (3.009950637817383) | > loss_disc_real_0: 0.1628277748823166 (0.1628277748823166) | > loss_disc_real_1: 0.3904540240764618 (0.3904540240764618) | > loss_disc_real_2: 0.34214553236961365 (0.34214553236961365) | > loss_disc_real_3: 0.34098467230796814 (0.34098467230796814) | > loss_disc_real_4: 0.41984933614730835 (0.41984933614730835) | > loss_disc_real_5: 0.41426509618759155 (0.41426509618759155) | > loss_0: 3.009950637817383 (3.009950637817383) | > loss_gen: 2.9256646633148193 (2.9256646633148193) | > loss_kl: 5.346406936645508 (5.346406936645508) | > loss_feat: 7.053915023803711 (7.053915023803711) | > loss_mel: 22.19068717956543 (22.19068717956543) | > loss_duration: 3.2303073406219482 (3.2303073406219482) | > loss_1: 40.74698257446289 (40.74698257446289)  --> STEP: 2 | > loss_disc: 2.829998254776001 (2.919974446296692) | > loss_disc_real_0: 0.05394153296947479 (0.10838465392589569) | > loss_disc_real_1: 0.28400918841362 (0.3372316062450409) | > loss_disc_real_2: 0.31684982776641846 (0.32949768006801605) | > loss_disc_real_3: 0.26627883315086365 (0.3036317527294159) | > loss_disc_real_4: 0.25877824425697327 (0.3393137902021408) | > loss_disc_real_5: 0.2766683101654053 (0.3454667031764984) | > loss_0: 2.829998254776001 (2.919974446296692) | > loss_gen: 1.777106761932373 (2.351385712623596) | > loss_kl: 6.0080246925354 (5.677215814590454) | > loss_feat: 1.6271543502807617 (4.340534687042236) | > loss_mel: 22.473480224609375 (22.332083702087402) | > loss_duration: 3.0632638931274414 (3.146785616874695) | > loss_1: 34.949031829833984 (37.84800720214844)  --> STEP: 3 | > loss_disc: 2.8295364379882812 (2.8898284435272217) | > loss_disc_real_0: 0.0975252091884613 (0.10476483901341756) | > loss_disc_real_1: 0.3544901907444 (0.34298446774482727) | > loss_disc_real_2: 0.22419430315494537 (0.2943965544303258) | > loss_disc_real_3: 0.3945808708667755 (0.3339481254418691) | > loss_disc_real_4: 0.31499558687210083 (0.3312077224254608) | > loss_disc_real_5: 0.26989468932151794 (0.32027603189150494) | > loss_0: 2.8295364379882812 (2.8898284435272217) | > loss_gen: 2.094618797302246 (2.265796740849813) | > loss_kl: 2.4325671195983887 (4.595666249593099) | > loss_feat: 4.854430198669434 (4.511833190917969) | > loss_mel: 21.22466278076172 (21.96294339497884) | > loss_duration: 2.949423313140869 (3.080998182296753) | > loss_1: 33.555702209472656 (36.41723887125651)  --> TIME: 2023-10-20 10:17:30 -- STEP: 49/50 -- GLOBAL_STEP: 96000 | > loss_disc: 2.456033229827881 (2.4733268217164643) | > loss_disc_real_0: 0.10515663027763367 (0.16569218847292425) | > loss_disc_real_1: 0.15135963261127472 (0.22486688196659088) | > loss_disc_real_2: 0.17678534984588623 (0.23074141289202527) | > loss_disc_real_3: 0.2066521793603897 (0.2429377484724534) | > loss_disc_real_4: 0.21942554414272308 (0.24551938227092734) | > loss_disc_real_5: 0.15640965104103088 (0.24661233585936074) | > loss_0: 2.456033229827881 (2.4733268217164643) | > grad_norm_0: tensor(542.4121, device='cuda:0') (tensor(573.8936, device='cuda:0')) | > loss_gen: 1.8695136308670044 (2.367808597428458) | > loss_kl: 0.5096184015274048 (0.8128774602498327) | > loss_feat: 5.598278522491455 (5.866916334028451) | > loss_mel: 24.51253318786621 (21.08769412916534) | > loss_duration: 1.5143649578094482 (1.380524474747327) | > loss_1: 34.004310607910156 (31.51582093141516) | > grad_norm_1: tensor(6527.6113, device='cuda:0') (tensor(17502.9707, device='cuda:0')) | > current_lr_0: 8.471254270452606e-05 | > current_lr_1: 8.471254270452606e-05 | > step_time: 2.0219 (0.5738669706850638) | > loader_time: 7.954 (0.18016332509566327) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_96000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9696943759918213 (2.9097949266433716) | > loss_disc_real_0: 0.15688012540340424 (0.11779366061091423) | > loss_disc_real_1: 0.25488758087158203 (0.32096024602651596) | > loss_disc_real_2: 0.2538191080093384 (0.28425219282507896) | > loss_disc_real_3: 0.21972011029720306 (0.3053911216557026) | > loss_disc_real_4: 0.22854070365428925 (0.3055409677326679) | > loss_disc_real_5: 0.25095903873443604 (0.3029467836022377) | > loss_0: 2.9696943759918213 (2.9097949266433716) | > loss_gen: 1.4141517877578735 (2.052885502576828) | > loss_kl: 4.9239654541015625 (4.677741050720215) | > loss_feat: 0.1449551284313202 (3.4201136752963066) | > loss_mel: 2.0871336460113525 (16.99399095773697) | > loss_duration: 2.9232611656188965 (3.041563928127289) | > loss_1: 11.493467330932617 (30.186295986175537)  --> STEP: 1 | > loss_disc: 2.7856833934783936 (2.884972620010376) | > loss_disc_real_0: 0.1310679167509079 (0.12044851183891296) | > loss_disc_real_1: 0.17438627779483795 (0.29164545238018036) | > loss_disc_real_2: 0.09189473092556 (0.24578070044517517) | > loss_disc_real_3: 0.2227720469236374 (0.28886730670928956) | > loss_disc_real_4: 0.3104415535926819 (0.3065210849046707) | > loss_disc_real_5: 0.3257102072238922 (0.3074994683265686) | > loss_0: 2.7856833934783936 (2.884972620010376) | > loss_gen: 1.6728776693344116 (1.9768839359283448) | > loss_kl: 5.410567283630371 (4.824306297302246) | > loss_feat: 5.308951377868652 (3.7978812158107758) | > loss_mel: 25.47589683532715 (18.690372133255003) | > loss_duration: 3.395057201385498 (3.1122625827789308) | > loss_1: 41.26335144042969 (32.401707077026366)  --> STEP: 2 | > loss_disc: 3.1598639488220215 (2.9307878414789834) | > loss_disc_real_0: 0.6084861755371094 (0.20178812245527902) | > loss_disc_real_1: 0.2780425548553467 (0.2893783027927081) | > loss_disc_real_2: 0.31136420369148254 (0.25671128431955975) | > loss_disc_real_3: 0.2309691160917282 (0.2792176082730293) | > loss_disc_real_4: 0.20957453548908234 (0.2903633266687393) | > loss_disc_real_5: 0.32178232073783875 (0.30987994372844696) | > loss_0: 3.1598639488220215 (2.9307878414789834) | > loss_gen: 2.5519211292266846 (2.072723468144735) | > loss_kl: 5.78823709487915 (4.98496143023173) | > loss_feat: 7.6612868309021 (4.441782151659329) | > loss_mel: 23.307281494140625 (19.459857026735943) | > loss_duration: 3.0285379886627197 (3.098308483759562) | > loss_1: 42.33726501464844 (34.05763339996338)  --> STEP: 3 | > loss_disc: 2.6777312755584717 (2.894636903490339) | > loss_disc_real_0: 0.07194812595844269 (0.18323955152715957) | > loss_disc_real_1: 0.3245473802089691 (0.2944024567093168) | > loss_disc_real_2: 0.26095902919769287 (0.25731810501643587) | > loss_disc_real_3: 0.2527635097503662 (0.2754384513412203) | > loss_disc_real_4: 0.34434953331947327 (0.29807564190455843) | > loss_disc_real_5: 0.3890860080718994 (0.3211950957775116) | > loss_0: 2.6777312755584717 (2.894636903490339) | > loss_gen: 2.2150163650512695 (2.093051024845668) | > loss_kl: 2.268592119216919 (4.596908671515329) | > loss_feat: 3.7661187648773193 (4.3452588106904715) | > loss_mel: 18.063518524169922 (19.26038009779794) | > loss_duration: 2.9253346920013428 (3.0735979420798167) | > loss_1: 29.23857879638672 (33.369197028023855) --> EVAL PERFORMANCE | > avg_loader_time: 0.846170152936663 (+0.8333648499988374) | > avg_loss_disc: 2.894636903490339 (+0.0967019739605135) | > avg_loss_disc_real_0: 0.18323955152715957 (-0.2710494874488739) | > avg_loss_disc_real_1: 0.2944024567093168 (-0.06490415689491091) | > avg_loss_disc_real_2: 0.25731810501643587 (-0.024399826214427045) | > avg_loss_disc_real_3: 0.2754384513412203 (-0.023718428044092077) | > avg_loss_disc_real_4: 0.29807564190455843 (+0.06662584167151223) | > avg_loss_disc_real_5: 0.3211950957775116 (+0.005099266767501831) | > avg_loss_0: 2.894636903490339 (+0.0967019739605135) | > avg_loss_gen: 2.093051024845668 (-0.9197220121111189) | > avg_loss_kl: 4.596908671515329 (+0.3079277901422408) | > avg_loss_feat: 4.3452588106904715 (-3.145400744108926) | > avg_loss_mel: 19.26038009779794 (-5.46252601487296) | > avg_loss_duration: 3.0735979420798167 (-0.08339242708115346) | > avg_loss_1: 33.369197028023855 (-9.303111575898669)  > EPOCH: 860/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:18:03)   --> TIME: 2023-10-20 10:18:27 -- STEP: 29/50 -- GLOBAL_STEP: 96030 | > loss_disc: 2.754819869995117 (2.331866642524456) | > loss_disc_real_0: 0.19239088892936707 (0.1559935257095715) | > loss_disc_real_1: 0.24571317434310913 (0.23333884081963835) | > loss_disc_real_2: 0.2463938444852829 (0.23518799733499002) | > loss_disc_real_3: 0.2560667395591736 (0.23454911518713523) | > loss_disc_real_4: 0.293425589799881 (0.21541251242160797) | > loss_disc_real_5: 0.26722973585128784 (0.20173075852979874) | > loss_0: 2.754819869995117 (2.331866642524456) | > grad_norm_0: tensor(554.7456, device='cuda:0') (tensor(500.4119, device='cuda:0')) | > loss_gen: 1.7934250831604004 (2.459667625098393) | > loss_kl: 0.8211169242858887 (0.9566795527935028) | > loss_feat: 0.8284364938735962 (6.222074086809981) | > loss_mel: 16.06485939025879 (19.97098976579206) | > loss_duration: 1.3717188835144043 (1.37733452895592) | > loss_1: 20.87955665588379 (30.986745735694623) | > grad_norm_1: tensor(9545.2764, device='cuda:0') (tensor(17541.1074, device='cuda:0')) | > current_lr_0: 8.462786721429496e-05 | > current_lr_1: 8.462786721429496e-05 | > step_time: 0.6966 (0.6454908354529019) | > loader_time: 0.0325 (0.025346739538784684)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.991363763809204 (2.991363763809204) | > loss_disc_real_0: 0.22724555432796478 (0.22724555432796478) | > loss_disc_real_1: 0.2679329812526703 (0.2679329812526703) | > loss_disc_real_2: 0.258419930934906 (0.258419930934906) | > loss_disc_real_3: 0.26773014664649963 (0.26773014664649963) | > loss_disc_real_4: 0.23554016649723053 (0.23554016649723053) | > loss_disc_real_5: 0.25927215814590454 (0.25927215814590454) | > loss_0: 2.991363763809204 (2.991363763809204) | > loss_gen: 1.5282646417617798 (1.5282646417617798) | > loss_kl: 4.674384117126465 (4.674384117126465) | > loss_feat: 0.034194398671388626 (0.034194398671388626) | > loss_mel: 1.1882481575012207 (1.1882481575012207) | > loss_duration: 2.8919296264648438 (2.8919296264648438) | > loss_1: 10.317020416259766 (10.317020416259766)  --> STEP: 1 | > loss_disc: 2.721433639526367 (2.721433639526367) | > loss_disc_real_0: 0.28556886315345764 (0.28556886315345764) | > loss_disc_real_1: 0.24217960238456726 (0.24217960238456726) | > loss_disc_real_2: 0.30743208527565 (0.30743208527565) | > loss_disc_real_3: 0.297991544008255 (0.297991544008255) | > loss_disc_real_4: 0.43164336681365967 (0.43164336681365967) | > loss_disc_real_5: 0.4630255699157715 (0.4630255699157715) | > loss_0: 2.721433639526367 (2.721433639526367) | > loss_gen: 3.046565055847168 (3.046565055847168) | > loss_kl: 5.108090400695801 (5.108090400695801) | > loss_feat: 7.10512638092041 (7.10512638092041) | > loss_mel: 23.47159194946289 (23.47159194946289) | > loss_duration: 3.326042413711548 (3.326042413711548) | > loss_1: 42.05741500854492 (42.05741500854492)  --> STEP: 2 | > loss_disc: 3.1725881099700928 (2.94701087474823) | > loss_disc_real_0: 0.3031502366065979 (0.29435954988002777) | > loss_disc_real_1: 0.28188398480415344 (0.26203179359436035) | > loss_disc_real_2: 0.2530764639377594 (0.2802542746067047) | > loss_disc_real_3: 0.31688207387924194 (0.3074368089437485) | > loss_disc_real_4: 0.3095102310180664 (0.37057679891586304) | > loss_disc_real_5: 0.35020938515663147 (0.4066174775362015) | > loss_0: 3.1725881099700928 (2.94701087474823) | > loss_gen: 1.8315937519073486 (2.4390794038772583) | > loss_kl: 5.78737211227417 (5.447731256484985) | > loss_feat: 1.9649949073791504 (4.53506064414978) | > loss_mel: 9.855839729309082 (16.663715839385986) | > loss_duration: 3.1051712036132812 (3.2156068086624146) | > loss_1: 22.544973373413086 (32.301194190979004)  --> STEP: 3 | > loss_disc: 2.7220306396484375 (2.8720174630482993) | > loss_disc_real_0: 0.24002107977867126 (0.27624672651290894) | > loss_disc_real_1: 0.2700645923614502 (0.2647093931833903) | > loss_disc_real_2: 0.4314579367637634 (0.3306554953257243) | > loss_disc_real_3: 0.4528191387653351 (0.35589758555094403) | > loss_disc_real_4: 0.3939611613750458 (0.37837158640225727) | > loss_disc_real_5: 0.3050823509693146 (0.3727724353472392) | > loss_0: 2.7220306396484375 (2.8720174630482993) | > loss_gen: 3.006085157394409 (2.6280813217163086) | > loss_kl: 2.1619436740875244 (4.352468729019165) | > loss_feat: 5.261712074279785 (4.777277787526448) | > loss_mel: 20.22195053100586 (17.849794069925945) | > loss_duration: 2.9867091178894043 (3.1393075784047446) | > loss_1: 33.63840103149414 (32.74692980448405) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025008519490559897 (-0.843669300987607) | > avg_loss_disc: 2.8720174630482993 (-0.022619440442039895) | > avg_loss_disc_real_0: 0.27624672651290894 (+0.09300717498574937) | > avg_loss_disc_real_1: 0.2647093931833903 (-0.02969306352592649) | > avg_loss_disc_real_2: 0.3306554953257243 (+0.07333739030928843) | > avg_loss_disc_real_3: 0.35589758555094403 (+0.08045913420972373) | > avg_loss_disc_real_4: 0.37837158640225727 (+0.08029594449769883) | > avg_loss_disc_real_5: 0.3727724353472392 (+0.0515773395697276) | > avg_loss_0: 2.8720174630482993 (-0.022619440442039895) | > avg_loss_gen: 2.6280813217163086 (+0.5350302968706404) | > avg_loss_kl: 4.352468729019165 (-0.24443994249616363) | > avg_loss_feat: 4.777277787526448 (+0.4320189768359768) | > avg_loss_mel: 17.849794069925945 (-1.410586027871993) | > avg_loss_duration: 3.1393075784047446 (+0.06570963632492788) | > avg_loss_1: 32.74692980448405 (-0.6222672235398079)  > EPOCH: 861/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:18:56)   --> TIME: 2023-10-20 10:19:06 -- STEP: 9/50 -- GLOBAL_STEP: 96060 | > loss_disc: 2.8686957359313965 (2.6039915217293634) | > loss_disc_real_0: 0.18205055594444275 (0.14166112368305525) | > loss_disc_real_1: 0.2898176312446594 (0.24964051528109443) | > loss_disc_real_2: 0.28103357553482056 (0.2548646512958739) | > loss_disc_real_3: 0.27937445044517517 (0.25002286831537884) | > loss_disc_real_4: 0.3971017599105835 (0.25455514672729707) | > loss_disc_real_5: 0.3901117146015167 (0.27271753715144265) | > loss_0: 2.8686957359313965 (2.6039915217293634) | > grad_norm_0: tensor(431.0428, device='cuda:0') (tensor(483.9242, device='cuda:0')) | > loss_gen: 2.1821937561035156 (2.264344996876187) | > loss_kl: 0.6224824786186218 (0.7260721623897552) | > loss_feat: 2.9915754795074463 (5.020658964912097) | > loss_mel: 19.644378662109375 (17.60689483748542) | > loss_duration: 1.347798466682434 (1.3843417035208807) | > loss_1: 26.788429260253906 (27.00231303109063) | > grad_norm_1: tensor(4441.5103, device='cuda:0') (tensor(27634.3066, device='cuda:0')) | > current_lr_0: 8.454327636251784e-05 | > current_lr_1: 8.454327636251784e-05 | > step_time: 0.3484 (0.5441595183478461) | > loader_time: 0.0199 (0.01625302102830675)  --> TIME: 2023-10-20 10:19:25 -- STEP: 39/50 -- GLOBAL_STEP: 96090 | > loss_disc: 2.66487979888916 (2.5578919526858206) | > loss_disc_real_0: 0.020700983703136444 (0.15210817596660212) | > loss_disc_real_1: 0.05057956278324127 (0.22687915559762564) | > loss_disc_real_2: 0.0545492097735405 (0.22859925757615995) | > loss_disc_real_3: 0.062051884829998016 (0.23133347388834524) | > loss_disc_real_4: 0.04102868586778641 (0.25401739900310827) | > loss_disc_real_5: 0.0026448245625942945 (0.2462252929317168) | > loss_0: 2.66487979888916 (2.5578919526858206) | > grad_norm_0: tensor(864.3102, device='cuda:0') (tensor(526.1373, device='cuda:0')) | > loss_gen: 1.5661089420318604 (2.1781274477640786) | > loss_kl: 0.40084558725357056 (0.78279265608543) | > loss_feat: 9.67356014251709 (4.692051249102522) | > loss_mel: 28.865737915039062 (18.49541898262807) | > loss_duration: 1.4521424770355225 (1.3675930897394817) | > loss_1: 41.95839309692383 (27.515983422597248) | > grad_norm_1: tensor(58991.6641, device='cuda:0') (tensor(21572.8828, device='cuda:0')) | > current_lr_0: 8.454327636251784e-05 | > current_lr_1: 8.454327636251784e-05 | > step_time: 0.4414 (0.6069339238680326) | > loader_time: 0.0248 (0.02070937401209122)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3568108081817627 (2.3568108081817627) | > loss_disc_real_0: 0.25711750984191895 (0.25711750984191895) | > loss_disc_real_1: 0.24358873069286346 (0.24358873069286346) | > loss_disc_real_2: 0.16060055792331696 (0.16060055792331696) | > loss_disc_real_3: 0.23360054194927216 (0.23360054194927216) | > loss_disc_real_4: 0.20538541674613953 (0.20538541674613953) | > loss_disc_real_5: 0.26498159766197205 (0.26498159766197205) | > loss_0: 2.3568108081817627 (2.3568108081817627) | > loss_gen: 2.5197505950927734 (2.5197505950927734) | > loss_kl: 4.952950477600098 (4.952950477600098) | > loss_feat: 5.1110639572143555 (5.1110639572143555) | > loss_mel: 26.538076400756836 (26.538076400756836) | > loss_duration: 2.8866708278656006 (2.8866708278656006) | > loss_1: 42.00851058959961 (42.00851058959961)  --> STEP: 1 | > loss_disc: 2.5669913291931152 (2.5669913291931152) | > loss_disc_real_0: 0.285524845123291 (0.285524845123291) | > loss_disc_real_1: 0.35442614555358887 (0.35442614555358887) | > loss_disc_real_2: 0.24285511672496796 (0.24285511672496796) | > loss_disc_real_3: 0.21701841056346893 (0.21701841056346893) | > loss_disc_real_4: 0.1830352544784546 (0.1830352544784546) | > loss_disc_real_5: 0.3725145161151886 (0.3725145161151886) | > loss_0: 2.5669913291931152 (2.5669913291931152) | > loss_gen: 2.868978977203369 (2.868978977203369) | > loss_kl: 5.12697172164917 (5.12697172164917) | > loss_feat: 4.748091220855713 (4.748091220855713) | > loss_mel: 23.316064834594727 (23.316064834594727) | > loss_duration: 3.3251538276672363 (3.3251538276672363) | > loss_1: 39.38526153564453 (39.38526153564453)  --> STEP: 2 | > loss_disc: 3.5208613872528076 (3.0439263582229614) | > loss_disc_real_0: 0.8236234188079834 (0.5545741319656372) | > loss_disc_real_1: 0.3245926797389984 (0.33950941264629364) | > loss_disc_real_2: 0.3144598603248596 (0.2786574885249138) | > loss_disc_real_3: 0.36747804284095764 (0.2922482267022133) | > loss_disc_real_4: 0.28512269258499146 (0.23407897353172302) | > loss_disc_real_5: 0.46761325001716614 (0.42006388306617737) | > loss_0: 3.5208613872528076 (3.0439263582229614) | > loss_gen: 2.884286403656006 (2.8766326904296875) | > loss_kl: 5.715795516967773 (5.421383619308472) | > loss_feat: 4.027740955352783 (4.387916088104248) | > loss_mel: 27.159940719604492 (25.23800277709961) | > loss_duration: 3.1289548873901367 (3.2270543575286865) | > loss_1: 42.916717529296875 (41.1509895324707)  --> STEP: 3 | > loss_disc: 3.048156261444092 (3.0453363259633384) | > loss_disc_real_0: 0.22790847718715668 (0.44568558037281036) | > loss_disc_real_1: 0.3883587419986725 (0.3557925224304199) | > loss_disc_real_2: 0.29088693857192993 (0.2827339718739192) | > loss_disc_real_3: 0.380907267332077 (0.3218012402455012) | > loss_disc_real_4: 0.37196028232574463 (0.2800394097963969) | > loss_disc_real_5: 0.335929811000824 (0.39201919237772626) | > loss_0: 3.048156261444092 (3.0453363259633384) | > loss_gen: 2.1653964519500732 (2.639553944269816) | > loss_kl: 2.3511247634887695 (4.397964000701904) | > loss_feat: 2.5646891593933105 (3.7801737785339355) | > loss_mel: 18.911951065063477 (23.129318873087566) | > loss_duration: 2.9362313747406006 (3.130113363265991) | > loss_1: 28.929391860961914 (37.07712364196777) --> EVAL PERFORMANCE | > avg_loader_time: 0.017261505126953125 (+0.014760653177897135) | > avg_loss_disc: 3.0453363259633384 (+0.17331886291503906) | > avg_loss_disc_real_0: 0.44568558037281036 (+0.16943885385990143) | > avg_loss_disc_real_1: 0.3557925224304199 (+0.0910831292470296) | > avg_loss_disc_real_2: 0.2827339718739192 (-0.047921523451805115) | > avg_loss_disc_real_3: 0.3218012402455012 (-0.03409634530544281) | > avg_loss_disc_real_4: 0.2800394097963969 (-0.09833217660586036) | > avg_loss_disc_real_5: 0.39201919237772626 (+0.01924675703048706) | > avg_loss_0: 3.0453363259633384 (+0.17331886291503906) | > avg_loss_gen: 2.639553944269816 (+0.011472622553507339) | > avg_loss_kl: 4.397964000701904 (+0.04549527168273926) | > avg_loss_feat: 3.7801737785339355 (-0.9971040089925127) | > avg_loss_mel: 23.129318873087566 (+5.279524803161621) | > avg_loss_duration: 3.130113363265991 (-0.009194215138753403) | > avg_loss_1: 37.07712364196777 (+4.330193837483726)  > EPOCH: 862/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:19:44)   --> TIME: 2023-10-20 10:19:59 -- STEP: 19/50 -- GLOBAL_STEP: 96120 | > loss_disc: 1.407718539237976 (2.6186294555664062) | > loss_disc_real_0: 0.06272625923156738 (0.1777611704249131) | > loss_disc_real_1: 0.036649785935878754 (0.23183974427612206) | > loss_disc_real_2: 0.07207790017127991 (0.245653623813077) | > loss_disc_real_3: 0.014439597725868225 (0.234250560795006) | > loss_disc_real_4: 0.06793577969074249 (0.23255676305607745) | > loss_disc_real_5: 0.06256286054849625 (0.27739958504312917) | > loss_0: 1.407718539237976 (2.6186294555664062) | > grad_norm_0: tensor(417.8833, device='cuda:0') (tensor(705.5599, device='cuda:0')) | > loss_gen: 2.5625929832458496 (2.139485378014414) | > loss_kl: 0.9591798186302185 (0.9850987478306419) | > loss_feat: 12.796072006225586 (4.519091582219851) | > loss_mel: 24.075014114379883 (18.40847561861339) | > loss_duration: 1.4742274284362793 (1.4155442275499042) | > loss_1: 41.86708450317383 (27.467695913816755) | > grad_norm_1: tensor(46800.1328, device='cuda:0') (tensor(17350.2109, device='cuda:0')) | > current_lr_0: 8.445877006459321e-05 | > current_lr_1: 8.445877006459321e-05 | > step_time: 0.4881 (0.5456445091649106) | > loader_time: 0.0201 (0.017401532122963352)  --> TIME: 2023-10-20 10:20:21 -- STEP: 49/50 -- GLOBAL_STEP: 96150 | > loss_disc: 2.5165486335754395 (2.5445757861040077) | > loss_disc_real_0: 0.0527835488319397 (0.1589025705292517) | > loss_disc_real_1: 0.29417791962623596 (0.22073951690476767) | > loss_disc_real_2: 0.14657054841518402 (0.23749351623106976) | > loss_disc_real_3: 0.265792578458786 (0.23924315507922853) | > loss_disc_real_4: 0.25100773572921753 (0.22994824333534558) | > loss_disc_real_5: 0.23452848196029663 (0.2400516970653315) | > loss_0: 2.5165486335754395 (2.5445757861040077) | > grad_norm_0: tensor(806.9745, device='cuda:0') (tensor(593.8691, device='cuda:0')) | > loss_gen: 1.9270744323730469 (2.178462862968445) | > loss_kl: 0.8201104998588562 (0.9270204986844744) | > loss_feat: 1.9626615047454834 (4.9617672242528315) | > loss_mel: 24.725086212158203 (19.475087473587113) | > loss_duration: 1.4951099157333374 (1.3669839014812393) | > loss_1: 30.930042266845703 (28.90932220342208) | > grad_norm_1: tensor(6335.3481, device='cuda:0') (tensor(17633.1484, device='cuda:0')) | > current_lr_0: 8.445877006459321e-05 | > current_lr_1: 8.445877006459321e-05 | > step_time: 0.9402 (0.6281412037051453) | > loader_time: 0.8538 (0.03531315375347527)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9152522087097168 (1.9152522087097168) | > loss_disc_real_0: 0.1430976241827011 (0.1430976241827011) | > loss_disc_real_1: 0.20461173355579376 (0.20461173355579376) | > loss_disc_real_2: 0.18853962421417236 (0.18853962421417236) | > loss_disc_real_3: 0.16867287456989288 (0.16867287456989288) | > loss_disc_real_4: 0.086082823574543 (0.086082823574543) | > loss_disc_real_5: 0.07508628815412521 (0.07508628815412521) | > loss_0: 1.9152522087097168 (1.9152522087097168) | > loss_gen: 2.2952988147735596 (2.2952988147735596) | > loss_kl: 5.927954196929932 (5.927954196929932) | > loss_feat: 7.940590858459473 (7.940590858459473) | > loss_mel: 21.600357055664062 (21.600357055664062) | > loss_duration: 2.8945069313049316 (2.8945069313049316) | > loss_1: 40.65871047973633 (40.65871047973633)  --> STEP: 1 | > loss_disc: 2.3078372478485107 (2.3078372478485107) | > loss_disc_real_0: 0.16399113833904266 (0.16399113833904266) | > loss_disc_real_1: 0.11204417794942856 (0.11204417794942856) | > loss_disc_real_2: 0.2894153594970703 (0.2894153594970703) | > loss_disc_real_3: 0.12753134965896606 (0.12753134965896606) | > loss_disc_real_4: 0.08477283269166946 (0.08477283269166946) | > loss_disc_real_5: 0.10621819645166397 (0.10621819645166397) | > loss_0: 2.3078372478485107 (2.3078372478485107) | > loss_gen: 2.212644100189209 (2.212644100189209) | > loss_kl: 5.194414138793945 (5.194414138793945) | > loss_feat: 7.281935214996338 (7.281935214996338) | > loss_mel: 24.28034210205078 (24.28034210205078) | > loss_duration: 3.4701943397521973 (3.4701943397521973) | > loss_1: 42.43952941894531 (42.43952941894531)  --> STEP: 2 | > loss_disc: 1.6317493915557861 (1.9697933197021484) | > loss_disc_real_0: 0.08952555060386658 (0.12675834447145462) | > loss_disc_real_1: 0.13513612747192383 (0.1235901527106762) | > loss_disc_real_2: 0.2733193635940552 (0.28136736154556274) | > loss_disc_real_3: 0.21456696093082428 (0.17104915529489517) | > loss_disc_real_4: 0.2129831165075302 (0.14887797459959984) | > loss_disc_real_5: 0.07759463042020798 (0.09190641343593597) | > loss_0: 1.6317493915557861 (1.9697933197021484) | > loss_gen: 3.7484323978424072 (2.980538249015808) | > loss_kl: 5.572920799255371 (5.383667469024658) | > loss_feat: 10.964225769042969 (9.123080492019653) | > loss_mel: 31.78647232055664 (28.03340721130371) | > loss_duration: 3.1906847953796387 (3.330439567565918) | > loss_1: 55.26273727416992 (48.85113334655762)  --> STEP: 3 | > loss_disc: 2.2174580097198486 (2.0523482163747153) | > loss_disc_real_0: 0.29728198051452637 (0.18359955648581186) | > loss_disc_real_1: 0.350495845079422 (0.19922538350025812) | > loss_disc_real_2: 0.21841521561145782 (0.2603833129008611) | > loss_disc_real_3: 0.17815923690795898 (0.17341918249924979) | > loss_disc_real_4: 0.12899407744407654 (0.14225000888109207) | > loss_disc_real_5: 0.10980964452028275 (0.09787415713071823) | > loss_0: 2.2174580097198486 (2.0523482163747153) | > loss_gen: 2.4800593852996826 (2.813711961110433) | > loss_kl: 2.4984774589538574 (4.421937465667725) | > loss_feat: 5.285965919494629 (7.8440423011779785) | > loss_mel: 21.188549041748047 (25.751787821451824) | > loss_duration: 2.9557204246520996 (3.205533186594645) | > loss_1: 34.40877151489258 (44.0370127360026) --> EVAL PERFORMANCE | > avg_loader_time: 0.0451958974202474 (+0.027934392293294273) | > avg_loss_disc: 2.0523482163747153 (-0.992988109588623) | > avg_loss_disc_real_0: 0.18359955648581186 (-0.26208602388699853) | > avg_loss_disc_real_1: 0.19922538350025812 (-0.1565671389301618) | > avg_loss_disc_real_2: 0.2603833129008611 (-0.022350658973058102) | > avg_loss_disc_real_3: 0.17341918249924979 (-0.14838205774625143) | > avg_loss_disc_real_4: 0.14225000888109207 (-0.13778940091530484) | > avg_loss_disc_real_5: 0.09787415713071823 (-0.294145035247008) | > avg_loss_0: 2.0523482163747153 (-0.992988109588623) | > avg_loss_gen: 2.813711961110433 (+0.17415801684061716) | > avg_loss_kl: 4.421937465667725 (+0.023973464965820312) | > avg_loss_feat: 7.8440423011779785 (+4.063868522644043) | > avg_loss_mel: 25.751787821451824 (+2.622468948364258) | > avg_loss_duration: 3.205533186594645 (+0.07541982332865382) | > avg_loss_1: 44.0370127360026 (+6.959889094034828)  > EPOCH: 863/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:20:34)   --> TIME: 2023-10-20 10:20:58 -- STEP: 29/50 -- GLOBAL_STEP: 96180 | > loss_disc: 2.873002529144287 (2.485064033804268) | > loss_disc_real_0: 0.18894286453723907 (0.14960240697937793) | > loss_disc_real_1: 0.25252774357795715 (0.2367361157104887) | > loss_disc_real_2: 0.2327275425195694 (0.22498788813064838) | > loss_disc_real_3: 0.23514702916145325 (0.2386819391415037) | > loss_disc_real_4: 0.2405308037996292 (0.22541075951323428) | > loss_disc_real_5: 0.24632036685943604 (0.23174508982177439) | > loss_0: 2.873002529144287 (2.485064033804268) | > grad_norm_0: tensor(381.6416, device='cuda:0') (tensor(651.1650, device='cuda:0')) | > loss_gen: 1.5510056018829346 (2.2834041653008295) | > loss_kl: 1.1679774522781372 (0.784952856343368) | > loss_feat: 0.3635648190975189 (4.777245534519697) | > loss_mel: 12.958683967590332 (21.586958001399857) | > loss_duration: 1.3652091026306152 (1.383618687761241) | > loss_1: 17.406442642211914 (30.816179291955358) | > grad_norm_1: tensor(10165.6982, device='cuda:0') (tensor(18716.1523, device='cuda:0')) | > current_lr_0: 8.437434823600426e-05 | > current_lr_1: 8.437434823600426e-05 | > step_time: 0.8209 (0.6061015540155871) | > loader_time: 0.0081 (0.02038057097073259)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.430230140686035 (2.430230140686035) | > loss_disc_real_0: 0.24865630269050598 (0.24865630269050598) | > loss_disc_real_1: 0.25845688581466675 (0.25845688581466675) | > loss_disc_real_2: 0.08817106485366821 (0.08817106485366821) | > loss_disc_real_3: 0.27614957094192505 (0.27614957094192505) | > loss_disc_real_4: 0.17428234219551086 (0.17428234219551086) | > loss_disc_real_5: 0.1462615728378296 (0.1462615728378296) | > loss_0: 2.430230140686035 (2.430230140686035) | > loss_gen: 2.0163626670837402 (2.0163626670837402) | > loss_kl: 5.7908172607421875 (5.7908172607421875) | > loss_feat: 3.315101146697998 (3.315101146697998) | > loss_mel: 21.78780174255371 (21.78780174255371) | > loss_duration: 2.982586622238159 (2.982586622238159) | > loss_1: 35.892669677734375 (35.892669677734375)  --> STEP: 1 | > loss_disc: 2.625227928161621 (2.625227928161621) | > loss_disc_real_0: 0.17306077480316162 (0.17306077480316162) | > loss_disc_real_1: 0.25714659690856934 (0.25714659690856934) | > loss_disc_real_2: 0.2847053110599518 (0.2847053110599518) | > loss_disc_real_3: 0.32475268840789795 (0.32475268840789795) | > loss_disc_real_4: 0.31823745369911194 (0.31823745369911194) | > loss_disc_real_5: 0.379904568195343 (0.379904568195343) | > loss_0: 2.625227928161621 (2.625227928161621) | > loss_gen: 2.7735042572021484 (2.7735042572021484) | > loss_kl: 4.610672473907471 (4.610672473907471) | > loss_feat: 6.633105754852295 (6.633105754852295) | > loss_mel: 23.264162063598633 (23.264162063598633) | > loss_duration: 3.1456046104431152 (3.1456046104431152) | > loss_1: 40.42705154418945 (40.42705154418945)  --> STEP: 2 | > loss_disc: 2.7842087745666504 (2.7047183513641357) | > loss_disc_real_0: 0.17102909088134766 (0.17204493284225464) | > loss_disc_real_1: 0.45078912377357483 (0.3539678603410721) | > loss_disc_real_2: 0.2213040590286255 (0.25300468504428864) | > loss_disc_real_3: 0.21423089504241943 (0.2694917917251587) | > loss_disc_real_4: 0.2908128499984741 (0.30452515184879303) | > loss_disc_real_5: 0.32442694902420044 (0.35216575860977173) | > loss_0: 2.7842087745666504 (2.7047183513641357) | > loss_gen: 2.4527764320373535 (2.613140344619751) | > loss_kl: 5.387741565704346 (4.999207019805908) | > loss_feat: 8.77502727508545 (7.704066514968872) | > loss_mel: 24.938570022583008 (24.10136604309082) | > loss_duration: 3.0561001300811768 (3.100852370262146) | > loss_1: 44.6102180480957 (42.51863479614258)  --> STEP: 3 | > loss_disc: 2.5121915340423584 (2.64054274559021) | > loss_disc_real_0: 0.3259538412094116 (0.22334790229797363) | > loss_disc_real_1: 0.23041269183158875 (0.3127828041712443) | > loss_disc_real_2: 0.2639579772949219 (0.2566557824611664) | > loss_disc_real_3: 0.2007392942905426 (0.24657429258028665) | > loss_disc_real_4: 0.3508329391479492 (0.3199610809485118) | > loss_disc_real_5: 0.3415985107421875 (0.34864334265391034) | > loss_0: 2.5121915340423584 (2.64054274559021) | > loss_gen: 2.705838441848755 (2.6440397103627524) | > loss_kl: 2.2444095611572266 (4.080941200256348) | > loss_feat: 4.302912712097168 (6.570348580678304) | > loss_mel: 21.231040954589844 (23.144591013590496) | > loss_duration: 2.948765993118286 (3.050156911214193) | > loss_1: 33.43296813964844 (39.49007924397787) --> EVAL PERFORMANCE | > avg_loader_time: 0.017591079076131184 (-0.027604818344116214) | > avg_loss_disc: 2.64054274559021 (+0.5881945292154946) | > avg_loss_disc_real_0: 0.22334790229797363 (+0.03974834581216177) | > avg_loss_disc_real_1: 0.3127828041712443 (+0.1135574206709862) | > avg_loss_disc_real_2: 0.2566557824611664 (-0.003727530439694704) | > avg_loss_disc_real_3: 0.24657429258028665 (+0.07315511008103687) | > avg_loss_disc_real_4: 0.3199610809485118 (+0.1777110720674197) | > avg_loss_disc_real_5: 0.34864334265391034 (+0.2507691855231921) | > avg_loss_0: 2.64054274559021 (+0.5881945292154946) | > avg_loss_gen: 2.6440397103627524 (-0.16967225074768066) | > avg_loss_kl: 4.080941200256348 (-0.34099626541137695) | > avg_loss_feat: 6.570348580678304 (-1.2736937204996748) | > avg_loss_mel: 23.144591013590496 (-2.607196807861328) | > avg_loss_duration: 3.050156911214193 (-0.15537627538045218) | > avg_loss_1: 39.49007924397787 (-4.546933492024735)  > EPOCH: 864/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:21:27)   --> TIME: 2023-10-20 10:21:38 -- STEP: 9/50 -- GLOBAL_STEP: 96210 | > loss_disc: 2.624431610107422 (2.388853735393948) | > loss_disc_real_0: 0.07751569151878357 (0.12279655411839485) | > loss_disc_real_1: 0.20451335608959198 (0.2193749240703053) | > loss_disc_real_2: 0.16383691132068634 (0.21787783172395495) | > loss_disc_real_3: 0.17546473443508148 (0.21572126862075594) | > loss_disc_real_4: 0.12666262686252594 (0.2275076061487198) | > loss_disc_real_5: 0.10128245502710342 (0.19841879854599634) | > loss_0: 2.624431610107422 (2.388853735393948) | > grad_norm_0: tensor(1593.9005, device='cuda:0') (tensor(781.7971, device='cuda:0')) | > loss_gen: 1.5377482175827026 (2.289828724331326) | > loss_kl: 0.5185901522636414 (0.771703850891855) | > loss_feat: 3.1881377696990967 (5.666216876771715) | > loss_mel: 15.68971061706543 (19.94093174404568) | > loss_duration: 1.321860909461975 (1.3792390425999959) | > loss_1: 22.25604820251465 (30.04791980319553) | > grad_norm_1: tensor(6545.3452, device='cuda:0') (tensor(22354.4082, device='cuda:0')) | > current_lr_0: 8.429001079231856e-05 | > current_lr_1: 8.429001079231856e-05 | > step_time: 0.7158 (0.6203758716583252) | > loader_time: 0.027 (0.026637024349636503)  --> TIME: 2023-10-20 10:21:51 -- STEP: 39/50 -- GLOBAL_STEP: 96240 | > loss_disc: 2.5022544860839844 (2.4295941744095235) | > loss_disc_real_0: 0.11686185747385025 (0.15484256540926603) | > loss_disc_real_1: 0.22892019152641296 (0.22306078538680688) | > loss_disc_real_2: 0.1707184910774231 (0.2317153845842068) | > loss_disc_real_3: 0.37600287795066833 (0.23744814078777265) | > loss_disc_real_4: 0.24760808050632477 (0.21249638894238534) | > loss_disc_real_5: 0.296091765165329 (0.2361090549100668) | > loss_0: 2.5022544860839844 (2.4295941744095235) | > grad_norm_0: tensor(745.8998, device='cuda:0') (tensor(617.8308, device='cuda:0')) | > loss_gen: 2.357206344604492 (2.3372850662622695) | > loss_kl: 0.7135159373283386 (0.7782529550485122) | > loss_feat: 3.8804869651794434 (5.52632461163478) | > loss_mel: 20.3543758392334 (20.89959523005363) | > loss_duration: 1.4367077350616455 (1.365037141702114) | > loss_1: 28.742294311523438 (30.90649443406325) | > grad_norm_1: tensor(11251.4336, device='cuda:0') (tensor(19243.3164, device='cuda:0')) | > current_lr_0: 8.429001079231856e-05 | > current_lr_1: 8.429001079231856e-05 | > step_time: 0.3755 (0.46590015215751446) | > loader_time: 0.0025 (0.012212056380051833)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.101637363433838 (2.101637363433838) | > loss_disc_real_0: 0.15050676465034485 (0.15050676465034485) | > loss_disc_real_1: 0.29221174120903015 (0.29221174120903015) | > loss_disc_real_2: 0.26206091046333313 (0.26206091046333313) | > loss_disc_real_3: 0.25785917043685913 (0.25785917043685913) | > loss_disc_real_4: 0.21340131759643555 (0.21340131759643555) | > loss_disc_real_5: 0.1545107364654541 (0.1545107364654541) | > loss_0: 2.101637363433838 (2.101637363433838) | > loss_gen: 2.9179365634918213 (2.9179365634918213) | > loss_kl: 5.288904666900635 (5.288904666900635) | > loss_feat: 7.582833766937256 (7.582833766937256) | > loss_mel: 21.514616012573242 (21.514616012573242) | > loss_duration: 3.053642511367798 (3.053642511367798) | > loss_1: 40.357933044433594 (40.357933044433594)  --> STEP: 1 | > loss_disc: 2.31303334236145 (2.31303334236145) | > loss_disc_real_0: 0.11830467730760574 (0.11830467730760574) | > loss_disc_real_1: 0.2428002506494522 (0.2428002506494522) | > loss_disc_real_2: 0.32032835483551025 (0.32032835483551025) | > loss_disc_real_3: 0.2644040286540985 (0.2644040286540985) | > loss_disc_real_4: 0.21060585975646973 (0.21060585975646973) | > loss_disc_real_5: 0.3188931345939636 (0.3188931345939636) | > loss_0: 2.31303334236145 (2.31303334236145) | > loss_gen: 2.7522430419921875 (2.7522430419921875) | > loss_kl: 5.164736747741699 (5.164736747741699) | > loss_feat: 7.7922797203063965 (7.7922797203063965) | > loss_mel: 24.47834587097168 (24.47834587097168) | > loss_duration: 3.363922595977783 (3.363922595977783) | > loss_1: 43.55152893066406 (43.55152893066406)  --> STEP: 2 | > loss_disc: 2.089383363723755 (2.2012083530426025) | > loss_disc_real_0: 0.09390242397785187 (0.1061035506427288) | > loss_disc_real_1: 0.30579015612602234 (0.2742952033877373) | > loss_disc_real_2: 0.25207218527793884 (0.28620027005672455) | > loss_disc_real_3: 0.3635779321193695 (0.313990980386734) | > loss_disc_real_4: 0.19580848515033722 (0.20320717245340347) | > loss_disc_real_5: 0.28494784235954285 (0.30192048847675323) | > loss_0: 2.089383363723755 (2.2012083530426025) | > loss_gen: 3.530073404312134 (3.1411582231521606) | > loss_kl: 5.333805561065674 (5.2492711544036865) | > loss_feat: 8.535143852233887 (8.163711786270142) | > loss_mel: 22.8035831451416 (23.64096450805664) | > loss_duration: 3.169421434402466 (3.2666720151901245) | > loss_1: 43.37202835083008 (43.46177864074707)  --> STEP: 3 | > loss_disc: 2.9791712760925293 (2.460529327392578) | > loss_disc_real_0: 0.28060799837112427 (0.16427169988552728) | > loss_disc_real_1: 0.34561288356781006 (0.29806776344776154) | > loss_disc_real_2: 0.3205823302268982 (0.2976609567801158) | > loss_disc_real_3: 0.2838071882724762 (0.30392971634864807) | > loss_disc_real_4: 0.41182100772857666 (0.27274511754512787) | > loss_disc_real_5: 0.43721553683280945 (0.347018837928772) | > loss_0: 2.9791712760925293 (2.460529327392578) | > loss_gen: 2.478463649749756 (2.920260032018026) | > loss_kl: 2.5925090312957764 (4.363683780034383) | > loss_feat: 2.7326717376708984 (6.3533651034037275) | > loss_mel: 19.66996192932129 (22.317296981811523) | > loss_duration: 3.021578073501587 (3.184974034627279) | > loss_1: 30.49518585205078 (39.139581044514976) --> EVAL PERFORMANCE | > avg_loader_time: 0.006549994150797526 (-0.011041084925333657) | > avg_loss_disc: 2.460529327392578 (-0.18001341819763184) | > avg_loss_disc_real_0: 0.16427169988552728 (-0.05907620241244635) | > avg_loss_disc_real_1: 0.29806776344776154 (-0.014715040723482786) | > avg_loss_disc_real_2: 0.2976609567801158 (+0.0410051743189494) | > avg_loss_disc_real_3: 0.30392971634864807 (+0.05735542376836142) | > avg_loss_disc_real_4: 0.27274511754512787 (-0.04721596340338391) | > avg_loss_disc_real_5: 0.347018837928772 (-0.0016245047251383649) | > avg_loss_0: 2.460529327392578 (-0.18001341819763184) | > avg_loss_gen: 2.920260032018026 (+0.27622032165527344) | > avg_loss_kl: 4.363683780034383 (+0.2827425797780352) | > avg_loss_feat: 6.3533651034037275 (-0.21698347727457623) | > avg_loss_mel: 22.317296981811523 (-0.8272940317789725) | > avg_loss_duration: 3.184974034627279 (+0.13481712341308594) | > avg_loss_1: 39.139581044514976 (-0.3504981994628906)  > EPOCH: 865/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:22:14)   --> TIME: 2023-10-20 10:22:30 -- STEP: 19/50 -- GLOBAL_STEP: 96270 | > loss_disc: 1.8895341157913208 (2.424716635754234) | > loss_disc_real_0: 0.06575827300548553 (0.12755362885562996) | > loss_disc_real_1: 0.2402396947145462 (0.23317136831189456) | > loss_disc_real_2: 0.15132518112659454 (0.21690722275525331) | > loss_disc_real_3: 0.2263142615556717 (0.25033419814548996) | > loss_disc_real_4: 0.12965169548988342 (0.24063406355286898) | > loss_disc_real_5: 0.2397308498620987 (0.27076935366188226) | > loss_0: 1.8895341157913208 (2.424716635754234) | > grad_norm_0: tensor(785.4830, device='cuda:0') (tensor(551.8336, device='cuda:0')) | > loss_gen: 2.7252817153930664 (2.4827894662555896) | > loss_kl: 0.8686901926994324 (0.8586101563353288) | > loss_feat: 8.774575233459473 (5.954103905903666) | > loss_mel: 23.711090087890625 (22.72949309098093) | > loss_duration: 1.515147089958191 (1.4101446929730868) | > loss_1: 37.594783782958984 (33.43514151322214) | > grad_norm_1: tensor(64204.2891, device='cuda:0') (tensor(23982.1094, device='cuda:0')) | > current_lr_0: 8.420575764918814e-05 | > current_lr_1: 8.420575764918814e-05 | > step_time: 0.5559 (0.6099337778593364) | > loader_time: 0.019 (0.021099755638524106)  --> TIME: 2023-10-20 10:22:49 -- STEP: 49/50 -- GLOBAL_STEP: 96300 | > loss_disc: 2.246400833129883 (2.3675550076426286) | > loss_disc_real_0: 0.12422885000705719 (0.1309312269357698) | > loss_disc_real_1: 0.14502322673797607 (0.22764167356856016) | > loss_disc_real_2: 0.24500611424446106 (0.2203785326826025) | > loss_disc_real_3: 0.2471272498369217 (0.2267299141658812) | > loss_disc_real_4: 0.2242269665002823 (0.22293855991138486) | > loss_disc_real_5: 0.10830525308847427 (0.23843790716206548) | > loss_0: 2.246400833129883 (2.3675550076426286) | > grad_norm_0: tensor(639.4603, device='cuda:0') (tensor(570.7003, device='cuda:0')) | > loss_gen: 2.3032729625701904 (2.397194198199681) | > loss_kl: 0.8240311145782471 (0.7917638335909162) | > loss_feat: 6.676786422729492 (5.440167678710152) | > loss_mel: 22.681411743164062 (20.664958691110414) | > loss_duration: 1.4629472494125366 (1.372032717782624) | > loss_1: 33.948448181152344 (30.666116996687293) | > grad_norm_1: tensor(9314.2773, device='cuda:0') (tensor(20673.6836, device='cuda:0')) | > current_lr_0: 8.420575764918814e-05 | > current_lr_1: 8.420575764918814e-05 | > step_time: 0.5944 (0.5976091793605258) | > loader_time: 0.4737 (0.03136906331899214)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9938578605651855 (2.9938578605651855) | > loss_disc_real_0: 0.17716209590435028 (0.17716209590435028) | > loss_disc_real_1: 0.21987265348434448 (0.21987265348434448) | > loss_disc_real_2: 0.29267317056655884 (0.29267317056655884) | > loss_disc_real_3: 0.23749606311321259 (0.23749606311321259) | > loss_disc_real_4: 0.2964009642601013 (0.2964009642601013) | > loss_disc_real_5: 0.2681810259819031 (0.2681810259819031) | > loss_0: 2.9938578605651855 (2.9938578605651855) | > loss_gen: 1.513322114944458 (1.513322114944458) | > loss_kl: 4.535019874572754 (4.535019874572754) | > loss_feat: 0.12771911919116974 (0.12771911919116974) | > loss_mel: 5.1056413650512695 (5.1056413650512695) | > loss_duration: 2.985320568084717 (2.985320568084717) | > loss_1: 14.267023086547852 (14.267023086547852)  --> STEP: 1 | > loss_disc: 2.557447910308838 (2.557447910308838) | > loss_disc_real_0: 0.15183871984481812 (0.15183871984481812) | > loss_disc_real_1: 0.2200094312429428 (0.2200094312429428) | > loss_disc_real_2: 0.262643426656723 (0.262643426656723) | > loss_disc_real_3: 0.3092857599258423 (0.3092857599258423) | > loss_disc_real_4: 0.29419803619384766 (0.29419803619384766) | > loss_disc_real_5: 0.2577180862426758 (0.2577180862426758) | > loss_0: 2.557447910308838 (2.557447910308838) | > loss_gen: 2.435778856277466 (2.435778856277466) | > loss_kl: 5.121309280395508 (5.121309280395508) | > loss_feat: 2.5763862133026123 (2.5763862133026123) | > loss_mel: 21.7122745513916 (21.7122745513916) | > loss_duration: 3.4040026664733887 (3.4040026664733887) | > loss_1: 35.249752044677734 (35.249752044677734)  --> STEP: 2 | > loss_disc: 3.0398361682891846 (2.7986420392990112) | > loss_disc_real_0: 0.28975892066955566 (0.2207988202571869) | > loss_disc_real_1: 0.365731805562973 (0.2928706184029579) | > loss_disc_real_2: 0.44197383522987366 (0.35230863094329834) | > loss_disc_real_3: 0.31654518842697144 (0.31291547417640686) | > loss_disc_real_4: 0.4238172471523285 (0.3590076416730881) | > loss_disc_real_5: 0.29940277338027954 (0.27856042981147766) | > loss_0: 3.0398361682891846 (2.7986420392990112) | > loss_gen: 2.484748363494873 (2.4602636098861694) | > loss_kl: 5.281641006469727 (5.201475143432617) | > loss_feat: 3.210721492767334 (2.893553853034973) | > loss_mel: 25.65955352783203 (23.685914039611816) | > loss_duration: 3.198972702026367 (3.301487684249878) | > loss_1: 39.83563995361328 (37.54269599914551)  --> STEP: 3 | > loss_disc: 2.6890861988067627 (2.762123425801595) | > loss_disc_real_0: 0.3159629702568054 (0.25252020359039307) | > loss_disc_real_1: 0.2992764711380005 (0.2950059026479721) | > loss_disc_real_2: 0.2581225633621216 (0.32091327508290607) | > loss_disc_real_3: 0.2126646339893341 (0.2794985274473826) | > loss_disc_real_4: 0.2894943654537201 (0.3358365495999654) | > loss_disc_real_5: 0.31351491808891296 (0.2902119259039561) | > loss_0: 2.6890861988067627 (2.762123425801595) | > loss_gen: 2.2251083850860596 (2.3818785349527993) | > loss_kl: 2.6613762378692627 (4.354775508244832) | > loss_feat: 2.1701645851135254 (2.6524240970611572) | > loss_mel: 18.977243423461914 (22.116357167561848) | > loss_duration: 2.8822195529937744 (3.1617316404978433) | > loss_1: 28.916112899780273 (34.667168299357094) --> EVAL PERFORMANCE | > avg_loader_time: 0.021913925806681316 (+0.015363931655883789) | > avg_loss_disc: 2.762123425801595 (+0.3015940984090171) | > avg_loss_disc_real_0: 0.25252020359039307 (+0.08824850370486578) | > avg_loss_disc_real_1: 0.2950059026479721 (-0.0030618607997894287) | > avg_loss_disc_real_2: 0.32091327508290607 (+0.023252318302790287) | > avg_loss_disc_real_3: 0.2794985274473826 (-0.024431188901265444) | > avg_loss_disc_real_4: 0.3358365495999654 (+0.06309143205483753) | > avg_loss_disc_real_5: 0.2902119259039561 (-0.05680691202481586) | > avg_loss_0: 2.762123425801595 (+0.3015940984090171) | > avg_loss_gen: 2.3818785349527993 (-0.5383814970652265) | > avg_loss_kl: 4.354775508244832 (-0.008908271789550781) | > avg_loss_feat: 2.6524240970611572 (-3.7009410063425703) | > avg_loss_mel: 22.116357167561848 (-0.20093981424967566) | > avg_loss_duration: 3.1617316404978433 (-0.023242394129435517) | > avg_loss_1: 34.667168299357094 (-4.472412745157882)  > EPOCH: 866/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:23:04)   --> TIME: 2023-10-20 10:23:25 -- STEP: 29/50 -- GLOBAL_STEP: 96330 | > loss_disc: 2.6741552352905273 (2.359253168106079) | > loss_disc_real_0: 0.20346514880657196 (0.1390175911565793) | > loss_disc_real_1: 0.258807897567749 (0.2092693080676013) | > loss_disc_real_2: 0.26081809401512146 (0.2156353867773352) | > loss_disc_real_3: 0.2538553476333618 (0.2335350288656251) | > loss_disc_real_4: 0.2505561113357544 (0.21359949443360854) | > loss_disc_real_5: 0.23013734817504883 (0.21083940112770633) | > loss_0: 2.6741552352905273 (2.359253168106079) | > grad_norm_0: tensor(411.2093, device='cuda:0') (tensor(488.4868, device='cuda:0')) | > loss_gen: 1.8067976236343384 (2.428614090228903) | > loss_kl: 0.6352172493934631 (0.7759202230593254) | > loss_feat: 1.2844752073287964 (6.118095553833349) | > loss_mel: 16.229488372802734 (20.657249368470296) | > loss_duration: 1.3978791236877441 (1.3991786035998115) | > loss_1: 21.353857040405273 (31.37905790065897) | > grad_norm_1: tensor(3067.9817, device='cuda:0') (tensor(24379.0996, device='cuda:0')) | > current_lr_0: 8.412158872234932e-05 | > current_lr_1: 8.412158872234932e-05 | > step_time: 0.4417 (0.493532657623291) | > loader_time: 0.0265 (0.016995060032811662)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0927836894989014 (3.0927836894989014) | > loss_disc_real_0: 0.3588760197162628 (0.3588760197162628) | > loss_disc_real_1: 0.32229480147361755 (0.32229480147361755) | > loss_disc_real_2: 0.432584673166275 (0.432584673166275) | > loss_disc_real_3: 0.30163925886154175 (0.30163925886154175) | > loss_disc_real_4: 0.4665115475654602 (0.4665115475654602) | > loss_disc_real_5: 0.369340717792511 (0.369340717792511) | > loss_0: 3.0927836894989014 (3.0927836894989014) | > loss_gen: 2.7979798316955566 (2.7979798316955566) | > loss_kl: 4.628454685211182 (4.628454685211182) | > loss_feat: 5.470139026641846 (5.470139026641846) | > loss_mel: 20.245296478271484 (20.245296478271484) | > loss_duration: 2.948185920715332 (2.948185920715332) | > loss_1: 36.090057373046875 (36.090057373046875)  --> STEP: 1 | > loss_disc: 2.9727656841278076 (2.9727656841278076) | > loss_disc_real_0: 0.31393754482269287 (0.31393754482269287) | > loss_disc_real_1: 0.2508794367313385 (0.2508794367313385) | > loss_disc_real_2: 0.21257105469703674 (0.21257105469703674) | > loss_disc_real_3: 0.25269627571105957 (0.25269627571105957) | > loss_disc_real_4: 0.2619524598121643 (0.2619524598121643) | > loss_disc_real_5: 0.2572788894176483 (0.2572788894176483) | > loss_0: 2.9727656841278076 (2.9727656841278076) | > loss_gen: 1.6060824394226074 (1.6060824394226074) | > loss_kl: 4.394097328186035 (4.394097328186035) | > loss_feat: 0.14014337956905365 (0.14014337956905365) | > loss_mel: 10.12460708618164 (10.12460708618164) | > loss_duration: 3.3731322288513184 (3.3731322288513184) | > loss_1: 19.638063430786133 (19.638063430786133)  --> STEP: 2 | > loss_disc: 1.9028714895248413 (2.4378185868263245) | > loss_disc_real_0: 0.09403042495250702 (0.20398398488759995) | > loss_disc_real_1: 0.18164104223251343 (0.21626023948192596) | > loss_disc_real_2: 0.1909664422273636 (0.20176874846220016) | > loss_disc_real_3: 0.307943731546402 (0.2803200036287308) | > loss_disc_real_4: 0.2231617569923401 (0.2425571084022522) | > loss_disc_real_5: 0.16979633271694183 (0.21353761106729507) | > loss_0: 1.9028714895248413 (2.4378185868263245) | > loss_gen: 2.887303352355957 (2.2466928958892822) | > loss_kl: 5.500432968139648 (4.947265148162842) | > loss_feat: 7.052217483520508 (3.5961804315447807) | > loss_mel: 24.86995506286621 (17.497281074523926) | > loss_duration: 3.1350455284118652 (3.254088878631592) | > loss_1: 43.44495391845703 (31.541508674621582)  --> STEP: 3 | > loss_disc: 2.425165891647339 (2.4336010217666626) | > loss_disc_real_0: 0.09626451879739761 (0.16807749619086584) | > loss_disc_real_1: 0.3430245816707611 (0.25851502021153766) | > loss_disc_real_2: 0.33935627341270447 (0.24763125677903494) | > loss_disc_real_3: 0.26143959164619446 (0.2740265329678853) | > loss_disc_real_4: 0.2199021428823471 (0.2350054532289505) | > loss_disc_real_5: 0.17095960676670074 (0.19934494296709696) | > loss_0: 2.425165891647339 (2.4336010217666626) | > loss_gen: 3.199089527130127 (2.5641584396362305) | > loss_kl: 2.509025812149048 (4.13451870282491) | > loss_feat: 8.454909324645996 (5.215756729245186) | > loss_mel: 24.240686416625977 (19.74508285522461) | > loss_duration: 2.8831140995025635 (3.1304306189219155) | > loss_1: 41.28682327270508 (34.78994687398275) --> EVAL PERFORMANCE | > avg_loader_time: 0.011302947998046875 (-0.010610977808634441) | > avg_loss_disc: 2.4336010217666626 (-0.3285224040349326) | > avg_loss_disc_real_0: 0.16807749619086584 (-0.08444270739952722) | > avg_loss_disc_real_1: 0.25851502021153766 (-0.036490882436434446) | > avg_loss_disc_real_2: 0.24763125677903494 (-0.07328201830387113) | > avg_loss_disc_real_3: 0.2740265329678853 (-0.005471994479497311) | > avg_loss_disc_real_4: 0.2350054532289505 (-0.1008310963710149) | > avg_loss_disc_real_5: 0.19934494296709696 (-0.09086698293685916) | > avg_loss_0: 2.4336010217666626 (-0.3285224040349326) | > avg_loss_gen: 2.5641584396362305 (+0.18227990468343114) | > avg_loss_kl: 4.13451870282491 (-0.22025680541992188) | > avg_loss_feat: 5.215756729245186 (+2.5633326321840286) | > avg_loss_mel: 19.74508285522461 (-2.3712743123372384) | > avg_loss_duration: 3.1304306189219155 (-0.031301021575927734) | > avg_loss_1: 34.78994687398275 (+0.12277857462565578)  > EPOCH: 867/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:23:52)   --> TIME: 2023-10-20 10:24:03 -- STEP: 9/50 -- GLOBAL_STEP: 96360 | > loss_disc: 3.0060834884643555 (2.357314692603217) | > loss_disc_real_0: 0.17846187949180603 (0.12001043516728613) | > loss_disc_real_1: 0.3016827404499054 (0.21972206069363487) | > loss_disc_real_2: 0.3362845778465271 (0.2306438527173466) | > loss_disc_real_3: 0.2949009835720062 (0.27556290560298496) | > loss_disc_real_4: 0.23100875318050385 (0.23866569043861496) | > loss_disc_real_5: 0.31931060552597046 (0.20854225175248253) | > loss_0: 3.0060834884643555 (2.357314692603217) | > grad_norm_0: tensor(521.7712, device='cuda:0') (tensor(572.5784, device='cuda:0')) | > loss_gen: 1.851189136505127 (2.683259063296848) | > loss_kl: 0.9135887026786804 (0.8014713807238473) | > loss_feat: 2.3489251136779785 (7.081676483154297) | > loss_mel: 25.051416397094727 (23.49489360385471) | > loss_duration: 1.3301434516906738 (1.3928705188963149) | > loss_1: 31.495262145996094 (35.454170015123154) | > grad_norm_1: tensor(2830.5833, device='cuda:0') (tensor(30828.1875, device='cuda:0')) | > current_lr_0: 8.403750392762265e-05 | > current_lr_1: 8.403750392762265e-05 | > step_time: 0.6057 (0.5926791826883951) | > loader_time: 0.0058 (0.023426294326782227)  --> TIME: 2023-10-20 10:24:22 -- STEP: 39/50 -- GLOBAL_STEP: 96390 | > loss_disc: 2.7220799922943115 (2.592030763626099) | > loss_disc_real_0: 0.0831008031964302 (0.15860717662442952) | > loss_disc_real_1: 0.26226872205734253 (0.22734699446039322) | > loss_disc_real_2: 0.20534314215183258 (0.24626607495622752) | > loss_disc_real_3: 0.1744260936975479 (0.24638023628638342) | > loss_disc_real_4: 0.21472737193107605 (0.24962057240116295) | > loss_disc_real_5: 0.23364318907260895 (0.2594552025294457) | > loss_0: 2.7220799922943115 (2.592030763626099) | > grad_norm_0: tensor(1061.0012, device='cuda:0') (tensor(573.7788, device='cuda:0')) | > loss_gen: 1.710080862045288 (2.2387666641137542) | > loss_kl: 0.564736545085907 (0.8300198410183955) | > loss_feat: 3.0577526092529297 (5.219874361386666) | > loss_mel: 19.82729721069336 (19.94936925936968) | > loss_duration: 1.445576786994934 (1.3819464322848198) | > loss_1: 26.605445861816406 (29.619976288233048) | > grad_norm_1: tensor(3248.2878, device='cuda:0') (tensor(17458.0059, device='cuda:0')) | > current_lr_0: 8.403750392762265e-05 | > current_lr_1: 8.403750392762265e-05 | > step_time: 0.5633 (0.6185890405606) | > loader_time: 0.0054 (0.02494642062064929)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1144661903381348 (3.1144661903381348) | > loss_disc_real_0: 0.47846025228500366 (0.47846025228500366) | > loss_disc_real_1: 0.26448363065719604 (0.26448363065719604) | > loss_disc_real_2: 0.3687160909175873 (0.3687160909175873) | > loss_disc_real_3: 0.2793940305709839 (0.2793940305709839) | > loss_disc_real_4: 0.5422147512435913 (0.5422147512435913) | > loss_disc_real_5: 0.38759422302246094 (0.38759422302246094) | > loss_0: 3.1144661903381348 (3.1144661903381348) | > loss_gen: 2.9193472862243652 (2.9193472862243652) | > loss_kl: 5.894711971282959 (5.894711971282959) | > loss_feat: 5.243273735046387 (5.243273735046387) | > loss_mel: 20.96467399597168 (20.96467399597168) | > loss_duration: 3.1473100185394287 (3.1473100185394287) | > loss_1: 38.169315338134766 (38.169315338134766)  --> STEP: 1 | > loss_disc: 2.8364810943603516 (2.8364810943603516) | > loss_disc_real_0: 0.15360420942306519 (0.15360420942306519) | > loss_disc_real_1: 0.24491389095783234 (0.24491389095783234) | > loss_disc_real_2: 0.2897558808326721 (0.2897558808326721) | > loss_disc_real_3: 0.25885269045829773 (0.25885269045829773) | > loss_disc_real_4: 0.24762621521949768 (0.24762621521949768) | > loss_disc_real_5: 0.2987150549888611 (0.2987150549888611) | > loss_0: 2.8364810943603516 (2.8364810943603516) | > loss_gen: 1.6811950206756592 (1.6811950206756592) | > loss_kl: 4.948333263397217 (4.948333263397217) | > loss_feat: 0.556512713432312 (0.556512713432312) | > loss_mel: 18.54897117614746 (18.54897117614746) | > loss_duration: 3.3337242603302 (3.3337242603302) | > loss_1: 29.068737030029297 (29.068737030029297)  --> STEP: 2 | > loss_disc: 2.700979709625244 (2.768730401992798) | > loss_disc_real_0: 0.33366861939430237 (0.24363641440868378) | > loss_disc_real_1: 0.23322895169258118 (0.23907142132520676) | > loss_disc_real_2: 0.27118533849716187 (0.280470609664917) | > loss_disc_real_3: 0.30797240138053894 (0.28341254591941833) | > loss_disc_real_4: 0.28076085448265076 (0.2641935348510742) | > loss_disc_real_5: 0.13316549360752106 (0.21594027429819107) | > loss_0: 2.700979709625244 (2.768730401992798) | > loss_gen: 2.288991689682007 (1.985093355178833) | > loss_kl: 4.979159355163574 (4.9637463092803955) | > loss_feat: 3.48964262008667 (2.023077666759491) | > loss_mel: 27.155391693115234 (22.852181434631348) | > loss_duration: 3.131960391998291 (3.2328423261642456) | > loss_1: 41.045143127441406 (35.05694007873535)  --> STEP: 3 | > loss_disc: 2.6053285598754883 (2.714263121287028) | > loss_disc_real_0: 0.2834283411502838 (0.2569003899892171) | > loss_disc_real_1: 0.2725115418434143 (0.25021812816460925) | > loss_disc_real_2: 0.2237110584974289 (0.2615507592757543) | > loss_disc_real_3: 0.18705405294895172 (0.25129304826259613) | > loss_disc_real_4: 0.2543312609195709 (0.2609061102072398) | > loss_disc_real_5: 0.21099139750003815 (0.21429064869880676) | > loss_0: 2.6053285598754883 (2.714263121287028) | > loss_gen: 2.049345016479492 (2.006510575612386) | > loss_kl: 2.346013069152832 (4.091168562571208) | > loss_feat: 2.335909605026245 (2.1273549795150757) | > loss_mel: 20.053800582885742 (21.919387817382812) | > loss_duration: 3.005671262741089 (3.157118638356527) | > loss_1: 29.790739059448242 (33.301539738972984) --> EVAL PERFORMANCE | > avg_loader_time: 0.003197352091471354 (-0.008105595906575521) | > avg_loss_disc: 2.714263121287028 (+0.28066209952036525) | > avg_loss_disc_real_0: 0.2569003899892171 (+0.08882289379835126) | > avg_loss_disc_real_1: 0.25021812816460925 (-0.008296892046928406) | > avg_loss_disc_real_2: 0.2615507592757543 (+0.013919502496719333) | > avg_loss_disc_real_3: 0.25129304826259613 (-0.022733484705289186) | > avg_loss_disc_real_4: 0.2609061102072398 (+0.025900656978289305) | > avg_loss_disc_real_5: 0.21429064869880676 (+0.014945705731709807) | > avg_loss_0: 2.714263121287028 (+0.28066209952036525) | > avg_loss_gen: 2.006510575612386 (-0.5576478640238443) | > avg_loss_kl: 4.091168562571208 (-0.04335014025370221) | > avg_loss_feat: 2.1273549795150757 (-3.08840174973011) | > avg_loss_mel: 21.919387817382812 (+2.174304962158203) | > avg_loss_duration: 3.157118638356527 (+0.0266880194346113) | > avg_loss_1: 33.301539738972984 (-1.4884071350097656)  > EPOCH: 868/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:24:44)   --> TIME: 2023-10-20 10:25:01 -- STEP: 19/50 -- GLOBAL_STEP: 96420 | > loss_disc: 2.358888626098633 (2.4705199818862114) | > loss_disc_real_0: 0.13449975848197937 (0.15720173412639843) | > loss_disc_real_1: 0.2176184058189392 (0.21125808132714347) | > loss_disc_real_2: 0.21109166741371155 (0.2191310454356043) | > loss_disc_real_3: 0.21288852393627167 (0.26299596009285825) | > loss_disc_real_4: 0.2155669927597046 (0.23523017930749215) | > loss_disc_real_5: 0.18734098970890045 (0.25942120083460685) | > loss_0: 2.358888626098633 (2.4705199818862114) | > grad_norm_0: tensor(320.4500, device='cuda:0') (tensor(488.0179, device='cuda:0')) | > loss_gen: 2.01963210105896 (2.356302957785757) | > loss_kl: 0.9739543199539185 (0.8111374127237421) | > loss_feat: 3.5621912479400635 (5.329909314450465) | > loss_mel: 11.504926681518555 (21.429869250247354) | > loss_duration: 1.4776482582092285 (1.4018188087563765) | > loss_1: 19.538352966308594 (31.329037892191035) | > grad_norm_1: tensor(22412.0566, device='cuda:0') (tensor(23631.4727, device='cuda:0')) | > current_lr_0: 8.395350318091279e-05 | > current_lr_1: 8.395350318091279e-05 | > step_time: 0.5005 (0.623813880117316) | > loader_time: 0.0101 (0.017717185773347553)  --> TIME: 2023-10-20 10:25:22 -- STEP: 49/50 -- GLOBAL_STEP: 96450 | > loss_disc: 2.372753381729126 (2.435767414618511) | > loss_disc_real_0: 0.11717711389064789 (0.1335823829570899) | > loss_disc_real_1: 0.2134980708360672 (0.22273175133278175) | > loss_disc_real_2: 0.215951070189476 (0.22655790588077235) | > loss_disc_real_3: 0.3131100833415985 (0.23777529300779712) | > loss_disc_real_4: 0.30245301127433777 (0.22835652184273517) | > loss_disc_real_5: 0.28676077723503113 (0.23578227573663604) | > loss_0: 2.372753381729126 (2.435767414618511) | > grad_norm_0: tensor(678.8907, device='cuda:0') (tensor(474.4759, device='cuda:0')) | > loss_gen: 2.6060338020324707 (2.3232726418242167) | > loss_kl: 0.711937427520752 (0.839268975111903) | > loss_feat: 4.164808750152588 (5.400279902073802) | > loss_mel: 22.110023498535156 (21.471690820187938) | > loss_duration: 1.4844943284988403 (1.3740823244561955) | > loss_1: 31.077299118041992 (31.408594919710744) | > grad_norm_1: tensor(30324.2832, device='cuda:0') (tensor(15393.6670, device='cuda:0')) | > current_lr_0: 8.395350318091279e-05 | > current_lr_1: 8.395350318091279e-05 | > step_time: 0.636 (0.6395004866074544) | > loader_time: 0.5949 (0.03271720847304986)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8867008686065674 (2.8867008686065674) | > loss_disc_real_0: 0.34450653195381165 (0.34450653195381165) | > loss_disc_real_1: 0.34522169828414917 (0.34522169828414917) | > loss_disc_real_2: 0.27459463477134705 (0.27459463477134705) | > loss_disc_real_3: 0.2800065875053406 (0.2800065875053406) | > loss_disc_real_4: 0.21527087688446045 (0.21527087688446045) | > loss_disc_real_5: 0.23082289099693298 (0.23082289099693298) | > loss_0: 2.8867008686065674 (2.8867008686065674) | > loss_gen: 1.9432358741760254 (1.9432358741760254) | > loss_kl: 4.990429401397705 (4.990429401397705) | > loss_feat: 0.902113139629364 (0.902113139629364) | > loss_mel: 14.412660598754883 (14.412660598754883) | > loss_duration: 2.991373062133789 (2.991373062133789) | > loss_1: 25.239810943603516 (25.239810943603516)  --> STEP: 1 | > loss_disc: 3.445897102355957 (3.445897102355957) | > loss_disc_real_0: 0.3860095739364624 (0.3860095739364624) | > loss_disc_real_1: 0.37326180934906006 (0.37326180934906006) | > loss_disc_real_2: 0.39528894424438477 (0.39528894424438477) | > loss_disc_real_3: 0.4260694980621338 (0.4260694980621338) | > loss_disc_real_4: 0.28362011909484863 (0.28362011909484863) | > loss_disc_real_5: 0.325324684381485 (0.325324684381485) | > loss_0: 3.445897102355957 (3.445897102355957) | > loss_gen: 2.3789515495300293 (2.3789515495300293) | > loss_kl: 5.082555294036865 (5.082555294036865) | > loss_feat: 3.652371406555176 (3.652371406555176) | > loss_mel: 23.00282859802246 (23.00282859802246) | > loss_duration: 3.405992269515991 (3.405992269515991) | > loss_1: 37.52269744873047 (37.52269744873047)  --> STEP: 2 | > loss_disc: 2.790894031524658 (3.1183955669403076) | > loss_disc_real_0: 0.13079306483268738 (0.2584013193845749) | > loss_disc_real_1: 0.28822627663612366 (0.33074404299259186) | > loss_disc_real_2: 0.3111916780471802 (0.35324031114578247) | > loss_disc_real_3: 0.2942934036254883 (0.36018145084381104) | > loss_disc_real_4: 0.2339058220386505 (0.2587629705667496) | > loss_disc_real_5: 0.2651948928833008 (0.2952597886323929) | > loss_0: 2.790894031524658 (3.1183955669403076) | > loss_gen: 1.882693886756897 (2.130822718143463) | > loss_kl: 5.3008646965026855 (5.191709995269775) | > loss_feat: 1.5197317600250244 (2.5860515832901) | > loss_mel: 20.98259925842285 (21.992713928222656) | > loss_duration: 3.0867197513580322 (3.2463560104370117) | > loss_1: 32.77260971069336 (35.147653579711914)  --> STEP: 3 | > loss_disc: 3.04158353805542 (3.0927915573120117) | > loss_disc_real_0: 0.3201081156730652 (0.27897025148073834) | > loss_disc_real_1: 0.33812904357910156 (0.3332057098547618) | > loss_disc_real_2: 0.2732633650302887 (0.32658132910728455) | > loss_disc_real_3: 0.27273133397102356 (0.3310314118862152) | > loss_disc_real_4: 0.23544202744960785 (0.25098932286103565) | > loss_disc_real_5: 0.2726149260997772 (0.287711501121521) | > loss_0: 3.04158353805542 (3.0927915573120117) | > loss_gen: 1.6940395832061768 (1.9852283398310344) | > loss_kl: 2.2950198650360107 (4.2261466185251875) | > loss_feat: 0.05121854692697525 (1.741107237835725) | > loss_mel: 2.1511056423187256 (15.378844499588013) | > loss_duration: 2.995698928833008 (3.1628036499023438) | > loss_1: 9.187082290649414 (26.494129816691082) --> EVAL PERFORMANCE | > avg_loader_time: 0.013240893681844076 (+0.010043541590372723) | > avg_loss_disc: 3.0927915573120117 (+0.37852843602498387) | > avg_loss_disc_real_0: 0.27897025148073834 (+0.022069861491521237) | > avg_loss_disc_real_1: 0.3332057098547618 (+0.08298758169015252) | > avg_loss_disc_real_2: 0.32658132910728455 (+0.06503056983153027) | > avg_loss_disc_real_3: 0.3310314118862152 (+0.07973836362361908) | > avg_loss_disc_real_4: 0.25098932286103565 (-0.009916787346204159) | > avg_loss_disc_real_5: 0.287711501121521 (+0.07342085242271423) | > avg_loss_0: 3.0927915573120117 (+0.37852843602498387) | > avg_loss_gen: 1.9852283398310344 (-0.0212822357813518) | > avg_loss_kl: 4.2261466185251875 (+0.1349780559539795) | > avg_loss_feat: 1.741107237835725 (-0.3862477416793506) | > avg_loss_mel: 15.378844499588013 (-6.5405433177948) | > avg_loss_duration: 3.1628036499023438 (+0.005685011545816909) | > avg_loss_1: 26.494129816691082 (-6.807409922281902)  > EPOCH: 869/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:25:35)   --> TIME: 2023-10-20 10:25:54 -- STEP: 29/50 -- GLOBAL_STEP: 96480 | > loss_disc: 2.908720016479492 (2.3368371190695933) | > loss_disc_real_0: 0.36940670013427734 (0.13742718158354017) | > loss_disc_real_1: 0.295358806848526 (0.22243775793447576) | > loss_disc_real_2: 0.23929986357688904 (0.21794191356106052) | > loss_disc_real_3: 0.25674915313720703 (0.212826548015763) | > loss_disc_real_4: 0.2757604122161865 (0.20307979180381217) | > loss_disc_real_5: 0.23002037405967712 (0.22322654020811977) | > loss_0: 2.908720016479492 (2.3368371190695933) | > grad_norm_0: tensor(1261.1853, device='cuda:0') (tensor(656.3149, device='cuda:0')) | > loss_gen: 1.7691502571105957 (2.397532915246898) | > loss_kl: 0.7374987006187439 (0.8176589207402591) | > loss_feat: 0.5781129002571106 (6.3520019537416) | > loss_mel: 14.372040748596191 (22.48462338283144) | > loss_duration: 1.3911986351013184 (1.4034203743112499) | > loss_1: 18.84800148010254 (33.455237717464044) | > grad_norm_1: tensor(6978.9453, device='cuda:0') (tensor(23665.8828, device='cuda:0')) | > current_lr_0: 8.386958639820851e-05 | > current_lr_1: 8.386958639820851e-05 | > step_time: 0.3627 (0.4770570705676901) | > loader_time: 0.0022 (0.01072564618340854)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7662127017974854 (2.7662127017974854) | > loss_disc_real_0: 0.21887469291687012 (0.21887469291687012) | > loss_disc_real_1: 0.29526716470718384 (0.29526716470718384) | > loss_disc_real_2: 0.3489585816860199 (0.3489585816860199) | > loss_disc_real_3: 0.299945592880249 (0.299945592880249) | > loss_disc_real_4: 0.3329612612724304 (0.3329612612724304) | > loss_disc_real_5: 0.33974942564964294 (0.33974942564964294) | > loss_0: 2.7662127017974854 (2.7662127017974854) | > loss_gen: 2.3412551879882812 (2.3412551879882812) | > loss_kl: 4.70057487487793 (4.70057487487793) | > loss_feat: 3.602731466293335 (3.602731466293335) | > loss_mel: 22.219676971435547 (22.219676971435547) | > loss_duration: 2.9591076374053955 (2.9591076374053955) | > loss_1: 35.82334518432617 (35.82334518432617)  --> STEP: 1 | > loss_disc: 2.0318939685821533 (2.0318939685821533) | > loss_disc_real_0: 0.11790207028388977 (0.11790207028388977) | > loss_disc_real_1: 0.19102658331394196 (0.19102658331394196) | > loss_disc_real_2: 0.1704256385564804 (0.1704256385564804) | > loss_disc_real_3: 0.23278148472309113 (0.23278148472309113) | > loss_disc_real_4: 0.2415088266134262 (0.2415088266134262) | > loss_disc_real_5: 0.18741965293884277 (0.18741965293884277) | > loss_0: 2.0318939685821533 (2.0318939685821533) | > loss_gen: 2.561185359954834 (2.561185359954834) | > loss_kl: 3.9866623878479004 (3.9866623878479004) | > loss_feat: 5.842822551727295 (5.842822551727295) | > loss_mel: 18.38505744934082 (18.38505744934082) | > loss_duration: 3.206453323364258 (3.206453323364258) | > loss_1: 33.982181549072266 (33.982181549072266)  --> STEP: 2 | > loss_disc: 2.7352051734924316 (2.3835495710372925) | > loss_disc_real_0: 0.10368475317955017 (0.11079341173171997) | > loss_disc_real_1: 0.28894102573394775 (0.23998380452394485) | > loss_disc_real_2: 0.2501141130924225 (0.21026987582445145) | > loss_disc_real_3: 0.31038638949394226 (0.2715839371085167) | > loss_disc_real_4: 0.3180108964443207 (0.27975986152887344) | > loss_disc_real_5: 0.29134929180145264 (0.2393844723701477) | > loss_0: 2.7352051734924316 (2.3835495710372925) | > loss_gen: 2.0829544067382812 (2.3220698833465576) | > loss_kl: 5.037727355957031 (4.512194871902466) | > loss_feat: 3.0991289615631104 (4.470975756645203) | > loss_mel: 21.807918548583984 (20.096487998962402) | > loss_duration: 3.1103172302246094 (3.1583852767944336) | > loss_1: 35.13804626464844 (34.56011390686035)  --> STEP: 3 | > loss_disc: 3.1914243698120117 (2.6528411706288657) | > loss_disc_real_0: 0.35017654299736023 (0.19058778882026672) | > loss_disc_real_1: 0.2731913924217224 (0.2510530004898707) | > loss_disc_real_2: 0.4245581030845642 (0.2816992849111557) | > loss_disc_real_3: 0.3192042112350464 (0.2874573618173599) | > loss_disc_real_4: 0.2550794184207916 (0.2715330471595128) | > loss_disc_real_5: 0.31940415501594543 (0.26605769991874695) | > loss_0: 3.1914243698120117 (2.6528411706288657) | > loss_gen: 2.1041784286499023 (2.2494393984476724) | > loss_kl: 2.39361834526062 (3.806002696355184) | > loss_feat: 3.4668102264404297 (4.136253913243611) | > loss_mel: 21.732318878173828 (20.641764958699543) | > loss_duration: 2.9121367931365967 (3.076302448908488) | > loss_1: 32.60906219482422 (33.90976333618164) --> EVAL PERFORMANCE | > avg_loader_time: 0.029423316319783527 (+0.016182422637939453) | > avg_loss_disc: 2.6528411706288657 (-0.439950386683146) | > avg_loss_disc_real_0: 0.19058778882026672 (-0.08838246266047162) | > avg_loss_disc_real_1: 0.2510530004898707 (-0.08215270936489105) | > avg_loss_disc_real_2: 0.2816992849111557 (-0.044882044196128845) | > avg_loss_disc_real_3: 0.2874573618173599 (-0.043574050068855286) | > avg_loss_disc_real_4: 0.2715330471595128 (+0.020543724298477173) | > avg_loss_disc_real_5: 0.26605769991874695 (-0.021653801202774048) | > avg_loss_0: 2.6528411706288657 (-0.439950386683146) | > avg_loss_gen: 2.2494393984476724 (+0.26421105861663796) | > avg_loss_kl: 3.806002696355184 (-0.4201439221700034) | > avg_loss_feat: 4.136253913243611 (+2.3951466754078865) | > avg_loss_mel: 20.641764958699543 (+5.26292045911153) | > avg_loss_duration: 3.076302448908488 (-0.08650120099385594) | > avg_loss_1: 33.90976333618164 (+7.415633519490559)  > EPOCH: 870/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:26:23)   --> TIME: 2023-10-20 10:26:34 -- STEP: 9/50 -- GLOBAL_STEP: 96510 | > loss_disc: 2.6254055500030518 (2.3085896836386786) | > loss_disc_real_0: 0.10926404595375061 (0.12881209804779953) | > loss_disc_real_1: 0.2708190083503723 (0.20579991903569964) | > loss_disc_real_2: 0.1565021276473999 (0.2201884738687012) | > loss_disc_real_3: 0.23602305352687836 (0.2036780644622114) | > loss_disc_real_4: 0.197597473859787 (0.20940014719963074) | > loss_disc_real_5: 0.24441516399383545 (0.19048431308733094) | > loss_0: 2.6254055500030518 (2.3085896836386786) | > grad_norm_0: tensor(545.8660, device='cuda:0') (tensor(574.8063, device='cuda:0')) | > loss_gen: 1.6653707027435303 (2.3230375713772244) | > loss_kl: 0.44212475419044495 (0.6263206005096436) | > loss_feat: 1.457767128944397 (6.194556097189586) | > loss_mel: 17.08052635192871 (21.493908988104927) | > loss_duration: 1.3332147598266602 (1.3738911549250286) | > loss_1: 21.97900390625 (32.01171472337511) | > grad_norm_1: tensor(2399.4829, device='cuda:0') (tensor(13123.5781, device='cuda:0')) | > current_lr_0: 8.378575349558252e-05 | > current_lr_1: 8.378575349558252e-05 | > step_time: 0.4998 (0.6095835632748074) | > loader_time: 0.0056 (0.02253845002916124)  --> TIME: 2023-10-20 10:26:50 -- STEP: 39/50 -- GLOBAL_STEP: 96540 | > loss_disc: 2.1160635948181152 (2.455781313089224) | > loss_disc_real_0: 0.02981829270720482 (0.13291629375173494) | > loss_disc_real_1: 0.0907711535692215 (0.23660945806365746) | > loss_disc_real_2: 0.14042000472545624 (0.2390203260553953) | > loss_disc_real_3: 0.07534072548151016 (0.22748311198292634) | > loss_disc_real_4: 0.2428324669599533 (0.23230077631962606) | > loss_disc_real_5: 0.3235197067260742 (0.20724962909634298) | > loss_0: 2.1160635948181152 (2.455781313089224) | > grad_norm_0: tensor(616.7119, device='cuda:0') (tensor(634.3131, device='cuda:0')) | > loss_gen: 2.303361177444458 (2.251721883431459) | > loss_kl: 0.7914396524429321 (0.7555933266113966) | > loss_feat: 5.92194128036499 (5.289567661782105) | > loss_mel: 23.52545928955078 (20.75445091113066) | > loss_duration: 1.3961706161499023 (1.360067523442782) | > loss_1: 33.93837356567383 (30.411401748657227) | > grad_norm_1: tensor(14584.4219, device='cuda:0') (tensor(12988.6943, device='cuda:0')) | > current_lr_0: 8.378575349558252e-05 | > current_lr_1: 8.378575349558252e-05 | > step_time: 0.6298 (0.5389446539756579) | > loader_time: 0.028 (0.01586009905888484)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.878148078918457 (2.878148078918457) | > loss_disc_real_0: 0.22152581810951233 (0.22152581810951233) | > loss_disc_real_1: 0.3106094300746918 (0.3106094300746918) | > loss_disc_real_2: 0.3290700912475586 (0.3290700912475586) | > loss_disc_real_3: 0.3717176914215088 (0.3717176914215088) | > loss_disc_real_4: 0.29104745388031006 (0.29104745388031006) | > loss_disc_real_5: 0.27949798107147217 (0.27949798107147217) | > loss_0: 2.878148078918457 (2.878148078918457) | > loss_gen: 2.180122137069702 (2.180122137069702) | > loss_kl: 4.355300426483154 (4.355300426483154) | > loss_feat: 1.1728934049606323 (1.1728934049606323) | > loss_mel: 18.000350952148438 (18.000350952148438) | > loss_duration: 2.959498882293701 (2.959498882293701) | > loss_1: 28.668167114257812 (28.668167114257812)  --> STEP: 1 | > loss_disc: 2.4395711421966553 (2.4395711421966553) | > loss_disc_real_0: 0.2376285344362259 (0.2376285344362259) | > loss_disc_real_1: 0.27531296014785767 (0.27531296014785767) | > loss_disc_real_2: 0.38300958275794983 (0.38300958275794983) | > loss_disc_real_3: 0.3435479402542114 (0.3435479402542114) | > loss_disc_real_4: 0.29201334714889526 (0.29201334714889526) | > loss_disc_real_5: 0.22774124145507812 (0.22774124145507812) | > loss_0: 2.4395711421966553 (2.4395711421966553) | > loss_gen: 3.119154453277588 (3.119154453277588) | > loss_kl: 4.830258846282959 (4.830258846282959) | > loss_feat: 7.642734527587891 (7.642734527587891) | > loss_mel: 22.753713607788086 (22.753713607788086) | > loss_duration: 3.298609972000122 (3.298609972000122) | > loss_1: 41.644474029541016 (41.644474029541016)  --> STEP: 2 | > loss_disc: 3.2806437015533447 (2.860107421875) | > loss_disc_real_0: 0.5693663358688354 (0.40349743515253067) | > loss_disc_real_1: 0.19812798500061035 (0.236720472574234) | > loss_disc_real_2: 0.29725736379623413 (0.340133473277092) | > loss_disc_real_3: 0.36282458901405334 (0.3531862646341324) | > loss_disc_real_4: 0.3187485635280609 (0.3053809553384781) | > loss_disc_real_5: 0.28151175379753113 (0.2546264976263046) | > loss_0: 3.2806437015533447 (2.860107421875) | > loss_gen: 2.1930060386657715 (2.6560802459716797) | > loss_kl: 5.685249328613281 (5.25775408744812) | > loss_feat: 8.872723579406738 (8.257729053497314) | > loss_mel: 21.08108901977539 (21.91740131378174) | > loss_duration: 3.130254030227661 (3.2144320011138916) | > loss_1: 40.962318420410156 (41.303396224975586)  --> STEP: 3 | > loss_disc: 3.053030014038086 (2.924414952596029) | > loss_disc_real_0: 0.34985142946243286 (0.3856154332558314) | > loss_disc_real_1: 0.33066657185554504 (0.2680358390013377) | > loss_disc_real_2: 0.3192061483860016 (0.3331576983133952) | > loss_disc_real_3: 0.3797236979007721 (0.36203207572301227) | > loss_disc_real_4: 0.3971002697944641 (0.3359540601571401) | > loss_disc_real_5: 0.38497066497802734 (0.2980745534102122) | > loss_0: 3.053030014038086 (2.924414952596029) | > loss_gen: 3.008390426635742 (2.7735169728597007) | > loss_kl: 2.59252667427063 (4.36934494972229) | > loss_feat: 3.920806884765625 (6.812088330586751) | > loss_mel: 18.98343849182129 (20.93941370646159) | > loss_duration: 3.040750741958618 (3.156538248062134) | > loss_1: 31.545913696289062 (38.05090204874674) --> EVAL PERFORMANCE | > avg_loader_time: 0.02053976058959961 (-0.008883555730183918) | > avg_loss_disc: 2.924414952596029 (+0.2715737819671631) | > avg_loss_disc_real_0: 0.3856154332558314 (+0.1950276444355647) | > avg_loss_disc_real_1: 0.2680358390013377 (+0.01698283851146698) | > avg_loss_disc_real_2: 0.3331576983133952 (+0.0514584134022395) | > avg_loss_disc_real_3: 0.36203207572301227 (+0.07457471390565235) | > avg_loss_disc_real_4: 0.3359540601571401 (+0.06442101299762726) | > avg_loss_disc_real_5: 0.2980745534102122 (+0.03201685349146527) | > avg_loss_0: 2.924414952596029 (+0.2715737819671631) | > avg_loss_gen: 2.7735169728597007 (+0.5240775744120283) | > avg_loss_kl: 4.36934494972229 (+0.563342253367106) | > avg_loss_feat: 6.812088330586751 (+2.6758344173431396) | > avg_loss_mel: 20.93941370646159 (+0.29764874776204664) | > avg_loss_duration: 3.156538248062134 (+0.08023579915364598) | > avg_loss_1: 38.05090204874674 (+4.141138712565102)  > EPOCH: 871/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:27:14)   --> TIME: 2023-10-20 10:27:29 -- STEP: 19/50 -- GLOBAL_STEP: 96570 | > loss_disc: 1.8419922590255737 (2.3748859543549385) | > loss_disc_real_0: 0.06661611795425415 (0.14967006082205395) | > loss_disc_real_1: 0.17203788459300995 (0.2399333397808828) | > loss_disc_real_2: 0.1997167468070984 (0.22683222435022654) | > loss_disc_real_3: 0.15942969918251038 (0.24541438625831352) | > loss_disc_real_4: 0.12550023198127747 (0.2036721918143724) | > loss_disc_real_5: 0.0814686045050621 (0.1962699732302051) | > loss_0: 1.8419922590255737 (2.3748859543549385) | > grad_norm_0: tensor(742.6339, device='cuda:0') (tensor(1087.8896, device='cuda:0')) | > loss_gen: 2.4147095680236816 (2.368945736634104) | > loss_kl: 0.7697669863700867 (0.6968319545450964) | > loss_feat: 7.307864665985107 (5.24652862470401) | > loss_mel: 28.28050994873047 (18.206596443527623) | > loss_duration: 1.4638912677764893 (1.4211404386319613) | > loss_1: 40.23674392700195 (27.94004357488532) | > grad_norm_1: tensor(63757.1523, device='cuda:0') (tensor(62396.4805, device='cuda:0')) | > current_lr_0: 8.370200438919145e-05 | > current_lr_1: 8.370200438919145e-05 | > step_time: 1.2437 (0.4384676029807643) | > loader_time: 0.0019 (0.012704460244429738)  --> TIME: 2023-10-20 10:27:43 -- STEP: 49/50 -- GLOBAL_STEP: 96600 | > loss_disc: 2.346663475036621 (2.479544697975626) | > loss_disc_real_0: 0.007459793705493212 (0.15347855881198635) | > loss_disc_real_1: 0.199514701962471 (0.22783783473530594) | > loss_disc_real_2: 0.1960744708776474 (0.22383233722375365) | > loss_disc_real_3: 0.23327262699604034 (0.23476018672999072) | > loss_disc_real_4: 0.2269563525915146 (0.22091037156630536) | > loss_disc_real_5: 0.2224939614534378 (0.22704460810185695) | > loss_0: 2.346663475036621 (2.479544697975626) | > grad_norm_0: tensor(2515.1719, device='cuda:0') (tensor(1246.7336, device='cuda:0')) | > loss_gen: 2.0597002506256104 (2.2042929080067855) | > loss_kl: 0.8276098370552063 (0.760876081579802) | > loss_feat: 2.7422049045562744 (4.6792001943198995) | > loss_mel: 22.63385009765625 (18.996804857740596) | > loss_duration: 1.4833766222000122 (1.3861808168644807) | > loss_1: 29.746742248535156 (28.02735495080753) | > grad_norm_1: tensor(17382.7852, device='cuda:0') (tensor(39416.4883, device='cuda:0')) | > current_lr_0: 8.370200438919145e-05 | > current_lr_1: 8.370200438919145e-05 | > step_time: 0.3697 (0.4474083696092878) | > loader_time: 0.3944 (0.018727755060001294)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4949452877044678 (3.4949452877044678) | > loss_disc_real_0: 0.6848222613334656 (0.6848222613334656) | > loss_disc_real_1: 0.29580432176589966 (0.29580432176589966) | > loss_disc_real_2: 0.3573780059814453 (0.3573780059814453) | > loss_disc_real_3: 0.36931219696998596 (0.36931219696998596) | > loss_disc_real_4: 0.40873873233795166 (0.40873873233795166) | > loss_disc_real_5: 0.4458642899990082 (0.4458642899990082) | > loss_0: 3.4949452877044678 (3.4949452877044678) | > loss_gen: 2.6869301795959473 (2.6869301795959473) | > loss_kl: 5.29135799407959 (5.29135799407959) | > loss_feat: 5.476358413696289 (5.476358413696289) | > loss_mel: 20.921524047851562 (20.921524047851562) | > loss_duration: 3.0382699966430664 (3.0382699966430664) | > loss_1: 37.4144401550293 (37.4144401550293)  --> STEP: 1 | > loss_disc: 3.1721463203430176 (3.1721463203430176) | > loss_disc_real_0: 0.7100498080253601 (0.7100498080253601) | > loss_disc_real_1: 0.25245359539985657 (0.25245359539985657) | > loss_disc_real_2: 0.3139967918395996 (0.3139967918395996) | > loss_disc_real_3: 0.23599106073379517 (0.23599106073379517) | > loss_disc_real_4: 0.31880033016204834 (0.31880033016204834) | > loss_disc_real_5: 0.23365885019302368 (0.23365885019302368) | > loss_0: 3.1721463203430176 (3.1721463203430176) | > loss_gen: 2.3694705963134766 (2.3694705963134766) | > loss_kl: 4.971658706665039 (4.971658706665039) | > loss_feat: 3.7005605697631836 (3.7005605697631836) | > loss_mel: 21.75620460510254 (21.75620460510254) | > loss_duration: 3.336202383041382 (3.336202383041382) | > loss_1: 36.134098052978516 (36.134098052978516)  --> STEP: 2 | > loss_disc: 2.3564293384552 (2.764287829399109) | > loss_disc_real_0: 0.455402135848999 (0.5827259719371796) | > loss_disc_real_1: 0.2315053641796112 (0.2419794797897339) | > loss_disc_real_2: 0.10659664869308472 (0.21029672026634216) | > loss_disc_real_3: 0.17906461656093597 (0.20752783864736557) | > loss_disc_real_4: 0.2104145735502243 (0.2646074518561363) | > loss_disc_real_5: 0.28161630034446716 (0.2576375752687454) | > loss_0: 2.3564293384552 (2.764287829399109) | > loss_gen: 2.671152114868164 (2.5203113555908203) | > loss_kl: 5.599351406097412 (5.285505056381226) | > loss_feat: 6.745926856994629 (5.223243713378906) | > loss_mel: 22.541711807250977 (22.148958206176758) | > loss_duration: 3.138216495513916 (3.237209439277649) | > loss_1: 40.69636154174805 (38.41522979736328)  --> STEP: 3 | > loss_disc: 2.8812081813812256 (2.8032612800598145) | > loss_disc_real_0: 0.6547155380249023 (0.6067224939664205) | > loss_disc_real_1: 0.3210398852825165 (0.26833294828732807) | > loss_disc_real_2: 0.12495610117912292 (0.18184984723726907) | > loss_disc_real_3: 0.2979872226715088 (0.2376809666554133) | > loss_disc_real_4: 0.18580679595470428 (0.23834056655565897) | > loss_disc_real_5: 0.21500210464000702 (0.2434257517258326) | > loss_0: 2.8812081813812256 (2.8032612800598145) | > loss_gen: 2.6989147663116455 (2.5798458258310952) | > loss_kl: 2.9431164264678955 (4.504708846410115) | > loss_feat: 4.970519542694092 (5.139002323150635) | > loss_mel: 20.459739685058594 (21.585885365804035) | > loss_duration: 2.9493777751922607 (3.141265551249186) | > loss_1: 34.02166748046875 (36.9507090250651) --> EVAL PERFORMANCE | > avg_loader_time: 0.007243792215983073 (-0.013295968373616535) | > avg_loss_disc: 2.8032612800598145 (-0.12115367253621434) | > avg_loss_disc_real_0: 0.6067224939664205 (+0.2211070607105891) | > avg_loss_disc_real_1: 0.26833294828732807 (+0.00029710928599036013) | > avg_loss_disc_real_2: 0.18184984723726907 (-0.15130785107612613) | > avg_loss_disc_real_3: 0.2376809666554133 (-0.12435110906759897) | > avg_loss_disc_real_4: 0.23834056655565897 (-0.09761349360148111) | > avg_loss_disc_real_5: 0.2434257517258326 (-0.054648801684379605) | > avg_loss_0: 2.8032612800598145 (-0.12115367253621434) | > avg_loss_gen: 2.5798458258310952 (-0.19367114702860544) | > avg_loss_kl: 4.504708846410115 (+0.13536389668782522) | > avg_loss_feat: 5.139002323150635 (-1.6730860074361162) | > avg_loss_mel: 21.585885365804035 (+0.6464716593424455) | > avg_loss_duration: 3.141265551249186 (-0.01527269681294774) | > avg_loss_1: 36.9507090250651 (-1.1001930236816406)  > EPOCH: 872/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:27:58)   --> TIME: 2023-10-20 10:28:26 -- STEP: 29/50 -- GLOBAL_STEP: 96630 | > loss_disc: 2.5102672576904297 (2.4520822270163176) | > loss_disc_real_0: 0.17201435565948486 (0.1818939514201263) | > loss_disc_real_1: 0.21026793122291565 (0.24720226074087215) | > loss_disc_real_2: 0.2761271595954895 (0.23034795277334494) | > loss_disc_real_3: 0.2200750857591629 (0.23452343393502564) | > loss_disc_real_4: 0.3173041343688965 (0.229984520195887) | > loss_disc_real_5: 0.3433483839035034 (0.21659842043601232) | > loss_0: 2.5102672576904297 (2.4520822270163176) | > grad_norm_0: tensor(484.9766, device='cuda:0') (tensor(862.1018, device='cuda:0')) | > loss_gen: 2.6511008739471436 (2.3620233206913386) | > loss_kl: 0.7577606439590454 (0.7744772894115284) | > loss_feat: 4.13788366317749 (5.882064359840648) | > loss_mel: 22.755775451660156 (20.441999213448888) | > loss_duration: 1.330033302307129 (1.3904360573867272) | > loss_1: 31.632553100585938 (30.851000950254242) | > grad_norm_1: tensor(2809.7551, device='cuda:0') (tensor(24235.1133, device='cuda:0')) | > current_lr_0: 8.36183389952757e-05 | > current_lr_1: 8.36183389952757e-05 | > step_time: 1.1153 (0.7804213145683552) | > loader_time: 0.0446 (0.029582525121754612)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9825074672698975 (2.9825074672698975) | > loss_disc_real_0: 0.14801770448684692 (0.14801770448684692) | > loss_disc_real_1: 0.24986279010772705 (0.24986279010772705) | > loss_disc_real_2: 0.2197522073984146 (0.2197522073984146) | > loss_disc_real_3: 0.23378366231918335 (0.23378366231918335) | > loss_disc_real_4: 0.20584748685359955 (0.20584748685359955) | > loss_disc_real_5: 0.2407035380601883 (0.2407035380601883) | > loss_0: 2.9825074672698975 (2.9825074672698975) | > loss_gen: 1.6669917106628418 (1.6669917106628418) | > loss_kl: 5.047422885894775 (5.047422885894775) | > loss_feat: 7.761618137359619 (7.761618137359619) | > loss_mel: 22.836563110351562 (22.836563110351562) | > loss_duration: 3.008418321609497 (3.008418321609497) | > loss_1: 40.321014404296875 (40.321014404296875)  --> STEP: 1 | > loss_disc: 2.7392184734344482 (2.7392184734344482) | > loss_disc_real_0: 0.02446555159986019 (0.02446555159986019) | > loss_disc_real_1: 0.2907831370830536 (0.2907831370830536) | > loss_disc_real_2: 0.2830526530742645 (0.2830526530742645) | > loss_disc_real_3: 0.2758129835128784 (0.2758129835128784) | > loss_disc_real_4: 0.2726954519748688 (0.2726954519748688) | > loss_disc_real_5: 0.16545316576957703 (0.16545316576957703) | > loss_0: 2.7392184734344482 (2.7392184734344482) | > loss_gen: 1.8275976181030273 (1.8275976181030273) | > loss_kl: 4.509366512298584 (4.509366512298584) | > loss_feat: 6.235642433166504 (6.235642433166504) | > loss_mel: 22.521114349365234 (22.521114349365234) | > loss_duration: 3.1944222450256348 (3.1944222450256348) | > loss_1: 38.288143157958984 (38.288143157958984)  --> STEP: 2 | > loss_disc: 2.680828094482422 (2.710023283958435) | > loss_disc_real_0: 0.09901390969753265 (0.06173973064869642) | > loss_disc_real_1: 0.21779151260852814 (0.25428732484579086) | > loss_disc_real_2: 0.1451098769903183 (0.2140812650322914) | > loss_disc_real_3: 0.11193837970495224 (0.19387568160891533) | > loss_disc_real_4: 0.11511314660310745 (0.1939042992889881) | > loss_disc_real_5: 0.2478136122226715 (0.20663338899612427) | > loss_0: 2.680828094482422 (2.710023283958435) | > loss_gen: 1.758047342300415 (1.7928224802017212) | > loss_kl: 5.687137126922607 (5.098251819610596) | > loss_feat: 10.725281715393066 (8.480462074279785) | > loss_mel: 23.58008575439453 (23.050600051879883) | > loss_duration: 3.152804374694824 (3.1736133098602295) | > loss_1: 44.903358459472656 (41.59575080871582)  --> STEP: 3 | > loss_disc: 2.4230775833129883 (2.6143747170766196) | > loss_disc_real_0: 0.0899878591299057 (0.07115577347576618) | > loss_disc_real_1: 0.26002177596092224 (0.25619880855083466) | > loss_disc_real_2: 0.2561055123806 (0.2280893474817276) | > loss_disc_real_3: 0.1824004352092743 (0.19005059947570166) | > loss_disc_real_4: 0.25472936034202576 (0.21417931964000067) | > loss_disc_real_5: 0.24360325932502747 (0.21895667910575867) | > loss_0: 2.4230775833129883 (2.6143747170766196) | > loss_gen: 2.09017276763916 (1.8919392426808674) | > loss_kl: 2.3999781608581543 (4.198827266693115) | > loss_feat: 3.2494001388549805 (6.736774762471517) | > loss_mel: 19.838300704956055 (21.979833602905273) | > loss_duration: 2.9261152744293213 (3.0911139647165933) | > loss_1: 30.503965377807617 (37.898488998413086) --> EVAL PERFORMANCE | > avg_loader_time: 0.011409680048624674 (+0.004165887832641601) | > avg_loss_disc: 2.6143747170766196 (-0.18888656298319484) | > avg_loss_disc_real_0: 0.07115577347576618 (-0.5355667204906543) | > avg_loss_disc_real_1: 0.25619880855083466 (-0.01213413973649341) | > avg_loss_disc_real_2: 0.2280893474817276 (+0.046239500244458526) | > avg_loss_disc_real_3: 0.19005059947570166 (-0.04763036717971164) | > avg_loss_disc_real_4: 0.21417931964000067 (-0.024161246915658297) | > avg_loss_disc_real_5: 0.21895667910575867 (-0.024469072620073945) | > avg_loss_0: 2.6143747170766196 (-0.18888656298319484) | > avg_loss_gen: 1.8919392426808674 (-0.6879065831502278) | > avg_loss_kl: 4.198827266693115 (-0.30588157971700003) | > avg_loss_feat: 6.736774762471517 (+1.5977724393208819) | > avg_loss_mel: 21.979833602905273 (+0.39394823710123816) | > avg_loss_duration: 3.0911139647165933 (-0.05015158653259277) | > avg_loss_1: 37.898488998413086 (+0.9477799733479841)  > EPOCH: 873/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:28:51)   --> TIME: 2023-10-20 10:29:01 -- STEP: 9/50 -- GLOBAL_STEP: 96660 | > loss_disc: 2.5582361221313477 (2.4841154283947415) | > loss_disc_real_0: 0.20126432180404663 (0.168819363332457) | > loss_disc_real_1: 0.13943377137184143 (0.23170824514495003) | > loss_disc_real_2: 0.22346131503582 (0.23398339251677194) | > loss_disc_real_3: 0.25205937027931213 (0.2326434792743789) | > loss_disc_real_4: 0.14748750627040863 (0.23923793766233656) | > loss_disc_real_5: 0.29556500911712646 (0.2478986589445008) | > loss_0: 2.5582361221313477 (2.4841154283947415) | > grad_norm_0: tensor(435.0195, device='cuda:0') (tensor(493.6895, device='cuda:0')) | > loss_gen: 2.1380832195281982 (2.35668683052063) | > loss_kl: 0.603377103805542 (0.7445387012428708) | > loss_feat: 6.205784797668457 (5.56839757412672) | > loss_mel: 21.19849395751953 (19.844521919886272) | > loss_duration: 1.3073341846466064 (1.3357817729314168) | > loss_1: 31.453073501586914 (29.849927107493084) | > grad_norm_1: tensor(10815.2393, device='cuda:0') (tensor(14601.9795, device='cuda:0')) | > current_lr_0: 8.353475723015938e-05 | > current_lr_1: 8.353475723015938e-05 | > step_time: 0.3375 (0.601920657687717) | > loader_time: 0.0095 (0.01673081186082628)  --> TIME: 2023-10-20 10:29:10 -- STEP: 39/50 -- GLOBAL_STEP: 96690 | > loss_disc: 2.4977529048919678 (2.4406539018337545) | > loss_disc_real_0: 0.010464247316122055 (0.1486239538838466) | > loss_disc_real_1: 0.1658189296722412 (0.227193754643966) | > loss_disc_real_2: 0.11839887499809265 (0.22587301562993956) | > loss_disc_real_3: 0.18923476338386536 (0.2448366777254985) | > loss_disc_real_4: 0.20817841589450836 (0.22837865132934007) | > loss_disc_real_5: 0.058286361396312714 (0.2212289477674625) | > loss_0: 2.4977529048919678 (2.4406539018337545) | > grad_norm_0: tensor(718.3011, device='cuda:0') (tensor(558.2860, device='cuda:0')) | > loss_gen: 1.9558924436569214 (2.331530201129424) | > loss_kl: 0.5470362305641174 (0.8000337156729821) | > loss_feat: 7.22062349319458 (5.536567008457125) | > loss_mel: 24.94789695739746 (21.434960848245865) | > loss_duration: 1.4076430797576904 (1.3579278481312285) | > loss_1: 36.0790901184082 (31.46101977274968) | > grad_norm_1: tensor(34397.4180, device='cuda:0') (tensor(15291.5928, device='cuda:0')) | > current_lr_0: 8.353475723015938e-05 | > current_lr_1: 8.353475723015938e-05 | > step_time: 0.255 (0.3646565339504144) | > loader_time: 0.0025 (0.006124148002037635)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8234915733337402 (2.8234915733337402) | > loss_disc_real_0: 0.41341954469680786 (0.41341954469680786) | > loss_disc_real_1: 0.28249529004096985 (0.28249529004096985) | > loss_disc_real_2: 0.3115662634372711 (0.3115662634372711) | > loss_disc_real_3: 0.249927818775177 (0.249927818775177) | > loss_disc_real_4: 0.19758115708827972 (0.19758115708827972) | > loss_disc_real_5: 0.2795647978782654 (0.2795647978782654) | > loss_0: 2.8234915733337402 (2.8234915733337402) | > loss_gen: 2.1579113006591797 (2.1579113006591797) | > loss_kl: 5.175827503204346 (5.175827503204346) | > loss_feat: 3.639071464538574 (3.639071464538574) | > loss_mel: 22.79916000366211 (22.79916000366211) | > loss_duration: 2.892428398132324 (2.892428398132324) | > loss_1: 36.66440200805664 (36.66440200805664)  --> STEP: 1 | > loss_disc: 2.7723922729492188 (2.7723922729492188) | > loss_disc_real_0: 0.10858559608459473 (0.10858559608459473) | > loss_disc_real_1: 0.2436203509569168 (0.2436203509569168) | > loss_disc_real_2: 0.27980875968933105 (0.27980875968933105) | > loss_disc_real_3: 0.2510886490345001 (0.2510886490345001) | > loss_disc_real_4: 0.2717183232307434 (0.2717183232307434) | > loss_disc_real_5: 0.292497843503952 (0.292497843503952) | > loss_0: 2.7723922729492188 (2.7723922729492188) | > loss_gen: 1.70579993724823 (1.70579993724823) | > loss_kl: 4.75900411605835 (4.75900411605835) | > loss_feat: 0.7157859206199646 (0.7157859206199646) | > loss_mel: 15.803472518920898 (15.803472518920898) | > loss_duration: 3.2622628211975098 (3.2622628211975098) | > loss_1: 26.24632453918457 (26.24632453918457)  --> STEP: 2 | > loss_disc: 3.007338523864746 (2.8898653984069824) | > loss_disc_real_0: 0.1711946427822113 (0.13989011943340302) | > loss_disc_real_1: 0.24367092549800873 (0.24364563822746277) | > loss_disc_real_2: 0.3073643743991852 (0.2935865670442581) | > loss_disc_real_3: 0.2514258027076721 (0.2512572258710861) | > loss_disc_real_4: 0.29035842418670654 (0.281038373708725) | > loss_disc_real_5: 0.3012990951538086 (0.2968984693288803) | > loss_0: 3.007338523864746 (2.8898653984069824) | > loss_gen: 1.5978319644927979 (1.651815950870514) | > loss_kl: 5.471674919128418 (5.115339517593384) | > loss_feat: 0.11301936209201813 (0.41440264135599136) | > loss_mel: 2.44746732711792 (9.12546992301941) | > loss_duration: 3.2185873985290527 (3.2404251098632812) | > loss_1: 12.848581314086914 (19.547452926635742)  --> STEP: 3 | > loss_disc: 3.006859302520752 (2.9288633664449057) | > loss_disc_real_0: 0.16925671696662903 (0.14967898527781168) | > loss_disc_real_1: 0.24368683993816376 (0.24365937213102976) | > loss_disc_real_2: 0.3072623312473297 (0.29814515511194867) | > loss_disc_real_3: 0.25150686502456665 (0.2513404389222463) | > loss_disc_real_4: 0.29042723774909973 (0.28416799505551654) | > loss_disc_real_5: 0.3013148605823517 (0.2983705997467041) | > loss_0: 3.006859302520752 (2.9288633664449057) | > loss_gen: 1.5969586372375488 (1.6335301796595256) | > loss_kl: 2.323610782623291 (4.184763272603353) | > loss_feat: 0.1127687469124794 (0.3138580098748207) | > loss_mel: 3.418945789337158 (7.223295211791992) | > loss_duration: 3.0293309688568115 (3.170060396194458) | > loss_1: 10.48161506652832 (16.5255069732666) --> EVAL PERFORMANCE | > avg_loader_time: 0.014551719029744467 (+0.003142038981119793) | > avg_loss_disc: 2.9288633664449057 (+0.31448864936828613) | > avg_loss_disc_real_0: 0.14967898527781168 (+0.0785232118020455) | > avg_loss_disc_real_1: 0.24365937213102976 (-0.0125394364198049) | > avg_loss_disc_real_2: 0.29814515511194867 (+0.07005580763022107) | > avg_loss_disc_real_3: 0.2513404389222463 (+0.06128983944654462) | > avg_loss_disc_real_4: 0.28416799505551654 (+0.06998867541551587) | > avg_loss_disc_real_5: 0.2983705997467041 (+0.07941392064094543) | > avg_loss_0: 2.9288633664449057 (+0.31448864936828613) | > avg_loss_gen: 1.6335301796595256 (-0.2584090630213418) | > avg_loss_kl: 4.184763272603353 (-0.014063994089762666) | > avg_loss_feat: 0.3138580098748207 (-6.422916752596696) | > avg_loss_mel: 7.223295211791992 (-14.756538391113281) | > avg_loss_duration: 3.170060396194458 (+0.07894643147786473) | > avg_loss_1: 16.5255069732666 (-21.372982025146484)  > EPOCH: 874/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:29:28)   --> TIME: 2023-10-20 10:29:45 -- STEP: 19/50 -- GLOBAL_STEP: 96720 | > loss_disc: 2.2302167415618896 (2.293850585034019) | > loss_disc_real_0: 0.10255562514066696 (0.12645395408923688) | > loss_disc_real_1: 0.22998471558094025 (0.20521570036285802) | > loss_disc_real_2: 0.17228668928146362 (0.20810444202078016) | > loss_disc_real_3: 0.18227216601371765 (0.24405747455985924) | > loss_disc_real_4: 0.22849899530410767 (0.18912290144515664) | > loss_disc_real_5: 0.2757398784160614 (0.16831305132884727) | > loss_0: 2.2302167415618896 (2.293850585034019) | > grad_norm_0: tensor(507.9262, device='cuda:0') (tensor(604.9229, device='cuda:0')) | > loss_gen: 2.5730721950531006 (2.5280924972734953) | > loss_kl: 0.805731475353241 (0.7917105179083975) | > loss_feat: 6.417624473571777 (7.27896437519475) | > loss_mel: 21.844074249267578 (24.06770083778783) | > loss_duration: 1.547174096107483 (1.4223085265410573) | > loss_1: 33.18767547607422 (36.088777240953945) | > grad_norm_1: tensor(17363.6992, device='cuda:0') (tensor(30194.5664, device='cuda:0')) | > current_lr_0: 8.34512590102503e-05 | > current_lr_1: 8.34512590102503e-05 | > step_time: 0.5769 (0.6201677447871158) | > loader_time: 0.0099 (0.026881556761892217)  --> TIME: 2023-10-20 10:30:05 -- STEP: 49/50 -- GLOBAL_STEP: 96750 | > loss_disc: 1.3584153652191162 (2.47010025442863) | > loss_disc_real_0: 0.01659763976931572 (0.15187652369162874) | > loss_disc_real_1: 0.14466515183448792 (0.2162080604811104) | > loss_disc_real_2: 0.09149759262800217 (0.22169863637916895) | > loss_disc_real_3: 0.112502820789814 (0.24439547393394964) | > loss_disc_real_4: 0.05799083039164543 (0.22647068105942134) | > loss_disc_real_5: 0.033817581832408905 (0.22363890247533516) | > loss_0: 1.3584153652191162 (2.47010025442863) | > grad_norm_0: tensor(430.5917, device='cuda:0') (tensor(681.9881, device='cuda:0')) | > loss_gen: 2.878861904144287 (2.3260943403049392) | > loss_kl: 0.7910432815551758 (0.7990433695364971) | > loss_feat: 10.37020206451416 (5.613752132167622) | > loss_mel: 27.611480712890625 (21.412522865801442) | > loss_duration: 1.528563380241394 (1.3838755184290361) | > loss_1: 43.180152893066406 (31.535288479863382) | > grad_norm_1: tensor(65810.6641, device='cuda:0') (tensor(21562.9590, device='cuda:0')) | > current_lr_0: 8.34512590102503e-05 | > current_lr_1: 8.34512590102503e-05 | > step_time: 0.5077 (0.6183214090308364) | > loader_time: 0.5578 (0.03585994000337562)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7221813201904297 (2.7221813201904297) | > loss_disc_real_0: 0.1755489856004715 (0.1755489856004715) | > loss_disc_real_1: 0.25501054525375366 (0.25501054525375366) | > loss_disc_real_2: 0.20820000767707825 (0.20820000767707825) | > loss_disc_real_3: 0.29638150334358215 (0.29638150334358215) | > loss_disc_real_4: 0.3182545602321625 (0.3182545602321625) | > loss_disc_real_5: 0.3327832818031311 (0.3327832818031311) | > loss_0: 2.7221813201904297 (2.7221813201904297) | > loss_gen: 2.1671559810638428 (2.1671559810638428) | > loss_kl: 4.863953113555908 (4.863953113555908) | > loss_feat: 6.808935642242432 (6.808935642242432) | > loss_mel: 24.14266586303711 (24.14266586303711) | > loss_duration: 2.9825246334075928 (2.9825246334075928) | > loss_1: 40.96523666381836 (40.96523666381836)  --> STEP: 1 | > loss_disc: 2.803171157836914 (2.803171157836914) | > loss_disc_real_0: 0.33574187755584717 (0.33574187755584717) | > loss_disc_real_1: 0.354827344417572 (0.354827344417572) | > loss_disc_real_2: 0.31610456109046936 (0.31610456109046936) | > loss_disc_real_3: 0.20841677486896515 (0.20841677486896515) | > loss_disc_real_4: 0.4772554039955139 (0.4772554039955139) | > loss_disc_real_5: 0.5063522458076477 (0.5063522458076477) | > loss_0: 2.803171157836914 (2.803171157836914) | > loss_gen: 3.24607515335083 (3.24607515335083) | > loss_kl: 4.904772758483887 (4.904772758483887) | > loss_feat: 6.645757675170898 (6.645757675170898) | > loss_mel: 22.553804397583008 (22.553804397583008) | > loss_duration: 3.3403239250183105 (3.3403239250183105) | > loss_1: 40.69073486328125 (40.69073486328125)  --> STEP: 2 | > loss_disc: 2.623772144317627 (2.7134716510772705) | > loss_disc_real_0: 0.3482975363731384 (0.3420197069644928) | > loss_disc_real_1: 0.18360459804534912 (0.26921597123146057) | > loss_disc_real_2: 0.1965237259864807 (0.25631414353847504) | > loss_disc_real_3: 0.2145710587501526 (0.21149391680955887) | > loss_disc_real_4: 0.14616791903972626 (0.3117116615176201) | > loss_disc_real_5: 0.23687812685966492 (0.3716151863336563) | > loss_0: 2.623772144317627 (2.7134716510772705) | > loss_gen: 1.957810640335083 (2.6019428968429565) | > loss_kl: 5.65069055557251 (5.277731657028198) | > loss_feat: 4.676946640014648 (5.661352157592773) | > loss_mel: 27.21813201904297 (24.88596820831299) | > loss_duration: 3.237161636352539 (3.288742780685425) | > loss_1: 42.74073791503906 (41.715736389160156)  --> STEP: 3 | > loss_disc: 3.0317535400390625 (2.8195656140645347) | > loss_disc_real_0: 0.24276557564735413 (0.3089349965254466) | > loss_disc_real_1: 0.2574561834335327 (0.2652960419654846) | > loss_disc_real_2: 0.28169769048690796 (0.2647753258546193) | > loss_disc_real_3: 0.2959967851638794 (0.23966153959433237) | > loss_disc_real_4: 0.2850568890571594 (0.3028267373641332) | > loss_disc_real_5: 0.25285881757736206 (0.3320297300815582) | > loss_0: 3.0317535400390625 (2.8195656140645347) | > loss_gen: 1.593209147453308 (2.2656983137130737) | > loss_kl: 2.274869441986084 (4.276777585347493) | > loss_feat: 0.05245773121714592 (3.791720682134231) | > loss_mel: 1.5384832620620728 (17.10347322622935) | > loss_duration: 2.9256112575531006 (3.167698939641317) | > loss_1: 8.384631156921387 (30.6053679784139) --> EVAL PERFORMANCE | > avg_loader_time: 0.004727602005004883 (-0.009824117024739584) | > avg_loss_disc: 2.8195656140645347 (-0.1092977523803711) | > avg_loss_disc_real_0: 0.3089349965254466 (+0.15925601124763492) | > avg_loss_disc_real_1: 0.2652960419654846 (+0.021636669834454864) | > avg_loss_disc_real_2: 0.2647753258546193 (-0.03336982925732934) | > avg_loss_disc_real_3: 0.23966153959433237 (-0.01167889932791391) | > avg_loss_disc_real_4: 0.3028267373641332 (+0.018658742308616638) | > avg_loss_disc_real_5: 0.3320297300815582 (+0.033659130334854126) | > avg_loss_0: 2.8195656140645347 (-0.1092977523803711) | > avg_loss_gen: 2.2656983137130737 (+0.6321681340535481) | > avg_loss_kl: 4.276777585347493 (+0.09201431274414062) | > avg_loss_feat: 3.791720682134231 (+3.4778626722594104) | > avg_loss_mel: 17.10347322622935 (+9.880178014437359) | > avg_loss_duration: 3.167698939641317 (-0.002361456553141128) | > avg_loss_1: 30.6053679784139 (+14.079861005147297)  > EPOCH: 875/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:30:21)   --> TIME: 2023-10-20 10:30:45 -- STEP: 29/50 -- GLOBAL_STEP: 96780 | > loss_disc: 3.0170934200286865 (2.504161703175512) | > loss_disc_real_0: 0.21699020266532898 (0.15971196083159284) | > loss_disc_real_1: 0.24915628135204315 (0.23484659361942062) | > loss_disc_real_2: 0.3120497763156891 (0.22995340644285597) | > loss_disc_real_3: 0.23554961383342743 (0.2601912574007593) | > loss_disc_real_4: 0.304006427526474 (0.24478598298697635) | > loss_disc_real_5: 0.2686081826686859 (0.24151472149994865) | > loss_0: 3.0170934200286865 (2.504161703175512) | > grad_norm_0: tensor(481.0803, device='cuda:0') (tensor(623.2478, device='cuda:0')) | > loss_gen: 1.5750280618667603 (2.2685329009746686) | > loss_kl: 1.1788746118545532 (0.9139792179239208) | > loss_feat: 0.056616198271512985 (4.937458378872995) | > loss_mel: 6.042144298553467 (20.240346185092264) | > loss_duration: 1.38825261592865 (1.380101384787724) | > loss_1: 10.240915298461914 (29.740417907977925) | > grad_norm_1: tensor(57204.6055, device='cuda:0') (tensor(20198.2949, device='cuda:0')) | > current_lr_0: 8.336784425203977e-05 | > current_lr_1: 8.336784425203977e-05 | > step_time: 0.8246 (0.6097277443984459) | > loader_time: 0.0237 (0.019058153547089677)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.178708076477051 (3.178708076477051) | > loss_disc_real_0: 0.3256264925003052 (0.3256264925003052) | > loss_disc_real_1: 0.22306877374649048 (0.22306877374649048) | > loss_disc_real_2: 0.27713093161582947 (0.27713093161582947) | > loss_disc_real_3: 0.20843125879764557 (0.20843125879764557) | > loss_disc_real_4: 0.4277246594429016 (0.4277246594429016) | > loss_disc_real_5: 0.5456685423851013 (0.5456685423851013) | > loss_0: 3.178708076477051 (3.178708076477051) | > loss_gen: 2.106879234313965 (2.106879234313965) | > loss_kl: 5.422214984893799 (5.422214984893799) | > loss_feat: 4.4896931648254395 (4.4896931648254395) | > loss_mel: 19.853357315063477 (19.853357315063477) | > loss_duration: 3.0397536754608154 (3.0397536754608154) | > loss_1: 34.91189956665039 (34.91189956665039)  --> STEP: 1 | > loss_disc: 1.7952755689620972 (1.7952755689620972) | > loss_disc_real_0: 0.07944529503583908 (0.07944529503583908) | > loss_disc_real_1: 0.13453710079193115 (0.13453710079193115) | > loss_disc_real_2: 0.12840190529823303 (0.12840190529823303) | > loss_disc_real_3: 0.18155576288700104 (0.18155576288700104) | > loss_disc_real_4: 0.18167385458946228 (0.18167385458946228) | > loss_disc_real_5: 0.13204875588417053 (0.13204875588417053) | > loss_0: 1.7952755689620972 (1.7952755689620972) | > loss_gen: 2.5111255645751953 (2.5111255645751953) | > loss_kl: 4.916541576385498 (4.916541576385498) | > loss_feat: 8.278284072875977 (8.278284072875977) | > loss_mel: 22.73739242553711 (22.73739242553711) | > loss_duration: 3.2302567958831787 (3.2302567958831787) | > loss_1: 41.67359924316406 (41.67359924316406)  --> STEP: 2 | > loss_disc: 3.665041208267212 (2.7301583886146545) | > loss_disc_real_0: 0.08896861970424652 (0.0842069573700428) | > loss_disc_real_1: 0.19174860417842865 (0.1631428524851799) | > loss_disc_real_2: 0.24897827208042145 (0.18869008868932724) | > loss_disc_real_3: 0.2306383103132248 (0.20609703660011292) | > loss_disc_real_4: 0.3454369008541107 (0.2635553777217865) | > loss_disc_real_5: 0.2783913016319275 (0.205220028758049) | > loss_0: 3.665041208267212 (2.7301583886146545) | > loss_gen: 1.3234500885009766 (1.917287826538086) | > loss_kl: 5.739608287811279 (5.328074932098389) | > loss_feat: 8.240499496459961 (8.259391784667969) | > loss_mel: 24.847612380981445 (23.792502403259277) | > loss_duration: 3.1054561138153076 (3.167856454849243) | > loss_1: 43.25662612915039 (42.46511268615723)  --> STEP: 3 | > loss_disc: 2.766146183013916 (2.742154320081075) | > loss_disc_real_0: 0.1206282526254654 (0.09634738912185033) | > loss_disc_real_1: 0.29034584760665894 (0.20554385085900626) | > loss_disc_real_2: 0.21651123464107513 (0.19796380400657654) | > loss_disc_real_3: 0.25322669744491577 (0.22180692354838052) | > loss_disc_real_4: 0.24376824498176575 (0.25695966680844623) | > loss_disc_real_5: 0.25222960114479065 (0.22088988622029623) | > loss_0: 2.766146183013916 (2.742154320081075) | > loss_gen: 1.6281538009643555 (1.820909818013509) | > loss_kl: 2.489543914794922 (4.381897926330566) | > loss_feat: 0.9610891342163086 (5.826624234517415) | > loss_mel: 13.976487159729004 (20.52049732208252) | > loss_duration: 3.0780129432678223 (3.137908617655436) | > loss_1: 22.13328742980957 (35.68783760070801) --> EVAL PERFORMANCE | > avg_loader_time: 0.0020836989084879556 (-0.0026439030965169272) | > avg_loss_disc: 2.742154320081075 (-0.07741129398345947) | > avg_loss_disc_real_0: 0.09634738912185033 (-0.21258760740359628) | > avg_loss_disc_real_1: 0.20554385085900626 (-0.059752191106478364) | > avg_loss_disc_real_2: 0.19796380400657654 (-0.06681152184804279) | > avg_loss_disc_real_3: 0.22180692354838052 (-0.017854616045951843) | > avg_loss_disc_real_4: 0.25695966680844623 (-0.04586707055568695) | > avg_loss_disc_real_5: 0.22088988622029623 (-0.111139843861262) | > avg_loss_0: 2.742154320081075 (-0.07741129398345947) | > avg_loss_gen: 1.820909818013509 (-0.4447884956995647) | > avg_loss_kl: 4.381897926330566 (+0.10512034098307321) | > avg_loss_feat: 5.826624234517415 (+2.034903552383184) | > avg_loss_mel: 20.52049732208252 (+3.4170240958531686) | > avg_loss_duration: 3.137908617655436 (-0.02979032198588083) | > avg_loss_1: 35.68783760070801 (+5.082469622294109)  > EPOCH: 876/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:31:12)   --> TIME: 2023-10-20 10:31:21 -- STEP: 9/50 -- GLOBAL_STEP: 96810 | > loss_disc: 2.318739175796509 (2.5923493438296847) | > loss_disc_real_0: 0.09121845662593842 (0.12401168545087178) | > loss_disc_real_1: 0.22459203004837036 (0.2408411880541179) | > loss_disc_real_2: 0.2511802911758423 (0.2382026712099711) | > loss_disc_real_3: 0.30940312147140503 (0.2538800624509652) | > loss_disc_real_4: 0.2242722362279892 (0.26184191596176887) | > loss_disc_real_5: 0.23844952881336212 (0.24723633378744125) | > loss_0: 2.318739175796509 (2.5923493438296847) | > grad_norm_0: tensor(366.2884, device='cuda:0') (tensor(576.3597, device='cuda:0')) | > loss_gen: 2.4281105995178223 (2.066413654221429) | > loss_kl: 0.7277791500091553 (0.7783733407656351) | > loss_feat: 4.041468620300293 (3.7795509000619254) | > loss_mel: 20.92032814025879 (19.461544248792862) | > loss_duration: 1.345489501953125 (1.3679489294687908) | > loss_1: 29.46317481994629 (27.453830930921768) | > grad_norm_1: tensor(4717.1851, device='cuda:0') (tensor(10196.7031, device='cuda:0')) | > current_lr_0: 8.328451287210264e-05 | > current_lr_1: 8.328451287210264e-05 | > step_time: 0.3825 (0.46928244166904026) | > loader_time: 0.0032 (0.01439197858174642)  --> TIME: 2023-10-20 10:31:33 -- STEP: 39/50 -- GLOBAL_STEP: 96840 | > loss_disc: 3.0043253898620605 (2.461923308861561) | > loss_disc_real_0: 0.3201572299003601 (0.1467948296847634) | > loss_disc_real_1: 0.24626678228378296 (0.21044956353039312) | > loss_disc_real_2: 0.2516682744026184 (0.2210530408490927) | > loss_disc_real_3: 0.2664042115211487 (0.2364246688114527) | > loss_disc_real_4: 0.25981777906417847 (0.23280008805867952) | > loss_disc_real_5: 0.2594422698020935 (0.23709429733646223) | > loss_0: 3.0043253898620605 (2.461923308861561) | > grad_norm_0: tensor(1194.0062, device='cuda:0') (tensor(573.0342, device='cuda:0')) | > loss_gen: 1.5854427814483643 (2.274953930805891) | > loss_kl: 0.47445186972618103 (0.7366495399903028) | > loss_feat: 0.08712879568338394 (5.7071993105495595) | > loss_mel: 2.8860533237457275 (21.048823536970676) | > loss_duration: 1.3626850843429565 (1.3686780471068163) | > loss_1: 6.395761966705322 (31.136304733080742) | > grad_norm_1: tensor(48012.5859, device='cuda:0') (tensor(18085.8027, device='cuda:0')) | > current_lr_0: 8.328451287210264e-05 | > current_lr_1: 8.328451287210264e-05 | > step_time: 0.2595 (0.4105682434179844) | > loader_time: 0.0038 (0.010222814021966396)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7361297607421875 (2.7361297607421875) | > loss_disc_real_0: 0.3340628743171692 (0.3340628743171692) | > loss_disc_real_1: 0.2300417721271515 (0.2300417721271515) | > loss_disc_real_2: 0.34453314542770386 (0.34453314542770386) | > loss_disc_real_3: 0.36403316259384155 (0.36403316259384155) | > loss_disc_real_4: 0.41442951560020447 (0.41442951560020447) | > loss_disc_real_5: 0.26320934295654297 (0.26320934295654297) | > loss_0: 2.7361297607421875 (2.7361297607421875) | > loss_gen: 2.9393396377563477 (2.9393396377563477) | > loss_kl: 4.419315814971924 (4.419315814971924) | > loss_feat: 8.089556694030762 (8.089556694030762) | > loss_mel: 23.2542781829834 (23.2542781829834) | > loss_duration: 3.073540210723877 (3.073540210723877) | > loss_1: 41.776031494140625 (41.776031494140625)  --> STEP: 1 | > loss_disc: 2.9374454021453857 (2.9374454021453857) | > loss_disc_real_0: 0.29427170753479004 (0.29427170753479004) | > loss_disc_real_1: 0.25173574686050415 (0.25173574686050415) | > loss_disc_real_2: 0.24186643958091736 (0.24186643958091736) | > loss_disc_real_3: 0.2387661635875702 (0.2387661635875702) | > loss_disc_real_4: 0.24954910576343536 (0.24954910576343536) | > loss_disc_real_5: 0.255188912153244 (0.255188912153244) | > loss_0: 2.9374454021453857 (2.9374454021453857) | > loss_gen: 1.6270593404769897 (1.6270593404769897) | > loss_kl: 4.883872985839844 (4.883872985839844) | > loss_feat: 0.18335655331611633 (0.18335655331611633) | > loss_mel: 11.126378059387207 (11.126378059387207) | > loss_duration: 3.277395486831665 (3.277395486831665) | > loss_1: 21.09806251525879 (21.09806251525879)  --> STEP: 2 | > loss_disc: 2.747706413269043 (2.8425759077072144) | > loss_disc_real_0: 0.2904277741909027 (0.2923497408628464) | > loss_disc_real_1: 0.22417910397052765 (0.2379574254155159) | > loss_disc_real_2: 0.263289213180542 (0.2525778263807297) | > loss_disc_real_3: 0.16296350955963135 (0.20086483657360077) | > loss_disc_real_4: 0.22152598202228546 (0.2355375438928604) | > loss_disc_real_5: 0.17334212362766266 (0.21426551789045334) | > loss_0: 2.747706413269043 (2.8425759077072144) | > loss_gen: 1.9165425300598145 (1.771800935268402) | > loss_kl: 5.640416145324707 (5.262144565582275) | > loss_feat: 5.136590957641602 (2.659973755478859) | > loss_mel: 23.566530227661133 (17.34645414352417) | > loss_duration: 3.173462390899658 (3.2254289388656616) | > loss_1: 39.43354034423828 (30.265801429748535)  --> STEP: 3 | > loss_disc: 3.2371809482574463 (2.9741109212239585) | > loss_disc_real_0: 0.5169325470924377 (0.36721067627271015) | > loss_disc_real_1: 0.3525117337703705 (0.2761421948671341) | > loss_disc_real_2: 0.21208573877811432 (0.23908046384652457) | > loss_disc_real_3: 0.3559730052947998 (0.2525675594806671) | > loss_disc_real_4: 0.3679088056087494 (0.27966129779815674) | > loss_disc_real_5: 0.18226997554302216 (0.2036003371079763) | > loss_0: 3.2371809482574463 (2.9741109212239585) | > loss_gen: 2.278726577758789 (1.9407761494318645) | > loss_kl: 2.4879164695739746 (4.337401866912842) | > loss_feat: 4.156981468200684 (3.1589763263861337) | > loss_mel: 21.826448440551758 (18.8397855758667) | > loss_duration: 2.9494845867156982 (3.1334474881490073) | > loss_1: 33.69955825805664 (31.41038703918457) --> EVAL PERFORMANCE | > avg_loader_time: 0.015866676966349285 (+0.01378297805786133) | > avg_loss_disc: 2.9741109212239585 (+0.2319566011428833) | > avg_loss_disc_real_0: 0.36721067627271015 (+0.27086328715085983) | > avg_loss_disc_real_1: 0.2761421948671341 (+0.07059834400812784) | > avg_loss_disc_real_2: 0.23908046384652457 (+0.04111665983994803) | > avg_loss_disc_real_3: 0.2525675594806671 (+0.03076063593228659) | > avg_loss_disc_real_4: 0.27966129779815674 (+0.02270163098971051) | > avg_loss_disc_real_5: 0.2036003371079763 (-0.017289549112319946) | > avg_loss_0: 2.9741109212239585 (+0.2319566011428833) | > avg_loss_gen: 1.9407761494318645 (+0.11986633141835545) | > avg_loss_kl: 4.337401866912842 (-0.04449605941772461) | > avg_loss_feat: 3.1589763263861337 (-2.6676479081312814) | > avg_loss_mel: 18.8397855758667 (-1.6807117462158203) | > avg_loss_duration: 3.1334474881490073 (-0.00446112950642874) | > avg_loss_1: 31.41038703918457 (-4.2774505615234375)  > EPOCH: 877/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:31:56)   --> TIME: 2023-10-20 10:32:13 -- STEP: 19/50 -- GLOBAL_STEP: 96870 | > loss_disc: 2.6129584312438965 (2.5034970107831453) | > loss_disc_real_0: 0.131216898560524 (0.15796020950533843) | > loss_disc_real_1: 0.15138691663742065 (0.2171541268104001) | > loss_disc_real_2: 0.11308614164590836 (0.19935726472421697) | > loss_disc_real_3: 0.27623432874679565 (0.26038066258555964) | > loss_disc_real_4: 0.15098154544830322 (0.2369532455739222) | > loss_disc_real_5: 0.08944541215896606 (0.262880162973153) | > loss_0: 2.6129584312438965 (2.5034970107831453) | > grad_norm_0: tensor(529.0384, device='cuda:0') (tensor(560.9515, device='cuda:0')) | > loss_gen: 1.8411195278167725 (2.2920150129418624) | > loss_kl: 0.5652302503585815 (0.7993858958545484) | > loss_feat: 5.971397876739502 (5.609587422915195) | > loss_mel: 23.41006088256836 (21.12663643611105) | > loss_duration: 1.4867987632751465 (1.3971618664892096) | > loss_1: 33.27460861206055 (31.224786181198922) | > grad_norm_1: tensor(8396.0400, device='cuda:0') (tensor(15721.2158, device='cuda:0')) | > current_lr_0: 8.320126478709707e-05 | > current_lr_1: 8.320126478709707e-05 | > step_time: 0.5677 (0.5955900142067357) | > loader_time: 0.0139 (0.014456297221936677)  --> TIME: 2023-10-20 10:32:31 -- STEP: 49/50 -- GLOBAL_STEP: 96900 | > loss_disc: 2.199629783630371 (2.458867673971215) | > loss_disc_real_0: 0.02650577574968338 (0.13800996880294109) | > loss_disc_real_1: 0.18949520587921143 (0.220440396392832) | > loss_disc_real_2: 0.06419253349304199 (0.19852146863633272) | > loss_disc_real_3: 0.11412616074085236 (0.23081810240234651) | > loss_disc_real_4: 0.06834127753973007 (0.21615489705332688) | > loss_disc_real_5: 0.0390169657766819 (0.23137483190821148) | > loss_0: 2.199629783630371 (2.458867673971215) | > grad_norm_0: tensor(729.0928, device='cuda:0') (tensor(619.6142, device='cuda:0')) | > loss_gen: 1.9159111976623535 (2.2105285732113584) | > loss_kl: 0.5764588713645935 (0.747190327972782) | > loss_feat: 6.958320140838623 (5.358985926955938) | > loss_mel: 23.018667221069336 (21.002507406838085) | > loss_duration: 1.4761173725128174 (1.3622189979163968) | > loss_1: 33.945472717285156 (30.681430884769984) | > grad_norm_1: tensor(25655.7832, device='cuda:0') (tensor(14868.0371, device='cuda:0')) | > current_lr_0: 8.320126478709707e-05 | > current_lr_1: 8.320126478709707e-05 | > step_time: 0.2633 (0.5797298100529886) | > loader_time: 0.4104 (0.02534718902743593)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.341299533843994 (2.341299533843994) | > loss_disc_real_0: 0.24821628630161285 (0.24821628630161285) | > loss_disc_real_1: 0.26828545331954956 (0.26828545331954956) | > loss_disc_real_2: 0.28264176845550537 (0.28264176845550537) | > loss_disc_real_3: 0.25317177176475525 (0.25317177176475525) | > loss_disc_real_4: 0.1318134069442749 (0.1318134069442749) | > loss_disc_real_5: 0.27709123492240906 (0.27709123492240906) | > loss_0: 2.341299533843994 (2.341299533843994) | > loss_gen: 2.7631804943084717 (2.7631804943084717) | > loss_kl: 4.868429183959961 (4.868429183959961) | > loss_feat: 7.614114761352539 (7.614114761352539) | > loss_mel: 20.71904754638672 (20.71904754638672) | > loss_duration: 2.9838008880615234 (2.9838008880615234) | > loss_1: 38.948570251464844 (38.948570251464844)  --> STEP: 1 | > loss_disc: 2.538787364959717 (2.538787364959717) | > loss_disc_real_0: 0.2879648208618164 (0.2879648208618164) | > loss_disc_real_1: 0.4207041263580322 (0.4207041263580322) | > loss_disc_real_2: 0.2848189175128937 (0.2848189175128937) | > loss_disc_real_3: 0.23571564257144928 (0.23571564257144928) | > loss_disc_real_4: 0.21506544947624207 (0.21506544947624207) | > loss_disc_real_5: 0.37414681911468506 (0.37414681911468506) | > loss_0: 2.538787364959717 (2.538787364959717) | > loss_gen: 3.2705421447753906 (3.2705421447753906) | > loss_kl: 4.7903947830200195 (4.7903947830200195) | > loss_feat: 8.28442096710205 (8.28442096710205) | > loss_mel: 22.03080177307129 (22.03080177307129) | > loss_duration: 3.3835978507995605 (3.3835978507995605) | > loss_1: 41.75975799560547 (41.75975799560547)  --> STEP: 2 | > loss_disc: 2.151445150375366 (2.3451162576675415) | > loss_disc_real_0: 0.36198294162750244 (0.3249738812446594) | > loss_disc_real_1: 0.37996742129325867 (0.40033577382564545) | > loss_disc_real_2: 0.16626404225826263 (0.22554147988557816) | > loss_disc_real_3: 0.3273230195045471 (0.2815193310379982) | > loss_disc_real_4: 0.10105700045824051 (0.1580612249672413) | > loss_disc_real_5: 0.12022819370031357 (0.2471875064074993) | > loss_0: 2.151445150375366 (2.3451162576675415) | > loss_gen: 3.2304253578186035 (3.250483751296997) | > loss_kl: 5.644660472869873 (5.217527627944946) | > loss_feat: 10.484708786010742 (9.384564876556396) | > loss_mel: 28.67640495300293 (25.35360336303711) | > loss_duration: 3.140160322189331 (3.261879086494446) | > loss_1: 51.176361083984375 (46.46805953979492)  --> STEP: 3 | > loss_disc: 3.1893866062164307 (2.626539707183838) | > loss_disc_real_0: 0.2744520306587219 (0.30813326438268024) | > loss_disc_real_1: 0.3511262834072113 (0.38393261035283405) | > loss_disc_real_2: 0.33619293570518494 (0.26242529849211377) | > loss_disc_real_3: 0.36205512285232544 (0.3083645949761073) | > loss_disc_real_4: 0.37452852725982666 (0.2302169923981031) | > loss_disc_real_5: 0.3316385746002197 (0.27533786247173947) | > loss_0: 3.1893866062164307 (2.626539707183838) | > loss_gen: 2.1729679107666016 (2.8913118044535318) | > loss_kl: 2.5383660793304443 (4.324473778406779) | > loss_feat: 3.741162061691284 (7.503430604934692) | > loss_mel: 18.36997413635254 (23.025726954142254) | > loss_duration: 3.029660701751709 (3.1844729582468667) | > loss_1: 29.852130889892578 (40.92941665649414) --> EVAL PERFORMANCE | > avg_loader_time: 0.0028922557830810547 (-0.01297442118326823) | > avg_loss_disc: 2.626539707183838 (-0.3475712140401206) | > avg_loss_disc_real_0: 0.30813326438268024 (-0.05907741189002991) | > avg_loss_disc_real_1: 0.38393261035283405 (+0.10779041548569995) | > avg_loss_disc_real_2: 0.26242529849211377 (+0.023344834645589202) | > avg_loss_disc_real_3: 0.3083645949761073 (+0.055797035495440184) | > avg_loss_disc_real_4: 0.2302169923981031 (-0.04944430540005365) | > avg_loss_disc_real_5: 0.27533786247173947 (+0.07173752536376318) | > avg_loss_0: 2.626539707183838 (-0.3475712140401206) | > avg_loss_gen: 2.8913118044535318 (+0.9505356550216673) | > avg_loss_kl: 4.324473778406779 (-0.01292808850606253) | > avg_loss_feat: 7.503430604934692 (+4.344454278548559) | > avg_loss_mel: 23.025726954142254 (+4.185941378275555) | > avg_loss_duration: 3.1844729582468667 (+0.051025470097859404) | > avg_loss_1: 40.92941665649414 (+9.51902961730957)  > EPOCH: 878/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:32:44)   --> TIME: 2023-10-20 10:33:06 -- STEP: 29/50 -- GLOBAL_STEP: 96930 | > loss_disc: 2.467515230178833 (2.565420894787229) | > loss_disc_real_0: 0.08480378985404968 (0.172153076221203) | > loss_disc_real_1: 0.1622878909111023 (0.23599585479703442) | > loss_disc_real_2: 0.2352016717195511 (0.2416728287935257) | > loss_disc_real_3: 0.3348316252231598 (0.2522673344817655) | > loss_disc_real_4: 0.18464761972427368 (0.23772810245382375) | > loss_disc_real_5: 0.1888999193906784 (0.2523854112830656) | > loss_0: 2.467515230178833 (2.565420894787229) | > grad_norm_0: tensor(472.1358, device='cuda:0') (tensor(701.8886, device='cuda:0')) | > loss_gen: 2.1936113834381104 (2.2220756144359193) | > loss_kl: 0.565592885017395 (0.8869587491298544) | > loss_feat: 5.693636417388916 (4.361214141650446) | > loss_mel: 21.024837493896484 (18.57855348751463) | > loss_duration: 1.39951753616333 (1.401952710644952) | > loss_1: 30.877195358276367 (27.450754708257215) | > grad_norm_1: tensor(18625.7617, device='cuda:0') (tensor(17439.1855, device='cuda:0')) | > current_lr_0: 8.311809991376457e-05 | > current_lr_1: 8.311809991376457e-05 | > step_time: 0.3363 (0.5468313611786942) | > loader_time: 0.0025 (0.01648847810153304)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.594898223876953 (2.594898223876953) | > loss_disc_real_0: 0.1748078465461731 (0.1748078465461731) | > loss_disc_real_1: 0.3349297344684601 (0.3349297344684601) | > loss_disc_real_2: 0.2919783294200897 (0.2919783294200897) | > loss_disc_real_3: 0.3386467397212982 (0.3386467397212982) | > loss_disc_real_4: 0.2847343981266022 (0.2847343981266022) | > loss_disc_real_5: 0.17392775416374207 (0.17392775416374207) | > loss_0: 2.594898223876953 (2.594898223876953) | > loss_gen: 2.751675605773926 (2.751675605773926) | > loss_kl: 5.380441188812256 (5.380441188812256) | > loss_feat: 8.205428123474121 (8.205428123474121) | > loss_mel: 23.606151580810547 (23.606151580810547) | > loss_duration: 2.9385986328125 (2.9385986328125) | > loss_1: 42.882293701171875 (42.882293701171875)  --> STEP: 1 | > loss_disc: 2.218291759490967 (2.218291759490967) | > loss_disc_real_0: 0.14373217523097992 (0.14373217523097992) | > loss_disc_real_1: 0.19300900399684906 (0.19300900399684906) | > loss_disc_real_2: 0.32078874111175537 (0.32078874111175537) | > loss_disc_real_3: 0.24452504515647888 (0.24452504515647888) | > loss_disc_real_4: 0.1722814291715622 (0.1722814291715622) | > loss_disc_real_5: 0.08965356647968292 (0.08965356647968292) | > loss_0: 2.218291759490967 (2.218291759490967) | > loss_gen: 2.3871240615844727 (2.3871240615844727) | > loss_kl: 5.086636543273926 (5.086636543273926) | > loss_feat: 7.917047500610352 (7.917047500610352) | > loss_mel: 27.855510711669922 (27.855510711669922) | > loss_duration: 3.267601728439331 (3.267601728439331) | > loss_1: 46.513919830322266 (46.513919830322266)  --> STEP: 2 | > loss_disc: 2.7888174057006836 (2.503554582595825) | > loss_disc_real_0: 0.22794845700263977 (0.18584031611680984) | > loss_disc_real_1: 0.24122321605682373 (0.2171161100268364) | > loss_disc_real_2: 0.19596344232559204 (0.2583760917186737) | > loss_disc_real_3: 0.2640375792980194 (0.25428131222724915) | > loss_disc_real_4: 0.2735319137573242 (0.2229066714644432) | > loss_disc_real_5: 0.2324279397726059 (0.1610407531261444) | > loss_0: 2.7888174057006836 (2.503554582595825) | > loss_gen: 1.7230695486068726 (2.0550968050956726) | > loss_kl: 5.578205108642578 (5.332420825958252) | > loss_feat: 2.0460758209228516 (4.981561660766602) | > loss_mel: 10.290915489196777 (19.07321310043335) | > loss_duration: 3.1289031505584717 (3.1982524394989014) | > loss_1: 22.767168045043945 (34.640543937683105)  --> STEP: 3 | > loss_disc: 2.7066123485565186 (2.571240504582723) | > loss_disc_real_0: 0.10397247970104218 (0.15855103731155396) | > loss_disc_real_1: 0.43049630522727966 (0.2882428417603175) | > loss_disc_real_2: 0.4646611213684082 (0.3271377682685852) | > loss_disc_real_3: 0.3670898675918579 (0.2918841640154521) | > loss_disc_real_4: 0.26942917704582214 (0.23841417332490286) | > loss_disc_real_5: 0.17151151597499847 (0.16453100740909576) | > loss_0: 2.7066123485565186 (2.571240504582723) | > loss_gen: 2.6618306636810303 (2.257341424624125) | > loss_kl: 2.4377357959747314 (4.367525815963745) | > loss_feat: 6.0003767013549805 (5.3211666742960615) | > loss_mel: 25.37038803100586 (21.172271410624187) | > loss_duration: 3.028048276901245 (3.141517718633016) | > loss_1: 39.498382568359375 (36.25982348124186) --> EVAL PERFORMANCE | > avg_loader_time: 0.009246269861857096 (+0.006354014078776041) | > avg_loss_disc: 2.571240504582723 (-0.05529920260111476) | > avg_loss_disc_real_0: 0.15855103731155396 (-0.14958222707112628) | > avg_loss_disc_real_1: 0.2882428417603175 (-0.09568976859251654) | > avg_loss_disc_real_2: 0.3271377682685852 (+0.06471246977647144) | > avg_loss_disc_real_3: 0.2918841640154521 (-0.016480430960655212) | > avg_loss_disc_real_4: 0.23841417332490286 (+0.008197180926799774) | > avg_loss_disc_real_5: 0.16453100740909576 (-0.1108068550626437) | > avg_loss_0: 2.571240504582723 (-0.05529920260111476) | > avg_loss_gen: 2.257341424624125 (-0.6339703798294067) | > avg_loss_kl: 4.367525815963745 (+0.04305203755696585) | > avg_loss_feat: 5.3211666742960615 (-2.182263930638631) | > avg_loss_mel: 21.172271410624187 (-1.8534555435180664) | > avg_loss_duration: 3.141517718633016 (-0.042955239613850615) | > avg_loss_1: 36.25982348124186 (-4.669593175252281)  > EPOCH: 879/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:33:33)   --> TIME: 2023-10-20 10:33:45 -- STEP: 9/50 -- GLOBAL_STEP: 96960 | > loss_disc: 2.454709053039551 (2.52741805712382) | > loss_disc_real_0: 0.1123339831829071 (0.18630308989021513) | > loss_disc_real_1: 0.1562299281358719 (0.2612856920394633) | > loss_disc_real_2: 0.11813654005527496 (0.22384867072105408) | > loss_disc_real_3: 0.13426922261714935 (0.24092697848876318) | > loss_disc_real_4: 0.04656459763646126 (0.21423759683966637) | > loss_disc_real_5: 0.0662243440747261 (0.1925375879638725) | > loss_0: 2.454709053039551 (2.52741805712382) | > grad_norm_0: tensor(768.9534, device='cuda:0') (tensor(698.8483, device='cuda:0')) | > loss_gen: 1.7502905130386353 (2.1220775975121393) | > loss_kl: 0.4435385465621948 (0.6452899840142992) | > loss_feat: 8.575091361999512 (4.73633058865865) | > loss_mel: 20.48729133605957 (17.596538888083565) | > loss_duration: 1.3593186140060425 (1.4149131509992812) | > loss_1: 32.61552810668945 (26.51515007019043) | > grad_norm_1: tensor(5728.6929, device='cuda:0') (tensor(8486.2666, device='cuda:0')) | > current_lr_0: 8.303501816892988e-05 | > current_lr_1: 8.303501816892988e-05 | > step_time: 0.5311 (0.6264309353298612) | > loader_time: 0.0198 (0.0283657709757487)  --> TIME: 2023-10-20 10:34:04 -- STEP: 39/50 -- GLOBAL_STEP: 96990 | > loss_disc: 2.081305503845215 (2.559956596447871) | > loss_disc_real_0: 0.09576372057199478 (0.18143304066063884) | > loss_disc_real_1: 0.18534187972545624 (0.24272867167989412) | > loss_disc_real_2: 0.09479492902755737 (0.2374119809231697) | > loss_disc_real_3: 0.15730351209640503 (0.24477582138318282) | > loss_disc_real_4: 0.11741829663515091 (0.23025774048307004) | > loss_disc_real_5: 0.14406000077724457 (0.22555862262080878) | > loss_0: 2.081305503845215 (2.559956596447871) | > grad_norm_0: tensor(378.2170, device='cuda:0') (tensor(847.0421, device='cuda:0')) | > loss_gen: 1.9799399375915527 (2.130278636247684) | > loss_kl: 0.7144621014595032 (0.7662878579054123) | > loss_feat: 4.966582775115967 (4.345583742818773) | > loss_mel: 21.036235809326172 (17.81425777154092) | > loss_duration: 1.4271661043167114 (1.3866279675410345) | > loss_1: 30.124387741088867 (26.443036103859924) | > grad_norm_1: tensor(3135.8701, device='cuda:0') (tensor(19643.3242, device='cuda:0')) | > current_lr_0: 8.303501816892988e-05 | > current_lr_1: 8.303501816892988e-05 | > step_time: 0.7986 (0.629768885098971) | > loader_time: 0.0178 (0.02425811229607998)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1592650413513184 (2.1592650413513184) | > loss_disc_real_0: 0.1153932735323906 (0.1153932735323906) | > loss_disc_real_1: 0.20062962174415588 (0.20062962174415588) | > loss_disc_real_2: 0.2173553854227066 (0.2173553854227066) | > loss_disc_real_3: 0.19994986057281494 (0.19994986057281494) | > loss_disc_real_4: 0.1944403201341629 (0.1944403201341629) | > loss_disc_real_5: 0.22469037771224976 (0.22469037771224976) | > loss_0: 2.1592650413513184 (2.1592650413513184) | > loss_gen: 2.584994316101074 (2.584994316101074) | > loss_kl: 4.955477237701416 (4.955477237701416) | > loss_feat: 7.957067966461182 (7.957067966461182) | > loss_mel: 23.558286666870117 (23.558286666870117) | > loss_duration: 2.9300942420959473 (2.9300942420959473) | > loss_1: 41.985923767089844 (41.985923767089844)  --> STEP: 1 | > loss_disc: 2.797459125518799 (2.797459125518799) | > loss_disc_real_0: 0.3401230573654175 (0.3401230573654175) | > loss_disc_real_1: 0.2662750780582428 (0.2662750780582428) | > loss_disc_real_2: 0.2903086841106415 (0.2903086841106415) | > loss_disc_real_3: 0.255428284406662 (0.255428284406662) | > loss_disc_real_4: 0.32341891527175903 (0.32341891527175903) | > loss_disc_real_5: 0.39492249488830566 (0.39492249488830566) | > loss_0: 2.797459125518799 (2.797459125518799) | > loss_gen: 2.657233238220215 (2.657233238220215) | > loss_kl: 4.960022926330566 (4.960022926330566) | > loss_feat: 4.055315017700195 (4.055315017700195) | > loss_mel: 24.681472778320312 (24.681472778320312) | > loss_duration: 3.3339014053344727 (3.3339014053344727) | > loss_1: 39.68794631958008 (39.68794631958008)  --> STEP: 2 | > loss_disc: 1.8902456760406494 (2.343852400779724) | > loss_disc_real_0: 0.07817967981100082 (0.20915136858820915) | > loss_disc_real_1: 0.3100642263889313 (0.28816965222358704) | > loss_disc_real_2: 0.13601818680763245 (0.21316343545913696) | > loss_disc_real_3: 0.17600418627262115 (0.21571623533964157) | > loss_disc_real_4: 0.2776440978050232 (0.3005315065383911) | > loss_disc_real_5: 0.2160591185092926 (0.30549080669879913) | > loss_0: 1.8902456760406494 (2.343852400779724) | > loss_gen: 3.190530300140381 (2.923881769180298) | > loss_kl: 5.270459175109863 (5.115241050720215) | > loss_feat: 8.333532333374023 (6.194423675537109) | > loss_mel: 26.619693756103516 (25.650583267211914) | > loss_duration: 3.2090108394622803 (3.2714561223983765) | > loss_1: 46.623226165771484 (43.15558624267578)  --> STEP: 3 | > loss_disc: 2.6393001079559326 (2.4423349698384604) | > loss_disc_real_0: 0.229062020778656 (0.21578825265169144) | > loss_disc_real_1: 0.21539026498794556 (0.26390985647837323) | > loss_disc_real_2: 0.3449627161026001 (0.257096529006958) | > loss_disc_real_3: 0.243605375289917 (0.2250126153230667) | > loss_disc_real_4: 0.39504700899124146 (0.33203667402267456) | > loss_disc_real_5: 0.34481456875801086 (0.31859872738520306) | > loss_0: 2.6393001079559326 (2.4423349698384604) | > loss_gen: 2.7499921321868896 (2.8659185568491616) | > loss_kl: 2.157137393951416 (4.129206498463948) | > loss_feat: 4.456704616546631 (5.61518398920695) | > loss_mel: 22.870227813720703 (24.723798116048176) | > loss_duration: 2.873530387878418 (3.1388142108917236) | > loss_1: 35.10759353637695 (40.472922007242836) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_97000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7789573669433594 (2.526490569114685) | > loss_disc_real_0: 0.25790342688560486 (0.2263170462101698) | > loss_disc_real_1: 0.29314175248146057 (0.27121783047914505) | > loss_disc_real_2: 0.33024343848228455 (0.27538325637578964) | > loss_disc_real_3: 0.41572898626327515 (0.2726917080581188) | > loss_disc_real_4: 0.33923664689064026 (0.333836667239666) | > loss_disc_real_5: 0.487547367811203 (0.36083588749170303) | > loss_0: 2.7789573669433594 (2.526490569114685) | > loss_gen: 3.759627342224121 (3.0893457531929016) | > loss_kl: 5.277824878692627 (4.416361093521118) | > loss_feat: 6.136284351348877 (5.745459079742432) | > loss_mel: 22.980283737182617 (24.287919521331787) | > loss_duration: 2.907273530960083 (3.0809290409088135) | > loss_1: 41.06129455566406 (40.620015144348145)  --> STEP: 1 | > loss_disc: 2.7527594566345215 (2.5717443466186523) | > loss_disc_real_0: 0.19946296513080597 (0.22094622999429703) | > loss_disc_real_1: 0.2305809110403061 (0.26309044659137726) | > loss_disc_real_2: 0.22435703873634338 (0.2651780128479004) | > loss_disc_real_3: 0.3848196566104889 (0.29511729776859286) | > loss_disc_real_4: 0.32719868421554565 (0.3325090706348419) | > loss_disc_real_5: 0.21713535487651825 (0.3320957809686661) | > loss_0: 2.7527594566345215 (2.5717443466186523) | > loss_gen: 2.1380414962768555 (2.8990849018096925) | > loss_kl: 4.754523754119873 (4.483993625640869) | > loss_feat: 7.143952369689941 (6.025157737731933) | > loss_mel: 23.627727508544922 (24.155881118774413) | > loss_duration: 3.3514301776885986 (3.1350292682647707) | > loss_1: 41.01567459106445 (40.6991470336914)  --> STEP: 2 | > loss_disc: 2.5456020832061768 (2.5673873027165732) | > loss_disc_real_0: 0.1677144169807434 (0.21207426115870476) | > loss_disc_real_1: 0.24827416241168976 (0.2606210658947627) | > loss_disc_real_2: 0.23420464992523193 (0.2600157856941223) | > loss_disc_real_3: 0.24363920092582703 (0.2865376149614652) | > loss_disc_real_4: 0.2975429594516754 (0.3266813854376475) | > loss_disc_real_5: 0.22653235495090485 (0.31450187663237256) | > loss_0: 2.5456020832061768 (2.5673873027165732) | > loss_gen: 2.067965507507324 (2.760565002759298) | > loss_kl: 5.727542877197266 (4.691251834233602) | > loss_feat: 2.6836533546447754 (5.46824034055074) | > loss_mel: 24.255523681640625 (24.17248821258545) | > loss_duration: 3.0934410095214844 (3.128097891807556) | > loss_1: 37.828125 (40.22064336140951)  --> STEP: 3 | > loss_disc: 3.1443891525268555 (2.6498161384037564) | > loss_disc_real_0: 0.6035504341125488 (0.2679994287235396) | > loss_disc_real_1: 0.3109954595565796 (0.2678174078464508) | > loss_disc_real_2: 0.3015301823616028 (0.26594641378947664) | > loss_disc_real_3: 0.2671239376068115 (0.283764232482229) | > loss_disc_real_4: 0.27358534932136536 (0.31909623742103577) | > loss_disc_real_5: 0.27225586771965027 (0.30846673250198364) | > loss_0: 3.1443891525268555 (2.6498161384037564) | > loss_gen: 2.1660566329956055 (2.6756352356501987) | > loss_kl: 2.516991376876831 (4.380643197468349) | > loss_feat: 0.9056333303451538 (4.8164393390928) | > loss_mel: 17.827404022216797 (23.266047613961355) | > loss_duration: 2.957671880722046 (3.1037513187953403) | > loss_1: 26.373756408691406 (38.24251665387835) --> EVAL PERFORMANCE | > avg_loader_time: 0.45849268777029856 (+0.44924641790844144) | > avg_loss_disc: 2.6498161384037564 (+0.07857563382103327) | > avg_loss_disc_real_0: 0.2679994287235396 (+0.10944839141198565) | > avg_loss_disc_real_1: 0.2678174078464508 (-0.020425433913866697) | > avg_loss_disc_real_2: 0.26594641378947664 (-0.06119135447910856) | > avg_loss_disc_real_3: 0.283764232482229 (-0.008119931533223101) | > avg_loss_disc_real_4: 0.31909623742103577 (+0.0806820640961329) | > avg_loss_disc_real_5: 0.30846673250198364 (+0.14393572509288788) | > avg_loss_0: 2.6498161384037564 (+0.07857563382103327) | > avg_loss_gen: 2.6756352356501987 (+0.41829381102607366) | > avg_loss_kl: 4.380643197468349 (+0.013117381504604175) | > avg_loss_feat: 4.8164393390928 (-0.5047273352032615) | > avg_loss_mel: 23.266047613961355 (+2.0937762033371676) | > avg_loss_duration: 3.1037513187953403 (-0.037766399837675824) | > avg_loss_1: 38.24251665387835 (+1.9826931726364876)  > EPOCH: 880/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:34:34)   --> TIME: 2023-10-20 10:34:52 -- STEP: 19/50 -- GLOBAL_STEP: 97020 | > loss_disc: 1.5418071746826172 (2.332310024060701) | > loss_disc_real_0: 0.032534159719944 (0.15346127121072067) | > loss_disc_real_1: 0.11692438274621964 (0.24539818928429954) | > loss_disc_real_2: 0.2038871943950653 (0.2437700127300463) | > loss_disc_real_3: 0.05595449358224869 (0.20541012738096087) | > loss_disc_real_4: 0.2550380527973175 (0.21933114371801676) | > loss_disc_real_5: 0.15701226890087128 (0.2144448686587183) | > loss_0: 1.5418071746826172 (2.332310024060701) | > grad_norm_0: tensor(240.1794, device='cuda:0') (tensor(682.9088, device='cuda:0')) | > loss_gen: 2.9999165534973145 (2.457806844460337) | > loss_kl: 0.7011402249336243 (0.7524280585348606) | > loss_feat: 8.76404094696045 (5.495743994650088) | > loss_mel: 22.502582550048828 (20.32485362730528) | > loss_duration: 1.4978097677230835 (1.4235153888401233) | > loss_1: 36.465492248535156 (30.454348237890947) | > grad_norm_1: tensor(21710.1250, device='cuda:0') (tensor(25755.2871, device='cuda:0')) | > current_lr_0: 8.295201946950084e-05 | > current_lr_1: 8.295201946950084e-05 | > step_time: 0.3155 (0.6520868351584986) | > loader_time: 0.0019 (0.01879748545194927)  --> TIME: 2023-10-20 10:35:07 -- STEP: 49/50 -- GLOBAL_STEP: 97050 | > loss_disc: 2.403569221496582 (2.4202625994779625) | > loss_disc_real_0: 0.035007160156965256 (0.14655585362747012) | > loss_disc_real_1: 0.1983272284269333 (0.23414707480340588) | > loss_disc_real_2: 0.1601044237613678 (0.2248785424293304) | > loss_disc_real_3: 0.2532026171684265 (0.23135679629536307) | > loss_disc_real_4: 0.2841528356075287 (0.222186325193972) | > loss_disc_real_5: 0.28690165281295776 (0.21788561606437576) | > loss_0: 2.403569221496582 (2.4202625994779625) | > grad_norm_0: tensor(1159.0779, device='cuda:0') (tensor(690.2820, device='cuda:0')) | > loss_gen: 2.0929737091064453 (2.3308428988164787) | > loss_kl: 0.5424813032150269 (0.8065607121252284) | > loss_feat: 2.3247740268707275 (5.246985156013041) | > loss_mel: 20.68995475769043 (20.559998890575102) | > loss_duration: 1.4852395057678223 (1.384817928684001) | > loss_1: 27.135421752929688 (30.32920571735927) | > grad_norm_1: tensor(7752.0459, device='cuda:0') (tensor(22031.6270, device='cuda:0')) | > current_lr_0: 8.295201946950084e-05 | > current_lr_1: 8.295201946950084e-05 | > step_time: 0.7626 (0.5369960191298504) | > loader_time: 0.7445 (0.02838610143077617)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.67401123046875 (2.67401123046875) | > loss_disc_real_0: 0.29697003960609436 (0.29697003960609436) | > loss_disc_real_1: 0.2691766917705536 (0.2691766917705536) | > loss_disc_real_2: 0.1962842047214508 (0.1962842047214508) | > loss_disc_real_3: 0.2727815806865692 (0.2727815806865692) | > loss_disc_real_4: 0.2386700063943863 (0.2386700063943863) | > loss_disc_real_5: 0.265372097492218 (0.265372097492218) | > loss_0: 2.67401123046875 (2.67401123046875) | > loss_gen: 2.0793347358703613 (2.0793347358703613) | > loss_kl: 5.882486820220947 (5.882486820220947) | > loss_feat: 4.111262321472168 (4.111262321472168) | > loss_mel: 18.13608741760254 (18.13608741760254) | > loss_duration: 3.066119432449341 (3.066119432449341) | > loss_1: 33.275291442871094 (33.275291442871094)  --> STEP: 1 | > loss_disc: 2.845022439956665 (2.845022439956665) | > loss_disc_real_0: 0.3034070134162903 (0.3034070134162903) | > loss_disc_real_1: 0.28283149003982544 (0.28283149003982544) | > loss_disc_real_2: 0.24132490158081055 (0.24132490158081055) | > loss_disc_real_3: 0.24646629393100739 (0.24646629393100739) | > loss_disc_real_4: 0.26619765162467957 (0.26619765162467957) | > loss_disc_real_5: 0.2573971152305603 (0.2573971152305603) | > loss_0: 2.845022439956665 (2.845022439956665) | > loss_gen: 1.8422751426696777 (1.8422751426696777) | > loss_kl: 5.242865562438965 (5.242865562438965) | > loss_feat: 0.5190933346748352 (0.5190933346748352) | > loss_mel: 13.675432205200195 (13.675432205200195) | > loss_duration: 3.417870044708252 (3.417870044708252) | > loss_1: 24.69753646850586 (24.69753646850586)  --> STEP: 2 | > loss_disc: 2.9954493045806885 (2.9202358722686768) | > loss_disc_real_0: 0.3490728735923767 (0.3262399435043335) | > loss_disc_real_1: 0.2850634753704071 (0.28394748270511627) | > loss_disc_real_2: 0.2574605941772461 (0.24939274787902832) | > loss_disc_real_3: 0.2508314251899719 (0.24864885956048965) | > loss_disc_real_4: 0.272230863571167 (0.2692142575979233) | > loss_disc_real_5: 0.2661677896976471 (0.2617824524641037) | > loss_0: 2.9954493045806885 (2.9202358722686768) | > loss_gen: 1.716817855834961 (1.7795464992523193) | > loss_kl: 5.636957168579102 (5.439911365509033) | > loss_feat: 0.07463251799345016 (0.2968629263341427) | > loss_mel: 3.6738879680633545 (8.674660086631775) | > loss_duration: 3.2765181064605713 (3.3471940755844116) | > loss_1: 14.378813743591309 (19.538175106048584)  --> STEP: 3 | > loss_disc: 2.2773313522338867 (2.7059343655904136) | > loss_disc_real_0: 0.28751468658447266 (0.31333152453104657) | > loss_disc_real_1: 0.18019142746925354 (0.2493621309598287) | > loss_disc_real_2: 0.24596421420574188 (0.24824990332126617) | > loss_disc_real_3: 0.20308566093444824 (0.23346112668514252) | > loss_disc_real_4: 0.2744540870189667 (0.27096086740493774) | > loss_disc_real_5: 0.3064294159412384 (0.2766647736231486) | > loss_0: 2.2773313522338867 (2.7059343655904136) | > loss_gen: 2.8030691146850586 (2.120720704396566) | > loss_kl: 2.4151644706726074 (4.431662400563558) | > loss_feat: 4.991393566131592 (1.8617064729332924) | > loss_mel: 19.03156280517578 (12.12696099281311) | > loss_duration: 2.9952433109283447 (3.229877154032389) | > loss_1: 32.23643493652344 (23.770928382873535) --> EVAL PERFORMANCE | > avg_loader_time: 0.019050995508829754 (-0.4394416922614688) | > avg_loss_disc: 2.7059343655904136 (+0.056118227186657155) | > avg_loss_disc_real_0: 0.31333152453104657 (+0.04533209580750697) | > avg_loss_disc_real_1: 0.2493621309598287 (-0.018455276886622102) | > avg_loss_disc_real_2: 0.24824990332126617 (-0.01769651046821047) | > avg_loss_disc_real_3: 0.23346112668514252 (-0.05030310579708647) | > avg_loss_disc_real_4: 0.27096086740493774 (-0.04813537001609802) | > avg_loss_disc_real_5: 0.2766647736231486 (-0.031801958878835024) | > avg_loss_0: 2.7059343655904136 (+0.056118227186657155) | > avg_loss_gen: 2.120720704396566 (-0.5549145312536328) | > avg_loss_kl: 4.431662400563558 (+0.051019203095208354) | > avg_loss_feat: 1.8617064729332924 (-2.9547328661595076) | > avg_loss_mel: 12.12696099281311 (-11.139086621148245) | > avg_loss_duration: 3.229877154032389 (+0.1261258352370489) | > avg_loss_1: 23.770928382873535 (-14.471588271004812)  > EPOCH: 881/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:35:19)   --> TIME: 2023-10-20 10:35:43 -- STEP: 29/50 -- GLOBAL_STEP: 97080 | > loss_disc: 2.385625123977661 (2.50086090893581) | > loss_disc_real_0: 0.03163545951247215 (0.14984748178514942) | > loss_disc_real_1: 0.23187611997127533 (0.23668380415645138) | > loss_disc_real_2: 0.5712847709655762 (0.24595111634196906) | > loss_disc_real_3: 0.26013341546058655 (0.23268358679167156) | > loss_disc_real_4: 0.25589248538017273 (0.21727818770912186) | > loss_disc_real_5: 0.3139786720275879 (0.215233460197161) | > loss_0: 2.385625123977661 (2.50086090893581) | > grad_norm_0: tensor(509.9063, device='cuda:0') (tensor(646.4033, device='cuda:0')) | > loss_gen: 2.965291976928711 (2.2989448391158005) | > loss_kl: 1.0401679277420044 (0.8894776249754017) | > loss_feat: 6.388473987579346 (5.7497349976208705) | > loss_mel: 24.2984619140625 (20.926173419787965) | > loss_duration: 1.398011565208435 (1.3932727698622078) | > loss_1: 36.09040832519531 (31.257603645324703) | > grad_norm_1: tensor(12643.6064, device='cuda:0') (tensor(21810.3535, device='cuda:0')) | > current_lr_0: 8.286910373246838e-05 | > current_lr_1: 8.286910373246838e-05 | > step_time: 0.7577 (0.6377792769464954) | > loader_time: 0.0332 (0.023291892018811457)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.5454165935516357 (3.5454165935516357) | > loss_disc_real_0: 0.47257187962532043 (0.47257187962532043) | > loss_disc_real_1: 0.36254292726516724 (0.36254292726516724) | > loss_disc_real_2: 0.3038424551486969 (0.3038424551486969) | > loss_disc_real_3: 0.4631947875022888 (0.4631947875022888) | > loss_disc_real_4: 0.47876250743865967 (0.47876250743865967) | > loss_disc_real_5: 0.41440683603286743 (0.41440683603286743) | > loss_0: 3.5454165935516357 (3.5454165935516357) | > loss_gen: 2.245412588119507 (2.245412588119507) | > loss_kl: 4.625298976898193 (4.625298976898193) | > loss_feat: 4.446804046630859 (4.446804046630859) | > loss_mel: 23.751239776611328 (23.751239776611328) | > loss_duration: 2.920642137527466 (2.920642137527466) | > loss_1: 37.98939514160156 (37.98939514160156)  --> STEP: 1 | > loss_disc: 2.962289333343506 (2.962289333343506) | > loss_disc_real_0: 0.609959065914154 (0.609959065914154) | > loss_disc_real_1: 0.37447649240493774 (0.37447649240493774) | > loss_disc_real_2: 0.28059786558151245 (0.28059786558151245) | > loss_disc_real_3: 0.34932059049606323 (0.34932059049606323) | > loss_disc_real_4: 0.2975890636444092 (0.2975890636444092) | > loss_disc_real_5: 0.4134434759616852 (0.4134434759616852) | > loss_0: 2.962289333343506 (2.962289333343506) | > loss_gen: 3.2412896156311035 (3.2412896156311035) | > loss_kl: 5.267168045043945 (5.267168045043945) | > loss_feat: 6.389824390411377 (6.389824390411377) | > loss_mel: 23.725109100341797 (23.725109100341797) | > loss_duration: 3.278897285461426 (3.278897285461426) | > loss_1: 41.90229034423828 (41.90229034423828)  --> STEP: 2 | > loss_disc: 2.984443426132202 (2.973366379737854) | > loss_disc_real_0: 0.3366152048110962 (0.4732871353626251) | > loss_disc_real_1: 0.24810723960399628 (0.311291866004467) | > loss_disc_real_2: 0.2650326192378998 (0.2728152424097061) | > loss_disc_real_3: 0.2738937437534332 (0.31160716712474823) | > loss_disc_real_4: 0.25816407799720764 (0.2778765708208084) | > loss_disc_real_5: 0.26133817434310913 (0.33739082515239716) | > loss_0: 2.984443426132202 (2.973366379737854) | > loss_gen: 1.6758368015289307 (2.458563208580017) | > loss_kl: 5.583676815032959 (5.425422430038452) | > loss_feat: 0.14306238293647766 (3.2664433866739273) | > loss_mel: 2.003596782684326 (12.864352941513062) | > loss_duration: 3.1087613105773926 (3.193829298019409) | > loss_1: 12.514934539794922 (27.2086124420166)  --> STEP: 3 | > loss_disc: 2.9364752769470215 (2.961069345474243) | > loss_disc_real_0: 0.33076906204223633 (0.42578111092249554) | > loss_disc_real_1: 0.25045567750930786 (0.2910131365060806) | > loss_disc_real_2: 0.26726290583610535 (0.2709644635518392) | > loss_disc_real_3: 0.27351468801498413 (0.2989096740881602) | > loss_disc_real_4: 0.25797924399375916 (0.2712441285451253) | > loss_disc_real_5: 0.26142698526382446 (0.3120695451895396) | > loss_0: 2.9364752769470215 (2.961069345474243) | > loss_gen: 1.7494969367980957 (2.22220778465271) | > loss_kl: 2.403704881668091 (4.418183247248332) | > loss_feat: 0.24275687336921692 (2.2585478822390237) | > loss_mel: 13.411097526550293 (13.046601136525473) | > loss_duration: 2.9576828479766846 (3.1151138146718345) | > loss_1: 20.764739990234375 (25.06065495808919) --> EVAL PERFORMANCE | > avg_loader_time: 0.0016871293385823567 (-0.017363866170247398) | > avg_loss_disc: 2.961069345474243 (+0.2551349798838296) | > avg_loss_disc_real_0: 0.42578111092249554 (+0.11244958639144897) | > avg_loss_disc_real_1: 0.2910131365060806 (+0.041651005546251924) | > avg_loss_disc_real_2: 0.2709644635518392 (+0.022714560230573) | > avg_loss_disc_real_3: 0.2989096740881602 (+0.0654485474030177) | > avg_loss_disc_real_4: 0.2712441285451253 (+0.0002832611401875629) | > avg_loss_disc_real_5: 0.3120695451895396 (+0.03540477156639099) | > avg_loss_0: 2.961069345474243 (+0.2551349798838296) | > avg_loss_gen: 2.22220778465271 (+0.10148708025614406) | > avg_loss_kl: 4.418183247248332 (-0.013479153315225645) | > avg_loss_feat: 2.2585478822390237 (+0.3968414093057313) | > avg_loss_mel: 13.046601136525473 (+0.9196401437123622) | > avg_loss_duration: 3.1151138146718345 (-0.11476333936055472) | > avg_loss_1: 25.06065495808919 (+1.2897265752156564)  > EPOCH: 882/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:36:11)   --> TIME: 2023-10-20 10:36:22 -- STEP: 9/50 -- GLOBAL_STEP: 97110 | > loss_disc: 3.1434171199798584 (2.2706635528140597) | > loss_disc_real_0: 0.5295836925506592 (0.1359732523560524) | > loss_disc_real_1: 0.2901918888092041 (0.2063787877559662) | > loss_disc_real_2: 0.3299901783466339 (0.2259386099047131) | > loss_disc_real_3: 0.43635204434394836 (0.26209906447264886) | > loss_disc_real_4: 0.29144352674484253 (0.20556726016932064) | > loss_disc_real_5: 0.3837588131427765 (0.19887034822669294) | > loss_0: 3.1434171199798584 (2.2706635528140597) | > grad_norm_0: tensor(576.9116, device='cuda:0') (tensor(505.4229, device='cuda:0')) | > loss_gen: 2.438124179840088 (2.5411893791622586) | > loss_kl: 0.9242866039276123 (0.8447778092490302) | > loss_feat: 4.182896614074707 (7.6145126024882) | > loss_mel: 22.100826263427734 (23.17853609720866) | > loss_duration: 1.305321455001831 (1.3670814169777765) | > loss_1: 30.951454162597656 (35.54609743754069) | > grad_norm_1: tensor(8423.3799, device='cuda:0') (tensor(34230.8828, device='cuda:0')) | > current_lr_0: 8.278627087490634e-05 | > current_lr_1: 8.278627087490634e-05 | > step_time: 0.5326 (0.6355085637834337) | > loader_time: 0.026 (0.016169071197509766)  --> TIME: 2023-10-20 10:36:42 -- STEP: 39/50 -- GLOBAL_STEP: 97140 | > loss_disc: 3.011389970779419 (2.506683438252179) | > loss_disc_real_0: 0.20611287653446198 (0.15701600231039217) | > loss_disc_real_1: 0.26132526993751526 (0.22344611374995646) | > loss_disc_real_2: 0.20075790584087372 (0.23307019949723512) | > loss_disc_real_3: 0.23160485923290253 (0.24800468541872808) | > loss_disc_real_4: 0.24253199994564056 (0.2441159145285686) | > loss_disc_real_5: 0.28400829434394836 (0.23631746844890025) | > loss_0: 3.011389970779419 (2.506683438252179) | > grad_norm_0: tensor(356.8512, device='cuda:0') (tensor(674.1893, device='cuda:0')) | > loss_gen: 1.4433467388153076 (2.3124531048994803) | > loss_kl: 0.5800037980079651 (0.8436937376092641) | > loss_feat: 0.009374686516821384 (5.458183772503756) | > loss_mel: 0.5925508141517639 (21.24372119322801) | > loss_duration: 1.421474575996399 (1.3651614861610608) | > loss_1: 4.046750545501709 (31.223213110214626) | > grad_norm_1: tensor(89832.2578, device='cuda:0') (tensor(19566.1309, device='cuda:0')) | > current_lr_0: 8.278627087490634e-05 | > current_lr_1: 8.278627087490634e-05 | > step_time: 1.2304 (0.6602873435387244) | > loader_time: 0.011 (0.021007788486969776)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.270223379135132 (3.270223379135132) | > loss_disc_real_0: 0.40924710035324097 (0.40924710035324097) | > loss_disc_real_1: 0.29306066036224365 (0.29306066036224365) | > loss_disc_real_2: 0.2350291907787323 (0.2350291907787323) | > loss_disc_real_3: 0.4499051570892334 (0.4499051570892334) | > loss_disc_real_4: 0.40382975339889526 (0.40382975339889526) | > loss_disc_real_5: 0.3668433427810669 (0.3668433427810669) | > loss_0: 3.270223379135132 (3.270223379135132) | > loss_gen: 2.237492322921753 (2.237492322921753) | > loss_kl: 4.666018486022949 (4.666018486022949) | > loss_feat: 5.422675132751465 (5.422675132751465) | > loss_mel: 25.879119873046875 (25.879119873046875) | > loss_duration: 2.9144256114959717 (2.9144256114959717) | > loss_1: 41.119728088378906 (41.119728088378906)  --> STEP: 1 | > loss_disc: 2.566586971282959 (2.566586971282959) | > loss_disc_real_0: 0.10249102860689163 (0.10249102860689163) | > loss_disc_real_1: 0.14767561852931976 (0.14767561852931976) | > loss_disc_real_2: 0.2624324560165405 (0.2624324560165405) | > loss_disc_real_3: 0.2045363038778305 (0.2045363038778305) | > loss_disc_real_4: 0.467627614736557 (0.467627614736557) | > loss_disc_real_5: 0.43245697021484375 (0.43245697021484375) | > loss_0: 2.566586971282959 (2.566586971282959) | > loss_gen: 2.3696208000183105 (2.3696208000183105) | > loss_kl: 5.313972473144531 (5.313972473144531) | > loss_feat: 6.574550628662109 (6.574550628662109) | > loss_mel: 26.474655151367188 (26.474655151367188) | > loss_duration: 3.251455068588257 (3.251455068588257) | > loss_1: 43.9842529296875 (43.9842529296875)  --> STEP: 2 | > loss_disc: 2.6005401611328125 (2.5835635662078857) | > loss_disc_real_0: 0.2229422628879547 (0.16271664574742317) | > loss_disc_real_1: 0.1736101359128952 (0.16064287722110748) | > loss_disc_real_2: 0.18405985832214355 (0.22324615716934204) | > loss_disc_real_3: 0.3016096353530884 (0.25307296961545944) | > loss_disc_real_4: 0.2565416097640991 (0.36208461225032806) | > loss_disc_real_5: 0.4530099332332611 (0.44273345172405243) | > loss_0: 2.6005401611328125 (2.5835635662078857) | > loss_gen: 2.2943177223205566 (2.3319692611694336) | > loss_kl: 5.405972003936768 (5.359972238540649) | > loss_feat: 5.238973140716553 (5.906761884689331) | > loss_mel: 23.414831161499023 (24.944743156433105) | > loss_duration: 3.143688917160034 (3.1975719928741455) | > loss_1: 39.49778366088867 (41.741018295288086)  --> STEP: 3 | > loss_disc: 2.204447031021118 (2.4571913878122964) | > loss_disc_real_0: 0.15110570192337036 (0.15884633113940558) | > loss_disc_real_1: 0.17579452693462372 (0.16569342712561289) | > loss_disc_real_2: 0.15612050890922546 (0.2008709410826365) | > loss_disc_real_3: 0.2557976245880127 (0.25398118793964386) | > loss_disc_real_4: 0.19776205718517303 (0.30731042722860974) | > loss_disc_real_5: 0.3320551812648773 (0.4058406949043274) | > loss_0: 2.204447031021118 (2.4571913878122964) | > loss_gen: 2.5274600982666016 (2.3971328735351562) | > loss_kl: 2.3565990924835205 (4.3588478565216064) | > loss_feat: 5.254823207855225 (5.689448992411296) | > loss_mel: 22.310827255249023 (24.066771189371746) | > loss_duration: 2.9574851989746094 (3.1175430615743003) | > loss_1: 35.40719223022461 (39.62974294026693) --> EVAL PERFORMANCE | > avg_loader_time: 0.005812406539916992 (+0.004125277201334636) | > avg_loss_disc: 2.4571913878122964 (-0.5038779576619468) | > avg_loss_disc_real_0: 0.15884633113940558 (-0.26693477978309) | > avg_loss_disc_real_1: 0.16569342712561289 (-0.12531970938046774) | > avg_loss_disc_real_2: 0.2008709410826365 (-0.07009352246920267) | > avg_loss_disc_real_3: 0.25398118793964386 (-0.044928486148516356) | > avg_loss_disc_real_4: 0.30731042722860974 (+0.03606629868348443) | > avg_loss_disc_real_5: 0.4058406949043274 (+0.09377114971478778) | > avg_loss_0: 2.4571913878122964 (-0.5038779576619468) | > avg_loss_gen: 2.3971328735351562 (+0.1749250888824463) | > avg_loss_kl: 4.3588478565216064 (-0.059335390726725556) | > avg_loss_feat: 5.689448992411296 (+3.430901110172272) | > avg_loss_mel: 24.066771189371746 (+11.020170052846273) | > avg_loss_duration: 3.1175430615743003 (+0.0024292469024658203) | > avg_loss_1: 39.62974294026693 (+14.569087982177738)  > EPOCH: 883/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:36:59)   --> TIME: 2023-10-20 10:37:15 -- STEP: 19/50 -- GLOBAL_STEP: 97170 | > loss_disc: 2.844491481781006 (2.5042664063604256) | > loss_disc_real_0: 0.027097178623080254 (0.13081633799562328) | > loss_disc_real_1: 0.12494385242462158 (0.22651234974986628) | > loss_disc_real_2: 0.10287320613861084 (0.23393661803320834) | > loss_disc_real_3: 0.1296156346797943 (0.2424607578861086) | > loss_disc_real_4: 0.10441387444734573 (0.19467527870284884) | > loss_disc_real_5: 0.14982903003692627 (0.22593337062158084) | > loss_0: 2.844491481781006 (2.5042664063604256) | > grad_norm_0: tensor(679.4486, device='cuda:0') (tensor(679.7939, device='cuda:0')) | > loss_gen: 1.6380157470703125 (2.2197071439341496) | > loss_kl: 0.9795692563056946 (0.7466214858975849) | > loss_feat: 7.503520488739014 (5.3299932558285565) | > loss_mel: 26.97861099243164 (21.919007125653717) | > loss_duration: 1.4474575519561768 (1.393872110467208) | > loss_1: 38.54717254638672 (31.609201330887643) | > grad_norm_1: tensor(12589.1260, device='cuda:0') (tensor(19698.2168, device='cuda:0')) | > current_lr_0: 8.27035208139716e-05 | > current_lr_1: 8.27035208139716e-05 | > step_time: 0.5568 (0.5294443808103863) | > loader_time: 0.0121 (0.014675341154399672)  --> TIME: 2023-10-20 10:37:28 -- STEP: 49/50 -- GLOBAL_STEP: 97200 | > loss_disc: 2.1176259517669678 (2.4648495158370642) | > loss_disc_real_0: 0.15642789006233215 (0.13940631913743456) | > loss_disc_real_1: 0.16968446969985962 (0.22353659904732995) | > loss_disc_real_2: 0.11304669082164764 (0.22547348341619483) | > loss_disc_real_3: 0.20313507318496704 (0.23474819273972997) | > loss_disc_real_4: 0.17429500818252563 (0.2241046452248583) | > loss_disc_real_5: 0.26288795471191406 (0.2333804958176856) | > loss_0: 2.1176259517669678 (2.4648495158370642) | > grad_norm_0: tensor(1206.3981, device='cuda:0') (tensor(645.4011, device='cuda:0')) | > loss_gen: 2.824568271636963 (2.320911932964714) | > loss_kl: 0.6654293537139893 (0.7656133270309288) | > loss_feat: 7.095613479614258 (5.674029039333061) | > loss_mel: 25.84714698791504 (21.32002252948528) | > loss_duration: 1.4776991605758667 (1.3747181284184355) | > loss_1: 37.910457611083984 (31.455295076175606) | > grad_norm_1: tensor(39222.9961, device='cuda:0') (tensor(20910.7656, device='cuda:0')) | > current_lr_0: 8.27035208139716e-05 | > current_lr_1: 8.27035208139716e-05 | > step_time: 0.7829 (0.45317844468720103) | > loader_time: 0.434 (0.01983137033423599)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1528191566467285 (3.1528191566467285) | > loss_disc_real_0: 0.31489402055740356 (0.31489402055740356) | > loss_disc_real_1: 0.3368050456047058 (0.3368050456047058) | > loss_disc_real_2: 0.42422568798065186 (0.42422568798065186) | > loss_disc_real_3: 0.3350553512573242 (0.3350553512573242) | > loss_disc_real_4: 0.19738656282424927 (0.19738656282424927) | > loss_disc_real_5: 0.3423568904399872 (0.3423568904399872) | > loss_0: 3.1528191566467285 (3.1528191566467285) | > loss_gen: 1.9739936590194702 (1.9739936590194702) | > loss_kl: 4.640703201293945 (4.640703201293945) | > loss_feat: 3.885693311691284 (3.885693311691284) | > loss_mel: 21.92354393005371 (21.92354393005371) | > loss_duration: 2.948087453842163 (2.948087453842163) | > loss_1: 35.37202072143555 (35.37202072143555)  --> STEP: 1 | > loss_disc: 2.7925941944122314 (2.7925941944122314) | > loss_disc_real_0: 0.16666319966316223 (0.16666319966316223) | > loss_disc_real_1: 0.4528730511665344 (0.4528730511665344) | > loss_disc_real_2: 0.3911513686180115 (0.3911513686180115) | > loss_disc_real_3: 0.2812251150608063 (0.2812251150608063) | > loss_disc_real_4: 0.24039532244205475 (0.24039532244205475) | > loss_disc_real_5: 0.4470604360103607 (0.4470604360103607) | > loss_0: 2.7925941944122314 (2.7925941944122314) | > loss_gen: 2.7840166091918945 (2.7840166091918945) | > loss_kl: 4.899998664855957 (4.899998664855957) | > loss_feat: 6.412306785583496 (6.412306785583496) | > loss_mel: 19.98351287841797 (19.98351287841797) | > loss_duration: 3.398163318634033 (3.398163318634033) | > loss_1: 37.477996826171875 (37.477996826171875)  --> STEP: 2 | > loss_disc: 2.7598533630371094 (2.7762237787246704) | > loss_disc_real_0: 0.03687680512666702 (0.10177000239491463) | > loss_disc_real_1: 0.28816869854927063 (0.3705208748579025) | > loss_disc_real_2: 0.36150413751602173 (0.3763277530670166) | > loss_disc_real_3: 0.3427969813346863 (0.3120110481977463) | > loss_disc_real_4: 0.23021019995212555 (0.23530276119709015) | > loss_disc_real_5: 0.2797715663909912 (0.36341600120067596) | > loss_0: 2.7598533630371094 (2.7762237787246704) | > loss_gen: 1.9024916887283325 (2.3432541489601135) | > loss_kl: 5.145747661590576 (5.022873163223267) | > loss_feat: 2.446958065032959 (4.4296324253082275) | > loss_mel: 22.925045013427734 (21.45427894592285) | > loss_duration: 3.2067959308624268 (3.30247962474823) | > loss_1: 35.627037048339844 (36.55251693725586)  --> STEP: 3 | > loss_disc: 3.004127025604248 (2.8521915276845298) | > loss_disc_real_0: 0.09686218202114105 (0.10013406227032344) | > loss_disc_real_1: 0.26347512006759644 (0.33483895659446716) | > loss_disc_real_2: 0.2730422914028168 (0.34189926584561664) | > loss_disc_real_3: 0.31740260124206543 (0.31380823254585266) | > loss_disc_real_4: 0.26399630308151245 (0.24486727515856424) | > loss_disc_real_5: 0.2522483766078949 (0.3263601263364156) | > loss_0: 3.004127025604248 (2.8521915276845298) | > loss_gen: 1.5097373723983765 (2.0654152234395347) | > loss_kl: 2.342221975326538 (4.12932276725769) | > loss_feat: 0.1966979056596756 (3.0186542520920434) | > loss_mel: 13.581998825073242 (18.830185572306316) | > loss_duration: 2.9551432132720947 (3.1867008209228516) | > loss_1: 20.585798263549805 (31.23027737935384) --> EVAL PERFORMANCE | > avg_loader_time: 0.019725958506266277 (+0.013913551966349285) | > avg_loss_disc: 2.8521915276845298 (+0.39500013987223337) | > avg_loss_disc_real_0: 0.10013406227032344 (-0.05871226886908214) | > avg_loss_disc_real_1: 0.33483895659446716 (+0.16914552946885428) | > avg_loss_disc_real_2: 0.34189926584561664 (+0.14102832476298013) | > avg_loss_disc_real_3: 0.31380823254585266 (+0.0598270446062088) | > avg_loss_disc_real_4: 0.24486727515856424 (-0.0624431520700455) | > avg_loss_disc_real_5: 0.3263601263364156 (-0.0794805685679118) | > avg_loss_0: 2.8521915276845298 (+0.39500013987223337) | > avg_loss_gen: 2.0654152234395347 (-0.3317176500956216) | > avg_loss_kl: 4.12932276725769 (-0.22952508926391602) | > avg_loss_feat: 3.0186542520920434 (-2.6707947403192525) | > avg_loss_mel: 18.830185572306316 (-5.23658561706543) | > avg_loss_duration: 3.1867008209228516 (+0.06915775934855128) | > avg_loss_1: 31.23027737935384 (-8.39946556091309)  > EPOCH: 884/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:37:50)   --> TIME: 2023-10-20 10:38:16 -- STEP: 29/50 -- GLOBAL_STEP: 97230 | > loss_disc: 2.0310516357421875 (2.402579689848012) | > loss_disc_real_0: 0.05169026926159859 (0.12048671394586563) | > loss_disc_real_1: 0.2614056169986725 (0.224817822976359) | > loss_disc_real_2: 0.18692968785762787 (0.22936379768211265) | > loss_disc_real_3: 0.23362791538238525 (0.237164578047292) | > loss_disc_real_4: 0.18769396841526031 (0.21098106585699936) | > loss_disc_real_5: 0.18468964099884033 (0.2020323547566759) | > loss_0: 2.0310516357421875 (2.402579689848012) | > grad_norm_0: tensor(222.9053, device='cuda:0') (tensor(555.8303, device='cuda:0')) | > loss_gen: 2.610089063644409 (2.4084935434933366) | > loss_kl: 1.1513671875 (0.8150317632946474) | > loss_feat: 6.260420322418213 (6.219398012449002) | > loss_mel: 21.147119522094727 (21.366450334417408) | > loss_duration: 1.3529709577560425 (1.3820975648945775) | > loss_1: 32.52196502685547 (32.19147116562415) | > grad_norm_1: tensor(10308.1650, device='cuda:0') (tensor(24006.5293, device='cuda:0')) | > current_lr_0: 8.262085346690368e-05 | > current_lr_1: 8.262085346690368e-05 | > step_time: 0.3422 (0.601220098035089) | > loader_time: 0.0032 (0.02331079285720299)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.981553554534912 (1.981553554534912) | > loss_disc_real_0: 0.20990122854709625 (0.20990122854709625) | > loss_disc_real_1: 0.26046043634414673 (0.26046043634414673) | > loss_disc_real_2: 0.22192035615444183 (0.22192035615444183) | > loss_disc_real_3: 0.10364936292171478 (0.10364936292171478) | > loss_disc_real_4: 0.1221819669008255 (0.1221819669008255) | > loss_disc_real_5: 0.16500858962535858 (0.16500858962535858) | > loss_0: 1.981553554534912 (1.981553554534912) | > loss_gen: 2.5421135425567627 (2.5421135425567627) | > loss_kl: 5.862997055053711 (5.862997055053711) | > loss_feat: 8.955012321472168 (8.955012321472168) | > loss_mel: 22.21054458618164 (22.21054458618164) | > loss_duration: 2.979360342025757 (2.979360342025757) | > loss_1: 42.550025939941406 (42.550025939941406)  --> STEP: 1 | > loss_disc: 2.39486026763916 (2.39486026763916) | > loss_disc_real_0: 0.22320638597011566 (0.22320638597011566) | > loss_disc_real_1: 0.15526093542575836 (0.15526093542575836) | > loss_disc_real_2: 0.09279605746269226 (0.09279605746269226) | > loss_disc_real_3: 0.1874428242444992 (0.1874428242444992) | > loss_disc_real_4: 0.21174535155296326 (0.21174535155296326) | > loss_disc_real_5: 0.23777933418750763 (0.23777933418750763) | > loss_0: 2.39486026763916 (2.39486026763916) | > loss_gen: 1.9825066328048706 (1.9825066328048706) | > loss_kl: 5.110883712768555 (5.110883712768555) | > loss_feat: 5.270505905151367 (5.270505905151367) | > loss_mel: 26.15960693359375 (26.15960693359375) | > loss_duration: 3.2905631065368652 (3.2905631065368652) | > loss_1: 41.814064025878906 (41.814064025878906)  --> STEP: 2 | > loss_disc: 2.7721824645996094 (2.5835213661193848) | > loss_disc_real_0: 0.06384216248989105 (0.14352427423000336) | > loss_disc_real_1: 0.269823282957077 (0.2125421091914177) | > loss_disc_real_2: 0.32657238841056824 (0.20968422293663025) | > loss_disc_real_3: 0.2409847229719162 (0.2142137736082077) | > loss_disc_real_4: 0.2320587933063507 (0.22190207242965698) | > loss_disc_real_5: 0.33704063296318054 (0.2874099835753441) | > loss_0: 2.7721824645996094 (2.5835213661193848) | > loss_gen: 2.2333993911743164 (2.1079530119895935) | > loss_kl: 5.4429826736450195 (5.276933193206787) | > loss_feat: 7.6248602867126465 (6.447683095932007) | > loss_mel: 26.839017868041992 (26.49931240081787) | > loss_duration: 3.1738698482513428 (3.232216477394104) | > loss_1: 45.31412887573242 (43.564096450805664)  --> STEP: 3 | > loss_disc: 2.975329875946045 (2.7141242027282715) | > loss_disc_real_0: 0.38888493180274963 (0.22531116008758545) | > loss_disc_real_1: 0.2726369798183441 (0.2325737327337265) | > loss_disc_real_2: 0.1404871791601181 (0.18661854167779288) | > loss_disc_real_3: 0.3502342104911804 (0.2595539192358653) | > loss_disc_real_4: 0.21007253229618073 (0.2179588923851649) | > loss_disc_real_5: 0.226148322224617 (0.2669894297917684) | > loss_0: 2.975329875946045 (2.7141242027282715) | > loss_gen: 1.9553484916687012 (2.057084838549296) | > loss_kl: 2.6832494735717773 (4.41237195332845) | > loss_feat: 3.704169273376465 (5.533178488413493) | > loss_mel: 20.77577781677246 (24.591467539469402) | > loss_duration: 3.0299153327941895 (3.164782762527466) | > loss_1: 32.148460388183594 (39.75888442993164) --> EVAL PERFORMANCE | > avg_loader_time: 0.0065966447194417315 (-0.013129313786824547) | > avg_loss_disc: 2.7141242027282715 (-0.13806732495625829) | > avg_loss_disc_real_0: 0.22531116008758545 (+0.125177097817262) | > avg_loss_disc_real_1: 0.2325737327337265 (-0.10226522386074066) | > avg_loss_disc_real_2: 0.18661854167779288 (-0.15528072416782376) | > avg_loss_disc_real_3: 0.2595539192358653 (-0.05425431330998737) | > avg_loss_disc_real_4: 0.2179588923851649 (-0.026908382773399353) | > avg_loss_disc_real_5: 0.2669894297917684 (-0.05937069654464722) | > avg_loss_0: 2.7141242027282715 (-0.13806732495625829) | > avg_loss_gen: 2.057084838549296 (-0.00833038489023874) | > avg_loss_kl: 4.41237195332845 (+0.2830491860707598) | > avg_loss_feat: 5.533178488413493 (+2.5145242363214497) | > avg_loss_mel: 24.591467539469402 (+5.761281967163086) | > avg_loss_duration: 3.164782762527466 (-0.021918058395385742) | > avg_loss_1: 39.75888442993164 (+8.5286070505778)  > EPOCH: 885/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:38:43)   --> TIME: 2023-10-20 10:38:53 -- STEP: 9/50 -- GLOBAL_STEP: 97260 | > loss_disc: 2.7530012130737305 (2.296762545903524) | > loss_disc_real_0: 0.10306009650230408 (0.11767255928781298) | > loss_disc_real_1: 0.27697333693504333 (0.2352285244398647) | > loss_disc_real_2: 0.22194859385490417 (0.23191221886210972) | > loss_disc_real_3: 0.3512241244316101 (0.24262075622876486) | > loss_disc_real_4: 0.32162895798683167 (0.19399498320288128) | > loss_disc_real_5: 0.32784879207611084 (0.18325105433662733) | > loss_0: 2.7530012130737305 (2.296762545903524) | > grad_norm_0: tensor(338.8244, device='cuda:0') (tensor(442.7468, device='cuda:0')) | > loss_gen: 1.9745278358459473 (2.4405685000949435) | > loss_kl: 0.8627769351005554 (0.9285998079511855) | > loss_feat: 1.9958524703979492 (6.485995610555013) | > loss_mel: 21.401548385620117 (22.51612154642741) | > loss_duration: 1.2966097593307495 (1.3772370550367568) | > loss_1: 27.531314849853516 (33.74852265252007) | > grad_norm_1: tensor(3122.7285, device='cuda:0') (tensor(22541.2969, device='cuda:0')) | > current_lr_0: 8.25382687510249e-05 | > current_lr_1: 8.25382687510249e-05 | > step_time: 0.2828 (0.4649341106414795) | > loader_time: 0.0023 (0.013631105422973633)  --> TIME: 2023-10-20 10:39:12 -- STEP: 39/50 -- GLOBAL_STEP: 97290 | > loss_disc: 2.530322790145874 (2.3873403133490143) | > loss_disc_real_0: 0.2118256390094757 (0.14154541411269936) | > loss_disc_real_1: 0.2409517467021942 (0.21566358829538027) | > loss_disc_real_2: 0.2783392369747162 (0.22198458569936264) | > loss_disc_real_3: 0.2331620752811432 (0.22596329546127564) | > loss_disc_real_4: 0.2405790090560913 (0.224214994850067) | > loss_disc_real_5: 0.2507076561450958 (0.226026834299167) | > loss_0: 2.530322790145874 (2.3873403133490143) | > grad_norm_0: tensor(641.0541, device='cuda:0') (tensor(618.0535, device='cuda:0')) | > loss_gen: 2.0480380058288574 (2.324612015332931) | > loss_kl: 0.6605346202850342 (0.8450104678288485) | > loss_feat: 2.192866802215576 (5.299280947026534) | > loss_mel: 20.139806747436523 (20.320627768834434) | > loss_duration: 1.500010371208191 (1.376246106930268) | > loss_1: 26.541255950927734 (30.165777548765526) | > grad_norm_1: tensor(7006.2764, device='cuda:0') (tensor(24913.9961, device='cuda:0')) | > current_lr_0: 8.25382687510249e-05 | > current_lr_1: 8.25382687510249e-05 | > step_time: 1.3355 (0.5820665604028946) | > loader_time: 0.0265 (0.017983699456239358)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.96187162399292 (2.96187162399292) | > loss_disc_real_0: 0.23461836576461792 (0.23461836576461792) | > loss_disc_real_1: 0.24662530422210693 (0.24662530422210693) | > loss_disc_real_2: 0.23470266163349152 (0.23470266163349152) | > loss_disc_real_3: 0.34795069694519043 (0.34795069694519043) | > loss_disc_real_4: 0.346474289894104 (0.346474289894104) | > loss_disc_real_5: 0.39836156368255615 (0.39836156368255615) | > loss_0: 2.96187162399292 (2.96187162399292) | > loss_gen: 2.201031446456909 (2.201031446456909) | > loss_kl: 5.5637078285217285 (5.5637078285217285) | > loss_feat: 5.078840732574463 (5.078840732574463) | > loss_mel: 24.7215633392334 (24.7215633392334) | > loss_duration: 2.9012677669525146 (2.9012677669525146) | > loss_1: 40.46641159057617 (40.46641159057617)  --> STEP: 1 | > loss_disc: 2.395749568939209 (2.395749568939209) | > loss_disc_real_0: 0.14160437881946564 (0.14160437881946564) | > loss_disc_real_1: 0.22440233826637268 (0.22440233826637268) | > loss_disc_real_2: 0.20480628311634064 (0.20480628311634064) | > loss_disc_real_3: 0.10651032626628876 (0.10651032626628876) | > loss_disc_real_4: 0.3731667697429657 (0.3731667697429657) | > loss_disc_real_5: 0.45411059260368347 (0.45411059260368347) | > loss_0: 2.395749568939209 (2.395749568939209) | > loss_gen: 2.5124247074127197 (2.5124247074127197) | > loss_kl: 5.170206546783447 (5.170206546783447) | > loss_feat: 6.858981609344482 (6.858981609344482) | > loss_mel: 23.699766159057617 (23.699766159057617) | > loss_duration: 3.30963134765625 (3.30963134765625) | > loss_1: 41.55101013183594 (41.55101013183594)  --> STEP: 2 | > loss_disc: 2.7260072231292725 (2.5608783960342407) | > loss_disc_real_0: 0.24660030007362366 (0.19410233944654465) | > loss_disc_real_1: 0.2654596269130707 (0.24493098258972168) | > loss_disc_real_2: 0.163364976644516 (0.18408562988042831) | > loss_disc_real_3: 0.1878565549850464 (0.14718344062566757) | > loss_disc_real_4: 0.2352241575717926 (0.30419546365737915) | > loss_disc_real_5: 0.359765887260437 (0.40693823993206024) | > loss_0: 2.7260072231292725 (2.5608783960342407) | > loss_gen: 2.5428271293640137 (2.5276259183883667) | > loss_kl: 5.3951191902160645 (5.282662868499756) | > loss_feat: 7.492616176605225 (7.1757988929748535) | > loss_mel: 22.867984771728516 (23.283875465393066) | > loss_duration: 3.028432607650757 (3.1690319776535034) | > loss_1: 41.32698059082031 (41.438995361328125)  --> STEP: 3 | > loss_disc: 2.7559967041015625 (2.625917832056681) | > loss_disc_real_0: 0.23619505763053894 (0.20813324550787607) | > loss_disc_real_1: 0.34212079644203186 (0.2773275872071584) | > loss_disc_real_2: 0.3922315537929535 (0.2534676045179367) | > loss_disc_real_3: 0.3915276527404785 (0.22863151133060455) | > loss_disc_real_4: 0.24864451587200165 (0.2856784810622533) | > loss_disc_real_5: 0.47474294900894165 (0.42953980962435406) | > loss_0: 2.7559967041015625 (2.625917832056681) | > loss_gen: 3.099409580230713 (2.7182204723358154) | > loss_kl: 2.485600471496582 (4.350308736165364) | > loss_feat: 4.566740989685059 (6.306112925211589) | > loss_mel: 22.908924102783203 (23.158891677856445) | > loss_duration: 2.898232936859131 (3.078765630722046) | > loss_1: 35.95890808105469 (39.61229960123698) --> EVAL PERFORMANCE | > avg_loader_time: 0.014226436614990234 (+0.007629791895548503) | > avg_loss_disc: 2.625917832056681 (-0.08820637067159032) | > avg_loss_disc_real_0: 0.20813324550787607 (-0.01717791457970938) | > avg_loss_disc_real_1: 0.2773275872071584 (+0.04475385447343189) | > avg_loss_disc_real_2: 0.2534676045179367 (+0.06684906284014383) | > avg_loss_disc_real_3: 0.22863151133060455 (-0.03092240790526074) | > avg_loss_disc_real_4: 0.2856784810622533 (+0.06771958867708841) | > avg_loss_disc_real_5: 0.42953980962435406 (+0.1625503798325857) | > avg_loss_0: 2.625917832056681 (-0.08820637067159032) | > avg_loss_gen: 2.7182204723358154 (+0.6611356337865195) | > avg_loss_kl: 4.350308736165364 (-0.06206321716308594) | > avg_loss_feat: 6.306112925211589 (+0.7729344367980957) | > avg_loss_mel: 23.158891677856445 (-1.432575861612957) | > avg_loss_duration: 3.078765630722046 (-0.08601713180541992) | > avg_loss_1: 39.61229960123698 (-0.14658482869466383)  > EPOCH: 886/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:39:32)   --> TIME: 2023-10-20 10:39:47 -- STEP: 19/50 -- GLOBAL_STEP: 97320 | > loss_disc: 3.138517141342163 (2.2934151762410213) | > loss_disc_real_0: 0.10254128277301788 (0.11254336047721536) | > loss_disc_real_1: 0.24109843373298645 (0.21273334500821015) | > loss_disc_real_2: 0.4512743353843689 (0.2461607174849824) | > loss_disc_real_3: 0.45671209692955017 (0.22540642272092795) | > loss_disc_real_4: 0.28025299310684204 (0.21697141602635384) | > loss_disc_real_5: 0.33217182755470276 (0.19363340627598136) | > loss_0: 3.138517141342163 (2.2934151762410213) | > grad_norm_0: tensor(589.1824, device='cuda:0') (tensor(560.4778, device='cuda:0')) | > loss_gen: 2.3349356651306152 (2.6005137531380904) | > loss_kl: 0.8630755543708801 (0.7511867069100079) | > loss_feat: 4.179376125335693 (6.88786241961153) | > loss_mel: 19.03571891784668 (23.008633688876504) | > loss_duration: 1.4590803384780884 (1.401686800153632) | > loss_1: 27.8721866607666 (34.64988397297106) | > grad_norm_1: tensor(16285.2432, device='cuda:0') (tensor(36381.1172, device='cuda:0')) | > current_lr_0: 8.245576658374022e-05 | > current_lr_1: 8.245576658374022e-05 | > step_time: 0.3555 (0.5169976510499653) | > loader_time: 0.0019 (0.020789485228689092)  --> TIME: 2023-10-20 10:40:07 -- STEP: 49/50 -- GLOBAL_STEP: 97350 | > loss_disc: 3.019768476486206 (2.464033878579432) | > loss_disc_real_0: 0.0893779993057251 (0.12032310117264183) | > loss_disc_real_1: 0.3382358253002167 (0.2186972399299242) | > loss_disc_real_2: 0.28012964129447937 (0.23546017330063848) | > loss_disc_real_3: 0.2943352162837982 (0.24735843097524987) | > loss_disc_real_4: 0.28393760323524475 (0.23248950696113158) | > loss_disc_real_5: 0.26323890686035156 (0.22917350963214222) | > loss_0: 3.019768476486206 (2.464033878579432) | > grad_norm_0: tensor(1134.3956, device='cuda:0') (tensor(673.3526, device='cuda:0')) | > loss_gen: 1.8067107200622559 (2.353467374431844) | > loss_kl: 0.6209943294525146 (0.7704967447385496) | > loss_feat: 2.724341630935669 (5.684024050071532) | > loss_mel: 21.210832595825195 (21.66904568915464) | > loss_duration: 1.4798556566238403 (1.3696791663461803) | > loss_1: 27.842735290527344 (31.846713319116706) | > grad_norm_1: tensor(2812.9238, device='cuda:0') (tensor(21269.4844, device='cuda:0')) | > current_lr_0: 8.245576658374022e-05 | > current_lr_1: 8.245576658374022e-05 | > step_time: 0.6959 (0.5807058908501452) | > loader_time: 0.5471 (0.030846590898474868)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8986716270446777 (2.8986716270446777) | > loss_disc_real_0: 0.2553936839103699 (0.2553936839103699) | > loss_disc_real_1: 0.2743460536003113 (0.2743460536003113) | > loss_disc_real_2: 0.17418864369392395 (0.17418864369392395) | > loss_disc_real_3: 0.2650638818740845 (0.2650638818740845) | > loss_disc_real_4: 0.29971468448638916 (0.29971468448638916) | > loss_disc_real_5: 0.24684835970401764 (0.24684835970401764) | > loss_0: 2.8986716270446777 (2.8986716270446777) | > loss_gen: 1.6978532075881958 (1.6978532075881958) | > loss_kl: 3.955789804458618 (3.955789804458618) | > loss_feat: 1.2723443508148193 (1.2723443508148193) | > loss_mel: 16.203872680664062 (16.203872680664062) | > loss_duration: 2.829519510269165 (2.829519510269165) | > loss_1: 25.959379196166992 (25.959379196166992)  --> STEP: 1 | > loss_disc: 2.9075424671173096 (2.9075424671173096) | > loss_disc_real_0: 0.37645888328552246 (0.37645888328552246) | > loss_disc_real_1: 0.174352765083313 (0.174352765083313) | > loss_disc_real_2: 0.21386393904685974 (0.21386393904685974) | > loss_disc_real_3: 0.2625257074832916 (0.2625257074832916) | > loss_disc_real_4: 0.29328301548957825 (0.29328301548957825) | > loss_disc_real_5: 0.23164474964141846 (0.23164474964141846) | > loss_0: 2.9075424671173096 (2.9075424671173096) | > loss_gen: 1.9873590469360352 (1.9873590469360352) | > loss_kl: 4.492341041564941 (4.492341041564941) | > loss_feat: 7.186061859130859 (7.186061859130859) | > loss_mel: 22.27044105529785 (22.27044105529785) | > loss_duration: 3.251279354095459 (3.251279354095459) | > loss_1: 39.18748092651367 (39.18748092651367)  --> STEP: 2 | > loss_disc: 2.8847689628601074 (2.8961557149887085) | > loss_disc_real_0: 0.5292171239852905 (0.4528380036354065) | > loss_disc_real_1: 0.20041851699352264 (0.18738564103841782) | > loss_disc_real_2: 0.24970358610153198 (0.23178376257419586) | > loss_disc_real_3: 0.3559189736843109 (0.30922234058380127) | > loss_disc_real_4: 0.15424266457557678 (0.22376284003257751) | > loss_disc_real_5: 0.2768484950065613 (0.25424662232398987) | > loss_0: 2.8847689628601074 (2.8961557149887085) | > loss_gen: 2.5282223224639893 (2.257790684700012) | > loss_kl: 5.785048961639404 (5.138695001602173) | > loss_feat: 8.285481452941895 (7.735771656036377) | > loss_mel: 21.730026245117188 (22.00023365020752) | > loss_duration: 3.114058017730713 (3.182668685913086) | > loss_1: 41.44283676147461 (40.31515884399414)  --> STEP: 3 | > loss_disc: 2.5215821266174316 (2.7712978521982827) | > loss_disc_real_0: 0.1324320137500763 (0.3460360070069631) | > loss_disc_real_1: 0.23701781034469604 (0.2039296974738439) | > loss_disc_real_2: 0.15839074552059174 (0.20731942355632782) | > loss_disc_real_3: 0.30606988072395325 (0.3081715206305186) | > loss_disc_real_4: 0.29315611720085144 (0.24689393242200217) | > loss_disc_real_5: 0.28891533613204956 (0.26580286026000977) | > loss_0: 2.5215821266174316 (2.7712978521982827) | > loss_gen: 2.1531190872192383 (2.222900152206421) | > loss_kl: 2.498368263244629 (4.258586088816325) | > loss_feat: 2.837801694869995 (6.10311500231425) | > loss_mel: 19.887800216674805 (21.29608917236328) | > loss_duration: 2.960413694381714 (3.108583688735962) | > loss_1: 30.33750343322754 (36.98927370707194) --> EVAL PERFORMANCE | > avg_loader_time: 0.01911298433939616 (+0.004886547724405926) | > avg_loss_disc: 2.7712978521982827 (+0.14538002014160156) | > avg_loss_disc_real_0: 0.3460360070069631 (+0.137902761499087) | > avg_loss_disc_real_1: 0.2039296974738439 (-0.07339788973331449) | > avg_loss_disc_real_2: 0.20731942355632782 (-0.04614818096160889) | > avg_loss_disc_real_3: 0.3081715206305186 (+0.07954000929991406) | > avg_loss_disc_real_4: 0.24689393242200217 (-0.03878454864025113) | > avg_loss_disc_real_5: 0.26580286026000977 (-0.1637369493643443) | > avg_loss_0: 2.7712978521982827 (+0.14538002014160156) | > avg_loss_gen: 2.222900152206421 (-0.49532032012939453) | > avg_loss_kl: 4.258586088816325 (-0.09172264734903912) | > avg_loss_feat: 6.10311500231425 (-0.20299792289733887) | > avg_loss_mel: 21.29608917236328 (-1.862802505493164) | > avg_loss_duration: 3.108583688735962 (+0.029818058013916016) | > avg_loss_1: 36.98927370707194 (-2.623025894165039)  > EPOCH: 887/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:40:24)   --> TIME: 2023-10-20 10:40:41 -- STEP: 29/50 -- GLOBAL_STEP: 97380 | > loss_disc: 2.96862530708313 (2.606139022728492) | > loss_disc_real_0: 0.19997593760490417 (0.1643547134088545) | > loss_disc_real_1: 0.36761966347694397 (0.2309146129751) | > loss_disc_real_2: 0.40433648228645325 (0.24245606806000758) | > loss_disc_real_3: 0.3261224925518036 (0.23776328820606757) | > loss_disc_real_4: 0.36003798246383667 (0.25318660253080827) | > loss_disc_real_5: 0.24779723584651947 (0.27227619511942414) | > loss_0: 2.96862530708313 (2.606139022728492) | > grad_norm_0: tensor(536.2385, device='cuda:0') (tensor(627.6110, device='cuda:0')) | > loss_gen: 2.7593536376953125 (2.198712706565857) | > loss_kl: 0.5682750940322876 (0.7900088172534416) | > loss_feat: 5.029596328735352 (4.843229675858185) | > loss_mel: 22.223608016967773 (19.63670454354122) | > loss_duration: 1.3719838857650757 (1.3800581241476124) | > loss_1: 31.952817916870117 (28.84871352952102) | > grad_norm_1: tensor(9566.9502, device='cuda:0') (tensor(20569.2480, device='cuda:0')) | > current_lr_0: 8.237334688253713e-05 | > current_lr_1: 8.237334688253713e-05 | > step_time: 0.3387 (0.3820126221097749) | > loader_time: 0.0023 (0.008546936100926895)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.459562301635742 (3.459562301635742) | > loss_disc_real_0: 0.5435112714767456 (0.5435112714767456) | > loss_disc_real_1: 0.2682715356349945 (0.2682715356349945) | > loss_disc_real_2: 0.3160764276981354 (0.3160764276981354) | > loss_disc_real_3: 0.3531554937362671 (0.3531554937362671) | > loss_disc_real_4: 0.3539877235889435 (0.3539877235889435) | > loss_disc_real_5: 0.415353924036026 (0.415353924036026) | > loss_0: 3.459562301635742 (3.459562301635742) | > loss_gen: 2.214064121246338 (2.214064121246338) | > loss_kl: 5.109533786773682 (5.109533786773682) | > loss_feat: 4.819829940795898 (4.819829940795898) | > loss_mel: 19.943145751953125 (19.943145751953125) | > loss_duration: 2.970390558242798 (2.970390558242798) | > loss_1: 35.05696487426758 (35.05696487426758)  --> STEP: 1 | > loss_disc: 2.214707612991333 (2.214707612991333) | > loss_disc_real_0: 0.30881333351135254 (0.30881333351135254) | > loss_disc_real_1: 0.20930662751197815 (0.20930662751197815) | > loss_disc_real_2: 0.2256476879119873 (0.2256476879119873) | > loss_disc_real_3: 0.10202733427286148 (0.10202733427286148) | > loss_disc_real_4: 0.3083646595478058 (0.3083646595478058) | > loss_disc_real_5: 0.21984396874904633 (0.21984396874904633) | > loss_0: 2.214707612991333 (2.214707612991333) | > loss_gen: 3.0993242263793945 (3.0993242263793945) | > loss_kl: 4.583504676818848 (4.583504676818848) | > loss_feat: 10.522883415222168 (10.522883415222168) | > loss_mel: 26.198442459106445 (26.198442459106445) | > loss_duration: 3.218125343322754 (3.218125343322754) | > loss_1: 47.62228012084961 (47.62228012084961)  --> STEP: 2 | > loss_disc: 2.922731876373291 (2.568719744682312) | > loss_disc_real_0: 0.14788156747817993 (0.22834745049476624) | > loss_disc_real_1: 0.26436933875083923 (0.2368379831314087) | > loss_disc_real_2: 0.28585726022720337 (0.25575247406959534) | > loss_disc_real_3: 0.27396634221076965 (0.18799683824181557) | > loss_disc_real_4: 0.27552229166030884 (0.2919434756040573) | > loss_disc_real_5: 0.2383674532175064 (0.22910571098327637) | > loss_0: 2.922731876373291 (2.568719744682312) | > loss_gen: 1.575584888458252 (2.3374545574188232) | > loss_kl: 5.401382923126221 (4.992443799972534) | > loss_feat: 0.5499613881111145 (5.536422401666641) | > loss_mel: 13.558354377746582 (19.878398418426514) | > loss_duration: 3.107227087020874 (3.162676215171814) | > loss_1: 24.1925106048584 (35.907395362854004)  --> STEP: 3 | > loss_disc: 2.400242328643799 (2.5125606060028076) | > loss_disc_real_0: 0.30056795477867126 (0.25242095192273456) | > loss_disc_real_1: 0.20402251183986664 (0.22589949270089468) | > loss_disc_real_2: 0.3907788395881653 (0.30076126257578534) | > loss_disc_real_3: 0.2850830852985382 (0.22035892059405646) | > loss_disc_real_4: 0.15581707656383514 (0.2465680092573166) | > loss_disc_real_5: 0.087406687438488 (0.18187270313501358) | > loss_0: 2.400242328643799 (2.5125606060028076) | > loss_gen: 2.6397883892059326 (2.43823250134786) | > loss_kl: 2.7488346099853516 (4.244574069976807) | > loss_feat: 4.822360038757324 (5.298401614030202) | > loss_mel: 22.645145416259766 (20.800647417704266) | > loss_duration: 2.863689661026001 (3.063014030456543) | > loss_1: 35.719818115234375 (35.84486961364746) --> EVAL PERFORMANCE | > avg_loader_time: 0.00901333491007487 (-0.01009964942932129) | > avg_loss_disc: 2.5125606060028076 (-0.2587372461954751) | > avg_loss_disc_real_0: 0.25242095192273456 (-0.09361505508422852) | > avg_loss_disc_real_1: 0.22589949270089468 (+0.02196979522705078) | > avg_loss_disc_real_2: 0.30076126257578534 (+0.09344183901945752) | > avg_loss_disc_real_3: 0.22035892059405646 (-0.08781260003646216) | > avg_loss_disc_real_4: 0.2465680092573166 (-0.00032592316468557647) | > avg_loss_disc_real_5: 0.18187270313501358 (-0.08393015712499619) | > avg_loss_0: 2.5125606060028076 (-0.2587372461954751) | > avg_loss_gen: 2.43823250134786 (+0.21533234914143895) | > avg_loss_kl: 4.244574069976807 (-0.014012018839518525) | > avg_loss_feat: 5.298401614030202 (-0.804713388284048) | > avg_loss_mel: 20.800647417704266 (-0.49544175465901574) | > avg_loss_duration: 3.063014030456543 (-0.045569658279418945) | > avg_loss_1: 35.84486961364746 (-1.1444040934244768)  > EPOCH: 888/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:41:11)   --> TIME: 2023-10-20 10:41:20 -- STEP: 9/50 -- GLOBAL_STEP: 97410 | > loss_disc: 3.0170044898986816 (2.355844153298272) | > loss_disc_real_0: 0.06108436733484268 (0.13656524010002613) | > loss_disc_real_1: 0.2798486351966858 (0.2089508618745539) | > loss_disc_real_2: 0.26817822456359863 (0.20943337720301416) | > loss_disc_real_3: 0.29372382164001465 (0.22038076569636664) | > loss_disc_real_4: 0.29368406534194946 (0.20207162201404572) | > loss_disc_real_5: 0.2450619637966156 (0.1942519032292896) | > loss_0: 3.0170044898986816 (2.355844153298272) | > grad_norm_0: tensor(1545.7867, device='cuda:0') (tensor(968.4949, device='cuda:0')) | > loss_gen: 1.6556402444839478 (2.33704772260454) | > loss_kl: 0.8255782127380371 (0.7590144996841749) | > loss_feat: 1.2203707695007324 (6.5534283253881656) | > loss_mel: 12.27310848236084 (20.4927585389879) | > loss_duration: 1.396303415298462 (1.390459034177992) | > loss_1: 17.371002197265625 (31.5327091217041) | > grad_norm_1: tensor(7243.0317, device='cuda:0') (tensor(14369.5879, device='cuda:0')) | > current_lr_0: 8.229100956498565e-05 | > current_lr_1: 8.229100956498565e-05 | > step_time: 0.5048 (0.6205591360727946) | > loader_time: 0.0325 (0.027283642027113173)  --> TIME: 2023-10-20 10:41:40 -- STEP: 39/50 -- GLOBAL_STEP: 97440 | > loss_disc: 2.7695913314819336 (2.5416452242777896) | > loss_disc_real_0: 0.1509488970041275 (0.178681041018512) | > loss_disc_real_1: 0.25722673535346985 (0.22922379036362356) | > loss_disc_real_2: 0.23082560300827026 (0.22201735507219267) | > loss_disc_real_3: 0.21670565009117126 (0.23146021507011774) | > loss_disc_real_4: 0.23708830773830414 (0.22957413404797897) | > loss_disc_real_5: 0.2847599983215332 (0.23426926606454146) | > loss_0: 2.7695913314819336 (2.5416452242777896) | > grad_norm_0: tensor(573.4430, device='cuda:0') (tensor(821.8548, device='cuda:0')) | > loss_gen: 1.6822829246520996 (2.201094664060152) | > loss_kl: 0.591330885887146 (0.7895044567875372) | > loss_feat: 1.1821098327636719 (4.97011909290002) | > loss_mel: 16.984024047851562 (19.32528305359375) | > loss_duration: 1.4283218383789062 (1.3672422170639038) | > loss_1: 21.868070602416992 (28.653244006328094) | > grad_norm_1: tensor(4519.1685, device='cuda:0') (tensor(16822.9297, device='cuda:0')) | > current_lr_0: 8.229100956498565e-05 | > current_lr_1: 8.229100956498565e-05 | > step_time: 0.6444 (0.6164436523730938) | > loader_time: 0.0356 (0.021752669261052054)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.464564800262451 (2.464564800262451) | > loss_disc_real_0: 0.2566533386707306 (0.2566533386707306) | > loss_disc_real_1: 0.2625812590122223 (0.2625812590122223) | > loss_disc_real_2: 0.1137264147400856 (0.1137264147400856) | > loss_disc_real_3: 0.14053088426589966 (0.14053088426589966) | > loss_disc_real_4: 0.16723234951496124 (0.16723234951496124) | > loss_disc_real_5: 0.20585086941719055 (0.20585086941719055) | > loss_0: 2.464564800262451 (2.464564800262451) | > loss_gen: 1.9780335426330566 (1.9780335426330566) | > loss_kl: 5.222711086273193 (5.222711086273193) | > loss_feat: 4.634857177734375 (4.634857177734375) | > loss_mel: 25.789461135864258 (25.789461135864258) | > loss_duration: 2.9710352420806885 (2.9710352420806885) | > loss_1: 40.596099853515625 (40.596099853515625)  --> STEP: 1 | > loss_disc: 2.572629928588867 (2.572629928588867) | > loss_disc_real_0: 0.34606271982192993 (0.34606271982192993) | > loss_disc_real_1: 0.39345410466194153 (0.39345410466194153) | > loss_disc_real_2: 0.30142441391944885 (0.30142441391944885) | > loss_disc_real_3: 0.3055354654788971 (0.3055354654788971) | > loss_disc_real_4: 0.32644161581993103 (0.32644161581993103) | > loss_disc_real_5: 0.23760072886943817 (0.23760072886943817) | > loss_0: 2.572629928588867 (2.572629928588867) | > loss_gen: 3.1865222454071045 (3.1865222454071045) | > loss_kl: 4.483572006225586 (4.483572006225586) | > loss_feat: 6.876702308654785 (6.876702308654785) | > loss_mel: 23.479907989501953 (23.479907989501953) | > loss_duration: 3.24021315574646 (3.24021315574646) | > loss_1: 41.26691818237305 (41.26691818237305)  --> STEP: 2 | > loss_disc: 3.372825860977173 (2.97272789478302) | > loss_disc_real_0: 0.34067463874816895 (0.34336867928504944) | > loss_disc_real_1: 0.29847168922424316 (0.34596289694309235) | > loss_disc_real_2: 0.33766525983810425 (0.31954483687877655) | > loss_disc_real_3: 0.45499297976493835 (0.3802642226219177) | > loss_disc_real_4: 0.3782927095890045 (0.3523671627044678) | > loss_disc_real_5: 0.3215276896953583 (0.2795642092823982) | > loss_0: 3.372825860977173 (2.97272789478302) | > loss_gen: 2.3291592597961426 (2.7578407526016235) | > loss_kl: 5.7764058113098145 (5.1299889087677) | > loss_feat: 5.373494625091553 (6.125098466873169) | > loss_mel: 26.479328155517578 (24.979618072509766) | > loss_duration: 3.0671401023864746 (3.1536766290664673) | > loss_1: 43.0255241394043 (42.14622116088867)  --> STEP: 3 | > loss_disc: 2.9441778659820557 (2.9632112185160318) | > loss_disc_real_0: 0.052342433482408524 (0.24635993068416914) | > loss_disc_real_1: 0.29556772112846375 (0.3291645050048828) | > loss_disc_real_2: 0.28069406747817993 (0.306594580411911) | > loss_disc_real_3: 0.26352325081825256 (0.34135056535402936) | > loss_disc_real_4: 0.27835404872894287 (0.32769612471262616) | > loss_disc_real_5: 0.2488265037536621 (0.2693183074394862) | > loss_0: 2.9441778659820557 (2.9632112185160318) | > loss_gen: 1.5056684017181396 (2.3404499689737954) | > loss_kl: 2.433091163635254 (4.231022993723552) | > loss_feat: 0.9710537195205688 (4.407083551088969) | > loss_mel: 17.370777130126953 (22.44333775838216) | > loss_duration: 2.956516742706299 (3.087956666946411) | > loss_1: 25.237106323242188 (36.509849548339844) --> EVAL PERFORMANCE | > avg_loader_time: 0.02323460578918457 (+0.014221270879109701) | > avg_loss_disc: 2.9632112185160318 (+0.45065061251322414) | > avg_loss_disc_real_0: 0.24635993068416914 (-0.006061021238565417) | > avg_loss_disc_real_1: 0.3291645050048828 (+0.10326501230398813) | > avg_loss_disc_real_2: 0.306594580411911 (+0.005833317836125673) | > avg_loss_disc_real_3: 0.34135056535402936 (+0.1209916447599729) | > avg_loss_disc_real_4: 0.32769612471262616 (+0.08112811545530957) | > avg_loss_disc_real_5: 0.2693183074394862 (+0.08744560430447262) | > avg_loss_0: 2.9632112185160318 (+0.45065061251322414) | > avg_loss_gen: 2.3404499689737954 (-0.09778253237406442) | > avg_loss_kl: 4.231022993723552 (-0.013551076253254912) | > avg_loss_feat: 4.407083551088969 (-0.8913180629412327) | > avg_loss_mel: 22.44333775838216 (+1.6426903406778948) | > avg_loss_duration: 3.087956666946411 (+0.024942636489868164) | > avg_loss_1: 36.509849548339844 (+0.6649799346923828)  > EPOCH: 889/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:42:04)   --> TIME: 2023-10-20 10:42:22 -- STEP: 19/50 -- GLOBAL_STEP: 97470 | > loss_disc: 2.2603049278259277 (2.366925515626606) | > loss_disc_real_0: 0.1625843644142151 (0.16600898104278664) | > loss_disc_real_1: 0.12135820090770721 (0.2196406224056294) | > loss_disc_real_2: 0.1683671921491623 (0.1919951372240719) | > loss_disc_real_3: 0.11001677811145782 (0.20987910542048907) | > loss_disc_real_4: 0.20965205132961273 (0.2164163756135263) | > loss_disc_real_5: 0.18313415348529816 (0.2222956348406641) | > loss_0: 2.2603049278259277 (2.366925515626606) | > grad_norm_0: tensor(1085.6669, device='cuda:0') (tensor(579.3315, device='cuda:0')) | > loss_gen: 1.8513048887252808 (2.291242499100535) | > loss_kl: 0.7652716040611267 (0.7971539089554235) | > loss_feat: 3.521937370300293 (4.86143732247384) | > loss_mel: 16.922353744506836 (18.650933403717843) | > loss_duration: 1.4441181421279907 (1.3913916600377936) | > loss_1: 24.504985809326172 (27.992159266220895) | > grad_norm_1: tensor(4728.0386, device='cuda:0') (tensor(17078.5840, device='cuda:0')) | > current_lr_0: 8.220875454873814e-05 | > current_lr_1: 8.220875454873814e-05 | > step_time: 0.4253 (0.6736022673155132) | > loader_time: 0.0056 (0.023097326881007144)  --> TIME: 2023-10-20 10:42:43 -- STEP: 49/50 -- GLOBAL_STEP: 97500 | > loss_disc: 2.4116804599761963 (2.4930230427761475) | > loss_disc_real_0: 0.2699706256389618 (0.16215488953249796) | > loss_disc_real_1: 0.2647338807582855 (0.22928189212570385) | > loss_disc_real_2: 0.2623943090438843 (0.21770882652122148) | > loss_disc_real_3: 0.2580641806125641 (0.22865252029530855) | > loss_disc_real_4: 0.201146200299263 (0.2264493776067179) | > loss_disc_real_5: 0.3101613521575928 (0.21435078613612116) | > loss_0: 2.4116804599761963 (2.4930230427761475) | > grad_norm_0: tensor(457.2390, device='cuda:0') (tensor(581.8481, device='cuda:0')) | > loss_gen: 2.639441728591919 (2.224193818715154) | > loss_kl: 0.7092771530151367 (0.7984692024029031) | > loss_feat: 3.5746560096740723 (4.668022782446779) | > loss_mel: 19.963573455810547 (19.16662507884356) | > loss_duration: 1.4870368242263794 (1.3685989185255405) | > loss_1: 28.373987197875977 (28.225910089453873) | > grad_norm_1: tensor(12355.3135, device='cuda:0') (tensor(15196.4023, device='cuda:0')) | > current_lr_0: 8.220875454873814e-05 | > current_lr_1: 8.220875454873814e-05 | > step_time: 0.5086 (0.6540525251505326) | > loader_time: 0.5617 (0.0316795183687794)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.962375521659851 (1.962375521659851) | > loss_disc_real_0: 0.18481844663619995 (0.18481844663619995) | > loss_disc_real_1: 0.22372104227542877 (0.22372104227542877) | > loss_disc_real_2: 0.2745647430419922 (0.2745647430419922) | > loss_disc_real_3: 0.2809358537197113 (0.2809358537197113) | > loss_disc_real_4: 0.13267800211906433 (0.13267800211906433) | > loss_disc_real_5: 0.09157811850309372 (0.09157811850309372) | > loss_0: 1.962375521659851 (1.962375521659851) | > loss_gen: 2.9177894592285156 (2.9177894592285156) | > loss_kl: 4.329375267028809 (4.329375267028809) | > loss_feat: 7.301375865936279 (7.301375865936279) | > loss_mel: 24.104419708251953 (24.104419708251953) | > loss_duration: 2.8779618740081787 (2.8779618740081787) | > loss_1: 41.53091812133789 (41.53091812133789)  --> STEP: 1 | > loss_disc: 2.920443058013916 (2.920443058013916) | > loss_disc_real_0: 0.389901340007782 (0.389901340007782) | > loss_disc_real_1: 0.271817684173584 (0.271817684173584) | > loss_disc_real_2: 0.2807910740375519 (0.2807910740375519) | > loss_disc_real_3: 0.2842645049095154 (0.2842645049095154) | > loss_disc_real_4: 0.252095490694046 (0.252095490694046) | > loss_disc_real_5: 0.2891984283924103 (0.2891984283924103) | > loss_0: 2.920443058013916 (2.920443058013916) | > loss_gen: 2.026190996170044 (2.026190996170044) | > loss_kl: 4.886332035064697 (4.886332035064697) | > loss_feat: 0.4794202446937561 (0.4794202446937561) | > loss_mel: 16.212072372436523 (16.212072372436523) | > loss_duration: 3.3148999214172363 (3.3148999214172363) | > loss_1: 26.918914794921875 (26.918914794921875)  --> STEP: 2 | > loss_disc: 2.82244610786438 (2.871444582939148) | > loss_disc_real_0: 0.1496124267578125 (0.26975688338279724) | > loss_disc_real_1: 0.45701754093170166 (0.3644176125526428) | > loss_disc_real_2: 0.3016788363456726 (0.29123495519161224) | > loss_disc_real_3: 0.35003459453582764 (0.3171495497226715) | > loss_disc_real_4: 0.25233784317970276 (0.2522166669368744) | > loss_disc_real_5: 0.3767230808734894 (0.33296075463294983) | > loss_0: 2.82244610786438 (2.871444582939148) | > loss_gen: 3.0330970287323 (2.529644012451172) | > loss_kl: 5.724594593048096 (5.3054633140563965) | > loss_feat: 7.189393520355225 (3.8344068825244904) | > loss_mel: 22.970945358276367 (19.591508865356445) | > loss_duration: 3.1094603538513184 (3.2121801376342773) | > loss_1: 42.027488708496094 (34.473201751708984)  --> STEP: 3 | > loss_disc: 2.3389782905578613 (2.6939558188120523) | > loss_disc_real_0: 0.2829850912094116 (0.2741662859916687) | > loss_disc_real_1: 0.2724478840827942 (0.3337610363960266) | > loss_disc_real_2: 0.2245858907699585 (0.26901860038439435) | > loss_disc_real_3: 0.22317934036254883 (0.2858261466026306) | > loss_disc_real_4: 0.1362273097038269 (0.2135535478591919) | > loss_disc_real_5: 0.1498110294342041 (0.2719108462333679) | > loss_0: 2.3389782905578613 (2.6939558188120523) | > loss_gen: 2.3395349979400635 (2.4662743409474692) | > loss_kl: 2.3397741317749023 (4.316900253295898) | > loss_feat: 4.385588645935059 (4.0181341369946795) | > loss_mel: 22.978012084960938 (20.720343271891277) | > loss_duration: 2.948692798614502 (3.1243510246276855) | > loss_1: 34.99160385131836 (34.646002451578774) --> EVAL PERFORMANCE | > avg_loader_time: 0.010729710261027018 (-0.012504895528157553) | > avg_loss_disc: 2.6939558188120523 (-0.2692553997039795) | > avg_loss_disc_real_0: 0.2741662859916687 (+0.02780635530749956) | > avg_loss_disc_real_1: 0.3337610363960266 (+0.004596531391143799) | > avg_loss_disc_real_2: 0.26901860038439435 (-0.037575980027516664) | > avg_loss_disc_real_3: 0.2858261466026306 (-0.05552441875139874) | > avg_loss_disc_real_4: 0.2135535478591919 (-0.11414257685343426) | > avg_loss_disc_real_5: 0.2719108462333679 (+0.0025925387938817157) | > avg_loss_0: 2.6939558188120523 (-0.2692553997039795) | > avg_loss_gen: 2.4662743409474692 (+0.1258243719736738) | > avg_loss_kl: 4.316900253295898 (+0.08587725957234671) | > avg_loss_feat: 4.0181341369946795 (-0.38894941409428974) | > avg_loss_mel: 20.720343271891277 (-1.722994486490883) | > avg_loss_duration: 3.1243510246276855 (+0.036394357681274414) | > avg_loss_1: 34.646002451578774 (-1.86384709676107)  > EPOCH: 890/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:43:12)   --> TIME: 2023-10-20 10:43:33 -- STEP: 29/50 -- GLOBAL_STEP: 97530 | > loss_disc: 2.8999595642089844 (2.4201993407874274) | > loss_disc_real_0: 0.1695803999900818 (0.14607914659226762) | > loss_disc_real_1: 0.25166869163513184 (0.221420399202355) | > loss_disc_real_2: 0.21463170647621155 (0.23287139216373706) | > loss_disc_real_3: 0.23026719689369202 (0.22372273040999627) | > loss_disc_real_4: 0.2620345950126648 (0.24048379436135292) | > loss_disc_real_5: 0.278337687253952 (0.22623968740989422) | > loss_0: 2.8999595642089844 (2.4201993407874274) | > grad_norm_0: tensor(2468.4165, device='cuda:0') (tensor(688.6263, device='cuda:0')) | > loss_gen: 1.6463810205459595 (2.280410676166929) | > loss_kl: 0.62795490026474 (0.8116358343897194) | > loss_feat: 0.41531437635421753 (5.224992295020614) | > loss_mel: 4.865076541900635 (20.06139551360032) | > loss_duration: 1.3712865114212036 (1.381596618685229) | > loss_1: 8.926012992858887 (29.760030828673266) | > grad_norm_1: tensor(14187.7861, device='cuda:0') (tensor(19595.6855, device='cuda:0')) | > current_lr_0: 8.212658175152932e-05 | > current_lr_1: 8.212658175152932e-05 | > step_time: 0.3936 (0.5440750368710222) | > loader_time: 0.0026 (0.014621619520516228)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.965217113494873 (2.965217113494873) | > loss_disc_real_0: 0.30657076835632324 (0.30657076835632324) | > loss_disc_real_1: 0.23717869818210602 (0.23717869818210602) | > loss_disc_real_2: 0.3099108040332794 (0.3099108040332794) | > loss_disc_real_3: 0.1987771838903427 (0.1987771838903427) | > loss_disc_real_4: 0.2763207256793976 (0.2763207256793976) | > loss_disc_real_5: 0.31510409712791443 (0.31510409712791443) | > loss_0: 2.965217113494873 (2.965217113494873) | > loss_gen: 1.8405977487564087 (1.8405977487564087) | > loss_kl: 4.89297342300415 (4.89297342300415) | > loss_feat: 3.2583563327789307 (3.2583563327789307) | > loss_mel: 20.647974014282227 (20.647974014282227) | > loss_duration: 2.93333101272583 (2.93333101272583) | > loss_1: 33.57323455810547 (33.57323455810547)  --> STEP: 1 | > loss_disc: 2.583073377609253 (2.583073377609253) | > loss_disc_real_0: 0.34227925539016724 (0.34227925539016724) | > loss_disc_real_1: 0.17764420807361603 (0.17764420807361603) | > loss_disc_real_2: 0.21771034598350525 (0.21771034598350525) | > loss_disc_real_3: 0.1341199278831482 (0.1341199278831482) | > loss_disc_real_4: 0.11067388951778412 (0.11067388951778412) | > loss_disc_real_5: 0.3955097794532776 (0.3955097794532776) | > loss_0: 2.583073377609253 (2.583073377609253) | > loss_gen: 2.1119918823242188 (2.1119918823242188) | > loss_kl: 4.930586814880371 (4.930586814880371) | > loss_feat: 7.170172691345215 (7.170172691345215) | > loss_mel: 23.60529899597168 (23.60529899597168) | > loss_duration: 3.374372959136963 (3.374372959136963) | > loss_1: 41.19242477416992 (41.19242477416992)  --> STEP: 2 | > loss_disc: 3.014681577682495 (2.798877477645874) | > loss_disc_real_0: 0.2068360298871994 (0.2745576426386833) | > loss_disc_real_1: 0.28016048669815063 (0.22890234738588333) | > loss_disc_real_2: 0.2895749807357788 (0.25364266335964203) | > loss_disc_real_3: 0.26721832156181335 (0.20066912472248077) | > loss_disc_real_4: 0.25605037808418274 (0.18336213380098343) | > loss_disc_real_5: 0.25295716524124146 (0.3242334723472595) | > loss_0: 3.014681577682495 (2.798877477645874) | > loss_gen: 1.5537315607070923 (1.8328617215156555) | > loss_kl: 5.513894081115723 (5.222240447998047) | > loss_feat: 0.14895106852054596 (3.6595618799328804) | > loss_mel: 1.8549102544784546 (12.730104625225067) | > loss_duration: 3.1460561752319336 (3.2602145671844482) | > loss_1: 12.217543601989746 (26.704984188079834)  --> STEP: 3 | > loss_disc: 2.503077507019043 (2.70027748743693) | > loss_disc_real_0: 0.1561959981918335 (0.23510376115640005) | > loss_disc_real_1: 0.31920191645622253 (0.2590022037426631) | > loss_disc_real_2: 0.32786980271339417 (0.2783850431442261) | > loss_disc_real_3: 0.36213067173957825 (0.2544896403948466) | > loss_disc_real_4: 0.19249987602233887 (0.18640804787476858) | > loss_disc_real_5: 0.2697362005710602 (0.3060677150885264) | > loss_0: 2.503077507019043 (2.70027748743693) | > loss_gen: 2.7195820808410645 (2.128435174624125) | > loss_kl: 2.3643531799316406 (4.269611358642578) | > loss_feat: 4.513416767120361 (3.9441801756620407) | > loss_mel: 20.472929000854492 (15.31104608376821) | > loss_duration: 2.996593475341797 (3.1723408699035645) | > loss_1: 33.066871643066406 (28.825613339742024) --> EVAL PERFORMANCE | > avg_loader_time: 0.019995689392089844 (+0.009265979131062826) | > avg_loss_disc: 2.70027748743693 (+0.00632166862487793) | > avg_loss_disc_real_0: 0.23510376115640005 (-0.03906252483526865) | > avg_loss_disc_real_1: 0.2590022037426631 (-0.07475883265336353) | > avg_loss_disc_real_2: 0.2783850431442261 (+0.009366442759831728) | > avg_loss_disc_real_3: 0.2544896403948466 (-0.031336506207784) | > avg_loss_disc_real_4: 0.18640804787476858 (-0.02714549998442331) | > avg_loss_disc_real_5: 0.3060677150885264 (+0.034156868855158506) | > avg_loss_0: 2.70027748743693 (+0.00632166862487793) | > avg_loss_gen: 2.128435174624125 (-0.3378391663233442) | > avg_loss_kl: 4.269611358642578 (-0.04728889465332031) | > avg_loss_feat: 3.9441801756620407 (-0.07395396133263876) | > avg_loss_mel: 15.31104608376821 (-5.409297188123068) | > avg_loss_duration: 3.1723408699035645 (+0.047989845275878906) | > avg_loss_1: 28.825613339742024 (-5.82038911183675)  > EPOCH: 891/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:44:07)   --> TIME: 2023-10-20 10:44:19 -- STEP: 9/50 -- GLOBAL_STEP: 97560 | > loss_disc: 2.6267004013061523 (2.5333011150360107) | > loss_disc_real_0: 0.0682470053434372 (0.18635386518306202) | > loss_disc_real_1: 0.23151612281799316 (0.2383272871375084) | > loss_disc_real_2: 0.25316333770751953 (0.2471690426270167) | > loss_disc_real_3: 0.28869855403900146 (0.2207029652264383) | > loss_disc_real_4: 0.225402370095253 (0.20405158069398668) | > loss_disc_real_5: 0.2846446931362152 (0.19978992620276081) | > loss_0: 2.6267004013061523 (2.5333011150360107) | > grad_norm_0: tensor(688.8521, device='cuda:0') (tensor(680.9315, device='cuda:0')) | > loss_gen: 1.91000235080719 (2.140450186199612) | > loss_kl: 0.6353466510772705 (0.9125417338477241) | > loss_feat: 2.160187005996704 (4.786480878790219) | > loss_mel: 19.11895751953125 (19.59399912092421) | > loss_duration: 1.3448240756988525 (1.3955378002590604) | > loss_1: 25.1693172454834 (28.82901011572944) | > grad_norm_1: tensor(3122.9702, device='cuda:0') (tensor(17301.2754, device='cuda:0')) | > current_lr_0: 8.204449109117608e-05 | > current_lr_1: 8.204449109117608e-05 | > step_time: 0.7925 (0.6167542139689127) | > loader_time: 0.0344 (0.02478798230489095)  --> TIME: 2023-10-20 10:44:34 -- STEP: 39/50 -- GLOBAL_STEP: 97590 | > loss_disc: 2.6946096420288086 (2.569224605193505) | > loss_disc_real_0: 0.3193214535713196 (0.16006809678406286) | > loss_disc_real_1: 0.24558107554912567 (0.23120358337958655) | > loss_disc_real_2: 0.22805535793304443 (0.2395639480688633) | > loss_disc_real_3: 0.2835492789745331 (0.23871847509573668) | > loss_disc_real_4: 0.1722135692834854 (0.23090688693217742) | > loss_disc_real_5: 0.20776094496250153 (0.2680695563650284) | > loss_0: 2.6946096420288086 (2.569224605193505) | > grad_norm_0: tensor(816.2532, device='cuda:0') (tensor(614.9642, device='cuda:0')) | > loss_gen: 1.8066697120666504 (2.202570878542387) | > loss_kl: 0.45430707931518555 (0.7990774924938495) | > loss_feat: 2.0273525714874268 (4.829675010739801) | > loss_mel: 7.743087291717529 (19.82785415955079) | > loss_duration: 1.4412866830825806 (1.3699182210824428) | > loss_1: 13.472702980041504 (29.029095710852207) | > grad_norm_1: tensor(63681.5195, device='cuda:0') (tensor(18275.9219, device='cuda:0')) | > current_lr_0: 8.204449109117608e-05 | > current_lr_1: 8.204449109117608e-05 | > step_time: 0.2516 (0.5132767237149752) | > loader_time: 0.002 (0.015446772942176232)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6835572719573975 (2.6835572719573975) | > loss_disc_real_0: 0.23575523495674133 (0.23575523495674133) | > loss_disc_real_1: 0.24451690912246704 (0.24451690912246704) | > loss_disc_real_2: 0.23884648084640503 (0.23884648084640503) | > loss_disc_real_3: 0.32996729016304016 (0.32996729016304016) | > loss_disc_real_4: 0.2967567443847656 (0.2967567443847656) | > loss_disc_real_5: 0.09241168200969696 (0.09241168200969696) | > loss_0: 2.6835572719573975 (2.6835572719573975) | > loss_gen: 2.1579952239990234 (2.1579952239990234) | > loss_kl: 4.894067764282227 (4.894067764282227) | > loss_feat: 5.8874430656433105 (5.8874430656433105) | > loss_mel: 17.091224670410156 (17.091224670410156) | > loss_duration: 2.977593421936035 (2.977593421936035) | > loss_1: 33.008323669433594 (33.008323669433594)  --> STEP: 1 | > loss_disc: 3.623159646987915 (3.623159646987915) | > loss_disc_real_0: 0.7319526076316833 (0.7319526076316833) | > loss_disc_real_1: 0.4509277939796448 (0.4509277939796448) | > loss_disc_real_2: 0.3938750922679901 (0.3938750922679901) | > loss_disc_real_3: 0.30526167154312134 (0.30526167154312134) | > loss_disc_real_4: 0.4089588522911072 (0.4089588522911072) | > loss_disc_real_5: 0.4684661626815796 (0.4684661626815796) | > loss_0: 3.623159646987915 (3.623159646987915) | > loss_gen: 2.9098119735717773 (2.9098119735717773) | > loss_kl: 4.756721496582031 (4.756721496582031) | > loss_feat: 6.225796222686768 (6.225796222686768) | > loss_mel: 23.36036491394043 (23.36036491394043) | > loss_duration: 3.3200297355651855 (3.3200297355651855) | > loss_1: 40.572723388671875 (40.572723388671875)  --> STEP: 2 | > loss_disc: 3.053755760192871 (3.338457703590393) | > loss_disc_real_0: 0.24589811265468597 (0.48892536014318466) | > loss_disc_real_1: 0.392367422580719 (0.4216476082801819) | > loss_disc_real_2: 0.4196110963821411 (0.4067430943250656) | > loss_disc_real_3: 0.36082348227500916 (0.33304257690906525) | > loss_disc_real_4: 0.3236483633518219 (0.36630360782146454) | > loss_disc_real_5: 0.35469627380371094 (0.41158121824264526) | > loss_0: 3.053755760192871 (3.338457703590393) | > loss_gen: 2.539198160171509 (2.724505066871643) | > loss_kl: 5.350697040557861 (5.053709268569946) | > loss_feat: 6.143147945404053 (6.18447208404541) | > loss_mel: 24.584569931030273 (23.97246742248535) | > loss_duration: 3.12571382522583 (3.222871780395508) | > loss_1: 41.74332809448242 (41.15802574157715)  --> STEP: 3 | > loss_disc: 3.2910072803497314 (3.322640895843506) | > loss_disc_real_0: 0.2942996621131897 (0.42405012746651966) | > loss_disc_real_1: 0.4121312201023102 (0.418475478887558) | > loss_disc_real_2: 0.28135502338409424 (0.36494707067807514) | > loss_disc_real_3: 0.3853894770145416 (0.3504915436108907) | > loss_disc_real_4: 0.49597257375717163 (0.40952659646670025) | > loss_disc_real_5: 0.3593989610671997 (0.39418713251749676) | > loss_0: 3.2910072803497314 (3.322640895843506) | > loss_gen: 2.4108691215515137 (2.619959751764933) | > loss_kl: 2.420788049697876 (4.176068862279256) | > loss_feat: 4.499553203582764 (5.622832457224528) | > loss_mel: 21.590023040771484 (23.178319295247395) | > loss_duration: 3.005366563796997 (3.1503700415293374) | > loss_1: 33.92660140991211 (38.74755096435547) --> EVAL PERFORMANCE | > avg_loader_time: 0.00683140754699707 (-0.013164281845092773) | > avg_loss_disc: 3.322640895843506 (+0.6223634084065757) | > avg_loss_disc_real_0: 0.42405012746651966 (+0.1889463663101196) | > avg_loss_disc_real_1: 0.418475478887558 (+0.1594732751448949) | > avg_loss_disc_real_2: 0.36494707067807514 (+0.08656202753384906) | > avg_loss_disc_real_3: 0.3504915436108907 (+0.09600190321604407) | > avg_loss_disc_real_4: 0.40952659646670025 (+0.22311854859193167) | > avg_loss_disc_real_5: 0.39418713251749676 (+0.08811941742897034) | > avg_loss_0: 3.322640895843506 (+0.6223634084065757) | > avg_loss_gen: 2.619959751764933 (+0.4915245771408081) | > avg_loss_kl: 4.176068862279256 (-0.09354249636332224) | > avg_loss_feat: 5.622832457224528 (+1.6786522815624876) | > avg_loss_mel: 23.178319295247395 (+7.867273211479185) | > avg_loss_duration: 3.1503700415293374 (-0.021970828374227036) | > avg_loss_1: 38.74755096435547 (+9.921937624613445)  > EPOCH: 892/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:44:59)   --> TIME: 2023-10-20 10:45:12 -- STEP: 19/50 -- GLOBAL_STEP: 97620 | > loss_disc: 1.537827968597412 (2.403518890079699) | > loss_disc_real_0: 0.01921253278851509 (0.16328585383139158) | > loss_disc_real_1: 0.13247695565223694 (0.22586557386737122) | > loss_disc_real_2: 0.04751493036746979 (0.22004075446411184) | > loss_disc_real_3: 0.09914212673902512 (0.2496052535348817) | > loss_disc_real_4: 0.06051904708147049 (0.20926298710860705) | > loss_disc_real_5: 0.018399428576231003 (0.2025940753519535) | > loss_0: 1.537827968597412 (2.403518890079699) | > grad_norm_0: tensor(1254.2188, device='cuda:0') (tensor(1297.8656, device='cuda:0')) | > loss_gen: 2.8868448734283447 (2.3220145388653406) | > loss_kl: 0.5369709730148315 (0.8899388909339905) | > loss_feat: 13.073287963867188 (5.518255283565898) | > loss_mel: 24.594308853149414 (18.42901680971447) | > loss_duration: 1.4475613832473755 (1.4089358543094836) | > loss_1: 42.53897476196289 (28.56816111112896) | > grad_norm_1: tensor(159119.8438, device='cuda:0') (tensor(35302.7383, device='cuda:0')) | > current_lr_0: 8.196248248557753e-05 | > current_lr_1: 8.196248248557753e-05 | > step_time: 0.6727 (0.4138746638047068) | > loader_time: 0.0049 (0.011725074366519326)  --> TIME: 2023-10-20 10:45:26 -- STEP: 49/50 -- GLOBAL_STEP: 97650 | > loss_disc: 2.7068777084350586 (2.4379763797837866) | > loss_disc_real_0: 0.382577121257782 (0.15783859287597696) | > loss_disc_real_1: 0.2796933650970459 (0.22592751088799262) | > loss_disc_real_2: 0.25454604625701904 (0.2212528542672493) | > loss_disc_real_3: 0.3341863453388214 (0.23619913074130916) | > loss_disc_real_4: 0.24243448674678802 (0.22843428564314938) | > loss_disc_real_5: 0.2317449301481247 (0.22759143137658128) | > loss_0: 2.7068777084350586 (2.4379763797837866) | > grad_norm_0: tensor(3020.4580, device='cuda:0') (tensor(1228.8807, device='cuda:0')) | > loss_gen: 2.5551414489746094 (2.3624824966703137) | > loss_kl: 0.6110215187072754 (0.8179231103585691) | > loss_feat: 2.194115400314331 (5.770162054622658) | > loss_mel: 18.82297134399414 (20.240582743469545) | > loss_duration: 1.543983817100525 (1.3755074179902367) | > loss_1: 25.72723388671875 (30.56665784485486) | > grad_norm_1: tensor(3553.0913, device='cuda:0') (tensor(38870.4766, device='cuda:0')) | > current_lr_0: 8.196248248557753e-05 | > current_lr_1: 8.196248248557753e-05 | > step_time: 0.2715 (0.42550032479422434) | > loader_time: 0.3514 (0.015066662613226443)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6494879722595215 (2.6494879722595215) | > loss_disc_real_0: 0.3741970658302307 (0.3741970658302307) | > loss_disc_real_1: 0.26913371682167053 (0.26913371682167053) | > loss_disc_real_2: 0.3838670253753662 (0.3838670253753662) | > loss_disc_real_3: 0.2557498812675476 (0.2557498812675476) | > loss_disc_real_4: 0.16404937207698822 (0.16404937207698822) | > loss_disc_real_5: 0.16694718599319458 (0.16694718599319458) | > loss_0: 2.6494879722595215 (2.6494879722595215) | > loss_gen: 2.4715728759765625 (2.4715728759765625) | > loss_kl: 4.440838813781738 (4.440838813781738) | > loss_feat: 5.759716033935547 (5.759716033935547) | > loss_mel: 22.391952514648438 (22.391952514648438) | > loss_duration: 2.9293270111083984 (2.9293270111083984) | > loss_1: 37.993408203125 (37.993408203125)  --> STEP: 1 | > loss_disc: 2.5638179779052734 (2.5638179779052734) | > loss_disc_real_0: 0.32309576869010925 (0.32309576869010925) | > loss_disc_real_1: 0.24865053594112396 (0.24865053594112396) | > loss_disc_real_2: 0.2427440732717514 (0.2427440732717514) | > loss_disc_real_3: 0.23252472281455994 (0.23252472281455994) | > loss_disc_real_4: 0.3254810571670532 (0.3254810571670532) | > loss_disc_real_5: 0.3172646760940552 (0.3172646760940552) | > loss_0: 2.5638179779052734 (2.5638179779052734) | > loss_gen: 2.588113307952881 (2.588113307952881) | > loss_kl: 4.958730220794678 (4.958730220794678) | > loss_feat: 7.091333866119385 (7.091333866119385) | > loss_mel: 23.101884841918945 (23.101884841918945) | > loss_duration: 3.3371753692626953 (3.3371753692626953) | > loss_1: 41.077232360839844 (41.077232360839844)  --> STEP: 2 | > loss_disc: 1.4227429628372192 (1.9932804703712463) | > loss_disc_real_0: 0.090384840965271 (0.20674030482769012) | > loss_disc_real_1: 0.020359516143798828 (0.1345050260424614) | > loss_disc_real_2: 0.02784493938088417 (0.1352945063263178) | > loss_disc_real_3: 0.04535336419939995 (0.13893904350697994) | > loss_disc_real_4: 0.012389485724270344 (0.16893527144566178) | > loss_disc_real_5: 0.024030758067965508 (0.17064771708101034) | > loss_0: 1.4227429628372192 (1.9932804703712463) | > loss_gen: 2.304983615875244 (2.4465484619140625) | > loss_kl: 5.2398786544799805 (5.099304437637329) | > loss_feat: 11.314619064331055 (9.20297646522522) | > loss_mel: 27.23263931274414 (25.167262077331543) | > loss_duration: 3.2109293937683105 (3.274052381515503) | > loss_1: 49.30305099487305 (45.190141677856445)  --> STEP: 3 | > loss_disc: 2.867109775543213 (2.2845569054285684) | > loss_disc_real_0: 0.13905835151672363 (0.18417965372403464) | > loss_disc_real_1: 0.2653160095214844 (0.1781086872021357) | > loss_disc_real_2: 0.2510469853878021 (0.17387866601347923) | > loss_disc_real_3: 0.29962092638015747 (0.19249967113137245) | > loss_disc_real_4: 0.2242887318134308 (0.18738642490158477) | > loss_disc_real_5: 0.23890231549739838 (0.19339924988647303) | > loss_0: 2.867109775543213 (2.2845569054285684) | > loss_gen: 1.5780205726623535 (2.157039165496826) | > loss_kl: 2.3913698196411133 (4.196659564971924) | > loss_feat: 0.6200109720230103 (6.34198796749115) | > loss_mel: 9.546853065490723 (19.9604590733846) | > loss_duration: 2.9946227073669434 (3.1809091567993164) | > loss_1: 17.130876541137695 (35.837053298950195) --> EVAL PERFORMANCE | > avg_loader_time: 0.021628300348917644 (+0.014796892801920574) | > avg_loss_disc: 2.2845569054285684 (-1.0380839904149375) | > avg_loss_disc_real_0: 0.18417965372403464 (-0.23987047374248502) | > avg_loss_disc_real_1: 0.1781086872021357 (-0.24036679168542227) | > avg_loss_disc_real_2: 0.17387866601347923 (-0.1910684046645959) | > avg_loss_disc_real_3: 0.19249967113137245 (-0.15799187247951824) | > avg_loss_disc_real_4: 0.18738642490158477 (-0.22214017156511548) | > avg_loss_disc_real_5: 0.19339924988647303 (-0.20078788263102373) | > avg_loss_0: 2.2845569054285684 (-1.0380839904149375) | > avg_loss_gen: 2.157039165496826 (-0.46292058626810695) | > avg_loss_kl: 4.196659564971924 (+0.02059070269266794) | > avg_loss_feat: 6.34198796749115 (+0.7191555102666216) | > avg_loss_mel: 19.9604590733846 (-3.217860221862793) | > avg_loss_duration: 3.1809091567993164 (+0.03053911526997899) | > avg_loss_1: 35.837053298950195 (-2.9104976654052734)  > EPOCH: 893/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:45:43)   --> TIME: 2023-10-20 10:46:07 -- STEP: 29/50 -- GLOBAL_STEP: 97680 | > loss_disc: 2.6756949424743652 (2.5036738083280365) | > loss_disc_real_0: 0.12599706649780273 (0.14075393910551892) | > loss_disc_real_1: 0.19447781145572662 (0.22867540899535704) | > loss_disc_real_2: 0.17268003523349762 (0.22100140404855384) | > loss_disc_real_3: 0.38465845584869385 (0.246343602811725) | > loss_disc_real_4: 0.06688760966062546 (0.22722224306700559) | > loss_disc_real_5: 0.25245797634124756 (0.22393038355070968) | > loss_0: 2.6756949424743652 (2.5036738083280365) | > grad_norm_0: tensor(760.1943, device='cuda:0') (tensor(1204.0498, device='cuda:0')) | > loss_gen: 1.9369986057281494 (2.144753036827876) | > loss_kl: 0.7698526382446289 (0.8165318996741854) | > loss_feat: 5.416008472442627 (4.5165189460947595) | > loss_mel: 22.150775909423828 (20.35958400265923) | > loss_duration: 1.353671669960022 (1.3564345261146282) | > loss_1: 31.627307891845703 (29.193822597635204) | > grad_norm_1: tensor(5322.0562, device='cuda:0') (tensor(31259.7871, device='cuda:0')) | > current_lr_0: 8.188055585271476e-05 | > current_lr_1: 8.188055585271476e-05 | > step_time: 0.6414 (0.6436057666252399) | > loader_time: 0.0279 (0.022233387519573343)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7031607627868652 (2.7031607627868652) | > loss_disc_real_0: 0.17343731224536896 (0.17343731224536896) | > loss_disc_real_1: 0.2491864264011383 (0.2491864264011383) | > loss_disc_real_2: 0.2743784189224243 (0.2743784189224243) | > loss_disc_real_3: 0.3616652190685272 (0.3616652190685272) | > loss_disc_real_4: 0.369630366563797 (0.369630366563797) | > loss_disc_real_5: 0.2911922335624695 (0.2911922335624695) | > loss_0: 2.7031607627868652 (2.7031607627868652) | > loss_gen: 2.387115955352783 (2.387115955352783) | > loss_kl: 3.947378635406494 (3.947378635406494) | > loss_feat: 5.330219745635986 (5.330219745635986) | > loss_mel: 23.19905662536621 (23.19905662536621) | > loss_duration: 2.8710508346557617 (2.8710508346557617) | > loss_1: 37.73482131958008 (37.73482131958008)  --> STEP: 1 | > loss_disc: 2.9928133487701416 (2.9928133487701416) | > loss_disc_real_0: 0.1873423010110855 (0.1873423010110855) | > loss_disc_real_1: 0.2853839695453644 (0.2853839695453644) | > loss_disc_real_2: 0.19309093058109283 (0.19309093058109283) | > loss_disc_real_3: 0.23594346642494202 (0.23594346642494202) | > loss_disc_real_4: 0.16684821248054504 (0.16684821248054504) | > loss_disc_real_5: 0.15609310567378998 (0.15609310567378998) | > loss_0: 2.9928133487701416 (2.9928133487701416) | > loss_gen: 1.580947995185852 (1.580947995185852) | > loss_kl: 4.834422588348389 (4.834422588348389) | > loss_feat: 5.865049839019775 (5.865049839019775) | > loss_mel: 26.343412399291992 (26.343412399291992) | > loss_duration: 3.3461756706237793 (3.3461756706237793) | > loss_1: 41.970008850097656 (41.970008850097656)  --> STEP: 2 | > loss_disc: 2.929831027984619 (2.9613221883773804) | > loss_disc_real_0: 0.19597241282463074 (0.19165735691785812) | > loss_disc_real_1: 0.248080313205719 (0.2667321413755417) | > loss_disc_real_2: 0.2499648481607437 (0.22152788937091827) | > loss_disc_real_3: 0.2594718039035797 (0.24770763516426086) | > loss_disc_real_4: 0.2739388942718506 (0.22039355337619781) | > loss_disc_real_5: 0.2651480734348297 (0.21062058955430984) | > loss_0: 2.929831027984619 (2.9613221883773804) | > loss_gen: 1.5919404029846191 (1.5864441990852356) | > loss_kl: 5.451801300048828 (5.143111944198608) | > loss_feat: 0.6534205675125122 (3.259235203266144) | > loss_mel: 8.497546195983887 (17.42047929763794) | > loss_duration: 3.101227045059204 (3.2237013578414917) | > loss_1: 19.295934677124023 (30.63297176361084)  --> STEP: 3 | > loss_disc: 2.2230966091156006 (2.7152469952901206) | > loss_disc_real_0: 0.06483902037143707 (0.14938457806905112) | > loss_disc_real_1: 0.2667361795902252 (0.26673348744710285) | > loss_disc_real_2: 0.14617164433002472 (0.19640914102395376) | > loss_disc_real_3: 0.10249723494052887 (0.19930416842301688) | > loss_disc_real_4: 0.19515293836593628 (0.21198001503944397) | > loss_disc_real_5: 0.08479055017232895 (0.16867724309364954) | > loss_0: 2.2230966091156006 (2.7152469952901206) | > loss_gen: 1.9815351963043213 (1.7181411981582642) | > loss_kl: 2.6095941066741943 (4.298605998357137) | > loss_feat: 6.567755699157715 (4.362075368563334) | > loss_mel: 21.854167938232422 (18.898375511169434) | > loss_duration: 3.0253102779388428 (3.157570997873942) | > loss_1: 36.03836441040039 (32.43476931254069) --> EVAL PERFORMANCE | > avg_loader_time: 0.002567927042643229 (-0.019060373306274414) | > avg_loss_disc: 2.7152469952901206 (+0.4306900898615522) | > avg_loss_disc_real_0: 0.14938457806905112 (-0.03479507565498352) | > avg_loss_disc_real_1: 0.26673348744710285 (+0.08862480024496713) | > avg_loss_disc_real_2: 0.19640914102395376 (+0.022530475010474532) | > avg_loss_disc_real_3: 0.19930416842301688 (+0.0068044972916444235) | > avg_loss_disc_real_4: 0.21198001503944397 (+0.024593590137859195) | > avg_loss_disc_real_5: 0.16867724309364954 (-0.024722006792823492) | > avg_loss_0: 2.7152469952901206 (+0.4306900898615522) | > avg_loss_gen: 1.7181411981582642 (-0.438897967338562) | > avg_loss_kl: 4.298605998357137 (+0.10194643338521292) | > avg_loss_feat: 4.362075368563334 (-1.9799125989278155) | > avg_loss_mel: 18.898375511169434 (-1.062083562215168) | > avg_loss_duration: 3.157570997873942 (-0.023338158925374497) | > avg_loss_1: 32.43476931254069 (-3.4022839864095076)  > EPOCH: 894/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:46:36)   --> TIME: 2023-10-20 10:46:46 -- STEP: 9/50 -- GLOBAL_STEP: 97710 | > loss_disc: 1.9178887605667114 (2.591414279407925) | > loss_disc_real_0: 0.04758328199386597 (0.20873572760158116) | > loss_disc_real_1: 0.1791134625673294 (0.22034843348794514) | > loss_disc_real_2: 0.16328991949558258 (0.22126648078362146) | > loss_disc_real_3: 0.338615745306015 (0.26724110047022503) | > loss_disc_real_4: 0.10167219489812851 (0.2587541912992795) | > loss_disc_real_5: 0.15919722616672516 (0.21471448325448567) | > loss_0: 1.9178887605667114 (2.591414279407925) | > grad_norm_0: tensor(444.6844, device='cuda:0') (tensor(1199.6731, device='cuda:0')) | > loss_gen: 2.7858166694641113 (2.178077869945102) | > loss_kl: 0.9558612108230591 (0.8710038065910339) | > loss_feat: 6.706902027130127 (4.970981019652552) | > loss_mel: 21.17913246154785 (16.474397513601517) | > loss_duration: 1.2766486406326294 (1.363305754131741) | > loss_1: 32.904361724853516 (25.85776689317491) | > grad_norm_1: tensor(13098.7402, device='cuda:0') (tensor(45576.7266, device='cuda:0')) | > current_lr_0: 8.179871111065092e-05 | > current_lr_1: 8.179871111065092e-05 | > step_time: 0.5727 (0.5885791513654921) | > loader_time: 0.0179 (0.018712653054131403)  --> TIME: 2023-10-20 10:47:06 -- STEP: 39/50 -- GLOBAL_STEP: 97740 | > loss_disc: 2.821901798248291 (2.5264120652125435) | > loss_disc_real_0: 0.2914336323738098 (0.16482991414765516) | > loss_disc_real_1: 0.25415050983428955 (0.224878493983012) | > loss_disc_real_2: 0.2865028381347656 (0.22029928949016792) | > loss_disc_real_3: 0.23883312940597534 (0.24333899807280454) | > loss_disc_real_4: 0.23436325788497925 (0.23556993366816106) | > loss_disc_real_5: 0.2657448351383209 (0.24370919234859637) | > loss_0: 2.821901798248291 (2.5264120652125435) | > grad_norm_0: tensor(1294.2367, device='cuda:0') (tensor(1207.6166, device='cuda:0')) | > loss_gen: 1.8381290435791016 (2.223907268964328) | > loss_kl: 0.9436894059181213 (0.8401730931722201) | > loss_feat: 0.8907403945922852 (5.327076225995254) | > loss_mel: 14.682916641235352 (20.42097845444312) | > loss_duration: 1.4539625644683838 (1.3612257975798385) | > loss_1: 19.809436798095703 (30.173360812358368) | > grad_norm_1: tensor(8452.8662, device='cuda:0') (tensor(38941.4531, device='cuda:0')) | > current_lr_0: 8.179871111065092e-05 | > current_lr_1: 8.179871111065092e-05 | > step_time: 0.4999 (0.6325992254110483) | > loader_time: 0.0055 (0.020247367712167594)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9115099906921387 (2.9115099906921387) | > loss_disc_real_0: 0.3475343883037567 (0.3475343883037567) | > loss_disc_real_1: 0.19316942989826202 (0.19316942989826202) | > loss_disc_real_2: 0.24813511967658997 (0.24813511967658997) | > loss_disc_real_3: 0.2543625235557556 (0.2543625235557556) | > loss_disc_real_4: 0.20129629969596863 (0.20129629969596863) | > loss_disc_real_5: 0.30213260650634766 (0.30213260650634766) | > loss_0: 2.9115099906921387 (2.9115099906921387) | > loss_gen: 1.9043092727661133 (1.9043092727661133) | > loss_kl: 5.526433944702148 (5.526433944702148) | > loss_feat: 7.6436767578125 (7.6436767578125) | > loss_mel: 22.343706130981445 (22.343706130981445) | > loss_duration: 2.9876654148101807 (2.9876654148101807) | > loss_1: 40.405792236328125 (40.405792236328125)  --> STEP: 1 | > loss_disc: 2.415728807449341 (2.415728807449341) | > loss_disc_real_0: 0.17197196185588837 (0.17197196185588837) | > loss_disc_real_1: 0.23962092399597168 (0.23962092399597168) | > loss_disc_real_2: 0.2532905340194702 (0.2532905340194702) | > loss_disc_real_3: 0.1081274002790451 (0.1081274002790451) | > loss_disc_real_4: 0.148563951253891 (0.148563951253891) | > loss_disc_real_5: 0.10154170542955399 (0.10154170542955399) | > loss_0: 2.415728807449341 (2.415728807449341) | > loss_gen: 1.960218906402588 (1.960218906402588) | > loss_kl: 5.387199878692627 (5.387199878692627) | > loss_feat: 7.413926601409912 (7.413926601409912) | > loss_mel: 26.364240646362305 (26.364240646362305) | > loss_duration: 3.335087299346924 (3.335087299346924) | > loss_1: 44.46067428588867 (44.46067428588867)  --> STEP: 2 | > loss_disc: 2.5505900382995605 (2.4831594228744507) | > loss_disc_real_0: 0.3121691644191742 (0.24207056313753128) | > loss_disc_real_1: 0.22894638776779175 (0.2342836558818817) | > loss_disc_real_2: 0.15775062143802643 (0.20552057772874832) | > loss_disc_real_3: 0.2838091254234314 (0.19596826285123825) | > loss_disc_real_4: 0.136834517121315 (0.142699234187603) | > loss_disc_real_5: 0.23273439705371857 (0.16713805124163628) | > loss_0: 2.5505900382995605 (2.4831594228744507) | > loss_gen: 2.3067617416381836 (2.1334903240203857) | > loss_kl: 5.850889205932617 (5.619044542312622) | > loss_feat: 5.420125961303711 (6.4170262813568115) | > loss_mel: 26.282917022705078 (26.32357883453369) | > loss_duration: 3.2316536903381348 (3.2833704948425293) | > loss_1: 43.092350006103516 (43.776512145996094)  --> STEP: 3 | > loss_disc: 3.1544950008392334 (2.7069379488627114) | > loss_disc_real_0: 0.26343834400177 (0.24919315675894418) | > loss_disc_real_1: 0.33471569418907166 (0.2677610019842784) | > loss_disc_real_2: 0.36860206723213196 (0.2598810742298762) | > loss_disc_real_3: 0.35553669929504395 (0.24915774166584015) | > loss_disc_real_4: 0.27121981978416443 (0.18553942938645682) | > loss_disc_real_5: 0.3294914960861206 (0.22125586618979773) | > loss_0: 3.1544950008392334 (2.7069379488627114) | > loss_gen: 1.9524586200714111 (2.073146422704061) | > loss_kl: 2.8650081157684326 (4.701032400131226) | > loss_feat: 2.234104871749878 (5.022719144821167) | > loss_mel: 18.22919464111328 (23.625450770060223) | > loss_duration: 3.00581955909729 (3.1908535162607827) | > loss_1: 28.28658676147461 (38.61320368448893) --> EVAL PERFORMANCE | > avg_loader_time: 0.005010763804117839 (+0.00244283676147461) | > avg_loss_disc: 2.7069379488627114 (-0.00830904642740915) | > avg_loss_disc_real_0: 0.24919315675894418 (+0.09980857868989307) | > avg_loss_disc_real_1: 0.2677610019842784 (+0.0010275145371755334) | > avg_loss_disc_real_2: 0.2598810742298762 (+0.06347193320592245) | > avg_loss_disc_real_3: 0.24915774166584015 (+0.049853573242823274) | > avg_loss_disc_real_4: 0.18553942938645682 (-0.026440585652987153) | > avg_loss_disc_real_5: 0.22125586618979773 (+0.05257862309614819) | > avg_loss_0: 2.7069379488627114 (-0.00830904642740915) | > avg_loss_gen: 2.073146422704061 (+0.35500522454579686) | > avg_loss_kl: 4.701032400131226 (+0.40242640177408884) | > avg_loss_feat: 5.022719144821167 (+0.6606437762578325) | > avg_loss_mel: 23.625450770060223 (+4.727075258890789) | > avg_loss_duration: 3.1908535162607827 (+0.03328251838684082) | > avg_loss_1: 38.61320368448893 (+6.178434371948242)  > EPOCH: 895/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:47:23)   --> TIME: 2023-10-20 10:47:38 -- STEP: 19/50 -- GLOBAL_STEP: 97770 | > loss_disc: 1.9883583784103394 (2.316767040051912) | > loss_disc_real_0: 0.16788215935230255 (0.13480549349792695) | > loss_disc_real_1: 0.1445484161376953 (0.2197286480743634) | > loss_disc_real_2: 0.2706717550754547 (0.24106128121677198) | > loss_disc_real_3: 0.19130685925483704 (0.22256572074011752) | > loss_disc_real_4: 0.24000810086727142 (0.19380516088322589) | > loss_disc_real_5: 0.27895236015319824 (0.19929575586789533) | > loss_0: 1.9883583784103394 (2.316767040051912) | > grad_norm_0: tensor(548.3767, device='cuda:0') (tensor(729.7850, device='cuda:0')) | > loss_gen: 3.281883478164673 (2.419524117519981) | > loss_kl: 1.171642780303955 (0.8739064273081327) | > loss_feat: 7.123520851135254 (6.073162410016122) | > loss_mel: 23.190256118774414 (21.34163042118675) | > loss_duration: 1.4719008207321167 (1.4089346433940686) | > loss_1: 36.23920440673828 (32.117158237256504) | > grad_norm_1: tensor(37306.9375, device='cuda:0') (tensor(24814.1328, device='cuda:0')) | > current_lr_0: 8.171694817753101e-05 | > current_lr_1: 8.171694817753101e-05 | > step_time: 0.4723 (0.49313448604784516) | > loader_time: 0.0212 (0.024258852005004883)  --> TIME: 2023-10-20 10:47:51 -- STEP: 49/50 -- GLOBAL_STEP: 97800 | > loss_disc: 2.4880473613739014 (2.3625594791100957) | > loss_disc_real_0: 0.1994767040014267 (0.13616651066635946) | > loss_disc_real_1: 0.1836872547864914 (0.21913151131296643) | > loss_disc_real_2: 0.1354936957359314 (0.2229159440161014) | > loss_disc_real_3: 0.2162710428237915 (0.21886974846830173) | > loss_disc_real_4: 0.26827019453048706 (0.2192504217430037) | > loss_disc_real_5: 0.24522599577903748 (0.22088542436154524) | > loss_0: 2.4880473613739014 (2.3625594791100957) | > grad_norm_0: tensor(463.4854, device='cuda:0') (tensor(633.9617, device='cuda:0')) | > loss_gen: 2.1207191944122314 (2.365787579088795) | > loss_kl: 1.0620718002319336 (0.8380040082396293) | > loss_feat: 3.752285957336426 (5.701486394797661) | > loss_mel: 19.48931884765625 (21.3169737397408) | > loss_duration: 1.4298371076583862 (1.3784096630252138) | > loss_1: 27.854232788085938 (31.600661180457294) | > grad_norm_1: tensor(11026.0283, device='cuda:0') (tensor(21502.0957, device='cuda:0')) | > current_lr_0: 8.171694817753101e-05 | > current_lr_1: 8.171694817753101e-05 | > step_time: 0.423 (0.4355157102857317) | > loader_time: 0.4474 (0.023548500878470286)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6406049728393555 (2.6406049728393555) | > loss_disc_real_0: 0.17707712948322296 (0.17707712948322296) | > loss_disc_real_1: 0.1820029765367508 (0.1820029765367508) | > loss_disc_real_2: 0.10881628096103668 (0.10881628096103668) | > loss_disc_real_3: 0.36436790227890015 (0.36436790227890015) | > loss_disc_real_4: 0.11633693426847458 (0.11633693426847458) | > loss_disc_real_5: 0.14242225885391235 (0.14242225885391235) | > loss_0: 2.6406049728393555 (2.6406049728393555) | > loss_gen: 1.7228771448135376 (1.7228771448135376) | > loss_kl: 4.194644451141357 (4.194644451141357) | > loss_feat: 6.953587055206299 (6.953587055206299) | > loss_mel: 23.653465270996094 (23.653465270996094) | > loss_duration: 2.812904119491577 (2.812904119491577) | > loss_1: 39.33747863769531 (39.33747863769531)  --> STEP: 1 | > loss_disc: 2.9859204292297363 (2.9859204292297363) | > loss_disc_real_0: 0.38871532678604126 (0.38871532678604126) | > loss_disc_real_1: 0.2809411883354187 (0.2809411883354187) | > loss_disc_real_2: 0.27299362421035767 (0.27299362421035767) | > loss_disc_real_3: 0.2853556275367737 (0.2853556275367737) | > loss_disc_real_4: 0.31212732195854187 (0.31212732195854187) | > loss_disc_real_5: 0.30619898438453674 (0.30619898438453674) | > loss_0: 2.9859204292297363 (2.9859204292297363) | > loss_gen: 2.0363457202911377 (2.0363457202911377) | > loss_kl: 4.45810604095459 (4.45810604095459) | > loss_feat: 1.740446925163269 (1.740446925163269) | > loss_mel: 19.960453033447266 (19.960453033447266) | > loss_duration: 3.293261766433716 (3.293261766433716) | > loss_1: 31.488615036010742 (31.488615036010742)  --> STEP: 2 | > loss_disc: 1.8453242778778076 (2.415622353553772) | > loss_disc_real_0: 0.022411994636058807 (0.20556366071105003) | > loss_disc_real_1: 0.06570958346128464 (0.17332538589835167) | > loss_disc_real_2: 0.06562171131372452 (0.1693076677620411) | > loss_disc_real_3: 0.07810509949922562 (0.18173036351799965) | > loss_disc_real_4: 0.054354652762413025 (0.18324098736047745) | > loss_disc_real_5: 0.0616990402340889 (0.18394901230931282) | > loss_0: 1.8453242778778076 (2.415622353553772) | > loss_gen: 1.9774895906448364 (2.006917655467987) | > loss_kl: 5.409340858459473 (4.933723449707031) | > loss_feat: 14.384978294372559 (8.062712609767914) | > loss_mel: 24.696029663085938 (22.3282413482666) | > loss_duration: 3.0973198413848877 (3.1952908039093018) | > loss_1: 49.56515884399414 (40.52688694000244)  --> STEP: 3 | > loss_disc: 2.7313055992126465 (2.52085010210673) | > loss_disc_real_0: 0.19297155737876892 (0.201366292933623) | > loss_disc_real_1: 0.3676823079586029 (0.23811102658510208) | > loss_disc_real_2: 0.24082621932029724 (0.19314718494812647) | > loss_disc_real_3: 0.328093558549881 (0.23051809519529343) | > loss_disc_real_4: 0.3334992229938507 (0.2333270659049352) | > loss_disc_real_5: 0.3753505349159241 (0.2477495198448499) | > loss_0: 2.7313055992126465 (2.52085010210673) | > loss_gen: 2.485658884048462 (2.166498064994812) | > loss_kl: 2.875742197036743 (4.2477296988169355) | > loss_feat: 3.6589407920837402 (6.594788670539856) | > loss_mel: 17.350666046142578 (20.669049580891926) | > loss_duration: 2.9484102725982666 (3.11299729347229) | > loss_1: 29.31941795349121 (36.791063944498696) --> EVAL PERFORMANCE | > avg_loader_time: 0.02468585968017578 (+0.01967509587605794) | > avg_loss_disc: 2.52085010210673 (-0.18608784675598145) | > avg_loss_disc_real_0: 0.201366292933623 (-0.0478268638253212) | > avg_loss_disc_real_1: 0.23811102658510208 (-0.029649975399176298) | > avg_loss_disc_real_2: 0.19314718494812647 (-0.06673388928174975) | > avg_loss_disc_real_3: 0.23051809519529343 (-0.018639646470546722) | > avg_loss_disc_real_4: 0.2333270659049352 (+0.047787636518478394) | > avg_loss_disc_real_5: 0.2477495198448499 (+0.026493653655052185) | > avg_loss_0: 2.52085010210673 (-0.18608784675598145) | > avg_loss_gen: 2.166498064994812 (+0.09335164229075099) | > avg_loss_kl: 4.2477296988169355 (-0.45330270131429007) | > avg_loss_feat: 6.594788670539856 (+1.572069525718689) | > avg_loss_mel: 20.669049580891926 (-2.9564011891682966) | > avg_loss_duration: 3.11299729347229 (-0.07785622278849269) | > avg_loss_1: 36.791063944498696 (-1.8221397399902344)  > EPOCH: 896/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:48:11)   --> TIME: 2023-10-20 10:48:37 -- STEP: 29/50 -- GLOBAL_STEP: 97830 | > loss_disc: 2.308718681335449 (2.3728364171652965) | > loss_disc_real_0: 0.3286718726158142 (0.1437389539747402) | > loss_disc_real_1: 0.19068455696105957 (0.2250506727602975) | > loss_disc_real_2: 0.34666457772254944 (0.21997587395639256) | > loss_disc_real_3: 0.2250041514635086 (0.24175981335855765) | > loss_disc_real_4: 0.39024779200553894 (0.19956626794461546) | > loss_disc_real_5: 0.24036645889282227 (0.19787163939327002) | > loss_0: 2.308718681335449 (2.3728364171652965) | > grad_norm_0: tensor(759.1344, device='cuda:0') (tensor(538.9354, device='cuda:0')) | > loss_gen: 3.2957358360290527 (2.3639675830972604) | > loss_kl: 0.47971439361572266 (0.8327958686598416) | > loss_feat: 6.667293071746826 (6.177983734820938) | > loss_mel: 23.77391815185547 (20.65510357248372) | > loss_duration: 1.3426461219787598 (1.382423655740146) | > loss_1: 35.55930709838867 (31.41227439354206) | > grad_norm_1: tensor(6773.3496, device='cuda:0') (tensor(31384.6465, device='cuda:0')) | > current_lr_0: 8.163526697158189e-05 | > current_lr_1: 8.163526697158189e-05 | > step_time: 0.3309 (0.6078975858359501) | > loader_time: 0.0023 (0.02541237864001044)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5561885833740234 (2.5561885833740234) | > loss_disc_real_0: 0.1679595410823822 (0.1679595410823822) | > loss_disc_real_1: 0.21262924373149872 (0.21262924373149872) | > loss_disc_real_2: 0.15968944132328033 (0.15968944132328033) | > loss_disc_real_3: 0.35877591371536255 (0.35877591371536255) | > loss_disc_real_4: 0.14849616587162018 (0.14849616587162018) | > loss_disc_real_5: 0.27805009484291077 (0.27805009484291077) | > loss_0: 2.5561885833740234 (2.5561885833740234) | > loss_gen: 2.043275833129883 (2.043275833129883) | > loss_kl: 4.82179594039917 (4.82179594039917) | > loss_feat: 6.490002155303955 (6.490002155303955) | > loss_mel: 24.06157875061035 (24.06157875061035) | > loss_duration: 2.9170074462890625 (2.9170074462890625) | > loss_1: 40.333656311035156 (40.333656311035156)  --> STEP: 1 | > loss_disc: 2.9192280769348145 (2.9192280769348145) | > loss_disc_real_0: 0.2998763918876648 (0.2998763918876648) | > loss_disc_real_1: 0.25832152366638184 (0.25832152366638184) | > loss_disc_real_2: 0.2470237910747528 (0.2470237910747528) | > loss_disc_real_3: 0.23601758480072021 (0.23601758480072021) | > loss_disc_real_4: 0.2575567662715912 (0.2575567662715912) | > loss_disc_real_5: 0.2581510841846466 (0.2581510841846466) | > loss_0: 2.9192280769348145 (2.9192280769348145) | > loss_gen: 1.6776301860809326 (1.6776301860809326) | > loss_kl: 5.097395420074463 (5.097395420074463) | > loss_feat: 0.2341894954442978 (0.2341894954442978) | > loss_mel: 11.895882606506348 (11.895882606506348) | > loss_duration: 3.233874797821045 (3.233874797821045) | > loss_1: 22.13897132873535 (22.13897132873535)  --> STEP: 2 | > loss_disc: 2.5923573970794678 (2.755792737007141) | > loss_disc_real_0: 0.27033090591430664 (0.2851036489009857) | > loss_disc_real_1: 0.22889107465744019 (0.243606299161911) | > loss_disc_real_2: 0.16340473294258118 (0.205214262008667) | > loss_disc_real_3: 0.16677309572696686 (0.20139534026384354) | > loss_disc_real_4: 0.20460554957389832 (0.23108115792274475) | > loss_disc_real_5: 0.14756885170936584 (0.20285996794700623) | > loss_0: 2.5923573970794678 (2.755792737007141) | > loss_gen: 1.8111846446990967 (1.7444074153900146) | > loss_kl: 5.564737319946289 (5.331066370010376) | > loss_feat: 4.191559314727783 (2.2128744050860405) | > loss_mel: 17.565967559814453 (14.7309250831604) | > loss_duration: 3.1043829917907715 (3.169128894805908) | > loss_1: 32.237831115722656 (27.188401222229004)  --> STEP: 3 | > loss_disc: 2.7245025634765625 (2.7453626791636148) | > loss_disc_real_0: 0.17954756319522858 (0.24991828699906668) | > loss_disc_real_1: 0.2922009229660034 (0.25980450709660846) | > loss_disc_real_2: 0.2626921534538269 (0.22437355915705362) | > loss_disc_real_3: 0.20999637246131897 (0.20426235099633536) | > loss_disc_real_4: 0.41623130440711975 (0.29279787341753644) | > loss_disc_real_5: 0.3771580755710602 (0.26095933715502423) | > loss_0: 2.7245025634765625 (2.7453626791636148) | > loss_gen: 2.2840707302093506 (1.92429518699646) | > loss_kl: 2.395719051361084 (4.352617263793945) | > loss_feat: 4.0195770263671875 (2.815108612179756) | > loss_mel: 20.681386947631836 (16.714412371317547) | > loss_duration: 2.9475982189178467 (3.095285336176554) | > loss_1: 32.32835388183594 (28.901718775431316) --> EVAL PERFORMANCE | > avg_loader_time: 0.013893206914265951 (-0.01079265276590983) | > avg_loss_disc: 2.7453626791636148 (+0.22451257705688477) | > avg_loss_disc_real_0: 0.24991828699906668 (+0.04855199406544369) | > avg_loss_disc_real_1: 0.25980450709660846 (+0.02169348051150638) | > avg_loss_disc_real_2: 0.22437355915705362 (+0.031226374208927155) | > avg_loss_disc_real_3: 0.20426235099633536 (-0.02625574419895807) | > avg_loss_disc_real_4: 0.29279787341753644 (+0.059470807512601226) | > avg_loss_disc_real_5: 0.26095933715502423 (+0.013209817310174315) | > avg_loss_0: 2.7453626791636148 (+0.22451257705688477) | > avg_loss_gen: 1.92429518699646 (-0.24220287799835205) | > avg_loss_kl: 4.352617263793945 (+0.1048875649770098) | > avg_loss_feat: 2.815108612179756 (-3.7796800583601) | > avg_loss_mel: 16.714412371317547 (-3.954637209574379) | > avg_loss_duration: 3.095285336176554 (-0.017711957295735825) | > avg_loss_1: 28.901718775431316 (-7.889345169067379)  > EPOCH: 897/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:49:04)   --> TIME: 2023-10-20 10:49:15 -- STEP: 9/50 -- GLOBAL_STEP: 97860 | > loss_disc: 2.510188579559326 (2.554696957270304) | > loss_disc_real_0: 0.18361341953277588 (0.11082011957963307) | > loss_disc_real_1: 0.2898746430873871 (0.27085502487089896) | > loss_disc_real_2: 0.23616346716880798 (0.22917556141813597) | > loss_disc_real_3: 0.28925976157188416 (0.24735396520959008) | > loss_disc_real_4: 0.23306870460510254 (0.24009107115368047) | > loss_disc_real_5: 0.24065232276916504 (0.2419571710957421) | > loss_0: 2.510188579559326 (2.554696957270304) | > grad_norm_0: tensor(614.2106, device='cuda:0') (tensor(570.6484, device='cuda:0')) | > loss_gen: 2.3154571056365967 (2.2284192906485663) | > loss_kl: 0.8819900751113892 (0.9410798880789015) | > loss_feat: 2.499917984008789 (5.488134801387787) | > loss_mel: 22.699363708496094 (21.52696990966797) | > loss_duration: 1.3755754232406616 (1.3696197668711345) | > loss_1: 29.77230453491211 (31.554223166571724) | > grad_norm_1: tensor(3770.7961, device='cuda:0') (tensor(16670.8066, device='cuda:0')) | > current_lr_0: 8.155366741111213e-05 | > current_lr_1: 8.155366741111213e-05 | > step_time: 0.3352 (0.6084831025865343) | > loader_time: 0.0184 (0.02615687582227919)  --> TIME: 2023-10-20 10:49:28 -- STEP: 39/50 -- GLOBAL_STEP: 97890 | > loss_disc: 2.425570487976074 (2.5164456275793228) | > loss_disc_real_0: 0.06858622282743454 (0.14836665300222543) | > loss_disc_real_1: 0.18193204700946808 (0.23543413298634383) | > loss_disc_real_2: 0.12904280424118042 (0.24118293372866434) | > loss_disc_real_3: 0.1411898285150528 (0.24153913099032182) | > loss_disc_real_4: 0.08377634733915329 (0.2401636943507653) | > loss_disc_real_5: 0.034163374453783035 (0.2344832496765332) | > loss_0: 2.425570487976074 (2.5164456275793228) | > grad_norm_0: tensor(626.7722, device='cuda:0') (tensor(647.7999, device='cuda:0')) | > loss_gen: 1.8243759870529175 (2.2628436516492787) | > loss_kl: 0.5661787986755371 (0.8561905912863903) | > loss_feat: 6.088069915771484 (5.273888103043039) | > loss_mel: 21.006946563720703 (20.040832112997006) | > loss_duration: 1.4027475118637085 (1.3644051857483692) | > loss_1: 30.88831901550293 (29.798159171373417) | > grad_norm_1: tensor(24669.9668, device='cuda:0') (tensor(19703.1309, device='cuda:0')) | > current_lr_0: 8.155366741111213e-05 | > current_lr_1: 8.155366741111213e-05 | > step_time: 0.3589 (0.4594436242030217) | > loader_time: 0.0125 (0.013261195940849109)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9344048500061035 (2.9344048500061035) | > loss_disc_real_0: 0.5698399543762207 (0.5698399543762207) | > loss_disc_real_1: 0.2532195448875427 (0.2532195448875427) | > loss_disc_real_2: 0.2480369657278061 (0.2480369657278061) | > loss_disc_real_3: 0.34422004222869873 (0.34422004222869873) | > loss_disc_real_4: 0.4088326096534729 (0.4088326096534729) | > loss_disc_real_5: 0.44349026679992676 (0.44349026679992676) | > loss_0: 2.9344048500061035 (2.9344048500061035) | > loss_gen: 3.3391337394714355 (3.3391337394714355) | > loss_kl: 5.367514610290527 (5.367514610290527) | > loss_feat: 5.775398254394531 (5.775398254394531) | > loss_mel: 22.57069969177246 (22.57069969177246) | > loss_duration: 2.9589478969573975 (2.9589478969573975) | > loss_1: 40.01169204711914 (40.01169204711914)  --> STEP: 1 | > loss_disc: 2.3623275756835938 (2.3623275756835938) | > loss_disc_real_0: 0.2725701332092285 (0.2725701332092285) | > loss_disc_real_1: 0.11423888057470322 (0.11423888057470322) | > loss_disc_real_2: 0.2637770175933838 (0.2637770175933838) | > loss_disc_real_3: 0.30749136209487915 (0.30749136209487915) | > loss_disc_real_4: 0.21597175300121307 (0.21597175300121307) | > loss_disc_real_5: 0.3230091333389282 (0.3230091333389282) | > loss_0: 2.3623275756835938 (2.3623275756835938) | > loss_gen: 3.0224978923797607 (3.0224978923797607) | > loss_kl: 5.2184553146362305 (5.2184553146362305) | > loss_feat: 6.976716041564941 (6.976716041564941) | > loss_mel: 24.109373092651367 (24.109373092651367) | > loss_duration: 3.271357774734497 (3.271357774734497) | > loss_1: 42.5984001159668 (42.5984001159668)  --> STEP: 2 | > loss_disc: 3.0268754959106445 (2.694601535797119) | > loss_disc_real_0: 0.3787572383880615 (0.325663685798645) | > loss_disc_real_1: 0.24085034430027008 (0.17754461243748665) | > loss_disc_real_2: 0.265175998210907 (0.2644765079021454) | > loss_disc_real_3: 0.27549779415130615 (0.29149457812309265) | > loss_disc_real_4: 0.23586609959602356 (0.22591892629861832) | > loss_disc_real_5: 0.1758470982313156 (0.24942811578512192) | > loss_0: 3.0268754959106445 (2.694601535797119) | > loss_gen: 1.6678727865219116 (2.345185339450836) | > loss_kl: 5.404074192047119 (5.311264753341675) | > loss_feat: 2.041839599609375 (4.509277820587158) | > loss_mel: 11.883827209472656 (17.99660015106201) | > loss_duration: 3.1305952072143555 (3.2009764909744263) | > loss_1: 24.12820816040039 (33.363304138183594)  --> STEP: 3 | > loss_disc: 2.985412836074829 (2.791538635889689) | > loss_disc_real_0: 0.4402826726436615 (0.3638700147469838) | > loss_disc_real_1: 0.2725525498390198 (0.20921392490466437) | > loss_disc_real_2: 0.2702508270740509 (0.2664012809594472) | > loss_disc_real_3: 0.28634124994277954 (0.2897768020629883) | > loss_disc_real_4: 0.2510679364204407 (0.2343019296725591) | > loss_disc_real_5: 0.2699548900127411 (0.256270373860995) | > loss_0: 2.985412836074829 (2.791538635889689) | > loss_gen: 2.0039114952087402 (2.2314273913701377) | > loss_kl: 2.4922173023223877 (4.371582269668579) | > loss_feat: 0.4741250276565552 (3.1642268896102905) | > loss_mel: 15.527199745178223 (17.173466682434082) | > loss_duration: 2.9668924808502197 (3.122948487599691) | > loss_1: 23.464345932006836 (30.06365140279134) --> EVAL PERFORMANCE | > avg_loader_time: 0.00589140256245931 (-0.00800180435180664) | > avg_loss_disc: 2.791538635889689 (+0.04617595672607422) | > avg_loss_disc_real_0: 0.3638700147469838 (+0.11395172774791715) | > avg_loss_disc_real_1: 0.20921392490466437 (-0.050590582191944095) | > avg_loss_disc_real_2: 0.2664012809594472 (+0.042027721802393586) | > avg_loss_disc_real_3: 0.2897768020629883 (+0.08551445106665292) | > avg_loss_disc_real_4: 0.2343019296725591 (-0.058495943744977325) | > avg_loss_disc_real_5: 0.256270373860995 (-0.004688963294029236) | > avg_loss_0: 2.791538635889689 (+0.04617595672607422) | > avg_loss_gen: 2.2314273913701377 (+0.3071322043736777) | > avg_loss_kl: 4.371582269668579 (+0.01896500587463379) | > avg_loss_feat: 3.1642268896102905 (+0.34911827743053436) | > avg_loss_mel: 17.173466682434082 (+0.4590543111165353) | > avg_loss_duration: 3.122948487599691 (+0.02766315142313669) | > avg_loss_1: 30.06365140279134 (+1.1619326273600237)  > EPOCH: 898/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:49:55)   --> TIME: 2023-10-20 10:50:12 -- STEP: 19/50 -- GLOBAL_STEP: 97920 | > loss_disc: 1.7908835411071777 (2.331407816786515) | > loss_disc_real_0: 0.02842784859240055 (0.16690173480463655) | > loss_disc_real_1: 0.1480841189622879 (0.20796394465785278) | > loss_disc_real_2: 0.21672169864177704 (0.20657811274653987) | > loss_disc_real_3: 0.11685028672218323 (0.2368291275281655) | > loss_disc_real_4: 0.2909482717514038 (0.21290982720491133) | > loss_disc_real_5: 0.22398054599761963 (0.2151518973865007) | > loss_0: 1.7908835411071777 (2.331407816786515) | > grad_norm_0: tensor(315.1937, device='cuda:0') (tensor(669.7955, device='cuda:0')) | > loss_gen: 2.8764986991882324 (2.434150557768972) | > loss_kl: 0.761938750743866 (0.86920953738062) | > loss_feat: 7.856658458709717 (6.054454607791023) | > loss_mel: 22.130224227905273 (20.294258516085776) | > loss_duration: 1.438744306564331 (1.4091572761535645) | > loss_1: 35.064064025878906 (31.061229806197318) | > grad_norm_1: tensor(9534.8340, device='cuda:0') (tensor(26904.3340, device='cuda:0')) | > current_lr_0: 8.147214941451194e-05 | > current_lr_1: 8.147214941451194e-05 | > step_time: 0.3428 (0.5718489446138081) | > loader_time: 0.0048 (0.029411014757658307)  --> TIME: 2023-10-20 10:50:33 -- STEP: 49/50 -- GLOBAL_STEP: 97950 | > loss_disc: 2.4221036434173584 (2.525780587780232) | > loss_disc_real_0: 0.012901977635920048 (0.1675532201533111) | > loss_disc_real_1: 0.19456015527248383 (0.2227870694228581) | > loss_disc_real_2: 0.0941341444849968 (0.2233075844694157) | > loss_disc_real_3: 0.33505818247795105 (0.23715855485322523) | > loss_disc_real_4: 0.2881484925746918 (0.2507317320500709) | > loss_disc_real_5: 0.2690151333808899 (0.23398629796444154) | > loss_0: 2.4221036434173584 (2.525780587780232) | > grad_norm_0: tensor(1488.5101, device='cuda:0') (tensor(670.6971, device='cuda:0')) | > loss_gen: 2.135132312774658 (2.2094329741536356) | > loss_kl: 0.9019158482551575 (0.8216816860498214) | > loss_feat: 2.5658481121063232 (4.68838806172871) | > loss_mel: 22.2314453125 (18.62362339910196) | > loss_duration: 1.4995009899139404 (1.3813485126106106) | > loss_1: 29.33384132385254 (27.72447457605479) | > grad_norm_1: tensor(8224.9902, device='cuda:0') (tensor(24224.6836, device='cuda:0')) | > current_lr_0: 8.147214941451194e-05 | > current_lr_1: 8.147214941451194e-05 | > step_time: 0.4978 (0.6180570806775775) | > loader_time: 0.5571 (0.03540895423110651)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9918458461761475 (2.9918458461761475) | > loss_disc_real_0: 0.2966929078102112 (0.2966929078102112) | > loss_disc_real_1: 0.28303247690200806 (0.28303247690200806) | > loss_disc_real_2: 0.2709873616695404 (0.2709873616695404) | > loss_disc_real_3: 0.2863423824310303 (0.2863423824310303) | > loss_disc_real_4: 0.27543243765830994 (0.27543243765830994) | > loss_disc_real_5: 0.27420341968536377 (0.27420341968536377) | > loss_0: 2.9918458461761475 (2.9918458461761475) | > loss_gen: 1.7112500667572021 (1.7112500667572021) | > loss_kl: 5.0490031242370605 (5.0490031242370605) | > loss_feat: 0.056056879460811615 (0.056056879460811615) | > loss_mel: 1.3361144065856934 (1.3361144065856934) | > loss_duration: 2.9937245845794678 (2.9937245845794678) | > loss_1: 11.146149635314941 (11.146149635314941)  --> STEP: 1 | > loss_disc: 2.5318732261657715 (2.5318732261657715) | > loss_disc_real_0: 0.14177140593528748 (0.14177140593528748) | > loss_disc_real_1: 0.25676050782203674 (0.25676050782203674) | > loss_disc_real_2: 0.20378726720809937 (0.20378726720809937) | > loss_disc_real_3: 0.33807387948036194 (0.33807387948036194) | > loss_disc_real_4: 0.2056376188993454 (0.2056376188993454) | > loss_disc_real_5: 0.1688806712627411 (0.1688806712627411) | > loss_0: 2.5318732261657715 (2.5318732261657715) | > loss_gen: 1.9991710186004639 (1.9991710186004639) | > loss_kl: 4.744796276092529 (4.744796276092529) | > loss_feat: 4.166982173919678 (4.166982173919678) | > loss_mel: 25.31043815612793 (25.31043815612793) | > loss_duration: 3.3136861324310303 (3.3136861324310303) | > loss_1: 39.53507614135742 (39.53507614135742)  --> STEP: 2 | > loss_disc: 2.8981943130493164 (2.715033769607544) | > loss_disc_real_0: 0.14617779850959778 (0.14397460222244263) | > loss_disc_real_1: 0.24996043741703033 (0.25336047261953354) | > loss_disc_real_2: 0.2943181097507477 (0.24905268847942352) | > loss_disc_real_3: 0.2755223214626312 (0.3067981004714966) | > loss_disc_real_4: 0.2715804874897003 (0.23860905319452286) | > loss_disc_real_5: 0.2713641822338104 (0.22012242674827576) | > loss_0: 2.8981943130493164 (2.715033769607544) | > loss_gen: 1.7105178833007812 (1.8548444509506226) | > loss_kl: 5.892600059509277 (5.318698167800903) | > loss_feat: 1.7065660953521729 (2.9367741346359253) | > loss_mel: 19.795757293701172 (22.55309772491455) | > loss_duration: 3.1404058933258057 (3.227046012878418) | > loss_1: 32.245849609375 (35.89046287536621)  --> STEP: 3 | > loss_disc: 3.152113437652588 (2.860726992289225) | > loss_disc_real_0: 0.17178943753242493 (0.15324621399243674) | > loss_disc_real_1: 0.3803291320800781 (0.2956833591063817) | > loss_disc_real_2: 0.2701023817062378 (0.25606925288836163) | > loss_disc_real_3: 0.3279726207256317 (0.3138562738895416) | > loss_disc_real_4: 0.40316516160964966 (0.29346108933289844) | > loss_disc_real_5: 0.3988800048828125 (0.27970828612645465) | > loss_0: 3.152113437652588 (2.860726992289225) | > loss_gen: 1.922001600265503 (1.877230167388916) | > loss_kl: 2.8429086208343506 (4.493434985478719) | > loss_feat: 2.9707655906677246 (2.9481046199798584) | > loss_mel: 19.40400505065918 (21.503400166829426) | > loss_duration: 2.9885482788085938 (3.1475467681884766) | > loss_1: 30.12822723388672 (33.96971766153971) --> EVAL PERFORMANCE | > avg_loader_time: 0.003547827402750651 (-0.0023435751597086587) | > avg_loss_disc: 2.860726992289225 (+0.06918835639953613) | > avg_loss_disc_real_0: 0.15324621399243674 (-0.2106238007545471) | > avg_loss_disc_real_1: 0.2956833591063817 (+0.08646943420171735) | > avg_loss_disc_real_2: 0.25606925288836163 (-0.010332028071085575) | > avg_loss_disc_real_3: 0.3138562738895416 (+0.024079471826553345) | > avg_loss_disc_real_4: 0.29346108933289844 (+0.05915915966033933) | > avg_loss_disc_real_5: 0.27970828612645465 (+0.02343791226545966) | > avg_loss_0: 2.860726992289225 (+0.06918835639953613) | > avg_loss_gen: 1.877230167388916 (-0.35419722398122166) | > avg_loss_kl: 4.493434985478719 (+0.12185271581013968) | > avg_loss_feat: 2.9481046199798584 (-0.21612226963043213) | > avg_loss_mel: 21.503400166829426 (+4.329933484395344) | > avg_loss_duration: 3.1475467681884766 (+0.02459828058878566) | > avg_loss_1: 33.96971766153971 (+3.906066258748371)  > EPOCH: 899/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:50:47)   --> TIME: 2023-10-20 10:51:10 -- STEP: 29/50 -- GLOBAL_STEP: 97980 | > loss_disc: 2.8044662475585938 (2.495096839707473) | > loss_disc_real_0: 0.1837172508239746 (0.18514577003902402) | > loss_disc_real_1: 0.25422677397727966 (0.22398193431054725) | > loss_disc_real_2: 0.23540084064006805 (0.23679041348654647) | > loss_disc_real_3: 0.20523430407047272 (0.23269061705675617) | > loss_disc_real_4: 0.1777070313692093 (0.21287630190109386) | > loss_disc_real_5: 0.1502297818660736 (0.2381707532652493) | > loss_0: 2.8044662475585938 (2.495096839707473) | > grad_norm_0: tensor(496.1840, device='cuda:0') (tensor(657.4564, device='cuda:0')) | > loss_gen: 1.5415148735046387 (2.2901901623298384) | > loss_kl: 0.8538292050361633 (0.9276040463611998) | > loss_feat: 1.5323419570922852 (5.185041911129292) | > loss_mel: 16.535173416137695 (19.450756689597824) | > loss_duration: 1.3355097770690918 (1.3731669639718944) | > loss_1: 21.798370361328125 (29.22675935153303) | > grad_norm_1: tensor(6240.2808, device='cuda:0') (tensor(23575.2246, device='cuda:0')) | > current_lr_0: 8.139071290025314e-05 | > current_lr_1: 8.139071290025314e-05 | > step_time: 0.3356 (0.5985201802747003) | > loader_time: 0.0023 (0.01708637434860756)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.111658811569214 (3.111658811569214) | > loss_disc_real_0: 0.23742040991783142 (0.23742040991783142) | > loss_disc_real_1: 0.45008814334869385 (0.45008814334869385) | > loss_disc_real_2: 0.3746037483215332 (0.3746037483215332) | > loss_disc_real_3: 0.34514185786247253 (0.34514185786247253) | > loss_disc_real_4: 0.42425307631492615 (0.42425307631492615) | > loss_disc_real_5: 0.2761059105396271 (0.2761059105396271) | > loss_0: 3.111658811569214 (3.111658811569214) | > loss_gen: 2.484221935272217 (2.484221935272217) | > loss_kl: 5.24717903137207 (5.24717903137207) | > loss_feat: 6.490528583526611 (6.490528583526611) | > loss_mel: 23.179798126220703 (23.179798126220703) | > loss_duration: 2.942509651184082 (2.942509651184082) | > loss_1: 40.344234466552734 (40.344234466552734)  --> STEP: 1 | > loss_disc: 3.0508410930633545 (3.0508410930633545) | > loss_disc_real_0: 0.13865911960601807 (0.13865911960601807) | > loss_disc_real_1: 0.21776598691940308 (0.21776598691940308) | > loss_disc_real_2: 0.22477389872074127 (0.22477389872074127) | > loss_disc_real_3: 0.15805990993976593 (0.15805990993976593) | > loss_disc_real_4: 0.35638150572776794 (0.35638150572776794) | > loss_disc_real_5: 0.3805626630783081 (0.3805626630783081) | > loss_0: 3.0508410930633545 (3.0508410930633545) | > loss_gen: 1.640542984008789 (1.640542984008789) | > loss_kl: 5.074362277984619 (5.074362277984619) | > loss_feat: 6.300426006317139 (6.300426006317139) | > loss_mel: 23.706541061401367 (23.706541061401367) | > loss_duration: 3.285736083984375 (3.285736083984375) | > loss_1: 40.007606506347656 (40.007606506347656)  --> STEP: 2 | > loss_disc: 2.6499571800231934 (2.850399136543274) | > loss_disc_real_0: 0.2122374325990677 (0.17544827610254288) | > loss_disc_real_1: 0.2714403569698334 (0.24460317194461823) | > loss_disc_real_2: 0.21504639089107513 (0.2199101448059082) | > loss_disc_real_3: 0.18554474413394928 (0.1718023270368576) | > loss_disc_real_4: 0.2850373387336731 (0.3207094222307205) | > loss_disc_real_5: 0.3409867584705353 (0.3607747107744217) | > loss_0: 2.6499571800231934 (2.850399136543274) | > loss_gen: 2.1365270614624023 (1.8885350227355957) | > loss_kl: 5.470221519470215 (5.272291898727417) | > loss_feat: 5.0222015380859375 (5.661313772201538) | > loss_mel: 18.028711318969727 (20.867626190185547) | > loss_duration: 3.103142738342285 (3.19443941116333) | > loss_1: 33.76080322265625 (36.88420486450195)  --> STEP: 3 | > loss_disc: 2.2088897228240967 (2.6365626653035483) | > loss_disc_real_0: 0.3637237250804901 (0.23820675909519196) | > loss_disc_real_1: 0.3043973445892334 (0.2645345628261566) | > loss_disc_real_2: 0.12480203062295914 (0.18820744007825851) | > loss_disc_real_3: 0.26706963777542114 (0.20355809728304544) | > loss_disc_real_4: 0.17735600471496582 (0.27292494972546893) | > loss_disc_real_5: 0.24375827610492706 (0.32176923255125683) | > loss_0: 2.2088897228240967 (2.6365626653035483) | > loss_gen: 2.908177375793457 (2.2284158070882163) | > loss_kl: 2.978879690170288 (4.507821162541707) | > loss_feat: 4.389915943145752 (5.237514495849609) | > loss_mel: 24.096254348754883 (21.943835576375324) | > loss_duration: 2.973902463912964 (3.120927095413208) | > loss_1: 37.347129821777344 (37.03851318359375) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_98000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9918785095214844 (2.7253916263580322) | > loss_disc_real_0: 0.4324926435947418 (0.2867782302200794) | > loss_disc_real_1: 0.34238556027412415 (0.2839973121881485) | > loss_disc_real_2: 0.20980243384838104 (0.19360618852078915) | > loss_disc_real_3: 0.240459144115448 (0.2127833589911461) | > loss_disc_real_4: 0.2206808626651764 (0.2598639279603958) | > loss_disc_real_5: 0.2786584794521332 (0.3109915442764759) | > loss_0: 2.9918785095214844 (2.7253916263580322) | > loss_gen: 1.9278138875961304 (2.1532653272151947) | > loss_kl: 5.912710666656494 (4.859043538570404) | > loss_feat: 2.798583745956421 (4.627781808376312) | > loss_mel: 21.399080276489258 (21.80764675140381) | > loss_duration: 2.9708964824676514 (3.083419442176819) | > loss_1: 35.00908660888672 (36.53115653991699)  --> STEP: 1 | > loss_disc: 3.3082847595214844 (2.8419702529907225) | > loss_disc_real_0: 0.3103320598602295 (0.2914889961481094) | > loss_disc_real_1: 0.25094613432884216 (0.27738707661628725) | > loss_disc_real_2: 0.1643787920475006 (0.18776070922613144) | > loss_disc_real_3: 0.12504427134990692 (0.19523554146289826) | > loss_disc_real_4: 0.280915766954422 (0.26407429575920105) | > loss_disc_real_5: 0.18847055733203888 (0.2864873468875885) | > loss_0: 3.3082847595214844 (2.8419702529907225) | > loss_gen: 1.2456902265548706 (1.97175030708313) | > loss_kl: 4.871230602264404 (4.861480951309204) | > loss_feat: 4.6408891677856445 (4.630403280258179) | > loss_mel: 25.45427703857422 (22.53697280883789) | > loss_duration: 3.3379106521606445 (3.134317684173584) | > loss_1: 39.54999542236328 (37.13492431640625)  --> STEP: 2 | > loss_disc: 2.916987419128418 (2.854473114013672) | > loss_disc_real_0: 0.19391915202140808 (0.2752273554603259) | > loss_disc_real_1: 0.29678967595100403 (0.28062084317207336) | > loss_disc_real_2: 0.33706340193748474 (0.21264449134469032) | > loss_disc_real_3: 0.29304084181785583 (0.21153642485539118) | > loss_disc_real_4: 0.23528200387954712 (0.2592755804459254) | > loss_disc_real_5: 0.28882479667663574 (0.2868769218524297) | > loss_0: 2.916987419128418 (2.854473114013672) | > loss_gen: 1.777787208557129 (1.9394231239954631) | > loss_kl: 5.339931488037109 (4.941222707430522) | > loss_feat: 0.4737805426120758 (3.937632823983828) | > loss_mel: 12.731308937072754 (20.902695496877033) | > loss_duration: 3.1088006496429443 (3.130064845085144) | > loss_1: 23.431608200073242 (34.85103829701742)  --> STEP: 3 | > loss_disc: 2.452601671218872 (2.7970629079001292) | > loss_disc_real_0: 0.2858690023422241 (0.2767475907291685) | > loss_disc_real_1: 0.29656460881233215 (0.2828985239778246) | > loss_disc_real_2: 0.18928027153015137 (0.20930674565689905) | > loss_disc_real_3: 0.21894997358322144 (0.21259550324508122) | > loss_disc_real_4: 0.11503744125366211 (0.2386701319898878) | > loss_disc_real_5: 0.2513931691646576 (0.28180781432560514) | > loss_0: 2.452601671218872 (2.7970629079001292) | > loss_gen: 2.519566059112549 (2.0223006861550465) | > loss_kl: 2.62309193611145 (4.610061168670654) | > loss_feat: 7.675641059875488 (4.47163400053978) | > loss_mel: 23.408668518066406 (21.26069164276123) | > loss_duration: 3.0602056980133057 (3.120084966932024) | > loss_1: 39.287174224853516 (35.484772000994) --> EVAL PERFORMANCE | > avg_loader_time: 0.409527131489345 (+0.40597930408659433) | > avg_loss_disc: 2.7970629079001292 (-0.06366408438909588) | > avg_loss_disc_real_0: 0.2767475907291685 (+0.12350137673673175) | > avg_loss_disc_real_1: 0.2828985239778246 (-0.012784835128557104) | > avg_loss_disc_real_2: 0.20930674565689905 (-0.04676250723146258) | > avg_loss_disc_real_3: 0.21259550324508122 (-0.1012607706444604) | > avg_loss_disc_real_4: 0.2386701319898878 (-0.05479095734301065) | > avg_loss_disc_real_5: 0.28180781432560514 (+0.002099528199150491) | > avg_loss_0: 2.7970629079001292 (-0.06366408438909588) | > avg_loss_gen: 2.0223006861550465 (+0.14507051876613053) | > avg_loss_kl: 4.610061168670654 (+0.11662618319193552) | > avg_loss_feat: 4.47163400053978 (+1.5235293805599213) | > avg_loss_mel: 21.26069164276123 (-0.24270852406819543) | > avg_loss_duration: 3.120084966932024 (-0.02746180125645248) | > avg_loss_1: 35.484772000994 (+1.515054339454288)  > EPOCH: 900/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:51:41)   --> TIME: 2023-10-20 10:51:52 -- STEP: 9/50 -- GLOBAL_STEP: 98010 | > loss_disc: 3.048204183578491 (2.746742222044203) | > loss_disc_real_0: 0.20624218881130219 (0.15212113286058107) | > loss_disc_real_1: 0.33517932891845703 (0.25294509943988586) | > loss_disc_real_2: 0.27207669615745544 (0.2533339237173398) | > loss_disc_real_3: 0.37050506472587585 (0.25498566859298283) | > loss_disc_real_4: 0.2952369451522827 (0.24926145498951277) | > loss_disc_real_5: 0.2553204894065857 (0.20602039247751236) | > loss_0: 3.048204183578491 (2.746742222044203) | > grad_norm_0: tensor(463.0252, device='cuda:0') (tensor(446.0128, device='cuda:0')) | > loss_gen: 1.8708897829055786 (2.061559213532342) | > loss_kl: 0.7673422694206238 (0.6717690742678113) | > loss_feat: 2.347532272338867 (4.331194096555312) | > loss_mel: 20.662578582763672 (15.487814585367838) | > loss_duration: 1.3019567728042603 (1.3602606455485027) | > loss_1: 26.950298309326172 (23.912598345014786) | > grad_norm_1: tensor(2482.2383, device='cuda:0') (tensor(13204.5332, device='cuda:0')) | > current_lr_0: 8.130935778688905e-05 | > current_lr_1: 8.130935778688905e-05 | > step_time: 0.6865 (0.6040473249223497) | > loader_time: 0.0451 (0.030246045854356553)  --> TIME: 2023-10-20 10:52:08 -- STEP: 39/50 -- GLOBAL_STEP: 98040 | > loss_disc: 1.4050229787826538 (2.519675169235621) | > loss_disc_real_0: 0.02508324384689331 (0.14276209998971373) | > loss_disc_real_1: 0.10926125198602676 (0.22927079077523488) | > loss_disc_real_2: 0.09775133430957794 (0.22596805098538214) | > loss_disc_real_3: 0.10363834351301193 (0.24177528955997565) | > loss_disc_real_4: 0.049891747534275055 (0.22245009014239678) | > loss_disc_real_5: 0.027886830270290375 (0.21131368359932914) | > loss_0: 1.4050229787826538 (2.519675169235621) | > grad_norm_0: tensor(421.8812, device='cuda:0') (tensor(460.9985, device='cuda:0')) | > loss_gen: 2.9167280197143555 (2.1679220352417388) | > loss_kl: 0.701502799987793 (0.7969142095400737) | > loss_feat: 10.745465278625488 (4.922726765991404) | > loss_mel: 27.582231521606445 (19.2224876391582) | > loss_duration: 1.4284251928329468 (1.369484699689425) | > loss_1: 43.374351501464844 (28.479535481868645) | > grad_norm_1: tensor(53731.3477, device='cuda:0') (tensor(16932.5938, device='cuda:0')) | > current_lr_0: 8.130935778688905e-05 | > current_lr_1: 8.130935778688905e-05 | > step_time: 0.4409 (0.5466655156551263) | > loader_time: 0.0058 (0.020560081188495342)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.837318181991577 (2.837318181991577) | > loss_disc_real_0: 0.13515827059745789 (0.13515827059745789) | > loss_disc_real_1: 0.2611638903617859 (0.2611638903617859) | > loss_disc_real_2: 0.19465050101280212 (0.19465050101280212) | > loss_disc_real_3: 0.2537800669670105 (0.2537800669670105) | > loss_disc_real_4: 0.28862619400024414 (0.28862619400024414) | > loss_disc_real_5: 0.27213048934936523 (0.27213048934936523) | > loss_0: 2.837318181991577 (2.837318181991577) | > loss_gen: 1.606544017791748 (1.606544017791748) | > loss_kl: 5.779607772827148 (5.779607772827148) | > loss_feat: 0.9305698871612549 (0.9305698871612549) | > loss_mel: 16.6734676361084 (16.6734676361084) | > loss_duration: 3.004483461380005 (3.004483461380005) | > loss_1: 27.994672775268555 (27.994672775268555)  --> STEP: 1 | > loss_disc: 2.413349151611328 (2.413349151611328) | > loss_disc_real_0: 0.21691817045211792 (0.21691817045211792) | > loss_disc_real_1: 0.24646838009357452 (0.24646838009357452) | > loss_disc_real_2: 0.2686704695224762 (0.2686704695224762) | > loss_disc_real_3: 0.22378483414649963 (0.22378483414649963) | > loss_disc_real_4: 0.213158518075943 (0.213158518075943) | > loss_disc_real_5: 0.24800053238868713 (0.24800053238868713) | > loss_0: 2.413349151611328 (2.413349151611328) | > loss_gen: 2.3319692611694336 (2.3319692611694336) | > loss_kl: 5.075651168823242 (5.075651168823242) | > loss_feat: 5.568480968475342 (5.568480968475342) | > loss_mel: 24.307836532592773 (24.307836532592773) | > loss_duration: 3.305772542953491 (3.305772542953491) | > loss_1: 40.5897102355957 (40.5897102355957)  --> STEP: 2 | > loss_disc: 2.8696374893188477 (2.641493320465088) | > loss_disc_real_0: 0.17440252006053925 (0.19566034525632858) | > loss_disc_real_1: 0.2498302310705185 (0.2481493055820465) | > loss_disc_real_2: 0.20777545869350433 (0.23822296410799026) | > loss_disc_real_3: 0.26200035214424133 (0.24289259314537048) | > loss_disc_real_4: 0.308331161737442 (0.2607448399066925) | > loss_disc_real_5: 0.2501388490200043 (0.2490696907043457) | > loss_0: 2.8696374893188477 (2.641493320465088) | > loss_gen: 1.6388376951217651 (1.9854034781455994) | > loss_kl: 5.342281818389893 (5.208966493606567) | > loss_feat: 0.769843578338623 (3.1691622734069824) | > loss_mel: 13.314091682434082 (18.810964107513428) | > loss_duration: 3.1222426891326904 (3.214007616043091) | > loss_1: 24.18729591369629 (32.388503074645996)  --> STEP: 3 | > loss_disc: 2.931835412979126 (2.738274017969767) | > loss_disc_real_0: 0.26557108759880066 (0.21896392603715262) | > loss_disc_real_1: 0.22886069118976593 (0.24171976745128632) | > loss_disc_real_2: 0.19891253113746643 (0.225119486451149) | > loss_disc_real_3: 0.3188132643699646 (0.26819948355356854) | > loss_disc_real_4: 0.34311962127685547 (0.2882031003634135) | > loss_disc_real_5: 0.3809913396835327 (0.293043573697408) | > loss_0: 2.931835412979126 (2.738274017969767) | > loss_gen: 1.979587197303772 (1.9834647178649902) | > loss_kl: 2.4376304149627686 (4.285187800725301) | > loss_feat: 2.2115273475646973 (2.849950631459554) | > loss_mel: 12.9032564163208 (16.84172821044922) | > loss_duration: 2.9009361267089844 (3.109650452931722) | > loss_1: 22.432937622070312 (29.06998125712077) --> EVAL PERFORMANCE | > avg_loader_time: 0.031092087427775066 (-0.3784350440615699) | > avg_loss_disc: 2.738274017969767 (-0.05878888993036213) | > avg_loss_disc_real_0: 0.21896392603715262 (-0.057783664692015874) | > avg_loss_disc_real_1: 0.24171976745128632 (-0.041178756526538296) | > avg_loss_disc_real_2: 0.225119486451149 (+0.015812740794249935) | > avg_loss_disc_real_3: 0.26819948355356854 (+0.055603980308487316) | > avg_loss_disc_real_4: 0.2882031003634135 (+0.04953296837352572) | > avg_loss_disc_real_5: 0.293043573697408 (+0.011235759371802878) | > avg_loss_0: 2.738274017969767 (-0.05878888993036213) | > avg_loss_gen: 1.9834647178649902 (-0.03883596829005631) | > avg_loss_kl: 4.285187800725301 (-0.3248733679453535) | > avg_loss_feat: 2.849950631459554 (-1.6216833690802255) | > avg_loss_mel: 16.84172821044922 (-4.418963432312012) | > avg_loss_duration: 3.109650452931722 (-0.010434514000301931) | > avg_loss_1: 29.06998125712077 (-6.41479074387323)  > EPOCH: 901/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:52:32)   --> TIME: 2023-10-20 10:52:52 -- STEP: 19/50 -- GLOBAL_STEP: 98070 | > loss_disc: 1.7855726480484009 (2.255875932542901) | > loss_disc_real_0: 0.04295089840888977 (0.13178165864787603) | > loss_disc_real_1: 0.178806871175766 (0.2198622889424625) | > loss_disc_real_2: 0.12922954559326172 (0.20411718891639458) | > loss_disc_real_3: 0.09506941586732864 (0.2076329390861486) | > loss_disc_real_4: 0.08972352743148804 (0.1978505569461145) | > loss_disc_real_5: 0.07116083055734634 (0.18782426260019602) | > loss_0: 1.7855726480484009 (2.255875932542901) | > grad_norm_0: tensor(592.1849, device='cuda:0') (tensor(568.8901, device='cuda:0')) | > loss_gen: 2.1377077102661133 (2.509819658179032) | > loss_kl: 0.7340511083602905 (0.7778507124044394) | > loss_feat: 6.895853042602539 (6.485026129766514) | > loss_mel: 18.053186416625977 (22.616144933198626) | > loss_duration: 1.5064359903335571 (1.4178690847597624) | > loss_1: 29.327232360839844 (33.806710494192025) | > grad_norm_1: tensor(8263.4551, device='cuda:0') (tensor(27969.1387, device='cuda:0')) | > current_lr_0: 8.122808399305436e-05 | > current_lr_1: 8.122808399305436e-05 | > step_time: 0.4893 (0.6603351894177889) | > loader_time: 0.0115 (0.024864886936388518)  --> TIME: 2023-10-20 10:53:12 -- STEP: 49/50 -- GLOBAL_STEP: 98100 | > loss_disc: 2.7109873294830322 (2.4099483295362822) | > loss_disc_real_0: 0.15624400973320007 (0.14659393791641506) | > loss_disc_real_1: 0.21265216171741486 (0.21790705180289793) | > loss_disc_real_2: 0.16382905840873718 (0.2258060881677939) | > loss_disc_real_3: 0.26489683985710144 (0.22605470069969186) | > loss_disc_real_4: 0.21104471385478973 (0.22055261376865057) | > loss_disc_real_5: 0.22726067900657654 (0.22763964818904595) | > loss_0: 2.7109873294830322 (2.4099483295362822) | > grad_norm_0: tensor(1064.1694, device='cuda:0') (tensor(671.0756, device='cuda:0')) | > loss_gen: 2.558570623397827 (2.347991035909069) | > loss_kl: 0.585995078086853 (0.7549614318627484) | > loss_feat: 6.008639812469482 (5.623720157815486) | > loss_mel: 22.88010025024414 (21.650020599365238) | > loss_duration: 1.460448980331421 (1.3741833433812978) | > loss_1: 33.49375534057617 (31.750876251532105) | > grad_norm_1: tensor(31728.5098, device='cuda:0') (tensor(21360.9863, device='cuda:0')) | > current_lr_0: 8.122808399305436e-05 | > current_lr_1: 8.122808399305436e-05 | > step_time: 0.503 (0.6367081768658697) | > loader_time: 0.3918 (0.031932572929226626)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.355194568634033 (2.355194568634033) | > loss_disc_real_0: 0.2002180963754654 (0.2002180963754654) | > loss_disc_real_1: 0.18178950250148773 (0.18178950250148773) | > loss_disc_real_2: 0.18133874237537384 (0.18133874237537384) | > loss_disc_real_3: 0.25609609484672546 (0.25609609484672546) | > loss_disc_real_4: 0.16603007912635803 (0.16603007912635803) | > loss_disc_real_5: 0.25283578038215637 (0.25283578038215637) | > loss_0: 2.355194568634033 (2.355194568634033) | > loss_gen: 2.150301456451416 (2.150301456451416) | > loss_kl: 5.295185089111328 (5.295185089111328) | > loss_feat: 4.861919403076172 (4.861919403076172) | > loss_mel: 18.955917358398438 (18.955917358398438) | > loss_duration: 3.012951612472534 (3.012951612472534) | > loss_1: 34.276275634765625 (34.276275634765625)  --> STEP: 1 | > loss_disc: 2.5584912300109863 (2.5584912300109863) | > loss_disc_real_0: 0.2922815680503845 (0.2922815680503845) | > loss_disc_real_1: 0.1712689995765686 (0.1712689995765686) | > loss_disc_real_2: 0.27307114005088806 (0.27307114005088806) | > loss_disc_real_3: 0.3069603443145752 (0.3069603443145752) | > loss_disc_real_4: 0.3461979627609253 (0.3461979627609253) | > loss_disc_real_5: 0.4980389475822449 (0.4980389475822449) | > loss_0: 2.5584912300109863 (2.5584912300109863) | > loss_gen: 3.071702718734741 (3.071702718734741) | > loss_kl: 4.746016979217529 (4.746016979217529) | > loss_feat: 6.455311298370361 (6.455311298370361) | > loss_mel: 26.379732131958008 (26.379732131958008) | > loss_duration: 3.2377068996429443 (3.2377068996429443) | > loss_1: 43.89046859741211 (43.89046859741211)  --> STEP: 2 | > loss_disc: 3.0132336616516113 (2.785862445831299) | > loss_disc_real_0: 0.2525694668292999 (0.2724255174398422) | > loss_disc_real_1: 0.32994964718818665 (0.2506093233823776) | > loss_disc_real_2: 0.24187761545181274 (0.2574743777513504) | > loss_disc_real_3: 0.2806931138038635 (0.29382672905921936) | > loss_disc_real_4: 0.2777254581451416 (0.31196171045303345) | > loss_disc_real_5: 0.25613468885421753 (0.3770868182182312) | > loss_0: 3.0132336616516113 (2.785862445831299) | > loss_gen: 1.6412007808685303 (2.3564517498016357) | > loss_kl: 5.460536003112793 (5.103276491165161) | > loss_feat: 0.03479989618062973 (3.2450555972754955) | > loss_mel: 1.5645114183425903 (13.972121775150299) | > loss_duration: 3.1373887062072754 (3.18754780292511) | > loss_1: 11.838436126708984 (27.864452362060547)  --> STEP: 3 | > loss_disc: 2.8239905834198 (2.798571825027466) | > loss_disc_real_0: 0.19428035616874695 (0.24637713034947714) | > loss_disc_real_1: 0.2768664062023163 (0.2593616843223572) | > loss_disc_real_2: 0.215534970164299 (0.24349457522233328) | > loss_disc_real_3: 0.18046030402183533 (0.2560379207134247) | > loss_disc_real_4: 0.20078521966934204 (0.274902880191803) | > loss_disc_real_5: 0.16129133105278015 (0.30515498916308087) | > loss_0: 2.8239905834198 (2.798571825027466) | > loss_gen: 1.6718251705169678 (2.1282428900400796) | > loss_kl: 2.36407208442688 (4.190208355585734) | > loss_feat: 3.277911424636841 (3.256007539729277) | > loss_mel: 10.236924171447754 (12.72705590724945) | > loss_duration: 3.104840040206909 (3.1599785486857095) | > loss_1: 20.65557289123535 (25.46149253845215) --> EVAL PERFORMANCE | > avg_loader_time: 0.013009309768676758 (-0.01808277765909831) | > avg_loss_disc: 2.798571825027466 (+0.060297807057698716) | > avg_loss_disc_real_0: 0.24637713034947714 (+0.027413204312324524) | > avg_loss_disc_real_1: 0.2593616843223572 (+0.017641916871070862) | > avg_loss_disc_real_2: 0.24349457522233328 (+0.018375088771184295) | > avg_loss_disc_real_3: 0.2560379207134247 (-0.012161562840143858) | > avg_loss_disc_real_4: 0.274902880191803 (-0.013300220171610533) | > avg_loss_disc_real_5: 0.30515498916308087 (+0.012111415465672848) | > avg_loss_0: 2.798571825027466 (+0.060297807057698716) | > avg_loss_gen: 2.1282428900400796 (+0.14477817217508937) | > avg_loss_kl: 4.190208355585734 (-0.09497944513956647) | > avg_loss_feat: 3.256007539729277 (+0.40605690826972296) | > avg_loss_mel: 12.72705590724945 (-4.114672303199768) | > avg_loss_duration: 3.1599785486857095 (+0.050328095753987334) | > avg_loss_1: 25.46149253845215 (-3.608488718668621)  > EPOCH: 902/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:53:48)   --> TIME: 2023-10-20 10:54:17 -- STEP: 29/50 -- GLOBAL_STEP: 98130 | > loss_disc: 2.9983925819396973 (2.4928800196483216) | > loss_disc_real_0: 0.19031131267547607 (0.16032142783033437) | > loss_disc_real_1: 0.2708689272403717 (0.23743741355579476) | > loss_disc_real_2: 0.24864396452903748 (0.22661325958525314) | > loss_disc_real_3: 0.2671845555305481 (0.2572181057827226) | > loss_disc_real_4: 0.2800762951374054 (0.21583579082427354) | > loss_disc_real_5: 0.25348153710365295 (0.22864949889481068) | > loss_0: 2.9983925819396973 (2.4928800196483216) | > grad_norm_0: tensor(356.2402, device='cuda:0') (tensor(646.7296, device='cuda:0')) | > loss_gen: 1.545989990234375 (2.3000415892436585) | > loss_kl: 1.2687662839889526 (0.9186896250165743) | > loss_feat: 0.4679236114025116 (5.407491670600299) | > loss_mel: 8.997214317321777 (19.24301409310308) | > loss_duration: 1.3230936527252197 (1.3712355021772713) | > loss_1: 13.602987289428711 (29.240472678480476) | > grad_norm_1: tensor(12627.6328, device='cuda:0') (tensor(24755.1621, device='cuda:0')) | > current_lr_0: 8.11468914374651e-05 | > current_lr_1: 8.11468914374651e-05 | > step_time: 0.4638 (0.8164904775290653) | > loader_time: 0.0389 (0.024229057903947502)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.5028269290924072 (3.5028269290924072) | > loss_disc_real_0: 0.43831998109817505 (0.43831998109817505) | > loss_disc_real_1: 0.26542478799819946 (0.26542478799819946) | > loss_disc_real_2: 0.4199681282043457 (0.4199681282043457) | > loss_disc_real_3: 0.42333242297172546 (0.42333242297172546) | > loss_disc_real_4: 0.5610976219177246 (0.5610976219177246) | > loss_disc_real_5: 0.39206716418266296 (0.39206716418266296) | > loss_0: 3.5028269290924072 (3.5028269290924072) | > loss_gen: 2.5682482719421387 (2.5682482719421387) | > loss_kl: 4.7248053550720215 (4.7248053550720215) | > loss_feat: 6.0685882568359375 (6.0685882568359375) | > loss_mel: 25.573902130126953 (25.573902130126953) | > loss_duration: 2.993947744369507 (2.993947744369507) | > loss_1: 41.92948913574219 (41.92948913574219)  --> STEP: 1 | > loss_disc: 2.709031343460083 (2.709031343460083) | > loss_disc_real_0: 0.35272812843322754 (0.35272812843322754) | > loss_disc_real_1: 0.22284340858459473 (0.22284340858459473) | > loss_disc_real_2: 0.16572655737400055 (0.16572655737400055) | > loss_disc_real_3: 0.1638394147157669 (0.1638394147157669) | > loss_disc_real_4: 0.23476818203926086 (0.23476818203926086) | > loss_disc_real_5: 0.290246844291687 (0.290246844291687) | > loss_0: 2.709031343460083 (2.709031343460083) | > loss_gen: 2.0273399353027344 (2.0273399353027344) | > loss_kl: 5.226234436035156 (5.226234436035156) | > loss_feat: 7.420633792877197 (7.420633792877197) | > loss_mel: 23.658878326416016 (23.658878326416016) | > loss_duration: 3.294565200805664 (3.294565200805664) | > loss_1: 41.627655029296875 (41.627655029296875)  --> STEP: 2 | > loss_disc: 2.442762613296509 (2.575896978378296) | > loss_disc_real_0: 0.13481535017490387 (0.2437717393040657) | > loss_disc_real_1: 0.26356837153434753 (0.24320589005947113) | > loss_disc_real_2: 0.24286630749702454 (0.20429643243551254) | > loss_disc_real_3: 0.31244224309921265 (0.23814082890748978) | > loss_disc_real_4: 0.2724725604057312 (0.25362037122249603) | > loss_disc_real_5: 0.2603558897972107 (0.27530136704444885) | > loss_0: 2.442762613296509 (2.575896978378296) | > loss_gen: 2.398736000061035 (2.2130379676818848) | > loss_kl: 6.07466983795166 (5.650452136993408) | > loss_feat: 4.435567855834961 (5.928100824356079) | > loss_mel: 21.6187686920166 (22.63882350921631) | > loss_duration: 3.1821370124816895 (3.2383511066436768) | > loss_1: 37.709877014160156 (39.668766021728516)  --> STEP: 3 | > loss_disc: 2.9684715270996094 (2.7067551612854004) | > loss_disc_real_0: 0.3188737630844116 (0.26880574723084766) | > loss_disc_real_1: 0.3087729513645172 (0.26506157716115314) | > loss_disc_real_2: 0.2885580360889435 (0.23238363365332285) | > loss_disc_real_3: 0.31491386890411377 (0.26373184223969776) | > loss_disc_real_4: 0.284319669008255 (0.2638534704844157) | > loss_disc_real_5: 0.25804197788238525 (0.269548237323761) | > loss_0: 2.9684715270996094 (2.7067551612854004) | > loss_gen: 1.8779906034469604 (2.10135551293691) | > loss_kl: 2.699577569961548 (4.666827281316121) | > loss_feat: 0.3127065896987915 (4.056302746136983) | > loss_mel: 8.769207000732422 (18.015618006388348) | > loss_duration: 2.984895706176758 (3.1538659731547036) | > loss_1: 16.644378662109375 (31.9939702351888) --> EVAL PERFORMANCE | > avg_loader_time: 0.013225158055623373 (+0.00021584828694661516) | > avg_loss_disc: 2.7067551612854004 (-0.09181666374206543) | > avg_loss_disc_real_0: 0.26880574723084766 (+0.022428616881370517) | > avg_loss_disc_real_1: 0.26506157716115314 (+0.005699892838795961) | > avg_loss_disc_real_2: 0.23238363365332285 (-0.011110941569010435) | > avg_loss_disc_real_3: 0.26373184223969776 (+0.007693921526273073) | > avg_loss_disc_real_4: 0.2638534704844157 (-0.01104940970738727) | > avg_loss_disc_real_5: 0.269548237323761 (-0.03560675183931988) | > avg_loss_0: 2.7067551612854004 (-0.09181666374206543) | > avg_loss_gen: 2.10135551293691 (-0.026887377103169463) | > avg_loss_kl: 4.666827281316121 (+0.4766189257303868) | > avg_loss_feat: 4.056302746136983 (+0.8002952064077058) | > avg_loss_mel: 18.015618006388348 (+5.288562099138897) | > avg_loss_duration: 3.1538659731547036 (-0.006112575531005859) | > avg_loss_1: 31.9939702351888 (+6.5324776967366525)  > EPOCH: 903/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:54:38)   --> TIME: 2023-10-20 10:54:49 -- STEP: 9/50 -- GLOBAL_STEP: 98160 | > loss_disc: 1.826751470565796 (2.523712052239312) | > loss_disc_real_0: 0.07218754291534424 (0.18195133573479122) | > loss_disc_real_1: 0.13121859729290009 (0.21892445700036156) | > loss_disc_real_2: 0.0636962279677391 (0.238470868104034) | > loss_disc_real_3: 0.0793602466583252 (0.23987768921587202) | > loss_disc_real_4: 0.04492047056555748 (0.27092869869536823) | > loss_disc_real_5: 0.009454243816435337 (0.21449825757493576) | > loss_0: 1.826751470565796 (2.523712052239312) | > grad_norm_0: tensor(254.2179, device='cuda:0') (tensor(510.9452, device='cuda:0')) | > loss_gen: 2.0011472702026367 (2.21329046620263) | > loss_kl: 0.7128695249557495 (0.7803524286589689) | > loss_feat: 7.909146785736084 (4.933892872598436) | > loss_mel: 22.815574645996094 (19.50297737121582) | > loss_duration: 1.3650155067443848 (1.3495060470369127) | > loss_1: 34.80375671386719 (28.78001923031277) | > grad_norm_1: tensor(3382.8523, device='cuda:0') (tensor(19436.9922, device='cuda:0')) | > current_lr_0: 8.106578003891857e-05 | > current_lr_1: 8.106578003891857e-05 | > step_time: 0.7386 (0.6303747230105929) | > loader_time: 0.0322 (0.030112213558620878)  --> TIME: 2023-10-20 10:55:07 -- STEP: 39/50 -- GLOBAL_STEP: 98190 | > loss_disc: 2.9676899909973145 (2.547818122765957) | > loss_disc_real_0: 0.2563515305519104 (0.15585516842129904) | > loss_disc_real_1: 0.27278247475624084 (0.22840141715147558) | > loss_disc_real_2: 0.253160685300827 (0.22987873403307718) | > loss_disc_real_3: 0.26290345191955566 (0.246558812709573) | > loss_disc_real_4: 0.25916630029678345 (0.2566430151271514) | > loss_disc_real_5: 0.23996733129024506 (0.23838453952414104) | > loss_0: 2.9676899909973145 (2.547818122765957) | > grad_norm_0: tensor(229.6786, device='cuda:0') (tensor(592.4173, device='cuda:0')) | > loss_gen: 1.5807580947875977 (2.2347935193624244) | > loss_kl: 0.3956211507320404 (0.8197869593755175) | > loss_feat: 0.10329607874155045 (4.783286158855146) | > loss_mel: 5.846527099609375 (19.45190881460141) | > loss_duration: 1.4246132373809814 (1.353488136560489) | > loss_1: 9.350815773010254 (28.64326370679415) | > grad_norm_1: tensor(45288.4531, device='cuda:0') (tensor(21925.6309, device='cuda:0')) | > current_lr_0: 8.106578003891857e-05 | > current_lr_1: 8.106578003891857e-05 | > step_time: 0.2595 (0.5916807529253839) | > loader_time: 0.0022 (0.02358071620647724)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.122392177581787 (2.122392177581787) | > loss_disc_real_0: 0.028191715478897095 (0.028191715478897095) | > loss_disc_real_1: 0.06822057068347931 (0.06822057068347931) | > loss_disc_real_2: 0.048926882445812225 (0.048926882445812225) | > loss_disc_real_3: 0.12468751519918442 (0.12468751519918442) | > loss_disc_real_4: 0.055978160351514816 (0.055978160351514816) | > loss_disc_real_5: 0.03592800348997116 (0.03592800348997116) | > loss_0: 2.122392177581787 (2.122392177581787) | > loss_gen: 1.916102647781372 (1.916102647781372) | > loss_kl: 5.7125115394592285 (5.7125115394592285) | > loss_feat: 11.390371322631836 (11.390371322631836) | > loss_mel: 26.915666580200195 (26.915666580200195) | > loss_duration: 2.997112274169922 (2.997112274169922) | > loss_1: 48.9317626953125 (48.9317626953125)  --> STEP: 1 | > loss_disc: 1.9970364570617676 (1.9970364570617676) | > loss_disc_real_0: 0.14099645614624023 (0.14099645614624023) | > loss_disc_real_1: 0.19745610654354095 (0.19745610654354095) | > loss_disc_real_2: 0.10264286398887634 (0.10264286398887634) | > loss_disc_real_3: 0.16559147834777832 (0.16559147834777832) | > loss_disc_real_4: 0.19362640380859375 (0.19362640380859375) | > loss_disc_real_5: 0.20799939334392548 (0.20799939334392548) | > loss_0: 1.9970364570617676 (1.9970364570617676) | > loss_gen: 2.5177199840545654 (2.5177199840545654) | > loss_kl: 4.988713264465332 (4.988713264465332) | > loss_feat: 8.633941650390625 (8.633941650390625) | > loss_mel: 25.443628311157227 (25.443628311157227) | > loss_duration: 3.409344434738159 (3.409344434738159) | > loss_1: 44.99334716796875 (44.99334716796875)  --> STEP: 2 | > loss_disc: 2.7322914600372314 (2.3646639585494995) | > loss_disc_real_0: 0.15219713747501373 (0.14659679681062698) | > loss_disc_real_1: 0.24267706274986267 (0.2200665846467018) | > loss_disc_real_2: 0.2762555480003357 (0.18944920599460602) | > loss_disc_real_3: 0.2665387690067291 (0.21606512367725372) | > loss_disc_real_4: 0.27076447010040283 (0.2321954369544983) | > loss_disc_real_5: 0.309626966714859 (0.25881318002939224) | > loss_0: 2.7322914600372314 (2.3646639585494995) | > loss_gen: 1.9718365669250488 (2.244778275489807) | > loss_kl: 5.903566837310791 (5.4461400508880615) | > loss_feat: 2.7589147090911865 (5.696428179740906) | > loss_mel: 10.177661895751953 (17.81064510345459) | > loss_duration: 3.2691256999969482 (3.3392350673675537) | > loss_1: 24.081104278564453 (34.5372257232666)  --> STEP: 3 | > loss_disc: 2.9266905784606934 (2.552006165186564) | > loss_disc_real_0: 0.23169869184494019 (0.17496409515539804) | > loss_disc_real_1: 0.260953813791275 (0.23369566102822623) | > loss_disc_real_2: 0.2618092894554138 (0.21356923381487528) | > loss_disc_real_3: 0.2869156002998352 (0.23968194921811423) | > loss_disc_real_4: 0.27731698751449585 (0.2472359538078308) | > loss_disc_real_5: 0.27845513820648193 (0.2653604994217555) | > loss_0: 2.9266905784606934 (2.552006165186564) | > loss_gen: 1.7033058404922485 (2.064287463823954) | > loss_kl: 2.5438971519470215 (4.478725751241048) | > loss_feat: 0.5657259821891785 (3.98619411389033) | > loss_mel: 11.202265739440918 (15.6078519821167) | > loss_duration: 2.9092936515808105 (3.195921262105306) | > loss_1: 18.924488067626953 (29.332979838053387) --> EVAL PERFORMANCE | > avg_loader_time: 0.022171735763549805 (+0.008946577707926432) | > avg_loss_disc: 2.552006165186564 (-0.1547489960988364) | > avg_loss_disc_real_0: 0.17496409515539804 (-0.09384165207544962) | > avg_loss_disc_real_1: 0.23369566102822623 (-0.03136591613292691) | > avg_loss_disc_real_2: 0.21356923381487528 (-0.01881439983844757) | > avg_loss_disc_real_3: 0.23968194921811423 (-0.02404989302158353) | > avg_loss_disc_real_4: 0.2472359538078308 (-0.016617516676584898) | > avg_loss_disc_real_5: 0.2653604994217555 (-0.004187737902005495) | > avg_loss_0: 2.552006165186564 (-0.1547489960988364) | > avg_loss_gen: 2.064287463823954 (-0.037068049112956025) | > avg_loss_kl: 4.478725751241048 (-0.18810153007507324) | > avg_loss_feat: 3.98619411389033 (-0.07010863224665309) | > avg_loss_mel: 15.6078519821167 (-2.4077660242716483) | > avg_loss_duration: 3.195921262105306 (+0.04205528895060251) | > avg_loss_1: 29.332979838053387 (-2.6609903971354143)  > EPOCH: 904/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:55:29)   --> TIME: 2023-10-20 10:55:46 -- STEP: 19/50 -- GLOBAL_STEP: 98220 | > loss_disc: 2.5537195205688477 (2.6604335433558415) | > loss_disc_real_0: 0.09311951696872711 (0.18787700055461182) | > loss_disc_real_1: 0.12729817628860474 (0.2289443988549082) | > loss_disc_real_2: 0.3946817219257355 (0.25677833980635595) | > loss_disc_real_3: 0.2440868318080902 (0.25626623865805176) | > loss_disc_real_4: 0.22007247805595398 (0.24546076396578237) | > loss_disc_real_5: 0.22727791965007782 (0.2495115126826261) | > loss_0: 2.5537195205688477 (2.6604335433558415) | > grad_norm_0: tensor(994.0035, device='cuda:0') (tensor(682.2533, device='cuda:0')) | > loss_gen: 2.340878486633301 (2.0742380305340418) | > loss_kl: 0.9408138394355774 (0.8431858749766099) | > loss_feat: 6.301484107971191 (3.3061668757153186) | > loss_mel: 23.96697998046875 (14.915334400377775) | > loss_duration: 1.5494345426559448 (1.3994552148015875) | > loss_1: 35.09959030151367 (22.53838022131669) | > grad_norm_1: tensor(34216.3594, device='cuda:0') (tensor(19828.9902, device='cuda:0')) | > current_lr_0: 8.09847497162932e-05 | > current_lr_1: 8.09847497162932e-05 | > step_time: 0.8083 (0.5868423612494218) | > loader_time: 0.0158 (0.019108747181139495)  --> TIME: 2023-10-20 10:56:03 -- STEP: 49/50 -- GLOBAL_STEP: 98250 | > loss_disc: 2.6964733600616455 (2.5093163884415923) | > loss_disc_real_0: 0.15129797160625458 (0.15532441484760873) | > loss_disc_real_1: 0.19380488991737366 (0.22060156431125136) | > loss_disc_real_2: 0.2186279445886612 (0.2392921672791851) | > loss_disc_real_3: 0.2699526846408844 (0.2302211450070751) | > loss_disc_real_4: 0.17941498756408691 (0.22168365789919484) | > loss_disc_real_5: 0.25604212284088135 (0.23880429271304485) | > loss_0: 2.6964733600616455 (2.5093163884415923) | > grad_norm_0: tensor(1945.1169, device='cuda:0') (tensor(677.8718, device='cuda:0')) | > loss_gen: 1.763948917388916 (2.2165706717238134) | > loss_kl: 0.7307263016700745 (0.7957847430085649) | > loss_feat: 1.762796401977539 (4.690612062279667) | > loss_mel: 20.204553604125977 (18.697942300718662) | > loss_duration: 1.4604274034500122 (1.367515493412407) | > loss_1: 25.922452926635742 (27.76842513376353) | > grad_norm_1: tensor(7387.7632, device='cuda:0') (tensor(17204.1406, device='cuda:0')) | > current_lr_0: 8.09847497162932e-05 | > current_lr_1: 8.09847497162932e-05 | > step_time: 0.2548 (0.5616228385847442) | > loader_time: 0.3689 (0.025702607874967615)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1010708808898926 (2.1010708808898926) | > loss_disc_real_0: 0.10713866353034973 (0.10713866353034973) | > loss_disc_real_1: 0.2722056210041046 (0.2722056210041046) | > loss_disc_real_2: 0.17474465072155 (0.17474465072155) | > loss_disc_real_3: 0.2822583019733429 (0.2822583019733429) | > loss_disc_real_4: 0.17485374212265015 (0.17485374212265015) | > loss_disc_real_5: 0.18746308982372284 (0.18746308982372284) | > loss_0: 2.1010708808898926 (2.1010708808898926) | > loss_gen: 2.5336215496063232 (2.5336215496063232) | > loss_kl: 5.071122646331787 (5.071122646331787) | > loss_feat: 5.882623195648193 (5.882623195648193) | > loss_mel: 13.126147270202637 (13.126147270202637) | > loss_duration: 3.008978843688965 (3.008978843688965) | > loss_1: 29.622493743896484 (29.622493743896484)  --> STEP: 1 | > loss_disc: 2.7204232215881348 (2.7204232215881348) | > loss_disc_real_0: 0.22568249702453613 (0.22568249702453613) | > loss_disc_real_1: 0.3752923905849457 (0.3752923905849457) | > loss_disc_real_2: 0.32613569498062134 (0.32613569498062134) | > loss_disc_real_3: 0.23234976828098297 (0.23234976828098297) | > loss_disc_real_4: 0.47207435965538025 (0.47207435965538025) | > loss_disc_real_5: 0.3649950921535492 (0.3649950921535492) | > loss_0: 2.7204232215881348 (2.7204232215881348) | > loss_gen: 3.061832904815674 (3.061832904815674) | > loss_kl: 5.078064441680908 (5.078064441680908) | > loss_feat: 5.63265323638916 (5.63265323638916) | > loss_mel: 23.389766693115234 (23.389766693115234) | > loss_duration: 3.342963218688965 (3.342963218688965) | > loss_1: 40.50528335571289 (40.50528335571289)  --> STEP: 2 | > loss_disc: 2.355682611465454 (2.5380529165267944) | > loss_disc_real_0: 0.10861856490373611 (0.16715053096413612) | > loss_disc_real_1: 0.10357242822647095 (0.2394324094057083) | > loss_disc_real_2: 0.11947596073150635 (0.22280582785606384) | > loss_disc_real_3: 0.13424143195152283 (0.1832956001162529) | > loss_disc_real_4: 0.16051806509494781 (0.31629621237516403) | > loss_disc_real_5: 0.09721573442220688 (0.23110541328787804) | > loss_0: 2.355682611465454 (2.5380529165267944) | > loss_gen: 1.825314998626709 (2.4435739517211914) | > loss_kl: 5.726077079772949 (5.402070760726929) | > loss_feat: 8.684988021850586 (7.158820629119873) | > loss_mel: 23.678796768188477 (23.534281730651855) | > loss_duration: 3.1807429790496826 (3.2618530988693237) | > loss_1: 43.09592056274414 (41.800601959228516)  --> STEP: 3 | > loss_disc: 2.589344024658203 (2.555149952570597) | > loss_disc_real_0: 0.31460779905319214 (0.21630295366048813) | > loss_disc_real_1: 0.280329167842865 (0.25306466221809387) | > loss_disc_real_2: 0.29663509130477905 (0.2474155823389689) | > loss_disc_real_3: 0.2963324785232544 (0.2209745595852534) | > loss_disc_real_4: 0.23505499958992004 (0.289215808113416) | > loss_disc_real_5: 0.32157665491104126 (0.26126249382893246) | > loss_0: 2.589344024658203 (2.555149952570597) | > loss_gen: 2.757711172103882 (2.5482863585154214) | > loss_kl: 2.5556833744049072 (4.453274965286255) | > loss_feat: 3.2019546031951904 (5.8398652871449785) | > loss_mel: 23.442150115966797 (23.503571192423504) | > loss_duration: 2.90189790725708 (3.1418680349985757) | > loss_1: 34.859397888183594 (39.48686726888021) --> EVAL PERFORMANCE | > avg_loader_time: 0.006888151168823242 (-0.015283584594726562) | > avg_loss_disc: 2.555149952570597 (+0.003143787384033203) | > avg_loss_disc_real_0: 0.21630295366048813 (+0.04133885850509009) | > avg_loss_disc_real_1: 0.25306466221809387 (+0.019369001189867646) | > avg_loss_disc_real_2: 0.2474155823389689 (+0.03384634852409363) | > avg_loss_disc_real_3: 0.2209745595852534 (-0.018707389632860838) | > avg_loss_disc_real_4: 0.289215808113416 (+0.04197985430558521) | > avg_loss_disc_real_5: 0.26126249382893246 (-0.0040980055928230286) | > avg_loss_0: 2.555149952570597 (+0.003143787384033203) | > avg_loss_gen: 2.5482863585154214 (+0.4839988946914673) | > avg_loss_kl: 4.453274965286255 (-0.025450785954792998) | > avg_loss_feat: 5.8398652871449785 (+1.8536711732546487) | > avg_loss_mel: 23.503571192423504 (+7.895719210306805) | > avg_loss_duration: 3.1418680349985757 (-0.05405322710673044) | > avg_loss_1: 39.48686726888021 (+10.153887430826824)  > EPOCH: 905/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:56:20)   --> TIME: 2023-10-20 10:56:41 -- STEP: 29/50 -- GLOBAL_STEP: 98280 | > loss_disc: 2.9808695316314697 (2.4778902242923606) | > loss_disc_real_0: 0.40973204374313354 (0.14354935378350062) | > loss_disc_real_1: 0.23278404772281647 (0.22840949533314542) | > loss_disc_real_2: 0.2048567682504654 (0.23937472790993486) | > loss_disc_real_3: 0.2599606215953827 (0.24754857541672115) | > loss_disc_real_4: 0.2864961624145508 (0.2467865423010341) | > loss_disc_real_5: 0.2673041820526123 (0.2676891599107405) | > loss_0: 2.9808695316314697 (2.4778902242923606) | > grad_norm_0: tensor(2816.6597, device='cuda:0') (tensor(726.2629, device='cuda:0')) | > loss_gen: 1.7478563785552979 (2.437925918348905) | > loss_kl: 0.8389822244644165 (0.8460238380678768) | > loss_feat: 0.23036408424377441 (5.555780291364624) | > loss_mel: 4.521364688873291 (20.32199716567993) | > loss_duration: 1.3563013076782227 (1.3748210010857418) | > loss_1: 8.694869041442871 (30.53654848296067) | > grad_norm_1: tensor(13941.2109, device='cuda:0') (tensor(25499.5645, device='cuda:0')) | > current_lr_0: 8.090380038854858e-05 | > current_lr_1: 8.090380038854858e-05 | > step_time: 0.3464 (0.5125355720520018) | > loader_time: 0.0082 (0.013168647371489426)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0024263858795166 (3.0024263858795166) | > loss_disc_real_0: 0.19201332330703735 (0.19201332330703735) | > loss_disc_real_1: 0.23283296823501587 (0.23283296823501587) | > loss_disc_real_2: 0.22716142237186432 (0.22716142237186432) | > loss_disc_real_3: 0.22355856001377106 (0.22355856001377106) | > loss_disc_real_4: 0.2574564814567566 (0.2574564814567566) | > loss_disc_real_5: 0.2387877106666565 (0.2387877106666565) | > loss_0: 3.0024263858795166 (3.0024263858795166) | > loss_gen: 1.382492184638977 (1.382492184638977) | > loss_kl: 5.347900390625 (5.347900390625) | > loss_feat: 0.061583276838064194 (0.061583276838064194) | > loss_mel: 1.9247260093688965 (1.9247260093688965) | > loss_duration: 3.0051121711730957 (3.0051121711730957) | > loss_1: 11.721813201904297 (11.721813201904297)  --> STEP: 1 | > loss_disc: 1.9761927127838135 (1.9761927127838135) | > loss_disc_real_0: 0.06033854931592941 (0.06033854931592941) | > loss_disc_real_1: 0.19293664395809174 (0.19293664395809174) | > loss_disc_real_2: 0.17198018729686737 (0.17198018729686737) | > loss_disc_real_3: 0.362131267786026 (0.362131267786026) | > loss_disc_real_4: 0.22525334358215332 (0.22525334358215332) | > loss_disc_real_5: 0.16337917745113373 (0.16337917745113373) | > loss_0: 1.9761927127838135 (1.9761927127838135) | > loss_gen: 3.0798885822296143 (3.0798885822296143) | > loss_kl: 5.518267631530762 (5.518267631530762) | > loss_feat: 9.354399681091309 (9.354399681091309) | > loss_mel: 26.389259338378906 (26.389259338378906) | > loss_duration: 3.3035061359405518 (3.3035061359405518) | > loss_1: 47.64531707763672 (47.64531707763672)  --> STEP: 2 | > loss_disc: 2.4441447257995605 (2.210168719291687) | > loss_disc_real_0: 0.14117039740085602 (0.10075447335839272) | > loss_disc_real_1: 0.11754748225212097 (0.15524206310510635) | > loss_disc_real_2: 0.27606797218322754 (0.22402407974004745) | > loss_disc_real_3: 0.14929431676864624 (0.2557127922773361) | > loss_disc_real_4: 0.2437589168548584 (0.23450613021850586) | > loss_disc_real_5: 0.22866663336753845 (0.1960229054093361) | > loss_0: 2.4441447257995605 (2.210168719291687) | > loss_gen: 2.1939258575439453 (2.63690721988678) | > loss_kl: 5.927158355712891 (5.722712993621826) | > loss_feat: 11.32826042175293 (10.34133005142212) | > loss_mel: 23.942277908325195 (25.16576862335205) | > loss_duration: 3.074523687362671 (3.1890149116516113) | > loss_1: 46.466148376464844 (47.05573272705078)  --> STEP: 3 | > loss_disc: 2.6946463584899902 (2.3716612656911216) | > loss_disc_real_0: 0.10398270189762115 (0.10183054953813553) | > loss_disc_real_1: 0.2737349271774292 (0.1947396844625473) | > loss_disc_real_2: 0.2883116900920868 (0.24545328319072723) | > loss_disc_real_3: 0.21670998632907867 (0.2427118569612503) | > loss_disc_real_4: 0.23711347579956055 (0.23537524541219076) | > loss_disc_real_5: 0.2347458451986313 (0.20893055200576782) | > loss_0: 2.6946463584899902 (2.3716612656911216) | > loss_gen: 1.7635459899902344 (2.3457868099212646) | > loss_kl: 2.8942794799804688 (4.77990182240804) | > loss_feat: 1.8210562467575073 (7.501238783200582) | > loss_mel: 18.01339340209961 (22.781643549601238) | > loss_duration: 2.988431215286255 (3.1221536795298257) | > loss_1: 27.4807071685791 (40.53072420756022) --> EVAL PERFORMANCE | > avg_loader_time: 0.004693349202473958 (-0.002194801966349284) | > avg_loss_disc: 2.3716612656911216 (-0.18348868687947562) | > avg_loss_disc_real_0: 0.10183054953813553 (-0.1144724041223526) | > avg_loss_disc_real_1: 0.1947396844625473 (-0.05832497775554657) | > avg_loss_disc_real_2: 0.24545328319072723 (-0.0019622991482416696) | > avg_loss_disc_real_3: 0.2427118569612503 (+0.021737297375996917) | > avg_loss_disc_real_4: 0.23537524541219076 (-0.05384056270122525) | > avg_loss_disc_real_5: 0.20893055200576782 (-0.05233194182316464) | > avg_loss_0: 2.3716612656911216 (-0.18348868687947562) | > avg_loss_gen: 2.3457868099212646 (-0.20249954859415675) | > avg_loss_kl: 4.77990182240804 (+0.3266268571217852) | > avg_loss_feat: 7.501238783200582 (+1.661373496055603) | > avg_loss_mel: 22.781643549601238 (-0.7219276428222656) | > avg_loss_duration: 3.1221536795298257 (-0.01971435546875) | > avg_loss_1: 40.53072420756022 (+1.0438569386800083)  > EPOCH: 906/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:57:09)   --> TIME: 2023-10-20 10:57:20 -- STEP: 9/50 -- GLOBAL_STEP: 98310 | > loss_disc: 1.9026408195495605 (2.2280682590272693) | > loss_disc_real_0: 0.04807597026228905 (0.11353252434896098) | > loss_disc_real_1: 0.20378592610359192 (0.18908792361617088) | > loss_disc_real_2: 0.12146943807601929 (0.17798817737234962) | > loss_disc_real_3: 0.18309755623340607 (0.17905667713946766) | > loss_disc_real_4: 0.23596474528312683 (0.18360067738427055) | > loss_disc_real_5: 0.08096723258495331 (0.12120390579932266) | > loss_0: 1.9026408195495605 (2.2280682590272693) | > grad_norm_0: tensor(419.1636, device='cuda:0') (tensor(575.3232, device='cuda:0')) | > loss_gen: 2.453664541244507 (2.2517833179897733) | > loss_kl: 0.6692553758621216 (0.6899972756703695) | > loss_feat: 7.239835262298584 (6.884211180938615) | > loss_mel: 22.494285583496094 (21.449894587198894) | > loss_duration: 1.3088347911834717 (1.3715812100304499) | > loss_1: 34.16587448120117 (32.647467295328774) | > grad_norm_1: tensor(6151.7476, device='cuda:0') (tensor(15074.6602, device='cuda:0')) | > current_lr_0: 8.082293197472522e-05 | > current_lr_1: 8.082293197472522e-05 | > step_time: 0.8312 (0.6209775341881646) | > loader_time: 0.0332 (0.02266828219095866)  --> TIME: 2023-10-20 10:57:40 -- STEP: 39/50 -- GLOBAL_STEP: 98340 | > loss_disc: 2.220938205718994 (2.408750763306251) | > loss_disc_real_0: 0.02860250324010849 (0.14158067135856703) | > loss_disc_real_1: 0.1463974565267563 (0.21449222654486313) | > loss_disc_real_2: 0.03335392847657204 (0.21550904462734857) | > loss_disc_real_3: 0.10406728088855743 (0.2403312009305526) | > loss_disc_real_4: 0.01349497027695179 (0.20568251533386034) | > loss_disc_real_5: 0.05362648516893387 (0.2102345317029036) | > loss_0: 2.220938205718994 (2.408750763306251) | > grad_norm_0: tensor(1082.9200, device='cuda:0') (tensor(575.5275, device='cuda:0')) | > loss_gen: 1.7301385402679443 (2.3020624228012867) | > loss_kl: 0.13363219797611237 (0.7831431913834351) | > loss_feat: 6.589752674102783 (5.7165406720760545) | > loss_mel: 23.70169448852539 (19.73152555257846) | > loss_duration: 1.3935737609863281 (1.3624857236177494) | > loss_1: 33.548789978027344 (29.895757381732647) | > grad_norm_1: tensor(19735.6367, device='cuda:0') (tensor(18310.8965, device='cuda:0')) | > current_lr_0: 8.082293197472522e-05 | > current_lr_1: 8.082293197472522e-05 | > step_time: 0.6039 (0.6271982254126133) | > loader_time: 0.0277 (0.02468216724884816)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3239593505859375 (2.3239593505859375) | > loss_disc_real_0: 0.11623384058475494 (0.11623384058475494) | > loss_disc_real_1: 0.3473961055278778 (0.3473961055278778) | > loss_disc_real_2: 0.25966739654541016 (0.25966739654541016) | > loss_disc_real_3: 0.3212851285934448 (0.3212851285934448) | > loss_disc_real_4: 0.29178518056869507 (0.29178518056869507) | > loss_disc_real_5: 0.28310415148735046 (0.28310415148735046) | > loss_0: 2.3239593505859375 (2.3239593505859375) | > loss_gen: 2.865020275115967 (2.865020275115967) | > loss_kl: 4.277026653289795 (4.277026653289795) | > loss_feat: 6.227612018585205 (6.227612018585205) | > loss_mel: 24.78241729736328 (24.78241729736328) | > loss_duration: 2.984440803527832 (2.984440803527832) | > loss_1: 41.13651657104492 (41.13651657104492)  --> STEP: 1 | > loss_disc: 2.309330463409424 (2.309330463409424) | > loss_disc_real_0: 0.12370524555444717 (0.12370524555444717) | > loss_disc_real_1: 0.2645482122898102 (0.2645482122898102) | > loss_disc_real_2: 0.2413385659456253 (0.2413385659456253) | > loss_disc_real_3: 0.3272331655025482 (0.3272331655025482) | > loss_disc_real_4: 0.11763731390237808 (0.11763731390237808) | > loss_disc_real_5: 0.09349257498979568 (0.09349257498979568) | > loss_0: 2.309330463409424 (2.309330463409424) | > loss_gen: 2.1262264251708984 (2.1262264251708984) | > loss_kl: 4.883851051330566 (4.883851051330566) | > loss_feat: 6.888997554779053 (6.888997554779053) | > loss_mel: 23.34280014038086 (23.34280014038086) | > loss_duration: 3.311495304107666 (3.311495304107666) | > loss_1: 40.55337142944336 (40.55337142944336)  --> STEP: 2 | > loss_disc: 2.3331542015075684 (2.321242332458496) | > loss_disc_real_0: 0.44598424434661865 (0.2848447449505329) | > loss_disc_real_1: 0.22288811206817627 (0.24371816217899323) | > loss_disc_real_2: 0.1438077688217163 (0.1925731673836708) | > loss_disc_real_3: 0.45045697689056396 (0.3888450711965561) | > loss_disc_real_4: 0.09586456418037415 (0.10675093904137611) | > loss_disc_real_5: 0.17664478719234467 (0.13506868109107018) | > loss_0: 2.3331542015075684 (2.321242332458496) | > loss_gen: 2.778522491455078 (2.4523744583129883) | > loss_kl: 5.693160533905029 (5.288505792617798) | > loss_feat: 9.686521530151367 (8.28775954246521) | > loss_mel: 25.363218307495117 (24.35300922393799) | > loss_duration: 3.095381021499634 (3.20343816280365) | > loss_1: 46.61680603027344 (43.5850887298584)  --> STEP: 3 | > loss_disc: 2.9971699714660645 (2.546551545461019) | > loss_disc_real_0: 0.12040203809738159 (0.2300305093328158) | > loss_disc_real_1: 0.20764823257923126 (0.2316948523124059) | > loss_disc_real_2: 0.2735242247581482 (0.21955685317516327) | > loss_disc_real_3: 0.24664637446403503 (0.3414455056190491) | > loss_disc_real_4: 0.2798444628715515 (0.16444878031810126) | > loss_disc_real_5: 0.39914900064468384 (0.22309545427560806) | > loss_0: 2.9971699714660645 (2.546551545461019) | > loss_gen: 1.7457618713378906 (2.216836929321289) | > loss_kl: 2.5440845489501953 (4.373698711395264) | > loss_feat: 3.004605770111084 (6.526708285013835) | > loss_mel: 23.9129638671875 (24.206327438354492) | > loss_duration: 2.9247543811798096 (3.1105435689290366) | > loss_1: 34.132171630859375 (40.43411636352539) --> EVAL PERFORMANCE | > avg_loader_time: 0.0035217603047688804 (-0.0011715888977050777) | > avg_loss_disc: 2.546551545461019 (+0.17489027976989746) | > avg_loss_disc_real_0: 0.2300305093328158 (+0.12819995979468027) | > avg_loss_disc_real_1: 0.2316948523124059 (+0.03695516784985861) | > avg_loss_disc_real_2: 0.21955685317516327 (-0.025896430015563965) | > avg_loss_disc_real_3: 0.3414455056190491 (+0.09873364865779877) | > avg_loss_disc_real_4: 0.16444878031810126 (-0.07092646509408951) | > avg_loss_disc_real_5: 0.22309545427560806 (+0.01416490226984024) | > avg_loss_0: 2.546551545461019 (+0.17489027976989746) | > avg_loss_gen: 2.216836929321289 (-0.12894988059997559) | > avg_loss_kl: 4.373698711395264 (-0.4062031110127764) | > avg_loss_feat: 6.526708285013835 (-0.9745304981867466) | > avg_loss_mel: 24.206327438354492 (+1.424683888753254) | > avg_loss_duration: 3.1105435689290366 (-0.011610110600789092) | > avg_loss_1: 40.43411636352539 (-0.09660784403482836)  > EPOCH: 907/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:58:01)   --> TIME: 2023-10-20 10:58:21 -- STEP: 19/50 -- GLOBAL_STEP: 98370 | > loss_disc: 1.1226023435592651 (2.3557576003827547) | > loss_disc_real_0: 0.023200420662760735 (0.13475899640960912) | > loss_disc_real_1: 0.12412001192569733 (0.2172809274573075) | > loss_disc_real_2: 0.07514407485723495 (0.20382231699400827) | > loss_disc_real_3: 0.11011558026075363 (0.2341633018498358) | > loss_disc_real_4: 0.05363740772008896 (0.21531391859446702) | > loss_disc_real_5: 0.06938210874795914 (0.23654581155431897) | > loss_0: 1.1226023435592651 (2.3557576003827547) | > grad_norm_0: tensor(593.7037, device='cuda:0') (tensor(614.9741, device='cuda:0')) | > loss_gen: 3.1499781608581543 (2.3686769008636475) | > loss_kl: 1.0377275943756104 (0.9183381764512313) | > loss_feat: 10.74154281616211 (6.199787134794812) | > loss_mel: 25.673635482788086 (19.721180144109223) | > loss_duration: 1.4649475812911987 (1.3998390436172485) | > loss_1: 42.06782913208008 (30.607820862217952) | > grad_norm_1: tensor(72669.4688, device='cuda:0') (tensor(30192.7051, device='cuda:0')) | > current_lr_0: 8.074214439394458e-05 | > current_lr_1: 8.074214439394458e-05 | > step_time: 0.3179 (0.6711330288334897) | > loader_time: 0.0018 (0.026890139830739873)  --> TIME: 2023-10-20 10:58:33 -- STEP: 49/50 -- GLOBAL_STEP: 98400 | > loss_disc: 2.289384603500366 (2.4608807636767014) | > loss_disc_real_0: 0.014352395199239254 (0.15357764788466144) | > loss_disc_real_1: 0.14851988852024078 (0.2228741204860259) | > loss_disc_real_2: 0.07124532014131546 (0.21677826645270903) | > loss_disc_real_3: 0.25407931208610535 (0.23503500310590072) | > loss_disc_real_4: 0.29656460881233215 (0.22341955631819307) | > loss_disc_real_5: 0.25773563981056213 (0.22981774936221083) | > loss_0: 2.289384603500366 (2.4608807636767014) | > grad_norm_0: tensor(884.1506, device='cuda:0') (tensor(629.6144, device='cuda:0')) | > loss_gen: 2.211785078048706 (2.2625889340225536) | > loss_kl: 0.5604086518287659 (0.8118632058708035) | > loss_feat: 3.042247772216797 (5.071866328162807) | > loss_mel: 22.39452362060547 (18.657419158487905) | > loss_duration: 1.418318510055542 (1.3681940813453828) | > loss_1: 29.627283096313477 (28.17193150033756) | > grad_norm_1: tensor(4534.7075, device='cuda:0') (tensor(21386.7949, device='cuda:0')) | > current_lr_0: 8.074214439394458e-05 | > current_lr_1: 8.074214439394458e-05 | > step_time: 0.5366 (0.489927749244534) | > loader_time: 0.4452 (0.022813286100115095)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.97904372215271 (2.97904372215271) | > loss_disc_real_0: 0.6732968091964722 (0.6732968091964722) | > loss_disc_real_1: 0.350572794675827 (0.350572794675827) | > loss_disc_real_2: 0.22238245606422424 (0.22238245606422424) | > loss_disc_real_3: 0.35822850465774536 (0.35822850465774536) | > loss_disc_real_4: 0.26266539096832275 (0.26266539096832275) | > loss_disc_real_5: 0.23906435072422028 (0.23906435072422028) | > loss_0: 2.97904372215271 (2.97904372215271) | > loss_gen: 2.4574360847473145 (2.4574360847473145) | > loss_kl: 5.0422515869140625 (5.0422515869140625) | > loss_feat: 5.901148319244385 (5.901148319244385) | > loss_mel: 23.602195739746094 (23.602195739746094) | > loss_duration: 3.0441839694976807 (3.0441839694976807) | > loss_1: 40.04721450805664 (40.04721450805664)  --> STEP: 1 | > loss_disc: 2.7910594940185547 (2.7910594940185547) | > loss_disc_real_0: 0.17465783655643463 (0.17465783655643463) | > loss_disc_real_1: 0.2246726006269455 (0.2246726006269455) | > loss_disc_real_2: 0.4048399329185486 (0.4048399329185486) | > loss_disc_real_3: 0.3449297249317169 (0.3449297249317169) | > loss_disc_real_4: 0.36270520091056824 (0.36270520091056824) | > loss_disc_real_5: 0.4675550162792206 (0.4675550162792206) | > loss_0: 2.7910594940185547 (2.7910594940185547) | > loss_gen: 2.8404147624969482 (2.8404147624969482) | > loss_kl: 4.79014253616333 (4.79014253616333) | > loss_feat: 5.620889186859131 (5.620889186859131) | > loss_mel: 23.818115234375 (23.818115234375) | > loss_duration: 3.29194712638855 (3.29194712638855) | > loss_1: 40.36151123046875 (40.36151123046875)  --> STEP: 2 | > loss_disc: 1.690354585647583 (2.240707039833069) | > loss_disc_real_0: 0.09384207427501678 (0.1342499554157257) | > loss_disc_real_1: 0.12018773704767227 (0.17243016883730888) | > loss_disc_real_2: 0.06875647604465485 (0.23679820448160172) | > loss_disc_real_3: 0.04142456129193306 (0.193177143111825) | > loss_disc_real_4: 0.10222424566745758 (0.2324647232890129) | > loss_disc_real_5: 0.21688677370548248 (0.34222089499235153) | > loss_0: 1.690354585647583 (2.240707039833069) | > loss_gen: 2.8134055137634277 (2.826910138130188) | > loss_kl: 5.16653299331665 (4.97833776473999) | > loss_feat: 16.834697723388672 (11.227793455123901) | > loss_mel: 23.156742095947266 (23.487428665161133) | > loss_duration: 3.0933802127838135 (3.1926636695861816) | > loss_1: 51.06475830078125 (45.713134765625)  --> STEP: 3 | > loss_disc: 3.0307154655456543 (2.504043181737264) | > loss_disc_real_0: 0.6120262145996094 (0.29350870847702026) | > loss_disc_real_1: 0.30750641226768494 (0.2174555833141009) | > loss_disc_real_2: 0.24678872525691986 (0.24012837807337442) | > loss_disc_real_3: 0.3260838985443115 (0.23747939492265382) | > loss_disc_real_4: 0.27859610319137573 (0.24784184992313385) | > loss_disc_real_5: 0.251818984746933 (0.31208692491054535) | > loss_0: 3.0307154655456543 (2.504043181737264) | > loss_gen: 2.4290313720703125 (2.694283882776896) | > loss_kl: 2.1153109073638916 (4.023995478947957) | > loss_feat: 1.6227577924728394 (8.026114900906881) | > loss_mel: 20.892404556274414 (22.62242062886556) | > loss_duration: 2.966886520385742 (3.1174046198527017) | > loss_1: 30.026391983032227 (40.48422050476074) --> EVAL PERFORMANCE | > avg_loader_time: 0.009046475092569986 (+0.005524714787801106) | > avg_loss_disc: 2.504043181737264 (-0.04250836372375488) | > avg_loss_disc_real_0: 0.29350870847702026 (+0.06347819914420447) | > avg_loss_disc_real_1: 0.2174555833141009 (-0.014239268998305021) | > avg_loss_disc_real_2: 0.24012837807337442 (+0.020571524898211152) | > avg_loss_disc_real_3: 0.23747939492265382 (-0.10396611069639525) | > avg_loss_disc_real_4: 0.24784184992313385 (+0.0833930696050326) | > avg_loss_disc_real_5: 0.31208692491054535 (+0.08899147063493729) | > avg_loss_0: 2.504043181737264 (-0.04250836372375488) | > avg_loss_gen: 2.694283882776896 (+0.47744695345560695) | > avg_loss_kl: 4.023995478947957 (-0.3497032324473066) | > avg_loss_feat: 8.026114900906881 (+1.4994066158930464) | > avg_loss_mel: 22.62242062886556 (-1.5839068094889335) | > avg_loss_duration: 3.1174046198527017 (+0.0068610509236650685) | > avg_loss_1: 40.48422050476074 (+0.05010414123535156)  > EPOCH: 908/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:58:45)   --> TIME: 2023-10-20 10:59:10 -- STEP: 29/50 -- GLOBAL_STEP: 98430 | > loss_disc: 2.894007682800293 (2.488620770388636) | > loss_disc_real_0: 0.19155976176261902 (0.16338937671790862) | > loss_disc_real_1: 0.3949835002422333 (0.23403595426473126) | > loss_disc_real_2: 0.38152778148651123 (0.2486089171263679) | > loss_disc_real_3: 0.42251890897750854 (0.23629606470208744) | > loss_disc_real_4: 0.3061152994632721 (0.22950259660338534) | > loss_disc_real_5: 0.4207092821598053 (0.21817150082567643) | > loss_0: 2.894007682800293 (2.488620770388636) | > grad_norm_0: tensor(479.2497, device='cuda:0') (tensor(492.6992, device='cuda:0')) | > loss_gen: 2.90641450881958 (2.3746366583067795) | > loss_kl: 0.35225775837898254 (0.8174926846705634) | > loss_feat: 4.720358371734619 (6.0742863000466905) | > loss_mel: 21.38645362854004 (21.4224416058639) | > loss_duration: 1.3395551443099976 (1.376685615243583) | > loss_1: 30.705039978027344 (32.06554264857851) | > grad_norm_1: tensor(3666.0479, device='cuda:0') (tensor(14243.9727, device='cuda:0')) | > current_lr_0: 8.066143756540899e-05 | > current_lr_1: 8.066143756540899e-05 | > step_time: 0.7565 (0.6257089993049358) | > loader_time: 0.0257 (0.02312206399851832)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6044957637786865 (2.6044957637786865) | > loss_disc_real_0: 0.4008346199989319 (0.4008346199989319) | > loss_disc_real_1: 0.17268940806388855 (0.17268940806388855) | > loss_disc_real_2: 0.3714767396450043 (0.3714767396450043) | > loss_disc_real_3: 0.27074238657951355 (0.27074238657951355) | > loss_disc_real_4: 0.27583640813827515 (0.27583640813827515) | > loss_disc_real_5: 0.228866845369339 (0.228866845369339) | > loss_0: 2.6044957637786865 (2.6044957637786865) | > loss_gen: 2.864492416381836 (2.864492416381836) | > loss_kl: 5.59174108505249 (5.59174108505249) | > loss_feat: 5.725382328033447 (5.725382328033447) | > loss_mel: 23.403261184692383 (23.403261184692383) | > loss_duration: 3.040635108947754 (3.040635108947754) | > loss_1: 40.625511169433594 (40.625511169433594)  --> STEP: 1 | > loss_disc: 2.8348913192749023 (2.8348913192749023) | > loss_disc_real_0: 0.29040268063545227 (0.29040268063545227) | > loss_disc_real_1: 0.2475304752588272 (0.2475304752588272) | > loss_disc_real_2: 0.3244815766811371 (0.3244815766811371) | > loss_disc_real_3: 0.2968250811100006 (0.2968250811100006) | > loss_disc_real_4: 0.2810875177383423 (0.2810875177383423) | > loss_disc_real_5: 0.2632226347923279 (0.2632226347923279) | > loss_0: 2.8348913192749023 (2.8348913192749023) | > loss_gen: 2.0273706912994385 (2.0273706912994385) | > loss_kl: 5.202452182769775 (5.202452182769775) | > loss_feat: 1.030897855758667 (1.030897855758667) | > loss_mel: 18.340065002441406 (18.340065002441406) | > loss_duration: 3.324425220489502 (3.324425220489502) | > loss_1: 29.925209045410156 (29.925209045410156)  --> STEP: 2 | > loss_disc: 1.6639540195465088 (2.2494226694107056) | > loss_disc_real_0: 0.11675447225570679 (0.20357857644557953) | > loss_disc_real_1: 0.16994208097457886 (0.20873627811670303) | > loss_disc_real_2: 0.12027966231107712 (0.2223806194961071) | > loss_disc_real_3: 0.11171700805425644 (0.20427104458212852) | > loss_disc_real_4: 0.11297090351581573 (0.197029210627079) | > loss_disc_real_5: 0.0776386633515358 (0.17043064907193184) | > loss_0: 1.6639540195465088 (2.2494226694107056) | > loss_gen: 2.601104259490967 (2.3142374753952026) | > loss_kl: 5.243422031402588 (5.222937107086182) | > loss_feat: 8.42615795135498 (4.728527903556824) | > loss_mel: 23.592853546142578 (20.966459274291992) | > loss_duration: 3.2111074924468994 (3.2677663564682007) | > loss_1: 43.074649810791016 (36.499929428100586)  --> STEP: 3 | > loss_disc: 2.8096699714660645 (2.436171770095825) | > loss_disc_real_0: 0.290456086397171 (0.23253774642944336) | > loss_disc_real_1: 0.2815794348716736 (0.2330173303683599) | > loss_disc_real_2: 0.28472909331321716 (0.24316344410181046) | > loss_disc_real_3: 0.241129532456398 (0.216557207206885) | > loss_disc_real_4: 0.26077505946159363 (0.21827782690525055) | > loss_disc_real_5: 0.26392829418182373 (0.20159653077522913) | > loss_0: 2.8096699714660645 (2.436171770095825) | > loss_gen: 2.0018999576568604 (2.210124969482422) | > loss_kl: 2.3809456825256348 (4.275606632232666) | > loss_feat: 0.8748741149902344 (3.443976640701294) | > loss_mel: 16.77756118774414 (19.570159912109375) | > loss_duration: 2.960815191268921 (3.165449301401774) | > loss_1: 24.996095657348633 (32.665318171183266) --> EVAL PERFORMANCE | > avg_loader_time: 0.013260523478190104 (+0.004214048385620117) | > avg_loss_disc: 2.436171770095825 (-0.06787141164143895) | > avg_loss_disc_real_0: 0.23253774642944336 (-0.060970962047576904) | > avg_loss_disc_real_1: 0.2330173303683599 (+0.015561747054259) | > avg_loss_disc_real_2: 0.24316344410181046 (+0.0030350660284360342) | > avg_loss_disc_real_3: 0.216557207206885 (-0.020922187715768814) | > avg_loss_disc_real_4: 0.21827782690525055 (-0.0295640230178833) | > avg_loss_disc_real_5: 0.20159653077522913 (-0.11049039413531622) | > avg_loss_0: 2.436171770095825 (-0.06787141164143895) | > avg_loss_gen: 2.210124969482422 (-0.48415891329447414) | > avg_loss_kl: 4.275606632232666 (+0.25161115328470895) | > avg_loss_feat: 3.443976640701294 (-4.582138260205587) | > avg_loss_mel: 19.570159912109375 (-3.0522607167561837) | > avg_loss_duration: 3.165449301401774 (+0.048044681549072266) | > avg_loss_1: 32.665318171183266 (-7.818902333577476)  > EPOCH: 909/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 10:59:39)   --> TIME: 2023-10-20 10:59:50 -- STEP: 9/50 -- GLOBAL_STEP: 98460 | > loss_disc: 2.2151803970336914 (1.8838021490308974) | > loss_disc_real_0: 0.0625370591878891 (0.10868098441925314) | > loss_disc_real_1: 0.188629150390625 (0.17090989980432722) | > loss_disc_real_2: 0.37026238441467285 (0.21668760354320207) | > loss_disc_real_3: 0.11483282595872879 (0.14935060859554344) | > loss_disc_real_4: 0.19997043907642365 (0.1582485307008028) | > loss_disc_real_5: 0.2977552115917206 (0.1642415610452493) | > loss_0: 2.2151803970336914 (1.8838021490308974) | > grad_norm_0: tensor(453.7304, device='cuda:0') (tensor(400.2819, device='cuda:0')) | > loss_gen: 2.719003915786743 (2.7991014454099865) | > loss_kl: 0.5201601386070251 (0.8871511916319529) | > loss_feat: 6.596909046173096 (8.348728011879656) | > loss_mel: 23.72393798828125 (20.77260829342736) | > loss_duration: 1.335102915763855 (1.3697992298338149) | > loss_1: 34.89511489868164 (34.17738840315077) | > grad_norm_1: tensor(8524.9775, device='cuda:0') (tensor(31289.7285, device='cuda:0')) | > current_lr_0: 8.05808114084015e-05 | > current_lr_1: 8.05808114084015e-05 | > step_time: 0.3636 (0.5876579814487033) | > loader_time: 0.0058 (0.017367760340372723)  --> TIME: 2023-10-20 11:00:10 -- STEP: 39/50 -- GLOBAL_STEP: 98490 | > loss_disc: 2.2942442893981934 (2.144117856637026) | > loss_disc_real_0: 0.10822437703609467 (0.1294770650804425) | > loss_disc_real_1: 0.16494320333003998 (0.20346027001356468) | > loss_disc_real_2: 0.16484586894512177 (0.20452290529815054) | > loss_disc_real_3: 0.22067469358444214 (0.2007179076377398) | > loss_disc_real_4: 0.1371600180864334 (0.18731903776717493) | > loss_disc_real_5: 0.07044321298599243 (0.18705504932082617) | > loss_0: 2.2942442893981934 (2.144117856637026) | > grad_norm_0: tensor(763.4432, device='cuda:0') (tensor(561.4296, device='cuda:0')) | > loss_gen: 1.9824886322021484 (2.5413652780728464) | > loss_kl: 0.3503889739513397 (0.8761361138178752) | > loss_feat: 5.280937194824219 (6.816953911899756) | > loss_mel: 20.232097625732422 (21.783334820698467) | > loss_duration: 1.4684566259384155 (1.363363498296493) | > loss_1: 29.314369201660156 (33.38115371801914) | > grad_norm_1: tensor(33108.8438, device='cuda:0') (tensor(23962.6582, device='cuda:0')) | > current_lr_0: 8.05808114084015e-05 | > current_lr_1: 8.05808114084015e-05 | > step_time: 0.4803 (0.6170087716518304) | > loader_time: 0.0075 (0.023749272028605144)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.3163065910339355 (3.3163065910339355) | > loss_disc_real_0: 0.5450236797332764 (0.5450236797332764) | > loss_disc_real_1: 0.2996774911880493 (0.2996774911880493) | > loss_disc_real_2: 0.35861626267433167 (0.35861626267433167) | > loss_disc_real_3: 0.33207061886787415 (0.33207061886787415) | > loss_disc_real_4: 0.4228862524032593 (0.4228862524032593) | > loss_disc_real_5: 0.5238347053527832 (0.5238347053527832) | > loss_0: 3.3163065910339355 (3.3163065910339355) | > loss_gen: 2.6142361164093018 (2.6142361164093018) | > loss_kl: 4.825515270233154 (4.825515270233154) | > loss_feat: 5.14844274520874 (5.14844274520874) | > loss_mel: 25.54279136657715 (25.54279136657715) | > loss_duration: 2.9192681312561035 (2.9192681312561035) | > loss_1: 41.050254821777344 (41.050254821777344)  --> STEP: 1 | > loss_disc: 2.973433494567871 (2.973433494567871) | > loss_disc_real_0: 0.16884826123714447 (0.16884826123714447) | > loss_disc_real_1: 0.28325727581977844 (0.28325727581977844) | > loss_disc_real_2: 0.252719908952713 (0.252719908952713) | > loss_disc_real_3: 0.2293381243944168 (0.2293381243944168) | > loss_disc_real_4: 0.2535456120967865 (0.2535456120967865) | > loss_disc_real_5: 0.2748134732246399 (0.2748134732246399) | > loss_0: 2.973433494567871 (2.973433494567871) | > loss_gen: 1.4981998205184937 (1.4981998205184937) | > loss_kl: 5.182311058044434 (5.182311058044434) | > loss_feat: 0.1607598513364792 (0.1607598513364792) | > loss_mel: 10.212468147277832 (10.212468147277832) | > loss_duration: 3.404412031173706 (3.404412031173706) | > loss_1: 20.45815086364746 (20.45815086364746)  --> STEP: 2 | > loss_disc: 2.6459572315216064 (2.8096953630447388) | > loss_disc_real_0: 0.38756537437438965 (0.27820681780576706) | > loss_disc_real_1: 0.13926556706428528 (0.21126142144203186) | > loss_disc_real_2: 0.1900777369737625 (0.22139882296323776) | > loss_disc_real_3: 0.2667095959186554 (0.2480238601565361) | > loss_disc_real_4: 0.2020016312599182 (0.22777362167835236) | > loss_disc_real_5: 0.2573191225528717 (0.2660662978887558) | > loss_0: 2.6459572315216064 (2.8096953630447388) | > loss_gen: 2.259600877761841 (1.8789003491401672) | > loss_kl: 5.644061088562012 (5.413186073303223) | > loss_feat: 6.476143836975098 (3.3184518441557884) | > loss_mel: 20.95577621459961 (15.58412218093872) | > loss_duration: 3.1211771965026855 (3.262794613838196) | > loss_1: 38.45676040649414 (29.4574556350708)  --> STEP: 3 | > loss_disc: 2.8292648792266846 (2.816218535105387) | > loss_disc_real_0: 0.14247021079063416 (0.2329612821340561) | > loss_disc_real_1: 0.2745065689086914 (0.2323431372642517) | > loss_disc_real_2: 0.21617497503757477 (0.2196575403213501) | > loss_disc_real_3: 0.23182569444179535 (0.24262447158495584) | > loss_disc_real_4: 0.25412890315055847 (0.23655871550242105) | > loss_disc_real_5: 0.26270103454589844 (0.26494454344113666) | > loss_0: 2.8292648792266846 (2.816218535105387) | > loss_gen: 1.5666595697402954 (1.77482008934021) | > loss_kl: 2.827021360397339 (4.551131169001262) | > loss_feat: 0.7001634836196899 (2.4456890573104224) | > loss_mel: 11.9660062789917 (14.37808354695638) | > loss_duration: 3.040806293487549 (3.188798507054647) | > loss_1: 20.100656509399414 (26.33852259318034) --> EVAL PERFORMANCE | > avg_loader_time: 0.02700463930765788 (+0.013744115829467775) | > avg_loss_disc: 2.816218535105387 (+0.380046765009562) | > avg_loss_disc_real_0: 0.2329612821340561 (+0.00042353570461273193) | > avg_loss_disc_real_1: 0.2323431372642517 (-0.0006741931041081839) | > avg_loss_disc_real_2: 0.2196575403213501 (-0.023505903780460358) | > avg_loss_disc_real_3: 0.24262447158495584 (+0.02606726437807083) | > avg_loss_disc_real_4: 0.23655871550242105 (+0.018280888597170503) | > avg_loss_disc_real_5: 0.26494454344113666 (+0.06334801266590753) | > avg_loss_0: 2.816218535105387 (+0.380046765009562) | > avg_loss_gen: 1.77482008934021 (-0.4353048801422119) | > avg_loss_kl: 4.551131169001262 (+0.2755245367685957) | > avg_loss_feat: 2.4456890573104224 (-0.9982875833908715) | > avg_loss_mel: 14.37808354695638 (-5.192076365152994) | > avg_loss_duration: 3.188798507054647 (+0.023349205652873017) | > avg_loss_1: 26.33852259318034 (-6.326795578002926)  > EPOCH: 910/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:00:28)   --> TIME: 2023-10-20 11:00:44 -- STEP: 19/50 -- GLOBAL_STEP: 98520 | > loss_disc: 2.0137598514556885 (2.535673975944519) | > loss_disc_real_0: 0.06339216977357864 (0.17449409465648627) | > loss_disc_real_1: 0.14731664955615997 (0.24597186634415075) | > loss_disc_real_2: 0.1507178694009781 (0.2183270466170813) | > loss_disc_real_3: 0.2186317890882492 (0.2589933078147863) | > loss_disc_real_4: 0.1772720217704773 (0.22502249881233038) | > loss_disc_real_5: 0.16173839569091797 (0.22530831033854107) | > loss_0: 2.0137598514556885 (2.535673975944519) | > grad_norm_0: tensor(547.5271, device='cuda:0') (tensor(603.9567, device='cuda:0')) | > loss_gen: 2.3641767501831055 (2.249026844376012) | > loss_kl: 0.5766124725341797 (0.8357318075079667) | > loss_feat: 7.4201178550720215 (5.2284932654154925) | > loss_mel: 19.848621368408203 (19.793908890924957) | > loss_duration: 1.541236162185669 (1.4116319104244834) | > loss_1: 31.75076675415039 (29.518792553951865) | > grad_norm_1: tensor(41180.1562, device='cuda:0') (tensor(19361.0430, device='cuda:0')) | > current_lr_0: 8.050026584228591e-05 | > current_lr_1: 8.050026584228591e-05 | > step_time: 0.4976 (0.5316990300228721) | > loader_time: 0.0179 (0.02085599146391216)  --> TIME: 2023-10-20 11:01:06 -- STEP: 49/50 -- GLOBAL_STEP: 98550 | > loss_disc: 2.49031662940979 (2.4968701819984283) | > loss_disc_real_0: 0.16597804427146912 (0.15808318707407737) | > loss_disc_real_1: 0.18001016974449158 (0.22817919293076408) | > loss_disc_real_2: 0.216095969080925 (0.21835367442393788) | > loss_disc_real_3: 0.24819298088550568 (0.2417060257676912) | > loss_disc_real_4: 0.20405298471450806 (0.22270971365577105) | > loss_disc_real_5: 0.36533981561660767 (0.21674081487391067) | > loss_0: 2.49031662940979 (2.4968701819984283) | > grad_norm_0: tensor(478.3253, device='cuda:0') (tensor(618.7761, device='cuda:0')) | > loss_gen: 2.224325180053711 (2.2429899999073575) | > loss_kl: 0.6888814568519592 (0.7878984863660774) | > loss_feat: 3.259199619293213 (5.154505298301881) | > loss_mel: 18.08493423461914 (20.446234866064426) | > loss_duration: 1.4839017391204834 (1.3785922113729983) | > loss_1: 25.741243362426758 (30.010220498454814) | > grad_norm_1: tensor(8099.1479, device='cuda:0') (tensor(19166.5410, device='cuda:0')) | > current_lr_0: 8.050026584228591e-05 | > current_lr_1: 8.050026584228591e-05 | > step_time: 1.4525 (0.63962535955468) | > loader_time: 0.6728 (0.03624913643817512)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.067154884338379 (2.067154884338379) | > loss_disc_real_0: 0.07350999861955643 (0.07350999861955643) | > loss_disc_real_1: 0.13441753387451172 (0.13441753387451172) | > loss_disc_real_2: 0.14442546665668488 (0.14442546665668488) | > loss_disc_real_3: 0.1821700632572174 (0.1821700632572174) | > loss_disc_real_4: 0.11803372204303741 (0.11803372204303741) | > loss_disc_real_5: 0.07198300212621689 (0.07198300212621689) | > loss_0: 2.067154884338379 (2.067154884338379) | > loss_gen: 1.8220984935760498 (1.8220984935760498) | > loss_kl: 4.704413414001465 (4.704413414001465) | > loss_feat: 11.369836807250977 (11.369836807250977) | > loss_mel: 27.493120193481445 (27.493120193481445) | > loss_duration: 2.9802703857421875 (2.9802703857421875) | > loss_1: 48.36973571777344 (48.36973571777344)  --> STEP: 1 | > loss_disc: 2.267852544784546 (2.267852544784546) | > loss_disc_real_0: 0.20332102477550507 (0.20332102477550507) | > loss_disc_real_1: 0.16281017661094666 (0.16281017661094666) | > loss_disc_real_2: 0.212107315659523 (0.212107315659523) | > loss_disc_real_3: 0.19068771600723267 (0.19068771600723267) | > loss_disc_real_4: 0.18271110951900482 (0.18271110951900482) | > loss_disc_real_5: 0.2776966392993927 (0.2776966392993927) | > loss_0: 2.267852544784546 (2.267852544784546) | > loss_gen: 2.3614439964294434 (2.3614439964294434) | > loss_kl: 4.411952495574951 (4.411952495574951) | > loss_feat: 8.098346710205078 (8.098346710205078) | > loss_mel: 22.492738723754883 (22.492738723754883) | > loss_duration: 3.2231438159942627 (3.2231438159942627) | > loss_1: 40.587623596191406 (40.587623596191406)  --> STEP: 2 | > loss_disc: 2.1918880939483643 (2.229870319366455) | > loss_disc_real_0: 0.21211332082748413 (0.2077171728014946) | > loss_disc_real_1: 0.14085151255130768 (0.15183084458112717) | > loss_disc_real_2: 0.11335907131433487 (0.16273319348692894) | > loss_disc_real_3: 0.12862475216388702 (0.15965623408555984) | > loss_disc_real_4: 0.08938923478126526 (0.13605017215013504) | > loss_disc_real_5: 0.04629652947187424 (0.16199658438563347) | > loss_0: 2.1918880939483643 (2.229870319366455) | > loss_gen: 2.383427381515503 (2.372435688972473) | > loss_kl: 5.602207183837891 (5.007079839706421) | > loss_feat: 10.793566703796387 (9.445956707000732) | > loss_mel: 26.447179794311523 (24.469959259033203) | > loss_duration: 3.095221757888794 (3.1591827869415283) | > loss_1: 48.32160568237305 (44.45461463928223)  --> STEP: 3 | > loss_disc: 2.77433443069458 (2.41135835647583) | > loss_disc_real_0: 0.47093525528907776 (0.29545653363068897) | > loss_disc_real_1: 0.2357470840215683 (0.17980292439460754) | > loss_disc_real_2: 0.34969159960746765 (0.22505266219377518) | > loss_disc_real_3: 0.2584919333457947 (0.19260146717230478) | > loss_disc_real_4: 0.27064356207847595 (0.180914635459582) | > loss_disc_real_5: 0.35852575302124023 (0.22750630726416907) | > loss_0: 2.77433443069458 (2.41135835647583) | > loss_gen: 2.6619486808776855 (2.468940019607544) | > loss_kl: 2.3416640758514404 (4.118607918421428) | > loss_feat: 2.3922619819641113 (7.094725131988525) | > loss_mel: 18.24547576904297 (22.395131429036457) | > loss_duration: 2.914632797241211 (3.0776661237080893) | > loss_1: 28.55598258972168 (39.15507062276205) --> EVAL PERFORMANCE | > avg_loader_time: 0.018474260965983074 (-0.008530378341674805) | > avg_loss_disc: 2.41135835647583 (-0.40486017862955714) | > avg_loss_disc_real_0: 0.29545653363068897 (+0.062495251496632875) | > avg_loss_disc_real_1: 0.17980292439460754 (-0.052540212869644165) | > avg_loss_disc_real_2: 0.22505266219377518 (+0.005395121872425079) | > avg_loss_disc_real_3: 0.19260146717230478 (-0.05002300441265106) | > avg_loss_disc_real_4: 0.180914635459582 (-0.05564408004283905) | > avg_loss_disc_real_5: 0.22750630726416907 (-0.03743823617696759) | > avg_loss_0: 2.41135835647583 (-0.40486017862955714) | > avg_loss_gen: 2.468940019607544 (+0.694119930267334) | > avg_loss_kl: 4.118607918421428 (-0.432523250579834) | > avg_loss_feat: 7.094725131988525 (+4.6490360746781025) | > avg_loss_mel: 22.395131429036457 (+8.017047882080076) | > avg_loss_duration: 3.0776661237080893 (-0.11113238334655762) | > avg_loss_1: 39.15507062276205 (+12.816548029581707)  > EPOCH: 911/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:01:17)   --> TIME: 2023-10-20 11:01:41 -- STEP: 29/50 -- GLOBAL_STEP: 98580 | > loss_disc: 2.8357887268066406 (2.4051406342407753) | > loss_disc_real_0: 0.2752615511417389 (0.12799907372943287) | > loss_disc_real_1: 0.255184531211853 (0.21753290803011122) | > loss_disc_real_2: 0.1920788735151291 (0.2260973008413767) | > loss_disc_real_3: 0.2560957968235016 (0.25689767969065697) | > loss_disc_real_4: 0.25635018944740295 (0.22164206405908898) | > loss_disc_real_5: 0.2538580596446991 (0.22865610736711273) | > loss_0: 2.8357887268066406 (2.4051406342407753) | > grad_norm_0: tensor(859.2999, device='cuda:0') (tensor(570.5233, device='cuda:0')) | > loss_gen: 1.7270362377166748 (2.4629761638312497) | > loss_kl: 0.5190786719322205 (0.7991092297537573) | > loss_feat: 0.5717601180076599 (6.123948110074832) | > loss_mel: 12.961549758911133 (21.905955384517537) | > loss_duration: 1.3628236055374146 (1.3953369773667434) | > loss_1: 17.142248153686523 (32.68732526384551) | > grad_norm_1: tensor(4118.1602, device='cuda:0') (tensor(23812.7559, device='cuda:0')) | > current_lr_0: 8.041980078650657e-05 | > current_lr_1: 8.041980078650657e-05 | > step_time: 0.4542 (0.5721823758092422) | > loader_time: 0.0017 (0.021183778499734813)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7433319091796875 (2.7433319091796875) | > loss_disc_real_0: 0.20204658806324005 (0.20204658806324005) | > loss_disc_real_1: 0.3246486186981201 (0.3246486186981201) | > loss_disc_real_2: 0.24052192270755768 (0.24052192270755768) | > loss_disc_real_3: 0.2665463089942932 (0.2665463089942932) | > loss_disc_real_4: 0.2780875563621521 (0.2780875563621521) | > loss_disc_real_5: 0.2806541323661804 (0.2806541323661804) | > loss_0: 2.7433319091796875 (2.7433319091796875) | > loss_gen: 2.197767496109009 (2.197767496109009) | > loss_kl: 5.010446071624756 (5.010446071624756) | > loss_feat: 2.9366748332977295 (2.9366748332977295) | > loss_mel: 20.98024559020996 (20.98024559020996) | > loss_duration: 2.968893527984619 (2.968893527984619) | > loss_1: 34.09402847290039 (34.09402847290039)  --> STEP: 1 | > loss_disc: 2.526625156402588 (2.526625156402588) | > loss_disc_real_0: 0.328484445810318 (0.328484445810318) | > loss_disc_real_1: 0.2905522584915161 (0.2905522584915161) | > loss_disc_real_2: 0.27971121668815613 (0.27971121668815613) | > loss_disc_real_3: 0.30694863200187683 (0.30694863200187683) | > loss_disc_real_4: 0.268999308347702 (0.268999308347702) | > loss_disc_real_5: 0.3080870807170868 (0.3080870807170868) | > loss_0: 2.526625156402588 (2.526625156402588) | > loss_gen: 2.7668492794036865 (2.7668492794036865) | > loss_kl: 4.924368381500244 (4.924368381500244) | > loss_feat: 6.82962703704834 (6.82962703704834) | > loss_mel: 24.34589958190918 (24.34589958190918) | > loss_duration: 3.2955145835876465 (3.2955145835876465) | > loss_1: 42.16225814819336 (42.16225814819336)  --> STEP: 2 | > loss_disc: 2.872307777404785 (2.6994664669036865) | > loss_disc_real_0: 0.1589922308921814 (0.2437383383512497) | > loss_disc_real_1: 0.293679416179657 (0.29211583733558655) | > loss_disc_real_2: 0.21362616121768951 (0.24666868895292282) | > loss_disc_real_3: 0.40027493238449097 (0.3536117821931839) | > loss_disc_real_4: 0.30492547154426575 (0.2869623899459839) | > loss_disc_real_5: 0.5488777160644531 (0.42848239839076996) | > loss_0: 2.872307777404785 (2.6994664669036865) | > loss_gen: 2.5470404624938965 (2.6569448709487915) | > loss_kl: 5.159695148468018 (5.042031764984131) | > loss_feat: 7.958074569702148 (7.393850803375244) | > loss_mel: 25.61394500732422 (24.9799222946167) | > loss_duration: 3.1696155071258545 (3.2325650453567505) | > loss_1: 44.448368072509766 (43.30531311035156)  --> STEP: 3 | > loss_disc: 2.863516330718994 (2.7541497548421225) | > loss_disc_real_0: 0.2976547181606293 (0.2617104649543762) | > loss_disc_real_1: 0.2700759470462799 (0.284769207239151) | > loss_disc_real_2: 0.26635265350341797 (0.2532300104697545) | > loss_disc_real_3: 0.342829167842865 (0.35001757740974426) | > loss_disc_real_4: 0.2510557472705841 (0.27499350905418396) | > loss_disc_real_5: 0.2242501676082611 (0.36040498812993366) | > loss_0: 2.863516330718994 (2.7541497548421225) | > loss_gen: 2.0996503829956055 (2.471180041631063) | > loss_kl: 2.7014617919921875 (4.261841773986816) | > loss_feat: 4.501833915710449 (6.4298451741536455) | > loss_mel: 21.60378074645996 (23.854541778564453) | > loss_duration: 3.007657766342163 (3.157595952351888) | > loss_1: 33.91438293457031 (40.17500305175781) --> EVAL PERFORMANCE | > avg_loader_time: 0.017126083374023438 (-0.0013481775919596366) | > avg_loss_disc: 2.7541497548421225 (+0.34279139836629247) | > avg_loss_disc_real_0: 0.2617104649543762 (-0.033746068676312746) | > avg_loss_disc_real_1: 0.284769207239151 (+0.10496628284454346) | > avg_loss_disc_real_2: 0.2532300104697545 (+0.02817734827597934) | > avg_loss_disc_real_3: 0.35001757740974426 (+0.15741611023743948) | > avg_loss_disc_real_4: 0.27499350905418396 (+0.09407887359460196) | > avg_loss_disc_real_5: 0.36040498812993366 (+0.1328986808657646) | > avg_loss_0: 2.7541497548421225 (+0.34279139836629247) | > avg_loss_gen: 2.471180041631063 (+0.0022400220235190282) | > avg_loss_kl: 4.261841773986816 (+0.1432338555653887) | > avg_loss_feat: 6.4298451741536455 (-0.6648799578348799) | > avg_loss_mel: 23.854541778564453 (+1.459410349527996) | > avg_loss_duration: 3.157595952351888 (+0.07992982864379883) | > avg_loss_1: 40.17500305175781 (+1.0199324289957659)  > EPOCH: 912/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:02:08)   --> TIME: 2023-10-20 11:02:17 -- STEP: 9/50 -- GLOBAL_STEP: 98610 | > loss_disc: 2.7228446006774902 (2.085735970073276) | > loss_disc_real_0: 0.2783668637275696 (0.1645257913817962) | > loss_disc_real_1: 0.29194390773773193 (0.242741788427035) | > loss_disc_real_2: 0.16992095112800598 (0.157668334328466) | > loss_disc_real_3: 0.2692927122116089 (0.20841305206219354) | > loss_disc_real_4: 0.22330042719841003 (0.1514495296610726) | > loss_disc_real_5: 0.25943124294281006 (0.1435438653247224) | > loss_0: 2.7228446006774902 (2.085735970073276) | > grad_norm_0: tensor(704.6891, device='cuda:0') (tensor(535.7599, device='cuda:0')) | > loss_gen: 1.76175856590271 (2.5605759488211737) | > loss_kl: 0.7436891794204712 (0.8343799511591593) | > loss_feat: 1.2267645597457886 (7.341255042288038) | > loss_mel: 16.66863441467285 (21.30352846781413) | > loss_duration: 1.3377540111541748 (1.398370001051161) | > loss_1: 21.73859977722168 (33.43810929192437) | > grad_norm_1: tensor(4223.8501, device='cuda:0') (tensor(23104.4727, device='cuda:0')) | > current_lr_0: 8.033941616058835e-05 | > current_lr_1: 8.033941616058835e-05 | > step_time: 0.5633 (0.4858141475253635) | > loader_time: 0.0115 (0.012136273913913302)  --> TIME: 2023-10-20 11:02:35 -- STEP: 39/50 -- GLOBAL_STEP: 98640 | > loss_disc: 2.8338382244110107 (2.3788743294202366) | > loss_disc_real_0: 0.24840541183948517 (0.14361979196277952) | > loss_disc_real_1: 0.3010185956954956 (0.23452102431120017) | > loss_disc_real_2: 0.2702122628688812 (0.2185370497023448) | > loss_disc_real_3: 0.27683308720588684 (0.23693284783989954) | > loss_disc_real_4: 0.3185597360134125 (0.20034254905887133) | > loss_disc_real_5: 0.3151546120643616 (0.21295127640358913) | > loss_0: 2.8338382244110107 (2.3788743294202366) | > grad_norm_0: tensor(997.4065, device='cuda:0') (tensor(634.6509, device='cuda:0')) | > loss_gen: 2.1407344341278076 (2.3572175258245225) | > loss_kl: 0.5770959258079529 (0.814545696362471) | > loss_feat: 1.8195288181304932 (6.071636441139838) | > loss_mel: 18.678678512573242 (21.231474760251167) | > loss_duration: 1.3998234272003174 (1.3717041657521172) | > loss_1: 24.615861892700195 (31.84657859802245) | > grad_norm_1: tensor(4192.0649, device='cuda:0') (tensor(25701.9531, device='cuda:0')) | > current_lr_0: 8.033941616058835e-05 | > current_lr_1: 8.033941616058835e-05 | > step_time: 0.9566 (0.5633190595186672) | > loader_time: 0.0043 (0.013549706874749599)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.429744243621826 (2.429744243621826) | > loss_disc_real_0: 0.18831928074359894 (0.18831928074359894) | > loss_disc_real_1: 0.1438581645488739 (0.1438581645488739) | > loss_disc_real_2: 0.0959559828042984 (0.0959559828042984) | > loss_disc_real_3: 0.23048283159732819 (0.23048283159732819) | > loss_disc_real_4: 0.12875834107398987 (0.12875834107398987) | > loss_disc_real_5: 0.13852709531784058 (0.13852709531784058) | > loss_0: 2.429744243621826 (2.429744243621826) | > loss_gen: 1.7692780494689941 (1.7692780494689941) | > loss_kl: 4.354072093963623 (4.354072093963623) | > loss_feat: 9.887826919555664 (9.887826919555664) | > loss_mel: 24.608386993408203 (24.608386993408203) | > loss_duration: 2.8755204677581787 (2.8755204677581787) | > loss_1: 43.495086669921875 (43.495086669921875)  --> STEP: 1 | > loss_disc: 2.9374747276306152 (2.9374747276306152) | > loss_disc_real_0: 0.17849375307559967 (0.17849375307559967) | > loss_disc_real_1: 0.3666568994522095 (0.3666568994522095) | > loss_disc_real_2: 0.26253291964530945 (0.26253291964530945) | > loss_disc_real_3: 0.3513961136341095 (0.3513961136341095) | > loss_disc_real_4: 0.3910958468914032 (0.3910958468914032) | > loss_disc_real_5: 0.282430499792099 (0.282430499792099) | > loss_0: 2.9374747276306152 (2.9374747276306152) | > loss_gen: 2.2443716526031494 (2.2443716526031494) | > loss_kl: 5.0870771408081055 (5.0870771408081055) | > loss_feat: 6.155465126037598 (6.155465126037598) | > loss_mel: 23.951766967773438 (23.951766967773438) | > loss_duration: 3.2925078868865967 (3.2925078868865967) | > loss_1: 40.7311897277832 (40.7311897277832)  --> STEP: 2 | > loss_disc: 3.058481216430664 (2.9979779720306396) | > loss_disc_real_0: 0.1100989580154419 (0.14429635554552078) | > loss_disc_real_1: 0.23315323889255524 (0.29990506917238235) | > loss_disc_real_2: 0.05416090413928032 (0.15834691189229488) | > loss_disc_real_3: 0.29807618260383606 (0.3247361481189728) | > loss_disc_real_4: 0.20862935483455658 (0.2998626008629799) | > loss_disc_real_5: 0.25723564624786377 (0.2698330730199814) | > loss_0: 3.058481216430664 (2.9979779720306396) | > loss_gen: 1.4870296716690063 (1.8657006621360779) | > loss_kl: 5.555587291717529 (5.321332216262817) | > loss_feat: 7.917706489562988 (7.036585807800293) | > loss_mel: 26.36937713623047 (25.160572052001953) | > loss_duration: 3.274290084838867 (3.283398985862732) | > loss_1: 44.60398864746094 (42.66758918762207)  --> STEP: 3 | > loss_disc: 3.047515869140625 (3.0144906044006348) | > loss_disc_real_0: 0.2594285011291504 (0.18267373740673065) | > loss_disc_real_1: 0.25950828194618225 (0.28643947343031567) | > loss_disc_real_2: 0.2839602828025818 (0.20021803552905718) | > loss_disc_real_3: 0.2645127475261688 (0.3046616812547048) | > loss_disc_real_4: 0.2765117883682251 (0.29207899669806164) | > loss_disc_real_5: 0.29989150166511536 (0.27985254923502606) | > loss_0: 3.047515869140625 (3.0144906044006348) | > loss_gen: 1.6057357788085938 (1.7790457010269165) | > loss_kl: 2.331437826156616 (4.324700752894084) | > loss_feat: 0.08797073364257812 (4.720380783081055) | > loss_mel: 2.106289863586426 (17.47581132253011) | > loss_duration: 2.991100788116455 (3.1859662532806396) | > loss_1: 9.122535705566406 (31.485904693603516) --> EVAL PERFORMANCE | > avg_loader_time: 0.01921383539835612 (+0.0020877520243326834) | > avg_loss_disc: 3.0144906044006348 (+0.2603408495585122) | > avg_loss_disc_real_0: 0.18267373740673065 (-0.07903672754764557) | > avg_loss_disc_real_1: 0.28643947343031567 (+0.001670266191164671) | > avg_loss_disc_real_2: 0.20021803552905718 (-0.05301197494069734) | > avg_loss_disc_real_3: 0.3046616812547048 (-0.04535589615503949) | > avg_loss_disc_real_4: 0.29207899669806164 (+0.017085487643877684) | > avg_loss_disc_real_5: 0.27985254923502606 (-0.0805524388949076) | > avg_loss_0: 3.0144906044006348 (+0.2603408495585122) | > avg_loss_gen: 1.7790457010269165 (-0.6921343406041465) | > avg_loss_kl: 4.324700752894084 (+0.06285897890726755) | > avg_loss_feat: 4.720380783081055 (-1.7094643910725908) | > avg_loss_mel: 17.47581132253011 (-6.378730456034344) | > avg_loss_duration: 3.1859662532806396 (+0.02837030092875148) | > avg_loss_1: 31.485904693603516 (-8.689098358154297)  > EPOCH: 913/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:02:50)   --> TIME: 2023-10-20 11:03:06 -- STEP: 19/50 -- GLOBAL_STEP: 98670 | > loss_disc: 2.674879312515259 (2.3480703077818217) | > loss_disc_real_0: 0.22590143978595734 (0.14703633675449773) | > loss_disc_real_1: 0.20664110779762268 (0.22734804412252024) | > loss_disc_real_2: 0.4036993384361267 (0.2329227347907267) | > loss_disc_real_3: 0.1762971729040146 (0.20629503754408737) | > loss_disc_real_4: 0.25594329833984375 (0.19782902261144236) | > loss_disc_real_5: 0.342050164937973 (0.1876079938129375) | > loss_0: 2.674879312515259 (2.3480703077818217) | > grad_norm_0: tensor(669.0043, device='cuda:0') (tensor(660.4999, device='cuda:0')) | > loss_gen: 2.563650608062744 (2.4260814566361275) | > loss_kl: 0.8221321702003479 (0.7593401839074335) | > loss_feat: 7.304004192352295 (6.6968055473346455) | > loss_mel: 20.952980041503906 (21.251363641337345) | > loss_duration: 1.4443901777267456 (1.3891643975910388) | > loss_1: 33.087158203125 (32.52275507073654) | > grad_norm_1: tensor(19344.8867, device='cuda:0') (tensor(20694.1934, device='cuda:0')) | > current_lr_0: 8.025911188413656e-05 | > current_lr_1: 8.025911188413656e-05 | > step_time: 0.4279 (0.5975443438479775) | > loader_time: 0.028 (0.02529372667011462)  --> TIME: 2023-10-20 11:03:26 -- STEP: 49/50 -- GLOBAL_STEP: 98700 | > loss_disc: 2.220277786254883 (2.4377566600332443) | > loss_disc_real_0: 0.060396384447813034 (0.14790323977263606) | > loss_disc_real_1: 0.16891196370124817 (0.22817981212723012) | > loss_disc_real_2: 0.13658392429351807 (0.23058291129311737) | > loss_disc_real_3: 0.11415699869394302 (0.22801716587677293) | > loss_disc_real_4: 0.035324085503816605 (0.20882580801844597) | > loss_disc_real_5: 0.07060521841049194 (0.2059389433006243) | > loss_0: 2.220277786254883 (2.4377566600332443) | > grad_norm_0: tensor(1004.4976, device='cuda:0') (tensor(740.2513, device='cuda:0')) | > loss_gen: 1.9070148468017578 (2.2815416467433067) | > loss_kl: 0.7315150499343872 (0.7785809786648167) | > loss_feat: 7.8522796630859375 (5.664637837330906) | > loss_mel: 23.885068893432617 (20.69165144647871) | > loss_duration: 1.493579626083374 (1.3582457376986135) | > loss_1: 35.86945724487305 (30.77465743434672) | > grad_norm_1: tensor(40932.1992, device='cuda:0') (tensor(19053.5352, device='cuda:0')) | > current_lr_0: 8.025911188413656e-05 | > current_lr_1: 8.025911188413656e-05 | > step_time: 0.6992 (0.6011728997133218) | > loader_time: 0.3814 (0.02963611057826451)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2897610664367676 (2.2897610664367676) | > loss_disc_real_0: 0.3286581039428711 (0.3286581039428711) | > loss_disc_real_1: 0.21153657138347626 (0.21153657138347626) | > loss_disc_real_2: 0.24706366658210754 (0.24706366658210754) | > loss_disc_real_3: 0.33626025915145874 (0.33626025915145874) | > loss_disc_real_4: 0.2452475130558014 (0.2452475130558014) | > loss_disc_real_5: 0.4344905614852905 (0.4344905614852905) | > loss_0: 2.2897610664367676 (2.2897610664367676) | > loss_gen: 3.6108620166778564 (3.6108620166778564) | > loss_kl: 5.14135217666626 (5.14135217666626) | > loss_feat: 8.039941787719727 (8.039941787719727) | > loss_mel: 21.944732666015625 (21.944732666015625) | > loss_duration: 3.0142416954040527 (3.0142416954040527) | > loss_1: 41.751129150390625 (41.751129150390625)  --> STEP: 1 | > loss_disc: 1.196842908859253 (1.196842908859253) | > loss_disc_real_0: 0.09891053289175034 (0.09891053289175034) | > loss_disc_real_1: 0.01380107831209898 (0.01380107831209898) | > loss_disc_real_2: 0.02459271438419819 (0.02459271438419819) | > loss_disc_real_3: 0.0768565982580185 (0.0768565982580185) | > loss_disc_real_4: 0.13293622434139252 (0.13293622434139252) | > loss_disc_real_5: 0.25095629692077637 (0.25095629692077637) | > loss_0: 1.196842908859253 (1.196842908859253) | > loss_gen: 3.115635633468628 (3.115635633468628) | > loss_kl: 4.8823137283325195 (4.8823137283325195) | > loss_feat: 20.402328491210938 (20.402328491210938) | > loss_mel: 28.494430541992188 (28.494430541992188) | > loss_duration: 3.3392415046691895 (3.3392415046691895) | > loss_1: 60.23394775390625 (60.23394775390625)  --> STEP: 2 | > loss_disc: 2.9240522384643555 (2.060447573661804) | > loss_disc_real_0: 0.19702070951461792 (0.14796562120318413) | > loss_disc_real_1: 0.2565963566303253 (0.13519871747121215) | > loss_disc_real_2: 0.24110184609889984 (0.13284728024154902) | > loss_disc_real_3: 0.2763625979423523 (0.1766095981001854) | > loss_disc_real_4: 0.2985382080078125 (0.2157372161746025) | > loss_disc_real_5: 0.3203807473182678 (0.2856685221195221) | > loss_0: 2.9240522384643555 (2.060447573661804) | > loss_gen: 1.7328205108642578 (2.424228072166443) | > loss_kl: 5.464629173278809 (5.173471450805664) | > loss_feat: 1.2045027017593384 (10.803415596485138) | > loss_mel: 21.7940673828125 (25.144248962402344) | > loss_duration: 3.211637258529663 (3.2754393815994263) | > loss_1: 33.407657623291016 (46.82080268859863)  --> STEP: 3 | > loss_disc: 3.440298557281494 (2.520397901535034) | > loss_disc_real_0: 0.2528451681137085 (0.18292547017335892) | > loss_disc_real_1: 0.298138827085495 (0.18951208734263977) | > loss_disc_real_2: 0.30022820830345154 (0.18864092292884985) | > loss_disc_real_3: 0.3408214747905731 (0.23134689033031464) | > loss_disc_real_4: 0.33496662974357605 (0.255480354030927) | > loss_disc_real_5: 0.5552188754081726 (0.3755186398824056) | > loss_0: 3.440298557281494 (2.520397901535034) | > loss_gen: 2.0231735706329346 (2.29054323832194) | > loss_kl: 2.522062063217163 (4.289668321609497) | > loss_feat: 4.587169170379639 (8.731333454449972) | > loss_mel: 21.147438049316406 (23.811978658040363) | > loss_duration: 3.042112350463867 (3.1976637045542398) | > loss_1: 33.32195281982422 (42.32118606567383) --> EVAL PERFORMANCE | > avg_loader_time: 0.020237445831298828 (+0.0010236104329427072) | > avg_loss_disc: 2.520397901535034 (-0.4940927028656006) | > avg_loss_disc_real_0: 0.18292547017335892 (+0.0002517327666282654) | > avg_loss_disc_real_1: 0.18951208734263977 (-0.0969273860876759) | > avg_loss_disc_real_2: 0.18864092292884985 (-0.011577112600207329) | > avg_loss_disc_real_3: 0.23134689033031464 (-0.07331479092439014) | > avg_loss_disc_real_4: 0.255480354030927 (-0.03659864266713464) | > avg_loss_disc_real_5: 0.3755186398824056 (+0.09566609064737952) | > avg_loss_0: 2.520397901535034 (-0.4940927028656006) | > avg_loss_gen: 2.29054323832194 (+0.5114975372950235) | > avg_loss_kl: 4.289668321609497 (-0.035032431284586885) | > avg_loss_feat: 8.731333454449972 (+4.010952671368917) | > avg_loss_mel: 23.811978658040363 (+6.336167335510254) | > avg_loss_duration: 3.1976637045542398 (+0.011697451273600112) | > avg_loss_1: 42.32118606567383 (+10.835281372070312)  > EPOCH: 914/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:03:41)   --> TIME: 2023-10-20 11:04:05 -- STEP: 29/50 -- GLOBAL_STEP: 98730 | > loss_disc: 2.6787614822387695 (2.4699349300614717) | > loss_disc_real_0: 0.1367909014225006 (0.17282445484708095) | > loss_disc_real_1: 0.2863806188106537 (0.23219001999702946) | > loss_disc_real_2: 0.18236389756202698 (0.22231100152792602) | > loss_disc_real_3: 0.2554674446582794 (0.24895908298163577) | > loss_disc_real_4: 0.2577120363712311 (0.23410254074581738) | > loss_disc_real_5: 0.30536001920700073 (0.23682075636140232) | > loss_0: 2.6787614822387695 (2.4699349300614717) | > grad_norm_0: tensor(672.8304, device='cuda:0') (tensor(706.2169, device='cuda:0')) | > loss_gen: 1.8138666152954102 (2.364772237580398) | > loss_kl: 0.836190938949585 (0.783608405754484) | > loss_feat: 1.323906421661377 (5.534698396921158) | > loss_mel: 15.92307186126709 (22.140357938306085) | > loss_duration: 1.3216127157211304 (1.380844519056123) | > loss_1: 21.218650817871094 (32.204281642519206) | > grad_norm_1: tensor(6209.2529, device='cuda:0') (tensor(17208.5957, device='cuda:0')) | > current_lr_0: 8.017888787683689e-05 | > current_lr_1: 8.017888787683689e-05 | > step_time: 0.466 (0.6060717270292085) | > loader_time: 0.0044 (0.019326612867158036)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.5073657035827637 (3.5073657035827637) | > loss_disc_real_0: 0.29340869188308716 (0.29340869188308716) | > loss_disc_real_1: 0.326263427734375 (0.326263427734375) | > loss_disc_real_2: 0.43413811922073364 (0.43413811922073364) | > loss_disc_real_3: 0.44081807136535645 (0.44081807136535645) | > loss_disc_real_4: 0.562616229057312 (0.562616229057312) | > loss_disc_real_5: 0.7594488859176636 (0.7594488859176636) | > loss_0: 3.5073657035827637 (3.5073657035827637) | > loss_gen: 2.955354690551758 (2.955354690551758) | > loss_kl: 6.268566608428955 (6.268566608428955) | > loss_feat: 5.680609703063965 (5.680609703063965) | > loss_mel: 22.193151473999023 (22.193151473999023) | > loss_duration: 3.0922951698303223 (3.0922951698303223) | > loss_1: 40.18997573852539 (40.18997573852539)  --> STEP: 1 | > loss_disc: 1.838465690612793 (1.838465690612793) | > loss_disc_real_0: 0.16815292835235596 (0.16815292835235596) | > loss_disc_real_1: 0.24691331386566162 (0.24691331386566162) | > loss_disc_real_2: 0.22560226917266846 (0.22560226917266846) | > loss_disc_real_3: 0.13547353446483612 (0.13547353446483612) | > loss_disc_real_4: 0.12984611093997955 (0.12984611093997955) | > loss_disc_real_5: 0.09672953188419342 (0.09672953188419342) | > loss_0: 1.838465690612793 (1.838465690612793) | > loss_gen: 2.931692600250244 (2.931692600250244) | > loss_kl: 5.542387962341309 (5.542387962341309) | > loss_feat: 8.81131362915039 (8.81131362915039) | > loss_mel: 25.067949295043945 (25.067949295043945) | > loss_duration: 3.286363124847412 (3.286363124847412) | > loss_1: 45.639705657958984 (45.639705657958984)  --> STEP: 2 | > loss_disc: 1.9100900888442993 (1.8742778897285461) | > loss_disc_real_0: 0.06293371319770813 (0.11554332077503204) | > loss_disc_real_1: 0.1475210338830948 (0.1972171738743782) | > loss_disc_real_2: 0.13713470101356506 (0.18136848509311676) | > loss_disc_real_3: 0.11664213240146637 (0.12605783343315125) | > loss_disc_real_4: 0.15952810645103455 (0.14468710869550705) | > loss_disc_real_5: 0.2737087905406952 (0.1852191612124443) | > loss_0: 1.9100900888442993 (1.8742778897285461) | > loss_gen: 2.598717212677002 (2.765204906463623) | > loss_kl: 5.109772205352783 (5.326080083847046) | > loss_feat: 9.603523254394531 (9.207418441772461) | > loss_mel: 27.830909729003906 (26.449429512023926) | > loss_duration: 3.1832544803619385 (3.2348088026046753) | > loss_1: 48.326175689697266 (46.982940673828125)  --> STEP: 3 | > loss_disc: 2.9262161254882812 (2.2249239683151245) | > loss_disc_real_0: 0.1236715316772461 (0.1182527244091034) | > loss_disc_real_1: 0.3703128397464752 (0.2549157291650772) | > loss_disc_real_2: 0.3628859221935272 (0.24187429745992026) | > loss_disc_real_3: 0.4156740605831146 (0.22259657581647238) | > loss_disc_real_4: 0.4533611536026001 (0.2475784569978714) | > loss_disc_real_5: 0.36113011837005615 (0.24385614693164825) | > loss_0: 2.9262161254882812 (2.2249239683151245) | > loss_gen: 2.564661979675293 (2.698357264200846) | > loss_kl: 1.946265459060669 (4.199475208918254) | > loss_feat: 3.208425521850586 (7.207754135131836) | > loss_mel: 18.607410430908203 (23.83542315165202) | > loss_duration: 3.006009101867676 (3.1585422356923423) | > loss_1: 29.33277130126953 (41.09955088297526) --> EVAL PERFORMANCE | > avg_loader_time: 0.011867523193359375 (-0.008369922637939453) | > avg_loss_disc: 2.2249239683151245 (-0.29547393321990967) | > avg_loss_disc_real_0: 0.1182527244091034 (-0.06467274576425552) | > avg_loss_disc_real_1: 0.2549157291650772 (+0.06540364182243744) | > avg_loss_disc_real_2: 0.24187429745992026 (+0.05323337453107041) | > avg_loss_disc_real_3: 0.22259657581647238 (-0.008750314513842256) | > avg_loss_disc_real_4: 0.2475784569978714 (-0.007901897033055605) | > avg_loss_disc_real_5: 0.24385614693164825 (-0.13166249295075733) | > avg_loss_0: 2.2249239683151245 (-0.29547393321990967) | > avg_loss_gen: 2.698357264200846 (+0.40781402587890625) | > avg_loss_kl: 4.199475208918254 (-0.0901931126912432) | > avg_loss_feat: 7.207754135131836 (-1.5235793193181362) | > avg_loss_mel: 23.83542315165202 (+0.023444493611656014) | > avg_loss_duration: 3.1585422356923423 (-0.03912146886189749) | > avg_loss_1: 41.09955088297526 (-1.22163518269857)  > EPOCH: 915/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:04:30)   --> TIME: 2023-10-20 11:04:42 -- STEP: 9/50 -- GLOBAL_STEP: 98760 | > loss_disc: 2.6398353576660156 (2.418099323908488) | > loss_disc_real_0: 0.2292010337114334 (0.15764168235990736) | > loss_disc_real_1: 0.28466466069221497 (0.236867256462574) | > loss_disc_real_2: 0.21072281897068024 (0.21618981079922783) | > loss_disc_real_3: 0.2897605001926422 (0.24338161158892843) | > loss_disc_real_4: 0.2346993237733841 (0.2577053950064712) | > loss_disc_real_5: 0.21564427018165588 (0.22400235001825625) | > loss_0: 2.6398353576660156 (2.418099323908488) | > grad_norm_0: tensor(1313.4200, device='cuda:0') (tensor(832.7693, device='cuda:0')) | > loss_gen: 1.9149928092956543 (2.386402130126953) | > loss_kl: 0.566512405872345 (0.6785923079070117) | > loss_feat: 1.2677597999572754 (5.1129453629255295) | > loss_mel: 18.0576171875 (16.58116841316223) | > loss_duration: 1.313247561454773 (1.374985032611423) | > loss_1: 23.12013053894043 (26.134092860751682) | > grad_norm_1: tensor(7952.3462, device='cuda:0') (tensor(22311.5723, device='cuda:0')) | > current_lr_0: 8.009874405845526e-05 | > current_lr_1: 8.009874405845526e-05 | > step_time: 0.8373 (0.6175478829277886) | > loader_time: 0.007 (0.0156451596154107)  --> TIME: 2023-10-20 11:04:59 -- STEP: 39/50 -- GLOBAL_STEP: 98790 | > loss_disc: 2.847931385040283 (2.4507696445171647) | > loss_disc_real_0: 0.04919399321079254 (0.14065306528638574) | > loss_disc_real_1: 0.23286046087741852 (0.22941256744357255) | > loss_disc_real_2: 0.24745526909828186 (0.22366785248502707) | > loss_disc_real_3: 0.30597004294395447 (0.2540201189903877) | > loss_disc_real_4: 0.20500460267066956 (0.23510779153842185) | > loss_disc_real_5: 0.10802625119686127 (0.21890124762191987) | > loss_0: 2.847931385040283 (2.4507696445171647) | > grad_norm_0: tensor(2048.8213, device='cuda:0') (tensor(1297.7428, device='cuda:0')) | > loss_gen: 1.6265898942947388 (2.288586194698627) | > loss_kl: 0.23014770448207855 (0.7050319654532732) | > loss_feat: 4.484649658203125 (5.397995797296365) | > loss_mel: 27.392559051513672 (20.573509344687828) | > loss_duration: 1.4229918718338013 (1.3502239263974702) | > loss_1: 35.15694046020508 (30.31534697459294) | > grad_norm_1: tensor(72190.7266, device='cuda:0') (tensor(34176.5312, device='cuda:0')) | > current_lr_0: 8.009874405845526e-05 | > current_lr_1: 8.009874405845526e-05 | > step_time: 0.8012 (0.569660804210565) | > loader_time: 0.0453 (0.019528682415301982)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.318194627761841 (2.318194627761841) | > loss_disc_real_0: 0.1605428010225296 (0.1605428010225296) | > loss_disc_real_1: 0.20622633397579193 (0.20622633397579193) | > loss_disc_real_2: 0.2868248522281647 (0.2868248522281647) | > loss_disc_real_3: 0.37812528014183044 (0.37812528014183044) | > loss_disc_real_4: 0.3343406319618225 (0.3343406319618225) | > loss_disc_real_5: 0.22768442332744598 (0.22768442332744598) | > loss_0: 2.318194627761841 (2.318194627761841) | > loss_gen: 3.073546886444092 (3.073546886444092) | > loss_kl: 5.149622917175293 (5.149622917175293) | > loss_feat: 9.45567798614502 (9.45567798614502) | > loss_mel: 22.242389678955078 (22.242389678955078) | > loss_duration: 2.8716485500335693 (2.8716485500335693) | > loss_1: 42.792884826660156 (42.792884826660156)  --> STEP: 1 | > loss_disc: 2.928046941757202 (2.928046941757202) | > loss_disc_real_0: 0.2379027158021927 (0.2379027158021927) | > loss_disc_real_1: 0.2617409825325012 (0.2617409825325012) | > loss_disc_real_2: 0.3437800705432892 (0.3437800705432892) | > loss_disc_real_3: 0.28489160537719727 (0.28489160537719727) | > loss_disc_real_4: 0.24656186997890472 (0.24656186997890472) | > loss_disc_real_5: 0.2589741051197052 (0.2589741051197052) | > loss_0: 2.928046941757202 (2.928046941757202) | > loss_gen: 1.7787200212478638 (1.7787200212478638) | > loss_kl: 5.006087779998779 (5.006087779998779) | > loss_feat: 0.788274884223938 (0.788274884223938) | > loss_mel: 19.11084747314453 (19.11084747314453) | > loss_duration: 3.2724051475524902 (3.2724051475524902) | > loss_1: 29.956336975097656 (29.956336975097656)  --> STEP: 2 | > loss_disc: 2.00473690032959 (2.466391921043396) | > loss_disc_real_0: 0.13168489933013916 (0.18479380756616592) | > loss_disc_real_1: 0.21665070950984955 (0.23919584602117538) | > loss_disc_real_2: 0.0682167336344719 (0.20599840208888054) | > loss_disc_real_3: 0.2607194483280182 (0.2728055268526077) | > loss_disc_real_4: 0.10755930840969086 (0.1770605891942978) | > loss_disc_real_5: 0.0984116792678833 (0.17869289219379425) | > loss_0: 2.00473690032959 (2.466391921043396) | > loss_gen: 2.317199230194092 (2.047959625720978) | > loss_kl: 5.3354620933532715 (5.170774936676025) | > loss_feat: 8.923994064331055 (4.856134474277496) | > loss_mel: 25.44460105895996 (22.277724266052246) | > loss_duration: 3.1736578941345215 (3.223031520843506) | > loss_1: 45.19491195678711 (37.57562446594238)  --> STEP: 3 | > loss_disc: 1.6672102212905884 (2.1999980211257935) | > loss_disc_real_0: 0.011570527218282223 (0.12705271411687136) | > loss_disc_real_1: 0.3274137079715729 (0.26860180000464123) | > loss_disc_real_2: 0.2287178337574005 (0.2135715459783872) | > loss_disc_real_3: 0.21015982329845428 (0.2519236256678899) | > loss_disc_real_4: 0.05992906913161278 (0.1380167491734028) | > loss_disc_real_5: 0.146919384598732 (0.16810172299544016) | > loss_0: 1.6672102212905884 (2.1999980211257935) | > loss_gen: 3.025620937347412 (2.373846729596456) | > loss_kl: 2.447927236557007 (4.2631590366363525) | > loss_feat: 6.765471458435059 (5.49258013566335) | > loss_mel: 23.820018768310547 (22.79182243347168) | > loss_duration: 2.9355826377868652 (3.1272152264912925) | > loss_1: 38.9946174621582 (38.048622131347656) --> EVAL PERFORMANCE | > avg_loader_time: 0.020325740178426106 (+0.00845821698506673) | > avg_loss_disc: 2.1999980211257935 (-0.024925947189331055) | > avg_loss_disc_real_0: 0.12705271411687136 (+0.008799989707767963) | > avg_loss_disc_real_1: 0.26860180000464123 (+0.013686070839564024) | > avg_loss_disc_real_2: 0.2135715459783872 (-0.02830275148153305) | > avg_loss_disc_real_3: 0.2519236256678899 (+0.029327049851417514) | > avg_loss_disc_real_4: 0.1380167491734028 (-0.10956170782446861) | > avg_loss_disc_real_5: 0.16810172299544016 (-0.0757544239362081) | > avg_loss_0: 2.1999980211257935 (-0.024925947189331055) | > avg_loss_gen: 2.373846729596456 (-0.32451053460439017) | > avg_loss_kl: 4.2631590366363525 (+0.06368382771809866) | > avg_loss_feat: 5.49258013566335 (-1.7151739994684858) | > avg_loss_mel: 22.79182243347168 (-1.0436007181803397) | > avg_loss_duration: 3.1272152264912925 (-0.031327009201049805) | > avg_loss_1: 38.048622131347656 (-3.050928751627602)  > EPOCH: 916/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:05:20)   --> TIME: 2023-10-20 11:05:40 -- STEP: 19/50 -- GLOBAL_STEP: 98820 | > loss_disc: 2.3851795196533203 (2.494037101143285) | > loss_disc_real_0: 0.2235596477985382 (0.16495509279009543) | > loss_disc_real_1: 0.3781208097934723 (0.22357504697222458) | > loss_disc_real_2: 0.27097728848457336 (0.22533869076716273) | > loss_disc_real_3: 0.22742469608783722 (0.21042371835363538) | > loss_disc_real_4: 0.17410071194171906 (0.2399394351400827) | > loss_disc_real_5: 0.3529007136821747 (0.25769144414286865) | > loss_0: 2.3851795196533203 (2.494037101143285) | > grad_norm_0: tensor(1353.2587, device='cuda:0') (tensor(1587.5466, device='cuda:0')) | > loss_gen: 3.1587233543395996 (2.2046268676456653) | > loss_kl: 1.0065574645996094 (0.8673737535351201) | > loss_feat: 7.104091167449951 (4.272848565719629) | > loss_mel: 27.508195877075195 (17.961626830853913) | > loss_duration: 1.485477328300476 (1.3891123407765438) | > loss_1: 40.26304244995117 (26.695587961297285) | > grad_norm_1: tensor(7572.6870, device='cuda:0') (tensor(31029.4141, device='cuda:0')) | > current_lr_0: 8.001868034883786e-05 | > current_lr_1: 8.001868034883786e-05 | > step_time: 0.8118 (0.6336021925273695) | > loader_time: 0.0292 (0.026280302750436885)  --> TIME: 2023-10-20 11:05:56 -- STEP: 49/50 -- GLOBAL_STEP: 98850 | > loss_disc: 2.5592360496520996 (2.485595055988857) | > loss_disc_real_0: 0.03616269677877426 (0.14771782063251856) | > loss_disc_real_1: 0.2317039668560028 (0.22161473668351464) | > loss_disc_real_2: 0.13835673034191132 (0.23151478247374904) | > loss_disc_real_3: 0.3083180785179138 (0.22871280621205056) | > loss_disc_real_4: 0.23299379646778107 (0.22527692740669056) | > loss_disc_real_5: 0.2577390968799591 (0.24206945573797034) | > loss_0: 2.5592360496520996 (2.485595055988857) | > grad_norm_0: tensor(1500.8364, device='cuda:0') (tensor(1414.7292, device='cuda:0')) | > loss_gen: 1.861546277999878 (2.222168591557715) | > loss_kl: 0.6288520693778992 (0.7925179250994507) | > loss_feat: 1.9127787351608276 (5.002801171827075) | > loss_mel: 20.962736129760742 (19.116283662465158) | > loss_duration: 1.529945731163025 (1.359436390351276) | > loss_1: 26.895858764648438 (28.493207415755915) | > grad_norm_1: tensor(7982.2773, device='cuda:0') (tensor(33669.8633, device='cuda:0')) | > current_lr_0: 8.001868034883786e-05 | > current_lr_1: 8.001868034883786e-05 | > step_time: 0.6021 (0.553171581151534) | > loader_time: 0.4329 (0.027137474137909557)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6687393188476562 (2.6687393188476562) | > loss_disc_real_0: 0.1870419979095459 (0.1870419979095459) | > loss_disc_real_1: 0.27741917967796326 (0.27741917967796326) | > loss_disc_real_2: 0.3275482952594757 (0.3275482952594757) | > loss_disc_real_3: 0.29732444882392883 (0.29732444882392883) | > loss_disc_real_4: 0.284847229719162 (0.284847229719162) | > loss_disc_real_5: 0.31979838013648987 (0.31979838013648987) | > loss_0: 2.6687393188476562 (2.6687393188476562) | > loss_gen: 2.75887393951416 (2.75887393951416) | > loss_kl: 4.743701934814453 (4.743701934814453) | > loss_feat: 7.255024433135986 (7.255024433135986) | > loss_mel: 23.581756591796875 (23.581756591796875) | > loss_duration: 2.9000535011291504 (2.9000535011291504) | > loss_1: 41.239410400390625 (41.239410400390625)  --> STEP: 1 | > loss_disc: 2.782911539077759 (2.782911539077759) | > loss_disc_real_0: 0.3727695941925049 (0.3727695941925049) | > loss_disc_real_1: 0.42017701268196106 (0.42017701268196106) | > loss_disc_real_2: 0.18629799783229828 (0.18629799783229828) | > loss_disc_real_3: 0.15252651274204254 (0.15252651274204254) | > loss_disc_real_4: 0.23647916316986084 (0.23647916316986084) | > loss_disc_real_5: 0.19385959208011627 (0.19385959208011627) | > loss_0: 2.782911539077759 (2.782911539077759) | > loss_gen: 2.155618906021118 (2.155618906021118) | > loss_kl: 5.077433109283447 (5.077433109283447) | > loss_feat: 5.493001937866211 (5.493001937866211) | > loss_mel: 25.317991256713867 (25.317991256713867) | > loss_duration: 3.200810670852661 (3.200810670852661) | > loss_1: 41.24485778808594 (41.24485778808594)  --> STEP: 2 | > loss_disc: 2.378945827484131 (2.580928683280945) | > loss_disc_real_0: 0.09804375469684601 (0.23540667444467545) | > loss_disc_real_1: 0.19128605723381042 (0.30573153495788574) | > loss_disc_real_2: 0.16836941242218018 (0.17733370512723923) | > loss_disc_real_3: 0.11601852625608444 (0.1342725194990635) | > loss_disc_real_4: 0.11324454098939896 (0.1748618520796299) | > loss_disc_real_5: 0.08903577923774719 (0.14144768565893173) | > loss_0: 2.378945827484131 (2.580928683280945) | > loss_gen: 2.000307321548462 (2.07796311378479) | > loss_kl: 5.569647312164307 (5.323540210723877) | > loss_feat: 10.534692764282227 (8.013847351074219) | > loss_mel: 23.24259376525879 (24.280292510986328) | > loss_duration: 3.190368890762329 (3.195589780807495) | > loss_1: 44.5376091003418 (42.89123344421387)  --> STEP: 3 | > loss_disc: 2.8412322998046875 (2.667696555455526) | > loss_disc_real_0: 0.3595724403858185 (0.27679526309172314) | > loss_disc_real_1: 0.3055589199066162 (0.3056739966074626) | > loss_disc_real_2: 0.2318340390920639 (0.19550048311551413) | > loss_disc_real_3: 0.29304245114326477 (0.18719583004713058) | > loss_disc_real_4: 0.2643160820007324 (0.2046799287199974) | > loss_disc_real_5: 0.26409783959388733 (0.18233107030391693) | > loss_0: 2.8412322998046875 (2.667696555455526) | > loss_gen: 2.073734760284424 (2.0765536626180015) | > loss_kl: 2.456500291824341 (4.367860237757365) | > loss_feat: 1.0374395847320557 (5.688378095626831) | > loss_mel: 17.592981338500977 (22.051188786824543) | > loss_duration: 2.925485610961914 (3.1055550575256348) | > loss_1: 26.08614158630371 (37.28953615824381) --> EVAL PERFORMANCE | > avg_loader_time: 0.019598007202148438 (-0.0007277329762776681) | > avg_loss_disc: 2.667696555455526 (+0.4676985343297324) | > avg_loss_disc_real_0: 0.27679526309172314 (+0.14974254897485179) | > avg_loss_disc_real_1: 0.3056739966074626 (+0.03707219660282135) | > avg_loss_disc_real_2: 0.19550048311551413 (-0.018071062862873077) | > avg_loss_disc_real_3: 0.18719583004713058 (-0.06472779562075931) | > avg_loss_disc_real_4: 0.2046799287199974 (+0.06666317954659462) | > avg_loss_disc_real_5: 0.18233107030391693 (+0.014229347308476775) | > avg_loss_0: 2.667696555455526 (+0.4676985343297324) | > avg_loss_gen: 2.0765536626180015 (-0.2972930669784546) | > avg_loss_kl: 4.367860237757365 (+0.10470120112101267) | > avg_loss_feat: 5.688378095626831 (+0.19579795996348093) | > avg_loss_mel: 22.051188786824543 (-0.7406336466471366) | > avg_loss_duration: 3.1055550575256348 (-0.0216601689656577) | > avg_loss_1: 37.28953615824381 (-0.7590859731038435)  > EPOCH: 917/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:06:16)   --> TIME: 2023-10-20 11:06:36 -- STEP: 29/50 -- GLOBAL_STEP: 98880 | > loss_disc: 2.1217517852783203 (2.4472187613618783) | > loss_disc_real_0: 0.032916679978370667 (0.1496602816764137) | > loss_disc_real_1: 0.13947555422782898 (0.2243700030034986) | > loss_disc_real_2: 0.1509796679019928 (0.2307869004535264) | > loss_disc_real_3: 0.29079967737197876 (0.2532466262707422) | > loss_disc_real_4: 0.13966664671897888 (0.2357646006255828) | > loss_disc_real_5: 0.11709630489349365 (0.21359558743103568) | > loss_0: 2.1217517852783203 (2.4472187613618783) | > grad_norm_0: tensor(1063.7860, device='cuda:0') (tensor(1305.9167, device='cuda:0')) | > loss_gen: 2.27400803565979 (2.2398980568195213) | > loss_kl: 0.8585625886917114 (0.8682362694164802) | > loss_feat: 7.746316432952881 (5.069507945714326) | > loss_mel: 22.073558807373047 (20.001727367269574) | > loss_duration: 1.3874415159225464 (1.3725889674548446) | > loss_1: 34.33988571166992 (29.5519584787303) | > grad_norm_1: tensor(45318.7188, device='cuda:0') (tensor(47664.7539, device='cuda:0')) | > current_lr_0: 7.993869666791097e-05 | > current_lr_1: 7.993869666791097e-05 | > step_time: 0.2978 (0.440227039929094) | > loader_time: 0.0154 (0.011458487346254546)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7616333961486816 (2.7616333961486816) | > loss_disc_real_0: 0.16126777231693268 (0.16126777231693268) | > loss_disc_real_1: 0.21816101670265198 (0.21816101670265198) | > loss_disc_real_2: 0.3977994918823242 (0.3977994918823242) | > loss_disc_real_3: 0.319737046957016 (0.319737046957016) | > loss_disc_real_4: 0.35413622856140137 (0.35413622856140137) | > loss_disc_real_5: 0.2833831310272217 (0.2833831310272217) | > loss_0: 2.7616333961486816 (2.7616333961486816) | > loss_gen: 2.2690532207489014 (2.2690532207489014) | > loss_kl: 4.270636558532715 (4.270636558532715) | > loss_feat: 4.369413375854492 (4.369413375854492) | > loss_mel: 20.33761215209961 (20.33761215209961) | > loss_duration: 2.9913697242736816 (2.9913697242736816) | > loss_1: 34.23808288574219 (34.23808288574219)  --> STEP: 1 | > loss_disc: 2.396301746368408 (2.396301746368408) | > loss_disc_real_0: 0.07572020590305328 (0.07572020590305328) | > loss_disc_real_1: 0.21931779384613037 (0.21931779384613037) | > loss_disc_real_2: 0.3648766279220581 (0.3648766279220581) | > loss_disc_real_3: 0.2856489419937134 (0.2856489419937134) | > loss_disc_real_4: 0.29422852396965027 (0.29422852396965027) | > loss_disc_real_5: 0.3144080638885498 (0.3144080638885498) | > loss_0: 2.396301746368408 (2.396301746368408) | > loss_gen: 2.867469310760498 (2.867469310760498) | > loss_kl: 5.176824569702148 (5.176824569702148) | > loss_feat: 6.627589702606201 (6.627589702606201) | > loss_mel: 25.730897903442383 (25.730897903442383) | > loss_duration: 3.3035695552825928 (3.3035695552825928) | > loss_1: 43.70635223388672 (43.70635223388672)  --> STEP: 2 | > loss_disc: 2.9930200576782227 (2.6946609020233154) | > loss_disc_real_0: 0.18605467677116394 (0.1308874413371086) | > loss_disc_real_1: 0.2927829921245575 (0.25605039298534393) | > loss_disc_real_2: 0.2757807672023773 (0.3203286975622177) | > loss_disc_real_3: 0.25941088795661926 (0.2725299149751663) | > loss_disc_real_4: 0.259786456823349 (0.27700749039649963) | > loss_disc_real_5: 0.282077431678772 (0.2982427477836609) | > loss_0: 2.9930200576782227 (2.6946609020233154) | > loss_gen: 1.575688123703003 (2.2215787172317505) | > loss_kl: 5.144635200500488 (5.160729885101318) | > loss_feat: 0.05416066572070122 (3.340875184163451) | > loss_mel: 4.428268909454346 (15.079583406448364) | > loss_duration: 3.1623318195343018 (3.2329506874084473) | > loss_1: 14.365084648132324 (29.03571844100952)  --> STEP: 3 | > loss_disc: 2.387803077697754 (2.5923749605814614) | > loss_disc_real_0: 0.06506969779729843 (0.10894819349050522) | > loss_disc_real_1: 0.18965381383895874 (0.23391819993654886) | > loss_disc_real_2: 0.34953004121780396 (0.33006247878074646) | > loss_disc_real_3: 0.330573171377182 (0.29187766710917157) | > loss_disc_real_4: 0.2947506904602051 (0.2829218904177348) | > loss_disc_real_5: 0.26151376962661743 (0.2859997550646464) | > loss_0: 2.387803077697754 (2.5923749605814614) | > loss_gen: 2.6791388988494873 (2.374098777770996) | > loss_kl: 2.567439556121826 (4.296299775441487) | > loss_feat: 3.995133876800537 (3.55896141504248) | > loss_mel: 21.040952682495117 (17.066706498463947) | > loss_duration: 3.047762393951416 (3.1712212562561035) | > loss_1: 33.33042907714844 (30.467288653055828) --> EVAL PERFORMANCE | > avg_loader_time: 0.008371432622273764 (-0.011226574579874674) | > avg_loss_disc: 2.5923749605814614 (-0.07532159487406442) | > avg_loss_disc_real_0: 0.10894819349050522 (-0.16784706960121792) | > avg_loss_disc_real_1: 0.23391819993654886 (-0.07175579667091372) | > avg_loss_disc_real_2: 0.33006247878074646 (+0.13456199566523233) | > avg_loss_disc_real_3: 0.29187766710917157 (+0.10468183706204098) | > avg_loss_disc_real_4: 0.2829218904177348 (+0.0782419616977374) | > avg_loss_disc_real_5: 0.2859997550646464 (+0.10366868476072949) | > avg_loss_0: 2.5923749605814614 (-0.07532159487406442) | > avg_loss_gen: 2.374098777770996 (+0.29754511515299464) | > avg_loss_kl: 4.296299775441487 (-0.07156046231587787) | > avg_loss_feat: 3.55896141504248 (-2.129416680584351) | > avg_loss_mel: 17.066706498463947 (-4.984482288360596) | > avg_loss_duration: 3.1712212562561035 (+0.06566619873046875) | > avg_loss_1: 30.467288653055828 (-6.822247505187985)  > EPOCH: 918/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:07:06)   --> TIME: 2023-10-20 11:07:17 -- STEP: 9/50 -- GLOBAL_STEP: 98910 | > loss_disc: 2.954418420791626 (2.249972495767805) | > loss_disc_real_0: 0.27770665287971497 (0.17334184298912683) | > loss_disc_real_1: 0.297454297542572 (0.22291787879334557) | > loss_disc_real_2: 0.26600220799446106 (0.21119904476735327) | > loss_disc_real_3: 0.2640385627746582 (0.19688466429296467) | > loss_disc_real_4: 0.2682766616344452 (0.19530478171590301) | > loss_disc_real_5: 0.2695315480232239 (0.17179873026907444) | > loss_0: 2.954418420791626 (2.249972495767805) | > grad_norm_0: tensor(1084.1042, device='cuda:0') (tensor(1261.6901, device='cuda:0')) | > loss_gen: 1.6877562999725342 (2.4267554548051624) | > loss_kl: 0.8254984617233276 (0.8604331082767911) | > loss_feat: 0.1664392352104187 (5.92798924446106) | > loss_mel: 8.532150268554688 (19.466201252407497) | > loss_duration: 1.2821159362792969 (1.3881044652726915) | > loss_1: 12.4939603805542 (30.069484180874294) | > grad_norm_1: tensor(82520.0938, device='cuda:0') (tensor(43169.1758, device='cuda:0')) | > current_lr_0: 7.985879293568091e-05 | > current_lr_1: 7.985879293568091e-05 | > step_time: 0.7885 (0.6090255048539903) | > loader_time: 0.0274 (0.01726494895087348)  --> TIME: 2023-10-20 11:07:37 -- STEP: 39/50 -- GLOBAL_STEP: 98940 | > loss_disc: 2.667698383331299 (2.490690853351201) | > loss_disc_real_0: 0.20441585779190063 (0.15893936852136484) | > loss_disc_real_1: 0.2913872003555298 (0.2292325257872924) | > loss_disc_real_2: 0.1848352551460266 (0.22945230807631445) | > loss_disc_real_3: 0.3444342613220215 (0.23798424628778145) | > loss_disc_real_4: 0.3244798183441162 (0.23106139432638884) | > loss_disc_real_5: 0.5150084495544434 (0.24178261601198942) | > loss_0: 2.667698383331299 (2.490690853351201) | > grad_norm_0: tensor(1594.4031, device='cuda:0') (tensor(822.3052, device='cuda:0')) | > loss_gen: 3.1255059242248535 (2.3174501260121665) | > loss_kl: 0.4703494906425476 (0.9073485006124545) | > loss_feat: 5.0123515129089355 (5.7977307213422575) | > loss_mel: 19.921241760253906 (19.864664554595947) | > loss_duration: 1.4203046560287476 (1.3609504730273516) | > loss_1: 29.949752807617188 (30.248144712203587) | > grad_norm_1: tensor(31643.0703, device='cuda:0') (tensor(30513.7598, device='cuda:0')) | > current_lr_0: 7.985879293568091e-05 | > current_lr_1: 7.985879293568091e-05 | > step_time: 0.5083 (0.6416237721076379) | > loader_time: 0.0274 (0.022053241729736328)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.460771083831787 (2.460771083831787) | > loss_disc_real_0: 0.17758065462112427 (0.17758065462112427) | > loss_disc_real_1: 0.19319012761116028 (0.19319012761116028) | > loss_disc_real_2: 0.22672629356384277 (0.22672629356384277) | > loss_disc_real_3: 0.2419191598892212 (0.2419191598892212) | > loss_disc_real_4: 0.132574200630188 (0.132574200630188) | > loss_disc_real_5: 0.2042776197195053 (0.2042776197195053) | > loss_0: 2.460771083831787 (2.460771083831787) | > loss_gen: 1.8856704235076904 (1.8856704235076904) | > loss_kl: 4.943337917327881 (4.943337917327881) | > loss_feat: 3.2412149906158447 (3.2412149906158447) | > loss_mel: 9.459694862365723 (9.459694862365723) | > loss_duration: 2.91795015335083 (2.91795015335083) | > loss_1: 22.44786834716797 (22.44786834716797)  --> STEP: 1 | > loss_disc: 3.004117488861084 (3.004117488861084) | > loss_disc_real_0: 0.3587183356285095 (0.3587183356285095) | > loss_disc_real_1: 0.2199324369430542 (0.2199324369430542) | > loss_disc_real_2: 0.36302366852760315 (0.36302366852760315) | > loss_disc_real_3: 0.3608577251434326 (0.3608577251434326) | > loss_disc_real_4: 0.5635669827461243 (0.5635669827461243) | > loss_disc_real_5: 0.2785837650299072 (0.2785837650299072) | > loss_0: 3.004117488861084 (3.004117488861084) | > loss_gen: 2.6288082599639893 (2.6288082599639893) | > loss_kl: 4.985847473144531 (4.985847473144531) | > loss_feat: 6.471381187438965 (6.471381187438965) | > loss_mel: 22.85198974609375 (22.85198974609375) | > loss_duration: 3.2671492099761963 (3.2671492099761963) | > loss_1: 40.205177307128906 (40.205177307128906)  --> STEP: 2 | > loss_disc: 3.0509305000305176 (3.027523994445801) | > loss_disc_real_0: 0.35628393292427063 (0.3575011342763901) | > loss_disc_real_1: 0.37239915132522583 (0.29616579413414) | > loss_disc_real_2: 0.37117570638656616 (0.36709968745708466) | > loss_disc_real_3: 0.3488435447216034 (0.354850634932518) | > loss_disc_real_4: 0.3040567934513092 (0.43381188809871674) | > loss_disc_real_5: 0.29229241609573364 (0.28543809056282043) | > loss_0: 3.0509305000305176 (3.027523994445801) | > loss_gen: 2.267522096633911 (2.44816517829895) | > loss_kl: 5.341837406158447 (5.163842439651489) | > loss_feat: 3.007336139678955 (4.73935866355896) | > loss_mel: 26.84743881225586 (24.849714279174805) | > loss_duration: 3.1317732334136963 (3.1994612216949463) | > loss_1: 40.595909118652344 (40.400543212890625)  --> STEP: 3 | > loss_disc: 2.003235340118408 (2.6860944430033364) | > loss_disc_real_0: 0.5356159806251526 (0.4168727497259776) | > loss_disc_real_1: 0.15624020993709564 (0.24952393273512521) | > loss_disc_real_2: 0.20218412578105927 (0.3121278335650762) | > loss_disc_real_3: 0.14398005604743958 (0.2845604419708252) | > loss_disc_real_4: 0.1287972629070282 (0.33214034636815387) | > loss_disc_real_5: 0.12101208418607712 (0.23062942177057266) | > loss_0: 2.003235340118408 (2.6860944430033364) | > loss_gen: 2.9952852725982666 (2.630538543065389) | > loss_kl: 2.4170079231262207 (4.248230934143066) | > loss_feat: 6.531628608703613 (5.336781978607178) | > loss_mel: 23.330469131469727 (24.343299229939777) | > loss_duration: 2.9818553924560547 (3.1269259452819824) | > loss_1: 38.256248474121094 (39.685778299967446) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024155775705973306 (-0.0059558550516764334) | > avg_loss_disc: 2.6860944430033364 (+0.093719482421875) | > avg_loss_disc_real_0: 0.4168727497259776 (+0.3079245562354724) | > avg_loss_disc_real_1: 0.24952393273512521 (+0.015605732798576355) | > avg_loss_disc_real_2: 0.3121278335650762 (-0.017934645215670286) | > avg_loss_disc_real_3: 0.2845604419708252 (-0.007317225138346373) | > avg_loss_disc_real_4: 0.33214034636815387 (+0.04921845595041907) | > avg_loss_disc_real_5: 0.23062942177057266 (-0.05537033329407376) | > avg_loss_0: 2.6860944430033364 (+0.093719482421875) | > avg_loss_gen: 2.630538543065389 (+0.25643976529439305) | > avg_loss_kl: 4.248230934143066 (-0.04806884129842093) | > avg_loss_feat: 5.336781978607178 (+1.7778205635646978) | > avg_loss_mel: 24.343299229939777 (+7.27659273147583) | > avg_loss_duration: 3.1269259452819824 (-0.044295310974121094) | > avg_loss_1: 39.685778299967446 (+9.218489646911618)  > EPOCH: 919/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:07:57)   --> TIME: 2023-10-20 11:08:18 -- STEP: 19/50 -- GLOBAL_STEP: 98970 | > loss_disc: 1.1139662265777588 (2.465713620185852) | > loss_disc_real_0: 0.03552171587944031 (0.17980655125881495) | > loss_disc_real_1: 0.06028358265757561 (0.22312504190363383) | > loss_disc_real_2: 0.08081754297018051 (0.21476214084970324) | > loss_disc_real_3: 0.033309418708086014 (0.2272624485194683) | > loss_disc_real_4: 0.0579167976975441 (0.22019924046961883) | > loss_disc_real_5: 0.04345551133155823 (0.21240601041599325) | > loss_0: 1.1139662265777588 (2.465713620185852) | > grad_norm_0: tensor(213.1536, device='cuda:0') (tensor(627.3486, device='cuda:0')) | > loss_gen: 2.9894886016845703 (2.355930893044723) | > loss_kl: 1.0291165113449097 (0.787237380680285) | > loss_feat: 11.626640319824219 (6.022728798959992) | > loss_mel: 24.2489070892334 (19.814705331074563) | > loss_duration: 1.4803584814071655 (1.3989003896713257) | > loss_1: 41.374507904052734 (30.379502974058454) | > grad_norm_1: tensor(23814.0078, device='cuda:0') (tensor(22370.2949, device='cuda:0')) | > current_lr_0: 7.977896907223392e-05 | > current_lr_1: 7.977896907223392e-05 | > step_time: 0.3448 (0.6134377529746607) | > loader_time: 0.0253 (0.02400374412536621)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.628772258758545 (3.628772258758545) | > loss_disc_real_0: 0.37517985701560974 (0.37517985701560974) | > loss_disc_real_1: 0.18471993505954742 (0.18471993505954742) | > loss_disc_real_2: 0.34204038977622986 (0.34204038977622986) | > loss_disc_real_3: 0.27703437209129333 (0.27703437209129333) | > loss_disc_real_4: 0.366664856672287 (0.366664856672287) | > loss_disc_real_5: 0.2633056938648224 (0.2633056938648224) | > loss_0: 3.628772258758545 (3.628772258758545) | > loss_gen: 1.7053831815719604 (1.7053831815719604) | > loss_kl: 4.675780773162842 (4.675780773162842) | > loss_feat: 6.079690456390381 (6.079690456390381) | > loss_mel: 21.570825576782227 (21.570825576782227) | > loss_duration: 2.803147792816162 (2.803147792816162) | > loss_1: 36.8348274230957 (36.8348274230957)  --> STEP: 1 | > loss_disc: 2.4887824058532715 (2.4887824058532715) | > loss_disc_real_0: 0.11811848729848862 (0.11811848729848862) | > loss_disc_real_1: 0.2531009018421173 (0.2531009018421173) | > loss_disc_real_2: 0.27906763553619385 (0.27906763553619385) | > loss_disc_real_3: 0.2947348952293396 (0.2947348952293396) | > loss_disc_real_4: 0.3440995514392853 (0.3440995514392853) | > loss_disc_real_5: 0.34723925590515137 (0.34723925590515137) | > loss_0: 2.4887824058532715 (2.4887824058532715) | > loss_gen: 2.7472808361053467 (2.7472808361053467) | > loss_kl: 4.923782825469971 (4.923782825469971) | > loss_feat: 8.248393058776855 (8.248393058776855) | > loss_mel: 22.68402862548828 (22.68402862548828) | > loss_duration: 3.195507764816284 (3.195507764816284) | > loss_1: 41.79899215698242 (41.79899215698242)  --> STEP: 2 | > loss_disc: 2.957545518875122 (2.7231639623641968) | > loss_disc_real_0: 0.3061271905899048 (0.2121228389441967) | > loss_disc_real_1: 0.25205132365226746 (0.2525761127471924) | > loss_disc_real_2: 0.24596671760082245 (0.26251717656850815) | > loss_disc_real_3: 0.25081557035446167 (0.27277523279190063) | > loss_disc_real_4: 0.26493003964424133 (0.3045147955417633) | > loss_disc_real_5: 0.2598779499530792 (0.3035586029291153) | > loss_0: 2.957545518875122 (2.7231639623641968) | > loss_gen: 1.6397404670715332 (2.19351065158844) | > loss_kl: 5.690952777862549 (5.30736780166626) | > loss_feat: 0.1390271782875061 (4.193710118532181) | > loss_mel: 9.309194564819336 (15.996611595153809) | > loss_duration: 3.1903834342956543 (3.1929455995559692) | > loss_1: 19.96929931640625 (30.884145736694336)  --> STEP: 3 | > loss_disc: 2.547649383544922 (2.664659102757772) | > loss_disc_real_0: 0.10561724007129669 (0.17662097265323004) | > loss_disc_real_1: 0.1321575790643692 (0.21243660151958466) | > loss_disc_real_2: 0.12347710132598877 (0.21617048482100168) | > loss_disc_real_3: 0.11101435869932175 (0.21885494142770767) | > loss_disc_real_4: 0.11232884973287582 (0.24045281360546747) | > loss_disc_real_5: 0.03814515098929405 (0.21508745228250822) | > loss_0: 2.547649383544922 (2.664659102757772) | > loss_gen: 1.5247772932052612 (1.9705995321273804) | > loss_kl: 2.3477463722229004 (4.32082732518514) | > loss_feat: 6.7624592781066895 (5.04995983839035) | > loss_mel: 24.584430694580078 (18.85921796162923) | > loss_duration: 2.928067922592163 (3.1046530405680337) | > loss_1: 38.14748001098633 (33.305257161458336)  --> TIME: 2023-10-20 11:08:44 -- STEP: 49/50 -- GLOBAL_STEP: 99000 | > loss_disc: 2.5468060970306396 (2.5014771831278897) | > loss_disc_real_0: 0.11305131763219833 (0.17983147040085526) | > loss_disc_real_1: 0.2670716345310211 (0.23420400697053695) | > loss_disc_real_2: 0.09236396104097366 (0.2154435819509078) | > loss_disc_real_3: 0.2608166038990021 (0.24149346298405103) | > loss_disc_real_4: 0.2731610834598541 (0.212569991174173) | > loss_disc_real_5: 0.2612858712673187 (0.2121375222899476) | > loss_0: 2.5468060970306396 (2.5014771831278897) | > grad_norm_0: tensor(856.7726, device='cuda:0') (tensor(673.3196, device='cuda:0')) | > loss_gen: 2.0761961936950684 (2.217392838731104) | > loss_kl: 0.8880161643028259 (0.7529496579450004) | > loss_feat: 1.907523512840271 (5.087667318080002) | > loss_mel: 20.822263717651367 (19.276891060021455) | > loss_duration: 1.4914313554763794 (1.3714819708648993) | > loss_1: 27.18543243408203 (28.706383228302002) | > grad_norm_1: tensor(5106.6909, device='cuda:0') (tensor(17944.1270, device='cuda:0')) | > current_lr_0: 7.977896907223392e-05 | > current_lr_1: 7.977896907223392e-05 | > step_time: 2.1038 (0.6328942532442052) | > loader_time: 5.9554 (0.14232114869721083) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_99000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7694172859191895 (2.690848648548126) | > loss_disc_real_0: 0.3888252377510071 (0.2296720389276743) | > loss_disc_real_1: 0.21964947879314423 (0.21423982083797455) | > loss_disc_real_2: 0.19877971708774567 (0.21182279288768768) | > loss_disc_real_3: 0.18321461975574493 (0.209944861009717) | > loss_disc_real_4: 0.287899911403656 (0.2523145880550146) | > loss_disc_real_5: 0.24996231496334076 (0.22380616795271635) | > loss_0: 2.7694172859191895 (2.690848648548126) | > loss_gen: 2.0321552753448486 (1.9859884679317474) | > loss_kl: 4.538387775421143 (4.375217437744141) | > loss_feat: 3.0918164253234863 (4.560423985123634) | > loss_mel: 14.16508674621582 (17.68568515777588) | > loss_duration: 2.8487629890441895 (3.0406805276870728) | > loss_1: 26.676210403442383 (31.647995471954346)  --> STEP: 1 | > loss_disc: 2.831056594848633 (2.7188902378082274) | > loss_disc_real_0: 0.32088974118232727 (0.2479155793786049) | > loss_disc_real_1: 0.3079565465450287 (0.23298316597938537) | > loss_disc_real_2: 0.2937525808811188 (0.2282087504863739) | > loss_disc_real_3: 0.32592687010765076 (0.23314126282930375) | > loss_disc_real_4: 0.3332044780254364 (0.268492566049099) | > loss_disc_real_5: 0.2848215103149414 (0.23600923642516136) | > loss_0: 2.831056594848633 (2.7188902378082274) | > loss_gen: 2.5950045585632324 (2.1077916860580443) | > loss_kl: 5.081759929656982 (4.516525936126709) | > loss_feat: 5.124001502990723 (4.673139488697052) | > loss_mel: 24.409217834472656 (19.030391693115234) | > loss_duration: 3.2238688468933105 (3.0773181915283203) | > loss_1: 40.43385314941406 (33.40516700744629)  --> STEP: 2 | > loss_disc: 3.066816806793213 (2.776877999305725) | > loss_disc_real_0: 0.4814033508300781 (0.28683020795385045) | > loss_disc_real_1: 0.24981851875782013 (0.2357890581091245) | > loss_disc_real_2: 0.26138028502464294 (0.23373733957608542) | > loss_disc_real_3: 0.25265923142433167 (0.23639425759514174) | > loss_disc_real_4: 0.27710583806037903 (0.26992811138431233) | > loss_disc_real_5: 0.26089370250701904 (0.2401566474388043) | > loss_0: 3.066816806793213 (2.776877999305725) | > loss_gen: 1.7901403903961182 (2.0548498034477234) | > loss_kl: 5.315903186798096 (4.649755477905273) | > loss_feat: 0.0635271668434143 (3.9048707683881125) | > loss_mel: 1.4825642108917236 (16.105753779411316) | > loss_duration: 3.088911294937134 (3.079250375429789) | > loss_1: 11.741045951843262 (29.794480164845783)  --> STEP: 3 | > loss_disc: 2.9352662563323975 (2.799504893166678) | > loss_disc_real_0: 0.45402172207832336 (0.31071470997163225) | > loss_disc_real_1: 0.2568281590938568 (0.23879464396408626) | > loss_disc_real_2: 0.20828698575496674 (0.23010157474449702) | > loss_disc_real_3: 0.2428569197654724 (0.2373174950480461) | > loss_disc_real_4: 0.2764475643634796 (0.27085946180990766) | > loss_disc_real_5: 0.23806047439575195 (0.23985719414693968) | > loss_0: 2.9352662563323975 (2.799504893166678) | > loss_gen: 1.982735514640808 (2.0445477621895924) | > loss_kl: 2.336684226989746 (4.319316727774484) | > loss_feat: 0.9018897414207458 (3.4758734788213457) | > loss_mel: 16.912202835083008 (16.220960787364415) | > loss_duration: 2.9404456615448 (3.0594211305890764) | > loss_1: 25.073955535888672 (29.120119503566197) --> EVAL PERFORMANCE | > avg_loader_time: 0.33650313104901997 (+0.3340875534784226) | > avg_loss_disc: 2.799504893166678 (+0.11341045016334173) | > avg_loss_disc_real_0: 0.31071470997163225 (-0.10615803975434535) | > avg_loss_disc_real_1: 0.23879464396408626 (-0.010729288771038958) | > avg_loss_disc_real_2: 0.23010157474449702 (-0.08202625882057915) | > avg_loss_disc_real_3: 0.2373174950480461 (-0.04724294692277908) | > avg_loss_disc_real_4: 0.27085946180990766 (-0.06128088455824621) | > avg_loss_disc_real_5: 0.23985719414693968 (+0.009227772376367016) | > avg_loss_0: 2.799504893166678 (+0.11341045016334173) | > avg_loss_gen: 2.0445477621895924 (-0.5859907808757967) | > avg_loss_kl: 4.319316727774484 (+0.07108579363141754) | > avg_loss_feat: 3.4758734788213457 (-1.860908499785832) | > avg_loss_mel: 16.220960787364415 (-8.122338442575362) | > avg_loss_duration: 3.0594211305890764 (-0.06750481469290603) | > avg_loss_1: 29.120119503566197 (-10.565658796401248)  > EPOCH: 920/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:08:55)   --> TIME: 2023-10-20 11:09:31 -- STEP: 29/50 -- GLOBAL_STEP: 99030 | > loss_disc: 2.913501739501953 (2.5080637417990586) | > loss_disc_real_0: 0.20282384753227234 (0.18287713229977365) | > loss_disc_real_1: 0.27057844400405884 (0.2238156333051879) | > loss_disc_real_2: 0.26726004481315613 (0.22558685321489286) | > loss_disc_real_3: 0.2708374559879303 (0.21449537189870044) | > loss_disc_real_4: 0.28204160928726196 (0.23162579819046217) | > loss_disc_real_5: 0.2527492344379425 (0.22729424618441482) | > loss_0: 2.913501739501953 (2.5080637417990586) | > grad_norm_0: tensor(351.3974, device='cuda:0') (tensor(761.2885, device='cuda:0')) | > loss_gen: 1.713179111480713 (2.2794463552277673) | > loss_kl: 0.9411489963531494 (0.7951999581579504) | > loss_feat: 0.2675057053565979 (5.435391315740758) | > loss_mel: 16.181692123413086 (20.901371717453003) | > loss_duration: 1.3543328046798706 (1.3622098462334995) | > loss_1: 20.457857131958008 (30.773619125629292) | > grad_norm_1: tensor(9870.7949, device='cuda:0') (tensor(21231.2090, device='cuda:0')) | > current_lr_0: 7.969922499773618e-05 | > current_lr_1: 7.969922499773618e-05 | > step_time: 0.4946 (0.750420463496241) | > loader_time: 0.0373 (0.02551623870586527)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.608950138092041 (2.608950138092041) | > loss_disc_real_0: 0.1618354767560959 (0.1618354767560959) | > loss_disc_real_1: 0.24978092312812805 (0.24978092312812805) | > loss_disc_real_2: 0.24869568645954132 (0.24869568645954132) | > loss_disc_real_3: 0.20798830687999725 (0.20798830687999725) | > loss_disc_real_4: 0.21313884854316711 (0.21313884854316711) | > loss_disc_real_5: 0.16630207002162933 (0.16630207002162933) | > loss_0: 2.608950138092041 (2.608950138092041) | > loss_gen: 1.7013442516326904 (1.7013442516326904) | > loss_kl: 4.584538459777832 (4.584538459777832) | > loss_feat: 1.5194729566574097 (1.5194729566574097) | > loss_mel: 13.866086959838867 (13.866086959838867) | > loss_duration: 2.9131574630737305 (2.9131574630737305) | > loss_1: 24.584598541259766 (24.584598541259766)  --> STEP: 1 | > loss_disc: 2.9900755882263184 (2.9900755882263184) | > loss_disc_real_0: 0.3788696229457855 (0.3788696229457855) | > loss_disc_real_1: 0.300901859998703 (0.300901859998703) | > loss_disc_real_2: 0.3074808418750763 (0.3074808418750763) | > loss_disc_real_3: 0.233134925365448 (0.233134925365448) | > loss_disc_real_4: 0.31968870759010315 (0.31968870759010315) | > loss_disc_real_5: 0.3220584988594055 (0.3220584988594055) | > loss_0: 2.9900755882263184 (2.9900755882263184) | > loss_gen: 2.148862838745117 (2.148862838745117) | > loss_kl: 5.276130676269531 (5.276130676269531) | > loss_feat: 2.5600244998931885 (2.5600244998931885) | > loss_mel: 20.186670303344727 (20.186670303344727) | > loss_duration: 3.4210236072540283 (3.4210236072540283) | > loss_1: 33.59271240234375 (33.59271240234375)  --> STEP: 2 | > loss_disc: 2.9842803478240967 (2.9871779680252075) | > loss_disc_real_0: 0.19620709121227264 (0.2875383570790291) | > loss_disc_real_1: 0.2713119685649872 (0.2861069142818451) | > loss_disc_real_2: 0.2777658700942993 (0.2926233559846878) | > loss_disc_real_3: 0.24209216237068176 (0.23761354386806488) | > loss_disc_real_4: 0.28092265129089355 (0.30030567944049835) | > loss_disc_real_5: 0.2695474624633789 (0.2958029806613922) | > loss_0: 2.9842803478240967 (2.9871779680252075) | > loss_gen: 1.5625805854797363 (1.8557217121124268) | > loss_kl: 5.355752468109131 (5.315941572189331) | > loss_feat: 0.11879096925258636 (1.3394077345728874) | > loss_mel: 3.673640727996826 (11.930155515670776) | > loss_duration: 3.0535967350006104 (3.2373101711273193) | > loss_1: 13.764360427856445 (23.678536415100098)  --> STEP: 3 | > loss_disc: 2.725637435913086 (2.8999977906545005) | > loss_disc_real_0: 0.21909010410308838 (0.2647222727537155) | > loss_disc_real_1: 0.28487345576286316 (0.28569576144218445) | > loss_disc_real_2: 0.16536110639572144 (0.25020260612169903) | > loss_disc_real_3: 0.33866357803344727 (0.271296888589859) | > loss_disc_real_4: 0.2911582589149475 (0.29725653926531476) | > loss_disc_real_5: 0.2937699556350708 (0.2951253056526184) | > loss_0: 2.725637435913086 (2.8999977906545005) | > loss_gen: 2.089639186859131 (1.9336942036946614) | > loss_kl: 2.4451746940612793 (4.3590192794799805) | > loss_feat: 2.32924222946167 (1.6693525662024815) | > loss_mel: 19.837600708007812 (14.565970579783121) | > loss_duration: 2.9767439365386963 (3.1504547595977783) | > loss_1: 29.678401947021484 (25.678491592407227) --> EVAL PERFORMANCE | > avg_loader_time: 0.006807406743367513 (-0.32969572430565247) | > avg_loss_disc: 2.8999977906545005 (+0.10049289748782231) | > avg_loss_disc_real_0: 0.2647222727537155 (-0.04599243721791674) | > avg_loss_disc_real_1: 0.28569576144218445 (+0.04690111747809819) | > avg_loss_disc_real_2: 0.25020260612169903 (+0.02010103137720201) | > avg_loss_disc_real_3: 0.271296888589859 (+0.0339793935418129) | > avg_loss_disc_real_4: 0.29725653926531476 (+0.026397077455407092) | > avg_loss_disc_real_5: 0.2951253056526184 (+0.05526811150567873) | > avg_loss_0: 2.8999977906545005 (+0.10049289748782231) | > avg_loss_gen: 1.9336942036946614 (-0.11085355849493106) | > avg_loss_kl: 4.3590192794799805 (+0.039702551705496525) | > avg_loss_feat: 1.6693525662024815 (-1.8065209126188642) | > avg_loss_mel: 14.565970579783121 (-1.6549902075812941) | > avg_loss_duration: 3.1504547595977783 (+0.09103362900870193) | > avg_loss_1: 25.678491592407227 (-3.441627911158971)  > EPOCH: 921/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:10:03)   --> TIME: 2023-10-20 11:10:14 -- STEP: 9/50 -- GLOBAL_STEP: 99060 | > loss_disc: 2.195185422897339 (2.5117523405287) | > loss_disc_real_0: 0.06400838494300842 (0.15446508137716186) | > loss_disc_real_1: 0.26085910201072693 (0.23877357939879099) | > loss_disc_real_2: 0.2073964923620224 (0.22866038812531364) | > loss_disc_real_3: 0.3496614098548889 (0.24685051209396786) | > loss_disc_real_4: 0.155595064163208 (0.2630756538775232) | > loss_disc_real_5: 0.1389710009098053 (0.2884017394648658) | > loss_0: 2.195185422897339 (2.5117523405287) | > grad_norm_0: tensor(827.7195, device='cuda:0') (tensor(727.0496, device='cuda:0')) | > loss_gen: 2.3746702671051025 (2.2964064677556357) | > loss_kl: 0.5598747134208679 (0.7606347699960073) | > loss_feat: 4.651932239532471 (4.579187644852532) | > loss_mel: 16.721715927124023 (20.973388777838814) | > loss_duration: 1.348184585571289 (1.3517755667368572) | > loss_1: 25.6563777923584 (29.96139356825087) | > grad_norm_1: tensor(25475.9395, device='cuda:0') (tensor(15505.3486, device='cuda:0')) | > current_lr_0: 7.961956063243362e-05 | > current_lr_1: 7.961956063243362e-05 | > step_time: 0.4179 (0.6080920696258545) | > loader_time: 0.0277 (0.016576819949679904)  --> TIME: 2023-10-20 11:10:30 -- STEP: 39/50 -- GLOBAL_STEP: 99090 | > loss_disc: 2.938127279281616 (2.4115454141910257) | > loss_disc_real_0: 0.2526177167892456 (0.1394357320207816) | > loss_disc_real_1: 0.24167203903198242 (0.2324159797758628) | > loss_disc_real_2: 0.2640519440174103 (0.2208645733503195) | > loss_disc_real_3: 0.25878530740737915 (0.2295617465980542) | > loss_disc_real_4: 0.23360513150691986 (0.224312130934917) | > loss_disc_real_5: 0.26549166440963745 (0.23110620156885722) | > loss_0: 2.938127279281616 (2.4115454141910257) | > grad_norm_0: tensor(932.3353, device='cuda:0') (tensor(648.4235, device='cuda:0')) | > loss_gen: 1.6327505111694336 (2.2640591065088906) | > loss_kl: 0.6983264088630676 (0.8021160547549908) | > loss_feat: 0.3662988245487213 (4.974009947134898) | > loss_mel: 15.322696685791016 (20.391785028653267) | > loss_duration: 1.390449047088623 (1.3630099785633576) | > loss_1: 19.4105224609375 (29.794980000226925) | > grad_norm_1: tensor(11489.1230, device='cuda:0') (tensor(19291.7988, device='cuda:0')) | > current_lr_0: 7.961956063243362e-05 | > current_lr_1: 7.961956063243362e-05 | > step_time: 0.8187 (0.5344208754025973) | > loader_time: 0.0276 (0.01620835524338942)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.922245979309082 (2.922245979309082) | > loss_disc_real_0: 0.09378447383642197 (0.09378447383642197) | > loss_disc_real_1: 0.29977044463157654 (0.29977044463157654) | > loss_disc_real_2: 0.30133453011512756 (0.30133453011512756) | > loss_disc_real_3: 0.1989375352859497 (0.1989375352859497) | > loss_disc_real_4: 0.2830365002155304 (0.2830365002155304) | > loss_disc_real_5: 0.23577575385570526 (0.23577575385570526) | > loss_0: 2.922245979309082 (2.922245979309082) | > loss_gen: 1.606005311012268 (1.606005311012268) | > loss_kl: 5.156242847442627 (5.156242847442627) | > loss_feat: 2.2046267986297607 (2.2046267986297607) | > loss_mel: 20.25322723388672 (20.25322723388672) | > loss_duration: 2.8997480869293213 (2.8997480869293213) | > loss_1: 32.119850158691406 (32.119850158691406)  --> STEP: 1 | > loss_disc: 2.306558609008789 (2.306558609008789) | > loss_disc_real_0: 0.19236229360103607 (0.19236229360103607) | > loss_disc_real_1: 0.3386498987674713 (0.3386498987674713) | > loss_disc_real_2: 0.2828802764415741 (0.2828802764415741) | > loss_disc_real_3: 0.27427297830581665 (0.27427297830581665) | > loss_disc_real_4: 0.16425365209579468 (0.16425365209579468) | > loss_disc_real_5: 0.24563254415988922 (0.24563254415988922) | > loss_0: 2.306558609008789 (2.306558609008789) | > loss_gen: 3.1544690132141113 (3.1544690132141113) | > loss_kl: 5.29596471786499 (5.29596471786499) | > loss_feat: 10.549578666687012 (10.549578666687012) | > loss_mel: 24.798479080200195 (24.798479080200195) | > loss_duration: 3.2917261123657227 (3.2917261123657227) | > loss_1: 47.090213775634766 (47.090213775634766)  --> STEP: 2 | > loss_disc: 2.706157684326172 (2.5063581466674805) | > loss_disc_real_0: 0.4191838502883911 (0.3057730719447136) | > loss_disc_real_1: 0.2933877408504486 (0.31601881980895996) | > loss_disc_real_2: 0.22007036209106445 (0.2514753192663193) | > loss_disc_real_3: 0.2706138789653778 (0.27244342863559723) | > loss_disc_real_4: 0.18637435138225555 (0.17531400173902512) | > loss_disc_real_5: 0.2706189751625061 (0.25812575966119766) | > loss_0: 2.706157684326172 (2.5063581466674805) | > loss_gen: 2.3566017150878906 (2.755535364151001) | > loss_kl: 5.555631160736084 (5.425797939300537) | > loss_feat: 3.7529654502868652 (7.1512720584869385) | > loss_mel: 23.79207992553711 (24.295279502868652) | > loss_duration: 3.2056515216827393 (3.248688817024231) | > loss_1: 38.66292953491211 (42.87657165527344)  --> STEP: 3 | > loss_disc: 2.926100730895996 (2.646272341410319) | > loss_disc_real_0: 0.25704020261764526 (0.28952878216902417) | > loss_disc_real_1: 0.3351551294326782 (0.3223975896835327) | > loss_disc_real_2: 0.25178322196006775 (0.2515779534975688) | > loss_disc_real_3: 0.34334811568260193 (0.29607832431793213) | > loss_disc_real_4: 0.3832192122936249 (0.24461573859055838) | > loss_disc_real_5: 0.34222114086151123 (0.2861575533946355) | > loss_0: 2.926100730895996 (2.646272341410319) | > loss_gen: 2.271240234375 (2.5941036542256675) | > loss_kl: 2.37341046333313 (4.408335447311401) | > loss_feat: 3.624401569366455 (5.975648562113444) | > loss_mel: 17.72722625732422 (22.105928421020508) | > loss_duration: 2.975449800491333 (3.157609144846598) | > loss_1: 28.971729278564453 (38.241624196370445) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026460488637288413 (-0.004161357879638672) | > avg_loss_disc: 2.646272341410319 (-0.2537254492441816) | > avg_loss_disc_real_0: 0.28952878216902417 (+0.024806509415308653) | > avg_loss_disc_real_1: 0.3223975896835327 (+0.03670182824134827) | > avg_loss_disc_real_2: 0.2515779534975688 (+0.001375347375869751) | > avg_loss_disc_real_3: 0.29607832431793213 (+0.02478143572807312) | > avg_loss_disc_real_4: 0.24461573859055838 (-0.05264080067475638) | > avg_loss_disc_real_5: 0.2861575533946355 (-0.008967752257982908) | > avg_loss_0: 2.646272341410319 (-0.2537254492441816) | > avg_loss_gen: 2.5941036542256675 (+0.6604094505310061) | > avg_loss_kl: 4.408335447311401 (+0.0493161678314209) | > avg_loss_feat: 5.975648562113444 (+4.306295995910963) | > avg_loss_mel: 22.105928421020508 (+7.539957841237387) | > avg_loss_duration: 3.157609144846598 (+0.007154385248819839) | > avg_loss_1: 38.241624196370445 (+12.563132603963219)  > EPOCH: 922/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:10:55)   --> TIME: 2023-10-20 11:11:12 -- STEP: 19/50 -- GLOBAL_STEP: 99120 | > loss_disc: 2.9467053413391113 (2.5134898800598946) | > loss_disc_real_0: 0.11939550191164017 (0.16136752059193035) | > loss_disc_real_1: 0.25183671712875366 (0.23031086239375567) | > loss_disc_real_2: 0.24294020235538483 (0.2166753883816694) | > loss_disc_real_3: 0.22525490820407867 (0.24604576875112558) | > loss_disc_real_4: 0.24148397147655487 (0.23002785150157778) | > loss_disc_real_5: 0.26082807779312134 (0.22083671645898567) | > loss_0: 2.9467053413391113 (2.5134898800598946) | > grad_norm_0: tensor(2394.7231, device='cuda:0') (tensor(746.1393, device='cuda:0')) | > loss_gen: 1.482752799987793 (2.1841367169430383) | > loss_kl: 0.9788377285003662 (0.8305409346756182) | > loss_feat: 0.3186571002006531 (5.021753773387325) | > loss_mel: 2.569056749343872 (17.907867836324794) | > loss_duration: 1.5081762075424194 (1.4045302930631136) | > loss_1: 6.857480525970459 (27.34882944508603) | > grad_norm_1: tensor(14091.9883, device='cuda:0') (tensor(30897.5723, device='cuda:0')) | > current_lr_0: 7.953997589665193e-05 | > current_lr_1: 7.953997589665193e-05 | > step_time: 0.417 (0.6111193330664384) | > loader_time: 0.0136 (0.023449458573993883)  --> TIME: 2023-10-20 11:11:33 -- STEP: 49/50 -- GLOBAL_STEP: 99150 | > loss_disc: 2.34443736076355 (2.451656353716948) | > loss_disc_real_0: 0.12147314846515656 (0.14511369662929555) | > loss_disc_real_1: 0.2154923528432846 (0.2244971864381615) | > loss_disc_real_2: 0.2278507947921753 (0.22740105972910413) | > loss_disc_real_3: 0.238804891705513 (0.2379979625420303) | > loss_disc_real_4: 0.32115229964256287 (0.22727770700442548) | > loss_disc_real_5: 0.24290552735328674 (0.22214732167063928) | > loss_0: 2.34443736076355 (2.451656353716948) | > grad_norm_0: tensor(378.6810, device='cuda:0') (tensor(708.6003, device='cuda:0')) | > loss_gen: 2.6486947536468506 (2.2915958968960517) | > loss_kl: 0.42123138904571533 (0.759576608331836) | > loss_feat: 5.772068500518799 (5.316925471952678) | > loss_mel: 26.239437103271484 (19.485416150822928) | > loss_duration: 1.4956283569335938 (1.3685051081131916) | > loss_1: 36.577056884765625 (29.222019088511566) | > grad_norm_1: tensor(11386.8369, device='cuda:0') (tensor(25525.4824, device='cuda:0')) | > current_lr_0: 7.953997589665193e-05 | > current_lr_1: 7.953997589665193e-05 | > step_time: 0.6324 (0.6400072671929184) | > loader_time: 0.4728 (0.033570995136183134)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4157867431640625 (3.4157867431640625) | > loss_disc_real_0: 0.897860050201416 (0.897860050201416) | > loss_disc_real_1: 0.3653760552406311 (0.3653760552406311) | > loss_disc_real_2: 0.38716036081314087 (0.38716036081314087) | > loss_disc_real_3: 0.3639404773712158 (0.3639404773712158) | > loss_disc_real_4: 0.3334557116031647 (0.3334557116031647) | > loss_disc_real_5: 0.35731783509254456 (0.35731783509254456) | > loss_0: 3.4157867431640625 (3.4157867431640625) | > loss_gen: 3.0224740505218506 (3.0224740505218506) | > loss_kl: 5.0041093826293945 (5.0041093826293945) | > loss_feat: 3.9632465839385986 (3.9632465839385986) | > loss_mel: 19.77471351623535 (19.77471351623535) | > loss_duration: 2.9505465030670166 (2.9505465030670166) | > loss_1: 34.715091705322266 (34.715091705322266)  --> STEP: 1 | > loss_disc: 2.476767063140869 (2.476767063140869) | > loss_disc_real_0: 0.30572909116744995 (0.30572909116744995) | > loss_disc_real_1: 0.313567578792572 (0.313567578792572) | > loss_disc_real_2: 0.30074837803840637 (0.30074837803840637) | > loss_disc_real_3: 0.18820445239543915 (0.18820445239543915) | > loss_disc_real_4: 0.23008224368095398 (0.23008224368095398) | > loss_disc_real_5: 0.352817177772522 (0.352817177772522) | > loss_0: 2.476767063140869 (2.476767063140869) | > loss_gen: 2.817089796066284 (2.817089796066284) | > loss_kl: 5.3414740562438965 (5.3414740562438965) | > loss_feat: 5.11006498336792 (5.11006498336792) | > loss_mel: 21.979686737060547 (21.979686737060547) | > loss_duration: 3.22515606880188 (3.22515606880188) | > loss_1: 38.47346878051758 (38.47346878051758)  --> STEP: 2 | > loss_disc: 3.1976046562194824 (2.837185859680176) | > loss_disc_real_0: 0.44394832849502563 (0.3748387098312378) | > loss_disc_real_1: 0.24980562925338745 (0.28168660402297974) | > loss_disc_real_2: 0.2093164473772049 (0.25503241270780563) | > loss_disc_real_3: 0.3104047477245331 (0.24930460005998611) | > loss_disc_real_4: 0.2832411527633667 (0.25666169822216034) | > loss_disc_real_5: 0.31986498832702637 (0.33634108304977417) | > loss_0: 3.1976046562194824 (2.837185859680176) | > loss_gen: 1.7155485153198242 (2.266319155693054) | > loss_kl: 5.667682647705078 (5.504578351974487) | > loss_feat: 2.7082231044769287 (3.9091440439224243) | > loss_mel: 13.284213066101074 (17.63194990158081) | > loss_duration: 3.246990203857422 (3.236073136329651) | > loss_1: 26.622657775878906 (32.54806327819824)  --> STEP: 3 | > loss_disc: 2.8782315254211426 (2.850867748260498) | > loss_disc_real_0: 0.2720743715763092 (0.3405839304129283) | > loss_disc_real_1: 0.2894919216632843 (0.2842883765697479) | > loss_disc_real_2: 0.27853238582611084 (0.26286573708057404) | > loss_disc_real_3: 0.30550000071525574 (0.2680364002784093) | > loss_disc_real_4: 0.28299108147621155 (0.26543815930684406) | > loss_disc_real_5: 0.26447737216949463 (0.31238651275634766) | > loss_0: 2.8782315254211426 (2.850867748260498) | > loss_gen: 1.9242868423461914 (2.152308384577433) | > loss_kl: 2.5046026706695557 (4.504586458206177) | > loss_feat: 0.5644965767860413 (2.794261554876963) | > loss_mel: 16.588010787963867 (17.28397019704183) | > loss_duration: 2.9094676971435547 (3.127204656600952) | > loss_1: 24.49086570739746 (29.86233075459798) --> EVAL PERFORMANCE | > avg_loader_time: 0.011168162027994791 (+0.00852211316426595) | > avg_loss_disc: 2.850867748260498 (+0.20459540685017918) | > avg_loss_disc_real_0: 0.3405839304129283 (+0.051055148243904114) | > avg_loss_disc_real_1: 0.2842883765697479 (-0.03810921311378479) | > avg_loss_disc_real_2: 0.26286573708057404 (+0.01128778358300525) | > avg_loss_disc_real_3: 0.2680364002784093 (-0.028041924039522825) | > avg_loss_disc_real_4: 0.26543815930684406 (+0.020822420716285678) | > avg_loss_disc_real_5: 0.31238651275634766 (+0.026228959361712156) | > avg_loss_0: 2.850867748260498 (+0.20459540685017918) | > avg_loss_gen: 2.152308384577433 (-0.44179526964823435) | > avg_loss_kl: 4.504586458206177 (+0.09625101089477539) | > avg_loss_feat: 2.794261554876963 (-3.181387007236481) | > avg_loss_mel: 17.28397019704183 (-4.82195822397868) | > avg_loss_duration: 3.127204656600952 (-0.03040448824564601) | > avg_loss_1: 29.86233075459798 (-8.379293441772464)  > EPOCH: 923/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:11:49)   --> TIME: 2023-10-20 11:12:09 -- STEP: 29/50 -- GLOBAL_STEP: 99180 | > loss_disc: 2.656785249710083 (2.546344294630248) | > loss_disc_real_0: 0.13464926183223724 (0.17494330189094462) | > loss_disc_real_1: 0.26250988245010376 (0.22900009527802467) | > loss_disc_real_2: 0.21892887353897095 (0.23255810218638387) | > loss_disc_real_3: 0.29035040736198425 (0.2504723481191643) | > loss_disc_real_4: 0.2620556056499481 (0.2638016424366627) | > loss_disc_real_5: 0.3170819878578186 (0.25282502017016045) | > loss_0: 2.656785249710083 (2.546344294630248) | > grad_norm_0: tensor(325.1295, device='cuda:0') (tensor(600.5403, device='cuda:0')) | > loss_gen: 2.051107406616211 (2.276078063866188) | > loss_kl: 0.5783460140228271 (0.848132109847562) | > loss_feat: 3.3372628688812256 (5.178669952626885) | > loss_mel: 18.968015670776367 (19.339035025958356) | > loss_duration: 1.353546142578125 (1.35602134260638) | > loss_1: 26.288278579711914 (28.997936478976545) | > grad_norm_1: tensor(4117.9551, device='cuda:0') (tensor(15382.2588, device='cuda:0')) | > current_lr_0: 7.946047071079635e-05 | > current_lr_1: 7.946047071079635e-05 | > step_time: 0.247 (0.4925591452368372) | > loader_time: 0.0036 (0.014510886422519026)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0244035720825195 (3.0244035720825195) | > loss_disc_real_0: 0.2756325602531433 (0.2756325602531433) | > loss_disc_real_1: 0.24908480048179626 (0.24908480048179626) | > loss_disc_real_2: 0.22822345793247223 (0.22822345793247223) | > loss_disc_real_3: 0.27849093079566956 (0.27849093079566956) | > loss_disc_real_4: 0.2758290469646454 (0.2758290469646454) | > loss_disc_real_5: 0.2941763997077942 (0.2941763997077942) | > loss_0: 3.0244035720825195 (3.0244035720825195) | > loss_gen: 1.5865412950515747 (1.5865412950515747) | > loss_kl: 5.582669734954834 (5.582669734954834) | > loss_feat: 0.07510145753622055 (0.07510145753622055) | > loss_mel: 1.5727895498275757 (1.5727895498275757) | > loss_duration: 3.1376466751098633 (3.1376466751098633) | > loss_1: 11.95474910736084 (11.95474910736084)  --> STEP: 1 | > loss_disc: 2.7470614910125732 (2.7470614910125732) | > loss_disc_real_0: 0.32253915071487427 (0.32253915071487427) | > loss_disc_real_1: 0.2932184636592865 (0.2932184636592865) | > loss_disc_real_2: 0.2609623670578003 (0.2609623670578003) | > loss_disc_real_3: 0.28535112738609314 (0.28535112738609314) | > loss_disc_real_4: 0.33567512035369873 (0.33567512035369873) | > loss_disc_real_5: 0.3237277567386627 (0.3237277567386627) | > loss_0: 2.7470614910125732 (2.7470614910125732) | > loss_gen: 2.8966240882873535 (2.8966240882873535) | > loss_kl: 5.819427490234375 (5.819427490234375) | > loss_feat: 7.874703407287598 (7.874703407287598) | > loss_mel: 25.817331314086914 (25.817331314086914) | > loss_duration: 3.3267881870269775 (3.3267881870269775) | > loss_1: 45.73487854003906 (45.73487854003906)  --> STEP: 2 | > loss_disc: 3.0254645347595215 (2.8862630128860474) | > loss_disc_real_0: 0.27786725759506226 (0.30020320415496826) | > loss_disc_real_1: 0.24907678365707397 (0.27114762365818024) | > loss_disc_real_2: 0.22822938859462738 (0.24459587782621384) | > loss_disc_real_3: 0.2784850001335144 (0.28191806375980377) | > loss_disc_real_4: 0.2758326828479767 (0.3057539016008377) | > loss_disc_real_5: 0.2941848635673523 (0.3089563101530075) | > loss_0: 3.0254645347595215 (2.8862630128860474) | > loss_gen: 1.5878396034240723 (2.242231845855713) | > loss_kl: 5.305695533752441 (5.562561511993408) | > loss_feat: 0.07470950484275818 (3.974706456065178) | > loss_mel: 1.5961120128631592 (13.706721663475037) | > loss_duration: 3.1677606105804443 (3.247274398803711) | > loss_1: 11.73211669921875 (28.733497619628906)  --> STEP: 3 | > loss_disc: 2.8847641944885254 (2.88576340675354) | > loss_disc_real_0: 0.2861764430999756 (0.2955276171366374) | > loss_disc_real_1: 0.250732958316803 (0.2643427352110545) | > loss_disc_real_2: 0.23835565149784088 (0.24251580238342285) | > loss_disc_real_3: 0.28552085161209106 (0.28311899304389954) | > loss_disc_real_4: 0.26998841762542725 (0.29383207360903424) | > loss_disc_real_5: 0.2880731225013733 (0.30199524760246277) | > loss_0: 2.8847641944885254 (2.88576340675354) | > loss_gen: 1.832433819770813 (2.105632503827413) | > loss_kl: 2.3195722103118896 (4.481565078099568) | > loss_feat: 0.6331855058670044 (2.8608661393324533) | > loss_mel: 15.852991104125977 (14.422144810358683) | > loss_duration: 2.99678635597229 (3.163778384526571) | > loss_1: 23.634967803955078 (27.033987681070965) --> EVAL PERFORMANCE | > avg_loader_time: 0.011994759241739908 (+0.0008265972137451172) | > avg_loss_disc: 2.88576340675354 (+0.03489565849304199) | > avg_loss_disc_real_0: 0.2955276171366374 (-0.045056313276290894) | > avg_loss_disc_real_1: 0.2643427352110545 (-0.019945641358693422) | > avg_loss_disc_real_2: 0.24251580238342285 (-0.020349934697151184) | > avg_loss_disc_real_3: 0.28311899304389954 (+0.015082592765490233) | > avg_loss_disc_real_4: 0.29383207360903424 (+0.028393914302190182) | > avg_loss_disc_real_5: 0.30199524760246277 (-0.010391265153884888) | > avg_loss_0: 2.88576340675354 (+0.03489565849304199) | > avg_loss_gen: 2.105632503827413 (-0.04667588075002005) | > avg_loss_kl: 4.481565078099568 (-0.02302138010660837) | > avg_loss_feat: 2.8608661393324533 (+0.06660458445549011) | > avg_loss_mel: 14.422144810358683 (-2.8618253866831456) | > avg_loss_duration: 3.163778384526571 (+0.03657372792561864) | > avg_loss_1: 27.033987681070965 (-2.828343073527016)  > EPOCH: 924/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:12:31)   --> TIME: 2023-10-20 11:12:44 -- STEP: 9/50 -- GLOBAL_STEP: 99210 | > loss_disc: 2.4690639972686768 (2.252900388505724) | > loss_disc_real_0: 0.1915162056684494 (0.2072387913035022) | > loss_disc_real_1: 0.20968389511108398 (0.22199118634064993) | > loss_disc_real_2: 0.2573016881942749 (0.22002524220281178) | > loss_disc_real_3: 0.22532771527767181 (0.22377312100595897) | > loss_disc_real_4: 0.20363588631153107 (0.20852521020505163) | > loss_disc_real_5: 0.2636341452598572 (0.20803471139839125) | > loss_0: 2.4690639972686768 (2.252900388505724) | > grad_norm_0: tensor(468.4347, device='cuda:0') (tensor(391.7367, device='cuda:0')) | > loss_gen: 2.0884294509887695 (2.549424065483941) | > loss_kl: 0.5784386396408081 (0.6183121204376221) | > loss_feat: 4.16970682144165 (7.190302219655779) | > loss_mel: 24.266393661499023 (20.218244592348736) | > loss_duration: 1.3230557441711426 (1.3613359928131104) | > loss_1: 32.426025390625 (31.93761936823527) | > grad_norm_1: tensor(16397.2559, device='cuda:0') (tensor(17102.4004, device='cuda:0')) | > current_lr_0: 7.938104499535182e-05 | > current_lr_1: 7.938104499535182e-05 | > step_time: 0.8005 (0.6490505006578233) | > loader_time: 0.0064 (0.01738066143459744)  --> TIME: 2023-10-20 11:13:03 -- STEP: 39/50 -- GLOBAL_STEP: 99240 | > loss_disc: 2.811483144760132 (2.485005513215676) | > loss_disc_real_0: 0.17971742153167725 (0.17177021044951218) | > loss_disc_real_1: 0.23077954351902008 (0.2247735292483599) | > loss_disc_real_2: 0.252348929643631 (0.2242850847542286) | > loss_disc_real_3: 0.2651931941509247 (0.23662335865008524) | > loss_disc_real_4: 0.26279959082603455 (0.2179600200496423) | > loss_disc_real_5: 0.2607104182243347 (0.24080434150826663) | > loss_0: 2.811483144760132 (2.485005513215676) | > grad_norm_0: tensor(443.7469, device='cuda:0') (tensor(668.8674, device='cuda:0')) | > loss_gen: 1.7790416479110718 (2.2694567166841946) | > loss_kl: 0.5354551076889038 (0.7773790403436391) | > loss_feat: 1.1219350099563599 (5.415362574733221) | > loss_mel: 14.89734935760498 (20.873130893095947) | > loss_duration: 1.45619797706604 (1.358513871828715) | > loss_1: 19.78997802734375 (30.6938431201837) | > grad_norm_1: tensor(13220.2559, device='cuda:0') (tensor(16017.5420, device='cuda:0')) | > current_lr_0: 7.938104499535182e-05 | > current_lr_1: 7.938104499535182e-05 | > step_time: 0.3613 (0.6159890064826379) | > loader_time: 0.0063 (0.022537103066077598)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.608245849609375 (1.608245849609375) | > loss_disc_real_0: 0.03017096035182476 (0.03017096035182476) | > loss_disc_real_1: 0.2510083317756653 (0.2510083317756653) | > loss_disc_real_2: 0.14298436045646667 (0.14298436045646667) | > loss_disc_real_3: 0.32572588324546814 (0.32572588324546814) | > loss_disc_real_4: 0.11422283947467804 (0.11422283947467804) | > loss_disc_real_5: 0.12958300113677979 (0.12958300113677979) | > loss_0: 1.608245849609375 (1.608245849609375) | > loss_gen: 3.1931798458099365 (3.1931798458099365) | > loss_kl: 5.035617828369141 (5.035617828369141) | > loss_feat: 8.50898265838623 (8.50898265838623) | > loss_mel: 21.415889739990234 (21.415889739990234) | > loss_duration: 2.9806437492370605 (2.9806437492370605) | > loss_1: 41.134315490722656 (41.134315490722656)  --> STEP: 1 | > loss_disc: 3.0166525840759277 (3.0166525840759277) | > loss_disc_real_0: 0.3088564872741699 (0.3088564872741699) | > loss_disc_real_1: 0.21271410584449768 (0.21271410584449768) | > loss_disc_real_2: 0.2562730312347412 (0.2562730312347412) | > loss_disc_real_3: 0.18882137537002563 (0.18882137537002563) | > loss_disc_real_4: 0.21104419231414795 (0.21104419231414795) | > loss_disc_real_5: 0.23027481138706207 (0.23027481138706207) | > loss_0: 3.0166525840759277 (3.0166525840759277) | > loss_gen: 1.571083426475525 (1.571083426475525) | > loss_kl: 5.3385515213012695 (5.3385515213012695) | > loss_feat: 3.3367888927459717 (3.3367888927459717) | > loss_mel: 21.771408081054688 (21.771408081054688) | > loss_duration: 3.30023455619812 (3.30023455619812) | > loss_1: 35.31806945800781 (35.31806945800781)  --> STEP: 2 | > loss_disc: 3.031719207763672 (3.0241858959198) | > loss_disc_real_0: 0.0604991689324379 (0.1846778281033039) | > loss_disc_real_1: 0.22898858785629272 (0.2208513468503952) | > loss_disc_real_2: 0.25012847781181335 (0.2532007545232773) | > loss_disc_real_3: 0.24079975485801697 (0.2148105651140213) | > loss_disc_real_4: 0.44564300775527954 (0.32834360003471375) | > loss_disc_real_5: 0.3494599759578705 (0.2898673936724663) | > loss_0: 3.031719207763672 (3.0241858959198) | > loss_gen: 1.7772449254989624 (1.6741641759872437) | > loss_kl: 6.105040073394775 (5.7217957973480225) | > loss_feat: 5.984797477722168 (4.66079318523407) | > loss_mel: 21.937286376953125 (21.854347229003906) | > loss_duration: 3.2074134349823 (3.25382399559021) | > loss_1: 39.01177978515625 (37.16492462158203)  --> STEP: 3 | > loss_disc: 2.705489158630371 (2.9179536501566568) | > loss_disc_real_0: 0.15243133902549744 (0.17392899841070175) | > loss_disc_real_1: 0.3649188280105591 (0.26887384057044983) | > loss_disc_real_2: 0.24352708458900452 (0.24997619787851968) | > loss_disc_real_3: 0.32575932145118713 (0.2517934838930766) | > loss_disc_real_4: 0.24681374430656433 (0.30116698145866394) | > loss_disc_real_5: 0.42329302430152893 (0.3343426038821538) | > loss_0: 2.705489158630371 (2.9179536501566568) | > loss_gen: 2.3795857429504395 (1.9093046983083088) | > loss_kl: 2.381847381591797 (4.608479658762614) | > loss_feat: 5.499936103820801 (4.9405074914296465) | > loss_mel: 22.957027435302734 (22.221907297770183) | > loss_duration: 2.8836522102355957 (3.1304334004720054) | > loss_1: 36.102046966552734 (36.8106320699056) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027771790822347007 (-0.009217580159505207) | > avg_loss_disc: 2.9179536501566568 (+0.032190243403116714) | > avg_loss_disc_real_0: 0.17392899841070175 (-0.12159861872593564) | > avg_loss_disc_real_1: 0.26887384057044983 (+0.0045311053593953265) | > avg_loss_disc_real_2: 0.24997619787851968 (+0.007460395495096833) | > avg_loss_disc_real_3: 0.2517934838930766 (-0.03132550915082294) | > avg_loss_disc_real_4: 0.30116698145866394 (+0.0073349078496297015) | > avg_loss_disc_real_5: 0.3343426038821538 (+0.03234735627969104) | > avg_loss_0: 2.9179536501566568 (+0.032190243403116714) | > avg_loss_gen: 1.9093046983083088 (-0.19632780551910423) | > avg_loss_kl: 4.608479658762614 (+0.12691458066304584) | > avg_loss_feat: 4.9405074914296465 (+2.0796413520971933) | > avg_loss_mel: 22.221907297770183 (+7.799762487411501) | > avg_loss_duration: 3.1304334004720054 (-0.03334498405456543) | > avg_loss_1: 36.8106320699056 (+9.776644388834637)  > EPOCH: 925/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:13:26)   --> TIME: 2023-10-20 11:13:45 -- STEP: 19/50 -- GLOBAL_STEP: 99270 | > loss_disc: 2.6975247859954834 (2.3832555256391825) | > loss_disc_real_0: 0.09483116865158081 (0.15747008600125187) | > loss_disc_real_1: 0.27628862857818604 (0.2245243340730667) | > loss_disc_real_2: 0.2892986536026001 (0.22203614817638145) | > loss_disc_real_3: 0.36299702525138855 (0.24875953205321966) | > loss_disc_real_4: 0.3187607526779175 (0.23927351636321922) | > loss_disc_real_5: 0.37775924801826477 (0.24331904727181322) | > loss_0: 2.6975247859954834 (2.3832555256391825) | > grad_norm_0: tensor(601.3932, device='cuda:0') (tensor(590.7623, device='cuda:0')) | > loss_gen: 2.424966335296631 (2.4563237240439966) | > loss_kl: 0.9882996678352356 (0.7547443842417315) | > loss_feat: 3.934558868408203 (4.9585499825250166) | > loss_mel: 22.333467483520508 (18.294314240154467) | > loss_duration: 1.4733998775482178 (1.406761696464137) | > loss_1: 31.154693603515625 (27.870693658527575) | > grad_norm_1: tensor(3599.8533, device='cuda:0') (tensor(28323.6348, device='cuda:0')) | > current_lr_0: 7.930169867088268e-05 | > current_lr_1: 7.930169867088268e-05 | > step_time: 0.5534 (0.5906608983090049) | > loader_time: 0.0261 (0.020159482955932617)  --> TIME: 2023-10-20 11:14:04 -- STEP: 49/50 -- GLOBAL_STEP: 99300 | > loss_disc: 2.883756637573242 (2.434898439718752) | > loss_disc_real_0: 0.050497159361839294 (0.14315610131895048) | > loss_disc_real_1: 0.20858365297317505 (0.22916422495428396) | > loss_disc_real_2: 0.19839565455913544 (0.2202587615014339) | > loss_disc_real_3: 0.14376454055309296 (0.23988064682605315) | > loss_disc_real_4: 0.46819832921028137 (0.22210741909791012) | > loss_disc_real_5: 0.4058390259742737 (0.22340046475660436) | > loss_0: 2.883756637573242 (2.434898439718752) | > grad_norm_0: tensor(978.8781, device='cuda:0') (tensor(666.7692, device='cuda:0')) | > loss_gen: 2.0290918350219727 (2.288668503566664) | > loss_kl: 0.7275698781013489 (0.756815530359745) | > loss_feat: 4.931631088256836 (4.7126399168782696) | > loss_mel: 24.01291275024414 (19.119436237276815) | > loss_duration: 1.5171700716018677 (1.3746423234744944) | > loss_1: 33.21837615966797 (28.25220252056511) | > grad_norm_1: tensor(15733.6396, device='cuda:0') (tensor(18430.0547, device='cuda:0')) | > current_lr_0: 7.930169867088268e-05 | > current_lr_1: 7.930169867088268e-05 | > step_time: 0.569 (0.5779391259563214) | > loader_time: 0.5305 (0.02868905359384965)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.941209077835083 (2.941209077835083) | > loss_disc_real_0: 0.37930238246917725 (0.37930238246917725) | > loss_disc_real_1: 0.29135993123054504 (0.29135993123054504) | > loss_disc_real_2: 0.2764418125152588 (0.2764418125152588) | > loss_disc_real_3: 0.25162363052368164 (0.25162363052368164) | > loss_disc_real_4: 0.29413747787475586 (0.29413747787475586) | > loss_disc_real_5: 0.2235005795955658 (0.2235005795955658) | > loss_0: 2.941209077835083 (2.941209077835083) | > loss_gen: 1.9183624982833862 (1.9183624982833862) | > loss_kl: 5.055675506591797 (5.055675506591797) | > loss_feat: 0.34721577167510986 (0.34721577167510986) | > loss_mel: 13.590086936950684 (13.590086936950684) | > loss_duration: 2.9142074584960938 (2.9142074584960938) | > loss_1: 23.825546264648438 (23.825546264648438)  --> STEP: 1 | > loss_disc: 3.2345023155212402 (3.2345023155212402) | > loss_disc_real_0: 0.3430042564868927 (0.3430042564868927) | > loss_disc_real_1: 0.3294049799442291 (0.3294049799442291) | > loss_disc_real_2: 0.38965025544166565 (0.38965025544166565) | > loss_disc_real_3: 0.19437485933303833 (0.19437485933303833) | > loss_disc_real_4: 0.30406472086906433 (0.30406472086906433) | > loss_disc_real_5: 0.32853031158447266 (0.32853031158447266) | > loss_0: 3.2345023155212402 (3.2345023155212402) | > loss_gen: 1.8504555225372314 (1.8504555225372314) | > loss_kl: 5.322007656097412 (5.322007656097412) | > loss_feat: 5.631197929382324 (5.631197929382324) | > loss_mel: 23.794116973876953 (23.794116973876953) | > loss_duration: 3.3282926082611084 (3.3282926082611084) | > loss_1: 39.92607116699219 (39.92607116699219)  --> STEP: 2 | > loss_disc: 2.4823901653289795 (2.85844624042511) | > loss_disc_real_0: 0.20618852972984314 (0.2745963931083679) | > loss_disc_real_1: 0.25948408246040344 (0.2944445312023163) | > loss_disc_real_2: 0.27753719687461853 (0.3335937261581421) | > loss_disc_real_3: 0.18705472350120544 (0.1907147914171219) | > loss_disc_real_4: 0.10434867441654205 (0.2042066976428032) | > loss_disc_real_5: 0.11322196573019028 (0.22087613865733147) | > loss_0: 2.4823901653289795 (2.85844624042511) | > loss_gen: 2.015901803970337 (1.9331786632537842) | > loss_kl: 5.608157157897949 (5.465082406997681) | > loss_feat: 5.0244550704956055 (5.327826499938965) | > loss_mel: 22.929418563842773 (23.361767768859863) | > loss_duration: 3.139244318008423 (3.2337684631347656) | > loss_1: 38.71717834472656 (39.321624755859375)  --> STEP: 3 | > loss_disc: 2.7980172634124756 (2.838303248087565) | > loss_disc_real_0: 0.24807168543338776 (0.2657548238833745) | > loss_disc_real_1: 0.23833197355270386 (0.2757403453191121) | > loss_disc_real_2: 0.14773982763290405 (0.27164242664972943) | > loss_disc_real_3: 0.28040120005607605 (0.22061026096343994) | > loss_disc_real_4: 0.2882494330406189 (0.23222094277540842) | > loss_disc_real_5: 0.2689827084541321 (0.23691166192293167) | > loss_0: 2.7980172634124756 (2.838303248087565) | > loss_gen: 1.778436303138733 (1.881597876548767) | > loss_kl: 2.759173631668091 (4.56311281522115) | > loss_feat: 2.428515911102295 (4.361389636993408) | > loss_mel: 20.860248565673828 (22.52792803446452) | > loss_duration: 3.005983352661133 (3.157840092976888) | > loss_1: 30.832359313964844 (36.491869608561196) --> EVAL PERFORMANCE | > avg_loader_time: 0.016809384028116863 (+0.014032204945882162) | > avg_loss_disc: 2.838303248087565 (-0.0796504020690918) | > avg_loss_disc_real_0: 0.2657548238833745 (+0.09182582547267276) | > avg_loss_disc_real_1: 0.2757403453191121 (+0.006866504748662294) | > avg_loss_disc_real_2: 0.27164242664972943 (+0.021666228771209745) | > avg_loss_disc_real_3: 0.22061026096343994 (-0.031183222929636656) | > avg_loss_disc_real_4: 0.23222094277540842 (-0.06894603868325552) | > avg_loss_disc_real_5: 0.23691166192293167 (-0.09743094195922214) | > avg_loss_0: 2.838303248087565 (-0.0796504020690918) | > avg_loss_gen: 1.881597876548767 (-0.027706821759541755) | > avg_loss_kl: 4.56311281522115 (-0.04536684354146381) | > avg_loss_feat: 4.361389636993408 (-0.5791178544362383) | > avg_loss_mel: 22.52792803446452 (+0.30602073669433594) | > avg_loss_duration: 3.157840092976888 (+0.027406692504882812) | > avg_loss_1: 36.491869608561196 (-0.3187624613444058)  > EPOCH: 926/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:14:19)   --> TIME: 2023-10-20 11:14:41 -- STEP: 29/50 -- GLOBAL_STEP: 99330 | > loss_disc: 1.9089140892028809 (2.4031765666501275) | > loss_disc_real_0: 0.058909885585308075 (0.1297828471288085) | > loss_disc_real_1: 0.20953845977783203 (0.2077252097941678) | > loss_disc_real_2: 0.08039235323667526 (0.21579832776353278) | > loss_disc_real_3: 0.3062615394592285 (0.22277425242395238) | > loss_disc_real_4: 0.1346830129623413 (0.2400442440833511) | > loss_disc_real_5: 0.16840587556362152 (0.2583989362906792) | > loss_0: 1.9089140892028809 (2.4031765666501275) | > grad_norm_0: tensor(310.6273, device='cuda:0') (tensor(635.6756, device='cuda:0')) | > loss_gen: 2.610867738723755 (2.4044907380794656) | > loss_kl: 1.0850285291671753 (0.8144718312240881) | > loss_feat: 6.662887096405029 (6.463805745644816) | > loss_mel: 21.62127685546875 (22.766699355224084) | > loss_duration: 1.3869531154632568 (1.3810128384623035) | > loss_1: 33.36701202392578 (33.83048018093766) | > grad_norm_1: tensor(6920.4189, device='cuda:0') (tensor(24135.0879, device='cuda:0')) | > current_lr_0: 7.922243165803269e-05 | > current_lr_1: 7.922243165803269e-05 | > step_time: 0.3591 (0.5090030061787573) | > loader_time: 0.0141 (0.017627551637846847)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1807119846343994 (2.1807119846343994) | > loss_disc_real_0: 0.11284027248620987 (0.11284027248620987) | > loss_disc_real_1: 0.19454197585582733 (0.19454197585582733) | > loss_disc_real_2: 0.1821567416191101 (0.1821567416191101) | > loss_disc_real_3: 0.1883877068758011 (0.1883877068758011) | > loss_disc_real_4: 0.32745468616485596 (0.32745468616485596) | > loss_disc_real_5: 0.2569805681705475 (0.2569805681705475) | > loss_0: 2.1807119846343994 (2.1807119846343994) | > loss_gen: 2.757819652557373 (2.757819652557373) | > loss_kl: 4.681491374969482 (4.681491374969482) | > loss_feat: 5.339861869812012 (5.339861869812012) | > loss_mel: 22.38602638244629 (22.38602638244629) | > loss_duration: 2.926007032394409 (2.926007032394409) | > loss_1: 38.09120559692383 (38.09120559692383)  --> STEP: 1 | > loss_disc: 2.332875967025757 (2.332875967025757) | > loss_disc_real_0: 0.21367274224758148 (0.21367274224758148) | > loss_disc_real_1: 0.27499333024024963 (0.27499333024024963) | > loss_disc_real_2: 0.32483431696891785 (0.32483431696891785) | > loss_disc_real_3: 0.18259096145629883 (0.18259096145629883) | > loss_disc_real_4: 0.29144707322120667 (0.29144707322120667) | > loss_disc_real_5: 0.43433648347854614 (0.43433648347854614) | > loss_0: 2.332875967025757 (2.332875967025757) | > loss_gen: 4.310762405395508 (4.310762405395508) | > loss_kl: 4.92200231552124 (4.92200231552124) | > loss_feat: 10.692924499511719 (10.692924499511719) | > loss_mel: 25.502300262451172 (25.502300262451172) | > loss_duration: 3.3748252391815186 (3.3748252391815186) | > loss_1: 48.80281066894531 (48.80281066894531)  --> STEP: 2 | > loss_disc: 3.067650079727173 (2.700263023376465) | > loss_disc_real_0: 0.48506155610084534 (0.3493671491742134) | > loss_disc_real_1: 0.27801117300987244 (0.27650225162506104) | > loss_disc_real_2: 0.29643934965133667 (0.31063683331012726) | > loss_disc_real_3: 0.3259396255016327 (0.25426529347896576) | > loss_disc_real_4: 0.44153517484664917 (0.3664911240339279) | > loss_disc_real_5: 0.37222820520401 (0.4032823443412781) | > loss_0: 3.067650079727173 (2.700263023376465) | > loss_gen: 2.689871311187744 (3.500316858291626) | > loss_kl: 6.121664524078369 (5.521833419799805) | > loss_feat: 4.411405563354492 (7.5521650314331055) | > loss_mel: 28.129009246826172 (26.815654754638672) | > loss_duration: 3.1381590366363525 (3.2564921379089355) | > loss_1: 44.4901123046875 (46.646461486816406)  --> STEP: 3 | > loss_disc: 2.866844654083252 (2.7557902336120605) | > loss_disc_real_0: 0.19083178043365479 (0.29652202626069385) | > loss_disc_real_1: 0.26866206526756287 (0.27388885617256165) | > loss_disc_real_2: 0.24798715114593506 (0.2897536059220632) | > loss_disc_real_3: 0.26160791516304016 (0.2567128340403239) | > loss_disc_real_4: 0.2878321409225464 (0.3402714629968007) | > loss_disc_real_5: 0.33574485778808594 (0.38076984882354736) | > loss_0: 2.866844654083252 (2.7557902336120605) | > loss_gen: 1.860512375831604 (2.953715364138285) | > loss_kl: 2.9049293994903564 (4.649532079696655) | > loss_feat: 1.7328702211380005 (5.612400094668071) | > loss_mel: 9.46949577331543 (21.033601760864258) | > loss_duration: 2.9288170337677 (3.1472671031951904) | > loss_1: 18.896625518798828 (37.39651616414388) --> EVAL PERFORMANCE | > avg_loader_time: 0.026513417561848957 (+0.009704033533732094) | > avg_loss_disc: 2.7557902336120605 (-0.08251301447550441) | > avg_loss_disc_real_0: 0.29652202626069385 (+0.030767202377319336) | > avg_loss_disc_real_1: 0.27388885617256165 (-0.001851489146550478) | > avg_loss_disc_real_2: 0.2897536059220632 (+0.018111179272333744) | > avg_loss_disc_real_3: 0.2567128340403239 (+0.03610257307688397) | > avg_loss_disc_real_4: 0.3402714629968007 (+0.1080505202213923) | > avg_loss_disc_real_5: 0.38076984882354736 (+0.1438581869006157) | > avg_loss_0: 2.7557902336120605 (-0.08251301447550441) | > avg_loss_gen: 2.953715364138285 (+1.072117487589518) | > avg_loss_kl: 4.649532079696655 (+0.08641926447550485) | > avg_loss_feat: 5.612400094668071 (+1.2510104576746626) | > avg_loss_mel: 21.033601760864258 (-1.4943262736002616) | > avg_loss_duration: 3.1472671031951904 (-0.01057298978169774) | > avg_loss_1: 37.39651616414388 (+0.904646555582687)  > EPOCH: 927/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:15:07)   --> TIME: 2023-10-20 11:15:19 -- STEP: 9/50 -- GLOBAL_STEP: 99360 | > loss_disc: 2.2586421966552734 (2.242778049574958) | > loss_disc_real_0: 0.10142182558774948 (0.11996239568624231) | > loss_disc_real_1: 0.23245957493782043 (0.22983291703793737) | > loss_disc_real_2: 0.2006455510854721 (0.22000574030809933) | > loss_disc_real_3: 0.3027133047580719 (0.19521291678150496) | > loss_disc_real_4: 0.14922857284545898 (0.20038474972049394) | > loss_disc_real_5: 0.18240970373153687 (0.23015701605214012) | > loss_0: 2.2586421966552734 (2.242778049574958) | > grad_norm_0: tensor(565.0446, device='cuda:0') (tensor(674.7895, device='cuda:0')) | > loss_gen: 2.171949625015259 (2.5162369277742176) | > loss_kl: 0.926308810710907 (0.9194614456759559) | > loss_feat: 3.540818214416504 (5.560782101419237) | > loss_mel: 15.868892669677734 (20.731748898824055) | > loss_duration: 1.3288447856903076 (1.3435379399193659) | > loss_1: 23.83681297302246 (31.071766535441082) | > grad_norm_1: tensor(18679.8652, device='cuda:0') (tensor(23540.4941, device='cuda:0')) | > current_lr_0: 7.914324387752489e-05 | > current_lr_1: 7.914324387752489e-05 | > step_time: 0.4865 (0.6324069499969482) | > loader_time: 0.0061 (0.020252095328436956)  --> TIME: 2023-10-20 11:15:36 -- STEP: 39/50 -- GLOBAL_STEP: 99390 | > loss_disc: 2.601102828979492 (2.3967814567761545) | > loss_disc_real_0: 0.20887766778469086 (0.13152998380171946) | > loss_disc_real_1: 0.37635326385498047 (0.23372432489234668) | > loss_disc_real_2: 0.43989986181259155 (0.2403161075587074) | > loss_disc_real_3: 0.30685853958129883 (0.23667543147427914) | > loss_disc_real_4: 0.37842392921447754 (0.23144132592595923) | > loss_disc_real_5: 0.30940383672714233 (0.2244869528744274) | > loss_0: 2.601102828979492 (2.3967814567761545) | > grad_norm_0: tensor(1077.5713, device='cuda:0') (tensor(786.5317, device='cuda:0')) | > loss_gen: 3.1561830043792725 (2.4763029508101635) | > loss_kl: 0.8532345294952393 (0.8156650410248683) | > loss_feat: 4.4414591789245605 (5.692403029172849) | > loss_mel: 20.123876571655273 (20.929771105448406) | > loss_duration: 1.3870246410369873 (1.3547461063433917) | > loss_1: 29.96177864074707 (31.268888277885242) | > grad_norm_1: tensor(27250.1152, device='cuda:0') (tensor(24726.9980, device='cuda:0')) | > current_lr_0: 7.914324387752489e-05 | > current_lr_1: 7.914324387752489e-05 | > step_time: 0.6608 (0.5675653127523569) | > loader_time: 0.0323 (0.018249811270298108)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4815802574157715 (2.4815802574157715) | > loss_disc_real_0: 0.10262395441532135 (0.10262395441532135) | > loss_disc_real_1: 0.24338684976100922 (0.24338684976100922) | > loss_disc_real_2: 0.2510457932949066 (0.2510457932949066) | > loss_disc_real_3: 0.3323979079723358 (0.3323979079723358) | > loss_disc_real_4: 0.1801493912935257 (0.1801493912935257) | > loss_disc_real_5: 0.3355690836906433 (0.3355690836906433) | > loss_0: 2.4815802574157715 (2.4815802574157715) | > loss_gen: 2.33550763130188 (2.33550763130188) | > loss_kl: 4.545772075653076 (4.545772075653076) | > loss_feat: 5.587701797485352 (5.587701797485352) | > loss_mel: 22.769798278808594 (22.769798278808594) | > loss_duration: 2.986173152923584 (2.986173152923584) | > loss_1: 38.224952697753906 (38.224952697753906)  --> STEP: 1 | > loss_disc: 2.1652724742889404 (2.1652724742889404) | > loss_disc_real_0: 0.032695524394512177 (0.032695524394512177) | > loss_disc_real_1: 0.23563042283058167 (0.23563042283058167) | > loss_disc_real_2: 0.21186287701129913 (0.21186287701129913) | > loss_disc_real_3: 0.2652634084224701 (0.2652634084224701) | > loss_disc_real_4: 0.10390686243772507 (0.10390686243772507) | > loss_disc_real_5: 0.21127717196941376 (0.21127717196941376) | > loss_0: 2.1652724742889404 (2.1652724742889404) | > loss_gen: 2.2758729457855225 (2.2758729457855225) | > loss_kl: 4.733898639678955 (4.733898639678955) | > loss_feat: 7.09724760055542 (7.09724760055542) | > loss_mel: 26.064956665039062 (26.064956665039062) | > loss_duration: 3.2641091346740723 (3.2641091346740723) | > loss_1: 43.43608474731445 (43.43608474731445)  --> STEP: 2 | > loss_disc: 2.6016440391540527 (2.3834582567214966) | > loss_disc_real_0: 0.01484117191284895 (0.023768348153680563) | > loss_disc_real_1: 0.0441167987883091 (0.13987361080944538) | > loss_disc_real_2: 0.04321739077568054 (0.12754013389348984) | > loss_disc_real_3: 0.04986785352230072 (0.1575656309723854) | > loss_disc_real_4: 0.050163526087999344 (0.0770351942628622) | > loss_disc_real_5: 0.026429975405335426 (0.11885357368737459) | > loss_0: 2.6016440391540527 (2.3834582567214966) | > loss_gen: 1.4244543313980103 (1.8501636385917664) | > loss_kl: 5.592240810394287 (5.163069725036621) | > loss_feat: 11.839749336242676 (9.468498468399048) | > loss_mel: 24.13003921508789 (25.097497940063477) | > loss_duration: 3.01743221282959 (3.140770673751831) | > loss_1: 46.00391387939453 (44.71999931335449)  --> STEP: 3 | > loss_disc: 1.7593424320220947 (2.175419648488363) | > loss_disc_real_0: 0.04926024377346039 (0.032265646693607174) | > loss_disc_real_1: 0.2719748020172119 (0.18390734121203423) | > loss_disc_real_2: 0.20107102394104004 (0.15205043057600656) | > loss_disc_real_3: 0.1466878354549408 (0.1539396991332372) | > loss_disc_real_4: 0.10410892218351364 (0.08605977023641269) | > loss_disc_real_5: 0.04005475342273712 (0.09258730026582877) | > loss_0: 1.7593424320220947 (2.175419648488363) | > loss_gen: 2.447869062423706 (2.0493987798690796) | > loss_kl: 2.676785707473755 (4.334308385848999) | > loss_feat: 6.048014163970947 (8.328337033589682) | > loss_mel: 26.35739517211914 (25.51746368408203) | > loss_duration: 2.954850673675537 (3.0787973403930664) | > loss_1: 40.48491287231445 (43.30830383300781) --> EVAL PERFORMANCE | > avg_loader_time: 0.007784128189086914 (-0.018729289372762043) | > avg_loss_disc: 2.175419648488363 (-0.5803705851236978) | > avg_loss_disc_real_0: 0.032265646693607174 (-0.2642563795670867) | > avg_loss_disc_real_1: 0.18390734121203423 (-0.08998151496052742) | > avg_loss_disc_real_2: 0.15205043057600656 (-0.1377031753460566) | > avg_loss_disc_real_3: 0.1539396991332372 (-0.1027731349070867) | > avg_loss_disc_real_4: 0.08605977023641269 (-0.254211692760388) | > avg_loss_disc_real_5: 0.09258730026582877 (-0.2881825485577186) | > avg_loss_0: 2.175419648488363 (-0.5803705851236978) | > avg_loss_gen: 2.0493987798690796 (-0.9043165842692056) | > avg_loss_kl: 4.334308385848999 (-0.31522369384765625) | > avg_loss_feat: 8.328337033589682 (+2.715936938921611) | > avg_loss_mel: 25.51746368408203 (+4.483861923217773) | > avg_loss_duration: 3.0787973403930664 (-0.06846976280212402) | > avg_loss_1: 43.30830383300781 (+5.91178766886393)  > EPOCH: 928/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:16:01)   --> TIME: 2023-10-20 11:16:15 -- STEP: 19/50 -- GLOBAL_STEP: 99420 | > loss_disc: 0.8742218017578125 (2.22476117234481) | > loss_disc_real_0: 0.029369544237852097 (0.1365557225715173) | > loss_disc_real_1: 0.06012355163693428 (0.20232006809429118) | > loss_disc_real_2: 0.014456045813858509 (0.1874128870764061) | > loss_disc_real_3: 0.014513109810650349 (0.21293695971957946) | > loss_disc_real_4: 0.07885376363992691 (0.19376984277838155) | > loss_disc_real_5: 0.009210496209561825 (0.2020139641765701) | > loss_0: 0.8742218017578125 (2.22476117234481) | > grad_norm_0: tensor(367.7945, device='cuda:0') (tensor(750.1008, device='cuda:0')) | > loss_gen: 3.337886095046997 (2.4816844902540507) | > loss_kl: 0.7068600058555603 (0.7746541186382896) | > loss_feat: 15.764273643493652 (7.109537589510805) | > loss_mel: 35.29356384277344 (22.75910004816557) | > loss_duration: 1.4805041551589966 (1.4006624723735608) | > loss_1: 56.58308792114258 (34.52563958418997) | > grad_norm_1: tensor(25587.3086, device='cuda:0') (tensor(29834.1582, device='cuda:0')) | > current_lr_0: 7.90641352501616e-05 | > current_lr_1: 7.90641352501616e-05 | > step_time: 0.3386 (0.3984763120350085) | > loader_time: 0.0019 (0.007189800864771793)  --> TIME: 2023-10-20 11:16:30 -- STEP: 49/50 -- GLOBAL_STEP: 99450 | > loss_disc: 2.951889991760254 (2.324591097783069) | > loss_disc_real_0: 0.36161744594573975 (0.15174220720952264) | > loss_disc_real_1: 0.36164265871047974 (0.22051471057442987) | > loss_disc_real_2: 0.40497711300849915 (0.21493928402434198) | > loss_disc_real_3: 0.31342756748199463 (0.22505046630620348) | > loss_disc_real_4: 0.43803900480270386 (0.21345346557850742) | > loss_disc_real_5: 0.4298790395259857 (0.21950648546370924) | > loss_0: 2.951889991760254 (2.324591097783069) | > grad_norm_0: tensor(776.3555, device='cuda:0') (tensor(646.2247, device='cuda:0')) | > loss_gen: 3.0399763584136963 (2.4785434275257345) | > loss_kl: 0.41110876202583313 (0.7896894228701689) | > loss_feat: 3.940328359603882 (6.681091175357602) | > loss_mel: 20.551109313964844 (21.444051577120412) | > loss_duration: 1.5053880214691162 (1.3688267615376686) | > loss_1: 29.44791030883789 (32.76220290514889) | > grad_norm_1: tensor(21360.8574, device='cuda:0') (tensor(23975.6875, device='cuda:0')) | > current_lr_0: 7.90641352501616e-05 | > current_lr_1: 7.90641352501616e-05 | > step_time: 0.8096 (0.462470074089206) | > loader_time: 0.4349 (0.01701212415889818)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0461270809173584 (3.0461270809173584) | > loss_disc_real_0: 0.5270063877105713 (0.5270063877105713) | > loss_disc_real_1: 0.2683878242969513 (0.2683878242969513) | > loss_disc_real_2: 0.363639235496521 (0.363639235496521) | > loss_disc_real_3: 0.3002305328845978 (0.3002305328845978) | > loss_disc_real_4: 0.44399186968803406 (0.44399186968803406) | > loss_disc_real_5: 0.618975043296814 (0.618975043296814) | > loss_0: 3.0461270809173584 (3.0461270809173584) | > loss_gen: 3.573848247528076 (3.573848247528076) | > loss_kl: 4.568288326263428 (4.568288326263428) | > loss_feat: 5.696590423583984 (5.696590423583984) | > loss_mel: 21.433027267456055 (21.433027267456055) | > loss_duration: 3.028346300125122 (3.028346300125122) | > loss_1: 38.30010223388672 (38.30010223388672)  --> STEP: 1 | > loss_disc: 1.8408676385879517 (1.8408676385879517) | > loss_disc_real_0: 0.11338987946510315 (0.11338987946510315) | > loss_disc_real_1: 0.08210888504981995 (0.08210888504981995) | > loss_disc_real_2: 0.1416395753622055 (0.1416395753622055) | > loss_disc_real_3: 0.12940345704555511 (0.12940345704555511) | > loss_disc_real_4: 0.0669039636850357 (0.0669039636850357) | > loss_disc_real_5: 0.16700978577136993 (0.16700978577136993) | > loss_0: 1.8408676385879517 (1.8408676385879517) | > loss_gen: 2.1359493732452393 (2.1359493732452393) | > loss_kl: 5.147939205169678 (5.147939205169678) | > loss_feat: 8.570981979370117 (8.570981979370117) | > loss_mel: 23.209108352661133 (23.209108352661133) | > loss_duration: 3.255418300628662 (3.255418300628662) | > loss_1: 42.31939697265625 (42.31939697265625)  --> STEP: 2 | > loss_disc: 3.2953460216522217 (2.5681068301200867) | > loss_disc_real_0: 0.22969605028629303 (0.1715429648756981) | > loss_disc_real_1: 0.39195021986961365 (0.2370295524597168) | > loss_disc_real_2: 0.41678571701049805 (0.2792126461863518) | > loss_disc_real_3: 0.4791792333126068 (0.30429134517908096) | > loss_disc_real_4: 0.2546631097793579 (0.1607835367321968) | > loss_disc_real_5: 0.2845360338687897 (0.2257729098200798) | > loss_0: 3.2953460216522217 (2.5681068301200867) | > loss_gen: 2.2697267532348633 (2.2028380632400513) | > loss_kl: 5.461291790008545 (5.304615497589111) | > loss_feat: 6.115607738494873 (7.343294858932495) | > loss_mel: 23.868240356445312 (23.538674354553223) | > loss_duration: 3.1991443634033203 (3.227281332015991) | > loss_1: 40.91400909423828 (41.616703033447266)  --> STEP: 3 | > loss_disc: 2.7209761142730713 (2.6190632581710815) | > loss_disc_real_0: 0.29219627380371094 (0.21176073451836905) | > loss_disc_real_1: 0.3272813558578491 (0.2671134869257609) | > loss_disc_real_2: 0.29270580410957336 (0.2837103654940923) | > loss_disc_real_3: 0.26902711391448975 (0.2925366014242172) | > loss_disc_real_4: 0.23846524953842163 (0.18667744100093842) | > loss_disc_real_5: 0.22340108454227448 (0.22498230139414468) | > loss_0: 2.7209761142730713 (2.6190632581710815) | > loss_gen: 2.3483057022094727 (2.2513272762298584) | > loss_kl: 2.4592576026916504 (4.356162865956624) | > loss_feat: 1.8378307819366455 (5.508140166600545) | > loss_mel: 20.920835494995117 (22.666061401367188) | > loss_duration: 3.0867323875427246 (3.180431683858236) | > loss_1: 30.652963638305664 (37.962123235066734) --> EVAL PERFORMANCE | > avg_loader_time: 0.006735483805338542 (-0.001048644383748372) | > avg_loss_disc: 2.6190632581710815 (+0.44364360968271876) | > avg_loss_disc_real_0: 0.21176073451836905 (+0.17949508782476187) | > avg_loss_disc_real_1: 0.2671134869257609 (+0.0832061457137267) | > avg_loss_disc_real_2: 0.2837103654940923 (+0.13165993491808572) | > avg_loss_disc_real_3: 0.2925366014242172 (+0.13859690229098) | > avg_loss_disc_real_4: 0.18667744100093842 (+0.10061767076452573) | > avg_loss_disc_real_5: 0.22498230139414468 (+0.13239500112831593) | > avg_loss_0: 2.6190632581710815 (+0.44364360968271876) | > avg_loss_gen: 2.2513272762298584 (+0.2019284963607788) | > avg_loss_kl: 4.356162865956624 (+0.02185448010762503) | > avg_loss_feat: 5.508140166600545 (-2.8201968669891366) | > avg_loss_mel: 22.666061401367188 (-2.8514022827148438) | > avg_loss_duration: 3.180431683858236 (+0.10163434346516942) | > avg_loss_1: 37.962123235066734 (-5.346180597941078)  > EPOCH: 929/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:16:51)   --> TIME: 2023-10-20 11:17:15 -- STEP: 29/50 -- GLOBAL_STEP: 99480 | > loss_disc: 2.7419309616088867 (2.394783772271255) | > loss_disc_real_0: 0.2513647675514221 (0.14827018288959715) | > loss_disc_real_1: 0.2973580062389374 (0.21926435230877891) | > loss_disc_real_2: 0.28683778643608093 (0.2255408143431976) | > loss_disc_real_3: 0.2665562629699707 (0.22025351521783862) | > loss_disc_real_4: 0.33226653933525085 (0.21516701463481475) | > loss_disc_real_5: 0.3045748472213745 (0.22044988233467627) | > loss_0: 2.7419309616088867 (2.394783772271255) | > grad_norm_0: tensor(348.1612, device='cuda:0') (tensor(772.1842, device='cuda:0')) | > loss_gen: 2.3124539852142334 (2.352079728554035) | > loss_kl: 0.8437503576278687 (0.8686188510779677) | > loss_feat: 3.8861124515533447 (6.113518162598384) | > loss_mel: 23.659347534179688 (22.032884910188873) | > loss_duration: 1.318197250366211 (1.3768245516152218) | > loss_1: 32.019859313964844 (32.74392642646) | > grad_norm_1: tensor(3773.1272, device='cuda:0') (tensor(22863.5410, device='cuda:0')) | > current_lr_0: 7.898510569682429e-05 | > current_lr_1: 7.898510569682429e-05 | > step_time: 0.4514 (0.6363811739559831) | > loader_time: 0.0338 (0.02322672153341359)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9193663597106934 (2.9193663597106934) | > loss_disc_real_0: 0.30495375394821167 (0.30495375394821167) | > loss_disc_real_1: 0.2502294182777405 (0.2502294182777405) | > loss_disc_real_2: 0.26568132638931274 (0.26568132638931274) | > loss_disc_real_3: 0.43268489837646484 (0.43268489837646484) | > loss_disc_real_4: 0.3215188980102539 (0.3215188980102539) | > loss_disc_real_5: 0.34528589248657227 (0.34528589248657227) | > loss_0: 2.9193663597106934 (2.9193663597106934) | > loss_gen: 2.394559383392334 (2.394559383392334) | > loss_kl: 6.072569370269775 (6.072569370269775) | > loss_feat: 4.609914302825928 (4.609914302825928) | > loss_mel: 21.156774520874023 (21.156774520874023) | > loss_duration: 3.064891815185547 (3.064891815185547) | > loss_1: 37.298709869384766 (37.298709869384766)  --> STEP: 1 | > loss_disc: 3.008063793182373 (3.008063793182373) | > loss_disc_real_0: 0.31584304571151733 (0.31584304571151733) | > loss_disc_real_1: 0.26223212480545044 (0.26223212480545044) | > loss_disc_real_2: 0.2631603479385376 (0.2631603479385376) | > loss_disc_real_3: 0.3571338951587677 (0.3571338951587677) | > loss_disc_real_4: 0.2826511859893799 (0.2826511859893799) | > loss_disc_real_5: 0.2582649290561676 (0.2582649290561676) | > loss_0: 3.008063793182373 (3.008063793182373) | > loss_gen: 1.7694244384765625 (1.7694244384765625) | > loss_kl: 5.278950214385986 (5.278950214385986) | > loss_feat: 0.09003647416830063 (0.09003647416830063) | > loss_mel: 11.534625053405762 (11.534625053405762) | > loss_duration: 3.3267760276794434 (3.3267760276794434) | > loss_1: 21.999813079833984 (21.999813079833984)  --> STEP: 2 | > loss_disc: 3.0305867195129395 (3.0193252563476562) | > loss_disc_real_0: 0.2805919051170349 (0.2982174754142761) | > loss_disc_real_1: 0.2608802616596222 (0.2615561932325363) | > loss_disc_real_2: 0.2641652226448059 (0.26366278529167175) | > loss_disc_real_3: 0.3578665852546692 (0.35750024020671844) | > loss_disc_real_4: 0.28264060616493225 (0.28264589607715607) | > loss_disc_real_5: 0.25828617811203003 (0.2582755535840988) | > loss_0: 3.0305867195129395 (3.0193252563476562) | > loss_gen: 1.698053002357483 (1.7337387204170227) | > loss_kl: 6.067958831787109 (5.673454523086548) | > loss_feat: 0.0499226339161396 (0.06997955404222012) | > loss_mel: 4.4020466804504395 (7.968335866928101) | > loss_duration: 3.20070481300354 (3.2637404203414917) | > loss_1: 15.418685913085938 (18.70924949645996)  --> STEP: 3 | > loss_disc: 2.755601167678833 (2.931417226791382) | > loss_disc_real_0: 0.30977219343185425 (0.3020690480868022) | > loss_disc_real_1: 0.3012918531894684 (0.27480141321818036) | > loss_disc_real_2: 0.3332793414592743 (0.28686830401420593) | > loss_disc_real_3: 0.33316493034362793 (0.3493884702523549) | > loss_disc_real_4: 0.2543260455131531 (0.2732059458891551) | > loss_disc_real_5: 0.28368282318115234 (0.2667446434497833) | > loss_0: 2.755601167678833 (2.931417226791382) | > loss_gen: 2.356795072555542 (1.9414241711298625) | > loss_kl: 2.64589786529541 (4.664268970489502) | > loss_feat: 1.735901117324829 (0.6252867418030897) | > loss_mel: 16.43090057373047 (10.789190769195557) | > loss_duration: 2.9757015705108643 (3.167727470397949) | > loss_1: 26.14519500732422 (21.18789800008138) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025177001953125 (-0.004217783610026042) | > avg_loss_disc: 2.931417226791382 (+0.3123539686203003) | > avg_loss_disc_real_0: 0.3020690480868022 (+0.09030831356843314) | > avg_loss_disc_real_1: 0.27480141321818036 (+0.007687926292419434) | > avg_loss_disc_real_2: 0.28686830401420593 (+0.0031579385201136456) | > avg_loss_disc_real_3: 0.3493884702523549 (+0.0568518688281377) | > avg_loss_disc_real_4: 0.2732059458891551 (+0.08652850488821667) | > avg_loss_disc_real_5: 0.2667446434497833 (+0.04176234205563864) | > avg_loss_0: 2.931417226791382 (+0.3123539686203003) | > avg_loss_gen: 1.9414241711298625 (-0.30990310509999586) | > avg_loss_kl: 4.664268970489502 (+0.3081061045328779) | > avg_loss_feat: 0.6252867418030897 (-4.882853424797455) | > avg_loss_mel: 10.789190769195557 (-11.87687063217163) | > avg_loss_duration: 3.167727470397949 (-0.012704213460286606) | > avg_loss_1: 21.18789800008138 (-16.774225234985355)  > EPOCH: 930/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:17:44)   --> TIME: 2023-10-20 11:18:05 -- STEP: 9/50 -- GLOBAL_STEP: 99510 | > loss_disc: 2.4889395236968994 (2.2258285019132824) | > loss_disc_real_0: 0.223253071308136 (0.1423546845714251) | > loss_disc_real_1: 0.2530268728733063 (0.23131502585278618) | > loss_disc_real_2: 0.1875801831483841 (0.2122897290521198) | > loss_disc_real_3: 0.27854371070861816 (0.25314289662573075) | > loss_disc_real_4: 0.24579083919525146 (0.21744909344447982) | > loss_disc_real_5: 0.15049932897090912 (0.19620601957043013) | > loss_0: 2.4889395236968994 (2.2258285019132824) | > grad_norm_0: tensor(330.7240, device='cuda:0') (tensor(561.4241, device='cuda:0')) | > loss_gen: 2.2045562267303467 (2.644820147090488) | > loss_kl: 0.4418480098247528 (0.8618129723601871) | > loss_feat: 6.88652229309082 (6.552714037398498) | > loss_mel: 21.988073348999023 (21.397178755866157) | > loss_duration: 1.3115006685256958 (1.4026927683088515) | > loss_1: 32.83250045776367 (32.85921891530355) | > grad_norm_1: tensor(2451.6699, device='cuda:0') (tensor(17079.3105, device='cuda:0')) | > current_lr_0: 7.890615513847354e-05 | > current_lr_1: 7.890615513847354e-05 | > step_time: 0.8146 (0.6326438850826688) | > loader_time: 0.0248 (0.021400875515407987)  --> TIME: 2023-10-20 11:18:25 -- STEP: 39/50 -- GLOBAL_STEP: 99540 | > loss_disc: 2.9387922286987305 (2.46385233830183) | > loss_disc_real_0: 0.1657295823097229 (0.13997619260006994) | > loss_disc_real_1: 0.29387974739074707 (0.2308202189130661) | > loss_disc_real_2: 0.3657093942165375 (0.23027902555007201) | > loss_disc_real_3: 0.35436156392097473 (0.2483352522055308) | > loss_disc_real_4: 0.5344829559326172 (0.23713457909150001) | > loss_disc_real_5: 0.36334869265556335 (0.24289870777955422) | > loss_0: 2.9387922286987305 (2.46385233830183) | > grad_norm_0: tensor(639.4562, device='cuda:0') (tensor(570.7323, device='cuda:0')) | > loss_gen: 2.638120412826538 (2.3611160669571323) | > loss_kl: 0.47342541813850403 (0.8285989967676309) | > loss_feat: 4.7804083824157715 (5.299826976843178) | > loss_mel: 22.048532485961914 (20.113004539257442) | > loss_duration: 1.4112292528152466 (1.3669374661567883) | > loss_1: 31.351716995239258 (29.969483889066257) | > grad_norm_1: tensor(21706.9043, device='cuda:0') (tensor(21887.4238, device='cuda:0')) | > current_lr_0: 7.890615513847354e-05 | > current_lr_1: 7.890615513847354e-05 | > step_time: 0.7592 (0.630427109889495) | > loader_time: 0.0071 (0.021751905098939553)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9356229305267334 (2.9356229305267334) | > loss_disc_real_0: 0.11351227760314941 (0.11351227760314941) | > loss_disc_real_1: 0.3010562062263489 (0.3010562062263489) | > loss_disc_real_2: 0.3829280138015747 (0.3829280138015747) | > loss_disc_real_3: 0.43825817108154297 (0.43825817108154297) | > loss_disc_real_4: 0.2574177384376526 (0.2574177384376526) | > loss_disc_real_5: 0.31213316321372986 (0.31213316321372986) | > loss_0: 2.9356229305267334 (2.9356229305267334) | > loss_gen: 2.1817634105682373 (2.1817634105682373) | > loss_kl: 4.931473255157471 (4.931473255157471) | > loss_feat: 7.09062385559082 (7.09062385559082) | > loss_mel: 26.113168716430664 (26.113168716430664) | > loss_duration: 3.061422109603882 (3.061422109603882) | > loss_1: 43.378448486328125 (43.378448486328125)  --> STEP: 1 | > loss_disc: 2.670093536376953 (2.670093536376953) | > loss_disc_real_0: 0.0920179933309555 (0.0920179933309555) | > loss_disc_real_1: 0.2337060570716858 (0.2337060570716858) | > loss_disc_real_2: 0.3132384121417999 (0.3132384121417999) | > loss_disc_real_3: 0.18692387640476227 (0.18692387640476227) | > loss_disc_real_4: 0.23314660787582397 (0.23314660787582397) | > loss_disc_real_5: 0.2551308870315552 (0.2551308870315552) | > loss_0: 2.670093536376953 (2.670093536376953) | > loss_gen: 1.9397215843200684 (1.9397215843200684) | > loss_kl: 4.712862014770508 (4.712862014770508) | > loss_feat: 6.538901329040527 (6.538901329040527) | > loss_mel: 24.00589942932129 (24.00589942932129) | > loss_duration: 3.467405080795288 (3.467405080795288) | > loss_1: 40.66478729248047 (40.66478729248047)  --> STEP: 2 | > loss_disc: 2.528428316116333 (2.599260926246643) | > loss_disc_real_0: 0.16493546962738037 (0.12847673147916794) | > loss_disc_real_1: 0.12648773193359375 (0.18009689450263977) | > loss_disc_real_2: 0.2977399230003357 (0.3054891675710678) | > loss_disc_real_3: 0.1349015086889267 (0.16091269254684448) | > loss_disc_real_4: 0.2690529227256775 (0.25109976530075073) | > loss_disc_real_5: 0.07459872961044312 (0.16486480832099915) | > loss_0: 2.528428316116333 (2.599260926246643) | > loss_gen: 2.1050052642822266 (2.0223634243011475) | > loss_kl: 5.856215000152588 (5.284538507461548) | > loss_feat: 11.76612377166748 (9.152512550354004) | > loss_mel: 23.473981857299805 (23.739940643310547) | > loss_duration: 3.2309091091156006 (3.3491570949554443) | > loss_1: 46.43223190307617 (43.54850959777832)  --> STEP: 3 | > loss_disc: 2.680239677429199 (2.626253843307495) | > loss_disc_real_0: 0.18601752817630768 (0.1476569970448812) | > loss_disc_real_1: 0.29874998331069946 (0.21964792410532633) | > loss_disc_real_2: 0.25137755274772644 (0.28745196262995404) | > loss_disc_real_3: 0.25651270151138306 (0.19277936220169067) | > loss_disc_real_4: 0.241440087556839 (0.2478798727194468) | > loss_disc_real_5: 0.23986482620239258 (0.18986481428146362) | > loss_0: 2.680239677429199 (2.626253843307495) | > loss_gen: 1.863020420074463 (1.9692490895589192) | > loss_kl: 2.3463783264160156 (4.30515178044637) | > loss_feat: 1.6044496297836304 (6.636491576830546) | > loss_mel: 19.399829864501953 (22.293237050374348) | > loss_duration: 2.989638090133667 (3.2293174266815186) | > loss_1: 28.20331573486328 (38.43344497680664) --> EVAL PERFORMANCE | > avg_loader_time: 0.009243647257486979 (+0.006725947062174479) | > avg_loss_disc: 2.626253843307495 (-0.3051633834838867) | > avg_loss_disc_real_0: 0.1476569970448812 (-0.154412051041921) | > avg_loss_disc_real_1: 0.21964792410532633 (-0.05515348911285403) | > avg_loss_disc_real_2: 0.28745196262995404 (+0.0005836586157481061) | > avg_loss_disc_real_3: 0.19277936220169067 (-0.15660910805066425) | > avg_loss_disc_real_4: 0.2478798727194468 (-0.02532607316970828) | > avg_loss_disc_real_5: 0.18986481428146362 (-0.0768798291683197) | > avg_loss_0: 2.626253843307495 (-0.3051633834838867) | > avg_loss_gen: 1.9692490895589192 (+0.027824918429056655) | > avg_loss_kl: 4.30515178044637 (-0.3591171900431318) | > avg_loss_feat: 6.636491576830546 (+6.011204835027456) | > avg_loss_mel: 22.293237050374348 (+11.504046281178791) | > avg_loss_duration: 3.2293174266815186 (+0.061589956283569336) | > avg_loss_1: 38.43344497680664 (+17.24554697672526)  > EPOCH: 931/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:18:56)   --> TIME: 2023-10-20 11:19:14 -- STEP: 19/50 -- GLOBAL_STEP: 99570 | > loss_disc: 2.7134904861450195 (2.5484854735826192) | > loss_disc_real_0: 0.07280178368091583 (0.1350051429318755) | > loss_disc_real_1: 0.2879841923713684 (0.23980041750167547) | > loss_disc_real_2: 0.27334484457969666 (0.24322245230800227) | > loss_disc_real_3: 0.28468620777130127 (0.25934216536973653) | > loss_disc_real_4: 0.319598913192749 (0.21088844008351626) | > loss_disc_real_5: 0.37716618180274963 (0.23074119596889145) | > loss_0: 2.7134904861450195 (2.5484854735826192) | > grad_norm_0: tensor(545.9181, device='cuda:0') (tensor(761.7124, device='cuda:0')) | > loss_gen: 2.4195098876953125 (2.169289965378611) | > loss_kl: 0.9189873933792114 (0.8447241830198389) | > loss_feat: 3.8767077922821045 (4.685724483116677) | > loss_mel: 21.709331512451172 (17.88130343587775) | > loss_duration: 1.4576536417007446 (1.4043889171198796) | > loss_1: 30.382190704345703 (26.98543109391865) | > grad_norm_1: tensor(5971.7646, device='cuda:0') (tensor(23257.4297, device='cuda:0')) | > current_lr_0: 7.882728349614889e-05 | > current_lr_1: 7.882728349614889e-05 | > step_time: 0.4291 (0.6264257305546811) | > loader_time: 0.0273 (0.02100496543081183)  --> TIME: 2023-10-20 11:19:32 -- STEP: 49/50 -- GLOBAL_STEP: 99600 | > loss_disc: 2.526369094848633 (2.52217154356898) | > loss_disc_real_0: 0.27615317702293396 (0.14590947449739491) | > loss_disc_real_1: 0.24616862833499908 (0.22461641796541457) | > loss_disc_real_2: 0.14005741477012634 (0.2291437877836276) | > loss_disc_real_3: 0.2732432186603546 (0.24001304178061533) | > loss_disc_real_4: 0.1831335574388504 (0.2092707891549383) | > loss_disc_real_5: 0.20591388642787933 (0.23414942641191336) | > loss_0: 2.526369094848633 (2.52217154356898) | > grad_norm_0: tensor(1024.7000, device='cuda:0') (tensor(765.6433, device='cuda:0')) | > loss_gen: 2.0225915908813477 (2.184896568862759) | > loss_kl: 0.5069146752357483 (0.8161423826704219) | > loss_feat: 1.8363829851150513 (5.1031003033324165) | > loss_mel: 17.077770233154297 (19.16441438636001) | > loss_duration: 1.4382084608078003 (1.355635132108416) | > loss_1: 22.881868362426758 (28.624188822142933) | > grad_norm_1: tensor(5674.7617, device='cuda:0') (tensor(21305.4824, device='cuda:0')) | > current_lr_0: 7.882728349614889e-05 | > current_lr_1: 7.882728349614889e-05 | > step_time: 0.3796 (0.5880298517188249) | > loader_time: 0.381 (0.026862913248490314)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2603209018707275 (2.2603209018707275) | > loss_disc_real_0: 0.38258689641952515 (0.38258689641952515) | > loss_disc_real_1: 0.20995572209358215 (0.20995572209358215) | > loss_disc_real_2: 0.12194671481847763 (0.12194671481847763) | > loss_disc_real_3: 0.2077207714319229 (0.2077207714319229) | > loss_disc_real_4: 0.31442078948020935 (0.31442078948020935) | > loss_disc_real_5: 0.22782891988754272 (0.22782891988754272) | > loss_0: 2.2603209018707275 (2.2603209018707275) | > loss_gen: 2.9345500469207764 (2.9345500469207764) | > loss_kl: 4.670399188995361 (4.670399188995361) | > loss_feat: 8.556236267089844 (8.556236267089844) | > loss_mel: 21.367456436157227 (21.367456436157227) | > loss_duration: 3.0319015979766846 (3.0319015979766846) | > loss_1: 40.560546875 (40.560546875)  --> STEP: 1 | > loss_disc: 2.9427030086517334 (2.9427030086517334) | > loss_disc_real_0: 0.3840998113155365 (0.3840998113155365) | > loss_disc_real_1: 0.2116345316171646 (0.2116345316171646) | > loss_disc_real_2: 0.30995088815689087 (0.30995088815689087) | > loss_disc_real_3: 0.41850101947784424 (0.41850101947784424) | > loss_disc_real_4: 0.3948311507701874 (0.3948311507701874) | > loss_disc_real_5: 0.32446053624153137 (0.32446053624153137) | > loss_0: 2.9427030086517334 (2.9427030086517334) | > loss_gen: 2.7037315368652344 (2.7037315368652344) | > loss_kl: 5.409169673919678 (5.409169673919678) | > loss_feat: 6.212283134460449 (6.212283134460449) | > loss_mel: 24.390993118286133 (24.390993118286133) | > loss_duration: 3.2971839904785156 (3.2971839904785156) | > loss_1: 42.01335906982422 (42.01335906982422)  --> STEP: 2 | > loss_disc: 3.111316680908203 (3.0270098447799683) | > loss_disc_real_0: 0.4647206664085388 (0.42441023886203766) | > loss_disc_real_1: 0.2920076549053192 (0.2518210932612419) | > loss_disc_real_2: 0.2763899266719818 (0.29317040741443634) | > loss_disc_real_3: 0.28668543696403503 (0.35259322822093964) | > loss_disc_real_4: 0.23981404304504395 (0.31732259690761566) | > loss_disc_real_5: 0.27550286054611206 (0.2999816983938217) | > loss_0: 3.111316680908203 (3.0270098447799683) | > loss_gen: 1.7724865674972534 (2.238109052181244) | > loss_kl: 5.766363620758057 (5.587766647338867) | > loss_feat: 0.17434048652648926 (3.1933118104934692) | > loss_mel: 1.7184603214263916 (13.054726719856262) | > loss_duration: 3.3188886642456055 (3.3080363273620605) | > loss_1: 12.750539779663086 (27.381949424743652)  --> STEP: 3 | > loss_disc: 3.1080222129821777 (3.054013967514038) | > loss_disc_real_0: 0.46207815408706665 (0.436966210603714) | > loss_disc_real_1: 0.2919583320617676 (0.2652001728614171) | > loss_disc_real_2: 0.27645695209503174 (0.28759925564130145) | > loss_disc_real_3: 0.28664490580558777 (0.330610454082489) | > loss_disc_real_4: 0.23997598886489868 (0.29154039422671) | > loss_disc_real_5: 0.2753086984157562 (0.29175736506779987) | > loss_0: 3.1080222129821777 (3.054013967514038) | > loss_gen: 1.7734687328338623 (2.0832289457321167) | > loss_kl: 2.72172212600708 (4.6324184735616045) | > loss_feat: 0.16707539558410645 (2.184566338857015) | > loss_mel: 2.3958640098571777 (9.501772483189901) | > loss_duration: 2.983591318130493 (3.199887990951538) | > loss_1: 10.04172134399414 (21.60187339782715) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024437904357910156 (-0.006799856821695963) | > avg_loss_disc: 3.054013967514038 (+0.42776012420654297) | > avg_loss_disc_real_0: 0.436966210603714 (+0.28930921355883277) | > avg_loss_disc_real_1: 0.2652001728614171 (+0.04555224875609079) | > avg_loss_disc_real_2: 0.28759925564130145 (+0.0001472930113474158) | > avg_loss_disc_real_3: 0.330610454082489 (+0.13783109188079834) | > avg_loss_disc_real_4: 0.29154039422671 (+0.04366052150726321) | > avg_loss_disc_real_5: 0.29175736506779987 (+0.10189255078633624) | > avg_loss_0: 3.054013967514038 (+0.42776012420654297) | > avg_loss_gen: 2.0832289457321167 (+0.1139798561731975) | > avg_loss_kl: 4.6324184735616045 (+0.3272666931152344) | > avg_loss_feat: 2.184566338857015 (-4.451925237973532) | > avg_loss_mel: 9.501772483189901 (-12.791464567184446) | > avg_loss_duration: 3.199887990951538 (-0.02942943572998047) | > avg_loss_1: 21.60187339782715 (-16.831571578979492)  > EPOCH: 932/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:19:48)   --> TIME: 2023-10-20 11:20:07 -- STEP: 29/50 -- GLOBAL_STEP: 99630 | > loss_disc: 1.8307178020477295 (2.3178852652681283) | > loss_disc_real_0: 0.06138317286968231 (0.1276593230150897) | > loss_disc_real_1: 0.1632913053035736 (0.21829871216724658) | > loss_disc_real_2: 0.10488412529230118 (0.22467419190396523) | > loss_disc_real_3: 0.24240480363368988 (0.23688435143437878) | > loss_disc_real_4: 0.0879489928483963 (0.22574305174679593) | > loss_disc_real_5: 0.13132867217063904 (0.21193388136553354) | > loss_0: 1.8307178020477295 (2.3178852652681283) | > grad_norm_0: tensor(280.3187, device='cuda:0') (tensor(738.9067, device='cuda:0')) | > loss_gen: 2.6099774837493896 (2.469717831447207) | > loss_kl: 0.6013310551643372 (0.7658981855573326) | > loss_feat: 8.027446746826172 (6.537424634756713) | > loss_mel: 22.16840171813965 (21.786720395088196) | > loss_duration: 1.2734705209732056 (1.3768335663039108) | > loss_1: 34.68062973022461 (32.936594288924645) | > grad_norm_1: tensor(5745.7588, device='cuda:0') (tensor(23824.6797, device='cuda:0')) | > current_lr_0: 7.874849069096887e-05 | > current_lr_1: 7.874849069096887e-05 | > step_time: 0.9681 (0.467156484209258) | > loader_time: 0.0379 (0.013316680645120555)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0123562812805176 (3.0123562812805176) | > loss_disc_real_0: 0.5528315901756287 (0.5528315901756287) | > loss_disc_real_1: 0.28951334953308105 (0.28951334953308105) | > loss_disc_real_2: 0.28570932149887085 (0.28570932149887085) | > loss_disc_real_3: 0.32816895842552185 (0.32816895842552185) | > loss_disc_real_4: 0.5797398090362549 (0.5797398090362549) | > loss_disc_real_5: 0.4098166227340698 (0.4098166227340698) | > loss_0: 3.0123562812805176 (3.0123562812805176) | > loss_gen: 3.436572313308716 (3.436572313308716) | > loss_kl: 4.92828893661499 (4.92828893661499) | > loss_feat: 6.242844581604004 (6.242844581604004) | > loss_mel: 21.974214553833008 (21.974214553833008) | > loss_duration: 2.9463613033294678 (2.9463613033294678) | > loss_1: 39.528282165527344 (39.528282165527344)  --> STEP: 1 | > loss_disc: 2.909379482269287 (2.909379482269287) | > loss_disc_real_0: 0.24673543870449066 (0.24673543870449066) | > loss_disc_real_1: 0.2878429889678955 (0.2878429889678955) | > loss_disc_real_2: 0.20251332223415375 (0.20251332223415375) | > loss_disc_real_3: 0.22129477560520172 (0.22129477560520172) | > loss_disc_real_4: 0.1557818204164505 (0.1557818204164505) | > loss_disc_real_5: 0.07292554527521133 (0.07292554527521133) | > loss_0: 2.909379482269287 (2.909379482269287) | > loss_gen: 1.5960850715637207 (1.5960850715637207) | > loss_kl: 4.980066776275635 (4.980066776275635) | > loss_feat: 6.5624284744262695 (6.5624284744262695) | > loss_mel: 25.78167724609375 (25.78167724609375) | > loss_duration: 3.31044864654541 (3.31044864654541) | > loss_1: 42.23070526123047 (42.23070526123047)  --> STEP: 2 | > loss_disc: 2.163709878921509 (2.536544680595398) | > loss_disc_real_0: 0.21515750885009766 (0.23094647377729416) | > loss_disc_real_1: 0.28296226263046265 (0.2854026257991791) | > loss_disc_real_2: 0.23345200717449188 (0.21798266470432281) | > loss_disc_real_3: 0.24364493787288666 (0.2324698567390442) | > loss_disc_real_4: 0.22776871919631958 (0.19177526980638504) | > loss_disc_real_5: 0.1953202486038208 (0.13412289693951607) | > loss_0: 2.163709878921509 (2.536544680595398) | > loss_gen: 2.8916385173797607 (2.2438617944717407) | > loss_kl: 5.486294269561768 (5.233180522918701) | > loss_feat: 7.974055290222168 (7.268241882324219) | > loss_mel: 25.305076599121094 (25.543376922607422) | > loss_duration: 3.1864213943481445 (3.2484350204467773) | > loss_1: 44.84348678588867 (43.53709602355957)  --> STEP: 3 | > loss_disc: 3.0151219367980957 (2.696070432662964) | > loss_disc_real_0: 0.2719353139400482 (0.2446094204982122) | > loss_disc_real_1: 0.23657022416591644 (0.26912515858809155) | > loss_disc_real_2: 0.25260457396507263 (0.22952330112457275) | > loss_disc_real_3: 0.2773919403553009 (0.24744388461112976) | > loss_disc_real_4: 0.28019753098487854 (0.22124935686588287) | > loss_disc_real_5: 0.25512468814849854 (0.17445682734251022) | > loss_0: 3.0151219367980957 (2.696070432662964) | > loss_gen: 1.5638351440429688 (2.017186244328817) | > loss_kl: 2.5401053428649902 (4.335488796234131) | > loss_feat: 0.0383521243929863 (4.858278629680474) | > loss_mel: 2.454259157180786 (17.847004334131878) | > loss_duration: 3.02728271484375 (3.174717585245768) | > loss_1: 9.623834609985352 (32.232675552368164) --> EVAL PERFORMANCE | > avg_loader_time: 0.015798489252726238 (+0.013354698816935223) | > avg_loss_disc: 2.696070432662964 (-0.3579435348510742) | > avg_loss_disc_real_0: 0.2446094204982122 (-0.1923567901055018) | > avg_loss_disc_real_1: 0.26912515858809155 (+0.003924985726674435) | > avg_loss_disc_real_2: 0.22952330112457275 (-0.0580759545167287) | > avg_loss_disc_real_3: 0.24744388461112976 (-0.08316656947135925) | > avg_loss_disc_real_4: 0.22124935686588287 (-0.07029103736082715) | > avg_loss_disc_real_5: 0.17445682734251022 (-0.11730053772528964) | > avg_loss_0: 2.696070432662964 (-0.3579435348510742) | > avg_loss_gen: 2.017186244328817 (-0.06604270140329982) | > avg_loss_kl: 4.335488796234131 (-0.29692967732747366) | > avg_loss_feat: 4.858278629680474 (+2.673712290823459) | > avg_loss_mel: 17.847004334131878 (+8.345231850941977) | > avg_loss_duration: 3.174717585245768 (-0.025170405705770005) | > avg_loss_1: 32.232675552368164 (+10.630802154541016)  > EPOCH: 933/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:20:35)   --> TIME: 2023-10-20 11:20:46 -- STEP: 9/50 -- GLOBAL_STEP: 99660 | > loss_disc: 2.427267074584961 (2.428820424609714) | > loss_disc_real_0: 0.0682797059416771 (0.14164702677064472) | > loss_disc_real_1: 0.2362322062253952 (0.23547525455554327) | > loss_disc_real_2: 0.22648262977600098 (0.24368919514947468) | > loss_disc_real_3: 0.421642929315567 (0.24363757628533575) | > loss_disc_real_4: 0.24491755664348602 (0.2375123682949278) | > loss_disc_real_5: 0.29169178009033203 (0.22534615877601835) | > loss_0: 2.427267074584961 (2.428820424609714) | > grad_norm_0: tensor(268.2531, device='cuda:0') (tensor(467.8835, device='cuda:0')) | > loss_gen: 2.4266679286956787 (2.3721119032965765) | > loss_kl: 0.6256265640258789 (0.9106666313277351) | > loss_feat: 3.6747403144836426 (5.339253370960553) | > loss_mel: 21.107070922851562 (18.57667308383518) | > loss_duration: 1.321603775024414 (1.367009957631429) | > loss_1: 29.155710220336914 (28.565715789794922) | > grad_norm_1: tensor(5995.5244, device='cuda:0') (tensor(14776.8682, device='cuda:0')) | > current_lr_0: 7.866977664413078e-05 | > current_lr_1: 7.866977664413078e-05 | > step_time: 0.9972 (0.6689019468095567) | > loader_time: 0.0475 (0.02392337057325575)  --> TIME: 2023-10-20 11:21:09 -- STEP: 39/50 -- GLOBAL_STEP: 99690 | > loss_disc: 2.5406627655029297 (2.412398475867051) | > loss_disc_real_0: 0.03419852256774902 (0.14436238397581458) | > loss_disc_real_1: 0.09848391264677048 (0.21135143314798674) | > loss_disc_real_2: 0.010329172946512699 (0.21732731376034328) | > loss_disc_real_3: 0.051615409553050995 (0.2404351117901313) | > loss_disc_real_4: 0.027491742745041847 (0.22492327468278697) | > loss_disc_real_5: 0.02097059041261673 (0.22496492449098673) | > loss_0: 2.5406627655029297 (2.412398475867051) | > grad_norm_0: tensor(1300.4586, device='cuda:0') (tensor(585.6689, device='cuda:0')) | > loss_gen: 1.7847938537597656 (2.370658504657256) | > loss_kl: -0.0086160684004426 (0.7641827966301487) | > loss_feat: 10.287665367126465 (6.117860680398269) | > loss_mel: 29.50535774230957 (20.861960227672874) | > loss_duration: 1.4006913900375366 (1.3576667981270032) | > loss_1: 42.96989440917969 (31.472329139709473) | > grad_norm_1: tensor(82849.5781, device='cuda:0') (tensor(22234.5527, device='cuda:0')) | > current_lr_0: 7.866977664413078e-05 | > current_lr_1: 7.866977664413078e-05 | > step_time: 0.3199 (0.7108961802262527) | > loader_time: 0.0251 (0.023606813870943506)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1586174964904785 (3.1586174964904785) | > loss_disc_real_0: 0.3270065486431122 (0.3270065486431122) | > loss_disc_real_1: 0.37071263790130615 (0.37071263790130615) | > loss_disc_real_2: 0.4356098473072052 (0.4356098473072052) | > loss_disc_real_3: 0.36609947681427 (0.36609947681427) | > loss_disc_real_4: 0.33722761273384094 (0.33722761273384094) | > loss_disc_real_5: 0.2627192437648773 (0.2627192437648773) | > loss_0: 3.1586174964904785 (3.1586174964904785) | > loss_gen: 2.587458610534668 (2.587458610534668) | > loss_kl: 4.516660213470459 (4.516660213470459) | > loss_feat: 7.083224773406982 (7.083224773406982) | > loss_mel: 23.303916931152344 (23.303916931152344) | > loss_duration: 2.9346394538879395 (2.9346394538879395) | > loss_1: 40.425899505615234 (40.425899505615234)  --> STEP: 1 | > loss_disc: 2.222303628921509 (2.222303628921509) | > loss_disc_real_0: 0.23117181658744812 (0.23117181658744812) | > loss_disc_real_1: 0.15665006637573242 (0.15665006637573242) | > loss_disc_real_2: 0.28712552785873413 (0.28712552785873413) | > loss_disc_real_3: 0.23950383067131042 (0.23950383067131042) | > loss_disc_real_4: 0.13851575553417206 (0.13851575553417206) | > loss_disc_real_5: 0.18133710324764252 (0.18133710324764252) | > loss_0: 2.222303628921509 (2.222303628921509) | > loss_gen: 2.6487956047058105 (2.6487956047058105) | > loss_kl: 5.223424434661865 (5.223424434661865) | > loss_feat: 8.67489242553711 (8.67489242553711) | > loss_mel: 22.409852981567383 (22.409852981567383) | > loss_duration: 3.3632595539093018 (3.3632595539093018) | > loss_1: 42.32022476196289 (42.32022476196289)  --> STEP: 2 | > loss_disc: 2.637857437133789 (2.430080533027649) | > loss_disc_real_0: 0.21633753180503845 (0.2237546741962433) | > loss_disc_real_1: 0.2187027931213379 (0.18767642974853516) | > loss_disc_real_2: 0.17741522192955017 (0.23227037489414215) | > loss_disc_real_3: 0.2981671094894409 (0.26883547008037567) | > loss_disc_real_4: 0.28516885638237 (0.21184230595827103) | > loss_disc_real_5: 0.3640937805175781 (0.2727154418826103) | > loss_0: 2.637857437133789 (2.430080533027649) | > loss_gen: 2.3941495418548584 (2.5214725732803345) | > loss_kl: 5.330951690673828 (5.277188062667847) | > loss_feat: 3.006425619125366 (5.840659022331238) | > loss_mel: 24.117725372314453 (23.263789176940918) | > loss_duration: 3.2471749782562256 (3.3052172660827637) | > loss_1: 38.0964241027832 (40.20832443237305)  --> STEP: 3 | > loss_disc: 2.9514660835266113 (2.603875716527303) | > loss_disc_real_0: 0.17101019620895386 (0.20617318153381348) | > loss_disc_real_1: 0.23502911627292633 (0.20346065858999887) | > loss_disc_real_2: 0.2757079303264618 (0.2467495600382487) | > loss_disc_real_3: 0.18887335062026978 (0.24218143026034036) | > loss_disc_real_4: 0.2939464747905731 (0.23921036223570505) | > loss_disc_real_5: 0.5853400826454163 (0.3769236554702123) | > loss_0: 2.9514660835266113 (2.603875716527303) | > loss_gen: 2.4283907413482666 (2.490445295969645) | > loss_kl: 2.4220516681671143 (4.3254759311676025) | > loss_feat: 5.527252674102783 (5.73619023958842) | > loss_mel: 23.879947662353516 (23.469175338745117) | > loss_duration: 2.96844482421875 (3.192959785461426) | > loss_1: 37.22608947753906 (39.214246114095054) --> EVAL PERFORMANCE | > avg_loader_time: 0.012133200963338217 (-0.0036652882893880214) | > avg_loss_disc: 2.603875716527303 (-0.09219471613566066) | > avg_loss_disc_real_0: 0.20617318153381348 (-0.03843623896439871) | > avg_loss_disc_real_1: 0.20346065858999887 (-0.06566449999809268) | > avg_loss_disc_real_2: 0.2467495600382487 (+0.017226258913675935) | > avg_loss_disc_real_3: 0.24218143026034036 (-0.005262454350789397) | > avg_loss_disc_real_4: 0.23921036223570505 (+0.017961005369822175) | > avg_loss_disc_real_5: 0.3769236554702123 (+0.20246682812770206) | > avg_loss_0: 2.603875716527303 (-0.09219471613566066) | > avg_loss_gen: 2.490445295969645 (+0.47325905164082815) | > avg_loss_kl: 4.3254759311676025 (-0.01001286506652832) | > avg_loss_feat: 5.73619023958842 (+0.8779116099079456) | > avg_loss_mel: 23.469175338745117 (+5.622171004613239) | > avg_loss_duration: 3.192959785461426 (+0.0182422002156577) | > avg_loss_1: 39.214246114095054 (+6.98157056172689)  > EPOCH: 934/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:21:26)   --> TIME: 2023-10-20 11:21:42 -- STEP: 19/50 -- GLOBAL_STEP: 99720 | > loss_disc: 2.687042236328125 (2.4360301306373193) | > loss_disc_real_0: 0.2935762405395508 (0.1484339599938769) | > loss_disc_real_1: 0.2026096135377884 (0.2240223480682624) | > loss_disc_real_2: 0.14565695822238922 (0.2382266890061529) | > loss_disc_real_3: 0.2608386278152466 (0.24013114318643747) | > loss_disc_real_4: 0.43633219599723816 (0.23995763573207357) | > loss_disc_real_5: 0.3894656300544739 (0.23845773758856872) | > loss_0: 2.687042236328125 (2.4360301306373193) | > grad_norm_0: tensor(897.9430, device='cuda:0') (tensor(566.4753, device='cuda:0')) | > loss_gen: 2.659924268722534 (2.356995745709068) | > loss_kl: 0.8607146739959717 (0.8077560788706729) | > loss_feat: 7.791385650634766 (5.926691437336175) | > loss_mel: 23.14791488647461 (20.346373143949005) | > loss_duration: 1.4671201705932617 (1.396338651054784) | > loss_1: 35.927059173583984 (30.834155233282793) | > grad_norm_1: tensor(18805.5898, device='cuda:0') (tensor(25499.2148, device='cuda:0')) | > current_lr_0: 7.859114127691074e-05 | > current_lr_1: 7.859114127691074e-05 | > step_time: 0.4983 (0.558303996136314) | > loader_time: 0.002 (0.01657406907332571)  --> TIME: 2023-10-20 11:21:59 -- STEP: 49/50 -- GLOBAL_STEP: 99750 | > loss_disc: 2.639333486557007 (2.498317567669616) | > loss_disc_real_0: 0.07172904908657074 (0.16182279892797982) | > loss_disc_real_1: 0.26136404275894165 (0.22505160527569906) | > loss_disc_real_2: 0.25946861505508423 (0.22966327959177446) | > loss_disc_real_3: 0.30999431014060974 (0.2383812142498031) | > loss_disc_real_4: 0.2773604989051819 (0.24662281162276564) | > loss_disc_real_5: 0.2693193256855011 (0.2394291815557042) | > loss_0: 2.639333486557007 (2.498317567669616) | > grad_norm_0: tensor(1077.4686, device='cuda:0') (tensor(719.1885, device='cuda:0')) | > loss_gen: 2.186614990234375 (2.258274275429395) | > loss_kl: 0.2630975842475891 (0.7392890304327011) | > loss_feat: 3.1884634494781494 (5.220793693725551) | > loss_mel: 22.492290496826172 (19.356098688378623) | > loss_duration: 1.4724897146224976 (1.3567827380433375) | > loss_1: 29.602956771850586 (28.931238476110963) | > grad_norm_1: tensor(12279.2490, device='cuda:0') (tensor(24477.2090, device='cuda:0')) | > current_lr_0: 7.859114127691074e-05 | > current_lr_1: 7.859114127691074e-05 | > step_time: 0.7498 (0.5500783968944936) | > loader_time: 0.4054 (0.023362563580882803)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0562891960144043 (2.0562891960144043) | > loss_disc_real_0: 0.13732025027275085 (0.13732025027275085) | > loss_disc_real_1: 0.17372769117355347 (0.17372769117355347) | > loss_disc_real_2: 0.20666979253292084 (0.20666979253292084) | > loss_disc_real_3: 0.33953750133514404 (0.33953750133514404) | > loss_disc_real_4: 0.16604508459568024 (0.16604508459568024) | > loss_disc_real_5: 0.15117956697940826 (0.15117956697940826) | > loss_0: 2.0562891960144043 (2.0562891960144043) | > loss_gen: 2.4616003036499023 (2.4616003036499023) | > loss_kl: 5.16256046295166 (5.16256046295166) | > loss_feat: 7.329136848449707 (7.329136848449707) | > loss_mel: 23.00986099243164 (23.00986099243164) | > loss_duration: 3.0435001850128174 (3.0435001850128174) | > loss_1: 41.006656646728516 (41.006656646728516)  --> STEP: 1 | > loss_disc: 2.9049856662750244 (2.9049856662750244) | > loss_disc_real_0: 0.24213016033172607 (0.24213016033172607) | > loss_disc_real_1: 0.26034119725227356 (0.26034119725227356) | > loss_disc_real_2: 0.3975464105606079 (0.3975464105606079) | > loss_disc_real_3: 0.1870889961719513 (0.1870889961719513) | > loss_disc_real_4: 0.3372235596179962 (0.3372235596179962) | > loss_disc_real_5: 0.1721661239862442 (0.1721661239862442) | > loss_0: 2.9049856662750244 (2.9049856662750244) | > loss_gen: 1.8955464363098145 (1.8955464363098145) | > loss_kl: 5.2039713859558105 (5.2039713859558105) | > loss_feat: 5.182802200317383 (5.182802200317383) | > loss_mel: 24.28894805908203 (24.28894805908203) | > loss_duration: 3.416642904281616 (3.416642904281616) | > loss_1: 39.98790740966797 (39.98790740966797)  --> STEP: 2 | > loss_disc: 2.9801137447357178 (2.942549705505371) | > loss_disc_real_0: 0.26014089584350586 (0.25113552808761597) | > loss_disc_real_1: 0.27673661708831787 (0.2685389071702957) | > loss_disc_real_2: 0.311688095331192 (0.35461725294589996) | > loss_disc_real_3: 0.2768666446208954 (0.23197782039642334) | > loss_disc_real_4: 0.25482383370399475 (0.2960236966609955) | > loss_disc_real_5: 0.2538916766643524 (0.2130289003252983) | > loss_0: 2.9801137447357178 (2.942549705505371) | > loss_gen: 1.6691198348999023 (1.7823331356048584) | > loss_kl: 5.429928302764893 (5.316949844360352) | > loss_feat: 0.2037472128868103 (2.6932747066020966) | > loss_mel: 2.5611140727996826 (13.425031065940857) | > loss_duration: 3.157727003097534 (3.287184953689575) | > loss_1: 13.021636962890625 (26.504772186279297)  --> STEP: 3 | > loss_disc: 2.927473545074463 (2.9375243186950684) | > loss_disc_real_0: 0.41189226508140564 (0.30472110708554584) | > loss_disc_real_1: 0.2729015350341797 (0.269993116458257) | > loss_disc_real_2: 0.3070685863494873 (0.3387676974137624) | > loss_disc_real_3: 0.27425092458724976 (0.24606885512669882) | > loss_disc_real_4: 0.27991488575935364 (0.29065409302711487) | > loss_disc_real_5: 0.2390591949224472 (0.22170566519101462) | > loss_0: 2.927473545074463 (2.9375243186950684) | > loss_gen: 2.0230867862701416 (1.8625843524932861) | > loss_kl: 2.4098453521728516 (4.347915013631185) | > loss_feat: 0.6704816818237305 (2.019010365009308) | > loss_mel: 15.103358268737793 (13.984473466873169) | > loss_duration: 3.0888335704803467 (3.2210678259531655) | > loss_1: 23.295604705810547 (25.435049692789715) --> EVAL PERFORMANCE | > avg_loader_time: 0.024409135182698567 (+0.01227593421936035) | > avg_loss_disc: 2.9375243186950684 (+0.33364860216776515) | > avg_loss_disc_real_0: 0.30472110708554584 (+0.09854792555173236) | > avg_loss_disc_real_1: 0.269993116458257 (+0.06653245786825815) | > avg_loss_disc_real_2: 0.3387676974137624 (+0.0920181373755137) | > avg_loss_disc_real_3: 0.24606885512669882 (+0.0038874248663584576) | > avg_loss_disc_real_4: 0.29065409302711487 (+0.05144373079140982) | > avg_loss_disc_real_5: 0.22170566519101462 (-0.15521799027919767) | > avg_loss_0: 2.9375243186950684 (+0.33364860216776515) | > avg_loss_gen: 1.8625843524932861 (-0.6278609434763589) | > avg_loss_kl: 4.347915013631185 (+0.02243908246358206) | > avg_loss_feat: 2.019010365009308 (-3.717179874579112) | > avg_loss_mel: 13.984473466873169 (-9.484701871871948) | > avg_loss_duration: 3.2210678259531655 (+0.02810804049173976) | > avg_loss_1: 25.435049692789715 (-13.77919642130534)  > EPOCH: 935/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:22:11)   --> TIME: 2023-10-20 11:22:31 -- STEP: 29/50 -- GLOBAL_STEP: 99780 | > loss_disc: 3.0781614780426025 (2.5189724790638897) | > loss_disc_real_0: 0.25746965408325195 (0.16334348493095102) | > loss_disc_real_1: 0.2829098403453827 (0.21929586935659934) | > loss_disc_real_2: 0.22521860897541046 (0.23388888558437085) | > loss_disc_real_3: 0.2220369577407837 (0.2313025014410759) | > loss_disc_real_4: 0.28543564677238464 (0.2313135239327776) | > loss_disc_real_5: 0.2700967788696289 (0.21982391625000486) | > loss_0: 3.0781614780426025 (2.5189724790638897) | > grad_norm_0: tensor(4850.4131, device='cuda:0') (tensor(1018.5819, device='cuda:0')) | > loss_gen: 1.5782713890075684 (2.278436377130706) | > loss_kl: 1.190212368965149 (0.7953392334025482) | > loss_feat: 0.2399722933769226 (5.8749730224753245) | > loss_mel: 12.02481746673584 (20.47798150161217) | > loss_duration: 1.3066506385803223 (1.3548119602532223) | > loss_1: 16.339923858642578 (30.78154205453807) | > grad_norm_1: tensor(13614.7979, device='cuda:0') (tensor(28145.6758, device='cuda:0')) | > current_lr_0: 7.851258451066355e-05 | > current_lr_1: 7.851258451066355e-05 | > step_time: 0.7745 (0.48927789720995674) | > loader_time: 0.0069 (0.01580030342628216)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8139545917510986 (2.8139545917510986) | > loss_disc_real_0: 0.14418542385101318 (0.14418542385101318) | > loss_disc_real_1: 0.22802703082561493 (0.22802703082561493) | > loss_disc_real_2: 0.23698031902313232 (0.23698031902313232) | > loss_disc_real_3: 0.2467247098684311 (0.2467247098684311) | > loss_disc_real_4: 0.24504531919956207 (0.24504531919956207) | > loss_disc_real_5: 0.2651621699333191 (0.2651621699333191) | > loss_0: 2.8139545917510986 (2.8139545917510986) | > loss_gen: 1.5609484910964966 (1.5609484910964966) | > loss_kl: 4.964859485626221 (4.964859485626221) | > loss_feat: 0.6079998016357422 (0.6079998016357422) | > loss_mel: 14.257035255432129 (14.257035255432129) | > loss_duration: 2.98576021194458 (2.98576021194458) | > loss_1: 24.376604080200195 (24.376604080200195)  --> STEP: 1 | > loss_disc: 2.092130422592163 (2.092130422592163) | > loss_disc_real_0: 0.2366783320903778 (0.2366783320903778) | > loss_disc_real_1: 0.156455859541893 (0.156455859541893) | > loss_disc_real_2: 0.18103772401809692 (0.18103772401809692) | > loss_disc_real_3: 0.15031202137470245 (0.15031202137470245) | > loss_disc_real_4: 0.19599954783916473 (0.19599954783916473) | > loss_disc_real_5: 0.14028692245483398 (0.14028692245483398) | > loss_0: 2.092130422592163 (2.092130422592163) | > loss_gen: 2.2841744422912598 (2.2841744422912598) | > loss_kl: 5.4275031089782715 (5.4275031089782715) | > loss_feat: 7.643012046813965 (7.643012046813965) | > loss_mel: 21.557775497436523 (21.557775497436523) | > loss_duration: 3.3959550857543945 (3.3959550857543945) | > loss_1: 40.30841827392578 (40.30841827392578)  --> STEP: 2 | > loss_disc: 3.0300588607788086 (2.561094641685486) | > loss_disc_real_0: 0.17725813388824463 (0.20696823298931122) | > loss_disc_real_1: 0.24538962543010712 (0.20092274248600006) | > loss_disc_real_2: 0.2715316116809845 (0.2262846678495407) | > loss_disc_real_3: 0.2522025406360626 (0.20125728100538254) | > loss_disc_real_4: 0.25617584586143494 (0.22608769685029984) | > loss_disc_real_5: 0.2745959162712097 (0.20744141936302185) | > loss_0: 3.0300588607788086 (2.561094641685486) | > loss_gen: 1.4720420837402344 (1.878108263015747) | > loss_kl: 5.891765117645264 (5.659634113311768) | > loss_feat: 0.11090660840272903 (3.876959327608347) | > loss_mel: 1.612058401107788 (11.584916949272156) | > loss_duration: 3.2178478240966797 (3.306901454925537) | > loss_1: 12.304619789123535 (26.306519031524658)  --> STEP: 3 | > loss_disc: 2.448590040206909 (2.5235931078592935) | > loss_disc_real_0: 0.11918479204177856 (0.17770708600680032) | > loss_disc_real_1: 0.19501309096813202 (0.19895285864671072) | > loss_disc_real_2: 0.1527298092842102 (0.2017663816610972) | > loss_disc_real_3: 0.22855384647846222 (0.21035613616307577) | > loss_disc_real_4: 0.20121456682682037 (0.21779665350914001) | > loss_disc_real_5: 0.1773906946182251 (0.19742451111475626) | > loss_0: 2.448590040206909 (2.5235931078592935) | > loss_gen: 1.7403240203857422 (1.8321801821390789) | > loss_kl: 2.370823860168457 (4.563364028930664) | > loss_feat: 2.098764657974243 (3.284227771063646) | > loss_mel: 17.461931228637695 (13.543921709060669) | > loss_duration: 3.063401460647583 (3.2257347901662192) | > loss_1: 26.735244750976562 (26.449427604675293) --> EVAL PERFORMANCE | > avg_loader_time: 0.002419551213582357 (-0.02198958396911621) | > avg_loss_disc: 2.5235931078592935 (-0.4139312108357749) | > avg_loss_disc_real_0: 0.17770708600680032 (-0.12701402107874551) | > avg_loss_disc_real_1: 0.19895285864671072 (-0.0710402578115463) | > avg_loss_disc_real_2: 0.2017663816610972 (-0.1370013157526652) | > avg_loss_disc_real_3: 0.21035613616307577 (-0.03571271896362305) | > avg_loss_disc_real_4: 0.21779665350914001 (-0.07285743951797485) | > avg_loss_disc_real_5: 0.19742451111475626 (-0.02428115407625836) | > avg_loss_0: 2.5235931078592935 (-0.4139312108357749) | > avg_loss_gen: 1.8321801821390789 (-0.030404170354207283) | > avg_loss_kl: 4.563364028930664 (+0.21544901529947946) | > avg_loss_feat: 3.284227771063646 (+1.265217406054338) | > avg_loss_mel: 13.543921709060669 (-0.4405517578125) | > avg_loss_duration: 3.2257347901662192 (+0.0046669642130536815) | > avg_loss_1: 26.449427604675293 (+1.0143779118855782)  > EPOCH: 936/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:22:59)   --> TIME: 2023-10-20 11:23:10 -- STEP: 9/50 -- GLOBAL_STEP: 99810 | > loss_disc: 2.7642998695373535 (2.2756630976994834) | > loss_disc_real_0: 0.13549832999706268 (0.15170065417057937) | > loss_disc_real_1: 0.35139891505241394 (0.20593517728977734) | > loss_disc_real_2: 0.34100955724716187 (0.2582642311851184) | > loss_disc_real_3: 0.37617501616477966 (0.20969240532981026) | > loss_disc_real_4: 0.24618655443191528 (0.1643681517905659) | > loss_disc_real_5: 0.34713923931121826 (0.17347215819689962) | > loss_0: 2.7642998695373535 (2.2756630976994834) | > grad_norm_0: tensor(482.9164, device='cuda:0') (tensor(711.6466, device='cuda:0')) | > loss_gen: 2.5649049282073975 (2.3887134790420532) | > loss_kl: 0.5555935502052307 (0.730162748032146) | > loss_feat: 3.9655284881591797 (6.580489549371931) | > loss_mel: 25.838462829589844 (21.712866730160183) | > loss_duration: 1.3287094831466675 (1.3744037283791437) | > loss_1: 34.253196716308594 (32.78663561079237) | > grad_norm_1: tensor(3911.8918, device='cuda:0') (tensor(14115.0625, device='cuda:0')) | > current_lr_0: 7.843410626682263e-05 | > current_lr_1: 7.843410626682263e-05 | > step_time: 0.3952 (0.5906118816799588) | > loader_time: 0.0027 (0.014063543743557401)  --> TIME: 2023-10-20 11:23:30 -- STEP: 39/50 -- GLOBAL_STEP: 99840 | > loss_disc: 2.749762535095215 (2.527424448575729) | > loss_disc_real_0: 0.31453099846839905 (0.16194950994581747) | > loss_disc_real_1: 0.38914206624031067 (0.2358338366716336) | > loss_disc_real_2: 0.19319194555282593 (0.23782888570657143) | > loss_disc_real_3: 0.25513818860054016 (0.23975795328330535) | > loss_disc_real_4: 0.2447877824306488 (0.20789310154624474) | > loss_disc_real_5: 0.13538016378879547 (0.21503020202120146) | > loss_0: 2.749762535095215 (2.527424448575729) | > grad_norm_0: tensor(1168.8588, device='cuda:0') (tensor(711.4683, device='cuda:0')) | > loss_gen: 2.3912904262542725 (2.1539809520428) | > loss_kl: 0.7386841177940369 (0.7946045119792987) | > loss_feat: 3.604302406311035 (4.779545035881874) | > loss_mel: 19.598596572875977 (18.084919883654667) | > loss_duration: 1.4502657651901245 (1.3592109313377967) | > loss_1: 27.783140182495117 (27.17226122587155) | > grad_norm_1: tensor(16368.4277, device='cuda:0') (tensor(28890.9102, device='cuda:0')) | > current_lr_0: 7.843410626682263e-05 | > current_lr_1: 7.843410626682263e-05 | > step_time: 0.8166 (0.6177073808816762) | > loader_time: 0.0189 (0.020878076553344727)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0815138816833496 (3.0815138816833496) | > loss_disc_real_0: 0.5091726779937744 (0.5091726779937744) | > loss_disc_real_1: 0.33055269718170166 (0.33055269718170166) | > loss_disc_real_2: 0.29834869503974915 (0.29834869503974915) | > loss_disc_real_3: 0.3636344075202942 (0.3636344075202942) | > loss_disc_real_4: 0.40394192934036255 (0.40394192934036255) | > loss_disc_real_5: 0.4726203680038452 (0.4726203680038452) | > loss_0: 3.0815138816833496 (3.0815138816833496) | > loss_gen: 3.1087684631347656 (3.1087684631347656) | > loss_kl: 5.511543273925781 (5.511543273925781) | > loss_feat: 5.345828533172607 (5.345828533172607) | > loss_mel: 23.239831924438477 (23.239831924438477) | > loss_duration: 3.072463035583496 (3.072463035583496) | > loss_1: 40.278438568115234 (40.278438568115234)  --> STEP: 1 | > loss_disc: 1.8049654960632324 (1.8049654960632324) | > loss_disc_real_0: 0.06453625857830048 (0.06453625857830048) | > loss_disc_real_1: 0.2335774004459381 (0.2335774004459381) | > loss_disc_real_2: 0.1772402822971344 (0.1772402822971344) | > loss_disc_real_3: 0.16490410268306732 (0.16490410268306732) | > loss_disc_real_4: 0.18693877756595612 (0.18693877756595612) | > loss_disc_real_5: 0.15724334120750427 (0.15724334120750427) | > loss_0: 1.8049654960632324 (1.8049654960632324) | > loss_gen: 3.0349411964416504 (3.0349411964416504) | > loss_kl: 4.962825775146484 (4.962825775146484) | > loss_feat: 6.515028476715088 (6.515028476715088) | > loss_mel: 20.33616828918457 (20.33616828918457) | > loss_duration: 3.2465438842773438 (3.2465438842773438) | > loss_1: 38.09550857543945 (38.09550857543945)  --> STEP: 2 | > loss_disc: 2.4083735942840576 (2.106669545173645) | > loss_disc_real_0: 0.2603604197502136 (0.16244833916425705) | > loss_disc_real_1: 0.13697940111160278 (0.18527840077877045) | > loss_disc_real_2: 0.2278635948896408 (0.2025519385933876) | > loss_disc_real_3: 0.24989166855812073 (0.20739788562059402) | > loss_disc_real_4: 0.28838932514190674 (0.23766405135393143) | > loss_disc_real_5: 0.5131575465202332 (0.3352004438638687) | > loss_0: 2.4083735942840576 (2.106669545173645) | > loss_gen: 2.980349540710449 (3.00764536857605) | > loss_kl: 5.9988484382629395 (5.480837106704712) | > loss_feat: 9.651445388793945 (8.083236932754517) | > loss_mel: 25.12603759765625 (22.73110294342041) | > loss_duration: 3.260537624359131 (3.2535407543182373) | > loss_1: 47.017215728759766 (42.55636215209961)  --> STEP: 3 | > loss_disc: 2.825380563735962 (2.3462398846944175) | > loss_disc_real_0: 0.19016525149345398 (0.17168730994065604) | > loss_disc_real_1: 0.30338236689567566 (0.22464638948440552) | > loss_disc_real_2: 0.29334592819213867 (0.23281660179297128) | > loss_disc_real_3: 0.35275596380233765 (0.2558505783478419) | > loss_disc_real_4: 0.40302225947380066 (0.2927834540605545) | > loss_disc_real_5: 0.3051455318927765 (0.32518213987350464) | > loss_0: 2.825380563735962 (2.3462398846944175) | > loss_gen: 2.4524827003479004 (2.8225911458333335) | > loss_kl: 2.7142763137817383 (4.558650175730388) | > loss_feat: 4.044268608093262 (6.736914157867432) | > loss_mel: 18.8697566986084 (21.443987528483074) | > loss_duration: 2.9327738285064697 (3.146618445714315) | > loss_1: 31.01355743408203 (38.708760579427086) --> EVAL PERFORMANCE | > avg_loader_time: 0.020404259363810223 (+0.017984708150227867) | > avg_loss_disc: 2.3462398846944175 (-0.177353223164876) | > avg_loss_disc_real_0: 0.17168730994065604 (-0.006019776066144289) | > avg_loss_disc_real_1: 0.22464638948440552 (+0.025693530837694795) | > avg_loss_disc_real_2: 0.23281660179297128 (+0.031050220131874084) | > avg_loss_disc_real_3: 0.2558505783478419 (+0.04549444218476614) | > avg_loss_disc_real_4: 0.2927834540605545 (+0.07498680055141449) | > avg_loss_disc_real_5: 0.32518213987350464 (+0.12775762875874838) | > avg_loss_0: 2.3462398846944175 (-0.177353223164876) | > avg_loss_gen: 2.8225911458333335 (+0.9904109636942546) | > avg_loss_kl: 4.558650175730388 (-0.004713853200276397) | > avg_loss_feat: 6.736914157867432 (+3.452686386803786) | > avg_loss_mel: 21.443987528483074 (+7.900065819422405) | > avg_loss_duration: 3.146618445714315 (-0.0791163444519043) | > avg_loss_1: 38.708760579427086 (+12.259332974751793)  > EPOCH: 937/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:23:50)   --> TIME: 2023-10-20 11:24:06 -- STEP: 19/50 -- GLOBAL_STEP: 99870 | > loss_disc: 1.404922604560852 (2.2809261993358008) | > loss_disc_real_0: 0.09689077734947205 (0.13172174443637855) | > loss_disc_real_1: 0.24966458976268768 (0.23503822058831392) | > loss_disc_real_2: 0.11777831614017487 (0.2162629448269543) | > loss_disc_real_3: 0.1275434046983719 (0.21951056369825414) | > loss_disc_real_4: 0.034413889050483704 (0.18401533620137916) | > loss_disc_real_5: 0.012604604475200176 (0.1925942678690741) | > loss_0: 1.404922604560852 (2.2809261993358008) | > grad_norm_0: tensor(540.0516, device='cuda:0') (tensor(604.4036, device='cuda:0')) | > loss_gen: 3.497358560562134 (2.3890182532762223) | > loss_kl: 0.6531547904014587 (0.7639527634570473) | > loss_feat: 13.559480667114258 (5.781633811561685) | > loss_mel: 37.49633026123047 (20.70138645172119) | > loss_duration: 1.45842707157135 (1.3761534000697888) | > loss_1: 56.66475296020508 (31.012144992226048) | > grad_norm_1: tensor(75611.9297, device='cuda:0') (tensor(33320.1133, device='cuda:0')) | > current_lr_0: 7.835570646689988e-05 | > current_lr_1: 7.835570646689988e-05 | > step_time: 0.4926 (0.5274942297684518) | > loader_time: 0.002 (0.018629789352416992)  --> TIME: 2023-10-20 11:24:27 -- STEP: 49/50 -- GLOBAL_STEP: 99900 | > loss_disc: 1.990086317062378 (2.3839196003213217) | > loss_disc_real_0: 0.12829571962356567 (0.151989950636896) | > loss_disc_real_1: 0.24115359783172607 (0.2155492557402776) | > loss_disc_real_2: 0.2083148956298828 (0.2119321930317246) | > loss_disc_real_3: 0.18214257061481476 (0.22738317727130286) | > loss_disc_real_4: 0.15346865355968475 (0.21225733015382167) | > loss_disc_real_5: 0.15088792145252228 (0.22576151804390307) | > loss_0: 1.990086317062378 (2.3839196003213217) | > grad_norm_0: tensor(680.5346, device='cuda:0') (tensor(630.1472, device='cuda:0')) | > loss_gen: 2.9473657608032227 (2.31159829363531) | > loss_kl: 0.5549338459968567 (0.7999017852909711) | > loss_feat: 7.52392578125 (5.566197057615738) | > loss_mel: 26.71422004699707 (19.886607437717682) | > loss_duration: 1.5226984024047852 (1.3613705051188572) | > loss_1: 39.26314163208008 (29.925674963970575) | > grad_norm_1: tensor(88535.0312, device='cuda:0') (tensor(28436.7773, device='cuda:0')) | > current_lr_0: 7.835570646689988e-05 | > current_lr_1: 7.835570646689988e-05 | > step_time: 0.9249 (0.613925486194844) | > loader_time: 0.4211 (0.028795047682158806)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2937400341033936 (2.2937400341033936) | > loss_disc_real_0: 0.3104894161224365 (0.3104894161224365) | > loss_disc_real_1: 0.37134677171707153 (0.37134677171707153) | > loss_disc_real_2: 0.21427753567695618 (0.21427753567695618) | > loss_disc_real_3: 0.24563339352607727 (0.24563339352607727) | > loss_disc_real_4: 0.21716664731502533 (0.21716664731502533) | > loss_disc_real_5: 0.2567954957485199 (0.2567954957485199) | > loss_0: 2.2937400341033936 (2.2937400341033936) | > loss_gen: 2.978679895401001 (2.978679895401001) | > loss_kl: 5.079521656036377 (5.079521656036377) | > loss_feat: 7.392874240875244 (7.392874240875244) | > loss_mel: 21.870746612548828 (21.870746612548828) | > loss_duration: 3.036487340927124 (3.036487340927124) | > loss_1: 40.35831069946289 (40.35831069946289)  --> STEP: 1 | > loss_disc: 1.7246896028518677 (1.7246896028518677) | > loss_disc_real_0: 0.08048881590366364 (0.08048881590366364) | > loss_disc_real_1: 0.20103204250335693 (0.20103204250335693) | > loss_disc_real_2: 0.10217241942882538 (0.10217241942882538) | > loss_disc_real_3: 0.15469354391098022 (0.15469354391098022) | > loss_disc_real_4: 0.07863876968622208 (0.07863876968622208) | > loss_disc_real_5: 0.052479080855846405 (0.052479080855846405) | > loss_0: 1.7246896028518677 (1.7246896028518677) | > loss_gen: 2.294071912765503 (2.294071912765503) | > loss_kl: 5.009674549102783 (5.009674549102783) | > loss_feat: 8.832271575927734 (8.832271575927734) | > loss_mel: 22.346792221069336 (22.346792221069336) | > loss_duration: 3.346428394317627 (3.346428394317627) | > loss_1: 41.8292350769043 (41.8292350769043)  --> STEP: 2 | > loss_disc: 1.772199034690857 (1.7484443187713623) | > loss_disc_real_0: 0.07140373438596725 (0.07594627514481544) | > loss_disc_real_1: 0.0889861211180687 (0.14500908181071281) | > loss_disc_real_2: 0.10345731675624847 (0.10281486809253693) | > loss_disc_real_3: 0.1790885627269745 (0.16689105331897736) | > loss_disc_real_4: 0.022700639441609383 (0.05066970456391573) | > loss_disc_real_5: 0.010247020982205868 (0.031363050919026136) | > loss_0: 1.772199034690857 (1.7484443187713623) | > loss_gen: 2.1237151622772217 (2.2088935375213623) | > loss_kl: 5.825215816497803 (5.417445182800293) | > loss_feat: 12.08726978302002 (10.459770679473877) | > loss_mel: 23.729846954345703 (23.03831958770752) | > loss_duration: 3.3115618228912354 (3.328995108604431) | > loss_1: 47.07761001586914 (44.45342254638672)  --> STEP: 3 | > loss_disc: 2.9562363624572754 (2.1510416666666665) | > loss_disc_real_0: 0.22064536809921265 (0.12417930612961452) | > loss_disc_real_1: 0.34747350215911865 (0.21249722192684808) | > loss_disc_real_2: 0.245458722114563 (0.15036281943321228) | > loss_disc_real_3: 0.2612825334072113 (0.19835488001505533) | > loss_disc_real_4: 0.3263547718524933 (0.14256472699344158) | > loss_disc_real_5: 0.33004525303840637 (0.13092378495881954) | > loss_0: 2.9562363624572754 (2.1510416666666665) | > loss_gen: 1.8883146047592163 (2.1020338932673135) | > loss_kl: 2.557705879211426 (4.464198748270671) | > loss_feat: 1.8076328039169312 (7.575724720954895) | > loss_mel: 19.223405838012695 (21.766681671142578) | > loss_duration: 3.0702555179595947 (3.242748578389486) | > loss_1: 28.54731559753418 (39.1513868967692) --> EVAL PERFORMANCE | > avg_loader_time: 0.0229032039642334 (+0.002498944600423176) | > avg_loss_disc: 2.1510416666666665 (-0.19519821802775095) | > avg_loss_disc_real_0: 0.12417930612961452 (-0.04750800381104152) | > avg_loss_disc_real_1: 0.21249722192684808 (-0.012149167557557433) | > avg_loss_disc_real_2: 0.15036281943321228 (-0.082453782359759) | > avg_loss_disc_real_3: 0.19835488001505533 (-0.05749569833278659) | > avg_loss_disc_real_4: 0.14256472699344158 (-0.15021872706711292) | > avg_loss_disc_real_5: 0.13092378495881954 (-0.1942583549146851) | > avg_loss_0: 2.1510416666666665 (-0.19519821802775095) | > avg_loss_gen: 2.1020338932673135 (-0.72055725256602) | > avg_loss_kl: 4.464198748270671 (-0.0944514274597168) | > avg_loss_feat: 7.575724720954895 (+0.8388105630874634) | > avg_loss_mel: 21.766681671142578 (+0.322694142659504) | > avg_loss_duration: 3.242748578389486 (+0.0961301326751709) | > avg_loss_1: 39.1513868967692 (+0.44262631734211766)  > EPOCH: 938/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:24:40)   --> TIME: 2023-10-20 11:25:04 -- STEP: 29/50 -- GLOBAL_STEP: 99930 | > loss_disc: 2.7275705337524414 (2.5011250232828073) | > loss_disc_real_0: 0.1621643453836441 (0.14593246309407823) | > loss_disc_real_1: 0.26075777411460876 (0.23120176984832205) | > loss_disc_real_2: 0.18230697512626648 (0.22839728550150476) | > loss_disc_real_3: 0.24291691184043884 (0.2440852925566764) | > loss_disc_real_4: 0.24541699886322021 (0.22802490432714595) | > loss_disc_real_5: 0.19760239124298096 (0.2453216936375046) | > loss_0: 2.7275705337524414 (2.5011250232828073) | > grad_norm_0: tensor(1151.6040, device='cuda:0') (tensor(1002.3427, device='cuda:0')) | > loss_gen: 1.652506709098816 (2.305528455767138) | > loss_kl: 0.5409752726554871 (0.7635316417135042) | > loss_feat: 0.991563618183136 (5.314878472737197) | > loss_mel: 14.424824714660645 (20.261040432699794) | > loss_duration: 1.4143202304840088 (1.36607695036921) | > loss_1: 19.024188995361328 (30.011055633939545) | > grad_norm_1: tensor(11495.8027, device='cuda:0') (tensor(31393.5449, device='cuda:0')) | > current_lr_0: 7.827738503248572e-05 | > current_lr_1: 7.827738503248572e-05 | > step_time: 0.4407 (0.610432633038225) | > loader_time: 0.0392 (0.027066904923011517)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0653905868530273 (3.0653905868530273) | > loss_disc_real_0: 0.3107154369354248 (0.3107154369354248) | > loss_disc_real_1: 0.3407951593399048 (0.3407951593399048) | > loss_disc_real_2: 0.35829925537109375 (0.35829925537109375) | > loss_disc_real_3: 0.3284735679626465 (0.3284735679626465) | > loss_disc_real_4: 0.40214183926582336 (0.40214183926582336) | > loss_disc_real_5: 0.5141760110855103 (0.5141760110855103) | > loss_0: 3.0653905868530273 (3.0653905868530273) | > loss_gen: 2.827134132385254 (2.827134132385254) | > loss_kl: 4.908242702484131 (4.908242702484131) | > loss_feat: 6.461226940155029 (6.461226940155029) | > loss_mel: 24.573522567749023 (24.573522567749023) | > loss_duration: 2.977325439453125 (2.977325439453125) | > loss_1: 41.74745178222656 (41.74745178222656)  --> STEP: 1 | > loss_disc: 2.478294610977173 (2.478294610977173) | > loss_disc_real_0: 0.1431499868631363 (0.1431499868631363) | > loss_disc_real_1: 0.3814932703971863 (0.3814932703971863) | > loss_disc_real_2: 0.3318043351173401 (0.3318043351173401) | > loss_disc_real_3: 0.27799567580223083 (0.27799567580223083) | > loss_disc_real_4: 0.20666895806789398 (0.20666895806789398) | > loss_disc_real_5: 0.392942875623703 (0.392942875623703) | > loss_0: 2.478294610977173 (2.478294610977173) | > loss_gen: 3.168358325958252 (3.168358325958252) | > loss_kl: 5.055841445922852 (5.055841445922852) | > loss_feat: 7.351807594299316 (7.351807594299316) | > loss_mel: 26.790695190429688 (26.790695190429688) | > loss_duration: 3.3462347984313965 (3.3462347984313965) | > loss_1: 45.71293640136719 (45.71293640136719)  --> STEP: 2 | > loss_disc: 2.989262104034424 (2.7337783575057983) | > loss_disc_real_0: 0.21924057602882385 (0.18119528144598007) | > loss_disc_real_1: 0.2865021824836731 (0.3339977264404297) | > loss_disc_real_2: 0.26489710807800293 (0.2983507215976715) | > loss_disc_real_3: 0.27802133560180664 (0.27800850570201874) | > loss_disc_real_4: 0.20676791667938232 (0.20671843737363815) | > loss_disc_real_5: 0.24192065000534058 (0.3174317628145218) | > loss_0: 2.989262104034424 (2.7337783575057983) | > loss_gen: 1.5179702043533325 (2.3431642651557922) | > loss_kl: 5.478600025177002 (5.267220735549927) | > loss_feat: 0.1334909349679947 (3.7426492646336555) | > loss_mel: 2.7637789249420166 (14.777237057685852) | > loss_duration: 3.26808500289917 (3.307159900665283) | > loss_1: 13.161924362182617 (29.437430381774902)  --> STEP: 3 | > loss_disc: 1.3200738430023193 (2.262543519337972) | > loss_disc_real_0: 0.02917274832725525 (0.13052110373973846) | > loss_disc_real_1: 0.101533442735672 (0.2565096318721771) | > loss_disc_real_2: 0.048315320163965225 (0.21500558778643608) | > loss_disc_real_3: 0.10149689018726349 (0.21917130053043365) | > loss_disc_real_4: 0.06536609679460526 (0.1596009905139605) | > loss_disc_real_5: 0.026375101879239082 (0.22041287583609423) | > loss_0: 1.3200738430023193 (2.262543519337972) | > loss_gen: 2.533872365951538 (2.4067336320877075) | > loss_kl: 2.7398874759674072 (4.424776315689087) | > loss_feat: 9.361858367919922 (5.615718965729077) | > loss_mel: 28.566274642944336 (19.37358291943868) | > loss_duration: 2.9149274826049805 (3.176415761311849) | > loss_1: 46.1168212890625 (34.997227350870766) --> EVAL PERFORMANCE | > avg_loader_time: 0.006357590357462565 (-0.016545613606770832) | > avg_loss_disc: 2.262543519337972 (+0.11150185267130563) | > avg_loss_disc_real_0: 0.13052110373973846 (+0.006341797610123948) | > avg_loss_disc_real_1: 0.2565096318721771 (+0.04401240994532904) | > avg_loss_disc_real_2: 0.21500558778643608 (+0.0646427683532238) | > avg_loss_disc_real_3: 0.21917130053043365 (+0.020816420515378325) | > avg_loss_disc_real_4: 0.1596009905139605 (+0.01703626352051893) | > avg_loss_disc_real_5: 0.22041287583609423 (+0.08948909087727469) | > avg_loss_0: 2.262543519337972 (+0.11150185267130563) | > avg_loss_gen: 2.4067336320877075 (+0.30469973882039403) | > avg_loss_kl: 4.424776315689087 (-0.039422432581583955) | > avg_loss_feat: 5.615718965729077 (-1.9600057552258177) | > avg_loss_mel: 19.37358291943868 (-2.3930987517038993) | > avg_loss_duration: 3.176415761311849 (-0.06633281707763672) | > avg_loss_1: 34.997227350870766 (-4.1541595458984375)  > EPOCH: 939/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:25:32)   --> TIME: 2023-10-20 11:25:42 -- STEP: 9/50 -- GLOBAL_STEP: 99960 | > loss_disc: 1.7582951784133911 (2.337518480088976) | > loss_disc_real_0: 0.026206575334072113 (0.17777368426322937) | > loss_disc_real_1: 0.2405167520046234 (0.27336298591560787) | > loss_disc_real_2: 0.13314533233642578 (0.24735115758246845) | > loss_disc_real_3: 0.2726981043815613 (0.2413630464838611) | > loss_disc_real_4: 0.08723907917737961 (0.21413755085733202) | > loss_disc_real_5: 0.09476746618747711 (0.23721927073266771) | > loss_0: 1.7582951784133911 (2.337518480088976) | > grad_norm_0: tensor(700.3952, device='cuda:0') (tensor(1589.6482, device='cuda:0')) | > loss_gen: 2.638056755065918 (2.589880837334527) | > loss_kl: 0.5464650392532349 (0.7556463711791568) | > loss_feat: 8.320196151733398 (5.973981906970342) | > loss_mel: 22.413774490356445 (19.938130802578396) | > loss_duration: 1.350586175918579 (1.3776265250311956) | > loss_1: 35.26907730102539 (30.6352661980523) | > grad_norm_1: tensor(15965.2051, device='cuda:0') (tensor(53089.6445, device='cuda:0')) | > current_lr_0: 7.819914188524891e-05 | > current_lr_1: 7.819914188524891e-05 | > step_time: 0.9199 (0.49311357074313694) | > loader_time: 0.0333 (0.013974984486897787)  --> TIME: 2023-10-20 11:26:00 -- STEP: 39/50 -- GLOBAL_STEP: 99990 | > loss_disc: 1.9651615619659424 (2.405816344114451) | > loss_disc_real_0: 0.10629143565893173 (0.15002403508585235) | > loss_disc_real_1: 0.18696695566177368 (0.24370241547242188) | > loss_disc_real_2: 0.15420344471931458 (0.21709908965306404) | > loss_disc_real_3: 0.032168708741664886 (0.22705280093046334) | > loss_disc_real_4: 0.12314531952142715 (0.2367004169485508) | > loss_disc_real_5: 0.127179354429245 (0.2437074723152014) | > loss_0: 1.9651615619659424 (2.405816344114451) | > grad_norm_0: tensor(1584.7877, device='cuda:0') (tensor(1506.8949, device='cuda:0')) | > loss_gen: 2.4669079780578613 (2.4076984295478243) | > loss_kl: 0.5599692463874817 (0.8183671129055512) | > loss_feat: 11.181903839111328 (5.693072426491058) | > loss_mel: 24.33748435974121 (20.08954807428213) | > loss_duration: 1.3967493772506714 (1.3607548505831986) | > loss_1: 39.94301223754883 (30.369440861237354) | > grad_norm_1: tensor(146740.3281, device='cuda:0') (tensor(49592.2461, device='cuda:0')) | > current_lr_0: 7.819914188524891e-05 | > current_lr_1: 7.819914188524891e-05 | > step_time: 0.3255 (0.5505816447429168) | > loader_time: 0.0102 (0.01613591267512395)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.3075084686279297 (3.3075084686279297) | > loss_disc_real_0: 0.4923243522644043 (0.4923243522644043) | > loss_disc_real_1: 0.25468119978904724 (0.25468119978904724) | > loss_disc_real_2: 0.2638985514640808 (0.2638985514640808) | > loss_disc_real_3: 0.31889432668685913 (0.31889432668685913) | > loss_disc_real_4: 0.25519323348999023 (0.25519323348999023) | > loss_disc_real_5: 0.5174601078033447 (0.5174601078033447) | > loss_0: 3.3075084686279297 (3.3075084686279297) | > loss_gen: 2.2665560245513916 (2.2665560245513916) | > loss_kl: 5.733686447143555 (5.733686447143555) | > loss_feat: 5.49492883682251 (5.49492883682251) | > loss_mel: 25.13591766357422 (25.13591766357422) | > loss_duration: 3.070103883743286 (3.070103883743286) | > loss_1: 41.70119094848633 (41.70119094848633)  --> STEP: 1 | > loss_disc: 2.0425055027008057 (2.0425055027008057) | > loss_disc_real_0: 0.1677955687046051 (0.1677955687046051) | > loss_disc_real_1: 0.10567983239889145 (0.10567983239889145) | > loss_disc_real_2: 0.13702909648418427 (0.13702909648418427) | > loss_disc_real_3: 0.2896140515804291 (0.2896140515804291) | > loss_disc_real_4: 0.13317912817001343 (0.13317912817001343) | > loss_disc_real_5: 0.3268699645996094 (0.3268699645996094) | > loss_0: 2.0425055027008057 (2.0425055027008057) | > loss_gen: 3.32169508934021 (3.32169508934021) | > loss_kl: 5.264880180358887 (5.264880180358887) | > loss_feat: 8.866432189941406 (8.866432189941406) | > loss_mel: 23.951900482177734 (23.951900482177734) | > loss_duration: 3.3313865661621094 (3.3313865661621094) | > loss_1: 44.73629379272461 (44.73629379272461)  --> STEP: 2 | > loss_disc: 2.069974899291992 (2.056240200996399) | > loss_disc_real_0: 0.30221351981163025 (0.23500454425811768) | > loss_disc_real_1: 0.17482009530067444 (0.14024996384978294) | > loss_disc_real_2: 0.2501826584339142 (0.19360587745904922) | > loss_disc_real_3: 0.1946450024843216 (0.24212952703237534) | > loss_disc_real_4: 0.18992392718791962 (0.16155152767896652) | > loss_disc_real_5: 0.19710533320903778 (0.2619876489043236) | > loss_0: 2.069974899291992 (2.056240200996399) | > loss_gen: 2.9416537284851074 (3.1316744089126587) | > loss_kl: 5.9549336433410645 (5.609906911849976) | > loss_feat: 9.720392227172852 (9.293412208557129) | > loss_mel: 24.153289794921875 (24.052595138549805) | > loss_duration: 3.2140402793884277 (3.2727134227752686) | > loss_1: 45.98430633544922 (45.360300064086914)  --> STEP: 3 | > loss_disc: 3.335233211517334 (2.4825712045033774) | > loss_disc_real_0: 0.21680918335914612 (0.22893942395846048) | > loss_disc_real_1: 0.3299158215522766 (0.20347191641728082) | > loss_disc_real_2: 0.49640005826950073 (0.2945372710625331) | > loss_disc_real_3: 0.4386288523674011 (0.3076293021440506) | > loss_disc_real_4: 0.36225277185440063 (0.22845194240411124) | > loss_disc_real_5: 0.5561078190803528 (0.36002770562966663) | > loss_0: 3.335233211517334 (2.4825712045033774) | > loss_gen: 2.9161062240600586 (3.0598183472951255) | > loss_kl: 2.249253273010254 (4.489689032236735) | > loss_feat: 5.551482677459717 (8.046102364857992) | > loss_mel: 22.76343536376953 (23.622875213623047) | > loss_duration: 3.030186414718628 (3.191871086756388) | > loss_1: 36.51046371459961 (42.41035461425781) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_100000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.969864845275879 (2.6043946146965027) | > loss_disc_real_0: 0.2305009514093399 (0.22932980582118034) | > loss_disc_real_1: 0.2876640260219574 (0.22451994381844997) | > loss_disc_real_2: 0.3367083668708801 (0.3050800450146198) | > loss_disc_real_3: 0.28820857405662537 (0.3027741201221943) | > loss_disc_real_4: 0.302289217710495 (0.24691126123070717) | > loss_disc_real_5: 0.23577921092510223 (0.32896558195352554) | > loss_0: 2.969864845275879 (2.6043946146965027) | > loss_gen: 1.7606452703475952 (2.735025078058243) | > loss_kl: 5.021792888641357 (4.622714996337891) | > loss_feat: 0.8020691871643066 (6.23509407043457) | > loss_mel: 17.59251594543457 (22.115285396575928) | > loss_duration: 3.0087738037109375 (3.1460967659950256) | > loss_1: 28.1857967376709 (38.854215145111084)  --> STEP: 1 | > loss_disc: 2.6519594192504883 (2.6139075756073) | > loss_disc_real_0: 0.45763900876045227 (0.27499164640903473) | > loss_disc_real_1: 0.26233407855033875 (0.23208277076482772) | > loss_disc_real_2: 0.2192002236843109 (0.28790408074855806) | > loss_disc_real_3: 0.22300183773040771 (0.286819663643837) | > loss_disc_real_4: 0.26074278354644775 (0.2496775656938553) | > loss_disc_real_5: 0.3457004129886627 (0.332312548160553) | > loss_0: 2.6519594192504883 (2.6139075756073) | > loss_gen: 2.924278497695923 (2.772875761985779) | > loss_kl: 4.785109043121338 (4.65519380569458) | > loss_feat: 6.962948322296143 (6.380664920806884) | > loss_mel: 22.366802215576172 (22.165588760375975) | > loss_duration: 3.3050003051757812 (3.1778774738311766) | > loss_1: 40.344139099121094 (39.15219993591309)  --> STEP: 2 | > loss_disc: 1.6405820846557617 (2.45168666044871) | > loss_disc_real_0: 0.07818908989429474 (0.24219122032324472) | > loss_disc_real_1: 0.1593780517578125 (0.21996531759699187) | > loss_disc_real_2: 0.11119671165943146 (0.25845285256703693) | > loss_disc_real_3: 0.14208798110485077 (0.2626977165540059) | > loss_disc_real_4: 0.1299438625574112 (0.22972194850444794) | > loss_disc_real_5: 0.07185890525579453 (0.2889036076764266) | > loss_0: 1.6405820846557617 (2.45168666044871) | > loss_gen: 2.94350004196167 (2.8013131419817605) | > loss_kl: 5.944136142730713 (4.8700175285339355) | > loss_feat: 10.869318008422852 (7.128773768742879) | > loss_mel: 20.751188278198242 (21.929855346679688) | > loss_duration: 3.2589149475097656 (3.191383719444275) | > loss_1: 43.767059326171875 (39.92134316762289)  --> STEP: 3 | > loss_disc: 3.1275908946990967 (2.5482444081987654) | > loss_disc_real_0: 0.4150831699371338 (0.26689007026808603) | > loss_disc_real_1: 0.32286036014556885 (0.2346646093896457) | > loss_disc_real_2: 0.3290627598762512 (0.26853998218263897) | > loss_disc_real_3: 0.31336110830307007 (0.2699353439467294) | > loss_disc_real_4: 0.24045449495315552 (0.23125516942569188) | > loss_disc_real_5: 0.37088924646377563 (0.300615841788905) | > loss_0: 3.1275908946990967 (2.5482444081987654) | > loss_gen: 2.3336880207061768 (2.7345095532281056) | > loss_kl: 2.7355105876922607 (4.565087965556553) | > loss_feat: 3.5251548290252686 (6.613971063068935) | > loss_mel: 24.41498374938965 (22.284873689923966) | > loss_duration: 3.0344619750976562 (3.168966327394758) | > loss_1: 36.043800354003906 (39.36740847996303) --> EVAL PERFORMANCE | > avg_loader_time: 0.364220176424299 (+0.3578625860668364) | > avg_loss_disc: 2.5482444081987654 (+0.28570088886079326) | > avg_loss_disc_real_0: 0.26689007026808603 (+0.13636896652834757) | > avg_loss_disc_real_1: 0.2346646093896457 (-0.021845022482531423) | > avg_loss_disc_real_2: 0.26853998218263897 (+0.05353439439620289) | > avg_loss_disc_real_3: 0.2699353439467294 (+0.05076404341629576) | > avg_loss_disc_real_4: 0.23125516942569188 (+0.07165417891173137) | > avg_loss_disc_real_5: 0.300615841788905 (+0.08020296595281076) | > avg_loss_0: 2.5482444081987654 (+0.28570088886079326) | > avg_loss_gen: 2.7345095532281056 (+0.3277759211403981) | > avg_loss_kl: 4.565087965556553 (+0.14031164986746614) | > avg_loss_feat: 6.613971063068935 (+0.9982520973398579) | > avg_loss_mel: 22.284873689923966 (+2.9112907704852873) | > avg_loss_duration: 3.168966327394758 (-0.007449433917090964) | > avg_loss_1: 39.36740847996303 (+4.370181129092266)  > EPOCH: 940/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:26:26)   --> TIME: 2023-10-20 11:26:43 -- STEP: 19/50 -- GLOBAL_STEP: 100020 | > loss_disc: 2.6101880073547363 (2.5045637456994307) | > loss_disc_real_0: 0.13846972584724426 (0.1394115739354962) | > loss_disc_real_1: 0.21122469007968903 (0.21781424001643532) | > loss_disc_real_2: 0.3136308193206787 (0.24430531714307635) | > loss_disc_real_3: 0.3148966133594513 (0.2547690906610928) | > loss_disc_real_4: 0.20520654320716858 (0.21075944788753986) | > loss_disc_real_5: 0.2724018096923828 (0.24634694067859336) | > loss_0: 2.6101880073547363 (2.5045637456994307) | > grad_norm_0: tensor(1293.6312, device='cuda:0') (tensor(1444.9681, device='cuda:0')) | > loss_gen: 2.0786895751953125 (2.2751531977402535) | > loss_kl: 0.7619445323944092 (0.7801739902872789) | > loss_feat: 2.090080499649048 (5.395238115207145) | > loss_mel: 20.08626937866211 (20.93803540029024) | > loss_duration: 1.457431435585022 (1.38685783587004) | > loss_1: 26.474414825439453 (30.775458762520238) | > grad_norm_1: tensor(8869.6025, device='cuda:0') (tensor(44424.6797, device='cuda:0')) | > current_lr_0: 7.81209769469365e-05 | > current_lr_1: 7.81209769469365e-05 | > step_time: 0.5218 (0.629932767466495) | > loader_time: 0.0057 (0.01884996263604415)  --> TIME: 2023-10-20 11:26:59 -- STEP: 49/50 -- GLOBAL_STEP: 100050 | > loss_disc: 3.072781562805176 (2.4707116350835685) | > loss_disc_real_0: 0.1413630247116089 (0.1573787793441087) | > loss_disc_real_1: 0.4081084430217743 (0.22877079065965147) | > loss_disc_real_2: 0.3705008327960968 (0.23165597774240435) | > loss_disc_real_3: 0.2662752866744995 (0.24450718151519493) | > loss_disc_real_4: 0.7485976815223694 (0.2070094217185159) | > loss_disc_real_5: 0.41788843274116516 (0.21829799796473615) | > loss_0: 3.072781562805176 (2.4707116350835685) | > grad_norm_0: tensor(1514.0494, device='cuda:0') (tensor(1380.8695, device='cuda:0')) | > loss_gen: 3.2448770999908447 (2.309571468100256) | > loss_kl: 0.23296675086021423 (0.7597837196472956) | > loss_feat: 6.430446147918701 (5.2869884311696715) | > loss_mel: 26.61478042602539 (19.507471928791123) | > loss_duration: 1.4724563360214233 (1.360972382584397) | > loss_1: 37.99552917480469 (29.224787974844173) | > grad_norm_1: tensor(44020.4453, device='cuda:0') (tensor(45757.0977, device='cuda:0')) | > current_lr_0: 7.81209769469365e-05 | > current_lr_1: 7.81209769469365e-05 | > step_time: 0.3896 (0.5480603198615871) | > loader_time: 0.6021 (0.028448732531800556)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9931845664978027 (1.9931845664978027) | > loss_disc_real_0: 0.10467414557933807 (0.10467414557933807) | > loss_disc_real_1: 0.3091069459915161 (0.3091069459915161) | > loss_disc_real_2: 0.10842213034629822 (0.10842213034629822) | > loss_disc_real_3: 0.031329695135354996 (0.031329695135354996) | > loss_disc_real_4: 0.1624649465084076 (0.1624649465084076) | > loss_disc_real_5: 0.10005369037389755 (0.10005369037389755) | > loss_0: 1.9931845664978027 (1.9931845664978027) | > loss_gen: 2.413726806640625 (2.413726806640625) | > loss_kl: 5.659013271331787 (5.659013271331787) | > loss_feat: 13.263981819152832 (13.263981819152832) | > loss_mel: 27.72083854675293 (27.72083854675293) | > loss_duration: 2.9820268154144287 (2.9820268154144287) | > loss_1: 52.03958511352539 (52.03958511352539)  --> STEP: 1 | > loss_disc: 3.011695623397827 (3.011695623397827) | > loss_disc_real_0: 0.084242083132267 (0.084242083132267) | > loss_disc_real_1: 0.49565836787223816 (0.49565836787223816) | > loss_disc_real_2: 0.3869805634021759 (0.3869805634021759) | > loss_disc_real_3: 0.3588409423828125 (0.3588409423828125) | > loss_disc_real_4: 0.3537164628505707 (0.3537164628505707) | > loss_disc_real_5: 0.36397460103034973 (0.36397460103034973) | > loss_0: 3.011695623397827 (3.011695623397827) | > loss_gen: 2.420001745223999 (2.420001745223999) | > loss_kl: 4.960397720336914 (4.960397720336914) | > loss_feat: 7.327726364135742 (7.327726364135742) | > loss_mel: 21.999053955078125 (21.999053955078125) | > loss_duration: 3.2872555255889893 (3.2872555255889893) | > loss_1: 39.99443435668945 (39.99443435668945)  --> STEP: 2 | > loss_disc: 3.0418601036071777 (3.0267778635025024) | > loss_disc_real_0: 0.14269359409809113 (0.11346783861517906) | > loss_disc_real_1: 0.25017911195755005 (0.3729187399148941) | > loss_disc_real_2: 0.2538994252681732 (0.32043999433517456) | > loss_disc_real_3: 0.2637016177177429 (0.3112712800502777) | > loss_disc_real_4: 0.3437330722808838 (0.34872476756572723) | > loss_disc_real_5: 0.25986137986183167 (0.3119179904460907) | > loss_0: 3.0418601036071777 (3.0267778635025024) | > loss_gen: 1.512089490890503 (1.966045618057251) | > loss_kl: 5.326967716217041 (5.1436827182769775) | > loss_feat: 0.2505365014076233 (3.7891314327716827) | > loss_mel: 10.353614807128906 (16.176334381103516) | > loss_duration: 3.2671561241149902 (3.2772058248519897) | > loss_1: 20.710365295410156 (30.352399826049805)  --> STEP: 3 | > loss_disc: 2.0401804447174072 (2.697912057240804) | > loss_disc_real_0: 0.021245397627353668 (0.0827270249525706) | > loss_disc_real_1: 0.16301028430461884 (0.302949254711469) | > loss_disc_real_2: 0.2540450394153595 (0.2983083426952362) | > loss_disc_real_3: 0.04434095695614815 (0.22229450568556786) | > loss_disc_real_4: 0.041591815650463104 (0.24634711692730585) | > loss_disc_real_5: 0.02170824073255062 (0.215181407208244) | > loss_0: 2.0401804447174072 (2.697912057240804) | > loss_gen: 2.246769428253174 (2.059620221455892) | > loss_kl: 2.7104506492614746 (4.332605361938477) | > loss_feat: 8.891393661499023 (5.48988550901413) | > loss_mel: 27.501083374023438 (19.951250712076824) | > loss_duration: 2.983212471008301 (3.1792080402374268) | > loss_1: 44.332908630371094 (35.012569427490234) --> EVAL PERFORMANCE | > avg_loader_time: 0.01463174819946289 (-0.3495884282248361) | > avg_loss_disc: 2.697912057240804 (+0.14966764904203878) | > avg_loss_disc_real_0: 0.0827270249525706 (-0.18416304531551542) | > avg_loss_disc_real_1: 0.302949254711469 (+0.0682846453218233) | > avg_loss_disc_real_2: 0.2983083426952362 (+0.029768360512597236) | > avg_loss_disc_real_3: 0.22229450568556786 (-0.047640838261161556) | > avg_loss_disc_real_4: 0.24634711692730585 (+0.015091947501613967) | > avg_loss_disc_real_5: 0.215181407208244 (-0.085434434580661) | > avg_loss_0: 2.697912057240804 (+0.14966764904203878) | > avg_loss_gen: 2.059620221455892 (-0.6748893317722136) | > avg_loss_kl: 4.332605361938477 (-0.2324826036180765) | > avg_loss_feat: 5.48988550901413 (-1.1240855540548056) | > avg_loss_mel: 19.951250712076824 (-2.333622977847142) | > avg_loss_duration: 3.1792080402374268 (+0.010241712842668615) | > avg_loss_1: 35.012569427490234 (-4.354839052472798)  > EPOCH: 941/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:27:19)   --> TIME: 2023-10-20 11:27:37 -- STEP: 29/50 -- GLOBAL_STEP: 100080 | > loss_disc: 2.9904518127441406 (2.624155245978257) | > loss_disc_real_0: 0.2672208547592163 (0.16298015377131) | > loss_disc_real_1: 0.27255871891975403 (0.237938262265304) | > loss_disc_real_2: 0.27142763137817383 (0.2230135721379313) | > loss_disc_real_3: 0.21363013982772827 (0.24016795230322868) | > loss_disc_real_4: 0.2940683662891388 (0.26212341967841685) | > loss_disc_real_5: 0.26991522312164307 (0.23103183148236112) | > loss_0: 2.9904518127441406 (2.624155245978257) | > grad_norm_0: tensor(983.9786, device='cuda:0') (tensor(1414.6594, device='cuda:0')) | > loss_gen: 1.5685518980026245 (2.1406058936283503) | > loss_kl: 0.5300261974334717 (0.9003576040267944) | > loss_feat: 0.10801848769187927 (5.1668701290056624) | > loss_mel: 8.285919189453125 (19.06946047010093) | > loss_duration: 1.3767820596694946 (1.3645667002118866) | > loss_1: 11.869297981262207 (28.641861208553973) | > grad_norm_1: tensor(54895.1992, device='cuda:0') (tensor(41764.0742, device='cuda:0')) | > current_lr_0: 7.804289013937383e-05 | > current_lr_1: 7.804289013937383e-05 | > step_time: 0.3028 (0.43859725162900726) | > loader_time: 0.0047 (0.009032356327977675)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.414214611053467 (3.414214611053467) | > loss_disc_real_0: 0.5487525463104248 (0.5487525463104248) | > loss_disc_real_1: 0.2707479000091553 (0.2707479000091553) | > loss_disc_real_2: 0.4744815528392792 (0.4744815528392792) | > loss_disc_real_3: 0.18572896718978882 (0.18572896718978882) | > loss_disc_real_4: 0.5529690980911255 (0.5529690980911255) | > loss_disc_real_5: 0.4472687542438507 (0.4472687542438507) | > loss_0: 3.414214611053467 (3.414214611053467) | > loss_gen: 2.656703233718872 (2.656703233718872) | > loss_kl: 5.254105567932129 (5.254105567932129) | > loss_feat: 6.392958164215088 (6.392958164215088) | > loss_mel: 22.5422306060791 (22.5422306060791) | > loss_duration: 2.951223611831665 (2.951223611831665) | > loss_1: 39.79722213745117 (39.79722213745117)  --> STEP: 1 | > loss_disc: 1.8897348642349243 (1.8897348642349243) | > loss_disc_real_0: 0.34293583035469055 (0.34293583035469055) | > loss_disc_real_1: 0.1072462871670723 (0.1072462871670723) | > loss_disc_real_2: 0.21111226081848145 (0.21111226081848145) | > loss_disc_real_3: 0.13003018498420715 (0.13003018498420715) | > loss_disc_real_4: 0.19840924441814423 (0.19840924441814423) | > loss_disc_real_5: 0.0528530590236187 (0.0528530590236187) | > loss_0: 1.8897348642349243 (1.8897348642349243) | > loss_gen: 2.7160229682922363 (2.7160229682922363) | > loss_kl: 6.012777805328369 (6.012777805328369) | > loss_feat: 8.92264461517334 (8.92264461517334) | > loss_mel: 26.09930992126465 (26.09930992126465) | > loss_duration: 3.372443437576294 (3.372443437576294) | > loss_1: 47.123199462890625 (47.123199462890625)  --> STEP: 2 | > loss_disc: 1.7901458740234375 (1.839940369129181) | > loss_disc_real_0: 0.11148807406425476 (0.22721195220947266) | > loss_disc_real_1: 0.12774327397346497 (0.11749478057026863) | > loss_disc_real_2: 0.1725064516067505 (0.19180935621261597) | > loss_disc_real_3: 0.27973130345344543 (0.2048807442188263) | > loss_disc_real_4: 0.1579432636499405 (0.17817625403404236) | > loss_disc_real_5: 0.05183890834450722 (0.05234598368406296) | > loss_0: 1.7901458740234375 (1.839940369129181) | > loss_gen: 3.330181121826172 (3.023102045059204) | > loss_kl: 5.892732620239258 (5.9527552127838135) | > loss_feat: 10.97986888885498 (9.95125675201416) | > loss_mel: 24.783287048339844 (25.441298484802246) | > loss_duration: 3.240394353866577 (3.3064188957214355) | > loss_1: 48.226463317871094 (47.67483139038086)  --> STEP: 3 | > loss_disc: 3.1164257526397705 (2.265435496966044) | > loss_disc_real_0: 0.6432474851608276 (0.36589046319325763) | > loss_disc_real_1: 0.27387934923171997 (0.16962297012408575) | > loss_disc_real_2: 0.22611035406589508 (0.20324302216370901) | > loss_disc_real_3: 0.23173823952674866 (0.21383324265480042) | > loss_disc_real_4: 0.2381458878517151 (0.1981661319732666) | > loss_disc_real_5: 0.23115576803684235 (0.11194924513498943) | > loss_0: 3.1164257526397705 (2.265435496966044) | > loss_gen: 1.8729345798492432 (2.6397128899892173) | > loss_kl: 2.620882987976074 (4.8421311378479) | > loss_feat: 0.49129319190979004 (6.797935565312703) | > loss_mel: 5.5803680419921875 (18.820988337198894) | > loss_duration: 2.9621386528015137 (3.1916588147481284) | > loss_1: 13.527616500854492 (36.292426427205406) --> EVAL PERFORMANCE | > avg_loader_time: 0.008159796396891275 (-0.006471951802571615) | > avg_loss_disc: 2.265435496966044 (-0.4324765602747602) | > avg_loss_disc_real_0: 0.36589046319325763 (+0.283163438240687) | > avg_loss_disc_real_1: 0.16962297012408575 (-0.13332628458738324) | > avg_loss_disc_real_2: 0.20324302216370901 (-0.09506532053152719) | > avg_loss_disc_real_3: 0.21383324265480042 (-0.00846126303076744) | > avg_loss_disc_real_4: 0.1981661319732666 (-0.048180984954039247) | > avg_loss_disc_real_5: 0.11194924513498943 (-0.10323216207325457) | > avg_loss_0: 2.265435496966044 (-0.4324765602747602) | > avg_loss_gen: 2.6397128899892173 (+0.5800926685333252) | > avg_loss_kl: 4.8421311378479 (+0.5095257759094238) | > avg_loss_feat: 6.797935565312703 (+1.3080500562985735) | > avg_loss_mel: 18.820988337198894 (-1.1302623748779297) | > avg_loss_duration: 3.1916588147481284 (+0.012450774510701645) | > avg_loss_1: 36.292426427205406 (+1.2798569997151716)  > EPOCH: 942/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:28:00)   --> TIME: 2023-10-20 11:28:11 -- STEP: 9/50 -- GLOBAL_STEP: 100110 | > loss_disc: 2.8424909114837646 (2.6348860131369696) | > loss_disc_real_0: 0.14649957418441772 (0.22091706014341778) | > loss_disc_real_1: 0.28541329503059387 (0.23602418849865595) | > loss_disc_real_2: 0.26997098326683044 (0.30752978059980607) | > loss_disc_real_3: 0.264120876789093 (0.2512025179134475) | > loss_disc_real_4: 0.24308298528194427 (0.28777971698178184) | > loss_disc_real_5: 0.23265770077705383 (0.2078614884780513) | > loss_0: 2.8424909114837646 (2.6348860131369696) | > grad_norm_0: tensor(946.5032, device='cuda:0') (tensor(1652.3342, device='cuda:0')) | > loss_gen: 1.703352689743042 (2.2916838857862682) | > loss_kl: 0.6497315168380737 (0.7908127506573995) | > loss_feat: 1.0365804433822632 (4.898979095328185) | > loss_mel: 16.528467178344727 (17.482454240322113) | > loss_duration: 1.3950289487838745 (1.3838390509287517) | > loss_1: 21.313159942626953 (26.84776809480455) | > grad_norm_1: tensor(2909.3022, device='cuda:0') (tensor(50919.1055, device='cuda:0')) | > current_lr_0: 7.796488138446425e-05 | > current_lr_1: 7.796488138446425e-05 | > step_time: 0.5121 (0.631355365117391) | > loader_time: 0.0024 (0.022500276565551758)  --> TIME: 2023-10-20 11:28:31 -- STEP: 39/50 -- GLOBAL_STEP: 100140 | > loss_disc: 2.085951089859009 (2.5211719610752206) | > loss_disc_real_0: 0.1429462730884552 (0.16252749518324167) | > loss_disc_real_1: 0.26762303709983826 (0.22464785667566153) | > loss_disc_real_2: 0.2125667929649353 (0.2535615218564487) | > loss_disc_real_3: 0.19250714778900146 (0.24016010169035348) | > loss_disc_real_4: 0.2256932407617569 (0.2370834301870603) | > loss_disc_real_5: 0.14809149503707886 (0.22006122581660748) | > loss_0: 2.085951089859009 (2.5211719610752206) | > grad_norm_0: tensor(559.1127, device='cuda:0') (tensor(806.0253, device='cuda:0')) | > loss_gen: 3.018641233444214 (2.2734683049030786) | > loss_kl: 0.4650332033634186 (0.8392487993607154) | > loss_feat: 7.3762664794921875 (5.520575367726194) | > loss_mel: 27.79908561706543 (20.65780624212363) | > loss_duration: 1.4207725524902344 (1.3608956031310253) | > loss_1: 40.07979965209961 (30.65199417945666) | > grad_norm_1: tensor(33903.3125, device='cuda:0') (tensor(26034.6133, device='cuda:0')) | > current_lr_0: 7.796488138446425e-05 | > current_lr_1: 7.796488138446425e-05 | > step_time: 0.608 (0.6532980600992838) | > loader_time: 0.0073 (0.018988743806496646)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.1655535697937012 (1.1655535697937012) | > loss_disc_real_0: 0.06510954350233078 (0.06510954350233078) | > loss_disc_real_1: 0.14927877485752106 (0.14927877485752106) | > loss_disc_real_2: 0.06025413051247597 (0.06025413051247597) | > loss_disc_real_3: 0.05709860101342201 (0.05709860101342201) | > loss_disc_real_4: 0.03685310482978821 (0.03685310482978821) | > loss_disc_real_5: 0.016986696049571037 (0.016986696049571037) | > loss_0: 1.1655535697937012 (1.1655535697937012) | > loss_gen: 2.8435370922088623 (2.8435370922088623) | > loss_kl: 6.014994144439697 (6.014994144439697) | > loss_feat: 13.892742156982422 (13.892742156982422) | > loss_mel: 25.117334365844727 (25.117334365844727) | > loss_duration: 3.0624172687530518 (3.0624172687530518) | > loss_1: 50.93102264404297 (50.93102264404297)  --> STEP: 1 | > loss_disc: 3.048774480819702 (3.048774480819702) | > loss_disc_real_0: 0.31869062781333923 (0.31869062781333923) | > loss_disc_real_1: 0.26994144916534424 (0.26994144916534424) | > loss_disc_real_2: 0.30327367782592773 (0.30327367782592773) | > loss_disc_real_3: 0.270539790391922 (0.270539790391922) | > loss_disc_real_4: 0.2813429534435272 (0.2813429534435272) | > loss_disc_real_5: 0.32511845231056213 (0.32511845231056213) | > loss_0: 3.048774480819702 (3.048774480819702) | > loss_gen: 1.7442679405212402 (1.7442679405212402) | > loss_kl: 4.990669250488281 (4.990669250488281) | > loss_feat: 0.08515901863574982 (0.08515901863574982) | > loss_mel: 4.722297191619873 (4.722297191619873) | > loss_duration: 3.27044677734375 (3.27044677734375) | > loss_1: 14.81283950805664 (14.81283950805664)  --> STEP: 2 | > loss_disc: 3.0557544231414795 (3.052264451980591) | > loss_disc_real_0: 0.3226538300514221 (0.3206722289323807) | > loss_disc_real_1: 0.26985764503479004 (0.26989954710006714) | > loss_disc_real_2: 0.30355197191238403 (0.3034128248691559) | > loss_disc_real_3: 0.2703233063220978 (0.2704315483570099) | > loss_disc_real_4: 0.2814997732639313 (0.28142136335372925) | > loss_disc_real_5: 0.3251437544822693 (0.3251311033964157) | > loss_0: 3.0557544231414795 (3.052264451980591) | > loss_gen: 1.7406651973724365 (1.7424665689468384) | > loss_kl: 5.729789733886719 (5.3602294921875) | > loss_feat: 0.09517213702201843 (0.09016557782888412) | > loss_mel: 1.7676624059677124 (3.2449797987937927) | > loss_duration: 3.2073471546173096 (3.23889696598053) | > loss_1: 12.54063606262207 (13.676737785339355)  --> STEP: 3 | > loss_disc: 3.232228994369507 (3.112252632776896) | > loss_disc_real_0: 0.6235594749450684 (0.42163464426994324) | > loss_disc_real_1: 0.2812665104866028 (0.27368853489557904) | > loss_disc_real_2: 0.2516348958015442 (0.28615351517995197) | > loss_disc_real_3: 0.24869191646575928 (0.2631850043932597) | > loss_disc_real_4: 0.28938281536102295 (0.28407518068949383) | > loss_disc_real_5: 0.406968891620636 (0.35241036613782245) | > loss_0: 3.232228994369507 (3.112252632776896) | > loss_gen: 2.5427820682525635 (2.0092384020487466) | > loss_kl: 2.583827018737793 (4.434762001037598) | > loss_feat: 4.050252437591553 (1.410194531083107) | > loss_mel: 21.985336303710938 (9.49176530043284) | > loss_duration: 2.997873067855835 (3.1585556666056314) | > loss_1: 34.16006851196289 (20.504514694213867) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024469693501790366 (-0.005712827046712238) | > avg_loss_disc: 3.112252632776896 (+0.846817135810852) | > avg_loss_disc_real_0: 0.42163464426994324 (+0.055744181076685606) | > avg_loss_disc_real_1: 0.27368853489557904 (+0.10406556477149329) | > avg_loss_disc_real_2: 0.28615351517995197 (+0.08291049301624295) | > avg_loss_disc_real_3: 0.2631850043932597 (+0.04935176173845929) | > avg_loss_disc_real_4: 0.28407518068949383 (+0.08590904871622723) | > avg_loss_disc_real_5: 0.35241036613782245 (+0.240461121002833) | > avg_loss_0: 3.112252632776896 (+0.846817135810852) | > avg_loss_gen: 2.0092384020487466 (-0.6304744879404707) | > avg_loss_kl: 4.434762001037598 (-0.40736913681030273) | > avg_loss_feat: 1.410194531083107 (-5.387741034229596) | > avg_loss_mel: 9.49176530043284 (-9.329223036766054) | > avg_loss_duration: 3.1585556666056314 (-0.03310314814249704) | > avg_loss_1: 20.504514694213867 (-15.787911732991539)  > EPOCH: 943/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:28:52)   --> TIME: 2023-10-20 11:29:08 -- STEP: 19/50 -- GLOBAL_STEP: 100170 | > loss_disc: 0.9055570960044861 (2.2797410958691646) | > loss_disc_real_0: 0.09871929883956909 (0.1539041851892283) | > loss_disc_real_1: 0.054560720920562744 (0.19804240743580617) | > loss_disc_real_2: 0.046865370124578476 (0.19486971307349832) | > loss_disc_real_3: 0.13920213282108307 (0.20223530146636462) | > loss_disc_real_4: 0.07057115435600281 (0.1994406398581831) | > loss_disc_real_5: 0.04536978155374527 (0.18996798178475155) | > loss_0: 0.9055570960044861 (2.2797410958691646) | > grad_norm_0: tensor(206.9071, device='cuda:0') (tensor(519.4982, device='cuda:0')) | > loss_gen: 4.489449977874756 (2.4891672573591532) | > loss_kl: 0.7563936114311218 (0.918779338660993) | > loss_feat: 17.20612907409668 (7.340475953919323) | > loss_mel: 34.751041412353516 (21.237961976151716) | > loss_duration: 1.4528284072875977 (1.3918486645347194) | > loss_1: 58.65583801269531 (33.37823315670616) | > grad_norm_1: tensor(109300.3906, device='cuda:0') (tensor(35280.8438, device='cuda:0')) | > current_lr_0: 7.788695060418928e-05 | > current_lr_1: 7.788695060418928e-05 | > step_time: 0.82 (0.5953560251938669) | > loader_time: 0.0269 (0.016623471912584807)  --> TIME: 2023-10-20 11:29:29 -- STEP: 49/50 -- GLOBAL_STEP: 100200 | > loss_disc: 2.5044209957122803 (2.38828413218868) | > loss_disc_real_0: 0.08803071826696396 (0.1677382573371335) | > loss_disc_real_1: 0.258895605802536 (0.22403249247189688) | > loss_disc_real_2: 0.2338513433933258 (0.21850363400821782) | > loss_disc_real_3: 0.24507001042366028 (0.22627848721280389) | > loss_disc_real_4: 0.2037663459777832 (0.22539408963021576) | > loss_disc_real_5: 0.2088407278060913 (0.21577882164214945) | > loss_0: 2.5044209957122803 (2.38828413218868) | > grad_norm_0: tensor(942.3495, device='cuda:0') (tensor(579.2176, device='cuda:0')) | > loss_gen: 2.1384077072143555 (2.4445226727699745) | > loss_kl: 0.6836311221122742 (0.9028921930157409) | > loss_feat: 2.277711868286133 (5.900400704647205) | > loss_mel: 19.042259216308594 (19.614371090519185) | > loss_duration: 1.4817861318588257 (1.348989654560479) | > loss_1: 25.623796463012695 (30.211176375953517) | > grad_norm_1: tensor(13906.6836, device='cuda:0') (tensor(28263.5117, device='cuda:0')) | > current_lr_0: 7.788695060418928e-05 | > current_lr_1: 7.788695060418928e-05 | > step_time: 0.4758 (0.6277585662141139) | > loader_time: 1.0007 (0.04135652464263293)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9897527694702148 (1.9897527694702148) | > loss_disc_real_0: 0.055077750235795975 (0.055077750235795975) | > loss_disc_real_1: 0.17082618176937103 (0.17082618176937103) | > loss_disc_real_2: 0.2207329422235489 (0.2207329422235489) | > loss_disc_real_3: 0.2449461668729782 (0.2449461668729782) | > loss_disc_real_4: 0.22420525550842285 (0.22420525550842285) | > loss_disc_real_5: 0.2068641632795334 (0.2068641632795334) | > loss_0: 1.9897527694702148 (1.9897527694702148) | > loss_gen: 2.718014717102051 (2.718014717102051) | > loss_kl: 6.055366039276123 (6.055366039276123) | > loss_feat: 10.684133529663086 (10.684133529663086) | > loss_mel: 23.24810218811035 (23.24810218811035) | > loss_duration: 3.0082390308380127 (3.0082390308380127) | > loss_1: 45.7138557434082 (45.7138557434082)  --> STEP: 1 | > loss_disc: 2.7467732429504395 (2.7467732429504395) | > loss_disc_real_0: 0.14348790049552917 (0.14348790049552917) | > loss_disc_real_1: 0.2734013497829437 (0.2734013497829437) | > loss_disc_real_2: 0.22469905018806458 (0.22469905018806458) | > loss_disc_real_3: 0.22928734123706818 (0.22928734123706818) | > loss_disc_real_4: 0.23071788251399994 (0.23071788251399994) | > loss_disc_real_5: 0.2323082983493805 (0.2323082983493805) | > loss_0: 2.7467732429504395 (2.7467732429504395) | > loss_gen: 1.6172363758087158 (1.6172363758087158) | > loss_kl: 5.453715801239014 (5.453715801239014) | > loss_feat: 0.6203753352165222 (0.6203753352165222) | > loss_mel: 11.957479476928711 (11.957479476928711) | > loss_duration: 3.357156991958618 (3.357156991958618) | > loss_1: 23.005964279174805 (23.005964279174805)  --> STEP: 2 | > loss_disc: 2.064321994781494 (2.405547618865967) | > loss_disc_real_0: 0.1644972562789917 (0.15399257838726044) | > loss_disc_real_1: 0.21140217781066895 (0.24240176379680634) | > loss_disc_real_2: 0.12709002196788788 (0.17589453607797623) | > loss_disc_real_3: 0.170303612947464 (0.19979547709226608) | > loss_disc_real_4: 0.13688382506370544 (0.1838008537888527) | > loss_disc_real_5: 0.12069646269083023 (0.17650238052010536) | > loss_0: 2.064321994781494 (2.405547618865967) | > loss_gen: 2.2817656993865967 (1.9495010375976562) | > loss_kl: 5.421030044555664 (5.437372922897339) | > loss_feat: 8.287564277648926 (4.453969806432724) | > loss_mel: 25.509050369262695 (18.733264923095703) | > loss_duration: 3.186887264251709 (3.2720221281051636) | > loss_1: 44.68629455566406 (33.846129417419434)  --> STEP: 3 | > loss_disc: 2.0532066822052 (2.2881006399790444) | > loss_disc_real_0: 0.21907168626785278 (0.17568561434745789) | > loss_disc_real_1: 0.24720166623592377 (0.24400173127651215) | > loss_disc_real_2: 0.21910907328128815 (0.19029938181241354) | > loss_disc_real_3: 0.21541105210781097 (0.20500066876411438) | > loss_disc_real_4: 0.08416926115751266 (0.15059032291173935) | > loss_disc_real_5: 0.045420434325933456 (0.1328083984553814) | > loss_0: 2.0532066822052 (2.2881006399790444) | > loss_gen: 2.3857996463775635 (2.0949339071909585) | > loss_kl: 2.5053749084472656 (4.460040251413981) | > loss_feat: 6.280877113342285 (5.062938908735911) | > loss_mel: 25.59320831298828 (21.019912719726562) | > loss_duration: 2.9245405197143555 (3.1561949253082275) | > loss_1: 39.68980026245117 (35.79401969909668) --> EVAL PERFORMANCE | > avg_loader_time: 0.004934469858805339 (+0.0024875005086263022) | > avg_loss_disc: 2.2881006399790444 (-0.8241519927978516) | > avg_loss_disc_real_0: 0.17568561434745789 (-0.24594902992248535) | > avg_loss_disc_real_1: 0.24400173127651215 (-0.029686803619066893) | > avg_loss_disc_real_2: 0.19029938181241354 (-0.09585413336753842) | > avg_loss_disc_real_3: 0.20500066876411438 (-0.05818433562914532) | > avg_loss_disc_real_4: 0.15059032291173935 (-0.13348485777775448) | > avg_loss_disc_real_5: 0.1328083984553814 (-0.21960196768244106) | > avg_loss_0: 2.2881006399790444 (-0.8241519927978516) | > avg_loss_gen: 2.0949339071909585 (+0.08569550514221191) | > avg_loss_kl: 4.460040251413981 (+0.02527825037638376) | > avg_loss_feat: 5.062938908735911 (+3.6527443776528044) | > avg_loss_mel: 21.019912719726562 (+11.528147419293722) | > avg_loss_duration: 3.1561949253082275 (-0.0023607412974038233) | > avg_loss_1: 35.79401969909668 (+15.289505004882812)  > EPOCH: 944/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:29:45)   --> TIME: 2023-10-20 11:30:04 -- STEP: 29/50 -- GLOBAL_STEP: 100230 | > loss_disc: 2.8829987049102783 (2.341404684658708) | > loss_disc_real_0: 0.20640809834003448 (0.1188543025918048) | > loss_disc_real_1: 0.2487192302942276 (0.19760054170057692) | > loss_disc_real_2: 0.23451368510723114 (0.21789705798286815) | > loss_disc_real_3: 0.22678063809871674 (0.22880214472012272) | > loss_disc_real_4: 0.28439438343048096 (0.20801069054367213) | > loss_disc_real_5: 0.2202707678079605 (0.2090325983048513) | > loss_0: 2.8829987049102783 (2.341404684658708) | > grad_norm_0: tensor(428.4608, device='cuda:0') (tensor(521.4622, device='cuda:0')) | > loss_gen: 1.5953238010406494 (2.392107901902034) | > loss_kl: 1.0439791679382324 (0.8282003567136568) | > loss_feat: 0.6756070852279663 (6.486706042662264) | > loss_mel: 9.856422424316406 (19.962926930394662) | > loss_duration: 1.3601547479629517 (1.3591391218119655) | > loss_1: 14.531487464904785 (31.02908052247146) | > grad_norm_1: tensor(33534.4766, device='cuda:0') (tensor(32815.1797, device='cuda:0')) | > current_lr_0: 7.78090977206084e-05 | > current_lr_1: 7.78090977206084e-05 | > step_time: 0.3426 (0.48250176988799004) | > loader_time: 0.0042 (0.014397448506848565)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.990875482559204 (2.990875482559204) | > loss_disc_real_0: 0.2694286108016968 (0.2694286108016968) | > loss_disc_real_1: 0.28889167308807373 (0.28889167308807373) | > loss_disc_real_2: 0.2817366123199463 (0.2817366123199463) | > loss_disc_real_3: 0.21761001646518707 (0.21761001646518707) | > loss_disc_real_4: 0.29235437512397766 (0.29235437512397766) | > loss_disc_real_5: 0.3240067958831787 (0.3240067958831787) | > loss_0: 2.990875482559204 (2.990875482559204) | > loss_gen: 1.8815677165985107 (1.8815677165985107) | > loss_kl: 5.382048606872559 (5.382048606872559) | > loss_feat: 2.1585707664489746 (2.1585707664489746) | > loss_mel: 20.218318939208984 (20.218318939208984) | > loss_duration: 3.0820891857147217 (3.0820891857147217) | > loss_1: 32.72259521484375 (32.72259521484375)  --> STEP: 1 | > loss_disc: 2.934818744659424 (2.934818744659424) | > loss_disc_real_0: 0.3296453654766083 (0.3296453654766083) | > loss_disc_real_1: 0.25995180010795593 (0.25995180010795593) | > loss_disc_real_2: 0.2565422058105469 (0.2565422058105469) | > loss_disc_real_3: 0.22649860382080078 (0.22649860382080078) | > loss_disc_real_4: 0.23696424067020416 (0.23696424067020416) | > loss_disc_real_5: 0.2570982575416565 (0.2570982575416565) | > loss_0: 2.934818744659424 (2.934818744659424) | > loss_gen: 1.6777468919754028 (1.6777468919754028) | > loss_kl: 5.387936115264893 (5.387936115264893) | > loss_feat: 0.2499593049287796 (0.2499593049287796) | > loss_mel: 12.538895606994629 (12.538895606994629) | > loss_duration: 3.2787907123565674 (3.2787907123565674) | > loss_1: 23.133331298828125 (23.133331298828125)  --> STEP: 2 | > loss_disc: 2.4411940574645996 (2.6880064010620117) | > loss_disc_real_0: 0.37170201539993286 (0.35067369043827057) | > loss_disc_real_1: 0.28094857931137085 (0.2704501897096634) | > loss_disc_real_2: 0.21225450932979584 (0.23439835757017136) | > loss_disc_real_3: 0.15634755790233612 (0.19142308086156845) | > loss_disc_real_4: 0.3512289226055145 (0.29409658163785934) | > loss_disc_real_5: 0.2621966600418091 (0.2596474587917328) | > loss_0: 2.4411940574645996 (2.6880064010620117) | > loss_gen: 3.1082191467285156 (2.3929830193519592) | > loss_kl: 5.9641242027282715 (5.676030158996582) | > loss_feat: 11.525663375854492 (5.887811340391636) | > loss_mel: 24.88372802734375 (18.71131181716919) | > loss_duration: 3.2675156593322754 (3.2731531858444214) | > loss_1: 48.74925231933594 (35.94129180908203)  --> STEP: 3 | > loss_disc: 2.8502039909362793 (2.742072264353434) | > loss_disc_real_0: 0.18429063260555267 (0.29521267116069794) | > loss_disc_real_1: 0.35582980513572693 (0.29891006151835126) | > loss_disc_real_2: 0.3752264380455017 (0.2813410510619481) | > loss_disc_real_3: 0.2967199385166168 (0.22652203341325125) | > loss_disc_real_4: 0.3397758901119232 (0.3093230177958806) | > loss_disc_real_5: 0.3219555914402008 (0.2804168363412221) | > loss_0: 2.8502039909362793 (2.742072264353434) | > loss_gen: 2.5271120071411133 (2.4376926819483438) | > loss_kl: 2.6238183975219727 (4.658626238505046) | > loss_feat: 4.285487651824951 (5.353703444202741) | > loss_mel: 21.515316009521484 (19.64597988128662) | > loss_duration: 3.010708808898926 (3.1856717268625894) | > loss_1: 33.962440490722656 (35.28167470296224) --> EVAL PERFORMANCE | > avg_loader_time: 0.029274145762125652 (+0.024339675903320312) | > avg_loss_disc: 2.742072264353434 (+0.45397162437438965) | > avg_loss_disc_real_0: 0.29521267116069794 (+0.11952705681324005) | > avg_loss_disc_real_1: 0.29891006151835126 (+0.05490833024183911) | > avg_loss_disc_real_2: 0.2813410510619481 (+0.09104166924953458) | > avg_loss_disc_real_3: 0.22652203341325125 (+0.02152136464913687) | > avg_loss_disc_real_4: 0.3093230177958806 (+0.15873269488414127) | > avg_loss_disc_real_5: 0.2804168363412221 (+0.14760843788584072) | > avg_loss_0: 2.742072264353434 (+0.45397162437438965) | > avg_loss_gen: 2.4376926819483438 (+0.34275877475738525) | > avg_loss_kl: 4.658626238505046 (+0.19858598709106445) | > avg_loss_feat: 5.353703444202741 (+0.29076453546682934) | > avg_loss_mel: 19.64597988128662 (-1.3739328384399414) | > avg_loss_duration: 3.1856717268625894 (+0.02947680155436183) | > avg_loss_1: 35.28167470296224 (-0.5123449961344377)  > EPOCH: 945/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:30:32)   --> TIME: 2023-10-20 11:30:42 -- STEP: 9/50 -- GLOBAL_STEP: 100260 | > loss_disc: 3.0587544441223145 (2.457289788458082) | > loss_disc_real_0: 0.14653007686138153 (0.1930181487566895) | > loss_disc_real_1: 0.2663063108921051 (0.2197287595934338) | > loss_disc_real_2: 0.29144713282585144 (0.2419689061741034) | > loss_disc_real_3: 0.3454190194606781 (0.1994981316642629) | > loss_disc_real_4: 0.4157589375972748 (0.2307311784889963) | > loss_disc_real_5: 0.5376145839691162 (0.26671654565466774) | > loss_0: 3.0587544441223145 (2.457289788458082) | > grad_norm_0: tensor(727.9948, device='cuda:0') (tensor(583.8171, device='cuda:0')) | > loss_gen: 2.539586305618286 (2.398603664504157) | > loss_kl: 1.043524980545044 (0.7983799113167657) | > loss_feat: 5.7903642654418945 (5.955709154407184) | > loss_mel: 24.688430786132812 (19.100449403127033) | > loss_duration: 1.3324116468429565 (1.3808817731009588) | > loss_1: 35.394317626953125 (29.634024408128525) | > grad_norm_1: tensor(4913.4399, device='cuda:0') (tensor(12387.2500, device='cuda:0')) | > current_lr_0: 7.7731322655859e-05 | > current_lr_1: 7.7731322655859e-05 | > step_time: 0.4114 (0.6233248710632324) | > loader_time: 0.011 (0.023722410202026367)  --> TIME: 2023-10-20 11:31:00 -- STEP: 39/50 -- GLOBAL_STEP: 100290 | > loss_disc: 2.9903972148895264 (2.456911417154165) | > loss_disc_real_0: 0.29102739691734314 (0.1584583392414527) | > loss_disc_real_1: 0.2702195644378662 (0.22592024275889763) | > loss_disc_real_2: 0.26500406861305237 (0.22637790556137377) | > loss_disc_real_3: 0.2427903562784195 (0.23559072580284032) | > loss_disc_real_4: 0.21650461852550507 (0.22632412822582784) | > loss_disc_real_5: 0.23679517209529877 (0.2435952718727863) | > loss_0: 2.9903972148895264 (2.456911417154165) | > grad_norm_0: tensor(705.4557, device='cuda:0') (tensor(532.3749, device='cuda:0')) | > loss_gen: 1.527681589126587 (2.322422528878236) | > loss_kl: 0.9638359546661377 (0.8523922524391077) | > loss_feat: 0.11692558228969574 (5.623773058637595) | > loss_mel: 1.8282440900802612 (20.003682371897575) | > loss_duration: 1.4493451118469238 (1.3625730795738025) | > loss_1: 5.886032581329346 (30.16484302129501) | > grad_norm_1: tensor(20271.9473, device='cuda:0') (tensor(21473.8691, device='cuda:0')) | > current_lr_0: 7.7731322655859e-05 | > current_lr_1: 7.7731322655859e-05 | > step_time: 0.7116 (0.5825801629286546) | > loader_time: 0.0408 (0.02092754535185985)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2999253273010254 (3.2999253273010254) | > loss_disc_real_0: 0.3819942772388458 (0.3819942772388458) | > loss_disc_real_1: 0.4353644549846649 (0.4353644549846649) | > loss_disc_real_2: 0.29577696323394775 (0.29577696323394775) | > loss_disc_real_3: 0.28038614988327026 (0.28038614988327026) | > loss_disc_real_4: 0.5148273706436157 (0.5148273706436157) | > loss_disc_real_5: 0.4071420729160309 (0.4071420729160309) | > loss_0: 3.2999253273010254 (3.2999253273010254) | > loss_gen: 2.5121355056762695 (2.5121355056762695) | > loss_kl: 5.1602044105529785 (5.1602044105529785) | > loss_feat: 6.095550060272217 (6.095550060272217) | > loss_mel: 21.555635452270508 (21.555635452270508) | > loss_duration: 3.0830440521240234 (3.0830440521240234) | > loss_1: 38.40657043457031 (38.40657043457031)  --> STEP: 1 | > loss_disc: 3.4758353233337402 (3.4758353233337402) | > loss_disc_real_0: 0.47430628538131714 (0.47430628538131714) | > loss_disc_real_1: 0.39897483587265015 (0.39897483587265015) | > loss_disc_real_2: 0.26088014245033264 (0.26088014245033264) | > loss_disc_real_3: 0.4499419927597046 (0.4499419927597046) | > loss_disc_real_4: 0.4312796890735626 (0.4312796890735626) | > loss_disc_real_5: 0.3275769352912903 (0.3275769352912903) | > loss_0: 3.4758353233337402 (3.4758353233337402) | > loss_gen: 2.174964666366577 (2.174964666366577) | > loss_kl: 5.23477840423584 (5.23477840423584) | > loss_feat: 3.5214333534240723 (3.5214333534240723) | > loss_mel: 24.261564254760742 (24.261564254760742) | > loss_duration: 3.48502254486084 (3.48502254486084) | > loss_1: 38.677764892578125 (38.677764892578125)  --> STEP: 2 | > loss_disc: 2.9725229740142822 (3.2241791486740112) | > loss_disc_real_0: 0.27991247177124023 (0.3771093785762787) | > loss_disc_real_1: 0.2638019323348999 (0.331388384103775) | > loss_disc_real_2: 0.2665688991546631 (0.26372452080249786) | > loss_disc_real_3: 0.2596110999584198 (0.3547765463590622) | > loss_disc_real_4: 0.29215532541275024 (0.36171750724315643) | > loss_disc_real_5: 0.2410045713186264 (0.28429075330495834) | > loss_0: 2.9725229740142822 (3.2241791486740112) | > loss_gen: 1.6447659730911255 (1.9098653197288513) | > loss_kl: 5.469964504241943 (5.352371454238892) | > loss_feat: 0.11108176410198212 (1.8162575587630272) | > loss_mel: 5.117477893829346 (14.689521074295044) | > loss_duration: 3.3366947174072266 (3.410858631134033) | > loss_1: 15.679985046386719 (27.178874969482422)  --> STEP: 3 | > loss_disc: 2.4870200157165527 (2.978459437688192) | > loss_disc_real_0: 0.03736947849392891 (0.2638627452154954) | > loss_disc_real_1: 0.07036185264587402 (0.2443795402844747) | > loss_disc_real_2: 0.05319390818476677 (0.19354764992992082) | > loss_disc_real_3: 0.01091840211302042 (0.24015716494371495) | > loss_disc_real_4: 0.0941045880317688 (0.27251320083936054) | > loss_disc_real_5: 0.004653349984437227 (0.19107828553145131) | > loss_0: 2.4870200157165527 (2.978459437688192) | > loss_gen: 1.4840433597564697 (1.7679246664047241) | > loss_kl: 2.5927836894989014 (4.4325088659922285) | > loss_feat: 10.136778831481934 (4.58976464966933) | > loss_mel: 27.603307723999023 (18.99411662419637) | > loss_duration: 3.0272276401519775 (3.2829816341400146) | > loss_1: 44.84414291381836 (33.0672976175944) --> EVAL PERFORMANCE | > avg_loader_time: 0.00245515505472819 (-0.02681899070739746) | > avg_loss_disc: 2.978459437688192 (+0.23638717333475778) | > avg_loss_disc_real_0: 0.2638627452154954 (-0.03134992594520253) | > avg_loss_disc_real_1: 0.2443795402844747 (-0.054530521233876555) | > avg_loss_disc_real_2: 0.19354764992992082 (-0.0877934011320273) | > avg_loss_disc_real_3: 0.24015716494371495 (+0.013635131530463696) | > avg_loss_disc_real_4: 0.27251320083936054 (-0.03680981695652008) | > avg_loss_disc_real_5: 0.19107828553145131 (-0.0893385508097708) | > avg_loss_0: 2.978459437688192 (+0.23638717333475778) | > avg_loss_gen: 1.7679246664047241 (-0.6697680155436196) | > avg_loss_kl: 4.4325088659922285 (-0.22611737251281738) | > avg_loss_feat: 4.58976464966933 (-0.7639387945334111) | > avg_loss_mel: 18.99411662419637 (-0.6518632570902518) | > avg_loss_duration: 3.2829816341400146 (+0.09730990727742528) | > avg_loss_1: 33.0672976175944 (-2.2143770853678433)  > EPOCH: 946/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:31:24)   --> TIME: 2023-10-20 11:31:39 -- STEP: 19/50 -- GLOBAL_STEP: 100320 | > loss_disc: 1.419503927230835 (2.400985830708554) | > loss_disc_real_0: 0.05263721942901611 (0.1626040971788921) | > loss_disc_real_1: 0.18934011459350586 (0.21511065724648928) | > loss_disc_real_2: 0.19773413240909576 (0.21181428157969526) | > loss_disc_real_3: 0.18507565557956696 (0.23272346920872988) | > loss_disc_real_4: 0.15008661150932312 (0.2564151755681163) | > loss_disc_real_5: 0.06622228026390076 (0.23760761849974332) | > loss_0: 1.419503927230835 (2.400985830708554) | > grad_norm_0: tensor(195.7532, device='cuda:0') (tensor(680.0214, device='cuda:0')) | > loss_gen: 3.5441040992736816 (2.4555405127374748) | > loss_kl: 0.7659087181091309 (0.8315679823097429) | > loss_feat: 9.251882553100586 (5.974587119723621) | > loss_mel: 22.599403381347656 (20.253550510657462) | > loss_duration: 1.5124934911727905 (1.4133625344226235) | > loss_1: 37.67379379272461 (30.928608894348145) | > grad_norm_1: tensor(9457.1475, device='cuda:0') (tensor(20954.2227, device='cuda:0')) | > current_lr_0: 7.765362533215625e-05 | > current_lr_1: 7.765362533215625e-05 | > step_time: 0.3622 (0.537582372364245) | > loader_time: 0.0049 (0.019090614820781508)  --> TIME: 2023-10-20 11:31:53 -- STEP: 49/50 -- GLOBAL_STEP: 100350 | > loss_disc: 2.72918701171875 (2.5471180920698204) | > loss_disc_real_0: 0.020915906876325607 (0.16756394923645623) | > loss_disc_real_1: 0.2215908169746399 (0.23173245574746812) | > loss_disc_real_2: 0.21640326082706451 (0.22925543359347753) | > loss_disc_real_3: 0.29553213715553284 (0.2453511534448789) | > loss_disc_real_4: 0.25906696915626526 (0.2531566507354074) | > loss_disc_real_5: 0.2682022452354431 (0.24312877700645097) | > loss_0: 2.72918701171875 (2.5471180920698204) | > grad_norm_0: tensor(1385.8041, device='cuda:0') (tensor(575.2285, device='cuda:0')) | > loss_gen: 1.767730712890625 (2.2414524579534727) | > loss_kl: 1.0265237092971802 (0.7943006578300681) | > loss_feat: 1.4537863731384277 (4.990945917231087) | > loss_mel: 20.28565216064453 (18.570305821846937) | > loss_duration: 1.4507641792297363 (1.3685618420036472) | > loss_1: 25.98445701599121 (27.9655667811024) | > grad_norm_1: tensor(6056.6406, device='cuda:0') (tensor(17958.7773, device='cuda:0')) | > current_lr_0: 7.765362533215625e-05 | > current_lr_1: 7.765362533215625e-05 | > step_time: 1.459 (0.47633885850711744) | > loader_time: 0.8848 (0.028348192876699013)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.13631534576416 (3.13631534576416) | > loss_disc_real_0: 0.4023212194442749 (0.4023212194442749) | > loss_disc_real_1: 0.3481990694999695 (0.3481990694999695) | > loss_disc_real_2: 0.4223496913909912 (0.4223496913909912) | > loss_disc_real_3: 0.3479871153831482 (0.3479871153831482) | > loss_disc_real_4: 0.4667329490184784 (0.4667329490184784) | > loss_disc_real_5: 0.2132476419210434 (0.2132476419210434) | > loss_0: 3.13631534576416 (3.13631534576416) | > loss_gen: 2.465366840362549 (2.465366840362549) | > loss_kl: 5.106688022613525 (5.106688022613525) | > loss_feat: 6.54573917388916 (6.54573917388916) | > loss_mel: 22.233118057250977 (22.233118057250977) | > loss_duration: 2.988693952560425 (2.988693952560425) | > loss_1: 39.339603424072266 (39.339603424072266)  --> STEP: 1 | > loss_disc: 3.010143280029297 (3.010143280029297) | > loss_disc_real_0: 0.41062068939208984 (0.41062068939208984) | > loss_disc_real_1: 0.2731780707836151 (0.2731780707836151) | > loss_disc_real_2: 0.3471543788909912 (0.3471543788909912) | > loss_disc_real_3: 0.3012218177318573 (0.3012218177318573) | > loss_disc_real_4: 0.3052642345428467 (0.3052642345428467) | > loss_disc_real_5: 0.26022741198539734 (0.26022741198539734) | > loss_0: 3.010143280029297 (3.010143280029297) | > loss_gen: 2.0085127353668213 (2.0085127353668213) | > loss_kl: 5.361129283905029 (5.361129283905029) | > loss_feat: 1.0508406162261963 (1.0508406162261963) | > loss_mel: 20.03977394104004 (20.03977394104004) | > loss_duration: 3.3183300495147705 (3.3183300495147705) | > loss_1: 31.778587341308594 (31.778587341308594)  --> STEP: 2 | > loss_disc: 2.5837297439575195 (2.796936511993408) | > loss_disc_real_0: 0.4182368814945221 (0.41442878544330597) | > loss_disc_real_1: 0.19470421969890594 (0.23394114524126053) | > loss_disc_real_2: 0.3095403015613556 (0.3283473402261734) | > loss_disc_real_3: 0.2623122036457062 (0.28176701068878174) | > loss_disc_real_4: 0.2439168095588684 (0.27459052205085754) | > loss_disc_real_5: 0.19892629981040955 (0.22957685589790344) | > loss_0: 2.5837297439575195 (2.796936511993408) | > loss_gen: 2.7362570762634277 (2.3723849058151245) | > loss_kl: 6.072627067565918 (5.716878175735474) | > loss_feat: 9.784433364868164 (5.41763699054718) | > loss_mel: 23.098033905029297 (21.568903923034668) | > loss_duration: 3.245807409286499 (3.2820687294006348) | > loss_1: 44.937156677246094 (38.357872009277344)  --> STEP: 3 | > loss_disc: 2.4645814895629883 (2.6861515045166016) | > loss_disc_real_0: 0.11348561942577362 (0.31411439677079517) | > loss_disc_real_1: 0.29585540294647217 (0.25457923114299774) | > loss_disc_real_2: 0.35385963320732117 (0.33685143788655597) | > loss_disc_real_3: 0.24969574809074402 (0.27107658982276917) | > loss_disc_real_4: 0.3039061427116394 (0.2843623956044515) | > loss_disc_real_5: 0.21616269648075104 (0.22510546942551932) | > loss_0: 2.4645814895629883 (2.6861515045166016) | > loss_gen: 2.655278205871582 (2.4666826725006104) | > loss_kl: 2.5184988975524902 (4.6507517496744795) | > loss_feat: 4.635447978973389 (5.156907320022583) | > loss_mel: 22.03191375732422 (21.72324053446452) | > loss_duration: 2.963228940963745 (3.1757887999216714) | > loss_1: 34.80436706542969 (37.173370361328125) --> EVAL PERFORMANCE | > avg_loader_time: 0.009183724721272787 (+0.0067285696665445975) | > avg_loss_disc: 2.6861515045166016 (-0.2923079331715903) | > avg_loss_disc_real_0: 0.31411439677079517 (+0.05025165155529976) | > avg_loss_disc_real_1: 0.25457923114299774 (+0.010199690858523042) | > avg_loss_disc_real_2: 0.33685143788655597 (+0.14330378795663515) | > avg_loss_disc_real_3: 0.27107658982276917 (+0.03091942487905422) | > avg_loss_disc_real_4: 0.2843623956044515 (+0.011849194765090942) | > avg_loss_disc_real_5: 0.22510546942551932 (+0.034027183894068) | > avg_loss_0: 2.6861515045166016 (-0.2923079331715903) | > avg_loss_gen: 2.4666826725006104 (+0.6987580060958862) | > avg_loss_kl: 4.6507517496744795 (+0.21824288368225098) | > avg_loss_feat: 5.156907320022583 (+0.5671426703532534) | > avg_loss_mel: 21.72324053446452 (+2.72912391026815) | > avg_loss_duration: 3.1757887999216714 (-0.10719283421834325) | > avg_loss_1: 37.173370361328125 (+4.106072743733726)  > EPOCH: 947/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:32:13)   --> TIME: 2023-10-20 11:32:37 -- STEP: 29/50 -- GLOBAL_STEP: 100380 | > loss_disc: 1.3028004169464111 (2.350104504618151) | > loss_disc_real_0: 0.013457685708999634 (0.13453242446071112) | > loss_disc_real_1: 0.06892035156488419 (0.22874906350826396) | > loss_disc_real_2: 0.10760719329118729 (0.23328367672089872) | > loss_disc_real_3: 0.20133958756923676 (0.24061022313504382) | > loss_disc_real_4: 0.08472900837659836 (0.2225007228553295) | > loss_disc_real_5: 0.0511174313724041 (0.20671813331287484) | > loss_0: 1.3028004169464111 (2.350104504618151) | > grad_norm_0: tensor(468.4650, device='cuda:0') (tensor(534.2020, device='cuda:0')) | > loss_gen: 3.2211644649505615 (2.435874918411518) | > loss_kl: 0.9117175936698914 (0.8032758603322094) | > loss_feat: 9.566031455993652 (6.61088347332231) | > loss_mel: 24.20562171936035 (22.30488260038968) | > loss_duration: 1.3579190969467163 (1.3707934371356307) | > loss_1: 39.262454986572266 (33.525710204551956) | > grad_norm_1: tensor(39921.9102, device='cuda:0') (tensor(24075.2637, device='cuda:0')) | > current_lr_0: 7.757600567179312e-05 | > current_lr_1: 7.757600567179312e-05 | > step_time: 0.5844 (0.6187369001322779) | > loader_time: 0.0095 (0.021403386675078292)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7568135261535645 (2.7568135261535645) | > loss_disc_real_0: 0.1611904352903366 (0.1611904352903366) | > loss_disc_real_1: 0.21830154955387115 (0.21830154955387115) | > loss_disc_real_2: 0.3169160783290863 (0.3169160783290863) | > loss_disc_real_3: 0.257487952709198 (0.257487952709198) | > loss_disc_real_4: 0.21260954439640045 (0.21260954439640045) | > loss_disc_real_5: 0.3274930715560913 (0.3274930715560913) | > loss_0: 2.7568135261535645 (2.7568135261535645) | > loss_gen: 1.9665031433105469 (1.9665031433105469) | > loss_kl: 5.363719940185547 (5.363719940185547) | > loss_feat: 5.089258193969727 (5.089258193969727) | > loss_mel: 23.20836639404297 (23.20836639404297) | > loss_duration: 3.0285892486572266 (3.0285892486572266) | > loss_1: 38.65644073486328 (38.65644073486328)  --> STEP: 1 | > loss_disc: 3.2788894176483154 (3.2788894176483154) | > loss_disc_real_0: 0.34269413352012634 (0.34269413352012634) | > loss_disc_real_1: 0.21448607742786407 (0.21448607742786407) | > loss_disc_real_2: 0.3067162036895752 (0.3067162036895752) | > loss_disc_real_3: 0.12655837833881378 (0.12655837833881378) | > loss_disc_real_4: 0.28700172901153564 (0.28700172901153564) | > loss_disc_real_5: 0.3558984100818634 (0.3558984100818634) | > loss_0: 3.2788894176483154 (3.2788894176483154) | > loss_gen: 1.8089416027069092 (1.8089416027069092) | > loss_kl: 4.9565229415893555 (4.9565229415893555) | > loss_feat: 4.725987434387207 (4.725987434387207) | > loss_mel: 25.005287170410156 (25.005287170410156) | > loss_duration: 3.369475841522217 (3.369475841522217) | > loss_1: 39.866214752197266 (39.866214752197266)  --> STEP: 2 | > loss_disc: 1.5175766944885254 (2.3982330560684204) | > loss_disc_real_0: 0.1110057532787323 (0.22684994339942932) | > loss_disc_real_1: 0.0497279092669487 (0.1321069933474064) | > loss_disc_real_2: 0.025664307177066803 (0.166190255433321) | > loss_disc_real_3: 0.08217566460371017 (0.10436702147126198) | > loss_disc_real_4: 0.07135091722011566 (0.17917632311582565) | > loss_disc_real_5: 0.03229064121842384 (0.19409452565014362) | > loss_0: 1.5175766944885254 (2.3982330560684204) | > loss_gen: 2.5891687870025635 (2.1990551948547363) | > loss_kl: 5.264108180999756 (5.110315561294556) | > loss_feat: 13.632474899291992 (9.1792311668396) | > loss_mel: 27.84908676147461 (26.427186965942383) | > loss_duration: 3.1900200843811035 (3.27974796295166) | > loss_1: 52.52486038208008 (46.19553756713867)  --> STEP: 3 | > loss_disc: 3.8433287143707275 (2.879931608835856) | > loss_disc_real_0: 0.08934185653924942 (0.181013914446036) | > loss_disc_real_1: 0.31290560960769653 (0.1923731987675031) | > loss_disc_real_2: 0.30894097685813904 (0.2137738292415937) | > loss_disc_real_3: 0.35827553272247314 (0.18900319188833237) | > loss_disc_real_4: 0.2585878372192383 (0.2056468278169632) | > loss_disc_real_5: 0.3624967932701111 (0.2502286148567994) | > loss_0: 3.8433287143707275 (2.879931608835856) | > loss_gen: 1.2493648529052734 (1.8824917475382488) | > loss_kl: 3.0946109294891357 (4.438414017359416) | > loss_feat: 4.976357936859131 (7.778273423512776) | > loss_mel: 22.59086036682129 (25.14841143290202) | > loss_duration: 3.074971914291382 (3.211489280064901) | > loss_1: 34.98616409301758 (42.45907974243164) --> EVAL PERFORMANCE | > avg_loader_time: 0.011313120524088541 (+0.002129395802815754) | > avg_loss_disc: 2.879931608835856 (+0.1937801043192544) | > avg_loss_disc_real_0: 0.181013914446036 (-0.13310048232475916) | > avg_loss_disc_real_1: 0.1923731987675031 (-0.06220603237549463) | > avg_loss_disc_real_2: 0.2137738292415937 (-0.12307760864496228) | > avg_loss_disc_real_3: 0.18900319188833237 (-0.0820733979344368) | > avg_loss_disc_real_4: 0.2056468278169632 (-0.07871556778748828) | > avg_loss_disc_real_5: 0.2502286148567994 (+0.02512314543128011) | > avg_loss_0: 2.879931608835856 (+0.1937801043192544) | > avg_loss_gen: 1.8824917475382488 (-0.5841909249623616) | > avg_loss_kl: 4.438414017359416 (-0.21233773231506348) | > avg_loss_feat: 7.778273423512776 (+2.6213661034901934) | > avg_loss_mel: 25.14841143290202 (+3.4251708984375) | > avg_loss_duration: 3.211489280064901 (+0.03570048014322946) | > avg_loss_1: 42.45907974243164 (+5.285709381103516)  > EPOCH: 948/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:33:06)   --> TIME: 2023-10-20 11:33:16 -- STEP: 9/50 -- GLOBAL_STEP: 100410 | > loss_disc: 2.83377742767334 (2.335185236401028) | > loss_disc_real_0: 0.13109643757343292 (0.15253534706102478) | > loss_disc_real_1: 0.24956963956356049 (0.22175985988643435) | > loss_disc_real_2: 0.2858029007911682 (0.20034311877356636) | > loss_disc_real_3: 0.3302142322063446 (0.23727924707863066) | > loss_disc_real_4: 0.28275150060653687 (0.21389746790130934) | > loss_disc_real_5: 0.2948058247566223 (0.20974891011913618) | > loss_0: 2.83377742767334 (2.335185236401028) | > grad_norm_0: tensor(427.9363, device='cuda:0') (tensor(477.4058, device='cuda:0')) | > loss_gen: 1.772666335105896 (2.455308026737637) | > loss_kl: 0.8184742331504822 (0.7331323954794142) | > loss_feat: 1.4419838190078735 (5.882747875319587) | > loss_mel: 19.87499237060547 (20.096490330166286) | > loss_duration: 1.3438953161239624 (1.3590461280610826) | > loss_1: 25.252012252807617 (30.526724497477215) | > grad_norm_1: tensor(2161.9309, device='cuda:0') (tensor(19226.1641, device='cuda:0')) | > current_lr_0: 7.749846359714023e-05 | > current_lr_1: 7.749846359714023e-05 | > step_time: 0.34 (0.5041158729129367) | > loader_time: 0.0044 (0.010569307539198134)  --> TIME: 2023-10-20 11:33:27 -- STEP: 39/50 -- GLOBAL_STEP: 100440 | > loss_disc: 2.638178825378418 (2.3580630895418997) | > loss_disc_real_0: 0.12351755797863007 (0.1422726392554931) | > loss_disc_real_1: 0.3228616416454315 (0.21657127457169387) | > loss_disc_real_2: 0.19087128341197968 (0.2124779340930474) | > loss_disc_real_3: 0.28356027603149414 (0.22967281813422838) | > loss_disc_real_4: 0.25959792733192444 (0.22699540404555124) | > loss_disc_real_5: 0.24145445227622986 (0.23909573834867048) | > loss_0: 2.638178825378418 (2.3580630895418997) | > grad_norm_0: tensor(813.3671, device='cuda:0') (tensor(589.6651, device='cuda:0')) | > loss_gen: 1.9315078258514404 (2.416021240063203) | > loss_kl: 0.6681382656097412 (0.7788640658060709) | > loss_feat: 2.7205848693847656 (5.3897643104577675) | > loss_mel: 21.23248291015625 (19.90254431198805) | > loss_duration: 1.4032213687896729 (1.3508938459249642) | > loss_1: 27.955934524536133 (29.838087827731403) | > grad_norm_1: tensor(3985.6116, device='cuda:0') (tensor(21541.7070, device='cuda:0')) | > current_lr_0: 7.749846359714023e-05 | > current_lr_1: 7.749846359714023e-05 | > step_time: 0.3155 (0.3725261321434608) | > loader_time: 0.0168 (0.007266466434185324)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7300161123275757 (1.7300161123275757) | > loss_disc_real_0: 0.1202811747789383 (0.1202811747789383) | > loss_disc_real_1: 0.20818157494068146 (0.20818157494068146) | > loss_disc_real_2: 0.113518625497818 (0.113518625497818) | > loss_disc_real_3: 0.27858707308769226 (0.27858707308769226) | > loss_disc_real_4: 0.05607597529888153 (0.05607597529888153) | > loss_disc_real_5: 0.04246370866894722 (0.04246370866894722) | > loss_0: 1.7300161123275757 (1.7300161123275757) | > loss_gen: 2.4699809551239014 (2.4699809551239014) | > loss_kl: 5.436545372009277 (5.436545372009277) | > loss_feat: 11.146085739135742 (11.146085739135742) | > loss_mel: 24.80234146118164 (24.80234146118164) | > loss_duration: 3.090946912765503 (3.090946912765503) | > loss_1: 46.945899963378906 (46.945899963378906)  --> STEP: 1 | > loss_disc: 2.8784916400909424 (2.8784916400909424) | > loss_disc_real_0: 0.11125309020280838 (0.11125309020280838) | > loss_disc_real_1: 0.35511475801467896 (0.35511475801467896) | > loss_disc_real_2: 0.16698256134986877 (0.16698256134986877) | > loss_disc_real_3: 0.2594817578792572 (0.2594817578792572) | > loss_disc_real_4: 0.16706489026546478 (0.16706489026546478) | > loss_disc_real_5: 0.30109283328056335 (0.30109283328056335) | > loss_0: 2.8784916400909424 (2.8784916400909424) | > loss_gen: 1.6074901819229126 (1.6074901819229126) | > loss_kl: 4.850466251373291 (4.850466251373291) | > loss_feat: 2.4063034057617188 (2.4063034057617188) | > loss_mel: 22.160049438476562 (22.160049438476562) | > loss_duration: 3.406942844390869 (3.406942844390869) | > loss_1: 34.431251525878906 (34.431251525878906)  --> STEP: 2 | > loss_disc: 2.9262406826019287 (2.9023661613464355) | > loss_disc_real_0: 0.2155168503522873 (0.16338497027754784) | > loss_disc_real_1: 0.3190873861312866 (0.3371010720729828) | > loss_disc_real_2: 0.2749502658843994 (0.2209664136171341) | > loss_disc_real_3: 0.31526556611061096 (0.2873736619949341) | > loss_disc_real_4: 0.24733416736125946 (0.20719952881336212) | > loss_disc_real_5: 0.2627457082271576 (0.2819192707538605) | > loss_0: 2.9262406826019287 (2.9023661613464355) | > loss_gen: 1.760533332824707 (1.6840117573738098) | > loss_kl: 5.559019088745117 (5.204742670059204) | > loss_feat: 0.8002769351005554 (1.603290170431137) | > loss_mel: 21.09345817565918 (21.62675380706787) | > loss_duration: 3.234280586242676 (3.3206117153167725) | > loss_1: 32.447566986083984 (33.439409255981445)  --> STEP: 3 | > loss_disc: 2.892214059829712 (2.898982127507528) | > loss_disc_real_0: 0.16285821795463562 (0.16320938616991043) | > loss_disc_real_1: 0.3049795925617218 (0.3263939122358958) | > loss_disc_real_2: 0.2565431594848633 (0.23282532890637717) | > loss_disc_real_3: 0.23832234740257263 (0.2710232237974803) | > loss_disc_real_4: 0.29919490218162537 (0.23786465326944986) | > loss_disc_real_5: 0.30505433678627014 (0.2896309594313304) | > loss_0: 2.892214059829712 (2.898982127507528) | > loss_gen: 1.7438827753067017 (1.7039687633514404) | > loss_kl: 2.4843199253082275 (4.297935088475545) | > loss_feat: 2.0678205490112305 (1.758133629957835) | > loss_mel: 19.422945022583008 (20.89215087890625) | > loss_duration: 2.986693859100342 (3.209305763244629) | > loss_1: 28.705663681030273 (31.861494064331055) --> EVAL PERFORMANCE | > avg_loader_time: 0.011323769887288412 (+1.0649363199870948e-05) | > avg_loss_disc: 2.898982127507528 (+0.019050518671671846) | > avg_loss_disc_real_0: 0.16320938616991043 (-0.01780452827612558) | > avg_loss_disc_real_1: 0.3263939122358958 (+0.1340207134683927) | > avg_loss_disc_real_2: 0.23282532890637717 (+0.019051499664783478) | > avg_loss_disc_real_3: 0.2710232237974803 (+0.08202003190914792) | > avg_loss_disc_real_4: 0.23786465326944986 (+0.032217825452486665) | > avg_loss_disc_real_5: 0.2896309594313304 (+0.039402344574530956) | > avg_loss_0: 2.898982127507528 (+0.019050518671671846) | > avg_loss_gen: 1.7039687633514404 (-0.17852298418680834) | > avg_loss_kl: 4.297935088475545 (-0.14047892888387103) | > avg_loss_feat: 1.758133629957835 (-6.020139793554941) | > avg_loss_mel: 20.89215087890625 (-4.256260553995769) | > avg_loss_duration: 3.209305763244629 (-0.002183516820271958) | > avg_loss_1: 31.861494064331055 (-10.597585678100586)  > EPOCH: 949/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:33:54)   --> TIME: 2023-10-20 11:34:11 -- STEP: 19/50 -- GLOBAL_STEP: 100470 | > loss_disc: 2.7060298919677734 (2.3550436371251156) | > loss_disc_real_0: 0.09905195981264114 (0.14989439398050308) | > loss_disc_real_1: 0.2277013063430786 (0.21475761207310776) | > loss_disc_real_2: 0.2605500817298889 (0.21154865612717053) | > loss_disc_real_3: 0.2982119619846344 (0.23545273393392563) | > loss_disc_real_4: 0.2174186408519745 (0.20278823811953006) | > loss_disc_real_5: 0.2764016389846802 (0.20453633042052388) | > loss_0: 2.7060298919677734 (2.3550436371251156) | > grad_norm_0: tensor(475.8214, device='cuda:0') (tensor(746.8837, device='cuda:0')) | > loss_gen: 1.8377947807312012 (2.394781125219245) | > loss_kl: 0.8142160177230835 (0.7504380486513439) | > loss_feat: 2.5319108963012695 (5.87644686971448) | > loss_mel: 21.486408233642578 (20.1133167241749) | > loss_duration: 1.4731464385986328 (1.3837471071042513) | > loss_1: 28.143476486206055 (30.518730138477526) | > grad_norm_1: tensor(3111.9956, device='cuda:0') (tensor(30794.8945, device='cuda:0')) | > current_lr_0: 7.742099903064584e-05 | > current_lr_1: 7.742099903064584e-05 | > step_time: 0.4354 (0.6211368535694324) | > loader_time: 0.0128 (0.021660792200188888)  --> TIME: 2023-10-20 11:34:30 -- STEP: 49/50 -- GLOBAL_STEP: 100500 | > loss_disc: 2.710221767425537 (2.298354766806778) | > loss_disc_real_0: 0.18072205781936646 (0.14966862644924198) | > loss_disc_real_1: 0.2160833775997162 (0.21184418472100278) | > loss_disc_real_2: 0.3358193039894104 (0.20759304928384265) | > loss_disc_real_3: 0.21400390565395355 (0.2202661861570514) | > loss_disc_real_4: 0.42162299156188965 (0.22263554797260737) | > loss_disc_real_5: 0.34982672333717346 (0.22063985566741653) | > loss_0: 2.710221767425537 (2.298354766806778) | > grad_norm_0: tensor(749.4601, device='cuda:0') (tensor(613.1300, device='cuda:0')) | > loss_gen: 2.7220635414123535 (2.4911870421195523) | > loss_kl: 0.5853245258331299 (0.8165357228444547) | > loss_feat: 5.616385459899902 (6.363287596944339) | > loss_mel: 22.748592376708984 (21.696168291325478) | > loss_duration: 1.4541667699813843 (1.363718641047575) | > loss_1: 33.12653350830078 (32.73089719305233) | > grad_norm_1: tensor(34449.7266, device='cuda:0') (tensor(23302.3691, device='cuda:0')) | > current_lr_0: 7.742099903064584e-05 | > current_lr_1: 7.742099903064584e-05 | > step_time: 0.4455 (0.6027445793151857) | > loader_time: 0.437 (0.029378657438317125)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8746538162231445 (2.8746538162231445) | > loss_disc_real_0: 0.18477410078048706 (0.18477410078048706) | > loss_disc_real_1: 0.476218581199646 (0.476218581199646) | > loss_disc_real_2: 0.41925275325775146 (0.41925275325775146) | > loss_disc_real_3: 0.36665651202201843 (0.36665651202201843) | > loss_disc_real_4: 0.3144119381904602 (0.3144119381904602) | > loss_disc_real_5: 0.24778594076633453 (0.24778594076633453) | > loss_0: 2.8746538162231445 (2.8746538162231445) | > loss_gen: 2.6605403423309326 (2.6605403423309326) | > loss_kl: 4.911032676696777 (4.911032676696777) | > loss_feat: 7.470082759857178 (7.470082759857178) | > loss_mel: 23.326190948486328 (23.326190948486328) | > loss_duration: 3.0002503395080566 (3.0002503395080566) | > loss_1: 41.368099212646484 (41.368099212646484)  --> STEP: 1 | > loss_disc: 2.511847972869873 (2.511847972869873) | > loss_disc_real_0: 0.09766624867916107 (0.09766624867916107) | > loss_disc_real_1: 0.22557535767555237 (0.22557535767555237) | > loss_disc_real_2: 0.21436047554016113 (0.21436047554016113) | > loss_disc_real_3: 0.27105703949928284 (0.27105703949928284) | > loss_disc_real_4: 0.2557999789714813 (0.2557999789714813) | > loss_disc_real_5: 0.30102118849754333 (0.30102118849754333) | > loss_0: 2.511847972869873 (2.511847972869873) | > loss_gen: 2.0024259090423584 (2.0024259090423584) | > loss_kl: 4.805465221405029 (4.805465221405029) | > loss_feat: 2.0076723098754883 (2.0076723098754883) | > loss_mel: 18.25434684753418 (18.25434684753418) | > loss_duration: 3.2355780601501465 (3.2355780601501465) | > loss_1: 30.30548858642578 (30.30548858642578)  --> STEP: 2 | > loss_disc: 2.985372304916382 (2.7486101388931274) | > loss_disc_real_0: 0.1581326574087143 (0.12789945304393768) | > loss_disc_real_1: 0.23948533833026886 (0.23253034800291061) | > loss_disc_real_2: 0.2824039161205292 (0.24838219583034515) | > loss_disc_real_3: 0.265270471572876 (0.2681637555360794) | > loss_disc_real_4: 0.2439710795879364 (0.24988552927970886) | > loss_disc_real_5: 0.2906936705112457 (0.29585742950439453) | > loss_0: 2.985372304916382 (2.7486101388931274) | > loss_gen: 1.5061362981796265 (1.7542811036109924) | > loss_kl: 5.815479755401611 (5.31047248840332) | > loss_feat: 0.1843189299106598 (1.095995619893074) | > loss_mel: 7.678611755371094 (12.966479301452637) | > loss_duration: 3.0926759243011475 (3.164126992225647) | > loss_1: 18.2772216796875 (24.29135513305664)  --> STEP: 3 | > loss_disc: 2.6236095428466797 (2.7069432735443115) | > loss_disc_real_0: 0.2518482506275177 (0.169215718905131) | > loss_disc_real_1: 0.30242207646369934 (0.2558275908231735) | > loss_disc_real_2: 0.35258591175079346 (0.28311676780382794) | > loss_disc_real_3: 0.3846667408943176 (0.3069980839888255) | > loss_disc_real_4: 0.322475403547287 (0.27408215403556824) | > loss_disc_real_5: 0.25255921483039856 (0.2814246912797292) | > loss_0: 2.6236095428466797 (2.7069432735443115) | > loss_gen: 2.841632843017578 (2.1167316834131875) | > loss_kl: 2.7886922359466553 (4.469879070917766) | > loss_feat: 4.37787389755249 (2.1899550457795462) | > loss_mel: 22.21651840209961 (16.04982566833496) | > loss_duration: 3.02422833442688 (3.1174941062927246) | > loss_1: 35.24894332885742 (27.943884531656902) --> EVAL PERFORMANCE | > avg_loader_time: 0.002141237258911133 (-0.00918253262837728) | > avg_loss_disc: 2.7069432735443115 (-0.1920388539632163) | > avg_loss_disc_real_0: 0.169215718905131 (+0.006006332735220582) | > avg_loss_disc_real_1: 0.2558275908231735 (-0.07056632141272229) | > avg_loss_disc_real_2: 0.28311676780382794 (+0.050291438897450774) | > avg_loss_disc_real_3: 0.3069980839888255 (+0.035974860191345215) | > avg_loss_disc_real_4: 0.27408215403556824 (+0.03621750076611838) | > avg_loss_disc_real_5: 0.2814246912797292 (-0.008206268151601193) | > avg_loss_0: 2.7069432735443115 (-0.1920388539632163) | > avg_loss_gen: 2.1167316834131875 (+0.4127629200617471) | > avg_loss_kl: 4.469879070917766 (+0.17194398244222064) | > avg_loss_feat: 2.1899550457795462 (+0.4318214158217113) | > avg_loss_mel: 16.04982566833496 (-4.842325210571289) | > avg_loss_duration: 3.1174941062927246 (-0.0918116569519043) | > avg_loss_1: 27.943884531656902 (-3.9176095326741525)  > EPOCH: 950/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:34:48)   --> TIME: 2023-10-20 11:35:22 -- STEP: 29/50 -- GLOBAL_STEP: 100530 | > loss_disc: 2.25160551071167 (2.3706381485379975) | > loss_disc_real_0: 0.08063646405935287 (0.12854378387845797) | > loss_disc_real_1: 0.13472580909729004 (0.2220039121035872) | > loss_disc_real_2: 0.21351803839206696 (0.2211729614385243) | > loss_disc_real_3: 0.20208105444908142 (0.24423416215797944) | > loss_disc_real_4: 0.25946295261383057 (0.23496177702628332) | > loss_disc_real_5: 0.13241419196128845 (0.22654734076610927) | > loss_0: 2.25160551071167 (2.3706381485379975) | > grad_norm_0: tensor(633.9060, device='cuda:0') (tensor(494.0341, device='cuda:0')) | > loss_gen: 2.410310983657837 (2.3982475461630988) | > loss_kl: 0.852940559387207 (0.820600215730996) | > loss_feat: 7.845404624938965 (5.5294788041762235) | > loss_mel: 20.641429901123047 (20.05843485223836) | > loss_duration: 1.319035291671753 (1.3692825662678685) | > loss_1: 33.069122314453125 (30.176044102372796) | > grad_norm_1: tensor(42884.8398, device='cuda:0') (tensor(24717.7520, device='cuda:0')) | > current_lr_0: 7.734361189483563e-05 | > current_lr_1: 7.734361189483563e-05 | > step_time: 0.4169 (0.6132241035329884) | > loader_time: 0.0018 (0.022920230339313376)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.431511878967285 (2.431511878967285) | > loss_disc_real_0: 0.2646690011024475 (0.2646690011024475) | > loss_disc_real_1: 0.23166604340076447 (0.23166604340076447) | > loss_disc_real_2: 0.2593464255332947 (0.2593464255332947) | > loss_disc_real_3: 0.2308514416217804 (0.2308514416217804) | > loss_disc_real_4: 0.20027154684066772 (0.20027154684066772) | > loss_disc_real_5: 0.23664002120494843 (0.23664002120494843) | > loss_0: 2.431511878967285 (2.431511878967285) | > loss_gen: 2.3797121047973633 (2.3797121047973633) | > loss_kl: 4.99321174621582 (4.99321174621582) | > loss_feat: 5.53632926940918 (5.53632926940918) | > loss_mel: 23.730409622192383 (23.730409622192383) | > loss_duration: 2.9883899688720703 (2.9883899688720703) | > loss_1: 39.6280517578125 (39.6280517578125)  --> STEP: 1 | > loss_disc: 1.9186315536499023 (1.9186315536499023) | > loss_disc_real_0: 0.22199705243110657 (0.22199705243110657) | > loss_disc_real_1: 0.223374143242836 (0.223374143242836) | > loss_disc_real_2: 0.2562558650970459 (0.2562558650970459) | > loss_disc_real_3: 0.2428857684135437 (0.2428857684135437) | > loss_disc_real_4: 0.15840452909469604 (0.15840452909469604) | > loss_disc_real_5: 0.1856122612953186 (0.1856122612953186) | > loss_0: 1.9186315536499023 (1.9186315536499023) | > loss_gen: 3.4118094444274902 (3.4118094444274902) | > loss_kl: 4.824845790863037 (4.824845790863037) | > loss_feat: 9.058340072631836 (9.058340072631836) | > loss_mel: 22.476696014404297 (22.476696014404297) | > loss_duration: 3.404487371444702 (3.404487371444702) | > loss_1: 43.176177978515625 (43.176177978515625)  --> STEP: 2 | > loss_disc: 1.937408447265625 (1.9280200004577637) | > loss_disc_real_0: 0.2633229196071625 (0.24265998601913452) | > loss_disc_real_1: 0.16359153389930725 (0.19348283857107162) | > loss_disc_real_2: 0.12392078340053558 (0.19008832424879074) | > loss_disc_real_3: 0.09134355932474136 (0.16711466386914253) | > loss_disc_real_4: 0.19230590760707855 (0.1753552183508873) | > loss_disc_real_5: 0.42109835147857666 (0.30335530638694763) | > loss_0: 1.937408447265625 (1.9280200004577637) | > loss_gen: 3.309116840362549 (3.3604631423950195) | > loss_kl: 5.764971733093262 (5.294908761978149) | > loss_feat: 7.665568828582764 (8.3619544506073) | > loss_mel: 24.267539978027344 (23.37211799621582) | > loss_duration: 3.274155855178833 (3.3393216133117676) | > loss_1: 44.28135299682617 (43.7287654876709)  --> STEP: 3 | > loss_disc: 2.0039916038513184 (1.9533438682556152) | > loss_disc_real_0: 0.3498140573501587 (0.2783780097961426) | > loss_disc_real_1: 0.22567398846149445 (0.20421322186787924) | > loss_disc_real_2: 0.21869824826717377 (0.19962496558825174) | > loss_disc_real_3: 0.20454908907413483 (0.17959280560413995) | > loss_disc_real_4: 0.3045647442340851 (0.21842506031195322) | > loss_disc_real_5: 0.23425640165805817 (0.2803223381439845) | > loss_0: 2.0039916038513184 (1.9533438682556152) | > loss_gen: 4.278805732727051 (3.6665773391723633) | > loss_kl: 2.459562063217163 (4.349793195724487) | > loss_feat: 7.909884929656982 (8.211264610290527) | > loss_mel: 21.51409339904785 (22.752776463826496) | > loss_duration: 3.0903074741363525 (3.256316900253296) | > loss_1: 39.252655029296875 (42.23672866821289) --> EVAL PERFORMANCE | > avg_loader_time: 0.00439763069152832 (+0.0022563934326171875) | > avg_loss_disc: 1.9533438682556152 (-0.7535994052886963) | > avg_loss_disc_real_0: 0.2783780097961426 (+0.10916229089101157) | > avg_loss_disc_real_1: 0.20421322186787924 (-0.05161436895529428) | > avg_loss_disc_real_2: 0.19962496558825174 (-0.0834918022155762) | > avg_loss_disc_real_3: 0.17959280560413995 (-0.12740527838468554) | > avg_loss_disc_real_4: 0.21842506031195322 (-0.05565709372361502) | > avg_loss_disc_real_5: 0.2803223381439845 (-0.0011023531357446936) | > avg_loss_0: 1.9533438682556152 (-0.7535994052886963) | > avg_loss_gen: 3.6665773391723633 (+1.5498456557591758) | > avg_loss_kl: 4.349793195724487 (-0.12008587519327829) | > avg_loss_feat: 8.211264610290527 (+6.021309564510981) | > avg_loss_mel: 22.752776463826496 (+6.702950795491535) | > avg_loss_duration: 3.256316900253296 (+0.1388227939605713) | > avg_loss_1: 42.23672866821289 (+14.292844136555988)  > EPOCH: 951/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:35:59)   --> TIME: 2023-10-20 11:36:13 -- STEP: 9/50 -- GLOBAL_STEP: 100560 | > loss_disc: 1.386168122291565 (2.269387682278951) | > loss_disc_real_0: 0.02763286978006363 (0.09658147394657135) | > loss_disc_real_1: 0.20004819333553314 (0.20303592830896378) | > loss_disc_real_2: 0.16908149421215057 (0.1978874769475725) | > loss_disc_real_3: 0.05837564170360565 (0.2185398754146364) | > loss_disc_real_4: 0.1610746830701828 (0.20117345535092884) | > loss_disc_real_5: 0.17052143812179565 (0.2079012253218227) | > loss_0: 1.386168122291565 (2.269387682278951) | > grad_norm_0: tensor(366.4348, device='cuda:0') (tensor(468.5723, device='cuda:0')) | > loss_gen: 3.4010727405548096 (2.3574291467666626) | > loss_kl: 0.8423022031784058 (0.9505085216628181) | > loss_feat: 10.055668830871582 (6.765893644756741) | > loss_mel: 23.35135269165039 (22.165502972073025) | > loss_duration: 1.3638124465942383 (1.3746569289101496) | > loss_1: 39.01420974731445 (33.61399141947428) | > grad_norm_1: tensor(44123.4883, device='cuda:0') (tensor(24224.2988, device='cuda:0')) | > current_lr_0: 7.726630211231284e-05 | > current_lr_1: 7.726630211231284e-05 | > step_time: 0.675 (0.9031211800045438) | > loader_time: 0.0077 (0.03045850329928928)  --> TIME: 2023-10-20 11:36:35 -- STEP: 39/50 -- GLOBAL_STEP: 100590 | > loss_disc: 0.790223240852356 (2.22919487953186) | > loss_disc_real_0: 0.019338205456733704 (0.126427033271354) | > loss_disc_real_1: 0.034019872546195984 (0.21435605151913104) | > loss_disc_real_2: 0.03489447385072708 (0.21225914836694032) | > loss_disc_real_3: 0.06149386614561081 (0.22495488058298063) | > loss_disc_real_4: 0.06991331279277802 (0.20295411181182432) | > loss_disc_real_5: 0.034343421459198 (0.2038216771892248) | > loss_0: 0.790223240852356 (2.22919487953186) | > grad_norm_0: tensor(330.8456, device='cuda:0') (tensor(579.4208, device='cuda:0')) | > loss_gen: 3.530465841293335 (2.4927793221595964) | > loss_kl: 0.6981509923934937 (0.8099093177379706) | > loss_feat: 12.258674621582031 (6.521707732708026) | > loss_mel: 23.11223793029785 (21.864711755361313) | > loss_duration: 1.4068562984466553 (1.3572916495494354) | > loss_1: 41.00638198852539 (33.04640002128406) | > grad_norm_1: tensor(32759.5078, device='cuda:0') (tensor(21314.0176, device='cuda:0')) | > current_lr_0: 7.726630211231284e-05 | > current_lr_1: 7.726630211231284e-05 | > step_time: 0.6702 (0.7339952358832726) | > loader_time: 0.0271 (0.021792038893088315)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.446678876876831 (2.446678876876831) | > loss_disc_real_0: 0.2861993610858917 (0.2861993610858917) | > loss_disc_real_1: 0.24581539630889893 (0.24581539630889893) | > loss_disc_real_2: 0.2644701302051544 (0.2644701302051544) | > loss_disc_real_3: 0.2828866243362427 (0.2828866243362427) | > loss_disc_real_4: 0.34566816687583923 (0.34566816687583923) | > loss_disc_real_5: 0.2635737359523773 (0.2635737359523773) | > loss_0: 2.446678876876831 (2.446678876876831) | > loss_gen: 2.735170602798462 (2.735170602798462) | > loss_kl: 4.745589256286621 (4.745589256286621) | > loss_feat: 5.964061260223389 (5.964061260223389) | > loss_mel: 22.79538345336914 (22.79538345336914) | > loss_duration: 3.0769078731536865 (3.0769078731536865) | > loss_1: 39.317115783691406 (39.317115783691406)  --> STEP: 1 | > loss_disc: 3.0237233638763428 (3.0237233638763428) | > loss_disc_real_0: 0.2639099657535553 (0.2639099657535553) | > loss_disc_real_1: 0.26134803891181946 (0.26134803891181946) | > loss_disc_real_2: 0.2168213576078415 (0.2168213576078415) | > loss_disc_real_3: 0.31900137662887573 (0.31900137662887573) | > loss_disc_real_4: 0.1622665971517563 (0.1622665971517563) | > loss_disc_real_5: 0.16354280710220337 (0.16354280710220337) | > loss_0: 3.0237233638763428 (3.0237233638763428) | > loss_gen: 1.9221160411834717 (1.9221160411834717) | > loss_kl: 5.224235534667969 (5.224235534667969) | > loss_feat: 3.2562754154205322 (3.2562754154205322) | > loss_mel: 19.357952117919922 (19.357952117919922) | > loss_duration: 3.4641313552856445 (3.4641313552856445) | > loss_1: 33.224708557128906 (33.224708557128906)  --> STEP: 2 | > loss_disc: 2.4569966793060303 (2.7403600215911865) | > loss_disc_real_0: 0.1541028469800949 (0.2090064063668251) | > loss_disc_real_1: 0.42786073684692383 (0.34460438787937164) | > loss_disc_real_2: 0.22997897863388062 (0.22340016812086105) | > loss_disc_real_3: 0.5426584482192993 (0.4308299124240875) | > loss_disc_real_4: 0.1631406992673874 (0.16270364820957184) | > loss_disc_real_5: 0.19932225346565247 (0.18143253028392792) | > loss_0: 2.4569966793060303 (2.7403600215911865) | > loss_gen: 2.951972007751465 (2.4370440244674683) | > loss_kl: 5.641468048095703 (5.432851791381836) | > loss_feat: 7.655483722686768 (5.45587956905365) | > loss_mel: 21.6072998046875 (20.48262596130371) | > loss_duration: 3.23150372505188 (3.347817540168762) | > loss_1: 41.08772659301758 (37.15621757507324)  --> STEP: 3 | > loss_disc: 2.7726259231567383 (2.751115322113037) | > loss_disc_real_0: 0.25193697214126587 (0.22331659495830536) | > loss_disc_real_1: 0.355537086725235 (0.34824862082799274) | > loss_disc_real_2: 0.32751691341400146 (0.2581057498852412) | > loss_disc_real_3: 0.26737305521965027 (0.3763442933559418) | > loss_disc_real_4: 0.32580167055130005 (0.21706965565681458) | > loss_disc_real_5: 0.37145867943763733 (0.24477458000183105) | > loss_0: 2.7726259231567383 (2.751115322113037) | > loss_gen: 2.612314462661743 (2.49546750386556) | > loss_kl: 2.621457099914551 (4.495720227559407) | > loss_feat: 3.399153232574463 (4.770304123560588) | > loss_mel: 22.64076042175293 (21.202004114786785) | > loss_duration: 3.0594234466552734 (3.251686175664266) | > loss_1: 34.333106994628906 (36.21518071492513) --> EVAL PERFORMANCE | > avg_loader_time: 0.006740967432657878 (+0.0023433367411295576) | > avg_loss_disc: 2.751115322113037 (+0.7977714538574219) | > avg_loss_disc_real_0: 0.22331659495830536 (-0.05506141483783722) | > avg_loss_disc_real_1: 0.34824862082799274 (+0.1440353989601135) | > avg_loss_disc_real_2: 0.2581057498852412 (+0.05848078429698947) | > avg_loss_disc_real_3: 0.3763442933559418 (+0.19675148775180182) | > avg_loss_disc_real_4: 0.21706965565681458 (-0.0013554046551386423) | > avg_loss_disc_real_5: 0.24477458000183105 (-0.03554775814215344) | > avg_loss_0: 2.751115322113037 (+0.7977714538574219) | > avg_loss_gen: 2.49546750386556 (-1.1711098353068032) | > avg_loss_kl: 4.495720227559407 (+0.14592703183491995) | > avg_loss_feat: 4.770304123560588 (-3.4409604867299395) | > avg_loss_mel: 21.202004114786785 (-1.5507723490397112) | > avg_loss_duration: 3.251686175664266 (-0.0046307245890298) | > avg_loss_1: 36.21518071492513 (-6.021547953287758)  > EPOCH: 952/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:36:52)   --> TIME: 2023-10-20 11:37:12 -- STEP: 19/50 -- GLOBAL_STEP: 100620 | > loss_disc: 2.766875982284546 (2.3475897563131234) | > loss_disc_real_0: 0.17792034149169922 (0.14118340856542716) | > loss_disc_real_1: 0.33057472109794617 (0.22872839240651383) | > loss_disc_real_2: 0.24583566188812256 (0.24640079470057236) | > loss_disc_real_3: 0.2537836730480194 (0.24096318393161423) | > loss_disc_real_4: 0.40112781524658203 (0.239351458259319) | > loss_disc_real_5: 0.38919731974601746 (0.22552902300498986) | > loss_0: 2.766875982284546 (2.3475897563131234) | > grad_norm_0: tensor(373.6430, device='cuda:0') (tensor(566.5626, device='cuda:0')) | > loss_gen: 2.513094663619995 (2.5397154343755624) | > loss_kl: 1.2838448286056519 (0.8991369699176989) | > loss_feat: 5.582712650299072 (6.801426002853795) | > loss_mel: 21.005525588989258 (22.929683860979583) | > loss_duration: 1.3853604793548584 (1.3801294565200806) | > loss_1: 31.770538330078125 (34.55009239598324) | > grad_norm_1: tensor(4949.5034, device='cuda:0') (tensor(20838.3066, device='cuda:0')) | > current_lr_0: 7.718906960575799e-05 | > current_lr_1: 7.718906960575799e-05 | > step_time: 0.5557 (0.7451792892656828) | > loader_time: 0.0084 (0.028617720854909795)  --> TIME: 2023-10-20 11:37:26 -- STEP: 49/50 -- GLOBAL_STEP: 100650 | > loss_disc: 2.6072640419006348 (2.4465714376799927) | > loss_disc_real_0: 0.10920862853527069 (0.14787334960182102) | > loss_disc_real_1: 0.2738564908504486 (0.22354054557425634) | > loss_disc_real_2: 0.20256024599075317 (0.22928096696126218) | > loss_disc_real_3: 0.30202725529670715 (0.23722135663336638) | > loss_disc_real_4: 0.28337642550468445 (0.23609440241541182) | > loss_disc_real_5: 0.2805131673812866 (0.23021563241372303) | > loss_0: 2.6072640419006348 (2.4465714376799927) | > grad_norm_0: tensor(728.8650, device='cuda:0') (tensor(521.0969, device='cuda:0')) | > loss_gen: 2.102313995361328 (2.350364565849304) | > loss_kl: 0.6630484461784363 (0.8048685339032388) | > loss_feat: 1.631805658340454 (5.696203042353902) | > loss_mel: 18.664100646972656 (19.583670998106196) | > loss_duration: 1.4580148458480835 (1.356043090625685) | > loss_1: 24.519283294677734 (29.791150258511912) | > grad_norm_1: tensor(6043.5234, device='cuda:0') (tensor(19986.0879, device='cuda:0')) | > current_lr_0: 7.718906960575799e-05 | > current_lr_1: 7.718906960575799e-05 | > step_time: 0.2875 (0.5521241061541496) | > loader_time: 0.4588 (0.02474501181621941)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9627203941345215 (2.9627203941345215) | > loss_disc_real_0: 0.3419809341430664 (0.3419809341430664) | > loss_disc_real_1: 0.272804856300354 (0.272804856300354) | > loss_disc_real_2: 0.3451469838619232 (0.3451469838619232) | > loss_disc_real_3: 0.32950153946876526 (0.32950153946876526) | > loss_disc_real_4: 0.38693493604660034 (0.38693493604660034) | > loss_disc_real_5: 0.428640216588974 (0.428640216588974) | > loss_0: 2.9627203941345215 (2.9627203941345215) | > loss_gen: 2.6330790519714355 (2.6330790519714355) | > loss_kl: 4.586206436157227 (4.586206436157227) | > loss_feat: 4.6867146492004395 (4.6867146492004395) | > loss_mel: 21.801620483398438 (21.801620483398438) | > loss_duration: 3.069082021713257 (3.069082021713257) | > loss_1: 36.77669906616211 (36.77669906616211)  --> STEP: 1 | > loss_disc: 2.563413619995117 (2.563413619995117) | > loss_disc_real_0: 0.4085022509098053 (0.4085022509098053) | > loss_disc_real_1: 0.24945688247680664 (0.24945688247680664) | > loss_disc_real_2: 0.17996296286582947 (0.17996296286582947) | > loss_disc_real_3: 0.3286953866481781 (0.3286953866481781) | > loss_disc_real_4: 0.2786164879798889 (0.2786164879798889) | > loss_disc_real_5: 0.3051554560661316 (0.3051554560661316) | > loss_0: 2.563413619995117 (2.563413619995117) | > loss_gen: 3.2617392539978027 (3.2617392539978027) | > loss_kl: 5.1376214027404785 (5.1376214027404785) | > loss_feat: 6.436446666717529 (6.436446666717529) | > loss_mel: 24.22054100036621 (24.22054100036621) | > loss_duration: 3.3713467121124268 (3.3713467121124268) | > loss_1: 42.42769241333008 (42.42769241333008)  --> STEP: 2 | > loss_disc: 3.0354201793670654 (2.7994168996810913) | > loss_disc_real_0: 0.3795308470726013 (0.3940165489912033) | > loss_disc_real_1: 0.27683785557746887 (0.26314736902713776) | > loss_disc_real_2: 0.24884726107120514 (0.2144051119685173) | > loss_disc_real_3: 0.26179301738739014 (0.2952442020177841) | > loss_disc_real_4: 0.27591338753700256 (0.27726493775844574) | > loss_disc_real_5: 0.27099448442459106 (0.28807497024536133) | > loss_0: 3.0354201793670654 (2.7994168996810913) | > loss_gen: 1.7109041213989258 (2.4863216876983643) | > loss_kl: 5.2645697593688965 (5.2010955810546875) | > loss_feat: 0.08733846992254257 (3.261892568320036) | > loss_mel: 2.5294272899627686 (13.37498414516449) | > loss_duration: 3.2286624908447266 (3.3000046014785767) | > loss_1: 12.820901870727539 (27.62429714202881)  --> STEP: 3 | > loss_disc: 2.3244612216949463 (2.6410983403523765) | > loss_disc_real_0: 0.1703256070613861 (0.3194529016812642) | > loss_disc_real_1: 0.2649770677089691 (0.26375726858774823) | > loss_disc_real_2: 0.3549634516239166 (0.2612578918536504) | > loss_disc_real_3: 0.3676523268222809 (0.319380243619283) | > loss_disc_real_4: 0.3040870130062103 (0.2862056295077006) | > loss_disc_real_5: 0.19940465688705444 (0.2585181991259257) | > loss_0: 2.3244612216949463 (2.6410983403523765) | > loss_gen: 2.8801329135894775 (2.6175920963287354) | > loss_kl: 2.5562119483947754 (4.319467703501384) | > loss_feat: 4.539615631103516 (3.6878002559145293) | > loss_mel: 22.366626739501953 (16.372198343276978) | > loss_duration: 3.112819194793701 (3.2376094659169516) | > loss_1: 35.455406188964844 (30.23466682434082) --> EVAL PERFORMANCE | > avg_loader_time: 0.013808250427246094 (+0.007067282994588216) | > avg_loss_disc: 2.6410983403523765 (-0.11001698176066066) | > avg_loss_disc_real_0: 0.3194529016812642 (+0.09613630672295886) | > avg_loss_disc_real_1: 0.26375726858774823 (-0.08449135224024451) | > avg_loss_disc_real_2: 0.2612578918536504 (+0.0031521419684091834) | > avg_loss_disc_real_3: 0.319380243619283 (-0.05696404973665875) | > avg_loss_disc_real_4: 0.2862056295077006 (+0.06913597385088605) | > avg_loss_disc_real_5: 0.2585181991259257 (+0.013743619124094664) | > avg_loss_0: 2.6410983403523765 (-0.11001698176066066) | > avg_loss_gen: 2.6175920963287354 (+0.12212459246317531) | > avg_loss_kl: 4.319467703501384 (-0.1762525240580235) | > avg_loss_feat: 3.6878002559145293 (-1.0825038676460585) | > avg_loss_mel: 16.372198343276978 (-4.8298057715098075) | > avg_loss_duration: 3.2376094659169516 (-0.014076709747314453) | > avg_loss_1: 30.23466682434082 (-5.980513890584312)  > EPOCH: 953/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:37:41)   --> TIME: 2023-10-20 11:38:07 -- STEP: 29/50 -- GLOBAL_STEP: 100680 | > loss_disc: 2.4079442024230957 (2.4522404958461896) | > loss_disc_real_0: 0.18978625535964966 (0.15664838793976554) | > loss_disc_real_1: 0.27621591091156006 (0.21713276297367853) | > loss_disc_real_2: 0.15377922356128693 (0.23298808572621182) | > loss_disc_real_3: 0.28072312474250793 (0.25205947767043935) | > loss_disc_real_4: 0.08546175807714462 (0.23635981835681816) | > loss_disc_real_5: 0.23792172968387604 (0.21624896572581653) | > loss_0: 2.4079442024230957 (2.4522404958461896) | > grad_norm_0: tensor(539.2354, device='cuda:0') (tensor(560.2151, device='cuda:0')) | > loss_gen: 2.4758715629577637 (2.3844064145252624) | > loss_kl: 0.7122549414634705 (0.8372516066863619) | > loss_feat: 7.984448432922363 (5.868138222473449) | > loss_mel: 23.50272560119629 (21.5315852658502) | > loss_duration: 1.2970446348190308 (1.3467937255727833) | > loss_1: 35.97234344482422 (31.96817565786428) | > grad_norm_1: tensor(20575.6523, device='cuda:0') (tensor(22879.4980, device='cuda:0')) | > current_lr_0: 7.711191429792891e-05 | > current_lr_1: 7.711191429792891e-05 | > step_time: 0.4307 (0.6146076794328361) | > loader_time: 0.0017 (0.024457298476120524)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9195713996887207 (2.9195713996887207) | > loss_disc_real_0: 0.2324911206960678 (0.2324911206960678) | > loss_disc_real_1: 0.248243048787117 (0.248243048787117) | > loss_disc_real_2: 0.21037377417087555 (0.21037377417087555) | > loss_disc_real_3: 0.2958987355232239 (0.2958987355232239) | > loss_disc_real_4: 0.261151522397995 (0.261151522397995) | > loss_disc_real_5: 0.28953978419303894 (0.28953978419303894) | > loss_0: 2.9195713996887207 (2.9195713996887207) | > loss_gen: 1.6871964931488037 (1.6871964931488037) | > loss_kl: 5.226693630218506 (5.226693630218506) | > loss_feat: 2.169668674468994 (2.169668674468994) | > loss_mel: 20.187564849853516 (20.187564849853516) | > loss_duration: 2.996138095855713 (2.996138095855713) | > loss_1: 32.26726150512695 (32.26726150512695)  --> STEP: 1 | > loss_disc: 2.612760543823242 (2.612760543823242) | > loss_disc_real_0: 0.19304007291793823 (0.19304007291793823) | > loss_disc_real_1: 0.14343856275081635 (0.14343856275081635) | > loss_disc_real_2: 0.2596723139286041 (0.2596723139286041) | > loss_disc_real_3: 0.24626146256923676 (0.24626146256923676) | > loss_disc_real_4: 0.2230197936296463 (0.2230197936296463) | > loss_disc_real_5: 0.17537179589271545 (0.17537179589271545) | > loss_0: 2.612760543823242 (2.612760543823242) | > loss_gen: 1.7086615562438965 (1.7086615562438965) | > loss_kl: 5.234064102172852 (5.234064102172852) | > loss_feat: 2.1538467407226562 (2.1538467407226562) | > loss_mel: 20.811689376831055 (20.811689376831055) | > loss_duration: 3.4299476146698 (3.4299476146698) | > loss_1: 33.33821105957031 (33.33821105957031)  --> STEP: 2 | > loss_disc: 2.9583332538604736 (2.785546898841858) | > loss_disc_real_0: 0.09843862801790237 (0.1457393504679203) | > loss_disc_real_1: 0.21764369308948517 (0.18054112792015076) | > loss_disc_real_2: 0.24091021716594696 (0.25029126554727554) | > loss_disc_real_3: 0.3070744574069977 (0.2766679599881172) | > loss_disc_real_4: 0.23636755347251892 (0.2296936735510826) | > loss_disc_real_5: 0.2844719886779785 (0.22992189228534698) | > loss_0: 2.9583332538604736 (2.785546898841858) | > loss_gen: 1.6363708972930908 (1.6725162267684937) | > loss_kl: 5.153329372406006 (5.193696737289429) | > loss_feat: 5.095157623291016 (3.624502182006836) | > loss_mel: 27.56561279296875 (24.188651084899902) | > loss_duration: 3.1579368114471436 (3.2939422130584717) | > loss_1: 42.6084098815918 (37.973310470581055)  --> STEP: 3 | > loss_disc: 2.6441733837127686 (2.738422393798828) | > loss_disc_real_0: 0.41835540533065796 (0.2366113687554995) | > loss_disc_real_1: 0.29201123118400574 (0.21769782900810242) | > loss_disc_real_2: 0.23142801225185394 (0.24400351444880167) | > loss_disc_real_3: 0.2599431872367859 (0.27109303573767346) | > loss_disc_real_4: 0.15509717166423798 (0.2048281729221344) | > loss_disc_real_5: 0.11587294191122055 (0.1919055754939715) | > loss_0: 2.6441733837127686 (2.738422393798828) | > loss_gen: 2.2132761478424072 (1.8527695337931316) | > loss_kl: 2.644010066986084 (4.343801180521647) | > loss_feat: 3.8477652072906494 (3.698923190434774) | > loss_mel: 22.35147476196289 (23.57625897725423) | > loss_duration: 3.040019989013672 (3.209301471710205) | > loss_1: 34.0965461730957 (36.6810557047526) --> EVAL PERFORMANCE | > avg_loader_time: 0.00923482577006022 (-0.004573424657185873) | > avg_loss_disc: 2.738422393798828 (+0.09732405344645167) | > avg_loss_disc_real_0: 0.2366113687554995 (-0.08284153292576471) | > avg_loss_disc_real_1: 0.21769782900810242 (-0.04605943957964581) | > avg_loss_disc_real_2: 0.24400351444880167 (-0.017254377404848725) | > avg_loss_disc_real_3: 0.27109303573767346 (-0.04828720788160956) | > avg_loss_disc_real_4: 0.2048281729221344 (-0.08137745658556622) | > avg_loss_disc_real_5: 0.1919055754939715 (-0.06661262363195422) | > avg_loss_0: 2.738422393798828 (+0.09732405344645167) | > avg_loss_gen: 1.8527695337931316 (-0.7648225625356038) | > avg_loss_kl: 4.343801180521647 (+0.024333477020263672) | > avg_loss_feat: 3.698923190434774 (+0.011122934520244598) | > avg_loss_mel: 23.57625897725423 (+7.204060633977253) | > avg_loss_duration: 3.209301471710205 (-0.028307994206746567) | > avg_loss_1: 36.6810557047526 (+6.4463888804117815)  > EPOCH: 954/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:38:31)   --> TIME: 2023-10-20 11:38:41 -- STEP: 9/50 -- GLOBAL_STEP: 100710 | > loss_disc: 2.8051464557647705 (2.655563089582655) | > loss_disc_real_0: 0.11432857066392899 (0.16164934241937268) | > loss_disc_real_1: 0.21684487164020538 (0.25402293188704383) | > loss_disc_real_2: 0.18261277675628662 (0.21650654739803737) | > loss_disc_real_3: 0.28772667050361633 (0.2334296554327011) | > loss_disc_real_4: 0.13116559386253357 (0.22070391062233183) | > loss_disc_real_5: 0.09149434417486191 (0.18637739246090254) | > loss_0: 2.8051464557647705 (2.655563089582655) | > grad_norm_0: tensor(401.4207, device='cuda:0') (tensor(487.7522, device='cuda:0')) | > loss_gen: 1.541282296180725 (2.0806234147813587) | > loss_kl: 0.6010849475860596 (0.7023316853576236) | > loss_feat: 4.78706169128418 (5.820373641120063) | > loss_mel: 22.40472412109375 (21.922947353786892) | > loss_duration: 1.2821820974349976 (1.3660761647754245) | > loss_1: 30.616334915161133 (31.892353057861328) | > grad_norm_1: tensor(1832.0360, device='cuda:0') (tensor(8683.1113, device='cuda:0')) | > current_lr_0: 7.703483611166064e-05 | > current_lr_1: 7.703483611166064e-05 | > step_time: 0.5998 (0.5174514187706841) | > loader_time: 0.0062 (0.016449398464626737)  --> TIME: 2023-10-20 11:39:01 -- STEP: 39/50 -- GLOBAL_STEP: 100740 | > loss_disc: 0.9858277440071106 (2.586379878031901) | > loss_disc_real_0: 0.045146629214286804 (0.1596728885689607) | > loss_disc_real_1: 0.04447571560740471 (0.23567865206263003) | > loss_disc_real_2: 0.03004358895123005 (0.2466044128418733) | > loss_disc_real_3: 0.07061023265123367 (0.23592857596201774) | > loss_disc_real_4: 0.01570952869951725 (0.23430009253132036) | > loss_disc_real_5: 0.008807153441011906 (0.22485809030536658) | > loss_0: 0.9858277440071106 (2.586379878031901) | > grad_norm_0: tensor(380.9160, device='cuda:0') (tensor(519.9184, device='cuda:0')) | > loss_gen: 3.5906126499176025 (2.2042002861316385) | > loss_kl: 0.5199692249298096 (0.7304283174184653) | > loss_feat: 13.736367225646973 (5.436810685082888) | > loss_mel: 26.336023330688477 (19.488880374492744) | > loss_duration: 1.4281902313232422 (1.3464112862562523) | > loss_1: 45.611167907714844 (29.206731172708366) | > grad_norm_1: tensor(72849.7734, device='cuda:0') (tensor(20328.2578, device='cuda:0')) | > current_lr_0: 7.703483611166064e-05 | > current_lr_1: 7.703483611166064e-05 | > step_time: 0.4507 (0.6103508411309658) | > loader_time: 0.0026 (0.017614358510726544)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9313526153564453 (2.9313526153564453) | > loss_disc_real_0: 0.15259501338005066 (0.15259501338005066) | > loss_disc_real_1: 0.26603034138679504 (0.26603034138679504) | > loss_disc_real_2: 0.2553829550743103 (0.2553829550743103) | > loss_disc_real_3: 0.29234710335731506 (0.29234710335731506) | > loss_disc_real_4: 0.28458908200263977 (0.28458908200263977) | > loss_disc_real_5: 0.27897122502326965 (0.27897122502326965) | > loss_0: 2.9313526153564453 (2.9313526153564453) | > loss_gen: 1.6494829654693604 (1.6494829654693604) | > loss_kl: 5.397697448730469 (5.397697448730469) | > loss_feat: 1.0324738025665283 (1.0324738025665283) | > loss_mel: 10.78394603729248 (10.78394603729248) | > loss_duration: 3.0780246257781982 (3.0780246257781982) | > loss_1: 21.94162368774414 (21.94162368774414)  --> STEP: 1 | > loss_disc: 2.2678651809692383 (2.2678651809692383) | > loss_disc_real_0: 0.18096114695072174 (0.18096114695072174) | > loss_disc_real_1: 0.26142334938049316 (0.26142334938049316) | > loss_disc_real_2: 0.18123281002044678 (0.18123281002044678) | > loss_disc_real_3: 0.269757479429245 (0.269757479429245) | > loss_disc_real_4: 0.18855732679367065 (0.18855732679367065) | > loss_disc_real_5: 0.1544858068227768 (0.1544858068227768) | > loss_0: 2.2678651809692383 (2.2678651809692383) | > loss_gen: 2.5864686965942383 (2.5864686965942383) | > loss_kl: 4.783046245574951 (4.783046245574951) | > loss_feat: 7.587644577026367 (7.587644577026367) | > loss_mel: 24.88081169128418 (24.88081169128418) | > loss_duration: 3.3877577781677246 (3.3877577781677246) | > loss_1: 43.22572708129883 (43.22572708129883)  --> STEP: 2 | > loss_disc: 2.035080909729004 (2.151473045349121) | > loss_disc_real_0: 0.05567000061273575 (0.11831557378172874) | > loss_disc_real_1: 0.20790566504001617 (0.23466450721025467) | > loss_disc_real_2: 0.23369476199150085 (0.20746378600597382) | > loss_disc_real_3: 0.2493005245923996 (0.2595290020108223) | > loss_disc_real_4: 0.1834789216518402 (0.18601812422275543) | > loss_disc_real_5: 0.4059047996997833 (0.28019530326128006) | > loss_0: 2.035080909729004 (2.151473045349121) | > loss_gen: 3.2690181732177734 (2.927743434906006) | > loss_kl: 5.208006858825684 (4.995526552200317) | > loss_feat: 9.190718650817871 (8.38918161392212) | > loss_mel: 27.804462432861328 (26.342637062072754) | > loss_duration: 3.3439879417419434 (3.365872859954834) | > loss_1: 48.816192626953125 (46.02095985412598)  --> STEP: 3 | > loss_disc: 2.75502610206604 (2.3526573975880942) | > loss_disc_real_0: 0.16896764934062958 (0.13519959896802902) | > loss_disc_real_1: 0.26200997829437256 (0.24377966423829397) | > loss_disc_real_2: 0.27678975462913513 (0.23057244221369425) | > loss_disc_real_3: 0.2679424583911896 (0.2623334874709447) | > loss_disc_real_4: 0.2820340096950531 (0.218023419380188) | > loss_disc_real_5: 0.25426432490348816 (0.27155164380868274) | > loss_0: 2.75502610206604 (2.3526573975880942) | > loss_gen: 1.797871470451355 (2.5511194467544556) | > loss_kl: 2.15842342376709 (4.049825509389241) | > loss_feat: 0.8311089873313904 (5.869824071725209) | > loss_mel: 15.617125511169434 (22.76746654510498) | > loss_duration: 3.0606436729431152 (3.2641297976175943) | > loss_1: 23.465173721313477 (38.50236447652181) --> EVAL PERFORMANCE | > avg_loader_time: 0.006379922231038411 (-0.0028549035390218096) | > avg_loss_disc: 2.3526573975880942 (-0.3857649962107339) | > avg_loss_disc_real_0: 0.13519959896802902 (-0.10141176978747049) | > avg_loss_disc_real_1: 0.24377966423829397 (+0.026081835230191558) | > avg_loss_disc_real_2: 0.23057244221369425 (-0.013431072235107422) | > avg_loss_disc_real_3: 0.2623334874709447 (-0.008759548266728756) | > avg_loss_disc_real_4: 0.218023419380188 (+0.013195246458053589) | > avg_loss_disc_real_5: 0.27155164380868274 (+0.07964606831471124) | > avg_loss_0: 2.3526573975880942 (-0.3857649962107339) | > avg_loss_gen: 2.5511194467544556 (+0.698349912961324) | > avg_loss_kl: 4.049825509389241 (-0.2939756711324062) | > avg_loss_feat: 5.869824071725209 (+2.1709008812904353) | > avg_loss_mel: 22.76746654510498 (-0.8087924321492501) | > avg_loss_duration: 3.2641297976175943 (+0.054828325907389175) | > avg_loss_1: 38.50236447652181 (+1.8213087717692105)  > EPOCH: 955/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:39:21)   --> TIME: 2023-10-20 11:39:38 -- STEP: 19/50 -- GLOBAL_STEP: 100770 | > loss_disc: 3.1831579208374023 (2.4543475979252865) | > loss_disc_real_0: 0.3571423292160034 (0.15872322444460893) | > loss_disc_real_1: 0.31354448199272156 (0.23684618857346082) | > loss_disc_real_2: 0.3731291592121124 (0.22578605970269755) | > loss_disc_real_3: 0.29384154081344604 (0.23722005517859207) | > loss_disc_real_4: 0.3182809054851532 (0.23658975488261172) | > loss_disc_real_5: 0.43489277362823486 (0.20779320519221456) | > loss_0: 3.1831579208374023 (2.4543475979252865) | > grad_norm_0: tensor(937.0677, device='cuda:0') (tensor(609.2054, device='cuda:0')) | > loss_gen: 2.0639657974243164 (2.287420950437847) | > loss_kl: 1.2195768356323242 (0.8805326301800577) | > loss_feat: 2.2081997394561768 (5.5549037119275635) | > loss_mel: 19.15072250366211 (18.60706173746209) | > loss_duration: 1.4434049129486084 (1.3875525123194645) | > loss_1: 26.08586883544922 (28.717471574482165) | > grad_norm_1: tensor(5921.4263, device='cuda:0') (tensor(32487.8613, device='cuda:0')) | > current_lr_0: 7.69578349698654e-05 | > current_lr_1: 7.69578349698654e-05 | > step_time: 0.506 (0.6389076333296927) | > loader_time: 0.0045 (0.021624652962935597)  --> TIME: 2023-10-20 11:40:00 -- STEP: 49/50 -- GLOBAL_STEP: 100800 | > loss_disc: 2.4771625995635986 (2.4269647087369646) | > loss_disc_real_0: 0.11422441154718399 (0.14851140552105344) | > loss_disc_real_1: 0.2954833507537842 (0.22355397372525565) | > loss_disc_real_2: 0.23411691188812256 (0.20907231728185197) | > loss_disc_real_3: 0.24776829779148102 (0.22042301162241065) | > loss_disc_real_4: 0.4200924336910248 (0.21678487561186965) | > loss_disc_real_5: 0.24868439137935638 (0.20969362450497492) | > loss_0: 2.4771625995635986 (2.4269647087369646) | > grad_norm_0: tensor(624.5301, device='cuda:0') (tensor(690.2389, device='cuda:0')) | > loss_gen: 2.734734535217285 (2.274049440208747) | > loss_kl: 0.8546124696731567 (0.8554023662391974) | > loss_feat: 4.81252384185791 (5.771750790124038) | > loss_mel: 24.013460159301758 (19.866392378904383) | > loss_duration: 1.4780828952789307 (1.3507325041050813) | > loss_1: 33.89341354370117 (30.118327471674704) | > grad_norm_1: tensor(8235.2832, device='cuda:0') (tensor(23190.1699, device='cuda:0')) | > current_lr_0: 7.69578349698654e-05 | > current_lr_1: 7.69578349698654e-05 | > step_time: 0.5827 (0.6562455673607029) | > loader_time: 0.6776 (0.03625944682529995)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.736712694168091 (2.736712694168091) | > loss_disc_real_0: 0.4598647952079773 (0.4598647952079773) | > loss_disc_real_1: 0.17551179230213165 (0.17551179230213165) | > loss_disc_real_2: 0.24463684856891632 (0.24463684856891632) | > loss_disc_real_3: 0.22393541038036346 (0.22393541038036346) | > loss_disc_real_4: 0.33538931608200073 (0.33538931608200073) | > loss_disc_real_5: 0.21194422245025635 (0.21194422245025635) | > loss_0: 2.736712694168091 (2.736712694168091) | > loss_gen: 2.635714054107666 (2.635714054107666) | > loss_kl: 4.797088623046875 (4.797088623046875) | > loss_feat: 6.644003391265869 (6.644003391265869) | > loss_mel: 21.714494705200195 (21.714494705200195) | > loss_duration: 2.9527175426483154 (2.9527175426483154) | > loss_1: 38.7440185546875 (38.7440185546875)  --> STEP: 1 | > loss_disc: 1.7400550842285156 (1.7400550842285156) | > loss_disc_real_0: 0.16260050237178802 (0.16260050237178802) | > loss_disc_real_1: 0.2979818880558014 (0.2979818880558014) | > loss_disc_real_2: 0.2647673487663269 (0.2647673487663269) | > loss_disc_real_3: 0.19471465051174164 (0.19471465051174164) | > loss_disc_real_4: 0.129045769572258 (0.129045769572258) | > loss_disc_real_5: 0.05718522146344185 (0.05718522146344185) | > loss_0: 1.7400550842285156 (1.7400550842285156) | > loss_gen: 3.3092751502990723 (3.3092751502990723) | > loss_kl: 4.766540050506592 (4.766540050506592) | > loss_feat: 8.928956985473633 (8.928956985473633) | > loss_mel: 22.480039596557617 (22.480039596557617) | > loss_duration: 3.373239278793335 (3.373239278793335) | > loss_1: 42.85805130004883 (42.85805130004883)  --> STEP: 2 | > loss_disc: 2.372218132019043 (2.0561366081237793) | > loss_disc_real_0: 0.27190688252449036 (0.2172536924481392) | > loss_disc_real_1: 0.24613209068775177 (0.2720569893717766) | > loss_disc_real_2: 0.3209275007247925 (0.2928474247455597) | > loss_disc_real_3: 0.2665765583515167 (0.23064560443162918) | > loss_disc_real_4: 0.2862977683544159 (0.20767176896333694) | > loss_disc_real_5: 0.286627858877182 (0.17190654017031193) | > loss_0: 2.372218132019043 (2.0561366081237793) | > loss_gen: 3.040278911590576 (3.174777030944824) | > loss_kl: 5.6052350997924805 (5.185887575149536) | > loss_feat: 8.71810531616211 (8.823531150817871) | > loss_mel: 21.355937957763672 (21.917988777160645) | > loss_duration: 3.248749017715454 (3.3109941482543945) | > loss_1: 41.96830749511719 (42.41317939758301)  --> STEP: 3 | > loss_disc: 2.7883782386779785 (2.3002171516418457) | > loss_disc_real_0: 0.44992226362228394 (0.29480988283952075) | > loss_disc_real_1: 0.33089902997016907 (0.2916710029045741) | > loss_disc_real_2: 0.27488768100738525 (0.2868608434995015) | > loss_disc_real_3: 0.3943900763988495 (0.28522709508736926) | > loss_disc_real_4: 0.1852128654718399 (0.2001854677995046) | > loss_disc_real_5: 0.2610529959201813 (0.20162202542026839) | > loss_0: 2.7883782386779785 (2.3002171516418457) | > loss_gen: 2.6030025482177734 (2.984185536702474) | > loss_kl: 2.4802656173706055 (4.284013589223226) | > loss_feat: 4.360652923583984 (7.335905075073242) | > loss_mel: 19.411678314208984 (21.082551956176758) | > loss_duration: 2.914381504058838 (3.1787899335225425) | > loss_1: 31.769981384277344 (38.86544672648112) --> EVAL PERFORMANCE | > avg_loader_time: 0.008591651916503906 (+0.002211729685465495) | > avg_loss_disc: 2.3002171516418457 (-0.05244024594624852) | > avg_loss_disc_real_0: 0.29480988283952075 (+0.15961028387149173) | > avg_loss_disc_real_1: 0.2916710029045741 (+0.04789133866628012) | > avg_loss_disc_real_2: 0.2868608434995015 (+0.05628840128580728) | > avg_loss_disc_real_3: 0.28522709508736926 (+0.02289360761642456) | > avg_loss_disc_real_4: 0.2001854677995046 (-0.01783795158068338) | > avg_loss_disc_real_5: 0.20162202542026839 (-0.06992961838841436) | > avg_loss_0: 2.3002171516418457 (-0.05244024594624852) | > avg_loss_gen: 2.984185536702474 (+0.43306608994801854) | > avg_loss_kl: 4.284013589223226 (+0.23418807983398438) | > avg_loss_feat: 7.335905075073242 (+1.466081003348033) | > avg_loss_mel: 21.082551956176758 (-1.6849145889282227) | > avg_loss_duration: 3.1787899335225425 (-0.08533986409505179) | > avg_loss_1: 38.86544672648112 (+0.36308224995930516)  > EPOCH: 956/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:40:14)   --> TIME: 2023-10-20 11:40:37 -- STEP: 29/50 -- GLOBAL_STEP: 100830 | > loss_disc: 1.618835210800171 (2.4607963356478466) | > loss_disc_real_0: 0.08270204067230225 (0.1506270097954006) | > loss_disc_real_1: 0.1901116520166397 (0.22719084240239243) | > loss_disc_real_2: 0.10453944653272629 (0.2312657018673831) | > loss_disc_real_3: 0.339445024728775 (0.259892889266384) | > loss_disc_real_4: 0.11200655251741409 (0.2312997588566665) | > loss_disc_real_5: 0.11012419313192368 (0.2156872720104353) | > loss_0: 1.618835210800171 (2.4607963356478466) | > grad_norm_0: tensor(345.9824, device='cuda:0') (tensor(605.9854, device='cuda:0')) | > loss_gen: 3.373103380203247 (2.403155409056565) | > loss_kl: 1.1212728023529053 (0.8616533669932135) | > loss_feat: 9.499421119689941 (5.945450392262689) | > loss_mel: 22.78985023498535 (20.933118626989167) | > loss_duration: 1.3791453838348389 (1.3669426194552718) | > loss_1: 38.16279602050781 (31.510320630566827) | > grad_norm_1: tensor(5489.1069, device='cuda:0') (tensor(22433.8535, device='cuda:0')) | > current_lr_0: 7.688091079553236e-05 | > current_lr_1: 7.688091079553236e-05 | > step_time: 0.5555 (0.6234320114398825) | > loader_time: 0.0343 (0.018483893624667465)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6737887859344482 (2.6737887859344482) | > loss_disc_real_0: 0.1919059157371521 (0.1919059157371521) | > loss_disc_real_1: 0.24398696422576904 (0.24398696422576904) | > loss_disc_real_2: 0.3717012107372284 (0.3717012107372284) | > loss_disc_real_3: 0.196459099650383 (0.196459099650383) | > loss_disc_real_4: 0.29151931405067444 (0.29151931405067444) | > loss_disc_real_5: 0.14988455176353455 (0.14988455176353455) | > loss_0: 2.6737887859344482 (2.6737887859344482) | > loss_gen: 2.053280830383301 (2.053280830383301) | > loss_kl: 4.497245788574219 (4.497245788574219) | > loss_feat: 5.302800178527832 (5.302800178527832) | > loss_mel: 22.419998168945312 (22.419998168945312) | > loss_duration: 3.004828453063965 (3.004828453063965) | > loss_1: 37.27815246582031 (37.27815246582031)  --> STEP: 1 | > loss_disc: 3.0970101356506348 (3.0970101356506348) | > loss_disc_real_0: 0.11547736078500748 (0.11547736078500748) | > loss_disc_real_1: 0.16635192930698395 (0.16635192930698395) | > loss_disc_real_2: 0.44583824276924133 (0.44583824276924133) | > loss_disc_real_3: 0.2213856428861618 (0.2213856428861618) | > loss_disc_real_4: 0.5073988437652588 (0.5073988437652588) | > loss_disc_real_5: 0.7261722087860107 (0.7261722087860107) | > loss_0: 3.0970101356506348 (3.0970101356506348) | > loss_gen: 2.556694507598877 (2.556694507598877) | > loss_kl: 5.0144524574279785 (5.0144524574279785) | > loss_feat: 6.694019317626953 (6.694019317626953) | > loss_mel: 25.36811637878418 (25.36811637878418) | > loss_duration: 3.3273119926452637 (3.3273119926452637) | > loss_1: 42.960594177246094 (42.960594177246094)  --> STEP: 2 | > loss_disc: 2.2434325218200684 (2.6702213287353516) | > loss_disc_real_0: 0.25895190238952637 (0.18721463158726692) | > loss_disc_real_1: 0.2282196581363678 (0.19728579372167587) | > loss_disc_real_2: 0.24262717366218567 (0.3442327082157135) | > loss_disc_real_3: 0.23038728535175323 (0.22588646411895752) | > loss_disc_real_4: 0.20756585896015167 (0.35748235136270523) | > loss_disc_real_5: 0.31642332673072815 (0.5212977677583694) | > loss_0: 2.2434325218200684 (2.6702213287353516) | > loss_gen: 2.9088072776794434 (2.73275089263916) | > loss_kl: 5.161355018615723 (5.087903738021851) | > loss_feat: 7.508727550506592 (7.1013734340667725) | > loss_mel: 23.436477661132812 (24.402297019958496) | > loss_duration: 3.252901554107666 (3.290106773376465) | > loss_1: 42.26826858520508 (42.614431381225586)  --> STEP: 3 | > loss_disc: 3.139047622680664 (2.8264967600504556) | > loss_disc_real_0: 0.2206142544746399 (0.19834783921639124) | > loss_disc_real_1: 0.3848753273487091 (0.25981563826402027) | > loss_disc_real_2: 0.4281540811061859 (0.3722064991792043) | > loss_disc_real_3: 0.31142789125442505 (0.25440027316411334) | > loss_disc_real_4: 0.34422728419303894 (0.35306399563948315) | > loss_disc_real_5: 0.3642632067203522 (0.46895291407903034) | > loss_0: 3.139047622680664 (2.8264967600504556) | > loss_gen: 2.104020357131958 (2.5231740474700928) | > loss_kl: 2.530191421508789 (4.23533296585083) | > loss_feat: 2.2435333728790283 (5.4820934136708575) | > loss_mel: 20.005273818969727 (22.936622619628906) | > loss_duration: 2.97930908203125 (3.18650754292806) | > loss_1: 29.862329483032227 (38.36373074849447) --> EVAL PERFORMANCE | > avg_loader_time: 0.018786271413167317 (+0.01019461949666341) | > avg_loss_disc: 2.8264967600504556 (+0.5262796084086099) | > avg_loss_disc_real_0: 0.19834783921639124 (-0.09646204362312952) | > avg_loss_disc_real_1: 0.25981563826402027 (-0.03185536464055383) | > avg_loss_disc_real_2: 0.3722064991792043 (+0.08534565567970276) | > avg_loss_disc_real_3: 0.25440027316411334 (-0.03082682192325592) | > avg_loss_disc_real_4: 0.35306399563948315 (+0.15287852783997855) | > avg_loss_disc_real_5: 0.46895291407903034 (+0.267330888658762) | > avg_loss_0: 2.8264967600504556 (+0.5262796084086099) | > avg_loss_gen: 2.5231740474700928 (-0.46101148923238133) | > avg_loss_kl: 4.23533296585083 (-0.04868062337239554) | > avg_loss_feat: 5.4820934136708575 (-1.8538116614023847) | > avg_loss_mel: 22.936622619628906 (+1.8540706634521484) | > avg_loss_duration: 3.18650754292806 (+0.007717609405517578) | > avg_loss_1: 38.36373074849447 (-0.5017159779866489)  > EPOCH: 957/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:41:00)   --> TIME: 2023-10-20 11:41:11 -- STEP: 9/50 -- GLOBAL_STEP: 100860 | > loss_disc: 2.891139507293701 (2.376200715700785) | > loss_disc_real_0: 0.03959445655345917 (0.1664346605539322) | > loss_disc_real_1: 0.2110559344291687 (0.2634669658210542) | > loss_disc_real_2: 0.28095024824142456 (0.23583676583237118) | > loss_disc_real_3: 0.26635387539863586 (0.24121768607033622) | > loss_disc_real_4: 0.3909223675727844 (0.24345374355713525) | > loss_disc_real_5: 0.2633794844150543 (0.20371940525041687) | > loss_0: 2.891139507293701 (2.376200715700785) | > grad_norm_0: tensor(626.3884, device='cuda:0') (tensor(552.9741, device='cuda:0')) | > loss_gen: 1.9510374069213867 (2.5253515905804105) | > loss_kl: 0.23396962881088257 (0.6396834419833289) | > loss_feat: 5.16021728515625 (6.361335379381974) | > loss_mel: 21.71558952331543 (20.713354852464462) | > loss_duration: 1.313618540763855 (1.3620036707984076) | > loss_1: 30.374431610107422 (31.601728757222492) | > grad_norm_1: tensor(3916.0266, device='cuda:0') (tensor(18762.6016, device='cuda:0')) | > current_lr_0: 7.680406351172774e-05 | > current_lr_1: 7.680406351172774e-05 | > step_time: 0.6648 (0.6700780656602647) | > loader_time: 0.0397 (0.022525469462076824)  --> TIME: 2023-10-20 11:41:25 -- STEP: 39/50 -- GLOBAL_STEP: 100890 | > loss_disc: 2.3578293323516846 (2.3687038085399528) | > loss_disc_real_0: 0.12306906282901764 (0.15662092204468378) | > loss_disc_real_1: 0.341594398021698 (0.23042763616794196) | > loss_disc_real_2: 0.24556830525398254 (0.21896424583899668) | > loss_disc_real_3: 0.2927062511444092 (0.23609669659382257) | > loss_disc_real_4: 0.24893200397491455 (0.2159412646164688) | > loss_disc_real_5: 0.26485103368759155 (0.20748739202435196) | > loss_0: 2.3578293323516846 (2.3687038085399528) | > grad_norm_0: tensor(812.4253, device='cuda:0') (tensor(583.1383, device='cuda:0')) | > loss_gen: 2.5533523559570312 (2.3717605486894264) | > loss_kl: 1.042235016822815 (0.8018427239014552) | > loss_feat: 4.212528228759766 (5.823818896825497) | > loss_mel: 21.526325225830078 (20.88448550150944) | > loss_duration: 1.3730123043060303 (1.3572779099146526) | > loss_1: 30.70745277404785 (31.239185455517898) | > grad_norm_1: tensor(26366.0703, device='cuda:0') (tensor(20369.6230, device='cuda:0')) | > current_lr_0: 7.680406351172774e-05 | > current_lr_1: 7.680406351172774e-05 | > step_time: 0.3421 (0.5083009218558285) | > loader_time: 0.0053 (0.013247386003151921)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6862406730651855 (2.6862406730651855) | > loss_disc_real_0: 0.3715735077857971 (0.3715735077857971) | > loss_disc_real_1: 0.3112347722053528 (0.3112347722053528) | > loss_disc_real_2: 0.31418219208717346 (0.31418219208717346) | > loss_disc_real_3: 0.2404853254556656 (0.2404853254556656) | > loss_disc_real_4: 0.28732484579086304 (0.28732484579086304) | > loss_disc_real_5: 0.353219211101532 (0.353219211101532) | > loss_0: 2.6862406730651855 (2.6862406730651855) | > loss_gen: 2.7706680297851562 (2.7706680297851562) | > loss_kl: 4.838938236236572 (4.838938236236572) | > loss_feat: 3.9508323669433594 (3.9508323669433594) | > loss_mel: 28.16554069519043 (28.16554069519043) | > loss_duration: 3.0537734031677246 (3.0537734031677246) | > loss_1: 42.77975082397461 (42.77975082397461)  --> STEP: 1 | > loss_disc: 2.740816831588745 (2.740816831588745) | > loss_disc_real_0: 0.15737032890319824 (0.15737032890319824) | > loss_disc_real_1: 0.3181726932525635 (0.3181726932525635) | > loss_disc_real_2: 0.4193481206893921 (0.4193481206893921) | > loss_disc_real_3: 0.2548319697380066 (0.2548319697380066) | > loss_disc_real_4: 0.5051624774932861 (0.5051624774932861) | > loss_disc_real_5: 0.37594497203826904 (0.37594497203826904) | > loss_0: 2.740816831588745 (2.740816831588745) | > loss_gen: 2.961041212081909 (2.961041212081909) | > loss_kl: 4.883370399475098 (4.883370399475098) | > loss_feat: 6.234091281890869 (6.234091281890869) | > loss_mel: 25.01077651977539 (25.01077651977539) | > loss_duration: 3.401961326599121 (3.401961326599121) | > loss_1: 42.491241455078125 (42.491241455078125)  --> STEP: 2 | > loss_disc: 3.1176466941833496 (2.9292317628860474) | > loss_disc_real_0: 0.3439575433731079 (0.2506639361381531) | > loss_disc_real_1: 0.2421201467514038 (0.28014642000198364) | > loss_disc_real_2: 0.23424997925758362 (0.32679904997348785) | > loss_disc_real_3: 0.2375919073820114 (0.246211938560009) | > loss_disc_real_4: 0.2854900062084198 (0.39532624185085297) | > loss_disc_real_5: 0.32181790471076965 (0.34888143837451935) | > loss_0: 3.1176466941833496 (2.9292317628860474) | > loss_gen: 1.5595210790634155 (2.2602811455726624) | > loss_kl: 5.335655689239502 (5.1095130443573) | > loss_feat: 0.24907971918582916 (3.241585500538349) | > loss_mel: 2.850898265838623 (13.930837392807007) | > loss_duration: 3.263680934906006 (3.3328211307525635) | > loss_1: 13.258834838867188 (27.875038146972656)  --> STEP: 3 | > loss_disc: 3.3414857387542725 (3.0666497548421225) | > loss_disc_real_0: 0.1211932972073555 (0.2075070564945539) | > loss_disc_real_1: 0.41391173005104065 (0.3247348566850026) | > loss_disc_real_2: 0.3822213113307953 (0.34527313709259033) | > loss_disc_real_3: 0.26178881525993347 (0.25140423079331714) | > loss_disc_real_4: 0.2017674595117569 (0.3308066477378209) | > loss_disc_real_5: 0.4616605341434479 (0.38647447029749554) | > loss_0: 3.3414857387542725 (3.0666497548421225) | > loss_gen: 1.7912232875823975 (2.103928526242574) | > loss_kl: 2.7631866931915283 (4.327404260635376) | > loss_feat: 5.666864395141602 (4.050011798739433) | > loss_mel: 24.98282241821289 (17.614832401275635) | > loss_duration: 3.0832648277282715 (3.249635696411133) | > loss_1: 38.287357330322266 (31.34581120808919) --> EVAL PERFORMANCE | > avg_loader_time: 0.02494223912556966 (+0.006155967712402344) | > avg_loss_disc: 3.0666497548421225 (+0.24015299479166696) | > avg_loss_disc_real_0: 0.2075070564945539 (+0.009159217278162657) | > avg_loss_disc_real_1: 0.3247348566850026 (+0.06491921842098236) | > avg_loss_disc_real_2: 0.34527313709259033 (-0.026933362086613954) | > avg_loss_disc_real_3: 0.25140423079331714 (-0.0029960423707962036) | > avg_loss_disc_real_4: 0.3308066477378209 (-0.022257347901662228) | > avg_loss_disc_real_5: 0.38647447029749554 (-0.0824784437815348) | > avg_loss_0: 3.0666497548421225 (+0.24015299479166696) | > avg_loss_gen: 2.103928526242574 (-0.41924552122751857) | > avg_loss_kl: 4.327404260635376 (+0.0920712947845459) | > avg_loss_feat: 4.050011798739433 (-1.4320816149314242) | > avg_loss_mel: 17.614832401275635 (-5.3217902183532715) | > avg_loss_duration: 3.249635696411133 (+0.06312815348307277) | > avg_loss_1: 31.34581120808919 (-7.017919540405277)  > EPOCH: 958/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:41:50)   --> TIME: 2023-10-20 11:42:10 -- STEP: 19/50 -- GLOBAL_STEP: 100920 | > loss_disc: 3.1100525856018066 (2.358893061939039) | > loss_disc_real_0: 0.4090985655784607 (0.15731975102895185) | > loss_disc_real_1: 0.3901595175266266 (0.2047822767574536) | > loss_disc_real_2: 0.32849422097206116 (0.21519162898000918) | > loss_disc_real_3: 0.3015472888946533 (0.19927627475638138) | > loss_disc_real_4: 0.33113783597946167 (0.21802964002678268) | > loss_disc_real_5: 0.3062792718410492 (0.22235521987864845) | > loss_0: 3.1100525856018066 (2.358893061939039) | > grad_norm_0: tensor(664.8260, device='cuda:0') (tensor(682.0961, device='cuda:0')) | > loss_gen: 2.264979839324951 (2.3295915001317073) | > loss_kl: 1.0668408870697021 (0.7880864284540477) | > loss_feat: 2.6873037815093994 (5.5077621560347705) | > loss_mel: 21.238525390625 (19.0214179566032) | > loss_duration: 1.467566967010498 (1.3751566159097772) | > loss_1: 28.725217819213867 (29.02201441714638) | > grad_norm_1: tensor(2861.8262, device='cuda:0') (tensor(22693.5820, device='cuda:0')) | > current_lr_0: 7.672729304159464e-05 | > current_lr_1: 7.672729304159464e-05 | > step_time: 0.7782 (0.6010344906857139) | > loader_time: 0.0316 (0.029214093559666685)  --> TIME: 2023-10-20 11:42:30 -- STEP: 49/50 -- GLOBAL_STEP: 100950 | > loss_disc: 2.6332011222839355 (2.4110181380291373) | > loss_disc_real_0: 0.06550166755914688 (0.1505908628127405) | > loss_disc_real_1: 0.29735901951789856 (0.21039498859674347) | > loss_disc_real_2: 0.17651914060115814 (0.20233995703106022) | > loss_disc_real_3: 0.30497288703918457 (0.2160262710281781) | > loss_disc_real_4: 0.24043403565883636 (0.22496223786123554) | > loss_disc_real_5: 0.3088222146034241 (0.2215541731186059) | > loss_0: 2.6332011222839355 (2.4110181380291373) | > grad_norm_0: tensor(975.2219, device='cuda:0') (tensor(700.1074, device='cuda:0')) | > loss_gen: 1.9155504703521729 (2.283403194680506) | > loss_kl: 0.8185663819313049 (0.8135149661375551) | > loss_feat: 1.4487805366516113 (5.418286426334965) | > loss_mel: 17.733963012695312 (19.96038225718907) | > loss_duration: 1.4876121282577515 (1.346221281557667) | > loss_1: 23.40447235107422 (29.821808211657466) | > grad_norm_1: tensor(9928.7676, device='cuda:0') (tensor(20509.7285, device='cuda:0')) | > current_lr_0: 7.672729304159464e-05 | > current_lr_1: 7.672729304159464e-05 | > step_time: 0.8023 (0.6208153841446858) | > loader_time: 0.5419 (0.03400511157755949)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6577258110046387 (2.6577258110046387) | > loss_disc_real_0: 0.21761061251163483 (0.21761061251163483) | > loss_disc_real_1: 0.32280978560447693 (0.32280978560447693) | > loss_disc_real_2: 0.32644882798194885 (0.32644882798194885) | > loss_disc_real_3: 0.22060708701610565 (0.22060708701610565) | > loss_disc_real_4: 0.43276217579841614 (0.43276217579841614) | > loss_disc_real_5: 0.5365722179412842 (0.5365722179412842) | > loss_0: 2.6577258110046387 (2.6577258110046387) | > loss_gen: 3.2428369522094727 (3.2428369522094727) | > loss_kl: 4.899399757385254 (4.899399757385254) | > loss_feat: 7.059932708740234 (7.059932708740234) | > loss_mel: 22.484661102294922 (22.484661102294922) | > loss_duration: 3.0280866622924805 (3.0280866622924805) | > loss_1: 40.71491622924805 (40.71491622924805)  --> STEP: 1 | > loss_disc: 1.888548731803894 (1.888548731803894) | > loss_disc_real_0: 0.08493735641241074 (0.08493735641241074) | > loss_disc_real_1: 0.07310867309570312 (0.07310867309570312) | > loss_disc_real_2: 0.16034026443958282 (0.16034026443958282) | > loss_disc_real_3: 0.18245552480220795 (0.18245552480220795) | > loss_disc_real_4: 0.20849166810512543 (0.20849166810512543) | > loss_disc_real_5: 0.19790597259998322 (0.19790597259998322) | > loss_0: 1.888548731803894 (1.888548731803894) | > loss_gen: 2.6384787559509277 (2.6384787559509277) | > loss_kl: 4.516259670257568 (4.516259670257568) | > loss_feat: 10.877435684204102 (10.877435684204102) | > loss_mel: 25.815561294555664 (25.815561294555664) | > loss_duration: 3.3392364978790283 (3.3392364978790283) | > loss_1: 47.186973571777344 (47.186973571777344)  --> STEP: 2 | > loss_disc: 2.0112414360046387 (1.9498950839042664) | > loss_disc_real_0: 0.18655529618263245 (0.1357463262975216) | > loss_disc_real_1: 0.2163502424955368 (0.14472945779561996) | > loss_disc_real_2: 0.03867912292480469 (0.09950969368219376) | > loss_disc_real_3: 0.1201007068157196 (0.15127811580896378) | > loss_disc_real_4: 0.06940467655658722 (0.13894817233085632) | > loss_disc_real_5: 0.11598336696624756 (0.1569446697831154) | > loss_0: 2.0112414360046387 (1.9498950839042664) | > loss_gen: 2.065722703933716 (2.3521007299423218) | > loss_kl: 5.79619836807251 (5.156229019165039) | > loss_feat: 9.625066757202148 (10.251251220703125) | > loss_mel: 25.737289428710938 (25.7764253616333) | > loss_duration: 3.227302074432373 (3.2832692861557007) | > loss_1: 46.45158004760742 (46.81927680969238)  --> STEP: 3 | > loss_disc: 2.7814440727233887 (2.227078080177307) | > loss_disc_real_0: 0.319612979888916 (0.1970352108279864) | > loss_disc_real_1: 0.2143440693616867 (0.1679343283176422) | > loss_disc_real_2: 0.24361379444599152 (0.147544393936793) | > loss_disc_real_3: 0.3285389244556427 (0.2103650520245234) | > loss_disc_real_4: 0.32211875915527344 (0.20000503460566202) | > loss_disc_real_5: 0.4128013551235199 (0.24223023156325021) | > loss_0: 2.7814440727233887 (2.227078080177307) | > loss_gen: 2.5772249698638916 (2.4271421432495117) | > loss_kl: 2.730342388153076 (4.347600142161052) | > loss_feat: 3.2587053775787354 (7.920402606328328) | > loss_mel: 15.685261726379395 (22.412704149882) | > loss_duration: 3.0012407302856445 (3.1892597675323486) | > loss_1: 27.25277328491211 (40.29710896809896) --> EVAL PERFORMANCE | > avg_loader_time: 0.02845486005147298 (+0.0035126209259033203) | > avg_loss_disc: 2.227078080177307 (-0.8395716746648154) | > avg_loss_disc_real_0: 0.1970352108279864 (-0.010471845666567503) | > avg_loss_disc_real_1: 0.1679343283176422 (-0.15680052836736041) | > avg_loss_disc_real_2: 0.147544393936793 (-0.19772874315579733) | > avg_loss_disc_real_3: 0.2103650520245234 (-0.04103917876879373) | > avg_loss_disc_real_4: 0.20000503460566202 (-0.1308016131321589) | > avg_loss_disc_real_5: 0.24223023156325021 (-0.14424423873424533) | > avg_loss_0: 2.227078080177307 (-0.8395716746648154) | > avg_loss_gen: 2.4271421432495117 (+0.3232136170069375) | > avg_loss_kl: 4.347600142161052 (+0.020195881525675752) | > avg_loss_feat: 7.920402606328328 (+3.870390807588895) | > avg_loss_mel: 22.412704149882 (+4.797871748606365) | > avg_loss_duration: 3.1892597675323486 (-0.06037592887878418) | > avg_loss_1: 40.29710896809896 (+8.95129776000977)  > EPOCH: 959/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:42:45)   --> TIME: 2023-10-20 11:43:04 -- STEP: 29/50 -- GLOBAL_STEP: 100980 | > loss_disc: 2.0273799896240234 (2.4469957433897873) | > loss_disc_real_0: 0.04155442863702774 (0.14701804737078733) | > loss_disc_real_1: 0.14675775170326233 (0.21994811097352668) | > loss_disc_real_2: 0.15045730769634247 (0.23011353560562792) | > loss_disc_real_3: 0.13443484902381897 (0.24706157425354267) | > loss_disc_real_4: 0.20610377192497253 (0.23698073278727202) | > loss_disc_real_5: 0.2886841297149658 (0.2412282114141974) | > loss_0: 2.0273799896240234 (2.4469957433897873) | > grad_norm_0: tensor(648.3996, device='cuda:0') (tensor(750.4158, device='cuda:0')) | > loss_gen: 2.614325523376465 (2.277068384762468) | > loss_kl: 0.6304045915603638 (0.8901683544290477) | > loss_feat: 7.273712635040283 (5.115743397446028) | > loss_mel: 16.24296760559082 (20.352003570260674) | > loss_duration: 1.3822174072265625 (1.3821488331104148) | > loss_1: 28.143627166748047 (30.0171327755369) | > grad_norm_1: tensor(14704.8066, device='cuda:0') (tensor(21629.3008, device='cuda:0')) | > current_lr_0: 7.665059930835296e-05 | > current_lr_1: 7.665059930835296e-05 | > step_time: 0.3511 (0.4771289249946331) | > loader_time: 0.0045 (0.016530817952649345)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2223572731018066 (3.2223572731018066) | > loss_disc_real_0: 0.36337944865226746 (0.36337944865226746) | > loss_disc_real_1: 0.26742008328437805 (0.26742008328437805) | > loss_disc_real_2: 0.2754601240158081 (0.2754601240158081) | > loss_disc_real_3: 0.34855812788009644 (0.34855812788009644) | > loss_disc_real_4: 0.24864259362220764 (0.24864259362220764) | > loss_disc_real_5: 0.2685641646385193 (0.2685641646385193) | > loss_0: 3.2223572731018066 (3.2223572731018066) | > loss_gen: 1.830559253692627 (1.830559253692627) | > loss_kl: 5.080845355987549 (5.080845355987549) | > loss_feat: 4.313663005828857 (4.313663005828857) | > loss_mel: 20.633211135864258 (20.633211135864258) | > loss_duration: 2.9515936374664307 (2.9515936374664307) | > loss_1: 34.809871673583984 (34.809871673583984)  --> STEP: 1 | > loss_disc: 2.8844258785247803 (2.8844258785247803) | > loss_disc_real_0: 0.4480474293231964 (0.4480474293231964) | > loss_disc_real_1: 0.31740179657936096 (0.31740179657936096) | > loss_disc_real_2: 0.3049710690975189 (0.3049710690975189) | > loss_disc_real_3: 0.260814905166626 (0.260814905166626) | > loss_disc_real_4: 0.26030203700065613 (0.26030203700065613) | > loss_disc_real_5: 0.5304689407348633 (0.5304689407348633) | > loss_0: 2.8844258785247803 (2.8844258785247803) | > loss_gen: 3.203481912612915 (3.203481912612915) | > loss_kl: 4.738136291503906 (4.738136291503906) | > loss_feat: 7.784193992614746 (7.784193992614746) | > loss_mel: 22.363967895507812 (22.363967895507812) | > loss_duration: 3.3871235847473145 (3.3871235847473145) | > loss_1: 41.476905822753906 (41.476905822753906)  --> STEP: 2 | > loss_disc: 2.731112003326416 (2.807768940925598) | > loss_disc_real_0: 0.2617741525173187 (0.35491079092025757) | > loss_disc_real_1: 0.24806557595729828 (0.2827336862683296) | > loss_disc_real_2: 0.36099737882614136 (0.33298422396183014) | > loss_disc_real_3: 0.37949052453041077 (0.32015271484851837) | > loss_disc_real_4: 0.26606225967407227 (0.2631821483373642) | > loss_disc_real_5: 0.1093871146440506 (0.31992802768945694) | > loss_0: 2.731112003326416 (2.807768940925598) | > loss_gen: 2.537869453430176 (2.8706756830215454) | > loss_kl: 6.059079170227051 (5.3986077308654785) | > loss_feat: 8.61934757232666 (8.201770782470703) | > loss_mel: 23.561052322387695 (22.962510108947754) | > loss_duration: 3.2243218421936035 (3.305722713470459) | > loss_1: 44.001670837402344 (42.739288330078125)  --> STEP: 3 | > loss_disc: 3.0718109607696533 (2.895782947540283) | > loss_disc_real_0: 0.5281121730804443 (0.41264458497365314) | > loss_disc_real_1: 0.2239612638950348 (0.2631428788105647) | > loss_disc_real_2: 0.3088148236274719 (0.32492775718371075) | > loss_disc_real_3: 0.2248416393995285 (0.28838235636552173) | > loss_disc_real_4: 0.2757892906665802 (0.26738452911376953) | > loss_disc_real_5: 0.2893412709236145 (0.3097324421008428) | > loss_0: 3.0718109607696533 (2.895782947540283) | > loss_gen: 1.9576371908187866 (2.566329518953959) | > loss_kl: 2.5116286277770996 (4.4362813631693525) | > loss_feat: 1.425494909286499 (5.943012158075969) | > loss_mel: 20.115493774414062 (22.01350466410319) | > loss_duration: 2.972172260284424 (3.194539229075114) | > loss_1: 28.9824275970459 (38.15366808573405) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_101000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1488113403320312 (2.95904004573822) | > loss_disc_real_0: 0.4030081629753113 (0.4102354794740677) | > loss_disc_real_1: 0.320499062538147 (0.27748192474246025) | > loss_disc_real_2: 0.3261953592300415 (0.3252446576952934) | > loss_disc_real_3: 0.2687423527240753 (0.28347235545516014) | > loss_disc_real_4: 0.11733505874872208 (0.22987216152250767) | > loss_disc_real_5: 0.06668321788311005 (0.2489701360464096) | > loss_0: 3.1488113403320312 (2.95904004573822) | > loss_gen: 2.053248167037964 (2.4380591809749603) | > loss_kl: 4.820224761962891 (4.532267212867737) | > loss_feat: 6.215306282043457 (6.011085689067841) | > loss_mel: 16.07040023803711 (20.52772855758667) | > loss_duration: 2.936647415161133 (3.1300662755966187) | > loss_1: 32.0958251953125 (36.63920736312866)  --> STEP: 1 | > loss_disc: 2.9401822090148926 (2.9552684783935548) | > loss_disc_real_0: 0.44988369941711426 (0.418165123462677) | > loss_disc_real_1: 0.22399751842021942 (0.2667850434780121) | > loss_disc_real_2: 0.3026740849018097 (0.32073054313659666) | > loss_disc_real_3: 0.33781737089157104 (0.2943413585424423) | > loss_disc_real_4: 0.17634031176567078 (0.2191657915711403) | > loss_disc_real_5: 0.2065402865409851 (0.2404841661453247) | > loss_0: 2.9401822090148926 (2.9552684783935548) | > loss_gen: 2.56107497215271 (2.4626623392105103) | > loss_kl: 5.199848175048828 (4.665783405303955) | > loss_feat: 6.439584732055664 (6.0967854976654055) | > loss_mel: 23.76557159423828 (21.17529716491699) | > loss_duration: 3.391728162765503 (3.1823986530303956) | > loss_1: 41.35780715942383 (37.5829273223877)  --> STEP: 2 | > loss_disc: 2.93583345413208 (2.952029307683309) | > loss_disc_real_0: 0.3241269290447235 (0.40249209105968475) | > loss_disc_real_1: 0.2327178567647934 (0.261107179025809) | > loss_disc_real_2: 0.24040067195892334 (0.3073422312736511) | > loss_disc_real_3: 0.29030874371528625 (0.29366925607124966) | > loss_disc_real_4: 0.2569460868835449 (0.22546250745654106) | > loss_disc_real_5: 0.2190801501274109 (0.23691683014233908) | > loss_0: 2.93583345413208 (2.952029307683309) | > loss_gen: 1.7420212030410767 (2.3425554831822715) | > loss_kl: 5.795938491821289 (4.854142586390178) | > loss_feat: 0.7797530293464661 (5.210613419612248) | > loss_mel: 15.290446281433105 (20.194488684336346) | > loss_duration: 3.2216949462890625 (3.1889480352401733) | > loss_1: 26.82985496520996 (35.790748596191406)  --> STEP: 3 | > loss_disc: 3.1258912086486816 (2.9768667221069336) | > loss_disc_real_0: 0.6163516044616699 (0.4330434501171112) | > loss_disc_real_1: 0.24538645148277283 (0.25886136080537525) | > loss_disc_real_2: 0.2543896734714508 (0.2997775801590511) | > loss_disc_real_3: 0.32964828610420227 (0.2988091175045286) | > loss_disc_real_4: 0.2161446064710617 (0.22413137874432973) | > loss_disc_real_5: 0.19236120581626892 (0.23055174095290049) | > loss_0: 3.1258912086486816 (2.9768667221069336) | > loss_gen: 1.9522395133972168 (2.2867960589272633) | > loss_kl: 2.5986011028289795 (4.531922374452863) | > loss_feat: 1.7223396301269531 (4.7122885925429205) | > loss_mel: 17.475805282592773 (19.80610534123012) | > loss_duration: 2.9785752296447754 (3.1588947772979736) | > loss_1: 26.72756004333496 (34.49600737435477) --> EVAL PERFORMANCE | > avg_loader_time: 0.5714436599186489 (+0.5429887998671759) | > avg_loss_disc: 2.9768667221069336 (+0.7497886419296265) | > avg_loss_disc_real_0: 0.4330434501171112 (+0.23600823928912482) | > avg_loss_disc_real_1: 0.25886136080537525 (+0.09092703248773304) | > avg_loss_disc_real_2: 0.2997775801590511 (+0.1522331862222581) | > avg_loss_disc_real_3: 0.2988091175045286 (+0.08844406548000519) | > avg_loss_disc_real_4: 0.22413137874432973 (+0.02412634413866771) | > avg_loss_disc_real_5: 0.23055174095290049 (-0.011678490610349729) | > avg_loss_0: 2.9768667221069336 (+0.7497886419296265) | > avg_loss_gen: 2.2867960589272633 (-0.14034608432224838) | > avg_loss_kl: 4.531922374452863 (+0.18432223229181144) | > avg_loss_feat: 4.7122885925429205 (-3.2081140137854076) | > avg_loss_mel: 19.80610534123012 (-2.6065988086518814) | > avg_loss_duration: 3.1588947772979736 (-0.030364990234375) | > avg_loss_1: 34.49600737435477 (-5.8011015937441925)  > EPOCH: 960/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:43:44)   --> TIME: 2023-10-20 11:44:07 -- STEP: 9/50 -- GLOBAL_STEP: 101010 | > loss_disc: 2.961888551712036 (2.617064674695333) | > loss_disc_real_0: 0.14045917987823486 (0.1550852432847023) | > loss_disc_real_1: 0.26853153109550476 (0.24707187712192535) | > loss_disc_real_2: 0.2701195478439331 (0.3233151055044598) | > loss_disc_real_3: 0.23982183635234833 (0.27601798209879136) | > loss_disc_real_4: 0.2614859938621521 (0.3069302671485477) | > loss_disc_real_5: 0.23250150680541992 (0.27633782227834064) | > loss_0: 2.961888551712036 (2.617064674695333) | > grad_norm_0: tensor(1056.7964, device='cuda:0') (tensor(633.5324, device='cuda:0')) | > loss_gen: 1.491804838180542 (2.439534134334988) | > loss_kl: 0.6055929660797119 (0.8572495910856459) | > loss_feat: 0.2106224149465561 (4.484129534827338) | > loss_mel: 10.771635055541992 (17.782551924387615) | > loss_duration: 1.3640060424804688 (1.3532091776529949) | > loss_1: 14.4436616897583 (26.91667408413357) | > grad_norm_1: tensor(7996.5586, device='cuda:0') (tensor(19824.1523, device='cuda:0')) | > current_lr_0: 7.657398223529944e-05 | > current_lr_1: 7.657398223529944e-05 | > step_time: 0.6976 (0.6125988165537516) | > loader_time: 0.0242 (0.01943548520406087)  --> TIME: 2023-10-20 11:44:32 -- STEP: 39/50 -- GLOBAL_STEP: 101040 | > loss_disc: 2.8242242336273193 (2.570097464781541) | > loss_disc_real_0: 0.09879298508167267 (0.1589453228009053) | > loss_disc_real_1: 0.2914890646934509 (0.24532422041281676) | > loss_disc_real_2: 0.21771439909934998 (0.2550363970490604) | > loss_disc_real_3: 0.26110854744911194 (0.2619317601888608) | > loss_disc_real_4: 0.21710757911205292 (0.2531990084128502) | > loss_disc_real_5: 0.22503463923931122 (0.24673809402455127) | > loss_0: 2.8242242336273193 (2.570097464781541) | > grad_norm_0: tensor(1132.5610, device='cuda:0') (tensor(662.8502, device='cuda:0')) | > loss_gen: 1.6638981103897095 (2.3155749638875327) | > loss_kl: 0.5473942756652832 (0.8337220541941814) | > loss_feat: 1.3828150033950806 (5.095330910804945) | > loss_mel: 12.746057510375977 (19.474809811665455) | > loss_duration: 1.4148681163787842 (1.3519374407254732) | > loss_1: 17.75503158569336 (29.0713748442821) | > grad_norm_1: tensor(17865.5312, device='cuda:0') (tensor(17767.1055, device='cuda:0')) | > current_lr_0: 7.657398223529944e-05 | > current_lr_1: 7.657398223529944e-05 | > step_time: 0.4543 (0.7394271691640218) | > loader_time: 0.0274 (0.024999147806412134)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.491184711456299 (2.491184711456299) | > loss_disc_real_0: 0.23832456767559052 (0.23832456767559052) | > loss_disc_real_1: 0.22999341785907745 (0.22999341785907745) | > loss_disc_real_2: 0.2528306543827057 (0.2528306543827057) | > loss_disc_real_3: 0.23792271316051483 (0.23792271316051483) | > loss_disc_real_4: 0.19536331295967102 (0.19536331295967102) | > loss_disc_real_5: 0.19279365241527557 (0.19279365241527557) | > loss_0: 2.491184711456299 (2.491184711456299) | > loss_gen: 2.0094709396362305 (2.0094709396362305) | > loss_kl: 4.811056137084961 (4.811056137084961) | > loss_feat: 2.3231260776519775 (2.3231260776519775) | > loss_mel: 23.287668228149414 (23.287668228149414) | > loss_duration: 3.050215244293213 (3.050215244293213) | > loss_1: 35.481536865234375 (35.481536865234375)  --> STEP: 1 | > loss_disc: 3.31422758102417 (3.31422758102417) | > loss_disc_real_0: 0.3148419260978699 (0.3148419260978699) | > loss_disc_real_1: 0.22370454668998718 (0.22370454668998718) | > loss_disc_real_2: 0.24055911600589752 (0.24055911600589752) | > loss_disc_real_3: 0.28292256593704224 (0.28292256593704224) | > loss_disc_real_4: 0.5425503849983215 (0.5425503849983215) | > loss_disc_real_5: 0.3866911232471466 (0.3866911232471466) | > loss_0: 3.31422758102417 (3.31422758102417) | > loss_gen: 2.3253586292266846 (2.3253586292266846) | > loss_kl: 4.92916202545166 (4.92916202545166) | > loss_feat: 7.149661540985107 (7.149661540985107) | > loss_mel: 25.1844539642334 (25.1844539642334) | > loss_duration: 3.3826634883880615 (3.3826634883880615) | > loss_1: 42.97129821777344 (42.97129821777344)  --> STEP: 2 | > loss_disc: 3.0412065982818604 (3.177717089653015) | > loss_disc_real_0: 0.43581706285476685 (0.37532949447631836) | > loss_disc_real_1: 0.2668650150299072 (0.2452847808599472) | > loss_disc_real_2: 0.29007089138031006 (0.2653150036931038) | > loss_disc_real_3: 0.2562789022922516 (0.2696007341146469) | > loss_disc_real_4: 0.22412589192390442 (0.383338138461113) | > loss_disc_real_5: 0.23559293150901794 (0.3111420273780823) | > loss_0: 3.0412065982818604 (3.177717089653015) | > loss_gen: 1.7388582229614258 (2.032108426094055) | > loss_kl: 5.462103843688965 (5.1956329345703125) | > loss_feat: 0.09915510565042496 (3.624408323317766) | > loss_mel: 1.9429508447647095 (13.563702404499054) | > loss_duration: 3.2503178119659424 (3.316490650177002) | > loss_1: 12.493385314941406 (27.732341766357422)  --> STEP: 3 | > loss_disc: 2.863804340362549 (3.073079506556193) | > loss_disc_real_0: 0.16213048994541168 (0.3042631596326828) | > loss_disc_real_1: 0.29142990708351135 (0.26066648960113525) | > loss_disc_real_2: 0.3081746995449066 (0.2796015689770381) | > loss_disc_real_3: 0.2995261251926422 (0.2795758644739787) | > loss_disc_real_4: 0.24408979713916779 (0.3369220246871312) | > loss_disc_real_5: 0.3263152837753296 (0.31619977951049805) | > loss_0: 2.863804340362549 (3.073079506556193) | > loss_gen: 2.0775516033172607 (2.0472561518351235) | > loss_kl: 2.4975860118865967 (4.296283960342407) | > loss_feat: 2.6103203296661377 (3.286378992100557) | > loss_mel: 22.28139877319336 (16.469601194063824) | > loss_duration: 3.0168254375457764 (3.2166022459665933) | > loss_1: 32.483680725097656 (29.316121419270832) --> EVAL PERFORMANCE | > avg_loader_time: 0.025226434071858723 (-0.5462172258467901) | > avg_loss_disc: 3.073079506556193 (+0.09621278444925929) | > avg_loss_disc_real_0: 0.3042631596326828 (-0.1287802904844284) | > avg_loss_disc_real_1: 0.26066648960113525 (+0.0018051287957600026) | > avg_loss_disc_real_2: 0.2796015689770381 (-0.02017601118201301) | > avg_loss_disc_real_3: 0.2795758644739787 (-0.0192332530305499) | > avg_loss_disc_real_4: 0.3369220246871312 (+0.1127906459428015) | > avg_loss_disc_real_5: 0.31619977951049805 (+0.08564803855759756) | > avg_loss_0: 3.073079506556193 (+0.09621278444925929) | > avg_loss_gen: 2.0472561518351235 (-0.2395399070921398) | > avg_loss_kl: 4.296283960342407 (-0.23563841411045594) | > avg_loss_feat: 3.286378992100557 (-1.4259096004423637) | > avg_loss_mel: 16.469601194063824 (-3.336504147166295) | > avg_loss_duration: 3.2166022459665933 (+0.057707468668619644) | > avg_loss_1: 29.316121419270832 (-5.179885955083936)  > EPOCH: 961/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:44:56)   --> TIME: 2023-10-20 11:45:20 -- STEP: 19/50 -- GLOBAL_STEP: 101070 | > loss_disc: 1.1842896938323975 (2.3026739296160246) | > loss_disc_real_0: 0.0385451465845108 (0.1270388283423687) | > loss_disc_real_1: 0.12965244054794312 (0.19803831706705846) | > loss_disc_real_2: 0.0955444723367691 (0.21868817831732726) | > loss_disc_real_3: 0.11888670921325684 (0.2115288874820659) | > loss_disc_real_4: 0.08035677671432495 (0.2088739748455976) | > loss_disc_real_5: 0.0846821516752243 (0.20371693323709464) | > loss_0: 1.1842896938323975 (2.3026739296160246) | > grad_norm_0: tensor(195.6487, device='cuda:0') (tensor(718.1720, device='cuda:0')) | > loss_gen: 3.336301803588867 (2.4485338926315308) | > loss_kl: 0.5730844140052795 (0.7849020816777882) | > loss_feat: 10.808432579040527 (6.913738539736522) | > loss_mel: 25.449968338012695 (21.26663105111373) | > loss_duration: 1.4814260005950928 (1.3867055867847644) | > loss_1: 41.64921188354492 (32.8005112095883) | > grad_norm_1: tensor(10821.4668, device='cuda:0') (tensor(23156.3047, device='cuda:0')) | > current_lr_0: 7.649744174580736e-05 | > current_lr_1: 7.649744174580736e-05 | > step_time: 0.8865 (0.8543630901135897) | > loader_time: 0.0433 (0.03380388962595087)  --> TIME: 2023-10-20 11:45:33 -- STEP: 49/50 -- GLOBAL_STEP: 101100 | > loss_disc: 2.492173433303833 (2.4692940663318255) | > loss_disc_real_0: 0.19802916049957275 (0.14326598208245575) | > loss_disc_real_1: 0.20973296463489532 (0.22506450549984464) | > loss_disc_real_2: 0.171744704246521 (0.2295377041232221) | > loss_disc_real_3: 0.1601250171661377 (0.22892441843845407) | > loss_disc_real_4: 0.18403802812099457 (0.22074908135952998) | > loss_disc_real_5: 0.22832125425338745 (0.23800212376732) | > loss_0: 2.492173433303833 (2.4692940663318255) | > grad_norm_0: tensor(743.7623, device='cuda:0') (tensor(712.5221, device='cuda:0')) | > loss_gen: 1.9698928594589233 (2.282363100927703) | > loss_kl: 0.5998511910438538 (0.7450214232109031) | > loss_feat: 4.307105541229248 (5.34191186072267) | > loss_mel: 20.926753997802734 (20.222159300531665) | > loss_duration: 1.5326989889144897 (1.3505020530856386) | > loss_1: 29.336301803588867 (29.94195796032341) | > grad_norm_1: tensor(4585.4673, device='cuda:0') (tensor(15907.7334, device='cuda:0')) | > current_lr_0: 7.649744174580736e-05 | > current_lr_1: 7.649744174580736e-05 | > step_time: 0.5685 (0.5866901533944267) | > loader_time: 0.3881 (0.02642770689360949)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5545263290405273 (2.5545263290405273) | > loss_disc_real_0: 0.10442598164081573 (0.10442598164081573) | > loss_disc_real_1: 0.2279360294342041 (0.2279360294342041) | > loss_disc_real_2: 0.30883386731147766 (0.30883386731147766) | > loss_disc_real_3: 0.28085896372795105 (0.28085896372795105) | > loss_disc_real_4: 0.2146584689617157 (0.2146584689617157) | > loss_disc_real_5: 0.2786482870578766 (0.2786482870578766) | > loss_0: 2.5545263290405273 (2.5545263290405273) | > loss_gen: 2.3458380699157715 (2.3458380699157715) | > loss_kl: 5.2860283851623535 (5.2860283851623535) | > loss_feat: 6.584761142730713 (6.584761142730713) | > loss_mel: 21.12790870666504 (21.12790870666504) | > loss_duration: 3.053086042404175 (3.053086042404175) | > loss_1: 38.397621154785156 (38.397621154785156)  --> STEP: 1 | > loss_disc: 1.5867440700531006 (1.5867440700531006) | > loss_disc_real_0: 0.04789801687002182 (0.04789801687002182) | > loss_disc_real_1: 0.1419365406036377 (0.1419365406036377) | > loss_disc_real_2: 0.0740138441324234 (0.0740138441324234) | > loss_disc_real_3: 0.1134955883026123 (0.1134955883026123) | > loss_disc_real_4: 0.1657629907131195 (0.1657629907131195) | > loss_disc_real_5: 0.0462455227971077 (0.0462455227971077) | > loss_0: 1.5867440700531006 (1.5867440700531006) | > loss_gen: 2.4542672634124756 (2.4542672634124756) | > loss_kl: 5.175517559051514 (5.175517559051514) | > loss_feat: 12.171407699584961 (12.171407699584961) | > loss_mel: 24.915315628051758 (24.915315628051758) | > loss_duration: 3.453345537185669 (3.453345537185669) | > loss_1: 48.16985321044922 (48.16985321044922)  --> STEP: 2 | > loss_disc: 2.870197057723999 (2.22847056388855) | > loss_disc_real_0: 0.3724856376647949 (0.21019182726740837) | > loss_disc_real_1: 0.28314781188964844 (0.21254217624664307) | > loss_disc_real_2: 0.2471885085105896 (0.1606011763215065) | > loss_disc_real_3: 0.41965699195861816 (0.26657629013061523) | > loss_disc_real_4: 0.14148135483264923 (0.15362217277288437) | > loss_disc_real_5: 0.28586050868034363 (0.16605301573872566) | > loss_0: 2.870197057723999 (2.22847056388855) | > loss_gen: 2.405700922012329 (2.4299840927124023) | > loss_kl: 5.835100173950195 (5.5053088665008545) | > loss_feat: 9.932110786437988 (11.051759243011475) | > loss_mel: 25.491132736206055 (25.203224182128906) | > loss_duration: 3.267874240875244 (3.3606098890304565) | > loss_1: 46.93191909790039 (47.550886154174805)  --> STEP: 3 | > loss_disc: 2.976680278778076 (2.4778738021850586) | > loss_disc_real_0: 0.2638881206512451 (0.2280905917286873) | > loss_disc_real_1: 0.22873611748218536 (0.2179401566584905) | > loss_disc_real_2: 0.21804584562778473 (0.17974939942359924) | > loss_disc_real_3: 0.15253056585788727 (0.2285610487063726) | > loss_disc_real_4: 0.17848211526870728 (0.161908820271492) | > loss_disc_real_5: 0.1537332981824875 (0.1619464432199796) | > loss_0: 2.976680278778076 (2.4778738021850586) | > loss_gen: 1.6403242349624634 (2.1667641401290894) | > loss_kl: 2.8221065998077393 (4.6109081109364825) | > loss_feat: 3.8707470893859863 (8.658088525136312) | > loss_mel: 12.557098388671875 (20.98784891764323) | > loss_duration: 3.048546075820923 (3.256588617960612) | > loss_1: 23.93882179260254 (39.68019803365072) --> EVAL PERFORMANCE | > avg_loader_time: 0.0036787192026774087 (-0.021547714869181313) | > avg_loss_disc: 2.4778738021850586 (-0.5952057043711343) | > avg_loss_disc_real_0: 0.2280905917286873 (-0.07617256790399551) | > avg_loss_disc_real_1: 0.2179401566584905 (-0.042726332942644746) | > avg_loss_disc_real_2: 0.17974939942359924 (-0.09985216955343884) | > avg_loss_disc_real_3: 0.2285610487063726 (-0.05101481576760611) | > avg_loss_disc_real_4: 0.161908820271492 (-0.17501320441563922) | > avg_loss_disc_real_5: 0.1619464432199796 (-0.15425333629051843) | > avg_loss_0: 2.4778738021850586 (-0.5952057043711343) | > avg_loss_gen: 2.1667641401290894 (+0.1195079882939658) | > avg_loss_kl: 4.6109081109364825 (+0.3146241505940752) | > avg_loss_feat: 8.658088525136312 (+5.371709533035755) | > avg_loss_mel: 20.98784891764323 (+4.518247723579407) | > avg_loss_duration: 3.256588617960612 (+0.039986371994018555) | > avg_loss_1: 39.68019803365072 (+10.364076614379886)  > EPOCH: 962/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:45:51)   --> TIME: 2023-10-20 11:46:12 -- STEP: 29/50 -- GLOBAL_STEP: 101130 | > loss_disc: 2.640852928161621 (2.4125791479801313) | > loss_disc_real_0: 0.01881233975291252 (0.1393219562054708) | > loss_disc_real_1: 0.21922197937965393 (0.2235930109846181) | > loss_disc_real_2: 0.3067433536052704 (0.21517926692191897) | > loss_disc_real_3: 0.18318304419517517 (0.23654887992246398) | > loss_disc_real_4: 0.3815978467464447 (0.22686864737549733) | > loss_disc_real_5: 0.2639337182044983 (0.22732528549586906) | > loss_0: 2.640852928161621 (2.4125791479801313) | > grad_norm_0: tensor(513.5371, device='cuda:0') (tensor(946.0557, device='cuda:0')) | > loss_gen: 2.261672019958496 (2.3415622587861695) | > loss_kl: 0.6975855231285095 (0.8328041642390448) | > loss_feat: 6.786444187164307 (5.603034587769673) | > loss_mel: 22.187244415283203 (20.105764804215262) | > loss_duration: 1.293322205543518 (1.3656188496227921) | > loss_1: 33.22626876831055 (30.248784690067687) | > grad_norm_1: tensor(7894.5771, device='cuda:0') (tensor(38356.8828, device='cuda:0')) | > current_lr_0: 7.642097776332669e-05 | > current_lr_1: 7.642097776332669e-05 | > step_time: 0.2634 (0.5267793638952848) | > loader_time: 0.0017 (0.02181804591211779)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.058022975921631 (3.058022975921631) | > loss_disc_real_0: 0.4844273030757904 (0.4844273030757904) | > loss_disc_real_1: 0.39866459369659424 (0.39866459369659424) | > loss_disc_real_2: 0.28231313824653625 (0.28231313824653625) | > loss_disc_real_3: 0.32192462682724 (0.32192462682724) | > loss_disc_real_4: 0.2833804488182068 (0.2833804488182068) | > loss_disc_real_5: 0.3593817949295044 (0.3593817949295044) | > loss_0: 3.058022975921631 (3.058022975921631) | > loss_gen: 2.689480781555176 (2.689480781555176) | > loss_kl: 4.578234672546387 (4.578234672546387) | > loss_feat: 4.334347248077393 (4.334347248077393) | > loss_mel: 23.589170455932617 (23.589170455932617) | > loss_duration: 3.070897102355957 (3.070897102355957) | > loss_1: 38.26213073730469 (38.26213073730469)  --> STEP: 1 | > loss_disc: 2.334500789642334 (2.334500789642334) | > loss_disc_real_0: 0.22326140105724335 (0.22326140105724335) | > loss_disc_real_1: 0.2591155767440796 (0.2591155767440796) | > loss_disc_real_2: 0.21634149551391602 (0.21634149551391602) | > loss_disc_real_3: 0.24471062421798706 (0.24471062421798706) | > loss_disc_real_4: 0.20742519199848175 (0.20742519199848175) | > loss_disc_real_5: 0.16911016404628754 (0.16911016404628754) | > loss_0: 2.334500789642334 (2.334500789642334) | > loss_gen: 2.424922227859497 (2.424922227859497) | > loss_kl: 4.997089862823486 (4.997089862823486) | > loss_feat: 3.683225631713867 (3.683225631713867) | > loss_mel: 13.995615005493164 (13.995615005493164) | > loss_duration: 3.3371589183807373 (3.3371589183807373) | > loss_1: 28.438011169433594 (28.438011169433594)  --> STEP: 2 | > loss_disc: 3.038689613342285 (2.6865952014923096) | > loss_disc_real_0: 0.35266566276550293 (0.28796353191137314) | > loss_disc_real_1: 0.27365487813949585 (0.2663852274417877) | > loss_disc_real_2: 0.2705359160900116 (0.2434387058019638) | > loss_disc_real_3: 0.2728484570980072 (0.25877954065799713) | > loss_disc_real_4: 0.2910284996032715 (0.24922684580087662) | > loss_disc_real_5: 0.2500879168510437 (0.20959904044866562) | > loss_0: 3.038689613342285 (2.6865952014923096) | > loss_gen: 1.6944468021392822 (2.0596845149993896) | > loss_kl: 5.583481788635254 (5.29028582572937) | > loss_feat: 0.06867333501577377 (1.8759494833648205) | > loss_mel: 2.4259560108184814 (8.210785508155823) | > loss_duration: 3.26965594291687 (3.3034074306488037) | > loss_1: 13.042213439941406 (20.7401123046875)  --> STEP: 3 | > loss_disc: 2.8795812129974365 (2.7509238719940186) | > loss_disc_real_0: 0.3395637273788452 (0.30516359706719715) | > loss_disc_real_1: 0.291289359331131 (0.2746866047382355) | > loss_disc_real_2: 0.2990145981311798 (0.2619640032450358) | > loss_disc_real_3: 0.2670890986919403 (0.2615493933359782) | > loss_disc_real_4: 0.27932292222976685 (0.25925887127717334) | > loss_disc_real_5: 0.26570841670036316 (0.22830216586589813) | > loss_0: 2.8795812129974365 (2.7509238719940186) | > loss_gen: 2.014127492904663 (2.044498840967814) | > loss_kl: 2.561000108718872 (4.380523920059204) | > loss_feat: 1.0412580966949463 (1.597719021141529) | > loss_mel: 13.824913024902344 (10.08216134707133) | > loss_duration: 3.0295281410217285 (3.2121143341064453) | > loss_1: 22.470827102661133 (21.31701723734538) --> EVAL PERFORMANCE | > avg_loader_time: 0.008245070775349935 (+0.004566351572672527) | > avg_loss_disc: 2.7509238719940186 (+0.27305006980895996) | > avg_loss_disc_real_0: 0.30516359706719715 (+0.07707300533850986) | > avg_loss_disc_real_1: 0.2746866047382355 (+0.056746448079744966) | > avg_loss_disc_real_2: 0.2619640032450358 (+0.08221460382143658) | > avg_loss_disc_real_3: 0.2615493933359782 (+0.03298834462960562) | > avg_loss_disc_real_4: 0.25925887127717334 (+0.09735005100568134) | > avg_loss_disc_real_5: 0.22830216586589813 (+0.06635572264591852) | > avg_loss_0: 2.7509238719940186 (+0.27305006980895996) | > avg_loss_gen: 2.044498840967814 (-0.12226529916127538) | > avg_loss_kl: 4.380523920059204 (-0.23038419087727835) | > avg_loss_feat: 1.597719021141529 (-7.060369503994783) | > avg_loss_mel: 10.08216134707133 (-10.905687570571901) | > avg_loss_duration: 3.2121143341064453 (-0.04447428385416652) | > avg_loss_1: 21.31701723734538 (-18.36318079630534)  > EPOCH: 963/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:46:41)   --> TIME: 2023-10-20 11:46:53 -- STEP: 9/50 -- GLOBAL_STEP: 101160 | > loss_disc: 2.7455146312713623 (2.492427666982015) | > loss_disc_real_0: 0.3190710246562958 (0.18281952509035668) | > loss_disc_real_1: 0.32586681842803955 (0.2512622152765592) | > loss_disc_real_2: 0.36056962609291077 (0.27877985106574166) | > loss_disc_real_3: 0.3690010905265808 (0.26569504621956086) | > loss_disc_real_4: 0.3323800265789032 (0.2467338666319847) | > loss_disc_real_5: 0.3353572487831116 (0.20676817331049177) | > loss_0: 2.7455146312713623 (2.492427666982015) | > grad_norm_0: tensor(778.6871, device='cuda:0') (tensor(1175.2380, device='cuda:0')) | > loss_gen: 2.774073362350464 (2.448417478137546) | > loss_kl: 1.0069944858551025 (0.8653094345677851) | > loss_feat: 4.460785865783691 (6.0596717355979814) | > loss_mel: 21.845218658447266 (20.042645666334366) | > loss_duration: 1.3151326179504395 (1.3516888353559706) | > loss_1: 31.402204513549805 (30.767733361985947) | > grad_norm_1: tensor(28169.6992, device='cuda:0') (tensor(36931.2344, device='cuda:0')) | > current_lr_0: 7.634459021138386e-05 | > current_lr_1: 7.634459021138386e-05 | > step_time: 0.83 (0.6622876591152616) | > loader_time: 0.0256 (0.022973961300320096)  --> TIME: 2023-10-20 11:47:08 -- STEP: 39/50 -- GLOBAL_STEP: 101190 | > loss_disc: 2.9985244274139404 (2.4900171603911962) | > loss_disc_real_0: 0.17228516936302185 (0.1652757432311773) | > loss_disc_real_1: 0.28239133954048157 (0.22980637065111062) | > loss_disc_real_2: 0.2673538625240326 (0.2367384026830013) | > loss_disc_real_3: 0.26644831895828247 (0.24181289001344106) | > loss_disc_real_4: 0.2450978308916092 (0.22705597523599863) | > loss_disc_real_5: 0.2589327096939087 (0.22430685779843956) | > loss_0: 2.9985244274139404 (2.4900171603911962) | > grad_norm_0: tensor(922.6964, device='cuda:0') (tensor(1503.9836, device='cuda:0')) | > loss_gen: 1.5413503646850586 (2.2805588153692384) | > loss_kl: 0.7341915965080261 (0.8292203360111811) | > loss_feat: 0.040957387536764145 (4.791182621835898) | > loss_mel: 1.027596116065979 (18.510906898058376) | > loss_duration: 1.3938544988632202 (1.351767090650705) | > loss_1: 4.737949848175049 (27.763635928814228) | > grad_norm_1: tensor(127441.5781, device='cuda:0') (tensor(40983.5117, device='cuda:0')) | > current_lr_0: 7.634459021138386e-05 | > current_lr_1: 7.634459021138386e-05 | > step_time: 0.3322 (0.5306039467836036) | > loader_time: 0.0027 (0.0178531316610483)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.091752529144287 (3.091752529144287) | > loss_disc_real_0: 0.48219233751296997 (0.48219233751296997) | > loss_disc_real_1: 0.27734285593032837 (0.27734285593032837) | > loss_disc_real_2: 0.3274359703063965 (0.3274359703063965) | > loss_disc_real_3: 0.25005558133125305 (0.25005558133125305) | > loss_disc_real_4: 0.27638986706733704 (0.27638986706733704) | > loss_disc_real_5: 0.2972330152988434 (0.2972330152988434) | > loss_0: 3.091752529144287 (3.091752529144287) | > loss_gen: 1.9176361560821533 (1.9176361560821533) | > loss_kl: 5.140231609344482 (5.140231609344482) | > loss_feat: 0.12020548433065414 (0.12020548433065414) | > loss_mel: 1.8816075325012207 (1.8816075325012207) | > loss_duration: 3.075500965118408 (3.075500965118408) | > loss_1: 12.135181427001953 (12.135181427001953)  --> STEP: 1 | > loss_disc: 2.2907462120056152 (2.2907462120056152) | > loss_disc_real_0: 0.1955530047416687 (0.1955530047416687) | > loss_disc_real_1: 0.14892041683197021 (0.14892041683197021) | > loss_disc_real_2: 0.20363450050354004 (0.20363450050354004) | > loss_disc_real_3: 0.20231600105762482 (0.20231600105762482) | > loss_disc_real_4: 0.2409645915031433 (0.2409645915031433) | > loss_disc_real_5: 0.20338307321071625 (0.20338307321071625) | > loss_0: 2.2907462120056152 (2.2907462120056152) | > loss_gen: 2.113473415374756 (2.113473415374756) | > loss_kl: 5.684875011444092 (5.684875011444092) | > loss_feat: 4.485547065734863 (4.485547065734863) | > loss_mel: 23.24728012084961 (23.24728012084961) | > loss_duration: 3.3572075366973877 (3.3572075366973877) | > loss_1: 38.88838195800781 (38.88838195800781)  --> STEP: 2 | > loss_disc: 3.302811622619629 (2.796778917312622) | > loss_disc_real_0: 0.18540632724761963 (0.19047966599464417) | > loss_disc_real_1: 0.16295725107192993 (0.15593883395195007) | > loss_disc_real_2: 0.37104806303977966 (0.28734128177165985) | > loss_disc_real_3: 0.14670993387699127 (0.17451296746730804) | > loss_disc_real_4: 0.200376495718956 (0.22067054361104965) | > loss_disc_real_5: 0.18836908042430878 (0.1958760768175125) | > loss_0: 3.302811622619629 (2.796778917312622) | > loss_gen: 1.3468146324157715 (1.7301440238952637) | > loss_kl: 5.719947338104248 (5.70241117477417) | > loss_feat: 7.052186965942383 (5.768867015838623) | > loss_mel: 21.28710174560547 (22.26719093322754) | > loss_duration: 3.1172194480895996 (3.2372134923934937) | > loss_1: 38.52326583862305 (38.70582389831543)  --> STEP: 3 | > loss_disc: 2.9639503955841064 (2.8525027434031167) | > loss_disc_real_0: 0.3347035050392151 (0.23855427900950113) | > loss_disc_real_1: 0.23522351682186127 (0.1823670615752538) | > loss_disc_real_2: 0.3687836229801178 (0.3144887288411458) | > loss_disc_real_3: 0.28001394867897034 (0.2096799612045288) | > loss_disc_real_4: 0.46508052945137024 (0.3021405388911565) | > loss_disc_real_5: 0.3532496690750122 (0.24833394090334573) | > loss_0: 2.9639503955841064 (2.8525027434031167) | > loss_gen: 2.6128196716308594 (2.024369239807129) | > loss_kl: 3.000919818878174 (4.801914056142171) | > loss_feat: 5.083043575286865 (5.54025920232137) | > loss_mel: 19.39133071899414 (21.308570861816406) | > loss_duration: 3.0984671115875244 (3.190964698791504) | > loss_1: 33.186580657958984 (36.866076151529946) --> EVAL PERFORMANCE | > avg_loader_time: 0.018621365229288738 (+0.010376294453938803) | > avg_loss_disc: 2.8525027434031167 (+0.10157887140909816) | > avg_loss_disc_real_0: 0.23855427900950113 (-0.06660931805769602) | > avg_loss_disc_real_1: 0.1823670615752538 (-0.09231954316298166) | > avg_loss_disc_real_2: 0.3144887288411458 (+0.05252472559610999) | > avg_loss_disc_real_3: 0.2096799612045288 (-0.0518694321314494) | > avg_loss_disc_real_4: 0.3021405388911565 (+0.042881667613983154) | > avg_loss_disc_real_5: 0.24833394090334573 (+0.020031775037447602) | > avg_loss_0: 2.8525027434031167 (+0.10157887140909816) | > avg_loss_gen: 2.024369239807129 (-0.020129601160685073) | > avg_loss_kl: 4.801914056142171 (+0.4213901360829668) | > avg_loss_feat: 5.54025920232137 (+3.942540181179841) | > avg_loss_mel: 21.308570861816406 (+11.226409514745077) | > avg_loss_duration: 3.190964698791504 (-0.021149635314941406) | > avg_loss_1: 36.866076151529946 (+15.549058914184567)  > EPOCH: 964/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:47:34)   --> TIME: 2023-10-20 11:47:47 -- STEP: 19/50 -- GLOBAL_STEP: 101220 | > loss_disc: 2.3755555152893066 (2.4434262984677364) | > loss_disc_real_0: 0.27487874031066895 (0.18765556282903018) | > loss_disc_real_1: 0.21462373435497284 (0.2239809664652536) | > loss_disc_real_2: 0.24157366156578064 (0.25577854737639427) | > loss_disc_real_3: 0.3400028944015503 (0.23385720317693134) | > loss_disc_real_4: 0.41074928641319275 (0.24451122491767532) | > loss_disc_real_5: 0.261722207069397 (0.2526679655635043) | > loss_0: 2.3755555152893066 (2.4434262984677364) | > grad_norm_0: tensor(1139.8386, device='cuda:0') (tensor(1698.3109, device='cuda:0')) | > loss_gen: 3.1664562225341797 (2.4174384694350395) | > loss_kl: 0.4925128221511841 (0.7923041237028021) | > loss_feat: 7.479071617126465 (6.020441253228407) | > loss_mel: 23.46835708618164 (18.791515381712664) | > loss_duration: 1.4338406324386597 (1.4047926413385492) | > loss_1: 36.04024124145508 (29.426492088719417) | > grad_norm_1: tensor(41585.3359, device='cuda:0') (tensor(34845.1133, device='cuda:0')) | > current_lr_0: 7.626827901358179e-05 | > current_lr_1: 7.626827901358179e-05 | > step_time: 0.3302 (0.4177369443993819) | > loader_time: 0.0073 (0.01440689438267758)  --> TIME: 2023-10-20 11:47:59 -- STEP: 49/50 -- GLOBAL_STEP: 101250 | > loss_disc: 2.48956036567688 (2.4818454774058596) | > loss_disc_real_0: 0.27582627534866333 (0.17008420475283448) | > loss_disc_real_1: 0.20583485066890717 (0.22013608202794377) | > loss_disc_real_2: 0.12971770763397217 (0.2338351486440824) | > loss_disc_real_3: 0.30118221044540405 (0.23368999639487997) | > loss_disc_real_4: 0.13129225373268127 (0.2320929912432116) | > loss_disc_real_5: 0.1641610860824585 (0.24373597549084497) | > loss_0: 2.48956036567688 (2.4818454774058596) | > grad_norm_0: tensor(2610.2251, device='cuda:0') (tensor(1355.6746, device='cuda:0')) | > loss_gen: 2.2015810012817383 (2.2504687333593556) | > loss_kl: 0.9994680285453796 (0.762809043560101) | > loss_feat: 6.016725063323975 (5.105311233740376) | > loss_mel: 24.436967849731445 (18.228564284285717) | > loss_duration: 1.4818882942199707 (1.363609883250022) | > loss_1: 35.13663101196289 (27.710763376586293) | > grad_norm_1: tensor(93888.3516, device='cuda:0') (tensor(35087.0664, device='cuda:0')) | > current_lr_0: 7.626827901358179e-05 | > current_lr_1: 7.626827901358179e-05 | > step_time: 0.4142 (0.38817376506571866) | > loader_time: 0.5327 (0.019877156432794064)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6628236770629883 (1.6628236770629883) | > loss_disc_real_0: 0.025072269141674042 (0.025072269141674042) | > loss_disc_real_1: 0.072953000664711 (0.072953000664711) | > loss_disc_real_2: 0.10189580172300339 (0.10189580172300339) | > loss_disc_real_3: 0.17689268290996552 (0.17689268290996552) | > loss_disc_real_4: 0.042861904948949814 (0.042861904948949814) | > loss_disc_real_5: 0.0384494848549366 (0.0384494848549366) | > loss_0: 1.6628236770629883 (1.6628236770629883) | > loss_gen: 2.2007510662078857 (2.2007510662078857) | > loss_kl: 5.580354690551758 (5.580354690551758) | > loss_feat: 11.138931274414062 (11.138931274414062) | > loss_mel: 25.64469337463379 (25.64469337463379) | > loss_duration: 3.1047821044921875 (3.1047821044921875) | > loss_1: 47.66951370239258 (47.66951370239258)  --> STEP: 1 | > loss_disc: 1.2348991632461548 (1.2348991632461548) | > loss_disc_real_0: 0.03582743555307388 (0.03582743555307388) | > loss_disc_real_1: 0.13498744368553162 (0.13498744368553162) | > loss_disc_real_2: 0.07677287608385086 (0.07677287608385086) | > loss_disc_real_3: 0.059585027396678925 (0.059585027396678925) | > loss_disc_real_4: 0.02922019362449646 (0.02922019362449646) | > loss_disc_real_5: 0.03426818922162056 (0.03426818922162056) | > loss_0: 1.2348991632461548 (1.2348991632461548) | > loss_gen: 2.656198024749756 (2.656198024749756) | > loss_kl: 5.264092445373535 (5.264092445373535) | > loss_feat: 12.865652084350586 (12.865652084350586) | > loss_mel: 24.980361938476562 (24.980361938476562) | > loss_duration: 3.3441805839538574 (3.3441805839538574) | > loss_1: 49.1104850769043 (49.1104850769043)  --> STEP: 2 | > loss_disc: 2.6229097843170166 (1.9289044737815857) | > loss_disc_real_0: 0.13797630369663239 (0.08690186962485313) | > loss_disc_real_1: 0.27630850672721863 (0.20564797520637512) | > loss_disc_real_2: 0.1947798728942871 (0.13577637448906898) | > loss_disc_real_3: 0.17417067289352417 (0.11687785014510155) | > loss_disc_real_4: 0.18045391142368317 (0.10483705252408981) | > loss_disc_real_5: 0.17145662009716034 (0.10286240465939045) | > loss_0: 2.6229097843170166 (1.9289044737815857) | > loss_gen: 2.1939401626586914 (2.4250690937042236) | > loss_kl: 5.428007125854492 (5.346049785614014) | > loss_feat: 9.980389595031738 (11.423020839691162) | > loss_mel: 25.81882667541504 (25.3995943069458) | > loss_duration: 3.241215944290161 (3.2926982641220093) | > loss_1: 46.662376403808594 (47.886430740356445)  --> STEP: 3 | > loss_disc: 2.303450345993042 (2.0537530978520713) | > loss_disc_real_0: 0.2170003354549408 (0.130268024901549) | > loss_disc_real_1: 0.23726649582386017 (0.21618748207887015) | > loss_disc_real_2: 0.22777606546878815 (0.16644293814897537) | > loss_disc_real_3: 0.13990236818790436 (0.12455268949270248) | > loss_disc_real_4: 0.16618308424949646 (0.12528572976589203) | > loss_disc_real_5: 0.1075250431895256 (0.10441661750276883) | > loss_0: 2.303450345993042 (2.0537530978520713) | > loss_gen: 2.279545545578003 (2.376561244328817) | > loss_kl: 2.57656192779541 (4.4228871663411455) | > loss_feat: 4.231346130371094 (9.025795936584473) | > loss_mel: 19.536666870117188 (23.445285161336262) | > loss_duration: 3.068028688430786 (3.217808405558268) | > loss_1: 31.692148208618164 (42.48833656311035) --> EVAL PERFORMANCE | > avg_loader_time: 0.010571002960205078 (-0.00805036226908366) | > avg_loss_disc: 2.0537530978520713 (-0.7987496455510454) | > avg_loss_disc_real_0: 0.130268024901549 (-0.10828625410795212) | > avg_loss_disc_real_1: 0.21618748207887015 (+0.03382042050361633) | > avg_loss_disc_real_2: 0.16644293814897537 (-0.14804579069217044) | > avg_loss_disc_real_3: 0.12455268949270248 (-0.08512727171182632) | > avg_loss_disc_real_4: 0.12528572976589203 (-0.17685480912526447) | > avg_loss_disc_real_5: 0.10441661750276883 (-0.1439173234005769) | > avg_loss_0: 2.0537530978520713 (-0.7987496455510454) | > avg_loss_gen: 2.376561244328817 (+0.352192004521688) | > avg_loss_kl: 4.4228871663411455 (-0.3790268898010254) | > avg_loss_feat: 9.025795936584473 (+3.4855367342631025) | > avg_loss_mel: 23.445285161336262 (+2.1367142995198556) | > avg_loss_duration: 3.217808405558268 (+0.026843706766764175) | > avg_loss_1: 42.48833656311035 (+5.622260411580406)  > EPOCH: 965/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:48:26)   --> TIME: 2023-10-20 11:49:04 -- STEP: 29/50 -- GLOBAL_STEP: 101280 | > loss_disc: 2.7006235122680664 (2.3025834231541076) | > loss_disc_real_0: 0.10812234878540039 (0.1151985836311661) | > loss_disc_real_1: 0.19955897331237793 (0.21077004910029215) | > loss_disc_real_2: 0.21117158234119415 (0.21561644226312637) | > loss_disc_real_3: 0.24055863916873932 (0.228562630263382) | > loss_disc_real_4: 0.23174986243247986 (0.2184010471763282) | > loss_disc_real_5: 0.2520173192024231 (0.22151324702105646) | > loss_0: 2.7006235122680664 (2.3025834231541076) | > grad_norm_0: tensor(2226.5471, device='cuda:0') (tensor(1142.0962, device='cuda:0')) | > loss_gen: 1.8017098903656006 (2.4671441563244523) | > loss_kl: 0.8833894729614258 (0.8796044114077913) | > loss_feat: 1.490722894668579 (6.632628918721758) | > loss_mel: 16.520105361938477 (21.3832877915481) | > loss_duration: 1.3991438150405884 (1.3691414676863571) | > loss_1: 22.09507179260254 (32.731807182575096) | > grad_norm_1: tensor(12598.8760, device='cuda:0') (tensor(43149.1523, device='cuda:0')) | > current_lr_0: 7.619204409359971e-05 | > current_lr_1: 7.619204409359971e-05 | > step_time: 0.9298 (0.6824007527581577) | > loader_time: 0.0434 (0.024498125602459085)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7420365810394287 (2.7420365810394287) | > loss_disc_real_0: 0.31499332189559937 (0.31499332189559937) | > loss_disc_real_1: 0.2320667952299118 (0.2320667952299118) | > loss_disc_real_2: 0.20894238352775574 (0.20894238352775574) | > loss_disc_real_3: 0.2769540250301361 (0.2769540250301361) | > loss_disc_real_4: 0.15231575071811676 (0.15231575071811676) | > loss_disc_real_5: 0.23646625876426697 (0.23646625876426697) | > loss_0: 2.7420365810394287 (2.7420365810394287) | > loss_gen: 1.9427801370620728 (1.9427801370620728) | > loss_kl: 6.204526424407959 (6.204526424407959) | > loss_feat: 2.380390167236328 (2.380390167236328) | > loss_mel: 14.309906005859375 (14.309906005859375) | > loss_duration: 3.1864683628082275 (3.1864683628082275) | > loss_1: 28.024070739746094 (28.024070739746094)  --> STEP: 1 | > loss_disc: 3.1007893085479736 (3.1007893085479736) | > loss_disc_real_0: 0.2724655568599701 (0.2724655568599701) | > loss_disc_real_1: 0.3587930202484131 (0.3587930202484131) | > loss_disc_real_2: 0.26957783102989197 (0.26957783102989197) | > loss_disc_real_3: 0.3024824559688568 (0.3024824559688568) | > loss_disc_real_4: 0.22867363691329956 (0.22867363691329956) | > loss_disc_real_5: 0.296669065952301 (0.296669065952301) | > loss_0: 3.1007893085479736 (3.1007893085479736) | > loss_gen: 2.0342025756835938 (2.0342025756835938) | > loss_kl: 5.133677959442139 (5.133677959442139) | > loss_feat: 6.545092582702637 (6.545092582702637) | > loss_mel: 25.079418182373047 (25.079418182373047) | > loss_duration: 3.376533031463623 (3.376533031463623) | > loss_1: 42.168922424316406 (42.168922424316406)  --> STEP: 2 | > loss_disc: 2.969372034072876 (3.035080671310425) | > loss_disc_real_0: 0.3212568163871765 (0.2968611866235733) | > loss_disc_real_1: 0.2772013247013092 (0.31799717247486115) | > loss_disc_real_2: 0.1958419233560562 (0.2327098771929741) | > loss_disc_real_3: 0.2690298557281494 (0.2857561558485031) | > loss_disc_real_4: 0.21778519451618195 (0.22322941571474075) | > loss_disc_real_5: 0.217682346701622 (0.2571757063269615) | > loss_0: 2.969372034072876 (3.035080671310425) | > loss_gen: 1.5603828430175781 (1.797292709350586) | > loss_kl: 5.394448280334473 (5.264063119888306) | > loss_feat: 0.17120672762393951 (3.358149655163288) | > loss_mel: 1.9593652486801147 (13.51939171552658) | > loss_duration: 3.2468130588531494 (3.3116730451583862) | > loss_1: 12.332216262817383 (27.250569343566895)  --> STEP: 3 | > loss_disc: 2.7971317768096924 (2.955764373143514) | > loss_disc_real_0: 0.39850425720214844 (0.330742210149765) | > loss_disc_real_1: 0.31630098819732666 (0.317431777715683) | > loss_disc_real_2: 0.2811926007270813 (0.24887078503767648) | > loss_disc_real_3: 0.36447885632514954 (0.31199705600738525) | > loss_disc_real_4: 0.280224472284317 (0.24222776790459952) | > loss_disc_real_5: 0.26722437143325806 (0.2605252613623937) | > loss_0: 2.7971317768096924 (2.955764373143514) | > loss_gen: 2.8148934841156006 (2.136492967605591) | > loss_kl: 2.686861991882324 (4.4049960772196455) | > loss_feat: 3.577695608139038 (3.4313316394885383) | > loss_mel: 23.35211181640625 (16.79696508248647) | > loss_duration: 3.028768539428711 (3.2173715432484946) | > loss_1: 35.4603271484375 (29.987155278523762) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024982293446858725 (-0.008072773615519205) | > avg_loss_disc: 2.955764373143514 (+0.9020112752914429) | > avg_loss_disc_real_0: 0.330742210149765 (+0.200474185248216) | > avg_loss_disc_real_1: 0.317431777715683 (+0.10124429563681284) | > avg_loss_disc_real_2: 0.24887078503767648 (+0.08242784688870111) | > avg_loss_disc_real_3: 0.31199705600738525 (+0.18744436651468277) | > avg_loss_disc_real_4: 0.24222776790459952 (+0.11694203813870749) | > avg_loss_disc_real_5: 0.2605252613623937 (+0.15610864385962486) | > avg_loss_0: 2.955764373143514 (+0.9020112752914429) | > avg_loss_gen: 2.136492967605591 (-0.24006827672322606) | > avg_loss_kl: 4.4049960772196455 (-0.01789108912150006) | > avg_loss_feat: 3.4313316394885383 (-5.594464297095934) | > avg_loss_mel: 16.79696508248647 (-6.6483200788497925) | > avg_loss_duration: 3.2173715432484946 (-0.00043686230977346696) | > avg_loss_1: 29.987155278523762 (-12.50118128458659)  > EPOCH: 966/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:49:39)   --> TIME: 2023-10-20 11:49:50 -- STEP: 9/50 -- GLOBAL_STEP: 101310 | > loss_disc: 2.5037879943847656 (2.193748301929898) | > loss_disc_real_0: 0.20725250244140625 (0.13843276393082407) | > loss_disc_real_1: 0.17734958231449127 (0.195778150525358) | > loss_disc_real_2: 0.3241974711418152 (0.21073815060986412) | > loss_disc_real_3: 0.4386996924877167 (0.2657750936018096) | > loss_disc_real_4: 0.12822525203227997 (0.18890088299910227) | > loss_disc_real_5: 0.15349158644676208 (0.18246622797515658) | > loss_0: 2.5037879943847656 (2.193748301929898) | > grad_norm_0: tensor(1116.1594, device='cuda:0') (tensor(1007.0284, device='cuda:0')) | > loss_gen: 2.4840493202209473 (2.6361199220021567) | > loss_kl: 1.1020032167434692 (0.9490292403433058) | > loss_feat: 6.252809524536133 (7.59401814142863) | > loss_mel: 20.683761596679688 (22.35879686143663) | > loss_duration: 1.3387587070465088 (1.3400138749016657) | > loss_1: 31.86138153076172 (34.87797864278158) | > grad_norm_1: tensor(35857.0312, device='cuda:0') (tensor(39823.6172, device='cuda:0')) | > current_lr_0: 7.611588537519316e-05 | > current_lr_1: 7.611588537519316e-05 | > step_time: 0.755 (0.7120680809020996) | > loader_time: 0.0617 (0.029593865076700848)  --> TIME: 2023-10-20 11:50:10 -- STEP: 39/50 -- GLOBAL_STEP: 101340 | > loss_disc: 2.666374683380127 (2.5894600978264455) | > loss_disc_real_0: 0.24497760832309723 (0.16066663258541852) | > loss_disc_real_1: 0.2780747711658478 (0.22674172734602904) | > loss_disc_real_2: 0.21409012377262115 (0.21512038451738846) | > loss_disc_real_3: 0.30036354064941406 (0.2447744357662323) | > loss_disc_real_4: 0.22985967993736267 (0.2366759130396904) | > loss_disc_real_5: 0.3681736886501312 (0.2592746542814451) | > loss_0: 2.666374683380127 (2.5894600978264455) | > grad_norm_0: tensor(1500.4164, device='cuda:0') (tensor(1100.3220, device='cuda:0')) | > loss_gen: 2.346804141998291 (2.1955104241004357) | > loss_kl: 0.5788879990577698 (0.8750111158841696) | > loss_feat: 2.3794033527374268 (5.376148414320481) | > loss_mel: 14.984020233154297 (20.253575285275776) | > loss_duration: 1.4224704504013062 (1.3371822895147862) | > loss_1: 21.711585998535156 (30.037427510970677) | > grad_norm_1: tensor(19840.5137, device='cuda:0') (tensor(33910.9141, device='cuda:0')) | > current_lr_0: 7.611588537519316e-05 | > current_lr_1: 7.611588537519316e-05 | > step_time: 0.8236 (0.6466711117671087) | > loader_time: 0.0235 (0.02488848490592761)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.773961305618286 (2.773961305618286) | > loss_disc_real_0: 0.28994178771972656 (0.28994178771972656) | > loss_disc_real_1: 0.27551543712615967 (0.27551543712615967) | > loss_disc_real_2: 0.22703386843204498 (0.22703386843204498) | > loss_disc_real_3: 0.2727805972099304 (0.2727805972099304) | > loss_disc_real_4: 0.26368746161460876 (0.26368746161460876) | > loss_disc_real_5: 0.2335248738527298 (0.2335248738527298) | > loss_0: 2.773961305618286 (2.773961305618286) | > loss_gen: 2.101499319076538 (2.101499319076538) | > loss_kl: 4.872921943664551 (4.872921943664551) | > loss_feat: 1.7112617492675781 (1.7112617492675781) | > loss_mel: 17.602453231811523 (17.602453231811523) | > loss_duration: 3.088834047317505 (3.088834047317505) | > loss_1: 29.376972198486328 (29.376972198486328)  --> STEP: 1 | > loss_disc: 2.7303128242492676 (2.7303128242492676) | > loss_disc_real_0: 0.370802640914917 (0.370802640914917) | > loss_disc_real_1: 0.2323090136051178 (0.2323090136051178) | > loss_disc_real_2: 0.1951347440481186 (0.1951347440481186) | > loss_disc_real_3: 0.1703828126192093 (0.1703828126192093) | > loss_disc_real_4: 0.22146517038345337 (0.22146517038345337) | > loss_disc_real_5: 0.24707457423210144 (0.24707457423210144) | > loss_0: 2.7303128242492676 (2.7303128242492676) | > loss_gen: 1.984816074371338 (1.984816074371338) | > loss_kl: 4.959989547729492 (4.959989547729492) | > loss_feat: 4.678056240081787 (4.678056240081787) | > loss_mel: 24.51774787902832 (24.51774787902832) | > loss_duration: 3.3455872535705566 (3.3455872535705566) | > loss_1: 39.48619842529297 (39.48619842529297)  --> STEP: 2 | > loss_disc: 2.0282657146453857 (2.3792892694473267) | > loss_disc_real_0: 0.24813055992126465 (0.3094666004180908) | > loss_disc_real_1: 0.2857106029987335 (0.25900980830192566) | > loss_disc_real_2: 0.28912800550460815 (0.24213137477636337) | > loss_disc_real_3: 0.171495720744133 (0.17093926668167114) | > loss_disc_real_4: 0.1273503601551056 (0.17440776526927948) | > loss_disc_real_5: 0.08667739480733871 (0.16687598451972008) | > loss_0: 2.0282657146453857 (2.3792892694473267) | > loss_gen: 2.9763293266296387 (2.4805727005004883) | > loss_kl: 5.415133476257324 (5.187561511993408) | > loss_feat: 8.282205581665039 (6.480130910873413) | > loss_mel: 22.86516571044922 (23.69145679473877) | > loss_duration: 3.2807984352111816 (3.313192844390869) | > loss_1: 42.81963348388672 (41.152915954589844)  --> STEP: 3 | > loss_disc: 2.613147258758545 (2.457241932551066) | > loss_disc_real_0: 0.15273138880729675 (0.2572215298811595) | > loss_disc_real_1: 0.3326968252658844 (0.2835721472899119) | > loss_disc_real_2: 0.26876601576805115 (0.2510095884402593) | > loss_disc_real_3: 0.32817506790161133 (0.2233512004216512) | > loss_disc_real_4: 0.29660531878471375 (0.21514028310775757) | > loss_disc_real_5: 0.34353339672088623 (0.22576178858677545) | > loss_0: 2.613147258758545 (2.457241932551066) | > loss_gen: 2.671553134918213 (2.5442328453063965) | > loss_kl: 2.915286064147949 (4.430136362711589) | > loss_feat: 3.616054058074951 (5.525438626607259) | > loss_mel: 20.249818801879883 (22.544244130452473) | > loss_duration: 3.038252592086792 (3.2215460936228433) | > loss_1: 32.490962982177734 (38.26559829711914) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026970704396565757 (+0.00019884109497070312) | > avg_loss_disc: 2.457241932551066 (-0.4985224405924482) | > avg_loss_disc_real_0: 0.2572215298811595 (-0.07352068026860553) | > avg_loss_disc_real_1: 0.2835721472899119 (-0.03385963042577106) | > avg_loss_disc_real_2: 0.2510095884402593 (+0.002138803402582795) | > avg_loss_disc_real_3: 0.2233512004216512 (-0.08864585558573404) | > avg_loss_disc_real_4: 0.21514028310775757 (-0.02708748479684195) | > avg_loss_disc_real_5: 0.22576178858677545 (-0.034763472775618226) | > avg_loss_0: 2.457241932551066 (-0.4985224405924482) | > avg_loss_gen: 2.5442328453063965 (+0.40773987770080566) | > avg_loss_kl: 4.430136362711589 (+0.02514028549194336) | > avg_loss_feat: 5.525438626607259 (+2.0941069871187206) | > avg_loss_mel: 22.544244130452473 (+5.747279047966003) | > avg_loss_duration: 3.2215460936228433 (+0.004174550374348662) | > avg_loss_1: 38.26559829711914 (+8.278443018595379)  > EPOCH: 967/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:50:32)   --> TIME: 2023-10-20 11:50:53 -- STEP: 19/50 -- GLOBAL_STEP: 101370 | > loss_disc: 1.9326729774475098 (2.3330343648007044) | > loss_disc_real_0: 0.09952662140130997 (0.17055279987030908) | > loss_disc_real_1: 0.1751174032688141 (0.21870553728781247) | > loss_disc_real_2: 0.1936616450548172 (0.2351481298867025) | > loss_disc_real_3: 0.14488279819488525 (0.19036981894781715) | > loss_disc_real_4: 0.31602558493614197 (0.20723792008663477) | > loss_disc_real_5: 0.3396964967250824 (0.23494857275172285) | > loss_0: 1.9326729774475098 (2.3330343648007044) | > grad_norm_0: tensor(1143.1536, device='cuda:0') (tensor(1105.7939, device='cuda:0')) | > loss_gen: 2.9923739433288574 (2.5589740401820134) | > loss_kl: 0.8878173828125 (0.798882406008871) | > loss_feat: 7.572169780731201 (6.620909402637105) | > loss_mel: 23.36897850036621 (21.939032353852923) | > loss_duration: 1.4214600324630737 (1.386063632212187) | > loss_1: 36.2427978515625 (33.303861818815534) | > grad_norm_1: tensor(36116.9219, device='cuda:0') (tensor(44370.7852, device='cuda:0')) | > current_lr_0: 7.603980278219392e-05 | > current_lr_1: 7.603980278219392e-05 | > step_time: 1.2578 (0.7565513661033229) | > loader_time: 0.0178 (0.025766887162861064)  --> TIME: 2023-10-20 11:51:06 -- STEP: 49/50 -- GLOBAL_STEP: 101400 | > loss_disc: 2.3057849407196045 (2.4763625397974125) | > loss_disc_real_0: 0.07336865365505219 (0.16365887460355855) | > loss_disc_real_1: 0.3948332369327545 (0.21659660772705563) | > loss_disc_real_2: 0.19072675704956055 (0.22996750394148485) | > loss_disc_real_3: 0.22509047389030457 (0.2244492504289564) | > loss_disc_real_4: 0.2854481339454651 (0.22669879717714325) | > loss_disc_real_5: 0.2931729257106781 (0.23990493300085775) | > loss_0: 2.3057849407196045 (2.4763625397974125) | > grad_norm_0: tensor(501.5526, device='cuda:0') (tensor(938.8733, device='cuda:0')) | > loss_gen: 2.69462251663208 (2.3208974745808817) | > loss_kl: 0.43130069971084595 (0.7459781977671143) | > loss_feat: 5.724043846130371 (5.531433636778775) | > loss_mel: 23.446237564086914 (20.240631694696376) | > loss_duration: 1.4860352277755737 (1.3537008738031193) | > loss_1: 33.7822380065918 (30.1926416377632) | > grad_norm_1: tensor(10127.5498, device='cuda:0') (tensor(31323.3828, device='cuda:0')) | > current_lr_0: 7.603980278219392e-05 | > current_lr_1: 7.603980278219392e-05 | > step_time: 0.3777 (0.5380706689795669) | > loader_time: 0.4371 (0.02271450782308773)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.837489604949951 (2.837489604949951) | > loss_disc_real_0: 0.32294347882270813 (0.32294347882270813) | > loss_disc_real_1: 0.35987213253974915 (0.35987213253974915) | > loss_disc_real_2: 0.2531416416168213 (0.2531416416168213) | > loss_disc_real_3: 0.23358848690986633 (0.23358848690986633) | > loss_disc_real_4: 0.21367304027080536 (0.21367304027080536) | > loss_disc_real_5: 0.1848200261592865 (0.1848200261592865) | > loss_0: 2.837489604949951 (2.837489604949951) | > loss_gen: 1.8169190883636475 (1.8169190883636475) | > loss_kl: 5.729146957397461 (5.729146957397461) | > loss_feat: 0.879398763179779 (0.879398763179779) | > loss_mel: 13.702387809753418 (13.702387809753418) | > loss_duration: 2.9954895973205566 (2.9954895973205566) | > loss_1: 25.123342514038086 (25.123342514038086)  --> STEP: 1 | > loss_disc: 2.6800384521484375 (2.6800384521484375) | > loss_disc_real_0: 0.27395617961883545 (0.27395617961883545) | > loss_disc_real_1: 0.3537050485610962 (0.3537050485610962) | > loss_disc_real_2: 0.3055880665779114 (0.3055880665779114) | > loss_disc_real_3: 0.3305351138114929 (0.3305351138114929) | > loss_disc_real_4: 0.3819352090358734 (0.3819352090358734) | > loss_disc_real_5: 0.3104524612426758 (0.3104524612426758) | > loss_0: 2.6800384521484375 (2.6800384521484375) | > loss_gen: 2.9927191734313965 (2.9927191734313965) | > loss_kl: 5.507698059082031 (5.507698059082031) | > loss_feat: 4.326355457305908 (4.326355457305908) | > loss_mel: 22.471712112426758 (22.471712112426758) | > loss_duration: 3.3551907539367676 (3.3551907539367676) | > loss_1: 38.65367126464844 (38.65367126464844)  --> STEP: 2 | > loss_disc: 1.666812777519226 (2.173425614833832) | > loss_disc_real_0: 0.11851201206445694 (0.1962340958416462) | > loss_disc_real_1: 0.24155613780021667 (0.29763059318065643) | > loss_disc_real_2: 0.17388767004013062 (0.239737868309021) | > loss_disc_real_3: 0.21188043057918549 (0.2712077721953392) | > loss_disc_real_4: 0.17264612019062042 (0.2772906646132469) | > loss_disc_real_5: 0.17610454559326172 (0.24327850341796875) | > loss_0: 1.666812777519226 (2.173425614833832) | > loss_gen: 3.5407052040100098 (3.266712188720703) | > loss_kl: 5.692152500152588 (5.59992527961731) | > loss_feat: 11.06856918334961 (7.697462320327759) | > loss_mel: 21.719486236572266 (22.09559917449951) | > loss_duration: 3.2593212127685547 (3.307255983352661) | > loss_1: 45.280235290527344 (41.96695327758789)  --> STEP: 3 | > loss_disc: 3.0140397548675537 (2.4536303281784058) | > loss_disc_real_0: 0.38619542121887207 (0.25955453763405484) | > loss_disc_real_1: 0.40776529908180237 (0.33434216181437176) | > loss_disc_real_2: 0.33521363139152527 (0.27156312266985577) | > loss_disc_real_3: 0.2642531991004944 (0.26888958116372425) | > loss_disc_real_4: 0.24205952882766724 (0.26554695268472034) | > loss_disc_real_5: 0.22231370210647583 (0.23629023631413779) | > loss_0: 3.0140397548675537 (2.4536303281784058) | > loss_gen: 1.9777429103851318 (2.837055762608846) | > loss_kl: 2.822110414505005 (4.673986991246541) | > loss_feat: 0.5254330635070801 (5.306785901387532) | > loss_mel: 16.72144889831543 (20.304215749104817) | > loss_duration: 3.001969575881958 (3.2054938475290933) | > loss_1: 25.0487060546875 (36.327537536621094) --> EVAL PERFORMANCE | > avg_loader_time: 0.003660996754964193 (+0.0009639263153076172) | > avg_loss_disc: 2.4536303281784058 (-0.003611604372660171) | > avg_loss_disc_real_0: 0.25955453763405484 (+0.0023330077528953552) | > avg_loss_disc_real_1: 0.33434216181437176 (+0.05077001452445984) | > avg_loss_disc_real_2: 0.27156312266985577 (+0.020553534229596493) | > avg_loss_disc_real_3: 0.26888958116372425 (+0.04553838074207303) | > avg_loss_disc_real_4: 0.26554695268472034 (+0.05040666957696277) | > avg_loss_disc_real_5: 0.23629023631413779 (+0.010528447727362333) | > avg_loss_0: 2.4536303281784058 (-0.003611604372660171) | > avg_loss_gen: 2.837055762608846 (+0.2928229173024497) | > avg_loss_kl: 4.673986991246541 (+0.2438506285349522) | > avg_loss_feat: 5.306785901387532 (-0.21865272521972656) | > avg_loss_mel: 20.304215749104817 (-2.2400283813476562) | > avg_loss_duration: 3.2054938475290933 (-0.01605224609375) | > avg_loss_1: 36.327537536621094 (-1.9380607604980469)  > EPOCH: 968/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:51:19)   --> TIME: 2023-10-20 11:51:45 -- STEP: 29/50 -- GLOBAL_STEP: 101430 | > loss_disc: 2.3615784645080566 (2.552843907783772) | > loss_disc_real_0: 0.01993386447429657 (0.16205955245371523) | > loss_disc_real_1: 0.1530749797821045 (0.2487737545422439) | > loss_disc_real_2: 0.2452283501625061 (0.22896459236227232) | > loss_disc_real_3: 0.3485252559185028 (0.2574503797523935) | > loss_disc_real_4: 0.17660629749298096 (0.2268865573508986) | > loss_disc_real_5: 0.19645926356315613 (0.23251082850941296) | > loss_0: 2.3615784645080566 (2.552843907783772) | > grad_norm_0: tensor(499.2681, device='cuda:0') (tensor(708.0271, device='cuda:0')) | > loss_gen: 2.166135311126709 (2.3016756197501875) | > loss_kl: 0.9431262612342834 (0.8598622361133839) | > loss_feat: 5.991692543029785 (5.555961909479108) | > loss_mel: 21.793251037597656 (21.657976594464532) | > loss_duration: 1.2654017210006714 (1.362326194500101) | > loss_1: 32.15960693359375 (31.737802834346375) | > grad_norm_1: tensor(19020.4824, device='cuda:0') (tensor(20543.8965, device='cuda:0')) | > current_lr_0: 7.596379623850986e-05 | > current_lr_1: 7.596379623850986e-05 | > step_time: 0.6332 (0.6461566645523598) | > loader_time: 0.0311 (0.020843834712587554)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.051445245742798 (2.051445245742798) | > loss_disc_real_0: 0.12321921437978745 (0.12321921437978745) | > loss_disc_real_1: 0.2785273492336273 (0.2785273492336273) | > loss_disc_real_2: 0.17132556438446045 (0.17132556438446045) | > loss_disc_real_3: 0.13934260606765747 (0.13934260606765747) | > loss_disc_real_4: 0.14007091522216797 (0.14007091522216797) | > loss_disc_real_5: 0.06186164915561676 (0.06186164915561676) | > loss_0: 2.051445245742798 (2.051445245742798) | > loss_gen: 2.2457473278045654 (2.2457473278045654) | > loss_kl: 5.7589430809021 (5.7589430809021) | > loss_feat: 10.231574058532715 (10.231574058532715) | > loss_mel: 25.137861251831055 (25.137861251831055) | > loss_duration: 3.048611640930176 (3.048611640930176) | > loss_1: 46.42273712158203 (46.42273712158203)  --> STEP: 1 | > loss_disc: 2.5744378566741943 (2.5744378566741943) | > loss_disc_real_0: 0.28591302037239075 (0.28591302037239075) | > loss_disc_real_1: 0.291574627161026 (0.291574627161026) | > loss_disc_real_2: 0.18214258551597595 (0.18214258551597595) | > loss_disc_real_3: 0.28758925199508667 (0.28758925199508667) | > loss_disc_real_4: 0.23538245260715485 (0.23538245260715485) | > loss_disc_real_5: 0.3193591237068176 (0.3193591237068176) | > loss_0: 2.5744378566741943 (2.5744378566741943) | > loss_gen: 2.6471548080444336 (2.6471548080444336) | > loss_kl: 5.199469566345215 (5.199469566345215) | > loss_feat: 5.118587493896484 (5.118587493896484) | > loss_mel: 22.590476989746094 (22.590476989746094) | > loss_duration: 3.471306800842285 (3.471306800842285) | > loss_1: 39.02699661254883 (39.02699661254883)  --> STEP: 2 | > loss_disc: 2.6200735569000244 (2.5972557067871094) | > loss_disc_real_0: 0.2772713601589203 (0.2815921902656555) | > loss_disc_real_1: 0.21915604174137115 (0.2553653344511986) | > loss_disc_real_2: 0.1317114382982254 (0.15692701190710068) | > loss_disc_real_3: 0.28924718499183655 (0.2884182184934616) | > loss_disc_real_4: 0.2000957727432251 (0.21773911267518997) | > loss_disc_real_5: 0.1748485118150711 (0.24710381776094437) | > loss_0: 2.6200735569000244 (2.5972557067871094) | > loss_gen: 2.6310276985168457 (2.6390912532806396) | > loss_kl: 5.831908702850342 (5.515689134597778) | > loss_feat: 8.63374137878418 (6.876164436340332) | > loss_mel: 24.288944244384766 (23.43971061706543) | > loss_duration: 3.2728793621063232 (3.372093081474304) | > loss_1: 44.65850067138672 (41.84274864196777)  --> STEP: 3 | > loss_disc: 2.905287027359009 (2.699932813644409) | > loss_disc_real_0: 0.1304197609424591 (0.2312013804912567) | > loss_disc_real_1: 0.27601614594459534 (0.2622489382823308) | > loss_disc_real_2: 0.27944129705429077 (0.19776510695616403) | > loss_disc_real_3: 0.30131620168685913 (0.2927175462245941) | > loss_disc_real_4: 0.2954847812652588 (0.24365433553854624) | > loss_disc_real_5: 0.300446093082428 (0.2648845762014389) | > loss_0: 2.905287027359009 (2.699932813644409) | > loss_gen: 1.7086063623428345 (2.328929622968038) | > loss_kl: 2.62127947807312 (4.550885915756226) | > loss_feat: 0.4688373804092407 (4.740388751029968) | > loss_mel: 16.61140251159668 (21.163607915242512) | > loss_duration: 3.0771350860595703 (3.273773749669393) | > loss_1: 24.487260818481445 (36.057586034139) --> EVAL PERFORMANCE | > avg_loader_time: 0.0037396748860677085 (+7.867813110351562e-05) | > avg_loss_disc: 2.699932813644409 (+0.24630248546600342) | > avg_loss_disc_real_0: 0.2312013804912567 (-0.028353157142798124) | > avg_loss_disc_real_1: 0.2622489382823308 (-0.07209322353204095) | > avg_loss_disc_real_2: 0.19776510695616403 (-0.07379801571369174) | > avg_loss_disc_real_3: 0.2927175462245941 (+0.02382796506086987) | > avg_loss_disc_real_4: 0.24365433553854624 (-0.021892617146174104) | > avg_loss_disc_real_5: 0.2648845762014389 (+0.028594339887301118) | > avg_loss_0: 2.699932813644409 (+0.24630248546600342) | > avg_loss_gen: 2.328929622968038 (-0.5081261396408081) | > avg_loss_kl: 4.550885915756226 (-0.12310107549031546) | > avg_loss_feat: 4.740388751029968 (-0.566397150357564) | > avg_loss_mel: 21.163607915242512 (+0.8593921661376953) | > avg_loss_duration: 3.273773749669393 (+0.06827990214029978) | > avg_loss_1: 36.057586034139 (-0.269951502482094)  > EPOCH: 969/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:52:14)   --> TIME: 2023-10-20 11:52:26 -- STEP: 9/50 -- GLOBAL_STEP: 101460 | > loss_disc: 3.023259162902832 (2.4562323490778604) | > loss_disc_real_0: 0.2588452696800232 (0.14582499251183537) | > loss_disc_real_1: 0.27701523900032043 (0.21734199134839904) | > loss_disc_real_2: 0.28204235434532166 (0.21960822648058334) | > loss_disc_real_3: 0.2666222155094147 (0.2804253163437049) | > loss_disc_real_4: 0.2735602557659149 (0.23769269035094315) | > loss_disc_real_5: 0.3229266405105591 (0.2060731980535719) | > loss_0: 3.023259162902832 (2.4562323490778604) | > grad_norm_0: tensor(204.3997, device='cuda:0') (tensor(479.5922, device='cuda:0')) | > loss_gen: 1.657293438911438 (2.439774261580573) | > loss_kl: 0.9963786005973816 (0.8331483668751187) | > loss_feat: 0.03993804007768631 (6.557635685635938) | > loss_mel: 1.2580264806747437 (20.34398803446028) | > loss_duration: 1.310673713684082 (1.3495599561267428) | > loss_1: 5.262310028076172 (31.524105283949112) | > grad_norm_1: tensor(42993.5859, device='cuda:0') (tensor(20651.6504, device='cuda:0')) | > current_lr_0: 7.588786566812494e-05 | > current_lr_1: 7.588786566812494e-05 | > step_time: 0.6605 (0.668135404586792) | > loader_time: 0.0247 (0.024530861112806533)  --> TIME: 2023-10-20 11:52:45 -- STEP: 39/50 -- GLOBAL_STEP: 101490 | > loss_disc: 2.689098834991455 (2.376401788149125) | > loss_disc_real_0: 0.09989525377750397 (0.14009829101940766) | > loss_disc_real_1: 0.2644161283969879 (0.22463863290464267) | > loss_disc_real_2: 0.14598727226257324 (0.21822559019216362) | > loss_disc_real_3: 0.33065420389175415 (0.24932334629388955) | > loss_disc_real_4: 0.3030172288417816 (0.23365486890841752) | > loss_disc_real_5: 0.30047085881233215 (0.2108338424601616) | > loss_0: 2.689098834991455 (2.376401788149125) | > grad_norm_0: tensor(416.9143, device='cuda:0') (tensor(518.6275, device='cuda:0')) | > loss_gen: 2.0580244064331055 (2.4146645130255284) | > loss_kl: 0.7352420687675476 (0.8782557440109742) | > loss_feat: 3.7511940002441406 (5.777272379360139) | > loss_mel: 20.466285705566406 (20.748073507577946) | > loss_duration: 1.3982433080673218 (1.3499337893265944) | > loss_1: 28.40898895263672 (31.168199575864353) | > grad_norm_1: tensor(2885.4939, device='cuda:0') (tensor(21458.0723, device='cuda:0')) | > current_lr_0: 7.588786566812494e-05 | > current_lr_1: 7.588786566812494e-05 | > step_time: 0.401 (0.6211375334323981) | > loader_time: 0.0057 (0.02172562403556628)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5616140365600586 (2.5616140365600586) | > loss_disc_real_0: 0.49387916922569275 (0.49387916922569275) | > loss_disc_real_1: 0.2570352852344513 (0.2570352852344513) | > loss_disc_real_2: 0.31192752718925476 (0.31192752718925476) | > loss_disc_real_3: 0.2606618106365204 (0.2606618106365204) | > loss_disc_real_4: 0.24155166745185852 (0.24155166745185852) | > loss_disc_real_5: 0.27496737241744995 (0.27496737241744995) | > loss_0: 2.5616140365600586 (2.5616140365600586) | > loss_gen: 2.7915725708007812 (2.7915725708007812) | > loss_kl: 5.614847660064697 (5.614847660064697) | > loss_feat: 6.815046310424805 (6.815046310424805) | > loss_mel: 22.56296157836914 (22.56296157836914) | > loss_duration: 3.133347511291504 (3.133347511291504) | > loss_1: 40.91777420043945 (40.91777420043945)  --> STEP: 1 | > loss_disc: 2.0976128578186035 (2.0976128578186035) | > loss_disc_real_0: 0.2945346236228943 (0.2945346236228943) | > loss_disc_real_1: 0.23035037517547607 (0.23035037517547607) | > loss_disc_real_2: 0.20047403872013092 (0.20047403872013092) | > loss_disc_real_3: 0.22393883764743805 (0.22393883764743805) | > loss_disc_real_4: 0.22405539453029633 (0.22405539453029633) | > loss_disc_real_5: 0.25533565878868103 (0.25533565878868103) | > loss_0: 2.0976128578186035 (2.0976128578186035) | > loss_gen: 3.0100014209747314 (3.0100014209747314) | > loss_kl: 5.050572872161865 (5.050572872161865) | > loss_feat: 6.774371147155762 (6.774371147155762) | > loss_mel: 24.725616455078125 (24.725616455078125) | > loss_duration: 3.3810830116271973 (3.3810830116271973) | > loss_1: 42.941646575927734 (42.941646575927734)  --> STEP: 2 | > loss_disc: 3.007673740386963 (2.552643299102783) | > loss_disc_real_0: 0.2862400412559509 (0.2903873324394226) | > loss_disc_real_1: 0.2408551722764969 (0.23560277372598648) | > loss_disc_real_2: 0.27756360173225403 (0.23901882022619247) | > loss_disc_real_3: 0.24159453809261322 (0.23276668787002563) | > loss_disc_real_4: 0.2830584943294525 (0.2535569444298744) | > loss_disc_real_5: 0.2801334857940674 (0.2677345722913742) | > loss_0: 3.007673740386963 (2.552643299102783) | > loss_gen: 1.6113455295562744 (2.310673475265503) | > loss_kl: 5.498015403747559 (5.274294137954712) | > loss_feat: 0.018710654228925705 (3.3965409006923437) | > loss_mel: 2.8263795375823975 (13.775997996330261) | > loss_duration: 3.2804861068725586 (3.330784559249878) | > loss_1: 13.234936714172363 (28.08829164505005)  --> STEP: 3 | > loss_disc: 2.881880044937134 (2.662388881047567) | > loss_disc_real_0: 0.2648358941078186 (0.28187018632888794) | > loss_disc_real_1: 0.24625813961029053 (0.23915456235408783) | > loss_disc_real_2: 0.3140728771686554 (0.26403683920701343) | > loss_disc_real_3: 0.2307371348142624 (0.2320901701847712) | > loss_disc_real_4: 0.29152828454971313 (0.266214057803154) | > loss_disc_real_5: 0.29462453722953796 (0.2766978939374288) | > loss_0: 2.881880044937134 (2.662388881047567) | > loss_gen: 1.8379628658294678 (2.1531032721201577) | > loss_kl: 2.70104718208313 (4.416545152664185) | > loss_feat: 1.4584161043167114 (2.7504993019004664) | > loss_mel: 17.634220123291016 (15.062072038650513) | > loss_duration: 2.966310501098633 (3.2092932065327964) | > loss_1: 26.597957611083984 (27.591513633728027) --> EVAL PERFORMANCE | > avg_loader_time: 0.0035185019175211587 (-0.00022117296854654977) | > avg_loss_disc: 2.662388881047567 (-0.0375439325968423) | > avg_loss_disc_real_0: 0.28187018632888794 (+0.050668805837631226) | > avg_loss_disc_real_1: 0.23915456235408783 (-0.023094375928242983) | > avg_loss_disc_real_2: 0.26403683920701343 (+0.0662717322508494) | > avg_loss_disc_real_3: 0.2320901701847712 (-0.060627376039822906) | > avg_loss_disc_real_4: 0.266214057803154 (+0.022559722264607757) | > avg_loss_disc_real_5: 0.2766978939374288 (+0.01181331773598987) | > avg_loss_0: 2.662388881047567 (-0.0375439325968423) | > avg_loss_gen: 2.1531032721201577 (-0.17582635084788034) | > avg_loss_kl: 4.416545152664185 (-0.13434076309204102) | > avg_loss_feat: 2.7504993019004664 (-1.9898894491295018) | > avg_loss_mel: 15.062072038650513 (-6.101535876591999) | > avg_loss_duration: 3.2092932065327964 (-0.06448054313659668) | > avg_loss_1: 27.591513633728027 (-8.466072400410972)  > EPOCH: 970/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:53:06)   --> TIME: 2023-10-20 11:53:23 -- STEP: 19/50 -- GLOBAL_STEP: 101520 | > loss_disc: 2.2908220291137695 (2.432370336432206) | > loss_disc_real_0: 0.04456387460231781 (0.18259023169153615) | > loss_disc_real_1: 0.2530331015586853 (0.23261167109012604) | > loss_disc_real_2: 0.2311866283416748 (0.2009394043370297) | > loss_disc_real_3: 0.2137458771467209 (0.23987671232929356) | > loss_disc_real_4: 0.28215956687927246 (0.21994763171594395) | > loss_disc_real_5: 0.19333718717098236 (0.21716104702729927) | > loss_0: 2.2908220291137695 (2.432370336432206) | > grad_norm_0: tensor(751.9210, device='cuda:0') (tensor(692.6596, device='cuda:0')) | > loss_gen: 2.342115879058838 (2.3557349066985283) | > loss_kl: 1.0065006017684937 (0.745433404257423) | > loss_feat: 4.301355361938477 (5.97615871529438) | > loss_mel: 21.33252716064453 (20.558854448167903) | > loss_duration: 1.4452883005142212 (1.3774663021689968) | > loss_1: 30.427785873413086 (31.01364820881894) | > grad_norm_1: tensor(22601.1816, device='cuda:0') (tensor(22178.4434, device='cuda:0')) | > current_lr_0: 7.581201099509909e-05 | > current_lr_1: 7.581201099509909e-05 | > step_time: 0.4156 (0.5794580861141808) | > loader_time: 0.005 (0.02037298051934493)  --> TIME: 2023-10-20 11:53:36 -- STEP: 49/50 -- GLOBAL_STEP: 101550 | > loss_disc: 2.6689846515655518 (2.5030074046582595) | > loss_disc_real_0: 0.007460571825504303 (0.16713456011244232) | > loss_disc_real_1: 0.1509690284729004 (0.22444151509173063) | > loss_disc_real_2: 0.1771346926689148 (0.2066362950266624) | > loss_disc_real_3: 0.2841257154941559 (0.22734301160944967) | > loss_disc_real_4: 0.2901659607887268 (0.2268206397337573) | > loss_disc_real_5: 0.2970089912414551 (0.241413164883852) | > loss_0: 2.6689846515655518 (2.5030074046582595) | > grad_norm_0: tensor(1497.6548, device='cuda:0') (tensor(734.0231, device='cuda:0')) | > loss_gen: 1.7238719463348389 (2.2260414945835967) | > loss_kl: 0.4447043836116791 (0.7143571867170383) | > loss_feat: 1.9099366664886475 (5.192800306201895) | > loss_mel: 22.575485229492188 (20.077957919665746) | > loss_duration: 1.460219144821167 (1.3433318867975352) | > loss_1: 28.114215850830078 (29.55448869783051) | > grad_norm_1: tensor(3240.6580, device='cuda:0') (tensor(18450.4238, device='cuda:0')) | > current_lr_0: 7.581201099509909e-05 | > current_lr_1: 7.581201099509909e-05 | > step_time: 0.4987 (0.4736270126031371) | > loader_time: 0.5309 (0.024113572373682134)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6714770793914795 (2.6714770793914795) | > loss_disc_real_0: 0.30131977796554565 (0.30131977796554565) | > loss_disc_real_1: 0.30120590329170227 (0.30120590329170227) | > loss_disc_real_2: 0.24705390632152557 (0.24705390632152557) | > loss_disc_real_3: 0.1815548539161682 (0.1815548539161682) | > loss_disc_real_4: 0.2613435685634613 (0.2613435685634613) | > loss_disc_real_5: 0.30336591601371765 (0.30336591601371765) | > loss_0: 2.6714770793914795 (2.6714770793914795) | > loss_gen: 2.4375698566436768 (2.4375698566436768) | > loss_kl: 4.805093288421631 (4.805093288421631) | > loss_feat: 7.0281901359558105 (7.0281901359558105) | > loss_mel: 22.986509323120117 (22.986509323120117) | > loss_duration: 3.0394184589385986 (3.0394184589385986) | > loss_1: 40.29677963256836 (40.29677963256836)  --> STEP: 1 | > loss_disc: 2.7861366271972656 (2.7861366271972656) | > loss_disc_real_0: 0.15935398638248444 (0.15935398638248444) | > loss_disc_real_1: 0.2743549942970276 (0.2743549942970276) | > loss_disc_real_2: 0.216934472322464 (0.216934472322464) | > loss_disc_real_3: 0.24735338985919952 (0.24735338985919952) | > loss_disc_real_4: 0.2495725452899933 (0.2495725452899933) | > loss_disc_real_5: 0.2965847849845886 (0.2965847849845886) | > loss_0: 2.7861366271972656 (2.7861366271972656) | > loss_gen: 1.6911286115646362 (1.6911286115646362) | > loss_kl: 5.1852288246154785 (5.1852288246154785) | > loss_feat: 0.8512336015701294 (0.8512336015701294) | > loss_mel: 15.867447853088379 (15.867447853088379) | > loss_duration: 3.4252593517303467 (3.4252593517303467) | > loss_1: 27.020296096801758 (27.020296096801758)  --> STEP: 2 | > loss_disc: 2.5792505741119385 (2.682693600654602) | > loss_disc_real_0: 0.38932380080223083 (0.27433889359235764) | > loss_disc_real_1: 0.20852643251419067 (0.24144071340560913) | > loss_disc_real_2: 0.221882626414299 (0.2194085493683815) | > loss_disc_real_3: 0.39220282435417175 (0.31977810710668564) | > loss_disc_real_4: 0.24608999490737915 (0.24783127009868622) | > loss_disc_real_5: 0.2684032618999481 (0.28249402344226837) | > loss_0: 2.5792505741119385 (2.682693600654602) | > loss_gen: 2.6777007579803467 (2.1844146847724915) | > loss_kl: 5.54215669631958 (5.363692760467529) | > loss_feat: 10.252840995788574 (5.552037298679352) | > loss_mel: 24.204927444458008 (20.036187648773193) | > loss_duration: 3.197549343109131 (3.3114043474197388) | > loss_1: 45.87517166137695 (36.447733879089355)  --> STEP: 3 | > loss_disc: 2.7027482986450195 (2.689378499984741) | > loss_disc_real_0: 0.19800515472888947 (0.24889431397120157) | > loss_disc_real_1: 0.2335667908191681 (0.23881607254346213) | > loss_disc_real_2: 0.3747735023498535 (0.2711968670288722) | > loss_disc_real_3: 0.38665613532066345 (0.3420707831780116) | > loss_disc_real_4: 0.37962621450424194 (0.29176291823387146) | > loss_disc_real_5: 0.4238545298576355 (0.32961419224739075) | > loss_0: 2.7027482986450195 (2.689378499984741) | > loss_gen: 2.9785590171813965 (2.4491294622421265) | > loss_kl: 2.106325387954712 (4.27790363629659) | > loss_feat: 4.569721698760986 (5.22459876537323) | > loss_mel: 24.389827728271484 (21.487401008605957) | > loss_duration: 2.95882248878479 (3.1938770612080893) | > loss_1: 37.003257751464844 (36.632908503214516) --> EVAL PERFORMANCE | > avg_loader_time: 0.024461746215820312 (+0.020943244298299152) | > avg_loss_disc: 2.689378499984741 (+0.02698961893717433) | > avg_loss_disc_real_0: 0.24889431397120157 (-0.03297587235768637) | > avg_loss_disc_real_1: 0.23881607254346213 (-0.0003384898106257028) | > avg_loss_disc_real_2: 0.2711968670288722 (+0.007160027821858761) | > avg_loss_disc_real_3: 0.3420707831780116 (+0.10998061299324038) | > avg_loss_disc_real_4: 0.29176291823387146 (+0.025548860430717468) | > avg_loss_disc_real_5: 0.32961419224739075 (+0.05291629830996197) | > avg_loss_0: 2.689378499984741 (+0.02698961893717433) | > avg_loss_gen: 2.4491294622421265 (+0.29602619012196874) | > avg_loss_kl: 4.27790363629659 (-0.1386415163675947) | > avg_loss_feat: 5.22459876537323 (+2.4740994634727635) | > avg_loss_mel: 21.487401008605957 (+6.425328969955444) | > avg_loss_duration: 3.1938770612080893 (-0.015416145324707031) | > avg_loss_1: 36.632908503214516 (+9.041394869486489)  > EPOCH: 971/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:53:52)   --> TIME: 2023-10-20 11:54:17 -- STEP: 29/50 -- GLOBAL_STEP: 101580 | > loss_disc: 2.9837546348571777 (2.5814258106823624) | > loss_disc_real_0: 0.23460353910923004 (0.1652262982880247) | > loss_disc_real_1: 0.25217950344085693 (0.2343217234673171) | > loss_disc_real_2: 0.23335319757461548 (0.22595545572453532) | > loss_disc_real_3: 0.2334258258342743 (0.239841024102322) | > loss_disc_real_4: 0.2851874530315399 (0.2334600374231051) | > loss_disc_real_5: 0.2706240117549896 (0.22731787981144314) | > loss_0: 2.9837546348571777 (2.5814258106823624) | > grad_norm_0: tensor(497.0888, device='cuda:0') (tensor(732.5731, device='cuda:0')) | > loss_gen: 1.6698598861694336 (2.096741717437218) | > loss_kl: 0.865123987197876 (0.7951643610822743) | > loss_feat: 0.12207696586847305 (4.311420014192317) | > loss_mel: 3.4438300132751465 (18.609904272802943) | > loss_duration: 1.370442271232605 (1.3636057993461346) | > loss_1: 7.4713335037231445 (27.176836227548534) | > grad_norm_1: tensor(15150.4707, device='cuda:0') (tensor(15705.9287, device='cuda:0')) | > current_lr_0: 7.573623214356814e-05 | > current_lr_1: 7.573623214356814e-05 | > step_time: 0.3129 (0.5692376679387586) | > loader_time: 0.0017 (0.022817562366354054)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.146225929260254 (3.146225929260254) | > loss_disc_real_0: 0.5110880136489868 (0.5110880136489868) | > loss_disc_real_1: 0.2470257431268692 (0.2470257431268692) | > loss_disc_real_2: 0.3440955877304077 (0.3440955877304077) | > loss_disc_real_3: 0.37825316190719604 (0.37825316190719604) | > loss_disc_real_4: 0.3736376166343689 (0.3736376166343689) | > loss_disc_real_5: 0.3539058268070221 (0.3539058268070221) | > loss_0: 3.146225929260254 (3.146225929260254) | > loss_gen: 2.8788862228393555 (2.8788862228393555) | > loss_kl: 5.6769208908081055 (5.6769208908081055) | > loss_feat: 4.957592487335205 (4.957592487335205) | > loss_mel: 20.67582893371582 (20.67582893371582) | > loss_duration: 3.0627787113189697 (3.0627787113189697) | > loss_1: 37.25200653076172 (37.25200653076172)  --> STEP: 1 | > loss_disc: 2.4922890663146973 (2.4922890663146973) | > loss_disc_real_0: 0.1802358478307724 (0.1802358478307724) | > loss_disc_real_1: 0.189535453915596 (0.189535453915596) | > loss_disc_real_2: 0.206434965133667 (0.206434965133667) | > loss_disc_real_3: 0.3060300648212433 (0.3060300648212433) | > loss_disc_real_4: 0.25868701934814453 (0.25868701934814453) | > loss_disc_real_5: 0.24821478128433228 (0.24821478128433228) | > loss_0: 2.4922890663146973 (2.4922890663146973) | > loss_gen: 2.6564230918884277 (2.6564230918884277) | > loss_kl: 4.398325443267822 (4.398325443267822) | > loss_feat: 5.567408084869385 (5.567408084869385) | > loss_mel: 21.435935974121094 (21.435935974121094) | > loss_duration: 3.455183506011963 (3.455183506011963) | > loss_1: 37.513275146484375 (37.513275146484375)  --> STEP: 2 | > loss_disc: 2.7962265014648438 (2.6442577838897705) | > loss_disc_real_0: 0.3078952133655548 (0.2440655305981636) | > loss_disc_real_1: 0.29698869585990906 (0.24326207488775253) | > loss_disc_real_2: 0.26812025904655457 (0.23727761209011078) | > loss_disc_real_3: 0.20733541250228882 (0.25668273866176605) | > loss_disc_real_4: 0.1955472230911255 (0.227117121219635) | > loss_disc_real_5: 0.22199241816997528 (0.23510359972715378) | > loss_0: 2.7962265014648438 (2.6442577838897705) | > loss_gen: 2.033996343612671 (2.3452097177505493) | > loss_kl: 5.5323486328125 (4.965337038040161) | > loss_feat: 5.383295059204102 (5.475351572036743) | > loss_mel: 23.892330169677734 (22.664133071899414) | > loss_duration: 3.2776246070861816 (3.3664040565490723) | > loss_1: 40.119598388671875 (38.816436767578125)  --> STEP: 3 | > loss_disc: 2.896758556365967 (2.7284247080485025) | > loss_disc_real_0: 0.15315303206443787 (0.21376136442025503) | > loss_disc_real_1: 0.32611265778541565 (0.27087893585364026) | > loss_disc_real_2: 0.2751879096031189 (0.24991437792778015) | > loss_disc_real_3: 0.37256813049316406 (0.29531120260556537) | > loss_disc_real_4: 0.36155301332473755 (0.2719290852546692) | > loss_disc_real_5: 0.384427547454834 (0.28487824896971387) | > loss_0: 2.896758556365967 (2.7284247080485025) | > loss_gen: 2.2410361766815186 (2.3104852040608725) | > loss_kl: 2.2480127811431885 (4.05956228574117) | > loss_feat: 3.079310178756714 (4.676671107610066) | > loss_mel: 18.852022171020508 (21.393429438273113) | > loss_duration: 3.1204397678375244 (3.2844159603118896) | > loss_1: 29.54081916809082 (35.72456423441569) --> EVAL PERFORMANCE | > avg_loader_time: 0.009956995646158854 (-0.014504750569661459) | > avg_loss_disc: 2.7284247080485025 (+0.039046208063761245) | > avg_loss_disc_real_0: 0.21376136442025503 (-0.035132949550946535) | > avg_loss_disc_real_1: 0.27087893585364026 (+0.03206286331017813) | > avg_loss_disc_real_2: 0.24991437792778015 (-0.02128248910109204) | > avg_loss_disc_real_3: 0.29531120260556537 (-0.046759580572446224) | > avg_loss_disc_real_4: 0.2719290852546692 (-0.01983383297920227) | > avg_loss_disc_real_5: 0.28487824896971387 (-0.04473594327767688) | > avg_loss_0: 2.7284247080485025 (+0.039046208063761245) | > avg_loss_gen: 2.3104852040608725 (-0.13864425818125392) | > avg_loss_kl: 4.05956228574117 (-0.21834135055541992) | > avg_loss_feat: 4.676671107610066 (-0.5479276577631635) | > avg_loss_mel: 21.393429438273113 (-0.09397157033284387) | > avg_loss_duration: 3.2844159603118896 (+0.09053889910380031) | > avg_loss_1: 35.72456423441569 (-0.9083442687988281)  > EPOCH: 972/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:54:47)   --> TIME: 2023-10-20 11:54:58 -- STEP: 9/50 -- GLOBAL_STEP: 101610 | > loss_disc: 3.0233314037323 (2.316936877038744) | > loss_disc_real_0: 0.319957971572876 (0.10118144274585777) | > loss_disc_real_1: 0.2724441885948181 (0.20562672320132455) | > loss_disc_real_2: 0.24719369411468506 (0.21105760542882812) | > loss_disc_real_3: 0.25429481267929077 (0.23553630813128418) | > loss_disc_real_4: 0.21482113003730774 (0.22182058915495872) | > loss_disc_real_5: 0.34471166133880615 (0.2314882574396001) | > loss_0: 3.0233314037323 (2.316936877038744) | > grad_norm_0: tensor(484.6400, device='cuda:0') (tensor(574.2584, device='cuda:0')) | > loss_gen: 1.6467524766921997 (2.4104664590623646) | > loss_kl: 0.8201611638069153 (0.7960506247149574) | > loss_feat: 0.03986642137169838 (6.542564018319051) | > loss_mel: 1.9786862134933472 (20.434689508544075) | > loss_duration: 1.3322640657424927 (1.3767513036727905) | > loss_1: 5.81773042678833 (31.56052276823256) | > grad_norm_1: tensor(19201.8145, device='cuda:0') (tensor(17928.2715, device='cuda:0')) | > current_lr_0: 7.566052903774377e-05 | > current_lr_1: 7.566052903774377e-05 | > step_time: 0.5047 (0.4136720498402913) | > loader_time: 0.0111 (0.006983412636650933)  --> TIME: 2023-10-20 11:55:14 -- STEP: 39/50 -- GLOBAL_STEP: 101640 | > loss_disc: 2.185612916946411 (2.548613759187552) | > loss_disc_real_0: 0.17137524485588074 (0.16007182718469545) | > loss_disc_real_1: 0.23095113039016724 (0.23260638718373883) | > loss_disc_real_2: 0.10096907615661621 (0.23383623695908448) | > loss_disc_real_3: 0.22289063036441803 (0.2428258944493838) | > loss_disc_real_4: 0.22570671141147614 (0.23566411669628742) | > loss_disc_real_5: 0.22843217849731445 (0.2512520715976373) | > loss_0: 2.185612916946411 (2.548613759187552) | > grad_norm_0: tensor(480.9548, device='cuda:0') (tensor(641.7025, device='cuda:0')) | > loss_gen: 2.312880754470825 (2.2874018656901822) | > loss_kl: 0.9462966322898865 (0.7919233846358764) | > loss_feat: 4.704316139221191 (5.655155181980286) | > loss_mel: 20.81603240966797 (20.428588054119007) | > loss_duration: 1.4034056663513184 (1.3540309147957041) | > loss_1: 30.182931900024414 (30.517099612798447) | > grad_norm_1: tensor(28206.2559, device='cuda:0') (tensor(18314.4727, device='cuda:0')) | > current_lr_0: 7.566052903774377e-05 | > current_lr_1: 7.566052903774377e-05 | > step_time: 0.267 (0.48934647364494127) | > loader_time: 0.0029 (0.007649354445628631)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4244072437286377 (2.4244072437286377) | > loss_disc_real_0: 0.12569653987884521 (0.12569653987884521) | > loss_disc_real_1: 0.282304584980011 (0.282304584980011) | > loss_disc_real_2: 0.20787495374679565 (0.20787495374679565) | > loss_disc_real_3: 0.24085697531700134 (0.24085697531700134) | > loss_disc_real_4: 0.20155079662799835 (0.20155079662799835) | > loss_disc_real_5: 0.1010395884513855 (0.1010395884513855) | > loss_0: 2.4244072437286377 (2.4244072437286377) | > loss_gen: 2.1194300651550293 (2.1194300651550293) | > loss_kl: 5.0956711769104 (5.0956711769104) | > loss_feat: 8.686996459960938 (8.686996459960938) | > loss_mel: 23.122753143310547 (23.122753143310547) | > loss_duration: 3.114591121673584 (3.114591121673584) | > loss_1: 42.13943862915039 (42.13943862915039)  --> STEP: 1 | > loss_disc: 2.4521560668945312 (2.4521560668945312) | > loss_disc_real_0: 0.23479074239730835 (0.23479074239730835) | > loss_disc_real_1: 0.23209214210510254 (0.23209214210510254) | > loss_disc_real_2: 0.23125237226486206 (0.23125237226486206) | > loss_disc_real_3: 0.17695754766464233 (0.17695754766464233) | > loss_disc_real_4: 0.12461606413125992 (0.12461606413125992) | > loss_disc_real_5: 0.13107962906360626 (0.13107962906360626) | > loss_0: 2.4521560668945312 (2.4521560668945312) | > loss_gen: 1.868454933166504 (1.868454933166504) | > loss_kl: 5.215526580810547 (5.215526580810547) | > loss_feat: 7.166779518127441 (7.166779518127441) | > loss_mel: 26.658910751342773 (26.658910751342773) | > loss_duration: 3.410515546798706 (3.410515546798706) | > loss_1: 44.320186614990234 (44.320186614990234)  --> STEP: 2 | > loss_disc: 1.702805519104004 (2.0774807929992676) | > loss_disc_real_0: 0.02550448291003704 (0.1301476126536727) | > loss_disc_real_1: 0.20493575930595398 (0.21851395070552826) | > loss_disc_real_2: 0.19733059406280518 (0.21429148316383362) | > loss_disc_real_3: 0.14396749436855316 (0.16046252101659775) | > loss_disc_real_4: 0.1405116617679596 (0.13256386294960976) | > loss_disc_real_5: 0.0745350569486618 (0.10280734300613403) | > loss_0: 1.702805519104004 (2.0774807929992676) | > loss_gen: 2.5210094451904297 (2.194732189178467) | > loss_kl: 5.026073455810547 (5.120800018310547) | > loss_feat: 8.369738578796387 (7.768259048461914) | > loss_mel: 24.114961624145508 (25.38693618774414) | > loss_duration: 3.1597771644592285 (3.2851463556289673) | > loss_1: 43.19156265258789 (43.75587463378906)  --> STEP: 3 | > loss_disc: 3.007246732711792 (2.3874027729034424) | > loss_disc_real_0: 0.22176367044448853 (0.16068629858394465) | > loss_disc_real_1: 0.2475687712430954 (0.22819889088471731) | > loss_disc_real_2: 0.2643919885158539 (0.23099165161450705) | > loss_disc_real_3: 0.23250555992126465 (0.18447686731815338) | > loss_disc_real_4: 0.25312861800193787 (0.17275211463371912) | > loss_disc_real_5: 0.24609966576099396 (0.15057145059108734) | > loss_0: 3.007246732711792 (2.3874027729034424) | > loss_gen: 1.4625695943832397 (1.9506779909133911) | > loss_kl: 2.3954765796661377 (4.212358872095744) | > loss_feat: 0.0505746454000473 (5.195697580774625) | > loss_mel: 2.1538031101226807 (17.642558495203655) | > loss_duration: 2.8461670875549316 (3.138819932937622) | > loss_1: 8.908591270446777 (32.140113512674965) --> EVAL PERFORMANCE | > avg_loader_time: 0.008692502975463867 (-0.0012644926706949864) | > avg_loss_disc: 2.3874027729034424 (-0.3410219351450601) | > avg_loss_disc_real_0: 0.16068629858394465 (-0.05307506583631039) | > avg_loss_disc_real_1: 0.22819889088471731 (-0.04268004496892294) | > avg_loss_disc_real_2: 0.23099165161450705 (-0.018922726313273103) | > avg_loss_disc_real_3: 0.18447686731815338 (-0.11083433528741199) | > avg_loss_disc_real_4: 0.17275211463371912 (-0.09917697062095007) | > avg_loss_disc_real_5: 0.15057145059108734 (-0.13430679837862652) | > avg_loss_0: 2.3874027729034424 (-0.3410219351450601) | > avg_loss_gen: 1.9506779909133911 (-0.35980721314748143) | > avg_loss_kl: 4.212358872095744 (+0.15279658635457416) | > avg_loss_feat: 5.195697580774625 (+0.5190264731645584) | > avg_loss_mel: 17.642558495203655 (-3.750870943069458) | > avg_loss_duration: 3.138819932937622 (-0.14559602737426758) | > avg_loss_1: 32.140113512674965 (-3.5844507217407227)  > EPOCH: 973/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:55:32)   --> TIME: 2023-10-20 11:55:49 -- STEP: 19/50 -- GLOBAL_STEP: 101670 | > loss_disc: 2.9683496952056885 (2.4470579184983907) | > loss_disc_real_0: 0.3399738669395447 (0.1568944351747632) | > loss_disc_real_1: 0.242656409740448 (0.2265389071483361) | > loss_disc_real_2: 0.24007689952850342 (0.22397023008057945) | > loss_disc_real_3: 0.28289949893951416 (0.2367010918494902) | > loss_disc_real_4: 0.26920729875564575 (0.22239156224225698) | > loss_disc_real_5: 0.275565505027771 (0.20922348354207843) | > loss_0: 2.9683496952056885 (2.4470579184983907) | > grad_norm_0: tensor(921.3642, device='cuda:0') (tensor(566.4464, device='cuda:0')) | > loss_gen: 1.7740306854248047 (2.338211599149202) | > loss_kl: 0.9994643926620483 (0.9247605988853856) | > loss_feat: 1.145098090171814 (4.9780795510466165) | > loss_mel: 18.445770263671875 (19.839283171452973) | > loss_duration: 1.420127034187317 (1.388953265390898) | > loss_1: 23.78449058532715 (29.469288047991302) | > grad_norm_1: tensor(4874.1011, device='cuda:0') (tensor(16521.0215, device='cuda:0')) | > current_lr_0: 7.558490160191337e-05 | > current_lr_1: 7.558490160191337e-05 | > step_time: 0.725 (0.6642856974350778) | > loader_time: 0.0249 (0.02282187813206723)  --> TIME: 2023-10-20 11:56:09 -- STEP: 49/50 -- GLOBAL_STEP: 101700 | > loss_disc: 1.9069814682006836 (2.4256374689997457) | > loss_disc_real_0: 0.055207498371601105 (0.15193005168468368) | > loss_disc_real_1: 0.1616542935371399 (0.21246707112509378) | > loss_disc_real_2: 0.1778266429901123 (0.22012371965208832) | > loss_disc_real_3: 0.17874222993850708 (0.22623643020586093) | > loss_disc_real_4: 0.07495102286338806 (0.2147752053427453) | > loss_disc_real_5: 0.13412995636463165 (0.21017784602483924) | > loss_0: 1.9069814682006836 (2.4256374689997457) | > grad_norm_0: tensor(580.8342, device='cuda:0') (tensor(558.3171, device='cuda:0')) | > loss_gen: 2.349534749984741 (2.304351159504482) | > loss_kl: 0.6804435849189758 (0.8114489767016196) | > loss_feat: 6.263603687286377 (5.434147851161507) | > loss_mel: 24.190025329589844 (20.015764560018262) | > loss_duration: 1.4649596214294434 (1.3513147660664149) | > loss_1: 34.94856643676758 (29.917027288553665) | > grad_norm_1: tensor(4818.3740, device='cuda:0') (tensor(20578.1406, device='cuda:0')) | > current_lr_0: 7.558490160191337e-05 | > current_lr_1: 7.558490160191337e-05 | > step_time: 0.4113 (0.6369523953418341) | > loader_time: 0.5598 (0.0313716713263064)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8674707412719727 (2.8674707412719727) | > loss_disc_real_0: 0.5037227869033813 (0.5037227869033813) | > loss_disc_real_1: 0.4141032099723816 (0.4141032099723816) | > loss_disc_real_2: 0.3243468403816223 (0.3243468403816223) | > loss_disc_real_3: 0.42749378085136414 (0.42749378085136414) | > loss_disc_real_4: 0.3375108540058136 (0.3375108540058136) | > loss_disc_real_5: 0.21009743213653564 (0.21009743213653564) | > loss_0: 2.8674707412719727 (2.8674707412719727) | > loss_gen: 3.196031093597412 (3.196031093597412) | > loss_kl: 5.306232929229736 (5.306232929229736) | > loss_feat: 6.077596187591553 (6.077596187591553) | > loss_mel: 25.00216293334961 (25.00216293334961) | > loss_duration: 3.071077585220337 (3.071077585220337) | > loss_1: 42.65310287475586 (42.65310287475586)  --> STEP: 1 | > loss_disc: 3.109208583831787 (3.109208583831787) | > loss_disc_real_0: 0.4231111407279968 (0.4231111407279968) | > loss_disc_real_1: 0.343575656414032 (0.343575656414032) | > loss_disc_real_2: 0.34580308198928833 (0.34580308198928833) | > loss_disc_real_3: 0.2907450795173645 (0.2907450795173645) | > loss_disc_real_4: 0.24679350852966309 (0.24679350852966309) | > loss_disc_real_5: 0.226087287068367 (0.226087287068367) | > loss_0: 3.109208583831787 (3.109208583831787) | > loss_gen: 2.0946455001831055 (2.0946455001831055) | > loss_kl: 5.006928443908691 (5.006928443908691) | > loss_feat: 1.9019936323165894 (1.9019936323165894) | > loss_mel: 20.74771499633789 (20.74771499633789) | > loss_duration: 3.3446106910705566 (3.3446106910705566) | > loss_1: 33.09589385986328 (33.09589385986328)  --> STEP: 2 | > loss_disc: 2.994603157043457 (3.051905870437622) | > loss_disc_real_0: 0.26646506786346436 (0.3447881042957306) | > loss_disc_real_1: 0.27336737513542175 (0.30847151577472687) | > loss_disc_real_2: 0.25684335827827454 (0.30132322013378143) | > loss_disc_real_3: 0.29376235604286194 (0.2922537177801132) | > loss_disc_real_4: 0.29315823316574097 (0.269975870847702) | > loss_disc_real_5: 0.24945588409900665 (0.23777158558368683) | > loss_0: 2.994603157043457 (3.051905870437622) | > loss_gen: 1.6484391689300537 (1.8715423345565796) | > loss_kl: 5.909836292266846 (5.4583823680877686) | > loss_feat: 0.054366905242204666 (0.978180268779397) | > loss_mel: 2.039332866668701 (11.393523931503296) | > loss_duration: 3.163752794265747 (3.254181742668152) | > loss_1: 12.815728187561035 (22.955811023712158)  --> STEP: 3 | > loss_disc: 3.0309407711029053 (3.0449175039927163) | > loss_disc_real_0: 0.1605423241853714 (0.2833728442589442) | > loss_disc_real_1: 0.4555029273033142 (0.357481986284256) | > loss_disc_real_2: 0.5097049474716187 (0.3707837959130605) | > loss_disc_real_3: 0.2799358665943146 (0.288147767384847) | > loss_disc_real_4: 0.26550090312957764 (0.2684842149416606) | > loss_disc_real_5: 0.2552158832550049 (0.2435863514741262) | > loss_0: 3.0309407711029053 (3.0449175039927163) | > loss_gen: 2.4185595512390137 (2.0538814067840576) | > loss_kl: 2.5370371341705322 (4.4846006234486895) | > loss_feat: 5.216625213623047 (2.390995250393947) | > loss_mel: 23.278444290161133 (15.355164051055908) | > loss_duration: 2.9973456859588623 (3.168569723765055) | > loss_1: 36.4480094909668 (27.45321051279704) --> EVAL PERFORMANCE | > avg_loader_time: 0.009764512379964193 (+0.001072009404500326) | > avg_loss_disc: 3.0449175039927163 (+0.6575147310892739) | > avg_loss_disc_real_0: 0.2833728442589442 (+0.12268654567499956) | > avg_loss_disc_real_1: 0.357481986284256 (+0.12928309539953867) | > avg_loss_disc_real_2: 0.3707837959130605 (+0.13979214429855344) | > avg_loss_disc_real_3: 0.288147767384847 (+0.1036709000666936) | > avg_loss_disc_real_4: 0.2684842149416606 (+0.09573210030794146) | > avg_loss_disc_real_5: 0.2435863514741262 (+0.09301490088303885) | > avg_loss_0: 3.0449175039927163 (+0.6575147310892739) | > avg_loss_gen: 2.0538814067840576 (+0.1032034158706665) | > avg_loss_kl: 4.4846006234486895 (+0.27224175135294537) | > avg_loss_feat: 2.390995250393947 (-2.8047023303806777) | > avg_loss_mel: 15.355164051055908 (-2.287394444147747) | > avg_loss_duration: 3.168569723765055 (+0.02974979082743312) | > avg_loss_1: 27.45321051279704 (-4.686902999877926)  > EPOCH: 974/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:56:23)   --> TIME: 2023-10-20 11:56:45 -- STEP: 29/50 -- GLOBAL_STEP: 101730 | > loss_disc: 2.476496458053589 (2.421025950333169) | > loss_disc_real_0: 0.03128143027424812 (0.1396552007003077) | > loss_disc_real_1: 0.49410781264305115 (0.24496423042026058) | > loss_disc_real_2: 0.1855180412530899 (0.2272280584378489) | > loss_disc_real_3: 0.35426920652389526 (0.2503662307200761) | > loss_disc_real_4: 0.29283562302589417 (0.21572276037828675) | > loss_disc_real_5: 0.10816863924264908 (0.20520589487819835) | > loss_0: 2.476496458053589 (2.421025950333169) | > grad_norm_0: tensor(704.6484, device='cuda:0') (tensor(609.0096, device='cuda:0')) | > loss_gen: 2.561340093612671 (2.323610860725929) | > loss_kl: 0.9080368876457214 (0.8404839192998821) | > loss_feat: 7.697136878967285 (5.454470242020385) | > loss_mel: 23.026742935180664 (20.76313015510296) | > loss_duration: 1.3239973783493042 (1.356966125554052) | > loss_1: 35.51725387573242 (30.73866130565775) | > grad_norm_1: tensor(17223.4473, device='cuda:0') (tensor(17734.2246, device='cuda:0')) | > current_lr_0: 7.550934976044006e-05 | > current_lr_1: 7.550934976044006e-05 | > step_time: 0.3683 (0.5532213079518286) | > loader_time: 0.0229 (0.023156979988361227)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0909814834594727 (3.0909814834594727) | > loss_disc_real_0: 0.4713856875896454 (0.4713856875896454) | > loss_disc_real_1: 0.3545856475830078 (0.3545856475830078) | > loss_disc_real_2: 0.31582245230674744 (0.31582245230674744) | > loss_disc_real_3: 0.33462631702423096 (0.33462631702423096) | > loss_disc_real_4: 0.3832278549671173 (0.3832278549671173) | > loss_disc_real_5: 0.4943753778934479 (0.4943753778934479) | > loss_0: 3.0909814834594727 (3.0909814834594727) | > loss_gen: 2.7322070598602295 (2.7322070598602295) | > loss_kl: 6.046289443969727 (6.046289443969727) | > loss_feat: 4.236046314239502 (4.236046314239502) | > loss_mel: 20.352487564086914 (20.352487564086914) | > loss_duration: 3.0583484172821045 (3.0583484172821045) | > loss_1: 36.42538070678711 (36.42538070678711)  --> STEP: 1 | > loss_disc: 2.8287816047668457 (2.8287816047668457) | > loss_disc_real_0: 0.2105221152305603 (0.2105221152305603) | > loss_disc_real_1: 0.34999319911003113 (0.34999319911003113) | > loss_disc_real_2: 0.32914188504219055 (0.32914188504219055) | > loss_disc_real_3: 0.2809181213378906 (0.2809181213378906) | > loss_disc_real_4: 0.28944480419158936 (0.28944480419158936) | > loss_disc_real_5: 0.4358811676502228 (0.4358811676502228) | > loss_0: 2.8287816047668457 (2.8287816047668457) | > loss_gen: 2.3817458152770996 (2.3817458152770996) | > loss_kl: 5.706188678741455 (5.706188678741455) | > loss_feat: 4.193084239959717 (4.193084239959717) | > loss_mel: 24.67453956604004 (24.67453956604004) | > loss_duration: 3.4635658264160156 (3.4635658264160156) | > loss_1: 40.419124603271484 (40.419124603271484)  --> STEP: 2 | > loss_disc: 3.070077419281006 (2.949429512023926) | > loss_disc_real_0: 0.20585854351520538 (0.20819032937288284) | > loss_disc_real_1: 0.35980501770973206 (0.3548991084098816) | > loss_disc_real_2: 0.16565875709056854 (0.24740032106637955) | > loss_disc_real_3: 0.2398361712694168 (0.2603771463036537) | > loss_disc_real_4: 0.1781536042690277 (0.23379920423030853) | > loss_disc_real_5: 0.30990251898765564 (0.3728918433189392) | > loss_0: 3.070077419281006 (2.949429512023926) | > loss_gen: 1.5592007637023926 (1.970473289489746) | > loss_kl: 5.627749443054199 (5.666969060897827) | > loss_feat: 7.73484468460083 (5.963964462280273) | > loss_mel: 25.698171615600586 (25.186355590820312) | > loss_duration: 3.2545273303985596 (3.3590465784072876) | > loss_1: 43.87449645996094 (42.14681053161621)  --> STEP: 3 | > loss_disc: 2.5148749351501465 (2.8045779863993325) | > loss_disc_real_0: 0.05908337980508804 (0.15848801285028458) | > loss_disc_real_1: 0.4278116524219513 (0.37920328974723816) | > loss_disc_real_2: 0.25716254115104675 (0.2506543944279353) | > loss_disc_real_3: 0.3516501486301422 (0.2908014804124832) | > loss_disc_real_4: 0.395580917596817 (0.2877264420191447) | > loss_disc_real_5: 0.423683226108551 (0.3898223042488098) | > loss_0: 2.5148749351501465 (2.8045779863993325) | > loss_gen: 3.0779640674591064 (2.3396368821461997) | > loss_kl: 2.7119808197021484 (4.681972980499268) | > loss_feat: 5.462950229644775 (5.7969597180684405) | > loss_mel: 20.829627990722656 (23.734113057454426) | > loss_duration: 3.0296247005462646 (3.2492392857869468) | > loss_1: 35.11214828491211 (39.80192311604818) --> EVAL PERFORMANCE | > avg_loader_time: 0.029197136561075848 (+0.019432624181111656) | > avg_loss_disc: 2.8045779863993325 (-0.2403395175933838) | > avg_loss_disc_real_0: 0.15848801285028458 (-0.12488483140865964) | > avg_loss_disc_real_1: 0.37920328974723816 (+0.021721303462982178) | > avg_loss_disc_real_2: 0.2506543944279353 (-0.12012940148512519) | > avg_loss_disc_real_3: 0.2908014804124832 (+0.0026537130276362286) | > avg_loss_disc_real_4: 0.2877264420191447 (+0.01924222707748413) | > avg_loss_disc_real_5: 0.3898223042488098 (+0.14623595277468363) | > avg_loss_0: 2.8045779863993325 (-0.2403395175933838) | > avg_loss_gen: 2.3396368821461997 (+0.2857554753621421) | > avg_loss_kl: 4.681972980499268 (+0.1973723570505781) | > avg_loss_feat: 5.7969597180684405 (+3.4059644676744933) | > avg_loss_mel: 23.734113057454426 (+8.378949006398518) | > avg_loss_duration: 3.2492392857869468 (+0.08066956202189157) | > avg_loss_1: 39.80192311604818 (+12.34871260325114)  > EPOCH: 975/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:57:06)   --> TIME: 2023-10-20 11:57:17 -- STEP: 9/50 -- GLOBAL_STEP: 101760 | > loss_disc: 2.8468470573425293 (2.676075405544705) | > loss_disc_real_0: 0.24479372799396515 (0.19357545673847198) | > loss_disc_real_1: 0.24522189795970917 (0.24070844385359022) | > loss_disc_real_2: 0.22084884345531464 (0.2205833685066965) | > loss_disc_real_3: 0.26116496324539185 (0.24460178116957346) | > loss_disc_real_4: 0.2809356153011322 (0.25777530256244874) | > loss_disc_real_5: 0.2965858280658722 (0.2972242683172226) | > loss_0: 2.8468470573425293 (2.676075405544705) | > grad_norm_0: tensor(781.9233, device='cuda:0') (tensor(652.4676, device='cuda:0')) | > loss_gen: 1.7724511623382568 (2.023601386282179) | > loss_kl: 0.6314053535461426 (0.6596425374348959) | > loss_feat: 0.9341367483139038 (3.7180312615301876) | > loss_mel: 16.84748077392578 (16.702537881003487) | > loss_duration: 1.313472867012024 (1.3691535658306546) | > loss_1: 21.498947143554688 (24.47296667098999) | > grad_norm_1: tensor(3424.7400, device='cuda:0') (tensor(26458.6953, device='cuda:0')) | > current_lr_0: 7.543387343776257e-05 | > current_lr_1: 7.543387343776257e-05 | > step_time: 0.6325 (0.6324040095011393) | > loader_time: 0.0284 (0.025541199578179255)  --> TIME: 2023-10-20 11:57:33 -- STEP: 39/50 -- GLOBAL_STEP: 101790 | > loss_disc: 2.363410234451294 (2.4765516244448147) | > loss_disc_real_0: 0.01706899330019951 (0.16159687955410054) | > loss_disc_real_1: 0.3442518413066864 (0.22691921717845476) | > loss_disc_real_2: 0.3009061813354492 (0.21415496254578614) | > loss_disc_real_3: 0.22330071032047272 (0.2300975949336321) | > loss_disc_real_4: 0.34821367263793945 (0.23753031180837217) | > loss_disc_real_5: 0.27028459310531616 (0.240346707833501) | > loss_0: 2.363410234451294 (2.4765516244448147) | > grad_norm_0: tensor(745.1928, device='cuda:0') (tensor(658.0245, device='cuda:0')) | > loss_gen: 2.535653829574585 (2.266360802528186) | > loss_kl: 0.23001088201999664 (0.7763112573287427) | > loss_feat: 4.055760860443115 (5.248939875656595) | > loss_mel: 24.949798583984375 (20.1834414096979) | > loss_duration: 1.402834415435791 (1.3626913596422245) | > loss_1: 33.1740608215332 (29.837744798415745) | > grad_norm_1: tensor(5628.4355, device='cuda:0') (tensor(21516.8105, device='cuda:0')) | > current_lr_0: 7.543387343776257e-05 | > current_lr_1: 7.543387343776257e-05 | > step_time: 0.3327 (0.5403826542389698) | > loader_time: 0.013 (0.01954502937121269)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.055271625518799 (3.055271625518799) | > loss_disc_real_0: 0.1897408664226532 (0.1897408664226532) | > loss_disc_real_1: 0.23975609242916107 (0.23975609242916107) | > loss_disc_real_2: 0.38077080249786377 (0.38077080249786377) | > loss_disc_real_3: 0.24799668788909912 (0.24799668788909912) | > loss_disc_real_4: 0.4283715486526489 (0.4283715486526489) | > loss_disc_real_5: 0.547497034072876 (0.547497034072876) | > loss_0: 3.055271625518799 (3.055271625518799) | > loss_gen: 2.298325300216675 (2.298325300216675) | > loss_kl: 6.459948539733887 (6.459948539733887) | > loss_feat: 5.313636302947998 (5.313636302947998) | > loss_mel: 22.364702224731445 (22.364702224731445) | > loss_duration: 3.0776407718658447 (3.0776407718658447) | > loss_1: 39.514251708984375 (39.514251708984375)  --> STEP: 1 | > loss_disc: 0.9018826484680176 (0.9018826484680176) | > loss_disc_real_0: 0.014164033345878124 (0.014164033345878124) | > loss_disc_real_1: 0.09276308119297028 (0.09276308119297028) | > loss_disc_real_2: 0.08207235485315323 (0.08207235485315323) | > loss_disc_real_3: 0.012244811281561852 (0.012244811281561852) | > loss_disc_real_4: 0.022456368431448936 (0.022456368431448936) | > loss_disc_real_5: 0.029304729774594307 (0.029304729774594307) | > loss_0: 0.9018826484680176 (0.9018826484680176) | > loss_gen: 3.0559921264648438 (3.0559921264648438) | > loss_kl: 5.148648738861084 (5.148648738861084) | > loss_feat: 16.845609664916992 (16.845609664916992) | > loss_mel: 28.362749099731445 (28.362749099731445) | > loss_duration: 3.3121848106384277 (3.3121848106384277) | > loss_1: 56.72518539428711 (56.72518539428711)  --> STEP: 2 | > loss_disc: 2.9619827270507812 (1.9319326877593994) | > loss_disc_real_0: 0.42377781867980957 (0.21897092601284385) | > loss_disc_real_1: 0.3039886951446533 (0.1983758881688118) | > loss_disc_real_2: 0.2992825210094452 (0.1906774379312992) | > loss_disc_real_3: 0.24928750097751617 (0.130766156129539) | > loss_disc_real_4: 0.2195175290107727 (0.12098694872111082) | > loss_disc_real_5: 0.20411169528961182 (0.11670821253210306) | > loss_0: 2.9619827270507812 (1.9319326877593994) | > loss_gen: 1.951232671737671 (2.5036123991012573) | > loss_kl: 5.4456868171691895 (5.297167778015137) | > loss_feat: 1.6008820533752441 (9.223245859146118) | > loss_mel: 25.93747329711914 (27.150111198425293) | > loss_duration: 3.175394296646118 (3.243789553642273) | > loss_1: 38.11067199707031 (47.41792869567871)  --> STEP: 3 | > loss_disc: 3.06198787689209 (2.3086177508036294) | > loss_disc_real_0: 0.4267462193965912 (0.28822935714075965) | > loss_disc_real_1: 0.32546478509902954 (0.2407388538122177) | > loss_disc_real_2: 0.3194259703159332 (0.23359361539284387) | > loss_disc_real_3: 0.2201780527830124 (0.16057012168069681) | > loss_disc_real_4: 0.45281437039375305 (0.23159608927865824) | > loss_disc_real_5: 0.45873355865478516 (0.23071666123966375) | > loss_0: 3.06198787689209 (2.3086177508036294) | > loss_gen: 2.6447243690490723 (2.550649722417196) | > loss_kl: 2.715219497680664 (4.4365183512369795) | > loss_feat: 5.109529495239258 (7.852007071177165) | > loss_mel: 27.65797996520996 (27.319400787353516) | > loss_duration: 2.9259233474731445 (3.137834151585897) | > loss_1: 41.053375244140625 (45.29641087849935) --> EVAL PERFORMANCE | > avg_loader_time: 0.004581451416015625 (-0.024615685145060223) | > avg_loss_disc: 2.3086177508036294 (-0.4959602355957031) | > avg_loss_disc_real_0: 0.28822935714075965 (+0.12974134429047507) | > avg_loss_disc_real_1: 0.2407388538122177 (-0.13846443593502045) | > avg_loss_disc_real_2: 0.23359361539284387 (-0.017060779035091428) | > avg_loss_disc_real_3: 0.16057012168069681 (-0.1302313587317864) | > avg_loss_disc_real_4: 0.23159608927865824 (-0.05613035274048647) | > avg_loss_disc_real_5: 0.23071666123966375 (-0.15910564300914606) | > avg_loss_0: 2.3086177508036294 (-0.4959602355957031) | > avg_loss_gen: 2.550649722417196 (+0.2110128402709961) | > avg_loss_kl: 4.4365183512369795 (-0.24545462926228812) | > avg_loss_feat: 7.852007071177165 (+2.0550473531087246) | > avg_loss_mel: 27.319400787353516 (+3.5852877298990897) | > avg_loss_duration: 3.137834151585897 (-0.1114051342010498) | > avg_loss_1: 45.29641087849935 (+5.494487762451172)  > EPOCH: 976/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:57:58)   --> TIME: 2023-10-20 11:58:17 -- STEP: 19/50 -- GLOBAL_STEP: 101820 | > loss_disc: 2.182224988937378 (2.4667323074842753) | > loss_disc_real_0: 0.036887042224407196 (0.1544889660650178) | > loss_disc_real_1: 0.18895065784454346 (0.21725358980658807) | > loss_disc_real_2: 0.21380715072155 (0.22429402143155275) | > loss_disc_real_3: 0.2832528054714203 (0.24532601237297058) | > loss_disc_real_4: 0.18771366775035858 (0.25316481762810755) | > loss_disc_real_5: 0.1740221530199051 (0.26553039860568545) | > loss_0: 2.182224988937378 (2.4667323074842753) | > grad_norm_0: tensor(587.9904, device='cuda:0') (tensor(473.5224, device='cuda:0')) | > loss_gen: 2.933885097503662 (2.3816796227505335) | > loss_kl: 0.9708080291748047 (0.9117260120416942) | > loss_feat: 10.90605640411377 (6.024614353321101) | > loss_mel: 24.87135124206543 (21.390973304447375) | > loss_duration: 1.471690058708191 (1.3867295290294446) | > loss_1: 41.15378952026367 (32.095723177257334) | > grad_norm_1: tensor(59794.7109, device='cuda:0') (tensor(20903.2773, device='cuda:0')) | > current_lr_0: 7.53584725583951e-05 | > current_lr_1: 7.53584725583951e-05 | > step_time: 0.6657 (0.603437298222592) | > loader_time: 0.0306 (0.02353482497365851)  --> TIME: 2023-10-20 11:58:33 -- STEP: 49/50 -- GLOBAL_STEP: 101850 | > loss_disc: 2.7564682960510254 (2.4773704300121384) | > loss_disc_real_0: 0.1259823590517044 (0.1541712898000771) | > loss_disc_real_1: 0.27927008271217346 (0.22269234935543974) | > loss_disc_real_2: 0.31815269589424133 (0.23308535564538777) | > loss_disc_real_3: 0.3307701647281647 (0.24104621709913623) | > loss_disc_real_4: 0.26606181263923645 (0.22922343095498426) | > loss_disc_real_5: 0.251198947429657 (0.2329102723041967) | > loss_0: 2.7564682960510254 (2.4773704300121384) | > grad_norm_0: tensor(443.5352, device='cuda:0') (tensor(514.5844, device='cuda:0')) | > loss_gen: 2.017129898071289 (2.2276424777751065) | > loss_kl: 0.2855677306652069 (0.7633157067228945) | > loss_feat: 1.7361984252929688 (5.241012187788681) | > loss_mel: 16.948673248291016 (19.858025701678528) | > loss_duration: 1.4756656885147095 (1.3517891752476594) | > loss_1: 22.46323585510254 (29.441785588556407) | > grad_norm_1: tensor(2070.2744, device='cuda:0') (tensor(19243.4082, device='cuda:0')) | > current_lr_0: 7.53584725583951e-05 | > current_lr_1: 7.53584725583951e-05 | > step_time: 0.4975 (0.5457174534700356) | > loader_time: 0.4542 (0.0287900262949418)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8970086574554443 (2.8970086574554443) | > loss_disc_real_0: 0.21481941640377045 (0.21481941640377045) | > loss_disc_real_1: 0.23718224465847015 (0.23718224465847015) | > loss_disc_real_2: 0.26665034890174866 (0.26665034890174866) | > loss_disc_real_3: 0.2481151670217514 (0.2481151670217514) | > loss_disc_real_4: 0.2519266903400421 (0.2519266903400421) | > loss_disc_real_5: 0.2485625147819519 (0.2485625147819519) | > loss_0: 2.8970086574554443 (2.8970086574554443) | > loss_gen: 1.5836702585220337 (1.5836702585220337) | > loss_kl: 5.182011127471924 (5.182011127471924) | > loss_feat: 0.26599302887916565 (0.26599302887916565) | > loss_mel: 13.06734561920166 (13.06734561920166) | > loss_duration: 3.1019504070281982 (3.1019504070281982) | > loss_1: 23.200969696044922 (23.200969696044922)  --> STEP: 1 | > loss_disc: 2.7694337368011475 (2.7694337368011475) | > loss_disc_real_0: 0.34365689754486084 (0.34365689754486084) | > loss_disc_real_1: 0.2386135309934616 (0.2386135309934616) | > loss_disc_real_2: 0.3757842779159546 (0.3757842779159546) | > loss_disc_real_3: 0.26587429642677307 (0.26587429642677307) | > loss_disc_real_4: 0.2795279920101166 (0.2795279920101166) | > loss_disc_real_5: 0.27193403244018555 (0.27193403244018555) | > loss_0: 2.7694337368011475 (2.7694337368011475) | > loss_gen: 2.499760866165161 (2.499760866165161) | > loss_kl: 4.789812088012695 (4.789812088012695) | > loss_feat: 2.589503765106201 (2.589503765106201) | > loss_mel: 20.036773681640625 (20.036773681640625) | > loss_duration: 3.3797640800476074 (3.3797640800476074) | > loss_1: 33.295616149902344 (33.295616149902344)  --> STEP: 2 | > loss_disc: 2.904372215270996 (2.8369029760360718) | > loss_disc_real_0: 0.17129793763160706 (0.25747741758823395) | > loss_disc_real_1: 0.4037742018699646 (0.3211938664317131) | > loss_disc_real_2: 0.3977793753147125 (0.38678182661533356) | > loss_disc_real_3: 0.5159069299697876 (0.39089061319828033) | > loss_disc_real_4: 0.18902374804019928 (0.23427587002515793) | > loss_disc_real_5: 0.24132421612739563 (0.2566291242837906) | > loss_0: 2.904372215270996 (2.8369029760360718) | > loss_gen: 2.550583600997925 (2.525172233581543) | > loss_kl: 5.507561206817627 (5.148686647415161) | > loss_feat: 6.488639831542969 (4.539071798324585) | > loss_mel: 21.25331687927246 (20.645045280456543) | > loss_duration: 3.349771738052368 (3.364767909049988) | > loss_1: 39.14987564086914 (36.22274589538574)  --> STEP: 3 | > loss_disc: 1.403506875038147 (2.35910427570343) | > loss_disc_real_0: 0.061378657817840576 (0.19211116433143616) | > loss_disc_real_1: 0.1272621899843216 (0.2565499742825826) | > loss_disc_real_2: 0.10243124514818192 (0.29199829945961636) | > loss_disc_real_3: 0.08877906203269958 (0.2901867628097534) | > loss_disc_real_4: 0.07718057185411453 (0.18191077063481012) | > loss_disc_real_5: 0.043518394231796265 (0.18559221426645914) | > loss_0: 1.403506875038147 (2.35910427570343) | > loss_gen: 2.866093158721924 (2.63881254196167) | > loss_kl: 2.715472936630249 (4.337615410486857) | > loss_feat: 9.667715072631836 (6.248619556427002) | > loss_mel: 24.019804000854492 (21.769964853922527) | > loss_duration: 2.921830177307129 (3.2171219984690347) | > loss_1: 42.190914154052734 (38.212135314941406) --> EVAL PERFORMANCE | > avg_loader_time: 0.010095596313476562 (+0.0055141448974609375) | > avg_loss_disc: 2.35910427570343 (+0.050486524899800767) | > avg_loss_disc_real_0: 0.19211116433143616 (-0.09611819280932349) | > avg_loss_disc_real_1: 0.2565499742825826 (+0.01581112047036487) | > avg_loss_disc_real_2: 0.29199829945961636 (+0.05840468406677249) | > avg_loss_disc_real_3: 0.2901867628097534 (+0.1296166411290566) | > avg_loss_disc_real_4: 0.18191077063481012 (-0.04968531864384812) | > avg_loss_disc_real_5: 0.18559221426645914 (-0.04512444697320461) | > avg_loss_0: 2.35910427570343 (+0.050486524899800767) | > avg_loss_gen: 2.63881254196167 (+0.08816281954447414) | > avg_loss_kl: 4.337615410486857 (-0.09890294075012207) | > avg_loss_feat: 6.248619556427002 (-1.603387514750163) | > avg_loss_mel: 21.769964853922527 (-5.549435933430988) | > avg_loss_duration: 3.2171219984690347 (+0.07928784688313772) | > avg_loss_1: 38.212135314941406 (-7.084275563557945)  > EPOCH: 977/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:58:50)   --> TIME: 2023-10-20 11:59:10 -- STEP: 29/50 -- GLOBAL_STEP: 101880 | > loss_disc: 2.4809045791625977 (2.4814178984740685) | > loss_disc_real_0: 0.17868876457214355 (0.15204653368684753) | > loss_disc_real_1: 0.2571035623550415 (0.23532547262208214) | > loss_disc_real_2: 0.23751595616340637 (0.23903004125017543) | > loss_disc_real_3: 0.19953486323356628 (0.2403272812351071) | > loss_disc_real_4: 0.2983056604862213 (0.2161995586136292) | > loss_disc_real_5: 0.21310383081436157 (0.21547922376414824) | > loss_0: 2.4809045791625977 (2.4814178984740685) | > grad_norm_0: tensor(290.5280, device='cuda:0') (tensor(689.2480, device='cuda:0')) | > loss_gen: 2.2123770713806152 (2.3465943665340037) | > loss_kl: 0.5461474061012268 (0.7394648718422857) | > loss_feat: 3.5412893295288086 (5.575642762512996) | > loss_mel: 20.271987915039062 (20.283214791067714) | > loss_duration: 1.3674358129501343 (1.365219420400159) | > loss_1: 27.939237594604492 (30.31013584136963) | > grad_norm_1: tensor(2573.1748, device='cuda:0') (tensor(21718.6016, device='cuda:0')) | > current_lr_0: 7.528314704692739e-05 | > current_lr_1: 7.528314704692739e-05 | > step_time: 0.6 (0.49594245285823435) | > loader_time: 0.0055 (0.013747782542787747)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.037026882171631 (3.037026882171631) | > loss_disc_real_0: 0.43956294655799866 (0.43956294655799866) | > loss_disc_real_1: 0.2535068094730377 (0.2535068094730377) | > loss_disc_real_2: 0.2144884616136551 (0.2144884616136551) | > loss_disc_real_3: 0.3657449781894684 (0.3657449781894684) | > loss_disc_real_4: 0.2776501178741455 (0.2776501178741455) | > loss_disc_real_5: 0.3821295499801636 (0.3821295499801636) | > loss_0: 3.037026882171631 (3.037026882171631) | > loss_gen: 2.3970425128936768 (2.3970425128936768) | > loss_kl: 5.945788383483887 (5.945788383483887) | > loss_feat: 5.382465839385986 (5.382465839385986) | > loss_mel: 22.95965003967285 (22.95965003967285) | > loss_duration: 3.1419482231140137 (3.1419482231140137) | > loss_1: 39.8268928527832 (39.8268928527832)  --> STEP: 1 | > loss_disc: 3.2315378189086914 (3.2315378189086914) | > loss_disc_real_0: 0.18996603786945343 (0.18996603786945343) | > loss_disc_real_1: 0.3500170409679413 (0.3500170409679413) | > loss_disc_real_2: 0.2251456081867218 (0.2251456081867218) | > loss_disc_real_3: 0.22311286628246307 (0.22311286628246307) | > loss_disc_real_4: 0.20848654210567474 (0.20848654210567474) | > loss_disc_real_5: 0.2716987431049347 (0.2716987431049347) | > loss_0: 3.2315378189086914 (3.2315378189086914) | > loss_gen: 1.7260346412658691 (1.7260346412658691) | > loss_kl: 5.128170967102051 (5.128170967102051) | > loss_feat: 4.423101425170898 (4.423101425170898) | > loss_mel: 23.148508071899414 (23.148508071899414) | > loss_duration: 3.5105268955230713 (3.5105268955230713) | > loss_1: 37.936344146728516 (37.936344146728516)  --> STEP: 2 | > loss_disc: 2.552299976348877 (2.891918897628784) | > loss_disc_real_0: 0.18237954378128052 (0.18617279082536697) | > loss_disc_real_1: 0.24361932277679443 (0.29681818187236786) | > loss_disc_real_2: 0.19058579206466675 (0.20786570012569427) | > loss_disc_real_3: 0.2071770876646042 (0.21514497697353363) | > loss_disc_real_4: 0.12773866951465607 (0.1681126058101654) | > loss_disc_real_5: 0.23166567087173462 (0.25168220698833466) | > loss_0: 2.552299976348877 (2.891918897628784) | > loss_gen: 2.1077771186828613 (1.9169058799743652) | > loss_kl: 5.206929683685303 (5.167550325393677) | > loss_feat: 9.391373634338379 (6.907237529754639) | > loss_mel: 25.751550674438477 (24.450029373168945) | > loss_duration: 3.2893781661987305 (3.399952530860901) | > loss_1: 45.74700927734375 (41.84167671203613)  --> STEP: 3 | > loss_disc: 2.9774768352508545 (2.920438210169474) | > loss_disc_real_0: 0.4104136824607849 (0.2609197547038396) | > loss_disc_real_1: 0.33326953649520874 (0.3089686334133148) | > loss_disc_real_2: 0.2927398085594177 (0.23615706960360208) | > loss_disc_real_3: 0.2583411931991577 (0.22954371571540833) | > loss_disc_real_4: 0.27588748931884766 (0.20403756697972616) | > loss_disc_real_5: 0.3021433651447296 (0.2685025930404663) | > loss_0: 2.9774768352508545 (2.920438210169474) | > loss_gen: 2.198415756225586 (2.010742505391439) | > loss_kl: 2.26286244392395 (4.199321031570435) | > loss_feat: 1.8228365182876587 (5.212437192598979) | > loss_mel: 19.85648536682129 (22.918848037719727) | > loss_duration: 3.040972948074341 (3.2802926699320474) | > loss_1: 29.18157386779785 (37.621642430623375) --> EVAL PERFORMANCE | > avg_loader_time: 0.005727529525756836 (-0.0043680667877197266) | > avg_loss_disc: 2.920438210169474 (+0.561333934466044) | > avg_loss_disc_real_0: 0.2609197547038396 (+0.06880859037240344) | > avg_loss_disc_real_1: 0.3089686334133148 (+0.05241865913073224) | > avg_loss_disc_real_2: 0.23615706960360208 (-0.05584122985601428) | > avg_loss_disc_real_3: 0.22954371571540833 (-0.06064304709434509) | > avg_loss_disc_real_4: 0.20403756697972616 (+0.022126796344916044) | > avg_loss_disc_real_5: 0.2685025930404663 (+0.08291037877400717) | > avg_loss_0: 2.920438210169474 (+0.561333934466044) | > avg_loss_gen: 2.010742505391439 (-0.628070036570231) | > avg_loss_kl: 4.199321031570435 (-0.13829437891642282) | > avg_loss_feat: 5.212437192598979 (-1.036182363828023) | > avg_loss_mel: 22.918848037719727 (+1.1488831837971993) | > avg_loss_duration: 3.2802926699320474 (+0.0631706714630127) | > avg_loss_1: 37.621642430623375 (-0.5904928843180315)  > EPOCH: 978/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 11:59:40)   --> TIME: 2023-10-20 11:59:50 -- STEP: 9/50 -- GLOBAL_STEP: 101910 | > loss_disc: 2.5952651500701904 (2.496001376046075) | > loss_disc_real_0: 0.11422006040811539 (0.1578773357388046) | > loss_disc_real_1: 0.31496596336364746 (0.22981537795729107) | > loss_disc_real_2: 0.33764615654945374 (0.2498961943719122) | > loss_disc_real_3: 0.32962313294410706 (0.2434563965847095) | > loss_disc_real_4: 0.3916741907596588 (0.21454245783388615) | > loss_disc_real_5: 0.2640550434589386 (0.20467058507104716) | > loss_0: 2.5952651500701904 (2.496001376046075) | > grad_norm_0: tensor(327.4748, device='cuda:0') (tensor(446.0828, device='cuda:0')) | > loss_gen: 2.597107172012329 (2.2824772463904486) | > loss_kl: 0.6464837193489075 (0.7600336533246769) | > loss_feat: 4.365952491760254 (5.855099468595451) | > loss_mel: 20.935691833496094 (19.886226389143204) | > loss_duration: 1.3192267417907715 (1.3527137570910983) | > loss_1: 29.86446189880371 (30.136549790700276) | > grad_norm_1: tensor(4272.5225, device='cuda:0') (tensor(27454.8691, device='cuda:0')) | > current_lr_0: 7.520789682802447e-05 | > current_lr_1: 7.520789682802447e-05 | > step_time: 0.5867 (0.600914822684394) | > loader_time: 0.0128 (0.02126116222805447)  --> TIME: 2023-10-20 12:00:11 -- STEP: 39/50 -- GLOBAL_STEP: 101940 | > loss_disc: 3.1203699111938477 (2.5239229477368874) | > loss_disc_real_0: 0.13679616153240204 (0.16724629898388416) | > loss_disc_real_1: 0.3472248315811157 (0.2422765148564791) | > loss_disc_real_2: 0.3998047709465027 (0.2310189406077067) | > loss_disc_real_3: 0.3456813395023346 (0.2341403084783218) | > loss_disc_real_4: 0.46807408332824707 (0.2327656913548708) | > loss_disc_real_5: 0.4453444480895996 (0.2507211768713135) | > loss_0: 3.1203699111938477 (2.5239229477368874) | > grad_norm_0: tensor(673.5441, device='cuda:0') (tensor(512.6016, device='cuda:0')) | > loss_gen: 2.6670684814453125 (2.286590481415773) | > loss_kl: 0.5968714356422424 (0.7887766833823079) | > loss_feat: 5.152055740356445 (5.601384813706271) | > loss_mel: 20.497398376464844 (20.313843210538227) | > loss_duration: 1.389716625213623 (1.3512800228901398) | > loss_1: 30.303112030029297 (30.341875271919445) | > grad_norm_1: tensor(22391.7148, device='cuda:0') (tensor(18952.4609, device='cuda:0')) | > current_lr_0: 7.520789682802447e-05 | > current_lr_1: 7.520789682802447e-05 | > step_time: 0.8219 (0.6344499282347851) | > loader_time: 0.0319 (0.025392526235335913)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1883723735809326 (2.1883723735809326) | > loss_disc_real_0: 0.20489326119422913 (0.20489326119422913) | > loss_disc_real_1: 0.08782454580068588 (0.08782454580068588) | > loss_disc_real_2: 0.18916243314743042 (0.18916243314743042) | > loss_disc_real_3: 0.11465343832969666 (0.11465343832969666) | > loss_disc_real_4: 0.06894047558307648 (0.06894047558307648) | > loss_disc_real_5: 0.06671470403671265 (0.06671470403671265) | > loss_0: 2.1883723735809326 (2.1883723735809326) | > loss_gen: 2.032097339630127 (2.032097339630127) | > loss_kl: 5.5073957443237305 (5.5073957443237305) | > loss_feat: 10.054649353027344 (10.054649353027344) | > loss_mel: 21.596574783325195 (21.596574783325195) | > loss_duration: 3.0918688774108887 (3.0918688774108887) | > loss_1: 42.28258514404297 (42.28258514404297)  --> STEP: 1 | > loss_disc: 2.0770084857940674 (2.0770084857940674) | > loss_disc_real_0: 0.1484936624765396 (0.1484936624765396) | > loss_disc_real_1: 0.1643706113100052 (0.1643706113100052) | > loss_disc_real_2: 0.2750878930091858 (0.2750878930091858) | > loss_disc_real_3: 0.16525417566299438 (0.16525417566299438) | > loss_disc_real_4: 0.19624796509742737 (0.19624796509742737) | > loss_disc_real_5: 0.18534067273139954 (0.18534067273139954) | > loss_0: 2.0770084857940674 (2.0770084857940674) | > loss_gen: 2.988102912902832 (2.988102912902832) | > loss_kl: 4.881309986114502 (4.881309986114502) | > loss_feat: 7.690606594085693 (7.690606594085693) | > loss_mel: 25.37293243408203 (25.37293243408203) | > loss_duration: 3.3635549545288086 (3.3635549545288086) | > loss_1: 44.296504974365234 (44.296504974365234)  --> STEP: 2 | > loss_disc: 2.6924777030944824 (2.384743094444275) | > loss_disc_real_0: 0.2019260972738266 (0.1752098798751831) | > loss_disc_real_1: 0.24074608087539673 (0.20255834609270096) | > loss_disc_real_2: 0.2916755676269531 (0.28338173031806946) | > loss_disc_real_3: 0.30983617901802063 (0.2375451773405075) | > loss_disc_real_4: 0.28821608424186707 (0.24223202466964722) | > loss_disc_real_5: 0.2573308050632477 (0.2213357388973236) | > loss_0: 2.6924777030944824 (2.384743094444275) | > loss_gen: 2.251434803009033 (2.6197688579559326) | > loss_kl: 5.237695693969727 (5.059502840042114) | > loss_feat: 3.7453219890594482 (5.717964291572571) | > loss_mel: 23.160480499267578 (24.266706466674805) | > loss_duration: 3.2053263187408447 (3.2844406366348267) | > loss_1: 37.600257873535156 (40.948381423950195)  --> STEP: 3 | > loss_disc: 1.8074970245361328 (2.1923277378082275) | > loss_disc_real_0: 0.07937855273485184 (0.14326610416173935) | > loss_disc_real_1: 0.15999014675617218 (0.18836894631385803) | > loss_disc_real_2: 0.15134073793888092 (0.23936806619167328) | > loss_disc_real_3: 0.2065349519252777 (0.2272084355354309) | > loss_disc_real_4: 0.19714416563510895 (0.22720273832480112) | > loss_disc_real_5: 0.22178782522678375 (0.221486434340477) | > loss_0: 1.8074970245361328 (2.1923277378082275) | > loss_gen: 3.0609326362609863 (2.7668234507242837) | > loss_kl: 2.3991363048553467 (4.172713994979858) | > loss_feat: 7.6015472412109375 (6.345825274785359) | > loss_mel: 26.89703941345215 (25.143484115600586) | > loss_duration: 3.0049004554748535 (3.191260576248169) | > loss_1: 42.963558197021484 (41.62010701497396) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024245580037434897 (-0.003302971522013346) | > avg_loss_disc: 2.1923277378082275 (-0.7281104723612466) | > avg_loss_disc_real_0: 0.14326610416173935 (-0.11765365054210025) | > avg_loss_disc_real_1: 0.18836894631385803 (-0.12059968709945679) | > avg_loss_disc_real_2: 0.23936806619167328 (+0.0032109965880711966) | > avg_loss_disc_real_3: 0.2272084355354309 (-0.002335280179977417) | > avg_loss_disc_real_4: 0.22720273832480112 (+0.023165171345074953) | > avg_loss_disc_real_5: 0.221486434340477 (-0.04701615869998932) | > avg_loss_0: 2.1923277378082275 (-0.7281104723612466) | > avg_loss_gen: 2.7668234507242837 (+0.7560809453328448) | > avg_loss_kl: 4.172713994979858 (-0.026607036590576172) | > avg_loss_feat: 6.345825274785359 (+1.1333880821863804) | > avg_loss_mel: 25.143484115600586 (+2.2246360778808594) | > avg_loss_duration: 3.191260576248169 (-0.08903209368387843) | > avg_loss_1: 41.62010701497396 (+3.998464584350586)  > EPOCH: 979/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:00:33)   --> TIME: 2023-10-20 12:00:50 -- STEP: 19/50 -- GLOBAL_STEP: 101970 | > loss_disc: 2.8202648162841797 (2.576151214147869) | > loss_disc_real_0: 0.3040922284126282 (0.1674677553145509) | > loss_disc_real_1: 0.23215115070343018 (0.2413816203020121) | > loss_disc_real_2: 0.3144793212413788 (0.24410999958452426) | > loss_disc_real_3: 0.2212313562631607 (0.2582309110776374) | > loss_disc_real_4: 0.2361295223236084 (0.23901561441782274) | > loss_disc_real_5: 0.27057501673698425 (0.22362454647296354) | > loss_0: 2.8202648162841797 (2.576151214147869) | > grad_norm_0: tensor(1130.5090, device='cuda:0') (tensor(534.4760, device='cuda:0')) | > loss_gen: 1.851841688156128 (2.170046197740655) | > loss_kl: 0.26061350107192993 (0.7088792292695296) | > loss_feat: 1.2054699659347534 (4.944986577488874) | > loss_mel: 18.23539924621582 (17.693259389776934) | > loss_duration: 1.4285720586776733 (1.363813368897689) | > loss_1: 22.981895446777344 (26.880984783172607) | > grad_norm_1: tensor(5716.6006, device='cuda:0') (tensor(26146.5547, device='cuda:0')) | > current_lr_0: 7.513272182642671e-05 | > current_lr_1: 7.513272182642671e-05 | > step_time: 0.3464 (0.6001326786844354) | > loader_time: 0.0034 (0.01766122014899003)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0687026977539062 (2.0687026977539062) | > loss_disc_real_0: 0.06440354138612747 (0.06440354138612747) | > loss_disc_real_1: 0.21549318730831146 (0.21549318730831146) | > loss_disc_real_2: 0.2890734374523163 (0.2890734374523163) | > loss_disc_real_3: 0.2396754026412964 (0.2396754026412964) | > loss_disc_real_4: 0.19358547031879425 (0.19358547031879425) | > loss_disc_real_5: 0.15991848707199097 (0.15991848707199097) | > loss_0: 2.0687026977539062 (2.0687026977539062) | > loss_gen: 2.510554790496826 (2.510554790496826) | > loss_kl: 5.38834285736084 (5.38834285736084) | > loss_feat: 9.682698249816895 (9.682698249816895) | > loss_mel: 22.837697982788086 (22.837697982788086) | > loss_duration: 2.9838600158691406 (2.9838600158691406) | > loss_1: 43.40315246582031 (43.40315246582031)  --> STEP: 1 | > loss_disc: 1.994285225868225 (1.994285225868225) | > loss_disc_real_0: 0.01934310980141163 (0.01934310980141163) | > loss_disc_real_1: 0.22730132937431335 (0.22730132937431335) | > loss_disc_real_2: 0.2724672555923462 (0.2724672555923462) | > loss_disc_real_3: 0.3008984625339508 (0.3008984625339508) | > loss_disc_real_4: 0.1619327813386917 (0.1619327813386917) | > loss_disc_real_5: 0.11844132840633392 (0.11844132840633392) | > loss_0: 1.994285225868225 (1.994285225868225) | > loss_gen: 2.5421864986419678 (2.5421864986419678) | > loss_kl: 5.032934665679932 (5.032934665679932) | > loss_feat: 7.461656093597412 (7.461656093597412) | > loss_mel: 23.268665313720703 (23.268665313720703) | > loss_duration: 3.3562347888946533 (3.3562347888946533) | > loss_1: 41.661678314208984 (41.661678314208984)  --> STEP: 2 | > loss_disc: 1.9473274946212769 (1.970806360244751) | > loss_disc_real_0: 0.10672914236783981 (0.06303612608462572) | > loss_disc_real_1: 0.1689249724149704 (0.19811315089464188) | > loss_disc_real_2: 0.21420201659202576 (0.24333463609218597) | > loss_disc_real_3: 0.2680217921733856 (0.2844601273536682) | > loss_disc_real_4: 0.0976373627781868 (0.12978507205843925) | > loss_disc_real_5: 0.053893160074949265 (0.0861672442406416) | > loss_0: 1.9473274946212769 (1.970806360244751) | > loss_gen: 2.2245984077453613 (2.3833924531936646) | > loss_kl: 5.620738983154297 (5.326836824417114) | > loss_feat: 8.330187797546387 (7.895921945571899) | > loss_mel: 25.77587127685547 (24.522268295288086) | > loss_duration: 3.1416993141174316 (3.2489670515060425) | > loss_1: 45.09309768676758 (43.37738800048828)  --> STEP: 3 | > loss_disc: 2.5986127853393555 (2.180075168609619) | > loss_disc_real_0: 0.22409433126449585 (0.11672219447791576) | > loss_disc_real_1: 0.2239057421684265 (0.20671068131923676) | > loss_disc_real_2: 0.21190516650676727 (0.23285814623037973) | > loss_disc_real_3: 0.2106374204158783 (0.2598525583744049) | > loss_disc_real_4: 0.21864771842956543 (0.15940595418214798) | > loss_disc_real_5: 0.21235699951648712 (0.12823049599925676) | > loss_0: 2.5986127853393555 (2.180075168609619) | > loss_gen: 2.009697675704956 (2.258827527364095) | > loss_kl: 2.665088176727295 (4.439587275187175) | > loss_feat: 4.0418500900268555 (6.611231327056885) | > loss_mel: 22.574304580688477 (23.872947057088215) | > loss_duration: 3.0039491653442383 (3.167294422785441) | > loss_1: 34.29488754272461 (40.34988784790039)  --> TIME: 2023-10-20 12:01:10 -- STEP: 49/50 -- GLOBAL_STEP: 102000 | > loss_disc: 2.8758668899536133 (2.4691688868464263) | > loss_disc_real_0: 0.07210810482501984 (0.14452309404708902) | > loss_disc_real_1: 0.150821715593338 (0.22570361683563311) | > loss_disc_real_2: 0.1352800875902176 (0.22523238182980188) | > loss_disc_real_3: 0.22720788419246674 (0.24093248315003457) | > loss_disc_real_4: 0.34247106313705444 (0.21770713626578145) | > loss_disc_real_5: 0.4327008128166199 (0.21393084636300194) | > loss_0: 2.8758668899536133 (2.4691688868464263) | > grad_norm_0: tensor(722.7107, device='cuda:0') (tensor(596.0194, device='cuda:0')) | > loss_gen: 1.9129598140716553 (2.226013351459892) | > loss_kl: 0.6083982586860657 (0.7566503493153319) | > loss_feat: 5.445544242858887 (5.457851407403239) | > loss_mel: 24.105897903442383 (19.072288408571364) | > loss_duration: 1.4687578678131104 (1.3515850402870957) | > loss_1: 33.54155731201172 (28.864388407493124) | > grad_norm_1: tensor(16425.1738, device='cuda:0') (tensor(20934.4297, device='cuda:0')) | > current_lr_0: 7.513272182642671e-05 | > current_lr_1: 7.513272182642671e-05 | > step_time: 1.0555 (0.4663084721078678) | > loader_time: 8.3144 (0.17902488611182388) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_102000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1811556816101074 (2.180345296859741) | > loss_disc_real_0: 0.01890847645699978 (0.09226876497268677) | > loss_disc_real_1: 0.3237616717815399 (0.23597342893481255) | > loss_disc_real_2: 0.20852528512477875 (0.2267749309539795) | > loss_disc_real_3: 0.3453719913959503 (0.28123241662979126) | > loss_disc_real_4: 0.25164613127708435 (0.18246599845588207) | > loss_disc_real_5: 0.15317665040493011 (0.1344670346006751) | > loss_0: 2.1811556816101074 (2.180345296859741) | > loss_gen: 2.5492758750915527 (2.3314396142959595) | > loss_kl: 5.337514877319336 (4.664069175720215) | > loss_feat: 8.226509094238281 (7.015050768852234) | > loss_mel: 22.14850616455078 (23.441836833953857) | > loss_duration: 2.9941248893737793 (3.1240020394325256) | > loss_1: 41.25593185424805 (40.576398849487305)  --> STEP: 1 | > loss_disc: 2.461185932159424 (2.2365134239196776) | > loss_disc_real_0: 0.11958607286214828 (0.09773222655057907) | > loss_disc_real_1: 0.290635883808136 (0.24690591990947724) | > loss_disc_real_2: 0.3418016731739044 (0.2497802793979645) | > loss_disc_real_3: 0.28190794587135315 (0.28136752247810365) | > loss_disc_real_4: 0.3251897394657135 (0.21101074665784836) | > loss_disc_real_5: 0.2768210172653198 (0.16293783113360405) | > loss_0: 2.461185932159424 (2.2365134239196776) | > loss_gen: 2.6237218379974365 (2.389896059036255) | > loss_kl: 4.944349765777588 (4.720125293731689) | > loss_feat: 6.68570613861084 (6.949181842803955) | > loss_mel: 22.930953979492188 (23.339660263061525) | > loss_duration: 3.300520658493042 (3.159305763244629) | > loss_1: 40.48525619506836 (40.558170318603516)  --> STEP: 2 | > loss_disc: 3.109002113342285 (2.3819282054901123) | > loss_disc_real_0: 0.4254588186740875 (0.1523533252378305) | > loss_disc_real_1: 0.2682255506515503 (0.2504591916998227) | > loss_disc_real_2: 0.25748056173324585 (0.25106365978717804) | > loss_disc_real_3: 0.27875304222106934 (0.2809317757685979) | > loss_disc_real_4: 0.2810741066932678 (0.22268797333041826) | > loss_disc_real_5: 0.2664386034011841 (0.18018795984486738) | > loss_0: 3.109002113342285 (2.3819282054901123) | > loss_gen: 1.8154181241989136 (2.2941497365633645) | > loss_kl: 5.767233848571777 (4.894643386205037) | > loss_feat: 0.717272937297821 (5.910530358552933) | > loss_mel: 20.48699188232422 (22.86421553293864) | > loss_duration: 3.1453444957733154 (3.156978885332743) | > loss_1: 31.932260513305664 (39.12051868438721)  --> STEP: 3 | > loss_disc: 3.145869731903076 (2.491062709263393) | > loss_disc_real_0: 0.034938935190439224 (0.135579840945346) | > loss_disc_real_1: 0.40047508478164673 (0.27189003356865477) | > loss_disc_real_2: 0.23269516229629517 (0.2484395887170519) | > loss_disc_real_3: 0.3921232223510742 (0.2968162681375231) | > loss_disc_real_4: 0.40244224667549133 (0.2483671552368573) | > loss_disc_real_5: 0.43098801374435425 (0.2160165389733655) | > loss_0: 3.145869731903076 (2.491062709263393) | > loss_gen: 2.0788235664367676 (2.263388855116708) | > loss_kl: 2.6345937252044678 (4.571779148919242) | > loss_feat: 5.804806232452393 (5.895426911967141) | > loss_mel: 22.880029678344727 (22.86647469656808) | > loss_duration: 3.0132951736450195 (3.1364526408059255) | > loss_1: 36.41154861450195 (38.73352296011789) --> EVAL PERFORMANCE | > avg_loader_time: 0.4901061739240374 (+0.4876816159202939) | > avg_loss_disc: 2.491062709263393 (+0.29873497145516525) | > avg_loss_disc_real_0: 0.135579840945346 (-0.007686263216393346) | > avg_loss_disc_real_1: 0.27189003356865477 (+0.08352108725479673) | > avg_loss_disc_real_2: 0.2484395887170519 (+0.009071522525378628) | > avg_loss_disc_real_3: 0.2968162681375231 (+0.06960783260209219) | > avg_loss_disc_real_4: 0.2483671552368573 (+0.021164416912056172) | > avg_loss_disc_real_5: 0.2160165389733655 (-0.0054698953671114825) | > avg_loss_0: 2.491062709263393 (+0.29873497145516525) | > avg_loss_gen: 2.263388855116708 (-0.5034345956075756) | > avg_loss_kl: 4.571779148919242 (+0.39906515393938324) | > avg_loss_feat: 5.895426911967141 (-0.450398362818218) | > avg_loss_mel: 22.86647469656808 (-2.277009419032506) | > avg_loss_duration: 3.1364526408059255 (-0.054807935442243494) | > avg_loss_1: 38.73352296011789 (-2.8865840548560726)  > EPOCH: 980/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:01:24)   --> TIME: 2023-10-20 12:01:47 -- STEP: 29/50 -- GLOBAL_STEP: 102030 | > loss_disc: 3.033018112182617 (2.3708654148825286) | > loss_disc_real_0: 0.38726064562797546 (0.15094393363286707) | > loss_disc_real_1: 0.2841360569000244 (0.209171950752879) | > loss_disc_real_2: 0.27797970175743103 (0.21268562844087338) | > loss_disc_real_3: 0.2609725594520569 (0.22701793947610363) | > loss_disc_real_4: 0.2664802372455597 (0.21520788851996947) | > loss_disc_real_5: 0.3139166533946991 (0.21935754596930127) | > loss_0: 3.033018112182617 (2.3708654148825286) | > grad_norm_0: tensor(573.1232, device='cuda:0') (tensor(635.2725, device='cuda:0')) | > loss_gen: 1.7714816331863403 (2.4571485601622483) | > loss_kl: 0.8223171830177307 (0.8262835751319754) | > loss_feat: 0.14804202318191528 (6.797327283641388) | > loss_mel: 4.592741012573242 (19.702883588856665) | > loss_duration: 1.3594284057617188 (1.3548970140259842) | > loss_1: 8.694009780883789 (31.13854013640305) | > grad_norm_1: tensor(14295.6807, device='cuda:0') (tensor(26394.1289, device='cuda:0')) | > current_lr_0: 7.50576219669497e-05 | > current_lr_1: 7.50576219669497e-05 | > step_time: 0.3637 (0.6070993933184397) | > loader_time: 0.0042 (0.022846221923828125)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4640753269195557 (2.4640753269195557) | > loss_disc_real_0: 0.1053772121667862 (0.1053772121667862) | > loss_disc_real_1: 0.22544114291667938 (0.22544114291667938) | > loss_disc_real_2: 0.19277289509773254 (0.19277289509773254) | > loss_disc_real_3: 0.22961436212062836 (0.22961436212062836) | > loss_disc_real_4: 0.3816232681274414 (0.3816232681274414) | > loss_disc_real_5: 0.43037575483322144 (0.43037575483322144) | > loss_0: 2.4640753269195557 (2.4640753269195557) | > loss_gen: 2.5483057498931885 (2.5483057498931885) | > loss_kl: 5.778165817260742 (5.778165817260742) | > loss_feat: 5.120968341827393 (5.120968341827393) | > loss_mel: 23.016061782836914 (23.016061782836914) | > loss_duration: 3.1534547805786133 (3.1534547805786133) | > loss_1: 39.6169548034668 (39.6169548034668)  --> STEP: 1 | > loss_disc: 2.656951665878296 (2.656951665878296) | > loss_disc_real_0: 0.1867063194513321 (0.1867063194513321) | > loss_disc_real_1: 0.24339313805103302 (0.24339313805103302) | > loss_disc_real_2: 0.26576271653175354 (0.26576271653175354) | > loss_disc_real_3: 0.2928886115550995 (0.2928886115550995) | > loss_disc_real_4: 0.27870479226112366 (0.27870479226112366) | > loss_disc_real_5: 0.2642238736152649 (0.2642238736152649) | > loss_0: 2.656951665878296 (2.656951665878296) | > loss_gen: 2.1509437561035156 (2.1509437561035156) | > loss_kl: 5.221238136291504 (5.221238136291504) | > loss_feat: 1.2884037494659424 (1.2884037494659424) | > loss_mel: 21.53158187866211 (21.53158187866211) | > loss_duration: 3.4346792697906494 (3.4346792697906494) | > loss_1: 33.62684631347656 (33.62684631347656)  --> STEP: 2 | > loss_disc: 2.968418836593628 (2.812685251235962) | > loss_disc_real_0: 0.1871376633644104 (0.18692199140787125) | > loss_disc_real_1: 0.2578687071800232 (0.2506309226155281) | > loss_disc_real_2: 0.3140742778778076 (0.2899184972047806) | > loss_disc_real_3: 0.2735213339328766 (0.28320497274398804) | > loss_disc_real_4: 0.2778242528438568 (0.27826452255249023) | > loss_disc_real_5: 0.26355457305908203 (0.26388922333717346) | > loss_0: 2.968418836593628 (2.812685251235962) | > loss_gen: 1.6176042556762695 (1.8842740058898926) | > loss_kl: 5.575699329376221 (5.398468732833862) | > loss_feat: 0.27786529064178467 (0.7831345200538635) | > loss_mel: 10.734992027282715 (16.133286952972412) | > loss_duration: 3.151257276535034 (3.292968273162842) | > loss_1: 21.357418060302734 (27.49213218688965)  --> STEP: 3 | > loss_disc: 2.933936834335327 (2.853102445602417) | > loss_disc_real_0: 0.11312688142061234 (0.16232362141211829) | > loss_disc_real_1: 0.3388980031013489 (0.2800532827774684) | > loss_disc_real_2: 0.20612742006778717 (0.2619881381591161) | > loss_disc_real_3: 0.39331284165382385 (0.3199075957139333) | > loss_disc_real_4: 0.30867964029312134 (0.2884028951327006) | > loss_disc_real_5: 0.2711717486381531 (0.2663167317708333) | > loss_0: 2.933936834335327 (2.853102445602417) | > loss_gen: 1.9379594326019287 (1.902169148127238) | > loss_kl: 2.523430347442627 (4.440122604370117) | > loss_feat: 4.805596351623535 (2.1239551305770874) | > loss_mel: 23.09500503540039 (18.45385964711507) | > loss_duration: 3.0691215991973877 (3.218352715174357) | > loss_1: 35.431114196777344 (30.13845952351888) --> EVAL PERFORMANCE | > avg_loader_time: 0.01611646016438802 (-0.4739897137596494) | > avg_loss_disc: 2.853102445602417 (+0.3620397363390242) | > avg_loss_disc_real_0: 0.16232362141211829 (+0.026743780466772282) | > avg_loss_disc_real_1: 0.2800532827774684 (+0.008163249208813617) | > avg_loss_disc_real_2: 0.2619881381591161 (+0.013548549442064184) | > avg_loss_disc_real_3: 0.3199075957139333 (+0.023091327576410192) | > avg_loss_disc_real_4: 0.2884028951327006 (+0.04003573989584333) | > avg_loss_disc_real_5: 0.2663167317708333 (+0.05030019279746781) | > avg_loss_0: 2.853102445602417 (+0.3620397363390242) | > avg_loss_gen: 1.902169148127238 (-0.36121970698947004) | > avg_loss_kl: 4.440122604370117 (-0.13165654454912445) | > avg_loss_feat: 2.1239551305770874 (-3.771471781390054) | > avg_loss_mel: 18.45385964711507 (-4.412615049453009) | > avg_loss_duration: 3.218352715174357 (+0.0819000743684315) | > avg_loss_1: 30.13845952351888 (-8.595063436599009)  > EPOCH: 981/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:02:18)   --> TIME: 2023-10-20 12:02:28 -- STEP: 9/50 -- GLOBAL_STEP: 102060 | > loss_disc: 2.9203989505767822 (2.4138217899534435) | > loss_disc_real_0: 0.1645956039428711 (0.1119217574596405) | > loss_disc_real_1: 0.22797565162181854 (0.2338411977721585) | > loss_disc_real_2: 0.22649410367012024 (0.2152695291572147) | > loss_disc_real_3: 0.2554735243320465 (0.22131681773397657) | > loss_disc_real_4: 0.28057950735092163 (0.2277321190469795) | > loss_disc_real_5: 0.25401049852371216 (0.32032142620947623) | > loss_0: 2.9203989505767822 (2.4138217899534435) | > grad_norm_0: tensor(588.5080, device='cuda:0') (tensor(452.3832, device='cuda:0')) | > loss_gen: 1.521161437034607 (2.314690762095981) | > loss_kl: 0.7290270924568176 (0.974959929784139) | > loss_feat: 0.28267014026641846 (5.234884407785204) | > loss_mel: 10.1437349319458 (19.38120110829671) | > loss_duration: 1.3397270441055298 (1.3708265357547336) | > loss_1: 14.01632022857666 (29.276562690734863) | > grad_norm_1: tensor(15478.5312, device='cuda:0') (tensor(18019.5664, device='cuda:0')) | > current_lr_0: 7.49825971744842e-05 | > current_lr_1: 7.49825971744842e-05 | > step_time: 0.4442 (0.6422894265916612) | > loader_time: 0.0231 (0.022701740264892578)  --> TIME: 2023-10-20 12:02:45 -- STEP: 39/50 -- GLOBAL_STEP: 102090 | > loss_disc: 2.431598424911499 (2.453520906277192) | > loss_disc_real_0: 0.16013553738594055 (0.14738533841684845) | > loss_disc_real_1: 0.18508380651474 (0.2171230091689489) | > loss_disc_real_2: 0.28959178924560547 (0.23007805158312505) | > loss_disc_real_3: 0.18817657232284546 (0.23051430227664801) | > loss_disc_real_4: 0.24584871530532837 (0.22642127281198135) | > loss_disc_real_5: 0.2002670019865036 (0.2454029907209751) | > loss_0: 2.431598424911499 (2.453520906277192) | > grad_norm_0: tensor(970.3949, device='cuda:0') (tensor(516.7878, device='cuda:0')) | > loss_gen: 2.345759153366089 (2.2518011728922525) | > loss_kl: 0.5401729941368103 (0.8236445142672613) | > loss_feat: 4.553226470947266 (5.206109790370251) | > loss_mel: 21.318145751953125 (20.996454798258267) | > loss_duration: 1.42324960231781 (1.3538516851571891) | > loss_1: 30.180553436279297 (30.63186168670655) | > grad_norm_1: tensor(5223.0923, device='cuda:0') (tensor(18252.6484, device='cuda:0')) | > current_lr_0: 7.49825971744842e-05 | > current_lr_1: 7.49825971744842e-05 | > step_time: 0.7421 (0.5721726784339316) | > loader_time: 0.0245 (0.0163882634578607)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.328529119491577 (2.328529119491577) | > loss_disc_real_0: 0.07961437106132507 (0.07961437106132507) | > loss_disc_real_1: 0.3195691406726837 (0.3195691406726837) | > loss_disc_real_2: 0.33799371123313904 (0.33799371123313904) | > loss_disc_real_3: 0.23380331695079803 (0.23380331695079803) | > loss_disc_real_4: 0.218552365899086 (0.218552365899086) | > loss_disc_real_5: 0.23496367037296295 (0.23496367037296295) | > loss_0: 2.328529119491577 (2.328529119491577) | > loss_gen: 2.7447221279144287 (2.7447221279144287) | > loss_kl: 4.399325847625732 (4.399325847625732) | > loss_feat: 9.684846878051758 (9.684846878051758) | > loss_mel: 23.014760971069336 (23.014760971069336) | > loss_duration: 3.0519886016845703 (3.0519886016845703) | > loss_1: 42.89564514160156 (42.89564514160156)  --> STEP: 1 | > loss_disc: 2.746783971786499 (2.746783971786499) | > loss_disc_real_0: 0.19596068561077118 (0.19596068561077118) | > loss_disc_real_1: 0.21757902204990387 (0.21757902204990387) | > loss_disc_real_2: 0.2866191864013672 (0.2866191864013672) | > loss_disc_real_3: 0.36384984850883484 (0.36384984850883484) | > loss_disc_real_4: 0.35020214319229126 (0.35020214319229126) | > loss_disc_real_5: 0.29800277948379517 (0.29800277948379517) | > loss_0: 2.746783971786499 (2.746783971786499) | > loss_gen: 2.5481278896331787 (2.5481278896331787) | > loss_kl: 5.044034957885742 (5.044034957885742) | > loss_feat: 7.563276767730713 (7.563276767730713) | > loss_mel: 25.20762825012207 (25.20762825012207) | > loss_duration: 3.408874273300171 (3.408874273300171) | > loss_1: 43.771942138671875 (43.771942138671875)  --> STEP: 2 | > loss_disc: 3.0338096618652344 (2.8902968168258667) | > loss_disc_real_0: 0.08896707743406296 (0.14246388152241707) | > loss_disc_real_1: 0.2791605293750763 (0.24836977571249008) | > loss_disc_real_2: 0.24579112231731415 (0.26620515435934067) | > loss_disc_real_3: 0.27163374423980713 (0.317741796374321) | > loss_disc_real_4: 0.26173293590545654 (0.3059675395488739) | > loss_disc_real_5: 0.25340157747268677 (0.27570217847824097) | > loss_0: 3.0338096618652344 (2.8902968168258667) | > loss_gen: 1.4366848468780518 (1.9924063682556152) | > loss_kl: 5.559150695800781 (5.301592826843262) | > loss_feat: 0.24346575140953064 (3.9033712595701218) | > loss_mel: 19.465988159179688 (22.33680820465088) | > loss_duration: 3.2021312713623047 (3.305502772331238) | > loss_1: 29.907421112060547 (36.83968162536621)  --> STEP: 3 | > loss_disc: 3.036391019821167 (2.938994884490967) | > loss_disc_real_0: 0.15067048370838165 (0.14519941558440527) | > loss_disc_real_1: 0.2663307785987854 (0.2543567766745885) | > loss_disc_real_2: 0.2501548230648041 (0.2608550439278285) | > loss_disc_real_3: 0.25783973932266235 (0.2977744440237681) | > loss_disc_real_4: 0.2614782154560089 (0.29113776485125226) | > loss_disc_real_5: 0.2519652843475342 (0.26778988043467206) | > loss_0: 3.036391019821167 (2.938994884490967) | > loss_gen: 1.4329746961593628 (1.805929144223531) | > loss_kl: 2.4336659908294678 (4.345617214838664) | > loss_feat: 0.05033774673938751 (2.6190267552932105) | > loss_mel: 2.202012300491333 (15.62520956993103) | > loss_duration: 2.9632139205932617 (3.191406488418579) | > loss_1: 9.082204818725586 (27.587189356486004) --> EVAL PERFORMANCE | > avg_loader_time: 0.015830596288045246 (-0.00028586387634277344) | > avg_loss_disc: 2.938994884490967 (+0.0858924388885498) | > avg_loss_disc_real_0: 0.14519941558440527 (-0.017124205827713013) | > avg_loss_disc_real_1: 0.2543567766745885 (-0.02569650610287988) | > avg_loss_disc_real_2: 0.2608550439278285 (-0.0011330942312876013) | > avg_loss_disc_real_3: 0.2977744440237681 (-0.022133151690165165) | > avg_loss_disc_real_4: 0.29113776485125226 (+0.0027348697185516357) | > avg_loss_disc_real_5: 0.26778988043467206 (+0.0014731486638387414) | > avg_loss_0: 2.938994884490967 (+0.0858924388885498) | > avg_loss_gen: 1.805929144223531 (-0.09624000390370702) | > avg_loss_kl: 4.345617214838664 (-0.09450538953145315) | > avg_loss_feat: 2.6190267552932105 (+0.4950716247161231) | > avg_loss_mel: 15.62520956993103 (-2.82865007718404) | > avg_loss_duration: 3.191406488418579 (-0.026946226755777847) | > avg_loss_1: 27.587189356486004 (-2.5512701670328752)  > EPOCH: 982/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:03:09)   --> TIME: 2023-10-20 12:03:22 -- STEP: 19/50 -- GLOBAL_STEP: 102120 | > loss_disc: 2.157580852508545 (2.287175178527832) | > loss_disc_real_0: 0.07754354178905487 (0.10507750393528688) | > loss_disc_real_1: 0.1735450178384781 (0.22795334242676435) | > loss_disc_real_2: 0.1874530166387558 (0.2358969273535829) | > loss_disc_real_3: 0.2593950927257538 (0.245259548880552) | > loss_disc_real_4: 0.2687096893787384 (0.22150873137932076) | > loss_disc_real_5: 0.37391936779022217 (0.19738336877995416) | > loss_0: 2.157580852508545 (2.287175178527832) | > grad_norm_0: tensor(248.2161, device='cuda:0') (tensor(544.3391, device='cuda:0')) | > loss_gen: 2.953669786453247 (2.491071148922569) | > loss_kl: 0.9053042531013489 (0.7398759800401565) | > loss_feat: 7.3931074142456055 (6.72955537234482) | > loss_mel: 22.33301544189453 (21.655643965068617) | > loss_duration: 1.3884280920028687 (1.3818464718366925) | > loss_1: 34.97352600097656 (32.99799279162758) | > grad_norm_1: tensor(14869.8125, device='cuda:0') (tensor(23534.2539, device='cuda:0')) | > current_lr_0: 7.490764737399602e-05 | > current_lr_1: 7.490764737399602e-05 | > step_time: 0.3263 (0.3618256794778924) | > loader_time: 0.0055 (0.008570796565005654)  --> TIME: 2023-10-20 12:03:34 -- STEP: 49/50 -- GLOBAL_STEP: 102150 | > loss_disc: 2.383841037750244 (2.4339417730058948) | > loss_disc_real_0: 0.11875614523887634 (0.1349985207982209) | > loss_disc_real_1: 0.3706929087638855 (0.22943073480713125) | > loss_disc_real_2: 0.19153019785881042 (0.22735982464284313) | > loss_disc_real_3: 0.31839534640312195 (0.24671104512348466) | > loss_disc_real_4: 0.15237957239151 (0.22444457028593337) | > loss_disc_real_5: 0.1584329754114151 (0.21171510599705637) | > loss_0: 2.383841037750244 (2.4339417730058948) | > grad_norm_0: tensor(565.5330, device='cuda:0') (tensor(581.2074, device='cuda:0')) | > loss_gen: 2.6104254722595215 (2.310759464088752) | > loss_kl: 0.9249750971794128 (0.7480214075945624) | > loss_feat: 6.696879863739014 (5.786025587165234) | > loss_mel: 29.141189575195312 (20.396424025905375) | > loss_duration: 1.4877512454986572 (1.3499341302988486) | > loss_1: 40.86122131347656 (30.591164326181218) | > grad_norm_1: tensor(49182.6094, device='cuda:0') (tensor(19601.5352, device='cuda:0')) | > current_lr_0: 7.490764737399602e-05 | > current_lr_1: 7.490764737399602e-05 | > step_time: 0.6308 (0.35873244246658015) | > loader_time: 0.6443 (0.018885860637742644)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3178000450134277 (2.3178000450134277) | > loss_disc_real_0: 0.17180097103118896 (0.17180097103118896) | > loss_disc_real_1: 0.20416806638240814 (0.20416806638240814) | > loss_disc_real_2: 0.2750151455402374 (0.2750151455402374) | > loss_disc_real_3: 0.19463752210140228 (0.19463752210140228) | > loss_disc_real_4: 0.11418372392654419 (0.11418372392654419) | > loss_disc_real_5: 0.12973152101039886 (0.12973152101039886) | > loss_0: 2.3178000450134277 (2.3178000450134277) | > loss_gen: 2.643239974975586 (2.643239974975586) | > loss_kl: 6.1316633224487305 (6.1316633224487305) | > loss_feat: 9.391963005065918 (9.391963005065918) | > loss_mel: 24.712799072265625 (24.712799072265625) | > loss_duration: 3.1215338706970215 (3.1215338706970215) | > loss_1: 46.00120162963867 (46.00120162963867)  --> STEP: 1 | > loss_disc: 2.003486156463623 (2.003486156463623) | > loss_disc_real_0: 0.02831125259399414 (0.02831125259399414) | > loss_disc_real_1: 0.3295063078403473 (0.3295063078403473) | > loss_disc_real_2: 0.27974531054496765 (0.27974531054496765) | > loss_disc_real_3: 0.30447858572006226 (0.30447858572006226) | > loss_disc_real_4: 0.16743183135986328 (0.16743183135986328) | > loss_disc_real_5: 0.2523685395717621 (0.2523685395717621) | > loss_0: 2.003486156463623 (2.003486156463623) | > loss_gen: 3.7624669075012207 (3.7624669075012207) | > loss_kl: 5.415471076965332 (5.415471076965332) | > loss_feat: 8.982816696166992 (8.982816696166992) | > loss_mel: 23.968957901000977 (23.968957901000977) | > loss_duration: 3.487445116043091 (3.487445116043091) | > loss_1: 45.617156982421875 (45.617156982421875)  --> STEP: 2 | > loss_disc: 2.8400416374206543 (2.4217638969421387) | > loss_disc_real_0: 0.18912243843078613 (0.10871684551239014) | > loss_disc_real_1: 0.2984127998352051 (0.3139595538377762) | > loss_disc_real_2: 0.19494162499904633 (0.237343467772007) | > loss_disc_real_3: 0.3001556396484375 (0.3023171126842499) | > loss_disc_real_4: 0.2662888467311859 (0.2168603390455246) | > loss_disc_real_5: 0.26600193977355957 (0.2591852396726608) | > loss_0: 2.8400416374206543 (2.4217638969421387) | > loss_gen: 1.7090531587600708 (2.7357600331306458) | > loss_kl: 5.399822235107422 (5.407646656036377) | > loss_feat: 1.1992852687835693 (5.091050982475281) | > loss_mel: 15.680028915405273 (19.824493408203125) | > loss_duration: 3.1796762943267822 (3.3335607051849365) | > loss_1: 27.167865753173828 (36.39251136779785)  --> STEP: 3 | > loss_disc: 1.8608710765838623 (2.23479962348938) | > loss_disc_real_0: 0.05005132034420967 (0.08916167045632999) | > loss_disc_real_1: 0.2202073335647583 (0.2827088137467702) | > loss_disc_real_2: 0.13869424164295197 (0.2044603923956553) | > loss_disc_real_3: 0.1688770204782486 (0.25783708194891614) | > loss_disc_real_4: 0.10951939970254898 (0.1810800259311994) | > loss_disc_real_5: 0.08182236552238464 (0.20006428162256876) | > loss_0: 1.8608710765838623 (2.23479962348938) | > loss_gen: 2.160064697265625 (2.5438615878423056) | > loss_kl: 2.904845714569092 (4.573379675547282) | > loss_feat: 4.953114986419678 (5.045072317123413) | > loss_mel: 20.27315330505371 (19.97404670715332) | > loss_duration: 3.071704626083374 (3.2462753454844155) | > loss_1: 33.362884521484375 (35.382635752360024) --> EVAL PERFORMANCE | > avg_loader_time: 0.002344528834025065 (-0.013486067454020182) | > avg_loss_disc: 2.23479962348938 (-0.7041952610015869) | > avg_loss_disc_real_0: 0.08916167045632999 (-0.056037745128075286) | > avg_loss_disc_real_1: 0.2827088137467702 (+0.0283520370721817) | > avg_loss_disc_real_2: 0.2044603923956553 (-0.056394651532173184) | > avg_loss_disc_real_3: 0.25783708194891614 (-0.03993736207485199) | > avg_loss_disc_real_4: 0.1810800259311994 (-0.11005773892005286) | > avg_loss_disc_real_5: 0.20006428162256876 (-0.0677255988121033) | > avg_loss_0: 2.23479962348938 (-0.7041952610015869) | > avg_loss_gen: 2.5438615878423056 (+0.7379324436187746) | > avg_loss_kl: 4.573379675547282 (+0.22776246070861816) | > avg_loss_feat: 5.045072317123413 (+2.4260455618302026) | > avg_loss_mel: 19.97404670715332 (+4.34883713722229) | > avg_loss_duration: 3.2462753454844155 (+0.05486885706583644) | > avg_loss_1: 35.382635752360024 (+7.79544639587402)  > EPOCH: 983/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:04:22)   --> TIME: 2023-10-20 12:04:46 -- STEP: 29/50 -- GLOBAL_STEP: 102180 | > loss_disc: 2.920478343963623 (2.4574591496895097) | > loss_disc_real_0: 0.2622133493423462 (0.13814710295791255) | > loss_disc_real_1: 0.2787877023220062 (0.23121611825351057) | > loss_disc_real_2: 0.2562841773033142 (0.240754965435842) | > loss_disc_real_3: 0.2908487021923065 (0.2329990527239339) | > loss_disc_real_4: 0.28829121589660645 (0.21853750051352486) | > loss_disc_real_5: 0.26056456565856934 (0.2310599079676743) | > loss_0: 2.920478343963623 (2.4574591496895097) | > grad_norm_0: tensor(444.4133, device='cuda:0') (tensor(672.1323, device='cuda:0')) | > loss_gen: 1.7182527780532837 (2.4116277489168887) | > loss_kl: 0.707966685295105 (0.9030882839498848) | > loss_feat: 0.35449427366256714 (5.988434477099057) | > loss_mel: 12.754358291625977 (20.80390760816377) | > loss_duration: 1.3545589447021484 (1.3692599904948268) | > loss_1: 16.889631271362305 (31.476318375817662) | > grad_norm_1: tensor(2720.5159, device='cuda:0') (tensor(24953.1465, device='cuda:0')) | > current_lr_0: 7.483277249052599e-05 | > current_lr_1: 7.483277249052599e-05 | > step_time: 0.4922 (0.661078691482544) | > loader_time: 0.0026 (0.022667112021610654)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.949524402618408 (2.949524402618408) | > loss_disc_real_0: 0.307766854763031 (0.307766854763031) | > loss_disc_real_1: 0.34336718916893005 (0.34336718916893005) | > loss_disc_real_2: 0.391358345746994 (0.391358345746994) | > loss_disc_real_3: 0.22342194616794586 (0.22342194616794586) | > loss_disc_real_4: 0.2074633687734604 (0.2074633687734604) | > loss_disc_real_5: 0.27967503666877747 (0.27967503666877747) | > loss_0: 2.949524402618408 (2.949524402618408) | > loss_gen: 2.475731372833252 (2.475731372833252) | > loss_kl: 5.110036849975586 (5.110036849975586) | > loss_feat: 6.595615863800049 (6.595615863800049) | > loss_mel: 21.626075744628906 (21.626075744628906) | > loss_duration: 3.0412206649780273 (3.0412206649780273) | > loss_1: 38.84867858886719 (38.84867858886719)  --> STEP: 1 | > loss_disc: 2.8549513816833496 (2.8549513816833496) | > loss_disc_real_0: 0.17461983859539032 (0.17461983859539032) | > loss_disc_real_1: 0.2594188451766968 (0.2594188451766968) | > loss_disc_real_2: 0.25305601954460144 (0.25305601954460144) | > loss_disc_real_3: 0.3236139416694641 (0.3236139416694641) | > loss_disc_real_4: 0.4774552285671234 (0.4774552285671234) | > loss_disc_real_5: 0.26796287298202515 (0.26796287298202515) | > loss_0: 2.8549513816833496 (2.8549513816833496) | > loss_gen: 2.2050979137420654 (2.2050979137420654) | > loss_kl: 4.868452548980713 (4.868452548980713) | > loss_feat: 7.922067642211914 (7.922067642211914) | > loss_mel: 24.035425186157227 (24.035425186157227) | > loss_duration: 3.3906161785125732 (3.3906161785125732) | > loss_1: 42.42165756225586 (42.42165756225586)  --> STEP: 2 | > loss_disc: 2.430912971496582 (2.642932176589966) | > loss_disc_real_0: 0.09245871752500534 (0.13353927806019783) | > loss_disc_real_1: 0.1757611334323883 (0.21758998930454254) | > loss_disc_real_2: 0.3990950584411621 (0.3260755389928818) | > loss_disc_real_3: 0.21230363845825195 (0.26795879006385803) | > loss_disc_real_4: 0.14461877942085266 (0.31103700399398804) | > loss_disc_real_5: 0.25217506289482117 (0.26006896793842316) | > loss_0: 2.430912971496582 (2.642932176589966) | > loss_gen: 2.4560136795043945 (2.33055579662323) | > loss_kl: 5.649580001831055 (5.259016275405884) | > loss_feat: 9.882451057434082 (8.902259349822998) | > loss_mel: 22.758745193481445 (23.397085189819336) | > loss_duration: 3.2863659858703613 (3.3384910821914673) | > loss_1: 44.03315353393555 (43.2274055480957)  --> STEP: 3 | > loss_disc: 2.7925288677215576 (2.6927977403004966) | > loss_disc_real_0: 0.3914472162723541 (0.21950859079758325) | > loss_disc_real_1: 0.29548054933547974 (0.24355350931485495) | > loss_disc_real_2: 0.1756046712398529 (0.2759185830752055) | > loss_disc_real_3: 0.23325777053833008 (0.2563917835553487) | > loss_disc_real_4: 0.24774323403835297 (0.289939080675443) | > loss_disc_real_5: 0.1265479326248169 (0.21556195616722107) | > loss_0: 2.7925288677215576 (2.6927977403004966) | > loss_gen: 2.040416955947876 (2.2338428497314453) | > loss_kl: 2.1362037658691406 (4.21807877222697) | > loss_feat: 3.4693496227264404 (7.0912894407908125) | > loss_mel: 19.734601974487305 (22.176257451375324) | > loss_duration: 2.8459384441375732 (3.174306869506836) | > loss_1: 30.226511001586914 (38.89377403259277) --> EVAL PERFORMANCE | > avg_loader_time: 0.011450370152791342 (+0.009105841318766277) | > avg_loss_disc: 2.6927977403004966 (+0.4579981168111167) | > avg_loss_disc_real_0: 0.21950859079758325 (+0.13034692034125328) | > avg_loss_disc_real_1: 0.24355350931485495 (-0.039155304431915255) | > avg_loss_disc_real_2: 0.2759185830752055 (+0.0714581906795502) | > avg_loss_disc_real_3: 0.2563917835553487 (-0.0014452983935674402) | > avg_loss_disc_real_4: 0.289939080675443 (+0.1088590547442436) | > avg_loss_disc_real_5: 0.21556195616722107 (+0.015497674544652312) | > avg_loss_0: 2.6927977403004966 (+0.4579981168111167) | > avg_loss_gen: 2.2338428497314453 (-0.31001873811086034) | > avg_loss_kl: 4.21807877222697 (-0.3553009033203125) | > avg_loss_feat: 7.0912894407908125 (+2.0462171236673994) | > avg_loss_mel: 22.176257451375324 (+2.202210744222004) | > avg_loss_duration: 3.174306869506836 (-0.0719684759775796) | > avg_loss_1: 38.89377403259277 (+3.5111382802327498)  > EPOCH: 984/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:05:13)   --> TIME: 2023-10-20 12:05:23 -- STEP: 9/50 -- GLOBAL_STEP: 102210 | > loss_disc: 2.628694534301758 (2.6780379348331027) | > loss_disc_real_0: 0.3474438190460205 (0.21790296418799293) | > loss_disc_real_1: 0.24420301616191864 (0.23734459777673086) | > loss_disc_real_2: 0.23327019810676575 (0.25086062649885815) | > loss_disc_real_3: 0.3331995904445648 (0.26913265470001435) | > loss_disc_real_4: 0.3414842188358307 (0.2610030604733361) | > loss_disc_real_5: 0.3450374901294708 (0.27341055621703464) | > loss_0: 2.628694534301758 (2.6780379348331027) | > grad_norm_0: tensor(475.3912, device='cuda:0') (tensor(1121.4319, device='cuda:0')) | > loss_gen: 2.6610562801361084 (2.334088431464301) | > loss_kl: 0.5814356207847595 (0.7243271039591895) | > loss_feat: 3.5611491203308105 (5.685849918259515) | > loss_mel: 19.408706665039062 (19.392166402604843) | > loss_duration: 1.356490135192871 (1.3395855559243097) | > loss_1: 27.56884002685547 (29.47601826985677) | > grad_norm_1: tensor(2373.1892, device='cuda:0') (tensor(11567.6240, device='cuda:0')) | > current_lr_0: 7.475797244918985e-05 | > current_lr_1: 7.475797244918985e-05 | > step_time: 0.5404 (0.552720758650038) | > loader_time: 0.0166 (0.015197462505764432)  --> TIME: 2023-10-20 12:05:55 -- STEP: 39/50 -- GLOBAL_STEP: 102240 | > loss_disc: 1.6672124862670898 (2.480282704035441) | > loss_disc_real_0: 0.07316216081380844 (0.16418997926685291) | > loss_disc_real_1: 0.16342045366764069 (0.21614534656206766) | > loss_disc_real_2: 0.11183870583772659 (0.2295010855469184) | > loss_disc_real_3: 0.07257844507694244 (0.23907951256021476) | > loss_disc_real_4: 0.08188515156507492 (0.2349050137668084) | > loss_disc_real_5: 0.0613139383494854 (0.23114307788320076) | > loss_0: 1.6672124862670898 (2.480282704035441) | > grad_norm_0: tensor(703.9785, device='cuda:0') (tensor(681.8551, device='cuda:0')) | > loss_gen: 2.561539888381958 (2.282069670848357) | > loss_kl: 0.45678311586380005 (0.7513311531108159) | > loss_feat: 8.956282615661621 (5.5972447599738056) | > loss_mel: 24.292818069458008 (20.911580519798473) | > loss_duration: 1.3933812379837036 (1.343192491775904) | > loss_1: 37.660804748535156 (30.885418818547176) | > grad_norm_1: tensor(9903.8252, device='cuda:0') (tensor(14453.9141, device='cuda:0')) | > current_lr_0: 7.475797244918985e-05 | > current_lr_1: 7.475797244918985e-05 | > step_time: 0.959 (0.9092400440802941) | > loader_time: 0.0455 (0.03254846426156851)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2211172580718994 (2.2211172580718994) | > loss_disc_real_0: 0.0872228816151619 (0.0872228816151619) | > loss_disc_real_1: 0.2487877607345581 (0.2487877607345581) | > loss_disc_real_2: 0.2735326290130615 (0.2735326290130615) | > loss_disc_real_3: 0.26744750142097473 (0.26744750142097473) | > loss_disc_real_4: 0.2708193063735962 (0.2708193063735962) | > loss_disc_real_5: 0.30309945344924927 (0.30309945344924927) | > loss_0: 2.2211172580718994 (2.2211172580718994) | > loss_gen: 2.8383398056030273 (2.8383398056030273) | > loss_kl: 6.094438552856445 (6.094438552856445) | > loss_feat: 5.919503688812256 (5.919503688812256) | > loss_mel: 22.770023345947266 (22.770023345947266) | > loss_duration: 3.1240968704223633 (3.1240968704223633) | > loss_1: 40.746402740478516 (40.746402740478516)  --> STEP: 1 | > loss_disc: 2.683589458465576 (2.683589458465576) | > loss_disc_real_0: 0.30353397130966187 (0.30353397130966187) | > loss_disc_real_1: 0.32314375042915344 (0.32314375042915344) | > loss_disc_real_2: 0.19635966420173645 (0.19635966420173645) | > loss_disc_real_3: 0.2792235314846039 (0.2792235314846039) | > loss_disc_real_4: 0.3159502446651459 (0.3159502446651459) | > loss_disc_real_5: 0.23492959141731262 (0.23492959141731262) | > loss_0: 2.683589458465576 (2.683589458465576) | > loss_gen: 2.3753857612609863 (2.3753857612609863) | > loss_kl: 4.55457067489624 (4.55457067489624) | > loss_feat: 6.860541820526123 (6.860541820526123) | > loss_mel: 24.354658126831055 (24.354658126831055) | > loss_duration: 3.3075852394104004 (3.3075852394104004) | > loss_1: 41.45274353027344 (41.45274353027344)  --> STEP: 2 | > loss_disc: 2.321533679962158 (2.502561569213867) | > loss_disc_real_0: 0.1240917295217514 (0.21381285041570663) | > loss_disc_real_1: 0.20877045392990112 (0.2659571021795273) | > loss_disc_real_2: 0.17269037663936615 (0.1845250204205513) | > loss_disc_real_3: 0.22492091357707977 (0.2520722225308418) | > loss_disc_real_4: 0.23968303203582764 (0.27781663835048676) | > loss_disc_real_5: 0.2402624785900116 (0.2375960350036621) | > loss_0: 2.321533679962158 (2.502561569213867) | > loss_gen: 2.2374491691589355 (2.306417465209961) | > loss_kl: 5.583059310913086 (5.068814992904663) | > loss_feat: 7.083510398864746 (6.972026109695435) | > loss_mel: 22.778024673461914 (23.566341400146484) | > loss_duration: 3.1512489318847656 (3.229417085647583) | > loss_1: 40.83329391479492 (41.14301872253418)  --> STEP: 3 | > loss_disc: 3.094827175140381 (2.6999834378560386) | > loss_disc_real_0: 0.1355835646390915 (0.1877364218235016) | > loss_disc_real_1: 0.30906179547309875 (0.28032533327738446) | > loss_disc_real_2: 0.2459511011838913 (0.20500038067499796) | > loss_disc_real_3: 0.3996685743331909 (0.3012710064649582) | > loss_disc_real_4: 0.25168925523757935 (0.26910751064618427) | > loss_disc_real_5: 0.27383264899253845 (0.24967490633328757) | > loss_0: 3.094827175140381 (2.6999834378560386) | > loss_gen: 1.8456791639328003 (2.1528380314509072) | > loss_kl: 2.3134825229644775 (4.150370836257935) | > loss_feat: 4.448179244995117 (6.130743821461995) | > loss_mel: 23.712594985961914 (23.615092595418293) | > loss_duration: 3.0782463550567627 (3.1790268421173096) | > loss_1: 35.3981819152832 (39.22807312011719) --> EVAL PERFORMANCE | > avg_loader_time: 0.0074198246002197266 (-0.004030545552571615) | > avg_loss_disc: 2.6999834378560386 (+0.007185697555541992) | > avg_loss_disc_real_0: 0.1877364218235016 (-0.031772168974081666) | > avg_loss_disc_real_1: 0.28032533327738446 (+0.03677182396252951) | > avg_loss_disc_real_2: 0.20500038067499796 (-0.07091820240020755) | > avg_loss_disc_real_3: 0.3012710064649582 (+0.044879222909609495) | > avg_loss_disc_real_4: 0.26910751064618427 (-0.020831570029258728) | > avg_loss_disc_real_5: 0.24967490633328757 (+0.0341129501660665) | > avg_loss_0: 2.6999834378560386 (+0.007185697555541992) | > avg_loss_gen: 2.1528380314509072 (-0.08100481828053807) | > avg_loss_kl: 4.150370836257935 (-0.06770793596903513) | > avg_loss_feat: 6.130743821461995 (-0.9605456193288173) | > avg_loss_mel: 23.615092595418293 (+1.4388351440429688) | > avg_loss_duration: 3.1790268421173096 (+0.004719972610473633) | > avg_loss_1: 39.22807312011719 (+0.33429908752441406)  > EPOCH: 985/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:06:10)   --> TIME: 2023-10-20 12:06:27 -- STEP: 19/50 -- GLOBAL_STEP: 102270 | > loss_disc: 1.8864444494247437 (2.422364310214394) | > loss_disc_real_0: 0.03403708338737488 (0.12468228420536769) | > loss_disc_real_1: 0.2096158117055893 (0.22817294221175344) | > loss_disc_real_2: 0.13199928402900696 (0.23608037594117617) | > loss_disc_real_3: 0.1885586380958557 (0.22779478309185883) | > loss_disc_real_4: 0.05388631299138069 (0.23567963587610344) | > loss_disc_real_5: 0.018349720165133476 (0.22506310624119483) | > loss_0: 1.8864444494247437 (2.422364310214394) | > grad_norm_0: tensor(403.9967, device='cuda:0') (tensor(535.0356, device='cuda:0')) | > loss_gen: 2.6091177463531494 (2.3573532104492188) | > loss_kl: 0.7698497176170349 (0.8078605262072462) | > loss_feat: 10.0862455368042 (6.000973949306889) | > loss_mel: 24.453889846801758 (22.95255133980199) | > loss_duration: 1.4378618001937866 (1.3840369550805343) | > loss_1: 39.35696792602539 (33.50277609574167) | > grad_norm_1: tensor(31476.7051, device='cuda:0') (tensor(21859.5332, device='cuda:0')) | > current_lr_0: 7.46832471751782e-05 | > current_lr_1: 7.46832471751782e-05 | > step_time: 0.5634 (0.6043646335601807) | > loader_time: 0.0092 (0.023163130408839175)  --> TIME: 2023-10-20 12:06:39 -- STEP: 49/50 -- GLOBAL_STEP: 102300 | > loss_disc: 2.4882583618164062 (2.4920155028907622) | > loss_disc_real_0: 0.08266080170869827 (0.13409092558585867) | > loss_disc_real_1: 0.198463574051857 (0.23446599211619826) | > loss_disc_real_2: 0.1797245293855667 (0.2298208885655111) | > loss_disc_real_3: 0.13902556896209717 (0.24723890613840563) | > loss_disc_real_4: 0.2708723545074463 (0.24194133806289456) | > loss_disc_real_5: 0.36924833059310913 (0.24379728821923538) | > loss_0: 2.4882583618164062 (2.4920155028907622) | > grad_norm_0: tensor(462.2129, device='cuda:0') (tensor(607.0423, device='cuda:0')) | > loss_gen: 2.055788040161133 (2.2564051491873607) | > loss_kl: 0.6739057302474976 (0.7710569712276362) | > loss_feat: 3.7358193397521973 (4.869694682408352) | > loss_mel: 21.32553482055664 (20.403841558767823) | > loss_duration: 1.4609100818634033 (1.346722488500634) | > loss_1: 29.2519588470459 (29.647720842945322) | > grad_norm_1: tensor(5885.5132, device='cuda:0') (tensor(17488.8223, device='cuda:0')) | > current_lr_0: 7.46832471751782e-05 | > current_lr_1: 7.46832471751782e-05 | > step_time: 0.3563 (0.46841539655412945) | > loader_time: 0.3958 (0.020376862311849788)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.921712875366211 (1.921712875366211) | > loss_disc_real_0: 0.1657692939043045 (0.1657692939043045) | > loss_disc_real_1: 0.15252803266048431 (0.15252803266048431) | > loss_disc_real_2: 0.16270069777965546 (0.16270069777965546) | > loss_disc_real_3: 0.13376043736934662 (0.13376043736934662) | > loss_disc_real_4: 0.25724244117736816 (0.25724244117736816) | > loss_disc_real_5: 0.08990035951137543 (0.08990035951137543) | > loss_0: 1.921712875366211 (1.921712875366211) | > loss_gen: 2.481318712234497 (2.481318712234497) | > loss_kl: 6.855166435241699 (6.855166435241699) | > loss_feat: 9.093294143676758 (9.093294143676758) | > loss_mel: 22.727684020996094 (22.727684020996094) | > loss_duration: 3.177682638168335 (3.177682638168335) | > loss_1: 44.33514404296875 (44.33514404296875)  --> STEP: 1 | > loss_disc: 2.3468313217163086 (2.3468313217163086) | > loss_disc_real_0: 0.12598726153373718 (0.12598726153373718) | > loss_disc_real_1: 0.1992570012807846 (0.1992570012807846) | > loss_disc_real_2: 0.2439919114112854 (0.2439919114112854) | > loss_disc_real_3: 0.205006405711174 (0.205006405711174) | > loss_disc_real_4: 0.1861652284860611 (0.1861652284860611) | > loss_disc_real_5: 0.2678897976875305 (0.2678897976875305) | > loss_0: 2.3468313217163086 (2.3468313217163086) | > loss_gen: 2.0521743297576904 (2.0521743297576904) | > loss_kl: 5.294360637664795 (5.294360637664795) | > loss_feat: 4.641323566436768 (4.641323566436768) | > loss_mel: 16.979890823364258 (16.979890823364258) | > loss_duration: 3.5376083850860596 (3.5376083850860596) | > loss_1: 32.50535583496094 (32.50535583496094)  --> STEP: 2 | > loss_disc: 2.8216824531555176 (2.584256887435913) | > loss_disc_real_0: 0.5700413584709167 (0.34801431000232697) | > loss_disc_real_1: 0.32945215702056885 (0.2643545791506767) | > loss_disc_real_2: 0.2137826681137085 (0.22888728976249695) | > loss_disc_real_3: 0.28510773181915283 (0.24505706876516342) | > loss_disc_real_4: 0.21047793328762054 (0.19832158088684082) | > loss_disc_real_5: 0.2205132097005844 (0.24420150369405746) | > loss_0: 2.8216824531555176 (2.584256887435913) | > loss_gen: 2.656590461730957 (2.3543823957443237) | > loss_kl: 5.370214939117432 (5.332287788391113) | > loss_feat: 7.919114112854004 (6.280218839645386) | > loss_mel: 22.5970401763916 (19.78846549987793) | > loss_duration: 3.4083399772644043 (3.472974181175232) | > loss_1: 41.951297760009766 (37.22832679748535)  --> STEP: 3 | > loss_disc: 2.8133881092071533 (2.6606339613596597) | > loss_disc_real_0: 0.038604434579610825 (0.24487768486142159) | > loss_disc_real_1: 0.21217575669288635 (0.24696163833141327) | > loss_disc_real_2: 0.187739759683609 (0.21517144640286764) | > loss_disc_real_3: 0.32572031021118164 (0.2719448159138362) | > loss_disc_real_4: 0.23862960934638977 (0.21175759037335715) | > loss_disc_real_5: 0.3307124376296997 (0.27303848167260486) | > loss_0: 2.8133881092071533 (2.6606339613596597) | > loss_gen: 1.787521481513977 (2.1654287576675415) | > loss_kl: 2.7395389080047607 (4.468038161595662) | > loss_feat: 4.666198253631592 (5.742211977640788) | > loss_mel: 18.36411476135254 (19.313681920369465) | > loss_duration: 3.057913064956665 (3.334620475769043) | > loss_1: 30.615285873413086 (35.023979822794594) --> EVAL PERFORMANCE | > avg_loader_time: 0.01204212506612142 (+0.004622300465901693) | > avg_loss_disc: 2.6606339613596597 (-0.03934947649637888) | > avg_loss_disc_real_0: 0.24487768486142159 (+0.05714126303792) | > avg_loss_disc_real_1: 0.24696163833141327 (-0.03336369494597119) | > avg_loss_disc_real_2: 0.21517144640286764 (+0.010171065727869688) | > avg_loss_disc_real_3: 0.2719448159138362 (-0.02932619055112201) | > avg_loss_disc_real_4: 0.21175759037335715 (-0.05734992027282712) | > avg_loss_disc_real_5: 0.27303848167260486 (+0.023363575339317294) | > avg_loss_0: 2.6606339613596597 (-0.03934947649637888) | > avg_loss_gen: 2.1654287576675415 (+0.012590726216634263) | > avg_loss_kl: 4.468038161595662 (+0.31766732533772757) | > avg_loss_feat: 5.742211977640788 (-0.3885318438212071) | > avg_loss_mel: 19.313681920369465 (-4.301410675048828) | > avg_loss_duration: 3.334620475769043 (+0.1555936336517334) | > avg_loss_1: 35.023979822794594 (-4.2040932973225935)  > EPOCH: 986/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:06:51)   --> TIME: 2023-10-20 12:07:17 -- STEP: 29/50 -- GLOBAL_STEP: 102330 | > loss_disc: 2.549880027770996 (2.366422447664984) | > loss_disc_real_0: 0.1269860714673996 (0.1246946925490067) | > loss_disc_real_1: 0.23682251572608948 (0.21912221122404624) | > loss_disc_real_2: 0.23902374505996704 (0.22846952466101483) | > loss_disc_real_3: 0.25554579496383667 (0.2217150536076776) | > loss_disc_real_4: 0.12599104642868042 (0.20674309507012367) | > loss_disc_real_5: 0.10919049382209778 (0.21639834569189056) | > loss_0: 2.549880027770996 (2.366422447664984) | > grad_norm_0: tensor(405.8398, device='cuda:0') (tensor(601.8986, device='cuda:0')) | > loss_gen: 1.74954354763031 (2.389428833435322) | > loss_kl: 0.835059404373169 (0.790021031452664) | > loss_feat: 3.3779938220977783 (6.056174149544074) | > loss_mel: 23.337554931640625 (21.544738103603496) | > loss_duration: 1.3648762702941895 (1.360188833598433) | > loss_1: 30.665027618408203 (32.14055094225653) | > grad_norm_1: tensor(2682.7383, device='cuda:0') (tensor(20574.6523, device='cuda:0')) | > current_lr_0: 7.460859659375643e-05 | > current_lr_1: 7.460859659375643e-05 | > step_time: 0.4753 (0.6364997502030998) | > loader_time: 0.0195 (0.019777857024094153)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.835609197616577 (2.835609197616577) | > loss_disc_real_0: 0.4869692325592041 (0.4869692325592041) | > loss_disc_real_1: 0.2862322926521301 (0.2862322926521301) | > loss_disc_real_2: 0.28179433941841125 (0.28179433941841125) | > loss_disc_real_3: 0.2648163437843323 (0.2648163437843323) | > loss_disc_real_4: 0.18074682354927063 (0.18074682354927063) | > loss_disc_real_5: 0.21544453501701355 (0.21544453501701355) | > loss_0: 2.835609197616577 (2.835609197616577) | > loss_gen: 2.4746153354644775 (2.4746153354644775) | > loss_kl: 5.921998500823975 (5.921998500823975) | > loss_feat: 4.959220886230469 (4.959220886230469) | > loss_mel: 20.97950553894043 (20.97950553894043) | > loss_duration: 3.1787989139556885 (3.1787989139556885) | > loss_1: 37.51414108276367 (37.51414108276367)  --> STEP: 1 | > loss_disc: 2.381725788116455 (2.381725788116455) | > loss_disc_real_0: 0.29362139105796814 (0.29362139105796814) | > loss_disc_real_1: 0.24072828888893127 (0.24072828888893127) | > loss_disc_real_2: 0.21888233721256256 (0.21888233721256256) | > loss_disc_real_3: 0.23145036399364471 (0.23145036399364471) | > loss_disc_real_4: 0.23879066109657288 (0.23879066109657288) | > loss_disc_real_5: 0.11794532090425491 (0.11794532090425491) | > loss_0: 2.381725788116455 (2.381725788116455) | > loss_gen: 2.5062124729156494 (2.5062124729156494) | > loss_kl: 4.662797927856445 (4.662797927856445) | > loss_feat: 7.699024200439453 (7.699024200439453) | > loss_mel: 22.352861404418945 (22.352861404418945) | > loss_duration: 3.4625766277313232 (3.4625766277313232) | > loss_1: 40.683475494384766 (40.683475494384766)  --> STEP: 2 | > loss_disc: 3.4010379314422607 (2.891381859779358) | > loss_disc_real_0: 0.4623311758041382 (0.37797628343105316) | > loss_disc_real_1: 0.33175504207611084 (0.28624166548252106) | > loss_disc_real_2: 0.3468855917453766 (0.2828839644789696) | > loss_disc_real_3: 0.2869383990764618 (0.25919438153505325) | > loss_disc_real_4: 0.3597639799118042 (0.29927732050418854) | > loss_disc_real_5: 0.3751955032348633 (0.2465704120695591) | > loss_0: 3.4010379314422607 (2.891381859779358) | > loss_gen: 1.8936952352523804 (2.199953854084015) | > loss_kl: 5.33787202835083 (5.000334978103638) | > loss_feat: 2.598331928253174 (5.1486780643463135) | > loss_mel: 26.414691925048828 (24.383776664733887) | > loss_duration: 3.202829122543335 (3.332702875137329) | > loss_1: 39.447418212890625 (40.065446853637695)  --> STEP: 3 | > loss_disc: 2.955719232559204 (2.912827650705973) | > loss_disc_real_0: 0.14647506177425385 (0.30080920954545337) | > loss_disc_real_1: 0.22509755194187164 (0.26586029430230457) | > loss_disc_real_2: 0.27580317854881287 (0.28052370250225067) | > loss_disc_real_3: 0.22624929249286652 (0.24821268518765768) | > loss_disc_real_4: 0.2665571868419647 (0.28837060928344727) | > loss_disc_real_5: 0.26584240794181824 (0.2529944106936455) | > loss_0: 2.955719232559204 (2.912827650705973) | > loss_gen: 1.5041245222091675 (1.9680107434590657) | > loss_kl: 2.4437971115112305 (4.148155689239502) | > loss_feat: 0.920011043548584 (3.7391223907470703) | > loss_mel: 17.14384651184082 (21.97046661376953) | > loss_duration: 3.0097241401672363 (3.225043296813965) | > loss_1: 25.021501541137695 (35.050798416137695) --> EVAL PERFORMANCE | > avg_loader_time: 0.015312512715657553 (+0.003270387649536133) | > avg_loss_disc: 2.912827650705973 (+0.2521936893463135) | > avg_loss_disc_real_0: 0.30080920954545337 (+0.055931524684031786) | > avg_loss_disc_real_1: 0.26586029430230457 (+0.018898655970891298) | > avg_loss_disc_real_2: 0.28052370250225067 (+0.06535225609938303) | > avg_loss_disc_real_3: 0.24821268518765768 (-0.023732130726178496) | > avg_loss_disc_real_4: 0.28837060928344727 (+0.07661301891009012) | > avg_loss_disc_real_5: 0.2529944106936455 (-0.020044070978959383) | > avg_loss_0: 2.912827650705973 (+0.2521936893463135) | > avg_loss_gen: 1.9680107434590657 (-0.19741801420847582) | > avg_loss_kl: 4.148155689239502 (-0.3198824723561602) | > avg_loss_feat: 3.7391223907470703 (-2.0030895868937177) | > avg_loss_mel: 21.97046661376953 (+2.6567846934000663) | > avg_loss_duration: 3.225043296813965 (-0.10957717895507812) | > avg_loss_1: 35.050798416137695 (+0.026818593343101327)  > EPOCH: 987/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:07:44)   --> TIME: 2023-10-20 12:07:55 -- STEP: 9/50 -- GLOBAL_STEP: 102360 | > loss_disc: 2.393312454223633 (2.3197745084762573) | > loss_disc_real_0: 0.0505523756146431 (0.1553704250189993) | > loss_disc_real_1: 0.2525619566440582 (0.2358210566971037) | > loss_disc_real_2: 0.1961030811071396 (0.20744674073325264) | > loss_disc_real_3: 0.11881431192159653 (0.20933767325348324) | > loss_disc_real_4: 0.1030554324388504 (0.17338817732201683) | > loss_disc_real_5: 0.08683568239212036 (0.20131721761491564) | > loss_0: 2.393312454223633 (2.3197745084762573) | > grad_norm_0: tensor(727.4026, device='cuda:0') (tensor(525.4984, device='cuda:0')) | > loss_gen: 1.726188063621521 (2.47050318453047) | > loss_kl: 0.8768829107284546 (0.8306541442871094) | > loss_feat: 6.7431135177612305 (6.6842492363519135) | > loss_mel: 21.954673767089844 (19.022793187035454) | > loss_duration: 1.2894514799118042 (1.3384920756022136) | > loss_1: 32.590309143066406 (30.346691449483234) | > grad_norm_1: tensor(6122.3408, device='cuda:0') (tensor(10376.9824, device='cuda:0')) | > current_lr_0: 7.453402063026462e-05 | > current_lr_1: 7.453402063026462e-05 | > step_time: 0.4971 (0.5209083557128906) | > loader_time: 0.0383 (0.025143994225396052)  --> TIME: 2023-10-20 12:08:16 -- STEP: 39/50 -- GLOBAL_STEP: 102390 | > loss_disc: 2.2562646865844727 (2.519407574947065) | > loss_disc_real_0: 0.03241052106022835 (0.16617188363885269) | > loss_disc_real_1: 0.29282766580581665 (0.22673777710550871) | > loss_disc_real_2: 0.06787386536598206 (0.22032799342503914) | > loss_disc_real_3: 0.29319998621940613 (0.24939879182821664) | > loss_disc_real_4: 0.2919357717037201 (0.24829284369181365) | > loss_disc_real_5: 0.12979455292224884 (0.23557653106175935) | > loss_0: 2.2562646865844727 (2.519407574947065) | > grad_norm_0: tensor(2510.2026, device='cuda:0') (tensor(907.7050, device='cuda:0')) | > loss_gen: 2.3621363639831543 (2.3074052975727963) | > loss_kl: 0.5577875971794128 (0.8145496715337802) | > loss_feat: 5.384220600128174 (5.46214090120525) | > loss_mel: 19.808181762695312 (19.107324934922733) | > loss_duration: 1.3977214097976685 (1.3501109740672967) | > loss_1: 29.51004981994629 (29.041531978509365) | > grad_norm_1: tensor(7225.1284, device='cuda:0') (tensor(26727.5059, device='cuda:0')) | > current_lr_0: 7.453402063026462e-05 | > current_lr_1: 7.453402063026462e-05 | > step_time: 0.422 (0.623321961133908) | > loader_time: 0.0027 (0.022388232059967823)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.615159749984741 (2.615159749984741) | > loss_disc_real_0: 0.3606470227241516 (0.3606470227241516) | > loss_disc_real_1: 0.25905683636665344 (0.25905683636665344) | > loss_disc_real_2: 0.2419130802154541 (0.2419130802154541) | > loss_disc_real_3: 0.2734108865261078 (0.2734108865261078) | > loss_disc_real_4: 0.3394051194190979 (0.3394051194190979) | > loss_disc_real_5: 0.3992685377597809 (0.3992685377597809) | > loss_0: 2.615159749984741 (2.615159749984741) | > loss_gen: 2.9235928058624268 (2.9235928058624268) | > loss_kl: 5.640935897827148 (5.640935897827148) | > loss_feat: 4.3180060386657715 (4.3180060386657715) | > loss_mel: 23.736270904541016 (23.736270904541016) | > loss_duration: 3.2354695796966553 (3.2354695796966553) | > loss_1: 39.85427474975586 (39.85427474975586)  --> STEP: 1 | > loss_disc: 2.5543293952941895 (2.5543293952941895) | > loss_disc_real_0: 0.16758090257644653 (0.16758090257644653) | > loss_disc_real_1: 0.2409687489271164 (0.2409687489271164) | > loss_disc_real_2: 0.23354968428611755 (0.23354968428611755) | > loss_disc_real_3: 0.2852316200733185 (0.2852316200733185) | > loss_disc_real_4: 0.27462369203567505 (0.27462369203567505) | > loss_disc_real_5: 0.28400567173957825 (0.28400567173957825) | > loss_0: 2.5543293952941895 (2.5543293952941895) | > loss_gen: 2.169574022293091 (2.169574022293091) | > loss_kl: 4.6939544677734375 (4.6939544677734375) | > loss_feat: 1.4466865062713623 (1.4466865062713623) | > loss_mel: 21.492897033691406 (21.492897033691406) | > loss_duration: 3.3378384113311768 (3.3378384113311768) | > loss_1: 33.14094924926758 (33.14094924926758)  --> STEP: 2 | > loss_disc: 2.946345806121826 (2.750337600708008) | > loss_disc_real_0: 0.20221126079559326 (0.1848960816860199) | > loss_disc_real_1: 0.26457682251930237 (0.2527727857232094) | > loss_disc_real_2: 0.2880765497684479 (0.2608131170272827) | > loss_disc_real_3: 0.2743135392665863 (0.2797725796699524) | > loss_disc_real_4: 0.27219197154045105 (0.27340783178806305) | > loss_disc_real_5: 0.2861594557762146 (0.2850825637578964) | > loss_0: 2.946345806121826 (2.750337600708008) | > loss_gen: 1.658959150314331 (1.914266586303711) | > loss_kl: 5.810641288757324 (5.252297878265381) | > loss_feat: 0.20784322917461395 (0.8272648677229881) | > loss_mel: 7.006203651428223 (14.249550342559814) | > loss_duration: 3.2284557819366455 (3.283147096633911) | > loss_1: 17.9121036529541 (25.52652645111084)  --> STEP: 3 | > loss_disc: 3.0009474754333496 (2.833874225616455) | > loss_disc_real_0: 0.20832645893096924 (0.19270620743433634) | > loss_disc_real_1: 0.2631284296512604 (0.2562246670325597) | > loss_disc_real_2: 0.2833428978919983 (0.2683230439821879) | > loss_disc_real_3: 0.2724018394947052 (0.2773156662782033) | > loss_disc_real_4: 0.27245020866394043 (0.27308862408002216) | > loss_disc_real_5: 0.2864266335964203 (0.28553058703740436) | > loss_0: 3.0009474754333496 (2.833874225616455) | > loss_gen: 1.5969836711883545 (1.808505614598592) | > loss_kl: 2.744412422180176 (4.4163360595703125) | > loss_feat: 0.07606291025876999 (0.5768642152349154) | > loss_mel: 2.384937047958374 (10.294679244359335) | > loss_duration: 2.9316694736480713 (3.1659878889719644) | > loss_1: 9.734065055847168 (20.262372652689617) --> EVAL PERFORMANCE | > avg_loader_time: 0.016327857971191406 (+0.0010153452555338536) | > avg_loss_disc: 2.833874225616455 (-0.07895342508951808) | > avg_loss_disc_real_0: 0.19270620743433634 (-0.10810300211111704) | > avg_loss_disc_real_1: 0.2562246670325597 (-0.009635627269744873) | > avg_loss_disc_real_2: 0.2683230439821879 (-0.012200658520062746) | > avg_loss_disc_real_3: 0.2773156662782033 (+0.029102981090545627) | > avg_loss_disc_real_4: 0.27308862408002216 (-0.015281985203425108) | > avg_loss_disc_real_5: 0.28553058703740436 (+0.03253617634375888) | > avg_loss_0: 2.833874225616455 (-0.07895342508951808) | > avg_loss_gen: 1.808505614598592 (-0.15950512886047363) | > avg_loss_kl: 4.4163360595703125 (+0.26818037033081055) | > avg_loss_feat: 0.5768642152349154 (-3.162258175512155) | > avg_loss_mel: 10.294679244359335 (-11.675787369410196) | > avg_loss_duration: 3.1659878889719644 (-0.059055407842000474) | > avg_loss_1: 20.262372652689617 (-14.788425763448078)  > EPOCH: 988/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:08:35)   --> TIME: 2023-10-20 12:08:53 -- STEP: 19/50 -- GLOBAL_STEP: 102420 | > loss_disc: 2.5391228199005127 (2.312375878032885) | > loss_disc_real_0: 0.3078320026397705 (0.1351982752522944) | > loss_disc_real_1: 0.2980937361717224 (0.20926263497063988) | > loss_disc_real_2: 0.2698291540145874 (0.19934416052542234) | > loss_disc_real_3: 0.3716830909252167 (0.22012857759469434) | > loss_disc_real_4: 0.3501307964324951 (0.19417401030659676) | > loss_disc_real_5: 0.32491928339004517 (0.1929199983316817) | > loss_0: 2.5391228199005127 (2.312375878032885) | > grad_norm_0: tensor(1520.7845, device='cuda:0') (tensor(1356.8915, device='cuda:0')) | > loss_gen: 3.2191405296325684 (2.338639547950343) | > loss_kl: 0.7821250557899475 (0.6654605692938754) | > loss_feat: 5.547483444213867 (6.4510823550977205) | > loss_mel: 20.347896575927734 (22.162692270780866) | > loss_duration: 1.4735735654830933 (1.3938428414495367) | > loss_1: 31.370220184326172 (33.01171784651907) | > grad_norm_1: tensor(24778.5059, device='cuda:0') (tensor(29144.8750, device='cuda:0')) | > current_lr_0: 7.445951921011747e-05 | > current_lr_1: 7.445951921011747e-05 | > step_time: 0.653 (0.6182309577339574) | > loader_time: 0.0288 (0.02488601835150468)  --> TIME: 2023-10-20 12:09:13 -- STEP: 49/50 -- GLOBAL_STEP: 102450 | > loss_disc: 3.1013376712799072 (2.361848687639042) | > loss_disc_real_0: 0.05616096034646034 (0.12952906742444906) | > loss_disc_real_1: 0.17142879962921143 (0.21872620983999602) | > loss_disc_real_2: 0.1203930675983429 (0.21253211416152054) | > loss_disc_real_3: 0.24448740482330322 (0.22413495137375228) | > loss_disc_real_4: 0.1566128432750702 (0.21788190107564537) | > loss_disc_real_5: 0.42098963260650635 (0.21240560510861023) | > loss_0: 3.1013376712799072 (2.361848687639042) | > grad_norm_0: tensor(1556.3700, device='cuda:0') (tensor(1444.5294, device='cuda:0')) | > loss_gen: 1.4599474668502808 (2.349065751445537) | > loss_kl: 0.37032651901245117 (0.6955094446941298) | > loss_feat: 4.845590591430664 (6.171285436469681) | > loss_mel: 20.47579002380371 (21.28963698659624) | > loss_duration: 1.4310187101364136 (1.3514257596463572) | > loss_1: 28.582674026489258 (31.856923366079524) | > grad_norm_1: tensor(12858.6328, device='cuda:0') (tensor(35185.0898, device='cuda:0')) | > current_lr_0: 7.445951921011747e-05 | > current_lr_1: 7.445951921011747e-05 | > step_time: 0.4055 (0.6196057796478273) | > loader_time: 0.4654 (0.031799452645438056)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7521021366119385 (2.7521021366119385) | > loss_disc_real_0: 0.17550741136074066 (0.17550741136074066) | > loss_disc_real_1: 0.24242839217185974 (0.24242839217185974) | > loss_disc_real_2: 0.21011649072170258 (0.21011649072170258) | > loss_disc_real_3: 0.20072537660598755 (0.20072537660598755) | > loss_disc_real_4: 0.24510937929153442 (0.24510937929153442) | > loss_disc_real_5: 0.19108684360980988 (0.19108684360980988) | > loss_0: 2.7521021366119385 (2.7521021366119385) | > loss_gen: 1.5863314867019653 (1.5863314867019653) | > loss_kl: 6.215458393096924 (6.215458393096924) | > loss_feat: 2.2385644912719727 (2.2385644912719727) | > loss_mel: 14.010878562927246 (14.010878562927246) | > loss_duration: 3.194561719894409 (3.194561719894409) | > loss_1: 27.24579429626465 (27.24579429626465)  --> STEP: 1 | > loss_disc: 2.6404428482055664 (2.6404428482055664) | > loss_disc_real_0: 0.10346578806638718 (0.10346578806638718) | > loss_disc_real_1: 0.17910505831241608 (0.17910505831241608) | > loss_disc_real_2: 0.18567250669002533 (0.18567250669002533) | > loss_disc_real_3: 0.26909521222114563 (0.26909521222114563) | > loss_disc_real_4: 0.29914575815200806 (0.29914575815200806) | > loss_disc_real_5: 0.25963136553764343 (0.25963136553764343) | > loss_0: 2.6404428482055664 (2.6404428482055664) | > loss_gen: 1.693496823310852 (1.693496823310852) | > loss_kl: 5.394538402557373 (5.394538402557373) | > loss_feat: 1.27357816696167 (1.27357816696167) | > loss_mel: 20.485931396484375 (20.485931396484375) | > loss_duration: 3.4206531047821045 (3.4206531047821045) | > loss_1: 32.2681999206543 (32.2681999206543)  --> STEP: 2 | > loss_disc: 2.7245218753814697 (2.682482361793518) | > loss_disc_real_0: 0.1461086869239807 (0.12478723749518394) | > loss_disc_real_1: 0.23278628289699554 (0.2059456706047058) | > loss_disc_real_2: 0.49676284193992615 (0.34121767431497574) | > loss_disc_real_3: 0.3141336441040039 (0.29161442816257477) | > loss_disc_real_4: 0.1423082798719406 (0.22072701901197433) | > loss_disc_real_5: 0.33292049169540405 (0.29627592861652374) | > loss_0: 2.7245218753814697 (2.682482361793518) | > loss_gen: 2.4573912620544434 (2.0754440426826477) | > loss_kl: 5.210157871246338 (5.3023481369018555) | > loss_feat: 9.43276309967041 (5.35317063331604) | > loss_mel: 23.099010467529297 (21.792470932006836) | > loss_duration: 3.3114380836486816 (3.366045594215393) | > loss_1: 43.51076126098633 (37.88948059082031)  --> STEP: 3 | > loss_disc: 3.0751492977142334 (2.8133713404337564) | > loss_disc_real_0: 0.11157620698213577 (0.12038356065750122) | > loss_disc_real_1: 0.3077419102191925 (0.23987775047620138) | > loss_disc_real_2: 0.411213755607605 (0.3645497014125188) | > loss_disc_real_3: 0.314635694026947 (0.29928818345069885) | > loss_disc_real_4: 0.24566274881362915 (0.22903892894585928) | > loss_disc_real_5: 0.4004073143005371 (0.3309863905111949) | > loss_0: 3.0751492977142334 (2.8133713404337564) | > loss_gen: 2.237037420272827 (2.129308501879374) | > loss_kl: 2.7087621688842773 (4.437819480895996) | > loss_feat: 4.566100597381592 (5.090813954671224) | > loss_mel: 21.41382598876953 (21.666255950927734) | > loss_duration: 2.9567489624023438 (3.2296133836110434) | > loss_1: 33.882476806640625 (36.553812662760414) --> EVAL PERFORMANCE | > avg_loader_time: 0.0032841364542643228 (-0.013043721516927084) | > avg_loss_disc: 2.8133713404337564 (-0.020502885182698716) | > avg_loss_disc_real_0: 0.12038356065750122 (-0.07232264677683511) | > avg_loss_disc_real_1: 0.23987775047620138 (-0.01634691655635831) | > avg_loss_disc_real_2: 0.3645497014125188 (+0.09622665743033088) | > avg_loss_disc_real_3: 0.29928818345069885 (+0.021972517172495543) | > avg_loss_disc_real_4: 0.22903892894585928 (-0.044049695134162875) | > avg_loss_disc_real_5: 0.3309863905111949 (+0.045455803473790524) | > avg_loss_0: 2.8133713404337564 (-0.020502885182698716) | > avg_loss_gen: 2.129308501879374 (+0.320802887280782) | > avg_loss_kl: 4.437819480895996 (+0.021483421325683594) | > avg_loss_feat: 5.090813954671224 (+4.513949739436308) | > avg_loss_mel: 21.666255950927734 (+11.3715767065684) | > avg_loss_duration: 3.2296133836110434 (+0.06362549463907907) | > avg_loss_1: 36.553812662760414 (+16.291440010070797)  > EPOCH: 989/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:09:30)   --> TIME: 2023-10-20 12:09:48 -- STEP: 29/50 -- GLOBAL_STEP: 102480 | > loss_disc: 2.894550085067749 (2.4171686049165406) | > loss_disc_real_0: 0.18699577450752258 (0.13264121121630587) | > loss_disc_real_1: 0.24941575527191162 (0.22232139675781645) | > loss_disc_real_2: 0.27884814143180847 (0.22355697021402163) | > loss_disc_real_3: 0.2505173087120056 (0.2343374565243721) | > loss_disc_real_4: 0.24442417919635773 (0.226045910269022) | > loss_disc_real_5: 0.2531377673149109 (0.21501244232058525) | > loss_0: 2.894550085067749 (2.4171686049165406) | > grad_norm_0: tensor(895.8888, device='cuda:0') (tensor(1067.9252, device='cuda:0')) | > loss_gen: 1.5964195728302002 (2.3083422019563873) | > loss_kl: 0.6349969506263733 (0.8187806113012905) | > loss_feat: 0.2960781753063202 (5.4341910349140905) | > loss_mel: 9.413375854492188 (20.631254208498987) | > loss_duration: 1.3424372673034668 (1.3599919162947554) | > loss_1: 13.283308029174805 (30.55256018145331) | > grad_norm_1: tensor(57591.2656, device='cuda:0') (tensor(38703.8164, device='cuda:0')) | > current_lr_0: 7.438509225880425e-05 | > current_lr_1: 7.438509225880425e-05 | > step_time: 0.3202 (0.42465000317014495) | > loader_time: 0.0093 (0.013555715823995656)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.8388183116912842 (1.8388183116912842) | > loss_disc_real_0: 0.23316633701324463 (0.23316633701324463) | > loss_disc_real_1: 0.15812818706035614 (0.15812818706035614) | > loss_disc_real_2: 0.1174403578042984 (0.1174403578042984) | > loss_disc_real_3: 0.12516841292381287 (0.12516841292381287) | > loss_disc_real_4: 0.24945451319217682 (0.24945451319217682) | > loss_disc_real_5: 0.15947474539279938 (0.15947474539279938) | > loss_0: 1.8388183116912842 (1.8388183116912842) | > loss_gen: 3.1284244060516357 (3.1284244060516357) | > loss_kl: 5.3661417961120605 (5.3661417961120605) | > loss_feat: 11.020005226135254 (11.020005226135254) | > loss_mel: 27.249025344848633 (27.249025344848633) | > loss_duration: 3.090198516845703 (3.090198516845703) | > loss_1: 49.85379409790039 (49.85379409790039)  --> STEP: 1 | > loss_disc: 3.0966436862945557 (3.0966436862945557) | > loss_disc_real_0: 0.393015593290329 (0.393015593290329) | > loss_disc_real_1: 0.28310340642929077 (0.28310340642929077) | > loss_disc_real_2: 0.2935679256916046 (0.2935679256916046) | > loss_disc_real_3: 0.28516367077827454 (0.28516367077827454) | > loss_disc_real_4: 0.31695353984832764 (0.31695353984832764) | > loss_disc_real_5: 0.2562284767627716 (0.2562284767627716) | > loss_0: 3.0966436862945557 (3.0966436862945557) | > loss_gen: 1.9078679084777832 (1.9078679084777832) | > loss_kl: 4.96199893951416 (4.96199893951416) | > loss_feat: 2.0792832374572754 (2.0792832374572754) | > loss_mel: 18.33960723876953 (18.33960723876953) | > loss_duration: 3.3002066612243652 (3.3002066612243652) | > loss_1: 30.588964462280273 (30.588964462280273)  --> STEP: 2 | > loss_disc: 1.8922739028930664 (2.494458794593811) | > loss_disc_real_0: 0.06007823348045349 (0.22654691338539124) | > loss_disc_real_1: 0.23837725818157196 (0.26074033230543137) | > loss_disc_real_2: 0.10480523109436035 (0.19918657839298248) | > loss_disc_real_3: 0.2409496009349823 (0.2630566358566284) | > loss_disc_real_4: 0.1970200538635254 (0.2569867968559265) | > loss_disc_real_5: 0.21953710913658142 (0.2378827929496765) | > loss_0: 1.8922739028930664 (2.494458794593811) | > loss_gen: 2.977670907974243 (2.442769408226013) | > loss_kl: 5.3670125007629395 (5.16450572013855) | > loss_feat: 7.559235572814941 (4.819259405136108) | > loss_mel: 24.384292602539062 (21.361949920654297) | > loss_duration: 3.2109639644622803 (3.2555853128433228) | > loss_1: 43.499176025390625 (37.04407024383545)  --> STEP: 3 | > loss_disc: 3.0975050926208496 (2.6954742272694907) | > loss_disc_real_0: 0.3641921877861023 (0.2724286715189616) | > loss_disc_real_1: 0.30777794122695923 (0.276419535279274) | > loss_disc_real_2: 0.27181491255760193 (0.2233960231145223) | > loss_disc_real_3: 0.48125189542770386 (0.3357883890469869) | > loss_disc_real_4: 0.28821638226509094 (0.2673966586589813) | > loss_disc_real_5: 0.2745722234249115 (0.2501126031080882) | > loss_0: 3.0975050926208496 (2.6954742272694907) | > loss_gen: 2.582423448562622 (2.489320755004883) | > loss_kl: 2.4901766777038574 (4.273062705993652) | > loss_feat: 4.270155429840088 (4.636224746704102) | > loss_mel: 25.044391632080078 (22.58943049112956) | > loss_duration: 2.9958622455596924 (3.169010957082113) | > loss_1: 37.38300704956055 (37.15704917907715) --> EVAL PERFORMANCE | > avg_loader_time: 0.017821788787841797 (+0.014537652333577475) | > avg_loss_disc: 2.6954742272694907 (-0.11789711316426565) | > avg_loss_disc_real_0: 0.2724286715189616 (+0.1520451108614604) | > avg_loss_disc_real_1: 0.276419535279274 (+0.0365417848030726) | > avg_loss_disc_real_2: 0.2233960231145223 (-0.1411536782979965) | > avg_loss_disc_real_3: 0.3357883890469869 (+0.03650020559628803) | > avg_loss_disc_real_4: 0.2673966586589813 (+0.03835772971312204) | > avg_loss_disc_real_5: 0.2501126031080882 (-0.08087378740310669) | > avg_loss_0: 2.6954742272694907 (-0.11789711316426565) | > avg_loss_gen: 2.489320755004883 (+0.3600122531255088) | > avg_loss_kl: 4.273062705993652 (-0.16475677490234375) | > avg_loss_feat: 4.636224746704102 (-0.4545892079671221) | > avg_loss_mel: 22.58943049112956 (+0.9231745402018241) | > avg_loss_duration: 3.169010957082113 (-0.060602426528930664) | > avg_loss_1: 37.15704917907715 (+0.6032365163167341)  > EPOCH: 990/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:10:11)   --> TIME: 2023-10-20 12:10:23 -- STEP: 9/50 -- GLOBAL_STEP: 102510 | > loss_disc: 2.770465850830078 (2.369303160243564) | > loss_disc_real_0: 0.26336848735809326 (0.15430759059058297) | > loss_disc_real_1: 0.46663808822631836 (0.29745063847965664) | > loss_disc_real_2: 0.32445868849754333 (0.24554020249181324) | > loss_disc_real_3: 0.30965718626976013 (0.2644182956880993) | > loss_disc_real_4: 0.3037533164024353 (0.22331877135568196) | > loss_disc_real_5: 0.20119479298591614 (0.19376672721571392) | > loss_0: 2.770465850830078 (2.369303160243564) | > grad_norm_0: tensor(1537.8065, device='cuda:0') (tensor(1590.2716, device='cuda:0')) | > loss_gen: 2.3575632572174072 (2.536293453640408) | > loss_kl: 0.6398730278015137 (0.7375135289298164) | > loss_feat: 3.3533239364624023 (5.724622087346183) | > loss_mel: 22.612037658691406 (19.835244178771973) | > loss_duration: 1.3082177639007568 (1.3558604187435574) | > loss_1: 30.271015167236328 (30.189533869425457) | > grad_norm_1: tensor(23787.7812, device='cuda:0') (tensor(36625.3633, device='cuda:0')) | > current_lr_0: 7.431073970188869e-05 | > current_lr_1: 7.431073970188869e-05 | > step_time: 0.6906 (0.6181352403428819) | > loader_time: 0.0236 (0.029516299565633137)  --> TIME: 2023-10-20 12:10:43 -- STEP: 39/50 -- GLOBAL_STEP: 102540 | > loss_disc: 1.5810766220092773 (2.4722757156078634) | > loss_disc_real_0: 0.038701388984918594 (0.15635384122530618) | > loss_disc_real_1: 0.122401662170887 (0.24247770240673658) | > loss_disc_real_2: 0.1084369495511055 (0.2343284594707) | > loss_disc_real_3: 0.07198729366064072 (0.2321068476407956) | > loss_disc_real_4: 0.10340709239244461 (0.23418785497928277) | > loss_disc_real_5: 0.1787230521440506 (0.2341771883985553) | > loss_0: 1.5810766220092773 (2.4722757156078634) | > grad_norm_0: tensor(784.6795, device='cuda:0') (tensor(1459.4956, device='cuda:0')) | > loss_gen: 2.8341779708862305 (2.3307937781016026) | > loss_kl: 0.7979696989059448 (0.7896408056601499) | > loss_feat: 10.459648132324219 (5.140029987845665) | > loss_mel: 25.80171012878418 (20.135183591109055) | > loss_duration: 1.3922921419143677 (1.3528635104497273) | > loss_1: 41.285797119140625 (29.748511351071873) | > grad_norm_1: tensor(165189.3750, device='cuda:0') (tensor(40771.3516, device='cuda:0')) | > current_lr_0: 7.431073970188869e-05 | > current_lr_1: 7.431073970188869e-05 | > step_time: 0.3068 (0.6218745036002917) | > loader_time: 0.0049 (0.020263830820719402)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7136902809143066 (2.7136902809143066) | > loss_disc_real_0: 0.43427619338035583 (0.43427619338035583) | > loss_disc_real_1: 0.3239905536174774 (0.3239905536174774) | > loss_disc_real_2: 0.24336442351341248 (0.24336442351341248) | > loss_disc_real_3: 0.20770210027694702 (0.20770210027694702) | > loss_disc_real_4: 0.09359367191791534 (0.09359367191791534) | > loss_disc_real_5: 0.05226705223321915 (0.05226705223321915) | > loss_0: 2.7136902809143066 (2.7136902809143066) | > loss_gen: 2.1724119186401367 (2.1724119186401367) | > loss_kl: 4.765127182006836 (4.765127182006836) | > loss_feat: 8.625162124633789 (8.625162124633789) | > loss_mel: 23.095718383789062 (23.095718383789062) | > loss_duration: 3.0309507846832275 (3.0309507846832275) | > loss_1: 41.68937301635742 (41.68937301635742)  --> STEP: 1 | > loss_disc: 2.7031819820404053 (2.7031819820404053) | > loss_disc_real_0: 0.12338770925998688 (0.12338770925998688) | > loss_disc_real_1: 0.33160078525543213 (0.33160078525543213) | > loss_disc_real_2: 0.39668717980384827 (0.39668717980384827) | > loss_disc_real_3: 0.32196077704429626 (0.32196077704429626) | > loss_disc_real_4: 0.2935076951980591 (0.2935076951980591) | > loss_disc_real_5: 0.2918965816497803 (0.2918965816497803) | > loss_0: 2.7031819820404053 (2.7031819820404053) | > loss_gen: 2.4544522762298584 (2.4544522762298584) | > loss_kl: 5.2965545654296875 (5.2965545654296875) | > loss_feat: 5.671319007873535 (5.671319007873535) | > loss_mel: 24.972061157226562 (24.972061157226562) | > loss_duration: 3.347134590148926 (3.347134590148926) | > loss_1: 41.741519927978516 (41.741519927978516)  --> STEP: 2 | > loss_disc: 1.8186895847320557 (2.2609357833862305) | > loss_disc_real_0: 0.02800198830664158 (0.07569484878331423) | > loss_disc_real_1: 0.2229374647140503 (0.2772691249847412) | > loss_disc_real_2: 0.23775669932365417 (0.3172219395637512) | > loss_disc_real_3: 0.1681470274925232 (0.24505390226840973) | > loss_disc_real_4: 0.06657352298498154 (0.1800406090915203) | > loss_disc_real_5: 0.021347664296627045 (0.15662212297320366) | > loss_0: 1.8186895847320557 (2.2609357833862305) | > loss_gen: 2.4648945331573486 (2.4596734046936035) | > loss_kl: 5.891058921813965 (5.593806743621826) | > loss_feat: 8.729240417480469 (7.200279712677002) | > loss_mel: 24.807048797607422 (24.889554977416992) | > loss_duration: 3.2014944553375244 (3.274314522743225) | > loss_1: 45.0937385559082 (43.41762924194336)  --> STEP: 3 | > loss_disc: 2.262664556503296 (2.261512041091919) | > loss_disc_real_0: 0.28524696826934814 (0.14554555527865887) | > loss_disc_real_1: 0.24814161658287048 (0.267559955517451) | > loss_disc_real_2: 0.24459214508533478 (0.29301200807094574) | > loss_disc_real_3: 0.2113061100244522 (0.23380463818709055) | > loss_disc_real_4: 0.1757207065820694 (0.17860064158837) | > loss_disc_real_5: 0.031234024092555046 (0.11482609001298745) | > loss_0: 2.262664556503296 (2.261512041091919) | > loss_gen: 2.651475429534912 (2.5236074129740396) | > loss_kl: 2.588155508041382 (4.591922998428345) | > loss_feat: 7.112301826477051 (7.170953750610352) | > loss_mel: 20.024850845336914 (23.2679869333903) | > loss_duration: 2.98494553565979 (3.1778581937154136) | > loss_1: 35.36172866821289 (40.73232905069987) --> EVAL PERFORMANCE | > avg_loader_time: 0.004930655161539714 (-0.012891133626302082) | > avg_loss_disc: 2.261512041091919 (-0.43396218617757176) | > avg_loss_disc_real_0: 0.14554555527865887 (-0.12688311624030274) | > avg_loss_disc_real_1: 0.267559955517451 (-0.008859579761823) | > avg_loss_disc_real_2: 0.29301200807094574 (+0.06961598495642343) | > avg_loss_disc_real_3: 0.23380463818709055 (-0.10198375085989633) | > avg_loss_disc_real_4: 0.17860064158837 (-0.08879601707061133) | > avg_loss_disc_real_5: 0.11482609001298745 (-0.13528651309510076) | > avg_loss_0: 2.261512041091919 (-0.43396218617757176) | > avg_loss_gen: 2.5236074129740396 (+0.03428665796915675) | > avg_loss_kl: 4.591922998428345 (+0.3188602924346924) | > avg_loss_feat: 7.170953750610352 (+2.53472900390625) | > avg_loss_mel: 23.2679869333903 (+0.6785564422607422) | > avg_loss_duration: 3.1778581937154136 (+0.008847236633300781) | > avg_loss_1: 40.73232905069987 (+3.575279871622719)  > EPOCH: 991/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:11:06)   --> TIME: 2023-10-20 12:11:24 -- STEP: 19/50 -- GLOBAL_STEP: 102570 | > loss_disc: 3.044971227645874 (2.5790866174195943) | > loss_disc_real_0: 0.054785825312137604 (0.13950987346470356) | > loss_disc_real_1: 0.24346864223480225 (0.24732979622326398) | > loss_disc_real_2: 0.23143278062343597 (0.22208660527279503) | > loss_disc_real_3: 0.2875421643257141 (0.24260934834417544) | > loss_disc_real_4: 0.3174510598182678 (0.20360975977229445) | > loss_disc_real_5: 0.2636951208114624 (0.21876423511850207) | > loss_0: 3.044971227645874 (2.5790866174195943) | > grad_norm_0: tensor(1478.4287, device='cuda:0') (tensor(822.8535, device='cuda:0')) | > loss_gen: 1.6401704549789429 (2.0682202075657092) | > loss_kl: 0.556100606918335 (0.8004114690579867) | > loss_feat: 1.515170931816101 (4.572973674065189) | > loss_mel: 18.534164428710938 (19.294919051622088) | > loss_duration: 1.4206708669662476 (1.3840364217758179) | > loss_1: 23.666278839111328 (28.120560796637278) | > grad_norm_1: tensor(2865.2114, device='cuda:0') (tensor(13149.4932, device='cuda:0')) | > current_lr_0: 7.423646146500893e-05 | > current_lr_1: 7.423646146500893e-05 | > step_time: 0.5333 (0.6094053042562384) | > loader_time: 0.04 (0.029184655139320774)  --> TIME: 2023-10-20 12:11:43 -- STEP: 49/50 -- GLOBAL_STEP: 102600 | > loss_disc: 2.6334128379821777 (2.5737120910566684) | > loss_disc_real_0: 0.03801465034484863 (0.14635130861888118) | > loss_disc_real_1: 0.27660009264945984 (0.236916646361351) | > loss_disc_real_2: 0.24549372494220734 (0.22823052290751009) | > loss_disc_real_3: 0.3200852572917938 (0.240511843896642) | > loss_disc_real_4: 0.21574442088603973 (0.2271577979304961) | > loss_disc_real_5: 0.23467056453227997 (0.23622979961183607) | > loss_0: 2.6334128379821777 (2.5737120910566684) | > grad_norm_0: tensor(758.1643, device='cuda:0') (tensor(691.3184, device='cuda:0')) | > loss_gen: 1.9350552558898926 (2.112768165919246) | > loss_kl: 0.6219918131828308 (0.7488032877445221) | > loss_feat: 2.5725250244140625 (4.534963040935749) | > loss_mel: 20.78447914123535 (19.516667609312098) | > loss_duration: 1.4523406028747559 (1.3526194363224266) | > loss_1: 27.366392135620117 (28.265821466640546) | > grad_norm_1: tensor(9097.3838, device='cuda:0') (tensor(15757.0508, device='cuda:0')) | > current_lr_0: 7.423646146500893e-05 | > current_lr_1: 7.423646146500893e-05 | > step_time: 0.7354 (0.6006385306922757) | > loader_time: 0.6069 (0.03320715865310358)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.820178747177124 (2.820178747177124) | > loss_disc_real_0: 0.3160187602043152 (0.3160187602043152) | > loss_disc_real_1: 0.23924188315868378 (0.23924188315868378) | > loss_disc_real_2: 0.29953354597091675 (0.29953354597091675) | > loss_disc_real_3: 0.08973409980535507 (0.08973409980535507) | > loss_disc_real_4: 0.17387743294239044 (0.17387743294239044) | > loss_disc_real_5: 0.18602429330348969 (0.18602429330348969) | > loss_0: 2.820178747177124 (2.820178747177124) | > loss_gen: 1.6613750457763672 (1.6613750457763672) | > loss_kl: 4.687262535095215 (4.687262535095215) | > loss_feat: 5.0565571784973145 (5.0565571784973145) | > loss_mel: 25.362831115722656 (25.362831115722656) | > loss_duration: 2.9452667236328125 (2.9452667236328125) | > loss_1: 39.713294982910156 (39.713294982910156)  --> STEP: 1 | > loss_disc: 2.285552978515625 (2.285552978515625) | > loss_disc_real_0: 0.09969307482242584 (0.09969307482242584) | > loss_disc_real_1: 0.31309953331947327 (0.31309953331947327) | > loss_disc_real_2: 0.177094504237175 (0.177094504237175) | > loss_disc_real_3: 0.3031468689441681 (0.3031468689441681) | > loss_disc_real_4: 0.21689806878566742 (0.21689806878566742) | > loss_disc_real_5: 0.1631087064743042 (0.1631087064743042) | > loss_0: 2.285552978515625 (2.285552978515625) | > loss_gen: 2.4872708320617676 (2.4872708320617676) | > loss_kl: 5.0597615242004395 (5.0597615242004395) | > loss_feat: 7.318855285644531 (7.318855285644531) | > loss_mel: 24.096158981323242 (24.096158981323242) | > loss_duration: 3.3250622749328613 (3.3250622749328613) | > loss_1: 42.287109375 (42.287109375)  --> STEP: 2 | > loss_disc: 2.792773723602295 (2.53916335105896) | > loss_disc_real_0: 0.13563597202301025 (0.11766452342271805) | > loss_disc_real_1: 0.30192992091178894 (0.3075147271156311) | > loss_disc_real_2: 0.30939215421676636 (0.24324332922697067) | > loss_disc_real_3: 0.34109005331993103 (0.32211846113204956) | > loss_disc_real_4: 0.22550925612449646 (0.22120366245508194) | > loss_disc_real_5: 0.2617824375629425 (0.21244557201862335) | > loss_0: 2.792773723602295 (2.53916335105896) | > loss_gen: 1.9304332733154297 (2.2088520526885986) | > loss_kl: 5.970061779022217 (5.514911651611328) | > loss_feat: 2.4511821269989014 (4.885018706321716) | > loss_mel: 25.874895095825195 (24.98552703857422) | > loss_duration: 3.2455265522003174 (3.2852944135665894) | > loss_1: 39.47209548950195 (40.87960243225098)  --> STEP: 3 | > loss_disc: 2.6080031394958496 (2.56210994720459) | > loss_disc_real_0: 0.04344896972179413 (0.09292600552241008) | > loss_disc_real_1: 0.23583468794822693 (0.2836213807264964) | > loss_disc_real_2: 0.2957441508769989 (0.2607436031103134) | > loss_disc_real_3: 0.3535017669200897 (0.3325795630613963) | > loss_disc_real_4: 0.18582430481910706 (0.2094105432430903) | > loss_disc_real_5: 0.11926881968975067 (0.1813866545756658) | > loss_0: 2.6080031394958496 (2.56210994720459) | > loss_gen: 1.8240872621536255 (2.0805971225102744) | > loss_kl: 2.6009724140167236 (4.543598572413127) | > loss_feat: 4.618990898132324 (4.796342770258586) | > loss_mel: 25.016633987426758 (24.995896021525066) | > loss_duration: 2.914036273956299 (3.161541700363159) | > loss_1: 36.9747200012207 (39.57797495524088) --> EVAL PERFORMANCE | > avg_loader_time: 0.020223061243693035 (+0.01529240608215332) | > avg_loss_disc: 2.56210994720459 (+0.3005979061126709) | > avg_loss_disc_real_0: 0.09292600552241008 (-0.05261954975624879) | > avg_loss_disc_real_1: 0.2836213807264964 (+0.01606142520904541) | > avg_loss_disc_real_2: 0.2607436031103134 (-0.032268404960632324) | > avg_loss_disc_real_3: 0.3325795630613963 (+0.09877492487430575) | > avg_loss_disc_real_4: 0.2094105432430903 (+0.030809901654720306) | > avg_loss_disc_real_5: 0.1813866545756658 (+0.06656056456267835) | > avg_loss_0: 2.56210994720459 (+0.3005979061126709) | > avg_loss_gen: 2.0805971225102744 (-0.44301029046376517) | > avg_loss_kl: 4.543598572413127 (-0.0483244260152178) | > avg_loss_feat: 4.796342770258586 (-2.3746109803517657) | > avg_loss_mel: 24.995896021525066 (+1.7279090881347656) | > avg_loss_duration: 3.161541700363159 (-0.01631649335225438) | > avg_loss_1: 39.57797495524088 (-1.1543540954589844)  > EPOCH: 992/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:11:56)   --> TIME: 2023-10-20 12:12:19 -- STEP: 29/50 -- GLOBAL_STEP: 102630 | > loss_disc: 1.8121825456619263 (2.427260398864746) | > loss_disc_real_0: 0.0482911691069603 (0.13436998338599146) | > loss_disc_real_1: 0.17359790205955505 (0.22465593059515132) | > loss_disc_real_2: 0.12956905364990234 (0.2411467138806294) | > loss_disc_real_3: 0.2681138217449188 (0.2609443546369158) | > loss_disc_real_4: 0.14517050981521606 (0.23695044152053266) | > loss_disc_real_5: 0.11834083497524261 (0.24458195561350415) | > loss_0: 1.8121825456619263 (2.427260398864746) | > grad_norm_0: tensor(370.7226, device='cuda:0') (tensor(521.0952, device='cuda:0')) | > loss_gen: 2.62235164642334 (2.4108085509004265) | > loss_kl: 0.975106954574585 (0.7946283051679874) | > loss_feat: 7.43690824508667 (6.2100202824021205) | > loss_mel: 22.71847915649414 (22.146211874896082) | > loss_duration: 1.2995682954788208 (1.3540153503417969) | > loss_1: 35.05241394042969 (32.91568417384707) | > grad_norm_1: tensor(14986.0283, device='cuda:0') (tensor(18375.5020, device='cuda:0')) | > current_lr_0: 7.416225747387741e-05 | > current_lr_1: 7.416225747387741e-05 | > step_time: 0.2514 (0.5550176028547615) | > loader_time: 0.0034 (0.016302281412585027)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.75146484375 (2.75146484375) | > loss_disc_real_0: 0.35600924491882324 (0.35600924491882324) | > loss_disc_real_1: 0.3011661469936371 (0.3011661469936371) | > loss_disc_real_2: 0.25792357325553894 (0.25792357325553894) | > loss_disc_real_3: 0.25728240609169006 (0.25728240609169006) | > loss_disc_real_4: 0.24946947395801544 (0.24946947395801544) | > loss_disc_real_5: 0.2506304681301117 (0.2506304681301117) | > loss_0: 2.75146484375 (2.75146484375) | > loss_gen: 2.2971127033233643 (2.2971127033233643) | > loss_kl: 5.672776222229004 (5.672776222229004) | > loss_feat: 2.409114360809326 (2.409114360809326) | > loss_mel: 21.35132598876953 (21.35132598876953) | > loss_duration: 3.253730058670044 (3.253730058670044) | > loss_1: 34.98405838012695 (34.98405838012695)  --> STEP: 1 | > loss_disc: 3.2852396965026855 (3.2852396965026855) | > loss_disc_real_0: 0.5085762739181519 (0.5085762739181519) | > loss_disc_real_1: 0.3672942519187927 (0.3672942519187927) | > loss_disc_real_2: 0.3894050717353821 (0.3894050717353821) | > loss_disc_real_3: 0.35661962628364563 (0.35661962628364563) | > loss_disc_real_4: 0.3522719144821167 (0.3522719144821167) | > loss_disc_real_5: 0.358808308839798 (0.358808308839798) | > loss_0: 3.2852396965026855 (3.2852396965026855) | > loss_gen: 2.857473850250244 (2.857473850250244) | > loss_kl: 5.158492088317871 (5.158492088317871) | > loss_feat: 3.106754779815674 (3.106754779815674) | > loss_mel: 22.591535568237305 (22.591535568237305) | > loss_duration: 3.555997610092163 (3.555997610092163) | > loss_1: 37.2702522277832 (37.2702522277832)  --> STEP: 2 | > loss_disc: 3.0128369331359863 (3.149038314819336) | > loss_disc_real_0: 0.2725844979286194 (0.3905803859233856) | > loss_disc_real_1: 0.24980174005031586 (0.3085479959845543) | > loss_disc_real_2: 0.29752394556999207 (0.3434645086526871) | > loss_disc_real_3: 0.2730115056037903 (0.31481556594371796) | > loss_disc_real_4: 0.3004705607891083 (0.3263712376356125) | > loss_disc_real_5: 0.24415691196918488 (0.3014826104044914) | > loss_0: 3.0128369331359863 (3.149038314819336) | > loss_gen: 1.6389079093933105 (2.2481908798217773) | > loss_kl: 5.550401210784912 (5.354446649551392) | > loss_feat: 0.033052217215299606 (1.5699034985154867) | > loss_mel: 2.03454852104187 (12.313042044639587) | > loss_duration: 3.266744613647461 (3.411371111869812) | > loss_1: 12.52365493774414 (24.896953582763672)  --> STEP: 3 | > loss_disc: 2.7150697708129883 (3.0043821334838867) | > loss_disc_real_0: 0.23764759302139282 (0.339602788289388) | > loss_disc_real_1: 0.4551234245300293 (0.3574064721663793) | > loss_disc_real_2: 0.3206932842731476 (0.3358741005261739) | > loss_disc_real_3: 0.33098697662353516 (0.32020603617032367) | > loss_disc_real_4: 0.196834534406662 (0.28319233655929565) | > loss_disc_real_5: 0.24803653359413147 (0.2836672514677048) | > loss_0: 2.7150697708129883 (3.0043821334838867) | > loss_gen: 2.7381324768066406 (2.4115047454833984) | > loss_kl: 2.4472761154174805 (4.385389804840088) | > loss_feat: 5.3602375984191895 (2.8333481984833875) | > loss_mel: 24.239822387695312 (16.28863549232483) | > loss_duration: 3.062628984451294 (3.295123736063639) | > loss_1: 37.84809875488281 (29.21400197347005) --> EVAL PERFORMANCE | > avg_loader_time: 0.03847654660542806 (+0.018253485361735027) | > avg_loss_disc: 3.0043821334838867 (+0.4422721862792969) | > avg_loss_disc_real_0: 0.339602788289388 (+0.2466767827669779) | > avg_loss_disc_real_1: 0.3574064721663793 (+0.07378509143988288) | > avg_loss_disc_real_2: 0.3358741005261739 (+0.07513049741586048) | > avg_loss_disc_real_3: 0.32020603617032367 (-0.012373526891072628) | > avg_loss_disc_real_4: 0.28319233655929565 (+0.07378179331620535) | > avg_loss_disc_real_5: 0.2836672514677048 (+0.10228059689203897) | > avg_loss_0: 3.0043821334838867 (+0.4422721862792969) | > avg_loss_gen: 2.4115047454833984 (+0.33090762297312404) | > avg_loss_kl: 4.385389804840088 (-0.15820876757303903) | > avg_loss_feat: 2.8333481984833875 (-1.9629945717751984) | > avg_loss_mel: 16.28863549232483 (-8.707260529200237) | > avg_loss_duration: 3.295123736063639 (+0.13358203570048) | > avg_loss_1: 29.21400197347005 (-10.363972981770832)  > EPOCH: 993/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:12:44)   --> TIME: 2023-10-20 12:12:58 -- STEP: 9/50 -- GLOBAL_STEP: 102660 | > loss_disc: 3.0087175369262695 (2.5814399189419217) | > loss_disc_real_0: 0.25571519136428833 (0.16453484342330033) | > loss_disc_real_1: 0.26303789019584656 (0.2792002459367116) | > loss_disc_real_2: 0.28753456473350525 (0.26715916726324296) | > loss_disc_real_3: 0.24177581071853638 (0.26878638813893) | > loss_disc_real_4: 0.2754378020763397 (0.2632382917735312) | > loss_disc_real_5: 0.24459443986415863 (0.21252132952213287) | > loss_0: 3.0087175369262695 (2.5814399189419217) | > grad_norm_0: tensor(421.7711, device='cuda:0') (tensor(453.4629, device='cuda:0')) | > loss_gen: 1.5718200206756592 (2.307602604230245) | > loss_kl: 0.7379695773124695 (0.713063163889779) | > loss_feat: 0.07107502222061157 (4.705153199947542) | > loss_mel: 2.388481616973877 (16.692117267184788) | > loss_duration: 1.302533507347107 (1.3382539351781209) | > loss_1: 6.071879863739014 (25.75618971718682) | > grad_norm_1: tensor(21863.6113, device='cuda:0') (tensor(17393.6562, device='cuda:0')) | > current_lr_0: 7.408812765428092e-05 | > current_lr_1: 7.408812765428092e-05 | > step_time: 0.8298 (0.6054542594485812) | > loader_time: 0.0272 (0.03113049930996365)  --> TIME: 2023-10-20 12:13:13 -- STEP: 39/50 -- GLOBAL_STEP: 102690 | > loss_disc: 2.5968832969665527 (2.590174143130963) | > loss_disc_real_0: 0.07419447600841522 (0.14740376098033703) | > loss_disc_real_1: 0.25919750332832336 (0.2369908570097043) | > loss_disc_real_2: 0.21470646560192108 (0.24221325856752893) | > loss_disc_real_3: 0.21794679760932922 (0.23754980682562563) | > loss_disc_real_4: 0.32514050602912903 (0.24347608536481857) | > loss_disc_real_5: 0.4752817451953888 (0.24615196033548087) | > loss_0: 2.5968832969665527 (2.590174143130963) | > grad_norm_0: tensor(817.6791, device='cuda:0') (tensor(508.6941, device='cuda:0')) | > loss_gen: 2.6611711978912354 (2.165952220941201) | > loss_kl: 0.688470184803009 (0.806207103606982) | > loss_feat: 4.864853858947754 (4.7063970397680235) | > loss_mel: 22.488765716552734 (19.001103706848923) | > loss_duration: 1.4468766450881958 (1.338011539899386) | > loss_1: 32.15013885498047 (28.017671768481915) | > grad_norm_1: tensor(11979.0869, device='cuda:0') (tensor(17932.7676, device='cuda:0')) | > current_lr_0: 7.408812765428092e-05 | > current_lr_1: 7.408812765428092e-05 | > step_time: 0.2562 (0.5162972181271284) | > loader_time: 0.0026 (0.01689574046012683)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.529416561126709 (2.529416561126709) | > loss_disc_real_0: 0.24731266498565674 (0.24731266498565674) | > loss_disc_real_1: 0.2925013601779938 (0.2925013601779938) | > loss_disc_real_2: 0.25777295231819153 (0.25777295231819153) | > loss_disc_real_3: 0.23017628490924835 (0.23017628490924835) | > loss_disc_real_4: 0.1858958899974823 (0.1858958899974823) | > loss_disc_real_5: 0.15685348212718964 (0.15685348212718964) | > loss_0: 2.529416561126709 (2.529416561126709) | > loss_gen: 2.276932954788208 (2.276932954788208) | > loss_kl: 5.142090797424316 (5.142090797424316) | > loss_feat: 9.688863754272461 (9.688863754272461) | > loss_mel: 22.41813850402832 (22.41813850402832) | > loss_duration: 3.1752588748931885 (3.1752588748931885) | > loss_1: 42.7012825012207 (42.7012825012207)  --> STEP: 1 | > loss_disc: 2.907999277114868 (2.907999277114868) | > loss_disc_real_0: 0.13291031122207642 (0.13291031122207642) | > loss_disc_real_1: 0.23300373554229736 (0.23300373554229736) | > loss_disc_real_2: 0.17321011424064636 (0.17321011424064636) | > loss_disc_real_3: 0.10057055205106735 (0.10057055205106735) | > loss_disc_real_4: 0.15177497267723083 (0.15177497267723083) | > loss_disc_real_5: 0.034961819648742676 (0.034961819648742676) | > loss_0: 2.907999277114868 (2.907999277114868) | > loss_gen: 1.3449223041534424 (1.3449223041534424) | > loss_kl: 5.1501641273498535 (5.1501641273498535) | > loss_feat: 7.305172920227051 (7.305172920227051) | > loss_mel: 28.12851905822754 (28.12851905822754) | > loss_duration: 3.4130852222442627 (3.4130852222442627) | > loss_1: 45.341861724853516 (45.341861724853516)  --> STEP: 2 | > loss_disc: 3.0877342224121094 (2.9978667497634888) | > loss_disc_real_0: 0.5289982557296753 (0.33095428347587585) | > loss_disc_real_1: 0.26763394474983215 (0.25031884014606476) | > loss_disc_real_2: 0.2934437394142151 (0.23332692682743073) | > loss_disc_real_3: 0.2831898033618927 (0.19188017770648003) | > loss_disc_real_4: 0.20958350598812103 (0.18067923933267593) | > loss_disc_real_5: 0.23239585757255554 (0.1336788386106491) | > loss_0: 3.0877342224121094 (2.9978667497634888) | > loss_gen: 1.8661218881607056 (1.605522096157074) | > loss_kl: 5.710813045501709 (5.430488586425781) | > loss_feat: 0.14423197507858276 (3.7247024476528168) | > loss_mel: 4.863781929016113 (16.496150493621826) | > loss_duration: 3.211458444595337 (3.3122718334198) | > loss_1: 15.796406745910645 (30.56913423538208)  --> STEP: 3 | > loss_disc: 2.981750965118408 (2.992494821548462) | > loss_disc_real_0: 0.21210575103759766 (0.29133810599644977) | > loss_disc_real_1: 0.2488253116607666 (0.24982099731763205) | > loss_disc_real_2: 0.28890523314476013 (0.2518530289332072) | > loss_disc_real_3: 0.27793335914611816 (0.22056457151969275) | > loss_disc_real_4: 0.26426923274993896 (0.2085425704717636) | > loss_disc_real_5: 0.2979716360569 (0.18844310442606607) | > loss_0: 2.981750965118408 (2.992494821548462) | > loss_gen: 1.7355557680130005 (1.6488666534423828) | > loss_kl: 2.5804288387298584 (4.480468670527141) | > loss_feat: 2.539621591567993 (3.3296754956245422) | > loss_mel: 20.77950668334961 (17.923935890197754) | > loss_duration: 3.043544054031372 (3.2226959069569907) | > loss_1: 30.67865753173828 (30.60564200083415) --> EVAL PERFORMANCE | > avg_loader_time: 0.004610856374104817 (-0.03386569023132324) | > avg_loss_disc: 2.992494821548462 (-0.011887311935424805) | > avg_loss_disc_real_0: 0.29133810599644977 (-0.04826468229293823) | > avg_loss_disc_real_1: 0.24982099731763205 (-0.10758547484874723) | > avg_loss_disc_real_2: 0.2518530289332072 (-0.08402107159296668) | > avg_loss_disc_real_3: 0.22056457151969275 (-0.09964146465063092) | > avg_loss_disc_real_4: 0.2085425704717636 (-0.07464976608753204) | > avg_loss_disc_real_5: 0.18844310442606607 (-0.0952241470416387) | > avg_loss_0: 2.992494821548462 (-0.011887311935424805) | > avg_loss_gen: 1.6488666534423828 (-0.7626380920410156) | > avg_loss_kl: 4.480468670527141 (+0.0950788656870527) | > avg_loss_feat: 3.3296754956245422 (+0.49632729714115476) | > avg_loss_mel: 17.923935890197754 (+1.6353003978729248) | > avg_loss_duration: 3.2226959069569907 (-0.07242782910664847) | > avg_loss_1: 30.60564200083415 (+1.3916400273640974)  > EPOCH: 994/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:13:36)   --> TIME: 2023-10-20 12:13:53 -- STEP: 19/50 -- GLOBAL_STEP: 102720 | > loss_disc: 1.8496074676513672 (2.4477457560990987) | > loss_disc_real_0: 0.13286623358726501 (0.16328389746578117) | > loss_disc_real_1: 0.22777079045772552 (0.22044157834821626) | > loss_disc_real_2: 0.28106874227523804 (0.2378144575969169) | > loss_disc_real_3: 0.2707723081111908 (0.23319779836425655) | > loss_disc_real_4: 0.1372307986021042 (0.20119394180609992) | > loss_disc_real_5: 0.16808870434761047 (0.23117964214792378) | > loss_0: 1.8496074676513672 (2.4477457560990987) | > grad_norm_0: tensor(478.7003, device='cuda:0') (tensor(712.4207, device='cuda:0')) | > loss_gen: 3.319366216659546 (2.4320841274763407) | > loss_kl: 0.8254268765449524 (0.8012500703334808) | > loss_feat: 8.316859245300293 (5.975509059468382) | > loss_mel: 21.20903778076172 (20.470094705882826) | > loss_duration: 1.4752373695373535 (1.3970938105332225) | > loss_1: 35.14592742919922 (31.07603178526226) | > grad_norm_1: tensor(27931.5723, device='cuda:0') (tensor(23543.4648, device='cuda:0')) | > current_lr_0: 7.401407193208033e-05 | > current_lr_1: 7.401407193208033e-05 | > step_time: 0.3584 (0.5724684188240453) | > loader_time: 0.0174 (0.016746295125860917)  --> TIME: 2023-10-20 12:14:06 -- STEP: 49/50 -- GLOBAL_STEP: 102750 | > loss_disc: 3.0229625701904297 (2.507606411466794) | > loss_disc_real_0: 0.34097206592559814 (0.17072327047282335) | > loss_disc_real_1: 0.2617693245410919 (0.22363842696863778) | > loss_disc_real_2: 0.3227786123752594 (0.22874087304333035) | > loss_disc_real_3: 0.2704629898071289 (0.231346087910387) | > loss_disc_real_4: 0.23407474160194397 (0.2356184995258037) | > loss_disc_real_5: 0.23907792568206787 (0.24577060763781164) | > loss_0: 3.0229625701904297 (2.507606411466794) | > grad_norm_0: tensor(449.4943, device='cuda:0') (tensor(578.6423, device='cuda:0')) | > loss_gen: 1.6456011533737183 (2.279315301350185) | > loss_kl: 0.5569933652877808 (0.767231805592167) | > loss_feat: 0.02076004073023796 (5.323264610630517) | > loss_mel: 1.7888203859329224 (19.52231940687919) | > loss_duration: 1.4692280292510986 (1.3570226479549796) | > loss_1: 5.481403350830078 (29.24915376974612) | > grad_norm_1: tensor(60108.5625, device='cuda:0') (tensor(18998.4297, device='cuda:0')) | > current_lr_0: 7.401407193208033e-05 | > current_lr_1: 7.401407193208033e-05 | > step_time: 0.4819 (0.4673497725506217) | > loader_time: 0.7484 (0.026733301123794243)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0171921253204346 (3.0171921253204346) | > loss_disc_real_0: 0.31071627140045166 (0.31071627140045166) | > loss_disc_real_1: 0.2641080915927887 (0.2641080915927887) | > loss_disc_real_2: 0.31627577543258667 (0.31627577543258667) | > loss_disc_real_3: 0.2711433172225952 (0.2711433172225952) | > loss_disc_real_4: 0.233778178691864 (0.233778178691864) | > loss_disc_real_5: 0.24257148802280426 (0.24257148802280426) | > loss_0: 3.0171921253204346 (3.0171921253204346) | > loss_gen: 1.6395952701568604 (1.6395952701568604) | > loss_kl: 5.092094898223877 (5.092094898223877) | > loss_feat: 0.029431164264678955 (0.029431164264678955) | > loss_mel: 1.5264500379562378 (1.5264500379562378) | > loss_duration: 3.0941977500915527 (3.0941977500915527) | > loss_1: 11.381769180297852 (11.381769180297852)  --> STEP: 1 | > loss_disc: 2.587301254272461 (2.587301254272461) | > loss_disc_real_0: 0.2910984456539154 (0.2910984456539154) | > loss_disc_real_1: 0.21011599898338318 (0.21011599898338318) | > loss_disc_real_2: 0.29081079363822937 (0.29081079363822937) | > loss_disc_real_3: 0.282301127910614 (0.282301127910614) | > loss_disc_real_4: 0.2183953821659088 (0.2183953821659088) | > loss_disc_real_5: 0.1402413249015808 (0.1402413249015808) | > loss_0: 2.587301254272461 (2.587301254272461) | > loss_gen: 2.291666269302368 (2.291666269302368) | > loss_kl: 5.234008312225342 (5.234008312225342) | > loss_feat: 3.2632932662963867 (3.2632932662963867) | > loss_mel: 25.312009811401367 (25.312009811401367) | > loss_duration: 3.3964149951934814 (3.3964149951934814) | > loss_1: 39.49739456176758 (39.49739456176758)  --> STEP: 2 | > loss_disc: 3.083430767059326 (2.8353660106658936) | > loss_disc_real_0: 0.30913490056991577 (0.3001166731119156) | > loss_disc_real_1: 0.267021119594574 (0.23856855928897858) | > loss_disc_real_2: 0.3426319360733032 (0.3167213648557663) | > loss_disc_real_3: 0.2603973150253296 (0.2713492214679718) | > loss_disc_real_4: 0.23935635387897491 (0.22887586802244186) | > loss_disc_real_5: 0.2785668969154358 (0.2094041109085083) | > loss_0: 3.083430767059326 (2.8353660106658936) | > loss_gen: 1.689464807510376 (1.990565538406372) | > loss_kl: 5.892959117889404 (5.563483715057373) | > loss_feat: 0.8457180261611938 (2.0545056462287903) | > loss_mel: 6.0304412841796875 (15.671225547790527) | > loss_duration: 3.1294877529144287 (3.262951374053955) | > loss_1: 17.588069915771484 (28.54273223876953)  --> STEP: 3 | > loss_disc: 2.0819084644317627 (2.5842134952545166) | > loss_disc_real_0: 0.1417274922132492 (0.2473202794790268) | > loss_disc_real_1: 0.25605934858322144 (0.24439882238705954) | > loss_disc_real_2: 0.23017902672290802 (0.2878739188114802) | > loss_disc_real_3: 0.25478628277778625 (0.2658282419045766) | > loss_disc_real_4: 0.18479867279529572 (0.21418346961339316) | > loss_disc_real_5: 0.21183131635189056 (0.2102131793896357) | > loss_0: 2.0819084644317627 (2.5842134952545166) | > loss_gen: 3.620915412902832 (2.534015496571859) | > loss_kl: 2.2162623405456543 (4.4477432568868) | > loss_feat: 9.013083457946777 (4.37403158346812) | > loss_mel: 22.209766387939453 (17.850739161173504) | > loss_duration: 2.949084997177124 (3.1583292484283447) | > loss_1: 40.00910949707031 (32.36485799153646) --> EVAL PERFORMANCE | > avg_loader_time: 0.008084932963053385 (+0.0034740765889485674) | > avg_loss_disc: 2.5842134952545166 (-0.4082813262939453) | > avg_loss_disc_real_0: 0.2473202794790268 (-0.044017826517422975) | > avg_loss_disc_real_1: 0.24439882238705954 (-0.00542217493057251) | > avg_loss_disc_real_2: 0.2878739188114802 (+0.03602088987827301) | > avg_loss_disc_real_3: 0.2658282419045766 (+0.04526367038488385) | > avg_loss_disc_real_4: 0.21418346961339316 (+0.005640899141629546) | > avg_loss_disc_real_5: 0.2102131793896357 (+0.02177007496356964) | > avg_loss_0: 2.5842134952545166 (-0.4082813262939453) | > avg_loss_gen: 2.534015496571859 (+0.8851488431294761) | > avg_loss_kl: 4.4477432568868 (-0.03272541364034076) | > avg_loss_feat: 4.37403158346812 (+1.0443560878435774) | > avg_loss_mel: 17.850739161173504 (-0.07319672902425012) | > avg_loss_duration: 3.1583292484283447 (-0.06436665852864598) | > avg_loss_1: 32.36485799153646 (+1.7592159907023124)  > EPOCH: 995/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:14:24)   --> TIME: 2023-10-20 12:14:41 -- STEP: 29/50 -- GLOBAL_STEP: 102780 | > loss_disc: 2.035963773727417 (2.4437089870715965) | > loss_disc_real_0: 0.05777020379900932 (0.1421860691866484) | > loss_disc_real_1: 0.2309761494398117 (0.2216758410735377) | > loss_disc_real_2: 0.24925535917282104 (0.23008497117151475) | > loss_disc_real_3: 0.2590010166168213 (0.23037481821816544) | > loss_disc_real_4: 0.2212657481431961 (0.21597087864988837) | > loss_disc_real_5: 0.2540852129459381 (0.23223160836717177) | > loss_0: 2.035963773727417 (2.4437089870715965) | > grad_norm_0: tensor(387.2882, device='cuda:0') (tensor(529.1697, device='cuda:0')) | > loss_gen: 2.9018144607543945 (2.2549746200956147) | > loss_kl: 0.9763686060905457 (0.8440994908069742) | > loss_feat: 6.651150226593018 (5.307647256758706) | > loss_mel: 23.478084564208984 (20.742351548425084) | > loss_duration: 1.3756710290908813 (1.3573461647691398) | > loss_1: 35.383087158203125 (30.506419247594373) | > grad_norm_1: tensor(15298.4521, device='cuda:0') (tensor(21666.4805, device='cuda:0')) | > current_lr_0: 7.394009023321066e-05 | > current_lr_1: 7.394009023321066e-05 | > step_time: 0.2699 (0.3834789539205617) | > loader_time: 0.0017 (0.011864374423849171)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7638795375823975 (2.7638795375823975) | > loss_disc_real_0: 0.4441710114479065 (0.4441710114479065) | > loss_disc_real_1: 0.21604610979557037 (0.21604610979557037) | > loss_disc_real_2: 0.18924440443515778 (0.18924440443515778) | > loss_disc_real_3: 0.28460925817489624 (0.28460925817489624) | > loss_disc_real_4: 0.2165519744157791 (0.2165519744157791) | > loss_disc_real_5: 0.22840586304664612 (0.22840586304664612) | > loss_0: 2.7638795375823975 (2.7638795375823975) | > loss_gen: 2.3221993446350098 (2.3221993446350098) | > loss_kl: 4.24976921081543 (4.24976921081543) | > loss_feat: 6.062440395355225 (6.062440395355225) | > loss_mel: 21.754901885986328 (21.754901885986328) | > loss_duration: 3.053678274154663 (3.053678274154663) | > loss_1: 37.442989349365234 (37.442989349365234)  --> STEP: 1 | > loss_disc: 2.982407331466675 (2.982407331466675) | > loss_disc_real_0: 0.32075196504592896 (0.32075196504592896) | > loss_disc_real_1: 0.24270173907279968 (0.24270173907279968) | > loss_disc_real_2: 0.341189444065094 (0.341189444065094) | > loss_disc_real_3: 0.25034099817276 (0.25034099817276) | > loss_disc_real_4: 0.31636136770248413 (0.31636136770248413) | > loss_disc_real_5: 0.3161768615245819 (0.3161768615245819) | > loss_0: 2.982407331466675 (2.982407331466675) | > loss_gen: 2.066269874572754 (2.066269874572754) | > loss_kl: 5.204537391662598 (5.204537391662598) | > loss_feat: 4.615509510040283 (4.615509510040283) | > loss_mel: 22.174726486206055 (22.174726486206055) | > loss_duration: 3.40244722366333 (3.40244722366333) | > loss_1: 37.4634895324707 (37.4634895324707)  --> STEP: 2 | > loss_disc: 2.5855164527893066 (2.7839618921279907) | > loss_disc_real_0: 0.05784124881029129 (0.18929660692811012) | > loss_disc_real_1: 0.23164260387420654 (0.2371721714735031) | > loss_disc_real_2: 0.30468523502349854 (0.32293733954429626) | > loss_disc_real_3: 0.25638625025749207 (0.25336362421512604) | > loss_disc_real_4: 0.2185175120830536 (0.26743943989276886) | > loss_disc_real_5: 0.2754989564418793 (0.2958379089832306) | > loss_0: 2.5855164527893066 (2.7839618921279907) | > loss_gen: 1.9969744682312012 (2.0316221714019775) | > loss_kl: 6.275680065155029 (5.7401087284088135) | > loss_feat: 2.3519632816314697 (3.4837363958358765) | > loss_mel: 23.74452018737793 (22.959623336791992) | > loss_duration: 3.2901835441589355 (3.346315383911133) | > loss_1: 37.65932083129883 (37.561405181884766)  --> STEP: 3 | > loss_disc: 1.7705565690994263 (2.4461601177851358) | > loss_disc_real_0: 0.059665314853191376 (0.14608617623647055) | > loss_disc_real_1: 0.21017006039619446 (0.2281714677810669) | > loss_disc_real_2: 0.1786515861749649 (0.2748420884211858) | > loss_disc_real_3: 0.16244453191757202 (0.22305726011594137) | > loss_disc_real_4: 0.10681470483541489 (0.21389786154031754) | > loss_disc_real_5: 0.2721094489097595 (0.28792842229207355) | > loss_0: 1.7705565690994263 (2.4461601177851358) | > loss_gen: 2.8897807598114014 (2.3176750342051187) | > loss_kl: 2.5314087867736816 (4.670542081197103) | > loss_feat: 7.420649528503418 (4.796040773391724) | > loss_mel: 24.403261184692383 (23.44083595275879) | > loss_duration: 3.119978904724121 (3.2708698908487954) | > loss_1: 40.365081787109375 (38.49596405029297) --> EVAL PERFORMANCE | > avg_loader_time: 0.002116123835245768 (-0.005968809127807617) | > avg_loss_disc: 2.4461601177851358 (-0.13805337746938084) | > avg_loss_disc_real_0: 0.14608617623647055 (-0.10123410324255624) | > avg_loss_disc_real_1: 0.2281714677810669 (-0.016227354605992644) | > avg_loss_disc_real_2: 0.2748420884211858 (-0.01303183039029443) | > avg_loss_disc_real_3: 0.22305726011594137 (-0.042770981788635226) | > avg_loss_disc_real_4: 0.21389786154031754 (-0.00028560807307562164) | > avg_loss_disc_real_5: 0.28792842229207355 (+0.07771524290243784) | > avg_loss_0: 2.4461601177851358 (-0.13805337746938084) | > avg_loss_gen: 2.3176750342051187 (-0.2163404623667402) | > avg_loss_kl: 4.670542081197103 (+0.22279882431030273) | > avg_loss_feat: 4.796040773391724 (+0.42200918992360403) | > avg_loss_mel: 23.44083595275879 (+5.590096791585285) | > avg_loss_duration: 3.2708698908487954 (+0.1125406424204507) | > avg_loss_1: 38.49596405029297 (+6.131106058756508)  > EPOCH: 996/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:15:01)   --> TIME: 2023-10-20 12:15:12 -- STEP: 9/50 -- GLOBAL_STEP: 102810 | > loss_disc: 2.4337539672851562 (2.3330799871020846) | > loss_disc_real_0: 0.18449470400810242 (0.17097034657167065) | > loss_disc_real_1: 0.3904183506965637 (0.1950772185292509) | > loss_disc_real_2: 0.3007736802101135 (0.20146561393307316) | > loss_disc_real_3: 0.3695189356803894 (0.2026231566237079) | > loss_disc_real_4: 0.2585999071598053 (0.14605818895830047) | > loss_disc_real_5: 0.27487868070602417 (0.14550112870832285) | > loss_0: 2.4337539672851562 (2.3330799871020846) | > grad_norm_0: tensor(498.9506, device='cuda:0') (tensor(723.9485, device='cuda:0')) | > loss_gen: 3.0790302753448486 (2.257399731212192) | > loss_kl: 0.9296298027038574 (0.7530284590191312) | > loss_feat: 4.633510589599609 (6.234688603215748) | > loss_mel: 23.55445098876953 (19.807237731085884) | > loss_duration: 1.353804588317871 (1.3584484656651814) | > loss_1: 33.5504264831543 (30.41080315907796) | > grad_norm_1: tensor(10707.8721, device='cuda:0') (tensor(19294.6211, device='cuda:0')) | > current_lr_0: 7.386618248368097e-05 | > current_lr_1: 7.386618248368097e-05 | > step_time: 0.6186 (0.6229008568657769) | > loader_time: 0.0073 (0.02251956197950575)  --> TIME: 2023-10-20 12:15:32 -- STEP: 39/50 -- GLOBAL_STEP: 102840 | > loss_disc: 2.7345783710479736 (2.4449711059912658) | > loss_disc_real_0: 0.30431365966796875 (0.153550155269794) | > loss_disc_real_1: 0.32437989115715027 (0.22490440261287567) | > loss_disc_real_2: 0.2719506621360779 (0.22850954737991858) | > loss_disc_real_3: 0.27261683344841003 (0.22227399113277593) | > loss_disc_real_4: 0.3002081513404846 (0.2216300705495553) | > loss_disc_real_5: 0.21499910950660706 (0.22044454882733333) | > loss_0: 2.7345783710479736 (2.4449711059912658) | > grad_norm_0: tensor(1218.9481, device='cuda:0') (tensor(670.5742, device='cuda:0')) | > loss_gen: 2.334103584289551 (2.3434485533298592) | > loss_kl: 0.5635693669319153 (0.8277603464248853) | > loss_feat: 2.1549606323242188 (5.791316871459667) | > loss_mel: 19.826534271240234 (21.14130005469689) | > loss_duration: 1.3908542394638062 (1.3514080750636566) | > loss_1: 26.270023345947266 (31.45523390403161) | > grad_norm_1: tensor(4232.7534, device='cuda:0') (tensor(20726.1621, device='cuda:0')) | > current_lr_0: 7.386618248368097e-05 | > current_lr_1: 7.386618248368097e-05 | > step_time: 0.3454 (0.625901399514614) | > loader_time: 0.0023 (0.021132958240998097)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7674992084503174 (2.7674992084503174) | > loss_disc_real_0: 0.38378801941871643 (0.38378801941871643) | > loss_disc_real_1: 0.23328983783721924 (0.23328983783721924) | > loss_disc_real_2: 0.15814538300037384 (0.15814538300037384) | > loss_disc_real_3: 0.22978346049785614 (0.22978346049785614) | > loss_disc_real_4: 0.17657071352005005 (0.17657071352005005) | > loss_disc_real_5: 0.10484509915113449 (0.10484509915113449) | > loss_0: 2.7674992084503174 (2.7674992084503174) | > loss_gen: 1.7774547338485718 (1.7774547338485718) | > loss_kl: 4.353597164154053 (4.353597164154053) | > loss_feat: 3.4477758407592773 (3.4477758407592773) | > loss_mel: 20.98902130126953 (20.98902130126953) | > loss_duration: 3.0825576782226562 (3.0825576782226562) | > loss_1: 33.65040588378906 (33.65040588378906)  --> STEP: 1 | > loss_disc: 3.161816120147705 (3.161816120147705) | > loss_disc_real_0: 0.32632479071617126 (0.32632479071617126) | > loss_disc_real_1: 0.20189441740512848 (0.20189441740512848) | > loss_disc_real_2: 0.2319902926683426 (0.2319902926683426) | > loss_disc_real_3: 0.2165410816669464 (0.2165410816669464) | > loss_disc_real_4: 0.24537234008312225 (0.24537234008312225) | > loss_disc_real_5: 0.20688901841640472 (0.20688901841640472) | > loss_0: 3.161816120147705 (3.161816120147705) | > loss_gen: 1.5551459789276123 (1.5551459789276123) | > loss_kl: 5.102824687957764 (5.102824687957764) | > loss_feat: 3.612941265106201 (3.612941265106201) | > loss_mel: 21.315258026123047 (21.315258026123047) | > loss_duration: 3.4036056995391846 (3.4036056995391846) | > loss_1: 34.989776611328125 (34.989776611328125)  --> STEP: 2 | > loss_disc: 2.7934131622314453 (2.977614641189575) | > loss_disc_real_0: 0.20722226798534393 (0.2667735293507576) | > loss_disc_real_1: 0.23615163564682007 (0.21902302652597427) | > loss_disc_real_2: 0.2625732421875 (0.2472817674279213) | > loss_disc_real_3: 0.2715701758861542 (0.2440556287765503) | > loss_disc_real_4: 0.22479979693889618 (0.23508606851100922) | > loss_disc_real_5: 0.2336922287940979 (0.2202906236052513) | > loss_0: 2.7934131622314453 (2.977614641189575) | > loss_gen: 1.723252534866333 (1.6391992568969727) | > loss_kl: 5.844204425811768 (5.473514556884766) | > loss_feat: 0.8745021224021912 (2.243721693754196) | > loss_mel: 13.963211059570312 (17.63923454284668) | > loss_duration: 3.348512649536133 (3.3760591745376587) | > loss_1: 25.75368309020996 (30.371729850769043)  --> STEP: 3 | > loss_disc: 2.9654173851013184 (2.9735488891601562) | > loss_disc_real_0: 0.33635103702545166 (0.28996603190898895) | > loss_disc_real_1: 0.24566949903964996 (0.22790518403053284) | > loss_disc_real_2: 0.24053631722927094 (0.24503328402837118) | > loss_disc_real_3: 0.26940998435020447 (0.252507080634435) | > loss_disc_real_4: 0.22797764837741852 (0.23271659513314566) | > loss_disc_real_5: 0.23741474747657776 (0.22599866489569345) | > loss_0: 2.9654173851013184 (2.9735488891601562) | > loss_gen: 1.6221747398376465 (1.6335244178771973) | > loss_kl: 2.490144729614258 (4.479057947794597) | > loss_feat: 0.13405118882656097 (1.5404981921116512) | > loss_mel: 2.359588146209717 (12.546019077301025) | > loss_duration: 3.0359416007995605 (3.2626866499582925) | > loss_1: 9.641900062561035 (23.46178658803304) --> EVAL PERFORMANCE | > avg_loader_time: 0.0063170591990153 (+0.004200935363769531) | > avg_loss_disc: 2.9735488891601562 (+0.5273887713750205) | > avg_loss_disc_real_0: 0.28996603190898895 (+0.1438798556725184) | > avg_loss_disc_real_1: 0.22790518403053284 (-0.0002662837505340576) | > avg_loss_disc_real_2: 0.24503328402837118 (-0.02980880439281461) | > avg_loss_disc_real_3: 0.252507080634435 (+0.029449820518493625) | > avg_loss_disc_real_4: 0.23271659513314566 (+0.018818733592828124) | > avg_loss_disc_real_5: 0.22599866489569345 (-0.0619297573963801) | > avg_loss_0: 2.9735488891601562 (+0.5273887713750205) | > avg_loss_gen: 1.6335244178771973 (-0.6841506163279214) | > avg_loss_kl: 4.479057947794597 (-0.19148413340250592) | > avg_loss_feat: 1.5404981921116512 (-3.2555425812800722) | > avg_loss_mel: 12.546019077301025 (-10.894816875457764) | > avg_loss_duration: 3.2626866499582925 (-0.00818324089050293) | > avg_loss_1: 23.46178658803304 (-15.03417746225993)  > EPOCH: 997/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:15:52)   --> TIME: 2023-10-20 12:16:11 -- STEP: 19/50 -- GLOBAL_STEP: 102870 | > loss_disc: 2.9273388385772705 (2.5123039358540584) | > loss_disc_real_0: 0.2930881381034851 (0.17289730171231846) | > loss_disc_real_1: 0.38689619302749634 (0.23300335007278541) | > loss_disc_real_2: 0.23803827166557312 (0.2318928315255203) | > loss_disc_real_3: 0.26326408982276917 (0.27516992468582957) | > loss_disc_real_4: 0.33773717284202576 (0.21410313336864897) | > loss_disc_real_5: 0.44201236963272095 (0.22248663522891307) | > loss_0: 2.9273388385772705 (2.5123039358540584) | > grad_norm_0: tensor(665.8683, device='cuda:0') (tensor(565.3899, device='cuda:0')) | > loss_gen: 2.3372230529785156 (2.319160825327824) | > loss_kl: 0.8059571385383606 (0.7627298612343637) | > loss_feat: 3.7722067832946777 (5.789937614218185) | > loss_mel: 23.831998825073242 (21.655226908232038) | > loss_duration: 1.4916183948516846 (1.370678186416626) | > loss_1: 32.23900604248047 (31.89773348758095) | > grad_norm_1: tensor(3758.6331, device='cuda:0') (tensor(15162.9463, device='cuda:0')) | > current_lr_0: 7.379234860957426e-05 | > current_lr_1: 7.379234860957426e-05 | > step_time: 0.481 (0.5701279891164679) | > loader_time: 0.0025 (0.018441187708001388)  --> TIME: 2023-10-20 12:16:30 -- STEP: 49/50 -- GLOBAL_STEP: 102900 | > loss_disc: 2.281121253967285 (2.4522942815508166) | > loss_disc_real_0: 0.18878501653671265 (0.15080233838181106) | > loss_disc_real_1: 0.2810879647731781 (0.22374937075133228) | > loss_disc_real_2: 0.20796367526054382 (0.21325771252111514) | > loss_disc_real_3: 0.12868081033229828 (0.23793976168547365) | > loss_disc_real_4: 0.2528478503227234 (0.2225383960889006) | > loss_disc_real_5: 0.27114149928092957 (0.22371295978296168) | > loss_0: 2.281121253967285 (2.4522942815508166) | > grad_norm_0: tensor(447.6916, device='cuda:0') (tensor(509.0707, device='cuda:0')) | > loss_gen: 2.48447585105896 (2.2604687822108365) | > loss_kl: 0.8188468217849731 (0.723964963032275) | > loss_feat: 3.9480817317962646 (5.451752744120907) | > loss_mel: 22.001344680786133 (19.925551261220658) | > loss_duration: 1.468450665473938 (1.3448460539992972) | > loss_1: 30.72119903564453 (29.706583801580933) | > grad_norm_1: tensor(14841.7910, device='cuda:0') (tensor(17975.3008, device='cuda:0')) | > current_lr_0: 7.379234860957426e-05 | > current_lr_1: 7.379234860957426e-05 | > step_time: 0.8284 (0.5821166768365978) | > loader_time: 0.5166 (0.026793129590092873)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6744260787963867 (1.6744260787963867) | > loss_disc_real_0: 0.16744935512542725 (0.16744935512542725) | > loss_disc_real_1: 0.17888443171977997 (0.17888443171977997) | > loss_disc_real_2: 0.17129236459732056 (0.17129236459732056) | > loss_disc_real_3: 0.1243354082107544 (0.1243354082107544) | > loss_disc_real_4: 0.25656870007514954 (0.25656870007514954) | > loss_disc_real_5: 0.2663958668708801 (0.2663958668708801) | > loss_0: 1.6744260787963867 (1.6744260787963867) | > loss_gen: 3.597289562225342 (3.597289562225342) | > loss_kl: 4.920540809631348 (4.920540809631348) | > loss_feat: 9.480144500732422 (9.480144500732422) | > loss_mel: 22.522354125976562 (22.522354125976562) | > loss_duration: 3.109203815460205 (3.109203815460205) | > loss_1: 43.62953186035156 (43.62953186035156)  --> STEP: 1 | > loss_disc: 2.8860771656036377 (2.8860771656036377) | > loss_disc_real_0: 0.41439539194107056 (0.41439539194107056) | > loss_disc_real_1: 0.24841511249542236 (0.24841511249542236) | > loss_disc_real_2: 0.19353508949279785 (0.19353508949279785) | > loss_disc_real_3: 0.1584024876356125 (0.1584024876356125) | > loss_disc_real_4: 0.21708236634731293 (0.21708236634731293) | > loss_disc_real_5: 0.30969858169555664 (0.30969858169555664) | > loss_0: 2.8860771656036377 (2.8860771656036377) | > loss_gen: 1.9746466875076294 (1.9746466875076294) | > loss_kl: 5.208225727081299 (5.208225727081299) | > loss_feat: 5.792354583740234 (5.792354583740234) | > loss_mel: 25.602672576904297 (25.602672576904297) | > loss_duration: 3.3290674686431885 (3.3290674686431885) | > loss_1: 41.90696716308594 (41.90696716308594)  --> STEP: 2 | > loss_disc: 2.2635819911956787 (2.574829578399658) | > loss_disc_real_0: 0.20399366319179535 (0.30919452756643295) | > loss_disc_real_1: 0.16716796159744263 (0.2077915370464325) | > loss_disc_real_2: 0.204000785946846 (0.19876793771982193) | > loss_disc_real_3: 0.10886561125516891 (0.1336340494453907) | > loss_disc_real_4: 0.17374713718891144 (0.19541475176811218) | > loss_disc_real_5: 0.17508630454540253 (0.24239244312047958) | > loss_0: 2.2635819911956787 (2.574829578399658) | > loss_gen: 2.3229408264160156 (2.1487937569618225) | > loss_kl: 5.562023639678955 (5.385124683380127) | > loss_feat: 8.669931411743164 (7.231142997741699) | > loss_mel: 21.631607055664062 (23.61713981628418) | > loss_duration: 3.252268075942993 (3.290667772293091) | > loss_1: 41.43877410888672 (41.67287063598633)  --> STEP: 3 | > loss_disc: 3.007420063018799 (2.7190264066060386) | > loss_disc_real_0: 0.5225492119789124 (0.3803127557039261) | > loss_disc_real_1: 0.2691664397716522 (0.22824983795483908) | > loss_disc_real_2: 0.29052719473838806 (0.22935435672601065) | > loss_disc_real_3: 0.25548404455184937 (0.17425071448087692) | > loss_disc_real_4: 0.28931909799575806 (0.2267162005106608) | > loss_disc_real_5: 0.36806219816207886 (0.2842823614676793) | > loss_0: 3.007420063018799 (2.7190264066060386) | > loss_gen: 2.337589740753174 (2.2117257515589395) | > loss_kl: 2.560641050338745 (4.443630139033) | > loss_feat: 2.0581886768341064 (5.506824890772502) | > loss_mel: 17.963529586791992 (21.732603073120117) | > loss_duration: 2.995603561401367 (3.192313035329183) | > loss_1: 27.915552139282227 (37.087097803751625) --> EVAL PERFORMANCE | > avg_loader_time: 0.016484578450520832 (+0.010167519251505532) | > avg_loss_disc: 2.7190264066060386 (-0.2545224825541177) | > avg_loss_disc_real_0: 0.3803127557039261 (+0.09034672379493713) | > avg_loss_disc_real_1: 0.22824983795483908 (+0.000344653924306243) | > avg_loss_disc_real_2: 0.22935435672601065 (-0.015678927302360535) | > avg_loss_disc_real_3: 0.17425071448087692 (-0.07825636615355808) | > avg_loss_disc_real_4: 0.2267162005106608 (-0.0060003946224848614) | > avg_loss_disc_real_5: 0.2842823614676793 (+0.05828369657198587) | > avg_loss_0: 2.7190264066060386 (-0.2545224825541177) | > avg_loss_gen: 2.2117257515589395 (+0.5782013336817422) | > avg_loss_kl: 4.443630139033 (-0.03542780876159668) | > avg_loss_feat: 5.506824890772502 (+3.9663266986608505) | > avg_loss_mel: 21.732603073120117 (+9.186583995819092) | > avg_loss_duration: 3.192313035329183 (-0.0703736146291094) | > avg_loss_1: 37.087097803751625 (+13.625311215718586)  > EPOCH: 998/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:16:46)   --> TIME: 2023-10-20 12:17:07 -- STEP: 29/50 -- GLOBAL_STEP: 102930 | > loss_disc: 2.7255876064300537 (2.31886232310328) | > loss_disc_real_0: 0.18472133576869965 (0.14121618900640767) | > loss_disc_real_1: 0.2511483132839203 (0.21757791936397552) | > loss_disc_real_2: 0.2597973048686981 (0.22023221734782744) | > loss_disc_real_3: 0.3468805253505707 (0.22489595631587095) | > loss_disc_real_4: 0.36737897992134094 (0.222211810535398) | > loss_disc_real_5: 0.35325559973716736 (0.1898375496525189) | > loss_0: 2.7255876064300537 (2.31886232310328) | > grad_norm_0: tensor(592.7114, device='cuda:0') (tensor(587.3340, device='cuda:0')) | > loss_gen: 2.565997362136841 (2.41454226806246) | > loss_kl: 0.6020881533622742 (0.7611564510855181) | > loss_feat: 4.8546881675720215 (6.069149163776431) | > loss_mel: 26.043704986572266 (21.378455277146966) | > loss_duration: 1.314210057258606 (1.3532242322790207) | > loss_1: 35.38068771362305 (31.9765270002957) | > grad_norm_1: tensor(20376.7344, device='cuda:0') (tensor(20733.8672, device='cuda:0')) | > current_lr_0: 7.37185885370474e-05 | > current_lr_1: 7.37185885370474e-05 | > step_time: 0.3617 (0.5413179150943098) | > loader_time: 0.0144 (0.021530784409621667)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.895557403564453 (2.895557403564453) | > loss_disc_real_0: 0.1739773154258728 (0.1739773154258728) | > loss_disc_real_1: 0.28393349051475525 (0.28393349051475525) | > loss_disc_real_2: 0.25318270921707153 (0.25318270921707153) | > loss_disc_real_3: 0.26548272371292114 (0.26548272371292114) | > loss_disc_real_4: 0.24212466180324554 (0.24212466180324554) | > loss_disc_real_5: 0.25416305661201477 (0.25416305661201477) | > loss_0: 2.895557403564453 (2.895557403564453) | > loss_gen: 1.584881067276001 (1.584881067276001) | > loss_kl: 5.376114845275879 (5.376114845275879) | > loss_feat: 0.2878771126270294 (0.2878771126270294) | > loss_mel: 11.146248817443848 (11.146248817443848) | > loss_duration: 3.072054147720337 (3.072054147720337) | > loss_1: 21.46717643737793 (21.46717643737793)  --> STEP: 1 | > loss_disc: 2.4284322261810303 (2.4284322261810303) | > loss_disc_real_0: 0.05898957699537277 (0.05898957699537277) | > loss_disc_real_1: 0.25374120473861694 (0.25374120473861694) | > loss_disc_real_2: 0.19782914221286774 (0.19782914221286774) | > loss_disc_real_3: 0.25283679366111755 (0.25283679366111755) | > loss_disc_real_4: 0.13912996649742126 (0.13912996649742126) | > loss_disc_real_5: 0.20149174332618713 (0.20149174332618713) | > loss_0: 2.4284322261810303 (2.4284322261810303) | > loss_gen: 1.8522732257843018 (1.8522732257843018) | > loss_kl: 5.262784481048584 (5.262784481048584) | > loss_feat: 4.2940521240234375 (4.2940521240234375) | > loss_mel: 20.2314395904541 (20.2314395904541) | > loss_duration: 3.346111536026001 (3.346111536026001) | > loss_1: 34.986663818359375 (34.986663818359375)  --> STEP: 2 | > loss_disc: 2.4812419414520264 (2.4548370838165283) | > loss_disc_real_0: 0.12591485679149628 (0.09245221689343452) | > loss_disc_real_1: 0.12411445379257202 (0.18892782926559448) | > loss_disc_real_2: 0.06446578353643417 (0.13114746287465096) | > loss_disc_real_3: 0.08515891432762146 (0.1689978539943695) | > loss_disc_real_4: 0.06220085918903351 (0.10066541284322739) | > loss_disc_real_5: 0.1142963394522667 (0.1578940413892269) | > loss_0: 2.4812419414520264 (2.4548370838165283) | > loss_gen: 1.596003770828247 (1.7241384983062744) | > loss_kl: 5.742892265319824 (5.502838373184204) | > loss_feat: 10.186530113220215 (7.240291118621826) | > loss_mel: 23.085405349731445 (21.658422470092773) | > loss_duration: 3.2371554374694824 (3.2916334867477417) | > loss_1: 43.84798812866211 (39.41732597351074)  --> STEP: 3 | > loss_disc: 2.276012659072876 (2.395228942235311) | > loss_disc_real_0: 0.06779403984546661 (0.08423282454411189) | > loss_disc_real_1: 0.32416313886642456 (0.2340062657992045) | > loss_disc_real_2: 0.26671695709228516 (0.17633729428052902) | > loss_disc_real_3: 0.29218071699142456 (0.2100588083267212) | > loss_disc_real_4: 0.11812245100736618 (0.10648442556460698) | > loss_disc_real_5: 0.1535739004611969 (0.15645399441321692) | > loss_0: 2.276012659072876 (2.395228942235311) | > loss_gen: 2.569366693496704 (2.0058812300364175) | > loss_kl: 2.4587020874023438 (4.488126277923584) | > loss_feat: 5.606876373291016 (6.69581953684489) | > loss_mel: 25.127838134765625 (22.81489435831706) | > loss_duration: 2.9087135791778564 (3.16399351755778) | > loss_1: 38.6714973449707 (39.16871643066406) --> EVAL PERFORMANCE | > avg_loader_time: 0.017273346583048504 (+0.0007887681325276716) | > avg_loss_disc: 2.395228942235311 (-0.32379746437072754) | > avg_loss_disc_real_0: 0.08423282454411189 (-0.2960799311598142) | > avg_loss_disc_real_1: 0.2340062657992045 (+0.005756427844365419) | > avg_loss_disc_real_2: 0.17633729428052902 (-0.05301706244548163) | > avg_loss_disc_real_3: 0.2100588083267212 (+0.03580809384584427) | > avg_loss_disc_real_4: 0.10648442556460698 (-0.12023177494605382) | > avg_loss_disc_real_5: 0.15645399441321692 (-0.1278283670544624) | > avg_loss_0: 2.395228942235311 (-0.32379746437072754) | > avg_loss_gen: 2.0058812300364175 (-0.20584452152252197) | > avg_loss_kl: 4.488126277923584 (+0.044496138890584014) | > avg_loss_feat: 6.69581953684489 (+1.1889946460723877) | > avg_loss_mel: 22.81489435831706 (+1.0822912851969413) | > avg_loss_duration: 3.16399351755778 (-0.02831951777140329) | > avg_loss_1: 39.16871643066406 (+2.0816186269124373)  > EPOCH: 999/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:17:39)   --> TIME: 2023-10-20 12:17:50 -- STEP: 9/50 -- GLOBAL_STEP: 102960 | > loss_disc: 2.5206406116485596 (2.395612504747179) | > loss_disc_real_0: 0.07625985890626907 (0.1130576462795337) | > loss_disc_real_1: 0.3238140642642975 (0.27676838056908715) | > loss_disc_real_2: 0.2861127257347107 (0.2368225682940748) | > loss_disc_real_3: 0.25924476981163025 (0.22991130294071305) | > loss_disc_real_4: 0.2588998079299927 (0.1637818995449278) | > loss_disc_real_5: 0.2871755361557007 (0.14654562539524502) | > loss_0: 2.5206406116485596 (2.395612504747179) | > grad_norm_0: tensor(511.4131, device='cuda:0') (tensor(457.2160, device='cuda:0')) | > loss_gen: 2.3498013019561768 (2.335634469985962) | > loss_kl: 0.6445750594139099 (0.7974795235527886) | > loss_feat: 3.9691216945648193 (7.437712854809231) | > loss_mel: 25.4605770111084 (23.00013181898329) | > loss_duration: 1.2796833515167236 (1.3745876550674438) | > loss_1: 33.703758239746094 (34.945546044243706) | > grad_norm_1: tensor(7314.4546, device='cuda:0') (tensor(27100.9434, device='cuda:0')) | > current_lr_0: 7.36449021923311e-05 | > current_lr_1: 7.36449021923311e-05 | > step_time: 0.8241 (0.6489310794406467) | > loader_time: 0.035 (0.02303494347466363)  --> TIME: 2023-10-20 12:18:08 -- STEP: 39/50 -- GLOBAL_STEP: 102990 | > loss_disc: 2.1499075889587402 (2.4845581268652897) | > loss_disc_real_0: 0.14950810372829437 (0.14337675001185676) | > loss_disc_real_1: 0.1957215964794159 (0.22773284952227885) | > loss_disc_real_2: 0.1604180932044983 (0.2295132244531161) | > loss_disc_real_3: 0.14874528348445892 (0.23234347158517593) | > loss_disc_real_4: 0.21281538903713226 (0.22027917578816414) | > loss_disc_real_5: 0.19463710486888885 (0.2310010145107905) | > loss_0: 2.1499075889587402 (2.4845581268652897) | > grad_norm_0: tensor(391.6883, device='cuda:0') (tensor(698.3630, device='cuda:0')) | > loss_gen: 2.2463324069976807 (2.2687430718006234) | > loss_kl: 0.41886603832244873 (0.8380583501779116) | > loss_feat: 4.207512855529785 (5.972626044295538) | > loss_mel: 15.619385719299316 (20.873723020920387) | > loss_duration: 1.4042264223098755 (1.3456996832138455) | > loss_1: 23.896324157714844 (31.298849704938057) | > grad_norm_1: tensor(10354.6855, device='cuda:0') (tensor(21777.2715, device='cuda:0')) | > current_lr_0: 7.36449021923311e-05 | > current_lr_1: 7.36449021923311e-05 | > step_time: 0.4403 (0.5953702376439023) | > loader_time: 0.0153 (0.0193634033203125)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.823028087615967 (2.823028087615967) | > loss_disc_real_0: 0.23439323902130127 (0.23439323902130127) | > loss_disc_real_1: 0.27733591198921204 (0.27733591198921204) | > loss_disc_real_2: 0.28172749280929565 (0.28172749280929565) | > loss_disc_real_3: 0.2606227695941925 (0.2606227695941925) | > loss_disc_real_4: 0.2669387459754944 (0.2669387459754944) | > loss_disc_real_5: 0.2925489544868469 (0.2925489544868469) | > loss_0: 2.823028087615967 (2.823028087615967) | > loss_gen: 1.8877811431884766 (1.8877811431884766) | > loss_kl: 5.834074974060059 (5.834074974060059) | > loss_feat: 0.8604193329811096 (0.8604193329811096) | > loss_mel: 15.306912422180176 (15.306912422180176) | > loss_duration: 3.090639352798462 (3.090639352798462) | > loss_1: 26.979827880859375 (26.979827880859375)  --> STEP: 1 | > loss_disc: 1.626739740371704 (1.626739740371704) | > loss_disc_real_0: 0.024123888462781906 (0.024123888462781906) | > loss_disc_real_1: 0.12596659362316132 (0.12596659362316132) | > loss_disc_real_2: 0.1390388160943985 (0.1390388160943985) | > loss_disc_real_3: 0.047641556710004807 (0.047641556710004807) | > loss_disc_real_4: 0.14875954389572144 (0.14875954389572144) | > loss_disc_real_5: 0.06589189171791077 (0.06589189171791077) | > loss_0: 1.626739740371704 (1.626739740371704) | > loss_gen: 2.569427013397217 (2.569427013397217) | > loss_kl: 5.577348709106445 (5.577348709106445) | > loss_feat: 11.294530868530273 (11.294530868530273) | > loss_mel: 25.5081787109375 (25.5081787109375) | > loss_duration: 3.375288724899292 (3.375288724899292) | > loss_1: 48.32477569580078 (48.32477569580078)  --> STEP: 2 | > loss_disc: 1.449979305267334 (1.538359522819519) | > loss_disc_real_0: 0.030486002564430237 (0.02730494551360607) | > loss_disc_real_1: 0.07219409942626953 (0.09908034652471542) | > loss_disc_real_2: 0.045693423599004745 (0.09236611984670162) | > loss_disc_real_3: 0.07821135967969894 (0.06292645819485188) | > loss_disc_real_4: 0.07181809842586517 (0.1102888211607933) | > loss_disc_real_5: 0.03139277175068855 (0.04864233173429966) | > loss_0: 1.449979305267334 (1.538359522819519) | > loss_gen: 3.171968936920166 (2.8706979751586914) | > loss_kl: 5.500551700592041 (5.538950204849243) | > loss_feat: 17.385908126831055 (14.340219497680664) | > loss_mel: 23.722393035888672 (24.615285873413086) | > loss_duration: 3.248208999633789 (3.3117488622665405) | > loss_1: 53.029029846191406 (50.676902770996094)  --> STEP: 3 | > loss_disc: 2.802337169647217 (1.9596854050954182) | > loss_disc_real_0: 0.2079058587551117 (0.08750524992744128) | > loss_disc_real_1: 0.2742807865142822 (0.15748049318790436) | > loss_disc_real_2: 0.28010398149490356 (0.15494540706276894) | > loss_disc_real_3: 0.28120487928390503 (0.13568593189120293) | > loss_disc_real_4: 0.28548872470855713 (0.1686887890100479) | > loss_disc_real_5: 0.28225961327552795 (0.1265147589147091) | > loss_0: 2.802337169647217 (1.9596854050954182) | > loss_gen: 1.902862548828125 (2.548086166381836) | > loss_kl: 2.569003105163574 (4.5489678382873535) | > loss_feat: 1.0508809089660645 (9.91043996810913) | > loss_mel: 16.280113220214844 (21.836894989013672) | > loss_duration: 3.1243677139282227 (3.249288479487101) | > loss_1: 24.927227020263672 (42.09367752075195) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_103000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0072901248931885 (1.9715865850448608) | > loss_disc_real_0: 0.19496244192123413 (0.11436954792588949) | > loss_disc_real_1: 0.2569379210472107 (0.18234485015273094) | > loss_disc_real_2: 0.2519683539867401 (0.17920114379376173) | > loss_disc_real_3: 0.2014845907688141 (0.15213559661060572) | > loss_disc_real_4: 0.2407798171043396 (0.18671154603362083) | > loss_disc_real_5: 0.23513765633106232 (0.1536704832687974) | > loss_0: 2.0072901248931885 (1.9715865850448608) | > loss_gen: 3.196169853210449 (2.7101070880889893) | > loss_kl: 5.915606498718262 (4.890627503395081) | > loss_feat: 8.217849731445312 (9.487292408943176) | > loss_mel: 22.0314884185791 (21.88554334640503) | > loss_duration: 3.1745002269744873 (3.2305914163589478) | > loss_1: 42.535614013671875 (42.204161643981934)  --> STEP: 1 | > loss_disc: 2.8095338344573975 (2.139176034927368) | > loss_disc_real_0: 0.1629399061203003 (0.12408361956477165) | > loss_disc_real_1: 0.31409141421318054 (0.20869416296482085) | > loss_disc_real_2: 0.4160294830799103 (0.22656681165099143) | > loss_disc_real_3: 0.3030034005641937 (0.1823091574013233) | > loss_disc_real_4: 0.226059228181839 (0.19458108246326447) | > loss_disc_real_5: 0.3479157090187073 (0.19251952841877937) | > loss_0: 2.8095338344573975 (2.139176034927368) | > loss_gen: 2.7954869270324707 (2.7271830558776857) | > loss_kl: 5.4328932762146 (4.999080657958984) | > loss_feat: 8.565792083740234 (9.302992343902588) | > loss_mel: 22.074512481689453 (21.923337173461913) | > loss_duration: 3.429741144180298 (3.270421361923218) | > loss_1: 42.298423767089844 (42.22301406860352)  --> STEP: 2 | > loss_disc: 2.498584747314453 (2.1990774869918823) | > loss_disc_real_0: 0.4631820321083069 (0.18060002165536085) | > loss_disc_real_1: 0.1413770467042923 (0.1974746435880661) | > loss_disc_real_2: 0.19187195599079132 (0.22078433570762476) | > loss_disc_real_3: 0.18851301074028015 (0.18334313295781612) | > loss_disc_real_4: 0.14197856187820435 (0.18581399569908777) | > loss_disc_real_5: 0.3078162372112274 (0.21173564655085406) | > loss_0: 2.498584747314453 (2.1990774869918823) | > loss_gen: 2.801097869873047 (2.739502191543579) | > loss_kl: 5.40413761138916 (5.066590150197347) | > loss_feat: 8.250184059143066 (9.127524296442667) | > loss_mel: 22.50132179260254 (22.019667943318684) | > loss_duration: 3.370924472808838 (3.2871718804041543) | > loss_1: 42.327667236328125 (42.24045626322428)  --> STEP: 3 | > loss_disc: 2.9032344818115234 (2.2996713433946883) | > loss_disc_real_0: 0.280910849571228 (0.19493013992905617) | > loss_disc_real_1: 0.2968496084213257 (0.2116710671356746) | > loss_disc_real_2: 0.2645418643951416 (0.22703541123441287) | > loss_disc_real_3: 0.28030815720558167 (0.1971952792789255) | > loss_disc_real_4: 0.29229292273521423 (0.20102527098996298) | > loss_disc_real_5: 0.2950466275215149 (0.22363721526094846) | > loss_0: 2.9032344818115234 (2.2996713433946883) | > loss_gen: 1.8823983669281006 (2.6170587880270824) | > loss_kl: 2.521777629852295 (4.703045504433768) | > loss_feat: 0.7398799657821655 (7.9292893920625955) | > loss_mel: 16.635047912597656 (21.250436510358536) | > loss_duration: 3.0206973552703857 (3.2491040910993303) | > loss_1: 24.799800872802734 (39.74893406459263) --> EVAL PERFORMANCE | > avg_loader_time: 0.6824785641261509 (+0.6652052175431025) | > avg_loss_disc: 2.2996713433946883 (-0.09555759884062276) | > avg_loss_disc_real_0: 0.19493013992905617 (+0.11069731538494428) | > avg_loss_disc_real_1: 0.2116710671356746 (-0.022335198663529898) | > avg_loss_disc_real_2: 0.22703541123441287 (+0.05069811695388385) | > avg_loss_disc_real_3: 0.1971952792789255 (-0.012863529047795697) | > avg_loss_disc_real_4: 0.20102527098996298 (+0.094540845425356) | > avg_loss_disc_real_5: 0.22363721526094846 (+0.06718322084773154) | > avg_loss_0: 2.2996713433946883 (-0.09555759884062276) | > avg_loss_gen: 2.6170587880270824 (+0.6111775579906649) | > avg_loss_kl: 4.703045504433768 (+0.21491922651018402) | > avg_loss_feat: 7.9292893920625955 (+1.233469855217706) | > avg_loss_mel: 21.250436510358536 (-1.564457847958522) | > avg_loss_duration: 3.2491040910993303 (+0.0851105735415505) | > avg_loss_1: 39.74893406459263 (+0.5802176339285694)  > EPOCH: 1000/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:18:40)   --> TIME: 2023-10-20 12:19:05 -- STEP: 19/50 -- GLOBAL_STEP: 103020 | > loss_disc: 2.9752466678619385 (2.340624119106092) | > loss_disc_real_0: 0.17483702301979065 (0.13170844551764035) | > loss_disc_real_1: 0.28801169991493225 (0.2674747523116438) | > loss_disc_real_2: 0.23933881521224976 (0.24206880127128802) | > loss_disc_real_3: 0.3242327868938446 (0.23665503588946243) | > loss_disc_real_4: 0.4515053331851959 (0.2272052029637914) | > loss_disc_real_5: 0.4049888253211975 (0.2289077453315258) | > loss_0: 2.9752466678619385 (2.340624119106092) | > grad_norm_0: tensor(679.8882, device='cuda:0') (tensor(502.9684, device='cuda:0')) | > loss_gen: 2.203789472579956 (2.5382511239302787) | > loss_kl: 1.1458840370178223 (0.8098536823925219) | > loss_feat: 4.3350067138671875 (6.278092229052594) | > loss_mel: 21.286441802978516 (21.58654031000639) | > loss_duration: 1.4844164848327637 (1.3788232301410877) | > loss_1: 30.455537796020508 (32.59156141783062) | > grad_norm_1: tensor(9339.0459, device='cuda:0') (tensor(22105.0273, device='cuda:0')) | > current_lr_0: 7.35712895017298e-05 | > current_lr_1: 7.35712895017298e-05 | > step_time: 0.5061 (0.6542084593521921) | > loader_time: 0.0285 (0.022002370733963817)  --> TIME: 2023-10-20 12:19:26 -- STEP: 49/50 -- GLOBAL_STEP: 103050 | > loss_disc: 2.2663941383361816 (2.34548442704337) | > loss_disc_real_0: 0.08168132603168488 (0.13305894957323158) | > loss_disc_real_1: 0.3462929129600525 (0.23899614043077647) | > loss_disc_real_2: 0.1808992326259613 (0.21976150329015692) | > loss_disc_real_3: 0.27306023240089417 (0.23904290361976138) | > loss_disc_real_4: 0.1701081246137619 (0.20481669929410726) | > loss_disc_real_5: 0.2837503254413605 (0.2214872773204531) | > loss_0: 2.2663941383361816 (2.34548442704337) | > grad_norm_0: tensor(507.0418, device='cuda:0') (tensor(645.4419, device='cuda:0')) | > loss_gen: 2.7081074714660645 (2.4471270940741716) | > loss_kl: 0.7376628518104553 (0.7600603815244169) | > loss_feat: 5.761005401611328 (6.280908400306896) | > loss_mel: 25.47313690185547 (21.78695050550967) | > loss_duration: 1.4189499616622925 (1.3446111095194915) | > loss_1: 36.09886169433594 (32.61965780842062) | > grad_norm_1: tensor(8818.4395, device='cuda:0') (tensor(18124.3066, device='cuda:0')) | > current_lr_0: 7.35712895017298e-05 | > current_lr_1: 7.35712895017298e-05 | > step_time: 1.2731 (0.6423410396186674) | > loader_time: 0.4848 (0.03064794443091567)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.076817512512207 (3.076817512512207) | > loss_disc_real_0: 0.13460838794708252 (0.13460838794708252) | > loss_disc_real_1: 0.24373136460781097 (0.24373136460781097) | > loss_disc_real_2: 0.18262016773223877 (0.18262016773223877) | > loss_disc_real_3: 0.28642168641090393 (0.28642168641090393) | > loss_disc_real_4: 0.26115062832832336 (0.26115062832832336) | > loss_disc_real_5: 0.27088937163352966 (0.27088937163352966) | > loss_0: 3.076817512512207 (3.076817512512207) | > loss_gen: 1.42130708694458 (1.42130708694458) | > loss_kl: 4.795045375823975 (4.795045375823975) | > loss_feat: 0.9750522375106812 (0.9750522375106812) | > loss_mel: 16.302248001098633 (16.302248001098633) | > loss_duration: 3.0506694316864014 (3.0506694316864014) | > loss_1: 26.544321060180664 (26.544321060180664)  --> STEP: 1 | > loss_disc: 1.8794982433319092 (1.8794982433319092) | > loss_disc_real_0: 0.07688544690608978 (0.07688544690608978) | > loss_disc_real_1: 0.22828376293182373 (0.22828376293182373) | > loss_disc_real_2: 0.23770923912525177 (0.23770923912525177) | > loss_disc_real_3: 0.16358530521392822 (0.16358530521392822) | > loss_disc_real_4: 0.1238679513335228 (0.1238679513335228) | > loss_disc_real_5: 0.13373295962810516 (0.13373295962810516) | > loss_0: 1.8794982433319092 (1.8794982433319092) | > loss_gen: 2.5813894271850586 (2.5813894271850586) | > loss_kl: 4.819139003753662 (4.819139003753662) | > loss_feat: 10.644108772277832 (10.644108772277832) | > loss_mel: 22.354700088500977 (22.354700088500977) | > loss_duration: 3.4384889602661133 (3.4384889602661133) | > loss_1: 43.837825775146484 (43.837825775146484)  --> STEP: 2 | > loss_disc: 2.4408838748931885 (2.160191059112549) | > loss_disc_real_0: 0.14989762008190155 (0.11339153349399567) | > loss_disc_real_1: 0.21214231848716736 (0.22021304070949554) | > loss_disc_real_2: 0.3156917095184326 (0.2767004743218422) | > loss_disc_real_3: 0.3369128704071045 (0.25024908781051636) | > loss_disc_real_4: 0.30040931701660156 (0.21213863417506218) | > loss_disc_real_5: 0.18829427659511566 (0.1610136181116104) | > loss_0: 2.4408838748931885 (2.160191059112549) | > loss_gen: 2.4785406589508057 (2.529965043067932) | > loss_kl: 5.642962455749512 (5.231050729751587) | > loss_feat: 3.6619701385498047 (7.153039455413818) | > loss_mel: 25.63983726501465 (23.997268676757812) | > loss_duration: 3.161346197128296 (3.2999175786972046) | > loss_1: 40.584659576416016 (42.21124267578125)  --> STEP: 3 | > loss_disc: 2.6207592487335205 (2.313713788986206) | > loss_disc_real_0: 0.10382559895515442 (0.11020288864771526) | > loss_disc_real_1: 0.23157496750354767 (0.22400034964084625) | > loss_disc_real_2: 0.1841825246810913 (0.24586115777492523) | > loss_disc_real_3: 0.14354939758777618 (0.2146825244029363) | > loss_disc_real_4: 0.2544918358325958 (0.22625636806090674) | > loss_disc_real_5: 0.38864994049072266 (0.23689239223798117) | > loss_0: 2.6207592487335205 (2.313713788986206) | > loss_gen: 2.1097540855407715 (2.389894723892212) | > loss_kl: 2.4577865600585938 (4.306629339853923) | > loss_feat: 6.729157447814941 (7.011745452880859) | > loss_mel: 24.56903648376465 (24.18785794576009) | > loss_duration: 3.103992223739624 (3.2346091270446777) | > loss_1: 38.9697265625 (41.1307373046875) --> EVAL PERFORMANCE | > avg_loader_time: 0.020548025767008465 (-0.6619305383591425) | > avg_loss_disc: 2.313713788986206 (+0.014042445591517794) | > avg_loss_disc_real_0: 0.11020288864771526 (-0.08472725128134091) | > avg_loss_disc_real_1: 0.22400034964084625 (+0.012329282505171651) | > avg_loss_disc_real_2: 0.24586115777492523 (+0.01882574654051236) | > avg_loss_disc_real_3: 0.2146825244029363 (+0.017487245124010814) | > avg_loss_disc_real_4: 0.22625636806090674 (+0.02523109707094376) | > avg_loss_disc_real_5: 0.23689239223798117 (+0.013255176977032712) | > avg_loss_0: 2.313713788986206 (+0.014042445591517794) | > avg_loss_gen: 2.389894723892212 (-0.22716406413487045) | > avg_loss_kl: 4.306629339853923 (-0.3964161645798452) | > avg_loss_feat: 7.011745452880859 (-0.9175439391817362) | > avg_loss_mel: 24.18785794576009 (+2.9374214354015535) | > avg_loss_duration: 3.2346091270446777 (-0.01449496405465256) | > avg_loss_1: 41.1307373046875 (+1.381803240094868)  > EPOCH: 1001/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:19:46)   --> TIME: 2023-10-20 12:20:11 -- STEP: 29/50 -- GLOBAL_STEP: 103080 | > loss_disc: 3.0193495750427246 (2.5153345404000116) | > loss_disc_real_0: 0.18255296349525452 (0.15183923849514847) | > loss_disc_real_1: 0.29359081387519836 (0.22441798063187762) | > loss_disc_real_2: 0.26410043239593506 (0.23190125411954418) | > loss_disc_real_3: 0.24744956195354462 (0.2504134512153165) | > loss_disc_real_4: 0.2612791359424591 (0.2363863987527017) | > loss_disc_real_5: 0.29146310687065125 (0.24949468418570428) | > loss_0: 3.0193495750427246 (2.5153345404000116) | > grad_norm_0: tensor(743.0845, device='cuda:0') (tensor(596.9936, device='cuda:0')) | > loss_gen: 1.564582347869873 (2.2654486689074287) | > loss_kl: 0.7206210494041443 (0.8485669163537437) | > loss_feat: 0.08924709260463715 (5.23809175552993) | > loss_mel: 5.984686374664307 (19.31881877882727) | > loss_duration: 1.3347923755645752 (1.3651760775467445) | > loss_1: 9.693928718566895 (29.036102558004444) | > grad_norm_1: tensor(17577.9336, device='cuda:0') (tensor(15062.1465, device='cuda:0')) | > current_lr_0: 7.34977503916216e-05 | > current_lr_1: 7.34977503916216e-05 | > step_time: 0.3363 (0.5976384672625314) | > loader_time: 0.0092 (0.02280837914039349)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.67000675201416 (2.67000675201416) | > loss_disc_real_0: 0.15483711659908295 (0.15483711659908295) | > loss_disc_real_1: 0.3313569724559784 (0.3313569724559784) | > loss_disc_real_2: 0.24669033288955688 (0.24669033288955688) | > loss_disc_real_3: 0.42140644788742065 (0.42140644788742065) | > loss_disc_real_4: 0.25161683559417725 (0.25161683559417725) | > loss_disc_real_5: 0.24949824810028076 (0.24949824810028076) | > loss_0: 2.67000675201416 (2.67000675201416) | > loss_gen: 2.5107836723327637 (2.5107836723327637) | > loss_kl: 4.945125579833984 (4.945125579833984) | > loss_feat: 9.198402404785156 (9.198402404785156) | > loss_mel: 20.271812438964844 (20.271812438964844) | > loss_duration: 3.0492093563079834 (3.0492093563079834) | > loss_1: 39.97533416748047 (39.97533416748047)  --> STEP: 1 | > loss_disc: 2.8902368545532227 (2.8902368545532227) | > loss_disc_real_0: 0.3830046057701111 (0.3830046057701111) | > loss_disc_real_1: 0.29417815804481506 (0.29417815804481506) | > loss_disc_real_2: 0.2723613679409027 (0.2723613679409027) | > loss_disc_real_3: 0.24833868443965912 (0.24833868443965912) | > loss_disc_real_4: 0.32399898767471313 (0.32399898767471313) | > loss_disc_real_5: 0.28501856327056885 (0.28501856327056885) | > loss_0: 2.8902368545532227 (2.8902368545532227) | > loss_gen: 2.230142116546631 (2.230142116546631) | > loss_kl: 5.206022262573242 (5.206022262573242) | > loss_feat: 2.5948755741119385 (2.5948755741119385) | > loss_mel: 21.191730499267578 (21.191730499267578) | > loss_duration: 3.358001470565796 (3.358001470565796) | > loss_1: 34.580772399902344 (34.580772399902344)  --> STEP: 2 | > loss_disc: 2.0250227451324463 (2.4576297998428345) | > loss_disc_real_0: 0.24364781379699707 (0.3133262097835541) | > loss_disc_real_1: 0.0987338125705719 (0.19645598530769348) | > loss_disc_real_2: 0.04412901774048805 (0.15824519284069538) | > loss_disc_real_3: 0.015392209403216839 (0.13186544692143798) | > loss_disc_real_4: 0.047602858394384384 (0.18580092303454876) | > loss_disc_real_5: 0.03962232172489166 (0.16232044249773026) | > loss_0: 2.0250227451324463 (2.4576297998428345) | > loss_gen: 2.3115832805633545 (2.2708626985549927) | > loss_kl: 5.932474136352539 (5.569248199462891) | > loss_feat: 12.526257514953613 (7.560566544532776) | > loss_mel: 25.2016544342041 (23.19669246673584) | > loss_duration: 3.3148701190948486 (3.3364357948303223) | > loss_1: 49.28683853149414 (41.93380546569824)  --> STEP: 3 | > loss_disc: 2.304558277130127 (2.4066059589385986) | > loss_disc_real_0: 0.20149099826812744 (0.27604780594507855) | > loss_disc_real_1: 0.27657508850097656 (0.22316235303878784) | > loss_disc_real_2: 0.2943223714828491 (0.20360425238807997) | > loss_disc_real_3: 0.2947905659675598 (0.18617381993681192) | > loss_disc_real_4: 0.32153668999671936 (0.23104617868860564) | > loss_disc_real_5: 0.35441210865974426 (0.22635099788506827) | > loss_0: 2.304558277130127 (2.4066059589385986) | > loss_gen: 3.368652105331421 (2.6367925008138022) | > loss_kl: 3.0296289920806885 (4.722708463668823) | > loss_feat: 6.498597621917725 (7.206576903661092) | > loss_mel: 21.502365112304688 (22.631916681925457) | > loss_duration: 3.011946678161621 (3.2282727559407554) | > loss_1: 37.411190032958984 (40.42626698811849) --> EVAL PERFORMANCE | > avg_loader_time: 0.02440365155537923 (+0.003855625788370766) | > avg_loss_disc: 2.4066059589385986 (+0.09289216995239258) | > avg_loss_disc_real_0: 0.27604780594507855 (+0.16584491729736328) | > avg_loss_disc_real_1: 0.22316235303878784 (-0.0008379966020584106) | > avg_loss_disc_real_2: 0.20360425238807997 (-0.04225690538684526) | > avg_loss_disc_real_3: 0.18617381993681192 (-0.028508704466124385) | > avg_loss_disc_real_4: 0.23104617868860564 (+0.004789810627698898) | > avg_loss_disc_real_5: 0.22635099788506827 (-0.010541394352912903) | > avg_loss_0: 2.4066059589385986 (+0.09289216995239258) | > avg_loss_gen: 2.6367925008138022 (+0.24689777692159032) | > avg_loss_kl: 4.722708463668823 (+0.4160791238149004) | > avg_loss_feat: 7.206576903661092 (+0.19483145078023245) | > avg_loss_mel: 22.631916681925457 (-1.555941263834633) | > avg_loss_duration: 3.2282727559407554 (-0.006336371103922378) | > avg_loss_1: 40.42626698811849 (-0.704470316569008)  > EPOCH: 1002/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:20:43)   --> TIME: 2023-10-20 12:20:55 -- STEP: 9/50 -- GLOBAL_STEP: 103110 | > loss_disc: 2.9103026390075684 (2.3234192662768893) | > loss_disc_real_0: 0.2239324450492859 (0.1324445145825545) | > loss_disc_real_1: 0.2914282977581024 (0.22976959496736526) | > loss_disc_real_2: 0.29745253920555115 (0.2786124646663666) | > loss_disc_real_3: 0.2873474359512329 (0.22290423181321886) | > loss_disc_real_4: 0.31271377205848694 (0.19348826590511534) | > loss_disc_real_5: 0.2642379105091095 (0.1818084700240029) | > loss_0: 2.9103026390075684 (2.3234192662768893) | > grad_norm_0: tensor(934.0598, device='cuda:0') (tensor(541.5236, device='cuda:0')) | > loss_gen: 1.811715006828308 (2.4078748491075306) | > loss_kl: 0.6578283309936523 (0.7769143117798699) | > loss_feat: 0.3374421000480652 (5.368783546818627) | > loss_mel: 10.617218017578125 (19.760152604844833) | > loss_duration: 1.2718956470489502 (1.3412872685326471) | > loss_1: 14.696099281311035 (29.65501266055637) | > grad_norm_1: tensor(16524.7344, device='cuda:0') (tensor(20909.3145, device='cuda:0')) | > current_lr_0: 7.34242847884582e-05 | > current_lr_1: 7.34242847884582e-05 | > step_time: 0.4748 (0.6379522747463651) | > loader_time: 0.0124 (0.02055062188042535)  --> TIME: 2023-10-20 12:21:12 -- STEP: 39/50 -- GLOBAL_STEP: 103140 | > loss_disc: 1.6608754396438599 (2.3445512056350717) | > loss_disc_real_0: 0.025796283036470413 (0.13895694047021565) | > loss_disc_real_1: 0.035006456077098846 (0.21947771234390062) | > loss_disc_real_2: 0.06212646886706352 (0.24359541816207078) | > loss_disc_real_3: 0.06342803686857224 (0.23483227986173752) | > loss_disc_real_4: 0.05501435697078705 (0.2386415367707228) | > loss_disc_real_5: 0.06640150398015976 (0.21449844028132084) | > loss_0: 1.6608754396438599 (2.3445512056350717) | > grad_norm_0: tensor(571.0222, device='cuda:0') (tensor(576.8885, device='cuda:0')) | > loss_gen: 2.1767029762268066 (2.400140416927826) | > loss_kl: 0.6555600166320801 (0.8185070531490521) | > loss_feat: 10.97182846069336 (5.772642335066428) | > loss_mel: 25.51862335205078 (21.091221088018173) | > loss_duration: 1.4155880212783813 (1.3377046829614885) | > loss_1: 40.738304138183594 (31.420215814541535) | > grad_norm_1: tensor(56395.5117, device='cuda:0') (tensor(16991.5117, device='cuda:0')) | > current_lr_0: 7.34242847884582e-05 | > current_lr_1: 7.34242847884582e-05 | > step_time: 0.4905 (0.5693120467357147) | > loader_time: 0.0075 (0.016607498511289943)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.136904716491699 (3.136904716491699) | > loss_disc_real_0: 0.5273131728172302 (0.5273131728172302) | > loss_disc_real_1: 0.33581846952438354 (0.33581846952438354) | > loss_disc_real_2: 0.2547896206378937 (0.2547896206378937) | > loss_disc_real_3: 0.3352384567260742 (0.3352384567260742) | > loss_disc_real_4: 0.32605499029159546 (0.32605499029159546) | > loss_disc_real_5: 0.40057986974716187 (0.40057986974716187) | > loss_0: 3.136904716491699 (3.136904716491699) | > loss_gen: 2.6511762142181396 (2.6511762142181396) | > loss_kl: 5.280431270599365 (5.280431270599365) | > loss_feat: 5.102052211761475 (5.102052211761475) | > loss_mel: 22.41815185546875 (22.41815185546875) | > loss_duration: 3.178114175796509 (3.178114175796509) | > loss_1: 38.62992858886719 (38.62992858886719)  --> STEP: 1 | > loss_disc: 2.879262924194336 (2.879262924194336) | > loss_disc_real_0: 0.3168299198150635 (0.3168299198150635) | > loss_disc_real_1: 0.32823002338409424 (0.32823002338409424) | > loss_disc_real_2: 0.3083053231239319 (0.3083053231239319) | > loss_disc_real_3: 0.3162350654602051 (0.3162350654602051) | > loss_disc_real_4: 0.2985486090183258 (0.2985486090183258) | > loss_disc_real_5: 0.282561719417572 (0.282561719417572) | > loss_0: 2.879262924194336 (2.879262924194336) | > loss_gen: 2.398101806640625 (2.398101806640625) | > loss_kl: 4.81531286239624 (4.81531286239624) | > loss_feat: 2.818025588989258 (2.818025588989258) | > loss_mel: 19.057395935058594 (19.057395935058594) | > loss_duration: 3.379502773284912 (3.379502773284912) | > loss_1: 32.46833801269531 (32.46833801269531)  --> STEP: 2 | > loss_disc: 1.344153881072998 (2.111708402633667) | > loss_disc_real_0: 0.22850742936134338 (0.27266867458820343) | > loss_disc_real_1: 0.10948678106069565 (0.21885840222239494) | > loss_disc_real_2: 0.1510045826435089 (0.2296549528837204) | > loss_disc_real_3: 0.16566547751426697 (0.24095027148723602) | > loss_disc_real_4: 0.060493409633636475 (0.17952100932598114) | > loss_disc_real_5: 0.03739779815077782 (0.15997975878417492) | > loss_0: 1.344153881072998 (2.111708402633667) | > loss_gen: 3.765103340148926 (3.0816025733947754) | > loss_kl: 5.7699360847473145 (5.292624473571777) | > loss_feat: 13.848124504089355 (8.333075046539307) | > loss_mel: 24.200136184692383 (21.62876605987549) | > loss_duration: 3.2011029720306396 (3.290302872657776) | > loss_1: 50.78440475463867 (41.62637138366699)  --> STEP: 3 | > loss_disc: 3.094029426574707 (2.439148743947347) | > loss_disc_real_0: 0.10487943887710571 (0.21673892935117087) | > loss_disc_real_1: 0.31552213430404663 (0.25107964624961215) | > loss_disc_real_2: 0.3192264437675476 (0.2595121165116628) | > loss_disc_real_3: 0.34071388840675354 (0.2742048104604085) | > loss_disc_real_4: 0.4395766258239746 (0.2662062148253123) | > loss_disc_real_5: 0.36786070466041565 (0.2292734074095885) | > loss_0: 3.094029426574707 (2.439148743947347) | > loss_gen: 1.99281644821167 (2.7186738650004068) | > loss_kl: 2.4664056301116943 (4.35055152575175) | > loss_feat: 3.796186685562134 (6.820778926213582) | > loss_mel: 24.141998291015625 (22.4665101369222) | > loss_duration: 3.004098892211914 (3.1949015458424888) | > loss_1: 35.40150451660156 (39.55141576131185) --> EVAL PERFORMANCE | > avg_loader_time: 0.016686518987019856 (-0.007717132568359375) | > avg_loss_disc: 2.439148743947347 (+0.03254278500874852) | > avg_loss_disc_real_0: 0.21673892935117087 (-0.05930887659390768) | > avg_loss_disc_real_1: 0.25107964624961215 (+0.027917293210824312) | > avg_loss_disc_real_2: 0.2595121165116628 (+0.05590786412358281) | > avg_loss_disc_real_3: 0.2742048104604085 (+0.08803099052359659) | > avg_loss_disc_real_4: 0.2662062148253123 (+0.03516003613670668) | > avg_loss_disc_real_5: 0.2292734074095885 (+0.0029224095245202197) | > avg_loss_0: 2.439148743947347 (+0.03254278500874852) | > avg_loss_gen: 2.7186738650004068 (+0.08188136418660452) | > avg_loss_kl: 4.35055152575175 (-0.37215693791707327) | > avg_loss_feat: 6.820778926213582 (-0.38579797744750977) | > avg_loss_mel: 22.4665101369222 (-0.16540654500325758) | > avg_loss_duration: 3.1949015458424888 (-0.0333712100982666) | > avg_loss_1: 39.55141576131185 (-0.8748512268066406)  > EPOCH: 1003/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:21:37)   --> TIME: 2023-10-20 12:21:50 -- STEP: 19/50 -- GLOBAL_STEP: 103170 | > loss_disc: 2.7526979446411133 (2.4201520618639494) | > loss_disc_real_0: 0.24697405099868774 (0.11906305631916772) | > loss_disc_real_1: 0.16257666051387787 (0.22466237529327995) | > loss_disc_real_2: 0.27874526381492615 (0.22249274191103482) | > loss_disc_real_3: 0.44797876477241516 (0.26261392000474426) | > loss_disc_real_4: 0.21531490981578827 (0.22363707668295033) | > loss_disc_real_5: 0.16949647665023804 (0.2269983986686719) | > loss_0: 2.7526979446411133 (2.4201520618639494) | > grad_norm_0: tensor(579.5784, device='cuda:0') (tensor(571.4839, device='cuda:0')) | > loss_gen: 2.166293144226074 (2.4481779650637976) | > loss_kl: 0.8571556210517883 (0.8835823379064861) | > loss_feat: 5.394189357757568 (7.106156286440398) | > loss_mel: 24.271875381469727 (23.27737727918123) | > loss_duration: 1.4643336534500122 (1.3797577619552612) | > loss_1: 34.153846740722656 (35.095051313701425) | > grad_norm_1: tensor(16084.2812, device='cuda:0') (tensor(25709.5488, device='cuda:0')) | > current_lr_0: 7.335089261876479e-05 | > current_lr_1: 7.335089261876479e-05 | > step_time: 0.3375 (0.3901263161709434) | > loader_time: 0.0078 (0.010971521076403166)  --> TIME: 2023-10-20 12:22:07 -- STEP: 49/50 -- GLOBAL_STEP: 103200 | > loss_disc: 2.7481529712677 (2.469966170739154) | > loss_disc_real_0: 0.13107864558696747 (0.1369715158504491) | > loss_disc_real_1: 0.22901539504528046 (0.2367364825034628) | > loss_disc_real_2: 0.28100907802581787 (0.22972732181755864) | > loss_disc_real_3: 0.22973380982875824 (0.2603299125116698) | > loss_disc_real_4: 0.270320862531662 (0.2300666874388651) | > loss_disc_real_5: 0.27623727917671204 (0.2288810993563764) | > loss_0: 2.7481529712677 (2.469966170739154) | > grad_norm_0: tensor(708.1812, device='cuda:0') (tensor(586.0996, device='cuda:0')) | > loss_gen: 1.7906854152679443 (2.3047784104639177) | > loss_kl: 0.5747498869895935 (0.8104388861137689) | > loss_feat: 1.6745754480361938 (5.669989018415918) | > loss_mel: 14.999711036682129 (21.21793172797378) | > loss_duration: 1.46599280834198 (1.3411676835040651) | > loss_1: 20.505714416503906 (31.34430562233438) | > grad_norm_1: tensor(5363.3848, device='cuda:0') (tensor(17845.8125, device='cuda:0')) | > current_lr_0: 7.335089261876479e-05 | > current_lr_1: 7.335089261876479e-05 | > step_time: 0.7937 (0.4749428350098279) | > loader_time: 0.4128 (0.019698512797452963)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.308012008666992 (2.308012008666992) | > loss_disc_real_0: 0.18115246295928955 (0.18115246295928955) | > loss_disc_real_1: 0.186272531747818 (0.186272531747818) | > loss_disc_real_2: 0.3183060884475708 (0.3183060884475708) | > loss_disc_real_3: 0.21283245086669922 (0.21283245086669922) | > loss_disc_real_4: 0.1586373746395111 (0.1586373746395111) | > loss_disc_real_5: 0.29708245396614075 (0.29708245396614075) | > loss_0: 2.308012008666992 (2.308012008666992) | > loss_gen: 2.438201665878296 (2.438201665878296) | > loss_kl: 4.9656524658203125 (4.9656524658203125) | > loss_feat: 6.826638221740723 (6.826638221740723) | > loss_mel: 23.822734832763672 (23.822734832763672) | > loss_duration: 3.0722126960754395 (3.0722126960754395) | > loss_1: 41.12543869018555 (41.12543869018555)  --> STEP: 1 | > loss_disc: 2.6463165283203125 (2.6463165283203125) | > loss_disc_real_0: 0.08927491307258606 (0.08927491307258606) | > loss_disc_real_1: 0.13639523088932037 (0.13639523088932037) | > loss_disc_real_2: 0.19292525947093964 (0.19292525947093964) | > loss_disc_real_3: 0.22661787271499634 (0.22661787271499634) | > loss_disc_real_4: 0.2982403039932251 (0.2982403039932251) | > loss_disc_real_5: 0.3928212821483612 (0.3928212821483612) | > loss_0: 2.6463165283203125 (2.6463165283203125) | > loss_gen: 2.0260167121887207 (2.0260167121887207) | > loss_kl: 4.730039119720459 (4.730039119720459) | > loss_feat: 7.287540435791016 (7.287540435791016) | > loss_mel: 23.479013442993164 (23.479013442993164) | > loss_duration: 3.2772905826568604 (3.2772905826568604) | > loss_1: 40.79990005493164 (40.79990005493164)  --> STEP: 2 | > loss_disc: 2.7478296756744385 (2.6970731019973755) | > loss_disc_real_0: 0.10880795121192932 (0.09904143214225769) | > loss_disc_real_1: 0.23710916936397552 (0.18675220012664795) | > loss_disc_real_2: 0.17147128283977509 (0.18219827115535736) | > loss_disc_real_3: 0.2584010660648346 (0.24250946938991547) | > loss_disc_real_4: 0.12302927672863007 (0.21063479036092758) | > loss_disc_real_5: 0.22196421027183533 (0.30739274621009827) | > loss_0: 2.7478296756744385 (2.6970731019973755) | > loss_gen: 1.9227932691574097 (1.9744049906730652) | > loss_kl: 5.5784807205200195 (5.154259920120239) | > loss_feat: 9.62913990020752 (8.458340167999268) | > loss_mel: 28.701189041137695 (26.09010124206543) | > loss_duration: 3.2646548748016357 (3.270972728729248) | > loss_1: 49.09626007080078 (44.94808006286621)  --> STEP: 3 | > loss_disc: 2.717714548110962 (2.703953584035238) | > loss_disc_real_0: 0.1650574952363968 (0.12104678650697072) | > loss_disc_real_1: 0.20504425466060638 (0.19284955163796744) | > loss_disc_real_2: 0.26560819149017334 (0.21000157793362936) | > loss_disc_real_3: 0.25546324253082275 (0.2468273937702179) | > loss_disc_real_4: 0.21151189506053925 (0.21092715859413147) | > loss_disc_real_5: 0.2511053681373596 (0.28863028685251874) | > loss_0: 2.717714548110962 (2.703953584035238) | > loss_gen: 1.7932249307632446 (1.9140116373697917) | > loss_kl: 2.7611944675445557 (4.356571435928345) | > loss_feat: 2.980942964553833 (6.632541100184123) | > loss_mel: 21.123075485229492 (24.434425989786785) | > loss_duration: 2.928349733352661 (3.1567650636037192) | > loss_1: 31.586788177490234 (40.49431610107422) --> EVAL PERFORMANCE | > avg_loader_time: 0.013703505198160807 (-0.002983013788859049) | > avg_loss_disc: 2.703953584035238 (+0.2648048400878906) | > avg_loss_disc_real_0: 0.12104678650697072 (-0.09569214284420015) | > avg_loss_disc_real_1: 0.19284955163796744 (-0.05823009461164472) | > avg_loss_disc_real_2: 0.21000157793362936 (-0.04951053857803342) | > avg_loss_disc_real_3: 0.2468273937702179 (-0.027377416690190615) | > avg_loss_disc_real_4: 0.21092715859413147 (-0.055279056231180845) | > avg_loss_disc_real_5: 0.28863028685251874 (+0.05935687944293025) | > avg_loss_0: 2.703953584035238 (+0.2648048400878906) | > avg_loss_gen: 1.9140116373697917 (-0.804662227630615) | > avg_loss_kl: 4.356571435928345 (+0.006019910176594756) | > avg_loss_feat: 6.632541100184123 (-0.18823782602945904) | > avg_loss_mel: 24.434425989786785 (+1.9679158528645857) | > avg_loss_duration: 3.1567650636037192 (-0.03813648223876953) | > avg_loss_1: 40.49431610107422 (+0.9429003397623674)  > EPOCH: 1004/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:22:30)   --> TIME: 2023-10-20 12:23:01 -- STEP: 29/50 -- GLOBAL_STEP: 103230 | > loss_disc: 3.0297622680664062 (2.3092100414736523) | > loss_disc_real_0: 0.15860185027122498 (0.1299072037097709) | > loss_disc_real_1: 0.25427496433258057 (0.20852905717389336) | > loss_disc_real_2: 0.23998720943927765 (0.2077841372068586) | > loss_disc_real_3: 0.2548157274723053 (0.24013067113942113) | > loss_disc_real_4: 0.23797684907913208 (0.23419999125702629) | > loss_disc_real_5: 0.26085907220840454 (0.21279406444779758) | > loss_0: 3.0297622680664062 (2.3092100414736523) | > grad_norm_0: tensor(2139.6414, device='cuda:0') (tensor(622.8032, device='cuda:0')) | > loss_gen: 1.45381498336792 (2.5108363217320933) | > loss_kl: 0.7055940628051758 (0.8044521541431032) | > loss_feat: 0.10243301093578339 (6.980385956065408) | > loss_mel: 3.084627151489258 (21.268786652334803) | > loss_duration: 1.3086504936218262 (1.361548793726954) | > loss_1: 6.6551194190979 (32.926010049622626) | > grad_norm_1: tensor(25132.7383, device='cuda:0') (tensor(17931.1641, device='cuda:0')) | > current_lr_0: 7.327757380914002e-05 | > current_lr_1: 7.327757380914002e-05 | > step_time: 0.3971 (0.5216984337773818) | > loader_time: 0.0097 (0.018062887520625674)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.77256441116333 (1.77256441116333) | > loss_disc_real_0: 0.019433343783020973 (0.019433343783020973) | > loss_disc_real_1: 0.11210376769304276 (0.11210376769304276) | > loss_disc_real_2: 0.10977193713188171 (0.10977193713188171) | > loss_disc_real_3: 0.1453695297241211 (0.1453695297241211) | > loss_disc_real_4: 0.21066957712173462 (0.21066957712173462) | > loss_disc_real_5: 0.22297899425029755 (0.22297899425029755) | > loss_0: 1.77256441116333 (1.77256441116333) | > loss_gen: 2.690992832183838 (2.690992832183838) | > loss_kl: 5.4496893882751465 (5.4496893882751465) | > loss_feat: 10.731228828430176 (10.731228828430176) | > loss_mel: 24.2233943939209 (24.2233943939209) | > loss_duration: 3.2251365184783936 (3.2251365184783936) | > loss_1: 46.32044219970703 (46.32044219970703)  --> STEP: 1 | > loss_disc: 2.4878666400909424 (2.4878666400909424) | > loss_disc_real_0: 0.10880021750926971 (0.10880021750926971) | > loss_disc_real_1: 0.3046228885650635 (0.3046228885650635) | > loss_disc_real_2: 0.3466479480266571 (0.3466479480266571) | > loss_disc_real_3: 0.28043583035469055 (0.28043583035469055) | > loss_disc_real_4: 0.34662926197052 (0.34662926197052) | > loss_disc_real_5: 0.2484475076198578 (0.2484475076198578) | > loss_0: 2.4878666400909424 (2.4878666400909424) | > loss_gen: 2.8901960849761963 (2.8901960849761963) | > loss_kl: 4.975074768066406 (4.975074768066406) | > loss_feat: 7.369665622711182 (7.369665622711182) | > loss_mel: 22.563884735107422 (22.563884735107422) | > loss_duration: 3.402829647064209 (3.402829647064209) | > loss_1: 41.2016487121582 (41.2016487121582)  --> STEP: 2 | > loss_disc: 2.848179340362549 (2.6680229902267456) | > loss_disc_real_0: 0.12166880071163177 (0.11523450911045074) | > loss_disc_real_1: 0.3046230375766754 (0.30462296307086945) | > loss_disc_real_2: 0.2819335162639618 (0.31429073214530945) | > loss_disc_real_3: 0.2697790861129761 (0.2751074582338333) | > loss_disc_real_4: 0.38257578015327454 (0.3646025210618973) | > loss_disc_real_5: 0.32515114545822144 (0.2867993265390396) | > loss_0: 2.848179340362549 (2.6680229902267456) | > loss_gen: 2.687621831893921 (2.7889089584350586) | > loss_kl: 5.630110740661621 (5.302592754364014) | > loss_feat: 7.364421844482422 (7.367043733596802) | > loss_mel: 22.444063186645508 (22.503973960876465) | > loss_duration: 3.374506950378418 (3.3886682987213135) | > loss_1: 41.50072479248047 (41.351186752319336)  --> STEP: 3 | > loss_disc: 2.764921188354492 (2.700322389602661) | > loss_disc_real_0: 0.06228022277355194 (0.09758308033148448) | > loss_disc_real_1: 0.3115307688713074 (0.30692556500434875) | > loss_disc_real_2: 0.39799728989601135 (0.3421929180622101) | > loss_disc_real_3: 0.3534916639328003 (0.30123552680015564) | > loss_disc_real_4: 0.3851577043533325 (0.37145424882570904) | > loss_disc_real_5: 0.6147613525390625 (0.39612000187238056) | > loss_0: 2.764921188354492 (2.700322389602661) | > loss_gen: 3.1001784801483154 (2.892665465672811) | > loss_kl: 2.31916880607605 (4.308118104934692) | > loss_feat: 3.8276944160461426 (6.187260627746582) | > loss_mel: 23.332794189453125 (22.78024737040202) | > loss_duration: 3.011502981185913 (3.262946526209513) | > loss_1: 35.59133529663086 (39.431236267089844) --> EVAL PERFORMANCE | > avg_loader_time: 0.013215939203898111 (-0.0004875659942626953) | > avg_loss_disc: 2.700322389602661 (-0.0036311944325766454) | > avg_loss_disc_real_0: 0.09758308033148448 (-0.023463706175486237) | > avg_loss_disc_real_1: 0.30692556500434875 (+0.11407601336638132) | > avg_loss_disc_real_2: 0.3421929180622101 (+0.13219134012858072) | > avg_loss_disc_real_3: 0.30123552680015564 (+0.054408133029937744) | > avg_loss_disc_real_4: 0.37145424882570904 (+0.16052709023157757) | > avg_loss_disc_real_5: 0.39612000187238056 (+0.10748971501986182) | > avg_loss_0: 2.700322389602661 (-0.0036311944325766454) | > avg_loss_gen: 2.892665465672811 (+0.9786538283030193) | > avg_loss_kl: 4.308118104934692 (-0.048453330993652344) | > avg_loss_feat: 6.187260627746582 (-0.445280472437541) | > avg_loss_mel: 22.78024737040202 (-1.6541786193847656) | > avg_loss_duration: 3.262946526209513 (+0.10618146260579397) | > avg_loss_1: 39.431236267089844 (-1.063079833984375)  > EPOCH: 1005/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:23:39)   --> TIME: 2023-10-20 12:23:51 -- STEP: 9/50 -- GLOBAL_STEP: 103260 | > loss_disc: 2.9120521545410156 (2.330429474512736) | > loss_disc_real_0: 0.21003568172454834 (0.18726276523537105) | > loss_disc_real_1: 0.29080140590667725 (0.18311540078785685) | > loss_disc_real_2: 0.3240658640861511 (0.22720665484666824) | > loss_disc_real_3: 0.27760595083236694 (0.2418159180217319) | > loss_disc_real_4: 0.28590553998947144 (0.16453005621830621) | > loss_disc_real_5: 0.2679409682750702 (0.18649518852018648) | > loss_0: 2.9120521545410156 (2.330429474512736) | > grad_norm_0: tensor(321.2195, device='cuda:0') (tensor(564.7081, device='cuda:0')) | > loss_gen: 1.720567226409912 (2.4454840554131403) | > loss_kl: 0.6611074805259705 (0.884046302901374) | > loss_feat: 0.2694147527217865 (7.3118389546871185) | > loss_mel: 12.306918144226074 (22.121486557854546) | > loss_duration: 1.2988903522491455 (1.3357902235454984) | > loss_1: 16.256898880004883 (34.098646799723305) | > grad_norm_1: tensor(48247.6328, device='cuda:0') (tensor(24355.3066, device='cuda:0')) | > current_lr_0: 7.320432828625591e-05 | > current_lr_1: 7.320432828625591e-05 | > step_time: 0.5275 (0.639023224512736) | > loader_time: 0.0359 (0.023471222983466253)  --> TIME: 2023-10-20 12:24:09 -- STEP: 39/50 -- GLOBAL_STEP: 103290 | > loss_disc: 2.5853536128997803 (2.4575992853213577) | > loss_disc_real_0: 0.07456408441066742 (0.14949095268280077) | > loss_disc_real_1: 0.2291022688150406 (0.211064346994345) | > loss_disc_real_2: 0.24604807794094086 (0.22938427271751258) | > loss_disc_real_3: 0.266237735748291 (0.23111260020866609) | > loss_disc_real_4: 0.2383175939321518 (0.2261513570944468) | > loss_disc_real_5: 0.2368936687707901 (0.2434436790406322) | > loss_0: 2.5853536128997803 (2.4575992853213577) | > grad_norm_0: tensor(676.7455, device='cuda:0') (tensor(567.9995, device='cuda:0')) | > loss_gen: 1.854732632637024 (2.2624880747917375) | > loss_kl: 0.24453668296337128 (0.8260139238375884) | > loss_feat: 2.979642391204834 (5.528408013666287) | > loss_mel: 17.856687545776367 (20.830280145009358) | > loss_duration: 1.3771270513534546 (1.3484370219401824) | > loss_1: 24.312725067138672 (30.795627129383575) | > grad_norm_1: tensor(4497.0225, device='cuda:0') (tensor(15036.2773, device='cuda:0')) | > current_lr_0: 7.320432828625591e-05 | > current_lr_1: 7.320432828625591e-05 | > step_time: 0.3306 (0.5939775491372133) | > loader_time: 0.0026 (0.020156890918047)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.275970697402954 (2.275970697402954) | > loss_disc_real_0: 0.11579953134059906 (0.11579953134059906) | > loss_disc_real_1: 0.2725163996219635 (0.2725163996219635) | > loss_disc_real_2: 0.2051519751548767 (0.2051519751548767) | > loss_disc_real_3: 0.22335249185562134 (0.22335249185562134) | > loss_disc_real_4: 0.13240306079387665 (0.13240306079387665) | > loss_disc_real_5: 0.09723351895809174 (0.09723351895809174) | > loss_0: 2.275970697402954 (2.275970697402954) | > loss_gen: 2.0302019119262695 (2.0302019119262695) | > loss_kl: 5.490834712982178 (5.490834712982178) | > loss_feat: 5.620438098907471 (5.620438098907471) | > loss_mel: 18.074514389038086 (18.074514389038086) | > loss_duration: 3.082634687423706 (3.082634687423706) | > loss_1: 34.298622131347656 (34.298622131347656)  --> STEP: 1 | > loss_disc: 2.8681182861328125 (2.8681182861328125) | > loss_disc_real_0: 0.4104788899421692 (0.4104788899421692) | > loss_disc_real_1: 0.20258569717407227 (0.20258569717407227) | > loss_disc_real_2: 0.25461751222610474 (0.25461751222610474) | > loss_disc_real_3: 0.2740664780139923 (0.2740664780139923) | > loss_disc_real_4: 0.25927501916885376 (0.25927501916885376) | > loss_disc_real_5: 0.26787465810775757 (0.26787465810775757) | > loss_0: 2.8681182861328125 (2.8681182861328125) | > loss_gen: 2.0189030170440674 (2.0189030170440674) | > loss_kl: 4.824219703674316 (4.824219703674316) | > loss_feat: 1.3696446418762207 (1.3696446418762207) | > loss_mel: 19.9121150970459 (19.9121150970459) | > loss_duration: 3.289687156677246 (3.289687156677246) | > loss_1: 31.414569854736328 (31.414569854736328)  --> STEP: 2 | > loss_disc: 2.5867061614990234 (2.727412223815918) | > loss_disc_real_0: 0.602581799030304 (0.5065303444862366) | > loss_disc_real_1: 0.2353312224149704 (0.21895845979452133) | > loss_disc_real_2: 0.16559438407421112 (0.21010594815015793) | > loss_disc_real_3: 0.16621990501880646 (0.22014319151639938) | > loss_disc_real_4: 0.2205844223499298 (0.23992972075939178) | > loss_disc_real_5: 0.28544890880584717 (0.27666178345680237) | > loss_0: 2.5867061614990234 (2.727412223815918) | > loss_gen: 3.518989324569702 (2.7689461708068848) | > loss_kl: 5.985042572021484 (5.4046311378479) | > loss_feat: 8.784318923950195 (5.076981782913208) | > loss_mel: 25.51573371887207 (22.713924407958984) | > loss_duration: 3.1874444484710693 (3.2385658025741577) | > loss_1: 46.99152755737305 (39.20304870605469)  --> STEP: 3 | > loss_disc: 2.22892165184021 (2.561248699824015) | > loss_disc_real_0: 0.2079329788684845 (0.4069978892803192) | > loss_disc_real_1: 0.18034300208091736 (0.20608664055665335) | > loss_disc_real_2: 0.21314406394958496 (0.2111186534166336) | > loss_disc_real_3: 0.29014843702316284 (0.2434782733519872) | > loss_disc_real_4: 0.1914054900407791 (0.2237549771865209) | > loss_disc_real_5: 0.1535062938928604 (0.23560995360215506) | > loss_0: 2.22892165184021 (2.561248699824015) | > loss_gen: 2.9039292335510254 (2.8139405250549316) | > loss_kl: 2.753328323364258 (4.5208635330200195) | > loss_feat: 5.298404693603516 (5.1507894198099775) | > loss_mel: 21.20374870300293 (22.210532506306965) | > loss_duration: 3.0107338428497314 (3.162621815999349) | > loss_1: 35.17014694213867 (37.85874811808268) --> EVAL PERFORMANCE | > avg_loader_time: 0.005761941274007161 (-0.00745399792989095) | > avg_loss_disc: 2.561248699824015 (-0.13907368977864598) | > avg_loss_disc_real_0: 0.4069978892803192 (+0.3094148089488347) | > avg_loss_disc_real_1: 0.20608664055665335 (-0.1008389244476954) | > avg_loss_disc_real_2: 0.2111186534166336 (-0.13107426464557648) | > avg_loss_disc_real_3: 0.2434782733519872 (-0.05775725344816843) | > avg_loss_disc_real_4: 0.2237549771865209 (-0.14769927163918814) | > avg_loss_disc_real_5: 0.23560995360215506 (-0.1605100482702255) | > avg_loss_0: 2.561248699824015 (-0.13907368977864598) | > avg_loss_gen: 2.8139405250549316 (-0.07872494061787938) | > avg_loss_kl: 4.5208635330200195 (+0.21274542808532715) | > avg_loss_feat: 5.1507894198099775 (-1.0364712079366045) | > avg_loss_mel: 22.210532506306965 (-0.5697148640950545) | > avg_loss_duration: 3.162621815999349 (-0.10032471021016409) | > avg_loss_1: 37.85874811808268 (-1.5724881490071638)  > EPOCH: 1006/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:24:31)   --> TIME: 2023-10-20 12:24:50 -- STEP: 19/50 -- GLOBAL_STEP: 103320 | > loss_disc: 1.8678967952728271 (2.3623128501992476) | > loss_disc_real_0: 0.04134707152843475 (0.16830152763347878) | > loss_disc_real_1: 0.2570191025733948 (0.19980406153358912) | > loss_disc_real_2: 0.26627063751220703 (0.19496537695981955) | > loss_disc_real_3: 0.1324862539768219 (0.2283700351652346) | > loss_disc_real_4: 0.22905460000038147 (0.22219129916476577) | > loss_disc_real_5: 0.1486857384443283 (0.21243496253890426) | > loss_0: 1.8678967952728271 (2.3623128501992476) | > grad_norm_0: tensor(344.0522, device='cuda:0') (tensor(601.7479, device='cuda:0')) | > loss_gen: 2.834322214126587 (2.3164680317828528) | > loss_kl: 0.6770015954971313 (0.860025156485407) | > loss_feat: 7.606714248657227 (5.940337429117215) | > loss_mel: 22.483734130859375 (19.34240060103567) | > loss_duration: 1.4717234373092651 (1.3789832403785305) | > loss_1: 35.07349395751953 (29.83821432214034) | > grad_norm_1: tensor(24604.1328, device='cuda:0') (tensor(28300.2441, device='cuda:0')) | > current_lr_0: 7.313115597685779e-05 | > current_lr_1: 7.313115597685779e-05 | > step_time: 0.5549 (0.6545422077178955) | > loader_time: 0.0213 (0.023386390585648387)  --> TIME: 2023-10-20 12:25:07 -- STEP: 49/50 -- GLOBAL_STEP: 103350 | > loss_disc: 2.6593544483184814 (2.368372114337221) | > loss_disc_real_0: 0.1401025652885437 (0.14716596832993084) | > loss_disc_real_1: 0.25523868203163147 (0.2128742395767144) | > loss_disc_real_2: 0.45281437039375305 (0.21829188375600747) | > loss_disc_real_3: 0.2219204157590866 (0.22498821980338923) | > loss_disc_real_4: 0.3083826005458832 (0.2102912534788555) | > loss_disc_real_5: 0.34289172291755676 (0.21004365473909645) | > loss_0: 2.6593544483184814 (2.368372114337221) | > grad_norm_0: tensor(1415.2596, device='cuda:0') (tensor(643.2430, device='cuda:0')) | > loss_gen: 3.2072646617889404 (2.3375802283384366) | > loss_kl: 0.44038400053977966 (0.8288372146839998) | > loss_feat: 6.465665817260742 (6.002673558510688) | > loss_mel: 23.444931030273438 (19.93939154002132) | > loss_duration: 1.4348456859588623 (1.3441447846743526) | > loss_1: 34.99309158325195 (30.452627454485214) | > grad_norm_1: tensor(44340.1758, device='cuda:0') (tensor(23736.5742, device='cuda:0')) | > current_lr_0: 7.313115597685779e-05 | > current_lr_1: 7.313115597685779e-05 | > step_time: 0.4784 (0.5732083125990263) | > loader_time: 0.4017 (0.02554969884911362)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1391491889953613 (3.1391491889953613) | > loss_disc_real_0: 0.1514548659324646 (0.1514548659324646) | > loss_disc_real_1: 0.2860308289527893 (0.2860308289527893) | > loss_disc_real_2: 0.20610825717449188 (0.20610825717449188) | > loss_disc_real_3: 0.3041892349720001 (0.3041892349720001) | > loss_disc_real_4: 0.3320537209510803 (0.3320537209510803) | > loss_disc_real_5: 0.4106760621070862 (0.4106760621070862) | > loss_0: 3.1391491889953613 (3.1391491889953613) | > loss_gen: 1.8052911758422852 (1.8052911758422852) | > loss_kl: 6.590235710144043 (6.590235710144043) | > loss_feat: 4.589949607849121 (4.589949607849121) | > loss_mel: 24.60088539123535 (24.60088539123535) | > loss_duration: 3.2338759899139404 (3.2338759899139404) | > loss_1: 40.82023620605469 (40.82023620605469)  --> STEP: 1 | > loss_disc: 2.776963472366333 (2.776963472366333) | > loss_disc_real_0: 0.2293386161327362 (0.2293386161327362) | > loss_disc_real_1: 0.22608813643455505 (0.22608813643455505) | > loss_disc_real_2: 0.34178686141967773 (0.34178686141967773) | > loss_disc_real_3: 0.2909542918205261 (0.2909542918205261) | > loss_disc_real_4: 0.2641891837120056 (0.2641891837120056) | > loss_disc_real_5: 0.2989899516105652 (0.2989899516105652) | > loss_0: 2.776963472366333 (2.776963472366333) | > loss_gen: 2.0011866092681885 (2.0011866092681885) | > loss_kl: 5.432353973388672 (5.432353973388672) | > loss_feat: 1.0382459163665771 (1.0382459163665771) | > loss_mel: 18.63603973388672 (18.63603973388672) | > loss_duration: 3.452388286590576 (3.452388286590576) | > loss_1: 30.56021499633789 (30.56021499633789)  --> STEP: 2 | > loss_disc: 3.0518317222595215 (2.9143975973129272) | > loss_disc_real_0: 0.3140466809272766 (0.2716926485300064) | > loss_disc_real_1: 0.22281283140182495 (0.22445048391819) | > loss_disc_real_2: 0.26157596707344055 (0.30168141424655914) | > loss_disc_real_3: 0.25012460350990295 (0.27053944766521454) | > loss_disc_real_4: 0.24206797778606415 (0.2531285807490349) | > loss_disc_real_5: 0.24180006980895996 (0.2703950107097626) | > loss_0: 3.0518317222595215 (2.9143975973129272) | > loss_gen: 1.527902364730835 (1.7645444869995117) | > loss_kl: 5.969748497009277 (5.701051235198975) | > loss_feat: 0.8975221514701843 (0.9678840339183807) | > loss_mel: 19.491907119750977 (19.063973426818848) | > loss_duration: 3.1574647426605225 (3.3049265146255493) | > loss_1: 31.044544219970703 (30.802379608154297)  --> STEP: 3 | > loss_disc: 3.342085838317871 (3.056960344314575) | > loss_disc_real_0: 0.38176605105400085 (0.3083837827046712) | > loss_disc_real_1: 0.31547555327415466 (0.25479217370351154) | > loss_disc_real_2: 0.5035783648490906 (0.36898039778073627) | > loss_disc_real_3: 0.32373449206352234 (0.28827112913131714) | > loss_disc_real_4: 0.39362096786499023 (0.29995937645435333) | > loss_disc_real_5: 0.4777315855026245 (0.33950720230738324) | > loss_0: 3.342085838317871 (3.056960344314575) | > loss_gen: 2.413060426712036 (1.9807164669036865) | > loss_kl: 2.6099801063537598 (4.670694192250569) | > loss_feat: 3.1683602333068848 (1.7013761003812153) | > loss_mel: 22.62904167175293 (20.252329508463543) | > loss_duration: 2.8683793544769287 (3.1594107945760093) | > loss_1: 33.68882369995117 (31.764527638753254) --> EVAL PERFORMANCE | > avg_loader_time: 0.022365331649780273 (+0.016603390375773113) | > avg_loss_disc: 3.056960344314575 (+0.49571164449056004) | > avg_loss_disc_real_0: 0.3083837827046712 (-0.09861410657564801) | > avg_loss_disc_real_1: 0.25479217370351154 (+0.04870553314685819) | > avg_loss_disc_real_2: 0.36898039778073627 (+0.15786174436410266) | > avg_loss_disc_real_3: 0.28827112913131714 (+0.044792855779329926) | > avg_loss_disc_real_4: 0.29995937645435333 (+0.07620439926783243) | > avg_loss_disc_real_5: 0.33950720230738324 (+0.10389724870522818) | > avg_loss_0: 3.056960344314575 (+0.49571164449056004) | > avg_loss_gen: 1.9807164669036865 (-0.8332240581512451) | > avg_loss_kl: 4.670694192250569 (+0.14983065923054983) | > avg_loss_feat: 1.7013761003812153 (-3.4494133194287624) | > avg_loss_mel: 20.252329508463543 (-1.958202997843422) | > avg_loss_duration: 3.1594107945760093 (-0.0032110214233398438) | > avg_loss_1: 31.764527638753254 (-6.094220479329426)  > EPOCH: 1007/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:25:24)   --> TIME: 2023-10-20 12:25:44 -- STEP: 29/50 -- GLOBAL_STEP: 103380 | > loss_disc: 2.4814984798431396 (2.378153920173645) | > loss_disc_real_0: 0.14157447218894958 (0.1230926734941273) | > loss_disc_real_1: 0.25322869420051575 (0.21843473754566292) | > loss_disc_real_2: 0.11811041831970215 (0.21001758208048754) | > loss_disc_real_3: 0.23273059725761414 (0.21480419178461208) | > loss_disc_real_4: 0.2311464548110962 (0.213891816678746) | > loss_disc_real_5: 0.2798418402671814 (0.2066469850211308) | > loss_0: 2.4814984798431396 (2.378153920173645) | > grad_norm_0: tensor(866.4557, device='cuda:0') (tensor(671.3557, device='cuda:0')) | > loss_gen: 1.9473885297775269 (2.2756276212889572) | > loss_kl: 0.8048626780509949 (0.7924614199276628) | > loss_feat: 1.8147534132003784 (5.981831847079871) | > loss_mel: 15.381457328796387 (20.5092708900057) | > loss_duration: 1.3770190477371216 (1.3650233416721738) | > loss_1: 21.325481414794922 (30.924215168788514) | > grad_norm_1: tensor(3902.9553, device='cuda:0') (tensor(21141.1211, device='cuda:0')) | > current_lr_0: 7.305805680776416e-05 | > current_lr_1: 7.305805680776416e-05 | > step_time: 0.3663 (0.4734062901858626) | > loader_time: 0.0033 (0.015050575650971511)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8275554180145264 (2.8275554180145264) | > loss_disc_real_0: 0.14640666544437408 (0.14640666544437408) | > loss_disc_real_1: 0.25268933176994324 (0.25268933176994324) | > loss_disc_real_2: 0.25990238785743713 (0.25990238785743713) | > loss_disc_real_3: 0.25130054354667664 (0.25130054354667664) | > loss_disc_real_4: 0.2550862431526184 (0.2550862431526184) | > loss_disc_real_5: 0.25316378474235535 (0.25316378474235535) | > loss_0: 2.8275554180145264 (2.8275554180145264) | > loss_gen: 1.6171162128448486 (1.6171162128448486) | > loss_kl: 6.339858055114746 (6.339858055114746) | > loss_feat: 0.4860060513019562 (0.4860060513019562) | > loss_mel: 15.240094184875488 (15.240094184875488) | > loss_duration: 3.110166072845459 (3.110166072845459) | > loss_1: 26.793241500854492 (26.793241500854492)  --> STEP: 1 | > loss_disc: 2.4989047050476074 (2.4989047050476074) | > loss_disc_real_0: 0.12771260738372803 (0.12771260738372803) | > loss_disc_real_1: 0.2358250916004181 (0.2358250916004181) | > loss_disc_real_2: 0.2914460301399231 (0.2914460301399231) | > loss_disc_real_3: 0.2696171700954437 (0.2696171700954437) | > loss_disc_real_4: 0.2496432512998581 (0.2496432512998581) | > loss_disc_real_5: 0.21957601606845856 (0.21957601606845856) | > loss_0: 2.4989047050476074 (2.4989047050476074) | > loss_gen: 2.5349955558776855 (2.5349955558776855) | > loss_kl: 5.332468032836914 (5.332468032836914) | > loss_feat: 7.9941205978393555 (7.9941205978393555) | > loss_mel: 22.715871810913086 (22.715871810913086) | > loss_duration: 3.394843101501465 (3.394843101501465) | > loss_1: 41.9723014831543 (41.9723014831543)  --> STEP: 2 | > loss_disc: 2.6837098598480225 (2.591307282447815) | > loss_disc_real_0: 0.49668267369270325 (0.31219764053821564) | > loss_disc_real_1: 0.1838778704404831 (0.2098514810204506) | > loss_disc_real_2: 0.2488466203212738 (0.27014632523059845) | > loss_disc_real_3: 0.3225174844264984 (0.29606732726097107) | > loss_disc_real_4: 0.18365922570228577 (0.21665123850107193) | > loss_disc_real_5: 0.09172452986240387 (0.1556502729654312) | > loss_0: 2.6837098598480225 (2.591307282447815) | > loss_gen: 2.2956690788269043 (2.415332317352295) | > loss_kl: 5.656955718994141 (5.494711875915527) | > loss_feat: 9.353275299072266 (8.67369794845581) | > loss_mel: 26.006052017211914 (24.3609619140625) | > loss_duration: 3.2033417224884033 (3.299092411994934) | > loss_1: 46.51529312133789 (44.243797302246094)  --> STEP: 3 | > loss_disc: 2.858914852142334 (2.6805098056793213) | > loss_disc_real_0: 0.15874868631362915 (0.26104798913002014) | > loss_disc_real_1: 0.25857099890708923 (0.2260913203159968) | > loss_disc_real_2: 0.297981858253479 (0.2794248362382253) | > loss_disc_real_3: 0.2620968818664551 (0.2847438454627991) | > loss_disc_real_4: 0.26008346676826477 (0.23112864792346954) | > loss_disc_real_5: 0.25732389092445374 (0.18954147895177206) | > loss_0: 2.858914852142334 (2.6805098056793213) | > loss_gen: 1.6492934226989746 (2.1599860191345215) | > loss_kl: 2.507502317428589 (4.498975356419881) | > loss_feat: 0.46749505400657654 (5.9382969836393995) | > loss_mel: 16.162322998046875 (21.628082275390625) | > loss_duration: 3.045698642730713 (3.214627822240194) | > loss_1: 23.832311630249023 (37.439968744913735) --> EVAL PERFORMANCE | > avg_loader_time: 0.006333112716674805 (-0.01603221893310547) | > avg_loss_disc: 2.6805098056793213 (-0.3764505386352539) | > avg_loss_disc_real_0: 0.26104798913002014 (-0.047335793574651064) | > avg_loss_disc_real_1: 0.2260913203159968 (-0.02870085338751474) | > avg_loss_disc_real_2: 0.2794248362382253 (-0.08955556154251099) | > avg_loss_disc_real_3: 0.2847438454627991 (-0.0035272836685180664) | > avg_loss_disc_real_4: 0.23112864792346954 (-0.06883072853088379) | > avg_loss_disc_real_5: 0.18954147895177206 (-0.14996572335561117) | > avg_loss_0: 2.6805098056793213 (-0.3764505386352539) | > avg_loss_gen: 2.1599860191345215 (+0.17926955223083496) | > avg_loss_kl: 4.498975356419881 (-0.17171883583068848) | > avg_loss_feat: 5.9382969836393995 (+4.236920883258184) | > avg_loss_mel: 21.628082275390625 (+1.3757527669270821) | > avg_loss_duration: 3.214627822240194 (+0.05521702766418457) | > avg_loss_1: 37.439968744913735 (+5.675441106160481)  > EPOCH: 1008/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:26:14)   --> TIME: 2023-10-20 12:26:26 -- STEP: 9/50 -- GLOBAL_STEP: 103410 | > loss_disc: 2.729144811630249 (2.409715599483914) | > loss_disc_real_0: 0.40517571568489075 (0.14526302615801492) | > loss_disc_real_1: 0.3112500011920929 (0.2284518008430799) | > loss_disc_real_2: 0.2610803544521332 (0.22729031617442766) | > loss_disc_real_3: 0.3462970554828644 (0.2537376909620232) | > loss_disc_real_4: 0.23661909997463226 (0.18228875286877155) | > loss_disc_real_5: 0.28231072425842285 (0.22264191839430067) | > loss_0: 2.729144811630249 (2.409715599483914) | > grad_norm_0: tensor(686.8539, device='cuda:0') (tensor(505.3647, device='cuda:0')) | > loss_gen: 2.5890583992004395 (2.5153650840123496) | > loss_kl: 0.8587642312049866 (0.9138989779684279) | > loss_feat: 2.9152607917785645 (6.81951342885279) | > loss_mel: 23.410398483276367 (20.629367676046158) | > loss_duration: 1.3093631267547607 (1.354202151298523) | > loss_1: 31.082843780517578 (32.232347912258575) | > grad_norm_1: tensor(5922.9062, device='cuda:0') (tensor(10643.2568, device='cuda:0')) | > current_lr_0: 7.298503070586673e-05 | > current_lr_1: 7.298503070586673e-05 | > step_time: 0.639 (0.6070687241024442) | > loader_time: 0.0302 (0.019887447357177734)  --> TIME: 2023-10-20 12:26:47 -- STEP: 39/50 -- GLOBAL_STEP: 103440 | > loss_disc: 1.989713191986084 (2.392520870917882) | > loss_disc_real_0: 0.21385478973388672 (0.14701768849045044) | > loss_disc_real_1: 0.2622399628162384 (0.21362682288655868) | > loss_disc_real_2: 0.09669367969036102 (0.2016615845645085) | > loss_disc_real_3: 0.22088126838207245 (0.2452836328974137) | > loss_disc_real_4: 0.30364990234375 (0.21183094100501293) | > loss_disc_real_5: 0.06276094168424606 (0.20628491435677576) | > loss_0: 1.989713191986084 (2.392520870917882) | > grad_norm_0: tensor(823.6381, device='cuda:0') (tensor(599.2927, device='cuda:0')) | > loss_gen: 3.1734938621520996 (2.3976484659390573) | > loss_kl: 0.7193495631217957 (0.8593880090958033) | > loss_feat: 6.627122402191162 (6.4596932174828945) | > loss_mel: 19.769285202026367 (21.70790315132875) | > loss_duration: 1.4077702760696411 (1.3440681390273266) | > loss_1: 31.697021484375 (32.76870111318735) | > grad_norm_1: tensor(15504.3945, device='cuda:0') (tensor(12502.6377, device='cuda:0')) | > current_lr_0: 7.298503070586673e-05 | > current_lr_1: 7.298503070586673e-05 | > step_time: 0.8403 (0.6412646587078388) | > loader_time: 0.0274 (0.0220332145690918)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6709389686584473 (2.6709389686584473) | > loss_disc_real_0: 0.14421041309833527 (0.14421041309833527) | > loss_disc_real_1: 0.27351418137550354 (0.27351418137550354) | > loss_disc_real_2: 0.35493338108062744 (0.35493338108062744) | > loss_disc_real_3: 0.22817331552505493 (0.22817331552505493) | > loss_disc_real_4: 0.12187612801790237 (0.12187612801790237) | > loss_disc_real_5: 0.26498791575431824 (0.26498791575431824) | > loss_0: 2.6709389686584473 (2.6709389686584473) | > loss_gen: 1.9649821519851685 (1.9649821519851685) | > loss_kl: 5.975936412811279 (5.975936412811279) | > loss_feat: 5.482837677001953 (5.482837677001953) | > loss_mel: 24.12270164489746 (24.12270164489746) | > loss_duration: 3.1741669178009033 (3.1741669178009033) | > loss_1: 40.72062301635742 (40.72062301635742)  --> STEP: 1 | > loss_disc: 2.68088436126709 (2.68088436126709) | > loss_disc_real_0: 0.10564849525690079 (0.10564849525690079) | > loss_disc_real_1: 0.25431495904922485 (0.25431495904922485) | > loss_disc_real_2: 0.2305733561515808 (0.2305733561515808) | > loss_disc_real_3: 0.28998279571533203 (0.28998279571533203) | > loss_disc_real_4: 0.14534485340118408 (0.14534485340118408) | > loss_disc_real_5: 0.2475479394197464 (0.2475479394197464) | > loss_0: 2.68088436126709 (2.68088436126709) | > loss_gen: 1.7248339653015137 (1.7248339653015137) | > loss_kl: 5.413548469543457 (5.413548469543457) | > loss_feat: 3.035776376724243 (3.035776376724243) | > loss_mel: 19.333301544189453 (19.333301544189453) | > loss_duration: 3.461212158203125 (3.461212158203125) | > loss_1: 32.96867370605469 (32.96867370605469)  --> STEP: 2 | > loss_disc: 2.2795870304107666 (2.4802356958389282) | > loss_disc_real_0: 0.134879469871521 (0.12026398256421089) | > loss_disc_real_1: 0.24078507721424103 (0.24755001813173294) | > loss_disc_real_2: 0.2743530869483948 (0.2524632215499878) | > loss_disc_real_3: 0.4261430501937866 (0.3580629229545593) | > loss_disc_real_4: 0.2140304297208786 (0.17968764156103134) | > loss_disc_real_5: 0.12268207967281342 (0.1851150095462799) | > loss_0: 2.2795870304107666 (2.4802356958389282) | > loss_gen: 2.8402554988861084 (2.282544732093811) | > loss_kl: 5.835784912109375 (5.624666690826416) | > loss_feat: 6.500722885131836 (4.7682496309280396) | > loss_mel: 23.30301856994629 (21.31816005706787) | > loss_duration: 3.3030200004577637 (3.3821160793304443) | > loss_1: 41.78280258178711 (37.3757381439209)  --> STEP: 3 | > loss_disc: 2.902339458465576 (2.620936950047811) | > loss_disc_real_0: 0.1504090279340744 (0.13031233102083206) | > loss_disc_real_1: 0.31395983695983887 (0.26968662440776825) | > loss_disc_real_2: 0.38998183608055115 (0.2983027597268422) | > loss_disc_real_3: 0.3886067867279053 (0.368244210879008) | > loss_disc_real_4: 0.38469982147216797 (0.24802503486474356) | > loss_disc_real_5: 0.4659494161605835 (0.2787264784177144) | > loss_0: 2.902339458465576 (2.620936950047811) | > loss_gen: 2.589719295501709 (2.384936253229777) | > loss_kl: 2.318622589111328 (4.52265199025472) | > loss_feat: 4.783593654632568 (4.773364305496216) | > loss_mel: 24.387279510498047 (22.34119987487793) | > loss_duration: 2.9896323680877686 (3.2512881755828857) | > loss_1: 37.06884765625 (37.273441314697266) --> EVAL PERFORMANCE | > avg_loader_time: 0.005001544952392578 (-0.0013315677642822266) | > avg_loss_disc: 2.620936950047811 (-0.05957285563151027) | > avg_loss_disc_real_0: 0.13031233102083206 (-0.13073565810918808) | > avg_loss_disc_real_1: 0.26968662440776825 (+0.04359530409177145) | > avg_loss_disc_real_2: 0.2983027597268422 (+0.018877923488616943) | > avg_loss_disc_real_3: 0.368244210879008 (+0.08350036541620892) | > avg_loss_disc_real_4: 0.24802503486474356 (+0.016896386941274016) | > avg_loss_disc_real_5: 0.2787264784177144 (+0.08918499946594236) | > avg_loss_0: 2.620936950047811 (-0.05957285563151027) | > avg_loss_gen: 2.384936253229777 (+0.22495023409525539) | > avg_loss_kl: 4.52265199025472 (+0.023676633834838867) | > avg_loss_feat: 4.773364305496216 (-1.1649326781431837) | > avg_loss_mel: 22.34119987487793 (+0.7131175994873047) | > avg_loss_duration: 3.2512881755828857 (+0.03666035334269191) | > avg_loss_1: 37.273441314697266 (-0.16652743021646899)  > EPOCH: 1009/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:27:08)   --> TIME: 2023-10-20 12:27:27 -- STEP: 19/50 -- GLOBAL_STEP: 103470 | > loss_disc: 2.814317464828491 (2.5700743700328625) | > loss_disc_real_0: 0.055194783955812454 (0.1723958099947164) | > loss_disc_real_1: 0.23840336501598358 (0.243315962976531) | > loss_disc_real_2: 0.21957352757453918 (0.23791819732440145) | > loss_disc_real_3: 0.31684979796409607 (0.24926323698539482) | > loss_disc_real_4: 0.24253755807876587 (0.23051769972631805) | > loss_disc_real_5: 0.17699411511421204 (0.24567529431691296) | > loss_0: 2.814317464828491 (2.5700743700328625) | > grad_norm_0: tensor(1035.1859, device='cuda:0') (tensor(616.5522, device='cuda:0')) | > loss_gen: 1.9989817142486572 (2.269168728276303) | > loss_kl: 1.1170648336410522 (0.8842972705238744) | > loss_feat: 7.6858344078063965 (5.144275116391088) | > loss_mel: 22.145299911499023 (19.53873018214577) | > loss_duration: 1.4697818756103516 (1.369467926652808) | > loss_1: 34.416961669921875 (29.2059390168441) | > grad_norm_1: tensor(75551.8984, device='cuda:0') (tensor(24656.3027, device='cuda:0')) | > current_lr_0: 7.291207759813028e-05 | > current_lr_1: 7.291207759813028e-05 | > step_time: 0.3357 (0.6445988479413485) | > loader_time: 0.0111 (0.02121969273215846)  --> TIME: 2023-10-20 12:27:41 -- STEP: 49/50 -- GLOBAL_STEP: 103500 | > loss_disc: 2.901453733444214 (2.4659560371418388) | > loss_disc_real_0: 0.29692918062210083 (0.15824386722655323) | > loss_disc_real_1: 0.2586020827293396 (0.22464719300671498) | > loss_disc_real_2: 0.29504212737083435 (0.22347494131144213) | > loss_disc_real_3: 0.25950756669044495 (0.2422173220892342) | > loss_disc_real_4: 0.25152531266212463 (0.20804479129004236) | > loss_disc_real_5: 0.24639387428760529 (0.22746952109951146) | > loss_0: 2.901453733444214 (2.4659560371418388) | > grad_norm_0: tensor(909.6402, device='cuda:0') (tensor(633.4492, device='cuda:0')) | > loss_gen: 1.7339494228363037 (2.2503071171896787) | > loss_kl: 0.7548360824584961 (0.7705582830370689) | > loss_feat: 0.3526460826396942 (5.16389942823016) | > loss_mel: 14.678814888000488 (19.74297367553322) | > loss_duration: 1.4058587551116943 (1.329809815299754) | > loss_1: 18.926105499267578 (29.25754827382613) | > grad_norm_1: tensor(17317.7539, device='cuda:0') (tensor(21822.3164, device='cuda:0')) | > current_lr_0: 7.291207759813028e-05 | > current_lr_1: 7.291207759813028e-05 | > step_time: 0.5253 (0.5142922012173399) | > loader_time: 0.5816 (0.025267970805265466)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5201079845428467 (2.5201079845428467) | > loss_disc_real_0: 0.1162291169166565 (0.1162291169166565) | > loss_disc_real_1: 0.2838261127471924 (0.2838261127471924) | > loss_disc_real_2: 0.27899184823036194 (0.27899184823036194) | > loss_disc_real_3: 0.2779378294944763 (0.2779378294944763) | > loss_disc_real_4: 0.37972837686538696 (0.37972837686538696) | > loss_disc_real_5: 0.20234808325767517 (0.20234808325767517) | > loss_0: 2.5201079845428467 (2.5201079845428467) | > loss_gen: 2.554823398590088 (2.554823398590088) | > loss_kl: 4.963731288909912 (4.963731288909912) | > loss_feat: 7.240650653839111 (7.240650653839111) | > loss_mel: 23.7678165435791 (23.7678165435791) | > loss_duration: 3.1365885734558105 (3.1365885734558105) | > loss_1: 41.663612365722656 (41.663612365722656)  --> STEP: 1 | > loss_disc: 2.346695899963379 (2.346695899963379) | > loss_disc_real_0: 0.11998119950294495 (0.11998119950294495) | > loss_disc_real_1: 0.26119810342788696 (0.26119810342788696) | > loss_disc_real_2: 0.28792867064476013 (0.28792867064476013) | > loss_disc_real_3: 0.3814426362514496 (0.3814426362514496) | > loss_disc_real_4: 0.23162131011486053 (0.23162131011486053) | > loss_disc_real_5: 0.16699784994125366 (0.16699784994125366) | > loss_0: 2.346695899963379 (2.346695899963379) | > loss_gen: 2.6507673263549805 (2.6507673263549805) | > loss_kl: 5.696101188659668 (5.696101188659668) | > loss_feat: 7.540451526641846 (7.540451526641846) | > loss_mel: 22.925203323364258 (22.925203323364258) | > loss_duration: 3.5240156650543213 (3.5240156650543213) | > loss_1: 42.336544036865234 (42.336544036865234)  --> STEP: 2 | > loss_disc: 2.934260606765747 (2.640478253364563) | > loss_disc_real_0: 0.2362096905708313 (0.17809544503688812) | > loss_disc_real_1: 0.25964221358299255 (0.26042015850543976) | > loss_disc_real_2: 0.2606894373893738 (0.27430905401706696) | > loss_disc_real_3: 0.2618753910064697 (0.32165901362895966) | > loss_disc_real_4: 0.25338131189346313 (0.24250131100416183) | > loss_disc_real_5: 0.2486918568611145 (0.20784485340118408) | > loss_0: 2.934260606765747 (2.640478253364563) | > loss_gen: 1.5899896621704102 (2.1203784942626953) | > loss_kl: 6.314455509185791 (6.0052783489227295) | > loss_feat: 0.16913367807865143 (3.8547926023602486) | > loss_mel: 1.9185625314712524 (12.421882927417755) | > loss_duration: 3.372647523880005 (3.448331594467163) | > loss_1: 13.364789009094238 (27.850666522979736)  --> STEP: 3 | > loss_disc: 2.933199405670166 (2.738051970799764) | > loss_disc_real_0: 0.2365141212940216 (0.19756833712259927) | > loss_disc_real_1: 0.2596445381641388 (0.2601616183916728) | > loss_disc_real_2: 0.2607714533805847 (0.2697965204715729) | > loss_disc_real_3: 0.26188263297080994 (0.3017335534095764) | > loss_disc_real_4: 0.25335967540740967 (0.24612076580524445) | > loss_disc_real_5: 0.2486935555934906 (0.22146108746528625) | > loss_0: 2.933199405670166 (2.738051970799764) | > loss_gen: 1.591462254524231 (1.9440730810165405) | > loss_kl: 2.1154725551605225 (4.70867641766866) | > loss_feat: 0.1715216189622879 (2.627035607894262) | > loss_mel: 2.7947254180908203 (9.212830424308777) | > loss_duration: 3.0577476024627686 (3.3181369304656982) | > loss_1: 9.730929374694824 (21.810754140218098) --> EVAL PERFORMANCE | > avg_loader_time: 0.018735726674397785 (+0.013734181722005207) | > avg_loss_disc: 2.738051970799764 (+0.11711502075195312) | > avg_loss_disc_real_0: 0.19756833712259927 (+0.06725600610176721) | > avg_loss_disc_real_1: 0.2601616183916728 (-0.00952500601609546) | > avg_loss_disc_real_2: 0.2697965204715729 (-0.02850623925526935) | > avg_loss_disc_real_3: 0.3017335534095764 (-0.06651065746943158) | > avg_loss_disc_real_4: 0.24612076580524445 (-0.001904269059499114) | > avg_loss_disc_real_5: 0.22146108746528625 (-0.05726539095242816) | > avg_loss_0: 2.738051970799764 (+0.11711502075195312) | > avg_loss_gen: 1.9440730810165405 (-0.44086317221323634) | > avg_loss_kl: 4.70867641766866 (+0.18602442741394043) | > avg_loss_feat: 2.627035607894262 (-2.146328697601954) | > avg_loss_mel: 9.212830424308777 (-13.128369450569153) | > avg_loss_duration: 3.3181369304656982 (+0.0668487548828125) | > avg_loss_1: 21.810754140218098 (-15.462687174479168)  > EPOCH: 1010/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:27:53)   --> TIME: 2023-10-20 12:28:18 -- STEP: 29/50 -- GLOBAL_STEP: 103530 | > loss_disc: 2.6884889602661133 (2.397591467561393) | > loss_disc_real_0: 0.20590436458587646 (0.12811373973843357) | > loss_disc_real_1: 0.34731584787368774 (0.23219854622308547) | > loss_disc_real_2: 0.33745771646499634 (0.2218415269563938) | > loss_disc_real_3: 0.4049754738807678 (0.2513453762592941) | > loss_disc_real_4: 0.26232054829597473 (0.2097517704141551) | > loss_disc_real_5: 0.19222325086593628 (0.20199529576147424) | > loss_0: 2.6884889602661133 (2.397591467561393) | > grad_norm_0: tensor(440.7430, device='cuda:0') (tensor(514.4175, device='cuda:0')) | > loss_gen: 2.515378952026367 (2.3418772631678078) | > loss_kl: 0.9904813766479492 (0.7726190028519466) | > loss_feat: 4.66854190826416 (5.8820075947662875) | > loss_mel: 23.705156326293945 (21.16234089588297) | > loss_duration: 1.287935495376587 (1.3578907456891292) | > loss_1: 33.16749572753906 (31.516735274216224) | > grad_norm_1: tensor(4388.0410, device='cuda:0') (tensor(20556.0918, device='cuda:0')) | > current_lr_0: 7.283919741159256e-05 | > current_lr_1: 7.283919741159256e-05 | > step_time: 0.5571 (0.6425301864229399) | > loader_time: 0.0393 (0.02437097450782513)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4434351921081543 (3.4434351921081543) | > loss_disc_real_0: 0.4478505253791809 (0.4478505253791809) | > loss_disc_real_1: 0.1886340230703354 (0.1886340230703354) | > loss_disc_real_2: 0.3137655556201935 (0.3137655556201935) | > loss_disc_real_3: 0.2856166362762451 (0.2856166362762451) | > loss_disc_real_4: 0.4918142557144165 (0.4918142557144165) | > loss_disc_real_5: 0.6604937314987183 (0.6604937314987183) | > loss_0: 3.4434351921081543 (3.4434351921081543) | > loss_gen: 2.7199110984802246 (2.7199110984802246) | > loss_kl: 5.602336883544922 (5.602336883544922) | > loss_feat: 5.180617332458496 (5.180617332458496) | > loss_mel: 25.441978454589844 (25.441978454589844) | > loss_duration: 3.1635804176330566 (3.1635804176330566) | > loss_1: 42.10842514038086 (42.10842514038086)  --> STEP: 1 | > loss_disc: 2.126957893371582 (2.126957893371582) | > loss_disc_real_0: 0.11169087886810303 (0.11169087886810303) | > loss_disc_real_1: 0.16494746506214142 (0.16494746506214142) | > loss_disc_real_2: 0.2531084716320038 (0.2531084716320038) | > loss_disc_real_3: 0.2252790480852127 (0.2252790480852127) | > loss_disc_real_4: 0.2445591539144516 (0.2445591539144516) | > loss_disc_real_5: 0.2070734202861786 (0.2070734202861786) | > loss_0: 2.126957893371582 (2.126957893371582) | > loss_gen: 2.7066104412078857 (2.7066104412078857) | > loss_kl: 5.761189937591553 (5.761189937591553) | > loss_feat: 8.076690673828125 (8.076690673828125) | > loss_mel: 24.059894561767578 (24.059894561767578) | > loss_duration: 3.5081403255462646 (3.5081403255462646) | > loss_1: 44.112525939941406 (44.112525939941406)  --> STEP: 2 | > loss_disc: 2.8858542442321777 (2.50640606880188) | > loss_disc_real_0: 0.3078596889972687 (0.20977528393268585) | > loss_disc_real_1: 0.23836125433444977 (0.2016543596982956) | > loss_disc_real_2: 0.32206660509109497 (0.2875875383615494) | > loss_disc_real_3: 0.2653811275959015 (0.2453300878405571) | > loss_disc_real_4: 0.23860108852386475 (0.24158012121915817) | > loss_disc_real_5: 0.24009361863136292 (0.22358351945877075) | > loss_0: 2.8858542442321777 (2.50640606880188) | > loss_gen: 2.058180809020996 (2.382395625114441) | > loss_kl: 5.782097816467285 (5.771643877029419) | > loss_feat: 3.801267623901367 (5.938979148864746) | > loss_mel: 25.538110733032227 (24.799002647399902) | > loss_duration: 3.208261013031006 (3.3582006692886353) | > loss_1: 40.387916564941406 (42.250221252441406)  --> STEP: 3 | > loss_disc: 1.977311611175537 (2.330041249593099) | > loss_disc_real_0: 0.04468471556901932 (0.15474509447813034) | > loss_disc_real_1: 0.16899004578590393 (0.1907662550608317) | > loss_disc_real_2: 0.13175976276397705 (0.23564494649569193) | > loss_disc_real_3: 0.07843484729528427 (0.1896983409921328) | > loss_disc_real_4: 0.16077348589897156 (0.2146445761124293) | > loss_disc_real_5: 0.08894046396017075 (0.17870250095923743) | > loss_0: 1.977311611175537 (2.330041249593099) | > loss_gen: 1.9586964845657349 (2.241162578264872) | > loss_kl: 2.517488718032837 (4.686925490697225) | > loss_feat: 6.718489646911621 (6.198815981547038) | > loss_mel: 26.234228134155273 (25.277411142985027) | > loss_duration: 3.115337610244751 (3.2772463162740073) | > loss_1: 40.54424285888672 (41.68156178792318) --> EVAL PERFORMANCE | > avg_loader_time: 0.002179384231567383 (-0.016556342442830402) | > avg_loss_disc: 2.330041249593099 (-0.40801072120666504) | > avg_loss_disc_real_0: 0.15474509447813034 (-0.042823242644468934) | > avg_loss_disc_real_1: 0.1907662550608317 (-0.06939536333084109) | > avg_loss_disc_real_2: 0.23564494649569193 (-0.03415157397588095) | > avg_loss_disc_real_3: 0.1896983409921328 (-0.1120352124174436) | > avg_loss_disc_real_4: 0.2146445761124293 (-0.031476189692815154) | > avg_loss_disc_real_5: 0.17870250095923743 (-0.04275858650604883) | > avg_loss_0: 2.330041249593099 (-0.40801072120666504) | > avg_loss_gen: 2.241162578264872 (+0.29708949724833156) | > avg_loss_kl: 4.686925490697225 (-0.021750926971435547) | > avg_loss_feat: 6.198815981547038 (+3.5717803736527762) | > avg_loss_mel: 25.277411142985027 (+16.06458071867625) | > avg_loss_duration: 3.2772463162740073 (-0.04089061419169093) | > avg_loss_1: 41.68156178792318 (+19.87080764770508)  > EPOCH: 1011/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:28:48)   --> TIME: 2023-10-20 12:28:59 -- STEP: 9/50 -- GLOBAL_STEP: 103560 | > loss_disc: 2.8389499187469482 (2.6127890745798745) | > loss_disc_real_0: 0.2326115220785141 (0.18066480259100595) | > loss_disc_real_1: 0.17561662197113037 (0.23638801111115348) | > loss_disc_real_2: 0.279283732175827 (0.22163792534006965) | > loss_disc_real_3: 0.2560177147388458 (0.24460343105925453) | > loss_disc_real_4: 0.32090693712234497 (0.31874856104453403) | > loss_disc_real_5: 0.38360491394996643 (0.2856718831592136) | > loss_0: 2.8389499187469482 (2.6127890745798745) | > grad_norm_0: tensor(1316.7205, device='cuda:0') (tensor(1110.1462, device='cuda:0')) | > loss_gen: 2.221304178237915 (2.335445443789164) | > loss_kl: 1.1476742029190063 (0.7766579770379596) | > loss_feat: 4.9144134521484375 (5.386871046490139) | > loss_mel: 20.694204330444336 (19.517733573913574) | > loss_duration: 1.3511767387390137 (1.323906699816386) | > loss_1: 30.328773498535156 (29.340614954630535) | > grad_norm_1: tensor(10755.5381, device='cuda:0') (tensor(29733.2188, device='cuda:0')) | > current_lr_0: 7.276639007336429e-05 | > current_lr_1: 7.276639007336429e-05 | > step_time: 0.7958 (0.6309306356641982) | > loader_time: 0.0136 (0.007638030582004123)  --> TIME: 2023-10-20 12:29:16 -- STEP: 39/50 -- GLOBAL_STEP: 103590 | > loss_disc: 2.7870802879333496 (2.5310165759844656) | > loss_disc_real_0: 0.035472527146339417 (0.14902131135265032) | > loss_disc_real_1: 0.22950494289398193 (0.23849010372009033) | > loss_disc_real_2: 0.22096730768680573 (0.22506055446007314) | > loss_disc_real_3: 0.3249751329421997 (0.24697653777324236) | > loss_disc_real_4: 0.09541850537061691 (0.23240110688866714) | > loss_disc_real_5: 0.18491053581237793 (0.23763964544886199) | > loss_0: 2.7870802879333496 (2.5310165759844656) | > grad_norm_0: tensor(594.7610, device='cuda:0') (tensor(728.2153, device='cuda:0')) | > loss_gen: 2.215686321258545 (2.2526066547785053) | > loss_kl: 0.357247531414032 (0.797771556637226) | > loss_feat: 5.789260387420654 (5.298548959243373) | > loss_mel: 20.504873275756836 (20.224770463429966) | > loss_duration: 1.3437236547470093 (1.334548430565076) | > loss_1: 30.210790634155273 (29.908245966984676) | > grad_norm_1: tensor(31129.9551, device='cuda:0') (tensor(19159.3398, device='cuda:0')) | > current_lr_0: 7.276639007336429e-05 | > current_lr_1: 7.276639007336429e-05 | > step_time: 0.4157 (0.5842020878425013) | > loader_time: 0.0318 (0.017006647892487355)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5610837936401367 (2.5610837936401367) | > loss_disc_real_0: 0.47036266326904297 (0.47036266326904297) | > loss_disc_real_1: 0.20721131563186646 (0.20721131563186646) | > loss_disc_real_2: 0.2353847622871399 (0.2353847622871399) | > loss_disc_real_3: 0.2616705000400543 (0.2616705000400543) | > loss_disc_real_4: 0.17174744606018066 (0.17174744606018066) | > loss_disc_real_5: 0.18932951986789703 (0.18932951986789703) | > loss_0: 2.5610837936401367 (2.5610837936401367) | > loss_gen: 3.093442440032959 (3.093442440032959) | > loss_kl: 5.599000453948975 (5.599000453948975) | > loss_feat: 7.8327717781066895 (7.8327717781066895) | > loss_mel: 24.05888557434082 (24.05888557434082) | > loss_duration: 3.0770463943481445 (3.0770463943481445) | > loss_1: 43.6611442565918 (43.6611442565918)  --> STEP: 1 | > loss_disc: 2.555903673171997 (2.555903673171997) | > loss_disc_real_0: 0.11165031790733337 (0.11165031790733337) | > loss_disc_real_1: 0.2293221652507782 (0.2293221652507782) | > loss_disc_real_2: 0.13812340795993805 (0.13812340795993805) | > loss_disc_real_3: 0.23192982375621796 (0.23192982375621796) | > loss_disc_real_4: 0.20088480412960052 (0.20088480412960052) | > loss_disc_real_5: 0.2790932059288025 (0.2790932059288025) | > loss_0: 2.555903673171997 (2.555903673171997) | > loss_gen: 1.8887144327163696 (1.8887144327163696) | > loss_kl: 4.976934909820557 (4.976934909820557) | > loss_feat: 4.739856719970703 (4.739856719970703) | > loss_mel: 23.855060577392578 (23.855060577392578) | > loss_duration: 3.4545440673828125 (3.4545440673828125) | > loss_1: 38.91511154174805 (38.91511154174805)  --> STEP: 2 | > loss_disc: 2.8132309913635254 (2.6845673322677612) | > loss_disc_real_0: 0.20155072212219238 (0.15660052001476288) | > loss_disc_real_1: 0.266220360994339 (0.2477712631225586) | > loss_disc_real_2: 0.28864333033561707 (0.21338336914777756) | > loss_disc_real_3: 0.2555147111415863 (0.24372226744890213) | > loss_disc_real_4: 0.2711178958415985 (0.23600134998559952) | > loss_disc_real_5: 0.23477737605571747 (0.25693529099226) | > loss_0: 2.8132309913635254 (2.6845673322677612) | > loss_gen: 1.749161958694458 (1.8189381957054138) | > loss_kl: 5.511375427246094 (5.244155168533325) | > loss_feat: 0.6534813642501831 (2.696669042110443) | > loss_mel: 15.615936279296875 (19.735498428344727) | > loss_duration: 3.296826124191284 (3.3756850957870483) | > loss_1: 26.826780319213867 (32.87094593048096)  --> STEP: 3 | > loss_disc: 2.6123127937316895 (2.660482486089071) | > loss_disc_real_0: 0.44239750504493713 (0.2518661816914876) | > loss_disc_real_1: 0.2433498501777649 (0.24629745880762735) | > loss_disc_real_2: 0.24095715582370758 (0.22257463137308756) | > loss_disc_real_3: 0.3177865743637085 (0.2684103697538376) | > loss_disc_real_4: 0.14926931262016296 (0.20709067086378732) | > loss_disc_real_5: 0.20780007541179657 (0.24055688579877219) | > loss_0: 2.6123127937316895 (2.660482486089071) | > loss_gen: 2.4305837154388428 (2.0228200356165567) | > loss_kl: 2.6780991554260254 (4.388803164164226) | > loss_feat: 3.6581408977508545 (3.017159660657247) | > loss_mel: 16.84113311767578 (18.770709991455078) | > loss_duration: 2.957993268966675 (3.236454486846924) | > loss_1: 28.565948486328125 (31.435946782430012) --> EVAL PERFORMANCE | > avg_loader_time: 0.006070534388224284 (+0.0038911501566569013) | > avg_loss_disc: 2.660482486089071 (+0.3304412364959717) | > avg_loss_disc_real_0: 0.2518661816914876 (+0.09712108721335727) | > avg_loss_disc_real_1: 0.24629745880762735 (+0.055531203746795654) | > avg_loss_disc_real_2: 0.22257463137308756 (-0.01307031512260437) | > avg_loss_disc_real_3: 0.2684103697538376 (+0.07871202876170477) | > avg_loss_disc_real_4: 0.20709067086378732 (-0.007553905248641968) | > avg_loss_disc_real_5: 0.24055688579877219 (+0.06185438483953476) | > avg_loss_0: 2.660482486089071 (+0.3304412364959717) | > avg_loss_gen: 2.0228200356165567 (-0.21834254264831543) | > avg_loss_kl: 4.388803164164226 (-0.2981223265329991) | > avg_loss_feat: 3.017159660657247 (-3.181656320889791) | > avg_loss_mel: 18.770709991455078 (-6.506701151529949) | > avg_loss_duration: 3.236454486846924 (-0.04079182942708348) | > avg_loss_1: 31.435946782430012 (-10.245615005493168)  > EPOCH: 1012/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:29:34)   --> TIME: 2023-10-20 12:29:52 -- STEP: 19/50 -- GLOBAL_STEP: 103620 | > loss_disc: 1.6902762651443481 (2.2401586018110575) | > loss_disc_real_0: 0.074522465467453 (0.12458424427007374) | > loss_disc_real_1: 0.21724551916122437 (0.19796660816983172) | > loss_disc_real_2: 0.22947944700717926 (0.2118537076013653) | > loss_disc_real_3: 0.13069795072078705 (0.2334599253770552) | > loss_disc_real_4: 0.09450501203536987 (0.18590224063710162) | > loss_disc_real_5: 0.05137955769896507 (0.19699918008164355) | > loss_0: 1.6902762651443481 (2.2401586018110575) | > grad_norm_0: tensor(215.1131, device='cuda:0') (tensor(507.3788, device='cuda:0')) | > loss_gen: 2.8989458084106445 (2.5154274074654834) | > loss_kl: 1.1494938135147095 (0.8732836952334956) | > loss_feat: 9.301651954650879 (6.673201186092276) | > loss_mel: 23.547348022460938 (21.4222186741076) | > loss_duration: 1.496152639389038 (1.3714173718502647) | > loss_1: 38.39358901977539 (32.85554825632196) | > grad_norm_1: tensor(9866.0332, device='cuda:0') (tensor(26521.4453, device='cuda:0')) | > current_lr_0: 7.269365551062898e-05 | > current_lr_1: 7.269365551062898e-05 | > step_time: 0.4155 (0.5729698758376273) | > loader_time: 0.0054 (0.02055643734179045)  --> TIME: 2023-10-20 12:30:05 -- STEP: 49/50 -- GLOBAL_STEP: 103650 | > loss_disc: 2.6457457542419434 (2.406307558624112) | > loss_disc_real_0: 0.16852983832359314 (0.12365633675030299) | > loss_disc_real_1: 0.27690425515174866 (0.21409176550425438) | > loss_disc_real_2: 0.278058797121048 (0.22554515108314097) | > loss_disc_real_3: 0.24804696440696716 (0.23098496402784882) | > loss_disc_real_4: 0.2230813205242157 (0.22812317311763763) | > loss_disc_real_5: 0.30026569962501526 (0.2309925089381179) | > loss_0: 2.6457457542419434 (2.406307558624112) | > grad_norm_0: tensor(466.2088, device='cuda:0') (tensor(511.4261, device='cuda:0')) | > loss_gen: 2.141484260559082 (2.3483783736520882) | > loss_kl: 0.45957431197166443 (0.8317549915946258) | > loss_feat: 2.6402981281280518 (5.810578842856446) | > loss_mel: 21.62790298461914 (20.85788361880244) | > loss_duration: 1.4171905517578125 (1.3427525856056992) | > loss_1: 28.286449432373047 (31.1913482413) | > grad_norm_1: tensor(4551.7856, device='cuda:0') (tensor(18699.3730, device='cuda:0')) | > current_lr_0: 7.269365551062898e-05 | > current_lr_1: 7.269365551062898e-05 | > step_time: 0.2839 (0.47973993359779826) | > loader_time: 0.4298 (0.022374819736091463)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.963681221008301 (2.963681221008301) | > loss_disc_real_0: 0.2367067039012909 (0.2367067039012909) | > loss_disc_real_1: 0.23506669700145721 (0.23506669700145721) | > loss_disc_real_2: 0.3423079550266266 (0.3423079550266266) | > loss_disc_real_3: 0.2805236279964447 (0.2805236279964447) | > loss_disc_real_4: 0.2586757242679596 (0.2586757242679596) | > loss_disc_real_5: 0.3199434280395508 (0.3199434280395508) | > loss_0: 2.963681221008301 (2.963681221008301) | > loss_gen: 1.748029112815857 (1.748029112815857) | > loss_kl: 5.04440975189209 (5.04440975189209) | > loss_feat: 0.25851646065711975 (0.25851646065711975) | > loss_mel: 13.842164993286133 (13.842164993286133) | > loss_duration: 3.0052359104156494 (3.0052359104156494) | > loss_1: 23.898357391357422 (23.898357391357422)  --> STEP: 1 | > loss_disc: 2.126879930496216 (2.126879930496216) | > loss_disc_real_0: 0.18349751830101013 (0.18349751830101013) | > loss_disc_real_1: 0.25783228874206543 (0.25783228874206543) | > loss_disc_real_2: 0.21452531218528748 (0.21452531218528748) | > loss_disc_real_3: 0.15693262219429016 (0.15693262219429016) | > loss_disc_real_4: 0.1518758237361908 (0.1518758237361908) | > loss_disc_real_5: 0.21199747920036316 (0.21199747920036316) | > loss_0: 2.126879930496216 (2.126879930496216) | > loss_gen: 2.694053888320923 (2.694053888320923) | > loss_kl: 5.536870956420898 (5.536870956420898) | > loss_feat: 7.89380407333374 (7.89380407333374) | > loss_mel: 21.629467010498047 (21.629467010498047) | > loss_duration: 3.2868096828460693 (3.2868096828460693) | > loss_1: 41.0410041809082 (41.0410041809082)  --> STEP: 2 | > loss_disc: 3.2810161113739014 (2.7039480209350586) | > loss_disc_real_0: 0.9007836580276489 (0.5421405881643295) | > loss_disc_real_1: 0.3088277578353882 (0.2833300232887268) | > loss_disc_real_2: 0.27315622568130493 (0.2438407689332962) | > loss_disc_real_3: 0.21255537867546082 (0.1847440004348755) | > loss_disc_real_4: 0.3750987648963928 (0.2634872943162918) | > loss_disc_real_5: 0.3502049446105957 (0.28110121190547943) | > loss_0: 3.2810161113739014 (2.7039480209350586) | > loss_gen: 3.0293965339660645 (2.8617252111434937) | > loss_kl: 5.4967498779296875 (5.516810417175293) | > loss_feat: 7.182041168212891 (7.537922620773315) | > loss_mel: 22.230968475341797 (21.930217742919922) | > loss_duration: 3.270951747894287 (3.2788807153701782) | > loss_1: 41.210105895996094 (41.12555503845215)  --> STEP: 3 | > loss_disc: 2.666869640350342 (2.691588560740153) | > loss_disc_real_0: 0.1175626888871193 (0.4006146217385928) | > loss_disc_real_1: 0.2614767551422119 (0.27604560057322186) | > loss_disc_real_2: 0.261964350938797 (0.2498819629351298) | > loss_disc_real_3: 0.24575071036815643 (0.2050795704126358) | > loss_disc_real_4: 0.3843538463115692 (0.3037761449813843) | > loss_disc_real_5: 0.33412593603134155 (0.29877611994743347) | > loss_0: 2.666869640350342 (2.691588560740153) | > loss_gen: 2.243255138397217 (2.655568520228068) | > loss_kl: 2.404268264770508 (4.479296366373698) | > loss_feat: 4.633981227874756 (6.569942156473796) | > loss_mel: 20.08333969116211 (21.314591725667317) | > loss_duration: 2.896761655807495 (3.1515076955159507) | > loss_1: 32.2616081237793 (38.17090606689453) --> EVAL PERFORMANCE | > avg_loader_time: 0.023000001907348633 (+0.016929467519124348) | > avg_loss_disc: 2.691588560740153 (+0.03110607465108206) | > avg_loss_disc_real_0: 0.4006146217385928 (+0.1487484400471052) | > avg_loss_disc_real_1: 0.27604560057322186 (+0.02974814176559451) | > avg_loss_disc_real_2: 0.2498819629351298 (+0.027307331562042236) | > avg_loss_disc_real_3: 0.2050795704126358 (-0.06333079934120178) | > avg_loss_disc_real_4: 0.3037761449813843 (+0.09668547411759695) | > avg_loss_disc_real_5: 0.29877611994743347 (+0.058219234148661286) | > avg_loss_0: 2.691588560740153 (+0.03110607465108206) | > avg_loss_gen: 2.655568520228068 (+0.6327484846115112) | > avg_loss_kl: 4.479296366373698 (+0.09049320220947266) | > avg_loss_feat: 6.569942156473796 (+3.552782495816549) | > avg_loss_mel: 21.314591725667317 (+2.5438817342122384) | > avg_loss_duration: 3.1515076955159507 (-0.08494679133097316) | > avg_loss_1: 38.17090606689453 (+6.734959284464519)  > EPOCH: 1013/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:30:26)   --> TIME: 2023-10-20 12:30:52 -- STEP: 29/50 -- GLOBAL_STEP: 103680 | > loss_disc: 2.5448591709136963 (2.5009678848858536) | > loss_disc_real_0: 0.24475811421871185 (0.1616086059346281) | > loss_disc_real_1: 0.13151122629642487 (0.20733033737231946) | > loss_disc_real_2: 0.2420690506696701 (0.22661998167890926) | > loss_disc_real_3: 0.2551860809326172 (0.22971194757726685) | > loss_disc_real_4: 0.3069193661212921 (0.25656875646833716) | > loss_disc_real_5: 0.2646835446357727 (0.239269424101402) | > loss_0: 2.5448591709136963 (2.5009678848858536) | > grad_norm_0: tensor(504.4056, device='cuda:0') (tensor(548.8807, device='cuda:0')) | > loss_gen: 2.3541226387023926 (2.290799083380864) | > loss_kl: 1.1070610284805298 (0.8451626763261598) | > loss_feat: 5.4191060066223145 (5.770341832062294) | > loss_mel: 21.543935775756836 (18.85868182675592) | > loss_duration: 1.3325681686401367 (1.3544808338428367) | > loss_1: 31.756793975830078 (29.119466008811163) | > grad_norm_1: tensor(4300.1079, device='cuda:0') (tensor(20662.9023, device='cuda:0')) | > current_lr_0: 7.262099365064297e-05 | > current_lr_1: 7.262099365064297e-05 | > step_time: 0.3826 (0.5845414605633967) | > loader_time: 0.0054 (0.017859804219213026)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.823735237121582 (1.823735237121582) | > loss_disc_real_0: 0.07559580355882645 (0.07559580355882645) | > loss_disc_real_1: 0.24704930186271667 (0.24704930186271667) | > loss_disc_real_2: 0.20558275282382965 (0.20558275282382965) | > loss_disc_real_3: 0.23139718174934387 (0.23139718174934387) | > loss_disc_real_4: 0.1653195470571518 (0.1653195470571518) | > loss_disc_real_5: 0.09131230413913727 (0.09131230413913727) | > loss_0: 1.823735237121582 (1.823735237121582) | > loss_gen: 2.6764395236968994 (2.6764395236968994) | > loss_kl: 4.982032775878906 (4.982032775878906) | > loss_feat: 8.758712768554688 (8.758712768554688) | > loss_mel: 22.635011672973633 (22.635011672973633) | > loss_duration: 3.0170698165893555 (3.0170698165893555) | > loss_1: 42.06926727294922 (42.06926727294922)  --> STEP: 1 | > loss_disc: 1.8380653858184814 (1.8380653858184814) | > loss_disc_real_0: 0.1393633484840393 (0.1393633484840393) | > loss_disc_real_1: 0.3182799816131592 (0.3182799816131592) | > loss_disc_real_2: 0.17429664731025696 (0.17429664731025696) | > loss_disc_real_3: 0.07692233473062515 (0.07692233473062515) | > loss_disc_real_4: 0.11986705660820007 (0.11986705660820007) | > loss_disc_real_5: 0.12889017164707184 (0.12889017164707184) | > loss_0: 1.8380653858184814 (1.8380653858184814) | > loss_gen: 2.780078649520874 (2.780078649520874) | > loss_kl: 5.285082817077637 (5.285082817077637) | > loss_feat: 7.744352340698242 (7.744352340698242) | > loss_mel: 24.17098617553711 (24.17098617553711) | > loss_duration: 3.423213243484497 (3.423213243484497) | > loss_1: 43.40371322631836 (43.40371322631836)  --> STEP: 2 | > loss_disc: 1.9933582544326782 (1.9157118201255798) | > loss_disc_real_0: 0.13870105147361755 (0.13903219997882843) | > loss_disc_real_1: 0.22874900698661804 (0.2735144942998886) | > loss_disc_real_2: 0.19400954246520996 (0.18415309488773346) | > loss_disc_real_3: 0.14382384717464447 (0.11037309095263481) | > loss_disc_real_4: 0.11627239733934402 (0.11806972697377205) | > loss_disc_real_5: 0.0914103239774704 (0.11015024781227112) | > loss_0: 1.9933582544326782 (1.9157118201255798) | > loss_gen: 2.489734411239624 (2.634906530380249) | > loss_kl: 5.529465198516846 (5.407274007797241) | > loss_feat: 11.120645523071289 (9.432498931884766) | > loss_mel: 26.006811141967773 (25.08889865875244) | > loss_duration: 3.1857969760894775 (3.3045051097869873) | > loss_1: 48.332454681396484 (45.86808395385742)  --> STEP: 3 | > loss_disc: 3.1647472381591797 (2.3320569594701133) | > loss_disc_real_0: 0.21700206398963928 (0.16502215464909872) | > loss_disc_real_1: 0.24584636092185974 (0.26429178317387897) | > loss_disc_real_2: 0.25250762701034546 (0.20693793892860413) | > loss_disc_real_3: 0.31903010606765747 (0.17992542932430902) | > loss_disc_real_4: 0.49111977219581604 (0.2424197420477867) | > loss_disc_real_5: 0.5815832614898682 (0.26729458570480347) | > loss_0: 3.1647472381591797 (2.3320569594701133) | > loss_gen: 2.3805603981018066 (2.550124486287435) | > loss_kl: 2.5845775604248047 (4.466375192006429) | > loss_feat: 5.067436695098877 (7.97747818628947) | > loss_mel: 22.136220932006836 (24.10467274983724) | > loss_duration: 2.928164005279541 (3.179058074951172) | > loss_1: 35.096961975097656 (42.2777099609375) --> EVAL PERFORMANCE | > avg_loader_time: 0.015456517537434896 (-0.007543484369913736) | > avg_loss_disc: 2.3320569594701133 (-0.3595316012700396) | > avg_loss_disc_real_0: 0.16502215464909872 (-0.23559246708949408) | > avg_loss_disc_real_1: 0.26429178317387897 (-0.011753817399342892) | > avg_loss_disc_real_2: 0.20693793892860413 (-0.042944024006525666) | > avg_loss_disc_real_3: 0.17992542932430902 (-0.02515414108832678) | > avg_loss_disc_real_4: 0.2424197420477867 (-0.061356402933597565) | > avg_loss_disc_real_5: 0.26729458570480347 (-0.031481534242630005) | > avg_loss_0: 2.3320569594701133 (-0.3595316012700396) | > avg_loss_gen: 2.550124486287435 (-0.10544403394063284) | > avg_loss_kl: 4.466375192006429 (-0.012921174367269472) | > avg_loss_feat: 7.97747818628947 (+1.4075360298156738) | > avg_loss_mel: 24.10467274983724 (+2.790081024169922) | > avg_loss_duration: 3.179058074951172 (+0.027550379435221206) | > avg_loss_1: 42.2777099609375 (+4.106803894042969)  > EPOCH: 1014/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:31:21)   --> TIME: 2023-10-20 12:31:31 -- STEP: 9/50 -- GLOBAL_STEP: 103710 | > loss_disc: 2.852642059326172 (2.547770871056451) | > loss_disc_real_0: 0.2540065050125122 (0.1757450136873457) | > loss_disc_real_1: 0.22829580307006836 (0.2213694453239441) | > loss_disc_real_2: 0.26943376660346985 (0.21228187655409178) | > loss_disc_real_3: 0.41868671774864197 (0.215618214259545) | > loss_disc_real_4: 0.3914697766304016 (0.23025282389587826) | > loss_disc_real_5: 0.4028282165527344 (0.2370627431405915) | > loss_0: 2.852642059326172 (2.547770871056451) | > grad_norm_0: tensor(659.4916, device='cuda:0') (tensor(528.4878, device='cuda:0')) | > loss_gen: 2.737720251083374 (2.1911456187566123) | > loss_kl: 0.81163489818573 (0.8136876126130422) | > loss_feat: 4.80445671081543 (5.195464796490139) | > loss_mel: 21.475088119506836 (20.170567088656956) | > loss_duration: 1.3379555940628052 (1.3523291614320543) | > loss_1: 31.166854858398438 (29.723193910386826) | > grad_norm_1: tensor(7323.7266, device='cuda:0') (tensor(17504.8789, device='cuda:0')) | > current_lr_0: 7.254840442073536e-05 | > current_lr_1: 7.254840442073536e-05 | > step_time: 0.6055 (0.47722652223375106) | > loader_time: 0.0106 (0.005983697043524848)  --> TIME: 2023-10-20 12:31:45 -- STEP: 39/50 -- GLOBAL_STEP: 103740 | > loss_disc: 2.8811869621276855 (2.5109516045986076) | > loss_disc_real_0: 0.1905215084552765 (0.15073511047432062) | > loss_disc_real_1: 0.3222891092300415 (0.2344802946616442) | > loss_disc_real_2: 0.2863836884498596 (0.22494603282748124) | > loss_disc_real_3: 0.33581382036209106 (0.2421832989232662) | > loss_disc_real_4: 0.3007916510105133 (0.2399471506762963) | > loss_disc_real_5: 0.3487032949924469 (0.2393198472996935) | > loss_0: 2.8811869621276855 (2.5109516045986076) | > grad_norm_0: tensor(481.1996, device='cuda:0') (tensor(559.7200, device='cuda:0')) | > loss_gen: 2.1574103832244873 (2.3306127419838543) | > loss_kl: 0.31102508306503296 (0.8823929451979123) | > loss_feat: 2.5618093013763428 (5.897652675970816) | > loss_mel: 20.65122413635254 (21.73787193420606) | > loss_duration: 1.3798561096191406 (1.3445446399542003) | > loss_1: 27.061325073242188 (32.193074911068656) | > grad_norm_1: tensor(9993.1738, device='cuda:0') (tensor(20479.9316, device='cuda:0')) | > current_lr_0: 7.254840442073536e-05 | > current_lr_1: 7.254840442073536e-05 | > step_time: 0.7047 (0.45297169074034077) | > loader_time: 0.0244 (0.009481063255896935)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.581562042236328 (2.581562042236328) | > loss_disc_real_0: 0.30994921922683716 (0.30994921922683716) | > loss_disc_real_1: 0.2601926326751709 (0.2601926326751709) | > loss_disc_real_2: 0.27049505710601807 (0.27049505710601807) | > loss_disc_real_3: 0.2815648913383484 (0.2815648913383484) | > loss_disc_real_4: 0.18709895014762878 (0.18709895014762878) | > loss_disc_real_5: 0.17554892599582672 (0.17554892599582672) | > loss_0: 2.581562042236328 (2.581562042236328) | > loss_gen: 2.381338357925415 (2.381338357925415) | > loss_kl: 5.768659591674805 (5.768659591674805) | > loss_feat: 2.303309679031372 (2.303309679031372) | > loss_mel: 18.238527297973633 (18.238527297973633) | > loss_duration: 3.078101873397827 (3.078101873397827) | > loss_1: 31.76993751525879 (31.76993751525879)  --> STEP: 1 | > loss_disc: 2.9679508209228516 (2.9679508209228516) | > loss_disc_real_0: 0.28004276752471924 (0.28004276752471924) | > loss_disc_real_1: 0.2627633810043335 (0.2627633810043335) | > loss_disc_real_2: 0.3602582514286041 (0.3602582514286041) | > loss_disc_real_3: 0.2879989743232727 (0.2879989743232727) | > loss_disc_real_4: 0.25841400027275085 (0.25841400027275085) | > loss_disc_real_5: 0.2646161913871765 (0.2646161913871765) | > loss_0: 2.9679508209228516 (2.9679508209228516) | > loss_gen: 1.7943142652511597 (1.7943142652511597) | > loss_kl: 5.668135643005371 (5.668135643005371) | > loss_feat: 0.32880574464797974 (0.32880574464797974) | > loss_mel: 11.983574867248535 (11.983574867248535) | > loss_duration: 3.368974208831787 (3.368974208831787) | > loss_1: 23.1438045501709 (23.1438045501709)  --> STEP: 2 | > loss_disc: 3.5134148597717285 (3.24068284034729) | > loss_disc_real_0: 0.6114318370819092 (0.4457373023033142) | > loss_disc_real_1: 0.2895509898662567 (0.2761571854352951) | > loss_disc_real_2: 0.28060686588287354 (0.32043255865573883) | > loss_disc_real_3: 0.2822551429271698 (0.28512705862522125) | > loss_disc_real_4: 0.23849815130233765 (0.24845607578754425) | > loss_disc_real_5: 0.19277259707450867 (0.2286943942308426) | > loss_0: 3.5134148597717285 (3.24068284034729) | > loss_gen: 1.7119220495224 (1.7531181573867798) | > loss_kl: 6.20070219039917 (5.9344189167022705) | > loss_feat: 8.537504196166992 (4.433154970407486) | > loss_mel: 26.045093536376953 (19.014334201812744) | > loss_duration: 3.3123486042022705 (3.340661406517029) | > loss_1: 45.80757141113281 (34.475687980651855)  --> STEP: 3 | > loss_disc: 3.063732624053955 (3.1816994349161782) | > loss_disc_real_0: 0.2713519334793091 (0.3876088460286458) | > loss_disc_real_1: 0.26244601607322693 (0.271586795647939) | > loss_disc_real_2: 0.3582732379436493 (0.33304611841837567) | > loss_disc_real_3: 0.2873702347278595 (0.28587478399276733) | > loss_disc_real_4: 0.2579079866409302 (0.2516067127386729) | > loss_disc_real_5: 0.26479092240333557 (0.24072657028834024) | > loss_0: 3.063732624053955 (3.1816994349161782) | > loss_gen: 1.6561918258666992 (1.7208093802134197) | > loss_kl: 2.6041104793548584 (4.824316104253133) | > loss_feat: 0.17753013968467712 (3.0146133601665497) | > loss_mel: 2.7404625415802 (13.589710315068563) | > loss_duration: 2.9864296913146973 (3.2225841681162515) | > loss_1: 10.164724349975586 (26.372033437093098) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026410420735677085 (-0.012815475463867188) | > avg_loss_disc: 3.1816994349161782 (+0.849642475446065) | > avg_loss_disc_real_0: 0.3876088460286458 (+0.2225866913795471) | > avg_loss_disc_real_1: 0.271586795647939 (+0.007295012474060059) | > avg_loss_disc_real_2: 0.33304611841837567 (+0.12610817948977154) | > avg_loss_disc_real_3: 0.28587478399276733 (+0.10594935466845831) | > avg_loss_disc_real_4: 0.2516067127386729 (+0.009186970690886198) | > avg_loss_disc_real_5: 0.24072657028834024 (-0.026568015416463225) | > avg_loss_0: 3.1816994349161782 (+0.849642475446065) | > avg_loss_gen: 1.7208093802134197 (-0.8293151060740154) | > avg_loss_kl: 4.824316104253133 (+0.3579409122467041) | > avg_loss_feat: 3.0146133601665497 (-4.96286482612292) | > avg_loss_mel: 13.589710315068563 (-10.514962434768675) | > avg_loss_duration: 3.2225841681162515 (+0.043526093165079605) | > avg_loss_1: 26.372033437093098 (-15.905676523844402)  > EPOCH: 1015/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:32:11)   --> TIME: 2023-10-20 12:32:27 -- STEP: 19/50 -- GLOBAL_STEP: 103770 | > loss_disc: 2.0566823482513428 (2.5562959909439087) | > loss_disc_real_0: 0.09818150848150253 (0.15449734791917236) | > loss_disc_real_1: 0.21359460055828094 (0.21813665761759407) | > loss_disc_real_2: 0.210586816072464 (0.24077906714458214) | > loss_disc_real_3: 0.2658517360687256 (0.2248168544549691) | > loss_disc_real_4: 0.24113471806049347 (0.2306164124686467) | > loss_disc_real_5: 0.19833137094974518 (0.2393791279510448) | > loss_0: 2.0566823482513428 (2.5562959909439087) | > grad_norm_0: tensor(386.4327, device='cuda:0') (tensor(824.3355, device='cuda:0')) | > loss_gen: 3.024317741394043 (2.179621338844299) | > loss_kl: 0.4673735201358795 (0.6962916443222448) | > loss_feat: 6.930314540863037 (5.430801804128446) | > loss_mel: 21.18358612060547 (21.171410874316567) | > loss_duration: 1.4836879968643188 (1.375435565647326) | > loss_1: 33.08927917480469 (30.853561150400264) | > grad_norm_1: tensor(7437.4146, device='cuda:0') (tensor(15575.0742, device='cuda:0')) | > current_lr_0: 7.24758877483078e-05 | > current_lr_1: 7.24758877483078e-05 | > step_time: 0.7562 (0.5382842641127737) | > loader_time: 0.0021 (0.014019715158562911)  --> TIME: 2023-10-20 12:32:45 -- STEP: 49/50 -- GLOBAL_STEP: 103800 | > loss_disc: 3.125429153442383 (2.498445464640247) | > loss_disc_real_0: 0.07385578751564026 (0.150414111396792) | > loss_disc_real_1: 0.32125526666641235 (0.22461138893755114) | > loss_disc_real_2: 0.2617338001728058 (0.2279953542260491) | > loss_disc_real_3: 0.2539554834365845 (0.23744443355470288) | > loss_disc_real_4: 0.35864555835723877 (0.23178172081100698) | > loss_disc_real_5: 0.36227962374687195 (0.23879466126007692) | > loss_0: 3.125429153442383 (2.498445464640247) | > grad_norm_0: tensor(1340.0376, device='cuda:0') (tensor(676.7913, device='cuda:0')) | > loss_gen: 1.848581314086914 (2.266522298053819) | > loss_kl: 0.6527024507522583 (0.7598295065821433) | > loss_feat: 5.7162604331970215 (5.437483984140718) | > loss_mel: 23.952274322509766 (20.35207219026527) | > loss_duration: 1.4280180931091309 (1.3512270353278333) | > loss_1: 33.597835540771484 (30.167135024557307) | > grad_norm_1: tensor(20052.5352, device='cuda:0') (tensor(16074.4961, device='cuda:0')) | > current_lr_0: 7.24758877483078e-05 | > current_lr_1: 7.24758877483078e-05 | > step_time: 0.6809 (0.5552543523360273) | > loader_time: 0.4138 (0.0248430602404536)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.894493341445923 (2.894493341445923) | > loss_disc_real_0: 0.23430198431015015 (0.23430198431015015) | > loss_disc_real_1: 0.22755929827690125 (0.22755929827690125) | > loss_disc_real_2: 0.27817976474761963 (0.27817976474761963) | > loss_disc_real_3: 0.26559677720069885 (0.26559677720069885) | > loss_disc_real_4: 0.2853958308696747 (0.2853958308696747) | > loss_disc_real_5: 0.3128911554813385 (0.3128911554813385) | > loss_0: 2.894493341445923 (2.894493341445923) | > loss_gen: 1.7981640100479126 (1.7981640100479126) | > loss_kl: 5.313960552215576 (5.313960552215576) | > loss_feat: 1.1438628435134888 (1.1438628435134888) | > loss_mel: 16.549551010131836 (16.549551010131836) | > loss_duration: 3.0967483520507812 (3.0967483520507812) | > loss_1: 27.902286529541016 (27.902286529541016)  --> STEP: 1 | > loss_disc: 2.714736223220825 (2.714736223220825) | > loss_disc_real_0: 0.27405932545661926 (0.27405932545661926) | > loss_disc_real_1: 0.2403215616941452 (0.2403215616941452) | > loss_disc_real_2: 0.3056538701057434 (0.3056538701057434) | > loss_disc_real_3: 0.3045298159122467 (0.3045298159122467) | > loss_disc_real_4: 0.43167588114738464 (0.43167588114738464) | > loss_disc_real_5: 0.3039032220840454 (0.3039032220840454) | > loss_0: 2.714736223220825 (2.714736223220825) | > loss_gen: 2.5844922065734863 (2.5844922065734863) | > loss_kl: 5.924003601074219 (5.924003601074219) | > loss_feat: 4.379169940948486 (4.379169940948486) | > loss_mel: 22.885784149169922 (22.885784149169922) | > loss_duration: 3.3947508335113525 (3.3947508335113525) | > loss_1: 39.1682014465332 (39.1682014465332)  --> STEP: 2 | > loss_disc: 2.6439809799194336 (2.6793586015701294) | > loss_disc_real_0: 0.09078848361968994 (0.1824239045381546) | > loss_disc_real_1: 0.2733268737792969 (0.25682421773672104) | > loss_disc_real_2: 0.336481511592865 (0.3210676908493042) | > loss_disc_real_3: 0.15314175188541412 (0.2288357838988304) | > loss_disc_real_4: 0.26403582096099854 (0.3478558510541916) | > loss_disc_real_5: 0.21390199661254883 (0.2589026093482971) | > loss_0: 2.6439809799194336 (2.6793586015701294) | > loss_gen: 1.9189071655273438 (2.251699686050415) | > loss_kl: 5.720448017120361 (5.82222580909729) | > loss_feat: 4.80718994140625 (4.593179941177368) | > loss_mel: 25.47788429260254 (24.18183422088623) | > loss_duration: 3.2394089698791504 (3.3170799016952515) | > loss_1: 41.163841247558594 (40.1660213470459)  --> STEP: 3 | > loss_disc: 2.9815738201141357 (2.780097007751465) | > loss_disc_real_0: 0.23902511596679688 (0.20129097501436868) | > loss_disc_real_1: 0.24731655418872833 (0.2536549965540568) | > loss_disc_real_2: 0.3202921748161316 (0.32080918550491333) | > loss_disc_real_3: 0.2626281976699829 (0.2400999218225479) | > loss_disc_real_4: 0.26490676403045654 (0.3202061553796132) | > loss_disc_real_5: 0.29132336378097534 (0.2697095274925232) | > loss_0: 2.9815738201141357 (2.780097007751465) | > loss_gen: 1.6743922233581543 (2.0592638651529946) | > loss_kl: 2.5036659240722656 (4.716039180755615) | > loss_feat: 0.7576049566268921 (3.3146549463272095) | > loss_mel: 15.537614822387695 (21.30042775472005) | > loss_duration: 2.9740149974823 (3.2027249336242676) | > loss_1: 23.44729232788086 (34.59311167399088) --> EVAL PERFORMANCE | > avg_loader_time: 0.014437675476074219 (+0.01179663340250651) | > avg_loss_disc: 2.780097007751465 (-0.4016024271647134) | > avg_loss_disc_real_0: 0.20129097501436868 (-0.18631787101427713) | > avg_loss_disc_real_1: 0.2536549965540568 (-0.017931799093882206) | > avg_loss_disc_real_2: 0.32080918550491333 (-0.01223693291346234) | > avg_loss_disc_real_3: 0.2400999218225479 (-0.04577486217021942) | > avg_loss_disc_real_4: 0.3202061553796132 (+0.06859944264094031) | > avg_loss_disc_real_5: 0.2697095274925232 (+0.028982957204182952) | > avg_loss_0: 2.780097007751465 (-0.4016024271647134) | > avg_loss_gen: 2.0592638651529946 (+0.338454484939575) | > avg_loss_kl: 4.716039180755615 (-0.10827692349751761) | > avg_loss_feat: 3.3146549463272095 (+0.3000415861606598) | > avg_loss_mel: 21.30042775472005 (+7.7107174396514875) | > avg_loss_duration: 3.2027249336242676 (-0.0198592344919839) | > avg_loss_1: 34.59311167399088 (+8.221078236897785)  > EPOCH: 1016/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:33:04)   --> TIME: 2023-10-20 12:33:28 -- STEP: 29/50 -- GLOBAL_STEP: 103830 | > loss_disc: 2.5648434162139893 (2.512914509608828) | > loss_disc_real_0: 0.018564071506261826 (0.15041323648444538) | > loss_disc_real_1: 0.2517303228378296 (0.22992475574900365) | > loss_disc_real_2: 0.2390078902244568 (0.23879733135731057) | > loss_disc_real_3: 0.4302675426006317 (0.23844228273835674) | > loss_disc_real_4: 0.3032315671443939 (0.231633258148514) | > loss_disc_real_5: 0.37114766240119934 (0.24892056553528225) | > loss_0: 2.5648434162139893 (2.512914509608828) | > grad_norm_0: tensor(218.1973, device='cuda:0') (tensor(626.0140, device='cuda:0')) | > loss_gen: 2.508549690246582 (2.2665638800325065) | > loss_kl: 0.7495028972625732 (0.728411768017144) | > loss_feat: 5.972803115844727 (5.032191340137144) | > loss_mel: 20.999425888061523 (18.237590374617742) | > loss_duration: 1.3112261295318604 (1.3378357147348339) | > loss_1: 31.541507720947266 (27.602592846442914) | > grad_norm_1: tensor(6563.4121, device='cuda:0') (tensor(22929.2773, device='cuda:0')) | > current_lr_0: 7.240344356083454e-05 | > current_lr_1: 7.240344356083454e-05 | > step_time: 0.4516 (0.6593752400628452) | > loader_time: 0.0024 (0.014606689584666285)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.349294424057007 (2.349294424057007) | > loss_disc_real_0: 0.04264593869447708 (0.04264593869447708) | > loss_disc_real_1: 0.22549287974834442 (0.22549287974834442) | > loss_disc_real_2: 0.18308240175247192 (0.18308240175247192) | > loss_disc_real_3: 0.2378724366426468 (0.2378724366426468) | > loss_disc_real_4: 0.24260036647319794 (0.24260036647319794) | > loss_disc_real_5: 0.27611082792282104 (0.27611082792282104) | > loss_0: 2.349294424057007 (2.349294424057007) | > loss_gen: 2.126863956451416 (2.126863956451416) | > loss_kl: 5.716663837432861 (5.716663837432861) | > loss_feat: 5.803941249847412 (5.803941249847412) | > loss_mel: 21.854202270507812 (21.854202270507812) | > loss_duration: 3.1601009368896484 (3.1601009368896484) | > loss_1: 38.661773681640625 (38.661773681640625)  --> STEP: 1 | > loss_disc: 2.190369129180908 (2.190369129180908) | > loss_disc_real_0: 0.05810558423399925 (0.05810558423399925) | > loss_disc_real_1: 0.14733751118183136 (0.14733751118183136) | > loss_disc_real_2: 0.1372435837984085 (0.1372435837984085) | > loss_disc_real_3: 0.26666074991226196 (0.26666074991226196) | > loss_disc_real_4: 0.1226646676659584 (0.1226646676659584) | > loss_disc_real_5: 0.18139851093292236 (0.18139851093292236) | > loss_0: 2.190369129180908 (2.190369129180908) | > loss_gen: 2.014352798461914 (2.014352798461914) | > loss_kl: 5.400805473327637 (5.400805473327637) | > loss_feat: 7.566830158233643 (7.566830158233643) | > loss_mel: 25.569705963134766 (25.569705963134766) | > loss_duration: 3.423734426498413 (3.423734426498413) | > loss_1: 43.97542953491211 (43.97542953491211)  --> STEP: 2 | > loss_disc: 1.9715237617492676 (2.080946445465088) | > loss_disc_real_0: 0.1302770972251892 (0.09419134072959423) | > loss_disc_real_1: 0.21119973063468933 (0.17926862090826035) | > loss_disc_real_2: 0.1049681156873703 (0.1211058497428894) | > loss_disc_real_3: 0.2834051549434662 (0.2750329524278641) | > loss_disc_real_4: 0.08887684345245361 (0.10577075555920601) | > loss_disc_real_5: 0.2068830281496048 (0.19414076954126358) | > loss_0: 1.9715237617492676 (2.080946445465088) | > loss_gen: 3.400089979171753 (2.7072213888168335) | > loss_kl: 5.329906940460205 (5.365356206893921) | > loss_feat: 10.715024948120117 (9.14092755317688) | > loss_mel: 26.506702423095703 (26.038204193115234) | > loss_duration: 3.294948101043701 (3.359341263771057) | > loss_1: 49.246673583984375 (46.61105155944824)  --> STEP: 3 | > loss_disc: 2.9337944984436035 (2.3652291297912598) | > loss_disc_real_0: 0.12135723233222961 (0.10324663793047269) | > loss_disc_real_1: 0.2700921595096588 (0.20954313377539316) | > loss_disc_real_2: 0.2792792022228241 (0.1738303005695343) | > loss_disc_real_3: 0.315443754196167 (0.28850321968396503) | > loss_disc_real_4: 0.29300209879875183 (0.16818120330572128) | > loss_disc_real_5: 0.3794257342815399 (0.255902424454689) | > loss_0: 2.9337944984436035 (2.3652291297912598) | > loss_gen: 1.9068779945373535 (2.4404402573903403) | > loss_kl: 2.439893960952759 (4.390202124913533) | > loss_feat: 1.853495478630066 (6.711783528327942) | > loss_mel: 18.551008224487305 (23.54247220357259) | > loss_duration: 2.9668257236480713 (3.2285027503967285) | > loss_1: 27.718101501464844 (40.313401540120445) --> EVAL PERFORMANCE | > avg_loader_time: 0.017659505208333332 (+0.0032218297322591134) | > avg_loss_disc: 2.3652291297912598 (-0.4148678779602051) | > avg_loss_disc_real_0: 0.10324663793047269 (-0.098044337083896) | > avg_loss_disc_real_1: 0.20954313377539316 (-0.04411186277866366) | > avg_loss_disc_real_2: 0.1738303005695343 (-0.14697888493537903) | > avg_loss_disc_real_3: 0.28850321968396503 (+0.048403297861417116) | > avg_loss_disc_real_4: 0.16818120330572128 (-0.15202495207389194) | > avg_loss_disc_real_5: 0.255902424454689 (-0.013807103037834167) | > avg_loss_0: 2.3652291297912598 (-0.4148678779602051) | > avg_loss_gen: 2.4404402573903403 (+0.3811763922373457) | > avg_loss_kl: 4.390202124913533 (-0.325837055842082) | > avg_loss_feat: 6.711783528327942 (+3.3971285820007324) | > avg_loss_mel: 23.54247220357259 (+2.242044448852539) | > avg_loss_duration: 3.2285027503967285 (+0.025777816772460938) | > avg_loss_1: 40.313401540120445 (+5.720289866129562)  > EPOCH: 1017/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:34:12)   --> TIME: 2023-10-20 12:34:22 -- STEP: 9/50 -- GLOBAL_STEP: 103860 | > loss_disc: 2.689243793487549 (2.596739927927653) | > loss_disc_real_0: 0.08299809694290161 (0.11616922356188297) | > loss_disc_real_1: 0.3053513169288635 (0.2656078553862042) | > loss_disc_real_2: 0.24408669769763947 (0.23340183993180594) | > loss_disc_real_3: 0.286374568939209 (0.24250645107693142) | > loss_disc_real_4: 0.17693737149238586 (0.24069050947825113) | > loss_disc_real_5: 0.4292631149291992 (0.2732347357604239) | > loss_0: 2.689243793487549 (2.596739927927653) | > grad_norm_0: tensor(470.7886, device='cuda:0') (tensor(615.5410, device='cuda:0')) | > loss_gen: 2.186577558517456 (2.201410108142429) | > loss_kl: 0.9931121468544006 (0.8402068482504951) | > loss_feat: 5.6742167472839355 (5.540475686391194) | > loss_mel: 16.425138473510742 (20.2961581548055) | > loss_duration: 1.3401018381118774 (1.329663144217597) | > loss_1: 26.6191463470459 (30.207913716634113) | > grad_norm_1: tensor(10010.1240, device='cuda:0') (tensor(18283.4180, device='cuda:0')) | > current_lr_0: 7.233107178586237e-05 | > current_lr_1: 7.233107178586237e-05 | > step_time: 0.5499 (0.5764000680711534) | > loader_time: 0.003 (0.019472466574774847)  --> TIME: 2023-10-20 12:34:41 -- STEP: 39/50 -- GLOBAL_STEP: 103890 | > loss_disc: 2.6799700260162354 (2.462973023072267) | > loss_disc_real_0: 0.2100898027420044 (0.14141372022911525) | > loss_disc_real_1: 0.29572275280952454 (0.233256231706876) | > loss_disc_real_2: 0.2565798759460449 (0.22371962532783166) | > loss_disc_real_3: 0.33728304505348206 (0.23304328417930847) | > loss_disc_real_4: 0.292129248380661 (0.22278192362342125) | > loss_disc_real_5: 0.3152935206890106 (0.23401333296146148) | > loss_0: 2.6799700260162354 (2.462973023072267) | > grad_norm_0: tensor(890.5288, device='cuda:0') (tensor(730.4879, device='cuda:0')) | > loss_gen: 2.4464149475097656 (2.257513544498345) | > loss_kl: 0.3930811285972595 (0.835684468348821) | > loss_feat: 3.1853017807006836 (5.742991904035593) | > loss_mel: 18.862173080444336 (21.533717451951446) | > loss_duration: 1.3695626258850098 (1.327641092813932) | > loss_1: 26.256532669067383 (31.6975484383412) | > grad_norm_1: tensor(8789.9580, device='cuda:0') (tensor(24259.3750, device='cuda:0')) | > current_lr_0: 7.233107178586237e-05 | > current_lr_1: 7.233107178586237e-05 | > step_time: 0.8541 (0.6127516612028463) | > loader_time: 0.0324 (0.019791346329909105)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.325165271759033 (2.325165271759033) | > loss_disc_real_0: 0.23204149305820465 (0.23204149305820465) | > loss_disc_real_1: 0.21090930700302124 (0.21090930700302124) | > loss_disc_real_2: 0.2130233198404312 (0.2130233198404312) | > loss_disc_real_3: 0.15554732084274292 (0.15554732084274292) | > loss_disc_real_4: 0.13515588641166687 (0.13515588641166687) | > loss_disc_real_5: 0.12838640809059143 (0.12838640809059143) | > loss_0: 2.325165271759033 (2.325165271759033) | > loss_gen: 2.227445363998413 (2.227445363998413) | > loss_kl: 5.813568592071533 (5.813568592071533) | > loss_feat: 4.5676350593566895 (4.5676350593566895) | > loss_mel: 20.038869857788086 (20.038869857788086) | > loss_duration: 3.159575939178467 (3.159575939178467) | > loss_1: 35.80709457397461 (35.80709457397461)  --> STEP: 1 | > loss_disc: 2.7117538452148438 (2.7117538452148438) | > loss_disc_real_0: 0.28952860832214355 (0.28952860832214355) | > loss_disc_real_1: 0.29197150468826294 (0.29197150468826294) | > loss_disc_real_2: 0.2835100591182709 (0.2835100591182709) | > loss_disc_real_3: 0.30286383628845215 (0.30286383628845215) | > loss_disc_real_4: 0.2074849158525467 (0.2074849158525467) | > loss_disc_real_5: 0.3452867865562439 (0.3452867865562439) | > loss_0: 2.7117538452148438 (2.7117538452148438) | > loss_gen: 2.430964469909668 (2.430964469909668) | > loss_kl: 5.2339396476745605 (5.2339396476745605) | > loss_feat: 4.281502723693848 (4.281502723693848) | > loss_mel: 24.861587524414062 (24.861587524414062) | > loss_duration: 3.4591286182403564 (3.4591286182403564) | > loss_1: 40.26712417602539 (40.26712417602539)  --> STEP: 2 | > loss_disc: 2.105922222137451 (2.4088380336761475) | > loss_disc_real_0: 0.18122772872447968 (0.23537816852331161) | > loss_disc_real_1: 0.20609508454799652 (0.24903329461812973) | > loss_disc_real_2: 0.2553091049194336 (0.26940958201885223) | > loss_disc_real_3: 0.29601597785949707 (0.2994399070739746) | > loss_disc_real_4: 0.0862392708659172 (0.14686209335923195) | > loss_disc_real_5: 0.1280754953622818 (0.23668114095926285) | > loss_0: 2.105922222137451 (2.4088380336761475) | > loss_gen: 3.0026156902313232 (2.7167900800704956) | > loss_kl: 5.833862781524658 (5.533901214599609) | > loss_feat: 7.666656017303467 (5.974079370498657) | > loss_mel: 26.008275985717773 (25.434931755065918) | > loss_duration: 3.3547539710998535 (3.406941294670105) | > loss_1: 45.86616897583008 (43.066646575927734)  --> STEP: 3 | > loss_disc: 2.8878185749053955 (2.568498214085897) | > loss_disc_real_0: 0.2966804802417755 (0.25581227242946625) | > loss_disc_real_1: 0.2665383219718933 (0.2548683037360509) | > loss_disc_real_2: 0.23371082544326782 (0.2575099964936574) | > loss_disc_real_3: 0.19561703503131866 (0.264832283059756) | > loss_disc_real_4: 0.2833051085472107 (0.19234309842189154) | > loss_disc_real_5: 0.26462945342063904 (0.2459972451130549) | > loss_0: 2.8878185749053955 (2.568498214085897) | > loss_gen: 1.700329065322876 (2.377969741821289) | > loss_kl: 2.448848247528076 (4.505550225575765) | > loss_feat: 0.6857998967170715 (4.211319545904796) | > loss_mel: 5.890570640563965 (18.9201447168986) | > loss_duration: 3.007293462753296 (3.2737253506978354) | > loss_1: 13.732841491699219 (33.28871154785156) --> EVAL PERFORMANCE | > avg_loader_time: 0.028522570927937824 (+0.010863065719604492) | > avg_loss_disc: 2.568498214085897 (+0.2032690842946372) | > avg_loss_disc_real_0: 0.25581227242946625 (+0.15256563449899357) | > avg_loss_disc_real_1: 0.2548683037360509 (+0.045325169960657746) | > avg_loss_disc_real_2: 0.2575099964936574 (+0.08367969592412311) | > avg_loss_disc_real_3: 0.264832283059756 (-0.02367093662420905) | > avg_loss_disc_real_4: 0.19234309842189154 (+0.024161895116170257) | > avg_loss_disc_real_5: 0.2459972451130549 (-0.009905179341634124) | > avg_loss_0: 2.568498214085897 (+0.2032690842946372) | > avg_loss_gen: 2.377969741821289 (-0.062470515569051255) | > avg_loss_kl: 4.505550225575765 (+0.11534810066223145) | > avg_loss_feat: 4.211319545904796 (-2.5004639824231463) | > avg_loss_mel: 18.9201447168986 (-4.6223274866739885) | > avg_loss_duration: 3.2737253506978354 (+0.04522260030110692) | > avg_loss_1: 33.28871154785156 (-7.024689992268883)  > EPOCH: 1018/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:35:10)   --> TIME: 2023-10-20 12:35:27 -- STEP: 19/50 -- GLOBAL_STEP: 103920 | > loss_disc: 1.8293204307556152 (2.358635055391412) | > loss_disc_real_0: 0.020107172429561615 (0.1193120626634673) | > loss_disc_real_1: 0.11615560948848724 (0.19833338417504964) | > loss_disc_real_2: 0.10068134218454361 (0.21229699195215576) | > loss_disc_real_3: 0.14030377566814423 (0.20697579493648127) | > loss_disc_real_4: 0.1435362845659256 (0.1982318615834964) | > loss_disc_real_5: 0.2772940695285797 (0.20164389810279795) | > loss_0: 1.8293204307556152 (2.358635055391412) | > grad_norm_0: tensor(374.3915, device='cuda:0') (tensor(533.4586, device='cuda:0')) | > loss_gen: 2.565802574157715 (2.234870283227218) | > loss_kl: 0.7582225203514099 (0.8328572888123361) | > loss_feat: 9.931718826293945 (5.951073373618879) | > loss_mel: 24.79935073852539 (22.44239696703459) | > loss_duration: 1.4983633756637573 (1.3684916119826467) | > loss_1: 39.55345916748047 (32.829689828973066) | > grad_norm_1: tensor(11251.5742, device='cuda:0') (tensor(21656.7148, device='cuda:0')) | > current_lr_0: 7.225877235101042e-05 | > current_lr_1: 7.225877235101042e-05 | > step_time: 0.9772 (0.6084845317037482) | > loader_time: 0.0109 (0.02245968266537315)  --> TIME: 2023-10-20 12:35:46 -- STEP: 49/50 -- GLOBAL_STEP: 103950 | > loss_disc: 1.9669421911239624 (2.4683062543674383) | > loss_disc_real_0: 0.04201541468501091 (0.14200856202110954) | > loss_disc_real_1: 0.2609987258911133 (0.22756962234876593) | > loss_disc_real_2: 0.12291768193244934 (0.22806140955309478) | > loss_disc_real_3: 0.3344442844390869 (0.24683008935986733) | > loss_disc_real_4: 0.06093558669090271 (0.22415890301368674) | > loss_disc_real_5: 0.15159766376018524 (0.23030941864969778) | > loss_0: 1.9669421911239624 (2.4683062543674383) | > grad_norm_0: tensor(1027.4106, device='cuda:0') (tensor(579.2570, device='cuda:0')) | > loss_gen: 2.60079288482666 (2.2912397944197362) | > loss_kl: 0.45771220326423645 (0.8249114484203105) | > loss_feat: 7.948349952697754 (5.585886377765205) | > loss_mel: 20.50016975402832 (21.48776363839909) | > loss_duration: 1.4574906826019287 (1.342799084527152) | > loss_1: 32.96451187133789 (31.53260034444381) | > grad_norm_1: tensor(43731.1602, device='cuda:0') (tensor(17736.0371, device='cuda:0')) | > current_lr_0: 7.225877235101042e-05 | > current_lr_1: 7.225877235101042e-05 | > step_time: 0.8126 (0.6032809335358288) | > loader_time: 0.4249 (0.027049575533185686)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.031890392303467 (2.031890392303467) | > loss_disc_real_0: 0.16949543356895447 (0.16949543356895447) | > loss_disc_real_1: 0.12330589443445206 (0.12330589443445206) | > loss_disc_real_2: 0.08809997141361237 (0.08809997141361237) | > loss_disc_real_3: 0.19135522842407227 (0.19135522842407227) | > loss_disc_real_4: 0.11613085120916367 (0.11613085120916367) | > loss_disc_real_5: 0.113316610455513 (0.113316610455513) | > loss_0: 2.031890392303467 (2.031890392303467) | > loss_gen: 2.1634140014648438 (2.1634140014648438) | > loss_kl: 5.308086395263672 (5.308086395263672) | > loss_feat: 10.208885192871094 (10.208885192871094) | > loss_mel: 26.15519905090332 (26.15519905090332) | > loss_duration: 3.1199820041656494 (3.1199820041656494) | > loss_1: 46.955570220947266 (46.955570220947266)  --> STEP: 1 | > loss_disc: 1.9490888118743896 (1.9490888118743896) | > loss_disc_real_0: 0.18292057514190674 (0.18292057514190674) | > loss_disc_real_1: 0.1318737268447876 (0.1318737268447876) | > loss_disc_real_2: 0.17338524758815765 (0.17338524758815765) | > loss_disc_real_3: 0.09712906926870346 (0.09712906926870346) | > loss_disc_real_4: 0.05834377929568291 (0.05834377929568291) | > loss_disc_real_5: 0.03318953886628151 (0.03318953886628151) | > loss_0: 1.9490888118743896 (1.9490888118743896) | > loss_gen: 1.933236837387085 (1.933236837387085) | > loss_kl: 4.927820682525635 (4.927820682525635) | > loss_feat: 7.100763320922852 (7.100763320922852) | > loss_mel: 25.852521896362305 (25.852521896362305) | > loss_duration: 3.3266348838806152 (3.3266348838806152) | > loss_1: 43.14097213745117 (43.14097213745117)  --> STEP: 2 | > loss_disc: 2.9632091522216797 (2.4561489820480347) | > loss_disc_real_0: 0.1090412363409996 (0.14598090574145317) | > loss_disc_real_1: 0.20229439437389374 (0.16708406060934067) | > loss_disc_real_2: 0.25673890113830566 (0.21506207436323166) | > loss_disc_real_3: 0.28009307384490967 (0.18861107155680656) | > loss_disc_real_4: 0.1370696872472763 (0.0977067332714796) | > loss_disc_real_5: 0.2953622341156006 (0.16427588649094105) | > loss_0: 2.9632091522216797 (2.4561489820480347) | > loss_gen: 1.6262574195861816 (1.7797471284866333) | > loss_kl: 5.828734874725342 (5.378277778625488) | > loss_feat: 8.74068546295166 (7.920724391937256) | > loss_mel: 23.460887908935547 (24.656704902648926) | > loss_duration: 3.295046091079712 (3.3108404874801636) | > loss_1: 42.95161437988281 (43.04629325866699)  --> STEP: 3 | > loss_disc: 1.5692533254623413 (2.16051709651947) | > loss_disc_real_0: 0.030390527099370956 (0.10745077952742577) | > loss_disc_real_1: 0.07624303549528122 (0.13680371890465418) | > loss_disc_real_2: 0.06832784414291382 (0.1661506642897924) | > loss_disc_real_3: 0.08064731955528259 (0.15262315422296524) | > loss_disc_real_4: 0.06243458762764931 (0.08594935139020284) | > loss_disc_real_5: 0.010503135621547699 (0.11301830286780994) | > loss_0: 1.5692533254623413 (2.16051709651947) | > loss_gen: 2.3516225814819336 (1.9703722794850667) | > loss_kl: 2.5807905197143555 (4.44578202565511) | > loss_feat: 9.122982025146484 (8.321476936340332) | > loss_mel: 26.94737434387207 (25.42026138305664) | > loss_duration: 2.9808149337768555 (3.200831969579061) | > loss_1: 43.983585357666016 (43.358723958333336) --> EVAL PERFORMANCE | > avg_loader_time: 0.018131732940673828 (-0.010390837987263996) | > avg_loss_disc: 2.16051709651947 (-0.40798111756642674) | > avg_loss_disc_real_0: 0.10745077952742577 (-0.14836149290204048) | > avg_loss_disc_real_1: 0.13680371890465418 (-0.11806458483139673) | > avg_loss_disc_real_2: 0.1661506642897924 (-0.09135933220386502) | > avg_loss_disc_real_3: 0.15262315422296524 (-0.11220912883679074) | > avg_loss_disc_real_4: 0.08594935139020284 (-0.1063937470316887) | > avg_loss_disc_real_5: 0.11301830286780994 (-0.13297894224524498) | > avg_loss_0: 2.16051709651947 (-0.40798111756642674) | > avg_loss_gen: 1.9703722794850667 (-0.4075974623362224) | > avg_loss_kl: 4.44578202565511 (-0.0597681999206543) | > avg_loss_feat: 8.321476936340332 (+4.110157390435536) | > avg_loss_mel: 25.42026138305664 (+6.500116666158039) | > avg_loss_duration: 3.200831969579061 (-0.07289338111877441) | > avg_loss_1: 43.358723958333336 (+10.070012410481773)  > EPOCH: 1019/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:36:04)   --> TIME: 2023-10-20 12:36:32 -- STEP: 29/50 -- GLOBAL_STEP: 103980 | > loss_disc: 2.8664753437042236 (2.403079657719053) | > loss_disc_real_0: 0.35338205099105835 (0.1341873454251166) | > loss_disc_real_1: 0.27873334288597107 (0.2188584910512998) | > loss_disc_real_2: 0.23715046048164368 (0.22494257768166476) | > loss_disc_real_3: 0.2995738983154297 (0.21712445005260664) | > loss_disc_real_4: 0.2862309217453003 (0.20456656531013293) | > loss_disc_real_5: 0.3047392964363098 (0.2129432167215594) | > loss_0: 2.8664753437042236 (2.403079657719053) | > grad_norm_0: tensor(601.8027, device='cuda:0') (tensor(599.6810, device='cuda:0')) | > loss_gen: 2.1304118633270264 (2.29574049752334) | > loss_kl: 0.9927013516426086 (0.8079512263166493) | > loss_feat: 2.025074005126953 (5.254845546815416) | > loss_mel: 15.131181716918945 (19.91079049480372) | > loss_duration: 1.3407562971115112 (1.345827501395653) | > loss_1: 21.6201229095459 (29.61515503916247) | > grad_norm_1: tensor(4904.3120, device='cuda:0') (tensor(22605.2715, device='cuda:0')) | > current_lr_0: 7.218654518397022e-05 | > current_lr_1: 7.218654518397022e-05 | > step_time: 0.5552 (0.776206452271034) | > loader_time: 0.0024 (0.02677165228745033)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8950858116149902 (2.8950858116149902) | > loss_disc_real_0: 0.2965264618396759 (0.2965264618396759) | > loss_disc_real_1: 0.178955078125 (0.178955078125) | > loss_disc_real_2: 0.27243924140930176 (0.27243924140930176) | > loss_disc_real_3: 0.40982910990715027 (0.40982910990715027) | > loss_disc_real_4: 0.3610227406024933 (0.3610227406024933) | > loss_disc_real_5: 0.4936977028846741 (0.4936977028846741) | > loss_0: 2.8950858116149902 (2.8950858116149902) | > loss_gen: 2.795726776123047 (2.795726776123047) | > loss_kl: 5.97094202041626 (5.97094202041626) | > loss_feat: 4.891106605529785 (4.891106605529785) | > loss_mel: 21.45797348022461 (21.45797348022461) | > loss_duration: 3.069244861602783 (3.069244861602783) | > loss_1: 38.184993743896484 (38.184993743896484)  --> STEP: 1 | > loss_disc: 3.320460557937622 (3.320460557937622) | > loss_disc_real_0: 0.619050145149231 (0.619050145149231) | > loss_disc_real_1: 0.25055915117263794 (0.25055915117263794) | > loss_disc_real_2: 0.409618616104126 (0.409618616104126) | > loss_disc_real_3: 0.3596839904785156 (0.3596839904785156) | > loss_disc_real_4: 0.39818960428237915 (0.39818960428237915) | > loss_disc_real_5: 0.42423248291015625 (0.42423248291015625) | > loss_0: 3.320460557937622 (3.320460557937622) | > loss_gen: 3.1649632453918457 (3.1649632453918457) | > loss_kl: 5.1732497215271 (5.1732497215271) | > loss_feat: 2.95212984085083 (2.95212984085083) | > loss_mel: 20.49718475341797 (20.49718475341797) | > loss_duration: 3.493069887161255 (3.493069887161255) | > loss_1: 35.28059768676758 (35.28059768676758)  --> STEP: 2 | > loss_disc: 3.0646181106567383 (3.19253933429718) | > loss_disc_real_0: 0.2875039875507355 (0.4532770663499832) | > loss_disc_real_1: 0.27244827151298523 (0.2615037113428116) | > loss_disc_real_2: 0.3156461715698242 (0.3626323938369751) | > loss_disc_real_3: 0.2890568971633911 (0.32437044382095337) | > loss_disc_real_4: 0.31352242827415466 (0.3558560162782669) | > loss_disc_real_5: 0.32595646381378174 (0.375094473361969) | > loss_0: 3.0646181106567383 (3.19253933429718) | > loss_gen: 1.768988013267517 (2.4669756293296814) | > loss_kl: 5.642281532287598 (5.407765626907349) | > loss_feat: 0.15064842998981476 (1.5513891354203224) | > loss_mel: 3.419773578643799 (11.958479166030884) | > loss_duration: 3.299447536468506 (3.3962587118148804) | > loss_1: 14.281139373779297 (24.780868530273438)  --> STEP: 3 | > loss_disc: 3.4393537044525146 (3.274810791015625) | > loss_disc_real_0: 0.583252489566803 (0.49660220742225647) | > loss_disc_real_1: 0.4339538812637329 (0.318987101316452) | > loss_disc_real_2: 0.4345337748527527 (0.3865995208422343) | > loss_disc_real_3: 0.39183303713798523 (0.3468579749266307) | > loss_disc_real_4: 0.44104135036468506 (0.3842511276404063) | > loss_disc_real_5: 0.24664843082427979 (0.33227912584940594) | > loss_0: 3.4393537044525146 (3.274810791015625) | > loss_gen: 2.5962417125701904 (2.5100643237431846) | > loss_kl: 2.6645796298980713 (4.493370294570923) | > loss_feat: 2.901573896408081 (2.001450722416242) | > loss_mel: 19.545658111572266 (14.487538814544678) | > loss_duration: 3.0069854259490967 (3.266500949859619) | > loss_1: 30.715038299560547 (26.75892512003581) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_104000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2299280166625977 (3.013590097427368) | > loss_disc_real_0: 0.21787038445472717 (0.42691925168037415) | > loss_disc_real_1: 0.25081342458724976 (0.30194368213415146) | > loss_disc_real_2: 0.2449112832546234 (0.3511774614453316) | > loss_disc_real_3: 0.2296903431415558 (0.31756606698036194) | > loss_disc_real_4: 0.14188797771930695 (0.32366034016013145) | > loss_disc_real_5: 0.12067369371652603 (0.27937776781618595) | > loss_0: 2.2299280166625977 (3.013590097427368) | > loss_gen: 2.4160749912261963 (2.4865669906139374) | > loss_kl: 5.715188503265381 (4.798824846744537) | > loss_feat: 4.9700026512146 (2.7435887046158314) | > loss_mel: 12.866019248962402 (14.082158923149109) | > loss_duration: 3.0813891887664795 (3.2202230095863342) | > loss_1: 29.048673629760742 (27.33136224746704)  --> STEP: 1 | > loss_disc: 1.894760251045227 (2.78982412815094) | > loss_disc_real_0: 0.1933223307132721 (0.3801998674869537) | > loss_disc_real_1: 0.17394684255123138 (0.27634431421756744) | > loss_disc_real_2: 0.17080539464950562 (0.3151030480861664) | > loss_disc_real_3: 0.1634235680103302 (0.28673756718635557) | > loss_disc_real_4: 0.23543691635131836 (0.30601565539836884) | > loss_disc_real_5: 0.1198665201663971 (0.24747551828622819) | > loss_0: 1.894760251045227 (2.78982412815094) | > loss_gen: 2.8063340187072754 (2.550520396232605) | > loss_kl: 5.180725574493408 (4.875204992294312) | > loss_feat: 6.801878452301025 (3.55524665415287) | > loss_mel: 21.079004287719727 (15.481527996063232) | > loss_duration: 3.464338541030884 (3.269046115875244) | > loss_1: 39.33228302001953 (29.73154640197754)  --> STEP: 2 | > loss_disc: 3.1179275512695312 (2.8445080320040383) | > loss_disc_real_0: 0.3047325611114502 (0.3676219830910365) | > loss_disc_real_1: 0.2715409994125366 (0.2755437617500623) | > loss_disc_real_2: 0.3116760849952698 (0.31453188757101697) | > loss_disc_real_3: 0.3004329204559326 (0.2890201260646184) | > loss_disc_real_4: 0.32318422198295593 (0.3088770831624667) | > loss_disc_real_5: 0.3233499228954315 (0.26012125238776207) | > loss_0: 3.1179275512695312 (2.8445080320040383) | > loss_gen: 1.7767524719238281 (2.4215590755144754) | > loss_kl: 5.683526039123535 (5.009925166765849) | > loss_feat: 1.0249459743499756 (3.133529874185721) | > loss_mel: 21.124298095703125 (16.421989679336548) | > loss_duration: 3.3870582580566406 (3.28871480623881) | > loss_1: 32.99658203125 (30.27571900685628)  --> STEP: 3 | > loss_disc: 3.0894694328308105 (2.8795025178364346) | > loss_disc_real_0: 0.263854444026947 (0.3527980489390237) | > loss_disc_real_1: 0.2803443968296051 (0.27622956676142557) | > loss_disc_real_2: 0.32507234811782837 (0.3160376676491329) | > loss_disc_real_3: 0.29415076971054077 (0.289753075156893) | > loss_disc_real_4: 0.32118847966194153 (0.3106358540909631) | > loss_disc_real_5: 0.32345813512802124 (0.26916937849351336) | > loss_0: 3.0894694328308105 (2.8795025178364346) | > loss_gen: 1.7509104013442993 (2.3257521220615933) | > loss_kl: 2.6503725051879883 (4.672846215111869) | > loss_feat: 0.16427135467529297 (2.7093500856842314) | > loss_mel: 2.6116011142730713 (14.449077027184623) | > loss_duration: 3.0598700046539307 (3.2560226917266846) | > loss_1: 10.237025260925293 (27.413048471723283) --> EVAL PERFORMANCE | > avg_loader_time: 0.41321185656956266 (+0.39508012362888884) | > avg_loss_disc: 2.8795025178364346 (+0.7189854213169644) | > avg_loss_disc_real_0: 0.3527980489390237 (+0.24534726941159796) | > avg_loss_disc_real_1: 0.27622956676142557 (+0.1394258478567714) | > avg_loss_disc_real_2: 0.3160376676491329 (+0.1498870033593405) | > avg_loss_disc_real_3: 0.289753075156893 (+0.13712992093392778) | > avg_loss_disc_real_4: 0.3106358540909631 (+0.2246865027007603) | > avg_loss_disc_real_5: 0.26916937849351336 (+0.1561510756257034) | > avg_loss_0: 2.8795025178364346 (+0.7189854213169644) | > avg_loss_gen: 2.3257521220615933 (+0.35537984257652666) | > avg_loss_kl: 4.672846215111869 (+0.22706418945675821) | > avg_loss_feat: 2.7093500856842314 (-5.6121268506561) | > avg_loss_mel: 14.449077027184623 (-10.971184355872017) | > avg_loss_duration: 3.2560226917266846 (+0.05519072214762355) | > avg_loss_1: 27.413048471723283 (-15.945675486610053)  > EPOCH: 1020/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:37:10)   --> TIME: 2023-10-20 12:37:22 -- STEP: 9/50 -- GLOBAL_STEP: 104010 | > loss_disc: 2.8493082523345947 (2.3361784882015653) | > loss_disc_real_0: 0.09741242229938507 (0.1151557130118211) | > loss_disc_real_1: 0.31391993165016174 (0.24137035177813637) | > loss_disc_real_2: 0.2961081564426422 (0.25219523906707764) | > loss_disc_real_3: 0.3200320303440094 (0.24252455598778194) | > loss_disc_real_4: 0.2976781725883484 (0.226144309880005) | > loss_disc_real_5: 0.27942582964897156 (0.21268859246952665) | > loss_0: 2.8493082523345947 (2.3361784882015653) | > grad_norm_0: tensor(562.4637, device='cuda:0') (tensor(878.9468, device='cuda:0')) | > loss_gen: 1.891489028930664 (2.5597393247816296) | > loss_kl: 0.7576890587806702 (0.7003063029713101) | > loss_feat: 1.5056543350219727 (6.2759825338919955) | > loss_mel: 20.63540267944336 (18.293859839439392) | > loss_duration: 1.2918931245803833 (1.3211680518256292) | > loss_1: 26.082128524780273 (29.151055759853786) | > grad_norm_1: tensor(2243.4004, device='cuda:0') (tensor(28114.2520, device='cuda:0')) | > current_lr_0: 7.211439021250557e-05 | > current_lr_1: 7.211439021250557e-05 | > step_time: 0.9267 (0.7006372875637479) | > loader_time: 0.0454 (0.030640893512301974)  --> TIME: 2023-10-20 12:37:43 -- STEP: 39/50 -- GLOBAL_STEP: 104040 | > loss_disc: 3.0042927265167236 (2.3489958491080847) | > loss_disc_real_0: 0.3184277415275574 (0.1353169039178353) | > loss_disc_real_1: 0.25539520382881165 (0.22302667510050994) | > loss_disc_real_2: 0.2693708837032318 (0.22246026859069482) | > loss_disc_real_3: 0.23974068462848663 (0.23854564684323776) | > loss_disc_real_4: 0.26390141248703003 (0.2393440276097793) | > loss_disc_real_5: 0.25372031331062317 (0.2293992530888854) | > loss_0: 3.0042927265167236 (2.3489958491080847) | > grad_norm_0: tensor(975.1240, device='cuda:0') (tensor(627.5807, device='cuda:0')) | > loss_gen: 1.607595443725586 (2.3913624531183486) | > loss_kl: 0.4249173104763031 (0.7664993210480764) | > loss_feat: 0.04907243698835373 (5.931701397714325) | > loss_mel: 3.9079108238220215 (20.97143333997482) | > loss_duration: 1.407323956489563 (1.3476368249991002) | > loss_1: 7.396820068359375 (31.408632999811427) | > grad_norm_1: tensor(24688.3105, device='cuda:0') (tensor(20829.4492, device='cuda:0')) | > current_lr_0: 7.211439021250557e-05 | > current_lr_1: 7.211439021250557e-05 | > step_time: 0.8984 (0.6631933114467522) | > loader_time: 0.0594 (0.023525592608329576)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.540994882583618 (2.540994882583618) | > loss_disc_real_0: 0.1850854754447937 (0.1850854754447937) | > loss_disc_real_1: 0.2773513197898865 (0.2773513197898865) | > loss_disc_real_2: 0.1384020447731018 (0.1384020447731018) | > loss_disc_real_3: 0.22817063331604004 (0.22817063331604004) | > loss_disc_real_4: 0.1467704027891159 (0.1467704027891159) | > loss_disc_real_5: 0.2545195519924164 (0.2545195519924164) | > loss_0: 2.540994882583618 (2.540994882583618) | > loss_gen: 1.824741244316101 (1.824741244316101) | > loss_kl: 4.680334568023682 (4.680334568023682) | > loss_feat: 4.393486976623535 (4.393486976623535) | > loss_mel: 22.776187896728516 (22.776187896728516) | > loss_duration: 3.134786367416382 (3.134786367416382) | > loss_1: 36.80953598022461 (36.80953598022461)  --> STEP: 1 | > loss_disc: 2.8815298080444336 (2.8815298080444336) | > loss_disc_real_0: 0.10747609287500381 (0.10747609287500381) | > loss_disc_real_1: 0.2784850001335144 (0.2784850001335144) | > loss_disc_real_2: 0.35770249366760254 (0.35770249366760254) | > loss_disc_real_3: 0.21775050461292267 (0.21775050461292267) | > loss_disc_real_4: 0.24183093011379242 (0.24183093011379242) | > loss_disc_real_5: 0.3859836459159851 (0.3859836459159851) | > loss_0: 2.8815298080444336 (2.8815298080444336) | > loss_gen: 2.0760691165924072 (2.0760691165924072) | > loss_kl: 5.431785583496094 (5.431785583496094) | > loss_feat: 8.068426132202148 (8.068426132202148) | > loss_mel: 22.54925537109375 (22.54925537109375) | > loss_duration: 3.437113046646118 (3.437113046646118) | > loss_1: 41.562652587890625 (41.562652587890625)  --> STEP: 2 | > loss_disc: 3.695373773574829 (3.2884517908096313) | > loss_disc_real_0: 0.6782951354980469 (0.39288561418652534) | > loss_disc_real_1: 0.2896410822868347 (0.28406304121017456) | > loss_disc_real_2: 0.4497571289539337 (0.4037298113107681) | > loss_disc_real_3: 0.1846255362033844 (0.20118802040815353) | > loss_disc_real_4: 0.4292718172073364 (0.3355513736605644) | > loss_disc_real_5: 0.380215585231781 (0.38309961557388306) | > loss_0: 3.695373773574829 (3.2884517908096313) | > loss_gen: 2.1313750743865967 (2.103722095489502) | > loss_kl: 5.97198486328125 (5.701885223388672) | > loss_feat: 8.075925827026367 (8.072175979614258) | > loss_mel: 22.338274002075195 (22.443764686584473) | > loss_duration: 3.321852445602417 (3.3794827461242676) | > loss_1: 41.839412689208984 (41.701032638549805)  --> STEP: 3 | > loss_disc: 2.396315336227417 (2.99107297261556) | > loss_disc_real_0: 0.1379019170999527 (0.30789104849100113) | > loss_disc_real_1: 0.25432583689689636 (0.27415063977241516) | > loss_disc_real_2: 0.276924192905426 (0.36146127184232074) | > loss_disc_real_3: 0.27532023191452026 (0.22589875757694244) | > loss_disc_real_4: 0.20416951179504395 (0.29175741970539093) | > loss_disc_real_5: 0.22647851705551147 (0.33089258273442584) | > loss_0: 2.396315336227417 (2.99107297261556) | > loss_gen: 2.2607622146606445 (2.156068801879883) | > loss_kl: 2.895397901535034 (4.766389449437459) | > loss_feat: 2.694089651107788 (6.279480536778768) | > loss_mel: 20.830060958862305 (21.905863444010418) | > loss_duration: 3.0542492866516113 (3.2710715929667153) | > loss_1: 31.73455810546875 (38.37887446085612) --> EVAL PERFORMANCE | > avg_loader_time: 0.028063853581746418 (-0.38514800298781626) | > avg_loss_disc: 2.99107297261556 (+0.11157045477912542) | > avg_loss_disc_real_0: 0.30789104849100113 (-0.044907000448022594) | > avg_loss_disc_real_1: 0.27415063977241516 (-0.00207892698901041) | > avg_loss_disc_real_2: 0.36146127184232074 (+0.04542360419318786) | > avg_loss_disc_real_3: 0.22589875757694244 (-0.06385431757995058) | > avg_loss_disc_real_4: 0.29175741970539093 (-0.018878434385572185) | > avg_loss_disc_real_5: 0.33089258273442584 (+0.06172320424091249) | > avg_loss_0: 2.99107297261556 (+0.11157045477912542) | > avg_loss_gen: 2.156068801879883 (-0.1696833201817105) | > avg_loss_kl: 4.766389449437459 (+0.09354323432559042) | > avg_loss_feat: 6.279480536778768 (+3.570130451094536) | > avg_loss_mel: 21.905863444010418 (+7.4567864168257945) | > avg_loss_duration: 3.2710715929667153 (+0.015048901240030776) | > avg_loss_1: 38.37887446085612 (+10.965825989132835)  > EPOCH: 1021/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:38:07)   --> TIME: 2023-10-20 12:38:26 -- STEP: 19/50 -- GLOBAL_STEP: 104070 | > loss_disc: 3.154512882232666 (2.7633882635518123) | > loss_disc_real_0: 0.33008384704589844 (0.17454684721796135) | > loss_disc_real_1: 0.25178593397140503 (0.24555391386935585) | > loss_disc_real_2: 0.32644033432006836 (0.24433105948724246) | > loss_disc_real_3: 0.2875542640686035 (0.24482340091153196) | > loss_disc_real_4: 0.2812469005584717 (0.24101870428574712) | > loss_disc_real_5: 0.25213009119033813 (0.23242052997413434) | > loss_0: 3.154512882232666 (2.7633882635518123) | > grad_norm_0: tensor(602.7479, device='cuda:0') (tensor(963.6591, device='cuda:0')) | > loss_gen: 1.7967437505722046 (2.0250097324973657) | > loss_kl: 0.9432194232940674 (0.8379534439820993) | > loss_feat: 1.681569218635559 (4.258653885439823) | > loss_mel: 19.947505950927734 (17.89771652849097) | > loss_duration: 1.506592869758606 (1.3912319697831805) | > loss_1: 25.87563133239746 (26.410565326088353) | > grad_norm_1: tensor(5115.9897, device='cuda:0') (tensor(29044.0801, device='cuda:0')) | > current_lr_0: 7.204230736445249e-05 | > current_lr_1: 7.204230736445249e-05 | > step_time: 0.5711 (0.5804723689430639) | > loader_time: 0.0294 (0.02215945093255294)  --> TIME: 2023-10-20 12:38:44 -- STEP: 49/50 -- GLOBAL_STEP: 104100 | > loss_disc: 2.312130928039551 (2.576817977185152) | > loss_disc_real_0: 0.13763844966888428 (0.14740091904389616) | > loss_disc_real_1: 0.2781819701194763 (0.23316465842784667) | > loss_disc_real_2: 0.2020094394683838 (0.22167647766823673) | > loss_disc_real_3: 0.24875225126743317 (0.24648978105004948) | > loss_disc_real_4: 0.20206861197948456 (0.22169560368876068) | > loss_disc_real_5: 0.1856561154127121 (0.22781072138827674) | > loss_0: 2.312130928039551 (2.576817977185152) | > grad_norm_0: tensor(560.1922, device='cuda:0') (tensor(763.9976, device='cuda:0')) | > loss_gen: 2.1987342834472656 (2.0969469109360057) | > loss_kl: 0.6739000678062439 (0.7943759419176043) | > loss_feat: 2.899700880050659 (4.730340935746019) | > loss_mel: 21.398319244384766 (19.33109724521637) | > loss_duration: 1.4687912464141846 (1.3475904878304923) | > loss_1: 28.639446258544922 (28.30035161972046) | > grad_norm_1: tensor(3009.4363, device='cuda:0') (tensor(19564.0293, device='cuda:0')) | > current_lr_0: 7.204230736445249e-05 | > current_lr_1: 7.204230736445249e-05 | > step_time: 0.3141 (0.5605746921227903) | > loader_time: 0.4112 (0.026399612426757816)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0806667804718018 (3.0806667804718018) | > loss_disc_real_0: 0.246909961104393 (0.246909961104393) | > loss_disc_real_1: 0.28497248888015747 (0.28497248888015747) | > loss_disc_real_2: 0.3505406975746155 (0.3505406975746155) | > loss_disc_real_3: 0.39337843656539917 (0.39337843656539917) | > loss_disc_real_4: 0.41808226704597473 (0.41808226704597473) | > loss_disc_real_5: 0.3829489052295685 (0.3829489052295685) | > loss_0: 3.0806667804718018 (3.0806667804718018) | > loss_gen: 2.476435899734497 (2.476435899734497) | > loss_kl: 4.936880111694336 (4.936880111694336) | > loss_feat: 5.240179538726807 (5.240179538726807) | > loss_mel: 22.560344696044922 (22.560344696044922) | > loss_duration: 3.068679094314575 (3.068679094314575) | > loss_1: 38.28252029418945 (38.28252029418945)  --> STEP: 1 | > loss_disc: 2.914475679397583 (2.914475679397583) | > loss_disc_real_0: 0.19391489028930664 (0.19391489028930664) | > loss_disc_real_1: 0.1621595323085785 (0.1621595323085785) | > loss_disc_real_2: 0.09184645116329193 (0.09184645116329193) | > loss_disc_real_3: 0.10512649267911911 (0.10512649267911911) | > loss_disc_real_4: 0.1208064928650856 (0.1208064928650856) | > loss_disc_real_5: 0.07877545803785324 (0.07877545803785324) | > loss_0: 2.914475679397583 (2.914475679397583) | > loss_gen: 1.419509768486023 (1.419509768486023) | > loss_kl: 5.290082931518555 (5.290082931518555) | > loss_feat: 5.102472305297852 (5.102472305297852) | > loss_mel: 23.557981491088867 (23.557981491088867) | > loss_duration: 3.35367751121521 (3.35367751121521) | > loss_1: 38.723724365234375 (38.723724365234375)  --> STEP: 2 | > loss_disc: 3.2817280292510986 (3.098101854324341) | > loss_disc_real_0: 0.8465763330459595 (0.5202456116676331) | > loss_disc_real_1: 0.21575486660003662 (0.18895719945430756) | > loss_disc_real_2: 0.15548792481422424 (0.12366718798875809) | > loss_disc_real_3: 0.26744601130485535 (0.18628625199198723) | > loss_disc_real_4: 0.19502954185009003 (0.15791801735758781) | > loss_disc_real_5: 0.30321428179740906 (0.19099486991763115) | > loss_0: 3.2817280292510986 (3.098101854324341) | > loss_gen: 2.0338611602783203 (1.7266854643821716) | > loss_kl: 5.839277744293213 (5.564680337905884) | > loss_feat: 7.270923614501953 (6.186697959899902) | > loss_mel: 21.798364639282227 (22.678173065185547) | > loss_duration: 3.3636839389801025 (3.3586807250976562) | > loss_1: 40.306114196777344 (39.51491928100586)  --> STEP: 3 | > loss_disc: 2.3806581497192383 (2.8589539527893066) | > loss_disc_real_0: 0.6512646675109863 (0.5639186302820841) | > loss_disc_real_1: 0.15559683740139008 (0.17783707877000174) | > loss_disc_real_2: 0.2201269119977951 (0.15582042932510376) | > loss_disc_real_3: 0.19399994611740112 (0.18885748336712518) | > loss_disc_real_4: 0.296332985162735 (0.20405633995930353) | > loss_disc_real_5: 0.16544337570667267 (0.182477705180645) | > loss_0: 2.3806581497192383 (2.8589539527893066) | > loss_gen: 3.5770375728607178 (2.343469500541687) | > loss_kl: 2.746823787689209 (4.625394821166992) | > loss_feat: 7.988533020019531 (6.787309646606445) | > loss_mel: 24.722475051879883 (23.359607060750324) | > loss_duration: 3.001436233520508 (3.2395992279052734) | > loss_1: 42.03630828857422 (40.35538228352865) --> EVAL PERFORMANCE | > avg_loader_time: 0.0077559153238932295 (-0.020307938257853188) | > avg_loss_disc: 2.8589539527893066 (-0.1321190198262534) | > avg_loss_disc_real_0: 0.5639186302820841 (+0.256027581791083) | > avg_loss_disc_real_1: 0.17783707877000174 (-0.09631356100241342) | > avg_loss_disc_real_2: 0.15582042932510376 (-0.20564084251721698) | > avg_loss_disc_real_3: 0.18885748336712518 (-0.03704127420981726) | > avg_loss_disc_real_4: 0.20405633995930353 (-0.0877010797460874) | > avg_loss_disc_real_5: 0.182477705180645 (-0.14841487755378086) | > avg_loss_0: 2.8589539527893066 (-0.1321190198262534) | > avg_loss_gen: 2.343469500541687 (+0.1874006986618042) | > avg_loss_kl: 4.625394821166992 (-0.14099462827046683) | > avg_loss_feat: 6.787309646606445 (+0.5078291098276777) | > avg_loss_mel: 23.359607060750324 (+1.4537436167399065) | > avg_loss_duration: 3.2395992279052734 (-0.03147236506144191) | > avg_loss_1: 40.35538228352865 (+1.9765078226725308)  > EPOCH: 1022/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:39:01)   --> TIME: 2023-10-20 12:39:25 -- STEP: 29/50 -- GLOBAL_STEP: 104130 | > loss_disc: 2.079988479614258 (2.245163786000219) | > loss_disc_real_0: 0.05066479369997978 (0.12139762189753092) | > loss_disc_real_1: 0.16846485435962677 (0.21062164535296374) | > loss_disc_real_2: 0.16801460087299347 (0.20589276390342875) | > loss_disc_real_3: 0.19255167245864868 (0.20941313561694375) | > loss_disc_real_4: 0.12679393589496613 (0.21319053209675798) | > loss_disc_real_5: 0.13004572689533234 (0.21022159143768507) | > loss_0: 2.079988479614258 (2.245163786000219) | > grad_norm_0: tensor(611.3150, device='cuda:0') (tensor(608.9623, device='cuda:0')) | > loss_gen: 2.0256357192993164 (2.4928120251359607) | > loss_kl: 1.1586767435073853 (0.9068213896504764) | > loss_feat: 4.538357257843018 (6.148369930941483) | > loss_mel: 18.810256958007812 (20.507934520984524) | > loss_duration: 1.3155344724655151 (1.332557567234697) | > loss_1: 27.848459243774414 (31.388495264382197) | > grad_norm_1: tensor(3179.3003, device='cuda:0') (tensor(23601.5078, device='cuda:0')) | > current_lr_0: 7.197029656771906e-05 | > current_lr_1: 7.197029656771906e-05 | > step_time: 0.3548 (0.6018333435058594) | > loader_time: 0.0019 (0.020215445551378972)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.928426742553711 (1.928426742553711) | > loss_disc_real_0: 0.06643650680780411 (0.06643650680780411) | > loss_disc_real_1: 0.2199888825416565 (0.2199888825416565) | > loss_disc_real_2: 0.25374865531921387 (0.25374865531921387) | > loss_disc_real_3: 0.22146986424922943 (0.22146986424922943) | > loss_disc_real_4: 0.10074658691883087 (0.10074658691883087) | > loss_disc_real_5: 0.0810287594795227 (0.0810287594795227) | > loss_0: 1.928426742553711 (1.928426742553711) | > loss_gen: 2.3956077098846436 (2.3956077098846436) | > loss_kl: 4.991912841796875 (4.991912841796875) | > loss_feat: 8.940452575683594 (8.940452575683594) | > loss_mel: 18.220542907714844 (18.220542907714844) | > loss_duration: 3.0272445678710938 (3.0272445678710938) | > loss_1: 37.57575988769531 (37.57575988769531)  --> STEP: 1 | > loss_disc: 2.5216000080108643 (2.5216000080108643) | > loss_disc_real_0: 0.1866438239812851 (0.1866438239812851) | > loss_disc_real_1: 0.22304318845272064 (0.22304318845272064) | > loss_disc_real_2: 0.2992807626724243 (0.2992807626724243) | > loss_disc_real_3: 0.24196454882621765 (0.24196454882621765) | > loss_disc_real_4: 0.13821621239185333 (0.13821621239185333) | > loss_disc_real_5: 0.15449558198451996 (0.15449558198451996) | > loss_0: 2.5216000080108643 (2.5216000080108643) | > loss_gen: 1.8787147998809814 (1.8787147998809814) | > loss_kl: 4.990944862365723 (4.990944862365723) | > loss_feat: 3.7280116081237793 (3.7280116081237793) | > loss_mel: 15.22593879699707 (15.22593879699707) | > loss_duration: 3.351896047592163 (3.351896047592163) | > loss_1: 29.175506591796875 (29.175506591796875)  --> STEP: 2 | > loss_disc: 2.690700054168701 (2.6061500310897827) | > loss_disc_real_0: 0.05305776745080948 (0.11985079571604729) | > loss_disc_real_1: 0.2040584236383438 (0.21355080604553223) | > loss_disc_real_2: 0.1665179431438446 (0.23289935290813446) | > loss_disc_real_3: 0.22809067368507385 (0.23502761125564575) | > loss_disc_real_4: 0.23635302484035492 (0.18728461861610413) | > loss_disc_real_5: 0.22692734003067017 (0.19071146100759506) | > loss_0: 2.690700054168701 (2.6061500310897827) | > loss_gen: 1.5607073307037354 (1.7197110652923584) | > loss_kl: 6.003699779510498 (5.49732232093811) | > loss_feat: 3.1699070930480957 (3.4489593505859375) | > loss_mel: 22.625444412231445 (18.925691604614258) | > loss_duration: 3.382002353668213 (3.366949200630188) | > loss_1: 36.741764068603516 (32.958635330200195)  --> STEP: 3 | > loss_disc: 3.101025104522705 (2.771108388900757) | > loss_disc_real_0: 0.48286354541778564 (0.24085504561662674) | > loss_disc_real_1: 0.25159624218940735 (0.2262326180934906) | > loss_disc_real_2: 0.20443041622638702 (0.22340970734755197) | > loss_disc_real_3: 0.35044339299201965 (0.2734995385011037) | > loss_disc_real_4: 0.2663642168045044 (0.2136444846789042) | > loss_disc_real_5: 0.384872704744339 (0.2554318755865097) | > loss_0: 3.101025104522705 (2.771108388900757) | > loss_gen: 2.0819685459136963 (1.8404635588328044) | > loss_kl: 2.737377643585205 (4.577340761820476) | > loss_feat: 2.6520566940307617 (3.1833251317342124) | > loss_mel: 14.261727333068848 (17.371036847432453) | > loss_duration: 2.8940839767456055 (3.209327459335327) | > loss_1: 24.627212524414062 (30.181494394938152) --> EVAL PERFORMANCE | > avg_loader_time: 0.0049237410227457685 (-0.002832174301147461) | > avg_loss_disc: 2.771108388900757 (-0.0878455638885498) | > avg_loss_disc_real_0: 0.24085504561662674 (-0.32306358466545737) | > avg_loss_disc_real_1: 0.2262326180934906 (+0.04839553932348886) | > avg_loss_disc_real_2: 0.22340970734755197 (+0.06758927802244821) | > avg_loss_disc_real_3: 0.2734995385011037 (+0.08464205513397852) | > avg_loss_disc_real_4: 0.2136444846789042 (+0.009588144719600677) | > avg_loss_disc_real_5: 0.2554318755865097 (+0.07295417040586472) | > avg_loss_0: 2.771108388900757 (-0.0878455638885498) | > avg_loss_gen: 1.8404635588328044 (-0.5030059417088826) | > avg_loss_kl: 4.577340761820476 (-0.04805405934651663) | > avg_loss_feat: 3.1833251317342124 (-3.603984514872233) | > avg_loss_mel: 17.371036847432453 (-5.988570213317871) | > avg_loss_duration: 3.209327459335327 (-0.03027176856994629) | > avg_loss_1: 30.181494394938152 (-10.173887888590496)  > EPOCH: 1023/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:39:51)   --> TIME: 2023-10-20 12:40:05 -- STEP: 9/50 -- GLOBAL_STEP: 104160 | > loss_disc: 2.624312400817871 (2.4826580948299832) | > loss_disc_real_0: 0.12850654125213623 (0.1762835776640309) | > loss_disc_real_1: 0.262673020362854 (0.23073000543647343) | > loss_disc_real_2: 0.34588590264320374 (0.2465797137055132) | > loss_disc_real_3: 0.3266433775424957 (0.19908093619677755) | > loss_disc_real_4: 0.2751924693584442 (0.219642649922106) | > loss_disc_real_5: 0.23373034596443176 (0.20380204170942307) | > loss_0: 2.624312400817871 (2.4826580948299832) | > grad_norm_0: tensor(404.4258, device='cuda:0') (tensor(754.7318, device='cuda:0')) | > loss_gen: 2.2592525482177734 (2.291112502415975) | > loss_kl: 0.4727708697319031 (0.6135756307178073) | > loss_feat: 5.2411088943481445 (5.771313349405925) | > loss_mel: 19.869102478027344 (20.427761395772297) | > loss_duration: 1.2948967218399048 (1.31575342019399) | > loss_1: 29.137130737304688 (30.41951666937934) | > grad_norm_1: tensor(5830.8955, device='cuda:0') (tensor(20168.8418, device='cuda:0')) | > current_lr_0: 7.189835775028554e-05 | > current_lr_1: 7.189835775028554e-05 | > step_time: 0.7841 (0.9403872489929199) | > loader_time: 0.0256 (0.03978011343214247)  --> TIME: 2023-10-20 12:40:31 -- STEP: 39/50 -- GLOBAL_STEP: 104190 | > loss_disc: 2.4506027698516846 (2.541215373919561) | > loss_disc_real_0: 0.24304646253585815 (0.15571272573792022) | > loss_disc_real_1: 0.2561676502227783 (0.23541242008407912) | > loss_disc_real_2: 0.2514694035053253 (0.22595042458329445) | > loss_disc_real_3: 0.28090494871139526 (0.23819480998775897) | > loss_disc_real_4: 0.31442734599113464 (0.23273230262864858) | > loss_disc_real_5: 0.30244582891464233 (0.23485221455876643) | > loss_0: 2.4506027698516846 (2.541215373919561) | > grad_norm_0: tensor(779.6489, device='cuda:0') (tensor(695.4360, device='cuda:0')) | > loss_gen: 2.705650806427002 (2.2066375078299107) | > loss_kl: 0.7540054321289062 (0.7714849702822857) | > loss_feat: 4.243466854095459 (5.160922405524896) | > loss_mel: 19.94603157043457 (19.43187153492218) | > loss_duration: 1.4169830083847046 (1.337941940014179) | > loss_1: 29.066137313842773 (28.90885849488087) | > grad_norm_1: tensor(5609.1616, device='cuda:0') (tensor(18941.9980, device='cuda:0')) | > current_lr_0: 7.189835775028554e-05 | > current_lr_1: 7.189835775028554e-05 | > step_time: 0.3834 (0.8450705088101901) | > loader_time: 0.0241 (0.03714563907721105)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9385515451431274 (1.9385515451431274) | > loss_disc_real_0: 0.07607065886259079 (0.07607065886259079) | > loss_disc_real_1: 0.11667931079864502 (0.11667931079864502) | > loss_disc_real_2: 0.08160864561796188 (0.08160864561796188) | > loss_disc_real_3: 0.07306487113237381 (0.07306487113237381) | > loss_disc_real_4: 0.05167483538389206 (0.05167483538389206) | > loss_disc_real_5: 0.01073437463492155 (0.01073437463492155) | > loss_0: 1.9385515451431274 (1.9385515451431274) | > loss_gen: 1.7450343370437622 (1.7450343370437622) | > loss_kl: 5.908641338348389 (5.908641338348389) | > loss_feat: 12.627775192260742 (12.627775192260742) | > loss_mel: 25.263835906982422 (25.263835906982422) | > loss_duration: 3.15755558013916 (3.15755558013916) | > loss_1: 48.702842712402344 (48.702842712402344)  --> STEP: 1 | > loss_disc: 1.9977936744689941 (1.9977936744689941) | > loss_disc_real_0: 0.16013433039188385 (0.16013433039188385) | > loss_disc_real_1: 0.14077068865299225 (0.14077068865299225) | > loss_disc_real_2: 0.21924732625484467 (0.21924732625484467) | > loss_disc_real_3: 0.10542374849319458 (0.10542374849319458) | > loss_disc_real_4: 0.09940839558839798 (0.09940839558839798) | > loss_disc_real_5: 0.0807032659649849 (0.0807032659649849) | > loss_0: 1.9977936744689941 (1.9977936744689941) | > loss_gen: 2.169778823852539 (2.169778823852539) | > loss_kl: 5.845073699951172 (5.845073699951172) | > loss_feat: 7.941556453704834 (7.941556453704834) | > loss_mel: 22.538114547729492 (22.538114547729492) | > loss_duration: 3.498175621032715 (3.498175621032715) | > loss_1: 41.992698669433594 (41.992698669433594)  --> STEP: 2 | > loss_disc: 2.0130064487457275 (2.005400061607361) | > loss_disc_real_0: 0.061712779104709625 (0.11092355474829674) | > loss_disc_real_1: 0.18276777863502502 (0.16176923364400864) | > loss_disc_real_2: 0.15473255515098572 (0.1869899407029152) | > loss_disc_real_3: 0.28597933053970337 (0.19570153951644897) | > loss_disc_real_4: 0.20634791254997253 (0.15287815406918526) | > loss_disc_real_5: 0.1753166764974594 (0.12800997123122215) | > loss_0: 2.0130064487457275 (2.005400061607361) | > loss_gen: 2.556894302368164 (2.3633365631103516) | > loss_kl: 5.977074146270752 (5.911073923110962) | > loss_feat: 5.721566677093506 (6.83156156539917) | > loss_mel: 23.892484664916992 (23.215299606323242) | > loss_duration: 3.287724733352661 (3.392950177192688) | > loss_1: 41.43574142456055 (41.71422004699707)  --> STEP: 3 | > loss_disc: 1.9014018774032593 (1.9707340002059937) | > loss_disc_real_0: 0.12487642467021942 (0.11557451138893764) | > loss_disc_real_1: 0.22365960478782654 (0.1823993573586146) | > loss_disc_real_2: 0.12455282360315323 (0.16617756833632788) | > loss_disc_real_3: 0.1546865552663803 (0.18202987809975943) | > loss_disc_real_4: 0.17653895914554596 (0.16076508909463882) | > loss_disc_real_5: 0.07645241171121597 (0.11082411805788676) | > loss_0: 1.9014018774032593 (1.9707340002059937) | > loss_gen: 2.389298915863037 (2.37199068069458) | > loss_kl: 2.7284674644470215 (4.850205103556315) | > loss_feat: 7.025920391082764 (6.896347840627034) | > loss_mel: 22.156381607055664 (22.862326939900715) | > loss_duration: 2.93778657913208 (3.241228977839152) | > loss_1: 37.23785400390625 (40.22209803263346) --> EVAL PERFORMANCE | > avg_loader_time: 0.0235293706258138 (+0.01860562960306803) | > avg_loss_disc: 1.9707340002059937 (-0.8003743886947632) | > avg_loss_disc_real_0: 0.11557451138893764 (-0.1252805342276891) | > avg_loss_disc_real_1: 0.1823993573586146 (-0.043833260734876006) | > avg_loss_disc_real_2: 0.16617756833632788 (-0.05723213901122409) | > avg_loss_disc_real_3: 0.18202987809975943 (-0.09146966040134427) | > avg_loss_disc_real_4: 0.16076508909463882 (-0.05287939558426538) | > avg_loss_disc_real_5: 0.11082411805788676 (-0.14460775752862293) | > avg_loss_0: 1.9707340002059937 (-0.8003743886947632) | > avg_loss_gen: 2.37199068069458 (+0.5315271218617756) | > avg_loss_kl: 4.850205103556315 (+0.27286434173583984) | > avg_loss_feat: 6.896347840627034 (+3.713022708892822) | > avg_loss_mel: 22.862326939900715 (+5.491290092468262) | > avg_loss_duration: 3.241228977839152 (+0.03190151850382472) | > avg_loss_1: 40.22209803263346 (+10.040603637695309)  > EPOCH: 1024/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:40:50)   --> TIME: 2023-10-20 12:41:22 -- STEP: 19/50 -- GLOBAL_STEP: 104220 | > loss_disc: 1.3559025526046753 (2.264751729212309) | > loss_disc_real_0: 0.0591418519616127 (0.1296804706124883) | > loss_disc_real_1: 0.0760013684630394 (0.22566922381520266) | > loss_disc_real_2: 0.1716078817844391 (0.21905222790021642) | > loss_disc_real_3: 0.1216607540845871 (0.21308876397578339) | > loss_disc_real_4: 0.10623887926340103 (0.2046397573461658) | > loss_disc_real_5: 0.08691275864839554 (0.21776747880013367) | > loss_0: 1.3559025526046753 (2.264751729212309) | > grad_norm_0: tensor(317.8711, device='cuda:0') (tensor(588.1446, device='cuda:0')) | > loss_gen: 3.3738441467285156 (2.5933413442812467) | > loss_kl: 0.678835928440094 (0.9243081494381553) | > loss_feat: 11.72961139678955 (6.644849003929841) | > loss_mel: 22.81916618347168 (20.51228488119025) | > loss_duration: 1.490922212600708 (1.380680328921268) | > loss_1: 40.09238052368164 (32.055463213669626) | > grad_norm_1: tensor(46070.2617, device='cuda:0') (tensor(27533.9453, device='cuda:0')) | > current_lr_0: 7.18264908402041e-05 | > current_lr_1: 7.18264908402041e-05 | > step_time: 0.8095 (0.8814176509254857) | > loader_time: 0.0337 (0.03098062465065404)  --> TIME: 2023-10-20 12:41:41 -- STEP: 49/50 -- GLOBAL_STEP: 104250 | > loss_disc: 2.7041749954223633 (2.3682340334872816) | > loss_disc_real_0: 0.1755862981081009 (0.13661336037805494) | > loss_disc_real_1: 0.24438363313674927 (0.22970279359391757) | > loss_disc_real_2: 0.2945784032344818 (0.22987117169767007) | > loss_disc_real_3: 0.30698275566101074 (0.2353099323809147) | > loss_disc_real_4: 0.33098137378692627 (0.2194549106631656) | > loss_disc_real_5: 0.3156701326370239 (0.20850603138001597) | > loss_0: 2.7041749954223633 (2.3682340334872816) | > grad_norm_0: tensor(470.8741, device='cuda:0') (tensor(582.8454, device='cuda:0')) | > loss_gen: 2.4212942123413086 (2.391854145088974) | > loss_kl: 0.496732622385025 (0.8569697853253813) | > loss_feat: 3.0562288761138916 (5.610942947849328) | > loss_mel: 21.318973541259766 (18.962450419153488) | > loss_duration: 1.4420677423477173 (1.3422737486508427) | > loss_1: 28.73529624938965 (29.164490544066137) | > grad_norm_1: tensor(4957.4258, device='cuda:0') (tensor(24013.2031, device='cuda:0')) | > current_lr_0: 7.18264908402041e-05 | > current_lr_1: 7.18264908402041e-05 | > step_time: 0.3533 (0.7150831368504739) | > loader_time: 0.4479 (0.03199047458415129)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.3067827224731445 (3.3067827224731445) | > loss_disc_real_0: 0.519310474395752 (0.519310474395752) | > loss_disc_real_1: 0.18702122569084167 (0.18702122569084167) | > loss_disc_real_2: 0.26448798179626465 (0.26448798179626465) | > loss_disc_real_3: 0.2491152584552765 (0.2491152584552765) | > loss_disc_real_4: 0.48592299222946167 (0.48592299222946167) | > loss_disc_real_5: 0.5404874086380005 (0.5404874086380005) | > loss_0: 3.3067827224731445 (3.3067827224731445) | > loss_gen: 2.60986328125 (2.60986328125) | > loss_kl: 5.5319318771362305 (5.5319318771362305) | > loss_feat: 4.946386814117432 (4.946386814117432) | > loss_mel: 21.343050003051758 (21.343050003051758) | > loss_duration: 3.108842134475708 (3.108842134475708) | > loss_1: 37.54007339477539 (37.54007339477539)  --> STEP: 1 | > loss_disc: 2.6897804737091064 (2.6897804737091064) | > loss_disc_real_0: 0.3605539798736572 (0.3605539798736572) | > loss_disc_real_1: 0.30280187726020813 (0.30280187726020813) | > loss_disc_real_2: 0.31720125675201416 (0.31720125675201416) | > loss_disc_real_3: 0.24185144901275635 (0.24185144901275635) | > loss_disc_real_4: 0.3025999963283539 (0.3025999963283539) | > loss_disc_real_5: 0.2502555549144745 (0.2502555549144745) | > loss_0: 2.6897804737091064 (2.6897804737091064) | > loss_gen: 2.6916933059692383 (2.6916933059692383) | > loss_kl: 5.440388202667236 (5.440388202667236) | > loss_feat: 7.7733001708984375 (7.7733001708984375) | > loss_mel: 22.910356521606445 (22.910356521606445) | > loss_duration: 3.4792728424072266 (3.4792728424072266) | > loss_1: 42.295013427734375 (42.295013427734375)  --> STEP: 2 | > loss_disc: 0.9576796889305115 (1.823730081319809) | > loss_disc_real_0: 0.09493239223957062 (0.22774318605661392) | > loss_disc_real_1: 0.06933101266622543 (0.18606644496321678) | > loss_disc_real_2: 0.06482119113206863 (0.1910112239420414) | > loss_disc_real_3: 0.045342832803726196 (0.14359714090824127) | > loss_disc_real_4: 0.055966783314943314 (0.1792833898216486) | > loss_disc_real_5: 0.016577670350670815 (0.13341661263257265) | > loss_0: 0.9576796889305115 (1.823730081319809) | > loss_gen: 3.4913148880004883 (3.0915040969848633) | > loss_kl: 6.137845039367676 (5.789116621017456) | > loss_feat: 16.776565551757812 (12.274932861328125) | > loss_mel: 23.542253494262695 (23.22630500793457) | > loss_duration: 3.299109935760498 (3.3891913890838623) | > loss_1: 53.24708938598633 (47.77105140686035)  --> STEP: 3 | > loss_disc: 2.925239086151123 (2.190899749596914) | > loss_disc_real_0: 0.34220847487449646 (0.26589828232924145) | > loss_disc_real_1: 0.25674760341644287 (0.20962683111429214) | > loss_disc_real_2: 0.3039228022098541 (0.22864841669797897) | > loss_disc_real_3: 0.23031878471374512 (0.1725043555100759) | > loss_disc_real_4: 0.26348045468330383 (0.20734907810886702) | > loss_disc_real_5: 0.26724061369895935 (0.17802461298803487) | > loss_0: 2.925239086151123 (2.190899749596914) | > loss_gen: 1.8698118925094604 (2.684273362159729) | > loss_kl: 2.5277388095855713 (4.701990683873494) | > loss_feat: 0.6726971864700317 (8.407520969708761) | > loss_mel: 15.65003776550293 (20.70088259379069) | > loss_duration: 3.0040535926818848 (3.2608121236165366) | > loss_1: 23.72433853149414 (39.755480448404946) --> EVAL PERFORMANCE | > avg_loader_time: 0.008637746175130209 (-0.014891624450683592) | > avg_loss_disc: 2.190899749596914 (+0.22016574939092015) | > avg_loss_disc_real_0: 0.26589828232924145 (+0.1503237709403038) | > avg_loss_disc_real_1: 0.20962683111429214 (+0.02722747375567755) | > avg_loss_disc_real_2: 0.22864841669797897 (+0.06247084836165109) | > avg_loss_disc_real_3: 0.1725043555100759 (-0.009525522589683533) | > avg_loss_disc_real_4: 0.20734907810886702 (+0.046583989014228194) | > avg_loss_disc_real_5: 0.17802461298803487 (+0.06720049493014811) | > avg_loss_0: 2.190899749596914 (+0.22016574939092015) | > avg_loss_gen: 2.684273362159729 (+0.3122826814651489) | > avg_loss_kl: 4.701990683873494 (-0.14821441968282123) | > avg_loss_feat: 8.407520969708761 (+1.511173129081727) | > avg_loss_mel: 20.70088259379069 (-2.1614443461100237) | > avg_loss_duration: 3.2608121236165366 (+0.019583145777384736) | > avg_loss_1: 39.755480448404946 (-0.4666175842285156)  > EPOCH: 1025/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:42:01)   --> TIME: 2023-10-20 12:42:26 -- STEP: 29/50 -- GLOBAL_STEP: 104280 | > loss_disc: 2.382145404815674 (2.5536834905887473) | > loss_disc_real_0: 0.18903514742851257 (0.17197657023267499) | > loss_disc_real_1: 0.25746622681617737 (0.2377368933681784) | > loss_disc_real_2: 0.22760485112667084 (0.24119123610956916) | > loss_disc_real_3: 0.3115611672401428 (0.24317506662216679) | > loss_disc_real_4: 0.16166914999485016 (0.2225910378941174) | > loss_disc_real_5: 0.2266026884317398 (0.23398591693619203) | > loss_0: 2.382145404815674 (2.5536834905887473) | > grad_norm_0: tensor(371.9780, device='cuda:0') (tensor(689.7081, device='cuda:0')) | > loss_gen: 2.551266670227051 (2.220292662752086) | > loss_kl: 0.7072339057922363 (0.8382780428590446) | > loss_feat: 5.657588958740234 (5.33503830047517) | > loss_mel: 20.969636917114258 (19.06802581507584) | > loss_duration: 1.3656620979309082 (1.3436707628184352) | > loss_1: 31.251388549804688 (28.805305037005194) | > grad_norm_1: tensor(3053.7202, device='cuda:0') (tensor(24654.6914, device='cuda:0')) | > current_lr_0: 7.175469576559881e-05 | > current_lr_1: 7.175469576559881e-05 | > step_time: 0.3134 (0.6018919698123272) | > loader_time: 0.0052 (0.018916911092297786)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.6910655498504639 (1.6910655498504639) | > loss_disc_real_0: 0.05679688975214958 (0.05679688975214958) | > loss_disc_real_1: 0.20544147491455078 (0.20544147491455078) | > loss_disc_real_2: 0.1296311616897583 (0.1296311616897583) | > loss_disc_real_3: 0.13531240820884705 (0.13531240820884705) | > loss_disc_real_4: 0.03850628063082695 (0.03850628063082695) | > loss_disc_real_5: 0.038132086396217346 (0.038132086396217346) | > loss_0: 1.6910655498504639 (1.6910655498504639) | > loss_gen: 2.2409043312072754 (2.2409043312072754) | > loss_kl: 5.991381645202637 (5.991381645202637) | > loss_feat: 11.59965991973877 (11.59965991973877) | > loss_mel: 22.671098709106445 (22.671098709106445) | > loss_duration: 3.1304948329925537 (3.1304948329925537) | > loss_1: 45.63353729248047 (45.63353729248047)  --> STEP: 1 | > loss_disc: 1.2201701402664185 (1.2201701402664185) | > loss_disc_real_0: 0.05008828267455101 (0.05008828267455101) | > loss_disc_real_1: 0.11283104121685028 (0.11283104121685028) | > loss_disc_real_2: 0.08226628601551056 (0.08226628601551056) | > loss_disc_real_3: 0.021203983575105667 (0.021203983575105667) | > loss_disc_real_4: 0.048292674124240875 (0.048292674124240875) | > loss_disc_real_5: 0.010438256897032261 (0.010438256897032261) | > loss_0: 1.2201701402664185 (1.2201701402664185) | > loss_gen: 2.908296585083008 (2.908296585083008) | > loss_kl: 5.737579822540283 (5.737579822540283) | > loss_feat: 14.78050708770752 (14.78050708770752) | > loss_mel: 26.787342071533203 (26.787342071533203) | > loss_duration: 3.4471139907836914 (3.4471139907836914) | > loss_1: 53.66083526611328 (53.66083526611328)  --> STEP: 2 | > loss_disc: 2.9087555408477783 (2.0644628405570984) | > loss_disc_real_0: 0.12228141725063324 (0.08618484996259212) | > loss_disc_real_1: 0.3258834779262543 (0.21935725957155228) | > loss_disc_real_2: 0.30936989188194275 (0.19581808894872665) | > loss_disc_real_3: 0.4454672932624817 (0.23333563841879368) | > loss_disc_real_4: 0.2542916238307953 (0.15129214897751808) | > loss_disc_real_5: 0.30551961064338684 (0.15797893377020955) | > loss_0: 2.9087555408477783 (2.0644628405570984) | > loss_gen: 2.190589427947998 (2.549443006515503) | > loss_kl: 6.006465435028076 (5.87202262878418) | > loss_feat: 7.338865280151367 (11.059686183929443) | > loss_mel: 20.66617202758789 (23.726757049560547) | > loss_duration: 3.246793270111084 (3.3469536304473877) | > loss_1: 39.44888687133789 (46.554861068725586)  --> STEP: 3 | > loss_disc: 2.8571102619171143 (2.3286786476771035) | > loss_disc_real_0: 0.2674221992492676 (0.14659729972481728) | > loss_disc_real_1: 0.26600587368011475 (0.23490679760773978) | > loss_disc_real_2: 0.26251983642578125 (0.21805200477441153) | > loss_disc_real_3: 0.27755728363990784 (0.24807618682583174) | > loss_disc_real_4: 0.26446813344955444 (0.18901747713486353) | > loss_disc_real_5: 0.26945921778678894 (0.1951390284424027) | > loss_0: 2.8571102619171143 (2.3286786476771035) | > loss_gen: 1.8212251663208008 (2.306703726450602) | > loss_kl: 2.79262375831604 (4.845556338628133) | > loss_feat: 0.47944191098213196 (7.532938092947006) | > loss_mel: 8.959186553955078 (18.80423355102539) | > loss_duration: 3.036158323287964 (3.2433551947275796) | > loss_1: 17.08863639831543 (36.73278617858887) --> EVAL PERFORMANCE | > avg_loader_time: 0.004862070083618164 (-0.003775676091512045) | > avg_loss_disc: 2.3286786476771035 (+0.13777889808018973) | > avg_loss_disc_real_0: 0.14659729972481728 (-0.11930098260442418) | > avg_loss_disc_real_1: 0.23490679760773978 (+0.02527996649344763) | > avg_loss_disc_real_2: 0.21805200477441153 (-0.010596411923567445) | > avg_loss_disc_real_3: 0.24807618682583174 (+0.07557183131575584) | > avg_loss_disc_real_4: 0.18901747713486353 (-0.018331600974003492) | > avg_loss_disc_real_5: 0.1951390284424027 (+0.017114415454367815) | > avg_loss_0: 2.3286786476771035 (+0.13777889808018973) | > avg_loss_gen: 2.306703726450602 (-0.37756963570912694) | > avg_loss_kl: 4.845556338628133 (+0.14356565475463867) | > avg_loss_feat: 7.532938092947006 (-0.874582876761755) | > avg_loss_mel: 18.80423355102539 (-1.8966490427653007) | > avg_loss_duration: 3.2433551947275796 (-0.017456928888957002) | > avg_loss_1: 36.73278617858887 (-3.0226942698160784)  > EPOCH: 1026/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:42:51)   --> TIME: 2023-10-20 12:43:04 -- STEP: 9/50 -- GLOBAL_STEP: 104310 | > loss_disc: 2.503335475921631 (2.3831431203418307) | > loss_disc_real_0: 0.15284045040607452 (0.14609380749364695) | > loss_disc_real_1: 0.38300931453704834 (0.2385826607545217) | > loss_disc_real_2: 0.28397440910339355 (0.2101675503783756) | > loss_disc_real_3: 0.24057501554489136 (0.23132289366589653) | > loss_disc_real_4: 0.23629099130630493 (0.20706695483790505) | > loss_disc_real_5: 0.29036304354667664 (0.22637117902437845) | > loss_0: 2.503335475921631 (2.3831431203418307) | > grad_norm_0: tensor(428.2148, device='cuda:0') (tensor(842.8719, device='cuda:0')) | > loss_gen: 2.4909660816192627 (2.3346940014097424) | > loss_kl: 1.0647190809249878 (0.8401970350080066) | > loss_feat: 4.120988368988037 (5.935960796144274) | > loss_mel: 23.682464599609375 (20.78603198793199) | > loss_duration: 1.304197907447815 (1.3575021425882976) | > loss_1: 32.66333770751953 (31.25438626607259) | > grad_norm_1: tensor(9714.5898, device='cuda:0') (tensor(17409.8379, device='cuda:0')) | > current_lr_0: 7.168297245466563e-05 | > current_lr_1: 7.168297245466563e-05 | > step_time: 0.9745 (0.864172617594401) | > loader_time: 0.0083 (0.03477297888861762)  --> TIME: 2023-10-20 12:43:24 -- STEP: 39/50 -- GLOBAL_STEP: 104340 | > loss_disc: 3.05532169342041 (2.5138382514317836) | > loss_disc_real_0: 0.1959894597530365 (0.15394378372300893) | > loss_disc_real_1: 0.25644469261169434 (0.23450376647405136) | > loss_disc_real_2: 0.24571481347084045 (0.21872634068131447) | > loss_disc_real_3: 0.24498562514781952 (0.22677691261737776) | > loss_disc_real_4: 0.24822750687599182 (0.22365855167691523) | > loss_disc_real_5: 0.2735770344734192 (0.2290935817723855) | > loss_0: 3.05532169342041 (2.5138382514317836) | > grad_norm_0: tensor(1405.3943, device='cuda:0') (tensor(647.9626, device='cuda:0')) | > loss_gen: 1.4512947797775269 (2.161278584064581) | > loss_kl: 0.23649460077285767 (0.8429028686040487) | > loss_feat: 0.04243689775466919 (4.943774225190282) | > loss_mel: 1.4465473890304565 (19.181904283853676) | > loss_duration: 1.3825223445892334 (1.3423840602238972) | > loss_1: 4.559295654296875 (28.47224403039003) | > grad_norm_1: tensor(31081.5566, device='cuda:0') (tensor(18542.0293, device='cuda:0')) | > current_lr_0: 7.168297245466563e-05 | > current_lr_1: 7.168297245466563e-05 | > step_time: 0.3859 (0.6945386483119085) | > loader_time: 0.0023 (0.02740779901162172)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.342895984649658 (2.342895984649658) | > loss_disc_real_0: 0.5115948915481567 (0.5115948915481567) | > loss_disc_real_1: 0.2813188135623932 (0.2813188135623932) | > loss_disc_real_2: 0.3400321304798126 (0.3400321304798126) | > loss_disc_real_3: 0.4378218948841095 (0.4378218948841095) | > loss_disc_real_4: 0.12032074481248856 (0.12032074481248856) | > loss_disc_real_5: 0.16457286477088928 (0.16457286477088928) | > loss_0: 2.342895984649658 (2.342895984649658) | > loss_gen: 3.5602447986602783 (3.5602447986602783) | > loss_kl: 6.051969528198242 (6.051969528198242) | > loss_feat: 7.330539703369141 (7.330539703369141) | > loss_mel: 23.46162223815918 (23.46162223815918) | > loss_duration: 3.068190097808838 (3.068190097808838) | > loss_1: 43.47256851196289 (43.47256851196289)  --> STEP: 1 | > loss_disc: 3.035842180252075 (3.035842180252075) | > loss_disc_real_0: 0.5362855195999146 (0.5362855195999146) | > loss_disc_real_1: 0.33533748984336853 (0.33533748984336853) | > loss_disc_real_2: 0.2755378484725952 (0.2755378484725952) | > loss_disc_real_3: 0.26354649662971497 (0.26354649662971497) | > loss_disc_real_4: 0.28478553891181946 (0.28478553891181946) | > loss_disc_real_5: 0.3909074366092682 (0.3909074366092682) | > loss_0: 3.035842180252075 (3.035842180252075) | > loss_gen: 2.850517988204956 (2.850517988204956) | > loss_kl: 5.35806941986084 (5.35806941986084) | > loss_feat: 5.528529167175293 (5.528529167175293) | > loss_mel: 25.038877487182617 (25.038877487182617) | > loss_duration: 3.3796091079711914 (3.3796091079711914) | > loss_1: 42.155601501464844 (42.155601501464844)  --> STEP: 2 | > loss_disc: 2.490384817123413 (2.763113498687744) | > loss_disc_real_0: 0.3906475305557251 (0.4634665250778198) | > loss_disc_real_1: 0.23129834234714508 (0.2833179160952568) | > loss_disc_real_2: 0.2317551225423813 (0.25364648550748825) | > loss_disc_real_3: 0.16098544001579285 (0.2122659683227539) | > loss_disc_real_4: 0.4306464195251465 (0.35771597921848297) | > loss_disc_real_5: 0.2820994257926941 (0.33650343120098114) | > loss_0: 2.490384817123413 (2.763113498687744) | > loss_gen: 2.9166641235351562 (2.883591055870056) | > loss_kl: 5.689492702484131 (5.523781061172485) | > loss_feat: 9.866349220275879 (7.697439193725586) | > loss_mel: 19.485950469970703 (22.26241397857666) | > loss_duration: 3.13175892829895 (3.255684018135071) | > loss_1: 41.09021759033203 (41.62290954589844)  --> STEP: 3 | > loss_disc: 4.054443836212158 (3.1935569445292153) | > loss_disc_real_0: 0.3644998073577881 (0.4304776191711426) | > loss_disc_real_1: 0.5437934398651123 (0.3701430906852086) | > loss_disc_real_2: 0.33365100622177124 (0.2803146590789159) | > loss_disc_real_3: 0.42239782214164734 (0.2823099195957184) | > loss_disc_real_4: 0.38120684027671814 (0.3655462662378947) | > loss_disc_real_5: 0.2882339060306549 (0.32041358947753906) | > loss_0: 4.054443836212158 (3.1935569445292153) | > loss_gen: 1.900390386581421 (2.555857499440511) | > loss_kl: 2.793757200241089 (4.6137731075286865) | > loss_feat: 5.038722991943359 (6.811200459798177) | > loss_mel: 22.771160125732422 (22.431996027628582) | > loss_duration: 3.0585110187530518 (3.189959685007731) | > loss_1: 35.56254196166992 (39.602787017822266) --> EVAL PERFORMANCE | > avg_loader_time: 0.01506503423055013 (+0.010202964146931967) | > avg_loss_disc: 3.1935569445292153 (+0.8648782968521118) | > avg_loss_disc_real_0: 0.4304776191711426 (+0.2838803194463253) | > avg_loss_disc_real_1: 0.3701430906852086 (+0.13523629307746884) | > avg_loss_disc_real_2: 0.2803146590789159 (+0.06226265430450437) | > avg_loss_disc_real_3: 0.2823099195957184 (+0.03423373276988664) | > avg_loss_disc_real_4: 0.3655462662378947 (+0.1765287891030312) | > avg_loss_disc_real_5: 0.32041358947753906 (+0.12527456103513637) | > avg_loss_0: 3.1935569445292153 (+0.8648782968521118) | > avg_loss_gen: 2.555857499440511 (+0.24915377298990915) | > avg_loss_kl: 4.6137731075286865 (-0.23178323109944632) | > avg_loss_feat: 6.811200459798177 (-0.7217376331488294) | > avg_loss_mel: 22.431996027628582 (+3.6277624766031913) | > avg_loss_duration: 3.189959685007731 (-0.05339550971984863) | > avg_loss_1: 39.602787017822266 (+2.8700008392333984)  > EPOCH: 1027/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:43:45)   --> TIME: 2023-10-20 12:44:07 -- STEP: 19/50 -- GLOBAL_STEP: 104370 | > loss_disc: 2.0788002014160156 (2.453032920235082) | > loss_disc_real_0: 0.08401559293270111 (0.1410758126723139) | > loss_disc_real_1: 0.29972004890441895 (0.23226922652439067) | > loss_disc_real_2: 0.22802695631980896 (0.23634923720046094) | > loss_disc_real_3: 0.18552276492118835 (0.2552192462118049) | > loss_disc_real_4: 0.0638083964586258 (0.21547991860854) | > loss_disc_real_5: 0.15160174667835236 (0.25088872231150927) | > loss_0: 2.0788002014160156 (2.453032920235082) | > grad_norm_0: tensor(621.8700, device='cuda:0') (tensor(742.0823, device='cuda:0')) | > loss_gen: 2.539438009262085 (2.351254776904458) | > loss_kl: 0.688119649887085 (0.717739933415463) | > loss_feat: 7.6123833656311035 (5.289424008444736) | > loss_mel: 22.44944953918457 (21.024022001969183) | > loss_duration: 1.5064376592636108 (1.350414332590605) | > loss_1: 34.79582977294922 (30.732855144299958) | > grad_norm_1: tensor(23832.7988, device='cuda:0') (tensor(24073.6914, device='cuda:0')) | > current_lr_0: 7.161132083567228e-05 | > current_lr_1: 7.161132083567228e-05 | > step_time: 0.6107 (0.8020901805476138) | > loader_time: 0.006 (0.028382288782220138)  --> TIME: 2023-10-20 12:44:27 -- STEP: 49/50 -- GLOBAL_STEP: 104400 | > loss_disc: 2.6992695331573486 (2.4415665183748527) | > loss_disc_real_0: 0.2726464569568634 (0.13945008559646654) | > loss_disc_real_1: 0.37889036536216736 (0.2255237897743984) | > loss_disc_real_2: 0.3876250982284546 (0.22555218884075173) | > loss_disc_real_3: 0.2510274350643158 (0.24261619390121528) | > loss_disc_real_4: 0.40331315994262695 (0.20918765116711052) | > loss_disc_real_5: 0.2300155758857727 (0.22732836226647607) | > loss_0: 2.6992695331573486 (2.4415665183748527) | > grad_norm_0: tensor(1231.1180, device='cuda:0') (tensor(673.8463, device='cuda:0')) | > loss_gen: 3.077265977859497 (2.2900793211800705) | > loss_kl: 0.9167307615280151 (0.7473889175726443) | > loss_feat: 4.877645015716553 (5.413352868386679) | > loss_mel: 22.104496002197266 (20.597813255932866) | > loss_duration: 1.4030734300613403 (1.339460192894449) | > loss_1: 32.37921142578125 (30.3880941332603) | > grad_norm_1: tensor(33144.3281, device='cuda:0') (tensor(18595.9082, device='cuda:0')) | > current_lr_0: 7.161132083567228e-05 | > current_lr_1: 7.161132083567228e-05 | > step_time: 0.8346 (0.692761464994781) | > loader_time: 0.5019 (0.032968015086894134)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.394600510597229 (1.394600510597229) | > loss_disc_real_0: 0.16815534234046936 (0.16815534234046936) | > loss_disc_real_1: 0.15589600801467896 (0.15589600801467896) | > loss_disc_real_2: 0.060357365757226944 (0.060357365757226944) | > loss_disc_real_3: 0.08671161532402039 (0.08671161532402039) | > loss_disc_real_4: 0.09948287904262543 (0.09948287904262543) | > loss_disc_real_5: 0.04713184013962746 (0.04713184013962746) | > loss_0: 1.394600510597229 (1.394600510597229) | > loss_gen: 2.8268003463745117 (2.8268003463745117) | > loss_kl: 5.2074055671691895 (5.2074055671691895) | > loss_feat: 12.486472129821777 (12.486472129821777) | > loss_mel: 24.905691146850586 (24.905691146850586) | > loss_duration: 3.1276912689208984 (3.1276912689208984) | > loss_1: 48.55406188964844 (48.55406188964844)  --> STEP: 1 | > loss_disc: 2.924940824508667 (2.924940824508667) | > loss_disc_real_0: 0.18328140676021576 (0.18328140676021576) | > loss_disc_real_1: 0.17002764344215393 (0.17002764344215393) | > loss_disc_real_2: 0.16890473663806915 (0.16890473663806915) | > loss_disc_real_3: 0.17814716696739197 (0.17814716696739197) | > loss_disc_real_4: 0.14964650571346283 (0.14964650571346283) | > loss_disc_real_5: 0.1015704870223999 (0.1015704870223999) | > loss_0: 2.924940824508667 (2.924940824508667) | > loss_gen: 1.5232795476913452 (1.5232795476913452) | > loss_kl: 5.254204273223877 (5.254204273223877) | > loss_feat: 3.4260051250457764 (3.4260051250457764) | > loss_mel: 19.68918228149414 (19.68918228149414) | > loss_duration: 3.410332679748535 (3.410332679748535) | > loss_1: 33.30300521850586 (33.30300521850586)  --> STEP: 2 | > loss_disc: 2.951704263687134 (2.9383225440979004) | > loss_disc_real_0: 0.4280376732349396 (0.30565953999757767) | > loss_disc_real_1: 0.4019657373428345 (0.2859966903924942) | > loss_disc_real_2: 0.45558273792266846 (0.3122437372803688) | > loss_disc_real_3: 0.30006158351898193 (0.23910437524318695) | > loss_disc_real_4: 0.2577851116657257 (0.20371580868959427) | > loss_disc_real_5: 0.25022366642951965 (0.17589707672595978) | > loss_0: 2.951704263687134 (2.9383225440979004) | > loss_gen: 3.020569086074829 (2.271924316883087) | > loss_kl: 5.789060592651367 (5.521632432937622) | > loss_feat: 3.3666462898254395 (3.396325707435608) | > loss_mel: 23.765783309936523 (21.727482795715332) | > loss_duration: 3.2293012142181396 (3.3198169469833374) | > loss_1: 39.17136001586914 (36.2371826171875)  --> STEP: 3 | > loss_disc: 2.3745179176330566 (2.750387668609619) | > loss_disc_real_0: 0.20967841148376465 (0.2736658304929733) | > loss_disc_real_1: 0.30482831597328186 (0.2922738989194234) | > loss_disc_real_2: 0.348745733499527 (0.3244110693534215) | > loss_disc_real_3: 0.3479927182197571 (0.2754004895687103) | > loss_disc_real_4: 0.24417252838611603 (0.2172013819217682) | > loss_disc_real_5: 0.19594475626945496 (0.1825796365737915) | > loss_0: 2.3745179176330566 (2.750387668609619) | > loss_gen: 3.3736681938171387 (2.6391722758611045) | > loss_kl: 3.1475119590759277 (4.730258941650391) | > loss_feat: 5.387315273284912 (4.059988896052043) | > loss_mel: 23.05904197692871 (22.171335856119793) | > loss_duration: 2.9932470321655273 (3.210960308710734) | > loss_1: 37.960784912109375 (36.81171671549479) --> EVAL PERFORMANCE | > avg_loader_time: 0.01310276985168457 (-0.0019622643788655605) | > avg_loss_disc: 2.750387668609619 (-0.4431692759195962) | > avg_loss_disc_real_0: 0.2736658304929733 (-0.15681178867816925) | > avg_loss_disc_real_1: 0.2922738989194234 (-0.07786919176578522) | > avg_loss_disc_real_2: 0.3244110693534215 (+0.044096410274505615) | > avg_loss_disc_real_3: 0.2754004895687103 (-0.006909430027008057) | > avg_loss_disc_real_4: 0.2172013819217682 (-0.14834488431612652) | > avg_loss_disc_real_5: 0.1825796365737915 (-0.13783395290374756) | > avg_loss_0: 2.750387668609619 (-0.4431692759195962) | > avg_loss_gen: 2.6391722758611045 (+0.08331477642059326) | > avg_loss_kl: 4.730258941650391 (+0.1164858341217041) | > avg_loss_feat: 4.059988896052043 (-2.751211563746134) | > avg_loss_mel: 22.171335856119793 (-0.26066017150878906) | > avg_loss_duration: 3.210960308710734 (+0.02100062370300293) | > avg_loss_1: 36.81171671549479 (-2.7910703023274763)  > EPOCH: 1028/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:44:35)   --> TIME: 2023-10-20 12:45:00 -- STEP: 29/50 -- GLOBAL_STEP: 104430 | > loss_disc: 1.2489407062530518 (2.4320240431818467) | > loss_disc_real_0: 0.015196196734905243 (0.15683809674248614) | > loss_disc_real_1: 0.15503042936325073 (0.21812129996973892) | > loss_disc_real_2: 0.037335459142923355 (0.2164952951515543) | > loss_disc_real_3: 0.08505579829216003 (0.2558542221527675) | > loss_disc_real_4: 0.04639651998877525 (0.24163622736673931) | > loss_disc_real_5: 0.0103507861495018 (0.2263603949084364) | > loss_0: 1.2489407062530518 (2.4320240431818467) | > grad_norm_0: tensor(485.1880, device='cuda:0') (tensor(544.8033, device='cuda:0')) | > loss_gen: 2.731459617614746 (2.3775501251220703) | > loss_kl: 0.9219672679901123 (0.7728592105980577) | > loss_feat: 11.454851150512695 (5.550710201777261) | > loss_mel: 25.559282302856445 (19.328981415978788) | > loss_duration: 1.299992322921753 (1.347721552026683) | > loss_1: 41.967552185058594 (29.377822415582067) | > grad_norm_1: tensor(24124.2734, device='cuda:0') (tensor(28760.3223, device='cuda:0')) | > current_lr_0: 7.15397408369582e-05 | > current_lr_1: 7.15397408369582e-05 | > step_time: 0.276 (0.6563649588617785) | > loader_time: 0.0019 (0.022768217941810345)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0334863662719727 (3.0334863662719727) | > loss_disc_real_0: 0.14629091322422028 (0.14629091322422028) | > loss_disc_real_1: 0.25164639949798584 (0.25164639949798584) | > loss_disc_real_2: 0.25033724308013916 (0.25033724308013916) | > loss_disc_real_3: 0.27045363187789917 (0.27045363187789917) | > loss_disc_real_4: 0.2530175447463989 (0.2530175447463989) | > loss_disc_real_5: 0.2615469992160797 (0.2615469992160797) | > loss_0: 3.0334863662719727 (3.0334863662719727) | > loss_gen: 1.434630274772644 (1.434630274772644) | > loss_kl: 5.128695964813232 (5.128695964813232) | > loss_feat: 0.037690918892621994 (0.037690918892621994) | > loss_mel: 1.476731777191162 (1.476731777191162) | > loss_duration: 3.0740108489990234 (3.0740108489990234) | > loss_1: 11.15176010131836 (11.15176010131836)  --> STEP: 1 | > loss_disc: 2.969749689102173 (2.969749689102173) | > loss_disc_real_0: 0.23611882328987122 (0.23611882328987122) | > loss_disc_real_1: 0.25633907318115234 (0.25633907318115234) | > loss_disc_real_2: 0.3380405604839325 (0.3380405604839325) | > loss_disc_real_3: 0.28449374437332153 (0.28449374437332153) | > loss_disc_real_4: 0.32681378722190857 (0.32681378722190857) | > loss_disc_real_5: 0.35373589396476746 (0.35373589396476746) | > loss_0: 2.969749689102173 (2.969749689102173) | > loss_gen: 2.1784162521362305 (2.1784162521362305) | > loss_kl: 5.317590236663818 (5.317590236663818) | > loss_feat: 2.777491807937622 (2.777491807937622) | > loss_mel: 20.470354080200195 (20.470354080200195) | > loss_duration: 3.389996290206909 (3.389996290206909) | > loss_1: 34.13385009765625 (34.13385009765625)  --> STEP: 2 | > loss_disc: 3.0334856510162354 (3.001617670059204) | > loss_disc_real_0: 0.14619986712932587 (0.19115934520959854) | > loss_disc_real_1: 0.2516375482082367 (0.2539883106946945) | > loss_disc_real_2: 0.2503516972064972 (0.29419612884521484) | > loss_disc_real_3: 0.27044540643692017 (0.27746957540512085) | > loss_disc_real_4: 0.2530317008495331 (0.2899227440357208) | > loss_disc_real_5: 0.2615547776222229 (0.3076453357934952) | > loss_0: 3.0334856510162354 (3.001617670059204) | > loss_gen: 1.434713363647461 (1.8065648078918457) | > loss_kl: 5.68555212020874 (5.501571178436279) | > loss_feat: 0.03868647292256355 (1.4080891404300928) | > loss_mel: 3.518775701522827 (11.994564890861511) | > loss_duration: 3.299454927444458 (3.3447256088256836) | > loss_1: 13.977182388305664 (24.055516242980957)  --> STEP: 3 | > loss_disc: 2.8673954010009766 (2.9568769137064614) | > loss_disc_real_0: 0.12705910205841064 (0.16979259749253592) | > loss_disc_real_1: 0.2501429319381714 (0.25270651777585346) | > loss_disc_real_2: 0.28387758135795593 (0.29075661301612854) | > loss_disc_real_3: 0.27123692631721497 (0.2753920257091522) | > loss_disc_real_4: 0.260044664144516 (0.2799633840719859) | > loss_disc_real_5: 0.27272316813468933 (0.2960046132405599) | > loss_0: 2.8673954010009766 (2.9568769137064614) | > loss_gen: 1.6162290573120117 (1.7431195576985676) | > loss_kl: 2.9113473892211914 (4.638163248697917) | > loss_feat: 0.6875821948051453 (1.1679201585551102) | > loss_mel: 15.995909690856934 (13.328346490859985) | > loss_duration: 2.954723596572876 (3.2147249380747476) | > loss_1: 24.165790557861328 (24.092274347941082) --> EVAL PERFORMANCE | > avg_loader_time: 0.01023570696512858 (-0.00286706288655599) | > avg_loss_disc: 2.9568769137064614 (+0.2064892450968423) | > avg_loss_disc_real_0: 0.16979259749253592 (-0.10387323300043741) | > avg_loss_disc_real_1: 0.25270651777585346 (-0.039567381143569946) | > avg_loss_disc_real_2: 0.29075661301612854 (-0.03365445633729297) | > avg_loss_disc_real_3: 0.2753920257091522 (-8.463859558105469e-06) | > avg_loss_disc_real_4: 0.2799633840719859 (+0.06276200215021771) | > avg_loss_disc_real_5: 0.2960046132405599 (+0.11342497666676837) | > avg_loss_0: 2.9568769137064614 (+0.2064892450968423) | > avg_loss_gen: 1.7431195576985676 (-0.8960527181625368) | > avg_loss_kl: 4.638163248697917 (-0.09209569295247366) | > avg_loss_feat: 1.1679201585551102 (-2.892068737496933) | > avg_loss_mel: 13.328346490859985 (-8.842989365259807) | > avg_loss_duration: 3.2147249380747476 (+0.003764629364013672) | > avg_loss_1: 24.092274347941082 (-12.719442367553707)  > EPOCH: 1029/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:45:24)   --> TIME: 2023-10-20 12:45:37 -- STEP: 9/50 -- GLOBAL_STEP: 104460 | > loss_disc: 2.5550425052642822 (2.6233323415120444) | > loss_disc_real_0: 0.04225415736436844 (0.14596246638231808) | > loss_disc_real_1: 0.34016165137290955 (0.22256862537728417) | > loss_disc_real_2: 0.2598057985305786 (0.2445364279879464) | > loss_disc_real_3: 0.3653247356414795 (0.2696834024455812) | > loss_disc_real_4: 0.2128870040178299 (0.2601157499011606) | > loss_disc_real_5: 0.11400012671947479 (0.3112846293176214) | > loss_0: 2.5550425052642822 (2.6233323415120444) | > grad_norm_0: tensor(575.8648, device='cuda:0') (tensor(570.4246, device='cuda:0')) | > loss_gen: 2.245110511779785 (2.32723335425059) | > loss_kl: 0.6107279062271118 (0.7121838513347838) | > loss_feat: 4.777472019195557 (6.530870411131117) | > loss_mel: 24.0218563079834 (22.99416224161784) | > loss_duration: 1.3256385326385498 (1.3400219811333551) | > loss_1: 32.980804443359375 (33.90447213914659) | > grad_norm_1: tensor(12132.4922, device='cuda:0') (tensor(26089.0566, device='cuda:0')) | > current_lr_0: 7.14682323869344e-05 | > current_lr_1: 7.14682323869344e-05 | > step_time: 0.8132 (0.6110139158036973) | > loader_time: 0.0287 (0.026815493901570637)  --> TIME: 2023-10-20 12:45:52 -- STEP: 39/50 -- GLOBAL_STEP: 104490 | > loss_disc: 2.59356689453125 (2.4869657265834317) | > loss_disc_real_0: 0.06842640042304993 (0.13901674981491685) | > loss_disc_real_1: 0.22892257571220398 (0.2218950772896791) | > loss_disc_real_2: 0.23820236325263977 (0.21129922969983175) | > loss_disc_real_3: 0.252271443605423 (0.23110399089562586) | > loss_disc_real_4: 0.28907498717308044 (0.2332427310100637) | > loss_disc_real_5: 0.2954102158546448 (0.24399268457618278) | > loss_0: 2.59356689453125 (2.4869657265834317) | > grad_norm_0: tensor(696.9251, device='cuda:0') (tensor(505.9160, device='cuda:0')) | > loss_gen: 2.1030519008636475 (2.2208271790773435) | > loss_kl: 0.444398432970047 (0.7589357849688102) | > loss_feat: 4.631564617156982 (5.44974669503669) | > loss_mel: 20.92730712890625 (21.13535842834375) | > loss_duration: 1.3884992599487305 (1.3416241560226831) | > loss_1: 29.49481964111328 (30.906492502261433) | > grad_norm_1: tensor(16818.8340, device='cuda:0') (tensor(20091.6270, device='cuda:0')) | > current_lr_0: 7.14682323869344e-05 | > current_lr_1: 7.14682323869344e-05 | > step_time: 0.2482 (0.501802432231414) | > loader_time: 0.0024 (0.015176815864367362)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.830947160720825 (2.830947160720825) | > loss_disc_real_0: 0.3950556218624115 (0.3950556218624115) | > loss_disc_real_1: 0.27238699793815613 (0.27238699793815613) | > loss_disc_real_2: 0.21145756542682648 (0.21145756542682648) | > loss_disc_real_3: 0.2857089638710022 (0.2857089638710022) | > loss_disc_real_4: 0.28871917724609375 (0.28871917724609375) | > loss_disc_real_5: 0.29670172929763794 (0.29670172929763794) | > loss_0: 2.830947160720825 (2.830947160720825) | > loss_gen: 2.3282692432403564 (2.3282692432403564) | > loss_kl: 5.388101577758789 (5.388101577758789) | > loss_feat: 1.3008038997650146 (1.3008038997650146) | > loss_mel: 15.533519744873047 (15.533519744873047) | > loss_duration: 3.0533204078674316 (3.0533204078674316) | > loss_1: 27.604015350341797 (27.604015350341797)  --> STEP: 1 | > loss_disc: 2.5249826908111572 (2.5249826908111572) | > loss_disc_real_0: 0.1102820336818695 (0.1102820336818695) | > loss_disc_real_1: 0.2457767277956009 (0.2457767277956009) | > loss_disc_real_2: 0.2337903082370758 (0.2337903082370758) | > loss_disc_real_3: 0.18117044866085052 (0.18117044866085052) | > loss_disc_real_4: 0.32854804396629333 (0.32854804396629333) | > loss_disc_real_5: 0.2963795065879822 (0.2963795065879822) | > loss_0: 2.5249826908111572 (2.5249826908111572) | > loss_gen: 2.251589298248291 (2.251589298248291) | > loss_kl: 5.02163553237915 (5.02163553237915) | > loss_feat: 8.26643180847168 (8.26643180847168) | > loss_mel: 22.717256546020508 (22.717256546020508) | > loss_duration: 3.4225516319274902 (3.4225516319274902) | > loss_1: 41.679466247558594 (41.679466247558594)  --> STEP: 2 | > loss_disc: 3.0589661598205566 (2.791974425315857) | > loss_disc_real_0: 0.5050236582756042 (0.3076528459787369) | > loss_disc_real_1: 0.2788439691066742 (0.26231034845113754) | > loss_disc_real_2: 0.28635862469673157 (0.2600744664669037) | > loss_disc_real_3: 0.27633535861968994 (0.22875290364027023) | > loss_disc_real_4: 0.27855002880096436 (0.30354903638362885) | > loss_disc_real_5: 0.29370421171188354 (0.29504185914993286) | > loss_0: 3.0589661598205566 (2.791974425315857) | > loss_gen: 2.012320041656494 (2.1319546699523926) | > loss_kl: 6.145442485809326 (5.583539009094238) | > loss_feat: 0.2414383590221405 (4.25393508374691) | > loss_mel: 5.613431453704834 (14.165343999862671) | > loss_duration: 3.2802181243896484 (3.3513848781585693) | > loss_1: 17.292850494384766 (29.48615837097168)  --> STEP: 3 | > loss_disc: 2.9015064239501953 (2.828485091527303) | > loss_disc_real_0: 0.1556195616722107 (0.25697508454322815) | > loss_disc_real_1: 0.35604387521743774 (0.2935548573732376) | > loss_disc_real_2: 0.33483484387397766 (0.28499459226926166) | > loss_disc_real_3: 0.30184340476989746 (0.2531164040168126) | > loss_disc_real_4: 0.2889082431793213 (0.298668771982193) | > loss_disc_real_5: 0.359991192817688 (0.31669163703918457) | > loss_0: 2.9015064239501953 (2.828485091527303) | > loss_gen: 2.5166969299316406 (2.260202089945475) | > loss_kl: 2.79140043258667 (4.652826150258382) | > loss_feat: 4.105952262878418 (4.204607476790746) | > loss_mel: 20.831378936767578 (16.38735564549764) | > loss_duration: 3.1150660514831543 (3.272611935933431) | > loss_1: 33.36049270629883 (30.777603149414062) --> EVAL PERFORMANCE | > avg_loader_time: 0.02580873171488444 (+0.015573024749755861) | > avg_loss_disc: 2.828485091527303 (-0.12839182217915823) | > avg_loss_disc_real_0: 0.25697508454322815 (+0.08718248705069223) | > avg_loss_disc_real_1: 0.2935548573732376 (+0.04084833959738415) | > avg_loss_disc_real_2: 0.28499459226926166 (-0.0057620207468668805) | > avg_loss_disc_real_3: 0.2531164040168126 (-0.022275621692339598) | > avg_loss_disc_real_4: 0.298668771982193 (+0.018705387910207094) | > avg_loss_disc_real_5: 0.31669163703918457 (+0.020687023798624693) | > avg_loss_0: 2.828485091527303 (-0.12839182217915823) | > avg_loss_gen: 2.260202089945475 (+0.5170825322469075) | > avg_loss_kl: 4.652826150258382 (+0.014662901560464903) | > avg_loss_feat: 4.204607476790746 (+3.0366873182356358) | > avg_loss_mel: 16.38735564549764 (+3.0590091546376534) | > avg_loss_duration: 3.272611935933431 (+0.057886997858683564) | > avg_loss_1: 30.777603149414062 (+6.685328801472981)  > EPOCH: 1030/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:46:19)   --> TIME: 2023-10-20 12:46:34 -- STEP: 19/50 -- GLOBAL_STEP: 104520 | > loss_disc: 2.9679577350616455 (2.5878192311839054) | > loss_disc_real_0: 0.25109872221946716 (0.18026187643408775) | > loss_disc_real_1: 0.2794193923473358 (0.2116151804986753) | > loss_disc_real_2: 0.29225149750709534 (0.2546046458576855) | > loss_disc_real_3: 0.28141212463378906 (0.26227930188179016) | > loss_disc_real_4: 0.25184792280197144 (0.2559084415827927) | > loss_disc_real_5: 0.238095223903656 (0.21555811519685544) | > loss_0: 2.9679577350616455 (2.5878192311839054) | > grad_norm_0: tensor(255.2943, device='cuda:0') (tensor(558.0301, device='cuda:0')) | > loss_gen: 1.597460150718689 (2.156118970168264) | > loss_kl: 1.0359911918640137 (0.6666224410659388) | > loss_feat: 0.10650806874036789 (4.2389195930016665) | > loss_mel: 1.6761882305145264 (15.547717853596335) | > loss_duration: 1.452109694480896 (1.3651908761576603) | > loss_1: 5.868257522583008 (23.974569521452253) | > grad_norm_1: tensor(27215.6758, device='cuda:0') (tensor(34394.2852, device='cuda:0')) | > current_lr_0: 7.139679541408351e-05 | > current_lr_1: 7.139679541408351e-05 | > step_time: 0.4537 (0.4821018545251143) | > loader_time: 0.0143 (0.017668598576595907)  --> TIME: 2023-10-20 12:46:46 -- STEP: 49/50 -- GLOBAL_STEP: 104550 | > loss_disc: 2.0022518634796143 (2.519484186659054) | > loss_disc_real_0: 0.12913155555725098 (0.15440898090220836) | > loss_disc_real_1: 0.2285836935043335 (0.22310153668632313) | > loss_disc_real_2: 0.2386271208524704 (0.2398985086807183) | > loss_disc_real_3: 0.15404634177684784 (0.24401535842643712) | > loss_disc_real_4: 0.1757121980190277 (0.24617711249358806) | > loss_disc_real_5: 0.15342608094215393 (0.22661025506653348) | > loss_0: 2.0022518634796143 (2.519484186659054) | > grad_norm_0: tensor(588.0800, device='cuda:0') (tensor(529.2421, device='cuda:0')) | > loss_gen: 2.865032434463501 (2.2425259181431363) | > loss_kl: 1.0044636726379395 (0.7107514720790239) | > loss_feat: 7.947774887084961 (4.9583881272725305) | > loss_mel: 24.091506958007812 (17.766787755246064) | > loss_duration: 1.4229114055633545 (1.3405933258484821) | > loss_1: 37.33169174194336 (27.019046481774783) | > grad_norm_1: tensor(22300.6777, device='cuda:0') (tensor(27646.1289, device='cuda:0')) | > current_lr_0: 7.139679541408351e-05 | > current_lr_1: 7.139679541408351e-05 | > step_time: 0.4406 (0.4157157284872873) | > loader_time: 0.5735 (0.022581392404984454)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.417928695678711 (2.417928695678711) | > loss_disc_real_0: 0.09931105375289917 (0.09931105375289917) | > loss_disc_real_1: 0.2805221378803253 (0.2805221378803253) | > loss_disc_real_2: 0.37051695585250854 (0.37051695585250854) | > loss_disc_real_3: 0.2963462173938751 (0.2963462173938751) | > loss_disc_real_4: 0.11297920346260071 (0.11297920346260071) | > loss_disc_real_5: 0.3265584111213684 (0.3265584111213684) | > loss_0: 2.417928695678711 (2.417928695678711) | > loss_gen: 2.6390674114227295 (2.6390674114227295) | > loss_kl: 5.294869899749756 (5.294869899749756) | > loss_feat: 6.217057704925537 (6.217057704925537) | > loss_mel: 20.953269958496094 (20.953269958496094) | > loss_duration: 3.0573885440826416 (3.0573885440826416) | > loss_1: 38.16165542602539 (38.16165542602539)  --> STEP: 1 | > loss_disc: 2.3112680912017822 (2.3112680912017822) | > loss_disc_real_0: 0.0846007913351059 (0.0846007913351059) | > loss_disc_real_1: 0.27735474705696106 (0.27735474705696106) | > loss_disc_real_2: 0.2085939347743988 (0.2085939347743988) | > loss_disc_real_3: 0.2635517120361328 (0.2635517120361328) | > loss_disc_real_4: 0.23051084578037262 (0.23051084578037262) | > loss_disc_real_5: 0.22780252993106842 (0.22780252993106842) | > loss_0: 2.3112680912017822 (2.3112680912017822) | > loss_gen: 2.236905574798584 (2.236905574798584) | > loss_kl: 5.598300933837891 (5.598300933837891) | > loss_feat: 5.838860511779785 (5.838860511779785) | > loss_mel: 22.161312103271484 (22.161312103271484) | > loss_duration: 3.391709804534912 (3.391709804534912) | > loss_1: 39.22708511352539 (39.22708511352539)  --> STEP: 2 | > loss_disc: 2.983293056488037 (2.6472805738449097) | > loss_disc_real_0: 0.20704025030136108 (0.1458205208182335) | > loss_disc_real_1: 0.2398020178079605 (0.2585783824324608) | > loss_disc_real_2: 0.2723011076450348 (0.2404475212097168) | > loss_disc_real_3: 0.25169116258621216 (0.2576214373111725) | > loss_disc_real_4: 0.235425665974617 (0.2329682558774948) | > loss_disc_real_5: 0.24959449470043182 (0.23869851231575012) | > loss_0: 2.983293056488037 (2.6472805738449097) | > loss_gen: 1.4768640995025635 (1.8568848371505737) | > loss_kl: 5.996082305908203 (5.797191619873047) | > loss_feat: 0.0673476830124855 (2.9531040973961353) | > loss_mel: 2.2365639209747314 (12.198938012123108) | > loss_duration: 3.2795097827911377 (3.335609793663025) | > loss_1: 13.056366920471191 (26.14172601699829)  --> STEP: 3 | > loss_disc: 2.9851720333099365 (2.759911060333252) | > loss_disc_real_0: 0.20956826210021973 (0.1670697679122289) | > loss_disc_real_1: 0.23981954157352448 (0.252325435479482) | > loss_disc_real_2: 0.27213624119758606 (0.2510104278723399) | > loss_disc_real_3: 0.2516794204711914 (0.2556407650311788) | > loss_disc_real_4: 0.23545119166374207 (0.23379590113957724) | > loss_disc_real_5: 0.24958007037639618 (0.24232569833596548) | > loss_0: 2.9851720333099365 (2.759911060333252) | > loss_gen: 1.4773050546646118 (1.7303582429885864) | > loss_kl: 2.828728437423706 (4.807703892389934) | > loss_feat: 0.0626697912812233 (1.9896259953578312) | > loss_mel: 2.4511513710021973 (8.949675798416138) | > loss_duration: 3.07123064994812 (3.247483412424723) | > loss_1: 9.891084671020508 (20.72484556833903) --> EVAL PERFORMANCE | > avg_loader_time: 0.002853234608968099 (-0.022955497105916343) | > avg_loss_disc: 2.759911060333252 (-0.06857403119405125) | > avg_loss_disc_real_0: 0.1670697679122289 (-0.08990531663099924) | > avg_loss_disc_real_1: 0.252325435479482 (-0.04122942189375561) | > avg_loss_disc_real_2: 0.2510104278723399 (-0.03398416439692176) | > avg_loss_disc_real_3: 0.2556407650311788 (+0.00252436101436615) | > avg_loss_disc_real_4: 0.23379590113957724 (-0.06487287084261575) | > avg_loss_disc_real_5: 0.24232569833596548 (-0.07436593870321909) | > avg_loss_0: 2.759911060333252 (-0.06857403119405125) | > avg_loss_gen: 1.7303582429885864 (-0.5298438469568887) | > avg_loss_kl: 4.807703892389934 (+0.1548777421315517) | > avg_loss_feat: 1.9896259953578312 (-2.2149814814329147) | > avg_loss_mel: 8.949675798416138 (-7.437679847081501) | > avg_loss_duration: 3.247483412424723 (-0.02512852350870798) | > avg_loss_1: 20.72484556833903 (-10.052757581075031)  > EPOCH: 1031/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:47:09)   --> TIME: 2023-10-20 12:47:33 -- STEP: 29/50 -- GLOBAL_STEP: 104580 | > loss_disc: 2.5546905994415283 (2.3864502947905972) | > loss_disc_real_0: 0.1261894404888153 (0.143288545631643) | > loss_disc_real_1: 0.17705443501472473 (0.20645624861635012) | > loss_disc_real_2: 0.26187220215797424 (0.21580198060335784) | > loss_disc_real_3: 0.26698392629623413 (0.23089564129196363) | > loss_disc_real_4: 0.34849944710731506 (0.2110988481676784) | > loss_disc_real_5: 0.3166882395744324 (0.229980552247886) | > loss_0: 2.5546905994415283 (2.3864502947905972) | > grad_norm_0: tensor(670.8444, device='cuda:0') (tensor(856.2142, device='cuda:0')) | > loss_gen: 2.4241788387298584 (2.3302579501579546) | > loss_kl: 0.6353078484535217 (0.8916051603596786) | > loss_feat: 5.859920978546143 (6.051238550194379) | > loss_mel: 21.147966384887695 (21.728752267771753) | > loss_duration: 1.3406809568405151 (1.3485969346145106) | > loss_1: 31.408056259155273 (32.350450647288355) | > grad_norm_1: tensor(26148.9316, device='cuda:0') (tensor(31464.4746, device='cuda:0')) | > current_lr_0: 7.13254298469596e-05 | > current_lr_1: 7.13254298469596e-05 | > step_time: 0.4423 (0.5976675296651905) | > loader_time: 0.0276 (0.019869006913283777)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0029296875 (3.0029296875) | > loss_disc_real_0: 0.2321716845035553 (0.2321716845035553) | > loss_disc_real_1: 0.2674657106399536 (0.2674657106399536) | > loss_disc_real_2: 0.26277056336402893 (0.26277056336402893) | > loss_disc_real_3: 0.2835772931575775 (0.2835772931575775) | > loss_disc_real_4: 0.2228945791721344 (0.2228945791721344) | > loss_disc_real_5: 0.260463684797287 (0.260463684797287) | > loss_0: 3.0029296875 (3.0029296875) | > loss_gen: 1.5338592529296875 (1.5338592529296875) | > loss_kl: 6.0502777099609375 (6.0502777099609375) | > loss_feat: 0.05137595906853676 (0.05137595906853676) | > loss_mel: 1.9421091079711914 (1.9421091079711914) | > loss_duration: 3.10792875289917 (3.10792875289917) | > loss_1: 12.685550689697266 (12.685550689697266)  --> STEP: 1 | > loss_disc: 2.875197649002075 (2.875197649002075) | > loss_disc_real_0: 0.2973825931549072 (0.2973825931549072) | > loss_disc_real_1: 0.3024972081184387 (0.3024972081184387) | > loss_disc_real_2: 0.20493586361408234 (0.20493586361408234) | > loss_disc_real_3: 0.14464689791202545 (0.14464689791202545) | > loss_disc_real_4: 0.38481438159942627 (0.38481438159942627) | > loss_disc_real_5: 0.4056391417980194 (0.4056391417980194) | > loss_0: 2.875197649002075 (2.875197649002075) | > loss_gen: 2.1907129287719727 (2.1907129287719727) | > loss_kl: 5.83489990234375 (5.83489990234375) | > loss_feat: 6.352924823760986 (6.352924823760986) | > loss_mel: 23.307497024536133 (23.307497024536133) | > loss_duration: 3.4390835762023926 (3.4390835762023926) | > loss_1: 41.125118255615234 (41.125118255615234)  --> STEP: 2 | > loss_disc: 2.7579569816589355 (2.8165773153305054) | > loss_disc_real_0: 0.20668572187423706 (0.25203415751457214) | > loss_disc_real_1: 0.3268103301525116 (0.31465376913547516) | > loss_disc_real_2: 0.21975718438625336 (0.21234652400016785) | > loss_disc_real_3: 0.327343612909317 (0.23599525541067123) | > loss_disc_real_4: 0.30650803446769714 (0.3456612080335617) | > loss_disc_real_5: 0.39493632316589355 (0.4002877324819565) | > loss_0: 2.7579569816589355 (2.8165773153305054) | > loss_gen: 2.509941339492798 (2.3503271341323853) | > loss_kl: 5.600991249084473 (5.717945575714111) | > loss_feat: 6.720591068267822 (6.536757946014404) | > loss_mel: 21.880199432373047 (22.59384822845459) | > loss_duration: 3.2706191539764404 (3.3548513650894165) | > loss_1: 39.98234176635742 (40.55373001098633)  --> STEP: 3 | > loss_disc: 2.5473365783691406 (2.7268304030100503) | > loss_disc_real_0: 0.2818426489830017 (0.261970321337382) | > loss_disc_real_1: 0.20685502886772156 (0.2787208557128906) | > loss_disc_real_2: 0.19101931154727936 (0.20523745318253836) | > loss_disc_real_3: 0.19775445759296417 (0.2232483228047689) | > loss_disc_real_4: 0.27553805708885193 (0.32228682438532513) | > loss_disc_real_5: 0.2315026968717575 (0.3440260539452235) | > loss_0: 2.5473365783691406 (2.7268304030100503) | > loss_gen: 2.1911842823028564 (2.2972795168558755) | > loss_kl: 2.6150031089782715 (4.683631420135498) | > loss_feat: 2.676663398742676 (5.250059763590495) | > loss_mel: 18.711769104003906 (21.299821853637695) | > loss_duration: 3.055497884750366 (3.2550668716430664) | > loss_1: 29.250118255615234 (36.78585942586263) --> EVAL PERFORMANCE | > avg_loader_time: 0.004805246988932292 (+0.0019520123799641929) | > avg_loss_disc: 2.7268304030100503 (-0.033080657323201645) | > avg_loss_disc_real_0: 0.261970321337382 (+0.0949005534251531) | > avg_loss_disc_real_1: 0.2787208557128906 (+0.02639542023340863) | > avg_loss_disc_real_2: 0.20523745318253836 (-0.04577297468980154) | > avg_loss_disc_real_3: 0.2232483228047689 (-0.032392442226409884) | > avg_loss_disc_real_4: 0.32228682438532513 (+0.0884909232457479) | > avg_loss_disc_real_5: 0.3440260539452235 (+0.10170035560925803) | > avg_loss_0: 2.7268304030100503 (-0.033080657323201645) | > avg_loss_gen: 2.2972795168558755 (+0.5669212738672891) | > avg_loss_kl: 4.683631420135498 (-0.12407247225443552) | > avg_loss_feat: 5.250059763590495 (+3.260433768232664) | > avg_loss_mel: 21.299821853637695 (+12.350146055221558) | > avg_loss_duration: 3.2550668716430664 (+0.007583459218343247) | > avg_loss_1: 36.78585942586263 (+16.0610138575236)  > EPOCH: 1032/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:48:02)   --> TIME: 2023-10-20 12:48:13 -- STEP: 9/50 -- GLOBAL_STEP: 104610 | > loss_disc: 2.627570629119873 (2.19679417875078) | > loss_disc_real_0: 0.09400282055139542 (0.11213636191354857) | > loss_disc_real_1: 0.2729024887084961 (0.21160359266731474) | > loss_disc_real_2: 0.3004688620567322 (0.21768485092454487) | > loss_disc_real_3: 0.43294185400009155 (0.24199818074703217) | > loss_disc_real_4: 0.21353411674499512 (0.19657378033217457) | > loss_disc_real_5: 0.2786145508289337 (0.16426804868711364) | > loss_0: 2.627570629119873 (2.19679417875078) | > grad_norm_0: tensor(1457.5039, device='cuda:0') (tensor(929.8895, device='cuda:0')) | > loss_gen: 2.3454291820526123 (2.466595596737332) | > loss_kl: 0.5355316996574402 (0.8491572274102105) | > loss_feat: 5.074485778808594 (7.561418851216634) | > loss_mel: 23.817686080932617 (21.66418276892768) | > loss_duration: 1.3535988330841064 (1.3765548997455173) | > loss_1: 33.126731872558594 (33.91790962219238) | > grad_norm_1: tensor(13021.9004, device='cuda:0') (tensor(43845.1289, device='cuda:0')) | > current_lr_0: 7.125413561418817e-05 | > current_lr_1: 7.125413561418817e-05 | > step_time: 0.538 (0.6148016452789307) | > loader_time: 0.0267 (0.020743237601386175)  --> TIME: 2023-10-20 12:48:24 -- STEP: 39/50 -- GLOBAL_STEP: 104640 | > loss_disc: 2.998361349105835 (2.518461342041309) | > loss_disc_real_0: 0.28228041529655457 (0.16351052896621132) | > loss_disc_real_1: 0.27276620268821716 (0.22013181486190894) | > loss_disc_real_2: 0.2849310040473938 (0.23044738044532445) | > loss_disc_real_3: 0.2755289673805237 (0.24455252662301064) | > loss_disc_real_4: 0.2455289661884308 (0.23643513487126583) | > loss_disc_real_5: 0.2880198061466217 (0.2243050236839992) | > loss_0: 2.998361349105835 (2.518461342041309) | > grad_norm_0: tensor(513.7366, device='cuda:0') (tensor(1202.9775, device='cuda:0')) | > loss_gen: 1.6657490730285645 (2.274465111585764) | > loss_kl: 0.4045991003513336 (0.7591689003583713) | > loss_feat: 0.03443896397948265 (5.8933200413026885) | > loss_mel: 2.42118763923645 (21.519715251066753) | > loss_duration: 1.4110640287399292 (1.3442893028259277) | > loss_1: 5.937038898468018 (31.790958404541023) | > grad_norm_1: tensor(158191.3125, device='cuda:0') (tensor(39229.6914, device='cuda:0')) | > current_lr_0: 7.125413561418817e-05 | > current_lr_1: 7.125413561418817e-05 | > step_time: 0.2593 (0.43442547626984424) | > loader_time: 0.0024 (0.008959103853274614)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2718214988708496 (3.2718214988708496) | > loss_disc_real_0: 0.41366779804229736 (0.41366779804229736) | > loss_disc_real_1: 0.2532201409339905 (0.2532201409339905) | > loss_disc_real_2: 0.2730611562728882 (0.2730611562728882) | > loss_disc_real_3: 0.41308945417404175 (0.41308945417404175) | > loss_disc_real_4: 0.44833052158355713 (0.44833052158355713) | > loss_disc_real_5: 0.4648055136203766 (0.4648055136203766) | > loss_0: 3.2718214988708496 (3.2718214988708496) | > loss_gen: 2.2982826232910156 (2.2982826232910156) | > loss_kl: 5.400371074676514 (5.400371074676514) | > loss_feat: 5.3534064292907715 (5.3534064292907715) | > loss_mel: 20.052183151245117 (20.052183151245117) | > loss_duration: 3.052445650100708 (3.052445650100708) | > loss_1: 36.15668869018555 (36.15668869018555)  --> STEP: 1 | > loss_disc: 2.7838892936706543 (2.7838892936706543) | > loss_disc_real_0: 0.06712090224027634 (0.06712090224027634) | > loss_disc_real_1: 0.19141001999378204 (0.19141001999378204) | > loss_disc_real_2: 0.17959685623645782 (0.17959685623645782) | > loss_disc_real_3: 0.25690633058547974 (0.25690633058547974) | > loss_disc_real_4: 0.2822757065296173 (0.2822757065296173) | > loss_disc_real_5: 0.29028913378715515 (0.29028913378715515) | > loss_0: 2.7838892936706543 (2.7838892936706543) | > loss_gen: 1.527529239654541 (1.527529239654541) | > loss_kl: 5.579446792602539 (5.579446792602539) | > loss_feat: 1.0172244310379028 (1.0172244310379028) | > loss_mel: 15.450517654418945 (15.450517654418945) | > loss_duration: 3.391798496246338 (3.391798496246338) | > loss_1: 26.966514587402344 (26.966514587402344)  --> STEP: 2 | > loss_disc: 2.2840654850006104 (2.5339773893356323) | > loss_disc_real_0: 0.11447999626398087 (0.0908004492521286) | > loss_disc_real_1: 0.08897252380847931 (0.14019127190113068) | > loss_disc_real_2: 0.03394608572125435 (0.10677147097885609) | > loss_disc_real_3: 0.06425396353006363 (0.16058014705777168) | > loss_disc_real_4: 0.01585671678185463 (0.14906621165573597) | > loss_disc_real_5: 0.059122007340192795 (0.17470557056367397) | > loss_0: 2.2840654850006104 (2.5339773893356323) | > loss_gen: 1.5948024988174438 (1.5611658692359924) | > loss_kl: 5.621862888336182 (5.60065484046936) | > loss_feat: 10.223832130432129 (5.620528280735016) | > loss_mel: 25.686073303222656 (20.5682954788208) | > loss_duration: 3.2141788005828857 (3.302988648414612) | > loss_1: 46.34075164794922 (36.65363311767578)  --> STEP: 3 | > loss_disc: 2.7399215698242188 (2.6026254494984946) | > loss_disc_real_0: 0.1643219292163849 (0.11530760924021403) | > loss_disc_real_1: 0.35573527216911316 (0.21203927199045816) | > loss_disc_real_2: 0.36831510066986084 (0.19395268087585768) | > loss_disc_real_3: 0.32696083188056946 (0.2160403753320376) | > loss_disc_real_4: 0.3906668722629547 (0.22959976519147554) | > loss_disc_real_5: 0.2381831705570221 (0.19586477056145668) | > loss_0: 2.7399215698242188 (2.6026254494984946) | > loss_gen: 2.612128973007202 (1.9114869038263957) | > loss_kl: 2.7071149349212646 (4.636141538619995) | > loss_feat: 5.722651958465576 (5.654569506645203) | > loss_mel: 21.376148223876953 (20.83757972717285) | > loss_duration: 2.908862352371216 (3.1716132164001465) | > loss_1: 35.326908111572266 (36.21139144897461) --> EVAL PERFORMANCE | > avg_loader_time: 0.007216612497965495 (+0.002411365509033203) | > avg_loss_disc: 2.6026254494984946 (-0.1242049535115557) | > avg_loss_disc_real_0: 0.11530760924021403 (-0.14666271209716797) | > avg_loss_disc_real_1: 0.21203927199045816 (-0.06668158372243246) | > avg_loss_disc_real_2: 0.19395268087585768 (-0.01128477230668068) | > avg_loss_disc_real_3: 0.2160403753320376 (-0.007207947472731291) | > avg_loss_disc_real_4: 0.22959976519147554 (-0.09268705919384959) | > avg_loss_disc_real_5: 0.19586477056145668 (-0.14816128338376683) | > avg_loss_0: 2.6026254494984946 (-0.1242049535115557) | > avg_loss_gen: 1.9114869038263957 (-0.38579261302947976) | > avg_loss_kl: 4.636141538619995 (-0.04748988151550293) | > avg_loss_feat: 5.654569506645203 (+0.40450974305470755) | > avg_loss_mel: 20.83757972717285 (-0.46224212646484375) | > avg_loss_duration: 3.1716132164001465 (-0.08345365524291992) | > avg_loss_1: 36.21139144897461 (-0.5744679768880232)  > EPOCH: 1033/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:48:45)   --> TIME: 2023-10-20 12:49:02 -- STEP: 19/50 -- GLOBAL_STEP: 104670 | > loss_disc: 2.472036361694336 (2.4834470937126563) | > loss_disc_real_0: 0.09354895353317261 (0.13146675201623062) | > loss_disc_real_1: 0.30704644322395325 (0.22742873234184166) | > loss_disc_real_2: 0.2654767334461212 (0.20626118994857134) | > loss_disc_real_3: 0.32615575194358826 (0.23408965884070648) | > loss_disc_real_4: 0.2711075246334076 (0.21746508806551756) | > loss_disc_real_5: 0.27396100759506226 (0.22926739654748848) | > loss_0: 2.472036361694336 (2.4834470937126563) | > grad_norm_0: tensor(460.6673, device='cuda:0') (tensor(872.4026, device='cuda:0')) | > loss_gen: 2.5438690185546875 (2.1918778356752897) | > loss_kl: 0.9830214977264404 (0.8786763407682118) | > loss_feat: 4.215719223022461 (5.844645920748773) | > loss_mel: 20.823200225830078 (20.949370399901742) | > loss_duration: 1.4215562343597412 (1.386136726329201) | > loss_1: 29.987367630004883 (31.250707049118844) | > grad_norm_1: tensor(14755.9678, device='cuda:0') (tensor(30523.2969, device='cuda:0')) | > current_lr_0: 7.118291264446609e-05 | > current_lr_1: 7.118291264446609e-05 | > step_time: 0.5995 (0.6184259339382774) | > loader_time: 0.0262 (0.025375228179128545)  --> TIME: 2023-10-20 12:49:22 -- STEP: 49/50 -- GLOBAL_STEP: 104700 | > loss_disc: 2.7899653911590576 (2.3223648849798706) | > loss_disc_real_0: 0.07923220098018646 (0.11786877949322974) | > loss_disc_real_1: 0.2445969432592392 (0.21889053490393015) | > loss_disc_real_2: 0.17677812278270721 (0.21372703702322074) | > loss_disc_real_3: 0.3032054007053375 (0.23321130035483106) | > loss_disc_real_4: 0.27765652537345886 (0.21688512640492041) | > loss_disc_real_5: 0.29205307364463806 (0.21266274337599778) | > loss_0: 2.7899653911590576 (2.3223648849798706) | > grad_norm_0: tensor(537.8451, device='cuda:0') (tensor(651.4208, device='cuda:0')) | > loss_gen: 2.0905725955963135 (2.370943556026537) | > loss_kl: 0.7770642638206482 (0.8227293865413082) | > loss_feat: 2.3039538860321045 (6.250874350645712) | > loss_mel: 20.42819595336914 (21.633376653097113) | > loss_duration: 1.4247440099716187 (1.3509015988330453) | > loss_1: 27.0245304107666 (32.428825641164984) | > grad_norm_1: tensor(2488.8757, device='cuda:0') (tensor(25598.4453, device='cuda:0')) | > current_lr_0: 7.118291264446609e-05 | > current_lr_1: 7.118291264446609e-05 | > step_time: 0.5618 (0.6164528253127116) | > loader_time: 0.6229 (0.032238994325910285)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4725282192230225 (2.4725282192230225) | > loss_disc_real_0: 0.23364338278770447 (0.23364338278770447) | > loss_disc_real_1: 0.2417568564414978 (0.2417568564414978) | > loss_disc_real_2: 0.32918310165405273 (0.32918310165405273) | > loss_disc_real_3: 0.2737644910812378 (0.2737644910812378) | > loss_disc_real_4: 0.2240854650735855 (0.2240854650735855) | > loss_disc_real_5: 0.36043214797973633 (0.36043214797973633) | > loss_0: 2.4725282192230225 (2.4725282192230225) | > loss_gen: 2.748013734817505 (2.748013734817505) | > loss_kl: 5.55769681930542 (5.55769681930542) | > loss_feat: 6.954945087432861 (6.954945087432861) | > loss_mel: 22.186769485473633 (22.186769485473633) | > loss_duration: 2.98319935798645 (2.98319935798645) | > loss_1: 40.43062210083008 (40.43062210083008)  --> STEP: 1 | > loss_disc: 2.384556531906128 (2.384556531906128) | > loss_disc_real_0: 0.22770154476165771 (0.22770154476165771) | > loss_disc_real_1: 0.19606661796569824 (0.19606661796569824) | > loss_disc_real_2: 0.2629099190235138 (0.2629099190235138) | > loss_disc_real_3: 0.25659069418907166 (0.25659069418907166) | > loss_disc_real_4: 0.24307268857955933 (0.24307268857955933) | > loss_disc_real_5: 0.12876807153224945 (0.12876807153224945) | > loss_0: 2.384556531906128 (2.384556531906128) | > loss_gen: 2.60489559173584 (2.60489559173584) | > loss_kl: 5.328055381774902 (5.328055381774902) | > loss_feat: 8.1237211227417 (8.1237211227417) | > loss_mel: 23.87272834777832 (23.87272834777832) | > loss_duration: 3.3434882164001465 (3.3434882164001465) | > loss_1: 43.27288818359375 (43.27288818359375)  --> STEP: 2 | > loss_disc: 2.771786689758301 (2.5781716108322144) | > loss_disc_real_0: 0.3686014711856842 (0.29815150797367096) | > loss_disc_real_1: 0.2577800452709198 (0.22692333161830902) | > loss_disc_real_2: 0.20102761685848236 (0.23196876794099808) | > loss_disc_real_3: 0.3521929085254669 (0.3043918013572693) | > loss_disc_real_4: 0.28856217861175537 (0.26581743359565735) | > loss_disc_real_5: 0.5020635724067688 (0.3154158219695091) | > loss_0: 2.771786689758301 (2.5781716108322144) | > loss_gen: 3.339165687561035 (2.9720306396484375) | > loss_kl: 5.84700345993042 (5.587529420852661) | > loss_feat: 8.138334274291992 (8.131027698516846) | > loss_mel: 24.00217628479004 (23.93745231628418) | > loss_duration: 3.3053910732269287 (3.3244396448135376) | > loss_1: 44.6320686340332 (43.95247840881348)  --> STEP: 3 | > loss_disc: 3.131847620010376 (2.762730280558268) | > loss_disc_real_0: 0.311564564704895 (0.302622526884079) | > loss_disc_real_1: 0.31426703929901123 (0.2560379008452098) | > loss_disc_real_2: 0.3899186849594116 (0.28461874028046924) | > loss_disc_real_3: 0.29445457458496094 (0.3010793924331665) | > loss_disc_real_4: 0.2887865900993347 (0.2734738190968831) | > loss_disc_real_5: 0.42691731452941895 (0.35258298615614575) | > loss_0: 3.131847620010376 (2.762730280558268) | > loss_gen: 2.8989062309265137 (2.9476558367411294) | > loss_kl: 2.6316897869110107 (4.602249542872111) | > loss_feat: 5.123842239379883 (7.128632545471191) | > loss_mel: 25.217727661132812 (24.36421076456706) | > loss_duration: 2.90508770942688 (3.1846556663513184) | > loss_1: 38.777252197265625 (42.227403004964195) --> EVAL PERFORMANCE | > avg_loader_time: 0.00595394770304362 (-0.001262664794921875) | > avg_loss_disc: 2.762730280558268 (+0.16010483105977347) | > avg_loss_disc_real_0: 0.302622526884079 (+0.18731491764386493) | > avg_loss_disc_real_1: 0.2560379008452098 (+0.043998628854751615) | > avg_loss_disc_real_2: 0.28461874028046924 (+0.09066605940461156) | > avg_loss_disc_real_3: 0.3010793924331665 (+0.0850390171011289) | > avg_loss_disc_real_4: 0.2734738190968831 (+0.04387405390540758) | > avg_loss_disc_real_5: 0.35258298615614575 (+0.15671821559468907) | > avg_loss_0: 2.762730280558268 (+0.16010483105977347) | > avg_loss_gen: 2.9476558367411294 (+1.0361689329147337) | > avg_loss_kl: 4.602249542872111 (-0.03389199574788382) | > avg_loss_feat: 7.128632545471191 (+1.4740630388259888) | > avg_loss_mel: 24.36421076456706 (+3.526631037394207) | > avg_loss_duration: 3.1846556663513184 (+0.013042449951171875) | > avg_loss_1: 42.227403004964195 (+6.016011555989586)  > EPOCH: 1034/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:49:37)   --> TIME: 2023-10-20 12:49:54 -- STEP: 29/50 -- GLOBAL_STEP: 104730 | > loss_disc: 2.77367901802063 (2.3949734712469164) | > loss_disc_real_0: 0.15227806568145752 (0.16462591386817652) | > loss_disc_real_1: 0.15871813893318176 (0.22858330697335047) | > loss_disc_real_2: 0.2758042812347412 (0.23468600380523452) | > loss_disc_real_3: 0.22617830336093903 (0.24190701261676592) | > loss_disc_real_4: 0.31497126817703247 (0.22217965671985312) | > loss_disc_real_5: 0.2361607402563095 (0.22411026844176754) | > loss_0: 2.77367901802063 (2.3949734712469164) | > grad_norm_0: tensor(294.8238, device='cuda:0') (tensor(587.7545, device='cuda:0')) | > loss_gen: 1.9958345890045166 (2.4159063018601517) | > loss_kl: 0.7097288966178894 (0.7194083446058733) | > loss_feat: 5.415637016296387 (5.884371864127702) | > loss_mel: 22.118738174438477 (21.070115969098847) | > loss_duration: 1.3770605325698853 (1.3466952093716325) | > loss_1: 31.61699867248535 (31.436497622522815) | > grad_norm_1: tensor(3743.8621, device='cuda:0') (tensor(20047.0703, device='cuda:0')) | > current_lr_0: 7.111176086656148e-05 | > current_lr_1: 7.111176086656148e-05 | > step_time: 0.3071 (0.42973088396006615) | > loader_time: 0.0023 (0.010534196064389986)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7778501510620117 (2.7778501510620117) | > loss_disc_real_0: 0.45306846499443054 (0.45306846499443054) | > loss_disc_real_1: 0.15731008350849152 (0.15731008350849152) | > loss_disc_real_2: 0.22921675443649292 (0.22921675443649292) | > loss_disc_real_3: 0.22944539785385132 (0.22944539785385132) | > loss_disc_real_4: 0.20972810685634613 (0.20972810685634613) | > loss_disc_real_5: 0.2514039874076843 (0.2514039874076843) | > loss_0: 2.7778501510620117 (2.7778501510620117) | > loss_gen: 2.3084537982940674 (2.3084537982940674) | > loss_kl: 6.2123918533325195 (6.2123918533325195) | > loss_feat: 7.583660125732422 (7.583660125732422) | > loss_mel: 23.216672897338867 (23.216672897338867) | > loss_duration: 3.07297945022583 (3.07297945022583) | > loss_1: 42.39415740966797 (42.39415740966797)  --> STEP: 1 | > loss_disc: 2.765376567840576 (2.765376567840576) | > loss_disc_real_0: 0.31578201055526733 (0.31578201055526733) | > loss_disc_real_1: 0.13407300412654877 (0.13407300412654877) | > loss_disc_real_2: 0.2814180850982666 (0.2814180850982666) | > loss_disc_real_3: 0.3187597990036011 (0.3187597990036011) | > loss_disc_real_4: 0.2390080839395523 (0.2390080839395523) | > loss_disc_real_5: 0.2160852551460266 (0.2160852551460266) | > loss_0: 2.765376567840576 (2.765376567840576) | > loss_gen: 2.406888484954834 (2.406888484954834) | > loss_kl: 5.102710723876953 (5.102710723876953) | > loss_feat: 7.869321346282959 (7.869321346282959) | > loss_mel: 22.6074275970459 (22.6074275970459) | > loss_duration: 3.478449821472168 (3.478449821472168) | > loss_1: 41.46479797363281 (41.46479797363281)  --> STEP: 2 | > loss_disc: 2.3276846408843994 (2.546530604362488) | > loss_disc_real_0: 0.28172481060028076 (0.29875341057777405) | > loss_disc_real_1: 0.1884048730134964 (0.16123893857002258) | > loss_disc_real_2: 0.0894906297326088 (0.1854543574154377) | > loss_disc_real_3: 0.08363692462444305 (0.20119836181402206) | > loss_disc_real_4: 0.06256706267595291 (0.1507875733077526) | > loss_disc_real_5: 0.0952618420124054 (0.155673548579216) | > loss_0: 2.3276846408843994 (2.546530604362488) | > loss_gen: 2.8882336616516113 (2.6475610733032227) | > loss_kl: 5.632203102111816 (5.367456912994385) | > loss_feat: 11.441564559936523 (9.655442953109741) | > loss_mel: 24.53912353515625 (23.573275566101074) | > loss_duration: 3.2432479858398438 (3.360848903656006) | > loss_1: 47.7443733215332 (44.60458564758301)  --> STEP: 3 | > loss_disc: 3.0360310077667236 (2.709697405497233) | > loss_disc_real_0: 0.43804994225502014 (0.34518558780352276) | > loss_disc_real_1: 0.2497178316116333 (0.19073190291722616) | > loss_disc_real_2: 0.2820613384246826 (0.21765668441851935) | > loss_disc_real_3: 0.26898083090782166 (0.22379251817862192) | > loss_disc_real_4: 0.27890706062316895 (0.19349406907955805) | > loss_disc_real_5: 0.2506481409072876 (0.18733174602190653) | > loss_0: 3.0360310077667236 (2.709697405497233) | > loss_gen: 1.8535387516021729 (2.3828869660695395) | > loss_kl: 2.420650005340576 (4.385187943776448) | > loss_feat: 0.3596014678478241 (6.556829124689102) | > loss_mel: 14.485967636108398 (20.544172922770183) | > loss_duration: 3.028578042984009 (3.2500919500986734) | > loss_1: 22.14833641052246 (37.11916923522949) --> EVAL PERFORMANCE | > avg_loader_time: 0.011560678482055664 (+0.005606730779012044) | > avg_loss_disc: 2.709697405497233 (-0.053032875061035156) | > avg_loss_disc_real_0: 0.34518558780352276 (+0.042563060919443785) | > avg_loss_disc_real_1: 0.19073190291722616 (-0.06530599792798361) | > avg_loss_disc_real_2: 0.21765668441851935 (-0.06696205586194989) | > avg_loss_disc_real_3: 0.22379251817862192 (-0.07728687425454459) | > avg_loss_disc_real_4: 0.19349406907955805 (-0.07997975001732507) | > avg_loss_disc_real_5: 0.18733174602190653 (-0.16525124013423922) | > avg_loss_0: 2.709697405497233 (-0.053032875061035156) | > avg_loss_gen: 2.3828869660695395 (-0.5647688706715899) | > avg_loss_kl: 4.385187943776448 (-0.21706159909566303) | > avg_loss_feat: 6.556829124689102 (-0.5718034207820892) | > avg_loss_mel: 20.544172922770183 (-3.820037841796875) | > avg_loss_duration: 3.2500919500986734 (+0.065436283747355) | > avg_loss_1: 37.11916923522949 (-5.108233769734703)  > EPOCH: 1035/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:50:15)   --> TIME: 2023-10-20 12:50:27 -- STEP: 9/50 -- GLOBAL_STEP: 104760 | > loss_disc: 2.454237937927246 (2.3841005166371665) | > loss_disc_real_0: 0.10472362488508224 (0.16992594384484822) | > loss_disc_real_1: 0.40068385004997253 (0.22711384627554151) | > loss_disc_real_2: 0.3052448034286499 (0.2455064637793435) | > loss_disc_real_3: 0.3891357481479645 (0.2392245555917422) | > loss_disc_real_4: 0.28251317143440247 (0.22615993602408302) | > loss_disc_real_5: 0.22815819084644318 (0.20033079344365332) | > loss_0: 2.454237937927246 (2.3841005166371665) | > grad_norm_0: tensor(321.6235, device='cuda:0') (tensor(690.0319, device='cuda:0')) | > loss_gen: 2.7444653511047363 (2.338143401675754) | > loss_kl: 0.2927670180797577 (0.8716724945439233) | > loss_feat: 4.5959577560424805 (6.019908918274774) | > loss_mel: 22.281780242919922 (20.225508160061306) | > loss_duration: 1.2878131866455078 (1.3337232139375474) | > loss_1: 31.202783584594727 (30.788956218295628) | > grad_norm_1: tensor(3887.5986, device='cuda:0') (tensor(19081.5820, device='cuda:0')) | > current_lr_0: 7.104068020931364e-05 | > current_lr_1: 7.104068020931364e-05 | > step_time: 0.5781 (0.5870989693535699) | > loader_time: 0.0059 (0.020504103766547307)  --> TIME: 2023-10-20 12:50:46 -- STEP: 39/50 -- GLOBAL_STEP: 104790 | > loss_disc: 2.257063388824463 (2.366463315792573) | > loss_disc_real_0: 0.0555066354572773 (0.1418154938862874) | > loss_disc_real_1: 0.23769132792949677 (0.2251561008966886) | > loss_disc_real_2: 0.16811935603618622 (0.22573922875408942) | > loss_disc_real_3: 0.13977859914302826 (0.23059926401728234) | > loss_disc_real_4: 0.1534758359193802 (0.21711890227519548) | > loss_disc_real_5: 0.15244466066360474 (0.20836562505708292) | > loss_0: 2.257063388824463 (2.366463315792573) | > grad_norm_0: tensor(706.5170, device='cuda:0') (tensor(698.8456, device='cuda:0')) | > loss_gen: 1.8359429836273193 (2.3241159396293836) | > loss_kl: 0.6366234421730042 (0.8276640925651941) | > loss_feat: 4.080849647521973 (5.926520573405119) | > loss_mel: 16.150358200073242 (20.892501158592033) | > loss_duration: 1.3838880062103271 (1.3338294059802325) | > loss_1: 24.087663650512695 (31.30463140438764) | > grad_norm_1: tensor(17234.9180, device='cuda:0') (tensor(21564.5938, device='cuda:0')) | > current_lr_0: 7.104068020931364e-05 | > current_lr_1: 7.104068020931364e-05 | > step_time: 0.3676 (0.6040253027891501) | > loader_time: 0.0027 (0.02221838021889711)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.693103313446045 (2.693103313446045) | > loss_disc_real_0: 0.21168750524520874 (0.21168750524520874) | > loss_disc_real_1: 0.2316722571849823 (0.2316722571849823) | > loss_disc_real_2: 0.27999255061149597 (0.27999255061149597) | > loss_disc_real_3: 0.39693483710289 (0.39693483710289) | > loss_disc_real_4: 0.35962170362472534 (0.35962170362472534) | > loss_disc_real_5: 0.3382374346256256 (0.3382374346256256) | > loss_0: 2.693103313446045 (2.693103313446045) | > loss_gen: 2.553175210952759 (2.553175210952759) | > loss_kl: 6.538449764251709 (6.538449764251709) | > loss_feat: 4.597035884857178 (4.597035884857178) | > loss_mel: 22.175861358642578 (22.175861358642578) | > loss_duration: 3.054732084274292 (3.054732084274292) | > loss_1: 38.91925811767578 (38.91925811767578)  --> STEP: 1 | > loss_disc: 2.9024245738983154 (2.9024245738983154) | > loss_disc_real_0: 0.374543696641922 (0.374543696641922) | > loss_disc_real_1: 0.30818894505500793 (0.30818894505500793) | > loss_disc_real_2: 0.336548388004303 (0.336548388004303) | > loss_disc_real_3: 0.4195569157600403 (0.4195569157600403) | > loss_disc_real_4: 0.29319852590560913 (0.29319852590560913) | > loss_disc_real_5: 0.2891242504119873 (0.2891242504119873) | > loss_0: 2.9024245738983154 (2.9024245738983154) | > loss_gen: 2.6670989990234375 (2.6670989990234375) | > loss_kl: 5.3248066902160645 (5.3248066902160645) | > loss_feat: 5.441870212554932 (5.441870212554932) | > loss_mel: 24.212478637695312 (24.212478637695312) | > loss_duration: 3.403501510620117 (3.403501510620117) | > loss_1: 41.04975891113281 (41.04975891113281)  --> STEP: 2 | > loss_disc: 2.607804536819458 (2.7551145553588867) | > loss_disc_real_0: 0.4711892604827881 (0.42286647856235504) | > loss_disc_real_1: 0.20737314224243164 (0.2577810436487198) | > loss_disc_real_2: 0.17671401798725128 (0.25663120299577713) | > loss_disc_real_3: 0.2535175085067749 (0.3365372121334076) | > loss_disc_real_4: 0.2916601300239563 (0.2924293279647827) | > loss_disc_real_5: 0.3866606056690216 (0.33789242804050446) | > loss_0: 2.607804536819458 (2.7551145553588867) | > loss_gen: 2.713989496231079 (2.6905442476272583) | > loss_kl: 5.829984188079834 (5.577395439147949) | > loss_feat: 6.509567737579346 (5.975718975067139) | > loss_mel: 24.587818145751953 (24.400148391723633) | > loss_duration: 3.3359291553497314 (3.3697153329849243) | > loss_1: 42.97728729248047 (42.01352310180664)  --> STEP: 3 | > loss_disc: 3.015817165374756 (2.8420154253641763) | > loss_disc_real_0: 0.2232564240694046 (0.3563297937313716) | > loss_disc_real_1: 0.40968114137649536 (0.30841440955797833) | > loss_disc_real_2: 0.32097184658050537 (0.2780780841906865) | > loss_disc_real_3: 0.3062233030796051 (0.3264325757821401) | > loss_disc_real_4: 0.30718985199928284 (0.2973495026429494) | > loss_disc_real_5: 0.3810485601425171 (0.352277805407842) | > loss_0: 3.015817165374756 (2.8420154253641763) | > loss_gen: 2.181483030319214 (2.5208571751912436) | > loss_kl: 2.587158203125 (4.580649693806966) | > loss_feat: 2.2467234134674072 (4.732720454533895) | > loss_mel: 19.700733184814453 (22.83367665608724) | > loss_duration: 3.0447616577148438 (3.261397441228231) | > loss_1: 29.7608585357666 (37.9293015797933) --> EVAL PERFORMANCE | > avg_loader_time: 0.004924694697062175 (-0.006635983784993489) | > avg_loss_disc: 2.8420154253641763 (+0.13231801986694336) | > avg_loss_disc_real_0: 0.3563297937313716 (+0.011144205927848816) | > avg_loss_disc_real_1: 0.30841440955797833 (+0.11768250664075217) | > avg_loss_disc_real_2: 0.2780780841906865 (+0.06042139977216718) | > avg_loss_disc_real_3: 0.3264325757821401 (+0.10264005760351816) | > avg_loss_disc_real_4: 0.2973495026429494 (+0.10385543356339136) | > avg_loss_disc_real_5: 0.352277805407842 (+0.16494605938593546) | > avg_loss_0: 2.8420154253641763 (+0.13231801986694336) | > avg_loss_gen: 2.5208571751912436 (+0.1379702091217041) | > avg_loss_kl: 4.580649693806966 (+0.19546175003051758) | > avg_loss_feat: 4.732720454533895 (-1.8241086701552076) | > avg_loss_mel: 22.83367665608724 (+2.289503733317055) | > avg_loss_duration: 3.261397441228231 (+0.011305491129557588) | > avg_loss_1: 37.9293015797933 (+0.8101323445638045)  > EPOCH: 1036/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:51:04)   --> TIME: 2023-10-20 12:51:22 -- STEP: 19/50 -- GLOBAL_STEP: 104820 | > loss_disc: 2.1715171337127686 (2.427790723348919) | > loss_disc_real_0: 0.17268744111061096 (0.12757094390690327) | > loss_disc_real_1: 0.1850549280643463 (0.22376211458130887) | > loss_disc_real_2: 0.15392418205738068 (0.21324795131620608) | > loss_disc_real_3: 0.22931715846061707 (0.2379719075795851) | > loss_disc_real_4: 0.14709582924842834 (0.20207701309731133) | > loss_disc_real_5: 0.11089731007814407 (0.2248517056240847) | > loss_0: 2.1715171337127686 (2.427790723348919) | > grad_norm_0: tensor(652.9047, device='cuda:0') (tensor(508.8736, device='cuda:0')) | > loss_gen: 2.2084598541259766 (2.276749767755207) | > loss_kl: 1.0303088426589966 (0.8433323157461066) | > loss_feat: 5.491498947143555 (5.482050850203163) | > loss_mel: 26.39632797241211 (19.459612037006178) | > loss_duration: 1.4360674619674683 (1.3817650958111412) | > loss_1: 36.562660217285156 (29.443510155928763) | > grad_norm_1: tensor(8860.1797, device='cuda:0') (tensor(22441.4355, device='cuda:0')) | > current_lr_0: 7.096967060163304e-05 | > current_lr_1: 7.096967060163304e-05 | > step_time: 0.3481 (0.6754408384624281) | > loader_time: 0.0355 (0.024201982899716024)  --> TIME: 2023-10-20 12:51:36 -- STEP: 49/50 -- GLOBAL_STEP: 104850 | > loss_disc: 2.169790506362915 (2.4088697141530564) | > loss_disc_real_0: 0.18991315364837646 (0.13006742454457043) | > loss_disc_real_1: 0.20488488674163818 (0.22705643730504171) | > loss_disc_real_2: 0.1908569037914276 (0.22240455007674742) | > loss_disc_real_3: 0.2739662230014801 (0.23733775386092615) | > loss_disc_real_4: 0.3563188910484314 (0.22585913219622203) | > loss_disc_real_5: 0.47714653611183167 (0.22199605665720848) | > loss_0: 2.169790506362915 (2.4088697141530564) | > grad_norm_0: tensor(576.5213, device='cuda:0') (tensor(554.4324, device='cuda:0')) | > loss_gen: 4.359470844268799 (2.392344056343545) | > loss_kl: 0.6093795895576477 (0.7610564219708346) | > loss_feat: 9.412741661071777 (6.201473460513718) | > loss_mel: 27.032394409179688 (20.951339193752833) | > loss_duration: 1.4246524572372437 (1.3418743196798832) | > loss_1: 42.83863830566406 (31.648087248510244) | > grad_norm_1: tensor(70980.5156, device='cuda:0') (tensor(20907.9844, device='cuda:0')) | > current_lr_0: 7.096967060163304e-05 | > current_lr_1: 7.096967060163304e-05 | > step_time: 0.6417 (0.5359748236987057) | > loader_time: 0.441 (0.024564378115595614)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9507317543029785 (2.9507317543029785) | > loss_disc_real_0: 0.24882732331752777 (0.24882732331752777) | > loss_disc_real_1: 0.24647605419158936 (0.24647605419158936) | > loss_disc_real_2: 0.2522091567516327 (0.2522091567516327) | > loss_disc_real_3: 0.24977637827396393 (0.24977637827396393) | > loss_disc_real_4: 0.25814300775527954 (0.25814300775527954) | > loss_disc_real_5: 0.27899497747421265 (0.27899497747421265) | > loss_0: 2.9507317543029785 (2.9507317543029785) | > loss_gen: 1.5948691368103027 (1.5948691368103027) | > loss_kl: 5.922184944152832 (5.922184944152832) | > loss_feat: 0.1454099863767624 (0.1454099863767624) | > loss_mel: 6.350870609283447 (6.350870609283447) | > loss_duration: 3.1331820487976074 (3.1331820487976074) | > loss_1: 17.146516799926758 (17.146516799926758)  --> STEP: 1 | > loss_disc: 2.9926204681396484 (2.9926204681396484) | > loss_disc_real_0: 0.2631323039531708 (0.2631323039531708) | > loss_disc_real_1: 0.24640338122844696 (0.24640338122844696) | > loss_disc_real_2: 0.2529403269290924 (0.2529403269290924) | > loss_disc_real_3: 0.24934422969818115 (0.24934422969818115) | > loss_disc_real_4: 0.25823837518692017 (0.25823837518692017) | > loss_disc_real_5: 0.27873292565345764 (0.27873292565345764) | > loss_0: 2.9926204681396484 (2.9926204681396484) | > loss_gen: 1.5599218606948853 (1.5599218606948853) | > loss_kl: 5.448885440826416 (5.448885440826416) | > loss_feat: 0.043629344552755356 (0.043629344552755356) | > loss_mel: 4.364783763885498 (4.364783763885498) | > loss_duration: 3.471432685852051 (3.471432685852051) | > loss_1: 14.888652801513672 (14.888652801513672)  --> STEP: 2 | > loss_disc: 2.4053494930267334 (2.698984980583191) | > loss_disc_real_0: 0.29594412446022034 (0.27953821420669556) | > loss_disc_real_1: 0.3275102376937866 (0.2869568094611168) | > loss_disc_real_2: 0.3227260112762451 (0.28783316910266876) | > loss_disc_real_3: 0.20168308913707733 (0.22551365941762924) | > loss_disc_real_4: 0.18328404426574707 (0.22076120972633362) | > loss_disc_real_5: 0.16528937220573425 (0.22201114892959595) | > loss_0: 2.4053494930267334 (2.698984980583191) | > loss_gen: 2.7595200538635254 (2.1597209572792053) | > loss_kl: 5.310657978057861 (5.379771709442139) | > loss_feat: 6.378438472747803 (3.211033908650279) | > loss_mel: 25.324193954467773 (14.844488859176636) | > loss_duration: 3.3118679523468018 (3.3916503190994263) | > loss_1: 43.084678649902344 (28.986665725708008)  --> STEP: 3 | > loss_disc: 2.8832294940948486 (2.76039981842041) | > loss_disc_real_0: 0.43655067682266235 (0.33187570174535114) | > loss_disc_real_1: 0.3231390416622162 (0.2990175535281499) | > loss_disc_real_2: 0.35716989636421204 (0.31094541152318317) | > loss_disc_real_3: 0.2546127438545227 (0.23521335422992706) | > loss_disc_real_4: 0.2578204274177551 (0.23311428229014078) | > loss_disc_real_5: 0.2755400836467743 (0.2398541271686554) | > loss_0: 2.8832294940948486 (2.76039981842041) | > loss_gen: 2.4884302616119385 (2.2692907253901162) | > loss_kl: 3.0195400714874268 (4.593027830123901) | > loss_feat: 4.359044551849365 (3.5937041230499744) | > loss_mel: 24.828527450561523 (18.1725017229716) | > loss_duration: 3.010627031326294 (3.2646425565083823) | > loss_1: 37.70616912841797 (31.89316685994466) --> EVAL PERFORMANCE | > avg_loader_time: 0.011816263198852539 (+0.006891568501790364) | > avg_loss_disc: 2.76039981842041 (-0.08161560694376613) | > avg_loss_disc_real_0: 0.33187570174535114 (-0.024454091986020443) | > avg_loss_disc_real_1: 0.2990175535281499 (-0.009396856029828426) | > avg_loss_disc_real_2: 0.31094541152318317 (+0.03286732733249664) | > avg_loss_disc_real_3: 0.23521335422992706 (-0.09121922155221301) | > avg_loss_disc_real_4: 0.23311428229014078 (-0.06423522035280863) | > avg_loss_disc_real_5: 0.2398541271686554 (-0.11242367823918659) | > avg_loss_0: 2.76039981842041 (-0.08161560694376613) | > avg_loss_gen: 2.2692907253901162 (-0.2515664498011274) | > avg_loss_kl: 4.593027830123901 (+0.012378136316935517) | > avg_loss_feat: 3.5937041230499744 (-1.1390163314839201) | > avg_loss_mel: 18.1725017229716 (-4.661174933115639) | > avg_loss_duration: 3.2646425565083823 (+0.003245115280151367) | > avg_loss_1: 31.89316685994466 (-6.036134719848636)  > EPOCH: 1037/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:51:53)   --> TIME: 2023-10-20 12:52:12 -- STEP: 29/50 -- GLOBAL_STEP: 104880 | > loss_disc: 1.8266801834106445 (2.330745524373548) | > loss_disc_real_0: 0.05107219144701958 (0.13997086060458214) | > loss_disc_real_1: 0.1780872792005539 (0.21855714814416294) | > loss_disc_real_2: 0.10607794672250748 (0.20397194365745988) | > loss_disc_real_3: 0.14379023015499115 (0.21764007352035622) | > loss_disc_real_4: 0.10453028976917267 (0.21576925431346072) | > loss_disc_real_5: 0.11998258531093597 (0.228125911206007) | > loss_0: 1.8266801834106445 (2.330745524373548) | > grad_norm_0: tensor(261.6393, device='cuda:0') (tensor(587.2147, device='cuda:0')) | > loss_gen: 2.7473220825195312 (2.414697108597591) | > loss_kl: 0.837821364402771 (0.8242926535935238) | > loss_feat: 7.792153835296631 (6.345563357439021) | > loss_mel: 20.615558624267578 (21.47381017331419) | > loss_duration: 1.3497341871261597 (1.3648135333225644) | > loss_1: 33.34259033203125 (32.42317635437537) | > grad_norm_1: tensor(7332.6987, device='cuda:0') (tensor(23648.6094, device='cuda:0')) | > current_lr_0: 7.089873197250119e-05 | > current_lr_1: 7.089873197250119e-05 | > step_time: 0.2894 (0.46985269414967507) | > loader_time: 0.0047 (0.015975697287197766)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.822819232940674 (2.822819232940674) | > loss_disc_real_0: 0.2191217541694641 (0.2191217541694641) | > loss_disc_real_1: 0.28914275765419006 (0.28914275765419006) | > loss_disc_real_2: 0.2930017411708832 (0.2930017411708832) | > loss_disc_real_3: 0.29837170243263245 (0.29837170243263245) | > loss_disc_real_4: 0.28136947751045227 (0.28136947751045227) | > loss_disc_real_5: 0.2759363353252411 (0.2759363353252411) | > loss_0: 2.822819232940674 (2.822819232940674) | > loss_gen: 2.035090446472168 (2.035090446472168) | > loss_kl: 6.0115838050842285 (6.0115838050842285) | > loss_feat: 1.6720821857452393 (1.6720821857452393) | > loss_mel: 21.25664520263672 (21.25664520263672) | > loss_duration: 3.1298000812530518 (3.1298000812530518) | > loss_1: 34.105201721191406 (34.105201721191406)  --> STEP: 1 | > loss_disc: 2.9077858924865723 (2.9077858924865723) | > loss_disc_real_0: 0.31691813468933105 (0.31691813468933105) | > loss_disc_real_1: 0.3433801233768463 (0.3433801233768463) | > loss_disc_real_2: 0.3004865050315857 (0.3004865050315857) | > loss_disc_real_3: 0.2935279905796051 (0.2935279905796051) | > loss_disc_real_4: 0.3059644103050232 (0.3059644103050232) | > loss_disc_real_5: 0.38004499673843384 (0.38004499673843384) | > loss_0: 2.9077858924865723 (2.9077858924865723) | > loss_gen: 2.4311342239379883 (2.4311342239379883) | > loss_kl: 5.404215335845947 (5.404215335845947) | > loss_feat: 6.366430759429932 (6.366430759429932) | > loss_mel: 20.731468200683594 (20.731468200683594) | > loss_duration: 3.3776378631591797 (3.3776378631591797) | > loss_1: 38.310882568359375 (38.310882568359375)  --> STEP: 2 | > loss_disc: 1.1234095096588135 (2.015597701072693) | > loss_disc_real_0: 0.02533664181828499 (0.17112738825380802) | > loss_disc_real_1: 0.1376950442790985 (0.2405375838279724) | > loss_disc_real_2: 0.11424018442630768 (0.20736334472894669) | > loss_disc_real_3: 0.059871744364500046 (0.17669986747205257) | > loss_disc_real_4: 0.09401414543390274 (0.19998927786946297) | > loss_disc_real_5: 0.01167394034564495 (0.1958594685420394) | > loss_0: 1.1234095096588135 (2.015597701072693) | > loss_gen: 3.605368137359619 (3.0182511806488037) | > loss_kl: 5.538341522216797 (5.471278429031372) | > loss_feat: 18.2037296295166 (12.285080194473267) | > loss_mel: 25.995851516723633 (23.363659858703613) | > loss_duration: 3.3567326068878174 (3.3671852350234985) | > loss_1: 56.70002365112305 (47.50545310974121)  --> STEP: 3 | > loss_disc: 2.399975061416626 (2.143723487854004) | > loss_disc_real_0: 0.23892468214035034 (0.19372648621598879) | > loss_disc_real_1: 0.29588836431503296 (0.2589878439903259) | > loss_disc_real_2: 0.2700712978839874 (0.22826599578062692) | > loss_disc_real_3: 0.3054311275482178 (0.21961028749744096) | > loss_disc_real_4: 0.27797478437423706 (0.22598444670438766) | > loss_disc_real_5: 0.30823272466659546 (0.23331722058355808) | > loss_0: 2.399975061416626 (2.143723487854004) | > loss_gen: 3.168355703353882 (3.0682860215504966) | > loss_kl: 2.5995919704437256 (4.514049609502156) | > loss_feat: 5.754796028137207 (10.10831880569458) | > loss_mel: 22.638731002807617 (23.12201690673828) | > loss_duration: 2.9565649032592773 (3.2303117911020913) | > loss_1: 37.118038177490234 (44.042981465657554) --> EVAL PERFORMANCE | > avg_loader_time: 0.0349272092183431 (+0.023110946019490562) | > avg_loss_disc: 2.143723487854004 (-0.6166763305664062) | > avg_loss_disc_real_0: 0.19372648621598879 (-0.13814921552936235) | > avg_loss_disc_real_1: 0.2589878439903259 (-0.040029709537823976) | > avg_loss_disc_real_2: 0.22826599578062692 (-0.08267941574255624) | > avg_loss_disc_real_3: 0.21961028749744096 (-0.015603066732486098) | > avg_loss_disc_real_4: 0.22598444670438766 (-0.007129835585753114) | > avg_loss_disc_real_5: 0.23331722058355808 (-0.006536906585097313) | > avg_loss_0: 2.143723487854004 (-0.6166763305664062) | > avg_loss_gen: 3.0682860215504966 (+0.7989952961603803) | > avg_loss_kl: 4.514049609502156 (-0.07897822062174509) | > avg_loss_feat: 10.10831880569458 (+6.514614682644606) | > avg_loss_mel: 23.12201690673828 (+4.949515183766682) | > avg_loss_duration: 3.2303117911020913 (-0.034330765406290986) | > avg_loss_1: 44.042981465657554 (+12.149814605712894)  > EPOCH: 1038/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:52:41)   --> TIME: 2023-10-20 12:52:51 -- STEP: 9/50 -- GLOBAL_STEP: 104910 | > loss_disc: 2.8775575160980225 (2.3195016781489053) | > loss_disc_real_0: 0.150428906083107 (0.12892932341330582) | > loss_disc_real_1: 0.3094857931137085 (0.24178273810280693) | > loss_disc_real_2: 0.23202857375144958 (0.2621723868780666) | > loss_disc_real_3: 0.3752489984035492 (0.24732392157117525) | > loss_disc_real_4: 0.427071213722229 (0.2750535609407557) | > loss_disc_real_5: 0.23614834249019623 (0.24656019256346756) | > loss_0: 2.8775575160980225 (2.3195016781489053) | > grad_norm_0: tensor(507.2321, device='cuda:0') (tensor(497.6768, device='cuda:0')) | > loss_gen: 2.0242903232574463 (2.574549092186822) | > loss_kl: 0.9552465677261353 (0.615141855345832) | > loss_feat: 3.8316407203674316 (6.272134635183546) | > loss_mel: 21.88953971862793 (21.433238983154297) | > loss_duration: 1.3295822143554688 (1.340875996483697) | > loss_1: 30.030298233032227 (32.235940085517036) | > grad_norm_1: tensor(8369.6045, device='cuda:0') (tensor(18427.1328, device='cuda:0')) | > current_lr_0: 7.082786425097057e-05 | > current_lr_1: 7.082786425097057e-05 | > step_time: 0.4617 (0.6242107020484077) | > loader_time: 0.0269 (0.023524125417073567)  --> TIME: 2023-10-20 12:53:11 -- STEP: 39/50 -- GLOBAL_STEP: 104940 | > loss_disc: 2.827510118484497 (2.513374218573937) | > loss_disc_real_0: 0.046915121376514435 (0.14061352109106687) | > loss_disc_real_1: 0.168625146150589 (0.23713001245871568) | > loss_disc_real_2: 0.2843218743801117 (0.23397456854581833) | > loss_disc_real_3: 0.2991028428077698 (0.2509132204338526) | > loss_disc_real_4: 0.280118852853775 (0.24535696418621603) | > loss_disc_real_5: 0.18039536476135254 (0.2288597340289599) | > loss_0: 2.827510118484497 (2.513374218573937) | > grad_norm_0: tensor(360.2966, device='cuda:0') (tensor(516.9586, device='cuda:0')) | > loss_gen: 1.9374171495437622 (2.266049171105409) | > loss_kl: 0.8606429696083069 (0.7414143442725524) | > loss_feat: 4.536057949066162 (5.188997261990339) | > loss_mel: 26.137704849243164 (20.024499391898132) | > loss_duration: 1.3622138500213623 (1.3357386803015685) | > loss_1: 34.83403396606445 (29.556698615734394) | > grad_norm_1: tensor(3068.6372, device='cuda:0') (tensor(17308.8320, device='cuda:0')) | > current_lr_0: 7.082786425097057e-05 | > current_lr_1: 7.082786425097057e-05 | > step_time: 0.8043 (0.6287886546208308) | > loader_time: 0.0244 (0.023079046836266152)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6537275314331055 (2.6537275314331055) | > loss_disc_real_0: 0.22433675825595856 (0.22433675825595856) | > loss_disc_real_1: 0.21944794058799744 (0.21944794058799744) | > loss_disc_real_2: 0.264482706785202 (0.264482706785202) | > loss_disc_real_3: 0.2818134129047394 (0.2818134129047394) | > loss_disc_real_4: 0.28386345505714417 (0.28386345505714417) | > loss_disc_real_5: 0.4011021554470062 (0.4011021554470062) | > loss_0: 2.6537275314331055 (2.6537275314331055) | > loss_gen: 2.5494723320007324 (2.5494723320007324) | > loss_kl: 5.432843208312988 (5.432843208312988) | > loss_feat: 7.4366254806518555 (7.4366254806518555) | > loss_mel: 22.050573348999023 (22.050573348999023) | > loss_duration: 3.040369749069214 (3.040369749069214) | > loss_1: 40.5098876953125 (40.5098876953125)  --> STEP: 1 | > loss_disc: 2.381294012069702 (2.381294012069702) | > loss_disc_real_0: 0.06194913759827614 (0.06194913759827614) | > loss_disc_real_1: 0.34014567732810974 (0.34014567732810974) | > loss_disc_real_2: 0.26638132333755493 (0.26638132333755493) | > loss_disc_real_3: 0.2957158386707306 (0.2957158386707306) | > loss_disc_real_4: 0.27164384722709656 (0.27164384722709656) | > loss_disc_real_5: 0.17524270713329315 (0.17524270713329315) | > loss_0: 2.381294012069702 (2.381294012069702) | > loss_gen: 2.4910192489624023 (2.4910192489624023) | > loss_kl: 4.6341938972473145 (4.6341938972473145) | > loss_feat: 6.859224319458008 (6.859224319458008) | > loss_mel: 23.996822357177734 (23.996822357177734) | > loss_duration: 3.3901009559631348 (3.3901009559631348) | > loss_1: 41.37136459350586 (41.37136459350586)  --> STEP: 2 | > loss_disc: 2.5157699584960938 (2.448531985282898) | > loss_disc_real_0: 0.2894102931022644 (0.17567971535027027) | > loss_disc_real_1: 0.3663935959339142 (0.35326963663101196) | > loss_disc_real_2: 0.2861146032810211 (0.276247963309288) | > loss_disc_real_3: 0.3879104256629944 (0.3418131321668625) | > loss_disc_real_4: 0.12851200997829437 (0.20007792860269547) | > loss_disc_real_5: 0.2142101526260376 (0.19472642987966537) | > loss_0: 2.5157699584960938 (2.448531985282898) | > loss_gen: 2.88860821723938 (2.689813733100891) | > loss_kl: 5.382539749145508 (5.008366823196411) | > loss_feat: 7.767359733581543 (7.313292026519775) | > loss_mel: 22.66624641418457 (23.331534385681152) | > loss_duration: 3.2605948448181152 (3.325347900390625) | > loss_1: 41.96534729003906 (41.66835594177246)  --> STEP: 3 | > loss_disc: 3.2221195697784424 (2.7063945134480796) | > loss_disc_real_0: 0.5722347497940063 (0.3078647268315156) | > loss_disc_real_1: 0.31360238790512085 (0.3400472203890483) | > loss_disc_real_2: 0.2072148472070694 (0.25323692460854846) | > loss_disc_real_3: 0.3897550106048584 (0.35779375831286114) | > loss_disc_real_4: 0.3192662000656128 (0.2398073524236679) | > loss_disc_real_5: 0.3045763075351715 (0.23134305576483408) | > loss_0: 3.2221195697784424 (2.7063945134480796) | > loss_gen: 2.591370105743408 (2.656999190648397) | > loss_kl: 2.684735059738159 (4.23382290204366) | > loss_feat: 4.234817028045654 (6.287133693695068) | > loss_mel: 19.727210998535156 (22.130093256632488) | > loss_duration: 3.0629093647003174 (3.237868388493856) | > loss_1: 32.30104064941406 (38.54591751098633) --> EVAL PERFORMANCE | > avg_loader_time: 0.035761515299479164 (+0.0008343060811360631) | > avg_loss_disc: 2.7063945134480796 (+0.5626710255940757) | > avg_loss_disc_real_0: 0.3078647268315156 (+0.11413824061552683) | > avg_loss_disc_real_1: 0.3400472203890483 (+0.08105937639872235) | > avg_loss_disc_real_2: 0.25323692460854846 (+0.02497092882792154) | > avg_loss_disc_real_3: 0.35779375831286114 (+0.13818347081542018) | > avg_loss_disc_real_4: 0.2398073524236679 (+0.013822905719280243) | > avg_loss_disc_real_5: 0.23134305576483408 (-0.0019741648187240057) | > avg_loss_0: 2.7063945134480796 (+0.5626710255940757) | > avg_loss_gen: 2.656999190648397 (-0.4112868309020996) | > avg_loss_kl: 4.23382290204366 (-0.2802267074584961) | > avg_loss_feat: 6.287133693695068 (-3.8211851119995117) | > avg_loss_mel: 22.130093256632488 (-0.9919236501057931) | > avg_loss_duration: 3.237868388493856 (+0.007556597391764619) | > avg_loss_1: 38.54591751098633 (-5.497063954671226)  > EPOCH: 1039/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:53:34)   --> TIME: 2023-10-20 12:53:51 -- STEP: 19/50 -- GLOBAL_STEP: 104970 | > loss_disc: 1.4921129941940308 (2.43678501405214) | > loss_disc_real_0: 0.0344645231962204 (0.12395444120231425) | > loss_disc_real_1: 0.18855208158493042 (0.21793427063446297) | > loss_disc_real_2: 0.18609219789505005 (0.23146383184939623) | > loss_disc_real_3: 0.08622515946626663 (0.23272355841962913) | > loss_disc_real_4: 0.15718042850494385 (0.22479167747262277) | > loss_disc_real_5: 0.1332826465368271 (0.24365670880989024) | > loss_0: 1.4921129941940308 (2.43678501405214) | > grad_norm_0: tensor(183.3497, device='cuda:0') (tensor(534.4387, device='cuda:0')) | > loss_gen: 3.3700520992279053 (2.3421292869668258) | > loss_kl: 0.9804385900497437 (0.7781921829047956) | > loss_feat: 8.91179370880127 (6.126699646052561) | > loss_mel: 22.389196395874023 (22.602960235194157) | > loss_duration: 1.4688535928726196 (1.3721760009464465) | > loss_1: 37.12033462524414 (33.22215772929945) | > grad_norm_1: tensor(4961.8223, device='cuda:0') (tensor(29036.0195, device='cuda:0')) | > current_lr_0: 7.07570673661646e-05 | > current_lr_1: 7.07570673661646e-05 | > step_time: 0.4974 (0.633017012947484) | > loader_time: 0.0099 (0.02275941246434262)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2264561653137207 (2.2264561653137207) | > loss_disc_real_0: 0.05565408989787102 (0.05565408989787102) | > loss_disc_real_1: 0.2641982138156891 (0.2641982138156891) | > loss_disc_real_2: 0.24922464787960052 (0.24922464787960052) | > loss_disc_real_3: 0.36390018463134766 (0.36390018463134766) | > loss_disc_real_4: 0.3542047441005707 (0.3542047441005707) | > loss_disc_real_5: 0.2988254427909851 (0.2988254427909851) | > loss_0: 2.2264561653137207 (2.2264561653137207) | > loss_gen: 3.2029900550842285 (3.2029900550842285) | > loss_kl: 6.21481466293335 (6.21481466293335) | > loss_feat: 6.3010759353637695 (6.3010759353637695) | > loss_mel: 23.13325309753418 (23.13325309753418) | > loss_duration: 2.9995787143707275 (2.9995787143707275) | > loss_1: 41.851715087890625 (41.851715087890625)  --> STEP: 1 | > loss_disc: 2.4610190391540527 (2.4610190391540527) | > loss_disc_real_0: 0.295553982257843 (0.295553982257843) | > loss_disc_real_1: 0.2989963889122009 (0.2989963889122009) | > loss_disc_real_2: 0.2945830523967743 (0.2945830523967743) | > loss_disc_real_3: 0.3630730211734772 (0.3630730211734772) | > loss_disc_real_4: 0.2817746698856354 (0.2817746698856354) | > loss_disc_real_5: 0.2625230848789215 (0.2625230848789215) | > loss_0: 2.4610190391540527 (2.4610190391540527) | > loss_gen: 3.057117462158203 (3.057117462158203) | > loss_kl: 4.873745918273926 (4.873745918273926) | > loss_feat: 7.132229804992676 (7.132229804992676) | > loss_mel: 26.196218490600586 (26.196218490600586) | > loss_duration: 3.457129955291748 (3.457129955291748) | > loss_1: 44.7164421081543 (44.7164421081543)  --> STEP: 2 | > loss_disc: 1.7521553039550781 (2.1065871715545654) | > loss_disc_real_0: 0.20446255803108215 (0.2500082701444626) | > loss_disc_real_1: 0.088582344353199 (0.19378936663269997) | > loss_disc_real_2: 0.08446794748306274 (0.18952549993991852) | > loss_disc_real_3: 0.2264414131641388 (0.294757217168808) | > loss_disc_real_4: 0.11761420220136642 (0.1996944360435009) | > loss_disc_real_5: 0.0415961854159832 (0.15205963514745235) | > loss_0: 1.7521553039550781 (2.1065871715545654) | > loss_gen: 2.5273091793060303 (2.7922133207321167) | > loss_kl: 5.1963605880737305 (5.035053253173828) | > loss_feat: 12.514930725097656 (9.823580265045166) | > loss_mel: 22.74271583557129 (24.469467163085938) | > loss_duration: 3.259207248687744 (3.358168601989746) | > loss_1: 46.24052810668945 (45.478485107421875)  --> STEP: 3 | > loss_disc: 3.0452141761779785 (2.4194628397623696) | > loss_disc_real_0: 0.590956449508667 (0.3636576632658641) | > loss_disc_real_1: 0.3244905471801758 (0.2373564268151919) | > loss_disc_real_2: 0.23000667989253998 (0.20301922659079233) | > loss_disc_real_3: 0.3087192177772522 (0.29941121737162274) | > loss_disc_real_4: 0.35694798827171326 (0.25211228678623837) | > loss_disc_real_5: 0.25935181975364685 (0.1878236966828505) | > loss_0: 3.0452141761779785 (2.4194628397623696) | > loss_gen: 2.398803949356079 (2.661076863606771) | > loss_kl: 2.648759603500366 (4.239622036616008) | > loss_feat: 5.169865608215332 (8.272342046101889) | > loss_mel: 21.680269241333008 (23.53973452250163) | > loss_duration: 3.093208074569702 (3.269848426183065) | > loss_1: 34.99090576171875 (41.982625325520836)  --> TIME: 2023-10-20 12:54:11 -- STEP: 49/50 -- GLOBAL_STEP: 105000 | > loss_disc: 2.89574933052063 (2.410249617634986) | > loss_disc_real_0: 0.24395504593849182 (0.13622474940303636) | > loss_disc_real_1: 0.34044501185417175 (0.22072924559517781) | > loss_disc_real_2: 0.3732356131076813 (0.23832737371249466) | > loss_disc_real_3: 0.46294382214546204 (0.22233511986477034) | > loss_disc_real_4: 0.37381163239479065 (0.2235030948887674) | > loss_disc_real_5: 0.3970471918582916 (0.2262156557063667) | > loss_0: 2.89574933052063 (2.410249617634986) | > grad_norm_0: tensor(692.0667, device='cuda:0') (tensor(644.9735, device='cuda:0')) | > loss_gen: 2.996652126312256 (2.3492087052792927) | > loss_kl: 0.826880156993866 (0.7131808877599481) | > loss_feat: 4.804150581359863 (5.876160574658793) | > loss_mel: 22.59221076965332 (21.046784870478568) | > loss_duration: 1.430364727973938 (1.3347698352774797) | > loss_1: 32.65026092529297 (31.320104813089177) | > grad_norm_1: tensor(22088.2051, device='cuda:0') (tensor(22989.0449, device='cuda:0')) | > current_lr_0: 7.07570673661646e-05 | > current_lr_1: 7.07570673661646e-05 | > step_time: 1.9077 (0.5272956089097625) | > loader_time: 6.0465 (0.13471026323279556) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_105000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7355759143829346 (2.498491108417511) | > loss_disc_real_0: 0.10423988103866577 (0.2988032177090645) | > loss_disc_real_1: 0.2595232427120209 (0.24289813078939915) | > loss_disc_real_2: 0.42530930042266846 (0.25859174504876137) | > loss_disc_real_3: 0.38247695565223694 (0.3201776519417763) | > loss_disc_real_4: 0.46123042702674866 (0.30439182184636593) | > loss_disc_real_5: 0.3108365535736084 (0.21857691090554) | > loss_0: 2.7355759143829346 (2.498491108417511) | > loss_gen: 2.9184350967407227 (2.725416421890259) | > loss_kl: 6.147731781005859 (4.7166494727134705) | > loss_feat: 6.3653717041015625 (7.795599460601807) | > loss_mel: 21.097959518432617 (22.929290771484375) | > loss_duration: 3.1709415912628174 (3.245121717453003) | > loss_1: 39.700435638427734 (41.41207790374756)  --> STEP: 1 | > loss_disc: 2.2701804637908936 (2.4528289794921876) | > loss_disc_real_0: 0.24417811632156372 (0.28787819743156434) | > loss_disc_real_1: 0.27358031272888184 (0.2490345671772957) | > loss_disc_real_2: 0.25967299938201904 (0.2588079959154129) | > loss_disc_real_3: 0.18077193200588226 (0.2922965079545975) | > loss_disc_real_4: 0.16412372887134552 (0.2763382032513618) | > loss_disc_real_5: 0.05888007581233978 (0.18663754388689996) | > loss_0: 2.2701804637908936 (2.4528289794921876) | > loss_gen: 2.2532124519348145 (2.63097562789917) | > loss_kl: 5.758142471313477 (4.924948072433471) | > loss_feat: 7.511859893798828 (7.738851547241211) | > loss_mel: 24.54852867126465 (23.25313835144043) | > loss_duration: 3.4435269832611084 (3.284802770614624) | > loss_1: 43.5152702331543 (41.832716369628905)  --> STEP: 2 | > loss_disc: 2.014249563217163 (2.3797324101130166) | > loss_disc_real_0: 0.300819456577301 (0.29003507395585376) | > loss_disc_real_1: 0.13435772061347961 (0.22992175941665968) | > loss_disc_real_2: 0.12332841753959656 (0.23622806618611017) | > loss_disc_real_3: 0.21276041865348816 (0.27904049307107925) | > loss_disc_real_4: 0.2560829520225525 (0.2729623280465603) | > loss_disc_real_5: 0.083773173391819 (0.16949348213771978) | > loss_0: 2.014249563217163 (2.3797324101130166) | > loss_gen: 2.996795415878296 (2.6919455925623574) | > loss_kl: 5.869479656219482 (5.082370003064473) | > loss_feat: 10.183982849121094 (8.146373430887857) | > loss_mel: 22.772933959960938 (23.173104286193848) | > loss_duration: 3.3425018787384033 (3.294419288635254) | > loss_1: 45.16569519042969 (42.38821283976237)  --> STEP: 3 | > loss_disc: 2.9032442569732666 (2.454519816807338) | > loss_disc_real_0: 0.7263182401657104 (0.35236124055726187) | > loss_disc_real_1: 0.3456750214099884 (0.2464579397014209) | > loss_disc_real_2: 0.30065014958381653 (0.2454312209572111) | > loss_disc_real_3: 0.2416784167289734 (0.27370305359363556) | > loss_disc_real_4: 0.2547142207622528 (0.2703554555773735) | > loss_disc_real_5: 0.2609003484249115 (0.1825516058930329) | > loss_0: 2.9032442569732666 (2.454519816807338) | > loss_gen: 2.929433822631836 (2.725872482572283) | > loss_kl: 2.717562675476074 (4.744540384837559) | > loss_feat: 4.412192344665527 (7.612918989998954) | > loss_mel: 23.038963317871094 (23.153941290719168) | > loss_duration: 3.0756266117095947 (3.2631631919315884) | > loss_1: 36.17377853393555 (41.50043651035854) --> EVAL PERFORMANCE | > avg_loader_time: 0.3996986321040562 (+0.363937116804577) | > avg_loss_disc: 2.454519816807338 (-0.25187469664074147) | > avg_loss_disc_real_0: 0.35236124055726187 (+0.044496513725746256) | > avg_loss_disc_real_1: 0.2464579397014209 (-0.09358928068762737) | > avg_loss_disc_real_2: 0.2454312209572111 (-0.00780570365133737) | > avg_loss_disc_real_3: 0.27370305359363556 (-0.08409070471922558) | > avg_loss_disc_real_4: 0.2703554555773735 (+0.030548103153705597) | > avg_loss_disc_real_5: 0.1825516058930329 (-0.048791449871801174) | > avg_loss_0: 2.454519816807338 (-0.25187469664074147) | > avg_loss_gen: 2.725872482572283 (+0.06887329192388592) | > avg_loss_kl: 4.744540384837559 (+0.5107174827938987) | > avg_loss_feat: 7.612918989998954 (+1.3257852963038852) | > avg_loss_mel: 23.153941290719168 (+1.0238480340866793) | > avg_loss_duration: 3.2631631919315884 (+0.025294803437732494) | > avg_loss_1: 41.50043651035854 (+2.954518999372212)  > EPOCH: 1040/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:54:25)   --> TIME: 2023-10-20 12:54:48 -- STEP: 29/50 -- GLOBAL_STEP: 105030 | > loss_disc: 2.9686992168426514 (2.2553491304660676) | > loss_disc_real_0: 0.10151316970586777 (0.1306375371099546) | > loss_disc_real_1: 0.2989450693130493 (0.21868439943626009) | > loss_disc_real_2: 0.25351911783218384 (0.22351161197855554) | > loss_disc_real_3: 0.2541672885417938 (0.2356828727984223) | > loss_disc_real_4: 0.23972488939762115 (0.19524447998866953) | > loss_disc_real_5: 0.24829162657260895 (0.20305417982283339) | > loss_0: 2.9686992168426514 (2.2553491304660676) | > grad_norm_0: tensor(1419.0083, device='cuda:0') (tensor(571.1022, device='cuda:0')) | > loss_gen: 1.5996030569076538 (2.5377684256126143) | > loss_kl: 0.7596120238304138 (0.7989025932961497) | > loss_feat: 1.5340651273727417 (7.329407523418295) | > loss_mel: 16.242700576782227 (23.976163601053173) | > loss_duration: 1.358188509941101 (1.3482462085526568) | > loss_1: 21.494169235229492 (35.99048871007458) | > grad_norm_1: tensor(4644.7456, device='cuda:0') (tensor(22997.1250, device='cuda:0')) | > current_lr_0: 7.068634124727753e-05 | > current_lr_1: 7.068634124727753e-05 | > step_time: 0.6042 (0.6293396703128157) | > loader_time: 0.0276 (0.023240574474992424)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4040257930755615 (2.4040257930755615) | > loss_disc_real_0: 0.0821521133184433 (0.0821521133184433) | > loss_disc_real_1: 0.18209731578826904 (0.18209731578826904) | > loss_disc_real_2: 0.26431167125701904 (0.26431167125701904) | > loss_disc_real_3: 0.2338128685951233 (0.2338128685951233) | > loss_disc_real_4: 0.2622210383415222 (0.2622210383415222) | > loss_disc_real_5: 0.20349815487861633 (0.20349815487861633) | > loss_0: 2.4040257930755615 (2.4040257930755615) | > loss_gen: 2.119952917098999 (2.119952917098999) | > loss_kl: 5.406820297241211 (5.406820297241211) | > loss_feat: 8.78072452545166 (8.78072452545166) | > loss_mel: 24.314565658569336 (24.314565658569336) | > loss_duration: 3.1246397495269775 (3.1246397495269775) | > loss_1: 43.7467041015625 (43.7467041015625)  --> STEP: 1 | > loss_disc: 3.103628396987915 (3.103628396987915) | > loss_disc_real_0: 0.2849162220954895 (0.2849162220954895) | > loss_disc_real_1: 0.4066242277622223 (0.4066242277622223) | > loss_disc_real_2: 0.4460678696632385 (0.4460678696632385) | > loss_disc_real_3: 0.22900272905826569 (0.22900272905826569) | > loss_disc_real_4: 0.3233514130115509 (0.3233514130115509) | > loss_disc_real_5: 0.3545083701610565 (0.3545083701610565) | > loss_0: 3.103628396987915 (3.103628396987915) | > loss_gen: 2.267747402191162 (2.267747402191162) | > loss_kl: 5.541463851928711 (5.541463851928711) | > loss_feat: 6.882229804992676 (6.882229804992676) | > loss_mel: 23.814620971679688 (23.814620971679688) | > loss_duration: 3.4369282722473145 (3.4369282722473145) | > loss_1: 41.942989349365234 (41.942989349365234)  --> STEP: 2 | > loss_disc: 3.0163588523864746 (3.059993624687195) | > loss_disc_real_0: 0.49174216389656067 (0.3883291929960251) | > loss_disc_real_1: 0.24781817197799683 (0.32722119987010956) | > loss_disc_real_2: 0.22783592343330383 (0.3369518965482712) | > loss_disc_real_3: 0.26785552501678467 (0.24842912703752518) | > loss_disc_real_4: 0.24623195827007294 (0.2847916856408119) | > loss_disc_real_5: 0.30434679985046387 (0.3294275850057602) | > loss_0: 3.0163588523864746 (3.059993624687195) | > loss_gen: 1.981858253479004 (2.124802827835083) | > loss_kl: 5.766783714294434 (5.654123783111572) | > loss_feat: 0.9818800091743469 (3.9320549070835114) | > loss_mel: 24.000642776489258 (23.907631874084473) | > loss_duration: 3.405709743499756 (3.421319007873535) | > loss_1: 36.136871337890625 (39.03993034362793)  --> STEP: 3 | > loss_disc: 1.92322838306427 (2.6810718774795532) | > loss_disc_real_0: 0.2418019026517868 (0.339486762881279) | > loss_disc_real_1: 0.1823265105485916 (0.27892297009627026) | > loss_disc_real_2: 0.13354645669460297 (0.2691500832637151) | > loss_disc_real_3: 0.16615772247314453 (0.22100532551606497) | > loss_disc_real_4: 0.1431543081998825 (0.23757922649383545) | > loss_disc_real_5: 0.16236205399036407 (0.2737390746672948) | > loss_0: 1.92322838306427 (2.6810718774795532) | > loss_gen: 2.606985092163086 (2.2855302492777505) | > loss_kl: 2.5827293395996094 (4.630325635274251) | > loss_feat: 6.420485496520996 (4.76153177022934) | > loss_mel: 24.701927185058594 (24.172396977742512) | > loss_duration: 3.0039937496185303 (3.2822105884552) | > loss_1: 39.31612014770508 (39.13199361165365) --> EVAL PERFORMANCE | > avg_loader_time: 0.002315362294514974 (-0.39738326980954125) | > avg_loss_disc: 2.6810718774795532 (+0.22655206067221512) | > avg_loss_disc_real_0: 0.339486762881279 (-0.012874477675982876) | > avg_loss_disc_real_1: 0.27892297009627026 (+0.032465030394849353) | > avg_loss_disc_real_2: 0.2691500832637151 (+0.023718862306503996) | > avg_loss_disc_real_3: 0.22100532551606497 (-0.05269772807757059) | > avg_loss_disc_real_4: 0.23757922649383545 (-0.032776229083538055) | > avg_loss_disc_real_5: 0.2737390746672948 (+0.0911874687742619) | > avg_loss_0: 2.6810718774795532 (+0.22655206067221512) | > avg_loss_gen: 2.2855302492777505 (-0.44034223329453237) | > avg_loss_kl: 4.630325635274251 (-0.1142147495633079) | > avg_loss_feat: 4.76153177022934 (-2.851387219769614) | > avg_loss_mel: 24.172396977742512 (+1.0184556870233443) | > avg_loss_duration: 3.2822105884552 (+0.01904739652361176) | > avg_loss_1: 39.13199361165365 (-2.3684428987048918)  > EPOCH: 1041/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:55:17)   --> TIME: 2023-10-20 12:55:27 -- STEP: 9/50 -- GLOBAL_STEP: 105060 | > loss_disc: 2.0317137241363525 (2.162436326344808) | > loss_disc_real_0: 0.15118056535720825 (0.10528383693761295) | > loss_disc_real_1: 0.24063274264335632 (0.1818680531448788) | > loss_disc_real_2: 0.20129211246967316 (0.17356564021772808) | > loss_disc_real_3: 0.22079689800739288 (0.19410972690416706) | > loss_disc_real_4: 0.17073746025562286 (0.15522094226131836) | > loss_disc_real_5: 0.08882220834493637 (0.17783987687693703) | > loss_0: 2.0317137241363525 (2.162436326344808) | > grad_norm_0: tensor(374.5835, device='cuda:0') (tensor(428.4076, device='cuda:0')) | > loss_gen: 2.564453601837158 (2.2969524595472546) | > loss_kl: 0.7890685796737671 (0.7303846610916985) | > loss_feat: 5.76701021194458 (7.358025696542528) | > loss_mel: 21.53130340576172 (20.770800431569416) | > loss_duration: 1.3411774635314941 (1.3740636375215318) | > loss_1: 31.993013381958008 (32.530227555169) | > grad_norm_1: tensor(3089.9175, device='cuda:0') (tensor(12182.6641, device='cuda:0')) | > current_lr_0: 7.06156858235744e-05 | > current_lr_1: 7.06156858235744e-05 | > step_time: 0.3778 (0.6128223472171359) | > loader_time: 0.0071 (0.01189520623948839)  --> TIME: 2023-10-20 12:55:46 -- STEP: 39/50 -- GLOBAL_STEP: 105090 | > loss_disc: 1.5561456680297852 (2.4873565007478757) | > loss_disc_real_0: 0.05195469781756401 (0.14530029014135018) | > loss_disc_real_1: 0.052736297249794006 (0.22294749797154695) | > loss_disc_real_2: 0.0660727396607399 (0.22175323810332861) | > loss_disc_real_3: 0.09407265484333038 (0.23487326383399657) | > loss_disc_real_4: 0.01811772771179676 (0.22626717486538184) | > loss_disc_real_5: 0.004539486486464739 (0.24276634383325776) | > loss_0: 1.5561456680297852 (2.4873565007478757) | > grad_norm_0: tensor(1000.4051, device='cuda:0') (tensor(525.7880, device='cuda:0')) | > loss_gen: 2.4299914836883545 (2.222043312512911) | > loss_kl: 0.48262345790863037 (0.872005921907914) | > loss_feat: 11.504668235778809 (5.794675417435475) | > loss_mel: 23.501319885253906 (20.540412811132573) | > loss_duration: 1.3973195552825928 (1.3500218849915724) | > loss_1: 39.315921783447266 (30.779159509218655) | > grad_norm_1: tensor(25581.6426, device='cuda:0') (tensor(13420.6729, device='cuda:0')) | > current_lr_0: 7.06156858235744e-05 | > current_lr_1: 7.06156858235744e-05 | > step_time: 0.4935 (0.6260738128270859) | > loader_time: 0.0037 (0.020591167303232048)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1058497428894043 (2.1058497428894043) | > loss_disc_real_0: 0.04645170643925667 (0.04645170643925667) | > loss_disc_real_1: 0.23595254123210907 (0.23595254123210907) | > loss_disc_real_2: 0.34525471925735474 (0.34525471925735474) | > loss_disc_real_3: 0.25325682759284973 (0.25325682759284973) | > loss_disc_real_4: 0.26511281728744507 (0.26511281728744507) | > loss_disc_real_5: 0.16249005496501923 (0.16249005496501923) | > loss_0: 2.1058497428894043 (2.1058497428894043) | > loss_gen: 2.733459234237671 (2.733459234237671) | > loss_kl: 6.890400409698486 (6.890400409698486) | > loss_feat: 9.275174140930176 (9.275174140930176) | > loss_mel: 24.859718322753906 (24.859718322753906) | > loss_duration: 3.2304935455322266 (3.2304935455322266) | > loss_1: 46.98924255371094 (46.98924255371094)  --> STEP: 1 | > loss_disc: 2.8811986446380615 (2.8811986446380615) | > loss_disc_real_0: 0.14538635313510895 (0.14538635313510895) | > loss_disc_real_1: 0.2622799575328827 (0.2622799575328827) | > loss_disc_real_2: 0.2532292306423187 (0.2532292306423187) | > loss_disc_real_3: 0.26403671503067017 (0.26403671503067017) | > loss_disc_real_4: 0.2495357096195221 (0.2495357096195221) | > loss_disc_real_5: 0.28087738156318665 (0.28087738156318665) | > loss_0: 2.8811986446380615 (2.8811986446380615) | > loss_gen: 1.5809075832366943 (1.5809075832366943) | > loss_kl: 5.542830467224121 (5.542830467224121) | > loss_feat: 0.3164329528808594 (0.3164329528808594) | > loss_mel: 12.269231796264648 (12.269231796264648) | > loss_duration: 3.3859610557556152 (3.3859610557556152) | > loss_1: 23.09536361694336 (23.09536361694336)  --> STEP: 2 | > loss_disc: 3.37092924118042 (3.1260639429092407) | > loss_disc_real_0: 0.11741305887699127 (0.1313997060060501) | > loss_disc_real_1: 0.23690658807754517 (0.24959327280521393) | > loss_disc_real_2: 0.27690887451171875 (0.26506905257701874) | > loss_disc_real_3: 0.34226009249687195 (0.30314840376377106) | > loss_disc_real_4: 0.226991206407547 (0.23826345801353455) | > loss_disc_real_5: 0.22585192322731018 (0.2533646523952484) | > loss_0: 3.37092924118042 (3.1260639429092407) | > loss_gen: 1.3786675930023193 (1.4797875881195068) | > loss_kl: 5.691455364227295 (5.617142915725708) | > loss_feat: 7.684818267822266 (4.0006256103515625) | > loss_mel: 23.889297485351562 (18.079264640808105) | > loss_duration: 3.271500587463379 (3.328730821609497) | > loss_1: 41.91573715209961 (32.505550384521484)  --> STEP: 3 | > loss_disc: 2.0590779781341553 (2.770401954650879) | > loss_disc_real_0: 0.28445860743522644 (0.18241933981577554) | > loss_disc_real_1: 0.27229318022727966 (0.25715990861256915) | > loss_disc_real_2: 0.2775605618953705 (0.2692328890164693) | > loss_disc_real_3: 0.25868353247642517 (0.28832678000132245) | > loss_disc_real_4: 0.20653903484344482 (0.2276886502901713) | > loss_disc_real_5: 0.22912082076072693 (0.24528337518374124) | > loss_0: 2.0590779781341553 (2.770401954650879) | > loss_gen: 3.5316152572631836 (2.1637301445007324) | > loss_kl: 2.7112247943878174 (4.648503541946411) | > loss_feat: 7.014927387237549 (5.005392869313558) | > loss_mel: 21.58442497253418 (19.24765141805013) | > loss_duration: 3.0537569522857666 (3.2370728651682534) | > loss_1: 37.89595031738281 (34.30235036214193) --> EVAL PERFORMANCE | > avg_loader_time: 0.01165310541788737 (+0.009337743123372395) | > avg_loss_disc: 2.770401954650879 (+0.08933007717132568) | > avg_loss_disc_real_0: 0.18241933981577554 (-0.15706742306550345) | > avg_loss_disc_real_1: 0.25715990861256915 (-0.021763061483701107) | > avg_loss_disc_real_2: 0.2692328890164693 (+8.280575275421143e-05) | > avg_loss_disc_real_3: 0.28832678000132245 (+0.06732145448525748) | > avg_loss_disc_real_4: 0.2276886502901713 (-0.009890576203664153) | > avg_loss_disc_real_5: 0.24528337518374124 (-0.02845569948355356) | > avg_loss_0: 2.770401954650879 (+0.08933007717132568) | > avg_loss_gen: 2.1637301445007324 (-0.12180010477701808) | > avg_loss_kl: 4.648503541946411 (+0.018177906672160127) | > avg_loss_feat: 5.005392869313558 (+0.24386109908421805) | > avg_loss_mel: 19.24765141805013 (-4.924745559692383) | > avg_loss_duration: 3.2370728651682534 (-0.04513772328694676) | > avg_loss_1: 34.30235036214193 (-4.829643249511719)  > EPOCH: 1042/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:56:05)   --> TIME: 2023-10-20 12:56:20 -- STEP: 19/50 -- GLOBAL_STEP: 105120 | > loss_disc: 1.6418538093566895 (2.4247928857803345) | > loss_disc_real_0: 0.061979152262210846 (0.16678035082785705) | > loss_disc_real_1: 0.13416458666324615 (0.21146954478401886) | > loss_disc_real_2: 0.1749269813299179 (0.22428118672810102) | > loss_disc_real_3: 0.10410521924495697 (0.22073696083144137) | > loss_disc_real_4: 0.033448364585638046 (0.20176179687443532) | > loss_disc_real_5: 0.09044893085956573 (0.20854153611550205) | > loss_0: 1.6418538093566895 (2.4247928857803345) | > grad_norm_0: tensor(280.6317, device='cuda:0') (tensor(497.0614, device='cuda:0')) | > loss_gen: 2.471273422241211 (2.199900564394499) | > loss_kl: 1.1932427883148193 (0.7997821051823465) | > loss_feat: 9.445419311523438 (5.570850734059748) | > loss_mel: 24.18680191040039 (18.244944142667872) | > loss_duration: 1.486790657043457 (1.3903698105561106) | > loss_1: 38.78352737426758 (28.20584676140233) | > grad_norm_1: tensor(11234.0439, device='cuda:0') (tensor(22985.2520, device='cuda:0')) | > current_lr_0: 7.054510102439096e-05 | > current_lr_1: 7.054510102439096e-05 | > step_time: 0.501 (0.5137106870350084) | > loader_time: 0.0067 (0.017095892052901417)  --> TIME: 2023-10-20 12:56:32 -- STEP: 49/50 -- GLOBAL_STEP: 105150 | > loss_disc: 2.7883663177490234 (2.3955052896421782) | > loss_disc_real_0: 0.15622134506702423 (0.1499709660111337) | > loss_disc_real_1: 0.26121577620506287 (0.2097589548449127) | > loss_disc_real_2: 0.23022282123565674 (0.2107296063735777) | > loss_disc_real_3: 0.27993854880332947 (0.22783833050302096) | > loss_disc_real_4: 0.3086884021759033 (0.21373792615129936) | > loss_disc_real_5: 0.28017115592956543 (0.2167007500609877) | > loss_0: 2.7883663177490234 (2.3955052896421782) | > grad_norm_0: tensor(595.5314, device='cuda:0') (tensor(503.9785, device='cuda:0')) | > loss_gen: 1.895514965057373 (2.2645687789333118) | > loss_kl: 0.8697645664215088 (0.793444815490927) | > loss_feat: 1.6542414426803589 (5.8466751433300725) | > loss_mel: 18.628320693969727 (19.519405901432034) | > loss_duration: 1.4456864595413208 (1.3434416712546835) | > loss_1: 24.493528366088867 (29.767536328763377) | > grad_norm_1: tensor(6616.0215, device='cuda:0') (tensor(21135.0176, device='cuda:0')) | > current_lr_0: 7.054510102439096e-05 | > current_lr_1: 7.054510102439096e-05 | > step_time: 0.2643 (0.4291489270268654) | > loader_time: 0.4582 (0.021276527521561603)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.343822479248047 (3.343822479248047) | > loss_disc_real_0: 0.7730318903923035 (0.7730318903923035) | > loss_disc_real_1: 0.3037116229534149 (0.3037116229534149) | > loss_disc_real_2: 0.34087949991226196 (0.34087949991226196) | > loss_disc_real_3: 0.39392030239105225 (0.39392030239105225) | > loss_disc_real_4: 0.34356486797332764 (0.34356486797332764) | > loss_disc_real_5: 0.45485278964042664 (0.45485278964042664) | > loss_0: 3.343822479248047 (3.343822479248047) | > loss_gen: 2.9260058403015137 (2.9260058403015137) | > loss_kl: 5.836118698120117 (5.836118698120117) | > loss_feat: 3.99320387840271 (3.99320387840271) | > loss_mel: 21.754377365112305 (21.754377365112305) | > loss_duration: 3.141178607940674 (3.141178607940674) | > loss_1: 37.650882720947266 (37.650882720947266)  --> STEP: 1 | > loss_disc: 2.802736759185791 (2.802736759185791) | > loss_disc_real_0: 0.36326339840888977 (0.36326339840888977) | > loss_disc_real_1: 0.6000787019729614 (0.6000787019729614) | > loss_disc_real_2: 0.3013686239719391 (0.3013686239719391) | > loss_disc_real_3: 0.18455660343170166 (0.18455660343170166) | > loss_disc_real_4: 0.2697925865650177 (0.2697925865650177) | > loss_disc_real_5: 0.2766461968421936 (0.2766461968421936) | > loss_0: 2.802736759185791 (2.802736759185791) | > loss_gen: 2.714390516281128 (2.714390516281128) | > loss_kl: 5.411620140075684 (5.411620140075684) | > loss_feat: 5.991933822631836 (5.991933822631836) | > loss_mel: 23.527605056762695 (23.527605056762695) | > loss_duration: 3.3649368286132812 (3.3649368286132812) | > loss_1: 41.0104866027832 (41.0104866027832)  --> STEP: 2 | > loss_disc: 2.652958869934082 (2.7278478145599365) | > loss_disc_real_0: 0.6155046224594116 (0.4893840104341507) | > loss_disc_real_1: 0.3785812556743622 (0.4893299788236618) | > loss_disc_real_2: 0.2314760982990265 (0.2664223611354828) | > loss_disc_real_3: 0.2855178713798523 (0.23503723740577698) | > loss_disc_real_4: 0.18462742865085602 (0.22721000760793686) | > loss_disc_real_5: 0.21617096662521362 (0.2464085817337036) | > loss_0: 2.652958869934082 (2.7278478145599365) | > loss_gen: 3.0790133476257324 (2.89670193195343) | > loss_kl: 6.398252487182617 (5.90493631362915) | > loss_feat: 9.25230884552002 (7.622121334075928) | > loss_mel: 22.503103256225586 (23.01535415649414) | > loss_duration: 3.369781494140625 (3.367359161376953) | > loss_1: 44.60245895385742 (42.80647277832031)  --> STEP: 3 | > loss_disc: 3.0149741172790527 (2.823556582132975) | > loss_disc_real_0: 0.39942508935928345 (0.45939770340919495) | > loss_disc_real_1: 0.24806222319602966 (0.4089073936144511) | > loss_disc_real_2: 0.27617672085762024 (0.26967381437619525) | > loss_disc_real_3: 0.2563610076904297 (0.24214516083399454) | > loss_disc_real_4: 0.27005964517593384 (0.2414932201306025) | > loss_disc_real_5: 0.2875126600265503 (0.2601099411646525) | > loss_0: 3.0149741172790527 (2.823556582132975) | > loss_gen: 1.774461030960083 (2.5226216316223145) | > loss_kl: 2.4485599994659424 (4.752810875574748) | > loss_feat: 0.09702015668153763 (5.113754274944465) | > loss_mel: 2.1595277786254883 (16.063412030537922) | > loss_duration: 2.9978301525115967 (3.244182825088501) | > loss_1: 9.477398872375488 (31.696781476338703) --> EVAL PERFORMANCE | > avg_loader_time: 0.024480263392130535 (+0.012827157974243166) | > avg_loss_disc: 2.823556582132975 (+0.053154627482096206) | > avg_loss_disc_real_0: 0.45939770340919495 (+0.27697836359341943) | > avg_loss_disc_real_1: 0.4089073936144511 (+0.15174748500188195) | > avg_loss_disc_real_2: 0.26967381437619525 (+0.00044092535972595215) | > avg_loss_disc_real_3: 0.24214516083399454 (-0.04618161916732791) | > avg_loss_disc_real_4: 0.2414932201306025 (+0.013804569840431213) | > avg_loss_disc_real_5: 0.2601099411646525 (+0.014826565980911283) | > avg_loss_0: 2.823556582132975 (+0.053154627482096206) | > avg_loss_gen: 2.5226216316223145 (+0.35889148712158203) | > avg_loss_kl: 4.752810875574748 (+0.10430733362833688) | > avg_loss_feat: 5.113754274944465 (+0.10836140563090702) | > avg_loss_mel: 16.063412030537922 (-3.184239387512207) | > avg_loss_duration: 3.244182825088501 (+0.007109959920247544) | > avg_loss_1: 31.696781476338703 (-2.605568885803226)  > EPOCH: 1043/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:56:52)   --> TIME: 2023-10-20 12:57:18 -- STEP: 29/50 -- GLOBAL_STEP: 105180 | > loss_disc: 2.088834524154663 (2.421778308934179) | > loss_disc_real_0: 0.08455976843833923 (0.14988380815063057) | > loss_disc_real_1: 0.13783684372901917 (0.22201255786007848) | > loss_disc_real_2: 0.1624697893857956 (0.2333408915277185) | > loss_disc_real_3: 0.2733513414859772 (0.251599732336813) | > loss_disc_real_4: 0.1152319461107254 (0.22904694260194383) | > loss_disc_real_5: 0.12052259594202042 (0.215872578804606) | > loss_0: 2.088834524154663 (2.421778308934179) | > grad_norm_0: tensor(333.5993, device='cuda:0') (tensor(554.1720, device='cuda:0')) | > loss_gen: 2.1907215118408203 (2.3077589931159186) | > loss_kl: 0.6504815816879272 (0.8396920736493736) | > loss_feat: 6.264043807983398 (5.305969833332146) | > loss_mel: 24.068557739257812 (18.618912568380097) | > loss_duration: 1.3531113862991333 (1.341802379180645) | > loss_1: 34.52691650390625 (28.414135308101258) | > grad_norm_1: tensor(5136.3213, device='cuda:0') (tensor(27390.5938, device='cuda:0')) | > current_lr_0: 7.047458677913359e-05 | > current_lr_1: 7.047458677913359e-05 | > step_time: 0.8152 (0.6313460284265978) | > loader_time: 0.0273 (0.018837715017384495)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.675493001937866 (2.675493001937866) | > loss_disc_real_0: 0.39096230268478394 (0.39096230268478394) | > loss_disc_real_1: 0.2559686005115509 (0.2559686005115509) | > loss_disc_real_2: 0.338429719209671 (0.338429719209671) | > loss_disc_real_3: 0.326710969209671 (0.326710969209671) | > loss_disc_real_4: 0.277809202671051 (0.277809202671051) | > loss_disc_real_5: 0.11505725979804993 (0.11505725979804993) | > loss_0: 2.675493001937866 (2.675493001937866) | > loss_gen: 2.609666585922241 (2.609666585922241) | > loss_kl: 5.839043617248535 (5.839043617248535) | > loss_feat: 6.3701958656311035 (6.3701958656311035) | > loss_mel: 23.667131423950195 (23.667131423950195) | > loss_duration: 3.0178894996643066 (3.0178894996643066) | > loss_1: 41.503929138183594 (41.503929138183594)  --> STEP: 1 | > loss_disc: 2.3286185264587402 (2.3286185264587402) | > loss_disc_real_0: 0.13026444613933563 (0.13026444613933563) | > loss_disc_real_1: 0.12097293883562088 (0.12097293883562088) | > loss_disc_real_2: 0.24174317717552185 (0.24174317717552185) | > loss_disc_real_3: 0.08174954354763031 (0.08174954354763031) | > loss_disc_real_4: 0.2836516499519348 (0.2836516499519348) | > loss_disc_real_5: 0.372231662273407 (0.372231662273407) | > loss_0: 2.3286185264587402 (2.3286185264587402) | > loss_gen: 2.3446743488311768 (2.3446743488311768) | > loss_kl: 5.29490327835083 (5.29490327835083) | > loss_feat: 9.461786270141602 (9.461786270141602) | > loss_mel: 24.623394012451172 (24.623394012451172) | > loss_duration: 3.368096351623535 (3.368096351623535) | > loss_1: 45.09284973144531 (45.09284973144531)  --> STEP: 2 | > loss_disc: 2.6187503337860107 (2.4736844301223755) | > loss_disc_real_0: 0.5814762115478516 (0.3558703288435936) | > loss_disc_real_1: 0.2422657161951065 (0.1816193275153637) | > loss_disc_real_2: 0.3134880065917969 (0.27761559188365936) | > loss_disc_real_3: 0.11382199823856354 (0.09778577089309692) | > loss_disc_real_4: 0.22127264738082886 (0.25246214866638184) | > loss_disc_real_5: 0.336394339799881 (0.354313001036644) | > loss_0: 2.6187503337860107 (2.4736844301223755) | > loss_gen: 2.753502607345581 (2.549088478088379) | > loss_kl: 5.971167087554932 (5.633035182952881) | > loss_feat: 9.567034721374512 (9.514410495758057) | > loss_mel: 27.937355041503906 (26.28037452697754) | > loss_duration: 3.328752040863037 (3.348424196243286) | > loss_1: 49.55780792236328 (47.3253288269043)  --> STEP: 3 | > loss_disc: 3.031228542327881 (2.6595324675242105) | > loss_disc_real_0: 0.3108287453651428 (0.34085646768411) | > loss_disc_real_1: 0.25683221220970154 (0.20669028908014297) | > loss_disc_real_2: 0.26694613695144653 (0.27405910690625507) | > loss_disc_real_3: 0.25514277815818787 (0.15023810664812723) | > loss_disc_real_4: 0.2809602916240692 (0.26196152965227765) | > loss_disc_real_5: 0.33939093351364136 (0.34933897852897644) | > loss_0: 3.031228542327881 (2.6595324675242105) | > loss_gen: 1.7014617919921875 (2.2665462493896484) | > loss_kl: 2.305166006088257 (4.52374545733134) | > loss_feat: 0.02242281846702099 (6.350414603327711) | > loss_mel: 1.9396036863327026 (18.166784246762592) | > loss_duration: 3.008267402648926 (3.2350385983784995) | > loss_1: 8.976921081542969 (34.54252624511719) --> EVAL PERFORMANCE | > avg_loader_time: 0.012370109558105469 (-0.012110153834025066) | > avg_loss_disc: 2.6595324675242105 (-0.16402411460876465) | > avg_loss_disc_real_0: 0.34085646768411 (-0.11854123572508496) | > avg_loss_disc_real_1: 0.20669028908014297 (-0.20221710453430813) | > avg_loss_disc_real_2: 0.27405910690625507 (+0.0043852925300598145) | > avg_loss_disc_real_3: 0.15023810664812723 (-0.09190705418586731) | > avg_loss_disc_real_4: 0.26196152965227765 (+0.020468309521675138) | > avg_loss_disc_real_5: 0.34933897852897644 (+0.08922903736432392) | > avg_loss_0: 2.6595324675242105 (-0.16402411460876465) | > avg_loss_gen: 2.2665462493896484 (-0.256075382232666) | > avg_loss_kl: 4.52374545733134 (-0.2290654182434082) | > avg_loss_feat: 6.350414603327711 (+1.2366603283832465) | > avg_loss_mel: 18.166784246762592 (+2.1033722162246704) | > avg_loss_duration: 3.2350385983784995 (-0.00914422671000148) | > avg_loss_1: 34.54252624511719 (+2.8457447687784843)  > EPOCH: 1044/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:57:47)   --> TIME: 2023-10-20 12:57:59 -- STEP: 9/50 -- GLOBAL_STEP: 105210 | > loss_disc: 2.9498729705810547 (2.4892369641198053) | > loss_disc_real_0: 0.18729938566684723 (0.17038552628623116) | > loss_disc_real_1: 0.29716619849205017 (0.24691221863031387) | > loss_disc_real_2: 0.28890183568000793 (0.2549173997508155) | > loss_disc_real_3: 0.27450206875801086 (0.24319265286127725) | > loss_disc_real_4: 0.26583829522132874 (0.27317339844173855) | > loss_disc_real_5: 0.286967009305954 (0.29390852484438157) | > loss_0: 2.9498729705810547 (2.4892369641198053) | > grad_norm_0: tensor(1461.0100, device='cuda:0') (tensor(837.0665, device='cuda:0')) | > loss_gen: 1.7060880661010742 (2.4333907630708485) | > loss_kl: 1.0138776302337646 (0.8201074451208115) | > loss_feat: 0.3357439339160919 (5.594891220331192) | > loss_mel: 16.758440017700195 (20.17069541083442) | > loss_duration: 1.344061017036438 (1.3491010400984023) | > loss_1: 21.1582088470459 (30.36818610297309) | > grad_norm_1: tensor(11299.6240, device='cuda:0') (tensor(13878.9785, device='cuda:0')) | > current_lr_0: 7.040414301727917e-05 | > current_lr_1: 7.040414301727917e-05 | > step_time: 0.3582 (0.6205061276753744) | > loader_time: 0.0042 (0.020851744545830622)  --> TIME: 2023-10-20 12:58:11 -- STEP: 39/50 -- GLOBAL_STEP: 105240 | > loss_disc: 2.77127742767334 (2.461123225016472) | > loss_disc_real_0: 0.2422720044851303 (0.16406006862719855) | > loss_disc_real_1: 0.34398210048675537 (0.22472393187956932) | > loss_disc_real_2: 0.3499918282032013 (0.22543195778360733) | > loss_disc_real_3: 0.3226590156555176 (0.24023254932119295) | > loss_disc_real_4: 0.2584451735019684 (0.22479354819426164) | > loss_disc_real_5: 0.16764244437217712 (0.24802419624458522) | > loss_0: 2.77127742767334 (2.461123225016472) | > grad_norm_0: tensor(651.0889, device='cuda:0') (tensor(687.9252, device='cuda:0')) | > loss_gen: 2.103714942932129 (2.279155214627583) | > loss_kl: 0.5416212677955627 (0.7892045019528805) | > loss_feat: 3.1381778717041016 (5.462785049198339) | > loss_mel: 18.050281524658203 (19.480694726491585) | > loss_duration: 1.4945592880249023 (1.337989097986466) | > loss_1: 25.328353881835938 (29.34982876899915) | > grad_norm_1: tensor(13218.3633, device='cuda:0') (tensor(16532.8555, device='cuda:0')) | > current_lr_0: 7.040414301727917e-05 | > current_lr_1: 7.040414301727917e-05 | > step_time: 0.3919 (0.45604375081184584) | > loader_time: 0.0047 (0.012934531920995468)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6540510654449463 (2.6540510654449463) | > loss_disc_real_0: 0.23660990595817566 (0.23660990595817566) | > loss_disc_real_1: 0.24442580342292786 (0.24442580342292786) | > loss_disc_real_2: 0.22277683019638062 (0.22277683019638062) | > loss_disc_real_3: 0.1879897117614746 (0.1879897117614746) | > loss_disc_real_4: 0.19264358282089233 (0.19264358282089233) | > loss_disc_real_5: 0.1808534413576126 (0.1808534413576126) | > loss_0: 2.6540510654449463 (2.6540510654449463) | > loss_gen: 1.7943294048309326 (1.7943294048309326) | > loss_kl: 6.184810638427734 (6.184810638427734) | > loss_feat: 2.6736056804656982 (2.6736056804656982) | > loss_mel: 19.490907669067383 (19.490907669067383) | > loss_duration: 3.0465829372406006 (3.0465829372406006) | > loss_1: 33.19023513793945 (33.19023513793945)  --> STEP: 1 | > loss_disc: 2.87247896194458 (2.87247896194458) | > loss_disc_real_0: 0.28801584243774414 (0.28801584243774414) | > loss_disc_real_1: 0.2428325116634369 (0.2428325116634369) | > loss_disc_real_2: 0.3093949854373932 (0.3093949854373932) | > loss_disc_real_3: 0.2792944610118866 (0.2792944610118866) | > loss_disc_real_4: 0.25871142745018005 (0.25871142745018005) | > loss_disc_real_5: 0.29916152358055115 (0.29916152358055115) | > loss_0: 2.87247896194458 (2.87247896194458) | > loss_gen: 1.8873825073242188 (1.8873825073242188) | > loss_kl: 5.071653842926025 (5.071653842926025) | > loss_feat: 0.9730144143104553 (0.9730144143104553) | > loss_mel: 18.703407287597656 (18.703407287597656) | > loss_duration: 3.2744300365448 (3.2744300365448) | > loss_1: 29.909887313842773 (29.909887313842773)  --> STEP: 2 | > loss_disc: 2.866135358810425 (2.8693071603775024) | > loss_disc_real_0: 0.07843422889709473 (0.18322503566741943) | > loss_disc_real_1: 0.21481607854366302 (0.22882429510354996) | > loss_disc_real_2: 0.2923233211040497 (0.30085915327072144) | > loss_disc_real_3: 0.23708093166351318 (0.2581876963376999) | > loss_disc_real_4: 0.2535727918148041 (0.25614210963249207) | > loss_disc_real_5: 0.29617375135421753 (0.29766763746738434) | > loss_0: 2.866135358810425 (2.8693071603775024) | > loss_gen: 1.5499939918518066 (1.7186882495880127) | > loss_kl: 5.528443813323975 (5.300048828125) | > loss_feat: 0.887637197971344 (0.9303258061408997) | > loss_mel: 14.10055160522461 (16.401979446411133) | > loss_duration: 3.3512487411499023 (3.312839388847351) | > loss_1: 25.41787338256836 (27.663880348205566)  --> STEP: 3 | > loss_disc: 2.989570140838623 (2.9093948205312095) | > loss_disc_real_0: 0.30043667554855347 (0.2222955822944641) | > loss_disc_real_1: 0.2627187967300415 (0.24012246231238046) | > loss_disc_real_2: 0.25756826996803284 (0.2864288588364919) | > loss_disc_real_3: 0.3306178152561188 (0.28233106931050617) | > loss_disc_real_4: 0.33196237683296204 (0.28141553203264874) | > loss_disc_real_5: 0.39002156257629395 (0.3284522791703542) | > loss_0: 2.989570140838623 (2.9093948205312095) | > loss_gen: 2.3596303462982178 (1.932335615158081) | > loss_kl: 2.7011499404907227 (4.433749198913574) | > loss_feat: 4.064540386199951 (1.9750639994939168) | > loss_mel: 20.032629013061523 (17.61219596862793) | > loss_duration: 2.9681921005249023 (3.1979569594065347) | > loss_1: 32.12614059448242 (29.15130043029785) --> EVAL PERFORMANCE | > avg_loader_time: 0.008111317952473959 (-0.00425879160563151) | > avg_loss_disc: 2.9093948205312095 (+0.249862353006999) | > avg_loss_disc_real_0: 0.2222955822944641 (-0.11856088538964588) | > avg_loss_disc_real_1: 0.24012246231238046 (+0.03343217323223749) | > avg_loss_disc_real_2: 0.2864288588364919 (+0.012369751930236816) | > avg_loss_disc_real_3: 0.28233106931050617 (+0.13209296266237894) | > avg_loss_disc_real_4: 0.28141553203264874 (+0.019454002380371094) | > avg_loss_disc_real_5: 0.3284522791703542 (-0.02088669935862225) | > avg_loss_0: 2.9093948205312095 (+0.249862353006999) | > avg_loss_gen: 1.932335615158081 (-0.3342106342315674) | > avg_loss_kl: 4.433749198913574 (-0.0899962584177656) | > avg_loss_feat: 1.9750639994939168 (-4.375350603833795) | > avg_loss_mel: 17.61219596862793 (-0.5545882781346627) | > avg_loss_duration: 3.1979569594065347 (-0.037081638971964814) | > avg_loss_1: 29.15130043029785 (-5.391225814819336)  > EPOCH: 1045/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:58:39)   --> TIME: 2023-10-20 12:58:58 -- STEP: 19/50 -- GLOBAL_STEP: 105270 | > loss_disc: 2.9286415576934814 (2.498441777731243) | > loss_disc_real_0: 0.2656717896461487 (0.1651591739960407) | > loss_disc_real_1: 0.26528677344322205 (0.22532443819861664) | > loss_disc_real_2: 0.23919235169887543 (0.229963032626792) | > loss_disc_real_3: 0.24617837369441986 (0.22102708212639155) | > loss_disc_real_4: 0.26225635409355164 (0.228700046280497) | > loss_disc_real_5: 0.3080725073814392 (0.24463629418689953) | > loss_0: 2.9286415576934814 (2.498441777731243) | > grad_norm_0: tensor(403.5211, device='cuda:0') (tensor(724.3798, device='cuda:0')) | > loss_gen: 1.6587464809417725 (2.285905643513328) | > loss_kl: 0.7065171599388123 (0.7521045850099701) | > loss_feat: 0.3428409695625305 (5.897269861478555) | > loss_mel: 4.1482343673706055 (20.17696980426186) | > loss_duration: 1.4595752954483032 (1.3728574702614231) | > loss_1: 8.31591510772705 (30.485107346584922) | > grad_norm_1: tensor(51805.1836, device='cuda:0') (tensor(17984.7695, device='cuda:0')) | > current_lr_0: 7.033376966837518e-05 | > current_lr_1: 7.033376966837518e-05 | > step_time: 0.6729 (0.614852604113127) | > loader_time: 0.0234 (0.02282832798204924)  --> TIME: 2023-10-20 12:59:18 -- STEP: 49/50 -- GLOBAL_STEP: 105300 | > loss_disc: 2.7222161293029785 (2.507036150718222) | > loss_disc_real_0: 0.05372028797864914 (0.15503292198159865) | > loss_disc_real_1: 0.2571325898170471 (0.22398359714342014) | > loss_disc_real_2: 0.322469025850296 (0.23061702457465688) | > loss_disc_real_3: 0.200706347823143 (0.23209715216439597) | > loss_disc_real_4: 0.33488643169403076 (0.24277381165599338) | > loss_disc_real_5: 0.3403919041156769 (0.2541343550939037) | > loss_0: 2.7222161293029785 (2.507036150718222) | > grad_norm_0: tensor(477.8902, device='cuda:0') (tensor(706.0073, device='cuda:0')) | > loss_gen: 2.2059850692749023 (2.2516001681892246) | > loss_kl: 0.5707323551177979 (0.7601629998534917) | > loss_feat: 3.865391254425049 (5.348231801116951) | > loss_mel: 23.89421272277832 (19.510989909269373) | > loss_duration: 1.4642376899719238 (1.3413815984920585) | > loss_1: 32.00056076049805 (29.212366892366994) | > grad_norm_1: tensor(9372.2930, device='cuda:0') (tensor(17444.2324, device='cuda:0')) | > current_lr_0: 7.033376966837518e-05 | > current_lr_1: 7.033376966837518e-05 | > step_time: 0.7544 (0.6203442738980663) | > loader_time: 0.417 (0.03132070327291684)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.297034740447998 (3.297034740447998) | > loss_disc_real_0: 0.5729328393936157 (0.5729328393936157) | > loss_disc_real_1: 0.35688209533691406 (0.35688209533691406) | > loss_disc_real_2: 0.39604660868644714 (0.39604660868644714) | > loss_disc_real_3: 0.35119205713272095 (0.35119205713272095) | > loss_disc_real_4: 0.4458809494972229 (0.4458809494972229) | > loss_disc_real_5: 0.37637314200401306 (0.37637314200401306) | > loss_0: 3.297034740447998 (3.297034740447998) | > loss_gen: 2.9513754844665527 (2.9513754844665527) | > loss_kl: 6.1178998947143555 (6.1178998947143555) | > loss_feat: 6.516125202178955 (6.516125202178955) | > loss_mel: 22.269229888916016 (22.269229888916016) | > loss_duration: 2.9877243041992188 (2.9877243041992188) | > loss_1: 40.84235382080078 (40.84235382080078)  --> STEP: 1 | > loss_disc: 2.5860862731933594 (2.5860862731933594) | > loss_disc_real_0: 0.23971882462501526 (0.23971882462501526) | > loss_disc_real_1: 0.40379634499549866 (0.40379634499549866) | > loss_disc_real_2: 0.2999102771282196 (0.2999102771282196) | > loss_disc_real_3: 0.20464061200618744 (0.20464061200618744) | > loss_disc_real_4: 0.2958708703517914 (0.2958708703517914) | > loss_disc_real_5: 0.30573201179504395 (0.30573201179504395) | > loss_0: 2.5860862731933594 (2.5860862731933594) | > loss_gen: 2.667548894882202 (2.667548894882202) | > loss_kl: 4.921854019165039 (4.921854019165039) | > loss_feat: 3.8234879970550537 (3.8234879970550537) | > loss_mel: 22.781803131103516 (22.781803131103516) | > loss_duration: 3.22540020942688 (3.22540020942688) | > loss_1: 37.42009353637695 (37.42009353637695)  --> STEP: 2 | > loss_disc: 2.44773530960083 (2.5169107913970947) | > loss_disc_real_0: 0.32641980051994324 (0.28306931257247925) | > loss_disc_real_1: 0.22345665097236633 (0.3136264979839325) | > loss_disc_real_2: 0.1704152673482895 (0.23516277223825455) | > loss_disc_real_3: 0.262768030166626 (0.2337043210864067) | > loss_disc_real_4: 0.32011568546295166 (0.3079932779073715) | > loss_disc_real_5: 0.2333560585975647 (0.2695440351963043) | > loss_0: 2.44773530960083 (2.5169107913970947) | > loss_gen: 2.808257818222046 (2.737903356552124) | > loss_kl: 6.036300182342529 (5.479077100753784) | > loss_feat: 7.690771102905273 (5.757129549980164) | > loss_mel: 21.574909210205078 (22.178356170654297) | > loss_duration: 3.2737066745758057 (3.2495534420013428) | > loss_1: 41.38394546508789 (39.40201950073242)  --> STEP: 3 | > loss_disc: 2.9786689281463623 (2.670830170313517) | > loss_disc_real_0: 0.29161837697029114 (0.2859190007050832) | > loss_disc_real_1: 0.2267850637435913 (0.2846793532371521) | > loss_disc_real_2: 0.22656355798244476 (0.23229636748631796) | > loss_disc_real_3: 0.24516882002353668 (0.2375258207321167) | > loss_disc_real_4: 0.2540411055088043 (0.29000922044118244) | > loss_disc_real_5: 0.29013535380363464 (0.27640780806541443) | > loss_0: 2.9786689281463623 (2.670830170313517) | > loss_gen: 1.5789334774017334 (2.3515800635019937) | > loss_kl: 2.4269192218780518 (4.46169114112854) | > loss_feat: 0.28835293650627136 (3.934204012155533) | > loss_mel: 15.544244766235352 (19.96698570251465) | > loss_duration: 2.953455686569214 (3.1508541901906333) | > loss_1: 22.791906356811523 (33.86531511942545) --> EVAL PERFORMANCE | > avg_loader_time: 0.0060803890228271484 (-0.0020309289296468105) | > avg_loss_disc: 2.670830170313517 (-0.23856465021769235) | > avg_loss_disc_real_0: 0.2859190007050832 (+0.06362341841061908) | > avg_loss_disc_real_1: 0.2846793532371521 (+0.044556890924771636) | > avg_loss_disc_real_2: 0.23229636748631796 (-0.05413249135017392) | > avg_loss_disc_real_3: 0.2375258207321167 (-0.04480524857838947) | > avg_loss_disc_real_4: 0.29000922044118244 (+0.008593688408533695) | > avg_loss_disc_real_5: 0.27640780806541443 (-0.05204447110493976) | > avg_loss_0: 2.670830170313517 (-0.23856465021769235) | > avg_loss_gen: 2.3515800635019937 (+0.4192444483439126) | > avg_loss_kl: 4.46169114112854 (+0.02794194221496582) | > avg_loss_feat: 3.934204012155533 (+1.959140012661616) | > avg_loss_mel: 19.96698570251465 (+2.3547897338867188) | > avg_loss_duration: 3.1508541901906333 (-0.0471027692159014) | > avg_loss_1: 33.86531511942545 (+4.714014689127602)  > EPOCH: 1046/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 12:59:34)   --> TIME: 2023-10-20 13:00:11 -- STEP: 29/50 -- GLOBAL_STEP: 105330 | > loss_disc: 2.1375136375427246 (2.2339811407286545) | > loss_disc_real_0: 0.0846928134560585 (0.1461808148065004) | > loss_disc_real_1: 0.27084386348724365 (0.21013916181079273) | > loss_disc_real_2: 0.26134192943573 (0.1932476344036645) | > loss_disc_real_3: 0.21772919595241547 (0.22439260177057366) | > loss_disc_real_4: 0.09472129493951797 (0.20117100732850618) | > loss_disc_real_5: 0.3576807975769043 (0.21541333905067936) | > loss_0: 2.1375136375427246 (2.2339811407286545) | > grad_norm_0: tensor(352.6936, device='cuda:0') (tensor(516.0668, device='cuda:0')) | > loss_gen: 2.7204325199127197 (2.5104641338874547) | > loss_kl: 0.555119514465332 (0.8548881082699217) | > loss_feat: 6.337436199188232 (6.452474420697524) | > loss_mel: 22.631704330444336 (19.928348150746576) | > loss_duration: 1.3247270584106445 (1.3491031712499157) | > loss_1: 33.569419860839844 (31.095278115108094) | > grad_norm_1: tensor(4399.4580, device='cuda:0') (tensor(29210.5352, device='cuda:0')) | > current_lr_0: 7.026346666203946e-05 | > current_lr_1: 7.026346666203946e-05 | > step_time: 1.073 (0.611972241566099) | > loader_time: 0.045 (0.025596347348443394)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.74224591255188 (3.74224591255188) | > loss_disc_real_0: 0.8227076530456543 (0.8227076530456543) | > loss_disc_real_1: 0.34768611192703247 (0.34768611192703247) | > loss_disc_real_2: 0.40111351013183594 (0.40111351013183594) | > loss_disc_real_3: 0.458120733499527 (0.458120733499527) | > loss_disc_real_4: 0.4494591951370239 (0.4494591951370239) | > loss_disc_real_5: 0.4436820447444916 (0.4436820447444916) | > loss_0: 3.74224591255188 (3.74224591255188) | > loss_gen: 2.6285738945007324 (2.6285738945007324) | > loss_kl: 5.558032989501953 (5.558032989501953) | > loss_feat: 3.453547954559326 (3.453547954559326) | > loss_mel: 20.418691635131836 (20.418691635131836) | > loss_duration: 3.094072103500366 (3.094072103500366) | > loss_1: 35.152915954589844 (35.152915954589844)  --> STEP: 1 | > loss_disc: 2.3421666622161865 (2.3421666622161865) | > loss_disc_real_0: 0.35768187046051025 (0.35768187046051025) | > loss_disc_real_1: 0.16538186371326447 (0.16538186371326447) | > loss_disc_real_2: 0.24935665726661682 (0.24935665726661682) | > loss_disc_real_3: 0.17947766184806824 (0.17947766184806824) | > loss_disc_real_4: 0.21627125144004822 (0.21627125144004822) | > loss_disc_real_5: 0.2237769365310669 (0.2237769365310669) | > loss_0: 2.3421666622161865 (2.3421666622161865) | > loss_gen: 2.7419519424438477 (2.7419519424438477) | > loss_kl: 5.5533127784729 (5.5533127784729) | > loss_feat: 6.848092555999756 (6.848092555999756) | > loss_mel: 24.411991119384766 (24.411991119384766) | > loss_duration: 3.397649049758911 (3.397649049758911) | > loss_1: 42.95299530029297 (42.95299530029297)  --> STEP: 2 | > loss_disc: 2.6783676147460938 (2.51026713848114) | > loss_disc_real_0: 0.36769241094589233 (0.3626871407032013) | > loss_disc_real_1: 0.2630411386489868 (0.21421150118112564) | > loss_disc_real_2: 0.2972063422203064 (0.2732814997434616) | > loss_disc_real_3: 0.34707415103912354 (0.2632759064435959) | > loss_disc_real_4: 0.3521536886692047 (0.28421247005462646) | > loss_disc_real_5: 0.3380172550678253 (0.2808970957994461) | > loss_0: 2.6783676147460938 (2.51026713848114) | > loss_gen: 3.456679344177246 (3.099315643310547) | > loss_kl: 6.071836948394775 (5.812574863433838) | > loss_feat: 7.621525287628174 (7.234808921813965) | > loss_mel: 28.299156188964844 (26.355573654174805) | > loss_duration: 3.4072892665863037 (3.4024691581726074) | > loss_1: 48.85648727416992 (45.904741287231445)  --> STEP: 3 | > loss_disc: 2.8548331260681152 (2.6251224676767984) | > loss_disc_real_0: 0.3994777798652649 (0.37495068709055585) | > loss_disc_real_1: 0.26370692253112793 (0.23070997496445975) | > loss_disc_real_2: 0.20542213320732117 (0.2506617108980815) | > loss_disc_real_3: 0.30939343571662903 (0.2786484162012736) | > loss_disc_real_4: 0.23261316120624542 (0.26701270043849945) | > loss_disc_real_5: 0.24501286447048187 (0.268935685356458) | > loss_0: 2.8548331260681152 (2.6251224676767984) | > loss_gen: 2.1580798625946045 (2.7855703830718994) | > loss_kl: 3.149806261062622 (4.9249853293101) | > loss_feat: 1.1321513652801514 (5.200589736302693) | > loss_mel: 14.731424331665039 (22.480857213338215) | > loss_duration: 3.0098252296447754 (3.27158784866333) | > loss_1: 24.181285858154297 (38.66358947753906) --> EVAL PERFORMANCE | > avg_loader_time: 0.016181230545043945 (+0.010100841522216797) | > avg_loss_disc: 2.6251224676767984 (-0.04570770263671875) | > avg_loss_disc_real_0: 0.37495068709055585 (+0.08903168638547265) | > avg_loss_disc_real_1: 0.23070997496445975 (-0.05396937827269235) | > avg_loss_disc_real_2: 0.2506617108980815 (+0.01836534341176352) | > avg_loss_disc_real_3: 0.2786484162012736 (+0.04112259546915692) | > avg_loss_disc_real_4: 0.26701270043849945 (-0.022996520002682985) | > avg_loss_disc_real_5: 0.268935685356458 (-0.007472122708956419) | > avg_loss_0: 2.6251224676767984 (-0.04570770263671875) | > avg_loss_gen: 2.7855703830718994 (+0.43399031956990575) | > avg_loss_kl: 4.9249853293101 (+0.46329418818155954) | > avg_loss_feat: 5.200589736302693 (+1.2663857241471606) | > avg_loss_mel: 22.480857213338215 (+2.5138715108235665) | > avg_loss_duration: 3.27158784866333 (+0.12073365847269679) | > avg_loss_1: 38.66358947753906 (+4.798274358113609)  > EPOCH: 1047/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:00:46)   --> TIME: 2023-10-20 13:00:56 -- STEP: 9/50 -- GLOBAL_STEP: 105360 | > loss_disc: 2.597125768661499 (1.9677477147844102) | > loss_disc_real_0: 0.09141571819782257 (0.09846771177318361) | > loss_disc_real_1: 0.3187100291252136 (0.24508475760618845) | > loss_disc_real_2: 0.2762439548969269 (0.2207423531346851) | > loss_disc_real_3: 0.4685603380203247 (0.2776515959865517) | > loss_disc_real_4: 0.3087121248245239 (0.1447378173470497) | > loss_disc_real_5: 0.3469676375389099 (0.13163263785342375) | > loss_0: 2.597125768661499 (1.9677477147844102) | > grad_norm_0: tensor(397.1361, device='cuda:0') (tensor(471.8207, device='cuda:0')) | > loss_gen: 2.6287379264831543 (3.0948859320746527) | > loss_kl: 0.6729187369346619 (0.7537927296426561) | > loss_feat: 3.775269031524658 (9.212638722525703) | > loss_mel: 20.529953002929688 (22.0798585679796) | > loss_duration: 1.2729060649871826 (1.3495312399334378) | > loss_1: 28.879785537719727 (36.49070803324381) | > grad_norm_1: tensor(3156.3191, device='cuda:0') (tensor(24976.6836, device='cuda:0')) | > current_lr_0: 7.019323392796018e-05 | > current_lr_1: 7.019323392796018e-05 | > step_time: 0.8257 (0.4716931978861491) | > loader_time: 0.0321 (0.011039177576700846)  --> TIME: 2023-10-20 13:01:13 -- STEP: 39/50 -- GLOBAL_STEP: 105390 | > loss_disc: 1.8826781511306763 (2.2906178388840104) | > loss_disc_real_0: 0.045610204339027405 (0.12277863255869119) | > loss_disc_real_1: 0.09488704800605774 (0.22310205415273324) | > loss_disc_real_2: 0.0329752042889595 (0.21465425508526656) | > loss_disc_real_3: 0.13912206888198853 (0.24611685702051866) | > loss_disc_real_4: 0.09576116502285004 (0.19583558787902197) | > loss_disc_real_5: 0.05923693999648094 (0.22588171212910077) | > loss_0: 1.8826781511306763 (2.2906178388840104) | > grad_norm_0: tensor(946.3731, device='cuda:0') (tensor(658.0461, device='cuda:0')) | > loss_gen: 2.1173548698425293 (2.560704686702826) | > loss_kl: 0.4773745834827423 (0.8113810698955487) | > loss_feat: 6.945487022399902 (6.448327653205547) | > loss_mel: 20.174692153930664 (19.755067635805176) | > loss_duration: 1.4240474700927734 (1.3435765749368913) | > loss_1: 31.13895606994629 (30.919058005015057) | > grad_norm_1: tensor(29974.9258, device='cuda:0') (tensor(20983.0273, device='cuda:0')) | > current_lr_0: 7.019323392796018e-05 | > current_lr_1: 7.019323392796018e-05 | > step_time: 0.2706 (0.5451775942093285) | > loader_time: 0.0024 (0.014211556850335537)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.831664562225342 (2.831664562225342) | > loss_disc_real_0: 0.3808363378047943 (0.3808363378047943) | > loss_disc_real_1: 0.24422882497310638 (0.24422882497310638) | > loss_disc_real_2: 0.3659711182117462 (0.3659711182117462) | > loss_disc_real_3: 0.27028217911720276 (0.27028217911720276) | > loss_disc_real_4: 0.33949998021125793 (0.33949998021125793) | > loss_disc_real_5: 0.31377196311950684 (0.31377196311950684) | > loss_0: 2.831664562225342 (2.831664562225342) | > loss_gen: 2.522277593612671 (2.522277593612671) | > loss_kl: 4.962012767791748 (4.962012767791748) | > loss_feat: 5.239847660064697 (5.239847660064697) | > loss_mel: 21.331546783447266 (21.331546783447266) | > loss_duration: 3.096778154373169 (3.096778154373169) | > loss_1: 37.152462005615234 (37.152462005615234)  --> STEP: 1 | > loss_disc: 2.6987180709838867 (2.6987180709838867) | > loss_disc_real_0: 0.12200310081243515 (0.12200310081243515) | > loss_disc_real_1: 0.24882081151008606 (0.24882081151008606) | > loss_disc_real_2: 0.24212732911109924 (0.24212732911109924) | > loss_disc_real_3: 0.2791791260242462 (0.2791791260242462) | > loss_disc_real_4: 0.2217969298362732 (0.2217969298362732) | > loss_disc_real_5: 0.23063336312770844 (0.23063336312770844) | > loss_0: 2.6987180709838867 (2.6987180709838867) | > loss_gen: 1.762363314628601 (1.762363314628601) | > loss_kl: 5.021978855133057 (5.021978855133057) | > loss_feat: 1.798036813735962 (1.798036813735962) | > loss_mel: 16.500272750854492 (16.500272750854492) | > loss_duration: 3.298306465148926 (3.298306465148926) | > loss_1: 28.380958557128906 (28.380958557128906)  --> STEP: 2 | > loss_disc: 2.7732927799224854 (2.736005425453186) | > loss_disc_real_0: 0.3033585548400879 (0.21268082782626152) | > loss_disc_real_1: 0.17206576466560364 (0.21044328808784485) | > loss_disc_real_2: 0.28903403878211975 (0.2655806839466095) | > loss_disc_real_3: 0.12455800920724869 (0.20186856761574745) | > loss_disc_real_4: 0.3255229890346527 (0.27365995943546295) | > loss_disc_real_5: 0.20984236896038055 (0.2202378660440445) | > loss_0: 2.7732927799224854 (2.736005425453186) | > loss_gen: 2.2573463916778564 (2.0098548531532288) | > loss_kl: 6.32773494720459 (5.674856901168823) | > loss_feat: 9.382843971252441 (5.590440392494202) | > loss_mel: 22.363765716552734 (19.432019233703613) | > loss_duration: 3.231344699859619 (3.2648255825042725) | > loss_1: 43.56303787231445 (35.97199821472168)  --> STEP: 3 | > loss_disc: 2.7353591918945312 (2.7357900142669678) | > loss_disc_real_0: 0.2530463933944702 (0.22613601634899774) | > loss_disc_real_1: 0.32887136936187744 (0.24991931517918906) | > loss_disc_real_2: 0.24184729158878326 (0.2576695531606674) | > loss_disc_real_3: 0.3194277882575989 (0.2410549744963646) | > loss_disc_real_4: 0.3269173204898834 (0.2914124131202698) | > loss_disc_real_5: 0.44049131870269775 (0.2936556835969289) | > loss_0: 2.7353591918945312 (2.7357900142669678) | > loss_gen: 2.6375317573547363 (2.2190804878870645) | > loss_kl: 2.6364173889160156 (4.662043730417888) | > loss_feat: 4.788967609405518 (5.323282798131307) | > loss_mel: 22.224088668823242 (20.362709045410156) | > loss_duration: 2.945680618286133 (3.1584439277648926) | > loss_1: 35.232688903808594 (35.72556177775065) --> EVAL PERFORMANCE | > avg_loader_time: 0.01865696907043457 (+0.002475738525390625) | > avg_loss_disc: 2.7357900142669678 (+0.11066754659016942) | > avg_loss_disc_real_0: 0.22613601634899774 (-0.1488146707415581) | > avg_loss_disc_real_1: 0.24991931517918906 (+0.01920934021472931) | > avg_loss_disc_real_2: 0.2576695531606674 (+0.007007842262585939) | > avg_loss_disc_real_3: 0.2410549744963646 (-0.037593441704909025) | > avg_loss_disc_real_4: 0.2914124131202698 (+0.024399712681770325) | > avg_loss_disc_real_5: 0.2936556835969289 (+0.024719998240470886) | > avg_loss_0: 2.7357900142669678 (+0.11066754659016942) | > avg_loss_gen: 2.2190804878870645 (-0.566489895184835) | > avg_loss_kl: 4.662043730417888 (-0.2629415988922119) | > avg_loss_feat: 5.323282798131307 (+0.12269306182861328) | > avg_loss_mel: 20.362709045410156 (-2.1181481679280587) | > avg_loss_duration: 3.1584439277648926 (-0.1131439208984375) | > avg_loss_1: 35.72556177775065 (-2.938027699788414)  > EPOCH: 1048/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:01:33)   --> TIME: 2023-10-20 13:01:51 -- STEP: 19/50 -- GLOBAL_STEP: 105420 | > loss_disc: 2.6895055770874023 (2.3016142092253027) | > loss_disc_real_0: 0.09515762329101562 (0.13802208143629527) | > loss_disc_real_1: 0.1881883591413498 (0.22030876812181974) | > loss_disc_real_2: 0.35803553462028503 (0.21088368720129916) | > loss_disc_real_3: 0.18671900033950806 (0.22346734118304754) | > loss_disc_real_4: 0.39887377619743347 (0.2222015681235414) | > loss_disc_real_5: 0.36757779121398926 (0.22408517165795752) | > loss_0: 2.6895055770874023 (2.3016142092253027) | > grad_norm_0: tensor(480.8862, device='cuda:0') (tensor(512.9418, device='cuda:0')) | > loss_gen: 2.2480592727661133 (2.481518080360011) | > loss_kl: 0.9694702625274658 (0.9231419422124562) | > loss_feat: 6.995779037475586 (6.479822422328748) | > loss_mel: 21.53248405456543 (23.381362965232448) | > loss_duration: 1.4564090967178345 (1.3726171631562083) | > loss_1: 33.20220184326172 (34.63846307051809) | > grad_norm_1: tensor(7751.2500, device='cuda:0') (tensor(17613.1602, device='cuda:0')) | > current_lr_0: 7.012307139589583e-05 | > current_lr_1: 7.012307139589583e-05 | > step_time: 0.4589 (0.6036674097964638) | > loader_time: 0.008 (0.02502868050023129)  --> TIME: 2023-10-20 13:02:13 -- STEP: 49/50 -- GLOBAL_STEP: 105450 | > loss_disc: 2.6343441009521484 (2.4071520104700204) | > loss_disc_real_0: 0.058668773621320724 (0.14152249091361854) | > loss_disc_real_1: 0.24167771637439728 (0.2139962916167415) | > loss_disc_real_2: 0.16978546977043152 (0.21738454163530652) | > loss_disc_real_3: 0.3051707148551941 (0.22891655488281834) | > loss_disc_real_4: 0.2597440481185913 (0.2219482661433974) | > loss_disc_real_5: 0.2710910439491272 (0.21581728429514535) | > loss_0: 2.6343441009521484 (2.4071520104700204) | > grad_norm_0: tensor(1754.9517, device='cuda:0') (tensor(624.0254, device='cuda:0')) | > loss_gen: 1.8840585947036743 (2.330451286568934) | > loss_kl: 0.3915637135505676 (0.8106732137349187) | > loss_feat: 1.7815190553665161 (6.06531583483578) | > loss_mel: 20.072429656982422 (21.777996533987473) | > loss_duration: 1.4388866424560547 (1.3507265460734466) | > loss_1: 25.568456649780273 (32.33516353490401) | > grad_norm_1: tensor(11003.8125, device='cuda:0') (tensor(19536.7188, device='cuda:0')) | > current_lr_0: 7.012307139589583e-05 | > current_lr_1: 7.012307139589583e-05 | > step_time: 0.7059 (0.647319861820766) | > loader_time: 0.5186 (0.034346439400497746)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1371123790740967 (3.1371123790740967) | > loss_disc_real_0: 0.38093557953834534 (0.38093557953834534) | > loss_disc_real_1: 0.539615273475647 (0.539615273475647) | > loss_disc_real_2: 0.4215485453605652 (0.4215485453605652) | > loss_disc_real_3: 0.49239927530288696 (0.49239927530288696) | > loss_disc_real_4: 0.20478731393814087 (0.20478731393814087) | > loss_disc_real_5: 0.1877782940864563 (0.1877782940864563) | > loss_0: 3.1371123790740967 (3.1371123790740967) | > loss_gen: 2.663206100463867 (2.663206100463867) | > loss_kl: 5.707442760467529 (5.707442760467529) | > loss_feat: 8.64690113067627 (8.64690113067627) | > loss_mel: 21.837919235229492 (21.837919235229492) | > loss_duration: 3.0628480911254883 (3.0628480911254883) | > loss_1: 41.91831588745117 (41.91831588745117)  --> STEP: 1 | > loss_disc: 3.045647144317627 (3.045647144317627) | > loss_disc_real_0: 0.5438518524169922 (0.5438518524169922) | > loss_disc_real_1: 0.2441059648990631 (0.2441059648990631) | > loss_disc_real_2: 0.39352792501449585 (0.39352792501449585) | > loss_disc_real_3: 0.30944788455963135 (0.30944788455963135) | > loss_disc_real_4: 0.3446246385574341 (0.3446246385574341) | > loss_disc_real_5: 0.4027337431907654 (0.4027337431907654) | > loss_0: 3.045647144317627 (3.045647144317627) | > loss_gen: 2.817765951156616 (2.817765951156616) | > loss_kl: 5.20930814743042 (5.20930814743042) | > loss_feat: 5.820460796356201 (5.820460796356201) | > loss_mel: 23.36045265197754 (23.36045265197754) | > loss_duration: 3.316023349761963 (3.316023349761963) | > loss_1: 40.524009704589844 (40.524009704589844)  --> STEP: 2 | > loss_disc: 2.029290199279785 (2.537468671798706) | > loss_disc_real_0: 0.3526137173175812 (0.4482327848672867) | > loss_disc_real_1: 0.1996660828590393 (0.2218860238790512) | > loss_disc_real_2: 0.1938125491142273 (0.2936702370643616) | > loss_disc_real_3: 0.1006864383816719 (0.20506716147065163) | > loss_disc_real_4: 0.2501487731933594 (0.29738670587539673) | > loss_disc_real_5: 0.15314912796020508 (0.27794143557548523) | > loss_0: 2.029290199279785 (2.537468671798706) | > loss_gen: 2.753908157348633 (2.7858370542526245) | > loss_kl: 5.501641273498535 (5.3554747104644775) | > loss_feat: 11.855456352233887 (8.837958574295044) | > loss_mel: 23.66831398010254 (23.51438331604004) | > loss_duration: 3.247605800628662 (3.2818145751953125) | > loss_1: 47.02692413330078 (43.77546691894531)  --> STEP: 3 | > loss_disc: 2.8034653663635254 (2.626134236653646) | > loss_disc_real_0: 0.2856349050998688 (0.3940334916114807) | > loss_disc_real_1: 0.46422669291496277 (0.30266624689102173) | > loss_disc_real_2: 0.49165821075439453 (0.35966622829437256) | > loss_disc_real_3: 0.3995903432369232 (0.26990822205940884) | > loss_disc_real_4: 0.284466028213501 (0.29307981332143146) | > loss_disc_real_5: 0.2173498570919037 (0.2577442427476247) | > loss_0: 2.8034653663635254 (2.626134236653646) | > loss_gen: 3.1232364177703857 (2.898303508758545) | > loss_kl: 2.525726556777954 (4.412225325902303) | > loss_feat: 4.799292087554932 (7.49173641204834) | > loss_mel: 24.687759399414062 (23.905508677164715) | > loss_duration: 2.8843700885772705 (3.1493330796559653) | > loss_1: 38.0203857421875 (41.85710652669271) --> EVAL PERFORMANCE | > avg_loader_time: 0.005277156829833984 (-0.013379812240600586) | > avg_loss_disc: 2.626134236653646 (-0.10965577761332179) | > avg_loss_disc_real_0: 0.3940334916114807 (+0.16789747526248297) | > avg_loss_disc_real_1: 0.30266624689102173 (+0.05274693171183267) | > avg_loss_disc_real_2: 0.35966622829437256 (+0.10199667513370514) | > avg_loss_disc_real_3: 0.26990822205940884 (+0.02885324756304425) | > avg_loss_disc_real_4: 0.29307981332143146 (+0.001667400201161684) | > avg_loss_disc_real_5: 0.2577442427476247 (-0.0359114408493042) | > avg_loss_0: 2.626134236653646 (-0.10965577761332179) | > avg_loss_gen: 2.898303508758545 (+0.6792230208714805) | > avg_loss_kl: 4.412225325902303 (-0.2498184045155849) | > avg_loss_feat: 7.49173641204834 (+2.168453613917033) | > avg_loss_mel: 23.905508677164715 (+3.5427996317545585) | > avg_loss_duration: 3.1493330796559653 (-0.00911084810892726) | > avg_loss_1: 41.85710652669271 (+6.131544748942062)  > EPOCH: 1049/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:02:29)   --> TIME: 2023-10-20 13:02:52 -- STEP: 29/50 -- GLOBAL_STEP: 105480 | > loss_disc: 3.0016212463378906 (2.533347775196207) | > loss_disc_real_0: 0.2522331178188324 (0.17486843068538038) | > loss_disc_real_1: 0.28515899181365967 (0.24533460167204507) | > loss_disc_real_2: 0.24992547929286957 (0.23468407667402563) | > loss_disc_real_3: 0.27931421995162964 (0.2553999724573102) | > loss_disc_real_4: 0.30494508147239685 (0.2335921343544434) | > loss_disc_real_5: 0.2569383978843689 (0.22431397168286915) | > loss_0: 3.0016212463378906 (2.533347775196207) | > grad_norm_0: tensor(401.5092, device='cuda:0') (tensor(716.6650, device='cuda:0')) | > loss_gen: 1.6709511280059814 (2.252526612117373) | > loss_kl: 1.0611085891723633 (0.8542821972534574) | > loss_feat: 0.05198788642883301 (5.4660306598605795) | > loss_mel: 2.956463575363159 (20.156449202833503) | > loss_duration: 1.3374295234680176 (1.3573739035376187) | > loss_1: 7.077940464019775 (30.08666207872588) | > grad_norm_1: tensor(27865.1465, device='cuda:0') (tensor(23878.1309, device='cuda:0')) | > current_lr_0: 7.005297899567515e-05 | > current_lr_1: 7.005297899567515e-05 | > step_time: 0.4425 (0.6007854280800655) | > loader_time: 0.0334 (0.023180501214389145)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7528905868530273 (2.7528905868530273) | > loss_disc_real_0: 0.17365750670433044 (0.17365750670433044) | > loss_disc_real_1: 0.20869110524654388 (0.20869110524654388) | > loss_disc_real_2: 0.4011703431606293 (0.4011703431606293) | > loss_disc_real_3: 0.3586631417274475 (0.3586631417274475) | > loss_disc_real_4: 0.26432740688323975 (0.26432740688323975) | > loss_disc_real_5: 0.34376758337020874 (0.34376758337020874) | > loss_0: 2.7528905868530273 (2.7528905868530273) | > loss_gen: 2.4152064323425293 (2.4152064323425293) | > loss_kl: 5.89424991607666 (5.89424991607666) | > loss_feat: 5.641932964324951 (5.641932964324951) | > loss_mel: 21.78000259399414 (21.78000259399414) | > loss_duration: 3.0525150299072266 (3.0525150299072266) | > loss_1: 38.783905029296875 (38.783905029296875)  --> STEP: 1 | > loss_disc: 1.7363395690917969 (1.7363395690917969) | > loss_disc_real_0: 0.06683479249477386 (0.06683479249477386) | > loss_disc_real_1: 0.20621603727340698 (0.20621603727340698) | > loss_disc_real_2: 0.204218789935112 (0.204218789935112) | > loss_disc_real_3: 0.175876647233963 (0.175876647233963) | > loss_disc_real_4: 0.08761117607355118 (0.08761117607355118) | > loss_disc_real_5: 0.0565514899790287 (0.0565514899790287) | > loss_0: 1.7363395690917969 (1.7363395690917969) | > loss_gen: 2.4330499172210693 (2.4330499172210693) | > loss_kl: 5.527886390686035 (5.527886390686035) | > loss_feat: 9.720181465148926 (9.720181465148926) | > loss_mel: 22.258289337158203 (22.258289337158203) | > loss_duration: 3.253000020980835 (3.253000020980835) | > loss_1: 43.19240188598633 (43.19240188598633)  --> STEP: 2 | > loss_disc: 2.9573774337768555 (2.346858501434326) | > loss_disc_real_0: 0.2673076093196869 (0.16707120090723038) | > loss_disc_real_1: 0.2100277990102768 (0.2081219181418419) | > loss_disc_real_2: 0.18473473191261292 (0.19447676092386246) | > loss_disc_real_3: 0.33621925115585327 (0.25604794919490814) | > loss_disc_real_4: 0.2282377928495407 (0.15792448446154594) | > loss_disc_real_5: 0.3675104081630707 (0.2120309490710497) | > loss_0: 2.9573774337768555 (2.346858501434326) | > loss_gen: 1.9069764614105225 (2.170013189315796) | > loss_kl: 6.285590171813965 (5.90673828125) | > loss_feat: 7.104000091552734 (8.41209077835083) | > loss_mel: 22.298309326171875 (22.27829933166504) | > loss_duration: 3.258768081665039 (3.255884051322937) | > loss_1: 40.85364532470703 (42.02302360534668)  --> STEP: 3 | > loss_disc: 1.5263257026672363 (2.073347568511963) | > loss_disc_real_0: 0.05147223919630051 (0.12853821367025375) | > loss_disc_real_1: 0.07261081039905548 (0.16295154889424643) | > loss_disc_real_2: 0.020482949912548065 (0.136478823920091) | > loss_disc_real_3: 0.034133266657590866 (0.18207638834913573) | > loss_disc_real_4: 0.0224623866379261 (0.11277045185367267) | > loss_disc_real_5: 0.004603468347340822 (0.14288845549648008) | > loss_0: 1.5263257026672363 (2.073347568511963) | > loss_gen: 2.256474494934082 (2.198833624521891) | > loss_kl: 2.522181510925293 (4.778552691141765) | > loss_feat: 10.104896545410156 (8.976359367370605) | > loss_mel: 25.001522064208984 (23.18604024251302) | > loss_duration: 2.9992244243621826 (3.170330842336019) | > loss_1: 42.884300231933594 (42.310115814208984) --> EVAL PERFORMANCE | > avg_loader_time: 0.008310794830322266 (+0.0030336380004882812) | > avg_loss_disc: 2.073347568511963 (-0.5527866681416831) | > avg_loss_disc_real_0: 0.12853821367025375 (-0.26549527794122696) | > avg_loss_disc_real_1: 0.16295154889424643 (-0.1397146979967753) | > avg_loss_disc_real_2: 0.136478823920091 (-0.22318740437428156) | > avg_loss_disc_real_3: 0.18207638834913573 (-0.08783183371027312) | > avg_loss_disc_real_4: 0.11277045185367267 (-0.18030936146775878) | > avg_loss_disc_real_5: 0.14288845549648008 (-0.11485578725114462) | > avg_loss_0: 2.073347568511963 (-0.5527866681416831) | > avg_loss_gen: 2.198833624521891 (-0.6994698842366538) | > avg_loss_kl: 4.778552691141765 (+0.36632736523946186) | > avg_loss_feat: 8.976359367370605 (+1.4846229553222656) | > avg_loss_mel: 23.18604024251302 (-0.7194684346516951) | > avg_loss_duration: 3.170330842336019 (+0.02099776268005371) | > avg_loss_1: 42.310115814208984 (+0.4530092875162737)  > EPOCH: 1050/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:03:19)   --> TIME: 2023-10-20 13:03:30 -- STEP: 9/50 -- GLOBAL_STEP: 105510 | > loss_disc: 2.6169748306274414 (2.4681402444839478) | > loss_disc_real_0: 0.36508995294570923 (0.16112572223775917) | > loss_disc_real_1: 0.2613309919834137 (0.18541095654169717) | > loss_disc_real_2: 0.15811945497989655 (0.21487493813037872) | > loss_disc_real_3: 0.22857683897018433 (0.2273877908786138) | > loss_disc_real_4: 0.20265278220176697 (0.2065317974322372) | > loss_disc_real_5: 0.23020261526107788 (0.26520396479301983) | > loss_0: 2.6169748306274414 (2.4681402444839478) | > grad_norm_0: tensor(588.5703, device='cuda:0') (tensor(546.9860, device='cuda:0')) | > loss_gen: 1.9502427577972412 (2.1164246002833047) | > loss_kl: 0.6063423156738281 (0.8265924586190118) | > loss_feat: 2.1553492546081543 (5.281879572404756) | > loss_mel: 19.134763717651367 (17.270449863539802) | > loss_duration: 1.3177741765975952 (1.3385579586029053) | > loss_1: 25.164472579956055 (26.833904425303142) | > grad_norm_1: tensor(1943.3943, device='cuda:0') (tensor(18544.3945, device='cuda:0')) | > current_lr_0: 6.998295665719692e-05 | > current_lr_1: 6.998295665719692e-05 | > step_time: 0.6019 (0.6187689834170871) | > loader_time: 0.042 (0.026833534240722656)  --> TIME: 2023-10-20 13:03:44 -- STEP: 39/50 -- GLOBAL_STEP: 105540 | > loss_disc: 2.8861865997314453 (2.4874643912682166) | > loss_disc_real_0: 0.1868099719285965 (0.1603233273356007) | > loss_disc_real_1: 0.2541077136993408 (0.21675236628223687) | > loss_disc_real_2: 0.2953929901123047 (0.22620060294866562) | > loss_disc_real_3: 0.28086206316947937 (0.22912170346348715) | > loss_disc_real_4: 0.28295210003852844 (0.2120953878531089) | > loss_disc_real_5: 0.2870958149433136 (0.22663462911851895) | > loss_0: 2.8861865997314453 (2.4874643912682166) | > grad_norm_0: tensor(535.0041, device='cuda:0') (tensor(535.7603, device='cuda:0')) | > loss_gen: 1.723682165145874 (2.142447150670565) | > loss_kl: 0.8393871188163757 (0.7640078579768156) | > loss_feat: 0.8968465328216553 (5.172485299790517) | > loss_mel: 15.478713035583496 (18.829883459286812) | > loss_duration: 1.4401532411575317 (1.3342338571181664) | > loss_1: 20.378782272338867 (28.24305759332119) | > grad_norm_1: tensor(6037.7280, device='cuda:0') (tensor(19522.9805, device='cuda:0')) | > current_lr_0: 6.998295665719692e-05 | > current_lr_1: 6.998295665719692e-05 | > step_time: 0.336 (0.4878827425149771) | > loader_time: 0.0154 (0.014883970602964744)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5256004333496094 (2.5256004333496094) | > loss_disc_real_0: 0.2705202102661133 (0.2705202102661133) | > loss_disc_real_1: 0.2361232191324234 (0.2361232191324234) | > loss_disc_real_2: 0.33140087127685547 (0.33140087127685547) | > loss_disc_real_3: 0.452913761138916 (0.452913761138916) | > loss_disc_real_4: 0.15352346003055573 (0.15352346003055573) | > loss_disc_real_5: 0.10871882736682892 (0.10871882736682892) | > loss_0: 2.5256004333496094 (2.5256004333496094) | > loss_gen: 3.1546542644500732 (3.1546542644500732) | > loss_kl: 6.24675178527832 (6.24675178527832) | > loss_feat: 8.55957317352295 (8.55957317352295) | > loss_mel: 17.811084747314453 (17.811084747314453) | > loss_duration: 3.099773406982422 (3.099773406982422) | > loss_1: 38.8718376159668 (38.8718376159668)  --> STEP: 1 | > loss_disc: 2.9459049701690674 (2.9459049701690674) | > loss_disc_real_0: 0.17881831526756287 (0.17881831526756287) | > loss_disc_real_1: 0.2712939381599426 (0.2712939381599426) | > loss_disc_real_2: 0.29039329290390015 (0.29039329290390015) | > loss_disc_real_3: 0.35454750061035156 (0.35454750061035156) | > loss_disc_real_4: 0.44022423028945923 (0.44022423028945923) | > loss_disc_real_5: 0.44729945063591003 (0.44729945063591003) | > loss_0: 2.9459049701690674 (2.9459049701690674) | > loss_gen: 2.475059986114502 (2.475059986114502) | > loss_kl: 5.549648761749268 (5.549648761749268) | > loss_feat: 4.346807479858398 (4.346807479858398) | > loss_mel: 23.151376724243164 (23.151376724243164) | > loss_duration: 3.3181512355804443 (3.3181512355804443) | > loss_1: 38.841041564941406 (38.841041564941406)  --> STEP: 2 | > loss_disc: 2.55255389213562 (2.7492294311523438) | > loss_disc_real_0: 0.1680496633052826 (0.17343398928642273) | > loss_disc_real_1: 0.2659763991832733 (0.26863516867160797) | > loss_disc_real_2: 0.3576311767101288 (0.32401223480701447) | > loss_disc_real_3: 0.26282697916030884 (0.3086872398853302) | > loss_disc_real_4: 0.26199549436569214 (0.3511098623275757) | > loss_disc_real_5: 0.42438068985939026 (0.43584007024765015) | > loss_0: 2.55255389213562 (2.7492294311523438) | > loss_gen: 2.680941581726074 (2.578000783920288) | > loss_kl: 5.993623733520508 (5.771636247634888) | > loss_feat: 8.141454696655273 (6.244131088256836) | > loss_mel: 24.242040634155273 (23.69670867919922) | > loss_duration: 3.2399370670318604 (3.2790441513061523) | > loss_1: 44.29800033569336 (41.56952095031738)  --> STEP: 3 | > loss_disc: 2.770949363708496 (2.756469408671061) | > loss_disc_real_0: 0.2926519215106964 (0.2131733000278473) | > loss_disc_real_1: 0.250517338514328 (0.26259589195251465) | > loss_disc_real_2: 0.2631470859050751 (0.30372385183970135) | > loss_disc_real_3: 0.22209519147872925 (0.27982322374979657) | > loss_disc_real_4: 0.26341477036476135 (0.3218781650066376) | > loss_disc_real_5: 0.2776980996131897 (0.38312608003616333) | > loss_0: 2.770949363708496 (2.756469408671061) | > loss_gen: 2.0222067832946777 (2.3927361170450845) | > loss_kl: 2.829923629760742 (4.791065375010173) | > loss_feat: 0.9617214202880859 (4.483327865600586) | > loss_mel: 17.31864356994629 (21.57068697611491) | > loss_duration: 2.855337142944336 (3.1378084818522134) | > loss_1: 25.98783302307129 (36.37562497456869) --> EVAL PERFORMANCE | > avg_loader_time: 0.028584957122802734 (+0.02027416229248047) | > avg_loss_disc: 2.756469408671061 (+0.6831218401590982) | > avg_loss_disc_real_0: 0.2131733000278473 (+0.08463508635759354) | > avg_loss_disc_real_1: 0.26259589195251465 (+0.09964434305826822) | > avg_loss_disc_real_2: 0.30372385183970135 (+0.16724502791961035) | > avg_loss_disc_real_3: 0.27982322374979657 (+0.09774683540066084) | > avg_loss_disc_real_4: 0.3218781650066376 (+0.2091077131529649) | > avg_loss_disc_real_5: 0.38312608003616333 (+0.24023762453968325) | > avg_loss_0: 2.756469408671061 (+0.6831218401590982) | > avg_loss_gen: 2.3927361170450845 (+0.19390249252319336) | > avg_loss_kl: 4.791065375010173 (+0.012512683868408203) | > avg_loss_feat: 4.483327865600586 (-4.4930315017700195) | > avg_loss_mel: 21.57068697611491 (-1.6153532663981096) | > avg_loss_duration: 3.1378084818522134 (-0.032522360483805635) | > avg_loss_1: 36.37562497456869 (-5.934490839640297)  > EPOCH: 1051/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:04:05)   --> TIME: 2023-10-20 13:04:24 -- STEP: 19/50 -- GLOBAL_STEP: 105570 | > loss_disc: 1.899448275566101 (2.414610216492101) | > loss_disc_real_0: 0.05822082608938217 (0.14425512422856532) | > loss_disc_real_1: 0.229555144906044 (0.2317226454615593) | > loss_disc_real_2: 0.22455066442489624 (0.25163092503422185) | > loss_disc_real_3: 0.1750842183828354 (0.24407750407331869) | > loss_disc_real_4: 0.16332630813121796 (0.22584660312062815) | > loss_disc_real_5: 0.17565523087978363 (0.22259083566697022) | > loss_0: 1.899448275566101 (2.414610216492101) | > grad_norm_0: tensor(370.5542, device='cuda:0') (tensor(603.1768, device='cuda:0')) | > loss_gen: 2.5126609802246094 (2.394564076473838) | > loss_kl: 0.7023837566375732 (0.8639389480415144) | > loss_feat: 6.893318176269531 (5.616769714575065) | > loss_mel: 21.287240982055664 (17.441106454322213) | > loss_duration: 1.421732783317566 (1.3628403262088173) | > loss_1: 32.81733703613281 (27.679219271007337) | > grad_norm_1: tensor(3307.6768, device='cuda:0') (tensor(28080.3594, device='cuda:0')) | > current_lr_0: 6.991300431043006e-05 | > current_lr_1: 6.991300431043006e-05 | > step_time: 0.6424 (0.5667118524250231) | > loader_time: 0.0416 (0.019959713283338044)  --> TIME: 2023-10-20 13:04:40 -- STEP: 49/50 -- GLOBAL_STEP: 105600 | > loss_disc: 2.7827858924865723 (2.464131294464579) | > loss_disc_real_0: 0.08704384416341782 (0.14030432917785887) | > loss_disc_real_1: 0.14108625054359436 (0.22290585859089482) | > loss_disc_real_2: 0.2802565097808838 (0.23934974772285442) | > loss_disc_real_3: 0.1900932341814041 (0.24194264138231472) | > loss_disc_real_4: 0.3078514337539673 (0.24506229945287414) | > loss_disc_real_5: 0.27015942335128784 (0.24371354122247016) | > loss_0: 2.7827858924865723 (2.464131294464579) | > grad_norm_0: tensor(428.7670, device='cuda:0') (tensor(670.4537, device='cuda:0')) | > loss_gen: 2.26063871383667 (2.288581840846003) | > loss_kl: 0.58088219165802 (0.8024221236000254) | > loss_feat: 5.29827880859375 (5.146911017520696) | > loss_mel: 25.405996322631836 (19.269331367648373) | > loss_duration: 1.3959317207336426 (1.3343976760397152) | > loss_1: 34.94172668457031 (28.84164388812318) | > grad_norm_1: tensor(3853.9839, device='cuda:0') (tensor(20187.5117, device='cuda:0')) | > current_lr_0: 6.991300431043006e-05 | > current_lr_1: 6.991300431043006e-05 | > step_time: 0.3073 (0.5451474141101448) | > loader_time: 0.3739 (0.024482415646922828)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9862619638442993 (1.9862619638442993) | > loss_disc_real_0: 0.13711024820804596 (0.13711024820804596) | > loss_disc_real_1: 0.2878919243812561 (0.2878919243812561) | > loss_disc_real_2: 0.2202988564968109 (0.2202988564968109) | > loss_disc_real_3: 0.18101483583450317 (0.18101483583450317) | > loss_disc_real_4: 0.16309553384780884 (0.16309553384780884) | > loss_disc_real_5: 0.20641739666461945 (0.20641739666461945) | > loss_0: 1.9862619638442993 (1.9862619638442993) | > loss_gen: 3.1940107345581055 (3.1940107345581055) | > loss_kl: 6.080109596252441 (6.080109596252441) | > loss_feat: 8.991825103759766 (8.991825103759766) | > loss_mel: 22.39397430419922 (22.39397430419922) | > loss_duration: 3.0654757022857666 (3.0654757022857666) | > loss_1: 43.72539520263672 (43.72539520263672)  --> STEP: 1 | > loss_disc: 2.1020565032958984 (2.1020565032958984) | > loss_disc_real_0: 0.12457670271396637 (0.12457670271396637) | > loss_disc_real_1: 0.12801361083984375 (0.12801361083984375) | > loss_disc_real_2: 0.25982072949409485 (0.25982072949409485) | > loss_disc_real_3: 0.1260516196489334 (0.1260516196489334) | > loss_disc_real_4: 0.14178891479969025 (0.14178891479969025) | > loss_disc_real_5: 0.07742325961589813 (0.07742325961589813) | > loss_0: 2.1020565032958984 (2.1020565032958984) | > loss_gen: 2.2432539463043213 (2.2432539463043213) | > loss_kl: 5.34455680847168 (5.34455680847168) | > loss_feat: 11.390090942382812 (11.390090942382812) | > loss_mel: 23.35245132446289 (23.35245132446289) | > loss_duration: 3.38472318649292 (3.38472318649292) | > loss_1: 45.7150764465332 (45.7150764465332)  --> STEP: 2 | > loss_disc: 2.729743480682373 (2.4158999919891357) | > loss_disc_real_0: 0.13050611317157745 (0.1275414079427719) | > loss_disc_real_1: 0.25552651286125183 (0.1917700618505478) | > loss_disc_real_2: 0.23171913623809814 (0.2457699328660965) | > loss_disc_real_3: 0.36773887276649475 (0.24689524620771408) | > loss_disc_real_4: 0.3385497033596039 (0.24016930907964706) | > loss_disc_real_5: 0.3363919258117676 (0.20690759271383286) | > loss_0: 2.729743480682373 (2.4158999919891357) | > loss_gen: 2.2223048210144043 (2.232779383659363) | > loss_kl: 5.563892364501953 (5.454224586486816) | > loss_feat: 3.5108087062835693 (7.450449824333191) | > loss_mel: 26.601276397705078 (24.976863861083984) | > loss_duration: 3.111649751663208 (3.248186469078064) | > loss_1: 41.00993347167969 (43.362504959106445)  --> STEP: 3 | > loss_disc: 2.8941612243652344 (2.5753204027811685) | > loss_disc_real_0: 0.30646660923957825 (0.18718314170837402) | > loss_disc_real_1: 0.2413259893655777 (0.20828870435555777) | > loss_disc_real_2: 0.24822911620140076 (0.24658966064453125) | > loss_disc_real_3: 0.24541135132312775 (0.24640061457951865) | > loss_disc_real_4: 0.2749718129634857 (0.25177014370759326) | > loss_disc_real_5: 0.3913339674472809 (0.26838305095831555) | > loss_0: 2.8941612243652344 (2.5753204027811685) | > loss_gen: 2.073762893676758 (2.1797738869984946) | > loss_kl: 2.7772789001464844 (4.561909357706706) | > loss_feat: 1.8491122722625732 (5.583337306976318) | > loss_mel: 17.298797607421875 (22.417508443196613) | > loss_duration: 2.9645345211029053 (3.153635819753011) | > loss_1: 26.96348762512207 (37.89616584777832) --> EVAL PERFORMANCE | > avg_loader_time: 0.021233479181925457 (-0.0073514779408772775) | > avg_loss_disc: 2.5753204027811685 (-0.18114900588989258) | > avg_loss_disc_real_0: 0.18718314170837402 (-0.025990158319473267) | > avg_loss_disc_real_1: 0.20828870435555777 (-0.05430718759695688) | > avg_loss_disc_real_2: 0.24658966064453125 (-0.0571341911951701) | > avg_loss_disc_real_3: 0.24640061457951865 (-0.03342260917027792) | > avg_loss_disc_real_4: 0.25177014370759326 (-0.07010802129904431) | > avg_loss_disc_real_5: 0.26838305095831555 (-0.11474302907784778) | > avg_loss_0: 2.5753204027811685 (-0.18114900588989258) | > avg_loss_gen: 2.1797738869984946 (-0.21296223004658987) | > avg_loss_kl: 4.561909357706706 (-0.2291560173034668) | > avg_loss_feat: 5.583337306976318 (+1.1000094413757324) | > avg_loss_mel: 22.417508443196613 (+0.8468214670817034) | > avg_loss_duration: 3.153635819753011 (+0.015827337900797822) | > avg_loss_1: 37.89616584777832 (+1.520540873209633)  > EPOCH: 1052/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:04:59)   --> TIME: 2023-10-20 13:05:20 -- STEP: 29/50 -- GLOBAL_STEP: 105630 | > loss_disc: 2.2303895950317383 (2.524112224578858) | > loss_disc_real_0: 0.02594105154275894 (0.133500251405198) | > loss_disc_real_1: 0.28268688917160034 (0.23842177488680544) | > loss_disc_real_2: 0.23424328863620758 (0.23482287347573658) | > loss_disc_real_3: 0.22299830615520477 (0.2501022245349555) | > loss_disc_real_4: 0.2384878396987915 (0.22710635558027645) | > loss_disc_real_5: 0.1919814944267273 (0.23766859980492755) | > loss_0: 2.2303895950317383 (2.524112224578858) | > grad_norm_0: tensor(496.9946, device='cuda:0') (tensor(546.4489, device='cuda:0')) | > loss_gen: 2.46886944770813 (2.218938922059948) | > loss_kl: 0.5239537358283997 (0.8596130812476421) | > loss_feat: 8.96917724609375 (5.418734534547248) | > loss_mel: 24.086044311523438 (21.00020782289834) | > loss_duration: 1.2818375825881958 (1.3342363382207936) | > loss_1: 37.32987976074219 (30.831730415081157) | > grad_norm_1: tensor(3605.9700, device='cuda:0') (tensor(19054.2656, device='cuda:0')) | > current_lr_0: 6.984312188541344e-05 | > current_lr_1: 6.984312188541344e-05 | > step_time: 0.3615 (0.49983411821825746) | > loader_time: 0.0148 (0.013163352834767309)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1410391330718994 (2.1410391330718994) | > loss_disc_real_0: 0.06240571290254593 (0.06240571290254593) | > loss_disc_real_1: 0.20452523231506348 (0.20452523231506348) | > loss_disc_real_2: 0.17338721454143524 (0.17338721454143524) | > loss_disc_real_3: 0.22147196531295776 (0.22147196531295776) | > loss_disc_real_4: 0.403477281332016 (0.403477281332016) | > loss_disc_real_5: 0.3246794641017914 (0.3246794641017914) | > loss_0: 2.1410391330718994 (2.1410391330718994) | > loss_gen: 2.7737016677856445 (2.7737016677856445) | > loss_kl: 5.201061725616455 (5.201061725616455) | > loss_feat: 10.189779281616211 (10.189779281616211) | > loss_mel: 23.985624313354492 (23.985624313354492) | > loss_duration: 3.0155904293060303 (3.0155904293060303) | > loss_1: 45.16575622558594 (45.16575622558594)  --> STEP: 1 | > loss_disc: 2.9400691986083984 (2.9400691986083984) | > loss_disc_real_0: 0.4302099049091339 (0.4302099049091339) | > loss_disc_real_1: 0.27767181396484375 (0.27767181396484375) | > loss_disc_real_2: 0.35888001322746277 (0.35888001322746277) | > loss_disc_real_3: 0.3078556954860687 (0.3078556954860687) | > loss_disc_real_4: 0.5164245963096619 (0.5164245963096619) | > loss_disc_real_5: 0.2735699713230133 (0.2735699713230133) | > loss_0: 2.9400691986083984 (2.9400691986083984) | > loss_gen: 2.9480953216552734 (2.9480953216552734) | > loss_kl: 5.5424041748046875 (5.5424041748046875) | > loss_feat: 4.484719753265381 (4.484719753265381) | > loss_mel: 23.150503158569336 (23.150503158569336) | > loss_duration: 3.3608944416046143 (3.3608944416046143) | > loss_1: 39.48661804199219 (39.48661804199219)  --> STEP: 2 | > loss_disc: 2.9816956520080566 (2.9608824253082275) | > loss_disc_real_0: 0.384717732667923 (0.40746381878852844) | > loss_disc_real_1: 0.25730109214782715 (0.26748645305633545) | > loss_disc_real_2: 0.23946106433868408 (0.2991705387830734) | > loss_disc_real_3: 0.24397173523902893 (0.27591371536254883) | > loss_disc_real_4: 0.2485315203666687 (0.3824780583381653) | > loss_disc_real_5: 0.24058350920677185 (0.2570767402648926) | > loss_0: 2.9816956520080566 (2.9608824253082275) | > loss_gen: 1.7089017629623413 (2.3284985423088074) | > loss_kl: 5.802340030670166 (5.672372102737427) | > loss_feat: 0.17577748000621796 (2.3302486166357994) | > loss_mel: 10.123245239257812 (16.636874198913574) | > loss_duration: 3.3240082263946533 (3.342451333999634) | > loss_1: 21.134273529052734 (30.31044578552246)  --> STEP: 3 | > loss_disc: 2.7116141319274902 (2.877792994181315) | > loss_disc_real_0: 0.4082925319671631 (0.40774005651474) | > loss_disc_real_1: 0.2396802306175232 (0.258217712243398) | > loss_disc_real_2: 0.33112242817878723 (0.3098211685816447) | > loss_disc_real_3: 0.20145106315612793 (0.2510928312937419) | > loss_disc_real_4: 0.3371351957321167 (0.36736377080281574) | > loss_disc_real_5: 0.22266116738319397 (0.2456048826376597) | > loss_0: 2.7116141319274902 (2.877792994181315) | > loss_gen: 2.720231294631958 (2.4590761264165244) | > loss_kl: 2.4225549697875977 (4.589099725087483) | > loss_feat: 5.810206413269043 (3.4902345488468804) | > loss_mel: 21.316076278686523 (18.19660822550456) | > loss_duration: 2.89717698097229 (3.194026549657186) | > loss_1: 35.1662483215332 (31.929046630859375) --> EVAL PERFORMANCE | > avg_loader_time: 0.006606260935465495 (-0.014627218246459961) | > avg_loss_disc: 2.877792994181315 (+0.3024725914001465) | > avg_loss_disc_real_0: 0.40774005651474 (+0.22055691480636597) | > avg_loss_disc_real_1: 0.258217712243398 (+0.04992900788784024) | > avg_loss_disc_real_2: 0.3098211685816447 (+0.06323150793711346) | > avg_loss_disc_real_3: 0.2510928312937419 (+0.004692216714223235) | > avg_loss_disc_real_4: 0.36736377080281574 (+0.11559362709522247) | > avg_loss_disc_real_5: 0.2456048826376597 (-0.02277816832065585) | > avg_loss_0: 2.877792994181315 (+0.3024725914001465) | > avg_loss_gen: 2.4590761264165244 (+0.2793022394180298) | > avg_loss_kl: 4.589099725087483 (+0.027190367380777403) | > avg_loss_feat: 3.4902345488468804 (-2.093102758129438) | > avg_loss_mel: 18.19660822550456 (-4.220900217692055) | > avg_loss_duration: 3.194026549657186 (+0.040390729904174805) | > avg_loss_1: 31.929046630859375 (-5.967119216918945)  > EPOCH: 1053/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:05:51)   --> TIME: 2023-10-20 13:06:02 -- STEP: 9/50 -- GLOBAL_STEP: 105660 | > loss_disc: 2.3422865867614746 (2.5627867778142295) | > loss_disc_real_0: 0.02507331222295761 (0.2007669307705429) | > loss_disc_real_1: 0.22109675407409668 (0.2502605120340983) | > loss_disc_real_2: 0.17095886170864105 (0.22925848927762774) | > loss_disc_real_3: 0.19763650000095367 (0.23289145529270172) | > loss_disc_real_4: 0.11092572659254074 (0.21517883075608146) | > loss_disc_real_5: 0.3177887499332428 (0.23335532057616445) | > loss_0: 2.3422865867614746 (2.5627867778142295) | > grad_norm_0: tensor(404.4760, device='cuda:0') (tensor(684.1294, device='cuda:0')) | > loss_gen: 1.9917868375778198 (2.1802190144856772) | > loss_kl: 0.448283851146698 (0.8381457726160685) | > loss_feat: 5.028790473937988 (5.150237467139959) | > loss_mel: 22.4432373046875 (17.266158329115974) | > loss_duration: 1.2759369611740112 (1.3554190927081637) | > loss_1: 31.188034057617188 (26.79017972946167) | > grad_norm_1: tensor(4996.9570, device='cuda:0') (tensor(21377.3945, device='cuda:0')) | > current_lr_0: 6.977330931225593e-05 | > current_lr_1: 6.977330931225593e-05 | > step_time: 0.4941 (0.5989531146155463) | > loader_time: 0.0101 (0.025324318144056533)  --> TIME: 2023-10-20 13:06:22 -- STEP: 39/50 -- GLOBAL_STEP: 105690 | > loss_disc: 2.6818480491638184 (2.5587780353350524) | > loss_disc_real_0: 0.09121013432741165 (0.15520565340725276) | > loss_disc_real_1: 0.23282302916049957 (0.23377476250514007) | > loss_disc_real_2: 0.20348848402500153 (0.2390040560410573) | > loss_disc_real_3: 0.3006674647331238 (0.2380291324777481) | > loss_disc_real_4: 0.3026195764541626 (0.23590100766756597) | > loss_disc_real_5: 0.3018799424171448 (0.24046615320138442) | > loss_0: 2.6818480491638184 (2.5587780353350524) | > grad_norm_0: tensor(956.6879, device='cuda:0') (tensor(880.6222, device='cuda:0')) | > loss_gen: 2.0754754543304443 (2.1369717365656142) | > loss_kl: 0.5759885907173157 (0.8354917772305317) | > loss_feat: 3.1432695388793945 (4.749229822307825) | > loss_mel: 23.116777420043945 (20.324447965010616) | > loss_duration: 1.382544755935669 (1.3339912921954424) | > loss_1: 30.294055938720703 (29.380132467318806) | > grad_norm_1: tensor(7268.1035, device='cuda:0') (tensor(21830.9219, device='cuda:0')) | > current_lr_0: 6.977330931225593e-05 | > current_lr_1: 6.977330931225593e-05 | > step_time: 0.6772 (0.6148249369401199) | > loader_time: 0.0323 (0.0257870417374831)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7151975631713867 (2.7151975631713867) | > loss_disc_real_0: 0.25652968883514404 (0.25652968883514404) | > loss_disc_real_1: 0.2783462703227997 (0.2783462703227997) | > loss_disc_real_2: 0.30590537190437317 (0.30590537190437317) | > loss_disc_real_3: 0.34904012084007263 (0.34904012084007263) | > loss_disc_real_4: 0.24953503906726837 (0.24953503906726837) | > loss_disc_real_5: 0.21496647596359253 (0.21496647596359253) | > loss_0: 2.7151975631713867 (2.7151975631713867) | > loss_gen: 2.221905469894409 (2.221905469894409) | > loss_kl: 6.065143585205078 (6.065143585205078) | > loss_feat: 5.0399370193481445 (5.0399370193481445) | > loss_mel: 22.133413314819336 (22.133413314819336) | > loss_duration: 3.087460517883301 (3.087460517883301) | > loss_1: 38.54785919189453 (38.54785919189453)  --> STEP: 1 | > loss_disc: 2.758584499359131 (2.758584499359131) | > loss_disc_real_0: 0.3145584762096405 (0.3145584762096405) | > loss_disc_real_1: 0.2828628420829773 (0.2828628420829773) | > loss_disc_real_2: 0.2685289978981018 (0.2685289978981018) | > loss_disc_real_3: 0.32262927293777466 (0.32262927293777466) | > loss_disc_real_4: 0.29426875710487366 (0.29426875710487366) | > loss_disc_real_5: 0.20239363610744476 (0.20239363610744476) | > loss_0: 2.758584499359131 (2.758584499359131) | > loss_gen: 2.186159372329712 (2.186159372329712) | > loss_kl: 5.159947395324707 (5.159947395324707) | > loss_feat: 4.196793556213379 (4.196793556213379) | > loss_mel: 23.851062774658203 (23.851062774658203) | > loss_duration: 3.302074432373047 (3.302074432373047) | > loss_1: 38.69603729248047 (38.69603729248047)  --> STEP: 2 | > loss_disc: 3.503708839416504 (3.1311466693878174) | > loss_disc_real_0: 1.0760722160339355 (0.695315346121788) | > loss_disc_real_1: 0.2898451089859009 (0.2863539755344391) | > loss_disc_real_2: 0.2302519530057907 (0.24939047545194626) | > loss_disc_real_3: 0.34115344285964966 (0.33189135789871216) | > loss_disc_real_4: 0.2379891574382782 (0.2661289572715759) | > loss_disc_real_5: 0.28217101097106934 (0.24228232353925705) | > loss_0: 3.503708839416504 (3.1311466693878174) | > loss_gen: 2.1988120079040527 (2.1924856901168823) | > loss_kl: 5.3145976066589355 (5.237272500991821) | > loss_feat: 7.1570634841918945 (5.676928520202637) | > loss_mel: 23.125612258911133 (23.488337516784668) | > loss_duration: 3.3350393772125244 (3.3185569047927856) | > loss_1: 41.131126403808594 (39.91358184814453)  --> STEP: 3 | > loss_disc: 3.000250816345215 (3.0875147183736167) | > loss_disc_real_0: 0.4590631425380707 (0.6165646115938822) | > loss_disc_real_1: 0.2690117061138153 (0.2805732190608978) | > loss_disc_real_2: 0.2980051040649414 (0.26559535165627796) | > loss_disc_real_3: 0.28152212500572205 (0.31510161360104877) | > loss_disc_real_4: 0.29949331283569336 (0.27725040912628174) | > loss_disc_real_5: 0.341815322637558 (0.27545998990535736) | > loss_0: 3.000250816345215 (3.0875147183736167) | > loss_gen: 2.3163633346557617 (2.233778238296509) | > loss_kl: 2.3884267807006836 (4.287657260894775) | > loss_feat: 1.8537523746490479 (4.4025364716847735) | > loss_mel: 18.407129287719727 (21.794601440429688) | > loss_duration: 2.9799959659576416 (3.2057032585144043) | > loss_1: 27.945667266845703 (35.924276987711586) --> EVAL PERFORMANCE | > avg_loader_time: 0.0051203568776448565 (-0.0014859040578206386) | > avg_loss_disc: 3.0875147183736167 (+0.20972172419230173) | > avg_loss_disc_real_0: 0.6165646115938822 (+0.20882455507914222) | > avg_loss_disc_real_1: 0.2805732190608978 (+0.022355506817499815) | > avg_loss_disc_real_2: 0.26559535165627796 (-0.04422581692536676) | > avg_loss_disc_real_3: 0.31510161360104877 (+0.06400878230730689) | > avg_loss_disc_real_4: 0.27725040912628174 (-0.090113361676534) | > avg_loss_disc_real_5: 0.27545998990535736 (+0.02985510726769766) | > avg_loss_0: 3.0875147183736167 (+0.20972172419230173) | > avg_loss_gen: 2.233778238296509 (-0.2252978881200156) | > avg_loss_kl: 4.287657260894775 (-0.30144246419270804) | > avg_loss_feat: 4.4025364716847735 (+0.912301922837893) | > avg_loss_mel: 21.794601440429688 (+3.597993214925129) | > avg_loss_duration: 3.2057032585144043 (+0.011676708857218276) | > avg_loss_1: 35.924276987711586 (+3.995230356852211)  > EPOCH: 1054/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:06:45)   --> TIME: 2023-10-20 13:07:02 -- STEP: 19/50 -- GLOBAL_STEP: 105720 | > loss_disc: 3.0406317710876465 (2.529032644472624) | > loss_disc_real_0: 0.2229708731174469 (0.15060820352090032) | > loss_disc_real_1: 0.26685479283332825 (0.22024863330941452) | > loss_disc_real_2: 0.28217029571533203 (0.22582595481684334) | > loss_disc_real_3: 0.2519344985485077 (0.24666438957578257) | > loss_disc_real_4: 0.2551301121711731 (0.2397609046219211) | > loss_disc_real_5: 0.3181900680065155 (0.2450074354480756) | > loss_0: 3.0406317710876465 (2.529032644472624) | > grad_norm_0: tensor(612.9467, device='cuda:0') (tensor(979.3463, device='cuda:0')) | > loss_gen: 1.5587730407714844 (2.136363412204542) | > loss_kl: 0.8335385918617249 (0.8250398463324496) | > loss_feat: 0.05729231983423233 (4.1169172297967105) | > loss_mel: 1.3725024461746216 (19.101414736948517) | > loss_duration: 1.3965169191360474 (1.3700498781706159) | > loss_1: 5.218623161315918 (27.549784961499665) | > grad_norm_1: tensor(69751.4688, device='cuda:0') (tensor(30638.8848, device='cuda:0')) | > current_lr_0: 6.97035665211362e-05 | > current_lr_1: 6.97035665211362e-05 | > step_time: 0.499 (0.5795828166760897) | > loader_time: 0.0069 (0.018951792466013057)  --> TIME: 2023-10-20 13:07:16 -- STEP: 49/50 -- GLOBAL_STEP: 105750 | > loss_disc: 2.4470176696777344 (2.5520388398851668) | > loss_disc_real_0: 0.20017647743225098 (0.1580754480875876) | > loss_disc_real_1: 0.3470350205898285 (0.22446341078956517) | > loss_disc_real_2: 0.22126023471355438 (0.21916890281195545) | > loss_disc_real_3: 0.24798017740249634 (0.2346689532111798) | > loss_disc_real_4: 0.2913874685764313 (0.2402999580894806) | > loss_disc_real_5: 0.36257800459861755 (0.2426678262726993) | > loss_0: 2.4470176696777344 (2.5520388398851668) | > grad_norm_0: tensor(1412.4526, device='cuda:0') (tensor(1434.7211, device='cuda:0')) | > loss_gen: 4.077309608459473 (2.1737942233377567) | > loss_kl: 0.4481702148914337 (0.8253490584237235) | > loss_feat: 8.63278579711914 (4.635166287916353) | > loss_mel: 23.263193130493164 (19.22399603347389) | > loss_duration: 1.4359513521194458 (1.3483947077575995) | > loss_1: 37.8574104309082 (28.206700247161244) | > grad_norm_1: tensor(149904.6562, device='cuda:0') (tensor(40007.1797, device='cuda:0')) | > current_lr_0: 6.97035665211362e-05 | > current_lr_1: 6.97035665211362e-05 | > step_time: 0.7453 (0.49975614158474674) | > loader_time: 0.4383 (0.02214124737953653)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.357173204421997 (2.357173204421997) | > loss_disc_real_0: 0.19792675971984863 (0.19792675971984863) | > loss_disc_real_1: 0.21726979315280914 (0.21726979315280914) | > loss_disc_real_2: 0.29230624437332153 (0.29230624437332153) | > loss_disc_real_3: 0.15397939085960388 (0.15397939085960388) | > loss_disc_real_4: 0.3653047978878021 (0.3653047978878021) | > loss_disc_real_5: 0.29234299063682556 (0.29234299063682556) | > loss_0: 2.357173204421997 (2.357173204421997) | > loss_gen: 2.6864466667175293 (2.6864466667175293) | > loss_kl: 6.918959617614746 (6.918959617614746) | > loss_feat: 7.428089618682861 (7.428089618682861) | > loss_mel: 21.45062255859375 (21.45062255859375) | > loss_duration: 3.041822910308838 (3.041822910308838) | > loss_1: 41.525943756103516 (41.525943756103516)  --> STEP: 1 | > loss_disc: 2.756436586380005 (2.756436586380005) | > loss_disc_real_0: 0.234655499458313 (0.234655499458313) | > loss_disc_real_1: 0.16173920035362244 (0.16173920035362244) | > loss_disc_real_2: 0.25486183166503906 (0.25486183166503906) | > loss_disc_real_3: 0.3218478858470917 (0.3218478858470917) | > loss_disc_real_4: 0.32082489132881165 (0.32082489132881165) | > loss_disc_real_5: 0.3047448396682739 (0.3047448396682739) | > loss_0: 2.756436586380005 (2.756436586380005) | > loss_gen: 2.2054688930511475 (2.2054688930511475) | > loss_kl: 5.929434299468994 (5.929434299468994) | > loss_feat: 7.263336658477783 (7.263336658477783) | > loss_mel: 22.09372901916504 (22.09372901916504) | > loss_duration: 3.349437713623047 (3.349437713623047) | > loss_1: 40.84140396118164 (40.84140396118164)  --> STEP: 2 | > loss_disc: 2.377917528152466 (2.5671770572662354) | > loss_disc_real_0: 0.08748435974121094 (0.16106992959976196) | > loss_disc_real_1: 0.21028542518615723 (0.18601231276988983) | > loss_disc_real_2: 0.24618381261825562 (0.25052282214164734) | > loss_disc_real_3: 0.2704423666000366 (0.29614512622356415) | > loss_disc_real_4: 0.2514213025569916 (0.2861230969429016) | > loss_disc_real_5: 0.35134685039520264 (0.3280458450317383) | > loss_0: 2.377917528152466 (2.5671770572662354) | > loss_gen: 2.4632694721221924 (2.33436918258667) | > loss_kl: 5.5688066482543945 (5.749120473861694) | > loss_feat: 5.962416648864746 (6.612876653671265) | > loss_mel: 22.30579376220703 (22.199761390686035) | > loss_duration: 3.162620782852173 (3.25602924823761) | > loss_1: 39.46290588378906 (40.15215492248535)  --> STEP: 3 | > loss_disc: 2.2527952194213867 (2.4623831113179526) | > loss_disc_real_0: 0.08834191411733627 (0.13682725777228674) | > loss_disc_real_1: 0.2609793543815613 (0.211001326640447) | > loss_disc_real_2: 0.19001251459121704 (0.23035271962483725) | > loss_disc_real_3: 0.21688446402549744 (0.26972490549087524) | > loss_disc_real_4: 0.28216850757598877 (0.284804900487264) | > loss_disc_real_5: 0.2391810268163681 (0.29842423895994824) | > loss_0: 2.2527952194213867 (2.4623831113179526) | > loss_gen: 2.355475664138794 (2.341404676437378) | > loss_kl: 2.489469528198242 (4.662570158640544) | > loss_feat: 3.285991668701172 (5.503914992014567) | > loss_mel: 19.402788162231445 (21.267436981201172) | > loss_duration: 2.9332687854766846 (3.1484424273173013) | > loss_1: 30.466995239257812 (36.92376836140951) --> EVAL PERFORMANCE | > avg_loader_time: 0.0044316450754801435 (-0.000688711802164713) | > avg_loss_disc: 2.4623831113179526 (-0.6251316070556641) | > avg_loss_disc_real_0: 0.13682725777228674 (-0.47973735382159544) | > avg_loss_disc_real_1: 0.211001326640447 (-0.06957189242045084) | > avg_loss_disc_real_2: 0.23035271962483725 (-0.03524263203144071) | > avg_loss_disc_real_3: 0.26972490549087524 (-0.045376708110173525) | > avg_loss_disc_real_4: 0.284804900487264 (+0.007554491360982241) | > avg_loss_disc_real_5: 0.29842423895994824 (+0.02296424905459088) | > avg_loss_0: 2.4623831113179526 (-0.6251316070556641) | > avg_loss_gen: 2.341404676437378 (+0.10762643814086914) | > avg_loss_kl: 4.662570158640544 (+0.3749128977457685) | > avg_loss_feat: 5.503914992014567 (+1.1013785203297939) | > avg_loss_mel: 21.267436981201172 (-0.5271644592285156) | > avg_loss_duration: 3.1484424273173013 (-0.05726083119710301) | > avg_loss_1: 36.92376836140951 (+0.9994913736979214)  > EPOCH: 1055/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:07:36)   --> TIME: 2023-10-20 13:08:00 -- STEP: 29/50 -- GLOBAL_STEP: 105780 | > loss_disc: 1.7653050422668457 (2.3548870107223254) | > loss_disc_real_0: 0.05491698533296585 (0.14246424146253486) | > loss_disc_real_1: 0.06704561412334442 (0.20078156426035124) | > loss_disc_real_2: 0.11158900707960129 (0.20228591198422785) | > loss_disc_real_3: 0.24743695557117462 (0.2361517188877895) | > loss_disc_real_4: 0.04932113736867905 (0.19715615843647513) | > loss_disc_real_5: 0.14700095355510712 (0.20476820445137806) | > loss_0: 1.7653050422668457 (2.3548870107223254) | > grad_norm_0: tensor(348.9092, device='cuda:0') (tensor(780.7031, device='cuda:0')) | > loss_gen: 2.8227381706237793 (2.394495072035955) | > loss_kl: 0.9021306037902832 (0.8680438563741487) | > loss_feat: 8.719743728637695 (7.022677937458301) | > loss_mel: 21.53365707397461 (22.032004866106757) | > loss_duration: 1.3522707223892212 (1.3417766916340794) | > loss_1: 35.33053970336914 (33.658998226297314) | > grad_norm_1: tensor(8594.1865, device='cuda:0') (tensor(24106.4648, device='cuda:0')) | > current_lr_0: 6.963389344230275e-05 | > current_lr_1: 6.963389344230275e-05 | > step_time: 0.6665 (0.6052234830527471) | > loader_time: 0.0366 (0.024958158361500705)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5630404949188232 (2.5630404949188232) | > loss_disc_real_0: 0.31263267993927 (0.31263267993927) | > loss_disc_real_1: 0.20810705423355103 (0.20810705423355103) | > loss_disc_real_2: 0.2519931197166443 (0.2519931197166443) | > loss_disc_real_3: 0.26559343934059143 (0.26559343934059143) | > loss_disc_real_4: 0.33409664034843445 (0.33409664034843445) | > loss_disc_real_5: 0.21416722238063812 (0.21416722238063812) | > loss_0: 2.5630404949188232 (2.5630404949188232) | > loss_gen: 2.5998096466064453 (2.5998096466064453) | > loss_kl: 5.7987189292907715 (5.7987189292907715) | > loss_feat: 5.967575550079346 (5.967575550079346) | > loss_mel: 19.63701629638672 (19.63701629638672) | > loss_duration: 2.9913313388824463 (2.9913313388824463) | > loss_1: 36.99445343017578 (36.99445343017578)  --> STEP: 1 | > loss_disc: 2.698594570159912 (2.698594570159912) | > loss_disc_real_0: 0.3172401785850525 (0.3172401785850525) | > loss_disc_real_1: 0.25288501381874084 (0.25288501381874084) | > loss_disc_real_2: 0.3536095917224884 (0.3536095917224884) | > loss_disc_real_3: 0.23983213305473328 (0.23983213305473328) | > loss_disc_real_4: 0.34257209300994873 (0.34257209300994873) | > loss_disc_real_5: 0.32733118534088135 (0.32733118534088135) | > loss_0: 2.698594570159912 (2.698594570159912) | > loss_gen: 2.6139132976531982 (2.6139132976531982) | > loss_kl: 5.508394241333008 (5.508394241333008) | > loss_feat: 4.406947135925293 (4.406947135925293) | > loss_mel: 24.850862503051758 (24.850862503051758) | > loss_duration: 3.4394171237945557 (3.4394171237945557) | > loss_1: 40.81953811645508 (40.81953811645508)  --> STEP: 2 | > loss_disc: 2.9244744777679443 (2.8115345239639282) | > loss_disc_real_0: 0.6484404802322388 (0.48284032940864563) | > loss_disc_real_1: 0.4145394265651703 (0.33371222019195557) | > loss_disc_real_2: 0.23160454630851746 (0.29260706901550293) | > loss_disc_real_3: 0.24080371856689453 (0.2403179258108139) | > loss_disc_real_4: 0.3887346684932709 (0.3656533807516098) | > loss_disc_real_5: 0.2109050154685974 (0.2691181004047394) | > loss_0: 2.9244744777679443 (2.8115345239639282) | > loss_gen: 3.0584826469421387 (2.8361979722976685) | > loss_kl: 5.801676273345947 (5.6550352573394775) | > loss_feat: 9.350645065307617 (6.878796100616455) | > loss_mel: 25.365161895751953 (25.108012199401855) | > loss_duration: 3.105458974838257 (3.2724380493164062) | > loss_1: 46.68142318725586 (43.75048065185547)  --> STEP: 3 | > loss_disc: 2.8663322925567627 (2.8298004468282065) | > loss_disc_real_0: 0.23476657271385193 (0.40014907717704773) | > loss_disc_real_1: 0.22456584870815277 (0.2973300963640213) | > loss_disc_real_2: 0.31048545241355896 (0.2985665301481883) | > loss_disc_real_3: 0.24568572640419006 (0.24210719267527261) | > loss_disc_real_4: 0.26236850023269653 (0.33122508724530536) | > loss_disc_real_5: 0.29471397399902344 (0.27765005826950073) | > loss_0: 2.8663322925567627 (2.8298004468282065) | > loss_gen: 1.7840932607650757 (2.485496401786804) | > loss_kl: 2.5700433254241943 (4.626704613367717) | > loss_feat: 0.932277262210846 (4.896623154481252) | > loss_mel: 16.6063175201416 (22.27411397298177) | > loss_duration: 2.9485809803009033 (3.1644856929779053) | > loss_1: 24.8413143157959 (37.44742520650228) --> EVAL PERFORMANCE | > avg_loader_time: 0.009247223536173502 (+0.0048155784606933585) | > avg_loss_disc: 2.8298004468282065 (+0.3674173355102539) | > avg_loss_disc_real_0: 0.40014907717704773 (+0.26332181940476096) | > avg_loss_disc_real_1: 0.2973300963640213 (+0.08632876972357431) | > avg_loss_disc_real_2: 0.2985665301481883 (+0.06821381052335104) | > avg_loss_disc_real_3: 0.24210719267527261 (-0.02761771281560263) | > avg_loss_disc_real_4: 0.33122508724530536 (+0.04642018675804138) | > avg_loss_disc_real_5: 0.27765005826950073 (-0.020774180690447508) | > avg_loss_0: 2.8298004468282065 (+0.3674173355102539) | > avg_loss_gen: 2.485496401786804 (+0.14409172534942627) | > avg_loss_kl: 4.626704613367717 (-0.03586554527282715) | > avg_loss_feat: 4.896623154481252 (-0.6072918375333156) | > avg_loss_mel: 22.27411397298177 (+1.0066769917805978) | > avg_loss_duration: 3.1644856929779053 (+0.01604326566060399) | > avg_loss_1: 37.44742520650228 (+0.5236568450927734)  > EPOCH: 1056/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:08:46)   --> TIME: 2023-10-20 13:08:57 -- STEP: 9/50 -- GLOBAL_STEP: 105810 | > loss_disc: 2.6297402381896973 (2.2064265807469687) | > loss_disc_real_0: 0.06709402054548264 (0.13339714395503202) | > loss_disc_real_1: 0.349690705537796 (0.23671909918387732) | > loss_disc_real_2: 0.36341410875320435 (0.22105142805311415) | > loss_disc_real_3: 0.2329801619052887 (0.2267293483018875) | > loss_disc_real_4: 0.3866783678531647 (0.21640447444385952) | > loss_disc_real_5: 0.3004416525363922 (0.1648504961695936) | > loss_0: 2.6297402381896973 (2.2064265807469687) | > grad_norm_0: tensor(451.7137, device='cuda:0') (tensor(485.4194, device='cuda:0')) | > loss_gen: 2.389976978302002 (2.6105980608198376) | > loss_kl: 0.2972657084465027 (0.7978528382049667) | > loss_feat: 4.390422344207764 (7.233303917778863) | > loss_mel: 23.17746353149414 (21.696635405222576) | > loss_duration: 1.3304884433746338 (1.3627732064988878) | > loss_1: 31.585615158081055 (33.70116255018446) | > grad_norm_1: tensor(6426.8740, device='cuda:0') (tensor(28647.1660, device='cuda:0')) | > current_lr_0: 6.95642900060738e-05 | > current_lr_1: 6.95642900060738e-05 | > step_time: 0.516 (0.6716438134511312) | > loader_time: 0.0224 (0.02768021159701877)  --> TIME: 2023-10-20 13:09:17 -- STEP: 39/50 -- GLOBAL_STEP: 105840 | > loss_disc: 2.70980167388916 (2.4609469450437107) | > loss_disc_real_0: 0.1429620385169983 (0.1490425652322861) | > loss_disc_real_1: 0.24504642188549042 (0.22329557199890798) | > loss_disc_real_2: 0.2220858931541443 (0.21015942765352053) | > loss_disc_real_3: 0.31052249670028687 (0.24713958341341752) | > loss_disc_real_4: 0.3168072998523712 (0.23445688971342185) | > loss_disc_real_5: 0.38118666410446167 (0.2306835050575244) | > loss_0: 2.70980167388916 (2.4609469450437107) | > grad_norm_0: tensor(826.0392, device='cuda:0') (tensor(656.2664, device='cuda:0')) | > loss_gen: 2.1619935035705566 (2.30601765253605) | > loss_kl: 0.30262890458106995 (0.8011987730860711) | > loss_feat: 2.884796142578125 (5.626586579646055) | > loss_mel: 23.216304779052734 (19.87656934444721) | > loss_duration: 1.403585433959961 (1.348561555911333) | > loss_1: 29.969308853149414 (29.958933744675075) | > grad_norm_1: tensor(2909.1802, device='cuda:0') (tensor(23072.9492, device='cuda:0')) | > current_lr_0: 6.95642900060738e-05 | > current_lr_1: 6.95642900060738e-05 | > step_time: 0.5958 (0.6516937292539158) | > loader_time: 0.0231 (0.02209989229838053)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2603261470794678 (3.2603261470794678) | > loss_disc_real_0: 0.3792855143547058 (0.3792855143547058) | > loss_disc_real_1: 0.25754761695861816 (0.25754761695861816) | > loss_disc_real_2: 0.40562862157821655 (0.40562862157821655) | > loss_disc_real_3: 0.2154272496700287 (0.2154272496700287) | > loss_disc_real_4: 0.386113703250885 (0.386113703250885) | > loss_disc_real_5: 0.44675320386886597 (0.44675320386886597) | > loss_0: 3.2603261470794678 (3.2603261470794678) | > loss_gen: 2.1357874870300293 (2.1357874870300293) | > loss_kl: 5.629122734069824 (5.629122734069824) | > loss_feat: 5.525455951690674 (5.525455951690674) | > loss_mel: 21.638505935668945 (21.638505935668945) | > loss_duration: 2.987569570541382 (2.987569570541382) | > loss_1: 37.916439056396484 (37.916439056396484)  --> STEP: 1 | > loss_disc: 3.418323040008545 (3.418323040008545) | > loss_disc_real_0: 0.3020409345626831 (0.3020409345626831) | > loss_disc_real_1: 0.31152454018592834 (0.31152454018592834) | > loss_disc_real_2: 0.3350156247615814 (0.3350156247615814) | > loss_disc_real_3: 0.2246827781200409 (0.2246827781200409) | > loss_disc_real_4: 0.3038925230503082 (0.3038925230503082) | > loss_disc_real_5: 0.4021780490875244 (0.4021780490875244) | > loss_0: 3.418323040008545 (3.418323040008545) | > loss_gen: 1.7702991962432861 (1.7702991962432861) | > loss_kl: 5.486938953399658 (5.486938953399658) | > loss_feat: 6.563270568847656 (6.563270568847656) | > loss_mel: 22.356924057006836 (22.356924057006836) | > loss_duration: 3.247244358062744 (3.247244358062744) | > loss_1: 39.424678802490234 (39.424678802490234)  --> STEP: 2 | > loss_disc: 2.42663311958313 (2.9224780797958374) | > loss_disc_real_0: 0.13088375329971313 (0.21646234393119812) | > loss_disc_real_1: 0.20699436962604523 (0.2592594549059868) | > loss_disc_real_2: 0.2283642441034317 (0.28168993443250656) | > loss_disc_real_3: 0.29803240299224854 (0.2613575905561447) | > loss_disc_real_4: 0.3064210116863251 (0.30515676736831665) | > loss_disc_real_5: 0.31756138801574707 (0.35986971855163574) | > loss_0: 2.42663311958313 (2.9224780797958374) | > loss_gen: 2.4316155910491943 (2.1009573936462402) | > loss_kl: 5.728358268737793 (5.607648611068726) | > loss_feat: 3.4776017665863037 (5.02043616771698) | > loss_mel: 23.581584930419922 (22.96925449371338) | > loss_duration: 3.1902315616607666 (3.2187379598617554) | > loss_1: 38.40938949584961 (38.91703414916992)  --> STEP: 3 | > loss_disc: 2.829608201980591 (2.891521453857422) | > loss_disc_real_0: 0.22730739414691925 (0.22007736066977182) | > loss_disc_real_1: 0.35264137387275696 (0.29038676122824353) | > loss_disc_real_2: 0.17269206047058105 (0.2453573097785314) | > loss_disc_real_3: 0.2658766806125641 (0.2628639539082845) | > loss_disc_real_4: 0.3554433286190033 (0.32191895445187885) | > loss_disc_real_5: 0.29607945680618286 (0.3386062979698181) | > loss_0: 2.829608201980591 (2.891521453857422) | > loss_gen: 2.2644309997558594 (2.15544859568278) | > loss_kl: 2.9356179237365723 (4.716971715291341) | > loss_feat: 4.401867866516113 (4.8142467339833575) | > loss_mel: 19.74332046508789 (21.893943150838215) | > loss_duration: 2.9254915714263916 (3.1209891637166343) | > loss_1: 32.270729064941406 (36.70159912109375) --> EVAL PERFORMANCE | > avg_loader_time: 0.023842255274454754 (+0.014595031738281252) | > avg_loss_disc: 2.891521453857422 (+0.06172100702921535) | > avg_loss_disc_real_0: 0.22007736066977182 (-0.1800717165072759) | > avg_loss_disc_real_1: 0.29038676122824353 (-0.006943335135777773) | > avg_loss_disc_real_2: 0.2453573097785314 (-0.05320922036965689) | > avg_loss_disc_real_3: 0.2628639539082845 (+0.020756761233011872) | > avg_loss_disc_real_4: 0.32191895445187885 (-0.009306132793426514) | > avg_loss_disc_real_5: 0.3386062979698181 (+0.06095623970031738) | > avg_loss_0: 2.891521453857422 (+0.06172100702921535) | > avg_loss_gen: 2.15544859568278 (-0.3300478061040244) | > avg_loss_kl: 4.716971715291341 (+0.09026710192362408) | > avg_loss_feat: 4.8142467339833575 (-0.08237642049789429) | > avg_loss_mel: 21.893943150838215 (-0.3801708221435547) | > avg_loss_duration: 3.1209891637166343 (-0.04349652926127101) | > avg_loss_1: 36.70159912109375 (-0.745826085408531)  > EPOCH: 1057/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:09:37)   --> TIME: 2023-10-20 13:09:55 -- STEP: 19/50 -- GLOBAL_STEP: 105870 | > loss_disc: 1.876169204711914 (2.4131548028243217) | > loss_disc_real_0: 0.01952621527016163 (0.1325449972462497) | > loss_disc_real_1: 0.16074210405349731 (0.21378369707810252) | > loss_disc_real_2: 0.21571899950504303 (0.2249886919009058) | > loss_disc_real_3: 0.14852991700172424 (0.21886058347789863) | > loss_disc_real_4: 0.11485879868268967 (0.24133443126552984) | > loss_disc_real_5: 0.14186370372772217 (0.2165896451394809) | > loss_0: 1.876169204711914 (2.4131548028243217) | > grad_norm_0: tensor(308.0714, device='cuda:0') (tensor(615.6536, device='cuda:0')) | > loss_gen: 2.5259206295013428 (2.3308488318794653) | > loss_kl: 0.8649383783340454 (0.8072714915401057) | > loss_feat: 9.856240272521973 (6.68818103737737) | > loss_mel: 23.897113800048828 (22.328142906490125) | > loss_duration: 1.4812642335891724 (1.3916567375785427) | > loss_1: 38.62548065185547 (33.54610136935585) | > grad_norm_1: tensor(9340.5400, device='cuda:0') (tensor(18413.3750, device='cuda:0')) | > current_lr_0: 6.949475614283718e-05 | > current_lr_1: 6.949475614283718e-05 | > step_time: 0.645 (0.6722091875578228) | > loader_time: 0.0239 (0.021214372233340616)  --> TIME: 2023-10-20 13:10:10 -- STEP: 49/50 -- GLOBAL_STEP: 105900 | > loss_disc: 2.1426520347595215 (2.405883419270418) | > loss_disc_real_0: 0.08528365939855576 (0.1427939156906641) | > loss_disc_real_1: 0.2221522480249405 (0.21921350806951523) | > loss_disc_real_2: 0.23187391459941864 (0.22566975356668842) | > loss_disc_real_3: 0.176335871219635 (0.2210112967509396) | > loss_disc_real_4: 0.21202491223812103 (0.21723410206827887) | > loss_disc_real_5: 0.19858045876026154 (0.20171032868781869) | > loss_0: 2.1426520347595215 (2.405883419270418) | > grad_norm_0: tensor(520.7974, device='cuda:0') (tensor(590.3492, device='cuda:0')) | > loss_gen: 2.3312034606933594 (2.3090101115557617) | > loss_kl: 0.9637117981910706 (0.8163397725747557) | > loss_feat: 3.4699745178222656 (6.345116478219931) | > loss_mel: 22.189393997192383 (22.1239748536324) | > loss_duration: 1.4234153032302856 (1.349660197082831) | > loss_1: 30.377700805664062 (32.94410150878282) | > grad_norm_1: tensor(2646.8176, device='cuda:0') (tensor(15030.6436, device='cuda:0')) | > current_lr_0: 6.949475614283718e-05 | > current_lr_1: 6.949475614283718e-05 | > step_time: 0.2486 (0.5409979576967201) | > loader_time: 0.373 (0.024804976521706094)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6436524391174316 (2.6436524391174316) | > loss_disc_real_0: 0.3365643322467804 (0.3365643322467804) | > loss_disc_real_1: 0.2695729732513428 (0.2695729732513428) | > loss_disc_real_2: 0.2924204170703888 (0.2924204170703888) | > loss_disc_real_3: 0.20680491626262665 (0.20680491626262665) | > loss_disc_real_4: 0.44519203901290894 (0.44519203901290894) | > loss_disc_real_5: 0.3833501636981964 (0.3833501636981964) | > loss_0: 2.6436524391174316 (2.6436524391174316) | > loss_gen: 2.9881675243377686 (2.9881675243377686) | > loss_kl: 5.430418014526367 (5.430418014526367) | > loss_feat: 8.125288963317871 (8.125288963317871) | > loss_mel: 23.628437042236328 (23.628437042236328) | > loss_duration: 3.091595411300659 (3.091595411300659) | > loss_1: 43.2639045715332 (43.2639045715332)  --> STEP: 1 | > loss_disc: 3.2268261909484863 (3.2268261909484863) | > loss_disc_real_0: 0.3140355050563812 (0.3140355050563812) | > loss_disc_real_1: 0.32568395137786865 (0.32568395137786865) | > loss_disc_real_2: 0.3423253297805786 (0.3423253297805786) | > loss_disc_real_3: 0.37217289209365845 (0.37217289209365845) | > loss_disc_real_4: 0.5741644501686096 (0.5741644501686096) | > loss_disc_real_5: 0.5240164399147034 (0.5240164399147034) | > loss_0: 3.2268261909484863 (3.2268261909484863) | > loss_gen: 2.9150073528289795 (2.9150073528289795) | > loss_kl: 5.117355823516846 (5.117355823516846) | > loss_feat: 7.408435344696045 (7.408435344696045) | > loss_mel: 24.0396728515625 (24.0396728515625) | > loss_duration: 3.3763043880462646 (3.3763043880462646) | > loss_1: 42.85677719116211 (42.85677719116211)  --> STEP: 2 | > loss_disc: 3.307645559310913 (3.2672358751296997) | > loss_disc_real_0: 0.4934588074684143 (0.40374715626239777) | > loss_disc_real_1: 0.20028792321681976 (0.2629859372973442) | > loss_disc_real_2: 0.2209143191576004 (0.2816198244690895) | > loss_disc_real_3: 0.2669183313846588 (0.31954561173915863) | > loss_disc_real_4: 0.3833884298801422 (0.4787764400243759) | > loss_disc_real_5: 0.6068733930587769 (0.5654449164867401) | > loss_0: 3.307645559310913 (3.2672358751296997) | > loss_gen: 2.2391045093536377 (2.5770559310913086) | > loss_kl: 5.7810845375061035 (5.449220180511475) | > loss_feat: 7.088793754577637 (7.248614549636841) | > loss_mel: 20.629602432250977 (22.33463764190674) | > loss_duration: 3.2584753036499023 (3.3173898458480835) | > loss_1: 38.99706268310547 (40.92691993713379)  --> STEP: 3 | > loss_disc: 2.7238879203796387 (3.0861198902130127) | > loss_disc_real_0: 0.18668663501739502 (0.33139364918073017) | > loss_disc_real_1: 0.21246667206287384 (0.2461461822191874) | > loss_disc_real_2: 0.23575595021247864 (0.26633186638355255) | > loss_disc_real_3: 0.23949970304965973 (0.2928636421759923) | > loss_disc_real_4: 0.31410232186317444 (0.4238850673039754) | > loss_disc_real_5: 0.469585657119751 (0.533491830031077) | > loss_0: 2.7238879203796387 (3.0861198902130127) | > loss_gen: 2.225658416748047 (2.459923426310221) | > loss_kl: 2.708514928817749 (4.5356517632802325) | > loss_feat: 2.693847894668579 (5.730358997980754) | > loss_mel: 20.837913513183594 (21.835729598999023) | > loss_duration: 2.960968255996704 (3.198582649230957) | > loss_1: 31.426902770996094 (37.760247548421226) --> EVAL PERFORMANCE | > avg_loader_time: 0.009756008783976236 (-0.014086246490478517) | > avg_loss_disc: 3.0861198902130127 (+0.19459843635559082) | > avg_loss_disc_real_0: 0.33139364918073017 (+0.11131628851095834) | > avg_loss_disc_real_1: 0.2461461822191874 (-0.04424057900905612) | > avg_loss_disc_real_2: 0.26633186638355255 (+0.02097455660502115) | > avg_loss_disc_real_3: 0.2928636421759923 (+0.029999688267707825) | > avg_loss_disc_real_4: 0.4238850673039754 (+0.10196611285209656) | > avg_loss_disc_real_5: 0.533491830031077 (+0.19488553206125891) | > avg_loss_0: 3.0861198902130127 (+0.19459843635559082) | > avg_loss_gen: 2.459923426310221 (+0.3044748306274414) | > avg_loss_kl: 4.5356517632802325 (-0.1813199520111084) | > avg_loss_feat: 5.730358997980754 (+0.9161122639973964) | > avg_loss_mel: 21.835729598999023 (-0.058213551839191524) | > avg_loss_duration: 3.198582649230957 (+0.07759348551432277) | > avg_loss_1: 37.760247548421226 (+1.0586484273274763)  > EPOCH: 1058/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:10:25)   --> TIME: 2023-10-20 13:10:46 -- STEP: 29/50 -- GLOBAL_STEP: 105930 | > loss_disc: 2.6897637844085693 (2.44967631841528) | > loss_disc_real_0: 0.26997581124305725 (0.16059499205057992) | > loss_disc_real_1: 0.24983525276184082 (0.2225060629947432) | > loss_disc_real_2: 0.2600719928741455 (0.22964132757022462) | > loss_disc_real_3: 0.28212982416152954 (0.2542946399671251) | > loss_disc_real_4: 0.3019919991493225 (0.23887069112267986) | > loss_disc_real_5: 0.2988302409648895 (0.23866037945744806) | > loss_0: 2.6897637844085693 (2.44967631841528) | > grad_norm_0: tensor(1103.6709, device='cuda:0') (tensor(621.0930, device='cuda:0')) | > loss_gen: 2.1683871746063232 (2.342373145037684) | > loss_kl: 0.6905943155288696 (0.8428687563744085) | > loss_feat: 1.980461835861206 (4.822640296071768) | > loss_mel: 16.227304458618164 (19.653428190741046) | > loss_duration: 1.3375415802001953 (1.3409794281268943) | > loss_1: 22.40428924560547 (29.002289837804334) | > grad_norm_1: tensor(3588.4548, device='cuda:0') (tensor(21164.1016, device='cuda:0')) | > current_lr_0: 6.942529178305034e-05 | > current_lr_1: 6.942529178305034e-05 | > step_time: 0.4533 (0.5618032915838833) | > loader_time: 0.0288 (0.025242945243572366)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.309499979019165 (1.309499979019165) | > loss_disc_real_0: 0.07460327446460724 (0.07460327446460724) | > loss_disc_real_1: 0.18079859018325806 (0.18079859018325806) | > loss_disc_real_2: 0.09655453264713287 (0.09655453264713287) | > loss_disc_real_3: 0.11366816610097885 (0.11366816610097885) | > loss_disc_real_4: 0.13753947615623474 (0.13753947615623474) | > loss_disc_real_5: 0.08956719934940338 (0.08956719934940338) | > loss_0: 1.309499979019165 (1.309499979019165) | > loss_gen: 3.61674165725708 (3.61674165725708) | > loss_kl: 5.388550281524658 (5.388550281524658) | > loss_feat: 13.635820388793945 (13.635820388793945) | > loss_mel: 25.8174991607666 (25.8174991607666) | > loss_duration: 2.973288059234619 (2.973288059234619) | > loss_1: 51.43190002441406 (51.43190002441406)  --> STEP: 1 | > loss_disc: 2.746838331222534 (2.746838331222534) | > loss_disc_real_0: 0.20136404037475586 (0.20136404037475586) | > loss_disc_real_1: 0.29639023542404175 (0.29639023542404175) | > loss_disc_real_2: 0.36072683334350586 (0.36072683334350586) | > loss_disc_real_3: 0.23151175677776337 (0.23151175677776337) | > loss_disc_real_4: 0.44823965430259705 (0.44823965430259705) | > loss_disc_real_5: 0.4957405924797058 (0.4957405924797058) | > loss_0: 2.746838331222534 (2.746838331222534) | > loss_gen: 2.970777988433838 (2.970777988433838) | > loss_kl: 5.325150966644287 (5.325150966644287) | > loss_feat: 6.870291233062744 (6.870291233062744) | > loss_mel: 19.872770309448242 (19.872770309448242) | > loss_duration: 3.2929296493530273 (3.2929296493530273) | > loss_1: 38.33192443847656 (38.33192443847656)  --> STEP: 2 | > loss_disc: 2.7760777473449707 (2.7614580392837524) | > loss_disc_real_0: 0.2674468159675598 (0.23440542817115784) | > loss_disc_real_1: 0.23612898588180542 (0.2662596106529236) | > loss_disc_real_2: 0.19805485010147095 (0.2793908417224884) | > loss_disc_real_3: 0.18089625239372253 (0.20620400458574295) | > loss_disc_real_4: 0.1912902593612671 (0.31976495683193207) | > loss_disc_real_5: 0.17266717553138733 (0.33420388400554657) | > loss_0: 2.7760777473449707 (2.7614580392837524) | > loss_gen: 1.6365107297897339 (2.303644359111786) | > loss_kl: 5.6465959548950195 (5.485873460769653) | > loss_feat: 3.9552183151245117 (5.412754774093628) | > loss_mel: 15.944291114807129 (17.908530712127686) | > loss_duration: 3.21234393119812 (3.2526367902755737) | > loss_1: 30.39495849609375 (34.363441467285156)  --> STEP: 3 | > loss_disc: 3.153677463531494 (2.892197847366333) | > loss_disc_real_0: 0.25165507197380066 (0.24015530943870544) | > loss_disc_real_1: 0.3637144863605499 (0.2987445692221324) | > loss_disc_real_2: 0.3817004859447479 (0.3134940564632416) | > loss_disc_real_3: 0.3315102159976959 (0.2479727417230606) | > loss_disc_real_4: 0.41427290439605713 (0.35126760601997375) | > loss_disc_real_5: 0.47095486521720886 (0.379787544409434) | > loss_0: 3.153677463531494 (2.892197847366333) | > loss_gen: 2.4273769855499268 (2.3448885679244995) | > loss_kl: 3.074462890625 (4.6820699373881025) | > loss_feat: 3.495499610900879 (4.773669719696045) | > loss_mel: 18.781044006347656 (18.199368476867676) | > loss_duration: 2.981675863265991 (3.1623164812723794) | > loss_1: 30.760059356689453 (33.162314097086586) --> EVAL PERFORMANCE | > avg_loader_time: 0.03473909695943197 (+0.024983088175455734) | > avg_loss_disc: 2.892197847366333 (-0.1939220428466797) | > avg_loss_disc_real_0: 0.24015530943870544 (-0.09123833974202472) | > avg_loss_disc_real_1: 0.2987445692221324 (+0.052598387002944974) | > avg_loss_disc_real_2: 0.3134940564632416 (+0.047162190079689026) | > avg_loss_disc_real_3: 0.2479727417230606 (-0.044890900452931704) | > avg_loss_disc_real_4: 0.35126760601997375 (-0.07261746128400165) | > avg_loss_disc_real_5: 0.379787544409434 (-0.153704285621643) | > avg_loss_0: 2.892197847366333 (-0.1939220428466797) | > avg_loss_gen: 2.3448885679244995 (-0.1150348583857217) | > avg_loss_kl: 4.6820699373881025 (+0.14641817410787006) | > avg_loss_feat: 4.773669719696045 (-0.956689278284709) | > avg_loss_mel: 18.199368476867676 (-3.6363611221313477) | > avg_loss_duration: 3.1623164812723794 (-0.03626616795857762) | > avg_loss_1: 33.162314097086586 (-4.59793345133464)  > EPOCH: 1059/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:11:13)   --> TIME: 2023-10-20 13:11:25 -- STEP: 9/50 -- GLOBAL_STEP: 105960 | > loss_disc: 2.570543050765991 (2.4720729986826577) | > loss_disc_real_0: 0.1101522296667099 (0.1267326358291838) | > loss_disc_real_1: 0.4281538426876068 (0.21605044851700464) | > loss_disc_real_2: 0.2286207377910614 (0.20309765140215555) | > loss_disc_real_3: 0.3154394030570984 (0.2154184869594044) | > loss_disc_real_4: 0.28474223613739014 (0.2369816613694032) | > loss_disc_real_5: 0.33263835310935974 (0.2163583772877852) | > loss_0: 2.570543050765991 (2.4720729986826577) | > grad_norm_0: tensor(814.9435, device='cuda:0') (tensor(616.4314, device='cuda:0')) | > loss_gen: 2.7816197872161865 (2.4191935062408447) | > loss_kl: 0.5599645376205444 (0.6481932004292806) | > loss_feat: 5.184484958648682 (6.435651229487525) | > loss_mel: 20.366674423217773 (20.413866996765137) | > loss_duration: 1.3262686729431152 (1.349072231186761) | > loss_1: 30.219013214111328 (31.26597722371419) | > grad_norm_1: tensor(18170.9219, device='cuda:0') (tensor(30372.8398, device='cuda:0')) | > current_lr_0: 6.935589685724022e-05 | > current_lr_1: 6.935589685724022e-05 | > step_time: 0.7255 (0.6208290788862441) | > loader_time: 0.0348 (0.027745591269599065)  --> TIME: 2023-10-20 13:11:44 -- STEP: 39/50 -- GLOBAL_STEP: 105990 | > loss_disc: 2.391672134399414 (2.4961427572445993) | > loss_disc_real_0: 0.14555098116397858 (0.13786139759497765) | > loss_disc_real_1: 0.49162325263023376 (0.22900573832866472) | > loss_disc_real_2: 0.29345282912254333 (0.22831985767548665) | > loss_disc_real_3: 0.28357458114624023 (0.22969912704175863) | > loss_disc_real_4: 0.3267001211643219 (0.23193528706160108) | > loss_disc_real_5: 0.13880625367164612 (0.22522413309138173) | > loss_0: 2.391672134399414 (2.4961427572445993) | > grad_norm_0: tensor(1224.8909, device='cuda:0') (tensor(763.8313, device='cuda:0')) | > loss_gen: 2.778531312942505 (2.247948050498963) | > loss_kl: 0.9079750776290894 (0.7843938446961917) | > loss_feat: 4.927438735961914 (5.225324476567598) | > loss_mel: 21.289762496948242 (20.536869489229645) | > loss_duration: 1.4391940832138062 (1.3358108477714734) | > loss_1: 31.3429012298584 (30.130346872867683) | > grad_norm_1: tensor(20756.4688, device='cuda:0') (tensor(22785.8789, device='cuda:0')) | > current_lr_0: 6.935589685724022e-05 | > current_lr_1: 6.935589685724022e-05 | > step_time: 0.3802 (0.6078066397935914) | > loader_time: 0.0244 (0.023884382003392927)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1864335536956787 (3.1864335536956787) | > loss_disc_real_0: 0.3766331672668457 (0.3766331672668457) | > loss_disc_real_1: 0.19609272480010986 (0.19609272480010986) | > loss_disc_real_2: 0.20975279808044434 (0.20975279808044434) | > loss_disc_real_3: 0.27349308133125305 (0.27349308133125305) | > loss_disc_real_4: 0.3281988501548767 (0.3281988501548767) | > loss_disc_real_5: 0.37855708599090576 (0.37855708599090576) | > loss_0: 3.1864335536956787 (3.1864335536956787) | > loss_gen: 1.9693894386291504 (1.9693894386291504) | > loss_kl: 5.4171576499938965 (5.4171576499938965) | > loss_feat: 5.3557024002075195 (5.3557024002075195) | > loss_mel: 22.962282180786133 (22.962282180786133) | > loss_duration: 3.076233386993408 (3.076233386993408) | > loss_1: 38.780765533447266 (38.780765533447266)  --> STEP: 1 | > loss_disc: 2.767930507659912 (2.767930507659912) | > loss_disc_real_0: 0.1469855010509491 (0.1469855010509491) | > loss_disc_real_1: 0.22900675237178802 (0.22900675237178802) | > loss_disc_real_2: 0.18233108520507812 (0.18233108520507812) | > loss_disc_real_3: 0.18668688833713531 (0.18668688833713531) | > loss_disc_real_4: 0.2973038852214813 (0.2973038852214813) | > loss_disc_real_5: 0.40563929080963135 (0.40563929080963135) | > loss_0: 2.767930507659912 (2.767930507659912) | > loss_gen: 1.921004295349121 (1.921004295349121) | > loss_kl: 5.360337257385254 (5.360337257385254) | > loss_feat: 5.767460346221924 (5.767460346221924) | > loss_mel: 23.495010375976562 (23.495010375976562) | > loss_duration: 3.3438076972961426 (3.3438076972961426) | > loss_1: 39.88762283325195 (39.88762283325195)  --> STEP: 2 | > loss_disc: 2.4945483207702637 (2.631239414215088) | > loss_disc_real_0: 0.2806372344493866 (0.21381136775016785) | > loss_disc_real_1: 0.2693508565425873 (0.24917880445718765) | > loss_disc_real_2: 0.221030592918396 (0.20168083906173706) | > loss_disc_real_3: 0.16516506671905518 (0.17592597752809525) | > loss_disc_real_4: 0.10410165786743164 (0.20070277154445648) | > loss_disc_real_5: 0.11404415220022202 (0.2598417215049267) | > loss_0: 2.4945483207702637 (2.631239414215088) | > loss_gen: 2.0097155570983887 (1.9653599262237549) | > loss_kl: 5.773797512054443 (5.567067384719849) | > loss_feat: 7.34959077835083 (6.558525562286377) | > loss_mel: 23.283428192138672 (23.389219284057617) | > loss_duration: 3.245756149291992 (3.2947819232940674) | > loss_1: 41.66228485107422 (40.774953842163086)  --> STEP: 3 | > loss_disc: 2.8165383338928223 (2.6930057207743325) | > loss_disc_real_0: 0.17427940666675568 (0.20063404738903046) | > loss_disc_real_1: 0.3046478033065796 (0.2676684707403183) | > loss_disc_real_2: 0.21277287602424622 (0.20537818471590677) | > loss_disc_real_3: 0.35823628306388855 (0.23669607937335968) | > loss_disc_real_4: 0.3606831729412079 (0.2540295720100403) | > loss_disc_real_5: 0.3847965598106384 (0.3014933342734973) | > loss_0: 2.8165383338928223 (2.6930057207743325) | > loss_gen: 2.3021962642669678 (2.0776387055714927) | > loss_kl: 2.662613868713379 (4.598916212717692) | > loss_feat: 2.975400924682617 (5.364150683085124) | > loss_mel: 17.856990814208984 (21.545143127441406) | > loss_duration: 3.035749912261963 (3.208437919616699) | > loss_1: 28.83295249938965 (36.79428672790527) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_106000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.992281913757324 (2.7678247690200806) | > loss_disc_real_0: 0.3200762867927551 (0.23049460723996162) | > loss_disc_real_1: 0.20901142060756683 (0.25300420820713043) | > loss_disc_real_2: 0.20239822566509247 (0.2046331949532032) | > loss_disc_real_3: 0.34602266550064087 (0.26402772590518) | > loss_disc_real_4: 0.2988726794719696 (0.2652403488755226) | > loss_disc_real_5: 0.3758511543273926 (0.3200827892869711) | > loss_0: 2.992281913757324 (2.7678247690200806) | > loss_gen: 2.280306577682495 (2.128305673599243) | > loss_kl: 5.281975746154785 (4.769681096076965) | > loss_feat: 5.339694976806641 (5.358036756515503) | > loss_mel: 22.58599090576172 (21.805355072021484) | > loss_duration: 3.055516004562378 (3.170207440853119) | > loss_1: 38.54348373413086 (37.23158597946167)  --> STEP: 1 | > loss_disc: 3.0586509704589844 (2.825990009307861) | > loss_disc_real_0: 0.6379531621932983 (0.31198631823062895) | > loss_disc_real_1: 0.3264554738998413 (0.2676944613456726) | > loss_disc_real_2: 0.25893473625183105 (0.21549350321292876) | > loss_disc_real_3: 0.2661241292953491 (0.2644470065832138) | > loss_disc_real_4: 0.2523983120918274 (0.2626719415187836) | > loss_disc_real_5: 0.23221811652183533 (0.30250985473394393) | > loss_0: 3.0586509704589844 (2.825990009307861) | > loss_gen: 2.197305202484131 (2.1421055793762207) | > loss_kl: 5.391032695770264 (4.893951416015625) | > loss_feat: 1.3028684854507446 (4.5470031023025514) | > loss_mel: 17.771718978881836 (20.998627853393554) | > loss_duration: 3.384587526321411 (3.2130834579467775) | > loss_1: 30.047513961791992 (35.79477157592773)  --> STEP: 2 | > loss_disc: 3.1288394927978516 (2.87646492322286) | > loss_disc_real_0: 0.6737616658210754 (0.3722822094957034) | > loss_disc_real_1: 0.23878562450408936 (0.2628763218720754) | > loss_disc_real_2: 0.107595294713974 (0.19751046846310297) | > loss_disc_real_3: 0.21794156730175018 (0.2566961000363032) | > loss_disc_real_4: 0.1452719122171402 (0.24310526996850967) | > loss_disc_real_5: 0.3419901728630066 (0.30908990775545436) | > loss_0: 3.1288394927978516 (2.87646492322286) | > loss_gen: 2.039646625518799 (2.1250290870666504) | > loss_kl: 5.701907634735107 (5.028610785802205) | > loss_feat: 7.777746200561523 (5.085460285345714) | > loss_mel: 21.2085018157959 (21.033606847127277) | > loss_duration: 3.2551050186157227 (3.2200870513916016) | > loss_1: 39.982906341552734 (36.492794036865234)  --> STEP: 3 | > loss_disc: 3.1130146980285645 (2.9102577481951033) | > loss_disc_real_0: 0.5387735366821289 (0.3960666848080499) | > loss_disc_real_1: 0.2539680600166321 (0.2616037130355835) | > loss_disc_real_2: 0.2867624759674072 (0.21026075524943216) | > loss_disc_real_3: 0.24518048763275146 (0.2550510125500815) | > loss_disc_real_4: 0.23354138433933258 (0.24173900059291295) | > loss_disc_real_5: 0.24678735435009003 (0.30018954298325945) | > loss_0: 3.1130146980285645 (2.9102577481951033) | > loss_gen: 1.8171075582504272 (2.0810402972357616) | > loss_kl: 2.808443069458008 (4.711443969181606) | > loss_feat: 0.05381026864051819 (4.366653140102114) | > loss_mel: 3.2911291122436523 (18.498967170715332) | > loss_duration: 2.9975736141204834 (3.1882994174957275) | > loss_1: 10.968063354492188 (32.84640393938337) --> EVAL PERFORMANCE | > avg_loader_time: 0.4290240832737514 (+0.39428498631431946) | > avg_loss_disc: 2.9102577481951033 (+0.018059900828770292) | > avg_loss_disc_real_0: 0.3960666848080499 (+0.15591137536934446) | > avg_loss_disc_real_1: 0.2616037130355835 (-0.03714085618654889) | > avg_loss_disc_real_2: 0.21026075524943216 (-0.10323330121380941) | > avg_loss_disc_real_3: 0.2550510125500815 (+0.007078270827020894) | > avg_loss_disc_real_4: 0.24173900059291295 (-0.1095286054270608) | > avg_loss_disc_real_5: 0.30018954298325945 (-0.07959800142617457) | > avg_loss_0: 2.9102577481951033 (+0.018059900828770292) | > avg_loss_gen: 2.0810402972357616 (-0.26384827068873795) | > avg_loss_kl: 4.711443969181606 (+0.02937403179350362) | > avg_loss_feat: 4.366653140102114 (-0.40701657959393067) | > avg_loss_mel: 18.498967170715332 (+0.29959869384765625) | > avg_loss_duration: 3.1882994174957275 (+0.02598293622334813) | > avg_loss_1: 32.84640393938337 (-0.3159101577032146)  > EPOCH: 1060/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:12:12)   --> TIME: 2023-10-20 13:12:29 -- STEP: 19/50 -- GLOBAL_STEP: 106020 | > loss_disc: 1.5094398260116577 (2.4976214672389787) | > loss_disc_real_0: 0.0141244325786829 (0.17787612611918072) | > loss_disc_real_1: 0.09823064506053925 (0.22963733069206538) | > loss_disc_real_2: 0.1617690622806549 (0.23084552821360135) | > loss_disc_real_3: 0.18145175278186798 (0.25779168337191405) | > loss_disc_real_4: 0.1521424800157547 (0.2258394983057913) | > loss_disc_real_5: 0.06927018612623215 (0.22368084884395725) | > loss_0: 1.5094398260116577 (2.4976214672389787) | > grad_norm_0: tensor(577.6016, device='cuda:0') (tensor(958.4504, device='cuda:0')) | > loss_gen: 2.6557600498199463 (2.4703020735790857) | > loss_kl: 0.7687819004058838 (0.7645061078824495) | > loss_feat: 8.963624000549316 (6.426564917752617) | > loss_mel: 24.810691833496094 (21.68358234355324) | > loss_duration: 1.4254276752471924 (1.3801486931349103) | > loss_1: 38.62428665161133 (32.725104783710684) | > grad_norm_1: tensor(20498.9727, device='cuda:0') (tensor(24306.2246, device='cuda:0')) | > current_lr_0: 6.928657129600322e-05 | > current_lr_1: 6.928657129600322e-05 | > step_time: 0.3603 (0.5957577730479994) | > loader_time: 0.0048 (0.020103567524960165)  --> TIME: 2023-10-20 13:12:40 -- STEP: 49/50 -- GLOBAL_STEP: 106050 | > loss_disc: 2.8548574447631836 (2.3758340125181237) | > loss_disc_real_0: 0.11401088535785675 (0.1533116210936284) | > loss_disc_real_1: 0.27467456459999084 (0.21919140759475378) | > loss_disc_real_2: 0.3173421323299408 (0.21746486045268118) | > loss_disc_real_3: 0.3253377377986908 (0.22799864954942342) | > loss_disc_real_4: 0.3652322590351105 (0.22067033385439794) | > loss_disc_real_5: 0.41528305411338806 (0.2182898766038065) | > loss_0: 2.8548574447631836 (2.3758340125181237) | > grad_norm_0: tensor(551.4545, device='cuda:0') (tensor(718.7598, device='cuda:0')) | > loss_gen: 2.4000840187072754 (2.415104428116156) | > loss_kl: 0.6607275605201721 (0.7598366664380444) | > loss_feat: 4.495315074920654 (5.994765482994975) | > loss_mel: 22.334291458129883 (20.424310321710553) | > loss_duration: 1.3965835571289062 (1.34848688208327) | > loss_1: 31.28700065612793 (30.942504114034232) | > grad_norm_1: tensor(5247.3428, device='cuda:0') (tensor(19177.4023, device='cuda:0')) | > current_lr_0: 6.928657129600322e-05 | > current_lr_1: 6.928657129600322e-05 | > step_time: 0.2672 (0.4442049629834233) | > loader_time: 0.3504 (0.01726644866320551)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0003881454467773 (3.0003881454467773) | > loss_disc_real_0: 0.19801530241966248 (0.19801530241966248) | > loss_disc_real_1: 0.2576313018798828 (0.2576313018798828) | > loss_disc_real_2: 0.26563340425491333 (0.26563340425491333) | > loss_disc_real_3: 0.28836706280708313 (0.28836706280708313) | > loss_disc_real_4: 0.2591817378997803 (0.2591817378997803) | > loss_disc_real_5: 0.26148396730422974 (0.26148396730422974) | > loss_0: 3.0003881454467773 (3.0003881454467773) | > loss_gen: 1.539338231086731 (1.539338231086731) | > loss_kl: 5.553164958953857 (5.553164958953857) | > loss_feat: 0.14041104912757874 (0.14041104912757874) | > loss_mel: 5.553041458129883 (5.553041458129883) | > loss_duration: 2.9861083030700684 (2.9861083030700684) | > loss_1: 15.772064208984375 (15.772064208984375)  --> STEP: 1 | > loss_disc: 2.523162841796875 (2.523162841796875) | > loss_disc_real_0: 0.15280194580554962 (0.15280194580554962) | > loss_disc_real_1: 0.3542810380458832 (0.3542810380458832) | > loss_disc_real_2: 0.3860308825969696 (0.3860308825969696) | > loss_disc_real_3: 0.3400491774082184 (0.3400491774082184) | > loss_disc_real_4: 0.2522561252117157 (0.2522561252117157) | > loss_disc_real_5: 0.37794825434684753 (0.37794825434684753) | > loss_0: 2.523162841796875 (2.523162841796875) | > loss_gen: 3.05614972114563 (3.05614972114563) | > loss_kl: 5.599091053009033 (5.599091053009033) | > loss_feat: 6.725785255432129 (6.725785255432129) | > loss_mel: 24.31796646118164 (24.31796646118164) | > loss_duration: 3.364623785018921 (3.364623785018921) | > loss_1: 43.06361770629883 (43.06361770629883)  --> STEP: 2 | > loss_disc: 3.0460546016693115 (2.7846087217330933) | > loss_disc_real_0: 0.19909702241420746 (0.17594948410987854) | > loss_disc_real_1: 0.25755903124809265 (0.3059200346469879) | > loss_disc_real_2: 0.26558706164360046 (0.32580897212028503) | > loss_disc_real_3: 0.2883307933807373 (0.31418998539447784) | > loss_disc_real_4: 0.2591536045074463 (0.255704864859581) | > loss_disc_real_5: 0.26150745153427124 (0.3197278529405594) | > loss_0: 3.0460546016693115 (2.7846087217330933) | > loss_gen: 1.5010616779327393 (2.2786056995391846) | > loss_kl: 5.687823295593262 (5.6434571743011475) | > loss_feat: 0.11506685614585876 (3.420426055788994) | > loss_mel: 1.9595496654510498 (13.138758063316345) | > loss_duration: 3.2770159244537354 (3.320819854736328) | > loss_1: 12.54051685333252 (27.802067279815674)  --> STEP: 3 | > loss_disc: 3.04498553276062 (2.871400992075602) | > loss_disc_real_0: 0.19813397526741028 (0.18334431449572244) | > loss_disc_real_1: 0.25754886865615845 (0.28979631265004474) | > loss_disc_real_2: 0.2653356194496155 (0.3056511878967285) | > loss_disc_real_3: 0.28833621740341187 (0.3055720627307892) | > loss_disc_real_4: 0.2592485845088959 (0.256886104742686) | > loss_disc_real_5: 0.26150670647621155 (0.3003208041191101) | > loss_0: 3.04498553276062 (2.871400992075602) | > loss_gen: 1.5010242462158203 (2.01941188176473) | > loss_kl: 2.7726330757141113 (4.686515808105469) | > loss_feat: 0.11410697549581528 (2.3183196956912675) | > loss_mel: 2.3361878395080566 (9.537901322046915) | > loss_duration: 2.977602958679199 (3.206414222717285) | > loss_1: 9.701555252075195 (21.768563270568848) --> EVAL PERFORMANCE | > avg_loader_time: 0.026855945587158203 (-0.4021681376865932) | > avg_loss_disc: 2.871400992075602 (-0.038856756119501235) | > avg_loss_disc_real_0: 0.18334431449572244 (-0.21272237031232746) | > avg_loss_disc_real_1: 0.28979631265004474 (+0.028192599614461245) | > avg_loss_disc_real_2: 0.3056511878967285 (+0.09539043264729635) | > avg_loss_disc_real_3: 0.3055720627307892 (+0.05052105018070768) | > avg_loss_disc_real_4: 0.256886104742686 (+0.015147104149773022) | > avg_loss_disc_real_5: 0.3003208041191101 (+0.00013126113585065768) | > avg_loss_0: 2.871400992075602 (-0.038856756119501235) | > avg_loss_gen: 2.01941188176473 (-0.061628415471031595) | > avg_loss_kl: 4.686515808105469 (-0.02492816107613738) | > avg_loss_feat: 2.3183196956912675 (-2.0483334444108467) | > avg_loss_mel: 9.537901322046915 (-8.961065848668417) | > avg_loss_duration: 3.206414222717285 (+0.018114805221557617) | > avg_loss_1: 21.768563270568848 (-11.077840668814524)  > EPOCH: 1061/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:12:53)   --> TIME: 2023-10-20 13:13:18 -- STEP: 29/50 -- GLOBAL_STEP: 106080 | > loss_disc: 2.221226215362549 (2.5846771577308916) | > loss_disc_real_0: 0.03227997198700905 (0.1536480131205814) | > loss_disc_real_1: 0.23145410418510437 (0.2276576740731453) | > loss_disc_real_2: 0.06323684751987457 (0.22878207009414148) | > loss_disc_real_3: 0.19951403141021729 (0.2616879004214344) | > loss_disc_real_4: 0.24031886458396912 (0.22931775893887568) | > loss_disc_real_5: 0.2977841794490814 (0.24315201500751854) | > loss_0: 2.221226215362549 (2.5846771577308916) | > grad_norm_0: tensor(559.7543, device='cuda:0') (tensor(738.1223, device='cuda:0')) | > loss_gen: 2.3692004680633545 (2.202715972374225) | > loss_kl: 0.8368609547615051 (0.8111953694244911) | > loss_feat: 7.918699741363525 (5.635952286679169) | > loss_mel: 20.14406394958496 (18.459292070618986) | > loss_duration: 1.3462746143341064 (1.3408463741170948) | > loss_1: 32.61509704589844 (28.45000229210689) | > grad_norm_1: tensor(5347.2588, device='cuda:0') (tensor(18869.4961, device='cuda:0')) | > current_lr_0: 6.921731503000509e-05 | > current_lr_1: 6.921731503000509e-05 | > step_time: 0.3674 (0.6216130585506044) | > loader_time: 0.0512 (0.021755054079253097)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.021631956100464 (3.021631956100464) | > loss_disc_real_0: 0.3278508186340332 (0.3278508186340332) | > loss_disc_real_1: 0.23084981739521027 (0.23084981739521027) | > loss_disc_real_2: 0.29389432072639465 (0.29389432072639465) | > loss_disc_real_3: 0.21899233758449554 (0.21899233758449554) | > loss_disc_real_4: 0.23495973646640778 (0.23495973646640778) | > loss_disc_real_5: 0.2725644111633301 (0.2725644111633301) | > loss_0: 3.021631956100464 (3.021631956100464) | > loss_gen: 1.5810470581054688 (1.5810470581054688) | > loss_kl: 6.016618251800537 (6.016618251800537) | > loss_feat: 0.03967396914958954 (0.03967396914958954) | > loss_mel: 1.0805422067642212 (1.0805422067642212) | > loss_duration: 2.9747695922851562 (2.9747695922851562) | > loss_1: 11.69265079498291 (11.69265079498291)  --> STEP: 1 | > loss_disc: 2.707113265991211 (2.707113265991211) | > loss_disc_real_0: 0.23708626627922058 (0.23708626627922058) | > loss_disc_real_1: 0.3053317964076996 (0.3053317964076996) | > loss_disc_real_2: 0.5237178802490234 (0.5237178802490234) | > loss_disc_real_3: 0.33805549144744873 (0.33805549144744873) | > loss_disc_real_4: 0.19071827828884125 (0.19071827828884125) | > loss_disc_real_5: 0.3284892141819 (0.3284892141819) | > loss_0: 2.707113265991211 (2.707113265991211) | > loss_gen: 3.3543148040771484 (3.3543148040771484) | > loss_kl: 5.764708042144775 (5.764708042144775) | > loss_feat: 8.077664375305176 (8.077664375305176) | > loss_mel: 22.54899787902832 (22.54899787902832) | > loss_duration: 3.3086509704589844 (3.3086509704589844) | > loss_1: 43.05434036254883 (43.05434036254883)  --> STEP: 2 | > loss_disc: 2.2117154598236084 (2.4594143629074097) | > loss_disc_real_0: 0.07861614227294922 (0.1578512042760849) | > loss_disc_real_1: 0.17037145793437958 (0.23785162717103958) | > loss_disc_real_2: 0.26294904947280884 (0.39333346486091614) | > loss_disc_real_3: 0.3058391511440277 (0.3219473212957382) | > loss_disc_real_4: 0.25734367966651917 (0.2240309789776802) | > loss_disc_real_5: 0.24101750552654266 (0.28475335985422134) | > loss_0: 2.2117154598236084 (2.4594143629074097) | > loss_gen: 2.5025556087493896 (2.928435206413269) | > loss_kl: 5.960923671722412 (5.862815856933594) | > loss_feat: 4.583449363708496 (6.330556869506836) | > loss_mel: 24.31673240661621 (23.432865142822266) | > loss_duration: 3.172630786895752 (3.240640878677368) | > loss_1: 40.536293029785156 (41.79531669616699)  --> STEP: 3 | > loss_disc: 2.884694814682007 (2.601174513498942) | > loss_disc_real_0: 0.22464211285114288 (0.1801148404677709) | > loss_disc_real_1: 0.23115861415863037 (0.23562062283356985) | > loss_disc_real_2: 0.31286993622779846 (0.3665122886498769) | > loss_disc_real_3: 0.23060175776481628 (0.2914988001187642) | > loss_disc_real_4: 0.23713482916355133 (0.22839892903963724) | > loss_disc_real_5: 0.27294260263442993 (0.2808164407809575) | > loss_0: 2.884694814682007 (2.601174513498942) | > loss_gen: 1.68697190284729 (2.5146141052246094) | > loss_kl: 2.7151193618774414 (4.813583691914876) | > loss_feat: 0.6400418281555176 (4.4337185223897295) | > loss_mel: 15.506067276000977 (20.790599187215168) | > loss_duration: 3.037727117538452 (3.1730029582977295) | > loss_1: 23.585927963256836 (35.72552045186361) --> EVAL PERFORMANCE | > avg_loader_time: 0.004168987274169922 (-0.02268695831298828) | > avg_loss_disc: 2.601174513498942 (-0.27022647857666016) | > avg_loss_disc_real_0: 0.1801148404677709 (-0.00322947402795154) | > avg_loss_disc_real_1: 0.23562062283356985 (-0.05417568981647489) | > avg_loss_disc_real_2: 0.3665122886498769 (+0.06086110075314838) | > avg_loss_disc_real_3: 0.2914988001187642 (-0.014073262612024962) | > avg_loss_disc_real_4: 0.22839892903963724 (-0.028487175703048734) | > avg_loss_disc_real_5: 0.2808164407809575 (-0.019504363338152586) | > avg_loss_0: 2.601174513498942 (-0.27022647857666016) | > avg_loss_gen: 2.5146141052246094 (+0.4952022234598794) | > avg_loss_kl: 4.813583691914876 (+0.12706788380940726) | > avg_loss_feat: 4.4337185223897295 (+2.115398826698462) | > avg_loss_mel: 20.790599187215168 (+11.252697865168253) | > avg_loss_duration: 3.1730029582977295 (-0.033411264419555664) | > avg_loss_1: 35.72552045186361 (+13.956957181294761)  > EPOCH: 1062/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:13:48)   --> TIME: 2023-10-20 13:13:58 -- STEP: 9/50 -- GLOBAL_STEP: 106110 | > loss_disc: 2.553252696990967 (2.390461881955465) | > loss_disc_real_0: 0.09407176822423935 (0.14075928409066465) | > loss_disc_real_1: 0.15769942104816437 (0.21585878191722763) | > loss_disc_real_2: 0.28716763854026794 (0.3093044428775708) | > loss_disc_real_3: 0.2603197395801544 (0.2201929394569662) | > loss_disc_real_4: 0.283022940158844 (0.24345485286580193) | > loss_disc_real_5: 0.3912408947944641 (0.21273326894475353) | > loss_0: 2.553252696990967 (2.390461881955465) | > grad_norm_0: tensor(370.4424, device='cuda:0') (tensor(549.1544, device='cuda:0')) | > loss_gen: 2.2723584175109863 (2.4739290873209634) | > loss_kl: 0.8495470881462097 (0.8360455996460385) | > loss_feat: 4.766407489776611 (6.872613456514147) | > loss_mel: 22.824636459350586 (22.16338348388672) | > loss_duration: 1.3406286239624023 (1.3441590468088787) | > loss_1: 32.0535774230957 (33.690130869547524) | > grad_norm_1: tensor(3765.3345, device='cuda:0') (tensor(24451.9492, device='cuda:0')) | > current_lr_0: 6.914812798998094e-05 | > current_lr_1: 6.914812798998094e-05 | > step_time: 0.3659 (0.5897698932223849) | > loader_time: 0.0113 (0.02019966973198785)  --> TIME: 2023-10-20 13:14:18 -- STEP: 39/50 -- GLOBAL_STEP: 106140 | > loss_disc: 2.638970375061035 (2.4017720069640722) | > loss_disc_real_0: 0.22475747764110565 (0.14223792618856979) | > loss_disc_real_1: 0.2796543836593628 (0.22344809531783447) | > loss_disc_real_2: 0.18361933529376984 (0.23531494428141) | > loss_disc_real_3: 0.2079666256904602 (0.23909706545945925) | > loss_disc_real_4: 0.18347673118114471 (0.2090368359707869) | > loss_disc_real_5: 0.19033628702163696 (0.21710017872735476) | > loss_0: 2.638970375061035 (2.4017720069640722) | > grad_norm_0: tensor(325.2974, device='cuda:0') (tensor(526.5104, device='cuda:0')) | > loss_gen: 1.6789164543151855 (2.309833933145572) | > loss_kl: 0.48047176003456116 (0.8864993483592303) | > loss_feat: 1.4271315336227417 (5.661544203185118) | > loss_mel: 11.311758041381836 (20.662486345340042) | > loss_duration: 1.3958536386489868 (1.3433297414046068) | > loss_1: 16.294130325317383 (30.86369362855569) | > grad_norm_1: tensor(13027.8984, device='cuda:0') (tensor(18631.7812, device='cuda:0')) | > current_lr_0: 6.914812798998094e-05 | > current_lr_1: 6.914812798998094e-05 | > step_time: 0.5736 (0.6297719295208272) | > loader_time: 0.004 (0.02066762019426395)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8412203788757324 (2.8412203788757324) | > loss_disc_real_0: 0.314089298248291 (0.314089298248291) | > loss_disc_real_1: 0.3170488774776459 (0.3170488774776459) | > loss_disc_real_2: 0.27704957127571106 (0.27704957127571106) | > loss_disc_real_3: 0.2756289839744568 (0.2756289839744568) | > loss_disc_real_4: 0.3879772424697876 (0.3879772424697876) | > loss_disc_real_5: 0.3366425037384033 (0.3366425037384033) | > loss_0: 2.8412203788757324 (2.8412203788757324) | > loss_gen: 2.4530367851257324 (2.4530367851257324) | > loss_kl: 6.697399616241455 (6.697399616241455) | > loss_feat: 5.657547950744629 (5.657547950744629) | > loss_mel: 20.636455535888672 (20.636455535888672) | > loss_duration: 3.1074161529541016 (3.1074161529541016) | > loss_1: 38.551856994628906 (38.551856994628906)  --> STEP: 1 | > loss_disc: 1.727197527885437 (1.727197527885437) | > loss_disc_real_0: 0.0706537589430809 (0.0706537589430809) | > loss_disc_real_1: 0.23362180590629578 (0.23362180590629578) | > loss_disc_real_2: 0.21764115989208221 (0.21764115989208221) | > loss_disc_real_3: 0.16905798017978668 (0.16905798017978668) | > loss_disc_real_4: 0.08537163585424423 (0.08537163585424423) | > loss_disc_real_5: 0.16857871413230896 (0.16857871413230896) | > loss_0: 1.727197527885437 (1.727197527885437) | > loss_gen: 2.77017879486084 (2.77017879486084) | > loss_kl: 5.941312789916992 (5.941312789916992) | > loss_feat: 8.504352569580078 (8.504352569580078) | > loss_mel: 21.412246704101562 (21.412246704101562) | > loss_duration: 3.409212589263916 (3.409212589263916) | > loss_1: 42.03730392456055 (42.03730392456055)  --> STEP: 2 | > loss_disc: 2.238222360610962 (1.9827099442481995) | > loss_disc_real_0: 0.14022354781627655 (0.10543865337967873) | > loss_disc_real_1: 0.14842714369297028 (0.19102447479963303) | > loss_disc_real_2: 0.2622491419315338 (0.23994515091180801) | > loss_disc_real_3: 0.175286203622818 (0.17217209190130234) | > loss_disc_real_4: 0.2116287350654602 (0.14850018545985222) | > loss_disc_real_5: 0.3682277798652649 (0.2684032469987869) | > loss_0: 2.238222360610962 (1.9827099442481995) | > loss_gen: 2.7683470249176025 (2.769262909889221) | > loss_kl: 5.639138221740723 (5.790225505828857) | > loss_feat: 7.931711673736572 (8.218032121658325) | > loss_mel: 23.436248779296875 (22.42424774169922) | > loss_duration: 3.30068039894104 (3.354946494102478) | > loss_1: 43.07612991333008 (42.55671691894531)  --> STEP: 3 | > loss_disc: 2.8417227268218994 (2.2690475384394326) | > loss_disc_real_0: 0.4074423611164093 (0.20610655595858893) | > loss_disc_real_1: 0.31216248869895935 (0.23140381276607513) | > loss_disc_real_2: 0.3386074900627136 (0.27283259729544324) | > loss_disc_real_3: 0.2639523446559906 (0.20276550948619843) | > loss_disc_real_4: 0.37414389848709106 (0.22371475646893182) | > loss_disc_real_5: 0.296921968460083 (0.2779094874858856) | > loss_0: 2.8417227268218994 (2.2690475384394326) | > loss_gen: 3.033815622329712 (2.8574471473693848) | > loss_kl: 2.9711544513702393 (4.850535154342651) | > loss_feat: 5.581910610198975 (7.339324951171875) | > loss_mel: 20.804706573486328 (21.884400685628254) | > loss_duration: 2.9449214935302734 (3.218271493911743) | > loss_1: 35.336509704589844 (40.14998118082682) --> EVAL PERFORMANCE | > avg_loader_time: 0.011905272801717123 (+0.007736285527547201) | > avg_loss_disc: 2.2690475384394326 (-0.3321269750595093) | > avg_loss_disc_real_0: 0.20610655595858893 (+0.025991715490818024) | > avg_loss_disc_real_1: 0.23140381276607513 (-0.0042168100674947195) | > avg_loss_disc_real_2: 0.27283259729544324 (-0.09367969135443366) | > avg_loss_disc_real_3: 0.20276550948619843 (-0.0887332906325658) | > avg_loss_disc_real_4: 0.22371475646893182 (-0.004684172570705414) | > avg_loss_disc_real_5: 0.2779094874858856 (-0.0029069532950719013) | > avg_loss_0: 2.2690475384394326 (-0.3321269750595093) | > avg_loss_gen: 2.8574471473693848 (+0.3428330421447754) | > avg_loss_kl: 4.850535154342651 (+0.03695146242777536) | > avg_loss_feat: 7.339324951171875 (+2.9056064287821455) | > avg_loss_mel: 21.884400685628254 (+1.093801498413086) | > avg_loss_duration: 3.218271493911743 (+0.04526853561401367) | > avg_loss_1: 40.14998118082682 (+4.424460728963211)  > EPOCH: 1063/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:14:37)   --> TIME: 2023-10-20 13:14:53 -- STEP: 19/50 -- GLOBAL_STEP: 106170 | > loss_disc: 3.007152557373047 (2.3422646836230627) | > loss_disc_real_0: 0.35953640937805176 (0.1397853898570726) | > loss_disc_real_1: 0.27741438150405884 (0.20859770829740323) | > loss_disc_real_2: 0.335651159286499 (0.22478897987227692) | > loss_disc_real_3: 0.31076574325561523 (0.21412819427879234) | > loss_disc_real_4: 0.35238438844680786 (0.22786496452202923) | > loss_disc_real_5: 0.43775689601898193 (0.25557648135643257) | > loss_0: 3.007152557373047 (2.3422646836230627) | > grad_norm_0: tensor(778.2570, device='cuda:0') (tensor(636.7086, device='cuda:0')) | > loss_gen: 2.4318795204162598 (2.4779933440057857) | > loss_kl: 0.8184906244277954 (0.8017047502492604) | > loss_feat: 3.497880697250366 (6.353923252146495) | > loss_mel: 14.107535362243652 (21.381671284374438) | > loss_duration: 1.448745846748352 (1.379951138245432) | > loss_1: 22.30453109741211 (32.39524437251844) | > grad_norm_1: tensor(20251.4121, device='cuda:0') (tensor(28282.8613, device='cuda:0')) | > current_lr_0: 6.907901010673502e-05 | > current_lr_1: 6.907901010673502e-05 | > step_time: 0.3666 (0.5444989455373663) | > loader_time: 0.0275 (0.017207271174380655)  --> TIME: 2023-10-20 13:15:10 -- STEP: 49/50 -- GLOBAL_STEP: 106200 | > loss_disc: 2.697225570678711 (2.3519076206246186) | > loss_disc_real_0: 0.20236161351203918 (0.1365230531640807) | > loss_disc_real_1: 0.25447046756744385 (0.21128159727216983) | > loss_disc_real_2: 0.2525028586387634 (0.21558239056291628) | > loss_disc_real_3: 0.28591546416282654 (0.22563463350643917) | > loss_disc_real_4: 0.2568172514438629 (0.208291229848959) | > loss_disc_real_5: 0.2437799870967865 (0.2358082105994833) | > loss_0: 2.697225570678711 (2.3519076206246186) | > grad_norm_0: tensor(1424.4996, device='cuda:0') (tensor(602.5715, device='cuda:0')) | > loss_gen: 1.8948204517364502 (2.3556468000217365) | > loss_kl: 0.5028557777404785 (0.7353699067417456) | > loss_feat: 1.0916595458984375 (5.947848862683286) | > loss_mel: 15.419561386108398 (20.524702989325235) | > loss_duration: 1.4835177659988403 (1.345320954614756) | > loss_1: 20.39241600036621 (30.908889682925476) | > grad_norm_1: tensor(6778.2593, device='cuda:0') (tensor(21389.6680, device='cuda:0')) | > current_lr_0: 6.907901010673502e-05 | > current_lr_1: 6.907901010673502e-05 | > step_time: 0.686 (0.5358329792411959) | > loader_time: 0.5464 (0.027828406314460593)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.927220344543457 (2.927220344543457) | > loss_disc_real_0: 0.2342243194580078 (0.2342243194580078) | > loss_disc_real_1: 0.2611677944660187 (0.2611677944660187) | > loss_disc_real_2: 0.2611055374145508 (0.2611055374145508) | > loss_disc_real_3: 0.23585326969623566 (0.23585326969623566) | > loss_disc_real_4: 0.2309410125017166 (0.2309410125017166) | > loss_disc_real_5: 0.23885105550289154 (0.23885105550289154) | > loss_0: 2.927220344543457 (2.927220344543457) | > loss_gen: 1.5755813121795654 (1.5755813121795654) | > loss_kl: 5.9495930671691895 (5.9495930671691895) | > loss_feat: 0.7901085615158081 (0.7901085615158081) | > loss_mel: 8.53028678894043 (8.53028678894043) | > loss_duration: 3.124551296234131 (3.124551296234131) | > loss_1: 19.970121383666992 (19.970121383666992)  --> STEP: 1 | > loss_disc: 2.5152597427368164 (2.5152597427368164) | > loss_disc_real_0: 0.24074812233448029 (0.24074812233448029) | > loss_disc_real_1: 0.2428482174873352 (0.2428482174873352) | > loss_disc_real_2: 0.17993874847888947 (0.17993874847888947) | > loss_disc_real_3: 0.18091446161270142 (0.18091446161270142) | > loss_disc_real_4: 0.2050144076347351 (0.2050144076347351) | > loss_disc_real_5: 0.267055481672287 (0.267055481672287) | > loss_0: 2.5152597427368164 (2.5152597427368164) | > loss_gen: 2.103046178817749 (2.103046178817749) | > loss_kl: 5.55523681640625 (5.55523681640625) | > loss_feat: 7.077395915985107 (7.077395915985107) | > loss_mel: 26.842601776123047 (26.842601776123047) | > loss_duration: 3.3446125984191895 (3.3446125984191895) | > loss_1: 44.92289352416992 (44.92289352416992)  --> STEP: 2 | > loss_disc: 2.991898775100708 (2.753579258918762) | > loss_disc_real_0: 0.2733449339866638 (0.25704652816057205) | > loss_disc_real_1: 0.2486332803964615 (0.24574074894189835) | > loss_disc_real_2: 0.28958502411842346 (0.23476188629865646) | > loss_disc_real_3: 0.2718373239040375 (0.22637589275836945) | > loss_disc_real_4: 0.24450595676898956 (0.22476018220186234) | > loss_disc_real_5: 0.2467077374458313 (0.25688160955905914) | > loss_0: 2.991898775100708 (2.753579258918762) | > loss_gen: 1.588101863861084 (1.8455740213394165) | > loss_kl: 5.672996997833252 (5.614116907119751) | > loss_feat: 0.09647493809461594 (3.5869354270398617) | > loss_mel: 1.841016411781311 (14.341809093952179) | > loss_duration: 3.248178720474243 (3.2963956594467163) | > loss_1: 12.446768760681152 (28.684831142425537)  --> STEP: 3 | > loss_disc: 2.97882080078125 (2.828659772872925) | > loss_disc_real_0: 0.3114532232284546 (0.2751820931831996) | > loss_disc_real_1: 0.24195680022239685 (0.24447943270206451) | > loss_disc_real_2: 0.296598881483078 (0.255374218026797) | > loss_disc_real_3: 0.2844654321670532 (0.24573907256126404) | > loss_disc_real_4: 0.25420480966567993 (0.23457505802313486) | > loss_disc_real_5: 0.2467021644115448 (0.2534884611765544) | > loss_0: 2.97882080078125 (2.828659772872925) | > loss_gen: 1.6784846782684326 (1.7898775736490886) | > loss_kl: 2.4891433715820312 (4.572459061940511) | > loss_feat: 0.3131375312805176 (2.495669461786747) | > loss_mel: 7.565986633300781 (12.08320160706838) | > loss_duration: 2.9391579627990723 (3.177316427230835) | > loss_1: 14.985910415649414 (24.118524233500164) --> EVAL PERFORMANCE | > avg_loader_time: 0.031601270039876304 (+0.01969599723815918) | > avg_loss_disc: 2.828659772872925 (+0.5596122344334922) | > avg_loss_disc_real_0: 0.2751820931831996 (+0.06907553722461066) | > avg_loss_disc_real_1: 0.24447943270206451 (+0.01307561993598938) | > avg_loss_disc_real_2: 0.255374218026797 (-0.01745837926864624) | > avg_loss_disc_real_3: 0.24573907256126404 (+0.04297356307506561) | > avg_loss_disc_real_4: 0.23457505802313486 (+0.010860301554203033) | > avg_loss_disc_real_5: 0.2534884611765544 (-0.02442102630933124) | > avg_loss_0: 2.828659772872925 (+0.5596122344334922) | > avg_loss_gen: 1.7898775736490886 (-1.0675695737202961) | > avg_loss_kl: 4.572459061940511 (-0.2780760924021406) | > avg_loss_feat: 2.495669461786747 (-4.843655489385128) | > avg_loss_mel: 12.08320160706838 (-9.801199078559874) | > avg_loss_duration: 3.177316427230835 (-0.0409550666809082) | > avg_loss_1: 24.118524233500164 (-16.031456947326657)  > EPOCH: 1064/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:15:25)   --> TIME: 2023-10-20 13:15:52 -- STEP: 29/50 -- GLOBAL_STEP: 106230 | > loss_disc: 2.712942361831665 (2.4960896393348433) | > loss_disc_real_0: 0.07302476465702057 (0.1412511131372945) | > loss_disc_real_1: 0.337931364774704 (0.2319851409772347) | > loss_disc_real_2: 0.21056367456912994 (0.24925443234628633) | > loss_disc_real_3: 0.25048571825027466 (0.22268172038783288) | > loss_disc_real_4: 0.3046916127204895 (0.24918995771942462) | > loss_disc_real_5: 0.18504786491394043 (0.23472693748772142) | > loss_0: 2.712942361831665 (2.4960896393348433) | > grad_norm_0: tensor(437.1808, device='cuda:0') (tensor(489.1154, device='cuda:0')) | > loss_gen: 1.9621325731277466 (2.2136007958445068) | > loss_kl: 0.6182489991188049 (0.8329939986097401) | > loss_feat: 3.4119298458099365 (5.332331980610716) | > loss_mel: 20.701818466186523 (19.513212832911254) | > loss_duration: 1.323089838027954 (1.3477095982124065) | > loss_1: 28.017221450805664 (29.239848942592225) | > grad_norm_1: tensor(3484.9695, device='cuda:0') (tensor(17336.9199, device='cuda:0')) | > current_lr_0: 6.900996131114085e-05 | > current_lr_1: 6.900996131114085e-05 | > step_time: 0.4694 (0.6122434139251707) | > loader_time: 0.0313 (0.026552512727934737)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0652248859405518 (3.0652248859405518) | > loss_disc_real_0: 0.5202003121376038 (0.5202003121376038) | > loss_disc_real_1: 0.2802274525165558 (0.2802274525165558) | > loss_disc_real_2: 0.24452875554561615 (0.24452875554561615) | > loss_disc_real_3: 0.25051432847976685 (0.25051432847976685) | > loss_disc_real_4: 0.25396668910980225 (0.25396668910980225) | > loss_disc_real_5: 0.24978084862232208 (0.24978084862232208) | > loss_0: 3.0652248859405518 (3.0652248859405518) | > loss_gen: 1.8821048736572266 (1.8821048736572266) | > loss_kl: 6.038476943969727 (6.038476943969727) | > loss_feat: 0.21269676089286804 (0.21269676089286804) | > loss_mel: 10.571600914001465 (10.571600914001465) | > loss_duration: 3.0557100772857666 (3.0557100772857666) | > loss_1: 21.760589599609375 (21.760589599609375)  --> STEP: 1 | > loss_disc: 3.0241312980651855 (3.0241312980651855) | > loss_disc_real_0: 0.35523808002471924 (0.35523808002471924) | > loss_disc_real_1: 0.3226105272769928 (0.3226105272769928) | > loss_disc_real_2: 0.2680360972881317 (0.2680360972881317) | > loss_disc_real_3: 0.3447231948375702 (0.3447231948375702) | > loss_disc_real_4: 0.26263195276260376 (0.26263195276260376) | > loss_disc_real_5: 0.28558093309402466 (0.28558093309402466) | > loss_0: 3.0241312980651855 (3.0241312980651855) | > loss_gen: 2.385413646697998 (2.385413646697998) | > loss_kl: 5.23207950592041 (5.23207950592041) | > loss_feat: 4.330130100250244 (4.330130100250244) | > loss_mel: 25.698883056640625 (25.698883056640625) | > loss_duration: 3.2956042289733887 (3.2956042289733887) | > loss_1: 40.94211196899414 (40.94211196899414)  --> STEP: 2 | > loss_disc: 3.0615649223327637 (3.0428481101989746) | > loss_disc_real_0: 0.4841236472129822 (0.4196808636188507) | > loss_disc_real_1: 0.27970898151397705 (0.3011597543954849) | > loss_disc_real_2: 0.2470204383134842 (0.25752826780080795) | > loss_disc_real_3: 0.25093814730644226 (0.2978306710720062) | > loss_disc_real_4: 0.2525884211063385 (0.25761018693447113) | > loss_disc_real_5: 0.25068196654319763 (0.26813144981861115) | > loss_0: 3.0615649223327637 (3.0428481101989746) | > loss_gen: 1.7869898080825806 (2.0862017273902893) | > loss_kl: 5.487053871154785 (5.359566688537598) | > loss_feat: 0.17137975990772247 (2.2507549300789833) | > loss_mel: 7.323295593261719 (16.511089324951172) | > loss_duration: 3.2200801372528076 (3.257842183113098) | > loss_1: 17.988800048828125 (29.465456008911133)  --> STEP: 3 | > loss_disc: 3.1091620922088623 (3.064952770868937) | > loss_disc_real_0: 0.26041311025619507 (0.3665916124979655) | > loss_disc_real_1: 0.40075385570526123 (0.33435778816541034) | > loss_disc_real_2: 0.2161247879266739 (0.24372710784276327) | > loss_disc_real_3: 0.30371108651161194 (0.2997908095518748) | > loss_disc_real_4: 0.3395894765853882 (0.28493661681811017) | > loss_disc_real_5: 0.39280059933662415 (0.30968783299128216) | > loss_0: 3.1091620922088623 (3.064952770868937) | > loss_gen: 2.5592119693756104 (2.243871808052063) | > loss_kl: 2.860323667526245 (4.5264856815338135) | > loss_feat: 3.536703586578369 (2.6794044822454453) | > loss_mel: 17.67095947265625 (16.89771270751953) | > loss_duration: 3.0369961261749268 (3.1842268308003745) | > loss_1: 29.664194107055664 (29.531702041625977) --> EVAL PERFORMANCE | > avg_loader_time: 0.00761564572652181 (-0.023985624313354496) | > avg_loss_disc: 3.064952770868937 (+0.23629299799601222) | > avg_loss_disc_real_0: 0.3665916124979655 (+0.09140951931476593) | > avg_loss_disc_real_1: 0.33435778816541034 (+0.08987835546334583) | > avg_loss_disc_real_2: 0.24372710784276327 (-0.011647110184033721) | > avg_loss_disc_real_3: 0.2997908095518748 (+0.05405173699061078) | > avg_loss_disc_real_4: 0.28493661681811017 (+0.05036155879497531) | > avg_loss_disc_real_5: 0.30968783299128216 (+0.05619937181472778) | > avg_loss_0: 3.064952770868937 (+0.23629299799601222) | > avg_loss_gen: 2.243871808052063 (+0.4539942344029744) | > avg_loss_kl: 4.5264856815338135 (-0.045973380406697295) | > avg_loss_feat: 2.6794044822454453 (+0.18373502045869827) | > avg_loss_mel: 16.89771270751953 (+4.814511100451151) | > avg_loss_duration: 3.1842268308003745 (+0.006910403569539536) | > avg_loss_1: 29.531702041625977 (+5.413177808125813)  > EPOCH: 1065/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:16:21)   --> TIME: 2023-10-20 13:16:33 -- STEP: 9/50 -- GLOBAL_STEP: 106260 | > loss_disc: 2.957657814025879 (2.4538178311453924) | > loss_disc_real_0: 0.20980778336524963 (0.16925408453163174) | > loss_disc_real_1: 0.2759643793106079 (0.24902464780542585) | > loss_disc_real_2: 0.25040143728256226 (0.21086319598058859) | > loss_disc_real_3: 0.2585170865058899 (0.27678664070036674) | > loss_disc_real_4: 0.2579270601272583 (0.1857747518353992) | > loss_disc_real_5: 0.2503657639026642 (0.20532462580336464) | > loss_0: 2.957657814025879 (2.4538178311453924) | > grad_norm_0: tensor(2189.1558, device='cuda:0') (tensor(929.3956, device='cuda:0')) | > loss_gen: 1.5484281778335571 (2.200407862663269) | > loss_kl: 0.7452122569084167 (0.8227898213598464) | > loss_feat: 0.16109970211982727 (5.830709611376126) | > loss_mel: 2.764256477355957 (17.591856135262383) | > loss_duration: 1.3357558250427246 (1.35233653916253) | > loss_1: 6.554752349853516 (27.79809988869561) | > grad_norm_1: tensor(15568.3857, device='cuda:0') (tensor(26752.0059, device='cuda:0')) | > current_lr_0: 6.894098153414101e-05 | > current_lr_1: 6.894098153414101e-05 | > step_time: 0.3881 (0.5737242698669434) | > loader_time: 0.0117 (0.026882410049438477)  --> TIME: 2023-10-20 13:16:45 -- STEP: 39/50 -- GLOBAL_STEP: 106290 | > loss_disc: 2.519193649291992 (2.5333628226549196) | > loss_disc_real_0: 0.11527226865291595 (0.15748330017026418) | > loss_disc_real_1: 0.2428109049797058 (0.23419670149301872) | > loss_disc_real_2: 0.17338477075099945 (0.23283524350382578) | > loss_disc_real_3: 0.2332935482263565 (0.24932085951933503) | > loss_disc_real_4: 0.3089028298854828 (0.22109751418853799) | > loss_disc_real_5: 0.18972867727279663 (0.23180951390606472) | > loss_0: 2.519193649291992 (2.5333628226549196) | > grad_norm_0: tensor(421.5480, device='cuda:0') (tensor(762.2656, device='cuda:0')) | > loss_gen: 2.13543701171875 (2.223653126985598) | > loss_kl: 0.6663349270820618 (0.7881472622736906) | > loss_feat: 3.4678566455841064 (5.595733003547559) | > loss_mel: 20.04119300842285 (20.530388871828716) | > loss_duration: 1.4444574117660522 (1.3402455525520522) | > loss_1: 27.755279541015625 (30.478167692820232) | > grad_norm_1: tensor(5924.8989, device='cuda:0') (tensor(23265.3359, device='cuda:0')) | > current_lr_0: 6.894098153414101e-05 | > current_lr_1: 6.894098153414101e-05 | > step_time: 0.3388 (0.43484410872826207) | > loader_time: 0.0111 (0.013736602587577624)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.521329641342163 (2.521329641342163) | > loss_disc_real_0: 0.10174816846847534 (0.10174816846847534) | > loss_disc_real_1: 0.24021179974079132 (0.24021179974079132) | > loss_disc_real_2: 0.32043853402137756 (0.32043853402137756) | > loss_disc_real_3: 0.266239732503891 (0.266239732503891) | > loss_disc_real_4: 0.20309998095035553 (0.20309998095035553) | > loss_disc_real_5: 0.23119588196277618 (0.23119588196277618) | > loss_0: 2.521329641342163 (2.521329641342163) | > loss_gen: 2.1666455268859863 (2.1666455268859863) | > loss_kl: 6.193892955780029 (6.193892955780029) | > loss_feat: 2.577737808227539 (2.577737808227539) | > loss_mel: 20.274070739746094 (20.274070739746094) | > loss_duration: 3.0744402408599854 (3.0744402408599854) | > loss_1: 34.28678894042969 (34.28678894042969)  --> STEP: 1 | > loss_disc: 2.5487091541290283 (2.5487091541290283) | > loss_disc_real_0: 0.2441440373659134 (0.2441440373659134) | > loss_disc_real_1: 0.4003128409385681 (0.4003128409385681) | > loss_disc_real_2: 0.3217598795890808 (0.3217598795890808) | > loss_disc_real_3: 0.27341485023498535 (0.27341485023498535) | > loss_disc_real_4: 0.33033129572868347 (0.33033129572868347) | > loss_disc_real_5: 0.2406807839870453 (0.2406807839870453) | > loss_0: 2.5487091541290283 (2.5487091541290283) | > loss_gen: 2.746884346008301 (2.746884346008301) | > loss_kl: 5.839974403381348 (5.839974403381348) | > loss_feat: 6.779284477233887 (6.779284477233887) | > loss_mel: 22.39072608947754 (22.39072608947754) | > loss_duration: 3.3335554599761963 (3.3335554599761963) | > loss_1: 41.09042739868164 (41.09042739868164)  --> STEP: 2 | > loss_disc: 2.182636260986328 (2.3656727075576782) | > loss_disc_real_0: 0.19261425733566284 (0.21837914735078812) | > loss_disc_real_1: 0.27217981219291687 (0.3362463265657425) | > loss_disc_real_2: 0.1766480654478073 (0.24920397251844406) | > loss_disc_real_3: 0.1839120090007782 (0.22866342961788177) | > loss_disc_real_4: 0.14256645739078522 (0.23644887655973434) | > loss_disc_real_5: 0.18250034749507904 (0.21159056574106216) | > loss_0: 2.182636260986328 (2.3656727075576782) | > loss_gen: 2.317188262939453 (2.532036304473877) | > loss_kl: 5.943733215332031 (5.8918538093566895) | > loss_feat: 6.083508491516113 (6.431396484375) | > loss_mel: 19.087608337402344 (20.73916721343994) | > loss_duration: 3.229302167892456 (3.281428813934326) | > loss_1: 36.661338806152344 (38.87588310241699)  --> STEP: 3 | > loss_disc: 3.017164468765259 (2.582836627960205) | > loss_disc_real_0: 0.2880792021751404 (0.24161249895890555) | > loss_disc_real_1: 0.3032620847225189 (0.32525157928466797) | > loss_disc_real_2: 0.28220057487487793 (0.2602028399705887) | > loss_disc_real_3: 0.29690274596214294 (0.2514098683993022) | > loss_disc_real_4: 0.2288477122783661 (0.2339151551326116) | > loss_disc_real_5: 0.27424222230911255 (0.23247445126374564) | > loss_0: 3.017164468765259 (2.582836627960205) | > loss_gen: 1.6739318370819092 (2.2460014820098877) | > loss_kl: 3.0277111530303955 (4.937139590581258) | > loss_feat: 0.02828550711274147 (4.2970261586209135) | > loss_mel: 2.315173387527466 (14.597835938135782) | > loss_duration: 2.970515012741089 (3.177790880203247) | > loss_1: 10.015617370605469 (29.255794525146484) --> EVAL PERFORMANCE | > avg_loader_time: 0.0053225358327229815 (-0.002293109893798828) | > avg_loss_disc: 2.582836627960205 (-0.48211614290873195) | > avg_loss_disc_real_0: 0.24161249895890555 (-0.12497911353905997) | > avg_loss_disc_real_1: 0.32525157928466797 (-0.009106208880742372) | > avg_loss_disc_real_2: 0.2602028399705887 (+0.01647573212782541) | > avg_loss_disc_real_3: 0.2514098683993022 (-0.04838094115257263) | > avg_loss_disc_real_4: 0.2339151551326116 (-0.051021461685498565) | > avg_loss_disc_real_5: 0.23247445126374564 (-0.07721338172753653) | > avg_loss_0: 2.582836627960205 (-0.48211614290873195) | > avg_loss_gen: 2.2460014820098877 (+0.002129673957824707) | > avg_loss_kl: 4.937139590581258 (+0.41065390904744437) | > avg_loss_feat: 4.2970261586209135 (+1.6176216763754683) | > avg_loss_mel: 14.597835938135782 (-2.299876769383749) | > avg_loss_duration: 3.177790880203247 (-0.006435950597127427) | > avg_loss_1: 29.255794525146484 (-0.2759075164794922)  > EPOCH: 1066/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:17:14)   --> TIME: 2023-10-20 13:17:30 -- STEP: 19/50 -- GLOBAL_STEP: 106320 | > loss_disc: 3.014212131500244 (2.433206401373211) | > loss_disc_real_0: 0.3364945650100708 (0.14189561230963782) | > loss_disc_real_1: 0.24931631982326508 (0.2292614681156058) | > loss_disc_real_2: 0.25524821877479553 (0.2220712915847176) | > loss_disc_real_3: 0.25414523482322693 (0.23371174558997154) | > loss_disc_real_4: 0.252634733915329 (0.22003112949038806) | > loss_disc_real_5: 0.3042351305484772 (0.21368071976068773) | > loss_0: 3.014212131500244 (2.433206401373211) | > grad_norm_0: tensor(881.8920, device='cuda:0') (tensor(841.6094, device='cuda:0')) | > loss_gen: 1.6412534713745117 (2.2443172743445947) | > loss_kl: 1.008058786392212 (0.9330491596146634) | > loss_feat: 0.12871026992797852 (4.750135229606378) | > loss_mel: 5.209203720092773 (18.528621435165405) | > loss_duration: 1.4357481002807617 (1.371519684791565) | > loss_1: 9.422974586486816 (27.827642566279362) | > grad_norm_1: tensor(35343.9961, device='cuda:0') (tensor(25103.8945, device='cuda:0')) | > current_lr_0: 6.887207070674702e-05 | > current_lr_1: 6.887207070674702e-05 | > step_time: 0.3097 (0.511937931964272) | > loader_time: 0.0067 (0.018936684257105776)  --> TIME: 2023-10-20 13:17:49 -- STEP: 49/50 -- GLOBAL_STEP: 106350 | > loss_disc: 3.015127182006836 (2.4043999849533546) | > loss_disc_real_0: 0.20012591779232025 (0.1465813673994675) | > loss_disc_real_1: 0.2562117874622345 (0.22122087090143136) | > loss_disc_real_2: 0.2254159301519394 (0.21474722177930633) | > loss_disc_real_3: 0.29092031717300415 (0.2300235542031575) | > loss_disc_real_4: 0.25301679968833923 (0.21649386208238347) | > loss_disc_real_5: 0.2821054756641388 (0.2110365277384313) | > loss_0: 3.015127182006836 (2.4043999849533546) | > grad_norm_0: tensor(1085.9867, device='cuda:0') (tensor(773.8229, device='cuda:0')) | > loss_gen: 1.5718953609466553 (2.2495951530884724) | > loss_kl: 0.8542255163192749 (0.7638850482750912) | > loss_feat: 0.060889121145009995 (4.905305691899693) | > loss_mel: 2.9628372192382812 (18.787359369044406) | > loss_duration: 1.4099786281585693 (1.3424792289733887) | > loss_1: 6.85982608795166 (28.048624447413854) | > grad_norm_1: tensor(76608.1484, device='cuda:0') (tensor(23792.4961, device='cuda:0')) | > current_lr_0: 6.887207070674702e-05 | > current_lr_1: 6.887207070674702e-05 | > step_time: 0.8503 (0.5623034311800587) | > loader_time: 0.4333 (0.025828896736612122)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.164252519607544 (2.164252519607544) | > loss_disc_real_0: 0.15846838057041168 (0.15846838057041168) | > loss_disc_real_1: 0.3944459557533264 (0.3944459557533264) | > loss_disc_real_2: 0.29246294498443604 (0.29246294498443604) | > loss_disc_real_3: 0.2910457253456116 (0.2910457253456116) | > loss_disc_real_4: 0.18154017627239227 (0.18154017627239227) | > loss_disc_real_5: 0.23524793982505798 (0.23524793982505798) | > loss_0: 2.164252519607544 (2.164252519607544) | > loss_gen: 3.3204708099365234 (3.3204708099365234) | > loss_kl: 5.385623455047607 (5.385623455047607) | > loss_feat: 8.588109970092773 (8.588109970092773) | > loss_mel: 22.470752716064453 (22.470752716064453) | > loss_duration: 2.9791290760040283 (2.9791290760040283) | > loss_1: 42.74409103393555 (42.74409103393555)  --> STEP: 1 | > loss_disc: 2.336505889892578 (2.336505889892578) | > loss_disc_real_0: 0.1323682963848114 (0.1323682963848114) | > loss_disc_real_1: 0.24569912254810333 (0.24569912254810333) | > loss_disc_real_2: 0.22567230463027954 (0.22567230463027954) | > loss_disc_real_3: 0.306607186794281 (0.306607186794281) | > loss_disc_real_4: 0.25662365555763245 (0.25662365555763245) | > loss_disc_real_5: 0.23146070539951324 (0.23146070539951324) | > loss_0: 2.336505889892578 (2.336505889892578) | > loss_gen: 2.880445957183838 (2.880445957183838) | > loss_kl: 5.423659324645996 (5.423659324645996) | > loss_feat: 8.012362480163574 (8.012362480163574) | > loss_mel: 23.214962005615234 (23.214962005615234) | > loss_duration: 3.3146445751190186 (3.3146445751190186) | > loss_1: 42.84607696533203 (42.84607696533203)  --> STEP: 2 | > loss_disc: 1.983973503112793 (2.1602396965026855) | > loss_disc_real_0: 0.1913779228925705 (0.16187310963869095) | > loss_disc_real_1: 0.16889488697052002 (0.20729700475931168) | > loss_disc_real_2: 0.14737871289253235 (0.18652550876140594) | > loss_disc_real_3: 0.0925123542547226 (0.1995597705245018) | > loss_disc_real_4: 0.26555851101875305 (0.26109108328819275) | > loss_disc_real_5: 0.24327629804611206 (0.23736850172281265) | > loss_0: 1.983973503112793 (2.1602396965026855) | > loss_gen: 2.7111239433288574 (2.7957849502563477) | > loss_kl: 5.653525352478027 (5.538592338562012) | > loss_feat: 9.852889060974121 (8.932625770568848) | > loss_mel: 22.303312301635742 (22.75913715362549) | > loss_duration: 3.1285884380340576 (3.221616506576538) | > loss_1: 43.64944076538086 (43.247758865356445)  --> STEP: 3 | > loss_disc: 3.0048959255218506 (2.4417917728424072) | > loss_disc_real_0: 0.36255452036857605 (0.2287669132153193) | > loss_disc_real_1: 0.6028385162353516 (0.33914417525132495) | > loss_disc_real_2: 0.5087738037109375 (0.29394160707791644) | > loss_disc_real_3: 0.4035223126411438 (0.26754728456338245) | > loss_disc_real_4: 0.3311551809310913 (0.28444578250249225) | > loss_disc_real_5: 0.25125330686569214 (0.2419967701037725) | > loss_0: 3.0048959255218506 (2.4417917728424072) | > loss_gen: 3.778140068054199 (3.123236656188965) | > loss_kl: 2.8735430240631104 (4.650242567062378) | > loss_feat: 6.276517391204834 (8.047256310780844) | > loss_mel: 21.2039852142334 (22.240753173828125) | > loss_duration: 2.9679574966430664 (3.137063503265381) | > loss_1: 37.10014343261719 (41.198553721110024) --> EVAL PERFORMANCE | > avg_loader_time: 0.007987419764200846 (+0.0026648839314778643) | > avg_loss_disc: 2.4417917728424072 (-0.14104485511779785) | > avg_loss_disc_real_0: 0.2287669132153193 (-0.01284558574358624) | > avg_loss_disc_real_1: 0.33914417525132495 (+0.013892595966656984) | > avg_loss_disc_real_2: 0.29394160707791644 (+0.03373876710732776) | > avg_loss_disc_real_3: 0.26754728456338245 (+0.016137416164080265) | > avg_loss_disc_real_4: 0.28444578250249225 (+0.05053062736988065) | > avg_loss_disc_real_5: 0.2419967701037725 (+0.009522318840026855) | > avg_loss_0: 2.4417917728424072 (-0.14104485511779785) | > avg_loss_gen: 3.123236656188965 (+0.8772351741790771) | > avg_loss_kl: 4.650242567062378 (-0.2868970235188799) | > avg_loss_feat: 8.047256310780844 (+3.75023015215993) | > avg_loss_mel: 22.240753173828125 (+7.642917235692343) | > avg_loss_duration: 3.137063503265381 (-0.04072737693786621) | > avg_loss_1: 41.198553721110024 (+11.94275919596354)  > EPOCH: 1067/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:18:09)   --> TIME: 2023-10-20 13:18:40 -- STEP: 29/50 -- GLOBAL_STEP: 106380 | > loss_disc: 1.6908643245697021 (2.429160923793398) | > loss_disc_real_0: 0.08764300495386124 (0.1370755582245003) | > loss_disc_real_1: 0.21793492138385773 (0.21957011469479265) | > loss_disc_real_2: 0.15625935792922974 (0.22132981817462835) | > loss_disc_real_3: 0.1873406618833542 (0.23146988014722691) | > loss_disc_real_4: 0.04453516751527786 (0.2200645981035356) | > loss_disc_real_5: 0.08774694800376892 (0.22257792940042143) | > loss_0: 1.6908643245697021 (2.429160923793398) | > grad_norm_0: tensor(381.4381, device='cuda:0') (tensor(671.9309, device='cuda:0')) | > loss_gen: 2.7733383178710938 (2.2527140378952017) | > loss_kl: 0.579442024230957 (0.8071244919094546) | > loss_feat: 9.572256088256836 (5.739084292331646) | > loss_mel: 21.42276382446289 (20.834260956994424) | > loss_duration: 1.3207793235778809 (1.3404007081327767) | > loss_1: 35.6685791015625 (30.973584438192432) | > grad_norm_1: tensor(23142.8184, device='cuda:0') (tensor(23917.5820, device='cuda:0')) | > current_lr_0: 6.880322876003946e-05 | > current_lr_1: 6.880322876003946e-05 | > step_time: 0.4659 (0.6282417198707317) | > loader_time: 0.0254 (0.020125027360587286)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9757778644561768 (2.9757778644561768) | > loss_disc_real_0: 0.36481109261512756 (0.36481109261512756) | > loss_disc_real_1: 0.27956756949424744 (0.27956756949424744) | > loss_disc_real_2: 0.30576062202453613 (0.30576062202453613) | > loss_disc_real_3: 0.4659716784954071 (0.4659716784954071) | > loss_disc_real_4: 0.2637052536010742 (0.2637052536010742) | > loss_disc_real_5: 0.23446369171142578 (0.23446369171142578) | > loss_0: 2.9757778644561768 (2.9757778644561768) | > loss_gen: 2.3360507488250732 (2.3360507488250732) | > loss_kl: 6.422004222869873 (6.422004222869873) | > loss_feat: 5.6528215408325195 (5.6528215408325195) | > loss_mel: 22.41866111755371 (22.41866111755371) | > loss_duration: 3.017730236053467 (3.017730236053467) | > loss_1: 39.847267150878906 (39.847267150878906)  --> STEP: 1 | > loss_disc: 2.676365852355957 (2.676365852355957) | > loss_disc_real_0: 0.1640649437904358 (0.1640649437904358) | > loss_disc_real_1: 0.2877185642719269 (0.2877185642719269) | > loss_disc_real_2: 0.33788102865219116 (0.33788102865219116) | > loss_disc_real_3: 0.37921249866485596 (0.37921249866485596) | > loss_disc_real_4: 0.2622508704662323 (0.2622508704662323) | > loss_disc_real_5: 0.2902529239654541 (0.2902529239654541) | > loss_0: 2.676365852355957 (2.676365852355957) | > loss_gen: 2.2922027111053467 (2.2922027111053467) | > loss_kl: 5.564109802246094 (5.564109802246094) | > loss_feat: 1.298678994178772 (1.298678994178772) | > loss_mel: 21.58213996887207 (21.58213996887207) | > loss_duration: 3.2615089416503906 (3.2615089416503906) | > loss_1: 33.99864196777344 (33.99864196777344)  --> STEP: 2 | > loss_disc: 3.0094001293182373 (2.842882990837097) | > loss_disc_real_0: 0.28548282384872437 (0.22477388381958008) | > loss_disc_real_1: 0.3292601406574249 (0.3084893524646759) | > loss_disc_real_2: 0.3606341481208801 (0.34925758838653564) | > loss_disc_real_3: 0.3427635729312897 (0.3609880357980728) | > loss_disc_real_4: 0.26260045170783997 (0.26242566108703613) | > loss_disc_real_5: 0.28929784893989563 (0.28977538645267487) | > loss_0: 3.0094001293182373 (2.842882990837097) | > loss_gen: 1.9602781534194946 (2.1262404322624207) | > loss_kl: 5.3073530197143555 (5.435731410980225) | > loss_feat: 0.6868958473205566 (0.9927874207496643) | > loss_mel: 20.342796325683594 (20.962468147277832) | > loss_duration: 3.241936206817627 (3.251722574234009) | > loss_1: 31.53925895690918 (32.76895046234131)  --> STEP: 3 | > loss_disc: 2.9589762687683105 (2.8815807501475015) | > loss_disc_real_0: 0.30561187863349915 (0.2517198820908864) | > loss_disc_real_1: 0.32574957609176636 (0.31424276034037274) | > loss_disc_real_2: 0.3705085515975952 (0.35634124279022217) | > loss_disc_real_3: 0.33868473768234253 (0.3535536030928294) | > loss_disc_real_4: 0.2620599865913391 (0.26230376958847046) | > loss_disc_real_5: 0.28934648633003235 (0.2896324197451274) | > loss_0: 2.9589762687683105 (2.8815807501475015) | > loss_gen: 2.06244158744812 (2.104974150657654) | > loss_kl: 2.982210159301758 (4.617890993754069) | > loss_feat: 0.421217143535614 (0.8022639950116476) | > loss_mel: 15.99059009552002 (19.305175463358562) | > loss_duration: 2.9915220737457275 (3.1649890740712485) | > loss_1: 24.447980880737305 (29.995293935139973) --> EVAL PERFORMANCE | > avg_loader_time: 0.00440216064453125 (-0.0035852591196695958) | > avg_loss_disc: 2.8815807501475015 (+0.43978897730509425) | > avg_loss_disc_real_0: 0.2517198820908864 (+0.02295296887556711) | > avg_loss_disc_real_1: 0.31424276034037274 (-0.024901414910952213) | > avg_loss_disc_real_2: 0.35634124279022217 (+0.06239963571230572) | > avg_loss_disc_real_3: 0.3535536030928294 (+0.08600631852944696) | > avg_loss_disc_real_4: 0.26230376958847046 (-0.02214201291402179) | > avg_loss_disc_real_5: 0.2896324197451274 (+0.04763564964135489) | > avg_loss_0: 2.8815807501475015 (+0.43978897730509425) | > avg_loss_gen: 2.104974150657654 (-1.018262505531311) | > avg_loss_kl: 4.617890993754069 (-0.03235157330830862) | > avg_loss_feat: 0.8022639950116476 (-7.2449923157691964) | > avg_loss_mel: 19.305175463358562 (-2.9355777104695626) | > avg_loss_duration: 3.1649890740712485 (+0.02792557080586766) | > avg_loss_1: 29.995293935139973 (-11.203259785970051)  > EPOCH: 1068/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:19:16)   --> TIME: 2023-10-20 13:19:27 -- STEP: 9/50 -- GLOBAL_STEP: 106410 | > loss_disc: 2.2458744049072266 (2.429268585311042) | > loss_disc_real_0: 0.12406593561172485 (0.1432147224744161) | > loss_disc_real_1: 0.20652981102466583 (0.22524434245294994) | > loss_disc_real_2: 0.15673045814037323 (0.23483268833822674) | > loss_disc_real_3: 0.24503129720687866 (0.23953189162744415) | > loss_disc_real_4: 0.1393134891986847 (0.1922693500916163) | > loss_disc_real_5: 0.21792973577976227 (0.2356000918791526) | > loss_0: 2.2458744049072266 (2.429268585311042) | > grad_norm_0: tensor(238.2473, device='cuda:0') (tensor(719.0468, device='cuda:0')) | > loss_gen: 2.2569963932037354 (2.2876681884129844) | > loss_kl: 0.6931862235069275 (0.757589171330134) | > loss_feat: 5.289828777313232 (5.821411641107665) | > loss_mel: 20.943567276000977 (17.797107193205093) | > loss_duration: 1.3345487117767334 (1.3580189281039767) | > loss_1: 30.51812744140625 (28.021794690026177) | > grad_norm_1: tensor(6213.0190, device='cuda:0') (tensor(28446.7812, device='cuda:0')) | > current_lr_0: 6.873445562516781e-05 | > current_lr_1: 6.873445562516781e-05 | > step_time: 0.362 (0.4728163613213433) | > loader_time: 0.0081 (0.010499980714586046)  --> TIME: 2023-10-20 13:19:41 -- STEP: 39/50 -- GLOBAL_STEP: 106440 | > loss_disc: 2.7229161262512207 (2.5012904161061997) | > loss_disc_real_0: 0.19003593921661377 (0.15495800991088915) | > loss_disc_real_1: 0.24312148988246918 (0.2204813914707838) | > loss_disc_real_2: 0.19029785692691803 (0.22974975149218851) | > loss_disc_real_3: 0.18827417492866516 (0.24486438500193458) | > loss_disc_real_4: 0.1882796734571457 (0.21698807055751482) | > loss_disc_real_5: 0.19400697946548462 (0.22777554432216746) | > loss_0: 2.7229161262512207 (2.5012904161061997) | > grad_norm_0: tensor(653.4258, device='cuda:0') (tensor(614.8803, device='cuda:0')) | > loss_gen: 1.901344656944275 (2.246599998229589) | > loss_kl: 0.5864248275756836 (0.7904499255214782) | > loss_feat: 4.484930992126465 (5.620836137674557) | > loss_mel: 23.24840545654297 (19.352228222749176) | > loss_duration: 1.447333812713623 (1.3453170489042234) | > loss_1: 31.668439865112305 (29.35543127549) | > grad_norm_1: tensor(5389.8765, device='cuda:0') (tensor(20341.5273, device='cuda:0')) | > current_lr_0: 6.873445562516781e-05 | > current_lr_1: 6.873445562516781e-05 | > step_time: 0.3188 (0.4723742069342198) | > loader_time: 0.0146 (0.012070826995067107)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1933250427246094 (3.1933250427246094) | > loss_disc_real_0: 0.6148136258125305 (0.6148136258125305) | > loss_disc_real_1: 0.25176820158958435 (0.25176820158958435) | > loss_disc_real_2: 0.44618991017341614 (0.44618991017341614) | > loss_disc_real_3: 0.30030307173728943 (0.30030307173728943) | > loss_disc_real_4: 0.382881760597229 (0.382881760597229) | > loss_disc_real_5: 0.4087257981300354 (0.4087257981300354) | > loss_0: 3.1933250427246094 (3.1933250427246094) | > loss_gen: 2.7829010486602783 (2.7829010486602783) | > loss_kl: 5.630856990814209 (5.630856990814209) | > loss_feat: 4.600766181945801 (4.600766181945801) | > loss_mel: 21.929636001586914 (21.929636001586914) | > loss_duration: 2.994908094406128 (2.994908094406128) | > loss_1: 37.93906784057617 (37.93906784057617)  --> STEP: 1 | > loss_disc: 2.917783260345459 (2.917783260345459) | > loss_disc_real_0: 0.43726229667663574 (0.43726229667663574) | > loss_disc_real_1: 0.29097139835357666 (0.29097139835357666) | > loss_disc_real_2: 0.2604171931743622 (0.2604171931743622) | > loss_disc_real_3: 0.251280814409256 (0.251280814409256) | > loss_disc_real_4: 0.2702551484107971 (0.2702551484107971) | > loss_disc_real_5: 0.20747891068458557 (0.20747891068458557) | > loss_0: 2.917783260345459 (2.917783260345459) | > loss_gen: 2.265641689300537 (2.265641689300537) | > loss_kl: 4.819942474365234 (4.819942474365234) | > loss_feat: 1.7687934637069702 (1.7687934637069702) | > loss_mel: 20.840091705322266 (20.840091705322266) | > loss_duration: 3.3142800331115723 (3.3142800331115723) | > loss_1: 33.008750915527344 (33.008750915527344)  --> STEP: 2 | > loss_disc: 2.871809482574463 (2.894796371459961) | > loss_disc_real_0: 0.2570374011993408 (0.3471498489379883) | > loss_disc_real_1: 0.3121212422847748 (0.3015463203191757) | > loss_disc_real_2: 0.29423201084136963 (0.2773246020078659) | > loss_disc_real_3: 0.248934805393219 (0.2501078099012375) | > loss_disc_real_4: 0.2769860625267029 (0.27362060546875) | > loss_disc_real_5: 0.26616615056991577 (0.23682253062725067) | > loss_0: 2.871809482574463 (2.894796371459961) | > loss_gen: 1.9146783351898193 (2.0901600122451782) | > loss_kl: 5.688454627990723 (5.2541985511779785) | > loss_feat: 1.5757386684417725 (1.6722660660743713) | > loss_mel: 21.753297805786133 (21.2966947555542) | > loss_duration: 3.115159749984741 (3.2147198915481567) | > loss_1: 34.04732894897461 (33.52803993225098)  --> STEP: 3 | > loss_disc: 3.085012912750244 (2.9582018852233887) | > loss_disc_real_0: 0.5409469604492188 (0.41174888610839844) | > loss_disc_real_1: 0.384552001953125 (0.3292148808638255) | > loss_disc_real_2: 0.2819162905216217 (0.2788551648457845) | > loss_disc_real_3: 0.23502163589000702 (0.24507908523082733) | > loss_disc_real_4: 0.2868501543998718 (0.2780304551124573) | > loss_disc_real_5: 0.241130068898201 (0.23825837671756744) | > loss_0: 3.085012912750244 (2.9582018852233887) | > loss_gen: 2.18182635307312 (2.1207154591878257) | > loss_kl: 2.8202872276306152 (4.4428947766621905) | > loss_feat: 1.3530519008636475 (1.5658613443374634) | > loss_mel: 21.497146606445312 (21.36351203918457) | > loss_duration: 2.927107572555542 (3.1188491185506186) | > loss_1: 30.7794189453125 (32.61183293660482) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025823116302490234 (-0.0018198490142822266) | > avg_loss_disc: 2.9582018852233887 (+0.07662113507588719) | > avg_loss_disc_real_0: 0.41174888610839844 (+0.16002900401751202) | > avg_loss_disc_real_1: 0.3292148808638255 (+0.014972120523452759) | > avg_loss_disc_real_2: 0.2788551648457845 (-0.07748607794443768) | > avg_loss_disc_real_3: 0.24507908523082733 (-0.10847451786200207) | > avg_loss_disc_real_4: 0.2780304551124573 (+0.015726685523986816) | > avg_loss_disc_real_5: 0.23825837671756744 (-0.051374043027559935) | > avg_loss_0: 2.9582018852233887 (+0.07662113507588719) | > avg_loss_gen: 2.1207154591878257 (+0.01574130853017186) | > avg_loss_kl: 4.4428947766621905 (-0.17499621709187885) | > avg_loss_feat: 1.5658613443374634 (+0.7635973493258158) | > avg_loss_mel: 21.36351203918457 (+2.058336575826008) | > avg_loss_duration: 3.1188491185506186 (-0.04613995552062988) | > avg_loss_1: 32.61183293660482 (+2.6165390014648473)  > EPOCH: 1069/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:20:06)   --> TIME: 2023-10-20 13:20:24 -- STEP: 19/50 -- GLOBAL_STEP: 106470 | > loss_disc: 1.6484746932983398 (2.32598004215642) | > loss_disc_real_0: 0.03939772769808769 (0.15352410587825274) | > loss_disc_real_1: 0.1112440899014473 (0.2122911606964312) | > loss_disc_real_2: 0.05169958993792534 (0.2231866680085659) | > loss_disc_real_3: 0.05511770769953728 (0.22308375039382985) | > loss_disc_real_4: 0.025940673425793648 (0.21123524098411986) | > loss_disc_real_5: 0.00815768726170063 (0.2178972444349998) | > loss_0: 1.6484746932983398 (2.32598004215642) | > grad_norm_0: tensor(296.1974, device='cuda:0') (tensor(674.9719, device='cuda:0')) | > loss_gen: 2.394392251968384 (2.36262771957799) | > loss_kl: 0.8988226652145386 (0.7866559765840831) | > loss_feat: 11.472146987915039 (5.839587782852743) | > loss_mel: 24.289674758911133 (20.29300480139883) | > loss_duration: 1.4094408750534058 (1.3763144392716258) | > loss_1: 40.4644775390625 (30.658190877814043) | > grad_norm_1: tensor(5095.4976, device='cuda:0') (tensor(27682.4707, device='cuda:0')) | > current_lr_0: 6.866575123335029e-05 | > current_lr_1: 6.866575123335029e-05 | > step_time: 0.6293 (0.6290618871387682) | > loader_time: 0.0274 (0.022073544953998766)  --> TIME: 2023-10-20 13:20:40 -- STEP: 49/50 -- GLOBAL_STEP: 106500 | > loss_disc: 2.3041374683380127 (2.432847706639037) | > loss_disc_real_0: 0.20524907112121582 (0.1487451979168216) | > loss_disc_real_1: 0.20562314987182617 (0.21824074164032936) | > loss_disc_real_2: 0.15766769647598267 (0.22013995613978835) | > loss_disc_real_3: 0.12542325258255005 (0.21743678924988727) | > loss_disc_real_4: 0.0964907631278038 (0.22193103563040495) | > loss_disc_real_5: 0.15130607783794403 (0.22489256740604735) | > loss_0: 2.3041374683380127 (2.432847706639037) | > grad_norm_0: tensor(593.3461, device='cuda:0') (tensor(635.3824, device='cuda:0')) | > loss_gen: 2.400019407272339 (2.2704277135887936) | > loss_kl: 0.5192167162895203 (0.8061273736613137) | > loss_feat: 6.726597309112549 (5.283158247834262) | > loss_mel: 26.319169998168945 (19.233482893632385) | > loss_duration: 1.454086422920227 (1.349154250962394) | > loss_1: 37.419090270996094 (28.942350630857508) | > grad_norm_1: tensor(34905.4062, device='cuda:0') (tensor(24247.9590, device='cuda:0')) | > current_lr_0: 6.866575123335029e-05 | > current_lr_1: 6.866575123335029e-05 | > step_time: 0.3355 (0.5537592196951107) | > loader_time: 0.5706 (0.03015002912404586)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.813201427459717 (2.813201427459717) | > loss_disc_real_0: 0.39715322852134705 (0.39715322852134705) | > loss_disc_real_1: 0.18206775188446045 (0.18206775188446045) | > loss_disc_real_2: 0.24888724088668823 (0.24888724088668823) | > loss_disc_real_3: 0.31557968258857727 (0.31557968258857727) | > loss_disc_real_4: 0.26189124584198 (0.26189124584198) | > loss_disc_real_5: 0.5416204333305359 (0.5416204333305359) | > loss_0: 2.813201427459717 (2.813201427459717) | > loss_gen: 3.1798605918884277 (3.1798605918884277) | > loss_kl: 5.650901794433594 (5.650901794433594) | > loss_feat: 5.9671525955200195 (5.9671525955200195) | > loss_mel: 22.395402908325195 (22.395402908325195) | > loss_duration: 2.995269536972046 (2.995269536972046) | > loss_1: 40.1885871887207 (40.1885871887207)  --> STEP: 1 | > loss_disc: 1.9536569118499756 (1.9536569118499756) | > loss_disc_real_0: 0.23794449865818024 (0.23794449865818024) | > loss_disc_real_1: 0.17338934540748596 (0.17338934540748596) | > loss_disc_real_2: 0.2157374769449234 (0.2157374769449234) | > loss_disc_real_3: 0.19504645466804504 (0.19504645466804504) | > loss_disc_real_4: 0.09498527646064758 (0.09498527646064758) | > loss_disc_real_5: 0.08886948227882385 (0.08886948227882385) | > loss_0: 1.9536569118499756 (1.9536569118499756) | > loss_gen: 2.437696695327759 (2.437696695327759) | > loss_kl: 5.619002819061279 (5.619002819061279) | > loss_feat: 10.39090633392334 (10.39090633392334) | > loss_mel: 22.95522117614746 (22.95522117614746) | > loss_duration: 3.4293079376220703 (3.4293079376220703) | > loss_1: 44.83213806152344 (44.83213806152344)  --> STEP: 2 | > loss_disc: 2.861208915710449 (2.4074329137802124) | > loss_disc_real_0: 0.3858855664730072 (0.3119150325655937) | > loss_disc_real_1: 0.33717331290245056 (0.25528132915496826) | > loss_disc_real_2: 0.16534046828746796 (0.19053897261619568) | > loss_disc_real_3: 0.271369993686676 (0.23320822417736053) | > loss_disc_real_4: 0.2906409800052643 (0.19281312823295593) | > loss_disc_real_5: 0.27379271388053894 (0.1813310980796814) | > loss_0: 2.861208915710449 (2.4074329137802124) | > loss_gen: 2.1153507232666016 (2.27652370929718) | > loss_kl: 5.671512126922607 (5.645257472991943) | > loss_feat: 1.9401614665985107 (6.165533900260925) | > loss_mel: 21.666797637939453 (22.311009407043457) | > loss_duration: 3.1516902446746826 (3.2904990911483765) | > loss_1: 34.54551315307617 (39.688825607299805)  --> STEP: 3 | > loss_disc: 3.2876455783843994 (2.7008371353149414) | > loss_disc_real_0: 0.7714555263519287 (0.4650951971610387) | > loss_disc_real_1: 0.28161489963531494 (0.2640591859817505) | > loss_disc_real_2: 0.2640983760356903 (0.21505877375602722) | > loss_disc_real_3: 0.2973535656929016 (0.2545900046825409) | > loss_disc_real_4: 0.28433385491371155 (0.22332003712654114) | > loss_disc_real_5: 0.24182027578353882 (0.20149415731430054) | > loss_0: 3.2876455783843994 (2.7008371353149414) | > loss_gen: 2.126725196838379 (2.226590871810913) | > loss_kl: 2.8533859252929688 (4.714633623758952) | > loss_feat: 0.08321663737297058 (4.138094812631607) | > loss_mel: 2.054802656173706 (15.558940490086874) | > loss_duration: 2.9633750915527344 (3.181457757949829) | > loss_1: 10.08150577545166 (29.819718996683758) --> EVAL PERFORMANCE | > avg_loader_time: 0.011942625045776367 (+0.009360313415527344) | > avg_loss_disc: 2.7008371353149414 (-0.25736474990844727) | > avg_loss_disc_real_0: 0.4650951971610387 (+0.05334631105264026) | > avg_loss_disc_real_1: 0.2640591859817505 (-0.06515569488207501) | > avg_loss_disc_real_2: 0.21505877375602722 (-0.06379639108975727) | > avg_loss_disc_real_3: 0.2545900046825409 (+0.009510919451713562) | > avg_loss_disc_real_4: 0.22332003712654114 (-0.05471041798591614) | > avg_loss_disc_real_5: 0.20149415731430054 (-0.03676421940326691) | > avg_loss_0: 2.7008371353149414 (-0.25736474990844727) | > avg_loss_gen: 2.226590871810913 (+0.10587541262308742) | > avg_loss_kl: 4.714633623758952 (+0.27173884709676166) | > avg_loss_feat: 4.138094812631607 (+2.5722334682941437) | > avg_loss_mel: 15.558940490086874 (-5.804571549097696) | > avg_loss_duration: 3.181457757949829 (+0.06260863939921046) | > avg_loss_1: 29.819718996683758 (-2.7921139399210624)  > EPOCH: 1070/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:20:59)   --> TIME: 2023-10-20 13:21:21 -- STEP: 29/50 -- GLOBAL_STEP: 106530 | > loss_disc: 1.6725410223007202 (2.538124585973805) | > loss_disc_real_0: 0.0947577953338623 (0.1931953751963788) | > loss_disc_real_1: 0.18119235336780548 (0.22714096815164747) | > loss_disc_real_2: 0.16101616621017456 (0.22801121812442254) | > loss_disc_real_3: 0.16717936098575592 (0.24870944601194603) | > loss_disc_real_4: 0.10004247725009918 (0.23039575775378737) | > loss_disc_real_5: 0.07944729924201965 (0.22882432384609147) | > loss_0: 1.6725410223007202 (2.538124585973805) | > grad_norm_0: tensor(282.2989, device='cuda:0') (tensor(644.5547, device='cuda:0')) | > loss_gen: 2.4844071865081787 (2.181875364533786) | > loss_kl: 0.8735060691833496 (0.7994250408534346) | > loss_feat: 7.541635990142822 (4.7545079103317756) | > loss_mel: 23.5505428314209 (17.759803027942265) | > loss_duration: 1.3328546285629272 (1.3558953507193203) | > loss_1: 35.7829475402832 (26.85150674293781) | > grad_norm_1: tensor(2777.6968, device='cuda:0') (tensor(26611.0605, device='cuda:0')) | > current_lr_0: 6.859711551587393e-05 | > current_lr_1: 6.859711551587393e-05 | > step_time: 0.587 (0.5518840839122904) | > loader_time: 0.0192 (0.015423955588505185)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.14920711517334 (3.14920711517334) | > loss_disc_real_0: 0.46950459480285645 (0.46950459480285645) | > loss_disc_real_1: 0.2256755232810974 (0.2256755232810974) | > loss_disc_real_2: 0.20409142971038818 (0.20409142971038818) | > loss_disc_real_3: 0.194950670003891 (0.194950670003891) | > loss_disc_real_4: 0.21434646844863892 (0.21434646844863892) | > loss_disc_real_5: 0.28903380036354065 (0.28903380036354065) | > loss_0: 3.14920711517334 (3.14920711517334) | > loss_gen: 1.5467605590820312 (1.5467605590820312) | > loss_kl: 5.493200302124023 (5.493200302124023) | > loss_feat: 2.534902572631836 (2.534902572631836) | > loss_mel: 19.567995071411133 (19.567995071411133) | > loss_duration: 2.9794468879699707 (2.9794468879699707) | > loss_1: 32.12230682373047 (32.12230682373047)  --> STEP: 1 | > loss_disc: 2.8938560485839844 (2.8938560485839844) | > loss_disc_real_0: 0.3037436008453369 (0.3037436008453369) | > loss_disc_real_1: 0.30140283703804016 (0.30140283703804016) | > loss_disc_real_2: 0.24462446570396423 (0.24462446570396423) | > loss_disc_real_3: 0.26370832324028015 (0.26370832324028015) | > loss_disc_real_4: 0.25855016708374023 (0.25855016708374023) | > loss_disc_real_5: 0.24070429801940918 (0.24070429801940918) | > loss_0: 2.8938560485839844 (2.8938560485839844) | > loss_gen: 1.7758139371871948 (1.7758139371871948) | > loss_kl: 4.919744491577148 (4.919744491577148) | > loss_feat: 0.4201948046684265 (0.4201948046684265) | > loss_mel: 13.527735710144043 (13.527735710144043) | > loss_duration: 3.247236728668213 (3.247236728668213) | > loss_1: 23.89072608947754 (23.89072608947754)  --> STEP: 2 | > loss_disc: 2.5719094276428223 (2.7328827381134033) | > loss_disc_real_0: 0.22301842272281647 (0.2633810117840767) | > loss_disc_real_1: 0.3582056164741516 (0.3298042267560959) | > loss_disc_real_2: 0.23447412252426147 (0.23954929411411285) | > loss_disc_real_3: 0.3858901262283325 (0.32479922473430634) | > loss_disc_real_4: 0.2572368085384369 (0.25789348781108856) | > loss_disc_real_5: 0.2284853458404541 (0.23459482192993164) | > loss_0: 2.5719094276428223 (2.7328827381134033) | > loss_gen: 2.7127878665924072 (2.244300901889801) | > loss_kl: 5.242573261260986 (5.081158876419067) | > loss_feat: 6.220277309417725 (3.3202360570430756) | > loss_mel: 24.10645866394043 (18.817097187042236) | > loss_duration: 3.2060916423797607 (3.226664185523987) | > loss_1: 41.488189697265625 (32.68945789337158)  --> STEP: 3 | > loss_disc: 3.0265092849731445 (2.830758253733317) | > loss_disc_real_0: 0.3396625220775604 (0.2888081818819046) | > loss_disc_real_1: 0.3015502691268921 (0.32038624087969464) | > loss_disc_real_2: 0.26164522767066956 (0.24691460529963175) | > loss_disc_real_3: 0.26753532886505127 (0.30571125944455463) | > loss_disc_real_4: 0.25761836767196655 (0.2578017810980479) | > loss_disc_real_5: 0.2419818490743637 (0.237057164311409) | > loss_0: 3.0265092849731445 (2.830758253733317) | > loss_gen: 1.6619236469268799 (2.050175150235494) | > loss_kl: 2.8605828285217285 (4.340966860453288) | > loss_feat: 0.09671839326620102 (2.2457301691174507) | > loss_mel: 2.7124505043029785 (13.44888162612915) | > loss_duration: 2.9884274005889893 (3.147251923878988) | > loss_1: 10.32010269165039 (25.23300615946452) --> EVAL PERFORMANCE | > avg_loader_time: 0.018368005752563477 (+0.006425380706787109) | > avg_loss_disc: 2.830758253733317 (+0.1299211184183755) | > avg_loss_disc_real_0: 0.2888081818819046 (-0.1762870152791341) | > avg_loss_disc_real_1: 0.32038624087969464 (+0.05632705489794415) | > avg_loss_disc_real_2: 0.24691460529963175 (+0.031855831543604524) | > avg_loss_disc_real_3: 0.30571125944455463 (+0.051121254762013735) | > avg_loss_disc_real_4: 0.2578017810980479 (+0.03448174397150677) | > avg_loss_disc_real_5: 0.237057164311409 (+0.03556300699710846) | > avg_loss_0: 2.830758253733317 (+0.1299211184183755) | > avg_loss_gen: 2.050175150235494 (-0.17641572157541896) | > avg_loss_kl: 4.340966860453288 (-0.37366676330566406) | > avg_loss_feat: 2.2457301691174507 (-1.8923646435141563) | > avg_loss_mel: 13.44888162612915 (-2.1100588639577236) | > avg_loss_duration: 3.147251923878988 (-0.03420583407084132) | > avg_loss_1: 25.23300615946452 (-4.586712837219238)  > EPOCH: 1071/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:21:47)   --> TIME: 2023-10-20 13:21:58 -- STEP: 9/50 -- GLOBAL_STEP: 106560 | > loss_disc: 2.429797410964966 (2.3921731180614896) | > loss_disc_real_0: 0.09609049558639526 (0.174157558215989) | > loss_disc_real_1: 0.27726876735687256 (0.25149015171660316) | > loss_disc_real_2: 0.22193481028079987 (0.23057970156272253) | > loss_disc_real_3: 0.27449050545692444 (0.23530995493961704) | > loss_disc_real_4: 0.18987677991390228 (0.2537548148797618) | > loss_disc_real_5: 0.13950639963150024 (0.2536561174525155) | > loss_0: 2.429797410964966 (2.3921731180614896) | > grad_norm_0: tensor(636.2910, device='cuda:0') (tensor(546.4523, device='cuda:0')) | > loss_gen: 1.84587562084198 (2.4994881550470986) | > loss_kl: 0.5038212537765503 (0.8604684538311429) | > loss_feat: 1.944400429725647 (5.786896109580994) | > loss_mel: 17.672649383544922 (20.721727159288193) | > loss_duration: 1.299934983253479 (1.363748828570048) | > loss_1: 23.266679763793945 (31.23232862684462) | > grad_norm_1: tensor(9813.1602, device='cuda:0') (tensor(16625.0293, device='cuda:0')) | > current_lr_0: 6.852854840409443e-05 | > current_lr_1: 6.852854840409443e-05 | > step_time: 0.7011 (0.6456375122070312) | > loader_time: 0.0359 (0.0272672176361084)  --> TIME: 2023-10-20 13:22:14 -- STEP: 39/50 -- GLOBAL_STEP: 106590 | > loss_disc: 1.1662583351135254 (2.523144781589509) | > loss_disc_real_0: 0.01096318755298853 (0.17793535085347217) | > loss_disc_real_1: 0.03588487580418587 (0.23480799770317015) | > loss_disc_real_2: 0.022375496104359627 (0.23811162248826945) | > loss_disc_real_3: 0.05014748498797417 (0.2446938604594041) | > loss_disc_real_4: 0.013216929510235786 (0.23133168164163065) | > loss_disc_real_5: 0.004734291695058346 (0.23527221054507372) | > loss_0: 1.1662583351135254 (2.523144781589509) | > grad_norm_0: tensor(405.7880, device='cuda:0') (tensor(632.3917, device='cuda:0')) | > loss_gen: 2.8296685218811035 (2.333245711448865) | > loss_kl: 0.4593856632709503 (0.8018360235370121) | > loss_feat: 12.614404678344727 (5.55047087963575) | > loss_mel: 24.77638816833496 (20.77246421117049) | > loss_duration: 1.429851770401001 (1.3431673355591602) | > loss_1: 42.10969924926758 (30.801183908413616) | > grad_norm_1: tensor(44032.7031, device='cuda:0') (tensor(18761.9980, device='cuda:0')) | > current_lr_0: 6.852854840409443e-05 | > current_lr_1: 6.852854840409443e-05 | > step_time: 0.3409 (0.5381591870234564) | > loader_time: 0.0039 (0.01884007453918457)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.075803279876709 (3.075803279876709) | > loss_disc_real_0: 0.43410274386405945 (0.43410274386405945) | > loss_disc_real_1: 0.410400927066803 (0.410400927066803) | > loss_disc_real_2: 0.25408628582954407 (0.25408628582954407) | > loss_disc_real_3: 0.1458071917295456 (0.1458071917295456) | > loss_disc_real_4: 0.5051966309547424 (0.5051966309547424) | > loss_disc_real_5: 0.6353143453598022 (0.6353143453598022) | > loss_0: 3.075803279876709 (3.075803279876709) | > loss_gen: 3.206749200820923 (3.206749200820923) | > loss_kl: 6.085665702819824 (6.085665702819824) | > loss_feat: 7.3153204917907715 (7.3153204917907715) | > loss_mel: 21.752599716186523 (21.752599716186523) | > loss_duration: 3.006424903869629 (3.006424903869629) | > loss_1: 41.36676025390625 (41.36676025390625)  --> STEP: 1 | > loss_disc: 2.9420411586761475 (2.9420411586761475) | > loss_disc_real_0: 0.17357009649276733 (0.17357009649276733) | > loss_disc_real_1: 0.3968409597873688 (0.3968409597873688) | > loss_disc_real_2: 0.3212697505950928 (0.3212697505950928) | > loss_disc_real_3: 0.2901093065738678 (0.2901093065738678) | > loss_disc_real_4: 0.42826780676841736 (0.42826780676841736) | > loss_disc_real_5: 0.474851131439209 (0.474851131439209) | > loss_0: 2.9420411586761475 (2.9420411586761475) | > loss_gen: 2.5730795860290527 (2.5730795860290527) | > loss_kl: 5.6178107261657715 (5.6178107261657715) | > loss_feat: 5.851803779602051 (5.851803779602051) | > loss_mel: 23.11943817138672 (23.11943817138672) | > loss_duration: 3.2922282218933105 (3.2922282218933105) | > loss_1: 40.4543571472168 (40.4543571472168)  --> STEP: 2 | > loss_disc: 2.394016742706299 (2.668028950691223) | > loss_disc_real_0: 0.028222735971212387 (0.10089641623198986) | > loss_disc_real_1: 0.2923942804336548 (0.3446176201105118) | > loss_disc_real_2: 0.23987823724746704 (0.2805739939212799) | > loss_disc_real_3: 0.34901079535484314 (0.31956005096435547) | > loss_disc_real_4: 0.21856600046157837 (0.32341690361499786) | > loss_disc_real_5: 0.2890407145023346 (0.3819459229707718) | > loss_0: 2.394016742706299 (2.668028950691223) | > loss_gen: 2.437162160873413 (2.505120873451233) | > loss_kl: 5.636462211608887 (5.627136468887329) | > loss_feat: 4.53663969039917 (5.19422173500061) | > loss_mel: 23.888072967529297 (23.503755569458008) | > loss_duration: 3.124467372894287 (3.208347797393799) | > loss_1: 39.622798919677734 (40.038578033447266)  --> STEP: 3 | > loss_disc: 2.88350772857666 (2.7398552099863687) | > loss_disc_real_0: 0.1880606710910797 (0.12995116785168648) | > loss_disc_real_1: 0.2696540951728821 (0.3196297784646352) | > loss_disc_real_2: 0.2985621690750122 (0.28657005230585736) | > loss_disc_real_3: 0.25781455636024475 (0.2989782194296519) | > loss_disc_real_4: 0.27471813559532166 (0.30718398094177246) | > loss_disc_real_5: 0.31428951025009155 (0.35939378539721173) | > loss_0: 2.88350772857666 (2.7398552099863687) | > loss_gen: 1.7907758951187134 (2.2670058806737265) | > loss_kl: 3.1460814476013184 (4.800118128458659) | > loss_feat: 1.5641230344772339 (3.9841888348261514) | > loss_mel: 16.32672119140625 (21.11141077677409) | > loss_duration: 2.970123052597046 (3.1289395491282144) | > loss_1: 25.79782485961914 (35.29166030883789) --> EVAL PERFORMANCE | > avg_loader_time: 0.02390265464782715 (+0.005534648895263672) | > avg_loss_disc: 2.7398552099863687 (-0.09090304374694824) | > avg_loss_disc_real_0: 0.12995116785168648 (-0.15885701403021812) | > avg_loss_disc_real_1: 0.3196297784646352 (-0.0007564624150594446) | > avg_loss_disc_real_2: 0.28657005230585736 (+0.039655447006225614) | > avg_loss_disc_real_3: 0.2989782194296519 (-0.006733040014902714) | > avg_loss_disc_real_4: 0.30718398094177246 (+0.04938219984372455) | > avg_loss_disc_real_5: 0.35939378539721173 (+0.12233662108580273) | > avg_loss_0: 2.7398552099863687 (-0.09090304374694824) | > avg_loss_gen: 2.2670058806737265 (+0.21683073043823242) | > avg_loss_kl: 4.800118128458659 (+0.4591512680053711) | > avg_loss_feat: 3.9841888348261514 (+1.7384586657087007) | > avg_loss_mel: 21.11141077677409 (+7.662529150644939) | > avg_loss_duration: 3.1289395491282144 (-0.018312374750773408) | > avg_loss_1: 35.29166030883789 (+10.058654149373371)  > EPOCH: 1072/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:22:37)   --> TIME: 2023-10-20 13:22:54 -- STEP: 19/50 -- GLOBAL_STEP: 106620 | > loss_disc: 2.0181972980499268 (2.6389443497908744) | > loss_disc_real_0: 0.17390510439872742 (0.18374324619377913) | > loss_disc_real_1: 0.1490321308374405 (0.24082983677324496) | > loss_disc_real_2: 0.23027893900871277 (0.23730993114019694) | > loss_disc_real_3: 0.20022264122962952 (0.24099892613134885) | > loss_disc_real_4: 0.24367927014827728 (0.2352753399234069) | > loss_disc_real_5: 0.21085654199123383 (0.26802189412869903) | > loss_0: 2.0181972980499268 (2.6389443497908744) | > grad_norm_0: tensor(523.1041, device='cuda:0') (tensor(583.1748, device='cuda:0')) | > loss_gen: 2.776458978652954 (2.1234444693515173) | > loss_kl: 0.6482842564582825 (0.8217659365189703) | > loss_feat: 6.292892932891846 (4.003151084639524) | > loss_mel: 21.702964782714844 (17.36502674378847) | > loss_duration: 1.4204977750778198 (1.382236832066586) | > loss_1: 32.84109878540039 (25.695625004015472) | > grad_norm_1: tensor(11175.7695, device='cuda:0') (tensor(24837.4219, device='cuda:0')) | > current_lr_0: 6.846004982943609e-05 | > current_lr_1: 6.846004982943609e-05 | > step_time: 0.8162 (0.5097507677580181) | > loader_time: 0.0396 (0.015515867032502828)  --> TIME: 2023-10-20 13:23:11 -- STEP: 49/50 -- GLOBAL_STEP: 106650 | > loss_disc: 2.7838587760925293 (2.5458687276256335) | > loss_disc_real_0: 0.024237412959337234 (0.14723684072342455) | > loss_disc_real_1: 0.20939378440380096 (0.22347617419246507) | > loss_disc_real_2: 0.14349456131458282 (0.2248315515034661) | > loss_disc_real_3: 0.2381526082754135 (0.2311467193827337) | > loss_disc_real_4: 0.26967310905456543 (0.22623483836650848) | > loss_disc_real_5: 0.2931479513645172 (0.24521493710273382) | > loss_0: 2.7838587760925293 (2.5458687276256335) | > grad_norm_0: tensor(1725.2341, device='cuda:0') (tensor(699.0123, device='cuda:0')) | > loss_gen: 1.58687162399292 (2.1348350121050466) | > loss_kl: 0.7563819885253906 (0.8331120272680205) | > loss_feat: 1.6355563402175903 (4.738333441925291) | > loss_mel: 22.48590850830078 (18.703676089948537) | > loss_duration: 1.4424304962158203 (1.3417650692316951) | > loss_1: 27.907148361206055 (27.751721605962636) | > grad_norm_1: tensor(2930.0933, device='cuda:0') (tensor(20906.2422, device='cuda:0')) | > current_lr_0: 6.846004982943609e-05 | > current_lr_1: 6.846004982943609e-05 | > step_time: 0.3097 (0.5209359246857312) | > loader_time: 0.4216 (0.024905535639548792)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.97921085357666 (2.97921085357666) | > loss_disc_real_0: 0.28066134452819824 (0.28066134452819824) | > loss_disc_real_1: 0.2922401428222656 (0.2922401428222656) | > loss_disc_real_2: 0.27180781960487366 (0.27180781960487366) | > loss_disc_real_3: 0.2771857976913452 (0.2771857976913452) | > loss_disc_real_4: 0.2818159759044647 (0.2818159759044647) | > loss_disc_real_5: 0.33041152358055115 (0.33041152358055115) | > loss_0: 2.97921085357666 (2.97921085357666) | > loss_gen: 2.172224760055542 (2.172224760055542) | > loss_kl: 5.31843900680542 (5.31843900680542) | > loss_feat: 6.187610149383545 (6.187610149383545) | > loss_mel: 21.898515701293945 (21.898515701293945) | > loss_duration: 3.057241439819336 (3.057241439819336) | > loss_1: 38.634033203125 (38.634033203125)  --> STEP: 1 | > loss_disc: 2.6079800128936768 (2.6079800128936768) | > loss_disc_real_0: 0.3364552855491638 (0.3364552855491638) | > loss_disc_real_1: 0.2734014689922333 (0.2734014689922333) | > loss_disc_real_2: 0.2864985466003418 (0.2864985466003418) | > loss_disc_real_3: 0.32437974214553833 (0.32437974214553833) | > loss_disc_real_4: 0.21291913092136383 (0.21291913092136383) | > loss_disc_real_5: 0.31411707401275635 (0.31411707401275635) | > loss_0: 2.6079800128936768 (2.6079800128936768) | > loss_gen: 2.89250111579895 (2.89250111579895) | > loss_kl: 5.6934027671813965 (5.6934027671813965) | > loss_feat: 6.125577449798584 (6.125577449798584) | > loss_mel: 23.268156051635742 (23.268156051635742) | > loss_duration: 3.415731906890869 (3.415731906890869) | > loss_1: 41.39537048339844 (41.39537048339844)  --> STEP: 2 | > loss_disc: 1.753949761390686 (2.1809648871421814) | > loss_disc_real_0: 0.11542213708162308 (0.22593871131539345) | > loss_disc_real_1: 0.17201773822307587 (0.22270960360765457) | > loss_disc_real_2: 0.10929261147975922 (0.1978955790400505) | > loss_disc_real_3: 0.13784854114055634 (0.23111414164304733) | > loss_disc_real_4: 0.12154333293437958 (0.1672312319278717) | > loss_disc_real_5: 0.11914828419685364 (0.216632679104805) | > loss_0: 1.753949761390686 (2.1809648871421814) | > loss_gen: 2.5548648834228516 (2.723682999610901) | > loss_kl: 5.681509971618652 (5.687456369400024) | > loss_feat: 10.165453910827637 (8.14551568031311) | > loss_mel: 20.617712020874023 (21.942934036254883) | > loss_duration: 3.1591732501983643 (3.2874525785446167) | > loss_1: 42.1787109375 (41.78704071044922)  --> STEP: 3 | > loss_disc: 2.859402656555176 (2.407110810279846) | > loss_disc_real_0: 0.24652133882045746 (0.2327995871504148) | > loss_disc_real_1: 0.2625342905521393 (0.23598449925581613) | > loss_disc_real_2: 0.24100761115550995 (0.21226625641187033) | > loss_disc_real_3: 0.3185448944568634 (0.26025772591431934) | > loss_disc_real_4: 0.4054213762283325 (0.24662794669469199) | > loss_disc_real_5: 0.5324925780296326 (0.3219193120797475) | > loss_0: 2.859402656555176 (2.407110810279846) | > loss_gen: 2.5652318000793457 (2.6708659331003823) | > loss_kl: 2.8452792167663574 (4.740063985188802) | > loss_feat: 4.080223560333252 (6.790418306986491) | > loss_mel: 19.682958602905273 (21.189608891805012) | > loss_duration: 2.952538013458252 (3.175814390182495) | > loss_1: 32.1262321472168 (38.56677118937174) --> EVAL PERFORMANCE | > avg_loader_time: 0.008028984069824219 (-0.01587367057800293) | > avg_loss_disc: 2.407110810279846 (-0.3327443997065225) | > avg_loss_disc_real_0: 0.2327995871504148 (+0.10284841929872832) | > avg_loss_disc_real_1: 0.23598449925581613 (-0.08364527920881906) | > avg_loss_disc_real_2: 0.21226625641187033 (-0.07430379589398703) | > avg_loss_disc_real_3: 0.26025772591431934 (-0.03872049351533258) | > avg_loss_disc_real_4: 0.24662794669469199 (-0.060556034247080476) | > avg_loss_disc_real_5: 0.3219193120797475 (-0.03747447331746423) | > avg_loss_0: 2.407110810279846 (-0.3327443997065225) | > avg_loss_gen: 2.6708659331003823 (+0.4038600524266558) | > avg_loss_kl: 4.740063985188802 (-0.06005414326985736) | > avg_loss_feat: 6.790418306986491 (+2.80622947216034) | > avg_loss_mel: 21.189608891805012 (+0.07819811503092211) | > avg_loss_duration: 3.175814390182495 (+0.04687484105428075) | > avg_loss_1: 38.56677118937174 (+3.275110880533852)  > EPOCH: 1073/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:23:33)   --> TIME: 2023-10-20 13:23:53 -- STEP: 29/50 -- GLOBAL_STEP: 106680 | > loss_disc: 2.433004379272461 (2.475940063081939) | > loss_disc_real_0: 0.17315973341464996 (0.14732019738133606) | > loss_disc_real_1: 0.16853751242160797 (0.22289081303210095) | > loss_disc_real_2: 0.251042902469635 (0.2334573212368735) | > loss_disc_real_3: 0.2591874301433563 (0.23936066570980796) | > loss_disc_real_4: 0.22861935198307037 (0.2320381237258171) | > loss_disc_real_5: 0.24783679842948914 (0.23230301418566499) | > loss_0: 2.433004379272461 (2.475940063081939) | > grad_norm_0: tensor(427.7466, device='cuda:0') (tensor(513.0270, device='cuda:0')) | > loss_gen: 2.4840688705444336 (2.2479980156339447) | > loss_kl: 0.7044897675514221 (0.8870418585579971) | > loss_feat: 5.10803747177124 (5.603302282249106) | > loss_mel: 22.065013885498047 (19.897817504817045) | > loss_duration: 1.2663905620574951 (1.3573290602914219) | > loss_1: 31.628000259399414 (29.99348887081804) | > grad_norm_1: tensor(2596.7251, device='cuda:0') (tensor(18467.0703, device='cuda:0')) | > current_lr_0: 6.839161972339177e-05 | > current_lr_1: 6.839161972339177e-05 | > step_time: 0.3036 (0.4525196470063308) | > loader_time: 0.003 (0.015194670907382309)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0837936401367188 (2.0837936401367188) | > loss_disc_real_0: 0.1475355178117752 (0.1475355178117752) | > loss_disc_real_1: 0.29973211884498596 (0.29973211884498596) | > loss_disc_real_2: 0.23107369244098663 (0.23107369244098663) | > loss_disc_real_3: 0.2695988714694977 (0.2695988714694977) | > loss_disc_real_4: 0.23755373060703278 (0.23755373060703278) | > loss_disc_real_5: 0.20300279557704926 (0.20300279557704926) | > loss_0: 2.0837936401367188 (2.0837936401367188) | > loss_gen: 3.037874460220337 (3.037874460220337) | > loss_kl: 5.212648868560791 (5.212648868560791) | > loss_feat: 10.678983688354492 (10.678983688354492) | > loss_mel: 22.340194702148438 (22.340194702148438) | > loss_duration: 2.8774218559265137 (2.8774218559265137) | > loss_1: 44.147125244140625 (44.147125244140625)  --> STEP: 1 | > loss_disc: 1.9893101453781128 (1.9893101453781128) | > loss_disc_real_0: 0.13241712749004364 (0.13241712749004364) | > loss_disc_real_1: 0.14500218629837036 (0.14500218629837036) | > loss_disc_real_2: 0.16720373928546906 (0.16720373928546906) | > loss_disc_real_3: 0.16773569583892822 (0.16773569583892822) | > loss_disc_real_4: 0.13056860864162445 (0.13056860864162445) | > loss_disc_real_5: 0.11982585489749908 (0.11982585489749908) | > loss_0: 1.9893101453781128 (1.9893101453781128) | > loss_gen: 2.1483800411224365 (2.1483800411224365) | > loss_kl: 4.90690279006958 (4.90690279006958) | > loss_feat: 6.41392183303833 (6.41392183303833) | > loss_mel: 25.072343826293945 (25.072343826293945) | > loss_duration: 3.189847230911255 (3.189847230911255) | > loss_1: 41.73139572143555 (41.73139572143555)  --> STEP: 2 | > loss_disc: 1.8465012311935425 (1.9179056882858276) | > loss_disc_real_0: 0.2177920639514923 (0.17510459572076797) | > loss_disc_real_1: 0.16981959342956543 (0.1574108898639679) | > loss_disc_real_2: 0.09499575197696686 (0.13109974563121796) | > loss_disc_real_3: 0.21062709391117096 (0.1891813948750496) | > loss_disc_real_4: 0.11768986284732819 (0.12412923574447632) | > loss_disc_real_5: 0.1746315062046051 (0.1472286805510521) | > loss_0: 1.8465012311935425 (1.9179056882858276) | > loss_gen: 2.7070720195770264 (2.4277260303497314) | > loss_kl: 5.700509548187256 (5.303706169128418) | > loss_feat: 8.74245548248291 (7.57818865776062) | > loss_mel: 22.99439239501953 (24.03336811065674) | > loss_duration: 3.128175973892212 (3.1590116024017334) | > loss_1: 43.272605895996094 (42.50200080871582)  --> STEP: 3 | > loss_disc: 2.9132239818573 (2.249678452809652) | > loss_disc_real_0: 0.13751503825187683 (0.1625747432311376) | > loss_disc_real_1: 0.34130942821502686 (0.2187104026476542) | > loss_disc_real_2: 0.24845772981643677 (0.17021907369295755) | > loss_disc_real_3: 0.36074987053871155 (0.24637088676293692) | > loss_disc_real_4: 0.2539266347885132 (0.16739503542582193) | > loss_disc_real_5: 0.34635403752326965 (0.2136037995417913) | > loss_0: 2.9132239818573 (2.249678452809652) | > loss_gen: 2.048222064971924 (2.301224708557129) | > loss_kl: 2.722775459289551 (4.443395932515462) | > loss_feat: 3.6533966064453125 (6.269924640655518) | > loss_mel: 19.037561416625977 (22.368099212646484) | > loss_duration: 2.8944597244262695 (3.0708276430765786) | > loss_1: 30.356414794921875 (38.45347213745117) --> EVAL PERFORMANCE | > avg_loader_time: 0.00743556022644043 (-0.0005934238433837891) | > avg_loss_disc: 2.249678452809652 (-0.15743235747019435) | > avg_loss_disc_real_0: 0.1625747432311376 (-0.07022484391927719) | > avg_loss_disc_real_1: 0.2187104026476542 (-0.017274096608161926) | > avg_loss_disc_real_2: 0.17021907369295755 (-0.04204718271891278) | > avg_loss_disc_real_3: 0.24637088676293692 (-0.013886839151382419) | > avg_loss_disc_real_4: 0.16739503542582193 (-0.07923291126887005) | > avg_loss_disc_real_5: 0.2136037995417913 (-0.10831551253795621) | > avg_loss_0: 2.249678452809652 (-0.15743235747019435) | > avg_loss_gen: 2.301224708557129 (-0.36964122454325343) | > avg_loss_kl: 4.443395932515462 (-0.29666805267333984) | > avg_loss_feat: 6.269924640655518 (-0.5204936663309736) | > avg_loss_mel: 22.368099212646484 (+1.1784903208414725) | > avg_loss_duration: 3.0708276430765786 (-0.10498674710591649) | > avg_loss_1: 38.45347213745117 (-0.11329905192057055)  > EPOCH: 1074/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:24:26)   --> TIME: 2023-10-20 13:24:37 -- STEP: 9/50 -- GLOBAL_STEP: 106710 | > loss_disc: 2.9415979385375977 (2.3527662091785007) | > loss_disc_real_0: 0.22722429037094116 (0.18881972382465997) | > loss_disc_real_1: 0.27876296639442444 (0.22817899617883894) | > loss_disc_real_2: 0.2528616189956665 (0.19106010844310126) | > loss_disc_real_3: 0.2969699800014496 (0.22688311338424683) | > loss_disc_real_4: 0.2656758427619934 (0.23845432615942425) | > loss_disc_real_5: 0.25913166999816895 (0.20195337384939194) | > loss_0: 2.9415979385375977 (2.3527662091785007) | > grad_norm_0: tensor(565.5037, device='cuda:0') (tensor(688.2461, device='cuda:0')) | > loss_gen: 1.6397264003753662 (2.4625750250286527) | > loss_kl: 1.0790038108825684 (0.7723767128255632) | > loss_feat: 0.1940784454345703 (5.314915474918154) | > loss_mel: 8.558552742004395 (17.633048587375217) | > loss_duration: 1.3058639764785767 (1.3576471275753446) | > loss_1: 12.777225494384766 (27.540563159518772) | > grad_norm_1: tensor(16941.4863, device='cuda:0') (tensor(26925.8359, device='cuda:0')) | > current_lr_0: 6.832325801752284e-05 | > current_lr_1: 6.832325801752284e-05 | > step_time: 0.4223 (0.6162386735280355) | > loader_time: 0.0409 (0.02347720993889703)  --> TIME: 2023-10-20 13:24:57 -- STEP: 39/50 -- GLOBAL_STEP: 106740 | > loss_disc: 2.294696092605591 (2.4548230782533302) | > loss_disc_real_0: 0.05677487701177597 (0.15500644666071123) | > loss_disc_real_1: 0.12163979560136795 (0.2340270838676355) | > loss_disc_real_2: 0.06395142525434494 (0.22171952785589757) | > loss_disc_real_3: 0.09316330403089523 (0.23566608283764276) | > loss_disc_real_4: 0.06685448437929153 (0.213950333209374) | > loss_disc_real_5: 0.018993763253092766 (0.19927368518442679) | > loss_0: 2.294696092605591 (2.4548230782533302) | > grad_norm_0: tensor(500.7167, device='cuda:0') (tensor(619.7518, device='cuda:0')) | > loss_gen: 1.8176839351654053 (2.2368182035592885) | > loss_kl: 0.531532883644104 (0.7821003399216212) | > loss_feat: 7.8464155197143555 (5.2594505340243) | > loss_mel: 25.057432174682617 (19.22236803861765) | > loss_duration: 1.3968881368637085 (1.3464159002670875) | > loss_1: 36.64995193481445 (28.84715310121194) | > grad_norm_1: tensor(6734.7661, device='cuda:0') (tensor(22673.0586, device='cuda:0')) | > current_lr_0: 6.832325801752284e-05 | > current_lr_1: 6.832325801752284e-05 | > step_time: 0.8343 (0.6277825648968036) | > loader_time: 0.0241 (0.02502726897215232)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7644174098968506 (2.7644174098968506) | > loss_disc_real_0: 0.3519359827041626 (0.3519359827041626) | > loss_disc_real_1: 0.23450013995170593 (0.23450013995170593) | > loss_disc_real_2: 0.3640463054180145 (0.3640463054180145) | > loss_disc_real_3: 0.3557763993740082 (0.3557763993740082) | > loss_disc_real_4: 0.17740090191364288 (0.17740090191364288) | > loss_disc_real_5: 0.21656149625778198 (0.21656149625778198) | > loss_0: 2.7644174098968506 (2.7644174098968506) | > loss_gen: 2.343179702758789 (2.343179702758789) | > loss_kl: 6.748132228851318 (6.748132228851318) | > loss_feat: 4.737651824951172 (4.737651824951172) | > loss_mel: 21.048782348632812 (21.048782348632812) | > loss_duration: 3.1272037029266357 (3.1272037029266357) | > loss_1: 38.00495147705078 (38.00495147705078)  --> STEP: 1 | > loss_disc: 2.169886827468872 (2.169886827468872) | > loss_disc_real_0: 0.1775854080915451 (0.1775854080915451) | > loss_disc_real_1: 0.21938453614711761 (0.21938453614711761) | > loss_disc_real_2: 0.19901886582374573 (0.19901886582374573) | > loss_disc_real_3: 0.15088339149951935 (0.15088339149951935) | > loss_disc_real_4: 0.24002355337142944 (0.24002355337142944) | > loss_disc_real_5: 0.17213676869869232 (0.17213676869869232) | > loss_0: 2.169886827468872 (2.169886827468872) | > loss_gen: 2.274474620819092 (2.274474620819092) | > loss_kl: 5.3830366134643555 (5.3830366134643555) | > loss_feat: 7.085746765136719 (7.085746765136719) | > loss_mel: 21.919584274291992 (21.919584274291992) | > loss_duration: 3.338728666305542 (3.338728666305542) | > loss_1: 40.00157165527344 (40.00157165527344)  --> STEP: 2 | > loss_disc: 2.5835745334625244 (2.3767306804656982) | > loss_disc_real_0: 0.18713141977787018 (0.18235841393470764) | > loss_disc_real_1: 0.2529076635837555 (0.23614609986543655) | > loss_disc_real_2: 0.24130463600158691 (0.22016175091266632) | > loss_disc_real_3: 0.2742302119731903 (0.21255680173635483) | > loss_disc_real_4: 0.26422321796417236 (0.2521233856678009) | > loss_disc_real_5: 0.2557975947856903 (0.21396718174219131) | > loss_0: 2.5835745334625244 (2.3767306804656982) | > loss_gen: 2.4417457580566406 (2.358110189437866) | > loss_kl: 5.946780204772949 (5.664908409118652) | > loss_feat: 4.0308990478515625 (5.558322906494141) | > loss_mel: 24.58915901184082 (23.254371643066406) | > loss_duration: 3.252399206161499 (3.2955639362335205) | > loss_1: 40.260982513427734 (40.131277084350586)  --> STEP: 3 | > loss_disc: 2.9820356369018555 (2.5784989992777505) | > loss_disc_real_0: 0.3812018036842346 (0.24863954385121664) | > loss_disc_real_1: 0.31516364216804504 (0.2624852806329727) | > loss_disc_real_2: 0.34293025732040405 (0.26108458638191223) | > loss_disc_real_3: 0.24771784245967865 (0.22427714864412943) | > loss_disc_real_4: 0.2823363244533539 (0.26219436526298523) | > loss_disc_real_5: 0.2933371663093567 (0.24042384326457977) | > loss_0: 2.9820356369018555 (2.5784989992777505) | > loss_gen: 2.0892765522003174 (2.26849897702535) | > loss_kl: 2.874784469604492 (4.734867095947266) | > loss_feat: 1.5324119329452515 (4.216352581977844) | > loss_mel: 19.239696502685547 (21.916146596272785) | > loss_duration: 2.9400815963745117 (3.177069822947184) | > loss_1: 28.676250457763672 (36.31293487548828) --> EVAL PERFORMANCE | > avg_loader_time: 0.011155287424723307 (+0.003719727198282877) | > avg_loss_disc: 2.5784989992777505 (+0.32882054646809866) | > avg_loss_disc_real_0: 0.24863954385121664 (+0.08606480062007904) | > avg_loss_disc_real_1: 0.2624852806329727 (+0.04377487798531851) | > avg_loss_disc_real_2: 0.26108458638191223 (+0.09086551268895468) | > avg_loss_disc_real_3: 0.22427714864412943 (-0.022093738118807493) | > avg_loss_disc_real_4: 0.26219436526298523 (+0.0947993298371633) | > avg_loss_disc_real_5: 0.24042384326457977 (+0.026820043722788484) | > avg_loss_0: 2.5784989992777505 (+0.32882054646809866) | > avg_loss_gen: 2.26849897702535 (-0.03272573153177882) | > avg_loss_kl: 4.734867095947266 (+0.2914711634318037) | > avg_loss_feat: 4.216352581977844 (-2.0535720586776733) | > avg_loss_mel: 21.916146596272785 (-0.4519526163736991) | > avg_loss_duration: 3.177069822947184 (+0.10624217987060547) | > avg_loss_1: 36.31293487548828 (-2.1405372619628906)  > EPOCH: 1075/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:25:21)   --> TIME: 2023-10-20 13:25:43 -- STEP: 19/50 -- GLOBAL_STEP: 106770 | > loss_disc: 1.7200864553451538 (2.315662660096821) | > loss_disc_real_0: 0.07048328220844269 (0.1689335860704121) | > loss_disc_real_1: 0.07817263901233673 (0.20341351549876363) | > loss_disc_real_2: 0.10257434844970703 (0.22174449441464325) | > loss_disc_real_3: 0.12391543388366699 (0.21544669029351912) | > loss_disc_real_4: 0.047698721289634705 (0.1984598422913175) | > loss_disc_real_5: 0.01689620316028595 (0.21381400358912192) | > loss_0: 1.7200864553451538 (2.315662660096821) | > grad_norm_0: tensor(947.5367, device='cuda:0') (tensor(1019.0617, device='cuda:0')) | > loss_gen: 2.4388327598571777 (2.4370125469408537) | > loss_kl: 1.0477583408355713 (0.9513802120560094) | > loss_feat: 12.198332786560059 (6.660252891088787) | > loss_mel: 29.62485694885254 (21.146324308295) | > loss_duration: 1.4547303915023804 (1.395849114970157) | > loss_1: 46.76451110839844 (32.59081855573152) | > grad_norm_1: tensor(116039.3125, device='cuda:0') (tensor(55513.3086, device='cuda:0')) | > current_lr_0: 6.825496464345897e-05 | > current_lr_1: 6.825496464345897e-05 | > step_time: 0.552 (0.6246120176817241) | > loader_time: 0.041 (0.01842659398129112)  --> TIME: 2023-10-20 13:26:03 -- STEP: 49/50 -- GLOBAL_STEP: 106800 | > loss_disc: 2.2431652545928955 (2.3626587390899663) | > loss_disc_real_0: 0.04025848209857941 (0.15877824829777287) | > loss_disc_real_1: 0.15657760202884674 (0.21120386129739332) | > loss_disc_real_2: 0.24841447174549103 (0.21255923549131472) | > loss_disc_real_3: 0.23289482295513153 (0.22202144232483542) | > loss_disc_real_4: 0.1752673238515854 (0.2063536438330704) | > loss_disc_real_5: 0.15228408575057983 (0.21618827808724375) | > loss_0: 2.2431652545928955 (2.3626587390899663) | > grad_norm_0: tensor(775.8151, device='cuda:0') (tensor(1057.5369, device='cuda:0')) | > loss_gen: 2.250589370727539 (2.3318123768787) | > loss_kl: 0.5567807555198669 (0.8402157386346739) | > loss_feat: 3.9959568977355957 (5.965666219135937) | > loss_mel: 20.90345573425293 (20.460469355388557) | > loss_duration: 1.4776151180267334 (1.3587074790682112) | > loss_1: 29.184398651123047 (30.956870945132504) | > grad_norm_1: tensor(22432.8398, device='cuda:0') (tensor(41704.8594, device='cuda:0')) | > current_lr_0: 6.825496464345897e-05 | > current_lr_1: 6.825496464345897e-05 | > step_time: 0.3493 (0.621641008221373) | > loader_time: 0.5419 (0.03164390641815809)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.890352725982666 (2.890352725982666) | > loss_disc_real_0: 0.4888803958892822 (0.4888803958892822) | > loss_disc_real_1: 0.20085376501083374 (0.20085376501083374) | > loss_disc_real_2: 0.31964078545570374 (0.31964078545570374) | > loss_disc_real_3: 0.5882719159126282 (0.5882719159126282) | > loss_disc_real_4: 0.25447458028793335 (0.25447458028793335) | > loss_disc_real_5: 0.38563868403434753 (0.38563868403434753) | > loss_0: 2.890352725982666 (2.890352725982666) | > loss_gen: 3.080596446990967 (3.080596446990967) | > loss_kl: 5.230869293212891 (5.230869293212891) | > loss_feat: 6.6930012702941895 (6.6930012702941895) | > loss_mel: 22.184001922607422 (22.184001922607422) | > loss_duration: 2.99619197845459 (2.99619197845459) | > loss_1: 40.184661865234375 (40.184661865234375)  --> STEP: 1 | > loss_disc: 2.8731887340545654 (2.8731887340545654) | > loss_disc_real_0: 0.2643347680568695 (0.2643347680568695) | > loss_disc_real_1: 0.28318551182746887 (0.28318551182746887) | > loss_disc_real_2: 0.2545178532600403 (0.2545178532600403) | > loss_disc_real_3: 0.2782829701900482 (0.2782829701900482) | > loss_disc_real_4: 0.2536594569683075 (0.2536594569683075) | > loss_disc_real_5: 0.2683773934841156 (0.2683773934841156) | > loss_0: 2.8731887340545654 (2.8731887340545654) | > loss_gen: 1.7814662456512451 (1.7814662456512451) | > loss_kl: 5.238466262817383 (5.238466262817383) | > loss_feat: 0.4516356587409973 (0.4516356587409973) | > loss_mel: 13.309085845947266 (13.309085845947266) | > loss_duration: 3.333681344985962 (3.333681344985962) | > loss_1: 24.114334106445312 (24.114334106445312)  --> STEP: 2 | > loss_disc: 2.5466718673706055 (2.7099303007125854) | > loss_disc_real_0: 0.10692276060581207 (0.1856287643313408) | > loss_disc_real_1: 0.22148317098617554 (0.2523343414068222) | > loss_disc_real_2: 0.2363768219947815 (0.2454473376274109) | > loss_disc_real_3: 0.27020418643951416 (0.2742435783147812) | > loss_disc_real_4: 0.3263455927371979 (0.2900025248527527) | > loss_disc_real_5: 0.2676328718662262 (0.2680051326751709) | > loss_0: 2.5466718673706055 (2.7099303007125854) | > loss_gen: 2.3404953479766846 (2.060980796813965) | > loss_kl: 5.737704277038574 (5.4880852699279785) | > loss_feat: 8.454095840454102 (4.452865749597549) | > loss_mel: 24.747331619262695 (19.02820873260498) | > loss_duration: 3.1644973754882812 (3.2490893602371216) | > loss_1: 44.44412612915039 (34.27923011779785)  --> STEP: 3 | > loss_disc: 3.012681484222412 (2.810847361882528) | > loss_disc_real_0: 0.2849291265010834 (0.21872888505458832) | > loss_disc_real_1: 0.2844904363155365 (0.263053039709727) | > loss_disc_real_2: 0.2695653736591339 (0.25348668297131854) | > loss_disc_real_3: 0.27888062596321106 (0.2757892608642578) | > loss_disc_real_4: 0.24523773789405823 (0.27508092919985455) | > loss_disc_real_5: 0.28281381726264954 (0.27294136087099713) | > loss_0: 3.012681484222412 (2.810847361882528) | > loss_gen: 1.643662929534912 (1.9218748410542805) | > loss_kl: 2.5690908432006836 (4.515087127685547) | > loss_feat: 0.12408995628356934 (3.009940485159556) | > loss_mel: 2.6965243816375732 (13.584313948949179) | > loss_duration: 2.9521639347076416 (3.1501142183939614) | > loss_1: 9.9855318069458 (26.181330680847168) --> EVAL PERFORMANCE | > avg_loader_time: 0.006078640619913737 (-0.0050766468048095694) | > avg_loss_disc: 2.810847361882528 (+0.23234836260477731) | > avg_loss_disc_real_0: 0.21872888505458832 (-0.029910658796628325) | > avg_loss_disc_real_1: 0.263053039709727 (+0.0005677590767542706) | > avg_loss_disc_real_2: 0.25348668297131854 (-0.007597903410593687) | > avg_loss_disc_real_3: 0.2757892608642578 (+0.051512112220128387) | > avg_loss_disc_real_4: 0.27508092919985455 (+0.012886563936869322) | > avg_loss_disc_real_5: 0.27294136087099713 (+0.03251751760641736) | > avg_loss_0: 2.810847361882528 (+0.23234836260477731) | > avg_loss_gen: 1.9218748410542805 (-0.34662413597106956) | > avg_loss_kl: 4.515087127685547 (-0.21977996826171875) | > avg_loss_feat: 3.009940485159556 (-1.2064120968182883) | > avg_loss_mel: 13.584313948949179 (-8.331832647323607) | > avg_loss_duration: 3.1501142183939614 (-0.026955604553222656) | > avg_loss_1: 26.181330680847168 (-10.131604194641113)  > EPOCH: 1076/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:26:30)   --> TIME: 2023-10-20 13:26:50 -- STEP: 29/50 -- GLOBAL_STEP: 106830 | > loss_disc: 2.74642014503479 (2.431471337532175) | > loss_disc_real_0: 0.16274505853652954 (0.13919252234286278) | > loss_disc_real_1: 0.3126731514930725 (0.21241566217665014) | > loss_disc_real_2: 0.24782387912273407 (0.21464996476625575) | > loss_disc_real_3: 0.26344606280326843 (0.2475789925083518) | > loss_disc_real_4: 0.3092028498649597 (0.2216893771085246) | > loss_disc_real_5: 0.28620243072509766 (0.26054276834274165) | > loss_0: 2.74642014503479 (2.431471337532175) | > grad_norm_0: tensor(1958.4175, device='cuda:0') (tensor(1250.4867, device='cuda:0')) | > loss_gen: 1.9276484251022339 (2.429956999318353) | > loss_kl: 1.2095317840576172 (0.8033093974508089) | > loss_feat: 0.8265305757522583 (6.1391808971248825) | > loss_mel: 16.563589096069336 (21.387158714491747) | > loss_duration: 1.3027527332305908 (1.3619492876118626) | > loss_1: 21.830053329467773 (32.121555722992994) | > grad_norm_1: tensor(16908.2148, device='cuda:0') (tensor(43915.4023, device='cuda:0')) | > current_lr_0: 6.818673953289829e-05 | > current_lr_1: 6.818673953289829e-05 | > step_time: 0.8112 (0.5141849353395659) | > loader_time: 0.0388 (0.01694093079402529)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4183731079101562 (2.4183731079101562) | > loss_disc_real_0: 0.09013070166110992 (0.09013070166110992) | > loss_disc_real_1: 0.17293709516525269 (0.17293709516525269) | > loss_disc_real_2: 0.2598474621772766 (0.2598474621772766) | > loss_disc_real_3: 0.34221214056015015 (0.34221214056015015) | > loss_disc_real_4: 0.14416155219078064 (0.14416155219078064) | > loss_disc_real_5: 0.1646735519170761 (0.1646735519170761) | > loss_0: 2.4183731079101562 (2.4183731079101562) | > loss_gen: 2.1498281955718994 (2.1498281955718994) | > loss_kl: 5.767772674560547 (5.767772674560547) | > loss_feat: 5.965603351593018 (5.965603351593018) | > loss_mel: 15.465437889099121 (15.465437889099121) | > loss_duration: 2.993652820587158 (2.993652820587158) | > loss_1: 32.3422966003418 (32.3422966003418)  --> STEP: 1 | > loss_disc: 2.1950087547302246 (2.1950087547302246) | > loss_disc_real_0: 0.09426966309547424 (0.09426966309547424) | > loss_disc_real_1: 0.2710897624492645 (0.2710897624492645) | > loss_disc_real_2: 0.21495430171489716 (0.21495430171489716) | > loss_disc_real_3: 0.3163602948188782 (0.3163602948188782) | > loss_disc_real_4: 0.26186999678611755 (0.26186999678611755) | > loss_disc_real_5: 0.19035664200782776 (0.19035664200782776) | > loss_0: 2.1950087547302246 (2.1950087547302246) | > loss_gen: 2.5512912273406982 (2.5512912273406982) | > loss_kl: 5.536788463592529 (5.536788463592529) | > loss_feat: 7.165889263153076 (7.165889263153076) | > loss_mel: 25.970420837402344 (25.970420837402344) | > loss_duration: 3.338221311569214 (3.338221311569214) | > loss_1: 44.56261444091797 (44.56261444091797)  --> STEP: 2 | > loss_disc: 2.9861254692077637 (2.590567111968994) | > loss_disc_real_0: 0.11559919267892838 (0.10493442788720131) | > loss_disc_real_1: 0.26032623648643494 (0.26570799946784973) | > loss_disc_real_2: 0.24289166927337646 (0.2289229854941368) | > loss_disc_real_3: 0.2760438621044159 (0.29620207846164703) | > loss_disc_real_4: 0.2887149155139923 (0.27529245615005493) | > loss_disc_real_5: 0.23276397585868835 (0.21156030893325806) | > loss_0: 2.9861254692077637 (2.590567111968994) | > loss_gen: 1.4697816371917725 (2.0105364322662354) | > loss_kl: 6.0017523765563965 (5.769270420074463) | > loss_feat: 0.6287292838096619 (3.897309273481369) | > loss_mel: 12.136566162109375 (19.05349349975586) | > loss_duration: 3.158498525619507 (3.2483599185943604) | > loss_1: 23.395328521728516 (33.97897148132324)  --> STEP: 3 | > loss_disc: 2.826124906539917 (2.6690863768259683) | > loss_disc_real_0: 0.09517710655927658 (0.10168198744455974) | > loss_disc_real_1: 0.3075157403945923 (0.27964391311009723) | > loss_disc_real_2: 0.2508960962295532 (0.2362473557392756) | > loss_disc_real_3: 0.2254127562046051 (0.27260563770929974) | > loss_disc_real_4: 0.3789269030094147 (0.3098372717698415) | > loss_disc_real_5: 0.3474893569946289 (0.25686999162038165) | > loss_0: 2.826124906539917 (2.6690863768259683) | > loss_gen: 2.0977954864501953 (2.0396227836608887) | > loss_kl: 2.8941941261291504 (4.810911655426025) | > loss_feat: 3.926762580871582 (3.90712704261144) | > loss_mel: 23.764179229736328 (20.623722076416016) | > loss_duration: 2.943122625350952 (3.146614154179891) | > loss_1: 35.62605285644531 (34.52799860636393) --> EVAL PERFORMANCE | > avg_loader_time: 0.02953060468037923 (+0.023451964060465492) | > avg_loss_disc: 2.6690863768259683 (-0.14176098505655954) | > avg_loss_disc_real_0: 0.10168198744455974 (-0.11704689761002858) | > avg_loss_disc_real_1: 0.27964391311009723 (+0.016590873400370243) | > avg_loss_disc_real_2: 0.2362473557392756 (-0.01723932723204294) | > avg_loss_disc_real_3: 0.27260563770929974 (-0.0031836231549580707) | > avg_loss_disc_real_4: 0.3098372717698415 (+0.03475634256998694) | > avg_loss_disc_real_5: 0.25686999162038165 (-0.016071369250615475) | > avg_loss_0: 2.6690863768259683 (-0.14176098505655954) | > avg_loss_gen: 2.0396227836608887 (+0.11774794260660815) | > avg_loss_kl: 4.810911655426025 (+0.2958245277404785) | > avg_loss_feat: 3.90712704261144 (+0.8971865574518842) | > avg_loss_mel: 20.623722076416016 (+7.039408127466837) | > avg_loss_duration: 3.146614154179891 (-0.003500064214070342) | > avg_loss_1: 34.52799860636393 (+8.346667925516762)  > EPOCH: 1077/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:27:29)   --> TIME: 2023-10-20 13:27:40 -- STEP: 9/50 -- GLOBAL_STEP: 106860 | > loss_disc: 2.9461147785186768 (2.3857993019951715) | > loss_disc_real_0: 0.2012302577495575 (0.1400133180949423) | > loss_disc_real_1: 0.26361599564552307 (0.1847035036318832) | > loss_disc_real_2: 0.3915276825428009 (0.2176437551776568) | > loss_disc_real_3: 0.4350183308124542 (0.22862202467189896) | > loss_disc_real_4: 0.38883015513420105 (0.226985109763013) | > loss_disc_real_5: 0.37327349185943604 (0.19643213020430672) | > loss_0: 2.9461147785186768 (2.3857993019951715) | > grad_norm_0: tensor(1454.5454, device='cuda:0') (tensor(898.2344, device='cuda:0')) | > loss_gen: 2.6188955307006836 (2.38375006781684) | > loss_kl: 0.6570296287536621 (0.831685205300649) | > loss_feat: 5.04200553894043 (7.405056344138251) | > loss_mel: 21.68539047241211 (22.885016865200466) | > loss_duration: 1.2831989526748657 (1.347223957379659) | > loss_1: 31.286521911621094 (34.852731704711914) | > grad_norm_1: tensor(8031.9399, device='cuda:0') (tensor(28564.9141, device='cuda:0')) | > current_lr_0: 6.811858261760715e-05 | > current_lr_1: 6.811858261760715e-05 | > step_time: 0.4927 (0.616154776679145) | > loader_time: 0.0499 (0.025837368435329862)  --> TIME: 2023-10-20 13:27:56 -- STEP: 39/50 -- GLOBAL_STEP: 106890 | > loss_disc: 2.7815818786621094 (2.4931965821828586) | > loss_disc_real_0: 0.11558195948600769 (0.16442652729053336) | > loss_disc_real_1: 0.2561664581298828 (0.22402069077659875) | > loss_disc_real_2: 0.2307431846857071 (0.22871330237159362) | > loss_disc_real_3: 0.3035900890827179 (0.24366991083400372) | > loss_disc_real_4: 0.31228670477867126 (0.2278292320597057) | > loss_disc_real_5: 0.3091807961463928 (0.2155283007484216) | > loss_0: 2.7815818786621094 (2.4931965821828586) | > grad_norm_0: tensor(2197.0535, device='cuda:0') (tensor(1553.9244, device='cuda:0')) | > loss_gen: 2.0123963356018066 (2.3064905924674792) | > loss_kl: 0.7992490530014038 (0.7921652902777379) | > loss_feat: 2.0032455921173096 (6.03066021662492) | > loss_mel: 20.290203094482422 (21.945636559755375) | > loss_duration: 1.4175468683242798 (1.3375952503620046) | > loss_1: 26.522640228271484 (32.41254753944201) | > grad_norm_1: tensor(7350.0620, device='cuda:0') (tensor(30153.0195, device='cuda:0')) | > current_lr_0: 6.811858261760715e-05 | > current_lr_1: 6.811858261760715e-05 | > step_time: 0.6205 (0.5351789058783115) | > loader_time: 0.0044 (0.016886277076525565)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.028683662414551 (3.028683662414551) | > loss_disc_real_0: 0.08957650512456894 (0.08957650512456894) | > loss_disc_real_1: 0.3189755082130432 (0.3189755082130432) | > loss_disc_real_2: 0.3089217245578766 (0.3089217245578766) | > loss_disc_real_3: 0.27394044399261475 (0.27394044399261475) | > loss_disc_real_4: 0.4130329191684723 (0.4130329191684723) | > loss_disc_real_5: 0.4116973876953125 (0.4116973876953125) | > loss_0: 3.028683662414551 (3.028683662414551) | > loss_gen: 2.034149169921875 (2.034149169921875) | > loss_kl: 5.654065132141113 (5.654065132141113) | > loss_feat: 4.91422700881958 (4.91422700881958) | > loss_mel: 21.95240020751953 (21.95240020751953) | > loss_duration: 3.036670446395874 (3.036670446395874) | > loss_1: 37.59151077270508 (37.59151077270508)  --> STEP: 1 | > loss_disc: 2.5429141521453857 (2.5429141521453857) | > loss_disc_real_0: 0.2285466492176056 (0.2285466492176056) | > loss_disc_real_1: 0.24069929122924805 (0.24069929122924805) | > loss_disc_real_2: 0.2799452245235443 (0.2799452245235443) | > loss_disc_real_3: 0.3655039966106415 (0.3655039966106415) | > loss_disc_real_4: 0.251139760017395 (0.251139760017395) | > loss_disc_real_5: 0.3192388713359833 (0.3192388713359833) | > loss_0: 2.5429141521453857 (2.5429141521453857) | > loss_gen: 2.470538377761841 (2.470538377761841) | > loss_kl: 5.328164577484131 (5.328164577484131) | > loss_feat: 4.84162712097168 (4.84162712097168) | > loss_mel: 23.349227905273438 (23.349227905273438) | > loss_duration: 3.4335291385650635 (3.4335291385650635) | > loss_1: 39.42308807373047 (39.42308807373047)  --> STEP: 2 | > loss_disc: 2.997237205505371 (2.7700756788253784) | > loss_disc_real_0: 0.24521900713443756 (0.23688282817602158) | > loss_disc_real_1: 0.3096233010292053 (0.2751612961292267) | > loss_disc_real_2: 0.28857749700546265 (0.2842613607645035) | > loss_disc_real_3: 0.31715935468673706 (0.34133167564868927) | > loss_disc_real_4: 0.27431315183639526 (0.26272645592689514) | > loss_disc_real_5: 0.359616219997406 (0.33942754566669464) | > loss_0: 2.997237205505371 (2.7700756788253784) | > loss_gen: 1.9341856241226196 (2.2023620009422302) | > loss_kl: 5.848196506500244 (5.5881805419921875) | > loss_feat: 2.131129026412964 (3.4863780736923218) | > loss_mel: 23.775556564331055 (23.562392234802246) | > loss_duration: 3.244396686553955 (3.3389629125595093) | > loss_1: 36.93346405029297 (38.17827606201172)  --> STEP: 3 | > loss_disc: 3.0697739124298096 (2.8699750900268555) | > loss_disc_real_0: 0.22113972902297974 (0.23163512845834097) | > loss_disc_real_1: 0.2733060419559479 (0.2745428780714671) | > loss_disc_real_2: 0.284062922000885 (0.284195214509964) | > loss_disc_real_3: 0.31916359066963196 (0.3339423139890035) | > loss_disc_real_4: 0.26086220145225525 (0.2621050377686818) | > loss_disc_real_5: 0.2710815370082855 (0.3166455427805583) | > loss_0: 3.0697739124298096 (2.8699750900268555) | > loss_gen: 1.6922178268432617 (2.0323139429092407) | > loss_kl: 2.8399131298065186 (4.672091404596965) | > loss_feat: 2.3072571754455566 (3.0933377742767334) | > loss_mel: 17.47990608215332 (21.534896850585938) | > loss_duration: 3.001851797103882 (3.226592540740967) | > loss_1: 27.32114601135254 (34.55923271179199) --> EVAL PERFORMANCE | > avg_loader_time: 0.007774670918782552 (-0.02175593376159668) | > avg_loss_disc: 2.8699750900268555 (+0.2008887132008872) | > avg_loss_disc_real_0: 0.23163512845834097 (+0.12995314101378125) | > avg_loss_disc_real_1: 0.2745428780714671 (-0.005101035038630131) | > avg_loss_disc_real_2: 0.284195214509964 (+0.047947858770688384) | > avg_loss_disc_real_3: 0.3339423139890035 (+0.06133667627970374) | > avg_loss_disc_real_4: 0.2621050377686818 (-0.04773223400115967) | > avg_loss_disc_real_5: 0.3166455427805583 (+0.05977555116017663) | > avg_loss_0: 2.8699750900268555 (+0.2008887132008872) | > avg_loss_gen: 2.0323139429092407 (-0.007308840751647949) | > avg_loss_kl: 4.672091404596965 (-0.13882025082906058) | > avg_loss_feat: 3.0933377742767334 (-0.8137892683347068) | > avg_loss_mel: 21.534896850585938 (+0.9111747741699219) | > avg_loss_duration: 3.226592540740967 (+0.0799783865610757) | > avg_loss_1: 34.55923271179199 (+0.031234105428062264)  > EPOCH: 1078/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:28:19)   --> TIME: 2023-10-20 13:28:35 -- STEP: 19/50 -- GLOBAL_STEP: 106920 | > loss_disc: 0.964317798614502 (2.228561514302304) | > loss_disc_real_0: 0.027649637311697006 (0.13934048118167802) | > loss_disc_real_1: 0.13717253506183624 (0.20503600647574977) | > loss_disc_real_2: 0.11671141535043716 (0.2026386800173082) | > loss_disc_real_3: 0.05877929925918579 (0.22655242916784787) | > loss_disc_real_4: 0.0781681165099144 (0.22064270294810595) | > loss_disc_real_5: 0.04467367008328438 (0.200874248127404) | > loss_0: 0.964317798614502 (2.228561514302304) | > grad_norm_0: tensor(691.3223, device='cuda:0') (tensor(1081.9564, device='cuda:0')) | > loss_gen: 3.5742835998535156 (2.6300316484350907) | > loss_kl: 1.0186529159545898 (0.8612729593327171) | > loss_feat: 14.194168090820312 (7.218176800610595) | > loss_mel: 27.37034797668457 (21.468035239922372) | > loss_duration: 1.4639687538146973 (1.3914769009539956) | > loss_1: 47.621421813964844 (33.568994220934414) | > grad_norm_1: tensor(134470.8438, device='cuda:0') (tensor(62183.4688, device='cuda:0')) | > current_lr_0: 6.80504938294201e-05 | > current_lr_1: 6.80504938294201e-05 | > step_time: 1.3679 (0.5480905457546836) | > loader_time: 0.0019 (0.011380735196565328)  --> TIME: 2023-10-20 13:28:51 -- STEP: 49/50 -- GLOBAL_STEP: 106950 | > loss_disc: 2.858302116394043 (2.3538278316964916) | > loss_disc_real_0: 0.21441930532455444 (0.14249593217153944) | > loss_disc_real_1: 0.2704727351665497 (0.21659229558949566) | > loss_disc_real_2: 0.22825944423675537 (0.20976158968952238) | > loss_disc_real_3: 0.27151671051979065 (0.23111297783194756) | > loss_disc_real_4: 0.30712372064590454 (0.23211734559462996) | > loss_disc_real_5: 0.28293514251708984 (0.22306256388713205) | > loss_0: 2.858302116394043 (2.3538278316964916) | > grad_norm_0: tensor(1035.4655, device='cuda:0') (tensor(1150.6472, device='cuda:0')) | > loss_gen: 1.887589693069458 (2.420884519207235) | > loss_kl: 0.845352053642273 (0.7901711895757791) | > loss_feat: 1.3408105373382568 (6.074463350755372) | > loss_mel: 15.57376766204834 (20.38111879144396) | > loss_duration: 1.419728398323059 (1.3568519086253887) | > loss_1: 21.067249298095703 (31.023490360804956) | > grad_norm_1: tensor(19260.1582, device='cuda:0') (tensor(44952.1484, device='cuda:0')) | > current_lr_0: 6.80504938294201e-05 | > current_lr_1: 6.80504938294201e-05 | > step_time: 0.7206 (0.5141482207239888) | > loader_time: 0.4268 (0.02039811562518684)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.297511339187622 (2.297511339187622) | > loss_disc_real_0: 0.14985798299312592 (0.14985798299312592) | > loss_disc_real_1: 0.2162213921546936 (0.2162213921546936) | > loss_disc_real_2: 0.2516702711582184 (0.2516702711582184) | > loss_disc_real_3: 0.2715871036052704 (0.2715871036052704) | > loss_disc_real_4: 0.16621120274066925 (0.16621120274066925) | > loss_disc_real_5: 0.09890872985124588 (0.09890872985124588) | > loss_0: 2.297511339187622 (2.297511339187622) | > loss_gen: 2.508185863494873 (2.508185863494873) | > loss_kl: 5.907436847686768 (5.907436847686768) | > loss_feat: 7.877845764160156 (7.877845764160156) | > loss_mel: 17.30927085876465 (17.30927085876465) | > loss_duration: 2.9600281715393066 (2.9600281715393066) | > loss_1: 36.562767028808594 (36.562767028808594)  --> STEP: 1 | > loss_disc: 2.4793407917022705 (2.4793407917022705) | > loss_disc_real_0: 0.40894633531570435 (0.40894633531570435) | > loss_disc_real_1: 0.21010339260101318 (0.21010339260101318) | > loss_disc_real_2: 0.17446331679821014 (0.17446331679821014) | > loss_disc_real_3: 0.24583250284194946 (0.24583250284194946) | > loss_disc_real_4: 0.15214449167251587 (0.15214449167251587) | > loss_disc_real_5: 0.11505478620529175 (0.11505478620529175) | > loss_0: 2.4793407917022705 (2.4793407917022705) | > loss_gen: 2.2929553985595703 (2.2929553985595703) | > loss_kl: 5.090278148651123 (5.090278148651123) | > loss_feat: 6.1915507316589355 (6.1915507316589355) | > loss_mel: 23.649324417114258 (23.649324417114258) | > loss_duration: 3.3700883388519287 (3.3700883388519287) | > loss_1: 40.59419250488281 (40.59419250488281)  --> STEP: 2 | > loss_disc: 2.870893955230713 (2.6751173734664917) | > loss_disc_real_0: 0.199036106467247 (0.3039912208914757) | > loss_disc_real_1: 0.23870745301246643 (0.2244054228067398) | > loss_disc_real_2: 0.2751483619213104 (0.22480583935976028) | > loss_disc_real_3: 0.24778485298156738 (0.24680867791175842) | > loss_disc_real_4: 0.2754269540309906 (0.21378572285175323) | > loss_disc_real_5: 0.34525638818740845 (0.2301555871963501) | > loss_0: 2.870893955230713 (2.6751173734664917) | > loss_gen: 1.7989108562469482 (2.0459331274032593) | > loss_kl: 5.466394901275635 (5.278336524963379) | > loss_feat: 2.489264488220215 (4.340407609939575) | > loss_mel: 9.99923324584961 (16.824278831481934) | > loss_duration: 3.2620816230773926 (3.3160849809646606) | > loss_1: 23.015884399414062 (31.805038452148438)  --> STEP: 3 | > loss_disc: 2.985928535461426 (2.7787210941314697) | > loss_disc_real_0: 0.2444995641708374 (0.28416066865126294) | > loss_disc_real_1: 0.2581585943698883 (0.23565647999445596) | > loss_disc_real_2: 0.27405211329460144 (0.24122126400470734) | > loss_disc_real_3: 0.270647794008255 (0.25475504994392395) | > loss_disc_real_4: 0.32683080434799194 (0.2514674166838328) | > loss_disc_real_5: 0.260810524225235 (0.24037389953931174) | > loss_0: 2.985928535461426 (2.7787210941314697) | > loss_gen: 1.6662321090698242 (1.9193661212921143) | > loss_kl: 2.738058090209961 (4.431577046712239) | > loss_feat: 0.1474887579679489 (2.9427679926156998) | > loss_mel: 2.3413469791412354 (11.9966348807017) | > loss_duration: 3.0125696659088135 (3.2149132092793784) | > loss_1: 9.905695915222168 (24.505257606506348) --> EVAL PERFORMANCE | > avg_loader_time: 0.009261449178059896 (+0.0014867782592773446) | > avg_loss_disc: 2.7787210941314697 (-0.09125399589538574) | > avg_loss_disc_real_0: 0.28416066865126294 (+0.052525540192921966) | > avg_loss_disc_real_1: 0.23565647999445596 (-0.038886398077011136) | > avg_loss_disc_real_2: 0.24122126400470734 (-0.04297395050525665) | > avg_loss_disc_real_3: 0.25475504994392395 (-0.07918726404507953) | > avg_loss_disc_real_4: 0.2514674166838328 (-0.010637621084849003) | > avg_loss_disc_real_5: 0.24037389953931174 (-0.07627164324124655) | > avg_loss_0: 2.7787210941314697 (-0.09125399589538574) | > avg_loss_gen: 1.9193661212921143 (-0.11294782161712646) | > avg_loss_kl: 4.431577046712239 (-0.24051435788472553) | > avg_loss_feat: 2.9427679926156998 (-0.15056978166103363) | > avg_loss_mel: 11.9966348807017 (-9.538261969884237) | > avg_loss_duration: 3.2149132092793784 (-0.011679331461588394) | > avg_loss_1: 24.505257606506348 (-10.053975105285645)  > EPOCH: 1079/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:29:08)   --> TIME: 2023-10-20 13:29:30 -- STEP: 29/50 -- GLOBAL_STEP: 106980 | > loss_disc: 2.663574457168579 (2.4317812714083438) | > loss_disc_real_0: 0.1930917650461197 (0.14092300234940544) | > loss_disc_real_1: 0.2235000878572464 (0.21503916100181383) | > loss_disc_real_2: 0.260860800743103 (0.22937371915784374) | > loss_disc_real_3: 0.2643137574195862 (0.23295963632649389) | > loss_disc_real_4: 0.2308209091424942 (0.23364079486707162) | > loss_disc_real_5: 0.2236277014017105 (0.21561587364252272) | > loss_0: 2.663574457168579 (2.4317812714083438) | > grad_norm_0: tensor(1188.8860, device='cuda:0') (tensor(1143.8202, device='cuda:0')) | > loss_gen: 1.9688923358917236 (2.296766774407748) | > loss_kl: 0.7359962463378906 (0.7285027688947218) | > loss_feat: 2.4108338356018066 (6.097987579117561) | > loss_mel: 14.691856384277344 (20.988741266316385) | > loss_duration: 1.3030482530593872 (1.35171888614523) | > loss_1: 21.110628128051758 (31.46371787169884) | > grad_norm_1: tensor(15531.7275, device='cuda:0') (tensor(38452.6641, device='cuda:0')) | > current_lr_0: 6.798247310023985e-05 | > current_lr_1: 6.798247310023985e-05 | > step_time: 0.5579 (0.5831822609079296) | > loader_time: 0.0042 (0.01878987509628822)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.115355968475342 (3.115355968475342) | > loss_disc_real_0: 0.13254542648792267 (0.13254542648792267) | > loss_disc_real_1: 0.42942574620246887 (0.42942574620246887) | > loss_disc_real_2: 0.4814338982105255 (0.4814338982105255) | > loss_disc_real_3: 0.2700122892856598 (0.2700122892856598) | > loss_disc_real_4: 0.3752560615539551 (0.3752560615539551) | > loss_disc_real_5: 0.4832879900932312 (0.4832879900932312) | > loss_0: 3.115355968475342 (3.115355968475342) | > loss_gen: 2.5777361392974854 (2.5777361392974854) | > loss_kl: 6.151206970214844 (6.151206970214844) | > loss_feat: 4.101728439331055 (4.101728439331055) | > loss_mel: 21.74378776550293 (21.74378776550293) | > loss_duration: 2.9459025859832764 (2.9459025859832764) | > loss_1: 37.520362854003906 (37.520362854003906)  --> STEP: 1 | > loss_disc: 2.8808255195617676 (2.8808255195617676) | > loss_disc_real_0: 0.3265075087547302 (0.3265075087547302) | > loss_disc_real_1: 0.3590008020401001 (0.3590008020401001) | > loss_disc_real_2: 0.42316514253616333 (0.42316514253616333) | > loss_disc_real_3: 0.2757432162761688 (0.2757432162761688) | > loss_disc_real_4: 0.25921598076820374 (0.25921598076820374) | > loss_disc_real_5: 0.24659501016139984 (0.24659501016139984) | > loss_0: 2.8808255195617676 (2.8808255195617676) | > loss_gen: 2.6347198486328125 (2.6347198486328125) | > loss_kl: 5.470876216888428 (5.470876216888428) | > loss_feat: 7.076959133148193 (7.076959133148193) | > loss_mel: 22.510581970214844 (22.510581970214844) | > loss_duration: 3.3886020183563232 (3.3886020183563232) | > loss_1: 41.08174133300781 (41.08174133300781)  --> STEP: 2 | > loss_disc: 3.1514577865600586 (3.016141653060913) | > loss_disc_real_0: 0.32370004057884216 (0.3251037746667862) | > loss_disc_real_1: 0.31195443868637085 (0.3354776203632355) | > loss_disc_real_2: 0.28375712037086487 (0.3534611314535141) | > loss_disc_real_3: 0.2442300021648407 (0.25998660922050476) | > loss_disc_real_4: 0.36098575592041016 (0.31010086834430695) | > loss_disc_real_5: 0.48178237676620483 (0.36418869346380234) | > loss_0: 3.1514577865600586 (3.016141653060913) | > loss_gen: 2.2193002700805664 (2.4270100593566895) | > loss_kl: 5.7413105964660645 (5.606093406677246) | > loss_feat: 5.98066520690918 (6.5288121700286865) | > loss_mel: 22.9521427154541 (22.731362342834473) | > loss_duration: 3.217006206512451 (3.302804112434387) | > loss_1: 40.11042404174805 (40.59608268737793)  --> STEP: 3 | > loss_disc: 2.9775121212005615 (3.003265142440796) | > loss_disc_real_0: 0.29755955934524536 (0.3159223695596059) | > loss_disc_real_1: 0.13439002633094788 (0.26844842235247296) | > loss_disc_real_2: 0.1515078991651535 (0.2861433873573939) | > loss_disc_real_3: 0.26556336879730225 (0.26184552907943726) | > loss_disc_real_4: 0.1799968183040619 (0.2667328516642253) | > loss_disc_real_5: 0.15426205098628998 (0.2942131459712982) | > loss_0: 2.9775121212005615 (3.003265142440796) | > loss_gen: 1.5326288938522339 (2.1288830041885376) | > loss_kl: 3.1090075969696045 (4.773731470108032) | > loss_feat: 6.812723636627197 (6.623449325561523) | > loss_mel: 21.65536117553711 (22.372695287068684) | > loss_duration: 2.989593982696533 (3.1984007358551025) | > loss_1: 36.09931182861328 (39.09715906778971) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_107000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.797778367996216 (2.951893448829651) | > loss_disc_real_0: 0.4719795882701874 (0.3549366742372513) | > loss_disc_real_1: 0.3843332827091217 (0.29741963744163513) | > loss_disc_real_2: 0.4747231602668762 (0.3332883305847645) | > loss_disc_real_3: 0.3786276876926422 (0.2910410687327385) | > loss_disc_real_4: 0.37309208512306213 (0.2933226600289345) | > loss_disc_real_5: 0.13885565102100372 (0.2553737722337246) | > loss_0: 2.797778367996216 (2.951893448829651) | > loss_gen: 3.607170581817627 (2.49845489859581) | > loss_kl: 6.233890533447266 (5.138771235942841) | > loss_feat: 10.096885681152344 (7.4918084144592285) | > loss_mel: 23.796876907348633 (22.728740692138672) | > loss_duration: 2.943535327911377 (3.134684383869171) | > loss_1: 46.67835998535156 (40.992459297180176)  --> STEP: 1 | > loss_disc: 3.4093894958496094 (3.0433926582336426) | > loss_disc_real_0: 0.6381473541259766 (0.4115788102149963) | > loss_disc_real_1: 0.33678436279296875 (0.30529258251190183) | > loss_disc_real_2: 0.3645835220813751 (0.3395473688840866) | > loss_disc_real_3: 0.23973917961120605 (0.280780690908432) | > loss_disc_real_4: 0.45525357127189636 (0.32570884227752683) | > loss_disc_real_5: 0.492575466632843 (0.3028141111135483) | > loss_0: 3.4093894958496094 (3.0433926582336426) | > loss_gen: 2.9099221229553223 (2.5807483434677123) | > loss_kl: 5.345596790313721 (5.180136346817017) | > loss_feat: 6.621924877166748 (7.317831707000733) | > loss_mel: 25.030004501342773 (23.188993453979492) | > loss_duration: 3.3302371501922607 (3.1737949371337892) | > loss_1: 43.23768997192383 (41.441505432128906)  --> STEP: 2 | > loss_disc: 3.5873637199401855 (3.1340545018514) | > loss_disc_real_0: 0.2252631038427353 (0.38052619248628616) | > loss_disc_real_1: 0.2298097163438797 (0.2927121048172315) | > loss_disc_real_2: 0.31271088123321533 (0.33507462094227475) | > loss_disc_real_3: 0.26873570680618286 (0.27877319355805713) | > loss_disc_real_4: 0.28684762120246887 (0.3192319720983505) | > loss_disc_real_5: 0.27668488025665283 (0.2984592393040657) | > loss_0: 3.5873637199401855 (3.1340545018514) | > loss_gen: 1.3683545589447021 (2.378682712713877) | > loss_kl: 5.810665130615234 (5.285224477450053) | > loss_feat: 9.083969116210938 (7.6121879418691) | > loss_mel: 23.496614456176758 (23.24026362101237) | > loss_duration: 3.227827787399292 (3.1828004121780396) | > loss_1: 42.98743438720703 (41.69916025797526)  --> STEP: 3 | > loss_disc: 3.0266900062561035 (3.1187167167663574) | > loss_disc_real_0: 0.27964815497398376 (0.36611504427024294) | > loss_disc_real_1: 0.40024080872535706 (0.308073348232678) | > loss_disc_real_2: 0.4596894085407257 (0.35287673345633913) | > loss_disc_real_3: 0.3624906539916992 (0.29073283076286316) | > loss_disc_real_4: 0.2541830241680145 (0.30993926525115967) | > loss_disc_real_5: 0.3440339267253876 (0.3049699089356831) | > loss_0: 3.0266900062561035 (3.1187167167663574) | > loss_gen: 2.534169912338257 (2.4008951698030745) | > loss_kl: 3.1511688232421875 (4.980359383991787) | > loss_feat: 3.399341583251953 (7.010352747780936) | > loss_mel: 24.395572662353516 (23.40530776977539) | > loss_duration: 2.9984872341156006 (3.1564699581691196) | > loss_1: 36.478736877441406 (40.953385489327566) --> EVAL PERFORMANCE | > avg_loader_time: 0.5174252986907959 (+0.508163849512736) | > avg_loss_disc: 3.1187167167663574 (+0.3399956226348877) | > avg_loss_disc_real_0: 0.36611504427024294 (+0.08195437561898) | > avg_loss_disc_real_1: 0.308073348232678 (+0.07241686823822205) | > avg_loss_disc_real_2: 0.35287673345633913 (+0.1116554694516318) | > avg_loss_disc_real_3: 0.29073283076286316 (+0.03597778081893921) | > avg_loss_disc_real_4: 0.30993926525115967 (+0.058471848567326845) | > avg_loss_disc_real_5: 0.3049699089356831 (+0.06459600939637136) | > avg_loss_0: 3.1187167167663574 (+0.3399956226348877) | > avg_loss_gen: 2.4008951698030745 (+0.48152904851096023) | > avg_loss_kl: 4.980359383991787 (+0.5487823372795475) | > avg_loss_feat: 7.010352747780936 (+4.067584755165236) | > avg_loss_mel: 23.40530776977539 (+11.40867288907369) | > avg_loss_duration: 3.1564699581691196 (-0.05844325111025883) | > avg_loss_1: 40.953385489327566 (+16.44812788282122)  > EPOCH: 1080/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:30:05)   --> TIME: 2023-10-20 13:30:26 -- STEP: 9/50 -- GLOBAL_STEP: 107010 | > loss_disc: 2.6225810050964355 (2.570824053552416) | > loss_disc_real_0: 0.20586317777633667 (0.19265787096487152) | > loss_disc_real_1: 0.19936230778694153 (0.24531291590796578) | > loss_disc_real_2: 0.2451239973306656 (0.23933397895760006) | > loss_disc_real_3: 0.3210579454898834 (0.23320432835155064) | > loss_disc_real_4: 0.361653596162796 (0.24068067553970549) | > loss_disc_real_5: 0.3343009948730469 (0.1966096531185839) | > loss_0: 2.6225810050964355 (2.570824053552416) | > grad_norm_0: tensor(548.4683, device='cuda:0') (tensor(584.7312, device='cuda:0')) | > loss_gen: 2.4106593132019043 (2.3012991878721447) | > loss_kl: 0.8386508226394653 (0.8632464740011427) | > loss_feat: 4.169619083404541 (5.492004109753503) | > loss_mel: 22.950843811035156 (20.859172079298233) | > loss_duration: 1.3026819229125977 (1.3716934786902533) | > loss_1: 31.672454833984375 (30.88741620381673) | > grad_norm_1: tensor(8075.3623, device='cuda:0') (tensor(12521.3408, device='cuda:0')) | > current_lr_0: 6.791452036203717e-05 | > current_lr_1: 6.791452036203717e-05 | > step_time: 0.6428 (0.6332231627570258) | > loader_time: 0.0044 (0.0274760193294949)  --> TIME: 2023-10-20 13:30:45 -- STEP: 39/50 -- GLOBAL_STEP: 107040 | > loss_disc: 1.9293289184570312 (2.5642517102070346) | > loss_disc_real_0: 0.03058822825551033 (0.1556667851475187) | > loss_disc_real_1: 0.15866267681121826 (0.23239011680468535) | > loss_disc_real_2: 0.13141372799873352 (0.22598461310068765) | > loss_disc_real_3: 0.11783116310834885 (0.23368742145024812) | > loss_disc_real_4: 0.3100799024105072 (0.23552450614097792) | > loss_disc_real_5: 0.09553693979978561 (0.2316349957806942) | > loss_0: 1.9293289184570312 (2.5642517102070346) | > grad_norm_0: tensor(244.5043, device='cuda:0') (tensor(622.1663, device='cuda:0')) | > loss_gen: 2.635960817337036 (2.20534518131843) | > loss_kl: 0.6120344996452332 (0.8151039022665757) | > loss_feat: 8.867149353027344 (5.308566694004605) | > loss_mel: 26.886600494384766 (19.895129870145748) | > loss_duration: 1.4560962915420532 (1.3566096379206731) | > loss_1: 40.45783996582031 (29.580755356030586) | > grad_norm_1: tensor(20718.0703, device='cuda:0') (tensor(17372.2852, device='cuda:0')) | > current_lr_0: 6.791452036203717e-05 | > current_lr_1: 6.791452036203717e-05 | > step_time: 0.4566 (0.6200454846406595) | > loader_time: 0.0088 (0.024917455819936905)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8315353393554688 (2.8315353393554688) | > loss_disc_real_0: 0.19597360491752625 (0.19597360491752625) | > loss_disc_real_1: 0.259111613035202 (0.259111613035202) | > loss_disc_real_2: 0.2290719747543335 (0.2290719747543335) | > loss_disc_real_3: 0.2588120400905609 (0.2588120400905609) | > loss_disc_real_4: 0.2566351890563965 (0.2566351890563965) | > loss_disc_real_5: 0.2745417356491089 (0.2745417356491089) | > loss_0: 2.8315353393554688 (2.8315353393554688) | > loss_gen: 1.6760330200195312 (1.6760330200195312) | > loss_kl: 5.929453372955322 (5.929453372955322) | > loss_feat: 0.5903249979019165 (0.5903249979019165) | > loss_mel: 17.033946990966797 (17.033946990966797) | > loss_duration: 3.0807723999023438 (3.0807723999023438) | > loss_1: 28.310531616210938 (28.310531616210938)  --> STEP: 1 | > loss_disc: 3.051454782485962 (3.051454782485962) | > loss_disc_real_0: 0.2027633786201477 (0.2027633786201477) | > loss_disc_real_1: 0.22708161175251007 (0.22708161175251007) | > loss_disc_real_2: 0.3485890328884125 (0.3485890328884125) | > loss_disc_real_3: 0.369708776473999 (0.369708776473999) | > loss_disc_real_4: 0.4162193238735199 (0.4162193238735199) | > loss_disc_real_5: 0.44871196150779724 (0.44871196150779724) | > loss_0: 3.051454782485962 (3.051454782485962) | > loss_gen: 2.4186415672302246 (2.4186415672302246) | > loss_kl: 5.474515914916992 (5.474515914916992) | > loss_feat: 5.990200042724609 (5.990200042724609) | > loss_mel: 21.030166625976562 (21.030166625976562) | > loss_duration: 3.3549866676330566 (3.3549866676330566) | > loss_1: 38.26850891113281 (38.26850891113281)  --> STEP: 2 | > loss_disc: 3.1840667724609375 (3.1177607774734497) | > loss_disc_real_0: 0.5508397817611694 (0.37680158019065857) | > loss_disc_real_1: 0.32254451513290405 (0.27481306344270706) | > loss_disc_real_2: 0.21825312077999115 (0.2834210768342018) | > loss_disc_real_3: 0.23727628588676453 (0.3034925311803818) | > loss_disc_real_4: 0.23856300115585327 (0.3273911625146866) | > loss_disc_real_5: 0.2505415678024292 (0.3496267646551132) | > loss_0: 3.1840667724609375 (3.1177607774734497) | > loss_gen: 2.216484785079956 (2.3175631761550903) | > loss_kl: 5.5959343910217285 (5.53522515296936) | > loss_feat: 6.637326240539551 (6.31376314163208) | > loss_mel: 26.97665023803711 (24.003408432006836) | > loss_duration: 3.2688870429992676 (3.311936855316162) | > loss_1: 44.695281982421875 (41.481895446777344)  --> STEP: 3 | > loss_disc: 2.961740255355835 (3.065753936767578) | > loss_disc_real_0: 0.23113226890563965 (0.3282451430956523) | > loss_disc_real_1: 0.24999697506427765 (0.2665410339832306) | > loss_disc_real_2: 0.23155927658081055 (0.2661338100830714) | > loss_disc_real_3: 0.2637883126735687 (0.2902577916781108) | > loss_disc_real_4: 0.2640197277069092 (0.3062673509120941) | > loss_disc_real_5: 0.2652401328086853 (0.3214978873729706) | > loss_0: 2.961740255355835 (3.065753936767578) | > loss_gen: 1.5504424571990967 (2.061856269836426) | > loss_kl: 2.8241326808929443 (4.631527662277222) | > loss_feat: 0.26362577080726624 (4.2970506846904755) | > loss_mel: 10.718354225158691 (19.57505702972412) | > loss_duration: 2.927304267883301 (3.1837259928385415) | > loss_1: 18.283859252929688 (33.74921671549479) --> EVAL PERFORMANCE | > avg_loader_time: 0.0018981297810872395 (-0.5155271689097086) | > avg_loss_disc: 3.065753936767578 (-0.0529627799987793) | > avg_loss_disc_real_0: 0.3282451430956523 (-0.03786990117459066) | > avg_loss_disc_real_1: 0.2665410339832306 (-0.04153231424944742) | > avg_loss_disc_real_2: 0.2661338100830714 (-0.08674292337326772) | > avg_loss_disc_real_3: 0.2902577916781108 (-0.0004750390847523822) | > avg_loss_disc_real_4: 0.3062673509120941 (-0.0036719143390655518) | > avg_loss_disc_real_5: 0.3214978873729706 (+0.016527978437287483) | > avg_loss_0: 3.065753936767578 (-0.0529627799987793) | > avg_loss_gen: 2.061856269836426 (-0.3390388999666487) | > avg_loss_kl: 4.631527662277222 (-0.3488317217145651) | > avg_loss_feat: 4.2970506846904755 (-2.7133020630904605) | > avg_loss_mel: 19.57505702972412 (-3.8302507400512695) | > avg_loss_duration: 3.1837259928385415 (+0.027256034669421947) | > avg_loss_1: 33.74921671549479 (-7.204168773832777)  > EPOCH: 1081/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:31:17)   --> TIME: 2023-10-20 13:31:32 -- STEP: 19/50 -- GLOBAL_STEP: 107070 | > loss_disc: 1.4554967880249023 (2.5515454756586173) | > loss_disc_real_0: 0.05911894887685776 (0.17893434080638385) | > loss_disc_real_1: 0.03401799499988556 (0.2372114474051877) | > loss_disc_real_2: 0.0878535658121109 (0.2258859043450732) | > loss_disc_real_3: 0.060021694749593735 (0.24716675105063537) | > loss_disc_real_4: 0.09110763669013977 (0.25050956050032064) | > loss_disc_real_5: 0.09796955436468124 (0.2703370170569734) | > loss_0: 1.4554967880249023 (2.5515454756586173) | > grad_norm_0: tensor(667.9261, device='cuda:0') (tensor(600.2959, device='cuda:0')) | > loss_gen: 2.6106932163238525 (2.3218313455581665) | > loss_kl: 0.9031378626823425 (0.7961354224305404) | > loss_feat: 12.46590805053711 (5.878823306607573) | > loss_mel: 24.321035385131836 (20.61581100915608) | > loss_duration: 1.4059503078460693 (1.38514717001664) | > loss_1: 41.70672607421875 (30.997748575712507) | > grad_norm_1: tensor(73312.6719, device='cuda:0') (tensor(26958.6484, device='cuda:0')) | > current_lr_0: 6.784663554685077e-05 | > current_lr_1: 6.784663554685077e-05 | > step_time: 0.4471 (0.5096207041489449) | > loader_time: 0.0266 (0.010644762139571341)  --> TIME: 2023-10-20 13:31:52 -- STEP: 49/50 -- GLOBAL_STEP: 107100 | > loss_disc: 1.8444851636886597 (2.4516558428199926) | > loss_disc_real_0: 0.06977836787700653 (0.15277999890398006) | > loss_disc_real_1: 0.10901922732591629 (0.2222333403722364) | > loss_disc_real_2: 0.1458795815706253 (0.21674398872621206) | > loss_disc_real_3: 0.21306520700454712 (0.2334955569584759) | > loss_disc_real_4: 0.11982224136590958 (0.2355224653052128) | > loss_disc_real_5: 0.2942955195903778 (0.2525704057545078) | > loss_0: 1.8444851636886597 (2.4516558428199926) | > grad_norm_0: tensor(1100.6619, device='cuda:0') (tensor(613.3212, device='cuda:0')) | > loss_gen: 2.5416502952575684 (2.3438940437472593) | > loss_kl: 0.7059692740440369 (0.8070181851484337) | > loss_feat: 5.7151780128479 (5.6988208366900075) | > loss_mel: 21.82636833190918 (20.508104893626) | > loss_duration: 1.4876043796539307 (1.3528033665248327) | > loss_1: 32.276771545410156 (30.710641345199274) | > grad_norm_1: tensor(28846.9316, device='cuda:0') (tensor(23414.9258, device='cuda:0')) | > current_lr_0: 6.784663554685077e-05 | > current_lr_1: 6.784663554685077e-05 | > step_time: 0.598 (0.5749545681233307) | > loader_time: 0.4258 (0.02703080858503069)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.934955596923828 (2.934955596923828) | > loss_disc_real_0: 0.31781986355781555 (0.31781986355781555) | > loss_disc_real_1: 0.26168370246887207 (0.26168370246887207) | > loss_disc_real_2: 0.23859092593193054 (0.23859092593193054) | > loss_disc_real_3: 0.23926250636577606 (0.23926250636577606) | > loss_disc_real_4: 0.25563040375709534 (0.25563040375709534) | > loss_disc_real_5: 0.2585214078426361 (0.2585214078426361) | > loss_0: 2.934955596923828 (2.934955596923828) | > loss_gen: 1.698869228363037 (1.698869228363037) | > loss_kl: 5.994239807128906 (5.994239807128906) | > loss_feat: 0.355660617351532 (0.355660617351532) | > loss_mel: 12.049469947814941 (12.049469947814941) | > loss_duration: 3.102260112762451 (3.102260112762451) | > loss_1: 23.20050048828125 (23.20050048828125)  --> STEP: 1 | > loss_disc: 2.218371629714966 (2.218371629714966) | > loss_disc_real_0: 0.19423654675483704 (0.19423654675483704) | > loss_disc_real_1: 0.28208255767822266 (0.28208255767822266) | > loss_disc_real_2: 0.2770763039588928 (0.2770763039588928) | > loss_disc_real_3: 0.2731569707393646 (0.2731569707393646) | > loss_disc_real_4: 0.11006759107112885 (0.11006759107112885) | > loss_disc_real_5: 0.2433251440525055 (0.2433251440525055) | > loss_0: 2.218371629714966 (2.218371629714966) | > loss_gen: 2.821364402770996 (2.821364402770996) | > loss_kl: 5.815279006958008 (5.815279006958008) | > loss_feat: 9.271163940429688 (9.271163940429688) | > loss_mel: 22.13195037841797 (22.13195037841797) | > loss_duration: 3.304910659790039 (3.304910659790039) | > loss_1: 43.34466552734375 (43.34466552734375)  --> STEP: 2 | > loss_disc: 3.0339367389678955 (2.6261541843414307) | > loss_disc_real_0: 0.32053858041763306 (0.25738756358623505) | > loss_disc_real_1: 0.2818724513053894 (0.28197750449180603) | > loss_disc_real_2: 0.24126863479614258 (0.2591724693775177) | > loss_disc_real_3: 0.24466848373413086 (0.25891272723674774) | > loss_disc_real_4: 0.2434433400630951 (0.17675546556711197) | > loss_disc_real_5: 0.2472062110900879 (0.2452656775712967) | > loss_0: 3.0339367389678955 (2.6261541843414307) | > loss_gen: 1.592526912689209 (2.2069456577301025) | > loss_kl: 5.539196968078613 (5.6772379875183105) | > loss_feat: 0.570328414440155 (4.920746177434921) | > loss_mel: 6.1500630378723145 (14.141006708145142) | > loss_duration: 3.172924280166626 (3.2389174699783325) | > loss_1: 17.025039672851562 (30.184852600097656)  --> STEP: 3 | > loss_disc: 2.8603274822235107 (2.704211950302124) | > loss_disc_real_0: 0.2213095724582672 (0.2453615665435791) | > loss_disc_real_1: 0.3288368880748749 (0.29759729901949566) | > loss_disc_real_2: 0.2518680989742279 (0.25673767924308777) | > loss_disc_real_3: 0.17283478379249573 (0.23022007942199707) | > loss_disc_real_4: 0.29575419425964355 (0.2164217084646225) | > loss_disc_real_5: 0.5540250539779663 (0.3481854697068532) | > loss_0: 2.8603274822235107 (2.704211950302124) | > loss_gen: 2.708693027496338 (2.374194780985514) | > loss_kl: 2.60565185546875 (4.65337594350179) | > loss_feat: 6.064440727233887 (5.301977694034576) | > loss_mel: 18.450998306274414 (15.577670574188232) | > loss_duration: 2.983649969100952 (3.1538283030192056) | > loss_1: 32.81343078613281 (31.061045328776043) --> EVAL PERFORMANCE | > avg_loader_time: 0.004325707753499349 (+0.0024275779724121094) | > avg_loss_disc: 2.704211950302124 (-0.3615419864654541) | > avg_loss_disc_real_0: 0.2453615665435791 (-0.08288357655207318) | > avg_loss_disc_real_1: 0.29759729901949566 (+0.031056265036265074) | > avg_loss_disc_real_2: 0.25673767924308777 (-0.00939613083998364) | > avg_loss_disc_real_3: 0.23022007942199707 (-0.06003771225611371) | > avg_loss_disc_real_4: 0.2164217084646225 (-0.08984564244747162) | > avg_loss_disc_real_5: 0.3481854697068532 (+0.02668758233388263) | > avg_loss_0: 2.704211950302124 (-0.3615419864654541) | > avg_loss_gen: 2.374194780985514 (+0.3123385111490884) | > avg_loss_kl: 4.65337594350179 (+0.02184828122456839) | > avg_loss_feat: 5.301977694034576 (+1.004927009344101) | > avg_loss_mel: 15.577670574188232 (-3.9973864555358887) | > avg_loss_duration: 3.1538283030192056 (-0.029897689819335938) | > avg_loss_1: 31.061045328776043 (-2.6881713867187464)  > EPOCH: 1082/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:32:08)   --> TIME: 2023-10-20 13:32:29 -- STEP: 29/50 -- GLOBAL_STEP: 107130 | > loss_disc: 2.531815528869629 (2.4773561995604942) | > loss_disc_real_0: 0.11320331692695618 (0.15450795691717287) | > loss_disc_real_1: 0.2189456820487976 (0.22065219122531085) | > loss_disc_real_2: 0.208046093583107 (0.2244188179229868) | > loss_disc_real_3: 0.24650821089744568 (0.22235863363562985) | > loss_disc_real_4: 0.2331455498933792 (0.216535958493578) | > loss_disc_real_5: 0.23835782706737518 (0.22519299503544282) | > loss_0: 2.531815528869629 (2.4773561995604942) | > grad_norm_0: tensor(433.6124, device='cuda:0') (tensor(716.6199, device='cuda:0')) | > loss_gen: 1.9799597263336182 (2.200440821976497) | > loss_kl: 0.695397675037384 (0.8710361811621435) | > loss_feat: 3.0707359313964844 (5.645740868973321) | > loss_mel: 16.975217819213867 (19.36825393808299) | > loss_duration: 1.2367287874221802 (1.3725101290078) | > loss_1: 23.958040237426758 (29.457981997522815) | > grad_norm_1: tensor(9498.5342, device='cuda:0') (tensor(22007.3906, device='cuda:0')) | > current_lr_0: 6.777881858678738e-05 | > current_lr_1: 6.777881858678738e-05 | > step_time: 0.3636 (0.4995563194669525) | > loader_time: 0.0021 (0.016167936653926452)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6522839069366455 (2.6522839069366455) | > loss_disc_real_0: 0.38043665885925293 (0.38043665885925293) | > loss_disc_real_1: 0.19117651879787445 (0.19117651879787445) | > loss_disc_real_2: 0.2691807746887207 (0.2691807746887207) | > loss_disc_real_3: 0.28998079895973206 (0.28998079895973206) | > loss_disc_real_4: 0.1690942496061325 (0.1690942496061325) | > loss_disc_real_5: 0.25384965538978577 (0.25384965538978577) | > loss_0: 2.6522839069366455 (2.6522839069366455) | > loss_gen: 2.49222469329834 (2.49222469329834) | > loss_kl: 6.285926818847656 (6.285926818847656) | > loss_feat: 7.802669525146484 (7.802669525146484) | > loss_mel: 25.09701156616211 (25.09701156616211) | > loss_duration: 3.0287201404571533 (3.0287201404571533) | > loss_1: 44.7065544128418 (44.7065544128418)  --> STEP: 1 | > loss_disc: 3.050593376159668 (3.050593376159668) | > loss_disc_real_0: 0.3602668046951294 (0.3602668046951294) | > loss_disc_real_1: 0.23431597650051117 (0.23431597650051117) | > loss_disc_real_2: 0.1830420047044754 (0.1830420047044754) | > loss_disc_real_3: 0.29244524240493774 (0.29244524240493774) | > loss_disc_real_4: 0.2626429796218872 (0.2626429796218872) | > loss_disc_real_5: 0.33877116441726685 (0.33877116441726685) | > loss_0: 3.050593376159668 (3.050593376159668) | > loss_gen: 2.0173792839050293 (2.0173792839050293) | > loss_kl: 5.786245346069336 (5.786245346069336) | > loss_feat: 2.053346633911133 (2.053346633911133) | > loss_mel: 18.032623291015625 (18.032623291015625) | > loss_duration: 3.3008110523223877 (3.3008110523223877) | > loss_1: 31.190406799316406 (31.190406799316406)  --> STEP: 2 | > loss_disc: 2.696418523788452 (2.87350594997406) | > loss_disc_real_0: 0.2673094868659973 (0.31378814578056335) | > loss_disc_real_1: 0.16504666209220886 (0.19968131929636002) | > loss_disc_real_2: 0.2240656316280365 (0.20355381816625595) | > loss_disc_real_3: 0.21210767328739166 (0.2522764578461647) | > loss_disc_real_4: 0.3461267650127411 (0.30438487231731415) | > loss_disc_real_5: 0.20341092348098755 (0.2710910439491272) | > loss_0: 2.696418523788452 (2.87350594997406) | > loss_gen: 1.992967963218689 (2.005173623561859) | > loss_kl: 5.667481422424316 (5.726863384246826) | > loss_feat: 4.65968656539917 (3.3565165996551514) | > loss_mel: 26.295082092285156 (22.16385269165039) | > loss_duration: 3.1399130821228027 (3.220362067222595) | > loss_1: 41.755130767822266 (36.472768783569336)  --> STEP: 3 | > loss_disc: 2.488086700439453 (2.745032866795858) | > loss_disc_real_0: 0.4067724645137787 (0.34478291869163513) | > loss_disc_real_1: 0.2512079179286957 (0.21685685217380524) | > loss_disc_real_2: 0.26391497254371643 (0.22367420295874277) | > loss_disc_real_3: 0.21387742459774017 (0.23947678009668985) | > loss_disc_real_4: 0.33913344144821167 (0.31596772869427997) | > loss_disc_real_5: 0.39240914583206177 (0.3115304112434387) | > loss_0: 2.488086700439453 (2.745032866795858) | > loss_gen: 3.553046703338623 (2.5211313168207803) | > loss_kl: 2.7296369075775146 (4.727787892023723) | > loss_feat: 6.336137771606445 (4.349723656972249) | > loss_mel: 17.388187408447266 (20.571964263916016) | > loss_duration: 2.974066972732544 (3.138263702392578) | > loss_1: 32.981075286865234 (35.30887095133463) --> EVAL PERFORMANCE | > avg_loader_time: 0.018401543299357098 (+0.01407583554585775) | > avg_loss_disc: 2.745032866795858 (+0.04082091649373387) | > avg_loss_disc_real_0: 0.34478291869163513 (+0.09942135214805603) | > avg_loss_disc_real_1: 0.21685685217380524 (-0.08074044684569043) | > avg_loss_disc_real_2: 0.22367420295874277 (-0.033063476284345) | > avg_loss_disc_real_3: 0.23947678009668985 (+0.00925670067469278) | > avg_loss_disc_real_4: 0.31596772869427997 (+0.09954602022965747) | > avg_loss_disc_real_5: 0.3115304112434387 (-0.03665505846341449) | > avg_loss_0: 2.745032866795858 (+0.04082091649373387) | > avg_loss_gen: 2.5211313168207803 (+0.1469365358352661) | > avg_loss_kl: 4.727787892023723 (+0.07441194852193256) | > avg_loss_feat: 4.349723656972249 (-0.9522540370623274) | > avg_loss_mel: 20.571964263916016 (+4.994293689727783) | > avg_loss_duration: 3.138263702392578 (-0.015564600626627456) | > avg_loss_1: 35.30887095133463 (+4.24782562255859)  > EPOCH: 1083/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:33:00)   --> TIME: 2023-10-20 13:33:12 -- STEP: 9/50 -- GLOBAL_STEP: 107160 | > loss_disc: 2.6190733909606934 (2.4709246688418918) | > loss_disc_real_0: 0.08287744224071503 (0.14160296527875793) | > loss_disc_real_1: 0.23472000658512115 (0.22147336188289854) | > loss_disc_real_2: 0.20765365660190582 (0.19413235204087365) | > loss_disc_real_3: 0.21367990970611572 (0.201783144639598) | > loss_disc_real_4: 0.3252272307872772 (0.2318368661734793) | > loss_disc_real_5: 0.40194499492645264 (0.2653989576631122) | > loss_0: 2.6190733909606934 (2.4709246688418918) | > grad_norm_0: tensor(352.8334, device='cuda:0') (tensor(686.5270, device='cuda:0')) | > loss_gen: 2.287121534347534 (2.2489663230048285) | > loss_kl: 0.7399085164070129 (0.9788565900590684) | > loss_feat: 5.060237884521484 (4.943710969967975) | > loss_mel: 21.456144332885742 (17.650659985012478) | > loss_duration: 1.3433144092559814 (1.3587967819637723) | > loss_1: 30.88672637939453 (27.180990272098118) | > grad_norm_1: tensor(4326.6177, device='cuda:0') (tensor(22866.1641, device='cuda:0')) | > current_lr_0: 6.771106941402156e-05 | > current_lr_1: 6.771106941402156e-05 | > step_time: 0.5994 (0.6445739269256592) | > loader_time: 0.0137 (0.02717357211642795)  --> TIME: 2023-10-20 13:33:31 -- STEP: 39/50 -- GLOBAL_STEP: 107190 | > loss_disc: 2.7489993572235107 (2.521639209527236) | > loss_disc_real_0: 0.16549865901470184 (0.14169283693608564) | > loss_disc_real_1: 0.19875892996788025 (0.23370868865496072) | > loss_disc_real_2: 0.25874921679496765 (0.226170335824673) | > loss_disc_real_3: 0.2965828478336334 (0.23916178521437523) | > loss_disc_real_4: 0.24408584833145142 (0.237510959784954) | > loss_disc_real_5: 0.2558034062385559 (0.25212345749903947) | > loss_0: 2.7489993572235107 (2.521639209527236) | > grad_norm_0: tensor(711.4653, device='cuda:0') (tensor(696.5806, device='cuda:0')) | > loss_gen: 1.8397635221481323 (2.2266656221487584) | > loss_kl: 0.43350210785865784 (0.8545848092971704) | > loss_feat: 1.3723342418670654 (4.881571806871738) | > loss_mel: 18.125757217407227 (20.288524652138733) | > loss_duration: 1.3582706451416016 (1.3413061637144823) | > loss_1: 23.129627227783203 (29.592652797698975) | > grad_norm_1: tensor(5714.0513, device='cuda:0') (tensor(17781.7402, device='cuda:0')) | > current_lr_0: 6.771106941402156e-05 | > current_lr_1: 6.771106941402156e-05 | > step_time: 0.6523 (0.6360565515664908) | > loader_time: 0.0175 (0.024541573646741036)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9441311359405518 (2.9441311359405518) | > loss_disc_real_0: 0.32262641191482544 (0.32262641191482544) | > loss_disc_real_1: 0.3014256954193115 (0.3014256954193115) | > loss_disc_real_2: 0.2719821631908417 (0.2719821631908417) | > loss_disc_real_3: 0.22727862000465393 (0.22727862000465393) | > loss_disc_real_4: 0.21680182218551636 (0.21680182218551636) | > loss_disc_real_5: 0.21852166950702667 (0.21852166950702667) | > loss_0: 2.9441311359405518 (2.9441311359405518) | > loss_gen: 1.90964674949646 (1.90964674949646) | > loss_kl: 5.6803436279296875 (5.6803436279296875) | > loss_feat: 8.070283889770508 (8.070283889770508) | > loss_mel: 22.614259719848633 (22.614259719848633) | > loss_duration: 2.97493052482605 (2.97493052482605) | > loss_1: 41.24946212768555 (41.24946212768555)  --> STEP: 1 | > loss_disc: 2.694943428039551 (2.694943428039551) | > loss_disc_real_0: 0.31963831186294556 (0.31963831186294556) | > loss_disc_real_1: 0.18648380041122437 (0.18648380041122437) | > loss_disc_real_2: 0.24738405644893646 (0.24738405644893646) | > loss_disc_real_3: 0.2565249502658844 (0.2565249502658844) | > loss_disc_real_4: 0.31632503867149353 (0.31632503867149353) | > loss_disc_real_5: 0.2995598316192627 (0.2995598316192627) | > loss_0: 2.694943428039551 (2.694943428039551) | > loss_gen: 2.2309017181396484 (2.2309017181396484) | > loss_kl: 5.635606288909912 (5.635606288909912) | > loss_feat: 6.363336086273193 (6.363336086273193) | > loss_mel: 24.664003372192383 (24.664003372192383) | > loss_duration: 3.4220845699310303 (3.4220845699310303) | > loss_1: 42.3159294128418 (42.3159294128418)  --> STEP: 2 | > loss_disc: 2.8547251224517822 (2.7748342752456665) | > loss_disc_real_0: 0.14787748456001282 (0.2337578982114792) | > loss_disc_real_1: 0.4026997983455658 (0.2945917993783951) | > loss_disc_real_2: 0.5820761919021606 (0.41473012417554855) | > loss_disc_real_3: 0.26076990365982056 (0.2586474269628525) | > loss_disc_real_4: 0.22592516243457794 (0.27112510055303574) | > loss_disc_real_5: 0.241046741604805 (0.27030328661203384) | > loss_0: 2.8547251224517822 (2.7748342752456665) | > loss_gen: 2.5027201175689697 (2.366810917854309) | > loss_kl: 5.957786560058594 (5.796696424484253) | > loss_feat: 4.305131435394287 (5.33423376083374) | > loss_mel: 26.216440200805664 (25.440221786499023) | > loss_duration: 3.1744136810302734 (3.298249125480652) | > loss_1: 42.156494140625 (42.2362117767334)  --> STEP: 3 | > loss_disc: 2.995170831680298 (2.8482797940572104) | > loss_disc_real_0: 0.2227480560541153 (0.23008795082569122) | > loss_disc_real_1: 0.25491663813591003 (0.2813667456309001) | > loss_disc_real_2: 0.25657716393470764 (0.36201247076193493) | > loss_disc_real_3: 0.2583008408546448 (0.2585318982601166) | > loss_disc_real_4: 0.23223090171813965 (0.2581603676080704) | > loss_disc_real_5: 0.2511903941631317 (0.2639323224623998) | > loss_0: 2.995170831680298 (2.8482797940572104) | > loss_gen: 1.4831253290176392 (2.0722490549087524) | > loss_kl: 3.0200047492980957 (4.871132532755534) | > loss_feat: 0.0346997007727623 (3.567722407480081) | > loss_mel: 1.6420148611068726 (17.50748614470164) | > loss_duration: 3.0554518699645996 (3.2173167069753013) | > loss_1: 9.235296249389648 (31.23590660095215) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031180381774902344 (-0.015283505121866863) | > avg_loss_disc: 2.8482797940572104 (+0.10324692726135254) | > avg_loss_disc_real_0: 0.23008795082569122 (-0.11469496786594391) | > avg_loss_disc_real_1: 0.2813667456309001 (+0.06450989345709485) | > avg_loss_disc_real_2: 0.36201247076193493 (+0.13833826780319217) | > avg_loss_disc_real_3: 0.2585318982601166 (+0.019055118163426726) | > avg_loss_disc_real_4: 0.2581603676080704 (-0.0578073610862096) | > avg_loss_disc_real_5: 0.2639323224623998 (-0.04759808878103894) | > avg_loss_0: 2.8482797940572104 (+0.10324692726135254) | > avg_loss_gen: 2.0722490549087524 (-0.44888226191202785) | > avg_loss_kl: 4.871132532755534 (+0.14334464073181152) | > avg_loss_feat: 3.567722407480081 (-0.782001249492168) | > avg_loss_mel: 17.50748614470164 (-3.0644781192143746) | > avg_loss_duration: 3.2173167069753013 (+0.07905300458272313) | > avg_loss_1: 31.23590660095215 (-4.072964350382485)  > EPOCH: 1084/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:33:55)   --> TIME: 2023-10-20 13:34:13 -- STEP: 19/50 -- GLOBAL_STEP: 107220 | > loss_disc: 2.8893258571624756 (2.598297407752589) | > loss_disc_real_0: 0.12844118475914001 (0.17978009503138692) | > loss_disc_real_1: 0.26825758814811707 (0.2382234734924216) | > loss_disc_real_2: 0.2902441620826721 (0.2377736968429465) | > loss_disc_real_3: 0.2428891956806183 (0.25207168216768067) | > loss_disc_real_4: 0.24328628182411194 (0.23921051915538938) | > loss_disc_real_5: 0.23000310361385345 (0.19896175202570462) | > loss_0: 2.8893258571624756 (2.598297407752589) | > grad_norm_0: tensor(1757.1117, device='cuda:0') (tensor(856.9677, device='cuda:0')) | > loss_gen: 1.5618956089019775 (2.0866299365696155) | > loss_kl: 0.7739269137382507 (0.781168016948198) | > loss_feat: 0.5596914887428284 (3.9943670732410332) | > loss_mel: 5.447456359863281 (19.07263297783701) | > loss_duration: 1.3692357540130615 (1.3852274355135465) | > loss_1: 9.71220588684082 (27.320025469127454) | > grad_norm_1: tensor(3658.8301, device='cuda:0') (tensor(9896.5605, device='cuda:0')) | > current_lr_0: 6.764338796079565e-05 | > current_lr_1: 6.764338796079565e-05 | > step_time: 0.3583 (0.5573220252990723) | > loader_time: 0.0112 (0.010616202103464227)  --> TIME: 2023-10-20 13:34:25 -- STEP: 49/50 -- GLOBAL_STEP: 107250 | > loss_disc: 3.0596203804016113 (2.4737671054139425) | > loss_disc_real_0: 0.24087750911712646 (0.1530192345380783) | > loss_disc_real_1: 0.2538694143295288 (0.2207718365350548) | > loss_disc_real_2: 0.23211470246315002 (0.22449513479154937) | > loss_disc_real_3: 0.2541632652282715 (0.23447549000990633) | > loss_disc_real_4: 0.3113880753517151 (0.21897307289194087) | > loss_disc_real_5: 0.2774280607700348 (0.20000217529964082) | > loss_0: 3.0596203804016113 (2.4737671054139425) | > grad_norm_0: tensor(833.4776, device='cuda:0') (tensor(679.2608, device='cuda:0')) | > loss_gen: 1.5507481098175049 (2.206665464809962) | > loss_kl: 0.6264275312423706 (0.7530150218885772) | > loss_feat: 0.10788870602846146 (5.272631660788035) | > loss_mel: 2.556952953338623 (19.822903326579503) | > loss_duration: 1.447750449180603 (1.3550601905705981) | > loss_1: 6.289767742156982 (29.41027561499148) | > grad_norm_1: tensor(19686.3184, device='cuda:0') (tensor(15661.8184, device='cuda:0')) | > current_lr_0: 6.764338796079565e-05 | > current_lr_1: 6.764338796079565e-05 | > step_time: 0.5103 (0.45348249162946436) | > loader_time: 0.5127 (0.019208912946739976)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2082619667053223 (2.2082619667053223) | > loss_disc_real_0: 0.2554982602596283 (0.2554982602596283) | > loss_disc_real_1: 0.23095041513442993 (0.23095041513442993) | > loss_disc_real_2: 0.1693272739648819 (0.1693272739648819) | > loss_disc_real_3: 0.21594597399234772 (0.21594597399234772) | > loss_disc_real_4: 0.10420505702495575 (0.10420505702495575) | > loss_disc_real_5: 0.09230753779411316 (0.09230753779411316) | > loss_0: 2.2082619667053223 (2.2082619667053223) | > loss_gen: 2.3431971073150635 (2.3431971073150635) | > loss_kl: 5.44194221496582 (5.44194221496582) | > loss_feat: 8.731929779052734 (8.731929779052734) | > loss_mel: 24.58205223083496 (24.58205223083496) | > loss_duration: 3.0622644424438477 (3.0622644424438477) | > loss_1: 44.16138458251953 (44.16138458251953)  --> STEP: 1 | > loss_disc: 3.2274608612060547 (3.2274608612060547) | > loss_disc_real_0: 0.5760446190834045 (0.5760446190834045) | > loss_disc_real_1: 0.36808571219444275 (0.36808571219444275) | > loss_disc_real_2: 0.32915934920310974 (0.32915934920310974) | > loss_disc_real_3: 0.2801748216152191 (0.2801748216152191) | > loss_disc_real_4: 0.19074663519859314 (0.19074663519859314) | > loss_disc_real_5: 0.2947051525115967 (0.2947051525115967) | > loss_0: 3.2274608612060547 (3.2274608612060547) | > loss_gen: 2.322120189666748 (2.322120189666748) | > loss_kl: 5.371617317199707 (5.371617317199707) | > loss_feat: 6.557828426361084 (6.557828426361084) | > loss_mel: 23.884435653686523 (23.884435653686523) | > loss_duration: 3.3499770164489746 (3.3499770164489746) | > loss_1: 41.48597717285156 (41.48597717285156)  --> STEP: 2 | > loss_disc: 3.0412096977233887 (3.1343352794647217) | > loss_disc_real_0: 0.2574108839035034 (0.416727751493454) | > loss_disc_real_1: 0.2573221027851105 (0.3127039074897766) | > loss_disc_real_2: 0.2369714379310608 (0.28306539356708527) | > loss_disc_real_3: 0.25768131017684937 (0.26892806589603424) | > loss_disc_real_4: 0.3100484311580658 (0.25039753317832947) | > loss_disc_real_5: 0.2752872407436371 (0.2849961966276169) | > loss_0: 3.0412096977233887 (3.1343352794647217) | > loss_gen: 1.5597339868545532 (1.9409270882606506) | > loss_kl: 5.746845722198486 (5.559231519699097) | > loss_feat: 0.08796383440494537 (3.3228961303830147) | > loss_mel: 1.652400016784668 (12.768417835235596) | > loss_duration: 3.1307971477508545 (3.2403870820999146) | > loss_1: 12.177741050720215 (26.83185911178589)  --> STEP: 3 | > loss_disc: 2.5586800575256348 (2.942450205485026) | > loss_disc_real_0: 0.21847638487815857 (0.35064396262168884) | > loss_disc_real_1: 0.2832992970943451 (0.30290237069129944) | > loss_disc_real_2: 0.2596059739589691 (0.27524558703104657) | > loss_disc_real_3: 0.1528773456811905 (0.23024449249108633) | > loss_disc_real_4: 0.22689133882522583 (0.24256213506062826) | > loss_disc_real_5: 0.4553138017654419 (0.34176873167355853) | > loss_0: 2.5586800575256348 (2.942450205485026) | > loss_gen: 2.5310981273651123 (2.1376507679621377) | > loss_kl: 2.4618752002716064 (4.526779413223267) | > loss_feat: 4.437266826629639 (3.6943530291318893) | > loss_mel: 14.658501625061035 (13.398445765177408) | > loss_duration: 3.045304298400879 (3.1753594875335693) | > loss_1: 27.134044647216797 (26.93258762359619) --> EVAL PERFORMANCE | > avg_loader_time: 0.021921793619791668 (+0.018803755442301433) | > avg_loss_disc: 2.942450205485026 (+0.09417041142781546) | > avg_loss_disc_real_0: 0.35064396262168884 (+0.12055601179599762) | > avg_loss_disc_real_1: 0.30290237069129944 (+0.021535625060399355) | > avg_loss_disc_real_2: 0.27524558703104657 (-0.08676688373088837) | > avg_loss_disc_real_3: 0.23024449249108633 (-0.028287405769030244) | > avg_loss_disc_real_4: 0.24256213506062826 (-0.015598232547442109) | > avg_loss_disc_real_5: 0.34176873167355853 (+0.07783640921115875) | > avg_loss_0: 2.942450205485026 (+0.09417041142781546) | > avg_loss_gen: 2.1376507679621377 (+0.06540171305338527) | > avg_loss_kl: 4.526779413223267 (-0.34435311953226755) | > avg_loss_feat: 3.6943530291318893 (+0.12663062165180827) | > avg_loss_mel: 13.398445765177408 (-4.109040379524233) | > avg_loss_duration: 3.1753594875335693 (-0.04195721944173192) | > avg_loss_1: 26.93258762359619 (-4.303318977355957)  > EPOCH: 1085/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:34:38)   --> TIME: 2023-10-20 13:35:03 -- STEP: 29/50 -- GLOBAL_STEP: 107280 | > loss_disc: 3.025198459625244 (2.5907199095035423) | > loss_disc_real_0: 0.17268291115760803 (0.144898239330485) | > loss_disc_real_1: 0.24124008417129517 (0.23296713751965556) | > loss_disc_real_2: 0.20958517491817474 (0.22747495757608577) | > loss_disc_real_3: 0.2570624351501465 (0.23618093646805863) | > loss_disc_real_4: 0.3713728189468384 (0.2652622469026467) | > loss_disc_real_5: 0.4183206558227539 (0.25221484193000304) | > loss_0: 3.025198459625244 (2.5907199095035423) | > grad_norm_0: tensor(427.8491, device='cuda:0') (tensor(624.4492, device='cuda:0')) | > loss_gen: 1.8786401748657227 (2.191142830355413) | > loss_kl: 0.8356204628944397 (0.8771908242126991) | > loss_feat: 4.02503776550293 (5.484972629567673) | > loss_mel: 17.458389282226562 (19.98830574545367) | > loss_duration: 1.3423418998718262 (1.349677895677501) | > loss_1: 25.54003143310547 (29.891290237163677) | > grad_norm_1: tensor(12282.9131, device='cuda:0') (tensor(15811.7822, device='cuda:0')) | > current_lr_0: 6.757577415941975e-05 | > current_lr_1: 6.757577415941975e-05 | > step_time: 0.8306 (0.6446052584154852) | > loader_time: 0.0262 (0.020555627757105333)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.764441967010498 (2.764441967010498) | > loss_disc_real_0: 0.15766017138957977 (0.15766017138957977) | > loss_disc_real_1: 0.2581724524497986 (0.2581724524497986) | > loss_disc_real_2: 0.2186681479215622 (0.2186681479215622) | > loss_disc_real_3: 0.27269625663757324 (0.27269625663757324) | > loss_disc_real_4: 0.26968324184417725 (0.26968324184417725) | > loss_disc_real_5: 0.27562078833580017 (0.27562078833580017) | > loss_0: 2.764441967010498 (2.764441967010498) | > loss_gen: 1.7235705852508545 (1.7235705852508545) | > loss_kl: 5.900733947753906 (5.900733947753906) | > loss_feat: 0.8205618262290955 (0.8205618262290955) | > loss_mel: 14.059779167175293 (14.059779167175293) | > loss_duration: 3.008932590484619 (3.008932590484619) | > loss_1: 25.51357650756836 (25.51357650756836)  --> STEP: 1 | > loss_disc: 2.533025026321411 (2.533025026321411) | > loss_disc_real_0: 0.35966283082962036 (0.35966283082962036) | > loss_disc_real_1: 0.17707499861717224 (0.17707499861717224) | > loss_disc_real_2: 0.21424256265163422 (0.21424256265163422) | > loss_disc_real_3: 0.10643099993467331 (0.10643099993467331) | > loss_disc_real_4: 0.11378319561481476 (0.11378319561481476) | > loss_disc_real_5: 0.08302309364080429 (0.08302309364080429) | > loss_0: 2.533025026321411 (2.533025026321411) | > loss_gen: 1.9027929306030273 (1.9027929306030273) | > loss_kl: 5.52031135559082 (5.52031135559082) | > loss_feat: 8.101603507995605 (8.101603507995605) | > loss_mel: 24.012727737426758 (24.012727737426758) | > loss_duration: 3.3516411781311035 (3.3516411781311035) | > loss_1: 42.88908004760742 (42.88908004760742)  --> STEP: 2 | > loss_disc: 3.6098387241363525 (3.071431875228882) | > loss_disc_real_0: 0.6353747248649597 (0.49751877784729004) | > loss_disc_real_1: 0.24028974771499634 (0.2086823731660843) | > loss_disc_real_2: 0.48704639077186584 (0.35064447671175003) | > loss_disc_real_3: 0.22645354270935059 (0.16644227132201195) | > loss_disc_real_4: 0.2552717626094818 (0.18452747911214828) | > loss_disc_real_5: 0.365460604429245 (0.22424184903502464) | > loss_0: 3.6098387241363525 (3.071431875228882) | > loss_gen: 1.9885196685791016 (1.9456562995910645) | > loss_kl: 6.063871383666992 (5.792091369628906) | > loss_feat: 6.6395392417907715 (7.3705713748931885) | > loss_mel: 22.93789291381836 (23.47531032562256) | > loss_duration: 3.1858086585998535 (3.2687249183654785) | > loss_1: 40.81563186645508 (41.85235595703125)  --> STEP: 3 | > loss_disc: 2.8200838565826416 (2.9876492023468018) | > loss_disc_real_0: 0.2478460818529129 (0.4142945458491643) | > loss_disc_real_1: 0.30599740147590637 (0.241120715936025) | > loss_disc_real_2: 0.3104417324066162 (0.33724356194337207) | > loss_disc_real_3: 0.29668083786964417 (0.20985512683788934) | > loss_disc_real_4: 0.3678623139858246 (0.24563909073670706) | > loss_disc_real_5: 0.2554009258747101 (0.23462820798158646) | > loss_0: 2.8200838565826416 (2.9876492023468018) | > loss_gen: 2.3428587913513184 (2.078057130177816) | > loss_kl: 2.5275275707244873 (4.703903436660767) | > loss_feat: 4.474971294403076 (6.405371348063151) | > loss_mel: 25.381977081298828 (24.11086591084798) | > loss_duration: 3.0243918895721436 (3.1872805754343667) | > loss_1: 37.75172424316406 (40.48547871907552) --> EVAL PERFORMANCE | > avg_loader_time: 0.017217715581258137 (-0.004704078038533531) | > avg_loss_disc: 2.9876492023468018 (+0.045198996861775864) | > avg_loss_disc_real_0: 0.4142945458491643 (+0.06365058322747547) | > avg_loss_disc_real_1: 0.241120715936025 (-0.061781654755274446) | > avg_loss_disc_real_2: 0.33724356194337207 (+0.061997974912325504) | > avg_loss_disc_real_3: 0.20985512683788934 (-0.02038936565319699) | > avg_loss_disc_real_4: 0.24563909073670706 (+0.0030769556760787964) | > avg_loss_disc_real_5: 0.23462820798158646 (-0.10714052369197208) | > avg_loss_0: 2.9876492023468018 (+0.045198996861775864) | > avg_loss_gen: 2.078057130177816 (-0.05959363778432181) | > avg_loss_kl: 4.703903436660767 (+0.1771240234375) | > avg_loss_feat: 6.405371348063151 (+2.711018318931262) | > avg_loss_mel: 24.11086591084798 (+10.712420145670572) | > avg_loss_duration: 3.1872805754343667 (+0.011921087900797378) | > avg_loss_1: 40.48547871907552 (+13.552891095479332)  > EPOCH: 1086/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:35:33)   --> TIME: 2023-10-20 13:35:43 -- STEP: 9/50 -- GLOBAL_STEP: 107310 | > loss_disc: 2.005593776702881 (2.3659594853719077) | > loss_disc_real_0: 0.05906686931848526 (0.1653582908006178) | > loss_disc_real_1: 0.26193612813949585 (0.20054398973782858) | > loss_disc_real_2: 0.3314117193222046 (0.223503934012519) | > loss_disc_real_3: 0.3410851061344147 (0.20713342684838507) | > loss_disc_real_4: 0.14407560229301453 (0.18567677152653536) | > loss_disc_real_5: 0.1707572191953659 (0.21932916922701728) | > loss_0: 2.005593776702881 (2.3659594853719077) | > grad_norm_0: tensor(290.3069, device='cuda:0') (tensor(460.8507, device='cuda:0')) | > loss_gen: 3.17682147026062 (2.3544803195529513) | > loss_kl: 0.9965029358863831 (0.8087547587023841) | > loss_feat: 7.272875785827637 (6.730939202838474) | > loss_mel: 19.94197654724121 (19.787466128667194) | > loss_duration: 1.3484864234924316 (1.3565997150209215) | > loss_1: 32.736663818359375 (31.03824053870307) | > grad_norm_1: tensor(12507.1943, device='cuda:0') (tensor(15839.0088, device='cuda:0')) | > current_lr_0: 6.750822794227156e-05 | > current_lr_1: 6.750822794227156e-05 | > step_time: 0.958 (0.5064406659868028) | > loader_time: 0.0123 (0.012068006727430556)  --> TIME: 2023-10-20 13:36:02 -- STEP: 39/50 -- GLOBAL_STEP: 107340 | > loss_disc: 2.0821566581726074 (2.4632362677500796) | > loss_disc_real_0: 0.061092961579561234 (0.15206409740046814) | > loss_disc_real_1: 0.23361101746559143 (0.22185444239622507) | > loss_disc_real_2: 0.14041973650455475 (0.22100861122210821) | > loss_disc_real_3: 0.1425596922636032 (0.23407319331398377) | > loss_disc_real_4: 0.2777007818222046 (0.23631301727623516) | > loss_disc_real_5: 0.2652205526828766 (0.23236080168340445) | > loss_0: 2.0821566581726074 (2.4632362677500796) | > grad_norm_0: tensor(390.5814, device='cuda:0') (tensor(590.8938, device='cuda:0')) | > loss_gen: 2.593468189239502 (2.2813649636048536) | > loss_kl: 0.29968270659446716 (0.8086105340805191) | > loss_feat: 5.601465702056885 (5.710610951750706) | > loss_mel: 21.955869674682617 (20.68565133596078) | > loss_duration: 1.34424889087677 (1.3411828829691959) | > loss_1: 31.794734954833984 (30.827420650384365) | > grad_norm_1: tensor(9987.1338, device='cuda:0') (tensor(12824.5771, device='cuda:0')) | > current_lr_0: 6.750822794227156e-05 | > current_lr_1: 6.750822794227156e-05 | > step_time: 0.5539 (0.5905994207431109) | > loader_time: 0.0027 (0.01745153696109087)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8865013122558594 (2.8865013122558594) | > loss_disc_real_0: 0.3324616849422455 (0.3324616849422455) | > loss_disc_real_1: 0.26142942905426025 (0.26142942905426025) | > loss_disc_real_2: 0.25036394596099854 (0.25036394596099854) | > loss_disc_real_3: 0.2358769029378891 (0.2358769029378891) | > loss_disc_real_4: 0.24715359508991241 (0.24715359508991241) | > loss_disc_real_5: 0.27310097217559814 (0.27310097217559814) | > loss_0: 2.8865013122558594 (2.8865013122558594) | > loss_gen: 1.87446928024292 (1.87446928024292) | > loss_kl: 6.6416335105896 (6.6416335105896) | > loss_feat: 0.4795517027378082 (0.4795517027378082) | > loss_mel: 15.853766441345215 (15.853766441345215) | > loss_duration: 3.1046626567840576 (3.1046626567840576) | > loss_1: 27.954084396362305 (27.954084396362305)  --> STEP: 1 | > loss_disc: 2.650824546813965 (2.650824546813965) | > loss_disc_real_0: 0.13909435272216797 (0.13909435272216797) | > loss_disc_real_1: 0.20506630837917328 (0.20506630837917328) | > loss_disc_real_2: 0.19516706466674805 (0.19516706466674805) | > loss_disc_real_3: 0.25996720790863037 (0.25996720790863037) | > loss_disc_real_4: 0.2606724500656128 (0.2606724500656128) | > loss_disc_real_5: 0.2746386229991913 (0.2746386229991913) | > loss_0: 2.650824546813965 (2.650824546813965) | > loss_gen: 1.7651197910308838 (1.7651197910308838) | > loss_kl: 5.562480449676514 (5.562480449676514) | > loss_feat: 1.1662683486938477 (1.1662683486938477) | > loss_mel: 20.699142456054688 (20.699142456054688) | > loss_duration: 3.4599881172180176 (3.4599881172180176) | > loss_1: 32.65299987792969 (32.65299987792969)  --> STEP: 2 | > loss_disc: 2.9841973781585693 (2.817510962486267) | > loss_disc_real_0: 0.3395698666572571 (0.23933210968971252) | > loss_disc_real_1: 0.25897416472435 (0.23202023655176163) | > loss_disc_real_2: 0.25186944007873535 (0.2235182523727417) | > loss_disc_real_3: 0.23251278698444366 (0.24623999744653702) | > loss_disc_real_4: 0.24714398384094238 (0.2539082169532776) | > loss_disc_real_5: 0.27292728424072266 (0.27378295361995697) | > loss_0: 2.9841973781585693 (2.817510962486267) | > loss_gen: 1.653449535369873 (1.7092846632003784) | > loss_kl: 5.448866844177246 (5.50567364692688) | > loss_feat: 0.1026935875415802 (0.6344809681177139) | > loss_mel: 9.132560729980469 (14.915851593017578) | > loss_duration: 3.207577705383301 (3.333782911300659) | > loss_1: 19.545146942138672 (26.09907341003418)  --> STEP: 3 | > loss_disc: 3.2388243675231934 (2.9579487641652427) | > loss_disc_real_0: 0.48901039361953735 (0.3225582043329875) | > loss_disc_real_1: 0.30661872029304504 (0.2568863977988561) | > loss_disc_real_2: 0.33536481857299805 (0.26080044110616046) | > loss_disc_real_3: 0.28566694259643555 (0.2593823124965032) | > loss_disc_real_4: 0.33350205421447754 (0.28043949604034424) | > loss_disc_real_5: 0.33654043078422546 (0.29470211267471313) | > loss_0: 3.2388243675231934 (2.9579487641652427) | > loss_gen: 2.3058295249938965 (1.9081329504648845) | > loss_kl: 2.6554670333862305 (4.555604775746663) | > loss_feat: 2.4833076000213623 (1.2507565120855968) | > loss_mel: 18.358139038085938 (16.0632807413737) | > loss_duration: 3.0498368740081787 (3.2391342322031655) | > loss_1: 28.852581024169922 (27.01690928141276) --> EVAL PERFORMANCE | > avg_loader_time: 0.01203616460164388 (-0.005181550979614256) | > avg_loss_disc: 2.9579487641652427 (-0.029700438181559097) | > avg_loss_disc_real_0: 0.3225582043329875 (-0.09173634151617682) | > avg_loss_disc_real_1: 0.2568863977988561 (+0.015765681862831088) | > avg_loss_disc_real_2: 0.26080044110616046 (-0.07644312083721161) | > avg_loss_disc_real_3: 0.2593823124965032 (+0.04952718565861383) | > avg_loss_disc_real_4: 0.28043949604034424 (+0.03480040530363718) | > avg_loss_disc_real_5: 0.29470211267471313 (+0.06007390469312668) | > avg_loss_0: 2.9579487641652427 (-0.029700438181559097) | > avg_loss_gen: 1.9081329504648845 (-0.1699241797129314) | > avg_loss_kl: 4.555604775746663 (-0.1482986609141035) | > avg_loss_feat: 1.2507565120855968 (-5.154614835977554) | > avg_loss_mel: 16.0632807413737 (-8.047585169474281) | > avg_loss_duration: 3.2391342322031655 (+0.05185365676879883) | > avg_loss_1: 27.01690928141276 (-13.468569437662762)  > EPOCH: 1087/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:36:19)   --> TIME: 2023-10-20 13:36:36 -- STEP: 19/50 -- GLOBAL_STEP: 107370 | > loss_disc: 3.018296480178833 (2.3134614480169198) | > loss_disc_real_0: 0.26103675365448 (0.1290068703850633) | > loss_disc_real_1: 0.22503161430358887 (0.21527501234882757) | > loss_disc_real_2: 0.24004477262496948 (0.22031769587805397) | > loss_disc_real_3: 0.24432583153247833 (0.22939150192235647) | > loss_disc_real_4: 0.2558741271495819 (0.21561109215805405) | > loss_disc_real_5: 0.25027692317962646 (0.21414815815851876) | > loss_0: 3.018296480178833 (2.3134614480169198) | > grad_norm_0: tensor(650.7292, device='cuda:0') (tensor(517.5487, device='cuda:0')) | > loss_gen: 1.453920602798462 (2.4306672748766447) | > loss_kl: 0.8879145383834839 (0.8530176281929016) | > loss_feat: 0.02362782135605812 (6.2414654279617885) | > loss_mel: 0.9432929158210754 (20.38242251308341) | > loss_duration: 1.4653345346450806 (1.375382053224664) | > loss_1: 4.77409029006958 (31.282955244967813) | > grad_norm_1: tensor(82436.0547, device='cuda:0') (tensor(27694.7246, device='cuda:0')) | > current_lr_0: 6.744074924179643e-05 | > current_lr_1: 6.744074924179643e-05 | > step_time: 0.3441 (0.5888853951504356) | > loader_time: 0.0134 (0.02057395483318128)  --> TIME: 2023-10-20 13:36:48 -- STEP: 49/50 -- GLOBAL_STEP: 107400 | > loss_disc: 2.1964876651763916 (2.422021350082086) | > loss_disc_real_0: 0.07141570746898651 (0.13487156037697387) | > loss_disc_real_1: 0.198750838637352 (0.2238638102248007) | > loss_disc_real_2: 0.13751600682735443 (0.21323054511936343) | > loss_disc_real_3: 0.1988292932510376 (0.2369671493996771) | > loss_disc_real_4: 0.05486543849110603 (0.2178743908523905) | > loss_disc_real_5: 0.10108467191457748 (0.2341639020822334) | > loss_0: 2.1964876651763916 (2.422021350082086) | > grad_norm_0: tensor(1159.1910, device='cuda:0') (tensor(581.8097, device='cuda:0')) | > loss_gen: 2.16365385055542 (2.344707007310828) | > loss_kl: 0.6919159293174744 (0.7937195228070627) | > loss_feat: 8.067473411560059 (6.163024117980076) | > loss_mel: 25.70307731628418 (20.968975837133367) | > loss_duration: 1.4967914819717407 (1.3509406556888497) | > loss_1: 38.1229133605957 (31.621367386409215) | > grad_norm_1: tensor(16721.2852, device='cuda:0') (tensor(21837.0957, device='cuda:0')) | > current_lr_0: 6.744074924179643e-05 | > current_lr_1: 6.744074924179643e-05 | > step_time: 0.3327 (0.4680338587079729) | > loader_time: 0.3982 (0.02016007170385244)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9025449752807617 (2.9025449752807617) | > loss_disc_real_0: 0.15279178321361542 (0.15279178321361542) | > loss_disc_real_1: 0.29936936497688293 (0.29936936497688293) | > loss_disc_real_2: 0.42708224058151245 (0.42708224058151245) | > loss_disc_real_3: 0.2339509278535843 (0.2339509278535843) | > loss_disc_real_4: 0.3546926975250244 (0.3546926975250244) | > loss_disc_real_5: 0.48742279410362244 (0.48742279410362244) | > loss_0: 2.9025449752807617 (2.9025449752807617) | > loss_gen: 2.441009521484375 (2.441009521484375) | > loss_kl: 6.690767288208008 (6.690767288208008) | > loss_feat: 7.088233947753906 (7.088233947753906) | > loss_mel: 23.333415985107422 (23.333415985107422) | > loss_duration: 3.038900375366211 (3.038900375366211) | > loss_1: 42.59233093261719 (42.59233093261719)  --> STEP: 1 | > loss_disc: 2.550935745239258 (2.550935745239258) | > loss_disc_real_0: 0.09919548034667969 (0.09919548034667969) | > loss_disc_real_1: 0.20450641214847565 (0.20450641214847565) | > loss_disc_real_2: 0.25437793135643005 (0.25437793135643005) | > loss_disc_real_3: 0.3110475242137909 (0.3110475242137909) | > loss_disc_real_4: 0.1793661266565323 (0.1793661266565323) | > loss_disc_real_5: 0.24996525049209595 (0.24996525049209595) | > loss_0: 2.550935745239258 (2.550935745239258) | > loss_gen: 2.1548221111297607 (2.1548221111297607) | > loss_kl: 5.761163711547852 (5.761163711547852) | > loss_feat: 8.226737976074219 (8.226737976074219) | > loss_mel: 21.937252044677734 (21.937252044677734) | > loss_duration: 3.3936028480529785 (3.3936028480529785) | > loss_1: 41.47358322143555 (41.47358322143555)  --> STEP: 2 | > loss_disc: 3.0833890438079834 (2.8171623945236206) | > loss_disc_real_0: 0.29977142810821533 (0.1994834542274475) | > loss_disc_real_1: 0.3359055817127228 (0.2702059969305992) | > loss_disc_real_2: 0.3379475474357605 (0.2961627393960953) | > loss_disc_real_3: 0.40070047974586487 (0.3558740019798279) | > loss_disc_real_4: 0.33905094861984253 (0.2592085376381874) | > loss_disc_real_5: 0.48275476694107056 (0.36636000871658325) | > loss_0: 3.0833890438079834 (2.8171623945236206) | > loss_gen: 2.461150884628296 (2.3079864978790283) | > loss_kl: 5.824531555175781 (5.792847633361816) | > loss_feat: 4.659553050994873 (6.443145513534546) | > loss_mel: 27.557130813598633 (24.747191429138184) | > loss_duration: 3.1941914558410645 (3.2938971519470215) | > loss_1: 43.696556091308594 (42.58506965637207)  --> STEP: 3 | > loss_disc: 2.866821050643921 (2.833715279897054) | > loss_disc_real_0: 0.1310817152261734 (0.17668287456035614) | > loss_disc_real_1: 0.28948137164115906 (0.27663112183411914) | > loss_disc_real_2: 0.2740723192691803 (0.28879926602045697) | > loss_disc_real_3: 0.28627631068229675 (0.3326747715473175) | > loss_disc_real_4: 0.24759089946746826 (0.255335991581281) | > loss_disc_real_5: 0.316197007894516 (0.34963900844256085) | > loss_0: 2.866821050643921 (2.833715279897054) | > loss_gen: 1.6997766494750977 (2.1052498817443848) | > loss_kl: 2.6633546352386475 (4.749683300654094) | > loss_feat: 0.5285934805870056 (4.471628169218699) | > loss_mel: 15.799947738647461 (21.764776865641277) | > loss_duration: 2.9772284030914307 (3.188340902328491) | > loss_1: 23.668901443481445 (36.279680252075195) --> EVAL PERFORMANCE | > avg_loader_time: 0.032874743143717446 (+0.020838578542073563) | > avg_loss_disc: 2.833715279897054 (-0.12423348426818848) | > avg_loss_disc_real_0: 0.17668287456035614 (-0.14587532977263135) | > avg_loss_disc_real_1: 0.27663112183411914 (+0.01974472403526306) | > avg_loss_disc_real_2: 0.28879926602045697 (+0.027998824914296505) | > avg_loss_disc_real_3: 0.3326747715473175 (+0.07329245905081433) | > avg_loss_disc_real_4: 0.255335991581281 (-0.02510350445906323) | > avg_loss_disc_real_5: 0.34963900844256085 (+0.054936895767847715) | > avg_loss_0: 2.833715279897054 (-0.12423348426818848) | > avg_loss_gen: 2.1052498817443848 (+0.19711693127950025) | > avg_loss_kl: 4.749683300654094 (+0.1940785249074306) | > avg_loss_feat: 4.471628169218699 (+3.2208716571331024) | > avg_loss_mel: 21.764776865641277 (+5.701496124267578) | > avg_loss_duration: 3.188340902328491 (-0.05079332987467433) | > avg_loss_1: 36.279680252075195 (+9.262770970662434)  > EPOCH: 1088/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:37:10)   --> TIME: 2023-10-20 13:37:35 -- STEP: 29/50 -- GLOBAL_STEP: 107430 | > loss_disc: 2.54768967628479 (2.5658480586676764) | > loss_disc_real_0: 0.15547621250152588 (0.17702553168356674) | > loss_disc_real_1: 0.14937874674797058 (0.23993751689277845) | > loss_disc_real_2: 0.22606812417507172 (0.22480079788586188) | > loss_disc_real_3: 0.2679538428783417 (0.24956042833369352) | > loss_disc_real_4: 0.3688170909881592 (0.24431917276875725) | > loss_disc_real_5: 0.2755003273487091 (0.23570254946063304) | > loss_0: 2.54768967628479 (2.5658480586676764) | > grad_norm_0: tensor(266.7434, device='cuda:0') (tensor(584.1381, device='cuda:0')) | > loss_gen: 2.2535886764526367 (2.294397530884579) | > loss_kl: 0.8069239854812622 (0.7856252244834242) | > loss_feat: 4.6727142333984375 (6.196381765192952) | > loss_mel: 20.327775955200195 (21.81290807395146) | > loss_duration: 1.3706903457641602 (1.3660572931684296) | > loss_1: 29.43169403076172 (32.45537040973532) | > grad_norm_1: tensor(4325.0024, device='cuda:0') (tensor(22333.2129, device='cuda:0')) | > current_lr_0: 6.737333799050723e-05 | > current_lr_1: 6.737333799050723e-05 | > step_time: 0.4783 (0.6571131821336418) | > loader_time: 0.0071 (0.02008326300259294)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9100229740142822 (2.9100229740142822) | > loss_disc_real_0: 0.4356996715068817 (0.4356996715068817) | > loss_disc_real_1: 0.15982045233249664 (0.15982045233249664) | > loss_disc_real_2: 0.24024219810962677 (0.24024219810962677) | > loss_disc_real_3: 0.3279102146625519 (0.3279102146625519) | > loss_disc_real_4: 0.14371280372142792 (0.14371280372142792) | > loss_disc_real_5: 0.28351423144340515 (0.28351423144340515) | > loss_0: 2.9100229740142822 (2.9100229740142822) | > loss_gen: 2.023357629776001 (2.023357629776001) | > loss_kl: 6.501001834869385 (6.501001834869385) | > loss_feat: 5.174415111541748 (5.174415111541748) | > loss_mel: 21.32033920288086 (21.32033920288086) | > loss_duration: 3.004995107650757 (3.004995107650757) | > loss_1: 38.02410888671875 (38.02410888671875)  --> STEP: 1 | > loss_disc: 1.8727099895477295 (1.8727099895477295) | > loss_disc_real_0: 0.07826562225818634 (0.07826562225818634) | > loss_disc_real_1: 0.07451868057250977 (0.07451868057250977) | > loss_disc_real_2: 0.1520446240901947 (0.1520446240901947) | > loss_disc_real_3: 0.0678430125117302 (0.0678430125117302) | > loss_disc_real_4: 0.017306622117757797 (0.017306622117757797) | > loss_disc_real_5: 0.07722488790750504 (0.07722488790750504) | > loss_0: 1.8727099895477295 (1.8727099895477295) | > loss_gen: 2.14163875579834 (2.14163875579834) | > loss_kl: 5.886595249176025 (5.886595249176025) | > loss_feat: 11.9530611038208 (11.9530611038208) | > loss_mel: 24.3709659576416 (24.3709659576416) | > loss_duration: 3.305795669555664 (3.305795669555664) | > loss_1: 47.658058166503906 (47.658058166503906)  --> STEP: 2 | > loss_disc: 3.053767681121826 (2.463238835334778) | > loss_disc_real_0: 0.49585527181625366 (0.28706044703722) | > loss_disc_real_1: 0.25873762369155884 (0.1666281521320343) | > loss_disc_real_2: 0.2522607147693634 (0.20215266942977905) | > loss_disc_real_3: 0.2688852548599243 (0.16836413368582726) | > loss_disc_real_4: 0.27667298913002014 (0.14698980562388897) | > loss_disc_real_5: 0.28891611099243164 (0.18307049944996834) | > loss_0: 3.053767681121826 (2.463238835334778) | > loss_gen: 1.9317679405212402 (2.03670334815979) | > loss_kl: 5.5861310958862305 (5.736363172531128) | > loss_feat: 0.14737260341644287 (6.050216853618622) | > loss_mel: 9.266924858093262 (16.81894540786743) | > loss_duration: 3.0867257118225098 (3.196260690689087) | > loss_1: 20.018922805786133 (33.83849048614502)  --> STEP: 3 | > loss_disc: 2.9710850715637207 (2.632520914077759) | > loss_disc_real_0: 0.5499167442321777 (0.37467921276887256) | > loss_disc_real_1: 0.3052160441875458 (0.21282411615053812) | > loss_disc_real_2: 0.2195572704076767 (0.20795420308907828) | > loss_disc_real_3: 0.2911544144153595 (0.209294227262338) | > loss_disc_real_4: 0.2869691252708435 (0.19364957883954048) | > loss_disc_real_5: 0.269927054643631 (0.21202268451452255) | > loss_0: 2.9710850715637207 (2.632520914077759) | > loss_gen: 2.421137571334839 (2.1648480892181396) | > loss_kl: 2.289508581161499 (4.587411642074585) | > loss_feat: 1.6419780254364014 (4.580803910891215) | > loss_mel: 21.188417434692383 (18.27543608347575) | > loss_duration: 3.0353827476501465 (3.142634709676107) | > loss_1: 30.57642364501953 (32.75113487243652) --> EVAL PERFORMANCE | > avg_loader_time: 0.006598949432373047 (-0.0262757937113444) | > avg_loss_disc: 2.632520914077759 (-0.2011943658192954) | > avg_loss_disc_real_0: 0.37467921276887256 (+0.19799633820851642) | > avg_loss_disc_real_1: 0.21282411615053812 (-0.06380700568358103) | > avg_loss_disc_real_2: 0.20795420308907828 (-0.08084506293137869) | > avg_loss_disc_real_3: 0.209294227262338 (-0.1233805442849795) | > avg_loss_disc_real_4: 0.19364957883954048 (-0.061686412741740526) | > avg_loss_disc_real_5: 0.21202268451452255 (-0.1376163239280383) | > avg_loss_0: 2.632520914077759 (-0.2011943658192954) | > avg_loss_gen: 2.1648480892181396 (+0.05959820747375488) | > avg_loss_kl: 4.587411642074585 (-0.16227165857950876) | > avg_loss_feat: 4.580803910891215 (+0.10917574167251587) | > avg_loss_mel: 18.27543608347575 (-3.4893407821655273) | > avg_loss_duration: 3.142634709676107 (-0.04570619265238429) | > avg_loss_1: 32.75113487243652 (-3.528545379638672)  > EPOCH: 1089/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:38:00)   --> TIME: 2023-10-20 13:38:12 -- STEP: 9/50 -- GLOBAL_STEP: 107460 | > loss_disc: 2.301950454711914 (2.338228623072306) | > loss_disc_real_0: 0.069157175719738 (0.19120431111918557) | > loss_disc_real_1: 0.3261587619781494 (0.20458598186572394) | > loss_disc_real_2: 0.28694990277290344 (0.19766562059521675) | > loss_disc_real_3: 0.25616297125816345 (0.2022535221444236) | > loss_disc_real_4: 0.21914099156856537 (0.20985167370074326) | > loss_disc_real_5: 0.24290458858013153 (0.23174890958600575) | > loss_0: 2.301950454711914 (2.338228623072306) | > grad_norm_0: tensor(253.9733, device='cuda:0') (tensor(460.7060, device='cuda:0')) | > loss_gen: 2.468522071838379 (2.418309463395013) | > loss_kl: 0.8267298936843872 (0.8138591183556451) | > loss_feat: 4.719695091247559 (6.99829347928365) | > loss_mel: 20.145530700683594 (22.13851186964247) | > loss_duration: 1.334639549255371 (1.3349220355351765) | > loss_1: 29.4951171875 (33.70389599270291) | > grad_norm_1: tensor(6596.4160, device='cuda:0') (tensor(25848.6719, device='cuda:0')) | > current_lr_0: 6.730599412098427e-05 | > current_lr_1: 6.730599412098427e-05 | > step_time: 0.4998 (0.7298857371012369) | > loader_time: 0.0158 (0.0289107428656684)  --> TIME: 2023-10-20 13:38:28 -- STEP: 39/50 -- GLOBAL_STEP: 107490 | > loss_disc: 1.8363786935806274 (2.477014217621241) | > loss_disc_real_0: 0.14160272479057312 (0.18019391109163946) | > loss_disc_real_1: 0.2027578204870224 (0.22031199358976805) | > loss_disc_real_2: 0.15752430260181427 (0.22077655992828882) | > loss_disc_real_3: 0.16053053736686707 (0.23155590099019882) | > loss_disc_real_4: 0.11062155663967133 (0.20872173014168555) | > loss_disc_real_5: 0.07048995047807693 (0.20863914336913672) | > loss_0: 1.8363786935806274 (2.477014217621241) | > grad_norm_0: tensor(479.7809, device='cuda:0') (tensor(673.5998, device='cuda:0')) | > loss_gen: 2.6831421852111816 (2.218588367486612) | > loss_kl: 0.3648039698600769 (0.8154445359340081) | > loss_feat: 6.302718162536621 (5.823039759332552) | > loss_mel: 14.69819164276123 (20.32590540555807) | > loss_duration: 1.385841727256775 (1.3434901115221856) | > loss_1: 25.434696197509766 (30.52646841147007) | > grad_norm_1: tensor(22329.3809, device='cuda:0') (tensor(22552.3203, device='cuda:0')) | > current_lr_0: 6.730599412098427e-05 | > current_lr_1: 6.730599412098427e-05 | > step_time: 0.8199 (0.5577388604482015) | > loader_time: 0.022 (0.01813063866052872)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1708929538726807 (3.1708929538726807) | > loss_disc_real_0: 0.17114326357841492 (0.17114326357841492) | > loss_disc_real_1: 0.19311805069446564 (0.19311805069446564) | > loss_disc_real_2: 0.24368245899677277 (0.24368245899677277) | > loss_disc_real_3: 0.35068279504776 (0.35068279504776) | > loss_disc_real_4: 0.3845161199569702 (0.3845161199569702) | > loss_disc_real_5: 0.3466092646121979 (0.3466092646121979) | > loss_0: 3.1708929538726807 (3.1708929538726807) | > loss_gen: 1.8499622344970703 (1.8499622344970703) | > loss_kl: 6.1211347579956055 (6.1211347579956055) | > loss_feat: 6.629147529602051 (6.629147529602051) | > loss_mel: 23.9140682220459 (23.9140682220459) | > loss_duration: 3.0860607624053955 (3.0860607624053955) | > loss_1: 41.600372314453125 (41.600372314453125)  --> STEP: 1 | > loss_disc: 2.669201374053955 (2.669201374053955) | > loss_disc_real_0: 0.2055078148841858 (0.2055078148841858) | > loss_disc_real_1: 0.2349204421043396 (0.2349204421043396) | > loss_disc_real_2: 0.3370012938976288 (0.3370012938976288) | > loss_disc_real_3: 0.2143132984638214 (0.2143132984638214) | > loss_disc_real_4: 0.2455580234527588 (0.2455580234527588) | > loss_disc_real_5: 0.19880640506744385 (0.19880640506744385) | > loss_0: 2.669201374053955 (2.669201374053955) | > loss_gen: 1.9985580444335938 (1.9985580444335938) | > loss_kl: 5.783130645751953 (5.783130645751953) | > loss_feat: 7.100151538848877 (7.100151538848877) | > loss_mel: 22.15196990966797 (22.15196990966797) | > loss_duration: 3.409357786178589 (3.409357786178589) | > loss_1: 40.44316864013672 (40.44316864013672)  --> STEP: 2 | > loss_disc: 2.941545248031616 (2.8053733110427856) | > loss_disc_real_0: 0.24393922090530396 (0.22472351789474487) | > loss_disc_real_1: 0.2561362385749817 (0.24552834033966064) | > loss_disc_real_2: 0.2575019598007202 (0.2972516268491745) | > loss_disc_real_3: 0.2701881527900696 (0.2422507256269455) | > loss_disc_real_4: 0.27565526962280273 (0.26060664653778076) | > loss_disc_real_5: 0.2596907317638397 (0.22924856841564178) | > loss_0: 2.941545248031616 (2.8053733110427856) | > loss_gen: 1.6407827138900757 (1.8196703791618347) | > loss_kl: 5.409285545349121 (5.596208095550537) | > loss_feat: 0.32643207907676697 (3.713291808962822) | > loss_mel: 8.15161418914795 (15.151792049407959) | > loss_duration: 3.173276901245117 (3.291317343711853) | > loss_1: 18.701391220092773 (29.572279930114746)  --> STEP: 3 | > loss_disc: 2.591160774230957 (2.7339691321055093) | > loss_disc_real_0: 0.19303026795387268 (0.21415910124778748) | > loss_disc_real_1: 0.24438560009002686 (0.24514742692311606) | > loss_disc_real_2: 0.21423478424549103 (0.26957934598128) | > loss_disc_real_3: 0.2694711685180664 (0.25132420659065247) | > loss_disc_real_4: 0.3142569065093994 (0.2784900665283203) | > loss_disc_real_5: 0.29698893427848816 (0.2518286903699239) | > loss_0: 2.591160774230957 (2.7339691321055093) | > loss_gen: 2.153749942779541 (1.93103023370107) | > loss_kl: 2.9467976093292236 (4.7130712668101) | > loss_feat: 2.4159488677978516 (3.2808441619078317) | > loss_mel: 19.868824005126953 (16.724136034647625) | > loss_duration: 3.0435218811035156 (3.2087188561757407) | > loss_1: 30.428842544555664 (29.85780080159505) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026503403981526694 (-0.003948609034220377) | > avg_loss_disc: 2.7339691321055093 (+0.1014482180277505) | > avg_loss_disc_real_0: 0.21415910124778748 (-0.16052011152108508) | > avg_loss_disc_real_1: 0.24514742692311606 (+0.03232331077257794) | > avg_loss_disc_real_2: 0.26957934598128 (+0.06162514289220175) | > avg_loss_disc_real_3: 0.25132420659065247 (+0.042029979328314454) | > avg_loss_disc_real_4: 0.2784900665283203 (+0.08484048768877983) | > avg_loss_disc_real_5: 0.2518286903699239 (+0.03980600585540134) | > avg_loss_0: 2.7339691321055093 (+0.1014482180277505) | > avg_loss_gen: 1.93103023370107 (-0.23381785551706957) | > avg_loss_kl: 4.7130712668101 (+0.12565962473551462) | > avg_loss_feat: 3.2808441619078317 (-1.2999597489833836) | > avg_loss_mel: 16.724136034647625 (-1.551300048828125) | > avg_loss_duration: 3.2087188561757407 (+0.06608414649963379) | > avg_loss_1: 29.85780080159505 (-2.8933340708414725)  > EPOCH: 1090/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:38:51)   --> TIME: 2023-10-20 13:39:08 -- STEP: 19/50 -- GLOBAL_STEP: 107520 | > loss_disc: 1.337371587753296 (2.544206694552773) | > loss_disc_real_0: 0.021120265126228333 (0.1566727138859661) | > loss_disc_real_1: 0.062303826212882996 (0.22204138299352244) | > loss_disc_real_2: 0.11871813237667084 (0.23532322715771825) | > loss_disc_real_3: 0.08780954033136368 (0.24305744037816399) | > loss_disc_real_4: 0.1091349795460701 (0.24288644288715563) | > loss_disc_real_5: 0.0269323717802763 (0.21595634392609722) | > loss_0: 1.337371587753296 (2.544206694552773) | > grad_norm_0: tensor(306.6596, device='cuda:0') (tensor(711.0732, device='cuda:0')) | > loss_gen: 2.8192739486694336 (2.213852047920227) | > loss_kl: 0.6159325838088989 (0.8179789520800114) | > loss_feat: 11.438372611999512 (5.581336652762012) | > loss_mel: 24.584840774536133 (20.141328824193852) | > loss_duration: 1.4363447427749634 (1.3793725967407227) | > loss_1: 40.8947639465332 (30.13386889507896) | > grad_norm_1: tensor(9982.8789, device='cuda:0') (tensor(15353.5264, device='cuda:0')) | > current_lr_0: 6.723871756587527e-05 | > current_lr_1: 6.723871756587527e-05 | > step_time: 0.441 (0.6157557964324951) | > loader_time: 0.0023 (0.022674046064677992)  --> TIME: 2023-10-20 13:39:25 -- STEP: 49/50 -- GLOBAL_STEP: 107550 | > loss_disc: 2.622798204421997 (2.568064964547449) | > loss_disc_real_0: 0.04642533138394356 (0.1656510586261141) | > loss_disc_real_1: 0.2587216794490814 (0.22908335452785297) | > loss_disc_real_2: 0.15896180272102356 (0.23429162199704015) | > loss_disc_real_3: 0.2005973905324936 (0.25081209093332285) | > loss_disc_real_4: 0.4155777096748352 (0.24189091880558705) | > loss_disc_real_5: 0.39007067680358887 (0.24118497196052754) | > loss_0: 2.622798204421997 (2.568064964547449) | > grad_norm_0: tensor(1223.5470, device='cuda:0') (tensor(748.2222, device='cuda:0')) | > loss_gen: 2.5057759284973145 (2.2403775088641114) | > loss_kl: 0.403322696685791 (0.8008910660080764) | > loss_feat: 8.584162712097168 (5.440886306196299) | > loss_mel: 26.309236526489258 (20.208744413998662) | > loss_duration: 1.455962061882019 (1.3475866561033287) | > loss_1: 39.258460998535156 (30.038485848173803) | > grad_norm_1: tensor(33525.9609, device='cuda:0') (tensor(16931.2109, device='cuda:0')) | > current_lr_0: 6.723871756587527e-05 | > current_lr_1: 6.723871756587527e-05 | > step_time: 0.8222 (0.565343443228274) | > loader_time: 0.4234 (0.027829608138726685)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.784902572631836 (2.784902572631836) | > loss_disc_real_0: 0.23779866099357605 (0.23779866099357605) | > loss_disc_real_1: 0.19436515867710114 (0.19436515867710114) | > loss_disc_real_2: 0.20018477737903595 (0.20018477737903595) | > loss_disc_real_3: 0.2548263669013977 (0.2548263669013977) | > loss_disc_real_4: 0.31158941984176636 (0.31158941984176636) | > loss_disc_real_5: 0.32479327917099 (0.32479327917099) | > loss_0: 2.784902572631836 (2.784902572631836) | > loss_gen: 1.8415802717208862 (1.8415802717208862) | > loss_kl: 5.840180397033691 (5.840180397033691) | > loss_feat: 1.8562175035476685 (1.8562175035476685) | > loss_mel: 18.656522750854492 (18.656522750854492) | > loss_duration: 3.029277801513672 (3.029277801513672) | > loss_1: 31.223777770996094 (31.223777770996094)  --> STEP: 1 | > loss_disc: 2.377403974533081 (2.377403974533081) | > loss_disc_real_0: 0.23865145444869995 (0.23865145444869995) | > loss_disc_real_1: 0.3199772536754608 (0.3199772536754608) | > loss_disc_real_2: 0.26614218950271606 (0.26614218950271606) | > loss_disc_real_3: 0.28738266229629517 (0.28738266229629517) | > loss_disc_real_4: 0.25377342104911804 (0.25377342104911804) | > loss_disc_real_5: 0.24103394150733948 (0.24103394150733948) | > loss_0: 2.377403974533081 (2.377403974533081) | > loss_gen: 2.845917224884033 (2.845917224884033) | > loss_kl: 5.785065650939941 (5.785065650939941) | > loss_feat: 7.483511924743652 (7.483511924743652) | > loss_mel: 22.451107025146484 (22.451107025146484) | > loss_duration: 3.36108136177063 (3.36108136177063) | > loss_1: 41.92668151855469 (41.92668151855469)  --> STEP: 2 | > loss_disc: 2.735262393951416 (2.5563331842422485) | > loss_disc_real_0: 0.30537036061286926 (0.2720109075307846) | > loss_disc_real_1: 0.19510924816131592 (0.25754325091838837) | > loss_disc_real_2: 0.2541225254535675 (0.2601323574781418) | > loss_disc_real_3: 0.24692289531230927 (0.2671527788043022) | > loss_disc_real_4: 0.21374501287937164 (0.23375921696424484) | > loss_disc_real_5: 0.20855878293514252 (0.224796362221241) | > loss_0: 2.735262393951416 (2.5563331842422485) | > loss_gen: 1.8133389949798584 (2.329628109931946) | > loss_kl: 5.512577533721924 (5.648821592330933) | > loss_feat: 2.209404706954956 (4.846458315849304) | > loss_mel: 8.845333099365234 (15.64822006225586) | > loss_duration: 3.1696150302886963 (3.265348196029663) | > loss_1: 21.550268173217773 (31.73847484588623)  --> STEP: 3 | > loss_disc: 2.7736878395080566 (2.628784735997518) | > loss_disc_real_0: 0.44488245248794556 (0.32963475584983826) | > loss_disc_real_1: 0.3365113139152527 (0.2838659385840098) | > loss_disc_real_2: 0.2561843693256378 (0.25881636142730713) | > loss_disc_real_3: 0.2526085078716278 (0.26230468849341076) | > loss_disc_real_4: 0.2888029217720032 (0.25210711856683093) | > loss_disc_real_5: 0.12361767888069153 (0.19107013444105783) | > loss_0: 2.7736878395080566 (2.628784735997518) | > loss_gen: 2.84468412399292 (2.5013134479522705) | > loss_kl: 2.794328451156616 (4.69732387860616) | > loss_feat: 5.161597728729248 (4.951504786809285) | > loss_mel: 22.49510955810547 (17.930516560872395) | > loss_duration: 2.9508650302886963 (3.1605204741160073) | > loss_1: 36.246585845947266 (33.24117851257324) --> EVAL PERFORMANCE | > avg_loader_time: 0.0091093381245931 (+0.00645899772644043) | > avg_loss_disc: 2.628784735997518 (-0.10518439610799124) | > avg_loss_disc_real_0: 0.32963475584983826 (+0.11547565460205078) | > avg_loss_disc_real_1: 0.2838659385840098 (+0.03871851166089377) | > avg_loss_disc_real_2: 0.25881636142730713 (-0.010762984553972899) | > avg_loss_disc_real_3: 0.26230468849341076 (+0.010980481902758299) | > avg_loss_disc_real_4: 0.25210711856683093 (-0.026382947961489378) | > avg_loss_disc_real_5: 0.19107013444105783 (-0.06075855592886606) | > avg_loss_0: 2.628784735997518 (-0.10518439610799124) | > avg_loss_gen: 2.5013134479522705 (+0.5702832142512004) | > avg_loss_kl: 4.69732387860616 (-0.015747388203939394) | > avg_loss_feat: 4.951504786809285 (+1.6706606249014535) | > avg_loss_mel: 17.930516560872395 (+1.2063805262247698) | > avg_loss_duration: 3.1605204741160073 (-0.04819838205973337) | > avg_loss_1: 33.24117851257324 (+3.3833777109781913)  > EPOCH: 1091/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:39:43)   --> TIME: 2023-10-20 13:40:03 -- STEP: 29/50 -- GLOBAL_STEP: 107580 | > loss_disc: 2.844794988632202 (2.359350849842203) | > loss_disc_real_0: 0.3192277252674103 (0.1423660980152159) | > loss_disc_real_1: 0.2561156451702118 (0.21841365561403078) | > loss_disc_real_2: 0.2193041741847992 (0.21359791478206372) | > loss_disc_real_3: 0.2417386770248413 (0.21382859991542225) | > loss_disc_real_4: 0.2456628829240799 (0.20292611818375259) | > loss_disc_real_5: 0.23397956788539886 (0.2072439120504363) | > loss_0: 2.844794988632202 (2.359350849842203) | > grad_norm_0: tensor(967.8232, device='cuda:0') (tensor(584.2153, device='cuda:0')) | > loss_gen: 1.7282459735870361 (2.304195991877852) | > loss_kl: 0.7515204548835754 (0.7857752940135783) | > loss_feat: 0.5762289762496948 (5.97465664867697) | > loss_mel: 17.457805633544922 (20.04496268568368) | > loss_duration: 1.311830997467041 (1.3678511052296078) | > loss_1: 21.825632095336914 (30.477441425981194) | > grad_norm_1: tensor(8405.7363, device='cuda:0') (tensor(26189.8789, device='cuda:0')) | > current_lr_0: 6.717150825789524e-05 | > current_lr_1: 6.717150825789524e-05 | > step_time: 0.3378 (0.47275026913346924) | > loader_time: 0.0047 (0.016621877407205513)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.601820468902588 (2.601820468902588) | > loss_disc_real_0: 0.210086852312088 (0.210086852312088) | > loss_disc_real_1: 0.2466876208782196 (0.2466876208782196) | > loss_disc_real_2: 0.22691714763641357 (0.22691714763641357) | > loss_disc_real_3: 0.24961401522159576 (0.24961401522159576) | > loss_disc_real_4: 0.3686755299568176 (0.3686755299568176) | > loss_disc_real_5: 0.28543177247047424 (0.28543177247047424) | > loss_0: 2.601820468902588 (2.601820468902588) | > loss_gen: 2.273324489593506 (2.273324489593506) | > loss_kl: 7.117237091064453 (7.117237091064453) | > loss_feat: 3.940359115600586 (3.940359115600586) | > loss_mel: 24.811052322387695 (24.811052322387695) | > loss_duration: 3.047149419784546 (3.047149419784546) | > loss_1: 41.18912124633789 (41.18912124633789)  --> STEP: 1 | > loss_disc: 2.6790528297424316 (2.6790528297424316) | > loss_disc_real_0: 0.29316189885139465 (0.29316189885139465) | > loss_disc_real_1: 0.33041688799858093 (0.33041688799858093) | > loss_disc_real_2: 0.23107850551605225 (0.23107850551605225) | > loss_disc_real_3: 0.2914509177207947 (0.2914509177207947) | > loss_disc_real_4: 0.3494469225406647 (0.3494469225406647) | > loss_disc_real_5: 0.2093559205532074 (0.2093559205532074) | > loss_0: 2.6790528297424316 (2.6790528297424316) | > loss_gen: 2.6808974742889404 (2.6808974742889404) | > loss_kl: 5.924807071685791 (5.924807071685791) | > loss_feat: 6.123220443725586 (6.123220443725586) | > loss_mel: 25.822235107421875 (25.822235107421875) | > loss_duration: 3.3231372833251953 (3.3231372833251953) | > loss_1: 43.874298095703125 (43.874298095703125)  --> STEP: 2 | > loss_disc: 2.7609195709228516 (2.7199862003326416) | > loss_disc_real_0: 0.2711501121520996 (0.28215600550174713) | > loss_disc_real_1: 0.21484579145908356 (0.27263133972883224) | > loss_disc_real_2: 0.23710983991622925 (0.23409417271614075) | > loss_disc_real_3: 0.34140118956565857 (0.3164260536432266) | > loss_disc_real_4: 0.24901635944843292 (0.2992316409945488) | > loss_disc_real_5: 0.3104023337364197 (0.25987912714481354) | > loss_0: 2.7609195709228516 (2.7199862003326416) | > loss_gen: 2.3852007389068604 (2.5330491065979004) | > loss_kl: 6.216822147369385 (6.070814609527588) | > loss_feat: 3.7731547355651855 (4.948187589645386) | > loss_mel: 25.929887771606445 (25.87606143951416) | > loss_duration: 3.153083324432373 (3.238110303878784) | > loss_1: 41.45814895629883 (42.66622352600098)  --> STEP: 3 | > loss_disc: 2.897975444793701 (2.779315948486328) | > loss_disc_real_0: 0.3049725890159607 (0.2897615333398183) | > loss_disc_real_1: 0.2304566353559494 (0.2585731049378713) | > loss_disc_real_2: 0.2725360691547394 (0.24690813819567362) | > loss_disc_real_3: 0.2796185612678528 (0.304156889518102) | > loss_disc_real_4: 0.24492406845092773 (0.2811291168133418) | > loss_disc_real_5: 0.2865934371948242 (0.26878389716148376) | > loss_0: 2.897975444793701 (2.779315948486328) | > loss_gen: 1.832523226737976 (2.2995404799779258) | > loss_kl: 2.917588710784912 (5.019739309946696) | > loss_feat: 0.5294495224952698 (3.475274900595347) | > loss_mel: 16.084230422973633 (22.612117767333984) | > loss_duration: 2.9261388778686523 (3.1341198285420737) | > loss_1: 24.289932250976562 (36.540793100992836) --> EVAL PERFORMANCE | > avg_loader_time: 0.007123152414957683 (-0.001986185709635417) | > avg_loss_disc: 2.779315948486328 (+0.15053121248881007) | > avg_loss_disc_real_0: 0.2897615333398183 (-0.03987322251001996) | > avg_loss_disc_real_1: 0.2585731049378713 (-0.025292833646138546) | > avg_loss_disc_real_2: 0.24690813819567362 (-0.011908223231633513) | > avg_loss_disc_real_3: 0.304156889518102 (+0.04185220102469123) | > avg_loss_disc_real_4: 0.2811291168133418 (+0.02902199824651086) | > avg_loss_disc_real_5: 0.26878389716148376 (+0.07771376272042593) | > avg_loss_0: 2.779315948486328 (+0.15053121248881007) | > avg_loss_gen: 2.2995404799779258 (-0.20177296797434474) | > avg_loss_kl: 5.019739309946696 (+0.3224154313405361) | > avg_loss_feat: 3.475274900595347 (-1.4762298862139382) | > avg_loss_mel: 22.612117767333984 (+4.68160120646159) | > avg_loss_duration: 3.1341198285420737 (-0.026400645573933623) | > avg_loss_1: 36.540793100992836 (+3.299614588419594)  > EPOCH: 1092/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:40:35)   --> TIME: 2023-10-20 13:40:47 -- STEP: 9/50 -- GLOBAL_STEP: 107610 | > loss_disc: 2.5049219131469727 (2.2940522564782038) | > loss_disc_real_0: 0.06791895627975464 (0.1294017694890499) | > loss_disc_real_1: 0.3144407868385315 (0.25570963157547844) | > loss_disc_real_2: 0.21937894821166992 (0.2079691630270746) | > loss_disc_real_3: 0.2990967631340027 (0.2306431850625409) | > loss_disc_real_4: 0.2596120238304138 (0.20988073106855154) | > loss_disc_real_5: 0.24303582310676575 (0.19428407975162068) | > loss_0: 2.5049219131469727 (2.2940522564782038) | > grad_norm_0: tensor(661.6520, device='cuda:0') (tensor(440.6199, device='cuda:0')) | > loss_gen: 2.0681185722351074 (2.335683902104696) | > loss_kl: 0.4694395065307617 (0.9482736322614882) | > loss_feat: 2.2264273166656494 (6.1369152598910865) | > loss_mel: 21.253236770629883 (21.68054665459527) | > loss_duration: 1.3535670042037964 (1.3603373501035902) | > loss_1: 27.370790481567383 (32.461757024129234) | > grad_norm_1: tensor(5524.9971, device='cuda:0') (tensor(9143.6045, device='cuda:0')) | > current_lr_0: 6.710436612982645e-05 | > current_lr_1: 6.710436612982645e-05 | > step_time: 0.2679 (0.6570061577690972) | > loader_time: 0.0026 (0.032364077038235135)  --> TIME: 2023-10-20 13:41:03 -- STEP: 39/50 -- GLOBAL_STEP: 107640 | > loss_disc: 2.900038480758667 (2.5425663850246334) | > loss_disc_real_0: 0.09681813418865204 (0.16601204437514147) | > loss_disc_real_1: 0.25663256645202637 (0.23733072441357833) | > loss_disc_real_2: 0.24602797627449036 (0.22277353818599993) | > loss_disc_real_3: 0.24786284565925598 (0.24686389158551508) | > loss_disc_real_4: 0.24778439104557037 (0.22855983013048387) | > loss_disc_real_5: 0.23592372238636017 (0.2326458734460175) | > loss_0: 2.900038480758667 (2.5425663850246334) | > grad_norm_0: tensor(1443.4924, device='cuda:0') (tensor(642.7397, device='cuda:0')) | > loss_gen: 1.5874022245407104 (2.1354244764034567) | > loss_kl: 1.0230499505996704 (0.8572195309859055) | > loss_feat: 0.6515334844589233 (4.993385111769805) | > loss_mel: 15.906582832336426 (19.10838604890383) | > loss_duration: 1.4162806272506714 (1.3577088576096754) | > loss_1: 20.584848403930664 (28.452123972085808) | > grad_norm_1: tensor(5989.0234, device='cuda:0') (tensor(19278.5234, device='cuda:0')) | > current_lr_0: 6.710436612982645e-05 | > current_lr_1: 6.710436612982645e-05 | > step_time: 0.8136 (0.5599962320083227) | > loader_time: 0.0149 (0.020794183779985476)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.890263080596924 (2.890263080596924) | > loss_disc_real_0: 0.09799988567829132 (0.09799988567829132) | > loss_disc_real_1: 0.1899005025625229 (0.1899005025625229) | > loss_disc_real_2: 0.24067722260951996 (0.24067722260951996) | > loss_disc_real_3: 0.2535549998283386 (0.2535549998283386) | > loss_disc_real_4: 0.24453990161418915 (0.24453990161418915) | > loss_disc_real_5: 0.38956114649772644 (0.38956114649772644) | > loss_0: 2.890263080596924 (2.890263080596924) | > loss_gen: 1.8057106733322144 (1.8057106733322144) | > loss_kl: 6.161867141723633 (6.161867141723633) | > loss_feat: 5.122635364532471 (5.122635364532471) | > loss_mel: 22.23274040222168 (22.23274040222168) | > loss_duration: 2.9392127990722656 (2.9392127990722656) | > loss_1: 38.26216506958008 (38.26216506958008)  --> STEP: 1 | > loss_disc: 2.8696224689483643 (2.8696224689483643) | > loss_disc_real_0: 0.22781360149383545 (0.22781360149383545) | > loss_disc_real_1: 0.20125281810760498 (0.20125281810760498) | > loss_disc_real_2: 0.4107137620449066 (0.4107137620449066) | > loss_disc_real_3: 0.26220670342445374 (0.26220670342445374) | > loss_disc_real_4: 0.260170042514801 (0.260170042514801) | > loss_disc_real_5: 0.35678502917289734 (0.35678502917289734) | > loss_0: 2.8696224689483643 (2.8696224689483643) | > loss_gen: 2.337684154510498 (2.337684154510498) | > loss_kl: 5.130436420440674 (5.130436420440674) | > loss_feat: 7.083955764770508 (7.083955764770508) | > loss_mel: 21.777063369750977 (21.777063369750977) | > loss_duration: 3.3678441047668457 (3.3678441047668457) | > loss_1: 39.696983337402344 (39.696983337402344)  --> STEP: 2 | > loss_disc: 3.0510506629943848 (2.9603365659713745) | > loss_disc_real_0: 0.4260141849517822 (0.32691389322280884) | > loss_disc_real_1: 0.29143714904785156 (0.24634498357772827) | > loss_disc_real_2: 0.3099316656589508 (0.3603227138519287) | > loss_disc_real_3: 0.24966445565223694 (0.25593557953834534) | > loss_disc_real_4: 0.28607410192489624 (0.27312207221984863) | > loss_disc_real_5: 0.2891426980495453 (0.3229638636112213) | > loss_0: 3.0510506629943848 (2.9603365659713745) | > loss_gen: 1.8674793243408203 (2.102581739425659) | > loss_kl: 5.440217018127441 (5.285326719284058) | > loss_feat: 0.04426167160272598 (3.564108718186617) | > loss_mel: 1.9787170886993408 (11.877890229225159) | > loss_duration: 3.1836445331573486 (3.275744318962097) | > loss_1: 12.51431941986084 (26.105651378631592)  --> STEP: 3 | > loss_disc: 2.202929735183716 (2.7078676223754883) | > loss_disc_real_0: 0.24784153699874878 (0.30055644114812213) | > loss_disc_real_1: 0.3003304898738861 (0.2643401523431142) | > loss_disc_real_2: 0.24504388868808746 (0.32189643879731494) | > loss_disc_real_3: 0.14126773178577423 (0.21771296362082163) | > loss_disc_real_4: 0.2599942684173584 (0.26874613761901855) | > loss_disc_real_5: 0.4610781669616699 (0.36900196472803753) | > loss_0: 2.202929735183716 (2.7078676223754883) | > loss_gen: 4.143313884735107 (2.782825787862142) | > loss_kl: 2.783299207687378 (4.451317548751831) | > loss_feat: 8.742298126220703 (5.290171854197979) | > loss_mel: 21.84226417541504 (15.199348211288452) | > loss_duration: 3.0703251361846924 (3.2072712580362954) | > loss_1: 40.58150100708008 (30.93093458811442) --> EVAL PERFORMANCE | > avg_loader_time: 0.020277897516886394 (+0.013154745101928711) | > avg_loss_disc: 2.7078676223754883 (-0.07144832611083984) | > avg_loss_disc_real_0: 0.30055644114812213 (+0.010794907808303833) | > avg_loss_disc_real_1: 0.2643401523431142 (+0.00576704740524292) | > avg_loss_disc_real_2: 0.32189643879731494 (+0.07498830060164133) | > avg_loss_disc_real_3: 0.21771296362082163 (-0.08644392589728037) | > avg_loss_disc_real_4: 0.26874613761901855 (-0.01238297919432324) | > avg_loss_disc_real_5: 0.36900196472803753 (+0.10021806756655377) | > avg_loss_0: 2.7078676223754883 (-0.07144832611083984) | > avg_loss_gen: 2.782825787862142 (+0.4832853078842163) | > avg_loss_kl: 4.451317548751831 (-0.5684217611948652) | > avg_loss_feat: 5.290171854197979 (+1.814896953602632) | > avg_loss_mel: 15.199348211288452 (-7.412769556045532) | > avg_loss_duration: 3.2072712580362954 (+0.07315142949422171) | > avg_loss_1: 30.93093458811442 (-5.609858512878414)  > EPOCH: 1093/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:41:25)   --> TIME: 2023-10-20 13:41:42 -- STEP: 19/50 -- GLOBAL_STEP: 107670 | > loss_disc: 1.3717752695083618 (2.4253072424938806) | > loss_disc_real_0: 0.02773824892938137 (0.16780104973402463) | > loss_disc_real_1: 0.21276363730430603 (0.20991049197159314) | > loss_disc_real_2: 0.1055375412106514 (0.2108624565758203) | > loss_disc_real_3: 0.10753311961889267 (0.21845203363581708) | > loss_disc_real_4: 0.10840260982513428 (0.20656005734283672) | > loss_disc_real_5: 0.02794329822063446 (0.2152410024090817) | > loss_0: 1.3717752695083618 (2.4253072424938806) | > grad_norm_0: tensor(499.5342, device='cuda:0') (tensor(950.7195, device='cuda:0')) | > loss_gen: 3.0370333194732666 (2.2948024084693506) | > loss_kl: 1.0112890005111694 (0.839769256742377) | > loss_feat: 12.1670503616333 (5.366963065964611) | > loss_mel: 24.36795997619629 (17.972778991649026) | > loss_duration: 1.456128716468811 (1.381948383230912) | > loss_1: 42.039459228515625 (27.856261880774248) | > grad_norm_1: tensor(62591.2422, device='cuda:0') (tensor(35366.5508, device='cuda:0')) | > current_lr_0: 6.703729111451837e-05 | > current_lr_1: 6.703729111451837e-05 | > step_time: 0.3482 (0.6198249490637529) | > loader_time: 0.0018 (0.018929606989810343)  --> TIME: 2023-10-20 13:42:06 -- STEP: 49/50 -- GLOBAL_STEP: 107700 | > loss_disc: 2.4672017097473145 (2.4423411962937336) | > loss_disc_real_0: 0.2502777874469757 (0.15532814641007966) | > loss_disc_real_1: 0.24042634665966034 (0.2231954764954898) | > loss_disc_real_2: 0.10053195804357529 (0.22512503774190434) | > loss_disc_real_3: 0.1555784046649933 (0.2289990748906014) | > loss_disc_real_4: 0.17582347989082336 (0.21955946711253146) | > loss_disc_real_5: 0.2467341423034668 (0.22025796191348712) | > loss_0: 2.4672017097473145 (2.4423411962937336) | > grad_norm_0: tensor(671.8741, device='cuda:0') (tensor(744.2067, device='cuda:0')) | > loss_gen: 2.005704402923584 (2.2657132392026935) | > loss_kl: 0.8051679730415344 (0.75399502039868) | > loss_feat: 5.179959774017334 (5.231049065307088) | > loss_mel: 24.306856155395508 (20.02011067283397) | > loss_duration: 1.4390751123428345 (1.3488655211974163) | > loss_1: 33.73676300048828 (29.61973341143861) | > grad_norm_1: tensor(25900.0879, device='cuda:0') (tensor(26111.8184, device='cuda:0')) | > current_lr_0: 6.703729111451837e-05 | > current_lr_1: 6.703729111451837e-05 | > step_time: 0.7686 (0.6996455922418711) | > loader_time: 0.5899 (0.03299369130815779)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.824784278869629 (2.824784278869629) | > loss_disc_real_0: 0.10432960093021393 (0.10432960093021393) | > loss_disc_real_1: 0.20551595091819763 (0.20551595091819763) | > loss_disc_real_2: 0.23027117550373077 (0.23027117550373077) | > loss_disc_real_3: 0.29400235414505005 (0.29400235414505005) | > loss_disc_real_4: 0.2081993967294693 (0.2081993967294693) | > loss_disc_real_5: 0.19423478841781616 (0.19423478841781616) | > loss_0: 2.824784278869629 (2.824784278869629) | > loss_gen: 1.5144495964050293 (1.5144495964050293) | > loss_kl: 5.157545566558838 (5.157545566558838) | > loss_feat: 1.7302147150039673 (1.7302147150039673) | > loss_mel: 14.224257469177246 (14.224257469177246) | > loss_duration: 2.984795570373535 (2.984795570373535) | > loss_1: 25.611263275146484 (25.611263275146484)  --> STEP: 1 | > loss_disc: 2.87446928024292 (2.87446928024292) | > loss_disc_real_0: 0.18171320855617523 (0.18171320855617523) | > loss_disc_real_1: 0.21443231403827667 (0.21443231403827667) | > loss_disc_real_2: 0.28299543261528015 (0.28299543261528015) | > loss_disc_real_3: 0.44232019782066345 (0.44232019782066345) | > loss_disc_real_4: 0.3964736759662628 (0.3964736759662628) | > loss_disc_real_5: 0.3535304665565491 (0.3535304665565491) | > loss_0: 2.87446928024292 (2.87446928024292) | > loss_gen: 2.413300037384033 (2.413300037384033) | > loss_kl: 5.239753246307373 (5.239753246307373) | > loss_feat: 6.950911045074463 (6.950911045074463) | > loss_mel: 24.193893432617188 (24.193893432617188) | > loss_duration: 3.3104143142700195 (3.3104143142700195) | > loss_1: 42.108272552490234 (42.108272552490234)  --> STEP: 2 | > loss_disc: 2.2456612586975098 (2.560065269470215) | > loss_disc_real_0: 0.18633557856082916 (0.1840243935585022) | > loss_disc_real_1: 0.15930187702178955 (0.1868670955300331) | > loss_disc_real_2: 0.16744643449783325 (0.2252209335565567) | > loss_disc_real_3: 0.08752619475126266 (0.26492319628596306) | > loss_disc_real_4: 0.07970412075519562 (0.23808889836072922) | > loss_disc_real_5: 0.1532898098230362 (0.25341013818979263) | > loss_0: 2.2456612586975098 (2.560065269470215) | > loss_gen: 2.035871982574463 (2.224586009979248) | > loss_kl: 5.824759483337402 (5.532256364822388) | > loss_feat: 11.775069236755371 (9.362990140914917) | > loss_mel: 22.923830032348633 (23.55886173248291) | > loss_duration: 3.166163921356201 (3.2382891178131104) | > loss_1: 45.7256965637207 (43.91698455810547)  --> STEP: 3 | > loss_disc: 3.0838401317596436 (2.734656890233358) | > loss_disc_real_0: 0.5216285586357117 (0.29655911525090534) | > loss_disc_real_1: 0.2775084376335144 (0.21708087623119354) | > loss_disc_real_2: 0.17710286378860474 (0.20918157696723938) | > loss_disc_real_3: 0.39293330907821655 (0.3075932338833809) | > loss_disc_real_4: 0.09647909551858902 (0.1908856307466825) | > loss_disc_real_5: 0.22547398507595062 (0.2440980871518453) | > loss_0: 3.0838401317596436 (2.734656890233358) | > loss_gen: 1.9599659442901611 (2.1363793214162192) | > loss_kl: 2.817000150680542 (4.627170960108439) | > loss_feat: 4.449877738952637 (7.72528600692749) | > loss_mel: 19.466018676757812 (22.19458071390788) | > loss_duration: 3.009575128555298 (3.1620511213938394) | > loss_1: 31.702438354492188 (39.84546915690104) --> EVAL PERFORMANCE | > avg_loader_time: 0.011883099873860678 (-0.008394797643025717) | > avg_loss_disc: 2.734656890233358 (+0.026789267857869614) | > avg_loss_disc_real_0: 0.29655911525090534 (-0.003997325897216797) | > avg_loss_disc_real_1: 0.21708087623119354 (-0.047259276111920656) | > avg_loss_disc_real_2: 0.20918157696723938 (-0.11271486183007556) | > avg_loss_disc_real_3: 0.3075932338833809 (+0.08988027026255926) | > avg_loss_disc_real_4: 0.1908856307466825 (-0.07786050687233606) | > avg_loss_disc_real_5: 0.2440980871518453 (-0.12490387757619223) | > avg_loss_0: 2.734656890233358 (+0.026789267857869614) | > avg_loss_gen: 2.1363793214162192 (-0.6464464664459229) | > avg_loss_kl: 4.627170960108439 (+0.17585341135660837) | > avg_loss_feat: 7.72528600692749 (+2.4351141527295113) | > avg_loss_mel: 22.19458071390788 (+6.995232502619427) | > avg_loss_duration: 3.1620511213938394 (-0.045220136642456055) | > avg_loss_1: 39.84546915690104 (+8.914534568786618)  > EPOCH: 1094/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:42:17)   --> TIME: 2023-10-20 13:42:53 -- STEP: 29/50 -- GLOBAL_STEP: 107730 | > loss_disc: 2.7596497535705566 (2.264143861573318) | > loss_disc_real_0: 0.22573381662368774 (0.13995910076231788) | > loss_disc_real_1: 0.2889362871646881 (0.20683620317742743) | > loss_disc_real_2: 0.22615967690944672 (0.20845470134297323) | > loss_disc_real_3: 0.2671354115009308 (0.24346963451083364) | > loss_disc_real_4: 0.2392399162054062 (0.2104371366058958) | > loss_disc_real_5: 0.21772342920303345 (0.210255840793252) | > loss_0: 2.7596497535705566 (2.264143861573318) | > grad_norm_0: tensor(660.2723, device='cuda:0') (tensor(550.6311, device='cuda:0')) | > loss_gen: 1.7833209037780762 (2.479312937835167) | > loss_kl: 0.49061909317970276 (0.8623719549384611) | > loss_feat: 0.7724284529685974 (6.495730790341723) | > loss_mel: 16.19131088256836 (21.227699300338482) | > loss_duration: 1.335878610610962 (1.3640095447671825) | > loss_1: 20.573558807373047 (32.4291248814813) | > grad_norm_1: tensor(25422.8906, device='cuda:0') (tensor(22302.9668, device='cuda:0')) | > current_lr_0: 6.697028314488764e-05 | > current_lr_1: 6.697028314488764e-05 | > step_time: 0.8214 (0.639778235862995) | > loader_time: 0.0368 (0.018464425514484274)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1653480529785156 (2.1653480529785156) | > loss_disc_real_0: 0.06902004033327103 (0.06902004033327103) | > loss_disc_real_1: 0.11102671921253204 (0.11102671921253204) | > loss_disc_real_2: 0.1181686744093895 (0.1181686744093895) | > loss_disc_real_3: 0.17131024599075317 (0.17131024599075317) | > loss_disc_real_4: 0.045270729809999466 (0.045270729809999466) | > loss_disc_real_5: 0.08794093877077103 (0.08794093877077103) | > loss_0: 2.1653480529785156 (2.1653480529785156) | > loss_gen: 1.7009073495864868 (1.7009073495864868) | > loss_kl: 5.309910774230957 (5.309910774230957) | > loss_feat: 10.843456268310547 (10.843456268310547) | > loss_mel: 23.47509765625 (23.47509765625) | > loss_duration: 2.92590069770813 (2.92590069770813) | > loss_1: 44.255271911621094 (44.255271911621094)  --> STEP: 1 | > loss_disc: 3.0417041778564453 (3.0417041778564453) | > loss_disc_real_0: 0.21808800101280212 (0.21808800101280212) | > loss_disc_real_1: 0.3874048590660095 (0.3874048590660095) | > loss_disc_real_2: 0.3052223324775696 (0.3052223324775696) | > loss_disc_real_3: 0.21519480645656586 (0.21519480645656586) | > loss_disc_real_4: 0.3766362965106964 (0.3766362965106964) | > loss_disc_real_5: 0.44302108883857727 (0.44302108883857727) | > loss_0: 3.0417041778564453 (3.0417041778564453) | > loss_gen: 2.2538814544677734 (2.2538814544677734) | > loss_kl: 5.453746318817139 (5.453746318817139) | > loss_feat: 6.901257038116455 (6.901257038116455) | > loss_mel: 22.96946907043457 (22.96946907043457) | > loss_duration: 3.299818754196167 (3.299818754196167) | > loss_1: 40.878173828125 (40.878173828125)  --> STEP: 2 | > loss_disc: 2.3829972743988037 (2.7123507261276245) | > loss_disc_real_0: 0.03869999572634697 (0.12839399836957455) | > loss_disc_real_1: 0.12149852514266968 (0.2544516921043396) | > loss_disc_real_2: 0.23263806104660034 (0.26893019676208496) | > loss_disc_real_3: 0.21039347350597382 (0.21279413998126984) | > loss_disc_real_4: 0.1310664713382721 (0.25385138392448425) | > loss_disc_real_5: 0.4935028553009033 (0.4682619720697403) | > loss_0: 2.3829972743988037 (2.7123507261276245) | > loss_gen: 2.300443649291992 (2.277162551879883) | > loss_kl: 5.890115261077881 (5.67193078994751) | > loss_feat: 9.091800689697266 (7.99652886390686) | > loss_mel: 24.39818000793457 (23.68382453918457) | > loss_duration: 3.1619391441345215 (3.2308789491653442) | > loss_1: 44.84247970581055 (42.86032676696777)  --> STEP: 3 | > loss_disc: 2.9042019844055176 (2.776301145553589) | > loss_disc_real_0: 0.3692433834075928 (0.2086771267155806) | > loss_disc_real_1: 0.2861565351486206 (0.2650199731190999) | > loss_disc_real_2: 0.2942080497741699 (0.2773561477661133) | > loss_disc_real_3: 0.2622334659099579 (0.22927391529083252) | > loss_disc_real_4: 0.27430883049964905 (0.2606705327828725) | > loss_disc_real_5: 0.2442885935306549 (0.3936041792233785) | > loss_0: 2.9042019844055176 (2.776301145553589) | > loss_gen: 2.0813961029052734 (2.211907068888346) | > loss_kl: 2.4429426193237305 (4.595601399739583) | > loss_feat: 1.0000741481781006 (5.6643772919972735) | > loss_mel: 16.97271156311035 (21.446786880493164) | > loss_duration: 3.0596890449523926 (3.173815647761027) | > loss_1: 25.556812286376953 (37.092488606770836) --> EVAL PERFORMANCE | > avg_loader_time: 0.02015097935994466 (+0.008267879486083983) | > avg_loss_disc: 2.776301145553589 (+0.04164425532023097) | > avg_loss_disc_real_0: 0.2086771267155806 (-0.08788198853532472) | > avg_loss_disc_real_1: 0.2650199731190999 (+0.047939096887906374) | > avg_loss_disc_real_2: 0.2773561477661133 (+0.0681745707988739) | > avg_loss_disc_real_3: 0.22927391529083252 (-0.07831931859254837) | > avg_loss_disc_real_4: 0.2606705327828725 (+0.06978490203619) | > avg_loss_disc_real_5: 0.3936041792233785 (+0.14950609207153318) | > avg_loss_0: 2.776301145553589 (+0.04164425532023097) | > avg_loss_gen: 2.211907068888346 (+0.07552774747212698) | > avg_loss_kl: 4.595601399739583 (-0.031569560368856386) | > avg_loss_feat: 5.6643772919972735 (-2.0609087149302168) | > avg_loss_mel: 21.446786880493164 (-0.7477938334147147) | > avg_loss_duration: 3.173815647761027 (+0.0117645263671875) | > avg_loss_1: 37.092488606770836 (-2.7529805501302036)  > EPOCH: 1095/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:43:30)   --> TIME: 2023-10-20 13:43:41 -- STEP: 9/50 -- GLOBAL_STEP: 107760 | > loss_disc: 3.0412700176239014 (2.592560821109348) | > loss_disc_real_0: 0.25080621242523193 (0.1539090019133356) | > loss_disc_real_1: 0.27926716208457947 (0.24309062792195213) | > loss_disc_real_2: 0.2618218660354614 (0.2388288660181893) | > loss_disc_real_3: 0.2651178240776062 (0.23952873961793053) | > loss_disc_real_4: 0.27102038264274597 (0.24801676472028097) | > loss_disc_real_5: 0.25685232877731323 (0.2277150203784307) | > loss_0: 3.0412700176239014 (2.592560821109348) | > grad_norm_0: tensor(821.2570, device='cuda:0') (tensor(627.4126, device='cuda:0')) | > loss_gen: 1.5228534936904907 (2.0620476139916315) | > loss_kl: 0.5573949217796326 (0.6637968454096053) | > loss_feat: 0.07443829625844955 (4.262699448193113) | > loss_mel: 1.5683486461639404 (14.944646146562365) | > loss_duration: 1.3291898965835571 (1.3278868463304307) | > loss_1: 5.052225112915039 (23.26107719209459) | > grad_norm_1: tensor(25636.0840, device='cuda:0') (tensor(32450.0176, device='cuda:0')) | > current_lr_0: 6.690334215391789e-05 | > current_lr_1: 6.690334215391789e-05 | > step_time: 0.8204 (0.6772450341118706) | > loader_time: 0.0325 (0.02216958999633789)  --> TIME: 2023-10-20 13:43:59 -- STEP: 39/50 -- GLOBAL_STEP: 107790 | > loss_disc: 2.716836452484131 (2.554663691765223) | > loss_disc_real_0: 0.19334962964057922 (0.1667565052421429) | > loss_disc_real_1: 0.24195443093776703 (0.22568120673680916) | > loss_disc_real_2: 0.28000199794769287 (0.22504914007507837) | > loss_disc_real_3: 0.26143333315849304 (0.24305621868906876) | > loss_disc_real_4: 0.2691936492919922 (0.22957976554066706) | > loss_disc_real_5: 0.24335576593875885 (0.22860256630258682) | > loss_0: 2.716836452484131 (2.554663691765223) | > grad_norm_0: tensor(412.4270, device='cuda:0') (tensor(689.5206, device='cuda:0')) | > loss_gen: 1.8650013208389282 (2.1179348413760843) | > loss_kl: 0.8086050748825073 (0.7136415946177946) | > loss_feat: 1.1234194040298462 (4.636361526898467) | > loss_mel: 15.69398021697998 (18.49337443632957) | > loss_duration: 1.3620989322662354 (1.3421732095571666) | > loss_1: 20.853105545043945 (27.303485369070984) | > grad_norm_1: tensor(8553.7334, device='cuda:0') (tensor(26040.7109, device='cuda:0')) | > current_lr_0: 6.690334215391789e-05 | > current_lr_1: 6.690334215391789e-05 | > step_time: 0.3595 (0.589892986493233) | > loader_time: 0.0033 (0.018703179481701977)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0681071281433105 (3.0681071281433105) | > loss_disc_real_0: 0.40528738498687744 (0.40528738498687744) | > loss_disc_real_1: 0.1536279320716858 (0.1536279320716858) | > loss_disc_real_2: 0.30136004090309143 (0.30136004090309143) | > loss_disc_real_3: 0.20857717096805573 (0.20857717096805573) | > loss_disc_real_4: 0.39308393001556396 (0.39308393001556396) | > loss_disc_real_5: 0.29502958059310913 (0.29502958059310913) | > loss_0: 3.0681071281433105 (3.0681071281433105) | > loss_gen: 2.2735700607299805 (2.2735700607299805) | > loss_kl: 5.744821071624756 (5.744821071624756) | > loss_feat: 7.2810773849487305 (7.2810773849487305) | > loss_mel: 23.58241081237793 (23.58241081237793) | > loss_duration: 3.0283725261688232 (3.0283725261688232) | > loss_1: 41.91025161743164 (41.91025161743164)  --> STEP: 1 | > loss_disc: 3.0406694412231445 (3.0406694412231445) | > loss_disc_real_0: 0.29450419545173645 (0.29450419545173645) | > loss_disc_real_1: 0.3197835683822632 (0.3197835683822632) | > loss_disc_real_2: 0.22899535298347473 (0.22899535298347473) | > loss_disc_real_3: 0.18343935906887054 (0.18343935906887054) | > loss_disc_real_4: 0.13005465269088745 (0.13005465269088745) | > loss_disc_real_5: 0.3675491511821747 (0.3675491511821747) | > loss_0: 3.0406694412231445 (3.0406694412231445) | > loss_gen: 1.859113097190857 (1.859113097190857) | > loss_kl: 5.775857448577881 (5.775857448577881) | > loss_feat: 5.735854625701904 (5.735854625701904) | > loss_mel: 23.310176849365234 (23.310176849365234) | > loss_duration: 3.3022656440734863 (3.3022656440734863) | > loss_1: 39.9832649230957 (39.9832649230957)  --> STEP: 2 | > loss_disc: 2.835419178009033 (2.938044309616089) | > loss_disc_real_0: 0.5042436122894287 (0.3993739038705826) | > loss_disc_real_1: 0.2544670104980469 (0.28712528944015503) | > loss_disc_real_2: 0.24207906424999237 (0.23553720861673355) | > loss_disc_real_3: 0.2516895830631256 (0.21756447106599808) | > loss_disc_real_4: 0.21010692417621613 (0.1700807884335518) | > loss_disc_real_5: 0.20772770047187805 (0.28763842582702637) | > loss_0: 2.835419178009033 (2.938044309616089) | > loss_gen: 2.1858067512512207 (2.022459924221039) | > loss_kl: 5.906937122344971 (5.841397285461426) | > loss_feat: 3.7814018726348877 (4.758628249168396) | > loss_mel: 23.64914321899414 (23.479660034179688) | > loss_duration: 3.29298734664917 (3.297626495361328) | > loss_1: 38.81627655029297 (39.399770736694336)  --> STEP: 3 | > loss_disc: 3.337552547454834 (3.071213722229004) | > loss_disc_real_0: 0.6481313109397888 (0.482293039560318) | > loss_disc_real_1: 0.29340407252311707 (0.2892182171344757) | > loss_disc_real_2: 0.3354417383670807 (0.26883871853351593) | > loss_disc_real_3: 0.30360326170921326 (0.2462440679470698) | > loss_disc_real_4: 0.27819204330444336 (0.20611787339051565) | > loss_disc_real_5: 0.3593534231185913 (0.31154342492421466) | > loss_0: 3.337552547454834 (3.071213722229004) | > loss_gen: 2.2551355361938477 (2.1000184615453086) | > loss_kl: 2.673144578933716 (4.785313049952189) | > loss_feat: 2.088871955871582 (3.8687094847361245) | > loss_mel: 19.50184440612793 (22.15372149149577) | > loss_duration: 3.091714382171631 (3.2289891242980957) | > loss_1: 29.6107120513916 (36.13675117492676) --> EVAL PERFORMANCE | > avg_loader_time: 0.012803792953491211 (-0.007347186406453449) | > avg_loss_disc: 3.071213722229004 (+0.29491257667541504) | > avg_loss_disc_real_0: 0.482293039560318 (+0.2736159128447374) | > avg_loss_disc_real_1: 0.2892182171344757 (+0.02419824401537579) | > avg_loss_disc_real_2: 0.26883871853351593 (-0.008517429232597351) | > avg_loss_disc_real_3: 0.2462440679470698 (+0.016970152656237275) | > avg_loss_disc_real_4: 0.20611787339051565 (-0.054552659392356845) | > avg_loss_disc_real_5: 0.31154342492421466 (-0.08206075429916382) | > avg_loss_0: 3.071213722229004 (+0.29491257667541504) | > avg_loss_gen: 2.1000184615453086 (-0.11188860734303763) | > avg_loss_kl: 4.785313049952189 (+0.1897116502126064) | > avg_loss_feat: 3.8687094847361245 (-1.795667807261149) | > avg_loss_mel: 22.15372149149577 (+0.7069346110026054) | > avg_loss_duration: 3.2289891242980957 (+0.05517347653706883) | > avg_loss_1: 36.13675117492676 (-0.9557374318440779)  > EPOCH: 1096/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:44:23)   --> TIME: 2023-10-20 13:44:42 -- STEP: 19/50 -- GLOBAL_STEP: 107820 | > loss_disc: 1.9942446947097778 (2.458454966545106) | > loss_disc_real_0: 0.11175061017274857 (0.1435245129426843) | > loss_disc_real_1: 0.1923149824142456 (0.21845369099786408) | > loss_disc_real_2: 0.238154798746109 (0.2170748483193548) | > loss_disc_real_3: 0.2713680863380432 (0.2355700754805615) | > loss_disc_real_4: 0.23526252806186676 (0.22863841919522537) | > loss_disc_real_5: 0.0991399735212326 (0.18094419727199956) | > loss_0: 1.9942446947097778 (2.458454966545106) | > grad_norm_0: tensor(296.5005, device='cuda:0') (tensor(492.2403, device='cuda:0')) | > loss_gen: 2.9821412563323975 (2.2298419852005806) | > loss_kl: 0.6666359305381775 (0.8412006183674461) | > loss_feat: 8.352928161621094 (6.059226489184718) | > loss_mel: 19.9273738861084 (20.655963471061305) | > loss_duration: 1.4618034362792969 (1.3676666335055703) | > loss_1: 33.39088439941406 (31.15389919281006) | > grad_norm_1: tensor(10561.4629, device='cuda:0') (tensor(19733.8086, device='cuda:0')) | > current_lr_0: 6.683646807465973e-05 | > current_lr_1: 6.683646807465973e-05 | > step_time: 0.5766 (0.6474735987813849) | > loader_time: 0.0096 (0.019130644045378033)  --> TIME: 2023-10-20 13:45:00 -- STEP: 49/50 -- GLOBAL_STEP: 107850 | > loss_disc: 2.3224234580993652 (2.4871555956042544) | > loss_disc_real_0: 0.0232094656676054 (0.1325682249699472) | > loss_disc_real_1: 0.07949253171682358 (0.2208059366260256) | > loss_disc_real_2: 0.04226116091012955 (0.2217208374367685) | > loss_disc_real_3: 0.26092156767845154 (0.24429747241796274) | > loss_disc_real_4: 0.29270297288894653 (0.22999885761920286) | > loss_disc_real_5: 0.25815972685813904 (0.21698270494840582) | > loss_0: 2.3224234580993652 (2.4871555956042544) | > grad_norm_0: tensor(1224.9235, device='cuda:0') (tensor(584.7467, device='cuda:0')) | > loss_gen: 1.9415417909622192 (2.203366756439209) | > loss_kl: 0.46267300844192505 (0.8088987950159578) | > loss_feat: 2.702522039413452 (5.404271084359107) | > loss_mel: 24.254457473754883 (20.754815627117548) | > loss_duration: 1.4820917844772339 (1.342326896531241) | > loss_1: 30.843286514282227 (30.513679173527933) | > grad_norm_1: tensor(8805.5205, device='cuda:0') (tensor(18118.8242, device='cuda:0')) | > current_lr_0: 6.683646807465973e-05 | > current_lr_1: 6.683646807465973e-05 | > step_time: 0.5549 (0.6006832268773294) | > loader_time: 0.4087 (0.025844807527503188)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5329864025115967 (2.5329864025115967) | > loss_disc_real_0: 0.10432305186986923 (0.10432305186986923) | > loss_disc_real_1: 0.2188364714384079 (0.2188364714384079) | > loss_disc_real_2: 0.20602986216545105 (0.20602986216545105) | > loss_disc_real_3: 0.35506564378738403 (0.35506564378738403) | > loss_disc_real_4: 0.3489803671836853 (0.3489803671836853) | > loss_disc_real_5: 0.394475519657135 (0.394475519657135) | > loss_0: 2.5329864025115967 (2.5329864025115967) | > loss_gen: 2.5109288692474365 (2.5109288692474365) | > loss_kl: 6.030693531036377 (6.030693531036377) | > loss_feat: 5.275275230407715 (5.275275230407715) | > loss_mel: 22.498634338378906 (22.498634338378906) | > loss_duration: 2.966216564178467 (2.966216564178467) | > loss_1: 39.2817497253418 (39.2817497253418)  --> STEP: 1 | > loss_disc: 2.4288341999053955 (2.4288341999053955) | > loss_disc_real_0: 0.117314413189888 (0.117314413189888) | > loss_disc_real_1: 0.15585114061832428 (0.15585114061832428) | > loss_disc_real_2: 0.13849136233329773 (0.13849136233329773) | > loss_disc_real_3: 0.13297498226165771 (0.13297498226165771) | > loss_disc_real_4: 0.2636425197124481 (0.2636425197124481) | > loss_disc_real_5: 0.14231808483600616 (0.14231808483600616) | > loss_0: 2.4288341999053955 (2.4288341999053955) | > loss_gen: 1.976197600364685 (1.976197600364685) | > loss_kl: 5.640084266662598 (5.640084266662598) | > loss_feat: 5.6993865966796875 (5.6993865966796875) | > loss_mel: 20.642717361450195 (20.642717361450195) | > loss_duration: 3.316333055496216 (3.316333055496216) | > loss_1: 37.27471923828125 (37.27471923828125)  --> STEP: 2 | > loss_disc: 2.833268165588379 (2.631051182746887) | > loss_disc_real_0: 0.09120830148458481 (0.1042613573372364) | > loss_disc_real_1: 0.2139013409614563 (0.1848762407898903) | > loss_disc_real_2: 0.2454535961151123 (0.19197247922420502) | > loss_disc_real_3: 0.31687405705451965 (0.22492451965808868) | > loss_disc_real_4: 0.22298918664455414 (0.24331585317850113) | > loss_disc_real_5: 0.41521716117858887 (0.2787676230072975) | > loss_0: 2.833268165588379 (2.631051182746887) | > loss_gen: 2.0864193439483643 (2.0313084721565247) | > loss_kl: 6.10799503326416 (5.874039649963379) | > loss_feat: 7.1166558265686035 (6.4080212116241455) | > loss_mel: 22.87497901916504 (21.758848190307617) | > loss_duration: 3.211858034133911 (3.2640955448150635) | > loss_1: 41.39790725708008 (39.336313247680664)  --> STEP: 3 | > loss_disc: 3.050414562225342 (2.770838975906372) | > loss_disc_real_0: 0.36909130215644836 (0.19253800561030707) | > loss_disc_real_1: 0.28762173652648926 (0.21912473936875662) | > loss_disc_real_2: 0.3048523962497711 (0.22959911823272705) | > loss_disc_real_3: 0.25993481278419495 (0.23659461736679077) | > loss_disc_real_4: 0.28787291049957275 (0.25816820561885834) | > loss_disc_real_5: 0.25807857513427734 (0.2718712737162908) | > loss_0: 3.050414562225342 (2.770838975906372) | > loss_gen: 1.7460476160049438 (1.9362215201059978) | > loss_kl: 2.946134328842163 (4.898071209589641) | > loss_feat: 0.0930895134806633 (4.303043978909652) | > loss_mel: 3.255955696105957 (15.591217358907064) | > loss_duration: 3.0895938873291016 (3.205928325653076) | > loss_1: 11.130821228027344 (29.93448257446289) --> EVAL PERFORMANCE | > avg_loader_time: 0.00990438461303711 (-0.0028994083404541016) | > avg_loss_disc: 2.770838975906372 (-0.30037474632263184) | > avg_loss_disc_real_0: 0.19253800561030707 (-0.2897550339500109) | > avg_loss_disc_real_1: 0.21912473936875662 (-0.07009347776571909) | > avg_loss_disc_real_2: 0.22959911823272705 (-0.03923960030078888) | > avg_loss_disc_real_3: 0.23659461736679077 (-0.009649450580279023) | > avg_loss_disc_real_4: 0.25816820561885834 (+0.05205033222834268) | > avg_loss_disc_real_5: 0.2718712737162908 (-0.03967215120792389) | > avg_loss_0: 2.770838975906372 (-0.30037474632263184) | > avg_loss_gen: 1.9362215201059978 (-0.16379694143931078) | > avg_loss_kl: 4.898071209589641 (+0.11275815963745117) | > avg_loss_feat: 4.303043978909652 (+0.4343344941735272) | > avg_loss_mel: 15.591217358907064 (-6.562504132588705) | > avg_loss_duration: 3.205928325653076 (-0.02306079864501953) | > avg_loss_1: 29.93448257446289 (-6.202268600463867)  > EPOCH: 1097/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:45:17)   --> TIME: 2023-10-20 13:45:40 -- STEP: 29/50 -- GLOBAL_STEP: 107880 | > loss_disc: 2.1364574432373047 (2.4488262266948304) | > loss_disc_real_0: 0.08433391898870468 (0.14580490941117547) | > loss_disc_real_1: 0.3075397312641144 (0.23636624499641615) | > loss_disc_real_2: 0.20964312553405762 (0.23469367443487563) | > loss_disc_real_3: 0.2355654239654541 (0.25541338555771737) | > loss_disc_real_4: 0.2335621565580368 (0.22156351946037392) | > loss_disc_real_5: 0.11247282475233078 (0.2239149130623916) | > loss_0: 2.1364574432373047 (2.4488262266948304) | > grad_norm_0: tensor(307.6900, device='cuda:0') (tensor(710.6115, device='cuda:0')) | > loss_gen: 2.5223941802978516 (2.3554406782676436) | > loss_kl: 0.49561798572540283 (0.7775554379512524) | > loss_feat: 5.65474271774292 (5.330809718575971) | > loss_mel: 20.684646606445312 (20.784332965982372) | > loss_duration: 1.3301554918289185 (1.358224293281292) | > loss_1: 30.687557220458984 (30.6063630827542) | > grad_norm_1: tensor(3432.5381, device='cuda:0') (tensor(23294.1191, device='cuda:0')) | > current_lr_0: 6.676966084023073e-05 | > current_lr_1: 6.676966084023073e-05 | > step_time: 0.6806 (0.5611765055820858) | > loader_time: 0.0244 (0.01362596709152748)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.111652135848999 (2.111652135848999) | > loss_disc_real_0: 0.12956510484218597 (0.12956510484218597) | > loss_disc_real_1: 0.20402497053146362 (0.20402497053146362) | > loss_disc_real_2: 0.29806527495384216 (0.29806527495384216) | > loss_disc_real_3: 0.32453322410583496 (0.32453322410583496) | > loss_disc_real_4: 0.16863180696964264 (0.16863180696964264) | > loss_disc_real_5: 0.1398623138666153 (0.1398623138666153) | > loss_0: 2.111652135848999 (2.111652135848999) | > loss_gen: 2.572317123413086 (2.572317123413086) | > loss_kl: 5.878963470458984 (5.878963470458984) | > loss_feat: 7.3537373542785645 (7.3537373542785645) | > loss_mel: 23.319210052490234 (23.319210052490234) | > loss_duration: 3.093998432159424 (3.093998432159424) | > loss_1: 42.21822738647461 (42.21822738647461)  --> STEP: 1 | > loss_disc: 2.9139347076416016 (2.9139347076416016) | > loss_disc_real_0: 0.16786164045333862 (0.16786164045333862) | > loss_disc_real_1: 0.2868802845478058 (0.2868802845478058) | > loss_disc_real_2: 0.17376495897769928 (0.17376495897769928) | > loss_disc_real_3: 0.16612844169139862 (0.16612844169139862) | > loss_disc_real_4: 0.2301386594772339 (0.2301386594772339) | > loss_disc_real_5: 0.30088964104652405 (0.30088964104652405) | > loss_0: 2.9139347076416016 (2.9139347076416016) | > loss_gen: 1.7355470657348633 (1.7355470657348633) | > loss_kl: 5.73763370513916 (5.73763370513916) | > loss_feat: 7.126564025878906 (7.126564025878906) | > loss_mel: 24.63177490234375 (24.63177490234375) | > loss_duration: 3.3344781398773193 (3.3344781398773193) | > loss_1: 42.56599426269531 (42.56599426269531)  --> STEP: 2 | > loss_disc: 2.6024439334869385 (2.75818932056427) | > loss_disc_real_0: 0.18027260899543762 (0.17406712472438812) | > loss_disc_real_1: 0.31139954924583435 (0.29913991689682007) | > loss_disc_real_2: 0.3887944221496582 (0.28127969056367874) | > loss_disc_real_3: 0.28953465819358826 (0.22783154994249344) | > loss_disc_real_4: 0.16529953479766846 (0.19771909713745117) | > loss_disc_real_5: 0.29785487055778503 (0.29937225580215454) | > loss_0: 2.6024439334869385 (2.75818932056427) | > loss_gen: 2.42976975440979 (2.0826584100723267) | > loss_kl: 5.996449947357178 (5.867041826248169) | > loss_feat: 7.24609899520874 (7.186331510543823) | > loss_mel: 23.3953914642334 (24.013583183288574) | > loss_duration: 3.2012970447540283 (3.267887592315674) | > loss_1: 42.26900863647461 (42.41750144958496)  --> STEP: 3 | > loss_disc: 3.1302132606506348 (2.882197300593058) | > loss_disc_real_0: 0.5004017353057861 (0.2828453282515208) | > loss_disc_real_1: 0.31018584966659546 (0.3028218944867452) | > loss_disc_real_2: 0.32681575417518616 (0.2964583784341812) | > loss_disc_real_3: 0.31354087591171265 (0.2564013252655665) | > loss_disc_real_4: 0.298859566450119 (0.23143258690834045) | > loss_disc_real_5: 0.3884727358818054 (0.32907241582870483) | > loss_0: 3.1302132606506348 (2.882197300593058) | > loss_gen: 2.286053419113159 (2.150456746419271) | > loss_kl: 3.0621345043182373 (4.932072718938191) | > loss_feat: 2.186619281768799 (5.519760767618815) | > loss_mel: 18.68145751953125 (22.236207962036133) | > loss_duration: 3.0872435569763184 (3.207672913869222) | > loss_1: 29.30350685119629 (38.046169916788735) --> EVAL PERFORMANCE | > avg_loader_time: 0.018797794977823894 (+0.008893410364786785) | > avg_loss_disc: 2.882197300593058 (+0.11135832468668605) | > avg_loss_disc_real_0: 0.2828453282515208 (+0.09030732264121374) | > avg_loss_disc_real_1: 0.3028218944867452 (+0.08369715511798856) | > avg_loss_disc_real_2: 0.2964583784341812 (+0.06685926020145416) | > avg_loss_disc_real_3: 0.2564013252655665 (+0.019806707898775755) | > avg_loss_disc_real_4: 0.23143258690834045 (-0.026735618710517883) | > avg_loss_disc_real_5: 0.32907241582870483 (+0.05720114211241406) | > avg_loss_0: 2.882197300593058 (+0.11135832468668605) | > avg_loss_gen: 2.150456746419271 (+0.21423522631327319) | > avg_loss_kl: 4.932072718938191 (+0.03400150934855084) | > avg_loss_feat: 5.519760767618815 (+1.2167167887091637) | > avg_loss_mel: 22.236207962036133 (+6.644990603129068) | > avg_loss_duration: 3.207672913869222 (+0.0017445882161459814) | > avg_loss_1: 38.046169916788735 (+8.111687342325844)  > EPOCH: 1098/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:46:03)   --> TIME: 2023-10-20 13:46:14 -- STEP: 9/50 -- GLOBAL_STEP: 107910 | > loss_disc: 2.8158726692199707 (2.620368719100952) | > loss_disc_real_0: 0.2820199728012085 (0.16284720102945963) | > loss_disc_real_1: 0.26151084899902344 (0.2451685079269939) | > loss_disc_real_2: 0.3199300169944763 (0.27072108371390236) | > loss_disc_real_3: 0.26881536841392517 (0.2369040416346656) | > loss_disc_real_4: 0.24435833096504211 (0.24936292072137198) | > loss_disc_real_5: 0.2646528482437134 (0.239306026034885) | > loss_0: 2.8158726692199707 (2.620368719100952) | > grad_norm_0: tensor(1001.8118, device='cuda:0') (tensor(544.9717, device='cuda:0')) | > loss_gen: 1.9921674728393555 (2.096251646677653) | > loss_kl: 0.6943743824958801 (0.8002902600500319) | > loss_feat: 0.8612072467803955 (3.838485757820308) | > loss_mel: 16.34764862060547 (14.168435447745853) | > loss_duration: 1.4073681831359863 (1.3637690544128418) | > loss_1: 21.302764892578125 (22.267231623331707) | > grad_norm_1: tensor(11911.2979, device='cuda:0') (tensor(25936.0879, device='cuda:0')) | > current_lr_0: 6.670292038381533e-05 | > current_lr_1: 6.670292038381533e-05 | > step_time: 0.7544 (0.7047919962141249) | > loader_time: 0.0419 (0.028214348687065974)  --> TIME: 2023-10-20 13:46:33 -- STEP: 39/50 -- GLOBAL_STEP: 107940 | > loss_disc: 1.6765410900115967 (2.5636898982219205) | > loss_disc_real_0: 0.07912866771221161 (0.1500614770473196) | > loss_disc_real_1: 0.22647768259048462 (0.22351565135595125) | > loss_disc_real_2: 0.18816892802715302 (0.2391360518641961) | > loss_disc_real_3: 0.20463556051254272 (0.2405187949920312) | > loss_disc_real_4: 0.1044650673866272 (0.2500707370539506) | > loss_disc_real_5: 0.09746861457824707 (0.23139344184444502) | > loss_0: 1.6765410900115967 (2.5636898982219205) | > grad_norm_0: tensor(226.8087, device='cuda:0') (tensor(587.6094, device='cuda:0')) | > loss_gen: 3.1294384002685547 (2.182724301631633) | > loss_kl: 0.3659033477306366 (0.8110922108858059) | > loss_feat: 7.208312034606934 (5.100232078550527) | > loss_mel: 17.902305603027344 (17.833454148891644) | > loss_duration: 1.368587613105774 (1.3562185580913837) | > loss_1: 29.974546432495117 (27.28372090902084) | > grad_norm_1: tensor(44136.5312, device='cuda:0') (tensor(23560.4609, device='cuda:0')) | > current_lr_0: 6.670292038381533e-05 | > current_lr_1: 6.670292038381533e-05 | > step_time: 0.4886 (0.622724698140071) | > loader_time: 0.0253 (0.022462771489070017)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.631694793701172 (2.631694793701172) | > loss_disc_real_0: 0.20128732919692993 (0.20128732919692993) | > loss_disc_real_1: 0.2610858678817749 (0.2610858678817749) | > loss_disc_real_2: 0.3067643642425537 (0.3067643642425537) | > loss_disc_real_3: 0.26784422993659973 (0.26784422993659973) | > loss_disc_real_4: 0.22916057705879211 (0.22916057705879211) | > loss_disc_real_5: 0.17871838808059692 (0.17871838808059692) | > loss_0: 2.631694793701172 (2.631694793701172) | > loss_gen: 2.1368825435638428 (2.1368825435638428) | > loss_kl: 5.452206134796143 (5.452206134796143) | > loss_feat: 8.653605461120605 (8.653605461120605) | > loss_mel: 21.797283172607422 (21.797283172607422) | > loss_duration: 2.9426639080047607 (2.9426639080047607) | > loss_1: 40.982643127441406 (40.982643127441406)  --> STEP: 1 | > loss_disc: 1.7504963874816895 (1.7504963874816895) | > loss_disc_real_0: 0.10930690914392471 (0.10930690914392471) | > loss_disc_real_1: 0.021025337278842926 (0.021025337278842926) | > loss_disc_real_2: 0.03902750834822655 (0.03902750834822655) | > loss_disc_real_3: 0.012665068730711937 (0.012665068730711937) | > loss_disc_real_4: 0.02761559747159481 (0.02761559747159481) | > loss_disc_real_5: 0.11949203163385391 (0.11949203163385391) | > loss_0: 1.7504963874816895 (1.7504963874816895) | > loss_gen: 2.059415340423584 (2.059415340423584) | > loss_kl: 5.351031303405762 (5.351031303405762) | > loss_feat: 17.503049850463867 (17.503049850463867) | > loss_mel: 27.887619018554688 (27.887619018554688) | > loss_duration: 3.3483991622924805 (3.3483991622924805) | > loss_1: 56.149513244628906 (56.149513244628906)  --> STEP: 2 | > loss_disc: 3.060953140258789 (2.4057247638702393) | > loss_disc_real_0: 0.09019392728805542 (0.09975041821599007) | > loss_disc_real_1: 0.2681201696395874 (0.14457275345921516) | > loss_disc_real_2: 0.23016616702079773 (0.13459683768451214) | > loss_disc_real_3: 0.28066474199295044 (0.1466649053618312) | > loss_disc_real_4: 0.25321173667907715 (0.14041366707533598) | > loss_disc_real_5: 0.24752146005630493 (0.18350674584507942) | > loss_0: 3.060953140258789 (2.4057247638702393) | > loss_gen: 1.3841569423675537 (1.7217861413955688) | > loss_kl: 6.021210670471191 (5.686120986938477) | > loss_feat: 0.06803523004055023 (8.785542540252209) | > loss_mel: 2.100541591644287 (14.994080305099487) | > loss_duration: 3.111999750137329 (3.230199456214905) | > loss_1: 12.685943603515625 (34.417728424072266)  --> STEP: 3 | > loss_disc: 2.886843204498291 (2.5660975774129233) | > loss_disc_real_0: 0.35078415274620056 (0.18342832972606024) | > loss_disc_real_1: 0.22034309804439545 (0.16982953498760858) | > loss_disc_real_2: 0.10894708335399628 (0.1260469195743402) | > loss_disc_real_3: 0.28154677152633667 (0.19162552741666636) | > loss_disc_real_4: 0.09047619253396988 (0.12376784222821395) | > loss_disc_real_5: 0.11514139920473099 (0.1607182969649633) | > loss_0: 2.886843204498291 (2.5660975774129233) | > loss_gen: 1.8711111545562744 (1.7715611457824707) | > loss_kl: 2.6562390327453613 (4.6761603355407715) | > loss_feat: 5.687183380126953 (7.75275615354379) | > loss_mel: 23.519960403442383 (17.83604033788045) | > loss_duration: 3.006633758544922 (3.155677556991577) | > loss_1: 36.741127014160156 (35.19219462076823) --> EVAL PERFORMANCE | > avg_loader_time: 0.007045269012451172 (-0.011752525965372723) | > avg_loss_disc: 2.5660975774129233 (-0.3160997231801348) | > avg_loss_disc_real_0: 0.18342832972606024 (-0.09941699852546057) | > avg_loss_disc_real_1: 0.16982953498760858 (-0.1329923594991366) | > avg_loss_disc_real_2: 0.1260469195743402 (-0.17041145885984102) | > avg_loss_disc_real_3: 0.19162552741666636 (-0.06477579784890017) | > avg_loss_disc_real_4: 0.12376784222821395 (-0.1076647446801265) | > avg_loss_disc_real_5: 0.1607182969649633 (-0.16835411886374155) | > avg_loss_0: 2.5660975774129233 (-0.3160997231801348) | > avg_loss_gen: 1.7715611457824707 (-0.3788956006368003) | > avg_loss_kl: 4.6761603355407715 (-0.25591238339741995) | > avg_loss_feat: 7.75275615354379 (+2.2329953859249745) | > avg_loss_mel: 17.83604033788045 (-4.4001676241556815) | > avg_loss_duration: 3.155677556991577 (-0.051995356877645005) | > avg_loss_1: 35.19219462076823 (-2.853975296020508)  > EPOCH: 1099/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:46:56)   --> TIME: 2023-10-20 13:47:16 -- STEP: 19/50 -- GLOBAL_STEP: 107970 | > loss_disc: 1.9078803062438965 (2.4632799060721147) | > loss_disc_real_0: 0.03897795453667641 (0.1491571539326718) | > loss_disc_real_1: 0.14710745215415955 (0.23447329590195104) | > loss_disc_real_2: 0.21108852326869965 (0.21573081769441305) | > loss_disc_real_3: 0.13217630982398987 (0.23299941302914368) | > loss_disc_real_4: 0.2111591398715973 (0.22540424293593356) | > loss_disc_real_5: 0.23343515396118164 (0.22778894026812754) | > loss_0: 1.9078803062438965 (2.4632799060721147) | > grad_norm_0: tensor(463.4136, device='cuda:0') (tensor(631.1104, device='cuda:0')) | > loss_gen: 2.5097031593322754 (2.273977806693629) | > loss_kl: 0.8689196705818176 (0.7827832902732649) | > loss_feat: 7.2985053062438965 (5.602268118607371) | > loss_mel: 20.4927921295166 (20.359257045545075) | > loss_duration: 1.4657645225524902 (1.3746025625028109) | > loss_1: 32.635684967041016 (30.392888320119756) | > grad_norm_1: tensor(7698.1118, device='cuda:0') (tensor(27930.1836, device='cuda:0')) | > current_lr_0: 6.663624663866468e-05 | > current_lr_1: 6.663624663866468e-05 | > step_time: 0.3464 (0.7453339852784809) | > loader_time: 0.0031 (0.02121207588597348)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.11773681640625 (2.11773681640625) | > loss_disc_real_0: 0.13226300477981567 (0.13226300477981567) | > loss_disc_real_1: 0.2707352340221405 (0.2707352340221405) | > loss_disc_real_2: 0.31257927417755127 (0.31257927417755127) | > loss_disc_real_3: 0.2808280289173126 (0.2808280289173126) | > loss_disc_real_4: 0.24482972919940948 (0.24482972919940948) | > loss_disc_real_5: 0.19579772651195526 (0.19579772651195526) | > loss_0: 2.11773681640625 (2.11773681640625) | > loss_gen: 3.1935019493103027 (3.1935019493103027) | > loss_kl: 5.525158405303955 (5.525158405303955) | > loss_feat: 9.778286933898926 (9.778286933898926) | > loss_mel: 23.984792709350586 (23.984792709350586) | > loss_duration: 2.988999366760254 (2.988999366760254) | > loss_1: 45.47073745727539 (45.47073745727539)  --> STEP: 1 | > loss_disc: 2.1617181301116943 (2.1617181301116943) | > loss_disc_real_0: 0.27261683344841003 (0.27261683344841003) | > loss_disc_real_1: 0.19194374978542328 (0.19194374978542328) | > loss_disc_real_2: 0.19521716237068176 (0.19521716237068176) | > loss_disc_real_3: 0.1968148648738861 (0.1968148648738861) | > loss_disc_real_4: 0.3425270617008209 (0.3425270617008209) | > loss_disc_real_5: 0.2710912227630615 (0.2710912227630615) | > loss_0: 2.1617181301116943 (2.1617181301116943) | > loss_gen: 3.118455648422241 (3.118455648422241) | > loss_kl: 5.23321008682251 (5.23321008682251) | > loss_feat: 9.245614051818848 (9.245614051818848) | > loss_mel: 23.578577041625977 (23.578577041625977) | > loss_duration: 3.3245153427124023 (3.3245153427124023) | > loss_1: 44.50037384033203 (44.50037384033203)  --> STEP: 2 | > loss_disc: 1.4616422653198242 (1.8116801977157593) | > loss_disc_real_0: 0.05271662771701813 (0.16266673058271408) | > loss_disc_real_1: 0.07899700105190277 (0.13547037541866302) | > loss_disc_real_2: 0.09192796051502228 (0.14357256144285202) | > loss_disc_real_3: 0.10262909531593323 (0.14972198009490967) | > loss_disc_real_4: 0.028276165947318077 (0.1854016138240695) | > loss_disc_real_5: 0.024607287719845772 (0.14784925524145365) | > loss_0: 1.4616422653198242 (1.8116801977157593) | > loss_gen: 2.3232810497283936 (2.7208683490753174) | > loss_kl: 5.473886966705322 (5.353548526763916) | > loss_feat: 14.636643409729004 (11.941128730773926) | > loss_mel: 26.276092529296875 (24.927334785461426) | > loss_duration: 3.2515437602996826 (3.2880295515060425) | > loss_1: 51.961448669433594 (48.23091125488281)  --> STEP: 3 | > loss_disc: 2.926135540008545 (2.1831653118133545) | > loss_disc_real_0: 0.23021401464939117 (0.1851824919382731) | > loss_disc_real_1: 0.3729613423347473 (0.2146340310573578) | > loss_disc_real_2: 0.4502392113208771 (0.24579477806886038) | > loss_disc_real_3: 0.2839825749397278 (0.19447551170984903) | > loss_disc_real_4: 0.48263728618621826 (0.2844801712781191) | > loss_disc_real_5: 0.38051456212997437 (0.22540435753762722) | > loss_0: 2.926135540008545 (2.1831653118133545) | > loss_gen: 3.458242416381836 (2.9666597048441568) | > loss_kl: 2.7097177505493164 (4.47227160135905) | > loss_feat: 4.082120418548584 (9.321459293365479) | > loss_mel: 18.691022872924805 (22.84856414794922) | > loss_duration: 3.0181736946105957 (3.19807759920756) | > loss_1: 31.95927619934082 (42.807032903035484)  --> TIME: 2023-10-20 13:47:37 -- STEP: 49/50 -- GLOBAL_STEP: 108000 | > loss_disc: 2.577364444732666 (2.527160775904754) | > loss_disc_real_0: 0.15817536413669586 (0.1434658460071956) | > loss_disc_real_1: 0.22134844958782196 (0.2342260330915451) | > loss_disc_real_2: 0.17864744365215302 (0.21941228134899723) | > loss_disc_real_3: 0.29132917523384094 (0.23915394486821429) | > loss_disc_real_4: 0.3146088719367981 (0.22502344823917564) | > loss_disc_real_5: 0.404071182012558 (0.24084499387108546) | > loss_0: 2.577364444732666 (2.527160775904754) | > grad_norm_0: tensor(1726.8628, device='cuda:0') (tensor(752.0029, device='cuda:0')) | > loss_gen: 2.793492317199707 (2.2516440907303155) | > loss_kl: 0.2520206570625305 (0.803207129240036) | > loss_feat: 5.4230780601501465 (5.662460729023632) | > loss_mel: 21.38932991027832 (20.309968408273186) | > loss_duration: 1.4728893041610718 (1.3385164956657252) | > loss_1: 31.330810546875 (30.36579654654678) | > grad_norm_1: tensor(32135.4238, device='cuda:0') (tensor(23872.8438, device='cuda:0')) | > current_lr_0: 6.663624663866468e-05 | > current_lr_1: 6.663624663866468e-05 | > step_time: 1.3726 (0.556944092925714) | > loader_time: 7.6954 (0.17125599724905832) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_108000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.3876309394836426 (2.4842817187309265) | > loss_disc_real_0: 0.29569947719573975 (0.21281173825263977) | > loss_disc_real_1: 0.26999157667160034 (0.22847341746091843) | > loss_disc_real_2: 0.3257890045642853 (0.2657933346927166) | > loss_disc_real_3: 0.27302804589271545 (0.21411364525556564) | > loss_disc_real_4: 0.5549202561378479 (0.3520901924930513) | > loss_disc_real_5: 0.5138073563575745 (0.29750510724261403) | > loss_0: 3.3876309394836426 (2.4842817187309265) | > loss_gen: 2.2071688175201416 (2.776786983013153) | > loss_kl: 5.345248222351074 (4.690515756607056) | > loss_feat: 7.5074920654296875 (8.86796748638153) | > loss_mel: 23.800189971923828 (23.08647060394287) | > loss_duration: 2.8958775997161865 (3.122527599334717) | > loss_1: 41.755977630615234 (42.54426908493042)  --> STEP: 1 | > loss_disc: 2.6082382202148438 (2.50907301902771) | > loss_disc_real_0: 0.2574692964553833 (0.22174324989318847) | > loss_disc_real_1: 0.25105708837509155 (0.23299015164375306) | > loss_disc_real_2: 0.292618066072464 (0.27115828096866607) | > loss_disc_real_3: 0.14962442219257355 (0.20121580064296724) | > loss_disc_real_4: 0.3447772264480591 (0.35062759928405285) | > loss_disc_real_5: 0.3876020908355713 (0.31552450396120546) | > loss_0: 2.6082382202148438 (2.50907301902771) | > loss_gen: 2.5892062187194824 (2.739270830154419) | > loss_kl: 5.209759712219238 (4.794364547729492) | > loss_feat: 6.186624050140381 (8.331698799133301) | > loss_mel: 23.702917098999023 (23.2097599029541) | > loss_duration: 3.3315045833587646 (3.1643229961395263) | > loss_1: 41.02001190185547 (42.23941764831543)  --> STEP: 2 | > loss_disc: 3.4441094398498535 (2.6649124224980674) | > loss_disc_real_0: 0.20378318428993225 (0.2187499056259791) | > loss_disc_real_1: 0.2979593575000763 (0.24381835261980692) | > loss_disc_real_2: 0.29279032349586487 (0.2747636213898659) | > loss_disc_real_3: 0.19799450039863586 (0.200678917268912) | > loss_disc_real_4: 0.2761133313179016 (0.3382085546230276) | > loss_disc_real_5: 0.6125973463058472 (0.3650366443519791) | > loss_0: 3.4441094398498535 (2.6649124224980674) | > loss_gen: 1.8059123754501343 (2.583711087703705) | > loss_kl: 5.559640407562256 (4.921910524368286) | > loss_feat: 9.394700050354004 (8.508865674336752) | > loss_mel: 22.54814910888672 (23.099491437276203) | > loss_duration: 3.2220380306243896 (3.1739421685536704) | > loss_1: 42.53043746948242 (42.28792095184326)  --> STEP: 3 | > loss_disc: 3.143911600112915 (2.7333408764430454) | > loss_disc_real_0: 0.48245906829833984 (0.2564226431506021) | > loss_disc_real_1: 0.31616342067718506 (0.2541533623422895) | > loss_disc_real_2: 0.3471941649913788 (0.2851108419043677) | > loss_disc_real_3: 0.2900025546550751 (0.21343943689550673) | > loss_disc_real_4: 0.296509712934494 (0.33225157723895143) | > loss_disc_real_5: 0.2475251406431198 (0.3482492866792849) | > loss_0: 3.143911600112915 (2.7333408764430454) | > loss_gen: 1.972597360610962 (2.496409126690456) | > loss_kl: 2.924933671951294 (4.636628116880145) | > loss_feat: 0.6911812424659729 (7.392053612640926) | > loss_mel: 15.915756225585938 (22.07324354989188) | > loss_duration: 3.032763957977295 (3.153773852757045) | > loss_1: 24.537233352661133 (39.75210843767439) --> EVAL PERFORMANCE | > avg_loader_time: 0.3284937654222761 (+0.3214484964098249) | > avg_loss_disc: 2.7333408764430454 (+0.16724329903012203) | > avg_loss_disc_real_0: 0.2564226431506021 (+0.07299431342454185) | > avg_loss_disc_real_1: 0.2541533623422895 (+0.08432382735468094) | > avg_loss_disc_real_2: 0.2851108419043677 (+0.1590639223300275) | > avg_loss_disc_real_3: 0.21343943689550673 (+0.021813909478840376) | > avg_loss_disc_real_4: 0.33225157723895143 (+0.20848373501073747) | > avg_loss_disc_real_5: 0.3482492866792849 (+0.1875309897143216) | > avg_loss_0: 2.7333408764430454 (+0.16724329903012203) | > avg_loss_gen: 2.496409126690456 (+0.7248479809079851) | > avg_loss_kl: 4.636628116880145 (-0.03953221866062684) | > avg_loss_feat: 7.392053612640926 (-0.3607025409028637) | > avg_loss_mel: 22.07324354989188 (+4.23720321201143) | > avg_loss_duration: 3.153773852757045 (-0.001903704234532011) | > avg_loss_1: 39.75210843767439 (+4.55991381690616)  > EPOCH: 1100/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:47:50)   --> TIME: 2023-10-20 13:48:14 -- STEP: 29/50 -- GLOBAL_STEP: 108030 | > loss_disc: 2.563096523284912 (2.289898370874339) | > loss_disc_real_0: 0.054819487035274506 (0.10737246284582491) | > loss_disc_real_1: 0.2649249732494354 (0.20580229394394775) | > loss_disc_real_2: 0.1386619210243225 (0.21732057502557492) | > loss_disc_real_3: 0.33907726407051086 (0.23626416587624058) | > loss_disc_real_4: 0.25636351108551025 (0.22303446298786278) | > loss_disc_real_5: 0.27251285314559937 (0.22064026046929688) | > loss_0: 2.563096523284912 (2.289898370874339) | > grad_norm_0: tensor(1036.7810, device='cuda:0') (tensor(1049.4451, device='cuda:0')) | > loss_gen: 2.3079488277435303 (2.5132638668191856) | > loss_kl: 0.6376055479049683 (0.8264692281854564) | > loss_feat: 5.62684965133667 (7.151868273215047) | > loss_mel: 22.45266342163086 (22.738889492791273) | > loss_duration: 1.3730921745300293 (1.3646984593621616) | > loss_1: 32.39815902709961 (34.595189357626026) | > grad_norm_1: tensor(13103.4941, device='cuda:0') (tensor(48036.7422, device='cuda:0')) | > current_lr_0: 6.656963953809672e-05 | > current_lr_1: 6.656963953809672e-05 | > step_time: 0.4226 (0.6416817040278994) | > loader_time: 0.0021 (0.01901982570516652)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1468443870544434 (3.1468443870544434) | > loss_disc_real_0: 0.5132402777671814 (0.5132402777671814) | > loss_disc_real_1: 0.23545671999454498 (0.23545671999454498) | > loss_disc_real_2: 0.37098127603530884 (0.37098127603530884) | > loss_disc_real_3: 0.3029109835624695 (0.3029109835624695) | > loss_disc_real_4: 0.2290283590555191 (0.2290283590555191) | > loss_disc_real_5: 0.43804389238357544 (0.43804389238357544) | > loss_0: 3.1468443870544434 (3.1468443870544434) | > loss_gen: 2.524261951446533 (2.524261951446533) | > loss_kl: 6.083269119262695 (6.083269119262695) | > loss_feat: 4.842771053314209 (4.842771053314209) | > loss_mel: 22.539535522460938 (22.539535522460938) | > loss_duration: 3.0536789894104004 (3.0536789894104004) | > loss_1: 39.04351806640625 (39.04351806640625)  --> STEP: 1 | > loss_disc: 2.5222997665405273 (2.5222997665405273) | > loss_disc_real_0: 0.13318297266960144 (0.13318297266960144) | > loss_disc_real_1: 0.31308382749557495 (0.31308382749557495) | > loss_disc_real_2: 0.20724697411060333 (0.20724697411060333) | > loss_disc_real_3: 0.3386342525482178 (0.3386342525482178) | > loss_disc_real_4: 0.19545063376426697 (0.19545063376426697) | > loss_disc_real_5: 0.21142186224460602 (0.21142186224460602) | > loss_0: 2.5222997665405273 (2.5222997665405273) | > loss_gen: 2.8784680366516113 (2.8784680366516113) | > loss_kl: 5.392457008361816 (5.392457008361816) | > loss_feat: 4.167603015899658 (4.167603015899658) | > loss_mel: 20.542522430419922 (20.542522430419922) | > loss_duration: 3.43693470954895 (3.43693470954895) | > loss_1: 36.41798782348633 (36.41798782348633)  --> STEP: 2 | > loss_disc: 2.8210268020629883 (2.671663284301758) | > loss_disc_real_0: 0.13555927574634552 (0.13437112420797348) | > loss_disc_real_1: 0.2469196766614914 (0.2800017520785332) | > loss_disc_real_2: 0.14158007502555847 (0.1744135245680809) | > loss_disc_real_3: 0.3978138566017151 (0.36822405457496643) | > loss_disc_real_4: 0.1028134897351265 (0.14913206174969673) | > loss_disc_real_5: 0.10590430349111557 (0.1586630828678608) | > loss_0: 2.8210268020629883 (2.671663284301758) | > loss_gen: 2.0292341709136963 (2.453851103782654) | > loss_kl: 5.707118511199951 (5.549787759780884) | > loss_feat: 11.566258430480957 (7.866930723190308) | > loss_mel: 25.220111846923828 (22.881317138671875) | > loss_duration: 3.201931953430176 (3.319433331489563) | > loss_1: 47.72465515136719 (42.07132148742676)  --> STEP: 3 | > loss_disc: 2.9278221130371094 (2.757049560546875) | > loss_disc_real_0: 0.3571600317955017 (0.20863409340381622) | > loss_disc_real_1: 0.3011375069618225 (0.28704700370629627) | > loss_disc_real_2: 0.28458958864212036 (0.2111388792594274) | > loss_disc_real_3: 0.27918243408203125 (0.3385435144106547) | > loss_disc_real_4: 0.24560841917991638 (0.18129084755976996) | > loss_disc_real_5: 0.2666213810443878 (0.19464918226003647) | > loss_0: 2.9278221130371094 (2.757049560546875) | > loss_gen: 1.8884938955307007 (2.265398701032003) | > loss_kl: 2.9526171684265137 (4.684064229329427) | > loss_feat: 0.34461456537246704 (5.359492003917694) | > loss_mel: 14.83800983428955 (20.200214703877766) | > loss_duration: 3.016580104827881 (3.218482255935669) | > loss_1: 23.04031753540039 (35.72765350341797) --> EVAL PERFORMANCE | > avg_loader_time: 0.01793559392293294 (-0.31055817149934317) | > avg_loss_disc: 2.757049560546875 (+0.023708684103829647) | > avg_loss_disc_real_0: 0.20863409340381622 (-0.04778854974678587) | > avg_loss_disc_real_1: 0.28704700370629627 (+0.03289364136400674) | > avg_loss_disc_real_2: 0.2111388792594274 (-0.0739719626449403) | > avg_loss_disc_real_3: 0.3385435144106547 (+0.125104077515148) | > avg_loss_disc_real_4: 0.18129084755976996 (-0.15096072967918148) | > avg_loss_disc_real_5: 0.19464918226003647 (-0.15360010441924843) | > avg_loss_0: 2.757049560546875 (+0.023708684103829647) | > avg_loss_gen: 2.265398701032003 (-0.23101042565845287) | > avg_loss_kl: 4.684064229329427 (+0.04743611244928214) | > avg_loss_feat: 5.359492003917694 (-2.032561608723232) | > avg_loss_mel: 20.200214703877766 (-1.8730288460141153) | > avg_loss_duration: 3.218482255935669 (+0.06470840317862381) | > avg_loss_1: 35.72765350341797 (-4.024454934256418)  > EPOCH: 1101/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:48:41)   --> TIME: 2023-10-20 13:48:53 -- STEP: 9/50 -- GLOBAL_STEP: 108060 | > loss_disc: 3.124415874481201 (2.4077228837543063) | > loss_disc_real_0: 0.23091453313827515 (0.15579080995586184) | > loss_disc_real_1: 0.4056154191493988 (0.27042951931556064) | > loss_disc_real_2: 0.40079715847969055 (0.2540268583430184) | > loss_disc_real_3: 0.30571261048316956 (0.2390805102056927) | > loss_disc_real_4: 0.3410418629646301 (0.2279116710027059) | > loss_disc_real_5: 0.43144020438194275 (0.2704539770881335) | > loss_0: 3.124415874481201 (2.4077228837543063) | > grad_norm_0: tensor(934.0320, device='cuda:0') (tensor(992.6377, device='cuda:0')) | > loss_gen: 2.369050979614258 (2.4755769968032837) | > loss_kl: 1.1368749141693115 (0.6855050110154681) | > loss_feat: 4.771575927734375 (5.625936998261346) | > loss_mel: 20.89386749267578 (18.586038483513725) | > loss_duration: 1.2693473100662231 (1.349888285001119) | > loss_1: 30.440717697143555 (28.72294595506456) | > grad_norm_1: tensor(4561.2993, device='cuda:0') (tensor(24010.9180, device='cuda:0')) | > current_lr_0: 6.650309901549601e-05 | > current_lr_1: 6.650309901549601e-05 | > step_time: 0.7209 (0.6848387718200684) | > loader_time: 0.0063 (0.02130558755662706)  --> TIME: 2023-10-20 13:49:13 -- STEP: 39/50 -- GLOBAL_STEP: 108090 | > loss_disc: 2.9634792804718018 (2.5684887109658656) | > loss_disc_real_0: 0.24576126039028168 (0.1624833596392702) | > loss_disc_real_1: 0.29624611139297485 (0.24090215095724815) | > loss_disc_real_2: 0.2464117556810379 (0.25034869997165143) | > loss_disc_real_3: 0.2504926919937134 (0.23019382529533827) | > loss_disc_real_4: 0.2570717930793762 (0.22439158268463918) | > loss_disc_real_5: 0.25666260719299316 (0.2328748335249913) | > loss_0: 2.9634792804718018 (2.5684887109658656) | > grad_norm_0: tensor(2026.8652, device='cuda:0') (tensor(1208.0483, device='cuda:0')) | > loss_gen: 1.6495338678359985 (2.193605300707695) | > loss_kl: 0.6778496503829956 (0.779593475545064) | > loss_feat: 0.15218660235404968 (4.920142537603776) | > loss_mel: 1.7440423965454102 (19.121122140150806) | > loss_duration: 1.3682159185409546 (1.336033011094118) | > loss_1: 5.591828346252441 (28.350496292114258) | > grad_norm_1: tensor(44710.3516, device='cuda:0') (tensor(29925.5000, device='cuda:0')) | > current_lr_0: 6.650309901549601e-05 | > current_lr_1: 6.650309901549601e-05 | > step_time: 0.6113 (0.6416508112198266) | > loader_time: 0.0491 (0.022476355234781902)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.153884172439575 (2.153884172439575) | > loss_disc_real_0: 0.25239595770835876 (0.25239595770835876) | > loss_disc_real_1: 0.2590736746788025 (0.2590736746788025) | > loss_disc_real_2: 0.24783150851726532 (0.24783150851726532) | > loss_disc_real_3: 0.3599870502948761 (0.3599870502948761) | > loss_disc_real_4: 0.11278439313173294 (0.11278439313173294) | > loss_disc_real_5: 0.07648973912000656 (0.07648973912000656) | > loss_0: 2.153884172439575 (2.153884172439575) | > loss_gen: 2.5812437534332275 (2.5812437534332275) | > loss_kl: 6.103979110717773 (6.103979110717773) | > loss_feat: 8.902910232543945 (8.902910232543945) | > loss_mel: 20.251100540161133 (20.251100540161133) | > loss_duration: 3.10599946975708 (3.10599946975708) | > loss_1: 40.94523239135742 (40.94523239135742)  --> STEP: 1 | > loss_disc: 2.584054470062256 (2.584054470062256) | > loss_disc_real_0: 0.16373826563358307 (0.16373826563358307) | > loss_disc_real_1: 0.21593300998210907 (0.21593300998210907) | > loss_disc_real_2: 0.28672659397125244 (0.28672659397125244) | > loss_disc_real_3: 0.16012805700302124 (0.16012805700302124) | > loss_disc_real_4: 0.1861310452222824 (0.1861310452222824) | > loss_disc_real_5: 0.24076437950134277 (0.24076437950134277) | > loss_0: 2.584054470062256 (2.584054470062256) | > loss_gen: 2.0758745670318604 (2.0758745670318604) | > loss_kl: 5.3686699867248535 (5.3686699867248535) | > loss_feat: 9.27591323852539 (9.27591323852539) | > loss_mel: 22.57284927368164 (22.57284927368164) | > loss_duration: 3.3301568031311035 (3.3301568031311035) | > loss_1: 42.62346267700195 (42.62346267700195)  --> STEP: 2 | > loss_disc: 3.120697021484375 (2.8523757457733154) | > loss_disc_real_0: 0.13883191347122192 (0.1512850895524025) | > loss_disc_real_1: 0.13524340093135834 (0.1755882054567337) | > loss_disc_real_2: 0.17358383536338806 (0.23015521466732025) | > loss_disc_real_3: 0.20102690160274506 (0.18057747930288315) | > loss_disc_real_4: 0.27993524074554443 (0.23303314298391342) | > loss_disc_real_5: 0.20647327601909637 (0.22361882776021957) | > loss_0: 3.120697021484375 (2.8523757457733154) | > loss_gen: 1.3672252893447876 (1.721549928188324) | > loss_kl: 5.5252909660339355 (5.4469804763793945) | > loss_feat: 8.663322448730469 (8.96961784362793) | > loss_mel: 21.163984298706055 (21.868416786193848) | > loss_duration: 3.185182809829712 (3.2576698064804077) | > loss_1: 39.90501022338867 (41.26423645019531)  --> STEP: 3 | > loss_disc: 2.8792428970336914 (2.8613314628601074) | > loss_disc_real_0: 0.23000216484069824 (0.17752411464850107) | > loss_disc_real_1: 0.27725717425346375 (0.2094778617223104) | > loss_disc_real_2: 0.3280438482761383 (0.26278475920359295) | > loss_disc_real_3: 0.349101185798645 (0.23675204813480377) | > loss_disc_real_4: 0.3513549864292145 (0.2724737574656804) | > loss_disc_real_5: 0.31856170296669006 (0.2552664528290431) | > loss_0: 2.8792428970336914 (2.8613314628601074) | > loss_gen: 2.199321746826172 (1.8808072010676067) | > loss_kl: 2.7788097858428955 (4.5575902462005615) | > loss_feat: 3.228506088256836 (7.055913925170898) | > loss_mel: 20.78995704650879 (21.508930206298828) | > loss_duration: 3.0099868774414062 (3.1751088301340737) | > loss_1: 32.0065803527832 (38.178351084391274) --> EVAL PERFORMANCE | > avg_loader_time: 0.012169599533081055 (-0.005765994389851887) | > avg_loss_disc: 2.8613314628601074 (+0.10428190231323242) | > avg_loss_disc_real_0: 0.17752411464850107 (-0.031109978755315154) | > avg_loss_disc_real_1: 0.2094778617223104 (-0.07756914198398587) | > avg_loss_disc_real_2: 0.26278475920359295 (+0.05164587994416556) | > avg_loss_disc_real_3: 0.23675204813480377 (-0.10179146627585095) | > avg_loss_disc_real_4: 0.2724737574656804 (+0.09118290990591046) | > avg_loss_disc_real_5: 0.2552664528290431 (+0.06061727056900662) | > avg_loss_0: 2.8613314628601074 (+0.10428190231323242) | > avg_loss_gen: 1.8808072010676067 (-0.38459149996439623) | > avg_loss_kl: 4.5575902462005615 (-0.12647398312886526) | > avg_loss_feat: 7.055913925170898 (+1.6964219212532043) | > avg_loss_mel: 21.508930206298828 (+1.3087155024210624) | > avg_loss_duration: 3.1751088301340737 (-0.0433734258015952) | > avg_loss_1: 38.178351084391274 (+2.450697580973305)  > EPOCH: 1102/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:49:37)   --> TIME: 2023-10-20 13:50:03 -- STEP: 19/50 -- GLOBAL_STEP: 108120 | > loss_disc: 2.5507712364196777 (2.566947435077868) | > loss_disc_real_0: 0.11588110029697418 (0.15502684622218735) | > loss_disc_real_1: 0.22763358056545258 (0.23589127628426804) | > loss_disc_real_2: 0.2668265402317047 (0.2570482237558616) | > loss_disc_real_3: 0.25942137837409973 (0.24727912325608112) | > loss_disc_real_4: 0.22255991399288177 (0.2607192208892421) | > loss_disc_real_5: 0.4159059524536133 (0.25426212286478594) | > loss_0: 2.5507712364196777 (2.566947435077868) | > grad_norm_0: tensor(1361.1748, device='cuda:0') (tensor(1383.4285, device='cuda:0')) | > loss_gen: 2.2533559799194336 (2.2697770470067073) | > loss_kl: 0.6192032694816589 (0.8583404986481917) | > loss_feat: 4.6480512619018555 (5.446682879015019) | > loss_mel: 28.618478775024414 (21.575640552922298) | > loss_duration: 1.4393198490142822 (1.3782040068977757) | > loss_1: 37.57841110229492 (31.528645816602204) | > grad_norm_1: tensor(14956.2656, device='cuda:0') (tensor(30614.5039, device='cuda:0')) | > current_lr_0: 6.643662500431367e-05 | > current_lr_1: 6.643662500431367e-05 | > step_time: 0.7514 (0.4727253662912469) | > loader_time: 0.0244 (0.011221032393606086)  --> TIME: 2023-10-20 13:50:25 -- STEP: 49/50 -- GLOBAL_STEP: 108150 | > loss_disc: 2.8508129119873047 (2.6147577081407816) | > loss_disc_real_0: 0.15475283563137054 (0.1704497154117847) | > loss_disc_real_1: 0.22616975009441376 (0.23307614879948751) | > loss_disc_real_2: 0.3375692069530487 (0.23876131394383862) | > loss_disc_real_3: 0.2732795774936676 (0.2374902388309034) | > loss_disc_real_4: 0.2567889988422394 (0.23560863733291626) | > loss_disc_real_5: 0.2373666912317276 (0.24413721544706096) | > loss_0: 2.8508129119873047 (2.6147577081407816) | > grad_norm_0: tensor(979.7449, device='cuda:0') (tensor(1344.5706, device='cuda:0')) | > loss_gen: 1.7391754388809204 (2.1105122103983036) | > loss_kl: 0.651545524597168 (0.7974734677343952) | > loss_feat: 0.7740700244903564 (4.519913213137462) | > loss_mel: 17.043407440185547 (19.08942456391393) | > loss_duration: 1.3926939964294434 (1.3341586249215263) | > loss_1: 21.600893020629883 (27.851482585984833) | > grad_norm_1: tensor(8522.8799, device='cuda:0') (tensor(30710.3047, device='cuda:0')) | > current_lr_0: 6.643662500431367e-05 | > current_lr_1: 6.643662500431367e-05 | > step_time: 0.546 (0.5991938698048496) | > loader_time: 0.4614 (0.026166268757411407)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.551266670227051 (2.551266670227051) | > loss_disc_real_0: 0.5559020638465881 (0.5559020638465881) | > loss_disc_real_1: 0.31769412755966187 (0.31769412755966187) | > loss_disc_real_2: 0.3026735484600067 (0.3026735484600067) | > loss_disc_real_3: 0.23984993994235992 (0.23984993994235992) | > loss_disc_real_4: 0.13400979340076447 (0.13400979340076447) | > loss_disc_real_5: 0.19321094453334808 (0.19321094453334808) | > loss_0: 2.551266670227051 (2.551266670227051) | > loss_gen: 3.1615004539489746 (3.1615004539489746) | > loss_kl: 5.485410690307617 (5.485410690307617) | > loss_feat: 6.018579959869385 (6.018579959869385) | > loss_mel: 21.26184844970703 (21.26184844970703) | > loss_duration: 3.1273446083068848 (3.1273446083068848) | > loss_1: 39.054683685302734 (39.054683685302734)  --> STEP: 1 | > loss_disc: 2.424023151397705 (2.424023151397705) | > loss_disc_real_0: 0.36472493410110474 (0.36472493410110474) | > loss_disc_real_1: 0.20546579360961914 (0.20546579360961914) | > loss_disc_real_2: 0.29684460163116455 (0.29684460163116455) | > loss_disc_real_3: 0.2632984519004822 (0.2632984519004822) | > loss_disc_real_4: 0.3428210914134979 (0.3428210914134979) | > loss_disc_real_5: 0.2669074833393097 (0.2669074833393097) | > loss_0: 2.424023151397705 (2.424023151397705) | > loss_gen: 3.3697071075439453 (3.3697071075439453) | > loss_kl: 5.65954065322876 (5.65954065322876) | > loss_feat: 8.318115234375 (8.318115234375) | > loss_mel: 22.176542282104492 (22.176542282104492) | > loss_duration: 3.346806049346924 (3.346806049346924) | > loss_1: 42.87070846557617 (42.87070846557617)  --> STEP: 2 | > loss_disc: 3.9924402236938477 (3.2082316875457764) | > loss_disc_real_0: 0.554480254650116 (0.45960259437561035) | > loss_disc_real_1: 0.43157708644866943 (0.3185214400291443) | > loss_disc_real_2: 0.4518974721431732 (0.3743710368871689) | > loss_disc_real_3: 0.3275003433227539 (0.29539939761161804) | > loss_disc_real_4: 0.30304959416389465 (0.3229353427886963) | > loss_disc_real_5: 0.3637908697128296 (0.31534917652606964) | > loss_0: 3.9924402236938477 (3.2082316875457764) | > loss_gen: 1.9496111869812012 (2.6596591472625732) | > loss_kl: 5.4359002113342285 (5.547720432281494) | > loss_feat: 7.357210636138916 (7.837662935256958) | > loss_mel: 23.092153549194336 (22.634347915649414) | > loss_duration: 3.234994888305664 (3.290900468826294) | > loss_1: 41.06986999511719 (41.97028923034668)  --> STEP: 3 | > loss_disc: 3.115908622741699 (3.177457332611084) | > loss_disc_real_0: 0.5764792561531067 (0.4985614816347758) | > loss_disc_real_1: 0.27498215436935425 (0.3040083448092143) | > loss_disc_real_2: 0.2851138114929199 (0.34461862842241925) | > loss_disc_real_3: 0.34930893778800964 (0.3133692443370819) | > loss_disc_real_4: 0.2926686704158783 (0.31284645199775696) | > loss_disc_real_5: 0.3242565393447876 (0.3183182974656423) | > loss_0: 3.115908622741699 (3.177457332611084) | > loss_gen: 3.080049753189087 (2.7997893492380777) | > loss_kl: 2.5407602787017822 (4.545400381088257) | > loss_feat: 5.017244338989258 (6.897523403167725) | > loss_mel: 22.284271240234375 (22.517655690511067) | > loss_duration: 3.0854151248931885 (3.2224053541819253) | > loss_1: 36.00774002075195 (39.98277282714844) --> EVAL PERFORMANCE | > avg_loader_time: 0.00690770149230957 (-0.005261898040771484) | > avg_loss_disc: 3.177457332611084 (+0.31612586975097656) | > avg_loss_disc_real_0: 0.4985614816347758 (+0.3210373669862747) | > avg_loss_disc_real_1: 0.3040083448092143 (+0.0945304830869039) | > avg_loss_disc_real_2: 0.34461862842241925 (+0.0818338692188263) | > avg_loss_disc_real_3: 0.3133692443370819 (+0.07661719620227814) | > avg_loss_disc_real_4: 0.31284645199775696 (+0.040372694532076536) | > avg_loss_disc_real_5: 0.3183182974656423 (+0.06305184463659919) | > avg_loss_0: 3.177457332611084 (+0.31612586975097656) | > avg_loss_gen: 2.7997893492380777 (+0.918982148170471) | > avg_loss_kl: 4.545400381088257 (-0.012189865112304688) | > avg_loss_feat: 6.897523403167725 (-0.15839052200317383) | > avg_loss_mel: 22.517655690511067 (+1.0087254842122384) | > avg_loss_duration: 3.2224053541819253 (+0.04729652404785156) | > avg_loss_1: 39.98277282714844 (+1.8044217427571638)  > EPOCH: 1103/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:50:51)   --> TIME: 2023-10-20 13:51:17 -- STEP: 29/50 -- GLOBAL_STEP: 108180 | > loss_disc: 2.760643482208252 (2.5216904426443167) | > loss_disc_real_0: 0.08242607861757278 (0.16005447840896145) | > loss_disc_real_1: 0.35110408067703247 (0.22695767108736367) | > loss_disc_real_2: 0.2262442409992218 (0.23001151763159652) | > loss_disc_real_3: 0.315980464220047 (0.23913731837067112) | > loss_disc_real_4: 0.28570395708084106 (0.2342287689961236) | > loss_disc_real_5: 0.25978949666023254 (0.24872938697708058) | > loss_0: 2.760643482208252 (2.5216904426443167) | > grad_norm_0: tensor(487.8646, device='cuda:0') (tensor(1347.5355, device='cuda:0')) | > loss_gen: 2.474736452102661 (2.224438223345526) | > loss_kl: 1.1209737062454224 (0.8368235292105839) | > loss_feat: 5.702601909637451 (5.410510239929988) | > loss_mel: 25.51348304748535 (19.976925109994824) | > loss_duration: 1.3851526975631714 (1.3485806358271633) | > loss_1: 36.19694519042969 (29.797277664316113) | > grad_norm_1: tensor(12183.9727, device='cuda:0') (tensor(43178.2656, device='cuda:0')) | > current_lr_0: 6.63702174380674e-05 | > current_lr_1: 6.63702174380674e-05 | > step_time: 0.3638 (0.6546875772805051) | > loader_time: 0.005 (0.02288014313270306)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2765045166015625 (2.2765045166015625) | > loss_disc_real_0: 0.05218398943543434 (0.05218398943543434) | > loss_disc_real_1: 0.1716056615114212 (0.1716056615114212) | > loss_disc_real_2: 0.2642250657081604 (0.2642250657081604) | > loss_disc_real_3: 0.2656928598880768 (0.2656928598880768) | > loss_disc_real_4: 0.2762989103794098 (0.2762989103794098) | > loss_disc_real_5: 0.2746042013168335 (0.2746042013168335) | > loss_0: 2.2765045166015625 (2.2765045166015625) | > loss_gen: 2.2845351696014404 (2.2845351696014404) | > loss_kl: 6.073388576507568 (6.073388576507568) | > loss_feat: 4.638955116271973 (4.638955116271973) | > loss_mel: 27.375810623168945 (27.375810623168945) | > loss_duration: 3.0750277042388916 (3.0750277042388916) | > loss_1: 43.447715759277344 (43.447715759277344)  --> STEP: 1 | > loss_disc: 2.977786064147949 (2.977786064147949) | > loss_disc_real_0: 0.22209298610687256 (0.22209298610687256) | > loss_disc_real_1: 0.26965823769569397 (0.26965823769569397) | > loss_disc_real_2: 0.277601420879364 (0.277601420879364) | > loss_disc_real_3: 0.2853856086730957 (0.2853856086730957) | > loss_disc_real_4: 0.22917865216732025 (0.22917865216732025) | > loss_disc_real_5: 0.32380959391593933 (0.32380959391593933) | > loss_0: 2.977786064147949 (2.977786064147949) | > loss_gen: 1.6523140668869019 (1.6523140668869019) | > loss_kl: 5.569201469421387 (5.569201469421387) | > loss_feat: 0.37323105335235596 (0.37323105335235596) | > loss_mel: 16.500028610229492 (16.500028610229492) | > loss_duration: 3.4533679485321045 (3.4533679485321045) | > loss_1: 27.548141479492188 (27.548141479492188)  --> STEP: 2 | > loss_disc: 2.6138458251953125 (2.795815944671631) | > loss_disc_real_0: 0.046027772128582 (0.13406037911772728) | > loss_disc_real_1: 0.11640148609876633 (0.19302986189723015) | > loss_disc_real_2: 0.24124185740947723 (0.2594216391444206) | > loss_disc_real_3: 0.2394265979528427 (0.2624061033129692) | > loss_disc_real_4: 0.2964532971382141 (0.2628159746527672) | > loss_disc_real_5: 0.3301118016242981 (0.3269606977701187) | > loss_0: 2.6138458251953125 (2.795815944671631) | > loss_gen: 1.879457950592041 (1.7658860087394714) | > loss_kl: 5.9748005867004395 (5.772001028060913) | > loss_feat: 6.390111923217773 (3.3816714882850647) | > loss_mel: 23.815311431884766 (20.15767002105713) | > loss_duration: 3.1678054332733154 (3.31058669090271) | > loss_1: 41.22748565673828 (34.387813568115234)  --> STEP: 3 | > loss_disc: 2.8955235481262207 (2.8290518124898276) | > loss_disc_real_0: 0.39328011870384216 (0.22046695897976556) | > loss_disc_real_1: 0.2926727831363678 (0.2262441689769427) | > loss_disc_real_2: 0.33913490176200867 (0.28599272668361664) | > loss_disc_real_3: 0.36460259556770325 (0.29647160073121387) | > loss_disc_real_4: 0.39304250478744507 (0.30622481803099316) | > loss_disc_real_5: 0.3271653652191162 (0.32702892025311786) | > loss_0: 2.8955235481262207 (2.8290518124898276) | > loss_gen: 2.713831901550293 (2.081867973009745) | > loss_kl: 2.6422204971313477 (4.728740851084392) | > loss_feat: 3.6078848838806152 (3.4570759534835815) | > loss_mel: 20.800033569335938 (20.37179120381673) | > loss_duration: 3.0393543243408203 (3.2201759020487466) | > loss_1: 32.803321838378906 (33.859649658203125) --> EVAL PERFORMANCE | > avg_loader_time: 0.013389666875203451 (+0.006481965382893881) | > avg_loss_disc: 2.8290518124898276 (-0.34840552012125636) | > avg_loss_disc_real_0: 0.22046695897976556 (-0.2780945226550102) | > avg_loss_disc_real_1: 0.2262441689769427 (-0.0777641758322716) | > avg_loss_disc_real_2: 0.28599272668361664 (-0.05862590173880261) | > avg_loss_disc_real_3: 0.29647160073121387 (-0.01689764360586804) | > avg_loss_disc_real_4: 0.30622481803099316 (-0.006621633966763796) | > avg_loss_disc_real_5: 0.32702892025311786 (+0.008710622787475586) | > avg_loss_0: 2.8290518124898276 (-0.34840552012125636) | > avg_loss_gen: 2.081867973009745 (-0.7179213762283325) | > avg_loss_kl: 4.728740851084392 (+0.18334046999613474) | > avg_loss_feat: 3.4570759534835815 (-3.440447449684143) | > avg_loss_mel: 20.37179120381673 (-2.145864486694336) | > avg_loss_duration: 3.2201759020487466 (-0.002229452133178711) | > avg_loss_1: 33.859649658203125 (-6.1231231689453125)  > EPOCH: 1104/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:51:42)   --> TIME: 2023-10-20 13:51:55 -- STEP: 9/50 -- GLOBAL_STEP: 108210 | > loss_disc: 2.9347782135009766 (2.679782403839959) | > loss_disc_real_0: 0.22447651624679565 (0.21135149399439493) | > loss_disc_real_1: 0.24591565132141113 (0.23352708336379793) | > loss_disc_real_2: 0.2538762092590332 (0.23411434557702807) | > loss_disc_real_3: 0.2992989718914032 (0.2390483965476354) | > loss_disc_real_4: 0.2574852406978607 (0.2248389890624417) | > loss_disc_real_5: 0.37163132429122925 (0.24215666535827848) | > loss_0: 2.9347782135009766 (2.679782403839959) | > grad_norm_0: tensor(647.7177, device='cuda:0') (tensor(1318.5162, device='cuda:0')) | > loss_gen: 1.7186061143875122 (2.0127806531058416) | > loss_kl: 0.843590259552002 (0.7931837207741208) | > loss_feat: 0.29610782861709595 (5.049097704390685) | > loss_mel: 10.856425285339355 (17.254553622669643) | > loss_duration: 1.2881569862365723 (1.327256096733941) | > loss_1: 15.002885818481445 (26.43687195248074) | > grad_norm_1: tensor(47706.4609, device='cuda:0') (tensor(36116.1445, device='cuda:0')) | > current_lr_0: 6.630387625034135e-05 | > current_lr_1: 6.630387625034135e-05 | > step_time: 0.7351 (0.7735859023200141) | > loader_time: 0.0166 (0.03393144077724881)  --> TIME: 2023-10-20 13:52:15 -- STEP: 39/50 -- GLOBAL_STEP: 108240 | > loss_disc: 2.0448989868164062 (2.62257163035564) | > loss_disc_real_0: 0.13460811972618103 (0.18812646325200033) | > loss_disc_real_1: 0.22229479253292084 (0.23861847416712686) | > loss_disc_real_2: 0.12111090868711472 (0.2357336071630319) | > loss_disc_real_3: 0.25823792815208435 (0.24208826132309738) | > loss_disc_real_4: 0.1555183231830597 (0.24244803104263085) | > loss_disc_real_5: 0.07134000211954117 (0.24047014690362495) | > loss_0: 2.0448989868164062 (2.62257163035564) | > grad_norm_0: tensor(608.1513, device='cuda:0') (tensor(778.7761, device='cuda:0')) | > loss_gen: 2.527191162109375 (2.096510948278966) | > loss_kl: 0.47883668541908264 (0.8171769563968365) | > loss_feat: 7.175069808959961 (4.319838555434193) | > loss_mel: 19.4326171875 (17.050869189775906) | > loss_duration: 1.4240200519561768 (1.3254182919477806) | > loss_1: 31.037734985351562 (25.60981386135786) | > grad_norm_1: tensor(46285.6758, device='cuda:0') (tensor(25645.5059, device='cuda:0')) | > current_lr_0: 6.630387625034135e-05 | > current_lr_1: 6.630387625034135e-05 | > step_time: 0.4962 (0.6603158804086539) | > loader_time: 0.0132 (0.023962858395698745)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.179692268371582 (2.179692268371582) | > loss_disc_real_0: 0.11275045573711395 (0.11275045573711395) | > loss_disc_real_1: 0.20639345049858093 (0.20639345049858093) | > loss_disc_real_2: 0.21399056911468506 (0.21399056911468506) | > loss_disc_real_3: 0.2651677429676056 (0.2651677429676056) | > loss_disc_real_4: 0.20413339138031006 (0.20413339138031006) | > loss_disc_real_5: 0.21429584920406342 (0.21429584920406342) | > loss_0: 2.179692268371582 (2.179692268371582) | > loss_gen: 2.7550995349884033 (2.7550995349884033) | > loss_kl: 6.729668617248535 (6.729668617248535) | > loss_feat: 7.814179420471191 (7.814179420471191) | > loss_mel: 21.0985050201416 (21.0985050201416) | > loss_duration: 3.0728330612182617 (3.0728330612182617) | > loss_1: 41.47028732299805 (41.47028732299805)  --> STEP: 1 | > loss_disc: 2.6936593055725098 (2.6936593055725098) | > loss_disc_real_0: 0.29015079140663147 (0.29015079140663147) | > loss_disc_real_1: 0.19129551947116852 (0.19129551947116852) | > loss_disc_real_2: 0.19589939713478088 (0.19589939713478088) | > loss_disc_real_3: 0.33914056420326233 (0.33914056420326233) | > loss_disc_real_4: 0.36304301023483276 (0.36304301023483276) | > loss_disc_real_5: 0.2553699314594269 (0.2553699314594269) | > loss_0: 2.6936593055725098 (2.6936593055725098) | > loss_gen: 2.5339834690093994 (2.5339834690093994) | > loss_kl: 5.319204807281494 (5.319204807281494) | > loss_feat: 7.641537666320801 (7.641537666320801) | > loss_mel: 24.09977912902832 (24.09977912902832) | > loss_duration: 3.2864294052124023 (3.2864294052124023) | > loss_1: 42.88093948364258 (42.88093948364258)  --> STEP: 2 | > loss_disc: 2.863215446472168 (2.778437376022339) | > loss_disc_real_0: 0.2675183415412903 (0.2788345664739609) | > loss_disc_real_1: 0.18155871331691742 (0.18642711639404297) | > loss_disc_real_2: 0.37530773878097534 (0.2856035679578781) | > loss_disc_real_3: 0.33593490719795227 (0.3375377357006073) | > loss_disc_real_4: 0.2588751018047333 (0.310959056019783) | > loss_disc_real_5: 0.18700359761714935 (0.22118676453828812) | > loss_0: 2.863215446472168 (2.778437376022339) | > loss_gen: 2.1557650566101074 (2.3448742628097534) | > loss_kl: 5.963617324829102 (5.641411066055298) | > loss_feat: 8.186820983886719 (7.91417932510376) | > loss_mel: 21.894575119018555 (22.997177124023438) | > loss_duration: 3.093893527984619 (3.1901614665985107) | > loss_1: 41.294673919677734 (42.087806701660156)  --> STEP: 3 | > loss_disc: 3.0282821655273438 (2.8617189725240073) | > loss_disc_real_0: 0.37405288219451904 (0.3105740050474803) | > loss_disc_real_1: 0.26367828249931335 (0.21217750509579977) | > loss_disc_real_2: 0.2599601149559021 (0.2770557502905528) | > loss_disc_real_3: 0.26634085178375244 (0.3138054410616557) | > loss_disc_real_4: 0.27642956376075745 (0.2994492252667745) | > loss_disc_real_5: 0.2844308018684387 (0.24226811031500498) | > loss_0: 3.0282821655273438 (2.8617189725240073) | > loss_gen: 1.7285044193267822 (2.1394176483154297) | > loss_kl: 2.8690035343170166 (4.717275222142537) | > loss_feat: 0.011376691982150078 (5.27991178072989) | > loss_mel: 1.1524052619934082 (15.715586503346762) | > loss_duration: 2.9477100372314453 (3.1093443234761557) | > loss_1: 8.708999633789062 (30.961537679036457) --> EVAL PERFORMANCE | > avg_loader_time: 0.016197681427001953 (+0.002808014551798502) | > avg_loss_disc: 2.8617189725240073 (+0.03266716003417969) | > avg_loss_disc_real_0: 0.3105740050474803 (+0.09010704606771472) | > avg_loss_disc_real_1: 0.21217750509579977 (-0.014066663881142916) | > avg_loss_disc_real_2: 0.2770557502905528 (-0.008936976393063845) | > avg_loss_disc_real_3: 0.3138054410616557 (+0.01733384033044183) | > avg_loss_disc_real_4: 0.2994492252667745 (-0.006775592764218685) | > avg_loss_disc_real_5: 0.24226811031500498 (-0.08476080993811289) | > avg_loss_0: 2.8617189725240073 (+0.03266716003417969) | > avg_loss_gen: 2.1394176483154297 (+0.057549675305684556) | > avg_loss_kl: 4.717275222142537 (-0.011465628941854433) | > avg_loss_feat: 5.27991178072989 (+1.8228358272463083) | > avg_loss_mel: 15.715586503346762 (-4.656204700469969) | > avg_loss_duration: 3.1093443234761557 (-0.11083157857259085) | > avg_loss_1: 30.961537679036457 (-2.898111979166668)  > EPOCH: 1105/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:52:37)   --> TIME: 2023-10-20 13:52:56 -- STEP: 19/50 -- GLOBAL_STEP: 108270 | > loss_disc: 2.043860673904419 (2.480900613885177) | > loss_disc_real_0: 0.08037795126438141 (0.14685450435469025) | > loss_disc_real_1: 0.17146216332912445 (0.22557688739738965) | > loss_disc_real_2: 0.17402036488056183 (0.24238130214967227) | > loss_disc_real_3: 0.16319231688976288 (0.2485537772115908) | > loss_disc_real_4: 0.208039790391922 (0.23382456796733955) | > loss_disc_real_5: 0.2192426472902298 (0.22668288206975712) | > loss_0: 2.043860673904419 (2.480900613885177) | > grad_norm_0: tensor(401.2152, device='cuda:0') (tensor(692.6137, device='cuda:0')) | > loss_gen: 2.365793466567993 (2.341467813441628) | > loss_kl: 0.7994192838668823 (0.8387453132554105) | > loss_feat: 4.746801853179932 (5.359894202482936) | > loss_mel: 23.74944305419922 (20.740687614993046) | > loss_duration: 1.4081108570098877 (1.3455570277414823) | > loss_1: 33.0695686340332 (30.626352385470742) | > grad_norm_1: tensor(16315.2217, device='cuda:0') (tensor(25019.1562, device='cuda:0')) | > current_lr_0: 6.623760137478598e-05 | > current_lr_1: 6.623760137478598e-05 | > step_time: 0.3266 (0.6596526597675524) | > loader_time: 0.0204 (0.023898212533248097)  --> TIME: 2023-10-20 13:53:08 -- STEP: 49/50 -- GLOBAL_STEP: 108300 | > loss_disc: 3.0369513034820557 (2.4856212260771766) | > loss_disc_real_0: 0.18394729495048523 (0.14066984306792826) | > loss_disc_real_1: 0.2458474487066269 (0.22136869357556713) | > loss_disc_real_2: 0.2683486044406891 (0.22532441033696643) | > loss_disc_real_3: 0.2689555883407593 (0.24730826921913085) | > loss_disc_real_4: 0.2757347524166107 (0.23662944305308012) | > loss_disc_real_5: 0.2590046226978302 (0.23133566287555257) | > loss_0: 3.0369513034820557 (2.4856212260771766) | > grad_norm_0: tensor(663.3480, device='cuda:0') (tensor(590.5193, device='cuda:0')) | > loss_gen: 1.5168859958648682 (2.2700596536908826) | > loss_kl: 0.80328369140625 (0.7950979507699305) | > loss_feat: 0.3141534924507141 (5.4926820332564565) | > loss_mel: 9.773933410644531 (20.657752209780167) | > loss_duration: 1.3908065557479858 (1.3193550912701353) | > loss_1: 13.799062728881836 (30.534947249354147) | > grad_norm_1: tensor(7511.8696, device='cuda:0') (tensor(15686.0791, device='cuda:0')) | > current_lr_0: 6.623760137478598e-05 | > current_lr_1: 6.623760137478598e-05 | > step_time: 0.7429 (0.48485966118014584) | > loader_time: 0.422 (0.022420221445511798)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9286108016967773 (2.9286108016967773) | > loss_disc_real_0: 0.21537725627422333 (0.21537725627422333) | > loss_disc_real_1: 0.2903006672859192 (0.2903006672859192) | > loss_disc_real_2: 0.3619600236415863 (0.3619600236415863) | > loss_disc_real_3: 0.2657773494720459 (0.2657773494720459) | > loss_disc_real_4: 0.4377095103263855 (0.4377095103263855) | > loss_disc_real_5: 0.3708612620830536 (0.3708612620830536) | > loss_0: 2.9286108016967773 (2.9286108016967773) | > loss_gen: 2.324357271194458 (2.324357271194458) | > loss_kl: 5.338787078857422 (5.338787078857422) | > loss_feat: 4.576285362243652 (4.576285362243652) | > loss_mel: 22.221027374267578 (22.221027374267578) | > loss_duration: 3.0221948623657227 (3.0221948623657227) | > loss_1: 37.48265075683594 (37.48265075683594)  --> STEP: 1 | > loss_disc: 2.7031617164611816 (2.7031617164611816) | > loss_disc_real_0: 0.2607036828994751 (0.2607036828994751) | > loss_disc_real_1: 0.34078121185302734 (0.34078121185302734) | > loss_disc_real_2: 0.28800034523010254 (0.28800034523010254) | > loss_disc_real_3: 0.24186201393604279 (0.24186201393604279) | > loss_disc_real_4: 0.35194048285484314 (0.35194048285484314) | > loss_disc_real_5: 0.3546401858329773 (0.3546401858329773) | > loss_0: 2.7031617164611816 (2.7031617164611816) | > loss_gen: 2.892437696456909 (2.892437696456909) | > loss_kl: 5.8644609451293945 (5.8644609451293945) | > loss_feat: 7.256997585296631 (7.256997585296631) | > loss_mel: 22.116422653198242 (22.116422653198242) | > loss_duration: 3.4704413414001465 (3.4704413414001465) | > loss_1: 41.60075759887695 (41.60075759887695)  --> STEP: 2 | > loss_disc: 3.38769268989563 (3.0454272031784058) | > loss_disc_real_0: 0.5886005759239197 (0.4246521294116974) | > loss_disc_real_1: 0.4588744342327118 (0.39982782304286957) | > loss_disc_real_2: 0.3913842439651489 (0.33969229459762573) | > loss_disc_real_3: 0.31894198060035706 (0.2804019972681999) | > loss_disc_real_4: 0.39094364643096924 (0.3714420646429062) | > loss_disc_real_5: 0.29274222254753113 (0.3236912041902542) | > loss_0: 3.38769268989563 (3.0454272031784058) | > loss_gen: 2.44085955619812 (2.6666486263275146) | > loss_kl: 5.773411750793457 (5.818936347961426) | > loss_feat: 4.765689849853516 (6.011343717575073) | > loss_mel: 26.415403366088867 (24.265913009643555) | > loss_duration: 3.1638801097869873 (3.317160725593567) | > loss_1: 42.55924606323242 (42.08000183105469)  --> STEP: 3 | > loss_disc: 2.826083183288574 (2.9723125298817954) | > loss_disc_real_0: 0.4282044768333435 (0.4258362452189128) | > loss_disc_real_1: 0.2125328779220581 (0.33739617466926575) | > loss_disc_real_2: 0.35479557514190674 (0.3447267214457194) | > loss_disc_real_3: 0.2362155169248581 (0.265673170487086) | > loss_disc_real_4: 0.3216707706451416 (0.354851633310318) | > loss_disc_real_5: 0.3234292268753052 (0.32360387841860455) | > loss_0: 2.826083183288574 (2.9723125298817954) | > loss_gen: 2.541729211807251 (2.6250088214874268) | > loss_kl: 2.602491855621338 (4.7467881838480634) | > loss_feat: 2.6975226402282715 (4.906736691792806) | > loss_mel: 18.957094192504883 (22.496306737263996) | > loss_duration: 2.949138879776001 (3.1944867769877114) | > loss_1: 29.747976303100586 (37.969326655069985) --> EVAL PERFORMANCE | > avg_loader_time: 0.014747381210327148 (-0.0014503002166748047) | > avg_loss_disc: 2.9723125298817954 (+0.11059355735778809) | > avg_loss_disc_real_0: 0.4258362452189128 (+0.1152622401714325) | > avg_loss_disc_real_1: 0.33739617466926575 (+0.12521866957346597) | > avg_loss_disc_real_2: 0.3447267214457194 (+0.06767097115516663) | > avg_loss_disc_real_3: 0.265673170487086 (-0.0481322705745697) | > avg_loss_disc_real_4: 0.354851633310318 (+0.055402408043543516) | > avg_loss_disc_real_5: 0.32360387841860455 (+0.08133576810359958) | > avg_loss_0: 2.9723125298817954 (+0.11059355735778809) | > avg_loss_gen: 2.6250088214874268 (+0.48559117317199707) | > avg_loss_kl: 4.7467881838480634 (+0.029512961705526308) | > avg_loss_feat: 4.906736691792806 (-0.3731750889370842) | > avg_loss_mel: 22.496306737263996 (+6.7807202339172346) | > avg_loss_duration: 3.1944867769877114 (+0.0851424535115557) | > avg_loss_1: 37.969326655069985 (+7.0077889760335275)  > EPOCH: 1106/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:53:21)   --> TIME: 2023-10-20 13:53:46 -- STEP: 29/50 -- GLOBAL_STEP: 108330 | > loss_disc: 2.221944570541382 (2.436816984209521) | > loss_disc_real_0: 0.11117354780435562 (0.1433737251008379) | > loss_disc_real_1: 0.17966540157794952 (0.2267082829413743) | > loss_disc_real_2: 0.1490601897239685 (0.21516702683835193) | > loss_disc_real_3: 0.3110704720020294 (0.2317798201893938) | > loss_disc_real_4: 0.29628613591194153 (0.2255413393522131) | > loss_disc_real_5: 0.2368129938840866 (0.22277678780514618) | > loss_0: 2.221944570541382 (2.436816984209521) | > grad_norm_0: tensor(217.6882, device='cuda:0') (tensor(460.2236, device='cuda:0')) | > loss_gen: 2.420372247695923 (2.245213738803206) | > loss_kl: 0.9684141278266907 (0.7978622050120913) | > loss_feat: 5.620326995849609 (5.658567844472569) | > loss_mel: 21.43838882446289 (20.886061121677532) | > loss_duration: 1.3065621852874756 (1.3460548129575007) | > loss_1: 31.754064559936523 (30.93375952490445) | > grad_norm_1: tensor(3452.1489, device='cuda:0') (tensor(20181.6406, device='cuda:0')) | > current_lr_0: 6.617139274511817e-05 | > current_lr_1: 6.617139274511817e-05 | > step_time: 0.8336 (0.6585691550682331) | > loader_time: 0.0312 (0.023045589183938914)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1541595458984375 (3.1541595458984375) | > loss_disc_real_0: 0.5301514863967896 (0.5301514863967896) | > loss_disc_real_1: 0.34846508502960205 (0.34846508502960205) | > loss_disc_real_2: 0.20778578519821167 (0.20778578519821167) | > loss_disc_real_3: 0.3778783977031708 (0.3778783977031708) | > loss_disc_real_4: 0.37111636996269226 (0.37111636996269226) | > loss_disc_real_5: 0.3790130615234375 (0.3790130615234375) | > loss_0: 3.1541595458984375 (3.1541595458984375) | > loss_gen: 2.527583122253418 (2.527583122253418) | > loss_kl: 5.08134651184082 (5.08134651184082) | > loss_feat: 3.9866137504577637 (3.9866137504577637) | > loss_mel: 19.135143280029297 (19.135143280029297) | > loss_duration: 3.086686849594116 (3.086686849594116) | > loss_1: 33.8173713684082 (33.8173713684082)  --> STEP: 1 | > loss_disc: 3.07932448387146 (3.07932448387146) | > loss_disc_real_0: 0.17865265905857086 (0.17865265905857086) | > loss_disc_real_1: 0.22935613989830017 (0.22935613989830017) | > loss_disc_real_2: 0.3514423966407776 (0.3514423966407776) | > loss_disc_real_3: 0.18550187349319458 (0.18550187349319458) | > loss_disc_real_4: 0.36304786801338196 (0.36304786801338196) | > loss_disc_real_5: 0.48017653822898865 (0.48017653822898865) | > loss_0: 3.07932448387146 (3.07932448387146) | > loss_gen: 2.0161938667297363 (2.0161938667297363) | > loss_kl: 5.2257795333862305 (5.2257795333862305) | > loss_feat: 6.348743438720703 (6.348743438720703) | > loss_mel: 23.2635440826416 (23.2635440826416) | > loss_duration: 3.3355705738067627 (3.3355705738067627) | > loss_1: 40.1898307800293 (40.1898307800293)  --> STEP: 2 | > loss_disc: 2.5400002002716064 (2.809662342071533) | > loss_disc_real_0: 0.379722535610199 (0.2791875973343849) | > loss_disc_real_1: 0.4353710412979126 (0.3323635905981064) | > loss_disc_real_2: 0.33238935470581055 (0.34191587567329407) | > loss_disc_real_3: 0.15356896817684174 (0.16953542083501816) | > loss_disc_real_4: 0.15839803218841553 (0.26072295010089874) | > loss_disc_real_5: 0.09965765476226807 (0.28991709649562836) | > loss_0: 2.5400002002716064 (2.809662342071533) | > loss_gen: 2.6893656253814697 (2.352779746055603) | > loss_kl: 5.785637378692627 (5.505708456039429) | > loss_feat: 12.056623458862305 (9.202683448791504) | > loss_mel: 25.934236526489258 (24.59889030456543) | > loss_duration: 3.1973278522491455 (3.266449213027954) | > loss_1: 49.66318893432617 (44.926509857177734)  --> STEP: 3 | > loss_disc: 1.9305965900421143 (2.5166404247283936) | > loss_disc_real_0: 0.4529193639755249 (0.3370981862147649) | > loss_disc_real_1: 0.2924662232398987 (0.3190644681453705) | > loss_disc_real_2: 0.21767178177833557 (0.3005011777083079) | > loss_disc_real_3: 0.20935629308223724 (0.18280904491742453) | > loss_disc_real_4: 0.12636736035346985 (0.21593775351842245) | > loss_disc_real_5: 0.17487923800945282 (0.2515711436669032) | > loss_0: 1.9305965900421143 (2.5166404247283936) | > loss_gen: 4.2302751541137695 (2.9786115487416587) | > loss_kl: 2.7678840160369873 (4.593100309371948) | > loss_feat: 8.09246826171875 (8.832611719767252) | > loss_mel: 19.097997665405273 (22.76525942484538) | > loss_duration: 3.1123108863830566 (3.2150697708129883) | > loss_1: 37.30093765258789 (42.38465245564779) --> EVAL PERFORMANCE | > avg_loader_time: 0.0050801436106363935 (-0.009667237599690754) | > avg_loss_disc: 2.5166404247283936 (-0.45567210515340184) | > avg_loss_disc_real_0: 0.3370981862147649 (-0.08873805900414788) | > avg_loss_disc_real_1: 0.3190644681453705 (-0.018331706523895264) | > avg_loss_disc_real_2: 0.3005011777083079 (-0.0442255437374115) | > avg_loss_disc_real_3: 0.18280904491742453 (-0.08286412556966147) | > avg_loss_disc_real_4: 0.21593775351842245 (-0.13891387979189554) | > avg_loss_disc_real_5: 0.2515711436669032 (-0.07203273475170135) | > avg_loss_0: 2.5166404247283936 (-0.45567210515340184) | > avg_loss_gen: 2.9786115487416587 (+0.3536027272542319) | > avg_loss_kl: 4.593100309371948 (-0.1536878744761152) | > avg_loss_feat: 8.832611719767252 (+3.9258750279744463) | > avg_loss_mel: 22.76525942484538 (+0.2689526875813826) | > avg_loss_duration: 3.2150697708129883 (+0.02058299382527684) | > avg_loss_1: 42.38465245564779 (+4.415325800577804)  > EPOCH: 1107/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:54:16)   --> TIME: 2023-10-20 13:54:28 -- STEP: 9/50 -- GLOBAL_STEP: 108360 | > loss_disc: 1.6047983169555664 (2.3775293429692588) | > loss_disc_real_0: 0.11173468828201294 (0.15494441530770725) | > loss_disc_real_1: 0.15837767720222473 (0.22161285165283415) | > loss_disc_real_2: 0.24577179551124573 (0.2648223415017128) | > loss_disc_real_3: 0.1622467041015625 (0.24281506405936348) | > loss_disc_real_4: 0.10275311768054962 (0.18552016818688977) | > loss_disc_real_5: 0.06173500418663025 (0.226840081728167) | > loss_0: 1.6047983169555664 (2.3775293429692588) | > grad_norm_0: tensor(364.9936, device='cuda:0') (tensor(669.0595, device='cuda:0')) | > loss_gen: 3.094197988510132 (2.5111145310931735) | > loss_kl: 0.548694372177124 (0.7900049057271745) | > loss_feat: 8.855279922485352 (6.507811486721039) | > loss_mel: 20.96807289123535 (20.354102028740776) | > loss_duration: 1.308547019958496 (1.3635132312774658) | > loss_1: 34.7747917175293 (31.526545842488606) | > grad_norm_1: tensor(12733.8896, device='cuda:0') (tensor(18146.4023, device='cuda:0')) | > current_lr_0: 6.610525029512098e-05 | > current_lr_1: 6.610525029512098e-05 | > step_time: 0.5272 (0.6952421135372586) | > loader_time: 0.009 (0.014205270343356662)  --> TIME: 2023-10-20 13:54:46 -- STEP: 39/50 -- GLOBAL_STEP: 108390 | > loss_disc: 2.91336989402771 (2.5309741833271118) | > loss_disc_real_0: 0.27205151319503784 (0.17165554649172685) | > loss_disc_real_1: 0.2563546597957611 (0.23284955943624178) | > loss_disc_real_2: 0.2718009054660797 (0.2351330665823741) | > loss_disc_real_3: 0.247947558760643 (0.23637802086961576) | > loss_disc_real_4: 0.27746543288230896 (0.23345890779716846) | > loss_disc_real_5: 0.2426007091999054 (0.24486053820986015) | > loss_0: 2.91336989402771 (2.5309741833271118) | > grad_norm_0: tensor(1596.8539, device='cuda:0') (tensor(680.8593, device='cuda:0')) | > loss_gen: 1.6946685314178467 (2.2402857908835787) | > loss_kl: 0.658562183380127 (0.7987105196867234) | > loss_feat: 0.5783352851867676 (5.001056719284791) | > loss_mel: 13.646010398864746 (18.278936196596195) | > loss_duration: 1.357507586479187 (1.337696420840728) | > loss_1: 17.935083389282227 (27.656685609083908) | > grad_norm_1: tensor(4778.7217, device='cuda:0') (tensor(16172.2500, device='cuda:0')) | > current_lr_0: 6.610525029512098e-05 | > current_lr_1: 6.610525029512098e-05 | > step_time: 0.47 (0.6065608171316293) | > loader_time: 0.0261 (0.017738201679327548)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.00476336479187 (3.00476336479187) | > loss_disc_real_0: 0.2888777256011963 (0.2888777256011963) | > loss_disc_real_1: 0.2749176621437073 (0.2749176621437073) | > loss_disc_real_2: 0.24533167481422424 (0.24533167481422424) | > loss_disc_real_3: 0.27086013555526733 (0.27086013555526733) | > loss_disc_real_4: 0.27701064944267273 (0.27701064944267273) | > loss_disc_real_5: 0.26277995109558105 (0.26277995109558105) | > loss_0: 3.00476336479187 (3.00476336479187) | > loss_gen: 1.6297318935394287 (1.6297318935394287) | > loss_kl: 5.986055374145508 (5.986055374145508) | > loss_feat: 0.12016168981790543 (0.12016168981790543) | > loss_mel: 8.308115005493164 (8.308115005493164) | > loss_duration: 3.0718884468078613 (3.0718884468078613) | > loss_1: 19.115951538085938 (19.115951538085938)  --> STEP: 1 | > loss_disc: 3.3217735290527344 (3.3217735290527344) | > loss_disc_real_0: 0.6365455389022827 (0.6365455389022827) | > loss_disc_real_1: 0.33635953068733215 (0.33635953068733215) | > loss_disc_real_2: 0.3819269835948944 (0.3819269835948944) | > loss_disc_real_3: 0.2879652976989746 (0.2879652976989746) | > loss_disc_real_4: 0.37776678800582886 (0.37776678800582886) | > loss_disc_real_5: 0.4855298101902008 (0.4855298101902008) | > loss_0: 3.3217735290527344 (3.3217735290527344) | > loss_gen: 2.880253314971924 (2.880253314971924) | > loss_kl: 5.48730993270874 (5.48730993270874) | > loss_feat: 4.823922157287598 (4.823922157287598) | > loss_mel: 22.14478874206543 (22.14478874206543) | > loss_duration: 3.436354637145996 (3.436354637145996) | > loss_1: 38.77262878417969 (38.77262878417969)  --> STEP: 2 | > loss_disc: 2.7858951091766357 (3.053834319114685) | > loss_disc_real_0: 0.15549468994140625 (0.3960201144218445) | > loss_disc_real_1: 0.3921308219432831 (0.3642451763153076) | > loss_disc_real_2: 0.362077534198761 (0.3720022588968277) | > loss_disc_real_3: 0.4044315218925476 (0.3461984097957611) | > loss_disc_real_4: 0.3407582640647888 (0.35926252603530884) | > loss_disc_real_5: 0.3626479208469391 (0.42408886551856995) | > loss_0: 2.7858951091766357 (3.053834319114685) | > loss_gen: 2.955233335494995 (2.9177433252334595) | > loss_kl: 5.892081260681152 (5.689695596694946) | > loss_feat: 8.232950210571289 (6.528436183929443) | > loss_mel: 23.79793357849121 (22.97136116027832) | > loss_duration: 3.182654619216919 (3.3095046281814575) | > loss_1: 44.060855865478516 (41.4167423248291)  --> STEP: 3 | > loss_disc: 2.867542028427124 (2.991736888885498) | > loss_disc_real_0: 0.15390071272850037 (0.3153136471907298) | > loss_disc_real_1: 0.5094573497772217 (0.4126492341359456) | > loss_disc_real_2: 0.6806743144989014 (0.4748929440975189) | > loss_disc_real_3: 0.41128891706466675 (0.367895245552063) | > loss_disc_real_4: 0.3413171172142029 (0.3532807230949402) | > loss_disc_real_5: 0.3615260720252991 (0.403234601020813) | > loss_0: 2.867542028427124 (2.991736888885498) | > loss_gen: 4.043817520141602 (3.2931013902028403) | > loss_kl: 3.0630013942718506 (4.814130862553914) | > loss_feat: 5.7167487144470215 (6.25787369410197) | > loss_mel: 23.274511337280273 (23.072411219278973) | > loss_duration: 3.087373733520508 (3.2354609966278076) | > loss_1: 39.185447692871094 (40.672977447509766) --> EVAL PERFORMANCE | > avg_loader_time: 0.012274662653605143 (+0.007194519042968749) | > avg_loss_disc: 2.991736888885498 (+0.4750964641571045) | > avg_loss_disc_real_0: 0.3153136471907298 (-0.0217845390240351) | > avg_loss_disc_real_1: 0.4126492341359456 (+0.09358476599057514) | > avg_loss_disc_real_2: 0.4748929440975189 (+0.174391766389211) | > avg_loss_disc_real_3: 0.367895245552063 (+0.18508620063463846) | > avg_loss_disc_real_4: 0.3532807230949402 (+0.13734296957651773) | > avg_loss_disc_real_5: 0.403234601020813 (+0.1516634573539098) | > avg_loss_0: 2.991736888885498 (+0.4750964641571045) | > avg_loss_gen: 3.2931013902028403 (+0.31448984146118164) | > avg_loss_kl: 4.814130862553914 (+0.22103055318196585) | > avg_loss_feat: 6.25787369410197 (-2.5747380256652823) | > avg_loss_mel: 23.072411219278973 (+0.30715179443359375) | > avg_loss_duration: 3.2354609966278076 (+0.020391225814819336) | > avg_loss_1: 40.672977447509766 (-1.7116750081380232)  > EPOCH: 1108/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:55:04)   --> TIME: 2023-10-20 13:55:20 -- STEP: 19/50 -- GLOBAL_STEP: 108420 | > loss_disc: 2.2282252311706543 (2.575240655949241) | > loss_disc_real_0: 0.15273042023181915 (0.15002365694626382) | > loss_disc_real_1: 0.19719399511814117 (0.2419685070451937) | > loss_disc_real_2: 0.18596047163009644 (0.26555694365187693) | > loss_disc_real_3: 0.18517297506332397 (0.26285550743341446) | > loss_disc_real_4: 0.15222719311714172 (0.26032333487742826) | > loss_disc_real_5: 0.23532895743846893 (0.2671458015316411) | > loss_0: 2.2282252311706543 (2.575240655949241) | > grad_norm_0: tensor(452.3600, device='cuda:0') (tensor(624.3419, device='cuda:0')) | > loss_gen: 2.1573891639709473 (2.3453175394158614) | > loss_kl: 0.510578453540802 (0.7939657349335519) | > loss_feat: 4.895654201507568 (4.951105727176917) | > loss_mel: 21.749935150146484 (17.58743278603804) | > loss_duration: 1.42449152469635 (1.3766668031090183) | > loss_1: 30.738048553466797 (27.054488332648027) | > grad_norm_1: tensor(4540.2212, device='cuda:0') (tensor(13791.9150, device='cuda:0')) | > current_lr_0: 6.60391739586437e-05 | > current_lr_1: 6.60391739586437e-05 | > step_time: 0.3153 (0.5924526892210308) | > loader_time: 0.0166 (0.025806765807302373)  --> TIME: 2023-10-20 13:55:33 -- STEP: 49/50 -- GLOBAL_STEP: 108450 | > loss_disc: 3.0497968196868896 (2.5997191643228335) | > loss_disc_real_0: 0.13575224578380585 (0.1522169343899099) | > loss_disc_real_1: 0.21867068111896515 (0.2276793185393421) | > loss_disc_real_2: 0.3658996820449829 (0.24329008587769096) | > loss_disc_real_3: 0.2793813943862915 (0.25294568746977925) | > loss_disc_real_4: 0.2929689586162567 (0.2510002490361127) | > loss_disc_real_5: 0.27209675312042236 (0.2677231499098469) | > loss_0: 3.0497968196868896 (2.5997191643228335) | > grad_norm_0: tensor(457.7391, device='cuda:0') (tensor(655.8584, device='cuda:0')) | > loss_gen: 2.0769951343536377 (2.215182058665217) | > loss_kl: 0.40631425380706787 (0.7536421524626868) | > loss_feat: 5.318769931793213 (4.907205084452821) | > loss_mel: 24.83017921447754 (19.175906609515753) | > loss_duration: 1.4186084270477295 (1.3361850247091176) | > loss_1: 34.05086898803711 (28.388120806947047) | > grad_norm_1: tensor(14173.6709, device='cuda:0') (tensor(13191.8662, device='cuda:0')) | > current_lr_0: 6.60391739586437e-05 | > current_lr_1: 6.60391739586437e-05 | > step_time: 0.3436 (0.4802978865954341) | > loader_time: 0.4217 (0.023774195690544283)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.449298858642578 (3.449298858642578) | > loss_disc_real_0: 0.429900586605072 (0.429900586605072) | > loss_disc_real_1: 0.30610477924346924 (0.30610477924346924) | > loss_disc_real_2: 0.31036922335624695 (0.31036922335624695) | > loss_disc_real_3: 0.2590760588645935 (0.2590760588645935) | > loss_disc_real_4: 0.5774966478347778 (0.5774966478347778) | > loss_disc_real_5: 0.4432470500469208 (0.4432470500469208) | > loss_0: 3.449298858642578 (3.449298858642578) | > loss_gen: 2.424565315246582 (2.424565315246582) | > loss_kl: 6.115280628204346 (6.115280628204346) | > loss_feat: 6.751443386077881 (6.751443386077881) | > loss_mel: 23.383176803588867 (23.383176803588867) | > loss_duration: 3.1536777019500732 (3.1536777019500732) | > loss_1: 41.82814407348633 (41.82814407348633)  --> STEP: 1 | > loss_disc: 2.4005308151245117 (2.4005308151245117) | > loss_disc_real_0: 0.0967114269733429 (0.0967114269733429) | > loss_disc_real_1: 0.17892712354660034 (0.17892712354660034) | > loss_disc_real_2: 0.22528977692127228 (0.22528977692127228) | > loss_disc_real_3: 0.3185132145881653 (0.3185132145881653) | > loss_disc_real_4: 0.32111847400665283 (0.32111847400665283) | > loss_disc_real_5: 0.3562866151332855 (0.3562866151332855) | > loss_0: 2.4005308151245117 (2.4005308151245117) | > loss_gen: 2.4539451599121094 (2.4539451599121094) | > loss_kl: 5.486449241638184 (5.486449241638184) | > loss_feat: 6.218365669250488 (6.218365669250488) | > loss_mel: 26.992042541503906 (26.992042541503906) | > loss_duration: 3.346778154373169 (3.346778154373169) | > loss_1: 44.497581481933594 (44.497581481933594)  --> STEP: 2 | > loss_disc: 2.5520520210266113 (2.4762914180755615) | > loss_disc_real_0: 0.30061498284339905 (0.19866320490837097) | > loss_disc_real_1: 0.18750186264514923 (0.1832144930958748) | > loss_disc_real_2: 0.1772460788488388 (0.20126792788505554) | > loss_disc_real_3: 0.26254695653915405 (0.29053008556365967) | > loss_disc_real_4: 0.3020688593387604 (0.3115936666727066) | > loss_disc_real_5: 0.26447436213493347 (0.3103804886341095) | > loss_0: 2.5520520210266113 (2.4762914180755615) | > loss_gen: 2.302964448928833 (2.378454804420471) | > loss_kl: 5.847522735595703 (5.666985988616943) | > loss_feat: 2.7055182456970215 (4.461941957473755) | > loss_mel: 22.90170669555664 (24.946874618530273) | > loss_duration: 3.2632534503936768 (3.305015802383423) | > loss_1: 37.020965576171875 (40.759273529052734)  --> STEP: 3 | > loss_disc: 3.319551944732666 (2.757378260294596) | > loss_disc_real_0: 0.24488767981529236 (0.2140713632106781) | > loss_disc_real_1: 0.36016368865966797 (0.24219755828380585) | > loss_disc_real_2: 0.40662744641304016 (0.2697211007277171) | > loss_disc_real_3: 0.2618197798728943 (0.28095998366673786) | > loss_disc_real_4: 0.36580803990364075 (0.3296651244163513) | > loss_disc_real_5: 0.5132752656936646 (0.3780120809872945) | > loss_0: 3.319551944732666 (2.757378260294596) | > loss_gen: 2.4794223308563232 (2.4121106465657554) | > loss_kl: 2.5707995891571045 (4.634923855463664) | > loss_feat: 5.8718743324279785 (4.931919415791829) | > loss_mel: 20.971471786499023 (23.621740341186523) | > loss_duration: 2.9854824542999268 (3.198504686355591) | > loss_1: 34.879051208496094 (38.79919942220052) --> EVAL PERFORMANCE | > avg_loader_time: 0.01581398646036784 (+0.003539323806762697) | > avg_loss_disc: 2.757378260294596 (-0.23435862859090184) | > avg_loss_disc_real_0: 0.2140713632106781 (-0.1012422839800517) | > avg_loss_disc_real_1: 0.24219755828380585 (-0.17045167585213977) | > avg_loss_disc_real_2: 0.2697211007277171 (-0.20517184336980182) | > avg_loss_disc_real_3: 0.28095998366673786 (-0.08693526188532513) | > avg_loss_disc_real_4: 0.3296651244163513 (-0.023615598678588867) | > avg_loss_disc_real_5: 0.3780120809872945 (-0.025222520033518492) | > avg_loss_0: 2.757378260294596 (-0.23435862859090184) | > avg_loss_gen: 2.4121106465657554 (-0.880990743637085) | > avg_loss_kl: 4.634923855463664 (-0.17920700709025006) | > avg_loss_feat: 4.931919415791829 (-1.3259542783101406) | > avg_loss_mel: 23.621740341186523 (+0.5493291219075509) | > avg_loss_duration: 3.198504686355591 (-0.0369563102722168) | > avg_loss_1: 38.79919942220052 (-1.8737780253092424)  > EPOCH: 1109/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:55:55)   --> TIME: 2023-10-20 13:56:19 -- STEP: 29/50 -- GLOBAL_STEP: 108480 | > loss_disc: 2.6698973178863525 (2.391055304428627) | > loss_disc_real_0: 0.5957855582237244 (0.1412778190369236) | > loss_disc_real_1: 0.2120937705039978 (0.22386618665066257) | > loss_disc_real_2: 0.15234819054603577 (0.23411608654363406) | > loss_disc_real_3: 0.18585427105426788 (0.24255944345274877) | > loss_disc_real_4: 0.2542046308517456 (0.24000073710841865) | > loss_disc_real_5: 0.21561983227729797 (0.21437043478262835) | > loss_0: 2.6698973178863525 (2.391055304428627) | > grad_norm_0: tensor(665.3091, device='cuda:0') (tensor(562.2026, device='cuda:0')) | > loss_gen: 2.4233975410461426 (2.408924226103158) | > loss_kl: 0.7642920017242432 (0.7885083643526867) | > loss_feat: 4.635666370391846 (5.848489597311308) | > loss_mel: 24.37665557861328 (20.82958644011925) | > loss_duration: 1.2960426807403564 (1.3477744151806008) | > loss_1: 33.496055603027344 (31.223283537502947) | > grad_norm_1: tensor(6966.4644, device='cuda:0') (tensor(22745.9629, device='cuda:0')) | > current_lr_0: 6.597316366960174e-05 | > current_lr_1: 6.597316366960174e-05 | > step_time: 0.8155 (0.6328612278247702) | > loader_time: 0.0357 (0.018342527849920864)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.323357343673706 (2.323357343673706) | > loss_disc_real_0: 0.18170946836471558 (0.18170946836471558) | > loss_disc_real_1: 0.184768944978714 (0.184768944978714) | > loss_disc_real_2: 0.2070869505405426 (0.2070869505405426) | > loss_disc_real_3: 0.29756054282188416 (0.29756054282188416) | > loss_disc_real_4: 0.18068651854991913 (0.18068651854991913) | > loss_disc_real_5: 0.17658808827400208 (0.17658808827400208) | > loss_0: 2.323357343673706 (2.323357343673706) | > loss_gen: 2.1478989124298096 (2.1478989124298096) | > loss_kl: 6.163486957550049 (6.163486957550049) | > loss_feat: 3.6488027572631836 (3.6488027572631836) | > loss_mel: 21.768823623657227 (21.768823623657227) | > loss_duration: 3.0122432708740234 (3.0122432708740234) | > loss_1: 36.74125671386719 (36.74125671386719)  --> STEP: 1 | > loss_disc: 2.8125667572021484 (2.8125667572021484) | > loss_disc_real_0: 0.40809425711631775 (0.40809425711631775) | > loss_disc_real_1: 0.3553740382194519 (0.3553740382194519) | > loss_disc_real_2: 0.27434685826301575 (0.27434685826301575) | > loss_disc_real_3: 0.23971307277679443 (0.23971307277679443) | > loss_disc_real_4: 0.2649141848087311 (0.2649141848087311) | > loss_disc_real_5: 0.3771147131919861 (0.3771147131919861) | > loss_0: 2.8125667572021484 (2.8125667572021484) | > loss_gen: 2.7444186210632324 (2.7444186210632324) | > loss_kl: 5.365200519561768 (5.365200519561768) | > loss_feat: 5.99043607711792 (5.99043607711792) | > loss_mel: 23.355974197387695 (23.355974197387695) | > loss_duration: 3.335886240005493 (3.335886240005493) | > loss_1: 40.79191589355469 (40.79191589355469)  --> STEP: 2 | > loss_disc: 3.0724263191223145 (2.9424965381622314) | > loss_disc_real_0: 0.41339749097824097 (0.41074587404727936) | > loss_disc_real_1: 0.25148725509643555 (0.3034306466579437) | > loss_disc_real_2: 0.27775534987449646 (0.2760511040687561) | > loss_disc_real_3: 0.31560298800468445 (0.27765803039073944) | > loss_disc_real_4: 0.26035135984420776 (0.2626327723264694) | > loss_disc_real_5: 0.3073923885822296 (0.34225355088710785) | > loss_0: 3.0724263191223145 (2.9424965381622314) | > loss_gen: 1.8069884777069092 (2.275703549385071) | > loss_kl: 5.705501556396484 (5.535351037979126) | > loss_feat: 0.09756584465503693 (3.0440009608864784) | > loss_mel: 4.838045120239258 (14.097009658813477) | > loss_duration: 3.234710216522217 (3.285298228263855) | > loss_1: 15.682811737060547 (28.237363815307617)  --> STEP: 3 | > loss_disc: 3.8481338024139404 (3.2443756262461343) | > loss_disc_real_0: 0.51844322681427 (0.44664499163627625) | > loss_disc_real_1: 0.3964126706123352 (0.3344246546427409) | > loss_disc_real_2: 0.37857213616371155 (0.31022478143374127) | > loss_disc_real_3: 0.4058772623538971 (0.3203977743784587) | > loss_disc_real_4: 0.3498972952365875 (0.2917209466298421) | > loss_disc_real_5: 0.4625183045864105 (0.38234180212020874) | > loss_0: 3.8481338024139404 (3.2443756262461343) | > loss_gen: 2.0006868839263916 (2.184031327565511) | > loss_kl: 2.6830646991729736 (4.584588925043742) | > loss_feat: 4.3181586265563965 (3.468720182776451) | > loss_mel: 23.73215103149414 (17.30872344970703) | > loss_duration: 3.0300309658050537 (3.200209140777588) | > loss_1: 35.76409149169922 (30.746273040771484) --> EVAL PERFORMANCE | > avg_loader_time: 0.004671812057495117 (-0.011142174402872723) | > avg_loss_disc: 3.2443756262461343 (+0.4869973659515381) | > avg_loss_disc_real_0: 0.44664499163627625 (+0.23257362842559814) | > avg_loss_disc_real_1: 0.3344246546427409 (+0.09222709635893506) | > avg_loss_disc_real_2: 0.31022478143374127 (+0.04050368070602417) | > avg_loss_disc_real_3: 0.3203977743784587 (+0.03943779071172082) | > avg_loss_disc_real_4: 0.2917209466298421 (-0.037944177786509214) | > avg_loss_disc_real_5: 0.38234180212020874 (+0.004329721132914244) | > avg_loss_0: 3.2443756262461343 (+0.4869973659515381) | > avg_loss_gen: 2.184031327565511 (-0.22807931900024414) | > avg_loss_kl: 4.584588925043742 (-0.050334930419921875) | > avg_loss_feat: 3.468720182776451 (-1.463199233015378) | > avg_loss_mel: 17.30872344970703 (-6.313016891479492) | > avg_loss_duration: 3.200209140777588 (+0.0017044544219970703) | > avg_loss_1: 30.746273040771484 (-8.052926381429039)  > EPOCH: 1110/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:56:43)   --> TIME: 2023-10-20 13:56:54 -- STEP: 9/50 -- GLOBAL_STEP: 108510 | > loss_disc: 2.6085617542266846 (2.540248023139106) | > loss_disc_real_0: 0.07532718777656555 (0.10923910027162896) | > loss_disc_real_1: 0.29892677068710327 (0.2352707642647955) | > loss_disc_real_2: 0.3855847418308258 (0.23657660682996115) | > loss_disc_real_3: 0.34880805015563965 (0.2583650064965089) | > loss_disc_real_4: 0.4055705666542053 (0.1982261266352402) | > loss_disc_real_5: 0.4109207093715668 (0.21563739691757494) | > loss_0: 2.6085617542266846 (2.540248023139106) | > grad_norm_0: tensor(318.8666, device='cuda:0') (tensor(693.4125, device='cuda:0')) | > loss_gen: 2.8417582511901855 (2.2208911842770047) | > loss_kl: 0.6374521255493164 (0.8117982215351529) | > loss_feat: 4.588022232055664 (5.453104548984104) | > loss_mel: 23.628700256347656 (20.807576921251083) | > loss_duration: 1.3266613483428955 (1.3349019553926256) | > loss_1: 33.0225944519043 (30.628271526760525) | > grad_norm_1: tensor(3896.4692, device='cuda:0') (tensor(26158.2578, device='cuda:0')) | > current_lr_0: 6.590721936197655e-05 | > current_lr_1: 6.590721936197655e-05 | > step_time: 0.4655 (0.6354266802469889) | > loader_time: 0.0332 (0.03500996695624457)  --> TIME: 2023-10-20 13:57:08 -- STEP: 39/50 -- GLOBAL_STEP: 108540 | > loss_disc: 3.1785366535186768 (2.4449851726874328) | > loss_disc_real_0: 0.06852013617753983 (0.13450536224991083) | > loss_disc_real_1: 0.17314323782920837 (0.2249318418594507) | > loss_disc_real_2: 0.20914699137210846 (0.21571685421543244) | > loss_disc_real_3: 0.14431776106357574 (0.2474745793793447) | > loss_disc_real_4: 0.17019036412239075 (0.21772426779931173) | > loss_disc_real_5: 0.1484895795583725 (0.21791043201795754) | > loss_0: 3.1785366535186768 (2.4449851726874328) | > grad_norm_0: tensor(760.1403, device='cuda:0') (tensor(593.7078, device='cuda:0')) | > loss_gen: 1.2746912240982056 (2.336692333221435) | > loss_kl: 0.6411002278327942 (0.8050484122374119) | > loss_feat: 4.328463554382324 (5.835308924365118) | > loss_mel: 25.215463638305664 (20.839910002855156) | > loss_duration: 1.3805606365203857 (1.3415892063043056) | > loss_1: 32.84027862548828 (31.158548477368477) | > grad_norm_1: tensor(4004.4219, device='cuda:0') (tensor(21478.3242, device='cuda:0')) | > current_lr_0: 6.590721936197655e-05 | > current_lr_1: 6.590721936197655e-05 | > step_time: 0.3412 (0.4994689806913718) | > loader_time: 0.0032 (0.016857245029547274)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4435908794403076 (3.4435908794403076) | > loss_disc_real_0: 0.13719666004180908 (0.13719666004180908) | > loss_disc_real_1: 0.3375574052333832 (0.3375574052333832) | > loss_disc_real_2: 0.24206288158893585 (0.24206288158893585) | > loss_disc_real_3: 0.3728993535041809 (0.3728993535041809) | > loss_disc_real_4: 0.31248483061790466 (0.31248483061790466) | > loss_disc_real_5: 0.5201354026794434 (0.5201354026794434) | > loss_0: 3.4435908794403076 (3.4435908794403076) | > loss_gen: 1.8881802558898926 (1.8881802558898926) | > loss_kl: 5.828701972961426 (5.828701972961426) | > loss_feat: 6.78147554397583 (6.78147554397583) | > loss_mel: 22.98440933227539 (22.98440933227539) | > loss_duration: 3.014066219329834 (3.014066219329834) | > loss_1: 40.49683380126953 (40.49683380126953)  --> STEP: 1 | > loss_disc: 2.794977903366089 (2.794977903366089) | > loss_disc_real_0: 0.08012177795171738 (0.08012177795171738) | > loss_disc_real_1: 0.2879655957221985 (0.2879655957221985) | > loss_disc_real_2: 0.22218753397464752 (0.22218753397464752) | > loss_disc_real_3: 0.30452975630760193 (0.30452975630760193) | > loss_disc_real_4: 0.3807649314403534 (0.3807649314403534) | > loss_disc_real_5: 0.3701726198196411 (0.3701726198196411) | > loss_0: 2.794977903366089 (2.794977903366089) | > loss_gen: 2.230921506881714 (2.230921506881714) | > loss_kl: 5.5044097900390625 (5.5044097900390625) | > loss_feat: 6.269985198974609 (6.269985198974609) | > loss_mel: 25.922748565673828 (25.922748565673828) | > loss_duration: 3.371367931365967 (3.371367931365967) | > loss_1: 43.299434661865234 (43.299434661865234)  --> STEP: 2 | > loss_disc: 2.8870952129364014 (2.841036558151245) | > loss_disc_real_0: 0.2801750898361206 (0.180148433893919) | > loss_disc_real_1: 0.2759036123752594 (0.28193460404872894) | > loss_disc_real_2: 0.2512573301792145 (0.236722432076931) | > loss_disc_real_3: 0.2622005343437195 (0.2833651453256607) | > loss_disc_real_4: 0.26577693223953247 (0.32327093183994293) | > loss_disc_real_5: 0.3146619200706482 (0.34241726994514465) | > loss_0: 2.8870952129364014 (2.841036558151245) | > loss_gen: 1.838257074356079 (2.0345892906188965) | > loss_kl: 5.664996147155762 (5.584702968597412) | > loss_feat: 0.4916028380393982 (3.380794018507004) | > loss_mel: 20.297204971313477 (23.109976768493652) | > loss_duration: 3.1852478981018066 (3.2783079147338867) | > loss_1: 31.47730827331543 (37.38837146759033)  --> STEP: 3 | > loss_disc: 2.186978816986084 (2.6230173110961914) | > loss_disc_real_0: 0.10109297931194305 (0.153796615699927) | > loss_disc_real_1: 0.37400558590888977 (0.3126249313354492) | > loss_disc_real_2: 0.22466130554676056 (0.23270205656687418) | > loss_disc_real_3: 0.3211466670036316 (0.2959589858849843) | > loss_disc_real_4: 0.11838376522064209 (0.25497520963350934) | > loss_disc_real_5: 0.2397594302892685 (0.3081979900598526) | > loss_0: 2.186978816986084 (2.6230173110961914) | > loss_gen: 2.81430721282959 (2.2944952646891275) | > loss_kl: 2.939836263656616 (4.7030807336171465) | > loss_feat: 5.330163478851318 (4.030583838621776) | > loss_mel: 20.477407455444336 (22.23245366414388) | > loss_duration: 3.0486514568328857 (3.2017557621002197) | > loss_1: 34.61036682128906 (36.46236991882324) --> EVAL PERFORMANCE | > avg_loader_time: 0.031684557596842446 (+0.02701274553934733) | > avg_loss_disc: 2.6230173110961914 (-0.6213583151499429) | > avg_loss_disc_real_0: 0.153796615699927 (-0.29284837593634927) | > avg_loss_disc_real_1: 0.3126249313354492 (-0.021799723307291685) | > avg_loss_disc_real_2: 0.23270205656687418 (-0.0775227248668671) | > avg_loss_disc_real_3: 0.2959589858849843 (-0.02443878849347436) | > avg_loss_disc_real_4: 0.25497520963350934 (-0.03674573699633277) | > avg_loss_disc_real_5: 0.3081979900598526 (-0.07414381206035614) | > avg_loss_0: 2.6230173110961914 (-0.6213583151499429) | > avg_loss_gen: 2.2944952646891275 (+0.11046393712361624) | > avg_loss_kl: 4.7030807336171465 (+0.11849180857340436) | > avg_loss_feat: 4.030583838621776 (+0.5618636558453245) | > avg_loss_mel: 22.23245366414388 (+4.923730214436848) | > avg_loss_duration: 3.2017557621002197 (+0.001546621322631836) | > avg_loss_1: 36.46236991882324 (+5.716096878051758)  > EPOCH: 1111/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:57:37)   --> TIME: 2023-10-20 13:57:55 -- STEP: 19/50 -- GLOBAL_STEP: 108570 | > loss_disc: 1.1893370151519775 (2.2600118423763074) | > loss_disc_real_0: 0.04725748300552368 (0.1332548601846946) | > loss_disc_real_1: 0.05574335157871246 (0.21530056862454666) | > loss_disc_real_2: 0.08181226253509521 (0.2071429508689203) | > loss_disc_real_3: 0.10575872659683228 (0.21580679087262405) | > loss_disc_real_4: 0.03571881353855133 (0.19466426115679114) | > loss_disc_real_5: 0.055332254618406296 (0.2153043463630112) | > loss_0: 1.1893370151519775 (2.2600118423763074) | > grad_norm_0: tensor(264.1140, device='cuda:0') (tensor(598.8964, device='cuda:0')) | > loss_gen: 3.2319600582122803 (2.515474476312336) | > loss_kl: 0.6461690068244934 (0.8349885219021848) | > loss_feat: 10.070985794067383 (6.646157098836021) | > loss_mel: 24.471925735473633 (22.284554054862575) | > loss_duration: 1.4635467529296875 (1.3809836914664821) | > loss_1: 39.884586334228516 (33.662157912003366) | > grad_norm_1: tensor(32460.9043, device='cuda:0') (tensor(21523.5996, device='cuda:0')) | > current_lr_0: 6.584134096981554e-05 | > current_lr_1: 6.584134096981554e-05 | > step_time: 0.6953 (0.6342827520872417) | > loader_time: 0.0272 (0.021733572608546206)  --> TIME: 2023-10-20 13:58:13 -- STEP: 49/50 -- GLOBAL_STEP: 108600 | > loss_disc: 2.2101755142211914 (2.439777953284128) | > loss_disc_real_0: 0.12455755472183228 (0.14677768272860925) | > loss_disc_real_1: 0.1929488182067871 (0.22710534561501475) | > loss_disc_real_2: 0.14724284410476685 (0.2317997724654115) | > loss_disc_real_3: 0.30885612964630127 (0.23358485045633753) | > loss_disc_real_4: 0.28705427050590515 (0.22463983472208587) | > loss_disc_real_5: 0.33613452315330505 (0.23986392380783753) | > loss_0: 2.2101755142211914 (2.439777953284128) | > grad_norm_0: tensor(446.6014, device='cuda:0') (tensor(581.1068, device='cuda:0')) | > loss_gen: 2.970484495162964 (2.355990358761378) | > loss_kl: 0.46240830421447754 (0.8064399537991506) | > loss_feat: 7.560905456542969 (5.9178319826570105) | > loss_mel: 21.069847106933594 (20.634289790172968) | > loss_duration: 1.3612171411514282 (1.3365483308325008) | > loss_1: 33.424861907958984 (31.05110028325296) | > grad_norm_1: tensor(22845.0840, device='cuda:0') (tensor(21650.3691, device='cuda:0')) | > current_lr_0: 6.584134096981554e-05 | > current_lr_1: 6.584134096981554e-05 | > step_time: 0.8211 (0.5910747781091806) | > loader_time: 0.418 (0.026090169439510424)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.627218008041382 (2.627218008041382) | > loss_disc_real_0: 0.3606608510017395 (0.3606608510017395) | > loss_disc_real_1: 0.22866716980934143 (0.22866716980934143) | > loss_disc_real_2: 0.29738184809684753 (0.29738184809684753) | > loss_disc_real_3: 0.2356829047203064 (0.2356829047203064) | > loss_disc_real_4: 0.2656494379043579 (0.2656494379043579) | > loss_disc_real_5: 0.18277214467525482 (0.18277214467525482) | > loss_0: 2.627218008041382 (2.627218008041382) | > loss_gen: 2.8369290828704834 (2.8369290828704834) | > loss_kl: 6.047903537750244 (6.047903537750244) | > loss_feat: 5.393339157104492 (5.393339157104492) | > loss_mel: 23.57291030883789 (23.57291030883789) | > loss_duration: 3.0261306762695312 (3.0261306762695312) | > loss_1: 40.87721252441406 (40.87721252441406)  --> STEP: 1 | > loss_disc: 2.48024582862854 (2.48024582862854) | > loss_disc_real_0: 0.37352848052978516 (0.37352848052978516) | > loss_disc_real_1: 0.16180028021335602 (0.16180028021335602) | > loss_disc_real_2: 0.08390186727046967 (0.08390186727046967) | > loss_disc_real_3: 0.16309389472007751 (0.16309389472007751) | > loss_disc_real_4: 0.24049919843673706 (0.24049919843673706) | > loss_disc_real_5: 0.2753080427646637 (0.2753080427646637) | > loss_0: 2.48024582862854 (2.48024582862854) | > loss_gen: 2.4147939682006836 (2.4147939682006836) | > loss_kl: 5.670927047729492 (5.670927047729492) | > loss_feat: 5.838989734649658 (5.838989734649658) | > loss_mel: 24.91082763671875 (24.91082763671875) | > loss_duration: 3.46266770362854 (3.46266770362854) | > loss_1: 42.29821014404297 (42.29821014404297)  --> STEP: 2 | > loss_disc: 3.393934965133667 (2.9370903968811035) | > loss_disc_real_0: 0.4856875538825989 (0.429608017206192) | > loss_disc_real_1: 0.17953072488307953 (0.17066550254821777) | > loss_disc_real_2: 0.22687916457653046 (0.15539051592350006) | > loss_disc_real_3: 0.18487244844436646 (0.17398317158222198) | > loss_disc_real_4: 0.186146080493927 (0.21332263946533203) | > loss_disc_real_5: 0.26808199286460876 (0.27169501781463623) | > loss_0: 3.393934965133667 (2.9370903968811035) | > loss_gen: 1.5423866510391235 (1.9785903096199036) | > loss_kl: 5.493220329284668 (5.58207368850708) | > loss_feat: 7.359033584594727 (6.599011659622192) | > loss_mel: 24.235279083251953 (24.57305335998535) | > loss_duration: 3.193134307861328 (3.327901005744934) | > loss_1: 41.82305145263672 (42.060630798339844)  --> STEP: 3 | > loss_disc: 2.2725236415863037 (2.7155681451161704) | > loss_disc_real_0: 0.15315502882003784 (0.33745702107747394) | > loss_disc_real_1: 0.2659158706665039 (0.20241562525431314) | > loss_disc_real_2: 0.1785794496536255 (0.16312016050020853) | > loss_disc_real_3: 0.32148393988609314 (0.22315009435017905) | > loss_disc_real_4: 0.17078407108783722 (0.19914311667283377) | > loss_disc_real_5: 0.21812784671783447 (0.25383929411570233) | > loss_0: 2.2725236415863037 (2.7155681451161704) | > loss_gen: 2.52457857131958 (2.160586396853129) | > loss_kl: 2.9422335624694824 (4.702126979827881) | > loss_feat: 4.905608177185059 (6.0345438321431475) | > loss_mel: 21.59644889831543 (23.580851872762043) | > loss_duration: 3.0112292766571045 (3.2223437627156577) | > loss_1: 34.980098724365234 (39.700453440348305) --> EVAL PERFORMANCE | > avg_loader_time: 0.01137844721476237 (-0.020306110382080078) | > avg_loss_disc: 2.7155681451161704 (+0.09255083401997899) | > avg_loss_disc_real_0: 0.33745702107747394 (+0.18366040537754694) | > avg_loss_disc_real_1: 0.20241562525431314 (-0.11020930608113608) | > avg_loss_disc_real_2: 0.16312016050020853 (-0.06958189606666565) | > avg_loss_disc_real_3: 0.22315009435017905 (-0.07280889153480527) | > avg_loss_disc_real_4: 0.19914311667283377 (-0.05583209296067557) | > avg_loss_disc_real_5: 0.25383929411570233 (-0.05435869594415027) | > avg_loss_0: 2.7155681451161704 (+0.09255083401997899) | > avg_loss_gen: 2.160586396853129 (-0.13390886783599854) | > avg_loss_kl: 4.702126979827881 (-0.0009537537892656545) | > avg_loss_feat: 6.0345438321431475 (+2.003959993521372) | > avg_loss_mel: 23.580851872762043 (+1.348398208618164) | > avg_loss_duration: 3.2223437627156577 (+0.020588000615437974) | > avg_loss_1: 39.700453440348305 (+3.2380835215250627)  > EPOCH: 1112/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:58:31)   --> TIME: 2023-10-20 13:58:54 -- STEP: 29/50 -- GLOBAL_STEP: 108630 | > loss_disc: 2.915864944458008 (2.39011432795689) | > loss_disc_real_0: 0.20677253603935242 (0.14647950861474562) | > loss_disc_real_1: 0.2623155117034912 (0.21899396412331482) | > loss_disc_real_2: 0.2463504672050476 (0.21093591392554087) | > loss_disc_real_3: 0.23921795189380646 (0.21724271209075532) | > loss_disc_real_4: 0.24574637413024902 (0.21081847999373388) | > loss_disc_real_5: 0.25502079725265503 (0.2227608400300659) | > loss_0: 2.915864944458008 (2.39011432795689) | > grad_norm_0: tensor(644.9045, device='cuda:0') (tensor(607.8224, device='cuda:0')) | > loss_gen: 1.5495984554290771 (2.238343259383892) | > loss_kl: 0.6871181130409241 (0.8100292533957238) | > loss_feat: 0.28283146023750305 (5.983900463786619) | > loss_mel: 9.6505708694458 (20.278373019448644) | > loss_duration: 1.3597612380981445 (1.3409220514626339) | > loss_1: 13.52988052368164 (30.651568182583514) | > grad_norm_1: tensor(14036.3867, device='cuda:0') (tensor(22100.5078, device='cuda:0')) | > current_lr_0: 6.577552842723212e-05 | > current_lr_1: 6.577552842723212e-05 | > step_time: 0.2703 (0.5757257773958403) | > loader_time: 0.0046 (0.018310513989678746)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7631161212921143 (2.7631161212921143) | > loss_disc_real_0: 0.2016194760799408 (0.2016194760799408) | > loss_disc_real_1: 0.18582673370838165 (0.18582673370838165) | > loss_disc_real_2: 0.30796849727630615 (0.30796849727630615) | > loss_disc_real_3: 0.2924492359161377 (0.2924492359161377) | > loss_disc_real_4: 0.2790117561817169 (0.2790117561817169) | > loss_disc_real_5: 0.07044690102338791 (0.07044690102338791) | > loss_0: 2.7631161212921143 (2.7631161212921143) | > loss_gen: 1.9914461374282837 (1.9914461374282837) | > loss_kl: 5.652030944824219 (5.652030944824219) | > loss_feat: 10.199980735778809 (10.199980735778809) | > loss_mel: 24.56616973876953 (24.56616973876953) | > loss_duration: 3.023707866668701 (3.023707866668701) | > loss_1: 45.4333381652832 (45.4333381652832)  --> STEP: 1 | > loss_disc: 3.17405366897583 (3.17405366897583) | > loss_disc_real_0: 0.2996441721916199 (0.2996441721916199) | > loss_disc_real_1: 0.24837367236614227 (0.24837367236614227) | > loss_disc_real_2: 0.3314766585826874 (0.3314766585826874) | > loss_disc_real_3: 0.2883840799331665 (0.2883840799331665) | > loss_disc_real_4: 0.5000934600830078 (0.5000934600830078) | > loss_disc_real_5: 0.4757378399372101 (0.4757378399372101) | > loss_0: 3.17405366897583 (3.17405366897583) | > loss_gen: 2.2947261333465576 (2.2947261333465576) | > loss_kl: 5.726430892944336 (5.726430892944336) | > loss_feat: 5.606311798095703 (5.606311798095703) | > loss_mel: 25.613744735717773 (25.613744735717773) | > loss_duration: 3.437570571899414 (3.437570571899414) | > loss_1: 42.67878723144531 (42.67878723144531)  --> STEP: 2 | > loss_disc: 2.4326364994049072 (2.8033450841903687) | > loss_disc_real_0: 0.25378328561782837 (0.2767137289047241) | > loss_disc_real_1: 0.15328387916088104 (0.20082877576351166) | > loss_disc_real_2: 0.16821753978729248 (0.24984709918498993) | > loss_disc_real_3: 0.19016920030117035 (0.23927664011716843) | > loss_disc_real_4: 0.26788610219955444 (0.38398978114128113) | > loss_disc_real_5: 0.20582206547260284 (0.34077995270490646) | > loss_0: 2.4326364994049072 (2.8033450841903687) | > loss_gen: 2.206545829772949 (2.2506359815597534) | > loss_kl: 5.906204700469971 (5.816317796707153) | > loss_feat: 9.654016494750977 (7.63016414642334) | > loss_mel: 23.63897132873535 (24.626358032226562) | > loss_duration: 3.1371665000915527 (3.2873685359954834) | > loss_1: 44.542903900146484 (43.6108455657959)  --> STEP: 3 | > loss_disc: 2.539313316345215 (2.715334494908651) | > loss_disc_real_0: 0.28934192657470703 (0.28092312812805176) | > loss_disc_real_1: 0.27910658717155457 (0.22692137956619263) | > loss_disc_real_2: 0.3515227138996124 (0.28373897075653076) | > loss_disc_real_3: 0.339731365442276 (0.27276154855887097) | > loss_disc_real_4: 0.22699551284313202 (0.33165835837523144) | > loss_disc_real_5: 0.30380672216415405 (0.32845554252465564) | > loss_0: 2.539313316345215 (2.715334494908651) | > loss_gen: 2.841273546218872 (2.4475151697794595) | > loss_kl: 2.903944969177246 (4.8455268541971845) | > loss_feat: 4.243068695068359 (6.501132329305013) | > loss_mel: 19.94363021850586 (23.065448760986328) | > loss_duration: 3.023573637008667 (3.199436902999878) | > loss_1: 32.95549392700195 (40.059061686197914) --> EVAL PERFORMANCE | > avg_loader_time: 0.00697016716003418 (-0.0044082800547281895) | > avg_loss_disc: 2.715334494908651 (-0.00023365020751953125) | > avg_loss_disc_real_0: 0.28092312812805176 (-0.05653389294942218) | > avg_loss_disc_real_1: 0.22692137956619263 (+0.024505754311879485) | > avg_loss_disc_real_2: 0.28373897075653076 (+0.12061881025632223) | > avg_loss_disc_real_3: 0.27276154855887097 (+0.049611454208691924) | > avg_loss_disc_real_4: 0.33165835837523144 (+0.13251524170239767) | > avg_loss_disc_real_5: 0.32845554252465564 (+0.07461624840895331) | > avg_loss_0: 2.715334494908651 (-0.00023365020751953125) | > avg_loss_gen: 2.4475151697794595 (+0.28692877292633057) | > avg_loss_kl: 4.8455268541971845 (+0.14339987436930368) | > avg_loss_feat: 6.501132329305013 (+0.46658849716186523) | > avg_loss_mel: 23.065448760986328 (-0.515403111775715) | > avg_loss_duration: 3.199436902999878 (-0.02290685971577977) | > avg_loss_1: 40.059061686197914 (+0.3586082458496094)  > EPOCH: 1113/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 13:59:15)   --> TIME: 2023-10-20 13:59:29 -- STEP: 9/50 -- GLOBAL_STEP: 108660 | > loss_disc: 2.920368194580078 (2.4185066885418363) | > loss_disc_real_0: 0.13423293828964233 (0.1446966499918037) | > loss_disc_real_1: 0.2547147274017334 (0.21362274885177612) | > loss_disc_real_2: 0.2912600636482239 (0.2259392100903723) | > loss_disc_real_3: 0.3039340078830719 (0.22238658203019035) | > loss_disc_real_4: 0.2870658040046692 (0.21106308905614746) | > loss_disc_real_5: 0.23648926615715027 (0.1806472291549047) | > loss_0: 2.920368194580078 (2.4185066885418363) | > grad_norm_0: tensor(754.1119, device='cuda:0') (tensor(705.1195, device='cuda:0')) | > loss_gen: 1.775740623474121 (2.2291909323798285) | > loss_kl: 0.8171218633651733 (0.8300254808531867) | > loss_feat: 1.239996075630188 (5.7973084515995446) | > loss_mel: 9.866621971130371 (16.67248953713311) | > loss_duration: 1.3282804489135742 (1.3335450887680054) | > loss_1: 15.027761459350586 (26.862560113271076) | > grad_norm_1: tensor(5198.5513, device='cuda:0') (tensor(22128.7930, device='cuda:0')) | > current_lr_0: 6.570978166840549e-05 | > current_lr_1: 6.570978166840549e-05 | > step_time: 0.61 (0.6152502960628934) | > loader_time: 0.0259 (0.02264820204840766)  --> TIME: 2023-10-20 13:59:44 -- STEP: 39/50 -- GLOBAL_STEP: 108690 | > loss_disc: 1.756280541419983 (2.4400576536472025) | > loss_disc_real_0: 0.18006271123886108 (0.14129365350191408) | > loss_disc_real_1: 0.19575028121471405 (0.2221510763733815) | > loss_disc_real_2: 0.0959584042429924 (0.20842687448916528) | > loss_disc_real_3: 0.15695041418075562 (0.23744309048813123) | > loss_disc_real_4: 0.050221893936395645 (0.22205020124331498) | > loss_disc_real_5: 0.0796835869550705 (0.21720175540600067) | > loss_0: 1.756280541419983 (2.4400576536472025) | > grad_norm_0: tensor(1135.7407, device='cuda:0') (tensor(630.2701, device='cuda:0')) | > loss_gen: 2.8185477256774902 (2.3005035596016126) | > loss_kl: 0.3810318410396576 (0.7981167586060623) | > loss_feat: 7.4653167724609375 (5.5999410928059845) | > loss_mel: 24.436262130737305 (19.548851110996345) | > loss_duration: 1.4493310451507568 (1.346685155844077) | > loss_1: 36.55048751831055 (29.59409796885955) | > grad_norm_1: tensor(68842.5078, device='cuda:0') (tensor(24657.6309, device='cuda:0')) | > current_lr_0: 6.570978166840549e-05 | > current_lr_1: 6.570978166840549e-05 | > step_time: 0.3562 (0.5102619024423453) | > loader_time: 0.0065 (0.017859746248294145)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.182063579559326 (3.182063579559326) | > loss_disc_real_0: 0.28608399629592896 (0.28608399629592896) | > loss_disc_real_1: 0.27894484996795654 (0.27894484996795654) | > loss_disc_real_2: 0.35405027866363525 (0.35405027866363525) | > loss_disc_real_3: 0.3372631371021271 (0.3372631371021271) | > loss_disc_real_4: 0.3998062312602997 (0.3998062312602997) | > loss_disc_real_5: 0.26670289039611816 (0.26670289039611816) | > loss_0: 3.182063579559326 (3.182063579559326) | > loss_gen: 2.155056953430176 (2.155056953430176) | > loss_kl: 4.9049506187438965 (4.9049506187438965) | > loss_feat: 6.259128093719482 (6.259128093719482) | > loss_mel: 22.47507095336914 (22.47507095336914) | > loss_duration: 3.1483278274536133 (3.1483278274536133) | > loss_1: 38.94253158569336 (38.94253158569336)  --> STEP: 1 | > loss_disc: 1.9274083375930786 (1.9274083375930786) | > loss_disc_real_0: 0.3740599751472473 (0.3740599751472473) | > loss_disc_real_1: 0.15449142456054688 (0.15449142456054688) | > loss_disc_real_2: 0.2123611867427826 (0.2123611867427826) | > loss_disc_real_3: 0.11903999745845795 (0.11903999745845795) | > loss_disc_real_4: 0.1633758544921875 (0.1633758544921875) | > loss_disc_real_5: 0.14615163207054138 (0.14615163207054138) | > loss_0: 1.9274083375930786 (1.9274083375930786) | > loss_gen: 3.339491605758667 (3.339491605758667) | > loss_kl: 5.38713264465332 (5.38713264465332) | > loss_feat: 8.82530403137207 (8.82530403137207) | > loss_mel: 24.541767120361328 (24.541767120361328) | > loss_duration: 3.411022901535034 (3.411022901535034) | > loss_1: 45.50471878051758 (45.50471878051758)  --> STEP: 2 | > loss_disc: 2.1810431480407715 (2.054225742816925) | > loss_disc_real_0: 0.3369847536087036 (0.35552236437797546) | > loss_disc_real_1: 0.28139442205429077 (0.21794292330741882) | > loss_disc_real_2: 0.16962046921253204 (0.19099082797765732) | > loss_disc_real_3: 0.28442296385765076 (0.20173148065805435) | > loss_disc_real_4: 0.12235364317893982 (0.14286474883556366) | > loss_disc_real_5: 0.3020448684692383 (0.22409825026988983) | > loss_0: 2.1810431480407715 (2.054225742816925) | > loss_gen: 3.919745445251465 (3.629618525505066) | > loss_kl: 5.693882942199707 (5.540507793426514) | > loss_feat: 11.218671798706055 (10.021987915039062) | > loss_mel: 24.959062576293945 (24.750414848327637) | > loss_duration: 3.253391742706299 (3.3322073221206665) | > loss_1: 49.04475784301758 (47.27473831176758)  --> STEP: 3 | > loss_disc: 3.053642988204956 (2.3873648246129355) | > loss_disc_real_0: 0.45980122685432434 (0.3902819852034251) | > loss_disc_real_1: 0.32365936040878296 (0.2531817356745402) | > loss_disc_real_2: 0.33130812644958496 (0.2377632608016332) | > loss_disc_real_3: 0.2510434091091156 (0.21816879014174143) | > loss_disc_real_4: 0.3238176703453064 (0.20318238933881125) | > loss_disc_real_5: 0.28101977705955505 (0.24307209253311157) | > loss_0: 3.053642988204956 (2.3873648246129355) | > loss_gen: 2.209425210952759 (3.1562207539876304) | > loss_kl: 3.1607606410980225 (4.74725874265035) | > loss_feat: 1.9418665170669556 (7.328614115715027) | > loss_mel: 20.024513244628906 (23.175114313761394) | > loss_duration: 3.0275931358337402 (3.2306692600250244) | > loss_1: 30.364158630371094 (41.63787841796875) --> EVAL PERFORMANCE | > avg_loader_time: 0.016044775644938152 (+0.009074608484903973) | > avg_loss_disc: 2.3873648246129355 (-0.32796967029571533) | > avg_loss_disc_real_0: 0.3902819852034251 (+0.10935885707537335) | > avg_loss_disc_real_1: 0.2531817356745402 (+0.026260356108347593) | > avg_loss_disc_real_2: 0.2377632608016332 (-0.04597570995489755) | > avg_loss_disc_real_3: 0.21816879014174143 (-0.054592758417129544) | > avg_loss_disc_real_4: 0.20318238933881125 (-0.1284759690364202) | > avg_loss_disc_real_5: 0.24307209253311157 (-0.08538344999154407) | > avg_loss_0: 2.3873648246129355 (-0.32796967029571533) | > avg_loss_gen: 3.1562207539876304 (+0.7087055842081709) | > avg_loss_kl: 4.74725874265035 (-0.0982681115468349) | > avg_loss_feat: 7.328614115715027 (+0.8274817864100141) | > avg_loss_mel: 23.175114313761394 (+0.10966555277506629) | > avg_loss_duration: 3.2306692600250244 (+0.031232357025146484) | > avg_loss_1: 41.63787841796875 (+1.5788167317708357)  > EPOCH: 1114/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:00:13)   --> TIME: 2023-10-20 14:00:29 -- STEP: 19/50 -- GLOBAL_STEP: 108720 | > loss_disc: 2.8703560829162598 (2.4193805644386694) | > loss_disc_real_0: 0.08928191661834717 (0.14725256951427773) | > loss_disc_real_1: 0.27275362610816956 (0.2264732016544593) | > loss_disc_real_2: 0.4229182302951813 (0.2434501479330816) | > loss_disc_real_3: 0.2785547375679016 (0.23767590169843875) | > loss_disc_real_4: 0.36088964343070984 (0.22815012990644104) | > loss_disc_real_5: 0.3597662150859833 (0.21697387275727173) | > loss_0: 2.8703560829162598 (2.4193805644386694) | > grad_norm_0: tensor(707.6690, device='cuda:0') (tensor(719.2217, device='cuda:0')) | > loss_gen: 2.1877477169036865 (2.354359833817733) | > loss_kl: 0.9523993134498596 (0.8078846845187639) | > loss_feat: 4.381372451782227 (5.61482177517916) | > loss_mel: 23.749950408935547 (20.85684051011738) | > loss_duration: 1.4740835428237915 (1.3606653715434827) | > loss_1: 32.74555206298828 (30.994572237918252) | > grad_norm_1: tensor(4679.7231, device='cuda:0') (tensor(31478.5488, device='cuda:0')) | > current_lr_0: 6.564410062758066e-05 | > current_lr_1: 6.564410062758066e-05 | > step_time: 0.3116 (0.4825563932719982) | > loader_time: 0.0049 (0.015961069809763057)  --> TIME: 2023-10-20 14:00:43 -- STEP: 49/50 -- GLOBAL_STEP: 108750 | > loss_disc: 2.6437931060791016 (2.492024280587021) | > loss_disc_real_0: 0.18185073137283325 (0.15205434388576114) | > loss_disc_real_1: 0.21750536561012268 (0.2221290327760638) | > loss_disc_real_2: 0.1148265078663826 (0.23033308777578024) | > loss_disc_real_3: 0.20621298253536224 (0.24118069430090944) | > loss_disc_real_4: 0.12775790691375732 (0.2321293934875605) | > loss_disc_real_5: 0.13358697295188904 (0.22685556326593673) | > loss_0: 2.6437931060791016 (2.492024280587021) | > grad_norm_0: tensor(717.9098, device='cuda:0') (tensor(701.1933, device='cuda:0')) | > loss_gen: 2.046379566192627 (2.230708852106212) | > loss_kl: 0.5766439437866211 (0.7810352748754074) | > loss_feat: 5.9229416847229 (5.013312935525057) | > loss_mel: 24.746137619018555 (20.41275746238475) | > loss_duration: 1.4344016313552856 (1.3333232524443643) | > loss_1: 34.726505279541016 (29.771137801968322) | > grad_norm_1: tensor(20891.5547, device='cuda:0') (tensor(20068.8047, device='cuda:0')) | > current_lr_0: 6.564410062758066e-05 | > current_lr_1: 6.564410062758066e-05 | > step_time: 0.3292 (0.4542659399460772) | > loader_time: 0.4833 (0.020405039495351364)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9885666370391846 (2.9885666370391846) | > loss_disc_real_0: 0.33750009536743164 (0.33750009536743164) | > loss_disc_real_1: 0.2548738420009613 (0.2548738420009613) | > loss_disc_real_2: 0.2393018752336502 (0.2393018752336502) | > loss_disc_real_3: 0.3010173738002777 (0.3010173738002777) | > loss_disc_real_4: 0.2460232824087143 (0.2460232824087143) | > loss_disc_real_5: 0.25091180205345154 (0.25091180205345154) | > loss_0: 2.9885666370391846 (2.9885666370391846) | > loss_gen: 1.668372631072998 (1.668372631072998) | > loss_kl: 5.544687747955322 (5.544687747955322) | > loss_feat: 0.08915483206510544 (0.08915483206510544) | > loss_mel: 4.304007530212402 (4.304007530212402) | > loss_duration: 3.048267126083374 (3.048267126083374) | > loss_1: 14.654489517211914 (14.654489517211914)  --> STEP: 1 | > loss_disc: 2.7582879066467285 (2.7582879066467285) | > loss_disc_real_0: 0.10062451660633087 (0.10062451660633087) | > loss_disc_real_1: 0.24299921095371246 (0.24299921095371246) | > loss_disc_real_2: 0.2980669438838959 (0.2980669438838959) | > loss_disc_real_3: 0.34278178215026855 (0.34278178215026855) | > loss_disc_real_4: 0.35201019048690796 (0.35201019048690796) | > loss_disc_real_5: 0.4199579358100891 (0.4199579358100891) | > loss_0: 2.7582879066467285 (2.7582879066467285) | > loss_gen: 2.3426918983459473 (2.3426918983459473) | > loss_kl: 5.562068462371826 (5.562068462371826) | > loss_feat: 6.347682476043701 (6.347682476043701) | > loss_mel: 23.721698760986328 (23.721698760986328) | > loss_duration: 3.398162603378296 (3.398162603378296) | > loss_1: 41.37230682373047 (41.37230682373047)  --> STEP: 2 | > loss_disc: 2.735752820968628 (2.7470203638076782) | > loss_disc_real_0: 0.5822657346725464 (0.34144512563943863) | > loss_disc_real_1: 0.1926422417163849 (0.21782072633504868) | > loss_disc_real_2: 0.22426116466522217 (0.261164054274559) | > loss_disc_real_3: 0.20525607466697693 (0.27401892840862274) | > loss_disc_real_4: 0.1330558806657791 (0.24253303557634354) | > loss_disc_real_5: 0.17228074371814728 (0.2961193397641182) | > loss_0: 2.735752820968628 (2.7470203638076782) | > loss_gen: 2.0457534790039062 (2.1942226886749268) | > loss_kl: 5.699306488037109 (5.630687475204468) | > loss_feat: 10.266117095947266 (8.306899785995483) | > loss_mel: 26.587499618530273 (25.1545991897583) | > loss_duration: 3.2110910415649414 (3.3046268224716187) | > loss_1: 47.80976867675781 (44.59103775024414)  --> STEP: 3 | > loss_disc: 2.7112162113189697 (2.735085646311442) | > loss_disc_real_0: 0.20815494656562805 (0.29701506594816846) | > loss_disc_real_1: 0.26869112253189087 (0.2347775250673294) | > loss_disc_real_2: 0.2650938928127289 (0.262474000453949) | > loss_disc_real_3: 0.4168848693370819 (0.32164090871810913) | > loss_disc_real_4: 0.27720391750335693 (0.25408999621868134) | > loss_disc_real_5: 0.3187568783760071 (0.3036651859680812) | > loss_0: 2.7112162113189697 (2.735085646311442) | > loss_gen: 2.4904115200042725 (2.292952299118042) | > loss_kl: 2.6031525135040283 (4.621509154637654) | > loss_feat: 3.1528985500335693 (6.588899374008179) | > loss_mel: 21.620784759521484 (23.976661046346027) | > loss_duration: 3.0038414001464844 (3.2043650150299072) | > loss_1: 32.87108612060547 (40.68438720703125) --> EVAL PERFORMANCE | > avg_loader_time: 0.007828791936238607 (-0.008215983708699545) | > avg_loss_disc: 2.735085646311442 (+0.3477208216985064) | > avg_loss_disc_real_0: 0.29701506594816846 (-0.09326691925525665) | > avg_loss_disc_real_1: 0.2347775250673294 (-0.018404210607210814) | > avg_loss_disc_real_2: 0.262474000453949 (+0.024710739652315766) | > avg_loss_disc_real_3: 0.32164090871810913 (+0.1034721185763677) | > avg_loss_disc_real_4: 0.25408999621868134 (+0.05090760687987009) | > avg_loss_disc_real_5: 0.3036651859680812 (+0.0605930934349696) | > avg_loss_0: 2.735085646311442 (+0.3477208216985064) | > avg_loss_gen: 2.292952299118042 (-0.8632684548695884) | > avg_loss_kl: 4.621509154637654 (-0.1257495880126953) | > avg_loss_feat: 6.588899374008179 (-0.7397147417068481) | > avg_loss_mel: 23.976661046346027 (+0.801546732584633) | > avg_loss_duration: 3.2043650150299072 (-0.026304244995117188) | > avg_loss_1: 40.68438720703125 (-0.9534912109375)  > EPOCH: 1115/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:01:05)   --> TIME: 2023-10-20 14:01:29 -- STEP: 29/50 -- GLOBAL_STEP: 108780 | > loss_disc: 2.309173822402954 (2.47849669333162) | > loss_disc_real_0: 0.2650923728942871 (0.15001369254856273) | > loss_disc_real_1: 0.1712774783372879 (0.22181396777259893) | > loss_disc_real_2: 0.21968062222003937 (0.22803800219091877) | > loss_disc_real_3: 0.3357444405555725 (0.25858882840337427) | > loss_disc_real_4: 0.18775638937950134 (0.24828429841275867) | > loss_disc_real_5: 0.25228700041770935 (0.2534856995374992) | > loss_0: 2.309173822402954 (2.47849669333162) | > grad_norm_0: tensor(466.2030, device='cuda:0') (tensor(561.8997, device='cuda:0')) | > loss_gen: 2.559375286102295 (2.2964071158705086) | > loss_kl: 0.6999140381813049 (0.8765030030546517) | > loss_feat: 5.073753833770752 (5.149746729767528) | > loss_mel: 24.533723831176758 (19.653855023712946) | > loss_duration: 1.3753081560134888 (1.335286757041668) | > loss_1: 34.2420768737793 (29.311798704081568) | > grad_norm_1: tensor(10459.8447, device='cuda:0') (tensor(20738.3730, device='cuda:0')) | > current_lr_0: 6.557848523906838e-05 | > current_lr_1: 6.557848523906838e-05 | > step_time: 0.6332 (0.6220023960902773) | > loader_time: 0.0061 (0.02214371746984022)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8916094303131104 (2.8916094303131104) | > loss_disc_real_0: 0.12662535905838013 (0.12662535905838013) | > loss_disc_real_1: 0.19677837193012238 (0.19677837193012238) | > loss_disc_real_2: 0.23452237248420715 (0.23452237248420715) | > loss_disc_real_3: 0.31453895568847656 (0.31453895568847656) | > loss_disc_real_4: 0.316610187292099 (0.316610187292099) | > loss_disc_real_5: 0.3798559606075287 (0.3798559606075287) | > loss_0: 2.8916094303131104 (2.8916094303131104) | > loss_gen: 1.9896867275238037 (1.9896867275238037) | > loss_kl: 5.3597731590271 (5.3597731590271) | > loss_feat: 5.193011283874512 (5.193011283874512) | > loss_mel: 22.916072845458984 (22.916072845458984) | > loss_duration: 3.1156859397888184 (3.1156859397888184) | > loss_1: 38.57422637939453 (38.57422637939453)  --> STEP: 1 | > loss_disc: 2.290773391723633 (2.290773391723633) | > loss_disc_real_0: 0.08432738482952118 (0.08432738482952118) | > loss_disc_real_1: 0.13679268956184387 (0.13679268956184387) | > loss_disc_real_2: 0.16680103540420532 (0.16680103540420532) | > loss_disc_real_3: 0.20863808691501617 (0.20863808691501617) | > loss_disc_real_4: 0.22632287442684174 (0.22632287442684174) | > loss_disc_real_5: 0.24308297038078308 (0.24308297038078308) | > loss_0: 2.290773391723633 (2.290773391723633) | > loss_gen: 1.9544458389282227 (1.9544458389282227) | > loss_kl: 5.552990436553955 (5.552990436553955) | > loss_feat: 5.002013206481934 (5.002013206481934) | > loss_mel: 23.142000198364258 (23.142000198364258) | > loss_duration: 3.405661106109619 (3.405661106109619) | > loss_1: 39.05711364746094 (39.05711364746094)  --> STEP: 2 | > loss_disc: 2.4521372318267822 (2.3714553117752075) | > loss_disc_real_0: 0.3421514630317688 (0.213239423930645) | > loss_disc_real_1: 0.19028066098690033 (0.1635366752743721) | > loss_disc_real_2: 0.33445292711257935 (0.25062698125839233) | > loss_disc_real_3: 0.17724624276161194 (0.19294216483831406) | > loss_disc_real_4: 0.19442416727542877 (0.21037352085113525) | > loss_disc_real_5: 0.18213732540607452 (0.2126101478934288) | > loss_0: 2.4521372318267822 (2.3714553117752075) | > loss_gen: 2.376962184906006 (2.1657040119171143) | > loss_kl: 5.819520950317383 (5.686255693435669) | > loss_feat: 9.803144454956055 (7.402578830718994) | > loss_mel: 26.076154708862305 (24.60907745361328) | > loss_duration: 3.1790640354156494 (3.2923625707626343) | > loss_1: 47.25484848022461 (43.15598106384277)  --> STEP: 3 | > loss_disc: 2.374222755432129 (2.372377792994181) | > loss_disc_real_0: 0.25949525833129883 (0.2286580353975296) | > loss_disc_real_1: 0.26532605290412903 (0.19746646781762442) | > loss_disc_real_2: 0.31550055742263794 (0.2722515066464742) | > loss_disc_real_3: 0.18681082129478455 (0.19089838365713754) | > loss_disc_real_4: 0.20790459215641022 (0.20955054461956024) | > loss_disc_real_5: 0.10533563047647476 (0.17685197542111078) | > loss_0: 2.374222755432129 (2.372377792994181) | > loss_gen: 2.8303680419921875 (2.387258688608805) | > loss_kl: 3.03737211227417 (4.803294499715169) | > loss_feat: 6.906506538391113 (7.237221399943034) | > loss_mel: 23.507844924926758 (24.241999944051106) | > loss_duration: 3.0777475833892822 (3.2208242416381836) | > loss_1: 39.35983657836914 (41.8905995686849) --> EVAL PERFORMANCE | > avg_loader_time: 0.006756703058878581 (-0.0010720888773600263) | > avg_loss_disc: 2.372377792994181 (-0.36270785331726074) | > avg_loss_disc_real_0: 0.2286580353975296 (-0.06835703055063885) | > avg_loss_disc_real_1: 0.19746646781762442 (-0.03731105724970499) | > avg_loss_disc_real_2: 0.2722515066464742 (+0.00977750619252521) | > avg_loss_disc_real_3: 0.19089838365713754 (-0.1307425250609716) | > avg_loss_disc_real_4: 0.20955054461956024 (-0.044539451599121094) | > avg_loss_disc_real_5: 0.17685197542111078 (-0.1268132105469704) | > avg_loss_0: 2.372377792994181 (-0.36270785331726074) | > avg_loss_gen: 2.387258688608805 (+0.0943063894907632) | > avg_loss_kl: 4.803294499715169 (+0.18178534507751465) | > avg_loss_feat: 7.237221399943034 (+0.6483220259348554) | > avg_loss_mel: 24.241999944051106 (+0.2653388977050781) | > avg_loss_duration: 3.2208242416381836 (+0.016459226608276367) | > avg_loss_1: 41.8905995686849 (+1.2062123616536482)  > EPOCH: 1116/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:02:18)   --> TIME: 2023-10-20 14:02:30 -- STEP: 9/50 -- GLOBAL_STEP: 108810 | > loss_disc: 1.964233160018921 (2.3501672877205744) | > loss_disc_real_0: 0.1976434737443924 (0.09641607995662424) | > loss_disc_real_1: 0.32110461592674255 (0.24066758569743898) | > loss_disc_real_2: 0.24069064855575562 (0.20935632619592878) | > loss_disc_real_3: 0.26187044382095337 (0.2327309399843216) | > loss_disc_real_4: 0.07702866196632385 (0.1600537987218963) | > loss_disc_real_5: 0.08758935332298279 (0.16109645118316016) | > loss_0: 1.964233160018921 (2.3501672877205744) | > grad_norm_0: tensor(338.8576, device='cuda:0') (tensor(582.9852, device='cuda:0')) | > loss_gen: 2.847916841506958 (2.2086210118399725) | > loss_kl: 0.9829169511795044 (0.7908454404936897) | > loss_feat: 7.501458644866943 (5.68217851055993) | > loss_mel: 20.52959442138672 (20.6705928378635) | > loss_duration: 1.3250641822814941 (1.3448362880282931) | > loss_1: 33.18695068359375 (30.69707383049859) | > grad_norm_1: tensor(33647.0273, device='cuda:0') (tensor(21942.9883, device='cuda:0')) | > current_lr_0: 6.551293543724506e-05 | > current_lr_1: 6.551293543724506e-05 | > step_time: 0.677 (0.6985707018110487) | > loader_time: 0.0429 (0.03827929496765137)  --> TIME: 2023-10-20 14:02:51 -- STEP: 39/50 -- GLOBAL_STEP: 108840 | > loss_disc: 2.204423427581787 (2.472219785054525) | > loss_disc_real_0: 0.12070248275995255 (0.13536553151714495) | > loss_disc_real_1: 0.1547553688287735 (0.23114123778083387) | > loss_disc_real_2: 0.1100674495100975 (0.23059958849961942) | > loss_disc_real_3: 0.22426657378673553 (0.22864851928674257) | > loss_disc_real_4: 0.13216790556907654 (0.21549347845407632) | > loss_disc_real_5: 0.23372018337249756 (0.20468662163385978) | > loss_0: 2.204423427581787 (2.472219785054525) | > grad_norm_0: tensor(825.9918, device='cuda:0') (tensor(572.8369, device='cuda:0')) | > loss_gen: 2.3248448371887207 (2.244169137416742) | > loss_kl: 0.6512887477874756 (0.8379084643645164) | > loss_feat: 5.963347434997559 (6.054741673362561) | > loss_mel: 18.996686935424805 (21.314845335789215) | > loss_duration: 1.3937066793441772 (1.326964714588263) | > loss_1: 29.329875946044922 (31.77862896063389) | > grad_norm_1: tensor(15291.4688, device='cuda:0') (tensor(18294.3398, device='cuda:0')) | > current_lr_0: 6.551293543724506e-05 | > current_lr_1: 6.551293543724506e-05 | > step_time: 1.0344 (0.6810894379248986) | > loader_time: 0.0461 (0.027649965041723006)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.955392360687256 (2.955392360687256) | > loss_disc_real_0: 0.18810857832431793 (0.18810857832431793) | > loss_disc_real_1: 0.2574668228626251 (0.2574668228626251) | > loss_disc_real_2: 0.2488483041524887 (0.2488483041524887) | > loss_disc_real_3: 0.2753734290599823 (0.2753734290599823) | > loss_disc_real_4: 0.26227620244026184 (0.26227620244026184) | > loss_disc_real_5: 0.29135358333587646 (0.29135358333587646) | > loss_0: 2.955392360687256 (2.955392360687256) | > loss_gen: 1.5804640054702759 (1.5804640054702759) | > loss_kl: 6.268649101257324 (6.268649101257324) | > loss_feat: 0.14087897539138794 (0.14087897539138794) | > loss_mel: 2.2361621856689453 (2.2361621856689453) | > loss_duration: 3.1119544506073 (3.1119544506073) | > loss_1: 13.338109970092773 (13.338109970092773)  --> STEP: 1 | > loss_disc: 1.3830820322036743 (1.3830820322036743) | > loss_disc_real_0: 0.14019271731376648 (0.14019271731376648) | > loss_disc_real_1: 0.013944673351943493 (0.013944673351943493) | > loss_disc_real_2: 0.05171089619398117 (0.05171089619398117) | > loss_disc_real_3: 0.1014268547296524 (0.1014268547296524) | > loss_disc_real_4: 0.047041259706020355 (0.047041259706020355) | > loss_disc_real_5: 0.12396085262298584 (0.12396085262298584) | > loss_0: 1.3830820322036743 (1.3830820322036743) | > loss_gen: 2.6676530838012695 (2.6676530838012695) | > loss_kl: 5.738385200500488 (5.738385200500488) | > loss_feat: 20.18372344970703 (20.18372344970703) | > loss_mel: 27.862001419067383 (27.862001419067383) | > loss_duration: 3.37628436088562 (3.37628436088562) | > loss_1: 59.82804870605469 (59.82804870605469)  --> STEP: 2 | > loss_disc: 2.6705057621002197 (2.026793897151947) | > loss_disc_real_0: 0.41615408658981323 (0.27817340195178986) | > loss_disc_real_1: 0.17552787065505981 (0.09473627200350165) | > loss_disc_real_2: 0.16516409814357758 (0.10843749716877937) | > loss_disc_real_3: 0.09703146666288376 (0.09922916069626808) | > loss_disc_real_4: 0.24057285487651825 (0.1438070572912693) | > loss_disc_real_5: 0.29036960005760193 (0.20716522634029388) | > loss_0: 2.6705057621002197 (2.026793897151947) | > loss_gen: 2.4725379943847656 (2.5700955390930176) | > loss_kl: 5.888125419616699 (5.813255310058594) | > loss_feat: 7.793257713317871 (13.988490581512451) | > loss_mel: 24.93431854248047 (26.398159980773926) | > loss_duration: 3.2339203357696533 (3.3051023483276367) | > loss_1: 44.32215881347656 (52.075103759765625)  --> STEP: 3 | > loss_disc: 3.094409704208374 (2.382665832837423) | > loss_disc_real_0: 0.28482839465141296 (0.28039173285166424) | > loss_disc_real_1: 0.276100218296051 (0.1551909207676848) | > loss_disc_real_2: 0.24745751917362213 (0.15477750450372696) | > loss_disc_real_3: 0.3576492667198181 (0.18536919603745142) | > loss_disc_real_4: 0.3393166661262512 (0.20897692690292993) | > loss_disc_real_5: 0.39400237798690796 (0.2694442768891652) | > loss_0: 3.094409704208374 (2.382665832837423) | > loss_gen: 2.0290513038635254 (2.389747460683187) | > loss_kl: 2.5818030834198 (4.736104567845662) | > loss_feat: 2.603381633758545 (10.193454265594482) | > loss_mel: 17.65241050720215 (23.48291015625) | > loss_duration: 3.163588047027588 (3.2579309145609536) | > loss_1: 28.03023338317871 (44.060146967569985) --> EVAL PERFORMANCE | > avg_loader_time: 0.007601420084635417 (+0.0008447170257568359) | > avg_loss_disc: 2.382665832837423 (+0.01028803984324167) | > avg_loss_disc_real_0: 0.28039173285166424 (+0.05173369745413464) | > avg_loss_disc_real_1: 0.1551909207676848 (-0.04227554704993963) | > avg_loss_disc_real_2: 0.15477750450372696 (-0.11747400214274722) | > avg_loss_disc_real_3: 0.18536919603745142 (-0.005529187619686127) | > avg_loss_disc_real_4: 0.20897692690292993 (-0.0005736177166303091) | > avg_loss_disc_real_5: 0.2694442768891652 (+0.09259230146805444) | > avg_loss_0: 2.382665832837423 (+0.01028803984324167) | > avg_loss_gen: 2.389747460683187 (+0.0024887720743818065) | > avg_loss_kl: 4.736104567845662 (-0.06718993186950684) | > avg_loss_feat: 10.193454265594482 (+2.9562328656514483) | > avg_loss_mel: 23.48291015625 (-0.7590897878011056) | > avg_loss_duration: 3.2579309145609536 (+0.037106672922770034) | > avg_loss_1: 44.060146967569985 (+2.1695473988850864)  > EPOCH: 1117/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:03:17)   --> TIME: 2023-10-20 14:03:34 -- STEP: 19/50 -- GLOBAL_STEP: 108870 | > loss_disc: 2.0246899127960205 (2.479840931139494) | > loss_disc_real_0: 0.03623124212026596 (0.1579644571205503) | > loss_disc_real_1: 0.1827983558177948 (0.21099234862547173) | > loss_disc_real_2: 0.21792776882648468 (0.21570052167302683) | > loss_disc_real_3: 0.22533610463142395 (0.25443846477489723) | > loss_disc_real_4: 0.1157868355512619 (0.24101932640922696) | > loss_disc_real_5: 0.14841493964195251 (0.2532891076254217) | > loss_0: 2.0246899127960205 (2.479840931139494) | > grad_norm_0: tensor(367.7829, device='cuda:0') (tensor(509.4005, device='cuda:0')) | > loss_gen: 2.314253330230713 (2.3068408150421944) | > loss_kl: 0.676702082157135 (0.8095790132095939) | > loss_feat: 5.841655731201172 (5.60842014182555) | > loss_mel: 21.851415634155273 (20.923220860330684) | > loss_duration: 1.3872151374816895 (1.3542773284410174) | > loss_1: 32.07124328613281 (31.002337907489977) | > grad_norm_1: tensor(6429.1196, device='cuda:0') (tensor(17206.1582, device='cuda:0')) | > current_lr_0: 6.54474511565527e-05 | > current_lr_1: 6.54474511565527e-05 | > step_time: 0.6939 (0.6140786974053634) | > loader_time: 0.0095 (0.021307957799811112)  --> TIME: 2023-10-20 14:03:47 -- STEP: 49/50 -- GLOBAL_STEP: 108900 | > loss_disc: 2.4102931022644043 (2.4659976813257956) | > loss_disc_real_0: 0.07520740479230881 (0.15111633509929692) | > loss_disc_real_1: 0.17643581330776215 (0.2157141323752549) | > loss_disc_real_2: 0.20998458564281464 (0.21685046573378602) | > loss_disc_real_3: 0.36386752128601074 (0.24460119457573307) | > loss_disc_real_4: 0.3108299672603607 (0.2336865687856869) | > loss_disc_real_5: 0.1861121654510498 (0.240183847291129) | > loss_0: 2.4102931022644043 (2.4659976813257956) | > grad_norm_0: tensor(803.3377, device='cuda:0') (tensor(576.3720, device='cuda:0')) | > loss_gen: 2.3019707202911377 (2.2805010761533464) | > loss_kl: 0.9062374234199524 (0.8237903528675741) | > loss_feat: 6.198964595794678 (5.3972025953081175) | > loss_mel: 24.044628143310547 (19.549713329393036) | > loss_duration: 1.4254999160766602 (1.327311739629629) | > loss_1: 34.87730026245117 (29.378518980376576) | > grad_norm_1: tensor(7430.2515, device='cuda:0') (tensor(15217.1191, device='cuda:0')) | > current_lr_0: 6.54474511565527e-05 | > current_lr_1: 6.54474511565527e-05 | > step_time: 0.5085 (0.4709319435820288) | > loader_time: 0.8029 (0.02824311353722397)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.100050926208496 (3.100050926208496) | > loss_disc_real_0: 0.5593913197517395 (0.5593913197517395) | > loss_disc_real_1: 0.2599976062774658 (0.2599976062774658) | > loss_disc_real_2: 0.23412904143333435 (0.23412904143333435) | > loss_disc_real_3: 0.25474968552589417 (0.25474968552589417) | > loss_disc_real_4: 0.23917967081069946 (0.23917967081069946) | > loss_disc_real_5: 0.2750628590583801 (0.2750628590583801) | > loss_0: 3.100050926208496 (3.100050926208496) | > loss_gen: 1.9743380546569824 (1.9743380546569824) | > loss_kl: 5.560383319854736 (5.560383319854736) | > loss_feat: 0.3248947560787201 (0.3248947560787201) | > loss_mel: 15.625097274780273 (15.625097274780273) | > loss_duration: 3.0554325580596924 (3.0554325580596924) | > loss_1: 26.54014778137207 (26.54014778137207)  --> STEP: 1 | > loss_disc: 2.7369065284729004 (2.7369065284729004) | > loss_disc_real_0: 0.3447640836238861 (0.3447640836238861) | > loss_disc_real_1: 0.29827749729156494 (0.29827749729156494) | > loss_disc_real_2: 0.20866569876670837 (0.20866569876670837) | > loss_disc_real_3: 0.29805317521095276 (0.29805317521095276) | > loss_disc_real_4: 0.27533936500549316 (0.27533936500549316) | > loss_disc_real_5: 0.1881708949804306 (0.1881708949804306) | > loss_0: 2.7369065284729004 (2.7369065284729004) | > loss_gen: 2.59248685836792 (2.59248685836792) | > loss_kl: 5.675170421600342 (5.675170421600342) | > loss_feat: 5.5574140548706055 (5.5574140548706055) | > loss_mel: 23.932191848754883 (23.932191848754883) | > loss_duration: 3.377974510192871 (3.377974510192871) | > loss_1: 41.13523864746094 (41.13523864746094)  --> STEP: 2 | > loss_disc: 3.571359395980835 (3.1541329622268677) | > loss_disc_real_0: 0.6379424333572388 (0.49135325849056244) | > loss_disc_real_1: 0.3265558183193207 (0.3124166578054428) | > loss_disc_real_2: 0.3801509141921997 (0.29440830647945404) | > loss_disc_real_3: 0.2457382082939148 (0.2718956917524338) | > loss_disc_real_4: 0.4318236708641052 (0.3535815179347992) | > loss_disc_real_5: 0.3765595257282257 (0.28236521035432816) | > loss_0: 3.571359395980835 (3.1541329622268677) | > loss_gen: 2.143282651901245 (2.3678847551345825) | > loss_kl: 5.524067401885986 (5.599618911743164) | > loss_feat: 8.903444290161133 (7.230429172515869) | > loss_mel: 21.738454818725586 (22.835323333740234) | > loss_duration: 3.2649617195129395 (3.3214681148529053) | > loss_1: 41.57421112060547 (41.3547248840332)  --> STEP: 3 | > loss_disc: 3.1012651920318604 (3.1365103721618652) | > loss_disc_real_0: 0.5801106691360474 (0.5209390620390574) | > loss_disc_real_1: 0.24540463089942932 (0.2900793155034383) | > loss_disc_real_2: 0.30169424414634705 (0.2968369523684184) | > loss_disc_real_3: 0.2733323574066162 (0.27237458030382794) | > loss_disc_real_4: 0.21596965193748474 (0.3077108959356944) | > loss_disc_real_5: 0.23899582028388977 (0.2679087469975154) | > loss_0: 3.1012651920318604 (3.1365103721618652) | > loss_gen: 2.0293772220611572 (2.255048910776774) | > loss_kl: 3.1155881881713867 (4.771608670552571) | > loss_feat: 1.023593783378601 (5.161484042803447) | > loss_mel: 14.84080982208252 (20.170485496520996) | > loss_duration: 3.073258399963379 (3.238731543223063) | > loss_1: 24.082626342773438 (35.59735870361328) --> EVAL PERFORMANCE | > avg_loader_time: 0.024650414784749348 (+0.01704899470011393) | > avg_loss_disc: 3.1365103721618652 (+0.7538445393244424) | > avg_loss_disc_real_0: 0.5209390620390574 (+0.24054732918739313) | > avg_loss_disc_real_1: 0.2900793155034383 (+0.1348883947357535) | > avg_loss_disc_real_2: 0.2968369523684184 (+0.14205944786469143) | > avg_loss_disc_real_3: 0.27237458030382794 (+0.08700538426637652) | > avg_loss_disc_real_4: 0.3077108959356944 (+0.09873396903276446) | > avg_loss_disc_real_5: 0.2679087469975154 (-0.001535529891649845) | > avg_loss_0: 3.1365103721618652 (+0.7538445393244424) | > avg_loss_gen: 2.255048910776774 (-0.13469854990641306) | > avg_loss_kl: 4.771608670552571 (+0.03550410270690918) | > avg_loss_feat: 5.161484042803447 (-5.031970222791036) | > avg_loss_mel: 20.170485496520996 (-3.312424659729004) | > avg_loss_duration: 3.238731543223063 (-0.019199371337890625) | > avg_loss_1: 35.59735870361328 (-8.462788263956703)  > EPOCH: 1118/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:04:02)   --> TIME: 2023-10-20 14:04:27 -- STEP: 29/50 -- GLOBAL_STEP: 108930 | > loss_disc: 2.7896270751953125 (2.5353246475088187) | > loss_disc_real_0: 0.1851898580789566 (0.1663406404570259) | > loss_disc_real_1: 0.30528193712234497 (0.21599167045848122) | > loss_disc_real_2: 0.3091971278190613 (0.22050062644070592) | > loss_disc_real_3: 0.26585087180137634 (0.2343043023399238) | > loss_disc_real_4: 0.27173471450805664 (0.2184055699356671) | > loss_disc_real_5: 0.2590787708759308 (0.2274630932972349) | > loss_0: 2.7896270751953125 (2.5353246475088187) | > grad_norm_0: tensor(755.6918, device='cuda:0') (tensor(744.0182, device='cuda:0')) | > loss_gen: 1.8861829042434692 (2.093354886975782) | > loss_kl: 0.9121585488319397 (0.8598188038530021) | > loss_feat: 0.8010500073432922 (4.727089706422953) | > loss_mel: 15.942206382751465 (18.635117374617472) | > loss_duration: 1.3386180400848389 (1.3348197402625248) | > loss_1: 20.88021469116211 (27.650200613613787) | > grad_norm_1: tensor(9247.4971, device='cuda:0') (tensor(19591.0254, device='cuda:0')) | > current_lr_0: 6.53820323314988e-05 | > current_lr_1: 6.53820323314988e-05 | > step_time: 0.6224 (0.6741521276276687) | > loader_time: 0.0351 (0.023784292155298693)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.718048334121704 (2.718048334121704) | > loss_disc_real_0: 0.15764883160591125 (0.15764883160591125) | > loss_disc_real_1: 0.24519100785255432 (0.24519100785255432) | > loss_disc_real_2: 0.3089921176433563 (0.3089921176433563) | > loss_disc_real_3: 0.3956906795501709 (0.3956906795501709) | > loss_disc_real_4: 0.4660882353782654 (0.4660882353782654) | > loss_disc_real_5: 0.3296891450881958 (0.3296891450881958) | > loss_0: 2.718048334121704 (2.718048334121704) | > loss_gen: 2.8070881366729736 (2.8070881366729736) | > loss_kl: 5.084631443023682 (5.084631443023682) | > loss_feat: 6.618384838104248 (6.618384838104248) | > loss_mel: 20.46398162841797 (20.46398162841797) | > loss_duration: 3.0271825790405273 (3.0271825790405273) | > loss_1: 38.00127029418945 (38.00127029418945)  --> STEP: 1 | > loss_disc: 1.8693400621414185 (1.8693400621414185) | > loss_disc_real_0: 0.029095204547047615 (0.029095204547047615) | > loss_disc_real_1: 0.2644960880279541 (0.2644960880279541) | > loss_disc_real_2: 0.16594365239143372 (0.16594365239143372) | > loss_disc_real_3: 0.16766181588172913 (0.16766181588172913) | > loss_disc_real_4: 0.10466417670249939 (0.10466417670249939) | > loss_disc_real_5: 0.16073276102542877 (0.16073276102542877) | > loss_0: 1.8693400621414185 (1.8693400621414185) | > loss_gen: 2.5746984481811523 (2.5746984481811523) | > loss_kl: 4.827295303344727 (4.827295303344727) | > loss_feat: 9.46876049041748 (9.46876049041748) | > loss_mel: 21.470800399780273 (21.470800399780273) | > loss_duration: 3.3203160762786865 (3.3203160762786865) | > loss_1: 41.66187286376953 (41.66187286376953)  --> STEP: 2 | > loss_disc: 3.0290727615356445 (2.4492064118385315) | > loss_disc_real_0: 0.2752925753593445 (0.15219388995319605) | > loss_disc_real_1: 0.27771884202957153 (0.2711074650287628) | > loss_disc_real_2: 0.27902087569236755 (0.22248226404190063) | > loss_disc_real_3: 0.2987990081310272 (0.23323041200637817) | > loss_disc_real_4: 0.2558113634586334 (0.1802377700805664) | > loss_disc_real_5: 0.29160815477371216 (0.22617045789957047) | > loss_0: 3.0290727615356445 (2.4492064118385315) | > loss_gen: 1.6639270782470703 (2.1193127632141113) | > loss_kl: 5.709721565246582 (5.268508434295654) | > loss_feat: 0.10347068309783936 (4.78611558675766) | > loss_mel: 2.4405436515808105 (11.955672025680542) | > loss_duration: 3.1430892944335938 (3.23170268535614) | > loss_1: 13.060752868652344 (27.361312866210938)  --> STEP: 3 | > loss_disc: 2.26617431640625 (2.3881957133611045) | > loss_disc_real_0: 0.015405071899294853 (0.10659761726856232) | > loss_disc_real_1: 0.2759876847267151 (0.27273420492808026) | > loss_disc_real_2: 0.2027404010295868 (0.21590164303779602) | > loss_disc_real_3: 0.30673131346702576 (0.2577307124932607) | > loss_disc_real_4: 0.15575233101844788 (0.17207595705986023) | > loss_disc_real_5: 0.1577223539352417 (0.20335442324479422) | > loss_0: 2.26617431640625 (2.3881957133611045) | > loss_gen: 2.240652322769165 (2.159759283065796) | > loss_kl: 2.8849990367889404 (4.474005301793416) | > loss_feat: 5.2189621925354 (4.930397788683574) | > loss_mel: 20.37472152709961 (14.762021859486898) | > loss_duration: 3.0453009605407715 (3.1695687770843506) | > loss_1: 33.7646369934082 (29.49575424194336) --> EVAL PERFORMANCE | > avg_loader_time: 0.0045545101165771484 (-0.0200959046681722) | > avg_loss_disc: 2.3881957133611045 (-0.7483146588007608) | > avg_loss_disc_real_0: 0.10659761726856232 (-0.41434144477049506) | > avg_loss_disc_real_1: 0.27273420492808026 (-0.017345110575358036) | > avg_loss_disc_real_2: 0.21590164303779602 (-0.08093530933062237) | > avg_loss_disc_real_3: 0.2577307124932607 (-0.014643867810567257) | > avg_loss_disc_real_4: 0.17207595705986023 (-0.13563493887583417) | > avg_loss_disc_real_5: 0.20335442324479422 (-0.06455432375272116) | > avg_loss_0: 2.3881957133611045 (-0.7483146588007608) | > avg_loss_gen: 2.159759283065796 (-0.09528962771097804) | > avg_loss_kl: 4.474005301793416 (-0.2976033687591553) | > avg_loss_feat: 4.930397788683574 (-0.23108625411987305) | > avg_loss_mel: 14.762021859486898 (-5.408463637034098) | > avg_loss_duration: 3.1695687770843506 (-0.06916276613871242) | > avg_loss_1: 29.49575424194336 (-6.101604461669922)  > EPOCH: 1119/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:04:54)   --> TIME: 2023-10-20 14:05:04 -- STEP: 9/50 -- GLOBAL_STEP: 108960 | > loss_disc: 2.907552719116211 (2.4161491923862033) | > loss_disc_real_0: 0.0944036915898323 (0.19337397834493053) | > loss_disc_real_1: 0.33689263463020325 (0.2225842388967673) | > loss_disc_real_2: 0.26772719621658325 (0.2296970621165302) | > loss_disc_real_3: 0.2817426025867462 (0.24272102779812282) | > loss_disc_real_4: 0.403913676738739 (0.27026425302028656) | > loss_disc_real_5: 0.3673103153705597 (0.24931366783049372) | > loss_0: 2.907552719116211 (2.4161491923862033) | > grad_norm_0: tensor(413.2119, device='cuda:0') (tensor(844.6180, device='cuda:0')) | > loss_gen: 2.2467904090881348 (2.4702757199605307) | > loss_kl: 0.8515381217002869 (0.7625576191478305) | > loss_feat: 4.740896701812744 (5.624588045809004) | > loss_mel: 20.708810806274414 (19.62318393919203) | > loss_duration: 1.313879370689392 (1.3243425952063665) | > loss_1: 29.861915588378906 (29.804948806762695) | > grad_norm_1: tensor(9785.3613, device='cuda:0') (tensor(19954.7617, device='cuda:0')) | > current_lr_0: 6.53166788966564e-05 | > current_lr_1: 6.53166788966564e-05 | > step_time: 0.3837 (0.6282768249511719) | > loader_time: 0.0061 (0.018076499303181965)  --> TIME: 2023-10-20 14:05:24 -- STEP: 39/50 -- GLOBAL_STEP: 108990 | > loss_disc: 2.505070447921753 (2.4541645722511487) | > loss_disc_real_0: 0.11299346387386322 (0.17155595176303998) | > loss_disc_real_1: 0.4071042835712433 (0.22854809052287003) | > loss_disc_real_2: 0.2980179488658905 (0.2252816894593147) | > loss_disc_real_3: 0.38293948769569397 (0.23619626271419036) | > loss_disc_real_4: 0.2752150893211365 (0.22150906779540655) | > loss_disc_real_5: 0.2901187837123871 (0.21183649085175532) | > loss_0: 2.505070447921753 (2.4541645722511487) | > grad_norm_0: tensor(618.5139, device='cuda:0') (tensor(776.0923, device='cuda:0')) | > loss_gen: 2.9866230487823486 (2.2552698361567955) | > loss_kl: 0.5771697759628296 (0.8018313306264389) | > loss_feat: 4.497433185577393 (5.026547423157936) | > loss_mel: 20.66835594177246 (18.467925866444904) | > loss_duration: 1.3953579664230347 (1.3347824108906277) | > loss_1: 30.12493896484375 (27.88635694063627) | > grad_norm_1: tensor(19071.4258, device='cuda:0') (tensor(21966.2461, device='cuda:0')) | > current_lr_0: 6.53166788966564e-05 | > current_lr_1: 6.53166788966564e-05 | > step_time: 0.3499 (0.6280023440336572) | > loader_time: 0.0072 (0.021052556160168767)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8465161323547363 (2.8465161323547363) | > loss_disc_real_0: 0.21793889999389648 (0.21793889999389648) | > loss_disc_real_1: 0.24245692789554596 (0.24245692789554596) | > loss_disc_real_2: 0.2217942476272583 (0.2217942476272583) | > loss_disc_real_3: 0.24052803218364716 (0.24052803218364716) | > loss_disc_real_4: 0.2465074509382248 (0.2465074509382248) | > loss_disc_real_5: 0.26921579241752625 (0.26921579241752625) | > loss_0: 2.8465161323547363 (2.8465161323547363) | > loss_gen: 1.6430463790893555 (1.6430463790893555) | > loss_kl: 5.833536624908447 (5.833536624908447) | > loss_feat: 1.190139651298523 (1.190139651298523) | > loss_mel: 16.71656608581543 (16.71656608581543) | > loss_duration: 2.9922006130218506 (2.9922006130218506) | > loss_1: 28.375490188598633 (28.375490188598633)  --> STEP: 1 | > loss_disc: 3.005101203918457 (3.005101203918457) | > loss_disc_real_0: 0.24572283029556274 (0.24572283029556274) | > loss_disc_real_1: 0.23939797282218933 (0.23939797282218933) | > loss_disc_real_2: 0.24452416598796844 (0.24452416598796844) | > loss_disc_real_3: 0.23937593400478363 (0.23937593400478363) | > loss_disc_real_4: 0.24970877170562744 (0.24970877170562744) | > loss_disc_real_5: 0.26976141333580017 (0.26976141333580017) | > loss_0: 3.005101203918457 (3.005101203918457) | > loss_gen: 1.4897136688232422 (1.4897136688232422) | > loss_kl: 5.787179470062256 (5.787179470062256) | > loss_feat: 0.13161779940128326 (0.13161779940128326) | > loss_mel: 4.913320541381836 (4.913320541381836) | > loss_duration: 3.3783209323883057 (3.3783209323883057) | > loss_1: 15.700152397155762 (15.700152397155762)  --> STEP: 2 | > loss_disc: 2.5085487365722656 (2.7568249702453613) | > loss_disc_real_0: 0.20337477326393127 (0.224548801779747) | > loss_disc_real_1: 0.36566588282585144 (0.3025319278240204) | > loss_disc_real_2: 0.17688250541687012 (0.21070333570241928) | > loss_disc_real_3: 0.3211131691932678 (0.2802445515990257) | > loss_disc_real_4: 0.1511208862066269 (0.20041482895612717) | > loss_disc_real_5: 0.09069695323705673 (0.18022918328642845) | > loss_0: 2.5085487365722656 (2.7568249702453613) | > loss_gen: 2.1482300758361816 (1.818971872329712) | > loss_kl: 5.612322807312012 (5.699751138687134) | > loss_feat: 8.912630081176758 (4.5221239402890205) | > loss_mel: 20.997447967529297 (12.955384254455566) | > loss_duration: 3.1626837253570557 (3.2705023288726807) | > loss_1: 40.833316802978516 (28.26673460006714)  --> STEP: 3 | > loss_disc: 3.0096991062164307 (2.8411163489023843) | > loss_disc_real_0: 0.24381324648857117 (0.23097028334935507) | > loss_disc_real_1: 0.23933559656143188 (0.2814664840698242) | > loss_disc_real_2: 0.24449872970581055 (0.22196846703688303) | > loss_disc_real_3: 0.2392784059047699 (0.26658916970094043) | > loss_disc_real_4: 0.249762624502182 (0.21686409413814545) | > loss_disc_real_5: 0.27001169323921204 (0.21015668660402298) | > loss_0: 3.0096991062164307 (2.8411163489023843) | > loss_gen: 1.4839001893997192 (1.7072813113530476) | > loss_kl: 2.881866931915283 (4.760456403096517) | > loss_feat: 0.13776730000972748 (3.0606717268625894) | > loss_mel: 2.6976423263549805 (9.536136945088705) | > loss_duration: 3.0218870639801025 (3.187630573908488) | > loss_1: 10.223063468933105 (22.252177556355793) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_109000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.889258861541748 (2.8531519770622253) | > loss_disc_real_0: 0.237415611743927 (0.23258161544799805) | > loss_disc_real_1: 0.23855023086071014 (0.2707374207675457) | > loss_disc_real_2: 0.2337251752614975 (0.22490764409303665) | > loss_disc_real_3: 0.2388305366039276 (0.25964951142668724) | > loss_disc_real_4: 0.2570512890815735 (0.22691089287400246) | > loss_disc_real_5: 0.28776815533638 (0.22955955378711224) | > loss_0: 2.889258861541748 (2.8531519770622253) | > loss_gen: 1.6279083490371704 (1.6874380707740784) | > loss_kl: 6.174722194671631 (5.114022850990295) | > loss_feat: 0.35329335927963257 (2.3838271349668503) | > loss_mel: 12.500903129577637 (10.277328491210938) | > loss_duration: 2.9251816272735596 (3.122018337249756) | > loss_1: 23.58201026916504 (22.584635734558105)  --> STEP: 1 | > loss_disc: 2.626250982284546 (2.8077717781066895) | > loss_disc_real_0: 0.19301478564739227 (0.2246682494878769) | > loss_disc_real_1: 0.20611776411533356 (0.25781348943710325) | > loss_disc_real_2: 0.18035729229450226 (0.21599757373332978) | > loss_disc_real_3: 0.2279602438211441 (0.25331165790557864) | > loss_disc_real_4: 0.2452794462442398 (0.23058460354804994) | > loss_disc_real_5: 0.29865574836730957 (0.24337879270315171) | > loss_0: 2.626250982284546 (2.8077717781066895) | > loss_gen: 1.8522928953170776 (1.7204090356826782) | > loss_kl: 5.080121994018555 (5.107242679595947) | > loss_feat: 1.4931690692901611 (2.2056955218315126) | > loss_mel: 16.9710750579834 (11.61607780456543) | > loss_duration: 3.348954439163208 (3.1674055576324465) | > loss_1: 28.74561309814453 (23.816831207275392)  --> STEP: 2 | > loss_disc: 2.9434256553649902 (2.8303807576497397) | > loss_disc_real_0: 0.3520205616950989 (0.24589363485574722) | > loss_disc_real_1: 0.24138124287128448 (0.25507478167613346) | > loss_disc_real_2: 0.32316306233406067 (0.23385848850011826) | > loss_disc_real_3: 0.28428134322166443 (0.25847327212492627) | > loss_disc_real_4: 0.13143111765384674 (0.21405902256568274) | > loss_disc_real_5: 0.27781760692596436 (0.24911859507362047) | > loss_0: 2.9434256553649902 (2.8303807576497397) | > loss_gen: 2.2461085319519043 (1.8080256183942158) | > loss_kl: 5.934537887573242 (5.24512521425883) | > loss_feat: 8.758955955505371 (3.297905594110489) | > loss_mel: 21.504343032836914 (13.264122009277344) | > loss_duration: 3.1089060306549072 (3.157655636469523) | > loss_1: 41.552852630615234 (26.77283477783203)  --> STEP: 3 | > loss_disc: 2.9950451850891113 (2.8539042472839355) | > loss_disc_real_0: 0.26050853729248047 (0.24798147806099483) | > loss_disc_real_1: 0.23901648819446564 (0.25278073975018095) | > loss_disc_real_2: 0.2408103495836258 (0.2348516115120479) | > loss_disc_real_3: 0.2372831404209137 (0.2554461104529245) | > loss_disc_real_4: 0.2523738741874695 (0.21953257279736654) | > loss_disc_real_5: 0.28414538502693176 (0.2541224222098078) | > loss_0: 2.9950451850891113 (2.8539042472839355) | > loss_gen: 1.5262324810028076 (1.767769455909729) | > loss_kl: 2.981362819671631 (4.921730586460659) | > loss_feat: 0.13257482647895813 (2.8457154844488417) | > loss_mel: 2.5885629653930664 (11.739042145865303) | > loss_duration: 3.028122663497925 (3.139150926045009) | > loss_1: 10.256855964660645 (24.41340923309326) --> EVAL PERFORMANCE | > avg_loader_time: 0.32668754032679964 (+0.3221330302102225) | > avg_loss_disc: 2.8539042472839355 (+0.46570853392283107) | > avg_loss_disc_real_0: 0.24798147806099483 (+0.1413838607924325) | > avg_loss_disc_real_1: 0.25278073975018095 (-0.01995346517789931) | > avg_loss_disc_real_2: 0.2348516115120479 (+0.01894996847425187) | > avg_loss_disc_real_3: 0.2554461104529245 (-0.0022846020403362033) | > avg_loss_disc_real_4: 0.21953257279736654 (+0.047456615737506314) | > avg_loss_disc_real_5: 0.2541224222098078 (+0.05076799896501358) | > avg_loss_0: 2.8539042472839355 (+0.46570853392283107) | > avg_loss_gen: 1.767769455909729 (-0.3919898271560669) | > avg_loss_kl: 4.921730586460659 (+0.4477252846672428) | > avg_loss_feat: 2.8457154844488417 (-2.084682304234732) | > avg_loss_mel: 11.739042145865303 (-3.022979713621595) | > avg_loss_duration: 3.139150926045009 (-0.03041785103934158) | > avg_loss_1: 24.41340923309326 (-5.082345008850098)  > EPOCH: 1120/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:05:51)   --> TIME: 2023-10-20 14:06:03 -- STEP: 19/50 -- GLOBAL_STEP: 109020 | > loss_disc: 0.8050819635391235 (2.393274056284051) | > loss_disc_real_0: 0.02861553430557251 (0.16183597418038467) | > loss_disc_real_1: 0.20404857397079468 (0.22862715862299265) | > loss_disc_real_2: 0.09419550001621246 (0.22149357258489258) | > loss_disc_real_3: 0.038743652403354645 (0.21260182030106844) | > loss_disc_real_4: 0.048966094851493835 (0.21500470116734505) | > loss_disc_real_5: 0.011932488530874252 (0.21370094161676734) | > loss_0: 0.8050819635391235 (2.393274056284051) | > grad_norm_0: tensor(258.9600, device='cuda:0') (tensor(639.9423, device='cuda:0')) | > loss_gen: 4.2142510414123535 (2.300952133379485) | > loss_kl: 0.937709391117096 (0.852351510211041) | > loss_feat: 15.670791625976562 (5.29338547469754) | > loss_mel: 27.353723526000977 (18.372741203559073) | > loss_duration: 1.443089485168457 (1.3566245656264455) | > loss_1: 49.61956787109375 (28.1760549796255) | > grad_norm_1: tensor(33542.6758, device='cuda:0') (tensor(25252.3398, device='cuda:0')) | > current_lr_0: 6.525139078666384e-05 | > current_lr_1: 6.525139078666384e-05 | > step_time: 0.3389 (0.41009988282856186) | > loader_time: 0.0034 (0.009320397126047235)  --> TIME: 2023-10-20 14:06:26 -- STEP: 49/50 -- GLOBAL_STEP: 109050 | > loss_disc: 3.0519285202026367 (2.506981973745386) | > loss_disc_real_0: 0.3574379086494446 (0.15395983155550702) | > loss_disc_real_1: 0.25158488750457764 (0.22794947142199595) | > loss_disc_real_2: 0.27652400732040405 (0.22254706827961668) | > loss_disc_real_3: 0.24162694811820984 (0.2280322384013205) | > loss_disc_real_4: 0.2399866133928299 (0.2312204184732875) | > loss_disc_real_5: 0.24851423501968384 (0.23279732378313736) | > loss_0: 3.0519285202026367 (2.506981973745386) | > grad_norm_0: tensor(1970.5446, device='cuda:0') (tensor(630.4087, device='cuda:0')) | > loss_gen: 1.5487103462219238 (2.15803354613635) | > loss_kl: 0.5844751596450806 (0.8729847949378344) | > loss_feat: 0.07560917735099792 (4.626996162442527) | > loss_mel: 2.306203603744507 (18.040320311273852) | > loss_duration: 1.4404224157333374 (1.329435574765108) | > loss_1: 5.955420970916748 (27.027770451137) | > grad_norm_1: tensor(18664.5820, device='cuda:0') (tensor(22175.5566, device='cuda:0')) | > current_lr_0: 6.525139078666384e-05 | > current_lr_1: 6.525139078666384e-05 | > step_time: 0.7864 (0.6002704707943664) | > loader_time: 0.8247 (0.03225343567984445)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2196366786956787 (3.2196366786956787) | > loss_disc_real_0: 0.6167106628417969 (0.6167106628417969) | > loss_disc_real_1: 0.23321810364723206 (0.23321810364723206) | > loss_disc_real_2: 0.2879575192928314 (0.2879575192928314) | > loss_disc_real_3: 0.27933067083358765 (0.27933067083358765) | > loss_disc_real_4: 0.3326910138130188 (0.3326910138130188) | > loss_disc_real_5: 0.34575751423835754 (0.34575751423835754) | > loss_0: 3.2196366786956787 (3.2196366786956787) | > loss_gen: 2.071453332901001 (2.071453332901001) | > loss_kl: 6.057784080505371 (6.057784080505371) | > loss_feat: 3.4696998596191406 (3.4696998596191406) | > loss_mel: 21.292085647583008 (21.292085647583008) | > loss_duration: 3.0411760807037354 (3.0411760807037354) | > loss_1: 35.93219757080078 (35.93219757080078)  --> STEP: 1 | > loss_disc: 2.1892142295837402 (2.1892142295837402) | > loss_disc_real_0: 0.1773122102022171 (0.1773122102022171) | > loss_disc_real_1: 0.2849283218383789 (0.2849283218383789) | > loss_disc_real_2: 0.2777189016342163 (0.2777189016342163) | > loss_disc_real_3: 0.22577571868896484 (0.22577571868896484) | > loss_disc_real_4: 0.19135645031929016 (0.19135645031929016) | > loss_disc_real_5: 0.037471480667591095 (0.037471480667591095) | > loss_0: 2.1892142295837402 (2.1892142295837402) | > loss_gen: 2.5616536140441895 (2.5616536140441895) | > loss_kl: 5.520350456237793 (5.520350456237793) | > loss_feat: 9.479262351989746 (9.479262351989746) | > loss_mel: 24.000385284423828 (24.000385284423828) | > loss_duration: 3.4026200771331787 (3.4026200771331787) | > loss_1: 44.964271545410156 (44.964271545410156)  --> STEP: 2 | > loss_disc: 2.2136948108673096 (2.201454520225525) | > loss_disc_real_0: 0.33090677857398987 (0.2541094943881035) | > loss_disc_real_1: 0.1882248967885971 (0.236576609313488) | > loss_disc_real_2: 0.21313951909542084 (0.24542921036481857) | > loss_disc_real_3: 0.26759615540504456 (0.2466859370470047) | > loss_disc_real_4: 0.2085709571838379 (0.19996370375156403) | > loss_disc_real_5: 0.2664105296134949 (0.15194100514054298) | > loss_0: 2.2136948108673096 (2.201454520225525) | > loss_gen: 2.9987130165100098 (2.7801833152770996) | > loss_kl: 5.428272247314453 (5.474311351776123) | > loss_feat: 8.689282417297363 (9.084272384643555) | > loss_mel: 23.79306411743164 (23.896724700927734) | > loss_duration: 3.2299177646636963 (3.3162689208984375) | > loss_1: 44.139251708984375 (44.551761627197266)  --> STEP: 3 | > loss_disc: 3.0661935806274414 (2.4897008736928306) | > loss_disc_real_0: 0.5237833261489868 (0.34400077164173126) | > loss_disc_real_1: 0.36320534348487854 (0.27878618737061817) | > loss_disc_real_2: 0.3539283871650696 (0.2815956026315689) | > loss_disc_real_3: 0.26163455843925476 (0.2516688108444214) | > loss_disc_real_4: 0.2940179407596588 (0.2313151160875956) | > loss_disc_real_5: 0.36281612515449524 (0.2222327118118604) | > loss_0: 3.0661935806274414 (2.4897008736928306) | > loss_gen: 3.1020119190216064 (2.8874595165252686) | > loss_kl: 2.9233298301696777 (4.623984177907308) | > loss_feat: 4.209681510925293 (7.459408760070801) | > loss_mel: 23.166988372802734 (23.653479258219402) | > loss_duration: 2.995807409286499 (3.2094484170277915) | > loss_1: 36.39781951904297 (41.833780924479164) --> EVAL PERFORMANCE | > avg_loader_time: 0.005377769470214844 (-0.3213097708565848) | > avg_loss_disc: 2.4897008736928306 (-0.364203373591105) | > avg_loss_disc_real_0: 0.34400077164173126 (+0.09601929358073644) | > avg_loss_disc_real_1: 0.27878618737061817 (+0.026005447620437216) | > avg_loss_disc_real_2: 0.2815956026315689 (+0.04674399111952102) | > avg_loss_disc_real_3: 0.2516688108444214 (-0.003777299608503093) | > avg_loss_disc_real_4: 0.2313151160875956 (+0.01178254329022907) | > avg_loss_disc_real_5: 0.2222327118118604 (-0.031889710397947385) | > avg_loss_0: 2.4897008736928306 (-0.364203373591105) | > avg_loss_gen: 2.8874595165252686 (+1.1196900606155396) | > avg_loss_kl: 4.623984177907308 (-0.2977464085533512) | > avg_loss_feat: 7.459408760070801 (+4.613693275621959) | > avg_loss_mel: 23.653479258219402 (+11.914437112354099) | > avg_loss_duration: 3.2094484170277915 (+0.07029749098278248) | > avg_loss_1: 41.833780924479164 (+17.420371691385903)  > EPOCH: 1121/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:06:38)   --> TIME: 2023-10-20 14:06:59 -- STEP: 29/50 -- GLOBAL_STEP: 109080 | > loss_disc: 2.8919925689697266 (2.458445331145977) | > loss_disc_real_0: 0.4223289489746094 (0.13335669294385044) | > loss_disc_real_1: 0.2340904027223587 (0.2136345742077663) | > loss_disc_real_2: 0.2420453429222107 (0.20946469825917277) | > loss_disc_real_3: 0.2164919078350067 (0.2283445794520707) | > loss_disc_real_4: 0.2725854218006134 (0.21932262040931602) | > loss_disc_real_5: 0.24460560083389282 (0.24475441988686036) | > loss_0: 2.8919925689697266 (2.458445331145977) | > grad_norm_0: tensor(1251.9993, device='cuda:0') (tensor(589.6694, device='cuda:0')) | > loss_gen: 1.7809046506881714 (2.190811769715671) | > loss_kl: 0.7518133521080017 (0.843502210132007) | > loss_feat: 0.8330504894256592 (5.625631726122108) | > loss_mel: 15.645478248596191 (20.938967630780972) | > loss_duration: 1.329393744468689 (1.3360069743518173) | > loss_1: 20.340641021728516 (30.934920130104853) | > grad_norm_1: tensor(15624.7998, device='cuda:0') (tensor(18847.7480, device='cuda:0')) | > current_lr_0: 6.518616793622487e-05 | > current_lr_1: 6.518616793622487e-05 | > step_time: 0.359 (0.5335207314326844) | > loader_time: 0.006 (0.016533974943489873)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.952554702758789 (2.952554702758789) | > loss_disc_real_0: 0.2399098426103592 (0.2399098426103592) | > loss_disc_real_1: 0.27866068482398987 (0.27866068482398987) | > loss_disc_real_2: 0.30441147089004517 (0.30441147089004517) | > loss_disc_real_3: 0.2803323566913605 (0.2803323566913605) | > loss_disc_real_4: 0.24350152909755707 (0.24350152909755707) | > loss_disc_real_5: 0.2641158401966095 (0.2641158401966095) | > loss_0: 2.952554702758789 (2.952554702758789) | > loss_gen: 1.6772537231445312 (1.6772537231445312) | > loss_kl: 5.8001179695129395 (5.8001179695129395) | > loss_feat: 0.1780710518360138 (0.1780710518360138) | > loss_mel: 9.270733833312988 (9.270733833312988) | > loss_duration: 3.089324474334717 (3.089324474334717) | > loss_1: 20.015501022338867 (20.015501022338867)  --> STEP: 1 | > loss_disc: 3.3285772800445557 (3.3285772800445557) | > loss_disc_real_0: 0.6482721567153931 (0.6482721567153931) | > loss_disc_real_1: 0.28254377841949463 (0.28254377841949463) | > loss_disc_real_2: 0.3277183473110199 (0.3277183473110199) | > loss_disc_real_3: 0.3510802686214447 (0.3510802686214447) | > loss_disc_real_4: 0.30128419399261475 (0.30128419399261475) | > loss_disc_real_5: 0.27432695031166077 (0.27432695031166077) | > loss_0: 3.3285772800445557 (3.3285772800445557) | > loss_gen: 2.555974245071411 (2.555974245071411) | > loss_kl: 6.12332010269165 (6.12332010269165) | > loss_feat: 4.928788661956787 (4.928788661956787) | > loss_mel: 23.4650936126709 (23.4650936126709) | > loss_duration: 3.3731021881103516 (3.3731021881103516) | > loss_1: 40.44628143310547 (40.44628143310547)  --> STEP: 2 | > loss_disc: 2.9231412410736084 (3.125859260559082) | > loss_disc_real_0: 0.3270411491394043 (0.4876566529273987) | > loss_disc_real_1: 0.3142567574977875 (0.29840026795864105) | > loss_disc_real_2: 0.3352503180503845 (0.3314843326807022) | > loss_disc_real_3: 0.28059226274490356 (0.31583626568317413) | > loss_disc_real_4: 0.26131075620651245 (0.2812974750995636) | > loss_disc_real_5: 0.28804242610931396 (0.28118468821048737) | > loss_0: 2.9231412410736084 (3.125859260559082) | > loss_gen: 2.212268829345703 (2.384121537208557) | > loss_kl: 5.910285472869873 (6.016802787780762) | > loss_feat: 1.6471307277679443 (3.2879596948623657) | > loss_mel: 21.814401626586914 (22.639747619628906) | > loss_duration: 3.1899569034576416 (3.2815295457839966) | > loss_1: 34.774044036865234 (37.61016273498535)  --> STEP: 3 | > loss_disc: 2.997535228729248 (3.0830845832824707) | > loss_disc_real_0: 0.24019071459770203 (0.4051680068174998) | > loss_disc_real_1: 0.2789950668811798 (0.2919318675994873) | > loss_disc_real_2: 0.30351522564888 (0.32216129700342816) | > loss_disc_real_3: 0.2802087068557739 (0.3039604127407074) | > loss_disc_real_4: 0.24301904439926147 (0.2685379981994629) | > loss_disc_real_5: 0.26447534561157227 (0.2756149073441823) | > loss_0: 2.997535228729248 (3.0830845832824707) | > loss_gen: 1.6231155395507812 (2.130452871322632) | > loss_kl: 2.8384268283843994 (4.957344134648641) | > loss_feat: 0.06474841386079788 (2.2135559345285096) | > loss_mel: 2.1841461658477783 (15.821213801701864) | > loss_duration: 3.071089744567871 (3.2113829453786216) | > loss_1: 9.781526565551758 (28.333950678507488) --> EVAL PERFORMANCE | > avg_loader_time: 0.015018622080485025 (+0.009640852610270182) | > avg_loss_disc: 3.0830845832824707 (+0.5933837095896402) | > avg_loss_disc_real_0: 0.4051680068174998 (+0.06116723517576855) | > avg_loss_disc_real_1: 0.2919318675994873 (+0.013145680228869139) | > avg_loss_disc_real_2: 0.32216129700342816 (+0.04056569437185925) | > avg_loss_disc_real_3: 0.3039604127407074 (+0.05229160189628601) | > avg_loss_disc_real_4: 0.2685379981994629 (+0.03722288211186728) | > avg_loss_disc_real_5: 0.2756149073441823 (+0.0533821955323219) | > avg_loss_0: 3.0830845832824707 (+0.5933837095896402) | > avg_loss_gen: 2.130452871322632 (-0.7570066452026367) | > avg_loss_kl: 4.957344134648641 (+0.333359956741333) | > avg_loss_feat: 2.2135559345285096 (-5.245852825542292) | > avg_loss_mel: 15.821213801701864 (-7.832265456517538) | > avg_loss_duration: 3.2113829453786216 (+0.0019345283508300781) | > avg_loss_1: 28.333950678507488 (-13.499830245971676)  > EPOCH: 1122/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:07:29)   --> TIME: 2023-10-20 14:07:39 -- STEP: 9/50 -- GLOBAL_STEP: 109110 | > loss_disc: 2.797978401184082 (2.2142743269602456) | > loss_disc_real_0: 0.09693358838558197 (0.15436970856454638) | > loss_disc_real_1: 0.26669278740882874 (0.20563498263557753) | > loss_disc_real_2: 0.2713612914085388 (0.25825122909413445) | > loss_disc_real_3: 0.2711559534072876 (0.25050098366207546) | > loss_disc_real_4: 0.25650423765182495 (0.23120582020945019) | > loss_disc_real_5: 0.26454320549964905 (0.23217271671940884) | > loss_0: 2.797978401184082 (2.2142743269602456) | > grad_norm_0: tensor(1069.1829, device='cuda:0') (tensor(603.5057, device='cuda:0')) | > loss_gen: 1.6880345344543457 (2.6871980826059976) | > loss_kl: 0.6767399907112122 (0.6759263608190749) | > loss_feat: 0.8021215200424194 (6.975191526942783) | > loss_mel: 12.710916519165039 (21.8220403459337) | > loss_duration: 1.2621123790740967 (1.3085008064905803) | > loss_1: 17.139925003051758 (33.468858083089195) | > grad_norm_1: tensor(9825.5996, device='cuda:0') (tensor(23096.7754, device='cuda:0')) | > current_lr_0: 6.512101028010847e-05 | > current_lr_1: 6.512101028010847e-05 | > step_time: 0.3831 (0.48468221558464897) | > loader_time: 0.0018 (0.01523953013949924)  --> TIME: 2023-10-20 14:07:51 -- STEP: 39/50 -- GLOBAL_STEP: 109140 | > loss_disc: 2.9542577266693115 (2.485179907236344) | > loss_disc_real_0: 0.39982712268829346 (0.16478734683149895) | > loss_disc_real_1: 0.4062226116657257 (0.2252191665271918) | > loss_disc_real_2: 0.3881160020828247 (0.2259203549952079) | > loss_disc_real_3: 0.38266393542289734 (0.23528670901671433) | > loss_disc_real_4: 0.3387933075428009 (0.2517104225280957) | > loss_disc_real_5: 0.33574238419532776 (0.2527373738539143) | > loss_0: 2.9542577266693115 (2.485179907236344) | > grad_norm_0: tensor(2037.6376, device='cuda:0') (tensor(695.6889, device='cuda:0')) | > loss_gen: 2.7601161003112793 (2.2986885737150144) | > loss_kl: 0.5979523062705994 (0.7699028918376336) | > loss_feat: 2.9277849197387695 (5.167906655380741) | > loss_mel: 18.764007568359375 (19.300576677689186) | > loss_duration: 1.3827999830245972 (1.3223712077507608) | > loss_1: 26.432661056518555 (28.85944630549504) | > grad_norm_1: tensor(3314.0383, device='cuda:0') (tensor(17363.7734, device='cuda:0')) | > current_lr_0: 6.512101028010847e-05 | > current_lr_1: 6.512101028010847e-05 | > step_time: 0.5363 (0.41098286555363583) | > loader_time: 0.0206 (0.011026565845196065)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9578332901000977 (2.9578332901000977) | > loss_disc_real_0: 0.35637474060058594 (0.35637474060058594) | > loss_disc_real_1: 0.2068553864955902 (0.2068553864955902) | > loss_disc_real_2: 0.21966983377933502 (0.21966983377933502) | > loss_disc_real_3: 0.2597251236438751 (0.2597251236438751) | > loss_disc_real_4: 0.22398042678833008 (0.22398042678833008) | > loss_disc_real_5: 0.2833620607852936 (0.2833620607852936) | > loss_0: 2.9578332901000977 (2.9578332901000977) | > loss_gen: 1.7690315246582031 (1.7690315246582031) | > loss_kl: 5.455777645111084 (5.455777645111084) | > loss_feat: 0.6125718951225281 (0.6125718951225281) | > loss_mel: 16.503280639648438 (16.503280639648438) | > loss_duration: 3.1115894317626953 (3.1115894317626953) | > loss_1: 27.452251434326172 (27.452251434326172)  --> STEP: 1 | > loss_disc: 2.446354389190674 (2.446354389190674) | > loss_disc_real_0: 0.08383014798164368 (0.08383014798164368) | > loss_disc_real_1: 0.267739474773407 (0.267739474773407) | > loss_disc_real_2: 0.24610821902751923 (0.24610821902751923) | > loss_disc_real_3: 0.20917533338069916 (0.20917533338069916) | > loss_disc_real_4: 0.25217190384864807 (0.25217190384864807) | > loss_disc_real_5: 0.24955083429813385 (0.24955083429813385) | > loss_0: 2.446354389190674 (2.446354389190674) | > loss_gen: 2.1638035774230957 (2.1638035774230957) | > loss_kl: 5.75844669342041 (5.75844669342041) | > loss_feat: 7.000432014465332 (7.000432014465332) | > loss_mel: 25.745365142822266 (25.745365142822266) | > loss_duration: 3.403087854385376 (3.403087854385376) | > loss_1: 44.07113265991211 (44.07113265991211)  --> STEP: 2 | > loss_disc: 3.088973045349121 (2.7676637172698975) | > loss_disc_real_0: 0.13887770473957062 (0.11135392636060715) | > loss_disc_real_1: 0.3227299153804779 (0.29523469507694244) | > loss_disc_real_2: 0.4025447368621826 (0.3243264779448509) | > loss_disc_real_3: 0.35200363397598267 (0.2805894836783409) | > loss_disc_real_4: 0.36329755187034607 (0.30773472785949707) | > loss_disc_real_5: 0.41457614302635193 (0.3320634886622429) | > loss_0: 3.088973045349121 (2.7676637172698975) | > loss_gen: 2.8322229385375977 (2.4980132579803467) | > loss_kl: 5.282715797424316 (5.520581245422363) | > loss_feat: 8.739775657653809 (7.87010383605957) | > loss_mel: 22.646989822387695 (24.19617748260498) | > loss_duration: 3.175154447555542 (3.289121150970459) | > loss_1: 42.676856994628906 (43.37399482727051)  --> STEP: 3 | > loss_disc: 2.356553077697754 (2.630626837412516) | > loss_disc_real_0: 0.23241694271564484 (0.15170826514561972) | > loss_disc_real_1: 0.39101335406303406 (0.32716091473897296) | > loss_disc_real_2: 0.2736818790435791 (0.3074449449777603) | > loss_disc_real_3: 0.283687949180603 (0.2816223055124283) | > loss_disc_real_4: 0.2934730648994446 (0.30298084020614624) | > loss_disc_real_5: 0.20163455605506897 (0.28858717779318493) | > loss_0: 2.356553077697754 (2.630626837412516) | > loss_gen: 3.2872157096862793 (2.761080741882324) | > loss_kl: 2.7716190814971924 (4.604260524113973) | > loss_feat: 5.9576802253723145 (7.232629299163818) | > loss_mel: 22.06573486328125 (23.486029942830402) | > loss_duration: 3.0099849700927734 (3.196075757344564) | > loss_1: 37.09223175048828 (41.28007380167643) --> EVAL PERFORMANCE | > avg_loader_time: 0.013472477595011393 (-0.0015461444854736328) | > avg_loss_disc: 2.630626837412516 (-0.4524577458699546) | > avg_loss_disc_real_0: 0.15170826514561972 (-0.2534597416718801) | > avg_loss_disc_real_1: 0.32716091473897296 (+0.03522904713948566) | > avg_loss_disc_real_2: 0.3074449449777603 (-0.014716352025667845) | > avg_loss_disc_real_3: 0.2816223055124283 (-0.022338107228279114) | > avg_loss_disc_real_4: 0.30298084020614624 (+0.03444284200668335) | > avg_loss_disc_real_5: 0.28858717779318493 (+0.01297227044900262) | > avg_loss_0: 2.630626837412516 (-0.4524577458699546) | > avg_loss_gen: 2.761080741882324 (+0.6306278705596924) | > avg_loss_kl: 4.604260524113973 (-0.35308361053466797) | > avg_loss_feat: 7.232629299163818 (+5.019073364635309) | > avg_loss_mel: 23.486029942830402 (+7.664816141128538) | > avg_loss_duration: 3.196075757344564 (-0.015307188034057617) | > avg_loss_1: 41.28007380167643 (+12.946123123168942)  > EPOCH: 1123/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:08:19)   --> TIME: 2023-10-20 14:08:36 -- STEP: 19/50 -- GLOBAL_STEP: 109170 | > loss_disc: 2.9350221157073975 (2.4976749859358134) | > loss_disc_real_0: 0.23110820353031158 (0.13013895272620413) | > loss_disc_real_1: 0.2725052237510681 (0.23722034104560552) | > loss_disc_real_2: 0.27667245268821716 (0.22684276966672196) | > loss_disc_real_3: 0.26449522376060486 (0.2502787595516757) | > loss_disc_real_4: 0.21754179894924164 (0.22179295357904935) | > loss_disc_real_5: 0.23735180497169495 (0.2072968737859475) | > loss_0: 2.9350221157073975 (2.4976749859358134) | > grad_norm_0: tensor(1187.8955, device='cuda:0') (tensor(598.7637, device='cuda:0')) | > loss_gen: 1.5969874858856201 (2.2066036525525545) | > loss_kl: 0.8236560821533203 (0.7586632410162374) | > loss_feat: 0.2635725736618042 (5.292848303521934) | > loss_mel: 4.817534923553467 (19.763398339873866) | > loss_duration: 1.4999113082885742 (1.3644383267352456) | > loss_1: 9.001662254333496 (29.385951769979375) | > grad_norm_1: tensor(19339.4141, device='cuda:0') (tensor(21274.5938, device='cuda:0')) | > current_lr_0: 6.505591775314885e-05 | > current_lr_1: 6.505591775314885e-05 | > step_time: 0.5323 (0.6127463767403051) | > loader_time: 0.0271 (0.026146198573865388)  --> TIME: 2023-10-20 14:08:57 -- STEP: 49/50 -- GLOBAL_STEP: 109200 | > loss_disc: 2.3131566047668457 (2.4282915446223052) | > loss_disc_real_0: 0.03239056468009949 (0.12735486188333253) | > loss_disc_real_1: 0.1835433393716812 (0.22773914981861504) | > loss_disc_real_2: 0.13377845287322998 (0.22115599189181717) | > loss_disc_real_3: 0.2481641173362732 (0.2377131516684075) | > loss_disc_real_4: 0.15748247504234314 (0.223003479823166) | > loss_disc_real_5: 0.3143339157104492 (0.2111708283500404) | > loss_0: 2.3131566047668457 (2.4282915446223052) | > grad_norm_0: tensor(1460.9839, device='cuda:0') (tensor(535.2137, device='cuda:0')) | > loss_gen: 2.088486433029175 (2.2688665244044093) | > loss_kl: 0.7540348768234253 (0.7742280208942841) | > loss_feat: 4.0143141746521 (5.791452983660357) | > loss_mel: 22.006305694580078 (20.46007477264015) | > loss_duration: 1.4104098081588745 (1.3222845598142974) | > loss_1: 30.273550033569336 (30.61690683754123) | > grad_norm_1: tensor(2688.4070, device='cuda:0') (tensor(17276.9824, device='cuda:0')) | > current_lr_0: 6.505591775314885e-05 | > current_lr_1: 6.505591775314885e-05 | > step_time: 0.4355 (0.6332765404058963) | > loader_time: 0.7858 (0.03846691092666315)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0450949668884277 (3.0450949668884277) | > loss_disc_real_0: 0.20393449068069458 (0.20393449068069458) | > loss_disc_real_1: 0.2343355268239975 (0.2343355268239975) | > loss_disc_real_2: 0.2776320278644562 (0.2776320278644562) | > loss_disc_real_3: 0.2745283246040344 (0.2745283246040344) | > loss_disc_real_4: 0.282734751701355 (0.282734751701355) | > loss_disc_real_5: 0.26372429728507996 (0.26372429728507996) | > loss_0: 3.0450949668884277 (3.0450949668884277) | > loss_gen: 1.5035864114761353 (1.5035864114761353) | > loss_kl: 5.695825576782227 (5.695825576782227) | > loss_feat: 0.13442835211753845 (0.13442835211753845) | > loss_mel: 2.1266300678253174 (2.1266300678253174) | > loss_duration: 3.1144325733184814 (3.1144325733184814) | > loss_1: 12.57490348815918 (12.57490348815918)  --> STEP: 1 | > loss_disc: 2.43587589263916 (2.43587589263916) | > loss_disc_real_0: 0.3817552328109741 (0.3817552328109741) | > loss_disc_real_1: 0.3268923759460449 (0.3268923759460449) | > loss_disc_real_2: 0.2082868367433548 (0.2082868367433548) | > loss_disc_real_3: 0.1783277839422226 (0.1783277839422226) | > loss_disc_real_4: 0.23882082104682922 (0.23882082104682922) | > loss_disc_real_5: 0.03168671950697899 (0.03168671950697899) | > loss_0: 2.43587589263916 (2.43587589263916) | > loss_gen: 2.9951999187469482 (2.9951999187469482) | > loss_kl: 5.85331392288208 (5.85331392288208) | > loss_feat: 10.028178215026855 (10.028178215026855) | > loss_mel: 25.02411651611328 (25.02411651611328) | > loss_duration: 3.5319628715515137 (3.5319628715515137) | > loss_1: 47.43277359008789 (47.43277359008789)  --> STEP: 2 | > loss_disc: 2.1901071071624756 (2.312991499900818) | > loss_disc_real_0: 0.13706108927726746 (0.2594081610441208) | > loss_disc_real_1: 0.27235037088394165 (0.2996213734149933) | > loss_disc_real_2: 0.253427654504776 (0.2308572456240654) | > loss_disc_real_3: 0.2445402294397354 (0.211434006690979) | > loss_disc_real_4: 0.15074194967746735 (0.19478138536214828) | > loss_disc_real_5: 0.3162313997745514 (0.1739590596407652) | > loss_0: 2.1901071071624756 (2.312991499900818) | > loss_gen: 3.109894037246704 (3.052546977996826) | > loss_kl: 5.722381114959717 (5.787847518920898) | > loss_feat: 8.666069030761719 (9.347123622894287) | > loss_mel: 26.820682525634766 (25.922399520874023) | > loss_duration: 3.3040976524353027 (3.418030261993408) | > loss_1: 47.62312316894531 (47.5279483795166)  --> STEP: 3 | > loss_disc: 2.6187376976013184 (2.414906899134318) | > loss_disc_real_0: 0.21269544959068298 (0.2438372572263082) | > loss_disc_real_1: 0.29641056060791016 (0.2985511024792989) | > loss_disc_real_2: 0.30816400051116943 (0.2566261639197667) | > loss_disc_real_3: 0.3679024279117584 (0.26359014709790546) | > loss_disc_real_4: 0.3271906077861786 (0.23891779283682504) | > loss_disc_real_5: 0.2921648919582367 (0.21336100374658903) | > loss_0: 2.6187376976013184 (2.414906899134318) | > loss_gen: 2.9130969047546387 (3.00606362024943) | > loss_kl: 2.851858615875244 (4.809184551239014) | > loss_feat: 4.5438361167907715 (7.746027787526448) | > loss_mel: 21.341663360595703 (24.395487467447918) | > loss_duration: 3.010575771331787 (3.2822120984395347) | > loss_1: 34.66102981567383 (43.238975524902344) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026247501373291016 (-0.010847727457682291) | > avg_loss_disc: 2.414906899134318 (-0.21571993827819824) | > avg_loss_disc_real_0: 0.2438372572263082 (+0.09212899208068848) | > avg_loss_disc_real_1: 0.2985511024792989 (-0.028609812259674072) | > avg_loss_disc_real_2: 0.2566261639197667 (-0.05081878105799359) | > avg_loss_disc_real_3: 0.26359014709790546 (-0.018032158414522825) | > avg_loss_disc_real_4: 0.23891779283682504 (-0.0640630473693212) | > avg_loss_disc_real_5: 0.21336100374658903 (-0.0752261740465959) | > avg_loss_0: 2.414906899134318 (-0.21571993827819824) | > avg_loss_gen: 3.00606362024943 (+0.24498287836710597) | > avg_loss_kl: 4.809184551239014 (+0.204924027125041) | > avg_loss_feat: 7.746027787526448 (+0.5133984883626299) | > avg_loss_mel: 24.395487467447918 (+0.9094575246175154) | > avg_loss_duration: 3.2822120984395347 (+0.0861363410949707) | > avg_loss_1: 43.238975524902344 (+1.9589017232259138)  > EPOCH: 1124/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:09:12)   --> TIME: 2023-10-20 14:09:30 -- STEP: 29/50 -- GLOBAL_STEP: 109230 | > loss_disc: 1.5315638780593872 (2.364403001193343) | > loss_disc_real_0: 0.16656139492988586 (0.14734715904141293) | > loss_disc_real_1: 0.19415250420570374 (0.1991807529381637) | > loss_disc_real_2: 0.16370698809623718 (0.21975159568005595) | > loss_disc_real_3: 0.10312040150165558 (0.22617116878772603) | > loss_disc_real_4: 0.05335526168346405 (0.21391780539576355) | > loss_disc_real_5: 0.07328116148710251 (0.2457219795163335) | > loss_0: 1.5315638780593872 (2.364403001193343) | > grad_norm_0: tensor(915.6530, device='cuda:0') (tensor(1068.2432, device='cuda:0')) | > loss_gen: 2.8871347904205322 (2.3761332446131203) | > loss_kl: 0.5539904236793518 (0.8410498561530277) | > loss_feat: 10.6066255569458 (6.631725743926805) | > loss_mel: 24.353479385375977 (22.25397751249116) | > loss_duration: 1.3269623517990112 (1.33367958973194) | > loss_1: 39.72819137573242 (33.43656622130296) | > grad_norm_1: tensor(70058.4375, device='cuda:0') (tensor(35557.1055, device='cuda:0')) | > current_lr_0: 6.49908902902453e-05 | > current_lr_1: 6.49908902902453e-05 | > step_time: 0.3575 (0.3710990774220434) | > loader_time: 0.0019 (0.007298847724651468)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.518561363220215 (2.518561363220215) | > loss_disc_real_0: 0.28585007786750793 (0.28585007786750793) | > loss_disc_real_1: 0.3375988006591797 (0.3375988006591797) | > loss_disc_real_2: 0.23531651496887207 (0.23531651496887207) | > loss_disc_real_3: 0.38966307044029236 (0.38966307044029236) | > loss_disc_real_4: 0.1555090844631195 (0.1555090844631195) | > loss_disc_real_5: 0.08590259402990341 (0.08590259402990341) | > loss_0: 2.518561363220215 (2.518561363220215) | > loss_gen: 2.4635910987854004 (2.4635910987854004) | > loss_kl: 6.123810291290283 (6.123810291290283) | > loss_feat: 8.065814971923828 (8.065814971923828) | > loss_mel: 24.20291519165039 (24.20291519165039) | > loss_duration: 3.075571298599243 (3.075571298599243) | > loss_1: 43.931705474853516 (43.931705474853516)  --> STEP: 1 | > loss_disc: 2.558704137802124 (2.558704137802124) | > loss_disc_real_0: 0.13783450424671173 (0.13783450424671173) | > loss_disc_real_1: 0.21259376406669617 (0.21259376406669617) | > loss_disc_real_2: 0.21147754788398743 (0.21147754788398743) | > loss_disc_real_3: 0.3035240173339844 (0.3035240173339844) | > loss_disc_real_4: 0.24799533188343048 (0.24799533188343048) | > loss_disc_real_5: 0.2749147117137909 (0.2749147117137909) | > loss_0: 2.558704137802124 (2.558704137802124) | > loss_gen: 1.939808964729309 (1.939808964729309) | > loss_kl: 5.657894611358643 (5.657894611358643) | > loss_feat: 1.2942805290222168 (1.2942805290222168) | > loss_mel: 20.82986831665039 (20.82986831665039) | > loss_duration: 3.427854299545288 (3.427854299545288) | > loss_1: 33.14970779418945 (33.14970779418945)  --> STEP: 2 | > loss_disc: 2.2636404037475586 (2.4111722707748413) | > loss_disc_real_0: 0.41973280906677246 (0.2787836566567421) | > loss_disc_real_1: 0.290479838848114 (0.2515368014574051) | > loss_disc_real_2: 0.2598959803581238 (0.2356867641210556) | > loss_disc_real_3: 0.10401949286460876 (0.20377175509929657) | > loss_disc_real_4: 0.18343226611614227 (0.21571379899978638) | > loss_disc_real_5: 0.22865910828113556 (0.2517869099974632) | > loss_0: 2.2636404037475586 (2.4111722707748413) | > loss_gen: 3.184587001800537 (2.562197983264923) | > loss_kl: 5.9158616065979 (5.7868781089782715) | > loss_feat: 7.907170295715332 (4.600725412368774) | > loss_mel: 24.83525276184082 (22.832560539245605) | > loss_duration: 3.276630163192749 (3.3522422313690186) | > loss_1: 45.119503021240234 (39.134605407714844)  --> STEP: 3 | > loss_disc: 2.8141658306121826 (2.5455034573872886) | > loss_disc_real_0: 0.2699248790740967 (0.2758307307958603) | > loss_disc_real_1: 0.21772153675556183 (0.24026504655679068) | > loss_disc_real_2: 0.29308342933654785 (0.25481898585955304) | > loss_disc_real_3: 0.27055272459983826 (0.2260320782661438) | > loss_disc_real_4: 0.2528940439224243 (0.22810721397399902) | > loss_disc_real_5: 0.2585826516151428 (0.25405215720335644) | > loss_0: 2.8141658306121826 (2.5455034573872886) | > loss_gen: 1.8721250295639038 (2.3321736653645835) | > loss_kl: 3.1024112701416016 (4.892055829366048) | > loss_feat: 1.2452497482299805 (3.4822335243225098) | > loss_mel: 17.770952224731445 (21.145357767740887) | > loss_duration: 3.1215901374816895 (3.275358200073242) | > loss_1: 27.112329483032227 (35.127180099487305) --> EVAL PERFORMANCE | > avg_loader_time: 0.007004658381144206 (+0.0043799082438151045) | > avg_loss_disc: 2.5455034573872886 (+0.13059655825297067) | > avg_loss_disc_real_0: 0.2758307307958603 (+0.031993473569552094) | > avg_loss_disc_real_1: 0.24026504655679068 (-0.05828605592250821) | > avg_loss_disc_real_2: 0.25481898585955304 (-0.0018071780602136878) | > avg_loss_disc_real_3: 0.2260320782661438 (-0.03755806883176166) | > avg_loss_disc_real_4: 0.22810721397399902 (-0.01081057886282602) | > avg_loss_disc_real_5: 0.25405215720335644 (+0.04069115345676741) | > avg_loss_0: 2.5455034573872886 (+0.13059655825297067) | > avg_loss_gen: 2.3321736653645835 (-0.6738899548848467) | > avg_loss_kl: 4.892055829366048 (+0.08287127812703421) | > avg_loss_feat: 3.4822335243225098 (-4.2637942632039385) | > avg_loss_mel: 21.145357767740887 (-3.2501296997070312) | > avg_loss_duration: 3.275358200073242 (-0.006853898366292466) | > avg_loss_1: 35.127180099487305 (-8.111795425415039)  > EPOCH: 1125/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:10:27)   --> TIME: 2023-10-20 14:10:37 -- STEP: 9/50 -- GLOBAL_STEP: 109260 | > loss_disc: 2.806570529937744 (2.2756336530049643) | > loss_disc_real_0: 0.2004219889640808 (0.1440013183487786) | > loss_disc_real_1: 0.2495262324810028 (0.27416033835874665) | > loss_disc_real_2: 0.22101342678070068 (0.24578914874129826) | > loss_disc_real_3: 0.2758624851703644 (0.24457012365261713) | > loss_disc_real_4: 0.23443815112113953 (0.20410962982310188) | > loss_disc_real_5: 0.22945533692836761 (0.14790686633851793) | > loss_0: 2.806570529937744 (2.2756336530049643) | > grad_norm_0: tensor(2781.9077, device='cuda:0') (tensor(1667.4540, device='cuda:0')) | > loss_gen: 1.639909029006958 (2.584203349219428) | > loss_kl: 0.9228260517120361 (0.7969324655003018) | > loss_feat: 0.645340621471405 (6.434979776541392) | > loss_mel: 11.350678443908691 (20.5959988700019) | > loss_duration: 1.3278073072433472 (1.319504936536153) | > loss_1: 15.886561393737793 (31.7316189871894) | > grad_norm_1: tensor(13855.2119, device='cuda:0') (tensor(64933.7500, device='cuda:0')) | > current_lr_0: 6.492592782636226e-05 | > current_lr_1: 6.492592782636226e-05 | > step_time: 0.9225 (0.6135492324829102) | > loader_time: 0.0171 (0.020839320288764104)  --> TIME: 2023-10-20 14:10:52 -- STEP: 39/50 -- GLOBAL_STEP: 109290 | > loss_disc: 2.40848970413208 (2.3755375238565297) | > loss_disc_real_0: 0.22243717312812805 (0.1395086612647925) | > loss_disc_real_1: 0.28281646966934204 (0.2275633885501287) | > loss_disc_real_2: 0.2880045771598816 (0.21980039030313492) | > loss_disc_real_3: 0.27791258692741394 (0.23763727530454978) | > loss_disc_real_4: 0.27944356203079224 (0.22247958402985182) | > loss_disc_real_5: 0.1860695481300354 (0.20479457424237177) | > loss_0: 2.40848970413208 (2.3755375238565297) | > grad_norm_0: tensor(2587.7148, device='cuda:0') (tensor(1626.2030, device='cuda:0')) | > loss_gen: 2.723799705505371 (2.3379267240181942) | > loss_kl: 0.5447252988815308 (0.7376183917125066) | > loss_feat: 3.577572822570801 (5.535515820273222) | > loss_mel: 18.21750259399414 (19.821451278833244) | > loss_duration: 1.4493705034255981 (1.3171192377041545) | > loss_1: 26.51297378540039 (29.749631429329895) | > grad_norm_1: tensor(16122.1445, device='cuda:0') (tensor(47482.8633, device='cuda:0')) | > current_lr_0: 6.492592782636226e-05 | > current_lr_1: 6.492592782636226e-05 | > step_time: 0.5308 (0.4980053045810797) | > loader_time: 0.0064 (0.013282054509872042)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5562903881073 (2.5562903881073) | > loss_disc_real_0: 0.16969072818756104 (0.16969072818756104) | > loss_disc_real_1: 0.26189154386520386 (0.26189154386520386) | > loss_disc_real_2: 0.3104114234447479 (0.3104114234447479) | > loss_disc_real_3: 0.23829670250415802 (0.23829670250415802) | > loss_disc_real_4: 0.28601107001304626 (0.28601107001304626) | > loss_disc_real_5: 0.2836644649505615 (0.2836644649505615) | > loss_0: 2.5562903881073 (2.5562903881073) | > loss_gen: 2.5554890632629395 (2.5554890632629395) | > loss_kl: 5.774588584899902 (5.774588584899902) | > loss_feat: 7.886682987213135 (7.886682987213135) | > loss_mel: 25.24551773071289 (25.24551773071289) | > loss_duration: 3.0783541202545166 (3.0783541202545166) | > loss_1: 44.54063415527344 (44.54063415527344)  --> STEP: 1 | > loss_disc: 3.1055526733398438 (3.1055526733398438) | > loss_disc_real_0: 0.30060648918151855 (0.30060648918151855) | > loss_disc_real_1: 0.205473855137825 (0.205473855137825) | > loss_disc_real_2: 0.36050471663475037 (0.36050471663475037) | > loss_disc_real_3: 0.28544214367866516 (0.28544214367866516) | > loss_disc_real_4: 0.28190428018569946 (0.28190428018569946) | > loss_disc_real_5: 0.3179560601711273 (0.3179560601711273) | > loss_0: 3.1055526733398438 (3.1055526733398438) | > loss_gen: 1.7053804397583008 (1.7053804397583008) | > loss_kl: 5.384320259094238 (5.384320259094238) | > loss_feat: 1.2769614458084106 (1.2769614458084106) | > loss_mel: 19.728471755981445 (19.728471755981445) | > loss_duration: 3.3744771480560303 (3.3744771480560303) | > loss_1: 31.46961212158203 (31.46961212158203)  --> STEP: 2 | > loss_disc: 3.122699737548828 (3.114126205444336) | > loss_disc_real_0: 0.1299382448196411 (0.21527236700057983) | > loss_disc_real_1: 0.24003911018371582 (0.22275648266077042) | > loss_disc_real_2: 0.2541058659553528 (0.3073052912950516) | > loss_disc_real_3: 0.2538912296295166 (0.2696666866540909) | > loss_disc_real_4: 0.30383217334747314 (0.2928682267665863) | > loss_disc_real_5: 0.3140087425708771 (0.3159824013710022) | > loss_0: 3.122699737548828 (3.114126205444336) | > loss_gen: 1.4501798152923584 (1.5777801275253296) | > loss_kl: 5.804749965667725 (5.5945351123809814) | > loss_feat: 0.1826401799917221 (0.7298008129000664) | > loss_mel: 2.411874532699585 (11.070173144340515) | > loss_duration: 3.2881698608398438 (3.331323504447937) | > loss_1: 13.137614250183105 (22.30361318588257)  --> STEP: 3 | > loss_disc: 2.512558937072754 (2.9136037826538086) | > loss_disc_real_0: 0.09281717240810394 (0.17445396880308786) | > loss_disc_real_1: 0.191081702709198 (0.21219822267691293) | > loss_disc_real_2: 0.25085142254829407 (0.2884873350461324) | > loss_disc_real_3: 0.20312918722629547 (0.2474875201781591) | > loss_disc_real_4: 0.28900396823883057 (0.2915801405906677) | > loss_disc_real_5: 0.2942848801612854 (0.3087498943010966) | > loss_0: 2.512558937072754 (2.9136037826538086) | > loss_gen: 1.9207924604415894 (1.6921175718307495) | > loss_kl: 2.77652907371521 (4.655199766159058) | > loss_feat: 2.5808706283569336 (1.346824084719022) | > loss_mel: 19.167011260986328 (13.769119183222452) | > loss_duration: 3.1302764415740967 (3.2643078168233237) | > loss_1: 29.575477600097656 (24.72756799062093) --> EVAL PERFORMANCE | > avg_loader_time: 0.003365755081176758 (-0.003638903299967448) | > avg_loss_disc: 2.9136037826538086 (+0.36810032526652003) | > avg_loss_disc_real_0: 0.17445396880308786 (-0.10137676199277243) | > avg_loss_disc_real_1: 0.21219822267691293 (-0.028066823879877745) | > avg_loss_disc_real_2: 0.2884873350461324 (+0.03366834918657935) | > avg_loss_disc_real_3: 0.2474875201781591 (+0.02145544191201529) | > avg_loss_disc_real_4: 0.2915801405906677 (+0.0634729266166687) | > avg_loss_disc_real_5: 0.3087498943010966 (+0.05469773709774017) | > avg_loss_0: 2.9136037826538086 (+0.36810032526652003) | > avg_loss_gen: 1.6921175718307495 (-0.640056093533834) | > avg_loss_kl: 4.655199766159058 (-0.23685606320699026) | > avg_loss_feat: 1.346824084719022 (-2.135409439603488) | > avg_loss_mel: 13.769119183222452 (-7.376238584518434) | > avg_loss_duration: 3.2643078168233237 (-0.011050383249918472) | > avg_loss_1: 24.72756799062093 (-10.399612108866375)  > EPOCH: 1126/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:11:15)   --> TIME: 2023-10-20 14:11:36 -- STEP: 19/50 -- GLOBAL_STEP: 109320 | > loss_disc: 3.042053699493408 (2.3977971986720434) | > loss_disc_real_0: 0.47928714752197266 (0.14490553609242565) | > loss_disc_real_1: 0.27244940400123596 (0.2515822613709851) | > loss_disc_real_2: 0.24147137999534607 (0.25800652762776927) | > loss_disc_real_3: 0.28677642345428467 (0.24126251434025012) | > loss_disc_real_4: 0.2787932753562927 (0.26026076205859056) | > loss_disc_real_5: 0.2488332837820053 (0.2388037823532757) | > loss_0: 3.042053699493408 (2.3977971986720434) | > grad_norm_0: tensor(2398.1121, device='cuda:0') (tensor(1336.1503, device='cuda:0')) | > loss_gen: 1.7478089332580566 (2.602080144380268) | > loss_kl: 0.8639557361602783 (0.8055820935650876) | > loss_feat: 0.2240099310874939 (6.6566520348975535) | > loss_mel: 4.980687618255615 (20.892284845051012) | > loss_duration: 1.431881070137024 (1.3609644237317537) | > loss_1: 9.248343467712402 (32.317563107139186) | > grad_norm_1: tensor(2921.9485, device='cuda:0') (tensor(46646.2461, device='cuda:0')) | > current_lr_0: 6.486103029652913e-05 | > current_lr_1: 6.486103029652913e-05 | > step_time: 0.821 (0.7413279759256464) | > loader_time: 0.0273 (0.02927752545005397)  --> TIME: 2023-10-20 14:11:57 -- STEP: 49/50 -- GLOBAL_STEP: 109350 | > loss_disc: 2.2183709144592285 (2.3239817838279557) | > loss_disc_real_0: 0.12013885378837585 (0.14271811597353343) | > loss_disc_real_1: 0.26931899785995483 (0.2239269515385433) | > loss_disc_real_2: 0.15781693160533905 (0.231125248786138) | > loss_disc_real_3: 0.23518846929073334 (0.2236070986457017) | > loss_disc_real_4: 0.18112967908382416 (0.2207503193343172) | > loss_disc_real_5: 0.31843051314353943 (0.21714374776549486) | > loss_0: 2.2183709144592285 (2.3239817838279557) | > grad_norm_0: tensor(1080.5634, device='cuda:0') (tensor(1448.2507, device='cuda:0')) | > loss_gen: 2.954169750213623 (2.5146979896389716) | > loss_kl: 0.7852060794830322 (0.7349012007518689) | > loss_feat: 7.211065292358398 (6.402376697683821) | > loss_mel: 27.895797729492188 (19.87640894675741) | > loss_duration: 1.390244722366333 (1.3216225152113004) | > loss_1: 40.236480712890625 (30.85000701826446) | > grad_norm_1: tensor(61649.8320, device='cuda:0') (tensor(48289.2578, device='cuda:0')) | > current_lr_0: 6.486103029652913e-05 | > current_lr_1: 6.486103029652913e-05 | > step_time: 0.6671 (0.6895936995136498) | > loader_time: 0.5527 (0.03370413001702757)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.791271448135376 (2.791271448135376) | > loss_disc_real_0: 0.14890822768211365 (0.14890822768211365) | > loss_disc_real_1: 0.2547846734523773 (0.2547846734523773) | > loss_disc_real_2: 0.2257746160030365 (0.2257746160030365) | > loss_disc_real_3: 0.2675001621246338 (0.2675001621246338) | > loss_disc_real_4: 0.2469407320022583 (0.2469407320022583) | > loss_disc_real_5: 0.2437659502029419 (0.2437659502029419) | > loss_0: 2.791271448135376 (2.791271448135376) | > loss_gen: 1.6318126916885376 (1.6318126916885376) | > loss_kl: 6.043758392333984 (6.043758392333984) | > loss_feat: 0.6180831789970398 (0.6180831789970398) | > loss_mel: 14.765852928161621 (14.765852928161621) | > loss_duration: 2.9783389568328857 (2.9783389568328857) | > loss_1: 26.037845611572266 (26.037845611572266)  --> STEP: 1 | > loss_disc: 2.0389506816864014 (2.0389506816864014) | > loss_disc_real_0: 0.15123112499713898 (0.15123112499713898) | > loss_disc_real_1: 0.44084325432777405 (0.44084325432777405) | > loss_disc_real_2: 0.3201722502708435 (0.3201722502708435) | > loss_disc_real_3: 0.17749997973442078 (0.17749997973442078) | > loss_disc_real_4: 0.09905465692281723 (0.09905465692281723) | > loss_disc_real_5: 0.09433463215827942 (0.09433463215827942) | > loss_0: 2.0389506816864014 (2.0389506816864014) | > loss_gen: 3.0723330974578857 (3.0723330974578857) | > loss_kl: 5.742179870605469 (5.742179870605469) | > loss_feat: 7.357752799987793 (7.357752799987793) | > loss_mel: 24.182889938354492 (24.182889938354492) | > loss_duration: 3.430680990219116 (3.430680990219116) | > loss_1: 43.78583526611328 (43.78583526611328)  --> STEP: 2 | > loss_disc: 2.81476092338562 (2.4268558025360107) | > loss_disc_real_0: 0.14060328900814056 (0.14591720700263977) | > loss_disc_real_1: 0.2660079896450043 (0.35342562198638916) | > loss_disc_real_2: 0.22282952070236206 (0.2715008854866028) | > loss_disc_real_3: 0.2755710780620575 (0.22653552889823914) | > loss_disc_real_4: 0.24729831516742706 (0.17317648604512215) | > loss_disc_real_5: 0.24438787996768951 (0.16936125606298447) | > loss_0: 2.81476092338562 (2.4268558025360107) | > loss_gen: 1.6180243492126465 (2.345178723335266) | > loss_kl: 6.228525638580322 (5.9853527545928955) | > loss_feat: 0.5914679169654846 (3.974610358476639) | > loss_mel: 12.458389282226562 (18.320639610290527) | > loss_duration: 3.176683187484741 (3.3036820888519287) | > loss_1: 24.073091506958008 (33.929463386535645)  --> STEP: 3 | > loss_disc: 2.9044156074523926 (2.5860424041748047) | > loss_disc_real_0: 0.23529811203479767 (0.17571084201335907) | > loss_disc_real_1: 0.263813316822052 (0.3235548535982768) | > loss_disc_real_2: 0.23329870402812958 (0.25876682500044507) | > loss_disc_real_3: 0.27940618991851807 (0.24415908257166544) | > loss_disc_real_4: 0.263616144657135 (0.2033230389157931) | > loss_disc_real_5: 0.2496711164712906 (0.19613120953241983) | > loss_0: 2.9044156074523926 (2.5860424041748047) | > loss_gen: 1.6733427047729492 (2.1212333838144937) | > loss_kl: 3.1032025814056396 (5.0246360301971436) | > loss_feat: 0.47995272278785706 (2.8097244799137115) | > loss_mel: 10.862227439880371 (15.834502220153809) | > loss_duration: 3.020612955093384 (3.2093257109324136) | > loss_1: 19.13933753967285 (28.99942143758138) --> EVAL PERFORMANCE | > avg_loader_time: 0.008439938227335611 (+0.005074183146158854) | > avg_loss_disc: 2.5860424041748047 (-0.3275613784790039) | > avg_loss_disc_real_0: 0.17571084201335907 (+0.0012568732102712088) | > avg_loss_disc_real_1: 0.3235548535982768 (+0.11135663092136386) | > avg_loss_disc_real_2: 0.25876682500044507 (-0.02972051004568732) | > avg_loss_disc_real_3: 0.24415908257166544 (-0.0033284376064936505) | > avg_loss_disc_real_4: 0.2033230389157931 (-0.08825710167487463) | > avg_loss_disc_real_5: 0.19613120953241983 (-0.11261868476867679) | > avg_loss_0: 2.5860424041748047 (-0.3275613784790039) | > avg_loss_gen: 2.1212333838144937 (+0.42911581198374416) | > avg_loss_kl: 5.0246360301971436 (+0.36943626403808594) | > avg_loss_feat: 2.8097244799137115 (+1.4629003951946895) | > avg_loss_mel: 15.834502220153809 (+2.0653830369313564) | > avg_loss_duration: 3.2093257109324136 (-0.05498210589091013) | > avg_loss_1: 28.99942143758138 (+4.271853446960449)  > EPOCH: 1127/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:12:09)   --> TIME: 2023-10-20 14:12:36 -- STEP: 29/50 -- GLOBAL_STEP: 109380 | > loss_disc: 2.9690988063812256 (2.4713455890787057) | > loss_disc_real_0: 0.1976863145828247 (0.14779181945426711) | > loss_disc_real_1: 0.24899569153785706 (0.21862665204138593) | > loss_disc_real_2: 0.2494780272245407 (0.214575516638057) | > loss_disc_real_3: 0.2550567388534546 (0.23105987431160335) | > loss_disc_real_4: 0.28600096702575684 (0.22357011580004774) | > loss_disc_real_5: 0.27173712849617004 (0.22928561726263885) | > loss_0: 2.9690988063812256 (2.4713455890787057) | > grad_norm_0: tensor(1981.2920, device='cuda:0') (tensor(1473.1825, device='cuda:0')) | > loss_gen: 1.5462415218353271 (2.1827468584323753) | > loss_kl: 1.15660560131073 (0.8730649804246837) | > loss_feat: 0.16292375326156616 (5.190317731864493) | > loss_mel: 8.591917037963867 (20.0728391203387) | > loss_duration: 1.3790268898010254 (1.3407998701621746) | > loss_1: 12.836715698242188 (29.65976879514497) | > grad_norm_1: tensor(46329.7656, device='cuda:0') (tensor(40546.1367, device='cuda:0')) | > current_lr_0: 6.479619763584028e-05 | > current_lr_1: 6.479619763584028e-05 | > step_time: 0.7181 (0.7118511611017687) | > loader_time: 0.0396 (0.020796414079337286)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5990357398986816 (2.5990357398986816) | > loss_disc_real_0: 0.48039716482162476 (0.48039716482162476) | > loss_disc_real_1: 0.3186401426792145 (0.3186401426792145) | > loss_disc_real_2: 0.3405529260635376 (0.3405529260635376) | > loss_disc_real_3: 0.23758719861507416 (0.23758719861507416) | > loss_disc_real_4: 0.22601398825645447 (0.22601398825645447) | > loss_disc_real_5: 0.22560715675354004 (0.22560715675354004) | > loss_0: 2.5990357398986816 (2.5990357398986816) | > loss_gen: 2.9437546730041504 (2.9437546730041504) | > loss_kl: 6.014501571655273 (6.014501571655273) | > loss_feat: 4.585798263549805 (4.585798263549805) | > loss_mel: 20.161191940307617 (20.161191940307617) | > loss_duration: 3.0126850605010986 (3.0126850605010986) | > loss_1: 36.71792984008789 (36.71792984008789)  --> STEP: 1 | > loss_disc: 2.78619384765625 (2.78619384765625) | > loss_disc_real_0: 0.37428224086761475 (0.37428224086761475) | > loss_disc_real_1: 0.26603031158447266 (0.26603031158447266) | > loss_disc_real_2: 0.24438686668872833 (0.24438686668872833) | > loss_disc_real_3: 0.20141148567199707 (0.20141148567199707) | > loss_disc_real_4: 0.24599292874336243 (0.24599292874336243) | > loss_disc_real_5: 0.23077286779880524 (0.23077286779880524) | > loss_0: 2.78619384765625 (2.78619384765625) | > loss_gen: 2.4997589588165283 (2.4997589588165283) | > loss_kl: 5.346153736114502 (5.346153736114502) | > loss_feat: 6.81511926651001 (6.81511926651001) | > loss_mel: 21.558090209960938 (21.558090209960938) | > loss_duration: 3.4583866596221924 (3.4583866596221924) | > loss_1: 39.67750930786133 (39.67750930786133)  --> STEP: 2 | > loss_disc: 2.7590906620025635 (2.7726422548294067) | > loss_disc_real_0: 0.18281599879264832 (0.27854911983013153) | > loss_disc_real_1: 0.24531638622283936 (0.255673348903656) | > loss_disc_real_2: 0.21997925639152527 (0.2321830615401268) | > loss_disc_real_3: 0.2649672329425812 (0.23318935930728912) | > loss_disc_real_4: 0.2461739480495453 (0.24608343839645386) | > loss_disc_real_5: 0.2430790215730667 (0.23692594468593597) | > loss_0: 2.7590906620025635 (2.7726422548294067) | > loss_gen: 1.6922143697738647 (2.0959866642951965) | > loss_kl: 5.434597015380859 (5.390375375747681) | > loss_feat: 0.7540005445480347 (3.784559905529022) | > loss_mel: 19.50093650817871 (20.529513359069824) | > loss_duration: 3.183173656463623 (3.3207801580429077) | > loss_1: 30.564922332763672 (35.1212158203125)  --> STEP: 3 | > loss_disc: 2.993032217025757 (2.8461055755615234) | > loss_disc_real_0: 0.3710336983203888 (0.3093773126602173) | > loss_disc_real_1: 0.24554555118083954 (0.25229741632938385) | > loss_disc_real_2: 0.20428301393985748 (0.22288304567337036) | > loss_disc_real_3: 0.29784539341926575 (0.254741370677948) | > loss_disc_real_4: 0.29503387212753296 (0.2624002496401469) | > loss_disc_real_5: 0.36274343729019165 (0.27886510888735455) | > loss_0: 2.993032217025757 (2.8461055755615234) | > loss_gen: 1.9605729579925537 (2.0508487621943154) | > loss_kl: 2.5627613067626953 (4.4478373527526855) | > loss_feat: 2.3377108573913574 (3.302276889483134) | > loss_mel: 18.587604522705078 (19.88221041361491) | > loss_duration: 3.0064220428466797 (3.215994119644165) | > loss_1: 28.4550724029541 (32.89916801452637) --> EVAL PERFORMANCE | > avg_loader_time: 0.012061119079589844 (+0.0036211808522542323) | > avg_loss_disc: 2.8461055755615234 (+0.26006317138671875) | > avg_loss_disc_real_0: 0.3093773126602173 (+0.13366647064685822) | > avg_loss_disc_real_1: 0.25229741632938385 (-0.07125743726889294) | > avg_loss_disc_real_2: 0.22288304567337036 (-0.035883779327074705) | > avg_loss_disc_real_3: 0.254741370677948 (+0.010582288106282561) | > avg_loss_disc_real_4: 0.2624002496401469 (+0.05907721072435382) | > avg_loss_disc_real_5: 0.27886510888735455 (+0.08273389935493472) | > avg_loss_0: 2.8461055755615234 (+0.26006317138671875) | > avg_loss_gen: 2.0508487621943154 (-0.07038462162017822) | > avg_loss_kl: 4.4478373527526855 (-0.576798677444458) | > avg_loss_feat: 3.302276889483134 (+0.49255240956942226) | > avg_loss_mel: 19.88221041361491 (+4.0477081934611014) | > avg_loss_duration: 3.215994119644165 (+0.00666840871175145) | > avg_loss_1: 32.89916801452637 (+3.899746576944988)  > EPOCH: 1128/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:12:58)   --> TIME: 2023-10-20 14:13:09 -- STEP: 9/50 -- GLOBAL_STEP: 109410 | > loss_disc: 1.565697193145752 (2.3791231049431696) | > loss_disc_real_0: 0.0448705218732357 (0.11351557158761555) | > loss_disc_real_1: 0.13408146798610687 (0.20194675193892586) | > loss_disc_real_2: 0.0851820632815361 (0.21300536973608863) | > loss_disc_real_3: 0.16948769986629486 (0.24215018418100145) | > loss_disc_real_4: 0.03213697671890259 (0.219577486316363) | > loss_disc_real_5: 0.06841988861560822 (0.24933800184064442) | > loss_0: 1.565697193145752 (2.3791231049431696) | > grad_norm_0: tensor(749.2897, device='cuda:0') (tensor(1227.1022, device='cuda:0')) | > loss_gen: 2.386155366897583 (2.339798370997111) | > loss_kl: 0.3519589900970459 (0.8793818420834012) | > loss_feat: 9.031023979187012 (5.47264442510075) | > loss_mel: 23.318876266479492 (19.341906547546387) | > loss_duration: 1.3471823930740356 (1.337477485338847) | > loss_1: 36.43519592285156 (29.371208137936062) | > grad_norm_1: tensor(16588.2383, device='cuda:0') (tensor(34012.7031, device='cuda:0')) | > current_lr_0: 6.473142977945493e-05 | > current_lr_1: 6.473142977945493e-05 | > step_time: 0.5966 (0.6105664306216769) | > loader_time: 0.0215 (0.02547589937845866)  --> TIME: 2023-10-20 14:13:24 -- STEP: 39/50 -- GLOBAL_STEP: 109440 | > loss_disc: 1.2119184732437134 (2.3002432798727965) | > loss_disc_real_0: 0.05504900589585304 (0.12676551551199877) | > loss_disc_real_1: 0.060577746480703354 (0.2169809990013257) | > loss_disc_real_2: 0.08093994110822678 (0.19657234178903776) | > loss_disc_real_3: 0.07293446362018585 (0.23159990755793375) | > loss_disc_real_4: 0.03300366923213005 (0.20862839261117655) | > loss_disc_real_5: 0.00543520413339138 (0.2078652553117046) | > loss_0: 1.2119184732437134 (2.3002432798727965) | > grad_norm_0: tensor(2682.9788, device='cuda:0') (tensor(1149.3644, device='cuda:0')) | > loss_gen: 2.931840658187866 (2.466536576931293) | > loss_kl: 0.5850752592086792 (0.8035631462549553) | > loss_feat: 11.838720321655273 (6.878633965666477) | > loss_mel: 25.53999900817871 (21.791407267252602) | > loss_duration: 1.4343329668045044 (1.3246025458360329) | > loss_1: 42.3299674987793 (33.26474310801579) | > grad_norm_1: tensor(169914.6406, device='cuda:0') (tensor(38572.1484, device='cuda:0')) | > current_lr_0: 6.473142977945493e-05 | > current_lr_1: 6.473142977945493e-05 | > step_time: 0.2609 (0.5177486920968081) | > loader_time: 0.0024 (0.014739164939293494)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.824392318725586 (2.824392318725586) | > loss_disc_real_0: 0.4869765639305115 (0.4869765639305115) | > loss_disc_real_1: 0.23044246435165405 (0.23044246435165405) | > loss_disc_real_2: 0.3031494915485382 (0.3031494915485382) | > loss_disc_real_3: 0.2679048478603363 (0.2679048478603363) | > loss_disc_real_4: 0.3778299391269684 (0.3778299391269684) | > loss_disc_real_5: 0.2997700572013855 (0.2997700572013855) | > loss_0: 2.824392318725586 (2.824392318725586) | > loss_gen: 2.9672346115112305 (2.9672346115112305) | > loss_kl: 5.340240955352783 (5.340240955352783) | > loss_feat: 4.280960559844971 (4.280960559844971) | > loss_mel: 14.472543716430664 (14.472543716430664) | > loss_duration: 3.049729585647583 (3.049729585647583) | > loss_1: 30.1107120513916 (30.1107120513916)  --> STEP: 1 | > loss_disc: 1.836035132408142 (1.836035132408142) | > loss_disc_real_0: 0.1803521364927292 (0.1803521364927292) | > loss_disc_real_1: 0.24495713412761688 (0.24495713412761688) | > loss_disc_real_2: 0.20177620649337769 (0.20177620649337769) | > loss_disc_real_3: 0.17952169477939606 (0.17952169477939606) | > loss_disc_real_4: 0.14267854392528534 (0.14267854392528534) | > loss_disc_real_5: 0.08476869016885757 (0.08476869016885757) | > loss_0: 1.836035132408142 (1.836035132408142) | > loss_gen: 2.69720196723938 (2.69720196723938) | > loss_kl: 5.481039047241211 (5.481039047241211) | > loss_feat: 9.528217315673828 (9.528217315673828) | > loss_mel: 22.88173484802246 (22.88173484802246) | > loss_duration: 3.4374327659606934 (3.4374327659606934) | > loss_1: 44.0256233215332 (44.0256233215332)  --> STEP: 2 | > loss_disc: 3.0460715293884277 (2.441053330898285) | > loss_disc_real_0: 0.35611164569854736 (0.2682318910956383) | > loss_disc_real_1: 0.27532878518104553 (0.2601429596543312) | > loss_disc_real_2: 0.28616634011268616 (0.24397127330303192) | > loss_disc_real_3: 0.25669369101524353 (0.2181076928973198) | > loss_disc_real_4: 0.27508530020713806 (0.2088819220662117) | > loss_disc_real_5: 0.24388442933559418 (0.16432655975222588) | > loss_0: 3.0460715293884277 (2.441053330898285) | > loss_gen: 1.6709203720092773 (2.1840611696243286) | > loss_kl: 5.526162624359131 (5.503600835800171) | > loss_feat: 0.118728406727314 (4.823472861200571) | > loss_mel: 5.978141784667969 (14.429938316345215) | > loss_duration: 3.1684157848358154 (3.3029242753982544) | > loss_1: 16.462369918823242 (30.243996620178223)  --> STEP: 3 | > loss_disc: 2.8008413314819336 (2.560982664426168) | > loss_disc_real_0: 0.1545983850955963 (0.23035405576229095) | > loss_disc_real_1: 0.3503958582878113 (0.2902272591988246) | > loss_disc_real_2: 0.281194806098938 (0.2563791175683339) | > loss_disc_real_3: 0.3246830403804779 (0.2536328087250392) | > loss_disc_real_4: 0.3553807735443115 (0.2577148725589116) | > loss_disc_real_5: 0.4075058400630951 (0.24538631985584894) | > loss_0: 2.8008413314819336 (2.560982664426168) | > loss_gen: 2.49737548828125 (2.2884992758433023) | > loss_kl: 3.080618381500244 (4.695940017700195) | > loss_feat: 3.5508689880371094 (4.399271570146084) | > loss_mel: 18.17290687561035 (15.677594502766928) | > loss_duration: 3.005505323410034 (3.203784624735514) | > loss_1: 30.307273864746094 (30.26508903503418) --> EVAL PERFORMANCE | > avg_loader_time: 0.01142589251200358 (-0.0006352265675862636) | > avg_loss_disc: 2.560982664426168 (-0.2851229111353555) | > avg_loss_disc_real_0: 0.23035405576229095 (-0.07902325689792633) | > avg_loss_disc_real_1: 0.2902272591988246 (+0.03792984286944073) | > avg_loss_disc_real_2: 0.2563791175683339 (+0.033496071894963564) | > avg_loss_disc_real_3: 0.2536328087250392 (-0.0011085619529088153) | > avg_loss_disc_real_4: 0.2577148725589116 (-0.004685377081235287) | > avg_loss_disc_real_5: 0.24538631985584894 (-0.03347878903150561) | > avg_loss_0: 2.560982664426168 (-0.2851229111353555) | > avg_loss_gen: 2.2884992758433023 (+0.23765051364898682) | > avg_loss_kl: 4.695940017700195 (+0.24810266494750977) | > avg_loss_feat: 4.399271570146084 (+1.09699468066295) | > avg_loss_mel: 15.677594502766928 (-4.204615910847982) | > avg_loss_duration: 3.203784624735514 (-0.012209494908650864) | > avg_loss_1: 30.26508903503418 (-2.6340789794921875)  > EPOCH: 1129/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:13:46)   --> TIME: 2023-10-20 14:14:07 -- STEP: 19/50 -- GLOBAL_STEP: 109470 | > loss_disc: 1.7760509252548218 (2.3217778017646387) | > loss_disc_real_0: 0.013010644353926182 (0.1519048549725037) | > loss_disc_real_1: 0.13876640796661377 (0.22571652755141258) | > loss_disc_real_2: 0.08232952654361725 (0.21810892587037464) | > loss_disc_real_3: 0.12217358499765396 (0.21591049354327352) | > loss_disc_real_4: 0.0976981595158577 (0.19863443880488998) | > loss_disc_real_5: 0.12208195775747299 (0.2043043389720352) | > loss_0: 1.7760509252548218 (2.3217778017646387) | > grad_norm_0: tensor(1303.4291, device='cuda:0') (tensor(1320.7711, device='cuda:0')) | > loss_gen: 2.1245951652526855 (2.3959488492262992) | > loss_kl: 1.0128257274627686 (0.8342360905616691) | > loss_feat: 7.205024242401123 (6.259691774845123) | > loss_mel: 20.4330997467041 (19.566298139722722) | > loss_duration: 1.4122726917266846 (1.3646595478057861) | > loss_1: 32.18781661987305 (30.42083424016049) | > grad_norm_1: tensor(17686.6152, device='cuda:0') (tensor(36916.1133, device='cuda:0')) | > current_lr_0: 6.466672666259707e-05 | > current_lr_1: 6.466672666259707e-05 | > step_time: 0.6712 (0.6405090658288253) | > loader_time: 0.0021 (0.01984039105867085)  --> TIME: 2023-10-20 14:14:21 -- STEP: 49/50 -- GLOBAL_STEP: 109500 | > loss_disc: 1.7256108522415161 (2.30045681461996) | > loss_disc_real_0: 0.10068542510271072 (0.1448111543431878) | > loss_disc_real_1: 0.20056137442588806 (0.2115606802078534) | > loss_disc_real_2: 0.16673511266708374 (0.209156619422898) | > loss_disc_real_3: 0.11245477199554443 (0.22950460220097887) | > loss_disc_real_4: 0.09228229522705078 (0.20159602902677598) | > loss_disc_real_5: 0.15607498586177826 (0.2097841575741768) | > loss_0: 1.7256108522415161 (2.30045681461996) | > grad_norm_0: tensor(1844.2395, device='cuda:0') (tensor(1261.1393, device='cuda:0')) | > loss_gen: 2.7497808933258057 (2.3826503996946373) | > loss_kl: 0.8505702614784241 (0.76130758942466) | > loss_feat: 8.714116096496582 (6.1537125624564215) | > loss_mel: 25.738990783691406 (19.693699678596186) | > loss_duration: 1.4889010190963745 (1.3298470414414698) | > loss_1: 39.5423583984375 (30.321216923849924) | > grad_norm_1: tensor(132472.0938, device='cuda:0') (tensor(35935.8672, device='cuda:0')) | > current_lr_0: 6.466672666259707e-05 | > current_lr_1: 6.466672666259707e-05 | > step_time: 0.3799 (0.5259780251249975) | > loader_time: 0.4349 (0.023720210912276288)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9378581047058105 (2.9378581047058105) | > loss_disc_real_0: 0.21369598805904388 (0.21369598805904388) | > loss_disc_real_1: 0.3852546811103821 (0.3852546811103821) | > loss_disc_real_2: 0.30382823944091797 (0.30382823944091797) | > loss_disc_real_3: 0.3131277561187744 (0.3131277561187744) | > loss_disc_real_4: 0.27489352226257324 (0.27489352226257324) | > loss_disc_real_5: 0.33737367391586304 (0.33737367391586304) | > loss_0: 2.9378581047058105 (2.9378581047058105) | > loss_gen: 2.3152143955230713 (2.3152143955230713) | > loss_kl: 5.411340236663818 (5.411340236663818) | > loss_feat: 7.918493270874023 (7.918493270874023) | > loss_mel: 22.270166397094727 (22.270166397094727) | > loss_duration: 3.1151294708251953 (3.1151294708251953) | > loss_1: 41.03034210205078 (41.03034210205078)  --> STEP: 1 | > loss_disc: 4.017757415771484 (4.017757415771484) | > loss_disc_real_0: 0.696636438369751 (0.696636438369751) | > loss_disc_real_1: 0.3779555857181549 (0.3779555857181549) | > loss_disc_real_2: 0.34761542081832886 (0.34761542081832886) | > loss_disc_real_3: 0.3796059191226959 (0.3796059191226959) | > loss_disc_real_4: 0.3692859709262848 (0.3692859709262848) | > loss_disc_real_5: 0.66270512342453 (0.66270512342453) | > loss_0: 4.017757415771484 (4.017757415771484) | > loss_gen: 2.677361011505127 (2.677361011505127) | > loss_kl: 5.099955081939697 (5.099955081939697) | > loss_feat: 8.107970237731934 (8.107970237731934) | > loss_mel: 22.966699600219727 (22.966699600219727) | > loss_duration: 3.392690420150757 (3.392690420150757) | > loss_1: 42.24467468261719 (42.24467468261719)  --> STEP: 2 | > loss_disc: 2.840574026107788 (3.4291657209396362) | > loss_disc_real_0: 0.18330393731594086 (0.4399701878428459) | > loss_disc_real_1: 0.26428279280662537 (0.32111918926239014) | > loss_disc_real_2: 0.25429245829582214 (0.3009539395570755) | > loss_disc_real_3: 0.26418545842170715 (0.32189568877220154) | > loss_disc_real_4: 0.26817020773887634 (0.31872808933258057) | > loss_disc_real_5: 0.23598971962928772 (0.4493474215269089) | > loss_0: 2.840574026107788 (3.4291657209396362) | > loss_gen: 1.6661343574523926 (2.1717476844787598) | > loss_kl: 5.84993839263916 (5.474946737289429) | > loss_feat: 0.6596647500991821 (4.383817493915558) | > loss_mel: 15.356279373168945 (19.161489486694336) | > loss_duration: 3.2881276607513428 (3.34040904045105) | > loss_1: 26.820144653320312 (34.53240966796875)  --> STEP: 3 | > loss_disc: 2.7221221923828125 (3.1934845447540283) | > loss_disc_real_0: 0.25642478466033936 (0.3787883867820104) | > loss_disc_real_1: 0.3303537368774414 (0.32419737180074054) | > loss_disc_real_2: 0.26173967123031616 (0.2878825167814891) | > loss_disc_real_3: 0.40591728687286377 (0.34990288813908893) | > loss_disc_real_4: 0.30260637402534485 (0.31335418423016864) | > loss_disc_real_5: 0.3089371621608734 (0.4025440017382304) | > loss_0: 2.7221221923828125 (3.1934845447540283) | > loss_gen: 2.5765252113342285 (2.306673526763916) | > loss_kl: 3.088843822479248 (4.679579099019368) | > loss_feat: 4.361724853515625 (4.376453280448914) | > loss_mel: 20.293603897094727 (19.5388609568278) | > loss_duration: 3.04020619392395 (3.2403414249420166) | > loss_1: 33.360904693603516 (34.14190800984701) --> EVAL PERFORMANCE | > avg_loader_time: 0.03387125333150228 (+0.022445360819498703) | > avg_loss_disc: 3.1934845447540283 (+0.6325018803278604) | > avg_loss_disc_real_0: 0.3787883867820104 (+0.14843433101971942) | > avg_loss_disc_real_1: 0.32419737180074054 (+0.03397011260191596) | > avg_loss_disc_real_2: 0.2878825167814891 (+0.03150339921315515) | > avg_loss_disc_real_3: 0.34990288813908893 (+0.09627007941404975) | > avg_loss_disc_real_4: 0.31335418423016864 (+0.05563931167125702) | > avg_loss_disc_real_5: 0.4025440017382304 (+0.15715768188238147) | > avg_loss_0: 3.1934845447540283 (+0.6325018803278604) | > avg_loss_gen: 2.306673526763916 (+0.018174250920613755) | > avg_loss_kl: 4.679579099019368 (-0.01636091868082712) | > avg_loss_feat: 4.376453280448914 (-0.022818289697170258) | > avg_loss_mel: 19.5388609568278 (+3.861266454060873) | > avg_loss_duration: 3.2403414249420166 (+0.03655680020650243) | > avg_loss_1: 34.14190800984701 (+3.876818974812828)  > EPOCH: 1130/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:14:41)   --> TIME: 2023-10-20 14:14:59 -- STEP: 29/50 -- GLOBAL_STEP: 109530 | > loss_disc: 2.583958864212036 (2.4400030004567115) | > loss_disc_real_0: 0.12120278179645538 (0.12404374190574065) | > loss_disc_real_1: 0.22127601504325867 (0.22202883391030903) | > loss_disc_real_2: 0.19882060587406158 (0.22487318438702616) | > loss_disc_real_3: 0.21341143548488617 (0.24922045416616154) | > loss_disc_real_4: 0.24881963431835175 (0.23279741297251194) | > loss_disc_real_5: 0.273260235786438 (0.20220049355050612) | > loss_0: 2.583958864212036 (2.4400030004567115) | > grad_norm_0: tensor(977.9578, device='cuda:0') (tensor(978.0076, device='cuda:0')) | > loss_gen: 1.8898038864135742 (2.311819771240497) | > loss_kl: 0.5242969393730164 (0.9174379233656258) | > loss_feat: 1.9061729907989502 (6.220850204085481) | > loss_mel: 16.721725463867188 (21.3336272486325) | > loss_duration: 1.328432559967041 (1.3284498905313427) | > loss_1: 22.370431900024414 (32.11218514935724) | > grad_norm_1: tensor(10228.2725, device='cuda:0') (tensor(44225.4258, device='cuda:0')) | > current_lr_0: 6.460208822055554e-05 | > current_lr_1: 6.460208822055554e-05 | > step_time: 0.3458 (0.44315071763663455) | > loader_time: 0.0096 (0.008545423376149145)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4371137619018555 (2.4371137619018555) | > loss_disc_real_0: 0.08442951738834381 (0.08442951738834381) | > loss_disc_real_1: 0.19018414616584778 (0.19018414616584778) | > loss_disc_real_2: 0.23213499784469604 (0.23213499784469604) | > loss_disc_real_3: 0.2401503473520279 (0.2401503473520279) | > loss_disc_real_4: 0.23680329322814941 (0.23680329322814941) | > loss_disc_real_5: 0.3107645511627197 (0.3107645511627197) | > loss_0: 2.4371137619018555 (2.4371137619018555) | > loss_gen: 2.115098476409912 (2.115098476409912) | > loss_kl: 5.819969654083252 (5.819969654083252) | > loss_feat: 4.5289387702941895 (4.5289387702941895) | > loss_mel: 22.715618133544922 (22.715618133544922) | > loss_duration: 3.014277458190918 (3.014277458190918) | > loss_1: 38.19390106201172 (38.19390106201172)  --> STEP: 1 | > loss_disc: 2.817805051803589 (2.817805051803589) | > loss_disc_real_0: 0.44169890880584717 (0.44169890880584717) | > loss_disc_real_1: 0.2677604854106903 (0.2677604854106903) | > loss_disc_real_2: 0.28031474351882935 (0.28031474351882935) | > loss_disc_real_3: 0.21586817502975464 (0.21586817502975464) | > loss_disc_real_4: 0.24547640979290009 (0.24547640979290009) | > loss_disc_real_5: 0.24769476056098938 (0.24769476056098938) | > loss_0: 2.817805051803589 (2.817805051803589) | > loss_gen: 2.2941653728485107 (2.2941653728485107) | > loss_kl: 5.364718914031982 (5.364718914031982) | > loss_feat: 3.5360703468322754 (3.5360703468322754) | > loss_mel: 19.57451820373535 (19.57451820373535) | > loss_duration: 3.2934038639068604 (3.2934038639068604) | > loss_1: 34.0628776550293 (34.0628776550293)  --> STEP: 2 | > loss_disc: 3.449002742767334 (3.1334038972854614) | > loss_disc_real_0: 0.830443799495697 (0.6360713541507721) | > loss_disc_real_1: 0.33762404322624207 (0.3026922643184662) | > loss_disc_real_2: 0.2232954502105713 (0.2518050968647003) | > loss_disc_real_3: 0.37316685914993286 (0.29451751708984375) | > loss_disc_real_4: 0.2889450788497925 (0.2672107443213463) | > loss_disc_real_5: 0.3349847197532654 (0.2913397401571274) | > loss_0: 3.449002742767334 (3.1334038972854614) | > loss_gen: 2.5211429595947266 (2.4076541662216187) | > loss_kl: 5.872500419616699 (5.618609666824341) | > loss_feat: 5.093111991882324 (4.3145911693573) | > loss_mel: 32.57453918457031 (26.074528694152832) | > loss_duration: 3.218766212463379 (3.2560850381851196) | > loss_1: 49.280059814453125 (41.67146873474121)  --> STEP: 3 | > loss_disc: 2.334380626678467 (2.86706280708313) | > loss_disc_real_0: 0.2290637344121933 (0.5004021475712458) | > loss_disc_real_1: 0.18431296944618225 (0.2632324993610382) | > loss_disc_real_2: 0.1383996158838272 (0.21400326987107596) | > loss_disc_real_3: 0.3199215829372406 (0.302985539038976) | > loss_disc_real_4: 0.21540005505084991 (0.24994051456451416) | > loss_disc_real_5: 0.19837325811386108 (0.26035091280937195) | > loss_0: 2.334380626678467 (2.86706280708313) | > loss_gen: 2.3261024951934814 (2.3804702758789062) | > loss_kl: 2.76747727394104 (4.668232202529907) | > loss_feat: 5.86532735824585 (4.831503232320149) | > loss_mel: 22.977832794189453 (25.04229672749837) | > loss_duration: 2.9839987754821777 (3.165389617284139) | > loss_1: 36.920738220214844 (40.08789189656576) --> EVAL PERFORMANCE | > avg_loader_time: 0.011356830596923828 (-0.022514422734578453) | > avg_loss_disc: 2.86706280708313 (-0.32642173767089844) | > avg_loss_disc_real_0: 0.5004021475712458 (+0.12161376078923541) | > avg_loss_disc_real_1: 0.2632324993610382 (-0.06096487243970233) | > avg_loss_disc_real_2: 0.21400326987107596 (-0.07387924691041312) | > avg_loss_disc_real_3: 0.302985539038976 (-0.046917349100112915) | > avg_loss_disc_real_4: 0.24994051456451416 (-0.06341366966565448) | > avg_loss_disc_real_5: 0.26035091280937195 (-0.14219308892885846) | > avg_loss_0: 2.86706280708313 (-0.32642173767089844) | > avg_loss_gen: 2.3804702758789062 (+0.07379674911499023) | > avg_loss_kl: 4.668232202529907 (-0.011346896489460967) | > avg_loss_feat: 4.831503232320149 (+0.45504995187123587) | > avg_loss_mel: 25.04229672749837 (+5.5034357706705705) | > avg_loss_duration: 3.165389617284139 (-0.07495180765787746) | > avg_loss_1: 40.08789189656576 (+5.94598388671875)  > EPOCH: 1131/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:15:31)   --> TIME: 2023-10-20 14:15:42 -- STEP: 9/50 -- GLOBAL_STEP: 109560 | > loss_disc: 2.785327434539795 (2.6598553392622204) | > loss_disc_real_0: 0.10415836423635483 (0.14973395193616548) | > loss_disc_real_1: 0.16919590532779694 (0.25979624026351505) | > loss_disc_real_2: 0.23218868672847748 (0.28766051928202313) | > loss_disc_real_3: 0.3228920102119446 (0.23084943989912668) | > loss_disc_real_4: 0.3659830093383789 (0.2968351211812761) | > loss_disc_real_5: 0.2739517390727997 (0.2567202432288064) | > loss_0: 2.785327434539795 (2.6598553392622204) | > grad_norm_0: tensor(722.5244, device='cuda:0') (tensor(1711.7429, device='cuda:0')) | > loss_gen: 2.116044759750366 (2.232487055990431) | > loss_kl: 0.6435619592666626 (0.7978577812512716) | > loss_feat: 6.092169284820557 (4.497431649102105) | > loss_mel: 21.494997024536133 (18.639941665861343) | > loss_duration: 1.296741008758545 (1.377973477045695) | > loss_1: 31.64351463317871 (27.545691543155247) | > grad_norm_1: tensor(24904.9785, device='cuda:0') (tensor(26069.6855, device='cuda:0')) | > current_lr_0: 6.453751438868382e-05 | > current_lr_1: 6.453751438868382e-05 | > step_time: 0.8377 (0.6269156403011746) | > loader_time: 0.0344 (0.024065944883558486)  --> TIME: 2023-10-20 14:16:01 -- STEP: 39/50 -- GLOBAL_STEP: 109590 | > loss_disc: 2.810396432876587 (2.4383993882399335) | > loss_disc_real_0: 0.32295385003089905 (0.13234140072017908) | > loss_disc_real_1: 0.2904691994190216 (0.2398471780694448) | > loss_disc_real_2: 0.22379045188426971 (0.23185571560110801) | > loss_disc_real_3: 0.2977243661880493 (0.22764270843412632) | > loss_disc_real_4: 0.24745719134807587 (0.22659068272855037) | > loss_disc_real_5: 0.23335421085357666 (0.24190465022976965) | > loss_0: 2.810396432876587 (2.4383993882399335) | > grad_norm_0: tensor(1513.3624, device='cuda:0') (tensor(1266.9670, device='cuda:0')) | > loss_gen: 1.9176204204559326 (2.3728843988516393) | > loss_kl: 0.285468190908432 (0.721832519158339) | > loss_feat: 1.2652111053466797 (5.888687231601813) | > loss_mel: 16.944705963134766 (21.556586791307502) | > loss_duration: 1.4407967329025269 (1.3375450770060222) | > loss_1: 21.853801727294922 (31.877535966726455) | > grad_norm_1: tensor(7224.0190, device='cuda:0') (tensor(32646.0039, device='cuda:0')) | > current_lr_0: 6.453751438868382e-05 | > current_lr_1: 6.453751438868382e-05 | > step_time: 0.5434 (0.6130792850103134) | > loader_time: 0.0098 (0.02141847977271447)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9656050205230713 (2.9656050205230713) | > loss_disc_real_0: 0.26597288250923157 (0.26597288250923157) | > loss_disc_real_1: 0.2517634928226471 (0.2517634928226471) | > loss_disc_real_2: 0.26016661524772644 (0.26016661524772644) | > loss_disc_real_3: 0.26365330815315247 (0.26365330815315247) | > loss_disc_real_4: 0.24960781633853912 (0.24960781633853912) | > loss_disc_real_5: 0.2537055015563965 (0.2537055015563965) | > loss_0: 2.9656050205230713 (2.9656050205230713) | > loss_gen: 1.5855799913406372 (1.5855799913406372) | > loss_kl: 5.4659247398376465 (5.4659247398376465) | > loss_feat: 0.08643155544996262 (0.08643155544996262) | > loss_mel: 6.034682750701904 (6.034682750701904) | > loss_duration: 3.021829843521118 (3.021829843521118) | > loss_1: 16.194448471069336 (16.194448471069336)  --> STEP: 1 | > loss_disc: 2.5713000297546387 (2.5713000297546387) | > loss_disc_real_0: 0.03290148451924324 (0.03290148451924324) | > loss_disc_real_1: 0.2186499983072281 (0.2186499983072281) | > loss_disc_real_2: 0.27189549803733826 (0.27189549803733826) | > loss_disc_real_3: 0.2521483302116394 (0.2521483302116394) | > loss_disc_real_4: 0.23009760677814484 (0.23009760677814484) | > loss_disc_real_5: 0.4058968126773834 (0.4058968126773834) | > loss_0: 2.5713000297546387 (2.5713000297546387) | > loss_gen: 2.1385037899017334 (2.1385037899017334) | > loss_kl: 5.444037437438965 (5.444037437438965) | > loss_feat: 5.075263023376465 (5.075263023376465) | > loss_mel: 23.77987289428711 (23.77987289428711) | > loss_duration: 3.3331122398376465 (3.3331122398376465) | > loss_1: 39.77078628540039 (39.77078628540039)  --> STEP: 2 | > loss_disc: 2.9914162158966064 (2.7813581228256226) | > loss_disc_real_0: 0.2567206025123596 (0.14481104351580143) | > loss_disc_real_1: 0.2517002820968628 (0.23517514020204544) | > loss_disc_real_2: 0.26001110672950745 (0.26595330238342285) | > loss_disc_real_3: 0.2634899914264679 (0.25781916081905365) | > loss_disc_real_4: 0.24944695830345154 (0.2397722825407982) | > loss_disc_real_5: 0.253818541765213 (0.3298576772212982) | > loss_0: 2.9914162158966064 (2.7813581228256226) | > loss_gen: 1.5453357696533203 (1.8419197797775269) | > loss_kl: 6.005216121673584 (5.724626779556274) | > loss_feat: 0.026053471490740776 (2.550658247433603) | > loss_mel: 1.4227652549743652 (12.601319074630737) | > loss_duration: 3.1705243587493896 (3.251818299293518) | > loss_1: 12.16989517211914 (25.970340728759766)  --> STEP: 3 | > loss_disc: 2.9909446239471436 (2.8512202898661294) | > loss_disc_real_0: 0.25677210092544556 (0.18213139598568281) | > loss_disc_real_1: 0.2517346441745758 (0.24069497485955557) | > loss_disc_real_2: 0.2599235475063324 (0.2639433840910594) | > loss_disc_real_3: 0.263577401638031 (0.25973857442537945) | > loss_disc_real_4: 0.24959716200828552 (0.24304724236329397) | > loss_disc_real_5: 0.25387001037597656 (0.30452845493952435) | > loss_0: 2.9909446239471436 (2.8512202898661294) | > loss_gen: 1.546083927154541 (1.7433078289031982) | > loss_kl: 2.7259418964385986 (4.725065151850383) | > loss_feat: 0.02724584937095642 (1.7095207814127207) | > loss_mel: 1.6000198125839233 (8.934219320615133) | > loss_duration: 2.979696750640869 (3.1611111164093018) | > loss_1: 8.878988265991211 (20.273223241170246) --> EVAL PERFORMANCE | > avg_loader_time: 0.02290479342142741 (+0.011547962824503582) | > avg_loss_disc: 2.8512202898661294 (-0.015842517217000474) | > avg_loss_disc_real_0: 0.18213139598568281 (-0.31827075158556295) | > avg_loss_disc_real_1: 0.24069497485955557 (-0.022537524501482636) | > avg_loss_disc_real_2: 0.2639433840910594 (+0.04994011421998343) | > avg_loss_disc_real_3: 0.25973857442537945 (-0.04324696461359656) | > avg_loss_disc_real_4: 0.24304724236329397 (-0.006893272201220185) | > avg_loss_disc_real_5: 0.30452845493952435 (+0.0441775421301524) | > avg_loss_0: 2.8512202898661294 (-0.015842517217000474) | > avg_loss_gen: 1.7433078289031982 (-0.637162446975708) | > avg_loss_kl: 4.725065151850383 (+0.056832949320475556) | > avg_loss_feat: 1.7095207814127207 (-3.1219824509074288) | > avg_loss_mel: 8.934219320615133 (-16.10807740688324) | > avg_loss_duration: 3.1611111164093018 (-0.004278500874837388) | > avg_loss_1: 20.273223241170246 (-19.81466865539551)  > EPOCH: 1132/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:16:23)   --> TIME: 2023-10-20 14:16:37 -- STEP: 19/50 -- GLOBAL_STEP: 109620 | > loss_disc: 1.4417204856872559 (2.2573690728137366) | > loss_disc_real_0: 0.0733221024274826 (0.12904893106927998) | > loss_disc_real_1: 0.161655992269516 (0.21072168609029368) | > loss_disc_real_2: 0.12234184890985489 (0.2200921052380612) | > loss_disc_real_3: 0.12904763221740723 (0.22285050192945882) | > loss_disc_real_4: 0.08087717741727829 (0.1971141258744817) | > loss_disc_real_5: 0.09453437477350235 (0.17900309799925276) | > loss_0: 1.4417204856872559 (2.2573690728137366) | > grad_norm_0: tensor(553.5306, device='cuda:0') (tensor(1024.4558, device='cuda:0')) | > loss_gen: 3.0525593757629395 (2.4568637923190466) | > loss_kl: 1.022814154624939 (0.8568773732863759) | > loss_feat: 7.520391464233398 (6.776327245721691) | > loss_mel: 24.742916107177734 (21.55388421761362) | > loss_duration: 1.4091031551361084 (1.3546193775377775) | > loss_1: 37.74778366088867 (32.998572173871494) | > grad_norm_1: tensor(14088.1123, device='cuda:0') (tensor(49375.5547, device='cuda:0')) | > current_lr_0: 6.447300510239998e-05 | > current_lr_1: 6.447300510239998e-05 | > step_time: 0.2586 (0.477748808107878) | > loader_time: 0.0076 (0.011150422849153218)  --> TIME: 2023-10-20 14:16:49 -- STEP: 49/50 -- GLOBAL_STEP: 109650 | > loss_disc: 2.753974676132202 (2.375264109397419) | > loss_disc_real_0: 0.11976100504398346 (0.1400681883096695) | > loss_disc_real_1: 0.28761592507362366 (0.2233314397079604) | > loss_disc_real_2: 0.23239058256149292 (0.22287786067748555) | > loss_disc_real_3: 0.3871166706085205 (0.2264054831193418) | > loss_disc_real_4: 0.2909040153026581 (0.21059297587798567) | > loss_disc_real_5: 0.3133980333805084 (0.21358765828974394) | > loss_0: 2.753974676132202 (2.375264109397419) | > grad_norm_0: tensor(1072.3705, device='cuda:0') (tensor(1209.4913, device='cuda:0')) | > loss_gen: 2.2431211471557617 (2.3265370641435896) | > loss_kl: 0.678377091884613 (0.8367758145631881) | > loss_feat: 2.397749900817871 (5.937325693666935) | > loss_mel: 19.855693817138672 (20.613543345003713) | > loss_duration: 1.4373213052749634 (1.3324200036574383) | > loss_1: 26.612262725830078 (31.04660177230836) | > grad_norm_1: tensor(9870.0010, device='cuda:0') (tensor(34236.3125, device='cuda:0')) | > current_lr_0: 6.447300510239998e-05 | > current_lr_1: 6.447300510239998e-05 | > step_time: 0.5914 (0.4184193416517608) | > loader_time: 0.5366 (0.019487419906927615)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.888977289199829 (2.888977289199829) | > loss_disc_real_0: 0.10471846163272858 (0.10471846163272858) | > loss_disc_real_1: 0.2751626968383789 (0.2751626968383789) | > loss_disc_real_2: 0.23246562480926514 (0.23246562480926514) | > loss_disc_real_3: 0.2704184055328369 (0.2704184055328369) | > loss_disc_real_4: 0.24924127757549286 (0.24924127757549286) | > loss_disc_real_5: 0.29339537024497986 (0.29339537024497986) | > loss_0: 2.888977289199829 (2.888977289199829) | > loss_gen: 1.5478501319885254 (1.5478501319885254) | > loss_kl: 5.956629276275635 (5.956629276275635) | > loss_feat: 0.3598925769329071 (0.3598925769329071) | > loss_mel: 13.72225284576416 (13.72225284576416) | > loss_duration: 3.03684663772583 (3.03684663772583) | > loss_1: 24.623470306396484 (24.623470306396484)  --> STEP: 1 | > loss_disc: 3.3120830059051514 (3.3120830059051514) | > loss_disc_real_0: 0.7634637355804443 (0.7634637355804443) | > loss_disc_real_1: 0.2807080149650574 (0.2807080149650574) | > loss_disc_real_2: 0.2903333008289337 (0.2903333008289337) | > loss_disc_real_3: 0.1834651231765747 (0.1834651231765747) | > loss_disc_real_4: 0.38289928436279297 (0.38289928436279297) | > loss_disc_real_5: 0.260154664516449 (0.260154664516449) | > loss_0: 3.3120830059051514 (3.3120830059051514) | > loss_gen: 2.953667640686035 (2.953667640686035) | > loss_kl: 5.65737771987915 (5.65737771987915) | > loss_feat: 6.15510368347168 (6.15510368347168) | > loss_mel: 22.446094512939453 (22.446094512939453) | > loss_duration: 3.2544193267822266 (3.2544193267822266) | > loss_1: 40.46665954589844 (40.46665954589844)  --> STEP: 2 | > loss_disc: 3.0146336555480957 (3.1633583307266235) | > loss_disc_real_0: 0.6848083734512329 (0.7241360545158386) | > loss_disc_real_1: 0.2659686207771301 (0.27333831787109375) | > loss_disc_real_2: 0.2566676437854767 (0.2735004723072052) | > loss_disc_real_3: 0.33558782935142517 (0.25952647626399994) | > loss_disc_real_4: 0.20174327492713928 (0.2923212796449661) | > loss_disc_real_5: 0.3287345767021179 (0.29444462060928345) | > loss_0: 3.0146336555480957 (3.1633583307266235) | > loss_gen: 2.6378238201141357 (2.7957457304000854) | > loss_kl: 6.0190019607543945 (5.8381898403167725) | > loss_feat: 5.558172225952148 (5.856637954711914) | > loss_mel: 26.138965606689453 (24.292530059814453) | > loss_duration: 3.1232402324676514 (3.188829779624939) | > loss_1: 43.47720718383789 (41.971933364868164)  --> STEP: 3 | > loss_disc: 3.13150691986084 (3.1527411937713623) | > loss_disc_real_0: 0.4684334099292755 (0.6389018396536509) | > loss_disc_real_1: 0.31936872005462646 (0.2886817852656047) | > loss_disc_real_2: 0.2747417390346527 (0.27391422788302106) | > loss_disc_real_3: 0.28545942902565 (0.2681707938512166) | > loss_disc_real_4: 0.33026188611984253 (0.3049681484699249) | > loss_disc_real_5: 0.32702577114105225 (0.30530500411987305) | > loss_0: 3.13150691986084 (3.1527411937713623) | > loss_gen: 2.037688732147217 (2.543060064315796) | > loss_kl: 3.024099588394165 (4.90015975634257) | > loss_feat: 2.1705400943756104 (4.6279386679331465) | > loss_mel: 17.70482635498047 (22.096628824869793) | > loss_duration: 2.929892063140869 (3.1025172074635825) | > loss_1: 27.867046356201172 (37.270304361979164) --> EVAL PERFORMANCE | > avg_loader_time: 0.016065120697021484 (-0.006839672724405926) | > avg_loss_disc: 3.1527411937713623 (+0.3015209039052329) | > avg_loss_disc_real_0: 0.6389018396536509 (+0.45677044366796804) | > avg_loss_disc_real_1: 0.2886817852656047 (+0.0479868104060491) | > avg_loss_disc_real_2: 0.27391422788302106 (+0.00997084379196167) | > avg_loss_disc_real_3: 0.2681707938512166 (+0.008432219425837162) | > avg_loss_disc_real_4: 0.3049681484699249 (+0.06192090610663095) | > avg_loss_disc_real_5: 0.30530500411987305 (+0.0007765491803486957) | > avg_loss_0: 3.1527411937713623 (+0.3015209039052329) | > avg_loss_gen: 2.543060064315796 (+0.7997522354125977) | > avg_loss_kl: 4.90015975634257 (+0.1750946044921875) | > avg_loss_feat: 4.6279386679331465 (+2.9184178865204258) | > avg_loss_mel: 22.096628824869793 (+13.16240950425466) | > avg_loss_duration: 3.1025172074635825 (-0.05859390894571925) | > avg_loss_1: 37.270304361979164 (+16.997081120808918)  > EPOCH: 1133/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:17:07)   --> TIME: 2023-10-20 14:17:31 -- STEP: 29/50 -- GLOBAL_STEP: 109680 | > loss_disc: 2.7249882221221924 (2.385240365718972) | > loss_disc_real_0: 0.15075477957725525 (0.1345827270234967) | > loss_disc_real_1: 0.21468760073184967 (0.21137613225085983) | > loss_disc_real_2: 0.2529982030391693 (0.21982428534277554) | > loss_disc_real_3: 0.284879595041275 (0.23412297653227016) | > loss_disc_real_4: 0.32648658752441406 (0.2552665342287771) | > loss_disc_real_5: 0.34276455640792847 (0.22587300040598574) | > loss_0: 2.7249882221221924 (2.385240365718972) | > grad_norm_0: tensor(1174.8826, device='cuda:0') (tensor(1024.2191, device='cuda:0')) | > loss_gen: 2.1972012519836426 (2.3523783848203452) | > loss_kl: 0.7757163643836975 (0.7953235419659779) | > loss_feat: 2.969528913497925 (5.860521164176793) | > loss_mel: 19.608287811279297 (19.85164579851874) | > loss_duration: 1.3150413036346436 (1.3244418399087314) | > loss_1: 26.865774154663086 (30.18431094597126) | > grad_norm_1: tensor(5272.4756, device='cuda:0') (tensor(34972.2695, device='cuda:0')) | > current_lr_0: 6.440856029718666e-05 | > current_lr_1: 6.440856029718666e-05 | > step_time: 0.8391 (0.6380048784716376) | > loader_time: 0.0279 (0.02367382213987153)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.211538791656494 (2.211538791656494) | > loss_disc_real_0: 0.020190590992569923 (0.020190590992569923) | > loss_disc_real_1: 0.33915823698043823 (0.33915823698043823) | > loss_disc_real_2: 0.23152735829353333 (0.23152735829353333) | > loss_disc_real_3: 0.24413809180259705 (0.24413809180259705) | > loss_disc_real_4: 0.189290851354599 (0.189290851354599) | > loss_disc_real_5: 0.07927481830120087 (0.07927481830120087) | > loss_0: 2.211538791656494 (2.211538791656494) | > loss_gen: 2.5914340019226074 (2.5914340019226074) | > loss_kl: 5.7901291847229 (5.7901291847229) | > loss_feat: 10.197647094726562 (10.197647094726562) | > loss_mel: 22.147174835205078 (22.147174835205078) | > loss_duration: 3.009154796600342 (3.009154796600342) | > loss_1: 43.735538482666016 (43.735538482666016)  --> STEP: 1 | > loss_disc: 2.6701672077178955 (2.6701672077178955) | > loss_disc_real_0: 0.3748650550842285 (0.3748650550842285) | > loss_disc_real_1: 0.34976479411125183 (0.34976479411125183) | > loss_disc_real_2: 0.30931371450424194 (0.30931371450424194) | > loss_disc_real_3: 0.29052871465682983 (0.29052871465682983) | > loss_disc_real_4: 0.32721731066703796 (0.32721731066703796) | > loss_disc_real_5: 0.27437901496887207 (0.27437901496887207) | > loss_0: 2.6701672077178955 (2.6701672077178955) | > loss_gen: 3.3510262966156006 (3.3510262966156006) | > loss_kl: 6.180915832519531 (6.180915832519531) | > loss_feat: 8.156355857849121 (8.156355857849121) | > loss_mel: 21.309253692626953 (21.309253692626953) | > loss_duration: 3.3732481002807617 (3.3732481002807617) | > loss_1: 42.37080001831055 (42.37080001831055)  --> STEP: 2 | > loss_disc: 1.9093873500823975 (2.2897772789001465) | > loss_disc_real_0: 0.17325104773044586 (0.2740580514073372) | > loss_disc_real_1: 0.06579511612653732 (0.20777995511889458) | > loss_disc_real_2: 0.1075458973646164 (0.20842980593442917) | > loss_disc_real_3: 0.153898224234581 (0.2222134694457054) | > loss_disc_real_4: 0.13286614418029785 (0.2300417274236679) | > loss_disc_real_5: 0.06105853617191315 (0.1677187755703926) | > loss_0: 1.9093873500823975 (2.2897772789001465) | > loss_gen: 2.1443331241607666 (2.7476797103881836) | > loss_kl: 6.193726062774658 (6.187320947647095) | > loss_feat: 12.702016830444336 (10.429186344146729) | > loss_mel: 24.346752166748047 (22.8280029296875) | > loss_duration: 3.1427221298217773 (3.2579851150512695) | > loss_1: 48.52954864501953 (45.45017433166504)  --> STEP: 3 | > loss_disc: 2.586787223815918 (2.3887805938720703) | > loss_disc_real_0: 0.2841615378856659 (0.2774258802334468) | > loss_disc_real_1: 0.2073652148246765 (0.2076417083541552) | > loss_disc_real_2: 0.19810661673545837 (0.20498874286810556) | > loss_disc_real_3: 0.19379884004592896 (0.2127419263124466) | > loss_disc_real_4: 0.28551656007766724 (0.24853333830833435) | > loss_disc_real_5: 0.34871700406074524 (0.22805151840051016) | > loss_0: 2.586787223815918 (2.3887805938720703) | > loss_gen: 2.3878517150878906 (2.627737045288086) | > loss_kl: 3.0141477584838867 (5.129596551259358) | > loss_feat: 6.532832145690918 (9.130401611328125) | > loss_mel: 24.738750457763672 (23.46491877237956) | > loss_duration: 3.0330004692077637 (3.182990233103434) | > loss_1: 39.706581115722656 (43.53564325968424) --> EVAL PERFORMANCE | > avg_loader_time: 0.007212479909261067 (-0.008852640787760418) | > avg_loss_disc: 2.3887805938720703 (-0.763960599899292) | > avg_loss_disc_real_0: 0.2774258802334468 (-0.3614759594202041) | > avg_loss_disc_real_1: 0.2076417083541552 (-0.08104007691144946) | > avg_loss_disc_real_2: 0.20498874286810556 (-0.0689254850149155) | > avg_loss_disc_real_3: 0.2127419263124466 (-0.05542886753877002) | > avg_loss_disc_real_4: 0.24853333830833435 (-0.056434810161590576) | > avg_loss_disc_real_5: 0.22805151840051016 (-0.07725348571936289) | > avg_loss_0: 2.3887805938720703 (-0.763960599899292) | > avg_loss_gen: 2.627737045288086 (+0.08467698097229004) | > avg_loss_kl: 5.129596551259358 (+0.22943679491678814) | > avg_loss_feat: 9.130401611328125 (+4.5024629433949785) | > avg_loss_mel: 23.46491877237956 (+1.3682899475097656) | > avg_loss_duration: 3.182990233103434 (+0.08047302563985159) | > avg_loss_1: 43.53564325968424 (+6.265338897705078)  > EPOCH: 1134/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:18:00)   --> TIME: 2023-10-20 14:18:10 -- STEP: 9/50 -- GLOBAL_STEP: 109710 | > loss_disc: 2.48567533493042 (2.565195004145304) | > loss_disc_real_0: 0.1398085504770279 (0.1439466873804728) | > loss_disc_real_1: 0.22848573327064514 (0.25689560837215847) | > loss_disc_real_2: 0.3693968951702118 (0.24659453497992623) | > loss_disc_real_3: 0.28397950530052185 (0.21141364756557676) | > loss_disc_real_4: 0.23742495477199554 (0.23581810295581818) | > loss_disc_real_5: 0.26170453429222107 (0.25399109141694176) | > loss_0: 2.48567533493042 (2.565195004145304) | > grad_norm_0: tensor(806.0197, device='cuda:0') (tensor(1107.5426, device='cuda:0')) | > loss_gen: 2.429438352584839 (2.2245284451378717) | > loss_kl: 0.6489731669425964 (0.8364604512850443) | > loss_feat: 5.22885274887085 (4.656034909188747) | > loss_mel: 21.15706443786621 (17.737211492326523) | > loss_duration: 1.348177433013916 (1.3409720791710749) | > loss_1: 30.812503814697266 (26.795207235548233) | > grad_norm_1: tensor(9024.7500, device='cuda:0') (tensor(23338.4414, device='cuda:0')) | > current_lr_0: 6.434417990859101e-05 | > current_lr_1: 6.434417990859101e-05 | > step_time: 0.3099 (0.572920110490587) | > loader_time: 0.0074 (0.01267785496181912)  --> TIME: 2023-10-20 14:18:21 -- STEP: 39/50 -- GLOBAL_STEP: 109740 | > loss_disc: 2.9915409088134766 (2.540317413134453) | > loss_disc_real_0: 0.2804325819015503 (0.16151944676843974) | > loss_disc_real_1: 0.2503536343574524 (0.22393852061568162) | > loss_disc_real_2: 0.26553574204444885 (0.23737537669829833) | > loss_disc_real_3: 0.2572360932826996 (0.22930441806331658) | > loss_disc_real_4: 0.2459927648305893 (0.2289347461400888) | > loss_disc_real_5: 0.2518558204174042 (0.24612382283577552) | > loss_0: 2.9915409088134766 (2.540317413134453) | > grad_norm_0: tensor(4472.5645, device='cuda:0') (tensor(1385.9778, device='cuda:0')) | > loss_gen: 1.5204503536224365 (2.2082412212322917) | > loss_kl: 0.7171750664710999 (0.8170589850499079) | > loss_feat: 0.13233092427253723 (4.932271617918443) | > loss_mel: 1.8655858039855957 (18.952744031563782) | > loss_duration: 1.3594975471496582 (1.3153892297011156) | > loss_1: 5.5950398445129395 (28.225705036750206) | > grad_norm_1: tensor(44836.9883, device='cuda:0') (tensor(35580.4805, device='cuda:0')) | > current_lr_0: 6.434417990859101e-05 | > current_lr_1: 6.434417990859101e-05 | > step_time: 0.3209 (0.4047536544310741) | > loader_time: 0.0142 (0.008916396361130934)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.578242778778076 (2.578242778778076) | > loss_disc_real_0: 0.16472959518432617 (0.16472959518432617) | > loss_disc_real_1: 0.23880113661289215 (0.23880113661289215) | > loss_disc_real_2: 0.14729495346546173 (0.14729495346546173) | > loss_disc_real_3: 0.2791006565093994 (0.2791006565093994) | > loss_disc_real_4: 0.24908052384853363 (0.24908052384853363) | > loss_disc_real_5: 0.20114269852638245 (0.20114269852638245) | > loss_0: 2.578242778778076 (2.578242778778076) | > loss_gen: 1.8639200925827026 (1.8639200925827026) | > loss_kl: 5.520116329193115 (5.520116329193115) | > loss_feat: 2.519507884979248 (2.519507884979248) | > loss_mel: 19.850317001342773 (19.850317001342773) | > loss_duration: 2.9175636768341064 (2.9175636768341064) | > loss_1: 32.671424865722656 (32.671424865722656)  --> STEP: 1 | > loss_disc: 2.5573432445526123 (2.5573432445526123) | > loss_disc_real_0: 0.5567264556884766 (0.5567264556884766) | > loss_disc_real_1: 0.2794986069202423 (0.2794986069202423) | > loss_disc_real_2: 0.2842653691768646 (0.2842653691768646) | > loss_disc_real_3: 0.26980918645858765 (0.26980918645858765) | > loss_disc_real_4: 0.17180415987968445 (0.17180415987968445) | > loss_disc_real_5: 0.2611689567565918 (0.2611689567565918) | > loss_0: 2.5573432445526123 (2.5573432445526123) | > loss_gen: 2.9358160495758057 (2.9358160495758057) | > loss_kl: 5.267648696899414 (5.267648696899414) | > loss_feat: 6.011132717132568 (6.011132717132568) | > loss_mel: 24.89000129699707 (24.89000129699707) | > loss_duration: 3.368725299835205 (3.368725299835205) | > loss_1: 42.47332763671875 (42.47332763671875)  --> STEP: 2 | > loss_disc: 2.183177947998047 (2.3702605962753296) | > loss_disc_real_0: 0.42321255803108215 (0.48996950685977936) | > loss_disc_real_1: 0.17687557637691498 (0.22818709164857864) | > loss_disc_real_2: 0.1811830848455429 (0.23272422701120377) | > loss_disc_real_3: 0.24786582589149475 (0.2588375061750412) | > loss_disc_real_4: 0.1263742595911026 (0.14908920973539352) | > loss_disc_real_5: 0.07529332488775253 (0.16823114082217216) | > loss_0: 2.183177947998047 (2.3702605962753296) | > loss_gen: 3.6069304943084717 (3.2713732719421387) | > loss_kl: 5.6689300537109375 (5.468289375305176) | > loss_feat: 13.089814186096191 (9.55047345161438) | > loss_mel: 21.882183074951172 (23.38609218597412) | > loss_duration: 3.221022367477417 (3.294873833656311) | > loss_1: 47.46887969970703 (44.97110366821289)  --> STEP: 3 | > loss_disc: 2.8414673805236816 (2.5273295243581138) | > loss_disc_real_0: 0.13068069517612457 (0.3702065696318944) | > loss_disc_real_1: 0.24379543960094452 (0.23338987429936728) | > loss_disc_real_2: 0.27948257327079773 (0.24831034243106842) | > loss_disc_real_3: 0.28773993253707886 (0.2684716482957204) | > loss_disc_real_4: 0.23728260397911072 (0.1784870078166326) | > loss_disc_real_5: 0.25609537959098816 (0.1975192204117775) | > loss_0: 2.8414673805236816 (2.5273295243581138) | > loss_gen: 1.6037229299545288 (2.7154898246129355) | > loss_kl: 3.3048856258392334 (4.747154792149861) | > loss_feat: 0.6439923048019409 (6.5816464026769) | > loss_mel: 14.782234191894531 (20.518139521280926) | > loss_duration: 3.0191097259521484 (3.2029524644215903) | > loss_1: 23.353944778442383 (37.76538403828939) --> EVAL PERFORMANCE | > avg_loader_time: 0.007551272710164388 (+0.0003387928009033203) | > avg_loss_disc: 2.5273295243581138 (+0.13854893048604344) | > avg_loss_disc_real_0: 0.3702065696318944 (+0.09278068939844764) | > avg_loss_disc_real_1: 0.23338987429936728 (+0.025748165945212065) | > avg_loss_disc_real_2: 0.24831034243106842 (+0.04332159956296286) | > avg_loss_disc_real_3: 0.2684716482957204 (+0.055729721983273806) | > avg_loss_disc_real_4: 0.1784870078166326 (-0.07004633049170175) | > avg_loss_disc_real_5: 0.1975192204117775 (-0.030532297988732665) | > avg_loss_0: 2.5273295243581138 (+0.13854893048604344) | > avg_loss_gen: 2.7154898246129355 (+0.0877527793248496) | > avg_loss_kl: 4.747154792149861 (-0.38244175910949707) | > avg_loss_feat: 6.5816464026769 (-2.548755208651225) | > avg_loss_mel: 20.518139521280926 (-2.946779251098633) | > avg_loss_duration: 3.2029524644215903 (+0.01996223131815622) | > avg_loss_1: 37.76538403828939 (-5.770259221394852)  > EPOCH: 1135/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:18:41)   --> TIME: 2023-10-20 14:18:58 -- STEP: 19/50 -- GLOBAL_STEP: 109770 | > loss_disc: 2.5419394969940186 (2.460594503503097) | > loss_disc_real_0: 0.1907208263874054 (0.13196175638586283) | > loss_disc_real_1: 0.24744629859924316 (0.2380562189378236) | > loss_disc_real_2: 0.2504653334617615 (0.22026813089063293) | > loss_disc_real_3: 0.32057422399520874 (0.21999873103279816) | > loss_disc_real_4: 0.27050262689590454 (0.2280103776750988) | > loss_disc_real_5: 0.3083796799182892 (0.2270878702402115) | > loss_0: 2.5419394969940186 (2.460594503503097) | > grad_norm_0: tensor(1135.1754, device='cuda:0') (tensor(1557.4032, device='cuda:0')) | > loss_gen: 2.4676949977874756 (2.2996818956575895) | > loss_kl: 0.9215559959411621 (0.7593584280265006) | > loss_feat: 5.408020496368408 (6.010297155693958) | > loss_mel: 20.333539962768555 (21.74878448561618) | > loss_duration: 1.4485960006713867 (1.335523900232817) | > loss_1: 30.57940673828125 (32.15364518918489) | > grad_norm_1: tensor(19937.9395, device='cuda:0') (tensor(50661.3828, device='cuda:0')) | > current_lr_0: 6.427986387222457e-05 | > current_lr_1: 6.427986387222457e-05 | > step_time: 0.8253 (0.6257839830298173) | > loader_time: 0.017 (0.025012304908350894)  --> TIME: 2023-10-20 14:19:19 -- STEP: 49/50 -- GLOBAL_STEP: 109800 | > loss_disc: 2.181488037109375 (2.4346351063981335) | > loss_disc_real_0: 0.14438728988170624 (0.14372981098309465) | > loss_disc_real_1: 0.2597106099128723 (0.21738739539774096) | > loss_disc_real_2: 0.22617557644844055 (0.2167720092194421) | > loss_disc_real_3: 0.2897627353668213 (0.22657634827251338) | > loss_disc_real_4: 0.16393041610717773 (0.22534645157771147) | > loss_disc_real_5: 0.1601572185754776 (0.223873248741943) | > loss_0: 2.181488037109375 (2.4346351063981335) | > grad_norm_0: tensor(1466.7990, device='cuda:0') (tensor(1512.5194, device='cuda:0')) | > loss_gen: 2.478820562362671 (2.297917519296918) | > loss_kl: 0.3953489661216736 (0.7570948196308953) | > loss_feat: 4.93159294128418 (5.7255082496879055) | > loss_mel: 22.241470336914062 (20.667169848266912) | > loss_duration: 1.4617738723754883 (1.3184404008242543) | > loss_1: 31.50900650024414 (30.766130408462214) | > grad_norm_1: tensor(22073.1074, device='cuda:0') (tensor(45932.8398, device='cuda:0')) | > current_lr_0: 6.427986387222457e-05 | > current_lr_1: 6.427986387222457e-05 | > step_time: 0.5191 (0.6347406445717326) | > loader_time: 0.6973 (0.0402066707611084)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.949712038040161 (2.949712038040161) | > loss_disc_real_0: 0.21846361458301544 (0.21846361458301544) | > loss_disc_real_1: 0.34683606028556824 (0.34683606028556824) | > loss_disc_real_2: 0.2687031328678131 (0.2687031328678131) | > loss_disc_real_3: 0.509028434753418 (0.509028434753418) | > loss_disc_real_4: 0.4137484133243561 (0.4137484133243561) | > loss_disc_real_5: 0.42031529545783997 (0.42031529545783997) | > loss_0: 2.949712038040161 (2.949712038040161) | > loss_gen: 2.696394443511963 (2.696394443511963) | > loss_kl: 6.2444891929626465 (6.2444891929626465) | > loss_feat: 5.095233917236328 (5.095233917236328) | > loss_mel: 24.096464157104492 (24.096464157104492) | > loss_duration: 3.1626389026641846 (3.1626389026641846) | > loss_1: 41.295223236083984 (41.295223236083984)  --> STEP: 1 | > loss_disc: 2.4577882289886475 (2.4577882289886475) | > loss_disc_real_0: 0.3130037188529968 (0.3130037188529968) | > loss_disc_real_1: 0.28608864545822144 (0.28608864545822144) | > loss_disc_real_2: 0.21051788330078125 (0.21051788330078125) | > loss_disc_real_3: 0.36931756138801575 (0.36931756138801575) | > loss_disc_real_4: 0.24747394025325775 (0.24747394025325775) | > loss_disc_real_5: 0.3482097089290619 (0.3482097089290619) | > loss_0: 2.4577882289886475 (2.4577882289886475) | > loss_gen: 2.833364248275757 (2.833364248275757) | > loss_kl: 5.353848934173584 (5.353848934173584) | > loss_feat: 5.432241439819336 (5.432241439819336) | > loss_mel: 24.89421272277832 (24.89421272277832) | > loss_duration: 3.4935052394866943 (3.4935052394866943) | > loss_1: 42.007171630859375 (42.007171630859375)  --> STEP: 2 | > loss_disc: 2.9504473209381104 (2.704117774963379) | > loss_disc_real_0: 0.34280985593795776 (0.3279067873954773) | > loss_disc_real_1: 0.30143287777900696 (0.2937607616186142) | > loss_disc_real_2: 0.26780855655670166 (0.23916321992874146) | > loss_disc_real_3: 0.28385716676712036 (0.32658736407756805) | > loss_disc_real_4: 0.2490411251783371 (0.24825753271579742) | > loss_disc_real_5: 0.3302510976791382 (0.33923040330410004) | > loss_0: 2.9504473209381104 (2.704117774963379) | > loss_gen: 1.9782450199127197 (2.4058046340942383) | > loss_kl: 5.8078460693359375 (5.580847501754761) | > loss_feat: 0.461980402469635 (2.9471109211444855) | > loss_mel: 19.509611129760742 (22.20191192626953) | > loss_duration: 3.229109048843384 (3.361307144165039) | > loss_1: 30.986791610717773 (36.496981620788574)  --> STEP: 3 | > loss_disc: 2.2986674308776855 (2.568967660268148) | > loss_disc_real_0: 0.1634976863861084 (0.2731037537256877) | > loss_disc_real_1: 0.23532956838607788 (0.27428369720776874) | > loss_disc_real_2: 0.21409772336483002 (0.23080805440743765) | > loss_disc_real_3: 0.22944943606853485 (0.29420805474122363) | > loss_disc_real_4: 0.19152005016803741 (0.22934503853321075) | > loss_disc_real_5: 0.19471372663974762 (0.2910581777493159) | > loss_0: 2.2986674308776855 (2.568967660268148) | > loss_gen: 2.227020263671875 (2.3462098439534507) | > loss_kl: 2.6735055446624756 (4.611733516057332) | > loss_feat: 2.7757012844085693 (2.889974375565847) | > loss_mel: 18.637371063232422 (21.013731638590496) | > loss_duration: 3.0162079334259033 (3.2462740739186606) | > loss_1: 29.32980728149414 (34.10792350769043) --> EVAL PERFORMANCE | > avg_loader_time: 0.0032303333282470703 (-0.004320939381917317) | > avg_loss_disc: 2.568967660268148 (+0.04163813591003418) | > avg_loss_disc_real_0: 0.2731037537256877 (-0.09710281590620673) | > avg_loss_disc_real_1: 0.27428369720776874 (+0.04089382290840146) | > avg_loss_disc_real_2: 0.23080805440743765 (-0.01750228802363077) | > avg_loss_disc_real_3: 0.29420805474122363 (+0.025736406445503235) | > avg_loss_disc_real_4: 0.22934503853321075 (+0.050858030716578156) | > avg_loss_disc_real_5: 0.2910581777493159 (+0.09353895733753842) | > avg_loss_0: 2.568967660268148 (+0.04163813591003418) | > avg_loss_gen: 2.3462098439534507 (-0.36927998065948486) | > avg_loss_kl: 4.611733516057332 (-0.1354212760925293) | > avg_loss_feat: 2.889974375565847 (-3.691672027111053) | > avg_loss_mel: 21.013731638590496 (+0.4955921173095703) | > avg_loss_duration: 3.2462740739186606 (+0.04332160949707031) | > avg_loss_1: 34.10792350769043 (-3.6574605305989607)  > EPOCH: 1136/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:19:34)   --> TIME: 2023-10-20 14:19:58 -- STEP: 29/50 -- GLOBAL_STEP: 109830 | > loss_disc: 1.7264471054077148 (2.511514782905578) | > loss_disc_real_0: 0.08093301206827164 (0.15222210025992886) | > loss_disc_real_1: 0.16534064710140228 (0.2280188770643596) | > loss_disc_real_2: 0.2012382596731186 (0.2200775806759966) | > loss_disc_real_3: 0.11508782207965851 (0.2482775629594409) | > loss_disc_real_4: 0.35907435417175293 (0.25278433039784426) | > loss_disc_real_5: 0.1560448408126831 (0.24898797633319072) | > loss_0: 1.7264471054077148 (2.511514782905578) | > grad_norm_0: tensor(972.9598, device='cuda:0') (tensor(1186.3760, device='cuda:0')) | > loss_gen: 3.244271755218506 (2.3069397375501435) | > loss_kl: 0.7100993990898132 (0.791129537697496) | > loss_feat: 11.169977188110352 (5.889668965647962) | > loss_mel: 22.58867645263672 (21.7281079210084) | > loss_duration: 1.339099645614624 (1.3242013146137372) | > loss_1: 39.0521240234375 (32.040048056635364) | > grad_norm_1: tensor(143429.4844, device='cuda:0') (tensor(38403.4414, device='cuda:0')) | > current_lr_0: 6.421561212376325e-05 | > current_lr_1: 6.421561212376325e-05 | > step_time: 0.8345 (0.635714004779684) | > loader_time: 0.0312 (0.022974466455393826)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6061296463012695 (2.6061296463012695) | > loss_disc_real_0: 0.3309723436832428 (0.3309723436832428) | > loss_disc_real_1: 0.08537320792675018 (0.08537320792675018) | > loss_disc_real_2: 0.15508852899074554 (0.15508852899074554) | > loss_disc_real_3: 0.25948628783226013 (0.25948628783226013) | > loss_disc_real_4: 0.23259955644607544 (0.23259955644607544) | > loss_disc_real_5: 0.14779148995876312 (0.14779148995876312) | > loss_0: 2.6061296463012695 (2.6061296463012695) | > loss_gen: 2.5218822956085205 (2.5218822956085205) | > loss_kl: 5.905369281768799 (5.905369281768799) | > loss_feat: 10.4826021194458 (10.4826021194458) | > loss_mel: 23.311614990234375 (23.311614990234375) | > loss_duration: 3.173567771911621 (3.173567771911621) | > loss_1: 45.39503479003906 (45.39503479003906)  --> STEP: 1 | > loss_disc: 2.1247591972351074 (2.1247591972351074) | > loss_disc_real_0: 0.19499710202217102 (0.19499710202217102) | > loss_disc_real_1: 0.17566008865833282 (0.17566008865833282) | > loss_disc_real_2: 0.2214372307062149 (0.2214372307062149) | > loss_disc_real_3: 0.2755640149116516 (0.2755640149116516) | > loss_disc_real_4: 0.18925495445728302 (0.18925495445728302) | > loss_disc_real_5: 0.1655537337064743 (0.1655537337064743) | > loss_0: 2.1247591972351074 (2.1247591972351074) | > loss_gen: 2.5967133045196533 (2.5967133045196533) | > loss_kl: 5.7953901290893555 (5.7953901290893555) | > loss_feat: 8.549450874328613 (8.549450874328613) | > loss_mel: 22.334306716918945 (22.334306716918945) | > loss_duration: 3.5607264041900635 (3.5607264041900635) | > loss_1: 42.836585998535156 (42.836585998535156)  --> STEP: 2 | > loss_disc: 3.235072374343872 (2.6799157857894897) | > loss_disc_real_0: 0.2541995048522949 (0.22459830343723297) | > loss_disc_real_1: 0.13655002415180206 (0.15610505640506744) | > loss_disc_real_2: 0.2711225748062134 (0.24627990275621414) | > loss_disc_real_3: 0.3342115879058838 (0.3048878014087677) | > loss_disc_real_4: 0.37822383642196655 (0.2837393954396248) | > loss_disc_real_5: 0.3805593252182007 (0.2730565294623375) | > loss_0: 3.235072374343872 (2.6799157857894897) | > loss_gen: 1.8879826068878174 (2.2423479557037354) | > loss_kl: 5.478038311004639 (5.636714220046997) | > loss_feat: 8.722691535949707 (8.63607120513916) | > loss_mel: 21.1480770111084 (21.741191864013672) | > loss_duration: 3.3383102416992188 (3.449518322944641) | > loss_1: 40.57509994506836 (41.70584297180176)  --> STEP: 3 | > loss_disc: 2.9959301948547363 (2.785253922144572) | > loss_disc_real_0: 0.27402281761169434 (0.24107314149538675) | > loss_disc_real_1: 0.29696130752563477 (0.20305714011192322) | > loss_disc_real_2: 0.27821335196495056 (0.25692438582579297) | > loss_disc_real_3: 0.26432183384895325 (0.2913658122221629) | > loss_disc_real_4: 0.3081510365009308 (0.2918766091267268) | > loss_disc_real_5: 0.28430846333503723 (0.27680717408657074) | > loss_0: 2.9959301948547363 (2.785253922144572) | > loss_gen: 1.7312049865722656 (2.0719669659932456) | > loss_kl: 3.1947951316833496 (4.822741190592448) | > loss_feat: 0.10045750439167023 (5.7908666382233305) | > loss_mel: 2.020266056060791 (15.167549928029379) | > loss_duration: 3.255711078643799 (3.384915908177694) | > loss_1: 10.302434921264648 (31.238040288289387) --> EVAL PERFORMANCE | > avg_loader_time: 0.02989617983500163 (+0.02666584650675456) | > avg_loss_disc: 2.785253922144572 (+0.21628626187642386) | > avg_loss_disc_real_0: 0.24107314149538675 (-0.03203061223030093) | > avg_loss_disc_real_1: 0.20305714011192322 (-0.07122655709584552) | > avg_loss_disc_real_2: 0.25692438582579297 (+0.026116331418355315) | > avg_loss_disc_real_3: 0.2913658122221629 (-0.0028422425190607337) | > avg_loss_disc_real_4: 0.2918766091267268 (+0.06253157059351605) | > avg_loss_disc_real_5: 0.27680717408657074 (-0.014251003662745176) | > avg_loss_0: 2.785253922144572 (+0.21628626187642386) | > avg_loss_gen: 2.0719669659932456 (-0.2742428779602051) | > avg_loss_kl: 4.822741190592448 (+0.21100767453511615) | > avg_loss_feat: 5.7908666382233305 (+2.9008922626574836) | > avg_loss_mel: 15.167549928029379 (-5.846181710561117) | > avg_loss_duration: 3.384915908177694 (+0.1386418342590332) | > avg_loss_1: 31.238040288289387 (-2.869883219401043)  > EPOCH: 1137/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:20:25)   --> TIME: 2023-10-20 14:20:36 -- STEP: 9/50 -- GLOBAL_STEP: 109860 | > loss_disc: 2.733492851257324 (2.494574851459927) | > loss_disc_real_0: 0.3802364468574524 (0.11814445091618432) | > loss_disc_real_1: 0.21684487164020538 (0.2557497214939859) | > loss_disc_real_2: 0.37748274207115173 (0.25530536183052593) | > loss_disc_real_3: 0.34514713287353516 (0.25036971850527656) | > loss_disc_real_4: 0.3250091075897217 (0.24339398824506336) | > loss_disc_real_5: 0.3552399277687073 (0.2541876435279846) | > loss_0: 2.733492851257324 (2.494574851459927) | > grad_norm_0: tensor(1407.1609, device='cuda:0') (tensor(1689.3888, device='cuda:0')) | > loss_gen: 2.899580717086792 (2.4119753572675915) | > loss_kl: 0.49753180146217346 (0.736413546734386) | > loss_feat: 5.804988384246826 (6.36707970003287) | > loss_mel: 22.133577346801758 (20.215125640233357) | > loss_duration: 1.299058437347412 (1.3463315566380818) | > loss_1: 32.634735107421875 (31.076925383673775) | > grad_norm_1: tensor(6913.3081, device='cuda:0') (tensor(46095.9883, device='cuda:0')) | > current_lr_0: 6.415142459894729e-05 | > current_lr_1: 6.415142459894729e-05 | > step_time: 0.3419 (0.60390747918023) | > loader_time: 0.012 (0.020105732811821833)  --> TIME: 2023-10-20 14:20:47 -- STEP: 39/50 -- GLOBAL_STEP: 109890 | > loss_disc: 2.9903244972229004 (2.5127784594511366) | > loss_disc_real_0: 0.2619945704936981 (0.1497668951558761) | > loss_disc_real_1: 0.25694990158081055 (0.22613290219734877) | > loss_disc_real_2: 0.2477913796901703 (0.22958239015096274) | > loss_disc_real_3: 0.22046415507793427 (0.23738296826680502) | > loss_disc_real_4: 0.273014634847641 (0.2281081395653578) | > loss_disc_real_5: 0.25082966685295105 (0.2403859692888382) | > loss_0: 2.9903244972229004 (2.5127784594511366) | > grad_norm_0: tensor(2561.6072, device='cuda:0') (tensor(1293.8083, device='cuda:0')) | > loss_gen: 1.5262141227722168 (2.216616526628151) | > loss_kl: 0.5083015561103821 (0.7882138028358802) | > loss_feat: 0.15884290635585785 (5.263529334599391) | > loss_mel: 1.8348723649978638 (18.849139956327583) | > loss_duration: 1.3762977123260498 (1.3194040304575212) | > loss_1: 5.404528617858887 (28.43690377015334) | > grad_norm_1: tensor(36941.6445, device='cuda:0') (tensor(51497.7266, device='cuda:0')) | > current_lr_0: 6.415142459894729e-05 | > current_lr_1: 6.415142459894729e-05 | > step_time: 0.2545 (0.4179657483712221) | > loader_time: 0.0025 (0.008280925261668669)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8412184715270996 (2.8412184715270996) | > loss_disc_real_0: 0.3837692141532898 (0.3837692141532898) | > loss_disc_real_1: 0.22547270357608795 (0.22547270357608795) | > loss_disc_real_2: 0.3546067178249359 (0.3546067178249359) | > loss_disc_real_3: 0.19697070121765137 (0.19697070121765137) | > loss_disc_real_4: 0.3376965820789337 (0.3376965820789337) | > loss_disc_real_5: 0.4562169313430786 (0.4562169313430786) | > loss_0: 2.8412184715270996 (2.8412184715270996) | > loss_gen: 2.4937732219696045 (2.4937732219696045) | > loss_kl: 6.143532752990723 (6.143532752990723) | > loss_feat: 5.133866786956787 (5.133866786956787) | > loss_mel: 20.52965545654297 (20.52965545654297) | > loss_duration: 3.0522310733795166 (3.0522310733795166) | > loss_1: 37.353057861328125 (37.353057861328125)  --> STEP: 1 | > loss_disc: 2.546753406524658 (2.546753406524658) | > loss_disc_real_0: 0.10022974014282227 (0.10022974014282227) | > loss_disc_real_1: 0.3150753080844879 (0.3150753080844879) | > loss_disc_real_2: 0.1270897537469864 (0.1270897537469864) | > loss_disc_real_3: 0.2370566725730896 (0.2370566725730896) | > loss_disc_real_4: 0.5101683139801025 (0.5101683139801025) | > loss_disc_real_5: 0.4003729224205017 (0.4003729224205017) | > loss_0: 2.546753406524658 (2.546753406524658) | > loss_gen: 2.984903335571289 (2.984903335571289) | > loss_kl: 4.8548994064331055 (4.8548994064331055) | > loss_feat: 9.903007507324219 (9.903007507324219) | > loss_mel: 25.96963882446289 (25.96963882446289) | > loss_duration: 3.3476314544677734 (3.3476314544677734) | > loss_1: 47.060081481933594 (47.060081481933594)  --> STEP: 2 | > loss_disc: 2.2631115913391113 (2.4049324989318848) | > loss_disc_real_0: 0.08078194409608841 (0.09050584211945534) | > loss_disc_real_1: 0.18708305060863495 (0.25107917934656143) | > loss_disc_real_2: 0.2693479359149933 (0.19821884483098984) | > loss_disc_real_3: 0.21980972588062286 (0.22843319922685623) | > loss_disc_real_4: 0.1555730402469635 (0.332870677113533) | > loss_disc_real_5: 0.23544175922870636 (0.31790734082460403) | > loss_0: 2.2631115913391113 (2.4049324989318848) | > loss_gen: 2.2990167140960693 (2.641960024833679) | > loss_kl: 5.582085132598877 (5.218492269515991) | > loss_feat: 6.195920467376709 (8.049463987350464) | > loss_mel: 22.286779403686523 (24.128209114074707) | > loss_duration: 3.280580520629883 (3.314105987548828) | > loss_1: 39.644378662109375 (43.352230072021484)  --> STEP: 3 | > loss_disc: 3.0597269535064697 (2.623197317123413) | > loss_disc_real_0: 0.21997757256031036 (0.13366308559974036) | > loss_disc_real_1: 0.2981478273868561 (0.2667687286933263) | > loss_disc_real_2: 0.3073131740093231 (0.2345836212237676) | > loss_disc_real_3: 0.18313069641590118 (0.21333236495653787) | > loss_disc_real_4: 0.4681093394756317 (0.3779502312342326) | > loss_disc_real_5: 0.39476802945137024 (0.34352757036685944) | > loss_0: 3.0597269535064697 (2.623197317123413) | > loss_gen: 1.9567325115203857 (2.413550853729248) | > loss_kl: 2.90889835357666 (4.448627630869548) | > loss_feat: 4.156622886657715 (6.751850287119548) | > loss_mel: 23.16869354248047 (23.80837059020996) | > loss_duration: 3.1857030391693115 (3.2713050047556558) | > loss_1: 35.376651763916016 (40.693703969319664) --> EVAL PERFORMANCE | > avg_loader_time: 0.02339347203572591 (-0.0065027077992757185) | > avg_loss_disc: 2.623197317123413 (-0.1620566050211587) | > avg_loss_disc_real_0: 0.13366308559974036 (-0.1074100558956464) | > avg_loss_disc_real_1: 0.2667687286933263 (+0.06371158858140308) | > avg_loss_disc_real_2: 0.2345836212237676 (-0.02234076460202536) | > avg_loss_disc_real_3: 0.21333236495653787 (-0.07803344726562503) | > avg_loss_disc_real_4: 0.3779502312342326 (+0.0860736221075058) | > avg_loss_disc_real_5: 0.34352757036685944 (+0.0667203962802887) | > avg_loss_0: 2.623197317123413 (-0.1620566050211587) | > avg_loss_gen: 2.413550853729248 (+0.34158388773600246) | > avg_loss_kl: 4.448627630869548 (-0.3741135597229004) | > avg_loss_feat: 6.751850287119548 (+0.9609836488962173) | > avg_loss_mel: 23.80837059020996 (+8.640820662180582) | > avg_loss_duration: 3.2713050047556558 (-0.11361090342203806) | > avg_loss_1: 40.693703969319664 (+9.455663681030277)  > EPOCH: 1138/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:21:07)   --> TIME: 2023-10-20 14:21:27 -- STEP: 19/50 -- GLOBAL_STEP: 109920 | > loss_disc: 1.3190293312072754 (2.3992198015514172) | > loss_disc_real_0: 0.042817622423172 (0.1570490303106214) | > loss_disc_real_1: 0.08976273983716965 (0.23255630072794461) | > loss_disc_real_2: 0.12222226709127426 (0.22260332421252602) | > loss_disc_real_3: 0.18775656819343567 (0.2588353374678838) | > loss_disc_real_4: 0.03886738792061806 (0.20304253079781406) | > loss_disc_real_5: 0.08689836412668228 (0.1820477715840465) | > loss_0: 1.3190293312072754 (2.3992198015514172) | > grad_norm_0: tensor(1305.8352, device='cuda:0') (tensor(1275.7072, device='cuda:0')) | > loss_gen: 3.2127573490142822 (2.459706714278773) | > loss_kl: 1.1832407712936401 (0.9158975827066522) | > loss_feat: 11.460768699645996 (6.576646232585373) | > loss_mel: 24.853452682495117 (21.45622885540912) | > loss_duration: 1.4216070175170898 (1.344774095635665) | > loss_1: 42.13182830810547 (32.7532538614775) | > grad_norm_1: tensor(165032.6250, device='cuda:0') (tensor(56935.7031, device='cuda:0')) | > current_lr_0: 6.40873012335811e-05 | > current_lr_1: 6.40873012335811e-05 | > step_time: 0.6551 (0.6718318336888364) | > loader_time: 0.0277 (0.027028309671502364)  --> TIME: 2023-10-20 14:21:43 -- STEP: 49/50 -- GLOBAL_STEP: 109950 | > loss_disc: 1.368109941482544 (2.4531566099244726) | > loss_disc_real_0: 0.04975723475217819 (0.13743930654030068) | > loss_disc_real_1: 0.1745932698249817 (0.23060383282753885) | > loss_disc_real_2: 0.12582367658615112 (0.2169148435398024) | > loss_disc_real_3: 0.07900986075401306 (0.23941441389675036) | > loss_disc_real_4: 0.09299585968255997 (0.2098938071225979) | > loss_disc_real_5: 0.05379438400268555 (0.21234718732991997) | > loss_0: 1.368109941482544 (2.4531566099244726) | > grad_norm_0: tensor(1093.7719, device='cuda:0') (tensor(1242.8584, device='cuda:0')) | > loss_gen: 3.291942834854126 (2.3693086541428845) | > loss_kl: 0.7200108170509338 (0.7602555399038353) | > loss_feat: 11.78158950805664 (6.00743763585936) | > loss_mel: 30.287033081054688 (21.681222787925176) | > loss_duration: 1.4482122659683228 (1.3243987146688965) | > loss_1: 47.52878952026367 (32.14262342453003) | > grad_norm_1: 0 (tensor(37083.1367, device='cuda:0')) | > current_lr_0: 6.40873012335811e-05 | > current_lr_1: 6.40873012335811e-05 | > step_time: 0.5129 (0.5627962326516911) | > loader_time: 0.3559 (0.02437340483373525)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7615246772766113 (2.7615246772766113) | > loss_disc_real_0: 0.2746938467025757 (0.2746938467025757) | > loss_disc_real_1: 0.25247398018836975 (0.25247398018836975) | > loss_disc_real_2: 0.3726813495159149 (0.3726813495159149) | > loss_disc_real_3: 0.2689761817455292 (0.2689761817455292) | > loss_disc_real_4: 0.24393805861473083 (0.24393805861473083) | > loss_disc_real_5: 0.2961093783378601 (0.2961093783378601) | > loss_0: 2.7615246772766113 (2.7615246772766113) | > loss_gen: 2.602350950241089 (2.602350950241089) | > loss_kl: 5.394157409667969 (5.394157409667969) | > loss_feat: 6.099071502685547 (6.099071502685547) | > loss_mel: 21.986852645874023 (21.986852645874023) | > loss_duration: 3.0929388999938965 (3.0929388999938965) | > loss_1: 39.17536926269531 (39.17536926269531)  --> STEP: 1 | > loss_disc: 3.1708931922912598 (3.1708931922912598) | > loss_disc_real_0: 0.18322904407978058 (0.18322904407978058) | > loss_disc_real_1: 0.2853701710700989 (0.2853701710700989) | > loss_disc_real_2: 0.32855165004730225 (0.32855165004730225) | > loss_disc_real_3: 0.32793474197387695 (0.32793474197387695) | > loss_disc_real_4: 0.4221687614917755 (0.4221687614917755) | > loss_disc_real_5: 0.3945295810699463 (0.3945295810699463) | > loss_0: 3.1708931922912598 (3.1708931922912598) | > loss_gen: 2.1520068645477295 (2.1520068645477295) | > loss_kl: 5.362925052642822 (5.362925052642822) | > loss_feat: 4.048739910125732 (4.048739910125732) | > loss_mel: 23.396377563476562 (23.396377563476562) | > loss_duration: 3.4355251789093018 (3.4355251789093018) | > loss_1: 38.39557647705078 (38.39557647705078)  --> STEP: 2 | > loss_disc: 2.722424030303955 (2.9466586112976074) | > loss_disc_real_0: 0.1962125450372696 (0.18972079455852509) | > loss_disc_real_1: 0.26845255494117737 (0.2769113630056381) | > loss_disc_real_2: 0.29910796880722046 (0.31382980942726135) | > loss_disc_real_3: 0.41138073801994324 (0.3696577399969101) | > loss_disc_real_4: 0.14214535057544708 (0.2821570560336113) | > loss_disc_real_5: 0.21469445526599884 (0.30461201816797256) | > loss_0: 2.722424030303955 (2.9466586112976074) | > loss_gen: 2.5805277824401855 (2.3662673234939575) | > loss_kl: 5.8750529289245605 (5.618988990783691) | > loss_feat: 9.766573905944824 (6.907656908035278) | > loss_mel: 29.040035247802734 (26.21820640563965) | > loss_duration: 3.240950345993042 (3.338237762451172) | > loss_1: 50.503143310546875 (44.44935989379883)  --> STEP: 3 | > loss_disc: 3.9402143955230713 (3.2778438727060952) | > loss_disc_real_0: 0.3598747253417969 (0.24643877148628235) | > loss_disc_real_1: 0.36906805634498596 (0.3076302607854207) | > loss_disc_real_2: 0.5622528791427612 (0.396637499332428) | > loss_disc_real_3: 0.29029741883277893 (0.3432042996088664) | > loss_disc_real_4: 0.5524715781211853 (0.3722618967294693) | > loss_disc_real_5: 0.7019209861755371 (0.43704834083716076) | > loss_0: 3.9402143955230713 (3.2778438727060952) | > loss_gen: 2.171459436416626 (2.301331361134847) | > loss_kl: 2.8878486156463623 (4.708608865737915) | > loss_feat: 3.9951367378234863 (5.936816851298015) | > loss_mel: 23.182327270507812 (25.206246693929035) | > loss_duration: 3.117800712585449 (3.264758745829264) | > loss_1: 35.35457229614258 (41.417764027913414) --> EVAL PERFORMANCE | > avg_loader_time: 0.013743082682291666 (-0.009650389353434244) | > avg_loss_disc: 3.2778438727060952 (+0.6546465555826821) | > avg_loss_disc_real_0: 0.24643877148628235 (+0.112775685886542) | > avg_loss_disc_real_1: 0.3076302607854207 (+0.04086153209209442) | > avg_loss_disc_real_2: 0.396637499332428 (+0.16205387810866037) | > avg_loss_disc_real_3: 0.3432042996088664 (+0.12987193465232852) | > avg_loss_disc_real_4: 0.3722618967294693 (-0.005688334504763304) | > avg_loss_disc_real_5: 0.43704834083716076 (+0.09352077047030133) | > avg_loss_0: 3.2778438727060952 (+0.6546465555826821) | > avg_loss_gen: 2.301331361134847 (-0.1122194925944009) | > avg_loss_kl: 4.708608865737915 (+0.2599812348683672) | > avg_loss_feat: 5.936816851298015 (-0.8150334358215332) | > avg_loss_mel: 25.206246693929035 (+1.3978761037190743) | > avg_loss_duration: 3.264758745829264 (-0.0065462589263916016) | > avg_loss_1: 41.417764027913414 (+0.72406005859375)  > EPOCH: 1139/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:22:01)   --> TIME: 2023-10-20 14:22:22 -- STEP: 29/50 -- GLOBAL_STEP: 109980 | > loss_disc: 2.3115358352661133 (2.601740072513449) | > loss_disc_real_0: 0.26264700293540955 (0.15365351145637446) | > loss_disc_real_1: 0.26063498854637146 (0.21747502016610112) | > loss_disc_real_2: 0.2550075948238373 (0.26228281906966505) | > loss_disc_real_3: 0.2421892136335373 (0.2508587623978484) | > loss_disc_real_4: 0.20148105919361115 (0.27078483587708974) | > loss_disc_real_5: 0.40375658869743347 (0.26084560335710133) | > loss_0: 2.3115358352661133 (2.601740072513449) | > grad_norm_0: tensor(522.4146, device='cuda:0') (tensor(524.4729, device='cuda:0')) | > loss_gen: 3.215785503387451 (2.2448148727416997) | > loss_kl: 1.0724557638168335 (0.8098659037516035) | > loss_feat: 6.380712509155273 (5.308125356340716) | > loss_mel: 21.156471252441406 (18.358271128144757) | > loss_duration: 1.328269600868225 (1.3406295447513974) | > loss_1: 33.15369415283203 (28.06170626344352) | > grad_norm_1: tensor(9970.3516, device='cuda:0') (tensor(23186.8789, device='cuda:0')) | > current_lr_0: 6.402324196353332e-05 | > current_lr_1: 6.40873012335811e-05 | > step_time: 0.6868 (0.533453398737414) | > loader_time: 0.022 (0.012915668816402041)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7706875801086426 (2.7706875801086426) | > loss_disc_real_0: 0.2900070250034332 (0.2900070250034332) | > loss_disc_real_1: 0.3182557225227356 (0.3182557225227356) | > loss_disc_real_2: 0.2526529133319855 (0.2526529133319855) | > loss_disc_real_3: 0.41120922565460205 (0.41120922565460205) | > loss_disc_real_4: 0.32863014936447144 (0.32863014936447144) | > loss_disc_real_5: 0.2312343716621399 (0.2312343716621399) | > loss_0: 2.7706875801086426 (2.7706875801086426) | > loss_gen: 2.6229963302612305 (2.6229963302612305) | > loss_kl: 5.347733497619629 (5.347733497619629) | > loss_feat: 6.697999954223633 (6.697999954223633) | > loss_mel: 25.179889678955078 (25.179889678955078) | > loss_duration: 3.1068670749664307 (3.1068670749664307) | > loss_1: 42.95549011230469 (42.95549011230469)  --> STEP: 1 | > loss_disc: 2.078880786895752 (2.078880786895752) | > loss_disc_real_0: 0.08657249063253403 (0.08657249063253403) | > loss_disc_real_1: 0.17917846143245697 (0.17917846143245697) | > loss_disc_real_2: 0.25853362679481506 (0.25853362679481506) | > loss_disc_real_3: 0.07102217525243759 (0.07102217525243759) | > loss_disc_real_4: 0.07813502848148346 (0.07813502848148346) | > loss_disc_real_5: 0.2147512584924698 (0.2147512584924698) | > loss_0: 2.078880786895752 (2.078880786895752) | > loss_gen: 2.2605199813842773 (2.2605199813842773) | > loss_kl: 5.327356815338135 (5.327356815338135) | > loss_feat: 10.923955917358398 (10.923955917358398) | > loss_mel: 22.57740592956543 (22.57740592956543) | > loss_duration: 3.373957395553589 (3.373957395553589) | > loss_1: 44.463199615478516 (44.463199615478516)  --> STEP: 2 | > loss_disc: 2.4304370880126953 (2.2546589374542236) | > loss_disc_real_0: 0.5381925106048584 (0.3123825006186962) | > loss_disc_real_1: 0.0948803499341011 (0.13702940568327904) | > loss_disc_real_2: 0.23682084679603577 (0.24767723679542542) | > loss_disc_real_3: 0.33337053656578064 (0.20219635590910912) | > loss_disc_real_4: 0.1818741261959076 (0.13000457733869553) | > loss_disc_real_5: 0.10976407676935196 (0.16225766763091087) | > loss_0: 2.4304370880126953 (2.2546589374542236) | > loss_gen: 2.7182300090789795 (2.4893749952316284) | > loss_kl: 5.780196666717529 (5.553776741027832) | > loss_feat: 10.29465389251709 (10.609304904937744) | > loss_mel: 19.8352108001709 (21.206308364868164) | > loss_duration: 3.1971852779388428 (3.285571336746216) | > loss_1: 41.825477600097656 (43.144338607788086)  --> STEP: 3 | > loss_disc: 2.9896109104156494 (2.4996429284413657) | > loss_disc_real_0: 0.2937594950199127 (0.3061748320857684) | > loss_disc_real_1: 0.36481645703315735 (0.21295842279990515) | > loss_disc_real_2: 0.4310992658138275 (0.30881791313489276) | > loss_disc_real_3: 0.3322969079017639 (0.2455632065733274) | > loss_disc_real_4: 0.30218425393104553 (0.18739780286947885) | > loss_disc_real_5: 0.32022786140441895 (0.2149143988887469) | > loss_0: 2.9896109104156494 (2.4996429284413657) | > loss_gen: 2.5952188968658447 (2.524656295776367) | > loss_kl: 3.556349039077759 (4.887967507044475) | > loss_feat: 2.558413505554199 (7.9256744384765625) | > loss_mel: 18.4981689453125 (20.303595225016277) | > loss_duration: 3.047481060028076 (3.2062079111735025) | > loss_1: 30.255630493164062 (38.84810256958008) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_110000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8135011196136475 (2.578107476234436) | > loss_disc_real_0: 0.23662516474723816 (0.2887874152511358) | > loss_disc_real_1: 0.28465938568115234 (0.23088366352021694) | > loss_disc_real_2: 0.36949166655540466 (0.32398635149002075) | > loss_disc_real_3: 0.22672955691814423 (0.2408547941595316) | > loss_disc_real_4: 0.2326761782169342 (0.1987173967063427) | > loss_disc_real_5: 0.2800038456916809 (0.2311867605894804) | > loss_0: 2.8135011196136475 (2.578107476234436) | > loss_gen: 2.062080144882202 (2.409012258052826) | > loss_kl: 5.484181880950928 (5.037021100521088) | > loss_feat: 5.102715492248535 (7.219934701919556) | > loss_mel: 24.178293228149414 (21.27226972579956) | > loss_duration: 2.9620373249053955 (3.145165264606476) | > loss_1: 39.789306640625 (39.08340358734131)  --> STEP: 1 | > loss_disc: 2.8063912391662598 (2.623764228820801) | > loss_disc_real_0: 0.22412313520908356 (0.2758545592427254) | > loss_disc_real_1: 0.3504454493522644 (0.25479602068662643) | > loss_disc_real_2: 0.3210315406322479 (0.3233953893184662) | > loss_disc_real_3: 0.23046724498271942 (0.23877728432416917) | > loss_disc_real_4: 0.2433847039937973 (0.2076508581638336) | > loss_disc_real_5: 0.18451465666294098 (0.22185233980417252) | > loss_0: 2.8063912391662598 (2.623764228820801) | > loss_gen: 2.1173882484436035 (2.3506874561309816) | > loss_kl: 5.681808948516846 (5.165978670120239) | > loss_feat: 6.047171592712402 (6.985382080078125) | > loss_mel: 20.869155883789062 (21.19164695739746) | > loss_duration: 3.3896007537841797 (3.1940523624420165) | > loss_1: 38.105125427246094 (38.88774795532227)  --> STEP: 2 | > loss_disc: 2.845566749572754 (2.660731315612793) | > loss_disc_real_0: 0.21858063340187073 (0.26630890493591625) | > loss_disc_real_1: 0.27805036306381226 (0.2586717444161574) | > loss_disc_real_2: 0.28390082716941833 (0.3168129622936249) | > loss_disc_real_3: 0.28257137537002563 (0.24607629949847856) | > loss_disc_real_4: 0.26015758514404297 (0.21640197932720184) | > loss_disc_real_5: 0.2690730094909668 (0.22972245141863823) | > loss_0: 2.845566749572754 (2.660731315612793) | > loss_gen: 1.8326932191848755 (2.2643550833066306) | > loss_kl: 6.093390464782715 (5.320547302563985) | > loss_feat: 1.6754357814788818 (6.1003910303115845) | > loss_mel: 22.853858947753906 (21.468682289123535) | > loss_duration: 3.2342522144317627 (3.200752337773641) | > loss_1: 35.689632415771484 (38.35472869873047)  --> STEP: 3 | > loss_disc: 3.0297207832336426 (2.713444096701486) | > loss_disc_real_0: 0.23395314812660217 (0.2616866539631571) | > loss_disc_real_1: 0.2638035714626312 (0.25940486256565365) | > loss_disc_real_2: 0.2625238001346588 (0.3090573676994869) | > loss_disc_real_3: 0.25812575221061707 (0.24779764988592692) | > loss_disc_real_4: 0.22732920944690704 (0.21796301220144546) | > loss_disc_real_5: 0.24337823688983917 (0.23167327791452408) | > loss_0: 3.0297207832336426 (2.713444096701486) | > loss_gen: 1.465830683708191 (2.150280169078282) | > loss_kl: 2.6584346294403076 (4.940245492117746) | > loss_feat: 0.06693954765796661 (5.238469389932496) | > loss_mel: 2.154414653778076 (18.7095011983599) | > loss_duration: 3.088223695755005 (3.1846768174852644) | > loss_1: 9.433843612670898 (34.22317368643625) --> EVAL PERFORMANCE | > avg_loader_time: 0.3401672158922468 (+0.3264241332099551) | > avg_loss_disc: 2.713444096701486 (-0.5643997760046093) | > avg_loss_disc_real_0: 0.2616866539631571 (+0.015247882476874752) | > avg_loss_disc_real_1: 0.25940486256565365 (-0.04822539821976707) | > avg_loss_disc_real_2: 0.3090573676994869 (-0.0875801316329411) | > avg_loss_disc_real_3: 0.24779764988592692 (-0.09540664972293947) | > avg_loss_disc_real_4: 0.21796301220144546 (-0.15429888452802384) | > avg_loss_disc_real_5: 0.23167327791452408 (-0.2053750629226367) | > avg_loss_0: 2.713444096701486 (-0.5643997760046093) | > avg_loss_gen: 2.150280169078282 (-0.15105119205656514) | > avg_loss_kl: 4.940245492117746 (+0.23163662637983062) | > avg_loss_feat: 5.238469389932496 (-0.6983474613655183) | > avg_loss_mel: 18.7095011983599 (-6.496745495569137) | > avg_loss_duration: 3.1846768174852644 (-0.08008192834399974) | > avg_loss_1: 34.22317368643625 (-7.194590341477166)  > EPOCH: 1140/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:22:58)   --> TIME: 2023-10-20 14:23:17 -- STEP: 9/50 -- GLOBAL_STEP: 110010 | > loss_disc: 2.9028778076171875 (2.4938347472084894) | > loss_disc_real_0: 0.5719631910324097 (0.18020597907404104) | > loss_disc_real_1: 0.3919287323951721 (0.2281133375234074) | > loss_disc_real_2: 0.2451852262020111 (0.19898795667621824) | > loss_disc_real_3: 0.4223014712333679 (0.24702084561189017) | > loss_disc_real_4: 0.22975289821624756 (0.210314579308033) | > loss_disc_real_5: 0.3891579210758209 (0.21030253171920776) | > loss_0: 2.9028778076171875 (2.4938347472084894) | > grad_norm_0: tensor(894.1144, device='cuda:0') (tensor(586.0971, device='cuda:0')) | > loss_gen: 3.0257716178894043 (2.265467988120185) | > loss_kl: 0.29441189765930176 (0.7689340114593506) | > loss_feat: 4.915792942047119 (6.752398914761013) | > loss_mel: 20.94974136352539 (21.21520815955268) | > loss_duration: 1.316213846206665 (1.3004912270439997) | > loss_1: 30.50193214416504 (32.30250040690104) | > grad_norm_1: tensor(21993.0957, device='cuda:0') (tensor(18422.7598, device='cuda:0')) | > current_lr_0: 6.39592467247367e-05 | > current_lr_1: 6.402324196353332e-05 | > step_time: 0.4197 (0.8234688705868192) | > loader_time: 0.0022 (0.03299593925476074)  --> TIME: 2023-10-20 14:23:38 -- STEP: 39/50 -- GLOBAL_STEP: 110040 | > loss_disc: 2.2727277278900146 (2.3876500741029396) | > loss_disc_real_0: 0.056916579604148865 (0.14251713428455284) | > loss_disc_real_1: 0.23189616203308105 (0.21748523213542426) | > loss_disc_real_2: 0.14872342348098755 (0.21541701935422727) | > loss_disc_real_3: 0.23902417719364166 (0.23360180229139635) | > loss_disc_real_4: 0.33073490858078003 (0.22568948399753141) | > loss_disc_real_5: 0.3145073652267456 (0.21193570591127261) | > loss_0: 2.2727277278900146 (2.3876500741029396) | > grad_norm_0: tensor(594.4988, device='cuda:0') (tensor(657.4716, device='cuda:0')) | > loss_gen: 3.00022029876709 (2.295537438148107) | > loss_kl: 0.32289817929267883 (0.8101287935024652) | > loss_feat: 4.649435997009277 (5.775808406181825) | > loss_mel: 26.39837074279785 (20.473084770716152) | > loss_duration: 1.4048384428024292 (1.316529209797199) | > loss_1: 35.77576446533203 (30.671088646619744) | > grad_norm_1: tensor(12285.7930, device='cuda:0') (tensor(23121.1406, device='cuda:0')) | > current_lr_0: 6.39592467247367e-05 | > current_lr_1: 6.402324196353332e-05 | > step_time: 0.5584 (0.7201650998531244) | > loader_time: 0.0027 (0.0235132987682636)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.700303316116333 (2.700303316116333) | > loss_disc_real_0: 0.2772175371646881 (0.2772175371646881) | > loss_disc_real_1: 0.2977862060070038 (0.2977862060070038) | > loss_disc_real_2: 0.2777615487575531 (0.2777615487575531) | > loss_disc_real_3: 0.2378082424402237 (0.2378082424402237) | > loss_disc_real_4: 0.20657366514205933 (0.20657366514205933) | > loss_disc_real_5: 0.19506831467151642 (0.19506831467151642) | > loss_0: 2.700303316116333 (2.700303316116333) | > loss_gen: 1.936697244644165 (1.936697244644165) | > loss_kl: 6.622541904449463 (6.622541904449463) | > loss_feat: 4.851413726806641 (4.851413726806641) | > loss_mel: 22.2083683013916 (22.2083683013916) | > loss_duration: 3.099163055419922 (3.099163055419922) | > loss_1: 38.71818542480469 (38.71818542480469)  --> STEP: 1 | > loss_disc: 2.6458888053894043 (2.6458888053894043) | > loss_disc_real_0: 0.24517126381397247 (0.24517126381397247) | > loss_disc_real_1: 0.20138385891914368 (0.20138385891914368) | > loss_disc_real_2: 0.214901402592659 (0.214901402592659) | > loss_disc_real_3: 0.2556286156177521 (0.2556286156177521) | > loss_disc_real_4: 0.1559375524520874 (0.1559375524520874) | > loss_disc_real_5: 0.13196827471256256 (0.13196827471256256) | > loss_0: 2.6458888053894043 (2.6458888053894043) | > loss_gen: 1.789400577545166 (1.789400577545166) | > loss_kl: 5.105984210968018 (5.105984210968018) | > loss_feat: 6.805363178253174 (6.805363178253174) | > loss_mel: 25.47164535522461 (25.47164535522461) | > loss_duration: 3.358882427215576 (3.358882427215576) | > loss_1: 42.53127670288086 (42.53127670288086)  --> STEP: 2 | > loss_disc: 2.723526954650879 (2.6847078800201416) | > loss_disc_real_0: 0.19072040915489197 (0.21794583648443222) | > loss_disc_real_1: 0.21584470570087433 (0.208614282310009) | > loss_disc_real_2: 0.31405001878738403 (0.2644757106900215) | > loss_disc_real_3: 0.18262143433094025 (0.21912502497434616) | > loss_disc_real_4: 0.42299947142601013 (0.28946851193904877) | > loss_disc_real_5: 0.4642805755138397 (0.29812442511320114) | > loss_0: 2.723526954650879 (2.6847078800201416) | > loss_gen: 2.784271717071533 (2.2868361473083496) | > loss_kl: 5.699814796447754 (5.402899503707886) | > loss_feat: 8.432982444763184 (7.619172811508179) | > loss_mel: 23.30489158630371 (24.38826847076416) | > loss_duration: 3.240980863571167 (3.2999316453933716) | > loss_1: 43.46294403076172 (42.99711036682129)  --> STEP: 3 | > loss_disc: 2.766693592071533 (2.712036450703939) | > loss_disc_real_0: 0.21807491779327393 (0.21798886358737946) | > loss_disc_real_1: 0.24154379963874817 (0.2195907880862554) | > loss_disc_real_2: 0.24683892726898193 (0.2585967828830083) | > loss_disc_real_3: 0.2998184263706207 (0.24602282543977103) | > loss_disc_real_4: 0.3149757981300354 (0.2979709406693776) | > loss_disc_real_5: 0.3651527166366577 (0.32046718895435333) | > loss_0: 2.766693592071533 (2.712036450703939) | > loss_gen: 2.1512041091918945 (2.2416254679361978) | > loss_kl: 2.649142026901245 (4.484980344772339) | > loss_feat: 2.0669233798980713 (5.7684230009714765) | > loss_mel: 18.501556396484375 (22.4260311126709) | > loss_duration: 3.0803158283233643 (3.2267263730367026) | > loss_1: 28.449140548706055 (38.14778709411621) --> EVAL PERFORMANCE | > avg_loader_time: 0.021406173706054688 (-0.3187610421861921) | > avg_loss_disc: 2.712036450703939 (-0.0014076459975469469) | > avg_loss_disc_real_0: 0.21798886358737946 (-0.043697790375777645) | > avg_loss_disc_real_1: 0.2195907880862554 (-0.03981407447939825) | > avg_loss_disc_real_2: 0.2585967828830083 (-0.05046058481647858) | > avg_loss_disc_real_3: 0.24602282543977103 (-0.0017748244461558982) | > avg_loss_disc_real_4: 0.2979709406693776 (+0.08000792846793217) | > avg_loss_disc_real_5: 0.32046718895435333 (+0.08879391103982925) | > avg_loss_0: 2.712036450703939 (-0.0014076459975469469) | > avg_loss_gen: 2.2416254679361978 (+0.09134529885791576) | > avg_loss_kl: 4.484980344772339 (-0.4552651473454068) | > avg_loss_feat: 5.7684230009714765 (+0.5299536110389802) | > avg_loss_mel: 22.4260311126709 (+3.7165299143109998) | > avg_loss_duration: 3.2267263730367026 (+0.04204955555143819) | > avg_loss_1: 38.14778709411621 (+3.9246134076799635)  > EPOCH: 1141/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:24:10)   --> TIME: 2023-10-20 14:24:27 -- STEP: 19/50 -- GLOBAL_STEP: 110070 | > loss_disc: 2.365471124649048 (2.461241320559853) | > loss_disc_real_0: 0.09522044658660889 (0.15396101797293676) | > loss_disc_real_1: 0.21077781915664673 (0.22686891414617238) | > loss_disc_real_2: 0.15114372968673706 (0.23615921680864535) | > loss_disc_real_3: 0.217048779129982 (0.2374460559926535) | > loss_disc_real_4: 0.23523099720478058 (0.23818151005788854) | > loss_disc_real_5: 0.27807122468948364 (0.2429979892055455) | > loss_0: 2.365471124649048 (2.461241320559853) | > grad_norm_0: tensor(674.0263, device='cuda:0') (tensor(641.7619, device='cuda:0')) | > loss_gen: 2.1704587936401367 (2.31449346165908) | > loss_kl: 0.9716228246688843 (0.8587846065822401) | > loss_feat: 4.161685943603516 (5.952746090920348) | > loss_mel: 20.032875061035156 (21.299614492215607) | > loss_duration: 1.4234535694122314 (1.3558926017660844) | > loss_1: 28.76009750366211 (31.781531384116725) | > grad_norm_1: tensor(8951.0371, device='cuda:0') (tensor(23698.5801, device='cuda:0')) | > current_lr_0: 6.389531545318794e-05 | > current_lr_1: 6.39592467247367e-05 | > step_time: 0.3491 (0.6207133092378315) | > loader_time: 0.0019 (0.028320638757002987)  --> TIME: 2023-10-20 14:24:45 -- STEP: 49/50 -- GLOBAL_STEP: 110100 | > loss_disc: 2.3919029235839844 (2.461471654930893) | > loss_disc_real_0: 0.06255656480789185 (0.14579386824779972) | > loss_disc_real_1: 0.1304483413696289 (0.21455528921618752) | > loss_disc_real_2: 0.05751856043934822 (0.2256121230216659) | > loss_disc_real_3: 0.20946964621543884 (0.221020907619778) | > loss_disc_real_4: 0.2673538029193878 (0.22720834228913395) | > loss_disc_real_5: 0.2620442509651184 (0.21760790671545024) | > loss_0: 2.3919029235839844 (2.461471654930893) | > grad_norm_0: tensor(567.9089, device='cuda:0') (tensor(566.7276, device='cuda:0')) | > loss_gen: 1.8950068950653076 (2.2554075474641753) | > loss_kl: 0.563582718372345 (0.812241040930456) | > loss_feat: 2.6322786808013916 (5.853552219628984) | > loss_mel: 22.213764190673828 (20.785604967146497) | > loss_duration: 1.3999335765838623 (1.3203900565906448) | > loss_1: 28.704565048217773 (31.027195589882986) | > grad_norm_1: tensor(8906.8281, device='cuda:0') (tensor(20101.0664, device='cuda:0')) | > current_lr_0: 6.389531545318794e-05 | > current_lr_1: 6.39592467247367e-05 | > step_time: 0.6905 (0.5876610327740105) | > loader_time: 0.3815 (0.030153415641006157)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9406466484069824 (2.9406466484069824) | > loss_disc_real_0: 0.309353768825531 (0.309353768825531) | > loss_disc_real_1: 0.18422381579875946 (0.18422381579875946) | > loss_disc_real_2: 0.34506428241729736 (0.34506428241729736) | > loss_disc_real_3: 0.2254144847393036 (0.2254144847393036) | > loss_disc_real_4: 0.3506835401058197 (0.3506835401058197) | > loss_disc_real_5: 0.457771897315979 (0.457771897315979) | > loss_0: 2.9406466484069824 (2.9406466484069824) | > loss_gen: 2.3704962730407715 (2.3704962730407715) | > loss_kl: 5.472471237182617 (5.472471237182617) | > loss_feat: 5.306793212890625 (5.306793212890625) | > loss_mel: 20.629186630249023 (20.629186630249023) | > loss_duration: 3.0380051136016846 (3.0380051136016846) | > loss_1: 36.816951751708984 (36.816951751708984)  --> STEP: 1 | > loss_disc: 2.9484639167785645 (2.9484639167785645) | > loss_disc_real_0: 0.35352280735969543 (0.35352280735969543) | > loss_disc_real_1: 0.2535259425640106 (0.2535259425640106) | > loss_disc_real_2: 0.2559071481227875 (0.2559071481227875) | > loss_disc_real_3: 0.2525887191295624 (0.2525887191295624) | > loss_disc_real_4: 0.2557712197303772 (0.2557712197303772) | > loss_disc_real_5: 0.26085522770881653 (0.26085522770881653) | > loss_0: 2.9484639167785645 (2.9484639167785645) | > loss_gen: 1.7568318843841553 (1.7568318843841553) | > loss_kl: 5.730978012084961 (5.730978012084961) | > loss_feat: 0.23193266987800598 (0.23193266987800598) | > loss_mel: 10.296769142150879 (10.296769142150879) | > loss_duration: 3.461772918701172 (3.461772918701172) | > loss_1: 21.47828483581543 (21.47828483581543)  --> STEP: 2 | > loss_disc: 2.244483470916748 (2.5964736938476562) | > loss_disc_real_0: 0.29767662286758423 (0.32559971511363983) | > loss_disc_real_1: 0.13509413599967957 (0.1943100392818451) | > loss_disc_real_2: 0.19232331216335297 (0.22411523014307022) | > loss_disc_real_3: 0.17921030521392822 (0.2158995121717453) | > loss_disc_real_4: 0.16487260162830353 (0.21032191067934036) | > loss_disc_real_5: 0.20944905281066895 (0.23515214025974274) | > loss_0: 2.244483470916748 (2.5964736938476562) | > loss_gen: 2.4374849796295166 (2.097158432006836) | > loss_kl: 5.9984564781188965 (5.864717245101929) | > loss_feat: 9.497309684753418 (4.864621177315712) | > loss_mel: 23.450674057006836 (16.873721599578857) | > loss_duration: 3.293874502182007 (3.3778237104415894) | > loss_1: 44.677799224853516 (33.07804203033447)  --> STEP: 3 | > loss_disc: 3.2043519020080566 (2.7990997632344565) | > loss_disc_real_0: 0.6034979820251465 (0.4182324707508087) | > loss_disc_real_1: 0.4138241410255432 (0.26748140652974445) | > loss_disc_real_2: 0.5103457570075989 (0.3195254057645798) | > loss_disc_real_3: 0.20259593427181244 (0.211464986205101) | > loss_disc_real_4: 0.33140188455581665 (0.25068190197149914) | > loss_disc_real_5: 0.4118571877479553 (0.2940538227558136) | > loss_0: 3.2043519020080566 (2.7990997632344565) | > loss_gen: 2.9886081218719482 (2.39430832862854) | > loss_kl: 2.693452835083008 (4.807629108428955) | > loss_feat: 3.855186939239502 (4.528143097956975) | > loss_mel: 23.233858108520508 (18.993767102559406) | > loss_duration: 3.1010684967041016 (3.2855719725290933) | > loss_1: 35.87217712402344 (34.00942039489746) --> EVAL PERFORMANCE | > avg_loader_time: 0.011347373326619467 (-0.01005880037943522) | > avg_loss_disc: 2.7990997632344565 (+0.08706331253051758) | > avg_loss_disc_real_0: 0.4182324707508087 (+0.20024360716342926) | > avg_loss_disc_real_1: 0.26748140652974445 (+0.04789061844348905) | > avg_loss_disc_real_2: 0.3195254057645798 (+0.06092862288157147) | > avg_loss_disc_real_3: 0.211464986205101 (-0.03455783923467001) | > avg_loss_disc_real_4: 0.25068190197149914 (-0.04728903869787848) | > avg_loss_disc_real_5: 0.2940538227558136 (-0.026413366198539734) | > avg_loss_0: 2.7990997632344565 (+0.08706331253051758) | > avg_loss_gen: 2.39430832862854 (+0.15268286069234227) | > avg_loss_kl: 4.807629108428955 (+0.3226487636566162) | > avg_loss_feat: 4.528143097956975 (-1.2402799030145015) | > avg_loss_mel: 18.993767102559406 (-3.432264010111492) | > avg_loss_duration: 3.2855719725290933 (+0.058845599492390654) | > avg_loss_1: 34.00942039489746 (-4.13836669921875)  > EPOCH: 1142/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:25:04)   --> TIME: 2023-10-20 14:25:31 -- STEP: 29/50 -- GLOBAL_STEP: 110130 | > loss_disc: 2.8559298515319824 (2.2897674585210863) | > loss_disc_real_0: 0.32065677642822266 (0.1326837221417448) | > loss_disc_real_1: 0.2764398157596588 (0.2144693637202526) | > loss_disc_real_2: 0.21277350187301636 (0.22047974606012477) | > loss_disc_real_3: 0.2604285478591919 (0.24006400796873817) | > loss_disc_real_4: 0.2616506516933441 (0.23684878274798393) | > loss_disc_real_5: 0.24698662757873535 (0.212069071829319) | > loss_0: 2.8559298515319824 (2.2897674585210863) | > grad_norm_0: tensor(985.4178, device='cuda:0') (tensor(645.0031, device='cuda:0')) | > loss_gen: 1.7505507469177246 (2.5724834244826744) | > loss_kl: 1.0761488676071167 (0.9047452499126566) | > loss_feat: 0.9929726123809814 (6.851160610801187) | > loss_mel: 16.03087615966797 (21.657675044289952) | > loss_duration: 1.312152624130249 (1.3155510343354324) | > loss_1: 21.162702560424805 (33.30161558348558) | > grad_norm_1: tensor(3979.2517, device='cuda:0') (tensor(22032.0371, device='cuda:0')) | > current_lr_0: 6.38314480849478e-05 | > current_lr_1: 6.389531545318794e-05 | > step_time: 0.4677 (0.7553837545986833) | > loader_time: 0.0021 (0.025617854348544418)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0096435546875 (3.0096435546875) | > loss_disc_real_0: 0.3301038146018982 (0.3301038146018982) | > loss_disc_real_1: 0.30285292863845825 (0.30285292863845825) | > loss_disc_real_2: 0.2638457119464874 (0.2638457119464874) | > loss_disc_real_3: 0.29984375834465027 (0.29984375834465027) | > loss_disc_real_4: 0.287381649017334 (0.287381649017334) | > loss_disc_real_5: 0.2581612169742584 (0.2581612169742584) | > loss_0: 3.0096435546875 (3.0096435546875) | > loss_gen: 1.7667549848556519 (1.7667549848556519) | > loss_kl: 6.5145673751831055 (6.5145673751831055) | > loss_feat: 0.04902195930480957 (0.04902195930480957) | > loss_mel: 5.643128395080566 (5.643128395080566) | > loss_duration: 3.114534616470337 (3.114534616470337) | > loss_1: 17.0880069732666 (17.0880069732666)  --> STEP: 1 | > loss_disc: 2.7473530769348145 (2.7473530769348145) | > loss_disc_real_0: 0.28747573494911194 (0.28747573494911194) | > loss_disc_real_1: 0.33128273487091064 (0.33128273487091064) | > loss_disc_real_2: 0.30440953373908997 (0.30440953373908997) | > loss_disc_real_3: 0.2784079313278198 (0.2784079313278198) | > loss_disc_real_4: 0.29516851902008057 (0.29516851902008057) | > loss_disc_real_5: 0.255523681640625 (0.255523681640625) | > loss_0: 2.7473530769348145 (2.7473530769348145) | > loss_gen: 2.241680383682251 (2.241680383682251) | > loss_kl: 5.730802059173584 (5.730802059173584) | > loss_feat: 1.6657828092575073 (1.6657828092575073) | > loss_mel: 20.15453338623047 (20.15453338623047) | > loss_duration: 3.4429144859313965 (3.4429144859313965) | > loss_1: 33.235713958740234 (33.235713958740234)  --> STEP: 2 | > loss_disc: 2.565337657928467 (2.6563453674316406) | > loss_disc_real_0: 0.1898016333580017 (0.23863868415355682) | > loss_disc_real_1: 0.32472679018974304 (0.32800476253032684) | > loss_disc_real_2: 0.26397043466567993 (0.28418998420238495) | > loss_disc_real_3: 0.18774822354316711 (0.23307807743549347) | > loss_disc_real_4: 0.10229507833719254 (0.19873179867863655) | > loss_disc_real_5: 0.1044047549366951 (0.17996421828866005) | > loss_0: 2.565337657928467 (2.6563453674316406) | > loss_gen: 2.044822931289673 (2.143251657485962) | > loss_kl: 5.856778621673584 (5.793790340423584) | > loss_feat: 8.179351806640625 (4.922567307949066) | > loss_mel: 26.922319412231445 (23.538426399230957) | > loss_duration: 3.2892353534698486 (3.3660749197006226) | > loss_1: 46.29250717163086 (39.76411056518555)  --> STEP: 3 | > loss_disc: 3.206545829772949 (2.83974552154541) | > loss_disc_real_0: 0.4279625117778778 (0.30174662669499713) | > loss_disc_real_1: 0.2424311488866806 (0.29948022464911145) | > loss_disc_real_2: 0.32869285345077515 (0.29902427395184833) | > loss_disc_real_3: 0.3907274007797241 (0.28562785188357037) | > loss_disc_real_4: 0.3590817451477051 (0.2521817808349927) | > loss_disc_real_5: 0.38966819643974304 (0.24986554433902106) | > loss_0: 3.206545829772949 (2.83974552154541) | > loss_gen: 2.5883688926696777 (2.291624069213867) | > loss_kl: 2.730475902557373 (4.772685527801514) | > loss_feat: 3.458012819290161 (4.434382478396098) | > loss_mel: 16.19874382019043 (21.09186553955078) | > loss_duration: 3.0850296020507812 (3.2723931471506753) | > loss_1: 28.060632705688477 (35.86295127868652) --> EVAL PERFORMANCE | > avg_loader_time: 0.010568459828694662 (-0.0007789134979248047) | > avg_loss_disc: 2.83974552154541 (+0.04064575831095363) | > avg_loss_disc_real_0: 0.30174662669499713 (-0.11648584405581158) | > avg_loss_disc_real_1: 0.29948022464911145 (+0.031998818119367) | > avg_loss_disc_real_2: 0.29902427395184833 (-0.020501131812731443) | > avg_loss_disc_real_3: 0.28562785188357037 (+0.07416286567846936) | > avg_loss_disc_real_4: 0.2521817808349927 (+0.0014998788634935645) | > avg_loss_disc_real_5: 0.24986554433902106 (-0.04418827841679254) | > avg_loss_0: 2.83974552154541 (+0.04064575831095363) | > avg_loss_gen: 2.291624069213867 (-0.10268425941467285) | > avg_loss_kl: 4.772685527801514 (-0.034943580627441406) | > avg_loss_feat: 4.434382478396098 (-0.09376061956087689) | > avg_loss_mel: 21.09186553955078 (+2.098098436991375) | > avg_loss_duration: 3.2723931471506753 (-0.013178825378417969) | > avg_loss_1: 35.86295127868652 (+1.8535308837890625)  > EPOCH: 1143/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:25:59)   --> TIME: 2023-10-20 14:26:10 -- STEP: 9/50 -- GLOBAL_STEP: 110160 | > loss_disc: 2.9607577323913574 (2.544750796424018) | > loss_disc_real_0: 0.20269346237182617 (0.16139120277431276) | > loss_disc_real_1: 0.30213484168052673 (0.2655872487359577) | > loss_disc_real_2: 0.258994460105896 (0.2580713513824675) | > loss_disc_real_3: 0.3376328647136688 (0.2747580193810993) | > loss_disc_real_4: 0.33264654874801636 (0.2540459707379341) | > loss_disc_real_5: 0.34354308247566223 (0.24916860564715332) | > loss_0: 2.9607577323913574 (2.544750796424018) | > grad_norm_0: tensor(684.3525, device='cuda:0') (tensor(514.7237, device='cuda:0')) | > loss_gen: 1.9726405143737793 (2.3791571193271213) | > loss_kl: 0.5569798350334167 (0.8532501922713386) | > loss_feat: 2.1414730548858643 (5.26892358602749) | > loss_mel: 21.969297409057617 (19.05216643545363) | > loss_duration: 1.314426064491272 (1.322457128100925) | > loss_1: 27.954818725585938 (28.875954310099285) | > grad_norm_1: tensor(3304.2568, device='cuda:0') (tensor(18676.9570, device='cuda:0')) | > current_lr_0: 6.37676445561409e-05 | > current_lr_1: 6.38314480849478e-05 | > step_time: 0.5354 (0.6546171506245931) | > loader_time: 0.0277 (0.02360820770263672)  --> TIME: 2023-10-20 14:26:29 -- STEP: 39/50 -- GLOBAL_STEP: 110190 | > loss_disc: 2.6574997901916504 (2.414872172551277) | > loss_disc_real_0: 0.019135180860757828 (0.1296913012957725) | > loss_disc_real_1: 0.23254059255123138 (0.23707424199733979) | > loss_disc_real_2: 0.27769067883491516 (0.23027960535807487) | > loss_disc_real_3: 0.1916503757238388 (0.23716507584620744) | > loss_disc_real_4: 0.2651921212673187 (0.22162215067790106) | > loss_disc_real_5: 0.2975263297557831 (0.24096630222331256) | > loss_0: 2.6574997901916504 (2.414872172551277) | > grad_norm_0: tensor(802.9398, device='cuda:0') (tensor(746.6015, device='cuda:0')) | > loss_gen: 1.8653604984283447 (2.374643775132986) | > loss_kl: 0.36790263652801514 (0.8191304529229034) | > loss_feat: 3.1898586750030518 (5.579002810880924) | > loss_mel: 20.462871551513672 (20.638830200219765) | > loss_duration: 1.3819047212600708 (1.3192679698650653) | > loss_1: 27.267898559570312 (30.730874880766258) | > grad_norm_1: tensor(3105.0320, device='cuda:0') (tensor(24241.3984, device='cuda:0')) | > current_lr_0: 6.37676445561409e-05 | > current_lr_1: 6.38314480849478e-05 | > step_time: 0.333 (0.6255815334809132) | > loader_time: 0.0036 (0.020923021512153823)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6957898139953613 (2.6957898139953613) | > loss_disc_real_0: 0.06290890276432037 (0.06290890276432037) | > loss_disc_real_1: 0.18591409921646118 (0.18591409921646118) | > loss_disc_real_2: 0.17522624135017395 (0.17522624135017395) | > loss_disc_real_3: 0.22584116458892822 (0.22584116458892822) | > loss_disc_real_4: 0.22202305495738983 (0.22202305495738983) | > loss_disc_real_5: 0.23595881462097168 (0.23595881462097168) | > loss_0: 2.6957898139953613 (2.6957898139953613) | > loss_gen: 1.5523818731307983 (1.5523818731307983) | > loss_kl: 5.3047709465026855 (5.3047709465026855) | > loss_feat: 3.3689818382263184 (3.3689818382263184) | > loss_mel: 21.698999404907227 (21.698999404907227) | > loss_duration: 3.0667436122894287 (3.0667436122894287) | > loss_1: 34.991878509521484 (34.991878509521484)  --> STEP: 1 | > loss_disc: 2.9371719360351562 (2.9371719360351562) | > loss_disc_real_0: 0.06331587582826614 (0.06331587582826614) | > loss_disc_real_1: 0.22259731590747833 (0.22259731590747833) | > loss_disc_real_2: 0.2535262405872345 (0.2535262405872345) | > loss_disc_real_3: 0.22729374468326569 (0.22729374468326569) | > loss_disc_real_4: 0.2237945944070816 (0.2237945944070816) | > loss_disc_real_5: 0.31653767824172974 (0.31653767824172974) | > loss_0: 2.9371719360351562 (2.9371719360351562) | > loss_gen: 1.4422664642333984 (1.4422664642333984) | > loss_kl: 5.2477874755859375 (5.2477874755859375) | > loss_feat: 1.0233423709869385 (1.0233423709869385) | > loss_mel: 15.83568000793457 (15.83568000793457) | > loss_duration: 3.419656991958618 (3.419656991958618) | > loss_1: 26.968732833862305 (26.968732833862305)  --> STEP: 2 | > loss_disc: 2.77832293510437 (2.857747435569763) | > loss_disc_real_0: 0.30149197578430176 (0.18240392580628395) | > loss_disc_real_1: 0.322206050157547 (0.27240168303251266) | > loss_disc_real_2: 0.28632330894470215 (0.2699247747659683) | > loss_disc_real_3: 0.25939783453941345 (0.24334578961133957) | > loss_disc_real_4: 0.3289591670036316 (0.2763768807053566) | > loss_disc_real_5: 0.3730948865413666 (0.34481628239154816) | > loss_0: 2.77832293510437 (2.857747435569763) | > loss_gen: 2.477672576904297 (1.9599695205688477) | > loss_kl: 5.73496675491333 (5.491377115249634) | > loss_feat: 4.525944709777832 (2.7746435403823853) | > loss_mel: 27.380462646484375 (21.608071327209473) | > loss_duration: 3.2302215099334717 (3.324939250946045) | > loss_1: 43.349266052246094 (35.1589994430542)  --> STEP: 3 | > loss_disc: 3.1083269119262695 (2.9412739276885986) | > loss_disc_real_0: 0.08700515329837799 (0.1506043349703153) | > loss_disc_real_1: 0.25280100107192993 (0.2658681223789851) | > loss_disc_real_2: 0.24922394752502441 (0.263024499018987) | > loss_disc_real_3: 0.22906124591827393 (0.23858427504698435) | > loss_disc_real_4: 0.22784852981567383 (0.260200763742129) | > loss_disc_real_5: 0.3231499195098877 (0.3375941614309947) | > loss_0: 3.1083269119262695 (2.9412739276885986) | > loss_gen: 1.365913987159729 (1.7619510094324748) | > loss_kl: 2.656100273132324 (4.546284834543864) | > loss_feat: 0.03907700628042221 (1.8627880290150642) | > loss_mel: 2.888293743133545 (15.36814546585083) | > loss_duration: 3.1332967281341553 (3.2610584100087485) | > loss_1: 10.082681655883789 (26.80022684733073) --> EVAL PERFORMANCE | > avg_loader_time: 0.0025610923767089844 (-0.008007367451985678) | > avg_loss_disc: 2.9412739276885986 (+0.10152840614318848) | > avg_loss_disc_real_0: 0.1506043349703153 (-0.15114229172468183) | > avg_loss_disc_real_1: 0.2658681223789851 (-0.03361210227012634) | > avg_loss_disc_real_2: 0.263024499018987 (-0.03599977493286133) | > avg_loss_disc_real_3: 0.23858427504698435 (-0.047043576836586026) | > avg_loss_disc_real_4: 0.260200763742129 (+0.008018982907136318) | > avg_loss_disc_real_5: 0.3375941614309947 (+0.08772861709197363) | > avg_loss_0: 2.9412739276885986 (+0.10152840614318848) | > avg_loss_gen: 1.7619510094324748 (-0.5296730597813923) | > avg_loss_kl: 4.546284834543864 (-0.22640069325764944) | > avg_loss_feat: 1.8627880290150642 (-2.571594449381034) | > avg_loss_mel: 15.36814546585083 (-5.723720073699951) | > avg_loss_duration: 3.2610584100087485 (-0.011334737141926787) | > avg_loss_1: 26.80022684733073 (-9.062724431355793)  > EPOCH: 1144/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:27:10)   --> TIME: 2023-10-20 14:27:27 -- STEP: 19/50 -- GLOBAL_STEP: 110220 | > loss_disc: 3.058397054672241 (2.447043908269782) | > loss_disc_real_0: 0.020805027335882187 (0.1366485499433781) | > loss_disc_real_1: 0.04514479264616966 (0.23745415261701533) | > loss_disc_real_2: 0.17033341526985168 (0.21869895234704018) | > loss_disc_real_3: 0.38338032364845276 (0.24342568277528412) | > loss_disc_real_4: 0.10665740817785263 (0.19708223670328917) | > loss_disc_real_5: 0.1735972762107849 (0.23075668788269946) | > loss_0: 3.058397054672241 (2.447043908269782) | > grad_norm_0: tensor(831.9913, device='cuda:0') (tensor(673.3491, device='cuda:0')) | > loss_gen: 1.5780208110809326 (2.4293802098224035) | > loss_kl: 0.7544238567352295 (0.8077645976292459) | > loss_feat: 8.580058097839355 (6.979382897776208) | > loss_mel: 23.19869613647461 (20.571041006790963) | > loss_duration: 1.49325692653656 (1.3426274563136855) | > loss_1: 35.60445785522461 (32.13019564277247) | > grad_norm_1: tensor(6068.8667, device='cuda:0') (tensor(21688.2344, device='cuda:0')) | > current_lr_0: 6.370390480295574e-05 | > current_lr_1: 6.37676445561409e-05 | > step_time: 0.7999 (0.6297071356522409) | > loader_time: 0.0139 (0.025560768027054637)  --> TIME: 2023-10-20 14:27:46 -- STEP: 49/50 -- GLOBAL_STEP: 110250 | > loss_disc: 2.851860284805298 (2.456400382275484) | > loss_disc_real_0: 0.10138657689094543 (0.13926422333686944) | > loss_disc_real_1: 0.2615419030189514 (0.22808821199043672) | > loss_disc_real_2: 0.33019399642944336 (0.21364938361304148) | > loss_disc_real_3: 0.30783048272132874 (0.23406902309127) | > loss_disc_real_4: 0.28505459427833557 (0.22418881443386174) | > loss_disc_real_5: 0.28291162848472595 (0.22874451333618895) | > loss_0: 2.851860284805298 (2.456400382275484) | > grad_norm_0: tensor(823.5893, device='cuda:0') (tensor(556.9332, device='cuda:0')) | > loss_gen: 1.9393579959869385 (2.3011644519105263) | > loss_kl: 0.46789565682411194 (0.7466453998064508) | > loss_feat: 1.6637696027755737 (5.887156482633888) | > loss_mel: 18.187759399414062 (19.899380975840046) | > loss_duration: 1.4069088697433472 (1.3174808706556047) | > loss_1: 23.66568946838379 (30.151827851120306) | > grad_norm_1: tensor(2314.9172, device='cuda:0') (tensor(17809.2969, device='cuda:0')) | > current_lr_0: 6.370390480295574e-05 | > current_lr_1: 6.37676445561409e-05 | > step_time: 0.548 (0.5980333552068592) | > loader_time: 0.4311 (0.02966021031749492)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7559616565704346 (2.7559616565704346) | > loss_disc_real_0: 0.36505311727523804 (0.36505311727523804) | > loss_disc_real_1: 0.24641504883766174 (0.24641504883766174) | > loss_disc_real_2: 0.34401950240135193 (0.34401950240135193) | > loss_disc_real_3: 0.27649158239364624 (0.27649158239364624) | > loss_disc_real_4: 0.15785138309001923 (0.15785138309001923) | > loss_disc_real_5: 0.37259116768836975 (0.37259116768836975) | > loss_0: 2.7559616565704346 (2.7559616565704346) | > loss_gen: 2.529787063598633 (2.529787063598633) | > loss_kl: 5.542634010314941 (5.542634010314941) | > loss_feat: 6.422070503234863 (6.422070503234863) | > loss_mel: 24.39258575439453 (24.39258575439453) | > loss_duration: 3.0739357471466064 (3.0739357471466064) | > loss_1: 41.96101379394531 (41.96101379394531)  --> STEP: 1 | > loss_disc: 1.6678638458251953 (1.6678638458251953) | > loss_disc_real_0: 0.03765791654586792 (0.03765791654586792) | > loss_disc_real_1: 0.09658540040254593 (0.09658540040254593) | > loss_disc_real_2: 0.13284289836883545 (0.13284289836883545) | > loss_disc_real_3: 0.08513016998767853 (0.08513016998767853) | > loss_disc_real_4: 0.1405939757823944 (0.1405939757823944) | > loss_disc_real_5: 0.11029048264026642 (0.11029048264026642) | > loss_0: 1.6678638458251953 (1.6678638458251953) | > loss_gen: 2.5262763500213623 (2.5262763500213623) | > loss_kl: 5.4299468994140625 (5.4299468994140625) | > loss_feat: 12.992884635925293 (12.992884635925293) | > loss_mel: 26.104961395263672 (26.104961395263672) | > loss_duration: 3.408137321472168 (3.408137321472168) | > loss_1: 50.46220779418945 (50.46220779418945)  --> STEP: 2 | > loss_disc: 2.953026294708252 (2.3104450702667236) | > loss_disc_real_0: 0.3096451759338379 (0.1736515462398529) | > loss_disc_real_1: 0.25765618681907654 (0.17712079361081123) | > loss_disc_real_2: 0.24986062943935394 (0.1913517639040947) | > loss_disc_real_3: 0.31934037804603577 (0.20223527401685715) | > loss_disc_real_4: 0.2694607079029083 (0.20502734184265137) | > loss_disc_real_5: 0.25757935643196106 (0.18393491953611374) | > loss_0: 2.953026294708252 (2.3104450702667236) | > loss_gen: 1.7406107187271118 (2.133443534374237) | > loss_kl: 5.617273330688477 (5.5236101150512695) | > loss_feat: 0.28952857851982117 (6.641206607222557) | > loss_mel: 8.133857727050781 (17.119409561157227) | > loss_duration: 3.241734504699707 (3.3249359130859375) | > loss_1: 19.02300453186035 (34.7426061630249)  --> STEP: 3 | > loss_disc: 3.164916515350342 (2.595268885294596) | > loss_disc_real_0: 0.558861494064331 (0.30205486218134564) | > loss_disc_real_1: 0.38196244835853577 (0.24540134519338608) | > loss_disc_real_2: 0.3243679106235504 (0.2356904794772466) | > loss_disc_real_3: 0.3538374900817871 (0.2527693460385005) | > loss_disc_real_4: 0.3252415060997009 (0.24509872992833456) | > loss_disc_real_5: 0.4436795115470886 (0.2705164502064387) | > loss_0: 3.164916515350342 (2.595268885294596) | > loss_gen: 2.670114040374756 (2.3123337030410767) | > loss_kl: 2.6856560707092285 (4.577625433603923) | > loss_feat: 3.5088579654693604 (5.597090393304825) | > loss_mel: 20.1566162109375 (18.131811777750652) | > loss_duration: 2.8799705505371094 (3.1766141255696616) | > loss_1: 31.901216506958008 (33.79547627766927) --> EVAL PERFORMANCE | > avg_loader_time: 0.0075715382893880205 (+0.005010445912679036) | > avg_loss_disc: 2.595268885294596 (-0.3460050423940024) | > avg_loss_disc_real_0: 0.30205486218134564 (+0.15145052721103033) | > avg_loss_disc_real_1: 0.24540134519338608 (-0.020466777185599028) | > avg_loss_disc_real_2: 0.2356904794772466 (-0.02733401954174039) | > avg_loss_disc_real_3: 0.2527693460385005 (+0.014185070991516141) | > avg_loss_disc_real_4: 0.24509872992833456 (-0.015102033813794463) | > avg_loss_disc_real_5: 0.2705164502064387 (-0.06707771122455597) | > avg_loss_0: 2.595268885294596 (-0.3460050423940024) | > avg_loss_gen: 2.3123337030410767 (+0.5503826936086018) | > avg_loss_kl: 4.577625433603923 (+0.031340599060058594) | > avg_loss_feat: 5.597090393304825 (+3.7343023642897606) | > avg_loss_mel: 18.131811777750652 (+2.763666311899822) | > avg_loss_duration: 3.1766141255696616 (-0.08444428443908691) | > avg_loss_1: 33.79547627766927 (+6.995249430338543)  > EPOCH: 1145/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:28:06)   --> TIME: 2023-10-20 14:28:28 -- STEP: 29/50 -- GLOBAL_STEP: 110280 | > loss_disc: 2.970829963684082 (2.387352199390017) | > loss_disc_real_0: 0.29988744854927063 (0.14256767133764667) | > loss_disc_real_1: 0.3012758195400238 (0.2043707154948136) | > loss_disc_real_2: 0.259880006313324 (0.21790419037229028) | > loss_disc_real_3: 0.32179972529411316 (0.22890982044668035) | > loss_disc_real_4: 0.27934515476226807 (0.20979057702011075) | > loss_disc_real_5: 0.2529790699481964 (0.21464358376146392) | > loss_0: 2.970829963684082 (2.387352199390017) | > grad_norm_0: tensor(2939.4336, device='cuda:0') (tensor(785.3902, device='cuda:0')) | > loss_gen: 1.7473372220993042 (2.3659340348736992) | > loss_kl: 0.7524901032447815 (0.7560412777138168) | > loss_feat: 0.40767499804496765 (6.48393866805167) | > loss_mel: 13.69166088104248 (21.204267431949752) | > loss_duration: 1.3144547939300537 (1.3396450897742962) | > loss_1: 17.913618087768555 (32.149826740396435) | > grad_norm_1: tensor(11636.4912, device='cuda:0') (tensor(25166.1055, device='cuda:0')) | > current_lr_0: 6.36402287616446e-05 | > current_lr_1: 6.370390480295574e-05 | > step_time: 0.2524 (0.5405059271845324) | > loader_time: 0.0018 (0.013797250287286166)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.541599750518799 (2.541599750518799) | > loss_disc_real_0: 0.05137521028518677 (0.05137521028518677) | > loss_disc_real_1: 0.24619844555854797 (0.24619844555854797) | > loss_disc_real_2: 0.2701927423477173 (0.2701927423477173) | > loss_disc_real_3: 0.22910581529140472 (0.22910581529140472) | > loss_disc_real_4: 0.21974234282970428 (0.21974234282970428) | > loss_disc_real_5: 0.21338596940040588 (0.21338596940040588) | > loss_0: 2.541599750518799 (2.541599750518799) | > loss_gen: 1.7446519136428833 (1.7446519136428833) | > loss_kl: 6.3561835289001465 (6.3561835289001465) | > loss_feat: 1.8964430093765259 (1.8964430093765259) | > loss_mel: 17.83658790588379 (17.83658790588379) | > loss_duration: 3.1317849159240723 (3.1317849159240723) | > loss_1: 30.96565055847168 (30.96565055847168)  --> STEP: 1 | > loss_disc: 2.89565372467041 (2.89565372467041) | > loss_disc_real_0: 0.16659989953041077 (0.16659989953041077) | > loss_disc_real_1: 0.27992263436317444 (0.27992263436317444) | > loss_disc_real_2: 0.2781873643398285 (0.2781873643398285) | > loss_disc_real_3: 0.2973882555961609 (0.2973882555961609) | > loss_disc_real_4: 0.22035039961338043 (0.22035039961338043) | > loss_disc_real_5: 0.2322205752134323 (0.2322205752134323) | > loss_0: 2.89565372467041 (2.89565372467041) | > loss_gen: 1.7192778587341309 (1.7192778587341309) | > loss_kl: 5.453086853027344 (5.453086853027344) | > loss_feat: 2.0706000328063965 (2.0706000328063965) | > loss_mel: 20.371305465698242 (20.371305465698242) | > loss_duration: 3.4787673950195312 (3.4787673950195312) | > loss_1: 33.093040466308594 (33.093040466308594)  --> STEP: 2 | > loss_disc: 2.8968868255615234 (2.896270275115967) | > loss_disc_real_0: 0.176223486661911 (0.1714116930961609) | > loss_disc_real_1: 0.2493586540222168 (0.2646406441926956) | > loss_disc_real_2: 0.22254109382629395 (0.2503642290830612) | > loss_disc_real_3: 0.2623160183429718 (0.27985213696956635) | > loss_disc_real_4: 0.20359395444393158 (0.211972177028656) | > loss_disc_real_5: 0.23120927810668945 (0.23171492666006088) | > loss_0: 2.8968868255615234 (2.896270275115967) | > loss_gen: 1.5330955982208252 (1.626186728477478) | > loss_kl: 6.201094627380371 (5.827090740203857) | > loss_feat: 1.4375755786895752 (1.7540878057479858) | > loss_mel: 22.816673278808594 (21.593989372253418) | > loss_duration: 3.301938056945801 (3.390352725982666) | > loss_1: 35.29037857055664 (34.19170951843262)  --> STEP: 3 | > loss_disc: 3.008924961090088 (2.9338218371073403) | > loss_disc_real_0: 0.1124359667301178 (0.1517531176408132) | > loss_disc_real_1: 0.27430078387260437 (0.2678606907526652) | > loss_disc_real_2: 0.23638342320919037 (0.2457039604584376) | > loss_disc_real_3: 0.243754580616951 (0.2678196181853612) | > loss_disc_real_4: 0.24161630868911743 (0.22185355424880981) | > loss_disc_real_5: 0.24588975310325623 (0.23643986880779266) | > loss_0: 3.008924961090088 (2.9338218371073403) | > loss_gen: 1.3909167051315308 (1.5477633873621623) | > loss_kl: 2.662780523300171 (4.772320667902629) | > loss_feat: 0.12385901808738708 (1.2106782098611195) | > loss_mel: 2.6476540565490723 (15.278544267018637) | > loss_duration: 3.035827159881592 (3.272177537282308) | > loss_1: 9.861038208007812 (26.081485748291016) --> EVAL PERFORMANCE | > avg_loader_time: 0.0071485042572021484 (-0.0004230340321858721) | > avg_loss_disc: 2.9338218371073403 (+0.33855295181274414) | > avg_loss_disc_real_0: 0.1517531176408132 (-0.15030174454053244) | > avg_loss_disc_real_1: 0.2678606907526652 (+0.022459345559279142) | > avg_loss_disc_real_2: 0.2457039604584376 (+0.01001348098119098) | > avg_loss_disc_real_3: 0.2678196181853612 (+0.015050272146860721) | > avg_loss_disc_real_4: 0.22185355424880981 (-0.02324517567952475) | > avg_loss_disc_real_5: 0.23643986880779266 (-0.034076581398646055) | > avg_loss_0: 2.9338218371073403 (+0.33855295181274414) | > avg_loss_gen: 1.5477633873621623 (-0.7645703156789143) | > avg_loss_kl: 4.772320667902629 (+0.19469523429870605) | > avg_loss_feat: 1.2106782098611195 (-4.3864121834437055) | > avg_loss_mel: 15.278544267018637 (-2.8532675107320156) | > avg_loss_duration: 3.272177537282308 (+0.09556341171264648) | > avg_loss_1: 26.081485748291016 (-7.713990529378258)  > EPOCH: 1146/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:28:47)   --> TIME: 2023-10-20 14:28:58 -- STEP: 9/50 -- GLOBAL_STEP: 110310 | > loss_disc: 2.8730993270874023 (2.62942992316352) | > loss_disc_real_0: 0.24275603890419006 (0.17670750121275583) | > loss_disc_real_1: 0.27287644147872925 (0.25515016002787483) | > loss_disc_real_2: 0.20264852046966553 (0.265927169058058) | > loss_disc_real_3: 0.24831543862819672 (0.21924502816465166) | > loss_disc_real_4: 0.2546628713607788 (0.2986925451291932) | > loss_disc_real_5: 0.2557958960533142 (0.2636628821492195) | > loss_0: 2.8730993270874023 (2.62942992316352) | > grad_norm_0: tensor(988.0017, device='cuda:0') (tensor(757.3817, device='cuda:0')) | > loss_gen: 1.6170169115066528 (2.290475712882148) | > loss_kl: 0.6473787426948547 (0.7143222909718234) | > loss_feat: 0.5326907634735107 (4.77109259698126) | > loss_mel: 5.2106757164001465 (17.40990612241957) | > loss_duration: 1.3228834867477417 (1.323095851474338) | > loss_1: 9.330645561218262 (26.508892059326172) | > grad_norm_1: tensor(6113.0757, device='cuda:0') (tensor(12798.5420, device='cuda:0')) | > current_lr_0: 6.357661636852346e-05 | > current_lr_1: 6.36402287616446e-05 | > step_time: 0.5895 (0.6097614500257704) | > loader_time: 0.011 (0.02490136358473036)  --> TIME: 2023-10-20 14:29:19 -- STEP: 39/50 -- GLOBAL_STEP: 110340 | > loss_disc: 3.0366170406341553 (2.400876476214483) | > loss_disc_real_0: 0.15009655058383942 (0.14624370204714632) | > loss_disc_real_1: 0.25822821259498596 (0.22313455196145254) | > loss_disc_real_2: 0.26757365465164185 (0.22323287564974564) | > loss_disc_real_3: 0.2537436783313751 (0.22499849589971396) | > loss_disc_real_4: 0.27289879322052 (0.22360878304029122) | > loss_disc_real_5: 0.28591811656951904 (0.19949161975334087) | > loss_0: 3.0366170406341553 (2.400876476214483) | > grad_norm_0: tensor(862.3024, device='cuda:0') (tensor(677.0566, device='cuda:0')) | > loss_gen: 1.5243438482284546 (2.2692308120238476) | > loss_kl: 0.5226278305053711 (0.764155580177127) | > loss_feat: 0.02085474692285061 (5.5302737183773365) | > loss_mel: 0.9511812329292297 (19.958859402399796) | > loss_duration: 1.3328955173492432 (1.3205983210832646) | > loss_1: 4.351902961730957 (29.843117665021847) | > grad_norm_1: tensor(79062.8594, device='cuda:0') (tensor(21734., device='cuda:0')) | > current_lr_0: 6.357661636852346e-05 | > current_lr_1: 6.36402287616446e-05 | > step_time: 0.7917 (0.645418448325915) | > loader_time: 0.0137 (0.02208130176250751)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1393494606018066 (3.1393494606018066) | > loss_disc_real_0: 0.2037196159362793 (0.2037196159362793) | > loss_disc_real_1: 0.3637295365333557 (0.3637295365333557) | > loss_disc_real_2: 0.3732895255088806 (0.3732895255088806) | > loss_disc_real_3: 0.28710228204727173 (0.28710228204727173) | > loss_disc_real_4: 0.2970874607563019 (0.2970874607563019) | > loss_disc_real_5: 0.3422008454799652 (0.3422008454799652) | > loss_0: 3.1393494606018066 (3.1393494606018066) | > loss_gen: 2.0889129638671875 (2.0889129638671875) | > loss_kl: 5.386936664581299 (5.386936664581299) | > loss_feat: 5.836905002593994 (5.836905002593994) | > loss_mel: 22.10006332397461 (22.10006332397461) | > loss_duration: 3.2164106369018555 (3.2164106369018555) | > loss_1: 38.62923049926758 (38.62923049926758)  --> STEP: 1 | > loss_disc: 2.9278645515441895 (2.9278645515441895) | > loss_disc_real_0: 0.1975976526737213 (0.1975976526737213) | > loss_disc_real_1: 0.252846360206604 (0.252846360206604) | > loss_disc_real_2: 0.27926284074783325 (0.27926284074783325) | > loss_disc_real_3: 0.2641875147819519 (0.2641875147819519) | > loss_disc_real_4: 0.2290220409631729 (0.2290220409631729) | > loss_disc_real_5: 0.253017395734787 (0.253017395734787) | > loss_0: 2.9278645515441895 (2.9278645515441895) | > loss_gen: 1.5566248893737793 (1.5566248893737793) | > loss_kl: 5.209123134613037 (5.209123134613037) | > loss_feat: 0.20816221833229065 (0.20816221833229065) | > loss_mel: 12.916560173034668 (12.916560173034668) | > loss_duration: 3.4332401752471924 (3.4332401752471924) | > loss_1: 23.323711395263672 (23.323711395263672)  --> STEP: 2 | > loss_disc: 3.008458375930786 (2.968161463737488) | > loss_disc_real_0: 0.2003171145915985 (0.1989573836326599) | > loss_disc_real_1: 0.25333136320114136 (0.2530888617038727) | > loss_disc_real_2: 0.2815225124359131 (0.28039267659187317) | > loss_disc_real_3: 0.26387283205986023 (0.26403017342090607) | > loss_disc_real_4: 0.22881190478801727 (0.2289169728755951) | > loss_disc_real_5: 0.25317516922950745 (0.2530962824821472) | > loss_0: 3.008458375930786 (2.968161463737488) | > loss_gen: 1.4846327304840088 (1.520628809928894) | > loss_kl: 5.8111724853515625 (5.5101478099823) | > loss_feat: 0.04494515061378479 (0.12655368447303772) | > loss_mel: 1.7982834577560425 (7.357421815395355) | > loss_duration: 3.3562865257263184 (3.3947633504867554) | > loss_1: 12.495321273803711 (17.90951633453369)  --> STEP: 3 | > loss_disc: 3.0646169185638428 (3.0003132820129395) | > loss_disc_real_0: 0.1307494193315506 (0.17622139553229013) | > loss_disc_real_1: 0.4100225865840912 (0.3054001033306122) | > loss_disc_real_2: 0.37464195489883423 (0.31180910269419354) | > loss_disc_real_3: 0.33341819047927856 (0.2871595124403636) | > loss_disc_real_4: 0.2299431413412094 (0.22925902903079987) | > loss_disc_real_5: 0.31609779596328735 (0.2740967869758606) | > loss_0: 3.0646169185638428 (3.0003132820129395) | > loss_gen: 1.9540575742721558 (1.6651050647099812) | > loss_kl: 2.7284176349639893 (4.582904418309529) | > loss_feat: 3.167315721511841 (1.1401410301526387) | > loss_mel: 22.784879684448242 (12.499907771746317) | > loss_duration: 3.0560808181762695 (3.2818691730499268) | > loss_1: 33.69075012207031 (23.1699275970459) --> EVAL PERFORMANCE | > avg_loader_time: 0.006220102310180664 (-0.0009284019470214844) | > avg_loss_disc: 3.0003132820129395 (+0.0664914449055991) | > avg_loss_disc_real_0: 0.17622139553229013 (+0.02446827789147693) | > avg_loss_disc_real_1: 0.3054001033306122 (+0.03753941257794696) | > avg_loss_disc_real_2: 0.31180910269419354 (+0.06610514223575595) | > avg_loss_disc_real_3: 0.2871595124403636 (+0.019339894255002377) | > avg_loss_disc_real_4: 0.22925902903079987 (+0.007405474781990051) | > avg_loss_disc_real_5: 0.2740967869758606 (+0.03765691816806793) | > avg_loss_0: 3.0003132820129395 (+0.0664914449055991) | > avg_loss_gen: 1.6651050647099812 (+0.11734167734781886) | > avg_loss_kl: 4.582904418309529 (-0.18941624959309955) | > avg_loss_feat: 1.1401410301526387 (-0.07053717970848083) | > avg_loss_mel: 12.499907771746317 (-2.7786364952723197) | > avg_loss_duration: 3.2818691730499268 (+0.009691635767618667) | > avg_loss_1: 23.1699275970459 (-2.911558151245117)  > EPOCH: 1147/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:29:44)   --> TIME: 2023-10-20 14:30:03 -- STEP: 19/50 -- GLOBAL_STEP: 110370 | > loss_disc: 1.6848968267440796 (2.422058055275365) | > loss_disc_real_0: 0.07230891287326813 (0.1470266221777389) | > loss_disc_real_1: 0.27443748712539673 (0.22952912806680328) | > loss_disc_real_2: 0.21115510165691376 (0.21492801038058182) | > loss_disc_real_3: 0.17781475186347961 (0.2295085173100233) | > loss_disc_real_4: 0.22278955578804016 (0.21407310890131875) | > loss_disc_real_5: 0.11294569820165634 (0.2058036287168139) | > loss_0: 1.6848968267440796 (2.422058055275365) | > grad_norm_0: tensor(370.2106, device='cuda:0') (tensor(796.7604, device='cuda:0')) | > loss_gen: 3.2230405807495117 (2.2623709001039205) | > loss_kl: 0.8168978095054626 (0.8358043510662881) | > loss_feat: 8.85970687866211 (5.0417781872184655) | > loss_mel: 23.817943572998047 (20.486905938700627) | > loss_duration: 1.3927069902420044 (1.344554248609041) | > loss_1: 38.11029815673828 (29.971413436688874) | > grad_norm_1: tensor(9490.9316, device='cuda:0') (tensor(19494.1348, device='cuda:0')) | > current_lr_0: 6.351306755997198e-05 | > current_lr_1: 6.357661636852346e-05 | > step_time: 0.8093 (0.6593813645212274) | > loader_time: 0.0313 (0.024540374153538755)  --> TIME: 2023-10-20 14:30:21 -- STEP: 49/50 -- GLOBAL_STEP: 110400 | > loss_disc: 1.9603525400161743 (2.4436194093859926) | > loss_disc_real_0: 0.09759417921304703 (0.137863672300413) | > loss_disc_real_1: 0.18758919835090637 (0.22557347944500494) | > loss_disc_real_2: 0.2171820104122162 (0.21459408522564538) | > loss_disc_real_3: 0.18898145854473114 (0.2240402509591409) | > loss_disc_real_4: 0.2505027651786804 (0.22367858791685835) | > loss_disc_real_5: 0.24184027314186096 (0.23170014968788138) | > loss_0: 1.9603525400161743 (2.4436194093859926) | > grad_norm_0: tensor(662.6807, device='cuda:0') (tensor(680.6347, device='cuda:0')) | > loss_gen: 3.1089096069335938 (2.2704685561510978) | > loss_kl: 0.6045302748680115 (0.7547244659187843) | > loss_feat: 7.0410847663879395 (5.48694397509098) | > loss_mel: 21.277122497558594 (20.886042332162663) | > loss_duration: 1.4183913469314575 (1.3182178662747752) | > loss_1: 33.45003890991211 (30.71639699352031) | > grad_norm_1: tensor(28112.0391, device='cuda:0') (tensor(15268.9307, device='cuda:0')) | > current_lr_0: 6.351306755997198e-05 | > current_lr_1: 6.357661636852346e-05 | > step_time: 0.5414 (0.6001064874687971) | > loader_time: 0.5678 (0.031955164306017816)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0022542476654053 (3.0022542476654053) | > loss_disc_real_0: 0.37600183486938477 (0.37600183486938477) | > loss_disc_real_1: 0.3090237081050873 (0.3090237081050873) | > loss_disc_real_2: 0.3892936110496521 (0.3892936110496521) | > loss_disc_real_3: 0.4936714768409729 (0.4936714768409729) | > loss_disc_real_4: 0.34110260009765625 (0.34110260009765625) | > loss_disc_real_5: 0.2515300214290619 (0.2515300214290619) | > loss_0: 3.0022542476654053 (3.0022542476654053) | > loss_gen: 2.638777017593384 (2.638777017593384) | > loss_kl: 5.192317962646484 (5.192317962646484) | > loss_feat: 6.598263740539551 (6.598263740539551) | > loss_mel: 21.650848388671875 (21.650848388671875) | > loss_duration: 3.077174425125122 (3.077174425125122) | > loss_1: 39.15738296508789 (39.15738296508789)  --> STEP: 1 | > loss_disc: 2.4548816680908203 (2.4548816680908203) | > loss_disc_real_0: 0.1351948380470276 (0.1351948380470276) | > loss_disc_real_1: 0.12169060111045837 (0.12169060111045837) | > loss_disc_real_2: 0.16170147061347961 (0.16170147061347961) | > loss_disc_real_3: 0.09048227965831757 (0.09048227965831757) | > loss_disc_real_4: 0.13678118586540222 (0.13678118586540222) | > loss_disc_real_5: 0.11369216442108154 (0.11369216442108154) | > loss_0: 2.4548816680908203 (2.4548816680908203) | > loss_gen: 1.5142652988433838 (1.5142652988433838) | > loss_kl: 5.533458709716797 (5.533458709716797) | > loss_feat: 6.534155368804932 (6.534155368804932) | > loss_mel: 26.942590713500977 (26.942590713500977) | > loss_duration: 3.4465885162353516 (3.4465885162353516) | > loss_1: 43.97106170654297 (43.97106170654297)  --> STEP: 2 | > loss_disc: 3.012636184692383 (2.7337589263916016) | > loss_disc_real_0: 0.30476146936416626 (0.21997815370559692) | > loss_disc_real_1: 0.2806921899318695 (0.20119139552116394) | > loss_disc_real_2: 0.2775454819202423 (0.21962347626686096) | > loss_disc_real_3: 0.24140985310077667 (0.16594606637954712) | > loss_disc_real_4: 0.24054153263568878 (0.1886613592505455) | > loss_disc_real_5: 0.2934333384037018 (0.20356275141239166) | > loss_0: 3.012636184692383 (2.7337589263916016) | > loss_gen: 1.6401257514953613 (1.5771955251693726) | > loss_kl: 6.046656608581543 (5.79005765914917) | > loss_feat: 0.007310396526008844 (3.2707328826654702) | > loss_mel: 0.592660665512085 (13.76762568950653) | > loss_duration: 3.4114084243774414 (3.4289984703063965) | > loss_1: 11.698161125183105 (27.834611415863037)  --> STEP: 3 | > loss_disc: 3.025230646133423 (2.830916166305542) | > loss_disc_real_0: 0.2676003575325012 (0.23585222164789835) | > loss_disc_real_1: 0.2749346196651459 (0.22577247023582458) | > loss_disc_real_2: 0.3606897294521332 (0.2666455606619517) | > loss_disc_real_3: 0.17997963726520538 (0.1706239233414332) | > loss_disc_real_4: 0.36332231760025024 (0.24688167870044708) | > loss_disc_real_5: 0.3751584589481354 (0.2607613205909729) | > loss_0: 3.025230646133423 (2.830916166305542) | > loss_gen: 1.9773156642913818 (1.710568904876709) | > loss_kl: 2.981444835662842 (4.8538533846537275) | > loss_feat: 3.4322965145111084 (3.3245874266140163) | > loss_mel: 20.87943458557129 (16.13822865486145) | > loss_duration: 3.192448377609253 (3.3501484394073486) | > loss_1: 32.46294021606445 (29.377387682596844) --> EVAL PERFORMANCE | > avg_loader_time: 0.016191800435384113 (+0.00997169812520345) | > avg_loss_disc: 2.830916166305542 (-0.16939711570739746) | > avg_loss_disc_real_0: 0.23585222164789835 (+0.059630826115608215) | > avg_loss_disc_real_1: 0.22577247023582458 (-0.0796276330947876) | > avg_loss_disc_real_2: 0.2666455606619517 (-0.04516354203224182) | > avg_loss_disc_real_3: 0.1706239233414332 (-0.11653558909893039) | > avg_loss_disc_real_4: 0.24688167870044708 (+0.017622649669647217) | > avg_loss_disc_real_5: 0.2607613205909729 (-0.013335466384887695) | > avg_loss_0: 2.830916166305542 (-0.16939711570739746) | > avg_loss_gen: 1.710568904876709 (+0.045463840166727776) | > avg_loss_kl: 4.8538533846537275 (+0.2709489663441982) | > avg_loss_feat: 3.3245874266140163 (+2.184446396461378) | > avg_loss_mel: 16.13822865486145 (+3.6383208831151332) | > avg_loss_duration: 3.3501484394073486 (+0.06827926635742188) | > avg_loss_1: 29.377387682596844 (+6.207460085550945)  > EPOCH: 1148/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:30:35)   --> TIME: 2023-10-20 14:30:56 -- STEP: 29/50 -- GLOBAL_STEP: 110430 | > loss_disc: 2.9709858894348145 (2.4176219701766968) | > loss_disc_real_0: 0.23166263103485107 (0.14812587085982848) | > loss_disc_real_1: 0.25368040800094604 (0.220051861271776) | > loss_disc_real_2: 0.2514391839504242 (0.21341550029043493) | > loss_disc_real_3: 0.24698425829410553 (0.21988957478054638) | > loss_disc_real_4: 0.2221924215555191 (0.23311396379923) | > loss_disc_real_5: 0.23874561488628387 (0.2536932398276082) | > loss_0: 2.9709858894348145 (2.4176219701766968) | > grad_norm_0: tensor(504.5404, device='cuda:0') (tensor(580.9532, device='cuda:0')) | > loss_gen: 1.5208536386489868 (2.402020470849398) | > loss_kl: 0.7919731140136719 (0.7317846014068045) | > loss_feat: 0.15505538880825043 (5.9940140861375575) | > loss_mel: 5.454712390899658 (20.175417410916296) | > loss_duration: 1.288504719734192 (1.327612519264221) | > loss_1: 9.211099624633789 (30.630849361419678) | > grad_norm_1: tensor(15876.3730, device='cuda:0') (tensor(22083.1504, device='cuda:0')) | > current_lr_0: 6.344958227243339e-05 | > current_lr_1: 6.351306755997198e-05 | > step_time: 0.3546 (0.5085561604335391) | > loader_time: 0.0096 (0.01640626479839457)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.351634979248047 (3.351634979248047) | > loss_disc_real_0: 0.46046826243400574 (0.46046826243400574) | > loss_disc_real_1: 0.3719238340854645 (0.3719238340854645) | > loss_disc_real_2: 0.5331148505210876 (0.5331148505210876) | > loss_disc_real_3: 0.4783034026622772 (0.4783034026622772) | > loss_disc_real_4: 0.31831955909729004 (0.31831955909729004) | > loss_disc_real_5: 0.3714219629764557 (0.3714219629764557) | > loss_0: 3.351634979248047 (3.351634979248047) | > loss_gen: 2.732034206390381 (2.732034206390381) | > loss_kl: 5.616732597351074 (5.616732597351074) | > loss_feat: 4.646162033081055 (4.646162033081055) | > loss_mel: 23.092382431030273 (23.092382431030273) | > loss_duration: 3.065451145172119 (3.065451145172119) | > loss_1: 39.15276336669922 (39.15276336669922)  --> STEP: 1 | > loss_disc: 1.4337533712387085 (1.4337533712387085) | > loss_disc_real_0: 0.10224010050296783 (0.10224010050296783) | > loss_disc_real_1: 0.13046641647815704 (0.13046641647815704) | > loss_disc_real_2: 0.10207608342170715 (0.10207608342170715) | > loss_disc_real_3: 0.10491090267896652 (0.10491090267896652) | > loss_disc_real_4: 0.10774876177310944 (0.10774876177310944) | > loss_disc_real_5: 0.07398150861263275 (0.07398150861263275) | > loss_0: 1.4337533712387085 (1.4337533712387085) | > loss_gen: 2.681666374206543 (2.681666374206543) | > loss_kl: 5.691131114959717 (5.691131114959717) | > loss_feat: 15.058170318603516 (15.058170318603516) | > loss_mel: 26.469524383544922 (26.469524383544922) | > loss_duration: 3.42960262298584 (3.42960262298584) | > loss_1: 53.33009719848633 (53.33009719848633)  --> STEP: 2 | > loss_disc: 3.6410281658172607 (2.5373907685279846) | > loss_disc_real_0: 0.7266594171524048 (0.4144497588276863) | > loss_disc_real_1: 0.2843843698501587 (0.20742539316415787) | > loss_disc_real_2: 0.309371680021286 (0.20572388172149658) | > loss_disc_real_3: 0.4955134391784668 (0.30021217092871666) | > loss_disc_real_4: 0.2413673847913742 (0.17455807328224182) | > loss_disc_real_5: 0.3356717526912689 (0.20482663065195084) | > loss_0: 3.6410281658172607 (2.5373907685279846) | > loss_gen: 2.3851609230041504 (2.5334136486053467) | > loss_kl: 5.758473873138428 (5.724802494049072) | > loss_feat: 7.061849117279053 (11.060009717941284) | > loss_mel: 21.687644958496094 (24.078584671020508) | > loss_duration: 3.33378267288208 (3.38169264793396) | > loss_1: 40.22691345214844 (46.77850532531738)  --> STEP: 3 | > loss_disc: 2.931162118911743 (2.668647885322571) | > loss_disc_real_0: 0.20896977186203003 (0.3459564298391342) | > loss_disc_real_1: 0.2659068703651428 (0.22691921889781952) | > loss_disc_real_2: 0.23168833553791046 (0.2143786996603012) | > loss_disc_real_3: 0.3015805184841156 (0.3006682867805163) | > loss_disc_real_4: 0.24183501303195953 (0.19698371986548105) | > loss_disc_real_5: 0.2485489547252655 (0.21940073867638907) | > loss_0: 2.931162118911743 (2.668647885322571) | > loss_gen: 1.575077772140503 (2.213968356450399) | > loss_kl: 2.8551363945007324 (4.768247127532959) | > loss_feat: 0.18906110525131226 (7.43636018037796) | > loss_mel: 3.6525416374206543 (17.269903659820557) | > loss_duration: 3.040915012359619 (3.268100102742513) | > loss_1: 11.312732696533203 (34.956581115722656) --> EVAL PERFORMANCE | > avg_loader_time: 0.03141887982686361 (+0.015227079391479496) | > avg_loss_disc: 2.668647885322571 (-0.1622682809829712) | > avg_loss_disc_real_0: 0.3459564298391342 (+0.11010420819123587) | > avg_loss_disc_real_1: 0.22691921889781952 (+0.001146748661994934) | > avg_loss_disc_real_2: 0.2143786996603012 (-0.05226686100165051) | > avg_loss_disc_real_3: 0.3006682867805163 (+0.13004436343908313) | > avg_loss_disc_real_4: 0.19698371986548105 (-0.04989795883496603) | > avg_loss_disc_real_5: 0.21940073867638907 (-0.04136058191458383) | > avg_loss_0: 2.668647885322571 (-0.1622682809829712) | > avg_loss_gen: 2.213968356450399 (+0.5033994515736899) | > avg_loss_kl: 4.768247127532959 (-0.08560625712076853) | > avg_loss_feat: 7.43636018037796 (+4.111772753763944) | > avg_loss_mel: 17.269903659820557 (+1.1316750049591064) | > avg_loss_duration: 3.268100102742513 (-0.08204833666483546) | > avg_loss_1: 34.956581115722656 (+5.579193433125813)  > EPOCH: 1149/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:31:21)   --> TIME: 2023-10-20 14:31:34 -- STEP: 9/50 -- GLOBAL_STEP: 110460 | > loss_disc: 2.9398458003997803 (2.0220642487208047) | > loss_disc_real_0: 0.2159084677696228 (0.1337488376431995) | > loss_disc_real_1: 0.2599891424179077 (0.19849741790029737) | > loss_disc_real_2: 0.24953801929950714 (0.21309664265977013) | > loss_disc_real_3: 0.2796837091445923 (0.24225068444179165) | > loss_disc_real_4: 0.2650986611843109 (0.1688890785185827) | > loss_disc_real_5: 0.2607179880142212 (0.16813756711781025) | > loss_0: 2.9398458003997803 (2.0220642487208047) | > grad_norm_0: tensor(803.0165, device='cuda:0') (tensor(413.3737, device='cuda:0')) | > loss_gen: 1.622066855430603 (2.6503367026646933) | > loss_kl: 0.5718387961387634 (0.5861412485440572) | > loss_feat: 0.20048381388187408 (7.7441516733831826) | > loss_mel: 2.87349009513855 (22.0071632332272) | > loss_duration: 1.2583897113800049 (1.3513884544372559) | > loss_1: 6.52626895904541 (34.33917988671197) | > grad_norm_1: tensor(24453.2266, device='cuda:0') (tensor(9147.7412, device='cuda:0')) | > current_lr_0: 6.338616044241446e-05 | > current_lr_1: 6.344958227243339e-05 | > step_time: 0.7123 (0.6025900575849745) | > loader_time: 0.0273 (0.02140400144788954)  --> TIME: 2023-10-20 14:31:51 -- STEP: 39/50 -- GLOBAL_STEP: 110490 | > loss_disc: 2.8657259941101074 (2.4772888085780997) | > loss_disc_real_0: 0.277140736579895 (0.13473410861423388) | > loss_disc_real_1: 0.2540898025035858 (0.23854614736942145) | > loss_disc_real_2: 0.3365682065486908 (0.22503523652752241) | > loss_disc_real_3: 0.30035316944122314 (0.25588248865917707) | > loss_disc_real_4: 0.24336107075214386 (0.23023166452558377) | > loss_disc_real_5: 0.2677195072174072 (0.23623457269217724) | > loss_0: 2.8657259941101074 (2.4772888085780997) | > grad_norm_0: tensor(657.3913, device='cuda:0') (tensor(676.0109, device='cuda:0')) | > loss_gen: 1.9299298524856567 (2.32485237182715) | > loss_kl: 0.4105408191680908 (0.7124585241843493) | > loss_feat: 0.898473858833313 (5.887184593348931) | > loss_mel: 13.783707618713379 (20.990409444539974) | > loss_duration: 1.4350759983062744 (1.327447622250288) | > loss_1: 18.457727432250977 (31.242352241124873) | > grad_norm_1: tensor(6361.2612, device='cuda:0') (tensor(13389.3740, device='cuda:0')) | > current_lr_0: 6.338616044241446e-05 | > current_lr_1: 6.344958227243339e-05 | > step_time: 0.3421 (0.5604592042091565) | > loader_time: 0.0024 (0.020668793947268765)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3220462799072266 (2.3220462799072266) | > loss_disc_real_0: 0.21204808354377747 (0.21204808354377747) | > loss_disc_real_1: 0.1721240133047104 (0.1721240133047104) | > loss_disc_real_2: 0.18405258655548096 (0.18405258655548096) | > loss_disc_real_3: 0.2518640458583832 (0.2518640458583832) | > loss_disc_real_4: 0.2220880687236786 (0.2220880687236786) | > loss_disc_real_5: 0.25200676918029785 (0.25200676918029785) | > loss_0: 2.3220462799072266 (2.3220462799072266) | > loss_gen: 2.52168607711792 (2.52168607711792) | > loss_kl: 5.431466102600098 (5.431466102600098) | > loss_feat: 9.745686531066895 (9.745686531066895) | > loss_mel: 22.244592666625977 (22.244592666625977) | > loss_duration: 3.079998254776001 (3.079998254776001) | > loss_1: 43.02342987060547 (43.02342987060547)  --> STEP: 1 | > loss_disc: 1.069643259048462 (1.069643259048462) | > loss_disc_real_0: 0.0070672170259058475 (0.0070672170259058475) | > loss_disc_real_1: 0.1377905160188675 (0.1377905160188675) | > loss_disc_real_2: 0.08524387329816818 (0.08524387329816818) | > loss_disc_real_3: 0.0471474751830101 (0.0471474751830101) | > loss_disc_real_4: 0.06703975796699524 (0.06703975796699524) | > loss_disc_real_5: 0.023300737142562866 (0.023300737142562866) | > loss_0: 1.069643259048462 (1.069643259048462) | > loss_gen: 3.644308567047119 (3.644308567047119) | > loss_kl: 5.3167595863342285 (5.3167595863342285) | > loss_feat: 14.969635963439941 (14.969635963439941) | > loss_mel: 26.775020599365234 (26.775020599365234) | > loss_duration: 3.4646785259246826 (3.4646785259246826) | > loss_1: 54.170406341552734 (54.170406341552734)  --> STEP: 2 | > loss_disc: 2.998817205429077 (2.0342302322387695) | > loss_disc_real_0: 0.2289486825466156 (0.11800794978626072) | > loss_disc_real_1: 0.2511119246482849 (0.1944512203335762) | > loss_disc_real_2: 0.22332370281219482 (0.1542837880551815) | > loss_disc_real_3: 0.23490935564041138 (0.14102841541171074) | > loss_disc_real_4: 0.25436896085739136 (0.1607043594121933) | > loss_disc_real_5: 0.25467148423194885 (0.13898611068725586) | > loss_0: 2.998817205429077 (2.0342302322387695) | > loss_gen: 1.4535505771636963 (2.5489295721054077) | > loss_kl: 5.928133964538574 (5.622446775436401) | > loss_feat: 0.019073212519288063 (7.494354587979615) | > loss_mel: 1.398687481880188 (14.086854040622711) | > loss_duration: 3.16872501373291 (3.3167017698287964) | > loss_1: 11.968170166015625 (33.06928825378418)  --> STEP: 3 | > loss_disc: 2.3134329319000244 (2.127297798792521) | > loss_disc_real_0: 0.22572289407253265 (0.15391293121501803) | > loss_disc_real_1: 0.18673227727413177 (0.19187823931376138) | > loss_disc_real_2: 0.1667167842388153 (0.15842812011639276) | > loss_disc_real_3: 0.2556036412715912 (0.1792201573650042) | > loss_disc_real_4: 0.0728815346956253 (0.13143008450667062) | > loss_disc_real_5: 0.10255628824234009 (0.1268428365389506) | > loss_0: 2.3134329319000244 (2.127297798792521) | > loss_gen: 1.974238634109497 (2.357365926106771) | > loss_kl: 2.993781566619873 (4.746225039164226) | > loss_feat: 5.7151875495910645 (6.901298908516765) | > loss_mel: 24.68185806274414 (17.61852204799652) | > loss_duration: 3.0817019939422607 (3.238368511199951) | > loss_1: 38.44676971435547 (34.86178207397461) --> EVAL PERFORMANCE | > avg_loader_time: 0.012491544087727865 (-0.018927335739135742) | > avg_loss_disc: 2.127297798792521 (-0.5413500865300498) | > avg_loss_disc_real_0: 0.15391293121501803 (-0.19204349862411618) | > avg_loss_disc_real_1: 0.19187823931376138 (-0.035040979584058135) | > avg_loss_disc_real_2: 0.15842812011639276 (-0.055950579543908446) | > avg_loss_disc_real_3: 0.1792201573650042 (-0.12144812941551211) | > avg_loss_disc_real_4: 0.13143008450667062 (-0.06555363535881042) | > avg_loss_disc_real_5: 0.1268428365389506 (-0.09255790213743847) | > avg_loss_0: 2.127297798792521 (-0.5413500865300498) | > avg_loss_gen: 2.357365926106771 (+0.14339756965637207) | > avg_loss_kl: 4.746225039164226 (-0.022022088368733428) | > avg_loss_feat: 6.901298908516765 (-0.5350612718611956) | > avg_loss_mel: 17.61852204799652 (+0.34861838817596436) | > avg_loss_duration: 3.238368511199951 (-0.029731591542561997) | > avg_loss_1: 34.86178207397461 (-0.09479904174804688)  > EPOCH: 1150/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:32:17)   --> TIME: 2023-10-20 14:32:33 -- STEP: 19/50 -- GLOBAL_STEP: 110520 | > loss_disc: 2.6447291374206543 (2.619459127124987) | > loss_disc_real_0: 0.2957434058189392 (0.17283908625770555) | > loss_disc_real_1: 0.22258718311786652 (0.23460987131846578) | > loss_disc_real_2: 0.283613920211792 (0.26126553314296824) | > loss_disc_real_3: 0.3222667872905731 (0.2545576538694532) | > loss_disc_real_4: 0.17732204496860504 (0.23487727716565132) | > loss_disc_real_5: 0.1486179679632187 (0.24273054929156052) | > loss_0: 2.6447291374206543 (2.619459127124987) | > grad_norm_0: tensor(916.0953, device='cuda:0') (tensor(657.8032, device='cuda:0')) | > loss_gen: 2.1574394702911377 (2.0837813866765877) | > loss_kl: 0.9134387969970703 (0.8676017538497323) | > loss_feat: 4.62484073638916 (4.085834945699102) | > loss_mel: 19.685333251953125 (19.356144741961835) | > loss_duration: 1.411010980606079 (1.3404615427318372) | > loss_1: 28.792064666748047 (27.73382478011282) | > grad_norm_1: tensor(10495.7168, device='cuda:0') (tensor(16644.1445, device='cuda:0')) | > current_lr_0: 6.332280200648545e-05 | > current_lr_1: 6.338616044241446e-05 | > step_time: 0.4831 (0.5208917918958162) | > loader_time: 0.0099 (0.021303227073267886)  --> TIME: 2023-10-20 14:32:47 -- STEP: 49/50 -- GLOBAL_STEP: 110550 | > loss_disc: 2.667405128479004 (2.5114834454594828) | > loss_disc_real_0: 0.08419118821620941 (0.1597644674344635) | > loss_disc_real_1: 0.2615099251270294 (0.22503735231501715) | > loss_disc_real_2: 0.277429461479187 (0.23384286250386918) | > loss_disc_real_3: 0.23108254373073578 (0.23379710902060782) | > loss_disc_real_4: 0.3040439188480377 (0.22202477011145377) | > loss_disc_real_5: 0.36688390374183655 (0.22151014900633267) | > loss_0: 2.667405128479004 (2.5114834454594828) | > grad_norm_0: tensor(932.8839, device='cuda:0') (tensor(599.9663, device='cuda:0')) | > loss_gen: 2.09370756149292 (2.181081759686373) | > loss_kl: 0.7189878821372986 (0.8384299950332058) | > loss_feat: 2.98134183883667 (5.221498914367081) | > loss_mel: 19.971141815185547 (19.62902456400346) | > loss_duration: 1.4185737371444702 (1.3275557172541712) | > loss_1: 27.183752059936523 (29.197591032300675) | > grad_norm_1: tensor(6033.5288, device='cuda:0') (tensor(17713.8965, device='cuda:0')) | > current_lr_0: 6.332280200648545e-05 | > current_lr_1: 6.338616044241446e-05 | > step_time: 0.5329 (0.4694091592516218) | > loader_time: 0.4152 (0.022060433212591678)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9589142799377441 (1.9589142799377441) | > loss_disc_real_0: 0.1251879334449768 (0.1251879334449768) | > loss_disc_real_1: 0.2112569361925125 (0.2112569361925125) | > loss_disc_real_2: 0.20665057003498077 (0.20665057003498077) | > loss_disc_real_3: 0.2428429126739502 (0.2428429126739502) | > loss_disc_real_4: 0.1771710067987442 (0.1771710067987442) | > loss_disc_real_5: 0.1381637156009674 (0.1381637156009674) | > loss_0: 1.9589142799377441 (1.9589142799377441) | > loss_gen: 2.8527982234954834 (2.8527982234954834) | > loss_kl: 5.4227471351623535 (5.4227471351623535) | > loss_feat: 8.833616256713867 (8.833616256713867) | > loss_mel: 23.785837173461914 (23.785837173461914) | > loss_duration: 3.071955680847168 (3.071955680847168) | > loss_1: 43.96695327758789 (43.96695327758789)  --> STEP: 1 | > loss_disc: 2.9110660552978516 (2.9110660552978516) | > loss_disc_real_0: 0.3799767792224884 (0.3799767792224884) | > loss_disc_real_1: 0.4738449454307556 (0.4738449454307556) | > loss_disc_real_2: 0.3725636303424835 (0.3725636303424835) | > loss_disc_real_3: 0.33678707480430603 (0.33678707480430603) | > loss_disc_real_4: 0.19327600300312042 (0.19327600300312042) | > loss_disc_real_5: 0.10645154863595963 (0.10645154863595963) | > loss_0: 2.9110660552978516 (2.9110660552978516) | > loss_gen: 2.335423469543457 (2.335423469543457) | > loss_kl: 5.626213073730469 (5.626213073730469) | > loss_feat: 7.0709228515625 (7.0709228515625) | > loss_mel: 23.408761978149414 (23.408761978149414) | > loss_duration: 3.365074872970581 (3.365074872970581) | > loss_1: 41.806392669677734 (41.806392669677734)  --> STEP: 2 | > loss_disc: 2.541935920715332 (2.726500988006592) | > loss_disc_real_0: 0.21606439352035522 (0.2980205863714218) | > loss_disc_real_1: 0.20307190716266632 (0.33845842629671097) | > loss_disc_real_2: 0.3262275457382202 (0.34939558804035187) | > loss_disc_real_3: 0.14215201139450073 (0.23946954309940338) | > loss_disc_real_4: 0.20079411566257477 (0.1970350593328476) | > loss_disc_real_5: 0.3461667597293854 (0.2263091541826725) | > loss_0: 2.541935920715332 (2.726500988006592) | > loss_gen: 2.4424164295196533 (2.388919949531555) | > loss_kl: 5.677117824554443 (5.651665449142456) | > loss_feat: 7.571640968322754 (7.321281909942627) | > loss_mel: 26.613292694091797 (25.011027336120605) | > loss_duration: 3.294553756713867 (3.329814314842224) | > loss_1: 45.599021911621094 (43.702707290649414)  --> STEP: 3 | > loss_disc: 2.4988489151000977 (2.6506169637044272) | > loss_disc_real_0: 0.16462652385234833 (0.25355589886506397) | > loss_disc_real_1: 0.25914308428764343 (0.3120199789603551) | > loss_disc_real_2: 0.23547133803367615 (0.31142083803812665) | > loss_disc_real_3: 0.22895129024982452 (0.23596345881621042) | > loss_disc_real_4: 0.20699019730091095 (0.20035343865553537) | > loss_disc_real_5: 0.19247378408908844 (0.21503069748481116) | > loss_0: 2.4988489151000977 (2.6506169637044272) | > loss_gen: 2.1843948364257812 (2.3207449118296304) | > loss_kl: 2.751492500305176 (4.684941132863362) | > loss_feat: 4.964907169342041 (6.535823663075765) | > loss_mel: 24.738365173339844 (24.92013994852702) | > loss_duration: 2.9650590419769287 (3.2082292238871255) | > loss_1: 37.604217529296875 (41.66987737019857) --> EVAL PERFORMANCE | > avg_loader_time: 0.003556330998738607 (-0.008935213088989258) | > avg_loss_disc: 2.6506169637044272 (+0.5233191649119062) | > avg_loss_disc_real_0: 0.25355589886506397 (+0.09964296765004593) | > avg_loss_disc_real_1: 0.3120199789603551 (+0.12014173964659372) | > avg_loss_disc_real_2: 0.31142083803812665 (+0.15299271792173388) | > avg_loss_disc_real_3: 0.23596345881621042 (+0.05674330145120621) | > avg_loss_disc_real_4: 0.20035343865553537 (+0.06892335414886475) | > avg_loss_disc_real_5: 0.21503069748481116 (+0.08818786094586056) | > avg_loss_0: 2.6506169637044272 (+0.5233191649119062) | > avg_loss_gen: 2.3207449118296304 (-0.036621014277140596) | > avg_loss_kl: 4.684941132863362 (-0.06128390630086322) | > avg_loss_feat: 6.535823663075765 (-0.36547524544099996) | > avg_loss_mel: 24.92013994852702 (+7.301617900530498) | > avg_loss_duration: 3.2082292238871255 (-0.03013928731282567) | > avg_loss_1: 41.66987737019857 (+6.808095296223961)  > EPOCH: 1151/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:33:05)   --> TIME: 2023-10-20 14:33:30 -- STEP: 29/50 -- GLOBAL_STEP: 110580 | > loss_disc: 2.7441444396972656 (2.2605781966242295) | > loss_disc_real_0: 0.13115574419498444 (0.13356309353598744) | > loss_disc_real_1: 0.26271572709083557 (0.20347262662032556) | > loss_disc_real_2: 0.231591135263443 (0.20250129391407146) | > loss_disc_real_3: 0.2740058898925781 (0.22795667184581017) | > loss_disc_real_4: 0.25694599747657776 (0.2177519496722982) | > loss_disc_real_5: 0.23916161060333252 (0.2051172278468208) | > loss_0: 2.7441444396972656 (2.2605781966242295) | > grad_norm_0: tensor(671.7102, device='cuda:0') (tensor(517.1796, device='cuda:0')) | > loss_gen: 1.7749378681182861 (2.543365042785118) | > loss_kl: 0.6172658205032349 (0.8013939456693058) | > loss_feat: 1.2897124290466309 (7.1740803289516215) | > loss_mel: 17.84113121032715 (23.42376996730936) | > loss_duration: 1.3096867799758911 (1.333535490364864) | > loss_1: 22.832735061645508 (35.276144948498946) | > grad_norm_1: tensor(2613.2505, device='cuda:0') (tensor(18007.2207, device='cuda:0')) | > current_lr_0: 6.325950690127996e-05 | > current_lr_1: 6.332280200648545e-05 | > step_time: 0.4217 (0.6215007716211782) | > loader_time: 0.011 (0.021837283825052196)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1749444007873535 (2.1749444007873535) | > loss_disc_real_0: 0.3425588607788086 (0.3425588607788086) | > loss_disc_real_1: 0.2891581356525421 (0.2891581356525421) | > loss_disc_real_2: 0.20948444306850433 (0.20948444306850433) | > loss_disc_real_3: 0.3145371973514557 (0.3145371973514557) | > loss_disc_real_4: 0.20237195491790771 (0.20237195491790771) | > loss_disc_real_5: 0.1430819183588028 (0.1430819183588028) | > loss_0: 2.1749444007873535 (2.1749444007873535) | > loss_gen: 3.485098361968994 (3.485098361968994) | > loss_kl: 5.1892499923706055 (5.1892499923706055) | > loss_feat: 9.425810813903809 (9.425810813903809) | > loss_mel: 21.514019012451172 (21.514019012451172) | > loss_duration: 3.1302194595336914 (3.1302194595336914) | > loss_1: 42.74440002441406 (42.74440002441406)  --> STEP: 1 | > loss_disc: 3.081878900527954 (3.081878900527954) | > loss_disc_real_0: 0.4842219352722168 (0.4842219352722168) | > loss_disc_real_1: 0.257823646068573 (0.257823646068573) | > loss_disc_real_2: 0.3001445531845093 (0.3001445531845093) | > loss_disc_real_3: 0.2204098403453827 (0.2204098403453827) | > loss_disc_real_4: 0.26358306407928467 (0.26358306407928467) | > loss_disc_real_5: 0.2494744062423706 (0.2494744062423706) | > loss_0: 3.081878900527954 (3.081878900527954) | > loss_gen: 1.7794725894927979 (1.7794725894927979) | > loss_kl: 4.975390434265137 (4.975390434265137) | > loss_feat: 0.05349183455109596 (0.05349183455109596) | > loss_mel: 5.954140663146973 (5.954140663146973) | > loss_duration: 3.3836920261383057 (3.3836920261383057) | > loss_1: 16.14618682861328 (16.14618682861328)  --> STEP: 2 | > loss_disc: 2.7798032760620117 (2.930841088294983) | > loss_disc_real_0: 0.5511734485626221 (0.5176976919174194) | > loss_disc_real_1: 0.2890952527523041 (0.27345944941043854) | > loss_disc_real_2: 0.3306407034397125 (0.3153926283121109) | > loss_disc_real_3: 0.3243694007396698 (0.27238962054252625) | > loss_disc_real_4: 0.3236438035964966 (0.2936134338378906) | > loss_disc_real_5: 0.28594261407852173 (0.26770851016044617) | > loss_0: 2.7798032760620117 (2.930841088294983) | > loss_gen: 3.1400036811828613 (2.4597381353378296) | > loss_kl: 5.995532512664795 (5.485461473464966) | > loss_feat: 4.9209065437316895 (2.4871991891413927) | > loss_mel: 27.508827209472656 (16.731483936309814) | > loss_duration: 3.2858293056488037 (3.3347606658935547) | > loss_1: 44.851097106933594 (30.498641967773438)  --> STEP: 3 | > loss_disc: 3.4162328243255615 (3.0926383336385093) | > loss_disc_real_0: 0.5048180818557739 (0.5134044885635376) | > loss_disc_real_1: 0.23786886036396027 (0.2615959197282791) | > loss_disc_real_2: 0.3018837571144104 (0.31088967124621075) | > loss_disc_real_3: 0.31837180256843567 (0.2877170145511627) | > loss_disc_real_4: 0.3769364058971405 (0.32138775785764057) | > loss_disc_real_5: 0.4621106684207916 (0.33250922958056134) | > loss_0: 3.4162328243255615 (3.0926383336385093) | > loss_gen: 2.0874433517456055 (2.3356398741404214) | > loss_kl: 2.8922338485717773 (4.621052265167236) | > loss_feat: 2.5539941787719727 (2.5094641856849194) | > loss_mel: 18.900606155395508 (17.454524676005047) | > loss_duration: 3.0093867778778076 (3.226302703221639) | > loss_1: 29.443662643432617 (30.146982192993164) --> EVAL PERFORMANCE | > avg_loader_time: 0.020014127095540363 (+0.016457796096801758) | > avg_loss_disc: 3.0926383336385093 (+0.44202136993408203) | > avg_loss_disc_real_0: 0.5134044885635376 (+0.25984858969847363) | > avg_loss_disc_real_1: 0.2615959197282791 (-0.05042405923207599) | > avg_loss_disc_real_2: 0.31088967124621075 (-0.0005311667919158936) | > avg_loss_disc_real_3: 0.2877170145511627 (+0.0517535557349523) | > avg_loss_disc_real_4: 0.32138775785764057 (+0.1210343192021052) | > avg_loss_disc_real_5: 0.33250922958056134 (+0.11747853209575018) | > avg_loss_0: 3.0926383336385093 (+0.44202136993408203) | > avg_loss_gen: 2.3356398741404214 (+0.014894962310791016) | > avg_loss_kl: 4.621052265167236 (-0.063888867696126) | > avg_loss_feat: 2.5094641856849194 (-4.026359477390845) | > avg_loss_mel: 17.454524676005047 (-7.465615272521973) | > avg_loss_duration: 3.226302703221639 (+0.018073479334513642) | > avg_loss_1: 30.146982192993164 (-11.522895177205406)  > EPOCH: 1152/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:34:00)   --> TIME: 2023-10-20 14:34:10 -- STEP: 9/50 -- GLOBAL_STEP: 110610 | > loss_disc: 2.4747111797332764 (2.2865202824274697) | > loss_disc_real_0: 0.1475694477558136 (0.17187282091213596) | > loss_disc_real_1: 0.22038647532463074 (0.25849805772304535) | > loss_disc_real_2: 0.22309961915016174 (0.2210129184855355) | > loss_disc_real_3: 0.20241017639636993 (0.22401943554480871) | > loss_disc_real_4: 0.13612054288387299 (0.178610031803449) | > loss_disc_real_5: 0.117893286049366 (0.1645948609544171) | > loss_0: 2.4747111797332764 (2.2865202824274697) | > grad_norm_0: tensor(649.2319, device='cuda:0') (tensor(541.0308, device='cuda:0')) | > loss_gen: 1.6270755529403687 (2.507537457678053) | > loss_kl: 0.6854161024093628 (0.8955654170778062) | > loss_feat: 2.2069616317749023 (6.638892164350384) | > loss_mel: 18.286516189575195 (19.79334162341224) | > loss_duration: 1.3163725137710571 (1.3229060702853732) | > loss_1: 24.12234115600586 (31.15824317932129) | > grad_norm_1: tensor(4287.6006, device='cuda:0') (tensor(23127.8047, device='cuda:0')) | > current_lr_0: 6.3196275063495e-05 | > current_lr_1: 6.325950690127996e-05 | > step_time: 0.5063 (0.5470810731252035) | > loader_time: 0.0147 (0.015159262551201714)  --> TIME: 2023-10-20 14:34:23 -- STEP: 39/50 -- GLOBAL_STEP: 110640 | > loss_disc: 2.951070785522461 (2.397722262602586) | > loss_disc_real_0: 0.26379773020744324 (0.13258427925981003) | > loss_disc_real_1: 0.22386005520820618 (0.23025923346479735) | > loss_disc_real_2: 0.25291380286216736 (0.22176336525724485) | > loss_disc_real_3: 0.2442323863506317 (0.22581776986137414) | > loss_disc_real_4: 0.2333340346813202 (0.22506804229357305) | > loss_disc_real_5: 0.25581520795822144 (0.21240824417999157) | > loss_0: 2.951070785522461 (2.397722262602586) | > grad_norm_0: tensor(578.1315, device='cuda:0') (tensor(643.9569, device='cuda:0')) | > loss_gen: 1.5613046884536743 (2.3838408146149073) | > loss_kl: 0.36177921295166016 (0.8606364165361111) | > loss_feat: 0.16669993102550507 (6.168586074279096) | > loss_mel: 2.077342987060547 (20.63995204522059) | > loss_duration: 1.4093197584152222 (1.3246571925970225) | > loss_1: 5.576446533203125 (31.377672782311073) | > grad_norm_1: tensor(21046.0078, device='cuda:0') (tensor(18183.2109, device='cuda:0')) | > current_lr_0: 6.3196275063495e-05 | > current_lr_1: 6.325950690127996e-05 | > step_time: 0.3428 (0.4485309368524796) | > loader_time: 0.0055 (0.012005023467235075)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.784435510635376 (2.784435510635376) | > loss_disc_real_0: 0.11097642779350281 (0.11097642779350281) | > loss_disc_real_1: 0.25973281264305115 (0.25973281264305115) | > loss_disc_real_2: 0.2962774336338043 (0.2962774336338043) | > loss_disc_real_3: 0.268351674079895 (0.268351674079895) | > loss_disc_real_4: 0.3026677668094635 (0.3026677668094635) | > loss_disc_real_5: 0.2559826076030731 (0.2559826076030731) | > loss_0: 2.784435510635376 (2.784435510635376) | > loss_gen: 1.7452154159545898 (1.7452154159545898) | > loss_kl: 5.344879150390625 (5.344879150390625) | > loss_feat: 0.658290445804596 (0.658290445804596) | > loss_mel: 17.647233963012695 (17.647233963012695) | > loss_duration: 3.1382856369018555 (3.1382856369018555) | > loss_1: 28.533905029296875 (28.533905029296875)  --> STEP: 1 | > loss_disc: 2.6959869861602783 (2.6959869861602783) | > loss_disc_real_0: 0.15828898549079895 (0.15828898549079895) | > loss_disc_real_1: 0.3228711783885956 (0.3228711783885956) | > loss_disc_real_2: 0.24283041059970856 (0.24283041059970856) | > loss_disc_real_3: 0.4010190963745117 (0.4010190963745117) | > loss_disc_real_4: 0.2273428738117218 (0.2273428738117218) | > loss_disc_real_5: 0.3109029531478882 (0.3109029531478882) | > loss_0: 2.6959869861602783 (2.6959869861602783) | > loss_gen: 2.6517577171325684 (2.6517577171325684) | > loss_kl: 5.006264686584473 (5.006264686584473) | > loss_feat: 6.579394817352295 (6.579394817352295) | > loss_mel: 25.945680618286133 (25.945680618286133) | > loss_duration: 3.4722843170166016 (3.4722843170166016) | > loss_1: 43.65538024902344 (43.65538024902344)  --> STEP: 2 | > loss_disc: 1.9486720561981201 (2.322329521179199) | > loss_disc_real_0: 0.30066800117492676 (0.22947849333286285) | > loss_disc_real_1: 0.20991256833076477 (0.2663918733596802) | > loss_disc_real_2: 0.18026423454284668 (0.21154732257127762) | > loss_disc_real_3: 0.1423238217830658 (0.27167145907878876) | > loss_disc_real_4: 0.0806279331445694 (0.1539854034781456) | > loss_disc_real_5: 0.14341892302036285 (0.22716093808412552) | > loss_0: 1.9486720561981201 (2.322329521179199) | > loss_gen: 3.0455338954925537 (2.848645806312561) | > loss_kl: 6.200210094451904 (5.6032373905181885) | > loss_feat: 10.973527908325195 (8.776461362838745) | > loss_mel: 22.064687728881836 (24.005184173583984) | > loss_duration: 3.241222381591797 (3.356753349304199) | > loss_1: 45.52518081665039 (44.590280532836914)  --> STEP: 3 | > loss_disc: 2.519721031188965 (2.3881266911824546) | > loss_disc_real_0: 0.11131991446018219 (0.19009230037530264) | > loss_disc_real_1: 0.17226989567279816 (0.23501788079738617) | > loss_disc_real_2: 0.23929840326309204 (0.22079768280188242) | > loss_disc_real_3: 0.24853065609931946 (0.2639578580856323) | > loss_disc_real_4: 0.21866030991077423 (0.17554370562235513) | > loss_disc_real_5: 0.2740369141101837 (0.24278626342614493) | > loss_0: 2.519721031188965 (2.3881266911824546) | > loss_gen: 1.96089768409729 (2.552729765574137) | > loss_kl: 2.7463879585266113 (4.650954246520996) | > loss_feat: 4.1004533767700195 (7.21779203414917) | > loss_mel: 20.97866439819336 (22.996344248453777) | > loss_duration: 3.0703787803649902 (3.2612951596577964) | > loss_1: 32.856781005859375 (40.6791140238444) --> EVAL PERFORMANCE | > avg_loader_time: 0.031296888987223305 (+0.011282761891682942) | > avg_loss_disc: 2.3881266911824546 (-0.7045116424560547) | > avg_loss_disc_real_0: 0.19009230037530264 (-0.32331218818823493) | > avg_loss_disc_real_1: 0.23501788079738617 (-0.026578038930892944) | > avg_loss_disc_real_2: 0.22079768280188242 (-0.09009198844432834) | > avg_loss_disc_real_3: 0.2639578580856323 (-0.023759156465530396) | > avg_loss_disc_real_4: 0.17554370562235513 (-0.14584405223528543) | > avg_loss_disc_real_5: 0.24278626342614493 (-0.08972296615441641) | > avg_loss_0: 2.3881266911824546 (-0.7045116424560547) | > avg_loss_gen: 2.552729765574137 (+0.21708989143371582) | > avg_loss_kl: 4.650954246520996 (+0.029901981353759766) | > avg_loss_feat: 7.21779203414917 (+4.708327848464251) | > avg_loss_mel: 22.996344248453777 (+5.5418195724487305) | > avg_loss_duration: 3.2612951596577964 (+0.03499245643615723) | > avg_loss_1: 40.6791140238444 (+10.532131830851235)  > EPOCH: 1153/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:34:43)   --> TIME: 2023-10-20 14:35:01 -- STEP: 19/50 -- GLOBAL_STEP: 110670 | > loss_disc: 1.966301679611206 (2.465618949187429) | > loss_disc_real_0: 0.060111578553915024 (0.1560990451590011) | > loss_disc_real_1: 0.16163840889930725 (0.23348355881477656) | > loss_disc_real_2: 0.09691182523965836 (0.24434305452986768) | > loss_disc_real_3: 0.16734056174755096 (0.25332375851116684) | > loss_disc_real_4: 0.12904588878154755 (0.20343124866485596) | > loss_disc_real_5: 0.15525703132152557 (0.21739353259143077) | > loss_0: 1.966301679611206 (2.465618949187429) | > grad_norm_0: tensor(289.4276, device='cuda:0') (tensor(636.6902, device='cuda:0')) | > loss_gen: 2.4082531929016113 (2.260435418078774) | > loss_kl: 0.9190834164619446 (0.9606021266234549) | > loss_feat: 9.95638370513916 (5.079890634962602) | > loss_mel: 26.084182739257812 (19.662953417552146) | > loss_duration: 1.4585309028625488 (1.3390251209861355) | > loss_1: 40.82643127441406 (29.30290691476119) | > grad_norm_1: tensor(17211.2480, device='cuda:0') (tensor(30281.7598, device='cuda:0')) | > current_lr_0: 6.31331064298908e-05 | > current_lr_1: 6.3196275063495e-05 | > step_time: 0.5569 (0.6272486887480083) | > loader_time: 0.0286 (0.02279546386317203)  --> TIME: 2023-10-20 14:35:22 -- STEP: 49/50 -- GLOBAL_STEP: 110700 | > loss_disc: 2.529557228088379 (2.5143180453047456) | > loss_disc_real_0: 0.10115136951208115 (0.14554676219668924) | > loss_disc_real_1: 0.21307511627674103 (0.229509170718339) | > loss_disc_real_2: 0.2362871617078781 (0.229797933326692) | > loss_disc_real_3: 0.23564261198043823 (0.24045602954467948) | > loss_disc_real_4: 0.37697097659111023 (0.2298449125064879) | > loss_disc_real_5: 0.33132851123809814 (0.2407967247715106) | > loss_0: 2.529557228088379 (2.5143180453047456) | > grad_norm_0: tensor(455.6281, device='cuda:0') (tensor(708.6654, device='cuda:0')) | > loss_gen: 2.3442530632019043 (2.217353326933725) | > loss_kl: 0.18830519914627075 (0.825366443821362) | > loss_feat: 4.653757095336914 (5.0617475023075045) | > loss_mel: 24.238786697387695 (19.843517314414584) | > loss_duration: 1.3946071863174438 (1.3161117689950128) | > loss_1: 32.81970977783203 (29.264096454698212) | > grad_norm_1: tensor(24488.8750, device='cuda:0') (tensor(22879.5938, device='cuda:0')) | > current_lr_0: 6.31331064298908e-05 | > current_lr_1: 6.3196275063495e-05 | > step_time: 0.5231 (0.6338285815959073) | > loader_time: 0.4972 (0.028959361874327374)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6789865493774414 (2.6789865493774414) | > loss_disc_real_0: 0.2345764935016632 (0.2345764935016632) | > loss_disc_real_1: 0.2772112786769867 (0.2772112786769867) | > loss_disc_real_2: 0.34185194969177246 (0.34185194969177246) | > loss_disc_real_3: 0.24725212156772614 (0.24725212156772614) | > loss_disc_real_4: 0.3920692205429077 (0.3920692205429077) | > loss_disc_real_5: 0.23060385882854462 (0.23060385882854462) | > loss_0: 2.6789865493774414 (2.6789865493774414) | > loss_gen: 2.326716899871826 (2.326716899871826) | > loss_kl: 6.03599214553833 (6.03599214553833) | > loss_feat: 5.070506572723389 (5.070506572723389) | > loss_mel: 23.16297721862793 (23.16297721862793) | > loss_duration: 3.087725877761841 (3.087725877761841) | > loss_1: 39.683921813964844 (39.683921813964844)  --> STEP: 1 | > loss_disc: 2.7706851959228516 (2.7706851959228516) | > loss_disc_real_0: 0.1964026391506195 (0.1964026391506195) | > loss_disc_real_1: 0.1763785034418106 (0.1763785034418106) | > loss_disc_real_2: 0.22488614916801453 (0.22488614916801453) | > loss_disc_real_3: 0.28004518151283264 (0.28004518151283264) | > loss_disc_real_4: 0.2822423279285431 (0.2822423279285431) | > loss_disc_real_5: 0.30228298902511597 (0.30228298902511597) | > loss_0: 2.7706851959228516 (2.7706851959228516) | > loss_gen: 1.755340576171875 (1.755340576171875) | > loss_kl: 5.495837688446045 (5.495837688446045) | > loss_feat: 0.9816188216209412 (0.9816188216209412) | > loss_mel: 19.92129898071289 (19.92129898071289) | > loss_duration: 3.3359506130218506 (3.3359506130218506) | > loss_1: 31.490047454833984 (31.490047454833984)  --> STEP: 2 | > loss_disc: 2.6870272159576416 (2.7288562059402466) | > loss_disc_real_0: 0.3518017530441284 (0.27410219609737396) | > loss_disc_real_1: 0.16637562215328217 (0.1713770627975464) | > loss_disc_real_2: 0.21896830201148987 (0.2219272255897522) | > loss_disc_real_3: 0.13582493364810944 (0.20793505758047104) | > loss_disc_real_4: 0.2955899238586426 (0.28891612589359283) | > loss_disc_real_5: 0.39019548892974854 (0.34623923897743225) | > loss_0: 2.6870272159576416 (2.7288562059402466) | > loss_gen: 2.499542713165283 (2.127441644668579) | > loss_kl: 5.840133190155029 (5.667985439300537) | > loss_feat: 10.70700740814209 (5.8443131148815155) | > loss_mel: 23.482807159423828 (21.70205307006836) | > loss_duration: 3.2622692584991455 (3.299109935760498) | > loss_1: 45.79175567626953 (38.64090156555176)  --> STEP: 3 | > loss_disc: 2.9466776847839355 (2.8014633655548096) | > loss_disc_real_0: 0.36803174018859863 (0.30541204412778217) | > loss_disc_real_1: 0.21716997027397156 (0.1866413652896881) | > loss_disc_real_2: 0.26139310002326965 (0.23508251706759134) | > loss_disc_real_3: 0.27078402042388916 (0.2288847118616104) | > loss_disc_real_4: 0.27029359340667725 (0.28270861506462097) | > loss_disc_real_5: 0.2856367826461792 (0.3260384202003479) | > loss_0: 2.9466776847839355 (2.8014633655548096) | > loss_gen: 1.8456958532333374 (2.033526380856832) | > loss_kl: 2.747819423675537 (4.694596767425537) | > loss_feat: 0.6998062133789062 (4.129477481047313) | > loss_mel: 17.11781120300293 (20.173972447713215) | > loss_duration: 3.0943551063537598 (3.230858325958252) | > loss_1: 25.5054874420166 (34.26243019104004) --> EVAL PERFORMANCE | > avg_loader_time: 0.015085458755493164 (-0.01621143023173014) | > avg_loss_disc: 2.8014633655548096 (+0.413336674372355) | > avg_loss_disc_real_0: 0.30541204412778217 (+0.11531974375247953) | > avg_loss_disc_real_1: 0.1866413652896881 (-0.04837651550769806) | > avg_loss_disc_real_2: 0.23508251706759134 (+0.014284834265708923) | > avg_loss_disc_real_3: 0.2288847118616104 (-0.03507314622402191) | > avg_loss_disc_real_4: 0.28270861506462097 (+0.10716490944226584) | > avg_loss_disc_real_5: 0.3260384202003479 (+0.08325215677420297) | > avg_loss_0: 2.8014633655548096 (+0.413336674372355) | > avg_loss_gen: 2.033526380856832 (-0.5192033847173052) | > avg_loss_kl: 4.694596767425537 (+0.043642520904541016) | > avg_loss_feat: 4.129477481047313 (-3.088314553101857) | > avg_loss_mel: 20.173972447713215 (-2.8223718007405623) | > avg_loss_duration: 3.230858325958252 (-0.03043683369954442) | > avg_loss_1: 34.26243019104004 (-6.41668383280436)  > EPOCH: 1154/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:35:37)   --> TIME: 2023-10-20 14:36:01 -- STEP: 29/50 -- GLOBAL_STEP: 110730 | > loss_disc: 2.983262538909912 (2.440126739699265) | > loss_disc_real_0: 0.246002197265625 (0.1548423233987956) | > loss_disc_real_1: 0.26279935240745544 (0.23112679311427578) | > loss_disc_real_2: 0.25945091247558594 (0.21982836466411065) | > loss_disc_real_3: 0.21167591214179993 (0.23080630484839965) | > loss_disc_real_4: 0.23262053728103638 (0.23247558790548095) | > loss_disc_real_5: 0.2459731101989746 (0.2307802640576044) | > loss_0: 2.983262538909912 (2.440126739699265) | > grad_norm_0: tensor(292.6737, device='cuda:0') (tensor(510.3027, device='cuda:0')) | > loss_gen: 1.510602355003357 (2.2867430982918573) | > loss_kl: 0.8404892086982727 (0.8063894643865782) | > loss_feat: 0.12664777040481567 (5.815156465974347) | > loss_mel: 3.965937614440918 (20.64542998938725) | > loss_duration: 1.2963695526123047 (1.337453895601733) | > loss_1: 7.740046501159668 (30.89117273791083) | > grad_norm_1: tensor(58148.6523, device='cuda:0') (tensor(18725.2383, device='cuda:0')) | > current_lr_0: 6.307000093729087e-05 | > current_lr_1: 6.31331064298908e-05 | > step_time: 0.7138 (0.6217473210959599) | > loader_time: 0.0251 (0.019115579539331896)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.008878231048584 (3.008878231048584) | > loss_disc_real_0: 0.31777703762054443 (0.31777703762054443) | > loss_disc_real_1: 0.24855390191078186 (0.24855390191078186) | > loss_disc_real_2: 0.25066399574279785 (0.25066399574279785) | > loss_disc_real_3: 0.2677854597568512 (0.2677854597568512) | > loss_disc_real_4: 0.2772499918937683 (0.2772499918937683) | > loss_disc_real_5: 0.24679039418697357 (0.24679039418697357) | > loss_0: 3.008878231048584 (3.008878231048584) | > loss_gen: 1.6124483346939087 (1.6124483346939087) | > loss_kl: 5.356142520904541 (5.356142520904541) | > loss_feat: 0.017291627824306488 (0.017291627824306488) | > loss_mel: 1.7051119804382324 (1.7051119804382324) | > loss_duration: 3.1178343296051025 (3.1178343296051025) | > loss_1: 11.808828353881836 (11.808828353881836)  --> STEP: 1 | > loss_disc: 2.817143201828003 (2.817143201828003) | > loss_disc_real_0: 0.36695799231529236 (0.36695799231529236) | > loss_disc_real_1: 0.2788824439048767 (0.2788824439048767) | > loss_disc_real_2: 0.27293315529823303 (0.27293315529823303) | > loss_disc_real_3: 0.23618832230567932 (0.23618832230567932) | > loss_disc_real_4: 0.3762015700340271 (0.3762015700340271) | > loss_disc_real_5: 0.3884579539299011 (0.3884579539299011) | > loss_0: 2.817143201828003 (2.817143201828003) | > loss_gen: 2.7210330963134766 (2.7210330963134766) | > loss_kl: 5.469114780426025 (5.469114780426025) | > loss_feat: 7.161733627319336 (7.161733627319336) | > loss_mel: 22.523866653442383 (22.523866653442383) | > loss_duration: 3.396496295928955 (3.396496295928955) | > loss_1: 41.27224349975586 (41.27224349975586)  --> STEP: 2 | > loss_disc: 1.771114468574524 (2.2941288352012634) | > loss_disc_real_0: 0.04945075884461403 (0.2082043755799532) | > loss_disc_real_1: 0.24367807805538177 (0.26128026098012924) | > loss_disc_real_2: 0.15709470212459564 (0.21501392871141434) | > loss_disc_real_3: 0.23984140157699585 (0.23801486194133759) | > loss_disc_real_4: 0.12329235672950745 (0.24974696338176727) | > loss_disc_real_5: 0.17836026847362518 (0.28340911120176315) | > loss_0: 1.771114468574524 (2.2941288352012634) | > loss_gen: 2.9372429847717285 (2.8291380405426025) | > loss_kl: 6.5816545486450195 (6.0253846645355225) | > loss_feat: 8.80422592163086 (7.982979774475098) | > loss_mel: 22.979602813720703 (22.751734733581543) | > loss_duration: 3.2953884601593018 (3.3459423780441284) | > loss_1: 44.598114013671875 (42.93517875671387)  --> STEP: 3 | > loss_disc: 2.6429569721221924 (2.4104048808415732) | > loss_disc_real_0: 0.16953785717487335 (0.19531553611159325) | > loss_disc_real_1: 0.2056477963924408 (0.24273610611756644) | > loss_disc_real_2: 0.21644532680511475 (0.21549106140931448) | > loss_disc_real_3: 0.2892819941043854 (0.25510390599568683) | > loss_disc_real_4: 0.272477924823761 (0.2573239505290985) | > loss_disc_real_5: 0.3582693040370941 (0.30836250881354016) | > loss_0: 2.6429569721221924 (2.4104048808415732) | > loss_gen: 2.031040668487549 (2.563105583190918) | > loss_kl: 2.3167598247528076 (4.789176384607951) | > loss_feat: 2.9090659618377686 (6.291675170262654) | > loss_mel: 18.8343505859375 (21.445940017700195) | > loss_duration: 3.099626302719116 (3.2638370196024575) | > loss_1: 29.19084358215332 (38.353733698527016) --> EVAL PERFORMANCE | > avg_loader_time: 0.011756340662638346 (-0.0033291180928548183) | > avg_loss_disc: 2.4104048808415732 (-0.39105848471323634) | > avg_loss_disc_real_0: 0.19531553611159325 (-0.11009650801618892) | > avg_loss_disc_real_1: 0.24273610611756644 (+0.056094740827878325) | > avg_loss_disc_real_2: 0.21549106140931448 (-0.019591455658276857) | > avg_loss_disc_real_3: 0.25510390599568683 (+0.026219194134076418) | > avg_loss_disc_real_4: 0.2573239505290985 (-0.02538466453552246) | > avg_loss_disc_real_5: 0.30836250881354016 (-0.01767591138680774) | > avg_loss_0: 2.4104048808415732 (-0.39105848471323634) | > avg_loss_gen: 2.563105583190918 (+0.529579202334086) | > avg_loss_kl: 4.789176384607951 (+0.09457961718241403) | > avg_loss_feat: 6.291675170262654 (+2.1621976892153416) | > avg_loss_mel: 21.445940017700195 (+1.2719675699869804) | > avg_loss_duration: 3.2638370196024575 (+0.03297869364420558) | > avg_loss_1: 38.353733698527016 (+4.091303507486977)  > EPOCH: 1155/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:36:29)   --> TIME: 2023-10-20 14:36:40 -- STEP: 9/50 -- GLOBAL_STEP: 110760 | > loss_disc: 2.710144519805908 (2.6513476769129434) | > loss_disc_real_0: 0.02575068734586239 (0.21590208055244553) | > loss_disc_real_1: 0.21931526064872742 (0.2303655660814709) | > loss_disc_real_2: 0.34535861015319824 (0.23687881396876442) | > loss_disc_real_3: 0.3745800256729126 (0.3070497165123622) | > loss_disc_real_4: 0.29116278886795044 (0.2451940733525488) | > loss_disc_real_5: 0.3376675248146057 (0.2815589631597201) | > loss_0: 2.710144519805908 (2.6513476769129434) | > grad_norm_0: tensor(355.2469, device='cuda:0') (tensor(525.3611, device='cuda:0')) | > loss_gen: 2.161292552947998 (2.1902380254533558) | > loss_kl: 1.1679883003234863 (0.7386084861225553) | > loss_feat: 5.010747909545898 (4.441498551517725) | > loss_mel: 20.234169006347656 (17.145607855584885) | > loss_duration: 1.2807990312576294 (1.3428967131508722) | > loss_1: 29.854997634887695 (25.858850055270725) | > grad_norm_1: tensor(7353.7109, device='cuda:0') (tensor(27018.5273, device='cuda:0')) | > current_lr_0: 6.300695852258177e-05 | > current_lr_1: 6.307000093729087e-05 | > step_time: 0.7994 (0.5674569871690538) | > loader_time: 0.0295 (0.023282368977864582)  --> TIME: 2023-10-20 14:36:53 -- STEP: 39/50 -- GLOBAL_STEP: 110790 | > loss_disc: 1.613317608833313 (2.558318098386128) | > loss_disc_real_0: 0.00955733098089695 (0.17271425379201388) | > loss_disc_real_1: 0.19733086228370667 (0.22102454390663367) | > loss_disc_real_2: 0.16264531016349792 (0.21869001203240493) | > loss_disc_real_3: 0.17737449705600739 (0.24392971320030016) | > loss_disc_real_4: 0.056199122220277786 (0.23172132021341568) | > loss_disc_real_5: 0.046736232936382294 (0.24618825507469666) | > loss_0: 1.613317608833313 (2.558318098386128) | > grad_norm_0: tensor(215.3942, device='cuda:0') (tensor(583.0169, device='cuda:0')) | > loss_gen: 2.920649528503418 (2.16566657103025) | > loss_kl: 0.7974211573600769 (0.7793630593671248) | > loss_feat: 8.82434368133545 (4.894993892512642) | > loss_mel: 22.871461868286133 (18.742712858395706) | > loss_duration: 1.4227392673492432 (1.3219826741096299) | > loss_1: 36.83661651611328 (27.90471901037754) | > grad_norm_1: tensor(25945.4375, device='cuda:0') (tensor(21870.9512, device='cuda:0')) | > current_lr_0: 6.300695852258177e-05 | > current_lr_1: 6.307000093729087e-05 | > step_time: 0.4013 (0.4491089857541598) | > loader_time: 0.0054 (0.011539226923233425)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9436838626861572 (2.9436838626861572) | > loss_disc_real_0: 0.2513052821159363 (0.2513052821159363) | > loss_disc_real_1: 0.4199414551258087 (0.4199414551258087) | > loss_disc_real_2: 0.45979201793670654 (0.45979201793670654) | > loss_disc_real_3: 0.2504277229309082 (0.2504277229309082) | > loss_disc_real_4: 0.366525799036026 (0.366525799036026) | > loss_disc_real_5: 0.2758128046989441 (0.2758128046989441) | > loss_0: 2.9436838626861572 (2.9436838626861572) | > loss_gen: 2.44767165184021 (2.44767165184021) | > loss_kl: 5.1938157081604 (5.1938157081604) | > loss_feat: 5.685132026672363 (5.685132026672363) | > loss_mel: 23.62782859802246 (23.62782859802246) | > loss_duration: 3.0492143630981445 (3.0492143630981445) | > loss_1: 40.003658294677734 (40.003658294677734)  --> STEP: 1 | > loss_disc: 2.5851638317108154 (2.5851638317108154) | > loss_disc_real_0: 0.17760518193244934 (0.17760518193244934) | > loss_disc_real_1: 0.22051699459552765 (0.22051699459552765) | > loss_disc_real_2: 0.17112305760383606 (0.17112305760383606) | > loss_disc_real_3: 0.21775953471660614 (0.21775953471660614) | > loss_disc_real_4: 0.1642315685749054 (0.1642315685749054) | > loss_disc_real_5: 0.18132826685905457 (0.18132826685905457) | > loss_0: 2.5851638317108154 (2.5851638317108154) | > loss_gen: 1.7477495670318604 (1.7477495670318604) | > loss_kl: 5.528174877166748 (5.528174877166748) | > loss_feat: 6.626667499542236 (6.626667499542236) | > loss_mel: 26.404510498046875 (26.404510498046875) | > loss_duration: 3.4812135696411133 (3.4812135696411133) | > loss_1: 43.78831481933594 (43.78831481933594)  --> STEP: 2 | > loss_disc: 1.685957431793213 (2.135560631752014) | > loss_disc_real_0: 0.2509303689002991 (0.2142677754163742) | > loss_disc_real_1: 0.06697354465723038 (0.143745269626379) | > loss_disc_real_2: 0.18849897384643555 (0.1798110157251358) | > loss_disc_real_3: 0.16029073297977448 (0.1890251338481903) | > loss_disc_real_4: 0.207336887717247 (0.1857842281460762) | > loss_disc_real_5: 0.07722213864326477 (0.12927520275115967) | > loss_0: 1.685957431793213 (2.135560631752014) | > loss_gen: 3.2463226318359375 (2.497036099433899) | > loss_kl: 5.907252311706543 (5.7177135944366455) | > loss_feat: 12.206024169921875 (9.416345834732056) | > loss_mel: 24.753589630126953 (25.579050064086914) | > loss_duration: 3.1944210529327393 (3.3378173112869263) | > loss_1: 49.30760955810547 (46.5479621887207)  --> STEP: 3 | > loss_disc: 3.3283066749572754 (2.533142646153768) | > loss_disc_real_0: 0.20962603390216827 (0.21272052824497223) | > loss_disc_real_1: 0.22606216371059418 (0.1711842343211174) | > loss_disc_real_2: 0.28560125827789307 (0.21507442990938822) | > loss_disc_real_3: 0.3931402862071991 (0.2570635179678599) | > loss_disc_real_4: 0.33655115962028503 (0.23603987197081247) | > loss_disc_real_5: 0.38420289754867554 (0.2142511010169983) | > loss_0: 3.3283066749572754 (2.533142646153768) | > loss_gen: 1.7303334474563599 (2.2414685487747192) | > loss_kl: 2.802271842956543 (4.745899677276611) | > loss_feat: 4.2678327560424805 (7.700174808502197) | > loss_mel: 21.598241806030273 (24.252113978068035) | > loss_duration: 3.0362348556518555 (3.237289826075236) | > loss_1: 33.434913635253906 (42.17694600423177) --> EVAL PERFORMANCE | > avg_loader_time: 0.01919865608215332 (+0.0074423154195149745) | > avg_loss_disc: 2.533142646153768 (+0.12273776531219482) | > avg_loss_disc_real_0: 0.21272052824497223 (+0.017404992133378983) | > avg_loss_disc_real_1: 0.1711842343211174 (-0.07155187179644903) | > avg_loss_disc_real_2: 0.21507442990938822 (-0.0004166314999262677) | > avg_loss_disc_real_3: 0.2570635179678599 (+0.001959611972173092) | > avg_loss_disc_real_4: 0.23603987197081247 (-0.02128407855828604) | > avg_loss_disc_real_5: 0.2142511010169983 (-0.09411140779654187) | > avg_loss_0: 2.533142646153768 (+0.12273776531219482) | > avg_loss_gen: 2.2414685487747192 (-0.32163703441619873) | > avg_loss_kl: 4.745899677276611 (-0.043276707331339814) | > avg_loss_feat: 7.700174808502197 (+1.408499638239543) | > avg_loss_mel: 24.252113978068035 (+2.8061739603678397) | > avg_loss_duration: 3.237289826075236 (-0.02654719352722168) | > avg_loss_1: 42.17694600423177 (+3.8232123057047573)  > EPOCH: 1156/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:37:19)   --> TIME: 2023-10-20 14:37:37 -- STEP: 19/50 -- GLOBAL_STEP: 110820 | > loss_disc: 2.9190163612365723 (2.652964604528327) | > loss_disc_real_0: 0.34236037731170654 (0.163475097402146) | > loss_disc_real_1: 0.33265987038612366 (0.2248592012022671) | > loss_disc_real_2: 0.27840346097946167 (0.269350386371738) | > loss_disc_real_3: 0.36309903860092163 (0.24463813497047676) | > loss_disc_real_4: 0.27143967151641846 (0.2403119766202412) | > loss_disc_real_5: 0.4610148072242737 (0.24246036565225376) | > loss_0: 2.9190163612365723 (2.652964604528327) | > grad_norm_0: tensor(721.7987, device='cuda:0') (tensor(583.6152, device='cuda:0')) | > loss_gen: 2.464693307876587 (2.1200805714255884) | > loss_kl: 0.9340424537658691 (0.7709853006036658) | > loss_feat: 3.9074854850769043 (4.820232895644088) | > loss_mel: 21.105770111083984 (19.83110219553897) | > loss_duration: 1.3869479894638062 (1.3441685751864785) | > loss_1: 29.798938751220703 (28.88656937448602) | > grad_norm_1: tensor(9188.6387, device='cuda:0') (tensor(15564.7070, device='cuda:0')) | > current_lr_0: 6.294397912271322e-05 | > current_lr_1: 6.300695852258177e-05 | > step_time: 0.3895 (0.5946316217121325) | > loader_time: 0.0252 (0.02183279238249126)  --> TIME: 2023-10-20 14:37:57 -- STEP: 49/50 -- GLOBAL_STEP: 110850 | > loss_disc: 3.2278261184692383 (2.5989520355146754) | > loss_disc_real_0: 0.1317901313304901 (0.15264548965710767) | > loss_disc_real_1: 0.2895950376987457 (0.23049710888643654) | > loss_disc_real_2: 0.1392212212085724 (0.24689244585377826) | > loss_disc_real_3: 0.3391076326370239 (0.2457752782775431) | > loss_disc_real_4: 0.26534944772720337 (0.23659198269324036) | > loss_disc_real_5: 0.4245399236679077 (0.255601742124299) | > loss_0: 3.2278261184692383 (2.5989520355146754) | > grad_norm_0: tensor(692.4069, device='cuda:0') (tensor(522.0136, device='cuda:0')) | > loss_gen: 1.6772289276123047 (2.145154140433487) | > loss_kl: 0.40404731035232544 (0.7107397053314713) | > loss_feat: 5.95441198348999 (5.025630669782357) | > loss_mel: 23.9790096282959 (19.534632660904705) | > loss_duration: 1.44119393825531 (1.3136133928688207) | > loss_1: 33.45589065551758 (28.72977066040039) | > grad_norm_1: tensor(10766.4453, device='cuda:0') (tensor(15767.5547, device='cuda:0')) | > current_lr_0: 6.294397912271322e-05 | > current_lr_1: 6.300695852258177e-05 | > step_time: 0.8104 (0.611085439214901) | > loader_time: 0.4631 (0.028264196551575957)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0337297916412354 (3.0337297916412354) | > loss_disc_real_0: 0.2526894509792328 (0.2526894509792328) | > loss_disc_real_1: 0.2509165108203888 (0.2509165108203888) | > loss_disc_real_2: 0.30679190158843994 (0.30679190158843994) | > loss_disc_real_3: 0.21197938919067383 (0.21197938919067383) | > loss_disc_real_4: 0.21483084559440613 (0.21483084559440613) | > loss_disc_real_5: 0.3543107211589813 (0.3543107211589813) | > loss_0: 3.0337297916412354 (3.0337297916412354) | > loss_gen: 1.7728180885314941 (1.7728180885314941) | > loss_kl: 5.840306282043457 (5.840306282043457) | > loss_feat: 3.4053163528442383 (3.4053163528442383) | > loss_mel: 19.55756950378418 (19.55756950378418) | > loss_duration: 3.1349611282348633 (3.1349611282348633) | > loss_1: 33.71097183227539 (33.71097183227539)  --> STEP: 1 | > loss_disc: 2.989082098007202 (2.989082098007202) | > loss_disc_real_0: 0.3620551824569702 (0.3620551824569702) | > loss_disc_real_1: 0.3975663185119629 (0.3975663185119629) | > loss_disc_real_2: 0.3636316955089569 (0.3636316955089569) | > loss_disc_real_3: 0.2776263356208801 (0.2776263356208801) | > loss_disc_real_4: 0.31720513105392456 (0.31720513105392456) | > loss_disc_real_5: 0.27015209197998047 (0.27015209197998047) | > loss_0: 2.989082098007202 (2.989082098007202) | > loss_gen: 2.4824860095977783 (2.4824860095977783) | > loss_kl: 5.639153957366943 (5.639153957366943) | > loss_feat: 5.957829475402832 (5.957829475402832) | > loss_mel: 23.12019920349121 (23.12019920349121) | > loss_duration: 3.547163724899292 (3.547163724899292) | > loss_1: 40.74683380126953 (40.74683380126953)  --> STEP: 2 | > loss_disc: 1.6640173196792603 (2.326549708843231) | > loss_disc_real_0: 0.03583107888698578 (0.198943130671978) | > loss_disc_real_1: 0.08853507041931152 (0.2430506944656372) | > loss_disc_real_2: 0.08090618252754211 (0.2222689390182495) | > loss_disc_real_3: 0.0308539941906929 (0.15424016490578651) | > loss_disc_real_4: 0.024362662807106972 (0.17078389693051577) | > loss_disc_real_5: 0.020670171827077866 (0.14541113190352917) | > loss_0: 1.6640173196792603 (2.326549708843231) | > loss_gen: 2.0235607624053955 (2.253023386001587) | > loss_kl: 6.0178632736206055 (5.828508615493774) | > loss_feat: 14.844676971435547 (10.40125322341919) | > loss_mel: 25.77516746520996 (24.447683334350586) | > loss_duration: 3.312897205352783 (3.4300304651260376) | > loss_1: 51.97416687011719 (46.36050033569336)  --> STEP: 3 | > loss_disc: 2.892585515975952 (2.5152283112208047) | > loss_disc_real_0: 0.3212311863899231 (0.23970581591129303) | > loss_disc_real_1: 0.38567885756492615 (0.2905934154987335) | > loss_disc_real_2: 0.2650690972805023 (0.23653565843900046) | > loss_disc_real_3: 0.3214329183101654 (0.20997108270724615) | > loss_disc_real_4: 0.27122703194618225 (0.20426494193573794) | > loss_disc_real_5: 0.4345245659351349 (0.24178227658073106) | > loss_0: 2.892585515975952 (2.5152283112208047) | > loss_gen: 2.555037498474121 (2.353694756825765) | > loss_kl: 2.9841363430023193 (4.880384524663289) | > loss_feat: 3.965238332748413 (8.25591492652893) | > loss_mel: 24.52176284790039 (24.472376505533855) | > loss_duration: 3.077970504760742 (3.3126771450042725) | > loss_1: 37.104148864746094 (43.2750498453776) --> EVAL PERFORMANCE | > avg_loader_time: 0.015455484390258789 (-0.0037431716918945312) | > avg_loss_disc: 2.5152283112208047 (-0.01791433493296335) | > avg_loss_disc_real_0: 0.23970581591129303 (+0.0269852876663208) | > avg_loss_disc_real_1: 0.2905934154987335 (+0.11940918117761612) | > avg_loss_disc_real_2: 0.23653565843900046 (+0.021461228529612242) | > avg_loss_disc_real_3: 0.20997108270724615 (-0.04709243526061377) | > avg_loss_disc_real_4: 0.20426494193573794 (-0.03177493003507453) | > avg_loss_disc_real_5: 0.24178227658073106 (+0.027531175563732774) | > avg_loss_0: 2.5152283112208047 (-0.01791433493296335) | > avg_loss_gen: 2.353694756825765 (+0.11222620805104588) | > avg_loss_kl: 4.880384524663289 (+0.13448484738667776) | > avg_loss_feat: 8.25591492652893 (+0.5557401180267334) | > avg_loss_mel: 24.472376505533855 (+0.2202625274658203) | > avg_loss_duration: 3.3126771450042725 (+0.0753873189290366) | > avg_loss_1: 43.2750498453776 (+1.0981038411458286)  > EPOCH: 1157/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:38:15)   --> TIME: 2023-10-20 14:38:30 -- STEP: 29/50 -- GLOBAL_STEP: 110880 | > loss_disc: 1.549417495727539 (2.437423603288058) | > loss_disc_real_0: 0.07784450054168701 (0.15552162558868013) | > loss_disc_real_1: 0.1361868977546692 (0.20599650642995176) | > loss_disc_real_2: 0.11378264427185059 (0.2128512065472274) | > loss_disc_real_3: 0.115895576775074 (0.2215758364262252) | > loss_disc_real_4: 0.140659898519516 (0.21180169451339492) | > loss_disc_real_5: 0.06589150428771973 (0.2437606419854123) | > loss_0: 1.549417495727539 (2.437423603288058) | > grad_norm_0: tensor(525.2679, device='cuda:0') (tensor(527.0014, device='cuda:0')) | > loss_gen: 2.774301052093506 (2.2392446501501677) | > loss_kl: 0.8487998843193054 (0.8205184432966955) | > loss_feat: 10.940556526184082 (5.880573652748918) | > loss_mel: 21.207496643066406 (20.583239824607453) | > loss_duration: 1.3665648698806763 (1.3316979572690766) | > loss_1: 37.137718200683594 (30.855274759489916) | > grad_norm_1: tensor(4133.2144, device='cuda:0') (tensor(19384.4336, device='cuda:0')) | > current_lr_0: 6.288106267469793e-05 | > current_lr_1: 6.294397912271322e-05 | > step_time: 0.2571 (0.32671482809658703) | > loader_time: 0.0018 (0.006493099804582267)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.410892963409424 (2.410892963409424) | > loss_disc_real_0: 0.297851026058197 (0.297851026058197) | > loss_disc_real_1: 0.20716366171836853 (0.20716366171836853) | > loss_disc_real_2: 0.23815476894378662 (0.23815476894378662) | > loss_disc_real_3: 0.3360317051410675 (0.3360317051410675) | > loss_disc_real_4: 0.30948546528816223 (0.30948546528816223) | > loss_disc_real_5: 0.2614109516143799 (0.2614109516143799) | > loss_0: 2.410892963409424 (2.410892963409424) | > loss_gen: 2.9987618923187256 (2.9987618923187256) | > loss_kl: 5.15605354309082 (5.15605354309082) | > loss_feat: 7.345176696777344 (7.345176696777344) | > loss_mel: 22.144880294799805 (22.144880294799805) | > loss_duration: 3.1714279651641846 (3.1714279651641846) | > loss_1: 40.81629943847656 (40.81629943847656)  --> STEP: 1 | > loss_disc: 2.3414523601531982 (2.3414523601531982) | > loss_disc_real_0: 0.16505342721939087 (0.16505342721939087) | > loss_disc_real_1: 0.15599976480007172 (0.15599976480007172) | > loss_disc_real_2: 0.24458234012126923 (0.24458234012126923) | > loss_disc_real_3: 0.19086004793643951 (0.19086004793643951) | > loss_disc_real_4: 0.16195759177207947 (0.16195759177207947) | > loss_disc_real_5: 0.053872376680374146 (0.053872376680374146) | > loss_0: 2.3414523601531982 (2.3414523601531982) | > loss_gen: 2.011732339859009 (2.011732339859009) | > loss_kl: 5.553437232971191 (5.553437232971191) | > loss_feat: 8.12173843383789 (8.12173843383789) | > loss_mel: 26.30055809020996 (26.30055809020996) | > loss_duration: 3.4918179512023926 (3.4918179512023926) | > loss_1: 45.479286193847656 (45.479286193847656)  --> STEP: 2 | > loss_disc: 2.4461188316345215 (2.39378559589386) | > loss_disc_real_0: 0.08289600908756256 (0.12397471815347672) | > loss_disc_real_1: 0.3691183626651764 (0.26255906373262405) | > loss_disc_real_2: 0.3094513714313507 (0.27701685577630997) | > loss_disc_real_3: 0.4768621623516083 (0.3338611051440239) | > loss_disc_real_4: 0.17489199340343475 (0.1684247925877571) | > loss_disc_real_5: 0.1828160434961319 (0.11834421008825302) | > loss_0: 2.4461188316345215 (2.39378559589386) | > loss_gen: 3.2204530239105225 (2.6160926818847656) | > loss_kl: 5.673978328704834 (5.613707780838013) | > loss_feat: 11.122631072998047 (9.622184753417969) | > loss_mel: 22.917362213134766 (24.608960151672363) | > loss_duration: 3.3446435928344727 (3.4182307720184326) | > loss_1: 46.27906799316406 (45.87917709350586)  --> STEP: 3 | > loss_disc: 2.890881299972534 (2.5594841639200845) | > loss_disc_real_0: 0.06490074098110199 (0.1042833924293518) | > loss_disc_real_1: 0.26299044489860535 (0.2627028574546178) | > loss_disc_real_2: 0.42064347863197327 (0.32489239672819775) | > loss_disc_real_3: 0.23384422063827515 (0.30052214364210766) | > loss_disc_real_4: 0.337557315826416 (0.22480230033397675) | > loss_disc_real_5: 0.34811604022979736 (0.19493482013543448) | > loss_0: 2.890881299972534 (2.5594841639200845) | > loss_gen: 2.1271233558654785 (2.4531029065450034) | > loss_kl: 2.60906982421875 (4.612161795298259) | > loss_feat: 4.973020553588867 (8.072463353474935) | > loss_mel: 25.160625457763672 (24.792848587036133) | > loss_duration: 3.121479034423828 (3.3193135261535645) | > loss_1: 37.99131774902344 (43.249890645345054) --> EVAL PERFORMANCE | > avg_loader_time: 0.009666522343953451 (-0.005788962046305338) | > avg_loss_disc: 2.5594841639200845 (+0.044255852699279785) | > avg_loss_disc_real_0: 0.1042833924293518 (-0.13542242348194122) | > avg_loss_disc_real_1: 0.2627028574546178 (-0.02789055804411572) | > avg_loss_disc_real_2: 0.32489239672819775 (+0.0883567382891973) | > avg_loss_disc_real_3: 0.30052214364210766 (+0.09055106093486151) | > avg_loss_disc_real_4: 0.22480230033397675 (+0.02053735839823881) | > avg_loss_disc_real_5: 0.19493482013543448 (-0.04684745644529659) | > avg_loss_0: 2.5594841639200845 (+0.044255852699279785) | > avg_loss_gen: 2.4531029065450034 (+0.09940814971923828) | > avg_loss_kl: 4.612161795298259 (-0.26822272936503033) | > avg_loss_feat: 8.072463353474935 (-0.18345157305399518) | > avg_loss_mel: 24.792848587036133 (+0.32047208150227746) | > avg_loss_duration: 3.3193135261535645 (+0.006636381149291992) | > avg_loss_1: 43.249890645345054 (-0.025159200032547346)  > EPOCH: 1158/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:39:17)   --> TIME: 2023-10-20 14:39:27 -- STEP: 9/50 -- GLOBAL_STEP: 110910 | > loss_disc: 2.842430591583252 (2.582022958331638) | > loss_disc_real_0: 0.19002538919448853 (0.1453806652377049) | > loss_disc_real_1: 0.2665885090827942 (0.25414659786555505) | > loss_disc_real_2: 0.24379590153694153 (0.23615128795305887) | > loss_disc_real_3: 0.21933993697166443 (0.2924153498477406) | > loss_disc_real_4: 0.2376287430524826 (0.2259216420352459) | > loss_disc_real_5: 0.24908144772052765 (0.22947784927156237) | > loss_0: 2.842430591583252 (2.582022958331638) | > grad_norm_0: tensor(512.5414, device='cuda:0') (tensor(714.0849, device='cuda:0')) | > loss_gen: 1.6715534925460815 (2.271338701248169) | > loss_kl: 0.6935380697250366 (0.7278288867738512) | > loss_feat: 0.4869254231452942 (4.91007995315724) | > loss_mel: 20.20068359375 (18.877879513634575) | > loss_duration: 1.2997270822525024 (1.3275803592469957) | > loss_1: 24.352426528930664 (28.114707310994465) | > grad_norm_1: tensor(18186.9434, device='cuda:0') (tensor(28221.9414, device='cuda:0')) | > current_lr_0: 6.28182091156116e-05 | > current_lr_1: 6.288106267469793e-05 | > step_time: 0.604 (0.6042025089263916) | > loader_time: 0.0371 (0.022901826434665255)  --> TIME: 2023-10-20 14:39:47 -- STEP: 39/50 -- GLOBAL_STEP: 110940 | > loss_disc: 3.008296489715576 (2.4886201253304123) | > loss_disc_real_0: 0.38333046436309814 (0.16054764764908797) | > loss_disc_real_1: 0.2568320333957672 (0.23013293026731566) | > loss_disc_real_2: 0.27381446957588196 (0.23028077548130965) | > loss_disc_real_3: 0.24974896013736725 (0.23473659043128675) | > loss_disc_real_4: 0.23741604387760162 (0.21063154649276) | > loss_disc_real_5: 0.2662357985973358 (0.2321740831129062) | > loss_0: 3.008296489715576 (2.4886201253304123) | > grad_norm_0: tensor(644.4210, device='cuda:0') (tensor(609.9953, device='cuda:0')) | > loss_gen: 1.7091476917266846 (2.238569913766323) | > loss_kl: 0.8295900225639343 (0.7635572636738802) | > loss_feat: 0.10081709921360016 (5.086935442848466) | > loss_mel: 1.755117416381836 (19.031999322084285) | > loss_duration: 1.3727946281433105 (1.3156543236512404) | > loss_1: 5.767467021942139 (28.436716091938507) | > grad_norm_1: tensor(18414.5195, device='cuda:0') (tensor(22594.1406, device='cuda:0')) | > current_lr_0: 6.28182091156116e-05 | > current_lr_1: 6.288106267469793e-05 | > step_time: 0.5303 (0.64005201902145) | > loader_time: 0.0345 (0.02286224487500313)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.003957509994507 (3.003957509994507) | > loss_disc_real_0: 0.2795262932777405 (0.2795262932777405) | > loss_disc_real_1: 0.3162877559661865 (0.3162877559661865) | > loss_disc_real_2: 0.22616593539714813 (0.22616593539714813) | > loss_disc_real_3: 0.26596060395240784 (0.26596060395240784) | > loss_disc_real_4: 0.26945188641548157 (0.26945188641548157) | > loss_disc_real_5: 0.26092514395713806 (0.26092514395713806) | > loss_0: 3.003957509994507 (3.003957509994507) | > loss_gen: 1.7667624950408936 (1.7667624950408936) | > loss_kl: 5.821650505065918 (5.821650505065918) | > loss_feat: 2.4729604721069336 (2.4729604721069336) | > loss_mel: 20.27105140686035 (20.27105140686035) | > loss_duration: 3.0699446201324463 (3.0699446201324463) | > loss_1: 33.40237045288086 (33.40237045288086)  --> STEP: 1 | > loss_disc: 2.410554885864258 (2.410554885864258) | > loss_disc_real_0: 0.04117053747177124 (0.04117053747177124) | > loss_disc_real_1: 0.2169564962387085 (0.2169564962387085) | > loss_disc_real_2: 0.23040230572223663 (0.23040230572223663) | > loss_disc_real_3: 0.20638006925582886 (0.20638006925582886) | > loss_disc_real_4: 0.12738069891929626 (0.12738069891929626) | > loss_disc_real_5: 0.25488895177841187 (0.25488895177841187) | > loss_0: 2.410554885864258 (2.410554885864258) | > loss_gen: 1.9839051961898804 (1.9839051961898804) | > loss_kl: 5.658224105834961 (5.658224105834961) | > loss_feat: 5.854960918426514 (5.854960918426514) | > loss_mel: 22.815393447875977 (22.815393447875977) | > loss_duration: 3.4325294494628906 (3.4325294494628906) | > loss_1: 39.74501419067383 (39.74501419067383)  --> STEP: 2 | > loss_disc: 2.789416551589966 (2.599985718727112) | > loss_disc_real_0: 0.2255164533853531 (0.13334349542856216) | > loss_disc_real_1: 0.2909509241580963 (0.2539537101984024) | > loss_disc_real_2: 0.3118320405483246 (0.2711171731352806) | > loss_disc_real_3: 0.24508479237556458 (0.22573243081569672) | > loss_disc_real_4: 0.3254237771034241 (0.22640223801136017) | > loss_disc_real_5: 0.28771963715553284 (0.27130429446697235) | > loss_0: 2.789416551589966 (2.599985718727112) | > loss_gen: 2.1774251461029053 (2.080665171146393) | > loss_kl: 6.1226348876953125 (5.890429496765137) | > loss_feat: 3.198049306869507 (4.52650511264801) | > loss_mel: 25.673158645629883 (24.24427604675293) | > loss_duration: 3.2326653003692627 (3.3325973749160767) | > loss_1: 40.403934478759766 (40.0744743347168)  --> STEP: 3 | > loss_disc: 2.9889376163482666 (2.7296363512674966) | > loss_disc_real_0: 0.3029758036136627 (0.18988759815692902) | > loss_disc_real_1: 0.28202685713768005 (0.2633114258448283) | > loss_disc_real_2: 0.2831335961818695 (0.27512264748414356) | > loss_disc_real_3: 0.26743283867836 (0.23963256676991782) | > loss_disc_real_4: 0.29249322414398193 (0.2484325667222341) | > loss_disc_real_5: 0.27609679102897644 (0.2729017933209737) | > loss_0: 2.9889376163482666 (2.7296363512674966) | > loss_gen: 1.7445683479309082 (1.9686328967412312) | > loss_kl: 2.644184112548828 (4.808347702026367) | > loss_feat: 0.2686883211135864 (3.107232848803202) | > loss_mel: 16.013813018798828 (21.50078837076823) | > loss_duration: 3.052053451538086 (3.2390827337900796) | > loss_1: 23.72330665588379 (34.624085108439125) --> EVAL PERFORMANCE | > avg_loader_time: 0.009525934855143229 (-0.0001405874888102225) | > avg_loss_disc: 2.7296363512674966 (+0.1701521873474121) | > avg_loss_disc_real_0: 0.18988759815692902 (+0.08560420572757721) | > avg_loss_disc_real_1: 0.2633114258448283 (+0.0006085683902105066) | > avg_loss_disc_real_2: 0.27512264748414356 (-0.049769749244054196) | > avg_loss_disc_real_3: 0.23963256676991782 (-0.06088957687218985) | > avg_loss_disc_real_4: 0.2484325667222341 (+0.023630266388257354) | > avg_loss_disc_real_5: 0.2729017933209737 (+0.07796697318553922) | > avg_loss_0: 2.7296363512674966 (+0.1701521873474121) | > avg_loss_gen: 1.9686328967412312 (-0.4844700098037722) | > avg_loss_kl: 4.808347702026367 (+0.19618590672810843) | > avg_loss_feat: 3.107232848803202 (-4.965230504671734) | > avg_loss_mel: 21.50078837076823 (-3.2920602162679025) | > avg_loss_duration: 3.2390827337900796 (-0.08023079236348485) | > avg_loss_1: 34.624085108439125 (-8.62580553690593)  > EPOCH: 1159/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:40:16)   --> TIME: 2023-10-20 14:40:34 -- STEP: 19/50 -- GLOBAL_STEP: 110970 | > loss_disc: 2.089639663696289 (2.5175352849458394) | > loss_disc_real_0: 0.07378260791301727 (0.12721171024206435) | > loss_disc_real_1: 0.23566152155399323 (0.22260545037294688) | > loss_disc_real_2: 0.2731706202030182 (0.22159336262235516) | > loss_disc_real_3: 0.28725817799568176 (0.21504180211769908) | > loss_disc_real_4: 0.24832803010940552 (0.20460766142136172) | > loss_disc_real_5: 0.39255836606025696 (0.2364510075973445) | > loss_0: 2.089639663696289 (2.5175352849458394) | > grad_norm_0: tensor(1073.1849, device='cuda:0') (tensor(1331.6749, device='cuda:0')) | > loss_gen: 3.2660958766937256 (2.187333627750999) | > loss_kl: 1.1886301040649414 (0.727743862490905) | > loss_feat: 6.540436744689941 (5.6253319421881125) | > loss_mel: 22.13690757751465 (19.56211483478546) | > loss_duration: 1.452621340751648 (1.3515618412118209) | > loss_1: 34.58469009399414 (29.45408592726055) | > grad_norm_1: tensor(15353.4375, device='cuda:0') (tensor(37485.0547, device='cuda:0')) | > current_lr_0: 6.275541838259278e-05 | > current_lr_1: 6.28182091156116e-05 | > step_time: 0.7018 (0.6772402587689852) | > loader_time: 0.0274 (0.02308059993543123)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9990291595458984 (2.9990291595458984) | > loss_disc_real_0: 0.21707728505134583 (0.21707728505134583) | > loss_disc_real_1: 0.2573079466819763 (0.2573079466819763) | > loss_disc_real_2: 0.2478708028793335 (0.2478708028793335) | > loss_disc_real_3: 0.2587801516056061 (0.2587801516056061) | > loss_disc_real_4: 0.2803642451763153 (0.2803642451763153) | > loss_disc_real_5: 0.26398852467536926 (0.26398852467536926) | > loss_0: 2.9990291595458984 (2.9990291595458984) | > loss_gen: 1.5314722061157227 (1.5314722061157227) | > loss_kl: 5.410995960235596 (5.410995960235596) | > loss_feat: 0.015464645810425282 (0.015464645810425282) | > loss_mel: 0.5238655805587769 (0.5238655805587769) | > loss_duration: 3.097630739212036 (3.097630739212036) | > loss_1: 10.579429626464844 (10.579429626464844)  --> STEP: 1 | > loss_disc: 2.754669666290283 (2.754669666290283) | > loss_disc_real_0: 0.417959988117218 (0.417959988117218) | > loss_disc_real_1: 0.20129631459712982 (0.20129631459712982) | > loss_disc_real_2: 0.20966987311840057 (0.20966987311840057) | > loss_disc_real_3: 0.3202248215675354 (0.3202248215675354) | > loss_disc_real_4: 0.2674189805984497 (0.2674189805984497) | > loss_disc_real_5: 0.3404351472854614 (0.3404351472854614) | > loss_0: 2.754669666290283 (2.754669666290283) | > loss_gen: 2.3809146881103516 (2.3809146881103516) | > loss_kl: 5.638118743896484 (5.638118743896484) | > loss_feat: 6.730669021606445 (6.730669021606445) | > loss_mel: 24.531572341918945 (24.531572341918945) | > loss_duration: 3.427356243133545 (3.427356243133545) | > loss_1: 42.7086296081543 (42.7086296081543)  --> STEP: 2 | > loss_disc: 3.0185704231262207 (2.886620044708252) | > loss_disc_real_0: 0.44413572549819946 (0.43104785680770874) | > loss_disc_real_1: 0.15387004613876343 (0.17758318036794662) | > loss_disc_real_2: 0.32822152972221375 (0.26894570142030716) | > loss_disc_real_3: 0.2767708897590637 (0.29849785566329956) | > loss_disc_real_4: 0.2865122854709625 (0.2769656330347061) | > loss_disc_real_5: 0.23717224597930908 (0.28880369663238525) | > loss_0: 3.0185704231262207 (2.886620044708252) | > loss_gen: 2.0314173698425293 (2.2061660289764404) | > loss_kl: 5.867427349090576 (5.75277304649353) | > loss_feat: 7.42906379699707 (7.079866409301758) | > loss_mel: 22.095352172851562 (23.313462257385254) | > loss_duration: 3.350891590118408 (3.3891239166259766) | > loss_1: 40.77415466308594 (41.74139213562012)  --> STEP: 3 | > loss_disc: 2.797651529312134 (2.856963872909546) | > loss_disc_real_0: 0.141975536942482 (0.3346904168526332) | > loss_disc_real_1: 0.27674052119255066 (0.2106356273094813) | > loss_disc_real_2: 0.32064375281333923 (0.2861783852179845) | > loss_disc_real_3: 0.29761412739753723 (0.2982032795747121) | > loss_disc_real_4: 0.30863627791404724 (0.28752251466115314) | > loss_disc_real_5: 0.30644190311431885 (0.2946830987930298) | > loss_0: 2.797651529312134 (2.856963872909546) | > loss_gen: 2.203876495361328 (2.2054028511047363) | > loss_kl: 2.912708044052124 (4.806084712346395) | > loss_feat: 3.3341119289398193 (5.831281582514445) | > loss_mel: 22.98944854736328 (23.20545768737793) | > loss_duration: 3.0621564388275146 (3.2801347573598227) | > loss_1: 34.50230026245117 (39.32836151123047)  --> TIME: 2023-10-20 14:40:58 -- STEP: 49/50 -- GLOBAL_STEP: 111000 | > loss_disc: 2.5475127696990967 (2.4792497668947493) | > loss_disc_real_0: 0.03999891132116318 (0.13542644078938326) | > loss_disc_real_1: 0.26556235551834106 (0.22225827009094004) | > loss_disc_real_2: 0.3117174506187439 (0.22103410134358065) | > loss_disc_real_3: 0.24394896626472473 (0.22216399576590987) | > loss_disc_real_4: 0.22895283997058868 (0.21359603601146718) | > loss_disc_real_5: 0.2698602080345154 (0.24659713539199873) | > loss_0: 2.5475127696990967 (2.4792497668947493) | > grad_norm_0: tensor(2414.4739, device='cuda:0') (tensor(1267.3046, device='cuda:0')) | > loss_gen: 1.963899850845337 (2.240176801778833) | > loss_kl: 0.7344827055931091 (0.7516330663038759) | > loss_feat: 2.0381882190704346 (5.551299070369222) | > loss_mel: 19.46855926513672 (20.034590387830935) | > loss_duration: 1.40403151512146 (1.319883752842339) | > loss_1: 25.609161376953125 (29.897583134320318) | > grad_norm_1: tensor(8427.9121, device='cuda:0') (tensor(27658.5859, device='cuda:0')) | > current_lr_0: 6.275541838259278e-05 | > current_lr_1: 6.28182091156116e-05 | > step_time: 1.8853 (0.6134916130377324) | > loader_time: 5.5904 (0.13261902089021643) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_111000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9932360649108887 (2.8910319209098816) | > loss_disc_real_0: 0.39257314801216125 (0.3491610996425152) | > loss_disc_real_1: 0.39834943413734436 (0.25756407901644707) | > loss_disc_real_2: 0.39223870635032654 (0.31269346550107) | > loss_disc_real_3: 0.294381320476532 (0.2972477898001671) | > loss_disc_real_4: 0.37484821677207947 (0.30935394018888474) | > loss_disc_real_5: 0.30927664041519165 (0.29833148419857025) | > loss_0: 2.9932360649108887 (2.8910319209098816) | > loss_gen: 2.8010144233703613 (2.3543057441711426) | > loss_kl: 5.362292766571045 (4.945136725902557) | > loss_feat: 6.282904624938965 (5.944187343120575) | > loss_mel: 21.4334716796875 (22.762461185455322) | > loss_duration: 3.094123601913452 (3.23363196849823) | > loss_1: 38.97380447387695 (39.23972225189209)  --> STEP: 1 | > loss_disc: 2.9425573348999023 (2.901337003707886) | > loss_disc_real_0: 0.2516810894012451 (0.32966509759426116) | > loss_disc_real_1: 0.2612612247467041 (0.2583035081624985) | > loss_disc_real_2: 0.24934586882591248 (0.3000239461660385) | > loss_disc_real_3: 0.26075229048728943 (0.28994868993759154) | > loss_disc_real_4: 0.28804323077201843 (0.3050917983055115) | > loss_disc_real_5: 0.2665731608867645 (0.2919798195362091) | > loss_0: 2.9425573348999023 (2.901337003707886) | > loss_gen: 1.6538145542144775 (2.2142075061798097) | > loss_kl: 5.521575450897217 (5.06042447090149) | > loss_feat: 0.16462767124176025 (4.788275408744812) | > loss_mel: 9.453596115112305 (20.100688171386718) | > loss_duration: 3.5197067260742188 (3.290846920013428) | > loss_1: 20.31332015991211 (35.45444183349609)  --> STEP: 2 | > loss_disc: 2.9934439659118652 (2.916688164075216) | > loss_disc_real_0: 0.23654800653457642 (0.31414558241764706) | > loss_disc_real_1: 0.26072585582733154 (0.258707232773304) | > loss_disc_real_2: 0.2488253265619278 (0.2914908428986867) | > loss_disc_real_3: 0.2603902518749237 (0.2850222835938136) | > loss_disc_real_4: 0.2878616750240326 (0.30222011109193164) | > loss_disc_real_5: 0.26659053564071655 (0.2877482722202937) | > loss_0: 2.9934439659118652 (2.916688164075216) | > loss_gen: 1.5731666088104248 (2.1073673566182456) | > loss_kl: 5.859048366546631 (5.193528453509013) | > loss_feat: 0.03232753276824951 (3.995617429415385) | > loss_mel: 2.5611572265625 (17.177433013916016) | > loss_duration: 3.2831549644470215 (3.289564927419027) | > loss_1: 13.308855056762695 (31.763510704040527)  --> STEP: 3 | > loss_disc: 2.816417694091797 (2.9023638112204417) | > loss_disc_real_0: 0.19684353470802307 (0.2973881470305579) | > loss_disc_real_1: 0.31940001249313354 (0.2673776298761368) | > loss_disc_real_2: 0.25738656520843506 (0.2866188032286508) | > loss_disc_real_3: 0.32126176357269287 (0.2901993521622249) | > loss_disc_real_4: 0.33674970269203186 (0.307152909891946) | > loss_disc_real_5: 0.3271602988243103 (0.2933785617351532) | > loss_0: 2.816417694091797 (2.9023638112204417) | > loss_gen: 2.3175597190856934 (2.137394836970738) | > loss_kl: 2.2749507427215576 (4.7765887805393765) | > loss_feat: 5.0921711921691895 (4.1522679669516425) | > loss_mel: 20.874210357666016 (17.705544063023158) | > loss_duration: 2.980254888534546 (3.245377779006958) | > loss_1: 33.539146423339844 (32.017172949654714) --> EVAL PERFORMANCE | > avg_loader_time: 0.3154544489724295 (+0.3059285141172863) | > avg_loss_disc: 2.9023638112204417 (+0.17272745995294514) | > avg_loss_disc_real_0: 0.2973881470305579 (+0.10750054887362887) | > avg_loss_disc_real_1: 0.2673776298761368 (+0.0040662040313084735) | > avg_loss_disc_real_2: 0.2866188032286508 (+0.011496155744507242) | > avg_loss_disc_real_3: 0.2901993521622249 (+0.050566785392307106) | > avg_loss_disc_real_4: 0.307152909891946 (+0.05872034316971189) | > avg_loss_disc_real_5: 0.2933785617351532 (+0.020476768414179503) | > avg_loss_0: 2.9023638112204417 (+0.17272745995294514) | > avg_loss_gen: 2.137394836970738 (+0.16876194022950686) | > avg_loss_kl: 4.7765887805393765 (-0.031758921486990666) | > avg_loss_feat: 4.1522679669516425 (+1.0450351181484403) | > avg_loss_mel: 17.705544063023158 (-3.7952443077450724) | > avg_loss_duration: 3.245377779006958 (+0.006295045216878403) | > avg_loss_1: 32.017172949654714 (-2.606912158784411)  > EPOCH: 1160/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:41:11)   --> TIME: 2023-10-20 14:41:36 -- STEP: 29/50 -- GLOBAL_STEP: 111030 | > loss_disc: 2.519566774368286 (2.4737777257787767) | > loss_disc_real_0: 0.11642412841320038 (0.13101714117259816) | > loss_disc_real_1: 0.3129471242427826 (0.22914311919232894) | > loss_disc_real_2: 0.17915475368499756 (0.219132365080817) | > loss_disc_real_3: 0.24214808642864227 (0.2518751364329765) | > loss_disc_real_4: 0.22048310935497284 (0.2151022124393233) | > loss_disc_real_5: 0.2410290390253067 (0.21233080385317063) | > loss_0: 2.519566774368286 (2.4737777257787767) | > grad_norm_0: tensor(1055.0034, device='cuda:0') (tensor(1071.1053, device='cuda:0')) | > loss_gen: 1.9442064762115479 (2.190038023323848) | > loss_kl: 0.8178902864456177 (0.8865925458998516) | > loss_feat: 1.7766737937927246 (5.486960660794686) | > loss_mel: 17.016284942626953 (21.171921750594834) | > loss_duration: 1.3050683736801147 (1.3249178960405548) | > loss_1: 22.860124588012695 (31.06043085558661) | > grad_norm_1: tensor(7948.5444, device='cuda:0') (tensor(36790.1602, device='cuda:0')) | > current_lr_0: 6.26926904128429e-05 | > current_lr_1: 6.275541838259278e-05 | > step_time: 0.2763 (0.6583407747334448) | > loader_time: 0.0047 (0.01854466569834742)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.788357734680176 (2.788357734680176) | > loss_disc_real_0: 0.10876794904470444 (0.10876794904470444) | > loss_disc_real_1: 0.26588404178619385 (0.26588404178619385) | > loss_disc_real_2: 0.2364456057548523 (0.2364456057548523) | > loss_disc_real_3: 0.23639585077762604 (0.23639585077762604) | > loss_disc_real_4: 0.2338768094778061 (0.2338768094778061) | > loss_disc_real_5: 0.263447105884552 (0.263447105884552) | > loss_0: 2.788357734680176 (2.788357734680176) | > loss_gen: 1.5655641555786133 (1.5655641555786133) | > loss_kl: 5.657622814178467 (5.657622814178467) | > loss_feat: 0.589422345161438 (0.589422345161438) | > loss_mel: 13.574752807617188 (13.574752807617188) | > loss_duration: 3.0415663719177246 (3.0415663719177246) | > loss_1: 24.428930282592773 (24.428930282592773)  --> STEP: 1 | > loss_disc: 2.8498380184173584 (2.8498380184173584) | > loss_disc_real_0: 0.12029233574867249 (0.12029233574867249) | > loss_disc_real_1: 0.2658312916755676 (0.2658312916755676) | > loss_disc_real_2: 0.24078568816184998 (0.24078568816184998) | > loss_disc_real_3: 0.23624616861343384 (0.23624616861343384) | > loss_disc_real_4: 0.23294010758399963 (0.23294010758399963) | > loss_disc_real_5: 0.2629750370979309 (0.2629750370979309) | > loss_0: 2.8498380184173584 (2.8498380184173584) | > loss_gen: 1.513310194015503 (1.513310194015503) | > loss_kl: 5.5928215980529785 (5.5928215980529785) | > loss_feat: 0.4445655643939972 (0.4445655643939972) | > loss_mel: 12.57209587097168 (12.57209587097168) | > loss_duration: 3.3757059574127197 (3.3757059574127197) | > loss_1: 23.498498916625977 (23.498498916625977)  --> STEP: 2 | > loss_disc: 2.7979114055633545 (2.8238747119903564) | > loss_disc_real_0: 0.4292575418949127 (0.2747749388217926) | > loss_disc_real_1: 0.3872651755809784 (0.326548233628273) | > loss_disc_real_2: 0.3859919011592865 (0.31338879466056824) | > loss_disc_real_3: 0.339388906955719 (0.2878175377845764) | > loss_disc_real_4: 0.27791711688041687 (0.25542861223220825) | > loss_disc_real_5: 0.3500076234340668 (0.30649133026599884) | > loss_0: 2.7979114055633545 (2.8238747119903564) | > loss_gen: 3.569124698638916 (2.5412174463272095) | > loss_kl: 5.758252143859863 (5.675536870956421) | > loss_feat: 10.200508117675781 (5.322536841034889) | > loss_mel: 23.635560989379883 (18.10382843017578) | > loss_duration: 3.3334603309631348 (3.3545831441879272) | > loss_1: 46.496910095214844 (34.99770450592041)  --> STEP: 3 | > loss_disc: 3.0072720050811768 (2.88500714302063) | > loss_disc_real_0: 0.26961958408355713 (0.2730564872423808) | > loss_disc_real_1: 0.37350064516067505 (0.34219903747240704) | > loss_disc_real_2: 0.4042755663394928 (0.3436843852202098) | > loss_disc_real_3: 0.17842471599578857 (0.25135326385498047) | > loss_disc_real_4: 0.32061633467674255 (0.27715785304705304) | > loss_disc_real_5: 0.3734889626502991 (0.32882387439409894) | > loss_0: 3.0072720050811768 (2.88500714302063) | > loss_gen: 2.5023858547210693 (2.528273582458496) | > loss_kl: 2.9062938690185547 (4.752455870310466) | > loss_feat: 4.765048980712891 (5.13670755426089) | > loss_mel: 22.868297576904297 (19.69198481241862) | > loss_duration: 3.1084437370300293 (3.2725366751352944) | > loss_1: 36.15047073364258 (35.38195991516113) --> EVAL PERFORMANCE | > avg_loader_time: 0.013268709182739258 (-0.30218573978969027) | > avg_loss_disc: 2.88500714302063 (-0.017356668199811853) | > avg_loss_disc_real_0: 0.2730564872423808 (-0.024331659788177085) | > avg_loss_disc_real_1: 0.34219903747240704 (+0.07482140759627026) | > avg_loss_disc_real_2: 0.3436843852202098 (+0.05706558199155898) | > avg_loss_disc_real_3: 0.25135326385498047 (-0.03884608830724445) | > avg_loss_disc_real_4: 0.27715785304705304 (-0.029995056844892953) | > avg_loss_disc_real_5: 0.32882387439409894 (+0.03544531265894574) | > avg_loss_0: 2.88500714302063 (-0.017356668199811853) | > avg_loss_gen: 2.528273582458496 (+0.39087874548775803) | > avg_loss_kl: 4.752455870310466 (-0.02413291022891073) | > avg_loss_feat: 5.13670755426089 (+0.9844395873092475) | > avg_loss_mel: 19.69198481241862 (+1.986440749395463) | > avg_loss_duration: 3.2725366751352944 (+0.02715889612833644) | > avg_loss_1: 35.38195991516113 (+3.3647869655064184)  > EPOCH: 1161/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:41:53)   --> TIME: 2023-10-20 14:42:04 -- STEP: 9/50 -- GLOBAL_STEP: 111060 | > loss_disc: 2.9639883041381836 (2.171329034699334) | > loss_disc_real_0: 0.46129077672958374 (0.16503432082633177) | > loss_disc_real_1: 0.23756371438503265 (0.21037105926209027) | > loss_disc_real_2: 0.19658304750919342 (0.19557379475898212) | > loss_disc_real_3: 0.2526462972164154 (0.17450416564113563) | > loss_disc_real_4: 0.25773096084594727 (0.17942408699956205) | > loss_disc_real_5: 0.2594572603702545 (0.18724436105953324) | > loss_0: 2.9639883041381836 (2.171329034699334) | > grad_norm_0: tensor(5667.9248, device='cuda:0') (tensor(1382.9102, device='cuda:0')) | > loss_gen: 1.8143579959869385 (2.501966781086392) | > loss_kl: 0.5529516339302063 (0.8057083619965447) | > loss_feat: 0.4950614869594574 (7.306069225072861) | > loss_mel: 12.593917846679688 (20.940709431966145) | > loss_duration: 1.3043055534362793 (1.3145761489868164) | > loss_1: 16.76059341430664 (32.86902936299642) | > grad_norm_1: tensor(48564.5039, device='cuda:0') (tensor(30576.4102, device='cuda:0')) | > current_lr_0: 6.263002514362617e-05 | > current_lr_1: 6.26926904128429e-05 | > step_time: 0.8208 (0.6311378743913438) | > loader_time: 0.0079 (0.03010114034016927)  --> TIME: 2023-10-20 14:42:23 -- STEP: 39/50 -- GLOBAL_STEP: 111090 | > loss_disc: 1.4121171236038208 (2.3762772327814345) | > loss_disc_real_0: 0.014014184474945068 (0.14052892161103392) | > loss_disc_real_1: 0.048177581280469894 (0.21182805949296707) | > loss_disc_real_2: 0.024441329762339592 (0.21067444984920514) | > loss_disc_real_3: 0.0949125811457634 (0.21750478556331915) | > loss_disc_real_4: 0.04986996203660965 (0.21186339535201207) | > loss_disc_real_5: 0.046247489750385284 (0.22755214056143394) | > loss_0: 1.4121171236038208 (2.3762772327814345) | > grad_norm_0: tensor(871.5873, device='cuda:0') (tensor(1260.8794, device='cuda:0')) | > loss_gen: 3.161179542541504 (2.3243352083059463) | > loss_kl: 0.866153359413147 (0.7497305052402692) | > loss_feat: 14.124044418334961 (5.967390210964742) | > loss_mel: 25.129859924316406 (20.324877641139885) | > loss_duration: 1.370361328125 (1.3122878930507562) | > loss_1: 44.65159606933594 (30.678621610005695) | > grad_norm_1: tensor(46632.6211, device='cuda:0') (tensor(37476.5273, device='cuda:0')) | > current_lr_0: 6.263002514362617e-05 | > current_lr_1: 6.26926904128429e-05 | > step_time: 0.5862 (0.620408602249928) | > loader_time: 0.0075 (0.023804682951707106)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2279138565063477 (2.2279138565063477) | > loss_disc_real_0: 0.2673608362674713 (0.2673608362674713) | > loss_disc_real_1: 0.16010861098766327 (0.16010861098766327) | > loss_disc_real_2: 0.15904958546161652 (0.15904958546161652) | > loss_disc_real_3: 0.07501982897520065 (0.07501982897520065) | > loss_disc_real_4: 0.25547343492507935 (0.25547343492507935) | > loss_disc_real_5: 0.22395728528499603 (0.22395728528499603) | > loss_0: 2.2279138565063477 (2.2279138565063477) | > loss_gen: 3.153780698776245 (3.153780698776245) | > loss_kl: 5.538044452667236 (5.538044452667236) | > loss_feat: 12.406495094299316 (12.406495094299316) | > loss_mel: 25.9967041015625 (25.9967041015625) | > loss_duration: 3.14357852935791 (3.14357852935791) | > loss_1: 50.23860549926758 (50.23860549926758)  --> STEP: 1 | > loss_disc: 2.833317995071411 (2.833317995071411) | > loss_disc_real_0: 0.18435895442962646 (0.18435895442962646) | > loss_disc_real_1: 0.2970075011253357 (0.2970075011253357) | > loss_disc_real_2: 0.30726268887519836 (0.30726268887519836) | > loss_disc_real_3: 0.3652034103870392 (0.3652034103870392) | > loss_disc_real_4: 0.2922128736972809 (0.2922128736972809) | > loss_disc_real_5: 0.3254251480102539 (0.3254251480102539) | > loss_0: 2.833317995071411 (2.833317995071411) | > loss_gen: 2.6103005409240723 (2.6103005409240723) | > loss_kl: 5.485340118408203 (5.485340118408203) | > loss_feat: 8.133858680725098 (8.133858680725098) | > loss_mel: 21.51753044128418 (21.51753044128418) | > loss_duration: 3.4322142601013184 (3.4322142601013184) | > loss_1: 41.17924499511719 (41.17924499511719)  --> STEP: 2 | > loss_disc: 1.9970359802246094 (2.4151769876480103) | > loss_disc_real_0: 0.1451207846403122 (0.16473986953496933) | > loss_disc_real_1: 0.12476437538862228 (0.210885938256979) | > loss_disc_real_2: 0.2216956466436386 (0.2644791677594185) | > loss_disc_real_3: 0.39660003781318665 (0.3809017241001129) | > loss_disc_real_4: 0.196010559797287 (0.24411171674728394) | > loss_disc_real_5: 0.21496431529521942 (0.27019473165273666) | > loss_0: 1.9970359802246094 (2.4151769876480103) | > loss_gen: 3.637662887573242 (3.1239817142486572) | > loss_kl: 5.823272705078125 (5.654306411743164) | > loss_feat: 9.412353515625 (8.773106098175049) | > loss_mel: 25.186050415039062 (23.35179042816162) | > loss_duration: 3.3234949111938477 (3.377854585647583) | > loss_1: 47.382835388183594 (44.28104019165039)  --> STEP: 3 | > loss_disc: 2.6739377975463867 (2.5014305909474692) | > loss_disc_real_0: 0.15488283336162567 (0.16145419081052145) | > loss_disc_real_1: 0.2619514465332031 (0.2279077743490537) | > loss_disc_real_2: 0.32379141449928284 (0.2842499166727066) | > loss_disc_real_3: 0.3376406729221344 (0.36648137370745343) | > loss_disc_real_4: 0.38621583580970764 (0.2914797564347585) | > loss_disc_real_5: 0.4125007092952728 (0.31763005753358203) | > loss_0: 2.6739377975463867 (2.5014305909474692) | > loss_gen: 3.5809030532836914 (3.2762888272603354) | > loss_kl: 2.8407301902770996 (4.716447671254476) | > loss_feat: 5.288323402404785 (7.611511866251628) | > loss_mel: 23.011123657226562 (23.238234837849934) | > loss_duration: 3.1120240688323975 (3.2892444133758545) | > loss_1: 37.83310317993164 (42.131727854410805) --> EVAL PERFORMANCE | > avg_loader_time: 0.00624394416809082 (-0.0070247650146484375) | > avg_loss_disc: 2.5014305909474692 (-0.38357655207316066) | > avg_loss_disc_real_0: 0.16145419081052145 (-0.11160229643185934) | > avg_loss_disc_real_1: 0.2279077743490537 (-0.11429126312335333) | > avg_loss_disc_real_2: 0.2842499166727066 (-0.05943446854750317) | > avg_loss_disc_real_3: 0.36648137370745343 (+0.11512810985247296) | > avg_loss_disc_real_4: 0.2914797564347585 (+0.014321903387705448) | > avg_loss_disc_real_5: 0.31763005753358203 (-0.011193816860516903) | > avg_loss_0: 2.5014305909474692 (-0.38357655207316066) | > avg_loss_gen: 3.2762888272603354 (+0.7480152448018393) | > avg_loss_kl: 4.716447671254476 (-0.036008199055990175) | > avg_loss_feat: 7.611511866251628 (+2.474804311990738) | > avg_loss_mel: 23.238234837849934 (+3.5462500254313127) | > avg_loss_duration: 3.2892444133758545 (+0.016707738240560044) | > avg_loss_1: 42.131727854410805 (+6.749767939249672)  > EPOCH: 1162/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:42:47)   --> TIME: 2023-10-20 14:43:03 -- STEP: 19/50 -- GLOBAL_STEP: 111120 | > loss_disc: 3.0087828636169434 (2.484612119825263) | > loss_disc_real_0: 0.4096536934375763 (0.14108343613579089) | > loss_disc_real_1: 0.2599605917930603 (0.21374473769805932) | > loss_disc_real_2: 0.21789290010929108 (0.2272028734809474) | > loss_disc_real_3: 0.275776207447052 (0.25654556563026026) | > loss_disc_real_4: 0.27672913670539856 (0.23764378302975706) | > loss_disc_real_5: 0.27799925208091736 (0.2163888394930645) | > loss_0: 3.0087828636169434 (2.484612119825263) | > grad_norm_0: tensor(2028.8793, device='cuda:0') (tensor(1331.0564, device='cuda:0')) | > loss_gen: 1.7101167440414429 (2.3331660220497534) | > loss_kl: 0.989525318145752 (0.7893277751772028) | > loss_feat: 0.7939990162849426 (5.949307972075124) | > loss_mel: 17.23336410522461 (20.82792636595274) | > loss_duration: 1.4367339611053467 (1.34755497857144) | > loss_1: 22.163738250732422 (31.247283433613024) | > grad_norm_1: tensor(4901.6973, device='cuda:0') (tensor(32966.7148, device='cuda:0')) | > current_lr_0: 6.256742251226943e-05 | > current_lr_1: 6.263002514362617e-05 | > step_time: 0.5574 (0.5847649197829398) | > loader_time: 0.0284 (0.016070667066072162)  --> TIME: 2023-10-20 14:43:22 -- STEP: 49/50 -- GLOBAL_STEP: 111150 | > loss_disc: 3.5177152156829834 (2.457411617648845) | > loss_disc_real_0: 0.08260862529277802 (0.14827805384993553) | > loss_disc_real_1: 0.2895507514476776 (0.224953918470716) | > loss_disc_real_2: 0.337129145860672 (0.22935931316139746) | > loss_disc_real_3: 0.3064339756965637 (0.23756453569750396) | > loss_disc_real_4: 0.20340768992900848 (0.2323982262299681) | > loss_disc_real_5: 0.19464010000228882 (0.2215873572253147) | > loss_0: 3.5177152156829834 (2.457411617648845) | > grad_norm_0: tensor(1406.3781, device='cuda:0') (tensor(1213.6434, device='cuda:0')) | > loss_gen: 1.494564175605774 (2.3122367469631895) | > loss_kl: 0.19253648817539215 (0.7773241982700265) | > loss_feat: 5.9926042556762695 (5.921061446548117) | > loss_mel: 22.541399002075195 (21.058980769040637) | > loss_duration: 1.428479790687561 (1.3270074664330003) | > loss_1: 31.64958381652832 (31.3966107465783) | > grad_norm_1: tensor(25353.1738, device='cuda:0') (tensor(31887.0156, device='cuda:0')) | > current_lr_0: 6.256742251226943e-05 | > current_lr_1: 6.263002514362617e-05 | > step_time: 0.691 (0.5809798970514416) | > loader_time: 0.3865 (0.024279842571336394)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.951509475708008 (2.951509475708008) | > loss_disc_real_0: 0.4124302864074707 (0.4124302864074707) | > loss_disc_real_1: 0.2751242518424988 (0.2751242518424988) | > loss_disc_real_2: 0.3500094711780548 (0.3500094711780548) | > loss_disc_real_3: 0.25772982835769653 (0.25772982835769653) | > loss_disc_real_4: 0.21783684194087982 (0.21783684194087982) | > loss_disc_real_5: 0.2501460611820221 (0.2501460611820221) | > loss_0: 2.951509475708008 (2.951509475708008) | > loss_gen: 2.030780792236328 (2.030780792236328) | > loss_kl: 6.31282377243042 (6.31282377243042) | > loss_feat: 3.4299051761627197 (3.4299051761627197) | > loss_mel: 24.24203872680664 (24.24203872680664) | > loss_duration: 3.10308837890625 (3.10308837890625) | > loss_1: 39.11863708496094 (39.11863708496094)  --> STEP: 1 | > loss_disc: 2.503291368484497 (2.503291368484497) | > loss_disc_real_0: 0.2561759948730469 (0.2561759948730469) | > loss_disc_real_1: 0.24277456104755402 (0.24277456104755402) | > loss_disc_real_2: 0.2672009766101837 (0.2672009766101837) | > loss_disc_real_3: 0.23071078956127167 (0.23071078956127167) | > loss_disc_real_4: 0.3229060769081116 (0.3229060769081116) | > loss_disc_real_5: 0.22784239053726196 (0.22784239053726196) | > loss_0: 2.503291368484497 (2.503291368484497) | > loss_gen: 2.4258840084075928 (2.4258840084075928) | > loss_kl: 5.247345447540283 (5.247345447540283) | > loss_feat: 4.881746768951416 (4.881746768951416) | > loss_mel: 21.667280197143555 (21.667280197143555) | > loss_duration: 3.3739233016967773 (3.3739233016967773) | > loss_1: 37.5961799621582 (37.5961799621582)  --> STEP: 2 | > loss_disc: 2.352633237838745 (2.427962303161621) | > loss_disc_real_0: 0.23852784931659698 (0.24735192209482193) | > loss_disc_real_1: 0.24001242220401764 (0.24139349162578583) | > loss_disc_real_2: 0.23692587018013 (0.25206342339515686) | > loss_disc_real_3: 0.37809398770332336 (0.3044023886322975) | > loss_disc_real_4: 0.26336613297462463 (0.2931361049413681) | > loss_disc_real_5: 0.3352474570274353 (0.28154492378234863) | > loss_0: 2.352633237838745 (2.427962303161621) | > loss_gen: 3.17922306060791 (2.8025535345077515) | > loss_kl: 5.899153709411621 (5.573249578475952) | > loss_feat: 7.616179943084717 (6.248963356018066) | > loss_mel: 22.647878646850586 (22.15757942199707) | > loss_duration: 3.2190229892730713 (3.2964731454849243) | > loss_1: 42.561458587646484 (40.078819274902344)  --> STEP: 3 | > loss_disc: 2.7862162590026855 (2.547380288441976) | > loss_disc_real_0: 0.25544100999832153 (0.2500482847293218) | > loss_disc_real_1: 0.261741578578949 (0.2481761872768402) | > loss_disc_real_2: 0.35000088810920715 (0.28470924496650696) | > loss_disc_real_3: 0.2691410183906555 (0.2926485985517502) | > loss_disc_real_4: 0.25680652260780334 (0.2810262441635132) | > loss_disc_real_5: 0.2736916244029999 (0.27892715732256573) | > loss_0: 2.7862162590026855 (2.547380288441976) | > loss_gen: 2.130950689315796 (2.578685919443766) | > loss_kl: 2.8643670082092285 (4.670288721720378) | > loss_feat: 1.8423656225204468 (4.780097444852193) | > loss_mel: 21.440471649169922 (21.918543497721355) | > loss_duration: 3.071992874145508 (3.2216463883717856) | > loss_1: 31.350149154663086 (37.16926256815592) --> EVAL PERFORMANCE | > avg_loader_time: 0.015825589497884113 (+0.009581645329793293) | > avg_loss_disc: 2.547380288441976 (+0.045949697494506836) | > avg_loss_disc_real_0: 0.2500482847293218 (+0.08859409391880033) | > avg_loss_disc_real_1: 0.2481761872768402 (+0.0202684129277865) | > avg_loss_disc_real_2: 0.28470924496650696 (+0.000459328293800354) | > avg_loss_disc_real_3: 0.2926485985517502 (-0.07383277515570325) | > avg_loss_disc_real_4: 0.2810262441635132 (-0.010453512271245302) | > avg_loss_disc_real_5: 0.27892715732256573 (-0.0387029002110163) | > avg_loss_0: 2.547380288441976 (+0.045949697494506836) | > avg_loss_gen: 2.578685919443766 (-0.6976029078165693) | > avg_loss_kl: 4.670288721720378 (-0.046158949534097715) | > avg_loss_feat: 4.780097444852193 (-2.831414421399435) | > avg_loss_mel: 21.918543497721355 (-1.3196913401285784) | > avg_loss_duration: 3.2216463883717856 (-0.06759802500406886) | > avg_loss_1: 37.16926256815592 (-4.962465286254883)  > EPOCH: 1163/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:43:35)   --> TIME: 2023-10-20 14:43:55 -- STEP: 29/50 -- GLOBAL_STEP: 111180 | > loss_disc: 2.9728174209594727 (2.4553385644123473) | > loss_disc_real_0: 0.3749997615814209 (0.14846327098022247) | > loss_disc_real_1: 0.23661060631275177 (0.2224469649894484) | > loss_disc_real_2: 0.22804255783557892 (0.21437875566811398) | > loss_disc_real_3: 0.2116527408361435 (0.22386247542654647) | > loss_disc_real_4: 0.24334585666656494 (0.24009968924882089) | > loss_disc_real_5: 0.26131555438041687 (0.2090245920779376) | > loss_0: 2.9728174209594727 (2.4553385644123473) | > grad_norm_0: tensor(1885.1259, device='cuda:0') (tensor(1010.8904, device='cuda:0')) | > loss_gen: 1.5769811868667603 (2.25662126623351) | > loss_kl: 0.6493020057678223 (0.8129294062482899) | > loss_feat: 0.2639898359775543 (5.375341262636257) | > loss_mel: 14.925130844116211 (18.127175914830175) | > loss_duration: 1.3298670053482056 (1.3278708416840126) | > loss_1: 18.745269775390625 (27.899938665587328) | > grad_norm_1: tensor(35875.6133, device='cuda:0') (tensor(37396.2852, device='cuda:0')) | > current_lr_0: 6.250488245616226e-05 | > current_lr_1: 6.256742251226943e-05 | > step_time: 0.4454 (0.489468344326677) | > loader_time: 0.0128 (0.015150242838366277)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.97346830368042 (1.97346830368042) | > loss_disc_real_0: 0.1368928700685501 (0.1368928700685501) | > loss_disc_real_1: 0.1319943070411682 (0.1319943070411682) | > loss_disc_real_2: 0.1056506410241127 (0.1056506410241127) | > loss_disc_real_3: 0.11803311109542847 (0.11803311109542847) | > loss_disc_real_4: 0.08958101272583008 (0.08958101272583008) | > loss_disc_real_5: 0.07878541201353073 (0.07878541201353073) | > loss_0: 1.97346830368042 (1.97346830368042) | > loss_gen: 2.202634811401367 (2.202634811401367) | > loss_kl: 5.362196922302246 (5.362196922302246) | > loss_feat: 10.883352279663086 (10.883352279663086) | > loss_mel: 25.166725158691406 (25.166725158691406) | > loss_duration: 2.9972259998321533 (2.9972259998321533) | > loss_1: 46.61213302612305 (46.61213302612305)  --> STEP: 1 | > loss_disc: 2.5382797718048096 (2.5382797718048096) | > loss_disc_real_0: 0.40660548210144043 (0.40660548210144043) | > loss_disc_real_1: 0.309834748506546 (0.309834748506546) | > loss_disc_real_2: 0.3497037887573242 (0.3497037887573242) | > loss_disc_real_3: 0.22217418253421783 (0.22217418253421783) | > loss_disc_real_4: 0.28081080317497253 (0.28081080317497253) | > loss_disc_real_5: 0.18055377900600433 (0.18055377900600433) | > loss_0: 2.5382797718048096 (2.5382797718048096) | > loss_gen: 2.873793840408325 (2.873793840408325) | > loss_kl: 5.492308616638184 (5.492308616638184) | > loss_feat: 7.623043060302734 (7.623043060302734) | > loss_mel: 22.111665725708008 (22.111665725708008) | > loss_duration: 3.531146287918091 (3.531146287918091) | > loss_1: 41.6319580078125 (41.6319580078125)  --> STEP: 2 | > loss_disc: 3.07708477973938 (2.8076822757720947) | > loss_disc_real_0: 0.42763248085975647 (0.41711898148059845) | > loss_disc_real_1: 0.25811895728111267 (0.28397685289382935) | > loss_disc_real_2: 0.21299424767494202 (0.2813490182161331) | > loss_disc_real_3: 0.24151289463043213 (0.23184353858232498) | > loss_disc_real_4: 0.27267009019851685 (0.2767404466867447) | > loss_disc_real_5: 0.2756597697734833 (0.2281067743897438) | > loss_0: 3.07708477973938 (2.8076822757720947) | > loss_gen: 1.6524856090545654 (2.2631397247314453) | > loss_kl: 5.734316349029541 (5.613312482833862) | > loss_feat: 0.07879139482975006 (3.850917227566242) | > loss_mel: 1.7229821681976318 (11.91732394695282) | > loss_duration: 3.2535202503204346 (3.3923332691192627) | > loss_1: 12.442095756530762 (27.03702688217163)  --> STEP: 3 | > loss_disc: 2.9405267238616943 (2.851963758468628) | > loss_disc_real_0: 0.3062589764595032 (0.3801656464735667) | > loss_disc_real_1: 0.24366506934165955 (0.27053959170977276) | > loss_disc_real_2: 0.1815347671508789 (0.2480776011943817) | > loss_disc_real_3: 0.2245025485754013 (0.22939654191335043) | > loss_disc_real_4: 0.26821544766426086 (0.27389878034591675) | > loss_disc_real_5: 0.26444336771965027 (0.2402189721663793) | > loss_0: 2.9405267238616943 (2.851963758468628) | > loss_gen: 1.60588538646698 (2.044054945309957) | > loss_kl: 2.6902098655700684 (4.638944943745931) | > loss_feat: 0.4467346966266632 (2.7161897172530494) | > loss_mel: 14.114278793334961 (12.6496422290802) | > loss_duration: 3.000373363494873 (3.2616799672444663) | > loss_1: 21.857481002807617 (25.310511589050293) --> EVAL PERFORMANCE | > avg_loader_time: 0.017005761464436848 (+0.0011801719665527344) | > avg_loss_disc: 2.851963758468628 (+0.30458347002665187) | > avg_loss_disc_real_0: 0.3801656464735667 (+0.13011736174424493) | > avg_loss_disc_real_1: 0.27053959170977276 (+0.022363404432932554) | > avg_loss_disc_real_2: 0.2480776011943817 (-0.036631643772125244) | > avg_loss_disc_real_3: 0.22939654191335043 (-0.06325205663839975) | > avg_loss_disc_real_4: 0.27389878034591675 (-0.0071274638175964355) | > avg_loss_disc_real_5: 0.2402189721663793 (-0.03870818515618643) | > avg_loss_0: 2.851963758468628 (+0.30458347002665187) | > avg_loss_gen: 2.044054945309957 (-0.5346309741338091) | > avg_loss_kl: 4.638944943745931 (-0.03134377797444721) | > avg_loss_feat: 2.7161897172530494 (-2.0639077275991435) | > avg_loss_mel: 12.6496422290802 (-9.268901268641155) | > avg_loss_duration: 3.2616799672444663 (+0.040033578872680664) | > avg_loss_1: 25.310511589050293 (-11.85875097910563)  > EPOCH: 1164/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:44:24)   --> TIME: 2023-10-20 14:44:35 -- STEP: 9/50 -- GLOBAL_STEP: 111210 | > loss_disc: 2.741461753845215 (2.5979729890823364) | > loss_disc_real_0: 0.23852106928825378 (0.22343969510661232) | > loss_disc_real_1: 0.20911234617233276 (0.22692446120911175) | > loss_disc_real_2: 0.23359699547290802 (0.2270136078198751) | > loss_disc_real_3: 0.22660283744335175 (0.22054270406564078) | > loss_disc_real_4: 0.38038623332977295 (0.2614472040699588) | > loss_disc_real_5: 0.3061716556549072 (0.2688128314912319) | > loss_0: 2.741461753845215 (2.5979729890823364) | > grad_norm_0: tensor(415.2955, device='cuda:0') (tensor(791.6898, device='cuda:0')) | > loss_gen: 2.340784788131714 (2.166681514845954) | > loss_kl: 0.9240337014198303 (0.6586370898617638) | > loss_feat: 4.950459957122803 (5.103502545091841) | > loss_mel: 21.797399520874023 (19.34574974907769) | > loss_duration: 1.3147133588790894 (1.3225772115919325) | > loss_1: 31.327390670776367 (28.59714847140842) | > grad_norm_1: tensor(7339.3442, device='cuda:0') (tensor(12723.2539, device='cuda:0')) | > current_lr_0: 6.244240491275675e-05 | > current_lr_1: 6.250488245616226e-05 | > step_time: 0.6457 (0.6204001903533936) | > loader_time: 0.0168 (0.025534205966525607)  --> TIME: 2023-10-20 14:44:57 -- STEP: 39/50 -- GLOBAL_STEP: 111240 | > loss_disc: 2.036637783050537 (2.6079892072922157) | > loss_disc_real_0: 0.1558048129081726 (0.1737198839441706) | > loss_disc_real_1: 0.1255338042974472 (0.22553033830645758) | > loss_disc_real_2: 0.17173759639263153 (0.2343935475517542) | > loss_disc_real_3: 0.1030149757862091 (0.23972086646617988) | > loss_disc_real_4: 0.09288118779659271 (0.22913434404211167) | > loss_disc_real_5: 0.06105425953865051 (0.23193593963216513) | > loss_0: 2.036637783050537 (2.6079892072922157) | > grad_norm_0: tensor(717.0181, device='cuda:0') (tensor(655.9709, device='cuda:0')) | > loss_gen: 2.0647668838500977 (2.0660223777477555) | > loss_kl: 0.30830180644989014 (0.7467411018143861) | > loss_feat: 6.858577251434326 (4.558107013599231) | > loss_mel: 17.057952880859375 (17.81136120282686) | > loss_duration: 1.3764121532440186 (1.3199539979298918) | > loss_1: 27.666011810302734 (26.50218580930661) | > grad_norm_1: tensor(33659.3438, device='cuda:0') (tensor(23335.5703, device='cuda:0')) | > current_lr_0: 6.244240491275675e-05 | > current_lr_1: 6.250488245616226e-05 | > step_time: 0.5806 (0.6667049481318548) | > loader_time: 0.0329 (0.025774540045322515)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.066380739212036 (3.066380739212036) | > loss_disc_real_0: 0.3145895004272461 (0.3145895004272461) | > loss_disc_real_1: 0.2934708297252655 (0.2934708297252655) | > loss_disc_real_2: 0.32991042733192444 (0.32991042733192444) | > loss_disc_real_3: 0.2770636975765228 (0.2770636975765228) | > loss_disc_real_4: 0.3176468014717102 (0.3176468014717102) | > loss_disc_real_5: 0.36212608218193054 (0.36212608218193054) | > loss_0: 3.066380739212036 (3.066380739212036) | > loss_gen: 2.0415525436401367 (2.0415525436401367) | > loss_kl: 5.874236106872559 (5.874236106872559) | > loss_feat: 3.546600818634033 (3.546600818634033) | > loss_mel: 23.45931625366211 (23.45931625366211) | > loss_duration: 3.140803337097168 (3.140803337097168) | > loss_1: 38.0625114440918 (38.0625114440918)  --> STEP: 1 | > loss_disc: 3.0576066970825195 (3.0576066970825195) | > loss_disc_real_0: 0.370319664478302 (0.370319664478302) | > loss_disc_real_1: 0.1928539127111435 (0.1928539127111435) | > loss_disc_real_2: 0.34534862637519836 (0.34534862637519836) | > loss_disc_real_3: 0.28889843821525574 (0.28889843821525574) | > loss_disc_real_4: 0.3328761160373688 (0.3328761160373688) | > loss_disc_real_5: 0.3664594292640686 (0.3664594292640686) | > loss_0: 3.0576066970825195 (3.0576066970825195) | > loss_gen: 2.0912582874298096 (2.0912582874298096) | > loss_kl: 5.456069469451904 (5.456069469451904) | > loss_feat: 2.935945510864258 (2.935945510864258) | > loss_mel: 24.87908935546875 (24.87908935546875) | > loss_duration: 3.4868853092193604 (3.4868853092193604) | > loss_1: 38.849246978759766 (38.849246978759766)  --> STEP: 2 | > loss_disc: 3.3832478523254395 (3.2204272747039795) | > loss_disc_real_0: 0.5480407476425171 (0.45918020606040955) | > loss_disc_real_1: 0.3780684471130371 (0.2854611799120903) | > loss_disc_real_2: 0.28896307945251465 (0.3171558529138565) | > loss_disc_real_3: 0.2579776346683502 (0.273438036441803) | > loss_disc_real_4: 0.15761178731918335 (0.24524395167827606) | > loss_disc_real_5: 0.2433718740940094 (0.304915651679039) | > loss_0: 3.3832478523254395 (3.2204272747039795) | > loss_gen: 1.8284610509872437 (1.9598596692085266) | > loss_kl: 5.43050479888916 (5.443287134170532) | > loss_feat: 6.0748610496521 (4.505403280258179) | > loss_mel: 24.595834732055664 (24.737462043762207) | > loss_duration: 3.324298143386841 (3.4055917263031006) | > loss_1: 41.25395965576172 (40.05160331726074)  --> STEP: 3 | > loss_disc: 2.9971072673797607 (3.1459872722625732) | > loss_disc_real_0: 0.36762866377830505 (0.42866302529970807) | > loss_disc_real_1: 0.26678216457366943 (0.27923484146595) | > loss_disc_real_2: 0.30827778577804565 (0.31419649720191956) | > loss_disc_real_3: 0.22190970182418823 (0.2562619249025981) | > loss_disc_real_4: 0.3063388168811798 (0.26560890674591064) | > loss_disc_real_5: 0.35484665632247925 (0.3215593198935191) | > loss_0: 2.9971072673797607 (3.1459872722625732) | > loss_gen: 1.9561880826950073 (1.9586358070373535) | > loss_kl: 3.090712785720825 (4.659095684687297) | > loss_feat: 1.9655314683914185 (3.6587793429692588) | > loss_mel: 19.95010757446289 (23.141677220662434) | > loss_duration: 3.0474112033843994 (3.2861982186635337) | > loss_1: 30.009950637817383 (36.70438575744629) --> EVAL PERFORMANCE | > avg_loader_time: 0.01160128911336263 (-0.005404472351074217) | > avg_loss_disc: 3.1459872722625732 (+0.2940235137939453) | > avg_loss_disc_real_0: 0.42866302529970807 (+0.04849737882614136) | > avg_loss_disc_real_1: 0.27923484146595 (+0.008695249756177248) | > avg_loss_disc_real_2: 0.31419649720191956 (+0.06611889600753784) | > avg_loss_disc_real_3: 0.2562619249025981 (+0.02686538298924765) | > avg_loss_disc_real_4: 0.26560890674591064 (-0.008289873600006104) | > avg_loss_disc_real_5: 0.3215593198935191 (+0.0813403477271398) | > avg_loss_0: 3.1459872722625732 (+0.2940235137939453) | > avg_loss_gen: 1.9586358070373535 (-0.0854191382726035) | > avg_loss_kl: 4.659095684687297 (+0.020150740941366152) | > avg_loss_feat: 3.6587793429692588 (+0.9425896257162094) | > avg_loss_mel: 23.141677220662434 (+10.492034991582234) | > avg_loss_duration: 3.2861982186635337 (+0.024518251419067383) | > avg_loss_1: 36.70438575744629 (+11.393874168395996)  > EPOCH: 1165/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:45:19)   --> TIME: 2023-10-20 14:45:36 -- STEP: 19/50 -- GLOBAL_STEP: 111270 | > loss_disc: 2.9575436115264893 (2.2828711961445056) | > loss_disc_real_0: 0.31926536560058594 (0.14073947464164935) | > loss_disc_real_1: 0.22028900682926178 (0.207293984921355) | > loss_disc_real_2: 0.22209104895591736 (0.21969999765094958) | > loss_disc_real_3: 0.25575926899909973 (0.22651830080308413) | > loss_disc_real_4: 0.25784990191459656 (0.1888907722344524) | > loss_disc_real_5: 0.2873987853527069 (0.20950493677274176) | > loss_0: 2.9575436115264893 (2.2828711961445056) | > grad_norm_0: tensor(1065.4979, device='cuda:0') (tensor(622.1054, device='cuda:0')) | > loss_gen: 1.6636768579483032 (2.393366813659668) | > loss_kl: 0.8760918974876404 (0.6890398514898199) | > loss_feat: 0.5558838248252869 (6.574354097247124) | > loss_mel: 7.193444728851318 (20.872731961702044) | > loss_duration: 1.3838976621627808 (1.3381439635628147) | > loss_1: 11.672995567321777 (31.867637082150107) | > grad_norm_1: tensor(4394.8779, device='cuda:0') (tensor(25313.9668, device='cuda:0')) | > current_lr_0: 6.237998981956754e-05 | > current_lr_1: 6.244240491275675e-05 | > step_time: 0.3198 (0.6027067711478785) | > loader_time: 0.0091 (0.018104289707384612)  --> TIME: 2023-10-20 14:45:48 -- STEP: 49/50 -- GLOBAL_STEP: 111300 | > loss_disc: 2.3334438800811768 (2.367221438154882) | > loss_disc_real_0: 0.21281450986862183 (0.14335359162080805) | > loss_disc_real_1: 0.2972860038280487 (0.21928767867538393) | > loss_disc_real_2: 0.12839965522289276 (0.22591689738387966) | > loss_disc_real_3: 0.2520914077758789 (0.23359445634545112) | > loss_disc_real_4: 0.21658875048160553 (0.224240688911202) | > loss_disc_real_5: 0.2754859924316406 (0.23154123439168445) | > loss_0: 2.3334438800811768 (2.367221438154882) | > grad_norm_0: tensor(736.3270, device='cuda:0') (tensor(600.7499, device='cuda:0')) | > loss_gen: 2.442012310028076 (2.369684868929338) | > loss_kl: 0.4932539463043213 (0.7033824327648902) | > loss_feat: 4.192798137664795 (6.108686848714644) | > loss_mel: 20.4550838470459 (20.726941955332855) | > loss_duration: 1.3995025157928467 (1.3080000123199151) | > loss_1: 28.982650756835938 (31.216696155314544) | > grad_norm_1: tensor(11722.5537, device='cuda:0') (tensor(20624.7812, device='cuda:0')) | > current_lr_0: 6.237998981956754e-05 | > current_lr_1: 6.244240491275675e-05 | > step_time: 0.4563 (0.4561938266364897) | > loader_time: 0.5578 (0.023746908927450374)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6996331214904785 (2.6996331214904785) | > loss_disc_real_0: 0.2256341576576233 (0.2256341576576233) | > loss_disc_real_1: 0.26783692836761475 (0.26783692836761475) | > loss_disc_real_2: 0.29752835631370544 (0.29752835631370544) | > loss_disc_real_3: 0.23345287144184113 (0.23345287144184113) | > loss_disc_real_4: 0.16737188398838043 (0.16737188398838043) | > loss_disc_real_5: 0.14703263342380524 (0.14703263342380524) | > loss_0: 2.6996331214904785 (2.6996331214904785) | > loss_gen: 1.7136294841766357 (1.7136294841766357) | > loss_kl: 5.581187725067139 (5.581187725067139) | > loss_feat: 2.2021899223327637 (2.2021899223327637) | > loss_mel: 17.79558753967285 (17.79558753967285) | > loss_duration: 3.2011420726776123 (3.2011420726776123) | > loss_1: 30.49373435974121 (30.49373435974121)  --> STEP: 1 | > loss_disc: 2.63765287399292 (2.63765287399292) | > loss_disc_real_0: 0.04949106648564339 (0.04949106648564339) | > loss_disc_real_1: 0.27519452571868896 (0.27519452571868896) | > loss_disc_real_2: 0.3309008479118347 (0.3309008479118347) | > loss_disc_real_3: 0.35462120175361633 (0.35462120175361633) | > loss_disc_real_4: 0.2701590359210968 (0.2701590359210968) | > loss_disc_real_5: 0.0752943903207779 (0.0752943903207779) | > loss_0: 2.63765287399292 (2.63765287399292) | > loss_gen: 1.9718756675720215 (1.9718756675720215) | > loss_kl: 6.010134696960449 (6.010134696960449) | > loss_feat: 7.861930847167969 (7.861930847167969) | > loss_mel: 22.128063201904297 (22.128063201904297) | > loss_duration: 3.5723719596862793 (3.5723719596862793) | > loss_1: 41.544376373291016 (41.544376373291016)  --> STEP: 2 | > loss_disc: 2.145987033843994 (2.391819953918457) | > loss_disc_real_0: 0.027326561510562897 (0.03840881399810314) | > loss_disc_real_1: 0.15709593892097473 (0.21614523231983185) | > loss_disc_real_2: 0.24407535791397095 (0.28748810291290283) | > loss_disc_real_3: 0.15790387988090515 (0.25626254081726074) | > loss_disc_real_4: 0.20441259443759918 (0.237285815179348) | > loss_disc_real_5: 0.19180519878864288 (0.1335497945547104) | > loss_0: 2.145987033843994 (2.391819953918457) | > loss_gen: 2.1643764972686768 (2.068126082420349) | > loss_kl: 5.619110107421875 (5.814622402191162) | > loss_feat: 8.341719627380371 (8.10182523727417) | > loss_mel: 23.593008041381836 (22.860535621643066) | > loss_duration: 3.29323148727417 (3.4328017234802246) | > loss_1: 43.011444091796875 (42.277910232543945)  --> STEP: 3 | > loss_disc: 2.6122987270355225 (2.465312878290812) | > loss_disc_real_0: 0.2166530340909958 (0.09782355402906735) | > loss_disc_real_1: 0.2569977641105652 (0.22976274291674295) | > loss_disc_real_2: 0.21705573797225952 (0.2640106479326884) | > loss_disc_real_3: 0.3645029067993164 (0.2923426628112793) | > loss_disc_real_4: 0.19079512357711792 (0.22178891797860464) | > loss_disc_real_5: 0.3078230619430542 (0.19164088368415833) | > loss_0: 2.6122987270355225 (2.465312878290812) | > loss_gen: 2.3592000007629395 (2.1651507218678794) | > loss_kl: 2.8419301509857178 (4.823724985122681) | > loss_feat: 5.399716377258301 (7.201122283935547) | > loss_mel: 25.862789154052734 (23.861286799112957) | > loss_duration: 3.0962564945220947 (3.320619980494181) | > loss_1: 39.55989074707031 (41.37190373738607) --> EVAL PERFORMANCE | > avg_loader_time: 0.015518506368001303 (+0.003917217254638672) | > avg_loss_disc: 2.465312878290812 (-0.6806743939717612) | > avg_loss_disc_real_0: 0.09782355402906735 (-0.33083947127064073) | > avg_loss_disc_real_1: 0.22976274291674295 (-0.04947209854920706) | > avg_loss_disc_real_2: 0.2640106479326884 (-0.05018584926923114) | > avg_loss_disc_real_3: 0.2923426628112793 (+0.036080737908681215) | > avg_loss_disc_real_4: 0.22178891797860464 (-0.043819988767306) | > avg_loss_disc_real_5: 0.19164088368415833 (-0.12991843620936078) | > avg_loss_0: 2.465312878290812 (-0.6806743939717612) | > avg_loss_gen: 2.1651507218678794 (+0.20651491483052586) | > avg_loss_kl: 4.823724985122681 (+0.16462930043538382) | > avg_loss_feat: 7.201122283935547 (+3.542342940966288) | > avg_loss_mel: 23.861286799112957 (+0.7196095784505232) | > avg_loss_duration: 3.320619980494181 (+0.03442176183064749) | > avg_loss_1: 41.37190373738607 (+4.667517979939781)  > EPOCH: 1166/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:46:02)   --> TIME: 2023-10-20 14:46:27 -- STEP: 29/50 -- GLOBAL_STEP: 111330 | > loss_disc: 2.5736169815063477 (2.36498662315566) | > loss_disc_real_0: 0.14280760288238525 (0.1403197728354356) | > loss_disc_real_1: 0.23979094624519348 (0.21495627997250394) | > loss_disc_real_2: 0.21378204226493835 (0.2475684313424703) | > loss_disc_real_3: 0.21764206886291504 (0.2291584679664209) | > loss_disc_real_4: 0.2033906877040863 (0.22078727808748855) | > loss_disc_real_5: 0.17309659719467163 (0.22131482675543118) | > loss_0: 2.5736169815063477 (2.36498662315566) | > grad_norm_0: tensor(468.8201, device='cuda:0') (tensor(579.5591, device='cuda:0')) | > loss_gen: 1.8673739433288574 (2.3847333850531744) | > loss_kl: 0.5663471817970276 (0.7828343474659426) | > loss_feat: 2.38844895362854 (6.115745427151179) | > loss_mel: 18.23523712158203 (21.049918240514295) | > loss_duration: 1.2957974672317505 (1.3206118961860394) | > loss_1: 24.35320472717285 (31.653843452190515) | > grad_norm_1: tensor(4611.7549, device='cuda:0') (tensor(18889.3145, device='cuda:0')) | > current_lr_0: 6.231763711417176e-05 | > current_lr_1: 6.237998981956754e-05 | > step_time: 0.3937 (0.6171433843415359) | > loader_time: 0.025 (0.025126046147839778)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8338472843170166 (2.8338472843170166) | > loss_disc_real_0: 0.13923074305057526 (0.13923074305057526) | > loss_disc_real_1: 0.24712638556957245 (0.24712638556957245) | > loss_disc_real_2: 0.30551421642303467 (0.30551421642303467) | > loss_disc_real_3: 0.25939300656318665 (0.25939300656318665) | > loss_disc_real_4: 0.2410828024148941 (0.2410828024148941) | > loss_disc_real_5: 0.25799697637557983 (0.25799697637557983) | > loss_0: 2.8338472843170166 (2.8338472843170166) | > loss_gen: 1.6390419006347656 (1.6390419006347656) | > loss_kl: 5.689345359802246 (5.689345359802246) | > loss_feat: 0.6370534300804138 (0.6370534300804138) | > loss_mel: 18.52189064025879 (18.52189064025879) | > loss_duration: 3.070146083831787 (3.070146083831787) | > loss_1: 29.557477951049805 (29.557477951049805)  --> STEP: 1 | > loss_disc: 3.436354637145996 (3.436354637145996) | > loss_disc_real_0: 0.4119982123374939 (0.4119982123374939) | > loss_disc_real_1: 0.43061432242393494 (0.43061432242393494) | > loss_disc_real_2: 0.4060301184654236 (0.4060301184654236) | > loss_disc_real_3: 0.3188263177871704 (0.3188263177871704) | > loss_disc_real_4: 0.4755910634994507 (0.4755910634994507) | > loss_disc_real_5: 0.4970022439956665 (0.4970022439956665) | > loss_0: 3.436354637145996 (3.436354637145996) | > loss_gen: 2.6599221229553223 (2.6599221229553223) | > loss_kl: 5.273648738861084 (5.273648738861084) | > loss_feat: 8.123603820800781 (8.123603820800781) | > loss_mel: 26.323551177978516 (26.323551177978516) | > loss_duration: 3.411421537399292 (3.411421537399292) | > loss_1: 45.79214859008789 (45.79214859008789)  --> STEP: 2 | > loss_disc: 2.264277458190918 (2.850316047668457) | > loss_disc_real_0: 0.18669742345809937 (0.29934781789779663) | > loss_disc_real_1: 0.17334149777889252 (0.3019779101014137) | > loss_disc_real_2: 0.2037028968334198 (0.3048665076494217) | > loss_disc_real_3: 0.16181053221225739 (0.2403184249997139) | > loss_disc_real_4: 0.14706656336784363 (0.31132881343364716) | > loss_disc_real_5: 0.0632021427154541 (0.2801021933555603) | > loss_0: 2.264277458190918 (2.850316047668457) | > loss_gen: 2.267719030380249 (2.4638205766677856) | > loss_kl: 6.122169494628906 (5.697909116744995) | > loss_feat: 11.71550178527832 (9.91955280303955) | > loss_mel: 31.9516544342041 (29.13760280609131) | > loss_duration: 3.3031563758850098 (3.357288956642151) | > loss_1: 55.36020278930664 (50.576175689697266)  --> STEP: 3 | > loss_disc: 2.860961437225342 (2.8538645108540854) | > loss_disc_real_0: 0.21408799290657043 (0.27092787623405457) | > loss_disc_real_1: 0.30959460139274597 (0.3045168071985245) | > loss_disc_real_2: 0.3687008321285248 (0.32614461580912274) | > loss_disc_real_3: 0.3431178331375122 (0.27458489437898) | > loss_disc_real_4: 0.26045504212379456 (0.2943708896636963) | > loss_disc_real_5: 0.3959326148033142 (0.31871233383814496) | > loss_0: 2.860961437225342 (2.8538645108540854) | > loss_gen: 2.4324302673339844 (2.453357140223185) | > loss_kl: 2.8226921558380127 (4.739503463109334) | > loss_feat: 3.6826529502868652 (7.840586185455322) | > loss_mel: 21.900516510009766 (26.72524070739746) | > loss_duration: 3.047717571258545 (3.2540984948476157) | > loss_1: 33.886009216308594 (45.012786865234375) --> EVAL PERFORMANCE | > avg_loader_time: 0.0050381819407145185 (-0.010480324427286785) | > avg_loss_disc: 2.8538645108540854 (+0.3885516325632734) | > avg_loss_disc_real_0: 0.27092787623405457 (+0.17310432220498723) | > avg_loss_disc_real_1: 0.3045168071985245 (+0.07475406428178152) | > avg_loss_disc_real_2: 0.32614461580912274 (+0.062133967876434326) | > avg_loss_disc_real_3: 0.27458489437898 (-0.017757768432299315) | > avg_loss_disc_real_4: 0.2943708896636963 (+0.07258197168509165) | > avg_loss_disc_real_5: 0.31871233383814496 (+0.12707145015398663) | > avg_loss_0: 2.8538645108540854 (+0.3885516325632734) | > avg_loss_gen: 2.453357140223185 (+0.2882064183553057) | > avg_loss_kl: 4.739503463109334 (-0.08422152201334665) | > avg_loss_feat: 7.840586185455322 (+0.6394639015197754) | > avg_loss_mel: 26.72524070739746 (+2.863953908284504) | > avg_loss_duration: 3.2540984948476157 (-0.06652148564656546) | > avg_loss_1: 45.012786865234375 (+3.640883127848305)  > EPOCH: 1167/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:46:57)   --> TIME: 2023-10-20 14:47:10 -- STEP: 9/50 -- GLOBAL_STEP: 111360 | > loss_disc: 2.1524760723114014 (1.9216827948888142) | > loss_disc_real_0: 0.0378529317677021 (0.096955182030797) | > loss_disc_real_1: 0.2799001634120941 (0.20402757657898796) | > loss_disc_real_2: 0.29819419980049133 (0.1995411001973682) | > loss_disc_real_3: 0.2981725335121155 (0.1645786634956797) | > loss_disc_real_4: 0.23485799133777618 (0.14347829141964516) | > loss_disc_real_5: 0.1710018813610077 (0.14956173435267475) | > loss_0: 2.1524760723114014 (1.9216827948888142) | > grad_norm_0: tensor(518.0410, device='cuda:0') (tensor(441.2234, device='cuda:0')) | > loss_gen: 2.7554702758789062 (2.842771848042806) | > loss_kl: 0.7942659258842468 (0.8811758955319723) | > loss_feat: 5.566108703613281 (9.985145939721) | > loss_mel: 22.085956573486328 (23.55822605556912) | > loss_duration: 1.3006459474563599 (1.3132101827197604) | > loss_1: 32.50244903564453 (38.58053101433648) | > grad_norm_1: tensor(7393.8521, device='cuda:0') (tensor(36491.3008, device='cuda:0')) | > current_lr_0: 6.225534673420887e-05 | > current_lr_1: 6.231763711417176e-05 | > step_time: 0.4606 (0.7196474605136447) | > loader_time: 0.008 (0.014356772104899088)  --> TIME: 2023-10-20 14:47:28 -- STEP: 39/50 -- GLOBAL_STEP: 111390 | > loss_disc: 2.773013114929199 (2.3825889734121475) | > loss_disc_real_0: 0.09781311452388763 (0.11929443235007617) | > loss_disc_real_1: 0.2931954264640808 (0.2211183013442235) | > loss_disc_real_2: 0.24470053613185883 (0.23486940409892645) | > loss_disc_real_3: 0.4457722306251526 (0.2310550184442829) | > loss_disc_real_4: 0.4342026710510254 (0.23571818887900847) | > loss_disc_real_5: 0.36556458473205566 (0.22858394742107543) | > loss_0: 2.773013114929199 (2.3825889734121475) | > grad_norm_0: tensor(536.2208, device='cuda:0') (tensor(669.2070, device='cuda:0')) | > loss_gen: 2.548912763595581 (2.4775466674413433) | > loss_kl: 0.6696948409080505 (0.7760972793285664) | > loss_feat: 3.8251888751983643 (6.59862710420902) | > loss_mel: 21.610200881958008 (21.53004986200577) | > loss_duration: 1.377366304397583 (1.3163892733745086) | > loss_1: 30.031362533569336 (32.69871044158937) | > grad_norm_1: tensor(12542.4922, device='cuda:0') (tensor(21406.0898, device='cuda:0')) | > current_lr_0: 6.225534673420887e-05 | > current_lr_1: 6.231763711417176e-05 | > step_time: 0.3345 (0.6273407569298377) | > loader_time: 0.0039 (0.020244531142405976)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.860106945037842 (2.860106945037842) | > loss_disc_real_0: 0.2308448702096939 (0.2308448702096939) | > loss_disc_real_1: 0.27196455001831055 (0.27196455001831055) | > loss_disc_real_2: 0.26349714398384094 (0.26349714398384094) | > loss_disc_real_3: 0.23234817385673523 (0.23234817385673523) | > loss_disc_real_4: 0.26773595809936523 (0.26773595809936523) | > loss_disc_real_5: 0.2570772171020508 (0.2570772171020508) | > loss_0: 2.860106945037842 (2.860106945037842) | > loss_gen: 1.693448543548584 (1.693448543548584) | > loss_kl: 5.6037211418151855 (5.6037211418151855) | > loss_feat: 0.8301705718040466 (0.8301705718040466) | > loss_mel: 15.921612739562988 (15.921612739562988) | > loss_duration: 3.2133595943450928 (3.2133595943450928) | > loss_1: 27.262313842773438 (27.262313842773438)  --> STEP: 1 | > loss_disc: 3.0747246742248535 (3.0747246742248535) | > loss_disc_real_0: 0.19759699702262878 (0.19759699702262878) | > loss_disc_real_1: 0.2769315242767334 (0.2769315242767334) | > loss_disc_real_2: 0.18003109097480774 (0.18003109097480774) | > loss_disc_real_3: 0.32007431983947754 (0.32007431983947754) | > loss_disc_real_4: 0.31485745310783386 (0.31485745310783386) | > loss_disc_real_5: 0.35718709230422974 (0.35718709230422974) | > loss_0: 3.0747246742248535 (3.0747246742248535) | > loss_gen: 1.7796214818954468 (1.7796214818954468) | > loss_kl: 5.131717205047607 (5.131717205047607) | > loss_feat: 4.414371013641357 (4.414371013641357) | > loss_mel: 24.112255096435547 (24.112255096435547) | > loss_duration: 3.5444304943084717 (3.5444304943084717) | > loss_1: 38.98239517211914 (38.98239517211914)  --> STEP: 2 | > loss_disc: 2.9124035835266113 (2.9935641288757324) | > loss_disc_real_0: 0.19470186531543732 (0.19614943116903305) | > loss_disc_real_1: 0.25478678941726685 (0.2658591568470001) | > loss_disc_real_2: 0.26032477617263794 (0.22017793357372284) | > loss_disc_real_3: 0.2524780333042145 (0.286276176571846) | > loss_disc_real_4: 0.2621147930622101 (0.288486123085022) | > loss_disc_real_5: 0.2634427547454834 (0.31031492352485657) | > loss_0: 2.9124035835266113 (2.9935641288757324) | > loss_gen: 1.5826393365859985 (1.6811304092407227) | > loss_kl: 5.926823139190674 (5.529270172119141) | > loss_feat: 0.2252921611070633 (2.3198315873742104) | > loss_mel: 10.50214958190918 (17.307202339172363) | > loss_duration: 3.2789463996887207 (3.411688446998596) | > loss_1: 21.515850067138672 (30.249122619628906)  --> STEP: 3 | > loss_disc: 2.1165764331817627 (2.7012348969777427) | > loss_disc_real_0: 0.08082947880029678 (0.15770944704612097) | > loss_disc_real_1: 0.18878433108329773 (0.24016754825909933) | > loss_disc_real_2: 0.3165273666381836 (0.2522944112618764) | > loss_disc_real_3: 0.2184230536222458 (0.26365846892197925) | > loss_disc_real_4: 0.19192221760749817 (0.25629815459251404) | > loss_disc_real_5: 0.11857051402330399 (0.24640012035767236) | > loss_0: 2.1165764331817627 (2.7012348969777427) | > loss_gen: 2.295990228652954 (1.886083682378133) | > loss_kl: 3.0140328407287598 (4.690857728322347) | > loss_feat: 4.965224266052246 (3.2016291469335556) | > loss_mel: 21.48113441467285 (18.69851303100586) | > loss_duration: 3.1405842304229736 (3.321320374806722) | > loss_1: 34.89696502685547 (31.79840342203776) --> EVAL PERFORMANCE | > avg_loader_time: 0.013898928960164389 (+0.008860747019449871) | > avg_loss_disc: 2.7012348969777427 (-0.15262961387634277) | > avg_loss_disc_real_0: 0.15770944704612097 (-0.1132184291879336) | > avg_loss_disc_real_1: 0.24016754825909933 (-0.06434925893942514) | > avg_loss_disc_real_2: 0.2522944112618764 (-0.07385020454724633) | > avg_loss_disc_real_3: 0.26365846892197925 (-0.010926425457000732) | > avg_loss_disc_real_4: 0.25629815459251404 (-0.03807273507118225) | > avg_loss_disc_real_5: 0.24640012035767236 (-0.07231221348047259) | > avg_loss_0: 2.7012348969777427 (-0.15262961387634277) | > avg_loss_gen: 1.886083682378133 (-0.567273457845052) | > avg_loss_kl: 4.690857728322347 (-0.048645734786987305) | > avg_loss_feat: 3.2016291469335556 (-4.638957038521767) | > avg_loss_mel: 18.69851303100586 (-8.026727676391602) | > avg_loss_duration: 3.321320374806722 (+0.06722187995910645) | > avg_loss_1: 31.79840342203776 (-13.214383443196613)  > EPOCH: 1168/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:47:48)   --> TIME: 2023-10-20 14:48:06 -- STEP: 19/50 -- GLOBAL_STEP: 111420 | > loss_disc: 2.3980417251586914 (2.515356503034893) | > loss_disc_real_0: 0.36726614832878113 (0.17600813145308117) | > loss_disc_real_1: 0.2055356204509735 (0.2172360820205588) | > loss_disc_real_2: 0.2559112310409546 (0.22528112640506343) | > loss_disc_real_3: 0.2708952724933624 (0.24187564653785606) | > loss_disc_real_4: 0.21157826483249664 (0.22821522739372754) | > loss_disc_real_5: 0.11201616376638412 (0.23002971630347402) | > loss_0: 2.3980417251586914 (2.515356503034893) | > grad_norm_0: tensor(697.0978, device='cuda:0') (tensor(411.2285, device='cuda:0')) | > loss_gen: 2.371689558029175 (2.186101041342083) | > loss_kl: 0.8884546756744385 (0.7856321893632412) | > loss_feat: 4.805501937866211 (4.820409104669173) | > loss_mel: 20.83700942993164 (16.420804579006997) | > loss_duration: 1.339072823524475 (1.3412134521885921) | > loss_1: 30.241727828979492 (25.55416036906995) | > grad_norm_1: tensor(16267.3721, device='cuda:0') (tensor(43320.3867, device='cuda:0')) | > current_lr_0: 6.219311861738072e-05 | > current_lr_1: 6.225534673420887e-05 | > step_time: 0.7908 (0.6461327954342491) | > loader_time: 0.0059 (0.021803165736951326)  --> TIME: 2023-10-20 14:48:18 -- STEP: 49/50 -- GLOBAL_STEP: 111450 | > loss_disc: 3.0021896362304688 (2.4292634093031586) | > loss_disc_real_0: 0.3133160471916199 (0.15714016043562065) | > loss_disc_real_1: 0.2541819214820862 (0.21103328036866625) | > loss_disc_real_2: 0.2506961226463318 (0.21942938674165277) | > loss_disc_real_3: 0.26527824997901917 (0.21794155848269559) | > loss_disc_real_4: 0.25124800205230713 (0.22553269846402868) | > loss_disc_real_5: 0.27072978019714355 (0.21523618591683252) | > loss_0: 3.0021896362304688 (2.4292634093031586) | > grad_norm_0: tensor(672.8096, device='cuda:0') (tensor(565.1285, device='cuda:0')) | > loss_gen: 1.5655690431594849 (2.2270983700849576) | > loss_kl: 0.9319860935211182 (0.7399457818543425) | > loss_feat: 0.021312063559889793 (5.556760838122242) | > loss_mel: 1.2202389240264893 (18.698100679991196) | > loss_duration: 1.4490786790847778 (1.3193109035491941) | > loss_1: 5.18818473815918 (28.54121649995142) | > grad_norm_1: tensor(20252.3477, device='cuda:0') (tensor(26540.6738, device='cuda:0')) | > current_lr_0: 6.219311861738072e-05 | > current_lr_1: 6.225534673420887e-05 | > step_time: 0.3434 (0.4889352808193287) | > loader_time: 0.373 (0.01949092806602011)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.775120735168457 (2.775120735168457) | > loss_disc_real_0: 0.08241435885429382 (0.08241435885429382) | > loss_disc_real_1: 0.4280966818332672 (0.4280966818332672) | > loss_disc_real_2: 0.41287344694137573 (0.41287344694137573) | > loss_disc_real_3: 0.29340964555740356 (0.29340964555740356) | > loss_disc_real_4: 0.16690608859062195 (0.16690608859062195) | > loss_disc_real_5: 0.38623759150505066 (0.38623759150505066) | > loss_0: 2.775120735168457 (2.775120735168457) | > loss_gen: 2.8182809352874756 (2.8182809352874756) | > loss_kl: 5.840657711029053 (5.840657711029053) | > loss_feat: 9.116853713989258 (9.116853713989258) | > loss_mel: 23.735557556152344 (23.735557556152344) | > loss_duration: 3.2485203742980957 (3.2485203742980957) | > loss_1: 44.75986862182617 (44.75986862182617)  --> STEP: 1 | > loss_disc: 2.6684412956237793 (2.6684412956237793) | > loss_disc_real_0: 0.19578048586845398 (0.19578048586845398) | > loss_disc_real_1: 0.3297671973705292 (0.3297671973705292) | > loss_disc_real_2: 0.17109008133411407 (0.17109008133411407) | > loss_disc_real_3: 0.19476693868637085 (0.19476693868637085) | > loss_disc_real_4: 0.24941378831863403 (0.24941378831863403) | > loss_disc_real_5: 0.26488766074180603 (0.26488766074180603) | > loss_0: 2.6684412956237793 (2.6684412956237793) | > loss_gen: 1.9687163829803467 (1.9687163829803467) | > loss_kl: 6.0085954666137695 (6.0085954666137695) | > loss_feat: 4.2573561668396 (4.2573561668396) | > loss_mel: 22.670473098754883 (22.670473098754883) | > loss_duration: 3.5446884632110596 (3.5446884632110596) | > loss_1: 38.4498291015625 (38.4498291015625)  --> STEP: 2 | > loss_disc: 3.047116756439209 (2.857779026031494) | > loss_disc_real_0: 0.391968309879303 (0.2938743978738785) | > loss_disc_real_1: 0.2610609531402588 (0.295414075255394) | > loss_disc_real_2: 0.25700193643569946 (0.21404600888490677) | > loss_disc_real_3: 0.28392839431762695 (0.2393476665019989) | > loss_disc_real_4: 0.2536739706993103 (0.25154387950897217) | > loss_disc_real_5: 0.2711126506328583 (0.26800015568733215) | > loss_0: 3.047116756439209 (2.857779026031494) | > loss_gen: 1.697422981262207 (1.8330696821212769) | > loss_kl: 6.315861701965332 (6.162228584289551) | > loss_feat: 0.37847861647605896 (2.3179173916578293) | > loss_mel: 20.689590454101562 (21.680031776428223) | > loss_duration: 3.223160982131958 (3.383924722671509) | > loss_1: 32.30451202392578 (35.37717056274414)  --> STEP: 3 | > loss_disc: 2.0753366947174072 (2.5969649155934653) | > loss_disc_real_0: 0.16955727338790894 (0.2524353563785553) | > loss_disc_real_1: 0.2524862289428711 (0.28110479315121967) | > loss_disc_real_2: 0.23386873304843903 (0.2206535836060842) | > loss_disc_real_3: 0.24590478837490082 (0.24153337379296622) | > loss_disc_real_4: 0.126324862241745 (0.2098042070865631) | > loss_disc_real_5: 0.0924314484000206 (0.2094772532582283) | > loss_0: 2.0753366947174072 (2.5969649155934653) | > loss_gen: 3.0188162326812744 (2.228318532307943) | > loss_kl: 2.537416458129883 (4.953957875569661) | > loss_feat: 7.39890193939209 (4.011578907569249) | > loss_mel: 23.181556701660156 (22.180540084838867) | > loss_duration: 3.071861982345581 (3.2799038092295327) | > loss_1: 39.208553314208984 (36.65429814656576) --> EVAL PERFORMANCE | > avg_loader_time: 0.019695123036702473 (+0.005796194076538084) | > avg_loss_disc: 2.5969649155934653 (-0.10426998138427734) | > avg_loss_disc_real_0: 0.2524353563785553 (+0.09472590933243433) | > avg_loss_disc_real_1: 0.28110479315121967 (+0.040937244892120334) | > avg_loss_disc_real_2: 0.2206535836060842 (-0.03164082765579221) | > avg_loss_disc_real_3: 0.24153337379296622 (-0.022125095129013034) | > avg_loss_disc_real_4: 0.2098042070865631 (-0.04649394750595093) | > avg_loss_disc_real_5: 0.2094772532582283 (-0.03692286709944406) | > avg_loss_0: 2.5969649155934653 (-0.10426998138427734) | > avg_loss_gen: 2.228318532307943 (+0.3422348499298098) | > avg_loss_kl: 4.953957875569661 (+0.26310014724731445) | > avg_loss_feat: 4.011578907569249 (+0.8099497606356936) | > avg_loss_mel: 22.180540084838867 (+3.482027053833008) | > avg_loss_duration: 3.2799038092295327 (-0.041416565577189424) | > avg_loss_1: 36.65429814656576 (+4.855894724527996)  > EPOCH: 1169/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:48:34)   --> TIME: 2023-10-20 14:49:01 -- STEP: 29/50 -- GLOBAL_STEP: 111480 | > loss_disc: 1.7167677879333496 (2.3186804138380905) | > loss_disc_real_0: 0.032142676413059235 (0.14167530269458375) | > loss_disc_real_1: 0.1418030858039856 (0.2132696148393483) | > loss_disc_real_2: 0.14497794210910797 (0.2262482555775807) | > loss_disc_real_3: 0.20482167601585388 (0.25460868193928526) | > loss_disc_real_4: 0.14246632158756256 (0.19285274296998978) | > loss_disc_real_5: 0.22012966871261597 (0.2165906510861783) | > loss_0: 1.7167677879333496 (2.3186804138380905) | > grad_norm_0: tensor(428.0477, device='cuda:0') (tensor(518.3218, device='cuda:0')) | > loss_gen: 2.8306920528411865 (2.476666495717805) | > loss_kl: 0.8452411890029907 (0.85303402358088) | > loss_feat: 8.381492614746094 (6.42233608072174) | > loss_mel: 22.654592514038086 (21.207156526631323) | > loss_duration: 1.3293678760528564 (1.3306889533996582) | > loss_1: 36.041385650634766 (32.28988147604054) | > grad_norm_1: tensor(19550.3535, device='cuda:0') (tensor(18140.2891, device='cuda:0')) | > current_lr_0: 6.213095270145138e-05 | > current_lr_1: 6.219311861738072e-05 | > step_time: 0.5006 (0.6384781393511542) | > loader_time: 0.0066 (0.02091627285398286)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8972301483154297 (2.8972301483154297) | > loss_disc_real_0: 0.30767080187797546 (0.30767080187797546) | > loss_disc_real_1: 0.24733193218708038 (0.24733193218708038) | > loss_disc_real_2: 0.3047013282775879 (0.3047013282775879) | > loss_disc_real_3: 0.30769696831703186 (0.30769696831703186) | > loss_disc_real_4: 0.42606696486473083 (0.42606696486473083) | > loss_disc_real_5: 0.28073522448539734 (0.28073522448539734) | > loss_0: 2.8972301483154297 (2.8972301483154297) | > loss_gen: 2.574556827545166 (2.574556827545166) | > loss_kl: 6.156440734863281 (6.156440734863281) | > loss_feat: 8.407320022583008 (8.407320022583008) | > loss_mel: 21.93501853942871 (21.93501853942871) | > loss_duration: 3.134347915649414 (3.134347915649414) | > loss_1: 42.20768737792969 (42.20768737792969)  --> STEP: 1 | > loss_disc: 2.943746566772461 (2.943746566772461) | > loss_disc_real_0: 0.3637145459651947 (0.3637145459651947) | > loss_disc_real_1: 0.29079726338386536 (0.29079726338386536) | > loss_disc_real_2: 0.26993119716644287 (0.26993119716644287) | > loss_disc_real_3: 0.41813796758651733 (0.41813796758651733) | > loss_disc_real_4: 0.2644052803516388 (0.2644052803516388) | > loss_disc_real_5: 0.3456001281738281 (0.3456001281738281) | > loss_0: 2.943746566772461 (2.943746566772461) | > loss_gen: 2.421508550643921 (2.421508550643921) | > loss_kl: 5.6317949295043945 (5.6317949295043945) | > loss_feat: 5.905993938446045 (5.905993938446045) | > loss_mel: 24.30230712890625 (24.30230712890625) | > loss_duration: 3.476148843765259 (3.476148843765259) | > loss_1: 41.737754821777344 (41.737754821777344)  --> STEP: 2 | > loss_disc: 2.1280617713928223 (2.5359041690826416) | > loss_disc_real_0: 0.13193482160568237 (0.24782468378543854) | > loss_disc_real_1: 0.1391836255788803 (0.21499044448137283) | > loss_disc_real_2: 0.10385648161172867 (0.18689383938908577) | > loss_disc_real_3: 0.154160737991333 (0.28614935278892517) | > loss_disc_real_4: 0.19070860743522644 (0.22755694389343262) | > loss_disc_real_5: 0.26171448826789856 (0.30365730822086334) | > loss_0: 2.1280617713928223 (2.5359041690826416) | > loss_gen: 2.2094173431396484 (2.3154629468917847) | > loss_kl: 6.254882335662842 (5.943338632583618) | > loss_feat: 8.415793418884277 (7.160893678665161) | > loss_mel: 23.868385314941406 (24.085346221923828) | > loss_duration: 3.2935972213745117 (3.3848730325698853) | > loss_1: 44.04207992553711 (42.88991737365723)  --> STEP: 3 | > loss_disc: 3.0240838527679443 (2.6986307303110757) | > loss_disc_real_0: 0.3510866165161133 (0.28224532802899677) | > loss_disc_real_1: 0.25548267364501953 (0.2284878542025884) | > loss_disc_real_2: 0.2631874084472656 (0.21232502907514572) | > loss_disc_real_3: 0.2604154646396637 (0.2775713900725047) | > loss_disc_real_4: 0.2653188705444336 (0.2401442527770996) | > loss_disc_real_5: 0.25554731488227844 (0.2876206437746684) | > loss_0: 3.0240838527679443 (2.6986307303110757) | > loss_gen: 1.6472615003585815 (2.092729131380717) | > loss_kl: 2.5750954151153564 (4.820590893427531) | > loss_feat: 0.03360389173030853 (4.785130416353543) | > loss_mel: 1.6911786794662476 (16.6206237077713) | > loss_duration: 3.0608129501342773 (3.276853005091349) | > loss_1: 9.007952690124512 (31.59592914581299) --> EVAL PERFORMANCE | > avg_loader_time: 0.010709285736083984 (-0.008985837300618488) | > avg_loss_disc: 2.6986307303110757 (+0.10166581471761038) | > avg_loss_disc_real_0: 0.28224532802899677 (+0.02980997165044147) | > avg_loss_disc_real_1: 0.2284878542025884 (-0.05261693894863126) | > avg_loss_disc_real_2: 0.21232502907514572 (-0.008328554530938476) | > avg_loss_disc_real_3: 0.2775713900725047 (+0.03603801627953848) | > avg_loss_disc_real_4: 0.2401442527770996 (+0.0303400456905365) | > avg_loss_disc_real_5: 0.2876206437746684 (+0.07814339051644009) | > avg_loss_0: 2.6986307303110757 (+0.10166581471761038) | > avg_loss_gen: 2.092729131380717 (-0.13558940092722604) | > avg_loss_kl: 4.820590893427531 (-0.13336698214212994) | > avg_loss_feat: 4.785130416353543 (+0.7735515087842941) | > avg_loss_mel: 16.6206237077713 (-5.559916377067566) | > avg_loss_duration: 3.276853005091349 (-0.0030508041381835938) | > avg_loss_1: 31.59592914581299 (-5.058369000752769)  > EPOCH: 1170/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:49:28)   --> TIME: 2023-10-20 14:49:40 -- STEP: 9/50 -- GLOBAL_STEP: 111510 | > loss_disc: 2.343017816543579 (2.4077818393707275) | > loss_disc_real_0: 0.08645518869161606 (0.14075943206747374) | > loss_disc_real_1: 0.23770995438098907 (0.19531711356507409) | > loss_disc_real_2: 0.13968342542648315 (0.24012837807337442) | > loss_disc_real_3: 0.38737183809280396 (0.2162979149983989) | > loss_disc_real_4: 0.2448970526456833 (0.22637277179294163) | > loss_disc_real_5: 0.26862832903862 (0.21292768232524395) | > loss_0: 2.343017816543579 (2.4077818393707275) | > grad_norm_0: tensor(403.2887, device='cuda:0') (tensor(446.2565, device='cuda:0')) | > loss_gen: 2.3753180503845215 (2.320242510901557) | > loss_kl: 0.7953974604606628 (0.8602558639314439) | > loss_feat: 4.733138084411621 (6.860206336300406) | > loss_mel: 23.20146942138672 (20.174497385819752) | > loss_duration: 1.268835186958313 (1.2810524503389995) | > loss_1: 32.37416076660156 (31.4962551328871) | > grad_norm_1: tensor(9001.9482, device='cuda:0') (tensor(18730.9980, device='cuda:0')) | > current_lr_0: 6.206884892424721e-05 | > current_lr_1: 6.213095270145138e-05 | > step_time: 0.4907 (0.655320856306288) | > loader_time: 0.0258 (0.03211201561821832)  --> TIME: 2023-10-20 14:49:54 -- STEP: 39/50 -- GLOBAL_STEP: 111540 | > loss_disc: 2.187741279602051 (2.3766143474823394) | > loss_disc_real_0: 0.09887215495109558 (0.1322841603690997) | > loss_disc_real_1: 0.24490581452846527 (0.20962601460707495) | > loss_disc_real_2: 0.19169747829437256 (0.23347814285602325) | > loss_disc_real_3: 0.17127978801727295 (0.24120353814214468) | > loss_disc_real_4: 0.11265590786933899 (0.2225291544619279) | > loss_disc_real_5: 0.11145377159118652 (0.2362048884328359) | > loss_0: 2.187741279602051 (2.3766143474823394) | > grad_norm_0: tensor(1242.2825, device='cuda:0') (tensor(576.0806, device='cuda:0')) | > loss_gen: 1.9773614406585693 (2.444354378260099) | > loss_kl: 0.4078122079372406 (0.8620701730251312) | > loss_feat: 4.495436191558838 (6.4963440689473195) | > loss_mel: 15.6721830368042 (21.329190368835743) | > loss_duration: 1.4220653772354126 (1.312224111495874) | > loss_1: 23.9748592376709 (32.44418315398388) | > grad_norm_1: tensor(13955.2852, device='cuda:0') (tensor(22493.5156, device='cuda:0')) | > current_lr_0: 6.206884892424721e-05 | > current_lr_1: 6.213095270145138e-05 | > step_time: 0.2799 (0.4976098170647256) | > loader_time: 0.0153 (0.01549374751555614)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2739415168762207 (2.2739415168762207) | > loss_disc_real_0: 0.1822560727596283 (0.1822560727596283) | > loss_disc_real_1: 0.10062813013792038 (0.10062813013792038) | > loss_disc_real_2: 0.10601135343313217 (0.10601135343313217) | > loss_disc_real_3: 0.16652865707874298 (0.16652865707874298) | > loss_disc_real_4: 0.13232900202274323 (0.13232900202274323) | > loss_disc_real_5: 0.040239185094833374 (0.040239185094833374) | > loss_0: 2.2739415168762207 (2.2739415168762207) | > loss_gen: 1.9215517044067383 (1.9215517044067383) | > loss_kl: 5.653209209442139 (5.653209209442139) | > loss_feat: 10.27568531036377 (10.27568531036377) | > loss_mel: 27.475431442260742 (27.475431442260742) | > loss_duration: 3.192638397216797 (3.192638397216797) | > loss_1: 48.518516540527344 (48.518516540527344)  --> STEP: 1 | > loss_disc: 3.1180012226104736 (3.1180012226104736) | > loss_disc_real_0: 0.2587345838546753 (0.2587345838546753) | > loss_disc_real_1: 0.25607627630233765 (0.25607627630233765) | > loss_disc_real_2: 0.2737363278865814 (0.2737363278865814) | > loss_disc_real_3: 0.27741101384162903 (0.27741101384162903) | > loss_disc_real_4: 0.2814887464046478 (0.2814887464046478) | > loss_disc_real_5: 0.24163271486759186 (0.24163271486759186) | > loss_0: 3.1180012226104736 (3.1180012226104736) | > loss_gen: 1.5110082626342773 (1.5110082626342773) | > loss_kl: 5.743356704711914 (5.743356704711914) | > loss_feat: 0.7876145839691162 (0.7876145839691162) | > loss_mel: 7.135085582733154 (7.135085582733154) | > loss_duration: 3.3741211891174316 (3.3741211891174316) | > loss_1: 18.55118751525879 (18.55118751525879)  --> STEP: 2 | > loss_disc: 3.042710304260254 (3.0803557634353638) | > loss_disc_real_0: 0.3211001753807068 (0.28991737961769104) | > loss_disc_real_1: 0.1478535234928131 (0.20196489989757538) | > loss_disc_real_2: 0.2411775439977646 (0.257456935942173) | > loss_disc_real_3: 0.3615162670612335 (0.3194636404514313) | > loss_disc_real_4: 0.3176068365573883 (0.29954779148101807) | > loss_disc_real_5: 0.2739810049533844 (0.25780685991048813) | > loss_0: 3.042710304260254 (3.0803557634353638) | > loss_gen: 2.0162949562072754 (1.7636516094207764) | > loss_kl: 6.267394542694092 (6.005375623703003) | > loss_feat: 8.374387741088867 (4.581001162528992) | > loss_mel: 22.25298309326172 (14.694034337997437) | > loss_duration: 3.3524489402770996 (3.3632850646972656) | > loss_1: 42.263511657714844 (30.407349586486816)  --> STEP: 3 | > loss_disc: 2.8914506435394287 (3.0173873901367188) | > loss_disc_real_0: 0.09667569398880005 (0.2255034844080607) | > loss_disc_real_1: 0.42680075764656067 (0.2769101858139038) | > loss_disc_real_2: 0.2813079357147217 (0.2654072691996892) | > loss_disc_real_3: 0.36293792724609375 (0.3339550693829854) | > loss_disc_real_4: 0.3086046278476715 (0.3025667369365692) | > loss_disc_real_5: 0.32478591799736023 (0.2801332126061122) | > loss_0: 2.8914506435394287 (3.0173873901367188) | > loss_gen: 2.0885391235351562 (1.871947447458903) | > loss_kl: 3.0400567054748535 (5.01693598429362) | > loss_feat: 2.931882858276367 (4.03129506111145) | > loss_mel: 18.455533981323242 (15.947867552439371) | > loss_duration: 3.0145480632781982 (3.2470393975575766) | > loss_1: 29.530559539794922 (30.11508623758952) --> EVAL PERFORMANCE | > avg_loader_time: 0.0029495557149251304 (-0.007759730021158854) | > avg_loss_disc: 3.0173873901367188 (+0.31875665982564305) | > avg_loss_disc_real_0: 0.2255034844080607 (-0.05674184362093607) | > avg_loss_disc_real_1: 0.2769101858139038 (+0.0484223316113154) | > avg_loss_disc_real_2: 0.2654072691996892 (+0.05308224012454349) | > avg_loss_disc_real_3: 0.3339550693829854 (+0.05638367931048072) | > avg_loss_disc_real_4: 0.3025667369365692 (+0.062422484159469604) | > avg_loss_disc_real_5: 0.2801332126061122 (-0.007487431168556213) | > avg_loss_0: 3.0173873901367188 (+0.31875665982564305) | > avg_loss_gen: 1.871947447458903 (-0.22078168392181374) | > avg_loss_kl: 5.01693598429362 (+0.19634509086608887) | > avg_loss_feat: 4.03129506111145 (-0.7538353552420931) | > avg_loss_mel: 15.947867552439371 (-0.6727561553319301) | > avg_loss_duration: 3.2470393975575766 (-0.02981360753377249) | > avg_loss_1: 30.11508623758952 (-1.4808429082234689)  > EPOCH: 1171/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:50:17)   --> TIME: 2023-10-20 14:50:35 -- STEP: 19/50 -- GLOBAL_STEP: 111570 | > loss_disc: 2.6379501819610596 (2.4930732250213623) | > loss_disc_real_0: 0.19676214456558228 (0.1291524562984705) | > loss_disc_real_1: 0.3204752206802368 (0.22476007867800563) | > loss_disc_real_2: 0.24000795185565948 (0.2486724555492401) | > loss_disc_real_3: 0.24078373610973358 (0.24741285392328308) | > loss_disc_real_4: 0.3182995915412903 (0.2381315776392033) | > loss_disc_real_5: 0.3947283625602722 (0.2528215866339834) | > loss_0: 2.6379501819610596 (2.4930732250213623) | > grad_norm_0: tensor(639.1125, device='cuda:0') (tensor(556.3182, device='cuda:0')) | > loss_gen: 3.159097671508789 (2.4176218760641) | > loss_kl: 0.7268767356872559 (0.8055356191961389) | > loss_feat: 8.011136054992676 (6.229491102068048) | > loss_mel: 20.370729446411133 (20.953430100491172) | > loss_duration: 1.4191533327102661 (1.3459504089857404) | > loss_1: 33.68699264526367 (31.752029067591618) | > grad_norm_1: tensor(48970.4766, device='cuda:0') (tensor(18415.6523, device='cuda:0')) | > current_lr_0: 6.200680722365663e-05 | > current_lr_1: 6.206884892424721e-05 | > step_time: 0.3264 (0.6570828839352256) | > loader_time: 0.0194 (0.0248283210553621)  --> TIME: 2023-10-20 14:50:50 -- STEP: 49/50 -- GLOBAL_STEP: 111600 | > loss_disc: 2.7452101707458496 (2.4272922034166293) | > loss_disc_real_0: 0.006568624638020992 (0.13401040185851107) | > loss_disc_real_1: 0.2409452199935913 (0.22363338566252164) | > loss_disc_real_2: 0.10565771907567978 (0.22244007368477023) | > loss_disc_real_3: 0.30293917655944824 (0.22959040432256095) | > loss_disc_real_4: 0.25763070583343506 (0.22407604360534827) | > loss_disc_real_5: 0.26529207825660706 (0.23402728084284735) | > loss_0: 2.7452101707458496 (2.4272922034166293) | > grad_norm_0: tensor(2016.4894, device='cuda:0') (tensor(620.8663, device='cuda:0')) | > loss_gen: 1.680975079536438 (2.34107079311293) | > loss_kl: 0.8409680128097534 (0.7559426563734911) | > loss_feat: 1.8460311889648438 (6.080263933965138) | > loss_mel: 22.632944107055664 (20.506781003913098) | > loss_duration: 1.4613676071166992 (1.320576979189503) | > loss_1: 28.462284088134766 (31.00463561622464) | > grad_norm_1: tensor(5665.2725, device='cuda:0') (tensor(16671.9316, device='cuda:0')) | > current_lr_0: 6.200680722365663e-05 | > current_lr_1: 6.206884892424721e-05 | > step_time: 0.3204 (0.526752656819869) | > loader_time: 0.3656 (0.023005334698424054)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.542426586151123 (2.542426586151123) | > loss_disc_real_0: 0.2754971981048584 (0.2754971981048584) | > loss_disc_real_1: 0.2302892953157425 (0.2302892953157425) | > loss_disc_real_2: 0.25287994742393494 (0.25287994742393494) | > loss_disc_real_3: 0.24815011024475098 (0.24815011024475098) | > loss_disc_real_4: 0.14332124590873718 (0.14332124590873718) | > loss_disc_real_5: 0.17443989217281342 (0.17443989217281342) | > loss_0: 2.542426586151123 (2.542426586151123) | > loss_gen: 2.104473114013672 (2.104473114013672) | > loss_kl: 5.6242265701293945 (5.6242265701293945) | > loss_feat: 5.286035537719727 (5.286035537719727) | > loss_mel: 19.07007598876953 (19.07007598876953) | > loss_duration: 3.1295528411865234 (3.1295528411865234) | > loss_1: 35.21436309814453 (35.21436309814453)  --> STEP: 1 | > loss_disc: 1.8974484205245972 (1.8974484205245972) | > loss_disc_real_0: 0.1642553210258484 (0.1642553210258484) | > loss_disc_real_1: 0.22536203265190125 (0.22536203265190125) | > loss_disc_real_2: 0.25035563111305237 (0.25035563111305237) | > loss_disc_real_3: 0.1525508463382721 (0.1525508463382721) | > loss_disc_real_4: 0.2588433027267456 (0.2588433027267456) | > loss_disc_real_5: 0.11554015427827835 (0.11554015427827835) | > loss_0: 1.8974484205245972 (1.8974484205245972) | > loss_gen: 3.312814712524414 (3.312814712524414) | > loss_kl: 5.474108695983887 (5.474108695983887) | > loss_feat: 9.688379287719727 (9.688379287719727) | > loss_mel: 21.153350830078125 (21.153350830078125) | > loss_duration: 3.5459625720977783 (3.5459625720977783) | > loss_1: 43.174617767333984 (43.174617767333984)  --> STEP: 2 | > loss_disc: 2.401519298553467 (2.149483859539032) | > loss_disc_real_0: 0.24559885263442993 (0.20492708683013916) | > loss_disc_real_1: 0.34404608607292175 (0.2847040593624115) | > loss_disc_real_2: 0.20061826705932617 (0.22548694908618927) | > loss_disc_real_3: 0.40092647075653076 (0.27673865854740143) | > loss_disc_real_4: 0.13271896541118622 (0.1957811340689659) | > loss_disc_real_5: 0.06585149466991425 (0.0906958244740963) | > loss_0: 2.401519298553467 (2.149483859539032) | > loss_gen: 2.6025214195251465 (2.9576680660247803) | > loss_kl: 5.937690734863281 (5.705899715423584) | > loss_feat: 7.202812194824219 (8.445595741271973) | > loss_mel: 24.1483211517334 (22.65083599090576) | > loss_duration: 3.3436179161071777 (3.444790244102478) | > loss_1: 43.234962463378906 (43.204790115356445)  --> STEP: 3 | > loss_disc: 2.8815860748291016 (2.3935179313023887) | > loss_disc_real_0: 0.4361878037452698 (0.28201399246851605) | > loss_disc_real_1: 0.326879620552063 (0.298762579758962) | > loss_disc_real_2: 0.3182642459869385 (0.25641271471977234) | > loss_disc_real_3: 0.3675287365913391 (0.3070020178953807) | > loss_disc_real_4: 0.339362770318985 (0.24364167948563895) | > loss_disc_real_5: 0.36573049426078796 (0.18237404773632684) | > loss_0: 2.8815860748291016 (2.3935179313023887) | > loss_gen: 3.0334930419921875 (2.982943058013916) | > loss_kl: 2.7355148792266846 (4.715771436691284) | > loss_feat: 4.601224899291992 (7.1641387939453125) | > loss_mel: 21.523452758789062 (22.275041580200195) | > loss_duration: 3.055556058883667 (3.3150455156962075) | > loss_1: 34.949241638183594 (40.45294062296549) --> EVAL PERFORMANCE | > avg_loader_time: 0.003004312515258789 (+5.475680033365871e-05) | > avg_loss_disc: 2.3935179313023887 (-0.6238694588343301) | > avg_loss_disc_real_0: 0.28201399246851605 (+0.05651050806045535) | > avg_loss_disc_real_1: 0.298762579758962 (+0.02185239394505817) | > avg_loss_disc_real_2: 0.25641271471977234 (-0.008994554479916872) | > avg_loss_disc_real_3: 0.3070020178953807 (-0.02695305148760474) | > avg_loss_disc_real_4: 0.24364167948563895 (-0.05892505745093027) | > avg_loss_disc_real_5: 0.18237404773632684 (-0.09775916486978534) | > avg_loss_0: 2.3935179313023887 (-0.6238694588343301) | > avg_loss_gen: 2.982943058013916 (+1.110995610555013) | > avg_loss_kl: 4.715771436691284 (-0.3011645476023359) | > avg_loss_feat: 7.1641387939453125 (+3.1328437328338623) | > avg_loss_mel: 22.275041580200195 (+6.327174027760824) | > avg_loss_duration: 3.3150455156962075 (+0.06800611813863089) | > avg_loss_1: 40.45294062296549 (+10.337854385375973)  > EPOCH: 1172/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:50:59)   --> TIME: 2023-10-20 14:51:31 -- STEP: 29/50 -- GLOBAL_STEP: 111630 | > loss_disc: 3.0275402069091797 (2.497785140728128) | > loss_disc_real_0: 0.6444821953773499 (0.17445075062328372) | > loss_disc_real_1: 0.2415125072002411 (0.21545821116787606) | > loss_disc_real_2: 0.2509825825691223 (0.23449490270737944) | > loss_disc_real_3: 0.28181201219558716 (0.24569982020505543) | > loss_disc_real_4: 0.3626416325569153 (0.24140311289450217) | > loss_disc_real_5: 0.32386085391044617 (0.2633702516041954) | > loss_0: 3.0275402069091797 (2.497785140728128) | > grad_norm_0: tensor(607.9829, device='cuda:0') (tensor(689.8508, device='cuda:0')) | > loss_gen: 2.7125816345214844 (2.3708856681297554) | > loss_kl: 0.6923582553863525 (0.8675324629093039) | > loss_feat: 4.240454196929932 (5.592086583761306) | > loss_mel: 22.283090591430664 (19.80481060208945) | > loss_duration: 1.3016737699508667 (1.3244823669565138) | > loss_1: 31.230159759521484 (29.959798105831812) | > grad_norm_1: tensor(2421.0249, device='cuda:0') (tensor(26147.4980, device='cuda:0')) | > current_lr_0: 6.194482753763017e-05 | > current_lr_1: 6.200680722365663e-05 | > step_time: 1.16 (0.9179367525824185) | > loader_time: 0.046 (0.03612595591051825)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0393152236938477 (3.0393152236938477) | > loss_disc_real_0: 0.20906463265419006 (0.20906463265419006) | > loss_disc_real_1: 0.25881943106651306 (0.25881943106651306) | > loss_disc_real_2: 0.26726821064949036 (0.26726821064949036) | > loss_disc_real_3: 0.27224963903427124 (0.27224963903427124) | > loss_disc_real_4: 0.29155784845352173 (0.29155784845352173) | > loss_disc_real_5: 0.24840059876441956 (0.24840059876441956) | > loss_0: 3.0393152236938477 (3.0393152236938477) | > loss_gen: 1.5114727020263672 (1.5114727020263672) | > loss_kl: 6.1596245765686035 (6.1596245765686035) | > loss_feat: 0.23142611980438232 (0.23142611980438232) | > loss_mel: 2.298250675201416 (2.298250675201416) | > loss_duration: 3.0710971355438232 (3.0710971355438232) | > loss_1: 13.271871566772461 (13.271871566772461)  --> STEP: 1 | > loss_disc: 1.578086018562317 (1.578086018562317) | > loss_disc_real_0: 0.1972866654396057 (0.1972866654396057) | > loss_disc_real_1: 0.30349496006965637 (0.30349496006965637) | > loss_disc_real_2: 0.24238808453083038 (0.24238808453083038) | > loss_disc_real_3: 0.18323051929473877 (0.18323051929473877) | > loss_disc_real_4: 0.15512871742248535 (0.15512871742248535) | > loss_disc_real_5: 0.06331073492765427 (0.06331073492765427) | > loss_0: 1.578086018562317 (1.578086018562317) | > loss_gen: 3.850271463394165 (3.850271463394165) | > loss_kl: 5.483185768127441 (5.483185768127441) | > loss_feat: 13.121042251586914 (13.121042251586914) | > loss_mel: 23.79670524597168 (23.79670524597168) | > loss_duration: 3.4831435680389404 (3.4831435680389404) | > loss_1: 49.73434829711914 (49.73434829711914)  --> STEP: 2 | > loss_disc: 1.6870687007904053 (1.632577359676361) | > loss_disc_real_0: 0.11773316562175751 (0.1575099155306816) | > loss_disc_real_1: 0.18035173416137695 (0.24192334711551666) | > loss_disc_real_2: 0.1353781819343567 (0.18888313323259354) | > loss_disc_real_3: 0.2384122610092163 (0.21082139015197754) | > loss_disc_real_4: 0.13330280780792236 (0.14421576261520386) | > loss_disc_real_5: 0.1530347615480423 (0.10817274823784828) | > loss_0: 1.6870687007904053 (1.632577359676361) | > loss_gen: 3.210675001144409 (3.530473232269287) | > loss_kl: 5.729803085327148 (5.606494426727295) | > loss_feat: 9.677878379821777 (11.399460315704346) | > loss_mel: 24.636186599731445 (24.216445922851562) | > loss_duration: 3.283909320831299 (3.3835264444351196) | > loss_1: 46.5384521484375 (48.13640022277832)  --> STEP: 3 | > loss_disc: 3.082731246948242 (2.1159619887669883) | > loss_disc_real_0: 0.2344602644443512 (0.18316003183523813) | > loss_disc_real_1: 0.2694811224937439 (0.2511092722415924) | > loss_disc_real_2: 0.26863956451416016 (0.21546861032644907) | > loss_disc_real_3: 0.2720537781715393 (0.23123218615849814) | > loss_disc_real_4: 0.2878718972206116 (0.19210114081700644) | > loss_disc_real_5: 0.24756285548210144 (0.154636117319266) | > loss_0: 3.082731246948242 (2.1159619887669883) | > loss_gen: 1.5065399408340454 (2.855828801790873) | > loss_kl: 2.7321975231170654 (4.648395458857219) | > loss_feat: 0.340335488319397 (7.713085373242696) | > loss_mel: 5.189462661743164 (17.874118169148762) | > loss_duration: 3.047529697418213 (3.2715275287628174) | > loss_1: 12.816064834594727 (36.36295509338379) --> EVAL PERFORMANCE | > avg_loader_time: 0.002942800521850586 (-6.151199340820312e-05) | > avg_loss_disc: 2.1159619887669883 (-0.2775559425354004) | > avg_loss_disc_real_0: 0.18316003183523813 (-0.09885396063327792) | > avg_loss_disc_real_1: 0.2511092722415924 (-0.04765330751736957) | > avg_loss_disc_real_2: 0.21546861032644907 (-0.04094410439332327) | > avg_loss_disc_real_3: 0.23123218615849814 (-0.07576983173688254) | > avg_loss_disc_real_4: 0.19210114081700644 (-0.05154053866863251) | > avg_loss_disc_real_5: 0.154636117319266 (-0.027737930417060852) | > avg_loss_0: 2.1159619887669883 (-0.2775559425354004) | > avg_loss_gen: 2.855828801790873 (-0.12711425622304295) | > avg_loss_kl: 4.648395458857219 (-0.06737597783406546) | > avg_loss_feat: 7.713085373242696 (+0.5489465792973833) | > avg_loss_mel: 17.874118169148762 (-4.4009234110514335) | > avg_loss_duration: 3.2715275287628174 (-0.04351798693339015) | > avg_loss_1: 36.36295509338379 (-4.089985529581703)  > EPOCH: 1173/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:51:58)   --> TIME: 2023-10-20 14:52:09 -- STEP: 9/50 -- GLOBAL_STEP: 111660 | > loss_disc: 2.3774142265319824 (2.46202552318573) | > loss_disc_real_0: 0.23940548300743103 (0.19049062952399254) | > loss_disc_real_1: 0.23092536628246307 (0.24040129056407344) | > loss_disc_real_2: 0.2188972532749176 (0.25070194486114716) | > loss_disc_real_3: 0.17837756872177124 (0.2963519516504473) | > loss_disc_real_4: 0.11827204376459122 (0.25786326152996886) | > loss_disc_real_5: 0.09721703827381134 (0.18691480739249122) | > loss_0: 2.3774142265319824 (2.46202552318573) | > grad_norm_0: tensor(448.1752, device='cuda:0') (tensor(505.3140, device='cuda:0')) | > loss_gen: 1.7778425216674805 (2.6583463748296103) | > loss_kl: 0.82663494348526 (0.6111822542217042) | > loss_feat: 3.073829174041748 (7.874447504679362) | > loss_mel: 17.015905380249023 (21.34821679857042) | > loss_duration: 1.2798610925674438 (1.3039579259024725) | > loss_1: 23.974075317382812 (33.796150631374786) | > grad_norm_1: tensor(9243.1660, device='cuda:0') (tensor(29791.5938, device='cuda:0')) | > current_lr_0: 6.188290980418041e-05 | > current_lr_1: 6.194482753763017e-05 | > step_time: 0.8132 (0.5981163713667128) | > loader_time: 0.0414 (0.029126750098334417)  --> TIME: 2023-10-20 14:52:26 -- STEP: 39/50 -- GLOBAL_STEP: 111690 | > loss_disc: 3.0155539512634277 (2.4283516315313487) | > loss_disc_real_0: 0.1415657103061676 (0.13974878932229975) | > loss_disc_real_1: 0.24958649277687073 (0.22575112322393137) | > loss_disc_real_2: 0.2822510302066803 (0.22965701698110655) | > loss_disc_real_3: 0.30053919553756714 (0.24762176669751987) | > loss_disc_real_4: 0.25921157002449036 (0.2268143484655481) | > loss_disc_real_5: 0.2807820439338684 (0.2244448428734755) | > loss_0: 3.0155539512634277 (2.4283516315313487) | > grad_norm_0: tensor(1253.0026, device='cuda:0') (tensor(583.0989, device='cuda:0')) | > loss_gen: 1.5488708019256592 (2.357584216655829) | > loss_kl: 0.4038025140762329 (0.76131005355945) | > loss_feat: 0.07164435088634491 (6.07216157630468) | > loss_mel: 1.4419639110565186 (21.757731896180374) | > loss_duration: 1.3889459371566772 (1.3069114623925624) | > loss_1: 4.855227470397949 (32.25569935334035) | > grad_norm_1: tensor(34362.3516, device='cuda:0') (tensor(16100.8926, device='cuda:0')) | > current_lr_0: 6.188290980418041e-05 | > current_lr_1: 6.194482753763017e-05 | > step_time: 0.4247 (0.5710059862870437) | > loader_time: 0.0038 (0.01960305067209097)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.91459059715271 (2.91459059715271) | > loss_disc_real_0: 0.3294570744037628 (0.3294570744037628) | > loss_disc_real_1: 0.27227693796157837 (0.27227693796157837) | > loss_disc_real_2: 0.4514791667461395 (0.4514791667461395) | > loss_disc_real_3: 0.2189663201570511 (0.2189663201570511) | > loss_disc_real_4: 0.317079097032547 (0.317079097032547) | > loss_disc_real_5: 0.3270178735256195 (0.3270178735256195) | > loss_0: 2.91459059715271 (2.91459059715271) | > loss_gen: 2.472959280014038 (2.472959280014038) | > loss_kl: 6.082509994506836 (6.082509994506836) | > loss_feat: 5.863726615905762 (5.863726615905762) | > loss_mel: 21.8392333984375 (21.8392333984375) | > loss_duration: 3.1650562286376953 (3.1650562286376953) | > loss_1: 39.423484802246094 (39.423484802246094)  --> STEP: 1 | > loss_disc: 2.9961862564086914 (2.9961862564086914) | > loss_disc_real_0: 0.4251921772956848 (0.4251921772956848) | > loss_disc_real_1: 0.2673501670360565 (0.2673501670360565) | > loss_disc_real_2: 0.27059152722358704 (0.27059152722358704) | > loss_disc_real_3: 0.24222609400749207 (0.24222609400749207) | > loss_disc_real_4: 0.2494128793478012 (0.2494128793478012) | > loss_disc_real_5: 0.2480710744857788 (0.2480710744857788) | > loss_0: 2.9961862564086914 (2.9961862564086914) | > loss_gen: 1.8342268466949463 (1.8342268466949463) | > loss_kl: 5.6203293800354 (5.6203293800354) | > loss_feat: 0.22320318222045898 (0.22320318222045898) | > loss_mel: 11.730504035949707 (11.730504035949707) | > loss_duration: 3.411048650741577 (3.411048650741577) | > loss_1: 22.819311141967773 (22.819311141967773)  --> STEP: 2 | > loss_disc: 2.4731626510620117 (2.7346744537353516) | > loss_disc_real_0: 0.06948414444923401 (0.2473381608724594) | > loss_disc_real_1: 0.2058381736278534 (0.23659417033195496) | > loss_disc_real_2: 0.2967471182346344 (0.2836693227291107) | > loss_disc_real_3: 0.2371201515197754 (0.23967312276363373) | > loss_disc_real_4: 0.1486920416355133 (0.19905246049165726) | > loss_disc_real_5: 0.327359139919281 (0.2877151072025299) | > loss_0: 2.4731626510620117 (2.7346744537353516) | > loss_gen: 2.3249282836914062 (2.0795775651931763) | > loss_kl: 5.983215808868408 (5.801772594451904) | > loss_feat: 8.291703224182129 (4.257453203201294) | > loss_mel: 23.764741897583008 (17.747622966766357) | > loss_duration: 3.3231966495513916 (3.3671226501464844) | > loss_1: 43.68778610229492 (33.25354862213135)  --> STEP: 3 | > loss_disc: 3.037598133087158 (2.835649013519287) | > loss_disc_real_0: 0.2841564416885376 (0.2596109211444855) | > loss_disc_real_1: 0.15598514676094055 (0.20972449580828348) | > loss_disc_real_2: 0.12282095104455948 (0.23005319883426031) | > loss_disc_real_3: 0.2018728256225586 (0.22707302371660867) | > loss_disc_real_4: 0.16974174976348877 (0.18928222358226776) | > loss_disc_real_5: 0.2179170399904251 (0.264449084798495) | > loss_0: 3.037598133087158 (2.835649013519287) | > loss_gen: 1.5469766855239868 (1.9020439386367798) | > loss_kl: 2.689901113510132 (4.7644821008046465) | > loss_feat: 5.009559154510498 (4.508155186971028) | > loss_mel: 21.098323822021484 (18.8645232518514) | > loss_duration: 3.139289140701294 (3.2911781469980874) | > loss_1: 33.484046936035156 (33.33038139343262) --> EVAL PERFORMANCE | > avg_loader_time: 0.021762927373250324 (+0.01882012685139974) | > avg_loss_disc: 2.835649013519287 (+0.7196870247522988) | > avg_loss_disc_real_0: 0.2596109211444855 (+0.07645088930924734) | > avg_loss_disc_real_1: 0.20972449580828348 (-0.04138477643330893) | > avg_loss_disc_real_2: 0.23005319883426031 (+0.014584588507811247) | > avg_loss_disc_real_3: 0.22707302371660867 (-0.0041591624418894635) | > avg_loss_disc_real_4: 0.18928222358226776 (-0.002818917234738677) | > avg_loss_disc_real_5: 0.264449084798495 (+0.109812967479229) | > avg_loss_0: 2.835649013519287 (+0.7196870247522988) | > avg_loss_gen: 1.9020439386367798 (-0.9537848631540933) | > avg_loss_kl: 4.7644821008046465 (+0.1160866419474278) | > avg_loss_feat: 4.508155186971028 (-3.2049301862716675) | > avg_loss_mel: 18.8645232518514 (+0.9904050827026367) | > avg_loss_duration: 3.2911781469980874 (+0.019650618235270034) | > avg_loss_1: 33.33038139343262 (-3.032573699951172)  > EPOCH: 1174/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:52:49)   --> TIME: 2023-10-20 14:53:05 -- STEP: 19/50 -- GLOBAL_STEP: 111720 | > loss_disc: 2.5754292011260986 (2.4575887604763635) | > loss_disc_real_0: 0.13667058944702148 (0.16299108415842056) | > loss_disc_real_1: 0.2283799797296524 (0.23965099218644595) | > loss_disc_real_2: 0.3318278193473816 (0.24067319008080582) | > loss_disc_real_3: 0.40663033723831177 (0.23173242346628717) | > loss_disc_real_4: 0.25971147418022156 (0.21204840235019984) | > loss_disc_real_5: 0.2670595645904541 (0.23626395432572617) | > loss_0: 2.5754292011260986 (2.4575887604763635) | > grad_norm_0: tensor(299.4260, device='cuda:0') (tensor(631.1406, device='cuda:0')) | > loss_gen: 2.428926467895508 (2.3550768212268225) | > loss_kl: 0.7017121911048889 (0.8998754965631586) | > loss_feat: 5.2383012771606445 (6.184690448798631) | > loss_mel: 23.85470962524414 (21.413323904338636) | > loss_duration: 1.4146018028259277 (1.3448384561036761) | > loss_1: 33.638248443603516 (32.19780510350277) | > grad_norm_1: tensor(3303.1233, device='cuda:0') (tensor(18947.5273, device='cuda:0')) | > current_lr_0: 6.182105396138186e-05 | > current_lr_1: 6.188290980418041e-05 | > step_time: 0.8508 (0.5305943865525095) | > loader_time: 0.0316 (0.015523684652228104)  --> TIME: 2023-10-20 14:53:31 -- STEP: 49/50 -- GLOBAL_STEP: 111750 | > loss_disc: 2.8558807373046875 (2.411021641322545) | > loss_disc_real_0: 0.14240612089633942 (0.14584989746918486) | > loss_disc_real_1: 0.2640596926212311 (0.21808912646861708) | > loss_disc_real_2: 0.3229016363620758 (0.22352902690062718) | > loss_disc_real_3: 0.4284924268722534 (0.23328525105453268) | > loss_disc_real_4: 0.31223610043525696 (0.22044041882060011) | > loss_disc_real_5: 0.23822788894176483 (0.2218032420365786) | > loss_0: 2.8558807373046875 (2.411021641322545) | > grad_norm_0: tensor(755.0332, device='cuda:0') (tensor(623.1572, device='cuda:0')) | > loss_gen: 2.420930862426758 (2.2931567722437327) | > loss_kl: 0.5640925168991089 (0.8218708336353302) | > loss_feat: 5.646634101867676 (5.658196381008138) | > loss_mel: 22.00541877746582 (20.176070558781532) | > loss_duration: 1.4255176782608032 (1.3152360721510283) | > loss_1: 32.062591552734375 (30.264530357049438) | > grad_norm_1: tensor(32975.4297, device='cuda:0') (tensor(19019.0430, device='cuda:0')) | > current_lr_0: 6.182105396138186e-05 | > current_lr_1: 6.188290980418041e-05 | > step_time: 0.3183 (0.6908630594915274) | > loader_time: 0.5204 (0.032437056911234954)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.679368019104004 (3.679368019104004) | > loss_disc_real_0: 0.2154407799243927 (0.2154407799243927) | > loss_disc_real_1: 0.3697957992553711 (0.3697957992553711) | > loss_disc_real_2: 0.32453447580337524 (0.32453447580337524) | > loss_disc_real_3: 0.27692627906799316 (0.27692627906799316) | > loss_disc_real_4: 0.26272112131118774 (0.26272112131118774) | > loss_disc_real_5: 0.31215763092041016 (0.31215763092041016) | > loss_0: 3.679368019104004 (3.679368019104004) | > loss_gen: 1.625554084777832 (1.625554084777832) | > loss_kl: 5.784817695617676 (5.784817695617676) | > loss_feat: 7.194830894470215 (7.194830894470215) | > loss_mel: 25.27580451965332 (25.27580451965332) | > loss_duration: 3.051081895828247 (3.051081895828247) | > loss_1: 42.932090759277344 (42.932090759277344)  --> STEP: 1 | > loss_disc: 2.9170658588409424 (2.9170658588409424) | > loss_disc_real_0: 0.31280243396759033 (0.31280243396759033) | > loss_disc_real_1: 0.32715749740600586 (0.32715749740600586) | > loss_disc_real_2: 0.2664400041103363 (0.2664400041103363) | > loss_disc_real_3: 0.33464470505714417 (0.33464470505714417) | > loss_disc_real_4: 0.353198766708374 (0.353198766708374) | > loss_disc_real_5: 0.26912543177604675 (0.26912543177604675) | > loss_0: 2.9170658588409424 (2.9170658588409424) | > loss_gen: 2.4769198894500732 (2.4769198894500732) | > loss_kl: 5.459352016448975 (5.459352016448975) | > loss_feat: 4.172943115234375 (4.172943115234375) | > loss_mel: 25.449438095092773 (25.449438095092773) | > loss_duration: 3.3879928588867188 (3.3879928588867188) | > loss_1: 40.94664764404297 (40.94664764404297)  --> STEP: 2 | > loss_disc: 1.867633581161499 (2.3923497200012207) | > loss_disc_real_0: 0.10359222441911697 (0.20819732919335365) | > loss_disc_real_1: 0.10265197604894638 (0.21490473672747612) | > loss_disc_real_2: 0.15310530364513397 (0.20977265387773514) | > loss_disc_real_3: 0.15223799645900726 (0.24344135075807571) | > loss_disc_real_4: 0.298622190952301 (0.3259104788303375) | > loss_disc_real_5: 0.04037175327539444 (0.1547485925257206) | > loss_0: 1.867633581161499 (2.3923497200012207) | > loss_gen: 2.6539363861083984 (2.565428137779236) | > loss_kl: 5.65548849105835 (5.557420253753662) | > loss_feat: 10.416592597961426 (7.2947678565979) | > loss_mel: 21.51349639892578 (23.481467247009277) | > loss_duration: 3.2524759769439697 (3.3202344179153442) | > loss_1: 43.49199295043945 (42.21932029724121)  --> STEP: 3 | > loss_disc: 2.4322774410247803 (2.4056589603424072) | > loss_disc_real_0: 0.18384353816509247 (0.20007939885059992) | > loss_disc_real_1: 0.2488422691822052 (0.22621724754571915) | > loss_disc_real_2: 0.2659969925880432 (0.2285141001145045) | > loss_disc_real_3: 0.1937745362520218 (0.2268857459227244) | > loss_disc_real_4: 0.28366902470588684 (0.3118299941221873) | > loss_disc_real_5: 0.12980380654335022 (0.14643366386493048) | > loss_0: 2.4322774410247803 (2.4056589603424072) | > loss_gen: 2.344437599182129 (2.4917646249135337) | > loss_kl: 2.755949020385742 (4.6235965092976885) | > loss_feat: 6.280003547668457 (6.956513086954753) | > loss_mel: 23.015222549438477 (23.32605234781901) | > loss_duration: 3.0164763927459717 (3.2189817428588867) | > loss_1: 37.412086486816406 (40.61690902709961) --> EVAL PERFORMANCE | > avg_loader_time: 0.020511945088704426 (-0.0012509822845458984) | > avg_loss_disc: 2.4056589603424072 (-0.4299900531768799) | > avg_loss_disc_real_0: 0.20007939885059992 (-0.05953152229388556) | > avg_loss_disc_real_1: 0.22621724754571915 (+0.016492751737435668) | > avg_loss_disc_real_2: 0.2285141001145045 (-0.001539098719755827) | > avg_loss_disc_real_3: 0.2268857459227244 (-0.00018727779388427734) | > avg_loss_disc_real_4: 0.3118299941221873 (+0.12254777053991955) | > avg_loss_disc_real_5: 0.14643366386493048 (-0.11801542093356451) | > avg_loss_0: 2.4056589603424072 (-0.4299900531768799) | > avg_loss_gen: 2.4917646249135337 (+0.5897206862767539) | > avg_loss_kl: 4.6235965092976885 (-0.140885591506958) | > avg_loss_feat: 6.956513086954753 (+2.4483578999837246) | > avg_loss_mel: 23.32605234781901 (+4.461529095967613) | > avg_loss_duration: 3.2189817428588867 (-0.0721964041392007) | > avg_loss_1: 40.61690902709961 (+7.286527633666992)  > EPOCH: 1175/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:53:39)   --> TIME: 2023-10-20 14:54:03 -- STEP: 29/50 -- GLOBAL_STEP: 111780 | > loss_disc: 2.9835357666015625 (2.577586354880498) | > loss_disc_real_0: 0.38141030073165894 (0.150280195898537) | > loss_disc_real_1: 0.2844083607196808 (0.23027147018703922) | > loss_disc_real_2: 0.28917428851127625 (0.23856821823222885) | > loss_disc_real_3: 0.24349218606948853 (0.24487074014955554) | > loss_disc_real_4: 0.28164154291152954 (0.24969680851389628) | > loss_disc_real_5: 0.30579930543899536 (0.23383099842688132) | > loss_0: 2.9835357666015625 (2.577586354880498) | > grad_norm_0: tensor(1404.9800, device='cuda:0') (tensor(638.8217, device='cuda:0')) | > loss_gen: 1.8487861156463623 (2.1933980728017883) | > loss_kl: 0.7787681818008423 (0.7994833588600159) | > loss_feat: 0.4848064184188843 (5.562392048280815) | > loss_mel: 14.33578109741211 (20.3313190731509) | > loss_duration: 1.3243783712387085 (1.3208234269043495) | > loss_1: 18.772520065307617 (30.20741576161878) | > grad_norm_1: tensor(10508.1406, device='cuda:0') (tensor(20336.9316, device='cuda:0')) | > current_lr_0: 6.175925994737095e-05 | > current_lr_1: 6.182105396138186e-05 | > step_time: 0.4158 (0.6069212699758595) | > loader_time: 0.027 (0.02462313092988113)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.962801933288574 (2.962801933288574) | > loss_disc_real_0: 0.2914590537548065 (0.2914590537548065) | > loss_disc_real_1: 0.2786310017108917 (0.2786310017108917) | > loss_disc_real_2: 0.2605370581150055 (0.2605370581150055) | > loss_disc_real_3: 0.2538185715675354 (0.2538185715675354) | > loss_disc_real_4: 0.2615875005722046 (0.2615875005722046) | > loss_disc_real_5: 0.244731143116951 (0.244731143116951) | > loss_0: 2.962801933288574 (2.962801933288574) | > loss_gen: 1.6430096626281738 (1.6430096626281738) | > loss_kl: 5.310542106628418 (5.310542106628418) | > loss_feat: 0.18996262550354004 (0.18996262550354004) | > loss_mel: 10.78441333770752 (10.78441333770752) | > loss_duration: 3.052978038787842 (3.052978038787842) | > loss_1: 20.980905532836914 (20.980905532836914)  --> STEP: 1 | > loss_disc: 2.8753128051757812 (2.8753128051757812) | > loss_disc_real_0: 0.16501739621162415 (0.16501739621162415) | > loss_disc_real_1: 0.2780771553516388 (0.2780771553516388) | > loss_disc_real_2: 0.27974173426628113 (0.27974173426628113) | > loss_disc_real_3: 0.25571054220199585 (0.25571054220199585) | > loss_disc_real_4: 0.26123934984207153 (0.26123934984207153) | > loss_disc_real_5: 0.24460409581661224 (0.24460409581661224) | > loss_0: 2.8753128051757812 (2.8753128051757812) | > loss_gen: 1.625767707824707 (1.625767707824707) | > loss_kl: 5.526509761810303 (5.526509761810303) | > loss_feat: 0.42362987995147705 (0.42362987995147705) | > loss_mel: 17.690574645996094 (17.690574645996094) | > loss_duration: 3.3593244552612305 (3.3593244552612305) | > loss_1: 28.625808715820312 (28.625808715820312)  --> STEP: 2 | > loss_disc: 3.0356881618499756 (2.9555004835128784) | > loss_disc_real_0: 0.3225000500679016 (0.24375872313976288) | > loss_disc_real_1: 0.27803486585617065 (0.2780560106039047) | > loss_disc_real_2: 0.26120465993881226 (0.2704731971025467) | > loss_disc_real_3: 0.2537284791469574 (0.2547195106744766) | > loss_disc_real_4: 0.2611335217952728 (0.2611864358186722) | > loss_disc_real_5: 0.24455690383911133 (0.24458049982786179) | > loss_0: 3.0356881618499756 (2.9555004835128784) | > loss_gen: 1.5918958187103271 (1.608831763267517) | > loss_kl: 6.384012222290039 (5.955260992050171) | > loss_feat: 0.18481366336345673 (0.3042217716574669) | > loss_mel: 2.0282363891601562 (9.859405517578125) | > loss_duration: 3.330747365951538 (3.3450359106063843) | > loss_1: 13.519705772399902 (21.072757244110107)  --> STEP: 3 | > loss_disc: 3.0350534915924072 (2.982018152872721) | > loss_disc_real_0: 0.32194751501083374 (0.2698216537634532) | > loss_disc_real_1: 0.2779889404773712 (0.27803365389506024) | > loss_disc_real_2: 0.26094916462898254 (0.26729851961135864) | > loss_disc_real_3: 0.2536432147026062 (0.25436074535051983) | > loss_disc_real_4: 0.26103779673576355 (0.26113688945770264) | > loss_disc_real_5: 0.24457113444805145 (0.24457737803459167) | > loss_0: 3.0350534915924072 (2.982018152872721) | > loss_gen: 1.5914528369903564 (1.6030387878417969) | > loss_kl: 3.000401020050049 (4.97030766805013) | > loss_feat: 0.18506811559200287 (0.2645038863023122) | > loss_mel: 2.6361618041992188 (7.451657613118489) | > loss_duration: 3.1161162853240967 (3.2687293688456216) | > loss_1: 10.529200553894043 (17.558238347371418) --> EVAL PERFORMANCE | > avg_loader_time: 0.015439192454020182 (-0.005072752634684244) | > avg_loss_disc: 2.982018152872721 (+0.576359192530314) | > avg_loss_disc_real_0: 0.2698216537634532 (+0.06974225491285327) | > avg_loss_disc_real_1: 0.27803365389506024 (+0.05181640634934109) | > avg_loss_disc_real_2: 0.26729851961135864 (+0.038784419496854156) | > avg_loss_disc_real_3: 0.25436074535051983 (+0.027474999427795438) | > avg_loss_disc_real_4: 0.26113688945770264 (-0.05069310466448468) | > avg_loss_disc_real_5: 0.24457737803459167 (+0.0981437141696612) | > avg_loss_0: 2.982018152872721 (+0.576359192530314) | > avg_loss_gen: 1.6030387878417969 (-0.8887258370717368) | > avg_loss_kl: 4.97030766805013 (+0.3467111587524414) | > avg_loss_feat: 0.2645038863023122 (-6.692009200652441) | > avg_loss_mel: 7.451657613118489 (-15.874394734700523) | > avg_loss_duration: 3.2687293688456216 (+0.04974762598673488) | > avg_loss_1: 17.558238347371418 (-23.05867067972819)  > EPOCH: 1176/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:54:31)   --> TIME: 2023-10-20 14:54:45 -- STEP: 9/50 -- GLOBAL_STEP: 111810 | > loss_disc: 2.9890527725219727 (2.634775479634603) | > loss_disc_real_0: 0.17277871072292328 (0.13620475141538513) | > loss_disc_real_1: 0.26379668712615967 (0.2364391874935892) | > loss_disc_real_2: 0.29296839237213135 (0.2523182870613204) | > loss_disc_real_3: 0.26355665922164917 (0.24860458986626732) | > loss_disc_real_4: 0.2134624421596527 (0.21669100638892916) | > loss_disc_real_5: 0.19726134836673737 (0.20799706627925238) | > loss_0: 2.9890527725219727 (2.634775479634603) | > grad_norm_0: tensor(680.3250, device='cuda:0') (tensor(627.0345, device='cuda:0')) | > loss_gen: 2.1029677391052246 (2.0229375229941473) | > loss_kl: 1.0295518636703491 (0.6843460963832008) | > loss_feat: 5.151804447174072 (4.347174962361653) | > loss_mel: 24.44904136657715 (19.263306829664444) | > loss_duration: 1.297568678855896 (1.3119845257865057) | > loss_1: 34.03093338012695 (27.629749721950954) | > grad_norm_1: tensor(2673.9014, device='cuda:0') (tensor(8113.7876, device='cuda:0')) | > current_lr_0: 6.169752770034592e-05 | > current_lr_1: 6.175925994737095e-05 | > step_time: 0.818 (0.842588848537869) | > loader_time: 0.0426 (0.0420477655198839)  --> TIME: 2023-10-20 14:55:07 -- STEP: 39/50 -- GLOBAL_STEP: 111840 | > loss_disc: 1.8491230010986328 (2.4600466581491323) | > loss_disc_real_0: 0.0715249553322792 (0.15880930738953444) | > loss_disc_real_1: 0.1343822032213211 (0.22484573817405945) | > loss_disc_real_2: 0.05142664536833763 (0.20856558474210593) | > loss_disc_real_3: 0.1316719353199005 (0.23160548319514745) | > loss_disc_real_4: 0.1771010458469391 (0.21017945639024943) | > loss_disc_real_5: 0.15866601467132568 (0.2080797651448311) | > loss_0: 1.8491230010986328 (2.4600466581491323) | > grad_norm_0: tensor(366.8618, device='cuda:0') (tensor(716.2841, device='cuda:0')) | > loss_gen: 2.620628595352173 (2.152031870988699) | > loss_kl: 0.6158431768417358 (0.754313564262329) | > loss_feat: 9.4323091506958 (5.020759492826002) | > loss_mel: 25.86591148376465 (19.762943053856873) | > loss_duration: 1.356947422027588 (1.3194175836367485) | > loss_1: 39.891639709472656 (29.009465792240242) | > grad_norm_1: tensor(11976.8604, device='cuda:0') (tensor(13177.4795, device='cuda:0')) | > current_lr_0: 6.169752770034592e-05 | > current_lr_1: 6.175925994737095e-05 | > step_time: 0.4821 (0.7507843359922752) | > loader_time: 0.0468 (0.02825153179657766)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.965481758117676 (2.965481758117676) | > loss_disc_real_0: 0.2176949381828308 (0.2176949381828308) | > loss_disc_real_1: 0.27030760049819946 (0.27030760049819946) | > loss_disc_real_2: 0.2790818214416504 (0.2790818214416504) | > loss_disc_real_3: 0.2396450638771057 (0.2396450638771057) | > loss_disc_real_4: 0.4006597101688385 (0.4006597101688385) | > loss_disc_real_5: 0.5092065334320068 (0.5092065334320068) | > loss_0: 2.965481758117676 (2.965481758117676) | > loss_gen: 2.274630546569824 (2.274630546569824) | > loss_kl: 5.178452014923096 (5.178452014923096) | > loss_feat: 4.882948875427246 (4.882948875427246) | > loss_mel: 22.417781829833984 (22.417781829833984) | > loss_duration: 2.996735095977783 (2.996735095977783) | > loss_1: 37.75054931640625 (37.75054931640625)  --> STEP: 1 | > loss_disc: 3.078195571899414 (3.078195571899414) | > loss_disc_real_0: 0.09333030134439468 (0.09333030134439468) | > loss_disc_real_1: 0.24078698456287384 (0.24078698456287384) | > loss_disc_real_2: 0.25789591670036316 (0.25789591670036316) | > loss_disc_real_3: 0.25143373012542725 (0.25143373012542725) | > loss_disc_real_4: 0.28285396099090576 (0.28285396099090576) | > loss_disc_real_5: 0.32121461629867554 (0.32121461629867554) | > loss_0: 3.078195571899414 (3.078195571899414) | > loss_gen: 1.4555104970932007 (1.4555104970932007) | > loss_kl: 5.255702018737793 (5.255702018737793) | > loss_feat: 0.07717505842447281 (0.07717505842447281) | > loss_mel: 3.989795207977295 (3.989795207977295) | > loss_duration: 3.3979649543762207 (3.3979649543762207) | > loss_1: 14.1761474609375 (14.1761474609375)  --> STEP: 2 | > loss_disc: 2.7213876247406006 (2.8997915983200073) | > loss_disc_real_0: 0.11860009282827377 (0.10596519708633423) | > loss_disc_real_1: 0.2454705834388733 (0.24312878400087357) | > loss_disc_real_2: 0.36433717608451843 (0.3111165463924408) | > loss_disc_real_3: 0.26079002022743225 (0.25611187517642975) | > loss_disc_real_4: 0.34077829122543335 (0.31181612610816956) | > loss_disc_real_5: 0.2534082531929016 (0.2873114347457886) | > loss_0: 2.7213876247406006 (2.8997915983200073) | > loss_gen: 2.056720018386841 (1.7561152577400208) | > loss_kl: 5.896338939666748 (5.5760204792022705) | > loss_feat: 3.293138265609741 (1.685156662017107) | > loss_mel: 26.804126739501953 (15.396960973739624) | > loss_duration: 3.358994483947754 (3.3784797191619873) | > loss_1: 41.40931701660156 (27.79273223876953)  --> STEP: 3 | > loss_disc: 2.97156023979187 (2.9237144788106284) | > loss_disc_real_0: 0.09060091525316238 (0.10084376980861028) | > loss_disc_real_1: 0.31621798872947693 (0.26749185224374133) | > loss_disc_real_2: 0.33532431721687317 (0.31918580333391827) | > loss_disc_real_3: 0.2350272387266159 (0.2490836630264918) | > loss_disc_real_4: 0.41412094235420227 (0.3459177315235138) | > loss_disc_real_5: 0.5968955159187317 (0.39050612847010296) | > loss_0: 2.97156023979187 (2.9237144788106284) | > loss_gen: 2.359917402267456 (1.9573826392491658) | > loss_kl: 2.6860151290893555 (4.612685362497966) | > loss_feat: 4.7805657386779785 (2.7169596875707307) | > loss_mel: 24.224552154541016 (18.339491367340088) | > loss_duration: 3.0536792278289795 (3.2702128887176514) | > loss_1: 37.104732513427734 (30.896732330322266) --> EVAL PERFORMANCE | > avg_loader_time: 0.005965789159138997 (-0.009473403294881184) | > avg_loss_disc: 2.9237144788106284 (-0.0583036740620928) | > avg_loss_disc_real_0: 0.10084376980861028 (-0.16897788395484292) | > avg_loss_disc_real_1: 0.26749185224374133 (-0.010541801651318905) | > avg_loss_disc_real_2: 0.31918580333391827 (+0.05188728372255963) | > avg_loss_disc_real_3: 0.2490836630264918 (-0.005277082324028043) | > avg_loss_disc_real_4: 0.3459177315235138 (+0.08478084206581116) | > avg_loss_disc_real_5: 0.39050612847010296 (+0.1459287504355113) | > avg_loss_0: 2.9237144788106284 (-0.0583036740620928) | > avg_loss_gen: 1.9573826392491658 (+0.3543438514073689) | > avg_loss_kl: 4.612685362497966 (-0.3576223055521641) | > avg_loss_feat: 2.7169596875707307 (+2.4524558012684183) | > avg_loss_mel: 18.339491367340088 (+10.8878337542216) | > avg_loss_duration: 3.2702128887176514 (+0.0014835198720297704) | > avg_loss_1: 30.896732330322266 (+13.338493982950848)  > EPOCH: 1177/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:55:24)   --> TIME: 2023-10-20 14:55:50 -- STEP: 19/50 -- GLOBAL_STEP: 111870 | > loss_disc: 3.048492431640625 (2.611379704977337) | > loss_disc_real_0: 0.15359777212142944 (0.17014264295759954) | > loss_disc_real_1: 0.24178771674633026 (0.22338831307072388) | > loss_disc_real_2: 0.2180880457162857 (0.22686238586902618) | > loss_disc_real_3: 0.23143546283245087 (0.23743039448010295) | > loss_disc_real_4: 0.27038857340812683 (0.27591212485965927) | > loss_disc_real_5: 0.2740693986415863 (0.23230292765717758) | > loss_0: 3.048492431640625 (2.611379704977337) | > grad_norm_0: tensor(678.0486, device='cuda:0') (tensor(863.5113, device='cuda:0')) | > loss_gen: 1.4201242923736572 (2.1714505772841606) | > loss_kl: 1.1838209629058838 (0.8949431871113024) | > loss_feat: 0.05092792958021164 (4.651153490339455) | > loss_mel: 1.5360504388809204 (19.22612630066119) | > loss_duration: 1.4624669551849365 (1.3546960228367855) | > loss_1: 5.653390884399414 (28.298369457847194) | > grad_norm_1: tensor(28346.0352, device='cuda:0') (tensor(14276.7998, device='cuda:0')) | > current_lr_0: 6.16358571585668e-05 | > current_lr_1: 6.169752770034592e-05 | > step_time: 0.6051 (0.6157763380753366) | > loader_time: 0.0334 (0.023630606500725997)  --> TIME: 2023-10-20 14:56:09 -- STEP: 49/50 -- GLOBAL_STEP: 111900 | > loss_disc: 2.611222505569458 (2.6066134705835466) | > loss_disc_real_0: 0.008346568793058395 (0.15148363634943962) | > loss_disc_real_1: 0.2511695921421051 (0.22394202938493418) | > loss_disc_real_2: 0.07562074065208435 (0.23398825663084888) | > loss_disc_real_3: 0.28607216477394104 (0.24328104988196675) | > loss_disc_real_4: 0.29717403650283813 (0.25448992295304723) | > loss_disc_real_5: 0.25338757038116455 (0.2308078118010747) | > loss_0: 2.611222505569458 (2.6066134705835466) | > grad_norm_0: tensor(1497.1283, device='cuda:0') (tensor(727.5787, device='cuda:0')) | > loss_gen: 1.7759068012237549 (2.1125902813308093) | > loss_kl: 0.6332868933677673 (0.766337549808074) | > loss_feat: 2.304603099822998 (4.5467536413700005) | > loss_mel: 20.281888961791992 (19.688540548694377) | > loss_duration: 1.4118720293045044 (1.3179187774658205) | > loss_1: 26.407560348510742 (28.43214072013388) | > grad_norm_1: tensor(4268.1968, device='cuda:0') (tensor(13863.0166, device='cuda:0')) | > current_lr_0: 6.16358571585668e-05 | > current_lr_1: 6.169752770034592e-05 | > step_time: 0.9257 (0.6022444695842509) | > loader_time: 0.4815 (0.0293010935491445)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9505832195281982 (2.9505832195281982) | > loss_disc_real_0: 0.4939599931240082 (0.4939599931240082) | > loss_disc_real_1: 0.29992571473121643 (0.29992571473121643) | > loss_disc_real_2: 0.33915388584136963 (0.33915388584136963) | > loss_disc_real_3: 0.3131943643093109 (0.3131943643093109) | > loss_disc_real_4: 0.384944885969162 (0.384944885969162) | > loss_disc_real_5: 0.3256949782371521 (0.3256949782371521) | > loss_0: 2.9505832195281982 (2.9505832195281982) | > loss_gen: 3.7037999629974365 (3.7037999629974365) | > loss_kl: 6.077151298522949 (6.077151298522949) | > loss_feat: 7.797431468963623 (7.797431468963623) | > loss_mel: 21.837005615234375 (21.837005615234375) | > loss_duration: 3.0051426887512207 (3.0051426887512207) | > loss_1: 42.420528411865234 (42.420528411865234)  --> STEP: 1 | > loss_disc: 3.209930658340454 (3.209930658340454) | > loss_disc_real_0: 0.5173324346542358 (0.5173324346542358) | > loss_disc_real_1: 0.3693581819534302 (0.3693581819534302) | > loss_disc_real_2: 0.40354111790657043 (0.40354111790657043) | > loss_disc_real_3: 0.3499400019645691 (0.3499400019645691) | > loss_disc_real_4: 0.32153716683387756 (0.32153716683387756) | > loss_disc_real_5: 0.3453098237514496 (0.3453098237514496) | > loss_0: 3.209930658340454 (3.209930658340454) | > loss_gen: 2.759341239929199 (2.759341239929199) | > loss_kl: 5.4338059425354 (5.4338059425354) | > loss_feat: 2.787503242492676 (2.787503242492676) | > loss_mel: 22.01664924621582 (22.01664924621582) | > loss_duration: 3.3555705547332764 (3.3555705547332764) | > loss_1: 36.35287094116211 (36.35287094116211)  --> STEP: 2 | > loss_disc: 1.9717211723327637 (2.590825915336609) | > loss_disc_real_0: 0.14057032763957977 (0.3289513811469078) | > loss_disc_real_1: 0.28691935539245605 (0.3281387686729431) | > loss_disc_real_2: 0.16055019199848175 (0.2820456549525261) | > loss_disc_real_3: 0.20549796521663666 (0.2777189835906029) | > loss_disc_real_4: 0.21228282153606415 (0.26690999418497086) | > loss_disc_real_5: 0.1755811870098114 (0.2604455053806305) | > loss_0: 1.9717211723327637 (2.590825915336609) | > loss_gen: 2.873000383377075 (2.816170811653137) | > loss_kl: 5.799400329589844 (5.616603136062622) | > loss_feat: 8.166643142700195 (5.4770731925964355) | > loss_mel: 24.958663940429688 (23.487656593322754) | > loss_duration: 3.288233757019043 (3.3219021558761597) | > loss_1: 45.085941314697266 (40.71940612792969)  --> STEP: 3 | > loss_disc: 2.6628453731536865 (2.6148324012756348) | > loss_disc_real_0: 0.3522535264492035 (0.3367187629143397) | > loss_disc_real_1: 0.32369181513786316 (0.32665645082791644) | > loss_disc_real_2: 0.3913673162460327 (0.3184862087170283) | > loss_disc_real_3: 0.32344281673431396 (0.2929602613051732) | > loss_disc_real_4: 0.25984612107276917 (0.26455536981423694) | > loss_disc_real_5: 0.23385348916053772 (0.2515814999739329) | > loss_0: 2.6628453731536865 (2.6148324012756348) | > loss_gen: 4.0594635009765625 (3.230601708094279) | > loss_kl: 2.6923975944519043 (4.641867955525716) | > loss_feat: 7.427648544311523 (6.127264976501465) | > loss_mel: 23.29351234436035 (23.42294184366862) | > loss_duration: 3.0564496517181396 (3.2334179878234863) | > loss_1: 40.52947235107422 (40.65609486897787) --> EVAL PERFORMANCE | > avg_loader_time: 0.022649685541788738 (+0.016683896382649742) | > avg_loss_disc: 2.6148324012756348 (-0.30888207753499364) | > avg_loss_disc_real_0: 0.3367187629143397 (+0.23587499310572946) | > avg_loss_disc_real_1: 0.32665645082791644 (+0.05916459858417511) | > avg_loss_disc_real_2: 0.3184862087170283 (-0.0006995946168899536) | > avg_loss_disc_real_3: 0.2929602613051732 (+0.04387659827868143) | > avg_loss_disc_real_4: 0.26455536981423694 (-0.08136236170927685) | > avg_loss_disc_real_5: 0.2515814999739329 (-0.13892462849617004) | > avg_loss_0: 2.6148324012756348 (-0.30888207753499364) | > avg_loss_gen: 3.230601708094279 (+1.273219068845113) | > avg_loss_kl: 4.641867955525716 (+0.02918259302775006) | > avg_loss_feat: 6.127264976501465 (+3.410305288930734) | > avg_loss_mel: 23.42294184366862 (+5.083450476328533) | > avg_loss_duration: 3.2334179878234863 (-0.03679490089416504) | > avg_loss_1: 40.65609486897787 (+9.759362538655601)  > EPOCH: 1178/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:56:29)   --> TIME: 2023-10-20 14:56:55 -- STEP: 29/50 -- GLOBAL_STEP: 111930 | > loss_disc: 2.777308702468872 (2.434442610576235) | > loss_disc_real_0: 0.19286860525608063 (0.1476992035991159) | > loss_disc_real_1: 0.254737913608551 (0.21468128135492062) | > loss_disc_real_2: 0.20291942358016968 (0.22940197227330045) | > loss_disc_real_3: 0.23834708333015442 (0.23320733331914606) | > loss_disc_real_4: 0.21724267303943634 (0.21033059991896152) | > loss_disc_real_5: 0.2534100413322449 (0.21107679460968437) | > loss_0: 2.777308702468872 (2.434442610576235) | > grad_norm_0: tensor(949.5319, device='cuda:0') (tensor(673.0616, device='cuda:0')) | > loss_gen: 1.6590392589569092 (2.3319994992223285) | > loss_kl: 0.9930630326271057 (0.8068896860911928) | > loss_feat: 0.9142585396766663 (6.2882782851249495) | > loss_mel: 14.798990249633789 (19.26004393963978) | > loss_duration: 1.2912213802337646 (1.3276603674066478) | > loss_1: 19.656572341918945 (30.014871564404718) | > grad_norm_1: tensor(2750.2734, device='cuda:0') (tensor(27587.3516, device='cuda:0')) | > current_lr_0: 6.157424826035535e-05 | > current_lr_1: 6.16358571585668e-05 | > step_time: 0.6195 (0.6028012160597176) | > loader_time: 0.0236 (0.02142422774742389)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.966492176055908 (2.966492176055908) | > loss_disc_real_0: 0.185350239276886 (0.185350239276886) | > loss_disc_real_1: 0.202592670917511 (0.202592670917511) | > loss_disc_real_2: 0.27412906289100647 (0.27412906289100647) | > loss_disc_real_3: 0.23374983668327332 (0.23374983668327332) | > loss_disc_real_4: 0.31282901763916016 (0.31282901763916016) | > loss_disc_real_5: 0.36408093571662903 (0.36408093571662903) | > loss_0: 2.966492176055908 (2.966492176055908) | > loss_gen: 1.8659292459487915 (1.8659292459487915) | > loss_kl: 6.058927059173584 (6.058927059173584) | > loss_feat: 5.6070990562438965 (5.6070990562438965) | > loss_mel: 20.974334716796875 (20.974334716796875) | > loss_duration: 3.029815435409546 (3.029815435409546) | > loss_1: 37.53610610961914 (37.53610610961914)  --> STEP: 1 | > loss_disc: 2.997763156890869 (2.997763156890869) | > loss_disc_real_0: 0.2763364315032959 (0.2763364315032959) | > loss_disc_real_1: 0.3157122731208801 (0.3157122731208801) | > loss_disc_real_2: 0.25785505771636963 (0.25785505771636963) | > loss_disc_real_3: 0.34532487392425537 (0.34532487392425537) | > loss_disc_real_4: 0.28841233253479004 (0.28841233253479004) | > loss_disc_real_5: 0.39762184023857117 (0.39762184023857117) | > loss_0: 2.997763156890869 (2.997763156890869) | > loss_gen: 2.0558180809020996 (2.0558180809020996) | > loss_kl: 5.586798191070557 (5.586798191070557) | > loss_feat: 2.868180274963379 (2.868180274963379) | > loss_mel: 20.343585968017578 (20.343585968017578) | > loss_duration: 3.4105026721954346 (3.4105026721954346) | > loss_1: 34.26488494873047 (34.26488494873047)  --> STEP: 2 | > loss_disc: 2.9923558235168457 (2.9950594902038574) | > loss_disc_real_0: 0.2142547369003296 (0.24529558420181274) | > loss_disc_real_1: 0.27027300000190735 (0.29299263656139374) | > loss_disc_real_2: 0.2511753737926483 (0.25451521575450897) | > loss_disc_real_3: 0.2563011646270752 (0.3008130192756653) | > loss_disc_real_4: 0.27902039885520935 (0.2837163656949997) | > loss_disc_real_5: 0.26228460669517517 (0.32995322346687317) | > loss_0: 2.9923558235168457 (2.9950594902038574) | > loss_gen: 1.5491151809692383 (1.802466630935669) | > loss_kl: 6.243935585021973 (5.915366888046265) | > loss_feat: 0.07821955531835556 (1.4731999151408672) | > loss_mel: 1.7665648460388184 (11.055075407028198) | > loss_duration: 3.2624599933624268 (3.3364813327789307) | > loss_1: 12.90029525756836 (23.582590103149414)  --> STEP: 3 | > loss_disc: 3.101835012435913 (3.030651330947876) | > loss_disc_real_0: 0.23153753578662872 (0.24070956806341806) | > loss_disc_real_1: 0.2522207498550415 (0.2794020076592763) | > loss_disc_real_2: 0.302722692489624 (0.270584374666214) | > loss_disc_real_3: 0.22445367276668549 (0.275359903772672) | > loss_disc_real_4: 0.33537521958351135 (0.3009359836578369) | > loss_disc_real_5: 0.6363770961761475 (0.4320945143699646) | > loss_0: 3.101835012435913 (3.030651330947876) | > loss_gen: 2.077057123184204 (1.893996795018514) | > loss_kl: 3.1284985542297363 (4.986410776774089) | > loss_feat: 4.697815418243408 (2.548071749508381) | > loss_mel: 23.519290924072266 (15.209813912709555) | > loss_duration: 3.0037784576416016 (3.225580374399821) | > loss_1: 36.42643737792969 (27.863872528076172) --> EVAL PERFORMANCE | > avg_loader_time: 0.01119685173034668 (-0.011452833811442058) | > avg_loss_disc: 3.030651330947876 (+0.4158189296722412) | > avg_loss_disc_real_0: 0.24070956806341806 (-0.09600919485092166) | > avg_loss_disc_real_1: 0.2794020076592763 (-0.04725444316864014) | > avg_loss_disc_real_2: 0.270584374666214 (-0.04790183405081433) | > avg_loss_disc_real_3: 0.275359903772672 (-0.01760035753250122) | > avg_loss_disc_real_4: 0.3009359836578369 (+0.036380613843599974) | > avg_loss_disc_real_5: 0.4320945143699646 (+0.18051301439603168) | > avg_loss_0: 3.030651330947876 (+0.4158189296722412) | > avg_loss_gen: 1.893996795018514 (-1.336604913075765) | > avg_loss_kl: 4.986410776774089 (+0.344542821248373) | > avg_loss_feat: 2.548071749508381 (-3.579193226993084) | > avg_loss_mel: 15.209813912709555 (-8.213127930959066) | > avg_loss_duration: 3.225580374399821 (-0.007837613423665513) | > avg_loss_1: 27.863872528076172 (-12.792222340901695)  > EPOCH: 1179/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:57:24)   --> TIME: 2023-10-20 14:57:34 -- STEP: 9/50 -- GLOBAL_STEP: 111960 | > loss_disc: 2.580132484436035 (2.264361792140537) | > loss_disc_real_0: 0.19269642233848572 (0.13042364103926551) | > loss_disc_real_1: 0.29375138878822327 (0.20143865628374946) | > loss_disc_real_2: 0.3036152124404907 (0.20064911039339173) | > loss_disc_real_3: 0.36488816142082214 (0.2004570017258326) | > loss_disc_real_4: 0.25658443570137024 (0.20314192357990477) | > loss_disc_real_5: 0.2699621319770813 (0.19368328981929356) | > loss_0: 2.580132484436035 (2.264361792140537) | > grad_norm_0: tensor(418.3235, device='cuda:0') (tensor(435.5839, device='cuda:0')) | > loss_gen: 2.483785629272461 (2.439045137829251) | > loss_kl: 0.8087550401687622 (0.8176920016606649) | > loss_feat: 4.567704677581787 (7.227189434899224) | > loss_mel: 20.632164001464844 (22.053936110602486) | > loss_duration: 1.2608023881912231 (1.3031829065746732) | > loss_1: 29.753211975097656 (33.84104495578342) | > grad_norm_1: tensor(4442.7593, device='cuda:0') (tensor(17506.8125, device='cuda:0')) | > current_lr_0: 6.151270094409495e-05 | > current_lr_1: 6.157424826035535e-05 | > step_time: 0.4771 (0.5261269940270318) | > loader_time: 0.0154 (0.015266630384657118)  --> TIME: 2023-10-20 14:57:52 -- STEP: 39/50 -- GLOBAL_STEP: 111990 | > loss_disc: 3.063049077987671 (2.50614603360494) | > loss_disc_real_0: 0.27871227264404297 (0.16473789981160408) | > loss_disc_real_1: 0.2558829188346863 (0.2206138756412726) | > loss_disc_real_2: 0.25207167863845825 (0.22575154279669127) | > loss_disc_real_3: 0.24554291367530823 (0.23678880652938133) | > loss_disc_real_4: 0.2885061502456665 (0.2270122200059585) | > loss_disc_real_5: 0.2567810118198395 (0.2373116668791343) | > loss_0: 3.063049077987671 (2.50614603360494) | > grad_norm_0: tensor(565.2260, device='cuda:0') (tensor(554.4745, device='cuda:0')) | > loss_gen: 1.5252184867858887 (2.1866415005463815) | > loss_kl: 0.4927999675273895 (0.841848496443186) | > loss_feat: 0.13604526221752167 (4.8828162656953715) | > loss_mel: 1.9260380268096924 (18.492307470395016) | > loss_duration: 1.3556623458862305 (1.3108452252852612) | > loss_1: 5.435764312744141 (27.714459125812237) | > grad_norm_1: tensor(16584.1680, device='cuda:0') (tensor(17546.3633, device='cuda:0')) | > current_lr_0: 6.151270094409495e-05 | > current_lr_1: 6.157424826035535e-05 | > step_time: 0.4752 (0.5606598548400097) | > loader_time: 0.0036 (0.015908987094194464)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5837936401367188 (2.5837936401367188) | > loss_disc_real_0: 0.03792308643460274 (0.03792308643460274) | > loss_disc_real_1: 0.23916757106781006 (0.23916757106781006) | > loss_disc_real_2: 0.2088182121515274 (0.2088182121515274) | > loss_disc_real_3: 0.25371989607810974 (0.25371989607810974) | > loss_disc_real_4: 0.17901644110679626 (0.17901644110679626) | > loss_disc_real_5: 0.20099639892578125 (0.20099639892578125) | > loss_0: 2.5837936401367188 (2.5837936401367188) | > loss_gen: 1.6171131134033203 (1.6171131134033203) | > loss_kl: 6.416064262390137 (6.416064262390137) | > loss_feat: 2.529667377471924 (2.529667377471924) | > loss_mel: 22.983598709106445 (22.983598709106445) | > loss_duration: 3.1773078441619873 (3.1773078441619873) | > loss_1: 36.723751068115234 (36.723751068115234)  --> STEP: 1 | > loss_disc: 2.5676960945129395 (2.5676960945129395) | > loss_disc_real_0: 0.24101939797401428 (0.24101939797401428) | > loss_disc_real_1: 0.162518709897995 (0.162518709897995) | > loss_disc_real_2: 0.19457978010177612 (0.19457978010177612) | > loss_disc_real_3: 0.3201882243156433 (0.3201882243156433) | > loss_disc_real_4: 0.33107635378837585 (0.33107635378837585) | > loss_disc_real_5: 0.23409481346607208 (0.23409481346607208) | > loss_0: 2.5676960945129395 (2.5676960945129395) | > loss_gen: 2.2335474491119385 (2.2335474491119385) | > loss_kl: 5.48073148727417 (5.48073148727417) | > loss_feat: 6.206331729888916 (6.206331729888916) | > loss_mel: 23.540138244628906 (23.540138244628906) | > loss_duration: 3.46183705329895 (3.46183705329895) | > loss_1: 40.92258834838867 (40.92258834838867)  --> STEP: 2 | > loss_disc: 3.0037741661071777 (2.7857351303100586) | > loss_disc_real_0: 0.20403242111206055 (0.22252590954303741) | > loss_disc_real_1: 0.25287503004074097 (0.20769686996936798) | > loss_disc_real_2: 0.3228551149368286 (0.25871744751930237) | > loss_disc_real_3: 0.2464623749256134 (0.28332529962062836) | > loss_disc_real_4: 0.30452579259872437 (0.3178010731935501) | > loss_disc_real_5: 0.25706467032432556 (0.24557974189519882) | > loss_0: 3.0037741661071777 (2.7857351303100586) | > loss_gen: 1.6045799255371094 (1.919063687324524) | > loss_kl: 6.250305652618408 (5.865518569946289) | > loss_feat: 0.047956157475709915 (3.127143943682313) | > loss_mel: 3.7591545581817627 (13.649646401405334) | > loss_duration: 3.3054144382476807 (3.3836257457733154) | > loss_1: 14.96741008758545 (27.94499921798706)  --> STEP: 3 | > loss_disc: 3.016883134841919 (2.862784465154012) | > loss_disc_real_0: 0.2030535340309143 (0.21603511770566305) | > loss_disc_real_1: 0.25296148657798767 (0.22278507550557455) | > loss_disc_real_2: 0.32282257080078125 (0.280085821946462) | > loss_disc_real_3: 0.24652735888957977 (0.2710593193769455) | > loss_disc_real_4: 0.30447912216186523 (0.31336042284965515) | > loss_disc_real_5: 0.257017582654953 (0.24939235548178354) | > loss_0: 3.016883134841919 (2.862784465154012) | > loss_gen: 1.592419981956482 (1.8101824522018433) | > loss_kl: 3.2040934562683105 (4.978376865386963) | > loss_feat: 0.034157220274209976 (2.0961483692129455) | > loss_mel: 2.086496114730835 (9.795262972513834) | > loss_duration: 3.082796573638916 (3.283349355061849) | > loss_1: 9.999963760375977 (21.9633207321167) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_112000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.690946102142334 (2.8198248744010925) | > loss_disc_real_0: 0.14015120267868042 (0.1970641389489174) | > loss_disc_real_1: 0.14430654048919678 (0.2031654417514801) | > loss_disc_real_2: 0.17543663084506989 (0.25392352417111397) | > loss_disc_real_3: 0.31102049350738525 (0.28104961290955544) | > loss_disc_real_4: 0.3218032717704773 (0.3154711350798607) | > loss_disc_real_5: 0.48027661442756653 (0.3071134202182293) | > loss_0: 2.690946102142334 (2.8198248744010925) | > loss_gen: 2.358224391937256 (1.9471929371356964) | > loss_kl: 6.439362049102783 (5.343623161315918) | > loss_feat: 5.564033508300781 (2.9631196539849043) | > loss_mel: 23.279922485351562 (13.166427850723267) | > loss_duration: 3.173206329345703 (3.2558135986328125) | > loss_1: 40.81474685668945 (26.676177263259888)  --> STEP: 1 | > loss_disc: 2.466832399368286 (2.749226379394531) | > loss_disc_real_0: 0.12260567396879196 (0.1821724459528923) | > loss_disc_real_1: 0.2877725064754486 (0.22008685469627381) | > loss_disc_real_2: 0.29345256090164185 (0.26182933151721954) | > loss_disc_real_3: 0.32149600982666016 (0.2891388922929764) | > loss_disc_real_4: 0.34740638732910156 (0.32185818552970885) | > loss_disc_real_5: 0.29498928785324097 (0.3046885937452316) | > loss_0: 2.466832399368286 (2.749226379394531) | > loss_gen: 2.9747536182403564 (2.1527050733566284) | > loss_kl: 5.62893009185791 (5.400684547424317) | > loss_feat: 8.190184593200684 (4.00853264182806) | > loss_mel: 23.43233299255371 (15.219608879089355) | > loss_duration: 3.503399610519409 (3.3053308010101317) | > loss_1: 43.7296028137207 (30.08686237335205)  --> STEP: 2 | > loss_disc: 3.0196990966796875 (2.794305165608724) | > loss_disc_real_0: 0.27710211277008057 (0.19799405708909035) | > loss_disc_real_1: 0.2514967620372772 (0.2253218392531077) | > loss_disc_real_2: 0.3261701762676239 (0.27255280564228695) | > loss_disc_real_3: 0.25034892559051514 (0.2826738978425662) | > loss_disc_real_4: 0.30420154333114624 (0.3189154118299484) | > loss_disc_real_5: 0.25689539313316345 (0.29672306030988693) | > loss_0: 3.0196990966796875 (2.794305165608724) | > loss_gen: 1.6656692028045654 (2.071532428264618) | > loss_kl: 6.220542907714844 (5.537327607472737) | > loss_feat: 0.041514962911605835 (3.3473630286753178) | > loss_mel: 2.1648125648498535 (13.043809493382772) | > loss_duration: 3.368805170059204 (3.3159098625183105) | > loss_1: 13.461344718933105 (27.315942764282227)  --> STEP: 3 | > loss_disc: 2.8289966583251953 (2.7992610931396484) | > loss_disc_real_0: 0.2063639760017395 (0.19918975979089737) | > loss_disc_real_1: 0.2487315535545349 (0.2286660841533116) | > loss_disc_real_2: 0.2876034379005432 (0.274702895964895) | > loss_disc_real_3: 0.29382798075675964 (0.2842673382588795) | > loss_disc_real_4: 0.37586408853530884 (0.32705093707357136) | > loss_disc_real_5: 0.2915034890174866 (0.29597740726811544) | > loss_0: 2.8289966583251953 (2.7992610931396484) | > loss_gen: 2.073340892791748 (2.071790780339922) | > loss_kl: 2.933666229248047 (5.165375982012067) | > loss_feat: 2.323517084121704 (3.2010993223105157) | > loss_mel: 18.64910888671875 (13.844566549573626) | > loss_duration: 3.0811069011688232 (3.2823665823255266) | > loss_1: 29.060739517211914 (27.56519944327218) --> EVAL PERFORMANCE | > avg_loader_time: 0.48669794627598356 (+0.4755010945456369) | > avg_loss_disc: 2.7992610931396484 (-0.23139023780822754) | > avg_loss_disc_real_0: 0.19918975979089737 (-0.04151980827252069) | > avg_loss_disc_real_1: 0.2286660841533116 (-0.0507359235059647) | > avg_loss_disc_real_2: 0.274702895964895 (+0.0041185212986810105) | > avg_loss_disc_real_3: 0.2842673382588795 (+0.00890743448620751) | > avg_loss_disc_real_4: 0.32705093707357136 (+0.026114953415734443) | > avg_loss_disc_real_5: 0.29597740726811544 (-0.13611710710184916) | > avg_loss_0: 2.7992610931396484 (-0.23139023780822754) | > avg_loss_gen: 2.071790780339922 (+0.1777939853214081) | > avg_loss_kl: 5.165375982012067 (+0.17896520523797843) | > avg_loss_feat: 3.2010993223105157 (+0.6530275728021349) | > avg_loss_mel: 13.844566549573626 (-1.3652473631359285) | > avg_loss_duration: 3.2823665823255266 (+0.05678620792570577) | > avg_loss_1: 27.56519944327218 (-0.29867308480399046)  > EPOCH: 1180/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:58:24)   --> TIME: 2023-10-20 14:58:49 -- STEP: 19/50 -- GLOBAL_STEP: 112020 | > loss_disc: 2.8645803928375244 (2.331075436190555) | > loss_disc_real_0: 0.33890825510025024 (0.1471001338703852) | > loss_disc_real_1: 0.2747316062450409 (0.21518673943845848) | > loss_disc_real_2: 0.24703988432884216 (0.2315683137429388) | > loss_disc_real_3: 0.3954865634441376 (0.2292362926037688) | > loss_disc_real_4: 0.29771944880485535 (0.22128558551010333) | > loss_disc_real_5: 0.3190092146396637 (0.19382920047562374) | > loss_0: 2.8645803928375244 (2.331075436190555) | > grad_norm_0: tensor(853.4858, device='cuda:0') (tensor(652.6285, device='cuda:0')) | > loss_gen: 2.243945360183716 (2.426249202929045) | > loss_kl: 0.8555044531822205 (0.803065593305387) | > loss_feat: 2.5754308700561523 (6.300095033488776) | > loss_mel: 20.488386154174805 (21.441607123927067) | > loss_duration: 1.3949156999588013 (1.3528673146900378) | > loss_1: 27.558183670043945 (32.32388406050833) | > grad_norm_1: tensor(2791.0774, device='cuda:0') (tensor(24292.3691, device='cuda:0')) | > current_lr_0: 6.145121514823058e-05 | > current_lr_1: 6.151270094409495e-05 | > step_time: 0.545 (0.5130333649484735) | > loader_time: 0.006 (0.010177072725797954)  --> TIME: 2023-10-20 14:59:09 -- STEP: 49/50 -- GLOBAL_STEP: 112050 | > loss_disc: 2.237470865249634 (2.4011095421654836) | > loss_disc_real_0: 0.08927823603153229 (0.13672046684564984) | > loss_disc_real_1: 0.19849875569343567 (0.2102145366370678) | > loss_disc_real_2: 0.21431702375411987 (0.21541716082363713) | > loss_disc_real_3: 0.1599172055721283 (0.23247583841486852) | > loss_disc_real_4: 0.197570338845253 (0.21373989005402036) | > loss_disc_real_5: 0.18957731127738953 (0.21139967791279968) | > loss_0: 2.237470865249634 (2.4011095421654836) | > grad_norm_0: tensor(404.8629, device='cuda:0') (tensor(553.5913, device='cuda:0')) | > loss_gen: 2.330742359161377 (2.2912089313779553) | > loss_kl: 0.7793872952461243 (0.7832242505890983) | > loss_feat: 6.197682857513428 (5.866817377963844) | > loss_mel: 27.002477645874023 (20.72516395121205) | > loss_duration: 1.4611916542053223 (1.315732466931246) | > loss_1: 37.771484375 (30.98214709028906) | > grad_norm_1: tensor(25351.8945, device='cuda:0') (tensor(21884.8594, device='cuda:0')) | > current_lr_0: 6.145121514823058e-05 | > current_lr_1: 6.151270094409495e-05 | > step_time: 1.1318 (0.5578409944261823) | > loader_time: 1.117 (0.0362722533089774)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2593064308166504 (3.2593064308166504) | > loss_disc_real_0: 0.4806424379348755 (0.4806424379348755) | > loss_disc_real_1: 0.33442050218582153 (0.33442050218582153) | > loss_disc_real_2: 0.37377938628196716 (0.37377938628196716) | > loss_disc_real_3: 0.48663586378097534 (0.48663586378097534) | > loss_disc_real_4: 0.45300978422164917 (0.45300978422164917) | > loss_disc_real_5: 0.4791446924209595 (0.4791446924209595) | > loss_0: 3.2593064308166504 (3.2593064308166504) | > loss_gen: 4.307470321655273 (4.307470321655273) | > loss_kl: 6.157609462738037 (6.157609462738037) | > loss_feat: 8.453397750854492 (8.453397750854492) | > loss_mel: 22.370824813842773 (22.370824813842773) | > loss_duration: 3.0800845623016357 (3.0800845623016357) | > loss_1: 44.36939239501953 (44.36939239501953)  --> STEP: 1 | > loss_disc: 3.351510524749756 (3.351510524749756) | > loss_disc_real_0: 0.548774242401123 (0.548774242401123) | > loss_disc_real_1: 0.3621561825275421 (0.3621561825275421) | > loss_disc_real_2: 0.4433605968952179 (0.4433605968952179) | > loss_disc_real_3: 0.4892520308494568 (0.4892520308494568) | > loss_disc_real_4: 0.5514055490493774 (0.5514055490493774) | > loss_disc_real_5: 0.30721473693847656 (0.30721473693847656) | > loss_0: 3.351510524749756 (3.351510524749756) | > loss_gen: 3.9623022079467773 (3.9623022079467773) | > loss_kl: 5.248243808746338 (5.248243808746338) | > loss_feat: 8.412437438964844 (8.412437438964844) | > loss_mel: 26.80864143371582 (26.80864143371582) | > loss_duration: 3.464700698852539 (3.464700698852539) | > loss_1: 47.896324157714844 (47.896324157714844)  --> STEP: 2 | > loss_disc: 2.737200975418091 (3.0443557500839233) | > loss_disc_real_0: 0.2539860010147095 (0.40138012170791626) | > loss_disc_real_1: 0.23754379153251648 (0.2998499870300293) | > loss_disc_real_2: 0.23489205539226532 (0.3391263261437416) | > loss_disc_real_3: 0.25376036763191223 (0.3715061992406845) | > loss_disc_real_4: 0.26187148690223694 (0.4066385179758072) | > loss_disc_real_5: 0.2513613998889923 (0.27928806841373444) | > loss_0: 2.737200975418091 (3.0443557500839233) | > loss_gen: 2.0858590602874756 (3.0240806341171265) | > loss_kl: 6.59051513671875 (5.919379472732544) | > loss_feat: 1.7575116157531738 (5.084974527359009) | > loss_mel: 11.842635154724121 (19.32563829421997) | > loss_duration: 3.4247331619262695 (3.4447169303894043) | > loss_1: 25.701255798339844 (36.798789978027344)  --> STEP: 3 | > loss_disc: 2.8800978660583496 (2.989603122075399) | > loss_disc_real_0: 0.1386224329471588 (0.31379422545433044) | > loss_disc_real_1: 0.3225967586040497 (0.30743224422136944) | > loss_disc_real_2: 0.26459935307502747 (0.31428400178750354) | > loss_disc_real_3: 0.2407323122024536 (0.32791490356127423) | > loss_disc_real_4: 0.38854530453681946 (0.40060744682947796) | > loss_disc_real_5: 0.43234890699386597 (0.33030834794044495) | > loss_0: 2.8800978660583496 (2.989603122075399) | > loss_gen: 2.191585063934326 (2.74658211072286) | > loss_kl: 3.0098965167999268 (4.949551820755005) | > loss_feat: 4.159026622772217 (4.776325225830078) | > loss_mel: 19.182510375976562 (19.277928988138836) | > loss_duration: 3.0599493980407715 (3.3164610862731934) | > loss_1: 31.602968215942383 (35.06684939066569) --> EVAL PERFORMANCE | > avg_loader_time: 0.019359668095906574 (-0.467338278180077) | > avg_loss_disc: 2.989603122075399 (+0.19034202893575047) | > avg_loss_disc_real_0: 0.31379422545433044 (+0.11460446566343307) | > avg_loss_disc_real_1: 0.30743224422136944 (+0.07876616006805784) | > avg_loss_disc_real_2: 0.31428400178750354 (+0.03958110582260854) | > avg_loss_disc_real_3: 0.32791490356127423 (+0.04364756530239472) | > avg_loss_disc_real_4: 0.40060744682947796 (+0.07355650975590661) | > avg_loss_disc_real_5: 0.33030834794044495 (+0.0343309406723295) | > avg_loss_0: 2.989603122075399 (+0.19034202893575047) | > avg_loss_gen: 2.74658211072286 (+0.6747913303829378) | > avg_loss_kl: 4.949551820755005 (-0.21582416125706239) | > avg_loss_feat: 4.776325225830078 (+1.5752259035195624) | > avg_loss_mel: 19.277928988138836 (+5.43336243856521) | > avg_loss_duration: 3.3164610862731934 (+0.03409450394766678) | > avg_loss_1: 35.06684939066569 (+7.501649947393506)  > EPOCH: 1181/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 14:59:37)   --> TIME: 2023-10-20 15:00:01 -- STEP: 29/50 -- GLOBAL_STEP: 112080 | > loss_disc: 2.354454517364502 (2.6246808767318726) | > loss_disc_real_0: 0.1562744677066803 (0.16445473751759734) | > loss_disc_real_1: 0.2538425326347351 (0.24765361100435257) | > loss_disc_real_2: 0.20631997287273407 (0.2353789703599338) | > loss_disc_real_3: 0.13728228211402893 (0.2601743800372912) | > loss_disc_real_4: 0.10963522642850876 (0.2567297102048479) | > loss_disc_real_5: 0.0926700010895729 (0.25477827083447885) | > loss_0: 2.354454517364502 (2.6246808767318726) | > grad_norm_0: tensor(399.0530, device='cuda:0') (tensor(495.1602, device='cuda:0')) | > loss_gen: 1.9555398225784302 (2.1795701569524306) | > loss_kl: 0.8003930449485779 (0.8065525766076713) | > loss_feat: 5.911986351013184 (5.069183920221082) | > loss_mel: 23.085201263427734 (19.016210214845067) | > loss_duration: 1.3125114440917969 (1.3290552188610203) | > loss_1: 33.06563186645508 (28.400571806677455) | > grad_norm_1: tensor(6995.6128, device='cuda:0') (tensor(16797.7051, device='cuda:0')) | > current_lr_0: 6.138979081126878e-05 | > current_lr_1: 6.145121514823058e-05 | > step_time: 0.4689 (0.6420905261204161) | > loader_time: 0.005 (0.02237013290668356)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.699012517929077 (2.699012517929077) | > loss_disc_real_0: 0.16557733714580536 (0.16557733714580536) | > loss_disc_real_1: 0.23126985132694244 (0.23126985132694244) | > loss_disc_real_2: 0.1844869703054428 (0.1844869703054428) | > loss_disc_real_3: 0.2651117146015167 (0.2651117146015167) | > loss_disc_real_4: 0.21768422424793243 (0.21768422424793243) | > loss_disc_real_5: 0.24851958453655243 (0.24851958453655243) | > loss_0: 2.699012517929077 (2.699012517929077) | > loss_gen: 1.7108111381530762 (1.7108111381530762) | > loss_kl: 5.77728796005249 (5.77728796005249) | > loss_feat: 1.296187400817871 (1.296187400817871) | > loss_mel: 16.22357749938965 (16.22357749938965) | > loss_duration: 2.9761147499084473 (2.9761147499084473) | > loss_1: 27.983978271484375 (27.983978271484375)  --> STEP: 1 | > loss_disc: 2.3055260181427 (2.3055260181427) | > loss_disc_real_0: 0.11419297754764557 (0.11419297754764557) | > loss_disc_real_1: 0.24501445889472961 (0.24501445889472961) | > loss_disc_real_2: 0.21268746256828308 (0.21268746256828308) | > loss_disc_real_3: 0.2455405443906784 (0.2455405443906784) | > loss_disc_real_4: 0.1804160475730896 (0.1804160475730896) | > loss_disc_real_5: 0.15626201033592224 (0.15626201033592224) | > loss_0: 2.3055260181427 (2.3055260181427) | > loss_gen: 2.0432255268096924 (2.0432255268096924) | > loss_kl: 5.380167484283447 (5.380167484283447) | > loss_feat: 4.228883266448975 (4.228883266448975) | > loss_mel: 20.887531280517578 (20.887531280517578) | > loss_duration: 3.5020973682403564 (3.5020973682403564) | > loss_1: 36.04190444946289 (36.04190444946289)  --> STEP: 2 | > loss_disc: 2.504164695739746 (2.404845356941223) | > loss_disc_real_0: 0.1985410749912262 (0.15636702626943588) | > loss_disc_real_1: 0.23470591008663177 (0.2398601844906807) | > loss_disc_real_2: 0.18828138709068298 (0.20048442482948303) | > loss_disc_real_3: 0.20778392255306244 (0.22666223347187042) | > loss_disc_real_4: 0.4159785211086273 (0.29819728434085846) | > loss_disc_real_5: 0.26653340458869934 (0.2113977074623108) | > loss_0: 2.504164695739746 (2.404845356941223) | > loss_gen: 2.5955007076263428 (2.3193631172180176) | > loss_kl: 5.649084568023682 (5.5146260261535645) | > loss_feat: 6.734499931335449 (5.481691598892212) | > loss_mel: 21.447973251342773 (21.167752265930176) | > loss_duration: 3.3164241313934326 (3.4092607498168945) | > loss_1: 39.74348449707031 (37.8926944732666)  --> STEP: 3 | > loss_disc: 3.032236099243164 (2.6139756043752036) | > loss_disc_real_0: 0.1693115532398224 (0.16068186859289804) | > loss_disc_real_1: 0.2524384558200836 (0.24405294160048166) | > loss_disc_real_2: 0.28511378169059753 (0.22869421044985452) | > loss_disc_real_3: 0.2802720367908478 (0.24453216791152954) | > loss_disc_real_4: 0.23974601924419403 (0.27871352930863696) | > loss_disc_real_5: 0.28006771206855774 (0.23428770899772644) | > loss_0: 3.032236099243164 (2.6139756043752036) | > loss_gen: 1.4933973550796509 (2.0440411965052285) | > loss_kl: 2.9389357566833496 (4.656062602996826) | > loss_feat: 0.07361625134944916 (3.678999816377958) | > loss_mel: 2.273914098739624 (14.869806210199991) | > loss_duration: 3.020773410797119 (3.279764970143636) | > loss_1: 9.800636291503906 (28.528675079345703) --> EVAL PERFORMANCE | > avg_loader_time: 0.004320780436197917 (-0.015038887659708657) | > avg_loss_disc: 2.6139756043752036 (-0.3756275177001953) | > avg_loss_disc_real_0: 0.16068186859289804 (-0.1531123568614324) | > avg_loss_disc_real_1: 0.24405294160048166 (-0.06337930262088778) | > avg_loss_disc_real_2: 0.22869421044985452 (-0.08558979133764902) | > avg_loss_disc_real_3: 0.24453216791152954 (-0.08338273564974469) | > avg_loss_disc_real_4: 0.27871352930863696 (-0.121893917520841) | > avg_loss_disc_real_5: 0.23428770899772644 (-0.0960206389427185) | > avg_loss_0: 2.6139756043752036 (-0.3756275177001953) | > avg_loss_gen: 2.0440411965052285 (-0.7025409142176313) | > avg_loss_kl: 4.656062602996826 (-0.2934892177581787) | > avg_loss_feat: 3.678999816377958 (-1.0973254094521203) | > avg_loss_mel: 14.869806210199991 (-4.4081227779388445) | > avg_loss_duration: 3.279764970143636 (-0.036696116129557144) | > avg_loss_1: 28.528675079345703 (-6.538174311319985)  > EPOCH: 1182/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:00:28)   --> TIME: 2023-10-20 15:00:41 -- STEP: 9/50 -- GLOBAL_STEP: 112110 | > loss_disc: 2.3174400329589844 (2.447632418738471) | > loss_disc_real_0: 0.15808245539665222 (0.19976722304191855) | > loss_disc_real_1: 0.25113096833229065 (0.2395770466989941) | > loss_disc_real_2: 0.21161185204982758 (0.23019441217184067) | > loss_disc_real_3: 0.2770724892616272 (0.27152163576748634) | > loss_disc_real_4: 0.18405014276504517 (0.17629271994034448) | > loss_disc_real_5: 0.17054441571235657 (0.19627870888345772) | > loss_0: 2.3174400329589844 (2.447632418738471) | > grad_norm_0: tensor(509.6379, device='cuda:0') (tensor(730.5121, device='cuda:0')) | > loss_gen: 2.4822092056274414 (2.416725900438097) | > loss_kl: 0.6431636810302734 (0.9031271537144979) | > loss_feat: 3.8728537559509277 (5.807741229732831) | > loss_mel: 22.750713348388672 (20.836228211720783) | > loss_duration: 1.3074978590011597 (1.3374551269743178) | > loss_1: 31.05643653869629 (31.30127737257216) | > grad_norm_1: tensor(2801.3682, device='cuda:0') (tensor(26569.3535, device='cuda:0')) | > current_lr_0: 6.132842787177753e-05 | > current_lr_1: 6.138979081126878e-05 | > step_time: 0.7214 (0.6985190444522433) | > loader_time: 0.028 (0.018920315636528864)  --> TIME: 2023-10-20 15:00:59 -- STEP: 39/50 -- GLOBAL_STEP: 112140 | > loss_disc: 2.622939348220825 (2.461525314893478) | > loss_disc_real_0: 0.20510727167129517 (0.14289018058050895) | > loss_disc_real_1: 0.27187347412109375 (0.2206750057446651) | > loss_disc_real_2: 0.21864835917949677 (0.22585298230823797) | > loss_disc_real_3: 0.3056466579437256 (0.23973927217034194) | > loss_disc_real_4: 0.3581043779850006 (0.20758371212734625) | > loss_disc_real_5: 0.36260339617729187 (0.21916784264911443) | > loss_0: 2.622939348220825 (2.461525314893478) | > grad_norm_0: tensor(943.6672, device='cuda:0') (tensor(623.8655, device='cuda:0')) | > loss_gen: 2.5311670303344727 (2.2770331700642905) | > loss_kl: 0.5762807130813599 (0.8842512155190493) | > loss_feat: 2.757190465927124 (5.50744783715942) | > loss_mel: 20.57013511657715 (19.55600633071019) | > loss_duration: 1.3745391368865967 (1.3206312992633917) | > loss_1: 27.809310913085938 (29.545369845170242) | > grad_norm_1: tensor(4867.5347, device='cuda:0') (tensor(23919.6035, device='cuda:0')) | > current_lr_0: 6.132842787177753e-05 | > current_lr_1: 6.138979081126878e-05 | > step_time: 0.344 (0.6081432195810171) | > loader_time: 0.0141 (0.019302392617250103)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.841179132461548 (2.841179132461548) | > loss_disc_real_0: 0.18151722848415375 (0.18151722848415375) | > loss_disc_real_1: 0.29480934143066406 (0.29480934143066406) | > loss_disc_real_2: 0.25361788272857666 (0.25361788272857666) | > loss_disc_real_3: 0.2303757518529892 (0.2303757518529892) | > loss_disc_real_4: 0.2634594142436981 (0.2634594142436981) | > loss_disc_real_5: 0.2564547061920166 (0.2564547061920166) | > loss_0: 2.841179132461548 (2.841179132461548) | > loss_gen: 1.8471462726593018 (1.8471462726593018) | > loss_kl: 5.946293830871582 (5.946293830871582) | > loss_feat: 2.0513322353363037 (2.0513322353363037) | > loss_mel: 19.348276138305664 (19.348276138305664) | > loss_duration: 3.0738515853881836 (3.0738515853881836) | > loss_1: 32.26689910888672 (32.26689910888672)  --> STEP: 1 | > loss_disc: 2.6668508052825928 (2.6668508052825928) | > loss_disc_real_0: 0.07797623425722122 (0.07797623425722122) | > loss_disc_real_1: 0.3303764760494232 (0.3303764760494232) | > loss_disc_real_2: 0.30557164549827576 (0.30557164549827576) | > loss_disc_real_3: 0.32813403010368347 (0.32813403010368347) | > loss_disc_real_4: 0.3799830675125122 (0.3799830675125122) | > loss_disc_real_5: 0.26955798268318176 (0.26955798268318176) | > loss_0: 2.6668508052825928 (2.6668508052825928) | > loss_gen: 3.058884382247925 (3.058884382247925) | > loss_kl: 5.575776100158691 (5.575776100158691) | > loss_feat: 8.362150192260742 (8.362150192260742) | > loss_mel: 22.51828956604004 (22.51828956604004) | > loss_duration: 3.3823282718658447 (3.3823282718658447) | > loss_1: 42.89742660522461 (42.89742660522461)  --> STEP: 2 | > loss_disc: 2.8010733127593994 (2.733962059020996) | > loss_disc_real_0: 0.34458237886428833 (0.21127930656075478) | > loss_disc_real_1: 0.20584702491760254 (0.2681117504835129) | > loss_disc_real_2: 0.3689608871936798 (0.3372662663459778) | > loss_disc_real_3: 0.2667695879936218 (0.29745180904865265) | > loss_disc_real_4: 0.33071383833885193 (0.35534845292568207) | > loss_disc_real_5: 0.276137113571167 (0.2728475481271744) | > loss_0: 2.8010733127593994 (2.733962059020996) | > loss_gen: 2.613705635070801 (2.836295008659363) | > loss_kl: 5.5108418464660645 (5.543308973312378) | > loss_feat: 5.425765037536621 (6.893957614898682) | > loss_mel: 25.632537841796875 (24.075413703918457) | > loss_duration: 3.3269131183624268 (3.3546206951141357) | > loss_1: 42.509761810302734 (42.70359420776367)  --> STEP: 3 | > loss_disc: 2.904567241668701 (2.790830453236898) | > loss_disc_real_0: 0.7038177251815796 (0.37545877943436307) | > loss_disc_real_1: 0.25693708658218384 (0.2643868625164032) | > loss_disc_real_2: 0.12608449161052704 (0.2668723414341609) | > loss_disc_real_3: 0.22427895665168762 (0.2730608582496643) | > loss_disc_real_4: 0.13280777633190155 (0.2811682273944219) | > loss_disc_real_5: 0.2869742810726166 (0.27755645910898846) | > loss_0: 2.904567241668701 (2.790830453236898) | > loss_gen: 2.3492250442504883 (2.6739383538564048) | > loss_kl: 3.1561810970306396 (4.747599681218465) | > loss_feat: 5.393939971923828 (6.3939517339070635) | > loss_mel: 18.9675235748291 (22.372783660888672) | > loss_duration: 3.010856866836548 (3.24003275235494) | > loss_1: 32.87772750854492 (39.428305308024086) --> EVAL PERFORMANCE | > avg_loader_time: 0.006570339202880859 (+0.0022495587666829424) | > avg_loss_disc: 2.790830453236898 (+0.17685484886169434) | > avg_loss_disc_real_0: 0.37545877943436307 (+0.21477691084146502) | > avg_loss_disc_real_1: 0.2643868625164032 (+0.02033392091592154) | > avg_loss_disc_real_2: 0.2668723414341609 (+0.03817813098430636) | > avg_loss_disc_real_3: 0.2730608582496643 (+0.028528690338134766) | > avg_loss_disc_real_4: 0.2811682273944219 (+0.002454698085784912) | > avg_loss_disc_real_5: 0.27755645910898846 (+0.04326875011126202) | > avg_loss_0: 2.790830453236898 (+0.17685484886169434) | > avg_loss_gen: 2.6739383538564048 (+0.6298971573511762) | > avg_loss_kl: 4.747599681218465 (+0.0915370782216387) | > avg_loss_feat: 6.3939517339070635 (+2.7149519175291057) | > avg_loss_mel: 22.372783660888672 (+7.502977450688681) | > avg_loss_duration: 3.24003275235494 (-0.03973221778869629) | > avg_loss_1: 39.428305308024086 (+10.899630228678383)  > EPOCH: 1183/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:01:22)   --> TIME: 2023-10-20 15:01:38 -- STEP: 19/50 -- GLOBAL_STEP: 112170 | > loss_disc: 1.5746848583221436 (2.4031785412838587) | > loss_disc_real_0: 0.016406619921326637 (0.11135276024670977) | > loss_disc_real_1: 0.06902797520160675 (0.2140989695724688) | > loss_disc_real_2: 0.0811036080121994 (0.19404257481035433) | > loss_disc_real_3: 0.028615502640604973 (0.23474729639527045) | > loss_disc_real_4: 0.06806451827287674 (0.2461928262522346) | > loss_disc_real_5: 0.019950874149799347 (0.2486190413566012) | > loss_0: 1.5746848583221436 (2.4031785412838587) | > grad_norm_0: tensor(343.4410, device='cuda:0') (tensor(546.6259, device='cuda:0')) | > loss_gen: 2.2623119354248047 (2.350538366719296) | > loss_kl: 0.7416771054267883 (0.7694649366956008) | > loss_feat: 13.575511932373047 (5.51437002734134) | > loss_mel: 27.457483291625977 (19.187006260219373) | > loss_duration: 1.3903241157531738 (1.3458081107390554) | > loss_1: 45.427310943603516 (29.167188042088558) | > grad_norm_1: tensor(6731.0986, device='cuda:0') (tensor(21470.1191, device='cuda:0')) | > current_lr_0: 6.126712626838618e-05 | > current_lr_1: 6.132842787177753e-05 | > step_time: 0.5204 (0.53928121767546) | > loader_time: 0.0061 (0.01871858145061292)  --> TIME: 2023-10-20 15:02:03 -- STEP: 49/50 -- GLOBAL_STEP: 112200 | > loss_disc: 2.925264358520508 (2.4043510994132684) | > loss_disc_real_0: 0.21209387481212616 (0.11783426156153484) | > loss_disc_real_1: 0.25303763151168823 (0.21974383978819362) | > loss_disc_real_2: 0.2765388786792755 (0.2097988702280789) | > loss_disc_real_3: 0.22938397526741028 (0.22554374174499997) | > loss_disc_real_4: 0.2643130123615265 (0.23181750655782465) | > loss_disc_real_5: 0.2654353976249695 (0.23104194430064182) | > loss_0: 2.925264358520508 (2.4043510994132684) | > grad_norm_0: tensor(1390.9282, device='cuda:0') (tensor(739.7734, device='cuda:0')) | > loss_gen: 1.6026904582977295 (2.3242973064889725) | > loss_kl: 0.540940523147583 (0.7672246074189946) | > loss_feat: 0.19733694195747375 (5.735810459268336) | > loss_mel: 2.2987749576568604 (19.93984064763906) | > loss_duration: 1.442991018295288 (1.3180081357761302) | > loss_1: 6.082734107971191 (30.085181450357243) | > grad_norm_1: tensor(55697.2109, device='cuda:0') (tensor(19537.0469, device='cuda:0')) | > current_lr_0: 6.126712626838618e-05 | > current_lr_1: 6.132842787177753e-05 | > step_time: 1.2858 (0.6797386772778568) | > loader_time: 0.5695 (0.03594887986475108)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.780379056930542 (2.780379056930542) | > loss_disc_real_0: 0.2727225422859192 (0.2727225422859192) | > loss_disc_real_1: 0.21250218152999878 (0.21250218152999878) | > loss_disc_real_2: 0.20032593607902527 (0.20032593607902527) | > loss_disc_real_3: 0.21829591691493988 (0.21829591691493988) | > loss_disc_real_4: 0.1393505036830902 (0.1393505036830902) | > loss_disc_real_5: 0.23595087230205536 (0.23595087230205536) | > loss_0: 2.780379056930542 (2.780379056930542) | > loss_gen: 1.8618966341018677 (1.8618966341018677) | > loss_kl: 5.634450912475586 (5.634450912475586) | > loss_feat: 3.838554620742798 (3.838554620742798) | > loss_mel: 21.714529037475586 (21.714529037475586) | > loss_duration: 3.0474302768707275 (3.0474302768707275) | > loss_1: 36.09686279296875 (36.09686279296875)  --> STEP: 1 | > loss_disc: 2.9193460941314697 (2.9193460941314697) | > loss_disc_real_0: 0.4110066890716553 (0.4110066890716553) | > loss_disc_real_1: 0.25887033343315125 (0.25887033343315125) | > loss_disc_real_2: 0.41768914461135864 (0.41768914461135864) | > loss_disc_real_3: 0.2815803289413452 (0.2815803289413452) | > loss_disc_real_4: 0.2608906626701355 (0.2608906626701355) | > loss_disc_real_5: 0.3216482102870941 (0.3216482102870941) | > loss_0: 2.9193460941314697 (2.9193460941314697) | > loss_gen: 2.4772448539733887 (2.4772448539733887) | > loss_kl: 5.269932270050049 (5.269932270050049) | > loss_feat: 2.4044971466064453 (2.4044971466064453) | > loss_mel: 21.208898544311523 (21.208898544311523) | > loss_duration: 3.3703742027282715 (3.3703742027282715) | > loss_1: 34.7309455871582 (34.7309455871582)  --> STEP: 2 | > loss_disc: 2.9633588790893555 (2.9413524866104126) | > loss_disc_real_0: 0.23555094003677368 (0.3232788145542145) | > loss_disc_real_1: 0.2501668930053711 (0.25451861321926117) | > loss_disc_real_2: 0.2654189169406891 (0.34155403077602386) | > loss_disc_real_3: 0.2318621426820755 (0.25672123581171036) | > loss_disc_real_4: 0.265619158744812 (0.26325491070747375) | > loss_disc_real_5: 0.2647465467453003 (0.2931973785161972) | > loss_0: 2.9633588790893555 (2.9413524866104126) | > loss_gen: 1.5545824766159058 (2.015913665294647) | > loss_kl: 5.987773895263672 (5.62885308265686) | > loss_feat: 0.09195364266633987 (1.2482253946363926) | > loss_mel: 1.9335284233093262 (11.571213483810425) | > loss_duration: 3.304091453552246 (3.337232828140259) | > loss_1: 12.871930122375488 (23.801437854766846)  --> STEP: 3 | > loss_disc: 2.0336391925811768 (2.6387813886006675) | > loss_disc_real_0: 0.2271089255809784 (0.2912221848964691) | > loss_disc_real_1: 0.25255274772644043 (0.25386332472165424) | > loss_disc_real_2: 0.23011444509029388 (0.3044075022141139) | > loss_disc_real_3: 0.17165564000606537 (0.2283660372098287) | > loss_disc_real_4: 0.14892391860485077 (0.22514458000659943) | > loss_disc_real_5: 0.11230721324682236 (0.23290065675973892) | > loss_0: 2.0336391925811768 (2.6387813886006675) | > loss_gen: 2.8260092735290527 (2.2859455347061157) | > loss_kl: 2.940599203109741 (4.732768456141154) | > loss_feat: 5.045696258544922 (2.5140490159392357) | > loss_mel: 22.839229583740234 (15.327218850453695) | > loss_duration: 3.068112850189209 (3.247526168823242) | > loss_1: 36.71964645385742 (28.10750738779704) --> EVAL PERFORMANCE | > avg_loader_time: 0.0019378662109375 (-0.004632472991943359) | > avg_loss_disc: 2.6387813886006675 (-0.15204906463623047) | > avg_loss_disc_real_0: 0.2912221848964691 (-0.08423659453789395) | > avg_loss_disc_real_1: 0.25386332472165424 (-0.01052353779474896) | > avg_loss_disc_real_2: 0.3044075022141139 (+0.037535160779953) | > avg_loss_disc_real_3: 0.2283660372098287 (-0.0446948210398356) | > avg_loss_disc_real_4: 0.22514458000659943 (-0.05602364738782245) | > avg_loss_disc_real_5: 0.23290065675973892 (-0.04465580234924954) | > avg_loss_0: 2.6387813886006675 (-0.15204906463623047) | > avg_loss_gen: 2.2859455347061157 (-0.38799281915028905) | > avg_loss_kl: 4.732768456141154 (-0.014831225077310606) | > avg_loss_feat: 2.5140490159392357 (-3.879902717967828) | > avg_loss_mel: 15.327218850453695 (-7.045564810434977) | > avg_loss_duration: 3.247526168823242 (+0.007493416468302261) | > avg_loss_1: 28.10750738779704 (-11.320797920227047)  > EPOCH: 1184/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:02:13)   --> TIME: 2023-10-20 15:02:36 -- STEP: 29/50 -- GLOBAL_STEP: 112230 | > loss_disc: 2.640300750732422 (2.2970422999612214) | > loss_disc_real_0: 0.21077895164489746 (0.13485084853038704) | > loss_disc_real_1: 0.27135470509529114 (0.20304627132056088) | > loss_disc_real_2: 0.2851817309856415 (0.21896155962142452) | > loss_disc_real_3: 0.230122372508049 (0.21370975461242528) | > loss_disc_real_4: 0.24028949439525604 (0.20054564059808336) | > loss_disc_real_5: 0.15579649806022644 (0.21312142645233664) | > loss_0: 2.640300750732422 (2.2970422999612214) | > grad_norm_0: tensor(886.0060, device='cuda:0') (tensor(1087.9877, device='cuda:0')) | > loss_gen: 2.278130054473877 (2.485212905653592) | > loss_kl: 0.820735514163971 (0.7695616185665131) | > loss_feat: 5.713888168334961 (6.940163734914927) | > loss_mel: 21.9259090423584 (19.672631115748963) | > loss_duration: 1.2856144905090332 (1.3236224445803415) | > loss_1: 32.02427673339844 (31.19119193636138) | > grad_norm_1: tensor(10377.7822, device='cuda:0') (tensor(48157.6133, device='cuda:0')) | > current_lr_0: 6.120588593978546e-05 | > current_lr_1: 6.126712626838618e-05 | > step_time: 0.4968 (0.6302235126495361) | > loader_time: 0.0031 (0.024367825738314926)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0030014514923096 (2.0030014514923096) | > loss_disc_real_0: 0.19536936283111572 (0.19536936283111572) | > loss_disc_real_1: 0.2140018492937088 (0.2140018492937088) | > loss_disc_real_2: 0.2175029069185257 (0.2175029069185257) | > loss_disc_real_3: 0.18098792433738708 (0.18098792433738708) | > loss_disc_real_4: 0.1223173663020134 (0.1223173663020134) | > loss_disc_real_5: 0.04997898265719414 (0.04997898265719414) | > loss_0: 2.0030014514923096 (2.0030014514923096) | > loss_gen: 3.041964054107666 (3.041964054107666) | > loss_kl: 6.157565593719482 (6.157565593719482) | > loss_feat: 7.415874481201172 (7.415874481201172) | > loss_mel: 19.16656494140625 (19.16656494140625) | > loss_duration: 3.121504068374634 (3.121504068374634) | > loss_1: 38.90347671508789 (38.90347671508789)  --> STEP: 1 | > loss_disc: 2.6305465698242188 (2.6305465698242188) | > loss_disc_real_0: 0.39774826169013977 (0.39774826169013977) | > loss_disc_real_1: 0.25807055830955505 (0.25807055830955505) | > loss_disc_real_2: 0.38119378685951233 (0.38119378685951233) | > loss_disc_real_3: 0.20693501830101013 (0.20693501830101013) | > loss_disc_real_4: 0.19053715467453003 (0.19053715467453003) | > loss_disc_real_5: 0.2643986940383911 (0.2643986940383911) | > loss_0: 2.6305465698242188 (2.6305465698242188) | > loss_gen: 2.679408073425293 (2.679408073425293) | > loss_kl: 5.91172981262207 (5.91172981262207) | > loss_feat: 2.5584707260131836 (2.5584707260131836) | > loss_mel: 19.139753341674805 (19.139753341674805) | > loss_duration: 3.423557996749878 (3.423557996749878) | > loss_1: 33.712921142578125 (33.712921142578125)  --> STEP: 2 | > loss_disc: 3.010087013244629 (2.820316791534424) | > loss_disc_real_0: 0.2999520003795624 (0.3488501310348511) | > loss_disc_real_1: 0.28825926780700684 (0.27316491305828094) | > loss_disc_real_2: 0.286712646484375 (0.33395321667194366) | > loss_disc_real_3: 0.26204797625541687 (0.2344914972782135) | > loss_disc_real_4: 0.27821826934814453 (0.23437771201133728) | > loss_disc_real_5: 0.2634775638580322 (0.26393812894821167) | > loss_0: 3.010087013244629 (2.820316791534424) | > loss_gen: 1.6822221279144287 (2.180815100669861) | > loss_kl: 5.9345879554748535 (5.923158884048462) | > loss_feat: 0.02421184442937374 (1.2913412852212787) | > loss_mel: 2.471745252609253 (10.805749297142029) | > loss_duration: 3.282439708709717 (3.3529988527297974) | > loss_1: 13.395206451416016 (23.55406379699707)  --> STEP: 3 | > loss_disc: 3.170382261276245 (2.9370052814483643) | > loss_disc_real_0: 0.3204360604286194 (0.3393787741661072) | > loss_disc_real_1: 0.3669032156467438 (0.30441101392110187) | > loss_disc_real_2: 0.3520585596561432 (0.3399883310000102) | > loss_disc_real_3: 0.34636881947517395 (0.27178393801053363) | > loss_disc_real_4: 0.336841881275177 (0.2685324350992839) | > loss_disc_real_5: 0.40423253178596497 (0.31070292989412945) | > loss_0: 3.170382261276245 (2.9370052814483643) | > loss_gen: 2.239179849624634 (2.2002700169881186) | > loss_kl: 2.607639789581299 (4.817985852559407) | > loss_feat: 2.8546319007873535 (1.812438157076637) | > loss_mel: 18.596471786499023 (13.40265679359436) | > loss_duration: 3.0997281074523926 (3.2685752709706626) | > loss_1: 29.39764976501465 (25.501925786336262) --> EVAL PERFORMANCE | > avg_loader_time: 0.012752135594685873 (+0.010814269383748373) | > avg_loss_disc: 2.9370052814483643 (+0.2982238928476968) | > avg_loss_disc_real_0: 0.3393787741661072 (+0.04815658926963806) | > avg_loss_disc_real_1: 0.30441101392110187 (+0.05054768919944763) | > avg_loss_disc_real_2: 0.3399883310000102 (+0.0355808287858963) | > avg_loss_disc_real_3: 0.27178393801053363 (+0.04341790080070493) | > avg_loss_disc_real_4: 0.2685324350992839 (+0.043387855092684446) | > avg_loss_disc_real_5: 0.31070292989412945 (+0.07780227313439053) | > avg_loss_0: 2.9370052814483643 (+0.2982238928476968) | > avg_loss_gen: 2.2002700169881186 (-0.08567551771799709) | > avg_loss_kl: 4.817985852559407 (+0.08521739641825299) | > avg_loss_feat: 1.812438157076637 (-0.7016108588625987) | > avg_loss_mel: 13.40265679359436 (-1.924562056859335) | > avg_loss_duration: 3.2685752709706626 (+0.021049102147420395) | > avg_loss_1: 25.501925786336262 (-2.605581601460777)  > EPOCH: 1185/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:03:07)   --> TIME: 2023-10-20 15:03:18 -- STEP: 9/50 -- GLOBAL_STEP: 112260 | > loss_disc: 2.8757097721099854 (2.4894861380259194) | > loss_disc_real_0: 0.05095784738659859 (0.12623886639873186) | > loss_disc_real_1: 0.31778472661972046 (0.24285398837592867) | > loss_disc_real_2: 0.24536974728107452 (0.22975399924649131) | > loss_disc_real_3: 0.26331979036331177 (0.2278753456970056) | > loss_disc_real_4: 0.32570287585258484 (0.2575080651375983) | > loss_disc_real_5: 0.41085705161094666 (0.2818353682135542) | > loss_0: 2.8757097721099854 (2.4894861380259194) | > grad_norm_0: tensor(1371.5374, device='cuda:0') (tensor(1130.3256, device='cuda:0')) | > loss_gen: 2.196296215057373 (2.361033942964342) | > loss_kl: 0.5986873507499695 (0.7708492113484277) | > loss_feat: 4.508697032928467 (6.749443054199219) | > loss_mel: 21.896427154541016 (20.88485590616862) | > loss_duration: 1.2610007524490356 (1.3385980129241943) | > loss_1: 30.461109161376953 (32.10477956136068) | > grad_norm_1: tensor(7516.6685, device='cuda:0') (tensor(30283.9102, device='cuda:0')) | > current_lr_0: 6.11447068247274e-05 | > current_lr_1: 6.120588593978546e-05 | > step_time: 0.8364 (0.6435006459554037) | > loader_time: 0.0314 (0.016951322555541992)  --> TIME: 2023-10-20 15:03:40 -- STEP: 39/50 -- GLOBAL_STEP: 112290 | > loss_disc: 3.033721923828125 (2.495213982386467) | > loss_disc_real_0: 0.09820125252008438 (0.15234158020944166) | > loss_disc_real_1: 0.26539114117622375 (0.2371378290729645) | > loss_disc_real_2: 0.26359567046165466 (0.22738889079445448) | > loss_disc_real_3: 0.2573927044868469 (0.21860310435295105) | > loss_disc_real_4: 0.2930854260921478 (0.22556996550888586) | > loss_disc_real_5: 0.2558184862136841 (0.23146342584051383) | > loss_0: 3.033721923828125 (2.495213982386467) | > grad_norm_0: tensor(3073.1611, device='cuda:0') (tensor(1492.9939, device='cuda:0')) | > loss_gen: 1.482403039932251 (2.1926785157277036) | > loss_kl: 0.8722379803657532 (0.7503139884808123) | > loss_feat: 0.11730998754501343 (5.233075985684991) | > loss_mel: 1.713627576828003 (18.301874515337822) | > loss_duration: 1.418926477432251 (1.3191449244817097) | > loss_1: 5.604504585266113 (27.79708774273212) | > grad_norm_1: tensor(50040.9648, device='cuda:0') (tensor(39040.5039, device='cuda:0')) | > current_lr_0: 6.11447068247274e-05 | > current_lr_1: 6.120588593978546e-05 | > step_time: 0.8263 (0.6813671955695519) | > loader_time: 0.0267 (0.023067174813686277)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.010113000869751 (3.010113000869751) | > loss_disc_real_0: 0.3428502678871155 (0.3428502678871155) | > loss_disc_real_1: 0.24824628233909607 (0.24824628233909607) | > loss_disc_real_2: 0.41360101103782654 (0.41360101103782654) | > loss_disc_real_3: 0.3571934103965759 (0.3571934103965759) | > loss_disc_real_4: 0.5065246820449829 (0.5065246820449829) | > loss_disc_real_5: 0.6269270181655884 (0.6269270181655884) | > loss_0: 3.010113000869751 (3.010113000869751) | > loss_gen: 3.5137076377868652 (3.5137076377868652) | > loss_kl: 5.734319686889648 (5.734319686889648) | > loss_feat: 7.017544746398926 (7.017544746398926) | > loss_mel: 21.879302978515625 (21.879302978515625) | > loss_duration: 3.194289207458496 (3.194289207458496) | > loss_1: 41.33916473388672 (41.33916473388672)  --> STEP: 1 | > loss_disc: 2.2125587463378906 (2.2125587463378906) | > loss_disc_real_0: 0.11983878910541534 (0.11983878910541534) | > loss_disc_real_1: 0.0974610298871994 (0.0974610298871994) | > loss_disc_real_2: 0.12419149279594421 (0.12419149279594421) | > loss_disc_real_3: 0.24454234540462494 (0.24454234540462494) | > loss_disc_real_4: 0.14866265654563904 (0.14866265654563904) | > loss_disc_real_5: 0.18815270066261292 (0.18815270066261292) | > loss_0: 2.2125587463378906 (2.2125587463378906) | > loss_gen: 1.8946068286895752 (1.8946068286895752) | > loss_kl: 6.137237071990967 (6.137237071990967) | > loss_feat: 6.446473121643066 (6.446473121643066) | > loss_mel: 25.92475128173828 (25.92475128173828) | > loss_duration: 3.4891364574432373 (3.4891364574432373) | > loss_1: 43.89220428466797 (43.89220428466797)  --> STEP: 2 | > loss_disc: 2.764636516571045 (2.4885976314544678) | > loss_disc_real_0: 0.14460614323616028 (0.1322224661707878) | > loss_disc_real_1: 0.2216031551361084 (0.1595320925116539) | > loss_disc_real_2: 0.24683819711208344 (0.18551484495401382) | > loss_disc_real_3: 0.2774416208267212 (0.26099198311567307) | > loss_disc_real_4: 0.2663252353668213 (0.20749394595623016) | > loss_disc_real_5: 0.2513357996940613 (0.2197442501783371) | > loss_0: 2.764636516571045 (2.4885976314544678) | > loss_gen: 1.6980301141738892 (1.7963184714317322) | > loss_kl: 5.90805196762085 (6.022644519805908) | > loss_feat: 1.0660337209701538 (3.75625342130661) | > loss_mel: 16.952590942382812 (21.438671112060547) | > loss_duration: 3.3241021633148193 (3.4066193103790283) | > loss_1: 28.948810577392578 (36.42050743103027)  --> STEP: 3 | > loss_disc: 2.961355209350586 (2.646183490753174) | > loss_disc_real_0: 0.33030176162719727 (0.19824889798959097) | > loss_disc_real_1: 0.2410929948091507 (0.18671905994415283) | > loss_disc_real_2: 0.21022383868694305 (0.19375117619832358) | > loss_disc_real_3: 0.25447922945022583 (0.25882106522719067) | > loss_disc_real_4: 0.2569039463996887 (0.22396394610404968) | > loss_disc_real_5: 0.2512366473674774 (0.23024171590805054) | > loss_0: 2.961355209350586 (2.646183490753174) | > loss_gen: 1.6218844652175903 (1.7381738026936848) | > loss_kl: 2.816779613494873 (4.9540228843688965) | > loss_feat: 0.20679186284542084 (2.5730995684862137) | > loss_mel: 5.6964640617370605 (16.191268761952717) | > loss_duration: 3.1545333862304688 (3.3225906689961753) | > loss_1: 13.496453285217285 (28.77915604909261) --> EVAL PERFORMANCE | > avg_loader_time: 0.005339463551839192 (-0.0074126720428466806) | > avg_loss_disc: 2.646183490753174 (-0.29082179069519043) | > avg_loss_disc_real_0: 0.19824889798959097 (-0.1411298761765162) | > avg_loss_disc_real_1: 0.18671905994415283 (-0.11769195397694904) | > avg_loss_disc_real_2: 0.19375117619832358 (-0.14623715480168661) | > avg_loss_disc_real_3: 0.25882106522719067 (-0.01296287278334296) | > avg_loss_disc_real_4: 0.22396394610404968 (-0.04456848899523419) | > avg_loss_disc_real_5: 0.23024171590805054 (-0.08046121398607892) | > avg_loss_0: 2.646183490753174 (-0.29082179069519043) | > avg_loss_gen: 1.7381738026936848 (-0.4620962142944338) | > avg_loss_kl: 4.9540228843688965 (+0.13603703180948923) | > avg_loss_feat: 2.5730995684862137 (+0.7606614114095767) | > avg_loss_mel: 16.191268761952717 (+2.7886119683583566) | > avg_loss_duration: 3.3225906689961753 (+0.054015398025512695) | > avg_loss_1: 28.77915604909261 (+3.2772302627563477)  > EPOCH: 1186/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:03:58)   --> TIME: 2023-10-20 15:04:14 -- STEP: 19/50 -- GLOBAL_STEP: 112320 | > loss_disc: 0.7280186414718628 (2.3414068535754553) | > loss_disc_real_0: 0.019855700433254242 (0.13385611203940292) | > loss_disc_real_1: 0.08856232464313507 (0.1965278761559411) | > loss_disc_real_2: 0.08869484812021255 (0.2093344205304196) | > loss_disc_real_3: 0.11521846801042557 (0.2080831357130879) | > loss_disc_real_4: 0.02082045003771782 (0.18838244519735636) | > loss_disc_real_5: 0.018629251047968864 (0.21802142840859137) | > loss_0: 0.7280186414718628 (2.3414068535754553) | > grad_norm_0: tensor(385.9069, device='cuda:0') (tensor(1103.0083, device='cuda:0')) | > loss_gen: 4.436502456665039 (2.433587300150018) | > loss_kl: 0.8291688561439514 (0.7186728778638338) | > loss_feat: 15.039013862609863 (7.060122844419982) | > loss_mel: 23.45707130432129 (22.947837729203073) | > loss_duration: 1.4186646938323975 (1.3455344062102468) | > loss_1: 45.180419921875 (34.50575532411274) | > grad_norm_1: tensor(72435.9766, device='cuda:0') (tensor(47338.1289, device='cuda:0')) | > current_lr_0: 6.108358886202525e-05 | > current_lr_1: 6.11447068247274e-05 | > step_time: 0.2955 (0.5493294816268118) | > loader_time: 0.0249 (0.023746816735518605)  --> TIME: 2023-10-20 15:04:29 -- STEP: 49/50 -- GLOBAL_STEP: 112350 | > loss_disc: 2.2458014488220215 (2.404813965972589) | > loss_disc_real_0: 0.09336662292480469 (0.13408815035862584) | > loss_disc_real_1: 0.14533159136772156 (0.20899852813810718) | > loss_disc_real_2: 0.20998980104923248 (0.23135422884809728) | > loss_disc_real_3: 0.2856922745704651 (0.2149925456211275) | > loss_disc_real_4: 0.2884614169597626 (0.21824737737069325) | > loss_disc_real_5: 0.30681830644607544 (0.23415654126022542) | > loss_0: 2.2458014488220215 (2.404813965972589) | > grad_norm_0: tensor(1172.5146, device='cuda:0') (tensor(1100.8669, device='cuda:0')) | > loss_gen: 2.5544214248657227 (2.3255084290796404) | > loss_kl: 0.7754114270210266 (0.8001629095904681) | > loss_feat: 3.8147506713867188 (5.846399145314888) | > loss_mel: 21.838111877441406 (20.314301768127752) | > loss_duration: 1.447594404220581 (1.3188497047035062) | > loss_1: 30.43029022216797 (30.605221962442204) | > grad_norm_1: tensor(20296.8594, device='cuda:0') (tensor(39291.8086, device='cuda:0')) | > current_lr_0: 6.108358886202525e-05 | > current_lr_1: 6.11447068247274e-05 | > step_time: 0.3571 (0.5038807830032038) | > loader_time: 0.469 (0.02806820674818389)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7498533725738525 (2.7498533725738525) | > loss_disc_real_0: 0.16823449730873108 (0.16823449730873108) | > loss_disc_real_1: 0.2503851056098938 (0.2503851056098938) | > loss_disc_real_2: 0.3214729130268097 (0.3214729130268097) | > loss_disc_real_3: 0.2376520186662674 (0.2376520186662674) | > loss_disc_real_4: 0.25413811206817627 (0.25413811206817627) | > loss_disc_real_5: 0.2859214246273041 (0.2859214246273041) | > loss_0: 2.7498533725738525 (2.7498533725738525) | > loss_gen: 1.8882830142974854 (1.8882830142974854) | > loss_kl: 5.817688465118408 (5.817688465118408) | > loss_feat: 0.8708109259605408 (0.8708109259605408) | > loss_mel: 17.882923126220703 (17.882923126220703) | > loss_duration: 3.025825023651123 (3.025825023651123) | > loss_1: 29.485530853271484 (29.485530853271484)  --> STEP: 1 | > loss_disc: 2.70391583442688 (2.70391583442688) | > loss_disc_real_0: 0.35469484329223633 (0.35469484329223633) | > loss_disc_real_1: 0.1859118640422821 (0.1859118640422821) | > loss_disc_real_2: 0.2596280872821808 (0.2596280872821808) | > loss_disc_real_3: 0.23127101361751556 (0.23127101361751556) | > loss_disc_real_4: 0.2877998352050781 (0.2877998352050781) | > loss_disc_real_5: 0.3723611831665039 (0.3723611831665039) | > loss_0: 2.70391583442688 (2.70391583442688) | > loss_gen: 2.8996479511260986 (2.8996479511260986) | > loss_kl: 5.832350730895996 (5.832350730895996) | > loss_feat: 6.610002517700195 (6.610002517700195) | > loss_mel: 22.918310165405273 (22.918310165405273) | > loss_duration: 3.4449665546417236 (3.4449665546417236) | > loss_1: 41.70527648925781 (41.70527648925781)  --> STEP: 2 | > loss_disc: 2.4663984775543213 (2.5851571559906006) | > loss_disc_real_0: 0.4471608102321625 (0.4009278267621994) | > loss_disc_real_1: 0.287883460521698 (0.23689766228199005) | > loss_disc_real_2: 0.27531883120536804 (0.2674734592437744) | > loss_disc_real_3: 0.3870638310909271 (0.30916742235422134) | > loss_disc_real_4: 0.2106412649154663 (0.24922055006027222) | > loss_disc_real_5: 0.15748293697834015 (0.264922060072422) | > loss_0: 2.4663984775543213 (2.5851571559906006) | > loss_gen: 3.915661096572876 (3.4076545238494873) | > loss_kl: 6.329259872436523 (6.08080530166626) | > loss_feat: 10.902971267700195 (8.756486892700195) | > loss_mel: 24.72043800354004 (23.819374084472656) | > loss_duration: 3.2285866737365723 (3.336776614189148) | > loss_1: 49.09691619873047 (45.40109634399414)  --> STEP: 3 | > loss_disc: 3.0103089809417725 (2.7268744309743247) | > loss_disc_real_0: 0.34066805243492126 (0.3808412353197734) | > loss_disc_real_1: 0.3984697163105011 (0.2907550136248271) | > loss_disc_real_2: 0.4331416189670563 (0.32269617915153503) | > loss_disc_real_3: 0.28642576932907104 (0.3015868713458379) | > loss_disc_real_4: 0.3296724855899811 (0.2760378619035085) | > loss_disc_real_5: 0.3992721438407898 (0.3097054213285446) | > loss_0: 3.0103089809417725 (2.7268744309743247) | > loss_gen: 2.7405171394348145 (3.185275395711263) | > loss_kl: 2.5278916358947754 (4.896500746409099) | > loss_feat: 3.052485227584839 (6.85515300432841) | > loss_mel: 20.101547241210938 (22.580098470052082) | > loss_duration: 2.970020294189453 (3.214524507522583) | > loss_1: 31.392459869384766 (40.73155085245768) --> EVAL PERFORMANCE | > avg_loader_time: 0.031973044077555336 (+0.026633580525716145) | > avg_loss_disc: 2.7268744309743247 (+0.08069094022115086) | > avg_loss_disc_real_0: 0.3808412353197734 (+0.1825923373301824) | > avg_loss_disc_real_1: 0.2907550136248271 (+0.10403595368067425) | > avg_loss_disc_real_2: 0.32269617915153503 (+0.12894500295321146) | > avg_loss_disc_real_3: 0.3015868713458379 (+0.04276580611864722) | > avg_loss_disc_real_4: 0.2760378619035085 (+0.0520739157994588) | > avg_loss_disc_real_5: 0.3097054213285446 (+0.07946370542049408) | > avg_loss_0: 2.7268744309743247 (+0.08069094022115086) | > avg_loss_gen: 3.185275395711263 (+1.4471015930175783) | > avg_loss_kl: 4.896500746409099 (-0.05752213795979788) | > avg_loss_feat: 6.85515300432841 (+4.282053435842196) | > avg_loss_mel: 22.580098470052082 (+6.388829708099365) | > avg_loss_duration: 3.214524507522583 (-0.10806616147359227) | > avg_loss_1: 40.73155085245768 (+11.95239480336507)  > EPOCH: 1187/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:04:45)   --> TIME: 2023-10-20 15:05:02 -- STEP: 29/50 -- GLOBAL_STEP: 112380 | > loss_disc: 2.3820552825927734 (2.536549962800124) | > loss_disc_real_0: 0.1485576182603836 (0.1452736945758606) | > loss_disc_real_1: 0.3065820336341858 (0.22568158137387243) | > loss_disc_real_2: 0.26409727334976196 (0.23290555770027227) | > loss_disc_real_3: 0.19770380854606628 (0.23427492604944214) | > loss_disc_real_4: 0.2115629017353058 (0.25183280274785796) | > loss_disc_real_5: 0.3600972592830658 (0.26572340803927386) | > loss_0: 2.3820552825927734 (2.536549962800124) | > grad_norm_0: tensor(803.9443, device='cuda:0') (tensor(1410.3600, device='cuda:0')) | > loss_gen: 2.7178831100463867 (2.3014763347033798) | > loss_kl: 0.6756788492202759 (0.8979721960836442) | > loss_feat: 6.260519981384277 (5.988171963599221) | > loss_mel: 19.677465438842773 (21.910396312845165) | > loss_duration: 1.3076764345169067 (1.3274472376395916) | > loss_1: 30.639223098754883 (32.425464038191166) | > grad_norm_1: tensor(16073.2227, device='cuda:0') (tensor(29516.6504, device='cuda:0')) | > current_lr_0: 6.102253199055334e-05 | > current_lr_1: 6.108358886202525e-05 | > step_time: 0.258 (0.40244116454288875) | > loader_time: 0.0022 (0.007590532302856445)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5720036029815674 (2.5720036029815674) | > loss_disc_real_0: 0.14262884855270386 (0.14262884855270386) | > loss_disc_real_1: 0.2233506143093109 (0.2233506143093109) | > loss_disc_real_2: 0.19324512779712677 (0.19324512779712677) | > loss_disc_real_3: 0.22850142419338226 (0.22850142419338226) | > loss_disc_real_4: 0.2129148542881012 (0.2129148542881012) | > loss_disc_real_5: 0.2929196357727051 (0.2929196357727051) | > loss_0: 2.5720036029815674 (2.5720036029815674) | > loss_gen: 2.170152187347412 (2.170152187347412) | > loss_kl: 6.343820095062256 (6.343820095062256) | > loss_feat: 8.417380332946777 (8.417380332946777) | > loss_mel: 22.872982025146484 (22.872982025146484) | > loss_duration: 3.190042734146118 (3.190042734146118) | > loss_1: 42.99437713623047 (42.99437713623047)  --> STEP: 1 | > loss_disc: 1.4974637031555176 (1.4974637031555176) | > loss_disc_real_0: 0.03649778291583061 (0.03649778291583061) | > loss_disc_real_1: 0.03845344856381416 (0.03845344856381416) | > loss_disc_real_2: 0.0832221508026123 (0.0832221508026123) | > loss_disc_real_3: 0.050056278705596924 (0.050056278705596924) | > loss_disc_real_4: 0.17115874588489532 (0.17115874588489532) | > loss_disc_real_5: 0.14234431087970734 (0.14234431087970734) | > loss_0: 1.4974637031555176 (1.4974637031555176) | > loss_gen: 2.888519048690796 (2.888519048690796) | > loss_kl: 5.814404487609863 (5.814404487609863) | > loss_feat: 12.767244338989258 (12.767244338989258) | > loss_mel: 26.04585838317871 (26.04585838317871) | > loss_duration: 3.5502898693084717 (3.5502898693084717) | > loss_1: 51.06631851196289 (51.06631851196289)  --> STEP: 2 | > loss_disc: 2.1833345890045166 (1.840399146080017) | > loss_disc_real_0: 0.06161583214998245 (0.04905680753290653) | > loss_disc_real_1: 0.20320633053779602 (0.12082988955080509) | > loss_disc_real_2: 0.29487502574920654 (0.18904858827590942) | > loss_disc_real_3: 0.2563307285308838 (0.15319350361824036) | > loss_disc_real_4: 0.17128252983093262 (0.17122063785791397) | > loss_disc_real_5: 0.06480086594820023 (0.10357258841395378) | > loss_0: 2.1833345890045166 (1.840399146080017) | > loss_gen: 2.492969274520874 (2.690744161605835) | > loss_kl: 6.00534725189209 (5.909875869750977) | > loss_feat: 8.790153503417969 (10.778698921203613) | > loss_mel: 27.652301788330078 (26.849080085754395) | > loss_duration: 3.198904275894165 (3.3745970726013184) | > loss_1: 48.139678955078125 (49.60299873352051)  --> STEP: 3 | > loss_disc: 2.543855667114258 (2.0748846530914307) | > loss_disc_real_0: 0.21093271672725677 (0.10301544393102328) | > loss_disc_real_1: 0.29867085814476013 (0.18011021241545677) | > loss_disc_real_2: 0.3695421516895294 (0.24921310941378275) | > loss_disc_real_3: 0.3978501856327057 (0.23474573095639548) | > loss_disc_real_4: 0.33306217193603516 (0.22516781588395438) | > loss_disc_real_5: 0.20585781335830688 (0.13766766339540482) | > loss_0: 2.543855667114258 (2.0748846530914307) | > loss_gen: 2.991488456726074 (2.790992259979248) | > loss_kl: 2.791996717453003 (4.870582818984985) | > loss_feat: 4.831096649169922 (8.796164830525717) | > loss_mel: 21.003679275512695 (24.90061314900716) | > loss_duration: 3.0257668495178223 (3.2583203315734863) | > loss_1: 34.6440315246582 (44.616676330566406) --> EVAL PERFORMANCE | > avg_loader_time: 0.01144703229268392 (-0.020526011784871415) | > avg_loss_disc: 2.0748846530914307 (-0.651989777882894) | > avg_loss_disc_real_0: 0.10301544393102328 (-0.2778257913887501) | > avg_loss_disc_real_1: 0.18011021241545677 (-0.11064480120937031) | > avg_loss_disc_real_2: 0.24921310941378275 (-0.07348306973775229) | > avg_loss_disc_real_3: 0.23474573095639548 (-0.06684114038944242) | > avg_loss_disc_real_4: 0.22516781588395438 (-0.05087004601955411) | > avg_loss_disc_real_5: 0.13766766339540482 (-0.1720377579331398) | > avg_loss_0: 2.0748846530914307 (-0.651989777882894) | > avg_loss_gen: 2.790992259979248 (-0.3942831357320151) | > avg_loss_kl: 4.870582818984985 (-0.025917927424113252) | > avg_loss_feat: 8.796164830525717 (+1.9410118261973066) | > avg_loss_mel: 24.90061314900716 (+2.320514678955078) | > avg_loss_duration: 3.2583203315734863 (+0.04379582405090332) | > avg_loss_1: 44.616676330566406 (+3.8851254781087263)  > EPOCH: 1188/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:05:26)   --> TIME: 2023-10-20 15:05:37 -- STEP: 9/50 -- GLOBAL_STEP: 112410 | > loss_disc: 1.8346824645996094 (2.279513716697693) | > loss_disc_real_0: 0.04805395379662514 (0.1367149730730388) | > loss_disc_real_1: 0.14112024009227753 (0.21371666176451576) | > loss_disc_real_2: 0.2892357409000397 (0.25399511721399093) | > loss_disc_real_3: 0.24440424144268036 (0.2235118175546328) | > loss_disc_real_4: 0.17789068818092346 (0.28407035105758244) | > loss_disc_real_5: 0.252823144197464 (0.24889015075233248) | > loss_0: 1.8346824645996094 (2.279513716697693) | > grad_norm_0: tensor(702.8979, device='cuda:0') (tensor(804.1010, device='cuda:0')) | > loss_gen: 3.220315933227539 (2.7375987900627985) | > loss_kl: 0.8222536444664001 (0.7260349061754015) | > loss_feat: 7.327373027801514 (6.93372466829088) | > loss_mel: 19.97855567932129 (22.213184780544704) | > loss_duration: 1.3045886754989624 (1.3222923808627658) | > loss_1: 32.6530876159668 (33.932835261027016) | > grad_norm_1: tensor(19842.8320, device='cuda:0') (tensor(26175.3105, device='cuda:0')) | > current_lr_0: 6.096153614924722e-05 | > current_lr_1: 6.102253199055334e-05 | > step_time: 0.5585 (0.5931134223937988) | > loader_time: 0.0428 (0.02831281556023492)  --> TIME: 2023-10-20 15:05:57 -- STEP: 39/50 -- GLOBAL_STEP: 112440 | > loss_disc: 2.871798515319824 (2.454765252577953) | > loss_disc_real_0: 0.1085631474852562 (0.15142416564795452) | > loss_disc_real_1: 0.43661391735076904 (0.22942754721794373) | > loss_disc_real_2: 0.27136874198913574 (0.22385483120496458) | > loss_disc_real_3: 0.2983599007129669 (0.22885491221379012) | > loss_disc_real_4: 0.3175756633281708 (0.2297674874560191) | > loss_disc_real_5: 0.13172480463981628 (0.21387803322898272) | > loss_0: 2.871798515319824 (2.454765252577953) | > grad_norm_0: tensor(4050.9531, device='cuda:0') (tensor(1141.0291, device='cuda:0')) | > loss_gen: 2.1121058464050293 (2.2187569233087396) | > loss_kl: 0.513548731803894 (0.788676911439651) | > loss_feat: 3.8643393516540527 (5.031543226196216) | > loss_mel: 20.57879066467285 (18.435883262218574) | > loss_duration: 1.3673617839813232 (1.30704150444422) | > loss_1: 28.436145782470703 (27.781901677449543) | > grad_norm_1: tensor(54376.7188, device='cuda:0') (tensor(35761.0391, device='cuda:0')) | > current_lr_0: 6.096153614924722e-05 | > current_lr_1: 6.102253199055334e-05 | > step_time: 0.5039 (0.6541092334649502) | > loader_time: 0.0172 (0.022003809611002605)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3528130054473877 (2.3528130054473877) | > loss_disc_real_0: 0.2257184535264969 (0.2257184535264969) | > loss_disc_real_1: 0.1986580342054367 (0.1986580342054367) | > loss_disc_real_2: 0.18067686259746552 (0.18067686259746552) | > loss_disc_real_3: 0.16813144087791443 (0.16813144087791443) | > loss_disc_real_4: 0.14258509874343872 (0.14258509874343872) | > loss_disc_real_5: 0.19930824637413025 (0.19930824637413025) | > loss_0: 2.3528130054473877 (2.3528130054473877) | > loss_gen: 2.3089635372161865 (2.3089635372161865) | > loss_kl: 6.046863555908203 (6.046863555908203) | > loss_feat: 10.926445007324219 (10.926445007324219) | > loss_mel: 24.973308563232422 (24.973308563232422) | > loss_duration: 3.1917855739593506 (3.1917855739593506) | > loss_1: 47.447364807128906 (47.447364807128906)  --> STEP: 1 | > loss_disc: 2.200986385345459 (2.200986385345459) | > loss_disc_real_0: 0.21004723012447357 (0.21004723012447357) | > loss_disc_real_1: 0.22177162766456604 (0.22177162766456604) | > loss_disc_real_2: 0.25708064436912537 (0.25708064436912537) | > loss_disc_real_3: 0.1441466361284256 (0.1441466361284256) | > loss_disc_real_4: 0.23112478852272034 (0.23112478852272034) | > loss_disc_real_5: 0.46192026138305664 (0.46192026138305664) | > loss_0: 2.200986385345459 (2.200986385345459) | > loss_gen: 3.074911117553711 (3.074911117553711) | > loss_kl: 6.177037239074707 (6.177037239074707) | > loss_feat: 7.22116231918335 (7.22116231918335) | > loss_mel: 23.887144088745117 (23.887144088745117) | > loss_duration: 3.4828429222106934 (3.4828429222106934) | > loss_1: 43.84309387207031 (43.84309387207031)  --> STEP: 2 | > loss_disc: 1.2945812940597534 (1.7477838397026062) | > loss_disc_real_0: 0.06327573955059052 (0.13666148483753204) | > loss_disc_real_1: 0.16366499662399292 (0.19271831214427948) | > loss_disc_real_2: 0.0730070173740387 (0.16504383087158203) | > loss_disc_real_3: 0.19531625509262085 (0.16973144561052322) | > loss_disc_real_4: 0.02535196952521801 (0.12823837902396917) | > loss_disc_real_5: 0.07440487295389175 (0.2681625671684742) | > loss_0: 1.2945812940597534 (1.7477838397026062) | > loss_gen: 3.459010124206543 (3.266960620880127) | > loss_kl: 5.933285713195801 (6.055161476135254) | > loss_feat: 11.27559757232666 (9.248379945755005) | > loss_mel: 24.498018264770508 (24.192581176757812) | > loss_duration: 3.3003110885620117 (3.3915770053863525) | > loss_1: 48.466224670410156 (46.154659271240234)  --> STEP: 3 | > loss_disc: 2.9825196266174316 (2.1593624353408813) | > loss_disc_real_0: 0.2653694748878479 (0.17956414818763733) | > loss_disc_real_1: 0.2581551671028137 (0.21453059713045755) | > loss_disc_real_2: 0.27755817770957947 (0.20254861315091452) | > loss_disc_real_3: 0.24407389760017395 (0.1945122629404068) | > loss_disc_real_4: 0.28616204857826233 (0.18087960220873356) | > loss_disc_real_5: 0.25977644324302673 (0.26536719252665836) | > loss_0: 2.9825196266174316 (2.1593624353408813) | > loss_gen: 1.6179105043411255 (2.71727724870046) | > loss_kl: 2.9361982345581055 (5.015507062276204) | > loss_feat: 0.0900363102555275 (6.1955987339218455) | > loss_mel: 2.8050737380981445 (17.063412030537922) | > loss_duration: 3.066389322280884 (3.283181111017863) | > loss_1: 10.515607833862305 (34.27497545878092) --> EVAL PERFORMANCE | > avg_loader_time: 0.019696871439615887 (+0.008249839146931967) | > avg_loss_disc: 2.1593624353408813 (+0.08447778224945068) | > avg_loss_disc_real_0: 0.17956414818763733 (+0.07654870425661404) | > avg_loss_disc_real_1: 0.21453059713045755 (+0.03442038471500078) | > avg_loss_disc_real_2: 0.20254861315091452 (-0.04666449626286823) | > avg_loss_disc_real_3: 0.1945122629404068 (-0.04023346801598868) | > avg_loss_disc_real_4: 0.18087960220873356 (-0.04428821367522082) | > avg_loss_disc_real_5: 0.26536719252665836 (+0.12769952913125354) | > avg_loss_0: 2.1593624353408813 (+0.08447778224945068) | > avg_loss_gen: 2.71727724870046 (-0.0737150112787881) | > avg_loss_kl: 5.015507062276204 (+0.14492424329121878) | > avg_loss_feat: 6.1955987339218455 (-2.6005660966038713) | > avg_loss_mel: 17.063412030537922 (-7.837201118469238) | > avg_loss_duration: 3.283181111017863 (+0.02486077944437648) | > avg_loss_1: 34.27497545878092 (-10.341700871785484)  > EPOCH: 1189/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:06:17)   --> TIME: 2023-10-20 15:06:36 -- STEP: 19/50 -- GLOBAL_STEP: 112470 | > loss_disc: 2.38157320022583 (2.306936169925489) | > loss_disc_real_0: 0.10878948867321014 (0.133487054784047) | > loss_disc_real_1: 0.33150872588157654 (0.21669419031394155) | > loss_disc_real_2: 0.2894558310508728 (0.2131977171490067) | > loss_disc_real_3: 0.32376226782798767 (0.20902882888913155) | > loss_disc_real_4: 0.19732703268527985 (0.1982900757146509) | > loss_disc_real_5: 0.23104265332221985 (0.1868322364201671) | > loss_0: 2.38157320022583 (2.306936169925489) | > grad_norm_0: tensor(722.2083, device='cuda:0') (tensor(1573.7263, device='cuda:0')) | > loss_gen: 2.604644298553467 (2.3990292988325415) | > loss_kl: 0.8682123422622681 (0.8308722000373038) | > loss_feat: 4.968685626983643 (5.9753092023495) | > loss_mel: 21.60065460205078 (18.986435852552713) | > loss_duration: 1.4369603395462036 (1.343291621459158) | > loss_1: 31.479158401489258 (29.534938385612087) | > grad_norm_1: tensor(6483.8052, device='cuda:0') (tensor(56383.2773, device='cuda:0')) | > current_lr_0: 6.090060127710338e-05 | > current_lr_1: 6.096153614924722e-05 | > step_time: 0.8106 (0.5949440378891794) | > loader_time: 0.0267 (0.022148847579956055)  --> TIME: 2023-10-20 15:06:54 -- STEP: 49/50 -- GLOBAL_STEP: 112500 | > loss_disc: 2.7743616104125977 (2.3964687318218) | > loss_disc_real_0: 0.00606910977512598 (0.13530888855077175) | > loss_disc_real_1: 0.2794249653816223 (0.22624408368173302) | > loss_disc_real_2: 0.2595269978046417 (0.22147217651410978) | > loss_disc_real_3: 0.20496292412281036 (0.22734677267013764) | > loss_disc_real_4: 0.169499471783638 (0.22606350447298312) | > loss_disc_real_5: 0.1621502935886383 (0.2117675804362005) | > loss_0: 2.7743616104125977 (2.3964687318218) | > grad_norm_0: tensor(2964.5076, device='cuda:0') (tensor(1259.2703, device='cuda:0')) | > loss_gen: 1.6579954624176025 (2.377681951133572) | > loss_kl: 0.5329200625419617 (0.8064690183620064) | > loss_feat: 2.9458577632904053 (5.7590309081941236) | > loss_mel: 20.569177627563477 (19.611770836674435) | > loss_duration: 1.389592170715332 (1.3160709142684937) | > loss_1: 27.095542907714844 (29.87102360628089) | > grad_norm_1: tensor(7380.5273, device='cuda:0') (tensor(41687.3984, device='cuda:0')) | > current_lr_0: 6.090060127710338e-05 | > current_lr_1: 6.096153614924722e-05 | > step_time: 0.7018 (0.5706547766315693) | > loader_time: 0.8464 (0.034897804260253906)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8369500637054443 (2.8369500637054443) | > loss_disc_real_0: 0.281148225069046 (0.281148225069046) | > loss_disc_real_1: 0.2436862736940384 (0.2436862736940384) | > loss_disc_real_2: 0.3692778944969177 (0.3692778944969177) | > loss_disc_real_3: 0.3067558705806732 (0.3067558705806732) | > loss_disc_real_4: 0.2881928086280823 (0.2881928086280823) | > loss_disc_real_5: 0.4285338521003723 (0.4285338521003723) | > loss_0: 2.8369500637054443 (2.8369500637054443) | > loss_gen: 2.5274393558502197 (2.5274393558502197) | > loss_kl: 5.958850383758545 (5.958850383758545) | > loss_feat: 5.088260650634766 (5.088260650634766) | > loss_mel: 20.31432342529297 (20.31432342529297) | > loss_duration: 3.2485549449920654 (3.2485549449920654) | > loss_1: 37.137428283691406 (37.137428283691406)  --> STEP: 1 | > loss_disc: 2.248208522796631 (2.248208522796631) | > loss_disc_real_0: 0.1373269110918045 (0.1373269110918045) | > loss_disc_real_1: 0.2617379426956177 (0.2617379426956177) | > loss_disc_real_2: 0.24086564779281616 (0.24086564779281616) | > loss_disc_real_3: 0.2564145624637604 (0.2564145624637604) | > loss_disc_real_4: 0.21999162435531616 (0.21999162435531616) | > loss_disc_real_5: 0.25315380096435547 (0.25315380096435547) | > loss_0: 2.248208522796631 (2.248208522796631) | > loss_gen: 2.662935733795166 (2.662935733795166) | > loss_kl: 5.51198148727417 (5.51198148727417) | > loss_feat: 6.362138271331787 (6.362138271331787) | > loss_mel: 23.573911666870117 (23.573911666870117) | > loss_duration: 3.44347882270813 (3.44347882270813) | > loss_1: 41.554447174072266 (41.554447174072266)  --> STEP: 2 | > loss_disc: 3.185728073120117 (2.716968297958374) | > loss_disc_real_0: 0.4796890914440155 (0.30850800126791) | > loss_disc_real_1: 0.3132752478122711 (0.2875065952539444) | > loss_disc_real_2: 0.389191210269928 (0.31502842903137207) | > loss_disc_real_3: 0.2618545591831207 (0.25913456082344055) | > loss_disc_real_4: 0.25792691111564636 (0.23895926773548126) | > loss_disc_real_5: 0.28206315636634827 (0.26760847866535187) | > loss_0: 3.185728073120117 (2.716968297958374) | > loss_gen: 2.035785675048828 (2.349360704421997) | > loss_kl: 6.222307205200195 (5.867144346237183) | > loss_feat: 2.422126293182373 (4.39213228225708) | > loss_mel: 24.549205780029297 (24.061558723449707) | > loss_duration: 3.28702449798584 (3.365251660346985) | > loss_1: 38.51645278930664 (40.03544998168945)  --> STEP: 3 | > loss_disc: 2.999613046646118 (2.811183214187622) | > loss_disc_real_0: 0.34532201290130615 (0.32077933847904205) | > loss_disc_real_1: 0.4506276547908783 (0.3418802817662557) | > loss_disc_real_2: 0.2607089579105377 (0.2969219386577606) | > loss_disc_real_3: 0.29740065336227417 (0.27188992500305176) | > loss_disc_real_4: 0.32159188389778137 (0.2665034731229146) | > loss_disc_real_5: 0.4374473989009857 (0.3242214520772298) | > loss_0: 2.999613046646118 (2.811183214187622) | > loss_gen: 2.711732864379883 (2.470151424407959) | > loss_kl: 2.7503583431243896 (4.828215678532918) | > loss_feat: 4.590363502502441 (4.4582093556722) | > loss_mel: 21.178585052490234 (23.10056749979655) | > loss_duration: 3.0652709007263184 (3.2652580738067627) | > loss_1: 34.29631042480469 (38.12240346272787) --> EVAL PERFORMANCE | > avg_loader_time: 0.0047779083251953125 (-0.014918963114420574) | > avg_loss_disc: 2.811183214187622 (+0.6518207788467407) | > avg_loss_disc_real_0: 0.32077933847904205 (+0.14121519029140472) | > avg_loss_disc_real_1: 0.3418802817662557 (+0.12734968463579813) | > avg_loss_disc_real_2: 0.2969219386577606 (+0.0943733255068461) | > avg_loss_disc_real_3: 0.27188992500305176 (+0.07737766206264496) | > avg_loss_disc_real_4: 0.2665034731229146 (+0.08562387091418106) | > avg_loss_disc_real_5: 0.3242214520772298 (+0.05885425955057144) | > avg_loss_0: 2.811183214187622 (+0.6518207788467407) | > avg_loss_gen: 2.470151424407959 (-0.24712582429250096) | > avg_loss_kl: 4.828215678532918 (-0.18729138374328613) | > avg_loss_feat: 4.4582093556722 (-1.7373893782496452) | > avg_loss_mel: 23.10056749979655 (+6.037155469258629) | > avg_loss_duration: 3.2652580738067627 (-0.017923037211100112) | > avg_loss_1: 38.12240346272787 (+3.847428003946945)  > EPOCH: 1190/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:07:09)   --> TIME: 2023-10-20 15:07:27 -- STEP: 29/50 -- GLOBAL_STEP: 112530 | > loss_disc: 2.521822929382324 (2.52170991897583) | > loss_disc_real_0: 0.20059260725975037 (0.15901887526029143) | > loss_disc_real_1: 0.2316843420267105 (0.2284734076980887) | > loss_disc_real_2: 0.14881350100040436 (0.21732602885057187) | > loss_disc_real_3: 0.24271321296691895 (0.2459547658418787) | > loss_disc_real_4: 0.19514323770999908 (0.23387249347207875) | > loss_disc_real_5: 0.28275853395462036 (0.2533509142311483) | > loss_0: 2.521822929382324 (2.52170991897583) | > grad_norm_0: tensor(687.6897, device='cuda:0') (tensor(1190.7612, device='cuda:0')) | > loss_gen: 1.9238182306289673 (2.208289536936529) | > loss_kl: 0.5678747296333313 (0.7330670033035607) | > loss_feat: 2.4756715297698975 (4.936118865064506) | > loss_mel: 17.981924057006836 (17.337060042496386) | > loss_duration: 1.297763466835022 (1.3119800995136126) | > loss_1: 24.247053146362305 (26.52651546741354) | > grad_norm_1: tensor(3904.1914, device='cuda:0') (tensor(43056.4141, device='cuda:0')) | > current_lr_0: 6.083972731317935e-05 | > current_lr_1: 6.090060127710338e-05 | > step_time: 0.3487 (0.44546772693765574) | > loader_time: 0.0051 (0.012258562548407194)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4316813945770264 (2.4316813945770264) | > loss_disc_real_0: 0.14162027835845947 (0.14162027835845947) | > loss_disc_real_1: 0.22154869139194489 (0.22154869139194489) | > loss_disc_real_2: 0.1773114800453186 (0.1773114800453186) | > loss_disc_real_3: 0.26276975870132446 (0.26276975870132446) | > loss_disc_real_4: 0.19716709852218628 (0.19716709852218628) | > loss_disc_real_5: 0.3119860887527466 (0.3119860887527466) | > loss_0: 2.4316813945770264 (2.4316813945770264) | > loss_gen: 2.2120823860168457 (2.2120823860168457) | > loss_kl: 5.479957580566406 (5.479957580566406) | > loss_feat: 5.936831951141357 (5.936831951141357) | > loss_mel: 22.464765548706055 (22.464765548706055) | > loss_duration: 3.0413551330566406 (3.0413551330566406) | > loss_1: 39.13499069213867 (39.13499069213867)  --> STEP: 1 | > loss_disc: 3.2467379570007324 (3.2467379570007324) | > loss_disc_real_0: 0.547545313835144 (0.547545313835144) | > loss_disc_real_1: 0.2292182445526123 (0.2292182445526123) | > loss_disc_real_2: 0.30782899260520935 (0.30782899260520935) | > loss_disc_real_3: 0.2630256116390228 (0.2630256116390228) | > loss_disc_real_4: 0.3238484859466553 (0.3238484859466553) | > loss_disc_real_5: 0.319392591714859 (0.319392591714859) | > loss_0: 3.2467379570007324 (3.2467379570007324) | > loss_gen: 2.0149343013763428 (2.0149343013763428) | > loss_kl: 6.011376857757568 (6.011376857757568) | > loss_feat: 3.3653714656829834 (3.3653714656829834) | > loss_mel: 21.538238525390625 (21.538238525390625) | > loss_duration: 3.438674211502075 (3.438674211502075) | > loss_1: 36.368595123291016 (36.368595123291016)  --> STEP: 2 | > loss_disc: 2.842055320739746 (3.0443966388702393) | > loss_disc_real_0: 0.24734026193618774 (0.3974427878856659) | > loss_disc_real_1: 0.24848946928977966 (0.23885385692119598) | > loss_disc_real_2: 0.21864159405231476 (0.26323529332876205) | > loss_disc_real_3: 0.2619116008281708 (0.2624686062335968) | > loss_disc_real_4: 0.2767893075942993 (0.3003188967704773) | > loss_disc_real_5: 0.2704728841781616 (0.2949327379465103) | > loss_0: 2.842055320739746 (3.0443966388702393) | > loss_gen: 1.7199913263320923 (1.8674628138542175) | > loss_kl: 6.261072635650635 (6.136224746704102) | > loss_feat: 0.9105228781700134 (2.1379471719264984) | > loss_mel: 8.83930492401123 (15.188771724700928) | > loss_duration: 3.2679545879364014 (3.3533143997192383) | > loss_1: 20.99884605407715 (28.683720588684082)  --> STEP: 3 | > loss_disc: 2.777397632598877 (2.9553969701131186) | > loss_disc_real_0: 0.2313791960477829 (0.3420882572730382) | > loss_disc_real_1: 0.3123451769351959 (0.2633509635925293) | > loss_disc_real_2: 0.34304848313331604 (0.28983968993028003) | > loss_disc_real_3: 0.33959686756134033 (0.288178026676178) | > loss_disc_real_4: 0.20949599146842957 (0.27004459500312805) | > loss_disc_real_5: 0.26774612069129944 (0.2858705321947734) | > loss_0: 2.777397632598877 (2.9553969701131186) | > loss_gen: 2.2940945625305176 (2.0096733967463174) | > loss_kl: 2.9951510429382324 (5.0892001787821455) | > loss_feat: 3.314950942993164 (2.5302817622820535) | > loss_mel: 20.61315155029297 (16.99689833323161) | > loss_duration: 3.067715644836426 (3.258114814758301) | > loss_1: 32.285064697265625 (29.88416862487793) --> EVAL PERFORMANCE | > avg_loader_time: 0.02162488301595052 (+0.016846974690755207) | > avg_loss_disc: 2.9553969701131186 (+0.14421375592549657) | > avg_loss_disc_real_0: 0.3420882572730382 (+0.021308918793996157) | > avg_loss_disc_real_1: 0.2633509635925293 (-0.07852931817372638) | > avg_loss_disc_real_2: 0.28983968993028003 (-0.007082248727480589) | > avg_loss_disc_real_3: 0.288178026676178 (+0.01628810167312622) | > avg_loss_disc_real_4: 0.27004459500312805 (+0.003541121880213438) | > avg_loss_disc_real_5: 0.2858705321947734 (-0.038350919882456425) | > avg_loss_0: 2.9553969701131186 (+0.14421375592549657) | > avg_loss_gen: 2.0096733967463174 (-0.4604780276616416) | > avg_loss_kl: 5.0892001787821455 (+0.2609845002492275) | > avg_loss_feat: 2.5302817622820535 (-1.9279275933901467) | > avg_loss_mel: 16.99689833323161 (-6.103669166564941) | > avg_loss_duration: 3.258114814758301 (-0.007143259048461914) | > avg_loss_1: 29.88416862487793 (-8.238234837849937)  > EPOCH: 1191/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:07:52)   --> TIME: 2023-10-20 15:08:05 -- STEP: 9/50 -- GLOBAL_STEP: 112560 | > loss_disc: 3.1070005893707275 (2.5965713792377048) | > loss_disc_real_0: 0.416309654712677 (0.15851160609680745) | > loss_disc_real_1: 0.21972878277301788 (0.21402752440836695) | > loss_disc_real_2: 0.32121774554252625 (0.307792288561662) | > loss_disc_real_3: 0.3088630735874176 (0.2464458073178927) | > loss_disc_real_4: 0.2729390561580658 (0.25915156056483585) | > loss_disc_real_5: 0.44085976481437683 (0.2761799444754918) | > loss_0: 3.1070005893707275 (2.5965713792377048) | > grad_norm_0: tensor(626.9424, device='cuda:0') (tensor(515.6354, device='cuda:0')) | > loss_gen: 2.4167697429656982 (2.294248342514038) | > loss_kl: 0.6646435260772705 (0.7615920975804329) | > loss_feat: 3.9964239597320557 (6.108232511414422) | > loss_mel: 20.782258987426758 (22.225800620185005) | > loss_duration: 1.2976740598678589 (1.327824552853902) | > loss_1: 29.15777015686035 (32.71769799126519) | > grad_norm_1: tensor(2043.4583, device='cuda:0') (tensor(7287.3110, device='cuda:0')) | > current_lr_0: 6.077891419659354e-05 | > current_lr_1: 6.083972731317935e-05 | > step_time: 0.8144 (0.6236737039354112) | > loader_time: 0.0262 (0.023302025265163846)  --> TIME: 2023-10-20 15:08:23 -- STEP: 39/50 -- GLOBAL_STEP: 112590 | > loss_disc: 2.9703147411346436 (2.4150702128043533) | > loss_disc_real_0: 0.36452335119247437 (0.13890546415813074) | > loss_disc_real_1: 0.2649416923522949 (0.22057855286850378) | > loss_disc_real_2: 0.2452414333820343 (0.22859079639116922) | > loss_disc_real_3: 0.25667524337768555 (0.2373955807624719) | > loss_disc_real_4: 0.24217897653579712 (0.2241322029955112) | > loss_disc_real_5: 0.25742289423942566 (0.22118683136068285) | > loss_0: 2.9703147411346436 (2.4150702128043533) | > grad_norm_0: tensor(2153.2727, device='cuda:0') (tensor(745.7424, device='cuda:0')) | > loss_gen: 1.6852772235870361 (2.3592845598856607) | > loss_kl: 0.5804208517074585 (0.7921581789851189) | > loss_feat: 0.2192755937576294 (6.0266325779450245) | > loss_mel: 1.8807579278945923 (20.248814867093014) | > loss_duration: 1.3961107730865479 (1.316064403607295) | > loss_1: 5.761841773986816 (30.742954229697204) | > grad_norm_1: tensor(21847.8418, device='cuda:0') (tensor(18686.8711, device='cuda:0')) | > current_lr_0: 6.077891419659354e-05 | > current_lr_1: 6.083972731317935e-05 | > step_time: 0.8095 (0.5997407864301633) | > loader_time: 0.0254 (0.015659161103077423)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.091327667236328 (2.091327667236328) | > loss_disc_real_0: 0.19291549921035767 (0.19291549921035767) | > loss_disc_real_1: 0.24543404579162598 (0.24543404579162598) | > loss_disc_real_2: 0.19981376826763153 (0.19981376826763153) | > loss_disc_real_3: 0.2859761714935303 (0.2859761714935303) | > loss_disc_real_4: 0.08614633977413177 (0.08614633977413177) | > loss_disc_real_5: 0.20813676714897156 (0.20813676714897156) | > loss_0: 2.091327667236328 (2.091327667236328) | > loss_gen: 2.7130908966064453 (2.7130908966064453) | > loss_kl: 6.336631774902344 (6.336631774902344) | > loss_feat: 6.939328193664551 (6.939328193664551) | > loss_mel: 21.488435745239258 (21.488435745239258) | > loss_duration: 3.1825456619262695 (3.1825456619262695) | > loss_1: 40.660030364990234 (40.660030364990234)  --> STEP: 1 | > loss_disc: 3.290276288986206 (3.290276288986206) | > loss_disc_real_0: 0.7000142335891724 (0.7000142335891724) | > loss_disc_real_1: 0.25855422019958496 (0.25855422019958496) | > loss_disc_real_2: 0.3791639804840088 (0.3791639804840088) | > loss_disc_real_3: 0.30492961406707764 (0.30492961406707764) | > loss_disc_real_4: 0.3389550447463989 (0.3389550447463989) | > loss_disc_real_5: 0.32485294342041016 (0.32485294342041016) | > loss_0: 3.290276288986206 (3.290276288986206) | > loss_gen: 2.4042952060699463 (2.4042952060699463) | > loss_kl: 5.656991004943848 (5.656991004943848) | > loss_feat: 3.098097324371338 (3.098097324371338) | > loss_mel: 21.561616897583008 (21.561616897583008) | > loss_duration: 3.4076242446899414 (3.4076242446899414) | > loss_1: 36.128623962402344 (36.128623962402344)  --> STEP: 2 | > loss_disc: 2.628329038619995 (2.9593026638031006) | > loss_disc_real_0: 0.35431408882141113 (0.5271641612052917) | > loss_disc_real_1: 0.115850530564785 (0.18720237538218498) | > loss_disc_real_2: 0.17117422819137573 (0.27516910433769226) | > loss_disc_real_3: 0.13311487436294556 (0.2190222442150116) | > loss_disc_real_4: 0.31736814975738525 (0.3281615972518921) | > loss_disc_real_5: 0.2524876892566681 (0.2886703163385391) | > loss_0: 2.628329038619995 (2.9593026638031006) | > loss_gen: 2.234779119491577 (2.3195371627807617) | > loss_kl: 5.89535665512085 (5.776173830032349) | > loss_feat: 6.8117756843566895 (4.954936504364014) | > loss_mel: 22.915721893310547 (22.238669395446777) | > loss_duration: 3.3490965366363525 (3.378360390663147) | > loss_1: 41.20673370361328 (38.66767883300781)  --> STEP: 3 | > loss_disc: 3.5834858417510986 (3.1673637231191) | > loss_disc_real_0: 0.9038819074630737 (0.6527367432912191) | > loss_disc_real_1: 0.3252297341823578 (0.23321149498224258) | > loss_disc_real_2: 0.3310033082962036 (0.29378050565719604) | > loss_disc_real_3: 0.3287637233734131 (0.2556027372678121) | > loss_disc_real_4: 0.300839900970459 (0.31905436515808105) | > loss_disc_real_5: 0.3325725793838501 (0.30330440402030945) | > loss_0: 3.5834858417510986 (3.1673637231191) | > loss_gen: 2.7990057468414307 (2.479360024134318) | > loss_kl: 2.8066012859344482 (4.786316315333049) | > loss_feat: 2.7131588459014893 (4.207677284876506) | > loss_mel: 21.127195358276367 (21.86817804972331) | > loss_duration: 2.968937873840332 (3.2418862183888755) | > loss_1: 32.41489791870117 (36.58341852823893) --> EVAL PERFORMANCE | > avg_loader_time: 0.015511592229207357 (-0.006113290786743162) | > avg_loss_disc: 3.1673637231191 (+0.21196675300598145) | > avg_loss_disc_real_0: 0.6527367432912191 (+0.3106484860181809) | > avg_loss_disc_real_1: 0.23321149498224258 (-0.030139468610286713) | > avg_loss_disc_real_2: 0.29378050565719604 (+0.003940815726916014) | > avg_loss_disc_real_3: 0.2556027372678121 (-0.032575289408365904) | > avg_loss_disc_real_4: 0.31905436515808105 (+0.049009770154953) | > avg_loss_disc_real_5: 0.30330440402030945 (+0.017433871825536074) | > avg_loss_0: 3.1673637231191 (+0.21196675300598145) | > avg_loss_gen: 2.479360024134318 (+0.4696866273880005) | > avg_loss_kl: 4.786316315333049 (-0.3028838634490967) | > avg_loss_feat: 4.207677284876506 (+1.6773955225944523) | > avg_loss_mel: 21.86817804972331 (+4.871279716491699) | > avg_loss_duration: 3.2418862183888755 (-0.016228596369425308) | > avg_loss_1: 36.58341852823893 (+6.699249903361)  > EPOCH: 1192/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:08:47)   --> TIME: 2023-10-20 15:09:02 -- STEP: 19/50 -- GLOBAL_STEP: 112620 | > loss_disc: 1.9884239435195923 (2.5819408893585205) | > loss_disc_real_0: 0.2969968318939209 (0.18925924765828409) | > loss_disc_real_1: 0.20006009936332703 (0.2310130772622008) | > loss_disc_real_2: 0.1970517486333847 (0.2347318857516113) | > loss_disc_real_3: 0.12080852687358856 (0.22955013909622243) | > loss_disc_real_4: 0.13091261684894562 (0.22705420420358055) | > loss_disc_real_5: 0.07509396225214005 (0.22341421873945938) | > loss_0: 1.9884239435195923 (2.5819408893585205) | > grad_norm_0: tensor(639.4620, device='cuda:0') (tensor(727.6374, device='cuda:0')) | > loss_gen: 2.552435874938965 (2.1468356534054407) | > loss_kl: 0.5093128681182861 (0.9117688222935325) | > loss_feat: 7.0480546951293945 (4.9905061811993) | > loss_mel: 26.066469192504883 (18.712127930239628) | > loss_duration: 1.4070398807525635 (1.3496787108873065) | > loss_1: 37.58331298828125 (28.110917342336553) | > grad_norm_1: tensor(16334.7324, device='cuda:0') (tensor(16096.9561, device='cuda:0')) | > current_lr_0: 6.0718161866525246e-05 | > current_lr_1: 6.077891419659354e-05 | > step_time: 0.3405 (0.44117463262457596) | > loader_time: 0.0102 (0.01575979433561626)  --> TIME: 2023-10-20 15:09:17 -- STEP: 49/50 -- GLOBAL_STEP: 112650 | > loss_disc: 2.5352330207824707 (2.540754050624613) | > loss_disc_real_0: 0.08761628717184067 (0.1774631713193898) | > loss_disc_real_1: 0.19013912975788116 (0.22531182695256205) | > loss_disc_real_2: 0.11914333701133728 (0.23335599503955062) | > loss_disc_real_3: 0.28468087315559387 (0.22533186692364363) | > loss_disc_real_4: 0.22815930843353271 (0.23082722335749742) | > loss_disc_real_5: 0.2669472396373749 (0.2439693653842016) | > loss_0: 2.5352330207824707 (2.540754050624613) | > grad_norm_0: tensor(682.0566, device='cuda:0') (tensor(667.0413, device='cuda:0')) | > loss_gen: 1.7997524738311768 (2.1741181879627463) | > loss_kl: 0.7170858979225159 (0.7849793482799919) | > loss_feat: 1.8363016843795776 (5.052256335865479) | > loss_mel: 20.24612808227539 (19.198179012658645) | > loss_duration: 1.4074852466583252 (1.3176960823487263) | > loss_1: 26.00675392150879 (28.52722875439391) | > grad_norm_1: tensor(2003.5298, device='cuda:0') (tensor(16926.1855, device='cuda:0')) | > current_lr_0: 6.0718161866525246e-05 | > current_lr_1: 6.077891419659354e-05 | > step_time: 0.5309 (0.4661055341058848) | > loader_time: 0.3822 (0.018609805982940052)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8595516681671143 (2.8595516681671143) | > loss_disc_real_0: 0.25952577590942383 (0.25952577590942383) | > loss_disc_real_1: 0.36808186769485474 (0.36808186769485474) | > loss_disc_real_2: 0.16836223006248474 (0.16836223006248474) | > loss_disc_real_3: 0.49330151081085205 (0.49330151081085205) | > loss_disc_real_4: 0.38526278734207153 (0.38526278734207153) | > loss_disc_real_5: 0.38266509771347046 (0.38266509771347046) | > loss_0: 2.8595516681671143 (2.8595516681671143) | > loss_gen: 2.797729015350342 (2.797729015350342) | > loss_kl: 5.650970458984375 (5.650970458984375) | > loss_feat: 6.720534324645996 (6.720534324645996) | > loss_mel: 23.644121170043945 (23.644121170043945) | > loss_duration: 3.1245808601379395 (3.1245808601379395) | > loss_1: 41.93793487548828 (41.93793487548828)  --> STEP: 1 | > loss_disc: 2.683091878890991 (2.683091878890991) | > loss_disc_real_0: 0.07954756170511246 (0.07954756170511246) | > loss_disc_real_1: 0.27052316069602966 (0.27052316069602966) | > loss_disc_real_2: 0.23119515180587769 (0.23119515180587769) | > loss_disc_real_3: 0.2958207130432129 (0.2958207130432129) | > loss_disc_real_4: 0.1975879967212677 (0.1975879967212677) | > loss_disc_real_5: 0.26566454768180847 (0.26566454768180847) | > loss_0: 2.683091878890991 (2.683091878890991) | > loss_gen: 1.9941602945327759 (1.9941602945327759) | > loss_kl: 5.646788120269775 (5.646788120269775) | > loss_feat: 7.738615036010742 (7.738615036010742) | > loss_mel: 24.674591064453125 (24.674591064453125) | > loss_duration: 3.4634077548980713 (3.4634077548980713) | > loss_1: 43.51756286621094 (43.51756286621094)  --> STEP: 2 | > loss_disc: 2.960202217102051 (2.821647047996521) | > loss_disc_real_0: 0.251170814037323 (0.16535918787121773) | > loss_disc_real_1: 0.2518734335899353 (0.2611982971429825) | > loss_disc_real_2: 0.25479573011398315 (0.24299544095993042) | > loss_disc_real_3: 0.26943182945251465 (0.28262627124786377) | > loss_disc_real_4: 0.21064355969429016 (0.20411577820777893) | > loss_disc_real_5: 0.23442107439041138 (0.2500428110361099) | > loss_0: 2.960202217102051 (2.821647047996521) | > loss_gen: 1.632676124572754 (1.813418209552765) | > loss_kl: 6.092053413391113 (5.869420766830444) | > loss_feat: 1.6398347616195679 (4.689224898815155) | > loss_mel: 19.892333984375 (22.283462524414062) | > loss_duration: 3.2331652641296387 (3.348286509513855) | > loss_1: 32.49006271362305 (38.00381278991699)  --> STEP: 3 | > loss_disc: 3.005425453186035 (2.882906516393026) | > loss_disc_real_0: 0.24023599922657013 (0.19031812498966852) | > loss_disc_real_1: 0.22998163104057312 (0.2507927417755127) | > loss_disc_real_2: 0.2852012813091278 (0.2570640544096629) | > loss_disc_real_3: 0.2639830410480499 (0.27641186118125916) | > loss_disc_real_4: 0.225061297416687 (0.21109761794408163) | > loss_disc_real_5: 0.2692146599292755 (0.2564334273338318) | > loss_0: 3.005425453186035 (2.882906516393026) | > loss_gen: 1.5129737854003906 (1.7132700681686401) | > loss_kl: 2.801510810852051 (4.8467841148376465) | > loss_feat: 0.09516654908657074 (3.1578721155722937) | > loss_mel: 2.5700645446777344 (15.712329864501953) | > loss_duration: 3.0521273612976074 (3.2495667934417725) | > loss_1: 10.031843185424805 (28.67982292175293) --> EVAL PERFORMANCE | > avg_loader_time: 0.012418985366821289 (-0.0030926068623860683) | > avg_loss_disc: 2.882906516393026 (-0.2844572067260742) | > avg_loss_disc_real_0: 0.19031812498966852 (-0.4624186183015506) | > avg_loss_disc_real_1: 0.2507927417755127 (+0.01758124679327011) | > avg_loss_disc_real_2: 0.2570640544096629 (-0.036716451247533144) | > avg_loss_disc_real_3: 0.27641186118125916 (+0.02080912391344708) | > avg_loss_disc_real_4: 0.21109761794408163 (-0.10795674721399942) | > avg_loss_disc_real_5: 0.2564334273338318 (-0.04687097668647766) | > avg_loss_0: 2.882906516393026 (-0.2844572067260742) | > avg_loss_gen: 1.7132700681686401 (-0.7660899559656777) | > avg_loss_kl: 4.8467841148376465 (+0.060467799504597686) | > avg_loss_feat: 3.1578721155722937 (-1.049805169304212) | > avg_loss_mel: 15.712329864501953 (-6.155848185221355) | > avg_loss_duration: 3.2495667934417725 (+0.007680575052896987) | > avg_loss_1: 28.67982292175293 (-7.903595606486)  > EPOCH: 1193/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:09:40)   --> TIME: 2023-10-20 15:10:05 -- STEP: 29/50 -- GLOBAL_STEP: 112680 | > loss_disc: 1.4445910453796387 (2.2525297321122273) | > loss_disc_real_0: 0.013519339263439178 (0.14801211500989978) | > loss_disc_real_1: 0.11933566629886627 (0.22440724537290377) | > loss_disc_real_2: 0.13565212488174438 (0.212246835231781) | > loss_disc_real_3: 0.21862274408340454 (0.23797858031145458) | > loss_disc_real_4: 0.043758973479270935 (0.18627120303953515) | > loss_disc_real_5: 0.04227420315146446 (0.1902695345724451) | > loss_0: 1.4445910453796387 (2.2525297321122273) | > grad_norm_0: tensor(398.9070, device='cuda:0') (tensor(562.7605, device='cuda:0')) | > loss_gen: 2.7350025177001953 (2.448093422527971) | > loss_kl: 0.7861223220825195 (0.8467325527092506) | > loss_feat: 8.739401817321777 (6.6812083412861005) | > loss_mel: 23.227079391479492 (22.27025032043457) | > loss_duration: 1.3047655820846558 (1.3303287563652828) | > loss_1: 36.79236602783203 (33.57661253830482) | > grad_norm_1: tensor(13188.2314, device='cuda:0') (tensor(20736.8281, device='cuda:0')) | > current_lr_0: 6.065747026221452e-05 | > current_lr_1: 6.0718161866525246e-05 | > step_time: 0.6091 (0.6388800390835466) | > loader_time: 0.0368 (0.025276389615289097)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5299720764160156 (2.5299720764160156) | > loss_disc_real_0: 0.17431864142417908 (0.17431864142417908) | > loss_disc_real_1: 0.1700025349855423 (0.1700025349855423) | > loss_disc_real_2: 0.15074829757213593 (0.15074829757213593) | > loss_disc_real_3: 0.2186415046453476 (0.2186415046453476) | > loss_disc_real_4: 0.23741094768047333 (0.23741094768047333) | > loss_disc_real_5: 0.2794422507286072 (0.2794422507286072) | > loss_0: 2.5299720764160156 (2.5299720764160156) | > loss_gen: 2.0006861686706543 (2.0006861686706543) | > loss_kl: 5.88779878616333 (5.88779878616333) | > loss_feat: 5.325053691864014 (5.325053691864014) | > loss_mel: 22.97740936279297 (22.97740936279297) | > loss_duration: 3.2023184299468994 (3.2023184299468994) | > loss_1: 39.39326858520508 (39.39326858520508)  --> STEP: 1 | > loss_disc: 2.782783269882202 (2.782783269882202) | > loss_disc_real_0: 0.48952436447143555 (0.48952436447143555) | > loss_disc_real_1: 0.29089587926864624 (0.29089587926864624) | > loss_disc_real_2: 0.13628102838993073 (0.13628102838993073) | > loss_disc_real_3: 0.35453179478645325 (0.35453179478645325) | > loss_disc_real_4: 0.20007172226905823 (0.20007172226905823) | > loss_disc_real_5: 0.19689424335956573 (0.19689424335956573) | > loss_0: 2.782783269882202 (2.782783269882202) | > loss_gen: 2.2748844623565674 (2.2748844623565674) | > loss_kl: 5.639554023742676 (5.639554023742676) | > loss_feat: 5.97753381729126 (5.97753381729126) | > loss_mel: 23.371868133544922 (23.371868133544922) | > loss_duration: 3.4203476905822754 (3.4203476905822754) | > loss_1: 40.68418884277344 (40.68418884277344)  --> STEP: 2 | > loss_disc: 3.390179395675659 (3.0864813327789307) | > loss_disc_real_0: 0.6391830444335938 (0.5643537044525146) | > loss_disc_real_1: 0.29916903376579285 (0.29503245651721954) | > loss_disc_real_2: 0.3578910529613495 (0.2470860406756401) | > loss_disc_real_3: 0.33228811621665955 (0.3434099555015564) | > loss_disc_real_4: 0.25870463252067566 (0.22938817739486694) | > loss_disc_real_5: 0.3697066307067871 (0.2833004370331764) | > loss_0: 3.390179395675659 (3.0864813327789307) | > loss_gen: 2.3506157398223877 (2.3127501010894775) | > loss_kl: 6.180696487426758 (5.910125255584717) | > loss_feat: 4.298798084259033 (5.1381659507751465) | > loss_mel: 26.924072265625 (25.14797019958496) | > loss_duration: 3.2147679328918457 (3.3175578117370605) | > loss_1: 42.96894836425781 (41.826568603515625)  --> STEP: 3 | > loss_disc: 3.003413677215576 (3.0587921142578125) | > loss_disc_real_0: 0.49656862020492554 (0.541758676369985) | > loss_disc_real_1: 0.28612878918647766 (0.29206456740697223) | > loss_disc_real_2: 0.3430540859699249 (0.27907538910706836) | > loss_disc_real_3: 0.2899811565876007 (0.32560035586357117) | > loss_disc_real_4: 0.24333806335926056 (0.23403813938299814) | > loss_disc_real_5: 0.3218317925930023 (0.29614422221978504) | > loss_0: 3.003413677215576 (3.0587921142578125) | > loss_gen: 2.2832188606262207 (2.302906354268392) | > loss_kl: 2.8002424240112305 (4.873497645060222) | > loss_feat: 1.8562142848968506 (4.044182062149048) | > loss_mel: 16.42342185974121 (22.239787419637043) | > loss_duration: 3.020838499069214 (3.218651374181112) | > loss_1: 26.383935928344727 (36.67902437845866) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022253195444742837 (-0.010193665822347006) | > avg_loss_disc: 3.0587921142578125 (+0.17588559786478664) | > avg_loss_disc_real_0: 0.541758676369985 (+0.3514405513803165) | > avg_loss_disc_real_1: 0.29206456740697223 (+0.041271825631459536) | > avg_loss_disc_real_2: 0.27907538910706836 (+0.02201133469740546) | > avg_loss_disc_real_3: 0.32560035586357117 (+0.04918849468231201) | > avg_loss_disc_real_4: 0.23403813938299814 (+0.022940521438916506) | > avg_loss_disc_real_5: 0.29614422221978504 (+0.03971079488595325) | > avg_loss_0: 3.0587921142578125 (+0.17588559786478664) | > avg_loss_gen: 2.302906354268392 (+0.5896362860997519) | > avg_loss_kl: 4.873497645060222 (+0.026713530222575166) | > avg_loss_feat: 4.044182062149048 (+0.8863099465767541) | > avg_loss_mel: 22.239787419637043 (+6.52745755513509) | > avg_loss_duration: 3.218651374181112 (-0.03091541926066066) | > avg_loss_1: 36.67902437845866 (+7.999201456705727)  > EPOCH: 1194/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:10:34)   --> TIME: 2023-10-20 15:10:58 -- STEP: 9/50 -- GLOBAL_STEP: 112710 | > loss_disc: 2.1788992881774902 (2.3869656324386597) | > loss_disc_real_0: 0.13763141632080078 (0.09438169602718618) | > loss_disc_real_1: 0.2168450951576233 (0.19712955256303152) | > loss_disc_real_2: 0.19040223956108093 (0.21741713500685161) | > loss_disc_real_3: 0.274480402469635 (0.17820888799097803) | > loss_disc_real_4: 0.13742248713970184 (0.18553189229634073) | > loss_disc_real_5: 0.1099228709936142 (0.19485984825425678) | > loss_0: 2.1788992881774902 (2.3869656324386597) | > grad_norm_0: tensor(473.9922, device='cuda:0') (tensor(537.3748, device='cuda:0')) | > loss_gen: 2.393145799636841 (2.221194042099847) | > loss_kl: 0.7711372971534729 (0.9981670214070214) | > loss_feat: 5.635026454925537 (7.775490178002252) | > loss_mel: 23.09578514099121 (22.497333526611328) | > loss_duration: 1.3022265434265137 (1.3239362637201946) | > loss_1: 33.197322845458984 (34.816121631198456) | > grad_norm_1: tensor(18646.3359, device='cuda:0') (tensor(35266.1445, device='cuda:0')) | > current_lr_0: 6.0596839322962145e-05 | > current_lr_1: 6.065747026221452e-05 | > step_time: 0.5957 (0.6276902357737223) | > loader_time: 0.0068 (0.022485733032226562)  --> TIME: 2023-10-20 15:11:17 -- STEP: 39/50 -- GLOBAL_STEP: 112740 | > loss_disc: 2.5646369457244873 (2.4030266969631886) | > loss_disc_real_0: 0.12892816960811615 (0.1372235994786024) | > loss_disc_real_1: 0.2803688943386078 (0.22552721594006586) | > loss_disc_real_2: 0.33899062871932983 (0.23066480887623933) | > loss_disc_real_3: 0.20352698862552643 (0.21802151532700428) | > loss_disc_real_4: 0.26559096574783325 (0.207919532003311) | > loss_disc_real_5: 0.3046743869781494 (0.2111739500377996) | > loss_0: 2.5646369457244873 (2.4030266969631886) | > grad_norm_0: tensor(844.7928, device='cuda:0') (tensor(701.5333, device='cuda:0')) | > loss_gen: 2.16593337059021 (2.292126472179706) | > loss_kl: 0.3880541920661926 (0.8115493357181549) | > loss_feat: 2.7298173904418945 (5.8252565658722935) | > loss_mel: 19.95850372314453 (19.499953786532085) | > loss_duration: 1.4421448707580566 (1.328700670829186) | > loss_1: 26.6844539642334 (29.757586723718887) | > grad_norm_1: tensor(6197.4341, device='cuda:0') (tensor(25843.1602, device='cuda:0')) | > current_lr_0: 6.0596839322962145e-05 | > current_lr_1: 6.065747026221452e-05 | > step_time: 0.8231 (0.6176750170878876) | > loader_time: 0.0275 (0.02454379277351575)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.744807243347168 (2.744807243347168) | > loss_disc_real_0: 0.10722555220127106 (0.10722555220127106) | > loss_disc_real_1: 0.2632785737514496 (0.2632785737514496) | > loss_disc_real_2: 0.25010865926742554 (0.25010865926742554) | > loss_disc_real_3: 0.2158443182706833 (0.2158443182706833) | > loss_disc_real_4: 0.2082880735397339 (0.2082880735397339) | > loss_disc_real_5: 0.24030911922454834 (0.24030911922454834) | > loss_0: 2.744807243347168 (2.744807243347168) | > loss_gen: 1.7546792030334473 (1.7546792030334473) | > loss_kl: 5.399795055389404 (5.399795055389404) | > loss_feat: 2.946662664413452 (2.946662664413452) | > loss_mel: 22.908836364746094 (22.908836364746094) | > loss_duration: 3.0015909671783447 (3.0015909671783447) | > loss_1: 36.011566162109375 (36.011566162109375)  --> STEP: 1 | > loss_disc: 1.830502986907959 (1.830502986907959) | > loss_disc_real_0: 0.1870056688785553 (0.1870056688785553) | > loss_disc_real_1: 0.2401687502861023 (0.2401687502861023) | > loss_disc_real_2: 0.18603400886058807 (0.18603400886058807) | > loss_disc_real_3: 0.2921844720840454 (0.2921844720840454) | > loss_disc_real_4: 0.12675288319587708 (0.12675288319587708) | > loss_disc_real_5: 0.07882209122180939 (0.07882209122180939) | > loss_0: 1.830502986907959 (1.830502986907959) | > loss_gen: 2.97949481010437 (2.97949481010437) | > loss_kl: 5.925346374511719 (5.925346374511719) | > loss_feat: 9.33594036102295 (9.33594036102295) | > loss_mel: 22.223703384399414 (22.223703384399414) | > loss_duration: 3.3754665851593018 (3.3754665851593018) | > loss_1: 43.83995056152344 (43.83995056152344)  --> STEP: 2 | > loss_disc: 2.7661590576171875 (2.2983310222625732) | > loss_disc_real_0: 0.17831194400787354 (0.18265880644321442) | > loss_disc_real_1: 0.44152697920799255 (0.3408478647470474) | > loss_disc_real_2: 0.2772020697593689 (0.23161803930997849) | > loss_disc_real_3: 0.6421086192131042 (0.46714654564857483) | > loss_disc_real_4: 0.2027067244052887 (0.16472980380058289) | > loss_disc_real_5: 0.3380640149116516 (0.2084430530667305) | > loss_0: 2.7661590576171875 (2.2983310222625732) | > loss_gen: 2.9246201515197754 (2.9520574808120728) | > loss_kl: 5.669188976287842 (5.79726767539978) | > loss_feat: 7.85077428817749 (8.59335732460022) | > loss_mel: 20.439393997192383 (21.3315486907959) | > loss_duration: 3.279973030090332 (3.327719807624817) | > loss_1: 40.1639518737793 (42.00195121765137)  --> STEP: 3 | > loss_disc: 2.743058681488037 (2.446573575337728) | > loss_disc_real_0: 0.2506224811077118 (0.20531336466471353) | > loss_disc_real_1: 0.2900408208370209 (0.32391218344370526) | > loss_disc_real_2: 0.2962990403175354 (0.2531783729791641) | > loss_disc_real_3: 0.22714745998382568 (0.38714685042699176) | > loss_disc_real_4: 0.386308878660202 (0.23858949542045593) | > loss_disc_real_5: 0.4772467613220215 (0.2980442891518275) | > loss_0: 2.743058681488037 (2.446573575337728) | > loss_gen: 2.761535167694092 (2.888550043106079) | > loss_kl: 2.7307262420654297 (4.775087197621663) | > loss_feat: 4.494950294494629 (7.227221647898356) | > loss_mel: 20.097013473510742 (20.920036951700848) | > loss_duration: 3.0352587699890137 (3.2302327950795493) | > loss_1: 33.119483947753906 (39.04112879435221) --> EVAL PERFORMANCE | > avg_loader_time: 0.0026226043701171875 (+0.0003972848256429038) | > avg_loss_disc: 2.446573575337728 (-0.6122185389200845) | > avg_loss_disc_real_0: 0.20531336466471353 (-0.3364453117052715) | > avg_loss_disc_real_1: 0.32391218344370526 (+0.03184761603673303) | > avg_loss_disc_real_2: 0.2531783729791641 (-0.025897016127904238) | > avg_loss_disc_real_3: 0.38714685042699176 (+0.061546494563420595) | > avg_loss_disc_real_4: 0.23858949542045593 (+0.004551356037457793) | > avg_loss_disc_real_5: 0.2980442891518275 (+0.0019000669320424768) | > avg_loss_0: 2.446573575337728 (-0.6122185389200845) | > avg_loss_gen: 2.888550043106079 (+0.585643688837687) | > avg_loss_kl: 4.775087197621663 (-0.09841044743855853) | > avg_loss_feat: 7.227221647898356 (+3.1830395857493086) | > avg_loss_mel: 20.920036951700848 (-1.3197504679361955) | > avg_loss_duration: 3.2302327950795493 (+0.0115814208984375) | > avg_loss_1: 39.04112879435221 (+2.3621044158935547)  > EPOCH: 1195/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:11:49)   --> TIME: 2023-10-20 15:12:08 -- STEP: 19/50 -- GLOBAL_STEP: 112770 | > loss_disc: 2.3855319023132324 (2.4282383793278743) | > loss_disc_real_0: 0.0707688257098198 (0.12110027558121242) | > loss_disc_real_1: 0.29341959953308105 (0.24620817425219635) | > loss_disc_real_2: 0.223215714097023 (0.2686879634857178) | > loss_disc_real_3: 0.3253924548625946 (0.2468697991418211) | > loss_disc_real_4: 0.36907798051834106 (0.24636297927875267) | > loss_disc_real_5: 0.3641929030418396 (0.2500459413093172) | > loss_0: 2.3855319023132324 (2.4282383793278743) | > grad_norm_0: tensor(509.2537, device='cuda:0') (tensor(562.5198, device='cuda:0')) | > loss_gen: 3.0559468269348145 (2.5453631752415706) | > loss_kl: 1.0631492137908936 (0.9148434463300203) | > loss_feat: 6.866807460784912 (7.103457292639895) | > loss_mel: 21.47138786315918 (21.85124116822293) | > loss_duration: 1.391459584236145 (1.3422436149496781) | > loss_1: 33.848751068115234 (33.75714851680555) | > grad_norm_1: tensor(5537.2461, device='cuda:0') (tensor(27428.3496, device='cuda:0')) | > current_lr_0: 6.053626898812962e-05 | > current_lr_1: 6.0596839322962145e-05 | > step_time: 0.819 (0.6538357107262862) | > loader_time: 0.0262 (0.019201630040218954)  --> TIME: 2023-10-20 15:12:26 -- STEP: 49/50 -- GLOBAL_STEP: 112800 | > loss_disc: 2.6019339561462402 (2.4784504807725245) | > loss_disc_real_0: 0.020623307675123215 (0.13306918814398191) | > loss_disc_real_1: 0.2669201195240021 (0.24028693223182035) | > loss_disc_real_2: 0.07144513726234436 (0.23509814529394613) | > loss_disc_real_3: 0.29924115538597107 (0.2413811636518459) | > loss_disc_real_4: 0.24958516657352448 (0.23916945203530546) | > loss_disc_real_5: 0.28832361102104187 (0.24271173429276263) | > loss_0: 2.6019339561462402 (2.4784504807725245) | > grad_norm_0: tensor(2030.1990, device='cuda:0') (tensor(645.2863, device='cuda:0')) | > loss_gen: 1.7645020484924316 (2.293517616330361) | > loss_kl: 0.31710124015808105 (0.7686796322160839) | > loss_feat: 2.20853853225708 (5.887215204955059) | > loss_mel: 19.00916862487793 (20.08705707228913) | > loss_duration: 1.4315587282180786 (1.3103555805829104) | > loss_1: 24.73086929321289 (30.346825152027364) | > grad_norm_1: tensor(7635.8687, device='cuda:0') (tensor(20101.6094, device='cuda:0')) | > current_lr_0: 6.053626898812962e-05 | > current_lr_1: 6.0596839322962145e-05 | > step_time: 0.5375 (0.5957890919276646) | > loader_time: 0.4299 (0.026788867249780773)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.890056848526001 (2.890056848526001) | > loss_disc_real_0: 0.09704854339361191 (0.09704854339361191) | > loss_disc_real_1: 0.2737877368927002 (0.2737877368927002) | > loss_disc_real_2: 0.27438291907310486 (0.27438291907310486) | > loss_disc_real_3: 0.275336891412735 (0.275336891412735) | > loss_disc_real_4: 0.2490357756614685 (0.2490357756614685) | > loss_disc_real_5: 0.28855204582214355 (0.28855204582214355) | > loss_0: 2.890056848526001 (2.890056848526001) | > loss_gen: 1.576082468032837 (1.576082468032837) | > loss_kl: 6.980086803436279 (6.980086803436279) | > loss_feat: 0.5745874643325806 (0.5745874643325806) | > loss_mel: 13.903914451599121 (13.903914451599121) | > loss_duration: 3.2533187866210938 (3.2533187866210938) | > loss_1: 26.287988662719727 (26.287988662719727)  --> STEP: 1 | > loss_disc: 2.221729278564453 (2.221729278564453) | > loss_disc_real_0: 0.15861186385154724 (0.15861186385154724) | > loss_disc_real_1: 0.18501846492290497 (0.18501846492290497) | > loss_disc_real_2: 0.2303948551416397 (0.2303948551416397) | > loss_disc_real_3: 0.17377711832523346 (0.17377711832523346) | > loss_disc_real_4: 0.1651640087366104 (0.1651640087366104) | > loss_disc_real_5: 0.3369756042957306 (0.3369756042957306) | > loss_0: 2.221729278564453 (2.221729278564453) | > loss_gen: 2.540933609008789 (2.540933609008789) | > loss_kl: 5.894080638885498 (5.894080638885498) | > loss_feat: 9.64200496673584 (9.64200496673584) | > loss_mel: 24.6466121673584 (24.6466121673584) | > loss_duration: 3.536625862121582 (3.536625862121582) | > loss_1: 46.260257720947266 (46.260257720947266)  --> STEP: 2 | > loss_disc: 2.4786128997802734 (2.3501710891723633) | > loss_disc_real_0: 0.17463654279708862 (0.16662420332431793) | > loss_disc_real_1: 0.28582125902175903 (0.235419861972332) | > loss_disc_real_2: 0.1709747016429901 (0.2006847783923149) | > loss_disc_real_3: 0.14637328684329987 (0.16007520258426666) | > loss_disc_real_4: 0.2718307673931122 (0.2184973880648613) | > loss_disc_real_5: 0.3004705607891083 (0.31872308254241943) | > loss_0: 2.4786128997802734 (2.3501710891723633) | > loss_gen: 2.4602584838867188 (2.500596046447754) | > loss_kl: 6.158440589904785 (6.026260614395142) | > loss_feat: 7.224366664886475 (8.433185815811157) | > loss_mel: 22.027833938598633 (23.337223052978516) | > loss_duration: 3.2868406772613525 (3.4117332696914673) | > loss_1: 41.15774154663086 (43.70899963378906)  --> STEP: 3 | > loss_disc: 2.6690382957458496 (2.456460158030192) | > loss_disc_real_0: 0.2065981775522232 (0.17994886140028635) | > loss_disc_real_1: 0.18618881702423096 (0.2190095136562983) | > loss_disc_real_2: 0.16004157066345215 (0.187137042482694) | > loss_disc_real_3: 0.1712658554315567 (0.16380542020003) | > loss_disc_real_4: 0.10549920052289963 (0.18083132555087408) | > loss_disc_real_5: 0.1303921341896057 (0.2559460997581482) | > loss_0: 2.6690382957458496 (2.456460158030192) | > loss_gen: 1.5293941497802734 (2.1768620808919272) | > loss_kl: 3.1638145446777344 (5.072111924489339) | > loss_feat: 6.2270708084106445 (7.697814146677653) | > loss_mel: 20.87371063232422 (22.51605224609375) | > loss_duration: 3.221869707107544 (3.348445415496826) | > loss_1: 35.0158576965332 (40.811285654703774) --> EVAL PERFORMANCE | > avg_loader_time: 0.020461082458496094 (+0.017838478088378906) | > avg_loss_disc: 2.456460158030192 (+0.009886582692463897) | > avg_loss_disc_real_0: 0.17994886140028635 (-0.025364503264427185) | > avg_loss_disc_real_1: 0.2190095136562983 (-0.10490266978740695) | > avg_loss_disc_real_2: 0.187137042482694 (-0.06604133049647012) | > avg_loss_disc_real_3: 0.16380542020003 (-0.22334143022696176) | > avg_loss_disc_real_4: 0.18083132555087408 (-0.05775816986958185) | > avg_loss_disc_real_5: 0.2559460997581482 (-0.04209818939367932) | > avg_loss_0: 2.456460158030192 (+0.009886582692463897) | > avg_loss_gen: 2.1768620808919272 (-0.7116879622141519) | > avg_loss_kl: 5.072111924489339 (+0.2970247268676758) | > avg_loss_feat: 7.697814146677653 (+0.4705924987792969) | > avg_loss_mel: 22.51605224609375 (+1.5960152943929025) | > avg_loss_duration: 3.348445415496826 (+0.11821262041727687) | > avg_loss_1: 40.811285654703774 (+1.7701568603515625)  > EPOCH: 1196/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:12:43)   --> TIME: 2023-10-20 15:13:05 -- STEP: 29/50 -- GLOBAL_STEP: 112830 | > loss_disc: 1.8916186094284058 (2.348157726485154) | > loss_disc_real_0: 0.12351126968860626 (0.1443530500320525) | > loss_disc_real_1: 0.16442759335041046 (0.2244110107421875) | > loss_disc_real_2: 0.13792742788791656 (0.23127666327716975) | > loss_disc_real_3: 0.13534167408943176 (0.23647441509468803) | > loss_disc_real_4: 0.1211504116654396 (0.19508021556097885) | > loss_disc_real_5: 0.057892341166734695 (0.206168032508215) | > loss_0: 1.8916186094284058 (2.348157726485154) | > grad_norm_0: tensor(370.5062, device='cuda:0') (tensor(626.9932, device='cuda:0')) | > loss_gen: 2.380577325820923 (2.336279655325002) | > loss_kl: 1.0308130979537964 (0.9180791932961037) | > loss_feat: 9.603431701660156 (6.33986091806457) | > loss_mel: 20.993667602539062 (21.433500257031675) | > loss_duration: 1.2980295419692993 (1.3288544210894353) | > loss_1: 35.306522369384766 (32.35657453536987) | > grad_norm_1: tensor(6700.1016, device='cuda:0') (tensor(15657.5176, device='cuda:0')) | > current_lr_0: 6.0475759197139027e-05 | > current_lr_1: 6.053626898812962e-05 | > step_time: 0.7847 (0.5099039735465214) | > loader_time: 0.022 (0.018133073017514986)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3979928493499756 (2.3979928493499756) | > loss_disc_real_0: 0.3037821054458618 (0.3037821054458618) | > loss_disc_real_1: 0.21544387936592102 (0.21544387936592102) | > loss_disc_real_2: 0.20573164522647858 (0.20573164522647858) | > loss_disc_real_3: 0.22378812730312347 (0.22378812730312347) | > loss_disc_real_4: 0.14512738585472107 (0.14512738585472107) | > loss_disc_real_5: 0.1151290088891983 (0.1151290088891983) | > loss_0: 2.3979928493499756 (2.3979928493499756) | > loss_gen: 1.944251537322998 (1.944251537322998) | > loss_kl: 5.03590726852417 (5.03590726852417) | > loss_feat: 4.04036283493042 (4.04036283493042) | > loss_mel: 19.804039001464844 (19.804039001464844) | > loss_duration: 3.0901026725769043 (3.0901026725769043) | > loss_1: 33.91466522216797 (33.91466522216797)  --> STEP: 1 | > loss_disc: 2.6235592365264893 (2.6235592365264893) | > loss_disc_real_0: 0.25281351804733276 (0.25281351804733276) | > loss_disc_real_1: 0.2414928376674652 (0.2414928376674652) | > loss_disc_real_2: 0.35209500789642334 (0.35209500789642334) | > loss_disc_real_3: 0.29128822684288025 (0.29128822684288025) | > loss_disc_real_4: 0.36789146065711975 (0.36789146065711975) | > loss_disc_real_5: 0.3250496983528137 (0.3250496983528137) | > loss_0: 2.6235592365264893 (2.6235592365264893) | > loss_gen: 2.8137245178222656 (2.8137245178222656) | > loss_kl: 5.726693630218506 (5.726693630218506) | > loss_feat: 6.462549686431885 (6.462549686431885) | > loss_mel: 23.651918411254883 (23.651918411254883) | > loss_duration: 3.4096455574035645 (3.4096455574035645) | > loss_1: 42.06453323364258 (42.06453323364258)  --> STEP: 2 | > loss_disc: 2.984036445617676 (2.8037978410720825) | > loss_disc_real_0: 0.17994633316993713 (0.21637992560863495) | > loss_disc_real_1: 0.27841508388519287 (0.25995396077632904) | > loss_disc_real_2: 0.24618157744407654 (0.29913829267024994) | > loss_disc_real_3: 0.2642953097820282 (0.2777917683124542) | > loss_disc_real_4: 0.2957093417644501 (0.3318004012107849) | > loss_disc_real_5: 0.27063482999801636 (0.29784226417541504) | > loss_0: 2.984036445617676 (2.8037978410720825) | > loss_gen: 1.5646356344223022 (2.189180076122284) | > loss_kl: 5.925161361694336 (5.825927495956421) | > loss_feat: 0.08726135641336441 (3.2749055214226246) | > loss_mel: 3.886038303375244 (13.768978357315063) | > loss_duration: 3.3361976146698 (3.372921586036682) | > loss_1: 14.799293518066406 (28.431913375854492)  --> STEP: 3 | > loss_disc: 2.7483808994293213 (2.785325527191162) | > loss_disc_real_0: 0.27300146222114563 (0.23525377114613852) | > loss_disc_real_1: 0.2986561357975006 (0.27285468578338623) | > loss_disc_real_2: 0.22338157892227173 (0.2738860547542572) | > loss_disc_real_3: 0.3312157094478607 (0.29559974869092304) | > loss_disc_real_4: 0.2479861080646515 (0.3038623034954071) | > loss_disc_real_5: 0.2466135174036026 (0.28076601525147754) | > loss_0: 2.7483808994293213 (2.785325527191162) | > loss_gen: 1.9915225505828857 (2.123294234275818) | > loss_kl: 2.8934919834136963 (4.848448991775513) | > loss_feat: 1.985641360282898 (2.8451508010427156) | > loss_mel: 21.01401710510254 (16.18399127324422) | > loss_duration: 3.126757860183716 (3.29086701075236) | > loss_1: 31.011430740356445 (29.291752497355144) --> EVAL PERFORMANCE | > avg_loader_time: 0.009214639663696289 (-0.011246442794799805) | > avg_loss_disc: 2.785325527191162 (+0.3288653691609702) | > avg_loss_disc_real_0: 0.23525377114613852 (+0.05530490974585217) | > avg_loss_disc_real_1: 0.27285468578338623 (+0.05384517212708792) | > avg_loss_disc_real_2: 0.2738860547542572 (+0.0867490122715632) | > avg_loss_disc_real_3: 0.29559974869092304 (+0.13179432849089304) | > avg_loss_disc_real_4: 0.3038623034954071 (+0.12303097794453302) | > avg_loss_disc_real_5: 0.28076601525147754 (+0.024819915493329348) | > avg_loss_0: 2.785325527191162 (+0.3288653691609702) | > avg_loss_gen: 2.123294234275818 (-0.05356784661610936) | > avg_loss_kl: 4.848448991775513 (-0.2236629327138262) | > avg_loss_feat: 2.8451508010427156 (-4.852663345634937) | > avg_loss_mel: 16.18399127324422 (-6.332060972849529) | > avg_loss_duration: 3.29086701075236 (-0.057578404744466294) | > avg_loss_1: 29.291752497355144 (-11.51953315734863)  > EPOCH: 1197/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:13:36)   --> TIME: 2023-10-20 15:13:47 -- STEP: 9/50 -- GLOBAL_STEP: 112860 | > loss_disc: 1.7659499645233154 (2.3376992808447943) | > loss_disc_real_0: 0.06432805955410004 (0.13178328864483368) | > loss_disc_real_1: 0.2067824751138687 (0.2210006962219874) | > loss_disc_real_2: 0.17207026481628418 (0.19138027975956598) | > loss_disc_real_3: 0.1972620040178299 (0.2509761100841893) | > loss_disc_real_4: 0.104830801486969 (0.18121596260203254) | > loss_disc_real_5: 0.12465208023786545 (0.20830465708341864) | > loss_0: 1.7659499645233154 (2.3376992808447943) | > grad_norm_0: tensor(355.2456, device='cuda:0') (tensor(675.1236, device='cuda:0')) | > loss_gen: 2.6486105918884277 (2.3118467728296914) | > loss_kl: 0.8257964253425598 (0.8514822125434875) | > loss_feat: 7.220003128051758 (6.0461935847997665) | > loss_mel: 20.002599716186523 (19.872528976864285) | > loss_duration: 1.2609326839447021 (1.335149884223938) | > loss_1: 31.957942962646484 (30.41720167795817) | > grad_norm_1: tensor(12001.5684, device='cuda:0') (tensor(17139.1523, device='cuda:0')) | > current_lr_0: 6.041530988947301e-05 | > current_lr_1: 6.0475759197139027e-05 | > step_time: 0.6438 (0.5831955538855659) | > loader_time: 0.0344 (0.022742430369059246)  --> TIME: 2023-10-20 15:14:08 -- STEP: 39/50 -- GLOBAL_STEP: 112890 | > loss_disc: 2.4164695739746094 (2.4459412495295205) | > loss_disc_real_0: 0.4745164215564728 (0.1532386478442603) | > loss_disc_real_1: 0.2919514775276184 (0.22818769419040436) | > loss_disc_real_2: 0.1884724199771881 (0.21102253863444695) | > loss_disc_real_3: 0.35431528091430664 (0.25586593743318164) | > loss_disc_real_4: 0.2934933006763458 (0.2275704178863611) | > loss_disc_real_5: 0.09355372935533524 (0.2323290043247816) | > loss_0: 2.4164695739746094 (2.4459412495295205) | > grad_norm_0: tensor(1639.8307, device='cuda:0') (tensor(696.6062, device='cuda:0')) | > loss_gen: 2.8619470596313477 (2.2836302335445695) | > loss_kl: 0.5904214978218079 (0.8520440994164883) | > loss_feat: 4.7076239585876465 (5.299273311900786) | > loss_mel: 21.471113204956055 (20.655086048138447) | > loss_duration: 1.40919029712677 (1.3239938784868288) | > loss_1: 31.040298461914062 (30.414027311863045) | > grad_norm_1: tensor(13522.8320, device='cuda:0') (tensor(16533.2031, device='cuda:0')) | > current_lr_0: 6.041530988947301e-05 | > current_lr_1: 6.0475759197139027e-05 | > step_time: 0.784 (0.6294206411410601) | > loader_time: 0.0101 (0.022364359635573167)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7668683528900146 (2.7668683528900146) | > loss_disc_real_0: 0.49207812547683716 (0.49207812547683716) | > loss_disc_real_1: 0.1825917661190033 (0.1825917661190033) | > loss_disc_real_2: 0.22631050646305084 (0.22631050646305084) | > loss_disc_real_3: 0.25209543108940125 (0.25209543108940125) | > loss_disc_real_4: 0.3233463168144226 (0.3233463168144226) | > loss_disc_real_5: 0.3744826912879944 (0.3744826912879944) | > loss_0: 2.7668683528900146 (2.7668683528900146) | > loss_gen: 2.8249807357788086 (2.8249807357788086) | > loss_kl: 5.541698932647705 (5.541698932647705) | > loss_feat: 8.001096725463867 (8.001096725463867) | > loss_mel: 21.149703979492188 (21.149703979492188) | > loss_duration: 3.1539502143859863 (3.1539502143859863) | > loss_1: 40.67142868041992 (40.67142868041992)  --> STEP: 1 | > loss_disc: 2.4432618618011475 (2.4432618618011475) | > loss_disc_real_0: 0.13695240020751953 (0.13695240020751953) | > loss_disc_real_1: 0.14163094758987427 (0.14163094758987427) | > loss_disc_real_2: 0.3343561291694641 (0.3343561291694641) | > loss_disc_real_3: 0.18578585982322693 (0.18578585982322693) | > loss_disc_real_4: 0.3294275403022766 (0.3294275403022766) | > loss_disc_real_5: 0.3093717396259308 (0.3093717396259308) | > loss_0: 2.4432618618011475 (2.4432618618011475) | > loss_gen: 2.460702419281006 (2.460702419281006) | > loss_kl: 5.133566856384277 (5.133566856384277) | > loss_feat: 6.776542663574219 (6.776542663574219) | > loss_mel: 24.036849975585938 (24.036849975585938) | > loss_duration: 3.447577953338623 (3.447577953338623) | > loss_1: 41.85523986816406 (41.85523986816406)  --> STEP: 2 | > loss_disc: 2.3898892402648926 (2.41657555103302) | > loss_disc_real_0: 0.0732869952917099 (0.10511969774961472) | > loss_disc_real_1: 0.16294389963150024 (0.15228742361068726) | > loss_disc_real_2: 0.2625613212585449 (0.2984587252140045) | > loss_disc_real_3: 0.20192283391952515 (0.19385434687137604) | > loss_disc_real_4: 0.1914079338312149 (0.26041773706674576) | > loss_disc_real_5: 0.1835169643163681 (0.24644435197114944) | > loss_0: 2.3898892402648926 (2.41657555103302) | > loss_gen: 1.9448986053466797 (2.2028005123138428) | > loss_kl: 6.012275695800781 (5.572921276092529) | > loss_feat: 4.771649360656738 (5.7740960121154785) | > loss_mel: 25.208194732666016 (24.622522354125977) | > loss_duration: 3.3571677207946777 (3.4023728370666504) | > loss_1: 41.294185638427734 (41.5747127532959)  --> STEP: 3 | > loss_disc: 2.996857166290283 (2.6100027561187744) | > loss_disc_real_0: 0.19808796048164368 (0.13610911866029105) | > loss_disc_real_1: 0.2650649845600128 (0.18987994392712912) | > loss_disc_real_2: 0.2631855905056 (0.2867010136445363) | > loss_disc_real_3: 0.2556925415992737 (0.21446707844734192) | > loss_disc_real_4: 0.24838456511497498 (0.25640667974948883) | > loss_disc_real_5: 0.2541761100292206 (0.24902160465717316) | > loss_0: 2.996857166290283 (2.6100027561187744) | > loss_gen: 1.4935111999511719 (1.9663707415262859) | > loss_kl: 2.8591461181640625 (4.66832955678304) | > loss_feat: 0.03198438510298729 (3.8600588031113148) | > loss_mel: 1.7927067279815674 (17.01258381207784) | > loss_duration: 3.029284954071045 (3.2780102094014487) | > loss_1: 9.206632614135742 (30.78535270690918) --> EVAL PERFORMANCE | > avg_loader_time: 0.0075922807057698565 (-0.0016223589579264326) | > avg_loss_disc: 2.6100027561187744 (-0.1753227710723877) | > avg_loss_disc_real_0: 0.13610911866029105 (-0.09914465248584747) | > avg_loss_disc_real_1: 0.18987994392712912 (-0.08297474185625711) | > avg_loss_disc_real_2: 0.2867010136445363 (+0.012814958890279116) | > avg_loss_disc_real_3: 0.21446707844734192 (-0.08113267024358112) | > avg_loss_disc_real_4: 0.25640667974948883 (-0.047455623745918274) | > avg_loss_disc_real_5: 0.24902160465717316 (-0.031744410594304384) | > avg_loss_0: 2.6100027561187744 (-0.1753227710723877) | > avg_loss_gen: 1.9663707415262859 (-0.156923492749532) | > avg_loss_kl: 4.66832955678304 (-0.18011943499247263) | > avg_loss_feat: 3.8600588031113148 (+1.0149080020685992) | > avg_loss_mel: 17.01258381207784 (+0.8285925388336182) | > avg_loss_duration: 3.2780102094014487 (-0.012856801350911162) | > avg_loss_1: 30.78535270690918 (+1.4936002095540353)  > EPOCH: 1198/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:14:31)   --> TIME: 2023-10-20 15:14:46 -- STEP: 19/50 -- GLOBAL_STEP: 112920 | > loss_disc: 2.8473243713378906 (2.332902287182055) | > loss_disc_real_0: 0.17460502684116364 (0.1478239564029009) | > loss_disc_real_1: 0.2815280854701996 (0.20980736730914368) | > loss_disc_real_2: 0.21790096163749695 (0.22413612235533564) | > loss_disc_real_3: 0.2724493145942688 (0.24767965225404814) | > loss_disc_real_4: 0.2455335408449173 (0.19354882306958499) | > loss_disc_real_5: 0.2423214614391327 (0.2155393587523385) | > loss_0: 2.8473243713378906 (2.332902287182055) | > grad_norm_0: tensor(557.2571, device='cuda:0') (tensor(564.7908, device='cuda:0')) | > loss_gen: 1.7786693572998047 (2.4283089010339034) | > loss_kl: 0.662546694278717 (0.8274198692095908) | > loss_feat: 1.5169647932052612 (6.096019128729639) | > loss_mel: 19.135833740234375 (20.88082109626971) | > loss_duration: 1.4000325202941895 (1.3509413254888434) | > loss_1: 24.494047164916992 (31.58351085060521) | > grad_norm_1: tensor(3261.4824, device='cuda:0') (tensor(33638.0938, device='cuda:0')) | > current_lr_0: 6.0354921004674705e-05 | > current_lr_1: 6.041530988947301e-05 | > step_time: 0.3316 (0.45706653594970714) | > loader_time: 0.0018 (0.012194834257427015)  --> TIME: 2023-10-20 15:15:00 -- STEP: 49/50 -- GLOBAL_STEP: 112950 | > loss_disc: 2.4217965602874756 (2.4446302944300133) | > loss_disc_real_0: 0.033348198980093 (0.1531732161434329) | > loss_disc_real_1: 0.2340487837791443 (0.22410678620241126) | > loss_disc_real_2: 0.12120499461889267 (0.21767268246229815) | > loss_disc_real_3: 0.23408617079257965 (0.23815287904319715) | > loss_disc_real_4: 0.2750098705291748 (0.20252519652095377) | > loss_disc_real_5: 0.2863262891769409 (0.2177752175995586) | > loss_0: 2.4217965602874756 (2.4446302944300133) | > grad_norm_0: tensor(393.8440, device='cuda:0') (tensor(638.8242, device='cuda:0')) | > loss_gen: 2.080507755279541 (2.2692198169474698) | > loss_kl: 1.2463114261627197 (0.7386297419363138) | > loss_feat: 2.33512806892395 (5.5695501872699475) | > loss_mel: 19.61495018005371 (19.78353311334337) | > loss_duration: 1.429212212562561 (1.3203727809750303) | > loss_1: 26.70611000061035 (29.68130584638946) | > grad_norm_1: tensor(3003.4265, device='cuda:0') (tensor(23438.5293, device='cuda:0')) | > current_lr_0: 6.0354921004674705e-05 | > current_lr_1: 6.041530988947301e-05 | > step_time: 0.8253 (0.4384709377678073) | > loader_time: 0.5492 (0.020509213817362884)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9589948654174805 (2.9589948654174805) | > loss_disc_real_0: 0.3654683530330658 (0.3654683530330658) | > loss_disc_real_1: 0.2540225386619568 (0.2540225386619568) | > loss_disc_real_2: 0.2853277027606964 (0.2853277027606964) | > loss_disc_real_3: 0.24210035800933838 (0.24210035800933838) | > loss_disc_real_4: 0.27691516280174255 (0.27691516280174255) | > loss_disc_real_5: 0.290622353553772 (0.290622353553772) | > loss_0: 2.9589948654174805 (2.9589948654174805) | > loss_gen: 1.8203074932098389 (1.8203074932098389) | > loss_kl: 6.128334045410156 (6.128334045410156) | > loss_feat: 0.2068435400724411 (0.2068435400724411) | > loss_mel: 9.847957611083984 (9.847957611083984) | > loss_duration: 3.0843663215637207 (3.0843663215637207) | > loss_1: 21.08780860900879 (21.08780860900879)  --> STEP: 1 | > loss_disc: 2.951035737991333 (2.951035737991333) | > loss_disc_real_0: 0.30488941073417664 (0.30488941073417664) | > loss_disc_real_1: 0.2540520131587982 (0.2540520131587982) | > loss_disc_real_2: 0.4258984625339508 (0.4258984625339508) | > loss_disc_real_3: 0.3082764148712158 (0.3082764148712158) | > loss_disc_real_4: 0.3480176031589508 (0.3480176031589508) | > loss_disc_real_5: 0.35303589701652527 (0.35303589701652527) | > loss_0: 2.951035737991333 (2.951035737991333) | > loss_gen: 2.5685160160064697 (2.5685160160064697) | > loss_kl: 5.571197986602783 (5.571197986602783) | > loss_feat: 3.554746389389038 (3.554746389389038) | > loss_mel: 19.63309669494629 (19.63309669494629) | > loss_duration: 3.3830220699310303 (3.3830220699310303) | > loss_1: 34.71057891845703 (34.71057891845703)  --> STEP: 2 | > loss_disc: 2.729240894317627 (2.84013831615448) | > loss_disc_real_0: 0.18147088587284088 (0.24318014830350876) | > loss_disc_real_1: 0.2815721035003662 (0.2678120583295822) | > loss_disc_real_2: 0.41553163528442383 (0.4207150489091873) | > loss_disc_real_3: 0.3025952875614166 (0.3054358512163162) | > loss_disc_real_4: 0.49098822474479675 (0.4195029139518738) | > loss_disc_real_5: 0.39072442054748535 (0.3718801587820053) | > loss_0: 2.729240894317627 (2.84013831615448) | > loss_gen: 3.075331687927246 (2.821923851966858) | > loss_kl: 6.113300800323486 (5.842249393463135) | > loss_feat: 8.281011581420898 (5.917878985404968) | > loss_mel: 21.02678108215332 (20.329938888549805) | > loss_duration: 3.3733677864074707 (3.3781949281692505) | > loss_1: 41.86979293823242 (38.29018592834473)  --> STEP: 3 | > loss_disc: 2.9606423377990723 (2.8803063233693442) | > loss_disc_real_0: 0.3609559237957001 (0.2824387401342392) | > loss_disc_real_1: 0.2527395486831665 (0.26278788844744366) | > loss_disc_real_2: 0.27848654985427856 (0.3733055492242177) | > loss_disc_real_3: 0.24130237102508545 (0.28405802448590595) | > loss_disc_real_4: 0.2750782072544098 (0.3713613450527191) | > loss_disc_real_5: 0.2877607047557831 (0.3438403407732646) | > loss_0: 2.9606423377990723 (2.8803063233693442) | > loss_gen: 1.7819321155548096 (2.4752599398295083) | > loss_kl: 2.979637861251831 (4.8880455493927) | > loss_feat: 0.1861308366060257 (4.007296269138654) | > loss_mel: 4.642721176147461 (15.100866317749023) | > loss_duration: 3.112776279449463 (3.2897220452626548) | > loss_1: 12.703197479248047 (29.761189778645832) --> EVAL PERFORMANCE | > avg_loader_time: 0.014817317326863607 (+0.007225036621093751) | > avg_loss_disc: 2.8803063233693442 (+0.2703035672505698) | > avg_loss_disc_real_0: 0.2824387401342392 (+0.14632962147394815) | > avg_loss_disc_real_1: 0.26278788844744366 (+0.07290794452031454) | > avg_loss_disc_real_2: 0.3733055492242177 (+0.0866045355796814) | > avg_loss_disc_real_3: 0.28405802448590595 (+0.06959094603856403) | > avg_loss_disc_real_4: 0.3713613450527191 (+0.11495466530323029) | > avg_loss_disc_real_5: 0.3438403407732646 (+0.09481873611609143) | > avg_loss_0: 2.8803063233693442 (+0.2703035672505698) | > avg_loss_gen: 2.4752599398295083 (+0.5088891983032224) | > avg_loss_kl: 4.8880455493927 (+0.21971599260966013) | > avg_loss_feat: 4.007296269138654 (+0.147237466027339) | > avg_loss_mel: 15.100866317749023 (-1.9117174943288155) | > avg_loss_duration: 3.2897220452626548 (+0.011711835861206055) | > avg_loss_1: 29.761189778645832 (-1.0241629282633475)  > EPOCH: 1199/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:15:17)   --> TIME: 2023-10-20 15:15:41 -- STEP: 29/50 -- GLOBAL_STEP: 112980 | > loss_disc: 1.934644341468811 (2.4229224879166176) | > loss_disc_real_0: 0.12362226843833923 (0.13330789241169028) | > loss_disc_real_1: 0.09688611328601837 (0.2049056877349985) | > loss_disc_real_2: 0.03912826254963875 (0.23874144268960784) | > loss_disc_real_3: 0.17729824781417847 (0.24591167823507867) | > loss_disc_real_4: 0.11863412708044052 (0.2421402376273583) | > loss_disc_real_5: 0.11990820616483688 (0.24808971503556798) | > loss_0: 1.934644341468811 (2.4229224879166176) | > grad_norm_0: tensor(386.5273, device='cuda:0') (tensor(567.2827, device='cuda:0')) | > loss_gen: 2.249471664428711 (2.4503901621391035) | > loss_kl: 0.8126347064971924 (0.7308192427816063) | > loss_feat: 9.646467208862305 (6.404112351351771) | > loss_mel: 21.35037612915039 (22.059795675606562) | > loss_duration: 1.3003288507461548 (1.3242550965013173) | > loss_1: 35.35927963256836 (32.96937232181944) | > grad_norm_1: tensor(22910.6094, device='cuda:0') (tensor(19207.8574, device='cuda:0')) | > current_lr_0: 6.029459248234766e-05 | > current_lr_1: 6.0354921004674705e-05 | > step_time: 0.5535 (0.6486521096065127) | > loader_time: 0.0338 (0.021198765984896957)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.496719479560852 (1.496719479560852) | > loss_disc_real_0: 0.11166390776634216 (0.11166390776634216) | > loss_disc_real_1: 0.11266770213842392 (0.11266770213842392) | > loss_disc_real_2: 0.14942367374897003 (0.14942367374897003) | > loss_disc_real_3: 0.051310278475284576 (0.051310278475284576) | > loss_disc_real_4: 0.08369562029838562 (0.08369562029838562) | > loss_disc_real_5: 0.07173793017864227 (0.07173793017864227) | > loss_0: 1.496719479560852 (1.496719479560852) | > loss_gen: 2.4840118885040283 (2.4840118885040283) | > loss_kl: 5.989869594573975 (5.989869594573975) | > loss_feat: 13.459104537963867 (13.459104537963867) | > loss_mel: 26.655763626098633 (26.655763626098633) | > loss_duration: 3.162529706954956 (3.162529706954956) | > loss_1: 51.751277923583984 (51.751277923583984)  --> STEP: 1 | > loss_disc: 3.0409488677978516 (3.0409488677978516) | > loss_disc_real_0: 0.18899111449718475 (0.18899111449718475) | > loss_disc_real_1: 0.22109907865524292 (0.22109907865524292) | > loss_disc_real_2: 0.28412145376205444 (0.28412145376205444) | > loss_disc_real_3: 0.28676557540893555 (0.28676557540893555) | > loss_disc_real_4: 0.269942969083786 (0.269942969083786) | > loss_disc_real_5: 0.2765246331691742 (0.2765246331691742) | > loss_0: 3.0409488677978516 (3.0409488677978516) | > loss_gen: 1.518125295639038 (1.518125295639038) | > loss_kl: 5.642756938934326 (5.642756938934326) | > loss_feat: 0.636641263961792 (0.636641263961792) | > loss_mel: 19.087299346923828 (19.087299346923828) | > loss_duration: 3.4491264820098877 (3.4491264820098877) | > loss_1: 30.33395004272461 (30.33395004272461)  --> STEP: 2 | > loss_disc: 3.0817031860351562 (3.061326026916504) | > loss_disc_real_0: 0.1853933036327362 (0.18719220906496048) | > loss_disc_real_1: 0.3448864221572876 (0.28299275040626526) | > loss_disc_real_2: 0.2595059275627136 (0.27181369066238403) | > loss_disc_real_3: 0.2503769099712372 (0.26857124269008636) | > loss_disc_real_4: 0.33698636293411255 (0.3034646660089493) | > loss_disc_real_5: 0.5067011713981628 (0.3916129022836685) | > loss_0: 3.0817031860351562 (3.061326026916504) | > loss_gen: 2.2372283935546875 (1.8776768445968628) | > loss_kl: 6.152463912963867 (5.897610425949097) | > loss_feat: 6.82373571395874 (3.730188488960266) | > loss_mel: 22.092708587646484 (20.590003967285156) | > loss_duration: 3.3733277320861816 (3.4112271070480347) | > loss_1: 40.679466247558594 (35.5067081451416)  --> STEP: 3 | > loss_disc: 3.118804693222046 (3.0804855823516846) | > loss_disc_real_0: 0.2345091998577118 (0.2029645393292109) | > loss_disc_real_1: 0.20993779599666595 (0.2586410989363988) | > loss_disc_real_2: 0.26888325810432434 (0.27083687980969745) | > loss_disc_real_3: 0.2225157469511032 (0.253219410777092) | > loss_disc_real_4: 0.23070959746837616 (0.2792129764954249) | > loss_disc_real_5: 0.22525259852409363 (0.33615946769714355) | > loss_0: 3.118804693222046 (3.0804855823516846) | > loss_gen: 1.4200845956802368 (1.7251460949579875) | > loss_kl: 2.889852523803711 (4.895024458567302) | > loss_feat: 1.5677149295806885 (3.0093639691670737) | > loss_mel: 7.942834377288818 (16.37428077061971) | > loss_duration: 3.0129666328430176 (3.2784736156463623) | > loss_1: 16.833454132080078 (29.28229014078776) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_113000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0976364612579346 (3.084773302078247) | > loss_disc_real_0: 0.2427966296672821 (0.21292256191372871) | > loss_disc_real_1: 0.26646658778190613 (0.26059747114777565) | > loss_disc_real_2: 0.26671019196510315 (0.2698052078485489) | > loss_disc_real_3: 0.21538588404655457 (0.24376102909445763) | > loss_disc_real_4: 0.4020008146762848 (0.3099099360406399) | > loss_disc_real_5: 0.3775475025177002 (0.3465064764022827) | > loss_0: 3.0976364612579346 (3.084773302078247) | > loss_gen: 1.8785988092422485 (1.7635092735290527) | > loss_kl: 6.258843898773193 (5.235979318618774) | > loss_feat: 5.289449691772461 (3.5793853998184204) | > loss_mel: 23.9263916015625 (18.262308478355408) | > loss_duration: 3.130356788635254 (3.241444408893585) | > loss_1: 40.483638763427734 (32.082627296447754)  --> STEP: 1 | > loss_disc: 2.3574438095092773 (2.9393074035644533) | > loss_disc_real_0: 0.20817694067955017 (0.211973437666893) | > loss_disc_real_1: 0.182090163230896 (0.24489600956439972) | > loss_disc_real_2: 0.176393061876297 (0.2511227786540985) | > loss_disc_real_3: 0.18360106647014618 (0.23172903656959534) | > loss_disc_real_4: 0.15563906729221344 (0.2790557622909546) | > loss_disc_real_5: 0.11880321055650711 (0.3009658232331276) | > loss_0: 2.3574438095092773 (2.9393074035644533) | > loss_gen: 1.9694286584854126 (1.8046931505203248) | > loss_kl: 5.2808308601379395 (5.244949626922607) | > loss_feat: 7.169308185577393 (4.297369956970215) | > loss_mel: 23.07438087463379 (19.224722957611085) | > loss_duration: 3.4840643405914307 (3.289968395233154) | > loss_1: 40.9780158996582 (33.86170501708985)  --> STEP: 2 | > loss_disc: 3.36057710647583 (3.009519020716349) | > loss_disc_real_0: 0.2234245091676712 (0.21388194958368936) | > loss_disc_real_1: 0.22145310044288635 (0.2409888580441475) | > loss_disc_real_2: 0.3360000550746918 (0.2652689913908641) | > loss_disc_real_3: 0.20868730545043945 (0.22788874804973602) | > loss_disc_real_4: 0.2309958040714264 (0.2710457692543666) | > loss_disc_real_5: 0.3315793573856354 (0.3060680789252122) | > loss_0: 3.36057710647583 (3.009519020716349) | > loss_gen: 1.453102469444275 (1.7460947036743164) | > loss_kl: 5.902783393859863 (5.354588588078816) | > loss_feat: 6.587331771850586 (4.679030259450276) | > loss_mel: 23.402881622314453 (19.921082735061646) | > loss_duration: 3.391031265258789 (3.3068122069040933) | > loss_1: 40.73712921142578 (35.007609049479164)  --> STEP: 3 | > loss_disc: 2.5726590156555176 (2.947110448564802) | > loss_disc_real_0: 0.19752299785614014 (0.21154495647975377) | > loss_disc_real_1: 0.22451536357402802 (0.2386355016912733) | > loss_disc_real_2: 0.15425479412078857 (0.24940982035228185) | > loss_disc_real_3: 0.24848942458629608 (0.23083170184067317) | > loss_disc_real_4: 0.3331124484539032 (0.2799124377114432) | > loss_disc_real_5: 0.3558183014392853 (0.3131752535700798) | > loss_0: 2.5726590156555176 (2.947110448564802) | > loss_gen: 2.2700648307800293 (1.8209475789751326) | > loss_kl: 2.745899200439453 (4.981918675558908) | > loss_feat: 3.943803310394287 (4.573997838156564) | > loss_mel: 21.029359817504883 (20.079408032553538) | > loss_duration: 3.0874526500701904 (3.275475127356393) | > loss_1: 33.07658004760742 (34.73174776349749) --> EVAL PERFORMANCE | > avg_loader_time: 0.8314118725912911 (+0.8165945552644275) | > avg_loss_disc: 2.947110448564802 (+0.06680412519545786) | > avg_loss_disc_real_0: 0.21154495647975377 (-0.07089378365448543) | > avg_loss_disc_real_1: 0.2386355016912733 (-0.024152386756170374) | > avg_loss_disc_real_2: 0.24940982035228185 (-0.12389572887193587) | > avg_loss_disc_real_3: 0.23083170184067317 (-0.053226322645232776) | > avg_loss_disc_real_4: 0.2799124377114432 (-0.09144890734127592) | > avg_loss_disc_real_5: 0.3131752535700798 (-0.030665087203184782) | > avg_loss_0: 2.947110448564802 (+0.06680412519545786) | > avg_loss_gen: 1.8209475789751326 (-0.6543123608543757) | > avg_loss_kl: 4.981918675558908 (+0.09387312616620758) | > avg_loss_feat: 4.573997838156564 (+0.5667015690179102) | > avg_loss_mel: 20.079408032553538 (+4.978541714804514) | > avg_loss_duration: 3.275475127356393 (-0.014246917906261647) | > avg_loss_1: 34.73174776349749 (+4.970557984851656)  > EPOCH: 1200/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:16:19)   --> TIME: 2023-10-20 15:16:36 -- STEP: 9/50 -- GLOBAL_STEP: 113010 | > loss_disc: 2.7148211002349854 (2.3224996990627713) | > loss_disc_real_0: 0.15688611567020416 (0.08383178979986244) | > loss_disc_real_1: 0.26502886414527893 (0.20148418760961956) | > loss_disc_real_2: 0.23037466406822205 (0.18660261399216121) | > loss_disc_real_3: 0.26418644189834595 (0.2076233136985037) | > loss_disc_real_4: 0.23077984154224396 (0.18547302981217703) | > loss_disc_real_5: 0.17935720086097717 (0.2157165246705214) | > loss_0: 2.7148211002349854 (2.3224996990627713) | > grad_norm_0: tensor(497.5203, device='cuda:0') (tensor(388.4492, device='cuda:0')) | > loss_gen: 1.7285523414611816 (2.231416874461704) | > loss_kl: 0.535709023475647 (0.7050232059425778) | > loss_feat: 1.5457402467727661 (6.100870225164625) | > loss_mel: 18.606075286865234 (21.484050750732422) | > loss_duration: 1.308086633682251 (1.3374495373831854) | > loss_1: 23.724163055419922 (31.858811060587566) | > grad_norm_1: tensor(4290.4463, device='cuda:0') (tensor(13137.2197, device='cuda:0')) | > current_lr_0: 6.0234324262155816e-05 | > current_lr_1: 6.029459248234766e-05 | > step_time: 0.6308 (0.5816836092207167) | > loader_time: 0.0247 (0.028655184639824763)  --> TIME: 2023-10-20 15:16:56 -- STEP: 39/50 -- GLOBAL_STEP: 113040 | > loss_disc: 2.977494239807129 (2.300579734337635) | > loss_disc_real_0: 0.33079174160957336 (0.1361078702581999) | > loss_disc_real_1: 0.27335578203201294 (0.203716066880868) | > loss_disc_real_2: 0.2825656235218048 (0.19433079010401016) | > loss_disc_real_3: 0.26795968413352966 (0.2178848181397487) | > loss_disc_real_4: 0.2748267948627472 (0.20315195777668402) | > loss_disc_real_5: 0.27996718883514404 (0.2067767131404999) | > loss_0: 2.977494239807129 (2.300579734337635) | > grad_norm_0: tensor(721.1066, device='cuda:0') (tensor(582.1498, device='cuda:0')) | > loss_gen: 1.715092420578003 (2.3421231172023673) | > loss_kl: 0.5836060047149658 (0.7790097181613629) | > loss_feat: 0.20303572714328766 (6.260126329576358) | > loss_mel: 5.153491497039795 (20.655902767792732) | > loss_duration: 1.3447134494781494 (1.3206436267265909) | > loss_1: 8.99993896484375 (31.357805631099602) | > grad_norm_1: tensor(21739.4160, device='cuda:0') (tensor(23191.1816, device='cuda:0')) | > current_lr_0: 6.0234324262155816e-05 | > current_lr_1: 6.029459248234766e-05 | > step_time: 0.4197 (0.615028576973157) | > loader_time: 0.0123 (0.022353239548511993)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.811384916305542 (2.811384916305542) | > loss_disc_real_0: 0.12312819063663483 (0.12312819063663483) | > loss_disc_real_1: 0.2819018065929413 (0.2819018065929413) | > loss_disc_real_2: 0.4164794683456421 (0.4164794683456421) | > loss_disc_real_3: 0.2817821204662323 (0.2817821204662323) | > loss_disc_real_4: 0.4228287935256958 (0.4228287935256958) | > loss_disc_real_5: 0.420499324798584 (0.420499324798584) | > loss_0: 2.811384916305542 (2.811384916305542) | > loss_gen: 2.668447971343994 (2.668447971343994) | > loss_kl: 5.711568832397461 (5.711568832397461) | > loss_feat: 4.826385974884033 (4.826385974884033) | > loss_mel: 21.663246154785156 (21.663246154785156) | > loss_duration: 3.0369033813476562 (3.0369033813476562) | > loss_1: 37.90655517578125 (37.90655517578125)  --> STEP: 1 | > loss_disc: 2.986717462539673 (2.986717462539673) | > loss_disc_real_0: 0.3041529357433319 (0.3041529357433319) | > loss_disc_real_1: 0.23161916434764862 (0.23161916434764862) | > loss_disc_real_2: 0.33805525302886963 (0.33805525302886963) | > loss_disc_real_3: 0.2827293276786804 (0.2827293276786804) | > loss_disc_real_4: 0.2672954201698303 (0.2672954201698303) | > loss_disc_real_5: 0.2542286515235901 (0.2542286515235901) | > loss_0: 2.986717462539673 (2.986717462539673) | > loss_gen: 1.806465983390808 (1.806465983390808) | > loss_kl: 5.38427209854126 (5.38427209854126) | > loss_feat: 0.8683056831359863 (0.8683056831359863) | > loss_mel: 18.427719116210938 (18.427719116210938) | > loss_duration: 3.4030404090881348 (3.4030404090881348) | > loss_1: 29.889802932739258 (29.889802932739258)  --> STEP: 2 | > loss_disc: 2.4359500408172607 (2.711333751678467) | > loss_disc_real_0: 0.2925056219100952 (0.29832927882671356) | > loss_disc_real_1: 0.18452467024326324 (0.20807191729545593) | > loss_disc_real_2: 0.3193577229976654 (0.3287064880132675) | > loss_disc_real_3: 0.2042882740497589 (0.24350880086421967) | > loss_disc_real_4: 0.21570304036140442 (0.24149923026561737) | > loss_disc_real_5: 0.26218074560165405 (0.25820469856262207) | > loss_0: 2.4359500408172607 (2.711333751678467) | > loss_gen: 2.7037439346313477 (2.255104959011078) | > loss_kl: 5.837555408477783 (5.6109137535095215) | > loss_feat: 9.469494819641113 (5.16890025138855) | > loss_mel: 22.44045066833496 (20.43408489227295) | > loss_duration: 3.206878900527954 (3.3049596548080444) | > loss_1: 43.65812301635742 (36.77396297454834)  --> STEP: 3 | > loss_disc: 2.7407290935516357 (2.721132198969523) | > loss_disc_real_0: 0.2000270038843155 (0.2655618538459142) | > loss_disc_real_1: 0.3417586386203766 (0.25263415773709613) | > loss_disc_real_2: 0.47569283843040466 (0.37770193815231323) | > loss_disc_real_3: 0.28250885009765625 (0.2565088172753652) | > loss_disc_real_4: 0.4974208474159241 (0.3268064359823863) | > loss_disc_real_5: 0.18116484582424164 (0.23252474764982858) | > loss_0: 2.7407290935516357 (2.721132198969523) | > loss_gen: 2.9544243812561035 (2.488211433092753) | > loss_kl: 2.836117744445801 (4.685981750488281) | > loss_feat: 5.428957462310791 (5.25558598836263) | > loss_mel: 23.265567779541016 (21.377912521362305) | > loss_duration: 3.0074212551116943 (3.2057801882425943) | > loss_1: 37.492488861083984 (37.013471603393555) --> EVAL PERFORMANCE | > avg_loader_time: 0.009782950083414713 (-0.8216289225078764) | > avg_loss_disc: 2.721132198969523 (-0.22597824959527912) | > avg_loss_disc_real_0: 0.2655618538459142 (+0.054016897366160416) | > avg_loss_disc_real_1: 0.25263415773709613 (+0.013998656045822844) | > avg_loss_disc_real_2: 0.37770193815231323 (+0.12829211780003139) | > avg_loss_disc_real_3: 0.2565088172753652 (+0.025677115434692005) | > avg_loss_disc_real_4: 0.3268064359823863 (+0.046893998270943094) | > avg_loss_disc_real_5: 0.23252474764982858 (-0.08065050592025122) | > avg_loss_0: 2.721132198969523 (-0.22597824959527912) | > avg_loss_gen: 2.488211433092753 (+0.6672638541176203) | > avg_loss_kl: 4.685981750488281 (-0.2959369250706265) | > avg_loss_feat: 5.25558598836263 (+0.6815881502060659) | > avg_loss_mel: 21.377912521362305 (+1.2985044888087671) | > avg_loss_duration: 3.2057801882425943 (-0.06969493911379887) | > avg_loss_1: 37.013471603393555 (+2.281723839896067)  > EPOCH: 1201/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:17:26)   --> TIME: 2023-10-20 15:17:41 -- STEP: 19/50 -- GLOBAL_STEP: 113070 | > loss_disc: 3.0052785873413086 (2.5077220389717505) | > loss_disc_real_0: 0.08205965161323547 (0.13595659119126044) | > loss_disc_real_1: 0.2402816116809845 (0.22175700864509532) | > loss_disc_real_2: 0.20045018196105957 (0.22699242531272926) | > loss_disc_real_3: 0.2511740028858185 (0.22975532200775647) | > loss_disc_real_4: 0.26820287108421326 (0.2188299651208677) | > loss_disc_real_5: 0.2397303432226181 (0.20559003086466537) | > loss_0: 3.0052785873413086 (2.5077220389717505) | > grad_norm_0: tensor(1400.7765, device='cuda:0') (tensor(720.1124, device='cuda:0')) | > loss_gen: 1.4468239545822144 (2.136396834724828) | > loss_kl: 0.5471388697624207 (0.7836191838509158) | > loss_feat: 0.7628508806228638 (5.246623707052908) | > loss_mel: 11.000368118286133 (18.958699226379395) | > loss_duration: 1.4526636600494385 (1.362890601158142) | > loss_1: 15.209845542907715 (28.488229475523298) | > grad_norm_1: tensor(7941.9380, device='cuda:0') (tensor(17230.9121, device='cuda:0')) | > current_lr_0: 6.0174116283823394e-05 | > current_lr_1: 6.0234324262155816e-05 | > step_time: 0.6927 (0.5494747161865234) | > loader_time: 0.0341 (0.014034271240234375)  --> TIME: 2023-10-20 15:18:00 -- STEP: 49/50 -- GLOBAL_STEP: 113100 | > loss_disc: 2.575075387954712 (2.4932120211270394) | > loss_disc_real_0: 0.013953324407339096 (0.13698648488415133) | > loss_disc_real_1: 0.16294525563716888 (0.22847555239437795) | > loss_disc_real_2: 0.06494905799627304 (0.22568869375984887) | > loss_disc_real_3: 0.2308463752269745 (0.2325804222907339) | > loss_disc_real_4: 0.25585106015205383 (0.22117242000388856) | > loss_disc_real_5: 0.2554725110530853 (0.21258288083065832) | > loss_0: 2.575075387954712 (2.4932120211270394) | > grad_norm_0: tensor(2445.7446, device='cuda:0') (tensor(780.6310, device='cuda:0')) | > loss_gen: 1.7505747079849243 (2.1655494412597345) | > loss_kl: 0.6333738565444946 (0.7505389264955813) | > loss_feat: 2.34359073638916 (4.981947900841431) | > loss_mel: 20.84650993347168 (19.679364669079682) | > loss_duration: 1.3989638090133667 (1.3311909802105961) | > loss_1: 26.973012924194336 (28.9085918251349) | > grad_norm_1: tensor(3980.7236, device='cuda:0') (tensor(17915.8418, device='cuda:0')) | > current_lr_0: 6.0174116283823394e-05 | > current_lr_1: 6.0234324262155816e-05 | > step_time: 0.4891 (0.5653574904616998) | > loader_time: 0.4274 (0.026759862899780273)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9171860218048096 (2.9171860218048096) | > loss_disc_real_0: 0.2940670847892761 (0.2940670847892761) | > loss_disc_real_1: 0.25880956649780273 (0.25880956649780273) | > loss_disc_real_2: 0.3186422288417816 (0.3186422288417816) | > loss_disc_real_3: 0.24849843978881836 (0.24849843978881836) | > loss_disc_real_4: 0.2503393888473511 (0.2503393888473511) | > loss_disc_real_5: 0.2519382834434509 (0.2519382834434509) | > loss_0: 2.9171860218048096 (2.9171860218048096) | > loss_gen: 1.7727874517440796 (1.7727874517440796) | > loss_kl: 5.7481794357299805 (5.7481794357299805) | > loss_feat: 0.3523854613304138 (0.3523854613304138) | > loss_mel: 15.157698631286621 (15.157698631286621) | > loss_duration: 3.176384687423706 (3.176384687423706) | > loss_1: 26.207433700561523 (26.207433700561523)  --> STEP: 1 | > loss_disc: 2.160531520843506 (2.160531520843506) | > loss_disc_real_0: 0.09590010344982147 (0.09590010344982147) | > loss_disc_real_1: 0.13656246662139893 (0.13656246662139893) | > loss_disc_real_2: 0.11509601026773453 (0.11509601026773453) | > loss_disc_real_3: 0.20386405289173126 (0.20386405289173126) | > loss_disc_real_4: 0.19952116906642914 (0.19952116906642914) | > loss_disc_real_5: 0.23393303155899048 (0.23393303155899048) | > loss_0: 2.160531520843506 (2.160531520843506) | > loss_gen: 2.3294711112976074 (2.3294711112976074) | > loss_kl: 5.507723808288574 (5.507723808288574) | > loss_feat: 7.808444499969482 (7.808444499969482) | > loss_mel: 23.555438995361328 (23.555438995361328) | > loss_duration: 3.5371694564819336 (3.5371694564819336) | > loss_1: 42.73824691772461 (42.73824691772461)  --> STEP: 2 | > loss_disc: 2.9466192722320557 (2.5535753965377808) | > loss_disc_real_0: 0.2984095513820648 (0.19715482741594315) | > loss_disc_real_1: 0.24867242574691772 (0.19261744618415833) | > loss_disc_real_2: 0.3043137490749359 (0.20970487967133522) | > loss_disc_real_3: 0.24879664182662964 (0.22633034735918045) | > loss_disc_real_4: 0.23893935978412628 (0.2192302644252777) | > loss_disc_real_5: 0.2288931906223297 (0.2314131110906601) | > loss_0: 2.9466192722320557 (2.5535753965377808) | > loss_gen: 1.6741414070129395 (2.0018062591552734) | > loss_kl: 6.243269920349121 (5.875496864318848) | > loss_feat: 1.077513575553894 (4.442979037761688) | > loss_mel: 17.72334861755371 (20.63939380645752) | > loss_duration: 3.2901241779327393 (3.4136468172073364) | > loss_1: 30.008398056030273 (36.37332248687744)  --> STEP: 3 | > loss_disc: 2.3573696613311768 (2.488173484802246) | > loss_disc_real_0: 0.1281110793352127 (0.17414024472236633) | > loss_disc_real_1: 0.3116605281829834 (0.2322984735171) | > loss_disc_real_2: 0.3263191282749176 (0.24857629587252936) | > loss_disc_real_3: 0.28322088718414307 (0.245293860634168) | > loss_disc_real_4: 0.23834429681301117 (0.2256016085545222) | > loss_disc_real_5: 0.22218072414398193 (0.2283356487751007) | > loss_0: 2.3573696613311768 (2.488173484802246) | > loss_gen: 2.7641944885253906 (2.2559356689453125) | > loss_kl: 2.576951265335083 (4.775981664657593) | > loss_feat: 5.381231307983398 (4.755729794502258) | > loss_mel: 23.2264461517334 (21.501744588216145) | > loss_duration: 2.9588241577148438 (3.2620392640431723) | > loss_1: 36.90764617919922 (36.55143038431803) --> EVAL PERFORMANCE | > avg_loader_time: 0.016373554865519207 (+0.006590604782104494) | > avg_loss_disc: 2.488173484802246 (-0.23295871416727687) | > avg_loss_disc_real_0: 0.17414024472236633 (-0.09142160912354785) | > avg_loss_disc_real_1: 0.2322984735171 (-0.020335684219996125) | > avg_loss_disc_real_2: 0.24857629587252936 (-0.12912564227978388) | > avg_loss_disc_real_3: 0.245293860634168 (-0.011214956641197177) | > avg_loss_disc_real_4: 0.2256016085545222 (-0.1012048274278641) | > avg_loss_disc_real_5: 0.2283356487751007 (-0.004189098874727876) | > avg_loss_0: 2.488173484802246 (-0.23295871416727687) | > avg_loss_gen: 2.2559356689453125 (-0.23227576414744044) | > avg_loss_kl: 4.775981664657593 (+0.08999991416931152) | > avg_loss_feat: 4.755729794502258 (-0.4998561938603716) | > avg_loss_mel: 21.501744588216145 (+0.12383206685383996) | > avg_loss_duration: 3.2620392640431723 (+0.056259075800578096) | > avg_loss_1: 36.55143038431803 (-0.4620412190755232)  > EPOCH: 1202/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:18:14)   --> TIME: 2023-10-20 15:18:42 -- STEP: 29/50 -- GLOBAL_STEP: 113130 | > loss_disc: 1.768938660621643 (2.486021568035257) | > loss_disc_real_0: 0.08431867510080338 (0.16164514766042604) | > loss_disc_real_1: 0.09493882954120636 (0.23557426061095862) | > loss_disc_real_2: 0.15292346477508545 (0.2380168912611131) | > loss_disc_real_3: 0.20429250597953796 (0.24725816019907076) | > loss_disc_real_4: 0.053024012595415115 (0.21960574041666656) | > loss_disc_real_5: 0.0818190649151802 (0.22118814796980085) | > loss_0: 1.768938660621643 (2.486021568035257) | > grad_norm_0: tensor(544.6796, device='cuda:0') (tensor(557.4173, device='cuda:0')) | > loss_gen: 2.3669705390930176 (2.247047218783148) | > loss_kl: 1.0731507539749146 (0.7918851026173296) | > loss_feat: 9.926207542419434 (6.052991935919071) | > loss_mel: 20.424787521362305 (20.839825038252204) | > loss_duration: 1.3287495374679565 (1.3402265844673946) | > loss_1: 35.11986541748047 (31.271976076323412) | > grad_norm_1: tensor(40588.8945, device='cuda:0') (tensor(23962.0723, device='cuda:0')) | > current_lr_0: 6.0113968487134916e-05 | > current_lr_1: 6.0174116283823394e-05 | > step_time: 0.354 (0.7710088696973078) | > loader_time: 0.0107 (0.02491490594271956)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8328475952148438 (2.8328475952148438) | > loss_disc_real_0: 0.31393057107925415 (0.31393057107925415) | > loss_disc_real_1: 0.22207088768482208 (0.22207088768482208) | > loss_disc_real_2: 0.25829416513442993 (0.25829416513442993) | > loss_disc_real_3: 0.23020078241825104 (0.23020078241825104) | > loss_disc_real_4: 0.27625757455825806 (0.27625757455825806) | > loss_disc_real_5: 0.3742997944355011 (0.3742997944355011) | > loss_0: 2.8328475952148438 (2.8328475952148438) | > loss_gen: 2.1578710079193115 (2.1578710079193115) | > loss_kl: 5.160452365875244 (5.160452365875244) | > loss_feat: 4.705629825592041 (4.705629825592041) | > loss_mel: 12.580209732055664 (12.580209732055664) | > loss_duration: 3.1006319522857666 (3.1006319522857666) | > loss_1: 27.704795837402344 (27.704795837402344)  --> STEP: 1 | > loss_disc: 3.385139226913452 (3.385139226913452) | > loss_disc_real_0: 0.4729597568511963 (0.4729597568511963) | > loss_disc_real_1: 0.3584945797920227 (0.3584945797920227) | > loss_disc_real_2: 0.33814436197280884 (0.33814436197280884) | > loss_disc_real_3: 0.28013789653778076 (0.28013789653778076) | > loss_disc_real_4: 0.38325372338294983 (0.38325372338294983) | > loss_disc_real_5: 0.3984163701534271 (0.3984163701534271) | > loss_0: 3.385139226913452 (3.385139226913452) | > loss_gen: 2.352385997772217 (2.352385997772217) | > loss_kl: 5.277615547180176 (5.277615547180176) | > loss_feat: 6.385098934173584 (6.385098934173584) | > loss_mel: 20.768430709838867 (20.768430709838867) | > loss_duration: 3.4800310134887695 (3.4800310134887695) | > loss_1: 38.2635612487793 (38.2635612487793)  --> STEP: 2 | > loss_disc: 2.446432113647461 (2.9157856702804565) | > loss_disc_real_0: 0.292221337556839 (0.38259054720401764) | > loss_disc_real_1: 0.26457682251930237 (0.31153570115566254) | > loss_disc_real_2: 0.3775182366371155 (0.35783129930496216) | > loss_disc_real_3: 0.2075779289007187 (0.24385791271924973) | > loss_disc_real_4: 0.22278745472431183 (0.30302058905363083) | > loss_disc_real_5: 0.20970511436462402 (0.3040607422590256) | > loss_0: 2.446432113647461 (2.9157856702804565) | > loss_gen: 2.8501060009002686 (2.6012459993362427) | > loss_kl: 6.2436442375183105 (5.760629892349243) | > loss_feat: 5.687498569488525 (6.036298751831055) | > loss_mel: 23.19660186767578 (21.982516288757324) | > loss_duration: 3.333430528640747 (3.4067307710647583) | > loss_1: 41.311283111572266 (39.78742218017578)  --> STEP: 3 | > loss_disc: 2.608236312866211 (2.8132692178090415) | > loss_disc_real_0: 0.10714372992515564 (0.290774941444397) | > loss_disc_real_1: 0.14847373962402344 (0.2571817139784495) | > loss_disc_real_2: 0.13439485430717468 (0.28335248430569965) | > loss_disc_real_3: 0.057446662336587906 (0.18172082925836244) | > loss_disc_real_4: 0.1149217039346695 (0.2403209606806437) | > loss_disc_real_5: 0.0944376066327095 (0.23418636371692023) | > loss_0: 2.608236312866211 (2.8132692178090415) | > loss_gen: 1.5300896167755127 (2.2441938718159995) | > loss_kl: 2.532442092895508 (4.684567292531331) | > loss_feat: 8.96566390991211 (7.012753804524739) | > loss_mel: 22.744056701660156 (22.23636309305827) | > loss_duration: 3.049158811569214 (3.2875401178995767) | > loss_1: 38.821414947509766 (39.46541976928711) --> EVAL PERFORMANCE | > avg_loader_time: 0.0170137882232666 (+0.0006402333577473947) | > avg_loss_disc: 2.8132692178090415 (+0.3250957330067954) | > avg_loss_disc_real_0: 0.290774941444397 (+0.11663469672203064) | > avg_loss_disc_real_1: 0.2571817139784495 (+0.024883240461349515) | > avg_loss_disc_real_2: 0.28335248430569965 (+0.03477618843317029) | > avg_loss_disc_real_3: 0.18172082925836244 (-0.06357303137580556) | > avg_loss_disc_real_4: 0.2403209606806437 (+0.014719352126121521) | > avg_loss_disc_real_5: 0.23418636371692023 (+0.005850714941819518) | > avg_loss_0: 2.8132692178090415 (+0.3250957330067954) | > avg_loss_gen: 2.2441938718159995 (-0.011741797129313003) | > avg_loss_kl: 4.684567292531331 (-0.09141437212626169) | > avg_loss_feat: 7.012753804524739 (+2.257024010022481) | > avg_loss_mel: 22.23636309305827 (+0.7346185048421248) | > avg_loss_duration: 3.2875401178995767 (+0.025500853856404326) | > avg_loss_1: 39.46541976928711 (+2.913989384969078)  > EPOCH: 1203/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:19:02)   --> TIME: 2023-10-20 15:19:12 -- STEP: 9/50 -- GLOBAL_STEP: 113160 | > loss_disc: 2.4153568744659424 (2.505616638395521) | > loss_disc_real_0: 0.06306576728820801 (0.14388948058088621) | > loss_disc_real_1: 0.15365950763225555 (0.21189880619446436) | > loss_disc_real_2: 0.17811010777950287 (0.2163309653600057) | > loss_disc_real_3: 0.3178348243236542 (0.22351165571146542) | > loss_disc_real_4: 0.13545306026935577 (0.20077912426657146) | > loss_disc_real_5: 0.21751098334789276 (0.21904471268256506) | > loss_0: 2.4153568744659424 (2.505616638395521) | > grad_norm_0: tensor(282.9346, device='cuda:0') (tensor(621.1785, device='cuda:0')) | > loss_gen: 2.2783446311950684 (2.112931966781616) | > loss_kl: 0.198225200176239 (0.8727300564448038) | > loss_feat: 6.950552940368652 (4.660659164190292) | > loss_mel: 19.669424057006836 (18.42879083421495) | > loss_duration: 1.3198550939559937 (1.3549728790918987) | > loss_1: 30.41640281677246 (27.430085288153755) | > grad_norm_1: tensor(5751.9932, device='cuda:0') (tensor(10888.6455, device='cuda:0')) | > current_lr_0: 6.0053880811935036e-05 | > current_lr_1: 6.0113968487134916e-05 | > step_time: 0.5209 (0.6459296014573839) | > loader_time: 0.0303 (0.017445802688598633)  --> TIME: 2023-10-20 15:19:32 -- STEP: 39/50 -- GLOBAL_STEP: 113190 | > loss_disc: 0.9651181697845459 (2.450904968457344) | > loss_disc_real_0: 0.01007125899195671 (0.13853767074835607) | > loss_disc_real_1: 0.042919278144836426 (0.21961809828495368) | > loss_disc_real_2: 0.06836724281311035 (0.22400517035753298) | > loss_disc_real_3: 0.09018763899803162 (0.22124049134361437) | > loss_disc_real_4: 0.02517801523208618 (0.2228338515911347) | > loss_disc_real_5: 0.0327773317694664 (0.22869864211250573) | > loss_0: 0.9651181697845459 (2.450904968457344) | > grad_norm_0: tensor(355.9299, device='cuda:0') (tensor(598.6211, device='cuda:0')) | > loss_gen: 3.6381914615631104 (2.24793016910553) | > loss_kl: 0.5382034778594971 (0.8679840641143994) | > loss_feat: 14.167671203613281 (5.569018443043417) | > loss_mel: 25.4219913482666 (20.43741580767509) | > loss_duration: 1.430808186531067 (1.3269951618634737) | > loss_1: 45.19686508178711 (30.449344072586452) | > grad_norm_1: tensor(6987.5796, device='cuda:0') (tensor(17133.9785, device='cuda:0')) | > current_lr_0: 6.0053880811935036e-05 | > current_lr_1: 6.0113968487134916e-05 | > step_time: 0.6139 (0.6354351043701172) | > loader_time: 0.024 (0.020936269026536208)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.020805835723877 (3.020805835723877) | > loss_disc_real_0: 0.21491014957427979 (0.21491014957427979) | > loss_disc_real_1: 0.27834540605545044 (0.27834540605545044) | > loss_disc_real_2: 0.27350738644599915 (0.27350738644599915) | > loss_disc_real_3: 0.27314233779907227 (0.27314233779907227) | > loss_disc_real_4: 0.293973833322525 (0.293973833322525) | > loss_disc_real_5: 0.27292218804359436 (0.27292218804359436) | > loss_0: 3.020805835723877 (3.020805835723877) | > loss_gen: 1.5960348844528198 (1.5960348844528198) | > loss_kl: 7.115029811859131 (7.115029811859131) | > loss_feat: 0.04442373290657997 (0.04442373290657997) | > loss_mel: 1.8560891151428223 (1.8560891151428223) | > loss_duration: 3.108266830444336 (3.108266830444336) | > loss_1: 13.719844818115234 (13.719844818115234)  --> STEP: 1 | > loss_disc: 2.357977867126465 (2.357977867126465) | > loss_disc_real_0: 0.15210576355457306 (0.15210576355457306) | > loss_disc_real_1: 0.2335226982831955 (0.2335226982831955) | > loss_disc_real_2: 0.2601547837257385 (0.2601547837257385) | > loss_disc_real_3: 0.26578420400619507 (0.26578420400619507) | > loss_disc_real_4: 0.3225666582584381 (0.3225666582584381) | > loss_disc_real_5: 0.2262762486934662 (0.2262762486934662) | > loss_0: 2.357977867126465 (2.357977867126465) | > loss_gen: 2.566145896911621 (2.566145896911621) | > loss_kl: 5.874902248382568 (5.874902248382568) | > loss_feat: 7.444370746612549 (7.444370746612549) | > loss_mel: 25.406517028808594 (25.406517028808594) | > loss_duration: 3.443413019180298 (3.443413019180298) | > loss_1: 44.7353515625 (44.7353515625)  --> STEP: 2 | > loss_disc: 2.7045271396636963 (2.5312525033950806) | > loss_disc_real_0: 0.09286363422870636 (0.12248469889163971) | > loss_disc_real_1: 0.29245662689208984 (0.26298966258764267) | > loss_disc_real_2: 0.32575997710227966 (0.2929573804140091) | > loss_disc_real_3: 0.2962598204612732 (0.28102201223373413) | > loss_disc_real_4: 0.32058489322662354 (0.3215757757425308) | > loss_disc_real_5: 0.3379276394844055 (0.28210194408893585) | > loss_0: 2.7045271396636963 (2.5312525033950806) | > loss_gen: 2.1756038665771484 (2.3708748817443848) | > loss_kl: 6.121662139892578 (5.998282194137573) | > loss_feat: 3.1487228870391846 (5.296546816825867) | > loss_mel: 24.74056625366211 (25.07354164123535) | > loss_duration: 3.301093816757202 (3.37225341796875) | > loss_1: 39.487648010253906 (42.11149978637695)  --> STEP: 3 | > loss_disc: 2.799960136413574 (2.620821714401245) | > loss_disc_real_0: 0.025769121944904327 (0.09024617324272792) | > loss_disc_real_1: 0.33289551734924316 (0.28629161417484283) | > loss_disc_real_2: 0.2163831740617752 (0.26743264496326447) | > loss_disc_real_3: 0.30867862701416016 (0.2902408838272095) | > loss_disc_real_4: 0.32510906457901 (0.32275353868802387) | > loss_disc_real_5: 0.35640257596969604 (0.3068688213825226) | > loss_0: 2.799960136413574 (2.620821714401245) | > loss_gen: 2.0876617431640625 (2.276470502217611) | > loss_kl: 2.3559346199035645 (4.78416633605957) | > loss_feat: 4.630838871002197 (5.074644168217977) | > loss_mel: 21.22259521484375 (23.789892832438152) | > loss_duration: 3.0381505489349365 (3.260885794957479) | > loss_1: 33.335182189941406 (39.1860605875651) --> EVAL PERFORMANCE | > avg_loader_time: 0.03521275520324707 (+0.01819896697998047) | > avg_loss_disc: 2.620821714401245 (-0.19244750340779637) | > avg_loss_disc_real_0: 0.09024617324272792 (-0.20052876820166904) | > avg_loss_disc_real_1: 0.28629161417484283 (+0.029109900196393312) | > avg_loss_disc_real_2: 0.26743264496326447 (-0.015919839342435183) | > avg_loss_disc_real_3: 0.2902408838272095 (+0.10852005456884703) | > avg_loss_disc_real_4: 0.32275353868802387 (+0.08243257800738016) | > avg_loss_disc_real_5: 0.3068688213825226 (+0.07268245766560236) | > avg_loss_0: 2.620821714401245 (-0.19244750340779637) | > avg_loss_gen: 2.276470502217611 (+0.03227663040161133) | > avg_loss_kl: 4.78416633605957 (+0.09959904352823923) | > avg_loss_feat: 5.074644168217977 (-1.9381096363067627) | > avg_loss_mel: 23.789892832438152 (+1.5535297393798828) | > avg_loss_duration: 3.260885794957479 (-0.026654322942097686) | > avg_loss_1: 39.1860605875651 (-0.2793591817220076)  > EPOCH: 1204/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:19:54)   --> TIME: 2023-10-20 15:20:12 -- STEP: 19/50 -- GLOBAL_STEP: 113220 | > loss_disc: 2.875565767288208 (2.1681567932430066) | > loss_disc_real_0: 0.3927859663963318 (0.13464807366069995) | > loss_disc_real_1: 0.27730751037597656 (0.19729519615832128) | > loss_disc_real_2: 0.25268447399139404 (0.17657011453258364) | > loss_disc_real_3: 0.2412584125995636 (0.18699399970079722) | > loss_disc_real_4: 0.3868628442287445 (0.20419778517986598) | > loss_disc_real_5: 0.38264456391334534 (0.20883663047693277) | > loss_0: 2.875565767288208 (2.1681567932430066) | > grad_norm_0: tensor(996.5316, device='cuda:0') (tensor(515.7645, device='cuda:0')) | > loss_gen: 2.4223170280456543 (2.4698586024736104) | > loss_kl: 0.7463520169258118 (0.8948715976194331) | > loss_feat: 2.9518744945526123 (7.300721938182649) | > loss_mel: 21.938161849975586 (20.619894316321925) | > loss_duration: 1.3891295194625854 (1.358699503697847) | > loss_1: 29.44783592224121 (32.644046105836566) | > grad_norm_1: tensor(2930.5256, device='cuda:0') (tensor(27958.2832, device='cuda:0')) | > current_lr_0: 5.999385319812857e-05 | > current_lr_1: 6.0053880811935036e-05 | > step_time: 0.443 (0.6237107452593351) | > loader_time: 0.007 (0.024874963258442125)  --> TIME: 2023-10-20 15:20:29 -- STEP: 49/50 -- GLOBAL_STEP: 113250 | > loss_disc: 1.9587078094482422 (2.3420762383207987) | > loss_disc_real_0: 0.015428914688527584 (0.12945022979485138) | > loss_disc_real_1: 0.14259082078933716 (0.21274158852745076) | > loss_disc_real_2: 0.19715870916843414 (0.21015261463364776) | > loss_disc_real_3: 0.27813228964805603 (0.23514093025302402) | > loss_disc_real_4: 0.13707147538661957 (0.2190286427432177) | > loss_disc_real_5: 0.06205618381500244 (0.22919055891736428) | > loss_0: 1.9587078094482422 (2.3420762383207987) | > grad_norm_0: tensor(923.4548, device='cuda:0') (tensor(580.1314, device='cuda:0')) | > loss_gen: 2.789185047149658 (2.334827819649054) | > loss_kl: 0.7685433030128479 (0.8369542002982023) | > loss_feat: 8.105755805969238 (5.768004902923594) | > loss_mel: 21.631507873535156 (19.205356720758946) | > loss_duration: 1.41913902759552 (1.3219742993919217) | > loss_1: 34.71413040161133 (29.467118088079957) | > grad_norm_1: tensor(11257.2637, device='cuda:0') (tensor(21992.6211, device='cuda:0')) | > current_lr_0: 5.999385319812857e-05 | > current_lr_1: 6.0053880811935036e-05 | > step_time: 0.53 (0.5829784578206586) | > loader_time: 0.4641 (0.03001256864898058)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8212318420410156 (2.8212318420410156) | > loss_disc_real_0: 0.2065390944480896 (0.2065390944480896) | > loss_disc_real_1: 0.23626306653022766 (0.23626306653022766) | > loss_disc_real_2: 0.2714797854423523 (0.2714797854423523) | > loss_disc_real_3: 0.21984966099262238 (0.21984966099262238) | > loss_disc_real_4: 0.28371462225914 (0.28371462225914) | > loss_disc_real_5: 0.27521559596061707 (0.27521559596061707) | > loss_0: 2.8212318420410156 (2.8212318420410156) | > loss_gen: 1.7183270454406738 (1.7183270454406738) | > loss_kl: 5.473944187164307 (5.473944187164307) | > loss_feat: 0.6258546113967896 (0.6258546113967896) | > loss_mel: 14.077873229980469 (14.077873229980469) | > loss_duration: 3.0672266483306885 (3.0672266483306885) | > loss_1: 24.963224411010742 (24.963224411010742)  --> STEP: 1 | > loss_disc: 0.9412572383880615 (0.9412572383880615) | > loss_disc_real_0: 0.05476442724466324 (0.05476442724466324) | > loss_disc_real_1: 0.07472158968448639 (0.07472158968448639) | > loss_disc_real_2: 0.055763956159353256 (0.055763956159353256) | > loss_disc_real_3: 0.0161786749958992 (0.0161786749958992) | > loss_disc_real_4: 0.033904314041137695 (0.033904314041137695) | > loss_disc_real_5: 0.04669412970542908 (0.04669412970542908) | > loss_0: 0.9412572383880615 (0.9412572383880615) | > loss_gen: 3.017387866973877 (3.017387866973877) | > loss_kl: 5.877296447753906 (5.877296447753906) | > loss_feat: 16.81669044494629 (16.81669044494629) | > loss_mel: 25.923357009887695 (25.923357009887695) | > loss_duration: 3.445034980773926 (3.445034980773926) | > loss_1: 55.07976531982422 (55.07976531982422)  --> STEP: 2 | > loss_disc: 3.547600746154785 (2.2444289922714233) | > loss_disc_real_0: 0.7352209687232971 (0.3949926979839802) | > loss_disc_real_1: 0.29700520634651184 (0.18586339801549911) | > loss_disc_real_2: 0.41005611419677734 (0.2329100351780653) | > loss_disc_real_3: 0.21872815489768982 (0.11745341494679451) | > loss_disc_real_4: 0.36317306756973267 (0.19853869080543518) | > loss_disc_real_5: 0.41072434186935425 (0.22870923578739166) | > loss_0: 3.547600746154785 (2.2444289922714233) | > loss_gen: 2.4002845287323 (2.7088361978530884) | > loss_kl: 6.759976387023926 (6.318636417388916) | > loss_feat: 7.814208507537842 (12.315449476242065) | > loss_mel: 22.639074325561523 (24.28121566772461) | > loss_duration: 3.2487633228302 (3.346899151802063) | > loss_1: 42.8623046875 (48.97103500366211)  --> STEP: 3 | > loss_disc: 2.9791388511657715 (2.4893322785695395) | > loss_disc_real_0: 0.30176210403442383 (0.3639158333341281) | > loss_disc_real_1: 0.23981085419654846 (0.20384588340918222) | > loss_disc_real_2: 0.2717839777469635 (0.2458680160343647) | > loss_disc_real_3: 0.21994328498840332 (0.15161670496066412) | > loss_disc_real_4: 0.27020540833473206 (0.22242759664853415) | > loss_disc_real_5: 0.27258265018463135 (0.24333370725313822) | > loss_0: 2.9791388511657715 (2.4893322785695395) | > loss_gen: 1.6139497756958008 (2.3438740571339927) | > loss_kl: 2.7103211879730225 (5.115864674250285) | > loss_feat: 0.1186939999461174 (8.24986431747675) | > loss_mel: 3.0329089164733887 (17.19844675064087) | > loss_duration: 2.9560468196868896 (3.2166150410970054) | > loss_1: 10.431921005249023 (36.12466367085775) --> EVAL PERFORMANCE | > avg_loader_time: 0.005271593729654948 (-0.02994116147359212) | > avg_loss_disc: 2.4893322785695395 (-0.13148943583170558) | > avg_loss_disc_real_0: 0.3639158333341281 (+0.27366966009140015) | > avg_loss_disc_real_1: 0.20384588340918222 (-0.08244573076566061) | > avg_loss_disc_real_2: 0.2458680160343647 (-0.021564628928899765) | > avg_loss_disc_real_3: 0.15161670496066412 (-0.13862417886654535) | > avg_loss_disc_real_4: 0.22242759664853415 (-0.10032594203948972) | > avg_loss_disc_real_5: 0.24333370725313822 (-0.06353511412938437) | > avg_loss_0: 2.4893322785695395 (-0.13148943583170558) | > avg_loss_gen: 2.3438740571339927 (+0.06740355491638184) | > avg_loss_kl: 5.115864674250285 (+0.3316983381907148) | > avg_loss_feat: 8.24986431747675 (+3.175220149258773) | > avg_loss_mel: 17.19844675064087 (-6.591446081797283) | > avg_loss_duration: 3.2166150410970054 (-0.04427075386047363) | > avg_loss_1: 36.12466367085775 (-3.061396916707352)  > EPOCH: 1205/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:20:46)   --> TIME: 2023-10-20 15:21:07 -- STEP: 29/50 -- GLOBAL_STEP: 113280 | > loss_disc: 1.5682979822158813 (2.4987723210762285) | > loss_disc_real_0: 0.03358003497123718 (0.16864752384095355) | > loss_disc_real_1: 0.1550331860780716 (0.22522076912995043) | > loss_disc_real_2: 0.10464926809072495 (0.2293692423865713) | > loss_disc_real_3: 0.07017000019550323 (0.23455132479811536) | > loss_disc_real_4: 0.030535917729139328 (0.23775875902381435) | > loss_disc_real_5: 0.025104299187660217 (0.22221407670013862) | > loss_0: 1.5682979822158813 (2.4987723210762285) | > grad_norm_0: tensor(615.2051, device='cuda:0') (tensor(760.0433, device='cuda:0')) | > loss_gen: 2.1631805896759033 (2.1939327100227617) | > loss_kl: 0.8392126560211182 (0.8076374232769012) | > loss_feat: 8.295171737670898 (5.55957951525162) | > loss_mel: 21.206968307495117 (19.097386430049763) | > loss_duration: 1.3408536911010742 (1.3418899404591527) | > loss_1: 33.84538650512695 (29.000426423960718) | > grad_norm_1: tensor(6346.4775, device='cuda:0') (tensor(17257.0332, device='cuda:0')) | > current_lr_0: 5.993388558568039e-05 | > current_lr_1: 5.999385319812857e-05 | > step_time: 0.8788 (0.5171515283913448) | > loader_time: 0.0415 (0.01565592864464069)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3690903186798096 (2.3690903186798096) | > loss_disc_real_0: 0.15533383190631866 (0.15533383190631866) | > loss_disc_real_1: 0.2027929425239563 (0.2027929425239563) | > loss_disc_real_2: 0.17009225487709045 (0.17009225487709045) | > loss_disc_real_3: 0.24764227867126465 (0.24764227867126465) | > loss_disc_real_4: 0.22171157598495483 (0.22171157598495483) | > loss_disc_real_5: 0.1975553035736084 (0.1975553035736084) | > loss_0: 2.3690903186798096 (2.3690903186798096) | > loss_gen: 2.071343183517456 (2.071343183517456) | > loss_kl: 5.393530368804932 (5.393530368804932) | > loss_feat: 2.822521686553955 (2.822521686553955) | > loss_mel: 18.0841064453125 (18.0841064453125) | > loss_duration: 3.0832114219665527 (3.0832114219665527) | > loss_1: 31.454713821411133 (31.454713821411133)  --> STEP: 1 | > loss_disc: 2.7187836170196533 (2.7187836170196533) | > loss_disc_real_0: 0.12284452468156815 (0.12284452468156815) | > loss_disc_real_1: 0.24253873527050018 (0.24253873527050018) | > loss_disc_real_2: 0.2805123031139374 (0.2805123031139374) | > loss_disc_real_3: 0.32877984642982483 (0.32877984642982483) | > loss_disc_real_4: 0.32858821749687195 (0.32858821749687195) | > loss_disc_real_5: 0.2832641303539276 (0.2832641303539276) | > loss_0: 2.7187836170196533 (2.7187836170196533) | > loss_gen: 2.252551555633545 (2.252551555633545) | > loss_kl: 5.840651035308838 (5.840651035308838) | > loss_feat: 6.174320697784424 (6.174320697784424) | > loss_mel: 23.393333435058594 (23.393333435058594) | > loss_duration: 3.4812798500061035 (3.4812798500061035) | > loss_1: 41.14213943481445 (41.14213943481445)  --> STEP: 2 | > loss_disc: 1.9504833221435547 (2.334633469581604) | > loss_disc_real_0: 0.08207297325134277 (0.10245874896645546) | > loss_disc_real_1: 0.29808151721954346 (0.2703101262450218) | > loss_disc_real_2: 0.1296938806772232 (0.2051030918955803) | > loss_disc_real_3: 0.1948697865009308 (0.2618248164653778) | > loss_disc_real_4: 0.11804535984992981 (0.22331678867340088) | > loss_disc_real_5: 0.18236353993415833 (0.23281383514404297) | > loss_0: 1.9504833221435547 (2.334633469581604) | > loss_gen: 2.7669079303741455 (2.509729743003845) | > loss_kl: 6.257297039031982 (6.04897403717041) | > loss_feat: 9.497156143188477 (7.83573842048645) | > loss_mel: 26.359725952148438 (24.876529693603516) | > loss_duration: 3.243476152420044 (3.3623780012130737) | > loss_1: 48.12456512451172 (44.633352279663086)  --> STEP: 3 | > loss_disc: 2.9001166820526123 (2.523127873738607) | > loss_disc_real_0: 0.3965267539024353 (0.20048141727844873) | > loss_disc_real_1: 0.27835068106651306 (0.2729903111855189) | > loss_disc_real_2: 0.2565068304538727 (0.22223767141501108) | > loss_disc_real_3: 0.36913058161735535 (0.2975934048493703) | > loss_disc_real_4: 0.19469335675239563 (0.21377564469973245) | > loss_disc_real_5: 0.14589223265647888 (0.20383996764818826) | > loss_0: 2.9001166820526123 (2.523127873738607) | > loss_gen: 1.99257493019104 (2.3373448053995767) | > loss_kl: 2.746678113937378 (4.948208729426066) | > loss_feat: 3.5119495391845703 (6.39447546005249) | > loss_mel: 20.817819595336914 (23.52362632751465) | > loss_duration: 3.0320730209350586 (3.252276341120402) | > loss_1: 32.10109329223633 (40.4559326171875) --> EVAL PERFORMANCE | > avg_loader_time: 0.0022394657135009766 (-0.0030321280161539716) | > avg_loss_disc: 2.523127873738607 (+0.03379559516906738) | > avg_loss_disc_real_0: 0.20048141727844873 (-0.16343441605567935) | > avg_loss_disc_real_1: 0.2729903111855189 (+0.0691444277763367) | > avg_loss_disc_real_2: 0.22223767141501108 (-0.02363034461935362) | > avg_loss_disc_real_3: 0.2975934048493703 (+0.14597669988870618) | > avg_loss_disc_real_4: 0.21377564469973245 (-0.008651951948801695) | > avg_loss_disc_real_5: 0.20383996764818826 (-0.03949373960494995) | > avg_loss_0: 2.523127873738607 (+0.03379559516906738) | > avg_loss_gen: 2.3373448053995767 (-0.006529251734415986) | > avg_loss_kl: 4.948208729426066 (-0.16765594482421875) | > avg_loss_feat: 6.39447546005249 (-1.8553888574242592) | > avg_loss_mel: 23.52362632751465 (+6.325179576873779) | > avg_loss_duration: 3.252276341120402 (+0.035661300023396514) | > avg_loss_1: 40.4559326171875 (+4.33126894632975)  > EPOCH: 1206/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:21:37)   --> TIME: 2023-10-20 15:21:48 -- STEP: 9/50 -- GLOBAL_STEP: 113310 | > loss_disc: 2.3132970333099365 (2.4402217864990234) | > loss_disc_real_0: 0.19093698263168335 (0.11607005074620247) | > loss_disc_real_1: 0.25578346848487854 (0.20716269852386582) | > loss_disc_real_2: 0.17615170776844025 (0.18885250265399614) | > loss_disc_real_3: 0.341330885887146 (0.23617197490400738) | > loss_disc_real_4: 0.20714780688285828 (0.2542719886534744) | > loss_disc_real_5: 0.22213757038116455 (0.1992696478135056) | > loss_0: 2.3132970333099365 (2.4402217864990234) | > grad_norm_0: tensor(804.3204, device='cuda:0') (tensor(737.2649, device='cuda:0')) | > loss_gen: 2.3860325813293457 (2.177185297012329) | > loss_kl: 0.6210463643074036 (0.7318904532326592) | > loss_feat: 3.5010786056518555 (6.081374163842863) | > loss_mel: 21.495874404907227 (18.50351275338067) | > loss_duration: 1.2896661758422852 (1.29998513062795) | > loss_1: 29.293697357177734 (28.793947643703884) | > grad_norm_1: tensor(5525.3208, device='cuda:0') (tensor(25447.1523, device='cuda:0')) | > current_lr_0: 5.9873977914615396e-05 | > current_lr_1: 5.993388558568039e-05 | > step_time: 0.5428 (0.547704643673367) | > loader_time: 0.0262 (0.03293638759189182)  --> TIME: 2023-10-20 15:22:06 -- STEP: 39/50 -- GLOBAL_STEP: 113340 | > loss_disc: 2.4593899250030518 (2.3673349985709558) | > loss_disc_real_0: 0.09895854443311691 (0.1361565307403604) | > loss_disc_real_1: 0.21731901168823242 (0.2198741591702669) | > loss_disc_real_2: 0.23615284264087677 (0.21175697990334952) | > loss_disc_real_3: 0.31023696064949036 (0.22224269969723162) | > loss_disc_real_4: 0.40098878741264343 (0.21652904444206983) | > loss_disc_real_5: 0.33357205986976624 (0.2074081888064169) | > loss_0: 2.4593899250030518 (2.3673349985709558) | > grad_norm_0: tensor(707.2002, device='cuda:0') (tensor(662.1814, device='cuda:0')) | > loss_gen: 2.8071112632751465 (2.295551948058299) | > loss_kl: 0.5444380044937134 (0.7456124929281381) | > loss_feat: 4.378629207611084 (5.64591555359463) | > loss_mel: 20.527812957763672 (19.33909473510889) | > loss_duration: 1.4105349779129028 (1.3179146693303034) | > loss_1: 29.668527603149414 (29.344089398017296) | > grad_norm_1: tensor(25110.3711, device='cuda:0') (tensor(21352.9922, device='cuda:0')) | > current_lr_0: 5.9873977914615396e-05 | > current_lr_1: 5.993388558568039e-05 | > step_time: 0.5566 (0.5928021822220242) | > loader_time: 0.0063 (0.023447696979229268)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.14093279838562 (2.14093279838562) | > loss_disc_real_0: 0.0664103701710701 (0.0664103701710701) | > loss_disc_real_1: 0.20210151374340057 (0.20210151374340057) | > loss_disc_real_2: 0.25238871574401855 (0.25238871574401855) | > loss_disc_real_3: 0.2958117425441742 (0.2958117425441742) | > loss_disc_real_4: 0.22589537501335144 (0.22589537501335144) | > loss_disc_real_5: 0.16638487577438354 (0.16638487577438354) | > loss_0: 2.14093279838562 (2.14093279838562) | > loss_gen: 2.5132265090942383 (2.5132265090942383) | > loss_kl: 5.416604995727539 (5.416604995727539) | > loss_feat: 7.611108303070068 (7.611108303070068) | > loss_mel: 23.851144790649414 (23.851144790649414) | > loss_duration: 3.120943546295166 (3.120943546295166) | > loss_1: 42.513031005859375 (42.513031005859375)  --> STEP: 1 | > loss_disc: 2.8870105743408203 (2.8870105743408203) | > loss_disc_real_0: 0.26677757501602173 (0.26677757501602173) | > loss_disc_real_1: 0.24533149600028992 (0.24533149600028992) | > loss_disc_real_2: 0.1690533310174942 (0.1690533310174942) | > loss_disc_real_3: 0.32250672578811646 (0.32250672578811646) | > loss_disc_real_4: 0.38997796177864075 (0.38997796177864075) | > loss_disc_real_5: 0.44312140345573425 (0.44312140345573425) | > loss_0: 2.8870105743408203 (2.8870105743408203) | > loss_gen: 2.2984867095947266 (2.2984867095947266) | > loss_kl: 5.695916175842285 (5.695916175842285) | > loss_feat: 5.63624382019043 (5.63624382019043) | > loss_mel: 24.978530883789062 (24.978530883789062) | > loss_duration: 3.3327407836914062 (3.3327407836914062) | > loss_1: 41.941917419433594 (41.941917419433594)  --> STEP: 2 | > loss_disc: 2.557936191558838 (2.722473382949829) | > loss_disc_real_0: 0.0738486796617508 (0.17031312733888626) | > loss_disc_real_1: 0.17543531954288483 (0.21038340777158737) | > loss_disc_real_2: 0.23881448805332184 (0.20393390953540802) | > loss_disc_real_3: 0.26115861535072327 (0.29183267056941986) | > loss_disc_real_4: 0.24030673503875732 (0.31514234840869904) | > loss_disc_real_5: 0.3347204625606537 (0.38892093300819397) | > loss_0: 2.557936191558838 (2.722473382949829) | > loss_gen: 1.9386810064315796 (2.118583858013153) | > loss_kl: 6.928185939788818 (6.312051057815552) | > loss_feat: 10.512324333190918 (8.074284076690674) | > loss_mel: 24.46329689025879 (24.720913887023926) | > loss_duration: 3.3759524822235107 (3.3543466329574585) | > loss_1: 47.21844482421875 (44.58018112182617)  --> STEP: 3 | > loss_disc: 2.5254549980163574 (2.6568005879720054) | > loss_disc_real_0: 0.12078726291656494 (0.15380450586477915) | > loss_disc_real_1: 0.29869088530540466 (0.23981923361619314) | > loss_disc_real_2: 0.27749618887901306 (0.2284546693166097) | > loss_disc_real_3: 0.2278272807598114 (0.2704975406328837) | > loss_disc_real_4: 0.26418936252593994 (0.29815801978111267) | > loss_disc_real_5: 0.27963829040527344 (0.35249338547388714) | > loss_0: 2.5254549980163574 (2.6568005879720054) | > loss_gen: 2.1414778232574463 (2.126215179761251) | > loss_kl: 3.109665870666504 (5.244589328765869) | > loss_feat: 2.7963030338287354 (6.314957062403361) | > loss_mel: 19.103708267211914 (22.848512013753254) | > loss_duration: 2.931885004043579 (3.2135260899861655) | > loss_1: 30.083040237426758 (39.74780082702637) --> EVAL PERFORMANCE | > avg_loader_time: 0.013851642608642578 (+0.011612176895141602) | > avg_loss_disc: 2.6568005879720054 (+0.13367271423339844) | > avg_loss_disc_real_0: 0.15380450586477915 (-0.046676911413669586) | > avg_loss_disc_real_1: 0.23981923361619314 (-0.033171077569325774) | > avg_loss_disc_real_2: 0.2284546693166097 (+0.006216997901598631) | > avg_loss_disc_real_3: 0.2704975406328837 (-0.027095864216486576) | > avg_loss_disc_real_4: 0.29815801978111267 (+0.08438237508138022) | > avg_loss_disc_real_5: 0.35249338547388714 (+0.14865341782569888) | > avg_loss_0: 2.6568005879720054 (+0.13367271423339844) | > avg_loss_gen: 2.126215179761251 (-0.2111296256383257) | > avg_loss_kl: 5.244589328765869 (+0.29638059933980276) | > avg_loss_feat: 6.314957062403361 (-0.07951839764912894) | > avg_loss_mel: 22.848512013753254 (-0.6751143137613944) | > avg_loss_duration: 3.2135260899861655 (-0.03875025113423636) | > avg_loss_1: 39.74780082702637 (-0.7081317901611328)  > EPOCH: 1207/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:22:32)   --> TIME: 2023-10-20 15:22:49 -- STEP: 19/50 -- GLOBAL_STEP: 113370 | > loss_disc: 2.040642738342285 (2.2470825063554862) | > loss_disc_real_0: 0.16158226132392883 (0.12170840142981003) | > loss_disc_real_1: 0.13088765740394592 (0.2007231567251055) | > loss_disc_real_2: 0.2498638778924942 (0.21416920085290544) | > loss_disc_real_3: 0.13364064693450928 (0.22565569130605773) | > loss_disc_real_4: 0.1509847491979599 (0.19318580098058047) | > loss_disc_real_5: 0.20603297650814056 (0.18658146968013362) | > loss_0: 2.040642738342285 (2.2470825063554862) | > grad_norm_0: tensor(846.3205, device='cuda:0') (tensor(649.1748, device='cuda:0')) | > loss_gen: 3.011324882507324 (2.469080096796939) | > loss_kl: 0.8915615081787109 (0.8372578338572854) | > loss_feat: 7.946165561676025 (6.736445434783635) | > loss_mel: 23.168865203857422 (22.989574187680294) | > loss_duration: 1.3780683279037476 (1.3730374762886448) | > loss_1: 36.3959846496582 (34.4053948302018) | > grad_norm_1: tensor(16412.9902, device='cuda:0') (tensor(20255.0781, device='cuda:0')) | > current_lr_0: 5.9814130125018406e-05 | > current_lr_1: 5.9873977914615396e-05 | > step_time: 0.3518 (0.6284134137003046) | > loader_time: 0.0031 (0.015322886015239515)  --> TIME: 2023-10-20 15:23:00 -- STEP: 49/50 -- GLOBAL_STEP: 113400 | > loss_disc: 2.026890754699707 (2.347711104519513) | > loss_disc_real_0: 0.09602145105600357 (0.13093730191491096) | > loss_disc_real_1: 0.16313667595386505 (0.2083601832998042) | > loss_disc_real_2: 0.3171568512916565 (0.20808069390833986) | > loss_disc_real_3: 0.22354701161384583 (0.23166014189470788) | > loss_disc_real_4: 0.32462450861930847 (0.21602176555565425) | > loss_disc_real_5: 0.22831839323043823 (0.21638857094304903) | > loss_0: 2.026890754699707 (2.347711104519513) | > grad_norm_0: tensor(545.3292, device='cuda:0') (tensor(578.6060, device='cuda:0')) | > loss_gen: 3.078831195831299 (2.3774575165339873) | > loss_kl: 0.7477858662605286 (0.8007421323231287) | > loss_feat: 5.976410388946533 (6.0106229105470135) | > loss_mel: 23.85501480102539 (21.508562411580765) | > loss_duration: 1.4686225652694702 (1.338645161414633) | > loss_1: 35.12666702270508 (32.03602990325617) | > grad_norm_1: tensor(48305.5000, device='cuda:0') (tensor(15384.5146, device='cuda:0')) | > current_lr_0: 5.9814130125018406e-05 | > current_lr_1: 5.9873977914615396e-05 | > step_time: 0.2542 (0.4562331024481327) | > loader_time: 0.3887 (0.01711798687370456)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8083646297454834 (2.8083646297454834) | > loss_disc_real_0: 0.2562163472175598 (0.2562163472175598) | > loss_disc_real_1: 0.2658642828464508 (0.2658642828464508) | > loss_disc_real_2: 0.25930535793304443 (0.25930535793304443) | > loss_disc_real_3: 0.23344285786151886 (0.23344285786151886) | > loss_disc_real_4: 0.2357371300458908 (0.2357371300458908) | > loss_disc_real_5: 0.18729370832443237 (0.18729370832443237) | > loss_0: 2.8083646297454834 (2.8083646297454834) | > loss_gen: 1.6721751689910889 (1.6721751689910889) | > loss_kl: 6.587474822998047 (6.587474822998047) | > loss_feat: 0.9051957130432129 (0.9051957130432129) | > loss_mel: 8.131349563598633 (8.131349563598633) | > loss_duration: 3.013479232788086 (3.013479232788086) | > loss_1: 20.309673309326172 (20.309673309326172)  --> STEP: 1 | > loss_disc: 2.2839152812957764 (2.2839152812957764) | > loss_disc_real_0: 0.00977782066911459 (0.00977782066911459) | > loss_disc_real_1: 0.11367572098970413 (0.11367572098970413) | > loss_disc_real_2: 0.07035700231790543 (0.07035700231790543) | > loss_disc_real_3: 0.06452277302742004 (0.06452277302742004) | > loss_disc_real_4: 0.219913050532341 (0.219913050532341) | > loss_disc_real_5: 0.07327893376350403 (0.07327893376350403) | > loss_0: 2.2839152812957764 (2.2839152812957764) | > loss_gen: 1.6424157619476318 (1.6424157619476318) | > loss_kl: 5.740304946899414 (5.740304946899414) | > loss_feat: 14.107168197631836 (14.107168197631836) | > loss_mel: 25.363073348999023 (25.363073348999023) | > loss_duration: 3.451335906982422 (3.451335906982422) | > loss_1: 50.304298400878906 (50.304298400878906)  --> STEP: 2 | > loss_disc: 2.521155834197998 (2.402535557746887) | > loss_disc_real_0: 0.07705900073051453 (0.04341841069981456) | > loss_disc_real_1: 0.20218202471733093 (0.15792887285351753) | > loss_disc_real_2: 0.2474731057882309 (0.15891505405306816) | > loss_disc_real_3: 0.262185275554657 (0.1633540242910385) | > loss_disc_real_4: 0.17631538212299347 (0.19811421632766724) | > loss_disc_real_5: 0.26133280992507935 (0.1673058718442917) | > loss_0: 2.521155834197998 (2.402535557746887) | > loss_gen: 2.0239992141723633 (1.8332074880599976) | > loss_kl: 6.07436990737915 (5.907337427139282) | > loss_feat: 7.702408313751221 (10.904788255691528) | > loss_mel: 25.548585891723633 (25.455829620361328) | > loss_duration: 3.209017753601074 (3.330176830291748) | > loss_1: 44.558380126953125 (47.431339263916016)  --> STEP: 3 | > loss_disc: 3.096494197845459 (2.633855104446411) | > loss_disc_real_0: 0.2806306779384613 (0.12248916644603014) | > loss_disc_real_1: 0.2516627013683319 (0.18917348235845566) | > loss_disc_real_2: 0.2941235899925232 (0.2039845660328865) | > loss_disc_real_3: 0.32260480523109436 (0.2164376179377238) | > loss_disc_real_4: 0.3463057577610016 (0.24751139680544534) | > loss_disc_real_5: 0.4895547926425934 (0.2747221787770589) | > loss_0: 3.096494197845459 (2.633855104446411) | > loss_gen: 2.3690853118896484 (2.011833429336548) | > loss_kl: 2.6817190647125244 (4.832131306330363) | > loss_feat: 5.053624153137207 (8.954400221506754) | > loss_mel: 20.676433563232422 (23.86269760131836) | > loss_duration: 3.0275468826293945 (3.2293001810709634) | > loss_1: 33.80841064453125 (42.89036305745443) --> EVAL PERFORMANCE | > avg_loader_time: 0.017714659372965496 (+0.003863016764322918) | > avg_loss_disc: 2.633855104446411 (-0.022945483525594224) | > avg_loss_disc_real_0: 0.12248916644603014 (-0.031315339418749005) | > avg_loss_disc_real_1: 0.18917348235845566 (-0.05064575125773749) | > avg_loss_disc_real_2: 0.2039845660328865 (-0.024470103283723205) | > avg_loss_disc_real_3: 0.2164376179377238 (-0.05405992269515994) | > avg_loss_disc_real_4: 0.24751139680544534 (-0.05064662297566733) | > avg_loss_disc_real_5: 0.2747221787770589 (-0.07777120669682824) | > avg_loss_0: 2.633855104446411 (-0.022945483525594224) | > avg_loss_gen: 2.011833429336548 (-0.11438175042470311) | > avg_loss_kl: 4.832131306330363 (-0.4124580224355059) | > avg_loss_feat: 8.954400221506754 (+2.6394431591033927) | > avg_loss_mel: 23.86269760131836 (+1.0141855875651054) | > avg_loss_duration: 3.2293001810709634 (+0.01577409108479788) | > avg_loss_1: 42.89036305745443 (+3.1425622304280623)  > EPOCH: 1208/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:23:15)   --> TIME: 2023-10-20 15:23:38 -- STEP: 29/50 -- GLOBAL_STEP: 113430 | > loss_disc: 2.8714089393615723 (2.3755799984109807) | > loss_disc_real_0: 0.20703794062137604 (0.12878163688784017) | > loss_disc_real_1: 0.25826120376586914 (0.23285597447177458) | > loss_disc_real_2: 0.22372005879878998 (0.2218055398171318) | > loss_disc_real_3: 0.2657652795314789 (0.2487677956192658) | > loss_disc_real_4: 0.25797566771507263 (0.2400848950612648) | > loss_disc_real_5: 0.26253077387809753 (0.210395970614627) | > loss_0: 2.8714089393615723 (2.3755799984109807) | > grad_norm_0: tensor(491.5837, device='cuda:0') (tensor(561.7222, device='cuda:0')) | > loss_gen: 1.6171857118606567 (2.437822185713668) | > loss_kl: 0.7755044102668762 (0.9321540100821133) | > loss_feat: 0.3523293435573578 (5.858461103819567) | > loss_mel: 11.536314010620117 (18.95552092996137) | > loss_duration: 1.3419350385665894 (1.3303503825746734) | > loss_1: 15.623268127441406 (29.51430869924611) | > grad_norm_1: tensor(23241.5156, device='cuda:0') (tensor(17702.7988, device='cuda:0')) | > current_lr_0: 5.9754342157034155e-05 | > current_lr_1: 5.9814130125018406e-05 | > step_time: 0.5798 (0.6311944106529499) | > loader_time: 0.026 (0.021706392025125438)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9008328914642334 (2.9008328914642334) | > loss_disc_real_0: 0.24240440130233765 (0.24240440130233765) | > loss_disc_real_1: 0.2547043263912201 (0.2547043263912201) | > loss_disc_real_2: 0.28080424666404724 (0.28080424666404724) | > loss_disc_real_3: 0.23650458455085754 (0.23650458455085754) | > loss_disc_real_4: 0.2759511470794678 (0.2759511470794678) | > loss_disc_real_5: 0.26752957701683044 (0.26752957701683044) | > loss_0: 2.9008328914642334 (2.9008328914642334) | > loss_gen: 1.6863771677017212 (1.6863771677017212) | > loss_kl: 6.640381813049316 (6.640381813049316) | > loss_feat: 0.2783427834510803 (0.2783427834510803) | > loss_mel: 12.401411056518555 (12.401411056518555) | > loss_duration: 3.0851752758026123 (3.0851752758026123) | > loss_1: 24.091686248779297 (24.091686248779297)  --> STEP: 1 | > loss_disc: 1.3091713190078735 (1.3091713190078735) | > loss_disc_real_0: 0.023486506193876266 (0.023486506193876266) | > loss_disc_real_1: 0.07828886061906815 (0.07828886061906815) | > loss_disc_real_2: 0.060653917491436005 (0.060653917491436005) | > loss_disc_real_3: 0.05779072269797325 (0.05779072269797325) | > loss_disc_real_4: 0.06793822348117828 (0.06793822348117828) | > loss_disc_real_5: 0.06071346998214722 (0.06071346998214722) | > loss_0: 1.3091713190078735 (1.3091713190078735) | > loss_gen: 2.4147040843963623 (2.4147040843963623) | > loss_kl: 5.972299098968506 (5.972299098968506) | > loss_feat: 14.224679946899414 (14.224679946899414) | > loss_mel: 25.2862548828125 (25.2862548828125) | > loss_duration: 3.4810988903045654 (3.4810988903045654) | > loss_1: 51.37903594970703 (51.37903594970703)  --> STEP: 2 | > loss_disc: 3.1262950897216797 (2.2177332043647766) | > loss_disc_real_0: 0.8742812871932983 (0.4488838966935873) | > loss_disc_real_1: 0.29357609152793884 (0.1859324760735035) | > loss_disc_real_2: 0.2554609477519989 (0.15805743262171745) | > loss_disc_real_3: 0.37182676792144775 (0.2148087453097105) | > loss_disc_real_4: 0.36828291416168213 (0.2181105688214302) | > loss_disc_real_5: 0.3590039908885956 (0.2098587304353714) | > loss_0: 3.1262950897216797 (2.2177332043647766) | > loss_gen: 3.3370490074157715 (2.875876545906067) | > loss_kl: 6.282227516174316 (6.127263307571411) | > loss_feat: 4.972626686096191 (9.598653316497803) | > loss_mel: 26.97406768798828 (26.13016128540039) | > loss_duration: 3.3187286853790283 (3.399913787841797) | > loss_1: 44.88469696044922 (48.131866455078125)  --> STEP: 3 | > loss_disc: 1.7651875019073486 (2.0668846368789673) | > loss_disc_real_0: 0.16719046235084534 (0.35498608524600667) | > loss_disc_real_1: 0.1510574221611023 (0.1743074581027031) | > loss_disc_real_2: 0.19540923833847046 (0.1705080345273018) | > loss_disc_real_3: 0.11429936438798904 (0.18130561833580336) | > loss_disc_real_4: 0.22034713625907898 (0.21885609130064645) | > loss_disc_real_5: 0.3409278988838196 (0.2535484532515208) | > loss_0: 1.7651875019073486 (2.0668846368789673) | > loss_gen: 3.607666492462158 (3.1198065280914307) | > loss_kl: 2.360372304916382 (4.871632973353068) | > loss_feat: 8.567873001098633 (9.255059878031412) | > loss_mel: 23.139760971069336 (25.13336118062337) | > loss_duration: 2.944488525390625 (3.2481053670247397) | > loss_1: 40.62016296386719 (45.62796529134115) --> EVAL PERFORMANCE | > avg_loader_time: 0.006741841634114583 (-0.010972817738850914) | > avg_loss_disc: 2.0668846368789673 (-0.5669704675674438) | > avg_loss_disc_real_0: 0.35498608524600667 (+0.23249691879997653) | > avg_loss_disc_real_1: 0.1743074581027031 (-0.014866024255752563) | > avg_loss_disc_real_2: 0.1705080345273018 (-0.03347653150558472) | > avg_loss_disc_real_3: 0.18130561833580336 (-0.03513199960192043) | > avg_loss_disc_real_4: 0.21885609130064645 (-0.02865530550479889) | > avg_loss_disc_real_5: 0.2535484532515208 (-0.02117372552553809) | > avg_loss_0: 2.0668846368789673 (-0.5669704675674438) | > avg_loss_gen: 3.1198065280914307 (+1.1079730987548828) | > avg_loss_kl: 4.871632973353068 (+0.03950166702270508) | > avg_loss_feat: 9.255059878031412 (+0.3006596565246582) | > avg_loss_mel: 25.13336118062337 (+1.2706635793050118) | > avg_loss_duration: 3.2481053670247397 (+0.018805185953776338) | > avg_loss_1: 45.62796529134115 (+2.7376022338867188)  > EPOCH: 1209/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:24:08)   --> TIME: 2023-10-20 15:24:18 -- STEP: 9/50 -- GLOBAL_STEP: 113460 | > loss_disc: 2.9580416679382324 (2.4504564735624523) | > loss_disc_real_0: 0.2905987799167633 (0.17697113338443968) | > loss_disc_real_1: 0.25298789143562317 (0.23528751068645054) | > loss_disc_real_2: 0.25178465247154236 (0.2617211333579487) | > loss_disc_real_3: 0.35422074794769287 (0.23219293190373314) | > loss_disc_real_4: 0.32365095615386963 (0.26049941447046066) | > loss_disc_real_5: 0.3835223317146301 (0.2537615986333953) | > loss_0: 2.9580416679382324 (2.4504564735624523) | > grad_norm_0: tensor(548.9024, device='cuda:0') (tensor(602.3134, device='cuda:0')) | > loss_gen: 2.0883688926696777 (2.4056723382737903) | > loss_kl: 0.7041550874710083 (0.6351507074303098) | > loss_feat: 2.4314990043640137 (5.1746838092803955) | > loss_mel: 21.45787811279297 (20.961842007107204) | > loss_duration: 1.331353783607483 (1.3147996928956773) | > loss_1: 28.013256072998047 (30.492148717244465) | > grad_norm_1: tensor(2441.5710, device='cuda:0') (tensor(10906.6738, device='cuda:0')) | > current_lr_0: 5.9694613950867184e-05 | > current_lr_1: 5.9754342157034155e-05 | > step_time: 0.3646 (0.5792006386650933) | > loader_time: 0.0154 (0.015137460496690538)  --> TIME: 2023-10-20 15:24:37 -- STEP: 39/50 -- GLOBAL_STEP: 113490 | > loss_disc: 1.3538517951965332 (2.452464751708202) | > loss_disc_real_0: 0.06327709555625916 (0.14549992200082693) | > loss_disc_real_1: 0.09173380583524704 (0.2263034985233576) | > loss_disc_real_2: 0.023593313992023468 (0.23089065230809724) | > loss_disc_real_3: 0.0724489614367485 (0.24075343956549963) | > loss_disc_real_4: 0.03119419701397419 (0.23186148832050654) | > loss_disc_real_5: 0.034577108919620514 (0.23496106434135866) | > loss_0: 1.3538517951965332 (2.452464751708202) | > grad_norm_0: tensor(603.4828, device='cuda:0') (tensor(670.2702, device='cuda:0')) | > loss_gen: 2.641248941421509 (2.310438883610261) | > loss_kl: 0.5432195663452148 (0.7597098468970029) | > loss_feat: 9.321319580078125 (5.309277183734453) | > loss_mel: 24.296091079711914 (19.865911801656086) | > loss_duration: 1.3571518659591675 (1.3245003467951066) | > loss_1: 38.15903091430664 (29.569837839175495) | > grad_norm_1: tensor(13264.6602, device='cuda:0') (tensor(17179.8711, device='cuda:0')) | > current_lr_0: 5.9694613950867184e-05 | > current_lr_1: 5.9754342157034155e-05 | > step_time: 0.3174 (0.6050367477612616) | > loader_time: 0.009 (0.020617448366605323)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.14375901222229 (2.14375901222229) | > loss_disc_real_0: 0.10780598223209381 (0.10780598223209381) | > loss_disc_real_1: 0.21959511935710907 (0.21959511935710907) | > loss_disc_real_2: 0.2043333351612091 (0.2043333351612091) | > loss_disc_real_3: 0.22883173823356628 (0.22883173823356628) | > loss_disc_real_4: 0.13465848565101624 (0.13465848565101624) | > loss_disc_real_5: 0.17065826058387756 (0.17065826058387756) | > loss_0: 2.14375901222229 (2.14375901222229) | > loss_gen: 2.5487256050109863 (2.5487256050109863) | > loss_kl: 6.576805591583252 (6.576805591583252) | > loss_feat: 9.416966438293457 (9.416966438293457) | > loss_mel: 23.02654457092285 (23.02654457092285) | > loss_duration: 3.21946120262146 (3.21946120262146) | > loss_1: 44.78850173950195 (44.78850173950195)  --> STEP: 1 | > loss_disc: 2.9417057037353516 (2.9417057037353516) | > loss_disc_real_0: 0.5067933201789856 (0.5067933201789856) | > loss_disc_real_1: 0.24439330399036407 (0.24439330399036407) | > loss_disc_real_2: 0.28338122367858887 (0.28338122367858887) | > loss_disc_real_3: 0.29787135124206543 (0.29787135124206543) | > loss_disc_real_4: 0.2765321135520935 (0.2765321135520935) | > loss_disc_real_5: 0.24551616609096527 (0.24551616609096527) | > loss_0: 2.9417057037353516 (2.9417057037353516) | > loss_gen: 2.1500325202941895 (2.1500325202941895) | > loss_kl: 6.303924560546875 (6.303924560546875) | > loss_feat: 2.5816431045532227 (2.5816431045532227) | > loss_mel: 20.676231384277344 (20.676231384277344) | > loss_duration: 3.538689613342285 (3.538689613342285) | > loss_1: 35.250518798828125 (35.250518798828125)  --> STEP: 2 | > loss_disc: 2.349031448364258 (2.6453685760498047) | > loss_disc_real_0: 0.21399259567260742 (0.3603929579257965) | > loss_disc_real_1: 0.12782980501651764 (0.18611155450344086) | > loss_disc_real_2: 0.1686815470457077 (0.22603138536214828) | > loss_disc_real_3: 0.0548684261739254 (0.17636988870799541) | > loss_disc_real_4: 0.23241904377937317 (0.25447557866573334) | > loss_disc_real_5: 0.15904121100902557 (0.20227868854999542) | > loss_0: 2.349031448364258 (2.6453685760498047) | > loss_gen: 2.3976404666900635 (2.2738364934921265) | > loss_kl: 5.866271018981934 (6.085097789764404) | > loss_feat: 12.590712547302246 (7.586177825927734) | > loss_mel: 24.38161277770996 (22.528922080993652) | > loss_duration: 3.2352404594421387 (3.386965036392212) | > loss_1: 48.47147750854492 (41.86099815368652)  --> STEP: 3 | > loss_disc: 3.054137706756592 (2.781624952952067) | > loss_disc_real_0: 0.1950673758983612 (0.30528443058331806) | > loss_disc_real_1: 0.3723069131374359 (0.24817667404810587) | > loss_disc_real_2: 0.4221703112125397 (0.29141102731227875) | > loss_disc_real_3: 0.3528953790664673 (0.23521171882748604) | > loss_disc_real_4: 0.3332979679107666 (0.28074970841407776) | > loss_disc_real_5: 0.21567323803901672 (0.2067435383796692) | > loss_0: 3.054137706756592 (2.781624952952067) | > loss_gen: 2.296597957611084 (2.281423648198446) | > loss_kl: 3.1478257179260254 (5.106007099151611) | > loss_feat: 4.490355491638184 (6.554237047831218) | > loss_mel: 21.009645462036133 (22.022496541341145) | > loss_duration: 3.0330569744110107 (3.268995682398478) | > loss_1: 33.977481842041016 (39.23315938313802) --> EVAL PERFORMANCE | > avg_loader_time: 0.008413553237915039 (+0.001671711603800456) | > avg_loss_disc: 2.781624952952067 (+0.7147403160730996) | > avg_loss_disc_real_0: 0.30528443058331806 (-0.04970165466268861) | > avg_loss_disc_real_1: 0.24817667404810587 (+0.07386921594540277) | > avg_loss_disc_real_2: 0.29141102731227875 (+0.12090299278497696) | > avg_loss_disc_real_3: 0.23521171882748604 (+0.05390610049168268) | > avg_loss_disc_real_4: 0.28074970841407776 (+0.061893617113431304) | > avg_loss_disc_real_5: 0.2067435383796692 (-0.04680491487185162) | > avg_loss_0: 2.781624952952067 (+0.7147403160730996) | > avg_loss_gen: 2.281423648198446 (-0.8383828798929849) | > avg_loss_kl: 5.106007099151611 (+0.234374125798543) | > avg_loss_feat: 6.554237047831218 (-2.7008228302001944) | > avg_loss_mel: 22.022496541341145 (-3.1108646392822266) | > avg_loss_duration: 3.268995682398478 (+0.02089031537373831) | > avg_loss_1: 39.23315938313802 (-6.394805908203125)  > EPOCH: 1210/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:24:59)   --> TIME: 2023-10-20 15:25:15 -- STEP: 19/50 -- GLOBAL_STEP: 113520 | > loss_disc: 2.8493852615356445 (2.6292426586151123) | > loss_disc_real_0: 0.2731635570526123 (0.1519757967540308) | > loss_disc_real_1: 0.42965999245643616 (0.233589527638335) | > loss_disc_real_2: 0.3331804573535919 (0.22210108371157394) | > loss_disc_real_3: 0.3943774104118347 (0.2337396287996518) | > loss_disc_real_4: 0.2972562313079834 (0.2407489783179603) | > loss_disc_real_5: 0.34538155794143677 (0.26228744735157017) | > loss_0: 2.8493852615356445 (2.6292426586151123) | > grad_norm_0: tensor(821.0838, device='cuda:0') (tensor(666.3134, device='cuda:0')) | > loss_gen: 2.7043349742889404 (2.1669122043408846) | > loss_kl: 1.1084518432617188 (0.8129712374586808) | > loss_feat: 3.826789140701294 (5.364303964141168) | > loss_mel: 22.71466064453125 (19.615803781308625) | > loss_duration: 1.447168231010437 (1.3535978731356169) | > loss_1: 31.80140495300293 (29.313588920392487) | > grad_norm_1: tensor(4812.4316, device='cuda:0') (tensor(20853.5273, device='cuda:0')) | > current_lr_0: 5.963494544678182e-05 | > current_lr_1: 5.9694613950867184e-05 | > step_time: 0.3134 (0.5966979704405132) | > loader_time: 0.0024 (0.022780041945608037)  --> TIME: 2023-10-20 15:25:27 -- STEP: 49/50 -- GLOBAL_STEP: 113550 | > loss_disc: 2.476198673248291 (2.5786054085712036) | > loss_disc_real_0: 0.027371086180210114 (0.1437465281852958) | > loss_disc_real_1: 0.15649805963039398 (0.22779262491634913) | > loss_disc_real_2: 0.05065695568919182 (0.22797909386608065) | > loss_disc_real_3: 0.24555586278438568 (0.24407589747285358) | > loss_disc_real_4: 0.22613537311553955 (0.2488411529445831) | > loss_disc_real_5: 0.22924436628818512 (0.27525787284521736) | > loss_0: 2.476198673248291 (2.5786054085712036) | > grad_norm_0: tensor(1794.4824, device='cuda:0') (tensor(1074.6154, device='cuda:0')) | > loss_gen: 1.7213648557662964 (2.1865317383591) | > loss_kl: 0.5879127383232117 (0.7894448704865514) | > loss_feat: 2.5693116188049316 (4.834180655071931) | > loss_mel: 19.412925720214844 (19.184045460759382) | > loss_duration: 1.4357506036758423 (1.3283957656548948) | > loss_1: 25.727266311645508 (28.32259853518739) | > grad_norm_1: tensor(9261.1396, device='cuda:0') (tensor(25000.8672, device='cuda:0')) | > current_lr_0: 5.963494544678182e-05 | > current_lr_1: 5.9694613950867184e-05 | > step_time: 0.2726 (0.4472475879046381) | > loader_time: 0.4127 (0.021658897399902344)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.714684009552002 (2.714684009552002) | > loss_disc_real_0: 0.31763583421707153 (0.31763583421707153) | > loss_disc_real_1: 0.23432590067386627 (0.23432590067386627) | > loss_disc_real_2: 0.2712240219116211 (0.2712240219116211) | > loss_disc_real_3: 0.22208648920059204 (0.22208648920059204) | > loss_disc_real_4: 0.17011770606040955 (0.17011770606040955) | > loss_disc_real_5: 0.23508065938949585 (0.23508065938949585) | > loss_0: 2.714684009552002 (2.714684009552002) | > loss_gen: 1.9135007858276367 (1.9135007858276367) | > loss_kl: 6.860881328582764 (6.860881328582764) | > loss_feat: 2.1763222217559814 (2.1763222217559814) | > loss_mel: 9.29979419708252 (9.29979419708252) | > loss_duration: 3.134442090988159 (3.134442090988159) | > loss_1: 23.38494110107422 (23.38494110107422)  --> STEP: 1 | > loss_disc: 2.5574376583099365 (2.5574376583099365) | > loss_disc_real_0: 0.17865628004074097 (0.17865628004074097) | > loss_disc_real_1: 0.23281647264957428 (0.23281647264957428) | > loss_disc_real_2: 0.25731849670410156 (0.25731849670410156) | > loss_disc_real_3: 0.25853410363197327 (0.25853410363197327) | > loss_disc_real_4: 0.22221168875694275 (0.22221168875694275) | > loss_disc_real_5: 0.23453129827976227 (0.23453129827976227) | > loss_0: 2.5574376583099365 (2.5574376583099365) | > loss_gen: 2.049250841140747 (2.049250841140747) | > loss_kl: 5.901151657104492 (5.901151657104492) | > loss_feat: 1.5495853424072266 (1.5495853424072266) | > loss_mel: 18.855052947998047 (18.855052947998047) | > loss_duration: 3.4880712032318115 (3.4880712032318115) | > loss_1: 31.84311294555664 (31.84311294555664)  --> STEP: 2 | > loss_disc: 3.0084307193756104 (2.7829341888427734) | > loss_disc_real_0: 0.3038320541381836 (0.24124416708946228) | > loss_disc_real_1: 0.2490839958190918 (0.24095023423433304) | > loss_disc_real_2: 0.27072572708129883 (0.2640221118927002) | > loss_disc_real_3: 0.24390845000743866 (0.25122127681970596) | > loss_disc_real_4: 0.21688741445541382 (0.21954955160617828) | > loss_disc_real_5: 0.22961875796318054 (0.2320750281214714) | > loss_0: 3.0084307193756104 (2.7829341888427734) | > loss_gen: 1.5139108896255493 (1.7815808653831482) | > loss_kl: 5.912779808044434 (5.906965732574463) | > loss_feat: 0.18940111994743347 (0.86949323117733) | > loss_mel: 5.309858798980713 (12.08245587348938) | > loss_duration: 3.2532331943511963 (3.370652198791504) | > loss_1: 16.179183959960938 (24.01114845275879)  --> STEP: 3 | > loss_disc: 3.1963987350463867 (2.920755704243978) | > loss_disc_real_0: 0.8502560257911682 (0.44424811999003094) | > loss_disc_real_1: 0.3093196451663971 (0.26374003787835437) | > loss_disc_real_2: 0.23508140444755554 (0.2543752094109853) | > loss_disc_real_3: 0.24606956541538239 (0.24950403968493143) | > loss_disc_real_4: 0.23911648988723755 (0.22607186436653137) | > loss_disc_real_5: 0.21731241047382355 (0.22715415557225546) | > loss_0: 3.1963987350463867 (2.920755704243978) | > loss_gen: 2.377117872238159 (1.9800932010014851) | > loss_kl: 3.0558791160583496 (4.956603527069092) | > loss_feat: 2.930354118347168 (1.5564468602339427) | > loss_mel: 19.340253829956055 (14.501721858978271) | > loss_duration: 3.014193534851074 (3.251832644144694) | > loss_1: 30.717796325683594 (26.246697743733723) --> EVAL PERFORMANCE | > avg_loader_time: 0.012759208679199219 (+0.00434565544128418) | > avg_loss_disc: 2.920755704243978 (+0.1391307512919111) | > avg_loss_disc_real_0: 0.44424811999003094 (+0.1389636894067129) | > avg_loss_disc_real_1: 0.26374003787835437 (+0.015563363830248506) | > avg_loss_disc_real_2: 0.2543752094109853 (-0.037035817901293455) | > avg_loss_disc_real_3: 0.24950403968493143 (+0.01429232085744539) | > avg_loss_disc_real_4: 0.22607186436653137 (-0.05467784404754639) | > avg_loss_disc_real_5: 0.22715415557225546 (+0.020410617192586272) | > avg_loss_0: 2.920755704243978 (+0.1391307512919111) | > avg_loss_gen: 1.9800932010014851 (-0.30133044719696067) | > avg_loss_kl: 4.956603527069092 (-0.14940357208251953) | > avg_loss_feat: 1.5564468602339427 (-4.997790187597275) | > avg_loss_mel: 14.501721858978271 (-7.520774682362873) | > avg_loss_duration: 3.251832644144694 (-0.01716303825378418) | > avg_loss_1: 26.246697743733723 (-12.9864616394043)  > EPOCH: 1211/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:25:44)   --> TIME: 2023-10-20 15:26:10 -- STEP: 29/50 -- GLOBAL_STEP: 113580 | > loss_disc: 2.9120750427246094 (2.345972722974317) | > loss_disc_real_0: 0.0869574099779129 (0.14689326922184434) | > loss_disc_real_1: 0.25880303978919983 (0.2153391119991911) | > loss_disc_real_2: 0.19959068298339844 (0.2214600406587124) | > loss_disc_real_3: 0.2559545636177063 (0.22624903853083478) | > loss_disc_real_4: 0.26061663031578064 (0.21115598358727736) | > loss_disc_real_5: 0.2483004778623581 (0.19799498198875065) | > loss_0: 2.9120750427246094 (2.345972722974317) | > grad_norm_0: tensor(4903.6621, device='cuda:0') (tensor(1355.8212, device='cuda:0')) | > loss_gen: 1.5237524509429932 (2.3039044593942575) | > loss_kl: 0.8434838652610779 (0.7675829694188875) | > loss_feat: 0.47293728590011597 (5.87914187743746) | > loss_mel: 13.920089721679688 (21.368743723836438) | > loss_duration: 1.3076419830322266 (1.3309075133553867) | > loss_1: 18.06790542602539 (31.6502806236004) | > grad_norm_1: tensor(21741.2031, device='cuda:0') (tensor(40468.7812, device='cuda:0')) | > current_lr_0: 5.95753365851021e-05 | > current_lr_1: 5.963494544678182e-05 | > step_time: 0.429 (0.6251966295571163) | > loader_time: 0.0249 (0.025321656259997136)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.695639133453369 (2.695639133453369) | > loss_disc_real_0: 0.26620981097221375 (0.26620981097221375) | > loss_disc_real_1: 0.2776893675327301 (0.2776893675327301) | > loss_disc_real_2: 0.3133232295513153 (0.3133232295513153) | > loss_disc_real_3: 0.33185476064682007 (0.33185476064682007) | > loss_disc_real_4: 0.20880506932735443 (0.20880506932735443) | > loss_disc_real_5: 0.3887641131877899 (0.3887641131877899) | > loss_0: 2.695639133453369 (2.695639133453369) | > loss_gen: 2.544168472290039 (2.544168472290039) | > loss_kl: 5.641032695770264 (5.641032695770264) | > loss_feat: 5.865548610687256 (5.865548610687256) | > loss_mel: 21.04066276550293 (21.04066276550293) | > loss_duration: 3.1109538078308105 (3.1109538078308105) | > loss_1: 38.202369689941406 (38.202369689941406)  --> STEP: 1 | > loss_disc: 2.5499777793884277 (2.5499777793884277) | > loss_disc_real_0: 0.16463547945022583 (0.16463547945022583) | > loss_disc_real_1: 0.35611823201179504 (0.35611823201179504) | > loss_disc_real_2: 0.2602906823158264 (0.2602906823158264) | > loss_disc_real_3: 0.2372414767742157 (0.2372414767742157) | > loss_disc_real_4: 0.28006434440612793 (0.28006434440612793) | > loss_disc_real_5: 0.1963340938091278 (0.1963340938091278) | > loss_0: 2.5499777793884277 (2.5499777793884277) | > loss_gen: 2.534301996231079 (2.534301996231079) | > loss_kl: 5.974742412567139 (5.974742412567139) | > loss_feat: 9.525632858276367 (9.525632858276367) | > loss_mel: 26.531681060791016 (26.531681060791016) | > loss_duration: 3.4177393913269043 (3.4177393913269043) | > loss_1: 47.984100341796875 (47.984100341796875)  --> STEP: 2 | > loss_disc: 2.55779767036438 (2.553887724876404) | > loss_disc_real_0: 0.3115255832672119 (0.23808053135871887) | > loss_disc_real_1: 0.29284587502479553 (0.3244820535182953) | > loss_disc_real_2: 0.2506001591682434 (0.2554454207420349) | > loss_disc_real_3: 0.3023281991481781 (0.2697848379611969) | > loss_disc_real_4: 0.31366193294525146 (0.2968631386756897) | > loss_disc_real_5: 0.27033910155296326 (0.23333659768104553) | > loss_0: 2.55779767036438 (2.553887724876404) | > loss_gen: 3.101673126220703 (2.817987561225891) | > loss_kl: 6.2842254638671875 (6.129483938217163) | > loss_feat: 8.51216983795166 (9.018901348114014) | > loss_mel: 24.506563186645508 (25.51912212371826) | > loss_duration: 3.2902374267578125 (3.3539884090423584) | > loss_1: 45.69486999511719 (46.83948516845703)  --> STEP: 3 | > loss_disc: 2.8099284172058105 (2.6392346223195395) | > loss_disc_real_0: 0.27312880754470825 (0.249763290087382) | > loss_disc_real_1: 0.4723271429538727 (0.3737637499968211) | > loss_disc_real_2: 0.1953338384628296 (0.23540822664896646) | > loss_disc_real_3: 0.239018514752388 (0.25952939689159393) | > loss_disc_real_4: 0.1214401125907898 (0.23838879664738974) | > loss_disc_real_5: 0.1884865164756775 (0.2183865706125895) | > loss_0: 2.8099284172058105 (2.6392346223195395) | > loss_gen: 2.0279550552368164 (2.554643392562866) | > loss_kl: 2.865692377090454 (5.041553417841594) | > loss_feat: 5.73809814453125 (7.925300280253093) | > loss_mel: 21.189056396484375 (24.075766881306965) | > loss_duration: 3.07448673248291 (3.2608211835225425) | > loss_1: 34.895286560058594 (42.85808563232422) --> EVAL PERFORMANCE | > avg_loader_time: 0.02163521448771159 (+0.008876005808512371) | > avg_loss_disc: 2.6392346223195395 (-0.2815210819244385) | > avg_loss_disc_real_0: 0.249763290087382 (-0.19448482990264895) | > avg_loss_disc_real_1: 0.3737637499968211 (+0.11002371211846673) | > avg_loss_disc_real_2: 0.23540822664896646 (-0.01896698276201883) | > avg_loss_disc_real_3: 0.25952939689159393 (+0.010025357206662505) | > avg_loss_disc_real_4: 0.23838879664738974 (+0.012316932280858367) | > avg_loss_disc_real_5: 0.2183865706125895 (-0.008767584959665953) | > avg_loss_0: 2.6392346223195395 (-0.2815210819244385) | > avg_loss_gen: 2.554643392562866 (+0.5745501915613811) | > avg_loss_kl: 5.041553417841594 (+0.08494989077250192) | > avg_loss_feat: 7.925300280253093 (+6.36885342001915) | > avg_loss_mel: 24.075766881306965 (+9.574045022328693) | > avg_loss_duration: 3.2608211835225425 (+0.008988539377848603) | > avg_loss_1: 42.85808563232422 (+16.611387888590496)  > EPOCH: 1212/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:26:38)   --> TIME: 2023-10-20 15:26:50 -- STEP: 9/50 -- GLOBAL_STEP: 113610 | > loss_disc: 2.552640676498413 (2.4623190297020807) | > loss_disc_real_0: 0.0852566808462143 (0.16164474230673578) | > loss_disc_real_1: 0.34787774085998535 (0.2386237254573239) | > loss_disc_real_2: 0.3995620906352997 (0.2304956234163708) | > loss_disc_real_3: 0.31649255752563477 (0.2533205780718062) | > loss_disc_real_4: 0.3464164733886719 (0.22524812734789318) | > loss_disc_real_5: 0.1925583928823471 (0.23918322515156534) | > loss_0: 2.552640676498413 (2.4623190297020807) | > grad_norm_0: tensor(696.4889, device='cuda:0') (tensor(1048.8530, device='cuda:0')) | > loss_gen: 2.611786365509033 (2.352904650900099) | > loss_kl: 0.9739713072776794 (0.8095505237579346) | > loss_feat: 5.164646148681641 (6.088560368865728) | > loss_mel: 23.638103485107422 (18.000451617770725) | > loss_duration: 1.3265451192855835 (1.3295024898317125) | > loss_1: 33.71505355834961 (28.58096906873915) | > grad_norm_1: tensor(4433.5293, device='cuda:0') (tensor(65365.5547, device='cuda:0')) | > current_lr_0: 5.95157873062117e-05 | > current_lr_1: 5.95753365851021e-05 | > step_time: 0.3311 (0.5555213557349311) | > loader_time: 0.0143 (0.016312387254503038)  --> TIME: 2023-10-20 15:27:02 -- STEP: 39/50 -- GLOBAL_STEP: 113640 | > loss_disc: 2.985546350479126 (2.5087127777246327) | > loss_disc_real_0: 0.4335411489009857 (0.1582028416868968) | > loss_disc_real_1: 0.2574089467525482 (0.23856084803358102) | > loss_disc_real_2: 0.26856839656829834 (0.22694743825839117) | > loss_disc_real_3: 0.2782202959060669 (0.24961648594874603) | > loss_disc_real_4: 0.29766950011253357 (0.22490780965353435) | > loss_disc_real_5: 0.29666396975517273 (0.23868268952728847) | > loss_0: 2.985546350479126 (2.5087127777246327) | > grad_norm_0: tensor(1522.4204, device='cuda:0') (tensor(843.8356, device='cuda:0')) | > loss_gen: 1.7916574478149414 (2.3027766912411423) | > loss_kl: 0.47145402431488037 (0.7770284941563239) | > loss_feat: 0.6693714261054993 (5.301968418252774) | > loss_mel: 13.803486824035645 (18.755847657338162) | > loss_duration: 1.3676702976226807 (1.3262801200915606) | > loss_1: 18.103639602661133 (28.46390109184461) | > grad_norm_1: tensor(7837.8696, device='cuda:0') (tensor(36920.1406, device='cuda:0')) | > current_lr_0: 5.95157873062117e-05 | > current_lr_1: 5.95753365851021e-05 | > step_time: 0.3476 (0.4421382133777325) | > loader_time: 0.0023 (0.009424001742631959)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7101008892059326 (2.7101008892059326) | > loss_disc_real_0: 0.10775506496429443 (0.10775506496429443) | > loss_disc_real_1: 0.20979826152324677 (0.20979826152324677) | > loss_disc_real_2: 0.2597155272960663 (0.2597155272960663) | > loss_disc_real_3: 0.25221800804138184 (0.25221800804138184) | > loss_disc_real_4: 0.2702414095401764 (0.2702414095401764) | > loss_disc_real_5: 0.30382442474365234 (0.30382442474365234) | > loss_0: 2.7101008892059326 (2.7101008892059326) | > loss_gen: 1.9382209777832031 (1.9382209777832031) | > loss_kl: 5.847503662109375 (5.847503662109375) | > loss_feat: 2.1845860481262207 (2.1845860481262207) | > loss_mel: 21.1168270111084 (21.1168270111084) | > loss_duration: 3.1566476821899414 (3.1566476821899414) | > loss_1: 34.2437858581543 (34.2437858581543)  --> STEP: 1 | > loss_disc: 2.853489398956299 (2.853489398956299) | > loss_disc_real_0: 0.14680765569210052 (0.14680765569210052) | > loss_disc_real_1: 0.22365304827690125 (0.22365304827690125) | > loss_disc_real_2: 0.1877521574497223 (0.1877521574497223) | > loss_disc_real_3: 0.20678061246871948 (0.20678061246871948) | > loss_disc_real_4: 0.27911853790283203 (0.27911853790283203) | > loss_disc_real_5: 0.25808385014533997 (0.25808385014533997) | > loss_0: 2.853489398956299 (2.853489398956299) | > loss_gen: 1.49859619140625 (1.49859619140625) | > loss_kl: 5.784759044647217 (5.784759044647217) | > loss_feat: 0.8770362734794617 (0.8770362734794617) | > loss_mel: 15.552424430847168 (15.552424430847168) | > loss_duration: 3.4167423248291016 (3.4167423248291016) | > loss_1: 27.129558563232422 (27.129558563232422)  --> STEP: 2 | > loss_disc: 2.053173065185547 (2.453331232070923) | > loss_disc_real_0: 0.3088524341583252 (0.22783004492521286) | > loss_disc_real_1: 0.10024774819612503 (0.16195039823651314) | > loss_disc_real_2: 0.17531195282936096 (0.18153205513954163) | > loss_disc_real_3: 0.09618271142244339 (0.15148166194558144) | > loss_disc_real_4: 0.13363522291183472 (0.20637688040733337) | > loss_disc_real_5: 0.13075414299964905 (0.1944189965724945) | > loss_0: 2.053173065185547 (2.453331232070923) | > loss_gen: 2.9889984130859375 (2.2437973022460938) | > loss_kl: 5.863620758056641 (5.824189901351929) | > loss_feat: 9.854917526245117 (5.365976899862289) | > loss_mel: 27.15067481994629 (21.35154962539673) | > loss_duration: 3.2815847396850586 (3.34916353225708) | > loss_1: 49.13979721069336 (38.13467788696289)  --> STEP: 3 | > loss_disc: 2.9663643836975098 (2.6243422826131186) | > loss_disc_real_0: 0.10696564614772797 (0.18754191199938455) | > loss_disc_real_1: 0.3757669925689697 (0.233222596347332) | > loss_disc_real_2: 0.30755317211151123 (0.22353909413019815) | > loss_disc_real_3: 0.4400342106819153 (0.24766584485769272) | > loss_disc_real_4: 0.4415058195590973 (0.2847531934579213) | > loss_disc_real_5: 0.31094643473625183 (0.2332614759604136) | > loss_0: 2.9663643836975098 (2.6243422826131186) | > loss_gen: 2.3462061882019043 (2.2779335975646973) | > loss_kl: 2.7865958213806152 (4.811658541361491) | > loss_feat: 5.003509998321533 (5.245154599348704) | > loss_mel: 23.42584228515625 (22.042980511983234) | > loss_duration: 3.0491487979888916 (3.2491586208343506) | > loss_1: 36.61130142211914 (37.626885732014976) --> EVAL PERFORMANCE | > avg_loader_time: 0.007877429326375326 (-0.013757785161336264) | > avg_loss_disc: 2.6243422826131186 (-0.014892339706420898) | > avg_loss_disc_real_0: 0.18754191199938455 (-0.062221378087997437) | > avg_loss_disc_real_1: 0.233222596347332 (-0.1405411536494891) | > avg_loss_disc_real_2: 0.22353909413019815 (-0.01186913251876831) | > avg_loss_disc_real_3: 0.24766584485769272 (-0.011863552033901215) | > avg_loss_disc_real_4: 0.2847531934579213 (+0.04636439681053159) | > avg_loss_disc_real_5: 0.2332614759604136 (+0.014874905347824097) | > avg_loss_0: 2.6243422826131186 (-0.014892339706420898) | > avg_loss_gen: 2.2779335975646973 (-0.27670979499816895) | > avg_loss_kl: 4.811658541361491 (-0.22989487648010254) | > avg_loss_feat: 5.245154599348704 (-2.6801456809043884) | > avg_loss_mel: 22.042980511983234 (-2.0327863693237305) | > avg_loss_duration: 3.2491586208343506 (-0.01166256268819188) | > avg_loss_1: 37.626885732014976 (-5.231199900309242)  > EPOCH: 1213/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:27:30)   --> TIME: 2023-10-20 15:27:47 -- STEP: 19/50 -- GLOBAL_STEP: 113670 | > loss_disc: 2.7986741065979004 (2.6198654425771615) | > loss_disc_real_0: 0.33364441990852356 (0.18200888621963954) | > loss_disc_real_1: 0.20664726197719574 (0.24042378836556486) | > loss_disc_real_2: 0.28546634316444397 (0.2368850962896096) | > loss_disc_real_3: 0.3074325621128082 (0.2556559090551577) | > loss_disc_real_4: 0.2179507315158844 (0.262283584789226) | > loss_disc_real_5: 0.26939404010772705 (0.2526770436057919) | > loss_0: 2.7986741065979004 (2.6198654425771615) | > grad_norm_0: tensor(806.1297, device='cuda:0') (tensor(685.6702, device='cuda:0')) | > loss_gen: 2.196598768234253 (2.2040255948116902) | > loss_kl: 0.8306223154067993 (0.8410364044340033) | > loss_feat: 3.0229506492614746 (4.6017923055118635) | > loss_mel: 21.23889923095703 (18.128879239684657) | > loss_duration: 1.3680734634399414 (1.3434414298910844) | > loss_1: 28.657142639160156 (27.119174831791927) | > grad_norm_1: tensor(2777.9480, device='cuda:0') (tensor(25683.7383, device='cuda:0')) | > current_lr_0: 5.94562975505539e-05 | > current_lr_1: 5.95157873062117e-05 | > step_time: 0.3271 (0.5555510269968134) | > loader_time: 0.0097 (0.022417106126484117)  --> TIME: 2023-10-20 15:28:07 -- STEP: 49/50 -- GLOBAL_STEP: 113700 | > loss_disc: 2.9073572158813477 (2.661809030844241) | > loss_disc_real_0: 0.2629333734512329 (0.17799930579067036) | > loss_disc_real_1: 0.2432156801223755 (0.24225016500876875) | > loss_disc_real_2: 0.3149377405643463 (0.24228418496798496) | > loss_disc_real_3: 0.26170238852500916 (0.24998688500146476) | > loss_disc_real_4: 0.24953052401542664 (0.2528962226850646) | > loss_disc_real_5: 0.26973068714141846 (0.24636587614611705) | > loss_0: 2.9073572158813477 (2.661809030844241) | > grad_norm_0: tensor(974.5638, device='cuda:0') (tensor(772.8712, device='cuda:0')) | > loss_gen: 1.7848598957061768 (2.0587519431600754) | > loss_kl: 0.17845219373703003 (0.7484660010252681) | > loss_feat: 0.4418966472148895 (3.9150760928739077) | > loss_mel: 14.097249031066895 (16.625227020711314) | > loss_duration: 1.4478473663330078 (1.3235111869111351) | > loss_1: 17.950305938720703 (24.671032117337603) | > grad_norm_1: tensor(4270.2681, device='cuda:0') (tensor(18926.2324, device='cuda:0')) | > current_lr_0: 5.94562975505539e-05 | > current_lr_1: 5.95157873062117e-05 | > step_time: 0.4662 (0.5946047889943024) | > loader_time: 0.6531 (0.03551763417769452)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.977360725402832 (2.977360725402832) | > loss_disc_real_0: 0.2884838581085205 (0.2884838581085205) | > loss_disc_real_1: 0.2428435981273651 (0.2428435981273651) | > loss_disc_real_2: 0.2816443145275116 (0.2816443145275116) | > loss_disc_real_3: 0.2572726309299469 (0.2572726309299469) | > loss_disc_real_4: 0.25262966752052307 (0.25262966752052307) | > loss_disc_real_5: 0.28055527806282043 (0.28055527806282043) | > loss_0: 2.977360725402832 (2.977360725402832) | > loss_gen: 1.6400222778320312 (1.6400222778320312) | > loss_kl: 5.7167558670043945 (5.7167558670043945) | > loss_feat: 0.07650887966156006 (0.07650887966156006) | > loss_mel: 1.2269840240478516 (1.2269840240478516) | > loss_duration: 3.080817461013794 (3.080817461013794) | > loss_1: 11.741087913513184 (11.741087913513184)  --> STEP: 1 | > loss_disc: 3.132408618927002 (3.132408618927002) | > loss_disc_real_0: 0.4801027178764343 (0.4801027178764343) | > loss_disc_real_1: 0.27579599618911743 (0.27579599618911743) | > loss_disc_real_2: 0.37380480766296387 (0.37380480766296387) | > loss_disc_real_3: 0.3320279121398926 (0.3320279121398926) | > loss_disc_real_4: 0.3307657241821289 (0.3307657241821289) | > loss_disc_real_5: 0.329955130815506 (0.329955130815506) | > loss_0: 3.132408618927002 (3.132408618927002) | > loss_gen: 2.5210306644439697 (2.5210306644439697) | > loss_kl: 5.582345008850098 (5.582345008850098) | > loss_feat: 2.4057071208953857 (2.4057071208953857) | > loss_mel: 20.352148056030273 (20.352148056030273) | > loss_duration: 3.506695508956909 (3.506695508956909) | > loss_1: 34.36792755126953 (34.36792755126953)  --> STEP: 2 | > loss_disc: 2.9755196571350098 (3.053964138031006) | > loss_disc_real_0: 0.2865612506866455 (0.3833319842815399) | > loss_disc_real_1: 0.24285511672496796 (0.2593255564570427) | > loss_disc_real_2: 0.28202351927757263 (0.32791416347026825) | > loss_disc_real_3: 0.25731968879699707 (0.2946738004684448) | > loss_disc_real_4: 0.25261610746383667 (0.2916909158229828) | > loss_disc_real_5: 0.2806142568588257 (0.30528469383716583) | > loss_0: 2.9755196571350098 (3.053964138031006) | > loss_gen: 1.6405422687530518 (2.0807864665985107) | > loss_kl: 6.128313064575195 (5.8553290367126465) | > loss_feat: 0.08114343881607056 (1.2434252798557281) | > loss_mel: 2.7258434295654297 (11.538995742797852) | > loss_duration: 3.4007859230041504 (3.45374071598053) | > loss_1: 13.976627349853516 (24.172277450561523)  --> STEP: 3 | > loss_disc: 2.976147174835205 (3.0280251502990723) | > loss_disc_real_0: 0.2876580059528351 (0.3514406581719716) | > loss_disc_real_1: 0.24284401535987854 (0.25383170942465466) | > loss_disc_real_2: 0.28209584951400757 (0.3126413921515147) | > loss_disc_real_3: 0.25725504755973816 (0.2822008828322093) | > loss_disc_real_4: 0.25260794162750244 (0.2786632577578227) | > loss_disc_real_5: 0.28055474162101746 (0.297041376431783) | > loss_0: 2.976147174835205 (3.0280251502990723) | > loss_gen: 1.6410350799560547 (1.9342026710510254) | > loss_kl: 2.6857564449310303 (4.7988048394521075) | > loss_feat: 0.07936186343431473 (0.8554041410485903) | > loss_mel: 1.9555487632751465 (8.344513416290283) | > loss_duration: 3.086398124694824 (3.3312931855519614) | > loss_1: 9.448100090026855 (19.2642183303833) --> EVAL PERFORMANCE | > avg_loader_time: 0.009784936904907227 (+0.0019075075785319005) | > avg_loss_disc: 3.0280251502990723 (+0.40368286768595363) | > avg_loss_disc_real_0: 0.3514406581719716 (+0.16389874617258707) | > avg_loss_disc_real_1: 0.25383170942465466 (+0.02060911307732266) | > avg_loss_disc_real_2: 0.3126413921515147 (+0.08910229802131656) | > avg_loss_disc_real_3: 0.2822008828322093 (+0.03453503797451657) | > avg_loss_disc_real_4: 0.2786632577578227 (-0.0060899357000986365) | > avg_loss_disc_real_5: 0.297041376431783 (+0.06377990047136942) | > avg_loss_0: 3.0280251502990723 (+0.40368286768595363) | > avg_loss_gen: 1.9342026710510254 (-0.3437309265136719) | > avg_loss_kl: 4.7988048394521075 (-0.01285370190938373) | > avg_loss_feat: 0.8554041410485903 (-4.389750458300114) | > avg_loss_mel: 8.344513416290283 (-13.698467095692951) | > avg_loss_duration: 3.3312931855519614 (+0.08213456471761083) | > avg_loss_1: 19.2642183303833 (-18.362667401631676)  > EPOCH: 1214/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:28:25)   --> TIME: 2023-10-20 15:28:43 -- STEP: 29/50 -- GLOBAL_STEP: 113730 | > loss_disc: 2.325789213180542 (2.5777735956783956) | > loss_disc_real_0: 0.1680152416229248 (0.15590852672426864) | > loss_disc_real_1: 0.20609678328037262 (0.22714440241969866) | > loss_disc_real_2: 0.10163804143667221 (0.2237890286949174) | > loss_disc_real_3: 0.3128691613674164 (0.2611684557692759) | > loss_disc_real_4: 0.3180529773235321 (0.22988527615008683) | > loss_disc_real_5: 0.29364973306655884 (0.25686936401601496) | > loss_0: 2.325789213180542 (2.5777735956783956) | > grad_norm_0: tensor(330.1012, device='cuda:0') (tensor(787.5942, device='cuda:0')) | > loss_gen: 2.586883544921875 (2.2773204014219077) | > loss_kl: 0.8682666420936584 (0.8144855437607601) | > loss_feat: 6.391775608062744 (5.179667347319554) | > loss_mel: 21.286378860473633 (20.323341599826154) | > loss_duration: 1.2986421585083008 (1.3252899071265911) | > loss_1: 32.43194580078125 (29.92010501335407) | > grad_norm_1: tensor(5630.4678, device='cuda:0') (tensor(18912.2637, device='cuda:0')) | > current_lr_0: 5.939686725863148e-05 | > current_lr_1: 5.94562975505539e-05 | > step_time: 0.3215 (0.4271294330728465) | > loader_time: 0.0044 (0.01102455731095939)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.001302719116211 (3.001302719116211) | > loss_disc_real_0: 0.3682003617286682 (0.3682003617286682) | > loss_disc_real_1: 0.2695126235485077 (0.2695126235485077) | > loss_disc_real_2: 0.26684656739234924 (0.26684656739234924) | > loss_disc_real_3: 0.28922122716903687 (0.28922122716903687) | > loss_disc_real_4: 0.28174930810928345 (0.28174930810928345) | > loss_disc_real_5: 0.2979164123535156 (0.2979164123535156) | > loss_0: 3.001302719116211 (3.001302719116211) | > loss_gen: 1.850135326385498 (1.850135326385498) | > loss_kl: 5.167660236358643 (5.167660236358643) | > loss_feat: 0.19950680434703827 (0.19950680434703827) | > loss_mel: 7.7895426750183105 (7.7895426750183105) | > loss_duration: 2.987067461013794 (2.987067461013794) | > loss_1: 17.993913650512695 (17.993913650512695)  --> STEP: 1 | > loss_disc: 2.960193157196045 (2.960193157196045) | > loss_disc_real_0: 0.4255181550979614 (0.4255181550979614) | > loss_disc_real_1: 0.23032516241073608 (0.23032516241073608) | > loss_disc_real_2: 0.3359050154685974 (0.3359050154685974) | > loss_disc_real_3: 0.27339962124824524 (0.27339962124824524) | > loss_disc_real_4: 0.273600697517395 (0.273600697517395) | > loss_disc_real_5: 0.2959810197353363 (0.2959810197353363) | > loss_0: 2.960193157196045 (2.960193157196045) | > loss_gen: 2.0615828037261963 (2.0615828037261963) | > loss_kl: 5.561224937438965 (5.561224937438965) | > loss_feat: 1.8059335947036743 (1.8059335947036743) | > loss_mel: 19.03304100036621 (19.03304100036621) | > loss_duration: 3.5004258155822754 (3.5004258155822754) | > loss_1: 31.962207794189453 (31.962207794189453)  --> STEP: 2 | > loss_disc: 3.001406192779541 (2.980799674987793) | > loss_disc_real_0: 0.2711750268936157 (0.3483465909957886) | > loss_disc_real_1: 0.2508150041103363 (0.2405700832605362) | > loss_disc_real_2: 0.07096776366233826 (0.20343638956546783) | > loss_disc_real_3: 0.20739354193210602 (0.24039658159017563) | > loss_disc_real_4: 0.3004459738731384 (0.2870233356952667) | > loss_disc_real_5: 0.3176366090774536 (0.30680881440639496) | > loss_0: 3.001406192779541 (2.980799674987793) | > loss_gen: 1.914754867553711 (1.9881688356399536) | > loss_kl: 5.509093284606934 (5.535159111022949) | > loss_feat: 7.155914306640625 (4.48092395067215) | > loss_mel: 24.76237678527832 (21.897708892822266) | > loss_duration: 3.1203014850616455 (3.3103636503219604) | > loss_1: 42.462440490722656 (37.212324142456055)  --> STEP: 3 | > loss_disc: 2.8705668449401855 (2.9440553983052573) | > loss_disc_real_0: 0.3013905882835388 (0.3326945900917053) | > loss_disc_real_1: 0.253813236951828 (0.24498446782430014) | > loss_disc_real_2: 0.22752214968204498 (0.21146497627099356) | > loss_disc_real_3: 0.28555819392204285 (0.2554504523674647) | > loss_disc_real_4: 0.2733142673969269 (0.28245364626248676) | > loss_disc_real_5: 0.32495927810668945 (0.3128589689731598) | > loss_0: 2.8705668449401855 (2.9440553983052573) | > loss_gen: 1.8849236965179443 (1.9537537892659504) | > loss_kl: 2.6849050521850586 (4.585074424743652) | > loss_feat: 0.9454770088195801 (3.302441636721293) | > loss_mel: 15.384173393249512 (19.72653039296468) | > loss_duration: 3.008277654647827 (3.2096683184305825) | > loss_1: 23.907756805419922 (32.77746836344401) --> EVAL PERFORMANCE | > avg_loader_time: 0.003290891647338867 (-0.006494045257568359) | > avg_loss_disc: 2.9440553983052573 (-0.08396975199381496) | > avg_loss_disc_real_0: 0.3326945900917053 (-0.018746068080266298) | > avg_loss_disc_real_1: 0.24498446782430014 (-0.008847241600354522) | > avg_loss_disc_real_2: 0.21146497627099356 (-0.10117641588052115) | > avg_loss_disc_real_3: 0.2554504523674647 (-0.026750430464744568) | > avg_loss_disc_real_4: 0.28245364626248676 (+0.003790388504664066) | > avg_loss_disc_real_5: 0.3128589689731598 (+0.015817592541376768) | > avg_loss_0: 2.9440553983052573 (-0.08396975199381496) | > avg_loss_gen: 1.9537537892659504 (+0.019551118214925056) | > avg_loss_kl: 4.585074424743652 (-0.2137304147084551) | > avg_loss_feat: 3.302441636721293 (+2.447037495672703) | > avg_loss_mel: 19.72653039296468 (+11.382016976674397) | > avg_loss_duration: 3.2096683184305825 (-0.12162486712137888) | > avg_loss_1: 32.77746836344401 (+13.513250033060707)  > EPOCH: 1215/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:29:10)   --> TIME: 2023-10-20 15:29:21 -- STEP: 9/50 -- GLOBAL_STEP: 113760 | > loss_disc: 2.888688087463379 (2.325996160507202) | > loss_disc_real_0: 0.25375813245773315 (0.15530880209472445) | > loss_disc_real_1: 0.2644211947917938 (0.20040095100800195) | > loss_disc_real_2: 0.2548566162586212 (0.20165198855102062) | > loss_disc_real_3: 0.3028077483177185 (0.26422730626331437) | > loss_disc_real_4: 0.3007442057132721 (0.1779639364944564) | > loss_disc_real_5: 0.28524112701416016 (0.16491511588295302) | > loss_0: 2.888688087463379 (2.325996160507202) | > grad_norm_0: tensor(641.5840, device='cuda:0') (tensor(456.8178, device='cuda:0')) | > loss_gen: 1.777091145515442 (2.3423922989103527) | > loss_kl: 0.7100337743759155 (0.7137400673495399) | > loss_feat: 0.4287433326244354 (6.665164053440094) | > loss_mel: 17.117076873779297 (19.16312559445699) | > loss_duration: 1.2781922817230225 (1.3095249467425876) | > loss_1: 21.311138153076172 (30.193947580125595) | > grad_norm_1: tensor(9459.9062, device='cuda:0') (tensor(24942.3066, device='cuda:0')) | > current_lr_0: 5.933749637100674e-05 | > current_lr_1: 5.939686725863148e-05 | > step_time: 0.8375 (0.6216673586103652) | > loader_time: 0.0136 (0.024785730573866103)  --> TIME: 2023-10-20 15:29:42 -- STEP: 39/50 -- GLOBAL_STEP: 113790 | > loss_disc: 2.448988199234009 (2.3001006918075757) | > loss_disc_real_0: 0.14431710541248322 (0.1374556415785964) | > loss_disc_real_1: 0.19609208405017853 (0.21740347283104292) | > loss_disc_real_2: 0.2472345381975174 (0.2063180160923646) | > loss_disc_real_3: 0.23603351414203644 (0.22869029825027937) | > loss_disc_real_4: 0.20125038921833038 (0.20776448007195425) | > loss_disc_real_5: 0.20338095724582672 (0.19820998136240703) | > loss_0: 2.448988199234009 (2.3001006918075757) | > grad_norm_0: tensor(398.6764, device='cuda:0') (tensor(505.6061, device='cuda:0')) | > loss_gen: 2.0029854774475098 (2.4376231798758874) | > loss_kl: 0.4533100724220276 (0.7545874867683802) | > loss_feat: 3.441039800643921 (6.738530448996103) | > loss_mel: 12.021380424499512 (20.94272579290928) | > loss_duration: 1.379516363143921 (1.3192392740494165) | > loss_1: 19.298233032226562 (32.1927060714135) | > grad_norm_1: tensor(56805.0508, device='cuda:0') (tensor(20759.2227, device='cuda:0')) | > current_lr_0: 5.933749637100674e-05 | > current_lr_1: 5.939686725863148e-05 | > step_time: 0.4377 (0.6446457642775315) | > loader_time: 0.0024 (0.02530064949622521)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0847132205963135 (2.0847132205963135) | > loss_disc_real_0: 0.10392807424068451 (0.10392807424068451) | > loss_disc_real_1: 0.28378036618232727 (0.28378036618232727) | > loss_disc_real_2: 0.16736681759357452 (0.16736681759357452) | > loss_disc_real_3: 0.15054556727409363 (0.15054556727409363) | > loss_disc_real_4: 0.13897496461868286 (0.13897496461868286) | > loss_disc_real_5: 0.047395382076501846 (0.047395382076501846) | > loss_0: 2.0847132205963135 (2.0847132205963135) | > loss_gen: 2.1698155403137207 (2.1698155403137207) | > loss_kl: 6.451329708099365 (6.451329708099365) | > loss_feat: 6.719714164733887 (6.719714164733887) | > loss_mel: 18.043943405151367 (18.043943405151367) | > loss_duration: 3.0497488975524902 (3.0497488975524902) | > loss_1: 36.43455123901367 (36.43455123901367)  --> STEP: 1 | > loss_disc: 3.1370458602905273 (3.1370458602905273) | > loss_disc_real_0: 0.4639396071434021 (0.4639396071434021) | > loss_disc_real_1: 0.25490111112594604 (0.25490111112594604) | > loss_disc_real_2: 0.2316901683807373 (0.2316901683807373) | > loss_disc_real_3: 0.2951522171497345 (0.2951522171497345) | > loss_disc_real_4: 0.49601542949676514 (0.49601542949676514) | > loss_disc_real_5: 0.5237751007080078 (0.5237751007080078) | > loss_0: 3.1370458602905273 (3.1370458602905273) | > loss_gen: 2.7436342239379883 (2.7436342239379883) | > loss_kl: 5.7538018226623535 (5.7538018226623535) | > loss_feat: 6.93276834487915 (6.93276834487915) | > loss_mel: 22.524532318115234 (22.524532318115234) | > loss_duration: 3.4988298416137695 (3.4988298416137695) | > loss_1: 41.45356369018555 (41.45356369018555)  --> STEP: 2 | > loss_disc: 2.996255874633789 (3.066650867462158) | > loss_disc_real_0: 0.41199159622192383 (0.43796560168266296) | > loss_disc_real_1: 0.09510882198810577 (0.1750049665570259) | > loss_disc_real_2: 0.21541716158390045 (0.22355366498231888) | > loss_disc_real_3: 0.21982929110527039 (0.25749075412750244) | > loss_disc_real_4: 0.4215802550315857 (0.4587978422641754) | > loss_disc_real_5: 0.4748184382915497 (0.49929676949977875) | > loss_0: 2.996255874633789 (3.066650867462158) | > loss_gen: 2.4033915996551514 (2.57351291179657) | > loss_kl: 6.049910545349121 (5.901856184005737) | > loss_feat: 6.686999797821045 (6.809884071350098) | > loss_mel: 22.881587982177734 (22.703060150146484) | > loss_duration: 3.152405261993408 (3.325617551803589) | > loss_1: 41.17429733276367 (41.31393051147461)  --> STEP: 3 | > loss_disc: 3.4671521186828613 (3.200151284535726) | > loss_disc_real_0: 0.47278904914855957 (0.4495734175046285) | > loss_disc_real_1: 0.4653429388999939 (0.27178429067134857) | > loss_disc_real_2: 0.42454686760902405 (0.2905513991912206) | > loss_disc_real_3: 0.3443538546562195 (0.28644512097040814) | > loss_disc_real_4: 0.4224705696105957 (0.44668875137964886) | > loss_disc_real_5: 0.5816580653190613 (0.5267505347728729) | > loss_0: 3.4671521186828613 (3.200151284535726) | > loss_gen: 2.834609031677246 (2.6605449517567954) | > loss_kl: 2.4100234508514404 (4.737911939620972) | > loss_feat: 3.8745386600494385 (5.831435600916545) | > loss_mel: 24.32748794555664 (23.24453608194987) | > loss_duration: 3.1709697246551514 (3.274068276087443) | > loss_1: 36.61763000488281 (39.748497009277344) --> EVAL PERFORMANCE | > avg_loader_time: 0.008786360422770182 (+0.0054954687754313145) | > avg_loss_disc: 3.200151284535726 (+0.25609588623046875) | > avg_loss_disc_real_0: 0.4495734175046285 (+0.11687882741292316) | > avg_loss_disc_real_1: 0.27178429067134857 (+0.026799822847048432) | > avg_loss_disc_real_2: 0.2905513991912206 (+0.07908642292022702) | > avg_loss_disc_real_3: 0.28644512097040814 (+0.03099466860294342) | > avg_loss_disc_real_4: 0.44668875137964886 (+0.1642351051171621) | > avg_loss_disc_real_5: 0.5267505347728729 (+0.21389156579971313) | > avg_loss_0: 3.200151284535726 (+0.25609588623046875) | > avg_loss_gen: 2.6605449517567954 (+0.706791162490845) | > avg_loss_kl: 4.737911939620972 (+0.15283751487731934) | > avg_loss_feat: 5.831435600916545 (+2.528993964195252) | > avg_loss_mel: 23.24453608194987 (+3.518005688985191) | > avg_loss_duration: 3.274068276087443 (+0.06439995765686035) | > avg_loss_1: 39.748497009277344 (+6.971028645833336)  > EPOCH: 1216/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:30:02)   --> TIME: 2023-10-20 15:30:21 -- STEP: 19/50 -- GLOBAL_STEP: 113820 | > loss_disc: 2.5931615829467773 (2.4739897125645687) | > loss_disc_real_0: 0.03363332524895668 (0.11731175303851303) | > loss_disc_real_1: 0.16160722076892853 (0.2161223798205978) | > loss_disc_real_2: 0.19858330488204956 (0.21293780207633972) | > loss_disc_real_3: 0.3048732280731201 (0.22812755582363983) | > loss_disc_real_4: 0.26344338059425354 (0.233752022350305) | > loss_disc_real_5: 0.30540528893470764 (0.22781075836208306) | > loss_0: 2.5931615829467773 (2.4739897125645687) | > grad_norm_0: tensor(570.2252, device='cuda:0') (tensor(584.3393, device='cuda:0')) | > loss_gen: 2.0089075565338135 (2.2213143047533537) | > loss_kl: 0.6488277316093445 (0.7868537134245822) | > loss_feat: 3.0587446689605713 (5.516633997230153) | > loss_mel: 23.50958824157715 (19.572279628954437) | > loss_duration: 1.4224213361740112 (1.3658085747769004) | > loss_1: 30.648488998413086 (29.46288972151907) | > grad_norm_1: tensor(3775.7949, device='cuda:0') (tensor(17881.4766, device='cuda:0')) | > current_lr_0: 5.9278184828301356e-05 | > current_lr_1: 5.933749637100674e-05 | > step_time: 0.663 (0.589058374103747) | > loader_time: 0.024 (0.018791474794086657)  --> TIME: 2023-10-20 15:30:38 -- STEP: 49/50 -- GLOBAL_STEP: 113850 | > loss_disc: 2.6485788822174072 (2.4959657070588097) | > loss_disc_real_0: 0.05166568607091904 (0.13851175080908798) | > loss_disc_real_1: 0.3044014275074005 (0.22245878923912438) | > loss_disc_real_2: 0.17798128724098206 (0.21480925244336224) | > loss_disc_real_3: 0.18680958449840546 (0.23348953886603824) | > loss_disc_real_4: 0.28746795654296875 (0.2436611684685459) | > loss_disc_real_5: 0.4625954329967499 (0.2637940101819683) | > loss_0: 2.6485788822174072 (2.4959657070588097) | > grad_norm_0: tensor(1596.8918, device='cuda:0') (tensor(640.3077, device='cuda:0')) | > loss_gen: 2.356544017791748 (2.2840826876309452) | > loss_kl: 0.5976411700248718 (0.7479733794319386) | > loss_feat: 4.616917133331299 (5.532383584170317) | > loss_mel: 24.73727035522461 (20.402799102724813) | > loss_duration: 1.4126728773117065 (1.3356740255745096) | > loss_1: 33.721046447753906 (30.302912712097168) | > grad_norm_1: tensor(17152.9062, device='cuda:0') (tensor(15330.6963, device='cuda:0')) | > current_lr_0: 5.9278184828301356e-05 | > current_lr_1: 5.933749637100674e-05 | > step_time: 0.6192 (0.5518751922918825) | > loader_time: 0.7175 (0.0323819384282949)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7709710597991943 (2.7709710597991943) | > loss_disc_real_0: 0.1096893697977066 (0.1096893697977066) | > loss_disc_real_1: 0.26353323459625244 (0.26353323459625244) | > loss_disc_real_2: 0.2746793329715729 (0.2746793329715729) | > loss_disc_real_3: 0.23460650444030762 (0.23460650444030762) | > loss_disc_real_4: 0.22417354583740234 (0.22417354583740234) | > loss_disc_real_5: 0.22625672817230225 (0.22625672817230225) | > loss_0: 2.7709710597991943 (2.7709710597991943) | > loss_gen: 1.5892246961593628 (1.5892246961593628) | > loss_kl: 5.891336441040039 (5.891336441040039) | > loss_feat: 0.7521260380744934 (0.7521260380744934) | > loss_mel: 17.018178939819336 (17.018178939819336) | > loss_duration: 3.0187501907348633 (3.0187501907348633) | > loss_1: 28.269615173339844 (28.269615173339844)  --> STEP: 1 | > loss_disc: 2.5991427898406982 (2.5991427898406982) | > loss_disc_real_0: 0.24740594625473022 (0.24740594625473022) | > loss_disc_real_1: 0.25428175926208496 (0.25428175926208496) | > loss_disc_real_2: 0.2122301310300827 (0.2122301310300827) | > loss_disc_real_3: 0.27650973200798035 (0.27650973200798035) | > loss_disc_real_4: 0.22706851363182068 (0.22706851363182068) | > loss_disc_real_5: 0.3433862626552582 (0.3433862626552582) | > loss_0: 2.5991427898406982 (2.5991427898406982) | > loss_gen: 2.4284276962280273 (2.4284276962280273) | > loss_kl: 5.637391567230225 (5.637391567230225) | > loss_feat: 4.980813980102539 (4.980813980102539) | > loss_mel: 24.394683837890625 (24.394683837890625) | > loss_duration: 3.3755605220794678 (3.3755605220794678) | > loss_1: 40.81687927246094 (40.81687927246094)  --> STEP: 2 | > loss_disc: 2.7031140327453613 (2.65112841129303) | > loss_disc_real_0: 0.3078041076660156 (0.2776050269603729) | > loss_disc_real_1: 0.26156818866729736 (0.25792497396469116) | > loss_disc_real_2: 0.22517244517803192 (0.2187012881040573) | > loss_disc_real_3: 0.24862101674079895 (0.26256537437438965) | > loss_disc_real_4: 0.21354258060455322 (0.22030554711818695) | > loss_disc_real_5: 0.4153655171394348 (0.3793758898973465) | > loss_0: 2.7031140327453613 (2.65112841129303) | > loss_gen: 2.633124589920044 (2.5307761430740356) | > loss_kl: 5.783442497253418 (5.710417032241821) | > loss_feat: 7.235754013061523 (6.108283996582031) | > loss_mel: 22.517581939697266 (23.456132888793945) | > loss_duration: 3.2472786903381348 (3.3114196062088013) | > loss_1: 41.41718292236328 (41.11703109741211)  --> STEP: 3 | > loss_disc: 2.91927433013916 (2.7405103842417398) | > loss_disc_real_0: 0.19202670454978943 (0.24907891949017844) | > loss_disc_real_1: 0.26273873448371887 (0.25952956080436707) | > loss_disc_real_2: 0.3281375467777252 (0.25518004099527997) | > loss_disc_real_3: 0.24942509829998016 (0.2581852823495865) | > loss_disc_real_4: 0.2095683366060257 (0.21672647694746652) | > loss_disc_real_5: 0.24105305969715118 (0.33326827983061474) | > loss_0: 2.91927433013916 (2.7405103842417398) | > loss_gen: 1.6064060926437378 (2.222652792930603) | > loss_kl: 2.610950231552124 (4.677261432011922) | > loss_feat: 1.1435881853103638 (4.453385392824809) | > loss_mel: 16.694746017456055 (21.20233726501465) | > loss_duration: 3.1600656509399414 (3.260968287785848) | > loss_1: 25.215755462646484 (35.81660588582357) --> EVAL PERFORMANCE | > avg_loader_time: 0.0033505757649739585 (-0.005435784657796223) | > avg_loss_disc: 2.7405103842417398 (-0.4596409002939863) | > avg_loss_disc_real_0: 0.24907891949017844 (-0.20049449801445005) | > avg_loss_disc_real_1: 0.25952956080436707 (-0.012254729866981506) | > avg_loss_disc_real_2: 0.25518004099527997 (-0.035371358195940616) | > avg_loss_disc_real_3: 0.2581852823495865 (-0.028259838620821653) | > avg_loss_disc_real_4: 0.21672647694746652 (-0.22996227443218234) | > avg_loss_disc_real_5: 0.33326827983061474 (-0.19348225494225818) | > avg_loss_0: 2.7405103842417398 (-0.4596409002939863) | > avg_loss_gen: 2.222652792930603 (-0.43789215882619237) | > avg_loss_kl: 4.677261432011922 (-0.060650507609049775) | > avg_loss_feat: 4.453385392824809 (-1.3780502080917358) | > avg_loss_mel: 21.20233726501465 (-2.0421988169352225) | > avg_loss_duration: 3.260968287785848 (-0.013099988301594756) | > avg_loss_1: 35.81660588582357 (-3.9318911234537737)  > EPOCH: 1217/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:30:51)   --> TIME: 2023-10-20 15:31:07 -- STEP: 29/50 -- GLOBAL_STEP: 113880 | > loss_disc: 2.54642391204834 (2.4574381318585625) | > loss_disc_real_0: 0.32905879616737366 (0.16493173817108417) | > loss_disc_real_1: 0.1894049048423767 (0.20641709427381383) | > loss_disc_real_2: 0.2081470489501953 (0.21789442388148145) | > loss_disc_real_3: 0.11260383576154709 (0.22414573294849233) | > loss_disc_real_4: 0.34217414259910583 (0.2156438180084886) | > loss_disc_real_5: 0.47404441237449646 (0.22346191834016094) | > loss_0: 2.54642391204834 (2.4574381318585625) | > grad_norm_0: tensor(548.5211, device='cuda:0') (tensor(654.5297, device='cuda:0')) | > loss_gen: 2.967374801635742 (2.2730232107228248) | > loss_kl: 0.6243095397949219 (0.7731577969830612) | > loss_feat: 7.055878639221191 (6.18651096978835) | > loss_mel: 24.40312385559082 (18.955387173027827) | > loss_duration: 1.2909719944000244 (1.3413813196379563) | > loss_1: 36.3416633605957 (29.529460150620032) | > grad_norm_1: tensor(6755.7334, device='cuda:0') (tensor(22268.6484, device='cuda:0')) | > current_lr_0: 5.921893257119636e-05 | > current_lr_1: 5.9278184828301356e-05 | > step_time: 0.3058 (0.3696110824058796) | > loader_time: 0.0031 (0.006957868049884665)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4332468509674072 (2.4332468509674072) | > loss_disc_real_0: 0.3170161545276642 (0.3170161545276642) | > loss_disc_real_1: 0.33372700214385986 (0.33372700214385986) | > loss_disc_real_2: 0.24884864687919617 (0.24884864687919617) | > loss_disc_real_3: 0.32148391008377075 (0.32148391008377075) | > loss_disc_real_4: 0.08884060382843018 (0.08884060382843018) | > loss_disc_real_5: 0.24677026271820068 (0.24677026271820068) | > loss_0: 2.4332468509674072 (2.4332468509674072) | > loss_gen: 2.6476893424987793 (2.6476893424987793) | > loss_kl: 5.679363250732422 (5.679363250732422) | > loss_feat: 5.992786884307861 (5.992786884307861) | > loss_mel: 20.993488311767578 (20.993488311767578) | > loss_duration: 2.9955992698669434 (2.9955992698669434) | > loss_1: 38.30892562866211 (38.30892562866211)  --> STEP: 1 | > loss_disc: 3.363849639892578 (3.363849639892578) | > loss_disc_real_0: 0.6675299406051636 (0.6675299406051636) | > loss_disc_real_1: 0.4175300598144531 (0.4175300598144531) | > loss_disc_real_2: 0.38416972756385803 (0.38416972756385803) | > loss_disc_real_3: 0.4002256989479065 (0.4002256989479065) | > loss_disc_real_4: 0.33733218908309937 (0.33733218908309937) | > loss_disc_real_5: 0.42588290572166443 (0.42588290572166443) | > loss_0: 3.363849639892578 (3.363849639892578) | > loss_gen: 3.08518648147583 (3.08518648147583) | > loss_kl: 5.529812812805176 (5.529812812805176) | > loss_feat: 7.34972620010376 (7.34972620010376) | > loss_mel: 22.51371955871582 (22.51371955871582) | > loss_duration: 3.4426305294036865 (3.4426305294036865) | > loss_1: 41.92107391357422 (41.92107391357422)  --> STEP: 2 | > loss_disc: 3.0404114723205566 (3.2021305561065674) | > loss_disc_real_0: 0.41293659806251526 (0.5402332693338394) | > loss_disc_real_1: 0.24584504961967468 (0.3316875547170639) | > loss_disc_real_2: 0.23948334157466888 (0.31182653456926346) | > loss_disc_real_3: 0.23586560785770416 (0.31804565340280533) | > loss_disc_real_4: 0.2430514544248581 (0.29019182175397873) | > loss_disc_real_5: 0.22506408393383026 (0.32547349482774734) | > loss_0: 3.0404114723205566 (3.2021305561065674) | > loss_gen: 1.614181399345398 (2.349683940410614) | > loss_kl: 5.799062252044678 (5.664437532424927) | > loss_feat: 0.03880093991756439 (3.694263570010662) | > loss_mel: 1.0037083625793457 (11.758713960647583) | > loss_duration: 3.2751803398132324 (3.3589054346084595) | > loss_1: 11.730932235717773 (26.826003074645996)  --> STEP: 3 | > loss_disc: 2.135462522506714 (2.846574544906616) | > loss_disc_real_0: 0.12854790687561035 (0.4030048151810964) | > loss_disc_real_1: 0.04997384920716286 (0.23778298621376356) | > loss_disc_real_2: 0.11572902649641037 (0.2464606985449791) | > loss_disc_real_3: 0.26084309816360474 (0.29897813498973846) | > loss_disc_real_4: 0.10108742862939835 (0.22715702404578528) | > loss_disc_real_5: 0.10831770300865173 (0.2530882308880488) | > loss_0: 2.135462522506714 (2.846574544906616) | > loss_gen: 2.337139844894409 (2.345502575238546) | > loss_kl: 2.723905324935913 (4.684260129928589) | > loss_feat: 8.052611351013184 (5.147046163678169) | > loss_mel: 23.009933471679688 (15.509120464324951) | > loss_duration: 3.102208375930786 (3.2733397483825684) | > loss_1: 39.22579574584961 (30.959267298380535) --> EVAL PERFORMANCE | > avg_loader_time: 0.012242317199707031 (+0.008891741434733072) | > avg_loss_disc: 2.846574544906616 (+0.10606416066487645) | > avg_loss_disc_real_0: 0.4030048151810964 (+0.15392589569091794) | > avg_loss_disc_real_1: 0.23778298621376356 (-0.0217465745906035) | > avg_loss_disc_real_2: 0.2464606985449791 (-0.008719342450300871) | > avg_loss_disc_real_3: 0.29897813498973846 (+0.04079285264015198) | > avg_loss_disc_real_4: 0.22715702404578528 (+0.010430547098318754) | > avg_loss_disc_real_5: 0.2530882308880488 (-0.08018004894256592) | > avg_loss_0: 2.846574544906616 (+0.10606416066487645) | > avg_loss_gen: 2.345502575238546 (+0.12284978230794286) | > avg_loss_kl: 4.684260129928589 (+0.006998697916666963) | > avg_loss_feat: 5.147046163678169 (+0.6936607708533602) | > avg_loss_mel: 15.509120464324951 (-5.693216800689697) | > avg_loss_duration: 3.2733397483825684 (+0.01237146059672023) | > avg_loss_1: 30.959267298380535 (-4.857338587443035)  > EPOCH: 1218/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:31:34)   --> TIME: 2023-10-20 15:31:45 -- STEP: 9/50 -- GLOBAL_STEP: 113910 | > loss_disc: 2.517889976501465 (2.2948898341920643) | > loss_disc_real_0: 0.047099798917770386 (0.10879836748871538) | > loss_disc_real_1: 0.25902387499809265 (0.2197504523727629) | > loss_disc_real_2: 0.3195301294326782 (0.25396692835622364) | > loss_disc_real_3: 0.24508436024188995 (0.19542889586753315) | > loss_disc_real_4: 0.29753318428993225 (0.18710612588458592) | > loss_disc_real_5: 0.3164644241333008 (0.17836429385675323) | > loss_0: 2.517889976501465 (2.2948898341920643) | > grad_norm_0: tensor(273.3773, device='cuda:0') (tensor(532.1934, device='cuda:0')) | > loss_gen: 2.2750205993652344 (2.4340353276994495) | > loss_kl: 0.4459467828273773 (0.6728049624297354) | > loss_feat: 3.8265748023986816 (7.724240859349568) | > loss_mel: 26.324583053588867 (23.917930391099716) | > loss_duration: 1.2916771173477173 (1.336062444580926) | > loss_1: 34.16379928588867 (36.085072411431206) | > grad_norm_1: tensor(6435.3311, device='cuda:0') (tensor(25712.6914, device='cuda:0')) | > current_lr_0: 5.915973954043209e-05 | > current_lr_1: 5.921893257119636e-05 | > step_time: 0.5773 (0.6305286619398329) | > loader_time: 0.0403 (0.027323987748887803)  --> TIME: 2023-10-20 15:32:01 -- STEP: 39/50 -- GLOBAL_STEP: 113940 | > loss_disc: 2.119535446166992 (2.493611687268966) | > loss_disc_real_0: 0.08063212037086487 (0.1524768691892043) | > loss_disc_real_1: 0.24399635195732117 (0.22948035043783677) | > loss_disc_real_2: 0.28240376710891724 (0.24365223628970292) | > loss_disc_real_3: 0.23555074632167816 (0.23680175793094513) | > loss_disc_real_4: 0.22541998326778412 (0.23100715273847947) | > loss_disc_real_5: 0.2877610921859741 (0.24073264919794524) | > loss_0: 2.119535446166992 (2.493611687268966) | > grad_norm_0: tensor(736.8325, device='cuda:0') (tensor(751.5601, device='cuda:0')) | > loss_gen: 2.9195570945739746 (2.2899869252473875) | > loss_kl: 0.5373649597167969 (0.7048526950753652) | > loss_feat: 5.730330944061279 (5.75647601351524) | > loss_mel: 20.67877197265625 (20.293770958215767) | > loss_duration: 1.341833233833313 (1.3288686092083273) | > loss_1: 31.20785903930664 (30.373955054160877) | > grad_norm_1: tensor(26245.6387, device='cuda:0') (tensor(16510.1855, device='cuda:0')) | > current_lr_0: 5.915973954043209e-05 | > current_lr_1: 5.921893257119636e-05 | > step_time: 0.6392 (0.5500069459279379) | > loader_time: 0.0249 (0.019164439959403798)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8672313690185547 (2.8672313690185547) | > loss_disc_real_0: 0.17665022611618042 (0.17665022611618042) | > loss_disc_real_1: 0.2584879398345947 (0.2584879398345947) | > loss_disc_real_2: 0.2902476489543915 (0.2902476489543915) | > loss_disc_real_3: 0.2837855815887451 (0.2837855815887451) | > loss_disc_real_4: 0.2714080810546875 (0.2714080810546875) | > loss_disc_real_5: 0.27903079986572266 (0.27903079986572266) | > loss_0: 2.8672313690185547 (2.8672313690185547) | > loss_gen: 1.8179394006729126 (1.8179394006729126) | > loss_kl: 4.957118511199951 (4.957118511199951) | > loss_feat: 1.9505201578140259 (1.9505201578140259) | > loss_mel: 20.664073944091797 (20.664073944091797) | > loss_duration: 3.006450653076172 (3.006450653076172) | > loss_1: 32.39610290527344 (32.39610290527344)  --> STEP: 1 | > loss_disc: 2.559342861175537 (2.559342861175537) | > loss_disc_real_0: 0.10436934977769852 (0.10436934977769852) | > loss_disc_real_1: 0.28114157915115356 (0.28114157915115356) | > loss_disc_real_2: 0.18721431493759155 (0.18721431493759155) | > loss_disc_real_3: 0.32402580976486206 (0.32402580976486206) | > loss_disc_real_4: 0.2103344202041626 (0.2103344202041626) | > loss_disc_real_5: 0.25175565481185913 (0.25175565481185913) | > loss_0: 2.559342861175537 (2.559342861175537) | > loss_gen: 2.0304267406463623 (2.0304267406463623) | > loss_kl: 5.698354721069336 (5.698354721069336) | > loss_feat: 3.278156042098999 (3.278156042098999) | > loss_mel: 19.310609817504883 (19.310609817504883) | > loss_duration: 3.472055673599243 (3.472055673599243) | > loss_1: 33.78960418701172 (33.78960418701172)  --> STEP: 2 | > loss_disc: 2.593994617462158 (2.5766687393188477) | > loss_disc_real_0: 0.20664936304092407 (0.1555093564093113) | > loss_disc_real_1: 0.20721925795078278 (0.24418041855096817) | > loss_disc_real_2: 0.2535799443721771 (0.22039712965488434) | > loss_disc_real_3: 0.2342415601015091 (0.2791336849331856) | > loss_disc_real_4: 0.25213688611984253 (0.23123565316200256) | > loss_disc_real_5: 0.32038700580596924 (0.2860713303089142) | > loss_0: 2.593994617462158 (2.5766687393188477) | > loss_gen: 2.1067471504211426 (2.0685869455337524) | > loss_kl: 5.879274368286133 (5.788814544677734) | > loss_feat: 4.086525917053223 (3.682340979576111) | > loss_mel: 16.75120735168457 (18.030908584594727) | > loss_duration: 3.2070250511169434 (3.3395403623580933) | > loss_1: 32.03077697753906 (32.91019058227539)  --> STEP: 3 | > loss_disc: 2.5038421154022217 (2.5523931980133057) | > loss_disc_real_0: 0.038579728454351425 (0.116532813757658) | > loss_disc_real_1: 0.3767482042312622 (0.28836968044439953) | > loss_disc_real_2: 0.23233987390995026 (0.22437804440657297) | > loss_disc_real_3: 0.2782018184661865 (0.2788230627775192) | > loss_disc_real_4: 0.18210464715957642 (0.21485865116119385) | > loss_disc_real_5: 0.0995694026350975 (0.22390402108430862) | > loss_0: 2.5038421154022217 (2.5523931980133057) | > loss_gen: 1.9108068943023682 (2.015993595123291) | > loss_kl: 3.1820483207702637 (4.919892470041911) | > loss_feat: 4.150368690490723 (3.838350216547648) | > loss_mel: 22.425086975097656 (19.49563471476237) | > loss_duration: 3.160792350769043 (3.2799576918284097) | > loss_1: 34.8291015625 (33.549827575683594) --> EVAL PERFORMANCE | > avg_loader_time: 0.015370527903238932 (+0.0031282107035319005) | > avg_loss_disc: 2.5523931980133057 (-0.29418134689331055) | > avg_loss_disc_real_0: 0.116532813757658 (-0.28647200142343837) | > avg_loss_disc_real_1: 0.28836968044439953 (+0.05058669423063597) | > avg_loss_disc_real_2: 0.22437804440657297 (-0.022082654138406127) | > avg_loss_disc_real_3: 0.2788230627775192 (-0.02015507221221924) | > avg_loss_disc_real_4: 0.21485865116119385 (-0.01229837288459143) | > avg_loss_disc_real_5: 0.22390402108430862 (-0.029184209803740202) | > avg_loss_0: 2.5523931980133057 (-0.29418134689331055) | > avg_loss_gen: 2.015993595123291 (-0.32950898011525487) | > avg_loss_kl: 4.919892470041911 (+0.23563234011332224) | > avg_loss_feat: 3.838350216547648 (-1.3086959471305213) | > avg_loss_mel: 19.49563471476237 (+3.98651425043742) | > avg_loss_duration: 3.2799576918284097 (+0.006617943445841323) | > avg_loss_1: 33.549827575683594 (+2.5905602773030587)  > EPOCH: 1219/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:32:26)   --> TIME: 2023-10-20 15:32:40 -- STEP: 19/50 -- GLOBAL_STEP: 113970 | > loss_disc: 1.4894015789031982 (2.418191018857454) | > loss_disc_real_0: 0.024353981018066406 (0.1457371702907901) | > loss_disc_real_1: 0.07432672381401062 (0.20496562985997452) | > loss_disc_real_2: 0.09390942007303238 (0.19085941738203951) | > loss_disc_real_3: 0.10959292203187943 (0.21148348560458735) | > loss_disc_real_4: 0.019298851490020752 (0.20991437235160876) | > loss_disc_real_5: 0.014515449292957783 (0.19040587941478743) | > loss_0: 1.4894015789031982 (2.418191018857454) | > grad_norm_0: tensor(374.1683, device='cuda:0') (tensor(633.8030, device='cuda:0')) | > loss_gen: 2.4523627758026123 (2.248566012633474) | > loss_kl: 0.8144657015800476 (0.7435373177653865) | > loss_feat: 11.369231224060059 (6.272384885894625) | > loss_mel: 22.657394409179688 (20.432567470952083) | > loss_duration: 1.4241750240325928 (1.3597253059086047) | > loss_1: 38.717628479003906 (31.056780764931126) | > grad_norm_1: tensor(18508.0371, device='cuda:0') (tensor(22427.8457, device='cuda:0')) | > current_lr_0: 5.91006056768081e-05 | > current_lr_1: 5.915973954043209e-05 | > step_time: 0.2977 (0.48770564480831746) | > loader_time: 0.0049 (0.014900822388498406)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8648407459259033 (2.8648407459259033) | > loss_disc_real_0: 0.19150152802467346 (0.19150152802467346) | > loss_disc_real_1: 0.26227936148643494 (0.26227936148643494) | > loss_disc_real_2: 0.23589549958705902 (0.23589549958705902) | > loss_disc_real_3: 0.24949203431606293 (0.24949203431606293) | > loss_disc_real_4: 0.27298808097839355 (0.27298808097839355) | > loss_disc_real_5: 0.30420416593551636 (0.30420416593551636) | > loss_0: 2.8648407459259033 (2.8648407459259033) | > loss_gen: 1.6766213178634644 (1.6766213178634644) | > loss_kl: 5.9826202392578125 (5.9826202392578125) | > loss_feat: 0.4028555154800415 (0.4028555154800415) | > loss_mel: 12.8143892288208 (12.8143892288208) | > loss_duration: 3.0628573894500732 (3.0628573894500732) | > loss_1: 23.939342498779297 (23.939342498779297)  --> STEP: 1 | > loss_disc: 1.4875258207321167 (1.4875258207321167) | > loss_disc_real_0: 0.0720391571521759 (0.0720391571521759) | > loss_disc_real_1: 0.10584422200918198 (0.10584422200918198) | > loss_disc_real_2: 0.09745453298091888 (0.09745453298091888) | > loss_disc_real_3: 0.12302906811237335 (0.12302906811237335) | > loss_disc_real_4: 0.20574185252189636 (0.20574185252189636) | > loss_disc_real_5: 0.19222156703472137 (0.19222156703472137) | > loss_0: 1.4875258207321167 (1.4875258207321167) | > loss_gen: 3.1888036727905273 (3.1888036727905273) | > loss_kl: 5.4282402992248535 (5.4282402992248535) | > loss_feat: 11.559667587280273 (11.559667587280273) | > loss_mel: 23.80384063720703 (23.80384063720703) | > loss_duration: 3.2771642208099365 (3.2771642208099365) | > loss_1: 47.25771713256836 (47.25771713256836)  --> STEP: 2 | > loss_disc: 2.8514397144317627 (2.1694827675819397) | > loss_disc_real_0: 0.414351224899292 (0.24319519102573395) | > loss_disc_real_1: 0.23420806229114532 (0.17002614215016365) | > loss_disc_real_2: 0.26417139172554016 (0.18081296235322952) | > loss_disc_real_3: 0.1988721489906311 (0.16095060855150223) | > loss_disc_real_4: 0.46833062171936035 (0.33703623712062836) | > loss_disc_real_5: 0.38775137066841125 (0.2899864688515663) | > loss_0: 2.8514397144317627 (2.1694827675819397) | > loss_gen: 2.6224136352539062 (2.905608654022217) | > loss_kl: 6.368983745574951 (5.898612022399902) | > loss_feat: 4.957877159118652 (8.258772373199463) | > loss_mel: 24.01207733154297 (23.907958984375) | > loss_duration: 3.2099287509918213 (3.243546485900879) | > loss_1: 41.17127990722656 (44.21449851989746)  --> STEP: 3 | > loss_disc: 2.4480981826782227 (2.262354572614034) | > loss_disc_real_0: 0.5164562463760376 (0.33428220947583515) | > loss_disc_real_1: 0.29021206498146057 (0.21008811642726263) | > loss_disc_real_2: 0.24759720265865326 (0.20307437578837076) | > loss_disc_real_3: 0.1640474945306778 (0.16198290387789407) | > loss_disc_real_4: 0.1887582689523697 (0.2876102477312088) | > loss_disc_real_5: 0.13114632666110992 (0.23703975478808084) | > loss_0: 2.4480981826782227 (2.262354572614034) | > loss_gen: 3.6446475982666016 (3.151954968770345) | > loss_kl: 2.842510223388672 (4.879911422729492) | > loss_feat: 7.726940155029297 (8.08149496714274) | > loss_mel: 23.788667678833008 (23.868195215861004) | > loss_duration: 3.0456631183624268 (3.1775853633880615) | > loss_1: 41.048423767089844 (43.159140268961586)  --> TIME: 2023-10-20 15:33:04 -- STEP: 49/50 -- GLOBAL_STEP: 114000 | > loss_disc: 2.717172145843506 (2.4527870732910775) | > loss_disc_real_0: 0.08011849969625473 (0.1531570295670203) | > loss_disc_real_1: 0.16943666338920593 (0.21647406856016238) | > loss_disc_real_2: 0.07339471578598022 (0.21624239990297628) | > loss_disc_real_3: 0.23571956157684326 (0.2368909182901285) | > loss_disc_real_4: 0.28292539715766907 (0.2282426247031105) | > loss_disc_real_5: 0.29983726143836975 (0.2208265352195927) | > loss_0: 2.717172145843506 (2.4527870732910775) | > grad_norm_0: tensor(805.6636, device='cuda:0') (tensor(641.7587, device='cuda:0')) | > loss_gen: 1.5960363149642944 (2.322502780933769) | > loss_kl: 0.6097331643104553 (0.640316864931766) | > loss_feat: 1.695137858390808 (5.853902333168959) | > loss_mel: 22.15288543701172 (20.273097394680487) | > loss_duration: 1.453978419303894 (1.3441890648433141) | > loss_1: 27.507770538330078 (30.434008364774744) | > grad_norm_1: tensor(6793.0205, device='cuda:0') (tensor(21482.4941, device='cuda:0')) | > current_lr_0: 5.91006056768081e-05 | > current_lr_1: 5.915973954043209e-05 | > step_time: 0.6187 (0.4501594086082614) | > loader_time: 10.8168 (0.23320487567356654) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_114000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 1.974194049835205 (2.190314441919327) | > loss_disc_real_0: 0.20904721319675446 (0.302973460406065) | > loss_disc_real_1: 0.17613524198532104 (0.20159989781677723) | > loss_disc_real_2: 0.20765137672424316 (0.20421862602233887) | > loss_disc_real_3: 0.11728399246931076 (0.15080817602574825) | > loss_disc_real_4: 0.14901286363601685 (0.2529609017074108) | > loss_disc_real_5: 0.16317416727542877 (0.21857335790991783) | > loss_0: 1.974194049835205 (2.190314441919327) | > loss_gen: 2.6171674728393555 (3.0182580947875977) | > loss_kl: 5.658798694610596 (5.074633240699768) | > loss_feat: 9.703919410705566 (8.487101078033447) | > loss_mel: 24.22489356994629 (23.957369804382324) | > loss_duration: 3.113905191421509 (3.1616653203964233) | > loss_1: 45.318687438964844 (43.6990270614624)  --> STEP: 1 | > loss_disc: 2.8109004497528076 (2.314431643486023) | > loss_disc_real_0: 0.27377939224243164 (0.29713464677333834) | > loss_disc_real_1: 0.4059462547302246 (0.2424691691994667) | > loss_disc_real_2: 0.336020827293396 (0.23057906627655028) | > loss_disc_real_3: 0.3086734116077423 (0.18238122314214705) | > loss_disc_real_4: 0.26857301592826843 (0.25608332455158234) | > loss_disc_real_5: 0.27139949798583984 (0.22913858592510222) | > loss_0: 2.8109004497528076 (2.314431643486023) | > loss_gen: 2.5743775367736816 (2.9294819831848145) | > loss_kl: 5.687875747680664 (5.197281742095948) | > loss_feat: 2.6929855346679688 (7.328277969360352) | > loss_mel: 21.263763427734375 (23.418648529052735) | > loss_duration: 3.4011311531066895 (3.2095584869384766) | > loss_1: 35.62013244628906 (42.083248138427734)  --> STEP: 2 | > loss_disc: 2.5582151412963867 (2.3550622264544168) | > loss_disc_real_0: 0.446743369102478 (0.3220694338281949) | > loss_disc_real_1: 0.14914147555828094 (0.2269145535926024) | > loss_disc_real_2: 0.23504474759101868 (0.23132334649562836) | > loss_disc_real_3: 0.11433982104063034 (0.17104098945856094) | > loss_disc_real_4: 0.14796388149261475 (0.23806341737508774) | > loss_disc_real_5: 0.22367344796657562 (0.22822772959868112) | > loss_0: 2.5582151412963867 (2.3550622264544168) | > loss_gen: 2.775343418121338 (2.903792222340902) | > loss_kl: 6.0330376625061035 (5.33657439549764) | > loss_feat: 8.923152923583984 (7.594090461730957) | > loss_mel: 25.539714813232422 (23.772159576416016) | > loss_duration: 3.2578811645507812 (3.2176122665405273) | > loss_1: 46.52912902832031 (42.824228286743164)  --> STEP: 3 | > loss_disc: 2.952575206756592 (2.440421223640442) | > loss_disc_real_0: 0.34279704093933105 (0.32503052055835724) | > loss_disc_real_1: 0.2759678065776825 (0.23392216116189957) | > loss_disc_real_2: 0.28094786405563354 (0.2384125632899148) | > loss_disc_real_3: 0.26510587334632874 (0.18447883001395635) | > loss_disc_real_4: 0.2722328305244446 (0.24294476211071014) | > loss_disc_real_5: 0.2978825569152832 (0.23817841921533858) | > loss_0: 2.952575206756592 (2.440421223640442) | > loss_gen: 1.9123433828353882 (2.762156673840114) | > loss_kl: 2.8289644718170166 (4.978344406400408) | > loss_feat: 0.5025820136070251 (6.581017826284681) | > loss_mel: 15.648298263549805 (22.61160796029227) | > loss_duration: 3.080155611038208 (3.1979756014687672) | > loss_1: 23.97234535217285 (40.13110215323312) --> EVAL PERFORMANCE | > avg_loader_time: 0.5555324554443359 (+0.540161927541097) | > avg_loss_disc: 2.440421223640442 (-0.11197197437286377) | > avg_loss_disc_real_0: 0.32503052055835724 (+0.20849770680069923) | > avg_loss_disc_real_1: 0.23392216116189957 (-0.05444751928249997) | > avg_loss_disc_real_2: 0.2384125632899148 (+0.01403451888334184) | > avg_loss_disc_real_3: 0.18447883001395635 (-0.09434423276356288) | > avg_loss_disc_real_4: 0.24294476211071014 (+0.028086110949516296) | > avg_loss_disc_real_5: 0.23817841921533858 (+0.014274398131029958) | > avg_loss_0: 2.440421223640442 (-0.11197197437286377) | > avg_loss_gen: 2.762156673840114 (+0.746163078716823) | > avg_loss_kl: 4.978344406400408 (+0.058451936358497214) | > avg_loss_feat: 6.581017826284681 (+2.742667609737033) | > avg_loss_mel: 22.61160796029227 (+3.1159732455299007) | > avg_loss_duration: 3.1979756014687672 (-0.08198209035964243) | > avg_loss_1: 40.13110215323312 (+6.581274577549529)  > EPOCH: 1220/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:33:22)   --> TIME: 2023-10-20 15:33:59 -- STEP: 29/50 -- GLOBAL_STEP: 114030 | > loss_disc: 2.5513763427734375 (2.465461151353244) | > loss_disc_real_0: 0.15509945154190063 (0.15200311350154466) | > loss_disc_real_1: 0.2126334011554718 (0.226399766217018) | > loss_disc_real_2: 0.1545107513666153 (0.24178022069150004) | > loss_disc_real_3: 0.2905404269695282 (0.23967200947989678) | > loss_disc_real_4: 0.3738963007926941 (0.26431295648217196) | > loss_disc_real_5: 0.31059935688972473 (0.2599796273199649) | > loss_0: 2.5513763427734375 (2.465461151353244) | > grad_norm_0: tensor(307.6189, device='cuda:0') (tensor(496.8448, device='cuda:0')) | > loss_gen: 2.333245038986206 (2.425376037071491) | > loss_kl: 0.5169476866722107 (0.7589154635267011) | > loss_feat: 5.745665550231934 (6.728024057016291) | > loss_mel: 20.932065963745117 (20.418937058284364) | > loss_duration: 1.324893593788147 (1.329751109254771) | > loss_1: 30.85281753540039 (31.66100360607279) | > grad_norm_1: tensor(4076.0339, device='cuda:0') (tensor(19930.2969, device='cuda:0')) | > current_lr_0: 5.904153092118314e-05 | > current_lr_1: 5.91006056768081e-05 | > step_time: 0.8664 (0.6359567888851825) | > loader_time: 0.0421 (0.021088337076121365)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1729984283447266 (2.1729984283447266) | > loss_disc_real_0: 0.09326790273189545 (0.09326790273189545) | > loss_disc_real_1: 0.09340503811836243 (0.09340503811836243) | > loss_disc_real_2: 0.17819182574748993 (0.17819182574748993) | > loss_disc_real_3: 0.19949527084827423 (0.19949527084827423) | > loss_disc_real_4: 0.10018681734800339 (0.10018681734800339) | > loss_disc_real_5: 0.21437327563762665 (0.21437327563762665) | > loss_0: 2.1729984283447266 (2.1729984283447266) | > loss_gen: 2.0238070487976074 (2.0238070487976074) | > loss_kl: 5.51662015914917 (5.51662015914917) | > loss_feat: 9.448836326599121 (9.448836326599121) | > loss_mel: 21.812585830688477 (21.812585830688477) | > loss_duration: 3.043644666671753 (3.043644666671753) | > loss_1: 41.84549331665039 (41.84549331665039)  --> STEP: 1 | > loss_disc: 1.6149251461029053 (1.6149251461029053) | > loss_disc_real_0: 0.049755558371543884 (0.049755558371543884) | > loss_disc_real_1: 0.05516594648361206 (0.05516594648361206) | > loss_disc_real_2: 0.08663257956504822 (0.08663257956504822) | > loss_disc_real_3: 0.026315584778785706 (0.026315584778785706) | > loss_disc_real_4: 0.08875694870948792 (0.08875694870948792) | > loss_disc_real_5: 0.0313335619866848 (0.0313335619866848) | > loss_0: 1.6149251461029053 (1.6149251461029053) | > loss_gen: 2.0263278484344482 (2.0263278484344482) | > loss_kl: 5.704596042633057 (5.704596042633057) | > loss_feat: 14.431437492370605 (14.431437492370605) | > loss_mel: 26.26026725769043 (26.26026725769043) | > loss_duration: 3.4177050590515137 (3.4177050590515137) | > loss_1: 51.840335845947266 (51.840335845947266)  --> STEP: 2 | > loss_disc: 2.599011182785034 (2.1069681644439697) | > loss_disc_real_0: 0.04263691231608391 (0.046196235343813896) | > loss_disc_real_1: 0.11875740438699722 (0.08696167543530464) | > loss_disc_real_2: 0.17165344953536987 (0.12914301455020905) | > loss_disc_real_3: 0.33800479769706726 (0.18216019123792648) | > loss_disc_real_4: 0.11805631220340729 (0.1034066304564476) | > loss_disc_real_5: 0.19042667746543884 (0.11088011972606182) | > loss_0: 2.599011182785034 (2.1069681644439697) | > loss_gen: 1.8477412462234497 (1.937034547328949) | > loss_kl: 6.227911472320557 (5.966253757476807) | > loss_feat: 9.54369068145752 (11.987564086914062) | > loss_mel: 22.93695640563965 (24.59861183166504) | > loss_duration: 3.2797625064849854 (3.3487337827682495) | > loss_1: 43.8360595703125 (47.83819770812988)  --> STEP: 3 | > loss_disc: 2.719205141067505 (2.311047156651815) | > loss_disc_real_0: 0.27020516991615295 (0.12086588020126025) | > loss_disc_real_1: 0.25835251808166504 (0.14409195631742477) | > loss_disc_real_2: 0.2126644402742386 (0.15698348979155222) | > loss_disc_real_3: 0.2353067249059677 (0.1998757024606069) | > loss_disc_real_4: 0.35165703296661377 (0.186156764626503) | > loss_disc_real_5: 0.3265416920185089 (0.18276731049021086) | > loss_0: 2.719205141067505 (2.311047156651815) | > loss_gen: 2.2579116821289062 (2.043993592262268) | > loss_kl: 2.6408915519714355 (4.857799688975017) | > loss_feat: 5.128309726715088 (9.701145966847738) | > loss_mel: 22.301773071289062 (23.832998911539715) | > loss_duration: 2.9894659519195557 (3.228977839152018) | > loss_1: 35.318355560302734 (43.6649169921875) --> EVAL PERFORMANCE | > avg_loader_time: 0.0040585994720458984 (-0.55147385597229) | > avg_loss_disc: 2.311047156651815 (-0.12937406698862697) | > avg_loss_disc_real_0: 0.12086588020126025 (-0.20416464035709697) | > avg_loss_disc_real_1: 0.14409195631742477 (-0.08983020484447479) | > avg_loss_disc_real_2: 0.15698348979155222 (-0.08142907349836259) | > avg_loss_disc_real_3: 0.1998757024606069 (+0.015396872446650556) | > avg_loss_disc_real_4: 0.186156764626503 (-0.05678799748420715) | > avg_loss_disc_real_5: 0.18276731049021086 (-0.05541110872512772) | > avg_loss_0: 2.311047156651815 (-0.12937406698862697) | > avg_loss_gen: 2.043993592262268 (-0.7181630815778459) | > avg_loss_kl: 4.857799688975017 (-0.12054471742539175) | > avg_loss_feat: 9.701145966847738 (+3.1201281405630574) | > avg_loss_mel: 23.832998911539715 (+1.221390951247443) | > avg_loss_duration: 3.228977839152018 (+0.031002237683250833) | > avg_loss_1: 43.6649169921875 (+3.5338148389543775)  > EPOCH: 1221/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:34:34)   --> TIME: 2023-10-20 15:34:47 -- STEP: 9/50 -- GLOBAL_STEP: 114060 | > loss_disc: 1.6939822435379028 (2.4434036281373768) | > loss_disc_real_0: 0.02852363884449005 (0.13676107716229227) | > loss_disc_real_1: 0.17417822778224945 (0.18765806820657518) | > loss_disc_real_2: 0.13784532248973846 (0.20079096075561312) | > loss_disc_real_3: 0.18837150931358337 (0.2125610245598687) | > loss_disc_real_4: 0.1628548800945282 (0.22919680343733895) | > loss_disc_real_5: 0.20181818306446075 (0.23282937043242985) | > loss_0: 1.6939822435379028 (2.4434036281373768) | > grad_norm_0: tensor(450.7925, device='cuda:0') (tensor(542.5212, device='cuda:0')) | > loss_gen: 2.919726610183716 (2.17917807896932) | > loss_kl: 1.0986171960830688 (0.8279353910022311) | > loss_feat: 6.93223237991333 (5.411698619524638) | > loss_mel: 22.396831512451172 (20.705489582485622) | > loss_duration: 1.2938374280929565 (1.3259227408303156) | > loss_1: 34.6412467956543 (30.450224346584744) | > grad_norm_1: tensor(7983.5308, device='cuda:0') (tensor(14783.6514, device='cuda:0')) | > current_lr_0: 5.8982515214475065e-05 | > current_lr_1: 5.904153092118314e-05 | > step_time: 0.6849 (0.9079001214769151) | > loader_time: 0.0417 (0.036036835776435)  --> TIME: 2023-10-20 15:35:06 -- STEP: 39/50 -- GLOBAL_STEP: 114090 | > loss_disc: 2.811199903488159 (2.471735532467182) | > loss_disc_real_0: 0.21811416745185852 (0.15003605669316566) | > loss_disc_real_1: 0.33772262930870056 (0.21940004863800147) | > loss_disc_real_2: 0.37748196721076965 (0.225995445671754) | > loss_disc_real_3: 0.2762208580970764 (0.22066380274601471) | > loss_disc_real_4: 0.2843526601791382 (0.23656901373313025) | > loss_disc_real_5: 0.1812698245048523 (0.22509196792275477) | > loss_0: 2.811199903488159 (2.471735532467182) | > grad_norm_0: tensor(1288.7925, device='cuda:0') (tensor(615.2106, device='cuda:0')) | > loss_gen: 2.2725157737731934 (2.1923976066784983) | > loss_kl: 0.30773016810417175 (0.7604998025374535) | > loss_feat: 4.137526512145996 (5.267084251038539) | > loss_mel: 19.59709930419922 (20.22804433871538) | > loss_duration: 1.3607347011566162 (1.323746002637423) | > loss_1: 27.675607681274414 (29.771772005619148) | > grad_norm_1: tensor(26413.1074, device='cuda:0') (tensor(15051.7100, device='cuda:0')) | > current_lr_0: 5.8982515214475065e-05 | > current_lr_1: 5.904153092118314e-05 | > step_time: 0.6087 (0.6737370124230017) | > loader_time: 0.007 (0.027993483421130057)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.120171546936035 (3.120171546936035) | > loss_disc_real_0: 0.36561864614486694 (0.36561864614486694) | > loss_disc_real_1: 0.3851337134838104 (0.3851337134838104) | > loss_disc_real_2: 0.27210232615470886 (0.27210232615470886) | > loss_disc_real_3: 0.39452823996543884 (0.39452823996543884) | > loss_disc_real_4: 0.3500342071056366 (0.3500342071056366) | > loss_disc_real_5: 0.5409747362136841 (0.5409747362136841) | > loss_0: 3.120171546936035 (3.120171546936035) | > loss_gen: 3.1128578186035156 (3.1128578186035156) | > loss_kl: 5.9087300300598145 (5.9087300300598145) | > loss_feat: 5.4864630699157715 (5.4864630699157715) | > loss_mel: 21.010286331176758 (21.010286331176758) | > loss_duration: 3.021109104156494 (3.021109104156494) | > loss_1: 38.53944778442383 (38.53944778442383)  --> STEP: 1 | > loss_disc: 2.9269683361053467 (2.9269683361053467) | > loss_disc_real_0: 0.15575622022151947 (0.15575622022151947) | > loss_disc_real_1: 0.2621651589870453 (0.2621651589870453) | > loss_disc_real_2: 0.2015962153673172 (0.2015962153673172) | > loss_disc_real_3: 0.2582379877567291 (0.2582379877567291) | > loss_disc_real_4: 0.258914053440094 (0.258914053440094) | > loss_disc_real_5: 0.2663695514202118 (0.2663695514202118) | > loss_0: 2.9269683361053467 (2.9269683361053467) | > loss_gen: 1.5303630828857422 (1.5303630828857422) | > loss_kl: 5.738194465637207 (5.738194465637207) | > loss_feat: 1.103153944015503 (1.103153944015503) | > loss_mel: 16.75506019592285 (16.75506019592285) | > loss_duration: 3.576690196990967 (3.576690196990967) | > loss_1: 28.703462600708008 (28.703462600708008)  --> STEP: 2 | > loss_disc: 3.216336727142334 (3.0716525316238403) | > loss_disc_real_0: 0.27326279878616333 (0.2145095095038414) | > loss_disc_real_1: 0.31233516335487366 (0.2872501611709595) | > loss_disc_real_2: 0.34916266798973083 (0.275379441678524) | > loss_disc_real_3: 0.29446157813072205 (0.2763497829437256) | > loss_disc_real_4: 0.4477694630622864 (0.3533417582511902) | > loss_disc_real_5: 0.40720129013061523 (0.3367854207754135) | > loss_0: 3.216336727142334 (3.0716525316238403) | > loss_gen: 2.5069901943206787 (2.0186766386032104) | > loss_kl: 6.272879600524902 (6.005537033081055) | > loss_feat: 4.86284875869751 (2.9830013513565063) | > loss_mel: 24.587594985961914 (20.671327590942383) | > loss_duration: 3.281338930130005 (3.429014563560486) | > loss_1: 41.51165008544922 (35.10755634307861)  --> STEP: 3 | > loss_disc: 3.2940621376037598 (3.14578906695048) | > loss_disc_real_0: 0.18455323576927185 (0.20452408492565155) | > loss_disc_real_1: 0.4128538966178894 (0.3291180729866028) | > loss_disc_real_2: 0.30355173349380493 (0.284770205616951) | > loss_disc_real_3: 0.25195592641830444 (0.2682184974352519) | > loss_disc_real_4: 0.36741167306900024 (0.3580317298571269) | > loss_disc_real_5: 0.5299974679946899 (0.4011894365151723) | > loss_0: 3.2940621376037598 (3.14578906695048) | > loss_gen: 2.0673296451568604 (2.0348943074544272) | > loss_kl: 2.6836047172546387 (4.898226261138916) | > loss_feat: 4.318670749664307 (3.428224484125773) | > loss_mel: 21.08992576599121 (20.81086031595866) | > loss_duration: 2.9952783584594727 (3.284435828526815) | > loss_1: 33.154808044433594 (34.45664024353027) --> EVAL PERFORMANCE | > avg_loader_time: 0.01852877934773763 (+0.01447017987569173) | > avg_loss_disc: 3.14578906695048 (+0.8347419102986651) | > avg_loss_disc_real_0: 0.20452408492565155 (+0.0836582047243913) | > avg_loss_disc_real_1: 0.3291180729866028 (+0.185026116669178) | > avg_loss_disc_real_2: 0.284770205616951 (+0.12778671582539877) | > avg_loss_disc_real_3: 0.2682184974352519 (+0.06834279497464499) | > avg_loss_disc_real_4: 0.3580317298571269 (+0.1718749652306239) | > avg_loss_disc_real_5: 0.4011894365151723 (+0.21842212602496144) | > avg_loss_0: 3.14578906695048 (+0.8347419102986651) | > avg_loss_gen: 2.0348943074544272 (-0.009099284807840835) | > avg_loss_kl: 4.898226261138916 (+0.040426572163899444) | > avg_loss_feat: 3.428224484125773 (-6.272921482721966) | > avg_loss_mel: 20.81086031595866 (-3.0221385955810547) | > avg_loss_duration: 3.284435828526815 (+0.055457989374796846) | > avg_loss_1: 34.45664024353027 (-9.208276748657227)  > EPOCH: 1222/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:35:27)   --> TIME: 2023-10-20 15:35:46 -- STEP: 19/50 -- GLOBAL_STEP: 114120 | > loss_disc: 1.9700736999511719 (2.422302635092484) | > loss_disc_real_0: 0.23404991626739502 (0.16357969453460292) | > loss_disc_real_1: 0.17112530767917633 (0.2110862735854952) | > loss_disc_real_2: 0.18212023377418518 (0.22070268169045448) | > loss_disc_real_3: 0.19066375494003296 (0.2195421339649903) | > loss_disc_real_4: 0.13583791255950928 (0.21399781970601334) | > loss_disc_real_5: 0.1347084939479828 (0.20648636747347682) | > loss_0: 1.9700736999511719 (2.422302635092484) | > grad_norm_0: tensor(642.5027, device='cuda:0') (tensor(526.0887, device='cuda:0')) | > loss_gen: 2.5971879959106445 (2.230398090262162) | > loss_kl: 0.9732510447502136 (0.8313464145911368) | > loss_feat: 5.137759208679199 (5.272829315380046) | > loss_mel: 19.213924407958984 (18.427931183262874) | > loss_duration: 1.4226658344268799 (1.3631000205090171) | > loss_1: 29.344789505004883 (28.12560528203061) | > grad_norm_1: tensor(11520.8955, device='cuda:0') (tensor(21517.5898, device='cuda:0')) | > current_lr_0: 5.8923558497660775e-05 | > current_lr_1: 5.8982515214475065e-05 | > step_time: 1.34 (0.6726144614972567) | > loader_time: 0.0138 (0.018105782960590563)  --> TIME: 2023-10-20 15:36:05 -- STEP: 49/50 -- GLOBAL_STEP: 114150 | > loss_disc: 2.3101511001586914 (2.4734409706933156) | > loss_disc_real_0: 0.10920249670743942 (0.1536084425692656) | > loss_disc_real_1: 0.20897366106510162 (0.21909038296767644) | > loss_disc_real_2: 0.17469526827335358 (0.22135018253204775) | > loss_disc_real_3: 0.15002097189426422 (0.22036091207849737) | > loss_disc_real_4: 0.31338995695114136 (0.22973615835819924) | > loss_disc_real_5: 0.30128803849220276 (0.23639815984940044) | > loss_0: 2.3101511001586914 (2.4734409706933156) | > grad_norm_0: tensor(583.9882, device='cuda:0') (tensor(635.8626, device='cuda:0')) | > loss_gen: 2.310831069946289 (2.1985494238989696) | > loss_kl: 0.49493277072906494 (0.8103521393269909) | > loss_feat: 5.376224994659424 (5.11890419070818) | > loss_mel: 26.901283264160156 (19.0722545117748) | > loss_duration: 1.4646788835525513 (1.3384084141984278) | > loss_1: 36.54795455932617 (28.538468652841996) | > grad_norm_1: tensor(11168.9941, device='cuda:0') (tensor(15693.5723, device='cuda:0')) | > current_lr_0: 5.8923558497660775e-05 | > current_lr_1: 5.8982515214475065e-05 | > step_time: 0.2566 (0.6308196807394222) | > loader_time: 0.3745 (0.027775287628173828)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0575833320617676 (3.0575833320617676) | > loss_disc_real_0: 0.12736617028713226 (0.12736617028713226) | > loss_disc_real_1: 0.1923230141401291 (0.1923230141401291) | > loss_disc_real_2: 0.22835782170295715 (0.22835782170295715) | > loss_disc_real_3: 0.2532684803009033 (0.2532684803009033) | > loss_disc_real_4: 0.26485681533813477 (0.26485681533813477) | > loss_disc_real_5: 0.32469460368156433 (0.32469460368156433) | > loss_0: 3.0575833320617676 (3.0575833320617676) | > loss_gen: 1.3962788581848145 (1.3962788581848145) | > loss_kl: 5.45786714553833 (5.45786714553833) | > loss_feat: 0.019464287906885147 (0.019464287906885147) | > loss_mel: 0.8774386048316956 (0.8774386048316956) | > loss_duration: 2.9634013175964355 (2.9634013175964355) | > loss_1: 10.71445083618164 (10.71445083618164)  --> STEP: 1 | > loss_disc: 2.977372169494629 (2.977372169494629) | > loss_disc_real_0: 0.2596466839313507 (0.2596466839313507) | > loss_disc_real_1: 0.21658307313919067 (0.21658307313919067) | > loss_disc_real_2: 0.30807992815971375 (0.30807992815971375) | > loss_disc_real_3: 0.29214802384376526 (0.29214802384376526) | > loss_disc_real_4: 0.27032265067100525 (0.27032265067100525) | > loss_disc_real_5: 0.33511343598365784 (0.33511343598365784) | > loss_0: 2.977372169494629 (2.977372169494629) | > loss_gen: 1.8591187000274658 (1.8591187000274658) | > loss_kl: 5.6280646324157715 (5.6280646324157715) | > loss_feat: 2.7390811443328857 (2.7390811443328857) | > loss_mel: 19.47224998474121 (19.47224998474121) | > loss_duration: 3.4232144355773926 (3.4232144355773926) | > loss_1: 33.12173080444336 (33.12173080444336)  --> STEP: 2 | > loss_disc: 2.6690428256988525 (2.8232074975967407) | > loss_disc_real_0: 0.37196630239486694 (0.3158064931631088) | > loss_disc_real_1: 0.24353580176830292 (0.2300594374537468) | > loss_disc_real_2: 0.28901124000549316 (0.29854558408260345) | > loss_disc_real_3: 0.3590104877948761 (0.3255792558193207) | > loss_disc_real_4: 0.1489209681749344 (0.20962180942296982) | > loss_disc_real_5: 0.3320505917072296 (0.3335820138454437) | > loss_0: 2.6690428256988525 (2.8232074975967407) | > loss_gen: 2.9069533348083496 (2.3830360174179077) | > loss_kl: 5.860393047332764 (5.744228839874268) | > loss_feat: 8.933752059936523 (5.836416602134705) | > loss_mel: 22.55794334411621 (21.01509666442871) | > loss_duration: 3.2496178150177 (3.3364161252975464) | > loss_1: 43.50865936279297 (38.315195083618164)  --> STEP: 3 | > loss_disc: 3.2830071449279785 (2.9764740467071533) | > loss_disc_real_0: 0.32023343443870544 (0.31728214025497437) | > loss_disc_real_1: 0.2974242568016052 (0.25251437723636627) | > loss_disc_real_2: 0.4171721339225769 (0.3380877673625946) | > loss_disc_real_3: 0.31942689418792725 (0.3235284686088562) | > loss_disc_real_4: 0.3292524814605713 (0.24949870010217032) | > loss_disc_real_5: 0.38060492277145386 (0.34925631682078045) | > loss_0: 3.2830071449279785 (2.9764740467071533) | > loss_gen: 2.000633716583252 (2.255568583806356) | > loss_kl: 2.6076853275299072 (4.6987143357594805) | > loss_feat: 3.1469147205352783 (4.9399159749348955) | > loss_mel: 20.15189552307129 (20.727362950642902) | > loss_duration: 3.042243003845215 (3.238358418146769) | > loss_1: 30.949371337890625 (35.859920501708984) --> EVAL PERFORMANCE | > avg_loader_time: 0.0064080556233723955 (-0.012120723724365234) | > avg_loss_disc: 2.9764740467071533 (-0.16931502024332667) | > avg_loss_disc_real_0: 0.31728214025497437 (+0.11275805532932281) | > avg_loss_disc_real_1: 0.25251437723636627 (-0.07660369575023651) | > avg_loss_disc_real_2: 0.3380877673625946 (+0.053317561745643616) | > avg_loss_disc_real_3: 0.3235284686088562 (+0.05530997117360431) | > avg_loss_disc_real_4: 0.24949870010217032 (-0.10853302975495657) | > avg_loss_disc_real_5: 0.34925631682078045 (-0.05193311969439185) | > avg_loss_0: 2.9764740467071533 (-0.16931502024332667) | > avg_loss_gen: 2.255568583806356 (+0.2206742763519287) | > avg_loss_kl: 4.6987143357594805 (-0.19951192537943552) | > avg_loss_feat: 4.9399159749348955 (+1.5116914908091226) | > avg_loss_mel: 20.727362950642902 (-0.08349736531575758) | > avg_loss_duration: 3.238358418146769 (-0.04607741038004587) | > avg_loss_1: 35.859920501708984 (+1.403280258178711)  > EPOCH: 1223/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:36:16)   --> TIME: 2023-10-20 15:36:38 -- STEP: 29/50 -- GLOBAL_STEP: 114180 | > loss_disc: 2.5393548011779785 (2.281968166088235) | > loss_disc_real_0: 0.194102942943573 (0.13941148173963203) | > loss_disc_real_1: 0.2966873049736023 (0.20490682889418355) | > loss_disc_real_2: 0.1852472722530365 (0.19802148614464135) | > loss_disc_real_3: 0.3311363458633423 (0.22848524564299091) | > loss_disc_real_4: 0.21110603213310242 (0.22266446384761868) | > loss_disc_real_5: 0.2943945825099945 (0.22905216377292728) | > loss_0: 2.5393548011779785 (2.281968166088235) | > grad_norm_0: tensor(306.9215, device='cuda:0') (tensor(538.8162, device='cuda:0')) | > loss_gen: 2.524460792541504 (2.434225555123954) | > loss_kl: 0.5508496761322021 (0.8030565422156761) | > loss_feat: 6.287431716918945 (6.665176537530176) | > loss_mel: 19.937774658203125 (21.072372255654166) | > loss_duration: 1.3429983854293823 (1.3392561304158177) | > loss_1: 30.643516540527344 (32.31408717714507) | > grad_norm_1: tensor(3688.3809, device='cuda:0') (tensor(17533.4766, device='cuda:0')) | > current_lr_0: 5.886466071177618e-05 | > current_lr_1: 5.8923558497660775e-05 | > step_time: 0.3571 (0.5790695239757669) | > loader_time: 0.002 (0.017762077265772325)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.786820888519287 (2.786820888519287) | > loss_disc_real_0: 0.08988699316978455 (0.08988699316978455) | > loss_disc_real_1: 0.1710662543773651 (0.1710662543773651) | > loss_disc_real_2: 0.2374667525291443 (0.2374667525291443) | > loss_disc_real_3: 0.300008624792099 (0.300008624792099) | > loss_disc_real_4: 0.3116507828235626 (0.3116507828235626) | > loss_disc_real_5: 0.3439716696739197 (0.3439716696739197) | > loss_0: 2.786820888519287 (2.786820888519287) | > loss_gen: 2.1469812393188477 (2.1469812393188477) | > loss_kl: 5.812359809875488 (5.812359809875488) | > loss_feat: 3.729367971420288 (3.729367971420288) | > loss_mel: 21.84444236755371 (21.84444236755371) | > loss_duration: 2.969820499420166 (2.969820499420166) | > loss_1: 36.50297164916992 (36.50297164916992)  --> STEP: 1 | > loss_disc: 2.6711649894714355 (2.6711649894714355) | > loss_disc_real_0: 0.17257732152938843 (0.17257732152938843) | > loss_disc_real_1: 0.243253692984581 (0.243253692984581) | > loss_disc_real_2: 0.17966009676456451 (0.17966009676456451) | > loss_disc_real_3: 0.21948620676994324 (0.21948620676994324) | > loss_disc_real_4: 0.2772597670555115 (0.2772597670555115) | > loss_disc_real_5: 0.2804061472415924 (0.2804061472415924) | > loss_0: 2.6711649894714355 (2.6711649894714355) | > loss_gen: 1.7831660509109497 (1.7831660509109497) | > loss_kl: 5.4569501876831055 (5.4569501876831055) | > loss_feat: 1.585097312927246 (1.585097312927246) | > loss_mel: 18.38666534423828 (18.38666534423828) | > loss_duration: 3.5727169513702393 (3.5727169513702393) | > loss_1: 30.784597396850586 (30.784597396850586)  --> STEP: 2 | > loss_disc: 3.3278939723968506 (2.999529480934143) | > loss_disc_real_0: 0.20025019347667694 (0.18641375750303268) | > loss_disc_real_1: 0.35633155703544617 (0.2997926250100136) | > loss_disc_real_2: 0.3664098381996155 (0.27303496748209) | > loss_disc_real_3: 0.32978472113609314 (0.2746354639530182) | > loss_disc_real_4: 0.1975010186433792 (0.23738039284944534) | > loss_disc_real_5: 0.3049592971801758 (0.2926827222108841) | > loss_0: 3.3278939723968506 (2.999529480934143) | > loss_gen: 1.8210480213165283 (1.802107036113739) | > loss_kl: 5.858697891235352 (5.6578240394592285) | > loss_feat: 8.012295722961426 (4.798696517944336) | > loss_mel: 22.66655921936035 (20.526612281799316) | > loss_duration: 3.2273263931274414 (3.4000216722488403) | > loss_1: 41.5859260559082 (36.185261726379395)  --> STEP: 3 | > loss_disc: 2.5013372898101807 (2.8334654172261557) | > loss_disc_real_0: 0.05524790659546852 (0.1426918072005113) | > loss_disc_real_1: 0.19845470786094666 (0.26601331929365796) | > loss_disc_real_2: 0.24169720709323883 (0.26258904735247296) | > loss_disc_real_3: 0.183792844414711 (0.24435459077358246) | > loss_disc_real_4: 0.14780259132385254 (0.20752112567424774) | > loss_disc_real_5: 0.2600307762622833 (0.28179874022801715) | > loss_0: 2.5013372898101807 (2.8334654172261557) | > loss_gen: 2.374079465866089 (1.9927645126978557) | > loss_kl: 2.5421321392059326 (4.61926007270813) | > loss_feat: 8.265549659729004 (5.954314231872559) | > loss_mel: 22.078371047973633 (21.043865203857422) | > loss_duration: 2.996500253677368 (3.265514532725016) | > loss_1: 38.25663757324219 (36.87572034200033) --> EVAL PERFORMANCE | > avg_loader_time: 0.020212809244791668 (+0.013804753621419273) | > avg_loss_disc: 2.8334654172261557 (-0.14300862948099757) | > avg_loss_disc_real_0: 0.1426918072005113 (-0.17459033305446306) | > avg_loss_disc_real_1: 0.26601331929365796 (+0.013498942057291685) | > avg_loss_disc_real_2: 0.26258904735247296 (-0.07549872001012164) | > avg_loss_disc_real_3: 0.24435459077358246 (-0.07917387783527374) | > avg_loss_disc_real_4: 0.20752112567424774 (-0.041977574427922576) | > avg_loss_disc_real_5: 0.28179874022801715 (-0.0674575765927633) | > avg_loss_0: 2.8334654172261557 (-0.14300862948099757) | > avg_loss_gen: 1.9927645126978557 (-0.26280407110850024) | > avg_loss_kl: 4.61926007270813 (-0.07945426305135062) | > avg_loss_feat: 5.954314231872559 (+1.014398256937663) | > avg_loss_mel: 21.043865203857422 (+0.3165022532145194) | > avg_loss_duration: 3.265514532725016 (+0.02715611457824707) | > avg_loss_1: 36.87572034200033 (+1.0157998402913435)  > EPOCH: 1224/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:37:05)   --> TIME: 2023-10-20 15:37:16 -- STEP: 9/50 -- GLOBAL_STEP: 114210 | > loss_disc: 2.4935519695281982 (2.594276507695516) | > loss_disc_real_0: 0.22190551459789276 (0.11459659991992845) | > loss_disc_real_1: 0.3011513650417328 (0.23001184314489365) | > loss_disc_real_2: 0.2980538010597229 (0.23145473044779566) | > loss_disc_real_3: 0.3584962487220764 (0.2289224945836597) | > loss_disc_real_4: 0.3408086895942688 (0.2511280868202448) | > loss_disc_real_5: 0.30780160427093506 (0.2654124987311661) | > loss_0: 2.4935519695281982 (2.594276507695516) | > grad_norm_0: tensor(737.8188, device='cuda:0') (tensor(460.6440, device='cuda:0')) | > loss_gen: 3.073716402053833 (2.247890181011624) | > loss_kl: 0.3976244628429413 (0.7461065219508277) | > loss_feat: 4.799343109130859 (5.70349914001094) | > loss_mel: 21.650766372680664 (18.339975621965195) | > loss_duration: 1.300329327583313 (1.335451775126987) | > loss_1: 31.22178077697754 (28.372922791375053) | > grad_norm_1: tensor(19273.2402, device='cuda:0') (tensor(24428.5840, device='cuda:0')) | > current_lr_0: 5.8805821797916125e-05 | > current_lr_1: 5.886466071177618e-05 | > step_time: 0.4699 (0.6647786034478081) | > loader_time: 0.005 (0.019749800364176433)  --> TIME: 2023-10-20 15:37:35 -- STEP: 39/50 -- GLOBAL_STEP: 114240 | > loss_disc: 2.9724037647247314 (2.414109716048607) | > loss_disc_real_0: 0.19372262060642242 (0.13212402475376922) | > loss_disc_real_1: 0.2851799428462982 (0.22080499755266386) | > loss_disc_real_2: 0.2663109004497528 (0.22286178525059652) | > loss_disc_real_3: 0.24868261814117432 (0.22905759542034224) | > loss_disc_real_4: 0.270541787147522 (0.23566499796624363) | > loss_disc_real_5: 0.2671854496002197 (0.23051665490493173) | > loss_0: 2.9724037647247314 (2.414109716048607) | > grad_norm_0: tensor(1501.5427, device='cuda:0') (tensor(615.0939, device='cuda:0')) | > loss_gen: 1.5856739282608032 (2.3466855440384298) | > loss_kl: 0.3089468777179718 (0.8024466442756163) | > loss_feat: 0.32220950722694397 (5.7180037307433595) | > loss_mel: 5.540936470031738 (19.9462082141485) | > loss_duration: 1.3946603536605835 (1.3287879106325984) | > loss_1: 9.152426719665527 (30.14213214776455) | > grad_norm_1: tensor(23056.7832, device='cuda:0') (tensor(18237.5859, device='cuda:0')) | > current_lr_0: 5.8805821797916125e-05 | > current_lr_1: 5.886466071177618e-05 | > step_time: 0.2572 (0.6180837826851087) | > loader_time: 0.0022 (0.020247972928560697)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2282819747924805 (3.2282819747924805) | > loss_disc_real_0: 0.1382235288619995 (0.1382235288619995) | > loss_disc_real_1: 0.2915344536304474 (0.2915344536304474) | > loss_disc_real_2: 0.18151096999645233 (0.18151096999645233) | > loss_disc_real_3: 0.44781509041786194 (0.44781509041786194) | > loss_disc_real_4: 0.19693045318126678 (0.19693045318126678) | > loss_disc_real_5: 0.18930822610855103 (0.18930822610855103) | > loss_0: 3.2282819747924805 (3.2282819747924805) | > loss_gen: 1.7203669548034668 (1.7203669548034668) | > loss_kl: 6.929418087005615 (6.929418087005615) | > loss_feat: 8.63626480102539 (8.63626480102539) | > loss_mel: 23.372787475585938 (23.372787475585938) | > loss_duration: 3.103407144546509 (3.103407144546509) | > loss_1: 43.762245178222656 (43.762245178222656)  --> STEP: 1 | > loss_disc: 1.6219909191131592 (1.6219909191131592) | > loss_disc_real_0: 0.07765953987836838 (0.07765953987836838) | > loss_disc_real_1: 0.05090595781803131 (0.05090595781803131) | > loss_disc_real_2: 0.08452462404966354 (0.08452462404966354) | > loss_disc_real_3: 0.08107320964336395 (0.08107320964336395) | > loss_disc_real_4: 0.08284992724657059 (0.08284992724657059) | > loss_disc_real_5: 0.019184766337275505 (0.019184766337275505) | > loss_0: 1.6219909191131592 (1.6219909191131592) | > loss_gen: 2.138805389404297 (2.138805389404297) | > loss_kl: 5.6399149894714355 (5.6399149894714355) | > loss_feat: 13.764108657836914 (13.764108657836914) | > loss_mel: 26.55158042907715 (26.55158042907715) | > loss_duration: 3.4927992820739746 (3.4927992820739746) | > loss_1: 51.58720779418945 (51.58720779418945)  --> STEP: 2 | > loss_disc: 2.7514662742614746 (2.186728596687317) | > loss_disc_real_0: 0.30824559926986694 (0.19295256957411766) | > loss_disc_real_1: 0.3398730158805847 (0.19538948684930801) | > loss_disc_real_2: 0.28553247451782227 (0.1850285492837429) | > loss_disc_real_3: 0.2448704093694687 (0.16297180950641632) | > loss_disc_real_4: 0.18131637573242188 (0.13208315148949623) | > loss_disc_real_5: 0.20728275179862976 (0.11323375906795263) | > loss_0: 2.7514662742614746 (2.186728596687317) | > loss_gen: 2.505453586578369 (2.322129487991333) | > loss_kl: 6.116763591766357 (5.8783392906188965) | > loss_feat: 10.404485702514648 (12.084297180175781) | > loss_mel: 23.974206924438477 (25.262893676757812) | > loss_duration: 3.293377161026001 (3.393088221549988) | > loss_1: 46.294288635253906 (48.94074821472168)  --> STEP: 3 | > loss_disc: 2.986882448196411 (2.453446547190348) | > loss_disc_real_0: 0.23197200894355774 (0.20595904936393103) | > loss_disc_real_1: 0.271994948387146 (0.220924640695254) | > loss_disc_real_2: 0.26678869128227234 (0.21228192994991937) | > loss_disc_real_3: 0.2752053439617157 (0.20038298765818277) | > loss_disc_real_4: 0.26520735025405884 (0.1764578844110171) | > loss_disc_real_5: 0.298930287361145 (0.1751326018323501) | > loss_0: 2.986882448196411 (2.453446547190348) | > loss_gen: 1.6351898908615112 (2.0931496222813926) | > loss_kl: 2.5473618507385254 (4.7680134773254395) | > loss_feat: 0.07519115507602692 (8.081261838475863) | > loss_mel: 2.1756489276885986 (17.567145427068073) | > loss_duration: 3.0980865955352783 (3.2947543462117515) | > loss_1: 9.531478881835938 (35.804325103759766) --> EVAL PERFORMANCE | > avg_loader_time: 0.00337068239847819 (-0.016842126846313477) | > avg_loss_disc: 2.453446547190348 (-0.3800188700358076) | > avg_loss_disc_real_0: 0.20595904936393103 (+0.06326724216341972) | > avg_loss_disc_real_1: 0.220924640695254 (-0.04508867859840396) | > avg_loss_disc_real_2: 0.21228192994991937 (-0.050307117402553586) | > avg_loss_disc_real_3: 0.20038298765818277 (-0.04397160311539969) | > avg_loss_disc_real_4: 0.1764578844110171 (-0.03106324126323065) | > avg_loss_disc_real_5: 0.1751326018323501 (-0.10666613839566705) | > avg_loss_0: 2.453446547190348 (-0.3800188700358076) | > avg_loss_gen: 2.0931496222813926 (+0.10038510958353686) | > avg_loss_kl: 4.7680134773254395 (+0.14875340461730957) | > avg_loss_feat: 8.081261838475863 (+2.126947606603304) | > avg_loss_mel: 17.567145427068073 (-3.4767197767893485) | > avg_loss_duration: 3.2947543462117515 (+0.029239813486735322) | > avg_loss_1: 35.804325103759766 (-1.0713952382405623)  > EPOCH: 1225/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:37:57)   --> TIME: 2023-10-20 15:38:12 -- STEP: 19/50 -- GLOBAL_STEP: 114270 | > loss_disc: 2.229463577270508 (2.3240206116124202) | > loss_disc_real_0: 0.033246345818042755 (0.11384702939540148) | > loss_disc_real_1: 0.22120651602745056 (0.211319752429661) | > loss_disc_real_2: 0.2836613357067108 (0.1973183626603139) | > loss_disc_real_3: 0.33658382296562195 (0.20883809471208797) | > loss_disc_real_4: 0.12597274780273438 (0.20929851451594578) | > loss_disc_real_5: 0.22232586145401 (0.21266702288075498) | > loss_0: 2.229463577270508 (2.3240206116124202) | > grad_norm_0: tensor(461.4085, device='cuda:0') (tensor(601.6596, device='cuda:0')) | > loss_gen: 2.3986117839813232 (2.347087182496723) | > loss_kl: 0.7995176911354065 (0.7713759141532999) | > loss_feat: 6.094160556793213 (6.046094582661202) | > loss_mel: 21.928333282470703 (22.54193810412758) | > loss_duration: 1.3810532093048096 (1.3531121015548706) | > loss_1: 32.60167694091797 (33.05960805792557) | > grad_norm_1: tensor(15976.0400, device='cuda:0') (tensor(19568.6094, device='cuda:0')) | > current_lr_0: 5.874704169723434e-05 | > current_lr_1: 5.8805821797916125e-05 | > step_time: 0.6487 (0.5358371985586066) | > loader_time: 0.0082 (0.017250362195466693)  --> TIME: 2023-10-20 15:38:34 -- STEP: 49/50 -- GLOBAL_STEP: 114300 | > loss_disc: 2.6497960090637207 (2.465571984952811) | > loss_disc_real_0: 0.18726739287376404 (0.14087722885745518) | > loss_disc_real_1: 0.2525145709514618 (0.23248438065757557) | > loss_disc_real_2: 0.15568849444389343 (0.2210111765913209) | > loss_disc_real_3: 0.24660299718379974 (0.23289653373768135) | > loss_disc_real_4: 0.31120461225509644 (0.22924174349374918) | > loss_disc_real_5: 0.30959776043891907 (0.23345538844563524) | > loss_0: 2.6497960090637207 (2.465571984952811) | > grad_norm_0: tensor(741.8522, device='cuda:0') (tensor(627.2605, device='cuda:0')) | > loss_gen: 2.1508870124816895 (2.2470776815803677) | > loss_kl: 0.7618160843849182 (0.7053778195867733) | > loss_feat: 3.271789073944092 (5.132075347538505) | > loss_mel: 18.482879638671875 (20.572776784702224) | > loss_duration: 1.398876667022705 (1.3330851039107965) | > loss_1: 26.066247940063477 (29.990392821175718) | > grad_norm_1: tensor(4001.6794, device='cuda:0') (tensor(19120.6816, device='cuda:0')) | > current_lr_0: 5.874704169723434e-05 | > current_lr_1: 5.8805821797916125e-05 | > step_time: 0.4591 (0.6234697663054175) | > loader_time: 0.7583 (0.03644180297851562)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0590083599090576 (2.0590083599090576) | > loss_disc_real_0: 0.09805940091609955 (0.09805940091609955) | > loss_disc_real_1: 0.07989279925823212 (0.07989279925823212) | > loss_disc_real_2: 0.09941676259040833 (0.09941676259040833) | > loss_disc_real_3: 0.04724428430199623 (0.04724428430199623) | > loss_disc_real_4: 0.05559821426868439 (0.05559821426868439) | > loss_disc_real_5: 0.1585911512374878 (0.1585911512374878) | > loss_0: 2.0590083599090576 (2.0590083599090576) | > loss_gen: 1.7578359842300415 (1.7578359842300415) | > loss_kl: 5.844986915588379 (5.844986915588379) | > loss_feat: 11.657139778137207 (11.657139778137207) | > loss_mel: 23.715038299560547 (23.715038299560547) | > loss_duration: 3.1311047077178955 (3.1311047077178955) | > loss_1: 46.106101989746094 (46.106101989746094)  --> STEP: 1 | > loss_disc: 2.9125261306762695 (2.9125261306762695) | > loss_disc_real_0: 0.2279684841632843 (0.2279684841632843) | > loss_disc_real_1: 0.2615138590335846 (0.2615138590335846) | > loss_disc_real_2: 0.23366600275039673 (0.23366600275039673) | > loss_disc_real_3: 0.23792439699172974 (0.23792439699172974) | > loss_disc_real_4: 0.26115450263023376 (0.26115450263023376) | > loss_disc_real_5: 0.26141357421875 (0.26141357421875) | > loss_0: 2.9125261306762695 (2.9125261306762695) | > loss_gen: 1.5860973596572876 (1.5860973596572876) | > loss_kl: 5.516114711761475 (5.516114711761475) | > loss_feat: 0.22915278375148773 (0.22915278375148773) | > loss_mel: 10.864401817321777 (10.864401817321777) | > loss_duration: 3.5012412071228027 (3.5012412071228027) | > loss_1: 21.69700813293457 (21.69700813293457)  --> STEP: 2 | > loss_disc: 1.2165359258651733 (2.0645310282707214) | > loss_disc_real_0: 0.01263466291129589 (0.1203015735372901) | > loss_disc_real_1: 0.07836069166660309 (0.16993727535009384) | > loss_disc_real_2: 0.11210781335830688 (0.1728869080543518) | > loss_disc_real_3: 0.07755833864212036 (0.15774136781692505) | > loss_disc_real_4: 0.036065246909856796 (0.14860987477004528) | > loss_disc_real_5: 0.02130127139389515 (0.14135742280632257) | > loss_0: 1.2165359258651733 (2.0645310282707214) | > loss_gen: 3.0723729133605957 (2.3292351365089417) | > loss_kl: 5.725143909454346 (5.62062931060791) | > loss_feat: 11.32172679901123 (5.775439791381359) | > loss_mel: 24.890432357788086 (17.87741708755493) | > loss_duration: 3.2428810596466064 (3.3720611333847046) | > loss_1: 48.25255584716797 (34.97478199005127)  --> STEP: 3 | > loss_disc: 3.2902493476867676 (2.4731038014094033) | > loss_disc_real_0: 0.1501034051179886 (0.13023551739752293) | > loss_disc_real_1: 0.2146758735179901 (0.18485014140605927) | > loss_disc_real_2: 0.31340640783309937 (0.21972674131393433) | > loss_disc_real_3: 0.18430794775485992 (0.16659689446290335) | > loss_disc_real_4: 0.2062435895204544 (0.16782111302018166) | > loss_disc_real_5: 0.26698803901672363 (0.18323429487645626) | > loss_0: 3.2902493476867676 (2.4731038014094033) | > loss_gen: 1.3833945989608765 (2.0139549573262534) | > loss_kl: 2.868568181991577 (4.703275601069133) | > loss_feat: 6.260084629058838 (5.936988070607185) | > loss_mel: 20.66785430908203 (18.807562828063965) | > loss_duration: 3.035646438598633 (3.259922901789347) | > loss_1: 34.215545654296875 (34.72170321146647) --> EVAL PERFORMANCE | > avg_loader_time: 0.002004702885945638 (-0.0013659795125325518) | > avg_loss_disc: 2.4731038014094033 (+0.019657254219055176) | > avg_loss_disc_real_0: 0.13023551739752293 (-0.0757235319664081) | > avg_loss_disc_real_1: 0.18485014140605927 (-0.036074499289194734) | > avg_loss_disc_real_2: 0.21972674131393433 (+0.007444811364014953) | > avg_loss_disc_real_3: 0.16659689446290335 (-0.03378609319527942) | > avg_loss_disc_real_4: 0.16782111302018166 (-0.008636771390835435) | > avg_loss_disc_real_5: 0.18323429487645626 (+0.008101693044106156) | > avg_loss_0: 2.4731038014094033 (+0.019657254219055176) | > avg_loss_gen: 2.0139549573262534 (-0.07919466495513916) | > avg_loss_kl: 4.703275601069133 (-0.06473787625630667) | > avg_loss_feat: 5.936988070607185 (-2.144273767868677) | > avg_loss_mel: 18.807562828063965 (+1.2404174009958915) | > avg_loss_duration: 3.259922901789347 (-0.03483144442240427) | > avg_loss_1: 34.72170321146647 (-1.0826218922932966)  > EPOCH: 1226/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:38:48)   --> TIME: 2023-10-20 15:39:12 -- STEP: 29/50 -- GLOBAL_STEP: 114330 | > loss_disc: 2.313511610031128 (2.5154606884923476) | > loss_disc_real_0: 0.14130175113677979 (0.14307093299154577) | > loss_disc_real_1: 0.24487917125225067 (0.2288502960883338) | > loss_disc_real_2: 0.16825690865516663 (0.240318663418293) | > loss_disc_real_3: 0.3088985085487366 (0.22235094755887985) | > loss_disc_real_4: 0.20932698249816895 (0.21565893163968777) | > loss_disc_real_5: 0.08849101513624191 (0.21277217721116953) | > loss_0: 2.313511610031128 (2.5154606884923476) | > grad_norm_0: tensor(433.8553, device='cuda:0') (tensor(525.5082, device='cuda:0')) | > loss_gen: 2.2484636306762695 (2.15196248991736) | > loss_kl: 0.9286717176437378 (0.8182915315545839) | > loss_feat: 5.438011169433594 (5.452183409240739) | > loss_mel: 23.772876739501953 (18.12525638218584) | > loss_duration: 1.3284798860549927 (1.3288058576912716) | > loss_1: 33.71650314331055 (27.876500244798333) | > grad_norm_1: tensor(7310.5146, device='cuda:0') (tensor(23443.6953, device='cuda:0')) | > current_lr_0: 5.868832035094338e-05 | > current_lr_1: 5.874704169723434e-05 | > step_time: 0.4746 (0.6115514574379757) | > loader_time: 0.0258 (0.022029621847744645)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.842322826385498 (2.842322826385498) | > loss_disc_real_0: 0.39074936509132385 (0.39074936509132385) | > loss_disc_real_1: 0.4206439256668091 (0.4206439256668091) | > loss_disc_real_2: 0.24936868250370026 (0.24936868250370026) | > loss_disc_real_3: 0.33800777792930603 (0.33800777792930603) | > loss_disc_real_4: 0.2505715489387512 (0.2505715489387512) | > loss_disc_real_5: 0.303223192691803 (0.303223192691803) | > loss_0: 2.842322826385498 (2.842322826385498) | > loss_gen: 2.511922836303711 (2.511922836303711) | > loss_kl: 5.470698356628418 (5.470698356628418) | > loss_feat: 5.484230995178223 (5.484230995178223) | > loss_mel: 20.67218017578125 (20.67218017578125) | > loss_duration: 3.044321298599243 (3.044321298599243) | > loss_1: 37.183353424072266 (37.183353424072266)  --> STEP: 1 | > loss_disc: 2.957078456878662 (2.957078456878662) | > loss_disc_real_0: 0.29580414295196533 (0.29580414295196533) | > loss_disc_real_1: 0.30173906683921814 (0.30173906683921814) | > loss_disc_real_2: 0.23343847692012787 (0.23343847692012787) | > loss_disc_real_3: 0.3422059416770935 (0.3422059416770935) | > loss_disc_real_4: 0.3346678614616394 (0.3346678614616394) | > loss_disc_real_5: 0.21992824971675873 (0.21992824971675873) | > loss_0: 2.957078456878662 (2.957078456878662) | > loss_gen: 2.8431618213653564 (2.8431618213653564) | > loss_kl: 5.906000137329102 (5.906000137329102) | > loss_feat: 7.207993507385254 (7.207993507385254) | > loss_mel: 27.155269622802734 (27.155269622802734) | > loss_duration: 3.6718862056732178 (3.6718862056732178) | > loss_1: 46.7843132019043 (46.7843132019043)  --> STEP: 2 | > loss_disc: 2.2072274684906006 (2.5821529626846313) | > loss_disc_real_0: 0.23010335862636566 (0.2629537507891655) | > loss_disc_real_1: 0.2909734845161438 (0.29635627567768097) | > loss_disc_real_2: 0.1503780633211136 (0.19190827012062073) | > loss_disc_real_3: 0.2515025734901428 (0.29685425758361816) | > loss_disc_real_4: 0.29522499442100525 (0.3149464279413223) | > loss_disc_real_5: 0.09835529327392578 (0.15914177149534225) | > loss_0: 2.2072274684906006 (2.5821529626846313) | > loss_gen: 2.7719080448150635 (2.80753493309021) | > loss_kl: 5.835977077484131 (5.870988607406616) | > loss_feat: 11.035072326660156 (9.121532917022705) | > loss_mel: 24.1024112701416 (25.628840446472168) | > loss_duration: 3.3295466899871826 (3.5007164478302) | > loss_1: 47.07491683959961 (46.92961502075195)  --> STEP: 3 | > loss_disc: 2.3170104026794434 (2.493772109349569) | > loss_disc_real_0: 0.2858947515487671 (0.27060075104236603) | > loss_disc_real_1: 0.359441876411438 (0.3173848092556) | > loss_disc_real_2: 0.2524275481700897 (0.21208136280377707) | > loss_disc_real_3: 0.22451752424240112 (0.27274201313654584) | > loss_disc_real_4: 0.29763761162757874 (0.3091768225034078) | > loss_disc_real_5: 0.10775542259216309 (0.14201298852761587) | > loss_0: 2.3170104026794434 (2.493772109349569) | > loss_gen: 2.9048635959625244 (2.839977820714315) | > loss_kl: 2.4230282306671143 (4.721668481826782) | > loss_feat: 6.224077224731445 (8.155714352925619) | > loss_mel: 21.506444931030273 (24.254708607991535) | > loss_duration: 3.084601879119873 (3.3620115915934243) | > loss_1: 36.14301681518555 (43.33408228556315) --> EVAL PERFORMANCE | > avg_loader_time: 0.018407185872395832 (+0.016402482986450195) | > avg_loss_disc: 2.493772109349569 (+0.020668307940165498) | > avg_loss_disc_real_0: 0.27060075104236603 (+0.1403652336448431) | > avg_loss_disc_real_1: 0.3173848092556 (+0.1325346678495407) | > avg_loss_disc_real_2: 0.21208136280377707 (-0.007645378510157258) | > avg_loss_disc_real_3: 0.27274201313654584 (+0.10614511867364249) | > avg_loss_disc_real_4: 0.3091768225034078 (+0.14135570948322612) | > avg_loss_disc_real_5: 0.14201298852761587 (-0.041221306348840386) | > avg_loss_0: 2.493772109349569 (+0.020668307940165498) | > avg_loss_gen: 2.839977820714315 (+0.8260228633880615) | > avg_loss_kl: 4.721668481826782 (+0.018392880757649444) | > avg_loss_feat: 8.155714352925619 (+2.2187262823184337) | > avg_loss_mel: 24.254708607991535 (+5.44714577992757) | > avg_loss_duration: 3.3620115915934243 (+0.10208868980407715) | > avg_loss_1: 43.33408228556315 (+8.61237907409668)  > EPOCH: 1227/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:39:41)   --> TIME: 2023-10-20 15:39:54 -- STEP: 9/50 -- GLOBAL_STEP: 114360 | > loss_disc: 2.950120687484741 (2.329030579990811) | > loss_disc_real_0: 0.17463421821594238 (0.14454560064607197) | > loss_disc_real_1: 0.23663270473480225 (0.22717483010556963) | > loss_disc_real_2: 0.2548460364341736 (0.21887214895751742) | > loss_disc_real_3: 0.2343205064535141 (0.22165407281782892) | > loss_disc_real_4: 0.2545710802078247 (0.2034648996260431) | > loss_disc_real_5: 0.26802298426628113 (0.17879175994959143) | > loss_0: 2.950120687484741 (2.329030579990811) | > grad_norm_0: tensor(681.8063, device='cuda:0') (tensor(769.8465, device='cuda:0')) | > loss_gen: 1.5242822170257568 (2.3125330607096353) | > loss_kl: 1.1585397720336914 (0.8329301012886895) | > loss_feat: 0.15183831751346588 (5.548287608557278) | > loss_mel: 7.3412041664123535 (16.90260401037004) | > loss_duration: 1.2883158922195435 (1.3528190586302016) | > loss_1: 11.464180946350098 (26.949174139234756) | > grad_norm_1: tensor(36146.6562, device='cuda:0') (tensor(21968.8203, device='cuda:0')) | > current_lr_0: 5.862965770031454e-05 | > current_lr_1: 5.868832035094338e-05 | > step_time: 0.4428 (0.6857933203379313) | > loader_time: 0.0239 (0.02935934066772461)  --> TIME: 2023-10-20 15:40:07 -- STEP: 39/50 -- GLOBAL_STEP: 114390 | > loss_disc: 3.2936272621154785 (2.5728853879830775) | > loss_disc_real_0: 0.08537888526916504 (0.1550139233422203) | > loss_disc_real_1: 0.17501793801784515 (0.22893623931285662) | > loss_disc_real_2: 0.3124184310436249 (0.22911747487691733) | > loss_disc_real_3: 0.19053171575069427 (0.2327953274242389) | > loss_disc_real_4: 0.1732492446899414 (0.22853080183267593) | > loss_disc_real_5: 0.14654980599880219 (0.22762140980324683) | > loss_0: 3.2936272621154785 (2.5728853879830775) | > grad_norm_0: tensor(1030.5845, device='cuda:0') (tensor(670.2967, device='cuda:0')) | > loss_gen: 1.5324862003326416 (2.0901894875061817) | > loss_kl: 0.7280930876731873 (0.7873364771023775) | > loss_feat: 5.580937385559082 (4.632940836441823) | > loss_mel: 22.97226905822754 (17.54630094002454) | > loss_duration: 1.3535279035568237 (1.3230964770683877) | > loss_1: 32.16731262207031 (26.3798644726093) | > grad_norm_1: tensor(12154.3320, device='cuda:0') (tensor(16447.7461, device='cuda:0')) | > current_lr_0: 5.862965770031454e-05 | > current_lr_1: 5.868832035094338e-05 | > step_time: 0.2576 (0.48410569093166256) | > loader_time: 0.0024 (0.014657919223491963)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.000916004180908 (3.000916004180908) | > loss_disc_real_0: 0.29877975583076477 (0.29877975583076477) | > loss_disc_real_1: 0.26164379715919495 (0.26164379715919495) | > loss_disc_real_2: 0.34363043308258057 (0.34363043308258057) | > loss_disc_real_3: 0.28439199924468994 (0.28439199924468994) | > loss_disc_real_4: 0.2888984680175781 (0.2888984680175781) | > loss_disc_real_5: 0.28307414054870605 (0.28307414054870605) | > loss_0: 3.000916004180908 (3.000916004180908) | > loss_gen: 1.7966046333312988 (1.7966046333312988) | > loss_kl: 5.6099724769592285 (5.6099724769592285) | > loss_feat: 0.0713069960474968 (0.0713069960474968) | > loss_mel: 5.884413242340088 (5.884413242340088) | > loss_duration: 3.042531967163086 (3.042531967163086) | > loss_1: 16.404829025268555 (16.404829025268555)  --> STEP: 1 | > loss_disc: 2.700939178466797 (2.700939178466797) | > loss_disc_real_0: 0.06038204953074455 (0.06038204953074455) | > loss_disc_real_1: 0.27087175846099854 (0.27087175846099854) | > loss_disc_real_2: 0.2583805322647095 (0.2583805322647095) | > loss_disc_real_3: 0.43106022477149963 (0.43106022477149963) | > loss_disc_real_4: 0.2989012897014618 (0.2989012897014618) | > loss_disc_real_5: 0.2765107750892639 (0.2765107750892639) | > loss_0: 2.700939178466797 (2.700939178466797) | > loss_gen: 2.137646198272705 (2.137646198272705) | > loss_kl: 6.1730499267578125 (6.1730499267578125) | > loss_feat: 7.094483852386475 (7.094483852386475) | > loss_mel: 22.384450912475586 (22.384450912475586) | > loss_duration: 3.4816360473632812 (3.4816360473632812) | > loss_1: 41.27126693725586 (41.27126693725586)  --> STEP: 2 | > loss_disc: 2.4138247966766357 (2.5573819875717163) | > loss_disc_real_0: 0.26572495698928833 (0.16305350326001644) | > loss_disc_real_1: 0.10549072921276093 (0.18818124383687973) | > loss_disc_real_2: 0.1940120905637741 (0.2261963114142418) | > loss_disc_real_3: 0.13358990848064423 (0.28232506662607193) | > loss_disc_real_4: 0.12138614058494568 (0.21014371514320374) | > loss_disc_real_5: 0.11240991204977036 (0.19446034356951714) | > loss_0: 2.4138247966766357 (2.5573819875717163) | > loss_gen: 1.892431616783142 (2.0150389075279236) | > loss_kl: 5.6554131507873535 (5.914231538772583) | > loss_feat: 12.53003215789795 (9.812258005142212) | > loss_mel: 21.956851959228516 (22.17065143585205) | > loss_duration: 3.2521791458129883 (3.3669075965881348) | > loss_1: 45.28690719604492 (43.27908706665039)  --> STEP: 3 | > loss_disc: 2.1867547035217285 (2.4338395595550537) | > loss_disc_real_0: 0.4105674624443054 (0.2455581563214461) | > loss_disc_real_1: 0.2665402591228485 (0.21430091559886932) | > loss_disc_real_2: 0.2339775115251541 (0.2287900447845459) | > loss_disc_real_3: 0.17434297502040863 (0.24633103609085083) | > loss_disc_real_4: 0.12854911386966705 (0.1829455147186915) | > loss_disc_real_5: 0.10319649428129196 (0.16403906047344208) | > loss_0: 2.1867547035217285 (2.4338395595550537) | > loss_gen: 3.1026852130889893 (2.377587676048279) | > loss_kl: 2.900447130203247 (4.909636735916138) | > loss_feat: 6.984625339508057 (8.86971378326416) | > loss_mel: 23.19962501525879 (22.51364262898763) | > loss_duration: 3.120619773864746 (3.2848116556803384) | > loss_1: 39.30800247192383 (41.95539220174154) --> EVAL PERFORMANCE | > avg_loader_time: 0.0043837229410807295 (-0.014023462931315102) | > avg_loss_disc: 2.4338395595550537 (-0.05993254979451512) | > avg_loss_disc_real_0: 0.2455581563214461 (-0.025042594720919936) | > avg_loss_disc_real_1: 0.21430091559886932 (-0.10308389365673065) | > avg_loss_disc_real_2: 0.2287900447845459 (+0.01670868198076883) | > avg_loss_disc_real_3: 0.24633103609085083 (-0.026410977045695005) | > avg_loss_disc_real_4: 0.1829455147186915 (-0.12623130778471628) | > avg_loss_disc_real_5: 0.16403906047344208 (+0.022026071945826203) | > avg_loss_0: 2.4338395595550537 (-0.05993254979451512) | > avg_loss_gen: 2.377587676048279 (-0.4623901446660361) | > avg_loss_kl: 4.909636735916138 (+0.18796825408935547) | > avg_loss_feat: 8.86971378326416 (+0.7139994303385411) | > avg_loss_mel: 22.51364262898763 (-1.7410659790039062) | > avg_loss_duration: 3.2848116556803384 (-0.07719993591308594) | > avg_loss_1: 41.95539220174154 (-1.3786900838216098)  > EPOCH: 1228/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:40:26)   --> TIME: 2023-10-20 15:40:44 -- STEP: 19/50 -- GLOBAL_STEP: 114420 | > loss_disc: 2.8484559059143066 (2.324258703934519) | > loss_disc_real_0: 0.26789355278015137 (0.14433809722724714) | > loss_disc_real_1: 0.2581508457660675 (0.2214215154710569) | > loss_disc_real_2: 0.2639375925064087 (0.243550724300899) | > loss_disc_real_3: 0.2540033757686615 (0.24405232934575333) | > loss_disc_real_4: 0.34404975175857544 (0.22969350326610238) | > loss_disc_real_5: 0.3157728612422943 (0.23060226886484184) | > loss_0: 2.8484559059143066 (2.324258703934519) | > grad_norm_0: tensor(489.9758, device='cuda:0') (tensor(520.2046, device='cuda:0')) | > loss_gen: 1.9359725713729858 (2.5004009071149325) | > loss_kl: 0.895989716053009 (0.7817056931947407) | > loss_feat: 1.8093501329421997 (6.207575892147265) | > loss_mel: 18.641977310180664 (21.176040197673597) | > loss_duration: 1.4487189054489136 (1.3704535961151123) | > loss_1: 24.73200798034668 (32.03617572784424) | > grad_norm_1: tensor(6914.2241, device='cuda:0') (tensor(24221.6191, device='cuda:0')) | > current_lr_0: 5.857105368667783e-05 | > current_lr_1: 5.862965770031454e-05 | > step_time: 0.4942 (0.6371602133700722) | > loader_time: 0.0401 (0.022216759229961195)  --> TIME: 2023-10-20 15:41:04 -- STEP: 49/50 -- GLOBAL_STEP: 114450 | > loss_disc: 2.4763412475585938 (2.460981342257285) | > loss_disc_real_0: 0.138779416680336 (0.14352176108454562) | > loss_disc_real_1: 0.21262513101100922 (0.2214982401655645) | > loss_disc_real_2: 0.2363843470811844 (0.23133038098410685) | > loss_disc_real_3: 0.24819333851337433 (0.23540541020279027) | > loss_disc_real_4: 0.3147111237049103 (0.24152178518778208) | > loss_disc_real_5: 0.3086216449737549 (0.22715854357775986) | > loss_0: 2.4763412475585938 (2.460981342257285) | > grad_norm_0: tensor(581.7054, device='cuda:0') (tensor(561.8799, device='cuda:0')) | > loss_gen: 2.374660015106201 (2.2584683773468965) | > loss_kl: 0.4542698562145233 (0.7570474590269887) | > loss_feat: 3.3636393547058105 (5.322180083895824) | > loss_mel: 21.203022003173828 (20.178874210435517) | > loss_duration: 1.4252209663391113 (1.3362704418143447) | > loss_1: 28.820812225341797 (29.85284048197221) | > grad_norm_1: tensor(4052.1902, device='cuda:0') (tensor(16697.8262, device='cuda:0')) | > current_lr_0: 5.857105368667783e-05 | > current_lr_1: 5.862965770031454e-05 | > step_time: 0.358 (0.6472344593125947) | > loader_time: 0.4208 (0.028863585725122563)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.269369602203369 (2.269369602203369) | > loss_disc_real_0: 0.12313808500766754 (0.12313808500766754) | > loss_disc_real_1: 0.21667450666427612 (0.21667450666427612) | > loss_disc_real_2: 0.1335640251636505 (0.1335640251636505) | > loss_disc_real_3: 0.16261860728263855 (0.16261860728263855) | > loss_disc_real_4: 0.13222217559814453 (0.13222217559814453) | > loss_disc_real_5: 0.063736192882061 (0.063736192882061) | > loss_0: 2.269369602203369 (2.269369602203369) | > loss_gen: 2.2692997455596924 (2.2692997455596924) | > loss_kl: 6.849668979644775 (6.849668979644775) | > loss_feat: 11.36818790435791 (11.36818790435791) | > loss_mel: 23.006916046142578 (23.006916046142578) | > loss_duration: 3.159313201904297 (3.159313201904297) | > loss_1: 46.653385162353516 (46.653385162353516)  --> STEP: 1 | > loss_disc: 2.7178192138671875 (2.7178192138671875) | > loss_disc_real_0: 0.17289000749588013 (0.17289000749588013) | > loss_disc_real_1: 0.2506750822067261 (0.2506750822067261) | > loss_disc_real_2: 0.19258439540863037 (0.19258439540863037) | > loss_disc_real_3: 0.21907928586006165 (0.21907928586006165) | > loss_disc_real_4: 0.24780623614788055 (0.24780623614788055) | > loss_disc_real_5: 0.20135122537612915 (0.20135122537612915) | > loss_0: 2.7178192138671875 (2.7178192138671875) | > loss_gen: 1.7391283512115479 (1.7391283512115479) | > loss_kl: 5.86614990234375 (5.86614990234375) | > loss_feat: 1.5401921272277832 (1.5401921272277832) | > loss_mel: 16.60076332092285 (16.60076332092285) | > loss_duration: 3.683016538619995 (3.683016538619995) | > loss_1: 29.429248809814453 (29.429248809814453)  --> STEP: 2 | > loss_disc: 2.689758777618408 (2.703788995742798) | > loss_disc_real_0: 0.28352415561676025 (0.2282070815563202) | > loss_disc_real_1: 0.2775648236274719 (0.264119952917099) | > loss_disc_real_2: 0.22967956960201263 (0.2111319825053215) | > loss_disc_real_3: 0.3037952780723572 (0.2614372819662094) | > loss_disc_real_4: 0.22866037487983704 (0.2382333055138588) | > loss_disc_real_5: 0.30546948313713074 (0.25341035425662994) | > loss_0: 2.689758777618408 (2.703788995742798) | > loss_gen: 2.2509870529174805 (1.9950577020645142) | > loss_kl: 5.816012859344482 (5.841081380844116) | > loss_feat: 2.5728843212127686 (2.056538224220276) | > loss_mel: 24.437490463256836 (20.519126892089844) | > loss_duration: 3.213502883911133 (3.448259711265564) | > loss_1: 38.29087829589844 (33.860063552856445)  --> STEP: 3 | > loss_disc: 2.315863609313965 (2.5744805335998535) | > loss_disc_real_0: 0.04092520475387573 (0.1657797892888387) | > loss_disc_real_1: 0.27650535106658936 (0.26824841896692914) | > loss_disc_real_2: 0.20036114752292633 (0.20754170417785645) | > loss_disc_real_3: 0.3468588590621948 (0.28991114099820453) | > loss_disc_real_4: 0.17125201225280762 (0.21590620776017508) | > loss_disc_real_5: 0.19586288928985596 (0.23422786593437195) | > loss_0: 2.315863609313965 (2.5744805335998535) | > loss_gen: 2.2667179107666016 (2.08561110496521) | > loss_kl: 3.068915605545044 (4.917026122411092) | > loss_feat: 5.703250885009766 (3.272109111150106) | > loss_mel: 24.857988357543945 (21.96541404724121) | > loss_duration: 3.059321403503418 (3.318613608678182) | > loss_1: 38.95619583129883 (35.55877431233724) --> EVAL PERFORMANCE | > avg_loader_time: 0.005893548329671224 (+0.0015098253885904942) | > avg_loss_disc: 2.5744805335998535 (+0.1406409740447998) | > avg_loss_disc_real_0: 0.1657797892888387 (-0.07977836703260738) | > avg_loss_disc_real_1: 0.26824841896692914 (+0.05394750336805981) | > avg_loss_disc_real_2: 0.20754170417785645 (-0.021248340606689453) | > avg_loss_disc_real_3: 0.28991114099820453 (+0.0435801049073537) | > avg_loss_disc_real_4: 0.21590620776017508 (+0.03296069304148358) | > avg_loss_disc_real_5: 0.23422786593437195 (+0.07018880546092987) | > avg_loss_0: 2.5744805335998535 (+0.1406409740447998) | > avg_loss_gen: 2.08561110496521 (-0.29197657108306885) | > avg_loss_kl: 4.917026122411092 (+0.007389386494954131) | > avg_loss_feat: 3.272109111150106 (-5.597604672114054) | > avg_loss_mel: 21.96541404724121 (-0.5482285817464181) | > avg_loss_duration: 3.318613608678182 (+0.03380195299784372) | > avg_loss_1: 35.55877431233724 (-6.396617889404297)  > EPOCH: 1229/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:41:21)   --> TIME: 2023-10-20 15:41:45 -- STEP: 29/50 -- GLOBAL_STEP: 114480 | > loss_disc: 2.6777257919311523 (2.356227973411823) | > loss_disc_real_0: 0.11637651175260544 (0.12215412485188452) | > loss_disc_real_1: 0.2795988619327545 (0.22207729312880287) | > loss_disc_real_2: 0.2612517178058624 (0.21259499726624326) | > loss_disc_real_3: 0.23911231756210327 (0.21951075155159522) | > loss_disc_real_4: 0.27448371052742004 (0.20918270309680495) | > loss_disc_real_5: 0.280940979719162 (0.18410155267037195) | > loss_0: 2.6777257919311523 (2.356227973411823) | > grad_norm_0: tensor(835.2717, device='cuda:0') (tensor(580.1503, device='cuda:0')) | > loss_gen: 1.9153488874435425 (2.3264401328974755) | > loss_kl: 0.9075649976730347 (0.7827608811444251) | > loss_feat: 1.6388740539550781 (6.4574736821111935) | > loss_mel: 15.80032730102539 (21.40548845817303) | > loss_duration: 1.3257564306259155 (1.3322132455891575) | > loss_1: 21.587871551513672 (32.30437604312239) | > grad_norm_1: tensor(5002.5757, device='cuda:0') (tensor(23028.5449, device='cuda:0')) | > current_lr_0: 5.851250825142191e-05 | > current_lr_1: 5.857105368667783e-05 | > step_time: 0.3528 (0.5564060786674762) | > loader_time: 0.012 (0.01660792580966292)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9132237434387207 (2.9132237434387207) | > loss_disc_real_0: 0.3618515729904175 (0.3618515729904175) | > loss_disc_real_1: 0.23493976891040802 (0.23493976891040802) | > loss_disc_real_2: 0.35941585898399353 (0.35941585898399353) | > loss_disc_real_3: 0.23536114394664764 (0.23536114394664764) | > loss_disc_real_4: 0.27399036288261414 (0.27399036288261414) | > loss_disc_real_5: 0.3101409375667572 (0.3101409375667572) | > loss_0: 2.9132237434387207 (2.9132237434387207) | > loss_gen: 2.1488780975341797 (2.1488780975341797) | > loss_kl: 5.721718788146973 (5.721718788146973) | > loss_feat: 3.5228052139282227 (3.5228052139282227) | > loss_mel: 23.31949806213379 (23.31949806213379) | > loss_duration: 3.0421500205993652 (3.0421500205993652) | > loss_1: 37.75504684448242 (37.75504684448242)  --> STEP: 1 | > loss_disc: 2.8693270683288574 (2.8693270683288574) | > loss_disc_real_0: 0.2884379029273987 (0.2884379029273987) | > loss_disc_real_1: 0.2674013078212738 (0.2674013078212738) | > loss_disc_real_2: 0.26401785016059875 (0.26401785016059875) | > loss_disc_real_3: 0.23420560359954834 (0.23420560359954834) | > loss_disc_real_4: 0.27912306785583496 (0.27912306785583496) | > loss_disc_real_5: 0.3127947747707367 (0.3127947747707367) | > loss_0: 2.8693270683288574 (2.8693270683288574) | > loss_gen: 1.8882701396942139 (1.8882701396942139) | > loss_kl: 5.662994861602783 (5.662994861602783) | > loss_feat: 1.1203967332839966 (1.1203967332839966) | > loss_mel: 17.014610290527344 (17.014610290527344) | > loss_duration: 3.4140472412109375 (3.4140472412109375) | > loss_1: 29.100318908691406 (29.100318908691406)  --> STEP: 2 | > loss_disc: 2.5720505714416504 (2.720688819885254) | > loss_disc_real_0: 0.09957653284072876 (0.19400721788406372) | > loss_disc_real_1: 0.14957192540168762 (0.2084866166114807) | > loss_disc_real_2: 0.12205775082111359 (0.19303780049085617) | > loss_disc_real_3: 0.06721683591604233 (0.15071121975779533) | > loss_disc_real_4: 0.04372134059667587 (0.16142220422625542) | > loss_disc_real_5: 0.019981812685728073 (0.16638829372823238) | > loss_0: 2.5720505714416504 (2.720688819885254) | > loss_gen: 1.3277193307876587 (1.6079947352409363) | > loss_kl: 6.373265743255615 (6.018130302429199) | > loss_feat: 10.375494956970215 (5.747945845127106) | > loss_mel: 26.572357177734375 (21.79348373413086) | > loss_duration: 3.4468955993652344 (3.430471420288086) | > loss_1: 48.095733642578125 (38.598026275634766)  --> STEP: 3 | > loss_disc: 2.785599708557129 (2.742325782775879) | > loss_disc_real_0: 0.26383766531944275 (0.21728403369585672) | > loss_disc_real_1: 0.350318968296051 (0.25576406717300415) | > loss_disc_real_2: 0.36201316118240356 (0.24936292072137198) | > loss_disc_real_3: 0.3057253658771515 (0.20238260179758072) | > loss_disc_real_4: 0.2123561054468155 (0.17840017129977545) | > loss_disc_real_5: 0.35542580485343933 (0.2294007974366347) | > loss_0: 2.785599708557129 (2.742325782775879) | > loss_gen: 2.6347765922546387 (1.9502553542455037) | > loss_kl: 2.6486287117004395 (4.894963105519612) | > loss_feat: 3.567657470703125 (5.021183053652446) | > loss_mel: 23.459264755249023 (22.348744074503582) | > loss_duration: 3.0643258094787598 (3.308422883351644) | > loss_1: 35.37465286254883 (37.52356847127279) --> EVAL PERFORMANCE | > avg_loader_time: 0.013587077458699545 (+0.007693529129028321) | > avg_loss_disc: 2.742325782775879 (+0.1678452491760254) | > avg_loss_disc_real_0: 0.21728403369585672 (+0.05150424440701801) | > avg_loss_disc_real_1: 0.25576406717300415 (-0.012484351793924986) | > avg_loss_disc_real_2: 0.24936292072137198 (+0.04182121654351553) | > avg_loss_disc_real_3: 0.20238260179758072 (-0.08752853920062381) | > avg_loss_disc_real_4: 0.17840017129977545 (-0.03750603646039963) | > avg_loss_disc_real_5: 0.2294007974366347 (-0.004827068497737258) | > avg_loss_0: 2.742325782775879 (+0.1678452491760254) | > avg_loss_gen: 1.9502553542455037 (-0.1353557507197063) | > avg_loss_kl: 4.894963105519612 (-0.022063016891479492) | > avg_loss_feat: 5.021183053652446 (+1.7490739425023398) | > avg_loss_mel: 22.348744074503582 (+0.383330027262371) | > avg_loss_duration: 3.308422883351644 (-0.010190725326538086) | > avg_loss_1: 37.52356847127279 (+1.9647941589355469)  > EPOCH: 1230/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:42:06)   --> TIME: 2023-10-20 15:42:18 -- STEP: 9/50 -- GLOBAL_STEP: 114510 | > loss_disc: 1.8463623523712158 (2.018089903725518) | > loss_disc_real_0: 0.046515338122844696 (0.10748674244516426) | > loss_disc_real_1: 0.17415548861026764 (0.18119455460045072) | > loss_disc_real_2: 0.2359180897474289 (0.1551100860039393) | > loss_disc_real_3: 0.28262585401535034 (0.15990682401590878) | > loss_disc_real_4: 0.22759908437728882 (0.14005329294337165) | > loss_disc_real_5: 0.23325729370117188 (0.13708128904302916) | > loss_0: 1.8463623523712158 (2.018089903725518) | > grad_norm_0: tensor(348.9637, device='cuda:0') (tensor(558.5374, device='cuda:0')) | > loss_gen: 3.0015313625335693 (2.5296630329555936) | > loss_kl: 0.4397454559803009 (0.7565328213903639) | > loss_feat: 7.647093296051025 (8.417966630723742) | > loss_mel: 23.095006942749023 (23.18255615234375) | > loss_duration: 1.292037010192871 (1.3152548869450886) | > loss_1: 35.47541427612305 (36.20197402106391) | > grad_norm_1: tensor(5958.2822, device='cuda:0') (tensor(35676.1562, device='cuda:0')) | > current_lr_0: 5.845402133599403e-05 | > current_lr_1: 5.851250825142191e-05 | > step_time: 0.4009 (0.6092430485619439) | > loader_time: 0.0099 (0.021802637312147353)  --> TIME: 2023-10-20 15:42:38 -- STEP: 39/50 -- GLOBAL_STEP: 114540 | > loss_disc: 2.990995168685913 (2.391810693801977) | > loss_disc_real_0: 0.25860676169395447 (0.1387581337386599) | > loss_disc_real_1: 0.2738024890422821 (0.21610479152355438) | > loss_disc_real_2: 0.2749968469142914 (0.21636565125141388) | > loss_disc_real_3: 0.26491791009902954 (0.23980272847872514) | > loss_disc_real_4: 0.27458319067955017 (0.2106861976476816) | > loss_disc_real_5: 0.28398510813713074 (0.24100852330239156) | > loss_0: 2.990995168685913 (2.391810693801977) | > grad_norm_0: tensor(307.9408, device='cuda:0') (tensor(597.8869, device='cuda:0')) | > loss_gen: 1.6324201822280884 (2.3442050279715123) | > loss_kl: 0.6609828472137451 (0.7609309523533552) | > loss_feat: 0.05369676277041435 (6.224019888024301) | > loss_mel: 3.9566938877105713 (21.015828872338318) | > loss_duration: 1.327579379081726 (1.3214657581769502) | > loss_1: 7.631372928619385 (31.666450708340374) | > grad_norm_1: tensor(52911.9023, device='cuda:0') (tensor(26891.2441, device='cuda:0')) | > current_lr_0: 5.845402133599403e-05 | > current_lr_1: 5.851250825142191e-05 | > step_time: 0.4162 (0.6288827015803411) | > loader_time: 0.0058 (0.024009515077639848)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9153974056243896 (2.9153974056243896) | > loss_disc_real_0: 0.3959231674671173 (0.3959231674671173) | > loss_disc_real_1: 0.2784251272678375 (0.2784251272678375) | > loss_disc_real_2: 0.28900885581970215 (0.28900885581970215) | > loss_disc_real_3: 0.3223893642425537 (0.3223893642425537) | > loss_disc_real_4: 0.16275881230831146 (0.16275881230831146) | > loss_disc_real_5: 0.12896095216274261 (0.12896095216274261) | > loss_0: 2.9153974056243896 (2.9153974056243896) | > loss_gen: 2.2697625160217285 (2.2697625160217285) | > loss_kl: 5.464040279388428 (5.464040279388428) | > loss_feat: 9.202784538269043 (9.202784538269043) | > loss_mel: 20.202789306640625 (20.202789306640625) | > loss_duration: 3.077737331390381 (3.077737331390381) | > loss_1: 40.21711349487305 (40.21711349487305)  --> STEP: 1 | > loss_disc: 2.471526622772217 (2.471526622772217) | > loss_disc_real_0: 0.08291112631559372 (0.08291112631559372) | > loss_disc_real_1: 0.23078308999538422 (0.23078308999538422) | > loss_disc_real_2: 0.19547736644744873 (0.19547736644744873) | > loss_disc_real_3: 0.26106736063957214 (0.26106736063957214) | > loss_disc_real_4: 0.2745591998100281 (0.2745591998100281) | > loss_disc_real_5: 0.28671178221702576 (0.28671178221702576) | > loss_0: 2.471526622772217 (2.471526622772217) | > loss_gen: 1.983360767364502 (1.983360767364502) | > loss_kl: 5.82049560546875 (5.82049560546875) | > loss_feat: 1.5304120779037476 (1.5304120779037476) | > loss_mel: 20.921201705932617 (20.921201705932617) | > loss_duration: 3.544898509979248 (3.544898509979248) | > loss_1: 33.80036926269531 (33.80036926269531)  --> STEP: 2 | > loss_disc: 3.3103623390197754 (2.890944480895996) | > loss_disc_real_0: 0.5679420232772827 (0.3254265747964382) | > loss_disc_real_1: 0.4772433042526245 (0.35401319712400436) | > loss_disc_real_2: 0.36646512150764465 (0.2809712439775467) | > loss_disc_real_3: 0.4192352592945099 (0.340151309967041) | > loss_disc_real_4: 0.2505985498428345 (0.2625788748264313) | > loss_disc_real_5: 0.27141961455345154 (0.27906569838523865) | > loss_0: 3.3103623390197754 (2.890944480895996) | > loss_gen: 2.703221559524536 (2.343291163444519) | > loss_kl: 6.102416038513184 (5.961455821990967) | > loss_feat: 4.588120937347412 (3.05926650762558) | > loss_mel: 28.195066452026367 (24.558134078979492) | > loss_duration: 3.4289755821228027 (3.4869370460510254) | > loss_1: 45.017799377441406 (39.40908432006836)  --> STEP: 3 | > loss_disc: 2.197079658508301 (2.659656206766764) | > loss_disc_real_0: 0.1238076388835907 (0.25822026282548904) | > loss_disc_real_1: 0.3650045096874237 (0.3576769679784775) | > loss_disc_real_2: 0.21123236417770386 (0.25772495071093243) | > loss_disc_real_3: 0.32246920466423035 (0.3342572748661041) | > loss_disc_real_4: 0.1378990113735199 (0.22101892034212747) | > loss_disc_real_5: 0.13113254308700562 (0.22975464661916098) | > loss_0: 2.197079658508301 (2.659656206766764) | > loss_gen: 2.814037322998047 (2.500206549962362) | > loss_kl: 2.9504408836364746 (4.957784175872803) | > loss_feat: 5.589987754821777 (3.902840256690979) | > loss_mel: 22.100568771362305 (23.738945643107098) | > loss_duration: 3.0698935985565186 (3.3479225635528564) | > loss_1: 36.524925231933594 (38.44769795735677) --> EVAL PERFORMANCE | > avg_loader_time: 0.02575572331746419 (+0.012168645858764647) | > avg_loss_disc: 2.659656206766764 (-0.08266957600911473) | > avg_loss_disc_real_0: 0.25822026282548904 (+0.04093622912963232) | > avg_loss_disc_real_1: 0.3576769679784775 (+0.10191290080547333) | > avg_loss_disc_real_2: 0.25772495071093243 (+0.008362029989560454) | > avg_loss_disc_real_3: 0.3342572748661041 (+0.1318746730685234) | > avg_loss_disc_real_4: 0.22101892034212747 (+0.04261874904235202) | > avg_loss_disc_real_5: 0.22975464661916098 (+0.00035384918252628905) | > avg_loss_0: 2.659656206766764 (-0.08266957600911473) | > avg_loss_gen: 2.500206549962362 (+0.5499511957168581) | > avg_loss_kl: 4.957784175872803 (+0.0628210703531904) | > avg_loss_feat: 3.902840256690979 (-1.1183427969614668) | > avg_loss_mel: 23.738945643107098 (+1.3902015686035156) | > avg_loss_duration: 3.3479225635528564 (+0.03949968020121242) | > avg_loss_1: 38.44769795735677 (+0.9241294860839844)  > EPOCH: 1231/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:42:58)   --> TIME: 2023-10-20 15:43:15 -- STEP: 19/50 -- GLOBAL_STEP: 114570 | > loss_disc: 2.847236156463623 (2.399668580607364) | > loss_disc_real_0: 0.15705527365207672 (0.1584653032845572) | > loss_disc_real_1: 0.2626175582408905 (0.20210752949902885) | > loss_disc_real_2: 0.23966655135154724 (0.21041296736190193) | > loss_disc_real_3: 0.2655869126319885 (0.2259320148119801) | > loss_disc_real_4: 0.2933502197265625 (0.2022485425205607) | > loss_disc_real_5: 0.26665759086608887 (0.19873103126883507) | > loss_0: 2.847236156463623 (2.399668580607364) | > grad_norm_0: tensor(629.4415, device='cuda:0') (tensor(580.1462, device='cuda:0')) | > loss_gen: 1.6713863611221313 (2.208583762771205) | > loss_kl: 0.9556321501731873 (0.8177638555827894) | > loss_feat: 0.6794782280921936 (5.412218907553899) | > loss_mel: 7.202267169952393 (18.051105678081512) | > loss_duration: 1.423691987991333 (1.345708451772991) | > loss_1: 11.932456016540527 (27.835381031036377) | > grad_norm_1: tensor(41799.9727, device='cuda:0') (tensor(35084.6367, device='cuda:0')) | > current_lr_0: 5.839559288189994e-05 | > current_lr_1: 5.845402133599403e-05 | > step_time: 0.5802 (0.5763595857118305) | > loader_time: 0.0145 (0.014386666448492753)  --> TIME: 2023-10-20 15:43:33 -- STEP: 49/50 -- GLOBAL_STEP: 114600 | > loss_disc: 2.316964864730835 (2.4523433008972475) | > loss_disc_real_0: 0.10627496987581253 (0.16422018731887236) | > loss_disc_real_1: 0.15655319392681122 (0.21757317182360864) | > loss_disc_real_2: 0.18281731009483337 (0.2175720385370814) | > loss_disc_real_3: 0.38753166794776917 (0.2363526029702352) | > loss_disc_real_4: 0.23613768815994263 (0.2135185698921583) | > loss_disc_real_5: 0.339145302772522 (0.21614920272852997) | > loss_0: 2.316964864730835 (2.4523433008972475) | > grad_norm_0: tensor(412.4491, device='cuda:0') (tensor(625.6872, device='cuda:0')) | > loss_gen: 2.680732488632202 (2.2389810790821003) | > loss_kl: 0.36705267429351807 (0.8236494331943746) | > loss_feat: 6.021698474884033 (5.756307925040627) | > loss_mel: 25.12419319152832 (19.343320779654448) | > loss_duration: 1.4162129163742065 (1.3186465453128422) | > loss_1: 35.60988998413086 (29.48090581504666) | > grad_norm_1: tensor(4468.3467, device='cuda:0') (tensor(23791.4121, device='cuda:0')) | > current_lr_0: 5.839559288189994e-05 | > current_lr_1: 5.845402133599403e-05 | > step_time: 0.3408 (0.5738702160971505) | > loader_time: 0.386 (0.025735349071269134)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.79845929145813 (2.79845929145813) | > loss_disc_real_0: 0.1591852307319641 (0.1591852307319641) | > loss_disc_real_1: 0.34631896018981934 (0.34631896018981934) | > loss_disc_real_2: 0.30855661630630493 (0.30855661630630493) | > loss_disc_real_3: 0.28967565298080444 (0.28967565298080444) | > loss_disc_real_4: 0.2579871416091919 (0.2579871416091919) | > loss_disc_real_5: 0.37857764959335327 (0.37857764959335327) | > loss_0: 2.79845929145813 (2.79845929145813) | > loss_gen: 2.386622190475464 (2.386622190475464) | > loss_kl: 6.269126892089844 (6.269126892089844) | > loss_feat: 4.355332851409912 (4.355332851409912) | > loss_mel: 22.499055862426758 (22.499055862426758) | > loss_duration: 3.116321325302124 (3.116321325302124) | > loss_1: 38.626461029052734 (38.626461029052734)  --> STEP: 1 | > loss_disc: 2.6233303546905518 (2.6233303546905518) | > loss_disc_real_0: 0.32371434569358826 (0.32371434569358826) | > loss_disc_real_1: 0.33114126324653625 (0.33114126324653625) | > loss_disc_real_2: 0.23916906118392944 (0.23916906118392944) | > loss_disc_real_3: 0.21529744565486908 (0.21529744565486908) | > loss_disc_real_4: 0.19607073068618774 (0.19607073068618774) | > loss_disc_real_5: 0.36213046312332153 (0.36213046312332153) | > loss_0: 2.6233303546905518 (2.6233303546905518) | > loss_gen: 2.4041924476623535 (2.4041924476623535) | > loss_kl: 5.548670291900635 (5.548670291900635) | > loss_feat: 6.672479629516602 (6.672479629516602) | > loss_mel: 23.571094512939453 (23.571094512939453) | > loss_duration: 3.541632652282715 (3.541632652282715) | > loss_1: 41.73807144165039 (41.73807144165039)  --> STEP: 2 | > loss_disc: 2.965552568435669 (2.7944414615631104) | > loss_disc_real_0: 0.30302971601486206 (0.31337203085422516) | > loss_disc_real_1: 0.25278180837631226 (0.29196153581142426) | > loss_disc_real_2: 0.26531049609184265 (0.25223977863788605) | > loss_disc_real_3: 0.2402711808681488 (0.22778431326150894) | > loss_disc_real_4: 0.26206788420677185 (0.2290693074464798) | > loss_disc_real_5: 0.2597476840019226 (0.31093907356262207) | > loss_0: 2.965552568435669 (2.7944414615631104) | > loss_gen: 1.6306697130203247 (2.017431080341339) | > loss_kl: 5.853652477264404 (5.7011613845825195) | > loss_feat: 0.11301213502883911 (3.3927458822727203) | > loss_mel: 1.9725502729415894 (12.771822392940521) | > loss_duration: 3.3085365295410156 (3.4250845909118652) | > loss_1: 12.878421783447266 (27.308246612548828)  --> STEP: 3 | > loss_disc: 2.9650731086730957 (2.851318677266439) | > loss_disc_real_0: 0.3027373254299164 (0.30982712904612225) | > loss_disc_real_1: 0.252777099609375 (0.27890005707740784) | > loss_disc_real_2: 0.2658570110797882 (0.2567788561185201) | > loss_disc_real_3: 0.24027802050113678 (0.2319488823413849) | > loss_disc_real_4: 0.2620631456375122 (0.24006725351015726) | > loss_disc_real_5: 0.2597044110298157 (0.29386085271835327) | > loss_0: 2.9650731086730957 (2.851318677266439) | > loss_gen: 1.6314610242843628 (1.8887743949890137) | > loss_kl: 2.959963321685791 (4.787428696950276) | > loss_feat: 0.11428719758987427 (2.2999263207117715) | > loss_mel: 2.556638717651367 (9.366761167844137) | > loss_duration: 3.050565004348755 (3.3002447287241616) | > loss_1: 10.312914848327637 (21.643136024475098) --> EVAL PERFORMANCE | > avg_loader_time: 0.006455183029174805 (-0.019300540288289387) | > avg_loss_disc: 2.851318677266439 (+0.19166247049967478) | > avg_loss_disc_real_0: 0.30982712904612225 (+0.05160686622063321) | > avg_loss_disc_real_1: 0.27890005707740784 (-0.07877691090106964) | > avg_loss_disc_real_2: 0.2567788561185201 (-0.0009460945924123498) | > avg_loss_disc_real_3: 0.2319488823413849 (-0.10230839252471924) | > avg_loss_disc_real_4: 0.24006725351015726 (+0.019048333168029785) | > avg_loss_disc_real_5: 0.29386085271835327 (+0.06410620609919229) | > avg_loss_0: 2.851318677266439 (+0.19166247049967478) | > avg_loss_gen: 1.8887743949890137 (-0.6114321549733481) | > avg_loss_kl: 4.787428696950276 (-0.17035547892252634) | > avg_loss_feat: 2.2999263207117715 (-1.6029139359792075) | > avg_loss_mel: 9.366761167844137 (-14.37218447526296) | > avg_loss_duration: 3.3002447287241616 (-0.04767783482869481) | > avg_loss_1: 21.643136024475098 (-16.804561932881676)  > EPOCH: 1232/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:43:48)   --> TIME: 2023-10-20 15:44:09 -- STEP: 29/50 -- GLOBAL_STEP: 114630 | > loss_disc: 2.8517727851867676 (2.3820900300453447) | > loss_disc_real_0: 0.15217477083206177 (0.1567165473122792) | > loss_disc_real_1: 0.2640896737575531 (0.21510487383809582) | > loss_disc_real_2: 0.3068840801715851 (0.20494311842425117) | > loss_disc_real_3: 0.24428625404834747 (0.2267085424271123) | > loss_disc_real_4: 0.2440851628780365 (0.21691036808850436) | > loss_disc_real_5: 0.2460169941186905 (0.23790126888017202) | > loss_0: 2.8517727851867676 (2.3820900300453447) | > grad_norm_0: tensor(1768.0422, device='cuda:0') (tensor(970.1253, device='cuda:0')) | > loss_gen: 1.648653507232666 (2.3122644671078385) | > loss_kl: 0.7941176295280457 (0.8012639767137067) | > loss_feat: 0.44917547702789307 (5.6704929702240845) | > loss_mel: 11.265515327453613 (20.13416778630224) | > loss_duration: 1.3193244934082031 (1.3274308401962807) | > loss_1: 15.476785659790039 (30.24561952722483) | > grad_norm_1: tensor(38155.4766, device='cuda:0') (tensor(28802.9648, device='cuda:0')) | > current_lr_0: 5.833722283070389e-05 | > current_lr_1: 5.839559288189994e-05 | > step_time: 0.5231 (0.5388406556228111) | > loader_time: 0.0183 (0.021802828229706864)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9322776794433594 (2.9322776794433594) | > loss_disc_real_0: 0.34099844098091125 (0.34099844098091125) | > loss_disc_real_1: 0.2414485663175583 (0.2414485663175583) | > loss_disc_real_2: 0.27798616886138916 (0.27798616886138916) | > loss_disc_real_3: 0.24774424731731415 (0.24774424731731415) | > loss_disc_real_4: 0.2471863180398941 (0.2471863180398941) | > loss_disc_real_5: 0.27080821990966797 (0.27080821990966797) | > loss_0: 2.9322776794433594 (2.9322776794433594) | > loss_gen: 1.7954285144805908 (1.7954285144805908) | > loss_kl: 5.374800682067871 (5.374800682067871) | > loss_feat: 0.2971709370613098 (0.2971709370613098) | > loss_mel: 12.694125175476074 (12.694125175476074) | > loss_duration: 3.058300256729126 (3.058300256729126) | > loss_1: 23.219825744628906 (23.219825744628906)  --> STEP: 1 | > loss_disc: 2.191375494003296 (2.191375494003296) | > loss_disc_real_0: 0.22977517545223236 (0.22977517545223236) | > loss_disc_real_1: 0.13322122395038605 (0.13322122395038605) | > loss_disc_real_2: 0.16552184522151947 (0.16552184522151947) | > loss_disc_real_3: 0.15424975752830505 (0.15424975752830505) | > loss_disc_real_4: 0.1989060789346695 (0.1989060789346695) | > loss_disc_real_5: 0.09903290867805481 (0.09903290867805481) | > loss_0: 2.191375494003296 (2.191375494003296) | > loss_gen: 2.2135207653045654 (2.2135207653045654) | > loss_kl: 5.869815826416016 (5.869815826416016) | > loss_feat: 8.346627235412598 (8.346627235412598) | > loss_mel: 23.742347717285156 (23.742347717285156) | > loss_duration: 3.4430699348449707 (3.4430699348449707) | > loss_1: 43.615379333496094 (43.615379333496094)  --> STEP: 2 | > loss_disc: 2.783997058868408 (2.487686276435852) | > loss_disc_real_0: 0.17357094585895538 (0.20167306065559387) | > loss_disc_real_1: 0.25250789523124695 (0.1928645595908165) | > loss_disc_real_2: 0.2943978011608124 (0.22995982319116592) | > loss_disc_real_3: 0.30573976039886475 (0.2299947589635849) | > loss_disc_real_4: 0.2879623472690582 (0.24343421310186386) | > loss_disc_real_5: 0.26969948410987854 (0.18436619639396667) | > loss_0: 2.783997058868408 (2.487686276435852) | > loss_gen: 2.204850435256958 (2.2091856002807617) | > loss_kl: 6.146353721618652 (6.008084774017334) | > loss_feat: 7.676752090454102 (8.01168966293335) | > loss_mel: 24.945796966552734 (24.344072341918945) | > loss_duration: 3.287909746170044 (3.3654898405075073) | > loss_1: 44.261661529541016 (43.938520431518555)  --> STEP: 3 | > loss_disc: 2.913644552230835 (2.629672368367513) | > loss_disc_real_0: 0.22809964418411255 (0.21048192183176676) | > loss_disc_real_1: 0.23151855170726776 (0.20574922362963358) | > loss_disc_real_2: 0.28676560521125793 (0.24889508386452994) | > loss_disc_real_3: 0.253807008266449 (0.23793217539787292) | > loss_disc_real_4: 0.24470382928848267 (0.24385741849740347) | > loss_disc_real_5: 0.2636798024177551 (0.21080406506856283) | > loss_0: 2.913644552230835 (2.629672368367513) | > loss_gen: 1.631126880645752 (2.0164993604024253) | > loss_kl: 2.881460428237915 (4.965876658757527) | > loss_feat: 0.43799230456352234 (5.487123876810074) | > loss_mel: 11.908979415893555 (20.19904136657715) | > loss_duration: 3.1453113555908203 (3.292097012201945) | > loss_1: 20.00486946105957 (35.96063677469889) --> EVAL PERFORMANCE | > avg_loader_time: 0.017118215560913086 (+0.010663032531738281) | > avg_loss_disc: 2.629672368367513 (-0.22164630889892578) | > avg_loss_disc_real_0: 0.21048192183176676 (-0.0993452072143555) | > avg_loss_disc_real_1: 0.20574922362963358 (-0.07315083344777426) | > avg_loss_disc_real_2: 0.24889508386452994 (-0.007883772253990146) | > avg_loss_disc_real_3: 0.23793217539787292 (+0.005983293056488037) | > avg_loss_disc_real_4: 0.24385741849740347 (+0.003790164987246214) | > avg_loss_disc_real_5: 0.21080406506856283 (-0.08305678764979044) | > avg_loss_0: 2.629672368367513 (-0.22164630889892578) | > avg_loss_gen: 2.0164993604024253 (+0.1277249654134116) | > avg_loss_kl: 4.965876658757527 (+0.17844796180725098) | > avg_loss_feat: 5.487123876810074 (+3.1871975560983024) | > avg_loss_mel: 20.19904136657715 (+10.832280198733011) | > avg_loss_duration: 3.292097012201945 (-0.008147716522216797) | > avg_loss_1: 35.96063677469889 (+14.317500750223793)  > EPOCH: 1233/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:44:38)   --> TIME: 2023-10-20 15:44:51 -- STEP: 9/50 -- GLOBAL_STEP: 114660 | > loss_disc: 1.776352047920227 (2.1059646209081015) | > loss_disc_real_0: 0.024495450779795647 (0.09885448072519568) | > loss_disc_real_1: 0.18443025648593903 (0.20702003108130562) | > loss_disc_real_2: 0.17394104599952698 (0.19276650663879183) | > loss_disc_real_3: 0.23496675491333008 (0.21998950921826893) | > loss_disc_real_4: 0.18899492919445038 (0.18348069075081083) | > loss_disc_real_5: 0.08396578580141068 (0.16560069678558242) | > loss_0: 1.776352047920227 (2.1059646209081015) | > grad_norm_0: tensor(662.1844, device='cuda:0') (tensor(1164.9572, device='cuda:0')) | > loss_gen: 2.613766670227051 (2.550251563390096) | > loss_kl: 0.4545179009437561 (0.6929918792512682) | > loss_feat: 6.00922966003418 (6.958362857500712) | > loss_mel: 22.976625442504883 (22.463515917460125) | > loss_duration: 1.2763893604278564 (1.3560433785120647) | > loss_1: 33.330528259277344 (34.021165423923065) | > grad_norm_1: tensor(12425.8193, device='cuda:0') (tensor(56789.5820, device='cuda:0')) | > current_lr_0: 5.827891112402851e-05 | > current_lr_1: 5.833722283070389e-05 | > step_time: 0.8272 (0.6701844268374972) | > loader_time: 0.026 (0.020764721764458552)  --> TIME: 2023-10-20 15:45:10 -- STEP: 39/50 -- GLOBAL_STEP: 114690 | > loss_disc: 3.0199897289276123 (2.4482684379968886) | > loss_disc_real_0: 0.29464128613471985 (0.15206386519070614) | > loss_disc_real_1: 0.25659245252609253 (0.22775613096279976) | > loss_disc_real_2: 0.26182878017425537 (0.22989256164202324) | > loss_disc_real_3: 0.23461571335792542 (0.23362570026746163) | > loss_disc_real_4: 0.2605419158935547 (0.2365686887731919) | > loss_disc_real_5: 0.28522664308547974 (0.22509938994279274) | > loss_0: 3.0199897289276123 (2.4482684379968886) | > grad_norm_0: tensor(852.2628, device='cuda:0') (tensor(1198.2129, device='cuda:0')) | > loss_gen: 1.571692705154419 (2.282126689568544) | > loss_kl: 0.37835565209388733 (0.7509543972137647) | > loss_feat: 0.03434036299586296 (5.421466750880847) | > loss_mel: 1.4403475522994995 (19.502496863022827) | > loss_duration: 1.4203948974609375 (1.3262904393367279) | > loss_1: 4.845130920410156 (29.28333517221304) | > grad_norm_1: tensor(93310.6641, device='cuda:0') (tensor(46756.9688, device='cuda:0')) | > current_lr_0: 5.827891112402851e-05 | > current_lr_1: 5.833722283070389e-05 | > step_time: 0.4996 (0.6066110378656632) | > loader_time: 0.0128 (0.015768894782433145)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.851738452911377 (2.851738452911377) | > loss_disc_real_0: 0.28069207072257996 (0.28069207072257996) | > loss_disc_real_1: 0.3427892029285431 (0.3427892029285431) | > loss_disc_real_2: 0.2885681092739105 (0.2885681092739105) | > loss_disc_real_3: 0.32797738909721375 (0.32797738909721375) | > loss_disc_real_4: 0.27287840843200684 (0.27287840843200684) | > loss_disc_real_5: 0.41703513264656067 (0.41703513264656067) | > loss_0: 2.851738452911377 (2.851738452911377) | > loss_gen: 2.6300456523895264 (2.6300456523895264) | > loss_kl: 5.694745063781738 (5.694745063781738) | > loss_feat: 7.870558261871338 (7.870558261871338) | > loss_mel: 22.9199161529541 (22.9199161529541) | > loss_duration: 3.0060834884643555 (3.0060834884643555) | > loss_1: 42.12135314941406 (42.12135314941406)  --> STEP: 1 | > loss_disc: 2.3065807819366455 (2.3065807819366455) | > loss_disc_real_0: 0.1269260048866272 (0.1269260048866272) | > loss_disc_real_1: 0.14883367717266083 (0.14883367717266083) | > loss_disc_real_2: 0.23816469311714172 (0.23816469311714172) | > loss_disc_real_3: 0.18980883061885834 (0.18980883061885834) | > loss_disc_real_4: 0.15578393638134003 (0.15578393638134003) | > loss_disc_real_5: 0.31008756160736084 (0.31008756160736084) | > loss_0: 2.3065807819366455 (2.3065807819366455) | > loss_gen: 2.324863910675049 (2.324863910675049) | > loss_kl: 5.881984710693359 (5.881984710693359) | > loss_feat: 5.204390048980713 (5.204390048980713) | > loss_mel: 23.25897979736328 (23.25897979736328) | > loss_duration: 3.554626941680908 (3.554626941680908) | > loss_1: 40.2248420715332 (40.2248420715332)  --> STEP: 2 | > loss_disc: 2.160611629486084 (2.2335962057113647) | > loss_disc_real_0: 0.36292538046836853 (0.24492569267749786) | > loss_disc_real_1: 0.17963933944702148 (0.16423650830984116) | > loss_disc_real_2: 0.22894662618637085 (0.2335556596517563) | > loss_disc_real_3: 0.2079228013753891 (0.19886581599712372) | > loss_disc_real_4: 0.12165200710296631 (0.13871797174215317) | > loss_disc_real_5: 0.037045918405056 (0.17356674000620842) | > loss_0: 2.160611629486084 (2.2335962057113647) | > loss_gen: 4.459504127502441 (3.392184019088745) | > loss_kl: 6.187045097351074 (6.034514904022217) | > loss_feat: 14.532369613647461 (9.868379831314087) | > loss_mel: 22.95452117919922 (23.10675048828125) | > loss_duration: 3.2464218139648438 (3.400524377822876) | > loss_1: 51.379859924316406 (45.802350997924805)  --> STEP: 3 | > loss_disc: 2.7782957553863525 (2.415162722269694) | > loss_disc_real_0: 0.1932455152273178 (0.22769896686077118) | > loss_disc_real_1: 0.2558232545852661 (0.19476542373498282) | > loss_disc_real_2: 0.28369829058647156 (0.25026986996332806) | > loss_disc_real_3: 0.24773351848125458 (0.21515505015850067) | > loss_disc_real_4: 0.2447930872440338 (0.17407634357611337) | > loss_disc_real_5: 0.25405552983283997 (0.2003963366150856) | > loss_0: 2.7782957553863525 (2.415162722269694) | > loss_gen: 1.7532963752746582 (2.845888137817383) | > loss_kl: 3.052375555038452 (5.040468454360962) | > loss_feat: 0.8817160129547119 (6.872825225194295) | > loss_mel: 14.315681457519531 (20.17639414469401) | > loss_duration: 2.999894618988037 (3.2669811248779297) | > loss_1: 23.00296401977539 (38.202555338541664) --> EVAL PERFORMANCE | > avg_loader_time: 0.016364653905232746 (-0.0007535616556803397) | > avg_loss_disc: 2.415162722269694 (-0.2145096460978193) | > avg_loss_disc_real_0: 0.22769896686077118 (+0.017217045029004424) | > avg_loss_disc_real_1: 0.19476542373498282 (-0.010983799894650759) | > avg_loss_disc_real_2: 0.25026986996332806 (+0.0013747860987981253) | > avg_loss_disc_real_3: 0.21515505015850067 (-0.022777125239372253) | > avg_loss_disc_real_4: 0.17407634357611337 (-0.0697810749212901) | > avg_loss_disc_real_5: 0.2003963366150856 (-0.010407728453477233) | > avg_loss_0: 2.415162722269694 (-0.2145096460978193) | > avg_loss_gen: 2.845888137817383 (+0.8293887774149575) | > avg_loss_kl: 5.040468454360962 (+0.07459179560343454) | > avg_loss_feat: 6.872825225194295 (+1.385701348384221) | > avg_loss_mel: 20.17639414469401 (-0.022647221883136837) | > avg_loss_duration: 3.2669811248779297 (-0.02511588732401515) | > avg_loss_1: 38.202555338541664 (+2.2419185638427734)  > EPOCH: 1234/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:45:32)   --> TIME: 2023-10-20 15:45:49 -- STEP: 19/50 -- GLOBAL_STEP: 114720 | > loss_disc: 2.2311456203460693 (2.5375701565491524) | > loss_disc_real_0: 0.22755713760852814 (0.1403409301450378) | > loss_disc_real_1: 0.2035597711801529 (0.22504689132696704) | > loss_disc_real_2: 0.25870588421821594 (0.24132217751129678) | > loss_disc_real_3: 0.16497446596622467 (0.2439556986485657) | > loss_disc_real_4: 0.27068769931793213 (0.24743094363887058) | > loss_disc_real_5: 0.19301870465278625 (0.261060269647523) | > loss_0: 2.2311456203460693 (2.5375701565491524) | > grad_norm_0: tensor(1069.7805, device='cuda:0') (tensor(1028.6938, device='cuda:0')) | > loss_gen: 2.6569080352783203 (2.2234470091368017) | > loss_kl: 1.0145032405853271 (0.6436923114876998) | > loss_feat: 5.817027568817139 (5.235343995258996) | > loss_mel: 22.073863983154297 (17.797102984629177) | > loss_duration: 1.4083061218261719 (1.3273032589962608) | > loss_1: 32.970611572265625 (27.226889409516986) | > grad_norm_1: tensor(24351.6250, device='cuda:0') (tensor(39184.1172, device='cuda:0')) | > current_lr_0: 5.822065770355482e-05 | > current_lr_1: 5.827891112402851e-05 | > step_time: 0.4917 (0.5257104823463842) | > loader_time: 0.0259 (0.019992062920018247)  --> TIME: 2023-10-20 15:46:03 -- STEP: 49/50 -- GLOBAL_STEP: 114750 | > loss_disc: 1.6944456100463867 (2.41115436262014) | > loss_disc_real_0: 0.07126970589160919 (0.13230728951035717) | > loss_disc_real_1: 0.1732298582792282 (0.20760631105121302) | > loss_disc_real_2: 0.05555252730846405 (0.21091889544409148) | > loss_disc_real_3: 0.24252739548683167 (0.2234694644504664) | > loss_disc_real_4: 0.08846688270568848 (0.22349408641457555) | > loss_disc_real_5: 0.14758683741092682 (0.24143272820784129) | > loss_0: 1.6944456100463867 (2.41115436262014) | > grad_norm_0: tensor(641.8867, device='cuda:0') (tensor(1063.0674, device='cuda:0')) | > loss_gen: 2.942309617996216 (2.283173052632079) | > loss_kl: 0.7530092000961304 (0.6580703994449305) | > loss_feat: 8.242132186889648 (6.117375839197514) | > loss_mel: 21.46466636657715 (19.734906233086885) | > loss_duration: 1.3583253622055054 (1.3098721966451525) | > loss_1: 34.76044464111328 (30.103397554280807) | > grad_norm_1: tensor(44043.5469, device='cuda:0') (tensor(34728.4766, device='cuda:0')) | > current_lr_0: 5.822065770355482e-05 | > current_lr_1: 5.827891112402851e-05 | > step_time: 0.3604 (0.4791503682428477) | > loader_time: 0.3924 (0.019548523182771643)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.338838577270508 (3.338838577270508) | > loss_disc_real_0: 0.5589368343353271 (0.5589368343353271) | > loss_disc_real_1: 0.43905264139175415 (0.43905264139175415) | > loss_disc_real_2: 0.4181039333343506 (0.4181039333343506) | > loss_disc_real_3: 0.37861594557762146 (0.37861594557762146) | > loss_disc_real_4: 0.33713066577911377 (0.33713066577911377) | > loss_disc_real_5: 0.4026516079902649 (0.4026516079902649) | > loss_0: 3.338838577270508 (3.338838577270508) | > loss_gen: 3.034914493560791 (3.034914493560791) | > loss_kl: 6.114490032196045 (6.114490032196045) | > loss_feat: 5.257572650909424 (5.257572650909424) | > loss_mel: 21.469873428344727 (21.469873428344727) | > loss_duration: 3.0302817821502686 (3.0302817821502686) | > loss_1: 38.90713119506836 (38.90713119506836)  --> STEP: 1 | > loss_disc: 2.6313462257385254 (2.6313462257385254) | > loss_disc_real_0: 0.25240474939346313 (0.25240474939346313) | > loss_disc_real_1: 0.3423328399658203 (0.3423328399658203) | > loss_disc_real_2: 0.4416411221027374 (0.4416411221027374) | > loss_disc_real_3: 0.5133823156356812 (0.5133823156356812) | > loss_disc_real_4: 0.21877843141555786 (0.21877843141555786) | > loss_disc_real_5: 0.18462926149368286 (0.18462926149368286) | > loss_0: 2.6313462257385254 (2.6313462257385254) | > loss_gen: 3.0292956829071045 (3.0292956829071045) | > loss_kl: 6.012056827545166 (6.012056827545166) | > loss_feat: 5.362776279449463 (5.362776279449463) | > loss_mel: 22.036067962646484 (22.036067962646484) | > loss_duration: 3.474477767944336 (3.474477767944336) | > loss_1: 39.9146728515625 (39.9146728515625)  --> STEP: 2 | > loss_disc: 2.8199760913848877 (2.7256611585617065) | > loss_disc_real_0: 0.24775108695030212 (0.25007791817188263) | > loss_disc_real_1: 0.3764258623123169 (0.3593793511390686) | > loss_disc_real_2: 0.21820801496505737 (0.3299245685338974) | > loss_disc_real_3: 0.4152410626411438 (0.4643116891384125) | > loss_disc_real_4: 0.4670659601688385 (0.3429221957921982) | > loss_disc_real_5: 0.4285644292831421 (0.3065968453884125) | > loss_0: 2.8199760913848877 (2.7256611585617065) | > loss_gen: 3.6451940536499023 (3.3372448682785034) | > loss_kl: 6.373438835144043 (6.1927478313446045) | > loss_feat: 7.173206806182861 (6.267991542816162) | > loss_mel: 21.855844497680664 (21.945956230163574) | > loss_duration: 3.26739501953125 (3.370936393737793) | > loss_1: 42.31507873535156 (41.11487579345703)  --> STEP: 3 | > loss_disc: 2.8679909706115723 (2.773104429244995) | > loss_disc_real_0: 0.20652467012405396 (0.2355601688226064) | > loss_disc_real_1: 0.2808782458305359 (0.33321231603622437) | > loss_disc_real_2: 0.3023010194301605 (0.3207167188326518) | > loss_disc_real_3: 0.3117607533931732 (0.4134613772233327) | > loss_disc_real_4: 0.27819156646728516 (0.3213453193505605) | > loss_disc_real_5: 0.2890435755252838 (0.30074575543403625) | > loss_0: 2.8679909706115723 (2.773104429244995) | > loss_gen: 1.8627361059188843 (2.845741947491964) | > loss_kl: 2.7489142417907715 (5.044803301493327) | > loss_feat: 0.4866822063922882 (4.3408884306748705) | > loss_mel: 15.16396427154541 (19.68529224395752) | > loss_duration: 3.1260428428649902 (3.2893052101135254) | > loss_1: 23.38833999633789 (35.20603052775065) --> EVAL PERFORMANCE | > avg_loader_time: 0.016616026560465496 (+0.0002513726552327497) | > avg_loss_disc: 2.773104429244995 (+0.35794170697530125) | > avg_loss_disc_real_0: 0.2355601688226064 (+0.007861201961835235) | > avg_loss_disc_real_1: 0.33321231603622437 (+0.13844689230124155) | > avg_loss_disc_real_2: 0.3207167188326518 (+0.07044684886932373) | > avg_loss_disc_real_3: 0.4134613772233327 (+0.19830632706483203) | > avg_loss_disc_real_4: 0.3213453193505605 (+0.14726897577444711) | > avg_loss_disc_real_5: 0.30074575543403625 (+0.10034941881895065) | > avg_loss_0: 2.773104429244995 (+0.35794170697530125) | > avg_loss_gen: 2.845741947491964 (-0.00014619032541896004) | > avg_loss_kl: 5.044803301493327 (+0.004334847132365205) | > avg_loss_feat: 4.3408884306748705 (-2.5319367945194244) | > avg_loss_mel: 19.68529224395752 (-0.49110190073649207) | > avg_loss_duration: 3.2893052101135254 (+0.022324085235595703) | > avg_loss_1: 35.20603052775065 (-2.9965248107910156)  > EPOCH: 1235/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:46:21)   --> TIME: 2023-10-20 15:46:45 -- STEP: 29/50 -- GLOBAL_STEP: 114780 | > loss_disc: 2.803938865661621 (2.5522270284850026) | > loss_disc_real_0: 0.058856621384620667 (0.15284583894214754) | > loss_disc_real_1: 0.2596900761127472 (0.23887002313959188) | > loss_disc_real_2: 0.14053821563720703 (0.28750077301058274) | > loss_disc_real_3: 0.23539486527442932 (0.2597242583488596) | > loss_disc_real_4: 0.2443457543849945 (0.26152871597301347) | > loss_disc_real_5: 0.28103524446487427 (0.2814057197678706) | > loss_0: 2.803938865661621 (2.5522270284850026) | > grad_norm_0: tensor(1789.4679, device='cuda:0') (tensor(818.7508, device='cuda:0')) | > loss_gen: 1.5758081674575806 (2.385564795855818) | > loss_kl: 0.5506580471992493 (0.7132187197948324) | > loss_feat: 1.0076119899749756 (5.564466125877766) | > loss_mel: 14.866475105285645 (19.13502625350295) | > loss_duration: 1.2873121500015259 (1.3389831370320813) | > loss_1: 19.287864685058594 (29.13725857899107) | > grad_norm_1: tensor(7183.6704, device='cuda:0') (tensor(23257.3105, device='cuda:0')) | > current_lr_0: 5.81624625110221e-05 | > current_lr_1: 5.822065770355482e-05 | > step_time: 0.4794 (0.6098226432142586) | > loader_time: 0.0054 (0.024466489923411404)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8700318336486816 (2.8700318336486816) | > loss_disc_real_0: 0.21750426292419434 (0.21750426292419434) | > loss_disc_real_1: 0.2682764530181885 (0.2682764530181885) | > loss_disc_real_2: 0.2714441418647766 (0.2714441418647766) | > loss_disc_real_3: 0.2608100175857544 (0.2608100175857544) | > loss_disc_real_4: 0.2694530785083771 (0.2694530785083771) | > loss_disc_real_5: 0.26982542872428894 (0.26982542872428894) | > loss_0: 2.8700318336486816 (2.8700318336486816) | > loss_gen: 1.7146191596984863 (1.7146191596984863) | > loss_kl: 5.628754615783691 (5.628754615783691) | > loss_feat: 0.34905141592025757 (0.34905141592025757) | > loss_mel: 13.957337379455566 (13.957337379455566) | > loss_duration: 3.0896999835968018 (3.0896999835968018) | > loss_1: 24.73946189880371 (24.73946189880371)  --> STEP: 1 | > loss_disc: 1.6417491436004639 (1.6417491436004639) | > loss_disc_real_0: 0.04636702314019203 (0.04636702314019203) | > loss_disc_real_1: 0.11592268943786621 (0.11592268943786621) | > loss_disc_real_2: 0.10392756015062332 (0.10392756015062332) | > loss_disc_real_3: 0.06029762327671051 (0.06029762327671051) | > loss_disc_real_4: 0.09593728184700012 (0.09593728184700012) | > loss_disc_real_5: 0.1024780422449112 (0.1024780422449112) | > loss_0: 1.6417491436004639 (1.6417491436004639) | > loss_gen: 2.156506299972534 (2.156506299972534) | > loss_kl: 5.5038628578186035 (5.5038628578186035) | > loss_feat: 11.330726623535156 (11.330726623535156) | > loss_mel: 24.504186630249023 (24.504186630249023) | > loss_duration: 3.4713845252990723 (3.4713845252990723) | > loss_1: 46.96666717529297 (46.96666717529297)  --> STEP: 2 | > loss_disc: 2.4897267818450928 (2.0657379627227783) | > loss_disc_real_0: 0.43911880254745483 (0.24274291284382343) | > loss_disc_real_1: 0.23728954792022705 (0.17660611867904663) | > loss_disc_real_2: 0.21326665580272675 (0.15859710797667503) | > loss_disc_real_3: 0.23157715797424316 (0.14593739062547684) | > loss_disc_real_4: 0.15884600579738617 (0.12739164382219315) | > loss_disc_real_5: 0.17071941494941711 (0.13659872859716415) | > loss_0: 2.4897267818450928 (2.0657379627227783) | > loss_gen: 2.282721757888794 (2.219614028930664) | > loss_kl: 5.816651344299316 (5.66025710105896) | > loss_feat: 4.984987735748291 (8.157857179641724) | > loss_mel: 23.0859317779541 (23.795059204101562) | > loss_duration: 3.32192325592041 (3.396653890609741) | > loss_1: 39.492218017578125 (43.22944259643555)  --> STEP: 3 | > loss_disc: 2.9822945594787598 (2.3712568283081055) | > loss_disc_real_0: 0.2107842117547989 (0.23209001248081526) | > loss_disc_real_1: 0.26600921154022217 (0.20640714963277182) | > loss_disc_real_2: 0.2698972523212433 (0.19569715609153113) | > loss_disc_real_3: 0.25963538885116577 (0.18383672336737314) | > loss_disc_real_4: 0.26984190940856934 (0.17487506568431854) | > loss_disc_real_5: 0.26981320977211 (0.18100355565547943) | > loss_0: 2.9822945594787598 (2.3712568283081055) | > loss_gen: 1.5703320503234863 (2.0031867027282715) | > loss_kl: 3.1124267578125 (4.810980319976807) | > loss_feat: 0.0647912472486496 (5.460168535510699) | > loss_mel: 2.6075117588043213 (16.732543389002483) | > loss_duration: 2.934008836746216 (3.242438872655233) | > loss_1: 10.289071083068848 (32.249318758646645) --> EVAL PERFORMANCE | > avg_loader_time: 0.009786844253540039 (-0.006829182306925457) | > avg_loss_disc: 2.3712568283081055 (-0.40184760093688965) | > avg_loss_disc_real_0: 0.23209001248081526 (-0.003470156341791153) | > avg_loss_disc_real_1: 0.20640714963277182 (-0.12680516640345255) | > avg_loss_disc_real_2: 0.19569715609153113 (-0.12501956274112067) | > avg_loss_disc_real_3: 0.18383672336737314 (-0.22962465385595957) | > avg_loss_disc_real_4: 0.17487506568431854 (-0.14647025366624195) | > avg_loss_disc_real_5: 0.18100355565547943 (-0.11974219977855682) | > avg_loss_0: 2.3712568283081055 (-0.40184760093688965) | > avg_loss_gen: 2.0031867027282715 (-0.8425552447636924) | > avg_loss_kl: 4.810980319976807 (-0.23382298151652048) | > avg_loss_feat: 5.460168535510699 (+1.1192801048358287) | > avg_loss_mel: 16.732543389002483 (-2.9527488549550363) | > avg_loss_duration: 3.242438872655233 (-0.046866337458292495) | > avg_loss_1: 32.249318758646645 (-2.956711769104004)  > EPOCH: 1236/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:47:15)   --> TIME: 2023-10-20 15:47:28 -- STEP: 9/50 -- GLOBAL_STEP: 114810 | > loss_disc: 2.9242360591888428 (2.2859046724107532) | > loss_disc_real_0: 0.10878560692071915 (0.12375375918216175) | > loss_disc_real_1: 0.28777629137039185 (0.22649744442767566) | > loss_disc_real_2: 0.27234944701194763 (0.23980258736345503) | > loss_disc_real_3: 0.2601105868816376 (0.22874520470698675) | > loss_disc_real_4: 0.28458696603775024 (0.19898875492314497) | > loss_disc_real_5: 0.32631587982177734 (0.22563300364547306) | > loss_0: 2.9242360591888428 (2.2859046724107532) | > grad_norm_0: tensor(2022.7227, device='cuda:0') (tensor(635.1812, device='cuda:0')) | > loss_gen: 1.7399492263793945 (2.5152367088529797) | > loss_kl: 0.7657344341278076 (0.7823142806688944) | > loss_feat: 0.37438473105430603 (6.617898699310091) | > loss_mel: 14.528039932250977 (20.925405502319336) | > loss_duration: 1.272605061531067 (1.3311761220296223) | > loss_1: 18.680713653564453 (32.17203034294976) | > grad_norm_1: tensor(31226.8633, device='cuda:0') (tensor(15929.5576, device='cuda:0')) | > current_lr_0: 5.810432548822789e-05 | > current_lr_1: 5.81624625110221e-05 | > step_time: 0.5382 (0.5650163491566976) | > loader_time: 0.002 (0.01929420895046658)  --> TIME: 2023-10-20 15:47:45 -- STEP: 39/50 -- GLOBAL_STEP: 114840 | > loss_disc: 2.9956188201904297 (2.407258064318926) | > loss_disc_real_0: 0.3234404921531677 (0.1506720538704823) | > loss_disc_real_1: 0.26721808314323425 (0.22258513201123628) | > loss_disc_real_2: 0.2606821060180664 (0.22567499553163847) | > loss_disc_real_3: 0.24659697711467743 (0.2284087295142504) | > loss_disc_real_4: 0.27121105790138245 (0.20931573116626495) | > loss_disc_real_5: 0.2724379301071167 (0.21928811615380722) | > loss_0: 2.9956188201904297 (2.407258064318926) | > grad_norm_0: tensor(1875.3993, device='cuda:0') (tensor(700.3866, device='cuda:0')) | > loss_gen: 1.6004045009613037 (2.2671116835031753) | > loss_kl: 0.6029888987541199 (0.7660911022088467) | > loss_feat: 0.07368772476911545 (5.1063503586711025) | > loss_mel: 2.5884897708892822 (19.63732228523645) | > loss_duration: 1.360561490058899 (1.3027012531573954) | > loss_1: 6.226132392883301 (29.079576174418133) | > grad_norm_1: tensor(45634.9062, device='cuda:0') (tensor(16727.9609, device='cuda:0')) | > current_lr_0: 5.810432548822789e-05 | > current_lr_1: 5.81624625110221e-05 | > step_time: 0.888 (0.5624772585355319) | > loader_time: 0.028 (0.02010110708383414)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4123053550720215 (2.4123053550720215) | > loss_disc_real_0: 0.2156759649515152 (0.2156759649515152) | > loss_disc_real_1: 0.22205308079719543 (0.22205308079719543) | > loss_disc_real_2: 0.31079232692718506 (0.31079232692718506) | > loss_disc_real_3: 0.5328677296638489 (0.5328677296638489) | > loss_disc_real_4: 0.23489290475845337 (0.23489290475845337) | > loss_disc_real_5: 0.1948874443769455 (0.1948874443769455) | > loss_0: 2.4123053550720215 (2.4123053550720215) | > loss_gen: 3.4317879676818848 (3.4317879676818848) | > loss_kl: 6.014017581939697 (6.014017581939697) | > loss_feat: 9.25261402130127 (9.25261402130127) | > loss_mel: 24.117563247680664 (24.117563247680664) | > loss_duration: 3.047450304031372 (3.047450304031372) | > loss_1: 45.863433837890625 (45.863433837890625)  --> STEP: 1 | > loss_disc: 2.7959887981414795 (2.7959887981414795) | > loss_disc_real_0: 0.3430880308151245 (0.3430880308151245) | > loss_disc_real_1: 0.1714812070131302 (0.1714812070131302) | > loss_disc_real_2: 0.24271851778030396 (0.24271851778030396) | > loss_disc_real_3: 0.3195604085922241 (0.3195604085922241) | > loss_disc_real_4: 0.1494537889957428 (0.1494537889957428) | > loss_disc_real_5: 0.3139077425003052 (0.3139077425003052) | > loss_0: 2.7959887981414795 (2.7959887981414795) | > loss_gen: 2.105807065963745 (2.105807065963745) | > loss_kl: 5.748632907867432 (5.748632907867432) | > loss_feat: 5.153102874755859 (5.153102874755859) | > loss_mel: 24.79890251159668 (24.79890251159668) | > loss_duration: 3.436053514480591 (3.436053514480591) | > loss_1: 41.24250030517578 (41.24250030517578)  --> STEP: 2 | > loss_disc: 3.0398967266082764 (2.917942762374878) | > loss_disc_real_0: 0.1218089908361435 (0.232448510825634) | > loss_disc_real_1: 0.27212783694267273 (0.22180452197790146) | > loss_disc_real_2: 0.2636983394622803 (0.2532084286212921) | > loss_disc_real_3: 0.2676962912082672 (0.29362834990024567) | > loss_disc_real_4: 0.2828027606010437 (0.21612827479839325) | > loss_disc_real_5: 0.25781121850013733 (0.28585948050022125) | > loss_0: 3.0398967266082764 (2.917942762374878) | > loss_gen: 1.4736205339431763 (1.7897137999534607) | > loss_kl: 5.579964637756348 (5.66429877281189) | > loss_feat: 0.030953193083405495 (2.5920280339196324) | > loss_mel: 0.556074321269989 (12.677488416433334) | > loss_duration: 3.381965398788452 (3.4090094566345215) | > loss_1: 11.022578239440918 (26.13253927230835)  --> STEP: 3 | > loss_disc: 3.0260169506073 (2.953967491785685) | > loss_disc_real_0: 0.5442152619361877 (0.3363707611958186) | > loss_disc_real_1: 0.25122857093811035 (0.2316125382979711) | > loss_disc_real_2: 0.30589577555656433 (0.2707708775997162) | > loss_disc_real_3: 0.30060234665870667 (0.29595301548639935) | > loss_disc_real_4: 0.27852532267570496 (0.23692729075749716) | > loss_disc_real_5: 0.26889196038246155 (0.280203640460968) | > loss_0: 3.0260169506073 (2.953967491785685) | > loss_gen: 2.287891387939453 (1.9557729959487915) | > loss_kl: 2.892348289489746 (4.740315278371175) | > loss_feat: 1.1803321838378906 (2.121462750559052) | > loss_mel: 18.401098251342773 (14.585358361403147) | > loss_duration: 3.025324821472168 (3.2811145782470703) | > loss_1: 27.78699493408203 (26.684024492899578) --> EVAL PERFORMANCE | > avg_loader_time: 0.007238070170084636 (-0.0025487740834554034) | > avg_loss_disc: 2.953967491785685 (+0.5827106634775796) | > avg_loss_disc_real_0: 0.3363707611958186 (+0.10428074871500334) | > avg_loss_disc_real_1: 0.2316125382979711 (+0.02520538866519928) | > avg_loss_disc_real_2: 0.2707708775997162 (+0.07507372150818506) | > avg_loss_disc_real_3: 0.29595301548639935 (+0.11211629211902621) | > avg_loss_disc_real_4: 0.23692729075749716 (+0.06205222507317862) | > avg_loss_disc_real_5: 0.280203640460968 (+0.09920008480548859) | > avg_loss_0: 2.953967491785685 (+0.5827106634775796) | > avg_loss_gen: 1.9557729959487915 (-0.04741370677947998) | > avg_loss_kl: 4.740315278371175 (-0.0706650416056318) | > avg_loss_feat: 2.121462750559052 (-3.3387057849516473) | > avg_loss_mel: 14.585358361403147 (-2.1471850275993365) | > avg_loss_duration: 3.2811145782470703 (+0.03867570559183742) | > avg_loss_1: 26.684024492899578 (-5.565294265747067)  > EPOCH: 1237/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:48:05)   --> TIME: 2023-10-20 15:48:18 -- STEP: 19/50 -- GLOBAL_STEP: 114870 | > loss_disc: 1.2930949926376343 (2.4570451410193193) | > loss_disc_real_0: 0.05070479214191437 (0.16136711002572587) | > loss_disc_real_1: 0.09910395741462708 (0.23614066853923232) | > loss_disc_real_2: 0.1522562950849533 (0.23943928727193883) | > loss_disc_real_3: 0.11628206074237823 (0.24933824472521482) | > loss_disc_real_4: 0.09460769593715668 (0.2168591657751485) | > loss_disc_real_5: 0.05275276303291321 (0.211469649582317) | > loss_0: 1.2930949926376343 (2.4570451410193193) | > grad_norm_0: tensor(202.2164, device='cuda:0') (tensor(801.7964, device='cuda:0')) | > loss_gen: 3.044734001159668 (2.4174309153305855) | > loss_kl: 0.7744645476341248 (0.7467835851405796) | > loss_feat: 11.802529335021973 (6.204514075952925) | > loss_mel: 23.918476104736328 (20.365089745897997) | > loss_duration: 1.36348557472229 (1.343365794733951) | > loss_1: 40.903690338134766 (31.077184200286865) | > grad_norm_1: tensor(7590.4985, device='cuda:0') (tensor(28136.8789, device='cuda:0')) | > current_lr_0: 5.804624657702788e-05 | > current_lr_1: 5.810432548822789e-05 | > step_time: 0.2552 (0.39603686332702637) | > loader_time: 0.0023 (0.012879810835185803)  --> TIME: 2023-10-20 15:48:28 -- STEP: 49/50 -- GLOBAL_STEP: 114900 | > loss_disc: 1.9916746616363525 (2.4594427931065455) | > loss_disc_real_0: 0.12738828361034393 (0.1614726880869391) | > loss_disc_real_1: 0.34795165061950684 (0.22788292380543995) | > loss_disc_real_2: 0.11275377869606018 (0.2252461569649833) | > loss_disc_real_3: 0.3224637508392334 (0.23386867002260933) | > loss_disc_real_4: 0.15718252956867218 (0.2264558700274448) | > loss_disc_real_5: 0.2310410439968109 (0.22514369426181122) | > loss_0: 1.9916746616363525 (2.4594427931065455) | > grad_norm_0: tensor(673.6180, device='cuda:0') (tensor(632.9558, device='cuda:0')) | > loss_gen: 2.8669424057006836 (2.2938796427785135) | > loss_kl: 0.984301745891571 (0.7966643897246342) | > loss_feat: 5.723865985870361 (5.628438508746271) | > loss_mel: 24.436397552490234 (19.539445722589683) | > loss_duration: 1.3989572525024414 (1.3098126065974334) | > loss_1: 35.410465240478516 (29.5682408761005) | > grad_norm_1: tensor(17041.4707, device='cuda:0') (tensor(21413.3008, device='cuda:0')) | > current_lr_0: 5.804624657702788e-05 | > current_lr_1: 5.810432548822789e-05 | > step_time: 0.2699 (0.35242522492700695) | > loader_time: 0.3918 (0.014356486651362205)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2023701667785645 (2.2023701667785645) | > loss_disc_real_0: 0.14412206411361694 (0.14412206411361694) | > loss_disc_real_1: 0.28236666321754456 (0.28236666321754456) | > loss_disc_real_2: 0.25325965881347656 (0.25325965881347656) | > loss_disc_real_3: 0.3163953721523285 (0.3163953721523285) | > loss_disc_real_4: 0.13323378562927246 (0.13323378562927246) | > loss_disc_real_5: 0.08596453070640564 (0.08596453070640564) | > loss_0: 2.2023701667785645 (2.2023701667785645) | > loss_gen: 2.500159740447998 (2.500159740447998) | > loss_kl: 5.545527935028076 (5.545527935028076) | > loss_feat: 4.948455810546875 (4.948455810546875) | > loss_mel: 12.376669883728027 (12.376669883728027) | > loss_duration: 3.043400287628174 (3.043400287628174) | > loss_1: 28.414215087890625 (28.414215087890625)  --> STEP: 1 | > loss_disc: 2.185814142227173 (2.185814142227173) | > loss_disc_real_0: 0.08722621202468872 (0.08722621202468872) | > loss_disc_real_1: 0.17370396852493286 (0.17370396852493286) | > loss_disc_real_2: 0.1886858195066452 (0.1886858195066452) | > loss_disc_real_3: 0.18253494799137115 (0.18253494799137115) | > loss_disc_real_4: 0.1128261536359787 (0.1128261536359787) | > loss_disc_real_5: 0.05771246552467346 (0.05771246552467346) | > loss_0: 2.185814142227173 (2.185814142227173) | > loss_gen: 1.9656540155410767 (1.9656540155410767) | > loss_kl: 5.655559062957764 (5.655559062957764) | > loss_feat: 8.660575866699219 (8.660575866699219) | > loss_mel: 26.803974151611328 (26.803974151611328) | > loss_duration: 3.4531049728393555 (3.4531049728393555) | > loss_1: 46.53886795043945 (46.53886795043945)  --> STEP: 2 | > loss_disc: 3.02372670173645 (2.6047704219818115) | > loss_disc_real_0: 0.1433229148387909 (0.11527456343173981) | > loss_disc_real_1: 0.26695340871810913 (0.220328688621521) | > loss_disc_real_2: 0.2544557750225067 (0.22157079726457596) | > loss_disc_real_3: 0.2823379337787628 (0.23243644088506699) | > loss_disc_real_4: 0.26419612765312195 (0.18851114064455032) | > loss_disc_real_5: 0.26278334856033325 (0.16024790704250336) | > loss_0: 3.02372670173645 (2.6047704219818115) | > loss_gen: 1.48234224319458 (1.7239981293678284) | > loss_kl: 6.315205097198486 (5.985382080078125) | > loss_feat: 0.02347646839916706 (4.342026167549193) | > loss_mel: 0.6470608115196228 (13.725517481565475) | > loss_duration: 3.305093765258789 (3.3790993690490723) | > loss_1: 11.773178100585938 (29.156023025512695)  --> STEP: 3 | > loss_disc: 2.811420440673828 (2.673653761545817) | > loss_disc_real_0: 0.19060559570789337 (0.14038490752379099) | > loss_disc_real_1: 0.43741220235824585 (0.29268985986709595) | > loss_disc_real_2: 0.3448692858219147 (0.26267029345035553) | > loss_disc_real_3: 0.3974536955356598 (0.2874421924352646) | > loss_disc_real_4: 0.21190407872200012 (0.1963087866703669) | > loss_disc_real_5: 0.16910438239574432 (0.16320006549358368) | > loss_0: 2.811420440673828 (2.673653761545817) | > loss_gen: 2.1974356174468994 (1.8818106253941853) | > loss_kl: 3.234525442123413 (5.068429867426555) | > loss_feat: 2.8457417488098145 (3.843264694636067) | > loss_mel: 20.49982261657715 (15.983619193236033) | > loss_duration: 2.967212200164795 (3.2418036460876465) | > loss_1: 31.74473762512207 (30.018927892049152) --> EVAL PERFORMANCE | > avg_loader_time: 0.0031637350718180337 (-0.0040743350982666016) | > avg_loss_disc: 2.673653761545817 (-0.28031373023986816) | > avg_loss_disc_real_0: 0.14038490752379099 (-0.19598585367202762) | > avg_loss_disc_real_1: 0.29268985986709595 (+0.06107732156912485) | > avg_loss_disc_real_2: 0.26267029345035553 (-0.008100584149360657) | > avg_loss_disc_real_3: 0.2874421924352646 (-0.008510823051134764) | > avg_loss_disc_real_4: 0.1963087866703669 (-0.04061850408713025) | > avg_loss_disc_real_5: 0.16320006549358368 (-0.11700357496738434) | > avg_loss_0: 2.673653761545817 (-0.28031373023986816) | > avg_loss_gen: 1.8818106253941853 (-0.0739623705546062) | > avg_loss_kl: 5.068429867426555 (+0.3281145890553798) | > avg_loss_feat: 3.843264694636067 (+1.721801944077015) | > avg_loss_mel: 15.983619193236033 (+1.3982608318328857) | > avg_loss_duration: 3.2418036460876465 (-0.03931093215942383) | > avg_loss_1: 30.018927892049152 (+3.3349033991495745)  > EPOCH: 1238/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:48:56)   --> TIME: 2023-10-20 15:49:19 -- STEP: 29/50 -- GLOBAL_STEP: 114930 | > loss_disc: 2.582756996154785 (2.5468961329295716) | > loss_disc_real_0: 0.09253869950771332 (0.14635367206586847) | > loss_disc_real_1: 0.22921304404735565 (0.23430264175965868) | > loss_disc_real_2: 0.2770337164402008 (0.23185065414371162) | > loss_disc_real_3: 0.2368210256099701 (0.24173495815745716) | > loss_disc_real_4: 0.37490442395210266 (0.22128030124666362) | > loss_disc_real_5: 0.48658639192581177 (0.23207249457080817) | > loss_0: 2.582756996154785 (2.5468961329295716) | > grad_norm_0: tensor(325.8140, device='cuda:0') (tensor(546.6857, device='cuda:0')) | > loss_gen: 2.552192449569702 (2.1357397580968924) | > loss_kl: 0.8387416005134583 (0.8041352896854795) | > loss_feat: 4.715516090393066 (4.931102953594307) | > loss_mel: 20.89185905456543 (17.99285939644123) | > loss_duration: 1.339093804359436 (1.3243622574312934) | > loss_1: 30.337404251098633 (27.188199848964295) | > grad_norm_1: tensor(5135.5864, device='cuda:0') (tensor(23247.5430, device='cuda:0')) | > current_lr_0: 5.79882257193359e-05 | > current_lr_1: 5.804624657702788e-05 | > step_time: 0.7797 (0.5839974798005203) | > loader_time: 0.0377 (0.019266301187975652)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3705503940582275 (2.3705503940582275) | > loss_disc_real_0: 0.10737638175487518 (0.10737638175487518) | > loss_disc_real_1: 0.19911600649356842 (0.19911600649356842) | > loss_disc_real_2: 0.300361692905426 (0.300361692905426) | > loss_disc_real_3: 0.3652149438858032 (0.3652149438858032) | > loss_disc_real_4: 0.1999426782131195 (0.1999426782131195) | > loss_disc_real_5: 0.19422973692417145 (0.19422973692417145) | > loss_0: 2.3705503940582275 (2.3705503940582275) | > loss_gen: 2.6551764011383057 (2.6551764011383057) | > loss_kl: 5.915160655975342 (5.915160655975342) | > loss_feat: 8.89387035369873 (8.89387035369873) | > loss_mel: 24.112878799438477 (24.112878799438477) | > loss_duration: 3.0960519313812256 (3.0960519313812256) | > loss_1: 44.67313766479492 (44.67313766479492)  --> STEP: 1 | > loss_disc: 3.7384204864501953 (3.7384204864501953) | > loss_disc_real_0: 0.39774879813194275 (0.39774879813194275) | > loss_disc_real_1: 0.3453177809715271 (0.3453177809715271) | > loss_disc_real_2: 0.34171435236930847 (0.34171435236930847) | > loss_disc_real_3: 0.24432842433452606 (0.24432842433452606) | > loss_disc_real_4: 0.3205779492855072 (0.3205779492855072) | > loss_disc_real_5: 0.18605956435203552 (0.18605956435203552) | > loss_0: 3.7384204864501953 (3.7384204864501953) | > loss_gen: 1.8589458465576172 (1.8589458465576172) | > loss_kl: 5.458731651306152 (5.458731651306152) | > loss_feat: 5.626409530639648 (5.626409530639648) | > loss_mel: 21.1492919921875 (21.1492919921875) | > loss_duration: 3.5090649127960205 (3.5090649127960205) | > loss_1: 37.602439880371094 (37.602439880371094)  --> STEP: 2 | > loss_disc: 2.457141637802124 (3.0977810621261597) | > loss_disc_real_0: 0.21579813957214355 (0.30677346885204315) | > loss_disc_real_1: 0.1907130628824234 (0.26801542192697525) | > loss_disc_real_2: 0.25715354084968567 (0.29943394660949707) | > loss_disc_real_3: 0.5078819394111633 (0.3761051818728447) | > loss_disc_real_4: 0.2897211015224457 (0.30514952540397644) | > loss_disc_real_5: 0.2608638405799866 (0.22346170246601105) | > loss_0: 2.457141637802124 (3.0977810621261597) | > loss_gen: 2.994168519973755 (2.426557183265686) | > loss_kl: 6.189761161804199 (5.824246406555176) | > loss_feat: 8.46696662902832 (7.046688079833984) | > loss_mel: 21.15385627746582 (21.15157413482666) | > loss_duration: 3.364185094833374 (3.4366250038146973) | > loss_1: 42.16893768310547 (39.88568878173828)  --> STEP: 3 | > loss_disc: 2.448476552963257 (2.8813462257385254) | > loss_disc_real_0: 0.27172642946243286 (0.2950911223888397) | > loss_disc_real_1: 0.21591214835643768 (0.2506476640701294) | > loss_disc_real_2: 0.17641609907150269 (0.2584279974301656) | > loss_disc_real_3: 0.21192893385887146 (0.32137976586818695) | > loss_disc_real_4: 0.18933090567588806 (0.26654331882794696) | > loss_disc_real_5: 0.17389324307441711 (0.20693888266881308) | > loss_0: 2.448476552963257 (2.8813462257385254) | > loss_gen: 2.4449172019958496 (2.4326771895090737) | > loss_kl: 2.8509366512298584 (4.83314315478007) | > loss_feat: 6.138247489929199 (6.743874549865723) | > loss_mel: 21.10966682434082 (21.13760503133138) | > loss_duration: 3.06683087348938 (3.3133602937062583) | > loss_1: 35.610595703125 (38.46065775553385) --> EVAL PERFORMANCE | > avg_loader_time: 0.004366715749104817 (+0.0012029806772867837) | > avg_loss_disc: 2.8813462257385254 (+0.20769246419270848) | > avg_loss_disc_real_0: 0.2950911223888397 (+0.15470621486504874) | > avg_loss_disc_real_1: 0.2506476640701294 (-0.04204219579696655) | > avg_loss_disc_real_2: 0.2584279974301656 (-0.0042422960201899396) | > avg_loss_disc_real_3: 0.32137976586818695 (+0.03393757343292236) | > avg_loss_disc_real_4: 0.26654331882794696 (+0.07023453215758005) | > avg_loss_disc_real_5: 0.20693888266881308 (+0.0437388171752294) | > avg_loss_0: 2.8813462257385254 (+0.20769246419270848) | > avg_loss_gen: 2.4326771895090737 (+0.5508665641148884) | > avg_loss_kl: 4.83314315478007 (-0.23528671264648438) | > avg_loss_feat: 6.743874549865723 (+2.9006098552296558) | > avg_loss_mel: 21.13760503133138 (+5.1539858380953465) | > avg_loss_duration: 3.3133602937062583 (+0.0715566476186118) | > avg_loss_1: 38.46065775553385 (+8.4417298634847)  > EPOCH: 1239/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:50:11)   --> TIME: 2023-10-20 15:50:20 -- STEP: 9/50 -- GLOBAL_STEP: 114960 | > loss_disc: 2.219766139984131 (2.7179694175720215) | > loss_disc_real_0: 0.07034382969141006 (0.12077828413910335) | > loss_disc_real_1: 0.27333539724349976 (0.24458498342169654) | > loss_disc_real_2: 0.2769159972667694 (0.2995423509014977) | > loss_disc_real_3: 0.2594044506549835 (0.2600887616475423) | > loss_disc_real_4: 0.24847733974456787 (0.30627670718563926) | > loss_disc_real_5: 0.17908556759357452 (0.3063333448436525) | > loss_0: 2.219766139984131 (2.7179694175720215) | > grad_norm_0: tensor(320.3929, device='cuda:0') (tensor(530.5969, device='cuda:0')) | > loss_gen: 2.5135338306427 (2.2271627850002713) | > loss_kl: 0.35459092259407043 (0.6448253012365766) | > loss_feat: 3.856870412826538 (5.116512576738994) | > loss_mel: 25.43130874633789 (20.86459181043837) | > loss_duration: 1.3058671951293945 (1.3063208659489949) | > loss_1: 33.4621696472168 (30.159413019816082) | > grad_norm_1: tensor(2337.7732, device='cuda:0') (tensor(11826.7354, device='cuda:0')) | > current_lr_0: 5.7930262857123826e-05 | > current_lr_1: 5.79882257193359e-05 | > step_time: 0.455 (0.44162315792507595) | > loader_time: 0.0093 (0.01422164175245497)  --> TIME: 2023-10-20 15:50:40 -- STEP: 39/50 -- GLOBAL_STEP: 114990 | > loss_disc: 2.894866704940796 (2.481225325511052) | > loss_disc_real_0: 0.08669622242450714 (0.12072308729283321) | > loss_disc_real_1: 0.25115320086479187 (0.2261434642550273) | > loss_disc_real_2: 0.25470322370529175 (0.23862962596691573) | > loss_disc_real_3: 0.269435852766037 (0.24454616325405928) | > loss_disc_real_4: 0.2583324909210205 (0.2391905999288727) | > loss_disc_real_5: 0.28239327669143677 (0.23679404361889908) | > loss_0: 2.894866704940796 (2.481225325511052) | > grad_norm_0: tensor(930.4696, device='cuda:0') (tensor(602.7603, device='cuda:0')) | > loss_gen: 1.6247895956039429 (2.278460126656753) | > loss_kl: 0.4180361330509186 (0.7117711443167466) | > loss_feat: 0.5308657288551331 (5.718940909092243) | > loss_mel: 12.513882637023926 (21.280762537931786) | > loss_duration: 1.346036672592163 (1.3054367701212566) | > loss_1: 16.433610916137695 (31.295371495760403) | > grad_norm_1: tensor(5220.9761, device='cuda:0') (tensor(14381.4404, device='cuda:0')) | > current_lr_0: 5.7930262857123826e-05 | > current_lr_1: 5.79882257193359e-05 | > step_time: 0.4954 (0.5805202753115923) | > loader_time: 0.0088 (0.02011897625067295)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.022883415222168 (3.022883415222168) | > loss_disc_real_0: 0.19726267457008362 (0.19726267457008362) | > loss_disc_real_1: 0.36422374844551086 (0.36422374844551086) | > loss_disc_real_2: 0.3911733627319336 (0.3911733627319336) | > loss_disc_real_3: 0.28111615777015686 (0.28111615777015686) | > loss_disc_real_4: 0.1610763669013977 (0.1610763669013977) | > loss_disc_real_5: 0.3220236301422119 (0.3220236301422119) | > loss_0: 3.022883415222168 (3.022883415222168) | > loss_gen: 1.8906893730163574 (1.8906893730163574) | > loss_kl: 5.61759090423584 (5.61759090423584) | > loss_feat: 7.080654621124268 (7.080654621124268) | > loss_mel: 21.252017974853516 (21.252017974853516) | > loss_duration: 2.937105655670166 (2.937105655670166) | > loss_1: 38.77806091308594 (38.77806091308594)  --> STEP: 1 | > loss_disc: 2.7501959800720215 (2.7501959800720215) | > loss_disc_real_0: 0.17084284126758575 (0.17084284126758575) | > loss_disc_real_1: 0.3114740550518036 (0.3114740550518036) | > loss_disc_real_2: 0.2831687033176422 (0.2831687033176422) | > loss_disc_real_3: 0.2217779904603958 (0.2217779904603958) | > loss_disc_real_4: 0.3137964904308319 (0.3137964904308319) | > loss_disc_real_5: 0.39830729365348816 (0.39830729365348816) | > loss_0: 2.7501959800720215 (2.7501959800720215) | > loss_gen: 2.381071090698242 (2.381071090698242) | > loss_kl: 5.671299934387207 (5.671299934387207) | > loss_feat: 8.50882339477539 (8.50882339477539) | > loss_mel: 22.29535675048828 (22.29535675048828) | > loss_duration: 3.3829777240753174 (3.3829777240753174) | > loss_1: 42.23952865600586 (42.23952865600586)  --> STEP: 2 | > loss_disc: 3.010688304901123 (2.8804421424865723) | > loss_disc_real_0: 0.3537973165512085 (0.2623200789093971) | > loss_disc_real_1: 0.2778925597667694 (0.2946833074092865) | > loss_disc_real_2: 0.328111469745636 (0.3056400865316391) | > loss_disc_real_3: 0.3549961745738983 (0.28838708251714706) | > loss_disc_real_4: 0.3321690857410431 (0.3229827880859375) | > loss_disc_real_5: 0.35749828815460205 (0.3779027909040451) | > loss_0: 3.010688304901123 (2.8804421424865723) | > loss_gen: 2.393857479095459 (2.3874642848968506) | > loss_kl: 5.622801780700684 (5.647050857543945) | > loss_feat: 2.688284397125244 (5.598553895950317) | > loss_mel: 24.97117042541504 (23.63326358795166) | > loss_duration: 3.3254735469818115 (3.3542256355285645) | > loss_1: 39.0015869140625 (40.62055778503418)  --> STEP: 3 | > loss_disc: 3.3897953033447266 (3.0502265294392905) | > loss_disc_real_0: 0.39522263407707214 (0.30662093063195545) | > loss_disc_real_1: 0.22620581090450287 (0.27185747524102527) | > loss_disc_real_2: 0.3309342861175537 (0.31407148639361065) | > loss_disc_real_3: 0.323055237531662 (0.29994313418865204) | > loss_disc_real_4: 0.34455981850624084 (0.33017513155937195) | > loss_disc_real_5: 0.38343846797943115 (0.37974801659584045) | > loss_0: 3.3897953033447266 (3.0502265294392905) | > loss_gen: 1.9717121124267578 (2.24888022740682) | > loss_kl: 2.680957078933716 (4.658352931340535) | > loss_feat: 3.8541922569274902 (5.017100016276042) | > loss_mel: 21.542438507080078 (22.9363218943278) | > loss_duration: 3.118191719055176 (3.275547663370768) | > loss_1: 33.1674919128418 (38.13620249430338) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_115000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0214478969573975 (3.043031871318817) | > loss_disc_real_0: 0.23221184313297272 (0.2880186587572098) | > loss_disc_real_1: 0.27808019518852234 (0.27341315522789955) | > loss_disc_real_2: 0.27994877099990845 (0.3055408075451851) | > loss_disc_real_3: 0.2471589893102646 (0.2867470979690552) | > loss_disc_real_4: 0.252238392829895 (0.3106909468770027) | > loss_disc_real_5: 0.2945415675640106 (0.358446404337883) | > loss_0: 3.0214478969573975 (3.043031871318817) | > loss_gen: 1.570255994796753 (2.079224169254303) | > loss_kl: 5.806236743927002 (4.945323884487152) | > loss_feat: 0.050296343863010406 (3.775399098172784) | > loss_mel: 2.0026025772094727 (17.702892065048218) | > loss_duration: 3.064866542816162 (3.2228773832321167) | > loss_1: 12.494258880615234 (31.725716590881348)  --> STEP: 1 | > loss_disc: 3.2114627361297607 (3.076718044281006) | > loss_disc_real_0: 0.3929835557937622 (0.30901163816452026) | > loss_disc_real_1: 0.31643491983413696 (0.28201750814914706) | > loss_disc_real_2: 0.5237295031547546 (0.349178546667099) | > loss_disc_real_3: 0.34733375906944275 (0.29886443018913267) | > loss_disc_real_4: 0.3298517167568207 (0.3145231008529663) | > loss_disc_real_5: 0.5447996854782104 (0.39571706056594846) | > loss_0: 3.2114627361297607 (3.076718044281006) | > loss_gen: 2.944124698638916 (2.2522042751312257) | > loss_kl: 5.514689922332764 (5.059197092056275) | > loss_feat: 5.641709327697754 (4.148661144077778) | > loss_mel: 22.42167091369629 (18.64664783477783) | > loss_duration: 3.5293843746185303 (3.2841787815093992) | > loss_1: 40.05158233642578 (33.390889739990236)  --> STEP: 2 | > loss_disc: 2.822932243347168 (3.0344204107920327) | > loss_disc_real_0: 0.18013767898082733 (0.2875326449672381) | > loss_disc_real_1: 0.2652870714664459 (0.2792291020353635) | > loss_disc_real_2: 0.2495279759168625 (0.33257011820872623) | > loss_disc_real_3: 0.26050421595573425 (0.29247106115023297) | > loss_disc_real_4: 0.25821512937545776 (0.3051384389400482) | > loss_disc_real_5: 0.2945282459259033 (0.378852258125941) | > loss_0: 2.822932243347168 (3.0344204107920327) | > loss_gen: 1.7887518405914307 (2.1749622027079263) | > loss_kl: 5.910732269287109 (5.201119621594747) | > loss_feat: 0.9427563548088074 (3.614343679199616) | > loss_mel: 14.45840835571289 (17.948607921600342) | > loss_duration: 3.273510217666626 (3.282400687535604) | > loss_1: 26.37415885925293 (32.221434593200684)  --> STEP: 3 | > loss_disc: 3.397195339202881 (3.0862454005650113) | > loss_disc_real_0: 0.11432531476020813 (0.2627887406519481) | > loss_disc_real_1: 0.18266724050045013 (0.26543455038751873) | > loss_disc_real_2: 0.34657296538352966 (0.3345705249479839) | > loss_disc_real_3: 0.35630255937576294 (0.30158984661102295) | > loss_disc_real_4: 0.22907468676567078 (0.2942721886294229) | > loss_disc_real_5: 0.5447303056716919 (0.40254912206104826) | > loss_0: 3.397195339202881 (3.0862454005650113) | > loss_gen: 1.6042505502700806 (2.093431966645377) | > loss_kl: 2.8516087532043457 (4.865475211824689) | > loss_feat: 6.344562530517578 (4.004374943673611) | > loss_mel: 22.76736831665039 (18.63700226375035) | > loss_duration: 3.191748857498169 (3.2694504261016846) | > loss_1: 36.75954055786133 (32.86973544529506) --> EVAL PERFORMANCE | > avg_loader_time: 0.4938983917236328 (+0.489531675974528) | > avg_loss_disc: 3.0862454005650113 (+0.2048991748264859) | > avg_loss_disc_real_0: 0.2627887406519481 (-0.032302381736891594) | > avg_loss_disc_real_1: 0.26543455038751873 (+0.014786886317389336) | > avg_loss_disc_real_2: 0.3345705249479839 (+0.0761425275178183) | > avg_loss_disc_real_3: 0.30158984661102295 (-0.019789919257164) | > avg_loss_disc_real_4: 0.2942721886294229 (+0.02772886980147593) | > avg_loss_disc_real_5: 0.40254912206104826 (+0.19561023939223518) | > avg_loss_0: 3.0862454005650113 (+0.2048991748264859) | > avg_loss_gen: 2.093431966645377 (-0.33924522286369685) | > avg_loss_kl: 4.865475211824689 (+0.032332057044619056) | > avg_loss_feat: 4.004374943673611 (-2.739499606192112) | > avg_loss_mel: 18.63700226375035 (-2.5006027675810287) | > avg_loss_duration: 3.2694504261016846 (-0.043909867604573716) | > avg_loss_1: 32.86973544529506 (-5.590922310238788)  > EPOCH: 1240/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:51:13)   --> TIME: 2023-10-20 15:51:28 -- STEP: 19/50 -- GLOBAL_STEP: 115020 | > loss_disc: 2.223830223083496 (2.5132884289089) | > loss_disc_real_0: 0.1439104974269867 (0.17033376123167968) | > loss_disc_real_1: 0.20850074291229248 (0.23474323592687907) | > loss_disc_real_2: 0.1743835210800171 (0.24261435866355902) | > loss_disc_real_3: 0.25944429636001587 (0.23784497458683818) | > loss_disc_real_4: 0.2279190570116043 (0.23397181300740494) | > loss_disc_real_5: 0.25953012704849243 (0.21791774426635943) | > loss_0: 2.223830223083496 (2.5132884289089) | > grad_norm_0: tensor(308.6492, device='cuda:0') (tensor(582.0062, device='cuda:0')) | > loss_gen: 2.5452473163604736 (2.167457913097582) | > loss_kl: 0.8953505754470825 (0.8395022781271684) | > loss_feat: 4.606080532073975 (4.468245498541939) | > loss_mel: 20.546775817871094 (16.733733641473872) | > loss_duration: 1.3873060941696167 (1.3403759253652472) | > loss_1: 29.98076057434082 (25.549315578059147) | > grad_norm_1: tensor(4413.3096, device='cuda:0') (tensor(19954.4355, device='cuda:0')) | > current_lr_0: 5.787235793242156e-05 | > current_lr_1: 5.7930262857123826e-05 | > step_time: 0.3298 (0.4972224988435444) | > loader_time: 0.0113 (0.013133325074848375)  --> TIME: 2023-10-20 15:51:47 -- STEP: 49/50 -- GLOBAL_STEP: 115050 | > loss_disc: 2.986257314682007 (2.5341159178286183) | > loss_disc_real_0: 0.29606539011001587 (0.16236409435656915) | > loss_disc_real_1: 0.23491865396499634 (0.22756015015195827) | > loss_disc_real_2: 0.25460219383239746 (0.2336034573310492) | > loss_disc_real_3: 0.2553170323371887 (0.23193567367840787) | > loss_disc_real_4: 0.24239379167556763 (0.2405421987784152) | > loss_disc_real_5: 0.25491654872894287 (0.23405055416633888) | > loss_0: 2.986257314682007 (2.5341159178286183) | > grad_norm_0: tensor(1025.2258, device='cuda:0') (tensor(576.7225, device='cuda:0')) | > loss_gen: 1.536377191543579 (2.1900838126941604) | > loss_kl: 0.744070291519165 (0.7838894411617395) | > loss_feat: 0.0724729672074318 (4.988973225447899) | > loss_mel: 1.5516504049301147 (18.251726303781776) | > loss_duration: 1.4533764123916626 (1.3145677313512685) | > loss_1: 5.35794734954834 (27.529240802842743) | > grad_norm_1: tensor(48007.4375, device='cuda:0') (tensor(18158.6875, device='cuda:0')) | > current_lr_0: 5.787235793242156e-05 | > current_lr_1: 5.7930262857123826e-05 | > step_time: 1.0243 (0.5451227402200505) | > loader_time: 0.8186 (0.031240628690135722)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1065025329589844 (3.1065025329589844) | > loss_disc_real_0: 0.24593724310398102 (0.24593724310398102) | > loss_disc_real_1: 0.29201820492744446 (0.29201820492744446) | > loss_disc_real_2: 0.3581187129020691 (0.3581187129020691) | > loss_disc_real_3: 0.3255578279495239 (0.3255578279495239) | > loss_disc_real_4: 0.4015781879425049 (0.4015781879425049) | > loss_disc_real_5: 0.30428367853164673 (0.30428367853164673) | > loss_0: 3.1065025329589844 (3.1065025329589844) | > loss_gen: 2.713512420654297 (2.713512420654297) | > loss_kl: 6.145564556121826 (6.145564556121826) | > loss_feat: 9.66590690612793 (9.66590690612793) | > loss_mel: 20.947214126586914 (20.947214126586914) | > loss_duration: 3.138730764389038 (3.138730764389038) | > loss_1: 42.61092758178711 (42.61092758178711)  --> STEP: 1 | > loss_disc: 3.183292865753174 (3.183292865753174) | > loss_disc_real_0: 0.7066431641578674 (0.7066431641578674) | > loss_disc_real_1: 0.21588189899921417 (0.21588189899921417) | > loss_disc_real_2: 0.2495851069688797 (0.2495851069688797) | > loss_disc_real_3: 0.3259594142436981 (0.3259594142436981) | > loss_disc_real_4: 0.3850654065608978 (0.3850654065608978) | > loss_disc_real_5: 0.4247097969055176 (0.4247097969055176) | > loss_0: 3.183292865753174 (3.183292865753174) | > loss_gen: 2.87222957611084 (2.87222957611084) | > loss_kl: 5.571496963500977 (5.571496963500977) | > loss_feat: 6.710509777069092 (6.710509777069092) | > loss_mel: 23.31610679626465 (23.31610679626465) | > loss_duration: 3.4994468688964844 (3.4994468688964844) | > loss_1: 41.969791412353516 (41.969791412353516)  --> STEP: 2 | > loss_disc: 2.602977752685547 (2.8931353092193604) | > loss_disc_real_0: 0.31822633743286133 (0.5124347507953644) | > loss_disc_real_1: 0.21670660376548767 (0.21629425138235092) | > loss_disc_real_2: 0.24122042953968048 (0.2454027682542801) | > loss_disc_real_3: 0.1439695656299591 (0.2349644899368286) | > loss_disc_real_4: 0.27922192215919495 (0.3321436643600464) | > loss_disc_real_5: 0.3336886167526245 (0.37919920682907104) | > loss_0: 2.602977752685547 (2.8931353092193604) | > loss_gen: 2.4845476150512695 (2.6783885955810547) | > loss_kl: 5.869266986846924 (5.72038197517395) | > loss_feat: 9.526510238647461 (8.118510007858276) | > loss_mel: 24.634218215942383 (23.975162506103516) | > loss_duration: 3.3179268836975098 (3.408686876296997) | > loss_1: 45.83246994018555 (43.90113067626953)  --> STEP: 3 | > loss_disc: 2.8166022300720215 (2.867624282836914) | > loss_disc_real_0: 0.18308033049106598 (0.4026499440272649) | > loss_disc_real_1: 0.2658625841140747 (0.2328170289595922) | > loss_disc_real_2: 0.20042702555656433 (0.23041085402170816) | > loss_disc_real_3: 0.3733101785182953 (0.2810797194639842) | > loss_disc_real_4: 0.3381306231021881 (0.33413931727409363) | > loss_disc_real_5: 0.3231225907802582 (0.36050700147946674) | > loss_0: 2.8166022300720215 (2.867624282836914) | > loss_gen: 2.281322956085205 (2.5460333824157715) | > loss_kl: 3.1913607120513916 (4.877374887466431) | > loss_feat: 5.263993263244629 (7.167004426320394) | > loss_mel: 21.043474197387695 (22.99793306986491) | > loss_duration: 3.068610191345215 (3.29532798131307) | > loss_1: 34.84876251220703 (40.88367462158203) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024663607279459634 (-0.49143203099568683) | > avg_loss_disc: 2.867624282836914 (-0.21862111772809723) | > avg_loss_disc_real_0: 0.4026499440272649 (+0.13986120337531677) | > avg_loss_disc_real_1: 0.2328170289595922 (-0.03261752142792654) | > avg_loss_disc_real_2: 0.23041085402170816 (-0.10415967092627573) | > avg_loss_disc_real_3: 0.2810797194639842 (-0.02051012714703876) | > avg_loss_disc_real_4: 0.33413931727409363 (+0.039867128644670735) | > avg_loss_disc_real_5: 0.36050700147946674 (-0.04204212058158152) | > avg_loss_0: 2.867624282836914 (-0.21862111772809723) | > avg_loss_gen: 2.5460333824157715 (+0.4526014157703946) | > avg_loss_kl: 4.877374887466431 (+0.011899675641741325) | > avg_loss_feat: 7.167004426320394 (+3.162629482646783) | > avg_loss_mel: 22.99793306986491 (+4.36093080611456) | > avg_loss_duration: 3.29532798131307 (+0.02587755521138524) | > avg_loss_1: 40.88367462158203 (+8.013939176286968)  > EPOCH: 1241/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:52:04)   --> TIME: 2023-10-20 15:52:26 -- STEP: 29/50 -- GLOBAL_STEP: 115080 | > loss_disc: 2.5672447681427 (2.3733598528237168) | > loss_disc_real_0: 0.1435643434524536 (0.11872472700759254) | > loss_disc_real_1: 0.165436789393425 (0.2076932006868823) | > loss_disc_real_2: 0.1745539754629135 (0.2346923960180118) | > loss_disc_real_3: 0.2970001995563507 (0.22555481449797235) | > loss_disc_real_4: 0.3497718572616577 (0.233343751779918) | > loss_disc_real_5: 0.26610830426216125 (0.21723621402835025) | > loss_0: 2.5672447681427 (2.3733598528237168) | > grad_norm_0: tensor(284.0406, device='cuda:0') (tensor(589.2369, device='cuda:0')) | > loss_gen: 2.462568521499634 (2.2977909096356095) | > loss_kl: 0.6245933175086975 (0.8096835119970913) | > loss_feat: 5.517939567565918 (5.97017383010223) | > loss_mel: 20.395248413085938 (21.405673914942245) | > loss_duration: 1.3159778118133545 (1.3128359071139633) | > loss_1: 30.316326141357422 (31.796158264423237) | > grad_norm_1: tensor(2463.1182, device='cuda:0') (tensor(17014.7715, device='cuda:0')) | > current_lr_0: 5.7814510887316914e-05 | > current_lr_1: 5.787235793242156e-05 | > step_time: 0.8211 (0.5749022878449539) | > loader_time: 0.0264 (0.01717566621714625)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3263795375823975 (2.3263795375823975) | > loss_disc_real_0: 0.16872671246528625 (0.16872671246528625) | > loss_disc_real_1: 0.3395500183105469 (0.3395500183105469) | > loss_disc_real_2: 0.37183305621147156 (0.37183305621147156) | > loss_disc_real_3: 0.41594013571739197 (0.41594013571739197) | > loss_disc_real_4: 0.16470611095428467 (0.16470611095428467) | > loss_disc_real_5: 0.16443417966365814 (0.16443417966365814) | > loss_0: 2.3263795375823975 (2.3263795375823975) | > loss_gen: 3.0505099296569824 (3.0505099296569824) | > loss_kl: 6.162750244140625 (6.162750244140625) | > loss_feat: 9.204780578613281 (9.204780578613281) | > loss_mel: 20.842985153198242 (20.842985153198242) | > loss_duration: 3.0328826904296875 (3.0328826904296875) | > loss_1: 42.29391098022461 (42.29391098022461)  --> STEP: 1 | > loss_disc: 2.9687771797180176 (2.9687771797180176) | > loss_disc_real_0: 0.3421594500541687 (0.3421594500541687) | > loss_disc_real_1: 0.22392666339874268 (0.22392666339874268) | > loss_disc_real_2: 0.27449190616607666 (0.27449190616607666) | > loss_disc_real_3: 0.26585784554481506 (0.26585784554481506) | > loss_disc_real_4: 0.255775511264801 (0.255775511264801) | > loss_disc_real_5: 0.25225532054901123 (0.25225532054901123) | > loss_0: 2.9687771797180176 (2.9687771797180176) | > loss_gen: 1.6851481199264526 (1.6851481199264526) | > loss_kl: 6.249142646789551 (6.249142646789551) | > loss_feat: 0.337697297334671 (0.337697297334671) | > loss_mel: 6.1169819831848145 (6.1169819831848145) | > loss_duration: 3.5490691661834717 (3.5490691661834717) | > loss_1: 17.938039779663086 (17.938039779663086)  --> STEP: 2 | > loss_disc: 1.4957765340805054 (2.2322768568992615) | > loss_disc_real_0: 0.04975556582212448 (0.1959575079381466) | > loss_disc_real_1: 0.11074226349592209 (0.16733446344733238) | > loss_disc_real_2: 0.07501325756311417 (0.1747525818645954) | > loss_disc_real_3: 0.09727045148611069 (0.18156414851546288) | > loss_disc_real_4: 0.06079234555363655 (0.1582839284092188) | > loss_disc_real_5: 0.034904297441244125 (0.14357980899512768) | > loss_0: 1.4957765340805054 (2.2322768568992615) | > loss_gen: 2.702023983001709 (2.193586051464081) | > loss_kl: 5.863765716552734 (6.056454181671143) | > loss_feat: 14.119531631469727 (7.228614464402199) | > loss_mel: 26.02887535095215 (16.07292866706848) | > loss_duration: 3.3433024883270264 (3.446185827255249) | > loss_1: 52.057498931884766 (34.997769355773926)  --> STEP: 3 | > loss_disc: 2.176652193069458 (2.213735302289327) | > loss_disc_real_0: 0.10531004518270493 (0.16574168701966605) | > loss_disc_real_1: 0.26298078894615173 (0.19921657194693884) | > loss_disc_real_2: 0.1711752712726593 (0.1735601450006167) | > loss_disc_real_3: 0.31230247020721436 (0.22514358907938004) | > loss_disc_real_4: 0.21572650969028473 (0.17743145550290743) | > loss_disc_real_5: 0.11859754472970963 (0.13525238757332167) | > loss_0: 2.176652193069458 (2.213735302289327) | > loss_gen: 2.7617835998535156 (2.382985234260559) | > loss_kl: 2.980433702468872 (5.031114021937053) | > loss_feat: 8.088939666748047 (7.515389531850815) | > loss_mel: 24.7365779876709 (18.960811773935955) | > loss_duration: 3.1213150024414062 (3.3378955523173013) | > loss_1: 41.689048767089844 (37.22819582621256) --> EVAL PERFORMANCE | > avg_loader_time: 0.011164267857869467 (+0.008697907129923504) | > avg_loss_disc: 2.213735302289327 (-0.6538889805475869) | > avg_loss_disc_real_0: 0.16574168701966605 (-0.23690825700759885) | > avg_loss_disc_real_1: 0.19921657194693884 (-0.03360045701265335) | > avg_loss_disc_real_2: 0.1735601450006167 (-0.05685070902109146) | > avg_loss_disc_real_3: 0.22514358907938004 (-0.055936130384604155) | > avg_loss_disc_real_4: 0.17743145550290743 (-0.1567078617711862) | > avg_loss_disc_real_5: 0.13525238757332167 (-0.22525461390614507) | > avg_loss_0: 2.213735302289327 (-0.6538889805475869) | > avg_loss_gen: 2.382985234260559 (-0.1630481481552124) | > avg_loss_kl: 5.031114021937053 (+0.15373913447062204) | > avg_loss_feat: 7.515389531850815 (+0.34838510553042124) | > avg_loss_mel: 18.960811773935955 (-4.037121295928955) | > avg_loss_duration: 3.3378955523173013 (+0.042567571004231475) | > avg_loss_1: 37.22819582621256 (-3.6554787953694685)  > EPOCH: 1242/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:52:52)   --> TIME: 2023-10-20 15:53:06 -- STEP: 9/50 -- GLOBAL_STEP: 115110 | > loss_disc: 2.0586791038513184 (2.6401225990719266) | > loss_disc_real_0: 0.02873310074210167 (0.20010914612147543) | > loss_disc_real_1: 0.1609373688697815 (0.2613449941078822) | > loss_disc_real_2: 0.2067548781633377 (0.3013249221775267) | > loss_disc_real_3: 0.2509249150753021 (0.2666509598493576) | > loss_disc_real_4: 0.264089971780777 (0.28499257067839306) | > loss_disc_real_5: 0.21028968691825867 (0.2582089338037703) | > loss_0: 2.0586791038513184 (2.6401225990719266) | > grad_norm_0: tensor(356.0501, device='cuda:0') (tensor(640.1901, device='cuda:0')) | > loss_gen: 2.4242892265319824 (2.3326306343078613) | > loss_kl: 0.6992594599723816 (0.7469635307788849) | > loss_feat: 5.461241722106934 (4.7328910496499805) | > loss_mel: 22.077550888061523 (18.958423879411484) | > loss_duration: 1.2891126871109009 (1.2899318801032171) | > loss_1: 31.951454162597656 (28.06084092458089) | > grad_norm_1: tensor(3087.2510, device='cuda:0') (tensor(10690.5859, device='cuda:0')) | > current_lr_0: 5.775672166395561e-05 | > current_lr_1: 5.7814510887316914e-05 | > step_time: 0.6819 (0.8928593529595269) | > loader_time: 0.0244 (0.03233514891730414)  --> TIME: 2023-10-20 15:53:30 -- STEP: 39/50 -- GLOBAL_STEP: 115140 | > loss_disc: 2.895826816558838 (2.5969309378892946) | > loss_disc_real_0: 0.29587292671203613 (0.1530739007374415) | > loss_disc_real_1: 0.25128740072250366 (0.23015128209804878) | > loss_disc_real_2: 0.2359362691640854 (0.24116340680764276) | > loss_disc_real_3: 0.2694885730743408 (0.23869847534940797) | > loss_disc_real_4: 0.23327285051345825 (0.24716606344550074) | > loss_disc_real_5: 0.24123355746269226 (0.2535674148836197) | > loss_0: 2.895826816558838 (2.5969309378892946) | > grad_norm_0: tensor(1536.7552, device='cuda:0') (tensor(735.9218, device='cuda:0')) | > loss_gen: 1.645613193511963 (2.1629514571947936) | > loss_kl: 0.6631593704223633 (0.7494662656233861) | > loss_feat: 0.31686151027679443 (5.111951723885842) | > loss_mel: 1.954932451248169 (19.270513167748085) | > loss_duration: 1.374369502067566 (1.302731475768945) | > loss_1: 5.9549360275268555 (28.597613860399296) | > grad_norm_1: tensor(22527.4277, device='cuda:0') (tensor(20024.9961, device='cuda:0')) | > current_lr_0: 5.775672166395561e-05 | > current_lr_1: 5.7814510887316914e-05 | > step_time: 0.8187 (0.786433219909668) | > loader_time: 0.003 (0.022512050775381237)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.390935182571411 (2.390935182571411) | > loss_disc_real_0: 0.21071341633796692 (0.21071341633796692) | > loss_disc_real_1: 0.3425914943218231 (0.3425914943218231) | > loss_disc_real_2: 0.3543986678123474 (0.3543986678123474) | > loss_disc_real_3: 0.26547032594680786 (0.26547032594680786) | > loss_disc_real_4: 0.23019449412822723 (0.23019449412822723) | > loss_disc_real_5: 0.13573119044303894 (0.13573119044303894) | > loss_0: 2.390935182571411 (2.390935182571411) | > loss_gen: 3.24137020111084 (3.24137020111084) | > loss_kl: 6.05481481552124 (6.05481481552124) | > loss_feat: 7.007422924041748 (7.007422924041748) | > loss_mel: 22.502958297729492 (22.502958297729492) | > loss_duration: 3.0559093952178955 (3.0559093952178955) | > loss_1: 41.86247634887695 (41.86247634887695)  --> STEP: 1 | > loss_disc: 3.0630507469177246 (3.0630507469177246) | > loss_disc_real_0: 0.4667431712150574 (0.4667431712150574) | > loss_disc_real_1: 0.14869776368141174 (0.14869776368141174) | > loss_disc_real_2: 0.3173343539237976 (0.3173343539237976) | > loss_disc_real_3: 0.30223944783210754 (0.30223944783210754) | > loss_disc_real_4: 0.41992348432540894 (0.41992348432540894) | > loss_disc_real_5: 0.3093838095664978 (0.3093838095664978) | > loss_0: 3.0630507469177246 (3.0630507469177246) | > loss_gen: 2.3595945835113525 (2.3595945835113525) | > loss_kl: 6.2094502449035645 (6.2094502449035645) | > loss_feat: 8.527616500854492 (8.527616500854492) | > loss_mel: 22.569568634033203 (22.569568634033203) | > loss_duration: 3.517733573913574 (3.517733573913574) | > loss_1: 43.183963775634766 (43.183963775634766)  --> STEP: 2 | > loss_disc: 3.1057345867156982 (3.0843926668167114) | > loss_disc_real_0: 0.1471649706363678 (0.3069540709257126) | > loss_disc_real_1: 0.3994089961051941 (0.2740533798933029) | > loss_disc_real_2: 0.29682978987693787 (0.30708207190036774) | > loss_disc_real_3: 0.3080257773399353 (0.3051326125860214) | > loss_disc_real_4: 0.3717985451221466 (0.39586101472377777) | > loss_disc_real_5: 0.2512015104293823 (0.28029265999794006) | > loss_0: 3.1057345867156982 (3.0843926668167114) | > loss_gen: 2.3435094356536865 (2.3515520095825195) | > loss_kl: 5.9198994636535645 (6.0646748542785645) | > loss_feat: 10.395517349243164 (9.461566925048828) | > loss_mel: 25.779619216918945 (24.174593925476074) | > loss_duration: 3.3310799598693848 (3.4244067668914795) | > loss_1: 47.76962661743164 (45.4767951965332)  --> STEP: 3 | > loss_disc: 3.014592170715332 (3.0611258347829184) | > loss_disc_real_0: 0.33657631278038025 (0.3168281515439351) | > loss_disc_real_1: 0.2708929777145386 (0.27299991250038147) | > loss_disc_real_2: 0.25888940691947937 (0.2910178502400716) | > loss_disc_real_3: 0.27259254455566406 (0.29428592324256897) | > loss_disc_real_4: 0.2397317886352539 (0.34381793936093646) | > loss_disc_real_5: 0.2561107873916626 (0.2722320357958476) | > loss_0: 3.014592170715332 (3.0611258347829184) | > loss_gen: 1.6400189399719238 (2.114374319712321) | > loss_kl: 2.79946231842041 (4.97627067565918) | > loss_feat: 0.05154517665505409 (6.32489300891757) | > loss_mel: 1.9572982788085938 (16.768828709920246) | > loss_duration: 2.960510015487671 (3.2697745164235434) | > loss_1: 9.408834457397461 (33.45414161682129) --> EVAL PERFORMANCE | > avg_loader_time: 0.011176188786824545 (+1.1920928955078125e-05) | > avg_loss_disc: 3.0611258347829184 (+0.8473905324935913) | > avg_loss_disc_real_0: 0.3168281515439351 (+0.15108646452426908) | > avg_loss_disc_real_1: 0.27299991250038147 (+0.07378334055344263) | > avg_loss_disc_real_2: 0.2910178502400716 (+0.1174577052394549) | > avg_loss_disc_real_3: 0.29428592324256897 (+0.06914233416318893) | > avg_loss_disc_real_4: 0.34381793936093646 (+0.16638648385802904) | > avg_loss_disc_real_5: 0.2722320357958476 (+0.13697964822252592) | > avg_loss_0: 3.0611258347829184 (+0.8473905324935913) | > avg_loss_gen: 2.114374319712321 (-0.26861091454823827) | > avg_loss_kl: 4.97627067565918 (-0.05484334627787302) | > avg_loss_feat: 6.32489300891757 (-1.1904965229332447) | > avg_loss_mel: 16.768828709920246 (-2.1919830640157087) | > avg_loss_duration: 3.2697745164235434 (-0.06812103589375784) | > avg_loss_1: 33.45414161682129 (-3.7740542093912737)  > EPOCH: 1243/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:53:45)   --> TIME: 2023-10-20 15:54:15 -- STEP: 19/50 -- GLOBAL_STEP: 115170 | > loss_disc: 2.654433012008667 (2.714230079399912) | > loss_disc_real_0: 0.13952699303627014 (0.21139405922670113) | > loss_disc_real_1: 0.2537449300289154 (0.23607703259116725) | > loss_disc_real_2: 0.2014852911233902 (0.22202941147904648) | > loss_disc_real_3: 0.22921358048915863 (0.23062164885433098) | > loss_disc_real_4: 0.2637726068496704 (0.24634626880288124) | > loss_disc_real_5: 0.23286697268486023 (0.2559676514448304) | > loss_0: 2.654433012008667 (2.714230079399912) | > grad_norm_0: tensor(544.0383, device='cuda:0') (tensor(723.3954, device='cuda:0')) | > loss_gen: 1.777194619178772 (1.987105833856683) | > loss_kl: 0.9254337549209595 (0.700428285096821) | > loss_feat: 1.7379432916641235 (3.937981310055444) | > loss_mel: 19.050546646118164 (14.979930927878932) | > loss_duration: 1.4506282806396484 (1.3420324451044987) | > loss_1: 24.941747665405273 (22.947479047273333) | > grad_norm_1: tensor(2591.6169, device='cuda:0') (tensor(30273.1543, device='cuda:0')) | > current_lr_0: 5.769899020454121e-05 | > current_lr_1: 5.775672166395561e-05 | > step_time: 0.8704 (0.7210503251929032) | > loader_time: 0.0536 (0.030650025919864054)  --> TIME: 2023-10-20 15:54:31 -- STEP: 49/50 -- GLOBAL_STEP: 115200 | > loss_disc: 2.932722568511963 (2.566045060449717) | > loss_disc_real_0: 0.1765204668045044 (0.1596204302064619) | > loss_disc_real_1: 0.20089615881443024 (0.2271386274725807) | > loss_disc_real_2: 0.18008047342300415 (0.22207754926413906) | > loss_disc_real_3: 0.32926470041275024 (0.23174176912526695) | > loss_disc_real_4: 0.28904634714126587 (0.24585676664600564) | > loss_disc_real_5: 0.34534502029418945 (0.24595230156365705) | > loss_0: 2.932722568511963 (2.566045060449717) | > grad_norm_0: tensor(754.8947, device='cuda:0') (tensor(623.9505, device='cuda:0')) | > loss_gen: 1.9083105325698853 (2.155680452074324) | > loss_kl: 0.5372126698493958 (0.7373750665966345) | > loss_feat: 5.2205963134765625 (5.2839645266684965) | > loss_mel: 20.50183868408203 (18.34360189827121) | > loss_duration: 1.397702693939209 (1.3121040062028535) | > loss_1: 29.56566047668457 (27.832726206098283) | > grad_norm_1: tensor(14902.4570, device='cuda:0') (tensor(22215.2207, device='cuda:0')) | > current_lr_0: 5.769899020454121e-05 | > current_lr_1: 5.775672166395561e-05 | > step_time: 0.9385 (0.5919410355237066) | > loader_time: 0.5103 (0.0317920665351712)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.711209774017334 (2.711209774017334) | > loss_disc_real_0: 0.23899969458580017 (0.23899969458580017) | > loss_disc_real_1: 0.2256961613893509 (0.2256961613893509) | > loss_disc_real_2: 0.2256813943386078 (0.2256813943386078) | > loss_disc_real_3: 0.3561490774154663 (0.3561490774154663) | > loss_disc_real_4: 0.13263258337974548 (0.13263258337974548) | > loss_disc_real_5: 0.2652648687362671 (0.2652648687362671) | > loss_0: 2.711209774017334 (2.711209774017334) | > loss_gen: 2.5435075759887695 (2.5435075759887695) | > loss_kl: 5.824609756469727 (5.824609756469727) | > loss_feat: 7.524528503417969 (7.524528503417969) | > loss_mel: 23.692354202270508 (23.692354202270508) | > loss_duration: 3.121959686279297 (3.121959686279297) | > loss_1: 42.70695877075195 (42.70695877075195)  --> STEP: 1 | > loss_disc: 2.6572139263153076 (2.6572139263153076) | > loss_disc_real_0: 0.3204590678215027 (0.3204590678215027) | > loss_disc_real_1: 0.2641910910606384 (0.2641910910606384) | > loss_disc_real_2: 0.22360444068908691 (0.22360444068908691) | > loss_disc_real_3: 0.2714749872684479 (0.2714749872684479) | > loss_disc_real_4: 0.26355865597724915 (0.26355865597724915) | > loss_disc_real_5: 0.3191983997821808 (0.3191983997821808) | > loss_0: 2.6572139263153076 (2.6572139263153076) | > loss_gen: 2.373579502105713 (2.373579502105713) | > loss_kl: 6.426013469696045 (6.426013469696045) | > loss_feat: 4.686802864074707 (4.686802864074707) | > loss_mel: 24.381296157836914 (24.381296157836914) | > loss_duration: 3.5942747592926025 (3.5942747592926025) | > loss_1: 41.46196746826172 (41.46196746826172)  --> STEP: 2 | > loss_disc: 2.1762402057647705 (2.416727066040039) | > loss_disc_real_0: 0.145353764295578 (0.23290641605854034) | > loss_disc_real_1: 0.2571072280406952 (0.2606491595506668) | > loss_disc_real_2: 0.2662718594074249 (0.24493815004825592) | > loss_disc_real_3: 0.16667205095291138 (0.21907351911067963) | > loss_disc_real_4: 0.09141626954078674 (0.17748746275901794) | > loss_disc_real_5: 0.2064153105020523 (0.26280685514211655) | > loss_0: 2.1762402057647705 (2.416727066040039) | > loss_gen: 3.238809585571289 (2.806194543838501) | > loss_kl: 5.993594169616699 (6.209803819656372) | > loss_feat: 10.705262184143066 (7.696032524108887) | > loss_mel: 22.607933044433594 (23.494614601135254) | > loss_duration: 3.2967214584350586 (3.4454981088638306) | > loss_1: 45.842323303222656 (43.65214538574219)  --> STEP: 3 | > loss_disc: 3.0208137035369873 (2.618089278539022) | > loss_disc_real_0: 0.26966220140457153 (0.2451583445072174) | > loss_disc_real_1: 0.25966039299964905 (0.2603195707003276) | > loss_disc_real_2: 0.21801792085170746 (0.2359647403160731) | > loss_disc_real_3: 0.26539406180381775 (0.23451370000839233) | > loss_disc_real_4: 0.24999728798866272 (0.20165740450223288) | > loss_disc_real_5: 0.2243369221687317 (0.24998354415098825) | > loss_0: 3.0208137035369873 (2.618089278539022) | > loss_gen: 1.471011757850647 (2.361133615175883) | > loss_kl: 2.3660881519317627 (4.928565263748169) | > loss_feat: 0.07209359854459763 (5.154719548920791) | > loss_mel: 1.9343749284744263 (16.307868043581646) | > loss_duration: 3.0342772006988525 (3.308424472808838) | > loss_1: 8.877845764160156 (32.06071217854818) --> EVAL PERFORMANCE | > avg_loader_time: 0.016515096028645832 (+0.005338907241821287) | > avg_loss_disc: 2.618089278539022 (-0.4430365562438965) | > avg_loss_disc_real_0: 0.2451583445072174 (-0.07166980703671771) | > avg_loss_disc_real_1: 0.2603195707003276 (-0.012680341800053896) | > avg_loss_disc_real_2: 0.2359647403160731 (-0.055053109923998506) | > avg_loss_disc_real_3: 0.23451370000839233 (-0.059772223234176636) | > avg_loss_disc_real_4: 0.20165740450223288 (-0.14216053485870359) | > avg_loss_disc_real_5: 0.24998354415098825 (-0.02224849164485934) | > avg_loss_0: 2.618089278539022 (-0.4430365562438965) | > avg_loss_gen: 2.361133615175883 (+0.246759295463562) | > avg_loss_kl: 4.928565263748169 (-0.04770541191101074) | > avg_loss_feat: 5.154719548920791 (-1.1701734599967795) | > avg_loss_mel: 16.307868043581646 (-0.46096066633860033) | > avg_loss_duration: 3.308424472808838 (+0.03864995638529445) | > avg_loss_1: 32.06071217854818 (-1.3934294382731096)  > EPOCH: 1244/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:54:53)   --> TIME: 2023-10-20 15:55:17 -- STEP: 29/50 -- GLOBAL_STEP: 115230 | > loss_disc: 2.6274428367614746 (2.4802302944249117) | > loss_disc_real_0: 0.1425887942314148 (0.16625875542903767) | > loss_disc_real_1: 0.24153368175029755 (0.2186534716908274) | > loss_disc_real_2: 0.19142450392246246 (0.22165122178607974) | > loss_disc_real_3: 0.21508587896823883 (0.224795443744495) | > loss_disc_real_4: 0.2072613388299942 (0.222216935314495) | > loss_disc_real_5: 0.25798171758651733 (0.22599838873178796) | > loss_0: 2.6274428367614746 (2.4802302944249117) | > grad_norm_0: tensor(606.4719, device='cuda:0') (tensor(672.8193, device='cuda:0')) | > loss_gen: 1.785714864730835 (2.1855059163323762) | > loss_kl: 0.7124007344245911 (0.7661724265279442) | > loss_feat: 2.871645450592041 (5.426707658017504) | > loss_mel: 20.384078979492188 (20.48130115969428) | > loss_duration: 1.3151026964187622 (1.3197363409502754) | > loss_1: 27.06894302368164 (30.17942400636344) | > grad_norm_1: tensor(3326.7820, device='cuda:0') (tensor(18757.5488, device='cuda:0')) | > current_lr_0: 5.764131645133503e-05 | > current_lr_1: 5.769899020454121e-05 | > step_time: 0.3683 (0.5956691051351612) | > loader_time: 0.0294 (0.01665829790049586)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.254227638244629 (2.254227638244629) | > loss_disc_real_0: 0.284148633480072 (0.284148633480072) | > loss_disc_real_1: 0.14621689915657043 (0.14621689915657043) | > loss_disc_real_2: 0.19512611627578735 (0.19512611627578735) | > loss_disc_real_3: 0.12921708822250366 (0.12921708822250366) | > loss_disc_real_4: 0.17532889544963837 (0.17532889544963837) | > loss_disc_real_5: 0.12451394647359848 (0.12451394647359848) | > loss_0: 2.254227638244629 (2.254227638244629) | > loss_gen: 2.6109743118286133 (2.6109743118286133) | > loss_kl: 5.429888725280762 (5.429888725280762) | > loss_feat: 9.810415267944336 (9.810415267944336) | > loss_mel: 25.03679847717285 (25.03679847717285) | > loss_duration: 3.0776662826538086 (3.0776662826538086) | > loss_1: 45.96574401855469 (45.96574401855469)  --> STEP: 1 | > loss_disc: 2.9485726356506348 (2.9485726356506348) | > loss_disc_real_0: 0.16203665733337402 (0.16203665733337402) | > loss_disc_real_1: 0.21190553903579712 (0.21190553903579712) | > loss_disc_real_2: 0.4363608658313751 (0.4363608658313751) | > loss_disc_real_3: 0.31567350029945374 (0.31567350029945374) | > loss_disc_real_4: 0.26745811104774475 (0.26745811104774475) | > loss_disc_real_5: 0.23137764632701874 (0.23137764632701874) | > loss_0: 2.9485726356506348 (2.9485726356506348) | > loss_gen: 1.753820538520813 (1.753820538520813) | > loss_kl: 5.745339393615723 (5.745339393615723) | > loss_feat: 0.848792552947998 (0.848792552947998) | > loss_mel: 18.828903198242188 (18.828903198242188) | > loss_duration: 3.4322099685668945 (3.4322099685668945) | > loss_1: 30.609066009521484 (30.609066009521484)  --> STEP: 2 | > loss_disc: 2.9901123046875 (2.9693424701690674) | > loss_disc_real_0: 0.2285563051700592 (0.1952964812517166) | > loss_disc_real_1: 0.26802587509155273 (0.23996570706367493) | > loss_disc_real_2: 0.335851788520813 (0.38610632717609406) | > loss_disc_real_3: 0.2753032445907593 (0.2954883724451065) | > loss_disc_real_4: 0.26466116309165955 (0.26605963706970215) | > loss_disc_real_5: 0.23967108130455017 (0.23552436381578445) | > loss_0: 2.9901123046875 (2.9693424701690674) | > loss_gen: 1.6377474069595337 (1.6957839727401733) | > loss_kl: 5.982597827911377 (5.86396861076355) | > loss_feat: 0.11567752808332443 (0.48223504051566124) | > loss_mel: 2.4550318717956543 (10.641967535018921) | > loss_duration: 3.420828342437744 (3.4265191555023193) | > loss_1: 13.611883163452148 (22.110474586486816)  --> STEP: 3 | > loss_disc: 2.9483678340911865 (2.962350924809774) | > loss_disc_real_0: 0.30222079157829285 (0.23093791802724203) | > loss_disc_real_1: 0.3033151626586914 (0.26108219226201373) | > loss_disc_real_2: 0.3722046911716461 (0.38147244850794476) | > loss_disc_real_3: 0.26411619782447815 (0.28503098090489704) | > loss_disc_real_4: 0.2829383611679077 (0.2716858784357707) | > loss_disc_real_5: 0.40116333961486816 (0.2907373557488124) | > loss_0: 2.9483678340911865 (2.962350924809774) | > loss_gen: 2.5651073455810547 (1.9855584303538005) | > loss_kl: 3.0162274837493896 (4.914721568425496) | > loss_feat: 3.8700637817382812 (1.6115112875898678) | > loss_mel: 24.247217178344727 (15.177050749460856) | > loss_duration: 3.073634624481201 (3.30889097849528) | > loss_1: 36.77225112915039 (26.99773343404134) --> EVAL PERFORMANCE | > avg_loader_time: 0.011295636494954428 (-0.0052194595336914045) | > avg_loss_disc: 2.962350924809774 (+0.34426164627075195) | > avg_loss_disc_real_0: 0.23093791802724203 (-0.014220426479975373) | > avg_loss_disc_real_1: 0.26108219226201373 (+0.0007626215616861609) | > avg_loss_disc_real_2: 0.38147244850794476 (+0.14550770819187167) | > avg_loss_disc_real_3: 0.28503098090489704 (+0.0505172808965047) | > avg_loss_disc_real_4: 0.2716858784357707 (+0.07002847393353781) | > avg_loss_disc_real_5: 0.2907373557488124 (+0.040753811597824124) | > avg_loss_0: 2.962350924809774 (+0.34426164627075195) | > avg_loss_gen: 1.9855584303538005 (-0.3755751848220823) | > avg_loss_kl: 4.914721568425496 (-0.013843695322672822) | > avg_loss_feat: 1.6115112875898678 (-3.543208261330923) | > avg_loss_mel: 15.177050749460856 (-1.1308172941207904) | > avg_loss_duration: 3.30889097849528 (+0.00046650568644190926) | > avg_loss_1: 26.99773343404134 (-5.0629787445068395)  > EPOCH: 1245/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:55:43)   --> TIME: 2023-10-20 15:55:52 -- STEP: 9/50 -- GLOBAL_STEP: 115260 | > loss_disc: 2.6606569290161133 (2.5804804695977106) | > loss_disc_real_0: 0.17039474844932556 (0.17679037691818345) | > loss_disc_real_1: 0.26377177238464355 (0.26451718641652) | > loss_disc_real_2: 0.24012388288974762 (0.27914323988888) | > loss_disc_real_3: 0.3023127615451813 (0.2633213789926635) | > loss_disc_real_4: 0.2707062363624573 (0.22479503519005245) | > loss_disc_real_5: 0.34741154313087463 (0.1986503799756368) | > loss_0: 2.6606569290161133 (2.5804804695977106) | > grad_norm_0: tensor(451.5580, device='cuda:0') (tensor(640.7059, device='cuda:0')) | > loss_gen: 2.296837091445923 (2.424633330769009) | > loss_kl: 0.6787882447242737 (0.8580238189962175) | > loss_feat: 4.581388473510742 (5.936657190322876) | > loss_mel: 21.425962448120117 (20.954783757527668) | > loss_duration: 1.323762059211731 (1.31475387679206) | > loss_1: 30.306737899780273 (31.488851971096462) | > grad_norm_1: tensor(6396.0742, device='cuda:0') (tensor(16690.8340, device='cuda:0')) | > current_lr_0: 5.758370034665609e-05 | > current_lr_1: 5.764131645133503e-05 | > step_time: 0.3127 (0.4558938874138726) | > loader_time: 0.005 (0.013263622919718424)  --> TIME: 2023-10-20 15:56:13 -- STEP: 39/50 -- GLOBAL_STEP: 115290 | > loss_disc: 2.4112963676452637 (2.5194986080512023) | > loss_disc_real_0: 0.15308183431625366 (0.14765428498578378) | > loss_disc_real_1: 0.11327173560857773 (0.228617597084779) | > loss_disc_real_2: 0.2468608170747757 (0.2310209946754651) | > loss_disc_real_3: 0.20001624524593353 (0.2404367538789908) | > loss_disc_real_4: 0.21662303805351257 (0.22269418988472375) | > loss_disc_real_5: 0.18230685591697693 (0.21223032732422537) | > loss_0: 2.4112963676452637 (2.5194986080512023) | > grad_norm_0: tensor(1137.3710, device='cuda:0') (tensor(688.0010, device='cuda:0')) | > loss_gen: 2.285630702972412 (2.2183781984524837) | > loss_kl: 0.5558451414108276 (0.8105072975158691) | > loss_feat: 5.171015739440918 (5.563017416649904) | > loss_mel: 22.486589431762695 (20.863092801509758) | > loss_duration: 1.3649535179138184 (1.3108980839069075) | > loss_1: 31.864036560058594 (30.76589391170404) | > grad_norm_1: tensor(15269.8896, device='cuda:0') (tensor(15534.6416, device='cuda:0')) | > current_lr_0: 5.758370034665609e-05 | > current_lr_1: 5.764131645133503e-05 | > step_time: 1.0372 (0.6346009755745913) | > loader_time: 0.027 (0.019942760467529293)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1288294792175293 (2.1288294792175293) | > loss_disc_real_0: 0.09953970462083817 (0.09953970462083817) | > loss_disc_real_1: 0.31072813272476196 (0.31072813272476196) | > loss_disc_real_2: 0.31053251028060913 (0.31053251028060913) | > loss_disc_real_3: 0.23285391926765442 (0.23285391926765442) | > loss_disc_real_4: 0.191274031996727 (0.191274031996727) | > loss_disc_real_5: 0.15037845075130463 (0.15037845075130463) | > loss_0: 2.1288294792175293 (2.1288294792175293) | > loss_gen: 2.7083163261413574 (2.7083163261413574) | > loss_kl: 5.529418468475342 (5.529418468475342) | > loss_feat: 10.284636497497559 (10.284636497497559) | > loss_mel: 24.757110595703125 (24.757110595703125) | > loss_duration: 2.946610450744629 (2.946610450744629) | > loss_1: 46.22609329223633 (46.22609329223633)  --> STEP: 1 | > loss_disc: 2.7408294677734375 (2.7408294677734375) | > loss_disc_real_0: 0.1727609932422638 (0.1727609932422638) | > loss_disc_real_1: 0.23715968430042267 (0.23715968430042267) | > loss_disc_real_2: 0.21409213542938232 (0.21409213542938232) | > loss_disc_real_3: 0.282685250043869 (0.282685250043869) | > loss_disc_real_4: 0.18993273377418518 (0.18993273377418518) | > loss_disc_real_5: 0.23388899862766266 (0.23388899862766266) | > loss_0: 2.7408294677734375 (2.7408294677734375) | > loss_gen: 2.2809934616088867 (2.2809934616088867) | > loss_kl: 6.179091453552246 (6.179091453552246) | > loss_feat: 7.021878719329834 (7.021878719329834) | > loss_mel: 22.717222213745117 (22.717222213745117) | > loss_duration: 3.4469809532165527 (3.4469809532165527) | > loss_1: 41.64616394042969 (41.64616394042969)  --> STEP: 2 | > loss_disc: 2.004934787750244 (2.372882127761841) | > loss_disc_real_0: 0.07031054049730301 (0.1215357668697834) | > loss_disc_real_1: 0.22179563343524933 (0.229477658867836) | > loss_disc_real_2: 0.23489971458911896 (0.22449592500925064) | > loss_disc_real_3: 0.11773540079593658 (0.2002103254199028) | > loss_disc_real_4: 0.13893438875675201 (0.1644335612654686) | > loss_disc_real_5: 0.09423436224460602 (0.16406168043613434) | > loss_0: 2.004934787750244 (2.372882127761841) | > loss_gen: 2.368021249771118 (2.3245073556900024) | > loss_kl: 5.9176859855651855 (6.048388719558716) | > loss_feat: 6.987668991088867 (7.004773855209351) | > loss_mel: 24.736713409423828 (23.726967811584473) | > loss_duration: 3.340452194213867 (3.39371657371521) | > loss_1: 43.35054016113281 (42.49835205078125)  --> STEP: 3 | > loss_disc: 2.6756784915924072 (2.4738142490386963) | > loss_disc_real_0: 0.47480952739715576 (0.2392936870455742) | > loss_disc_real_1: 0.27314484119415283 (0.24403338630994162) | > loss_disc_real_2: 0.24395278096199036 (0.23098154366016388) | > loss_disc_real_3: 0.2596436142921448 (0.22002142171065012) | > loss_disc_real_4: 0.19298939406871796 (0.17395217219988504) | > loss_disc_real_5: 0.16467012465000153 (0.16426449517409006) | > loss_0: 2.6756784915924072 (2.4738142490386963) | > loss_gen: 2.757523536682129 (2.468846082687378) | > loss_kl: 3.1923630237579346 (5.096380154291789) | > loss_feat: 3.3586039543151855 (5.789383888244629) | > loss_mel: 18.721248626708984 (22.05839474995931) | > loss_duration: 3.1059985160827637 (3.2978105545043945) | > loss_1: 31.135738372802734 (38.71081415812174) --> EVAL PERFORMANCE | > avg_loader_time: 0.01172033945719401 (+0.0004247029622395822) | > avg_loss_disc: 2.4738142490386963 (-0.4885366757710776) | > avg_loss_disc_real_0: 0.2392936870455742 (+0.008355769018332154) | > avg_loss_disc_real_1: 0.24403338630994162 (-0.017048805952072116) | > avg_loss_disc_real_2: 0.23098154366016388 (-0.15049090484778088) | > avg_loss_disc_real_3: 0.22002142171065012 (-0.06500955919424692) | > avg_loss_disc_real_4: 0.17395217219988504 (-0.09773370623588565) | > avg_loss_disc_real_5: 0.16426449517409006 (-0.12647286057472232) | > avg_loss_0: 2.4738142490386963 (-0.4885366757710776) | > avg_loss_gen: 2.468846082687378 (+0.4832876523335774) | > avg_loss_kl: 5.096380154291789 (+0.1816585858662929) | > avg_loss_feat: 5.789383888244629 (+4.177872600654761) | > avg_loss_mel: 22.05839474995931 (+6.881344000498453) | > avg_loss_duration: 3.2978105545043945 (-0.011080423990885269) | > avg_loss_1: 38.71081415812174 (+11.713080724080402)  > EPOCH: 1246/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:56:31)   --> TIME: 2023-10-20 15:56:48 -- STEP: 19/50 -- GLOBAL_STEP: 115320 | > loss_disc: 1.6859047412872314 (2.2643207939047563) | > loss_disc_real_0: 0.07253348082304001 (0.13691990783340052) | > loss_disc_real_1: 0.1442127227783203 (0.2141924198520811) | > loss_disc_real_2: 0.09946558624505997 (0.2074202205005445) | > loss_disc_real_3: 0.07267307490110397 (0.21964278934817566) | > loss_disc_real_4: 0.15078574419021606 (0.19927593595103213) | > loss_disc_real_5: 0.10672664642333984 (0.18736281951791361) | > loss_0: 1.6859047412872314 (2.2643207939047563) | > grad_norm_0: tensor(390.6832, device='cuda:0') (tensor(667.4041, device='cuda:0')) | > loss_gen: 2.380413055419922 (2.430954757489656) | > loss_kl: 0.6697880625724792 (0.8324834531859348) | > loss_feat: 7.207120895385742 (6.60020240043339) | > loss_mel: 19.688112258911133 (21.652159916727168) | > loss_duration: 1.4260764122009277 (1.3425613829964085) | > loss_1: 31.371511459350586 (32.858361997102435) | > grad_norm_1: tensor(3584.1018, device='cuda:0') (tensor(24628.9609, device='cuda:0')) | > current_lr_0: 5.7526141832881083e-05 | > current_lr_1: 5.758370034665609e-05 | > step_time: 0.6586 (0.6084680933701364) | > loader_time: 0.0357 (0.02651046451769377)  --> TIME: 2023-10-20 15:57:08 -- STEP: 49/50 -- GLOBAL_STEP: 115350 | > loss_disc: 2.4227888584136963 (2.389954817538359) | > loss_disc_real_0: 0.06064973771572113 (0.13888846592483473) | > loss_disc_real_1: 0.19974875450134277 (0.2159780580930564) | > loss_disc_real_2: 0.16959872841835022 (0.21239449175036684) | > loss_disc_real_3: 0.25821903347969055 (0.22607412751840086) | > loss_disc_real_4: 0.11847610026597977 (0.21978993622624143) | > loss_disc_real_5: 0.1900133639574051 (0.2222754712767747) | > loss_0: 2.4227888584136963 (2.389954817538359) | > grad_norm_0: tensor(1024.7080, device='cuda:0') (tensor(669.9427, device='cuda:0')) | > loss_gen: 2.319941997528076 (2.2839352792623084) | > loss_kl: 0.8863696455955505 (0.8041103372768481) | > loss_feat: 7.357348918914795 (5.621543940840935) | > loss_mel: 21.459238052368164 (20.419191375070685) | > loss_duration: 1.3798049688339233 (1.318269615270654) | > loss_1: 33.402706146240234 (30.447050551978908) | > grad_norm_1: tensor(53990.3906, device='cuda:0') (tensor(22944.3047, device='cuda:0')) | > current_lr_0: 5.7526141832881083e-05 | > current_lr_1: 5.758370034665609e-05 | > step_time: 0.5853 (0.6193264747152523) | > loader_time: 0.4992 (0.03458203101644711)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0312659740448 (2.0312659740448) | > loss_disc_real_0: 0.17819616198539734 (0.17819616198539734) | > loss_disc_real_1: 0.256961464881897 (0.256961464881897) | > loss_disc_real_2: 0.27111682295799255 (0.27111682295799255) | > loss_disc_real_3: 0.18063104152679443 (0.18063104152679443) | > loss_disc_real_4: 0.17517708241939545 (0.17517708241939545) | > loss_disc_real_5: 0.13896401226520538 (0.13896401226520538) | > loss_0: 2.0312659740448 (2.0312659740448) | > loss_gen: 2.8157496452331543 (2.8157496452331543) | > loss_kl: 5.893734931945801 (5.893734931945801) | > loss_feat: 7.36719274520874 (7.36719274520874) | > loss_mel: 21.294145584106445 (21.294145584106445) | > loss_duration: 2.9949612617492676 (2.9949612617492676) | > loss_1: 40.36578369140625 (40.36578369140625)  --> STEP: 1 | > loss_disc: 2.5403249263763428 (2.5403249263763428) | > loss_disc_real_0: 0.28277915716171265 (0.28277915716171265) | > loss_disc_real_1: 0.2176385074853897 (0.2176385074853897) | > loss_disc_real_2: 0.2186977118253708 (0.2186977118253708) | > loss_disc_real_3: 0.13755832612514496 (0.13755832612514496) | > loss_disc_real_4: 0.15837137401103973 (0.15837137401103973) | > loss_disc_real_5: 0.16011981666088104 (0.16011981666088104) | > loss_0: 2.5403249263763428 (2.5403249263763428) | > loss_gen: 2.218186855316162 (2.218186855316162) | > loss_kl: 5.691294193267822 (5.691294193267822) | > loss_feat: 7.856535911560059 (7.856535911560059) | > loss_mel: 24.771150588989258 (24.771150588989258) | > loss_duration: 3.5069499015808105 (3.5069499015808105) | > loss_1: 44.04411697387695 (44.04411697387695)  --> STEP: 2 | > loss_disc: 2.890507936477661 (2.715416431427002) | > loss_disc_real_0: 0.25993454456329346 (0.27135685086250305) | > loss_disc_real_1: 0.29706352949142456 (0.25735101848840714) | > loss_disc_real_2: 0.26716288924217224 (0.24293030053377151) | > loss_disc_real_3: 0.2348114252090454 (0.18618487566709518) | > loss_disc_real_4: 0.25842809677124023 (0.20839973539113998) | > loss_disc_real_5: 0.3074091672897339 (0.23376449197530746) | > loss_0: 2.890507936477661 (2.715416431427002) | > loss_gen: 1.8548153638839722 (2.036501109600067) | > loss_kl: 6.083126068115234 (5.887210130691528) | > loss_feat: 0.813003659248352 (4.334769785404205) | > loss_mel: 6.912013053894043 (15.84158182144165) | > loss_duration: 3.2917635440826416 (3.399356722831726) | > loss_1: 18.954721450805664 (31.49941921234131)  --> STEP: 3 | > loss_disc: 1.841406226158142 (2.424079696337382) | > loss_disc_real_0: 0.13357415795326233 (0.22542928655942282) | > loss_disc_real_1: 0.1348026543855667 (0.21650156378746033) | > loss_disc_real_2: 0.18947112560272217 (0.22511057555675507) | > loss_disc_real_3: 0.3403739929199219 (0.23758124808470407) | > loss_disc_real_4: 0.17988410592079163 (0.19889452556769052) | > loss_disc_real_5: 0.11844690144062042 (0.19532529513041177) | > loss_0: 1.841406226158142 (2.424079696337382) | > loss_gen: 2.878986358642578 (2.317329525947571) | > loss_kl: 2.792736768722534 (4.855719010035197) | > loss_feat: 8.182175636291504 (5.617238402366638) | > loss_mel: 23.180648803710938 (18.28793748219808) | > loss_duration: 3.1669018268585205 (3.321871757507324) | > loss_1: 40.20145034790039 (34.40009625752767) --> EVAL PERFORMANCE | > avg_loader_time: 0.005752722422281901 (-0.0059676170349121085) | > avg_loss_disc: 2.424079696337382 (-0.04973455270131444) | > avg_loss_disc_real_0: 0.22542928655942282 (-0.013864400486151368) | > avg_loss_disc_real_1: 0.21650156378746033 (-0.027531822522481292) | > avg_loss_disc_real_2: 0.22511057555675507 (-0.0058709681034088135) | > avg_loss_disc_real_3: 0.23758124808470407 (+0.017559826374053955) | > avg_loss_disc_real_4: 0.19889452556769052 (+0.02494235336780548) | > avg_loss_disc_real_5: 0.19532529513041177 (+0.031060799956321716) | > avg_loss_0: 2.424079696337382 (-0.04973455270131444) | > avg_loss_gen: 2.317329525947571 (-0.15151655673980713) | > avg_loss_kl: 4.855719010035197 (-0.2406611442565918) | > avg_loss_feat: 5.617238402366638 (-0.17214548587799072) | > avg_loss_mel: 18.28793748219808 (-3.7704572677612305) | > avg_loss_duration: 3.321871757507324 (+0.024061203002929688) | > avg_loss_1: 34.40009625752767 (-4.310717900594071)  > EPOCH: 1247/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:57:24)   --> TIME: 2023-10-20 15:57:48 -- STEP: 29/50 -- GLOBAL_STEP: 115380 | > loss_disc: 2.4714531898498535 (2.5607547883329715) | > loss_disc_real_0: 0.028501905500888824 (0.16440711395236954) | > loss_disc_real_1: 0.21507114171981812 (0.2211576990526298) | > loss_disc_real_2: 0.20393043756484985 (0.22706700989912296) | > loss_disc_real_3: 0.2136542797088623 (0.2368927747011185) | > loss_disc_real_4: 0.25183406472206116 (0.24761837425416913) | > loss_disc_real_5: 0.17248697578907013 (0.2291687926084831) | > loss_0: 2.4714531898498535 (2.5607547883329715) | > grad_norm_0: tensor(1222.1537, device='cuda:0') (tensor(585.2843, device='cuda:0')) | > loss_gen: 1.8848316669464111 (2.126626133918763) | > loss_kl: 0.9972691535949707 (0.8383704362244442) | > loss_feat: 2.789236068725586 (4.6586028771346495) | > loss_mel: 18.5831241607666 (16.68483169325467) | > loss_duration: 1.2879480123519897 (1.3143717831578745) | > loss_1: 25.542409896850586 (25.62280298101491) | > grad_norm_1: tensor(8338.5039, device='cuda:0') (tensor(20653.3516, device='cuda:0')) | > current_lr_0: 5.74686408524443e-05 | > current_lr_1: 5.7526141832881083e-05 | > step_time: 0.7285 (0.6236133657652757) | > loader_time: 0.028 (0.022074584303231073)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9284510612487793 (2.9284510612487793) | > loss_disc_real_0: 0.11797662824392319 (0.11797662824392319) | > loss_disc_real_1: 0.2761733829975128 (0.2761733829975128) | > loss_disc_real_2: 0.25036248564720154 (0.25036248564720154) | > loss_disc_real_3: 0.27569860219955444 (0.27569860219955444) | > loss_disc_real_4: 0.2750059962272644 (0.2750059962272644) | > loss_disc_real_5: 0.2785138487815857 (0.2785138487815857) | > loss_0: 2.9284510612487793 (2.9284510612487793) | > loss_gen: 1.5601441860198975 (1.5601441860198975) | > loss_kl: 5.500265121459961 (5.500265121459961) | > loss_feat: 0.30853909254074097 (0.30853909254074097) | > loss_mel: 11.96420669555664 (11.96420669555664) | > loss_duration: 3.052703857421875 (3.052703857421875) | > loss_1: 22.3858585357666 (22.3858585357666)  --> STEP: 1 | > loss_disc: 2.8485054969787598 (2.8485054969787598) | > loss_disc_real_0: 0.19175489246845245 (0.19175489246845245) | > loss_disc_real_1: 0.2171705663204193 (0.2171705663204193) | > loss_disc_real_2: 0.2728790044784546 (0.2728790044784546) | > loss_disc_real_3: 0.19829869270324707 (0.19829869270324707) | > loss_disc_real_4: 0.30440956354141235 (0.30440956354141235) | > loss_disc_real_5: 0.42477667331695557 (0.42477667331695557) | > loss_0: 2.8485054969787598 (2.8485054969787598) | > loss_gen: 1.9825916290283203 (1.9825916290283203) | > loss_kl: 6.001089096069336 (6.001089096069336) | > loss_feat: 6.128303050994873 (6.128303050994873) | > loss_mel: 22.33592987060547 (22.33592987060547) | > loss_duration: 3.5093791484832764 (3.5093791484832764) | > loss_1: 39.95729446411133 (39.95729446411133)  --> STEP: 2 | > loss_disc: 3.005801200866699 (2.9271533489227295) | > loss_disc_real_0: 0.1823686957359314 (0.18706179410219193) | > loss_disc_real_1: 0.2748171389102936 (0.24599385261535645) | > loss_disc_real_2: 0.2458110749721527 (0.25934503972530365) | > loss_disc_real_3: 0.27172932028770447 (0.23501400649547577) | > loss_disc_real_4: 0.2763529121875763 (0.2903812378644943) | > loss_disc_real_5: 0.2805001139640808 (0.3526383936405182) | > loss_0: 3.005801200866699 (2.9271533489227295) | > loss_gen: 1.540806531906128 (1.7616990804672241) | > loss_kl: 6.558995723724365 (6.280042409896851) | > loss_feat: 0.02376156859099865 (3.076032309792936) | > loss_mel: 1.7067837715148926 (12.02135682106018) | > loss_duration: 3.394890785217285 (3.4521349668502808) | > loss_1: 13.225238800048828 (26.591266632080078)  --> STEP: 3 | > loss_disc: 2.393622636795044 (2.749309778213501) | > loss_disc_real_0: 0.21947969496250153 (0.19786776105562845) | > loss_disc_real_1: 0.2893950939178467 (0.26046093304951984) | > loss_disc_real_2: 0.2551201581954956 (0.2579367458820343) | > loss_disc_real_3: 0.19014473259449005 (0.22005758186181387) | > loss_disc_real_4: 0.1756928265094757 (0.25215176741282147) | > loss_disc_real_5: 0.12050524353981018 (0.27526067694028217) | > loss_0: 2.393622636795044 (2.749309778213501) | > loss_gen: 2.1558644771575928 (1.8930875460306804) | > loss_kl: 2.956021308898926 (5.172035376230876) | > loss_feat: 3.5597617626190186 (3.2372754607349634) | > loss_mel: 19.333826065063477 (14.45884656906128) | > loss_duration: 3.0508973598480225 (3.318389097849528) | > loss_1: 31.056371688842773 (28.07963498433431) --> EVAL PERFORMANCE | > avg_loader_time: 0.01152650515238444 (+0.005773782730102538) | > avg_loss_disc: 2.749309778213501 (+0.3252300818761191) | > avg_loss_disc_real_0: 0.19786776105562845 (-0.02756152550379437) | > avg_loss_disc_real_1: 0.26046093304951984 (+0.04395936926205951) | > avg_loss_disc_real_2: 0.2579367458820343 (+0.032826170325279236) | > avg_loss_disc_real_3: 0.22005758186181387 (-0.0175236662228902) | > avg_loss_disc_real_4: 0.25215176741282147 (+0.05325724184513095) | > avg_loss_disc_real_5: 0.27526067694028217 (+0.07993538180987039) | > avg_loss_0: 2.749309778213501 (+0.3252300818761191) | > avg_loss_gen: 1.8930875460306804 (-0.4242419799168904) | > avg_loss_kl: 5.172035376230876 (+0.3163163661956787) | > avg_loss_feat: 3.2372754607349634 (-2.3799629416316748) | > avg_loss_mel: 14.45884656906128 (-3.829090913136799) | > avg_loss_duration: 3.318389097849528 (-0.003482659657796372) | > avg_loss_1: 28.07963498433431 (-6.320461273193363)  > EPOCH: 1248/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:58:14)   --> TIME: 2023-10-20 15:58:26 -- STEP: 9/50 -- GLOBAL_STEP: 115410 | > loss_disc: 3.0524775981903076 (2.298833171526591) | > loss_disc_real_0: 0.37549376487731934 (0.16221231553289625) | > loss_disc_real_1: 0.27535685896873474 (0.21309752513964972) | > loss_disc_real_2: 0.2654917538166046 (0.20615056653817496) | > loss_disc_real_3: 0.29904812574386597 (0.20294792039526832) | > loss_disc_real_4: 0.29789116978645325 (0.18777361429399914) | > loss_disc_real_5: 0.3038633167743683 (0.20774834354718527) | > loss_0: 3.0524775981903076 (2.298833171526591) | > grad_norm_0: tensor(1131.6938, device='cuda:0') (tensor(665.2961, device='cuda:0')) | > loss_gen: 1.7654690742492676 (2.3987017737494574) | > loss_kl: 0.7356117367744446 (0.616272411412663) | > loss_feat: 0.023224735632538795 (6.5660849836551485) | > loss_mel: 0.9324504137039185 (20.019317534234787) | > loss_duration: 1.2284412384033203 (1.3006866640514798) | > loss_1: 4.685196876525879 (30.901062117682564) | > grad_norm_1: tensor(77909.1875, device='cuda:0') (tensor(24654.3613, device='cuda:0')) | > current_lr_0: 5.741119734783756e-05 | > current_lr_1: 5.74686408524443e-05 | > step_time: 0.615 (0.6027111742231581) | > loader_time: 0.0258 (0.019903924730088975)  --> TIME: 2023-10-20 15:58:40 -- STEP: 39/50 -- GLOBAL_STEP: 115440 | > loss_disc: 2.9464962482452393 (2.549413118606959) | > loss_disc_real_0: 0.1810922473669052 (0.16424846610961816) | > loss_disc_real_1: 0.31317248940467834 (0.23677886239229104) | > loss_disc_real_2: 0.2456100434064865 (0.2361626875324127) | > loss_disc_real_3: 0.30586737394332886 (0.2373238870730767) | > loss_disc_real_4: 0.3448108732700348 (0.23966393887232512) | > loss_disc_real_5: 0.2186998873949051 (0.2519027309922072) | > loss_0: 2.9464962482452393 (2.549413118606959) | > grad_norm_0: tensor(517.2935, device='cuda:0') (tensor(668.4559, device='cuda:0')) | > loss_gen: 2.0355026721954346 (2.188640258251093) | > loss_kl: 0.5830665826797485 (0.749432355738603) | > loss_feat: 5.0743794441223145 (4.838663889572788) | > loss_mel: 18.827701568603516 (18.76832494063255) | > loss_duration: 1.3339248895645142 (1.3108830390832362) | > loss_1: 27.854576110839844 (27.85594425445948) | > grad_norm_1: tensor(16817.8008, device='cuda:0') (tensor(21376.7285, device='cuda:0')) | > current_lr_0: 5.741119734783756e-05 | > current_lr_1: 5.74686408524443e-05 | > step_time: 0.318 (0.47978756366631903) | > loader_time: 0.006 (0.014359413049159905)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7538979053497314 (2.7538979053497314) | > loss_disc_real_0: 0.2686067819595337 (0.2686067819595337) | > loss_disc_real_1: 0.22503472864627838 (0.22503472864627838) | > loss_disc_real_2: 0.25687405467033386 (0.25687405467033386) | > loss_disc_real_3: 0.2675183415412903 (0.2675183415412903) | > loss_disc_real_4: 0.35805651545524597 (0.35805651545524597) | > loss_disc_real_5: 0.34578415751457214 (0.34578415751457214) | > loss_0: 2.7538979053497314 (2.7538979053497314) | > loss_gen: 2.4046268463134766 (2.4046268463134766) | > loss_kl: 5.7820048332214355 (5.7820048332214355) | > loss_feat: 4.167781829833984 (4.167781829833984) | > loss_mel: 21.753131866455078 (21.753131866455078) | > loss_duration: 3.0615785121917725 (3.0615785121917725) | > loss_1: 37.16912078857422 (37.16912078857422)  --> STEP: 1 | > loss_disc: 2.5813488960266113 (2.5813488960266113) | > loss_disc_real_0: 0.11443391442298889 (0.11443391442298889) | > loss_disc_real_1: 0.20388378202915192 (0.20388378202915192) | > loss_disc_real_2: 0.2736528217792511 (0.2736528217792511) | > loss_disc_real_3: 0.3146167993545532 (0.3146167993545532) | > loss_disc_real_4: 0.3016982674598694 (0.3016982674598694) | > loss_disc_real_5: 0.18514685332775116 (0.18514685332775116) | > loss_0: 2.5813488960266113 (2.5813488960266113) | > loss_gen: 2.211132526397705 (2.211132526397705) | > loss_kl: 5.550401210784912 (5.550401210784912) | > loss_feat: 8.062912940979004 (8.062912940979004) | > loss_mel: 21.898040771484375 (21.898040771484375) | > loss_duration: 3.4851503372192383 (3.4851503372192383) | > loss_1: 41.20763397216797 (41.20763397216797)  --> STEP: 2 | > loss_disc: 1.778515100479126 (2.1799319982528687) | > loss_disc_real_0: 0.22287139296531677 (0.16865265369415283) | > loss_disc_real_1: 0.1207226812839508 (0.16230323165655136) | > loss_disc_real_2: 0.2877669036388397 (0.2807098627090454) | > loss_disc_real_3: 0.19053210318088531 (0.25257445126771927) | > loss_disc_real_4: 0.11678850650787354 (0.20924338698387146) | > loss_disc_real_5: 0.16484086215496063 (0.1749938577413559) | > loss_0: 1.778515100479126 (2.1799319982528687) | > loss_gen: 3.136763334274292 (2.6739479303359985) | > loss_kl: 6.627345085144043 (6.0888731479644775) | > loss_feat: 9.354138374328613 (8.708525657653809) | > loss_mel: 26.62738037109375 (24.262710571289062) | > loss_duration: 3.4582114219665527 (3.4716808795928955) | > loss_1: 49.20383834838867 (45.20573616027832)  --> STEP: 3 | > loss_disc: 3.215993642807007 (2.5252858797709146) | > loss_disc_real_0: 0.7563971281051636 (0.36456747849782306) | > loss_disc_real_1: 0.2779046595096588 (0.2008370409409205) | > loss_disc_real_2: 0.27888306975364685 (0.28010093172391254) | > loss_disc_real_3: 0.2701449990272522 (0.2584313005208969) | > loss_disc_real_4: 0.25852125883102417 (0.2256693442662557) | > loss_disc_real_5: 0.26147031784057617 (0.20381934444109598) | > loss_0: 3.215993642807007 (2.5252858797709146) | > loss_gen: 2.26617169380188 (2.538022518157959) | > loss_kl: 3.1158640384674072 (5.097870111465454) | > loss_feat: 0.7057316899299622 (6.040927668412526) | > loss_mel: 16.776304244995117 (21.767241795857746) | > loss_duration: 3.015658140182495 (3.3196732997894287) | > loss_1: 25.879730224609375 (38.76373418172201) --> EVAL PERFORMANCE | > avg_loader_time: 0.03314820925394694 (+0.0216217041015625) | > avg_loss_disc: 2.5252858797709146 (-0.2240238984425864) | > avg_loss_disc_real_0: 0.36456747849782306 (+0.1666997174421946) | > avg_loss_disc_real_1: 0.2008370409409205 (-0.059623892108599336) | > avg_loss_disc_real_2: 0.28010093172391254 (+0.022164185841878237) | > avg_loss_disc_real_3: 0.2584313005208969 (+0.03837371865908304) | > avg_loss_disc_real_4: 0.2256693442662557 (-0.026482423146565764) | > avg_loss_disc_real_5: 0.20381934444109598 (-0.07144133249918619) | > avg_loss_0: 2.5252858797709146 (-0.2240238984425864) | > avg_loss_gen: 2.538022518157959 (+0.6449349721272786) | > avg_loss_kl: 5.097870111465454 (-0.07416526476542185) | > avg_loss_feat: 6.040927668412526 (+2.8036522076775627) | > avg_loss_mel: 21.767241795857746 (+7.308395226796467) | > avg_loss_duration: 3.3196732997894287 (+0.0012842019399008642) | > avg_loss_1: 38.76373418172201 (+10.684099197387699)  > EPOCH: 1249/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:59:02)   --> TIME: 2023-10-20 15:59:22 -- STEP: 19/50 -- GLOBAL_STEP: 115470 | > loss_disc: 2.6573402881622314 (2.565698598560534) | > loss_disc_real_0: 0.09171309322118759 (0.15029399940057805) | > loss_disc_real_1: 0.239219531416893 (0.24136633190669513) | > loss_disc_real_2: 0.2302200347185135 (0.23665056338435725) | > loss_disc_real_3: 0.2562851011753082 (0.2682041290559268) | > loss_disc_real_4: 0.2605944871902466 (0.23601795536907097) | > loss_disc_real_5: 0.2680172622203827 (0.24721559568455345) | > loss_0: 2.6573402881622314 (2.565698598560534) | > grad_norm_0: tensor(1039.2153, device='cuda:0') (tensor(820.4417, device='cuda:0')) | > loss_gen: 1.8668617010116577 (2.1680372451481067) | > loss_kl: 0.9916364550590515 (0.7631180851083053) | > loss_feat: 1.5064911842346191 (4.320758100108881) | > loss_mel: 16.56792449951172 (18.169289030526812) | > loss_duration: 1.3546417951583862 (1.3396434595710354) | > loss_1: 22.287553787231445 (26.76084623838726) | > grad_norm_1: tensor(4361.1514, device='cuda:0') (tensor(23786.6445, device='cuda:0')) | > current_lr_0: 5.735381126161017e-05 | > current_lr_1: 5.741119734783756e-05 | > step_time: 0.5052 (0.6209189891815186) | > loader_time: 0.0059 (0.020438206823248612)  --> TIME: 2023-10-20 15:59:41 -- STEP: 49/50 -- GLOBAL_STEP: 115500 | > loss_disc: 1.6598902940750122 (2.4852470427143336) | > loss_disc_real_0: 0.02577764168381691 (0.14447252670949212) | > loss_disc_real_1: 0.1556757241487503 (0.22277756673949106) | > loss_disc_real_2: 0.05543499439954758 (0.22043451347521373) | > loss_disc_real_3: 0.02449348010122776 (0.2419169206476334) | > loss_disc_real_4: 0.03550468385219574 (0.22626507662388742) | > loss_disc_real_5: 0.02103731594979763 (0.24306061362125436) | > loss_0: 1.6598902940750122 (2.4852470427143336) | > grad_norm_0: tensor(314.5769, device='cuda:0') (tensor(750.7390, device='cuda:0')) | > loss_gen: 2.266868829727173 (2.2266787168930984) | > loss_kl: 0.724307119846344 (0.7649562687289957) | > loss_feat: 8.720830917358398 (5.082505613945575) | > loss_mel: 22.234920501708984 (18.175188587636363) | > loss_duration: 1.4353609085083008 (1.3181838356718725) | > loss_1: 35.382286071777344 (27.567513388030385) | > grad_norm_1: tensor(11169.5674, device='cuda:0') (tensor(23983.6113, device='cuda:0')) | > current_lr_0: 5.735381126161017e-05 | > current_lr_1: 5.741119734783756e-05 | > step_time: 0.3981 (0.6008073845688178) | > loader_time: 0.4358 (0.028649680468500877)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.959451198577881 (2.959451198577881) | > loss_disc_real_0: 0.2901031970977783 (0.2901031970977783) | > loss_disc_real_1: 0.26910459995269775 (0.26910459995269775) | > loss_disc_real_2: 0.26916033029556274 (0.26916033029556274) | > loss_disc_real_3: 0.24651429057121277 (0.24651429057121277) | > loss_disc_real_4: 0.2623278796672821 (0.2623278796672821) | > loss_disc_real_5: 0.27169808745384216 (0.27169808745384216) | > loss_0: 2.959451198577881 (2.959451198577881) | > loss_gen: 1.6847347021102905 (1.6847347021102905) | > loss_kl: 5.134142875671387 (5.134142875671387) | > loss_feat: 0.26854944229125977 (0.26854944229125977) | > loss_mel: 10.978184700012207 (10.978184700012207) | > loss_duration: 3.0302655696868896 (3.0302655696868896) | > loss_1: 21.095876693725586 (21.095876693725586)  --> STEP: 1 | > loss_disc: 2.456347703933716 (2.456347703933716) | > loss_disc_real_0: 0.24840036034584045 (0.24840036034584045) | > loss_disc_real_1: 0.3366581201553345 (0.3366581201553345) | > loss_disc_real_2: 0.2271759957075119 (0.2271759957075119) | > loss_disc_real_3: 0.20022302865982056 (0.20022302865982056) | > loss_disc_real_4: 0.22632545232772827 (0.22632545232772827) | > loss_disc_real_5: 0.3831739127635956 (0.3831739127635956) | > loss_0: 2.456347703933716 (2.456347703933716) | > loss_gen: 2.8142552375793457 (2.8142552375793457) | > loss_kl: 5.636837482452393 (5.636837482452393) | > loss_feat: 7.086666584014893 (7.086666584014893) | > loss_mel: 20.408449172973633 (20.408449172973633) | > loss_duration: 3.4771273136138916 (3.4771273136138916) | > loss_1: 39.423336029052734 (39.423336029052734)  --> STEP: 2 | > loss_disc: 2.6366889476776123 (2.546518325805664) | > loss_disc_real_0: 0.1728600412607193 (0.21063020080327988) | > loss_disc_real_1: 0.27869898080825806 (0.30767855048179626) | > loss_disc_real_2: 0.28750360012054443 (0.25733979791402817) | > loss_disc_real_3: 0.3389616012573242 (0.2695923149585724) | > loss_disc_real_4: 0.15651801228523254 (0.1914217323064804) | > loss_disc_real_5: 0.19615325331687927 (0.2896635830402374) | > loss_0: 2.6366889476776123 (2.546518325805664) | > loss_gen: 2.2677924633026123 (2.541023850440979) | > loss_kl: 5.848238468170166 (5.742537975311279) | > loss_feat: 9.00338077545166 (8.045023679733276) | > loss_mel: 25.753183364868164 (23.0808162689209) | > loss_duration: 3.372455596923828 (3.42479145526886) | > loss_1: 46.245052337646484 (42.83419418334961)  --> STEP: 3 | > loss_disc: 3.0008342266082764 (2.6979569594065347) | > loss_disc_real_0: 0.23208636045455933 (0.21778225402037302) | > loss_disc_real_1: 0.2823598384857178 (0.29923897981643677) | > loss_disc_real_2: 0.2837013602256775 (0.2661269853512446) | > loss_disc_real_3: 0.3027481138706207 (0.2806442479292552) | > loss_disc_real_4: 0.3008866310119629 (0.22791003187497458) | > loss_disc_real_5: 0.37357795238494873 (0.31763503948847455) | > loss_0: 3.0008342266082764 (2.6979569594065347) | > loss_gen: 2.1165263652801514 (2.399524688720703) | > loss_kl: 2.6637377738952637 (4.7162712415059405) | > loss_feat: 2.4482085704803467 (6.179418643315633) | > loss_mel: 17.79294776916504 (21.318193435668945) | > loss_duration: 3.0717475414276123 (3.307110150655111) | > loss_1: 28.09316635131836 (37.920518239339195) --> EVAL PERFORMANCE | > avg_loader_time: 0.009861389795939127 (-0.023286819458007812) | > avg_loss_disc: 2.6979569594065347 (+0.17267107963562012) | > avg_loss_disc_real_0: 0.21778225402037302 (-0.14678522447745004) | > avg_loss_disc_real_1: 0.29923897981643677 (+0.09840193887551626) | > avg_loss_disc_real_2: 0.2661269853512446 (-0.013973946372667911) | > avg_loss_disc_real_3: 0.2806442479292552 (+0.022212947408358275) | > avg_loss_disc_real_4: 0.22791003187497458 (+0.002240687608718872) | > avg_loss_disc_real_5: 0.31763503948847455 (+0.11381569504737857) | > avg_loss_0: 2.6979569594065347 (+0.17267107963562012) | > avg_loss_gen: 2.399524688720703 (-0.13849782943725586) | > avg_loss_kl: 4.7162712415059405 (-0.38159886995951364) | > avg_loss_feat: 6.179418643315633 (+0.1384909749031067) | > avg_loss_mel: 21.318193435668945 (-0.4490483601888009) | > avg_loss_duration: 3.307110150655111 (-0.012563149134317886) | > avg_loss_1: 37.920518239339195 (-0.8432159423828125)  > EPOCH: 1250/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 15:59:57)   --> TIME: 2023-10-20 16:00:16 -- STEP: 29/50 -- GLOBAL_STEP: 115530 | > loss_disc: 2.933380603790283 (2.3243381504354805) | > loss_disc_real_0: 0.15810096263885498 (0.16048280939716716) | > loss_disc_real_1: 0.26047196984291077 (0.2318896254331901) | > loss_disc_real_2: 0.23535071313381195 (0.2221391991037747) | > loss_disc_real_3: 0.24688784778118134 (0.24945990233842666) | > loss_disc_real_4: 0.2670224606990814 (0.20377531053562617) | > loss_disc_real_5: 0.26305460929870605 (0.20734197766809115) | > loss_0: 2.933380603790283 (2.3243381504354805) | > grad_norm_0: tensor(914.4185, device='cuda:0') (tensor(725.6830, device='cuda:0')) | > loss_gen: 1.5312910079956055 (2.6358392485256856) | > loss_kl: 0.8283506035804749 (0.8072121225554367) | > loss_feat: 0.23778070509433746 (7.339857474162147) | > loss_mel: 9.767451286315918 (20.596195821104377) | > loss_duration: 1.3371423482894897 (1.3234468575181633) | > loss_1: 13.70201587677002 (32.70255157865326) | > grad_norm_1: tensor(22380.6250, device='cuda:0') (tensor(25133.0605, device='cuda:0')) | > current_lr_0: 5.729648253636887e-05 | > current_lr_1: 5.735381126161017e-05 | > step_time: 0.5152 (0.4455804495975889) | > loader_time: 0.0115 (0.012498008793797987)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0326552391052246 (3.0326552391052246) | > loss_disc_real_0: 0.19667500257492065 (0.19667500257492065) | > loss_disc_real_1: 0.20798227190971375 (0.20798227190971375) | > loss_disc_real_2: 0.20243966579437256 (0.20243966579437256) | > loss_disc_real_3: 0.2641777992248535 (0.2641777992248535) | > loss_disc_real_4: 0.48034894466400146 (0.48034894466400146) | > loss_disc_real_5: 0.4502161145210266 (0.4502161145210266) | > loss_0: 3.0326552391052246 (3.0326552391052246) | > loss_gen: 2.167612314224243 (2.167612314224243) | > loss_kl: 6.3805437088012695 (6.3805437088012695) | > loss_feat: 4.521718978881836 (4.521718978881836) | > loss_mel: 23.168277740478516 (23.168277740478516) | > loss_duration: 3.0801005363464355 (3.0801005363464355) | > loss_1: 39.31825637817383 (39.31825637817383)  --> STEP: 1 | > loss_disc: 3.182297706604004 (3.182297706604004) | > loss_disc_real_0: 0.19363504648208618 (0.19363504648208618) | > loss_disc_real_1: 0.33838438987731934 (0.33838438987731934) | > loss_disc_real_2: 0.35958564281463623 (0.35958564281463623) | > loss_disc_real_3: 0.41507941484451294 (0.41507941484451294) | > loss_disc_real_4: 0.33566686511039734 (0.33566686511039734) | > loss_disc_real_5: 0.3512685000896454 (0.3512685000896454) | > loss_0: 3.182297706604004 (3.182297706604004) | > loss_gen: 2.067265510559082 (2.067265510559082) | > loss_kl: 5.4220757484436035 (5.4220757484436035) | > loss_feat: 5.523573875427246 (5.523573875427246) | > loss_mel: 23.761844635009766 (23.761844635009766) | > loss_duration: 3.395007610321045 (3.395007610321045) | > loss_1: 40.169769287109375 (40.169769287109375)  --> STEP: 2 | > loss_disc: 2.992015838623047 (3.0871567726135254) | > loss_disc_real_0: 0.33913642168045044 (0.2663857340812683) | > loss_disc_real_1: 0.23842023313045502 (0.2884023115038872) | > loss_disc_real_2: 0.24929316341876984 (0.30443940311670303) | > loss_disc_real_3: 0.25227129459381104 (0.333675354719162) | > loss_disc_real_4: 0.24808068573474884 (0.2918737754225731) | > loss_disc_real_5: 0.2633689045906067 (0.30731870234012604) | > loss_0: 2.992015838623047 (3.0871567726135254) | > loss_gen: 1.6240696907043457 (1.8456676006317139) | > loss_kl: 6.117171764373779 (5.769623756408691) | > loss_feat: 0.07368040829896927 (2.7986271418631077) | > loss_mel: 2.491969347000122 (13.126906991004944) | > loss_duration: 3.357545852661133 (3.376276731491089) | > loss_1: 13.664436340332031 (26.917102813720703)  --> STEP: 3 | > loss_disc: 2.029989719390869 (2.73476775487264) | > loss_disc_real_0: 0.1881507933139801 (0.24030742049217224) | > loss_disc_real_1: 0.12616358697414398 (0.23432273666063944) | > loss_disc_real_2: 0.16579897701740265 (0.2582259277502696) | > loss_disc_real_3: 0.1295669972896576 (0.26563923557599384) | > loss_disc_real_4: 0.13347232341766357 (0.23907329142093658) | > loss_disc_real_5: 0.32305461168289185 (0.3125640054543813) | > loss_0: 2.029989719390869 (2.73476775487264) | > loss_gen: 2.7037999629974365 (2.131711721420288) | > loss_kl: 2.8527889251708984 (4.797345479329427) | > loss_feat: 6.583447456359863 (4.060233913362026) | > loss_mel: 22.487510681152344 (16.247108221054077) | > loss_duration: 3.0032758712768555 (3.2519431114196777) | > loss_1: 37.63082504272461 (30.488343556722004) --> EVAL PERFORMANCE | > avg_loader_time: 0.005762338638305664 (-0.004099051157633463) | > avg_loss_disc: 2.73476775487264 (+0.03681079546610544) | > avg_loss_disc_real_0: 0.24030742049217224 (+0.022525166471799224) | > avg_loss_disc_real_1: 0.23432273666063944 (-0.06491624315579733) | > avg_loss_disc_real_2: 0.2582259277502696 (-0.007901057600975037) | > avg_loss_disc_real_3: 0.26563923557599384 (-0.015005012353261349) | > avg_loss_disc_real_4: 0.23907329142093658 (+0.011163259545962007) | > avg_loss_disc_real_5: 0.3125640054543813 (-0.005071034034093258) | > avg_loss_0: 2.73476775487264 (+0.03681079546610544) | > avg_loss_gen: 2.131711721420288 (-0.26781296730041504) | > avg_loss_kl: 4.797345479329427 (+0.08107423782348633) | > avg_loss_feat: 4.060233913362026 (-2.1191847299536066) | > avg_loss_mel: 16.247108221054077 (-5.071085214614868) | > avg_loss_duration: 3.2519431114196777 (-0.05516703923543309) | > avg_loss_1: 30.488343556722004 (-7.432174682617191)  > EPOCH: 1251/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:00:41)   --> TIME: 2023-10-20 16:00:51 -- STEP: 9/50 -- GLOBAL_STEP: 115560 | > loss_disc: 2.975560188293457 (2.474331325954861) | > loss_disc_real_0: 0.28957921266555786 (0.16647949188740718) | > loss_disc_real_1: 0.26775214076042175 (0.18982347514894274) | > loss_disc_real_2: 0.2720049321651459 (0.2033871639933851) | > loss_disc_real_3: 0.2651364803314209 (0.20416121805707613) | > loss_disc_real_4: 0.26091036200523376 (0.19649598209394348) | > loss_disc_real_5: 0.25277015566825867 (0.18628586808012593) | > loss_0: 2.975560188293457 (2.474331325954861) | > grad_norm_0: tensor(627.5450, device='cuda:0') (tensor(508.4908, device='cuda:0')) | > loss_gen: 1.6031286716461182 (1.9907310406366985) | > loss_kl: 0.441671758890152 (0.7233639889293246) | > loss_feat: 0.12568914890289307 (5.519929806391398) | > loss_mel: 1.7574374675750732 (17.05266308784485) | > loss_duration: 1.224948763847351 (1.2855986886554294) | > loss_1: 5.152875900268555 (26.572285546196827) | > grad_norm_1: tensor(21597.0625, device='cuda:0') (tensor(22276.8887, device='cuda:0')) | > current_lr_0: 5.723921111477776e-05 | > current_lr_1: 5.729648253636887e-05 | > step_time: 0.4491 (0.5792399512396919) | > loader_time: 0.0022 (0.01701211929321289)  --> TIME: 2023-10-20 16:01:11 -- STEP: 39/50 -- GLOBAL_STEP: 115590 | > loss_disc: 1.6120665073394775 (2.4220023720692367) | > loss_disc_real_0: 0.0449247732758522 (0.1428661523028635) | > loss_disc_real_1: 0.11421389132738113 (0.22779255016491964) | > loss_disc_real_2: 0.06922683119773865 (0.21769895882178575) | > loss_disc_real_3: 0.06269460916519165 (0.22331689565609664) | > loss_disc_real_4: 0.0715530514717102 (0.22501480808624855) | > loss_disc_real_5: 0.02679068222641945 (0.22725994175729844) | > loss_0: 1.6120665073394775 (2.4220023720692367) | > grad_norm_0: tensor(437.5792, device='cuda:0') (tensor(647.1993, device='cuda:0')) | > loss_gen: 2.332348585128784 (2.2489588841413846) | > loss_kl: 0.45810678601264954 (0.7863015956603565) | > loss_feat: 10.620505332946777 (5.318798900558017) | > loss_mel: 23.749048233032227 (18.771200311489594) | > loss_duration: 1.3597418069839478 (1.3031827700443757) | > loss_1: 38.51974868774414 (28.428442148061897) | > grad_norm_1: tensor(13755.4229, device='cuda:0') (tensor(20722.2070, device='cuda:0')) | > current_lr_0: 5.723921111477776e-05 | > current_lr_1: 5.729648253636887e-05 | > step_time: 0.5737 (0.6272495037470107) | > loader_time: 0.0164 (0.0218201417189378)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6627354621887207 (2.6627354621887207) | > loss_disc_real_0: 0.1501624584197998 (0.1501624584197998) | > loss_disc_real_1: 0.19356399774551392 (0.19356399774551392) | > loss_disc_real_2: 0.18797990679740906 (0.18797990679740906) | > loss_disc_real_3: 0.20469461381435394 (0.20469461381435394) | > loss_disc_real_4: 0.2810867726802826 (0.2810867726802826) | > loss_disc_real_5: 0.403084933757782 (0.403084933757782) | > loss_0: 2.6627354621887207 (2.6627354621887207) | > loss_gen: 2.1411280632019043 (2.1411280632019043) | > loss_kl: 5.214475154876709 (5.214475154876709) | > loss_feat: 9.07834529876709 (9.07834529876709) | > loss_mel: 23.891624450683594 (23.891624450683594) | > loss_duration: 3.0845022201538086 (3.0845022201538086) | > loss_1: 43.41007614135742 (43.41007614135742)  --> STEP: 1 | > loss_disc: 2.3170735836029053 (2.3170735836029053) | > loss_disc_real_0: 0.13090397417545319 (0.13090397417545319) | > loss_disc_real_1: 0.28844842314720154 (0.28844842314720154) | > loss_disc_real_2: 0.20998439192771912 (0.20998439192771912) | > loss_disc_real_3: 0.16412535309791565 (0.16412535309791565) | > loss_disc_real_4: 0.1547011286020279 (0.1547011286020279) | > loss_disc_real_5: 0.16767200827598572 (0.16767200827598572) | > loss_0: 2.3170735836029053 (2.3170735836029053) | > loss_gen: 2.157559633255005 (2.157559633255005) | > loss_kl: 5.547352313995361 (5.547352313995361) | > loss_feat: 7.632696628570557 (7.632696628570557) | > loss_mel: 21.984376907348633 (21.984376907348633) | > loss_duration: 3.369260549545288 (3.369260549545288) | > loss_1: 40.69124221801758 (40.69124221801758)  --> STEP: 2 | > loss_disc: 2.9972376823425293 (2.6571556329727173) | > loss_disc_real_0: 0.20143352448940277 (0.16616874933242798) | > loss_disc_real_1: 0.2764394283294678 (0.28244392573833466) | > loss_disc_real_2: 0.25325462222099304 (0.23161950707435608) | > loss_disc_real_3: 0.2542645037174225 (0.20919492840766907) | > loss_disc_real_4: 0.25783830881118774 (0.20626971870660782) | > loss_disc_real_5: 0.23949480056762695 (0.20358340442180634) | > loss_0: 2.9972376823425293 (2.6571556329727173) | > loss_gen: 1.4996256828308105 (1.8285926580429077) | > loss_kl: 6.473931789398193 (6.010642051696777) | > loss_feat: 0.17122843861579895 (3.901962533593178) | > loss_mel: 5.3669753074646 (13.675676107406616) | > loss_duration: 3.3508355617523193 (3.3600480556488037) | > loss_1: 16.86259651184082 (28.7769193649292)  --> STEP: 3 | > loss_disc: 3.3907651901245117 (2.9016921520233154) | > loss_disc_real_0: 0.44062235951423645 (0.25765328605969745) | > loss_disc_real_1: 0.2833307385444641 (0.2827395300070445) | > loss_disc_real_2: 0.24316301941871643 (0.2354673445224762) | > loss_disc_real_3: 0.3741058111190796 (0.2641652226448059) | > loss_disc_real_4: 0.3081500232219696 (0.24022982021172842) | > loss_disc_real_5: 0.3550254702568054 (0.2540640930334727) | > loss_0: 3.3907651901245117 (2.9016921520233154) | > loss_gen: 1.7763588428497314 (1.8111813863118489) | > loss_kl: 3.078885078430176 (5.033389727274577) | > loss_feat: 3.4999570846557617 (3.767960717280706) | > loss_mel: 20.823972702026367 (16.058441638946533) | > loss_duration: 3.0210611820220947 (3.2470524311065674) | > loss_1: 32.20023727416992 (29.918025334676106) --> EVAL PERFORMANCE | > avg_loader_time: 0.007543643315633138 (+0.0017813046773274737) | > avg_loss_disc: 2.9016921520233154 (+0.1669243971506753) | > avg_loss_disc_real_0: 0.25765328605969745 (+0.01734586556752521) | > avg_loss_disc_real_1: 0.2827395300070445 (+0.04841679334640506) | > avg_loss_disc_real_2: 0.2354673445224762 (-0.022758583227793394) | > avg_loss_disc_real_3: 0.2641652226448059 (-0.001474012931187929) | > avg_loss_disc_real_4: 0.24022982021172842 (+0.0011565287907918387) | > avg_loss_disc_real_5: 0.2540640930334727 (-0.05849991242090857) | > avg_loss_0: 2.9016921520233154 (+0.1669243971506753) | > avg_loss_gen: 1.8111813863118489 (-0.3205303351084392) | > avg_loss_kl: 5.033389727274577 (+0.23604424794515033) | > avg_loss_feat: 3.767960717280706 (-0.2922731960813203) | > avg_loss_mel: 16.058441638946533 (-0.18866658210754395) | > avg_loss_duration: 3.2470524311065674 (-0.0048906803131103516) | > avg_loss_1: 29.918025334676106 (-0.5703182220458984)  > EPOCH: 1252/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:01:32)   --> TIME: 2023-10-20 16:01:50 -- STEP: 19/50 -- GLOBAL_STEP: 115620 | > loss_disc: 3.0024266242980957 (2.5065261564756693) | > loss_disc_real_0: 0.3619511127471924 (0.1762271722974746) | > loss_disc_real_1: 0.2505374550819397 (0.23424392075915085) | > loss_disc_real_2: 0.37997016310691833 (0.22364004603342005) | > loss_disc_real_3: 0.3168112635612488 (0.23168353501119113) | > loss_disc_real_4: 0.4215424954891205 (0.2570209010063033) | > loss_disc_real_5: 0.2493705302476883 (0.23449037924997115) | > loss_0: 3.0024266242980957 (2.5065261564756693) | > grad_norm_0: tensor(749.2029, device='cuda:0') (tensor(666.0417, device='cuda:0')) | > loss_gen: 2.430488109588623 (2.324836756053724) | > loss_kl: 0.8410988450050354 (0.79845582340893) | > loss_feat: 2.983473062515259 (5.998381371168714) | > loss_mel: 16.243928909301758 (19.8921686159937) | > loss_duration: 1.4426945447921753 (1.3381930307338112) | > loss_1: 23.941682815551758 (30.352035798524554) | > grad_norm_1: tensor(6922.5864, device='cuda:0') (tensor(18423.8184, device='cuda:0')) | > current_lr_0: 5.718199693955826e-05 | > current_lr_1: 5.723921111477776e-05 | > step_time: 0.5462 (0.5919629021694786) | > loader_time: 0.0339 (0.014830739874588815)  --> TIME: 2023-10-20 16:02:11 -- STEP: 49/50 -- GLOBAL_STEP: 115650 | > loss_disc: 2.997596502304077 (2.449411545481001) | > loss_disc_real_0: 0.28049737215042114 (0.1620075270647601) | > loss_disc_real_1: 0.26796576380729675 (0.2189240809149888) | > loss_disc_real_2: 0.2562013566493988 (0.21719370660733203) | > loss_disc_real_3: 0.27454671263694763 (0.2193359147985371) | > loss_disc_real_4: 0.24080738425254822 (0.24179949771080703) | > loss_disc_real_5: 0.2507593035697937 (0.2347063759379849) | > loss_0: 2.997596502304077 (2.449411545481001) | > grad_norm_0: tensor(352.0877, device='cuda:0') (tensor(610.8644, device='cuda:0')) | > loss_gen: 1.5794358253479004 (2.2707629325438514) | > loss_kl: 0.7052171230316162 (0.7088188650656719) | > loss_feat: 0.045682620257139206 (5.968937602046193) | > loss_mel: 3.1103875637054443 (20.39696767622111) | > loss_duration: 1.4284982681274414 (1.3105085419148814) | > loss_1: 6.8692216873168945 (30.655995787406454) | > grad_norm_1: tensor(40706.4258, device='cuda:0') (tensor(16031.6465, device='cuda:0')) | > current_lr_0: 5.718199693955826e-05 | > current_lr_1: 5.723921111477776e-05 | > step_time: 0.4328 (0.6300671927782954) | > loader_time: 0.3857 (0.023999355277236626)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7683446407318115 (2.7683446407318115) | > loss_disc_real_0: 0.17177623510360718 (0.17177623510360718) | > loss_disc_real_1: 0.24662701785564423 (0.24662701785564423) | > loss_disc_real_2: 0.19402095675468445 (0.19402095675468445) | > loss_disc_real_3: 0.21494010090827942 (0.21494010090827942) | > loss_disc_real_4: 0.18872307240962982 (0.18872307240962982) | > loss_disc_real_5: 0.1998530626296997 (0.1998530626296997) | > loss_0: 2.7683446407318115 (2.7683446407318115) | > loss_gen: 1.575265884399414 (1.575265884399414) | > loss_kl: 6.184237480163574 (6.184237480163574) | > loss_feat: 1.9748624563217163 (1.9748624563217163) | > loss_mel: 13.141018867492676 (13.141018867492676) | > loss_duration: 3.0926969051361084 (3.0926969051361084) | > loss_1: 25.968080520629883 (25.968080520629883)  --> STEP: 1 | > loss_disc: 2.7261667251586914 (2.7261667251586914) | > loss_disc_real_0: 0.30830368399620056 (0.30830368399620056) | > loss_disc_real_1: 0.27262482047080994 (0.27262482047080994) | > loss_disc_real_2: 0.23383937776088715 (0.23383937776088715) | > loss_disc_real_3: 0.3791886866092682 (0.3791886866092682) | > loss_disc_real_4: 0.28547048568725586 (0.28547048568725586) | > loss_disc_real_5: 0.28649938106536865 (0.28649938106536865) | > loss_0: 2.7261667251586914 (2.7261667251586914) | > loss_gen: 2.4558169841766357 (2.4558169841766357) | > loss_kl: 5.677988052368164 (5.677988052368164) | > loss_feat: 6.069274425506592 (6.069274425506592) | > loss_mel: 20.72854232788086 (20.72854232788086) | > loss_duration: 3.580212116241455 (3.580212116241455) | > loss_1: 38.511837005615234 (38.511837005615234)  --> STEP: 2 | > loss_disc: 3.2032575607299805 (2.964712142944336) | > loss_disc_real_0: 0.37613940238952637 (0.34222154319286346) | > loss_disc_real_1: 0.40933430194854736 (0.34097956120967865) | > loss_disc_real_2: 0.19157299399375916 (0.21270618587732315) | > loss_disc_real_3: 0.24899663031101227 (0.31409265846014023) | > loss_disc_real_4: 0.29795658588409424 (0.29171353578567505) | > loss_disc_real_5: 0.33442452549934387 (0.31046195328235626) | > loss_0: 3.2032575607299805 (2.964712142944336) | > loss_gen: 1.9977529048919678 (2.2267849445343018) | > loss_kl: 7.037517547607422 (6.357752799987793) | > loss_feat: 9.284808158874512 (7.677041292190552) | > loss_mel: 25.527427673339844 (23.12798500061035) | > loss_duration: 3.3765194416046143 (3.4783657789230347) | > loss_1: 47.22402572631836 (42.8679313659668)  --> STEP: 3 | > loss_disc: 2.7466182708740234 (2.892014185587565) | > loss_disc_real_0: 0.7446204423904419 (0.4763545095920563) | > loss_disc_real_1: 0.29564449191093445 (0.3258678714434306) | > loss_disc_real_2: 0.22324150800704956 (0.21621795992056528) | > loss_disc_real_3: 0.2751826047897339 (0.30112264057000476) | > loss_disc_real_4: 0.2744695246219635 (0.28596553206443787) | > loss_disc_real_5: 0.29617825150489807 (0.30570071935653687) | > loss_0: 2.7466182708740234 (2.892014185587565) | > loss_gen: 3.4314985275268555 (2.628356138865153) | > loss_kl: 2.845029830932617 (5.186845143636067) | > loss_feat: 5.245668411254883 (6.866583665211995) | > loss_mel: 19.389612197875977 (21.881860733032227) | > loss_duration: 3.027486801147461 (3.3280727863311768) | > loss_1: 33.939292907714844 (39.89171854654948) --> EVAL PERFORMANCE | > avg_loader_time: 0.010973850886027018 (+0.00343020757039388) | > avg_loss_disc: 2.892014185587565 (-0.009677966435750474) | > avg_loss_disc_real_0: 0.4763545095920563 (+0.21870122353235882) | > avg_loss_disc_real_1: 0.3258678714434306 (+0.04312834143638611) | > avg_loss_disc_real_2: 0.21621795992056528 (-0.01924938460191092) | > avg_loss_disc_real_3: 0.30112264057000476 (+0.036957417925198854) | > avg_loss_disc_real_4: 0.28596553206443787 (+0.04573571185270944) | > avg_loss_disc_real_5: 0.30570071935653687 (+0.05163662632306415) | > avg_loss_0: 2.892014185587565 (-0.009677966435750474) | > avg_loss_gen: 2.628356138865153 (+0.817174752553304) | > avg_loss_kl: 5.186845143636067 (+0.1534554163614903) | > avg_loss_feat: 6.866583665211995 (+3.0986229479312892) | > avg_loss_mel: 21.881860733032227 (+5.823419094085693) | > avg_loss_duration: 3.3280727863311768 (+0.08102035522460938) | > avg_loss_1: 39.89171854654948 (+9.973693211873371)  > EPOCH: 1253/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:02:22)   --> TIME: 2023-10-20 16:02:44 -- STEP: 29/50 -- GLOBAL_STEP: 115680 | > loss_disc: 2.9969749450683594 (2.508769861583052) | > loss_disc_real_0: 0.1800917088985443 (0.14884193903156395) | > loss_disc_real_1: 0.2607661187648773 (0.22374811832760944) | > loss_disc_real_2: 0.23850387334823608 (0.2308192791353012) | > loss_disc_real_3: 0.2516999840736389 (0.23251927065952074) | > loss_disc_real_4: 0.24399974942207336 (0.2473361033560901) | > loss_disc_real_5: 0.23810656368732452 (0.24658713785224942) | > loss_0: 2.9969749450683594 (2.508769861583052) | > grad_norm_0: tensor(575.1680, device='cuda:0') (tensor(603.8360, device='cuda:0')) | > loss_gen: 1.4320318698883057 (2.2270425516983554) | > loss_kl: 0.745940625667572 (0.8029229938983917) | > loss_feat: 0.06099435314536095 (5.373051989309746) | > loss_mel: 2.8621199131011963 (19.182981433539553) | > loss_duration: 1.2836432456970215 (1.315404879635778) | > loss_1: 6.384729862213135 (28.901403969731824) | > grad_norm_1: tensor(44303.0117, device='cuda:0') (tensor(23596.9453, device='cuda:0')) | > current_lr_0: 5.7124839953489036e-05 | > current_lr_1: 5.718199693955826e-05 | > step_time: 0.4299 (0.5714023524317248) | > loader_time: 0.0047 (0.02152408402541588)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.715752124786377 (2.715752124786377) | > loss_disc_real_0: 0.2758025527000427 (0.2758025527000427) | > loss_disc_real_1: 0.2807968556880951 (0.2807968556880951) | > loss_disc_real_2: 0.2286340743303299 (0.2286340743303299) | > loss_disc_real_3: 0.27621951699256897 (0.27621951699256897) | > loss_disc_real_4: 0.3342800438404083 (0.3342800438404083) | > loss_disc_real_5: 0.2999270260334015 (0.2999270260334015) | > loss_0: 2.715752124786377 (2.715752124786377) | > loss_gen: 2.3226263523101807 (2.3226263523101807) | > loss_kl: 5.190855026245117 (5.190855026245117) | > loss_feat: 3.335764169692993 (3.335764169692993) | > loss_mel: 20.75291633605957 (20.75291633605957) | > loss_duration: 3.0780251026153564 (3.0780251026153564) | > loss_1: 34.6801872253418 (34.6801872253418)  --> STEP: 1 | > loss_disc: 2.810504198074341 (2.810504198074341) | > loss_disc_real_0: 0.1930796355009079 (0.1930796355009079) | > loss_disc_real_1: 0.19191139936447144 (0.19191139936447144) | > loss_disc_real_2: 0.3608810007572174 (0.3608810007572174) | > loss_disc_real_3: 0.4029868543148041 (0.4029868543148041) | > loss_disc_real_4: 0.28115302324295044 (0.28115302324295044) | > loss_disc_real_5: 0.18995139002799988 (0.18995139002799988) | > loss_0: 2.810504198074341 (2.810504198074341) | > loss_gen: 2.2144412994384766 (2.2144412994384766) | > loss_kl: 5.547275543212891 (5.547275543212891) | > loss_feat: 7.731380939483643 (7.731380939483643) | > loss_mel: 22.182586669921875 (22.182586669921875) | > loss_duration: 3.4800798892974854 (3.4800798892974854) | > loss_1: 41.15576171875 (41.15576171875)  --> STEP: 2 | > loss_disc: 2.964191198348999 (2.88734769821167) | > loss_disc_real_0: 0.38204213976860046 (0.2875608876347542) | > loss_disc_real_1: 0.2645955979824066 (0.22825349867343903) | > loss_disc_real_2: 0.3400355577468872 (0.3504582792520523) | > loss_disc_real_3: 0.3131542503833771 (0.3580705523490906) | > loss_disc_real_4: 0.2692616581916809 (0.2752073407173157) | > loss_disc_real_5: 0.26352477073669434 (0.2267380803823471) | > loss_0: 2.964191198348999 (2.88734769821167) | > loss_gen: 2.3012948036193848 (2.2578680515289307) | > loss_kl: 6.983463764190674 (6.265369653701782) | > loss_feat: 2.9993844032287598 (5.365382671356201) | > loss_mel: 12.96388053894043 (17.573233604431152) | > loss_duration: 3.409297466278076 (3.4446886777877808) | > loss_1: 28.657320022583008 (34.906540870666504)  --> STEP: 3 | > loss_disc: 2.122332811355591 (2.63234273592631) | > loss_disc_real_0: 0.27049025893211365 (0.28187067806720734) | > loss_disc_real_1: 0.25711506605148315 (0.23787402113278708) | > loss_disc_real_2: 0.1895258128643036 (0.2968141237894694) | > loss_disc_real_3: 0.18805822730064392 (0.3013997773329417) | > loss_disc_real_4: 0.19458620250225067 (0.24833362797896066) | > loss_disc_real_5: 0.18091121315956116 (0.2114624579747518) | > loss_0: 2.122332811355591 (2.63234273592631) | > loss_gen: 3.3608639240264893 (2.62553334236145) | > loss_kl: 2.43233060836792 (4.987689971923828) | > loss_feat: 7.214450359344482 (5.981738567352295) | > loss_mel: 22.52971076965332 (19.225392659505207) | > loss_duration: 3.05954647064209 (3.3163079420725503) | > loss_1: 38.596900939941406 (36.13666089375814) --> EVAL PERFORMANCE | > avg_loader_time: 0.030809879302978516 (+0.0198360284169515) | > avg_loss_disc: 2.63234273592631 (-0.2596714496612549) | > avg_loss_disc_real_0: 0.28187067806720734 (-0.19448383152484894) | > avg_loss_disc_real_1: 0.23787402113278708 (-0.08799385031064352) | > avg_loss_disc_real_2: 0.2968141237894694 (+0.08059616386890414) | > avg_loss_disc_real_3: 0.3013997773329417 (+0.000277136762936947) | > avg_loss_disc_real_4: 0.24833362797896066 (-0.0376319040854772) | > avg_loss_disc_real_5: 0.2114624579747518 (-0.09423826138178507) | > avg_loss_0: 2.63234273592631 (-0.2596714496612549) | > avg_loss_gen: 2.62553334236145 (-0.0028227965037026514) | > avg_loss_kl: 4.987689971923828 (-0.1991551717122393) | > avg_loss_feat: 5.981738567352295 (-0.8848450978597002) | > avg_loss_mel: 19.225392659505207 (-2.6564680735270194) | > avg_loss_duration: 3.3163079420725503 (-0.01176484425862645) | > avg_loss_1: 36.13666089375814 (-3.7550576527913364)  > EPOCH: 1254/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:03:13)   --> TIME: 2023-10-20 16:03:27 -- STEP: 9/50 -- GLOBAL_STEP: 115710 | > loss_disc: 2.8131284713745117 (2.1901835997899375) | > loss_disc_real_0: 0.1617450714111328 (0.12185152827037705) | > loss_disc_real_1: 0.30793988704681396 (0.2216548059756557) | > loss_disc_real_2: 0.29914358258247375 (0.23035496100783348) | > loss_disc_real_3: 0.40031397342681885 (0.25169428893261486) | > loss_disc_real_4: 0.2304694801568985 (0.19604116967982715) | > loss_disc_real_5: 0.34243619441986084 (0.19891870394349098) | > loss_0: 2.8131284713745117 (2.1901835997899375) | > grad_norm_0: tensor(321.4660, device='cuda:0') (tensor(463.1368, device='cuda:0')) | > loss_gen: 2.2676167488098145 (2.6643817159864636) | > loss_kl: 0.7219516634941101 (0.7520116567611694) | > loss_feat: 3.5881969928741455 (7.515735149383545) | > loss_mel: 13.716466903686523 (21.880217658148872) | > loss_duration: 1.2699706554412842 (1.32103431224823) | > loss_1: 21.56420135498047 (34.13338067796495) | > grad_norm_1: tensor(16986.9297, device='cuda:0') (tensor(18377.1641, device='cuda:0')) | > current_lr_0: 5.706774009940596e-05 | > current_lr_1: 5.7124839953489036e-05 | > step_time: 0.8239 (0.595289044910007) | > loader_time: 0.0306 (0.018950992160373263)  --> TIME: 2023-10-20 16:03:44 -- STEP: 39/50 -- GLOBAL_STEP: 115740 | > loss_disc: 2.1941819190979004 (2.3702793365869765) | > loss_disc_real_0: 0.1263115555047989 (0.12886223521752235) | > loss_disc_real_1: 0.1980648636817932 (0.22462647907340375) | > loss_disc_real_2: 0.15538182854652405 (0.20996651593118143) | > loss_disc_real_3: 0.19972331821918488 (0.2326094415755226) | > loss_disc_real_4: 0.1453588306903839 (0.2201625173433851) | > loss_disc_real_5: 0.1528579294681549 (0.21297224866560635) | > loss_0: 2.1941819190979004 (2.3702793365869765) | > grad_norm_0: tensor(435.5838, device='cuda:0') (tensor(603.6116, device='cuda:0')) | > loss_gen: 2.1547412872314453 (2.356073624048478) | > loss_kl: 0.782210648059845 (0.8096287602033371) | > loss_feat: 6.3608574867248535 (6.112209609303719) | > loss_mel: 16.581605911254883 (20.95629719587473) | > loss_duration: 1.3494354486465454 (1.3183183853442852) | > loss_1: 27.228851318359375 (31.55252743989993) | > grad_norm_1: tensor(9933.1055, device='cuda:0') (tensor(17254.1309, device='cuda:0')) | > current_lr_0: 5.706774009940596e-05 | > current_lr_1: 5.7124839953489036e-05 | > step_time: 0.3456 (0.5626892798986192) | > loader_time: 0.0053 (0.017216853606395233)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7337710857391357 (1.7337710857391357) | > loss_disc_real_0: 0.03528575226664543 (0.03528575226664543) | > loss_disc_real_1: 0.12673619389533997 (0.12673619389533997) | > loss_disc_real_2: 0.13455410301685333 (0.13455410301685333) | > loss_disc_real_3: 0.20149914920330048 (0.20149914920330048) | > loss_disc_real_4: 0.08604223281145096 (0.08604223281145096) | > loss_disc_real_5: 0.06100796163082123 (0.06100796163082123) | > loss_0: 1.7337710857391357 (1.7337710857391357) | > loss_gen: 2.2502403259277344 (2.2502403259277344) | > loss_kl: 5.685919761657715 (5.685919761657715) | > loss_feat: 9.842329978942871 (9.842329978942871) | > loss_mel: 26.158327102661133 (26.158327102661133) | > loss_duration: 3.145169734954834 (3.145169734954834) | > loss_1: 47.08198547363281 (47.08198547363281)  --> STEP: 1 | > loss_disc: 2.3887221813201904 (2.3887221813201904) | > loss_disc_real_0: 0.3427359461784363 (0.3427359461784363) | > loss_disc_real_1: 0.2465270310640335 (0.2465270310640335) | > loss_disc_real_2: 0.22595220804214478 (0.22595220804214478) | > loss_disc_real_3: 0.28033187985420227 (0.28033187985420227) | > loss_disc_real_4: 0.1515604704618454 (0.1515604704618454) | > loss_disc_real_5: 0.16759102046489716 (0.16759102046489716) | > loss_0: 2.3887221813201904 (2.3887221813201904) | > loss_gen: 2.8819451332092285 (2.8819451332092285) | > loss_kl: 5.441464424133301 (5.441464424133301) | > loss_feat: 6.137104034423828 (6.137104034423828) | > loss_mel: 22.43437385559082 (22.43437385559082) | > loss_duration: 3.4839484691619873 (3.4839484691619873) | > loss_1: 40.37883758544922 (40.37883758544922)  --> STEP: 2 | > loss_disc: 2.3869364261627197 (2.387829303741455) | > loss_disc_real_0: 0.24516817927360535 (0.2939520627260208) | > loss_disc_real_1: 0.06818405538797379 (0.15735554322600365) | > loss_disc_real_2: 0.17244243621826172 (0.19919732213020325) | > loss_disc_real_3: 0.14656324684619904 (0.21344756335020065) | > loss_disc_real_4: 0.1959940791130066 (0.173777274787426) | > loss_disc_real_5: 0.15823929011821747 (0.1629151552915573) | > loss_0: 2.3869364261627197 (2.387829303741455) | > loss_gen: 2.2978272438049316 (2.58988618850708) | > loss_kl: 6.153570652008057 (5.797517538070679) | > loss_feat: 10.375873565673828 (8.256488800048828) | > loss_mel: 21.641212463378906 (22.037793159484863) | > loss_duration: 3.3367719650268555 (3.4103602170944214) | > loss_1: 43.80525588989258 (42.0920467376709)  --> STEP: 3 | > loss_disc: 2.5557925701141357 (2.443817059199015) | > loss_disc_real_0: 0.1582867056131363 (0.24873027702172598) | > loss_disc_real_1: 0.24056659638881683 (0.18509256094694138) | > loss_disc_real_2: 0.35462048649787903 (0.25100504358609516) | > loss_disc_real_3: 0.3883875608444214 (0.27176089584827423) | > loss_disc_real_4: 0.21435411274433136 (0.18730288743972778) | > loss_disc_real_5: 0.3391209542751312 (0.22165042161941528) | > loss_0: 2.5557925701141357 (2.443817059199015) | > loss_gen: 2.5143179893493652 (2.564696788787842) | > loss_kl: 2.5385255813598633 (4.71118688583374) | > loss_feat: 4.579835414886475 (7.030937671661377) | > loss_mel: 24.312870025634766 (22.796152114868164) | > loss_duration: 2.9727137088775635 (3.2644780476888022) | > loss_1: 36.91826248168945 (40.367451985677086) --> EVAL PERFORMANCE | > avg_loader_time: 0.01345976193745931 (-0.017350117365519203) | > avg_loss_disc: 2.443817059199015 (-0.18852567672729492) | > avg_loss_disc_real_0: 0.24873027702172598 (-0.033140401045481355) | > avg_loss_disc_real_1: 0.18509256094694138 (-0.0527814601858457) | > avg_loss_disc_real_2: 0.25100504358609516 (-0.045809080203374264) | > avg_loss_disc_real_3: 0.27176089584827423 (-0.02963888148466748) | > avg_loss_disc_real_4: 0.18730288743972778 (-0.06103074053923288) | > avg_loss_disc_real_5: 0.22165042161941528 (+0.010187963644663484) | > avg_loss_0: 2.443817059199015 (-0.18852567672729492) | > avg_loss_gen: 2.564696788787842 (-0.0608365535736084) | > avg_loss_kl: 4.71118688583374 (-0.2765030860900879) | > avg_loss_feat: 7.030937671661377 (+1.049199104309082) | > avg_loss_mel: 22.796152114868164 (+3.570759455362957) | > avg_loss_duration: 3.2644780476888022 (-0.051829894383748076) | > avg_loss_1: 40.367451985677086 (+4.230791091918945)  > EPOCH: 1255/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:04:05)   --> TIME: 2023-10-20 16:04:24 -- STEP: 19/50 -- GLOBAL_STEP: 115770 | > loss_disc: 1.5977743864059448 (2.523504269750495) | > loss_disc_real_0: 0.13457664847373962 (0.155246887061941) | > loss_disc_real_1: 0.12522730231285095 (0.23304170448529093) | > loss_disc_real_2: 0.23349706828594208 (0.23226113186070793) | > loss_disc_real_3: 0.2551337480545044 (0.24561044711031413) | > loss_disc_real_4: 0.262077271938324 (0.23768147796784578) | > loss_disc_real_5: 0.12268995493650436 (0.2336306340110145) | > loss_0: 1.5977743864059448 (2.523504269750495) | > grad_norm_0: tensor(1614.3981, device='cuda:0') (tensor(997.7646, device='cuda:0')) | > loss_gen: 3.9022057056427 (2.2662152742084705) | > loss_kl: 1.192834734916687 (0.867967006407286) | > loss_feat: 8.716997146606445 (4.9918854772848515) | > loss_mel: 24.57537841796875 (17.21396410151532) | > loss_duration: 1.4098961353302002 (1.3387455626537925) | > loss_1: 39.79731369018555 (26.678777468831914) | > grad_norm_1: tensor(64595.1875, device='cuda:0') (tensor(52150.7227, device='cuda:0')) | > current_lr_0: 5.701069732020202e-05 | > current_lr_1: 5.706774009940596e-05 | > step_time: 0.5336 (0.6627121348130075) | > loader_time: 0.0064 (0.02201163141350997)  --> TIME: 2023-10-20 16:04:39 -- STEP: 49/50 -- GLOBAL_STEP: 115800 | > loss_disc: 2.3778066635131836 (2.504727760139777) | > loss_disc_real_0: 0.2166757583618164 (0.15173828039242296) | > loss_disc_real_1: 0.24397829174995422 (0.22636330203742397) | > loss_disc_real_2: 0.3069246709346771 (0.23092002345591175) | > loss_disc_real_3: 0.28561994433403015 (0.24169912242463654) | > loss_disc_real_4: 0.30062270164489746 (0.23202540888926204) | > loss_disc_real_5: 0.35743212699890137 (0.23734132833398727) | > loss_0: 2.3778066635131836 (2.504727760139777) | > grad_norm_0: tensor(2106.8992, device='cuda:0') (tensor(1269.9174, device='cuda:0')) | > loss_gen: 3.1251351833343506 (2.224311731299575) | > loss_kl: 0.6336064338684082 (0.7734057732230547) | > loss_feat: 5.73667049407959 (4.909742057133389) | > loss_mel: 23.565330505371094 (19.14897521296326) | > loss_duration: 1.3512835502624512 (1.3034879017849361) | > loss_1: 34.412025451660156 (28.359922885894775) | > grad_norm_1: tensor(77287.6562, device='cuda:0') (tensor(38070.7266, device='cuda:0')) | > current_lr_0: 5.701069732020202e-05 | > current_lr_1: 5.706774009940596e-05 | > step_time: 0.459 (0.533507322778507) | > loader_time: 0.5696 (0.027636498821024993)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.404477596282959 (2.404477596282959) | > loss_disc_real_0: 0.2670907974243164 (0.2670907974243164) | > loss_disc_real_1: 0.2584505081176758 (0.2584505081176758) | > loss_disc_real_2: 0.2342633754014969 (0.2342633754014969) | > loss_disc_real_3: 0.25252726674079895 (0.25252726674079895) | > loss_disc_real_4: 0.13603705167770386 (0.13603705167770386) | > loss_disc_real_5: 0.12713448703289032 (0.12713448703289032) | > loss_0: 2.404477596282959 (2.404477596282959) | > loss_gen: 2.0786266326904297 (2.0786266326904297) | > loss_kl: 5.786604881286621 (5.786604881286621) | > loss_feat: 4.086079120635986 (4.086079120635986) | > loss_mel: 19.804994583129883 (19.804994583129883) | > loss_duration: 3.0744380950927734 (3.0744380950927734) | > loss_1: 34.83074188232422 (34.83074188232422)  --> STEP: 1 | > loss_disc: 2.813417911529541 (2.813417911529541) | > loss_disc_real_0: 0.3308054208755493 (0.3308054208755493) | > loss_disc_real_1: 0.28165286779403687 (0.28165286779403687) | > loss_disc_real_2: 0.32308289408683777 (0.32308289408683777) | > loss_disc_real_3: 0.3438130021095276 (0.3438130021095276) | > loss_disc_real_4: 0.3715892434120178 (0.3715892434120178) | > loss_disc_real_5: 0.38763734698295593 (0.38763734698295593) | > loss_0: 2.813417911529541 (2.813417911529541) | > loss_gen: 2.7789878845214844 (2.7789878845214844) | > loss_kl: 5.859376430511475 (5.859376430511475) | > loss_feat: 4.326578617095947 (4.326578617095947) | > loss_mel: 24.316593170166016 (24.316593170166016) | > loss_duration: 3.418921709060669 (3.418921709060669) | > loss_1: 40.70045852661133 (40.70045852661133)  --> STEP: 2 | > loss_disc: 2.4649853706359863 (2.6392016410827637) | > loss_disc_real_0: 0.13740067183971405 (0.23410304635763168) | > loss_disc_real_1: 0.18884430825710297 (0.23524858802556992) | > loss_disc_real_2: 0.2522352635860443 (0.28765907883644104) | > loss_disc_real_3: 0.21631227433681488 (0.28006263822317123) | > loss_disc_real_4: 0.14738699793815613 (0.259488120675087) | > loss_disc_real_5: 0.07718575745820999 (0.23241155222058296) | > loss_0: 2.4649853706359863 (2.6392016410827637) | > loss_gen: 2.4672951698303223 (2.6231415271759033) | > loss_kl: 6.234866142272949 (6.047121286392212) | > loss_feat: 9.883673667907715 (7.105126142501831) | > loss_mel: 30.169044494628906 (27.24281883239746) | > loss_duration: 3.3464367389678955 (3.3826792240142822) | > loss_1: 52.101314544677734 (46.40088653564453)  --> STEP: 3 | > loss_disc: 2.8382761478424072 (2.705559810002645) | > loss_disc_real_0: 0.45520639419555664 (0.3078041623036067) | > loss_disc_real_1: 0.2176527976989746 (0.2293833245833715) | > loss_disc_real_2: 0.19577376544475555 (0.2570306410392125) | > loss_disc_real_3: 0.25400179624557495 (0.2713756908973058) | > loss_disc_real_4: 0.31813639402389526 (0.27903754512468976) | > loss_disc_real_5: 0.33660751581192017 (0.26714354008436203) | > loss_0: 2.8382761478424072 (2.705559810002645) | > loss_gen: 2.353342294692993 (2.5332084496816) | > loss_kl: 2.7116317749023438 (4.935291449228923) | > loss_feat: 2.638396978378296 (5.616216421127319) | > loss_mel: 19.85747718811035 (24.781038284301758) | > loss_duration: 3.1122097969055176 (3.292522748311361) | > loss_1: 30.673057556152344 (41.158276875813804) --> EVAL PERFORMANCE | > avg_loader_time: 0.004066944122314453 (-0.009392817815144857) | > avg_loss_disc: 2.705559810002645 (+0.26174275080362985) | > avg_loss_disc_real_0: 0.3078041623036067 (+0.059073885281880706) | > avg_loss_disc_real_1: 0.2293833245833715 (+0.044290763636430114) | > avg_loss_disc_real_2: 0.2570306410392125 (+0.006025597453117371) | > avg_loss_disc_real_3: 0.2713756908973058 (-0.000385204950968443) | > avg_loss_disc_real_4: 0.27903754512468976 (+0.09173465768496197) | > avg_loss_disc_real_5: 0.26714354008436203 (+0.04549311846494675) | > avg_loss_0: 2.705559810002645 (+0.26174275080362985) | > avg_loss_gen: 2.5332084496816 (-0.031488339106241714) | > avg_loss_kl: 4.935291449228923 (+0.2241045633951826) | > avg_loss_feat: 5.616216421127319 (-1.4147212505340576) | > avg_loss_mel: 24.781038284301758 (+1.9848861694335938) | > avg_loss_duration: 3.292522748311361 (+0.028044700622558594) | > avg_loss_1: 41.158276875813804 (+0.7908248901367188)  > EPOCH: 1256/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:04:55)   --> TIME: 2023-10-20 16:05:21 -- STEP: 29/50 -- GLOBAL_STEP: 115830 | > loss_disc: 2.6601948738098145 (2.3852838277816772) | > loss_disc_real_0: 0.22297537326812744 (0.1400477657544202) | > loss_disc_real_1: 0.20667237043380737 (0.21961978225615517) | > loss_disc_real_2: 0.2835962772369385 (0.2404503738828774) | > loss_disc_real_3: 0.3182927668094635 (0.22530684292573352) | > loss_disc_real_4: 0.1963946521282196 (0.2221673642895345) | > loss_disc_real_5: 0.26612433791160583 (0.22689240181754375) | > loss_0: 2.6601948738098145 (2.3852838277816772) | > grad_norm_0: tensor(1024.6616, device='cuda:0') (tensor(1178.1910, device='cuda:0')) | > loss_gen: 2.0268449783325195 (2.3599404096603394) | > loss_kl: 0.764077365398407 (0.8908987785207814) | > loss_feat: 2.269413948059082 (5.896898380898196) | > loss_mel: 11.879380226135254 (19.828889057554047) | > loss_duration: 1.3185023069381714 (1.3184690968743686) | > loss_1: 18.25821876525879 (30.295095229970997) | > grad_norm_1: tensor(21026.1543, device='cuda:0') (tensor(47807.3906, device='cuda:0')) | > current_lr_0: 5.695371155882731e-05 | > current_lr_1: 5.701069732020202e-05 | > step_time: 0.5686 (0.6790491794717723) | > loader_time: 0.0289 (0.023424288322185648)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9694247245788574 (2.9694247245788574) | > loss_disc_real_0: 0.449113130569458 (0.449113130569458) | > loss_disc_real_1: 0.2200976461172104 (0.2200976461172104) | > loss_disc_real_2: 0.22599679231643677 (0.22599679231643677) | > loss_disc_real_3: 0.3647238612174988 (0.3647238612174988) | > loss_disc_real_4: 0.4084223508834839 (0.4084223508834839) | > loss_disc_real_5: 0.4890941083431244 (0.4890941083431244) | > loss_0: 2.9694247245788574 (2.9694247245788574) | > loss_gen: 2.6683719158172607 (2.6683719158172607) | > loss_kl: 6.534457206726074 (6.534457206726074) | > loss_feat: 4.89627742767334 (4.89627742767334) | > loss_mel: 21.837289810180664 (21.837289810180664) | > loss_duration: 3.2014002799987793 (3.2014002799987793) | > loss_1: 39.13779830932617 (39.13779830932617)  --> STEP: 1 | > loss_disc: 3.0423102378845215 (3.0423102378845215) | > loss_disc_real_0: 0.49693387746810913 (0.49693387746810913) | > loss_disc_real_1: 0.26597926020622253 (0.26597926020622253) | > loss_disc_real_2: 0.33644112944602966 (0.33644112944602966) | > loss_disc_real_3: 0.3264446556568146 (0.3264446556568146) | > loss_disc_real_4: 0.2967001795768738 (0.2967001795768738) | > loss_disc_real_5: 0.2830403745174408 (0.2830403745174408) | > loss_0: 3.0423102378845215 (3.0423102378845215) | > loss_gen: 2.110238790512085 (2.110238790512085) | > loss_kl: 6.069957733154297 (6.069957733154297) | > loss_feat: 0.8406400680541992 (0.8406400680541992) | > loss_mel: 19.002756118774414 (19.002756118774414) | > loss_duration: 3.4975509643554688 (3.4975509643554688) | > loss_1: 31.521142959594727 (31.521142959594727)  --> STEP: 2 | > loss_disc: 2.8018453121185303 (2.922077775001526) | > loss_disc_real_0: 0.34151118993759155 (0.41922253370285034) | > loss_disc_real_1: 0.29925936460494995 (0.28261931240558624) | > loss_disc_real_2: 0.19837971031665802 (0.26741041988134384) | > loss_disc_real_3: 0.31401026248931885 (0.3202274590730667) | > loss_disc_real_4: 0.27618393301963806 (0.2864420562982559) | > loss_disc_real_5: 0.26062366366386414 (0.27183201909065247) | > loss_0: 2.8018453121185303 (2.922077775001526) | > loss_gen: 2.202286720275879 (2.156262755393982) | > loss_kl: 6.607997894287109 (6.338977813720703) | > loss_feat: 4.005547523498535 (2.423093795776367) | > loss_mel: 24.262208938598633 (21.632482528686523) | > loss_duration: 3.4052300453186035 (3.451390504837036) | > loss_1: 40.483272552490234 (36.00220775604248)  --> STEP: 3 | > loss_disc: 3.3962292671203613 (3.080128272374471) | > loss_disc_real_0: 0.4793493151664734 (0.4392647941907247) | > loss_disc_real_1: 0.3852147161960602 (0.3168177803357442) | > loss_disc_real_2: 0.3924172818660736 (0.3090793738762538) | > loss_disc_real_3: 0.38195329904556274 (0.34080273906389874) | > loss_disc_real_4: 0.3818289637565613 (0.31823769211769104) | > loss_disc_real_5: 0.44654157757759094 (0.33006853858629864) | > loss_0: 3.3962292671203613 (3.080128272374471) | > loss_gen: 2.586196184158325 (2.2995738983154297) | > loss_kl: 2.6893198490142822 (5.1224251588185625) | > loss_feat: 3.241905689239502 (2.696031093597412) | > loss_mel: 18.319509506225586 (20.52815818786621) | > loss_duration: 2.985975503921509 (3.296252171198527) | > loss_1: 29.822908401489258 (33.94244130452474) --> EVAL PERFORMANCE | > avg_loader_time: 0.0066004594167073565 (+0.0025335152943929034) | > avg_loss_disc: 3.080128272374471 (+0.37456846237182617) | > avg_loss_disc_real_0: 0.4392647941907247 (+0.13146063188711798) | > avg_loss_disc_real_1: 0.3168177803357442 (+0.08743445575237271) | > avg_loss_disc_real_2: 0.3090793738762538 (+0.052048732837041256) | > avg_loss_disc_real_3: 0.34080273906389874 (+0.06942704816659295) | > avg_loss_disc_real_4: 0.31823769211769104 (+0.039200146993001284) | > avg_loss_disc_real_5: 0.33006853858629864 (+0.06292499850193661) | > avg_loss_0: 3.080128272374471 (+0.37456846237182617) | > avg_loss_gen: 2.2995738983154297 (-0.2336345513661704) | > avg_loss_kl: 5.1224251588185625 (+0.1871337095896397) | > avg_loss_feat: 2.696031093597412 (-2.9201853275299072) | > avg_loss_mel: 20.52815818786621 (-4.252880096435547) | > avg_loss_duration: 3.296252171198527 (+0.003729422887166045) | > avg_loss_1: 33.94244130452474 (-7.2158355712890625)  > EPOCH: 1257/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:05:48)   --> TIME: 2023-10-20 16:06:03 -- STEP: 9/50 -- GLOBAL_STEP: 115860 | > loss_disc: 2.864583730697632 (2.331904027197096) | > loss_disc_real_0: 0.13453957438468933 (0.15850035773797166) | > loss_disc_real_1: 0.337400883436203 (0.25193986379437977) | > loss_disc_real_2: 0.2860760986804962 (0.2492273954881562) | > loss_disc_real_3: 0.34417489171028137 (0.24929149904184872) | > loss_disc_real_4: 0.31515875458717346 (0.22164824894732899) | > loss_disc_real_5: 0.29983076453208923 (0.20223913507329094) | > loss_0: 2.864583730697632 (2.331904027197096) | > grad_norm_0: tensor(1268.9933, device='cuda:0') (tensor(1100.6888, device='cuda:0')) | > loss_gen: 1.9949991703033447 (2.4479041629367404) | > loss_kl: 0.5382198095321655 (0.6746196813053555) | > loss_feat: 1.8469535112380981 (5.350185376074579) | > loss_mel: 18.98590850830078 (18.669578737682766) | > loss_duration: 1.2042734622955322 (1.3018214702606201) | > loss_1: 24.570354461669922 (28.44411039352417) | > grad_norm_1: tensor(7305.8096, device='cuda:0') (tensor(45624.6211, device='cuda:0')) | > current_lr_0: 5.689678275828894e-05 | > current_lr_1: 5.695371155882731e-05 | > step_time: 0.4637 (0.9106989171769884) | > loader_time: 0.0109 (0.031147321065266926)  --> TIME: 2023-10-20 16:06:14 -- STEP: 39/50 -- GLOBAL_STEP: 115890 | > loss_disc: 2.6983044147491455 (2.364274624066475) | > loss_disc_real_0: 0.13221558928489685 (0.13448218511751833) | > loss_disc_real_1: 0.2258666604757309 (0.21694735705088347) | > loss_disc_real_2: 0.18107981979846954 (0.22901438959898093) | > loss_disc_real_3: 0.28771159052848816 (0.23924005671571463) | > loss_disc_real_4: 0.21839186549186707 (0.21842972074563688) | > loss_disc_real_5: 0.26102620363235474 (0.23128214994302163) | > loss_0: 2.6983044147491455 (2.364274624066475) | > grad_norm_0: tensor(731.1513, device='cuda:0') (tensor(999.6270, device='cuda:0')) | > loss_gen: 1.7416102886199951 (2.461064396760403) | > loss_kl: 0.32419291138648987 (0.7875742411766296) | > loss_feat: 2.5879528522491455 (6.468960974699794) | > loss_mel: 10.288299560546875 (19.511102089515095) | > loss_duration: 1.3631113767623901 (1.3119559563123262) | > loss_1: 16.305166244506836 (30.540657899318596) | > grad_norm_1: tensor(48689.8594, device='cuda:0') (tensor(45736.5547, device='cuda:0')) | > current_lr_0: 5.689678275828894e-05 | > current_lr_1: 5.695371155882731e-05 | > step_time: 0.2512 (0.4947339877104149) | > loader_time: 0.0041 (0.010986413711156598)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7712273597717285 (2.7712273597717285) | > loss_disc_real_0: 0.2293388396501541 (0.2293388396501541) | > loss_disc_real_1: 0.3701639473438263 (0.3701639473438263) | > loss_disc_real_2: 0.2758583426475525 (0.2758583426475525) | > loss_disc_real_3: 0.37611624598503113 (0.37611624598503113) | > loss_disc_real_4: 0.37232136726379395 (0.37232136726379395) | > loss_disc_real_5: 0.5655383467674255 (0.5655383467674255) | > loss_0: 2.7712273597717285 (2.7712273597717285) | > loss_gen: 3.3517496585845947 (3.3517496585845947) | > loss_kl: 6.181567668914795 (6.181567668914795) | > loss_feat: 7.844944477081299 (7.844944477081299) | > loss_mel: 22.0766544342041 (22.0766544342041) | > loss_duration: 3.1751973628997803 (3.1751973628997803) | > loss_1: 42.63011169433594 (42.63011169433594)  --> STEP: 1 | > loss_disc: 2.3200016021728516 (2.3200016021728516) | > loss_disc_real_0: 0.057131536304950714 (0.057131536304950714) | > loss_disc_real_1: 0.32793644070625305 (0.32793644070625305) | > loss_disc_real_2: 0.20227377116680145 (0.20227377116680145) | > loss_disc_real_3: 0.25491824746131897 (0.25491824746131897) | > loss_disc_real_4: 0.22516724467277527 (0.22516724467277527) | > loss_disc_real_5: 0.0902123674750328 (0.0902123674750328) | > loss_0: 2.3200016021728516 (2.3200016021728516) | > loss_gen: 2.449423313140869 (2.449423313140869) | > loss_kl: 5.839943885803223 (5.839943885803223) | > loss_feat: 9.275899887084961 (9.275899887084961) | > loss_mel: 25.114120483398438 (25.114120483398438) | > loss_duration: 3.540459156036377 (3.540459156036377) | > loss_1: 46.2198486328125 (46.2198486328125)  --> STEP: 2 | > loss_disc: 2.301403522491455 (2.3107025623321533) | > loss_disc_real_0: 0.26937416195869446 (0.16325284913182259) | > loss_disc_real_1: 0.18186591565608978 (0.2549011781811714) | > loss_disc_real_2: 0.3660145401954651 (0.28414415568113327) | > loss_disc_real_3: 0.19127903878688812 (0.22309864312410355) | > loss_disc_real_4: 0.19421979784965515 (0.2096935212612152) | > loss_disc_real_5: 0.16183358430862427 (0.12602297589182854) | > loss_0: 2.301403522491455 (2.3107025623321533) | > loss_gen: 2.716524839401245 (2.582974076271057) | > loss_kl: 6.173086643218994 (6.006515264511108) | > loss_feat: 7.394443988800049 (8.335171937942505) | > loss_mel: 25.957616806030273 (25.535868644714355) | > loss_duration: 3.3458147048950195 (3.4431369304656982) | > loss_1: 45.587486267089844 (45.90366744995117)  --> STEP: 3 | > loss_disc: 2.7823026180267334 (2.467902580897013) | > loss_disc_real_0: 0.24368426203727722 (0.19006332010030746) | > loss_disc_real_1: 0.5589930415153503 (0.3562651326258977) | > loss_disc_real_2: 0.3742758631706238 (0.3141880581776301) | > loss_disc_real_3: 0.34773916006088257 (0.2646454821030299) | > loss_disc_real_4: 0.310281902551651 (0.24322298169136047) | > loss_disc_real_5: 0.3112397789955139 (0.18776191025972366) | > loss_0: 2.7823026180267334 (2.467902580897013) | > loss_gen: 3.068556547164917 (2.7448348999023438) | > loss_kl: 2.7307913303375244 (4.914607286453247) | > loss_feat: 4.737919807434082 (7.136087894439697) | > loss_mel: 23.91054916381836 (24.99409548441569) | > loss_duration: 2.9905107021331787 (3.292261521021525) | > loss_1: 37.43832778930664 (43.081887563069664) --> EVAL PERFORMANCE | > avg_loader_time: 0.007941802342732748 (+0.0013413429260253915) | > avg_loss_disc: 2.467902580897013 (-0.612225691477458) | > avg_loss_disc_real_0: 0.19006332010030746 (-0.2492014740904172) | > avg_loss_disc_real_1: 0.3562651326258977 (+0.0394473522901535) | > avg_loss_disc_real_2: 0.3141880581776301 (+0.005108684301376343) | > avg_loss_disc_real_3: 0.2646454821030299 (-0.07615725696086884) | > avg_loss_disc_real_4: 0.24322298169136047 (-0.07501471042633057) | > avg_loss_disc_real_5: 0.18776191025972366 (-0.14230662832657498) | > avg_loss_0: 2.467902580897013 (-0.612225691477458) | > avg_loss_gen: 2.7448348999023438 (+0.44526100158691406) | > avg_loss_kl: 4.914607286453247 (-0.20781787236531546) | > avg_loss_feat: 7.136087894439697 (+4.440056800842285) | > avg_loss_mel: 24.99409548441569 (+4.46593729654948) | > avg_loss_duration: 3.292261521021525 (-0.003990650177001953) | > avg_loss_1: 43.081887563069664 (+9.139446258544922)  > EPOCH: 1258/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:06:31)   --> TIME: 2023-10-20 16:06:48 -- STEP: 19/50 -- GLOBAL_STEP: 115920 | > loss_disc: 1.1810107231140137 (2.4091240920518575) | > loss_disc_real_0: 0.005777614191174507 (0.1292940857575128) | > loss_disc_real_1: 0.020313171669840813 (0.21957695709639474) | > loss_disc_real_2: 0.016452686861157417 (0.22658164436487774) | > loss_disc_real_3: 0.10178635269403458 (0.24308394013266815) | > loss_disc_real_4: 0.023117542266845703 (0.2387167639834316) | > loss_disc_real_5: 0.028403017669916153 (0.20773156457825712) | > loss_0: 1.1810107231140137 (2.4091240920518575) | > grad_norm_0: tensor(398.2630, device='cuda:0') (tensor(627.3632, device='cuda:0')) | > loss_gen: 2.6320414543151855 (2.4175838169298673) | > loss_kl: 1.1563769578933716 (0.8023769996668163) | > loss_feat: 15.039091110229492 (6.494496983426966) | > loss_mel: 26.3137149810791 (20.028074877826793) | > loss_duration: 1.4057971239089966 (1.3385533470856517) | > loss_1: 46.54702377319336 (31.081086309332598) | > grad_norm_1: tensor(23264.8027, device='cuda:0') (tensor(24999.9570, device='cuda:0')) | > current_lr_0: 5.683991086165097e-05 | > current_lr_1: 5.689678275828894e-05 | > step_time: 0.6648 (0.6222270287965473) | > loader_time: 0.0052 (0.02435906309830515)  --> TIME: 2023-10-20 16:07:06 -- STEP: 49/50 -- GLOBAL_STEP: 115950 | > loss_disc: 2.6612346172332764 (2.4702567178375867) | > loss_disc_real_0: 0.05496884509921074 (0.14048592124742512) | > loss_disc_real_1: 0.24213816225528717 (0.23254092159319897) | > loss_disc_real_2: 0.26512038707733154 (0.22358743926244123) | > loss_disc_real_3: 0.2545563876628876 (0.24835701389428305) | > loss_disc_real_4: 0.27991539239883423 (0.24257652688657447) | > loss_disc_real_5: 0.2651735842227936 (0.23533091612388285) | > loss_0: 2.6612346172332764 (2.4702567178375867) | > grad_norm_0: tensor(557.7917, device='cuda:0') (tensor(625.0930, device='cuda:0')) | > loss_gen: 1.8792154788970947 (2.3031150881125) | > loss_kl: 0.8046290874481201 (0.762641657980121) | > loss_feat: 1.923312783241272 (5.6309743043491425) | > loss_mel: 17.909103393554688 (19.481696237714928) | > loss_duration: 1.4186278581619263 (1.308324385662468) | > loss_1: 23.93488883972168 (29.48675165371019) | > grad_norm_1: tensor(1790.3923, device='cuda:0') (tensor(16472.8574, device='cuda:0')) | > current_lr_0: 5.683991086165097e-05 | > current_lr_1: 5.689678275828894e-05 | > step_time: 0.7048 (0.5939724542656724) | > loader_time: 0.6666 (0.030882402342192982)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9606709480285645 (2.9606709480285645) | > loss_disc_real_0: 0.32637304067611694 (0.32637304067611694) | > loss_disc_real_1: 0.24525417387485504 (0.24525417387485504) | > loss_disc_real_2: 0.24494899809360504 (0.24494899809360504) | > loss_disc_real_3: 0.24334679543972015 (0.24334679543972015) | > loss_disc_real_4: 0.3336002230644226 (0.3336002230644226) | > loss_disc_real_5: 0.3066697418689728 (0.3066697418689728) | > loss_0: 2.9606709480285645 (2.9606709480285645) | > loss_gen: 2.062941551208496 (2.062941551208496) | > loss_kl: 6.0965576171875 (6.0965576171875) | > loss_feat: 6.962950706481934 (6.962950706481934) | > loss_mel: 21.39751434326172 (21.39751434326172) | > loss_duration: 3.0927011966705322 (3.0927011966705322) | > loss_1: 39.612667083740234 (39.612667083740234)  --> STEP: 1 | > loss_disc: 2.4855682849884033 (2.4855682849884033) | > loss_disc_real_0: 0.2829670011997223 (0.2829670011997223) | > loss_disc_real_1: 0.24252957105636597 (0.24252957105636597) | > loss_disc_real_2: 0.19055253267288208 (0.19055253267288208) | > loss_disc_real_3: 0.19784393906593323 (0.19784393906593323) | > loss_disc_real_4: 0.3105758726596832 (0.3105758726596832) | > loss_disc_real_5: 0.3296647071838379 (0.3296647071838379) | > loss_0: 2.4855682849884033 (2.4855682849884033) | > loss_gen: 2.9070775508880615 (2.9070775508880615) | > loss_kl: 5.798302173614502 (5.798302173614502) | > loss_feat: 9.039192199707031 (9.039192199707031) | > loss_mel: 25.792795181274414 (25.792795181274414) | > loss_duration: 3.547708034515381 (3.547708034515381) | > loss_1: 47.0850715637207 (47.0850715637207)  --> STEP: 2 | > loss_disc: 3.1260218620300293 (2.8057950735092163) | > loss_disc_real_0: 0.295183002948761 (0.28907500207424164) | > loss_disc_real_1: 0.10963809490203857 (0.17608383297920227) | > loss_disc_real_2: 0.2927824854850769 (0.2416675090789795) | > loss_disc_real_3: 0.12457859516143799 (0.1612112671136856) | > loss_disc_real_4: 0.1773478239774704 (0.2439618483185768) | > loss_disc_real_5: 0.3044278919696808 (0.31704629957675934) | > loss_0: 3.1260218620300293 (2.8057950735092163) | > loss_gen: 1.6633423566818237 (2.2852099537849426) | > loss_kl: 5.928965091705322 (5.863633632659912) | > loss_feat: 9.953323364257812 (9.496257781982422) | > loss_mel: 23.008882522583008 (24.40083885192871) | > loss_duration: 3.4589569568634033 (3.503332495689392) | > loss_1: 44.01346969604492 (45.54927062988281)  --> STEP: 3 | > loss_disc: 3.1850643157958984 (2.932218154271444) | > loss_disc_real_0: 0.3331083357334137 (0.3037527799606323) | > loss_disc_real_1: 0.34553205966949463 (0.23256657520929971) | > loss_disc_real_2: 0.3978637456893921 (0.2937329212824504) | > loss_disc_real_3: 0.3534230589866638 (0.22528186440467834) | > loss_disc_real_4: 0.38139158487319946 (0.28977176050345105) | > loss_disc_real_5: 0.4335756301879883 (0.3558894097805023) | > loss_0: 3.1850643157958984 (2.932218154271444) | > loss_gen: 2.383678674697876 (2.3180328607559204) | > loss_kl: 2.62095046043396 (4.782739241917928) | > loss_feat: 2.49027419090271 (7.160929918289185) | > loss_mel: 19.818069458007812 (22.873249053955078) | > loss_duration: 3.122636318206787 (3.376433769861857) | > loss_1: 30.435609817504883 (40.5113836924235) --> EVAL PERFORMANCE | > avg_loader_time: 0.018973827362060547 (+0.011032025019327799) | > avg_loss_disc: 2.932218154271444 (+0.46431557337443063) | > avg_loss_disc_real_0: 0.3037527799606323 (+0.11368945986032486) | > avg_loss_disc_real_1: 0.23256657520929971 (-0.12369855741659799) | > avg_loss_disc_real_2: 0.2937329212824504 (-0.02045513689517975) | > avg_loss_disc_real_3: 0.22528186440467834 (-0.03936361769835156) | > avg_loss_disc_real_4: 0.28977176050345105 (+0.046548778812090574) | > avg_loss_disc_real_5: 0.3558894097805023 (+0.16812749952077866) | > avg_loss_0: 2.932218154271444 (+0.46431557337443063) | > avg_loss_gen: 2.3180328607559204 (-0.42680203914642334) | > avg_loss_kl: 4.782739241917928 (-0.1318680445353193) | > avg_loss_feat: 7.160929918289185 (+0.024842023849487305) | > avg_loss_mel: 22.873249053955078 (-2.120846430460613) | > avg_loss_duration: 3.376433769861857 (+0.08417224884033203) | > avg_loss_1: 40.5113836924235 (-2.5705038706461636)  > EPOCH: 1259/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:07:22)   --> TIME: 2023-10-20 16:07:48 -- STEP: 29/50 -- GLOBAL_STEP: 115980 | > loss_disc: 2.730215549468994 (2.43215155190435) | > loss_disc_real_0: 0.18802331387996674 (0.14217246696352961) | > loss_disc_real_1: 0.2671372890472412 (0.21987931995556273) | > loss_disc_real_2: 0.29126882553100586 (0.21878671286434964) | > loss_disc_real_3: 0.24043869972229004 (0.22751186235711493) | > loss_disc_real_4: 0.1990119069814682 (0.21493145926245327) | > loss_disc_real_5: 0.16049082577228546 (0.21895631906929716) | > loss_0: 2.730215549468994 (2.43215155190435) | > grad_norm_0: tensor(774.8800, device='cuda:0') (tensor(716.9523, device='cuda:0')) | > loss_gen: 1.67288339138031 (2.247365688455516) | > loss_kl: 0.8608875870704651 (0.8231440032350605) | > loss_feat: 1.2350666522979736 (5.23556302667692) | > loss_mel: 14.90095043182373 (18.95126863594713) | > loss_duration: 1.309499740600586 (1.3339406046374092) | > loss_1: 19.97928810119629 (28.59128215395171) | > grad_norm_1: tensor(4224.0640, device='cuda:0') (tensor(15462.2852, device='cuda:0')) | > current_lr_0: 5.678309581203441e-05 | > current_lr_1: 5.683991086165097e-05 | > step_time: 0.9302 (0.6806242054906386) | > loader_time: 0.024 (0.017867820016269027)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9063432216644287 (2.9063432216644287) | > loss_disc_real_0: 0.3297724723815918 (0.3297724723815918) | > loss_disc_real_1: 0.2634204924106598 (0.2634204924106598) | > loss_disc_real_2: 0.30930760502815247 (0.30930760502815247) | > loss_disc_real_3: 0.29109737277030945 (0.29109737277030945) | > loss_disc_real_4: 0.44028088450431824 (0.44028088450431824) | > loss_disc_real_5: 0.4821935296058655 (0.4821935296058655) | > loss_0: 2.9063432216644287 (2.9063432216644287) | > loss_gen: 2.7691538333892822 (2.7691538333892822) | > loss_kl: 6.022406101226807 (6.022406101226807) | > loss_feat: 5.436622619628906 (5.436622619628906) | > loss_mel: 23.576171875 (23.576171875) | > loss_duration: 3.199525833129883 (3.199525833129883) | > loss_1: 41.003883361816406 (41.003883361816406)  --> STEP: 1 | > loss_disc: 2.983792304992676 (2.983792304992676) | > loss_disc_real_0: 0.23460820317268372 (0.23460820317268372) | > loss_disc_real_1: 0.20719262957572937 (0.20719262957572937) | > loss_disc_real_2: 0.27705544233322144 (0.27705544233322144) | > loss_disc_real_3: 0.2564862072467804 (0.2564862072467804) | > loss_disc_real_4: 0.34595629572868347 (0.34595629572868347) | > loss_disc_real_5: 0.3116393983364105 (0.3116393983364105) | > loss_0: 2.983792304992676 (2.983792304992676) | > loss_gen: 1.8282155990600586 (1.8282155990600586) | > loss_kl: 5.865265369415283 (5.865265369415283) | > loss_feat: 2.5223565101623535 (2.5223565101623535) | > loss_mel: 21.191499710083008 (21.191499710083008) | > loss_duration: 3.5197813510894775 (3.5197813510894775) | > loss_1: 34.927120208740234 (34.927120208740234)  --> STEP: 2 | > loss_disc: 3.0075864791870117 (2.9956893920898438) | > loss_disc_real_0: 0.16936424374580383 (0.20198622345924377) | > loss_disc_real_1: 0.2632289230823517 (0.23521077632904053) | > loss_disc_real_2: 0.22470994293689728 (0.25088269263505936) | > loss_disc_real_3: 0.29622548818588257 (0.2763558477163315) | > loss_disc_real_4: 0.23326118290424347 (0.28960873931646347) | > loss_disc_real_5: 0.2504010498523712 (0.28102022409439087) | > loss_0: 3.0075864791870117 (2.9956893920898438) | > loss_gen: 1.4488412141799927 (1.6385284066200256) | > loss_kl: 6.192338943481445 (6.028802156448364) | > loss_feat: 0.03498973697423935 (1.2786731235682964) | > loss_mel: 1.0922290086746216 (11.141864359378815) | > loss_duration: 3.338898181915283 (3.4293397665023804) | > loss_1: 12.107297897338867 (23.51720905303955)  --> STEP: 3 | > loss_disc: 2.5857765674591064 (2.859051783879598) | > loss_disc_real_0: 0.09408371895551682 (0.16601872195800146) | > loss_disc_real_1: 0.2945200204849243 (0.25498052438100177) | > loss_disc_real_2: 0.17702385783195496 (0.22626308103402457) | > loss_disc_real_3: 0.26540011167526245 (0.2727039357026418) | > loss_disc_real_4: 0.25340089201927185 (0.2775394568840663) | > loss_disc_real_5: 0.2590433955192566 (0.27369461456934613) | > loss_0: 2.5857765674591064 (2.859051783879598) | > loss_gen: 1.8491134643554688 (1.7087234258651733) | > loss_kl: 3.1429502964019775 (5.066851536432902) | > loss_feat: 1.6667872667312622 (1.4080445046226184) | > loss_mel: 18.351688385009766 (13.545139034589132) | > loss_duration: 3.0867390632629395 (3.3151395320892334) | > loss_1: 28.097278594970703 (25.043898900349934) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_116000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.720799684524536 (2.8244887590408325) | > loss_disc_real_0: 0.07549915462732315 (0.14338883012533188) | > loss_disc_real_1: 0.25831496715545654 (0.2558141350746155) | > loss_disc_real_2: 0.2332228571176529 (0.22800302505493164) | > loss_disc_real_3: 0.2586499750614166 (0.2691904455423355) | > loss_disc_real_4: 0.16630549728870392 (0.24973096698522568) | > loss_disc_real_5: 0.16283613443374634 (0.24597999453544617) | > loss_0: 2.720799684524536 (2.8244887590408325) | > loss_gen: 1.699780821800232 (1.706487774848938) | > loss_kl: 6.048874855041504 (5.3123573660850525) | > loss_feat: 6.749858856201172 (2.7434980925172567) | > loss_mel: 23.636159896850586 (16.067894250154495) | > loss_duration: 3.1387431621551514 (3.271040439605713) | > loss_1: 41.27341842651367 (29.10127878189087)  --> STEP: 1 | > loss_disc: 2.6216835975646973 (2.7839277267456053) | > loss_disc_real_0: 0.14859503507614136 (0.14443007111549377) | > loss_disc_real_1: 0.2764970362186432 (0.259950715303421) | > loss_disc_real_2: 0.232192724943161 (0.2288409650325775) | > loss_disc_real_3: 0.33124667406082153 (0.28160169124603274) | > loss_disc_real_4: 0.2517262101173401 (0.25013001561164855) | > loss_disc_real_5: 0.3483184576034546 (0.2664476871490479) | > loss_0: 2.6216835975646973 (2.7839277267456053) | > loss_gen: 2.2944977283477783 (1.824089765548706) | > loss_kl: 5.794857025146484 (5.408857297897339) | > loss_feat: 6.199824333190918 (3.434763340651989) | > loss_mel: 21.848623275756836 (17.224040055274962) | > loss_duration: 3.5146491527557373 (3.319762182235718) | > loss_1: 39.65245056152344 (31.211513137817384)  --> STEP: 2 | > loss_disc: 2.788393497467041 (2.7846720218658447) | > loss_disc_real_0: 0.32842355966567993 (0.1750956525405248) | > loss_disc_real_1: 0.23941680788993835 (0.2565283974011739) | > loss_disc_real_2: 0.1432342231273651 (0.21457317471504211) | > loss_disc_real_3: 0.1083950623869896 (0.25273391976952553) | > loss_disc_real_4: 0.23732103407382965 (0.2479951853553454) | > loss_disc_real_5: 0.34717756509780884 (0.2799026668071747) | > loss_0: 2.788393497467041 (2.7846720218658447) | > loss_gen: 2.2363576889038086 (1.8928010861078899) | > loss_kl: 6.3789215087890625 (5.5705346663792925) | > loss_feat: 9.765616416931152 (4.48990552003185) | > loss_mel: 22.21358299255371 (18.055630544821422) | > loss_duration: 3.445671319961548 (3.340747038523356) | > loss_1: 44.04015350341797 (33.34961986541748)  --> STEP: 3 | > loss_disc: 2.9265429973602295 (2.8049393040793285) | > loss_disc_real_0: 0.1191917434334755 (0.16710937981094634) | > loss_disc_real_1: 0.2671922743320465 (0.25805180839129854) | > loss_disc_real_2: 0.22358420491218567 (0.21586046474320547) | > loss_disc_real_3: 0.2987684905529022 (0.25931028702429365) | > loss_disc_real_4: 0.2342441827058792 (0.24603075640542166) | > loss_disc_real_5: 0.25715380907058716 (0.27665282998766216) | > loss_0: 2.9265429973602295 (2.8049393040793285) | > loss_gen: 1.4905915260314941 (1.8353425775255476) | > loss_kl: 2.850754976272583 (5.181994710649763) | > loss_feat: 0.33154118061065674 (3.895853471543108) | > loss_mel: 14.059605598449707 (17.48476983819689) | > loss_duration: 3.0361318588256836 (3.2972305842808316) | > loss_1: 21.76862335205078 (31.69519179207938) --> EVAL PERFORMANCE | > avg_loader_time: 0.29709015573774067 (+0.2781163283756801) | > avg_loss_disc: 2.8049393040793285 (-0.12727885019211538) | > avg_loss_disc_real_0: 0.16710937981094634 (-0.13664340014968598) | > avg_loss_disc_real_1: 0.25805180839129854 (+0.02548523318199883) | > avg_loss_disc_real_2: 0.21586046474320547 (-0.0778724565392449) | > avg_loss_disc_real_3: 0.25931028702429365 (+0.034028422619615306) | > avg_loss_disc_real_4: 0.24603075640542166 (-0.04374100409802939) | > avg_loss_disc_real_5: 0.27665282998766216 (-0.07923657979284016) | > avg_loss_0: 2.8049393040793285 (-0.12727885019211538) | > avg_loss_gen: 1.8353425775255476 (-0.4826902832303728) | > avg_loss_kl: 5.181994710649763 (+0.3992554687318348) | > avg_loss_feat: 3.895853471543108 (-3.2650764467460767) | > avg_loss_mel: 17.48476983819689 (-5.3884792157581884) | > avg_loss_duration: 3.2972305842808316 (-0.07920318558102535) | > avg_loss_1: 31.69519179207938 (-8.81619190034412)  > EPOCH: 1260/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:08:20)   --> TIME: 2023-10-20 16:08:28 -- STEP: 9/50 -- GLOBAL_STEP: 116010 | > loss_disc: 2.8147318363189697 (2.2099037965138755) | > loss_disc_real_0: 0.33069494366645813 (0.14688222710457113) | > loss_disc_real_1: 0.26858124136924744 (0.2000837992462847) | > loss_disc_real_2: 0.2452564388513565 (0.18445318026675117) | > loss_disc_real_3: 0.29048803448677063 (0.21965050655934545) | > loss_disc_real_4: 0.2083415389060974 (0.17968910125394663) | > loss_disc_real_5: 0.31798115372657776 (0.19499390986230639) | > loss_0: 2.8147318363189697 (2.2099037965138755) | > grad_norm_0: tensor(626.5125, device='cuda:0') (tensor(432.7765, device='cuda:0')) | > loss_gen: 2.2257795333862305 (2.5096802049212985) | > loss_kl: 0.5334922671318054 (0.7104863598942757) | > loss_feat: 4.218982696533203 (8.070936361948648) | > loss_mel: 21.20667839050293 (22.096767213609482) | > loss_duration: 1.2544876337051392 (1.3033668597539265) | > loss_1: 29.439420700073242 (34.691236919826935) | > grad_norm_1: tensor(4425.3921, device='cuda:0') (tensor(7431.0332, device='cuda:0')) | > current_lr_0: 5.6726337552617096e-05 | > current_lr_1: 5.678309581203441e-05 | > step_time: 0.2938 (0.45979327625698513) | > loader_time: 0.0025 (0.013953473832872178)  --> TIME: 2023-10-20 16:08:45 -- STEP: 39/50 -- GLOBAL_STEP: 116040 | > loss_disc: 2.564763069152832 (2.388373668377216) | > loss_disc_real_0: 0.2284470498561859 (0.14240423714121184) | > loss_disc_real_1: 0.16103523969650269 (0.2180375920083278) | > loss_disc_real_2: 0.16758225858211517 (0.21208633960057527) | > loss_disc_real_3: 0.2246813178062439 (0.24185138845290893) | > loss_disc_real_4: 0.14993496239185333 (0.2174890853751164) | > loss_disc_real_5: 0.21350900828838348 (0.22526646023377395) | > loss_0: 2.564763069152832 (2.388373668377216) | > grad_norm_0: tensor(599.9794, device='cuda:0') (tensor(498.7871, device='cuda:0')) | > loss_gen: 1.75863778591156 (2.316462562634394) | > loss_kl: 0.447645902633667 (0.7361394019845203) | > loss_feat: 4.068161964416504 (5.808490453144679) | > loss_mel: 13.758432388305664 (20.423015498197994) | > loss_duration: 1.4131821393966675 (1.310643351995028) | > loss_1: 21.446060180664062 (30.594751296899258) | > grad_norm_1: tensor(18318.6387, device='cuda:0') (tensor(12519.1885, device='cuda:0')) | > current_lr_0: 5.6726337552617096e-05 | > current_lr_1: 5.678309581203441e-05 | > step_time: 0.9381 (0.5111776498647836) | > loader_time: 0.022 (0.013447388624533629)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4974472522735596 (2.4974472522735596) | > loss_disc_real_0: 0.2871667146682739 (0.2871667146682739) | > loss_disc_real_1: 0.23506782948970795 (0.23506782948970795) | > loss_disc_real_2: 0.30309340357780457 (0.30309340357780457) | > loss_disc_real_3: 0.23993976414203644 (0.23993976414203644) | > loss_disc_real_4: 0.23201721906661987 (0.23201721906661987) | > loss_disc_real_5: 0.23586143553256989 (0.23586143553256989) | > loss_0: 2.4974472522735596 (2.4974472522735596) | > loss_gen: 2.550243377685547 (2.550243377685547) | > loss_kl: 6.150155544281006 (6.150155544281006) | > loss_feat: 5.475416660308838 (5.475416660308838) | > loss_mel: 22.161046981811523 (22.161046981811523) | > loss_duration: 3.0549161434173584 (3.0549161434173584) | > loss_1: 39.391780853271484 (39.391780853271484)  --> STEP: 1 | > loss_disc: 2.9828248023986816 (2.9828248023986816) | > loss_disc_real_0: 0.748426079750061 (0.748426079750061) | > loss_disc_real_1: 0.29287028312683105 (0.29287028312683105) | > loss_disc_real_2: 0.31795334815979004 (0.31795334815979004) | > loss_disc_real_3: 0.22109244763851166 (0.22109244763851166) | > loss_disc_real_4: 0.29940763115882874 (0.29940763115882874) | > loss_disc_real_5: 0.2721128761768341 (0.2721128761768341) | > loss_0: 2.9828248023986816 (2.9828248023986816) | > loss_gen: 2.845079183578491 (2.845079183578491) | > loss_kl: 5.861051559448242 (5.861051559448242) | > loss_feat: 4.655176639556885 (4.655176639556885) | > loss_mel: 21.115612030029297 (21.115612030029297) | > loss_duration: 3.4645583629608154 (3.4645583629608154) | > loss_1: 37.94147491455078 (37.94147491455078)  --> STEP: 2 | > loss_disc: 2.790268659591675 (2.8865467309951782) | > loss_disc_real_0: 0.18192362785339355 (0.4651748538017273) | > loss_disc_real_1: 0.25720763206481934 (0.2750389575958252) | > loss_disc_real_2: 0.16245897114276886 (0.24020615965127945) | > loss_disc_real_3: 0.2731984257698059 (0.24714543670415878) | > loss_disc_real_4: 0.1587071567773819 (0.22905739396810532) | > loss_disc_real_5: 0.36452516913414 (0.31831902265548706) | > loss_0: 2.790268659591675 (2.8865467309951782) | > loss_gen: 2.0826194286346436 (2.4638493061065674) | > loss_kl: 6.043935298919678 (5.95249342918396) | > loss_feat: 8.80866813659668 (6.731922388076782) | > loss_mel: 26.22043800354004 (23.668025016784668) | > loss_duration: 3.405022382736206 (3.4347903728485107) | > loss_1: 46.56068420410156 (42.25107955932617)  --> STEP: 3 | > loss_disc: 2.911022901535034 (2.8947054545084634) | > loss_disc_real_0: 0.5948579907417297 (0.5084025661150614) | > loss_disc_real_1: 0.3293422758579254 (0.29314006368319195) | > loss_disc_real_2: 0.2733645439147949 (0.2512589544057846) | > loss_disc_real_3: 0.3138214647769928 (0.26937077939510345) | > loss_disc_real_4: 0.2526094913482666 (0.23690809309482574) | > loss_disc_real_5: 0.19667434692382812 (0.27777079741160077) | > loss_0: 2.911022901535034 (2.8947054545084634) | > loss_gen: 2.9183263778686523 (2.6153416633605957) | > loss_kl: 2.8519814014434814 (4.918989419937134) | > loss_feat: 5.251591682434082 (6.238478819529216) | > loss_mel: 20.331655502319336 (22.555901845296223) | > loss_duration: 3.025637149810791 (3.298405965169271) | > loss_1: 34.37919235229492 (39.62711715698242) --> EVAL PERFORMANCE | > avg_loader_time: 0.010263840357462565 (-0.2868263153802781) | > avg_loss_disc: 2.8947054545084634 (+0.08976615042913494) | > avg_loss_disc_real_0: 0.5084025661150614 (+0.3412931863041151) | > avg_loss_disc_real_1: 0.29314006368319195 (+0.03508825529189341) | > avg_loss_disc_real_2: 0.2512589544057846 (+0.035398489662579136) | > avg_loss_disc_real_3: 0.26937077939510345 (+0.010060492370809804) | > avg_loss_disc_real_4: 0.23690809309482574 (-0.009122663310595913) | > avg_loss_disc_real_5: 0.27777079741160077 (+0.001117967423938604) | > avg_loss_0: 2.8947054545084634 (+0.08976615042913494) | > avg_loss_gen: 2.6153416633605957 (+0.7799990858350481) | > avg_loss_kl: 4.918989419937134 (-0.2630052907126288) | > avg_loss_feat: 6.238478819529216 (+2.342625347986108) | > avg_loss_mel: 22.555901845296223 (+5.071132007099333) | > avg_loss_duration: 3.298405965169271 (+0.0011753808884393813) | > avg_loss_1: 39.62711715698242 (+7.931925364903041)  > EPOCH: 1261/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:09:10)   --> TIME: 2023-10-20 16:09:27 -- STEP: 19/50 -- GLOBAL_STEP: 116070 | > loss_disc: 2.454890489578247 (2.4740069037989567) | > loss_disc_real_0: 0.028229840099811554 (0.156017994998317) | > loss_disc_real_1: 0.34545204043388367 (0.22849860650144124) | > loss_disc_real_2: 0.2636869251728058 (0.2359507432403533) | > loss_disc_real_3: 0.353270560503006 (0.25605474079125806) | > loss_disc_real_4: 0.27455636858940125 (0.21849085704276436) | > loss_disc_real_5: 0.2663723826408386 (0.2130247836834506) | > loss_0: 2.454890489578247 (2.4740069037989567) | > grad_norm_0: tensor(536.5534, device='cuda:0') (tensor(662.8602, device='cuda:0')) | > loss_gen: 2.4032974243164062 (2.303289400903802) | > loss_kl: 0.6466408371925354 (0.6658798691473509) | > loss_feat: 3.3056530952453613 (5.561779351806955) | > loss_mel: 22.293415069580078 (22.20589404357107) | > loss_duration: 1.4168462753295898 (1.3457790173982318) | > loss_1: 30.065853118896484 (32.08262152420847) | > grad_norm_1: tensor(2094.2817, device='cuda:0') (tensor(21191.7793, device='cuda:0')) | > current_lr_0: 5.666963602663367e-05 | > current_lr_1: 5.6726337552617096e-05 | > step_time: 0.3457 (0.6115779374775133) | > loader_time: 0.003 (0.02185486492357756)  --> TIME: 2023-10-20 16:09:44 -- STEP: 49/50 -- GLOBAL_STEP: 116100 | > loss_disc: 2.339113235473633 (2.4547696478512817) | > loss_disc_real_0: 0.09693680703639984 (0.14543384133020837) | > loss_disc_real_1: 0.13563698530197144 (0.21756114065647125) | > loss_disc_real_2: 0.17981652915477753 (0.2233534787344385) | > loss_disc_real_3: 0.20676037669181824 (0.24413642051572704) | > loss_disc_real_4: 0.4429496228694916 (0.2193532353837271) | > loss_disc_real_5: 0.3018319606781006 (0.21149466753158033) | > loss_0: 2.339113235473633 (2.4547696478512817) | > grad_norm_0: tensor(402.6858, device='cuda:0') (tensor(565.6813, device='cuda:0')) | > loss_gen: 2.637977123260498 (2.2251360611039765) | > loss_kl: 0.6418717503547668 (0.7345656965460096) | > loss_feat: 7.504791736602783 (5.605097012024145) | > loss_mel: 24.281448364257812 (20.71999318259103) | > loss_duration: 1.4465094804763794 (1.3128196463292956) | > loss_1: 36.51259994506836 (30.597611767905093) | > grad_norm_1: tensor(19748.8359, device='cuda:0') (tensor(18523.6133, device='cuda:0')) | > current_lr_0: 5.666963602663367e-05 | > current_lr_1: 5.6726337552617096e-05 | > step_time: 1.0889 (0.5761956827981131) | > loader_time: 0.5003 (0.027047176750338804)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3292179107666016 (2.3292179107666016) | > loss_disc_real_0: 0.1735316514968872 (0.1735316514968872) | > loss_disc_real_1: 0.21666355431079865 (0.21666355431079865) | > loss_disc_real_2: 0.22945453226566315 (0.22945453226566315) | > loss_disc_real_3: 0.2910178303718567 (0.2910178303718567) | > loss_disc_real_4: 0.1987379789352417 (0.1987379789352417) | > loss_disc_real_5: 0.1611768901348114 (0.1611768901348114) | > loss_0: 2.3292179107666016 (2.3292179107666016) | > loss_gen: 2.183744192123413 (2.183744192123413) | > loss_kl: 6.6878252029418945 (6.6878252029418945) | > loss_feat: 9.811101913452148 (9.811101913452148) | > loss_mel: 22.98406410217285 (22.98406410217285) | > loss_duration: 3.1599764823913574 (3.1599764823913574) | > loss_1: 44.82671356201172 (44.82671356201172)  --> STEP: 1 | > loss_disc: 2.915599822998047 (2.915599822998047) | > loss_disc_real_0: 0.211391881108284 (0.211391881108284) | > loss_disc_real_1: 0.23935578763484955 (0.23935578763484955) | > loss_disc_real_2: 0.274492472410202 (0.274492472410202) | > loss_disc_real_3: 0.24619042873382568 (0.24619042873382568) | > loss_disc_real_4: 0.23739704489707947 (0.23739704489707947) | > loss_disc_real_5: 0.2664530575275421 (0.2664530575275421) | > loss_0: 2.915599822998047 (2.915599822998047) | > loss_gen: 1.5682148933410645 (1.5682148933410645) | > loss_kl: 5.495832920074463 (5.495832920074463) | > loss_feat: 0.2241056114435196 (0.2241056114435196) | > loss_mel: 12.821255683898926 (12.821255683898926) | > loss_duration: 3.5516271591186523 (3.5516271591186523) | > loss_1: 23.66103744506836 (23.66103744506836)  --> STEP: 2 | > loss_disc: 2.35957407951355 (2.6375869512557983) | > loss_disc_real_0: 0.1736515909433365 (0.19252173602581024) | > loss_disc_real_1: 0.24510452151298523 (0.2422301545739174) | > loss_disc_real_2: 0.22440271079540253 (0.24944759160280228) | > loss_disc_real_3: 0.39695224165916443 (0.32157133519649506) | > loss_disc_real_4: 0.18444781005382538 (0.21092242747545242) | > loss_disc_real_5: 0.1813696324825287 (0.2239113450050354) | > loss_0: 2.35957407951355 (2.6375869512557983) | > loss_gen: 2.755638360977173 (2.1619266271591187) | > loss_kl: 5.858719825744629 (5.677276372909546) | > loss_feat: 10.321104049682617 (5.272604830563068) | > loss_mel: 24.338764190673828 (18.580009937286377) | > loss_duration: 3.4705727100372314 (3.511099934577942) | > loss_1: 46.74480056762695 (35.202919006347656)  --> STEP: 3 | > loss_disc: 2.96807861328125 (2.7477508385976157) | > loss_disc_real_0: 0.31093475222587585 (0.23199274142583212) | > loss_disc_real_1: 0.3325127363204956 (0.2723243484894435) | > loss_disc_real_2: 0.3231859505176544 (0.2740270445744197) | > loss_disc_real_3: 0.2677454948425293 (0.3036293884118398) | > loss_disc_real_4: 0.28983035683631897 (0.23722507059574127) | > loss_disc_real_5: 0.3162105679512024 (0.25467775265375775) | > loss_0: 2.96807861328125 (2.7477508385976157) | > loss_gen: 2.052966833114624 (2.1256066958109536) | > loss_kl: 2.7988715171813965 (4.717808087666829) | > loss_feat: 2.267477512359619 (4.270895724495252) | > loss_mel: 19.725385665893555 (18.9618018468221) | > loss_duration: 2.948655128479004 (3.3236183325449624) | > loss_1: 29.793357849121094 (33.399731953938804) --> EVAL PERFORMANCE | > avg_loader_time: 0.019524812698364258 (+0.009260972340901693) | > avg_loss_disc: 2.7477508385976157 (-0.14695461591084769) | > avg_loss_disc_real_0: 0.23199274142583212 (-0.27640982468922926) | > avg_loss_disc_real_1: 0.2723243484894435 (-0.020815715193748474) | > avg_loss_disc_real_2: 0.2740270445744197 (+0.02276809016863507) | > avg_loss_disc_real_3: 0.3036293884118398 (+0.03425860901673633) | > avg_loss_disc_real_4: 0.23722507059574127 (+0.00031697750091552734) | > avg_loss_disc_real_5: 0.25467775265375775 (-0.023093044757843018) | > avg_loss_0: 2.7477508385976157 (-0.14695461591084769) | > avg_loss_gen: 2.1256066958109536 (-0.4897349675496421) | > avg_loss_kl: 4.717808087666829 (-0.20118133227030466) | > avg_loss_feat: 4.270895724495252 (-1.9675830950339641) | > avg_loss_mel: 18.9618018468221 (-3.594099998474121) | > avg_loss_duration: 3.3236183325449624 (+0.025212367375691436) | > avg_loss_1: 33.399731953938804 (-6.227385203043617)  > EPOCH: 1262/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:10:03)   --> TIME: 2023-10-20 16:10:38 -- STEP: 29/50 -- GLOBAL_STEP: 116130 | > loss_disc: 2.913851737976074 (2.3431435330160735) | > loss_disc_real_0: 0.36454933881759644 (0.14146906872890114) | > loss_disc_real_1: 0.31289535760879517 (0.22403818285413857) | > loss_disc_real_2: 0.31930938363075256 (0.2404998560147039) | > loss_disc_real_3: 0.45426449179649353 (0.2534012572261794) | > loss_disc_real_4: 0.16240017116069794 (0.21363000886450553) | > loss_disc_real_5: 0.26323530077934265 (0.23158988581392273) | > loss_0: 2.913851737976074 (2.3431435330160735) | > grad_norm_0: tensor(622.6372, device='cuda:0') (tensor(484.9606, device='cuda:0')) | > loss_gen: 2.4027211666107178 (2.543545801064064) | > loss_kl: 0.7948278188705444 (0.7749713458891573) | > loss_feat: 5.2983078956604 (7.657045810900885) | > loss_mel: 21.85541534423828 (22.391121239497743) | > loss_duration: 1.2988228797912598 (1.3244756254656562) | > loss_1: 31.650094985961914 (34.691160136255725) | > grad_norm_1: tensor(18248.9492, device='cuda:0') (tensor(21977.5762, device='cuda:0')) | > current_lr_0: 5.661299117737551e-05 | > current_lr_1: 5.666963602663367e-05 | > step_time: 0.4833 (0.5362189802630194) | > loader_time: 0.0365 (0.014434058090736127)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8461556434631348 (2.8461556434631348) | > loss_disc_real_0: 0.13809046149253845 (0.13809046149253845) | > loss_disc_real_1: 0.24719713628292084 (0.24719713628292084) | > loss_disc_real_2: 0.1989203840494156 (0.1989203840494156) | > loss_disc_real_3: 0.30063214898109436 (0.30063214898109436) | > loss_disc_real_4: 0.21930266916751862 (0.21930266916751862) | > loss_disc_real_5: 0.22203406691551208 (0.22203406691551208) | > loss_0: 2.8461556434631348 (2.8461556434631348) | > loss_gen: 1.649032711982727 (1.649032711982727) | > loss_kl: 6.24365234375 (6.24365234375) | > loss_feat: 5.374853610992432 (5.374853610992432) | > loss_mel: 21.521804809570312 (21.521804809570312) | > loss_duration: 3.150594472885132 (3.150594472885132) | > loss_1: 37.939937591552734 (37.939937591552734)  --> STEP: 1 | > loss_disc: 2.0497641563415527 (2.0497641563415527) | > loss_disc_real_0: 0.1651688814163208 (0.1651688814163208) | > loss_disc_real_1: 0.17693082988262177 (0.17693082988262177) | > loss_disc_real_2: 0.1930132508277893 (0.1930132508277893) | > loss_disc_real_3: 0.20316076278686523 (0.20316076278686523) | > loss_disc_real_4: 0.2089269608259201 (0.2089269608259201) | > loss_disc_real_5: 0.13865524530410767 (0.13865524530410767) | > loss_0: 2.0497641563415527 (2.0497641563415527) | > loss_gen: 2.4692301750183105 (2.4692301750183105) | > loss_kl: 5.553049564361572 (5.553049564361572) | > loss_feat: 7.556716442108154 (7.556716442108154) | > loss_mel: 23.86885643005371 (23.86885643005371) | > loss_duration: 3.5682506561279297 (3.5682506561279297) | > loss_1: 43.01610565185547 (43.01610565185547)  --> STEP: 2 | > loss_disc: 2.985276937484741 (2.517520546913147) | > loss_disc_real_0: 0.27003705501556396 (0.21760296821594238) | > loss_disc_real_1: 0.25548478960990906 (0.2162078097462654) | > loss_disc_real_2: 0.24154984951019287 (0.2172815501689911) | > loss_disc_real_3: 0.25195029377937317 (0.2275555282831192) | > loss_disc_real_4: 0.239975243806839 (0.22445110231637955) | > loss_disc_real_5: 0.2669600546360016 (0.20280764997005463) | > loss_0: 2.985276937484741 (2.517520546913147) | > loss_gen: 1.5455304384231567 (2.0073803067207336) | > loss_kl: 6.250959396362305 (5.9020044803619385) | > loss_feat: 0.05667954310774803 (3.806697992607951) | > loss_mel: 1.6287645101547241 (12.748810470104218) | > loss_duration: 3.4137282371520996 (3.4909894466400146) | > loss_1: 12.895662307739258 (27.955883979797363)  --> STEP: 3 | > loss_disc: 2.9876630306243896 (2.674234708150228) | > loss_disc_real_0: 0.27220749855041504 (0.23580447832743326) | > loss_disc_real_1: 0.25539132952690125 (0.22926898300647736) | > loss_disc_real_2: 0.24190761148929596 (0.22549023727575937) | > loss_disc_real_3: 0.2519730031490326 (0.235694686571757) | > loss_disc_real_4: 0.23997415602207184 (0.22962545355161032) | > loss_disc_real_5: 0.2670436203479767 (0.22421964009602866) | > loss_0: 2.9876630306243896 (2.674234708150228) | > loss_gen: 1.5457425117492676 (1.8535010417302449) | > loss_kl: 2.799114227294922 (4.8677077293396) | > loss_feat: 0.0539320632815361 (2.555776016165813) | > loss_mel: 1.8828561305999756 (9.12682569026947) | > loss_duration: 3.054103374481201 (3.34536075592041) | > loss_1: 9.335748672485352 (21.74917221069336) --> EVAL PERFORMANCE | > avg_loader_time: 0.008957544962565104 (-0.010567267735799154) | > avg_loss_disc: 2.674234708150228 (-0.0735161304473877) | > avg_loss_disc_real_0: 0.23580447832743326 (+0.003811736901601137) | > avg_loss_disc_real_1: 0.22926898300647736 (-0.043055365482966124) | > avg_loss_disc_real_2: 0.22549023727575937 (-0.048536807298660306) | > avg_loss_disc_real_3: 0.235694686571757 (-0.0679347018400828) | > avg_loss_disc_real_4: 0.22962545355161032 (-0.007599617044130952) | > avg_loss_disc_real_5: 0.22421964009602866 (-0.030458112557729095) | > avg_loss_0: 2.674234708150228 (-0.0735161304473877) | > avg_loss_gen: 1.8535010417302449 (-0.27210565408070875) | > avg_loss_kl: 4.8677077293396 (+0.14989964167277048) | > avg_loss_feat: 2.555776016165813 (-1.7151197083294387) | > avg_loss_mel: 9.12682569026947 (-9.834976156552631) | > avg_loss_duration: 3.34536075592041 (+0.02174242337544774) | > avg_loss_1: 21.74917221069336 (-11.650559743245445)  > EPOCH: 1263/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:11:17)   --> TIME: 2023-10-20 16:11:29 -- STEP: 9/50 -- GLOBAL_STEP: 116160 | > loss_disc: 2.6972815990448 (2.535384323861864) | > loss_disc_real_0: 0.058082036674022675 (0.1759650959736771) | > loss_disc_real_1: 0.17680595815181732 (0.22352411184046003) | > loss_disc_real_2: 0.29992905259132385 (0.22199762405620682) | > loss_disc_real_3: 0.28506186604499817 (0.2630668696429994) | > loss_disc_real_4: 0.32271963357925415 (0.23035889284478295) | > loss_disc_real_5: 0.2893371880054474 (0.22694797213706705) | > loss_0: 2.6972815990448 (2.535384323861864) | > grad_norm_0: tensor(590.2995, device='cuda:0') (tensor(671.2499, device='cuda:0')) | > loss_gen: 1.8809731006622314 (2.167401976055569) | > loss_kl: 0.5815949440002441 (0.9258432255850898) | > loss_feat: 2.751037120819092 (4.07760579759876) | > loss_mel: 20.493385314941406 (13.847131941053602) | > loss_duration: 1.2796330451965332 (1.2902878787782457) | > loss_1: 26.986623764038086 (22.308270931243896) | > grad_norm_1: tensor(12838.5410, device='cuda:0') (tensor(23041.2852, device='cuda:0')) | > current_lr_0: 5.655640294819068e-05 | > current_lr_1: 5.661299117737551e-05 | > step_time: 0.8183 (0.8149485323164198) | > loader_time: 0.0447 (0.029403739505343966)  --> TIME: 2023-10-20 16:11:47 -- STEP: 39/50 -- GLOBAL_STEP: 116190 | > loss_disc: 1.8932349681854248 (2.4398264212486067) | > loss_disc_real_0: 0.20476076006889343 (0.15057078438500562) | > loss_disc_real_1: 0.25744614005088806 (0.22675374393852857) | > loss_disc_real_2: 0.20462483167648315 (0.2090556416182946) | > loss_disc_real_3: 0.1847875416278839 (0.23484463056024069) | > loss_disc_real_4: 0.14810390770435333 (0.23120158676726696) | > loss_disc_real_5: 0.06310353428125381 (0.2161996887328151) | > loss_0: 1.8932349681854248 (2.4398264212486067) | > grad_norm_0: tensor(731.8894, device='cuda:0') (tensor(669.0133, device='cuda:0')) | > loss_gen: 2.9057703018188477 (2.268039361024514) | > loss_kl: 0.6869275569915771 (0.8049798309803009) | > loss_feat: 7.934912204742432 (5.338996484207037) | > loss_mel: 20.611230850219727 (19.484051368175408) | > loss_duration: 1.3585050106048584 (1.297370773095351) | > loss_1: 33.497344970703125 (29.19343758852054) | > grad_norm_1: tensor(10088.7275, device='cuda:0') (tensor(17410.6309, device='cuda:0')) | > current_lr_0: 5.655640294819068e-05 | > current_lr_1: 5.661299117737551e-05 | > step_time: 0.3608 (0.6178371539482703) | > loader_time: 0.0136 (0.018845331974518605)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.527184247970581 (2.527184247970581) | > loss_disc_real_0: 0.19389337301254272 (0.19389337301254272) | > loss_disc_real_1: 0.2557412087917328 (0.2557412087917328) | > loss_disc_real_2: 0.3599318563938141 (0.3599318563938141) | > loss_disc_real_3: 0.2858535647392273 (0.2858535647392273) | > loss_disc_real_4: 0.2414660006761551 (0.2414660006761551) | > loss_disc_real_5: 0.2937096655368805 (0.2937096655368805) | > loss_0: 2.527184247970581 (2.527184247970581) | > loss_gen: 2.6811025142669678 (2.6811025142669678) | > loss_kl: 6.513420104980469 (6.513420104980469) | > loss_feat: 6.926925182342529 (6.926925182342529) | > loss_mel: 23.046926498413086 (23.046926498413086) | > loss_duration: 3.1487462520599365 (3.1487462520599365) | > loss_1: 42.31712341308594 (42.31712341308594)  --> STEP: 1 | > loss_disc: 2.5984461307525635 (2.5984461307525635) | > loss_disc_real_0: 0.35378867387771606 (0.35378867387771606) | > loss_disc_real_1: 0.2741701304912567 (0.2741701304912567) | > loss_disc_real_2: 0.20407123863697052 (0.20407123863697052) | > loss_disc_real_3: 0.12558889389038086 (0.12558889389038086) | > loss_disc_real_4: 0.21638958156108856 (0.21638958156108856) | > loss_disc_real_5: 0.3073747754096985 (0.3073747754096985) | > loss_0: 2.5984461307525635 (2.5984461307525635) | > loss_gen: 2.1905298233032227 (2.1905298233032227) | > loss_kl: 6.313572406768799 (6.313572406768799) | > loss_feat: 4.704055309295654 (4.704055309295654) | > loss_mel: 23.875064849853516 (23.875064849853516) | > loss_duration: 3.606410503387451 (3.606410503387451) | > loss_1: 40.689632415771484 (40.689632415771484)  --> STEP: 2 | > loss_disc: 3.022566556930542 (2.8105063438415527) | > loss_disc_real_0: 0.3609737753868103 (0.3573812246322632) | > loss_disc_real_1: 0.2568112015724182 (0.26549066603183746) | > loss_disc_real_2: 0.26705822348594666 (0.2355647310614586) | > loss_disc_real_3: 0.2601921260356903 (0.19289050996303558) | > loss_disc_real_4: 0.26010391116142273 (0.23824674636125565) | > loss_disc_real_5: 0.2529110014438629 (0.2801428884267807) | > loss_0: 3.022566556930542 (2.8105063438415527) | > loss_gen: 1.659085988998413 (1.9248079061508179) | > loss_kl: 6.0456461906433105 (6.179609298706055) | > loss_feat: 0.009487321600317955 (2.356771315447986) | > loss_mel: 0.7995580434799194 (12.337311446666718) | > loss_duration: 3.344158887863159 (3.475284695625305) | > loss_1: 11.85793685913086 (26.273784637451172)  --> STEP: 3 | > loss_disc: 3.083860158920288 (2.9016242822011313) | > loss_disc_real_0: 0.41844767332077026 (0.3777367075284322) | > loss_disc_real_1: 0.41417792439460754 (0.3150530854860942) | > loss_disc_real_2: 0.5240928530693054 (0.33174077173074085) | > loss_disc_real_3: 0.44181469082832336 (0.27586523691813153) | > loss_disc_real_4: 0.365212082862854 (0.28056852519512177) | > loss_disc_real_5: 0.2361832857131958 (0.2654896875222524) | > loss_0: 3.083860158920288 (2.9016242822011313) | > loss_gen: 3.4769692420959473 (2.442195018132528) | > loss_kl: 2.682527780532837 (5.013915459314982) | > loss_feat: 5.309399127960205 (3.3409805862853923) | > loss_mel: 23.871810913085938 (16.18214460213979) | > loss_duration: 2.9714925289154053 (3.307353973388672) | > loss_1: 38.31220245361328 (30.286590576171875) --> EVAL PERFORMANCE | > avg_loader_time: 0.00911553700764974 (+0.00015799204508463657) | > avg_loss_disc: 2.9016242822011313 (+0.22738957405090332) | > avg_loss_disc_real_0: 0.3777367075284322 (+0.14193222920099893) | > avg_loss_disc_real_1: 0.3150530854860942 (+0.08578410247961682) | > avg_loss_disc_real_2: 0.33174077173074085 (+0.10625053445498148) | > avg_loss_disc_real_3: 0.27586523691813153 (+0.04017055034637454) | > avg_loss_disc_real_4: 0.28056852519512177 (+0.050943071643511445) | > avg_loss_disc_real_5: 0.2654896875222524 (+0.04127004742622373) | > avg_loss_0: 2.9016242822011313 (+0.22738957405090332) | > avg_loss_gen: 2.442195018132528 (+0.5886939764022829) | > avg_loss_kl: 5.013915459314982 (+0.14620772997538278) | > avg_loss_feat: 3.3409805862853923 (+0.7852045701195793) | > avg_loss_mel: 16.18214460213979 (+7.0553189118703195) | > avg_loss_duration: 3.307353973388672 (-0.03800678253173828) | > avg_loss_1: 30.286590576171875 (+8.537418365478516)  > EPOCH: 1264/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:12:10)   --> TIME: 2023-10-20 16:12:31 -- STEP: 19/50 -- GLOBAL_STEP: 116220 | > loss_disc: 2.7927327156066895 (2.5144844682593095) | > loss_disc_real_0: 0.07062229514122009 (0.14661561158534728) | > loss_disc_real_1: 0.27254730463027954 (0.20884865934127256) | > loss_disc_real_2: 0.2171076536178589 (0.23779892372457603) | > loss_disc_real_3: 0.25529977679252625 (0.23137359360330984) | > loss_disc_real_4: 0.25164100527763367 (0.2280060186197883) | > loss_disc_real_5: 0.2557462155818939 (0.2145912019830001) | > loss_0: 2.7927327156066895 (2.5144844682593095) | > grad_norm_0: tensor(1285.5215, device='cuda:0') (tensor(686.9416, device='cuda:0')) | > loss_gen: 1.6439735889434814 (2.1066170805378963) | > loss_kl: 0.9671152830123901 (0.8362015642617878) | > loss_feat: 1.0378347635269165 (4.424690767338402) | > loss_mel: 11.159049987792969 (18.179384833888005) | > loss_duration: 1.3836402893066406 (1.3319832400271767) | > loss_1: 16.191612243652344 (26.878877790350664) | > grad_norm_1: tensor(5883.0923, device='cuda:0') (tensor(24033.2910, device='cuda:0')) | > current_lr_0: 5.649987128248387e-05 | > current_lr_1: 5.655640294819068e-05 | > step_time: 0.5577 (0.7371413833216617) | > loader_time: 0.0245 (0.03233961055153295)  --> TIME: 2023-10-20 16:12:44 -- STEP: 49/50 -- GLOBAL_STEP: 116250 | > loss_disc: 2.615875005722046 (2.547635771790329) | > loss_disc_real_0: 0.15239131450653076 (0.1638951669542157) | > loss_disc_real_1: 0.3641820251941681 (0.22219160518475942) | > loss_disc_real_2: 0.25805893540382385 (0.23167310579090702) | > loss_disc_real_3: 0.33898767828941345 (0.23594554163971726) | > loss_disc_real_4: 0.20053090155124664 (0.24619672880793103) | > loss_disc_real_5: 0.25372639298439026 (0.2388620651041975) | > loss_0: 2.615875005722046 (2.547635771790329) | > grad_norm_0: tensor(588.4346, device='cuda:0') (tensor(673.3873, device='cuda:0')) | > loss_gen: 2.3167359828948975 (2.1697501163093413) | > loss_kl: 0.488518625497818 (0.8228001071482288) | > loss_feat: 4.541718482971191 (4.716507252381773) | > loss_mel: 22.006507873535156 (18.81037986765102) | > loss_duration: 1.417464017868042 (1.2969256250225771) | > loss_1: 30.770944595336914 (27.81636314975972) | > grad_norm_1: tensor(10820.0137, device='cuda:0') (tensor(21034.9492, device='cuda:0')) | > current_lr_0: 5.649987128248387e-05 | > current_lr_1: 5.655640294819068e-05 | > step_time: 0.5071 (0.5265189092986438) | > loader_time: 0.4124 (0.027378568843919402)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6119163036346436 (2.6119163036346436) | > loss_disc_real_0: 0.10007397830486298 (0.10007397830486298) | > loss_disc_real_1: 0.28309085965156555 (0.28309085965156555) | > loss_disc_real_2: 0.24145403504371643 (0.24145403504371643) | > loss_disc_real_3: 0.20978905260562897 (0.20978905260562897) | > loss_disc_real_4: 0.21489214897155762 (0.21489214897155762) | > loss_disc_real_5: 0.2787061035633087 (0.2787061035633087) | > loss_0: 2.6119163036346436 (2.6119163036346436) | > loss_gen: 1.9309136867523193 (1.9309136867523193) | > loss_kl: 6.356924057006836 (6.356924057006836) | > loss_feat: 4.744958400726318 (4.744958400726318) | > loss_mel: 17.223840713500977 (17.223840713500977) | > loss_duration: 3.040126323699951 (3.040126323699951) | > loss_1: 33.2967643737793 (33.2967643737793)  --> STEP: 1 | > loss_disc: 2.9285078048706055 (2.9285078048706055) | > loss_disc_real_0: 0.5050933361053467 (0.5050933361053467) | > loss_disc_real_1: 0.2849971354007721 (0.2849971354007721) | > loss_disc_real_2: 0.2599746584892273 (0.2599746584892273) | > loss_disc_real_3: 0.0611216239631176 (0.0611216239631176) | > loss_disc_real_4: 0.19572286307811737 (0.19572286307811737) | > loss_disc_real_5: 0.39564865827560425 (0.39564865827560425) | > loss_0: 2.9285078048706055 (2.9285078048706055) | > loss_gen: 2.3052916526794434 (2.3052916526794434) | > loss_kl: 5.508502006530762 (5.508502006530762) | > loss_feat: 6.610005855560303 (6.610005855560303) | > loss_mel: 24.609006881713867 (24.609006881713867) | > loss_duration: 3.5101351737976074 (3.5101351737976074) | > loss_1: 42.54294204711914 (42.54294204711914)  --> STEP: 2 | > loss_disc: 2.199157476425171 (2.563832640647888) | > loss_disc_real_0: 0.14467564225196838 (0.32488448917865753) | > loss_disc_real_1: 0.13717277348041534 (0.21108495444059372) | > loss_disc_real_2: 0.24661549925804138 (0.25329507887363434) | > loss_disc_real_3: 0.1319652646780014 (0.0965434443205595) | > loss_disc_real_4: 0.18450017273426056 (0.19011151790618896) | > loss_disc_real_5: 0.22734424471855164 (0.31149645149707794) | > loss_0: 2.199157476425171 (2.563832640647888) | > loss_gen: 2.433208703994751 (2.369250178337097) | > loss_kl: 6.178915977478027 (5.8437089920043945) | > loss_feat: 6.90334939956665 (6.756677627563477) | > loss_mel: 25.182849884033203 (24.895928382873535) | > loss_duration: 3.354628562927246 (3.4323818683624268) | > loss_1: 44.05295181274414 (43.29794692993164)  --> STEP: 3 | > loss_disc: 2.60807728767395 (2.578580856323242) | > loss_disc_real_0: 0.17328917980194092 (0.27435271938641864) | > loss_disc_real_1: 0.3247969448566437 (0.2489889512459437) | > loss_disc_real_2: 0.2780575156211853 (0.2615492244561513) | > loss_disc_real_3: 0.24926628172397614 (0.14745105678836504) | > loss_disc_real_4: 0.28581246733665466 (0.22201183438301086) | > loss_disc_real_5: 0.2660607099533081 (0.29635120431582135) | > loss_0: 2.60807728767395 (2.578580856323242) | > loss_gen: 2.2422878742218018 (2.3269294102986655) | > loss_kl: 2.689462423324585 (4.792293469111125) | > loss_feat: 4.245271682739258 (5.91954231262207) | > loss_mel: 23.084064483642578 (24.29197374979655) | > loss_duration: 3.084359884262085 (3.3163745403289795) | > loss_1: 35.34544372558594 (40.64711252848307) --> EVAL PERFORMANCE | > avg_loader_time: 0.013706445693969727 (+0.004590908686319986) | > avg_loss_disc: 2.578580856323242 (-0.32304342587788915) | > avg_loss_disc_real_0: 0.27435271938641864 (-0.10338398814201355) | > avg_loss_disc_real_1: 0.2489889512459437 (-0.06606413424015048) | > avg_loss_disc_real_2: 0.2615492244561513 (-0.07019154727458954) | > avg_loss_disc_real_3: 0.14745105678836504 (-0.1284141801297665) | > avg_loss_disc_real_4: 0.22201183438301086 (-0.0585566908121109) | > avg_loss_disc_real_5: 0.29635120431582135 (+0.030861516793568966) | > avg_loss_0: 2.578580856323242 (-0.32304342587788915) | > avg_loss_gen: 2.3269294102986655 (-0.1152656078338623) | > avg_loss_kl: 4.792293469111125 (-0.22162199020385742) | > avg_loss_feat: 5.91954231262207 (+2.578561726336678) | > avg_loss_mel: 24.29197374979655 (+8.109829147656761) | > avg_loss_duration: 3.3163745403289795 (+0.009020566940307617) | > avg_loss_1: 40.64711252848307 (+10.360521952311196)  > EPOCH: 1265/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:13:02)   --> TIME: 2023-10-20 16:13:21 -- STEP: 29/50 -- GLOBAL_STEP: 116280 | > loss_disc: 2.9650893211364746 (2.5057235915085365) | > loss_disc_real_0: 0.29687047004699707 (0.13904953889291863) | > loss_disc_real_1: 0.21480706334114075 (0.23089063797017623) | > loss_disc_real_2: 0.2846227288246155 (0.21808994381592192) | > loss_disc_real_3: 0.21015363931655884 (0.23573142778256845) | > loss_disc_real_4: 0.26412972807884216 (0.22857946192781473) | > loss_disc_real_5: 0.24565467238426208 (0.24375008451270647) | > loss_0: 2.9650893211364746 (2.5057235915085365) | > grad_norm_0: tensor(1632.3682, device='cuda:0') (tensor(654.0519, device='cuda:0')) | > loss_gen: 1.5576303005218506 (2.2375247725125025) | > loss_kl: 0.9043950438499451 (0.8044448063291353) | > loss_feat: 0.2281600385904312 (5.476985469460487) | > loss_mel: 10.427848815917969 (19.906840698472386) | > loss_duration: 1.2880278825759888 (1.31315933424851) | > loss_1: 14.406062126159668 (29.738955349757752) | > grad_norm_1: tensor(21243.6660, device='cuda:0') (tensor(22284.9746, device='cuda:0')) | > current_lr_0: 5.644339612371634e-05 | > current_lr_1: 5.649987128248387e-05 | > step_time: 0.3788 (0.42746137750559837) | > loader_time: 0.01 (0.01507596311898067)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.784402847290039 (2.784402847290039) | > loss_disc_real_0: 0.24154379963874817 (0.24154379963874817) | > loss_disc_real_1: 0.24320150911808014 (0.24320150911808014) | > loss_disc_real_2: 0.18185201287269592 (0.18185201287269592) | > loss_disc_real_3: 0.1943916380405426 (0.1943916380405426) | > loss_disc_real_4: 0.18741954863071442 (0.18741954863071442) | > loss_disc_real_5: 0.19285118579864502 (0.19285118579864502) | > loss_0: 2.784402847290039 (2.784402847290039) | > loss_gen: 1.556020975112915 (1.556020975112915) | > loss_kl: 5.472705841064453 (5.472705841064453) | > loss_feat: 1.6762597560882568 (1.6762597560882568) | > loss_mel: 13.787528991699219 (13.787528991699219) | > loss_duration: 3.1306564807891846 (3.1306564807891846) | > loss_1: 25.623172760009766 (25.623172760009766)  --> STEP: 1 | > loss_disc: 3.7092838287353516 (3.7092838287353516) | > loss_disc_real_0: 1.111911654472351 (1.111911654472351) | > loss_disc_real_1: 0.27725324034690857 (0.27725324034690857) | > loss_disc_real_2: 0.27512454986572266 (0.27512454986572266) | > loss_disc_real_3: 0.2547122836112976 (0.2547122836112976) | > loss_disc_real_4: 0.2601528763771057 (0.2601528763771057) | > loss_disc_real_5: 0.3906669020652771 (0.3906669020652771) | > loss_0: 3.7092838287353516 (3.7092838287353516) | > loss_gen: 2.3259856700897217 (2.3259856700897217) | > loss_kl: 5.463059425354004 (5.463059425354004) | > loss_feat: 5.917771816253662 (5.917771816253662) | > loss_mel: 24.47133445739746 (24.47133445739746) | > loss_duration: 3.624795913696289 (3.624795913696289) | > loss_1: 41.802947998046875 (41.802947998046875)  --> STEP: 2 | > loss_disc: 2.975229501724243 (3.3422566652297974) | > loss_disc_real_0: 0.31218528747558594 (0.7120484709739685) | > loss_disc_real_1: 0.2592862546443939 (0.26826974749565125) | > loss_disc_real_2: 0.22014836966991425 (0.24763645976781845) | > loss_disc_real_3: 0.2601173520088196 (0.2574148178100586) | > loss_disc_real_4: 0.259345144033432 (0.25974901020526886) | > loss_disc_real_5: 0.2415146827697754 (0.31609079241752625) | > loss_0: 2.975229501724243 (3.3422566652297974) | > loss_gen: 1.601771593093872 (1.9638786315917969) | > loss_kl: 6.1708478927612305 (5.816953659057617) | > loss_feat: 0.12042579054832458 (3.0190988034009933) | > loss_mel: 7.498419284820557 (15.984876871109009) | > loss_duration: 3.493068218231201 (3.558932065963745) | > loss_1: 18.884532928466797 (30.343740463256836)  --> STEP: 3 | > loss_disc: 2.870450019836426 (3.184987783432007) | > loss_disc_real_0: 0.1991533637046814 (0.5410834352175394) | > loss_disc_real_1: 0.3210037052631378 (0.2858477334181468) | > loss_disc_real_2: 0.42926207184791565 (0.3081783304611842) | > loss_disc_real_3: 0.3515113890171051 (0.2887803415457408) | > loss_disc_real_4: 0.36116471886634827 (0.29355424642562866) | > loss_disc_real_5: 0.31475862860679626 (0.3156467378139496) | > loss_0: 2.870450019836426 (3.184987783432007) | > loss_gen: 2.689513683319092 (2.205756982167562) | > loss_kl: 3.16493558883667 (4.932947635650635) | > loss_feat: 4.86569881439209 (3.6346321403980255) | > loss_mel: 22.452777862548828 (18.140843868255615) | > loss_duration: 3.0336833000183105 (3.3838491439819336) | > loss_1: 36.206607818603516 (32.29802958170573) --> EVAL PERFORMANCE | > avg_loader_time: 0.007469971974690755 (-0.006236473719278972) | > avg_loss_disc: 3.184987783432007 (+0.6064069271087646) | > avg_loss_disc_real_0: 0.5410834352175394 (+0.2667307158311208) | > avg_loss_disc_real_1: 0.2858477334181468 (+0.03685878217220309) | > avg_loss_disc_real_2: 0.3081783304611842 (+0.046629106005032894) | > avg_loss_disc_real_3: 0.2887803415457408 (+0.14132928475737574) | > avg_loss_disc_real_4: 0.29355424642562866 (+0.0715424120426178) | > avg_loss_disc_real_5: 0.3156467378139496 (+0.019295533498128237) | > avg_loss_0: 3.184987783432007 (+0.6064069271087646) | > avg_loss_gen: 2.205756982167562 (-0.12117242813110352) | > avg_loss_kl: 4.932947635650635 (+0.1406541665395098) | > avg_loss_feat: 3.6346321403980255 (-2.284910172224045) | > avg_loss_mel: 18.140843868255615 (-6.151129881540935) | > avg_loss_duration: 3.3838491439819336 (+0.0674746036529541) | > avg_loss_1: 32.29802958170573 (-8.349082946777344)  > EPOCH: 1266/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:13:55)   --> TIME: 2023-10-20 16:14:19 -- STEP: 9/50 -- GLOBAL_STEP: 116310 | > loss_disc: 3.009310722351074 (2.3818503618240356) | > loss_disc_real_0: 0.24927200376987457 (0.12297911341819498) | > loss_disc_real_1: 0.2644248604774475 (0.20463486967815292) | > loss_disc_real_2: 0.23533524572849274 (0.201178172396289) | > loss_disc_real_3: 0.25913432240486145 (0.21636572604378065) | > loss_disc_real_4: 0.25955596566200256 (0.22309275137053597) | > loss_disc_real_5: 0.2512842118740082 (0.21815751637849543) | > loss_0: 3.009310722351074 (2.3818503618240356) | > grad_norm_0: tensor(1429.4072, device='cuda:0') (tensor(693.7853, device='cuda:0')) | > loss_gen: 1.5361214876174927 (2.176549474398295) | > loss_kl: 0.597669780254364 (0.9855135679244995) | > loss_feat: 0.05506142973899841 (5.494850126198596) | > loss_mel: 2.460881233215332 (16.46261927816603) | > loss_duration: 1.2571942806243896 (1.3092240360048082) | > loss_1: 5.906928062438965 (26.4287559721205) | > grad_norm_1: tensor(14153.7275, device='cuda:0') (tensor(21141.3535, device='cuda:0')) | > current_lr_0: 5.6386977415405873e-05 | > current_lr_1: 5.644339612371634e-05 | > step_time: 0.5949 (0.5961578422122531) | > loader_time: 0.0042 (0.015130811267428927)  --> TIME: 2023-10-20 16:14:42 -- STEP: 39/50 -- GLOBAL_STEP: 116340 | > loss_disc: 1.6516364812850952 (2.404829816940503) | > loss_disc_real_0: 0.02257779985666275 (0.13930122334605607) | > loss_disc_real_1: 0.1305401623249054 (0.2158944628750666) | > loss_disc_real_2: 0.09969481080770493 (0.22303555046136564) | > loss_disc_real_3: 0.11501897871494293 (0.2436506189405918) | > loss_disc_real_4: 0.06473705917596817 (0.22437198952031442) | > loss_disc_real_5: 0.04597153514623642 (0.21566518704191998) | > loss_0: 1.6516364812850952 (2.404829816940503) | > grad_norm_0: tensor(604.7593, device='cuda:0') (tensor(705.0526, device='cuda:0')) | > loss_gen: 2.41593337059021 (2.275260096941239) | > loss_kl: 0.4800921678543091 (0.8474847762248455) | > loss_feat: 10.395517349243164 (5.720060538213986) | > loss_mel: 22.148883819580078 (18.744807185270847) | > loss_duration: 1.390025019645691 (1.3031495534456694) | > loss_1: 36.83045196533203 (28.89076229242178) | > grad_norm_1: tensor(4597.5537, device='cuda:0') (tensor(23460.5000, device='cuda:0')) | > current_lr_0: 5.6386977415405873e-05 | > current_lr_1: 5.644339612371634e-05 | > step_time: 0.9311 (0.6801931185600085) | > loader_time: 0.0266 (0.02299328339405549)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7315309047698975 (2.7315309047698975) | > loss_disc_real_0: 0.09243275970220566 (0.09243275970220566) | > loss_disc_real_1: 0.2780558466911316 (0.2780558466911316) | > loss_disc_real_2: 0.18222498893737793 (0.18222498893737793) | > loss_disc_real_3: 0.3005017042160034 (0.3005017042160034) | > loss_disc_real_4: 0.18766894936561584 (0.18766894936561584) | > loss_disc_real_5: 0.2217937707901001 (0.2217937707901001) | > loss_0: 2.7315309047698975 (2.7315309047698975) | > loss_gen: 1.9312454462051392 (1.9312454462051392) | > loss_kl: 5.57001256942749 (5.57001256942749) | > loss_feat: 7.107849597930908 (7.107849597930908) | > loss_mel: 23.61114501953125 (23.61114501953125) | > loss_duration: 3.192023515701294 (3.192023515701294) | > loss_1: 41.41227722167969 (41.41227722167969)  --> STEP: 1 | > loss_disc: 2.7506327629089355 (2.7506327629089355) | > loss_disc_real_0: 0.2342582792043686 (0.2342582792043686) | > loss_disc_real_1: 0.3828388452529907 (0.3828388452529907) | > loss_disc_real_2: 0.20192398130893707 (0.20192398130893707) | > loss_disc_real_3: 0.3911956250667572 (0.3911956250667572) | > loss_disc_real_4: 0.2653370201587677 (0.2653370201587677) | > loss_disc_real_5: 0.33720365166664124 (0.33720365166664124) | > loss_0: 2.7506327629089355 (2.7506327629089355) | > loss_gen: 2.7063241004943848 (2.7063241004943848) | > loss_kl: 6.040098667144775 (6.040098667144775) | > loss_feat: 6.2451910972595215 (6.2451910972595215) | > loss_mel: 26.17157745361328 (26.17157745361328) | > loss_duration: 3.457821846008301 (3.457821846008301) | > loss_1: 44.62101364135742 (44.62101364135742)  --> STEP: 2 | > loss_disc: 3.1453943252563477 (2.9480135440826416) | > loss_disc_real_0: 0.2799241840839386 (0.2570912316441536) | > loss_disc_real_1: 0.32255664467811584 (0.3526977449655533) | > loss_disc_real_2: 0.3049537241458893 (0.2534388527274132) | > loss_disc_real_3: 0.2559616267681122 (0.3235786259174347) | > loss_disc_real_4: 0.26123887300491333 (0.2632879465818405) | > loss_disc_real_5: 0.3791367709636688 (0.35817021131515503) | > loss_0: 3.1453943252563477 (2.9480135440826416) | > loss_gen: 2.26440167427063 (2.4853628873825073) | > loss_kl: 6.047590255737305 (6.04384446144104) | > loss_feat: 7.5819292068481445 (6.913560152053833) | > loss_mel: 21.9852294921875 (24.07840347290039) | > loss_duration: 3.2878243923187256 (3.372823119163513) | > loss_1: 41.16697311401367 (42.89399337768555)  --> STEP: 3 | > loss_disc: 2.941274404525757 (2.9457671642303467) | > loss_disc_real_0: 0.152194082736969 (0.22212551534175873) | > loss_disc_real_1: 0.25877195596694946 (0.32138914863268536) | > loss_disc_real_2: 0.2778622806072235 (0.2615799953540166) | > loss_disc_real_3: 0.2628200650215149 (0.3033257722854614) | > loss_disc_real_4: 0.259622722864151 (0.26206620534261066) | > loss_disc_real_5: 0.27529042959213257 (0.3305436174074809) | > loss_0: 2.941274404525757 (2.9457671642303467) | > loss_gen: 1.5701327323913574 (2.180286169052124) | > loss_kl: 2.9059863090515137 (4.997891743977864) | > loss_feat: 0.4393688440322876 (4.755496382713318) | > loss_mel: 11.871773719787598 (20.00952688852946) | > loss_duration: 2.9919281005859375 (3.245858112970988) | > loss_1: 19.779190063476562 (35.18905893961588) --> EVAL PERFORMANCE | > avg_loader_time: 0.002290646235148112 (-0.005179325739542643) | > avg_loss_disc: 2.9457671642303467 (-0.23922061920166016) | > avg_loss_disc_real_0: 0.22212551534175873 (-0.3189579198757807) | > avg_loss_disc_real_1: 0.32138914863268536 (+0.035541415214538574) | > avg_loss_disc_real_2: 0.2615799953540166 (-0.0465983351071676) | > avg_loss_disc_real_3: 0.3033257722854614 (+0.014545430739720644) | > avg_loss_disc_real_4: 0.26206620534261066 (-0.031488041083018004) | > avg_loss_disc_real_5: 0.3305436174074809 (+0.01489687959353131) | > avg_loss_0: 2.9457671642303467 (-0.23922061920166016) | > avg_loss_gen: 2.180286169052124 (-0.025470813115437974) | > avg_loss_kl: 4.997891743977864 (+0.06494410832722952) | > avg_loss_feat: 4.755496382713318 (+1.1208642423152924) | > avg_loss_mel: 20.00952688852946 (+1.8686830202738456) | > avg_loss_duration: 3.245858112970988 (-0.13799103101094579) | > avg_loss_1: 35.18905893961588 (+2.8910293579101562)  > EPOCH: 1267/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:15:08)   --> TIME: 2023-10-20 16:15:29 -- STEP: 19/50 -- GLOBAL_STEP: 116370 | > loss_disc: 1.7682514190673828 (2.4580112319243583) | > loss_disc_real_0: 0.09229524433612823 (0.14766776689181202) | > loss_disc_real_1: 0.20070664584636688 (0.215577829237047) | > loss_disc_real_2: 0.19820693135261536 (0.2314409148928366) | > loss_disc_real_3: 0.1452997326850891 (0.22979101970007546) | > loss_disc_real_4: 0.10732367634773254 (0.19791770353913307) | > loss_disc_real_5: 0.11830485612154007 (0.2173403334852896) | > loss_0: 1.7682514190673828 (2.4580112319243583) | > grad_norm_0: tensor(309.0596, device='cuda:0') (tensor(553.4101, device='cuda:0')) | > loss_gen: 2.5747666358947754 (2.2139774874637) | > loss_kl: 0.6919990181922913 (0.8267035201976174) | > loss_feat: 5.58358907699585 (5.983161607169007) | > loss_mel: 23.106544494628906 (19.466779875127894) | > loss_duration: 1.4418466091156006 (1.3256918254651522) | > loss_1: 33.398746490478516 (29.816314596878854) | > grad_norm_1: tensor(7743.8115, device='cuda:0') (tensor(29927.6777, device='cuda:0')) | > current_lr_0: 5.633061510112671e-05 | > current_lr_1: 5.6386977415405873e-05 | > step_time: 0.7861 (0.6806940154025429) | > loader_time: 0.026 (0.025153411062140214)  --> TIME: 2023-10-20 16:15:48 -- STEP: 49/50 -- GLOBAL_STEP: 116400 | > loss_disc: 3.0067214965820312 (2.4450142456560715) | > loss_disc_real_0: 0.33137911558151245 (0.14015604734268727) | > loss_disc_real_1: 0.2667231559753418 (0.22058996501169642) | > loss_disc_real_2: 0.2461329698562622 (0.21318648135935775) | > loss_disc_real_3: 0.29606130719184875 (0.24272883442059465) | > loss_disc_real_4: 0.30254411697387695 (0.21846581368269968) | > loss_disc_real_5: 0.2778075933456421 (0.22072225419462335) | > loss_0: 3.0067214965820312 (2.4450142456560715) | > grad_norm_0: tensor(530.6361, device='cuda:0') (tensor(643.2810, device='cuda:0')) | > loss_gen: 1.7158350944519043 (2.288787170332305) | > loss_kl: 0.986341655254364 (0.8343896549575183) | > loss_feat: 0.07401368767023087 (5.979918723697869) | > loss_mel: 4.230860710144043 (19.734084257057738) | > loss_duration: 1.410560131072998 (1.3034664684412434) | > loss_1: 8.417611122131348 (30.140646593911306) | > grad_norm_1: tensor(30264.1250, device='cuda:0') (tensor(24207.5957, device='cuda:0')) | > current_lr_0: 5.633061510112671e-05 | > current_lr_1: 5.6386977415405873e-05 | > step_time: 0.4832 (0.6272394267880186) | > loader_time: 0.4044 (0.029859640160385437)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.784149169921875 (2.784149169921875) | > loss_disc_real_0: 0.2592392563819885 (0.2592392563819885) | > loss_disc_real_1: 0.3245639503002167 (0.3245639503002167) | > loss_disc_real_2: 0.4050085246562958 (0.4050085246562958) | > loss_disc_real_3: 0.2624254524707794 (0.2624254524707794) | > loss_disc_real_4: 0.3229122459888458 (0.3229122459888458) | > loss_disc_real_5: 0.3284952938556671 (0.3284952938556671) | > loss_0: 2.784149169921875 (2.784149169921875) | > loss_gen: 2.827162027359009 (2.827162027359009) | > loss_kl: 6.4258270263671875 (6.4258270263671875) | > loss_feat: 7.163298606872559 (7.163298606872559) | > loss_mel: 23.178497314453125 (23.178497314453125) | > loss_duration: 3.099569082260132 (3.099569082260132) | > loss_1: 42.69435501098633 (42.69435501098633)  --> STEP: 1 | > loss_disc: 2.672196388244629 (2.672196388244629) | > loss_disc_real_0: 0.3581773638725281 (0.3581773638725281) | > loss_disc_real_1: 0.18747659027576447 (0.18747659027576447) | > loss_disc_real_2: 0.23797889053821564 (0.23797889053821564) | > loss_disc_real_3: 0.19762559235095978 (0.19762559235095978) | > loss_disc_real_4: 0.1565883904695511 (0.1565883904695511) | > loss_disc_real_5: 0.11595340073108673 (0.11595340073108673) | > loss_0: 2.672196388244629 (2.672196388244629) | > loss_gen: 1.789808750152588 (1.789808750152588) | > loss_kl: 6.096936225891113 (6.096936225891113) | > loss_feat: 5.832907676696777 (5.832907676696777) | > loss_mel: 24.923686981201172 (24.923686981201172) | > loss_duration: 3.5741665363311768 (3.5741665363311768) | > loss_1: 42.217506408691406 (42.217506408691406)  --> STEP: 2 | > loss_disc: 3.018688678741455 (2.845442533493042) | > loss_disc_real_0: 0.2987980246543884 (0.32848769426345825) | > loss_disc_real_1: 0.26484373211860657 (0.22616016119718552) | > loss_disc_real_2: 0.2516755163669586 (0.24482720345258713) | > loss_disc_real_3: 0.28935563564300537 (0.24349061399698257) | > loss_disc_real_4: 0.3023495674133301 (0.22946897894144058) | > loss_disc_real_5: 0.2729616165161133 (0.1944575086236) | > loss_0: 3.018688678741455 (2.845442533493042) | > loss_gen: 1.6762090921401978 (1.7330089211463928) | > loss_kl: 5.948661804199219 (6.022799015045166) | > loss_feat: 0.016414780169725418 (2.9246612284332514) | > loss_mel: 2.0693657398223877 (13.49652636051178) | > loss_duration: 3.4714863300323486 (3.5228264331817627) | > loss_1: 13.182137489318848 (27.699821949005127)  --> STEP: 3 | > loss_disc: 2.8694891929626465 (2.8534580866495767) | > loss_disc_real_0: 0.22332364320755005 (0.2934330105781555) | > loss_disc_real_1: 0.30950453877449036 (0.2539416203896205) | > loss_disc_real_2: 0.2705230712890625 (0.25339249273141223) | > loss_disc_real_3: 0.32691600918769836 (0.2712990790605545) | > loss_disc_real_4: 0.2932574450969696 (0.25073180099328357) | > loss_disc_real_5: 0.3248426914215088 (0.23791923622290292) | > loss_0: 2.8694891929626465 (2.8534580866495767) | > loss_gen: 2.1749565601348877 (1.8803248008092244) | > loss_kl: 2.6581294536590576 (4.90124249458313) | > loss_feat: 2.2669224739074707 (2.705414976924658) | > loss_mel: 17.81513023376465 (14.936060984929403) | > loss_duration: 3.1425890922546387 (3.396080652872721) | > loss_1: 28.057727813720703 (27.81912390391032) --> EVAL PERFORMANCE | > avg_loader_time: 0.02880716323852539 (+0.026516517003377277) | > avg_loss_disc: 2.8534580866495767 (-0.09230907758077) | > avg_loss_disc_real_0: 0.2934330105781555 (+0.07130749523639679) | > avg_loss_disc_real_1: 0.2539416203896205 (-0.06744752824306488) | > avg_loss_disc_real_2: 0.25339249273141223 (-0.00818750262260437) | > avg_loss_disc_real_3: 0.2712990790605545 (-0.03202669322490692) | > avg_loss_disc_real_4: 0.25073180099328357 (-0.011334404349327087) | > avg_loss_disc_real_5: 0.23791923622290292 (-0.09262438118457797) | > avg_loss_0: 2.8534580866495767 (-0.09230907758077) | > avg_loss_gen: 1.8803248008092244 (-0.29996136824289965) | > avg_loss_kl: 4.90124249458313 (-0.0966492493947344) | > avg_loss_feat: 2.705414976924658 (-2.05008140578866) | > avg_loss_mel: 14.936060984929403 (-5.073465903600058) | > avg_loss_duration: 3.396080652872721 (+0.1502225399017334) | > avg_loss_1: 27.81912390391032 (-7.369935035705563)  > EPOCH: 1268/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:16:03)   --> TIME: 2023-10-20 16:16:25 -- STEP: 29/50 -- GLOBAL_STEP: 116430 | > loss_disc: 2.8395628929138184 (2.507904603563506) | > loss_disc_real_0: 0.07764281332492828 (0.1412235045612886) | > loss_disc_real_1: 0.25250038504600525 (0.22180420866814152) | > loss_disc_real_2: 0.22677864134311676 (0.22505293593838296) | > loss_disc_real_3: 0.2588329017162323 (0.21836771135186328) | > loss_disc_real_4: 0.282036155462265 (0.23912716836764894) | > loss_disc_real_5: 0.2667310833930969 (0.22335086094922033) | > loss_0: 2.8395628929138184 (2.507904603563506) | > grad_norm_0: tensor(1035.4834, device='cuda:0') (tensor(709.3680, device='cuda:0')) | > loss_gen: 1.5649840831756592 (2.149425005090648) | > loss_kl: 0.6342706084251404 (0.8077160335820297) | > loss_feat: 0.5938544869422913 (4.940866879605016) | > loss_mel: 9.072178840637207 (18.934860291152166) | > loss_duration: 1.2721400260925293 (1.3130745312263223) | > loss_1: 13.137428283691406 (28.14594291818553) | > grad_norm_1: tensor(11171.7471, device='cuda:0') (tensor(16851.9590, device='cuda:0')) | > current_lr_0: 5.6274309124509475e-05 | > current_lr_1: 5.633061510112671e-05 | > step_time: 0.3224 (0.5480575068243618) | > loader_time: 0.0018 (0.020988110838265253)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5982437133789062 (2.5982437133789062) | > loss_disc_real_0: 0.056917883455753326 (0.056917883455753326) | > loss_disc_real_1: 0.30028036236763 (0.30028036236763) | > loss_disc_real_2: 0.2821454405784607 (0.2821454405784607) | > loss_disc_real_3: 0.31105515360832214 (0.31105515360832214) | > loss_disc_real_4: 0.2733555734157562 (0.2733555734157562) | > loss_disc_real_5: 0.3514052927494049 (0.3514052927494049) | > loss_0: 2.5982437133789062 (2.5982437133789062) | > loss_gen: 2.348586082458496 (2.348586082458496) | > loss_kl: 5.996009826660156 (5.996009826660156) | > loss_feat: 9.438619613647461 (9.438619613647461) | > loss_mel: 23.661191940307617 (23.661191940307617) | > loss_duration: 3.119901418685913 (3.119901418685913) | > loss_1: 44.564308166503906 (44.564308166503906)  --> STEP: 1 | > loss_disc: 3.160872459411621 (3.160872459411621) | > loss_disc_real_0: 0.31496790051460266 (0.31496790051460266) | > loss_disc_real_1: 0.2062629759311676 (0.2062629759311676) | > loss_disc_real_2: 0.1847715973854065 (0.1847715973854065) | > loss_disc_real_3: 0.1851252019405365 (0.1851252019405365) | > loss_disc_real_4: 0.17164133489131927 (0.17164133489131927) | > loss_disc_real_5: 0.2477085143327713 (0.2477085143327713) | > loss_0: 3.160872459411621 (3.160872459411621) | > loss_gen: 1.4603818655014038 (1.4603818655014038) | > loss_kl: 5.898466110229492 (5.898466110229492) | > loss_feat: 2.7074451446533203 (2.7074451446533203) | > loss_mel: 19.58930206298828 (19.58930206298828) | > loss_duration: 3.4647960662841797 (3.4647960662841797) | > loss_1: 33.120391845703125 (33.120391845703125)  --> STEP: 2 | > loss_disc: 2.6954410076141357 (2.9281567335128784) | > loss_disc_real_0: 0.29828280210494995 (0.3066253513097763) | > loss_disc_real_1: 0.24001286923885345 (0.22313792258501053) | > loss_disc_real_2: 0.2501467168331146 (0.21745915710926056) | > loss_disc_real_3: 0.17568233609199524 (0.18040376901626587) | > loss_disc_real_4: 0.34920117259025574 (0.2604212537407875) | > loss_disc_real_5: 0.2801293432712555 (0.2639189288020134) | > loss_0: 2.6954410076141357 (2.9281567335128784) | > loss_gen: 2.1420974731445312 (1.8012396693229675) | > loss_kl: 6.279390811920166 (6.088928461074829) | > loss_feat: 6.012304306030273 (4.359874725341797) | > loss_mel: 24.722637176513672 (22.155969619750977) | > loss_duration: 3.3919668197631836 (3.4283814430236816) | > loss_1: 42.548397064208984 (37.834394454956055)  --> STEP: 3 | > loss_disc: 3.24692702293396 (3.034413496653239) | > loss_disc_real_0: 0.23755961656570435 (0.283603439728419) | > loss_disc_real_1: 0.25241947174072266 (0.2328984389702479) | > loss_disc_real_2: 0.3039701282978058 (0.2462961475054423) | > loss_disc_real_3: 0.226145401597023 (0.19565097987651825) | > loss_disc_real_4: 0.3167964816093445 (0.27921299636363983) | > loss_disc_real_5: 0.32432660460472107 (0.28405482073624927) | > loss_0: 3.24692702293396 (3.034413496653239) | > loss_gen: 1.5992977619171143 (1.733925700187683) | > loss_kl: 2.8755335807800293 (5.0177968343098955) | > loss_feat: 2.017895221710205 (3.579214890797933) | > loss_mel: 20.86003303527832 (21.72399075826009) | > loss_duration: 3.0276408195495605 (3.2948012351989746) | > loss_1: 30.380401611328125 (35.34973017374674) --> EVAL PERFORMANCE | > avg_loader_time: 0.007357120513916016 (-0.021450042724609375) | > avg_loss_disc: 3.034413496653239 (+0.1809554100036621) | > avg_loss_disc_real_0: 0.283603439728419 (-0.009829570849736513) | > avg_loss_disc_real_1: 0.2328984389702479 (-0.021043181419372586) | > avg_loss_disc_real_2: 0.2462961475054423 (-0.007096345225969941) | > avg_loss_disc_real_3: 0.19565097987651825 (-0.07564809918403625) | > avg_loss_disc_real_4: 0.27921299636363983 (+0.02848119537035626) | > avg_loss_disc_real_5: 0.28405482073624927 (+0.046135584513346345) | > avg_loss_0: 3.034413496653239 (+0.1809554100036621) | > avg_loss_gen: 1.733925700187683 (-0.14639910062154127) | > avg_loss_kl: 5.0177968343098955 (+0.11655433972676565) | > avg_loss_feat: 3.579214890797933 (+0.8737999138732753) | > avg_loss_mel: 21.72399075826009 (+6.787929773330687) | > avg_loss_duration: 3.2948012351989746 (-0.1012794176737466) | > avg_loss_1: 35.34973017374674 (+7.530606269836422)  > EPOCH: 1269/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:16:54)   --> TIME: 2023-10-20 16:17:07 -- STEP: 9/50 -- GLOBAL_STEP: 116460 | > loss_disc: 2.739238739013672 (2.42802095413208) | > loss_disc_real_0: 0.26611611247062683 (0.15869607486658627) | > loss_disc_real_1: 0.2215627133846283 (0.2041724291112688) | > loss_disc_real_2: 0.24449308216571808 (0.21778396889567375) | > loss_disc_real_3: 0.34726855158805847 (0.23246313465966117) | > loss_disc_real_4: 0.29498785734176636 (0.20496726325816578) | > loss_disc_real_5: 0.29016801714897156 (0.243623533182674) | > loss_0: 2.739238739013672 (2.42802095413208) | > grad_norm_0: tensor(394.7719, device='cuda:0') (tensor(495.0804, device='cuda:0')) | > loss_gen: 2.3211889266967773 (2.2711317009396024) | > loss_kl: 0.7051554918289185 (0.7507980347921451) | > loss_feat: 3.798973560333252 (7.210321373409695) | > loss_mel: 20.291915893554688 (20.495047993130154) | > loss_duration: 1.2806658744812012 (1.2956233554416232) | > loss_1: 28.397899627685547 (32.02292251586914) | > grad_norm_1: tensor(3162.6311, device='cuda:0') (tensor(12169.1904, device='cuda:0')) | > current_lr_0: 5.621805942924115e-05 | > current_lr_1: 5.6274309124509475e-05 | > step_time: 0.3674 (0.904655483033922) | > loader_time: 0.0482 (0.0400191413031684)  --> TIME: 2023-10-20 16:17:25 -- STEP: 39/50 -- GLOBAL_STEP: 116490 | > loss_disc: 2.726062297821045 (2.4757182812079406) | > loss_disc_real_0: 0.3005886971950531 (0.1501718090894895) | > loss_disc_real_1: 0.2510928213596344 (0.2200465627396718) | > loss_disc_real_2: 0.20488186180591583 (0.2253982049341385) | > loss_disc_real_3: 0.2035674750804901 (0.2324662186587468) | > loss_disc_real_4: 0.24409307539463043 (0.23336490635306406) | > loss_disc_real_5: 0.22644072771072388 (0.24601929520185178) | > loss_0: 2.726062297821045 (2.4757182812079406) | > grad_norm_0: tensor(947.8375, device='cuda:0') (tensor(619.7535, device='cuda:0')) | > loss_gen: 1.7631714344024658 (2.2272715079478727) | > loss_kl: 0.65517258644104 (0.7942830289308077) | > loss_feat: 1.4356118440628052 (5.609054710811529) | > loss_mel: 16.358449935913086 (20.757369212615185) | > loss_duration: 1.3816032409667969 (1.3005808622409136) | > loss_1: 21.594009399414062 (30.68855966665806) | > grad_norm_1: tensor(12949.3018, device='cuda:0') (tensor(13141.4102, device='cuda:0')) | > current_lr_0: 5.621805942924115e-05 | > current_lr_1: 5.6274309124509475e-05 | > step_time: 0.713 (0.6439376060779279) | > loader_time: 0.033 (0.02266084842192821)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.157789468765259 (2.157789468765259) | > loss_disc_real_0: 0.0587165392935276 (0.0587165392935276) | > loss_disc_real_1: 0.20174163579940796 (0.20174163579940796) | > loss_disc_real_2: 0.16062255203723907 (0.16062255203723907) | > loss_disc_real_3: 0.18415100872516632 (0.18415100872516632) | > loss_disc_real_4: 0.12574420869350433 (0.12574420869350433) | > loss_disc_real_5: 0.053300585597753525 (0.053300585597753525) | > loss_0: 2.157789468765259 (2.157789468765259) | > loss_gen: 1.9577505588531494 (1.9577505588531494) | > loss_kl: 5.721246242523193 (5.721246242523193) | > loss_feat: 11.112098693847656 (11.112098693847656) | > loss_mel: 25.76580047607422 (25.76580047607422) | > loss_duration: 3.207390785217285 (3.207390785217285) | > loss_1: 47.764286041259766 (47.764286041259766)  --> STEP: 1 | > loss_disc: 2.923356294631958 (2.923356294631958) | > loss_disc_real_0: 0.1517796814441681 (0.1517796814441681) | > loss_disc_real_1: 0.1935960352420807 (0.1935960352420807) | > loss_disc_real_2: 0.29218971729278564 (0.29218971729278564) | > loss_disc_real_3: 0.4563576281070709 (0.4563576281070709) | > loss_disc_real_4: 0.3655567169189453 (0.3655567169189453) | > loss_disc_real_5: 0.39142993092536926 (0.39142993092536926) | > loss_0: 2.923356294631958 (2.923356294631958) | > loss_gen: 2.224560260772705 (2.224560260772705) | > loss_kl: 5.7743730545043945 (5.7743730545043945) | > loss_feat: 7.774946212768555 (7.774946212768555) | > loss_mel: 22.608339309692383 (22.608339309692383) | > loss_duration: 3.5922446250915527 (3.5922446250915527) | > loss_1: 41.97446060180664 (41.97446060180664)  --> STEP: 2 | > loss_disc: 3.008993625640869 (2.9661749601364136) | > loss_disc_real_0: 0.32457149028778076 (0.23817558586597443) | > loss_disc_real_1: 0.2617298364639282 (0.22766293585300446) | > loss_disc_real_2: 0.28017833828926086 (0.28618402779102325) | > loss_disc_real_3: 0.26753100752830505 (0.361944317817688) | > loss_disc_real_4: 0.2596571147441864 (0.31260691583156586) | > loss_disc_real_5: 0.25979509949684143 (0.32561251521110535) | > loss_0: 3.008993625640869 (2.9661749601364136) | > loss_gen: 1.660071849822998 (1.9423160552978516) | > loss_kl: 6.353332042694092 (6.063852548599243) | > loss_feat: 0.02402082085609436 (3.8994835168123245) | > loss_mel: 1.1266968250274658 (11.867518067359924) | > loss_duration: 3.367776870727539 (3.480010747909546) | > loss_1: 12.531898498535156 (27.2531795501709)  --> STEP: 3 | > loss_disc: 2.2313625812530518 (2.7212375005086265) | > loss_disc_real_0: 0.34110015630722046 (0.27248377601305646) | > loss_disc_real_1: 0.2239828258752823 (0.22643623252709708) | > loss_disc_real_2: 0.2281723916530609 (0.2668468157450358) | > loss_disc_real_3: 0.2858993113040924 (0.33659598231315613) | > loss_disc_real_4: 0.19865334033966064 (0.27462239066759747) | > loss_disc_real_5: 0.11637450009584427 (0.25586651017268497) | > loss_0: 2.2313625812530518 (2.7212375005086265) | > loss_gen: 2.6133623123168945 (2.1659981409708657) | > loss_kl: 2.8946712017059326 (5.007458766301473) | > loss_feat: 4.63255500793457 (4.14384068051974) | > loss_mel: 19.08048439025879 (14.27184017499288) | > loss_duration: 3.0412802696228027 (3.3337672551472983) | > loss_1: 32.262351989746094 (28.922903696695965) --> EVAL PERFORMANCE | > avg_loader_time: 0.017684221267700195 (+0.01032710075378418) | > avg_loss_disc: 2.7212375005086265 (-0.31317599614461233) | > avg_loss_disc_real_0: 0.27248377601305646 (-0.011119663715362549) | > avg_loss_disc_real_1: 0.22643623252709708 (-0.00646220644315082) | > avg_loss_disc_real_2: 0.2668468157450358 (+0.020550668239593534) | > avg_loss_disc_real_3: 0.33659598231315613 (+0.14094500243663788) | > avg_loss_disc_real_4: 0.27462239066759747 (-0.00459060569604236) | > avg_loss_disc_real_5: 0.25586651017268497 (-0.0281883105635643) | > avg_loss_0: 2.7212375005086265 (-0.31317599614461233) | > avg_loss_gen: 2.1659981409708657 (+0.43207244078318263) | > avg_loss_kl: 5.007458766301473 (-0.010338068008422852) | > avg_loss_feat: 4.14384068051974 (+0.564625789721807) | > avg_loss_mel: 14.27184017499288 (-7.45215058326721) | > avg_loss_duration: 3.3337672551472983 (+0.038966019948323716) | > avg_loss_1: 28.922903696695965 (-6.426826477050778)  > EPOCH: 1270/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:17:43)   --> TIME: 2023-10-20 16:17:59 -- STEP: 19/50 -- GLOBAL_STEP: 116520 | > loss_disc: 2.921112060546875 (2.595342523173282) | > loss_disc_real_0: 0.29599806666374207 (0.15210020169615746) | > loss_disc_real_1: 0.21954582631587982 (0.2297298425906583) | > loss_disc_real_2: 0.23951445519924164 (0.2236621964134668) | > loss_disc_real_3: 0.2689739465713501 (0.24339075572788715) | > loss_disc_real_4: 0.2878115773200989 (0.23558358710847402) | > loss_disc_real_5: 0.3008868396282196 (0.24760035974414726) | > loss_0: 2.921112060546875 (2.595342523173282) | > grad_norm_0: tensor(1250.6747, device='cuda:0') (tensor(659.9883, device='cuda:0')) | > loss_gen: 1.8450665473937988 (2.1245679541638025) | > loss_kl: 0.9080173969268799 (0.8011776691204623) | > loss_feat: 1.251626968383789 (4.811036352264254) | > loss_mel: 18.72477149963379 (18.978314249139082) | > loss_duration: 1.418617844581604 (1.3340737004029124) | > loss_1: 24.148099899291992 (28.049169967049046) | > grad_norm_1: tensor(8222.7988, device='cuda:0') (tensor(18783.6680, device='cuda:0')) | > current_lr_0: 5.6161865959065e-05 | > current_lr_1: 5.621805942924115e-05 | > step_time: 0.5954 (0.5466407098268208) | > loader_time: 0.0021 (0.017441348025673313)  --> TIME: 2023-10-20 16:18:11 -- STEP: 49/50 -- GLOBAL_STEP: 116550 | > loss_disc: 2.4550302028656006 (2.4796210795032736) | > loss_disc_real_0: 0.0649581253528595 (0.14429801973105616) | > loss_disc_real_1: 0.242852121591568 (0.2308723443016714) | > loss_disc_real_2: 0.20491985976696014 (0.21899398355459682) | > loss_disc_real_3: 0.25458091497421265 (0.24132899647312506) | > loss_disc_real_4: 0.27328574657440186 (0.22653194549208394) | > loss_disc_real_5: 0.23400500416755676 (0.2337331336409766) | > loss_0: 2.4550302028656006 (2.4796210795032736) | > grad_norm_0: tensor(336.3236, device='cuda:0') (tensor(688.6625, device='cuda:0')) | > loss_gen: 2.0853476524353027 (2.2055056241093856) | > loss_kl: 0.500144898891449 (0.7636153605215403) | > loss_feat: 2.486417055130005 (5.130442936809695) | > loss_mel: 17.048023223876953 (19.439647285305718) | > loss_duration: 1.3899415731430054 (1.301550809217959) | > loss_1: 23.509876251220703 (28.840761836694213) | > grad_norm_1: tensor(6754.8511, device='cuda:0') (tensor(17834.5137, device='cuda:0')) | > current_lr_0: 5.6161865959065e-05 | > current_lr_1: 5.621805942924115e-05 | > step_time: 0.3784 (0.44688072496530973) | > loader_time: 0.4291 (0.017421586172921315)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.143131971359253 (3.143131971359253) | > loss_disc_real_0: 0.5148775577545166 (0.5148775577545166) | > loss_disc_real_1: 0.23796577751636505 (0.23796577751636505) | > loss_disc_real_2: 0.32550475001335144 (0.32550475001335144) | > loss_disc_real_3: 0.20290407538414001 (0.20290407538414001) | > loss_disc_real_4: 0.3005603551864624 (0.3005603551864624) | > loss_disc_real_5: 0.4832185208797455 (0.4832185208797455) | > loss_0: 3.143131971359253 (3.143131971359253) | > loss_gen: 2.304636240005493 (2.304636240005493) | > loss_kl: 5.959113121032715 (5.959113121032715) | > loss_feat: 6.749866485595703 (6.749866485595703) | > loss_mel: 20.690380096435547 (20.690380096435547) | > loss_duration: 3.1694626808166504 (3.1694626808166504) | > loss_1: 38.87346267700195 (38.87346267700195)  --> STEP: 1 | > loss_disc: 1.9482357501983643 (1.9482357501983643) | > loss_disc_real_0: 0.029193446040153503 (0.029193446040153503) | > loss_disc_real_1: 0.08988237380981445 (0.08988237380981445) | > loss_disc_real_2: 0.09469030797481537 (0.09469030797481537) | > loss_disc_real_3: 0.10592027008533478 (0.10592027008533478) | > loss_disc_real_4: 0.18620847165584564 (0.18620847165584564) | > loss_disc_real_5: 0.09371138364076614 (0.09371138364076614) | > loss_0: 1.9482357501983643 (1.9482357501983643) | > loss_gen: 2.3744378089904785 (2.3744378089904785) | > loss_kl: 5.875298500061035 (5.875298500061035) | > loss_feat: 11.706157684326172 (11.706157684326172) | > loss_mel: 25.04707145690918 (25.04707145690918) | > loss_duration: 3.5377511978149414 (3.5377511978149414) | > loss_1: 48.540714263916016 (48.540714263916016)  --> STEP: 2 | > loss_disc: 2.9949557781219482 (2.4715957641601562) | > loss_disc_real_0: 0.2149459719657898 (0.12206970900297165) | > loss_disc_real_1: 0.2557803988456726 (0.17283138632774353) | > loss_disc_real_2: 0.2282555103302002 (0.16147290915250778) | > loss_disc_real_3: 0.24283884465694427 (0.17437955737113953) | > loss_disc_real_4: 0.2633804976940155 (0.22479448467493057) | > loss_disc_real_5: 0.25138723850250244 (0.1725493110716343) | > loss_0: 2.9949557781219482 (2.4715957641601562) | > loss_gen: 1.4663207530975342 (1.9203792810440063) | > loss_kl: 6.5286712646484375 (6.201984882354736) | > loss_feat: 0.031275052577257156 (5.8687163684517145) | > loss_mel: 1.2532509565353394 (13.15016120672226) | > loss_duration: 3.31052827835083 (3.4241397380828857) | > loss_1: 12.590045928955078 (30.565380096435547)  --> STEP: 3 | > loss_disc: 2.6911165714263916 (2.544769366582235) | > loss_disc_real_0: 0.28831303119659424 (0.17748414973417917) | > loss_disc_real_1: 0.24480994045734406 (0.19682423770427704) | > loss_disc_real_2: 0.2760961949825287 (0.19968067109584808) | > loss_disc_real_3: 0.3348294198513031 (0.22786284486452738) | > loss_disc_real_4: 0.15705138444900513 (0.20221345126628876) | > loss_disc_real_5: 0.12146928906440735 (0.1555226370692253) | > loss_0: 2.6911165714263916 (2.544769366582235) | > loss_gen: 2.0966734886169434 (1.979144016901652) | > loss_kl: 2.6568734645843506 (5.020281076431274) | > loss_feat: 2.6215920448303223 (4.78634159391125) | > loss_mel: 18.175413131713867 (14.825245181719461) | > loss_duration: 3.184049606323242 (3.3441096941630044) | > loss_1: 28.734601974487305 (29.9551207224528) --> EVAL PERFORMANCE | > avg_loader_time: 0.028771479924519856 (+0.01108725865681966) | > avg_loss_disc: 2.544769366582235 (-0.1764681339263916) | > avg_loss_disc_real_0: 0.17748414973417917 (-0.09499962627887729) | > avg_loss_disc_real_1: 0.19682423770427704 (-0.029611994822820037) | > avg_loss_disc_real_2: 0.19968067109584808 (-0.06716614464918774) | > avg_loss_disc_real_3: 0.22786284486452738 (-0.10873313744862875) | > avg_loss_disc_real_4: 0.20221345126628876 (-0.07240893940130871) | > avg_loss_disc_real_5: 0.1555226370692253 (-0.10034387310345966) | > avg_loss_0: 2.544769366582235 (-0.1764681339263916) | > avg_loss_gen: 1.979144016901652 (-0.18685412406921365) | > avg_loss_kl: 5.020281076431274 (+0.012822310129801728) | > avg_loss_feat: 4.78634159391125 (+0.64250091339151) | > avg_loss_mel: 14.825245181719461 (+0.5534050067265817) | > avg_loss_duration: 3.3441096941630044 (+0.010342439015706084) | > avg_loss_1: 29.9551207224528 (+1.032217025756836)  > EPOCH: 1271/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:18:25)   --> TIME: 2023-10-20 16:18:49 -- STEP: 29/50 -- GLOBAL_STEP: 116580 | > loss_disc: 2.8629438877105713 (2.5860851674244323) | > loss_disc_real_0: 0.10847528278827667 (0.15841084127796107) | > loss_disc_real_1: 0.24835672974586487 (0.2311042457305152) | > loss_disc_real_2: 0.2392786741256714 (0.22711828325329156) | > loss_disc_real_3: 0.251464307308197 (0.22975586226274228) | > loss_disc_real_4: 0.2564318776130676 (0.2356777230984178) | > loss_disc_real_5: 0.25171583890914917 (0.2302103084351482) | > loss_0: 2.8629438877105713 (2.5860851674244323) | > grad_norm_0: tensor(1397.6631, device='cuda:0') (tensor(587.9327, device='cuda:0')) | > loss_gen: 1.591764211654663 (2.111372076231858) | > loss_kl: 1.1394238471984863 (0.8426013475862043) | > loss_feat: 0.48481279611587524 (4.871334582904418) | > loss_mel: 13.799003601074219 (18.12848994238623) | > loss_duration: 1.267532229423523 (1.3084233094905982) | > loss_1: 18.28253746032715 (27.262221780316583) | > grad_norm_1: tensor(14744.9102, device='cuda:0') (tensor(23344.8691, device='cuda:0')) | > current_lr_0: 5.6105728657780536e-05 | > current_lr_1: 5.6161865959065e-05 | > step_time: 0.544 (0.639830942811637) | > loader_time: 0.0284 (0.020456470292190027)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8709261417388916 (2.8709261417388916) | > loss_disc_real_0: 0.24806171655654907 (0.24806171655654907) | > loss_disc_real_1: 0.25472596287727356 (0.25472596287727356) | > loss_disc_real_2: 0.25382283329963684 (0.25382283329963684) | > loss_disc_real_3: 0.23790498077869415 (0.23790498077869415) | > loss_disc_real_4: 0.28894519805908203 (0.28894519805908203) | > loss_disc_real_5: 0.277719110250473 (0.277719110250473) | > loss_0: 2.8709261417388916 (2.8709261417388916) | > loss_gen: 1.7335870265960693 (1.7335870265960693) | > loss_kl: 5.651795864105225 (5.651795864105225) | > loss_feat: 0.3505089581012726 (0.3505089581012726) | > loss_mel: 13.20124626159668 (13.20124626159668) | > loss_duration: 3.1471352577209473 (3.1471352577209473) | > loss_1: 24.084274291992188 (24.084274291992188)  --> STEP: 1 | > loss_disc: 3.2186899185180664 (3.2186899185180664) | > loss_disc_real_0: 0.5301400423049927 (0.5301400423049927) | > loss_disc_real_1: 0.3313390016555786 (0.3313390016555786) | > loss_disc_real_2: 0.304440975189209 (0.304440975189209) | > loss_disc_real_3: 0.3218804895877838 (0.3218804895877838) | > loss_disc_real_4: 0.3121621310710907 (0.3121621310710907) | > loss_disc_real_5: 0.34490758180618286 (0.34490758180618286) | > loss_0: 3.2186899185180664 (3.2186899185180664) | > loss_gen: 2.375563383102417 (2.375563383102417) | > loss_kl: 5.284175395965576 (5.284175395965576) | > loss_feat: 2.5295708179473877 (2.5295708179473877) | > loss_mel: 19.31855010986328 (19.31855010986328) | > loss_duration: 3.4714953899383545 (3.4714953899383545) | > loss_1: 32.97935485839844 (32.97935485839844)  --> STEP: 2 | > loss_disc: 2.8067517280578613 (3.012720823287964) | > loss_disc_real_0: 0.11977022141218185 (0.32495513185858727) | > loss_disc_real_1: 0.23965708911418915 (0.2854980453848839) | > loss_disc_real_2: 0.24685025215148926 (0.2756456136703491) | > loss_disc_real_3: 0.2432728111743927 (0.28257665038108826) | > loss_disc_real_4: 0.29349517822265625 (0.3028286546468735) | > loss_disc_real_5: 0.27281874418258667 (0.30886316299438477) | > loss_0: 2.8067517280578613 (3.012720823287964) | > loss_gen: 1.626629114151001 (2.001096248626709) | > loss_kl: 6.163213729858398 (5.723694562911987) | > loss_feat: 0.7941416501998901 (1.661856234073639) | > loss_mel: 18.042551040649414 (18.680550575256348) | > loss_duration: 3.4297075271606445 (3.4506014585494995) | > loss_1: 30.056243896484375 (31.517799377441406)  --> STEP: 3 | > loss_disc: 2.763493776321411 (2.9296451409657798) | > loss_disc_real_0: 0.17015479505062103 (0.27335501958926517) | > loss_disc_real_1: 0.29737353324890137 (0.2894565413395564) | > loss_disc_real_2: 0.23057229816913605 (0.26062117516994476) | > loss_disc_real_3: 0.3779979348182678 (0.31438374519348145) | > loss_disc_real_4: 0.3571040630340576 (0.3209204574426015) | > loss_disc_real_5: 0.3574281632900238 (0.32505149642626446) | > loss_0: 2.763493776321411 (2.9296451409657798) | > loss_gen: 2.3774266242980957 (2.126539707183838) | > loss_kl: 3.109255313873291 (4.852214813232422) | > loss_feat: 4.576105117797852 (2.6332725286483765) | > loss_mel: 18.7855224609375 (18.71554120381673) | > loss_duration: 3.1760897636413574 (3.3590975602467856) | > loss_1: 32.02439880371094 (31.686665852864582) --> EVAL PERFORMANCE | > avg_loader_time: 0.006846984227498372 (-0.021924495697021484) | > avg_loss_disc: 2.9296451409657798 (+0.3848757743835449) | > avg_loss_disc_real_0: 0.27335501958926517 (+0.095870869855086) | > avg_loss_disc_real_1: 0.2894565413395564 (+0.09263230363527936) | > avg_loss_disc_real_2: 0.26062117516994476 (+0.06094050407409668) | > avg_loss_disc_real_3: 0.31438374519348145 (+0.08652090032895407) | > avg_loss_disc_real_4: 0.3209204574426015 (+0.11870700617631275) | > avg_loss_disc_real_5: 0.32505149642626446 (+0.16952885935703915) | > avg_loss_0: 2.9296451409657798 (+0.3848757743835449) | > avg_loss_gen: 2.126539707183838 (+0.1473956902821858) | > avg_loss_kl: 4.852214813232422 (-0.16806626319885254) | > avg_loss_feat: 2.6332725286483765 (-2.1530690652628737) | > avg_loss_mel: 18.71554120381673 (+3.890296022097269) | > avg_loss_duration: 3.3590975602467856 (+0.01498786608378122) | > avg_loss_1: 31.686665852864582 (+1.7315451304117815)  > EPOCH: 1272/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:19:18)   --> TIME: 2023-10-20 16:19:29 -- STEP: 9/50 -- GLOBAL_STEP: 116610 | > loss_disc: 3.0229878425598145 (2.1620726452933416) | > loss_disc_real_0: 0.42511793971061707 (0.14902354611290825) | > loss_disc_real_1: 0.3319554626941681 (0.19800702896383074) | > loss_disc_real_2: 0.24084188044071198 (0.17770733187596002) | > loss_disc_real_3: 0.38961222767829895 (0.18078863186140856) | > loss_disc_real_4: 0.3331548273563385 (0.17004697397351265) | > loss_disc_real_5: 0.3816573917865753 (0.1556823735849725) | > loss_0: 3.0229878425598145 (2.1620726452933416) | > grad_norm_0: tensor(642.9755, device='cuda:0') (tensor(491.5008, device='cuda:0')) | > loss_gen: 2.4206109046936035 (2.3721261819203696) | > loss_kl: 0.6470843553543091 (0.7625227669874827) | > loss_feat: 3.2247142791748047 (7.654332688285245) | > loss_mel: 20.09741973876953 (20.894066558943855) | > loss_duration: 1.2729145288467407 (1.3111743927001953) | > loss_1: 27.662744522094727 (32.99422242906358) | > grad_norm_1: tensor(3916.0269, device='cuda:0') (tensor(25800.8535, device='cuda:0')) | > current_lr_0: 5.604964746924343e-05 | > current_lr_1: 5.6105728657780536e-05 | > step_time: 1.6153 (0.6284663412306044) | > loader_time: 0.0222 (0.01427006721496582)  --> TIME: 2023-10-20 16:19:48 -- STEP: 39/50 -- GLOBAL_STEP: 116640 | > loss_disc: 2.7246756553649902 (2.410044764861082) | > loss_disc_real_0: 0.17891448736190796 (0.13745179829689172) | > loss_disc_real_1: 0.22779275476932526 (0.21015756481733078) | > loss_disc_real_2: 0.22694867849349976 (0.22357767591109642) | > loss_disc_real_3: 0.24629665911197662 (0.22611147485291347) | > loss_disc_real_4: 0.23274046182632446 (0.21316148732335138) | > loss_disc_real_5: 0.23563720285892487 (0.2263936537485092) | > loss_0: 2.7246756553649902 (2.410044764861082) | > grad_norm_0: tensor(586.4890, device='cuda:0') (tensor(525.8577, device='cuda:0')) | > loss_gen: 1.8025143146514893 (2.2949252556531863) | > loss_kl: 0.887040913105011 (0.7738347840614808) | > loss_feat: 1.730745553970337 (6.962524192073406) | > loss_mel: 15.695168495178223 (21.76960078569559) | > loss_duration: 1.4422087669372559 (1.3035709246610985) | > loss_1: 21.55767822265625 (33.10445594787598) | > grad_norm_1: tensor(6076.3989, device='cuda:0') (tensor(25371.2285, device='cuda:0')) | > current_lr_0: 5.604964746924343e-05 | > current_lr_1: 5.6105728657780536e-05 | > step_time: 0.7682 (0.6297465471120981) | > loader_time: 0.0207 (0.022589261715228744)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5972180366516113 (2.5972180366516113) | > loss_disc_real_0: 0.2289082109928131 (0.2289082109928131) | > loss_disc_real_1: 0.41225466132164 (0.41225466132164) | > loss_disc_real_2: 0.2869505286216736 (0.2869505286216736) | > loss_disc_real_3: 0.3621937036514282 (0.3621937036514282) | > loss_disc_real_4: 0.2436237782239914 (0.2436237782239914) | > loss_disc_real_5: 0.3010474145412445 (0.3010474145412445) | > loss_0: 2.5972180366516113 (2.5972180366516113) | > loss_gen: 3.3218696117401123 (3.3218696117401123) | > loss_kl: 5.408910274505615 (5.408910274505615) | > loss_feat: 9.790212631225586 (9.790212631225586) | > loss_mel: 20.628093719482422 (20.628093719482422) | > loss_duration: 3.0693280696868896 (3.0693280696868896) | > loss_1: 42.218414306640625 (42.218414306640625)  --> STEP: 1 | > loss_disc: 2.6484689712524414 (2.6484689712524414) | > loss_disc_real_0: 0.19454558193683624 (0.19454558193683624) | > loss_disc_real_1: 0.3372439742088318 (0.3372439742088318) | > loss_disc_real_2: 0.2849487364292145 (0.2849487364292145) | > loss_disc_real_3: 0.15008436143398285 (0.15008436143398285) | > loss_disc_real_4: 0.33280640840530396 (0.33280640840530396) | > loss_disc_real_5: 0.48553431034088135 (0.48553431034088135) | > loss_0: 2.6484689712524414 (2.6484689712524414) | > loss_gen: 2.6839263439178467 (2.6839263439178467) | > loss_kl: 5.924116611480713 (5.924116611480713) | > loss_feat: 6.1196112632751465 (6.1196112632751465) | > loss_mel: 24.095012664794922 (24.095012664794922) | > loss_duration: 3.5816359519958496 (3.5816359519958496) | > loss_1: 42.404300689697266 (42.404300689697266)  --> STEP: 2 | > loss_disc: 3.022425651550293 (2.835447311401367) | > loss_disc_real_0: 0.39193931221961975 (0.293242447078228) | > loss_disc_real_1: 0.25713974237442017 (0.297191858291626) | > loss_disc_real_2: 0.28373733162879944 (0.28434303402900696) | > loss_disc_real_3: 0.24782422184944153 (0.1989542916417122) | > loss_disc_real_4: 0.24728815257549286 (0.2900472804903984) | > loss_disc_real_5: 0.2407332807779312 (0.3631337955594063) | > loss_0: 3.022425651550293 (2.835447311401367) | > loss_gen: 1.6947585344314575 (2.189342439174652) | > loss_kl: 5.816061496734619 (5.870089054107666) | > loss_feat: 0.058691564947366714 (3.0891514141112566) | > loss_mel: 2.458188772201538 (13.27660071849823) | > loss_duration: 3.3933215141296387 (3.487478733062744) | > loss_1: 13.421022415161133 (27.9126615524292)  --> STEP: 3 | > loss_disc: 2.446784734725952 (2.705893119176229) | > loss_disc_real_0: 0.4617156386375427 (0.3494001775979996) | > loss_disc_real_1: 0.2501412332057953 (0.28150831659634906) | > loss_disc_real_2: 0.23865236341953278 (0.26911281049251556) | > loss_disc_real_3: 0.13644753396511078 (0.17811870574951172) | > loss_disc_real_4: 0.1609538197517395 (0.24701612691084543) | > loss_disc_real_5: 0.1786269098520279 (0.30163150032361347) | > loss_0: 2.446784734725952 (2.705893119176229) | > loss_gen: 2.5445950031280518 (2.307759960492452) | > loss_kl: 2.9649643898010254 (4.901714166005452) | > loss_feat: 6.7852630615234375 (4.321188629915317) | > loss_mel: 23.24056625366211 (16.597922563552856) | > loss_duration: 3.0890161991119385 (3.3546578884124756) | > loss_1: 38.6244010925293 (31.48324139912923) --> EVAL PERFORMANCE | > avg_loader_time: 0.017712195714314777 (+0.010865211486816406) | > avg_loss_disc: 2.705893119176229 (-0.22375202178955078) | > avg_loss_disc_real_0: 0.3494001775979996 (+0.0760451580087344) | > avg_loss_disc_real_1: 0.28150831659634906 (-0.007948224743207333) | > avg_loss_disc_real_2: 0.26911281049251556 (+0.0084916353225708) | > avg_loss_disc_real_3: 0.17811870574951172 (-0.13626503944396973) | > avg_loss_disc_real_4: 0.24701612691084543 (-0.07390433053175607) | > avg_loss_disc_real_5: 0.30163150032361347 (-0.023419996102650997) | > avg_loss_0: 2.705893119176229 (-0.22375202178955078) | > avg_loss_gen: 2.307759960492452 (+0.18122025330861424) | > avg_loss_kl: 4.901714166005452 (+0.0494993527730303) | > avg_loss_feat: 4.321188629915317 (+1.6879161012669401) | > avg_loss_mel: 16.597922563552856 (-2.117618640263874) | > avg_loss_duration: 3.3546578884124756 (-0.004439671834310044) | > avg_loss_1: 31.48324139912923 (-0.20342445373535156)  > EPOCH: 1273/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:20:04)   --> TIME: 2023-10-20 16:20:21 -- STEP: 19/50 -- GLOBAL_STEP: 116670 | > loss_disc: 2.6936869621276855 (2.4295779403887297) | > loss_disc_real_0: 0.34789037704467773 (0.17086261192238644) | > loss_disc_real_1: 0.219326913356781 (0.24462137057592995) | > loss_disc_real_2: 0.37115001678466797 (0.250512208887621) | > loss_disc_real_3: 0.328533411026001 (0.2161406645257222) | > loss_disc_real_4: 0.287056565284729 (0.22306038870623238) | > loss_disc_real_5: 0.21009573340415955 (0.225668327784852) | > loss_0: 2.6936869621276855 (2.4295779403887297) | > grad_norm_0: tensor(561.3154, device='cuda:0') (tensor(683.8768, device='cuda:0')) | > loss_gen: 2.4002599716186523 (2.327284436476858) | > loss_kl: 0.7466830611228943 (0.7491816423441234) | > loss_feat: 6.055448055267334 (5.686479882190103) | > loss_mel: 22.521326065063477 (20.51226904517726) | > loss_duration: 1.4230440855026245 (1.3382215123427539) | > loss_1: 33.146759033203125 (30.613436196979723) | > grad_norm_1: tensor(18319.0234, device='cuda:0') (tensor(18693.3262, device='cuda:0')) | > current_lr_0: 5.599362233736547e-05 | > current_lr_1: 5.604964746924343e-05 | > step_time: 0.3549 (0.5951335179178339) | > loader_time: 0.0182 (0.021901080482884458)  --> TIME: 2023-10-20 16:20:42 -- STEP: 49/50 -- GLOBAL_STEP: 116700 | > loss_disc: 2.397416114807129 (2.4858304091862276) | > loss_disc_real_0: 0.019006580114364624 (0.16653561111235496) | > loss_disc_real_1: 0.25436916947364807 (0.22937416053396098) | > loss_disc_real_2: 0.08063993602991104 (0.2306687263201694) | > loss_disc_real_3: 0.24921007454395294 (0.23071949860575247) | > loss_disc_real_4: 0.2932627499103546 (0.22628033054726465) | > loss_disc_real_5: 0.286282479763031 (0.22969111454273974) | > loss_0: 2.397416114807129 (2.4858304091862276) | > grad_norm_0: tensor(558.3195, device='cuda:0') (tensor(676.2771, device='cuda:0')) | > loss_gen: 2.1699345111846924 (2.2632906947817117) | > loss_kl: 0.5876832008361816 (0.7496294792817564) | > loss_feat: 2.8720543384552 (5.539480127394202) | > loss_mel: 20.452302932739258 (19.695219584873737) | > loss_duration: 1.3709678649902344 (1.2994108102759538) | > loss_1: 27.452943801879883 (29.547030526764537) | > grad_norm_1: tensor(3784.7507, device='cuda:0') (tensor(14625.2852, device='cuda:0')) | > current_lr_0: 5.599362233736547e-05 | > current_lr_1: 5.604964746924343e-05 | > step_time: 0.7259 (0.6232730807090292) | > loader_time: 0.4431 (0.02864340860016492)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0529675483703613 (3.0529675483703613) | > loss_disc_real_0: 0.493452250957489 (0.493452250957489) | > loss_disc_real_1: 0.33456194400787354 (0.33456194400787354) | > loss_disc_real_2: 0.4214631915092468 (0.4214631915092468) | > loss_disc_real_3: 0.3846948742866516 (0.3846948742866516) | > loss_disc_real_4: 0.29409483075141907 (0.29409483075141907) | > loss_disc_real_5: 0.3811488747596741 (0.3811488747596741) | > loss_0: 3.0529675483703613 (3.0529675483703613) | > loss_gen: 2.7658815383911133 (2.7658815383911133) | > loss_kl: 6.101866722106934 (6.101866722106934) | > loss_feat: 4.863326549530029 (4.863326549530029) | > loss_mel: 22.601016998291016 (22.601016998291016) | > loss_duration: 3.1086487770080566 (3.1086487770080566) | > loss_1: 39.440738677978516 (39.440738677978516)  --> STEP: 1 | > loss_disc: 2.721175193786621 (2.721175193786621) | > loss_disc_real_0: 0.22860684990882874 (0.22860684990882874) | > loss_disc_real_1: 0.2701002359390259 (0.2701002359390259) | > loss_disc_real_2: 0.2618817389011383 (0.2618817389011383) | > loss_disc_real_3: 0.131384015083313 (0.131384015083313) | > loss_disc_real_4: 0.19557234644889832 (0.19557234644889832) | > loss_disc_real_5: 0.138447567820549 (0.138447567820549) | > loss_0: 2.721175193786621 (2.721175193786621) | > loss_gen: 1.763022780418396 (1.763022780418396) | > loss_kl: 6.0371198654174805 (6.0371198654174805) | > loss_feat: 5.702748775482178 (5.702748775482178) | > loss_mel: 22.496618270874023 (22.496618270874023) | > loss_duration: 3.482356548309326 (3.482356548309326) | > loss_1: 39.481868743896484 (39.481868743896484)  --> STEP: 2 | > loss_disc: 2.5964341163635254 (2.6588046550750732) | > loss_disc_real_0: 0.251534104347229 (0.24007047712802887) | > loss_disc_real_1: 0.24109792709350586 (0.25559908151626587) | > loss_disc_real_2: 0.32381799817085266 (0.2928498685359955) | > loss_disc_real_3: 0.3135955333709717 (0.22248977422714233) | > loss_disc_real_4: 0.3071071207523346 (0.25133973360061646) | > loss_disc_real_5: 0.2861082851886749 (0.21227792650461197) | > loss_0: 2.5964341163635254 (2.6588046550750732) | > loss_gen: 2.571113109588623 (2.1670679450035095) | > loss_kl: 6.371120452880859 (6.20412015914917) | > loss_feat: 3.3645060062408447 (4.533627390861511) | > loss_mel: 25.92595100402832 (24.211284637451172) | > loss_duration: 3.4438178539276123 (3.4630872011184692) | > loss_1: 41.67650604248047 (40.57918739318848)  --> STEP: 3 | > loss_disc: 3.0072450637817383 (2.774951457977295) | > loss_disc_real_0: 0.23113296926021576 (0.23709130783875784) | > loss_disc_real_1: 0.24178706109523773 (0.25099507470925647) | > loss_disc_real_2: 0.2776015102863312 (0.28776708245277405) | > loss_disc_real_3: 0.22937165200710297 (0.2247837334871292) | > loss_disc_real_4: 0.2825116217136383 (0.2617303629716237) | > loss_disc_real_5: 0.28772684931755066 (0.2374275674422582) | > loss_0: 3.0072450637817383 (2.774951457977295) | > loss_gen: 1.551666498184204 (1.9619341293970745) | > loss_kl: 2.749845027923584 (5.052695115407308) | > loss_feat: 0.03350246697664261 (3.033585749566555) | > loss_mel: 2.032104253768921 (16.818224509557087) | > loss_duration: 3.0091493129730225 (3.311774571736654) | > loss_1: 9.376267433166504 (30.178214073181152) --> EVAL PERFORMANCE | > avg_loader_time: 0.02310776710510254 (+0.005395571390787762) | > avg_loss_disc: 2.774951457977295 (+0.06905833880106593) | > avg_loss_disc_real_0: 0.23709130783875784 (-0.11230886975924173) | > avg_loss_disc_real_1: 0.25099507470925647 (-0.03051324188709259) | > avg_loss_disc_real_2: 0.28776708245277405 (+0.018654271960258484) | > avg_loss_disc_real_3: 0.2247837334871292 (+0.04666502773761749) | > avg_loss_disc_real_4: 0.2617303629716237 (+0.01471423606077829) | > avg_loss_disc_real_5: 0.2374275674422582 (-0.06420393288135526) | > avg_loss_0: 2.774951457977295 (+0.06905833880106593) | > avg_loss_gen: 1.9619341293970745 (-0.3458258310953777) | > avg_loss_kl: 5.052695115407308 (+0.15098094940185547) | > avg_loss_feat: 3.033585749566555 (-1.2876028803487616) | > avg_loss_mel: 16.818224509557087 (+0.2203019460042306) | > avg_loss_duration: 3.311774571736654 (-0.04288331667582179) | > avg_loss_1: 30.178214073181152 (-1.3050273259480782)  > EPOCH: 1274/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:20:55)   --> TIME: 2023-10-20 16:21:22 -- STEP: 29/50 -- GLOBAL_STEP: 116730 | > loss_disc: 1.2835712432861328 (2.5777769787558196) | > loss_disc_real_0: 0.14720824360847473 (0.18025664175892697) | > loss_disc_real_1: 0.060642506927251816 (0.22599460480028186) | > loss_disc_real_2: 0.06280717253684998 (0.24472092644407825) | > loss_disc_real_3: 0.0996902659535408 (0.23846024547799907) | > loss_disc_real_4: 0.04328162223100662 (0.22743821850624577) | > loss_disc_real_5: 0.07581178098917007 (0.24387036402035386) | > loss_0: 1.2835712432861328 (2.5777769787558196) | > grad_norm_0: tensor(437.1262, device='cuda:0') (tensor(574.6572, device='cuda:0')) | > loss_gen: 3.0342230796813965 (2.2294404136723487) | > loss_kl: 0.8652175068855286 (0.8624802344831927) | > loss_feat: 11.645646095275879 (5.488713427350439) | > loss_mel: 25.55368423461914 (18.918711193676653) | > loss_duration: 1.2999215126037598 (1.3214575915501034) | > loss_1: 42.3986930847168 (28.820803181878453) | > grad_norm_1: tensor(7503.0181, device='cuda:0') (tensor(26091.6445, device='cuda:0')) | > current_lr_0: 5.5937653206114513e-05 | > current_lr_1: 5.599362233736547e-05 | > step_time: 0.4077 (0.6304333127778152) | > loader_time: 0.0278 (0.021449508338138974)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4868907928466797 (2.4868907928466797) | > loss_disc_real_0: 0.16023075580596924 (0.16023075580596924) | > loss_disc_real_1: 0.3195633292198181 (0.3195633292198181) | > loss_disc_real_2: 0.3346445858478546 (0.3346445858478546) | > loss_disc_real_3: 0.2996872663497925 (0.2996872663497925) | > loss_disc_real_4: 0.4417591094970703 (0.4417591094970703) | > loss_disc_real_5: 0.4770781695842743 (0.4770781695842743) | > loss_0: 2.4868907928466797 (2.4868907928466797) | > loss_gen: 4.072729587554932 (4.072729587554932) | > loss_kl: 6.194989204406738 (6.194989204406738) | > loss_feat: 9.747589111328125 (9.747589111328125) | > loss_mel: 22.4931583404541 (22.4931583404541) | > loss_duration: 3.1749818325042725 (3.1749818325042725) | > loss_1: 45.683448791503906 (45.683448791503906)  --> STEP: 1 | > loss_disc: 2.591704845428467 (2.591704845428467) | > loss_disc_real_0: 0.20653527975082397 (0.20653527975082397) | > loss_disc_real_1: 0.2715558409690857 (0.2715558409690857) | > loss_disc_real_2: 0.2698945999145508 (0.2698945999145508) | > loss_disc_real_3: 0.25429248809814453 (0.25429248809814453) | > loss_disc_real_4: 0.2905636727809906 (0.2905636727809906) | > loss_disc_real_5: 0.23728220164775848 (0.23728220164775848) | > loss_0: 2.591704845428467 (2.591704845428467) | > loss_gen: 2.2392735481262207 (2.2392735481262207) | > loss_kl: 5.608409404754639 (5.608409404754639) | > loss_feat: 3.399463653564453 (3.399463653564453) | > loss_mel: 15.39382553100586 (15.39382553100586) | > loss_duration: 3.432047128677368 (3.432047128677368) | > loss_1: 30.07301902770996 (30.07301902770996)  --> STEP: 2 | > loss_disc: 2.524932622909546 (2.5583187341690063) | > loss_disc_real_0: 0.3576980233192444 (0.2821166515350342) | > loss_disc_real_1: 0.14633513987064362 (0.20894549041986465) | > loss_disc_real_2: 0.291900098323822 (0.2808973491191864) | > loss_disc_real_3: 0.1459510177373886 (0.20012175291776657) | > loss_disc_real_4: 0.18576893210411072 (0.23816630244255066) | > loss_disc_real_5: 0.31902366876602173 (0.2781529352068901) | > loss_0: 2.524932622909546 (2.5583187341690063) | > loss_gen: 2.2788965702056885 (2.2590850591659546) | > loss_kl: 6.402169704437256 (6.005289554595947) | > loss_feat: 6.559684753417969 (4.979574203491211) | > loss_mel: 22.434886932373047 (18.914356231689453) | > loss_duration: 3.463930368423462 (3.447988748550415) | > loss_1: 41.13957214355469 (35.606295585632324)  --> STEP: 3 | > loss_disc: 2.738938093185425 (2.618525187174479) | > loss_disc_real_0: 0.41223540902137756 (0.3254895706971486) | > loss_disc_real_1: 0.3846926987171173 (0.26752789318561554) | > loss_disc_real_2: 0.36620205640792847 (0.3093322515487671) | > loss_disc_real_3: 0.32603710889816284 (0.24209353824456534) | > loss_disc_real_4: 0.3052970767021179 (0.26054322719573975) | > loss_disc_real_5: 0.2611732482910156 (0.27249303956826526) | > loss_0: 2.738938093185425 (2.618525187174479) | > loss_gen: 3.2209081649780273 (2.579692761103312) | > loss_kl: 3.0176990032196045 (5.0094260374705) | > loss_feat: 3.0760486125946045 (4.345065673192342) | > loss_mel: 18.865537643432617 (18.898083368937176) | > loss_duration: 2.9810690879821777 (3.292348861694336) | > loss_1: 31.161264419555664 (34.12461853027344) --> EVAL PERFORMANCE | > avg_loader_time: 0.013801495234171549 (-0.00930627187093099) | > avg_loss_disc: 2.618525187174479 (-0.1564262708028159) | > avg_loss_disc_real_0: 0.3254895706971486 (+0.08839826285839078) | > avg_loss_disc_real_1: 0.26752789318561554 (+0.016532818476359068) | > avg_loss_disc_real_2: 0.3093322515487671 (+0.021565169095993042) | > avg_loss_disc_real_3: 0.24209353824456534 (+0.017309804757436126) | > avg_loss_disc_real_4: 0.26054322719573975 (-0.001187135775883974) | > avg_loss_disc_real_5: 0.27249303956826526 (+0.03506547212600705) | > avg_loss_0: 2.618525187174479 (-0.1564262708028159) | > avg_loss_gen: 2.579692761103312 (+0.6177586317062376) | > avg_loss_kl: 5.0094260374705 (-0.043269077936807676) | > avg_loss_feat: 4.345065673192342 (+1.3114799236257868) | > avg_loss_mel: 18.898083368937176 (+2.0798588593800886) | > avg_loss_duration: 3.292348861694336 (-0.019425710042317856) | > avg_loss_1: 34.12461853027344 (+3.946404457092285)  > EPOCH: 1275/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:21:51)   --> TIME: 2023-10-20 16:22:03 -- STEP: 9/50 -- GLOBAL_STEP: 116760 | > loss_disc: 2.961729049682617 (2.399652772479587) | > loss_disc_real_0: 0.1937708556652069 (0.17658134632640415) | > loss_disc_real_1: 0.16053451597690582 (0.2131648353404469) | > loss_disc_real_2: 0.4242464005947113 (0.252322503262096) | > loss_disc_real_3: 0.2877940237522125 (0.22083758604195383) | > loss_disc_real_4: 0.283100962638855 (0.2382879579025838) | > loss_disc_real_5: 0.3971380591392517 (0.2707270872261789) | > loss_0: 2.961729049682617 (2.399652772479587) | > grad_norm_0: tensor(547.5131, device='cuda:0') (tensor(794.5490, device='cuda:0')) | > loss_gen: 2.0922017097473145 (2.5157638125949435) | > loss_kl: 0.3201449513435364 (0.8176475829548306) | > loss_feat: 5.957378387451172 (7.295673860443963) | > loss_mel: 20.98677635192871 (19.80106924639808) | > loss_duration: 1.2494059801101685 (1.3164439068900213) | > loss_1: 30.605907440185547 (31.74659792582194) | > grad_norm_1: tensor(18886.2031, device='cuda:0') (tensor(28569.0859, device='cuda:0')) | > current_lr_0: 5.588174001951443e-05 | > current_lr_1: 5.5937653206114513e-05 | > step_time: 0.6504 (0.6409180959065756) | > loader_time: 0.0483 (0.029201030731201172)  --> TIME: 2023-10-20 16:22:16 -- STEP: 39/50 -- GLOBAL_STEP: 116790 | > loss_disc: 2.187260627746582 (2.4634586480947642) | > loss_disc_real_0: 0.040540944784879684 (0.16108627810787696) | > loss_disc_real_1: 0.3144141733646393 (0.21841325448491636) | > loss_disc_real_2: 0.28772470355033875 (0.21945663641851682) | > loss_disc_real_3: 0.3528212606906891 (0.2434632383669034) | > loss_disc_real_4: 0.22597983479499817 (0.23774316056798667) | > loss_disc_real_5: 0.25349804759025574 (0.23905586059658956) | > loss_0: 2.187260627746582 (2.4634586480947642) | > grad_norm_0: tensor(364.6860, device='cuda:0') (tensor(667.9249, device='cuda:0')) | > loss_gen: 2.8497533798217773 (2.2918326426775035) | > loss_kl: 0.5275082588195801 (0.8162963046477392) | > loss_feat: 4.137974739074707 (5.997142430490408) | > loss_mel: 22.824148178100586 (20.956075922036785) | > loss_duration: 1.37824285030365 (1.300153952378493) | > loss_1: 31.717628479003906 (31.361501498100086) | > grad_norm_1: tensor(4915.8330, device='cuda:0') (tensor(17423.9785, device='cuda:0')) | > current_lr_0: 5.588174001951443e-05 | > current_lr_1: 5.5937653206114513e-05 | > step_time: 0.3324 (0.4607368371425531) | > loader_time: 0.0057 (0.014770428339640299)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9787118434906006 (2.9787118434906006) | > loss_disc_real_0: 0.5119585990905762 (0.5119585990905762) | > loss_disc_real_1: 0.24648679792881012 (0.24648679792881012) | > loss_disc_real_2: 0.39670559763908386 (0.39670559763908386) | > loss_disc_real_3: 0.36599886417388916 (0.36599886417388916) | > loss_disc_real_4: 0.37350741028785706 (0.37350741028785706) | > loss_disc_real_5: 0.40839436650276184 (0.40839436650276184) | > loss_0: 2.9787118434906006 (2.9787118434906006) | > loss_gen: 3.259626865386963 (3.259626865386963) | > loss_kl: 6.211010932922363 (6.211010932922363) | > loss_feat: 6.886970520019531 (6.886970520019531) | > loss_mel: 21.43027687072754 (21.43027687072754) | > loss_duration: 3.205477237701416 (3.205477237701416) | > loss_1: 40.99336624145508 (40.99336624145508)  --> STEP: 1 | > loss_disc: 2.912325382232666 (2.912325382232666) | > loss_disc_real_0: 0.37819886207580566 (0.37819886207580566) | > loss_disc_real_1: 0.23508472740650177 (0.23508472740650177) | > loss_disc_real_2: 0.2732430398464203 (0.2732430398464203) | > loss_disc_real_3: 0.24619139730930328 (0.24619139730930328) | > loss_disc_real_4: 0.31059038639068604 (0.31059038639068604) | > loss_disc_real_5: 0.268542617559433 (0.268542617559433) | > loss_0: 2.912325382232666 (2.912325382232666) | > loss_gen: 1.9514274597167969 (1.9514274597167969) | > loss_kl: 5.637197494506836 (5.637197494506836) | > loss_feat: 2.2987005710601807 (2.2987005710601807) | > loss_mel: 19.342256546020508 (19.342256546020508) | > loss_duration: 3.5341908931732178 (3.5341908931732178) | > loss_1: 32.763771057128906 (32.763771057128906)  --> STEP: 2 | > loss_disc: 1.8829973936080933 (2.3976613879203796) | > loss_disc_real_0: 0.2341102659702301 (0.3061545640230179) | > loss_disc_real_1: 0.21855467557907104 (0.2268197014927864) | > loss_disc_real_2: 0.12612301111221313 (0.1996830254793167) | > loss_disc_real_3: 0.14595657587051392 (0.1960739865899086) | > loss_disc_real_4: 0.100925974547863 (0.20575818046927452) | > loss_disc_real_5: 0.09434250742197037 (0.18144256249070168) | > loss_0: 1.8829973936080933 (2.3976613879203796) | > loss_gen: 2.593639850616455 (2.272533655166626) | > loss_kl: 6.376353740692139 (6.006775617599487) | > loss_feat: 9.009243965148926 (5.653972268104553) | > loss_mel: 26.68688201904297 (23.01456928253174) | > loss_duration: 3.365116834640503 (3.4496538639068604) | > loss_1: 48.03123474121094 (40.39750289916992)  --> STEP: 3 | > loss_disc: 3.002683639526367 (2.599335471789042) | > loss_disc_real_0: 0.17534442245960236 (0.2625511835018794) | > loss_disc_real_1: 0.24865761399269104 (0.2340990056594213) | > loss_disc_real_2: 0.26739832758903503 (0.2222547928492228) | > loss_disc_real_3: 0.25884273648262024 (0.21699690322081247) | > loss_disc_real_4: 0.23240146040916443 (0.21463927378257117) | > loss_disc_real_5: 0.25295668840408325 (0.20528060446182886) | > loss_0: 3.002683639526367 (2.599335471789042) | > loss_gen: 1.4447989463806152 (1.996622085571289) | > loss_kl: 2.974719762802124 (4.996090332667033) | > loss_feat: 0.027962105348706245 (3.7786355471859374) | > loss_mel: 1.6509652137756348 (15.893367926279703) | > loss_duration: 2.934722661972046 (3.278010129928589) | > loss_1: 9.03316879272461 (29.942724863688152) --> EVAL PERFORMANCE | > avg_loader_time: 0.016019026438395183 (+0.0022175312042236345) | > avg_loss_disc: 2.599335471789042 (-0.01918971538543701) | > avg_loss_disc_real_0: 0.2625511835018794 (-0.06293838719526923) | > avg_loss_disc_real_1: 0.2340990056594213 (-0.033428887526194245) | > avg_loss_disc_real_2: 0.2222547928492228 (-0.08707745869954428) | > avg_loss_disc_real_3: 0.21699690322081247 (-0.025096635023752867) | > avg_loss_disc_real_4: 0.21463927378257117 (-0.04590395341316858) | > avg_loss_disc_real_5: 0.20528060446182886 (-0.0672124351064364) | > avg_loss_0: 2.599335471789042 (-0.01918971538543701) | > avg_loss_gen: 1.996622085571289 (-0.583070675532023) | > avg_loss_kl: 4.996090332667033 (-0.013335704803466797) | > avg_loss_feat: 3.7786355471859374 (-0.5664301260064044) | > avg_loss_mel: 15.893367926279703 (-3.0047154426574725) | > avg_loss_duration: 3.278010129928589 (-0.01433873176574707) | > avg_loss_1: 29.942724863688152 (-4.181893666585285)  > EPOCH: 1276/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:22:44)   --> TIME: 2023-10-20 16:23:02 -- STEP: 19/50 -- GLOBAL_STEP: 116820 | > loss_disc: 3.047579288482666 (2.2755697557800696) | > loss_disc_real_0: 0.5090572237968445 (0.1495779860568674) | > loss_disc_real_1: 0.2651844918727875 (0.244109581959875) | > loss_disc_real_2: 0.3541502356529236 (0.21975171193480492) | > loss_disc_real_3: 0.3535967171192169 (0.24409485686766474) | > loss_disc_real_4: 0.41431036591529846 (0.21472518322499176) | > loss_disc_real_5: 0.3563077747821808 (0.2204228243545482) | > loss_0: 3.047579288482666 (2.2755697557800696) | > grad_norm_0: tensor(1005.2955, device='cuda:0') (tensor(529.5507, device='cuda:0')) | > loss_gen: 2.6507668495178223 (2.4743415619197644) | > loss_kl: 0.7389278411865234 (0.7689731560255352) | > loss_feat: 4.133162498474121 (6.11829539457042) | > loss_mel: 20.453289031982422 (21.142936279899196) | > loss_duration: 1.4126619100570679 (1.3341673110660754) | > loss_1: 29.38880729675293 (31.838713696128444) | > grad_norm_1: tensor(5014.7295, device='cuda:0') (tensor(14626.3076, device='cuda:0')) | > current_lr_0: 5.582588272164505e-05 | > current_lr_1: 5.588174001951443e-05 | > step_time: 0.418 (0.5936060202749152) | > loader_time: 0.033 (0.02255142362494218)  --> TIME: 2023-10-20 16:23:22 -- STEP: 49/50 -- GLOBAL_STEP: 116850 | > loss_disc: 2.313519239425659 (2.421658463624059) | > loss_disc_real_0: 0.06676333397626877 (0.14983433724514073) | > loss_disc_real_1: 0.2146887332201004 (0.22876110095150617) | > loss_disc_real_2: 0.1794540286064148 (0.21485103697192912) | > loss_disc_real_3: 0.3615051507949829 (0.2412774711087042) | > loss_disc_real_4: 0.20607765018939972 (0.23411834392012382) | > loss_disc_real_5: 0.20596179366111755 (0.23890349162476404) | > loss_0: 2.313519239425659 (2.421658463624059) | > grad_norm_0: tensor(331.1508, device='cuda:0') (tensor(639.1086, device='cuda:0')) | > loss_gen: 2.3556084632873535 (2.31323738973968) | > loss_kl: 0.5568287372589111 (0.7505183633492918) | > loss_feat: 6.266887664794922 (5.702623579385025) | > loss_mel: 20.91123390197754 (20.288624033635973) | > loss_duration: 1.3801770210266113 (1.3029799461364746) | > loss_1: 31.470735549926758 (30.357983258305765) | > grad_norm_1: tensor(4447.2178, device='cuda:0') (tensor(14612.5020, device='cuda:0')) | > current_lr_0: 5.582588272164505e-05 | > current_lr_1: 5.588174001951443e-05 | > step_time: 0.6814 (0.6240507680542614) | > loader_time: 0.4349 (0.032446272519170025)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6208443641662598 (2.6208443641662598) | > loss_disc_real_0: 0.38116517663002014 (0.38116517663002014) | > loss_disc_real_1: 0.19364053010940552 (0.19364053010940552) | > loss_disc_real_2: 0.23495331406593323 (0.23495331406593323) | > loss_disc_real_3: 0.3638620376586914 (0.3638620376586914) | > loss_disc_real_4: 0.26855379343032837 (0.26855379343032837) | > loss_disc_real_5: 0.1418909877538681 (0.1418909877538681) | > loss_0: 2.6208443641662598 (2.6208443641662598) | > loss_gen: 2.3797852993011475 (2.3797852993011475) | > loss_kl: 6.3259406089782715 (6.3259406089782715) | > loss_feat: 6.18283224105835 (6.18283224105835) | > loss_mel: 20.79778480529785 (20.79778480529785) | > loss_duration: 3.1002726554870605 (3.1002726554870605) | > loss_1: 38.78661346435547 (38.78661346435547)  --> STEP: 1 | > loss_disc: 2.899742364883423 (2.899742364883423) | > loss_disc_real_0: 0.2356966733932495 (0.2356966733932495) | > loss_disc_real_1: 0.1796303242444992 (0.1796303242444992) | > loss_disc_real_2: 0.22753235697746277 (0.22753235697746277) | > loss_disc_real_3: 0.2173282951116562 (0.2173282951116562) | > loss_disc_real_4: 0.21801960468292236 (0.21801960468292236) | > loss_disc_real_5: 0.1887982040643692 (0.1887982040643692) | > loss_0: 2.899742364883423 (2.899742364883423) | > loss_gen: 1.823835015296936 (1.823835015296936) | > loss_kl: 6.263083457946777 (6.263083457946777) | > loss_feat: 4.963038444519043 (4.963038444519043) | > loss_mel: 21.88457679748535 (21.88457679748535) | > loss_duration: 3.4606051445007324 (3.4606051445007324) | > loss_1: 38.395137786865234 (38.395137786865234)  --> STEP: 2 | > loss_disc: 3.233365297317505 (3.066553831100464) | > loss_disc_real_0: 0.05982614681124687 (0.1477614101022482) | > loss_disc_real_1: 0.14239229261875153 (0.16101130843162537) | > loss_disc_real_2: 0.24130840599536896 (0.23442038148641586) | > loss_disc_real_3: 0.15062415599822998 (0.18397622555494308) | > loss_disc_real_4: 0.13733918964862823 (0.1776793971657753) | > loss_disc_real_5: 0.15766996145248413 (0.17323408275842667) | > loss_0: 3.233365297317505 (3.066553831100464) | > loss_gen: 1.2787758111953735 (1.5513054132461548) | > loss_kl: 6.65736722946167 (6.460225343704224) | > loss_feat: 9.431098937988281 (7.197068691253662) | > loss_mel: 21.42320442199707 (21.65389060974121) | > loss_duration: 3.386012554168701 (3.423308849334717) | > loss_1: 42.17646026611328 (40.28579902648926)  --> STEP: 3 | > loss_disc: 2.844261407852173 (2.9924563566843667) | > loss_disc_real_0: 0.29677700996398926 (0.19743327672282854) | > loss_disc_real_1: 0.2691696584224701 (0.19706409176190695) | > loss_disc_real_2: 0.27668049931526184 (0.24850708742936453) | > loss_disc_real_3: 0.2576550543308258 (0.208535835146904) | > loss_disc_real_4: 0.280076265335083 (0.21181168655554453) | > loss_disc_real_5: 0.2453417330980301 (0.19726996620496115) | > loss_0: 2.844261407852173 (2.9924563566843667) | > loss_gen: 2.0015323162078857 (1.7013810475667317) | > loss_kl: 2.6669647693634033 (5.195805152257283) | > loss_feat: 0.8976091742515564 (5.09724885225296) | > loss_mel: 14.866119384765625 (19.391300201416016) | > loss_duration: 2.992269992828369 (3.2796292304992676) | > loss_1: 23.42449378967285 (34.66536394755045) --> EVAL PERFORMANCE | > avg_loader_time: 0.0023272832234700522 (-0.01369174321492513) | > avg_loss_disc: 2.9924563566843667 (+0.3931208848953247) | > avg_loss_disc_real_0: 0.19743327672282854 (-0.06511790677905085) | > avg_loss_disc_real_1: 0.19706409176190695 (-0.03703491389751434) | > avg_loss_disc_real_2: 0.24850708742936453 (+0.026252294580141722) | > avg_loss_disc_real_3: 0.208535835146904 (-0.008461068073908479) | > avg_loss_disc_real_4: 0.21181168655554453 (-0.00282758722702664) | > avg_loss_disc_real_5: 0.19726996620496115 (-0.008010638256867708) | > avg_loss_0: 2.9924563566843667 (+0.3931208848953247) | > avg_loss_gen: 1.7013810475667317 (-0.29524103800455737) | > avg_loss_kl: 5.195805152257283 (+0.19971481959025006) | > avg_loss_feat: 5.09724885225296 (+1.3186133050670228) | > avg_loss_mel: 19.391300201416016 (+3.4979322751363124) | > avg_loss_duration: 3.2796292304992676 (+0.001619100570678711) | > avg_loss_1: 34.66536394755045 (+4.722639083862301)  > EPOCH: 1277/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:23:39)   --> TIME: 2023-10-20 16:24:13 -- STEP: 29/50 -- GLOBAL_STEP: 116880 | > loss_disc: 2.766144037246704 (2.4443421076084006) | > loss_disc_real_0: 0.13585442304611206 (0.13217901830272427) | > loss_disc_real_1: 0.2163786143064499 (0.2290925578824405) | > loss_disc_real_2: 0.22075927257537842 (0.21520257490719186) | > loss_disc_real_3: 0.3090168237686157 (0.22784121000561222) | > loss_disc_real_4: 0.16275553405284882 (0.20487988701668278) | > loss_disc_real_5: 0.24106627702713013 (0.20656461409967522) | > loss_0: 2.766144037246704 (2.4443421076084006) | > grad_norm_0: tensor(713.2800, device='cuda:0') (tensor(588.0637, device='cuda:0')) | > loss_gen: 1.9956103563308716 (2.2635528753543728) | > loss_kl: 0.4728104770183563 (0.8489769974659229) | > loss_feat: 5.513827800750732 (5.942165960782561) | > loss_mel: 21.455482482910156 (20.854234736541223) | > loss_duration: 1.3431872129440308 (1.3041395688879078) | > loss_1: 30.78091812133789 (31.21307029395268) | > grad_norm_1: tensor(7059.9912, device='cuda:0') (tensor(17139.1133, device='cuda:0')) | > current_lr_0: 5.5770081256642084e-05 | > current_lr_1: 5.582588272164505e-05 | > step_time: 0.3944 (0.6003367571995177) | > loader_time: 0.0281 (0.025668308652680497)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9073915481567383 (2.9073915481567383) | > loss_disc_real_0: 0.2937963008880615 (0.2937963008880615) | > loss_disc_real_1: 0.3301146626472473 (0.3301146626472473) | > loss_disc_real_2: 0.2252907007932663 (0.2252907007932663) | > loss_disc_real_3: 0.27718669176101685 (0.27718669176101685) | > loss_disc_real_4: 0.37426018714904785 (0.37426018714904785) | > loss_disc_real_5: 0.32008805871009827 (0.32008805871009827) | > loss_0: 2.9073915481567383 (2.9073915481567383) | > loss_gen: 2.121856689453125 (2.121856689453125) | > loss_kl: 5.825116157531738 (5.825116157531738) | > loss_feat: 2.5872373580932617 (2.5872373580932617) | > loss_mel: 19.291786193847656 (19.291786193847656) | > loss_duration: 3.085984706878662 (3.085984706878662) | > loss_1: 32.91197967529297 (32.91197967529297)  --> STEP: 1 | > loss_disc: 2.6586146354675293 (2.6586146354675293) | > loss_disc_real_0: 0.12949760258197784 (0.12949760258197784) | > loss_disc_real_1: 0.23335283994674683 (0.23335283994674683) | > loss_disc_real_2: 0.2707825005054474 (0.2707825005054474) | > loss_disc_real_3: 0.24124912917613983 (0.24124912917613983) | > loss_disc_real_4: 0.3173936605453491 (0.3173936605453491) | > loss_disc_real_5: 0.2967119514942169 (0.2967119514942169) | > loss_0: 2.6586146354675293 (2.6586146354675293) | > loss_gen: 1.949914574623108 (1.949914574623108) | > loss_kl: 5.809226989746094 (5.809226989746094) | > loss_feat: 1.4595047235488892 (1.4595047235488892) | > loss_mel: 17.955547332763672 (17.955547332763672) | > loss_duration: 3.4970431327819824 (3.4970431327819824) | > loss_1: 30.67123794555664 (30.67123794555664)  --> STEP: 2 | > loss_disc: 2.9855704307556152 (2.8220925331115723) | > loss_disc_real_0: 0.2140059918165207 (0.17175179719924927) | > loss_disc_real_1: 0.30043768882751465 (0.26689526438713074) | > loss_disc_real_2: 0.31151846051216125 (0.2911504805088043) | > loss_disc_real_3: 0.3252025246620178 (0.2832258269190788) | > loss_disc_real_4: 0.2679710388183594 (0.29268234968185425) | > loss_disc_real_5: 0.28981441259384155 (0.29326318204402924) | > loss_0: 2.9855704307556152 (2.8220925331115723) | > loss_gen: 2.2859950065612793 (2.1179547905921936) | > loss_kl: 6.636000156402588 (6.222613573074341) | > loss_feat: 8.987378120422363 (5.223441421985626) | > loss_mel: 20.829803466796875 (19.392675399780273) | > loss_duration: 3.494776487350464 (3.495909810066223) | > loss_1: 42.23395538330078 (36.45259666442871)  --> STEP: 3 | > loss_disc: 2.9391632080078125 (2.861116091410319) | > loss_disc_real_0: 0.30491018295288086 (0.21613792578379312) | > loss_disc_real_1: 0.3322697579860687 (0.2886867622534434) | > loss_disc_real_2: 0.32623472809791565 (0.30284522970517475) | > loss_disc_real_3: 0.2047731727361679 (0.25707494219144184) | > loss_disc_real_4: 0.3447982966899872 (0.31005433201789856) | > loss_disc_real_5: 0.2661866843700409 (0.28423768281936646) | > loss_0: 2.9391632080078125 (2.861116091410319) | > loss_gen: 2.1285691261291504 (2.1214929024378457) | > loss_kl: 2.959824800491333 (5.135017315546672) | > loss_feat: 3.6442322731018066 (4.697038372357686) | > loss_mel: 22.893047332763672 (20.559466044108074) | > loss_duration: 3.0532259941101074 (3.348348538080851) | > loss_1: 34.678897857666016 (35.86136372884115) --> EVAL PERFORMANCE | > avg_loader_time: 0.012043952941894531 (+0.009716669718424479) | > avg_loss_disc: 2.861116091410319 (-0.13134026527404785) | > avg_loss_disc_real_0: 0.21613792578379312 (+0.018704649060964584) | > avg_loss_disc_real_1: 0.2886867622534434 (+0.09162267049153647) | > avg_loss_disc_real_2: 0.30284522970517475 (+0.054338142275810214) | > avg_loss_disc_real_3: 0.25707494219144184 (+0.048539107044537844) | > avg_loss_disc_real_4: 0.31005433201789856 (+0.09824264546235403) | > avg_loss_disc_real_5: 0.28423768281936646 (+0.0869677166144053) | > avg_loss_0: 2.861116091410319 (-0.13134026527404785) | > avg_loss_gen: 2.1214929024378457 (+0.420111854871114) | > avg_loss_kl: 5.135017315546672 (-0.06078783671061139) | > avg_loss_feat: 4.697038372357686 (-0.40021047989527414) | > avg_loss_mel: 20.559466044108074 (+1.1681658426920585) | > avg_loss_duration: 3.348348538080851 (+0.06871930758158351) | > avg_loss_1: 35.86136372884115 (+1.1959997812906948)  > EPOCH: 1278/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:24:52)   --> TIME: 2023-10-20 16:25:04 -- STEP: 9/50 -- GLOBAL_STEP: 116910 | > loss_disc: 2.352689266204834 (2.6387463675604925) | > loss_disc_real_0: 0.17800402641296387 (0.17733326512906286) | > loss_disc_real_1: 0.4348137080669403 (0.27728328771061367) | > loss_disc_real_2: 0.13631483912467957 (0.25143039060963523) | > loss_disc_real_3: 0.20888590812683105 (0.20003904319471782) | > loss_disc_real_4: 0.1948263943195343 (0.33017055028014713) | > loss_disc_real_5: 0.3189806342124939 (0.32186271250247955) | > loss_0: 2.352689266204834 (2.6387463675604925) | > grad_norm_0: tensor(817.0714, device='cuda:0') (tensor(1200.7999, device='cuda:0')) | > loss_gen: 2.493281602859497 (2.24931898381975) | > loss_kl: 0.8966997265815735 (0.943266749382019) | > loss_feat: 4.981939315795898 (4.16327655977673) | > loss_mel: 21.89808464050293 (19.7698974609375) | > loss_duration: 1.26570725440979 (1.295893006854587) | > loss_1: 31.53571319580078 (28.42165247599284) | > grad_norm_1: tensor(10461.3330, device='cuda:0') (tensor(22116.8848, device='cuda:0')) | > current_lr_0: 5.5714335568697066e-05 | > current_lr_1: 5.5770081256642084e-05 | > step_time: 0.4875 (0.5923900074428983) | > loader_time: 0.0081 (0.015102148056030273)  --> TIME: 2023-10-20 16:25:24 -- STEP: 39/50 -- GLOBAL_STEP: 116940 | > loss_disc: 1.7587708234786987 (2.487748791009952) | > loss_disc_real_0: 0.0687309056520462 (0.13173960182720265) | > loss_disc_real_1: 0.23450985550880432 (0.24155222185147115) | > loss_disc_real_2: 0.15199944376945496 (0.21798811279810393) | > loss_disc_real_3: 0.1719592958688736 (0.2226657754717729) | > loss_disc_real_4: 0.1292240470647812 (0.24495485243506915) | > loss_disc_real_5: 0.10946059226989746 (0.2569730413647798) | > loss_0: 1.7587708234786987 (2.487748791009952) | > grad_norm_0: tensor(1540.3330, device='cuda:0') (tensor(1275.5697, device='cuda:0')) | > loss_gen: 2.8571958541870117 (2.2524824937184653) | > loss_kl: 0.4989683926105499 (0.8193624730293567) | > loss_feat: 7.319499969482422 (4.915964026290637) | > loss_mel: 18.30978012084961 (20.07183948541299) | > loss_duration: 1.3868286609649658 (1.2882376939822466) | > loss_1: 30.372272491455078 (29.34788597547091) | > grad_norm_1: tensor(38656.6875, device='cuda:0') (tensor(28173.3340, device='cuda:0')) | > current_lr_0: 5.5714335568697066e-05 | > current_lr_1: 5.5770081256642084e-05 | > step_time: 0.2606 (0.6236627590961945) | > loader_time: 0.0023 (0.022463242212931316)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.962986469268799 (2.962986469268799) | > loss_disc_real_0: 0.23346610367298126 (0.23346610367298126) | > loss_disc_real_1: 0.3418511152267456 (0.3418511152267456) | > loss_disc_real_2: 0.2118958979845047 (0.2118958979845047) | > loss_disc_real_3: 0.39278244972229004 (0.39278244972229004) | > loss_disc_real_4: 0.3102175295352936 (0.3102175295352936) | > loss_disc_real_5: 0.3536766767501831 (0.3536766767501831) | > loss_0: 2.962986469268799 (2.962986469268799) | > loss_gen: 2.3552114963531494 (2.3552114963531494) | > loss_kl: 5.663991451263428 (5.663991451263428) | > loss_feat: 6.160896301269531 (6.160896301269531) | > loss_mel: 22.698076248168945 (22.698076248168945) | > loss_duration: 3.213020086288452 (3.213020086288452) | > loss_1: 40.0911979675293 (40.0911979675293)  --> STEP: 1 | > loss_disc: 2.5538442134857178 (2.5538442134857178) | > loss_disc_real_0: 0.46394509077072144 (0.46394509077072144) | > loss_disc_real_1: 0.3356281816959381 (0.3356281816959381) | > loss_disc_real_2: 0.23877504467964172 (0.23877504467964172) | > loss_disc_real_3: 0.2456415891647339 (0.2456415891647339) | > loss_disc_real_4: 0.24779939651489258 (0.24779939651489258) | > loss_disc_real_5: 0.06931178271770477 (0.06931178271770477) | > loss_0: 2.5538442134857178 (2.5538442134857178) | > loss_gen: 2.4331555366516113 (2.4331555366516113) | > loss_kl: 5.675134181976318 (5.675134181976318) | > loss_feat: 6.934228897094727 (6.934228897094727) | > loss_mel: 22.471485137939453 (22.471485137939453) | > loss_duration: 3.536310911178589 (3.536310911178589) | > loss_1: 41.050315856933594 (41.050315856933594)  --> STEP: 2 | > loss_disc: 1.7581374645233154 (2.1559908390045166) | > loss_disc_real_0: 0.10879333317279816 (0.2863692119717598) | > loss_disc_real_1: 0.15200017392635345 (0.24381417781114578) | > loss_disc_real_2: 0.08661018311977386 (0.1626926138997078) | > loss_disc_real_3: 0.20869168639183044 (0.22716663777828217) | > loss_disc_real_4: 0.06647873669862747 (0.15713906660676003) | > loss_disc_real_5: 0.04752570018172264 (0.05841874144971371) | > loss_0: 1.7581374645233154 (2.1559908390045166) | > loss_gen: 2.4377245903015137 (2.4354400634765625) | > loss_kl: 6.471062660217285 (6.073098421096802) | > loss_feat: 9.357973098754883 (8.146100997924805) | > loss_mel: 25.56346893310547 (24.01747703552246) | > loss_duration: 3.596036195755005 (3.566173553466797) | > loss_1: 47.426265716552734 (44.238290786743164)  --> STEP: 3 | > loss_disc: 2.9442460536956787 (2.418742577234904) | > loss_disc_real_0: 0.12394343316555023 (0.23222728570302328) | > loss_disc_real_1: 0.25067150592803955 (0.24609995385011038) | > loss_disc_real_2: 0.32529711723327637 (0.2168941150108973) | > loss_disc_real_3: 0.3013369143009186 (0.25189006328582764) | > loss_disc_real_4: 0.23447205126285553 (0.18291672815879187) | > loss_disc_real_5: 0.26161035895347595 (0.12614928061763445) | > loss_0: 2.9442460536956787 (2.418742577234904) | > loss_gen: 1.5870085954666138 (2.152629574139913) | > loss_kl: 3.279123544692993 (5.141773462295532) | > loss_feat: 0.4233180582523346 (5.571840018033981) | > loss_mel: 15.595760345458984 (21.210238138834637) | > loss_duration: 3.0413990020751953 (3.3912487030029297) | > loss_1: 23.926610946655273 (37.4677308400472) --> EVAL PERFORMANCE | > avg_loader_time: 0.03476198514302572 (+0.022718032201131187) | > avg_loss_disc: 2.418742577234904 (-0.44237351417541504) | > avg_loss_disc_real_0: 0.23222728570302328 (+0.01608935991923016) | > avg_loss_disc_real_1: 0.24609995385011038 (-0.04258680840333304) | > avg_loss_disc_real_2: 0.2168941150108973 (-0.08595111469427744) | > avg_loss_disc_real_3: 0.25189006328582764 (-0.005184878905614199) | > avg_loss_disc_real_4: 0.18291672815879187 (-0.1271376038591067) | > avg_loss_disc_real_5: 0.12614928061763445 (-0.158088402201732) | > avg_loss_0: 2.418742577234904 (-0.44237351417541504) | > avg_loss_gen: 2.152629574139913 (+0.031136671702067353) | > avg_loss_kl: 5.141773462295532 (+0.006756146748860381) | > avg_loss_feat: 5.571840018033981 (+0.8748016456762953) | > avg_loss_mel: 21.210238138834637 (+0.6507720947265625) | > avg_loss_duration: 3.3912487030029297 (+0.0429001649220786) | > avg_loss_1: 37.4677308400472 (+1.6063671112060547)  > EPOCH: 1279/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:25:42)   --> TIME: 2023-10-20 16:25:57 -- STEP: 19/50 -- GLOBAL_STEP: 116970 | > loss_disc: 2.8618879318237305 (2.5108933448791504) | > loss_disc_real_0: 0.022046692669391632 (0.15906172265347682) | > loss_disc_real_1: 0.2836523950099945 (0.23100565295470388) | > loss_disc_real_2: 0.17791247367858887 (0.23626643438872538) | > loss_disc_real_3: 0.23932862281799316 (0.2355932919798713) | > loss_disc_real_4: 0.23857618868350983 (0.23039347599995763) | > loss_disc_real_5: 0.2952788472175598 (0.22708600852638483) | > loss_0: 2.8618879318237305 (2.5108933448791504) | > grad_norm_0: tensor(3686.3579, device='cuda:0') (tensor(1450.2855, device='cuda:0')) | > loss_gen: 1.604292392730713 (2.199653380795529) | > loss_kl: 0.5741091370582581 (0.8049816202960516) | > loss_feat: 1.623246669769287 (4.615874010873468) | > loss_mel: 16.445541381835938 (19.74250366813258) | > loss_duration: 1.3193395137786865 (1.3174346685409546) | > loss_1: 21.5665283203125 (28.680447076496325) | > grad_norm_1: tensor(5173.8647, device='cuda:0') (tensor(37457.4570, device='cuda:0')) | > current_lr_0: 5.565864560205736e-05 | > current_lr_1: 5.5714335568697066e-05 | > step_time: 0.4148 (0.5325742144333688) | > loader_time: 0.0022 (0.01677165533366956)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.168614625930786 (2.168614625930786) | > loss_disc_real_0: 0.06450344622135162 (0.06450344622135162) | > loss_disc_real_1: 0.17773540318012238 (0.17773540318012238) | > loss_disc_real_2: 0.16973784565925598 (0.16973784565925598) | > loss_disc_real_3: 0.22299525141716003 (0.22299525141716003) | > loss_disc_real_4: 0.28425708413124084 (0.28425708413124084) | > loss_disc_real_5: 0.21696703135967255 (0.21696703135967255) | > loss_0: 2.168614625930786 (2.168614625930786) | > loss_gen: 2.601768732070923 (2.601768732070923) | > loss_kl: 5.7865824699401855 (5.7865824699401855) | > loss_feat: 4.941043853759766 (4.941043853759766) | > loss_mel: 27.35965919494629 (27.35965919494629) | > loss_duration: 3.1095468997955322 (3.1095468997955322) | > loss_1: 43.79860305786133 (43.79860305786133)  --> STEP: 1 | > loss_disc: 2.3462138175964355 (2.3462138175964355) | > loss_disc_real_0: 0.14223214983940125 (0.14223214983940125) | > loss_disc_real_1: 0.21732819080352783 (0.21732819080352783) | > loss_disc_real_2: 0.272606760263443 (0.272606760263443) | > loss_disc_real_3: 0.22230324149131775 (0.22230324149131775) | > loss_disc_real_4: 0.2559245526790619 (0.2559245526790619) | > loss_disc_real_5: 0.2774944603443146 (0.2774944603443146) | > loss_0: 2.3462138175964355 (2.3462138175964355) | > loss_gen: 2.5076611042022705 (2.5076611042022705) | > loss_kl: 5.494235515594482 (5.494235515594482) | > loss_feat: 6.60863733291626 (6.60863733291626) | > loss_mel: 22.38443374633789 (22.38443374633789) | > loss_duration: 3.4849090576171875 (3.4849090576171875) | > loss_1: 40.47987365722656 (40.47987365722656)  --> STEP: 2 | > loss_disc: 2.3047096729278564 (2.325461745262146) | > loss_disc_real_0: 0.18700334429740906 (0.16461774706840515) | > loss_disc_real_1: 0.19990143179893494 (0.20861481130123138) | > loss_disc_real_2: 0.3067227602005005 (0.28966476023197174) | > loss_disc_real_3: 0.16153617203235626 (0.191919706761837) | > loss_disc_real_4: 0.34610357880592346 (0.3010140657424927) | > loss_disc_real_5: 0.20610201358795166 (0.24179823696613312) | > loss_0: 2.3047096729278564 (2.325461745262146) | > loss_gen: 2.9180538654327393 (2.712857484817505) | > loss_kl: 6.182074069976807 (5.8381547927856445) | > loss_feat: 11.07882022857666 (8.84372878074646) | > loss_mel: 23.97152328491211 (23.177978515625) | > loss_duration: 3.3966355323791504 (3.440772294998169) | > loss_1: 47.5471076965332 (44.01349067687988)  --> STEP: 3 | > loss_disc: 2.944211006164551 (2.5317114988962808) | > loss_disc_real_0: 0.21545782685279846 (0.1815644403298696) | > loss_disc_real_1: 0.26481184363365173 (0.22734715541203818) | > loss_disc_real_2: 0.2590846121311188 (0.27947137753168744) | > loss_disc_real_3: 0.26595938205718994 (0.21659959852695465) | > loss_disc_real_4: 0.2525486648082733 (0.28485893209775287) | > loss_disc_real_5: 0.30634966492652893 (0.2633153796195984) | > loss_0: 2.944211006164551 (2.5317114988962808) | > loss_gen: 1.6329607963562012 (2.3528919219970703) | > loss_kl: 2.9587676525115967 (4.878359079360962) | > loss_feat: 0.17632955312728882 (5.954595704873403) | > loss_mel: 4.278594970703125 (16.878184000651043) | > loss_duration: 3.167280435562134 (3.3496083418528237) | > loss_1: 12.213933944702148 (33.41363843282064)  --> TIME: 2023-10-20 16:26:27 -- STEP: 49/50 -- GLOBAL_STEP: 117000 | > loss_disc: 1.9981096982955933 (2.3984878793054705) | > loss_disc_real_0: 0.08657228201627731 (0.1371847404623214) | > loss_disc_real_1: 0.24816210567951202 (0.22668897406179078) | > loss_disc_real_2: 0.06675293296575546 (0.22554245431508338) | > loss_disc_real_3: 0.254173219203949 (0.23014143630101971) | > loss_disc_real_4: 0.3621557354927063 (0.2128714719141016) | > loss_disc_real_5: 0.15568403899669647 (0.20655522470799637) | > loss_0: 1.9981096982955933 (2.3984878793054705) | > grad_norm_0: tensor(2693.1758, device='cuda:0') (tensor(1240.5945, device='cuda:0')) | > loss_gen: 3.3943076133728027 (2.2772385514512354) | > loss_kl: 0.7920618653297424 (0.7900286364007969) | > loss_feat: 9.699092864990234 (5.222557228894864) | > loss_mel: 23.65723419189453 (19.873486638069156) | > loss_duration: 1.4351774454116821 (1.2930573079050802) | > loss_1: 38.97787094116211 (29.456368387961874) | > grad_norm_1: tensor(128001.0078, device='cuda:0') (tensor(40378.8203, device='cuda:0')) | > current_lr_0: 5.565864560205736e-05 | > current_lr_1: 5.5714335568697066e-05 | > step_time: 1.7154 (0.6335525755979576) | > loader_time: 8.1718 (0.1871587646250822) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_117000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8162264823913574 (2.60284024477005) | > loss_disc_real_0: 0.3865371346473694 (0.23280761390924454) | > loss_disc_real_1: 0.34317076206207275 (0.2563030570745468) | > loss_disc_real_2: 0.3286288380622864 (0.29176074266433716) | > loss_disc_real_3: 0.2859031558036804 (0.2339254878461361) | > loss_disc_real_4: 0.2894285321235657 (0.2860013321042061) | > loss_disc_real_5: 0.32493507862091064 (0.27872030436992645) | > loss_0: 2.8162264823913574 (2.60284024477005) | > loss_gen: 2.6697561740875244 (2.432107985019684) | > loss_kl: 5.7998881340026855 (5.108741343021393) | > loss_feat: 6.7046284675598145 (6.142103895545006) | > loss_mel: 23.836769104003906 (18.617830276489258) | > loss_duration: 3.114858388900757 (3.290920853614807) | > loss_1: 42.12590026855469 (35.59170389175415)  --> STEP: 1 | > loss_disc: 2.534917116165161 (2.589255619049072) | > loss_disc_real_0: 0.19831548631191254 (0.22590918838977814) | > loss_disc_real_1: 0.2650689482688904 (0.25805623531341554) | > loss_disc_real_2: 0.25677675008773804 (0.28476394414901735) | > loss_disc_real_3: 0.3059385120868683 (0.24832809269428252) | > loss_disc_real_4: 0.3613080084323883 (0.30106266736984255) | > loss_disc_real_5: 0.4602997601032257 (0.3150361955165863) | > loss_0: 2.534917116165161 (2.589255619049072) | > loss_gen: 3.167374610900879 (2.5791613101959228) | > loss_kl: 5.027456760406494 (5.092484426498413) | > loss_feat: 6.354979991912842 (6.184679114818573) | > loss_mel: 23.307680130004883 (19.555800247192384) | > loss_duration: 3.49357533454895 (3.331451749801636) | > loss_1: 41.35106658935547 (36.74357643127441)  --> STEP: 2 | > loss_disc: 2.9913878440856934 (2.656277656555176) | > loss_disc_real_0: 0.6133154630661011 (0.29047690083583194) | > loss_disc_real_1: 0.22821861505508423 (0.25308329860369366) | > loss_disc_real_2: 0.2181617170572281 (0.27366357296705246) | > loss_disc_real_3: 0.255132794380188 (0.24946220964193344) | > loss_disc_real_4: 0.2592998445034027 (0.29410219689210254) | > loss_disc_real_5: 0.2537422180175781 (0.30482053260008496) | > loss_0: 2.9913878440856934 (2.656277656555176) | > loss_gen: 2.88913893699646 (2.630824247996012) | > loss_kl: 6.24866247177124 (5.285180767377217) | > loss_feat: 5.470211505889893 (6.065601179997127) | > loss_mel: 28.221881866455078 (21.000147183736164) | > loss_duration: 3.4338796138763428 (3.3485230604807534) | > loss_1: 46.26377487182617 (38.33027617136637)  --> STEP: 3 | > loss_disc: 2.576172113418579 (2.644834007535662) | > loss_disc_real_0: 0.1791016161441803 (0.2745661458798817) | > loss_disc_real_1: 0.37115463614463806 (0.2699506325381143) | > loss_disc_real_2: 0.27369582653045654 (0.2736681806189673) | > loss_disc_real_3: 0.3330930471420288 (0.26140947214194704) | > loss_disc_real_4: 0.41879287362098694 (0.3119151507105146) | > loss_disc_real_5: 0.20925094187259674 (0.2911677339247295) | > loss_0: 2.576172113418579 (2.644834007535662) | > loss_gen: 3.0841763019561768 (2.6955888271331787) | > loss_kl: 2.9812934398651123 (4.9560540063040595) | > loss_feat: 5.573422431945801 (5.995289930275509) | > loss_mel: 21.27573585510254 (21.03951699393136) | > loss_duration: 3.0617449283599854 (3.3075547558920726) | > loss_1: 35.97637176513672 (37.99400411333357) --> EVAL PERFORMANCE | > avg_loader_time: 0.29328414372035433 (+0.25852215857732863) | > avg_loss_disc: 2.644834007535662 (+0.22609143030075796) | > avg_loss_disc_real_0: 0.2745661458798817 (+0.04233886017685842) | > avg_loss_disc_real_1: 0.2699506325381143 (+0.023850678688003918) | > avg_loss_disc_real_2: 0.2736681806189673 (+0.056774065608069996) | > avg_loss_disc_real_3: 0.26140947214194704 (+0.009519408856119405) | > avg_loss_disc_real_4: 0.3119151507105146 (+0.12899842255172275) | > avg_loss_disc_real_5: 0.2911677339247295 (+0.16501845330709505) | > avg_loss_0: 2.644834007535662 (+0.22609143030075796) | > avg_loss_gen: 2.6955888271331787 (+0.5429592529932656) | > avg_loss_kl: 4.9560540063040595 (-0.18571945599147277) | > avg_loss_feat: 5.995289930275509 (+0.4234499122415274) | > avg_loss_mel: 21.03951699393136 (-0.1707211449032755) | > avg_loss_duration: 3.3075547558920726 (-0.08369394711085709) | > avg_loss_1: 37.99400411333357 (+0.526273273286364)  > EPOCH: 1280/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:26:39)   --> TIME: 2023-10-20 16:27:03 -- STEP: 29/50 -- GLOBAL_STEP: 117030 | > loss_disc: 2.8717732429504395 (2.525056423812077) | > loss_disc_real_0: 0.1799352616071701 (0.13660816520709415) | > loss_disc_real_1: 0.2542606294155121 (0.23339819676917176) | > loss_disc_real_2: 0.31772083044052124 (0.25883608260031404) | > loss_disc_real_3: 0.26390495896339417 (0.24404323807564274) | > loss_disc_real_4: 0.22552983462810516 (0.24677407677317487) | > loss_disc_real_5: 0.20200301706790924 (0.22292774135311103) | > loss_0: 2.8717732429504395 (2.525056423812077) | > grad_norm_0: tensor(859.0334, device='cuda:0') (tensor(1466.1809, device='cuda:0')) | > loss_gen: 1.755514144897461 (2.323453936083563) | > loss_kl: 0.7903779745101929 (0.8420930689778822) | > loss_feat: 1.3192360401153564 (5.515006795525551) | > loss_mel: 16.84672737121582 (19.201529926267163) | > loss_duration: 1.3227155208587646 (1.322589479643723) | > loss_1: 22.034570693969727 (29.204673438236632) | > grad_norm_1: tensor(11313.1025, device='cuda:0') (tensor(61680.2188, device='cuda:0')) | > current_lr_0: 5.5603011301026015e-05 | > current_lr_1: 5.565864560205736e-05 | > step_time: 0.5242 (0.6372639064131115) | > loader_time: 0.0098 (0.019837289020932954)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0207555294036865 (3.0207555294036865) | > loss_disc_real_0: 0.4044496417045593 (0.4044496417045593) | > loss_disc_real_1: 0.3654652237892151 (0.3654652237892151) | > loss_disc_real_2: 0.24011613428592682 (0.24011613428592682) | > loss_disc_real_3: 0.26209720969200134 (0.26209720969200134) | > loss_disc_real_4: 0.26251453161239624 (0.26251453161239624) | > loss_disc_real_5: 0.30512547492980957 (0.30512547492980957) | > loss_0: 3.0207555294036865 (3.0207555294036865) | > loss_gen: 2.0180249214172363 (2.0180249214172363) | > loss_kl: 6.2414350509643555 (6.2414350509643555) | > loss_feat: 4.952775001525879 (4.952775001525879) | > loss_mel: 21.42700958251953 (21.42700958251953) | > loss_duration: 3.03340220451355 (3.03340220451355) | > loss_1: 37.672645568847656 (37.672645568847656)  --> STEP: 1 | > loss_disc: 3.033339738845825 (3.033339738845825) | > loss_disc_real_0: 0.377254456281662 (0.377254456281662) | > loss_disc_real_1: 0.3136691153049469 (0.3136691153049469) | > loss_disc_real_2: 0.26832616329193115 (0.26832616329193115) | > loss_disc_real_3: 0.30615124106407166 (0.30615124106407166) | > loss_disc_real_4: 0.32469257712364197 (0.32469257712364197) | > loss_disc_real_5: 0.38460415601730347 (0.38460415601730347) | > loss_0: 3.033339738845825 (3.033339738845825) | > loss_gen: 2.2941195964813232 (2.2941195964813232) | > loss_kl: 5.843703746795654 (5.843703746795654) | > loss_feat: 4.615972518920898 (4.615972518920898) | > loss_mel: 25.574546813964844 (25.574546813964844) | > loss_duration: 3.5400373935699463 (3.5400373935699463) | > loss_1: 41.868385314941406 (41.868385314941406)  --> STEP: 2 | > loss_disc: 3.2107648849487305 (3.122052311897278) | > loss_disc_real_0: 0.2666875123977661 (0.32197098433971405) | > loss_disc_real_1: 0.3709501028060913 (0.3423096090555191) | > loss_disc_real_2: 0.2647687494754791 (0.26654745638370514) | > loss_disc_real_3: 0.5317097306251526 (0.4189304858446121) | > loss_disc_real_4: 0.1914903223514557 (0.25809144973754883) | > loss_disc_real_5: 0.25411099195480347 (0.31935757398605347) | > loss_0: 3.2107648849487305 (3.122052311897278) | > loss_gen: 2.0320887565612793 (2.1631041765213013) | > loss_kl: 6.346377372741699 (6.095040559768677) | > loss_feat: 7.6586222648620605 (6.1372973918914795) | > loss_mel: 20.48745346069336 (23.0310001373291) | > loss_duration: 3.4864342212677 (3.5132358074188232) | > loss_1: 40.01097869873047 (40.93968200683594)  --> STEP: 3 | > loss_disc: 2.877211332321167 (3.040438652038574) | > loss_disc_real_0: 0.31135094165802 (0.3184309701124827) | > loss_disc_real_1: 0.2561669945716858 (0.31359540422757465) | > loss_disc_real_2: 0.2846413552761078 (0.27257875601450604) | > loss_disc_real_3: 0.25888335704803467 (0.3655814429124196) | > loss_disc_real_4: 0.26194173097610474 (0.25937487681706745) | > loss_disc_real_5: 0.2561390697956085 (0.29828473925590515) | > loss_0: 2.877211332321167 (3.040438652038574) | > loss_gen: 1.845648169517517 (2.05728550752004) | > loss_kl: 3.201969861984253 (5.130683660507202) | > loss_feat: 0.5316833257675171 (4.268759369850159) | > loss_mel: 15.672816276550293 (20.578272183736164) | > loss_duration: 3.055687427520752 (3.360719680786133) | > loss_1: 24.307804107666016 (35.39572270711263) --> EVAL PERFORMANCE | > avg_loader_time: 0.023136297861735027 (-0.2701478458586193) | > avg_loss_disc: 3.040438652038574 (+0.39560464450291244) | > avg_loss_disc_real_0: 0.3184309701124827 (+0.04386482423260102) | > avg_loss_disc_real_1: 0.31359540422757465 (+0.04364477168946035) | > avg_loss_disc_real_2: 0.27257875601450604 (-0.0010894246044612643) | > avg_loss_disc_real_3: 0.3655814429124196 (+0.10417197077047258) | > avg_loss_disc_real_4: 0.25937487681706745 (-0.052540273893447176) | > avg_loss_disc_real_5: 0.29828473925590515 (+0.007117005331175652) | > avg_loss_0: 3.040438652038574 (+0.39560464450291244) | > avg_loss_gen: 2.05728550752004 (-0.6383033196131387) | > avg_loss_kl: 5.130683660507202 (+0.1746296542031427) | > avg_loss_feat: 4.268759369850159 (-1.72653056042535) | > avg_loss_mel: 20.578272183736164 (-0.4612448101951969) | > avg_loss_duration: 3.360719680786133 (+0.05316492489406022) | > avg_loss_1: 35.39572270711263 (-2.5982814062209343)  > EPOCH: 1281/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:27:31)   --> TIME: 2023-10-20 16:27:43 -- STEP: 9/50 -- GLOBAL_STEP: 117060 | > loss_disc: 2.955005407333374 (2.380648652712504) | > loss_disc_real_0: 0.03624832630157471 (0.17706094144119155) | > loss_disc_real_1: 0.251059889793396 (0.22181257439984214) | > loss_disc_real_2: 0.3514847457408905 (0.21752174778117073) | > loss_disc_real_3: 0.3215867578983307 (0.22166335872477955) | > loss_disc_real_4: 0.4700881838798523 (0.215807246354719) | > loss_disc_real_5: 0.36543071269989014 (0.234369316448768) | > loss_0: 2.955005407333374 (2.380648652712504) | > grad_norm_0: tensor(1293.7561, device='cuda:0') (tensor(1253.8086, device='cuda:0')) | > loss_gen: 2.1782078742980957 (2.4000381098853216) | > loss_kl: 0.5057109594345093 (0.7471731272008684) | > loss_feat: 5.147809982299805 (7.098918018241723) | > loss_mel: 22.021583557128906 (19.56474871105618) | > loss_duration: 1.2703138589859009 (1.3214777575598822) | > loss_1: 31.123624801635742 (31.132356272803413) | > grad_norm_1: tensor(18623.8340, device='cuda:0') (tensor(32221.5527, device='cuda:0')) | > current_lr_0: 5.554743260996178e-05 | > current_lr_1: 5.5603011301026015e-05 | > step_time: 0.5059 (0.6293834315405952) | > loader_time: 0.046 (0.03193990389506022)  --> TIME: 2023-10-20 16:27:57 -- STEP: 39/50 -- GLOBAL_STEP: 117090 | > loss_disc: 2.3129308223724365 (2.502246596874335) | > loss_disc_real_0: 0.1097889319062233 (0.14481717481827125) | > loss_disc_real_1: 0.1850261241197586 (0.22417091979430273) | > loss_disc_real_2: 0.12203019112348557 (0.2281476501853038) | > loss_disc_real_3: 0.24656260013580322 (0.23038184356230956) | > loss_disc_real_4: 0.08558045327663422 (0.229685078566082) | > loss_disc_real_5: 0.18211939930915833 (0.24142828688789636) | > loss_0: 2.3129308223724365 (2.502246596874335) | > grad_norm_0: tensor(1472.9558, device='cuda:0') (tensor(1364.8634, device='cuda:0')) | > loss_gen: 2.21662974357605 (2.2298012177149453) | > loss_kl: 0.34229299426078796 (0.7732538130038824) | > loss_feat: 6.08731746673584 (5.6309565380215645) | > loss_mel: 21.855607986450195 (21.150427928337685) | > loss_duration: 1.3893300294876099 (1.296108114413726) | > loss_1: 31.891176223754883 (31.080547760694454) | > grad_norm_1: tensor(26002.3672, device='cuda:0') (tensor(31520.1250, device='cuda:0')) | > current_lr_0: 5.554743260996178e-05 | > current_lr_1: 5.5603011301026015e-05 | > step_time: 0.3321 (0.49421147199777454) | > loader_time: 0.0179 (0.018092723993154675)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.944979429244995 (2.944979429244995) | > loss_disc_real_0: 0.0793047845363617 (0.0793047845363617) | > loss_disc_real_1: 0.23572690784931183 (0.23572690784931183) | > loss_disc_real_2: 0.1877901256084442 (0.1877901256084442) | > loss_disc_real_3: 0.27777811884880066 (0.27777811884880066) | > loss_disc_real_4: 0.37101542949676514 (0.37101542949676514) | > loss_disc_real_5: 0.2981770634651184 (0.2981770634651184) | > loss_0: 2.944979429244995 (2.944979429244995) | > loss_gen: 1.697614312171936 (1.697614312171936) | > loss_kl: 5.981019020080566 (5.981019020080566) | > loss_feat: 5.054077625274658 (5.054077625274658) | > loss_mel: 22.144853591918945 (22.144853591918945) | > loss_duration: 3.1791956424713135 (3.1791956424713135) | > loss_1: 38.056758880615234 (38.056758880615234)  --> STEP: 1 | > loss_disc: 2.944777250289917 (2.944777250289917) | > loss_disc_real_0: 0.015207188203930855 (0.015207188203930855) | > loss_disc_real_1: 0.2693804204463959 (0.2693804204463959) | > loss_disc_real_2: 0.19965337216854095 (0.19965337216854095) | > loss_disc_real_3: 0.3019372522830963 (0.3019372522830963) | > loss_disc_real_4: 0.25414419174194336 (0.25414419174194336) | > loss_disc_real_5: 0.2505321204662323 (0.2505321204662323) | > loss_0: 2.944777250289917 (2.944777250289917) | > loss_gen: 1.5165072679519653 (1.5165072679519653) | > loss_kl: 5.917978763580322 (5.917978763580322) | > loss_feat: 1.7251386642456055 (1.7251386642456055) | > loss_mel: 18.38249397277832 (18.38249397277832) | > loss_duration: 3.4921858310699463 (3.4921858310699463) | > loss_1: 31.034305572509766 (31.034305572509766)  --> STEP: 2 | > loss_disc: 3.3856406211853027 (3.16520893573761) | > loss_disc_real_0: 0.009026015177369118 (0.012116601690649986) | > loss_disc_real_1: 0.2595917582511902 (0.26448608934879303) | > loss_disc_real_2: 0.27599093317985535 (0.23782215267419815) | > loss_disc_real_3: 0.2895371615886688 (0.29573720693588257) | > loss_disc_real_4: 0.2715739905834198 (0.2628590911626816) | > loss_disc_real_5: 0.24063792824745178 (0.24558502435684204) | > loss_0: 3.3856406211853027 (3.16520893573761) | > loss_gen: 1.3473011255264282 (1.4319041967391968) | > loss_kl: 6.330081939697266 (6.124030351638794) | > loss_feat: 0.020754443481564522 (0.872946553863585) | > loss_mel: 0.6924836039543152 (9.537488788366318) | > loss_duration: 3.368370294570923 (3.4302780628204346) | > loss_1: 11.758991241455078 (21.396648406982422)  --> STEP: 3 | > loss_disc: 3.2876698970794678 (3.206029256184896) | > loss_disc_real_0: 0.013916244730353355 (0.012716482703884443) | > loss_disc_real_1: 0.26321932673454285 (0.26406383514404297) | > loss_disc_real_2: 0.26301634311676025 (0.24622021615505219) | > loss_disc_real_3: 0.2865960896015167 (0.2926901678244273) | > loss_disc_real_4: 0.26141977310180664 (0.26237931847572327) | > loss_disc_real_5: 0.23226235806941986 (0.24114413559436798) | > loss_0: 3.2876698970794678 (3.206029256184896) | > loss_gen: 1.3600871562957764 (1.4079651832580566) | > loss_kl: 2.8983259201049805 (5.0487955411275225) | > loss_feat: 0.4193863868713379 (0.721759831532836) | > loss_mel: 13.090567588806152 (10.72184838851293) | > loss_duration: 3.0967423915863037 (3.319099505742391) | > loss_1: 20.865108489990234 (21.21946843465169) --> EVAL PERFORMANCE | > avg_loader_time: 0.016398111979166668 (-0.006738185882568359) | > avg_loss_disc: 3.206029256184896 (+0.16559060414632176) | > avg_loss_disc_real_0: 0.012716482703884443 (-0.3057144874085983) | > avg_loss_disc_real_1: 0.26406383514404297 (-0.04953156908353168) | > avg_loss_disc_real_2: 0.24622021615505219 (-0.026358539859453856) | > avg_loss_disc_real_3: 0.2926901678244273 (-0.07289127508799231) | > avg_loss_disc_real_4: 0.26237931847572327 (+0.003004441658655821) | > avg_loss_disc_real_5: 0.24114413559436798 (-0.05714060366153717) | > avg_loss_0: 3.206029256184896 (+0.16559060414632176) | > avg_loss_gen: 1.4079651832580566 (-0.6493203242619834) | > avg_loss_kl: 5.0487955411275225 (-0.08188811937967966) | > avg_loss_feat: 0.721759831532836 (-3.5469995383173227) | > avg_loss_mel: 10.72184838851293 (-9.856423795223234) | > avg_loss_duration: 3.319099505742391 (-0.041620175043741714) | > avg_loss_1: 21.21946843465169 (-14.176254272460941)  > EPOCH: 1282/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:28:12)   --> TIME: 2023-10-20 16:28:30 -- STEP: 19/50 -- GLOBAL_STEP: 117120 | > loss_disc: 2.9099154472351074 (2.639803748381765) | > loss_disc_real_0: 0.3285627067089081 (0.15602554086791842) | > loss_disc_real_1: 0.3399612605571747 (0.22744323038741163) | > loss_disc_real_2: 0.31656140089035034 (0.232700467501816) | > loss_disc_real_3: 0.25724777579307556 (0.2422605258853812) | > loss_disc_real_4: 0.3176001310348511 (0.23323994404391238) | > loss_disc_real_5: 0.2844448983669281 (0.22442430649933062) | > loss_0: 2.9099154472351074 (2.639803748381765) | > grad_norm_0: tensor(1323.9926, device='cuda:0') (tensor(1569.9404, device='cuda:0')) | > loss_gen: 2.19134783744812 (2.0659270725752177) | > loss_kl: 0.6708543300628662 (0.8204105072899869) | > loss_feat: 2.8376305103302 (4.825803845924766) | > loss_mel: 21.199260711669922 (19.47671822497719) | > loss_duration: 1.3718615770339966 (1.333825381178605) | > loss_1: 28.270954132080078 (28.522684850190814) | > grad_norm_1: tensor(7070.5820, device='cuda:0') (tensor(36763.0898, device='cuda:0')) | > current_lr_0: 5.549190947327901e-05 | > current_lr_1: 5.554743260996178e-05 | > step_time: 0.5766 (0.6101780439677992) | > loader_time: 0.0269 (0.023248998742354542)  --> TIME: 2023-10-20 16:28:50 -- STEP: 49/50 -- GLOBAL_STEP: 117150 | > loss_disc: 2.3621504306793213 (2.435110367074304) | > loss_disc_real_0: 0.10483255237340927 (0.13891254665748198) | > loss_disc_real_1: 0.2684345245361328 (0.21102689571526587) | > loss_disc_real_2: 0.36233603954315186 (0.20724766374546655) | > loss_disc_real_3: 0.3192357122898102 (0.2307335495644686) | > loss_disc_real_4: 0.304227352142334 (0.2124185458357845) | > loss_disc_real_5: 0.3540653586387634 (0.21782723840858256) | > loss_0: 2.3621504306793213 (2.435110367074304) | > grad_norm_0: tensor(1295.4056, device='cuda:0') (tensor(1294.0532, device='cuda:0')) | > loss_gen: 3.228292465209961 (2.2329654547632964) | > loss_kl: 0.6999817490577698 (0.7457946180080881) | > loss_feat: 4.604726314544678 (5.892428897701356) | > loss_mel: 21.536968231201172 (20.746011091738325) | > loss_duration: 1.4122848510742188 (1.3045115519543082) | > loss_1: 31.482254028320312 (30.921711444854736) | > grad_norm_1: tensor(5951.2070, device='cuda:0') (tensor(34617.4492, device='cuda:0')) | > current_lr_0: 5.549190947327901e-05 | > current_lr_1: 5.554743260996178e-05 | > step_time: 0.3612 (0.6192262367326388) | > loader_time: 0.54 (0.03406337815888074)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.998445510864258 (2.998445510864258) | > loss_disc_real_0: 0.5543501377105713 (0.5543501377105713) | > loss_disc_real_1: 0.31462106108665466 (0.31462106108665466) | > loss_disc_real_2: 0.2980329990386963 (0.2980329990386963) | > loss_disc_real_3: 0.35887423157691956 (0.35887423157691956) | > loss_disc_real_4: 0.3676949739456177 (0.3676949739456177) | > loss_disc_real_5: 0.3271113932132721 (0.3271113932132721) | > loss_0: 2.998445510864258 (2.998445510864258) | > loss_gen: 2.96701979637146 (2.96701979637146) | > loss_kl: 6.0792155265808105 (6.0792155265808105) | > loss_feat: 5.608081817626953 (5.608081817626953) | > loss_mel: 21.175739288330078 (21.175739288330078) | > loss_duration: 3.179417848587036 (3.179417848587036) | > loss_1: 39.00947189331055 (39.00947189331055)  --> STEP: 1 | > loss_disc: 2.571678876876831 (2.571678876876831) | > loss_disc_real_0: 0.3806992173194885 (0.3806992173194885) | > loss_disc_real_1: 0.2778848111629486 (0.2778848111629486) | > loss_disc_real_2: 0.29086506366729736 (0.29086506366729736) | > loss_disc_real_3: 0.16747713088989258 (0.16747713088989258) | > loss_disc_real_4: 0.2577504515647888 (0.2577504515647888) | > loss_disc_real_5: 0.2609735131263733 (0.2609735131263733) | > loss_0: 2.571678876876831 (2.571678876876831) | > loss_gen: 2.409834384918213 (2.409834384918213) | > loss_kl: 6.331596851348877 (6.331596851348877) | > loss_feat: 5.197304725646973 (5.197304725646973) | > loss_mel: 24.101308822631836 (24.101308822631836) | > loss_duration: 3.511535167694092 (3.511535167694092) | > loss_1: 41.55158233642578 (41.55158233642578)  --> STEP: 2 | > loss_disc: 3.0800695419311523 (2.8258742094039917) | > loss_disc_real_0: 0.4398952126502991 (0.4102972149848938) | > loss_disc_real_1: 0.36310338973999023 (0.3204941004514694) | > loss_disc_real_2: 0.3363286256790161 (0.31359684467315674) | > loss_disc_real_3: 0.36054500937461853 (0.26401107013225555) | > loss_disc_real_4: 0.3775728642940521 (0.31766165792942047) | > loss_disc_real_5: 0.3713005781173706 (0.31613704562187195) | > loss_0: 3.0800695419311523 (2.8258742094039917) | > loss_gen: 2.7737982273101807 (2.5918163061141968) | > loss_kl: 6.70633602142334 (6.518966436386108) | > loss_feat: 4.943333625793457 (5.070319175720215) | > loss_mel: 28.15142822265625 (26.126368522644043) | > loss_duration: 3.4069571495056152 (3.4592461585998535) | > loss_1: 45.98185348510742 (43.7667179107666)  --> STEP: 3 | > loss_disc: 2.5986428260803223 (2.7501304149627686) | > loss_disc_real_0: 0.1322660744190216 (0.3176201681296031) | > loss_disc_real_1: 0.4535138010978699 (0.3648340006669362) | > loss_disc_real_2: 0.24502335488796234 (0.2907390147447586) | > loss_disc_real_3: 0.3720458149909973 (0.3000226517518361) | > loss_disc_real_4: 0.2374981939792633 (0.2909405032793681) | > loss_disc_real_5: 0.14577622711658478 (0.25935010612010956) | > loss_0: 2.5986428260803223 (2.7501304149627686) | > loss_gen: 2.4132494926452637 (2.5322940349578857) | > loss_kl: 3.213714122772217 (5.417215665181478) | > loss_feat: 5.110193252563477 (5.083610534667969) | > loss_mel: 24.314294815063477 (25.52234395345052) | > loss_duration: 3.1091363430023193 (3.342542886734009) | > loss_1: 38.160587310791016 (41.89800771077474) --> EVAL PERFORMANCE | > avg_loader_time: 0.004926602045694987 (-0.01147150993347168) | > avg_loss_disc: 2.7501304149627686 (-0.4558988412221274) | > avg_loss_disc_real_0: 0.3176201681296031 (+0.30490368542571866) | > avg_loss_disc_real_1: 0.3648340006669362 (+0.10077016552289325) | > avg_loss_disc_real_2: 0.2907390147447586 (+0.04451879858970642) | > avg_loss_disc_real_3: 0.3000226517518361 (+0.007332483927408817) | > avg_loss_disc_real_4: 0.2909405032793681 (+0.028561184803644835) | > avg_loss_disc_real_5: 0.25935010612010956 (+0.018205970525741577) | > avg_loss_0: 2.7501304149627686 (-0.4558988412221274) | > avg_loss_gen: 2.5322940349578857 (+1.124328851699829) | > avg_loss_kl: 5.417215665181478 (+0.3684201240539551) | > avg_loss_feat: 5.083610534667969 (+4.361850703135133) | > avg_loss_mel: 25.52234395345052 (+14.80049556493759) | > avg_loss_duration: 3.342542886734009 (+0.02344338099161769) | > avg_loss_1: 41.89800771077474 (+20.67853927612305)  > EPOCH: 1283/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:29:06)   --> TIME: 2023-10-20 16:29:30 -- STEP: 29/50 -- GLOBAL_STEP: 117180 | > loss_disc: 2.5601813793182373 (2.335877624051325) | > loss_disc_real_0: 0.2779375910758972 (0.12487084887407977) | > loss_disc_real_1: 0.18828028440475464 (0.21498832800265016) | > loss_disc_real_2: 0.3188345730304718 (0.2090877390562974) | > loss_disc_real_3: 0.2985127568244934 (0.22804132450757356) | > loss_disc_real_4: 0.21290989220142365 (0.22933259908238363) | > loss_disc_real_5: 0.29307490587234497 (0.22388078028271938) | > loss_0: 2.5601813793182373 (2.335877624051325) | > grad_norm_0: tensor(770.5836, device='cuda:0') (tensor(740.3886, device='cuda:0')) | > loss_gen: 3.1920931339263916 (2.421157960234018) | > loss_kl: 0.9392542839050293 (0.8590065508053221) | > loss_feat: 6.489139080047607 (6.43374765510189) | > loss_mel: 22.78362274169922 (19.451852383284734) | > loss_duration: 1.320874810218811 (1.3017503639747356) | > loss_1: 34.72498321533203 (30.467514991760254) | > grad_norm_1: tensor(5723.0659, device='cuda:0') (tensor(22977.5059, device='cuda:0')) | > current_lr_0: 5.543644183544763e-05 | > current_lr_1: 5.549190947327901e-05 | > step_time: 0.7626 (0.6172627827216841) | > loader_time: 0.0317 (0.021974037433492723)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5111405849456787 (2.5111405849456787) | > loss_disc_real_0: 0.3319408893585205 (0.3319408893585205) | > loss_disc_real_1: 0.2690921723842621 (0.2690921723842621) | > loss_disc_real_2: 0.38962554931640625 (0.38962554931640625) | > loss_disc_real_3: 0.18777339160442352 (0.18777339160442352) | > loss_disc_real_4: 0.329223096370697 (0.329223096370697) | > loss_disc_real_5: 0.20800049602985382 (0.20800049602985382) | > loss_0: 2.5111405849456787 (2.5111405849456787) | > loss_gen: 2.761298656463623 (2.761298656463623) | > loss_kl: 5.536371231079102 (5.536371231079102) | > loss_feat: 5.602810382843018 (5.602810382843018) | > loss_mel: 22.91118049621582 (22.91118049621582) | > loss_duration: 3.0715219974517822 (3.0715219974517822) | > loss_1: 39.883182525634766 (39.883182525634766)  --> STEP: 1 | > loss_disc: 3.0450925827026367 (3.0450925827026367) | > loss_disc_real_0: 0.33388400077819824 (0.33388400077819824) | > loss_disc_real_1: 0.19431117177009583 (0.19431117177009583) | > loss_disc_real_2: 0.2757161557674408 (0.2757161557674408) | > loss_disc_real_3: 0.21537798643112183 (0.21537798643112183) | > loss_disc_real_4: 0.4087334871292114 (0.4087334871292114) | > loss_disc_real_5: 0.4401543140411377 (0.4401543140411377) | > loss_0: 3.0450925827026367 (3.0450925827026367) | > loss_gen: 2.0990350246429443 (2.0990350246429443) | > loss_kl: 5.594196796417236 (5.594196796417236) | > loss_feat: 6.172510147094727 (6.172510147094727) | > loss_mel: 23.079896926879883 (23.079896926879883) | > loss_duration: 3.602228879928589 (3.602228879928589) | > loss_1: 40.54786682128906 (40.54786682128906)  --> STEP: 2 | > loss_disc: 2.494419813156128 (2.7697561979293823) | > loss_disc_real_0: 0.12625724077224731 (0.23007062077522278) | > loss_disc_real_1: 0.28416866064071655 (0.2392399162054062) | > loss_disc_real_2: 0.288353830575943 (0.2820349931716919) | > loss_disc_real_3: 0.22787407040596008 (0.22162602841854095) | > loss_disc_real_4: 0.3313242495059967 (0.37002886831760406) | > loss_disc_real_5: 0.1651802361011505 (0.3026672750711441) | > loss_0: 2.494419813156128 (2.7697561979293823) | > loss_gen: 2.3558647632598877 (2.227449893951416) | > loss_kl: 6.275398254394531 (5.934797525405884) | > loss_feat: 5.405776023864746 (5.789143085479736) | > loss_mel: 23.537046432495117 (23.3084716796875) | > loss_duration: 3.3114161491394043 (3.4568225145339966) | > loss_1: 40.885501861572266 (40.716684341430664)  --> STEP: 3 | > loss_disc: 3.032219409942627 (2.8572439352671304) | > loss_disc_real_0: 0.09663568437099457 (0.18559230864048004) | > loss_disc_real_1: 0.2502399682998657 (0.2429066002368927) | > loss_disc_real_2: 0.27568650245666504 (0.2799188296000163) | > loss_disc_real_3: 0.31559261679649353 (0.25294822454452515) | > loss_disc_real_4: 0.28412023186683655 (0.3413926561673482) | > loss_disc_real_5: 0.2996319830417633 (0.3016555110613505) | > loss_0: 3.032219409942627 (2.8572439352671304) | > loss_gen: 1.5825408697128296 (2.0124802192052207) | > loss_kl: 3.0697145462036133 (4.979769865671794) | > loss_feat: 1.2806962728500366 (4.286327481269836) | > loss_mel: 7.869815826416016 (18.16225306193034) | > loss_duration: 3.219933032989502 (3.377859354019165) | > loss_1: 17.0226993560791 (32.81868934631348) --> EVAL PERFORMANCE | > avg_loader_time: 0.01384894053141276 (+0.008922338485717773) | > avg_loss_disc: 2.8572439352671304 (+0.10711352030436183) | > avg_loss_disc_real_0: 0.18559230864048004 (-0.13202785948912305) | > avg_loss_disc_real_1: 0.2429066002368927 (-0.12192740043004352) | > avg_loss_disc_real_2: 0.2799188296000163 (-0.010820185144742311) | > avg_loss_disc_real_3: 0.25294822454452515 (-0.047074427207310976) | > avg_loss_disc_real_4: 0.3413926561673482 (+0.050452152887980106) | > avg_loss_disc_real_5: 0.3016555110613505 (+0.042305404941240965) | > avg_loss_0: 2.8572439352671304 (+0.10711352030436183) | > avg_loss_gen: 2.0124802192052207 (-0.519813815752665) | > avg_loss_kl: 4.979769865671794 (-0.43744579950968365) | > avg_loss_feat: 4.286327481269836 (-0.7972830533981323) | > avg_loss_mel: 18.16225306193034 (-7.36009089152018) | > avg_loss_duration: 3.377859354019165 (+0.03531646728515625) | > avg_loss_1: 32.81868934631348 (-9.079318364461265)  > EPOCH: 1284/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:30:00)   --> TIME: 2023-10-20 16:30:12 -- STEP: 9/50 -- GLOBAL_STEP: 117210 | > loss_disc: 2.97836971282959 (2.5114663574430676) | > loss_disc_real_0: 0.23575299978256226 (0.16347254833413494) | > loss_disc_real_1: 0.2333884984254837 (0.20703492975897259) | > loss_disc_real_2: 0.27496835589408875 (0.2415881488058302) | > loss_disc_real_3: 0.28567326068878174 (0.21983624001344046) | > loss_disc_real_4: 0.2635098099708557 (0.24165000311202472) | > loss_disc_real_5: 0.30813565850257874 (0.26790985382265514) | > loss_0: 2.97836971282959 (2.5114663574430676) | > grad_norm_0: tensor(946.1223, device='cuda:0') (tensor(614.7251, device='cuda:0')) | > loss_gen: 1.643857717514038 (2.3746518823835583) | > loss_kl: 0.7799570560455322 (0.9242128133773804) | > loss_feat: 0.20285256206989288 (5.758254052036339) | > loss_mel: 6.935514450073242 (18.326822135183548) | > loss_duration: 1.2695671319961548 (1.310468726687961) | > loss_1: 10.831748962402344 (28.694409794277615) | > grad_norm_1: tensor(14348.3574, device='cuda:0') (tensor(18272.7285, device='cuda:0')) | > current_lr_0: 5.5381029640993053e-05 | > current_lr_1: 5.543644183544763e-05 | > step_time: 0.8243 (0.6757644282446967) | > loader_time: 0.0273 (0.02121530638800727)  --> TIME: 2023-10-20 16:30:25 -- STEP: 39/50 -- GLOBAL_STEP: 117240 | > loss_disc: 3.166008472442627 (2.5300108072085257) | > loss_disc_real_0: 0.15455475449562073 (0.14381594497423905) | > loss_disc_real_1: 0.30210545659065247 (0.21974122103972313) | > loss_disc_real_2: 0.2742388844490051 (0.23139714373227876) | > loss_disc_real_3: 0.3198704123497009 (0.2426185953693512) | > loss_disc_real_4: 0.31826290488243103 (0.23640192882754865) | > loss_disc_real_5: 0.33586135506629944 (0.2386445857775517) | > loss_0: 3.166008472442627 (2.5300108072085257) | > grad_norm_0: tensor(568.2900, device='cuda:0') (tensor(568.2972, device='cuda:0')) | > loss_gen: 1.6756714582443237 (2.2168981906695246) | > loss_kl: 0.2642160654067993 (0.8128779656611954) | > loss_feat: 1.3908251523971558 (4.936258040941679) | > loss_mel: 6.229698657989502 (17.496823332248585) | > loss_duration: 1.360206961631775 (1.2953564509367332) | > loss_1: 10.920618057250977 (26.758213850168083) | > grad_norm_1: tensor(22269.1211, device='cuda:0') (tensor(20746.9512, device='cuda:0')) | > current_lr_0: 5.5381029640993053e-05 | > current_lr_1: 5.543644183544763e-05 | > step_time: 0.334 (0.4824109199719551) | > loader_time: 0.0041 (0.012580015720465246)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9022700786590576 (2.9022700786590576) | > loss_disc_real_0: 0.08358386904001236 (0.08358386904001236) | > loss_disc_real_1: 0.25604814291000366 (0.25604814291000366) | > loss_disc_real_2: 0.2845551669597626 (0.2845551669597626) | > loss_disc_real_3: 0.2599986493587494 (0.2599986493587494) | > loss_disc_real_4: 0.14550185203552246 (0.14550185203552246) | > loss_disc_real_5: 0.15769073367118835 (0.15769073367118835) | > loss_0: 2.9022700786590576 (2.9022700786590576) | > loss_gen: 1.4505488872528076 (1.4505488872528076) | > loss_kl: 6.025619983673096 (6.025619983673096) | > loss_feat: 1.861742615699768 (1.861742615699768) | > loss_mel: 19.449007034301758 (19.449007034301758) | > loss_duration: 3.13820219039917 (3.13820219039917) | > loss_1: 31.925119400024414 (31.925119400024414)  --> STEP: 1 | > loss_disc: 2.8687384128570557 (2.8687384128570557) | > loss_disc_real_0: 0.41602903604507446 (0.41602903604507446) | > loss_disc_real_1: 0.30589303374290466 (0.30589303374290466) | > loss_disc_real_2: 0.391704261302948 (0.391704261302948) | > loss_disc_real_3: 0.14684875309467316 (0.14684875309467316) | > loss_disc_real_4: 0.25870487093925476 (0.25870487093925476) | > loss_disc_real_5: 0.09954824298620224 (0.09954824298620224) | > loss_0: 2.8687384128570557 (2.8687384128570557) | > loss_gen: 2.320326328277588 (2.320326328277588) | > loss_kl: 5.978328227996826 (5.978328227996826) | > loss_feat: 7.914597511291504 (7.914597511291504) | > loss_mel: 22.572467803955078 (22.572467803955078) | > loss_duration: 3.4564859867095947 (3.4564859867095947) | > loss_1: 42.24220657348633 (42.24220657348633)  --> STEP: 2 | > loss_disc: 2.6667070388793945 (2.767722725868225) | > loss_disc_real_0: 0.2662631571292877 (0.3411460965871811) | > loss_disc_real_1: 0.22521433234214783 (0.26555368304252625) | > loss_disc_real_2: 0.24463754892349243 (0.3181709051132202) | > loss_disc_real_3: 0.21386538445949554 (0.18035706877708435) | > loss_disc_real_4: 0.23431673645973206 (0.2465108036994934) | > loss_disc_real_5: 0.14577892422676086 (0.12266358360648155) | > loss_0: 2.6667070388793945 (2.767722725868225) | > loss_gen: 1.8462769985198975 (2.0833016633987427) | > loss_kl: 6.286481857299805 (6.132405042648315) | > loss_feat: 2.0626935958862305 (4.988645553588867) | > loss_mel: 6.6278886795043945 (14.600178241729736) | > loss_duration: 3.3702340126037598 (3.4133599996566772) | > loss_1: 20.193574905395508 (31.217890739440918)  --> STEP: 3 | > loss_disc: 2.6790456771850586 (2.738163709640503) | > loss_disc_real_0: 0.18826210498809814 (0.29018476605415344) | > loss_disc_real_1: 0.28085577487945557 (0.2706543803215027) | > loss_disc_real_2: 0.19294136762619019 (0.2764277259508769) | > loss_disc_real_3: 0.3026161193847656 (0.22111008564631143) | > loss_disc_real_4: 0.25910118222236633 (0.25070759654045105) | > loss_disc_real_5: 0.17837269604206085 (0.14123328775167465) | > loss_0: 2.6790456771850586 (2.738163709640503) | > loss_gen: 1.9612959623336792 (2.0426330963770547) | > loss_kl: 2.83836030960083 (5.034390131632487) | > loss_feat: 1.830561876296997 (3.935950994491577) | > loss_mel: 7.113418102264404 (12.104591528574625) | > loss_duration: 3.044409990310669 (3.290376663208008) | > loss_1: 16.788047790527344 (26.40794308980306) --> EVAL PERFORMANCE | > avg_loader_time: 0.019009908040364582 (+0.005160967508951822) | > avg_loss_disc: 2.738163709640503 (-0.11908022562662746) | > avg_loss_disc_real_0: 0.29018476605415344 (+0.1045924574136734) | > avg_loss_disc_real_1: 0.2706543803215027 (+0.027747780084609985) | > avg_loss_disc_real_2: 0.2764277259508769 (-0.0034911036491394043) | > avg_loss_disc_real_3: 0.22111008564631143 (-0.031838138898213714) | > avg_loss_disc_real_4: 0.25070759654045105 (-0.09068505962689716) | > avg_loss_disc_real_5: 0.14123328775167465 (-0.16042222330967587) | > avg_loss_0: 2.738163709640503 (-0.11908022562662746) | > avg_loss_gen: 2.0426330963770547 (+0.030152877171834014) | > avg_loss_kl: 5.034390131632487 (+0.05462026596069336) | > avg_loss_feat: 3.935950994491577 (-0.3503764867782593) | > avg_loss_mel: 12.104591528574625 (-6.057661533355715) | > avg_loss_duration: 3.290376663208008 (-0.08748269081115723) | > avg_loss_1: 26.40794308980306 (-6.410746256510418)  > EPOCH: 1285/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:30:46)   --> TIME: 2023-10-20 16:31:06 -- STEP: 19/50 -- GLOBAL_STEP: 117270 | > loss_disc: 2.220148801803589 (2.576035970135739) | > loss_disc_real_0: 0.2250516414642334 (0.1590330936504822) | > loss_disc_real_1: 0.12393447011709213 (0.23156540860470973) | > loss_disc_real_2: 0.13837647438049316 (0.24443251051400838) | > loss_disc_real_3: 0.22239482402801514 (0.24827258406501068) | > loss_disc_real_4: 0.13216917216777802 (0.22643090549268222) | > loss_disc_real_5: 0.10718458145856857 (0.2061393413398611) | > loss_0: 2.220148801803589 (2.576035970135739) | > grad_norm_0: tensor(682.6900, device='cuda:0') (tensor(599.6572, device='cuda:0')) | > loss_gen: 2.0386147499084473 (2.1891750724692094) | > loss_kl: 0.5300843715667725 (0.7894094372658353) | > loss_feat: 6.466443061828613 (5.17857458403236) | > loss_mel: 25.4644718170166 (19.992333161203486) | > loss_duration: 1.398558497428894 (1.3286725533635992) | > loss_1: 35.89817428588867 (29.478164221111097) | > grad_norm_1: tensor(7476.2085, device='cuda:0') (tensor(17238.3594, device='cuda:0')) | > current_lr_0: 5.532567283449615e-05 | > current_lr_1: 5.5381029640993053e-05 | > step_time: 0.5149 (0.6243332687177156) | > loader_time: 0.0018 (0.018515762529875104)  --> TIME: 2023-10-20 16:31:23 -- STEP: 49/50 -- GLOBAL_STEP: 117300 | > loss_disc: 2.5042972564697266 (2.560469150543212) | > loss_disc_real_0: 0.11282657086849213 (0.14485859846202082) | > loss_disc_real_1: 0.18854445219039917 (0.2249785562102892) | > loss_disc_real_2: 0.22077034413814545 (0.23620607536666247) | > loss_disc_real_3: 0.3683713674545288 (0.23961884718464346) | > loss_disc_real_4: 0.19193074107170105 (0.23542179750772763) | > loss_disc_real_5: 0.25496527552604675 (0.21063512227288922) | > loss_0: 2.5042972564697266 (2.560469150543212) | > grad_norm_0: tensor(742.1273, device='cuda:0') (tensor(600.3280, device='cuda:0')) | > loss_gen: 2.1487112045288086 (2.165733142774932) | > loss_kl: 0.28499770164489746 (0.7071931711112966) | > loss_feat: 3.6197257041931152 (5.377724497369965) | > loss_mel: 18.662019729614258 (19.538751795583845) | > loss_duration: 1.3726227283477783 (1.3033414689861997) | > loss_1: 26.088077545166016 (29.092743961178527) | > grad_norm_1: tensor(5885.3892, device='cuda:0') (tensor(17505.9551, device='cuda:0')) | > current_lr_0: 5.532567283449615e-05 | > current_lr_1: 5.5381029640993053e-05 | > step_time: 0.4702 (0.5675600645493488) | > loader_time: 0.4108 (0.024747522509827907)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.150033473968506 (3.150033473968506) | > loss_disc_real_0: 0.39985769987106323 (0.39985769987106323) | > loss_disc_real_1: 0.25950518250465393 (0.25950518250465393) | > loss_disc_real_2: 0.3977096676826477 (0.3977096676826477) | > loss_disc_real_3: 0.3417908549308777 (0.3417908549308777) | > loss_disc_real_4: 0.35279613733291626 (0.35279613733291626) | > loss_disc_real_5: 0.33068951964378357 (0.33068951964378357) | > loss_0: 3.150033473968506 (3.150033473968506) | > loss_gen: 2.221651792526245 (2.221651792526245) | > loss_kl: 6.6613616943359375 (6.6613616943359375) | > loss_feat: 2.706345558166504 (2.706345558166504) | > loss_mel: 22.79492950439453 (22.79492950439453) | > loss_duration: 3.111137628555298 (3.111137628555298) | > loss_1: 37.495426177978516 (37.495426177978516)  --> STEP: 1 | > loss_disc: 2.9695820808410645 (2.9695820808410645) | > loss_disc_real_0: 0.3185783624649048 (0.3185783624649048) | > loss_disc_real_1: 0.25141850113868713 (0.25141850113868713) | > loss_disc_real_2: 0.24728310108184814 (0.24728310108184814) | > loss_disc_real_3: 0.26192840933799744 (0.26192840933799744) | > loss_disc_real_4: 0.2602386474609375 (0.2602386474609375) | > loss_disc_real_5: 0.23902930319309235 (0.23902930319309235) | > loss_0: 2.9695820808410645 (2.9695820808410645) | > loss_gen: 1.631670594215393 (1.631670594215393) | > loss_kl: 5.914276123046875 (5.914276123046875) | > loss_feat: 0.13887566328048706 (0.13887566328048706) | > loss_mel: 9.425459861755371 (9.425459861755371) | > loss_duration: 3.515610456466675 (3.515610456466675) | > loss_1: 20.625890731811523 (20.625890731811523)  --> STEP: 2 | > loss_disc: 2.904247760772705 (2.9369149208068848) | > loss_disc_real_0: 0.23318135738372803 (0.2758798599243164) | > loss_disc_real_1: 0.260539710521698 (0.25597910583019257) | > loss_disc_real_2: 0.3213309943675995 (0.2843070477247238) | > loss_disc_real_3: 0.34730052947998047 (0.30461446940898895) | > loss_disc_real_4: 0.2833428978919983 (0.2717907726764679) | > loss_disc_real_5: 0.26572418212890625 (0.2523767426609993) | > loss_0: 2.904247760772705 (2.9369149208068848) | > loss_gen: 2.030228853225708 (1.8309497237205505) | > loss_kl: 6.181715488433838 (6.0479958057403564) | > loss_feat: 1.4701086282730103 (0.8044921457767487) | > loss_mel: 19.141942977905273 (14.283701419830322) | > loss_duration: 3.3098978996276855 (3.41275417804718) | > loss_1: 32.13389205932617 (26.379891395568848)  --> STEP: 3 | > loss_disc: 2.861804723739624 (2.9118781884511313) | > loss_disc_real_0: 0.43003717064857483 (0.3272656301657359) | > loss_disc_real_1: 0.3296201229095459 (0.28052611152331036) | > loss_disc_real_2: 0.3964114487171173 (0.321675181388855) | > loss_disc_real_3: 0.4775761663913727 (0.3622683684031169) | > loss_disc_real_4: 0.26712095737457275 (0.2702341675758362) | > loss_disc_real_5: 0.21745407581329346 (0.240735853711764) | > loss_0: 2.861804723739624 (2.9118781884511313) | > loss_gen: 2.9277687072753906 (2.196556051572164) | > loss_kl: 2.874274730682373 (4.990088780721028) | > loss_feat: 4.441619873046875 (2.0168680548667908) | > loss_mel: 21.362903594970703 (16.64343547821045) | > loss_duration: 3.052260160446167 (3.2925895055135093) | > loss_1: 34.65882873535156 (29.139537175496418) --> EVAL PERFORMANCE | > avg_loader_time: 0.019688526789347332 (+0.0006786187489827497) | > avg_loss_disc: 2.9118781884511313 (+0.1737144788106284) | > avg_loss_disc_real_0: 0.3272656301657359 (+0.03708086411158246) | > avg_loss_disc_real_1: 0.28052611152331036 (+0.009871731201807676) | > avg_loss_disc_real_2: 0.321675181388855 (+0.04524745543797809) | > avg_loss_disc_real_3: 0.3622683684031169 (+0.14115828275680545) | > avg_loss_disc_real_4: 0.2702341675758362 (+0.019526571035385132) | > avg_loss_disc_real_5: 0.240735853711764 (+0.09950256596008936) | > avg_loss_0: 2.9118781884511313 (+0.1737144788106284) | > avg_loss_gen: 2.196556051572164 (+0.15392295519510935) | > avg_loss_kl: 4.990088780721028 (-0.044301350911458925) | > avg_loss_feat: 2.0168680548667908 (-1.9190829396247864) | > avg_loss_mel: 16.64343547821045 (+4.538843949635824) | > avg_loss_duration: 3.2925895055135093 (+0.00221284230550145) | > avg_loss_1: 29.139537175496418 (+2.7315940856933594)  > EPOCH: 1286/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:31:37)   --> TIME: 2023-10-20 16:31:58 -- STEP: 29/50 -- GLOBAL_STEP: 117330 | > loss_disc: 1.5985240936279297 (2.395080307434345) | > loss_disc_real_0: 0.03460761159658432 (0.13343120937974287) | > loss_disc_real_1: 0.12850724160671234 (0.21591010856731185) | > loss_disc_real_2: 0.10637445747852325 (0.21279896230533205) | > loss_disc_real_3: 0.1188526526093483 (0.22563368223350624) | > loss_disc_real_4: 0.08236422389745712 (0.2178511200793858) | > loss_disc_real_5: 0.10215183347463608 (0.23182061854107627) | > loss_0: 1.5985240936279297 (2.395080307434345) | > grad_norm_0: tensor(443.6813, device='cuda:0') (tensor(552.9106, device='cuda:0')) | > loss_gen: 2.4042882919311523 (2.326211222286882) | > loss_kl: 0.5309329032897949 (0.7711149084156957) | > loss_feat: 8.656352996826172 (6.212032262364338) | > loss_mel: 23.164413452148438 (21.42707631505769) | > loss_duration: 1.2311978340148926 (1.2966823372347605) | > loss_1: 35.987186431884766 (32.03311739296749) | > grad_norm_1: tensor(6225.0098, device='cuda:0') (tensor(11100.5498, device='cuda:0')) | > current_lr_0: 5.5270371360593194e-05 | > current_lr_1: 5.532567283449615e-05 | > step_time: 0.5742 (0.5301409260980015) | > loader_time: 0.0018 (0.01288006223481277)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4477880001068115 (2.4477880001068115) | > loss_disc_real_0: 0.33998772501945496 (0.33998772501945496) | > loss_disc_real_1: 0.37521088123321533 (0.37521088123321533) | > loss_disc_real_2: 0.4578239619731903 (0.4578239619731903) | > loss_disc_real_3: 0.21418583393096924 (0.21418583393096924) | > loss_disc_real_4: 0.2923542857170105 (0.2923542857170105) | > loss_disc_real_5: 0.18278735876083374 (0.18278735876083374) | > loss_0: 2.4477880001068115 (2.4477880001068115) | > loss_gen: 3.2903199195861816 (3.2903199195861816) | > loss_kl: 6.695276737213135 (6.695276737213135) | > loss_feat: 6.310575485229492 (6.310575485229492) | > loss_mel: 25.454914093017578 (25.454914093017578) | > loss_duration: 3.1795005798339844 (3.1795005798339844) | > loss_1: 44.93058776855469 (44.93058776855469)  --> STEP: 1 | > loss_disc: 3.1403369903564453 (3.1403369903564453) | > loss_disc_real_0: 0.6321328282356262 (0.6321328282356262) | > loss_disc_real_1: 0.2952902615070343 (0.2952902615070343) | > loss_disc_real_2: 0.3491741120815277 (0.3491741120815277) | > loss_disc_real_3: 0.10574746131896973 (0.10574746131896973) | > loss_disc_real_4: 0.2823566496372223 (0.2823566496372223) | > loss_disc_real_5: 0.26859697699546814 (0.26859697699546814) | > loss_0: 3.1403369903564453 (3.1403369903564453) | > loss_gen: 2.508986473083496 (2.508986473083496) | > loss_kl: 6.012914657592773 (6.012914657592773) | > loss_feat: 6.111196994781494 (6.111196994781494) | > loss_mel: 24.527576446533203 (24.527576446533203) | > loss_duration: 3.5250587463378906 (3.5250587463378906) | > loss_1: 42.685733795166016 (42.685733795166016)  --> STEP: 2 | > loss_disc: 3.080962896347046 (3.1106499433517456) | > loss_disc_real_0: 0.3116459846496582 (0.4718894064426422) | > loss_disc_real_1: 0.31387925148010254 (0.3045847564935684) | > loss_disc_real_2: 0.3046032786369324 (0.32688869535923004) | > loss_disc_real_3: 0.25755515694618225 (0.181651309132576) | > loss_disc_real_4: 0.26934120059013367 (0.275848925113678) | > loss_disc_real_5: 0.2311127483844757 (0.24985486268997192) | > loss_0: 3.080962896347046 (3.1106499433517456) | > loss_gen: 1.7739391326904297 (2.141462802886963) | > loss_kl: 6.569179058074951 (6.291046857833862) | > loss_feat: 2.425966739654541 (4.268581867218018) | > loss_mel: 25.449787139892578 (24.98868179321289) | > loss_duration: 3.43211030960083 (3.4785845279693604) | > loss_1: 39.65098190307617 (41.168357849121094)  --> STEP: 3 | > loss_disc: 2.807427406311035 (3.0095757643381753) | > loss_disc_real_0: 0.4738265573978424 (0.4725351234277089) | > loss_disc_real_1: 0.24909798800945282 (0.2860891669988632) | > loss_disc_real_2: 0.2637270390987396 (0.3058348099390666) | > loss_disc_real_3: 0.2451549470424652 (0.2028191884358724) | > loss_disc_real_4: 0.2545313239097595 (0.26874305804570514) | > loss_disc_real_5: 0.2282567173242569 (0.24265548090140024) | > loss_0: 2.807427406311035 (3.0095757643381753) | > loss_gen: 2.245065689086914 (2.1759970982869468) | > loss_kl: 3.2045493125915527 (5.262214342753093) | > loss_feat: 1.5019850730895996 (3.3463829358418784) | > loss_mel: 17.36370849609375 (22.44702402750651) | > loss_duration: 3.1548855304718018 (3.370684862136841) | > loss_1: 27.470195770263672 (36.60230382283529) --> EVAL PERFORMANCE | > avg_loader_time: 0.015578031539916992 (-0.00411049524943034) | > avg_loss_disc: 3.0095757643381753 (+0.09769757588704397) | > avg_loss_disc_real_0: 0.4725351234277089 (+0.14526949326197303) | > avg_loss_disc_real_1: 0.2860891669988632 (+0.005563055475552858) | > avg_loss_disc_real_2: 0.3058348099390666 (-0.015840371449788393) | > avg_loss_disc_real_3: 0.2028191884358724 (-0.15944917996724448) | > avg_loss_disc_real_4: 0.26874305804570514 (-0.0014911095301310406) | > avg_loss_disc_real_5: 0.24265548090140024 (+0.0019196271896362305) | > avg_loss_0: 3.0095757643381753 (+0.09769757588704397) | > avg_loss_gen: 2.1759970982869468 (-0.020558953285217285) | > avg_loss_kl: 5.262214342753093 (+0.2721255620320644) | > avg_loss_feat: 3.3463829358418784 (+1.3295148809750876) | > avg_loss_mel: 22.44702402750651 (+5.803588549296062) | > avg_loss_duration: 3.370684862136841 (+0.07809535662333156) | > avg_loss_1: 36.60230382283529 (+7.462766647338871)  > EPOCH: 1287/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:32:18)   --> TIME: 2023-10-20 16:32:28 -- STEP: 9/50 -- GLOBAL_STEP: 117360 | > loss_disc: 2.8429031372070312 (2.3082636064953275) | > loss_disc_real_0: 0.09715079516172409 (0.15552351189156374) | > loss_disc_real_1: 0.37112993001937866 (0.23066875835259756) | > loss_disc_real_2: 0.2285042256116867 (0.18081395348740947) | > loss_disc_real_3: 0.3010942041873932 (0.22706037883957228) | > loss_disc_real_4: 0.2840239405632019 (0.19131561741232872) | > loss_disc_real_5: 0.19818483293056488 (0.17297462053183052) | > loss_0: 2.8429031372070312 (2.3082636064953275) | > grad_norm_0: tensor(790.0288, device='cuda:0') (tensor(723.9512, device='cuda:0')) | > loss_gen: 2.1279783248901367 (2.3646415604485407) | > loss_kl: 0.801257848739624 (0.8671867516305711) | > loss_feat: 4.9622602462768555 (6.39449009547631) | > loss_mel: 20.27911376953125 (20.22689284218682) | > loss_duration: 1.3156734704971313 (1.3062739902072482) | > loss_1: 29.486286163330078 (31.159485816955566) | > grad_norm_1: tensor(7728.5654, device='cuda:0') (tensor(17815.4883, device='cuda:0')) | > current_lr_0: 5.5215125163975795e-05 | > current_lr_1: 5.5270371360593194e-05 | > step_time: 0.6761 (0.596749464670817) | > loader_time: 0.0128 (0.02191472053527832)  --> TIME: 2023-10-20 16:32:47 -- STEP: 39/50 -- GLOBAL_STEP: 117390 | > loss_disc: 2.980210304260254 (2.4323496787976) | > loss_disc_real_0: 0.2643856406211853 (0.14292727907498676) | > loss_disc_real_1: 0.2548154592514038 (0.22573082416485518) | > loss_disc_real_2: 0.2676498591899872 (0.22193661441978735) | > loss_disc_real_3: 0.24909436702728271 (0.22700165508267206) | > loss_disc_real_4: 0.24127408862113953 (0.230912788078571) | > loss_disc_real_5: 0.27204087376594543 (0.2038508584149755) | > loss_0: 2.980210304260254 (2.4323496787976) | > grad_norm_0: tensor(976.2149, device='cuda:0') (tensor(681.4938, device='cuda:0')) | > loss_gen: 1.634211540222168 (2.262482117383908) | > loss_kl: 0.6881848573684692 (0.8271332642970941) | > loss_feat: 0.05946745350956917 (5.548475355196459) | > loss_mel: 1.499158501625061 (19.15155987556164) | > loss_duration: 1.3670578002929688 (1.2996536095937092) | > loss_1: 5.248080253601074 (29.089304202642197) | > grad_norm_1: tensor(54900.8672, device='cuda:0') (tensor(16679.5020, device='cuda:0')) | > current_lr_0: 5.5215125163975795e-05 | > current_lr_1: 5.5270371360593194e-05 | > step_time: 0.4113 (0.6112913168393649) | > loader_time: 0.0028 (0.02164458005856245)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8880324363708496 (2.8880324363708496) | > loss_disc_real_0: 0.2888016998767853 (0.2888016998767853) | > loss_disc_real_1: 0.19874495267868042 (0.19874495267868042) | > loss_disc_real_2: 0.28431436419487 (0.28431436419487) | > loss_disc_real_3: 0.2418593317270279 (0.2418593317270279) | > loss_disc_real_4: 0.3141251504421234 (0.3141251504421234) | > loss_disc_real_5: 0.48947688937187195 (0.48947688937187195) | > loss_0: 2.8880324363708496 (2.8880324363708496) | > loss_gen: 2.376620054244995 (2.376620054244995) | > loss_kl: 5.33528995513916 (5.33528995513916) | > loss_feat: 5.574077129364014 (5.574077129364014) | > loss_mel: 19.388507843017578 (19.388507843017578) | > loss_duration: 3.091733694076538 (3.091733694076538) | > loss_1: 35.76622772216797 (35.76622772216797)  --> STEP: 1 | > loss_disc: 3.060837745666504 (3.060837745666504) | > loss_disc_real_0: 0.402166485786438 (0.402166485786438) | > loss_disc_real_1: 0.18510673940181732 (0.18510673940181732) | > loss_disc_real_2: 0.3313252329826355 (0.3313252329826355) | > loss_disc_real_3: 0.2389526516199112 (0.2389526516199112) | > loss_disc_real_4: 0.30946728587150574 (0.30946728587150574) | > loss_disc_real_5: 0.3883708417415619 (0.3883708417415619) | > loss_0: 3.060837745666504 (3.060837745666504) | > loss_gen: 2.0008063316345215 (2.0008063316345215) | > loss_kl: 5.532233238220215 (5.532233238220215) | > loss_feat: 5.396965980529785 (5.396965980529785) | > loss_mel: 23.005481719970703 (23.005481719970703) | > loss_duration: 3.549103021621704 (3.549103021621704) | > loss_1: 39.484588623046875 (39.484588623046875)  --> STEP: 2 | > loss_disc: 2.7509548664093018 (2.905896306037903) | > loss_disc_real_0: 0.09351882338523865 (0.24784265458583832) | > loss_disc_real_1: 0.32961684465408325 (0.2573617920279503) | > loss_disc_real_2: 0.2682272791862488 (0.29977625608444214) | > loss_disc_real_3: 0.3758275806903839 (0.30739011615514755) | > loss_disc_real_4: 0.26726970076560974 (0.28836849331855774) | > loss_disc_real_5: 0.48043468594551086 (0.4344027638435364) | > loss_0: 2.7509548664093018 (2.905896306037903) | > loss_gen: 2.65916109085083 (2.329983711242676) | > loss_kl: 6.605378150939941 (6.068805694580078) | > loss_feat: 6.841641426086426 (6.1193037033081055) | > loss_mel: 21.723907470703125 (22.364694595336914) | > loss_duration: 3.3548545837402344 (3.4519788026809692) | > loss_1: 41.18494415283203 (40.33476638793945)  --> STEP: 3 | > loss_disc: 2.948660373687744 (2.9201509952545166) | > loss_disc_real_0: 0.27250951528549194 (0.25606494148572284) | > loss_disc_real_1: 0.23213163018226624 (0.24895173807938895) | > loss_disc_real_2: 0.2249797135591507 (0.27484407524267834) | > loss_disc_real_3: 0.25519222021102905 (0.28999081750710803) | > loss_disc_real_4: 0.24581778049468994 (0.2741849223772685) | > loss_disc_real_5: 0.3144383430480957 (0.39441462357838947) | > loss_0: 2.948660373687744 (2.9201509952545166) | > loss_gen: 1.6135268211364746 (2.091164747873942) | > loss_kl: 2.763490915298462 (4.967034101486206) | > loss_feat: 0.4256736934185028 (4.221427033344905) | > loss_mel: 8.149787902832031 (17.626392364501953) | > loss_duration: 3.0552871227264404 (3.3197482426961265) | > loss_1: 16.007766723632812 (32.22576649983724) --> EVAL PERFORMANCE | > avg_loader_time: 0.004479726155598958 (-0.011098305384318035) | > avg_loss_disc: 2.9201509952545166 (-0.0894247690836587) | > avg_loss_disc_real_0: 0.25606494148572284 (-0.21647018194198608) | > avg_loss_disc_real_1: 0.24895173807938895 (-0.037137428919474275) | > avg_loss_disc_real_2: 0.27484407524267834 (-0.030990734696388245) | > avg_loss_disc_real_3: 0.28999081750710803 (+0.08717162907123563) | > avg_loss_disc_real_4: 0.2741849223772685 (+0.005441864331563351) | > avg_loss_disc_real_5: 0.39441462357838947 (+0.15175914267698923) | > avg_loss_0: 2.9201509952545166 (-0.0894247690836587) | > avg_loss_gen: 2.091164747873942 (-0.08483235041300485) | > avg_loss_kl: 4.967034101486206 (-0.2951802412668867) | > avg_loss_feat: 4.221427033344905 (+0.8750440975030265) | > avg_loss_mel: 17.626392364501953 (-4.8206316630045585) | > avg_loss_duration: 3.3197482426961265 (-0.05093661944071437) | > avg_loss_1: 32.22576649983724 (-4.376537322998047)  > EPOCH: 1288/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:33:08)   --> TIME: 2023-10-20 16:33:24 -- STEP: 19/50 -- GLOBAL_STEP: 117420 | > loss_disc: 2.375903606414795 (2.6441229205382495) | > loss_disc_real_0: 0.05491010844707489 (0.16836760369570633) | > loss_disc_real_1: 0.14945177733898163 (0.22521641262267766) | > loss_disc_real_2: 0.21245329082012177 (0.23783077181954132) | > loss_disc_real_3: 0.2658199667930603 (0.24041860236933357) | > loss_disc_real_4: 0.26260387897491455 (0.2343335649684856) | > loss_disc_real_5: 0.17728975415229797 (0.22202827781438828) | > loss_0: 2.375903606414795 (2.6441229205382495) | > grad_norm_0: tensor(359.6336, device='cuda:0') (tensor(761.1154, device='cuda:0')) | > loss_gen: 2.2496418952941895 (2.045400901844627) | > loss_kl: 0.8480740189552307 (0.721763634367993) | > loss_feat: 7.002765655517578 (4.572562196144932) | > loss_mel: 22.374553680419922 (17.00599399993294) | > loss_duration: 1.3794116973876953 (1.3310340893896002) | > loss_1: 33.85444641113281 (25.6767547758002) | > grad_norm_1: tensor(5470.9214, device='cuda:0') (tensor(20529.2773, device='cuda:0')) | > current_lr_0: 5.515993418939085e-05 | > current_lr_1: 5.5215125163975795e-05 | > step_time: 0.8023 (0.49606512722216156) | > loader_time: 0.0433 (0.01984914980436626)  --> TIME: 2023-10-20 16:33:38 -- STEP: 49/50 -- GLOBAL_STEP: 117450 | > loss_disc: 2.7009756565093994 (2.60679896267093) | > loss_disc_real_0: 0.08216983079910278 (0.1695354140116548) | > loss_disc_real_1: 0.29400548338890076 (0.22917849083944242) | > loss_disc_real_2: 0.31282851099967957 (0.22863423930747168) | > loss_disc_real_3: 0.25114190578460693 (0.2411552476791703) | > loss_disc_real_4: 0.28022006154060364 (0.23459910031179992) | > loss_disc_real_5: 0.3083932399749756 (0.2219821230641433) | > loss_0: 2.7009756565093994 (2.60679896267093) | > grad_norm_0: tensor(676.3206, device='cuda:0') (tensor(733.6347, device='cuda:0')) | > loss_gen: 2.0304207801818848 (2.0473414562186423) | > loss_kl: 0.36080285906791687 (0.7597374228798613) | > loss_feat: 1.4375101327896118 (4.268719832355878) | > loss_mel: 17.580341339111328 (16.829726928350876) | > loss_duration: 1.4177100658416748 (1.2961002332823615) | > loss_1: 22.826784133911133 (25.201625687735422) | > grad_norm_1: tensor(3030.2402, device='cuda:0') (tensor(18846.5586, device='cuda:0')) | > current_lr_0: 5.515993418939085e-05 | > current_lr_1: 5.5215125163975795e-05 | > step_time: 0.2688 (0.45138503094108723) | > loader_time: 0.3876 (0.0216499104791758)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.351351261138916 (3.351351261138916) | > loss_disc_real_0: 0.4937394857406616 (0.4937394857406616) | > loss_disc_real_1: 0.22508513927459717 (0.22508513927459717) | > loss_disc_real_2: 0.30533406138420105 (0.30533406138420105) | > loss_disc_real_3: 0.26031294465065 (0.26031294465065) | > loss_disc_real_4: 0.28997576236724854 (0.28997576236724854) | > loss_disc_real_5: 0.4946683943271637 (0.4946683943271637) | > loss_0: 3.351351261138916 (3.351351261138916) | > loss_gen: 2.2640435695648193 (2.2640435695648193) | > loss_kl: 5.4551005363464355 (5.4551005363464355) | > loss_feat: 5.273386478424072 (5.273386478424072) | > loss_mel: 25.473913192749023 (25.473913192749023) | > loss_duration: 3.171746015548706 (3.171746015548706) | > loss_1: 41.638187408447266 (41.638187408447266)  --> STEP: 1 | > loss_disc: 2.8316123485565186 (2.8316123485565186) | > loss_disc_real_0: 0.49228569865226746 (0.49228569865226746) | > loss_disc_real_1: 0.23686781525611877 (0.23686781525611877) | > loss_disc_real_2: 0.21390029788017273 (0.21390029788017273) | > loss_disc_real_3: 0.28583627939224243 (0.28583627939224243) | > loss_disc_real_4: 0.27013006806373596 (0.27013006806373596) | > loss_disc_real_5: 0.27823013067245483 (0.27823013067245483) | > loss_0: 2.8316123485565186 (2.8316123485565186) | > loss_gen: 2.3175647258758545 (2.3175647258758545) | > loss_kl: 5.342008113861084 (5.342008113861084) | > loss_feat: 1.3795843124389648 (1.3795843124389648) | > loss_mel: 17.99093246459961 (17.99093246459961) | > loss_duration: 3.5803756713867188 (3.5803756713867188) | > loss_1: 30.610464096069336 (30.610464096069336)  --> STEP: 2 | > loss_disc: 2.0918235778808594 (2.461717963218689) | > loss_disc_real_0: 0.25668585300445557 (0.3744857758283615) | > loss_disc_real_1: 0.04753638431429863 (0.1422020997852087) | > loss_disc_real_2: 0.22031936049461365 (0.2171098291873932) | > loss_disc_real_3: 0.1850019246339798 (0.23541910201311111) | > loss_disc_real_4: 0.19209466874599457 (0.23111236840486526) | > loss_disc_real_5: 0.10128818452358246 (0.18975915759801865) | > loss_0: 2.0918235778808594 (2.461717963218689) | > loss_gen: 2.5542075634002686 (2.4358861446380615) | > loss_kl: 6.5998430252075195 (5.970925569534302) | > loss_feat: 13.358394622802734 (7.36898946762085) | > loss_mel: 23.513107299804688 (20.75201988220215) | > loss_duration: 3.386420249938965 (3.483397960662842) | > loss_1: 49.41197204589844 (40.01121807098389)  --> STEP: 3 | > loss_disc: 3.0089802742004395 (2.644138733545939) | > loss_disc_real_0: 0.4035321772098541 (0.3841679096221924) | > loss_disc_real_1: 0.3207172453403473 (0.20170714830358824) | > loss_disc_real_2: 0.31749987602233887 (0.25057317813237506) | > loss_disc_real_3: 0.2959952652454376 (0.2556111564238866) | > loss_disc_real_4: 0.2998802661895752 (0.25403500099976856) | > loss_disc_real_5: 0.36651796102523804 (0.2486787587404251) | > loss_0: 3.0089802742004395 (2.644138733545939) | > loss_gen: 2.665760040283203 (2.5125107765197754) | > loss_kl: 2.920452117919922 (4.954101085662842) | > loss_feat: 2.6225738525390625 (5.786850929260254) | > loss_mel: 18.651866912841797 (20.051968892415363) | > loss_duration: 3.111225128173828 (3.3593403498331704) | > loss_1: 29.971878051757812 (36.66477139790853) --> EVAL PERFORMANCE | > avg_loader_time: 0.0027801195780436196 (-0.0016996065775553384) | > avg_loss_disc: 2.644138733545939 (-0.2760122617085776) | > avg_loss_disc_real_0: 0.3841679096221924 (+0.12810296813646954) | > avg_loss_disc_real_1: 0.20170714830358824 (-0.047244589775800705) | > avg_loss_disc_real_2: 0.25057317813237506 (-0.02427089711030328) | > avg_loss_disc_real_3: 0.2556111564238866 (-0.034379661083221436) | > avg_loss_disc_real_4: 0.25403500099976856 (-0.020149921377499935) | > avg_loss_disc_real_5: 0.2486787587404251 (-0.14573586483796436) | > avg_loss_0: 2.644138733545939 (-0.2760122617085776) | > avg_loss_gen: 2.5125107765197754 (+0.4213460286458335) | > avg_loss_kl: 4.954101085662842 (-0.012933015823364258) | > avg_loss_feat: 5.786850929260254 (+1.565423895915349) | > avg_loss_mel: 20.051968892415363 (+2.4255765279134103) | > avg_loss_duration: 3.3593403498331704 (+0.039592107137043975) | > avg_loss_1: 36.66477139790853 (+4.439004898071289)  > EPOCH: 1289/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:33:56)   --> TIME: 2023-10-20 16:34:21 -- STEP: 29/50 -- GLOBAL_STEP: 117480 | > loss_disc: 2.7144267559051514 (2.5352223782703796) | > loss_disc_real_0: 0.23059359192848206 (0.14723751857748318) | > loss_disc_real_1: 0.2545933425426483 (0.23384929313484965) | > loss_disc_real_2: 0.215849831700325 (0.22754891473671485) | > loss_disc_real_3: 0.24926061928272247 (0.2512549773372453) | > loss_disc_real_4: 0.23804831504821777 (0.22932483127404904) | > loss_disc_real_5: 0.26390936970710754 (0.23355713602283906) | > loss_0: 2.7144267559051514 (2.5352223782703796) | > grad_norm_0: tensor(632.8749, device='cuda:0') (tensor(639.2667, device='cuda:0')) | > loss_gen: 1.8207074403762817 (2.1992210067551716) | > loss_kl: 0.6082720160484314 (0.7988516672931868) | > loss_feat: 1.0508790016174316 (5.201188837017479) | > loss_mel: 14.935113906860352 (18.57868781994129) | > loss_duration: 1.2744176387786865 (1.310999874410958) | > loss_1: 19.689390182495117 (28.08894920349121) | > grad_norm_1: tensor(4354.3911, device='cuda:0') (tensor(23395.3770, device='cuda:0')) | > current_lr_0: 5.510479838164047e-05 | > current_lr_1: 5.515993418939085e-05 | > step_time: 0.7591 (0.6529112437675738) | > loader_time: 0.024 (0.02491140365600586)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.294313430786133 (3.294313430786133) | > loss_disc_real_0: 0.42861825227737427 (0.42861825227737427) | > loss_disc_real_1: 0.25650420784950256 (0.25650420784950256) | > loss_disc_real_2: 0.32141757011413574 (0.32141757011413574) | > loss_disc_real_3: 0.3664611577987671 (0.3664611577987671) | > loss_disc_real_4: 0.3150513470172882 (0.3150513470172882) | > loss_disc_real_5: 0.45109114050865173 (0.45109114050865173) | > loss_0: 3.294313430786133 (3.294313430786133) | > loss_gen: 2.2235007286071777 (2.2235007286071777) | > loss_kl: 5.059218406677246 (5.059218406677246) | > loss_feat: 5.29508113861084 (5.29508113861084) | > loss_mel: 24.18369483947754 (24.18369483947754) | > loss_duration: 3.083677291870117 (3.083677291870117) | > loss_1: 39.84516906738281 (39.84516906738281)  --> STEP: 1 | > loss_disc: 3.12984037399292 (3.12984037399292) | > loss_disc_real_0: 0.2864821255207062 (0.2864821255207062) | > loss_disc_real_1: 0.26858556270599365 (0.26858556270599365) | > loss_disc_real_2: 0.3268614411354065 (0.3268614411354065) | > loss_disc_real_3: 0.30657240748405457 (0.30657240748405457) | > loss_disc_real_4: 0.4014551341533661 (0.4014551341533661) | > loss_disc_real_5: 0.41205450892448425 (0.41205450892448425) | > loss_0: 3.12984037399292 (3.12984037399292) | > loss_gen: 2.0922513008117676 (2.0922513008117676) | > loss_kl: 5.409201622009277 (5.409201622009277) | > loss_feat: 5.481417179107666 (5.481417179107666) | > loss_mel: 22.758216857910156 (22.758216857910156) | > loss_duration: 3.550266981124878 (3.550266981124878) | > loss_1: 39.291351318359375 (39.291351318359375)  --> STEP: 2 | > loss_disc: 3.069155693054199 (3.0994980335235596) | > loss_disc_real_0: 0.24262955784797668 (0.26455584168434143) | > loss_disc_real_1: 0.26291200518608093 (0.2657487839460373) | > loss_disc_real_2: 0.2682968080043793 (0.2975791245698929) | > loss_disc_real_3: 0.21079890429973602 (0.2586856558918953) | > loss_disc_real_4: 0.45633095502853394 (0.42889304459095) | > loss_disc_real_5: 0.31495583057403564 (0.36350516974925995) | > loss_0: 3.069155693054199 (3.0994980335235596) | > loss_gen: 1.949342966079712 (2.0207971334457397) | > loss_kl: 6.476461887359619 (5.942831754684448) | > loss_feat: 3.848151922225952 (4.664784550666809) | > loss_mel: 11.02726936340332 (16.89274311065674) | > loss_duration: 3.3434500694274902 (3.446858525276184) | > loss_1: 26.644676208496094 (32.968013763427734)  --> STEP: 3 | > loss_disc: 2.3419649600982666 (2.846987009048462) | > loss_disc_real_0: 0.12635508179664612 (0.21848892172177634) | > loss_disc_real_1: 0.32713136076927185 (0.2862096428871155) | > loss_disc_real_2: 0.2099841684103012 (0.268380805850029) | > loss_disc_real_3: 0.32883551716804504 (0.2820689429839452) | > loss_disc_real_4: 0.15121550858020782 (0.33633386592070263) | > loss_disc_real_5: 0.1466650515794754 (0.2912251303593318) | > loss_0: 2.3419649600982666 (2.846987009048462) | > loss_gen: 2.416929244995117 (2.1528411706288657) | > loss_kl: 2.9453442096710205 (4.943669239679973) | > loss_feat: 5.285888671875 (4.871819257736206) | > loss_mel: 23.87506866455078 (19.220184961954754) | > loss_duration: 3.0045669078826904 (3.2994279861450195) | > loss_1: 37.52779769897461 (34.48794174194336) --> EVAL PERFORMANCE | > avg_loader_time: 0.011325836181640625 (+0.008545716603597006) | > avg_loss_disc: 2.846987009048462 (+0.20284827550252293) | > avg_loss_disc_real_0: 0.21848892172177634 (-0.16567898790041605) | > avg_loss_disc_real_1: 0.2862096428871155 (+0.08450249458352724) | > avg_loss_disc_real_2: 0.268380805850029 (+0.01780762771765393) | > avg_loss_disc_real_3: 0.2820689429839452 (+0.026457786560058594) | > avg_loss_disc_real_4: 0.33633386592070263 (+0.08229886492093408) | > avg_loss_disc_real_5: 0.2912251303593318 (+0.042546371618906675) | > avg_loss_0: 2.846987009048462 (+0.20284827550252293) | > avg_loss_gen: 2.1528411706288657 (-0.3596696058909097) | > avg_loss_kl: 4.943669239679973 (-0.01043184598286917) | > avg_loss_feat: 4.871819257736206 (-0.9150316715240479) | > avg_loss_mel: 19.220184961954754 (-0.8317839304606096) | > avg_loss_duration: 3.2994279861450195 (-0.059912363688150894) | > avg_loss_1: 34.48794174194336 (-2.1768296559651716)  > EPOCH: 1290/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:34:51)   --> TIME: 2023-10-20 16:35:02 -- STEP: 9/50 -- GLOBAL_STEP: 117510 | > loss_disc: 3.0646586418151855 (2.455206367704603) | > loss_disc_real_0: 0.21207588911056519 (0.11428582212991184) | > loss_disc_real_1: 0.27960968017578125 (0.24234515014621946) | > loss_disc_real_2: 0.3142997920513153 (0.21299785623947778) | > loss_disc_real_3: 0.3107989728450775 (0.22050929317871729) | > loss_disc_real_4: 0.3889435827732086 (0.2768320565422376) | > loss_disc_real_5: 0.28184813261032104 (0.2367317672404978) | > loss_0: 3.0646586418151855 (2.455206367704603) | > grad_norm_0: tensor(681.9482, device='cuda:0') (tensor(545.7433, device='cuda:0')) | > loss_gen: 2.271604537963867 (2.331821468141344) | > loss_kl: 0.93980872631073 (0.8561794691615634) | > loss_feat: 4.876616954803467 (6.840313381618923) | > loss_mel: 20.904937744140625 (21.328035354614258) | > loss_duration: 1.2421212196350098 (1.3236699766582913) | > loss_1: 30.235088348388672 (32.68001937866211) | > grad_norm_1: tensor(5750.2837, device='cuda:0') (tensor(13526.5283, device='cuda:0')) | > current_lr_0: 5.504971768558195e-05 | > current_lr_1: 5.510479838164047e-05 | > step_time: 0.3945 (0.6370533042483859) | > loader_time: 0.0056 (0.01901849110921224)  --> TIME: 2023-10-20 16:35:21 -- STEP: 39/50 -- GLOBAL_STEP: 117540 | > loss_disc: 1.4792671203613281 (2.334733348626357) | > loss_disc_real_0: 0.05810542404651642 (0.12373831557730834) | > loss_disc_real_1: 0.2365466058254242 (0.22302851367455262) | > loss_disc_real_2: 0.0957982987165451 (0.22453071234317926) | > loss_disc_real_3: 0.14624394476413727 (0.2153222251396913) | > loss_disc_real_4: 0.11085303872823715 (0.22569977391797763) | > loss_disc_real_5: 0.10402151942253113 (0.224040047910351) | > loss_0: 1.4792671203613281 (2.334733348626357) | > grad_norm_0: tensor(466.1863, device='cuda:0') (tensor(557.5269, device='cuda:0')) | > loss_gen: 3.391791343688965 (2.4339308463610134) | > loss_kl: 0.33621564507484436 (0.8187015629731692) | > loss_feat: 10.834026336669922 (6.7850943345289965) | > loss_mel: 22.2867488861084 (21.867505574837708) | > loss_duration: 1.4145280122756958 (1.2969172489948761) | > loss_1: 38.26331329345703 (33.20214988023807) | > grad_norm_1: tensor(90934.2578, device='cuda:0') (tensor(23515.5273, device='cuda:0')) | > current_lr_0: 5.504971768558195e-05 | > current_lr_1: 5.510479838164047e-05 | > step_time: 0.4109 (0.631132932809683) | > loader_time: 0.0049 (0.020485450059939653)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.75182843208313 (2.75182843208313) | > loss_disc_real_0: 0.36919456720352173 (0.36919456720352173) | > loss_disc_real_1: 0.26741814613342285 (0.26741814613342285) | > loss_disc_real_2: 0.35189154744148254 (0.35189154744148254) | > loss_disc_real_3: 0.17482860386371613 (0.17482860386371613) | > loss_disc_real_4: 0.29451173543930054 (0.29451173543930054) | > loss_disc_real_5: 0.2659229338169098 (0.2659229338169098) | > loss_0: 2.75182843208313 (2.75182843208313) | > loss_gen: 2.4453392028808594 (2.4453392028808594) | > loss_kl: 5.541235446929932 (5.541235446929932) | > loss_feat: 8.822218894958496 (8.822218894958496) | > loss_mel: 24.25402069091797 (24.25402069091797) | > loss_duration: 3.0882608890533447 (3.0882608890533447) | > loss_1: 44.15107727050781 (44.15107727050781)  --> STEP: 1 | > loss_disc: 3.319119930267334 (3.319119930267334) | > loss_disc_real_0: 0.22172051668167114 (0.22172051668167114) | > loss_disc_real_1: 0.2387285828590393 (0.2387285828590393) | > loss_disc_real_2: 0.34192419052124023 (0.34192419052124023) | > loss_disc_real_3: 0.3341032564640045 (0.3341032564640045) | > loss_disc_real_4: 0.3333134949207306 (0.3333134949207306) | > loss_disc_real_5: 0.4718109369277954 (0.4718109369277954) | > loss_0: 3.319119930267334 (3.319119930267334) | > loss_gen: 1.9000942707061768 (1.9000942707061768) | > loss_kl: 5.572269439697266 (5.572269439697266) | > loss_feat: 5.137645721435547 (5.137645721435547) | > loss_mel: 25.648256301879883 (25.648256301879883) | > loss_duration: 3.5788581371307373 (3.5788581371307373) | > loss_1: 41.837120056152344 (41.837120056152344)  --> STEP: 2 | > loss_disc: 2.5215797424316406 (2.9203498363494873) | > loss_disc_real_0: 0.09533311426639557 (0.15852681547403336) | > loss_disc_real_1: 0.2549399733543396 (0.24683427810668945) | > loss_disc_real_2: 0.26569461822509766 (0.30380940437316895) | > loss_disc_real_3: 0.30695807933807373 (0.3205306679010391) | > loss_disc_real_4: 0.28629735112190247 (0.30980542302131653) | > loss_disc_real_5: 0.36417776346206665 (0.41799435019493103) | > loss_0: 2.5215797424316406 (2.9203498363494873) | > loss_gen: 2.5632152557373047 (2.2316547632217407) | > loss_kl: 6.210944652557373 (5.891607046127319) | > loss_feat: 3.975292444229126 (4.556469082832336) | > loss_mel: 22.426013946533203 (24.037135124206543) | > loss_duration: 3.462376594543457 (3.520617365837097) | > loss_1: 38.63784408569336 (40.23748207092285)  --> STEP: 3 | > loss_disc: 2.6977593898773193 (2.8461530208587646) | > loss_disc_real_0: 0.18839603662490845 (0.16848322252432504) | > loss_disc_real_1: 0.24983565509319305 (0.24783473710219064) | > loss_disc_real_2: 0.23632943630218506 (0.281316081682841) | > loss_disc_real_3: 0.2865094840526581 (0.3091902732849121) | > loss_disc_real_4: 0.28168052434921265 (0.3004304567972819) | > loss_disc_real_5: 0.2733515202999115 (0.36978007356325787) | > loss_0: 2.6977593898773193 (2.8461530208587646) | > loss_gen: 1.9845467805862427 (2.1492854356765747) | > loss_kl: 3.0270862579345703 (4.936766783396403) | > loss_feat: 1.1850364208221436 (3.4326581954956055) | > loss_mel: 15.720602989196777 (21.264957745869953) | > loss_duration: 3.112854242324829 (3.3846963246663413) | > loss_1: 25.030126571655273 (35.16836357116699) --> EVAL PERFORMANCE | > avg_loader_time: 0.009737412134806315 (-0.0015884240468343105) | > avg_loss_disc: 2.8461530208587646 (-0.0008339881896972656) | > avg_loss_disc_real_0: 0.16848322252432504 (-0.05000569919745129) | > avg_loss_disc_real_1: 0.24783473710219064 (-0.038374905784924834) | > avg_loss_disc_real_2: 0.281316081682841 (+0.01293527583281201) | > avg_loss_disc_real_3: 0.3091902732849121 (+0.027121330300966917) | > avg_loss_disc_real_4: 0.3004304567972819 (-0.035903409123420715) | > avg_loss_disc_real_5: 0.36978007356325787 (+0.07855494320392609) | > avg_loss_0: 2.8461530208587646 (-0.0008339881896972656) | > avg_loss_gen: 2.1492854356765747 (-0.003555734952291001) | > avg_loss_kl: 4.936766783396403 (-0.006902456283569336) | > avg_loss_feat: 3.4326581954956055 (-1.4391610622406006) | > avg_loss_mel: 21.264957745869953 (+2.0447727839151995) | > avg_loss_duration: 3.3846963246663413 (+0.08526833852132176) | > avg_loss_1: 35.16836357116699 (+0.6804218292236328)  > EPOCH: 1291/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:35:43)   --> TIME: 2023-10-20 16:35:59 -- STEP: 19/50 -- GLOBAL_STEP: 117570 | > loss_disc: 3.051779270172119 (2.4313931402407194) | > loss_disc_real_0: 0.26240745186805725 (0.13538531231154738) | > loss_disc_real_1: 0.34719061851501465 (0.22740793385003744) | > loss_disc_real_2: 0.4181179404258728 (0.22529829273882665) | > loss_disc_real_3: 0.33215340971946716 (0.2512822039425373) | > loss_disc_real_4: 0.44507360458374023 (0.21666218546268187) | > loss_disc_real_5: 0.5063765048980713 (0.23318639593689064) | > loss_0: 3.051779270172119 (2.4313931402407194) | > grad_norm_0: tensor(400.6359, device='cuda:0') (tensor(648.9197, device='cuda:0')) | > loss_gen: 2.85353684425354 (2.3164741302791394) | > loss_kl: 0.5596283674240112 (0.8334180273507771) | > loss_feat: 5.621744155883789 (5.80032921151111) | > loss_mel: 24.86831283569336 (21.09276540655839) | > loss_duration: 1.4257228374481201 (1.3472895434028225) | > loss_1: 35.328948974609375 (31.39027680848774) | > grad_norm_1: tensor(4525.0503, device='cuda:0') (tensor(22295.4434, device='cuda:0')) | > current_lr_0: 5.4994692046127715e-05 | > current_lr_1: 5.504971768558195e-05 | > step_time: 0.3854 (0.5780230195898759) | > loader_time: 0.0019 (0.01819989555760434)  --> TIME: 2023-10-20 16:36:12 -- STEP: 49/50 -- GLOBAL_STEP: 117600 | > loss_disc: 3.0381875038146973 (2.4824648171055075) | > loss_disc_real_0: 0.2738018035888672 (0.14438334942738318) | > loss_disc_real_1: 0.2803780734539032 (0.2227953843468306) | > loss_disc_real_2: 0.3080301284790039 (0.2249997399595319) | > loss_disc_real_3: 0.27274858951568604 (0.23257132444758805) | > loss_disc_real_4: 0.2724842131137848 (0.23502671053367002) | > loss_disc_real_5: 0.26369571685791016 (0.2362175838527631) | > loss_0: 3.0381875038146973 (2.4824648171055075) | > grad_norm_0: tensor(1296.8223, device='cuda:0') (tensor(628.0001, device='cuda:0')) | > loss_gen: 1.6401174068450928 (2.2406641512501007) | > loss_kl: 0.6807910203933716 (0.7605427403231056) | > loss_feat: 0.12857156991958618 (5.394430197395232) | > loss_mel: 2.4944400787353516 (20.017392028351225) | > loss_duration: 1.454187273979187 (1.317045705659049) | > loss_1: 6.398107528686523 (29.73007478519362) | > grad_norm_1: tensor(18722.6758, device='cuda:0') (tensor(19659.4531, device='cuda:0')) | > current_lr_0: 5.4994692046127715e-05 | > current_lr_1: 5.504971768558195e-05 | > step_time: 0.3172 (0.4702758886376206) | > loader_time: 0.4818 (0.022611136339148696)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1130805015563965 (3.1130805015563965) | > loss_disc_real_0: 0.7583699226379395 (0.7583699226379395) | > loss_disc_real_1: 0.3277926445007324 (0.3277926445007324) | > loss_disc_real_2: 0.28569987416267395 (0.28569987416267395) | > loss_disc_real_3: 0.4336628019809723 (0.4336628019809723) | > loss_disc_real_4: 0.21453525125980377 (0.21453525125980377) | > loss_disc_real_5: 0.2560621201992035 (0.2560621201992035) | > loss_0: 3.1130805015563965 (3.1130805015563965) | > loss_gen: 2.647519111633301 (2.647519111633301) | > loss_kl: 6.60679817199707 (6.60679817199707) | > loss_feat: 5.17576789855957 (5.17576789855957) | > loss_mel: 24.135522842407227 (24.135522842407227) | > loss_duration: 3.1700055599212646 (3.1700055599212646) | > loss_1: 41.73561477661133 (41.73561477661133)  --> STEP: 1 | > loss_disc: 2.673649311065674 (2.673649311065674) | > loss_disc_real_0: 0.20380140841007233 (0.20380140841007233) | > loss_disc_real_1: 0.17381538450717926 (0.17381538450717926) | > loss_disc_real_2: 0.18828581273555756 (0.18828581273555756) | > loss_disc_real_3: 0.41050416231155396 (0.41050416231155396) | > loss_disc_real_4: 0.23169638216495514 (0.23169638216495514) | > loss_disc_real_5: 0.31126874685287476 (0.31126874685287476) | > loss_0: 2.673649311065674 (2.673649311065674) | > loss_gen: 2.136183977127075 (2.136183977127075) | > loss_kl: 5.098045349121094 (5.098045349121094) | > loss_feat: 8.70743179321289 (8.70743179321289) | > loss_mel: 23.337120056152344 (23.337120056152344) | > loss_duration: 3.5123918056488037 (3.5123918056488037) | > loss_1: 42.79117202758789 (42.79117202758789)  --> STEP: 2 | > loss_disc: 2.7849009037017822 (2.729275107383728) | > loss_disc_real_0: 0.38685280084609985 (0.2953271046280861) | > loss_disc_real_1: 0.2805125117301941 (0.22716394811868668) | > loss_disc_real_2: 0.30615541338920593 (0.24722061306238174) | > loss_disc_real_3: 0.20555932819843292 (0.30803174525499344) | > loss_disc_real_4: 0.22367249429225922 (0.22768443822860718) | > loss_disc_real_5: 0.24768124520778656 (0.27947499603033066) | > loss_0: 2.7849009037017822 (2.729275107383728) | > loss_gen: 2.237614154815674 (2.1868990659713745) | > loss_kl: 6.216480255126953 (5.657262802124023) | > loss_feat: 2.747749090194702 (5.727590441703796) | > loss_mel: 23.015356063842773 (23.17623805999756) | > loss_duration: 3.3920674324035645 (3.452229619026184) | > loss_1: 37.60926818847656 (40.20022010803223)  --> STEP: 3 | > loss_disc: 3.0262062549591064 (2.828252156575521) | > loss_disc_real_0: 0.26213592290878296 (0.28426337738831836) | > loss_disc_real_1: 0.27902382612228394 (0.24445057411988577) | > loss_disc_real_2: 0.3038543462753296 (0.2660985241333644) | > loss_disc_real_3: 0.2726459801197052 (0.29623649020989734) | > loss_disc_real_4: 0.2768416106700897 (0.24407016237576803) | > loss_disc_real_5: 0.2652732729911804 (0.2747410883506139) | > loss_0: 3.0262062549591064 (2.828252156575521) | > loss_gen: 1.6424678564071655 (2.005421996116638) | > loss_kl: 2.845109224319458 (4.719878276189168) | > loss_feat: 0.11489735543727875 (3.856692746281624) | > loss_mel: 2.3529210090637207 (16.235132376352947) | > loss_duration: 3.050978660583496 (3.318479299545288) | > loss_1: 10.00637435913086 (30.135604858398438) --> EVAL PERFORMANCE | > avg_loader_time: 0.02016313870747884 (+0.010425726572672525) | > avg_loss_disc: 2.828252156575521 (-0.017900864283243667) | > avg_loss_disc_real_0: 0.28426337738831836 (+0.11578015486399332) | > avg_loss_disc_real_1: 0.24445057411988577 (-0.0033841629823048724) | > avg_loss_disc_real_2: 0.2660985241333644 (-0.015217557549476624) | > avg_loss_disc_real_3: 0.29623649020989734 (-0.012953783075014769) | > avg_loss_disc_real_4: 0.24407016237576803 (-0.056360294421513885) | > avg_loss_disc_real_5: 0.2747410883506139 (-0.09503898521264398) | > avg_loss_0: 2.828252156575521 (-0.017900864283243667) | > avg_loss_gen: 2.005421996116638 (-0.14386343955993652) | > avg_loss_kl: 4.719878276189168 (-0.2168885072072353) | > avg_loss_feat: 3.856692746281624 (+0.42403455078601837) | > avg_loss_mel: 16.235132376352947 (-5.029825369517006) | > avg_loss_duration: 3.318479299545288 (-0.06621702512105321) | > avg_loss_1: 30.135604858398438 (-5.032758712768555)  > EPOCH: 1292/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:36:28)   --> TIME: 2023-10-20 16:36:54 -- STEP: 29/50 -- GLOBAL_STEP: 117630 | > loss_disc: 2.748319149017334 (2.446680389601609) | > loss_disc_real_0: 0.09049190580844879 (0.14477690685026604) | > loss_disc_real_1: 0.11195243149995804 (0.22754943871806407) | > loss_disc_real_2: 0.350813627243042 (0.2219244255844889) | > loss_disc_real_3: 0.27251625061035156 (0.22238138986044917) | > loss_disc_real_4: 0.3547418713569641 (0.2033124084359613) | > loss_disc_real_5: 0.26814281940460205 (0.23528137334204954) | > loss_0: 2.748319149017334 (2.446680389601609) | > grad_norm_0: tensor(296.9311, device='cuda:0') (tensor(678.2854, device='cuda:0')) | > loss_gen: 2.2061429023742676 (2.256282062366091) | > loss_kl: 0.7141090035438538 (0.8377842235154119) | > loss_feat: 9.119507789611816 (5.955135112435653) | > loss_mel: 23.183984756469727 (20.39201957192915) | > loss_duration: 1.2998197078704834 (1.313311165776746) | > loss_1: 36.523563385009766 (30.754531959007526) | > grad_norm_1: tensor(27066.2598, device='cuda:0') (tensor(17931.1953, device='cuda:0')) | > current_lr_0: 5.493972140824523e-05 | > current_lr_1: 5.4994692046127715e-05 | > step_time: 0.7304 (0.5992317528560243) | > loader_time: 0.0256 (0.020115375518798828)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9949419498443604 (2.9949419498443604) | > loss_disc_real_0: 0.4194001257419586 (0.4194001257419586) | > loss_disc_real_1: 0.25094929337501526 (0.25094929337501526) | > loss_disc_real_2: 0.2982906103134155 (0.2982906103134155) | > loss_disc_real_3: 0.2732657790184021 (0.2732657790184021) | > loss_disc_real_4: 0.25477278232574463 (0.25477278232574463) | > loss_disc_real_5: 0.2655147910118103 (0.2655147910118103) | > loss_0: 2.9949419498443604 (2.9949419498443604) | > loss_gen: 1.8988308906555176 (1.8988308906555176) | > loss_kl: 5.8653411865234375 (5.8653411865234375) | > loss_feat: 0.27646303176879883 (0.27646303176879883) | > loss_mel: 11.443283081054688 (11.443283081054688) | > loss_duration: 3.1994524002075195 (3.1994524002075195) | > loss_1: 22.683368682861328 (22.683368682861328)  --> STEP: 1 | > loss_disc: 2.634255886077881 (2.634255886077881) | > loss_disc_real_0: 0.3995897173881531 (0.3995897173881531) | > loss_disc_real_1: 0.24603010714054108 (0.24603010714054108) | > loss_disc_real_2: 0.14905118942260742 (0.14905118942260742) | > loss_disc_real_3: 0.2779155671596527 (0.2779155671596527) | > loss_disc_real_4: 0.28865522146224976 (0.28865522146224976) | > loss_disc_real_5: 0.27466440200805664 (0.27466440200805664) | > loss_0: 2.634255886077881 (2.634255886077881) | > loss_gen: 2.7546141147613525 (2.7546141147613525) | > loss_kl: 5.251218795776367 (5.251218795776367) | > loss_feat: 7.927815914154053 (7.927815914154053) | > loss_mel: 23.547340393066406 (23.547340393066406) | > loss_duration: 3.506649971008301 (3.506649971008301) | > loss_1: 42.987640380859375 (42.987640380859375)  --> STEP: 2 | > loss_disc: 2.668224573135376 (2.6512402296066284) | > loss_disc_real_0: 0.24500074982643127 (0.3222952336072922) | > loss_disc_real_1: 0.2193155586719513 (0.23267283290624619) | > loss_disc_real_2: 0.4083617925643921 (0.27870649099349976) | > loss_disc_real_3: 0.3063994348049164 (0.29215750098228455) | > loss_disc_real_4: 0.14425602555274963 (0.2164556235074997) | > loss_disc_real_5: 0.1855422556400299 (0.23010332882404327) | > loss_0: 2.668224573135376 (2.6512402296066284) | > loss_gen: 2.313258647918701 (2.533936381340027) | > loss_kl: 5.603909015655518 (5.427563905715942) | > loss_feat: 7.785432815551758 (7.856624364852905) | > loss_mel: 25.29810905456543 (24.422724723815918) | > loss_duration: 3.4040110111236572 (3.455330491065979) | > loss_1: 44.404720306396484 (43.69618034362793)  --> STEP: 3 | > loss_disc: 2.468289375305176 (2.590256611506144) | > loss_disc_real_0: 0.14872756600379944 (0.26443934440612793) | > loss_disc_real_1: 0.28094738721847534 (0.24876435101032257) | > loss_disc_real_2: 0.30224883556365967 (0.28655393918355304) | > loss_disc_real_3: 0.22644490003585815 (0.2702533006668091) | > loss_disc_real_4: 0.12917929887771606 (0.1873635152975718) | > loss_disc_real_5: 0.15535752475261688 (0.20518806080023447) | > loss_0: 2.468289375305176 (2.590256611506144) | > loss_gen: 2.084939479827881 (2.384270747502645) | > loss_kl: 2.8541364669799805 (4.569754759470622) | > loss_feat: 4.551735877990723 (6.754994869232178) | > loss_mel: 20.425691604614258 (23.0903803507487) | > loss_duration: 2.9625909328460693 (3.2910839716593423) | > loss_1: 32.879093170166016 (40.090484619140625) --> EVAL PERFORMANCE | > avg_loader_time: 0.006923278172810872 (-0.013239860534667969) | > avg_loss_disc: 2.590256611506144 (-0.23799554506937692) | > avg_loss_disc_real_0: 0.26443934440612793 (-0.01982403298219043) | > avg_loss_disc_real_1: 0.24876435101032257 (+0.004313776890436799) | > avg_loss_disc_real_2: 0.28655393918355304 (+0.020455415050188663) | > avg_loss_disc_real_3: 0.2702533006668091 (-0.02598318954308826) | > avg_loss_disc_real_4: 0.1873635152975718 (-0.056706647078196226) | > avg_loss_disc_real_5: 0.20518806080023447 (-0.06955302755037943) | > avg_loss_0: 2.590256611506144 (-0.23799554506937692) | > avg_loss_gen: 2.384270747502645 (+0.3788487513860068) | > avg_loss_kl: 4.569754759470622 (-0.15012351671854596) | > avg_loss_feat: 6.754994869232178 (+2.898302122950554) | > avg_loss_mel: 23.0903803507487 (+6.855247974395752) | > avg_loss_duration: 3.2910839716593423 (-0.027395327885945786) | > avg_loss_1: 40.090484619140625 (+9.954879760742188)  > EPOCH: 1293/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:37:23)   --> TIME: 2023-10-20 16:37:35 -- STEP: 9/50 -- GLOBAL_STEP: 117660 | > loss_disc: 2.7953810691833496 (2.5154583321677313) | > loss_disc_real_0: 0.266152024269104 (0.2314216678755151) | > loss_disc_real_1: 0.2323717176914215 (0.2174171387321419) | > loss_disc_real_2: 0.316863089799881 (0.22671760411726105) | > loss_disc_real_3: 0.25215980410575867 (0.21701008288396728) | > loss_disc_real_4: 0.2523497939109802 (0.22059680997497505) | > loss_disc_real_5: 0.27683043479919434 (0.22837011598878437) | > loss_0: 2.7953810691833496 (2.5154583321677313) | > grad_norm_0: tensor(368.2962, device='cuda:0') (tensor(683.9009, device='cuda:0')) | > loss_gen: 1.8872065544128418 (2.1896919276979236) | > loss_kl: 0.3497348725795746 (0.6411583001414934) | > loss_feat: 1.955245852470398 (4.860990688204765) | > loss_mel: 19.267812728881836 (18.704284959369236) | > loss_duration: 1.3491028547286987 (1.3369697862201266) | > loss_1: 24.80910301208496 (27.7330961227417) | > grad_norm_1: tensor(2297.8159, device='cuda:0') (tensor(7700.1035, device='cuda:0')) | > current_lr_0: 5.488480571695699e-05 | > current_lr_1: 5.493972140824523e-05 | > step_time: 0.8736 (0.6256834930843778) | > loader_time: 0.0217 (0.025216235054863825)  --> TIME: 2023-10-20 16:37:48 -- STEP: 39/50 -- GLOBAL_STEP: 117690 | > loss_disc: 2.5037918090820312 (2.3735844447062564) | > loss_disc_real_0: 0.2909403145313263 (0.15050959510680956) | > loss_disc_real_1: 0.23072482645511627 (0.2175535051486431) | > loss_disc_real_2: 0.19213855266571045 (0.2208487961727839) | > loss_disc_real_3: 0.2110034078359604 (0.2209993346283833) | > loss_disc_real_4: 0.20994481444358826 (0.21427697826845524) | > loss_disc_real_5: 0.17700569331645966 (0.2300456972219623) | > loss_0: 2.5037918090820312 (2.3735844447062564) | > grad_norm_0: tensor(684.2463, device='cuda:0') (tensor(636.1681, device='cuda:0')) | > loss_gen: 1.907914161682129 (2.338148982096941) | > loss_kl: 0.6206983923912048 (0.6830469425290059) | > loss_feat: 2.8302085399627686 (5.863726270886568) | > loss_mel: 17.388025283813477 (20.672028755530334) | > loss_duration: 1.3821464776992798 (1.3100899717746637) | > loss_1: 24.128992080688477 (30.867040805327587) | > grad_norm_1: tensor(7966.1729, device='cuda:0') (tensor(13382.1709, device='cuda:0')) | > current_lr_0: 5.488480571695699e-05 | > current_lr_1: 5.493972140824523e-05 | > step_time: 0.3473 (0.4550369091523) | > loader_time: 0.0027 (0.012428430410531852)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9109301567077637 (2.9109301567077637) | > loss_disc_real_0: 0.27626699209213257 (0.27626699209213257) | > loss_disc_real_1: 0.2456926554441452 (0.2456926554441452) | > loss_disc_real_2: 0.21268905699253082 (0.21268905699253082) | > loss_disc_real_3: 0.23559218645095825 (0.23559218645095825) | > loss_disc_real_4: 0.26194196939468384 (0.26194196939468384) | > loss_disc_real_5: 0.25852882862091064 (0.25852882862091064) | > loss_0: 2.9109301567077637 (2.9109301567077637) | > loss_gen: 1.670339584350586 (1.670339584350586) | > loss_kl: 5.739718437194824 (5.739718437194824) | > loss_feat: 2.2342348098754883 (2.2342348098754883) | > loss_mel: 18.989517211914062 (18.989517211914062) | > loss_duration: 3.1830437183380127 (3.1830437183380127) | > loss_1: 31.81685447692871 (31.81685447692871)  --> STEP: 1 | > loss_disc: 1.814917802810669 (1.814917802810669) | > loss_disc_real_0: 0.16416996717453003 (0.16416996717453003) | > loss_disc_real_1: 0.21105603873729706 (0.21105603873729706) | > loss_disc_real_2: 0.20663896203041077 (0.20663896203041077) | > loss_disc_real_3: 0.16282230615615845 (0.16282230615615845) | > loss_disc_real_4: 0.09670289605855942 (0.09670289605855942) | > loss_disc_real_5: 0.1045721247792244 (0.1045721247792244) | > loss_0: 1.814917802810669 (1.814917802810669) | > loss_gen: 2.5608179569244385 (2.5608179569244385) | > loss_kl: 5.859899520874023 (5.859899520874023) | > loss_feat: 7.52528190612793 (7.52528190612793) | > loss_mel: 22.347410202026367 (22.347410202026367) | > loss_duration: 3.4654932022094727 (3.4654932022094727) | > loss_1: 41.7588996887207 (41.7588996887207)  --> STEP: 2 | > loss_disc: 2.1740570068359375 (1.9944874048233032) | > loss_disc_real_0: 0.14814552664756775 (0.1561577469110489) | > loss_disc_real_1: 0.5234434008598328 (0.3672497197985649) | > loss_disc_real_2: 0.21586212515830994 (0.21125054359436035) | > loss_disc_real_3: 0.3961454927921295 (0.279483899474144) | > loss_disc_real_4: 0.08802375197410583 (0.09236332401633263) | > loss_disc_real_5: 0.1356053203344345 (0.12008872255682945) | > loss_0: 2.1740570068359375 (1.9944874048233032) | > loss_gen: 3.1897103786468506 (2.8752641677856445) | > loss_kl: 6.170462608337402 (6.015181064605713) | > loss_feat: 8.978042602539062 (8.251662254333496) | > loss_mel: 25.60521697998047 (23.976313591003418) | > loss_duration: 3.352708101272583 (3.409100651741028) | > loss_1: 47.296138763427734 (44.52751922607422)  --> STEP: 3 | > loss_disc: 3.36885404586792 (2.4526096185048423) | > loss_disc_real_0: 0.7405617833137512 (0.35095909237861633) | > loss_disc_real_1: 0.345315545797348 (0.35993832846482593) | > loss_disc_real_2: 0.27565324306488037 (0.2327181100845337) | > loss_disc_real_3: 0.23344635963439941 (0.2641380528608958) | > loss_disc_real_4: 0.26719361543655396 (0.15064008782307306) | > loss_disc_real_5: 0.2901698648929596 (0.17678243666887283) | > loss_0: 3.36885404586792 (2.4526096185048423) | > loss_gen: 1.9465960264205933 (2.565708120663961) | > loss_kl: 3.2194747924804688 (5.083278973897298) | > loss_feat: 2.6368277072906494 (6.380050738652547) | > loss_mel: 20.974740982055664 (22.975789388020832) | > loss_duration: 3.1485471725463867 (3.322249492009481) | > loss_1: 31.926185607910156 (40.327074686686196) --> EVAL PERFORMANCE | > avg_loader_time: 0.007464090983072917 (+0.0005408128102620448) | > avg_loss_disc: 2.4526096185048423 (-0.1376469930013018) | > avg_loss_disc_real_0: 0.35095909237861633 (+0.0865197479724884) | > avg_loss_disc_real_1: 0.35993832846482593 (+0.11117397745450336) | > avg_loss_disc_real_2: 0.2327181100845337 (-0.05383582909901935) | > avg_loss_disc_real_3: 0.2641380528608958 (-0.006115247805913271) | > avg_loss_disc_real_4: 0.15064008782307306 (-0.03672342747449875) | > avg_loss_disc_real_5: 0.17678243666887283 (-0.028405624131361634) | > avg_loss_0: 2.4526096185048423 (-0.1376469930013018) | > avg_loss_gen: 2.565708120663961 (+0.18143737316131592) | > avg_loss_kl: 5.083278973897298 (+0.5135242144266758) | > avg_loss_feat: 6.380050738652547 (-0.37494413057963083) | > avg_loss_mel: 22.975789388020832 (-0.11459096272786695) | > avg_loss_duration: 3.322249492009481 (+0.031165520350138642) | > avg_loss_1: 40.327074686686196 (+0.23659006754557055)  > EPOCH: 1294/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:38:12)   --> TIME: 2023-10-20 16:38:29 -- STEP: 19/50 -- GLOBAL_STEP: 117720 | > loss_disc: 2.6573848724365234 (2.379146569653561) | > loss_disc_real_0: 0.06687124073505402 (0.15256794306792712) | > loss_disc_real_1: 0.25967758893966675 (0.22704618855526573) | > loss_disc_real_2: 0.32050129771232605 (0.21922180546741737) | > loss_disc_real_3: 0.29515352845191956 (0.23816689692045512) | > loss_disc_real_4: 0.2664804458618164 (0.209365731987514) | > loss_disc_real_5: 0.2800792157649994 (0.2217745643697287) | > loss_0: 2.6573848724365234 (2.379146569653561) | > grad_norm_0: tensor(478.6120, device='cuda:0') (tensor(603.7260, device='cuda:0')) | > loss_gen: 1.965804934501648 (2.4049732057671798) | > loss_kl: 0.99997878074646 (0.8490188560987774) | > loss_feat: 2.077420234680176 (6.363471405678673) | > loss_mel: 20.99581527709961 (21.107447806157563) | > loss_duration: 1.3956512212753296 (1.344521911520707) | > loss_1: 27.434669494628906 (32.06943316208689) | > grad_norm_1: tensor(5503.3242, device='cuda:0') (tensor(23826.5410, device='cuda:0')) | > current_lr_0: 5.482994491734043e-05 | > current_lr_1: 5.488480571695699e-05 | > step_time: 0.3434 (0.5983798252908807) | > loader_time: 0.0031 (0.021780403036820262)  --> TIME: 2023-10-20 16:38:46 -- STEP: 49/50 -- GLOBAL_STEP: 117750 | > loss_disc: 2.7985472679138184 (2.3726889491081224) | > loss_disc_real_0: 0.07952199131250381 (0.13658279666144932) | > loss_disc_real_1: 0.18806332349777222 (0.21948059271945028) | > loss_disc_real_2: 0.16126999258995056 (0.21556648716558607) | > loss_disc_real_3: 0.33861666917800903 (0.23051000842634511) | > loss_disc_real_4: 0.18716268241405487 (0.21503410509274323) | > loss_disc_real_5: 0.31008827686309814 (0.2292816700147731) | > loss_0: 2.7985472679138184 (2.3726889491081224) | > grad_norm_0: tensor(877.2616, device='cuda:0') (tensor(585.4070, device='cuda:0')) | > loss_gen: 1.9059723615646362 (2.362276846048783) | > loss_kl: 0.8483117818832397 (0.8184698701513057) | > loss_feat: 5.039212703704834 (6.216308851327215) | > loss_mel: 24.290712356567383 (20.85721533882375) | > loss_duration: 1.4766950607299805 (1.308113611474329) | > loss_1: 33.56090545654297 (31.56238454701949) | > grad_norm_1: tensor(7298.3770, device='cuda:0') (tensor(20050.1074, device='cuda:0')) | > current_lr_0: 5.482994491734043e-05 | > current_lr_1: 5.488480571695699e-05 | > step_time: 0.4693 (0.5596415412669279) | > loader_time: 0.3922 (0.0277021904380954)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.235877513885498 (3.235877513885498) | > loss_disc_real_0: 0.4486323595046997 (0.4486323595046997) | > loss_disc_real_1: 0.2985725998878479 (0.2985725998878479) | > loss_disc_real_2: 0.3278752863407135 (0.3278752863407135) | > loss_disc_real_3: 0.1970587968826294 (0.1970587968826294) | > loss_disc_real_4: 0.45249858498573303 (0.45249858498573303) | > loss_disc_real_5: 0.421578973531723 (0.421578973531723) | > loss_0: 3.235877513885498 (3.235877513885498) | > loss_gen: 2.3838281631469727 (2.3838281631469727) | > loss_kl: 6.00638484954834 (6.00638484954834) | > loss_feat: 7.263149261474609 (7.263149261474609) | > loss_mel: 22.286575317382812 (22.286575317382812) | > loss_duration: 3.129708766937256 (3.129708766937256) | > loss_1: 41.069644927978516 (41.069644927978516)  --> STEP: 1 | > loss_disc: 2.958785057067871 (2.958785057067871) | > loss_disc_real_0: 0.18754082918167114 (0.18754082918167114) | > loss_disc_real_1: 0.3086417019367218 (0.3086417019367218) | > loss_disc_real_2: 0.29212692379951477 (0.29212692379951477) | > loss_disc_real_3: 0.27808743715286255 (0.27808743715286255) | > loss_disc_real_4: 0.44965559244155884 (0.44965559244155884) | > loss_disc_real_5: 0.26956480741500854 (0.26956480741500854) | > loss_0: 2.958785057067871 (2.958785057067871) | > loss_gen: 2.094825029373169 (2.094825029373169) | > loss_kl: 5.374726295471191 (5.374726295471191) | > loss_feat: 6.9314188957214355 (6.9314188957214355) | > loss_mel: 22.748855590820312 (22.748855590820312) | > loss_duration: 3.498616933822632 (3.498616933822632) | > loss_1: 40.648441314697266 (40.648441314697266)  --> STEP: 2 | > loss_disc: 2.598076343536377 (2.778430700302124) | > loss_disc_real_0: 0.16661465167999268 (0.1770777404308319) | > loss_disc_real_1: 0.3017745316028595 (0.30520811676979065) | > loss_disc_real_2: 0.3379797637462616 (0.3150533437728882) | > loss_disc_real_3: 0.5837885737419128 (0.4309380054473877) | > loss_disc_real_4: 0.24335207045078278 (0.3465038314461708) | > loss_disc_real_5: 0.22985388338565826 (0.2497093454003334) | > loss_0: 2.598076343536377 (2.778430700302124) | > loss_gen: 2.8739943504333496 (2.4844096899032593) | > loss_kl: 6.171026706695557 (5.772876501083374) | > loss_feat: 8.554239273071289 (7.742829084396362) | > loss_mel: 19.812808990478516 (21.280832290649414) | > loss_duration: 3.2570834159851074 (3.3778501749038696) | > loss_1: 40.669151306152344 (40.658796310424805)  --> STEP: 3 | > loss_disc: 2.703010082244873 (2.7532904942830405) | > loss_disc_real_0: 0.09333114326000214 (0.14916220804055533) | > loss_disc_real_1: 0.3274480998516083 (0.31262144446372986) | > loss_disc_real_2: 0.2815393805503845 (0.3038820226987203) | > loss_disc_real_3: 0.2847827970981598 (0.3822196026643117) | > loss_disc_real_4: 0.3880470097064972 (0.3603515575329463) | > loss_disc_real_5: 0.2720503509044647 (0.2571563472350438) | > loss_0: 2.703010082244873 (2.7532904942830405) | > loss_gen: 2.233812093734741 (2.4008771578470864) | > loss_kl: 2.9743072986602783 (4.840020100275676) | > loss_feat: 4.466918468475342 (6.6508588790893555) | > loss_mel: 19.6964111328125 (20.752691904703777) | > loss_duration: 2.948075771331787 (3.2345920403798423) | > loss_1: 32.31952667236328 (37.8790397644043) --> EVAL PERFORMANCE | > avg_loader_time: 0.011003812154134115 (+0.003539721171061198) | > avg_loss_disc: 2.7532904942830405 (+0.30068087577819824) | > avg_loss_disc_real_0: 0.14916220804055533 (-0.201796884338061) | > avg_loss_disc_real_1: 0.31262144446372986 (-0.04731688400109607) | > avg_loss_disc_real_2: 0.3038820226987203 (+0.07116391261418659) | > avg_loss_disc_real_3: 0.3822196026643117 (+0.1180815498034159) | > avg_loss_disc_real_4: 0.3603515575329463 (+0.20971146970987323) | > avg_loss_disc_real_5: 0.2571563472350438 (+0.08037391056617099) | > avg_loss_0: 2.7532904942830405 (+0.30068087577819824) | > avg_loss_gen: 2.4008771578470864 (-0.16483096281687448) | > avg_loss_kl: 4.840020100275676 (-0.24325887362162213) | > avg_loss_feat: 6.6508588790893555 (+0.27080814043680856) | > avg_loss_mel: 20.752691904703777 (-2.223097483317055) | > avg_loss_duration: 3.2345920403798423 (-0.08765745162963867) | > avg_loss_1: 37.8790397644043 (-2.4480349222818987)  > EPOCH: 1295/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:39:05)   --> TIME: 2023-10-20 16:39:23 -- STEP: 29/50 -- GLOBAL_STEP: 117780 | > loss_disc: 2.9511775970458984 (2.296044090698505) | > loss_disc_real_0: 0.1204594150185585 (0.143198534011327) | > loss_disc_real_1: 0.2473861128091812 (0.2334355198103806) | > loss_disc_real_2: 0.1858452707529068 (0.21914019281494207) | > loss_disc_real_3: 0.25045761466026306 (0.2190684638917446) | > loss_disc_real_4: 0.25188735127449036 (0.2044075116643618) | > loss_disc_real_5: 0.25165629386901855 (0.18774095543756567) | > loss_0: 2.9511775970458984 (2.296044090698505) | > grad_norm_0: tensor(359.6673, device='cuda:0') (tensor(591.1021, device='cuda:0')) | > loss_gen: 1.530877947807312 (2.3807534678228977) | > loss_kl: 0.650726318359375 (0.8301507799789823) | > loss_feat: 2.252950429916382 (6.351562356255178) | > loss_mel: 20.231443405151367 (19.326365376340927) | > loss_duration: 1.2812961339950562 (1.3167064189910889) | > loss_1: 25.947294235229492 (30.20553807554574) | > grad_norm_1: tensor(2093.0608, device='cuda:0') (tensor(20651.0820, device='cuda:0')) | > current_lr_0: 5.4775138954527894e-05 | > current_lr_1: 5.482994491734043e-05 | > step_time: 0.3469 (0.4075513872607001) | > loader_time: 0.0043 (0.01413300941730368)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0828871726989746 (3.0828871726989746) | > loss_disc_real_0: 0.11520025879144669 (0.11520025879144669) | > loss_disc_real_1: 0.467388778924942 (0.467388778924942) | > loss_disc_real_2: 0.5315679907798767 (0.5315679907798767) | > loss_disc_real_3: 0.40183085203170776 (0.40183085203170776) | > loss_disc_real_4: 0.339232474565506 (0.339232474565506) | > loss_disc_real_5: 0.3035276234149933 (0.3035276234149933) | > loss_0: 3.0828871726989746 (3.0828871726989746) | > loss_gen: 2.855992078781128 (2.855992078781128) | > loss_kl: 6.159291744232178 (6.159291744232178) | > loss_feat: 9.838988304138184 (9.838988304138184) | > loss_mel: 21.652753829956055 (21.652753829956055) | > loss_duration: 3.11285662651062 (3.11285662651062) | > loss_1: 43.61988067626953 (43.61988067626953)  --> STEP: 1 | > loss_disc: 2.930511951446533 (2.930511951446533) | > loss_disc_real_0: 0.14837656915187836 (0.14837656915187836) | > loss_disc_real_1: 0.2645125389099121 (0.2645125389099121) | > loss_disc_real_2: 0.30747199058532715 (0.30747199058532715) | > loss_disc_real_3: 0.3363325595855713 (0.3363325595855713) | > loss_disc_real_4: 0.31320205330848694 (0.31320205330848694) | > loss_disc_real_5: 0.2708970010280609 (0.2708970010280609) | > loss_0: 2.930511951446533 (2.930511951446533) | > loss_gen: 1.7602729797363281 (1.7602729797363281) | > loss_kl: 5.673516750335693 (5.673516750335693) | > loss_feat: 1.8369264602661133 (1.8369264602661133) | > loss_mel: 19.905187606811523 (19.905187606811523) | > loss_duration: 3.4989733695983887 (3.4989733695983887) | > loss_1: 32.67487716674805 (32.67487716674805)  --> STEP: 2 | > loss_disc: 2.562918186187744 (2.7467150688171387) | > loss_disc_real_0: 0.09405946731567383 (0.12121801823377609) | > loss_disc_real_1: 0.29530540108680725 (0.2799089699983597) | > loss_disc_real_2: 0.30840471386909485 (0.307938352227211) | > loss_disc_real_3: 0.3249567151069641 (0.3306446373462677) | > loss_disc_real_4: 0.22597217559814453 (0.26958711445331573) | > loss_disc_real_5: 0.18103665113449097 (0.22596682608127594) | > loss_0: 2.562918186187744 (2.7467150688171387) | > loss_gen: 2.0002760887145996 (1.8802745342254639) | > loss_kl: 6.499844074249268 (6.0866804122924805) | > loss_feat: 3.646064281463623 (2.741495370864868) | > loss_mel: 26.395702362060547 (23.150444984436035) | > loss_duration: 3.326826333999634 (3.4128998517990112) | > loss_1: 41.86871337890625 (37.27179527282715)  --> STEP: 3 | > loss_disc: 2.802295446395874 (2.765241861343384) | > loss_disc_real_0: 0.06898647546768188 (0.10380750397841136) | > loss_disc_real_1: 0.32808008790016174 (0.2959660092989604) | > loss_disc_real_2: 0.26273757219314575 (0.29287142554918927) | > loss_disc_real_3: 0.2189040631055832 (0.29339777926603955) | > loss_disc_real_4: 0.28402987122535706 (0.27440136671066284) | > loss_disc_real_5: 0.2543129622936249 (0.23541553815205893) | > loss_0: 2.802295446395874 (2.765241861343384) | > loss_gen: 1.6803388595581055 (1.8136293093363445) | > loss_kl: 2.9884963035583496 (5.0539523760477705) | > loss_feat: 1.6326780319213867 (2.371889591217041) | > loss_mel: 20.36839485168457 (22.223094940185547) | > loss_duration: 3.028850793838501 (3.284883499145508) | > loss_1: 29.69875717163086 (34.747449239095054) --> EVAL PERFORMANCE | > avg_loader_time: 0.014412800470987955 (+0.00340898831685384) | > avg_loss_disc: 2.765241861343384 (+0.011951367060343276) | > avg_loss_disc_real_0: 0.10380750397841136 (-0.045354704062143966) | > avg_loss_disc_real_1: 0.2959660092989604 (-0.016655435164769472) | > avg_loss_disc_real_2: 0.29287142554918927 (-0.01101059714953101) | > avg_loss_disc_real_3: 0.29339777926603955 (-0.08882182339827216) | > avg_loss_disc_real_4: 0.27440136671066284 (-0.08595019082228345) | > avg_loss_disc_real_5: 0.23541553815205893 (-0.021740809082984897) | > avg_loss_0: 2.765241861343384 (+0.011951367060343276) | > avg_loss_gen: 1.8136293093363445 (-0.587247848510742) | > avg_loss_kl: 5.0539523760477705 (+0.21393227577209473) | > avg_loss_feat: 2.371889591217041 (-4.2789692878723145) | > avg_loss_mel: 22.223094940185547 (+1.4704030354817696) | > avg_loss_duration: 3.284883499145508 (+0.05029145876566554) | > avg_loss_1: 34.747449239095054 (-3.1315905253092424)  > EPOCH: 1296/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:39:59)   --> TIME: 2023-10-20 16:40:21 -- STEP: 9/50 -- GLOBAL_STEP: 117810 | > loss_disc: 3.3479559421539307 (2.483571449915568) | > loss_disc_real_0: 0.3793434798717499 (0.17804826692574555) | > loss_disc_real_1: 0.42739802598953247 (0.2726115726141466) | > loss_disc_real_2: 0.3376650810241699 (0.23026459705498484) | > loss_disc_real_3: 0.3634386956691742 (0.266570954480105) | > loss_disc_real_4: 0.34445932507514954 (0.21924362497197258) | > loss_disc_real_5: 0.4257234036922455 (0.2554837603949838) | > loss_0: 3.3479559421539307 (2.483571449915568) | > grad_norm_0: tensor(445.1194, device='cuda:0') (tensor(517.4224, device='cuda:0')) | > loss_gen: 2.3766298294067383 (2.5298589070638022) | > loss_kl: 0.4218863248825073 (0.7984736296865675) | > loss_feat: 5.436110019683838 (7.40105324321323) | > loss_mel: 20.428808212280273 (21.260910669962566) | > loss_duration: 1.2594331502914429 (1.2762631177902222) | > loss_1: 29.922866821289062 (33.2665589650472) | > grad_norm_1: tensor(9662.9004, device='cuda:0') (tensor(17352.2402, device='cuda:0')) | > current_lr_0: 5.472038777370655e-05 | > current_lr_1: 5.4775138954527894e-05 | > step_time: 0.8048 (0.6635061634911431) | > loader_time: 0.0723 (0.02751506699456109)  --> TIME: 2023-10-20 16:40:38 -- STEP: 39/50 -- GLOBAL_STEP: 117840 | > loss_disc: 2.336104393005371 (2.5460588870904384) | > loss_disc_real_0: 0.08326327800750732 (0.15807557846300113) | > loss_disc_real_1: 0.21728064119815826 (0.24297497041810018) | > loss_disc_real_2: 0.16744117438793182 (0.23196128813120034) | > loss_disc_real_3: 0.3252716064453125 (0.24169425193506938) | > loss_disc_real_4: 0.240098774433136 (0.24643879279924127) | > loss_disc_real_5: 0.22552652657032013 (0.25182450185410477) | > loss_0: 2.336104393005371 (2.5460588870904384) | > grad_norm_0: tensor(691.9609, device='cuda:0') (tensor(675.6219, device='cuda:0')) | > loss_gen: 2.255007743835449 (2.24335696758368) | > loss_kl: 0.7917734980583191 (0.8021371578558897) | > loss_feat: 3.378891706466675 (5.588377051437512) | > loss_mel: 25.458526611328125 (19.820610345938263) | > loss_duration: 1.362826943397522 (1.2956653344325535) | > loss_1: 33.24702835083008 (29.75014674357879) | > grad_norm_1: tensor(3422.8069, device='cuda:0') (tensor(16397.5469, device='cuda:0')) | > current_lr_0: 5.472038777370655e-05 | > current_lr_1: 5.4775138954527894e-05 | > step_time: 0.4944 (0.5754192425654484) | > loader_time: 0.0324 (0.021605283786088992)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.601191997528076 (2.601191997528076) | > loss_disc_real_0: 0.1169663667678833 (0.1169663667678833) | > loss_disc_real_1: 0.21478332579135895 (0.21478332579135895) | > loss_disc_real_2: 0.25917646288871765 (0.25917646288871765) | > loss_disc_real_3: 0.2761928141117096 (0.2761928141117096) | > loss_disc_real_4: 0.27916860580444336 (0.27916860580444336) | > loss_disc_real_5: 0.2541065812110901 (0.2541065812110901) | > loss_0: 2.601191997528076 (2.601191997528076) | > loss_gen: 2.1755523681640625 (2.1755523681640625) | > loss_kl: 6.204036235809326 (6.204036235809326) | > loss_feat: 9.457408905029297 (9.457408905029297) | > loss_mel: 27.12643814086914 (27.12643814086914) | > loss_duration: 3.0830538272857666 (3.0830538272857666) | > loss_1: 48.04648971557617 (48.04648971557617)  --> STEP: 1 | > loss_disc: 2.9052538871765137 (2.9052538871765137) | > loss_disc_real_0: 0.2086106687784195 (0.2086106687784195) | > loss_disc_real_1: 0.2909330129623413 (0.2909330129623413) | > loss_disc_real_2: 0.2767198979854584 (0.2767198979854584) | > loss_disc_real_3: 0.2746942937374115 (0.2746942937374115) | > loss_disc_real_4: 0.27705833315849304 (0.27705833315849304) | > loss_disc_real_5: 0.2571094036102295 (0.2571094036102295) | > loss_0: 2.9052538871765137 (2.9052538871765137) | > loss_gen: 1.6972664594650269 (1.6972664594650269) | > loss_kl: 5.660639762878418 (5.660639762878418) | > loss_feat: 0.2633015215396881 (0.2633015215396881) | > loss_mel: 12.574175834655762 (12.574175834655762) | > loss_duration: 3.5209672451019287 (3.5209672451019287) | > loss_1: 23.716350555419922 (23.716350555419922)  --> STEP: 2 | > loss_disc: 2.5321221351623535 (2.7186880111694336) | > loss_disc_real_0: 0.1431843489408493 (0.1758975088596344) | > loss_disc_real_1: 0.30169034004211426 (0.2963116765022278) | > loss_disc_real_2: 0.23162095248699188 (0.25417042523622513) | > loss_disc_real_3: 0.2916450798511505 (0.283169686794281) | > loss_disc_real_4: 0.27738338708877563 (0.27722086012363434) | > loss_disc_real_5: 0.26134297251701355 (0.2592261880636215) | > loss_0: 2.5321221351623535 (2.7186880111694336) | > loss_gen: 2.279231309890747 (1.988248884677887) | > loss_kl: 6.432109355926514 (6.046374559402466) | > loss_feat: 2.831075429916382 (1.547188475728035) | > loss_mel: 24.227779388427734 (18.400977611541748) | > loss_duration: 3.3731191158294678 (3.4470431804656982) | > loss_1: 39.143314361572266 (31.429832458496094)  --> STEP: 3 | > loss_disc: 3.3599119186401367 (2.932429313659668) | > loss_disc_real_0: 0.36650997400283813 (0.2394349972407023) | > loss_disc_real_1: 0.3099072575569153 (0.3008435368537903) | > loss_disc_real_2: 0.34216728806495667 (0.2835027128458023) | > loss_disc_real_3: 0.30632153153419495 (0.2908869683742523) | > loss_disc_real_4: 0.341209352016449 (0.2985503574212392) | > loss_disc_real_5: 0.34667253494262695 (0.28837497035662335) | > loss_0: 3.3599119186401367 (2.932429313659668) | > loss_gen: 1.9655399322509766 (1.9806792338689168) | > loss_kl: 3.0500688552856445 (5.047605991363525) | > loss_feat: 2.5627334117889404 (1.8857034544150035) | > loss_mel: 19.94562339782715 (18.915859540303547) | > loss_duration: 3.0349059104919434 (3.3096640904744468) | > loss_1: 30.55887222290039 (31.13951237996419) --> EVAL PERFORMANCE | > avg_loader_time: 0.008579095204671225 (-0.005833705266316731) | > avg_loss_disc: 2.932429313659668 (+0.16718745231628418) | > avg_loss_disc_real_0: 0.2394349972407023 (+0.13562749326229095) | > avg_loss_disc_real_1: 0.3008435368537903 (+0.004877527554829897) | > avg_loss_disc_real_2: 0.2835027128458023 (-0.009368712703386961) | > avg_loss_disc_real_3: 0.2908869683742523 (-0.0025108108917872296) | > avg_loss_disc_real_4: 0.2985503574212392 (+0.024148990710576357) | > avg_loss_disc_real_5: 0.28837497035662335 (+0.05295943220456442) | > avg_loss_0: 2.932429313659668 (+0.16718745231628418) | > avg_loss_gen: 1.9806792338689168 (+0.16704992453257228) | > avg_loss_kl: 5.047605991363525 (-0.006346384684245088) | > avg_loss_feat: 1.8857034544150035 (-0.4861861368020375) | > avg_loss_mel: 18.915859540303547 (-3.307235399882) | > avg_loss_duration: 3.3096640904744468 (+0.02478059132893895) | > avg_loss_1: 31.13951237996419 (-3.607936859130863)  > EPOCH: 1297/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:41:08)   --> TIME: 2023-10-20 16:41:25 -- STEP: 19/50 -- GLOBAL_STEP: 117870 | > loss_disc: 1.823371171951294 (2.4892756938934326) | > loss_disc_real_0: 0.010456436313688755 (0.1301337316338169) | > loss_disc_real_1: 0.243672713637352 (0.2258464125426192) | > loss_disc_real_2: 0.19703981280326843 (0.23215442444933088) | > loss_disc_real_3: 0.3102879822254181 (0.24486245724715686) | > loss_disc_real_4: 0.1368541270494461 (0.2281620830395504) | > loss_disc_real_5: 0.19884423911571503 (0.24122096100626023) | > loss_0: 1.823371171951294 (2.4892756938934326) | > grad_norm_0: tensor(378.5765, device='cuda:0') (tensor(507.3298, device='cuda:0')) | > loss_gen: 2.888328790664673 (2.1551739353882637) | > loss_kl: 0.8059525489807129 (0.7499672658741474) | > loss_feat: 7.807541847229004 (4.8447266602398535) | > loss_mel: 22.059171676635742 (18.793764167710354) | > loss_duration: 1.4079434871673584 (1.3328524137798108) | > loss_1: 34.96894073486328 (27.876483691366094) | > grad_norm_1: tensor(22730.7988, device='cuda:0') (tensor(17329.7793, device='cuda:0')) | > current_lr_0: 5.466569132011838e-05 | > current_lr_1: 5.472038777370655e-05 | > step_time: 0.6425 (0.6026103371068051) | > loader_time: 0.0297 (0.02448355524163497)  --> TIME: 2023-10-20 16:41:46 -- STEP: 49/50 -- GLOBAL_STEP: 117900 | > loss_disc: 2.160067081451416 (2.5081844110878144) | > loss_disc_real_0: 0.12940044701099396 (0.14942973800839818) | > loss_disc_real_1: 0.20738504827022552 (0.21877921053341456) | > loss_disc_real_2: 0.11716818809509277 (0.21924714249919872) | > loss_disc_real_3: 0.12762783467769623 (0.2331035212442583) | > loss_disc_real_4: 0.0968029573559761 (0.23336646563316488) | > loss_disc_real_5: 0.1948544681072235 (0.227406713702925) | > loss_0: 2.160067081451416 (2.5081844110878144) | > grad_norm_0: tensor(772.5590, device='cuda:0') (tensor(698.5479, device='cuda:0')) | > loss_gen: 2.3403120040893555 (2.134543258316663) | > loss_kl: 0.814772367477417 (0.7537037881509382) | > loss_feat: 6.188780784606934 (4.960678895175153) | > loss_mel: 25.695528030395508 (18.77015538118324) | > loss_duration: 1.4357112646102905 (1.297539670856632) | > loss_1: 36.47510528564453 (27.91662073135376) | > grad_norm_1: tensor(42626.6367, device='cuda:0') (tensor(20522.0781, device='cuda:0')) | > current_lr_0: 5.466569132011838e-05 | > current_lr_1: 5.472038777370655e-05 | > step_time: 0.6726 (0.6264591898236956) | > loader_time: 0.446 (0.033041316635754645)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.649010181427002 (2.649010181427002) | > loss_disc_real_0: 0.3618285655975342 (0.3618285655975342) | > loss_disc_real_1: 0.3727262020111084 (0.3727262020111084) | > loss_disc_real_2: 0.4029494822025299 (0.4029494822025299) | > loss_disc_real_3: 0.30824652314186096 (0.30824652314186096) | > loss_disc_real_4: 0.23680441081523895 (0.23680441081523895) | > loss_disc_real_5: 0.27456921339035034 (0.27456921339035034) | > loss_0: 2.649010181427002 (2.649010181427002) | > loss_gen: 2.7969741821289062 (2.7969741821289062) | > loss_kl: 6.830679893493652 (6.830679893493652) | > loss_feat: 5.754414081573486 (5.754414081573486) | > loss_mel: 21.337251663208008 (21.337251663208008) | > loss_duration: 3.123444080352783 (3.123444080352783) | > loss_1: 39.84276580810547 (39.84276580810547)  --> STEP: 1 | > loss_disc: 3.001964569091797 (3.001964569091797) | > loss_disc_real_0: 0.12118479609489441 (0.12118479609489441) | > loss_disc_real_1: 0.2596215307712555 (0.2596215307712555) | > loss_disc_real_2: 0.2689409554004669 (0.2689409554004669) | > loss_disc_real_3: 0.25368592143058777 (0.25368592143058777) | > loss_disc_real_4: 0.2565532922744751 (0.2565532922744751) | > loss_disc_real_5: 0.2819143533706665 (0.2819143533706665) | > loss_0: 3.001964569091797 (3.001964569091797) | > loss_gen: 1.467089056968689 (1.467089056968689) | > loss_kl: 6.643126487731934 (6.643126487731934) | > loss_feat: 0.13366660475730896 (0.13366660475730896) | > loss_mel: 9.202310562133789 (9.202310562133789) | > loss_duration: 3.5714871883392334 (3.5714871883392334) | > loss_1: 21.01767921447754 (21.01767921447754)  --> STEP: 2 | > loss_disc: 2.9235219955444336 (2.9627432823181152) | > loss_disc_real_0: 0.06570427119731903 (0.09344453364610672) | > loss_disc_real_1: 0.24290680885314941 (0.25126416981220245) | > loss_disc_real_2: 0.26095426082611084 (0.2649476081132889) | > loss_disc_real_3: 0.2558618485927582 (0.254773885011673) | > loss_disc_real_4: 0.2555027902126312 (0.25602804124355316) | > loss_disc_real_5: 0.28072822093963623 (0.28132128715515137) | > loss_0: 2.9235219955444336 (2.9627432823181152) | > loss_gen: 1.4773902893066406 (1.4722396731376648) | > loss_kl: 6.1879496574401855 (6.41553807258606) | > loss_feat: 0.5629708766937256 (0.3483187407255173) | > loss_mel: 11.938471794128418 (10.570391178131104) | > loss_duration: 3.4615862369537354 (3.5165367126464844) | > loss_1: 23.628368377685547 (22.323023796081543)  --> STEP: 3 | > loss_disc: 1.8282091617584229 (2.5845652421315513) | > loss_disc_real_0: 0.07465597987174988 (0.08718168238798778) | > loss_disc_real_1: 0.3523709774017334 (0.28496643900871277) | > loss_disc_real_2: 0.06674658507108688 (0.19888060043255487) | > loss_disc_real_3: 0.16184160113334656 (0.22379645705223083) | > loss_disc_real_4: 0.058791082352399826 (0.19028238827983537) | > loss_disc_real_5: 0.14748471975326538 (0.23670909802118936) | > loss_0: 1.8282091617584229 (2.5845652421315513) | > loss_gen: 2.63348126411438 (1.8593202034632366) | > loss_kl: 3.238516330718994 (5.356530825297038) | > loss_feat: 7.524733543395996 (2.7404570082823434) | > loss_mel: 21.713655471801758 (14.284812609354654) | > loss_duration: 3.0363335609436035 (3.356468995412191) | > loss_1: 38.14672088623047 (27.59758949279785) --> EVAL PERFORMANCE | > avg_loader_time: 0.008510271708170572 (-6.88234965006522e-05) | > avg_loss_disc: 2.5845652421315513 (-0.3478640715281167) | > avg_loss_disc_real_0: 0.08718168238798778 (-0.15225331485271454) | > avg_loss_disc_real_1: 0.28496643900871277 (-0.015877097845077515) | > avg_loss_disc_real_2: 0.19888060043255487 (-0.08462211241324744) | > avg_loss_disc_real_3: 0.22379645705223083 (-0.06709051132202148) | > avg_loss_disc_real_4: 0.19028238827983537 (-0.10826796914140382) | > avg_loss_disc_real_5: 0.23670909802118936 (-0.05166587233543399) | > avg_loss_0: 2.5845652421315513 (-0.3478640715281167) | > avg_loss_gen: 1.8593202034632366 (-0.12135903040568019) | > avg_loss_kl: 5.356530825297038 (+0.30892483393351267) | > avg_loss_feat: 2.7404570082823434 (+0.8547535538673399) | > avg_loss_mel: 14.284812609354654 (-4.631046930948893) | > avg_loss_duration: 3.356468995412191 (+0.04680490493774414) | > avg_loss_1: 27.59758949279785 (-3.54192288716634)  > EPOCH: 1298/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:42:02)   --> TIME: 2023-10-20 16:42:26 -- STEP: 29/50 -- GLOBAL_STEP: 117930 | > loss_disc: 2.8296713829040527 (2.565921701233963) | > loss_disc_real_0: 0.18930229544639587 (0.14714860055467174) | > loss_disc_real_1: 0.25465187430381775 (0.23956462329831615) | > loss_disc_real_2: 0.2269061654806137 (0.23659031427112118) | > loss_disc_real_3: 0.25150367617607117 (0.23709102540180602) | > loss_disc_real_4: 0.2459365874528885 (0.23678397586376504) | > loss_disc_real_5: 0.2658625543117523 (0.23216634134537187) | > loss_0: 2.8296713829040527 (2.565921701233963) | > grad_norm_0: tensor(1854.4210, device='cuda:0') (tensor(668.1805, device='cuda:0')) | > loss_gen: 1.6954017877578735 (2.1662110008042434) | > loss_kl: 0.7672618627548218 (0.7358126076387947) | > loss_feat: 0.6862261295318604 (4.7528372148758375) | > loss_mel: 10.083378791809082 (17.741293586533644) | > loss_duration: 1.336095929145813 (1.2967891652008583) | > loss_1: 14.568365097045898 (26.692943556555385) | > grad_norm_1: tensor(16703.9980, device='cuda:0') (tensor(17895.5762, device='cuda:0')) | > current_lr_0: 5.461104953906007e-05 | > current_lr_1: 5.466569132011838e-05 | > step_time: 0.7224 (0.6086963949532345) | > loader_time: 0.0405 (0.021719883228170457)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.562540054321289 (2.562540054321289) | > loss_disc_real_0: 0.09065361320972443 (0.09065361320972443) | > loss_disc_real_1: 0.2167748510837555 (0.2167748510837555) | > loss_disc_real_2: 0.10543946921825409 (0.10543946921825409) | > loss_disc_real_3: 0.2403557151556015 (0.2403557151556015) | > loss_disc_real_4: 0.1828799843788147 (0.1828799843788147) | > loss_disc_real_5: 0.1781250685453415 (0.1781250685453415) | > loss_0: 2.562540054321289 (2.562540054321289) | > loss_gen: 1.5617454051971436 (1.5617454051971436) | > loss_kl: 6.049326419830322 (6.049326419830322) | > loss_feat: 2.7994556427001953 (2.7994556427001953) | > loss_mel: 20.246259689331055 (20.246259689331055) | > loss_duration: 3.0789217948913574 (3.0789217948913574) | > loss_1: 33.7357063293457 (33.7357063293457)  --> STEP: 1 | > loss_disc: 2.868764877319336 (2.868764877319336) | > loss_disc_real_0: 0.4786209464073181 (0.4786209464073181) | > loss_disc_real_1: 0.21600422263145447 (0.21600422263145447) | > loss_disc_real_2: 0.11374836415052414 (0.11374836415052414) | > loss_disc_real_3: 0.17708946764469147 (0.17708946764469147) | > loss_disc_real_4: 0.27930939197540283 (0.27930939197540283) | > loss_disc_real_5: 0.3243173658847809 (0.3243173658847809) | > loss_0: 2.868764877319336 (2.868764877319336) | > loss_gen: 2.043759346008301 (2.043759346008301) | > loss_kl: 6.090968132019043 (6.090968132019043) | > loss_feat: 5.402796268463135 (5.402796268463135) | > loss_mel: 25.081226348876953 (25.081226348876953) | > loss_duration: 3.398179292678833 (3.398179292678833) | > loss_1: 42.01692581176758 (42.01692581176758)  --> STEP: 2 | > loss_disc: 2.996054172515869 (2.9324095249176025) | > loss_disc_real_0: 0.2193714827299118 (0.34899621456861496) | > loss_disc_real_1: 0.25689956545829773 (0.2364518940448761) | > loss_disc_real_2: 0.2748737037181854 (0.19431103393435478) | > loss_disc_real_3: 0.2450638711452484 (0.21107666939496994) | > loss_disc_real_4: 0.2603513300418854 (0.2698303610086441) | > loss_disc_real_5: 0.24603110551834106 (0.285174235701561) | > loss_0: 2.996054172515869 (2.9324095249176025) | > loss_gen: 1.5085402727127075 (1.7761498093605042) | > loss_kl: 6.42145299911499 (6.256210565567017) | > loss_feat: 0.06538672000169754 (2.734091494232416) | > loss_mel: 1.4361798763275146 (13.258703112602234) | > loss_duration: 3.3735897541046143 (3.3858845233917236) | > loss_1: 12.80514907836914 (27.41103744506836)  --> STEP: 3 | > loss_disc: 2.8626585006713867 (2.9091591835021973) | > loss_disc_real_0: 0.18429158627986908 (0.29409467180569965) | > loss_disc_real_1: 0.2618170380592346 (0.24490694204966226) | > loss_disc_real_2: 0.27726131677627563 (0.22196112821499506) | > loss_disc_real_3: 0.25101739168167114 (0.22439024349053702) | > loss_disc_real_4: 0.26058605313301086 (0.2667489250500997) | > loss_disc_real_5: 0.2461390197277069 (0.2721624970436096) | > loss_0: 2.8626585006713867 (2.9091591835021973) | > loss_gen: 1.6399221420288086 (1.7307405869166057) | > loss_kl: 2.8699710369110107 (5.127464056015015) | > loss_feat: 0.45506948232650757 (1.9744174902637799) | > loss_mel: 14.390875816345215 (13.636094013849894) | > loss_duration: 2.9661412239074707 (3.245970090230306) | > loss_1: 22.321979522705078 (25.714684804280598) --> EVAL PERFORMANCE | > avg_loader_time: 0.0024770100911458335 (-0.006033261617024738) | > avg_loss_disc: 2.9091591835021973 (+0.324593941370646) | > avg_loss_disc_real_0: 0.29409467180569965 (+0.20691298941771186) | > avg_loss_disc_real_1: 0.24490694204966226 (-0.040059496959050506) | > avg_loss_disc_real_2: 0.22196112821499506 (+0.023080527782440186) | > avg_loss_disc_real_3: 0.22439024349053702 (+0.0005937864383061819) | > avg_loss_disc_real_4: 0.2667489250500997 (+0.0764665367702643) | > avg_loss_disc_real_5: 0.2721624970436096 (+0.03545339902242026) | > avg_loss_0: 2.9091591835021973 (+0.324593941370646) | > avg_loss_gen: 1.7307405869166057 (-0.12857961654663086) | > avg_loss_kl: 5.127464056015015 (-0.2290667692820234) | > avg_loss_feat: 1.9744174902637799 (-0.7660395180185635) | > avg_loss_mel: 13.636094013849894 (-0.6487185955047607) | > avg_loss_duration: 3.245970090230306 (-0.11049890518188477) | > avg_loss_1: 25.714684804280598 (-1.8829046885172538)  > EPOCH: 1299/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:42:50)   --> TIME: 2023-10-20 16:43:00 -- STEP: 9/50 -- GLOBAL_STEP: 117960 | > loss_disc: 2.7844772338867188 (2.7032839987013073) | > loss_disc_real_0: 0.25453972816467285 (0.11814646712607807) | > loss_disc_real_1: 0.2353866696357727 (0.261015600628323) | > loss_disc_real_2: 0.262661874294281 (0.24289357331064013) | > loss_disc_real_3: 0.2368362694978714 (0.22547729396157795) | > loss_disc_real_4: 0.26063287258148193 (0.24424891670544943) | > loss_disc_real_5: 0.22023752331733704 (0.22347328604923355) | > loss_0: 2.7844772338867188 (2.7032839987013073) | > grad_norm_0: tensor(682.2113, device='cuda:0') (tensor(797.0835, device='cuda:0')) | > loss_gen: 1.8918354511260986 (1.9539136356777616) | > loss_kl: 0.9930431842803955 (0.6924596755868859) | > loss_feat: 1.8481467962265015 (4.171192227138413) | > loss_mel: 22.567760467529297 (18.440294053819443) | > loss_duration: 1.2426401376724243 (1.2874731355243259) | > loss_1: 28.543426513671875 (26.545332696702744) | > grad_norm_1: tensor(3179.0400, device='cuda:0') (tensor(15900.5381, device='cuda:0')) | > current_lr_0: 5.455646237588303e-05 | > current_lr_1: 5.461104953906007e-05 | > step_time: 0.7476 (0.5996015601687961) | > loader_time: 0.0304 (0.024291356404622395)  --> TIME: 2023-10-20 16:43:17 -- STEP: 39/50 -- GLOBAL_STEP: 117990 | > loss_disc: 2.6980819702148438 (2.5684375701806483) | > loss_disc_real_0: 0.1675150990486145 (0.15911033176458803) | > loss_disc_real_1: 0.2333199381828308 (0.23702804171122038) | > loss_disc_real_2: 0.20033223927021027 (0.2373952336418323) | > loss_disc_real_3: 0.2717953324317932 (0.24056547154218721) | > loss_disc_real_4: 0.2285935878753662 (0.23356226946298891) | > loss_disc_real_5: 0.2526744306087494 (0.22720111538775456) | > loss_0: 2.6980819702148438 (2.5684375701806483) | > grad_norm_0: tensor(280.4154, device='cuda:0') (tensor(669.2642, device='cuda:0')) | > loss_gen: 1.896799087524414 (2.1124719503598337) | > loss_kl: 0.5649265646934509 (0.7640274219596997) | > loss_feat: 2.4567596912384033 (4.700796503860217) | > loss_mel: 8.993507385253906 (18.886668510926068) | > loss_duration: 1.3392531871795654 (1.289673863313137) | > loss_1: 15.251246452331543 (27.753638340876652) | > grad_norm_1: tensor(26204.5801, device='cuda:0') (tensor(16677.6387, device='cuda:0')) | > current_lr_0: 5.455646237588303e-05 | > current_lr_1: 5.461104953906007e-05 | > step_time: 0.3545 (0.5504452754289676) | > loader_time: 0.0058 (0.020298163096110027)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5604381561279297 (2.5604381561279297) | > loss_disc_real_0: 0.18911628425121307 (0.18911628425121307) | > loss_disc_real_1: 0.2765243351459503 (0.2765243351459503) | > loss_disc_real_2: 0.3351755440235138 (0.3351755440235138) | > loss_disc_real_3: 0.31748026609420776 (0.31748026609420776) | > loss_disc_real_4: 0.34899845719337463 (0.34899845719337463) | > loss_disc_real_5: 0.2836155295372009 (0.2836155295372009) | > loss_0: 2.5604381561279297 (2.5604381561279297) | > loss_gen: 2.8874564170837402 (2.8874564170837402) | > loss_kl: 5.721680641174316 (5.721680641174316) | > loss_feat: 6.634260177612305 (6.634260177612305) | > loss_mel: 23.837894439697266 (23.837894439697266) | > loss_duration: 3.1616880893707275 (3.1616880893707275) | > loss_1: 42.24298095703125 (42.24298095703125)  --> STEP: 1 | > loss_disc: 1.96573805809021 (1.96573805809021) | > loss_disc_real_0: 0.05026993155479431 (0.05026993155479431) | > loss_disc_real_1: 0.19389508664608002 (0.19389508664608002) | > loss_disc_real_2: 0.22598835825920105 (0.22598835825920105) | > loss_disc_real_3: 0.2315136343240738 (0.2315136343240738) | > loss_disc_real_4: 0.10319417715072632 (0.10319417715072632) | > loss_disc_real_5: 0.14406150579452515 (0.14406150579452515) | > loss_0: 1.96573805809021 (1.96573805809021) | > loss_gen: 2.28244686126709 (2.28244686126709) | > loss_kl: 5.490978240966797 (5.490978240966797) | > loss_feat: 8.674958229064941 (8.674958229064941) | > loss_mel: 22.856826782226562 (22.856826782226562) | > loss_duration: 3.4543375968933105 (3.4543375968933105) | > loss_1: 42.75954818725586 (42.75954818725586)  --> STEP: 2 | > loss_disc: 2.9535863399505615 (2.4596621990203857) | > loss_disc_real_0: 0.23168277740478516 (0.14097635447978973) | > loss_disc_real_1: 0.28537142276763916 (0.2396332547068596) | > loss_disc_real_2: 0.3235018849372864 (0.2747451215982437) | > loss_disc_real_3: 0.29408347606658936 (0.2627985551953316) | > loss_disc_real_4: 0.32503652572631836 (0.21411535143852234) | > loss_disc_real_5: 0.2811676561832428 (0.21261458098888397) | > loss_0: 2.9535863399505615 (2.4596621990203857) | > loss_gen: 1.9595082998275757 (2.1209775805473328) | > loss_kl: 6.229831218719482 (5.86040472984314) | > loss_feat: 1.6062405109405518 (5.140599370002747) | > loss_mel: 20.276241302490234 (21.5665340423584) | > loss_duration: 3.417945384979248 (3.4361414909362793) | > loss_1: 33.48976516723633 (38.124656677246094)  --> STEP: 3 | > loss_disc: 2.45078182220459 (2.4567020734151206) | > loss_disc_real_0: 0.1758665144443512 (0.1526064078013102) | > loss_disc_real_1: 0.25397244095802307 (0.2444129834572474) | > loss_disc_real_2: 0.24637915194034576 (0.2652897983789444) | > loss_disc_real_3: 0.21440277993679047 (0.2466666301091512) | > loss_disc_real_4: 0.2163534313440323 (0.21486137807369232) | > loss_disc_real_5: 0.35070598125457764 (0.2586450477441152) | > loss_0: 2.45078182220459 (2.4567020734151206) | > loss_gen: 2.5557618141174316 (2.2659056584040322) | > loss_kl: 2.569800853729248 (4.763536771138509) | > loss_feat: 5.04417085647583 (5.108456532160441) | > loss_mel: 22.152667999267578 (21.761912027994793) | > loss_duration: 3.0738956928253174 (3.3153928915659585) | > loss_1: 35.396297454833984 (37.215203603108726) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_118000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1390132904052734 (2.6272798776626587) | > loss_disc_real_0: 0.3066728711128235 (0.19112302362918854) | > loss_disc_real_1: 0.4873669445514679 (0.30515147373080254) | > loss_disc_real_2: 0.48541346192359924 (0.3203207142651081) | > loss_disc_real_3: 0.31657108664512634 (0.264142744243145) | > loss_disc_real_4: 0.3940718173980713 (0.25966398790478706) | > loss_disc_real_5: 0.3469701409339905 (0.280726321041584) | > loss_0: 3.1390132904052734 (2.6272798776626587) | > loss_gen: 2.8756909370422363 (2.4183519780635834) | > loss_kl: 5.5704145431518555 (4.965256214141846) | > loss_feat: 6.885771751403809 (5.552785336971283) | > loss_mel: 23.670642852783203 (22.239094734191895) | > loss_duration: 3.1348392963409424 (3.2702544927597046) | > loss_1: 42.137359619140625 (38.4457426071167)  --> STEP: 1 | > loss_disc: 2.2715930938720703 (2.556142520904541) | > loss_disc_real_0: 0.09048206359148026 (0.1709948316216469) | > loss_disc_real_1: 0.25847989320755005 (0.295817157626152) | > loss_disc_real_2: 0.27250662446022034 (0.31075789630413053) | > loss_disc_real_3: 0.21486833691596985 (0.25428786277771) | > loss_disc_real_4: 0.15645365417003632 (0.2390219211578369) | > loss_disc_real_5: 0.19668833911418915 (0.26391872465610505) | > loss_0: 2.2715930938720703 (2.556142520904541) | > loss_gen: 2.495790481567383 (2.4338396787643433) | > loss_kl: 5.792847156524658 (5.130774402618409) | > loss_feat: 6.492973327636719 (5.7408229351043705) | > loss_mel: 21.695096969604492 (22.130295181274413) | > loss_duration: 3.4922873973846436 (3.314661073684692) | > loss_1: 39.968994140625 (38.75039291381836)  --> STEP: 2 | > loss_disc: 2.804492950439453 (2.59753425916036) | > loss_disc_real_0: 0.3324723243713379 (0.19790774707992873) | > loss_disc_real_1: 0.27944040298461914 (0.2930876985192299) | > loss_disc_real_2: 0.2643987238407135 (0.3030313675602277) | > loss_disc_real_3: 0.25258371233940125 (0.2540038377046585) | > loss_disc_real_4: 0.4504297971725464 (0.2742565671602885) | > loss_disc_real_5: 0.31946811079978943 (0.27317695568005246) | > loss_0: 2.804492950439453 (2.59753425916036) | > loss_gen: 2.79133939743042 (2.4934229652086892) | > loss_kl: 6.442340850830078 (5.3493688106536865) | > loss_feat: 8.10666275024414 (6.1351295709609985) | > loss_mel: 22.7307186126709 (22.230365753173828) | > loss_duration: 3.3790977001190186 (3.3254005114237466) | > loss_1: 43.45016098022461 (39.533687591552734)  --> STEP: 3 | > loss_disc: 2.941819190979004 (2.6467178208487376) | > loss_disc_real_0: 0.32838141918182373 (0.21654684309448516) | > loss_disc_real_1: 0.2608676552772522 (0.28848483519894735) | > loss_disc_real_2: 0.32539990544319153 (0.3062268729720797) | > loss_disc_real_3: 0.285442054271698 (0.25849501149994986) | > loss_disc_real_4: 0.29369035363197327 (0.2770328223705292) | > loss_disc_real_5: 0.2618589401245117 (0.2715600963149752) | > loss_0: 2.941819190979004 (2.6467178208487376) | > loss_gen: 1.9052678346633911 (2.4094008037022183) | > loss_kl: 2.4687721729278564 (4.937855005264282) | > loss_feat: 0.4760023355484009 (5.326682823044913) | > loss_mel: 15.579068183898926 (21.280180386134557) | > loss_duration: 3.1060752868652344 (3.2940683364868164) | > loss_1: 23.535184860229492 (37.2481872013637) --> EVAL PERFORMANCE | > avg_loader_time: 0.46852203777858187 (+0.46604502768743605) | > avg_loss_disc: 2.6467178208487376 (-0.26244136265345963) | > avg_loss_disc_real_0: 0.21654684309448516 (-0.07754782871121449) | > avg_loss_disc_real_1: 0.28848483519894735 (+0.04357789314928509) | > avg_loss_disc_real_2: 0.3062268729720797 (+0.08426574475708462) | > avg_loss_disc_real_3: 0.25849501149994986 (+0.03410476800941284) | > avg_loss_disc_real_4: 0.2770328223705292 (+0.010283897320429503) | > avg_loss_disc_real_5: 0.2715600963149752 (-0.0006024007286344335) | > avg_loss_0: 2.6467178208487376 (-0.26244136265345963) | > avg_loss_gen: 2.4094008037022183 (+0.6786602167856126) | > avg_loss_kl: 4.937855005264282 (-0.18960905075073242) | > avg_loss_feat: 5.326682823044913 (+3.3522653327811334) | > avg_loss_mel: 21.280180386134557 (+7.644086372284663) | > avg_loss_duration: 3.2940683364868164 (+0.04809824625651027) | > avg_loss_1: 37.2481872013637 (+11.533502397083101)  > EPOCH: 1300/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:43:49)   --> TIME: 2023-10-20 16:44:06 -- STEP: 19/50 -- GLOBAL_STEP: 118020 | > loss_disc: 3.088486909866333 (2.6220163169660067) | > loss_disc_real_0: 0.12727925181388855 (0.16737217495315954) | > loss_disc_real_1: 0.29144278168678284 (0.24811117900045296) | > loss_disc_real_2: 0.3952369689941406 (0.2650917707697341) | > loss_disc_real_3: 0.31175991892814636 (0.25536711161073883) | > loss_disc_real_4: 0.3658297657966614 (0.2856143383603347) | > loss_disc_real_5: 0.20889711380004883 (0.270321512692853) | > loss_0: 3.088486909866333 (2.6220163169660067) | > grad_norm_0: tensor(480.6502, device='cuda:0') (tensor(737.3344, device='cuda:0')) | > loss_gen: 1.937417984008789 (2.246909361136587) | > loss_kl: 1.0051658153533936 (0.8119680473678991) | > loss_feat: 5.303394794464111 (4.583110169360512) | > loss_mel: 23.115175247192383 (18.934864671606768) | > loss_duration: 1.4404064416885376 (1.3506900824998553) | > loss_1: 32.80155944824219 (27.92754208414178) | > grad_norm_1: tensor(7224.4761, device='cuda:0') (tensor(17417.2109, device='cuda:0')) | > current_lr_0: 5.4501929775993236e-05 | > current_lr_1: 5.455646237588303e-05 | > step_time: 0.8151 (0.6345727694661993) | > loader_time: 0.0266 (0.021594838092201633)  --> TIME: 2023-10-20 16:44:23 -- STEP: 49/50 -- GLOBAL_STEP: 118050 | > loss_disc: 2.8310470581054688 (2.4709791966847003) | > loss_disc_real_0: 0.12581244111061096 (0.1574424450114673) | > loss_disc_real_1: 0.23997947573661804 (0.22196635816778457) | > loss_disc_real_2: 0.26843950152397156 (0.22146748485309736) | > loss_disc_real_3: 0.28433042764663696 (0.2232274044381112) | > loss_disc_real_4: 0.2563782036304474 (0.23335721511013655) | > loss_disc_real_5: 0.2756955921649933 (0.23582513250258505) | > loss_0: 2.8310470581054688 (2.4709791966847003) | > grad_norm_0: tensor(1254.7268, device='cuda:0') (tensor(747.1433, device='cuda:0')) | > loss_gen: 1.663781762123108 (2.1919998149482574) | > loss_kl: 0.5072780847549438 (0.7488830734272393) | > loss_feat: 0.5443261861801147 (4.8488315917855624) | > loss_mel: 10.497346878051758 (18.488439756996776) | > loss_duration: 1.4149450063705444 (1.3095345253847084) | > loss_1: 14.627677917480469 (27.58768872825467) | > grad_norm_1: tensor(14656.1738, device='cuda:0') (tensor(16321.1396, device='cuda:0')) | > current_lr_0: 5.4501929775993236e-05 | > current_lr_1: 5.455646237588303e-05 | > step_time: 0.9205 (0.5818520176167391) | > loader_time: 0.5203 (0.028273752757481167)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4618825912475586 (2.4618825912475586) | > loss_disc_real_0: 0.17141136527061462 (0.17141136527061462) | > loss_disc_real_1: 0.28594112396240234 (0.28594112396240234) | > loss_disc_real_2: 0.3700091242790222 (0.3700091242790222) | > loss_disc_real_3: 0.34451836347579956 (0.34451836347579956) | > loss_disc_real_4: 0.24724969267845154 (0.24724969267845154) | > loss_disc_real_5: 0.16625213623046875 (0.16625213623046875) | > loss_0: 2.4618825912475586 (2.4618825912475586) | > loss_gen: 2.5002193450927734 (2.5002193450927734) | > loss_kl: 6.340308666229248 (6.340308666229248) | > loss_feat: 5.620420932769775 (5.620420932769775) | > loss_mel: 22.738719940185547 (22.738719940185547) | > loss_duration: 3.1525354385375977 (3.1525354385375977) | > loss_1: 40.352203369140625 (40.352203369140625)  --> STEP: 1 | > loss_disc: 2.9940836429595947 (2.9940836429595947) | > loss_disc_real_0: 0.261699914932251 (0.261699914932251) | > loss_disc_real_1: 0.2721271812915802 (0.2721271812915802) | > loss_disc_real_2: 0.2555771768093109 (0.2555771768093109) | > loss_disc_real_3: 0.27197951078414917 (0.27197951078414917) | > loss_disc_real_4: 0.25883087515830994 (0.25883087515830994) | > loss_disc_real_5: 0.2973737418651581 (0.2973737418651581) | > loss_0: 2.9940836429595947 (2.9940836429595947) | > loss_gen: 1.8896325826644897 (1.8896325826644897) | > loss_kl: 5.920351982116699 (5.920351982116699) | > loss_feat: 2.4632043838500977 (2.4632043838500977) | > loss_mel: 20.111738204956055 (20.111738204956055) | > loss_duration: 3.4037728309631348 (3.4037728309631348) | > loss_1: 33.788700103759766 (33.788700103759766)  --> STEP: 2 | > loss_disc: 2.930023431777954 (2.9620535373687744) | > loss_disc_real_0: 0.15207788348197937 (0.20688889920711517) | > loss_disc_real_1: 0.2395108938217163 (0.25581903755664825) | > loss_disc_real_2: 0.24276933073997498 (0.24917325377464294) | > loss_disc_real_3: 0.28568971157073975 (0.27883461117744446) | > loss_disc_real_4: 0.254548043012619 (0.2566894590854645) | > loss_disc_real_5: 0.26830875873565674 (0.2828412503004074) | > loss_0: 2.930023431777954 (2.9620535373687744) | > loss_gen: 1.525666356086731 (1.7076494693756104) | > loss_kl: 6.312613487243652 (6.116482734680176) | > loss_feat: 0.23636358976364136 (1.3497839868068695) | > loss_mel: 2.0016143321990967 (11.056676268577576) | > loss_duration: 3.4735193252563477 (3.438646078109741) | > loss_1: 13.549777030944824 (23.669238567352295)  --> STEP: 3 | > loss_disc: 2.558602809906006 (2.8275699615478516) | > loss_disc_real_0: 0.1309673935174942 (0.18158173064390817) | > loss_disc_real_1: 0.2274094521999359 (0.24634917577107748) | > loss_disc_real_2: 0.3216785788536072 (0.27334169546763104) | > loss_disc_real_3: 0.2838151454925537 (0.2804947892824809) | > loss_disc_real_4: 0.1968538761138916 (0.23674426476160684) | > loss_disc_real_5: 0.1997651308774948 (0.2551492104927699) | > loss_0: 2.558602809906006 (2.8275699615478516) | > loss_gen: 2.0380218029022217 (1.8177735805511475) | > loss_kl: 3.1788010597229004 (5.137255509694417) | > loss_feat: 2.165306568145752 (1.6216248472531636) | > loss_mel: 17.768205642700195 (13.293852726618448) | > loss_duration: 3.066859245300293 (3.3147171338399253) | > loss_1: 28.217193603515625 (25.18522357940674) --> EVAL PERFORMANCE | > avg_loader_time: 0.006175597508748372 (-0.4623464402698335) | > avg_loss_disc: 2.8275699615478516 (+0.18085214069911393) | > avg_loss_disc_real_0: 0.18158173064390817 (-0.034965112450576985) | > avg_loss_disc_real_1: 0.24634917577107748 (-0.04213565942786987) | > avg_loss_disc_real_2: 0.27334169546763104 (-0.03288517750444864) | > avg_loss_disc_real_3: 0.2804947892824809 (+0.021999777782531038) | > avg_loss_disc_real_4: 0.23674426476160684 (-0.04028855760892233) | > avg_loss_disc_real_5: 0.2551492104927699 (-0.01641088582220529) | > avg_loss_0: 2.8275699615478516 (+0.18085214069911393) | > avg_loss_gen: 1.8177735805511475 (-0.5916272231510709) | > avg_loss_kl: 5.137255509694417 (+0.1994005044301348) | > avg_loss_feat: 1.6216248472531636 (-3.7050579757917497) | > avg_loss_mel: 13.293852726618448 (-7.986327659516109) | > avg_loss_duration: 3.3147171338399253 (+0.020648797353108872) | > avg_loss_1: 25.18522357940674 (-12.06296362195696)  > EPOCH: 1301/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:44:41)   --> TIME: 2023-10-20 16:45:03 -- STEP: 29/50 -- GLOBAL_STEP: 118080 | > loss_disc: 2.5139458179473877 (2.428860356067789) | > loss_disc_real_0: 0.20383384823799133 (0.16125454560949884) | > loss_disc_real_1: 0.21471518278121948 (0.22449978479537472) | > loss_disc_real_2: 0.20149153470993042 (0.22388703376054764) | > loss_disc_real_3: 0.21055220067501068 (0.23884167355196229) | > loss_disc_real_4: 0.2593245804309845 (0.24611480688226633) | > loss_disc_real_5: 0.35664454102516174 (0.24613332138236227) | > loss_0: 2.5139458179473877 (2.428860356067789) | > grad_norm_0: tensor(388.6351, device='cuda:0') (tensor(808.1877, device='cuda:0')) | > loss_gen: 2.2026844024658203 (2.4283510898721627) | > loss_kl: 0.7380576729774475 (0.8660661259601856) | > loss_feat: 4.627224445343018 (6.224346122865019) | > loss_mel: 16.400083541870117 (19.75953769683838) | > loss_duration: 1.2658199071884155 (1.3044690921388824) | > loss_1: 25.233869552612305 (30.582770347595215) | > grad_norm_1: tensor(9446.9443, device='cuda:0') (tensor(17954.0625, device='cuda:0')) | > current_lr_0: 5.444745168485129e-05 | > current_lr_1: 5.4501929775993236e-05 | > step_time: 0.7197 (0.5514942366501381) | > loader_time: 0.027 (0.019882794084220102)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3887014389038086 (2.3887014389038086) | > loss_disc_real_0: 0.08821742981672287 (0.08821742981672287) | > loss_disc_real_1: 0.20688819885253906 (0.20688819885253906) | > loss_disc_real_2: 0.11771674454212189 (0.11771674454212189) | > loss_disc_real_3: 0.1646961122751236 (0.1646961122751236) | > loss_disc_real_4: 0.2042940855026245 (0.2042940855026245) | > loss_disc_real_5: 0.16175591945648193 (0.16175591945648193) | > loss_0: 2.3887014389038086 (2.3887014389038086) | > loss_gen: 1.7106038331985474 (1.7106038331985474) | > loss_kl: 6.844411849975586 (6.844411849975586) | > loss_feat: 2.9248342514038086 (2.9248342514038086) | > loss_mel: 19.299041748046875 (19.299041748046875) | > loss_duration: 3.167433738708496 (3.167433738708496) | > loss_1: 33.94632339477539 (33.94632339477539)  --> STEP: 1 | > loss_disc: 2.723557710647583 (2.723557710647583) | > loss_disc_real_0: 0.1232864111661911 (0.1232864111661911) | > loss_disc_real_1: 0.20584383606910706 (0.20584383606910706) | > loss_disc_real_2: 0.1741006076335907 (0.1741006076335907) | > loss_disc_real_3: 0.21157333254814148 (0.21157333254814148) | > loss_disc_real_4: 0.20968025922775269 (0.20968025922775269) | > loss_disc_real_5: 0.25612619519233704 (0.25612619519233704) | > loss_0: 2.723557710647583 (2.723557710647583) | > loss_gen: 1.477145791053772 (1.477145791053772) | > loss_kl: 5.823103427886963 (5.823103427886963) | > loss_feat: 1.3069779872894287 (1.3069779872894287) | > loss_mel: 18.077909469604492 (18.077909469604492) | > loss_duration: 3.4728784561157227 (3.4728784561157227) | > loss_1: 30.158016204833984 (30.158016204833984)  --> STEP: 2 | > loss_disc: 2.833432912826538 (2.7784953117370605) | > loss_disc_real_0: 0.3037196397781372 (0.21350302547216415) | > loss_disc_real_1: 0.23568730056285858 (0.22076556831598282) | > loss_disc_real_2: 0.2533806264400482 (0.21374061703681946) | > loss_disc_real_3: 0.2049836367368698 (0.20827848464250565) | > loss_disc_real_4: 0.18078665435314178 (0.19523345679044724) | > loss_disc_real_5: 0.194315567612648 (0.22522088140249252) | > loss_0: 2.833432912826538 (2.7784953117370605) | > loss_gen: 1.7262110710144043 (1.6016784310340881) | > loss_kl: 6.186283588409424 (6.004693508148193) | > loss_feat: 2.211113452911377 (1.7590457201004028) | > loss_mel: 25.35073471069336 (21.714322090148926) | > loss_duration: 3.299605369567871 (3.386241912841797) | > loss_1: 38.773948669433594 (34.46598243713379)  --> STEP: 3 | > loss_disc: 2.6614866256713867 (2.739492416381836) | > loss_disc_real_0: 0.2096298784017563 (0.21221197644869486) | > loss_disc_real_1: 0.1888751983642578 (0.21013544499874115) | > loss_disc_real_2: 0.19829533994197845 (0.20859219133853912) | > loss_disc_real_3: 0.15195898711681366 (0.1895053188006083) | > loss_disc_real_4: 0.191267728805542 (0.19391154746214548) | > loss_disc_real_5: 0.18992003798484802 (0.21345393359661102) | > loss_0: 2.6614866256713867 (2.739492416381836) | > loss_gen: 1.7991187572479248 (1.667491873105367) | > loss_kl: 2.963329553604126 (4.990905523300171) | > loss_feat: 4.890578269958496 (2.802889903386434) | > loss_mel: 16.95612335205078 (20.12825584411621) | > loss_duration: 3.028425931930542 (3.266969919204712) | > loss_1: 29.637575149536133 (32.856513341267906) --> EVAL PERFORMANCE | > avg_loader_time: 0.02967699368794759 (+0.02350139617919922) | > avg_loss_disc: 2.739492416381836 (-0.08807754516601562) | > avg_loss_disc_real_0: 0.21221197644869486 (+0.030630245804786682) | > avg_loss_disc_real_1: 0.21013544499874115 (-0.03621373077233633) | > avg_loss_disc_real_2: 0.20859219133853912 (-0.06474950412909192) | > avg_loss_disc_real_3: 0.1895053188006083 (-0.09098947048187259) | > avg_loss_disc_real_4: 0.19391154746214548 (-0.042832717299461365) | > avg_loss_disc_real_5: 0.21345393359661102 (-0.04169527689615887) | > avg_loss_0: 2.739492416381836 (-0.08807754516601562) | > avg_loss_gen: 1.667491873105367 (-0.1502817074457805) | > avg_loss_kl: 4.990905523300171 (-0.14634998639424612) | > avg_loss_feat: 2.802889903386434 (+1.1812650561332705) | > avg_loss_mel: 20.12825584411621 (+6.834403117497763) | > avg_loss_duration: 3.266969919204712 (-0.047747214635213364) | > avg_loss_1: 32.856513341267906 (+7.671289761861168)  > EPOCH: 1302/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:45:33)   --> TIME: 2023-10-20 16:45:43 -- STEP: 9/50 -- GLOBAL_STEP: 118110 | > loss_disc: 2.78362774848938 (2.545341624153985) | > loss_disc_real_0: 0.1629263013601303 (0.16239228078888523) | > loss_disc_real_1: 0.2461051642894745 (0.19706565307246315) | > loss_disc_real_2: 0.2632295787334442 (0.2094644597835011) | > loss_disc_real_3: 0.2342766970396042 (0.19120446427000892) | > loss_disc_real_4: 0.245883509516716 (0.21752906921837065) | > loss_disc_real_5: 0.23102787137031555 (0.20904134027659893) | > loss_0: 2.78362774848938 (2.545341624153985) | > grad_norm_0: tensor(753.0865, device='cuda:0') (tensor(632.2616, device='cuda:0')) | > loss_gen: 1.726407527923584 (2.1085476875305176) | > loss_kl: 0.7356846332550049 (1.0231430133183796) | > loss_feat: 0.6427743434906006 (5.299021542072296) | > loss_mel: 16.244884490966797 (19.317564845085144) | > loss_duration: 1.256901502609253 (1.3026001585854425) | > loss_1: 20.606653213500977 (29.05087688234117) | > grad_norm_1: tensor(43452.9375, device='cuda:0') (tensor(23711.1426, device='cuda:0')) | > current_lr_0: 5.439302804797227e-05 | > current_lr_1: 5.444745168485129e-05 | > step_time: 0.8199 (0.6276259422302246) | > loader_time: 0.032 (0.025061607360839844)  --> TIME: 2023-10-20 16:46:03 -- STEP: 39/50 -- GLOBAL_STEP: 118140 | > loss_disc: 2.7533788681030273 (2.4255805107263413) | > loss_disc_real_0: 0.18628685176372528 (0.1470981645756043) | > loss_disc_real_1: 0.3313167989253998 (0.22214981264028794) | > loss_disc_real_2: 0.3661402761936188 (0.21419427945063665) | > loss_disc_real_3: 0.35577431321144104 (0.21897441951128152) | > loss_disc_real_4: 0.2998396158218384 (0.2297959442322071) | > loss_disc_real_5: 0.25789058208465576 (0.21174165066809225) | > loss_0: 2.7533788681030273 (2.4255805107263413) | > grad_norm_0: tensor(1174.8239, device='cuda:0') (tensor(631.3065, device='cuda:0')) | > loss_gen: 2.4089057445526123 (2.3035739171199308) | > loss_kl: 0.4721241295337677 (0.81386239024309) | > loss_feat: 2.482090711593628 (6.024147365337762) | > loss_mel: 19.95475196838379 (20.8715900243857) | > loss_duration: 1.331154465675354 (1.3006674784880419) | > loss_1: 26.649024963378906 (31.31384090276865) | > grad_norm_1: tensor(5272.7026, device='cuda:0') (tensor(17878.4766, device='cuda:0')) | > current_lr_0: 5.439302804797227e-05 | > current_lr_1: 5.444745168485129e-05 | > step_time: 0.8209 (0.633723680789654) | > loader_time: 0.0269 (0.025649370291294195)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.9237298965454102 (1.9237298965454102) | > loss_disc_real_0: 0.14655807614326477 (0.14655807614326477) | > loss_disc_real_1: 0.17981433868408203 (0.17981433868408203) | > loss_disc_real_2: 0.12826310098171234 (0.12826310098171234) | > loss_disc_real_3: 0.20892353355884552 (0.20892353355884552) | > loss_disc_real_4: 0.10373475402593613 (0.10373475402593613) | > loss_disc_real_5: 0.046261873096227646 (0.046261873096227646) | > loss_0: 1.9237298965454102 (1.9237298965454102) | > loss_gen: 2.1463277339935303 (2.1463277339935303) | > loss_kl: 7.069833755493164 (7.069833755493164) | > loss_feat: 9.419357299804688 (9.419357299804688) | > loss_mel: 19.492481231689453 (19.492481231689453) | > loss_duration: 3.205821990966797 (3.205821990966797) | > loss_1: 41.333824157714844 (41.333824157714844)  --> STEP: 1 | > loss_disc: 2.570138454437256 (2.570138454437256) | > loss_disc_real_0: 0.10652410238981247 (0.10652410238981247) | > loss_disc_real_1: 0.2924761474132538 (0.2924761474132538) | > loss_disc_real_2: 0.27352699637413025 (0.27352699637413025) | > loss_disc_real_3: 0.25110408663749695 (0.25110408663749695) | > loss_disc_real_4: 0.3374999165534973 (0.3374999165534973) | > loss_disc_real_5: 0.2019115388393402 (0.2019115388393402) | > loss_0: 2.570138454437256 (2.570138454437256) | > loss_gen: 2.182640790939331 (2.182640790939331) | > loss_kl: 5.4907026290893555 (5.4907026290893555) | > loss_feat: 3.534881353378296 (3.534881353378296) | > loss_mel: 20.728357315063477 (20.728357315063477) | > loss_duration: 3.515054941177368 (3.515054941177368) | > loss_1: 35.451637268066406 (35.451637268066406)  --> STEP: 2 | > loss_disc: 1.7609854936599731 (2.1655619740486145) | > loss_disc_real_0: 0.09423571825027466 (0.10037991032004356) | > loss_disc_real_1: 0.2814139425754547 (0.28694504499435425) | > loss_disc_real_2: 0.14620135724544525 (0.20986417680978775) | > loss_disc_real_3: 0.2941228747367859 (0.2726134806871414) | > loss_disc_real_4: 0.08370871096849442 (0.21060431376099586) | > loss_disc_real_5: 0.12579494714736938 (0.1638532429933548) | > loss_0: 1.7609854936599731 (2.1655619740486145) | > loss_gen: 2.9237074851989746 (2.553174138069153) | > loss_kl: 5.973299980163574 (5.732001304626465) | > loss_feat: 9.600658416748047 (6.567769885063171) | > loss_mel: 26.077152252197266 (23.40275478363037) | > loss_duration: 3.4031972885131836 (3.459126114845276) | > loss_1: 47.9780158996582 (41.714826583862305)  --> STEP: 3 | > loss_disc: 2.837972640991211 (2.38969886302948) | > loss_disc_real_0: 0.2171735316514969 (0.13931111743052801) | > loss_disc_real_1: 0.34150591492652893 (0.3051320016384125) | > loss_disc_real_2: 0.31702786684036255 (0.24558540681997934) | > loss_disc_real_3: 0.49123820662498474 (0.3454883893330892) | > loss_disc_real_4: 0.36349761486053467 (0.26156874746084213) | > loss_disc_real_5: 0.2975273132324219 (0.20841126640637717) | > loss_0: 2.837972640991211 (2.38969886302948) | > loss_gen: 2.6603589057922363 (2.588902393976847) | > loss_kl: 2.940465211868286 (4.801489273707072) | > loss_feat: 5.313686370849609 (6.149742046991984) | > loss_mel: 21.578617095947266 (22.794708887736004) | > loss_duration: 2.9477367401123047 (3.2886629899342856) | > loss_1: 35.44086456298828 (39.62350591023763) --> EVAL PERFORMANCE | > avg_loader_time: 0.004879872004191081 (-0.024797121683756508) | > avg_loss_disc: 2.38969886302948 (-0.34979355335235596) | > avg_loss_disc_real_0: 0.13931111743052801 (-0.07290085901816684) | > avg_loss_disc_real_1: 0.3051320016384125 (+0.09499655663967133) | > avg_loss_disc_real_2: 0.24558540681997934 (+0.03699321548144022) | > avg_loss_disc_real_3: 0.3454883893330892 (+0.15598307053248087) | > avg_loss_disc_real_4: 0.26156874746084213 (+0.06765719999869665) | > avg_loss_disc_real_5: 0.20841126640637717 (-0.005042667190233857) | > avg_loss_0: 2.38969886302948 (-0.34979355335235596) | > avg_loss_gen: 2.588902393976847 (+0.9214105208714802) | > avg_loss_kl: 4.801489273707072 (-0.18941624959309866) | > avg_loss_feat: 6.149742046991984 (+3.3468521436055503) | > avg_loss_mel: 22.794708887736004 (+2.666453043619793) | > avg_loss_duration: 3.2886629899342856 (+0.021693070729573716) | > avg_loss_1: 39.62350591023763 (+6.766992568969727)  > EPOCH: 1303/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:46:25)   --> TIME: 2023-10-20 16:46:39 -- STEP: 19/50 -- GLOBAL_STEP: 118170 | > loss_disc: 2.428715705871582 (2.4933346698158667) | > loss_disc_real_0: 0.08426226675510406 (0.14703401050677425) | > loss_disc_real_1: 0.39420536160469055 (0.223960663535093) | > loss_disc_real_2: 0.2832942008972168 (0.2148022420312229) | > loss_disc_real_3: 0.4077416658401489 (0.23645705484638088) | > loss_disc_real_4: 0.2506387233734131 (0.20866270049622185) | > loss_disc_real_5: 0.12280445545911789 (0.21817784011363983) | > loss_0: 2.428715705871582 (2.4933346698158667) | > grad_norm_0: tensor(1110.5045, device='cuda:0') (tensor(1356.8666, device='cuda:0')) | > loss_gen: 2.6731064319610596 (2.13795030117035) | > loss_kl: 0.6944566965103149 (0.7848163513760817) | > loss_feat: 7.073920726776123 (5.250202917935033) | > loss_mel: 23.105562210083008 (17.68312449831712) | > loss_duration: 1.3878353834152222 (1.3374872521350258) | > loss_1: 34.93488311767578 (27.193581681502494) | > grad_norm_1: tensor(16197.5703, device='cuda:0') (tensor(43291.9922, device='cuda:0')) | > current_lr_0: 5.433865881092574e-05 | > current_lr_1: 5.439302804797227e-05 | > step_time: 0.3416 (0.4603437624479595) | > loader_time: 0.0106 (0.012341398941843133)  --> TIME: 2023-10-20 16:46:51 -- STEP: 49/50 -- GLOBAL_STEP: 118200 | > loss_disc: 3.0522260665893555 (2.4362074915243666) | > loss_disc_real_0: 0.3702269196510315 (0.13551483748062532) | > loss_disc_real_1: 0.25777363777160645 (0.22517763610397065) | > loss_disc_real_2: 0.271188884973526 (0.22036450713568803) | > loss_disc_real_3: 0.24278534948825836 (0.22241094210470208) | > loss_disc_real_4: 0.25295963883399963 (0.21312951851560144) | > loss_disc_real_5: 0.29320061206817627 (0.2206093697067426) | > loss_0: 3.0522260665893555 (2.4362074915243666) | > grad_norm_0: tensor(5952.4062, device='cuda:0') (tensor(1408.8323, device='cuda:0')) | > loss_gen: 1.660441517829895 (2.216091552559209) | > loss_kl: 0.611305296421051 (0.6858181864099235) | > loss_feat: 0.09550715982913971 (5.57898064999252) | > loss_mel: 2.490731716156006 (19.22902617405872) | > loss_duration: 1.381242036819458 (1.2994704149207292) | > loss_1: 6.239227294921875 (29.00938689951994) | > grad_norm_1: tensor(52257.4609, device='cuda:0') (tensor(34447.9180, device='cuda:0')) | > current_lr_0: 5.433865881092574e-05 | > current_lr_1: 5.439302804797227e-05 | > step_time: 0.5708 (0.41891624976177605) | > loader_time: 0.4802 (0.018722509851261063)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9163432121276855 (2.9163432121276855) | > loss_disc_real_0: 0.3178431987762451 (0.3178431987762451) | > loss_disc_real_1: 0.38719213008880615 (0.38719213008880615) | > loss_disc_real_2: 0.23774784803390503 (0.23774784803390503) | > loss_disc_real_3: 0.3708494007587433 (0.3708494007587433) | > loss_disc_real_4: 0.3520919978618622 (0.3520919978618622) | > loss_disc_real_5: 0.3282015323638916 (0.3282015323638916) | > loss_0: 2.9163432121276855 (2.9163432121276855) | > loss_gen: 2.4231081008911133 (2.4231081008911133) | > loss_kl: 6.114642143249512 (6.114642143249512) | > loss_feat: 3.6677234172821045 (3.6677234172821045) | > loss_mel: 16.635696411132812 (16.635696411132812) | > loss_duration: 3.270237684249878 (3.270237684249878) | > loss_1: 32.11140823364258 (32.11140823364258)  --> STEP: 1 | > loss_disc: 2.8651461601257324 (2.8651461601257324) | > loss_disc_real_0: 0.49733033776283264 (0.49733033776283264) | > loss_disc_real_1: 0.2422802597284317 (0.2422802597284317) | > loss_disc_real_2: 0.27678191661834717 (0.27678191661834717) | > loss_disc_real_3: 0.3027120530605316 (0.3027120530605316) | > loss_disc_real_4: 0.28291019797325134 (0.28291019797325134) | > loss_disc_real_5: 0.2303445041179657 (0.2303445041179657) | > loss_0: 2.8651461601257324 (2.8651461601257324) | > loss_gen: 2.386789560317993 (2.386789560317993) | > loss_kl: 5.737295150756836 (5.737295150756836) | > loss_feat: 5.294130325317383 (5.294130325317383) | > loss_mel: 23.632190704345703 (23.632190704345703) | > loss_duration: 3.4174439907073975 (3.4174439907073975) | > loss_1: 40.46784973144531 (40.46784973144531)  --> STEP: 2 | > loss_disc: 2.959167242050171 (2.9121567010879517) | > loss_disc_real_0: 0.3772835433483124 (0.4373069405555725) | > loss_disc_real_1: 0.2973383665084839 (0.2698093131184578) | > loss_disc_real_2: 0.305048406124115 (0.2909151613712311) | > loss_disc_real_3: 0.24979710578918457 (0.2762545794248581) | > loss_disc_real_4: 0.25155583024024963 (0.2672330141067505) | > loss_disc_real_5: 0.2725219130516052 (0.25143320858478546) | > loss_0: 2.959167242050171 (2.9121567010879517) | > loss_gen: 1.895272970199585 (2.141031265258789) | > loss_kl: 6.631965637207031 (6.184630393981934) | > loss_feat: 0.6653050184249878 (2.9797176718711853) | > loss_mel: 7.67048454284668 (15.651337623596191) | > loss_duration: 3.3770360946655273 (3.3972400426864624) | > loss_1: 20.240062713623047 (30.35395622253418)  --> STEP: 3 | > loss_disc: 3.106313467025757 (2.97687562306722) | > loss_disc_real_0: 0.42255282402038574 (0.43238890171051025) | > loss_disc_real_1: 0.33841925859451294 (0.2926792949438095) | > loss_disc_real_2: 0.36081740260124207 (0.3142159084479014) | > loss_disc_real_3: 0.31203290820121765 (0.28818068901697796) | > loss_disc_real_4: 0.46030935645103455 (0.3315917948881785) | > loss_disc_real_5: 0.5177650451660156 (0.3402104874451955) | > loss_0: 3.106313467025757 (2.97687562306722) | > loss_gen: 3.772122383117676 (2.6847283045450845) | > loss_kl: 2.942112922668457 (5.103791236877441) | > loss_feat: 4.839085102081299 (3.5995068152745566) | > loss_mel: 19.698726654052734 (17.00046730041504) | > loss_duration: 2.9823899269104004 (3.2589566707611084) | > loss_1: 34.234439849853516 (31.647450764973957) --> EVAL PERFORMANCE | > avg_loader_time: 0.004248460133870442 (-0.0006314118703206386) | > avg_loss_disc: 2.97687562306722 (+0.5871767600377402) | > avg_loss_disc_real_0: 0.43238890171051025 (+0.2930777842799822) | > avg_loss_disc_real_1: 0.2926792949438095 (-0.012452706694602966) | > avg_loss_disc_real_2: 0.3142159084479014 (+0.06863050162792209) | > avg_loss_disc_real_3: 0.28818068901697796 (-0.05730770031611121) | > avg_loss_disc_real_4: 0.3315917948881785 (+0.0700230474273364) | > avg_loss_disc_real_5: 0.3402104874451955 (+0.13179922103881833) | > avg_loss_0: 2.97687562306722 (+0.5871767600377402) | > avg_loss_gen: 2.6847283045450845 (+0.0958259105682373) | > avg_loss_kl: 5.103791236877441 (+0.30230196317036917) | > avg_loss_feat: 3.5995068152745566 (-2.5502352317174277) | > avg_loss_mel: 17.00046730041504 (-5.794241587320965) | > avg_loss_duration: 3.2589566707611084 (-0.02970631917317723) | > avg_loss_1: 31.647450764973957 (-7.976055145263675)  > EPOCH: 1304/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:47:39)   --> TIME: 2023-10-20 16:48:01 -- STEP: 29/50 -- GLOBAL_STEP: 118230 | > loss_disc: 2.4956250190734863 (2.4117175998358893) | > loss_disc_real_0: 0.04681909829378128 (0.13639673163536295) | > loss_disc_real_1: 0.17819392681121826 (0.21917454615749163) | > loss_disc_real_2: 0.1713421493768692 (0.22223268667685575) | > loss_disc_real_3: 0.14177674055099487 (0.24095361833942347) | > loss_disc_real_4: 0.2283523678779602 (0.21662229543616032) | > loss_disc_real_5: 0.37681522965431213 (0.21933117574723116) | > loss_0: 2.4956250190734863 (2.4117175998358893) | > grad_norm_0: tensor(1423.8755, device='cuda:0') (tensor(1338.9053, device='cuda:0')) | > loss_gen: 1.930673360824585 (2.3735137396845323) | > loss_kl: 0.765975296497345 (0.7769686579704285) | > loss_feat: 5.324865818023682 (6.782040773280736) | > loss_mel: 14.64261245727539 (20.08059855165153) | > loss_duration: 1.3229594230651855 (1.3030664468633717) | > loss_1: 23.98708724975586 (31.316187710597596) | > grad_norm_1: tensor(25075.6660, device='cuda:0') (tensor(48284.7109, device='cuda:0')) | > current_lr_0: 5.428434391933567e-05 | > current_lr_1: 5.433865881092574e-05 | > step_time: 0.6318 (0.551853714318111) | > loader_time: 0.009 (0.01817135975278657)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5374999046325684 (2.5374999046325684) | > loss_disc_real_0: 0.08850650489330292 (0.08850650489330292) | > loss_disc_real_1: 0.19530710577964783 (0.19530710577964783) | > loss_disc_real_2: 0.280218243598938 (0.280218243598938) | > loss_disc_real_3: 0.302314430475235 (0.302314430475235) | > loss_disc_real_4: 0.29087409377098083 (0.29087409377098083) | > loss_disc_real_5: 0.3153297007083893 (0.3153297007083893) | > loss_0: 2.5374999046325684 (2.5374999046325684) | > loss_gen: 2.128080129623413 (2.128080129623413) | > loss_kl: 6.417229652404785 (6.417229652404785) | > loss_feat: 4.5504374504089355 (4.5504374504089355) | > loss_mel: 28.05489730834961 (28.05489730834961) | > loss_duration: 3.177107572555542 (3.177107572555542) | > loss_1: 44.32775115966797 (44.32775115966797)  --> STEP: 1 | > loss_disc: 2.3656136989593506 (2.3656136989593506) | > loss_disc_real_0: 0.16258272528648376 (0.16258272528648376) | > loss_disc_real_1: 0.2383992075920105 (0.2383992075920105) | > loss_disc_real_2: 0.26973286271095276 (0.26973286271095276) | > loss_disc_real_3: 0.16500860452651978 (0.16500860452651978) | > loss_disc_real_4: 0.16793645918369293 (0.16793645918369293) | > loss_disc_real_5: 0.13264760375022888 (0.13264760375022888) | > loss_0: 2.3656136989593506 (2.3656136989593506) | > loss_gen: 2.043102502822876 (2.043102502822876) | > loss_kl: 5.704664707183838 (5.704664707183838) | > loss_feat: 6.49149751663208 (6.49149751663208) | > loss_mel: 22.528764724731445 (22.528764724731445) | > loss_duration: 3.4467692375183105 (3.4467692375183105) | > loss_1: 40.21479797363281 (40.21479797363281)  --> STEP: 2 | > loss_disc: 2.929002285003662 (2.6473079919815063) | > loss_disc_real_0: 0.3403926491737366 (0.25148768723011017) | > loss_disc_real_1: 0.19973479211330414 (0.21906699985265732) | > loss_disc_real_2: 0.3182055950164795 (0.2939692288637161) | > loss_disc_real_3: 0.19713182747364044 (0.1810702160000801) | > loss_disc_real_4: 0.391119122505188 (0.27952779084444046) | > loss_disc_real_5: 0.3235637843608856 (0.22810569405555725) | > loss_0: 2.929002285003662 (2.6473079919815063) | > loss_gen: 2.099108934402466 (2.071105718612671) | > loss_kl: 6.696197032928467 (6.200430870056152) | > loss_feat: 3.797842264175415 (5.144669890403748) | > loss_mel: 11.049434661865234 (16.78909969329834) | > loss_duration: 3.4611024856567383 (3.4539358615875244) | > loss_1: 27.103687286376953 (33.65924263000488)  --> STEP: 3 | > loss_disc: 2.9187653064727783 (2.737793763478597) | > loss_disc_real_0: 0.2355140745639801 (0.2461631496747335) | > loss_disc_real_1: 0.2752915620803833 (0.23780852059523264) | > loss_disc_real_2: 0.31983739137649536 (0.3025919497013092) | > loss_disc_real_3: 0.26791098713874817 (0.21001713971296945) | > loss_disc_real_4: 0.26464158296585083 (0.27456572155157727) | > loss_disc_real_5: 0.24758678674697876 (0.2345993916193644) | > loss_0: 2.9187653064727783 (2.737793763478597) | > loss_gen: 1.7424737215042114 (1.9615617195765178) | > loss_kl: 3.114408493041992 (5.171756744384766) | > loss_feat: 0.7436740398406982 (3.677671273549398) | > loss_mel: 15.912115097045898 (16.496771494547527) | > loss_duration: 3.023373603820801 (3.3104151089986167) | > loss_1: 24.53604507446289 (30.61817677815755) --> EVAL PERFORMANCE | > avg_loader_time: 0.007655143737792969 (+0.0034066836039225263) | > avg_loss_disc: 2.737793763478597 (-0.23908185958862305) | > avg_loss_disc_real_0: 0.2461631496747335 (-0.18622575203577676) | > avg_loss_disc_real_1: 0.23780852059523264 (-0.05487077434857687) | > avg_loss_disc_real_2: 0.3025919497013092 (-0.011623958746592222) | > avg_loss_disc_real_3: 0.21001713971296945 (-0.07816354930400851) | > avg_loss_disc_real_4: 0.27456572155157727 (-0.05702607333660126) | > avg_loss_disc_real_5: 0.2345993916193644 (-0.10561109582583109) | > avg_loss_0: 2.737793763478597 (-0.23908185958862305) | > avg_loss_gen: 1.9615617195765178 (-0.7231665849685667) | > avg_loss_kl: 5.171756744384766 (+0.06796550750732422) | > avg_loss_feat: 3.677671273549398 (+0.07816445827484131) | > avg_loss_mel: 16.496771494547527 (-0.5036958058675118) | > avg_loss_duration: 3.3104151089986167 (+0.051458438237508286) | > avg_loss_1: 30.61817677815755 (-1.0292739868164062)  > EPOCH: 1305/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:48:33)   --> TIME: 2023-10-20 16:48:43 -- STEP: 9/50 -- GLOBAL_STEP: 118260 | > loss_disc: 2.418827772140503 (2.5425407224231296) | > loss_disc_real_0: 0.10076190531253815 (0.16246384589208496) | > loss_disc_real_1: 0.10963492840528488 (0.22008856385946274) | > loss_disc_real_2: 0.1711587756872177 (0.24580151422156227) | > loss_disc_real_3: 0.14209963381290436 (0.22672455923424828) | > loss_disc_real_4: 0.11583897471427917 (0.24359017113844553) | > loss_disc_real_5: 0.12011031806468964 (0.2444040005405744) | > loss_0: 2.418827772140503 (2.5425407224231296) | > grad_norm_0: tensor(454.7272, device='cuda:0') (tensor(733.6670, device='cuda:0')) | > loss_gen: 1.9024837017059326 (2.248866253428989) | > loss_kl: 0.8891140222549438 (0.8205330769220988) | > loss_feat: 8.325780868530273 (5.641609244876438) | > loss_mel: 21.072227478027344 (20.705928166707356) | > loss_duration: 1.2315226793289185 (1.294511768552992) | > loss_1: 33.42112731933594 (30.711448245578342) | > grad_norm_1: tensor(12408.4941, device='cuda:0') (tensor(13653.0029, device='cuda:0')) | > current_lr_0: 5.4230083318880354e-05 | > current_lr_1: 5.428434391933567e-05 | > step_time: 0.5808 (0.6368029912312826) | > loader_time: 0.0259 (0.02163145277235243)  --> TIME: 2023-10-20 16:49:01 -- STEP: 39/50 -- GLOBAL_STEP: 118290 | > loss_disc: 2.9126243591308594 (2.536915583488269) | > loss_disc_real_0: 0.1768292486667633 (0.1593057921108527) | > loss_disc_real_1: 0.2764202654361725 (0.23013546642584679) | > loss_disc_real_2: 0.23248647153377533 (0.2284404641160598) | > loss_disc_real_3: 0.23603501915931702 (0.23433057772807586) | > loss_disc_real_4: 0.25593307614326477 (0.24409440226661852) | > loss_disc_real_5: 0.2755587100982666 (0.2600363000081135) | > loss_0: 2.9126243591308594 (2.536915583488269) | > grad_norm_0: tensor(913.6110, device='cuda:0') (tensor(813.5309, device='cuda:0')) | > loss_gen: 1.5450071096420288 (2.219252375456003) | > loss_kl: 0.3254713714122772 (0.745502925836123) | > loss_feat: 0.28626108169555664 (4.67865852622363) | > loss_mel: 2.085909128189087 (18.830041798261497) | > loss_duration: 1.3657574653625488 (1.2852832078933716) | > loss_1: 5.608406066894531 (27.75873903127817) | > grad_norm_1: tensor(20044.9062, device='cuda:0') (tensor(18923.3184, device='cuda:0')) | > current_lr_0: 5.4230083318880354e-05 | > current_lr_1: 5.428434391933567e-05 | > step_time: 0.5637 (0.5767025275108142) | > loader_time: 0.0243 (0.02026082919194148)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.3177661895751953 (2.3177661895751953) | > loss_disc_real_0: 0.11644364893436432 (0.11644364893436432) | > loss_disc_real_1: 0.3443659245967865 (0.3443659245967865) | > loss_disc_real_2: 0.212233304977417 (0.212233304977417) | > loss_disc_real_3: 0.23277391493320465 (0.23277391493320465) | > loss_disc_real_4: 0.26029279828071594 (0.26029279828071594) | > loss_disc_real_5: 0.19589103758335114 (0.19589103758335114) | > loss_0: 2.3177661895751953 (2.3177661895751953) | > loss_gen: 2.468275547027588 (2.468275547027588) | > loss_kl: 6.190317153930664 (6.190317153930664) | > loss_feat: 5.838282108306885 (5.838282108306885) | > loss_mel: 21.80658721923828 (21.80658721923828) | > loss_duration: 3.1445200443267822 (3.1445200443267822) | > loss_1: 39.44798278808594 (39.44798278808594)  --> STEP: 1 | > loss_disc: 2.267319679260254 (2.267319679260254) | > loss_disc_real_0: 0.10043129324913025 (0.10043129324913025) | > loss_disc_real_1: 0.22940000891685486 (0.22940000891685486) | > loss_disc_real_2: 0.23796476423740387 (0.23796476423740387) | > loss_disc_real_3: 0.3575846552848816 (0.3575846552848816) | > loss_disc_real_4: 0.20075811445713043 (0.20075811445713043) | > loss_disc_real_5: 0.11222834885120392 (0.11222834885120392) | > loss_0: 2.267319679260254 (2.267319679260254) | > loss_gen: 2.5636744499206543 (2.5636744499206543) | > loss_kl: 5.848626613616943 (5.848626613616943) | > loss_feat: 6.325401782989502 (6.325401782989502) | > loss_mel: 22.306440353393555 (22.306440353393555) | > loss_duration: 3.481963634490967 (3.481963634490967) | > loss_1: 40.52610778808594 (40.52610778808594)  --> STEP: 2 | > loss_disc: 2.3815906047821045 (2.324455142021179) | > loss_disc_real_0: 0.15992803871631622 (0.13017966598272324) | > loss_disc_real_1: 0.24509266018867493 (0.2372463345527649) | > loss_disc_real_2: 0.3433140218257904 (0.29063939303159714) | > loss_disc_real_3: 0.367710679769516 (0.3626476675271988) | > loss_disc_real_4: 0.19343042373657227 (0.19709426909685135) | > loss_disc_real_5: 0.1642867475748062 (0.13825754821300507) | > loss_0: 2.3815906047821045 (2.324455142021179) | > loss_gen: 2.89878249168396 (2.731228470802307) | > loss_kl: 6.382946968078613 (6.115786790847778) | > loss_feat: 8.722311973571777 (7.52385687828064) | > loss_mel: 22.001928329467773 (22.154184341430664) | > loss_duration: 3.4911623001098633 (3.486562967300415) | > loss_1: 43.497127532958984 (42.01161766052246)  --> STEP: 3 | > loss_disc: 2.626986503601074 (2.4252989292144775) | > loss_disc_real_0: 0.14633013308048248 (0.13556315501530966) | > loss_disc_real_1: 0.30196982622146606 (0.2588208317756653) | > loss_disc_real_2: 0.3229160010814667 (0.30139826238155365) | > loss_disc_real_3: 0.33345475792884827 (0.35291669766108197) | > loss_disc_real_4: 0.206397145986557 (0.20019522806008658) | > loss_disc_real_5: 0.2181396782398224 (0.16488492488861084) | > loss_0: 2.626986503601074 (2.4252989292144775) | > loss_gen: 2.2266087532043457 (2.5630218982696533) | > loss_kl: 3.1175055503845215 (5.116359710693359) | > loss_feat: 4.085662364959717 (6.377792040506999) | > loss_mel: 21.86992073059082 (22.05942980448405) | > loss_duration: 3.0082404613494873 (3.327122131983439) | > loss_1: 34.30793762207031 (39.44372431437174) --> EVAL PERFORMANCE | > avg_loader_time: 0.011576096216837565 (+0.003920952479044596) | > avg_loss_disc: 2.4252989292144775 (-0.3124948342641196) | > avg_loss_disc_real_0: 0.13556315501530966 (-0.11059999465942383) | > avg_loss_disc_real_1: 0.2588208317756653 (+0.021012311180432647) | > avg_loss_disc_real_2: 0.30139826238155365 (-0.0011936873197555542) | > avg_loss_disc_real_3: 0.35291669766108197 (+0.14289955794811252) | > avg_loss_disc_real_4: 0.20019522806008658 (-0.07437049349149069) | > avg_loss_disc_real_5: 0.16488492488861084 (-0.06971446673075357) | > avg_loss_0: 2.4252989292144775 (-0.3124948342641196) | > avg_loss_gen: 2.5630218982696533 (+0.6014601786931355) | > avg_loss_kl: 5.116359710693359 (-0.05539703369140625) | > avg_loss_feat: 6.377792040506999 (+2.700120766957601) | > avg_loss_mel: 22.05942980448405 (+5.562658309936523) | > avg_loss_duration: 3.327122131983439 (+0.016707022984822295) | > avg_loss_1: 39.44372431437174 (+8.825547536214192)  > EPOCH: 1306/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:49:22)   --> TIME: 2023-10-20 16:49:38 -- STEP: 19/50 -- GLOBAL_STEP: 118320 | > loss_disc: 2.3028554916381836 (2.4107399739717184) | > loss_disc_real_0: 0.13057979941368103 (0.1501647683938867) | > loss_disc_real_1: 0.2396373450756073 (0.22958008454818474) | > loss_disc_real_2: 0.2674574553966522 (0.20636468870859398) | > loss_disc_real_3: 0.22943297028541565 (0.23653913818691907) | > loss_disc_real_4: 0.18773186206817627 (0.2188234442943021) | > loss_disc_real_5: 0.18967090547084808 (0.21500131240310638) | > loss_0: 2.3028554916381836 (2.4107399739717184) | > grad_norm_0: tensor(533.0008, device='cuda:0') (tensor(734.5787, device='cuda:0')) | > loss_gen: 2.396559000015259 (2.29362081853967) | > loss_kl: 0.5416477918624878 (0.7156074431381727) | > loss_feat: 4.118409633636475 (5.332171574038894) | > loss_mel: 19.097881317138672 (16.914943883293553) | > loss_duration: 1.3480496406555176 (1.3464793657001697) | > loss_1: 27.502546310424805 (26.602822655125667) | > grad_norm_1: tensor(3511.0417, device='cuda:0') (tensor(22996.9453, device='cuda:0')) | > current_lr_0: 5.417587695529242e-05 | > current_lr_1: 5.4230083318880354e-05 | > step_time: 1.2095 (0.5605266721625077) | > loader_time: 0.0027 (0.014953889344867907)  --> TIME: 2023-10-20 16:49:48 -- STEP: 49/50 -- GLOBAL_STEP: 118350 | > loss_disc: 2.071284294128418 (2.4516849128567437) | > loss_disc_real_0: 0.05514203757047653 (0.1348794054011909) | > loss_disc_real_1: 0.188480406999588 (0.22501084140064764) | > loss_disc_real_2: 0.06824018806219101 (0.2121344907399343) | > loss_disc_real_3: 0.13325165212154388 (0.22816608382426962) | > loss_disc_real_4: 0.09313022345304489 (0.22120306861339784) | > loss_disc_real_5: 0.08109048008918762 (0.22837711242502745) | > loss_0: 2.071284294128418 (2.4516849128567437) | > grad_norm_0: tensor(426.6682, device='cuda:0') (tensor(661.2215, device='cuda:0')) | > loss_gen: 2.218031167984009 (2.2496054999682373) | > loss_kl: 0.38317710161209106 (0.6979474911884387) | > loss_feat: 7.3073039054870605 (5.453647678527905) | > loss_mel: 21.23037338256836 (17.8872499332136) | > loss_duration: 1.3900585174560547 (1.302161421094622) | > loss_1: 32.52894592285156 (27.59061200278146) | > grad_norm_1: tensor(8594.8887, device='cuda:0') (tensor(19616.1660, device='cuda:0')) | > current_lr_0: 5.417587695529242e-05 | > current_lr_1: 5.4230083318880354e-05 | > step_time: 0.254 (0.41182996302234876) | > loader_time: 0.3698 (0.01475973518527284)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1646032333374023 (3.1646032333374023) | > loss_disc_real_0: 0.21112743020057678 (0.21112743020057678) | > loss_disc_real_1: 0.25357547402381897 (0.25357547402381897) | > loss_disc_real_2: 0.3993760049343109 (0.3993760049343109) | > loss_disc_real_3: 0.356564998626709 (0.356564998626709) | > loss_disc_real_4: 0.3553592264652252 (0.3553592264652252) | > loss_disc_real_5: 0.4246745705604553 (0.4246745705604553) | > loss_0: 3.1646032333374023 (3.1646032333374023) | > loss_gen: 2.1266727447509766 (2.1266727447509766) | > loss_kl: 6.4894819259643555 (6.4894819259643555) | > loss_feat: 5.912456512451172 (5.912456512451172) | > loss_mel: 19.599172592163086 (19.599172592163086) | > loss_duration: 3.2205021381378174 (3.2205021381378174) | > loss_1: 37.34828567504883 (37.34828567504883)  --> STEP: 1 | > loss_disc: 2.9009218215942383 (2.9009218215942383) | > loss_disc_real_0: 0.26837658882141113 (0.26837658882141113) | > loss_disc_real_1: 0.25681787729263306 (0.25681787729263306) | > loss_disc_real_2: 0.280831903219223 (0.280831903219223) | > loss_disc_real_3: 0.2716870605945587 (0.2716870605945587) | > loss_disc_real_4: 0.2573598027229309 (0.2573598027229309) | > loss_disc_real_5: 0.22697493433952332 (0.22697493433952332) | > loss_0: 2.9009218215942383 (2.9009218215942383) | > loss_gen: 1.7138086557388306 (1.7138086557388306) | > loss_kl: 6.331802845001221 (6.331802845001221) | > loss_feat: 0.29878029227256775 (0.29878029227256775) | > loss_mel: 12.73975944519043 (12.73975944519043) | > loss_duration: 3.5210041999816895 (3.5210041999816895) | > loss_1: 24.605154037475586 (24.605154037475586)  --> STEP: 2 | > loss_disc: 1.041587233543396 (1.9712545275688171) | > loss_disc_real_0: 0.009687896817922592 (0.13903224281966686) | > loss_disc_real_1: 0.10048685222864151 (0.17865236476063728) | > loss_disc_real_2: 0.09942574054002762 (0.19012882187962532) | > loss_disc_real_3: 0.10599540174007416 (0.18884123116731644) | > loss_disc_real_4: 0.02857876569032669 (0.1429692842066288) | > loss_disc_real_5: 0.01637095771729946 (0.12167294602841139) | > loss_0: 1.041587233543396 (1.9712545275688171) | > loss_gen: 3.433095932006836 (2.5734522938728333) | > loss_kl: 7.003291606903076 (6.667547225952148) | > loss_feat: 16.8548526763916 (8.576816484332085) | > loss_mel: 26.92496681213379 (19.83236312866211) | > loss_duration: 3.5049543380737305 (3.51297926902771) | > loss_1: 57.72116470336914 (41.16315937042236)  --> STEP: 3 | > loss_disc: 2.8867146968841553 (2.2764079173405967) | > loss_disc_real_0: 0.20953485369682312 (0.1625331131120523) | > loss_disc_real_1: 0.24376286566257477 (0.2003558650612831) | > loss_disc_real_2: 0.3186076283454895 (0.23295509070158005) | > loss_disc_real_3: 0.2836126983165741 (0.220431720217069) | > loss_disc_real_4: 0.2553200125694275 (0.18041952699422836) | > loss_disc_real_5: 0.22268392145633698 (0.15534327117105326) | > loss_0: 2.8867146968841553 (2.2764079173405967) | > loss_gen: 1.6713758707046509 (2.2727601528167725) | > loss_kl: 3.004425525665283 (5.44650665918986) | > loss_feat: 0.5305895805358887 (5.894740849733353) | > loss_mel: 15.103174209594727 (18.255966822306316) | > loss_duration: 3.043170213699341 (3.3563762505849204) | > loss_1: 23.35273551940918 (35.22635142008463) --> EVAL PERFORMANCE | > avg_loader_time: 0.00664981206258138 (-0.004926284154256185) | > avg_loss_disc: 2.2764079173405967 (-0.14889101187388087) | > avg_loss_disc_real_0: 0.1625331131120523 (+0.02696995809674263) | > avg_loss_disc_real_1: 0.2003558650612831 (-0.05846496671438217) | > avg_loss_disc_real_2: 0.23295509070158005 (-0.0684431716799736) | > avg_loss_disc_real_3: 0.220431720217069 (-0.13248497744401297) | > avg_loss_disc_real_4: 0.18041952699422836 (-0.019775701065858214) | > avg_loss_disc_real_5: 0.15534327117105326 (-0.00954165371755758) | > avg_loss_0: 2.2764079173405967 (-0.14889101187388087) | > avg_loss_gen: 2.2727601528167725 (-0.29026174545288086) | > avg_loss_kl: 5.44650665918986 (+0.33014694849650095) | > avg_loss_feat: 5.894740849733353 (-0.48305119077364633) | > avg_loss_mel: 18.255966822306316 (-3.8034629821777344) | > avg_loss_duration: 3.3563762505849204 (+0.029254118601481416) | > avg_loss_1: 35.22635142008463 (-4.217372894287109)  > EPOCH: 1307/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:50:02)   --> TIME: 2023-10-20 16:50:25 -- STEP: 29/50 -- GLOBAL_STEP: 118380 | > loss_disc: 2.9359822273254395 (2.4975564890894395) | > loss_disc_real_0: 0.41385969519615173 (0.14999411335407659) | > loss_disc_real_1: 0.2671643793582916 (0.23069436809626118) | > loss_disc_real_2: 0.24885961413383484 (0.2345791507897706) | > loss_disc_real_3: 0.22911639511585236 (0.2404664752619534) | > loss_disc_real_4: 0.2818143367767334 (0.2425913409618982) | > loss_disc_real_5: 0.26681020855903625 (0.22171839854904804) | > loss_0: 2.9359822273254395 (2.4975564890894395) | > grad_norm_0: tensor(2406.7954, device='cuda:0') (tensor(922.4563, device='cuda:0')) | > loss_gen: 1.8432977199554443 (2.3125701608328995) | > loss_kl: 0.8998953700065613 (0.9000058852393051) | > loss_feat: 0.46337535977363586 (5.712465404821881) | > loss_mel: 10.577006340026855 (19.068246043961622) | > loss_duration: 1.314976453781128 (1.3052275941289704) | > loss_1: 15.098551750183105 (29.29851487587238) | > grad_norm_1: tensor(18299.9766, device='cuda:0') (tensor(25479.4082, device='cuda:0')) | > current_lr_0: 5.412172477435873e-05 | > current_lr_1: 5.417587695529242e-05 | > step_time: 0.3907 (0.6293076071245917) | > loader_time: 0.0246 (0.023944517661785257)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.7470128536224365 (1.7470128536224365) | > loss_disc_real_0: 0.03555510193109512 (0.03555510193109512) | > loss_disc_real_1: 0.15903908014297485 (0.15903908014297485) | > loss_disc_real_2: 0.1724129170179367 (0.1724129170179367) | > loss_disc_real_3: 0.16137798130512238 (0.16137798130512238) | > loss_disc_real_4: 0.13086865842342377 (0.13086865842342377) | > loss_disc_real_5: 0.06621157377958298 (0.06621157377958298) | > loss_0: 1.7470128536224365 (1.7470128536224365) | > loss_gen: 2.365769863128662 (2.365769863128662) | > loss_kl: 6.4572978019714355 (6.4572978019714355) | > loss_feat: 9.979497909545898 (9.979497909545898) | > loss_mel: 25.665422439575195 (25.665422439575195) | > loss_duration: 3.189830780029297 (3.189830780029297) | > loss_1: 47.65781784057617 (47.65781784057617)  --> STEP: 1 | > loss_disc: 2.508040428161621 (2.508040428161621) | > loss_disc_real_0: 0.223666250705719 (0.223666250705719) | > loss_disc_real_1: 0.2634480893611908 (0.2634480893611908) | > loss_disc_real_2: 0.24551089107990265 (0.24551089107990265) | > loss_disc_real_3: 0.25592032074928284 (0.25592032074928284) | > loss_disc_real_4: 0.32776084542274475 (0.32776084542274475) | > loss_disc_real_5: 0.18607410788536072 (0.18607410788536072) | > loss_0: 2.508040428161621 (2.508040428161621) | > loss_gen: 2.2564826011657715 (2.2564826011657715) | > loss_kl: 5.832767486572266 (5.832767486572266) | > loss_feat: 6.034231185913086 (6.034231185913086) | > loss_mel: 21.760421752929688 (21.760421752929688) | > loss_duration: 3.50622820854187 (3.50622820854187) | > loss_1: 39.39012908935547 (39.39012908935547)  --> STEP: 2 | > loss_disc: 1.2700985670089722 (1.8890694975852966) | > loss_disc_real_0: 0.07693463563919067 (0.15030044317245483) | > loss_disc_real_1: 0.05358795449137688 (0.15851802192628384) | > loss_disc_real_2: 0.14758799970149994 (0.1965494453907013) | > loss_disc_real_3: 0.09035663306713104 (0.17313847690820694) | > loss_disc_real_4: 0.06386154890060425 (0.1958111971616745) | > loss_disc_real_5: 0.029240891337394714 (0.10765749961137772) | > loss_0: 1.2700985670089722 (1.8890694975852966) | > loss_gen: 3.1659047603607178 (2.7111936807632446) | > loss_kl: 7.016263484954834 (6.42451548576355) | > loss_feat: 14.640737533569336 (10.337484359741211) | > loss_mel: 25.963275909423828 (23.861848831176758) | > loss_duration: 3.3825316429138184 (3.4443799257278442) | > loss_1: 54.1687126159668 (46.77942085266113)  --> STEP: 3 | > loss_disc: 2.953935146331787 (2.244024713834127) | > loss_disc_real_0: 0.42881715297698975 (0.24313934644063315) | > loss_disc_real_1: 0.3523920476436615 (0.22314269716540971) | > loss_disc_real_2: 0.4075149595737457 (0.2668712834517161) | > loss_disc_real_3: 0.24843844771385193 (0.19823846717675528) | > loss_disc_real_4: 0.33013004064559937 (0.24058414498964945) | > loss_disc_real_5: 0.2227754294872284 (0.14603014290332794) | > loss_0: 2.953935146331787 (2.244024713834127) | > loss_gen: 2.6201233863830566 (2.6808369159698486) | > loss_kl: 2.9724349975585938 (5.273821989695231) | > loss_feat: 5.973048210144043 (8.882672309875488) | > loss_mel: 24.176700592041016 (23.96679941813151) | > loss_duration: 3.087923526763916 (3.3255611260732016) | > loss_1: 38.83023452758789 (44.12969207763672) --> EVAL PERFORMANCE | > avg_loader_time: 0.003794511159261068 (-0.002855300903320312) | > avg_loss_disc: 2.244024713834127 (-0.03238320350646973) | > avg_loss_disc_real_0: 0.24313934644063315 (+0.08060623332858086) | > avg_loss_disc_real_1: 0.22314269716540971 (+0.022786832104126603) | > avg_loss_disc_real_2: 0.2668712834517161 (+0.033916192750136076) | > avg_loss_disc_real_3: 0.19823846717675528 (-0.02219325304031372) | > avg_loss_disc_real_4: 0.24058414498964945 (+0.06016461799542108) | > avg_loss_disc_real_5: 0.14603014290332794 (-0.009313128267725318) | > avg_loss_0: 2.244024713834127 (-0.03238320350646973) | > avg_loss_gen: 2.6808369159698486 (+0.40807676315307617) | > avg_loss_kl: 5.273821989695231 (-0.1726846694946289) | > avg_loss_feat: 8.882672309875488 (+2.9879314601421356) | > avg_loss_mel: 23.96679941813151 (+5.710832595825195) | > avg_loss_duration: 3.3255611260732016 (-0.03081512451171875) | > avg_loss_1: 44.12969207763672 (+8.903340657552086)  > EPOCH: 1308/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:50:55)   --> TIME: 2023-10-20 16:51:06 -- STEP: 9/50 -- GLOBAL_STEP: 118410 | > loss_disc: 2.8112969398498535 (2.6561324199040732) | > loss_disc_real_0: 0.35333794355392456 (0.20801013935771254) | > loss_disc_real_1: 0.22110025584697723 (0.23793777078390121) | > loss_disc_real_2: 0.18322280049324036 (0.23901565621296564) | > loss_disc_real_3: 0.19618207216262817 (0.23774116817447874) | > loss_disc_real_4: 0.2665978968143463 (0.28478197422292495) | > loss_disc_real_5: 0.21915405988693237 (0.3052886178096135) | > loss_0: 2.8112969398498535 (2.6561324199040732) | > grad_norm_0: tensor(427.9270, device='cuda:0') (tensor(838.5950, device='cuda:0')) | > loss_gen: 1.7944531440734863 (2.1198015345467462) | > loss_kl: 0.43107473850250244 (0.7748886677953932) | > loss_feat: 3.460233449935913 (4.269241122735871) | > loss_mel: 19.17442512512207 (18.978819052378338) | > loss_duration: 1.2696462869644165 (1.332488218943278) | > loss_1: 26.129831314086914 (27.4752385881212) | > grad_norm_1: tensor(4690.5444, device='cuda:0') (tensor(9301.8037, device='cuda:0')) | > current_lr_0: 5.406762672192031e-05 | > current_lr_1: 5.412172477435873e-05 | > step_time: 0.4712 (0.5616397062937418) | > loader_time: 0.0147 (0.02307022942437066)  --> TIME: 2023-10-20 16:51:22 -- STEP: 39/50 -- GLOBAL_STEP: 118440 | > loss_disc: 1.230951189994812 (2.400574179796073) | > loss_disc_real_0: 0.0720338523387909 (0.14473501749288958) | > loss_disc_real_1: 0.08666595816612244 (0.21222479947102377) | > loss_disc_real_2: 0.05949413776397705 (0.21562982345811832) | > loss_disc_real_3: 0.023358942940831184 (0.217567814896122) | > loss_disc_real_4: 0.018350185826420784 (0.22366824829712129) | > loss_disc_real_5: 0.038351934403181076 (0.22416956913776886) | > loss_0: 1.230951189994812 (2.400574179796073) | > grad_norm_0: tensor(497.2116, device='cuda:0') (tensor(599.7252, device='cuda:0')) | > loss_gen: 2.917210340499878 (2.230669489273658) | > loss_kl: 0.7677773237228394 (0.7328891815283359) | > loss_feat: 10.663236618041992 (5.481803166465118) | > loss_mel: 24.770078659057617 (20.190723932706387) | > loss_duration: 1.349518895149231 (1.2996676533650129) | > loss_1: 40.46781921386719 (29.935753076504437) | > grad_norm_1: tensor(41543.9609, device='cuda:0') (tensor(21025.4414, device='cuda:0')) | > current_lr_0: 5.406762672192031e-05 | > current_lr_1: 5.412172477435873e-05 | > step_time: 0.4493 (0.5294751448509023) | > loader_time: 0.0249 (0.015370827454787036)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8485052585601807 (2.8485052585601807) | > loss_disc_real_0: 0.17745696008205414 (0.17745696008205414) | > loss_disc_real_1: 0.2616136372089386 (0.2616136372089386) | > loss_disc_real_2: 0.2613249719142914 (0.2613249719142914) | > loss_disc_real_3: 0.25823143124580383 (0.25823143124580383) | > loss_disc_real_4: 0.3008391857147217 (0.3008391857147217) | > loss_disc_real_5: 0.26957884430885315 (0.26957884430885315) | > loss_0: 2.8485052585601807 (2.8485052585601807) | > loss_gen: 1.7059317827224731 (1.7059317827224731) | > loss_kl: 7.620416641235352 (7.620416641235352) | > loss_feat: 0.4414225220680237 (0.4414225220680237) | > loss_mel: 12.024641990661621 (12.024641990661621) | > loss_duration: 3.2897446155548096 (3.2897446155548096) | > loss_1: 25.0821590423584 (25.0821590423584)  --> STEP: 1 | > loss_disc: 2.8477606773376465 (2.8477606773376465) | > loss_disc_real_0: 0.19655263423919678 (0.19655263423919678) | > loss_disc_real_1: 0.3336739242076874 (0.3336739242076874) | > loss_disc_real_2: 0.27284643054008484 (0.27284643054008484) | > loss_disc_real_3: 0.3082893192768097 (0.3082893192768097) | > loss_disc_real_4: 0.3044191896915436 (0.3044191896915436) | > loss_disc_real_5: 0.3146495521068573 (0.3146495521068573) | > loss_0: 2.8477606773376465 (2.8477606773376465) | > loss_gen: 2.293215751647949 (2.293215751647949) | > loss_kl: 6.033212184906006 (6.033212184906006) | > loss_feat: 5.474243640899658 (5.474243640899658) | > loss_mel: 21.468778610229492 (21.468778610229492) | > loss_duration: 3.428264856338501 (3.428264856338501) | > loss_1: 38.697715759277344 (38.697715759277344)  --> STEP: 2 | > loss_disc: 2.667004108428955 (2.757382392883301) | > loss_disc_real_0: 0.1068008616566658 (0.1516767479479313) | > loss_disc_real_1: 0.25820446014404297 (0.2959391921758652) | > loss_disc_real_2: 0.31509116291999817 (0.2939687967300415) | > loss_disc_real_3: 0.3337458074092865 (0.3210175633430481) | > loss_disc_real_4: 0.3181336224079132 (0.3112764060497284) | > loss_disc_real_5: 0.36338987946510315 (0.3390197157859802) | > loss_0: 2.667004108428955 (2.757382392883301) | > loss_gen: 2.361347198486328 (2.3272814750671387) | > loss_kl: 6.254169940948486 (6.143691062927246) | > loss_feat: 3.305107593536377 (4.389675617218018) | > loss_mel: 22.68824577331543 (22.07851219177246) | > loss_duration: 3.3986611366271973 (3.413462996482849) | > loss_1: 38.00753402709961 (38.35262489318848)  --> STEP: 3 | > loss_disc: 3.0094215869903564 (2.841395457585653) | > loss_disc_real_0: 0.09299467504024506 (0.13211605697870255) | > loss_disc_real_1: 0.4274393618106842 (0.3397725820541382) | > loss_disc_real_2: 0.3579544126987457 (0.31529733538627625) | > loss_disc_real_3: 0.33564674854278564 (0.32589395840962726) | > loss_disc_real_4: 0.3409656584262848 (0.3211728235085805) | > loss_disc_real_5: 0.4053434729576111 (0.3611276348431905) | > loss_0: 3.0094215869903564 (2.841395457585653) | > loss_gen: 2.199733018875122 (2.2847653230031333) | > loss_kl: 3.050347328186035 (5.112576484680176) | > loss_feat: 3.779191255569458 (4.186180830001831) | > loss_mel: 22.515926361083984 (22.2243169148763) | > loss_duration: 2.9938268661499023 (3.2735842863718667) | > loss_1: 34.539024353027344 (37.081424713134766) --> EVAL PERFORMANCE | > avg_loader_time: 0.03185701370239258 (+0.02806250254313151) | > avg_loss_disc: 2.841395457585653 (+0.5973707437515259) | > avg_loss_disc_real_0: 0.13211605697870255 (-0.1110232894619306) | > avg_loss_disc_real_1: 0.3397725820541382 (+0.11662988488872847) | > avg_loss_disc_real_2: 0.31529733538627625 (+0.04842605193456012) | > avg_loss_disc_real_3: 0.32589395840962726 (+0.12765549123287198) | > avg_loss_disc_real_4: 0.3211728235085805 (+0.08058867851893106) | > avg_loss_disc_real_5: 0.3611276348431905 (+0.21509749193986255) | > avg_loss_0: 2.841395457585653 (+0.5973707437515259) | > avg_loss_gen: 2.2847653230031333 (-0.39607159296671535) | > avg_loss_kl: 5.112576484680176 (-0.16124550501505563) | > avg_loss_feat: 4.186180830001831 (-4.696491479873657) | > avg_loss_mel: 22.2243169148763 (-1.7424825032552107) | > avg_loss_duration: 3.2735842863718667 (-0.05197683970133493) | > avg_loss_1: 37.081424713134766 (-7.048267364501953)  > EPOCH: 1309/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:51:38)   --> TIME: 2023-10-20 16:51:56 -- STEP: 19/50 -- GLOBAL_STEP: 118470 | > loss_disc: 2.596074342727661 (2.3126503291882967) | > loss_disc_real_0: 0.07635389268398285 (0.14302523370440068) | > loss_disc_real_1: 0.26952603459358215 (0.20502279189072156) | > loss_disc_real_2: 0.35590213537216187 (0.2309032925649693) | > loss_disc_real_3: 0.35818520188331604 (0.23083174522770078) | > loss_disc_real_4: 0.39797860383987427 (0.22488379096122166) | > loss_disc_real_5: 0.344224750995636 (0.22046518463053202) | > loss_0: 2.596074342727661 (2.3126503291882967) | > grad_norm_0: tensor(435.0431, device='cuda:0') (tensor(650.4357, device='cuda:0')) | > loss_gen: 2.7441470623016357 (2.3933830574939123) | > loss_kl: 0.7154422402381897 (0.8415469488030985) | > loss_feat: 4.285605430603027 (6.3333282353062375) | > loss_mel: 22.485740661621094 (20.259266100431745) | > loss_duration: 1.3281999826431274 (1.3203489843167757) | > loss_1: 31.559133529663086 (31.147873225964997) | > grad_norm_1: tensor(8659.6260, device='cuda:0') (tensor(15894.1221, device='cuda:0')) | > current_lr_0: 5.401358274387234e-05 | > current_lr_1: 5.406762672192031e-05 | > step_time: 0.4025 (0.6125707375375848) | > loader_time: 0.0188 (0.02000922905771356)  --> TIME: 2023-10-20 16:52:09 -- STEP: 49/50 -- GLOBAL_STEP: 118500 | > loss_disc: 2.1047427654266357 (2.4097902701825515) | > loss_disc_real_0: 0.06910176575183868 (0.1323022062947251) | > loss_disc_real_1: 0.11434146016836166 (0.21970557178161582) | > loss_disc_real_2: 0.12127598375082016 (0.21635638375063332) | > loss_disc_real_3: 0.030158070847392082 (0.23211956677996382) | > loss_disc_real_4: 0.37410396337509155 (0.23288704808421282) | > loss_disc_real_5: 0.2569267153739929 (0.2399931402154723) | > loss_0: 2.1047427654266357 (2.4097902701825515) | > grad_norm_0: tensor(592.3304, device='cuda:0') (tensor(587.2911, device='cuda:0')) | > loss_gen: 2.546963930130005 (2.3191511849967807) | > loss_kl: 0.7246169447898865 (0.7878282003256739) | > loss_feat: 8.480815887451172 (5.947467143742406) | > loss_mel: 27.060245513916016 (20.51013284800004) | > loss_duration: 1.3875623941421509 (1.291789276259286) | > loss_1: 40.20020294189453 (30.85636839574697) | > grad_norm_1: tensor(18631.2207, device='cuda:0') (tensor(14832.6934, device='cuda:0')) | > current_lr_0: 5.401358274387234e-05 | > current_lr_1: 5.406762672192031e-05 | > step_time: 0.3292 (0.49423105862675853) | > loader_time: 0.5307 (0.024724897073239695)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6776208877563477 (2.6776208877563477) | > loss_disc_real_0: 0.268126517534256 (0.268126517534256) | > loss_disc_real_1: 0.23799152672290802 (0.23799152672290802) | > loss_disc_real_2: 0.25323811173439026 (0.25323811173439026) | > loss_disc_real_3: 0.19022978842258453 (0.19022978842258453) | > loss_disc_real_4: 0.3040236234664917 (0.3040236234664917) | > loss_disc_real_5: 0.21598628163337708 (0.21598628163337708) | > loss_0: 2.6776208877563477 (2.6776208877563477) | > loss_gen: 1.9909825325012207 (1.9909825325012207) | > loss_kl: 6.982975006103516 (6.982975006103516) | > loss_feat: 3.159208059310913 (3.159208059310913) | > loss_mel: 11.090102195739746 (11.090102195739746) | > loss_duration: 3.2015299797058105 (3.2015299797058105) | > loss_1: 26.42479705810547 (26.42479705810547)  --> STEP: 1 | > loss_disc: 1.9945743083953857 (1.9945743083953857) | > loss_disc_real_0: 0.23030421137809753 (0.23030421137809753) | > loss_disc_real_1: 0.18391557037830353 (0.18391557037830353) | > loss_disc_real_2: 0.16611066460609436 (0.16611066460609436) | > loss_disc_real_3: 0.09271569550037384 (0.09271569550037384) | > loss_disc_real_4: 0.1120857298374176 (0.1120857298374176) | > loss_disc_real_5: 0.08812381327152252 (0.08812381327152252) | > loss_0: 1.9945743083953857 (1.9945743083953857) | > loss_gen: 2.634906768798828 (2.634906768798828) | > loss_kl: 6.193474769592285 (6.193474769592285) | > loss_feat: 9.28555965423584 (9.28555965423584) | > loss_mel: 26.358633041381836 (26.358633041381836) | > loss_duration: 3.480282783508301 (3.480282783508301) | > loss_1: 47.952857971191406 (47.952857971191406)  --> STEP: 2 | > loss_disc: 2.1839957237243652 (2.0892850160598755) | > loss_disc_real_0: 0.1644717901945114 (0.19738800078630447) | > loss_disc_real_1: 0.2047019898891449 (0.1943087801337242) | > loss_disc_real_2: 0.16367535293102264 (0.1648930087685585) | > loss_disc_real_3: 0.18484359979629517 (0.1387796476483345) | > loss_disc_real_4: 0.2078840583562851 (0.15998489409685135) | > loss_disc_real_5: 0.20451097190380096 (0.14631739258766174) | > loss_0: 2.1839957237243652 (2.0892850160598755) | > loss_gen: 2.9751007556915283 (2.8050037622451782) | > loss_kl: 6.492980480194092 (6.3432276248931885) | > loss_feat: 9.562959671020508 (9.424259662628174) | > loss_mel: 25.037721633911133 (25.698177337646484) | > loss_duration: 3.368717908859253 (3.424500346183777) | > loss_1: 47.43748092651367 (47.69516944885254)  --> STEP: 3 | > loss_disc: 2.0591511726379395 (2.079240401585897) | > loss_disc_real_0: 0.3893250823020935 (0.26136702795823413) | > loss_disc_real_1: 0.27693629264831543 (0.2218512843052546) | > loss_disc_real_2: 0.2528521716594696 (0.19421272973219553) | > loss_disc_real_3: 0.08645142614841461 (0.1213369071483612) | > loss_disc_real_4: 0.1319122463464737 (0.15062734484672546) | > loss_disc_real_5: 0.20877157151699066 (0.1671354522307714) | > loss_0: 2.0591511726379395 (2.079240401585897) | > loss_gen: 2.982914447784424 (2.8643073240915933) | > loss_kl: 2.8831894397735596 (5.1898815631866455) | > loss_feat: 7.636976718902588 (8.828498681386312) | > loss_mel: 23.83860206604004 (25.078318913777668) | > loss_duration: 3.0515201091766357 (3.30017360051473) | > loss_1: 40.39320373535156 (45.26118087768555) --> EVAL PERFORMANCE | > avg_loader_time: 0.02927398681640625 (-0.002583026885986328) | > avg_loss_disc: 2.079240401585897 (-0.7621550559997559) | > avg_loss_disc_real_0: 0.26136702795823413 (+0.1292509709795316) | > avg_loss_disc_real_1: 0.2218512843052546 (-0.11792129774888357) | > avg_loss_disc_real_2: 0.19421272973219553 (-0.12108460565408072) | > avg_loss_disc_real_3: 0.1213369071483612 (-0.20455705126126605) | > avg_loss_disc_real_4: 0.15062734484672546 (-0.17054547866185504) | > avg_loss_disc_real_5: 0.1671354522307714 (-0.1939921826124191) | > avg_loss_0: 2.079240401585897 (-0.7621550559997559) | > avg_loss_gen: 2.8643073240915933 (+0.57954200108846) | > avg_loss_kl: 5.1898815631866455 (+0.07730507850646973) | > avg_loss_feat: 8.828498681386312 (+4.642317851384481) | > avg_loss_mel: 25.078318913777668 (+2.854001998901367) | > avg_loss_duration: 3.30017360051473 (+0.026589314142863252) | > avg_loss_1: 45.26118087768555 (+8.179756164550781)  > EPOCH: 1310/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:52:30)   --> TIME: 2023-10-20 16:52:55 -- STEP: 29/50 -- GLOBAL_STEP: 118530 | > loss_disc: 2.7237443923950195 (2.501643250728476) | > loss_disc_real_0: 0.0648157000541687 (0.15355412257385664) | > loss_disc_real_1: 0.2832697629928589 (0.22975260957047858) | > loss_disc_real_2: 0.17462001740932465 (0.21646598906352602) | > loss_disc_real_3: 0.26429009437561035 (0.23185059505289998) | > loss_disc_real_4: 0.26778629422187805 (0.2245643973864358) | > loss_disc_real_5: 0.27675479650497437 (0.24625263896224828) | > loss_0: 2.7237443923950195 (2.501643250728476) | > grad_norm_0: tensor(1733.4072, device='cuda:0') (tensor(649.9779, device='cuda:0')) | > loss_gen: 1.72840416431427 (2.2245251104749486) | > loss_kl: 0.3329223394393921 (0.8442420024296333) | > loss_feat: 1.0688376426696777 (5.532109035885539) | > loss_mel: 12.68608570098877 (20.39196711162041) | > loss_duration: 1.2523366212844849 (1.30707337116373) | > loss_1: 17.068586349487305 (30.29991603719777) | > grad_norm_1: tensor(7902.6973, device='cuda:0') (tensor(25305.6875, device='cuda:0')) | > current_lr_0: 5.3959592786164085e-05 | > current_lr_1: 5.401358274387234e-05 | > step_time: 0.4629 (0.6519420146942139) | > loader_time: 0.0272 (0.019725446043343385)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.618809700012207 (2.618809700012207) | > loss_disc_real_0: 0.333116739988327 (0.333116739988327) | > loss_disc_real_1: 0.17368268966674805 (0.17368268966674805) | > loss_disc_real_2: 0.24652081727981567 (0.24652081727981567) | > loss_disc_real_3: 0.2677542269229889 (0.2677542269229889) | > loss_disc_real_4: 0.3649463355541229 (0.3649463355541229) | > loss_disc_real_5: 0.2424142211675644 (0.2424142211675644) | > loss_0: 2.618809700012207 (2.618809700012207) | > loss_gen: 2.5941567420959473 (2.5941567420959473) | > loss_kl: 6.547700881958008 (6.547700881958008) | > loss_feat: 6.451845645904541 (6.451845645904541) | > loss_mel: 21.922481536865234 (21.922481536865234) | > loss_duration: 3.228940725326538 (3.228940725326538) | > loss_1: 40.74512481689453 (40.74512481689453)  --> STEP: 1 | > loss_disc: 2.6278247833251953 (2.6278247833251953) | > loss_disc_real_0: 0.35157904028892517 (0.35157904028892517) | > loss_disc_real_1: 0.27640393376350403 (0.27640393376350403) | > loss_disc_real_2: 0.21393649280071259 (0.21393649280071259) | > loss_disc_real_3: 0.1735839545726776 (0.1735839545726776) | > loss_disc_real_4: 0.26412233710289 (0.26412233710289) | > loss_disc_real_5: 0.26611268520355225 (0.26611268520355225) | > loss_0: 2.6278247833251953 (2.6278247833251953) | > loss_gen: 2.2911534309387207 (2.2911534309387207) | > loss_kl: 6.138900279998779 (6.138900279998779) | > loss_feat: 7.855527400970459 (7.855527400970459) | > loss_mel: 21.72295379638672 (21.72295379638672) | > loss_duration: 3.5542402267456055 (3.5542402267456055) | > loss_1: 41.562774658203125 (41.562774658203125)  --> STEP: 2 | > loss_disc: 3.0170114040374756 (2.8224180936813354) | > loss_disc_real_0: 0.1835930347442627 (0.26758603751659393) | > loss_disc_real_1: 0.23344390094280243 (0.25492391735315323) | > loss_disc_real_2: 0.2668102979660034 (0.240373395383358) | > loss_disc_real_3: 0.2764591574668884 (0.22502155601978302) | > loss_disc_real_4: 0.2698204517364502 (0.2669713944196701) | > loss_disc_real_5: 0.34151381254196167 (0.30381324887275696) | > loss_0: 3.0170114040374756 (2.8224180936813354) | > loss_gen: 1.58445143699646 (1.9378024339675903) | > loss_kl: 6.3514299392700195 (6.245165109634399) | > loss_feat: 0.0377071276307106 (3.946617264300585) | > loss_mel: 1.2172508239746094 (11.470102310180664) | > loss_duration: 3.3392252922058105 (3.446732759475708) | > loss_1: 12.530065536499023 (27.046420097351074)  --> STEP: 3 | > loss_disc: 3.013392686843872 (2.886076291402181) | > loss_disc_real_0: 0.17970117926597595 (0.23829108476638794) | > loss_disc_real_1: 0.23342035710811615 (0.24775606393814087) | > loss_disc_real_2: 0.2681116759777069 (0.24961948891480765) | > loss_disc_real_3: 0.27647775411605835 (0.2421736220518748) | > loss_disc_real_4: 0.26979705691337585 (0.267913281917572) | > loss_disc_real_5: 0.3415278196334839 (0.31638477245966595) | > loss_0: 3.013392686843872 (2.886076291402181) | > loss_gen: 1.5852144956588745 (1.8202731211980183) | > loss_kl: 3.02774715423584 (5.17269245783488) | > loss_feat: 0.04653038829565048 (2.646588305632273) | > loss_mel: 2.1117630004882812 (8.350655873616537) | > loss_duration: 3.056734800338745 (3.316733439763387) | > loss_1: 9.827990531921387 (21.30694357554118) --> EVAL PERFORMANCE | > avg_loader_time: 0.013431866963704428 (-0.01584211985270182) | > avg_loss_disc: 2.886076291402181 (+0.8068358898162842) | > avg_loss_disc_real_0: 0.23829108476638794 (-0.023075943191846193) | > avg_loss_disc_real_1: 0.24775606393814087 (+0.02590477963288626) | > avg_loss_disc_real_2: 0.24961948891480765 (+0.05540675918261212) | > avg_loss_disc_real_3: 0.2421736220518748 (+0.12083671490351358) | > avg_loss_disc_real_4: 0.267913281917572 (+0.11728593707084656) | > avg_loss_disc_real_5: 0.31638477245966595 (+0.14924932022889456) | > avg_loss_0: 2.886076291402181 (+0.8068358898162842) | > avg_loss_gen: 1.8202731211980183 (-1.044034202893575) | > avg_loss_kl: 5.17269245783488 (-0.017189105351765654) | > avg_loss_feat: 2.646588305632273 (-6.18191037575404) | > avg_loss_mel: 8.350655873616537 (-16.727663040161133) | > avg_loss_duration: 3.316733439763387 (+0.016559839248657227) | > avg_loss_1: 21.30694357554118 (-23.954237302144367)  > EPOCH: 1311/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:53:25)   --> TIME: 2023-10-20 16:53:34 -- STEP: 9/50 -- GLOBAL_STEP: 118560 | > loss_disc: 2.8242716789245605 (2.648414134979248) | > loss_disc_real_0: 0.1244434267282486 (0.09652186904309525) | > loss_disc_real_1: 0.21783283352851868 (0.21383883307377496) | > loss_disc_real_2: 0.40656688809394836 (0.25039952662256026) | > loss_disc_real_3: 0.34821611642837524 (0.2567862346768379) | > loss_disc_real_4: 0.35065317153930664 (0.26305656962924534) | > loss_disc_real_5: 0.31584402918815613 (0.26232272303766674) | > loss_0: 2.8242716789245605 (2.648414134979248) | > grad_norm_0: tensor(319.9492, device='cuda:0') (tensor(753.8735, device='cuda:0')) | > loss_gen: 2.3959782123565674 (2.1197517448001437) | > loss_kl: 0.7066591382026672 (0.731457451151477) | > loss_feat: 4.961889743804932 (5.199170519908269) | > loss_mel: 20.057287216186523 (19.5311664475335) | > loss_duration: 1.2407341003417969 (1.3058227830462985) | > loss_1: 29.362548828125 (28.887368626064724) | > grad_norm_1: tensor(4163.7241, device='cuda:0') (tensor(19967.5879, device='cuda:0')) | > current_lr_0: 5.390565679479885e-05 | > current_lr_1: 5.3959592786164085e-05 | > step_time: 0.3609 (0.4554198582967122) | > loader_time: 0.0088 (0.014506340026855469)  --> TIME: 2023-10-20 16:53:54 -- STEP: 39/50 -- GLOBAL_STEP: 118590 | > loss_disc: 2.820131778717041 (2.4981184555934024) | > loss_disc_real_0: 0.4002772569656372 (0.13143930726278671) | > loss_disc_real_1: 0.2966345250606537 (0.22046291388762304) | > loss_disc_real_2: 0.3537645637989044 (0.22605674680417928) | > loss_disc_real_3: 0.29287537932395935 (0.22729361773683474) | > loss_disc_real_4: 0.30701056122779846 (0.23270961594505188) | > loss_disc_real_5: 0.3175469636917114 (0.24658791329234064) | > loss_0: 2.820131778717041 (2.4981184555934024) | > grad_norm_0: tensor(1279.3835, device='cuda:0') (tensor(655.0138, device='cuda:0')) | > loss_gen: 2.5625662803649902 (2.2797009211320143) | > loss_kl: 0.5434579253196716 (0.7913984646781896) | > loss_feat: 2.340663194656372 (6.1264060123417625) | > loss_mel: 16.394577026367188 (20.35711057063861) | > loss_duration: 1.3708126544952393 (1.2859865427017212) | > loss_1: 23.212078094482422 (30.840602605770794) | > grad_norm_1: tensor(15179.5361, device='cuda:0') (tensor(18408.7559, device='cuda:0')) | > current_lr_0: 5.390565679479885e-05 | > current_lr_1: 5.3959592786164085e-05 | > step_time: 0.8076 (0.5849945484063565) | > loader_time: 0.0377 (0.018030563990275066)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.458909511566162 (2.458909511566162) | > loss_disc_real_0: 0.5625002384185791 (0.5625002384185791) | > loss_disc_real_1: 0.19179722666740417 (0.19179722666740417) | > loss_disc_real_2: 0.18927763402462006 (0.18927763402462006) | > loss_disc_real_3: 0.174270898103714 (0.174270898103714) | > loss_disc_real_4: 0.30361270904541016 (0.30361270904541016) | > loss_disc_real_5: 0.05893819034099579 (0.05893819034099579) | > loss_0: 2.458909511566162 (2.458909511566162) | > loss_gen: 2.5342283248901367 (2.5342283248901367) | > loss_kl: 6.804371356964111 (6.804371356964111) | > loss_feat: 7.858970642089844 (7.858970642089844) | > loss_mel: 21.56603240966797 (21.56603240966797) | > loss_duration: 3.122068166732788 (3.122068166732788) | > loss_1: 41.88566970825195 (41.88566970825195)  --> STEP: 1 | > loss_disc: 2.884624481201172 (2.884624481201172) | > loss_disc_real_0: 0.4449921250343323 (0.4449921250343323) | > loss_disc_real_1: 0.1644265055656433 (0.1644265055656433) | > loss_disc_real_2: 0.21146711707115173 (0.21146711707115173) | > loss_disc_real_3: 0.1560463011264801 (0.1560463011264801) | > loss_disc_real_4: 0.39636966586112976 (0.39636966586112976) | > loss_disc_real_5: 0.31214505434036255 (0.31214505434036255) | > loss_0: 2.884624481201172 (2.884624481201172) | > loss_gen: 2.2739481925964355 (2.2739481925964355) | > loss_kl: 6.498961448669434 (6.498961448669434) | > loss_feat: 8.38050365447998 (8.38050365447998) | > loss_mel: 27.155298233032227 (27.155298233032227) | > loss_duration: 3.4205288887023926 (3.4205288887023926) | > loss_1: 47.72924041748047 (47.72924041748047)  --> STEP: 2 | > loss_disc: 2.961653232574463 (2.9231388568878174) | > loss_disc_real_0: 0.1593165546655655 (0.3021543398499489) | > loss_disc_real_1: 0.2523231506347656 (0.20837482810020447) | > loss_disc_real_2: 0.23519571125507355 (0.22333141416311264) | > loss_disc_real_3: 0.27709680795669556 (0.21657155454158783) | > loss_disc_real_4: 0.27520525455474854 (0.33578746020793915) | > loss_disc_real_5: 0.27299565076828003 (0.2925703525543213) | > loss_0: 2.961653232574463 (2.9231388568878174) | > loss_gen: 1.5311000347137451 (1.9025241136550903) | > loss_kl: 6.943002700805664 (6.720982074737549) | > loss_feat: 0.3634115159511566 (4.3719575852155685) | > loss_mel: 19.876014709472656 (23.51565647125244) | > loss_duration: 3.256531000137329 (3.338529944419861) | > loss_1: 31.97005844116211 (39.84964942932129)  --> STEP: 3 | > loss_disc: 2.9951303005218506 (2.9471360047658286) | > loss_disc_real_0: 0.2371712327003479 (0.2804933041334152) | > loss_disc_real_1: 0.23941586911678314 (0.21872184177239737) | > loss_disc_real_2: 0.244157612323761 (0.23027348021666208) | > loss_disc_real_3: 0.24717408418655396 (0.22677239775657654) | > loss_disc_real_4: 0.27335554361343384 (0.31497682134310406) | > loss_disc_real_5: 0.27241477370262146 (0.2858518262704213) | > loss_0: 2.9951303005218506 (2.9471360047658286) | > loss_gen: 1.5218794345855713 (1.7756425539652507) | > loss_kl: 3.058093786239624 (5.500019311904907) | > loss_feat: 0.030798636376857758 (2.9249046022693315) | > loss_mel: 1.9285446405410767 (16.319952527681988) | > loss_duration: 3.0535476207733154 (3.243535836537679) | > loss_1: 9.592864036560059 (29.76405429840088) --> EVAL PERFORMANCE | > avg_loader_time: 0.009000221888224283 (-0.004431645075480144) | > avg_loss_disc: 2.9471360047658286 (+0.06105971336364746) | > avg_loss_disc_real_0: 0.2804933041334152 (+0.04220221936702728) | > avg_loss_disc_real_1: 0.21872184177239737 (-0.0290342221657435) | > avg_loss_disc_real_2: 0.23027348021666208 (-0.019346008698145567) | > avg_loss_disc_real_3: 0.22677239775657654 (-0.01540122429529825) | > avg_loss_disc_real_4: 0.31497682134310406 (+0.04706353942553204) | > avg_loss_disc_real_5: 0.2858518262704213 (-0.030532946189244625) | > avg_loss_0: 2.9471360047658286 (+0.06105971336364746) | > avg_loss_gen: 1.7756425539652507 (-0.04463056723276759) | > avg_loss_kl: 5.500019311904907 (+0.3273268540700274) | > avg_loss_feat: 2.9249046022693315 (+0.27831629663705826) | > avg_loss_mel: 16.319952527681988 (+7.969296654065451) | > avg_loss_duration: 3.243535836537679 (-0.07319760322570801) | > avg_loss_1: 29.76405429840088 (+8.4571107228597)  > EPOCH: 1312/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:54:12)   --> TIME: 2023-10-20 16:54:29 -- STEP: 19/50 -- GLOBAL_STEP: 118620 | > loss_disc: 1.8267608880996704 (2.329411117654098) | > loss_disc_real_0: 0.11165718734264374 (0.14432528418929955) | > loss_disc_real_1: 0.2283233255147934 (0.21060413161390706) | > loss_disc_real_2: 0.2145782858133316 (0.2245682577945684) | > loss_disc_real_3: 0.2402203381061554 (0.1960845036726249) | > loss_disc_real_4: 0.17891116440296173 (0.18971828675191654) | > loss_disc_real_5: 0.13885290920734406 (0.18803453523861735) | > loss_0: 1.8267608880996704 (2.329411117654098) | > grad_norm_0: tensor(299.2791, device='cuda:0') (tensor(606.6197, device='cuda:0')) | > loss_gen: 2.8959567546844482 (2.2721940216265226) | > loss_kl: 1.0471162796020508 (0.8637460125120062) | > loss_feat: 7.235424995422363 (5.916267613439183) | > loss_mel: 24.8776798248291 (19.649368775518315) | > loss_duration: 1.4140737056732178 (1.342541776205364) | > loss_1: 37.470252990722656 (30.044118479678506) | > grad_norm_1: tensor(15115.0820, device='cuda:0') (tensor(24687.3496, device='cuda:0')) | > current_lr_0: 5.385177471583388e-05 | > current_lr_1: 5.390565679479885e-05 | > step_time: 0.3662 (0.5907111293391177) | > loader_time: 0.0448 (0.027552316063328794)  --> TIME: 2023-10-20 16:54:50 -- STEP: 49/50 -- GLOBAL_STEP: 118650 | > loss_disc: 2.357368230819702 (2.4563799877556) | > loss_disc_real_0: 0.04993342608213425 (0.15036735856639485) | > loss_disc_real_1: 0.1377105861902237 (0.22063194580224096) | > loss_disc_real_2: 0.1607249230146408 (0.2320871150159106) | > loss_disc_real_3: 0.11980754882097244 (0.22340500423190546) | > loss_disc_real_4: 0.3543177545070648 (0.21785254187273737) | > loss_disc_real_5: 0.3091908097267151 (0.21117018109985758) | > loss_0: 2.357368230819702 (2.4563799877556) | > grad_norm_0: tensor(556.6895, device='cuda:0') (tensor(615.4664, device='cuda:0')) | > loss_gen: 2.377861261367798 (2.1791562158234266) | > loss_kl: 0.6886785626411438 (0.7668939921624807) | > loss_feat: 7.206779956817627 (5.1516533290245095) | > loss_mel: 23.592557907104492 (18.546658474571846) | > loss_duration: 1.4218690395355225 (1.3075879751419532) | > loss_1: 35.28774642944336 (27.951950219212748) | > grad_norm_1: tensor(30375.1816, device='cuda:0') (tensor(21869.7285, device='cuda:0')) | > current_lr_0: 5.385177471583388e-05 | > current_lr_1: 5.390565679479885e-05 | > step_time: 0.4831 (0.6365394300344039) | > loader_time: 0.5512 (0.03496470743296098)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.389620065689087 (2.389620065689087) | > loss_disc_real_0: 0.26294195652008057 (0.26294195652008057) | > loss_disc_real_1: 0.24086764454841614 (0.24086764454841614) | > loss_disc_real_2: 0.22306910157203674 (0.22306910157203674) | > loss_disc_real_3: 0.29722291231155396 (0.29722291231155396) | > loss_disc_real_4: 0.1126684844493866 (0.1126684844493866) | > loss_disc_real_5: 0.12952972948551178 (0.12952972948551178) | > loss_0: 2.389620065689087 (2.389620065689087) | > loss_gen: 2.497572183609009 (2.497572183609009) | > loss_kl: 6.3384857177734375 (6.3384857177734375) | > loss_feat: 9.824292182922363 (9.824292182922363) | > loss_mel: 20.96335220336914 (20.96335220336914) | > loss_duration: 3.132364511489868 (3.132364511489868) | > loss_1: 42.75606918334961 (42.75606918334961)  --> STEP: 1 | > loss_disc: 2.6854090690612793 (2.6854090690612793) | > loss_disc_real_0: 0.15028341114521027 (0.15028341114521027) | > loss_disc_real_1: 0.21408995985984802 (0.21408995985984802) | > loss_disc_real_2: 0.27190640568733215 (0.27190640568733215) | > loss_disc_real_3: 0.2608957886695862 (0.2608957886695862) | > loss_disc_real_4: 0.265347957611084 (0.265347957611084) | > loss_disc_real_5: 0.207166388630867 (0.207166388630867) | > loss_0: 2.6854090690612793 (2.6854090690612793) | > loss_gen: 1.862945318222046 (1.862945318222046) | > loss_kl: 6.258779048919678 (6.258779048919678) | > loss_feat: 2.1800732612609863 (2.1800732612609863) | > loss_mel: 19.68355369567871 (19.68355369567871) | > loss_duration: 3.535933256149292 (3.535933256149292) | > loss_1: 33.52128601074219 (33.52128601074219)  --> STEP: 2 | > loss_disc: 2.990001678466797 (2.837705373764038) | > loss_disc_real_0: 0.18163515627384186 (0.16595928370952606) | > loss_disc_real_1: 0.23764626681804657 (0.2258681133389473) | > loss_disc_real_2: 0.2555289566516876 (0.2637176811695099) | > loss_disc_real_3: 0.21430470049381256 (0.23760024458169937) | > loss_disc_real_4: 0.25060421228408813 (0.25797608494758606) | > loss_disc_real_5: 0.25192850828170776 (0.22954744845628738) | > loss_0: 2.990001678466797 (2.837705373764038) | > loss_gen: 1.4092440605163574 (1.6360946893692017) | > loss_kl: 6.85413122177124 (6.556455135345459) | > loss_feat: 0.10317937284708023 (1.1416263170540333) | > loss_mel: 1.8041865825653076 (10.74387013912201) | > loss_duration: 3.3170411586761475 (3.4264872074127197) | > loss_1: 13.487783432006836 (23.50453472137451)  --> STEP: 3 | > loss_disc: 2.6560537815093994 (2.7771548430124917) | > loss_disc_real_0: 0.25800520181655884 (0.19664125641187033) | > loss_disc_real_1: 0.196397602558136 (0.21604460974534354) | > loss_disc_real_2: 0.2771945595741272 (0.268209973971049) | > loss_disc_real_3: 0.20296166837215424 (0.22605405251185098) | > loss_disc_real_4: 0.29054173827171326 (0.2688313027222951) | > loss_disc_real_5: 0.1307741403579712 (0.19662301242351532) | > loss_0: 2.6560537815093994 (2.7771548430124917) | > loss_gen: 1.9113569259643555 (1.727848768234253) | > loss_kl: 3.05265474319458 (5.388521671295166) | > loss_feat: 4.553691387176514 (2.2789813404281936) | > loss_mel: 20.769041061401367 (14.085593779881796) | > loss_duration: 3.000068187713623 (3.2843475341796875) | > loss_1: 33.28681182861328 (26.76529375712077) --> EVAL PERFORMANCE | > avg_loader_time: 0.010740200678507486 (+0.0017399787902832031) | > avg_loss_disc: 2.7771548430124917 (-0.16998116175333688) | > avg_loss_disc_real_0: 0.19664125641187033 (-0.08385204772154489) | > avg_loss_disc_real_1: 0.21604460974534354 (-0.002677232027053833) | > avg_loss_disc_real_2: 0.268209973971049 (+0.03793649375438693) | > avg_loss_disc_real_3: 0.22605405251185098 (-0.0007183452447255545) | > avg_loss_disc_real_4: 0.2688313027222951 (-0.046145518620808956) | > avg_loss_disc_real_5: 0.19662301242351532 (-0.08922881384690601) | > avg_loss_0: 2.7771548430124917 (-0.16998116175333688) | > avg_loss_gen: 1.727848768234253 (-0.047793785730997795) | > avg_loss_kl: 5.388521671295166 (-0.11149764060974121) | > avg_loss_feat: 2.2789813404281936 (-0.6459232618411379) | > avg_loss_mel: 14.085593779881796 (-2.234358747800192) | > avg_loss_duration: 3.2843475341796875 (+0.040811697642008316) | > avg_loss_1: 26.76529375712077 (-2.9987605412801095)  > EPOCH: 1313/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:55:06)   --> TIME: 2023-10-20 16:55:28 -- STEP: 29/50 -- GLOBAL_STEP: 118680 | > loss_disc: 2.775451183319092 (2.38720322888473) | > loss_disc_real_0: 0.32006293535232544 (0.14076950561640592) | > loss_disc_real_1: 0.19723010063171387 (0.22384225069705782) | > loss_disc_real_2: 0.2251126766204834 (0.2111432152190085) | > loss_disc_real_3: 0.2434118092060089 (0.24286727093417068) | > loss_disc_real_4: 0.23111562430858612 (0.2108547541409217) | > loss_disc_real_5: 0.24523960053920746 (0.22460764723605123) | > loss_0: 2.775451183319092 (2.38720322888473) | > grad_norm_0: tensor(788.9221, device='cuda:0') (tensor(566.8430, device='cuda:0')) | > loss_gen: 1.7262672185897827 (2.3563261402064355) | > loss_kl: 0.7963115572929382 (0.8551883584466474) | > loss_feat: 1.334611415863037 (6.02535891378748) | > loss_mel: 17.399097442626953 (20.041729947616314) | > loss_duration: 1.281569242477417 (1.309379035028918) | > loss_1: 22.53785514831543 (30.58798222706236) | > grad_norm_1: tensor(3625.2344, device='cuda:0') (tensor(18955.5762, device='cuda:0')) | > current_lr_0: 5.379794649538034e-05 | > current_lr_1: 5.385177471583388e-05 | > step_time: 0.336 (0.5125448868192476) | > loader_time: 0.0018 (0.01818250787669215)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.064838171005249 (3.064838171005249) | > loss_disc_real_0: 0.514014482498169 (0.514014482498169) | > loss_disc_real_1: 0.3507797122001648 (0.3507797122001648) | > loss_disc_real_2: 0.33703553676605225 (0.33703553676605225) | > loss_disc_real_3: 0.1488846093416214 (0.1488846093416214) | > loss_disc_real_4: 0.2202392965555191 (0.2202392965555191) | > loss_disc_real_5: 0.0965365618467331 (0.0965365618467331) | > loss_0: 3.064838171005249 (3.064838171005249) | > loss_gen: 2.3012566566467285 (2.3012566566467285) | > loss_kl: 5.722681045532227 (5.722681045532227) | > loss_feat: 5.768929481506348 (5.768929481506348) | > loss_mel: 22.607275009155273 (22.607275009155273) | > loss_duration: 3.107314348220825 (3.107314348220825) | > loss_1: 39.5074577331543 (39.5074577331543)  --> STEP: 1 | > loss_disc: 2.426854372024536 (2.426854372024536) | > loss_disc_real_0: 0.4736484885215759 (0.4736484885215759) | > loss_disc_real_1: 0.3413967192173004 (0.3413967192173004) | > loss_disc_real_2: 0.2366066426038742 (0.2366066426038742) | > loss_disc_real_3: 0.09316777437925339 (0.09316777437925339) | > loss_disc_real_4: 0.19094090163707733 (0.19094090163707733) | > loss_disc_real_5: 0.11011911183595657 (0.11011911183595657) | > loss_0: 2.426854372024536 (2.426854372024536) | > loss_gen: 2.640873908996582 (2.640873908996582) | > loss_kl: 5.978055000305176 (5.978055000305176) | > loss_feat: 6.987082481384277 (6.987082481384277) | > loss_mel: 25.66008758544922 (25.66008758544922) | > loss_duration: 3.4391379356384277 (3.4391379356384277) | > loss_1: 44.70523452758789 (44.70523452758789)  --> STEP: 2 | > loss_disc: 2.4658429622650146 (2.4463486671447754) | > loss_disc_real_0: 0.08350254595279694 (0.27857551723718643) | > loss_disc_real_1: 0.19588443636894226 (0.26864057779312134) | > loss_disc_real_2: 0.3048276901245117 (0.27071716636419296) | > loss_disc_real_3: 0.27591216564178467 (0.18453997001051903) | > loss_disc_real_4: 0.22350694239139557 (0.20722392201423645) | > loss_disc_real_5: 0.28932368755340576 (0.19972139969468117) | > loss_0: 2.4658429622650146 (2.4463486671447754) | > loss_gen: 2.319612979888916 (2.480243444442749) | > loss_kl: 6.56753396987915 (6.272794485092163) | > loss_feat: 3.932523488998413 (5.459802985191345) | > loss_mel: 23.708494186401367 (24.684290885925293) | > loss_duration: 3.3527309894561768 (3.3959344625473022) | > loss_1: 39.88089370727539 (42.29306411743164)  --> STEP: 3 | > loss_disc: 1.9945350885391235 (2.2957441409428916) | > loss_disc_real_0: 0.1299304962158203 (0.22902717689673105) | > loss_disc_real_1: 0.3246976435184479 (0.28732626636823017) | > loss_disc_real_2: 0.26428207755088806 (0.268572136759758) | > loss_disc_real_3: 0.2742527723312378 (0.2144442374507586) | > loss_disc_real_4: 0.07938024401664734 (0.16460936268170676) | > loss_disc_real_5: 0.043241944164037704 (0.1475615811844667) | > loss_0: 1.9945350885391235 (2.2957441409428916) | > loss_gen: 2.8427250385284424 (2.6010706424713135) | > loss_kl: 2.9385623931884766 (5.1613837877909345) | > loss_feat: 6.6334028244018555 (5.851002931594849) | > loss_mel: 23.029293060302734 (24.132624944051106) | > loss_duration: 3.1552884578704834 (3.3157191276550293) | > loss_1: 38.59926986694336 (41.06179936726888) --> EVAL PERFORMANCE | > avg_loader_time: 0.015578031539916992 (+0.004837830861409506) | > avg_loss_disc: 2.2957441409428916 (-0.4814107020696001) | > avg_loss_disc_real_0: 0.22902717689673105 (+0.03238592048486072) | > avg_loss_disc_real_1: 0.28732626636823017 (+0.07128165662288663) | > avg_loss_disc_real_2: 0.268572136759758 (+0.0003621627887089862) | > avg_loss_disc_real_3: 0.2144442374507586 (-0.011609815061092377) | > avg_loss_disc_real_4: 0.16460936268170676 (-0.10422194004058835) | > avg_loss_disc_real_5: 0.1475615811844667 (-0.04906143123904863) | > avg_loss_0: 2.2957441409428916 (-0.4814107020696001) | > avg_loss_gen: 2.6010706424713135 (+0.8732218742370605) | > avg_loss_kl: 5.1613837877909345 (-0.22713788350423147) | > avg_loss_feat: 5.851002931594849 (+3.572021591166655) | > avg_loss_mel: 24.132624944051106 (+10.04703116416931) | > avg_loss_duration: 3.3157191276550293 (+0.0313715934753418) | > avg_loss_1: 41.06179936726888 (+14.296505610148113)  > EPOCH: 1314/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:55:53)   --> TIME: 2023-10-20 16:56:04 -- STEP: 9/50 -- GLOBAL_STEP: 118710 | > loss_disc: 3.1094601154327393 (2.775384638044569) | > loss_disc_real_0: 0.1455705463886261 (0.14051353517505857) | > loss_disc_real_1: 0.3011189103126526 (0.24805866264634663) | > loss_disc_real_2: 0.40303367376327515 (0.2634353041648865) | > loss_disc_real_3: 0.49642640352249146 (0.28039073447386426) | > loss_disc_real_4: 0.30606332421302795 (0.2652515421311061) | > loss_disc_real_5: 0.40311312675476074 (0.2655417389339871) | > loss_0: 3.1094601154327393 (2.775384638044569) | > grad_norm_0: tensor(473.8238, device='cuda:0') (tensor(592.8864, device='cuda:0')) | > loss_gen: 2.3591489791870117 (2.138479312260946) | > loss_kl: 0.6595513224601746 (0.8469469878408644) | > loss_feat: 4.582366943359375 (5.711250199211968) | > loss_mel: 20.334413528442383 (20.846681276957195) | > loss_duration: 1.296642780303955 (1.3034470478693645) | > loss_1: 29.23212432861328 (30.846804089016384) | > grad_norm_1: tensor(4434.4668, device='cuda:0') (tensor(17438.8438, device='cuda:0')) | > current_lr_0: 5.3744172079603306e-05 | > current_lr_1: 5.379794649538034e-05 | > step_time: 0.4797 (0.6417803234524198) | > loader_time: 0.0306 (0.023164537217881944)  --> TIME: 2023-10-20 16:56:24 -- STEP: 39/50 -- GLOBAL_STEP: 118740 | > loss_disc: 1.5183056592941284 (2.5703007105069284) | > loss_disc_real_0: 0.10106366127729416 (0.1427279676382359) | > loss_disc_real_1: 0.10240772366523743 (0.2270770013714448) | > loss_disc_real_2: 0.04016079008579254 (0.2328199107104387) | > loss_disc_real_3: 0.06546717137098312 (0.243889026152782) | > loss_disc_real_4: 0.1560475379228592 (0.24280850312266594) | > loss_disc_real_5: 0.09743564575910568 (0.23867896863092214) | > loss_0: 1.5183056592941284 (2.5703007105069284) | > grad_norm_0: tensor(433.4085, device='cuda:0') (tensor(714.8613, device='cuda:0')) | > loss_gen: 3.0061097145080566 (2.183446254485693) | > loss_kl: 0.6850486397743225 (0.852415254793297) | > loss_feat: 9.99272632598877 (5.60355287971787) | > loss_mel: 25.12891387939453 (20.699306573623264) | > loss_duration: 1.3731907606124878 (1.2901187477967677) | > loss_1: 40.18599319458008 (30.62883981068929) | > grad_norm_1: tensor(10119.5840, device='cuda:0') (tensor(15715.6465, device='cuda:0')) | > current_lr_0: 5.3744172079603306e-05 | > current_lr_1: 5.379794649538034e-05 | > step_time: 0.4784 (0.6359759783133482) | > loader_time: 0.028 (0.024405999061388847)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7978906631469727 (2.7978906631469727) | > loss_disc_real_0: 0.2494657188653946 (0.2494657188653946) | > loss_disc_real_1: 0.22878403961658478 (0.22878403961658478) | > loss_disc_real_2: 0.30140286684036255 (0.30140286684036255) | > loss_disc_real_3: 0.2358071208000183 (0.2358071208000183) | > loss_disc_real_4: 0.2908296287059784 (0.2908296287059784) | > loss_disc_real_5: 0.3515823185443878 (0.3515823185443878) | > loss_0: 2.7978906631469727 (2.7978906631469727) | > loss_gen: 2.2618937492370605 (2.2618937492370605) | > loss_kl: 6.077906131744385 (6.077906131744385) | > loss_feat: 4.729515075683594 (4.729515075683594) | > loss_mel: 21.887493133544922 (21.887493133544922) | > loss_duration: 3.1515965461730957 (3.1515965461730957) | > loss_1: 38.10840606689453 (38.10840606689453)  --> STEP: 1 | > loss_disc: 3.151787519454956 (3.151787519454956) | > loss_disc_real_0: 0.573087215423584 (0.573087215423584) | > loss_disc_real_1: 0.22704683244228363 (0.22704683244228363) | > loss_disc_real_2: 0.2966662347316742 (0.2966662347316742) | > loss_disc_real_3: 0.19157500565052032 (0.19157500565052032) | > loss_disc_real_4: 0.30587172508239746 (0.30587172508239746) | > loss_disc_real_5: 0.2704625129699707 (0.2704625129699707) | > loss_0: 3.151787519454956 (3.151787519454956) | > loss_gen: 1.9458354711532593 (1.9458354711532593) | > loss_kl: 6.057715892791748 (6.057715892791748) | > loss_feat: 3.345736503601074 (3.345736503601074) | > loss_mel: 21.55959701538086 (21.55959701538086) | > loss_duration: 3.453650951385498 (3.453650951385498) | > loss_1: 36.3625373840332 (36.3625373840332)  --> STEP: 2 | > loss_disc: 1.8834998607635498 (2.517643690109253) | > loss_disc_real_0: 0.15910008549690247 (0.3660936504602432) | > loss_disc_real_1: 0.12059152126312256 (0.1738191768527031) | > loss_disc_real_2: 0.08934688568115234 (0.19300656020641327) | > loss_disc_real_3: 0.17798982560634613 (0.18478241562843323) | > loss_disc_real_4: 0.08829152584075928 (0.19708162546157837) | > loss_disc_real_5: 0.08062198758125305 (0.17554225027561188) | > loss_0: 1.8834998607635498 (2.517643690109253) | > loss_gen: 2.1535136699676514 (2.0496745705604553) | > loss_kl: 6.592319488525391 (6.325017690658569) | > loss_feat: 8.022306442260742 (5.684021472930908) | > loss_mel: 25.664901733398438 (23.61224937438965) | > loss_duration: 3.4284772872924805 (3.4410641193389893) | > loss_1: 45.86151885986328 (41.11202812194824)  --> STEP: 3 | > loss_disc: 2.45546293258667 (2.4969167709350586) | > loss_disc_real_0: 0.24835576117038727 (0.3268476873636246) | > loss_disc_real_1: 0.2459338754415512 (0.19785740971565247) | > loss_disc_real_2: 0.21248841285705566 (0.19950051108996072) | > loss_disc_real_3: 0.18894712626934052 (0.18617065250873566) | > loss_disc_real_4: 0.278731107711792 (0.2242981195449829) | > loss_disc_real_5: 0.3741253912448883 (0.241736630598704) | > loss_0: 2.45546293258667 (2.4969167709350586) | > loss_gen: 2.5896730422973633 (2.229674061139425) | > loss_kl: 2.963559150695801 (5.2045315106709795) | > loss_feat: 3.5269646644592285 (4.965002536773682) | > loss_mel: 22.22241973876953 (23.14897282918294) | > loss_duration: 3.020763874053955 (3.300964037577311) | > loss_1: 34.32337951660156 (38.84914525349935) --> EVAL PERFORMANCE | > avg_loader_time: 0.007623434066772461 (-0.007954597473144531) | > avg_loss_disc: 2.4969167709350586 (+0.201172629992167) | > avg_loss_disc_real_0: 0.3268476873636246 (+0.09782051046689352) | > avg_loss_disc_real_1: 0.19785740971565247 (-0.0894688566525777) | > avg_loss_disc_real_2: 0.19950051108996072 (-0.06907162566979727) | > avg_loss_disc_real_3: 0.18617065250873566 (-0.02827358494202295) | > avg_loss_disc_real_4: 0.2242981195449829 (+0.059688756863276154) | > avg_loss_disc_real_5: 0.241736630598704 (+0.09417504941423732) | > avg_loss_0: 2.4969167709350586 (+0.201172629992167) | > avg_loss_gen: 2.229674061139425 (-0.3713965813318887) | > avg_loss_kl: 5.2045315106709795 (+0.04314772288004498) | > avg_loss_feat: 4.965002536773682 (-0.886000394821167) | > avg_loss_mel: 23.14897282918294 (-0.9836521148681641) | > avg_loss_duration: 3.300964037577311 (-0.014755090077718247) | > avg_loss_1: 38.84914525349935 (-2.2126541137695312)  > EPOCH: 1315/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:56:46)   --> TIME: 2023-10-20 16:57:04 -- STEP: 19/50 -- GLOBAL_STEP: 118770 | > loss_disc: 2.6913633346557617 (2.518476680705422) | > loss_disc_real_0: 0.014525691978633404 (0.14549370105133244) | > loss_disc_real_1: 0.21573135256767273 (0.22630466275701397) | > loss_disc_real_2: 0.24147790670394897 (0.21825423777887695) | > loss_disc_real_3: 0.3191312253475189 (0.24523522842087245) | > loss_disc_real_4: 0.3184046149253845 (0.20740287290199808) | > loss_disc_real_5: 0.3470126688480377 (0.2263941709932528) | > loss_0: 2.6913633346557617 (2.518476680705422) | > grad_norm_0: tensor(427.1335, device='cuda:0') (tensor(588.0394, device='cuda:0')) | > loss_gen: 2.2011516094207764 (2.1847756787350305) | > loss_kl: 0.9555604457855225 (0.7819398453361109) | > loss_feat: 4.9722795486450195 (5.418951562360713) | > loss_mel: 22.443347930908203 (18.24274770837081) | > loss_duration: 1.3332651853561401 (1.3260691228665804) | > loss_1: 31.90560531616211 (27.95448398590088) | > grad_norm_1: tensor(4373.7822, device='cuda:0') (tensor(13572.3779, device='cuda:0')) | > current_lr_0: 5.369045141472162e-05 | > current_lr_1: 5.3744172079603306e-05 | > step_time: 0.7582 (0.5611384542364823) | > loader_time: 0.0265 (0.025100256267346834)  --> TIME: 2023-10-20 16:57:24 -- STEP: 49/50 -- GLOBAL_STEP: 118800 | > loss_disc: 2.036390542984009 (2.5702240442743105) | > loss_disc_real_0: 0.04082491993904114 (0.159754024894566) | > loss_disc_real_1: 0.14470680058002472 (0.21971831147616006) | > loss_disc_real_2: 0.09619953483343124 (0.21627798300160436) | > loss_disc_real_3: 0.18551449477672577 (0.2373091168321517) | > loss_disc_real_4: 0.13691139221191406 (0.2180799292590545) | > loss_disc_real_5: 0.25264233350753784 (0.2415900654634651) | > loss_0: 2.036390542984009 (2.5702240442743105) | > grad_norm_0: tensor(484.7931, device='cuda:0') (tensor(588.0716, device='cuda:0')) | > loss_gen: 2.403726577758789 (2.0916573685042716) | > loss_kl: 0.915669322013855 (0.7969233089563798) | > loss_feat: 6.596009254455566 (4.705210844092831) | > loss_mel: 26.062698364257812 (17.526382499811596) | > loss_duration: 1.4054168462753296 (1.299959769054335) | > loss_1: 37.383522033691406 (26.42013386317662) | > grad_norm_1: tensor(8085.1177, device='cuda:0') (tensor(16653.6250, device='cuda:0')) | > current_lr_0: 5.369045141472162e-05 | > current_lr_1: 5.3744172079603306e-05 | > step_time: 0.5707 (0.5930350410694979) | > loader_time: 0.5071 (0.03158026325459383)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7766740322113037 (2.7766740322113037) | > loss_disc_real_0: 0.25660964846611023 (0.25660964846611023) | > loss_disc_real_1: 0.24905186891555786 (0.24905186891555786) | > loss_disc_real_2: 0.2412342131137848 (0.2412342131137848) | > loss_disc_real_3: 0.24772848188877106 (0.24772848188877106) | > loss_disc_real_4: 0.2788810431957245 (0.2788810431957245) | > loss_disc_real_5: 0.27118778228759766 (0.27118778228759766) | > loss_0: 2.7766740322113037 (2.7766740322113037) | > loss_gen: 1.8456372022628784 (1.8456372022628784) | > loss_kl: 6.1927266120910645 (6.1927266120910645) | > loss_feat: 0.7574513554573059 (0.7574513554573059) | > loss_mel: 14.472576141357422 (14.472576141357422) | > loss_duration: 3.0733842849731445 (3.0733842849731445) | > loss_1: 26.341773986816406 (26.341773986816406)  --> STEP: 1 | > loss_disc: 2.6929526329040527 (2.6929526329040527) | > loss_disc_real_0: 0.4066894054412842 (0.4066894054412842) | > loss_disc_real_1: 0.3398497402667999 (0.3398497402667999) | > loss_disc_real_2: 0.23587340116500854 (0.23587340116500854) | > loss_disc_real_3: 0.2792374789714813 (0.2792374789714813) | > loss_disc_real_4: 0.27125632762908936 (0.27125632762908936) | > loss_disc_real_5: 0.23320530354976654 (0.23320530354976654) | > loss_0: 2.6929526329040527 (2.6929526329040527) | > loss_gen: 2.8008506298065186 (2.8008506298065186) | > loss_kl: 6.058525085449219 (6.058525085449219) | > loss_feat: 6.213027000427246 (6.213027000427246) | > loss_mel: 25.350845336914062 (25.350845336914062) | > loss_duration: 3.4549334049224854 (3.4549334049224854) | > loss_1: 43.87818145751953 (43.87818145751953)  --> STEP: 2 | > loss_disc: 2.8046536445617676 (2.74880313873291) | > loss_disc_real_0: 0.2846880555152893 (0.34568873047828674) | > loss_disc_real_1: 0.1264573484659195 (0.2331535443663597) | > loss_disc_real_2: 0.2094578742980957 (0.22266563773155212) | > loss_disc_real_3: 0.16616135835647583 (0.22269941866397858) | > loss_disc_real_4: 0.14520712196826935 (0.20823172479867935) | > loss_disc_real_5: 0.07735127955675125 (0.1552782915532589) | > loss_0: 2.8046536445617676 (2.74880313873291) | > loss_gen: 1.981486439704895 (2.391168534755707) | > loss_kl: 6.18330192565918 (6.120913505554199) | > loss_feat: 10.113883972167969 (8.163455486297607) | > loss_mel: 21.936525344848633 (23.643685340881348) | > loss_duration: 3.2820065021514893 (3.3684699535369873) | > loss_1: 43.4972038269043 (43.687692642211914)  --> STEP: 3 | > loss_disc: 2.2106661796569824 (2.5694241523742676) | > loss_disc_real_0: 0.6694352030754089 (0.45360422134399414) | > loss_disc_real_1: 0.3009157180786133 (0.2557409356037776) | > loss_disc_real_2: 0.10115222632884979 (0.18216116726398468) | > loss_disc_real_3: 0.1678113341331482 (0.20440339048703512) | > loss_disc_real_4: 0.10733835399150848 (0.17460060119628906) | > loss_disc_real_5: 0.14567194879055023 (0.15207617729902267) | > loss_0: 2.2106661796569824 (2.5694241523742676) | > loss_gen: 3.7312192916870117 (2.837852120399475) | > loss_kl: 3.0075559616088867 (5.083127657572429) | > loss_feat: 7.9202046394348145 (8.082371870676676) | > loss_mel: 21.651994705200195 (22.979788462320965) | > loss_duration: 2.993401288986206 (3.2434470653533936) | > loss_1: 39.304378509521484 (42.2265879313151) --> EVAL PERFORMANCE | > avg_loader_time: 0.00751956303914388 (-0.00010387102762858102) | > avg_loss_disc: 2.5694241523742676 (+0.07250738143920898) | > avg_loss_disc_real_0: 0.45360422134399414 (+0.12675653398036957) | > avg_loss_disc_real_1: 0.2557409356037776 (+0.05788352588812512) | > avg_loss_disc_real_2: 0.18216116726398468 (-0.017339343825976045) | > avg_loss_disc_real_3: 0.20440339048703512 (+0.018232737978299468) | > avg_loss_disc_real_4: 0.17460060119628906 (-0.04969751834869385) | > avg_loss_disc_real_5: 0.15207617729902267 (-0.08966045329968134) | > avg_loss_0: 2.5694241523742676 (+0.07250738143920898) | > avg_loss_gen: 2.837852120399475 (+0.6081780592600503) | > avg_loss_kl: 5.083127657572429 (-0.12140385309855084) | > avg_loss_feat: 8.082371870676676 (+3.117369333902994) | > avg_loss_mel: 22.979788462320965 (-0.1691843668619768) | > avg_loss_duration: 3.2434470653533936 (-0.057516972223917495) | > avg_loss_1: 42.2265879313151 (+3.3774426778157505)  > EPOCH: 1316/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:57:41)   --> TIME: 2023-10-20 16:57:59 -- STEP: 29/50 -- GLOBAL_STEP: 118830 | > loss_disc: 2.9798622131347656 (2.5560042405950614) | > loss_disc_real_0: 0.17168939113616943 (0.16264856157117874) | > loss_disc_real_1: 0.28100189566612244 (0.23859206587076187) | > loss_disc_real_2: 0.24505284428596497 (0.2431343463731223) | > loss_disc_real_3: 0.27030685544013977 (0.24288305126387494) | > loss_disc_real_4: 0.26333850622177124 (0.21958509036179247) | > loss_disc_real_5: 0.2821914851665497 (0.22370477611648626) | > loss_0: 2.9798622131347656 (2.5560042405950614) | > grad_norm_0: tensor(3487.2856, device='cuda:0') (tensor(682.7987, device='cuda:0')) | > loss_gen: 1.5878748893737793 (2.202454562844901) | > loss_kl: 0.7377209663391113 (0.8371807419020554) | > loss_feat: 0.2436583787202835 (5.27818339844716) | > loss_mel: 8.155738830566406 (18.51519123439131) | > loss_duration: 1.2377568483352661 (1.3008878231048584) | > loss_1: 11.962749481201172 (28.133897880028034) | > grad_norm_1: tensor(25697.1836, device='cuda:0') (tensor(18277.9941, device='cuda:0')) | > current_lr_0: 5.363678444700789e-05 | > current_lr_1: 5.369045141472162e-05 | > step_time: 0.3461 (0.4417215709028573) | > loader_time: 0.0051 (0.010937748284175479)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9590606689453125 (2.9590606689453125) | > loss_disc_real_0: 0.4001791775226593 (0.4001791775226593) | > loss_disc_real_1: 0.21098865568637848 (0.21098865568637848) | > loss_disc_real_2: 0.23431168496608734 (0.23431168496608734) | > loss_disc_real_3: 0.3011196553707123 (0.3011196553707123) | > loss_disc_real_4: 0.4190046191215515 (0.4190046191215515) | > loss_disc_real_5: 0.39373958110809326 (0.39373958110809326) | > loss_0: 2.9590606689453125 (2.9590606689453125) | > loss_gen: 2.686772584915161 (2.686772584915161) | > loss_kl: 6.126585483551025 (6.126585483551025) | > loss_feat: 5.219879627227783 (5.219879627227783) | > loss_mel: 22.64848518371582 (22.64848518371582) | > loss_duration: 3.1346404552459717 (3.1346404552459717) | > loss_1: 39.81636047363281 (39.81636047363281)  --> STEP: 1 | > loss_disc: 3.6859402656555176 (3.6859402656555176) | > loss_disc_real_0: 0.27120810747146606 (0.27120810747146606) | > loss_disc_real_1: 0.3593115210533142 (0.3593115210533142) | > loss_disc_real_2: 0.2003631591796875 (0.2003631591796875) | > loss_disc_real_3: 0.19258877635002136 (0.19258877635002136) | > loss_disc_real_4: 0.3520989716053009 (0.3520989716053009) | > loss_disc_real_5: 0.2502254545688629 (0.2502254545688629) | > loss_0: 3.6859402656555176 (3.6859402656555176) | > loss_gen: 1.4381691217422485 (1.4381691217422485) | > loss_kl: 5.794638633728027 (5.794638633728027) | > loss_feat: 8.667048454284668 (8.667048454284668) | > loss_mel: 21.434146881103516 (21.434146881103516) | > loss_duration: 3.5624618530273438 (3.5624618530273438) | > loss_1: 40.89646530151367 (40.89646530151367)  --> STEP: 2 | > loss_disc: 3.016695022583008 (3.3513176441192627) | > loss_disc_real_0: 0.32960450649261475 (0.3004063069820404) | > loss_disc_real_1: 0.30731117725372314 (0.3333113491535187) | > loss_disc_real_2: 0.3143449127674103 (0.2573540359735489) | > loss_disc_real_3: 0.27663782238960266 (0.234613299369812) | > loss_disc_real_4: 0.2739357352256775 (0.3130173534154892) | > loss_disc_real_5: 0.297539085149765 (0.27388226985931396) | > loss_0: 3.016695022583008 (3.3513176441192627) | > loss_gen: 1.8253376483917236 (1.631753385066986) | > loss_kl: 6.366137504577637 (6.080388069152832) | > loss_feat: 0.10391265898942947 (4.385480556637049) | > loss_mel: 4.977230548858643 (13.205688714981079) | > loss_duration: 3.242492437362671 (3.4024771451950073) | > loss_1: 16.51511001586914 (28.705787658691406)  --> STEP: 3 | > loss_disc: 2.600740671157837 (3.1011253197987876) | > loss_disc_real_0: 0.2659218907356262 (0.28891150156656903) | > loss_disc_real_1: 0.26684847474098206 (0.31115705768267315) | > loss_disc_real_2: 0.272649884223938 (0.2624526520570119) | > loss_disc_real_3: 0.24385486543178558 (0.23769382139046988) | > loss_disc_real_4: 0.2774905860424042 (0.3011750976244609) | > loss_disc_real_5: 0.3218182325363159 (0.28986092408498126) | > loss_0: 2.600740671157837 (3.1011253197987876) | > loss_gen: 2.662372589111328 (1.9752931197484334) | > loss_kl: 2.6827704906463623 (4.947848876317342) | > loss_feat: 5.53992223739624 (4.770294450223446) | > loss_mel: 21.969690322875977 (16.127022584279377) | > loss_duration: 3.0475540161132812 (3.2841694355010986) | > loss_1: 35.90230941772461 (31.10462824503581) --> EVAL PERFORMANCE | > avg_loader_time: 0.006893237431844075 (-0.0006263256072998047) | > avg_loss_disc: 3.1011253197987876 (+0.53170116742452) | > avg_loss_disc_real_0: 0.28891150156656903 (-0.1646927197774251) | > avg_loss_disc_real_1: 0.31115705768267315 (+0.05541612207889557) | > avg_loss_disc_real_2: 0.2624526520570119 (+0.08029148479302722) | > avg_loss_disc_real_3: 0.23769382139046988 (+0.03329043090343475) | > avg_loss_disc_real_4: 0.3011750976244609 (+0.1265744964281718) | > avg_loss_disc_real_5: 0.28986092408498126 (+0.1377847467859586) | > avg_loss_0: 3.1011253197987876 (+0.53170116742452) | > avg_loss_gen: 1.9752931197484334 (-0.8625590006510417) | > avg_loss_kl: 4.947848876317342 (-0.13527878125508686) | > avg_loss_feat: 4.770294450223446 (-3.31207742045323) | > avg_loss_mel: 16.127022584279377 (-6.852765878041588) | > avg_loss_duration: 3.2841694355010986 (+0.04072237014770508) | > avg_loss_1: 31.10462824503581 (-11.121959686279293)  > EPOCH: 1317/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:58:25)   --> TIME: 2023-10-20 16:58:38 -- STEP: 9/50 -- GLOBAL_STEP: 118860 | > loss_disc: 3.0475564002990723 (2.4060453441407947) | > loss_disc_real_0: 0.1736963391304016 (0.15452739844719568) | > loss_disc_real_1: 0.3169095814228058 (0.2357900912563006) | > loss_disc_real_2: 0.33368438482284546 (0.2316059014863438) | > loss_disc_real_3: 0.28343626856803894 (0.260780511630906) | > loss_disc_real_4: 0.25851863622665405 (0.19844885170459747) | > loss_disc_real_5: 0.3347945511341095 (0.18674073037174013) | > loss_0: 3.0475564002990723 (2.4060453441407947) | > grad_norm_0: tensor(605.2891, device='cuda:0') (tensor(428.3552, device='cuda:0')) | > loss_gen: 1.6866989135742188 (2.4213128089904785) | > loss_kl: 0.8245187997817993 (0.9688155849774679) | > loss_feat: 0.061843693256378174 (7.210527718067169) | > loss_mel: 1.844334363937378 (20.917829593022663) | > loss_duration: 1.321889042854309 (1.3348315821753607) | > loss_1: 5.739284515380859 (32.853317472669815) | > grad_norm_1: tensor(34237.4062, device='cuda:0') (tensor(28283.8809, device='cuda:0')) | > current_lr_0: 5.358317112278845e-05 | > current_lr_1: 5.363678444700789e-05 | > step_time: 0.8152 (0.6741584671868218) | > loader_time: 0.0391 (0.0259555180867513)  --> TIME: 2023-10-20 16:58:54 -- STEP: 39/50 -- GLOBAL_STEP: 118890 | > loss_disc: 2.180598735809326 (2.4129971846556053) | > loss_disc_real_0: 0.08675017207860947 (0.1372717667179994) | > loss_disc_real_1: 0.13831394910812378 (0.21878251318748182) | > loss_disc_real_2: 0.2819152772426605 (0.21882781892632827) | > loss_disc_real_3: 0.27524733543395996 (0.24083284976390693) | > loss_disc_real_4: 0.3279533088207245 (0.20888780515927535) | > loss_disc_real_5: 0.21686019003391266 (0.209627621448957) | > loss_0: 2.180598735809326 (2.4129971846556053) | > grad_norm_0: tensor(388.4963, device='cuda:0') (tensor(545.3217, device='cuda:0')) | > loss_gen: 3.38165283203125 (2.30830032703204) | > loss_kl: 0.4023449420928955 (0.7313054005304972) | > loss_feat: 8.185386657714844 (5.8947636628380184) | > loss_mel: 26.43538475036621 (20.85019026658474) | > loss_duration: 1.3948805332183838 (1.3108554543592992) | > loss_1: 39.799652099609375 (31.095414993090507) | > grad_norm_1: tensor(37636.0703, device='cuda:0') (tensor(23542.3027, device='cuda:0')) | > current_lr_0: 5.358317112278845e-05 | > current_lr_1: 5.363678444700789e-05 | > step_time: 0.3488 (0.5570698456886487) | > loader_time: 0.0085 (0.01654848074301695)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.425462484359741 (2.425462484359741) | > loss_disc_real_0: 0.09901755303144455 (0.09901755303144455) | > loss_disc_real_1: 0.5451777577400208 (0.5451777577400208) | > loss_disc_real_2: 0.30753159523010254 (0.30753159523010254) | > loss_disc_real_3: 0.19454161822795868 (0.19454161822795868) | > loss_disc_real_4: 0.2528941035270691 (0.2528941035270691) | > loss_disc_real_5: 0.23070977628231049 (0.23070977628231049) | > loss_0: 2.425462484359741 (2.425462484359741) | > loss_gen: 3.086294174194336 (3.086294174194336) | > loss_kl: 6.2868194580078125 (6.2868194580078125) | > loss_feat: 11.36910629272461 (11.36910629272461) | > loss_mel: 25.681791305541992 (25.681791305541992) | > loss_duration: 3.0366945266723633 (3.0366945266723633) | > loss_1: 49.4607048034668 (49.4607048034668)  --> STEP: 1 | > loss_disc: 2.611968755722046 (2.611968755722046) | > loss_disc_real_0: 0.04793936014175415 (0.04793936014175415) | > loss_disc_real_1: 0.2111969143152237 (0.2111969143152237) | > loss_disc_real_2: 0.2215893268585205 (0.2215893268585205) | > loss_disc_real_3: 0.21682485938072205 (0.21682485938072205) | > loss_disc_real_4: 0.30470454692840576 (0.30470454692840576) | > loss_disc_real_5: 0.22731301188468933 (0.22731301188468933) | > loss_0: 2.611968755722046 (2.611968755722046) | > loss_gen: 1.8168072700500488 (1.8168072700500488) | > loss_kl: 6.063648223876953 (6.063648223876953) | > loss_feat: 4.68149995803833 (4.68149995803833) | > loss_mel: 19.87759780883789 (19.87759780883789) | > loss_duration: 3.5114853382110596 (3.5114853382110596) | > loss_1: 35.9510383605957 (35.9510383605957)  --> STEP: 2 | > loss_disc: 2.4885404109954834 (2.5502545833587646) | > loss_disc_real_0: 0.06511375308036804 (0.056526556611061096) | > loss_disc_real_1: 0.23339812457561493 (0.2222975194454193) | > loss_disc_real_2: 0.2208377718925476 (0.22121354937553406) | > loss_disc_real_3: 0.14926858246326447 (0.18304672092199326) | > loss_disc_real_4: 0.26489385962486267 (0.2847992032766342) | > loss_disc_real_5: 0.24701575934886932 (0.23716438561677933) | > loss_0: 2.4885404109954834 (2.5502545833587646) | > loss_gen: 1.9521359205245972 (1.884471595287323) | > loss_kl: 6.508797645568848 (6.2862229347229) | > loss_feat: 5.303748607635498 (4.992624282836914) | > loss_mel: 27.04242515563965 (23.46001148223877) | > loss_duration: 3.3710455894470215 (3.4412654638290405) | > loss_1: 44.17815399169922 (40.06459617614746)  --> STEP: 3 | > loss_disc: 2.9625957012176514 (2.68770162264506) | > loss_disc_real_0: 0.1777167171239853 (0.09692327678203583) | > loss_disc_real_1: 0.30226272344589233 (0.248952587445577) | > loss_disc_real_2: 0.2795860171318054 (0.2406710386276245) | > loss_disc_real_3: 0.25344544649124146 (0.20651296277840933) | > loss_disc_real_4: 0.2800246775150299 (0.2832076946894328) | > loss_disc_real_5: 0.28043001890182495 (0.2515862633784612) | > loss_0: 2.9625957012176514 (2.68770162264506) | > loss_gen: 1.6357671022415161 (1.8015700976053874) | > loss_kl: 3.1266226768493652 (5.233022848765056) | > loss_feat: 0.886542558670044 (3.6239303747812905) | > loss_mel: 14.649188995361328 (20.52307065327962) | > loss_duration: 2.9806463718414307 (3.2877257664998374) | > loss_1: 23.278766632080078 (34.469319661458336) --> EVAL PERFORMANCE | > avg_loader_time: 0.006824890772501628 (-6.834665934244734e-05) | > avg_loss_disc: 2.68770162264506 (-0.4134236971537275) | > avg_loss_disc_real_0: 0.09692327678203583 (-0.1919882247845332) | > avg_loss_disc_real_1: 0.248952587445577 (-0.06220447023709616) | > avg_loss_disc_real_2: 0.2406710386276245 (-0.021781613429387392) | > avg_loss_disc_real_3: 0.20651296277840933 (-0.031180858612060547) | > avg_loss_disc_real_4: 0.2832076946894328 (-0.017967402935028076) | > avg_loss_disc_real_5: 0.2515862633784612 (-0.03827466070652008) | > avg_loss_0: 2.68770162264506 (-0.4134236971537275) | > avg_loss_gen: 1.8015700976053874 (-0.1737230221430459) | > avg_loss_kl: 5.233022848765056 (+0.2851739724477138) | > avg_loss_feat: 3.6239303747812905 (-1.1463640754421554) | > avg_loss_mel: 20.52307065327962 (+4.396048069000244) | > avg_loss_duration: 3.2877257664998374 (+0.003556330998738755) | > avg_loss_1: 34.469319661458336 (+3.3646914164225272)  > EPOCH: 1318/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 16:59:17)   --> TIME: 2023-10-20 16:59:34 -- STEP: 19/50 -- GLOBAL_STEP: 118920 | > loss_disc: 3.010612726211548 (2.2586110202889693) | > loss_disc_real_0: 0.21657556295394897 (0.13666010927408934) | > loss_disc_real_1: 0.27076438069343567 (0.20060021469467565) | > loss_disc_real_2: 0.26255205273628235 (0.21125985054593338) | > loss_disc_real_3: 0.2792470455169678 (0.21532761678099632) | > loss_disc_real_4: 0.2678827941417694 (0.2012623052455877) | > loss_disc_real_5: 0.2618122100830078 (0.17265666457579323) | > loss_0: 3.010612726211548 (2.2586110202889693) | > grad_norm_0: tensor(429.0716, device='cuda:0') (tensor(537.5074, device='cuda:0')) | > loss_gen: 1.5888543128967285 (2.3557221575787195) | > loss_kl: 0.6940855979919434 (0.7107329854839727) | > loss_feat: 0.018660645931959152 (6.26881702224675) | > loss_mel: 1.138826847076416 (19.951098975382354) | > loss_duration: 1.3125733137130737 (1.3191305587166233) | > loss_1: 4.753000736236572 (30.605501626667223) | > grad_norm_1: tensor(50137.4180, device='cuda:0') (tensor(25682.9609, device='cuda:0')) | > current_lr_0: 5.3529611388443265e-05 | > current_lr_1: 5.358317112278845e-05 | > step_time: 0.323 (0.6149977006410298) | > loader_time: 0.0058 (0.017836068805895354)  --> TIME: 2023-10-20 16:59:46 -- STEP: 49/50 -- GLOBAL_STEP: 118950 | > loss_disc: 2.1167073249816895 (2.3036400541967277) | > loss_disc_real_0: 0.14565272629261017 (0.13883633225471992) | > loss_disc_real_1: 0.2682090103626251 (0.2145851079602631) | > loss_disc_real_2: 0.1923750936985016 (0.20885857468356891) | > loss_disc_real_3: 0.3187386393547058 (0.22754705111895288) | > loss_disc_real_4: 0.30469197034835815 (0.20969708758045216) | > loss_disc_real_5: 0.140159472823143 (0.20225357418233642) | > loss_0: 2.1167073249816895 (2.3036400541967277) | > grad_norm_0: tensor(610.1426, device='cuda:0') (tensor(570.6330, device='cuda:0')) | > loss_gen: 3.200809955596924 (2.3799442709708707) | > loss_kl: 0.8736576437950134 (0.7147222691956832) | > loss_feat: 6.312331199645996 (6.262145295054937) | > loss_mel: 22.202896118164062 (21.013757489165478) | > loss_duration: 1.391884446144104 (1.2957735012988656) | > loss_1: 33.9815788269043 (31.666343085619868) | > grad_norm_1: tensor(23077.8184, device='cuda:0') (tensor(19198.8477, device='cuda:0')) | > current_lr_0: 5.3529611388443265e-05 | > current_lr_1: 5.358317112278845e-05 | > step_time: 0.363 (0.46201546338139743) | > loader_time: 0.4798 (0.020810847379723375)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0434274673461914 (3.0434274673461914) | > loss_disc_real_0: 0.25063109397888184 (0.25063109397888184) | > loss_disc_real_1: 0.24550938606262207 (0.24550938606262207) | > loss_disc_real_2: 0.17474845051765442 (0.17474845051765442) | > loss_disc_real_3: 0.3237421214580536 (0.3237421214580536) | > loss_disc_real_4: 0.4517182409763336 (0.4517182409763336) | > loss_disc_real_5: 0.4070150554180145 (0.4070150554180145) | > loss_0: 3.0434274673461914 (3.0434274673461914) | > loss_gen: 2.3608620166778564 (2.3608620166778564) | > loss_kl: 6.290280342102051 (6.290280342102051) | > loss_feat: 5.245350360870361 (5.245350360870361) | > loss_mel: 22.3203125 (22.3203125) | > loss_duration: 3.169548749923706 (3.169548749923706) | > loss_1: 39.3863525390625 (39.3863525390625)  --> STEP: 1 | > loss_disc: 3.0646352767944336 (3.0646352767944336) | > loss_disc_real_0: 0.39013782143592834 (0.39013782143592834) | > loss_disc_real_1: 0.26034480333328247 (0.26034480333328247) | > loss_disc_real_2: 0.20076625049114227 (0.20076625049114227) | > loss_disc_real_3: 0.2421916127204895 (0.2421916127204895) | > loss_disc_real_4: 0.11649822443723679 (0.11649822443723679) | > loss_disc_real_5: 0.1516067385673523 (0.1516067385673523) | > loss_0: 3.0646352767944336 (3.0646352767944336) | > loss_gen: 1.8170084953308105 (1.8170084953308105) | > loss_kl: 6.069891929626465 (6.069891929626465) | > loss_feat: 6.351565361022949 (6.351565361022949) | > loss_mel: 24.394140243530273 (24.394140243530273) | > loss_duration: 3.531466484069824 (3.531466484069824) | > loss_1: 42.1640739440918 (42.1640739440918)  --> STEP: 2 | > loss_disc: 3.008854389190674 (3.0367448329925537) | > loss_disc_real_0: 0.22441086173057556 (0.30727434158325195) | > loss_disc_real_1: 0.2919733226299286 (0.27615906298160553) | > loss_disc_real_2: 0.3064984679222107 (0.2536323592066765) | > loss_disc_real_3: 0.2854243814945221 (0.2638079971075058) | > loss_disc_real_4: 0.32645344734191895 (0.22147583588957787) | > loss_disc_real_5: 0.270609974861145 (0.21110835671424866) | > loss_0: 3.008854389190674 (3.0367448329925537) | > loss_gen: 1.8366966247558594 (1.826852560043335) | > loss_kl: 6.71991491317749 (6.3949034214019775) | > loss_feat: 1.510980248451233 (3.931272804737091) | > loss_mel: 22.026582717895508 (23.21036148071289) | > loss_duration: 3.3215091228485107 (3.4264878034591675) | > loss_1: 35.41568374633789 (38.789878845214844)  --> STEP: 3 | > loss_disc: 2.990635871887207 (3.0213751792907715) | > loss_disc_real_0: 0.13759884238243103 (0.25071584184964496) | > loss_disc_real_1: 0.25825339555740356 (0.2701905071735382) | > loss_disc_real_2: 0.22942902147769928 (0.24556457996368408) | > loss_disc_real_3: 0.2592080533504486 (0.26227468252182007) | > loss_disc_real_4: 0.2770816385746002 (0.24001110345125198) | > loss_disc_real_5: 0.25901177525520325 (0.22707616289456686) | > loss_0: 2.990635871887207 (3.0213751792907715) | > loss_gen: 1.4555845260620117 (1.7030965487162273) | > loss_kl: 2.76389217376709 (5.184566338857015) | > loss_feat: 0.26683229207992554 (2.7097926338513694) | > loss_mel: 7.72752046585083 (18.04941447575887) | > loss_duration: 2.938368082046509 (3.2637812296549478) | > loss_1: 15.15219783782959 (30.910651842753094) --> EVAL PERFORMANCE | > avg_loader_time: 0.008826176325480143 (+0.0020012855529785148) | > avg_loss_disc: 3.0213751792907715 (+0.3336735566457114) | > avg_loss_disc_real_0: 0.25071584184964496 (+0.15379256506760913) | > avg_loss_disc_real_1: 0.2701905071735382 (+0.021237919727961213) | > avg_loss_disc_real_2: 0.24556457996368408 (+0.00489354133605957) | > avg_loss_disc_real_3: 0.26227468252182007 (+0.05576171974341074) | > avg_loss_disc_real_4: 0.24001110345125198 (-0.043196591238180815) | > avg_loss_disc_real_5: 0.22707616289456686 (-0.02451010048389432) | > avg_loss_0: 3.0213751792907715 (+0.3336735566457114) | > avg_loss_gen: 1.7030965487162273 (-0.09847354888916016) | > avg_loss_kl: 5.184566338857015 (-0.04845650990804096) | > avg_loss_feat: 2.7097926338513694 (-0.9141377409299212) | > avg_loss_mel: 18.04941447575887 (-2.473656177520752) | > avg_loss_duration: 3.2637812296549478 (-0.02394453684488962) | > avg_loss_1: 30.910651842753094 (-3.558667818705242)  > EPOCH: 1319/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:00:11)   --> TIME: 2023-10-20 17:00:32 -- STEP: 29/50 -- GLOBAL_STEP: 118980 | > loss_disc: 2.7887654304504395 (2.584862123275626) | > loss_disc_real_0: 0.20030906796455383 (0.14485696131556197) | > loss_disc_real_1: 0.2682885527610779 (0.21112959247467847) | > loss_disc_real_2: 0.2488785684108734 (0.21964774801042572) | > loss_disc_real_3: 0.23650506138801575 (0.2366066255831513) | > loss_disc_real_4: 0.24846364557743073 (0.24726486356993174) | > loss_disc_real_5: 0.2408166080713272 (0.23541428424931804) | > loss_0: 2.7887654304504395 (2.584862123275626) | > grad_norm_0: tensor(775.6445, device='cuda:0') (tensor(633.7397, device='cuda:0')) | > loss_gen: 1.672552466392517 (2.213680431760591) | > loss_kl: 1.048323631286621 (0.7666138143375002) | > loss_feat: 0.6554592847824097 (5.275704807505526) | > loss_mel: 13.52994155883789 (20.107576534665863) | > loss_duration: 1.298672080039978 (1.3052842082648441) | > loss_1: 18.20494842529297 (29.66885943248354) | > grad_norm_1: tensor(6445.2339, device='cuda:0') (tensor(17559.1289, device='cuda:0')) | > current_lr_0: 5.34761051904059e-05 | > current_lr_1: 5.3529611388443265e-05 | > step_time: 0.2794 (0.5492856420319656) | > loader_time: 0.002 (0.017278317747444948)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0213873386383057 (3.0213873386383057) | > loss_disc_real_0: 0.342706561088562 (0.342706561088562) | > loss_disc_real_1: 0.26074495911598206 (0.26074495911598206) | > loss_disc_real_2: 0.2482747584581375 (0.2482747584581375) | > loss_disc_real_3: 0.24664270877838135 (0.24664270877838135) | > loss_disc_real_4: 0.23982033133506775 (0.23982033133506775) | > loss_disc_real_5: 0.2630692422389984 (0.2630692422389984) | > loss_0: 3.0213873386383057 (3.0213873386383057) | > loss_gen: 1.593285083770752 (1.593285083770752) | > loss_kl: 5.80524206161499 (5.80524206161499) | > loss_feat: 0.05838098004460335 (0.05838098004460335) | > loss_mel: 1.7525146007537842 (1.7525146007537842) | > loss_duration: 3.067281484603882 (3.067281484603882) | > loss_1: 12.276704788208008 (12.276704788208008)  --> STEP: 1 | > loss_disc: 2.2726526260375977 (2.2726526260375977) | > loss_disc_real_0: 0.48896968364715576 (0.48896968364715576) | > loss_disc_real_1: 0.17542573809623718 (0.17542573809623718) | > loss_disc_real_2: 0.13985669612884521 (0.13985669612884521) | > loss_disc_real_3: 0.159773588180542 (0.159773588180542) | > loss_disc_real_4: 0.34428682923316956 (0.34428682923316956) | > loss_disc_real_5: 0.21324904263019562 (0.21324904263019562) | > loss_0: 2.2726526260375977 (2.2726526260375977) | > loss_gen: 3.488420248031616 (3.488420248031616) | > loss_kl: 5.841127395629883 (5.841127395629883) | > loss_feat: 7.434360027313232 (7.434360027313232) | > loss_mel: 22.451997756958008 (22.451997756958008) | > loss_duration: 3.45033597946167 (3.45033597946167) | > loss_1: 42.66624069213867 (42.66624069213867)  --> STEP: 2 | > loss_disc: 2.7861337661743164 (2.529393196105957) | > loss_disc_real_0: 0.44443318247795105 (0.4667014330625534) | > loss_disc_real_1: 0.27184203267097473 (0.22363388538360596) | > loss_disc_real_2: 0.34718644618988037 (0.2435215711593628) | > loss_disc_real_3: 0.2737377882003784 (0.2167556881904602) | > loss_disc_real_4: 0.3251116871833801 (0.33469925820827484) | > loss_disc_real_5: 0.2797785699367523 (0.24651380628347397) | > loss_0: 2.7861337661743164 (2.529393196105957) | > loss_gen: 2.500699758529663 (2.9945600032806396) | > loss_kl: 6.436619281768799 (6.138873338699341) | > loss_feat: 2.6512086391448975 (5.042784333229065) | > loss_mel: 23.454938888549805 (22.953468322753906) | > loss_duration: 3.257391929626465 (3.3538639545440674) | > loss_1: 38.30085754394531 (40.48354911804199)  --> STEP: 3 | > loss_disc: 2.54268217086792 (2.533822854359945) | > loss_disc_real_0: 0.33455443382263184 (0.4226524333159129) | > loss_disc_real_1: 0.2697509825229645 (0.23900625109672546) | > loss_disc_real_2: 0.18494659662246704 (0.2239965796470642) | > loss_disc_real_3: 0.33503258228302 (0.2561813195546468) | > loss_disc_real_4: 0.31994640827178955 (0.3297816415627797) | > loss_disc_real_5: 0.13542965054512024 (0.2094857543706894) | > loss_0: 2.54268217086792 (2.533822854359945) | > loss_gen: 2.471893072128296 (2.820337692896525) | > loss_kl: 3.0439612865448 (5.10723598798116) | > loss_feat: 4.9865264892578125 (5.0240317185719805) | > loss_mel: 22.07978630065918 (22.662240982055664) | > loss_duration: 3.0602545738220215 (3.2559941609700522) | > loss_1: 35.64242172241211 (38.86983998616537) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_119000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8307583332061768 (2.6080567240715027) | > loss_disc_real_0: 0.2838935852050781 (0.3879627212882042) | > loss_disc_real_1: 0.2768802046775818 (0.24847473949193954) | > loss_disc_real_2: 0.20576111972332 (0.21943771466612816) | > loss_disc_real_3: 0.26467686891555786 (0.2583052068948746) | > loss_disc_real_4: 0.12100467830896378 (0.27758740074932575) | > loss_disc_real_5: 0.25894781947135925 (0.22185127064585686) | > loss_0: 2.8307583332061768 (2.6080567240715027) | > loss_gen: 1.9316757917404175 (2.598172217607498) | > loss_kl: 6.538067817687988 (5.464943945407867) | > loss_feat: 5.578684329986572 (5.162694871425629) | > loss_mel: 20.040555953979492 (22.00681972503662) | > loss_duration: 3.2460620403289795 (3.253511130809784) | > loss_1: 37.33504867553711 (38.4861421585083)  --> STEP: 1 | > loss_disc: 2.6931536197662354 (2.625076103210449) | > loss_disc_real_0: 0.5021195411682129 (0.4107940852642059) | > loss_disc_real_1: 0.19900333881378174 (0.23858045935630798) | > loss_disc_real_2: 0.3076901435852051 (0.23708820044994355) | > loss_disc_real_3: 0.2011260688304901 (0.24686937928199768) | > loss_disc_real_4: 0.31832101941108704 (0.285734124481678) | > loss_disc_real_5: 0.2913844585418701 (0.23575790822505951) | > loss_0: 2.6931536197662354 (2.625076103210449) | > loss_gen: 2.6691646575927734 (2.6123707056045533) | > loss_kl: 5.954145908355713 (5.562784337997437) | > loss_feat: 4.970029354095459 (5.1241617679595945) | > loss_mel: 23.503982543945312 (22.30625228881836) | > loss_duration: 3.402484178543091 (3.2833057403564454) | > loss_1: 40.49980545043945 (38.88887481689453)  --> STEP: 2 | > loss_disc: 2.1939260959625244 (2.5532177686691284) | > loss_disc_real_0: 0.30911630392074585 (0.39384778837362927) | > loss_disc_real_1: 0.25844699144363403 (0.241891548037529) | > loss_disc_real_2: 0.16875675320625305 (0.22569962590932846) | > loss_disc_real_3: 0.14079894125461578 (0.2291909729441007) | > loss_disc_real_4: 0.2561477720737457 (0.28080306574702263) | > loss_disc_real_5: 0.24076908826828003 (0.2365931048989296) | > loss_0: 2.1939260959625244 (2.5532177686691284) | > loss_gen: 3.041219472885132 (2.683845500151316) | > loss_kl: 6.736001014709473 (5.758320450782776) | > loss_feat: 8.030713081359863 (5.608586986859639) | > loss_mel: 26.11437225341797 (22.94093894958496) | > loss_duration: 3.3684051036834717 (3.2974889675776162) | > loss_1: 47.29071044921875 (40.289180755615234)  --> STEP: 3 | > loss_disc: 3.016787528991699 (2.6194420201437816) | > loss_disc_real_0: 0.5747134685516357 (0.41968574268477304) | > loss_disc_real_1: 0.2828935384750366 (0.24774897524288722) | > loss_disc_real_2: 0.2286626547574997 (0.2261229157447815) | > loss_disc_real_3: 0.36129194498062134 (0.24806254037788936) | > loss_disc_real_4: 0.25944751501083374 (0.27775227278470993) | > loss_disc_real_5: 0.29481935501098633 (0.24491114062922342) | > loss_0: 3.016787528991699 (2.6194420201437816) | > loss_gen: 2.368223190307617 (2.6387565987450734) | > loss_kl: 2.7828502655029297 (5.333253281457083) | > loss_feat: 1.8199050426483154 (5.0673467091151645) | > loss_mel: 19.704654693603516 (22.478612627301896) | > loss_duration: 3.1282548904418945 (3.273312670843942) | > loss_1: 29.803890228271484 (38.79128210885184) --> EVAL PERFORMANCE | > avg_loader_time: 0.4840798718588693 (+0.47525369553338914) | > avg_loss_disc: 2.6194420201437816 (-0.4019331591469899) | > avg_loss_disc_real_0: 0.41968574268477304 (+0.16896990083512808) | > avg_loss_disc_real_1: 0.24774897524288722 (-0.022441531930650988) | > avg_loss_disc_real_2: 0.2261229157447815 (-0.019441664218902588) | > avg_loss_disc_real_3: 0.24806254037788936 (-0.014212142143930712) | > avg_loss_disc_real_4: 0.27775227278470993 (+0.03774116933345795) | > avg_loss_disc_real_5: 0.24491114062922342 (+0.01783497773465656) | > avg_loss_0: 2.6194420201437816 (-0.4019331591469899) | > avg_loss_gen: 2.6387565987450734 (+0.9356600500288461) | > avg_loss_kl: 5.333253281457083 (+0.14868694260006876) | > avg_loss_feat: 5.0673467091151645 (+2.357554075263795) | > avg_loss_mel: 22.478612627301896 (+4.4291981515430265) | > avg_loss_duration: 3.273312670843942 (+0.009531441188994183) | > avg_loss_1: 38.79128210885184 (+7.880630266098745)  > EPOCH: 1320/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:01:08)   --> TIME: 2023-10-20 17:01:23 -- STEP: 9/50 -- GLOBAL_STEP: 119010 | > loss_disc: 2.2156693935394287 (2.1036133103900485) | > loss_disc_real_0: 0.07589565217494965 (0.08522001695301798) | > loss_disc_real_1: 0.12281874567270279 (0.17967480421066284) | > loss_disc_real_2: 0.08779238164424896 (0.17546358704566956) | > loss_disc_real_3: 0.0813463032245636 (0.1827290513449245) | > loss_disc_real_4: 0.04758736491203308 (0.15519782155752182) | > loss_disc_real_5: 0.01670839451253414 (0.167407907338606) | > loss_0: 2.2156693935394287 (2.1036133103900485) | > grad_norm_0: tensor(1069.5823, device='cuda:0') (tensor(519.7045, device='cuda:0')) | > loss_gen: 1.7100180387496948 (2.474793619579739) | > loss_kl: 0.6840405464172363 (0.7430090506871542) | > loss_feat: 8.648993492126465 (8.438428454928928) | > loss_mel: 20.043697357177734 (21.36660035451253) | > loss_duration: 1.3048474788665771 (1.3273855182859633) | > loss_1: 32.391597747802734 (34.35021760728624) | > grad_norm_1: tensor(12324.2773, device='cuda:0') (tensor(21776.0566, device='cuda:0')) | > current_lr_0: 5.342265247516346e-05 | > current_lr_1: 5.34761051904059e-05 | > step_time: 0.4151 (0.4469443957010905) | > loader_time: 0.0042 (0.01507931285434299)  --> TIME: 2023-10-20 17:01:40 -- STEP: 39/50 -- GLOBAL_STEP: 119040 | > loss_disc: 2.2916300296783447 (2.3783078682728305) | > loss_disc_real_0: 0.14040425419807434 (0.1432101256094682) | > loss_disc_real_1: 0.17376917600631714 (0.21662349846118537) | > loss_disc_real_2: 0.15237517654895782 (0.2347950658355004) | > loss_disc_real_3: 0.1256464570760727 (0.22687894831865263) | > loss_disc_real_4: 0.1714380383491516 (0.20547164508547539) | > loss_disc_real_5: 0.23260007798671722 (0.20563739590728894) | > loss_0: 2.2916300296783447 (2.3783078682728305) | > grad_norm_0: tensor(705.0427, device='cuda:0') (tensor(651.4136, device='cuda:0')) | > loss_gen: 2.5959599018096924 (2.3683554209195656) | > loss_kl: 0.5453205108642578 (0.7741683385311029) | > loss_feat: 5.790733814239502 (6.051653789881711) | > loss_mel: 21.609970092773438 (19.672558912864098) | > loss_duration: 1.386397361755371 (1.297836474883251) | > loss_1: 31.928382873535156 (30.164573119236874) | > grad_norm_1: tensor(9187.4033, device='cuda:0') (tensor(22887.4082, device='cuda:0')) | > current_lr_0: 5.342265247516346e-05 | > current_lr_1: 5.34761051904059e-05 | > step_time: 0.5618 (0.5284508130489252) | > loader_time: 0.0315 (0.01337584471091246)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.140085458755493 (2.140085458755493) | > loss_disc_real_0: 0.0854816809296608 (0.0854816809296608) | > loss_disc_real_1: 0.22998467087745667 (0.22998467087745667) | > loss_disc_real_2: 0.1895558089017868 (0.1895558089017868) | > loss_disc_real_3: 0.2963383197784424 (0.2963383197784424) | > loss_disc_real_4: 0.15059806406497955 (0.15059806406497955) | > loss_disc_real_5: 0.05617298558354378 (0.05617298558354378) | > loss_0: 2.140085458755493 (2.140085458755493) | > loss_gen: 2.1913833618164062 (2.1913833618164062) | > loss_kl: 7.089873313903809 (7.089873313903809) | > loss_feat: 6.878924369812012 (6.878924369812012) | > loss_mel: 13.902023315429688 (13.902023315429688) | > loss_duration: 3.1502909660339355 (3.1502909660339355) | > loss_1: 33.212493896484375 (33.212493896484375)  --> STEP: 1 | > loss_disc: 3.0432369709014893 (3.0432369709014893) | > loss_disc_real_0: 0.34643155336380005 (0.34643155336380005) | > loss_disc_real_1: 0.3043104112148285 (0.3043104112148285) | > loss_disc_real_2: 0.26958099007606506 (0.26958099007606506) | > loss_disc_real_3: 0.3759731352329254 (0.3759731352329254) | > loss_disc_real_4: 0.3515962064266205 (0.3515962064266205) | > loss_disc_real_5: 0.37189075350761414 (0.37189075350761414) | > loss_0: 3.0432369709014893 (3.0432369709014893) | > loss_gen: 2.291008472442627 (2.291008472442627) | > loss_kl: 5.74360990524292 (5.74360990524292) | > loss_feat: 5.13511323928833 (5.13511323928833) | > loss_mel: 23.40935516357422 (23.40935516357422) | > loss_duration: 3.4614675045013428 (3.4614675045013428) | > loss_1: 40.04055404663086 (40.04055404663086)  --> STEP: 2 | > loss_disc: 2.846014976501465 (2.944625973701477) | > loss_disc_real_0: 0.40510040521621704 (0.37576597929000854) | > loss_disc_real_1: 0.16039295494556427 (0.23235168308019638) | > loss_disc_real_2: 0.1590348780155182 (0.21430793404579163) | > loss_disc_real_3: 0.11244606226682663 (0.24420959874987602) | > loss_disc_real_4: 0.05413394048810005 (0.20286507345736027) | > loss_disc_real_5: 0.14325787127017975 (0.25757431238889694) | > loss_0: 2.846014976501465 (2.944625973701477) | > loss_gen: 1.8155252933502197 (2.0532668828964233) | > loss_kl: 6.664889812469482 (6.204249858856201) | > loss_feat: 11.379291534423828 (8.257202386856079) | > loss_mel: 27.037275314331055 (25.223315238952637) | > loss_duration: 3.3661317825317383 (3.4137996435165405) | > loss_1: 50.26311492919922 (45.15183448791504)  --> STEP: 3 | > loss_disc: 2.8998396396636963 (2.9296971956888833) | > loss_disc_real_0: 0.06919771432876587 (0.273576557636261) | > loss_disc_real_1: 0.2527238428592682 (0.23914240300655365) | > loss_disc_real_2: 0.2737868130207062 (0.2341342270374298) | > loss_disc_real_3: 0.29483577609062195 (0.26108499119679135) | > loss_disc_real_4: 0.24819783866405487 (0.21797599519292513) | > loss_disc_real_5: 0.272785484790802 (0.262644703189532) | > loss_0: 2.8998396396636963 (2.9296971956888833) | > loss_gen: 1.5661697387695312 (1.8909011681874592) | > loss_kl: 2.828524589538574 (5.079008102416992) | > loss_feat: 0.99593186378479 (5.836778879165649) | > loss_mel: 17.34744644165039 (22.598025639851887) | > loss_duration: 2.981886863708496 (3.269828716913859) | > loss_1: 25.719959259033203 (38.67454274495443) --> EVAL PERFORMANCE | > avg_loader_time: 0.011964639027913412 (-0.4721152328309559) | > avg_loss_disc: 2.9296971956888833 (+0.31025517554510174) | > avg_loss_disc_real_0: 0.273576557636261 (-0.14610918504851206) | > avg_loss_disc_real_1: 0.23914240300655365 (-0.00860657223633357) | > avg_loss_disc_real_2: 0.2341342270374298 (+0.008011311292648315) | > avg_loss_disc_real_3: 0.26108499119679135 (+0.013022450818901993) | > avg_loss_disc_real_4: 0.21797599519292513 (-0.059776277591784804) | > avg_loss_disc_real_5: 0.262644703189532 (+0.017733562560308558) | > avg_loss_0: 2.9296971956888833 (+0.31025517554510174) | > avg_loss_gen: 1.8909011681874592 (-0.7478554305576142) | > avg_loss_kl: 5.079008102416992 (-0.25424517904009125) | > avg_loss_feat: 5.836778879165649 (+0.7694321700504849) | > avg_loss_mel: 22.598025639851887 (+0.11941301254999104) | > avg_loss_duration: 3.269828716913859 (-0.00348395393008305) | > avg_loss_1: 38.67454274495443 (-0.11673936389740902)  > EPOCH: 1321/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:02:17)   --> TIME: 2023-10-20 17:02:34 -- STEP: 19/50 -- GLOBAL_STEP: 119070 | > loss_disc: 2.969109058380127 (2.4175836726238855) | > loss_disc_real_0: 0.24141624569892883 (0.1437495819440014) | > loss_disc_real_1: 0.3273772597312927 (0.205158768123702) | > loss_disc_real_2: 0.37393060326576233 (0.21344439293208875) | > loss_disc_real_3: 0.290858656167984 (0.23298906829012067) | > loss_disc_real_4: 0.3648081123828888 (0.22893137700463595) | > loss_disc_real_5: 0.3332724869251251 (0.26417233814534385) | > loss_0: 2.969109058380127 (2.4175836726238855) | > grad_norm_0: tensor(673.8130, device='cuda:0') (tensor(730.9507, device='cuda:0')) | > loss_gen: 2.1070635318756104 (2.462750974454378) | > loss_kl: 0.921413004398346 (0.9111048140023884) | > loss_feat: 2.248176336288452 (6.423172579784143) | > loss_mel: 23.409832000732422 (22.211824392017565) | > loss_duration: 1.3825128078460693 (1.333663676914416) | > loss_1: 30.068998336791992 (33.34251629678827) | > grad_norm_1: tensor(3225.9353, device='cuda:0') (tensor(18888.1699, device='cuda:0')) | > current_lr_0: 5.336925318925655e-05 | > current_lr_1: 5.342265247516346e-05 | > step_time: 0.4288 (0.6410590974908126) | > loader_time: 0.003 (0.02447157157094855)  --> TIME: 2023-10-20 17:02:49 -- STEP: 49/50 -- GLOBAL_STEP: 119100 | > loss_disc: 2.4818601608276367 (2.57307618734788) | > loss_disc_real_0: 0.05796363949775696 (0.15093966079305626) | > loss_disc_real_1: 0.12099280208349228 (0.2272281328178182) | > loss_disc_real_2: 0.10663687437772751 (0.23097203352621623) | > loss_disc_real_3: 0.17490923404693604 (0.23541179656678315) | > loss_disc_real_4: 0.3032471239566803 (0.24141248186327974) | > loss_disc_real_5: 0.5420749187469482 (0.25403385845069976) | > loss_0: 2.4818601608276367 (2.57307618734788) | > grad_norm_0: tensor(565.7071, device='cuda:0') (tensor(751.8179, device='cuda:0')) | > loss_gen: 2.5876457691192627 (2.2122077066071184) | > loss_kl: 0.38090407848358154 (0.8042074151869331) | > loss_feat: 8.597186088562012 (4.9495931031296445) | > loss_mel: 24.28948974609375 (18.92078776505528) | > loss_duration: 1.4571352005004883 (1.305927879956304) | > loss_1: 37.31235885620117 (28.19272382891908) | > grad_norm_1: tensor(21416.6191, device='cuda:0') (tensor(17785.0117, device='cuda:0')) | > current_lr_0: 5.336925318925655e-05 | > current_lr_1: 5.342265247516346e-05 | > step_time: 0.3508 (0.536647879347509) | > loader_time: 0.4184 (0.026295199686167198)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0465493202209473 (3.0465493202209473) | > loss_disc_real_0: 0.38680005073547363 (0.38680005073547363) | > loss_disc_real_1: 0.24134954810142517 (0.24134954810142517) | > loss_disc_real_2: 0.21132276952266693 (0.21132276952266693) | > loss_disc_real_3: 0.1910334825515747 (0.1910334825515747) | > loss_disc_real_4: 0.27353695034980774 (0.27353695034980774) | > loss_disc_real_5: 0.27805012464523315 (0.27805012464523315) | > loss_0: 3.0465493202209473 (3.0465493202209473) | > loss_gen: 1.7866991758346558 (1.7866991758346558) | > loss_kl: 6.516932964324951 (6.516932964324951) | > loss_feat: 4.4221601486206055 (4.4221601486206055) | > loss_mel: 25.658716201782227 (25.658716201782227) | > loss_duration: 3.066194534301758 (3.066194534301758) | > loss_1: 41.45069885253906 (41.45069885253906)  --> STEP: 1 | > loss_disc: 2.9330735206604004 (2.9330735206604004) | > loss_disc_real_0: 0.4540325105190277 (0.4540325105190277) | > loss_disc_real_1: 0.2586979568004608 (0.2586979568004608) | > loss_disc_real_2: 0.10181436687707901 (0.10181436687707901) | > loss_disc_real_3: 0.18319343030452728 (0.18319343030452728) | > loss_disc_real_4: 0.15699291229248047 (0.15699291229248047) | > loss_disc_real_5: 0.2070859968662262 (0.2070859968662262) | > loss_0: 2.9330735206604004 (2.9330735206604004) | > loss_gen: 1.7051920890808105 (1.7051920890808105) | > loss_kl: 5.743043422698975 (5.743043422698975) | > loss_feat: 5.445328712463379 (5.445328712463379) | > loss_mel: 24.01229476928711 (24.01229476928711) | > loss_duration: 3.4136087894439697 (3.4136087894439697) | > loss_1: 40.3194694519043 (40.3194694519043)  --> STEP: 2 | > loss_disc: 3.3977856636047363 (3.1654295921325684) | > loss_disc_real_0: 0.4464767575263977 (0.4502546340227127) | > loss_disc_real_1: 0.2715262770652771 (0.26511211693286896) | > loss_disc_real_2: 0.21170982718467712 (0.15676209703087807) | > loss_disc_real_3: 0.3030831813812256 (0.24313830584287643) | > loss_disc_real_4: 0.2789110243320465 (0.2179519683122635) | > loss_disc_real_5: 0.37222546339035034 (0.28965573012828827) | > loss_0: 3.3977856636047363 (3.1654295921325684) | > loss_gen: 1.7339744567871094 (1.71958327293396) | > loss_kl: 6.4255218505859375 (6.084282636642456) | > loss_feat: 6.467232704162598 (5.956280708312988) | > loss_mel: 21.971908569335938 (22.992101669311523) | > loss_duration: 3.3868892192840576 (3.4002490043640137) | > loss_1: 39.98552703857422 (40.15249824523926)  --> STEP: 3 | > loss_disc: 3.069200277328491 (3.1333531538645425) | > loss_disc_real_0: 0.36839330196380615 (0.4229675233364105) | > loss_disc_real_1: 0.333001047372818 (0.287741760412852) | > loss_disc_real_2: 0.3309861421585083 (0.21483677874008814) | > loss_disc_real_3: 0.3433830738067627 (0.2765532284975052) | > loss_disc_real_4: 0.4224740266799927 (0.2861259877681732) | > loss_disc_real_5: 0.3074197769165039 (0.2955770790576935) | > loss_0: 3.069200277328491 (3.1333531538645425) | > loss_gen: 2.3951961994171143 (1.944787581761678) | > loss_kl: 2.913433313369751 (5.027332862218221) | > loss_feat: 4.839167594909668 (5.583909670511882) | > loss_mel: 21.27326011657715 (22.41915448506673) | > loss_duration: 3.053603172302246 (3.284700393676758) | > loss_1: 34.47465896606445 (38.25988515218099) --> EVAL PERFORMANCE | > avg_loader_time: 0.010154326756795248 (-0.001810312271118164) | > avg_loss_disc: 3.1333531538645425 (+0.20365595817565918) | > avg_loss_disc_real_0: 0.4229675233364105 (+0.14939096570014954) | > avg_loss_disc_real_1: 0.287741760412852 (+0.04859935740629834) | > avg_loss_disc_real_2: 0.21483677874008814 (-0.019297448297341674) | > avg_loss_disc_real_3: 0.2765532284975052 (+0.015468237300713839) | > avg_loss_disc_real_4: 0.2861259877681732 (+0.06814999257524809) | > avg_loss_disc_real_5: 0.2955770790576935 (+0.0329323758681615) | > avg_loss_0: 3.1333531538645425 (+0.20365595817565918) | > avg_loss_gen: 1.944787581761678 (+0.05388641357421875) | > avg_loss_kl: 5.027332862218221 (-0.051675240198771455) | > avg_loss_feat: 5.583909670511882 (-0.2528692086537676) | > avg_loss_mel: 22.41915448506673 (-0.17887115478515625) | > avg_loss_duration: 3.284700393676758 (+0.014871676762898911) | > avg_loss_1: 38.25988515218099 (-0.4146575927734375)  > EPOCH: 1322/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:03:10)   --> TIME: 2023-10-20 17:03:35 -- STEP: 29/50 -- GLOBAL_STEP: 119130 | > loss_disc: 2.1185357570648193 (2.398646519101899) | > loss_disc_real_0: 0.12352059781551361 (0.12606483518049635) | > loss_disc_real_1: 0.19558997452259064 (0.22760298694002218) | > loss_disc_real_2: 0.14348989725112915 (0.21835287583285365) | > loss_disc_real_3: 0.06741148978471756 (0.25259822478582117) | > loss_disc_real_4: 0.16899444162845612 (0.2166652906814526) | > loss_disc_real_5: 0.2834957242012024 (0.21841839810126815) | > loss_0: 2.1185357570648193 (2.398646519101899) | > grad_norm_0: tensor(354.3164, device='cuda:0') (tensor(442.9105, device='cuda:0')) | > loss_gen: 2.439366102218628 (2.443355913819938) | > loss_kl: 0.727534294128418 (0.8059472636929874) | > loss_feat: 7.37229585647583 (7.355829411443194) | > loss_mel: 24.0906925201416 (21.55825501063774) | > loss_duration: 1.2783734798431396 (1.310663075282656) | > loss_1: 35.908260345458984 (33.47405094935977) | > grad_norm_1: tensor(8935.2041, device='cuda:0') (tensor(21174.7871, device='cuda:0')) | > current_lr_0: 5.3315907279279205e-05 | > current_lr_1: 5.336925318925655e-05 | > step_time: 0.3667 (0.6227759657234981) | > loader_time: 0.0108 (0.019915852053412078)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.573268175125122 (2.573268175125122) | > loss_disc_real_0: 0.104049451649189 (0.104049451649189) | > loss_disc_real_1: 0.31682533025741577 (0.31682533025741577) | > loss_disc_real_2: 0.32085996866226196 (0.32085996866226196) | > loss_disc_real_3: 0.26118791103363037 (0.26118791103363037) | > loss_disc_real_4: 0.39855334162712097 (0.39855334162712097) | > loss_disc_real_5: 0.3221224248409271 (0.3221224248409271) | > loss_0: 2.573268175125122 (2.573268175125122) | > loss_gen: 2.8592007160186768 (2.8592007160186768) | > loss_kl: 6.0207414627075195 (6.0207414627075195) | > loss_feat: 4.583920955657959 (4.583920955657959) | > loss_mel: 25.51755142211914 (25.51755142211914) | > loss_duration: 3.158215284347534 (3.158215284347534) | > loss_1: 42.13962936401367 (42.13962936401367)  --> STEP: 1 | > loss_disc: 2.663949489593506 (2.663949489593506) | > loss_disc_real_0: 0.3152124881744385 (0.3152124881744385) | > loss_disc_real_1: 0.3521961271762848 (0.3521961271762848) | > loss_disc_real_2: 0.3239070773124695 (0.3239070773124695) | > loss_disc_real_3: 0.3155018985271454 (0.3155018985271454) | > loss_disc_real_4: 0.3423295021057129 (0.3423295021057129) | > loss_disc_real_5: 0.4428825378417969 (0.4428825378417969) | > loss_0: 2.663949489593506 (2.663949489593506) | > loss_gen: 3.9833872318267822 (3.9833872318267822) | > loss_kl: 5.991185665130615 (5.991185665130615) | > loss_feat: 5.553816318511963 (5.553816318511963) | > loss_mel: 24.13792610168457 (24.13792610168457) | > loss_duration: 3.524052381515503 (3.524052381515503) | > loss_1: 43.19036865234375 (43.19036865234375)  --> STEP: 2 | > loss_disc: 2.1163136959075928 (2.3901315927505493) | > loss_disc_real_0: 0.25547105073928833 (0.2853417694568634) | > loss_disc_real_1: 0.139494389295578 (0.2458452582359314) | > loss_disc_real_2: 0.06751316785812378 (0.19571012258529663) | > loss_disc_real_3: 0.09503313153982162 (0.2052675150334835) | > loss_disc_real_4: 0.020524276420474052 (0.18142688926309347) | > loss_disc_real_5: 0.10562728345394135 (0.2742549106478691) | > loss_0: 2.1163136959075928 (2.3901315927505493) | > loss_gen: 2.0267205238342285 (3.0050538778305054) | > loss_kl: 6.675983428955078 (6.333584547042847) | > loss_feat: 10.043496131896973 (7.798656225204468) | > loss_mel: 25.769229888916016 (24.953577995300293) | > loss_duration: 3.3738646507263184 (3.4489585161209106) | > loss_1: 47.8892936706543 (45.53983116149902)  --> STEP: 3 | > loss_disc: 3.582892656326294 (2.7877186139424643) | > loss_disc_real_0: 0.10669496655464172 (0.22579283515612283) | > loss_disc_real_1: 0.3151366710662842 (0.268942395846049) | > loss_disc_real_2: 0.40554141998291016 (0.26565388838450116) | > loss_disc_real_3: 0.39110955595970154 (0.2672148620088895) | > loss_disc_real_4: 0.5438596606254578 (0.30223781305054825) | > loss_disc_real_5: 0.54599928855896 (0.36483636995156604) | > loss_0: 3.582892656326294 (2.7877186139424643) | > loss_gen: 2.2272591590881348 (2.7457889715830484) | > loss_kl: 2.925260543823242 (5.1974765459696455) | > loss_feat: 5.339530944824219 (6.978947798411052) | > loss_mel: 21.66998863220215 (23.85904820760091) | > loss_duration: 3.069232225418091 (3.322383085886637) | > loss_1: 35.23127365112305 (42.10364532470703) --> EVAL PERFORMANCE | > avg_loader_time: 0.02486276626586914 (+0.014708439509073893) | > avg_loss_disc: 2.7877186139424643 (-0.34563453992207815) | > avg_loss_disc_real_0: 0.22579283515612283 (-0.1971746881802877) | > avg_loss_disc_real_1: 0.268942395846049 (-0.01879936456680298) | > avg_loss_disc_real_2: 0.26565388838450116 (+0.05081710964441302) | > avg_loss_disc_real_3: 0.2672148620088895 (-0.00933836648861569) | > avg_loss_disc_real_4: 0.30223781305054825 (+0.016111825282375036) | > avg_loss_disc_real_5: 0.36483636995156604 (+0.06925929089387256) | > avg_loss_0: 2.7877186139424643 (-0.34563453992207815) | > avg_loss_gen: 2.7457889715830484 (+0.8010013898213704) | > avg_loss_kl: 5.1974765459696455 (+0.17014368375142475) | > avg_loss_feat: 6.978947798411052 (+1.39503812789917) | > avg_loss_mel: 23.85904820760091 (+1.4398937225341797) | > avg_loss_duration: 3.322383085886637 (+0.03768269220987941) | > avg_loss_1: 42.10364532470703 (+3.8437601725260393)  > EPOCH: 1323/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:04:05)   --> TIME: 2023-10-20 17:04:16 -- STEP: 9/50 -- GLOBAL_STEP: 119160 | > loss_disc: 2.978043794631958 (2.4938548141055636) | > loss_disc_real_0: 0.22343671321868896 (0.1823413067807754) | > loss_disc_real_1: 0.28632691502571106 (0.24677306910355887) | > loss_disc_real_2: 0.28138357400894165 (0.22763332310650083) | > loss_disc_real_3: 0.2685282230377197 (0.23681153274244732) | > loss_disc_real_4: 0.2565303444862366 (0.21647664739025962) | > loss_disc_real_5: 0.25200679898262024 (0.17762084098325837) | > loss_0: 2.978043794631958 (2.4938548141055636) | > grad_norm_0: tensor(697.0821, device='cuda:0') (tensor(756.4514, device='cuda:0')) | > loss_gen: 1.60289466381073 (2.144420451588101) | > loss_kl: 0.7563371062278748 (0.7126628094249301) | > loss_feat: 0.1254250854253769 (4.89577933980359) | > loss_mel: 1.421557068824768 (15.752735998895433) | > loss_duration: 1.2670153379440308 (1.3132653501298692) | > loss_1: 5.173229217529297 (24.81886386871338) | > grad_norm_1: tensor(35644.6875, device='cuda:0') (tensor(10604.5811, device='cuda:0')) | > current_lr_0: 5.3262614691878824e-05 | > current_lr_1: 5.3315907279279205e-05 | > step_time: 0.3051 (0.640962176852756) | > loader_time: 0.0048 (0.024458991156684026)  --> TIME: 2023-10-20 17:04:28 -- STEP: 39/50 -- GLOBAL_STEP: 119190 | > loss_disc: 0.9306914210319519 (2.4285995730986962) | > loss_disc_real_0: 0.007908361032605171 (0.14062477696018338) | > loss_disc_real_1: 0.04570998623967171 (0.22010626137638703) | > loss_disc_real_2: 0.02156664803624153 (0.21483561301078552) | > loss_disc_real_3: 0.01974443346261978 (0.2302353479541265) | > loss_disc_real_4: 0.017069676890969276 (0.22655554746205991) | > loss_disc_real_5: 0.03337985649704933 (0.22134124425550303) | > loss_0: 0.9306914210319519 (2.4285995730986962) | > grad_norm_0: tensor(323.3802, device='cuda:0') (tensor(565.7393, device='cuda:0')) | > loss_gen: 3.399369478225708 (2.2843230045758762) | > loss_kl: 0.4070441722869873 (0.733391729828257) | > loss_feat: 13.759573936462402 (6.312816861539315) | > loss_mel: 24.88852310180664 (20.167689772752617) | > loss_duration: 1.3711117506027222 (1.2974029871133657) | > loss_1: 43.82562255859375 (30.795624402853157) | > grad_norm_1: tensor(45044.4180, device='cuda:0') (tensor(15295.8965, device='cuda:0')) | > current_lr_0: 5.3262614691878824e-05 | > current_lr_1: 5.3315907279279205e-05 | > step_time: 0.336 (0.45295121730902255) | > loader_time: 0.0025 (0.012995695456480369)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8410539627075195 (2.8410539627075195) | > loss_disc_real_0: 0.4455317258834839 (0.4455317258834839) | > loss_disc_real_1: 0.2779974639415741 (0.2779974639415741) | > loss_disc_real_2: 0.3408890962600708 (0.3408890962600708) | > loss_disc_real_3: 0.25502684712409973 (0.25502684712409973) | > loss_disc_real_4: 0.2740737795829773 (0.2740737795829773) | > loss_disc_real_5: 0.4490778148174286 (0.4490778148174286) | > loss_0: 2.8410539627075195 (2.8410539627075195) | > loss_gen: 2.6810269355773926 (2.6810269355773926) | > loss_kl: 6.718602180480957 (6.718602180480957) | > loss_feat: 5.3692827224731445 (5.3692827224731445) | > loss_mel: 22.04224967956543 (22.04224967956543) | > loss_duration: 3.1157076358795166 (3.1157076358795166) | > loss_1: 39.9268684387207 (39.9268684387207)  --> STEP: 1 | > loss_disc: 2.7331290245056152 (2.7331290245056152) | > loss_disc_real_0: 0.3590099811553955 (0.3590099811553955) | > loss_disc_real_1: 0.39319899678230286 (0.39319899678230286) | > loss_disc_real_2: 0.22236037254333496 (0.22236037254333496) | > loss_disc_real_3: 0.3273736238479614 (0.3273736238479614) | > loss_disc_real_4: 0.44978827238082886 (0.44978827238082886) | > loss_disc_real_5: 0.25671035051345825 (0.25671035051345825) | > loss_0: 2.7331290245056152 (2.7331290245056152) | > loss_gen: 3.6268203258514404 (3.6268203258514404) | > loss_kl: 6.06842565536499 (6.06842565536499) | > loss_feat: 9.262325286865234 (9.262325286865234) | > loss_mel: 25.263029098510742 (25.263029098510742) | > loss_duration: 3.476527214050293 (3.476527214050293) | > loss_1: 47.69712829589844 (47.69712829589844)  --> STEP: 2 | > loss_disc: 3.0961670875549316 (2.9146480560302734) | > loss_disc_real_0: 0.35634827613830566 (0.3576791286468506) | > loss_disc_real_1: 0.2810983955860138 (0.3371486961841583) | > loss_disc_real_2: 0.2554342448711395 (0.23889730870723724) | > loss_disc_real_3: 0.27101579308509827 (0.29919470846652985) | > loss_disc_real_4: 0.2752813398838043 (0.3625348061323166) | > loss_disc_real_5: 0.2554660737514496 (0.2560882121324539) | > loss_0: 3.0961670875549316 (2.9146480560302734) | > loss_gen: 1.676690697669983 (2.6517555117607117) | > loss_kl: 6.837292671203613 (6.452859163284302) | > loss_feat: 0.5212841629981995 (4.891804724931717) | > loss_mel: 6.980695724487305 (16.121862411499023) | > loss_duration: 3.300916910171509 (3.388722062110901) | > loss_1: 19.316879272460938 (33.50700378417969)  --> STEP: 3 | > loss_disc: 3.617154598236084 (3.1488169034322104) | > loss_disc_real_0: 0.6085626482963562 (0.4413069685300191) | > loss_disc_real_1: 0.2645699381828308 (0.3129557768503825) | > loss_disc_real_2: 0.28575876355171204 (0.2545177936553955) | > loss_disc_real_3: 0.31693732738494873 (0.3051089147726695) | > loss_disc_real_4: 0.3272687792778015 (0.3507794638474782) | > loss_disc_real_5: 0.3654014468193054 (0.2925259570280711) | > loss_0: 3.617154598236084 (3.1488169034322104) | > loss_gen: 1.676861047744751 (2.326790690422058) | > loss_kl: 3.2949891090393066 (5.400235811869304) | > loss_feat: 2.9117884635925293 (4.231799304485321) | > loss_mel: 19.607959747314453 (17.283894856770832) | > loss_duration: 3.0375618934631348 (3.2716686725616455) | > loss_1: 30.529159545898438 (32.51438903808594) --> EVAL PERFORMANCE | > avg_loader_time: 0.00491182009379069 (-0.01995094617207845) | > avg_loss_disc: 3.1488169034322104 (+0.3610982894897461) | > avg_loss_disc_real_0: 0.4413069685300191 (+0.21551413337389627) | > avg_loss_disc_real_1: 0.3129557768503825 (+0.044013381004333496) | > avg_loss_disc_real_2: 0.2545177936553955 (-0.01113609472910565) | > avg_loss_disc_real_3: 0.3051089147726695 (+0.037894052763779995) | > avg_loss_disc_real_4: 0.3507794638474782 (+0.04854165079692996) | > avg_loss_disc_real_5: 0.2925259570280711 (-0.07231041292349494) | > avg_loss_0: 3.1488169034322104 (+0.3610982894897461) | > avg_loss_gen: 2.326790690422058 (-0.41899828116099025) | > avg_loss_kl: 5.400235811869304 (+0.2027592658996582) | > avg_loss_feat: 4.231799304485321 (-2.7471484939257307) | > avg_loss_mel: 17.283894856770832 (-6.575153350830078) | > avg_loss_duration: 3.2716686725616455 (-0.050714413324991714) | > avg_loss_1: 32.51438903808594 (-9.589256286621094)  > EPOCH: 1324/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:04:57)   --> TIME: 2023-10-20 17:05:10 -- STEP: 19/50 -- GLOBAL_STEP: 119220 | > loss_disc: 2.5362987518310547 (2.5321807359394275) | > loss_disc_real_0: 0.05244509503245354 (0.16619739289346494) | > loss_disc_real_1: 0.3477223813533783 (0.22982947920498095) | > loss_disc_real_2: 0.36240172386169434 (0.2248028828517387) | > loss_disc_real_3: 0.3945978879928589 (0.2317550215674074) | > loss_disc_real_4: 0.4078108072280884 (0.24622517588891482) | > loss_disc_real_5: 0.3512505888938904 (0.26388441555594144) | > loss_0: 2.5362987518310547 (2.5321807359394275) | > grad_norm_0: tensor(489.9478, device='cuda:0') (tensor(782.4311, device='cuda:0')) | > loss_gen: 2.965454578399658 (2.2852671460101477) | > loss_kl: 0.9172819256782532 (0.734643210705958) | > loss_feat: 5.305063247680664 (5.095240788240182) | > loss_mel: 22.149503707885742 (19.72900823542946) | > loss_duration: 1.3478150367736816 (1.3349513442892778) | > loss_1: 32.68511962890625 (29.179111229745967) | > grad_norm_1: tensor(6438.9424, device='cuda:0') (tensor(20617.3496, device='cuda:0')) | > current_lr_0: 5.3209375373756165e-05 | > current_lr_1: 5.3262614691878824e-05 | > step_time: 0.2427 (0.4021937094236675) | > loader_time: 0.0018 (0.016181042319849917)  --> TIME: 2023-10-20 17:05:26 -- STEP: 49/50 -- GLOBAL_STEP: 119250 | > loss_disc: 2.0573031902313232 (2.4987835494839405) | > loss_disc_real_0: 0.08274668455123901 (0.14408816529285848) | > loss_disc_real_1: 0.1653313785791397 (0.2249103063831524) | > loss_disc_real_2: 0.1583671122789383 (0.22329263807255395) | > loss_disc_real_3: 0.24867387115955353 (0.2355376573241487) | > loss_disc_real_4: 0.13620799779891968 (0.23785261568442292) | > loss_disc_real_5: 0.15637561678886414 (0.23784196481336745) | > loss_0: 2.0573031902313232 (2.4987835494839405) | > grad_norm_0: tensor(1426.6492, device='cuda:0') (tensor(819.3631, device='cuda:0')) | > loss_gen: 2.2778818607330322 (2.2287579653214435) | > loss_kl: 0.4870259165763855 (0.7446866214883571) | > loss_feat: 4.584586143493652 (5.197042440653456) | > loss_mel: 19.837074279785156 (19.34103921724825) | > loss_duration: 1.3755301237106323 (1.300397882656175) | > loss_1: 28.562097549438477 (28.811924243459895) | > grad_norm_1: tensor(7786.3145, device='cuda:0') (tensor(17826.9902, device='cuda:0')) | > current_lr_0: 5.3209375373756165e-05 | > current_lr_1: 5.3262614691878824e-05 | > step_time: 0.4204 (0.46227691124896614) | > loader_time: 0.4324 (0.022871153695242747)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7081174850463867 (2.7081174850463867) | > loss_disc_real_0: 0.3779473304748535 (0.3779473304748535) | > loss_disc_real_1: 0.34006792306900024 (0.34006792306900024) | > loss_disc_real_2: 0.31375885009765625 (0.31375885009765625) | > loss_disc_real_3: 0.20630130171775818 (0.20630130171775818) | > loss_disc_real_4: 0.14545109868049622 (0.14545109868049622) | > loss_disc_real_5: 0.30825427174568176 (0.30825427174568176) | > loss_0: 2.7081174850463867 (2.7081174850463867) | > loss_gen: 2.7814419269561768 (2.7814419269561768) | > loss_kl: 6.700500011444092 (6.700500011444092) | > loss_feat: 7.604367256164551 (7.604367256164551) | > loss_mel: 25.342784881591797 (25.342784881591797) | > loss_duration: 3.127627372741699 (3.127627372741699) | > loss_1: 45.55672073364258 (45.55672073364258)  --> STEP: 1 | > loss_disc: 2.8894999027252197 (2.8894999027252197) | > loss_disc_real_0: 0.20431196689605713 (0.20431196689605713) | > loss_disc_real_1: 0.09853404760360718 (0.09853404760360718) | > loss_disc_real_2: 0.05448034405708313 (0.05448034405708313) | > loss_disc_real_3: 0.13927635550498962 (0.13927635550498962) | > loss_disc_real_4: 0.09215282648801804 (0.09215282648801804) | > loss_disc_real_5: 0.07403016090393066 (0.07403016090393066) | > loss_0: 2.8894999027252197 (2.8894999027252197) | > loss_gen: 1.5170162916183472 (1.5170162916183472) | > loss_kl: 6.260181903839111 (6.260181903839111) | > loss_feat: 11.259992599487305 (11.259992599487305) | > loss_mel: 25.590160369873047 (25.590160369873047) | > loss_duration: 3.503469705581665 (3.503469705581665) | > loss_1: 48.13082504272461 (48.13082504272461)  --> STEP: 2 | > loss_disc: 3.4965994358062744 (3.193049669265747) | > loss_disc_real_0: 0.5809148550033569 (0.39261341094970703) | > loss_disc_real_1: 0.2610120177268982 (0.17977303266525269) | > loss_disc_real_2: 0.2311953902244568 (0.14283786714076996) | > loss_disc_real_3: 0.26728248596191406 (0.20327942073345184) | > loss_disc_real_4: 0.29368430376052856 (0.1929185651242733) | > loss_disc_real_5: 0.3321535289287567 (0.2030918449163437) | > loss_0: 3.4965994358062744 (3.193049669265747) | > loss_gen: 1.8182982206344604 (1.6676572561264038) | > loss_kl: 6.89595890045166 (6.578070402145386) | > loss_feat: 3.6935458183288574 (7.476769208908081) | > loss_mel: 13.468072891235352 (19.5291166305542) | > loss_duration: 3.340583324432373 (3.422026515007019) | > loss_1: 29.216459274291992 (38.6736421585083)  --> STEP: 3 | > loss_disc: 3.344193458557129 (3.2434309323628745) | > loss_disc_real_0: 0.3481890559196472 (0.37780529260635376) | > loss_disc_real_1: 0.32928046584129333 (0.2296088437239329) | > loss_disc_real_2: 0.27091023325920105 (0.18552865584691366) | > loss_disc_real_3: 0.3358050584793091 (0.24745463331540427) | > loss_disc_real_4: 0.4268905520439148 (0.27090922743082047) | > loss_disc_real_5: 0.48786038160324097 (0.29801469047864276) | > loss_0: 3.344193458557129 (3.2434309323628745) | > loss_gen: 2.2943549156188965 (1.8765564759572346) | > loss_kl: 3.2574377059936523 (5.471192836761475) | > loss_feat: 4.054371356964111 (6.335969924926758) | > loss_mel: 19.86761474609375 (19.64194933573405) | > loss_duration: 3.1692049503326416 (3.33775266011556) | > loss_1: 32.64298629760742 (36.66342353820801) --> EVAL PERFORMANCE | > avg_loader_time: 0.011379480361938477 (+0.006467660268147786) | > avg_loss_disc: 3.2434309323628745 (+0.09461402893066406) | > avg_loss_disc_real_0: 0.37780529260635376 (-0.06350167592366535) | > avg_loss_disc_real_1: 0.2296088437239329 (-0.08334693312644961) | > avg_loss_disc_real_2: 0.18552865584691366 (-0.06898913780848184) | > avg_loss_disc_real_3: 0.24745463331540427 (-0.05765428145726523) | > avg_loss_disc_real_4: 0.27090922743082047 (-0.07987023641665775) | > avg_loss_disc_real_5: 0.29801469047864276 (+0.005488733450571659) | > avg_loss_0: 3.2434309323628745 (+0.09461402893066406) | > avg_loss_gen: 1.8765564759572346 (-0.4502342144648235) | > avg_loss_kl: 5.471192836761475 (+0.07095702489217093) | > avg_loss_feat: 6.335969924926758 (+2.1041706204414368) | > avg_loss_mel: 19.64194933573405 (+2.3580544789632185) | > avg_loss_duration: 3.33775266011556 (+0.06608398755391454) | > avg_loss_1: 36.66342353820801 (+4.14903450012207)  > EPOCH: 1325/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:05:46)   --> TIME: 2023-10-20 17:06:02 -- STEP: 29/50 -- GLOBAL_STEP: 119280 | > loss_disc: 2.936673402786255 (2.385531840653255) | > loss_disc_real_0: 0.3089902400970459 (0.14824963951932973) | > loss_disc_real_1: 0.26558172702789307 (0.21444967646023322) | > loss_disc_real_2: 0.2728084921836853 (0.20171650614717912) | > loss_disc_real_3: 0.26173192262649536 (0.22945913466913948) | > loss_disc_real_4: 0.23318210244178772 (0.2113141567799552) | > loss_disc_real_5: 0.2183004766702652 (0.20501418848489894) | > loss_0: 2.936673402786255 (2.385531840653255) | > grad_norm_0: tensor(3521.4536, device='cuda:0') (tensor(1142.6610, device='cuda:0')) | > loss_gen: 1.638957142829895 (2.3167861042351556) | > loss_kl: 0.8870201706886292 (0.8636964960344906) | > loss_feat: 0.3278283178806305 (6.055570219097467) | > loss_mel: 11.946106910705566 (19.5171999520269) | > loss_duration: 1.2596352100372314 (1.297098579077885) | > loss_1: 16.059547424316406 (30.050351422408532) | > grad_norm_1: tensor(38197.9453, device='cuda:0') (tensor(48149.6719, device='cuda:0')) | > current_lr_0: 5.3156189271665246e-05 | > current_lr_1: 5.3209375373756165e-05 | > step_time: 0.4471 (0.34245434300652866) | > loader_time: 0.0024 (0.006781931581168339)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7819178104400635 (2.7819178104400635) | > loss_disc_real_0: 0.4003075659275055 (0.4003075659275055) | > loss_disc_real_1: 0.3840324580669403 (0.3840324580669403) | > loss_disc_real_2: 0.3171907067298889 (0.3171907067298889) | > loss_disc_real_3: 0.2047819197177887 (0.2047819197177887) | > loss_disc_real_4: 0.38552623987197876 (0.38552623987197876) | > loss_disc_real_5: 0.3699939548969269 (0.3699939548969269) | > loss_0: 2.7819178104400635 (2.7819178104400635) | > loss_gen: 2.796093702316284 (2.796093702316284) | > loss_kl: 6.709826469421387 (6.709826469421387) | > loss_feat: 6.697335720062256 (6.697335720062256) | > loss_mel: 21.20206642150879 (21.20206642150879) | > loss_duration: 3.1882309913635254 (3.1882309913635254) | > loss_1: 40.59355545043945 (40.59355545043945)  --> STEP: 1 | > loss_disc: 2.9776644706726074 (2.9776644706726074) | > loss_disc_real_0: 0.3865875005722046 (0.3865875005722046) | > loss_disc_real_1: 0.25364354252815247 (0.25364354252815247) | > loss_disc_real_2: 0.34883102774620056 (0.34883102774620056) | > loss_disc_real_3: 0.3426472842693329 (0.3426472842693329) | > loss_disc_real_4: 0.27637940645217896 (0.27637940645217896) | > loss_disc_real_5: 0.34880849719047546 (0.34880849719047546) | > loss_0: 2.9776644706726074 (2.9776644706726074) | > loss_gen: 2.2516837120056152 (2.2516837120056152) | > loss_kl: 6.3068647384643555 (6.3068647384643555) | > loss_feat: 1.5948830842971802 (1.5948830842971802) | > loss_mel: 19.36963653564453 (19.36963653564453) | > loss_duration: 3.483133554458618 (3.483133554458618) | > loss_1: 33.006202697753906 (33.006202697753906)  --> STEP: 2 | > loss_disc: 2.9025774002075195 (2.9401209354400635) | > loss_disc_real_0: 0.27350926399230957 (0.3300483822822571) | > loss_disc_real_1: 0.2998950779438019 (0.2767693102359772) | > loss_disc_real_2: 0.24864044785499573 (0.29873573780059814) | > loss_disc_real_3: 0.3009001612663269 (0.3217737227678299) | > loss_disc_real_4: 0.35932233929634094 (0.31785087287425995) | > loss_disc_real_5: 0.40194013714790344 (0.37537431716918945) | > loss_0: 2.9025774002075195 (2.9401209354400635) | > loss_gen: 2.5191805362701416 (2.3854321241378784) | > loss_kl: 6.71429967880249 (6.510582208633423) | > loss_feat: 7.642958164215088 (4.618920624256134) | > loss_mel: 23.525880813598633 (21.447758674621582) | > loss_duration: 3.317535877227783 (3.4003347158432007) | > loss_1: 43.71985626220703 (38.36302947998047)  --> STEP: 3 | > loss_disc: 2.8622031211853027 (2.9141483306884766) | > loss_disc_real_0: 0.3255053162574768 (0.32853402694066364) | > loss_disc_real_1: 0.259478896856308 (0.2710058391094208) | > loss_disc_real_2: 0.3093929886817932 (0.3022881547609965) | > loss_disc_real_3: 0.27403950691223145 (0.30586231748263043) | > loss_disc_real_4: 0.23755915462970734 (0.29108696679274243) | > loss_disc_real_5: 0.26904305815696716 (0.33993056416511536) | > loss_0: 2.8622031211853027 (2.9141483306884766) | > loss_gen: 1.9593329429626465 (2.2433990637461343) | > loss_kl: 3.1512386798858643 (5.390801032384236) | > loss_feat: 1.0374946594238281 (3.425111969312032) | > loss_mel: 17.923538208007812 (20.27301851908366) | > loss_duration: 3.138842821121216 (3.3131707509358725) | > loss_1: 27.210447311401367 (34.6455020904541) --> EVAL PERFORMANCE | > avg_loader_time: 0.011016050974527994 (-0.00036342938741048235) | > avg_loss_disc: 2.9141483306884766 (-0.32928260167439793) | > avg_loss_disc_real_0: 0.32853402694066364 (-0.04927126566569012) | > avg_loss_disc_real_1: 0.2710058391094208 (+0.041396995385487884) | > avg_loss_disc_real_2: 0.3022881547609965 (+0.11675949891408285) | > avg_loss_disc_real_3: 0.30586231748263043 (+0.058407684167226165) | > avg_loss_disc_real_4: 0.29108696679274243 (+0.020177739361921965) | > avg_loss_disc_real_5: 0.33993056416511536 (+0.04191587368647259) | > avg_loss_0: 2.9141483306884766 (-0.32928260167439793) | > avg_loss_gen: 2.2433990637461343 (+0.36684258778889967) | > avg_loss_kl: 5.390801032384236 (-0.08039180437723825) | > avg_loss_feat: 3.425111969312032 (-2.9108579556147256) | > avg_loss_mel: 20.27301851908366 (+0.6310691833496094) | > avg_loss_duration: 3.3131707509358725 (-0.0245819091796875) | > avg_loss_1: 34.6455020904541 (-2.0179214477539062)  > EPOCH: 1326/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:06:36)   --> TIME: 2023-10-20 17:06:59 -- STEP: 9/50 -- GLOBAL_STEP: 119310 | > loss_disc: 2.760392427444458 (2.6524813572565713) | > loss_disc_real_0: 0.1693832278251648 (0.11843897609247102) | > loss_disc_real_1: 0.25996002554893494 (0.24745123585065207) | > loss_disc_real_2: 0.16281060874462128 (0.26662372714943355) | > loss_disc_real_3: 0.29069283604621887 (0.25187225743300384) | > loss_disc_real_4: 0.24129371345043182 (0.23725101972619692) | > loss_disc_real_5: 0.29750528931617737 (0.270053187592162) | > loss_0: 2.760392427444458 (2.6524813572565713) | > grad_norm_0: tensor(1122.0814, device='cuda:0') (tensor(1254.6396, device='cuda:0')) | > loss_gen: 1.8862977027893066 (2.268170807096693) | > loss_kl: 0.6807941794395447 (0.6910432113541497) | > loss_feat: 2.8429386615753174 (6.665303786595662) | > loss_mel: 22.34567642211914 (22.04607825809055) | > loss_duration: 1.3279640674591064 (1.3331516716215346) | > loss_1: 29.08367156982422 (33.00374857584635) | > grad_norm_1: tensor(3988.9673, device='cuda:0') (tensor(28278.9277, device='cuda:0')) | > current_lr_0: 5.3103056332413326e-05 | > current_lr_1: 5.3156189271665246e-05 | > step_time: 0.8265 (0.7006897926330566) | > loader_time: 0.0336 (0.03324903382195367)  --> TIME: 2023-10-20 17:07:14 -- STEP: 39/50 -- GLOBAL_STEP: 119340 | > loss_disc: 1.2461628913879395 (2.571133873401544) | > loss_disc_real_0: 0.039957307279109955 (0.15669344403804877) | > loss_disc_real_1: 0.09866005927324295 (0.236849807202816) | > loss_disc_real_2: 0.01305781863629818 (0.23560015245890006) | > loss_disc_real_3: 0.16258716583251953 (0.23249727501892126) | > loss_disc_real_4: 0.02637561783194542 (0.2283746879070233) | > loss_disc_real_5: 0.010112856514751911 (0.23377546765960944) | > loss_0: 1.2461628913879395 (2.571133873401544) | > grad_norm_0: tensor(337.4085, device='cuda:0') (tensor(776.2995, device='cuda:0')) | > loss_gen: 2.9203972816467285 (2.167465533965673) | > loss_kl: 0.5607056021690369 (0.8023814398508806) | > loss_feat: 10.68781852722168 (5.191850462785134) | > loss_mel: 28.036012649536133 (18.798859000205994) | > loss_duration: 1.3099734783172607 (1.3014491551961653) | > loss_1: 43.51491165161133 (28.262005989368145) | > grad_norm_1: tensor(23517.8809, device='cuda:0') (tensor(17793.2051, device='cuda:0')) | > current_lr_0: 5.3103056332413326e-05 | > current_lr_1: 5.3156189271665246e-05 | > step_time: 0.3514 (0.5258032358609711) | > loader_time: 0.0091 (0.017514387766520183)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2434425354003906 (2.2434425354003906) | > loss_disc_real_0: 0.48544859886169434 (0.48544859886169434) | > loss_disc_real_1: 0.27019003033638 (0.27019003033638) | > loss_disc_real_2: 0.22782742977142334 (0.22782742977142334) | > loss_disc_real_3: 0.15361690521240234 (0.15361690521240234) | > loss_disc_real_4: 0.2453259825706482 (0.2453259825706482) | > loss_disc_real_5: 0.14617766439914703 (0.14617766439914703) | > loss_0: 2.2434425354003906 (2.2434425354003906) | > loss_gen: 3.2041118144989014 (3.2041118144989014) | > loss_kl: 7.3560638427734375 (7.3560638427734375) | > loss_feat: 10.350120544433594 (10.350120544433594) | > loss_mel: 25.778823852539062 (25.778823852539062) | > loss_duration: 3.217796564102173 (3.217796564102173) | > loss_1: 49.906917572021484 (49.906917572021484)  --> STEP: 1 | > loss_disc: 2.3703622817993164 (2.3703622817993164) | > loss_disc_real_0: 0.040049221366643906 (0.040049221366643906) | > loss_disc_real_1: 0.16852597892284393 (0.16852597892284393) | > loss_disc_real_2: 0.23929058015346527 (0.23929058015346527) | > loss_disc_real_3: 0.36649906635284424 (0.36649906635284424) | > loss_disc_real_4: 0.1449163258075714 (0.1449163258075714) | > loss_disc_real_5: 0.14756229519844055 (0.14756229519844055) | > loss_0: 2.3703622817993164 (2.3703622817993164) | > loss_gen: 2.3854241371154785 (2.3854241371154785) | > loss_kl: 6.468341827392578 (6.468341827392578) | > loss_feat: 9.53892993927002 (9.53892993927002) | > loss_mel: 23.038272857666016 (23.038272857666016) | > loss_duration: 3.3968591690063477 (3.3968591690063477) | > loss_1: 44.82782745361328 (44.82782745361328)  --> STEP: 2 | > loss_disc: 2.7864060401916504 (2.5783841609954834) | > loss_disc_real_0: 0.3265282213687897 (0.1832887213677168) | > loss_disc_real_1: 0.1733936071395874 (0.17095979303121567) | > loss_disc_real_2: 0.27933356165885925 (0.25931207090616226) | > loss_disc_real_3: 0.3089736998081207 (0.3377363830804825) | > loss_disc_real_4: 0.15175217390060425 (0.14833424985408783) | > loss_disc_real_5: 0.10448607802391052 (0.12602418661117554) | > loss_0: 2.7864060401916504 (2.5783841609954834) | > loss_gen: 2.071751594543457 (2.2285878658294678) | > loss_kl: 6.5549139976501465 (6.511627912521362) | > loss_feat: 9.258660316467285 (9.398795127868652) | > loss_mel: 23.561294555664062 (23.29978370666504) | > loss_duration: 3.2823519706726074 (3.3396055698394775) | > loss_1: 44.728973388671875 (44.77840042114258)  --> STEP: 3 | > loss_disc: 3.1652743816375732 (2.7740142345428467) | > loss_disc_real_0: 0.40789860486984253 (0.25815868253509205) | > loss_disc_real_1: 0.30238378047943115 (0.2147677888472875) | > loss_disc_real_2: 0.2968160808086395 (0.27181340754032135) | > loss_disc_real_3: 0.2753860652446747 (0.3169529438018799) | > loss_disc_real_4: 0.321336567401886 (0.20600168903668722) | > loss_disc_real_5: 0.2566688060760498 (0.16957239309946695) | > loss_0: 3.1652743816375732 (2.7740142345428467) | > loss_gen: 2.0606443881988525 (2.1726067066192627) | > loss_kl: 2.9840331077575684 (5.335762977600098) | > loss_feat: 3.091564416885376 (7.296384890874227) | > loss_mel: 19.31901741027832 (21.972861607869465) | > loss_duration: 3.0895845890045166 (3.2562652428944907) | > loss_1: 30.544843673706055 (40.033881505330406) --> EVAL PERFORMANCE | > avg_loader_time: 0.003522634506225586 (-0.007493416468302408) | > avg_loss_disc: 2.7740142345428467 (-0.14013409614562988) | > avg_loss_disc_real_0: 0.25815868253509205 (-0.07037534440557158) | > avg_loss_disc_real_1: 0.2147677888472875 (-0.05623805026213327) | > avg_loss_disc_real_2: 0.27181340754032135 (-0.03047474722067517) | > avg_loss_disc_real_3: 0.3169529438018799 (+0.011090626319249453) | > avg_loss_disc_real_4: 0.20600168903668722 (-0.0850852777560552) | > avg_loss_disc_real_5: 0.16957239309946695 (-0.1703581710656484) | > avg_loss_0: 2.7740142345428467 (-0.14013409614562988) | > avg_loss_gen: 2.1726067066192627 (-0.0707923571268716) | > avg_loss_kl: 5.335762977600098 (-0.0550380547841387) | > avg_loss_feat: 7.296384890874227 (+3.8712729215621944) | > avg_loss_mel: 21.972861607869465 (+1.699843088785805) | > avg_loss_duration: 3.2562652428944907 (-0.056905508041381836) | > avg_loss_1: 40.033881505330406 (+5.3883794148763045)  > EPOCH: 1327/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:07:47)   --> TIME: 2023-10-20 17:08:03 -- STEP: 19/50 -- GLOBAL_STEP: 119370 | > loss_disc: 2.2412004470825195 (2.4932941574799385) | > loss_disc_real_0: 0.08341863006353378 (0.1396763028675004) | > loss_disc_real_1: 0.3144705891609192 (0.2320096267289237) | > loss_disc_real_2: 0.19994044303894043 (0.22434422589446368) | > loss_disc_real_3: 0.2806737422943115 (0.24220276937672966) | > loss_disc_real_4: 0.25056806206703186 (0.2576620951294899) | > loss_disc_real_5: 0.22329068183898926 (0.20837829899238913) | > loss_0: 2.2412004470825195 (2.4932941574799385) | > grad_norm_0: tensor(333.2268, device='cuda:0') (tensor(573.4155, device='cuda:0')) | > loss_gen: 2.554453134536743 (2.227268281735871) | > loss_kl: 0.6629371047019958 (0.6904349578054327) | > loss_feat: 5.925385475158691 (5.062468376206724) | > loss_mel: 22.867149353027344 (19.533620533190273) | > loss_duration: 1.3467433452606201 (1.3128051067653452) | > loss_1: 33.35667037963867 (28.82659746471204) | > grad_norm_1: tensor(7842.8423, device='cuda:0') (tensor(15218.3213, device='cuda:0')) | > current_lr_0: 5.3049976502860804e-05 | > current_lr_1: 5.3103056332413326e-05 | > step_time: 0.5347 (0.6366100311279297) | > loader_time: 0.0283 (0.021887603558992084)  --> TIME: 2023-10-20 17:08:22 -- STEP: 49/50 -- GLOBAL_STEP: 119400 | > loss_disc: 2.714718818664551 (2.500444521709365) | > loss_disc_real_0: 0.04837806522846222 (0.14750844453062328) | > loss_disc_real_1: 0.21194566786289215 (0.23097054128135955) | > loss_disc_real_2: 0.3074135482311249 (0.22602524197831445) | > loss_disc_real_3: 0.23146675527095795 (0.2397299092643115) | > loss_disc_real_4: 0.19413435459136963 (0.24669190226312795) | > loss_disc_real_5: 0.18423710763454437 (0.2215787765703031) | > loss_0: 2.714718818664551 (2.500444521709365) | > grad_norm_0: tensor(787.4184, device='cuda:0') (tensor(587.0821, device='cuda:0')) | > loss_gen: 1.8716028928756714 (2.2191691836532277) | > loss_kl: 0.5469199419021606 (0.7102805595008694) | > loss_feat: 3.7137835025787354 (4.8970610485697295) | > loss_mel: 23.189783096313477 (19.09046691047902) | > loss_duration: 1.4256529808044434 (1.2929630109242027) | > loss_1: 30.747743606567383 (28.209940939533467) | > grad_norm_1: tensor(4895.7852, device='cuda:0') (tensor(14807.8760, device='cuda:0')) | > current_lr_0: 5.3049976502860804e-05 | > current_lr_1: 5.3103056332413326e-05 | > step_time: 0.5967 (0.612699163203337) | > loader_time: 0.4181 (0.02953116747797752)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.280609369277954 (2.280609369277954) | > loss_disc_real_0: 0.2636120915412903 (0.2636120915412903) | > loss_disc_real_1: 0.20186297595500946 (0.20186297595500946) | > loss_disc_real_2: 0.19506560266017914 (0.19506560266017914) | > loss_disc_real_3: 0.17034584283828735 (0.17034584283828735) | > loss_disc_real_4: 0.20193104445934296 (0.20193104445934296) | > loss_disc_real_5: 0.3636850118637085 (0.3636850118637085) | > loss_0: 2.280609369277954 (2.280609369277954) | > loss_gen: 2.4777629375457764 (2.4777629375457764) | > loss_kl: 5.760058403015137 (5.760058403015137) | > loss_feat: 6.501552104949951 (6.501552104949951) | > loss_mel: 21.607402801513672 (21.607402801513672) | > loss_duration: 3.054457426071167 (3.054457426071167) | > loss_1: 39.4012336730957 (39.4012336730957)  --> STEP: 1 | > loss_disc: 2.873504161834717 (2.873504161834717) | > loss_disc_real_0: 0.2898695468902588 (0.2898695468902588) | > loss_disc_real_1: 0.3028488755226135 (0.3028488755226135) | > loss_disc_real_2: 0.2791106104850769 (0.2791106104850769) | > loss_disc_real_3: 0.27580904960632324 (0.27580904960632324) | > loss_disc_real_4: 0.290848970413208 (0.290848970413208) | > loss_disc_real_5: 0.2587786316871643 (0.2587786316871643) | > loss_0: 2.873504161834717 (2.873504161834717) | > loss_gen: 2.0028834342956543 (2.0028834342956543) | > loss_kl: 6.1839823722839355 (6.1839823722839355) | > loss_feat: 1.9318979978561401 (1.9318979978561401) | > loss_mel: 19.49911880493164 (19.49911880493164) | > loss_duration: 3.4310693740844727 (3.4310693740844727) | > loss_1: 33.0489501953125 (33.0489501953125)  --> STEP: 2 | > loss_disc: 2.2226946353912354 (2.548099398612976) | > loss_disc_real_0: 0.2676513195037842 (0.2787604331970215) | > loss_disc_real_1: 0.2499309629201889 (0.2763899192214012) | > loss_disc_real_2: 0.23303115367889404 (0.2560708820819855) | > loss_disc_real_3: 0.2441607266664505 (0.25998488813638687) | > loss_disc_real_4: 0.10371503233909607 (0.19728200137615204) | > loss_disc_real_5: 0.07521495223045349 (0.1669967919588089) | > loss_0: 2.2226946353912354 (2.548099398612976) | > loss_gen: 2.4950294494628906 (2.2489564418792725) | > loss_kl: 6.443849563598633 (6.313915967941284) | > loss_feat: 9.074777603149414 (5.503337800502777) | > loss_mel: 23.851224899291992 (21.675171852111816) | > loss_duration: 3.3042585849761963 (3.3676639795303345) | > loss_1: 45.16913986206055 (39.10904502868652)  --> STEP: 3 | > loss_disc: 3.0999388694763184 (2.732045888900757) | > loss_disc_real_0: 0.23316718637943268 (0.2635626842578252) | > loss_disc_real_1: 0.29037177562713623 (0.28105053802331287) | > loss_disc_real_2: 0.3178274631500244 (0.2766564091046651) | > loss_disc_real_3: 0.3119748830795288 (0.2773148864507675) | > loss_disc_real_4: 0.3947340250015259 (0.26309934258461) | > loss_disc_real_5: 0.36247554421424866 (0.23215637604395548) | > loss_0: 3.0999388694763184 (2.732045888900757) | > loss_gen: 2.1859397888183594 (2.2279508908589682) | > loss_kl: 3.0774152278900146 (5.235082387924194) | > loss_feat: 4.458227157592773 (5.154967586199443) | > loss_mel: 21.811098098754883 (21.72048060099284) | > loss_duration: 3.078761100769043 (3.2713630199432373) | > loss_1: 34.61144256591797 (37.60984420776367) --> EVAL PERFORMANCE | > avg_loader_time: 0.008351484934488932 (+0.004828850428263346) | > avg_loss_disc: 2.732045888900757 (-0.041968345642089844) | > avg_loss_disc_real_0: 0.2635626842578252 (+0.005404001722733143) | > avg_loss_disc_real_1: 0.28105053802331287 (+0.06628274917602536) | > avg_loss_disc_real_2: 0.2766564091046651 (+0.004843001564343752) | > avg_loss_disc_real_3: 0.2773148864507675 (-0.039638057351112366) | > avg_loss_disc_real_4: 0.26309934258461 (+0.05709765354792276) | > avg_loss_disc_real_5: 0.23215637604395548 (+0.06258398294448853) | > avg_loss_0: 2.732045888900757 (-0.041968345642089844) | > avg_loss_gen: 2.2279508908589682 (+0.05534418423970555) | > avg_loss_kl: 5.235082387924194 (-0.10068058967590332) | > avg_loss_feat: 5.154967586199443 (-2.1414173046747838) | > avg_loss_mel: 21.72048060099284 (-0.25238100687662524) | > avg_loss_duration: 3.2713630199432373 (+0.015097777048746597) | > avg_loss_1: 37.60984420776367 (-2.424037297566734)  > EPOCH: 1328/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:08:37)   --> TIME: 2023-10-20 17:09:01 -- STEP: 29/50 -- GLOBAL_STEP: 119430 | > loss_disc: 1.4486671686172485 (2.4239796194536924) | > loss_disc_real_0: 0.0374317467212677 (0.14762762596766493) | > loss_disc_real_1: 0.16842196881771088 (0.2178261811877119) | > loss_disc_real_2: 0.13954035937786102 (0.21676147934691659) | > loss_disc_real_3: 0.08711791783571243 (0.2190172017134469) | > loss_disc_real_4: 0.03254486992955208 (0.21522160311197414) | > loss_disc_real_5: 0.04629528895020485 (0.21647110215291895) | > loss_0: 1.4486671686172485 (2.4239796194536924) | > grad_norm_0: tensor(273.4633, device='cuda:0') (tensor(633.1606, device='cuda:0')) | > loss_gen: 2.721034288406372 (2.2642676501438537) | > loss_kl: 0.8945221304893494 (0.7926576507502587) | > loss_feat: 11.33209228515625 (5.94836292364474) | > loss_mel: 23.348739624023438 (18.337217236387318) | > loss_duration: 1.2342506647109985 (1.299216130684162) | > loss_1: 39.5306396484375 (28.64172149526662) | > grad_norm_1: tensor(13307.2695, device='cuda:0') (tensor(22265.6895, device='cuda:0')) | > current_lr_0: 5.299694972992121e-05 | > current_lr_1: 5.3049976502860804e-05 | > step_time: 0.835 (0.6068887874997894) | > loader_time: 0.0236 (0.01846242773121801)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8470442295074463 (2.8470442295074463) | > loss_disc_real_0: 0.5134338140487671 (0.5134338140487671) | > loss_disc_real_1: 0.28793564438819885 (0.28793564438819885) | > loss_disc_real_2: 0.2498696744441986 (0.2498696744441986) | > loss_disc_real_3: 0.3412042558193207 (0.3412042558193207) | > loss_disc_real_4: 0.29755207896232605 (0.29755207896232605) | > loss_disc_real_5: 0.4302440285682678 (0.4302440285682678) | > loss_0: 2.8470442295074463 (2.8470442295074463) | > loss_gen: 3.304882049560547 (3.304882049560547) | > loss_kl: 5.507801532745361 (5.507801532745361) | > loss_feat: 6.277451992034912 (6.277451992034912) | > loss_mel: 20.9128360748291 (20.9128360748291) | > loss_duration: 3.0506653785705566 (3.0506653785705566) | > loss_1: 39.05363845825195 (39.05363845825195)  --> STEP: 1 | > loss_disc: 2.7899365425109863 (2.7899365425109863) | > loss_disc_real_0: 0.2083028256893158 (0.2083028256893158) | > loss_disc_real_1: 0.21690742671489716 (0.21690742671489716) | > loss_disc_real_2: 0.3141261339187622 (0.3141261339187622) | > loss_disc_real_3: 0.1868329793214798 (0.1868329793214798) | > loss_disc_real_4: 0.37077993154525757 (0.37077993154525757) | > loss_disc_real_5: 0.4545924961566925 (0.4545924961566925) | > loss_0: 2.7899365425109863 (2.7899365425109863) | > loss_gen: 2.3217225074768066 (2.3217225074768066) | > loss_kl: 5.556457042694092 (5.556457042694092) | > loss_feat: 6.819047451019287 (6.819047451019287) | > loss_mel: 23.31130599975586 (23.31130599975586) | > loss_duration: 3.438495397567749 (3.438495397567749) | > loss_1: 41.44702911376953 (41.44702911376953)  --> STEP: 2 | > loss_disc: 2.7757327556610107 (2.7828346490859985) | > loss_disc_real_0: 0.2910250425338745 (0.24966393411159515) | > loss_disc_real_1: 0.28486913442611694 (0.25088828057050705) | > loss_disc_real_2: 0.34604790806770325 (0.3300870209932327) | > loss_disc_real_3: 0.3096603751182556 (0.2482466772198677) | > loss_disc_real_4: 0.27423402667045593 (0.32250697910785675) | > loss_disc_real_5: 0.23180440068244934 (0.3431984484195709) | > loss_0: 2.7757327556610107 (2.7828346490859985) | > loss_gen: 2.1892294883728027 (2.2554759979248047) | > loss_kl: 7.104020595550537 (6.3302388191223145) | > loss_feat: 3.3375020027160645 (5.078274726867676) | > loss_mel: 25.252958297729492 (24.282132148742676) | > loss_duration: 3.3090736865997314 (3.3737845420837402) | > loss_1: 41.19278335571289 (41.31990623474121)  --> STEP: 3 | > loss_disc: 3.0099332332611084 (2.8585341771443686) | > loss_disc_real_0: 0.5354061126708984 (0.34491132696469623) | > loss_disc_real_1: 0.24033837020397186 (0.247371643781662) | > loss_disc_real_2: 0.252241849899292 (0.3041386306285858) | > loss_disc_real_3: 0.30326300859451294 (0.26658545434474945) | > loss_disc_real_4: 0.2612224817276001 (0.30207881331443787) | > loss_disc_real_5: 0.24447444081306458 (0.3102904458840688) | > loss_0: 3.0099332332611084 (2.8585341771443686) | > loss_gen: 2.040843963623047 (2.1839319864908853) | > loss_kl: 3.25188946723938 (5.30412236849467) | > loss_feat: 1.1377066373825073 (3.7647520303726196) | > loss_mel: 17.75070571899414 (22.104990005493164) | > loss_duration: 3.019941806793213 (3.2558369636535645) | > loss_1: 27.201086044311523 (36.61363283793131) --> EVAL PERFORMANCE | > avg_loader_time: 0.013323068618774414 (+0.004971583684285482) | > avg_loss_disc: 2.8585341771443686 (+0.1264882882436118) | > avg_loss_disc_real_0: 0.34491132696469623 (+0.08134864270687103) | > avg_loss_disc_real_1: 0.247371643781662 (-0.03367889424165088) | > avg_loss_disc_real_2: 0.3041386306285858 (+0.027482221523920713) | > avg_loss_disc_real_3: 0.26658545434474945 (-0.010729432106018066) | > avg_loss_disc_real_4: 0.30207881331443787 (+0.03897947072982788) | > avg_loss_disc_real_5: 0.3102904458840688 (+0.07813406984011331) | > avg_loss_0: 2.8585341771443686 (+0.1264882882436118) | > avg_loss_gen: 2.1839319864908853 (-0.04401890436808298) | > avg_loss_kl: 5.30412236849467 (+0.06903998057047556) | > avg_loss_feat: 3.7647520303726196 (-1.3902155558268232) | > avg_loss_mel: 22.104990005493164 (+0.38450940450032434) | > avg_loss_duration: 3.2558369636535645 (-0.015526056289672852) | > avg_loss_1: 36.61363283793131 (-0.9962113698323591)  > EPOCH: 1329/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:09:25)   --> TIME: 2023-10-20 17:09:36 -- STEP: 9/50 -- GLOBAL_STEP: 119460 | > loss_disc: 2.687990665435791 (2.6399979061550565) | > loss_disc_real_0: 0.1599246710538864 (0.13852408900856972) | > loss_disc_real_1: 0.27639704942703247 (0.25178495711750454) | > loss_disc_real_2: 0.29840660095214844 (0.26618261800871956) | > loss_disc_real_3: 0.35784733295440674 (0.30439625349309707) | > loss_disc_real_4: 0.28828129172325134 (0.2682829913165834) | > loss_disc_real_5: 0.302005410194397 (0.25861354503366685) | > loss_0: 2.687990665435791 (2.6399979061550565) | > grad_norm_0: tensor(431.2109, device='cuda:0') (tensor(584.3324, device='cuda:0')) | > loss_gen: 2.343733310699463 (2.148933860990736) | > loss_kl: 0.8621640801429749 (0.8634593553013272) | > loss_feat: 4.230832099914551 (4.142264541652468) | > loss_mel: 19.959217071533203 (17.250674857033623) | > loss_duration: 1.3212940692901611 (1.3138284418318007) | > loss_1: 28.717241287231445 (25.719160821702744) | > grad_norm_1: tensor(4668.8540, device='cuda:0') (tensor(13261.9102, device='cuda:0')) | > current_lr_0: 5.294397596056115e-05 | > current_lr_1: 5.299694972992121e-05 | > step_time: 0.4932 (0.6376899613274468) | > loader_time: 0.0098 (0.02348600493537055)  --> TIME: 2023-10-20 17:09:53 -- STEP: 39/50 -- GLOBAL_STEP: 119490 | > loss_disc: 2.5978803634643555 (2.4743702778449426) | > loss_disc_real_0: 0.2644226551055908 (0.13985780650415477) | > loss_disc_real_1: 0.4252931773662567 (0.2274720378411122) | > loss_disc_real_2: 0.2715623676776886 (0.22787702217316017) | > loss_disc_real_3: 0.1955334097146988 (0.24641941473461115) | > loss_disc_real_4: 0.27396559715270996 (0.2278420021996284) | > loss_disc_real_5: 0.1768205761909485 (0.22522376315333906) | > loss_0: 2.5978803634643555 (2.4743702778449426) | > grad_norm_0: tensor(823.7459, device='cuda:0') (tensor(565.8810, device='cuda:0')) | > loss_gen: 2.6556453704833984 (2.2365916447761722) | > loss_kl: 0.6742805242538452 (0.8283096223305433) | > loss_feat: 5.439489364624023 (5.45377620214071) | > loss_mel: 19.586374282836914 (19.76053706499246) | > loss_duration: 1.4027210474014282 (1.293786809994624) | > loss_1: 29.75851058959961 (29.57300112797664) | > grad_norm_1: tensor(7285.0835, device='cuda:0') (tensor(14274.1426, device='cuda:0')) | > current_lr_0: 5.294397596056115e-05 | > current_lr_1: 5.299694972992121e-05 | > step_time: 0.7867 (0.5814645412640694) | > loader_time: 0.0333 (0.018031774423061267)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0018067359924316 (3.0018067359924316) | > loss_disc_real_0: 0.43787461519241333 (0.43787461519241333) | > loss_disc_real_1: 0.2671356201171875 (0.2671356201171875) | > loss_disc_real_2: 0.27365756034851074 (0.27365756034851074) | > loss_disc_real_3: 0.28279900550842285 (0.28279900550842285) | > loss_disc_real_4: 0.28907474875450134 (0.28907474875450134) | > loss_disc_real_5: 0.2670402228832245 (0.2670402228832245) | > loss_0: 3.0018067359924316 (3.0018067359924316) | > loss_gen: 2.071641683578491 (2.071641683578491) | > loss_kl: 6.1328630447387695 (6.1328630447387695) | > loss_feat: 0.789142370223999 (0.789142370223999) | > loss_mel: 18.87989044189453 (18.87989044189453) | > loss_duration: 3.0537109375 (3.0537109375) | > loss_1: 30.927248001098633 (30.927248001098633)  --> STEP: 1 | > loss_disc: 3.2062299251556396 (3.2062299251556396) | > loss_disc_real_0: 0.4988059401512146 (0.4988059401512146) | > loss_disc_real_1: 0.3031192719936371 (0.3031192719936371) | > loss_disc_real_2: 0.3038935363292694 (0.3038935363292694) | > loss_disc_real_3: 0.21727001667022705 (0.21727001667022705) | > loss_disc_real_4: 0.2845284640789032 (0.2845284640789032) | > loss_disc_real_5: 0.376524418592453 (0.376524418592453) | > loss_0: 3.2062299251556396 (3.2062299251556396) | > loss_gen: 1.9887539148330688 (1.9887539148330688) | > loss_kl: 6.169960021972656 (6.169960021972656) | > loss_feat: 5.307084083557129 (5.307084083557129) | > loss_mel: 22.69060516357422 (22.69060516357422) | > loss_duration: 3.506438970565796 (3.506438970565796) | > loss_1: 39.662841796875 (39.662841796875)  --> STEP: 2 | > loss_disc: 2.0944108963012695 (2.6503204107284546) | > loss_disc_real_0: 0.09473375231027603 (0.2967698462307453) | > loss_disc_real_1: 0.21895121037960052 (0.2610352411866188) | > loss_disc_real_2: 0.1975671797990799 (0.25073035806417465) | > loss_disc_real_3: 0.21257147192955017 (0.2149207442998886) | > loss_disc_real_4: 0.1280761957168579 (0.20630232989788055) | > loss_disc_real_5: 0.1028934195637703 (0.23970891907811165) | > loss_0: 2.0944108963012695 (2.6503204107284546) | > loss_gen: 2.5500810146331787 (2.269417464733124) | > loss_kl: 7.06213903427124 (6.616049528121948) | > loss_feat: 10.74332332611084 (8.025203704833984) | > loss_mel: 22.773548126220703 (22.73207664489746) | > loss_duration: 3.354255437850952 (3.430347204208374) | > loss_1: 46.48334503173828 (43.07309341430664)  --> STEP: 3 | > loss_disc: 2.230746269226074 (2.5104623635609946) | > loss_disc_real_0: 0.3711197078227997 (0.32155313342809677) | > loss_disc_real_1: 0.32506218552589417 (0.28237755596637726) | > loss_disc_real_2: 0.26678013801574707 (0.2560802847146988) | > loss_disc_real_3: 0.20219159126281738 (0.21067769328753153) | > loss_disc_real_4: 0.2176167517900467 (0.21007380386193594) | > loss_disc_real_5: 0.10595471411943436 (0.1951241840918859) | > loss_0: 2.230746269226074 (2.5104623635609946) | > loss_gen: 3.4451045989990234 (2.6613131761550903) | > loss_kl: 2.7738053798675537 (5.335301478703816) | > loss_feat: 8.094796180725098 (8.04840119679769) | > loss_mel: 25.37388038635254 (23.612677892049152) | > loss_duration: 3.0954971313476562 (3.3187305132548013) | > loss_1: 42.7830810546875 (42.97642262776693) --> EVAL PERFORMANCE | > avg_loader_time: 0.024323145548502605 (+0.011000076929728191) | > avg_loss_disc: 2.5104623635609946 (-0.348071813583374) | > avg_loss_disc_real_0: 0.32155313342809677 (-0.02335819353659946) | > avg_loss_disc_real_1: 0.28237755596637726 (+0.03500591218471527) | > avg_loss_disc_real_2: 0.2560802847146988 (-0.048058345913887024) | > avg_loss_disc_real_3: 0.21067769328753153 (-0.055907761057217925) | > avg_loss_disc_real_4: 0.21007380386193594 (-0.09200500945250192) | > avg_loss_disc_real_5: 0.1951241840918859 (-0.1151662617921829) | > avg_loss_0: 2.5104623635609946 (-0.348071813583374) | > avg_loss_gen: 2.6613131761550903 (+0.47738118966420506) | > avg_loss_kl: 5.335301478703816 (+0.031179110209146543) | > avg_loss_feat: 8.04840119679769 (+4.28364916642507) | > avg_loss_mel: 23.612677892049152 (+1.5076878865559884) | > avg_loss_duration: 3.3187305132548013 (+0.06289354960123683) | > avg_loss_1: 42.97642262776693 (+6.362789789835617)  > EPOCH: 1330/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:10:15)   --> TIME: 2023-10-20 17:10:33 -- STEP: 19/50 -- GLOBAL_STEP: 119520 | > loss_disc: 1.5519157648086548 (2.526052280476218) | > loss_disc_real_0: 0.04704033210873604 (0.17442739259843765) | > loss_disc_real_1: 0.15729495882987976 (0.20883953100756594) | > loss_disc_real_2: 0.15930138528347015 (0.23778633861557433) | > loss_disc_real_3: 0.11353019624948502 (0.25098530859931517) | > loss_disc_real_4: 0.07918953150510788 (0.23644935736726774) | > loss_disc_real_5: 0.09284878522157669 (0.25772954793156755) | > loss_0: 1.5519157648086548 (2.526052280476218) | > grad_norm_0: tensor(345.0511, device='cuda:0') (tensor(664.8613, device='cuda:0')) | > loss_gen: 2.5295417308807373 (2.2643703410499976) | > loss_kl: 0.7068578004837036 (0.866422143421675) | > loss_feat: 7.21683931350708 (5.4930970066864235) | > loss_mel: 24.09425926208496 (17.641808779616106) | > loss_duration: 1.378857970237732 (1.3226977649487948) | > loss_1: 35.926353454589844 (27.588395972000924) | > grad_norm_1: tensor(4352.6665, device='cuda:0') (tensor(26082.0957, device='cuda:0')) | > current_lr_0: 5.289105514180021e-05 | > current_lr_1: 5.294397596056115e-05 | > step_time: 0.5624 (0.6012157389992162) | > loader_time: 0.0355 (0.02610771279585989)  --> TIME: 2023-10-20 17:10:53 -- STEP: 49/50 -- GLOBAL_STEP: 119550 | > loss_disc: 2.6714580059051514 (2.4514985376474807) | > loss_disc_real_0: 0.03197351470589638 (0.15752917706814348) | > loss_disc_real_1: 0.18527749180793762 (0.2129621704926296) | > loss_disc_real_2: 0.12931644916534424 (0.2152127161698074) | > loss_disc_real_3: 0.2618747353553772 (0.25206715944318137) | > loss_disc_real_4: 0.2572009265422821 (0.22331444825977087) | > loss_disc_real_5: 0.2752758264541626 (0.22719714815291212) | > loss_0: 2.6714580059051514 (2.4514985376474807) | > grad_norm_0: tensor(1425.7682, device='cuda:0') (tensor(626.7559, device='cuda:0')) | > loss_gen: 1.6114692687988281 (2.2750095274983613) | > loss_kl: 0.5085850954055786 (0.8087832523243768) | > loss_feat: 1.4097117185592651 (5.770710315251228) | > loss_mel: 20.04822540283203 (18.99743287903922) | > loss_duration: 1.4071228504180908 (1.2912162226073596) | > loss_1: 24.98511505126953 (29.14315234398355) | > grad_norm_1: tensor(4240.0684, device='cuda:0') (tensor(22757.4766, device='cuda:0')) | > current_lr_0: 5.289105514180021e-05 | > current_lr_1: 5.294397596056115e-05 | > step_time: 0.7635 (0.6180873111802704) | > loader_time: 0.4559 (0.03204750528140944)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2703685760498047 (2.2703685760498047) | > loss_disc_real_0: 0.08590209484100342 (0.08590209484100342) | > loss_disc_real_1: 0.195537731051445 (0.195537731051445) | > loss_disc_real_2: 0.18503694236278534 (0.18503694236278534) | > loss_disc_real_3: 0.1607396900653839 (0.1607396900653839) | > loss_disc_real_4: 0.10643888264894485 (0.10643888264894485) | > loss_disc_real_5: 0.05539222061634064 (0.05539222061634064) | > loss_0: 2.2703685760498047 (2.2703685760498047) | > loss_gen: 1.9380007982254028 (1.9380007982254028) | > loss_kl: 5.767629146575928 (5.767629146575928) | > loss_feat: 10.049674034118652 (10.049674034118652) | > loss_mel: 25.440900802612305 (25.440900802612305) | > loss_duration: 3.033073663711548 (3.033073663711548) | > loss_1: 46.22927474975586 (46.22927474975586)  --> STEP: 1 | > loss_disc: 2.5367445945739746 (2.5367445945739746) | > loss_disc_real_0: 0.505424439907074 (0.505424439907074) | > loss_disc_real_1: 0.2765335738658905 (0.2765335738658905) | > loss_disc_real_2: 0.21500582993030548 (0.21500582993030548) | > loss_disc_real_3: 0.22874484956264496 (0.22874484956264496) | > loss_disc_real_4: 0.2618373930454254 (0.2618373930454254) | > loss_disc_real_5: 0.31236258149147034 (0.31236258149147034) | > loss_0: 2.5367445945739746 (2.5367445945739746) | > loss_gen: 3.047880172729492 (3.047880172729492) | > loss_kl: 5.845282554626465 (5.845282554626465) | > loss_feat: 6.729037284851074 (6.729037284851074) | > loss_mel: 22.243545532226562 (22.243545532226562) | > loss_duration: 3.527634859085083 (3.527634859085083) | > loss_1: 41.39337921142578 (41.39337921142578)  --> STEP: 2 | > loss_disc: 1.9666777849197388 (2.2517111897468567) | > loss_disc_real_0: 0.19129624962806702 (0.3483603447675705) | > loss_disc_real_1: 0.22578099370002747 (0.251157283782959) | > loss_disc_real_2: 0.2518233358860016 (0.23341458290815353) | > loss_disc_real_3: 0.29323577880859375 (0.26099031418561935) | > loss_disc_real_4: 0.09048235416412354 (0.17615987360477448) | > loss_disc_real_5: 0.17428496479988098 (0.24332377314567566) | > loss_0: 1.9666777849197388 (2.2517111897468567) | > loss_gen: 2.8755319118499756 (2.961706042289734) | > loss_kl: 6.739686012268066 (6.292484283447266) | > loss_feat: 10.393692970275879 (8.561365127563477) | > loss_mel: 27.216707229614258 (24.73012638092041) | > loss_duration: 3.334646701812744 (3.4311407804489136) | > loss_1: 50.560264587402344 (45.97682189941406)  --> STEP: 3 | > loss_disc: 3.0007681846618652 (2.5013968547185264) | > loss_disc_real_0: 0.24068258702754974 (0.3124677588542302) | > loss_disc_real_1: 0.23971165716648102 (0.24734207491079965) | > loss_disc_real_2: 0.25777506828308105 (0.24153474469979605) | > loss_disc_real_3: 0.25133413076400757 (0.2577715863784154) | > loss_disc_real_4: 0.25737661123275757 (0.20323211948076883) | > loss_disc_real_5: 0.26750507950782776 (0.2513842085997264) | > loss_0: 3.0007681846618652 (2.5013968547185264) | > loss_gen: 1.5148462057113647 (2.4794194300969443) | > loss_kl: 2.9217910766601562 (5.1689198811848955) | > loss_feat: 0.033839937299489975 (5.718856730808814) | > loss_mel: 1.9918087720870972 (17.15068717797597) | > loss_duration: 2.993276596069336 (3.2851860523223877) | > loss_1: 9.455562591552734 (33.80306879679362) --> EVAL PERFORMANCE | > avg_loader_time: 0.0064678192138671875 (-0.017855326334635418) | > avg_loss_disc: 2.5013968547185264 (-0.009065508842468262) | > avg_loss_disc_real_0: 0.3124677588542302 (-0.009085374573866545) | > avg_loss_disc_real_1: 0.24734207491079965 (-0.035035481055577605) | > avg_loss_disc_real_2: 0.24153474469979605 (-0.014545540014902741) | > avg_loss_disc_real_3: 0.2577715863784154 (+0.04709389309088388) | > avg_loss_disc_real_4: 0.20323211948076883 (-0.006841684381167112) | > avg_loss_disc_real_5: 0.2513842085997264 (+0.056260024507840484) | > avg_loss_0: 2.5013968547185264 (-0.009065508842468262) | > avg_loss_gen: 2.4794194300969443 (-0.181893746058146) | > avg_loss_kl: 5.1689198811848955 (-0.1663815975189209) | > avg_loss_feat: 5.718856730808814 (-2.3295444659888753) | > avg_loss_mel: 17.15068717797597 (-6.461990714073181) | > avg_loss_duration: 3.2851860523223877 (-0.03354446093241359) | > avg_loss_1: 33.80306879679362 (-9.173353830973312)  > EPOCH: 1331/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:11:11)   --> TIME: 2023-10-20 17:11:33 -- STEP: 29/50 -- GLOBAL_STEP: 119580 | > loss_disc: 2.98884654045105 (2.599416556029485) | > loss_disc_real_0: 0.19835221767425537 (0.15984714448708912) | > loss_disc_real_1: 0.26901617646217346 (0.23145599213653598) | > loss_disc_real_2: 0.2491176426410675 (0.22117661106689224) | > loss_disc_real_3: 0.2522954046726227 (0.23296020475441012) | > loss_disc_real_4: 0.25578218698501587 (0.2523442095723645) | > loss_disc_real_5: 0.24687142670154572 (0.2383503410322913) | > loss_0: 2.98884654045105 (2.599416556029485) | > grad_norm_0: tensor(484.3714, device='cuda:0') (tensor(553.5001, device='cuda:0')) | > loss_gen: 1.4996271133422852 (2.051552941059244) | > loss_kl: 1.0187369585037231 (0.8382598644700544) | > loss_feat: 0.04775778949260712 (4.435122762389224) | > loss_mel: 3.743825674057007 (17.022934463517423) | > loss_duration: 1.2939413785934448 (1.3095788051342139) | > loss_1: 7.603888988494873 (25.65744871106641) | > grad_norm_1: tensor(46484.2617, device='cuda:0') (tensor(24677.6543, device='cuda:0')) | > current_lr_0: 5.283818722071095e-05 | > current_lr_1: 5.289105514180021e-05 | > step_time: 0.3437 (0.5447196796022613) | > loader_time: 0.0019 (0.013285768443140493)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1334142684936523 (3.1334142684936523) | > loss_disc_real_0: 0.1902388334274292 (0.1902388334274292) | > loss_disc_real_1: 0.21347229182720184 (0.21347229182720184) | > loss_disc_real_2: 0.2633463740348816 (0.2633463740348816) | > loss_disc_real_3: 0.37548044323921204 (0.37548044323921204) | > loss_disc_real_4: 0.38455116748809814 (0.38455116748809814) | > loss_disc_real_5: 0.5358968377113342 (0.5358968377113342) | > loss_0: 3.1334142684936523 (3.1334142684936523) | > loss_gen: 2.1914584636688232 (2.1914584636688232) | > loss_kl: 6.129554271697998 (6.129554271697998) | > loss_feat: 6.545207977294922 (6.545207977294922) | > loss_mel: 23.79567527770996 (23.79567527770996) | > loss_duration: 3.0414252281188965 (3.0414252281188965) | > loss_1: 41.70331954956055 (41.70331954956055)  --> STEP: 1 | > loss_disc: 3.130403518676758 (3.130403518676758) | > loss_disc_real_0: 0.20810803771018982 (0.20810803771018982) | > loss_disc_real_1: 0.3414804935455322 (0.3414804935455322) | > loss_disc_real_2: 0.27536311745643616 (0.27536311745643616) | > loss_disc_real_3: 0.23115645349025726 (0.23115645349025726) | > loss_disc_real_4: 0.3607061207294464 (0.3607061207294464) | > loss_disc_real_5: 0.31312087178230286 (0.31312087178230286) | > loss_0: 3.130403518676758 (3.130403518676758) | > loss_gen: 2.1161956787109375 (2.1161956787109375) | > loss_kl: 6.067699432373047 (6.067699432373047) | > loss_feat: 9.607157707214355 (9.607157707214355) | > loss_mel: 23.10346031188965 (23.10346031188965) | > loss_duration: 3.4092743396759033 (3.4092743396759033) | > loss_1: 44.30378723144531 (44.30378723144531)  --> STEP: 2 | > loss_disc: 2.392502546310425 (2.7614530324935913) | > loss_disc_real_0: 0.04817705601453781 (0.12814254686236382) | > loss_disc_real_1: 0.20017875730991364 (0.27082962542772293) | > loss_disc_real_2: 0.1436811089515686 (0.20952211320400238) | > loss_disc_real_3: 0.212799534201622 (0.22197799384593964) | > loss_disc_real_4: 0.11677706241607666 (0.23874159157276154) | > loss_disc_real_5: 0.14562782645225525 (0.22937434911727905) | > loss_0: 2.392502546310425 (2.7614530324935913) | > loss_gen: 1.6457853317260742 (1.8809905052185059) | > loss_kl: 6.473252296447754 (6.2704758644104) | > loss_feat: 6.903752326965332 (8.255455017089844) | > loss_mel: 22.101987838745117 (22.602724075317383) | > loss_duration: 3.3918750286102295 (3.4005746841430664) | > loss_1: 40.51665496826172 (42.410221099853516)  --> STEP: 3 | > loss_disc: 3.2238848209381104 (2.9155969619750977) | > loss_disc_real_0: 0.2507052719593048 (0.16899678856134415) | > loss_disc_real_1: 0.33977827429771423 (0.2938125083843867) | > loss_disc_real_2: 0.47046011686325073 (0.29650144775708515) | > loss_disc_real_3: 0.2858075797557831 (0.2432545224825541) | > loss_disc_real_4: 0.3303450644016266 (0.26927608251571655) | > loss_disc_real_5: 0.3553540110588074 (0.27136756976445514) | > loss_0: 3.2238848209381104 (2.9155969619750977) | > loss_gen: 2.0534474849700928 (1.9384761651357014) | > loss_kl: 2.8986337184906006 (5.146528482437134) | > loss_feat: 3.569046974182129 (6.693319002787272) | > loss_mel: 20.82185173034668 (22.00909996032715) | > loss_duration: 3.0244791507720947 (3.2752095063527427) | > loss_1: 32.36745834350586 (39.0626335144043) --> EVAL PERFORMANCE | > avg_loader_time: 0.012985626856486002 (+0.0065178076426188145) | > avg_loss_disc: 2.9155969619750977 (+0.4142001072565713) | > avg_loss_disc_real_0: 0.16899678856134415 (-0.14347097029288608) | > avg_loss_disc_real_1: 0.2938125083843867 (+0.046470433473587064) | > avg_loss_disc_real_2: 0.29650144775708515 (+0.054966703057289096) | > avg_loss_disc_real_3: 0.2432545224825541 (-0.014517063895861299) | > avg_loss_disc_real_4: 0.26927608251571655 (+0.06604396303494772) | > avg_loss_disc_real_5: 0.27136756976445514 (+0.019983361164728763) | > avg_loss_0: 2.9155969619750977 (+0.4142001072565713) | > avg_loss_gen: 1.9384761651357014 (-0.5409432649612429) | > avg_loss_kl: 5.146528482437134 (-0.022391398747761748) | > avg_loss_feat: 6.693319002787272 (+0.9744622719784584) | > avg_loss_mel: 22.00909996032715 (+4.858412782351177) | > avg_loss_duration: 3.2752095063527427 (-0.009976545969645034) | > avg_loss_1: 39.0626335144043 (+5.2595647176106795)  > EPOCH: 1332/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:11:53)   --> TIME: 2023-10-20 17:12:04 -- STEP: 9/50 -- GLOBAL_STEP: 119610 | > loss_disc: 2.496920347213745 (2.3974849780400596) | > loss_disc_real_0: 0.12842214107513428 (0.12356189245151149) | > loss_disc_real_1: 0.33290961384773254 (0.22459059953689575) | > loss_disc_real_2: 0.1892399936914444 (0.22621956798765394) | > loss_disc_real_3: 0.34050607681274414 (0.21807380558715928) | > loss_disc_real_4: 0.28131648898124695 (0.24699856713414192) | > loss_disc_real_5: 0.22396714985370636 (0.25342291427983177) | > loss_0: 2.496920347213745 (2.3974849780400596) | > grad_norm_0: tensor(662.7106, device='cuda:0') (tensor(424.8427, device='cuda:0')) | > loss_gen: 2.3029730319976807 (2.323480566342672) | > loss_kl: 0.4032265543937683 (0.5597318145963881) | > loss_feat: 4.183407783508301 (6.6353997679220305) | > loss_mel: 22.42087745666504 (19.804041783014934) | > loss_duration: 1.319312572479248 (1.2853061623043485) | > loss_1: 30.629796981811523 (30.607959853278267) | > grad_norm_1: tensor(15838.3213, device='cuda:0') (tensor(18465.9512, device='cuda:0')) | > current_lr_0: 5.2785372144418854e-05 | > current_lr_1: 5.283818722071095e-05 | > step_time: 0.5573 (0.6028436554802789) | > loader_time: 0.0387 (0.030761109458075628)  --> TIME: 2023-10-20 17:12:24 -- STEP: 39/50 -- GLOBAL_STEP: 119640 | > loss_disc: 2.962073802947998 (2.5517552724251376) | > loss_disc_real_0: 0.3289225995540619 (0.1591977807573783) | > loss_disc_real_1: 0.2778814136981964 (0.22295697396382308) | > loss_disc_real_2: 0.2519892156124115 (0.2284732976785073) | > loss_disc_real_3: 0.22544489800930023 (0.23015805075948054) | > loss_disc_real_4: 0.2905067801475525 (0.23629072724053493) | > loss_disc_real_5: 0.2941714823246002 (0.23567868143511125) | > loss_0: 2.962073802947998 (2.5517552724251376) | > grad_norm_0: tensor(549.6692, device='cuda:0') (tensor(686.4439, device='cuda:0')) | > loss_gen: 1.7851171493530273 (2.109526466100643) | > loss_kl: 0.4691048562526703 (0.7166776189055198) | > loss_feat: 0.782161295413971 (4.6970014948493395) | > loss_mel: 14.649360656738281 (17.799885477775177) | > loss_duration: 1.3333340883255005 (1.2859274851970182) | > loss_1: 19.019079208374023 (26.609018301352478) | > grad_norm_1: tensor(6793.6504, device='cuda:0') (tensor(20803.3359, device='cuda:0')) | > current_lr_0: 5.2785372144418854e-05 | > current_lr_1: 5.283818722071095e-05 | > step_time: 0.8247 (0.6383653848599165) | > loader_time: 0.0254 (0.02625163396199544)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.719853401184082 (2.719853401184082) | > loss_disc_real_0: 0.3141704201698303 (0.3141704201698303) | > loss_disc_real_1: 0.19582688808441162 (0.19582688808441162) | > loss_disc_real_2: 0.3766879141330719 (0.3766879141330719) | > loss_disc_real_3: 0.2715894281864166 (0.2715894281864166) | > loss_disc_real_4: 0.3050472140312195 (0.3050472140312195) | > loss_disc_real_5: 0.31288549304008484 (0.31288549304008484) | > loss_0: 2.719853401184082 (2.719853401184082) | > loss_gen: 2.5052685737609863 (2.5052685737609863) | > loss_kl: 6.06400203704834 (6.06400203704834) | > loss_feat: 2.9395244121551514 (2.9395244121551514) | > loss_mel: 21.521764755249023 (21.521764755249023) | > loss_duration: 3.2023494243621826 (3.2023494243621826) | > loss_1: 36.23291015625 (36.23291015625)  --> STEP: 1 | > loss_disc: 2.4911999702453613 (2.4911999702453613) | > loss_disc_real_0: 0.09679605066776276 (0.09679605066776276) | > loss_disc_real_1: 0.2742977738380432 (0.2742977738380432) | > loss_disc_real_2: 0.1775500774383545 (0.1775500774383545) | > loss_disc_real_3: 0.25914275646209717 (0.25914275646209717) | > loss_disc_real_4: 0.21589258313179016 (0.21589258313179016) | > loss_disc_real_5: 0.24494150280952454 (0.24494150280952454) | > loss_0: 2.4911999702453613 (2.4911999702453613) | > loss_gen: 1.9610638618469238 (1.9610638618469238) | > loss_kl: 5.709731101989746 (5.709731101989746) | > loss_feat: 2.4941301345825195 (2.4941301345825195) | > loss_mel: 19.262531280517578 (19.262531280517578) | > loss_duration: 3.4823248386383057 (3.4823248386383057) | > loss_1: 32.90978240966797 (32.90978240966797)  --> STEP: 2 | > loss_disc: 2.5225796699523926 (2.506889820098877) | > loss_disc_real_0: 0.2047882378101349 (0.15079214423894882) | > loss_disc_real_1: 0.22347910702228546 (0.24888844043016434) | > loss_disc_real_2: 0.3099205195903778 (0.24373529851436615) | > loss_disc_real_3: 0.29116061329841614 (0.27515168488025665) | > loss_disc_real_4: 0.2544492185115814 (0.2351709008216858) | > loss_disc_real_5: 0.15604817867279053 (0.20049484074115753) | > loss_0: 2.5225796699523926 (2.506889820098877) | > loss_gen: 2.297393798828125 (2.1292288303375244) | > loss_kl: 6.894644737243652 (6.302187919616699) | > loss_feat: 3.928321123123169 (3.2112256288528442) | > loss_mel: 26.089895248413086 (22.676213264465332) | > loss_duration: 3.5145320892333984 (3.498428463935852) | > loss_1: 42.72478485107422 (37.817283630371094)  --> STEP: 3 | > loss_disc: 2.2830278873443604 (2.4322691758473716) | > loss_disc_real_0: 0.14596009254455566 (0.14918146034081778) | > loss_disc_real_1: 0.23230616748332977 (0.24336101611455283) | > loss_disc_real_2: 0.20362558960914612 (0.23036539554595947) | > loss_disc_real_3: 0.22123821079730988 (0.2571805268526077) | > loss_disc_real_4: 0.17144864797592163 (0.21393014987309775) | > loss_disc_real_5: 0.14572659134864807 (0.18223875761032104) | > loss_0: 2.2830278873443604 (2.4322691758473716) | > loss_gen: 1.9650676250457764 (2.0745084285736084) | > loss_kl: 2.983370304107666 (5.1959153811136884) | > loss_feat: 2.739107847213745 (3.0538530349731445) | > loss_mel: 18.44966697692871 (21.267364501953125) | > loss_duration: 3.0500776767730713 (3.3489782015482583) | > loss_1: 29.18729019165039 (34.940619150797524) --> EVAL PERFORMANCE | > avg_loader_time: 0.006905476252237956 (-0.006080150604248046) | > avg_loss_disc: 2.4322691758473716 (-0.4833277861277261) | > avg_loss_disc_real_0: 0.14918146034081778 (-0.019815328220526368) | > avg_loss_disc_real_1: 0.24336101611455283 (-0.05045149226983389) | > avg_loss_disc_real_2: 0.23036539554595947 (-0.06613605221112567) | > avg_loss_disc_real_3: 0.2571805268526077 (+0.013926004370053618) | > avg_loss_disc_real_4: 0.21393014987309775 (-0.055345932642618806) | > avg_loss_disc_real_5: 0.18223875761032104 (-0.0891288121541341) | > avg_loss_0: 2.4322691758473716 (-0.4833277861277261) | > avg_loss_gen: 2.0745084285736084 (+0.13603226343790698) | > avg_loss_kl: 5.1959153811136884 (+0.04938689867655466) | > avg_loss_feat: 3.0538530349731445 (-3.639465967814128) | > avg_loss_mel: 21.267364501953125 (-0.7417354583740234) | > avg_loss_duration: 3.3489782015482583 (+0.07376869519551565) | > avg_loss_1: 34.940619150797524 (-4.122014363606773)  > EPOCH: 1333/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:12:46)   --> TIME: 2023-10-20 17:13:03 -- STEP: 19/50 -- GLOBAL_STEP: 119670 | > loss_disc: 1.6621520519256592 (2.4732755171625236) | > loss_disc_real_0: 0.044217273592948914 (0.15265588305498423) | > loss_disc_real_1: 0.17382200062274933 (0.22617038653085106) | > loss_disc_real_2: 0.13753069937229156 (0.2274967475157035) | > loss_disc_real_3: 0.22609488666057587 (0.22807367067588002) | > loss_disc_real_4: 0.1676701158285141 (0.23415590038425044) | > loss_disc_real_5: 0.18511615693569183 (0.21832157945946642) | > loss_0: 1.6621520519256592 (2.4732755171625236) | > grad_norm_0: tensor(485.2721, device='cuda:0') (tensor(677.2940, device='cuda:0')) | > loss_gen: 3.1973588466644287 (2.2045003175735474) | > loss_kl: 0.7002697587013245 (0.7707161730841586) | > loss_feat: 9.376778602600098 (4.885085687433419) | > loss_mel: 25.591073989868164 (18.274344507016632) | > loss_duration: 1.4025441408157349 (1.31576448992679) | > loss_1: 40.26802444458008 (27.45041116915251) | > grad_norm_1: tensor(52232.5664, device='cuda:0') (tensor(26005.4766, device='cuda:0')) | > current_lr_0: 5.273260986010223e-05 | > current_lr_1: 5.2785372144418854e-05 | > step_time: 0.6298 (0.5982305376153244) | > loader_time: 0.0064 (0.017159876070524518)  --> TIME: 2023-10-20 17:13:23 -- STEP: 49/50 -- GLOBAL_STEP: 119700 | > loss_disc: 2.129783868789673 (2.483198372685179) | > loss_disc_real_0: 0.06777030974626541 (0.15186923191103405) | > loss_disc_real_1: 0.15730927884578705 (0.21984549558588437) | > loss_disc_real_2: 0.2825484275817871 (0.2238258996940389) | > loss_disc_real_3: 0.24616402387619019 (0.23717381337619559) | > loss_disc_real_4: 0.20028842985630035 (0.22312462212023687) | > loss_disc_real_5: 0.17970997095108032 (0.2181783393310497) | > loss_0: 2.129783868789673 (2.483198372685179) | > grad_norm_0: tensor(359.5321, device='cuda:0') (tensor(706.7061, device='cuda:0')) | > loss_gen: 2.385810613632202 (2.194549144530783) | > loss_kl: 0.46126866340637207 (0.7747965959870086) | > loss_feat: 5.033796310424805 (5.041560218346362) | > loss_mel: 21.619247436523438 (18.716966098668628) | > loss_duration: 1.459911584854126 (1.2986604936268864) | > loss_1: 30.960033416748047 (28.02653236778415) | > grad_norm_1: tensor(3341.9663, device='cuda:0') (tensor(21579.1875, device='cuda:0')) | > current_lr_0: 5.273260986010223e-05 | > current_lr_1: 5.2785372144418854e-05 | > step_time: 0.8857 (0.612113295769205) | > loader_time: 0.5339 (0.029731181203102582)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.759592890739441 (1.759592890739441) | > loss_disc_real_0: 0.044660694897174835 (0.044660694897174835) | > loss_disc_real_1: 0.3024383783340454 (0.3024383783340454) | > loss_disc_real_2: 0.30115988850593567 (0.30115988850593567) | > loss_disc_real_3: 0.14275440573692322 (0.14275440573692322) | > loss_disc_real_4: 0.08577167987823486 (0.08577167987823486) | > loss_disc_real_5: 0.052478186786174774 (0.052478186786174774) | > loss_0: 1.759592890739441 (1.759592890739441) | > loss_gen: 2.8437533378601074 (2.8437533378601074) | > loss_kl: 6.523952484130859 (6.523952484130859) | > loss_feat: 10.714594841003418 (10.714594841003418) | > loss_mel: 22.100872039794922 (22.100872039794922) | > loss_duration: 3.165807008743286 (3.165807008743286) | > loss_1: 45.34897994995117 (45.34897994995117)  --> STEP: 1 | > loss_disc: 2.8959734439849854 (2.8959734439849854) | > loss_disc_real_0: 0.49846845865249634 (0.49846845865249634) | > loss_disc_real_1: 0.25864166021347046 (0.25864166021347046) | > loss_disc_real_2: 0.2084646075963974 (0.2084646075963974) | > loss_disc_real_3: 0.2420547902584076 (0.2420547902584076) | > loss_disc_real_4: 0.4047483205795288 (0.4047483205795288) | > loss_disc_real_5: 0.3759815990924835 (0.3759815990924835) | > loss_0: 2.8959734439849854 (2.8959734439849854) | > loss_gen: 2.741076946258545 (2.741076946258545) | > loss_kl: 5.875614166259766 (5.875614166259766) | > loss_feat: 5.820524215698242 (5.820524215698242) | > loss_mel: 21.833663940429688 (21.833663940429688) | > loss_duration: 3.49185848236084 (3.49185848236084) | > loss_1: 39.76273727416992 (39.76273727416992)  --> STEP: 2 | > loss_disc: 2.703523635864258 (2.7997485399246216) | > loss_disc_real_0: 0.39199137687683105 (0.4452299177646637) | > loss_disc_real_1: 0.2254050076007843 (0.24202333390712738) | > loss_disc_real_2: 0.23121404647827148 (0.21983932703733444) | > loss_disc_real_3: 0.3009202480316162 (0.2714875191450119) | > loss_disc_real_4: 0.2822146415710449 (0.34348148107528687) | > loss_disc_real_5: 0.27106258273124695 (0.32352209091186523) | > loss_0: 2.703523635864258 (2.7997485399246216) | > loss_gen: 2.4808871746063232 (2.610982060432434) | > loss_kl: 6.317872047424316 (6.096743106842041) | > loss_feat: 6.9639573097229 (6.392240762710571) | > loss_mel: 21.548398971557617 (21.691031455993652) | > loss_duration: 3.4217777252197266 (3.456818103790283) | > loss_1: 40.73289489746094 (40.24781608581543)  --> STEP: 3 | > loss_disc: 3.0124728679656982 (2.870656649271647) | > loss_disc_real_0: 0.15634462237358093 (0.3489348193009694) | > loss_disc_real_1: 0.2788884937763214 (0.2543117205301921) | > loss_disc_real_2: 0.25169840455055237 (0.23045901954174042) | > loss_disc_real_3: 0.25851136445999146 (0.26716213425000507) | > loss_disc_real_4: 0.30205366015434265 (0.3296722074349721) | > loss_disc_real_5: 0.2566000819206238 (0.3012147545814514) | > loss_0: 3.0124728679656982 (2.870656649271647) | > loss_gen: 1.515493631362915 (2.2458192507425943) | > loss_kl: 3.1462790966033936 (5.113255103429158) | > loss_feat: 0.037429921329021454 (4.273970482250054) | > loss_mel: 1.5961368083953857 (14.992733240127563) | > loss_duration: 3.1278631687164307 (3.3471664587656655) | > loss_1: 9.423202514648438 (29.972944895426433) --> EVAL PERFORMANCE | > avg_loader_time: 0.03380123774210612 (+0.02689576148986816) | > avg_loss_disc: 2.870656649271647 (+0.4383874734242754) | > avg_loss_disc_real_0: 0.3489348193009694 (+0.19975335896015164) | > avg_loss_disc_real_1: 0.2543117205301921 (+0.01095070441563925) | > avg_loss_disc_real_2: 0.23045901954174042 (+9.362399578094482e-05) | > avg_loss_disc_real_3: 0.26716213425000507 (+0.00998160739739734) | > avg_loss_disc_real_4: 0.3296722074349721 (+0.11574205756187436) | > avg_loss_disc_real_5: 0.3012147545814514 (+0.11897599697113037) | > avg_loss_0: 2.870656649271647 (+0.4383874734242754) | > avg_loss_gen: 2.2458192507425943 (+0.17131082216898585) | > avg_loss_kl: 5.113255103429158 (-0.08266027768453021) | > avg_loss_feat: 4.273970482250054 (+1.2201174472769099) | > avg_loss_mel: 14.992733240127563 (-6.2746312618255615) | > avg_loss_duration: 3.3471664587656655 (-0.0018117427825927734) | > avg_loss_1: 29.972944895426433 (-4.96767425537109)  > EPOCH: 1334/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:13:36)   --> TIME: 2023-10-20 17:13:56 -- STEP: 29/50 -- GLOBAL_STEP: 119730 | > loss_disc: 1.2723325490951538 (2.243121856245501) | > loss_disc_real_0: 0.07779988646507263 (0.1328059865868297) | > loss_disc_real_1: 0.10526435077190399 (0.21731426952214078) | > loss_disc_real_2: 0.03716310113668442 (0.19316689605856763) | > loss_disc_real_3: 0.1857420802116394 (0.21977240585818372) | > loss_disc_real_4: 0.06056048348546028 (0.2073256829753518) | > loss_disc_real_5: 0.07437857240438461 (0.19411890462426276) | > loss_0: 1.2723325490951538 (2.243121856245501) | > grad_norm_0: tensor(344.4497, device='cuda:0') (tensor(640.4257, device='cuda:0')) | > loss_gen: 3.1819913387298584 (2.515677830268597) | > loss_kl: 0.8300408124923706 (0.7585473214757854) | > loss_feat: 9.33915901184082 (7.319335886758977) | > loss_mel: 24.18747329711914 (21.333220679184485) | > loss_duration: 1.236033320426941 (1.3076262597380013) | > loss_1: 38.77470016479492 (33.23440831283044) | > grad_norm_1: tensor(24040.5488, device='cuda:0') (tensor(16823.3105, device='cuda:0')) | > current_lr_0: 5.267990031499219e-05 | > current_lr_1: 5.273260986010223e-05 | > step_time: 0.3991 (0.4878045114977605) | > loader_time: 0.005 (0.012110989669273637)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.4804489612579346 (2.4804489612579346) | > loss_disc_real_0: 0.15757453441619873 (0.15757453441619873) | > loss_disc_real_1: 0.19394013285636902 (0.19394013285636902) | > loss_disc_real_2: 0.18660621345043182 (0.18660621345043182) | > loss_disc_real_3: 0.13302868604660034 (0.13302868604660034) | > loss_disc_real_4: 0.31044813990592957 (0.31044813990592957) | > loss_disc_real_5: 0.3543180525302887 (0.3543180525302887) | > loss_0: 2.4804489612579346 (2.4804489612579346) | > loss_gen: 2.4808197021484375 (2.4808197021484375) | > loss_kl: 7.230007171630859 (7.230007171630859) | > loss_feat: 10.461703300476074 (10.461703300476074) | > loss_mel: 21.91167449951172 (21.91167449951172) | > loss_duration: 3.2211079597473145 (3.2211079597473145) | > loss_1: 45.30531311035156 (45.30531311035156)  --> STEP: 1 | > loss_disc: 2.0352630615234375 (2.0352630615234375) | > loss_disc_real_0: 0.21607202291488647 (0.21607202291488647) | > loss_disc_real_1: 0.16781650483608246 (0.16781650483608246) | > loss_disc_real_2: 0.12344177812337875 (0.12344177812337875) | > loss_disc_real_3: 0.10296366363763809 (0.10296366363763809) | > loss_disc_real_4: 0.1507577747106552 (0.1507577747106552) | > loss_disc_real_5: 0.18186984956264496 (0.18186984956264496) | > loss_0: 2.0352630615234375 (2.0352630615234375) | > loss_gen: 2.325899362564087 (2.325899362564087) | > loss_kl: 5.595761299133301 (5.595761299133301) | > loss_feat: 9.196242332458496 (9.196242332458496) | > loss_mel: 22.909008026123047 (22.909008026123047) | > loss_duration: 3.4960808753967285 (3.4960808753967285) | > loss_1: 43.52299499511719 (43.52299499511719)  --> STEP: 2 | > loss_disc: 2.850107431411743 (2.4426852464675903) | > loss_disc_real_0: 0.3242880403995514 (0.27018003165721893) | > loss_disc_real_1: 0.2584788203239441 (0.21314766258001328) | > loss_disc_real_2: 0.27879565954208374 (0.20111871883273125) | > loss_disc_real_3: 0.2460753470659256 (0.17451950535178185) | > loss_disc_real_4: 0.24560672044754028 (0.19818224757909775) | > loss_disc_real_5: 0.25810062885284424 (0.2199852392077446) | > loss_0: 2.850107431411743 (2.4426852464675903) | > loss_gen: 1.936048984527588 (2.1309741735458374) | > loss_kl: 6.484308242797852 (6.040034770965576) | > loss_feat: 0.5810858011245728 (4.888664066791534) | > loss_mel: 11.546613693237305 (17.227810859680176) | > loss_duration: 3.4259772300720215 (3.461029052734375) | > loss_1: 23.97403335571289 (33.74851417541504)  --> STEP: 3 | > loss_disc: 3.0071802139282227 (2.6308502356211343) | > loss_disc_real_0: 0.4455440640449524 (0.32863470911979675) | > loss_disc_real_1: 0.258672297000885 (0.22832254072030386) | > loss_disc_real_2: 0.27245259284973145 (0.22489667683839798) | > loss_disc_real_3: 0.2431068867444992 (0.19738196581602097) | > loss_disc_real_4: 0.24472258985042572 (0.21369569500287375) | > loss_disc_real_5: 0.25906628370285034 (0.2330122540394465) | > loss_0: 3.0071802139282227 (2.6308502356211343) | > loss_gen: 1.7995749711990356 (2.0205077727635703) | > loss_kl: 3.1031768321990967 (5.061082124710083) | > loss_feat: 0.1776915341615677 (3.3183398892482123) | > loss_mel: 2.889737844467163 (12.448453187942505) | > loss_duration: 3.1056888103485107 (3.3425823052724204) | > loss_1: 11.0758695602417 (26.190965970357258) --> EVAL PERFORMANCE | > avg_loader_time: 0.006211598714192708 (-0.02758963902791341) | > avg_loss_disc: 2.6308502356211343 (-0.2398064136505127) | > avg_loss_disc_real_0: 0.32863470911979675 (-0.02030011018117267) | > avg_loss_disc_real_1: 0.22832254072030386 (-0.025989179809888213) | > avg_loss_disc_real_2: 0.22489667683839798 (-0.005562342703342438) | > avg_loss_disc_real_3: 0.19738196581602097 (-0.0697801684339841) | > avg_loss_disc_real_4: 0.21369569500287375 (-0.11597651243209836) | > avg_loss_disc_real_5: 0.2330122540394465 (-0.06820250054200491) | > avg_loss_0: 2.6308502356211343 (-0.2398064136505127) | > avg_loss_gen: 2.0205077727635703 (-0.22531147797902396) | > avg_loss_kl: 5.061082124710083 (-0.052172978719075225) | > avg_loss_feat: 3.3183398892482123 (-0.955630593001842) | > avg_loss_mel: 12.448453187942505 (-2.5442800521850586) | > avg_loss_duration: 3.3425823052724204 (-0.004584153493245147) | > avg_loss_1: 26.190965970357258 (-3.7819789250691755)  > EPOCH: 1335/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:14:27)   --> TIME: 2023-10-20 17:14:39 -- STEP: 9/50 -- GLOBAL_STEP: 119760 | > loss_disc: 2.7033774852752686 (2.393498566415575) | > loss_disc_real_0: 0.2637837827205658 (0.17320415750145912) | > loss_disc_real_1: 0.35283777117729187 (0.21032360941171646) | > loss_disc_real_2: 0.4751187562942505 (0.23151619070106083) | > loss_disc_real_3: 0.3023461401462555 (0.21445300016138288) | > loss_disc_real_4: 0.4151028096675873 (0.22712334700756603) | > loss_disc_real_5: 0.43767547607421875 (0.24699697302033505) | > loss_0: 2.7033774852752686 (2.393498566415575) | > grad_norm_0: tensor(662.6622, device='cuda:0') (tensor(592.5682, device='cuda:0')) | > loss_gen: 3.3973910808563232 (2.5780904160605536) | > loss_kl: 0.7701882719993591 (0.8175977071126302) | > loss_feat: 4.615546703338623 (7.794618606567383) | > loss_mel: 20.28904914855957 (22.749195522732204) | > loss_duration: 1.2552874088287354 (1.292536523607042) | > loss_1: 30.32746124267578 (35.23203786214193) | > grad_norm_1: tensor(4068.5244, device='cuda:0') (tensor(17204.3613, device='cuda:0')) | > current_lr_0: 5.262724345637259e-05 | > current_lr_1: 5.267990031499219e-05 | > step_time: 0.835 (0.6229708989461263) | > loader_time: 0.02 (0.026893430285983615)  --> TIME: 2023-10-20 17:14:57 -- STEP: 39/50 -- GLOBAL_STEP: 119790 | > loss_disc: 2.9533751010894775 (2.4408954167977353) | > loss_disc_real_0: 0.2231118381023407 (0.13584689891491186) | > loss_disc_real_1: 0.29436829686164856 (0.2153371893442594) | > loss_disc_real_2: 0.26117369532585144 (0.2266245526381028) | > loss_disc_real_3: 0.27533531188964844 (0.22848520447046328) | > loss_disc_real_4: 0.2347579151391983 (0.24036866703476656) | > loss_disc_real_5: 0.2860538363456726 (0.2595639965043236) | > loss_0: 2.9533751010894775 (2.4408954167977353) | > grad_norm_0: tensor(559.7324, device='cuda:0') (tensor(537.9539, device='cuda:0')) | > loss_gen: 1.6299293041229248 (2.3362945043123684) | > loss_kl: 0.6476190090179443 (0.8364722591180068) | > loss_feat: 0.16620729863643646 (6.45446249575187) | > loss_mel: 3.649657964706421 (22.06047560007144) | > loss_duration: 1.4269030094146729 (1.2877891461054483) | > loss_1: 7.520316123962402 (32.97549370007637) | > grad_norm_1: tensor(22369.2402, device='cuda:0') (tensor(14357.2842, device='cuda:0')) | > current_lr_0: 5.262724345637259e-05 | > current_lr_1: 5.267990031499219e-05 | > step_time: 0.5139 (0.6009963108943059) | > loader_time: 0.0079 (0.02172424854376377)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0223171710968018 (3.0223171710968018) | > loss_disc_real_0: 0.47456231713294983 (0.47456231713294983) | > loss_disc_real_1: 0.2815922796726227 (0.2815922796726227) | > loss_disc_real_2: 0.4107055366039276 (0.4107055366039276) | > loss_disc_real_3: 0.2720157206058502 (0.2720157206058502) | > loss_disc_real_4: 0.3624955713748932 (0.3624955713748932) | > loss_disc_real_5: 0.22603674232959747 (0.22603674232959747) | > loss_0: 3.0223171710968018 (3.0223171710968018) | > loss_gen: 2.6840343475341797 (2.6840343475341797) | > loss_kl: 6.483060836791992 (6.483060836791992) | > loss_feat: 7.125007629394531 (7.125007629394531) | > loss_mel: 22.712207794189453 (22.712207794189453) | > loss_duration: 3.170153856277466 (3.170153856277466) | > loss_1: 42.17446517944336 (42.17446517944336)  --> STEP: 1 | > loss_disc: 3.1485700607299805 (3.1485700607299805) | > loss_disc_real_0: 0.5251220464706421 (0.5251220464706421) | > loss_disc_real_1: 0.22594426572322845 (0.22594426572322845) | > loss_disc_real_2: 0.3501385748386383 (0.3501385748386383) | > loss_disc_real_3: 0.24719484150409698 (0.24719484150409698) | > loss_disc_real_4: 0.36418628692626953 (0.36418628692626953) | > loss_disc_real_5: 0.26262226700782776 (0.26262226700782776) | > loss_0: 3.1485700607299805 (3.1485700607299805) | > loss_gen: 1.9898970127105713 (1.9898970127105713) | > loss_kl: 5.831118106842041 (5.831118106842041) | > loss_feat: 3.2031800746917725 (3.2031800746917725) | > loss_mel: 21.457921981811523 (21.457921981811523) | > loss_duration: 3.530012369155884 (3.530012369155884) | > loss_1: 36.01213073730469 (36.01213073730469)  --> STEP: 2 | > loss_disc: 2.9923129081726074 (3.070441484451294) | > loss_disc_real_0: 0.1706923246383667 (0.3479071855545044) | > loss_disc_real_1: 0.27480626106262207 (0.25037526339292526) | > loss_disc_real_2: 0.27038633823394775 (0.31026245653629303) | > loss_disc_real_3: 0.25833937525749207 (0.2527671083807945) | > loss_disc_real_4: 0.24901756644248962 (0.3066019266843796) | > loss_disc_real_5: 0.28532248735427856 (0.27397237718105316) | > loss_0: 2.9923129081726074 (3.070441484451294) | > loss_gen: 1.5292774438858032 (1.7595872282981873) | > loss_kl: 7.1208648681640625 (6.475991487503052) | > loss_feat: 0.05477379262447357 (1.628976933658123) | > loss_mel: 3.3092541694641113 (12.383588075637817) | > loss_duration: 3.4397358894348145 (3.484874129295349) | > loss_1: 15.453907012939453 (25.73301887512207)  --> STEP: 3 | > loss_disc: 2.908912181854248 (3.016598383585612) | > loss_disc_real_0: 0.432190477848053 (0.37600161631902057) | > loss_disc_real_1: 0.22025920450687408 (0.24033657709757486) | > loss_disc_real_2: 0.2606070041656494 (0.2937106390794118) | > loss_disc_real_3: 0.291800320148468 (0.26577817897001904) | > loss_disc_real_4: 0.22691625356674194 (0.28004003564516705) | > loss_disc_real_5: 0.2582201659679413 (0.26872164011001587) | > loss_0: 2.908912181854248 (3.016598383585612) | > loss_gen: 1.9684919118881226 (1.8292221228281658) | > loss_kl: 3.1774041652679443 (5.37646238009135) | > loss_feat: 1.364534854888916 (1.5408295740683873) | > loss_mel: 19.400972366333008 (14.722716172536215) | > loss_duration: 3.0729947090148926 (3.3475809892018638) | > loss_1: 28.984397888183594 (26.81681187947591) --> EVAL PERFORMANCE | > avg_loader_time: 0.015861908594767254 (+0.009650309880574547) | > avg_loss_disc: 3.016598383585612 (+0.38574814796447754) | > avg_loss_disc_real_0: 0.37600161631902057 (+0.04736690719922382) | > avg_loss_disc_real_1: 0.24033657709757486 (+0.012014036377270998) | > avg_loss_disc_real_2: 0.2937106390794118 (+0.06881396224101383) | > avg_loss_disc_real_3: 0.26577817897001904 (+0.06839621315399808) | > avg_loss_disc_real_4: 0.28004003564516705 (+0.0663443406422933) | > avg_loss_disc_real_5: 0.26872164011001587 (+0.035709386070569366) | > avg_loss_0: 3.016598383585612 (+0.38574814796447754) | > avg_loss_gen: 1.8292221228281658 (-0.19128564993540453) | > avg_loss_kl: 5.37646238009135 (+0.31538025538126657) | > avg_loss_feat: 1.5408295740683873 (-1.777510315179825) | > avg_loss_mel: 14.722716172536215 (+2.27426298459371) | > avg_loss_duration: 3.3475809892018638 (+0.004998683929443359) | > avg_loss_1: 26.81681187947591 (+0.6258459091186523)  > EPOCH: 1336/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:15:21)   --> TIME: 2023-10-20 17:15:37 -- STEP: 19/50 -- GLOBAL_STEP: 119820 | > loss_disc: 1.9547522068023682 (2.5773062329543266) | > loss_disc_real_0: 0.19381913542747498 (0.15135859629433407) | > loss_disc_real_1: 0.16980034112930298 (0.23489457133569216) | > loss_disc_real_2: 0.12459995597600937 (0.2487981464517744) | > loss_disc_real_3: 0.31084123253822327 (0.2319705419634518) | > loss_disc_real_4: 0.22804784774780273 (0.22213541010492727) | > loss_disc_real_5: 0.1989172101020813 (0.2608093342890864) | > loss_0: 1.9547522068023682 (2.5773062329543266) | > grad_norm_0: tensor(554.2076, device='cuda:0') (tensor(623.5233, device='cuda:0')) | > loss_gen: 3.2913315296173096 (2.1846395605488826) | > loss_kl: 1.178362488746643 (0.8768073602726585) | > loss_feat: 9.957430839538574 (4.83212917209848) | > loss_mel: 24.38562774658203 (16.344774619529122) | > loss_duration: 1.3833653926849365 (1.3385099737267745) | > loss_1: 40.19612121582031 (25.576861205853913) | > grad_norm_1: tensor(6032.2007, device='cuda:0') (tensor(28533.3184, device='cuda:0')) | > current_lr_0: 5.257463923158001e-05 | > current_lr_1: 5.262724345637259e-05 | > step_time: 0.5054 (0.4826608206096448) | > loader_time: 0.0035 (0.01588112429568642)  --> TIME: 2023-10-20 17:15:52 -- STEP: 49/50 -- GLOBAL_STEP: 119850 | > loss_disc: 2.0066492557525635 (2.527179812898441) | > loss_disc_real_0: 0.06642042845487595 (0.13646614369080992) | > loss_disc_real_1: 0.11761225014925003 (0.22911653044272443) | > loss_disc_real_2: 0.2977219820022583 (0.23415963328918632) | > loss_disc_real_3: 0.15216131508350372 (0.22753975266704754) | > loss_disc_real_4: 0.26401060819625854 (0.23061400682342295) | > loss_disc_real_5: 0.21280278265476227 (0.24575037547216125) | > loss_0: 2.0066492557525635 (2.527179812898441) | > grad_norm_0: tensor(584.2385, device='cuda:0') (tensor(669.7029, device='cuda:0')) | > loss_gen: 3.032771110534668 (2.1520014247115773) | > loss_kl: 0.3004497289657593 (0.8001296727024779) | > loss_feat: 7.98020601272583 (4.638564139414504) | > loss_mel: 21.18442153930664 (18.4637335356401) | > loss_duration: 1.3912111520767212 (1.30008750302451) | > loss_1: 33.889060974121094 (27.354516292104915) | > grad_norm_1: tensor(43298.2617, device='cuda:0') (tensor(19176.9160, device='cuda:0')) | > current_lr_0: 5.257463923158001e-05 | > current_lr_1: 5.262724345637259e-05 | > step_time: 0.6917 (0.4656119541246064) | > loader_time: 0.4482 (0.02045706340244838)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.055081844329834 (3.055081844329834) | > loss_disc_real_0: 0.4320496618747711 (0.4320496618747711) | > loss_disc_real_1: 0.1823173612356186 (0.1823173612356186) | > loss_disc_real_2: 0.38129091262817383 (0.38129091262817383) | > loss_disc_real_3: 0.3094581961631775 (0.3094581961631775) | > loss_disc_real_4: 0.29171156883239746 (0.29171156883239746) | > loss_disc_real_5: 0.27310997247695923 (0.27310997247695923) | > loss_0: 3.055081844329834 (3.055081844329834) | > loss_gen: 2.0556600093841553 (2.0556600093841553) | > loss_kl: 5.741098403930664 (5.741098403930664) | > loss_feat: 2.375770092010498 (2.375770092010498) | > loss_mel: 21.385915756225586 (21.385915756225586) | > loss_duration: 3.1657955646514893 (3.1657955646514893) | > loss_1: 34.724239349365234 (34.724239349365234)  --> STEP: 1 | > loss_disc: 2.6261494159698486 (2.6261494159698486) | > loss_disc_real_0: 0.36208659410476685 (0.36208659410476685) | > loss_disc_real_1: 0.25283682346343994 (0.25283682346343994) | > loss_disc_real_2: 0.24877481162548065 (0.24877481162548065) | > loss_disc_real_3: 0.21477478742599487 (0.21477478742599487) | > loss_disc_real_4: 0.15761341154575348 (0.15761341154575348) | > loss_disc_real_5: 0.16001103818416595 (0.16001103818416595) | > loss_0: 2.6261494159698486 (2.6261494159698486) | > loss_gen: 2.235332727432251 (2.235332727432251) | > loss_kl: 5.585710525512695 (5.585710525512695) | > loss_feat: 7.149951457977295 (7.149951457977295) | > loss_mel: 27.428003311157227 (27.428003311157227) | > loss_duration: 3.5396885871887207 (3.5396885871887207) | > loss_1: 45.93868637084961 (45.93868637084961)  --> STEP: 2 | > loss_disc: 2.8444631099700928 (2.7353062629699707) | > loss_disc_real_0: 0.2902188003063202 (0.3261526972055435) | > loss_disc_real_1: 0.3537909686565399 (0.30331389605998993) | > loss_disc_real_2: 0.2510150969028473 (0.24989495426416397) | > loss_disc_real_3: 0.5874924063682556 (0.40113359689712524) | > loss_disc_real_4: 0.19666504859924316 (0.17713923007249832) | > loss_disc_real_5: 0.19057239592075348 (0.17529171705245972) | > loss_0: 2.8444631099700928 (2.7353062629699707) | > loss_gen: 2.858151435852051 (2.546742081642151) | > loss_kl: 7.1379618644714355 (6.361836194992065) | > loss_feat: 7.9302144050598145 (7.540082931518555) | > loss_mel: 20.98543930053711 (24.206721305847168) | > loss_duration: 3.352447509765625 (3.446068048477173) | > loss_1: 42.26421356201172 (44.101449966430664)  --> STEP: 3 | > loss_disc: 2.2395942211151123 (2.570068915685018) | > loss_disc_real_0: 0.05130866914987564 (0.23453802118698755) | > loss_disc_real_1: 0.27366355061531067 (0.2934304475784302) | > loss_disc_real_2: 0.13498413562774658 (0.21159134805202484) | > loss_disc_real_3: 0.2248472422361374 (0.34237147867679596) | > loss_disc_real_4: 0.11164917796850204 (0.15530921270449957) | > loss_disc_real_5: 0.20096847414970398 (0.18385063608487448) | > loss_0: 2.2395942211151123 (2.570068915685018) | > loss_gen: 2.040530204772949 (2.378004789352417) | > loss_kl: 2.7832131385803223 (5.168961842854817) | > loss_feat: 5.303368091583252 (6.794511318206787) | > loss_mel: 21.13422966003418 (23.182557423909504) | > loss_duration: 3.046475887298584 (3.312870661417643) | > loss_1: 34.30781555175781 (40.83690516153971) --> EVAL PERFORMANCE | > avg_loader_time: 0.022706349690755207 (+0.006844441095987953) | > avg_loss_disc: 2.570068915685018 (-0.4465294679005938) | > avg_loss_disc_real_0: 0.23453802118698755 (-0.14146359513203302) | > avg_loss_disc_real_1: 0.2934304475784302 (+0.053093870480855315) | > avg_loss_disc_real_2: 0.21159134805202484 (-0.08211929102738696) | > avg_loss_disc_real_3: 0.34237147867679596 (+0.07659329970677692) | > avg_loss_disc_real_4: 0.15530921270449957 (-0.12473082294066748) | > avg_loss_disc_real_5: 0.18385063608487448 (-0.08487100402514139) | > avg_loss_0: 2.570068915685018 (-0.4465294679005938) | > avg_loss_gen: 2.378004789352417 (+0.5487826665242512) | > avg_loss_kl: 5.168961842854817 (-0.20750053723653217) | > avg_loss_feat: 6.794511318206787 (+5.2536817441384) | > avg_loss_mel: 23.182557423909504 (+8.45984125137329) | > avg_loss_duration: 3.312870661417643 (-0.034710327784220674) | > avg_loss_1: 40.83690516153971 (+14.020093282063801)  > EPOCH: 1337/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:16:07)   --> TIME: 2023-10-20 17:16:31 -- STEP: 29/50 -- GLOBAL_STEP: 119880 | > loss_disc: 2.993537187576294 (2.4554822855982286) | > loss_disc_real_0: 0.18306991457939148 (0.1645520068705082) | > loss_disc_real_1: 0.2825225591659546 (0.20717071298638295) | > loss_disc_real_2: 0.27627602219581604 (0.21988425101956416) | > loss_disc_real_3: 0.2738230228424072 (0.2303769227502675) | > loss_disc_real_4: 0.26911506056785583 (0.21975442895601535) | > loss_disc_real_5: 0.29293179512023926 (0.2132798674805411) | > loss_0: 2.993537187576294 (2.4554822855982286) | > grad_norm_0: tensor(1002.5876, device='cuda:0') (tensor(729.1054, device='cuda:0')) | > loss_gen: 1.601370096206665 (2.2218340347553127) | > loss_kl: 0.6085522174835205 (0.7945356127516977) | > loss_feat: 0.2404218465089798 (5.364293306038298) | > loss_mel: 9.520331382751465 (18.310264735386298) | > loss_duration: 1.2453709840774536 (1.3030618593610566) | > loss_1: 13.216046333312988 (27.993989615604796) | > grad_norm_1: tensor(19097.9824, device='cuda:0') (tensor(26432.7051, device='cuda:0')) | > current_lr_0: 5.252208758800362e-05 | > current_lr_1: 5.257463923158001e-05 | > step_time: 0.6659 (0.6286279579688763) | > loader_time: 0.0326 (0.023101017392914872)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2832345962524414 (2.2832345962524414) | > loss_disc_real_0: 0.14175187051296234 (0.14175187051296234) | > loss_disc_real_1: 0.3674020767211914 (0.3674020767211914) | > loss_disc_real_2: 0.2349032759666443 (0.2349032759666443) | > loss_disc_real_3: 0.23354394733905792 (0.23354394733905792) | > loss_disc_real_4: 0.1906275898218155 (0.1906275898218155) | > loss_disc_real_5: 0.18516826629638672 (0.18516826629638672) | > loss_0: 2.2832345962524414 (2.2832345962524414) | > loss_gen: 2.636768102645874 (2.636768102645874) | > loss_kl: 5.651554107666016 (5.651554107666016) | > loss_feat: 7.0111284255981445 (7.0111284255981445) | > loss_mel: 21.825485229492188 (21.825485229492188) | > loss_duration: 3.111354112625122 (3.111354112625122) | > loss_1: 40.236289978027344 (40.236289978027344)  --> STEP: 1 | > loss_disc: 2.8448877334594727 (2.8448877334594727) | > loss_disc_real_0: 0.09470243752002716 (0.09470243752002716) | > loss_disc_real_1: 0.22683455049991608 (0.22683455049991608) | > loss_disc_real_2: 0.19829243421554565 (0.19829243421554565) | > loss_disc_real_3: 0.19946609437465668 (0.19946609437465668) | > loss_disc_real_4: 0.28038063645362854 (0.28038063645362854) | > loss_disc_real_5: 0.25283896923065186 (0.25283896923065186) | > loss_0: 2.8448877334594727 (2.8448877334594727) | > loss_gen: 1.4430477619171143 (1.4430477619171143) | > loss_kl: 5.29766321182251 (5.29766321182251) | > loss_feat: 0.8450503349304199 (0.8450503349304199) | > loss_mel: 14.63478946685791 (14.63478946685791) | > loss_duration: 3.5371406078338623 (3.5371406078338623) | > loss_1: 25.757692337036133 (25.757692337036133)  --> STEP: 2 | > loss_disc: 2.784811496734619 (2.814849615097046) | > loss_disc_real_0: 0.2266981154680252 (0.16070027649402618) | > loss_disc_real_1: 0.27444490790367126 (0.25063972920179367) | > loss_disc_real_2: 0.3383674621582031 (0.2683299481868744) | > loss_disc_real_3: 0.19699861109256744 (0.19823235273361206) | > loss_disc_real_4: 0.2673984169960022 (0.27388952672481537) | > loss_disc_real_5: 0.18377022445201874 (0.2183045968413353) | > loss_0: 2.784811496734619 (2.814849615097046) | > loss_gen: 1.9357366561889648 (1.6893922090530396) | > loss_kl: 7.103482723236084 (6.200572967529297) | > loss_feat: 4.697625637054443 (2.7713379859924316) | > loss_mel: 11.986824035644531 (13.31080675125122) | > loss_duration: 3.3628745079040527 (3.4500075578689575) | > loss_1: 29.086545944213867 (27.422119140625)  --> STEP: 3 | > loss_disc: 2.218506336212158 (2.6160685221354165) | > loss_disc_real_0: 0.22419604659080505 (0.18186553319295248) | > loss_disc_real_1: 0.28412169218063354 (0.2618003835280736) | > loss_disc_real_2: 0.22505970299243927 (0.2539065331220627) | > loss_disc_real_3: 0.2757786810398102 (0.2240811288356781) | > loss_disc_real_4: 0.20792309939861298 (0.25190071761608124) | > loss_disc_real_5: 0.3739737570285797 (0.2701943169037501) | > loss_0: 2.218506336212158 (2.6160685221354165) | > loss_gen: 3.853260040283203 (2.4106814861297607) | > loss_kl: 2.820899724960327 (5.074015220006307) | > loss_feat: 7.88628625869751 (4.476320743560791) | > loss_mel: 21.85169219970703 (16.157768567403156) | > loss_duration: 3.1384310722351074 (3.346148729324341) | > loss_1: 39.550567626953125 (31.464935302734375) --> EVAL PERFORMANCE | > avg_loader_time: 0.008225043614705404 (-0.014481306076049803) | > avg_loss_disc: 2.6160685221354165 (+0.04599960645039847) | > avg_loss_disc_real_0: 0.18186553319295248 (-0.05267248799403507) | > avg_loss_disc_real_1: 0.2618003835280736 (-0.031630064050356566) | > avg_loss_disc_real_2: 0.2539065331220627 (+0.04231518507003784) | > avg_loss_disc_real_3: 0.2240811288356781 (-0.11829034984111786) | > avg_loss_disc_real_4: 0.25190071761608124 (+0.09659150491158167) | > avg_loss_disc_real_5: 0.2701943169037501 (+0.08634368081887564) | > avg_loss_0: 2.6160685221354165 (+0.04599960645039847) | > avg_loss_gen: 2.4106814861297607 (+0.03267669677734375) | > avg_loss_kl: 5.074015220006307 (-0.09494662284851074) | > avg_loss_feat: 4.476320743560791 (-2.318190574645996) | > avg_loss_mel: 16.157768567403156 (-7.024788856506348) | > avg_loss_duration: 3.346148729324341 (+0.03327806790669774) | > avg_loss_1: 31.464935302734375 (-9.371969858805336)  > EPOCH: 1338/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:17:02)   --> TIME: 2023-10-20 17:17:12 -- STEP: 9/50 -- GLOBAL_STEP: 119910 | > loss_disc: 2.918257236480713 (2.30527839395735) | > loss_disc_real_0: 0.4028834104537964 (0.1384350988599989) | > loss_disc_real_1: 0.29556047916412354 (0.20280373675955665) | > loss_disc_real_2: 0.33403345942497253 (0.24224679751528633) | > loss_disc_real_3: 0.2745940685272217 (0.20165053837829167) | > loss_disc_real_4: 0.3289147615432739 (0.22185316681861877) | > loss_disc_real_5: 0.3024548292160034 (0.21453210628694958) | > loss_0: 2.918257236480713 (2.30527839395735) | > grad_norm_0: tensor(768.0823, device='cuda:0') (tensor(430.9318, device='cuda:0')) | > loss_gen: 2.248962879180908 (2.4356836875279746) | > loss_kl: 0.5796252489089966 (0.8327659931447771) | > loss_feat: 2.172302007675171 (5.9174730446603565) | > loss_mel: 20.923643112182617 (20.639386494954426) | > loss_duration: 1.2902305126190186 (1.3276342286003961) | > loss_1: 27.214763641357422 (31.152943293253582) | > grad_norm_1: tensor(4157.7974, device='cuda:0') (tensor(16027.1230, device='cuda:0')) | > current_lr_0: 5.246958847308522e-05 | > current_lr_1: 5.252208758800362e-05 | > step_time: 1.6891 (0.6531730228000217) | > loader_time: 0.0087 (0.013260126113891602)  --> TIME: 2023-10-20 17:17:32 -- STEP: 39/50 -- GLOBAL_STEP: 119940 | > loss_disc: 1.4167046546936035 (2.3337669097460227) | > loss_disc_real_0: 0.017022188752889633 (0.13580568779546479) | > loss_disc_real_1: 0.11240503191947937 (0.21748511283061442) | > loss_disc_real_2: 0.08340244740247726 (0.22897547005842894) | > loss_disc_real_3: 0.15405866503715515 (0.21650423931005675) | > loss_disc_real_4: 0.06472911685705185 (0.22001751464528915) | > loss_disc_real_5: 0.060596611350774765 (0.2222390487216986) | > loss_0: 1.4167046546936035 (2.3337669097460227) | > grad_norm_0: tensor(621.5667, device='cuda:0') (tensor(508.2737, device='cuda:0')) | > loss_gen: 2.7776167392730713 (2.404734819363325) | > loss_kl: 0.8688111901283264 (0.8204519406725199) | > loss_feat: 11.28835391998291 (6.158968380628488) | > loss_mel: 26.50457000732422 (21.23570335828341) | > loss_duration: 1.3337446451187134 (1.2980130024445362) | > loss_1: 42.77309799194336 (31.917871695298416) | > grad_norm_1: tensor(46683.5664, device='cuda:0') (tensor(23702.2832, device='cuda:0')) | > current_lr_0: 5.246958847308522e-05 | > current_lr_1: 5.252208758800362e-05 | > step_time: 0.7418 (0.6490410963694254) | > loader_time: 0.0246 (0.018482098212608926)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.678586959838867 (2.678586959838867) | > loss_disc_real_0: 0.2265024036169052 (0.2265024036169052) | > loss_disc_real_1: 0.2758776843547821 (0.2758776843547821) | > loss_disc_real_2: 0.22417260706424713 (0.22417260706424713) | > loss_disc_real_3: 0.22311140596866608 (0.22311140596866608) | > loss_disc_real_4: 0.24426314234733582 (0.24426314234733582) | > loss_disc_real_5: 0.39542487263679504 (0.39542487263679504) | > loss_0: 2.678586959838867 (2.678586959838867) | > loss_gen: 2.2505874633789062 (2.2505874633789062) | > loss_kl: 6.080356597900391 (6.080356597900391) | > loss_feat: 5.4570512771606445 (5.4570512771606445) | > loss_mel: 22.23350715637207 (22.23350715637207) | > loss_duration: 3.179091453552246 (3.179091453552246) | > loss_1: 39.20059585571289 (39.20059585571289)  --> STEP: 1 | > loss_disc: 3.7284936904907227 (3.7284936904907227) | > loss_disc_real_0: 0.33694934844970703 (0.33694934844970703) | > loss_disc_real_1: 0.3454826772212982 (0.3454826772212982) | > loss_disc_real_2: 0.2918701469898224 (0.2918701469898224) | > loss_disc_real_3: 0.27991512417793274 (0.27991512417793274) | > loss_disc_real_4: 0.4350624978542328 (0.4350624978542328) | > loss_disc_real_5: 0.15989786386489868 (0.15989786386489868) | > loss_0: 3.7284936904907227 (3.7284936904907227) | > loss_gen: 1.4721673727035522 (1.4721673727035522) | > loss_kl: 6.060595512390137 (6.060595512390137) | > loss_feat: 8.577448844909668 (8.577448844909668) | > loss_mel: 22.90006446838379 (22.90006446838379) | > loss_duration: 3.443554162979126 (3.443554162979126) | > loss_1: 42.45383071899414 (42.45383071899414)  --> STEP: 2 | > loss_disc: 2.7645633220672607 (3.2465285062789917) | > loss_disc_real_0: 0.6779168844223022 (0.5074331164360046) | > loss_disc_real_1: 0.31434452533721924 (0.32991360127925873) | > loss_disc_real_2: 0.24018165469169617 (0.2660259008407593) | > loss_disc_real_3: 0.17722773551940918 (0.22857142984867096) | > loss_disc_real_4: 0.3560633361339569 (0.39556291699409485) | > loss_disc_real_5: 0.2620966136455536 (0.21099723875522614) | > loss_0: 2.7645633220672607 (3.2465285062789917) | > loss_gen: 4.206144332885742 (2.839155852794647) | > loss_kl: 7.01531457901001 (6.537955045700073) | > loss_feat: 11.514239311218262 (10.045844078063965) | > loss_mel: 24.667034149169922 (23.783549308776855) | > loss_duration: 3.4793269634246826 (3.4614405632019043) | > loss_1: 50.88206100463867 (46.667945861816406)  --> STEP: 3 | > loss_disc: 2.946770191192627 (3.14660906791687) | > loss_disc_real_0: 0.1694081425666809 (0.39475812514623004) | > loss_disc_real_1: 0.22013607621192932 (0.29332109292348224) | > loss_disc_real_2: 0.23471222817897797 (0.25558800995349884) | > loss_disc_real_3: 0.29172906279563904 (0.249623974164327) | > loss_disc_real_4: 0.27727895975112915 (0.35613493124643963) | > loss_disc_real_5: 0.24468375742435455 (0.22222607831160227) | > loss_0: 2.946770191192627 (3.14660906791687) | > loss_gen: 1.6161681413650513 (2.4314932823181152) | > loss_kl: 3.4975485801696777 (5.524486223856608) | > loss_feat: 2.4287383556365967 (7.506808837254842) | > loss_mel: 18.53328514099121 (22.03346125284831) | > loss_duration: 3.1387126445770264 (3.353864590326945) | > loss_1: 29.214452743530273 (40.850114822387695) --> EVAL PERFORMANCE | > avg_loader_time: 0.014165560404459635 (+0.005940516789754231) | > avg_loss_disc: 3.14660906791687 (+0.5305405457814536) | > avg_loss_disc_real_0: 0.39475812514623004 (+0.21289259195327756) | > avg_loss_disc_real_1: 0.29332109292348224 (+0.03152070939540863) | > avg_loss_disc_real_2: 0.25558800995349884 (+0.0016814768314361572) | > avg_loss_disc_real_3: 0.249623974164327 (+0.025542845328648894) | > avg_loss_disc_real_4: 0.35613493124643963 (+0.1042342136303584) | > avg_loss_disc_real_5: 0.22222607831160227 (-0.047968238592147855) | > avg_loss_0: 3.14660906791687 (+0.5305405457814536) | > avg_loss_gen: 2.4314932823181152 (+0.020811796188354492) | > avg_loss_kl: 5.524486223856608 (+0.4504710038503017) | > avg_loss_feat: 7.506808837254842 (+3.030488093694051) | > avg_loss_mel: 22.03346125284831 (+5.875692685445152) | > avg_loss_duration: 3.353864590326945 (+0.007715861002604019) | > avg_loss_1: 40.850114822387695 (+9.38517951965332)  > EPOCH: 1339/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:17:48)   --> TIME: 2023-10-20 17:18:04 -- STEP: 19/50 -- GLOBAL_STEP: 119970 | > loss_disc: 2.9881038665771484 (2.5422104032416093) | > loss_disc_real_0: 0.24920861423015594 (0.1641970567013088) | > loss_disc_real_1: 0.2925470173358917 (0.24136285679905037) | > loss_disc_real_2: 0.28442510962486267 (0.22517408391362742) | > loss_disc_real_3: 0.3031732141971588 (0.2441728391537541) | > loss_disc_real_4: 0.29280394315719604 (0.23251330656440636) | > loss_disc_real_5: 0.2911723554134369 (0.22042136727587172) | > loss_0: 2.9881038665771484 (2.5422104032416093) | > grad_norm_0: tensor(1931.7698, device='cuda:0') (tensor(795.9341, device='cuda:0')) | > loss_gen: 1.9438685178756714 (2.195082187652588) | > loss_kl: 0.9920028448104858 (0.827436796928707) | > loss_feat: 1.4377180337905884 (5.963112865623675) | > loss_mel: 19.686601638793945 (18.48821901020251) | > loss_duration: 1.3748363256454468 (1.3185230493545532) | > loss_1: 25.435026168823242 (28.79237393329018) | > grad_norm_1: tensor(3208.0171, device='cuda:0') (tensor(19651.9121, device='cuda:0')) | > current_lr_0: 5.241714183431911e-05 | > current_lr_1: 5.246958847308522e-05 | > step_time: 0.3708 (0.5518217337758917) | > loader_time: 0.0025 (0.0168511616556268)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.539945602416992 (2.539945602416992) | > loss_disc_real_0: 0.18456879258155823 (0.18456879258155823) | > loss_disc_real_1: 0.27327197790145874 (0.27327197790145874) | > loss_disc_real_2: 0.3584049940109253 (0.3584049940109253) | > loss_disc_real_3: 0.3883899748325348 (0.3883899748325348) | > loss_disc_real_4: 0.3095589578151703 (0.3095589578151703) | > loss_disc_real_5: 0.1709691286087036 (0.1709691286087036) | > loss_0: 2.539945602416992 (2.539945602416992) | > loss_gen: 2.9559969902038574 (2.9559969902038574) | > loss_kl: 6.103448390960693 (6.103448390960693) | > loss_feat: 7.3491973876953125 (7.3491973876953125) | > loss_mel: 22.35321044921875 (22.35321044921875) | > loss_duration: 3.244028329849243 (3.244028329849243) | > loss_1: 42.005882263183594 (42.005882263183594)  --> STEP: 1 | > loss_disc: 2.9680898189544678 (2.9680898189544678) | > loss_disc_real_0: 0.31285154819488525 (0.31285154819488525) | > loss_disc_real_1: 0.260448694229126 (0.260448694229126) | > loss_disc_real_2: 0.3030877411365509 (0.3030877411365509) | > loss_disc_real_3: 0.31248730421066284 (0.31248730421066284) | > loss_disc_real_4: 0.28442803025245667 (0.28442803025245667) | > loss_disc_real_5: 0.346508264541626 (0.346508264541626) | > loss_0: 2.9680898189544678 (2.9680898189544678) | > loss_gen: 2.130303144454956 (2.130303144454956) | > loss_kl: 6.318461894989014 (6.318461894989014) | > loss_feat: 3.29659366607666 (3.29659366607666) | > loss_mel: 21.905593872070312 (21.905593872070312) | > loss_duration: 3.589937210083008 (3.589937210083008) | > loss_1: 37.24089050292969 (37.24089050292969)  --> STEP: 2 | > loss_disc: 2.0562331676483154 (2.5121614933013916) | > loss_disc_real_0: 0.1530676931142807 (0.23295962065458298) | > loss_disc_real_1: 0.10315357893705368 (0.18180113658308983) | > loss_disc_real_2: 0.07076815515756607 (0.1869279481470585) | > loss_disc_real_3: 0.05393431708216667 (0.18321081064641476) | > loss_disc_real_4: 0.13205720484256744 (0.20824261754751205) | > loss_disc_real_5: 0.16470590233802795 (0.25560708343982697) | > loss_0: 2.0562331676483154 (2.5121614933013916) | > loss_gen: 1.9223437309265137 (2.026323437690735) | > loss_kl: 6.310978889465332 (6.314720392227173) | > loss_feat: 9.1310453414917 (6.21381950378418) | > loss_mel: 21.918664932250977 (21.912129402160645) | > loss_duration: 3.371772289276123 (3.4808547496795654) | > loss_1: 42.65480422973633 (39.94784736633301)  --> STEP: 3 | > loss_disc: 3.101954460144043 (2.708759148915609) | > loss_disc_real_0: 0.5249119400978088 (0.3302770604689916) | > loss_disc_real_1: 0.31223469972610474 (0.2252789909640948) | > loss_disc_real_2: 0.28281885385513306 (0.21889158338308334) | > loss_disc_real_3: 0.3372632563114166 (0.23456162586808205) | > loss_disc_real_4: 0.26695263385772705 (0.2278126229842504) | > loss_disc_real_5: 0.32565224170684814 (0.27895546952883404) | > loss_0: 3.101954460144043 (2.708759148915609) | > loss_gen: 2.327817440032959 (2.126821438471476) | > loss_kl: 3.23850679397583 (5.289315859476726) | > loss_feat: 2.156677007675171 (4.861438671747844) | > loss_mel: 18.64073371887207 (20.821664174397785) | > loss_duration: 3.2111704349517822 (3.3909599781036377) | > loss_1: 29.574905395507812 (36.49020004272461)  --> TIME: 2023-10-20 17:18:23 -- STEP: 49/50 -- GLOBAL_STEP: 120000 | > loss_disc: 2.2266793251037598 (2.549308396115595) | > loss_disc_real_0: 0.19608402252197266 (0.15990308447912027) | > loss_disc_real_1: 0.34915289282798767 (0.23297192825346577) | > loss_disc_real_2: 0.209990456700325 (0.21849925702019612) | > loss_disc_real_3: 0.3156907558441162 (0.23913221312116603) | > loss_disc_real_4: 0.24378083646297455 (0.2292017344461412) | > loss_disc_real_5: 0.28474411368370056 (0.23428523061530931) | > loss_0: 2.2266793251037598 (2.549308396115595) | > grad_norm_0: tensor(976.4042, device='cuda:0') (tensor(714.2484, device='cuda:0')) | > loss_gen: 3.1738016605377197 (2.163364502848411) | > loss_kl: 0.8189134001731873 (0.7745488474563677) | > loss_feat: 5.782740116119385 (5.0177168057737305) | > loss_mel: 23.127925872802734 (18.066775132198728) | > loss_duration: 1.4132905006408691 (1.2917180584401504) | > loss_1: 34.316673278808594 (27.314123465090383) | > grad_norm_1: tensor(4583.1587, device='cuda:0') (tensor(16811.8711, device='cuda:0')) | > current_lr_0: 5.241714183431911e-05 | > current_lr_1: 5.246958847308522e-05 | > step_time: 0.8252 (0.48428107767688994) | > loader_time: 6.2153 (0.13848483319185217) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_120000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7315421104431152 (2.7144548892974854) | > loss_disc_real_0: 0.09300583600997925 (0.2709592543542385) | > loss_disc_real_1: 0.2386508733034134 (0.22862196154892445) | > loss_disc_real_2: 0.20997761189937592 (0.2166630905121565) | > loss_disc_real_3: 0.24562294781208038 (0.23732695635408163) | > loss_disc_real_4: 0.26541978120803833 (0.23721441254019737) | > loss_disc_real_5: 0.2771953046321869 (0.27851542830467224) | > loss_0: 2.7315421104431152 (2.7144548892974854) | > loss_gen: 1.6684319972991943 (2.0122240781784058) | > loss_kl: 6.384263515472412 (5.563052773475647) | > loss_feat: 1.2602262496948242 (3.9611355662345886) | > loss_mel: 17.209964752197266 (19.918739318847656) | > loss_duration: 3.185519218444824 (3.3395997881889343) | > loss_1: 29.708404541015625 (34.79475116729736)  --> STEP: 1 | > loss_disc: 3.195132255554199 (2.810590362548828) | > loss_disc_real_0: 0.5057142376899719 (0.3179102510213852) | > loss_disc_real_1: 0.2898319959640503 (0.24086396843194963) | > loss_disc_real_2: 0.21630291640758514 (0.2165910556912422) | > loss_disc_real_3: 0.29977619647979736 (0.24981680437922477) | > loss_disc_real_4: 0.3840692341327667 (0.26658537685871125) | > loss_disc_real_5: 0.2877242863178253 (0.28035719990730285) | > loss_0: 3.195132255554199 (2.810590362548828) | > loss_gen: 2.1544692516326904 (2.040673112869263) | > loss_kl: 6.152766227722168 (5.680995464324951) | > loss_feat: 2.77980637550354 (3.724869728088379) | > loss_mel: 19.846843719482422 (19.904360198974608) | > loss_duration: 3.546096086502075 (3.3808990478515626) | > loss_1: 34.47998046875 (34.73179702758789)  --> STEP: 2 | > loss_disc: 2.830951690673828 (2.813983917236328) | > loss_disc_real_0: 0.13079625368118286 (0.28672458479801816) | > loss_disc_real_1: 0.25164005160331726 (0.24265998229384422) | > loss_disc_real_2: 0.1812507063150406 (0.2107009974618753) | > loss_disc_real_3: 0.3436579406261444 (0.2654569937537114) | > loss_disc_real_4: 0.15794330835342407 (0.2484783654411634) | > loss_disc_real_5: 0.3258669972419739 (0.28794216612974805) | > loss_0: 2.830951690673828 (2.813983917236328) | > loss_gen: 2.0481061935424805 (2.0419119596481323) | > loss_kl: 6.400730133056641 (5.800951242446899) | > loss_feat: 10.882736206054688 (4.917847474416097) | > loss_mel: 24.185319900512695 (20.61785348256429) | > loss_duration: 3.3907971382141113 (3.382548729578654) | > loss_1: 46.907691955566406 (36.76111284891764)  --> STEP: 3 | > loss_disc: 3.13008713722229 (2.8591415200914656) | > loss_disc_real_0: 0.5618288516998291 (0.3260251943554197) | > loss_disc_real_1: 0.37664511799812317 (0.26180071596588406) | > loss_disc_real_2: 0.24372941255569458 (0.21541934247527803) | > loss_disc_real_3: 0.3091232478618622 (0.2716950300548758) | > loss_disc_real_4: 0.29234087467193604 (0.25474443818841663) | > loss_disc_real_5: 0.29055070877075195 (0.28831481507846285) | > loss_0: 3.13008713722229 (2.8591415200914656) | > loss_gen: 2.177676200866699 (2.0613068512507846) | > loss_kl: 2.9519293308258057 (5.393948112215314) | > loss_feat: 1.4871039390563965 (4.427741255078997) | > loss_mel: 20.148962020874023 (20.55086898803711) | > loss_duration: 3.128976583480835 (3.3463241372789656) | > loss_1: 29.8946475982666 (35.78018924168178) --> EVAL PERFORMANCE | > avg_loader_time: 0.37467503547668457 (+0.3605094750722249) | > avg_loss_disc: 2.8591415200914656 (-0.2874675478254045) | > avg_loss_disc_real_0: 0.3260251943554197 (-0.06873293079081033) | > avg_loss_disc_real_1: 0.26180071596588406 (-0.031520376957598184) | > avg_loss_disc_real_2: 0.21541934247527803 (-0.040168667478220815) | > avg_loss_disc_real_3: 0.2716950300548758 (+0.02207105589054878) | > avg_loss_disc_real_4: 0.25474443818841663 (-0.101390493058023) | > avg_loss_disc_real_5: 0.28831481507846285 (+0.06608873676686058) | > avg_loss_0: 2.8591415200914656 (-0.2874675478254045) | > avg_loss_gen: 2.0613068512507846 (-0.3701864310673306) | > avg_loss_kl: 5.393948112215314 (-0.13053811164129403) | > avg_loss_feat: 4.427741255078997 (-3.0790675821758446) | > avg_loss_mel: 20.55086898803711 (-1.482592264811199) | > avg_loss_duration: 3.3463241372789656 (-0.007540453047979234) | > avg_loss_1: 35.78018924168178 (-5.069925580705913)  > EPOCH: 1340/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:18:52)   --> TIME: 2023-10-20 17:19:30 -- STEP: 29/50 -- GLOBAL_STEP: 120030 | > loss_disc: 2.194256544113159 (2.6214113276580284) | > loss_disc_real_0: 0.08798383921384811 (0.17253482874868245) | > loss_disc_real_1: 0.22814488410949707 (0.2280393423962182) | > loss_disc_real_2: 0.20337364077568054 (0.22689226154109526) | > loss_disc_real_3: 0.21989811956882477 (0.25599255088459827) | > loss_disc_real_4: 0.18949678540229797 (0.2431077534525559) | > loss_disc_real_5: 0.1409098505973816 (0.24173107858875703) | > loss_0: 2.194256544113159 (2.6214113276580284) | > grad_norm_0: tensor(408.6397, device='cuda:0') (tensor(644.1927, device='cuda:0')) | > loss_gen: 2.202509880065918 (2.1007531593585838) | > loss_kl: 0.7626425623893738 (0.7941790557113187) | > loss_feat: 4.341983795166016 (4.818872327177689) | > loss_mel: 17.581253051757812 (18.960426178471796) | > loss_duration: 1.2627283334732056 (1.3062927352971043) | > loss_1: 26.1511173248291 (27.980523668486498) | > grad_norm_1: tensor(3510.0491, device='cuda:0') (tensor(23665.6055, device='cuda:0')) | > current_lr_0: 5.2364747619252105e-05 | > current_lr_1: 5.241714183431911e-05 | > step_time: 0.9137 (0.6292712441806135) | > loader_time: 0.0378 (0.024928849318931842)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.827117443084717 (2.827117443084717) | > loss_disc_real_0: 0.150600403547287 (0.150600403547287) | > loss_disc_real_1: 0.25605958700180054 (0.25605958700180054) | > loss_disc_real_2: 0.3683294653892517 (0.3683294653892517) | > loss_disc_real_3: 0.3151482045650482 (0.3151482045650482) | > loss_disc_real_4: 0.3401236832141876 (0.3401236832141876) | > loss_disc_real_5: 0.3099283277988434 (0.3099283277988434) | > loss_0: 2.827117443084717 (2.827117443084717) | > loss_gen: 2.2487082481384277 (2.2487082481384277) | > loss_kl: 6.149040222167969 (6.149040222167969) | > loss_feat: 4.234766483306885 (4.234766483306885) | > loss_mel: 22.91901397705078 (22.91901397705078) | > loss_duration: 3.1031978130340576 (3.1031978130340576) | > loss_1: 38.65472412109375 (38.65472412109375)  --> STEP: 1 | > loss_disc: 2.6599068641662598 (2.6599068641662598) | > loss_disc_real_0: 0.294389545917511 (0.294389545917511) | > loss_disc_real_1: 0.30266913771629333 (0.30266913771629333) | > loss_disc_real_2: 0.24223017692565918 (0.24223017692565918) | > loss_disc_real_3: 0.2348085343837738 (0.2348085343837738) | > loss_disc_real_4: 0.2703483998775482 (0.2703483998775482) | > loss_disc_real_5: 0.2536385953426361 (0.2536385953426361) | > loss_0: 2.6599068641662598 (2.6599068641662598) | > loss_gen: 2.263380289077759 (2.263380289077759) | > loss_kl: 5.708507061004639 (5.708507061004639) | > loss_feat: 7.714089393615723 (7.714089393615723) | > loss_mel: 21.89471435546875 (21.89471435546875) | > loss_duration: 3.5942060947418213 (3.5942060947418213) | > loss_1: 41.17490005493164 (41.17490005493164)  --> STEP: 2 | > loss_disc: 3.096743583679199 (2.8783252239227295) | > loss_disc_real_0: 0.06058671697974205 (0.17748813144862652) | > loss_disc_real_1: 0.17554931342601776 (0.23910922557115555) | > loss_disc_real_2: 0.19296123087406158 (0.21759570389986038) | > loss_disc_real_3: 0.2918383479118347 (0.26332344114780426) | > loss_disc_real_4: 0.28380367159843445 (0.27707603573799133) | > loss_disc_real_5: 0.26874810457229614 (0.2611933499574661) | > loss_0: 3.096743583679199 (2.8783252239227295) | > loss_gen: 1.55240797996521 (1.9078941345214844) | > loss_kl: 6.984275817871094 (6.346391439437866) | > loss_feat: 8.555695533752441 (8.134892463684082) | > loss_mel: 21.346664428710938 (21.620689392089844) | > loss_duration: 3.4765963554382324 (3.535401225090027) | > loss_1: 41.9156379699707 (41.54526901245117)  --> STEP: 3 | > loss_disc: 2.9239449501037598 (2.8935317993164062) | > loss_disc_real_0: 0.08286495506763458 (0.14594707265496254) | > loss_disc_real_1: 0.26880842447280884 (0.24900895853837332) | > loss_disc_real_2: 0.3315858840942383 (0.2555924306313197) | > loss_disc_real_3: 0.24682563543319702 (0.2578241725762685) | > loss_disc_real_4: 0.265465646982193 (0.2732059061527252) | > loss_disc_real_5: 0.2665797173976898 (0.262988805770874) | > loss_0: 2.9239449501037598 (2.8935317993164062) | > loss_gen: 1.607611894607544 (1.807800054550171) | > loss_kl: 3.026482105255127 (5.239754994710286) | > loss_feat: 1.1259186267852783 (5.7985678513844805) | > loss_mel: 16.321571350097656 (19.85431671142578) | > loss_duration: 3.1061205863952637 (3.392307678858439) | > loss_1: 25.187705993652344 (36.0927480061849) --> EVAL PERFORMANCE | > avg_loader_time: 0.016373078028361004 (-0.35830195744832355) | > avg_loss_disc: 2.8935317993164062 (+0.034390279224940645) | > avg_loss_disc_real_0: 0.14594707265496254 (-0.18007812170045717) | > avg_loss_disc_real_1: 0.24900895853837332 (-0.012791757427510736) | > avg_loss_disc_real_2: 0.2555924306313197 (+0.040173088156041675) | > avg_loss_disc_real_3: 0.2578241725762685 (-0.01387085747860728) | > avg_loss_disc_real_4: 0.2732059061527252 (+0.018461467964308587) | > avg_loss_disc_real_5: 0.262988805770874 (-0.025326009307588826) | > avg_loss_0: 2.8935317993164062 (+0.034390279224940645) | > avg_loss_gen: 1.807800054550171 (-0.2535067967006137) | > avg_loss_kl: 5.239754994710286 (-0.15419311750502818) | > avg_loss_feat: 5.7985678513844805 (+1.3708265963054833) | > avg_loss_mel: 19.85431671142578 (-0.6965522766113281) | > avg_loss_duration: 3.392307678858439 (+0.045983541579473375) | > avg_loss_1: 36.0927480061849 (+0.31255876450311604)  > EPOCH: 1341/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:20:08)   --> TIME: 2023-10-20 17:20:23 -- STEP: 9/50 -- GLOBAL_STEP: 120060 | > loss_disc: 2.757267475128174 (2.4195195039113364) | > loss_disc_real_0: 0.20784667134284973 (0.18516267215212187) | > loss_disc_real_1: 0.1922709345817566 (0.22985626757144928) | > loss_disc_real_2: 0.3240506649017334 (0.2166114937927988) | > loss_disc_real_3: 0.3379215896129608 (0.19743895447916454) | > loss_disc_real_4: 0.31836774945259094 (0.21534769319825703) | > loss_disc_real_5: 0.3867042362689972 (0.2312427586875856) | > loss_0: 2.757267475128174 (2.4195195039113364) | > grad_norm_0: tensor(307.1793, device='cuda:0') (tensor(649.0255, device='cuda:0')) | > loss_gen: 2.4177966117858887 (2.3129054175482855) | > loss_kl: 0.7817098498344421 (0.7466486700707011) | > loss_feat: 5.259312152862549 (6.634744864371088) | > loss_mel: 20.412065505981445 (18.82981565263536) | > loss_duration: 1.2809280157089233 (1.3317555454042223) | > loss_1: 30.151811599731445 (29.855870776706272) | > grad_norm_1: tensor(3918.5505, device='cuda:0') (tensor(18911.6074, device='cuda:0')) | > current_lr_0: 5.2312405775483415e-05 | > current_lr_1: 5.2364747619252105e-05 | > step_time: 0.5574 (0.9027837912241617) | > loader_time: 0.0643 (0.040836201773749456)  --> TIME: 2023-10-20 17:20:41 -- STEP: 39/50 -- GLOBAL_STEP: 120090 | > loss_disc: 2.992255449295044 (2.360166589419047) | > loss_disc_real_0: 0.05345730111002922 (0.14364029132784942) | > loss_disc_real_1: 0.2185092717409134 (0.21618741215803686) | > loss_disc_real_2: 0.21034570038318634 (0.2177978943173702) | > loss_disc_real_3: 0.2546134293079376 (0.22229717471278634) | > loss_disc_real_4: 0.2355155199766159 (0.20762077160179615) | > loss_disc_real_5: 0.25884586572647095 (0.21231277930574158) | > loss_0: 2.992255449295044 (2.360166589419047) | > grad_norm_0: tensor(2102.7756, device='cuda:0') (tensor(737.0536, device='cuda:0')) | > loss_gen: 1.5327478647232056 (2.2907174030939736) | > loss_kl: 0.596565842628479 (0.7746614853923138) | > loss_feat: 0.9579663872718811 (5.887385050073648) | > loss_mel: 9.666533470153809 (20.471683881221676) | > loss_duration: 1.3425401449203491 (1.2958815220074775) | > loss_1: 14.096353530883789 (30.720329822638096) | > grad_norm_1: tensor(21213.2930, device='cuda:0') (tensor(20110.0547, device='cuda:0')) | > current_lr_0: 5.2312405775483415e-05 | > current_lr_1: 5.2364747619252105e-05 | > step_time: 0.2518 (0.6579993199079465) | > loader_time: 0.0023 (0.025395943568303048)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2658071517944336 (3.2658071517944336) | > loss_disc_real_0: 0.3851161003112793 (0.3851161003112793) | > loss_disc_real_1: 0.18750512599945068 (0.18750512599945068) | > loss_disc_real_2: 0.2504501938819885 (0.2504501938819885) | > loss_disc_real_3: 0.2161474972963333 (0.2161474972963333) | > loss_disc_real_4: 0.3106491267681122 (0.3106491267681122) | > loss_disc_real_5: 0.3231738209724426 (0.3231738209724426) | > loss_0: 3.2658071517944336 (3.2658071517944336) | > loss_gen: 1.5250688791275024 (1.5250688791275024) | > loss_kl: 6.297703266143799 (6.297703266143799) | > loss_feat: 2.67842960357666 (2.67842960357666) | > loss_mel: 19.396459579467773 (19.396459579467773) | > loss_duration: 3.306928873062134 (3.306928873062134) | > loss_1: 33.20458984375 (33.20458984375)  --> STEP: 1 | > loss_disc: 3.7819740772247314 (3.7819740772247314) | > loss_disc_real_0: 0.39330393075942993 (0.39330393075942993) | > loss_disc_real_1: 0.2744297981262207 (0.2744297981262207) | > loss_disc_real_2: 0.23529931902885437 (0.23529931902885437) | > loss_disc_real_3: 0.29757437109947205 (0.29757437109947205) | > loss_disc_real_4: 0.23796851933002472 (0.23796851933002472) | > loss_disc_real_5: 0.23513023555278778 (0.23513023555278778) | > loss_0: 3.7819740772247314 (3.7819740772247314) | > loss_gen: 1.3972969055175781 (1.3972969055175781) | > loss_kl: 5.723116874694824 (5.723116874694824) | > loss_feat: 7.2528486251831055 (7.2528486251831055) | > loss_mel: 22.241331100463867 (22.241331100463867) | > loss_duration: 3.522956132888794 (3.522956132888794) | > loss_1: 40.137550354003906 (40.137550354003906)  --> STEP: 2 | > loss_disc: 2.495563268661499 (3.1387686729431152) | > loss_disc_real_0: 0.1660262644290924 (0.27966509759426117) | > loss_disc_real_1: 0.18620255589485168 (0.2303161770105362) | > loss_disc_real_2: 0.12321433424949646 (0.17925682663917542) | > loss_disc_real_3: 0.1509198248386383 (0.22424709796905518) | > loss_disc_real_4: 0.146071195602417 (0.19201985746622086) | > loss_disc_real_5: 0.2568662762641907 (0.24599825590848923) | > loss_0: 2.495563268661499 (3.1387686729431152) | > loss_gen: 2.020684242248535 (1.7089905738830566) | > loss_kl: 7.385537624359131 (6.5543272495269775) | > loss_feat: 8.244880676269531 (7.748864650726318) | > loss_mel: 24.814895629882812 (23.52811336517334) | > loss_duration: 3.4118261337280273 (3.4673911333084106) | > loss_1: 45.87782287597656 (43.007686614990234)  --> STEP: 3 | > loss_disc: 3.146027088165283 (3.141188144683838) | > loss_disc_real_0: 0.5110244750976562 (0.3567848900953929) | > loss_disc_real_1: 0.2560598850250244 (0.2388974130153656) | > loss_disc_real_2: 0.2737087905406952 (0.21074081460634866) | > loss_disc_real_3: 0.2726387083530426 (0.24037763476371765) | > loss_disc_real_4: 0.27721837162971497 (0.22041936218738556) | > loss_disc_real_5: 0.27994295954704285 (0.25731315712134045) | > loss_0: 3.146027088165283 (3.141188144683838) | > loss_gen: 1.8756557703018188 (1.7645456393559773) | > loss_kl: 3.1013331413269043 (5.403329213460286) | > loss_feat: 1.2645018100738525 (5.58741037050883) | > loss_mel: 18.115665435791016 (21.72396405537923) | > loss_duration: 3.1099472045898438 (3.348243157068888) | > loss_1: 27.467103958129883 (37.82749239603678) --> EVAL PERFORMANCE | > avg_loader_time: 0.028535842895507812 (+0.012162764867146809) | > avg_loss_disc: 3.141188144683838 (+0.24765634536743164) | > avg_loss_disc_real_0: 0.3567848900953929 (+0.21083781744043034) | > avg_loss_disc_real_1: 0.2388974130153656 (-0.01011154552300772) | > avg_loss_disc_real_2: 0.21074081460634866 (-0.044851616024971036) | > avg_loss_disc_real_3: 0.24037763476371765 (-0.017446537812550844) | > avg_loss_disc_real_4: 0.22041936218738556 (-0.05278654396533966) | > avg_loss_disc_real_5: 0.25731315712134045 (-0.005675648649533571) | > avg_loss_0: 3.141188144683838 (+0.24765634536743164) | > avg_loss_gen: 1.7645456393559773 (-0.043254415194193596) | > avg_loss_kl: 5.403329213460286 (+0.16357421875) | > avg_loss_feat: 5.58741037050883 (-0.21115748087565045) | > avg_loss_mel: 21.72396405537923 (+1.8696473439534493) | > avg_loss_duration: 3.348243157068888 (-0.04406452178955078) | > avg_loss_1: 37.82749239603678 (+1.7347443898518833)  > EPOCH: 1342/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:21:02)   --> TIME: 2023-10-20 17:21:21 -- STEP: 19/50 -- GLOBAL_STEP: 120120 | > loss_disc: 2.2224960327148438 (2.3532788659396924) | > loss_disc_real_0: 0.09215300530195236 (0.14371180598084865) | > loss_disc_real_1: 0.12662947177886963 (0.21794596843813596) | > loss_disc_real_2: 0.15643258392810822 (0.20658620564561142) | > loss_disc_real_3: 0.2162291407585144 (0.2399740348521032) | > loss_disc_real_4: 0.050153978168964386 (0.18105547169321462) | > loss_disc_real_5: 0.043501801788806915 (0.18474310126743818) | > loss_0: 2.2224960327148438 (2.3532788659396924) | > grad_norm_0: tensor(356.3776, device='cuda:0') (tensor(575.2232, device='cuda:0')) | > loss_gen: 2.3286848068237305 (2.3257224622525667) | > loss_kl: 0.8160456418991089 (0.7243472965140092) | > loss_feat: 8.355425834655762 (6.547151642802515) | > loss_mel: 20.268470764160156 (21.745360173677142) | > loss_duration: 1.3876246213912964 (1.3247053497716) | > loss_1: 33.15625 (32.667286923057155) | > grad_norm_1: tensor(15436.0654, device='cuda:0') (tensor(18716.3906, device='cuda:0')) | > current_lr_0: 5.226011625066467e-05 | > current_lr_1: 5.2312405775483415e-05 | > step_time: 0.4977 (0.6845551791944002) | > loader_time: 0.0206 (0.025054404610081724)  --> TIME: 2023-10-20 17:21:34 -- STEP: 49/50 -- GLOBAL_STEP: 120150 | > loss_disc: 2.017458438873291 (2.426437909505804) | > loss_disc_real_0: 0.028973044827580452 (0.14217789552877752) | > loss_disc_real_1: 0.15488649904727936 (0.21813003407145032) | > loss_disc_real_2: 0.09962043166160583 (0.21483603758471354) | > loss_disc_real_3: 0.17627084255218506 (0.23477472167234031) | > loss_disc_real_4: 0.13504436612129211 (0.21448324529492124) | > loss_disc_real_5: 0.29865187406539917 (0.22699824667402677) | > loss_0: 2.017458438873291 (2.426437909505804) | > grad_norm_0: tensor(567.7487, device='cuda:0') (tensor(545.1089, device='cuda:0')) | > loss_gen: 2.2781124114990234 (2.247628910200937) | > loss_kl: 0.8921047449111938 (0.7220661841637018) | > loss_feat: 6.834168434143066 (5.350534599312411) | > loss_mel: 24.107648849487305 (18.825110776083804) | > loss_duration: 1.3592486381530762 (1.2989618583601348) | > loss_1: 35.471282958984375 (28.444302286420548) | > grad_norm_1: tensor(5879.7686, device='cuda:0') (tensor(18898.0996, device='cuda:0')) | > current_lr_0: 5.226011625066467e-05 | > current_lr_1: 5.2312405775483415e-05 | > step_time: 0.7909 (0.5135926129866619) | > loader_time: 0.399 (0.021141859949851523)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.0197360515594482 (2.0197360515594482) | > loss_disc_real_0: 0.1598787158727646 (0.1598787158727646) | > loss_disc_real_1: 0.22644752264022827 (0.22644752264022827) | > loss_disc_real_2: 0.17330320179462433 (0.17330320179462433) | > loss_disc_real_3: 0.1927901953458786 (0.1927901953458786) | > loss_disc_real_4: 0.20757287740707397 (0.20757287740707397) | > loss_disc_real_5: 0.1448349952697754 (0.1448349952697754) | > loss_0: 2.0197360515594482 (2.0197360515594482) | > loss_gen: 2.851074695587158 (2.851074695587158) | > loss_kl: 6.684420585632324 (6.684420585632324) | > loss_feat: 8.713541030883789 (8.713541030883789) | > loss_mel: 21.36175537109375 (21.36175537109375) | > loss_duration: 3.171285390853882 (3.171285390853882) | > loss_1: 42.782073974609375 (42.782073974609375)  --> STEP: 1 | > loss_disc: 3.172806978225708 (3.172806978225708) | > loss_disc_real_0: 0.3943478465080261 (0.3943478465080261) | > loss_disc_real_1: 0.2440052181482315 (0.2440052181482315) | > loss_disc_real_2: 0.23356400430202484 (0.23356400430202484) | > loss_disc_real_3: 0.2645820379257202 (0.2645820379257202) | > loss_disc_real_4: 0.4249969720840454 (0.4249969720840454) | > loss_disc_real_5: 0.3482040762901306 (0.3482040762901306) | > loss_0: 3.172806978225708 (3.172806978225708) | > loss_gen: 1.9618701934814453 (1.9618701934814453) | > loss_kl: 5.97196102142334 (5.97196102142334) | > loss_feat: 5.10031270980835 (5.10031270980835) | > loss_mel: 24.393966674804688 (24.393966674804688) | > loss_duration: 3.4232234954833984 (3.4232234954833984) | > loss_1: 40.85133361816406 (40.85133361816406)  --> STEP: 2 | > loss_disc: 2.1590259075164795 (2.6659164428710938) | > loss_disc_real_0: 0.18183633685112 (0.28809209167957306) | > loss_disc_real_1: 0.16499486565589905 (0.20450004190206528) | > loss_disc_real_2: 0.21269598603248596 (0.2231299951672554) | > loss_disc_real_3: 0.1245623230934143 (0.19457218050956726) | > loss_disc_real_4: 0.1692236065864563 (0.29711028933525085) | > loss_disc_real_5: 0.08794127404689789 (0.21807267516851425) | > loss_0: 2.1590259075164795 (2.6659164428710938) | > loss_gen: 1.9669792652130127 (1.964424729347229) | > loss_kl: 6.901012897491455 (6.4364869594573975) | > loss_feat: 7.9387664794921875 (6.5195395946502686) | > loss_mel: 17.091838836669922 (20.742902755737305) | > loss_duration: 3.2858376502990723 (3.3545305728912354) | > loss_1: 37.1844367980957 (39.01788520812988)  --> STEP: 3 | > loss_disc: 3.0041656494140625 (2.7786661783854165) | > loss_disc_real_0: 0.4130339026451111 (0.32973936200141907) | > loss_disc_real_1: 0.26518434286117554 (0.2247281422217687) | > loss_disc_real_2: 0.23112908005714417 (0.22579635679721832) | > loss_disc_real_3: 0.250095009803772 (0.21307979027430216) | > loss_disc_real_4: 0.24699461460113525 (0.28040506442387897) | > loss_disc_real_5: 0.24640624225139618 (0.22751719752947488) | > loss_0: 3.0041656494140625 (2.7786661783854165) | > loss_gen: 1.7159439325332642 (1.8815977970759075) | > loss_kl: 3.2412946224212646 (5.37142284711202) | > loss_feat: 0.16965477168560028 (4.4029113203287125) | > loss_mel: 13.159070014953613 (18.214958508809406) | > loss_duration: 3.00809383392334 (3.239051659901937) | > loss_1: 21.294055938720703 (33.10994211832682) --> EVAL PERFORMANCE | > avg_loader_time: 0.008427143096923828 (-0.020108699798583984) | > avg_loss_disc: 2.7786661783854165 (-0.36252196629842137) | > avg_loss_disc_real_0: 0.32973936200141907 (-0.027045528093973814) | > avg_loss_disc_real_1: 0.2247281422217687 (-0.014169270793596894) | > avg_loss_disc_real_2: 0.22579635679721832 (+0.015055542190869659) | > avg_loss_disc_real_3: 0.21307979027430216 (-0.027297844489415496) | > avg_loss_disc_real_4: 0.28040506442387897 (+0.05998570223649341) | > avg_loss_disc_real_5: 0.22751719752947488 (-0.029795959591865567) | > avg_loss_0: 2.7786661783854165 (-0.36252196629842137) | > avg_loss_gen: 1.8815977970759075 (+0.11705215771993016) | > avg_loss_kl: 5.37142284711202 (-0.0319063663482666) | > avg_loss_feat: 4.4029113203287125 (-1.1844990501801176) | > avg_loss_mel: 18.214958508809406 (-3.509005546569824) | > avg_loss_duration: 3.239051659901937 (-0.1091914971669512) | > avg_loss_1: 33.10994211832682 (-4.717550277709961)  > EPOCH: 1343/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:21:52)   --> TIME: 2023-10-20 17:22:18 -- STEP: 29/50 -- GLOBAL_STEP: 120180 | > loss_disc: 1.5990229845046997 (2.388511772813468) | > loss_disc_real_0: 0.06655649095773697 (0.158262698943245) | > loss_disc_real_1: 0.17771543562412262 (0.22760014852573132) | > loss_disc_real_2: 0.14239630103111267 (0.21861185621598672) | > loss_disc_real_3: 0.1945464015007019 (0.2424476517942445) | > loss_disc_real_4: 0.15104259550571442 (0.2128428892585738) | > loss_disc_real_5: 0.11965201050043106 (0.2109009191907685) | > loss_0: 1.5990229845046997 (2.388511772813468) | > grad_norm_0: tensor(283.9189, device='cuda:0') (tensor(593.1558, device='cuda:0')) | > loss_gen: 2.995549440383911 (2.404313827383108) | > loss_kl: 1.0126168727874756 (0.8292138206547705) | > loss_feat: 10.014740943908691 (6.487633180900894) | > loss_mel: 21.663991928100586 (20.847800665888293) | > loss_duration: 1.2931865453720093 (1.2920685225519641) | > loss_1: 36.98008346557617 (31.861029361856396) | > grad_norm_1: tensor(19385.2910, device='cuda:0') (tensor(18084.7891, device='cuda:0')) | > current_lr_0: 5.220787899249979e-05 | > current_lr_1: 5.226011625066467e-05 | > step_time: 0.3676 (0.6764907014781031) | > loader_time: 0.0402 (0.025015280164521318)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.572138786315918 (2.572138786315918) | > loss_disc_real_0: 0.45646825432777405 (0.45646825432777405) | > loss_disc_real_1: 0.23654185235500336 (0.23654185235500336) | > loss_disc_real_2: 0.18857449293136597 (0.18857449293136597) | > loss_disc_real_3: 0.21146661043167114 (0.21146661043167114) | > loss_disc_real_4: 0.213491752743721 (0.213491752743721) | > loss_disc_real_5: 0.26886269450187683 (0.26886269450187683) | > loss_0: 2.572138786315918 (2.572138786315918) | > loss_gen: 2.5559685230255127 (2.5559685230255127) | > loss_kl: 6.23487663269043 (6.23487663269043) | > loss_feat: 4.7067551612854 (4.7067551612854) | > loss_mel: 24.454683303833008 (24.454683303833008) | > loss_duration: 3.2409815788269043 (3.2409815788269043) | > loss_1: 41.193267822265625 (41.193267822265625)  --> STEP: 1 | > loss_disc: 2.9323949813842773 (2.9323949813842773) | > loss_disc_real_0: 0.5885534286499023 (0.5885534286499023) | > loss_disc_real_1: 0.29142165184020996 (0.29142165184020996) | > loss_disc_real_2: 0.2935231328010559 (0.2935231328010559) | > loss_disc_real_3: 0.17355404794216156 (0.17355404794216156) | > loss_disc_real_4: 0.28919580578804016 (0.28919580578804016) | > loss_disc_real_5: 0.25013935565948486 (0.25013935565948486) | > loss_0: 2.9323949813842773 (2.9323949813842773) | > loss_gen: 2.2630131244659424 (2.2630131244659424) | > loss_kl: 6.261159420013428 (6.261159420013428) | > loss_feat: 4.796108722686768 (4.796108722686768) | > loss_mel: 24.14087677001953 (24.14087677001953) | > loss_duration: 3.5710229873657227 (3.5710229873657227) | > loss_1: 41.03217697143555 (41.03217697143555)  --> STEP: 2 | > loss_disc: 1.5274397134780884 (2.229917347431183) | > loss_disc_real_0: 0.03917212411761284 (0.3138627763837576) | > loss_disc_real_1: 0.11617076396942139 (0.20379620790481567) | > loss_disc_real_2: 0.09484288841485977 (0.19418301060795784) | > loss_disc_real_3: 0.1670726090669632 (0.17031332850456238) | > loss_disc_real_4: 0.09243707358837128 (0.19081643968820572) | > loss_disc_real_5: 0.06858497112989426 (0.15936216339468956) | > loss_0: 1.5274397134780884 (2.229917347431183) | > loss_gen: 2.9603028297424316 (2.611657977104187) | > loss_kl: 6.697559833526611 (6.4793596267700195) | > loss_feat: 9.710614204406738 (7.253361463546753) | > loss_mel: 24.979154586791992 (24.56001567840576) | > loss_duration: 3.4003500938415527 (3.4856865406036377) | > loss_1: 47.747982025146484 (44.390079498291016)  --> STEP: 3 | > loss_disc: 2.9869675636291504 (2.482267419497172) | > loss_disc_real_0: 0.35936570167541504 (0.3290304181476434) | > loss_disc_real_1: 0.32689642906188965 (0.24482961495717367) | > loss_disc_real_2: 0.3310087025165558 (0.23979157457749048) | > loss_disc_real_3: 0.2979801595211029 (0.2128689388434092) | > loss_disc_real_4: 0.3016663193702698 (0.22776639958222708) | > loss_disc_real_5: 0.26992976665496826 (0.19621803114811578) | > loss_0: 2.9869675636291504 (2.482267419497172) | > loss_gen: 2.122286319732666 (2.44853409131368) | > loss_kl: 3.068246841430664 (5.342322031656901) | > loss_feat: 1.4549232721328735 (5.3205487330754595) | > loss_mel: 14.512707710266113 (21.21091302235921) | > loss_duration: 3.136279821395874 (3.36921763420105) | > loss_1: 24.294443130493164 (37.6915340423584) --> EVAL PERFORMANCE | > avg_loader_time: 0.018506447474161785 (+0.010079304377237957) | > avg_loss_disc: 2.482267419497172 (-0.29639875888824463) | > avg_loss_disc_real_0: 0.3290304181476434 (-0.0007089438537756787) | > avg_loss_disc_real_1: 0.24482961495717367 (+0.020101472735404968) | > avg_loss_disc_real_2: 0.23979157457749048 (+0.013995217780272157) | > avg_loss_disc_real_3: 0.2128689388434092 (-0.00021085143089294434) | > avg_loss_disc_real_4: 0.22776639958222708 (-0.05263866484165189) | > avg_loss_disc_real_5: 0.19621803114811578 (-0.0312991663813591) | > avg_loss_0: 2.482267419497172 (-0.29639875888824463) | > avg_loss_gen: 2.44853409131368 (+0.5669362942377727) | > avg_loss_kl: 5.342322031656901 (-0.029100815455118223) | > avg_loss_feat: 5.3205487330754595 (+0.917637412746747) | > avg_loss_mel: 21.21091302235921 (+2.9959545135498047) | > avg_loss_duration: 3.36921763420105 (+0.1301659742991128) | > avg_loss_1: 37.6915340423584 (+4.581591924031578)  > EPOCH: 1344/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:22:43)   --> TIME: 2023-10-20 17:22:52 -- STEP: 9/50 -- GLOBAL_STEP: 120210 | > loss_disc: 2.367414712905884 (2.31673182381524) | > loss_disc_real_0: 0.17724543809890747 (0.13450271843208206) | > loss_disc_real_1: 0.28135496377944946 (0.21381409880187777) | > loss_disc_real_2: 0.20181983709335327 (0.2251310580306583) | > loss_disc_real_3: 0.3069397807121277 (0.27175958620177376) | > loss_disc_real_4: 0.27382659912109375 (0.21638227999210358) | > loss_disc_real_5: 0.20152021944522858 (0.16048561036586761) | > loss_0: 2.367414712905884 (2.31673182381524) | > grad_norm_0: tensor(379.0808, device='cuda:0') (tensor(425.0894, device='cuda:0')) | > loss_gen: 2.4352080821990967 (2.479897287156847) | > loss_kl: 0.7737508416175842 (0.743547797203064) | > loss_feat: 3.7589080333709717 (7.110700686772664) | > loss_mel: 22.674821853637695 (22.003845638699) | > loss_duration: 1.254284143447876 (1.2906902498669095) | > loss_1: 30.89697265625 (33.628681394788956) | > grad_norm_1: tensor(2237.4482, device='cuda:0') (tensor(19484.4785, device='cuda:0')) | > current_lr_0: 5.215569394874499e-05 | > current_lr_1: 5.220787899249979e-05 | > step_time: 1.0678 (0.40504103236728245) | > loader_time: 0.022 (0.007364087634616428)  --> TIME: 2023-10-20 17:23:23 -- STEP: 39/50 -- GLOBAL_STEP: 120240 | > loss_disc: 2.0668115615844727 (2.3149673510820445) | > loss_disc_real_0: 0.0645936131477356 (0.14459189519477197) | > loss_disc_real_1: 0.22298893332481384 (0.2162408723663061) | > loss_disc_real_2: 0.2423880398273468 (0.22654391404909965) | > loss_disc_real_3: 0.07361755520105362 (0.23536793868511152) | > loss_disc_real_4: 0.1724233478307724 (0.1948555217912564) | > loss_disc_real_5: 0.19145743548870087 (0.17910670465192735) | > loss_0: 2.0668115615844727 (2.3149673510820445) | > grad_norm_0: tensor(560.0385, device='cuda:0') (tensor(594.4651, device='cuda:0')) | > loss_gen: 2.5401268005371094 (2.391634131089235) | > loss_kl: 0.6146466135978699 (0.7714525522329868) | > loss_feat: 9.845614433288574 (6.780822287958402) | > loss_mel: 24.919822692871094 (21.147595790716323) | > loss_duration: 1.3959296941757202 (1.2872453331947329) | > loss_1: 39.31614303588867 (32.378750263116295) | > grad_norm_1: tensor(71374.2734, device='cuda:0') (tensor(21567.9746, device='cuda:0')) | > current_lr_0: 5.215569394874499e-05 | > current_lr_1: 5.220787899249979e-05 | > step_time: 0.6545 (0.8460780596121763) | > loader_time: 0.0045 (0.03485103142567169)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.982419013977051 (2.982419013977051) | > loss_disc_real_0: 0.06111133098602295 (0.06111133098602295) | > loss_disc_real_1: 0.27153581380844116 (0.27153581380844116) | > loss_disc_real_2: 0.34628117084503174 (0.34628117084503174) | > loss_disc_real_3: 0.336124062538147 (0.336124062538147) | > loss_disc_real_4: 0.4803374111652374 (0.4803374111652374) | > loss_disc_real_5: 0.37374818325042725 (0.37374818325042725) | > loss_0: 2.982419013977051 (2.982419013977051) | > loss_gen: 2.131582736968994 (2.131582736968994) | > loss_kl: 5.8693342208862305 (5.8693342208862305) | > loss_feat: 4.6973700523376465 (4.6973700523376465) | > loss_mel: 22.006988525390625 (22.006988525390625) | > loss_duration: 3.2358319759368896 (3.2358319759368896) | > loss_1: 37.94110870361328 (37.94110870361328)  --> STEP: 1 | > loss_disc: 2.743997097015381 (2.743997097015381) | > loss_disc_real_0: 0.19778841733932495 (0.19778841733932495) | > loss_disc_real_1: 0.3715989887714386 (0.3715989887714386) | > loss_disc_real_2: 0.23271314799785614 (0.23271314799785614) | > loss_disc_real_3: 0.3287302851676941 (0.3287302851676941) | > loss_disc_real_4: 0.39712846279144287 (0.39712846279144287) | > loss_disc_real_5: 0.16860173642635345 (0.16860173642635345) | > loss_0: 2.743997097015381 (2.743997097015381) | > loss_gen: 2.286223888397217 (2.286223888397217) | > loss_kl: 5.831110954284668 (5.831110954284668) | > loss_feat: 6.013412952423096 (6.013412952423096) | > loss_mel: 21.22301483154297 (21.22301483154297) | > loss_duration: 3.548337459564209 (3.548337459564209) | > loss_1: 38.902099609375 (38.902099609375)  --> STEP: 2 | > loss_disc: 2.3492953777313232 (2.546646237373352) | > loss_disc_real_0: 0.041251372545957565 (0.11951989494264126) | > loss_disc_real_1: 0.22754666209220886 (0.29957282543182373) | > loss_disc_real_2: 0.1768518090248108 (0.20478247851133347) | > loss_disc_real_3: 0.2287154197692871 (0.2787228524684906) | > loss_disc_real_4: 0.1844811588525772 (0.29080481082201004) | > loss_disc_real_5: 0.21131734549999237 (0.1899595409631729) | > loss_0: 2.3492953777313232 (2.546646237373352) | > loss_gen: 2.2806856632232666 (2.2834547758102417) | > loss_kl: 6.596909523010254 (6.214010238647461) | > loss_feat: 9.648568153381348 (7.830990552902222) | > loss_mel: 23.315277099609375 (22.269145965576172) | > loss_duration: 3.3998537063598633 (3.474095582962036) | > loss_1: 45.24129104614258 (42.07169532775879)  --> STEP: 3 | > loss_disc: 2.6291677951812744 (2.574153423309326) | > loss_disc_real_0: 0.06937985867261887 (0.10280654951930046) | > loss_disc_real_1: 0.30438342690467834 (0.3011763592561086) | > loss_disc_real_2: 0.3382820188999176 (0.24928232530752817) | > loss_disc_real_3: 0.3288358449935913 (0.29542718331019086) | > loss_disc_real_4: 0.2635864019393921 (0.2817320078611374) | > loss_disc_real_5: 0.25535517930984497 (0.21175808707873026) | > loss_0: 2.6291677951812744 (2.574153423309326) | > loss_gen: 2.2648797035217285 (2.277263085047404) | > loss_kl: 2.798340320587158 (5.075453599294026) | > loss_feat: 4.819314002990723 (6.827098369598389) | > loss_mel: 21.149198532104492 (21.895830154418945) | > loss_duration: 3.1251182556152344 (3.357769807179769) | > loss_1: 34.15685272216797 (39.433414459228516) --> EVAL PERFORMANCE | > avg_loader_time: 0.007352272669474284 (-0.0111541748046875) | > avg_loss_disc: 2.574153423309326 (+0.09188600381215428) | > avg_loss_disc_real_0: 0.10280654951930046 (-0.22622386862834293) | > avg_loss_disc_real_1: 0.3011763592561086 (+0.05634674429893491) | > avg_loss_disc_real_2: 0.24928232530752817 (+0.00949075073003769) | > avg_loss_disc_real_3: 0.29542718331019086 (+0.08255824446678164) | > avg_loss_disc_real_4: 0.2817320078611374 (+0.05396560827891031) | > avg_loss_disc_real_5: 0.21175808707873026 (+0.015540055930614471) | > avg_loss_0: 2.574153423309326 (+0.09188600381215428) | > avg_loss_gen: 2.277263085047404 (-0.17127100626627634) | > avg_loss_kl: 5.075453599294026 (-0.26686843236287494) | > avg_loss_feat: 6.827098369598389 (+1.5065496365229292) | > avg_loss_mel: 21.895830154418945 (+0.6849171320597343) | > avg_loss_duration: 3.357769807179769 (-0.011447827021280776) | > avg_loss_1: 39.433414459228516 (+1.7418804168701172)  > EPOCH: 1345/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:23:37)   --> TIME: 2023-10-20 17:23:55 -- STEP: 19/50 -- GLOBAL_STEP: 120270 | > loss_disc: 2.404188394546509 (2.485918139156542) | > loss_disc_real_0: 0.1108984425663948 (0.13849908329154315) | > loss_disc_real_1: 0.30817192792892456 (0.2110233110816855) | > loss_disc_real_2: 0.2091820389032364 (0.21576628128164693) | > loss_disc_real_3: 0.28249555826187134 (0.24091202648062454) | > loss_disc_real_4: 0.25208166241645813 (0.2686992044511594) | > loss_disc_real_5: 0.3420940339565277 (0.24724743005476496) | > loss_0: 2.404188394546509 (2.485918139156542) | > grad_norm_0: tensor(497.2315, device='cuda:0') (tensor(567.9326, device='cuda:0')) | > loss_gen: 2.4770188331604004 (2.295032413382279) | > loss_kl: 0.8754928112030029 (0.807536106360586) | > loss_feat: 3.725399971008301 (5.5222530913980385) | > loss_mel: 21.488649368286133 (20.79329970635866) | > loss_duration: 1.365380048751831 (1.311349630355835) | > loss_1: 29.93194007873535 (30.729470754924574) | > grad_norm_1: tensor(3190.9551, device='cuda:0') (tensor(13148.5342, device='cuda:0')) | > current_lr_0: 5.210356106720869e-05 | > current_lr_1: 5.215569394874499e-05 | > step_time: 0.7437 (0.658658830743087) | > loader_time: 0.0284 (0.02405908233241031)  --> TIME: 2023-10-20 17:24:12 -- STEP: 49/50 -- GLOBAL_STEP: 120300 | > loss_disc: 2.983240842819214 (2.5128407599974647) | > loss_disc_real_0: 0.2921980023384094 (0.14472683785217144) | > loss_disc_real_1: 0.26016736030578613 (0.21746793830273103) | > loss_disc_real_2: 0.27354612946510315 (0.21972812757808335) | > loss_disc_real_3: 0.2461366355419159 (0.23498421360035332) | > loss_disc_real_4: 0.2527410089969635 (0.23453116660215417) | > loss_disc_real_5: 0.28445756435394287 (0.23561773871128652) | > loss_0: 2.983240842819214 (2.5128407599974647) | > grad_norm_0: tensor(440.0665, device='cuda:0') (tensor(619.3811, device='cuda:0')) | > loss_gen: 1.6235381364822388 (2.199722046754798) | > loss_kl: 0.6256009936332703 (0.7843717443091529) | > loss_feat: 0.07732920348644257 (5.054197207397343) | > loss_mel: 2.2084240913391113 (19.163229348708178) | > loss_duration: 1.4520928859710693 (1.2852732162086333) | > loss_1: 5.986985206604004 (28.4867937516193) | > grad_norm_1: tensor(29358.9375, device='cuda:0') (tensor(18131.7695, device='cuda:0')) | > current_lr_0: 5.210356106720869e-05 | > current_lr_1: 5.215569394874499e-05 | > step_time: 0.8603 (0.5854246081138142) | > loader_time: 0.5137 (0.02901614928732113)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.794674873352051 (2.794674873352051) | > loss_disc_real_0: 0.4788815975189209 (0.4788815975189209) | > loss_disc_real_1: 0.23702771961688995 (0.23702771961688995) | > loss_disc_real_2: 0.26711156964302063 (0.26711156964302063) | > loss_disc_real_3: 0.2570037841796875 (0.2570037841796875) | > loss_disc_real_4: 0.3443281352519989 (0.3443281352519989) | > loss_disc_real_5: 0.40725448727607727 (0.40725448727607727) | > loss_0: 2.794674873352051 (2.794674873352051) | > loss_gen: 2.9907538890838623 (2.9907538890838623) | > loss_kl: 6.2295942306518555 (6.2295942306518555) | > loss_feat: 4.763431072235107 (4.763431072235107) | > loss_mel: 21.876306533813477 (21.876306533813477) | > loss_duration: 3.1265463829040527 (3.1265463829040527) | > loss_1: 38.986629486083984 (38.986629486083984)  --> STEP: 1 | > loss_disc: 2.140522003173828 (2.140522003173828) | > loss_disc_real_0: 0.16545063257217407 (0.16545063257217407) | > loss_disc_real_1: 0.2847473621368408 (0.2847473621368408) | > loss_disc_real_2: 0.2529248893260956 (0.2529248893260956) | > loss_disc_real_3: 0.12449795752763748 (0.12449795752763748) | > loss_disc_real_4: 0.1794419139623642 (0.1794419139623642) | > loss_disc_real_5: 0.14298968017101288 (0.14298968017101288) | > loss_0: 2.140522003173828 (2.140522003173828) | > loss_gen: 2.696544647216797 (2.696544647216797) | > loss_kl: 5.745742321014404 (5.745742321014404) | > loss_feat: 6.414472579956055 (6.414472579956055) | > loss_mel: 21.898475646972656 (21.898475646972656) | > loss_duration: 3.5124287605285645 (3.5124287605285645) | > loss_1: 40.26766586303711 (40.26766586303711)  --> STEP: 2 | > loss_disc: 1.9774659872055054 (2.0589939951896667) | > loss_disc_real_0: 0.29116329550743103 (0.22830696403980255) | > loss_disc_real_1: 0.15053114295005798 (0.2176392525434494) | > loss_disc_real_2: 0.10823909193277359 (0.18058199062943459) | > loss_disc_real_3: 0.14764079451560974 (0.1360693760216236) | > loss_disc_real_4: 0.13532650470733643 (0.1573842093348503) | > loss_disc_real_5: 0.1634109765291214 (0.15320032835006714) | > loss_0: 1.9774659872055054 (2.0589939951896667) | > loss_gen: 2.9036011695861816 (2.8000729084014893) | > loss_kl: 6.603278160095215 (6.17451024055481) | > loss_feat: 11.96496295928955 (9.189717769622803) | > loss_mel: 25.455415725708008 (23.676945686340332) | > loss_duration: 3.471513509750366 (3.4919711351394653) | > loss_1: 50.398773193359375 (45.33321952819824)  --> STEP: 3 | > loss_disc: 2.743185520172119 (2.2870578368504844) | > loss_disc_real_0: 0.4301772117614746 (0.29559704661369324) | > loss_disc_real_1: 0.24564991891384125 (0.22697614133358002) | > loss_disc_real_2: 0.2901552617549896 (0.21710641433795294) | > loss_disc_real_3: 0.3512965142726898 (0.2078117554386457) | > loss_disc_real_4: 0.2729809880256653 (0.1959164688984553) | > loss_disc_real_5: 0.3348630666732788 (0.21375457445780435) | > loss_0: 2.743185520172119 (2.2870578368504844) | > loss_gen: 2.6760642528533936 (2.7587366898854575) | > loss_kl: 3.1358284950256348 (5.161616325378418) | > loss_feat: 2.5247175693511963 (6.968051036198934) | > loss_mel: 16.983484268188477 (21.445791880289715) | > loss_duration: 3.107776641845703 (3.3639063040415444) | > loss_1: 28.427871704101562 (39.69810358683268) --> EVAL PERFORMANCE | > avg_loader_time: 0.020282745361328125 (+0.01293047269185384) | > avg_loss_disc: 2.2870578368504844 (-0.2870955864588418) | > avg_loss_disc_real_0: 0.29559704661369324 (+0.19279049709439278) | > avg_loss_disc_real_1: 0.22697614133358002 (-0.07420021792252857) | > avg_loss_disc_real_2: 0.21710641433795294 (-0.03217591096957523) | > avg_loss_disc_real_3: 0.2078117554386457 (-0.08761542787154517) | > avg_loss_disc_real_4: 0.1959164688984553 (-0.0858155389626821) | > avg_loss_disc_real_5: 0.21375457445780435 (+0.0019964873790740967) | > avg_loss_0: 2.2870578368504844 (-0.2870955864588418) | > avg_loss_gen: 2.7587366898854575 (+0.4814736048380537) | > avg_loss_kl: 5.161616325378418 (+0.08616272608439157) | > avg_loss_feat: 6.968051036198934 (+0.14095266660054495) | > avg_loss_mel: 21.445791880289715 (-0.4500382741292306) | > avg_loss_duration: 3.3639063040415444 (+0.00613649686177542) | > avg_loss_1: 39.69810358683268 (+0.2646891276041643)  > EPOCH: 1346/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:24:29)   --> TIME: 2023-10-20 17:24:46 -- STEP: 29/50 -- GLOBAL_STEP: 120330 | > loss_disc: 2.7049143314361572 (2.4989805139344314) | > loss_disc_real_0: 0.16457541286945343 (0.14009307087238496) | > loss_disc_real_1: 0.11894667893648148 (0.21924458842339187) | > loss_disc_real_2: 0.17676982283592224 (0.23739114821214097) | > loss_disc_real_3: 0.26354408264160156 (0.226776410793436) | > loss_disc_real_4: 0.24832867085933685 (0.22368878562902583) | > loss_disc_real_5: 0.13783323764801025 (0.23365061678763094) | > loss_0: 2.7049143314361572 (2.4989805139344314) | > grad_norm_0: tensor(758.0320, device='cuda:0') (tensor(1053.4921, device='cuda:0')) | > loss_gen: 1.955956220626831 (2.2240355220334282) | > loss_kl: 0.8364503383636475 (0.7429314183777777) | > loss_feat: 5.7297539710998535 (5.536154734613053) | > loss_mel: 20.33176040649414 (20.261954663128687) | > loss_duration: 1.2877973318099976 (1.3053542457777876) | > loss_1: 30.1417179107666 (30.070430492532665) | > grad_norm_1: tensor(11564.9414, device='cuda:0') (tensor(33744.6602, device='cuda:0')) | > current_lr_0: 5.2051480295751494e-05 | > current_lr_1: 5.210356106720869e-05 | > step_time: 0.3441 (0.3561458505433181) | > loader_time: 0.0029 (0.005690541760674839)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.101362466812134 (3.101362466812134) | > loss_disc_real_0: 0.21631383895874023 (0.21631383895874023) | > loss_disc_real_1: 0.4424991309642792 (0.4424991309642792) | > loss_disc_real_2: 0.3356136977672577 (0.3356136977672577) | > loss_disc_real_3: 0.25749921798706055 (0.25749921798706055) | > loss_disc_real_4: 0.4520493745803833 (0.4520493745803833) | > loss_disc_real_5: 0.4064851701259613 (0.4064851701259613) | > loss_0: 3.101362466812134 (3.101362466812134) | > loss_gen: 2.5006747245788574 (2.5006747245788574) | > loss_kl: 6.971986770629883 (6.971986770629883) | > loss_feat: 7.2741007804870605 (7.2741007804870605) | > loss_mel: 21.64640235900879 (21.64640235900879) | > loss_duration: 3.084489107131958 (3.084489107131958) | > loss_1: 41.47765350341797 (41.47765350341797)  --> STEP: 1 | > loss_disc: 2.3764100074768066 (2.3764100074768066) | > loss_disc_real_0: 0.1315917819738388 (0.1315917819738388) | > loss_disc_real_1: 0.33634239435195923 (0.33634239435195923) | > loss_disc_real_2: 0.20148266851902008 (0.20148266851902008) | > loss_disc_real_3: 0.24512559175491333 (0.24512559175491333) | > loss_disc_real_4: 0.30110135674476624 (0.30110135674476624) | > loss_disc_real_5: 0.2533436417579651 (0.2533436417579651) | > loss_0: 2.3764100074768066 (2.3764100074768066) | > loss_gen: 2.3545844554901123 (2.3545844554901123) | > loss_kl: 5.791723728179932 (5.791723728179932) | > loss_feat: 3.911485195159912 (3.911485195159912) | > loss_mel: 24.134145736694336 (24.134145736694336) | > loss_duration: 3.5518290996551514 (3.5518290996551514) | > loss_1: 39.743770599365234 (39.743770599365234)  --> STEP: 2 | > loss_disc: 2.7629480361938477 (2.569679021835327) | > loss_disc_real_0: 0.17543776333332062 (0.1535147726535797) | > loss_disc_real_1: 0.34491798281669617 (0.3406301885843277) | > loss_disc_real_2: 0.32017743587493896 (0.2608300521969795) | > loss_disc_real_3: 0.35950130224227905 (0.3023134469985962) | > loss_disc_real_4: 0.31515002250671387 (0.30812568962574005) | > loss_disc_real_5: 0.3288189470767975 (0.2910812944173813) | > loss_0: 2.7629480361938477 (2.569679021835327) | > loss_gen: 2.454016923904419 (2.4043006896972656) | > loss_kl: 6.839089393615723 (6.315406560897827) | > loss_feat: 3.327120542526245 (3.6193028688430786) | > loss_mel: 24.308780670166016 (24.221463203430176) | > loss_duration: 3.361527919769287 (3.4566785097122192) | > loss_1: 40.29053497314453 (40.01715278625488)  --> STEP: 3 | > loss_disc: 2.8061628341674805 (2.6485069592793784) | > loss_disc_real_0: 0.1464245617389679 (0.15115136901537576) | > loss_disc_real_1: 0.36596590280532837 (0.34907542665799457) | > loss_disc_real_2: 0.21537938714027405 (0.24567983051141104) | > loss_disc_real_3: 0.3537778854370117 (0.31946825981140137) | > loss_disc_real_4: 0.32841598987579346 (0.3148891230424245) | > loss_disc_real_5: 0.21487730741500854 (0.2656799654165904) | > loss_0: 2.8061628341674805 (2.6485069592793784) | > loss_gen: 2.3718438148498535 (2.393481731414795) | > loss_kl: 2.976181983947754 (5.20233170191447) | > loss_feat: 5.524445056915283 (4.2543502648671465) | > loss_mel: 20.027774810791016 (22.823567072550457) | > loss_duration: 3.1425890922546387 (3.351982037226359) | > loss_1: 34.0428352355957 (38.02571360270182) --> EVAL PERFORMANCE | > avg_loader_time: 0.004513104756673177 (-0.01576964060465495) | > avg_loss_disc: 2.6485069592793784 (+0.36144912242889404) | > avg_loss_disc_real_0: 0.15115136901537576 (-0.14444567759831747) | > avg_loss_disc_real_1: 0.34907542665799457 (+0.12209928532441455) | > avg_loss_disc_real_2: 0.24567983051141104 (+0.0285734161734581) | > avg_loss_disc_real_3: 0.31946825981140137 (+0.11165650437275568) | > avg_loss_disc_real_4: 0.3148891230424245 (+0.11897265414396921) | > avg_loss_disc_real_5: 0.2656799654165904 (+0.05192539095878604) | > avg_loss_0: 2.6485069592793784 (+0.36144912242889404) | > avg_loss_gen: 2.393481731414795 (-0.3652549584706626) | > avg_loss_kl: 5.20233170191447 (+0.04071537653605173) | > avg_loss_feat: 4.2543502648671465 (-2.713700771331787) | > avg_loss_mel: 22.823567072550457 (+1.3777751922607422) | > avg_loss_duration: 3.351982037226359 (-0.011924266815185547) | > avg_loss_1: 38.02571360270182 (-1.6723899841308594)  > EPOCH: 1347/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:25:44)   --> TIME: 2023-10-20 17:25:54 -- STEP: 9/50 -- GLOBAL_STEP: 120360 | > loss_disc: 2.993077516555786 (2.392845948537191) | > loss_disc_real_0: 0.223467156291008 (0.15475019191702208) | > loss_disc_real_1: 0.24006706476211548 (0.18870626472764546) | > loss_disc_real_2: 0.24732854962348938 (0.23078177041477627) | > loss_disc_real_3: 0.25714999437332153 (0.19102607170740762) | > loss_disc_real_4: 0.24631482362747192 (0.21053667697641584) | > loss_disc_real_5: 0.24241143465042114 (0.20836395190821755) | > loss_0: 2.993077516555786 (2.392845948537191) | > grad_norm_0: tensor(401.3365, device='cuda:0') (tensor(932.5074, device='cuda:0')) | > loss_gen: 1.482922077178955 (2.2251800431145563) | > loss_kl: 0.4939240515232086 (0.8966438207361433) | > loss_feat: 0.027472056448459625 (5.771494734204477) | > loss_mel: 0.7299299240112305 (14.523360835181343) | > loss_duration: 1.3024132251739502 (1.2861795292960272) | > loss_1: 4.036661148071289 (24.702859984503853) | > grad_norm_1: 0 (tensor(46142.4102, device='cuda:0')) | > current_lr_0: 5.199945158228611e-05 | > current_lr_1: 5.2051480295751494e-05 | > step_time: 0.3787 (0.5951877699957954) | > loader_time: 0.0238 (0.02184462547302246)  --> TIME: 2023-10-20 17:26:12 -- STEP: 39/50 -- GLOBAL_STEP: 120390 | > loss_disc: 1.7549762725830078 (2.50716124742459) | > loss_disc_real_0: 0.06874208152294159 (0.15286649443591255) | > loss_disc_real_1: 0.15801919996738434 (0.22363406305129713) | > loss_disc_real_2: 0.06881215423345566 (0.22427831551967523) | > loss_disc_real_3: 0.1521323174238205 (0.24442330671426576) | > loss_disc_real_4: 0.034526556730270386 (0.21660875376218405) | > loss_disc_real_5: 0.029499074444174767 (0.20321732410826746) | > loss_0: 1.7549762725830078 (2.50716124742459) | > grad_norm_0: tensor(633.4443, device='cuda:0') (tensor(643.1120, device='cuda:0')) | > loss_gen: 2.375281572341919 (2.1885843796607776) | > loss_kl: 0.572294294834137 (0.8388878137637408) | > loss_feat: 8.685970306396484 (5.505379138371119) | > loss_mel: 23.057762145996094 (17.675356812966175) | > loss_duration: 1.3393181562423706 (1.2922639082639644) | > loss_1: 36.03062438964844 (27.500472374451466) | > grad_norm_1: tensor(23295.7441, device='cuda:0') (tensor(27866.8145, device='cuda:0')) | > current_lr_0: 5.199945158228611e-05 | > current_lr_1: 5.2051480295751494e-05 | > step_time: 0.3541 (0.568808696208856) | > loader_time: 0.0045 (0.018873893297635592)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.667214870452881 (2.667214870452881) | > loss_disc_real_0: 0.1860368549823761 (0.1860368549823761) | > loss_disc_real_1: 0.21155107021331787 (0.21155107021331787) | > loss_disc_real_2: 0.3333716094493866 (0.3333716094493866) | > loss_disc_real_3: 0.18604333698749542 (0.18604333698749542) | > loss_disc_real_4: 0.4260237216949463 (0.4260237216949463) | > loss_disc_real_5: 0.2636462152004242 (0.2636462152004242) | > loss_0: 2.667214870452881 (2.667214870452881) | > loss_gen: 2.195065498352051 (2.195065498352051) | > loss_kl: 6.0770583152771 (6.0770583152771) | > loss_feat: 6.445584297180176 (6.445584297180176) | > loss_mel: 20.898588180541992 (20.898588180541992) | > loss_duration: 3.064537286758423 (3.064537286758423) | > loss_1: 38.68083190917969 (38.68083190917969)  --> STEP: 1 | > loss_disc: 2.3672380447387695 (2.3672380447387695) | > loss_disc_real_0: 0.1926712989807129 (0.1926712989807129) | > loss_disc_real_1: 0.22336119413375854 (0.22336119413375854) | > loss_disc_real_2: 0.24754734337329865 (0.24754734337329865) | > loss_disc_real_3: 0.256395548582077 (0.256395548582077) | > loss_disc_real_4: 0.21531175076961517 (0.21531175076961517) | > loss_disc_real_5: 0.1848427802324295 (0.1848427802324295) | > loss_0: 2.3672380447387695 (2.3672380447387695) | > loss_gen: 2.512021780014038 (2.512021780014038) | > loss_kl: 5.956295967102051 (5.956295967102051) | > loss_feat: 6.006888389587402 (6.006888389587402) | > loss_mel: 21.485239028930664 (21.485239028930664) | > loss_duration: 3.427077293395996 (3.427077293395996) | > loss_1: 39.38752365112305 (39.38752365112305)  --> STEP: 2 | > loss_disc: 3.012709617614746 (2.689973831176758) | > loss_disc_real_0: 0.2772331237792969 (0.23495221138000488) | > loss_disc_real_1: 0.23876342177391052 (0.23106230795383453) | > loss_disc_real_2: 0.27583518624305725 (0.26169126480817795) | > loss_disc_real_3: 0.24360567331314087 (0.25000061094760895) | > loss_disc_real_4: 0.24970921874046326 (0.23251048475503922) | > loss_disc_real_5: 0.27321794629096985 (0.22903036326169968) | > loss_0: 3.012709617614746 (2.689973831176758) | > loss_gen: 1.5512357950210571 (2.0316287875175476) | > loss_kl: 6.8224639892578125 (6.389379978179932) | > loss_feat: 0.11870534718036652 (3.0627968683838844) | > loss_mel: 5.271450519561768 (13.378344774246216) | > loss_duration: 3.38454008102417 (3.405808687210083) | > loss_1: 17.148395538330078 (28.267959594726562)  --> STEP: 3 | > loss_disc: 2.7773897647857666 (2.7191124757130942) | > loss_disc_real_0: 0.16949039697647095 (0.2131316065788269) | > loss_disc_real_1: 0.2359093427658081 (0.2326779862244924) | > loss_disc_real_2: 0.2802693545818329 (0.26788396139939624) | > loss_disc_real_3: 0.32666081190109253 (0.2755540112654368) | > loss_disc_real_4: 0.36398279666900635 (0.2763345887263616) | > loss_disc_real_5: 0.22305534780025482 (0.22703869144121805) | > loss_0: 2.7773897647857666 (2.7191124757130942) | > loss_gen: 2.1284172534942627 (2.063891609509786) | > loss_kl: 2.9134132862091064 (5.230724414189656) | > loss_feat: 4.4039812088012695 (3.5098583151896796) | > loss_mel: 21.923892974853516 (16.226860841115315) | > loss_duration: 3.1312272548675537 (3.3142815430959067) | > loss_1: 34.50093078613281 (30.345616658528645) --> EVAL PERFORMANCE | > avg_loader_time: 0.009929498036702475 (+0.005416393280029298) | > avg_loss_disc: 2.7191124757130942 (+0.07060551643371582) | > avg_loss_disc_real_0: 0.2131316065788269 (+0.06198023756345114) | > avg_loss_disc_real_1: 0.2326779862244924 (-0.11639744043350217) | > avg_loss_disc_real_2: 0.26788396139939624 (+0.022204130887985202) | > avg_loss_disc_real_3: 0.2755540112654368 (-0.04391424854596454) | > avg_loss_disc_real_4: 0.2763345887263616 (-0.03855453431606293) | > avg_loss_disc_real_5: 0.22703869144121805 (-0.03864127397537234) | > avg_loss_0: 2.7191124757130942 (+0.07060551643371582) | > avg_loss_gen: 2.063891609509786 (-0.3295901219050088) | > avg_loss_kl: 5.230724414189656 (+0.028392712275186582) | > avg_loss_feat: 3.5098583151896796 (-0.7444919496774669) | > avg_loss_mel: 16.226860841115315 (-6.596706231435142) | > avg_loss_duration: 3.3142815430959067 (-0.03770049413045218) | > avg_loss_1: 30.345616658528645 (-7.680096944173176)  > EPOCH: 1348/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:26:34)   --> TIME: 2023-10-20 17:26:54 -- STEP: 19/50 -- GLOBAL_STEP: 120420 | > loss_disc: 2.7029733657836914 (2.352549044709457) | > loss_disc_real_0: 0.08254014700651169 (0.11885390393926121) | > loss_disc_real_1: 0.3108718693256378 (0.20851083786079758) | > loss_disc_real_2: 0.22846513986587524 (0.2306359976922211) | > loss_disc_real_3: 0.28619053959846497 (0.22679242432901733) | > loss_disc_real_4: 0.25993797183036804 (0.20780245371555028) | > loss_disc_real_5: 0.338966429233551 (0.23145408300977005) | > loss_0: 2.7029733657836914 (2.352549044709457) | > grad_norm_0: tensor(480.8402, device='cuda:0') (tensor(556.1475, device='cuda:0')) | > loss_gen: 2.0133228302001953 (2.3615782762828625) | > loss_kl: 0.9228076934814453 (0.7744732577549783) | > loss_feat: 1.7687711715698242 (6.083945333173401) | > loss_mel: 17.721981048583984 (20.036520675608987) | > loss_duration: 1.3772666454315186 (1.3369090808065314) | > loss_1: 23.804147720336914 (30.59342670440674) | > grad_norm_1: tensor(3117.8792, device='cuda:0') (tensor(14612.3721, device='cuda:0')) | > current_lr_0: 5.194747487477733e-05 | > current_lr_1: 5.199945158228611e-05 | > step_time: 0.5058 (0.6400695725491172) | > loader_time: 0.0316 (0.021137074420326633)  --> TIME: 2023-10-20 17:27:10 -- STEP: 49/50 -- GLOBAL_STEP: 120450 | > loss_disc: 2.0066285133361816 (2.4400886370211237) | > loss_disc_real_0: 0.06274040788412094 (0.14847680858849563) | > loss_disc_real_1: 0.23980630934238434 (0.21875642475729085) | > loss_disc_real_2: 0.19541160762310028 (0.22348191539699935) | > loss_disc_real_3: 0.1569201946258545 (0.2378003330407094) | > loss_disc_real_4: 0.1852775663137436 (0.21688334628635522) | > loss_disc_real_5: 0.24516558647155762 (0.2355328342896335) | > loss_0: 2.0066285133361816 (2.4400886370211237) | > grad_norm_0: tensor(269.3943, device='cuda:0') (tensor(630.7074, device='cuda:0')) | > loss_gen: 2.739828586578369 (2.269329075910608) | > loss_kl: 0.6476891040802002 (0.8546223153873366) | > loss_feat: 7.124845504760742 (5.217491047836994) | > loss_mel: 20.88808822631836 (19.40241296194037) | > loss_duration: 1.4508450031280518 (1.294501777814359) | > loss_1: 32.851295471191406 (29.038357189723424) | > grad_norm_1: tensor(20725.3984, device='cuda:0') (tensor(14417.9307, device='cuda:0')) | > current_lr_0: 5.194747487477733e-05 | > current_lr_1: 5.199945158228611e-05 | > step_time: 0.6545 (0.5593488800282379) | > loader_time: 0.4106 (0.027925535124175404)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.377380132675171 (2.377380132675171) | > loss_disc_real_0: 0.28937894105911255 (0.28937894105911255) | > loss_disc_real_1: 0.22858190536499023 (0.22858190536499023) | > loss_disc_real_2: 0.2614955008029938 (0.2614955008029938) | > loss_disc_real_3: 0.20023368299007416 (0.20023368299007416) | > loss_disc_real_4: 0.14504016935825348 (0.14504016935825348) | > loss_disc_real_5: 0.1093350425362587 (0.1093350425362587) | > loss_0: 2.377380132675171 (2.377380132675171) | > loss_gen: 2.2124922275543213 (2.2124922275543213) | > loss_kl: 6.300207138061523 (6.300207138061523) | > loss_feat: 4.347044467926025 (4.347044467926025) | > loss_mel: 19.84174156188965 (19.84174156188965) | > loss_duration: 3.2026267051696777 (3.2026267051696777) | > loss_1: 35.904109954833984 (35.904109954833984)  --> STEP: 1 | > loss_disc: 3.4459004402160645 (3.4459004402160645) | > loss_disc_real_0: 0.7803456783294678 (0.7803456783294678) | > loss_disc_real_1: 0.3596665859222412 (0.3596665859222412) | > loss_disc_real_2: 0.34790679812431335 (0.34790679812431335) | > loss_disc_real_3: 0.21738888323307037 (0.21738888323307037) | > loss_disc_real_4: 0.30489856004714966 (0.30489856004714966) | > loss_disc_real_5: 0.3605337142944336 (0.3605337142944336) | > loss_0: 3.4459004402160645 (3.4459004402160645) | > loss_gen: 2.3440473079681396 (2.3440473079681396) | > loss_kl: 5.323092937469482 (5.323092937469482) | > loss_feat: 5.842188835144043 (5.842188835144043) | > loss_mel: 23.817943572998047 (23.817943572998047) | > loss_duration: 3.4169368743896484 (3.4169368743896484) | > loss_1: 40.74420928955078 (40.74420928955078)  --> STEP: 2 | > loss_disc: 3.2585740089416504 (3.3522372245788574) | > loss_disc_real_0: 0.37044915556907654 (0.5753974169492722) | > loss_disc_real_1: 0.2704053819179535 (0.31503598392009735) | > loss_disc_real_2: 0.3676918148994446 (0.35779930651187897) | > loss_disc_real_3: 0.30468153953552246 (0.2610352113842964) | > loss_disc_real_4: 0.27880460023880005 (0.29185158014297485) | > loss_disc_real_5: 0.37214961647987366 (0.3663416653871536) | > loss_0: 3.2585740089416504 (3.3522372245788574) | > loss_gen: 2.029776096343994 (2.186911702156067) | > loss_kl: 6.3847270011901855 (5.853909969329834) | > loss_feat: 3.923088312149048 (4.882638573646545) | > loss_mel: 26.497499465942383 (25.157721519470215) | > loss_duration: 3.417799711227417 (3.4173682928085327) | > loss_1: 42.252891540527344 (41.49855041503906)  --> STEP: 3 | > loss_disc: 2.9987246990203857 (3.2343997160593667) | > loss_disc_real_0: 0.22705060243606567 (0.4592818121115367) | > loss_disc_real_1: 0.2538316547870636 (0.29463454087575275) | > loss_disc_real_2: 0.27962663769721985 (0.3317417502403259) | > loss_disc_real_3: 0.2671167850494385 (0.26306240260601044) | > loss_disc_real_4: 0.24861262738704681 (0.27743859589099884) | > loss_disc_real_5: 0.2628670036792755 (0.3318501114845276) | > loss_0: 2.9987246990203857 (3.2343997160593667) | > loss_gen: 1.5441745519638062 (1.9726659854253132) | > loss_kl: 2.9242424964904785 (4.877354145050049) | > loss_feat: 0.02729068323969841 (3.264189276844263) | > loss_mel: 1.7746831178665161 (17.363375385602314) | > loss_duration: 3.0847673416137695 (3.306501309076945) | > loss_1: 9.355157852172852 (30.784086227416992) --> EVAL PERFORMANCE | > avg_loader_time: 0.014931996663411459 (+0.005002498626708984) | > avg_loss_disc: 3.2343997160593667 (+0.5152872403462725) | > avg_loss_disc_real_0: 0.4592818121115367 (+0.24615020553270978) | > avg_loss_disc_real_1: 0.29463454087575275 (+0.06195655465126035) | > avg_loss_disc_real_2: 0.3317417502403259 (+0.06385778884092969) | > avg_loss_disc_real_3: 0.26306240260601044 (-0.01249160865942639) | > avg_loss_disc_real_4: 0.27743859589099884 (+0.0011040071646372662) | > avg_loss_disc_real_5: 0.3318501114845276 (+0.10481142004330954) | > avg_loss_0: 3.2343997160593667 (+0.5152872403462725) | > avg_loss_gen: 1.9726659854253132 (-0.09122562408447288) | > avg_loss_kl: 4.877354145050049 (-0.35337026913960745) | > avg_loss_feat: 3.264189276844263 (-0.24566903834541653) | > avg_loss_mel: 17.363375385602314 (+1.1365145444869995) | > avg_loss_duration: 3.306501309076945 (-0.007780234018961885) | > avg_loss_1: 30.784086227416992 (+0.43846956888834754)  > EPOCH: 1349/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:27:25)   --> TIME: 2023-10-20 17:27:46 -- STEP: 29/50 -- GLOBAL_STEP: 120480 | > loss_disc: 2.5684144496917725 (2.413845049923864) | > loss_disc_real_0: 0.22587339580059052 (0.12627055862083517) | > loss_disc_real_1: 0.18192003667354584 (0.21842943427377734) | > loss_disc_real_2: 0.19794850051403046 (0.23346099925452266) | > loss_disc_real_3: 0.33259207010269165 (0.22090179967726098) | > loss_disc_real_4: 0.34983643889427185 (0.2415784297767898) | > loss_disc_real_5: 0.23789598047733307 (0.22770225423677215) | > loss_0: 2.5684144496917725 (2.413845049923864) | > grad_norm_0: tensor(359.8579, device='cuda:0') (tensor(553.0859, device='cuda:0')) | > loss_gen: 2.491851329803467 (2.4758539035402496) | > loss_kl: 0.8831409215927124 (0.7965854837976653) | > loss_feat: 5.418262481689453 (7.1321183936349275) | > loss_mel: 20.55084991455078 (21.782478200978247) | > loss_duration: 1.3011633157730103 (1.2904076946192775) | > loss_1: 30.645267486572266 (33.47744336621515) | > grad_norm_1: tensor(3060.3757, device='cuda:0') (tensor(18378.1660, device='cuda:0')) | > current_lr_0: 5.1895550121241926e-05 | > current_lr_1: 5.194747487477733e-05 | > step_time: 0.7513 (0.5191359108891981) | > loader_time: 0.022 (0.01693820131236109)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8078088760375977 (2.8078088760375977) | > loss_disc_real_0: 0.16371145844459534 (0.16371145844459534) | > loss_disc_real_1: 0.2451632022857666 (0.2451632022857666) | > loss_disc_real_2: 0.22423195838928223 (0.22423195838928223) | > loss_disc_real_3: 0.22337332367897034 (0.22337332367897034) | > loss_disc_real_4: 0.2424098402261734 (0.2424098402261734) | > loss_disc_real_5: 0.2389780431985855 (0.2389780431985855) | > loss_0: 2.8078088760375977 (2.8078088760375977) | > loss_gen: 1.5487476587295532 (1.5487476587295532) | > loss_kl: 6.476180553436279 (6.476180553436279) | > loss_feat: 0.5742847919464111 (0.5742847919464111) | > loss_mel: 13.689449310302734 (13.689449310302734) | > loss_duration: 3.2936508655548096 (3.2936508655548096) | > loss_1: 25.582313537597656 (25.582313537597656)  --> STEP: 1 | > loss_disc: 2.7316083908081055 (2.7316083908081055) | > loss_disc_real_0: 0.16908790171146393 (0.16908790171146393) | > loss_disc_real_1: 0.23636364936828613 (0.23636364936828613) | > loss_disc_real_2: 0.21126925945281982 (0.21126925945281982) | > loss_disc_real_3: 0.22935877740383148 (0.22935877740383148) | > loss_disc_real_4: 0.22719505429267883 (0.22719505429267883) | > loss_disc_real_5: 0.28817474842071533 (0.28817474842071533) | > loss_0: 2.7316083908081055 (2.7316083908081055) | > loss_gen: 1.7608842849731445 (1.7608842849731445) | > loss_kl: 6.279473304748535 (6.279473304748535) | > loss_feat: 1.9856117963790894 (1.9856117963790894) | > loss_mel: 18.348468780517578 (18.348468780517578) | > loss_duration: 3.607300043106079 (3.607300043106079) | > loss_1: 31.981739044189453 (31.981739044189453)  --> STEP: 2 | > loss_disc: 2.9553537368774414 (2.8434810638427734) | > loss_disc_real_0: 0.1651255190372467 (0.16710671037435532) | > loss_disc_real_1: 0.33108842372894287 (0.2837260365486145) | > loss_disc_real_2: 0.4471679627895355 (0.3292186111211777) | > loss_disc_real_3: 0.30986377596855164 (0.26961127668619156) | > loss_disc_real_4: 0.5060014724731445 (0.3665982633829117) | > loss_disc_real_5: 0.4588050842285156 (0.3734899163246155) | > loss_0: 2.9553537368774414 (2.8434810638427734) | > loss_gen: 2.867380142211914 (2.3141322135925293) | > loss_kl: 6.621012210845947 (6.450242757797241) | > loss_feat: 6.917839050292969 (4.451725423336029) | > loss_mel: 22.477977752685547 (20.413223266601562) | > loss_duration: 3.5098211765289307 (3.558560609817505) | > loss_1: 42.3940315246582 (37.18788528442383)  --> STEP: 3 | > loss_disc: 2.771994113922119 (2.8196520805358887) | > loss_disc_real_0: 0.10717720538377762 (0.1471302087108294) | > loss_disc_real_1: 0.2496088594198227 (0.2723536441723506) | > loss_disc_real_2: 0.24339212477207184 (0.3006097823381424) | > loss_disc_real_3: 0.24012301862239838 (0.2597818573315938) | > loss_disc_real_4: 0.25252005457878113 (0.32857219378153485) | > loss_disc_real_5: 0.23847541213035583 (0.3284850815931956) | > loss_0: 2.771994113922119 (2.8196520805358887) | > loss_gen: 1.5960952043533325 (2.0747865438461304) | > loss_kl: 2.6886098384857178 (5.196365118026733) | > loss_feat: 0.7253473997116089 (3.209599415461222) | > loss_mel: 15.186551094055176 (18.6709992090861) | > loss_duration: 3.088010549545288 (3.401710589726766) | > loss_1: 23.28461456298828 (32.55346171061198) --> EVAL PERFORMANCE | > avg_loader_time: 0.019092400868733723 (+0.004160404205322264) | > avg_loss_disc: 2.8196520805358887 (-0.41474763552347804) | > avg_loss_disc_real_0: 0.1471302087108294 (-0.31215160340070724) | > avg_loss_disc_real_1: 0.2723536441723506 (-0.022280896703402164) | > avg_loss_disc_real_2: 0.3006097823381424 (-0.031131967902183533) | > avg_loss_disc_real_3: 0.2597818573315938 (-0.003280545274416624) | > avg_loss_disc_real_4: 0.32857219378153485 (+0.05113359789053601) | > avg_loss_disc_real_5: 0.3284850815931956 (-0.003365029891331972) | > avg_loss_0: 2.8196520805358887 (-0.41474763552347804) | > avg_loss_gen: 2.0747865438461304 (+0.10212055842081713) | > avg_loss_kl: 5.196365118026733 (+0.31901097297668457) | > avg_loss_feat: 3.209599415461222 (-0.054589861383040894) | > avg_loss_mel: 18.6709992090861 (+1.3076238234837874) | > avg_loss_duration: 3.401710589726766 (+0.09520928064982126) | > avg_loss_1: 32.55346171061198 (+1.7693754831949846)  > EPOCH: 1350/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:28:14)   --> TIME: 2023-10-20 17:28:25 -- STEP: 9/50 -- GLOBAL_STEP: 120510 | > loss_disc: 2.715487241744995 (2.289780537287394) | > loss_disc_real_0: 0.08189201354980469 (0.10350748399893443) | > loss_disc_real_1: 0.2704571485519409 (0.2066631420618958) | > loss_disc_real_2: 0.18894147872924805 (0.26213309086031383) | > loss_disc_real_3: 0.24380995333194733 (0.22125150677230623) | > loss_disc_real_4: 0.23620152473449707 (0.22797205588883823) | > loss_disc_real_5: 0.2215995043516159 (0.20351264625787735) | > loss_0: 2.715487241744995 (2.289780537287394) | > grad_norm_0: tensor(886.9379, device='cuda:0') (tensor(615.4982, device='cuda:0')) | > loss_gen: 1.6726255416870117 (2.63861702548133) | > loss_kl: 0.6798173785209656 (0.8807521065076193) | > loss_feat: 1.0659979581832886 (7.157167567147149) | > loss_mel: 17.52968406677246 (21.497498406304253) | > loss_duration: 1.2970679998397827 (1.3174799813164606) | > loss_1: 22.24519157409668 (33.49151462978787) | > grad_norm_1: tensor(7737.3213, device='cuda:0') (tensor(35550.1250, device='cuda:0')) | > current_lr_0: 5.184367726974866e-05 | > current_lr_1: 5.1895550121241926e-05 | > step_time: 0.6416 (0.6218605041503906) | > loader_time: 0.0297 (0.022862672805786133)  --> TIME: 2023-10-20 17:28:45 -- STEP: 39/50 -- GLOBAL_STEP: 120540 | > loss_disc: 3.0045955181121826 (2.5511933167775473) | > loss_disc_real_0: 0.18070071935653687 (0.15701722821746117) | > loss_disc_real_1: 0.2655562162399292 (0.22446759646901718) | > loss_disc_real_2: 0.24926984310150146 (0.23541799512429115) | > loss_disc_real_3: 0.2743147313594818 (0.24068399862601206) | > loss_disc_real_4: 0.26417508721351624 (0.2353462063922332) | > loss_disc_real_5: 0.2517096996307373 (0.22182185928790998) | > loss_0: 3.0045955181121826 (2.5511933167775473) | > grad_norm_0: tensor(1030.8352, device='cuda:0') (tensor(726.5130, device='cuda:0')) | > loss_gen: 1.5581371784210205 (2.1521278191835447) | > loss_kl: 0.5289138555526733 (0.834241828857324) | > loss_feat: 0.04181801900267601 (4.809549946146897) | > loss_mel: 1.3597276210784912 (17.17869734764099) | > loss_duration: 1.371584177017212 (1.291922709880731) | > loss_1: 4.860180854797363 (26.266539671482185) | > grad_norm_1: tensor(34093.4727, device='cuda:0') (tensor(22091.0410, device='cuda:0')) | > current_lr_0: 5.184367726974866e-05 | > current_lr_1: 5.1895550121241926e-05 | > step_time: 0.6988 (0.625387619703244) | > loader_time: 0.0272 (0.024711816738813352)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1379637718200684 (3.1379637718200684) | > loss_disc_real_0: 0.3181653618812561 (0.3181653618812561) | > loss_disc_real_1: 0.2630314230918884 (0.2630314230918884) | > loss_disc_real_2: 0.26315903663635254 (0.26315903663635254) | > loss_disc_real_3: 0.22338686883449554 (0.22338686883449554) | > loss_disc_real_4: 0.22008153796195984 (0.22008153796195984) | > loss_disc_real_5: 0.5676774382591248 (0.5676774382591248) | > loss_0: 3.1379637718200684 (3.1379637718200684) | > loss_gen: 2.085113048553467 (2.085113048553467) | > loss_kl: 6.188547611236572 (6.188547611236572) | > loss_feat: 5.593367576599121 (5.593367576599121) | > loss_mel: 22.708232879638672 (22.708232879638672) | > loss_duration: 3.075263738632202 (3.075263738632202) | > loss_1: 39.65052795410156 (39.65052795410156)  --> STEP: 1 | > loss_disc: 2.7790589332580566 (2.7790589332580566) | > loss_disc_real_0: 0.3449978828430176 (0.3449978828430176) | > loss_disc_real_1: 0.28820499777793884 (0.28820499777793884) | > loss_disc_real_2: 0.407036691904068 (0.407036691904068) | > loss_disc_real_3: 0.14387448132038116 (0.14387448132038116) | > loss_disc_real_4: 0.2802793085575104 (0.2802793085575104) | > loss_disc_real_5: 0.22576838731765747 (0.22576838731765747) | > loss_0: 2.7790589332580566 (2.7790589332580566) | > loss_gen: 2.562647581100464 (2.562647581100464) | > loss_kl: 5.62165641784668 (5.62165641784668) | > loss_feat: 5.978359699249268 (5.978359699249268) | > loss_mel: 24.085878372192383 (24.085878372192383) | > loss_duration: 3.4192206859588623 (3.4192206859588623) | > loss_1: 41.667762756347656 (41.667762756347656)  --> STEP: 2 | > loss_disc: 2.421050786972046 (2.6000548601150513) | > loss_disc_real_0: 0.25963491201400757 (0.3023163974285126) | > loss_disc_real_1: 0.09799838066101074 (0.1931016892194748) | > loss_disc_real_2: 0.2500624358654022 (0.3285495638847351) | > loss_disc_real_3: 0.12215026468038559 (0.13301237300038338) | > loss_disc_real_4: 0.10064008831977844 (0.1904596984386444) | > loss_disc_real_5: 0.13097138702869415 (0.1783698871731758) | > loss_0: 2.421050786972046 (2.6000548601150513) | > loss_gen: 2.033940553665161 (2.2982940673828125) | > loss_kl: 6.668663501739502 (6.145159959793091) | > loss_feat: 8.349279403686523 (7.1638195514678955) | > loss_mel: 26.699724197387695 (25.39280128479004) | > loss_duration: 3.511711597442627 (3.4654661417007446) | > loss_1: 47.2633171081543 (44.46553993225098)  --> STEP: 3 | > loss_disc: 2.5348496437072754 (2.578319787979126) | > loss_disc_real_0: 0.4033238887786865 (0.33598556121190387) | > loss_disc_real_1: 0.3286551833152771 (0.2382861872514089) | > loss_disc_real_2: 0.21646234393119812 (0.2911871572335561) | > loss_disc_real_3: 0.2540581524372101 (0.17336096614599228) | > loss_disc_real_4: 0.2816046178340912 (0.22084133823712668) | > loss_disc_real_5: 0.13486704230308533 (0.16386893888314566) | > loss_0: 2.5348496437072754 (2.578319787979126) | > loss_gen: 2.6112890243530273 (2.4026257197062173) | > loss_kl: 2.886033773422241 (5.058784564336141) | > loss_feat: 5.684069633483887 (6.6705695788065595) | > loss_mel: 20.627689361572266 (23.80443064371745) | > loss_duration: 3.1261091232299805 (3.3523471355438232) | > loss_1: 34.9351921081543 (41.28875732421875) --> EVAL PERFORMANCE | > avg_loader_time: 0.007845004399617514 (-0.01124739646911621) | > avg_loss_disc: 2.578319787979126 (-0.2413322925567627) | > avg_loss_disc_real_0: 0.33598556121190387 (+0.18885535250107446) | > avg_loss_disc_real_1: 0.2382861872514089 (-0.03406745692094168) | > avg_loss_disc_real_2: 0.2911871572335561 (-0.009422625104586302) | > avg_loss_disc_real_3: 0.17336096614599228 (-0.08642089118560153) | > avg_loss_disc_real_4: 0.22084133823712668 (-0.10773085554440817) | > avg_loss_disc_real_5: 0.16386893888314566 (-0.16461614271004996) | > avg_loss_0: 2.578319787979126 (-0.2413322925567627) | > avg_loss_gen: 2.4026257197062173 (+0.32783917586008693) | > avg_loss_kl: 5.058784564336141 (-0.13758055369059274) | > avg_loss_feat: 6.6705695788065595 (+3.4609701633453374) | > avg_loss_mel: 23.80443064371745 (+5.133431434631348) | > avg_loss_duration: 3.3523471355438232 (-0.049363454182942856) | > avg_loss_1: 41.28875732421875 (+8.735295613606773)  > EPOCH: 1351/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:29:06)   --> TIME: 2023-10-20 17:29:24 -- STEP: 19/50 -- GLOBAL_STEP: 120570 | > loss_disc: 2.1299216747283936 (2.467637256572121) | > loss_disc_real_0: 0.11674503237009048 (0.11865695330657455) | > loss_disc_real_1: 0.1846178025007248 (0.2063732770712752) | > loss_disc_real_2: 0.18626396358013153 (0.224175497301315) | > loss_disc_real_3: 0.11632705479860306 (0.225497147754619) | > loss_disc_real_4: 0.2137880027294159 (0.21368495178850075) | > loss_disc_real_5: 0.19888173043727875 (0.22891011236137465) | > loss_0: 2.1299216747283936 (2.467637256572121) | > grad_norm_0: tensor(259.0818, device='cuda:0') (tensor(574.2299, device='cuda:0')) | > loss_gen: 2.47906231880188 (2.169500150178608) | > loss_kl: 1.0731921195983887 (0.8105063014908841) | > loss_feat: 6.616037845611572 (6.162274791123836) | > loss_mel: 21.58155632019043 (19.811387764780147) | > loss_duration: 1.379576325416565 (1.3204334095904702) | > loss_1: 33.129425048828125 (30.274101709064684) | > grad_norm_1: tensor(4598.7300, device='cuda:0') (tensor(27711.2793, device='cuda:0')) | > current_lr_0: 5.1791856268418176e-05 | > current_lr_1: 5.184367726974866e-05 | > step_time: 0.3405 (0.6581914048445853) | > loader_time: 0.0028 (0.022874380412854646)  --> TIME: 2023-10-20 17:29:36 -- STEP: 49/50 -- GLOBAL_STEP: 120600 | > loss_disc: 2.109800100326538 (2.5378789123223746) | > loss_disc_real_0: 0.08323920518159866 (0.13889377267689118) | > loss_disc_real_1: 0.11800643056631088 (0.22588889787391742) | > loss_disc_real_2: 0.18332406878471375 (0.23280703451256363) | > loss_disc_real_3: 0.2766374945640564 (0.2460048997736707) | > loss_disc_real_4: 0.27152132987976074 (0.24774892658603434) | > loss_disc_real_5: 0.3384386897087097 (0.23728962322430952) | > loss_0: 2.109800100326538 (2.5378789123223746) | > grad_norm_0: tensor(392.7412, device='cuda:0') (tensor(620.4500, device='cuda:0')) | > loss_gen: 2.5721051692962646 (2.192205871854509) | > loss_kl: 1.1957006454467773 (0.793393400250649) | > loss_feat: 4.298884391784668 (5.639477605608349) | > loss_mel: 21.68415069580078 (19.87150959579313) | > loss_duration: 1.3986314535140991 (1.2831533368752928) | > loss_1: 31.149473190307617 (29.779739778869008) | > grad_norm_1: tensor(5734.2832, device='cuda:0') (tensor(19472.7461, device='cuda:0')) | > current_lr_0: 5.1791856268418176e-05 | > current_lr_1: 5.184367726974866e-05 | > step_time: 0.2898 (0.4720402201827692) | > loader_time: 0.3844 (0.02099644894502601)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9805638790130615 (2.9805638790130615) | > loss_disc_real_0: 0.04638171195983887 (0.04638171195983887) | > loss_disc_real_1: 0.27400922775268555 (0.27400922775268555) | > loss_disc_real_2: 0.2732025384902954 (0.2732025384902954) | > loss_disc_real_3: 0.2657169997692108 (0.2657169997692108) | > loss_disc_real_4: 0.26246097683906555 (0.26246097683906555) | > loss_disc_real_5: 0.23674486577510834 (0.23674486577510834) | > loss_0: 2.9805638790130615 (2.9805638790130615) | > loss_gen: 1.431630253791809 (1.431630253791809) | > loss_kl: 7.280126571655273 (7.280126571655273) | > loss_feat: 0.40109190344810486 (0.40109190344810486) | > loss_mel: 15.080530166625977 (15.080530166625977) | > loss_duration: 3.190457820892334 (3.190457820892334) | > loss_1: 27.383838653564453 (27.383838653564453)  --> STEP: 1 | > loss_disc: 2.6538519859313965 (2.6538519859313965) | > loss_disc_real_0: 0.2894018292427063 (0.2894018292427063) | > loss_disc_real_1: 0.26967716217041016 (0.26967716217041016) | > loss_disc_real_2: 0.20944230258464813 (0.20944230258464813) | > loss_disc_real_3: 0.2930280268192291 (0.2930280268192291) | > loss_disc_real_4: 0.21655985713005066 (0.21655985713005066) | > loss_disc_real_5: 0.2413490116596222 (0.2413490116596222) | > loss_0: 2.6538519859313965 (2.6538519859313965) | > loss_gen: 2.1282119750976562 (2.1282119750976562) | > loss_kl: 6.072126865386963 (6.072126865386963) | > loss_feat: 5.592284679412842 (5.592284679412842) | > loss_mel: 21.488943099975586 (21.488943099975586) | > loss_duration: 3.567121744155884 (3.567121744155884) | > loss_1: 38.848690032958984 (38.848690032958984)  --> STEP: 2 | > loss_disc: 3.0593719482421875 (2.856611967086792) | > loss_disc_real_0: 0.6163539886474609 (0.4528779089450836) | > loss_disc_real_1: 0.21632759273052216 (0.24300237745046616) | > loss_disc_real_2: 0.2153763622045517 (0.21240933239459991) | > loss_disc_real_3: 0.17735110223293304 (0.23518956452608109) | > loss_disc_real_4: 0.4227772355079651 (0.3196685463190079) | > loss_disc_real_5: 0.3484174907207489 (0.29488325119018555) | > loss_0: 3.0593719482421875 (2.856611967086792) | > loss_gen: 2.800009250640869 (2.4641106128692627) | > loss_kl: 6.462497234344482 (6.267312049865723) | > loss_feat: 9.080432891845703 (7.3363587856292725) | > loss_mel: 21.491527557373047 (21.490235328674316) | > loss_duration: 3.3578298091888428 (3.4624757766723633) | > loss_1: 43.192298889160156 (41.02049446105957)  --> STEP: 3 | > loss_disc: 2.324570894241333 (2.679264942804972) | > loss_disc_real_0: 0.10004454106092453 (0.3352667863170306) | > loss_disc_real_1: 0.2100522667169571 (0.23201900720596313) | > loss_disc_real_2: 0.19574685394763947 (0.20685517291227976) | > loss_disc_real_3: 0.18643857538700104 (0.2189392348130544) | > loss_disc_real_4: 0.15932418406009674 (0.2662204255660375) | > loss_disc_real_5: 0.10752786695957184 (0.23243145644664764) | > loss_0: 2.324570894241333 (2.679264942804972) | > loss_gen: 1.8471019268035889 (2.2584410508473716) | > loss_kl: 3.2205841541290283 (5.251736084620158) | > loss_feat: 4.181938171386719 (6.284885247548421) | > loss_mel: 17.738414764404297 (20.239628473917644) | > loss_duration: 3.190309762954712 (3.371753772099813) | > loss_1: 30.178348541259766 (37.406445821126304) --> EVAL PERFORMANCE | > avg_loader_time: 0.002914985020955404 (-0.004930019378662109) | > avg_loss_disc: 2.679264942804972 (+0.1009451548258462) | > avg_loss_disc_real_0: 0.3352667863170306 (-0.0007187748948732642) | > avg_loss_disc_real_1: 0.23201900720596313 (-0.006267180045445769) | > avg_loss_disc_real_2: 0.20685517291227976 (-0.08433198432127634) | > avg_loss_disc_real_3: 0.2189392348130544 (+0.04557826866706213) | > avg_loss_disc_real_4: 0.2662204255660375 (+0.0453790873289108) | > avg_loss_disc_real_5: 0.23243145644664764 (+0.06856251756350198) | > avg_loss_0: 2.679264942804972 (+0.1009451548258462) | > avg_loss_gen: 2.2584410508473716 (-0.14418466885884573) | > avg_loss_kl: 5.251736084620158 (+0.19295152028401752) | > avg_loss_feat: 6.284885247548421 (-0.3856843312581386) | > avg_loss_mel: 20.239628473917644 (-3.5648021697998047) | > avg_loss_duration: 3.371753772099813 (+0.01940663655598973) | > avg_loss_1: 37.406445821126304 (-3.8823115030924455)  > EPOCH: 1352/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:29:49)   --> TIME: 2023-10-20 17:30:14 -- STEP: 29/50 -- GLOBAL_STEP: 120630 | > loss_disc: 2.7143235206604004 (2.5679590743163536) | > loss_disc_real_0: 0.16220174729824066 (0.1534343058692998) | > loss_disc_real_1: 0.10299956053495407 (0.23449392411215556) | > loss_disc_real_2: 0.24969594180583954 (0.22437746553071614) | > loss_disc_real_3: 0.32624727487564087 (0.2430189754171618) | > loss_disc_real_4: 0.3082188367843628 (0.22813015456857352) | > loss_disc_real_5: 0.1975230872631073 (0.22124899127360048) | > loss_0: 2.7143235206604004 (2.5679590743163536) | > grad_norm_0: tensor(285.4746, device='cuda:0') (tensor(582.0802, device='cuda:0')) | > loss_gen: 1.9175115823745728 (2.113538799614742) | > loss_kl: 0.6119587421417236 (0.8507087374555653) | > loss_feat: 5.4024200439453125 (4.840437296392588) | > loss_mel: 19.618606567382812 (18.780318001220966) | > loss_duration: 1.247870922088623 (1.298386964304694) | > loss_1: 28.79836654663086 (27.883389768929316) | > grad_norm_1: tensor(3398.9636, device='cuda:0') (tensor(17278.1172, device='cuda:0')) | > current_lr_0: 5.174008706542301e-05 | > current_lr_1: 5.1791856268418176e-05 | > step_time: 0.8341 (0.6379000236248148) | > loader_time: 0.0337 (0.02571079648774246)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5660367012023926 (2.5660367012023926) | > loss_disc_real_0: 0.17070230841636658 (0.17070230841636658) | > loss_disc_real_1: 0.1824309080839157 (0.1824309080839157) | > loss_disc_real_2: 0.2348589152097702 (0.2348589152097702) | > loss_disc_real_3: 0.3610655665397644 (0.3610655665397644) | > loss_disc_real_4: 0.18708667159080505 (0.18708667159080505) | > loss_disc_real_5: 0.2964232563972473 (0.2964232563972473) | > loss_0: 2.5660367012023926 (2.5660367012023926) | > loss_gen: 2.0743019580841064 (2.0743019580841064) | > loss_kl: 6.704446792602539 (6.704446792602539) | > loss_feat: 4.038512706756592 (4.038512706756592) | > loss_mel: 23.05801010131836 (23.05801010131836) | > loss_duration: 3.277900457382202 (3.277900457382202) | > loss_1: 39.153175354003906 (39.153175354003906)  --> STEP: 1 | > loss_disc: 2.792557954788208 (2.792557954788208) | > loss_disc_real_0: 0.34064415097236633 (0.34064415097236633) | > loss_disc_real_1: 0.3056385815143585 (0.3056385815143585) | > loss_disc_real_2: 0.37387505173683167 (0.37387505173683167) | > loss_disc_real_3: 0.2957412898540497 (0.2957412898540497) | > loss_disc_real_4: 0.29834821820259094 (0.29834821820259094) | > loss_disc_real_5: 0.41946208477020264 (0.41946208477020264) | > loss_0: 2.792557954788208 (2.792557954788208) | > loss_gen: 2.9108269214630127 (2.9108269214630127) | > loss_kl: 6.339364051818848 (6.339364051818848) | > loss_feat: 4.90983772277832 (4.90983772277832) | > loss_mel: 22.03647804260254 (22.03647804260254) | > loss_duration: 3.574551820755005 (3.574551820755005) | > loss_1: 39.77105712890625 (39.77105712890625)  --> STEP: 2 | > loss_disc: 2.8736541271209717 (2.83310604095459) | > loss_disc_real_0: 0.2254486382007599 (0.2830463945865631) | > loss_disc_real_1: 0.2911929488182068 (0.29841576516628265) | > loss_disc_real_2: 0.3614881932735443 (0.367681622505188) | > loss_disc_real_3: 0.3271767795085907 (0.3114590346813202) | > loss_disc_real_4: 0.2976386845111847 (0.2979934513568878) | > loss_disc_real_5: 0.3556673526763916 (0.3875647187232971) | > loss_0: 2.8736541271209717 (2.83310604095459) | > loss_gen: 2.2085399627685547 (2.5596834421157837) | > loss_kl: 6.320356369018555 (6.329860210418701) | > loss_feat: 3.071377754211426 (3.990607738494873) | > loss_mel: 25.465240478515625 (23.750859260559082) | > loss_duration: 3.2904303073883057 (3.4324910640716553) | > loss_1: 40.3559455871582 (40.06350135803223)  --> STEP: 3 | > loss_disc: 2.5397372245788574 (2.735316435496012) | > loss_disc_real_0: 0.2303277552127838 (0.26547351479530334) | > loss_disc_real_1: 0.3322142958641052 (0.3096819420655568) | > loss_disc_real_2: 0.41556262969970703 (0.38364195823669434) | > loss_disc_real_3: 0.3657304346561432 (0.32954950133959454) | > loss_disc_real_4: 0.2855876088142395 (0.2938581705093384) | > loss_disc_real_5: 0.33933714032173157 (0.3714888592561086) | > loss_0: 2.5397372245788574 (2.735316435496012) | > loss_gen: 3.1407384872436523 (2.7533684571584067) | > loss_kl: 3.160970687866211 (5.273563702901204) | > loss_feat: 4.636049270629883 (4.20575491587321) | > loss_mel: 22.02125358581543 (23.17432403564453) | > loss_duration: 3.202861785888672 (3.355947971343994) | > loss_1: 36.16187286376953 (38.76295852661133) --> EVAL PERFORMANCE | > avg_loader_time: 0.011022647221883139 (+0.008107662200927734) | > avg_loss_disc: 2.735316435496012 (+0.05605149269104004) | > avg_loss_disc_real_0: 0.26547351479530334 (-0.06979327152172726) | > avg_loss_disc_real_1: 0.3096819420655568 (+0.07766293485959369) | > avg_loss_disc_real_2: 0.38364195823669434 (+0.17678678532441458) | > avg_loss_disc_real_3: 0.32954950133959454 (+0.11061026652654013) | > avg_loss_disc_real_4: 0.2938581705093384 (+0.0276377449433009) | > avg_loss_disc_real_5: 0.3714888592561086 (+0.13905740280946094) | > avg_loss_0: 2.735316435496012 (+0.05605149269104004) | > avg_loss_gen: 2.7533684571584067 (+0.49492740631103516) | > avg_loss_kl: 5.273563702901204 (+0.021827618281045957) | > avg_loss_feat: 4.20575491587321 (-2.079130331675211) | > avg_loss_mel: 23.17432403564453 (+2.934695561726887) | > avg_loss_duration: 3.355947971343994 (-0.015805800755818833) | > avg_loss_1: 38.76295852661133 (+1.3565127054850237)  > EPOCH: 1353/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:30:43)   --> TIME: 2023-10-20 17:30:54 -- STEP: 9/50 -- GLOBAL_STEP: 120660 | > loss_disc: 2.9015398025512695 (2.6061968670950995) | > loss_disc_real_0: 0.17988617718219757 (0.1990478452708986) | > loss_disc_real_1: 0.25398123264312744 (0.25812913477420807) | > loss_disc_real_2: 0.26103854179382324 (0.26293323354588616) | > loss_disc_real_3: 0.2560828626155853 (0.2679835847682423) | > loss_disc_real_4: 0.27172958850860596 (0.2350313522749477) | > loss_disc_real_5: 0.2954796552658081 (0.27154714862505597) | > loss_0: 2.9015398025512695 (2.6061968670950995) | > grad_norm_0: tensor(587.5046, device='cuda:0') (tensor(763.6703, device='cuda:0')) | > loss_gen: 1.6561620235443115 (2.258520245552063) | > loss_kl: 0.8329060673713684 (0.79100701212883) | > loss_feat: 0.3426116704940796 (5.027821314003733) | > loss_mel: 14.507970809936523 (19.211741871303982) | > loss_duration: 1.2876228094100952 (1.2903980281617906) | > loss_1: 18.627273559570312 (28.579488542344833) | > grad_norm_1: tensor(20137.6445, device='cuda:0') (tensor(12172.7314, device='cuda:0')) | > current_lr_0: 5.168836960898747e-05 | > current_lr_1: 5.174008706542301e-05 | > step_time: 1.4924 (0.5926888783772787) | > loader_time: 0.0325 (0.018555323282877605)  --> TIME: 2023-10-20 17:31:13 -- STEP: 39/50 -- GLOBAL_STEP: 120690 | > loss_disc: 2.9908089637756348 (2.470031504447643) | > loss_disc_real_0: 0.12278790771961212 (0.1604288806422399) | > loss_disc_real_1: 0.2688184678554535 (0.22732812892167997) | > loss_disc_real_2: 0.18871423602104187 (0.22154882177710533) | > loss_disc_real_3: 0.2750490605831146 (0.2438094305495421) | > loss_disc_real_4: 0.27624186873435974 (0.23341035183805686) | > loss_disc_real_5: 0.25442829728126526 (0.24596405793458986) | > loss_0: 2.9908089637756348 (2.470031504447643) | > grad_norm_0: tensor(1011.9473, device='cuda:0') (tensor(675.2227, device='cuda:0')) | > loss_gen: 1.4886713027954102 (2.2747339224204044) | > loss_kl: 0.418171763420105 (0.7818259329367907) | > loss_feat: 0.3604634404182434 (5.628014973340889) | > loss_mel: 7.183309555053711 (20.523036599159237) | > loss_duration: 1.3831052780151367 (1.2767134935427937) | > loss_1: 10.833721160888672 (30.484324895418595) | > grad_norm_1: tensor(53660.5195, device='cuda:0') (tensor(18370.9688, device='cuda:0')) | > current_lr_0: 5.168836960898747e-05 | > current_lr_1: 5.174008706542301e-05 | > step_time: 0.8058 (0.62446849162762) | > loader_time: 0.0335 (0.021097140434460763)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7950034141540527 (2.7950034141540527) | > loss_disc_real_0: 0.4482980966567993 (0.4482980966567993) | > loss_disc_real_1: 0.29073983430862427 (0.29073983430862427) | > loss_disc_real_2: 0.28422045707702637 (0.28422045707702637) | > loss_disc_real_3: 0.19828487932682037 (0.19828487932682037) | > loss_disc_real_4: 0.2721808850765228 (0.2721808850765228) | > loss_disc_real_5: 0.2849690020084381 (0.2849690020084381) | > loss_0: 2.7950034141540527 (2.7950034141540527) | > loss_gen: 2.299161672592163 (2.299161672592163) | > loss_kl: 6.280572891235352 (6.280572891235352) | > loss_feat: 8.592351913452148 (8.592351913452148) | > loss_mel: 24.845256805419922 (24.845256805419922) | > loss_duration: 3.2032833099365234 (3.2032833099365234) | > loss_1: 45.22062683105469 (45.22062683105469)  --> STEP: 1 | > loss_disc: 2.8493452072143555 (2.8493452072143555) | > loss_disc_real_0: 0.17504660785198212 (0.17504660785198212) | > loss_disc_real_1: 0.33285051584243774 (0.33285051584243774) | > loss_disc_real_2: 0.39479267597198486 (0.39479267597198486) | > loss_disc_real_3: 0.21706326305866241 (0.21706326305866241) | > loss_disc_real_4: 0.18240368366241455 (0.18240368366241455) | > loss_disc_real_5: 0.21592600643634796 (0.21592600643634796) | > loss_0: 2.8493452072143555 (2.8493452072143555) | > loss_gen: 2.07928729057312 (2.07928729057312) | > loss_kl: 6.429769039154053 (6.429769039154053) | > loss_feat: 8.726507186889648 (8.726507186889648) | > loss_mel: 25.721317291259766 (25.721317291259766) | > loss_duration: 3.621037244796753 (3.621037244796753) | > loss_1: 46.577919006347656 (46.577919006347656)  --> STEP: 2 | > loss_disc: 3.1142630577087402 (2.981804132461548) | > loss_disc_real_0: 0.14741502702236176 (0.16123081743717194) | > loss_disc_real_1: 0.541581392288208 (0.4372159540653229) | > loss_disc_real_2: 0.30601418018341064 (0.35040342807769775) | > loss_disc_real_3: 0.5872440934181213 (0.4021536782383919) | > loss_disc_real_4: 0.3055814504623413 (0.24399256706237793) | > loss_disc_real_5: 0.28655368089675903 (0.2512398436665535) | > loss_0: 3.1142630577087402 (2.981804132461548) | > loss_gen: 2.70090913772583 (2.390098214149475) | > loss_kl: 6.428844451904297 (6.429306745529175) | > loss_feat: 7.673248291015625 (8.199877738952637) | > loss_mel: 20.892898559570312 (23.30710792541504) | > loss_duration: 3.377669095993042 (3.4993531703948975) | > loss_1: 41.073570251464844 (43.82574462890625)  --> STEP: 3 | > loss_disc: 2.8586018085479736 (2.940736691157023) | > loss_disc_real_0: 0.3360469341278076 (0.2195028563340505) | > loss_disc_real_1: 0.28305134177207947 (0.3858277499675751) | > loss_disc_real_2: 0.3728446364402771 (0.3578838308652242) | > loss_disc_real_3: 0.2208121120929718 (0.34170648952325183) | > loss_disc_real_4: 0.41010582447052 (0.299363652865092) | > loss_disc_real_5: 0.37300413846969604 (0.2918279419342677) | > loss_0: 2.8586018085479736 (2.940736691157023) | > loss_gen: 2.8368277549743652 (2.539008061091105) | > loss_kl: 3.0310256481170654 (5.296546379725139) | > loss_feat: 6.047802448272705 (7.482519308725993) | > loss_mel: 23.08833122253418 (23.234182357788086) | > loss_duration: 3.1756441593170166 (3.3914501667022705) | > loss_1: 38.179630279541016 (41.94370651245117) --> EVAL PERFORMANCE | > avg_loader_time: 0.0066305796305338545 (-0.004392067591349284) | > avg_loss_disc: 2.940736691157023 (+0.20542025566101074) | > avg_loss_disc_real_0: 0.2195028563340505 (-0.04597065846125284) | > avg_loss_disc_real_1: 0.3858277499675751 (+0.07614580790201825) | > avg_loss_disc_real_2: 0.3578838308652242 (-0.025758127371470152) | > avg_loss_disc_real_3: 0.34170648952325183 (+0.012156988183657291) | > avg_loss_disc_real_4: 0.299363652865092 (+0.005505482355753599) | > avg_loss_disc_real_5: 0.2918279419342677 (-0.07966091732184089) | > avg_loss_0: 2.940736691157023 (+0.20542025566101074) | > avg_loss_gen: 2.539008061091105 (-0.21436039606730173) | > avg_loss_kl: 5.296546379725139 (+0.02298267682393451) | > avg_loss_feat: 7.482519308725993 (+3.276764392852783) | > avg_loss_mel: 23.234182357788086 (+0.05985832214355469) | > avg_loss_duration: 3.3914501667022705 (+0.03550219535827637) | > avg_loss_1: 41.94370651245117 (+3.1807479858398438)  > EPOCH: 1354/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:31:36)   --> TIME: 2023-10-20 17:31:53 -- STEP: 19/50 -- GLOBAL_STEP: 120720 | > loss_disc: 1.9196630716323853 (2.283934568103991) | > loss_disc_real_0: 0.04857022687792778 (0.13017686917201468) | > loss_disc_real_1: 0.24375632405281067 (0.22612931226429187) | > loss_disc_real_2: 0.3226849436759949 (0.24109109324452124) | > loss_disc_real_3: 0.2576736807823181 (0.23229698964247578) | > loss_disc_real_4: 0.17522430419921875 (0.20536537066494165) | > loss_disc_real_5: 0.13694962859153748 (0.198837883427347) | > loss_0: 1.9196630716323853 (2.283934568103991) | > grad_norm_0: tensor(290.4879, device='cuda:0') (tensor(525.6040, device='cuda:0')) | > loss_gen: 2.895202398300171 (2.4437409764841984) | > loss_kl: 1.0993157625198364 (0.8118028578005339) | > loss_feat: 6.801026344299316 (6.415942047183451) | > loss_mel: 22.369186401367188 (19.538162331832083) | > loss_duration: 1.398149847984314 (1.3152900244060315) | > loss_1: 34.56288146972656 (30.524937730086478) | > grad_norm_1: tensor(2756.3967, device='cuda:0') (tensor(21545.6328, device='cuda:0')) | > current_lr_0: 5.163670384738764e-05 | > current_lr_1: 5.168836960898747e-05 | > step_time: 0.788 (0.5528118484898618) | > loader_time: 0.0066 (0.02286437938087865)  --> TIME: 2023-10-20 17:32:08 -- STEP: 49/50 -- GLOBAL_STEP: 120750 | > loss_disc: 2.0335419178009033 (2.283923231825537) | > loss_disc_real_0: 0.036179281771183014 (0.13628953778926206) | > loss_disc_real_1: 0.3429616391658783 (0.21978075163705008) | > loss_disc_real_2: 0.2154417335987091 (0.21772964887929205) | > loss_disc_real_3: 0.2081434577703476 (0.22749771531291155) | > loss_disc_real_4: 0.18982593715190887 (0.20588882712229173) | > loss_disc_real_5: 0.325486958026886 (0.20487673974082787) | > loss_0: 2.0335419178009033 (2.283923231825537) | > grad_norm_0: tensor(600.9611, device='cuda:0') (tensor(521.5143, device='cuda:0')) | > loss_gen: 2.822399377822876 (2.431445907573311) | > loss_kl: 0.3709283769130707 (0.8143986585188885) | > loss_feat: 6.498028755187988 (6.535092801805966) | > loss_mel: 25.833940505981445 (20.06759962986926) | > loss_duration: 1.361270785331726 (1.2898940431828405) | > loss_1: 36.886566162109375 (31.13843102844394) | > grad_norm_1: tensor(14428.1680, device='cuda:0') (tensor(18212.6797, device='cuda:0')) | > current_lr_0: 5.163670384738764e-05 | > current_lr_1: 5.168836960898747e-05 | > step_time: 0.6808 (0.5033992212645861) | > loader_time: 0.4135 (0.02254545445344886)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.5336804389953613 (2.5336804389953613) | > loss_disc_real_0: 0.10006196796894073 (0.10006196796894073) | > loss_disc_real_1: 0.4824926555156708 (0.4824926555156708) | > loss_disc_real_2: 0.22646889090538025 (0.22646889090538025) | > loss_disc_real_3: 0.23939205706119537 (0.23939205706119537) | > loss_disc_real_4: 0.26722630858421326 (0.26722630858421326) | > loss_disc_real_5: 0.2137521505355835 (0.2137521505355835) | > loss_0: 2.5336804389953613 (2.5336804389953613) | > loss_gen: 2.595776319503784 (2.595776319503784) | > loss_kl: 6.268325328826904 (6.268325328826904) | > loss_feat: 7.917110443115234 (7.917110443115234) | > loss_mel: 21.169315338134766 (21.169315338134766) | > loss_duration: 3.2562549114227295 (3.2562549114227295) | > loss_1: 41.206783294677734 (41.206783294677734)  --> STEP: 1 | > loss_disc: 2.313192844390869 (2.313192844390869) | > loss_disc_real_0: 0.0983552411198616 (0.0983552411198616) | > loss_disc_real_1: 0.3135429620742798 (0.3135429620742798) | > loss_disc_real_2: 0.22164663672447205 (0.22164663672447205) | > loss_disc_real_3: 0.2308504581451416 (0.2308504581451416) | > loss_disc_real_4: 0.22956331074237823 (0.22956331074237823) | > loss_disc_real_5: 0.06085135415196419 (0.06085135415196419) | > loss_0: 2.313192844390869 (2.313192844390869) | > loss_gen: 2.0857105255126953 (2.0857105255126953) | > loss_kl: 6.203513145446777 (6.203513145446777) | > loss_feat: 8.59304428100586 (8.59304428100586) | > loss_mel: 21.383037567138672 (21.383037567138672) | > loss_duration: 3.5877583026885986 (3.5877583026885986) | > loss_1: 41.85306167602539 (41.85306167602539)  --> STEP: 2 | > loss_disc: 2.835446357727051 (2.57431960105896) | > loss_disc_real_0: 0.11811667680740356 (0.10823595896363258) | > loss_disc_real_1: 0.2550167143344879 (0.28427983820438385) | > loss_disc_real_2: 0.21997223794460297 (0.2208094373345375) | > loss_disc_real_3: 0.27966442704200745 (0.2552574425935745) | > loss_disc_real_4: 0.2808237671852112 (0.2551935389637947) | > loss_disc_real_5: 0.31484928727149963 (0.1878503207117319) | > loss_0: 2.835446357727051 (2.57431960105896) | > loss_gen: 1.7426328659057617 (1.9141716957092285) | > loss_kl: 6.316003799438477 (6.259758472442627) | > loss_feat: 1.4420543909072876 (5.0175493359565735) | > loss_mel: 10.840970039367676 (16.112003803253174) | > loss_duration: 3.3355000019073486 (3.4616291522979736) | > loss_1: 23.677160263061523 (32.76511096954346)  --> STEP: 3 | > loss_disc: 2.705998659133911 (2.618212620417277) | > loss_disc_real_0: 0.22109805047512054 (0.14585665613412857) | > loss_disc_real_1: 0.34817230701446533 (0.3055773278077443) | > loss_disc_real_2: 0.30636027455329895 (0.24932638307412466) | > loss_disc_real_3: 0.3786831200122833 (0.2963993350664775) | > loss_disc_real_4: 0.2581140398979187 (0.2561670392751694) | > loss_disc_real_5: 0.2529829740524292 (0.209561205158631) | > loss_0: 2.705998659133911 (2.618212620417277) | > loss_gen: 2.5547730922698975 (2.1277054945627847) | > loss_kl: 3.0279974937438965 (5.182504812876384) | > loss_feat: 2.6835639476776123 (4.239554206530253) | > loss_mel: 20.843652725219727 (17.68922011057536) | > loss_duration: 3.1629014015197754 (3.3620532353719077) | > loss_1: 32.27288818359375 (32.60103670756022) --> EVAL PERFORMANCE | > avg_loader_time: 0.030429363250732422 (+0.023798783620198567) | > avg_loss_disc: 2.618212620417277 (-0.3225240707397461) | > avg_loss_disc_real_0: 0.14585665613412857 (-0.07364620019992194) | > avg_loss_disc_real_1: 0.3055773278077443 (-0.08025042215983075) | > avg_loss_disc_real_2: 0.24932638307412466 (-0.10855744779109952) | > avg_loss_disc_real_3: 0.2963993350664775 (-0.04530715445677436) | > avg_loss_disc_real_4: 0.2561670392751694 (-0.043196613589922606) | > avg_loss_disc_real_5: 0.209561205158631 (-0.0822667367756367) | > avg_loss_0: 2.618212620417277 (-0.3225240707397461) | > avg_loss_gen: 2.1277054945627847 (-0.4113025665283203) | > avg_loss_kl: 5.182504812876384 (-0.11404156684875488) | > avg_loss_feat: 4.239554206530253 (-3.2429651021957397) | > avg_loss_mel: 17.68922011057536 (-5.544962247212727) | > avg_loss_duration: 3.3620532353719077 (-0.029396931330362808) | > avg_loss_1: 32.60103670756022 (-9.342669804890953)  > EPOCH: 1355/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:32:23)   --> TIME: 2023-10-20 17:32:49 -- STEP: 29/50 -- GLOBAL_STEP: 120780 | > loss_disc: 2.5167019367218018 (2.477662550991979) | > loss_disc_real_0: 0.2359474152326584 (0.1667877091415997) | > loss_disc_real_1: 0.23114362359046936 (0.21674977018144623) | > loss_disc_real_2: 0.28252995014190674 (0.22776225928602548) | > loss_disc_real_3: 0.20365017652511597 (0.2533649621081763) | > loss_disc_real_4: 0.10980349779129028 (0.2210830165201734) | > loss_disc_real_5: 0.2249317467212677 (0.20154344476759434) | > loss_0: 2.5167019367218018 (2.477662550991979) | > grad_norm_0: tensor(377.3155, device='cuda:0') (tensor(594.0423, device='cuda:0')) | > loss_gen: 2.2435684204101562 (2.276739367123308) | > loss_kl: 1.0553562641143799 (0.9014163726362688) | > loss_feat: 6.111194133758545 (6.044336788227846) | > loss_mel: 20.618986129760742 (19.48199959458976) | > loss_duration: 1.2658026218414307 (1.3076613853717673) | > loss_1: 31.29490852355957 (30.012153822800208) | > grad_norm_1: tensor(2593.8076, device='cuda:0') (tensor(23675.4727, device='cuda:0')) | > current_lr_0: 5.1585089728951294e-05 | > current_lr_1: 5.163670384738764e-05 | > step_time: 0.4828 (0.6332179677897486) | > loader_time: 0.0018 (0.018293668483865672)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1074957847595215 (3.1074957847595215) | > loss_disc_real_0: 0.21645525097846985 (0.21645525097846985) | > loss_disc_real_1: 0.2292269617319107 (0.2292269617319107) | > loss_disc_real_2: 0.3379264771938324 (0.3379264771938324) | > loss_disc_real_3: 0.31179437041282654 (0.31179437041282654) | > loss_disc_real_4: 0.332876592874527 (0.332876592874527) | > loss_disc_real_5: 0.5493017435073853 (0.5493017435073853) | > loss_0: 3.1074957847595215 (3.1074957847595215) | > loss_gen: 2.147439479827881 (2.147439479827881) | > loss_kl: 6.472194194793701 (6.472194194793701) | > loss_feat: 4.542309761047363 (4.542309761047363) | > loss_mel: 21.365478515625 (21.365478515625) | > loss_duration: 3.1432342529296875 (3.1432342529296875) | > loss_1: 37.670654296875 (37.670654296875)  --> STEP: 1 | > loss_disc: 2.8193931579589844 (2.8193931579589844) | > loss_disc_real_0: 0.04830031841993332 (0.04830031841993332) | > loss_disc_real_1: 0.3626841604709625 (0.3626841604709625) | > loss_disc_real_2: 0.38460391759872437 (0.38460391759872437) | > loss_disc_real_3: 0.33255910873413086 (0.33255910873413086) | > loss_disc_real_4: 0.2850448787212372 (0.2850448787212372) | > loss_disc_real_5: 0.3578108251094818 (0.3578108251094818) | > loss_0: 2.8193931579589844 (2.8193931579589844) | > loss_gen: 2.3941893577575684 (2.3941893577575684) | > loss_kl: 5.7935028076171875 (5.7935028076171875) | > loss_feat: 7.897906303405762 (7.897906303405762) | > loss_mel: 22.129371643066406 (22.129371643066406) | > loss_duration: 3.5250182151794434 (3.5250182151794434) | > loss_1: 41.739986419677734 (41.739986419677734)  --> STEP: 2 | > loss_disc: 1.6380388736724854 (2.228716015815735) | > loss_disc_real_0: 0.22764210402965546 (0.1379712112247944) | > loss_disc_real_1: 0.14182256162166595 (0.25225336104631424) | > loss_disc_real_2: 0.2333269715309143 (0.30896544456481934) | > loss_disc_real_3: 0.2321682572364807 (0.2823636829853058) | > loss_disc_real_4: 0.09805681556463242 (0.1915508471429348) | > loss_disc_real_5: 0.14597535133361816 (0.25189308822155) | > loss_0: 1.6380388736724854 (2.228716015815735) | > loss_gen: 3.482016086578369 (2.9381027221679688) | > loss_kl: 6.659371852874756 (6.226437330245972) | > loss_feat: 11.246167182922363 (9.572036743164062) | > loss_mel: 22.843902587890625 (22.486637115478516) | > loss_duration: 3.3891184329986572 (3.4570683240890503) | > loss_1: 47.62057876586914 (44.68028259277344)  --> STEP: 3 | > loss_disc: 2.7294774055480957 (2.395636479059855) | > loss_disc_real_0: 0.15976357460021973 (0.14523533234993616) | > loss_disc_real_1: 0.26057493686676025 (0.2550272196531296) | > loss_disc_real_2: 0.27277830243110657 (0.29690306385358173) | > loss_disc_real_3: 0.27507638931274414 (0.2799345850944519) | > loss_disc_real_4: 0.3355943262577057 (0.23956534018119177) | > loss_disc_real_5: 0.3989538550376892 (0.30091334382692975) | > loss_0: 2.7294774055480957 (2.395636479059855) | > loss_gen: 2.269225835800171 (2.7151437600453696) | > loss_kl: 2.8706510066986084 (5.1078418890635175) | > loss_feat: 4.734034538269043 (7.95936934153239) | > loss_mel: 20.505098342895508 (21.82612419128418) | > loss_duration: 3.136272668838501 (3.3501364390055337) | > loss_1: 33.515281677246094 (40.95861562093099) --> EVAL PERFORMANCE | > avg_loader_time: 0.007277727127075195 (-0.023151636123657227) | > avg_loss_disc: 2.395636479059855 (-0.22257614135742188) | > avg_loss_disc_real_0: 0.14523533234993616 (-0.0006213237841924124) | > avg_loss_disc_real_1: 0.2550272196531296 (-0.05055010815461475) | > avg_loss_disc_real_2: 0.29690306385358173 (+0.047576680779457065) | > avg_loss_disc_real_3: 0.2799345850944519 (-0.016464749972025572) | > avg_loss_disc_real_4: 0.23956534018119177 (-0.0166016990939776) | > avg_loss_disc_real_5: 0.30091334382692975 (+0.09135213866829875) | > avg_loss_0: 2.395636479059855 (-0.22257614135742188) | > avg_loss_gen: 2.7151437600453696 (+0.5874382654825849) | > avg_loss_kl: 5.1078418890635175 (-0.07466292381286621) | > avg_loss_feat: 7.95936934153239 (+3.7198151350021362) | > avg_loss_mel: 21.82612419128418 (+4.13690408070882) | > avg_loss_duration: 3.3501364390055337 (-0.011916796366373994) | > avg_loss_1: 40.95861562093099 (+8.357578913370773)  > EPOCH: 1356/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:33:20)   --> TIME: 2023-10-20 17:33:31 -- STEP: 9/50 -- GLOBAL_STEP: 120810 | > loss_disc: 3.0234737396240234 (2.473211990462409) | > loss_disc_real_0: 0.2172888070344925 (0.1493912918700112) | > loss_disc_real_1: 0.28757885098457336 (0.25351649026076) | > loss_disc_real_2: 0.29543203115463257 (0.2404393893149164) | > loss_disc_real_3: 0.2693350613117218 (0.24682031903001997) | > loss_disc_real_4: 0.24126024544239044 (0.2075375583436754) | > loss_disc_real_5: 0.243167906999588 (0.1713077425956726) | > loss_0: 3.0234737396240234 (2.473211990462409) | > grad_norm_0: tensor(615.8078, device='cuda:0') (tensor(717.8978, device='cuda:0')) | > loss_gen: 1.6195217370986938 (2.154100881682502) | > loss_kl: 0.6720841526985168 (0.6332123776276907) | > loss_feat: 0.9806026220321655 (5.143062472343445) | > loss_mel: 17.356037139892578 (17.564580506748623) | > loss_duration: 1.2522053718566895 (1.3184324238035414) | > loss_1: 21.880451202392578 (26.813388930426704) | > grad_norm_1: tensor(3959.1597, device='cuda:0') (tensor(13696.0156, device='cuda:0')) | > current_lr_0: 5.153352720205785e-05 | > current_lr_1: 5.1585089728951294e-05 | > step_time: 0.3507 (0.5326790279812283) | > loader_time: 0.0067 (0.015492306815253364)  --> TIME: 2023-10-20 17:33:43 -- STEP: 39/50 -- GLOBAL_STEP: 120840 | > loss_disc: 2.2561123371124268 (2.5494484962561184) | > loss_disc_real_0: 0.03709384426474571 (0.16075605794023246) | > loss_disc_real_1: 0.23150582611560822 (0.23199118673801422) | > loss_disc_real_2: 0.26578372716903687 (0.24624524322839883) | > loss_disc_real_3: 0.3437440097332001 (0.2463541968892782) | > loss_disc_real_4: 0.22440971434116364 (0.21692859744414306) | > loss_disc_real_5: 0.11402830481529236 (0.22518853776347944) | > loss_0: 2.2561123371124268 (2.5494484962561184) | > grad_norm_0: tensor(699.0820, device='cuda:0') (tensor(771.4039, device='cuda:0')) | > loss_gen: 2.303816318511963 (2.1304246248343053) | > loss_kl: 0.5319296717643738 (0.756969540547102) | > loss_feat: 5.3131256103515625 (4.53450811902682) | > loss_mel: 20.68543243408203 (18.013270436189114) | > loss_duration: 1.4008506536483765 (1.2863360551687388) | > loss_1: 30.235153198242188 (26.721508686359112) | > grad_norm_1: tensor(25210.0645, device='cuda:0') (tensor(15350.3574, device='cuda:0')) | > current_lr_0: 5.153352720205785e-05 | > current_lr_1: 5.1585089728951294e-05 | > step_time: 0.3925 (0.43040070166954625) | > loader_time: 0.0036 (0.010205843509771885)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7460556030273438 (2.7460556030273438) | > loss_disc_real_0: 0.22334420680999756 (0.22334420680999756) | > loss_disc_real_1: 0.20804812014102936 (0.20804812014102936) | > loss_disc_real_2: 0.3365302085876465 (0.3365302085876465) | > loss_disc_real_3: 0.2436499148607254 (0.2436499148607254) | > loss_disc_real_4: 0.1921909898519516 (0.1921909898519516) | > loss_disc_real_5: 0.16666650772094727 (0.16666650772094727) | > loss_0: 2.7460556030273438 (2.7460556030273438) | > loss_gen: 1.8861446380615234 (1.8861446380615234) | > loss_kl: 6.699721336364746 (6.699721336364746) | > loss_feat: 5.257105827331543 (5.257105827331543) | > loss_mel: 21.93179702758789 (21.93179702758789) | > loss_duration: 3.2004289627075195 (3.2004289627075195) | > loss_1: 38.97520065307617 (38.97520065307617)  --> STEP: 1 | > loss_disc: 2.4647376537323 (2.4647376537323) | > loss_disc_real_0: 0.1489734798669815 (0.1489734798669815) | > loss_disc_real_1: 0.1942654401063919 (0.1942654401063919) | > loss_disc_real_2: 0.14687712490558624 (0.14687712490558624) | > loss_disc_real_3: 0.16073641180992126 (0.16073641180992126) | > loss_disc_real_4: 0.24551211297512054 (0.24551211297512054) | > loss_disc_real_5: 0.2698289752006531 (0.2698289752006531) | > loss_0: 2.4647376537323 (2.4647376537323) | > loss_gen: 1.9383748769760132 (1.9383748769760132) | > loss_kl: 5.690201282501221 (5.690201282501221) | > loss_feat: 7.737035751342773 (7.737035751342773) | > loss_mel: 26.213438034057617 (26.213438034057617) | > loss_duration: 3.5224061012268066 (3.5224061012268066) | > loss_1: 45.10145568847656 (45.10145568847656)  --> STEP: 2 | > loss_disc: 1.8609105348587036 (2.1628240942955017) | > loss_disc_real_0: 0.2211451530456543 (0.1850593164563179) | > loss_disc_real_1: 0.09272050112485886 (0.14349297061562538) | > loss_disc_real_2: 0.18201284110546112 (0.16444498300552368) | > loss_disc_real_3: 0.07149853557348251 (0.11611747369170189) | > loss_disc_real_4: 0.11929190903902054 (0.18240201100707054) | > loss_disc_real_5: 0.04389369860291481 (0.15686133690178394) | > loss_0: 1.8609105348587036 (2.1628240942955017) | > loss_gen: 2.794760227203369 (2.366567552089691) | > loss_kl: 6.446218967437744 (6.068210124969482) | > loss_feat: 13.17737102508545 (10.457203388214111) | > loss_mel: 22.882883071899414 (24.548160552978516) | > loss_duration: 3.406176805496216 (3.4642914533615112) | > loss_1: 48.70741271972656 (46.90443420410156)  --> STEP: 3 | > loss_disc: 2.409386157989502 (2.2450114488601685) | > loss_disc_real_0: 0.14489755034446716 (0.171672061085701) | > loss_disc_real_1: 0.2550203800201416 (0.1806687737504641) | > loss_disc_real_2: 0.2896043360233307 (0.2061647673447927) | > loss_disc_real_3: 0.34650465846061707 (0.19291320194800696) | > loss_disc_real_4: 0.255350261926651 (0.2067180946469307) | > loss_disc_real_5: 0.2852928340435028 (0.19967183594902357) | > loss_0: 2.409386157989502 (2.2450114488601685) | > loss_gen: 2.644371271133423 (2.459168791770935) | > loss_kl: 3.2744102478027344 (5.136943499247233) | > loss_feat: 5.140366077423096 (8.684924284617106) | > loss_mel: 20.335681915283203 (23.144001007080078) | > loss_duration: 3.1465394496917725 (3.3583741188049316) | > loss_1: 34.54136657714844 (42.78341166178385) --> EVAL PERFORMANCE | > avg_loader_time: 0.00750271479288737 (+0.00022498766581217477) | > avg_loss_disc: 2.2450114488601685 (-0.15062503019968654) | > avg_loss_disc_real_0: 0.171672061085701 (+0.02643672873576483) | > avg_loss_disc_real_1: 0.1806687737504641 (-0.07435844590266547) | > avg_loss_disc_real_2: 0.2061647673447927 (-0.09073829650878903) | > avg_loss_disc_real_3: 0.19291320194800696 (-0.08702138314644495) | > avg_loss_disc_real_4: 0.2067180946469307 (-0.03284724553426108) | > avg_loss_disc_real_5: 0.19967183594902357 (-0.10124150787790617) | > avg_loss_0: 2.2450114488601685 (-0.15062503019968654) | > avg_loss_gen: 2.459168791770935 (-0.25597496827443456) | > avg_loss_kl: 5.136943499247233 (+0.02910161018371582) | > avg_loss_feat: 8.684924284617106 (+0.7255549430847159) | > avg_loss_mel: 23.144001007080078 (+1.3178768157958984) | > avg_loss_duration: 3.3583741188049316 (+0.008237679799397934) | > avg_loss_1: 42.78341166178385 (+1.8247960408528598)  > EPOCH: 1357/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:34:11)   --> TIME: 2023-10-20 17:34:29 -- STEP: 19/50 -- GLOBAL_STEP: 120870 | > loss_disc: 2.0104355812072754 (2.324047038429662) | > loss_disc_real_0: 0.025394916534423828 (0.14381893910467625) | > loss_disc_real_1: 0.17954397201538086 (0.19396149249453293) | > loss_disc_real_2: 0.2033742219209671 (0.2256661035904759) | > loss_disc_real_3: 0.08290957659482956 (0.19280424106277919) | > loss_disc_real_4: 0.4694640636444092 (0.2095569459427344) | > loss_disc_real_5: 0.30661460757255554 (0.20464038848876953) | > loss_0: 2.0104355812072754 (2.324047038429662) | > grad_norm_0: tensor(402.8748, device='cuda:0') (tensor(578.8976, device='cuda:0')) | > loss_gen: 2.833512783050537 (2.3325652197787634) | > loss_kl: 0.7139221429824829 (0.9376520389004758) | > loss_feat: 8.855395317077637 (6.897214444844346) | > loss_mel: 23.711811065673828 (20.950349638336583) | > loss_duration: 1.3403030633926392 (1.3078255025964034) | > loss_1: 37.45494079589844 (32.42560670250341) | > grad_norm_1: tensor(22107.7480, device='cuda:0') (tensor(26038.1016, device='cuda:0')) | > current_lr_0: 5.148201621513833e-05 | > current_lr_1: 5.153352720205785e-05 | > step_time: 0.4512 (0.6077181540037456) | > loader_time: 0.0088 (0.020195634741532176)  --> TIME: 2023-10-20 17:34:50 -- STEP: 49/50 -- GLOBAL_STEP: 120900 | > loss_disc: 2.7495830059051514 (2.4217857949587764) | > loss_disc_real_0: 0.12840288877487183 (0.138503616561695) | > loss_disc_real_1: 0.3288165330886841 (0.21822042854464785) | > loss_disc_real_2: 0.17901009321212769 (0.22312582078941015) | > loss_disc_real_3: 0.29055675864219666 (0.229538087409978) | > loss_disc_real_4: 0.2708433270454407 (0.22595917051467967) | > loss_disc_real_5: 0.25156915187835693 (0.22028075975879113) | > loss_0: 2.7495830059051514 (2.4217857949587764) | > grad_norm_0: tensor(868.1470, device='cuda:0') (tensor(612.5090, device='cuda:0')) | > loss_gen: 1.769171118736267 (2.2772977449456033) | > loss_kl: 0.49243631958961487 (0.8338289534559056) | > loss_feat: 1.177733302116394 (5.890175453406208) | > loss_mel: 20.19004249572754 (19.659295330242234) | > loss_duration: 1.4698030948638916 (1.28248761624706) | > loss_1: 25.099185943603516 (29.943084677871393) | > grad_norm_1: tensor(5919.7515, device='cuda:0') (tensor(19564.8105, device='cuda:0')) | > current_lr_0: 5.148201621513833e-05 | > current_lr_1: 5.153352720205785e-05 | > step_time: 0.476 (0.6230812462008729) | > loader_time: 0.6443 (0.03547442689233897)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.981792688369751 (2.981792688369751) | > loss_disc_real_0: 0.2552318274974823 (0.2552318274974823) | > loss_disc_real_1: 0.25611287355422974 (0.25611287355422974) | > loss_disc_real_2: 0.2847798764705658 (0.2847798764705658) | > loss_disc_real_3: 0.2691744565963745 (0.2691744565963745) | > loss_disc_real_4: 0.27077516913414 (0.27077516913414) | > loss_disc_real_5: 0.2579849064350128 (0.2579849064350128) | > loss_0: 2.981792688369751 (2.981792688369751) | > loss_gen: 1.618119716644287 (1.618119716644287) | > loss_kl: 6.067307472229004 (6.067307472229004) | > loss_feat: 0.0629228949546814 (0.0629228949546814) | > loss_mel: 2.3192005157470703 (2.3192005157470703) | > loss_duration: 3.1431937217712402 (3.1431937217712402) | > loss_1: 13.210744857788086 (13.210744857788086)  --> STEP: 1 | > loss_disc: 3.0229053497314453 (3.0229053497314453) | > loss_disc_real_0: 0.466386616230011 (0.466386616230011) | > loss_disc_real_1: 0.2765156328678131 (0.2765156328678131) | > loss_disc_real_2: 0.34356242418289185 (0.34356242418289185) | > loss_disc_real_3: 0.24819275736808777 (0.24819275736808777) | > loss_disc_real_4: 0.2899037301540375 (0.2899037301540375) | > loss_disc_real_5: 0.37168264389038086 (0.37168264389038086) | > loss_0: 3.0229053497314453 (3.0229053497314453) | > loss_gen: 2.4205803871154785 (2.4205803871154785) | > loss_kl: 6.063007831573486 (6.063007831573486) | > loss_feat: 3.3164618015289307 (3.3164618015289307) | > loss_mel: 18.938859939575195 (18.938859939575195) | > loss_duration: 3.4520797729492188 (3.4520797729492188) | > loss_1: 34.19098663330078 (34.19098663330078)  --> STEP: 2 | > loss_disc: 2.9061636924743652 (2.9645345211029053) | > loss_disc_real_0: 0.2167135775089264 (0.3415500968694687) | > loss_disc_real_1: 0.2762950658798218 (0.27640534937381744) | > loss_disc_real_2: 0.18182413280010223 (0.26269327849149704) | > loss_disc_real_3: 0.3109659254550934 (0.2795793414115906) | > loss_disc_real_4: 0.28608137369155884 (0.28799255192279816) | > loss_disc_real_5: 0.2656351625919342 (0.31865890324115753) | > loss_0: 2.9061636924743652 (2.9645345211029053) | > loss_gen: 1.7087652683258057 (2.064672827720642) | > loss_kl: 6.821269989013672 (6.442138910293579) | > loss_feat: 1.4691463708877563 (2.3928040862083435) | > loss_mel: 16.33712387084961 (17.637991905212402) | > loss_duration: 3.4011762142181396 (3.426627993583679) | > loss_1: 29.73748207092285 (31.964234352111816)  --> STEP: 3 | > loss_disc: 2.7507691383361816 (2.8932793935139975) | > loss_disc_real_0: 0.18283246457576752 (0.288644219438235) | > loss_disc_real_1: 0.28337666392326355 (0.2787291208902995) | > loss_disc_real_2: 0.2862979471683502 (0.27056150138378143) | > loss_disc_real_3: 0.28796708583831787 (0.2823752562204997) | > loss_disc_real_4: 0.2751307785511017 (0.28370529413223267) | > loss_disc_real_5: 0.26003360748291016 (0.2991171379884084) | > loss_0: 2.7507691383361816 (2.8932793935139975) | > loss_gen: 1.941532850265503 (2.023626168568929) | > loss_kl: 2.9030351638793945 (5.262437661488851) | > loss_feat: 0.8285216689109802 (1.8713766137758892) | > loss_mel: 16.19987678527832 (17.158620198567707) | > loss_duration: 3.2368640899658203 (3.363373359044393) | > loss_1: 25.109830856323242 (29.679433186848957) --> EVAL PERFORMANCE | > avg_loader_time: 0.005785147349039714 (-0.0017175674438476562) | > avg_loss_disc: 2.8932793935139975 (+0.6482679446538291) | > avg_loss_disc_real_0: 0.288644219438235 (+0.116972158352534) | > avg_loss_disc_real_1: 0.2787291208902995 (+0.09806034713983539) | > avg_loss_disc_real_2: 0.27056150138378143 (+0.06439673403898874) | > avg_loss_disc_real_3: 0.2823752562204997 (+0.08946205427249274) | > avg_loss_disc_real_4: 0.28370529413223267 (+0.07698719948530197) | > avg_loss_disc_real_5: 0.2991171379884084 (+0.09944530203938481) | > avg_loss_0: 2.8932793935139975 (+0.6482679446538291) | > avg_loss_gen: 2.023626168568929 (-0.4355426232020059) | > avg_loss_kl: 5.262437661488851 (+0.12549416224161725) | > avg_loss_feat: 1.8713766137758892 (-6.813547670841216) | > avg_loss_mel: 17.158620198567707 (-5.985380808512371) | > avg_loss_duration: 3.363373359044393 (+0.004999240239461411) | > avg_loss_1: 29.679433186848957 (-13.103978474934895)  > EPOCH: 1358/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:35:23)   --> TIME: 2023-10-20 17:35:48 -- STEP: 29/50 -- GLOBAL_STEP: 120930 | > loss_disc: 2.6464829444885254 (2.3301343794526725) | > loss_disc_real_0: 0.20868343114852905 (0.1277731387586943) | > loss_disc_real_1: 0.24837906658649445 (0.21092063573927716) | > loss_disc_real_2: 0.23336254060268402 (0.23010651754408046) | > loss_disc_real_3: 0.24342094361782074 (0.2155281187131487) | > loss_disc_real_4: 0.20191705226898193 (0.20679688864740833) | > loss_disc_real_5: 0.21306447684764862 (0.19891576308371692) | > loss_0: 2.6464829444885254 (2.3301343794526725) | > grad_norm_0: tensor(709.6647, device='cuda:0') (tensor(629.0886, device='cuda:0')) | > loss_gen: 1.8556127548217773 (2.3739308982059875) | > loss_kl: 0.7239415645599365 (0.8172160613125768) | > loss_feat: 1.54104483127594 (6.573735498791111) | > loss_mel: 17.275548934936523 (20.40318253122527) | > loss_duration: 1.325258731842041 (1.2906530520011639) | > loss_1: 22.721406936645508 (31.45871797101251) | > grad_norm_1: tensor(4122.8574, device='cuda:0') (tensor(20229.9355, device='cuda:0')) | > current_lr_0: 5.1430556716675296e-05 | > current_lr_1: 5.148201621513833e-05 | > step_time: 0.8344 (0.6277643154407369) | > loader_time: 0.0269 (0.02220078994487894)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8996422290802 (2.8996422290802) | > loss_disc_real_0: 0.24939210712909698 (0.24939210712909698) | > loss_disc_real_1: 0.33225202560424805 (0.33225202560424805) | > loss_disc_real_2: 0.40068405866622925 (0.40068405866622925) | > loss_disc_real_3: 0.32262277603149414 (0.32262277603149414) | > loss_disc_real_4: 0.403433620929718 (0.403433620929718) | > loss_disc_real_5: 0.24320846796035767 (0.24320846796035767) | > loss_0: 2.8996422290802 (2.8996422290802) | > loss_gen: 2.3965442180633545 (2.3965442180633545) | > loss_kl: 6.069255828857422 (6.069255828857422) | > loss_feat: 5.134364128112793 (5.134364128112793) | > loss_mel: 21.230262756347656 (21.230262756347656) | > loss_duration: 3.093435049057007 (3.093435049057007) | > loss_1: 37.92386245727539 (37.92386245727539)  --> STEP: 1 | > loss_disc: 2.4099061489105225 (2.4099061489105225) | > loss_disc_real_0: 0.20314016938209534 (0.20314016938209534) | > loss_disc_real_1: 0.2861338257789612 (0.2861338257789612) | > loss_disc_real_2: 0.35463935136795044 (0.35463935136795044) | > loss_disc_real_3: 0.22679226100444794 (0.22679226100444794) | > loss_disc_real_4: 0.25319555401802063 (0.25319555401802063) | > loss_disc_real_5: 0.21611250936985016 (0.21611250936985016) | > loss_0: 2.4099061489105225 (2.4099061489105225) | > loss_gen: 2.7288877964019775 (2.7288877964019775) | > loss_kl: 5.888268947601318 (5.888268947601318) | > loss_feat: 6.819443702697754 (6.819443702697754) | > loss_mel: 23.267425537109375 (23.267425537109375) | > loss_duration: 3.4944067001342773 (3.4944067001342773) | > loss_1: 42.19843292236328 (42.19843292236328)  --> STEP: 2 | > loss_disc: 2.993101119995117 (2.70150363445282) | > loss_disc_real_0: 0.14794252812862396 (0.17554134875535965) | > loss_disc_real_1: 0.26090988516807556 (0.27352185547351837) | > loss_disc_real_2: 0.26619404554367065 (0.31041669845581055) | > loss_disc_real_3: 0.2394627183675766 (0.23312748968601227) | > loss_disc_real_4: 0.23868714272975922 (0.24594134837388992) | > loss_disc_real_5: 0.2325977236032486 (0.22435511648654938) | > loss_0: 2.993101119995117 (2.70150363445282) | > loss_gen: 1.4153401851654053 (2.0721139907836914) | > loss_kl: 6.66852331161499 (6.278396129608154) | > loss_feat: 0.09548569470643997 (3.457464698702097) | > loss_mel: 2.5594215393066406 (12.913423538208008) | > loss_duration: 3.3226799964904785 (3.408543348312378) | > loss_1: 14.061450958251953 (28.129941940307617)  --> STEP: 3 | > loss_disc: 3.002399444580078 (2.8018022378285727) | > loss_disc_real_0: 0.27829912304878235 (0.20979394018650055) | > loss_disc_real_1: 0.24277964234352112 (0.2632744510968526) | > loss_disc_real_2: 0.2773079574108124 (0.29938045144081116) | > loss_disc_real_3: 0.25330835580825806 (0.2398544450600942) | > loss_disc_real_4: 0.24476128816604614 (0.24554799497127533) | > loss_disc_real_5: 0.2468099147081375 (0.23184004922707876) | > loss_0: 3.002399444580078 (2.8018022378285727) | > loss_gen: 1.6025174856185913 (1.9155818223953247) | > loss_kl: 3.2301459312438965 (5.262312730153401) | > loss_feat: 0.7395569086074829 (2.5514954353372254) | > loss_mel: 16.061500549316406 (13.962782541910807) | > loss_duration: 3.134885311126709 (3.3173240025838218) | > loss_1: 24.76860809326172 (27.009497324625652) --> EVAL PERFORMANCE | > avg_loader_time: 0.005439360936482747 (-0.0003457864125569667) | > avg_loss_disc: 2.8018022378285727 (-0.0914771556854248) | > avg_loss_disc_real_0: 0.20979394018650055 (-0.07885027925173443) | > avg_loss_disc_real_1: 0.2632744510968526 (-0.015454669793446896) | > avg_loss_disc_real_2: 0.29938045144081116 (+0.028818950057029724) | > avg_loss_disc_real_3: 0.2398544450600942 (-0.042520811160405486) | > avg_loss_disc_real_4: 0.24554799497127533 (-0.038157299160957336) | > avg_loss_disc_real_5: 0.23184004922707876 (-0.06727708876132962) | > avg_loss_0: 2.8018022378285727 (-0.0914771556854248) | > avg_loss_gen: 1.9155818223953247 (-0.10804434617360448) | > avg_loss_kl: 5.262312730153401 (-0.00012493133544921875) | > avg_loss_feat: 2.5514954353372254 (+0.6801188215613363) | > avg_loss_mel: 13.962782541910807 (-3.1958376566569004) | > avg_loss_duration: 3.3173240025838218 (-0.04604935646057129) | > avg_loss_1: 27.009497324625652 (-2.669935862223305)  > EPOCH: 1359/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:36:16)   --> TIME: 2023-10-20 17:36:28 -- STEP: 9/50 -- GLOBAL_STEP: 120960 | > loss_disc: 3.139195442199707 (2.5911528534359403) | > loss_disc_real_0: 0.2988438010215759 (0.14716906224687895) | > loss_disc_real_1: 0.31264597177505493 (0.24509316517247093) | > loss_disc_real_2: 0.425107479095459 (0.28623195654816097) | > loss_disc_real_3: 0.29496943950653076 (0.25530135962698197) | > loss_disc_real_4: 0.3976057767868042 (0.24323519733217028) | > loss_disc_real_5: 0.4341728389263153 (0.3101453069183562) | > loss_0: 3.139195442199707 (2.5911528534359403) | > grad_norm_0: tensor(478.0735, device='cuda:0') (tensor(640.2198, device='cuda:0')) | > loss_gen: 2.3754491806030273 (2.385185850991143) | > loss_kl: 0.5052950978279114 (0.6793907814555697) | > loss_feat: 4.157536029815674 (5.686116428838836) | > loss_mel: 19.68012809753418 (19.6805991464191) | > loss_duration: 1.2665270566940308 (1.2921881808174982) | > loss_1: 27.98493766784668 (29.72348059548272) | > grad_norm_1: tensor(3495.9475, device='cuda:0') (tensor(20779.1719, device='cuda:0')) | > current_lr_0: 5.137914865520282e-05 | > current_lr_1: 5.1430556716675296e-05 | > step_time: 0.4024 (0.5532448556688097) | > loader_time: 0.0144 (0.02276190121968587)  --> TIME: 2023-10-20 17:36:47 -- STEP: 39/50 -- GLOBAL_STEP: 120990 | > loss_disc: 1.978035807609558 (2.4465918143590293) | > loss_disc_real_0: 0.13196340203285217 (0.13577627457487276) | > loss_disc_real_1: 0.3287796676158905 (0.23136225304542443) | > loss_disc_real_2: 0.25181904435157776 (0.23906660595765475) | > loss_disc_real_3: 0.20714256167411804 (0.23120842931362298) | > loss_disc_real_4: 0.23803234100341797 (0.22597637447791222) | > loss_disc_real_5: 0.12315215915441513 (0.2430311337304421) | > loss_0: 1.978035807609558 (2.4465918143590293) | > grad_norm_0: tensor(646.9812, device='cuda:0') (tensor(683.8595, device='cuda:0')) | > loss_gen: 3.0739176273345947 (2.3486563731462526) | > loss_kl: 0.5910925269126892 (0.8150336956366514) | > loss_feat: 7.106837272644043 (5.823206230042836) | > loss_mel: 21.16913414001465 (19.98301585821005) | > loss_duration: 1.3163561820983887 (1.280638213341053) | > loss_1: 33.2573356628418 (30.2505506001986) | > grad_norm_1: tensor(4154.0415, device='cuda:0') (tensor(18408.4336, device='cuda:0')) | > current_lr_0: 5.137914865520282e-05 | > current_lr_1: 5.1430556716675296e-05 | > step_time: 0.6361 (0.6176480329953709) | > loader_time: 0.0248 (0.017934267337505635)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.802760124206543 (2.802760124206543) | > loss_disc_real_0: 0.24071788787841797 (0.24071788787841797) | > loss_disc_real_1: 0.29384124279022217 (0.29384124279022217) | > loss_disc_real_2: 0.21252386271953583 (0.21252386271953583) | > loss_disc_real_3: 0.2664392292499542 (0.2664392292499542) | > loss_disc_real_4: 0.10509765893220901 (0.10509765893220901) | > loss_disc_real_5: 0.19576136767864227 (0.19576136767864227) | > loss_0: 2.802760124206543 (2.802760124206543) | > loss_gen: 1.8463129997253418 (1.8463129997253418) | > loss_kl: 6.153443813323975 (6.153443813323975) | > loss_feat: 6.015262603759766 (6.015262603759766) | > loss_mel: 22.768400192260742 (22.768400192260742) | > loss_duration: 3.2319788932800293 (3.2319788932800293) | > loss_1: 40.01539993286133 (40.01539993286133)  --> STEP: 1 | > loss_disc: 2.8849453926086426 (2.8849453926086426) | > loss_disc_real_0: 0.272914856672287 (0.272914856672287) | > loss_disc_real_1: 0.13497394323349 (0.13497394323349) | > loss_disc_real_2: 0.22778718173503876 (0.22778718173503876) | > loss_disc_real_3: 0.10828012973070145 (0.10828012973070145) | > loss_disc_real_4: 0.14133241772651672 (0.14133241772651672) | > loss_disc_real_5: 0.061050474643707275 (0.061050474643707275) | > loss_0: 2.8849453926086426 (2.8849453926086426) | > loss_gen: 1.5335944890975952 (1.5335944890975952) | > loss_kl: 6.130629539489746 (6.130629539489746) | > loss_feat: 5.696930408477783 (5.696930408477783) | > loss_mel: 22.476560592651367 (22.476560592651367) | > loss_duration: 3.4480490684509277 (3.4480490684509277) | > loss_1: 39.2857666015625 (39.2857666015625)  --> STEP: 2 | > loss_disc: 2.9895858764648438 (2.937265634536743) | > loss_disc_real_0: 0.24163657426834106 (0.257275715470314) | > loss_disc_real_1: 0.23502205312252045 (0.18499799817800522) | > loss_disc_real_2: 0.24438875913619995 (0.23608797043561935) | > loss_disc_real_3: 0.23354823887348175 (0.1709141843020916) | > loss_disc_real_4: 0.2644886076450348 (0.20291051268577576) | > loss_disc_real_5: 0.24800632894039154 (0.1545284017920494) | > loss_0: 2.9895858764648438 (2.937265634536743) | > loss_gen: 1.4796380996704102 (1.5066162943840027) | > loss_kl: 6.98809289932251 (6.559361219406128) | > loss_feat: 0.03267815709114075 (2.864804282784462) | > loss_mel: 1.2164638042449951 (11.846512198448181) | > loss_duration: 3.3672361373901367 (3.4076426029205322) | > loss_1: 13.08410930633545 (26.184937953948975)  --> STEP: 3 | > loss_disc: 2.8035030364990234 (2.8926781018575034) | > loss_disc_real_0: 0.189325749874115 (0.23462572693824768) | > loss_disc_real_1: 0.2528022229671478 (0.20759940644105276) | > loss_disc_real_2: 0.24495159089565277 (0.23904251058896384) | > loss_disc_real_3: 0.26068565249443054 (0.20083800703287125) | > loss_disc_real_4: 0.26435980200767517 (0.2233936091264089) | > loss_disc_real_5: 0.2560427486896515 (0.18836651742458344) | > loss_0: 2.8035030364990234 (2.8926781018575034) | > loss_gen: 1.7555701732635498 (1.589600920677185) | > loss_kl: 3.2087602615356445 (5.4424942334493) | > loss_feat: 0.8078944087028503 (2.1791676580905914) | > loss_mel: 17.292558670043945 (13.661861022313436) | > loss_duration: 3.2115094661712646 (3.3422648906707764) | > loss_1: 26.27629280090332 (26.215389569600422) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_121000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.555441379547119 (2.8083689212799072) | > loss_disc_real_0: 0.20581993460655212 (0.2274242788553238) | > loss_disc_real_1: 0.1689026802778244 (0.19792522490024567) | > loss_disc_real_2: 0.13676756620407104 (0.21347377449274063) | > loss_disc_real_3: 0.379120409488678 (0.24540860764682293) | > loss_disc_real_4: 0.14314262568950653 (0.2033308632671833) | > loss_disc_real_5: 0.13024631142616272 (0.17383646592497826) | > loss_0: 2.555441379547119 (2.8083689212799072) | > loss_gen: 2.180457353591919 (1.7373150289058685) | > loss_kl: 6.091090679168701 (5.60464334487915) | > loss_feat: 8.552741050720215 (3.7725610062479973) | > loss_mel: 23.349151611328125 (16.083683669567108) | > loss_duration: 3.173292398452759 (3.300021767616272) | > loss_1: 43.34673309326172 (30.498225450515747)  --> STEP: 1 | > loss_disc: 2.7037477493286133 (2.7874446868896485) | > loss_disc_real_0: 0.11608575284481049 (0.20515657365322112) | > loss_disc_real_1: 0.2483588308095932 (0.20801194608211518) | > loss_disc_real_2: 0.23821063339710236 (0.21842114627361298) | > loss_disc_real_3: 0.266287237405777 (0.24958433359861373) | > loss_disc_real_4: 0.27540430426597595 (0.21774555146694183) | > loss_disc_real_5: 0.2810799479484558 (0.19528516232967377) | > loss_0: 2.7037477493286133 (2.7874446868896485) | > loss_gen: 1.8929297924041748 (1.7684379816055298) | > loss_kl: 5.710510730743408 (5.625816822052002) | > loss_feat: 2.3027684688568115 (3.47860249876976) | > loss_mel: 20.919509887695312 (17.05084891319275) | > loss_duration: 3.5841410160064697 (3.3568456172943115) | > loss_1: 34.40985870361328 (31.280552101135253)  --> STEP: 2 | > loss_disc: 1.980005145072937 (2.6528714299201965) | > loss_disc_real_0: 0.16145846247673035 (0.197873555123806) | > loss_disc_real_1: 0.1689060926437378 (0.20149430384238562) | > loss_disc_real_2: 0.19392284750938416 (0.21433809647957483) | > loss_disc_real_3: 0.2463628053665161 (0.24904741222659746) | > loss_disc_real_4: 0.11135078221559525 (0.20001308992505074) | > loss_disc_real_5: 0.0788261890411377 (0.1758753334482511) | > loss_0: 1.980005145072937 (2.6528714299201965) | > loss_gen: 2.5715041160583496 (1.9022823373476665) | > loss_kl: 7.131274223327637 (5.876726388931274) | > loss_feat: 9.646854400634766 (4.506644482413928) | > loss_mel: 27.551477432250977 (18.80095366636912) | > loss_duration: 3.3826193809509277 (3.361141244570414) | > loss_1: 50.28372573852539 (34.44774770736694)  --> STEP: 3 | > loss_disc: 2.5837326049804688 (2.642994454928807) | > loss_disc_real_0: 0.16675299406051636 (0.1934277606861932) | > loss_disc_real_1: 0.1977943778038025 (0.20096574297973088) | > loss_disc_real_2: 0.20828190445899963 (0.21347292619092123) | > loss_disc_real_3: 0.1899976134300232 (0.24061172668422973) | > loss_disc_real_4: 0.20166681706905365 (0.2002493366599083) | > loss_disc_real_5: 0.1973082721233368 (0.1789371818304062) | > loss_0: 2.5837326049804688 (2.642994454928807) | > loss_gen: 1.6796133518218994 (1.870472482272557) | > loss_kl: 2.9518027305603027 (5.458880152021136) | > loss_feat: 2.896879196166992 (4.27667801295008) | > loss_mel: 8.769508361816406 (17.36789005143302) | > loss_duration: 3.1262035369873047 (3.3275787149156844) | > loss_1: 19.424007415771484 (32.30149909428188) --> EVAL PERFORMANCE | > avg_loader_time: 0.35557358605521067 (+0.35013422511872794) | > avg_loss_disc: 2.642994454928807 (-0.15880778289976583) | > avg_loss_disc_real_0: 0.1934277606861932 (-0.01636617950030736) | > avg_loss_disc_real_1: 0.20096574297973088 (-0.06230870811712172) | > avg_loss_disc_real_2: 0.21347292619092123 (-0.08590752524988993) | > avg_loss_disc_real_3: 0.24061172668422973 (+0.0007572816241355196) | > avg_loss_disc_real_4: 0.2002493366599083 (-0.045298658311367035) | > avg_loss_disc_real_5: 0.1789371818304062 (-0.052902867396672576) | > avg_loss_0: 2.642994454928807 (-0.15880778289976583) | > avg_loss_gen: 1.870472482272557 (-0.045109340122767794) | > avg_loss_kl: 5.458880152021136 (+0.19656742186773446) | > avg_loss_feat: 4.27667801295008 (+1.7251825776128542) | > avg_loss_mel: 17.36789005143302 (+3.405107509522212) | > avg_loss_duration: 3.3275787149156844 (+0.010254712331862592) | > avg_loss_1: 32.30149909428188 (+5.292001769656228)  > EPOCH: 1360/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:37:14)   --> TIME: 2023-10-20 17:37:27 -- STEP: 19/50 -- GLOBAL_STEP: 121020 | > loss_disc: 2.8248400688171387 (2.562886118888855) | > loss_disc_real_0: 0.20476678013801575 (0.1581496820834122) | > loss_disc_real_1: 0.27923235297203064 (0.22108201535516664) | > loss_disc_real_2: 0.2743283808231354 (0.23198470394862325) | > loss_disc_real_3: 0.4085974097251892 (0.2445075054603972) | > loss_disc_real_4: 0.3256014883518219 (0.22789116262605316) | > loss_disc_real_5: 0.41568106412887573 (0.24112004757319627) | > loss_0: 2.8248400688171387 (2.562886118888855) | > grad_norm_0: tensor(635.3892, device='cuda:0') (tensor(623.6914, device='cuda:0')) | > loss_gen: 2.375393867492676 (2.128336787223816) | > loss_kl: 1.0591057538986206 (0.8386889602008619) | > loss_feat: 4.070363521575928 (4.141671409732417) | > loss_mel: 19.27271842956543 (18.955481039850337) | > loss_duration: 1.377801775932312 (1.3061515406558388) | > loss_1: 28.15538215637207 (27.37032978158248) | > grad_norm_1: tensor(3394.8655, device='cuda:0') (tensor(22746.1211, device='cuda:0')) | > current_lr_0: 5.132779197930642e-05 | > current_lr_1: 5.137914865520282e-05 | > step_time: 0.4585 (0.4589871607328716) | > loader_time: 0.0029 (0.012502030322426244)  --> TIME: 2023-10-20 17:37:56 -- STEP: 49/50 -- GLOBAL_STEP: 121050 | > loss_disc: 2.527766704559326 (2.5321553507629706) | > loss_disc_real_0: 0.033376313745975494 (0.1514678313491904) | > loss_disc_real_1: 0.18961301445960999 (0.22948913340817909) | > loss_disc_real_2: 0.11218024045228958 (0.23597453473782054) | > loss_disc_real_3: 0.24380835890769958 (0.24328330377763024) | > loss_disc_real_4: 0.19527854025363922 (0.21857470239759708) | > loss_disc_real_5: 0.12503637373447418 (0.2257245279924602) | > loss_0: 2.527766704559326 (2.5321553507629706) | > grad_norm_0: tensor(1374.1627, device='cuda:0') (tensor(687.8631, device='cuda:0')) | > loss_gen: 1.864138126373291 (2.167228321639859) | > loss_kl: 0.3114542067050934 (0.7900301047733853) | > loss_feat: 4.0292840003967285 (4.982965663075447) | > loss_mel: 21.749462127685547 (19.019691846808616) | > loss_duration: 1.4371914863586426 (1.2800203756410249) | > loss_1: 29.391529083251953 (28.239936196074193) | > grad_norm_1: tensor(8496.7275, device='cuda:0') (tensor(16181.7598, device='cuda:0')) | > current_lr_0: 5.132779197930642e-05 | > current_lr_1: 5.137914865520282e-05 | > step_time: 0.7982 (0.7352820707827198) | > loader_time: 0.6052 (0.03530700352727151)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6294798851013184 (2.6294798851013184) | > loss_disc_real_0: 0.26693522930145264 (0.26693522930145264) | > loss_disc_real_1: 0.2843238413333893 (0.2843238413333893) | > loss_disc_real_2: 0.21106791496276855 (0.21106791496276855) | > loss_disc_real_3: 0.2789674401283264 (0.2789674401283264) | > loss_disc_real_4: 0.37048545479774475 (0.37048545479774475) | > loss_disc_real_5: 0.3422447741031647 (0.3422447741031647) | > loss_0: 2.6294798851013184 (2.6294798851013184) | > loss_gen: 2.670419454574585 (2.670419454574585) | > loss_kl: 6.595850467681885 (6.595850467681885) | > loss_feat: 6.07096529006958 (6.07096529006958) | > loss_mel: 19.493064880371094 (19.493064880371094) | > loss_duration: 3.1884119510650635 (3.1884119510650635) | > loss_1: 38.01871109008789 (38.01871109008789)  --> STEP: 1 | > loss_disc: 2.7136383056640625 (2.7136383056640625) | > loss_disc_real_0: 0.027480628341436386 (0.027480628341436386) | > loss_disc_real_1: 0.19573979079723358 (0.19573979079723358) | > loss_disc_real_2: 0.21899093687534332 (0.21899093687534332) | > loss_disc_real_3: 0.10029231011867523 (0.10029231011867523) | > loss_disc_real_4: 0.4951035678386688 (0.4951035678386688) | > loss_disc_real_5: 0.3779802620410919 (0.3779802620410919) | > loss_0: 2.7136383056640625 (2.7136383056640625) | > loss_gen: 2.068887948989868 (2.068887948989868) | > loss_kl: 6.350833892822266 (6.350833892822266) | > loss_feat: 10.495610237121582 (10.495610237121582) | > loss_mel: 23.760944366455078 (23.760944366455078) | > loss_duration: 3.5448007583618164 (3.5448007583618164) | > loss_1: 46.22107696533203 (46.22107696533203)  --> STEP: 2 | > loss_disc: 3.0105490684509277 (2.862093687057495) | > loss_disc_real_0: 0.3238888382911682 (0.1756847333163023) | > loss_disc_real_1: 0.25500375032424927 (0.22537177056074142) | > loss_disc_real_2: 0.2792642116546631 (0.2491275742650032) | > loss_disc_real_3: 0.23338307440280914 (0.1668376922607422) | > loss_disc_real_4: 0.2533048689365387 (0.37420421838760376) | > loss_disc_real_5: 0.2780095040798187 (0.3279948830604553) | > loss_0: 3.0105490684509277 (2.862093687057495) | > loss_gen: 1.6327590942382812 (1.8508235216140747) | > loss_kl: 6.503173351287842 (6.427003622055054) | > loss_feat: 0.11157452315092087 (5.3035923801362514) | > loss_mel: 3.9772536754608154 (13.869099020957947) | > loss_duration: 3.453864574432373 (3.4993326663970947) | > loss_1: 15.678625106811523 (30.949851036071777)  --> STEP: 3 | > loss_disc: 2.752202033996582 (2.825463136037191) | > loss_disc_real_0: 0.30055323243141174 (0.2173075663546721) | > loss_disc_real_1: 0.2026630938053131 (0.21780221164226532) | > loss_disc_real_2: 0.25307926535606384 (0.25044480462869007) | > loss_disc_real_3: 0.23760932683944702 (0.19042823712031046) | > loss_disc_real_4: 0.2452017217874527 (0.3312033861875534) | > loss_disc_real_5: 0.34796884655952454 (0.3346528708934784) | > loss_0: 2.752202033996582 (2.825463136037191) | > loss_gen: 1.9949520826339722 (1.8988663752873738) | > loss_kl: 2.8131747245788574 (5.222393989562988) | > loss_feat: 1.947759985923767 (4.184981582065423) | > loss_mel: 17.641157150268555 (15.12645173072815) | > loss_duration: 3.1047825813293457 (3.3678159713745117) | > loss_1: 27.5018253326416 (29.800509134928387) --> EVAL PERFORMANCE | > avg_loader_time: 0.005539099375406901 (-0.35003448667980375) | > avg_loss_disc: 2.825463136037191 (+0.182468681108384) | > avg_loss_disc_real_0: 0.2173075663546721 (+0.023879805668478915) | > avg_loss_disc_real_1: 0.21780221164226532 (+0.016836468662534437) | > avg_loss_disc_real_2: 0.25044480462869007 (+0.036971878437768835) | > avg_loss_disc_real_3: 0.19042823712031046 (-0.05018348956391927) | > avg_loss_disc_real_4: 0.3312033861875534 (+0.1309540495276451) | > avg_loss_disc_real_5: 0.3346528708934784 (+0.1557156890630722) | > avg_loss_0: 2.825463136037191 (+0.182468681108384) | > avg_loss_gen: 1.8988663752873738 (+0.028393893014816873) | > avg_loss_kl: 5.222393989562988 (-0.23648616245814758) | > avg_loss_feat: 4.184981582065423 (-0.09169643088465662) | > avg_loss_mel: 15.12645173072815 (-2.2414383207048694) | > avg_loss_duration: 3.3678159713745117 (+0.040237256458827364) | > avg_loss_1: 29.800509134928387 (-2.500989959353493)  > EPOCH: 1361/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:38:07)   --> TIME: 2023-10-20 17:38:29 -- STEP: 29/50 -- GLOBAL_STEP: 121080 | > loss_disc: 2.2537553310394287 (2.598583196771556) | > loss_disc_real_0: 0.02377714030444622 (0.1761992184509491) | > loss_disc_real_1: 0.0752953514456749 (0.2225480262061645) | > loss_disc_real_2: 0.060844484716653824 (0.23180590094677334) | > loss_disc_real_3: 0.05441417172551155 (0.2233199649329843) | > loss_disc_real_4: 0.21724846959114075 (0.23414677253057214) | > loss_disc_real_5: 0.05755303055047989 (0.2550696623993331) | > loss_0: 2.2537553310394287 (2.598583196771556) | > grad_norm_0: tensor(695.0816, device='cuda:0') (tensor(762.8513, device='cuda:0')) | > loss_gen: 1.9541101455688477 (2.1085957782021882) | > loss_kl: 0.7666570544242859 (0.8241283914138531) | > loss_feat: 10.93017864227295 (4.844866333722041) | > loss_mel: 24.35918426513672 (17.769392338292356) | > loss_duration: 1.299542784690857 (1.294407108734394) | > loss_1: 39.309669494628906 (26.841389623181573) | > grad_norm_1: tensor(8159.2710, device='cuda:0') (tensor(18330.2910, device='cuda:0')) | > current_lr_0: 5.127648663762299e-05 | > current_lr_1: 5.132779197930642e-05 | > step_time: 0.3203 (0.5425644989671379) | > loader_time: 0.0059 (0.01895733537345097)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9932684898376465 (2.9932684898376465) | > loss_disc_real_0: 0.26075685024261475 (0.26075685024261475) | > loss_disc_real_1: 0.44431450963020325 (0.44431450963020325) | > loss_disc_real_2: 0.3277614116668701 (0.3277614116668701) | > loss_disc_real_3: 0.3380264341831207 (0.3380264341831207) | > loss_disc_real_4: 0.4428006410598755 (0.4428006410598755) | > loss_disc_real_5: 0.4465669095516205 (0.4465669095516205) | > loss_0: 2.9932684898376465 (2.9932684898376465) | > loss_gen: 2.9241416454315186 (2.9241416454315186) | > loss_kl: 5.9103474617004395 (5.9103474617004395) | > loss_feat: 6.710172653198242 (6.710172653198242) | > loss_mel: 22.518627166748047 (22.518627166748047) | > loss_duration: 3.127457857131958 (3.127457857131958) | > loss_1: 41.19074249267578 (41.19074249267578)  --> STEP: 1 | > loss_disc: 3.166131019592285 (3.166131019592285) | > loss_disc_real_0: 0.3291894197463989 (0.3291894197463989) | > loss_disc_real_1: 0.2665577530860901 (0.2665577530860901) | > loss_disc_real_2: 0.2401667982339859 (0.2401667982339859) | > loss_disc_real_3: 0.3503265380859375 (0.3503265380859375) | > loss_disc_real_4: 0.3906426429748535 (0.3906426429748535) | > loss_disc_real_5: 0.24919439852237701 (0.24919439852237701) | > loss_0: 3.166131019592285 (3.166131019592285) | > loss_gen: 1.9015218019485474 (1.9015218019485474) | > loss_kl: 6.036121368408203 (6.036121368408203) | > loss_feat: 7.022073268890381 (7.022073268890381) | > loss_mel: 22.56682777404785 (22.56682777404785) | > loss_duration: 3.4946887493133545 (3.4946887493133545) | > loss_1: 41.021236419677734 (41.021236419677734)  --> STEP: 2 | > loss_disc: 2.117844581604004 (2.6419878005981445) | > loss_disc_real_0: 0.07374769449234009 (0.2014685571193695) | > loss_disc_real_1: 0.29321539402008057 (0.2798865735530853) | > loss_disc_real_2: 0.1970374435186386 (0.21860212087631226) | > loss_disc_real_3: 0.31255269050598145 (0.3314396142959595) | > loss_disc_real_4: 0.2436181604862213 (0.3171304017305374) | > loss_disc_real_5: 0.15217261016368866 (0.20068350434303284) | > loss_0: 2.117844581604004 (2.6419878005981445) | > loss_gen: 2.723809242248535 (2.3126655220985413) | > loss_kl: 6.209052085876465 (6.122586727142334) | > loss_feat: 10.9273099899292 (8.97469162940979) | > loss_mel: 24.62514305114746 (23.595985412597656) | > loss_duration: 3.380553722381592 (3.437621235847473) | > loss_1: 47.865867614746094 (44.443552017211914)  --> STEP: 3 | > loss_disc: 2.683384418487549 (2.655786673227946) | > loss_disc_real_0: 0.4321973919868469 (0.278378168741862) | > loss_disc_real_1: 0.2838402986526489 (0.2812044819196065) | > loss_disc_real_2: 0.18383190035820007 (0.20701204737027487) | > loss_disc_real_3: 0.2019943743944168 (0.28829120099544525) | > loss_disc_real_4: 0.18260978162288666 (0.2722901950279872) | > loss_disc_real_5: 0.10825566202402115 (0.16987422357002893) | > loss_0: 2.683384418487549 (2.655786673227946) | > loss_gen: 2.3990025520324707 (2.3414445320765176) | > loss_kl: 2.8852219581604004 (5.0434651374816895) | > loss_feat: 6.342385768890381 (8.097256342569986) | > loss_mel: 20.737192153930664 (22.643054326375324) | > loss_duration: 3.0504024028778076 (3.3085482915242515) | > loss_1: 35.414207458496094 (41.433770497639976) --> EVAL PERFORMANCE | > avg_loader_time: 0.013034820556640625 (+0.007495721181233724) | > avg_loss_disc: 2.655786673227946 (-0.1696764628092451) | > avg_loss_disc_real_0: 0.278378168741862 (+0.06107060238718989) | > avg_loss_disc_real_1: 0.2812044819196065 (+0.06340227027734119) | > avg_loss_disc_real_2: 0.20701204737027487 (-0.043432757258415194) | > avg_loss_disc_real_3: 0.28829120099544525 (+0.0978629638751348) | > avg_loss_disc_real_4: 0.2722901950279872 (-0.058913191159566225) | > avg_loss_disc_real_5: 0.16987422357002893 (-0.16477864732344946) | > avg_loss_0: 2.655786673227946 (-0.1696764628092451) | > avg_loss_gen: 2.3414445320765176 (+0.4425781567891438) | > avg_loss_kl: 5.0434651374816895 (-0.17892885208129883) | > avg_loss_feat: 8.097256342569986 (+3.9122747605045634) | > avg_loss_mel: 22.643054326375324 (+7.516602595647175) | > avg_loss_duration: 3.3085482915242515 (-0.05926767985026027) | > avg_loss_1: 41.433770497639976 (+11.63326136271159)  > EPOCH: 1362/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:38:58)   --> TIME: 2023-10-20 17:39:09 -- STEP: 9/50 -- GLOBAL_STEP: 121110 | > loss_disc: 2.6431031227111816 (2.3630102607938976) | > loss_disc_real_0: 0.11752288788557053 (0.1811770900256104) | > loss_disc_real_1: 0.24076949059963226 (0.21091705726252663) | > loss_disc_real_2: 0.2590431571006775 (0.21893263939354154) | > loss_disc_real_3: 0.2795848548412323 (0.2247723779744572) | > loss_disc_real_4: 0.15339697897434235 (0.2508179723388619) | > loss_disc_real_5: 0.21554477512836456 (0.20964009200947153) | > loss_0: 2.6431031227111816 (2.3630102607938976) | > grad_norm_0: tensor(552.1851, device='cuda:0') (tensor(612.8754, device='cuda:0')) | > loss_gen: 1.7821913957595825 (2.4031520552105374) | > loss_kl: 1.003125548362732 (0.8415033287472196) | > loss_feat: 3.612060308456421 (6.00201983584298) | > loss_mel: 9.720683097839355 (18.034354752964443) | > loss_duration: 1.2684203386306763 (1.3271652460098267) | > loss_1: 17.38648223876953 (28.608195622762043) | > grad_norm_1: tensor(25125.6680, device='cuda:0') (tensor(28467.8145, device='cuda:0')) | > current_lr_0: 5.122523257884077e-05 | > current_lr_1: 5.127648663762299e-05 | > step_time: 0.5269 (0.5613872740003798) | > loader_time: 0.0503 (0.026986784405178495)  --> TIME: 2023-10-20 17:39:20 -- STEP: 39/50 -- GLOBAL_STEP: 121140 | > loss_disc: 2.029238224029541 (2.434671759605408) | > loss_disc_real_0: 0.07512892782688141 (0.13853080668606052) | > loss_disc_real_1: 0.21514081954956055 (0.21683485672259942) | > loss_disc_real_2: 0.14833387732505798 (0.21328838570759848) | > loss_disc_real_3: 0.22270886600017548 (0.22817348230343598) | > loss_disc_real_4: 0.2297828048467636 (0.23504904495217863) | > loss_disc_real_5: 0.14853179454803467 (0.23365711805243522) | > loss_0: 2.029238224029541 (2.434671759605408) | > grad_norm_0: tensor(472.0429, device='cuda:0') (tensor(607.8127, device='cuda:0')) | > loss_gen: 2.4214236736297607 (2.2983373403549194) | > loss_kl: 0.4174770414829254 (0.7375021783205179) | > loss_feat: 6.03299617767334 (5.703992505677236) | > loss_mel: 23.63945960998535 (19.559386021051647) | > loss_duration: 1.342150092124939 (1.2901296798999493) | > loss_1: 33.85350799560547 (29.589347814902283) | > grad_norm_1: tensor(15097.7266, device='cuda:0') (tensor(22360.5723, device='cuda:0')) | > current_lr_0: 5.122523257884077e-05 | > current_lr_1: 5.127648663762299e-05 | > step_time: 0.4275 (0.41439412190363956) | > loader_time: 0.007 (0.013620914557041267)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.763976812362671 (2.763976812362671) | > loss_disc_real_0: 0.08050811290740967 (0.08050811290740967) | > loss_disc_real_1: 0.2490314543247223 (0.2490314543247223) | > loss_disc_real_2: 0.25761279463768005 (0.25761279463768005) | > loss_disc_real_3: 0.2799304127693176 (0.2799304127693176) | > loss_disc_real_4: 0.2573617100715637 (0.2573617100715637) | > loss_disc_real_5: 0.21689598262310028 (0.21689598262310028) | > loss_0: 2.763976812362671 (2.763976812362671) | > loss_gen: 1.6021060943603516 (1.6021060943603516) | > loss_kl: 6.811499118804932 (6.811499118804932) | > loss_feat: 1.0119400024414062 (1.0119400024414062) | > loss_mel: 13.2002592086792 (13.2002592086792) | > loss_duration: 3.2262144088745117 (3.2262144088745117) | > loss_1: 25.852020263671875 (25.852020263671875)  --> STEP: 1 | > loss_disc: 2.700068473815918 (2.700068473815918) | > loss_disc_real_0: 0.13795633614063263 (0.13795633614063263) | > loss_disc_real_1: 0.16245408356189728 (0.16245408356189728) | > loss_disc_real_2: 0.19731776416301727 (0.19731776416301727) | > loss_disc_real_3: 0.20605894923210144 (0.20605894923210144) | > loss_disc_real_4: 0.25369271636009216 (0.25369271636009216) | > loss_disc_real_5: 0.30225592851638794 (0.30225592851638794) | > loss_0: 2.700068473815918 (2.700068473815918) | > loss_gen: 1.9123989343643188 (1.9123989343643188) | > loss_kl: 5.854964733123779 (5.854964733123779) | > loss_feat: 7.785224437713623 (7.785224437713623) | > loss_mel: 23.439117431640625 (23.439117431640625) | > loss_duration: 3.411574602127075 (3.411574602127075) | > loss_1: 42.403282165527344 (42.403282165527344)  --> STEP: 2 | > loss_disc: 1.8103569746017456 (2.255212724208832) | > loss_disc_real_0: 0.13696788251399994 (0.13746210932731628) | > loss_disc_real_1: 0.286823034286499 (0.22463855892419815) | > loss_disc_real_2: 0.13451580703258514 (0.1659167855978012) | > loss_disc_real_3: 0.14607669413089752 (0.17606782168149948) | > loss_disc_real_4: 0.07455939799547195 (0.16412605717778206) | > loss_disc_real_5: 0.05005320534110069 (0.17615456692874432) | > loss_0: 1.8103569746017456 (2.255212724208832) | > loss_gen: 2.4749927520751953 (2.193695843219757) | > loss_kl: 6.230663776397705 (6.042814254760742) | > loss_feat: 13.006906509399414 (10.396065473556519) | > loss_mel: 27.83123016357422 (25.635173797607422) | > loss_duration: 3.389862060546875 (3.400718331336975) | > loss_1: 52.93365478515625 (47.6684684753418)  --> STEP: 3 | > loss_disc: 2.3999252319335938 (2.3034502267837524) | > loss_disc_real_0: 0.1061934232711792 (0.1270392139752706) | > loss_disc_real_1: 0.23847359418869019 (0.2292502373456955) | > loss_disc_real_2: 0.2537768483161926 (0.19520347317059836) | > loss_disc_real_3: 0.21333499252796173 (0.18849021196365356) | > loss_disc_real_4: 0.18283121287822723 (0.17036110907793045) | > loss_disc_real_5: 0.11994677037000656 (0.1574186347424984) | > loss_0: 2.3999252319335938 (2.3034502267837524) | > loss_gen: 1.7986178398132324 (2.062003175417582) | > loss_kl: 3.1981191635131836 (5.094582557678223) | > loss_feat: 2.346013069152832 (7.712714672088623) | > loss_mel: 18.878013610839844 (23.382787068684895) | > loss_duration: 3.1492319107055664 (3.316889524459839) | > loss_1: 29.3699951171875 (41.56897735595703) --> EVAL PERFORMANCE | > avg_loader_time: 0.011747519175211588 (-0.001287301381429037) | > avg_loss_disc: 2.3034502267837524 (-0.3523364464441934) | > avg_loss_disc_real_0: 0.1270392139752706 (-0.1513389547665914) | > avg_loss_disc_real_1: 0.2292502373456955 (-0.05195424457391101) | > avg_loss_disc_real_2: 0.19520347317059836 (-0.011808574199676514) | > avg_loss_disc_real_3: 0.18849021196365356 (-0.09980098903179169) | > avg_loss_disc_real_4: 0.17036110907793045 (-0.10192908595005673) | > avg_loss_disc_real_5: 0.1574186347424984 (-0.012455588827530534) | > avg_loss_0: 2.3034502267837524 (-0.3523364464441934) | > avg_loss_gen: 2.062003175417582 (-0.27944135665893555) | > avg_loss_kl: 5.094582557678223 (+0.0511174201965332) | > avg_loss_feat: 7.712714672088623 (-0.38454167048136334) | > avg_loss_mel: 23.382787068684895 (+0.7397327423095703) | > avg_loss_duration: 3.316889524459839 (+0.008341232935587417) | > avg_loss_1: 41.56897735595703 (+0.13520685831705492)  > EPOCH: 1363/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:39:47)   --> TIME: 2023-10-20 17:40:04 -- STEP: 19/50 -- GLOBAL_STEP: 121170 | > loss_disc: 2.743838310241699 (2.4833845653032003) | > loss_disc_real_0: 0.18798430263996124 (0.13626321753192888) | > loss_disc_real_1: 0.2688484787940979 (0.22907436109687151) | > loss_disc_real_2: 0.26851552724838257 (0.2303457015046948) | > loss_disc_real_3: 0.24227923154830933 (0.20795551511017898) | > loss_disc_real_4: 0.20363013446331024 (0.21586309530233083) | > loss_disc_real_5: 0.18742533028125763 (0.20772268681934006) | > loss_0: 2.743838310241699 (2.4833845653032003) | > grad_norm_0: tensor(619.9702, device='cuda:0') (tensor(570.5515, device='cuda:0')) | > loss_gen: 2.0533676147460938 (2.262733541036907) | > loss_kl: 0.7733129858970642 (0.8114977428003362) | > loss_feat: 5.750688076019287 (6.119846038912472) | > loss_mel: 20.518667221069336 (18.93770011475212) | > loss_duration: 1.3777750730514526 (1.3091372376994084) | > loss_1: 30.47381019592285 (29.4409146057932) | > grad_norm_1: tensor(7524.0552, device='cuda:0') (tensor(22358.8281, device='cuda:0')) | > current_lr_0: 5.117402975169929e-05 | > current_lr_1: 5.122523257884077e-05 | > step_time: 0.5872 (0.6413285481302362) | > loader_time: 0.0177 (0.022224388624492445)  --> TIME: 2023-10-20 17:40:25 -- STEP: 49/50 -- GLOBAL_STEP: 121200 | > loss_disc: 2.623534917831421 (2.4574992218796083) | > loss_disc_real_0: 0.2282460331916809 (0.14280321774053936) | > loss_disc_real_1: 0.17830605804920197 (0.218486699750837) | > loss_disc_real_2: 0.2003108114004135 (0.22519445700608953) | > loss_disc_real_3: 0.2535499930381775 (0.2342836290445863) | > loss_disc_real_4: 0.2716025412082672 (0.23150248428312492) | > loss_disc_real_5: 0.2832682132720947 (0.22096472636473422) | > loss_0: 2.623534917831421 (2.4574992218796083) | > grad_norm_0: tensor(926.2869, device='cuda:0') (tensor(581.2163, device='cuda:0')) | > loss_gen: 1.9519835710525513 (2.2724836140262834) | > loss_kl: 0.5765082240104675 (0.7609205880601493) | > loss_feat: 1.9488452672958374 (5.850342346393332) | > loss_mel: 19.811439514160156 (19.909693598747253) | > loss_duration: 1.4079352617263794 (1.2823088631338002) | > loss_1: 25.696712493896484 (30.075749085873973) | > grad_norm_1: tensor(1764.4327, device='cuda:0') (tensor(15266.6846, device='cuda:0')) | > current_lr_0: 5.117402975169929e-05 | > current_lr_1: 5.122523257884077e-05 | > step_time: 0.4632 (0.6375496290167983) | > loader_time: 0.4615 (0.030851417658280353)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.6506896018981934 (2.6506896018981934) | > loss_disc_real_0: 0.15170060098171234 (0.15170060098171234) | > loss_disc_real_1: 0.22246253490447998 (0.22246253490447998) | > loss_disc_real_2: 0.25199759006500244 (0.25199759006500244) | > loss_disc_real_3: 0.22743088006973267 (0.22743088006973267) | > loss_disc_real_4: 0.0900251492857933 (0.0900251492857933) | > loss_disc_real_5: 0.14244791865348816 (0.14244791865348816) | > loss_0: 2.6506896018981934 (2.6506896018981934) | > loss_gen: 1.7178508043289185 (1.7178508043289185) | > loss_kl: 6.884359836578369 (6.884359836578369) | > loss_feat: 7.955674648284912 (7.955674648284912) | > loss_mel: 23.608060836791992 (23.608060836791992) | > loss_duration: 3.2948873043060303 (3.2948873043060303) | > loss_1: 43.46083450317383 (43.46083450317383)  --> STEP: 1 | > loss_disc: 3.0791172981262207 (3.0791172981262207) | > loss_disc_real_0: 0.4306584894657135 (0.4306584894657135) | > loss_disc_real_1: 0.2784547805786133 (0.2784547805786133) | > loss_disc_real_2: 0.3142241835594177 (0.3142241835594177) | > loss_disc_real_3: 0.2638719975948334 (0.2638719975948334) | > loss_disc_real_4: 0.29006195068359375 (0.29006195068359375) | > loss_disc_real_5: 0.35733267664909363 (0.35733267664909363) | > loss_0: 3.0791172981262207 (3.0791172981262207) | > loss_gen: 2.311486005783081 (2.311486005783081) | > loss_kl: 6.547008514404297 (6.547008514404297) | > loss_feat: 4.119316101074219 (4.119316101074219) | > loss_mel: 21.3134765625 (21.3134765625) | > loss_duration: 3.743748188018799 (3.743748188018799) | > loss_1: 38.0350341796875 (38.0350341796875)  --> STEP: 2 | > loss_disc: 1.967858910560608 (2.5234881043434143) | > loss_disc_real_0: 0.12434379011392593 (0.2775011397898197) | > loss_disc_real_1: 0.19739024341106415 (0.23792251199483871) | > loss_disc_real_2: 0.22698669135570526 (0.2706054374575615) | > loss_disc_real_3: 0.19718696177005768 (0.23052947968244553) | > loss_disc_real_4: 0.16356346011161804 (0.2268127053976059) | > loss_disc_real_5: 0.10891459882259369 (0.23312363773584366) | > loss_0: 1.967858910560608 (2.5234881043434143) | > loss_gen: 2.4340851306915283 (2.3727855682373047) | > loss_kl: 6.418342590332031 (6.482675552368164) | > loss_feat: 6.689276218414307 (5.404296159744263) | > loss_mel: 25.837156295776367 (23.575316429138184) | > loss_duration: 3.379892349243164 (3.5618202686309814) | > loss_1: 44.758750915527344 (41.39689254760742)  --> STEP: 3 | > loss_disc: 2.7315115928649902 (2.5928292671839395) | > loss_disc_real_0: 0.2067149132490158 (0.2539057309428851) | > loss_disc_real_1: 0.260109543800354 (0.2453181892633438) | > loss_disc_real_2: 0.2053680717945099 (0.24885964890321097) | > loss_disc_real_3: 0.24500170350074768 (0.23535355428854624) | > loss_disc_real_4: 0.3057803809642792 (0.2531352639198303) | > loss_disc_real_5: 0.4783779978752136 (0.31487509111563367) | > loss_0: 2.7315115928649902 (2.5928292671839395) | > loss_gen: 2.3371469974517822 (2.3609060446421304) | > loss_kl: 3.0263965129852295 (5.3305825392405195) | > loss_feat: 5.4170379638671875 (5.408543427785237) | > loss_mel: 21.424720764160156 (22.85845120747884) | > loss_duration: 3.1424834728240967 (3.422041336695353) | > loss_1: 35.34778594970703 (39.380523681640625) --> EVAL PERFORMANCE | > avg_loader_time: 0.015350898106892904 (+0.0036033789316813163) | > avg_loss_disc: 2.5928292671839395 (+0.289379040400187) | > avg_loss_disc_real_0: 0.2539057309428851 (+0.1268665169676145) | > avg_loss_disc_real_1: 0.2453181892633438 (+0.016067951917648315) | > avg_loss_disc_real_2: 0.24885964890321097 (+0.05365617573261261) | > avg_loss_disc_real_3: 0.23535355428854624 (+0.04686334232489267) | > avg_loss_disc_real_4: 0.2531352639198303 (+0.08277415484189987) | > avg_loss_disc_real_5: 0.31487509111563367 (+0.15745645637313527) | > avg_loss_0: 2.5928292671839395 (+0.289379040400187) | > avg_loss_gen: 2.3609060446421304 (+0.29890286922454834) | > avg_loss_kl: 5.3305825392405195 (+0.23599998156229685) | > avg_loss_feat: 5.408543427785237 (-2.3041712443033857) | > avg_loss_mel: 22.85845120747884 (-0.5243358612060547) | > avg_loss_duration: 3.422041336695353 (+0.10515181223551417) | > avg_loss_1: 39.380523681640625 (-2.1884536743164062)  > EPOCH: 1364/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:40:39)   --> TIME: 2023-10-20 17:40:57 -- STEP: 29/50 -- GLOBAL_STEP: 121230 | > loss_disc: 2.281372308731079 (2.5117485728757134) | > loss_disc_real_0: 0.1684374213218689 (0.15713233259859785) | > loss_disc_real_1: 0.1891791820526123 (0.21629382824075633) | > loss_disc_real_2: 0.1934148222208023 (0.22325447073270535) | > loss_disc_real_3: 0.17886468768119812 (0.2359881878926836) | > loss_disc_real_4: 0.26831433176994324 (0.2321301675562201) | > loss_disc_real_5: 0.11529004573822021 (0.2262529987071095) | > loss_0: 2.281372308731079 (2.5117485728757134) | > grad_norm_0: tensor(375.1867, device='cuda:0') (tensor(590.8319, device='cuda:0')) | > loss_gen: 2.2296977043151855 (2.163501406538075) | > loss_kl: 1.1040805578231812 (0.7288636215801898) | > loss_feat: 8.44854736328125 (5.206591271120926) | > loss_mel: 22.012592315673828 (19.68500410277268) | > loss_duration: 1.2849797010421753 (1.3105544509558842) | > loss_1: 35.079898834228516 (29.094514748145794) | > grad_norm_1: tensor(4519.6147, device='cuda:0') (tensor(14806.0293, device='cuda:0')) | > current_lr_0: 5.11228781049893e-05 | > current_lr_1: 5.117402975169929e-05 | > step_time: 0.3033 (0.40450412651588175) | > loader_time: 0.0046 (0.009595328363878974)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1185896396636963 (3.1185896396636963) | > loss_disc_real_0: 0.5524284839630127 (0.5524284839630127) | > loss_disc_real_1: 0.2389046549797058 (0.2389046549797058) | > loss_disc_real_2: 0.35375404357910156 (0.35375404357910156) | > loss_disc_real_3: 0.3654438555240631 (0.3654438555240631) | > loss_disc_real_4: 0.27931326627731323 (0.27931326627731323) | > loss_disc_real_5: 0.3900543451309204 (0.3900543451309204) | > loss_0: 3.1185896396636963 (3.1185896396636963) | > loss_gen: 2.493123769760132 (2.493123769760132) | > loss_kl: 6.693440914154053 (6.693440914154053) | > loss_feat: 4.495599269866943 (4.495599269866943) | > loss_mel: 20.299482345581055 (20.299482345581055) | > loss_duration: 3.217146635055542 (3.217146635055542) | > loss_1: 37.19879150390625 (37.19879150390625)  --> STEP: 1 | > loss_disc: 2.931797981262207 (2.931797981262207) | > loss_disc_real_0: 0.3687650263309479 (0.3687650263309479) | > loss_disc_real_1: 0.2516108453273773 (0.2516108453273773) | > loss_disc_real_2: 0.32646745443344116 (0.32646745443344116) | > loss_disc_real_3: 0.2489977926015854 (0.2489977926015854) | > loss_disc_real_4: 0.3262768089771271 (0.3262768089771271) | > loss_disc_real_5: 0.2986108064651489 (0.2986108064651489) | > loss_0: 2.931797981262207 (2.931797981262207) | > loss_gen: 2.4826395511627197 (2.4826395511627197) | > loss_kl: 6.132861137390137 (6.132861137390137) | > loss_feat: 6.906793117523193 (6.906793117523193) | > loss_mel: 23.94101905822754 (23.94101905822754) | > loss_duration: 3.581430435180664 (3.581430435180664) | > loss_1: 43.04474639892578 (43.04474639892578)  --> STEP: 2 | > loss_disc: 2.9491188526153564 (2.9404584169387817) | > loss_disc_real_0: 0.07757318019866943 (0.22316910326480865) | > loss_disc_real_1: 0.20001693069934845 (0.22581388801336288) | > loss_disc_real_2: 0.31556612253189087 (0.321016788482666) | > loss_disc_real_3: 0.41241034865379333 (0.33070407062768936) | > loss_disc_real_4: 0.2447451949119568 (0.28551100194454193) | > loss_disc_real_5: 0.37759023904800415 (0.33810052275657654) | > loss_0: 2.9491188526153564 (2.9404584169387817) | > loss_gen: 1.9548372030258179 (2.218738377094269) | > loss_kl: 6.25147819519043 (6.192169666290283) | > loss_feat: 7.049962043762207 (6.9783775806427) | > loss_mel: 24.06806182861328 (24.00454044342041) | > loss_duration: 3.267763614654541 (3.4245970249176025) | > loss_1: 42.592105865478516 (42.81842613220215)  --> STEP: 3 | > loss_disc: 2.6256816387176514 (2.835532824198405) | > loss_disc_real_0: 0.3298267722129822 (0.2587216595808665) | > loss_disc_real_1: 0.14149418473243713 (0.1977073202530543) | > loss_disc_real_2: 0.2055712342262268 (0.28253493706385296) | > loss_disc_real_3: 0.16904062032699585 (0.2768162538607915) | > loss_disc_real_4: 0.19448846578598022 (0.2551701565583547) | > loss_disc_real_5: 0.15134838223457336 (0.27584980924924213) | > loss_0: 2.6256816387176514 (2.835532824198405) | > loss_gen: 2.0519211292266846 (2.163132627805074) | > loss_kl: 3.1646227836608887 (5.182987372080485) | > loss_feat: 7.308586597442627 (7.088447252909343) | > loss_mel: 23.033164978027344 (23.680748621622723) | > loss_duration: 3.0424978733062744 (3.2972306410471597) | > loss_1: 38.60079574584961 (41.412549336751304) --> EVAL PERFORMANCE | > avg_loader_time: 0.01892995834350586 (+0.003579060236612955) | > avg_loss_disc: 2.835532824198405 (+0.24270355701446533) | > avg_loss_disc_real_0: 0.2587216595808665 (+0.004815928637981415) | > avg_loss_disc_real_1: 0.1977073202530543 (-0.04761086901028952) | > avg_loss_disc_real_2: 0.28253493706385296 (+0.033675288160642) | > avg_loss_disc_real_3: 0.2768162538607915 (+0.04146269957224527) | > avg_loss_disc_real_4: 0.2551701565583547 (+0.002034892638524355) | > avg_loss_disc_real_5: 0.27584980924924213 (-0.03902528186639154) | > avg_loss_0: 2.835532824198405 (+0.24270355701446533) | > avg_loss_gen: 2.163132627805074 (-0.19777341683705618) | > avg_loss_kl: 5.182987372080485 (-0.14759516716003418) | > avg_loss_feat: 7.088447252909343 (+1.6799038251241054) | > avg_loss_mel: 23.680748621622723 (+0.8222974141438826) | > avg_loss_duration: 3.2972306410471597 (-0.12481069564819336) | > avg_loss_1: 41.412549336751304 (+2.0320256551106795)  > EPOCH: 1365/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:41:55)   --> TIME: 2023-10-20 17:42:05 -- STEP: 9/50 -- GLOBAL_STEP: 121260 | > loss_disc: 1.9204258918762207 (2.431533998913235) | > loss_disc_real_0: 0.09559206664562225 (0.17968792592485747) | > loss_disc_real_1: 0.17782507836818695 (0.24680262307325998) | > loss_disc_real_2: 0.23273210227489471 (0.23479055282142428) | > loss_disc_real_3: 0.17650631070137024 (0.22564570109049478) | > loss_disc_real_4: 0.15343432128429413 (0.22563856260644066) | > loss_disc_real_5: 0.26902344822883606 (0.2308893021610048) | > loss_0: 1.9204258918762207 (2.431533998913235) | > grad_norm_0: tensor(291.9026, device='cuda:0') (tensor(618.3331, device='cuda:0')) | > loss_gen: 2.68332576751709 (2.409383681085375) | > loss_kl: 0.5653563737869263 (0.7571532660060458) | > loss_feat: 8.378094673156738 (5.81975639031993) | > loss_mel: 23.25039291381836 (18.56638488504622) | > loss_duration: 1.2747604846954346 (1.306766841146681) | > loss_1: 36.15193176269531 (28.859445148044163) | > grad_norm_1: tensor(10083.5752, device='cuda:0') (tensor(14804.5439, device='cuda:0')) | > current_lr_0: 5.107177758755277e-05 | > current_lr_1: 5.11228781049893e-05 | > step_time: 0.7017 (0.6323637432522244) | > loader_time: 0.0397 (0.023962020874023438)  --> TIME: 2023-10-20 17:42:22 -- STEP: 39/50 -- GLOBAL_STEP: 121290 | > loss_disc: 2.195488214492798 (2.5434895662161017) | > loss_disc_real_0: 0.15886811912059784 (0.1370688700236571) | > loss_disc_real_1: 0.21831291913986206 (0.22856803372120246) | > loss_disc_real_2: 0.2051417976617813 (0.23170186607883528) | > loss_disc_real_3: 0.2176748514175415 (0.23510389354748604) | > loss_disc_real_4: 0.1764836311340332 (0.24315946630369395) | > loss_disc_real_5: 0.11391044408082962 (0.24430790199683264) | > loss_0: 2.195488214492798 (2.5434895662161017) | > grad_norm_0: tensor(1035.4968, device='cuda:0') (tensor(582.4693, device='cuda:0')) | > loss_gen: 2.2047483921051025 (2.1735097139309616) | > loss_kl: 0.5201416611671448 (0.78113925915498) | > loss_feat: 4.0985331535339355 (5.357571949656958) | > loss_mel: 13.700544357299805 (20.651058117548626) | > loss_duration: 1.3894333839416504 (1.2967658684803889) | > loss_1: 21.913400650024414 (30.260044831496018) | > grad_norm_1: tensor(12539.2852, device='cuda:0') (tensor(13415.0664, device='cuda:0')) | > current_lr_0: 5.107177758755277e-05 | > current_lr_1: 5.11228781049893e-05 | > step_time: 0.9883 (0.5688042701819006) | > loader_time: 0.0248 (0.017261578486515924)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7545433044433594 (2.7545433044433594) | > loss_disc_real_0: 0.2453915923833847 (0.2453915923833847) | > loss_disc_real_1: 0.3486737012863159 (0.3486737012863159) | > loss_disc_real_2: 0.33068618178367615 (0.33068618178367615) | > loss_disc_real_3: 0.22869160771369934 (0.22869160771369934) | > loss_disc_real_4: 0.19081200659275055 (0.19081200659275055) | > loss_disc_real_5: 0.321596622467041 (0.321596622467041) | > loss_0: 2.7545433044433594 (2.7545433044433594) | > loss_gen: 2.2721664905548096 (2.2721664905548096) | > loss_kl: 6.970854759216309 (6.970854759216309) | > loss_feat: 3.9621057510375977 (3.9621057510375977) | > loss_mel: 23.890586853027344 (23.890586853027344) | > loss_duration: 3.2632029056549072 (3.2632029056549072) | > loss_1: 40.358917236328125 (40.358917236328125)  --> STEP: 1 | > loss_disc: 1.3807951211929321 (1.3807951211929321) | > loss_disc_real_0: 0.026965264230966568 (0.026965264230966568) | > loss_disc_real_1: 0.1102646142244339 (0.1102646142244339) | > loss_disc_real_2: 0.04229327291250229 (0.04229327291250229) | > loss_disc_real_3: 0.0491301603615284 (0.0491301603615284) | > loss_disc_real_4: 0.0354493074119091 (0.0354493074119091) | > loss_disc_real_5: 0.02632019855082035 (0.02632019855082035) | > loss_0: 1.3807951211929321 (1.3807951211929321) | > loss_gen: 2.3543312549591064 (2.3543312549591064) | > loss_kl: 6.416110038757324 (6.416110038757324) | > loss_feat: 13.07422924041748 (13.07422924041748) | > loss_mel: 24.951244354248047 (24.951244354248047) | > loss_duration: 3.5792973041534424 (3.5792973041534424) | > loss_1: 50.37520980834961 (50.37520980834961)  --> STEP: 2 | > loss_disc: 2.2891345024108887 (1.8349648118019104) | > loss_disc_real_0: 0.3798210322856903 (0.20339314825832844) | > loss_disc_real_1: 0.2042451798915863 (0.1572548970580101) | > loss_disc_real_2: 0.185292050242424 (0.11379266157746315) | > loss_disc_real_3: 0.08537373691797256 (0.06725194863975048) | > loss_disc_real_4: 0.10307325422763824 (0.06926128081977367) | > loss_disc_real_5: 0.17364758253097534 (0.09998389054089785) | > loss_0: 2.2891345024108887 (1.8349648118019104) | > loss_gen: 2.361511707305908 (2.3579214811325073) | > loss_kl: 6.4643449783325195 (6.440227508544922) | > loss_feat: 9.171051025390625 (11.122640132904053) | > loss_mel: 25.580249786376953 (25.2657470703125) | > loss_duration: 3.4162423610687256 (3.497769832611084) | > loss_1: 46.9933967590332 (48.684303283691406)  --> STEP: 3 | > loss_disc: 2.572331666946411 (2.080753763516744) | > loss_disc_real_0: 0.5172085762023926 (0.30799829090634984) | > loss_disc_real_1: 0.2383139580488205 (0.1842745840549469) | > loss_disc_real_2: 0.23369060456752777 (0.15375864257415137) | > loss_disc_real_3: 0.23048867285251617 (0.12166419004400571) | > loss_disc_real_4: 0.17254330217838287 (0.1036886212726434) | > loss_disc_real_5: 0.22140175104141235 (0.14045651070773602) | > loss_0: 2.572331666946411 (2.080753763516744) | > loss_gen: 2.4722983837127686 (2.3960471153259277) | > loss_kl: 3.096512794494629 (5.325655937194824) | > loss_feat: 5.430829048156738 (9.225369771321615) | > loss_mel: 22.493751525878906 (24.3417485555013) | > loss_duration: 3.2276995182037354 (3.4077463944753013) | > loss_1: 36.721092224121094 (44.69656626383463) --> EVAL PERFORMANCE | > avg_loader_time: 0.005891720453898112 (-0.013038237889607746) | > avg_loss_disc: 2.080753763516744 (-0.7547790606816607) | > avg_loss_disc_real_0: 0.30799829090634984 (+0.04927663132548332) | > avg_loss_disc_real_1: 0.1842745840549469 (-0.013432736198107392) | > avg_loss_disc_real_2: 0.15375864257415137 (-0.1287762944897016) | > avg_loss_disc_real_3: 0.12166419004400571 (-0.1551520638167858) | > avg_loss_disc_real_4: 0.1036886212726434 (-0.1514815352857113) | > avg_loss_disc_real_5: 0.14045651070773602 (-0.1353932985415061) | > avg_loss_0: 2.080753763516744 (-0.7547790606816607) | > avg_loss_gen: 2.3960471153259277 (+0.23291448752085353) | > avg_loss_kl: 5.325655937194824 (+0.1426685651143389) | > avg_loss_feat: 9.225369771321615 (+2.1369225184122724) | > avg_loss_mel: 24.3417485555013 (+0.6609999338785784) | > avg_loss_duration: 3.4077463944753013 (+0.11051575342814157) | > avg_loss_1: 44.69656626383463 (+3.2840169270833286)  > EPOCH: 1366/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:42:51)   --> TIME: 2023-10-20 17:43:09 -- STEP: 19/50 -- GLOBAL_STEP: 121320 | > loss_disc: 3.0282163619995117 (2.549436613133079) | > loss_disc_real_0: 0.28940701484680176 (0.16394233002670502) | > loss_disc_real_1: 0.3552683889865875 (0.23533929609938672) | > loss_disc_real_2: 0.24270480871200562 (0.2467079644924716) | > loss_disc_real_3: 0.32033810019493103 (0.2372797241336421) | > loss_disc_real_4: 0.3681774437427521 (0.23546493190683818) | > loss_disc_real_5: 0.38011789321899414 (0.23162706784511866) | > loss_0: 3.0282163619995117 (2.549436613133079) | > grad_norm_0: tensor(485.6794, device='cuda:0') (tensor(560.3068, device='cuda:0')) | > loss_gen: 2.486323833465576 (2.2206822633743286) | > loss_kl: 0.6309207677841187 (0.7858134476762069) | > loss_feat: 3.4709579944610596 (4.538711036506452) | > loss_mel: 11.415619850158691 (17.643838531092594) | > loss_duration: 1.417494535446167 (1.341717713757565) | > loss_1: 19.421316146850586 (26.530763174358167) | > grad_norm_1: tensor(23731.3555, device='cuda:0') (tensor(20219.4219, device='cuda:0')) | > current_lr_0: 5.1020728148282795e-05 | > current_lr_1: 5.107177758755277e-05 | > step_time: 0.7304 (0.6193471331345407) | > loader_time: 0.0233 (0.025353695216931794)  --> TIME: 2023-10-20 17:43:27 -- STEP: 49/50 -- GLOBAL_STEP: 121350 | > loss_disc: 2.6859729290008545 (2.5010652907040654) | > loss_disc_real_0: 0.059274621307849884 (0.15056847657400127) | > loss_disc_real_1: 0.23499354720115662 (0.23127792228241356) | > loss_disc_real_2: 0.16466550529003143 (0.23610308097333324) | > loss_disc_real_3: 0.24526001513004303 (0.24101301084975807) | > loss_disc_real_4: 0.24286381900310516 (0.2323877567387357) | > loss_disc_real_5: 0.24663883447647095 (0.23154925091230139) | > loss_0: 2.6859729290008545 (2.5010652907040654) | > grad_norm_0: tensor(1038.1980, device='cuda:0') (tensor(547.7732, device='cuda:0')) | > loss_gen: 1.6000192165374756 (2.2065020823965273) | > loss_kl: 0.6958938241004944 (0.7501374148592657) | > loss_feat: 1.2475978136062622 (4.7046950657909) | > loss_mel: 18.120986938476562 (18.647844169212846) | > loss_duration: 1.3865010738372803 (1.3000953440763512) | > loss_1: 23.05099868774414 (27.60927405649302) | > grad_norm_1: tensor(3578.4961, device='cuda:0') (tensor(16906.9121, device='cuda:0')) | > current_lr_0: 5.1020728148282795e-05 | > current_lr_1: 5.107177758755277e-05 | > step_time: 0.5242 (0.5960970995377521) | > loader_time: 0.5327 (0.03160207612173898)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.829962730407715 (2.829962730407715) | > loss_disc_real_0: 0.18060240149497986 (0.18060240149497986) | > loss_disc_real_1: 0.2526433765888214 (0.2526433765888214) | > loss_disc_real_2: 0.2593417465686798 (0.2593417465686798) | > loss_disc_real_3: 0.2882673144340515 (0.2882673144340515) | > loss_disc_real_4: 0.24111641943454742 (0.24111641943454742) | > loss_disc_real_5: 0.2373930811882019 (0.2373930811882019) | > loss_0: 2.829962730407715 (2.829962730407715) | > loss_gen: 1.669857382774353 (1.669857382774353) | > loss_kl: 6.761474132537842 (6.761474132537842) | > loss_feat: 0.8609262108802795 (0.8609262108802795) | > loss_mel: 13.620600700378418 (13.620600700378418) | > loss_duration: 3.191603899002075 (3.191603899002075) | > loss_1: 26.104461669921875 (26.104461669921875)  --> STEP: 1 | > loss_disc: 2.6199159622192383 (2.6199159622192383) | > loss_disc_real_0: 0.3139360249042511 (0.3139360249042511) | > loss_disc_real_1: 0.3531518876552582 (0.3531518876552582) | > loss_disc_real_2: 0.26690447330474854 (0.26690447330474854) | > loss_disc_real_3: 0.1184006854891777 (0.1184006854891777) | > loss_disc_real_4: 0.16969801485538483 (0.16969801485538483) | > loss_disc_real_5: 0.1096794530749321 (0.1096794530749321) | > loss_0: 2.6199159622192383 (2.6199159622192383) | > loss_gen: 1.9162753820419312 (1.9162753820419312) | > loss_kl: 5.767858028411865 (5.767858028411865) | > loss_feat: 5.035419464111328 (5.035419464111328) | > loss_mel: 23.594642639160156 (23.594642639160156) | > loss_duration: 3.517991781234741 (3.517991781234741) | > loss_1: 39.832183837890625 (39.832183837890625)  --> STEP: 2 | > loss_disc: 2.6266918182373047 (2.6233038902282715) | > loss_disc_real_0: 0.09207499027252197 (0.20300550758838654) | > loss_disc_real_1: 0.2206905633211136 (0.2869212254881859) | > loss_disc_real_2: 0.25513654947280884 (0.2610205113887787) | > loss_disc_real_3: 0.2242017686367035 (0.1713012270629406) | > loss_disc_real_4: 0.2205863744020462 (0.19514219462871552) | > loss_disc_real_5: 0.21029038727283478 (0.15998492017388344) | > loss_0: 2.6266918182373047 (2.6233038902282715) | > loss_gen: 1.9476556777954102 (1.9319655299186707) | > loss_kl: 7.108731746673584 (6.438294887542725) | > loss_feat: 2.8719117641448975 (3.953665614128113) | > loss_mel: 21.832094192504883 (22.71336841583252) | > loss_duration: 3.3011879920959473 (3.4095898866653442) | > loss_1: 37.061580657958984 (38.446882247924805)  --> STEP: 3 | > loss_disc: 2.563519239425659 (2.6033756732940674) | > loss_disc_real_0: 0.23115533590316772 (0.2123887836933136) | > loss_disc_real_1: 0.19693149626255035 (0.2569246490796407) | > loss_disc_real_2: 0.18631522357463837 (0.23611874878406525) | > loss_disc_real_3: 0.33007723093032837 (0.2242265616854032) | > loss_disc_real_4: 0.2632453739643097 (0.21784325440724692) | > loss_disc_real_5: 0.24044230580329895 (0.18680404871702194) | > loss_0: 2.563519239425659 (2.6033756732940674) | > loss_gen: 2.2826156616210938 (2.0488489071528115) | > loss_kl: 3.0531976222991943 (5.309929132461548) | > loss_feat: 5.280859470367432 (4.396063566207886) | > loss_mel: 22.644287109375 (22.690341313680012) | > loss_duration: 3.022979974746704 (3.2807199160257974) | > loss_1: 36.283939361572266 (37.72590128580729) --> EVAL PERFORMANCE | > avg_loader_time: 0.011205593744913736 (+0.005313873291015624) | > avg_loss_disc: 2.6033756732940674 (+0.5226219097773233) | > avg_loss_disc_real_0: 0.2123887836933136 (-0.09560950721303624) | > avg_loss_disc_real_1: 0.2569246490796407 (+0.07265006502469379) | > avg_loss_disc_real_2: 0.23611874878406525 (+0.08236010620991388) | > avg_loss_disc_real_3: 0.2242265616854032 (+0.10256237164139749) | > avg_loss_disc_real_4: 0.21784325440724692 (+0.11415463313460351) | > avg_loss_disc_real_5: 0.18680404871702194 (+0.04634753800928593) | > avg_loss_0: 2.6033756732940674 (+0.5226219097773233) | > avg_loss_gen: 2.0488489071528115 (-0.3471982081731162) | > avg_loss_kl: 5.309929132461548 (-0.015726804733276367) | > avg_loss_feat: 4.396063566207886 (-4.829306205113729) | > avg_loss_mel: 22.690341313680012 (-1.651407241821289) | > avg_loss_duration: 3.2807199160257974 (-0.12702647844950388) | > avg_loss_1: 37.72590128580729 (-6.970664978027344)  > EPOCH: 1367/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:43:42)   --> TIME: 2023-10-20 17:44:03 -- STEP: 29/50 -- GLOBAL_STEP: 121380 | > loss_disc: 2.2202987670898438 (2.296359962430494) | > loss_disc_real_0: 0.15596352517604828 (0.15877203771780277) | > loss_disc_real_1: 0.28691649436950684 (0.22905836074516692) | > loss_disc_real_2: 0.28322917222976685 (0.227827504148771) | > loss_disc_real_3: 0.277852863073349 (0.2289356029239194) | > loss_disc_real_4: 0.34465888142585754 (0.2144660543778847) | > loss_disc_real_5: 0.171139195561409 (0.21120200636957226) | > loss_0: 2.2202987670898438 (2.296359962430494) | > grad_norm_0: tensor(403.9515, device='cuda:0') (tensor(788.6369, device='cuda:0')) | > loss_gen: 3.1159462928771973 (2.5304279656245794) | > loss_kl: 0.8953787684440613 (0.8188752366936413) | > loss_feat: 6.664856910705566 (6.488764932700272) | > loss_mel: 20.851600646972656 (20.33439120547525) | > loss_duration: 1.2979375123977661 (1.3013167011326756) | > loss_1: 32.825721740722656 (31.4737758472048) | > grad_norm_1: tensor(5867.8550, device='cuda:0') (tensor(29554.4668, device='cuda:0')) | > current_lr_0: 5.096972973612354e-05 | > current_lr_1: 5.1020728148282795e-05 | > step_time: 0.3061 (0.5071854426943022) | > loader_time: 0.0028 (0.015551550634976092)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9245710372924805 (2.9245710372924805) | > loss_disc_real_0: 0.37941214442253113 (0.37941214442253113) | > loss_disc_real_1: 0.25527873635292053 (0.25527873635292053) | > loss_disc_real_2: 0.29706287384033203 (0.29706287384033203) | > loss_disc_real_3: 0.271016389131546 (0.271016389131546) | > loss_disc_real_4: 0.23883657157421112 (0.23883657157421112) | > loss_disc_real_5: 0.2896896004676819 (0.2896896004676819) | > loss_0: 2.9245710372924805 (2.9245710372924805) | > loss_gen: 2.0150070190429688 (2.0150070190429688) | > loss_kl: 6.277631759643555 (6.277631759643555) | > loss_feat: 3.6687982082366943 (3.6687982082366943) | > loss_mel: 20.59388542175293 (20.59388542175293) | > loss_duration: 3.1133761405944824 (3.1133761405944824) | > loss_1: 35.668697357177734 (35.668697357177734)  --> STEP: 1 | > loss_disc: 2.602010726928711 (2.602010726928711) | > loss_disc_real_0: 0.26424890756607056 (0.26424890756607056) | > loss_disc_real_1: 0.17630718648433685 (0.17630718648433685) | > loss_disc_real_2: 0.22305160760879517 (0.22305160760879517) | > loss_disc_real_3: 0.3172244131565094 (0.3172244131565094) | > loss_disc_real_4: 0.27726128697395325 (0.27726128697395325) | > loss_disc_real_5: 0.2783010005950928 (0.2783010005950928) | > loss_0: 2.602010726928711 (2.602010726928711) | > loss_gen: 2.1493639945983887 (2.1493639945983887) | > loss_kl: 5.353118419647217 (5.353118419647217) | > loss_feat: 2.0396032333374023 (2.0396032333374023) | > loss_mel: 19.13653564453125 (19.13653564453125) | > loss_duration: 3.483776092529297 (3.483776092529297) | > loss_1: 32.16239929199219 (32.16239929199219)  --> STEP: 2 | > loss_disc: 2.270407199859619 (2.436208963394165) | > loss_disc_real_0: 0.43337482213974 (0.3488118648529053) | > loss_disc_real_1: 0.26232457160949707 (0.21931587904691696) | > loss_disc_real_2: 0.22073310613632202 (0.2218923568725586) | > loss_disc_real_3: 0.2907148599624634 (0.3039696365594864) | > loss_disc_real_4: 0.14968079328536987 (0.21347104012966156) | > loss_disc_real_5: 0.11800451576709747 (0.19815275818109512) | > loss_0: 2.270407199859619 (2.436208963394165) | > loss_gen: 3.0373616218566895 (2.593362808227539) | > loss_kl: 6.801539421081543 (6.07732892036438) | > loss_feat: 10.298383712768555 (6.1689934730529785) | > loss_mel: 23.078140258789062 (21.107337951660156) | > loss_duration: 3.3865489959716797 (3.4351625442504883) | > loss_1: 46.60197448730469 (39.38218688964844)  --> STEP: 3 | > loss_disc: 2.7657382488250732 (2.5460520585378013) | > loss_disc_real_0: 0.1063188910484314 (0.2679808735847473) | > loss_disc_real_1: 0.31015658378601074 (0.2495961139599482) | > loss_disc_real_2: 0.29977843165397644 (0.24785438179969788) | > loss_disc_real_3: 0.23595140874385834 (0.28129689395427704) | > loss_disc_real_4: 0.3817659914493561 (0.2695693572362264) | > loss_disc_real_5: 0.3166946768760681 (0.23766673107941946) | > loss_0: 2.7657382488250732 (2.5460520585378013) | > loss_gen: 2.2926223278045654 (2.4931159814198813) | > loss_kl: 3.0973267555236816 (5.0839948654174805) | > loss_feat: 4.801399230957031 (5.713128725687663) | > loss_mel: 23.4875545501709 (21.90074348449707) | > loss_duration: 3.0844836235046387 (3.3182695706685386) | > loss_1: 36.76338577270508 (38.50925318400065) --> EVAL PERFORMANCE | > avg_loader_time: 0.017136653264363606 (+0.005931059519449869) | > avg_loss_disc: 2.5460520585378013 (-0.05732361475626613) | > avg_loss_disc_real_0: 0.2679808735847473 (+0.055592089891433716) | > avg_loss_disc_real_1: 0.2495961139599482 (-0.007328535119692475) | > avg_loss_disc_real_2: 0.24785438179969788 (+0.01173563301563263) | > avg_loss_disc_real_3: 0.28129689395427704 (+0.05707033226887384) | > avg_loss_disc_real_4: 0.2695693572362264 (+0.051726102828979464) | > avg_loss_disc_real_5: 0.23766673107941946 (+0.05086268236239752) | > avg_loss_0: 2.5460520585378013 (-0.05732361475626613) | > avg_loss_gen: 2.4931159814198813 (+0.4442670742670698) | > avg_loss_kl: 5.0839948654174805 (-0.22593426704406738) | > avg_loss_feat: 5.713128725687663 (+1.3170651594797773) | > avg_loss_mel: 21.90074348449707 (-0.7895978291829415) | > avg_loss_duration: 3.3182695706685386 (+0.03754965464274118) | > avg_loss_1: 38.50925318400065 (+0.7833518981933594)  > EPOCH: 1368/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:44:23)   --> TIME: 2023-10-20 17:44:35 -- STEP: 9/50 -- GLOBAL_STEP: 121410 | > loss_disc: 2.4782626628875732 (2.550336890750461) | > loss_disc_real_0: 0.1846017688512802 (0.16022343954278362) | > loss_disc_real_1: 0.3034535348415375 (0.24314652383327484) | > loss_disc_real_2: 0.2198975384235382 (0.20580384218030506) | > loss_disc_real_3: 0.2993122339248657 (0.23461647000577715) | > loss_disc_real_4: 0.13296817243099213 (0.23087730672624376) | > loss_disc_real_5: 0.27455174922943115 (0.25722621629635495) | > loss_0: 2.4782626628875732 (2.550336890750461) | > grad_norm_0: tensor(509.9387, device='cuda:0') (tensor(501.0618, device='cuda:0')) | > loss_gen: 2.402373790740967 (2.1356707678900824) | > loss_kl: 0.5276688933372498 (0.7858884731928507) | > loss_feat: 5.120282173156738 (4.686270404607058) | > loss_mel: 22.85858917236328 (16.871347308158875) | > loss_duration: 1.2475913763046265 (1.2960426145129733) | > loss_1: 32.1565055847168 (25.775219387478298) | > grad_norm_1: tensor(6312.6348, device='cuda:0') (tensor(20718.0391, device='cuda:0')) | > current_lr_0: 5.0918782300070205e-05 | > current_lr_1: 5.096972973612354e-05 | > step_time: 0.682 (0.6315169599321153) | > loader_time: 0.0354 (0.023545477125379775)  --> TIME: 2023-10-20 17:44:55 -- STEP: 39/50 -- GLOBAL_STEP: 121440 | > loss_disc: 1.9595744609832764 (2.574117651352516) | > loss_disc_real_0: 0.07110242545604706 (0.16326569460141352) | > loss_disc_real_1: 0.18941326439380646 (0.22994951970684221) | > loss_disc_real_2: 0.06836516410112381 (0.21551613280406365) | > loss_disc_real_3: 0.1328890472650528 (0.23745942526520827) | > loss_disc_real_4: 0.1174025610089302 (0.22469160705804825) | > loss_disc_real_5: 0.056884460151195526 (0.23301949944251624) | > loss_0: 1.9595744609832764 (2.574117651352516) | > grad_norm_0: tensor(743.6583, device='cuda:0') (tensor(586.3157, device='cuda:0')) | > loss_gen: 2.578425407409668 (2.0547998440571322) | > loss_kl: 0.4761005938053131 (0.759418595295686) | > loss_feat: 9.683294296264648 (4.4235027850820465) | > loss_mel: 22.180988311767578 (17.536262230995373) | > loss_duration: 1.3878341913223267 (1.2842654326023202) | > loss_1: 36.306644439697266 (26.058248629936806) | > grad_norm_1: tensor(65274.2109, device='cuda:0') (tensor(19702.5234, device='cuda:0')) | > current_lr_0: 5.0918782300070205e-05 | > current_lr_1: 5.096972973612354e-05 | > step_time: 0.5854 (0.6385455865126389) | > loader_time: 0.024 (0.024424265592526168)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.419463872909546 (2.419463872909546) | > loss_disc_real_0: 0.044522665441036224 (0.044522665441036224) | > loss_disc_real_1: 0.11061445623636246 (0.11061445623636246) | > loss_disc_real_2: 0.17220617830753326 (0.17220617830753326) | > loss_disc_real_3: 0.21907800436019897 (0.21907800436019897) | > loss_disc_real_4: 0.1704782098531723 (0.1704782098531723) | > loss_disc_real_5: 0.16252972185611725 (0.16252972185611725) | > loss_0: 2.419463872909546 (2.419463872909546) | > loss_gen: 1.9146637916564941 (1.9146637916564941) | > loss_kl: 6.739632606506348 (6.739632606506348) | > loss_feat: 8.498953819274902 (8.498953819274902) | > loss_mel: 26.19093132019043 (26.19093132019043) | > loss_duration: 3.1114964485168457 (3.1114964485168457) | > loss_1: 46.45568084716797 (46.45568084716797)  --> STEP: 1 | > loss_disc: 2.655587911605835 (2.655587911605835) | > loss_disc_real_0: 0.4767140746116638 (0.4767140746116638) | > loss_disc_real_1: 0.21859794855117798 (0.21859794855117798) | > loss_disc_real_2: 0.2686573266983032 (0.2686573266983032) | > loss_disc_real_3: 0.1788749098777771 (0.1788749098777771) | > loss_disc_real_4: 0.24362227320671082 (0.24362227320671082) | > loss_disc_real_5: 0.27550485730171204 (0.27550485730171204) | > loss_0: 2.655587911605835 (2.655587911605835) | > loss_gen: 2.5751326084136963 (2.5751326084136963) | > loss_kl: 5.718078136444092 (5.718078136444092) | > loss_feat: 7.249875068664551 (7.249875068664551) | > loss_mel: 21.718074798583984 (21.718074798583984) | > loss_duration: 3.45353627204895 (3.45353627204895) | > loss_1: 40.714698791503906 (40.714698791503906)  --> STEP: 2 | > loss_disc: 1.752461314201355 (2.204024612903595) | > loss_disc_real_0: 0.05395808815956116 (0.2653360813856125) | > loss_disc_real_1: 0.18099750578403473 (0.19979772716760635) | > loss_disc_real_2: 0.09920573234558105 (0.18393152952194214) | > loss_disc_real_3: 0.026378083974123 (0.10262649692595005) | > loss_disc_real_4: 0.13345760107040405 (0.18853993713855743) | > loss_disc_real_5: 0.08544423431158066 (0.18047454580664635) | > loss_0: 1.752461314201355 (2.204024612903595) | > loss_gen: 2.211845874786377 (2.3934892416000366) | > loss_kl: 6.705994129180908 (6.2120361328125) | > loss_feat: 14.169662475585938 (10.709768772125244) | > loss_mel: 26.198429107666016 (23.958251953125) | > loss_duration: 3.3967525959014893 (3.4251444339752197) | > loss_1: 52.682682037353516 (46.69869041442871)  --> STEP: 3 | > loss_disc: 3.3194663524627686 (2.5758385260899863) | > loss_disc_real_0: 0.5989522337913513 (0.37654146552085876) | > loss_disc_real_1: 0.2531927824020386 (0.21759607891241708) | > loss_disc_real_2: 0.26759758591651917 (0.21182021498680115) | > loss_disc_real_3: 0.2909010350704193 (0.1653846763074398) | > loss_disc_real_4: 0.21528193354606628 (0.1974539359410604) | > loss_disc_real_5: 0.28380757570266724 (0.21491888910531998) | > loss_0: 3.3194663524627686 (2.5758385260899863) | > loss_gen: 1.7944799661636353 (2.1938194831212363) | > loss_kl: 2.963536024093628 (5.129202763239543) | > loss_feat: 4.689275741577148 (8.702937761942545) | > loss_mel: 21.9501895904541 (23.2888978322347) | > loss_duration: 3.177647829055786 (3.3426455656687417) | > loss_1: 34.57512664794922 (42.65750249226888) --> EVAL PERFORMANCE | > avg_loader_time: 0.00429844856262207 (-0.012838204701741535) | > avg_loss_disc: 2.5758385260899863 (+0.02978646755218506) | > avg_loss_disc_real_0: 0.37654146552085876 (+0.10856059193611145) | > avg_loss_disc_real_1: 0.21759607891241708 (-0.03200003504753113) | > avg_loss_disc_real_2: 0.21182021498680115 (-0.03603416681289673) | > avg_loss_disc_real_3: 0.1653846763074398 (-0.11591221764683723) | > avg_loss_disc_real_4: 0.1974539359410604 (-0.07211542129516599) | > avg_loss_disc_real_5: 0.21491888910531998 (-0.022747841974099486) | > avg_loss_0: 2.5758385260899863 (+0.02978646755218506) | > avg_loss_gen: 2.1938194831212363 (-0.299296498298645) | > avg_loss_kl: 5.129202763239543 (+0.04520789782206247) | > avg_loss_feat: 8.702937761942545 (+2.989809036254882) | > avg_loss_mel: 23.2888978322347 (+1.388154347737629) | > avg_loss_duration: 3.3426455656687417 (+0.024375995000203154) | > avg_loss_1: 42.65750249226888 (+4.148249308268234)  > EPOCH: 1369/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:45:13)   --> TIME: 2023-10-20 17:45:35 -- STEP: 19/50 -- GLOBAL_STEP: 121470 | > loss_disc: 2.9034993648529053 (2.3340489048706856) | > loss_disc_real_0: 0.19951559603214264 (0.12496091092103406) | > loss_disc_real_1: 0.2531614303588867 (0.21247674505177297) | > loss_disc_real_2: 0.3189564645290375 (0.19351313890595184) | > loss_disc_real_3: 0.27105283737182617 (0.20676829587472112) | > loss_disc_real_4: 0.2742861807346344 (0.20253077365065875) | > loss_disc_real_5: 0.28956782817840576 (0.17733872809300297) | > loss_0: 2.9034993648529053 (2.3340489048706856) | > grad_norm_0: tensor(616.9850, device='cuda:0') (tensor(541.0283, device='cuda:0')) | > loss_gen: 1.8759560585021973 (2.2496133979998136) | > loss_kl: 0.872139573097229 (0.7849962617221632) | > loss_feat: 1.848697543144226 (5.9403091045586685) | > loss_mel: 18.20868682861328 (20.720076448039006) | > loss_duration: 1.3831441402435303 (1.3300628222917255) | > loss_1: 24.188623428344727 (31.025057817760267) | > grad_norm_1: tensor(2785.5962, device='cuda:0') (tensor(23784.3340, device='cuda:0')) | > current_lr_0: 5.0867885789168996e-05 | > current_lr_1: 5.0918782300070205e-05 | > step_time: 0.5236 (0.8710559041876542) | > loader_time: 0.0021 (0.0323636531829834)  --> TIME: 2023-10-20 17:45:52 -- STEP: 49/50 -- GLOBAL_STEP: 121500 | > loss_disc: 2.978895664215088 (2.4787956427554696) | > loss_disc_real_0: 0.22733983397483826 (0.1478380569237836) | > loss_disc_real_1: 0.2560964524745941 (0.22310281286434253) | > loss_disc_real_2: 0.2551783621311188 (0.21648953839832422) | > loss_disc_real_3: 0.2536333203315735 (0.23009503955895805) | > loss_disc_real_4: 0.2669236660003662 (0.2322314523008405) | > loss_disc_real_5: 0.267434686422348 (0.21984425403785948) | > loss_0: 2.978895664215088 (2.4787956427554696) | > grad_norm_0: tensor(1410.9391, device='cuda:0') (tensor(640.7852, device='cuda:0')) | > loss_gen: 1.5713181495666504 (2.1768280340700734) | > loss_kl: 0.684032678604126 (0.8383663676831187) | > loss_feat: 0.07878534495830536 (4.8996251459632605) | > loss_mel: 2.0345327854156494 (18.736106309355517) | > loss_duration: 1.3923075199127197 (1.292308157804061) | > loss_1: 5.760976791381836 (27.94323392790191) | > grad_norm_1: tensor(22048.7031, device='cuda:0') (tensor(20445.0293, device='cuda:0')) | > current_lr_0: 5.0867885789168996e-05 | > current_lr_1: 5.0918782300070205e-05 | > step_time: 0.6779 (0.6562649522508893) | > loader_time: 0.5675 (0.03271526706462003)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.2151870727539062 (3.2151870727539062) | > loss_disc_real_0: 0.19628652930259705 (0.19628652930259705) | > loss_disc_real_1: 0.30784663558006287 (0.30784663558006287) | > loss_disc_real_2: 0.2645224630832672 (0.2645224630832672) | > loss_disc_real_3: 0.4253295958042145 (0.4253295958042145) | > loss_disc_real_4: 0.24932201206684113 (0.24932201206684113) | > loss_disc_real_5: 0.43705126643180847 (0.43705126643180847) | > loss_0: 3.2151870727539062 (3.2151870727539062) | > loss_gen: 2.2420575618743896 (2.2420575618743896) | > loss_kl: 6.475841045379639 (6.475841045379639) | > loss_feat: 8.805517196655273 (8.805517196655273) | > loss_mel: 23.69728660583496 (23.69728660583496) | > loss_duration: 3.237513542175293 (3.237513542175293) | > loss_1: 44.45821762084961 (44.45821762084961)  --> STEP: 1 | > loss_disc: 2.941584587097168 (2.941584587097168) | > loss_disc_real_0: 0.18820428848266602 (0.18820428848266602) | > loss_disc_real_1: 0.24682217836380005 (0.24682217836380005) | > loss_disc_real_2: 0.2353598028421402 (0.2353598028421402) | > loss_disc_real_3: 0.29091453552246094 (0.29091453552246094) | > loss_disc_real_4: 0.3058648109436035 (0.3058648109436035) | > loss_disc_real_5: 0.3754538595676422 (0.3754538595676422) | > loss_0: 2.941584587097168 (2.941584587097168) | > loss_gen: 2.1271352767944336 (2.1271352767944336) | > loss_kl: 6.186269283294678 (6.186269283294678) | > loss_feat: 6.266619682312012 (6.266619682312012) | > loss_mel: 21.770971298217773 (21.770971298217773) | > loss_duration: 3.509965181350708 (3.509965181350708) | > loss_1: 39.8609619140625 (39.8609619140625)  --> STEP: 2 | > loss_disc: 2.6222341060638428 (2.7819093465805054) | > loss_disc_real_0: 0.5426560640335083 (0.36543017625808716) | > loss_disc_real_1: 0.20590971410274506 (0.22636594623327255) | > loss_disc_real_2: 0.29057422280311584 (0.262967012822628) | > loss_disc_real_3: 0.2591431140899658 (0.2750288248062134) | > loss_disc_real_4: 0.2065631002187729 (0.2562139555811882) | > loss_disc_real_5: 0.31227588653564453 (0.34386487305164337) | > loss_0: 2.6222341060638428 (2.7819093465805054) | > loss_gen: 2.939974784851074 (2.533555030822754) | > loss_kl: 6.831305027008057 (6.508787155151367) | > loss_feat: 11.038175582885742 (8.652397632598877) | > loss_mel: 22.27690315246582 (22.023937225341797) | > loss_duration: 3.5001726150512695 (3.5050688982009888) | > loss_1: 46.58653259277344 (43.22374725341797)  --> STEP: 3 | > loss_disc: 2.6978766918182373 (2.7538984616597495) | > loss_disc_real_0: 0.27773338556289673 (0.3361979126930237) | > loss_disc_real_1: 0.27734485268592834 (0.2433589150508245) | > loss_disc_real_2: 0.25999143719673157 (0.26197515428066254) | > loss_disc_real_3: 0.2404981404542923 (0.26351859668890637) | > loss_disc_real_4: 0.23445942997932434 (0.24896244704723358) | > loss_disc_real_5: 0.24473175406455994 (0.3108205000559489) | > loss_0: 2.6978766918182373 (2.7538984616597495) | > loss_gen: 1.969534158706665 (2.345548073450724) | > loss_kl: 3.170380115509033 (5.395984808603923) | > loss_feat: 1.457090139389038 (6.253961801528931) | > loss_mel: 19.30693817138672 (21.118270874023438) | > loss_duration: 3.0246708393096924 (3.34493621190389) | > loss_1: 28.928613662719727 (38.45870272318522) --> EVAL PERFORMANCE | > avg_loader_time: 0.01892717679341634 (+0.01462872823079427) | > avg_loss_disc: 2.7538984616597495 (+0.17805993556976318) | > avg_loss_disc_real_0: 0.3361979126930237 (-0.04034355282783508) | > avg_loss_disc_real_1: 0.2433589150508245 (+0.025762836138407408) | > avg_loss_disc_real_2: 0.26197515428066254 (+0.05015493929386139) | > avg_loss_disc_real_3: 0.26351859668890637 (+0.09813392038146657) | > avg_loss_disc_real_4: 0.24896244704723358 (+0.05150851110617319) | > avg_loss_disc_real_5: 0.3108205000559489 (+0.09590161095062893) | > avg_loss_0: 2.7538984616597495 (+0.17805993556976318) | > avg_loss_gen: 2.345548073450724 (+0.15172859032948782) | > avg_loss_kl: 5.395984808603923 (+0.2667820453643799) | > avg_loss_feat: 6.253961801528931 (-2.4489759604136143) | > avg_loss_mel: 21.118270874023438 (-2.170626958211262) | > avg_loss_duration: 3.34493621190389 (+0.002290646235148408) | > avg_loss_1: 38.45870272318522 (-4.198799769083664)  > EPOCH: 1370/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:46:00)   --> TIME: 2023-10-20 17:46:22 -- STEP: 29/50 -- GLOBAL_STEP: 121530 | > loss_disc: 2.413849115371704 (2.496783568941314) | > loss_disc_real_0: 0.18882690370082855 (0.14520659662205085) | > loss_disc_real_1: 0.26237723231315613 (0.22255448637337522) | > loss_disc_real_2: 0.21494294703006744 (0.2235839319383276) | > loss_disc_real_3: 0.41237470507621765 (0.25421861950950375) | > loss_disc_real_4: 0.11081485450267792 (0.215194054365415) | > loss_disc_real_5: 0.1871994286775589 (0.2140448696847106) | > loss_0: 2.413849115371704 (2.496783568941314) | > grad_norm_0: tensor(421.5501, device='cuda:0') (tensor(558.3290, device='cuda:0')) | > loss_gen: 2.5500245094299316 (2.200729822290355) | > loss_kl: 1.2792454957962036 (0.7455184387749639) | > loss_feat: 6.625952243804932 (5.9929188670397835) | > loss_mel: 21.4959774017334 (20.343612933981007) | > loss_duration: 1.2820160388946533 (1.3059931623524634) | > loss_1: 33.23321533203125 (30.58877315192387) | > grad_norm_1: tensor(2305.4656, device='cuda:0') (tensor(16404.7520, device='cuda:0')) | > current_lr_0: 5.081704015251704e-05 | > current_lr_1: 5.0867885789168996e-05 | > step_time: 0.3071 (0.5667833459788355) | > loader_time: 0.0022 (0.01555045719804435)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8973026275634766 (2.8973026275634766) | > loss_disc_real_0: 0.31071174144744873 (0.31071174144744873) | > loss_disc_real_1: 0.33641958236694336 (0.33641958236694336) | > loss_disc_real_2: 0.19024690985679626 (0.19024690985679626) | > loss_disc_real_3: 0.26081332564353943 (0.26081332564353943) | > loss_disc_real_4: 0.31829512119293213 (0.31829512119293213) | > loss_disc_real_5: 0.3600575625896454 (0.3600575625896454) | > loss_0: 2.8973026275634766 (2.8973026275634766) | > loss_gen: 2.2402186393737793 (2.2402186393737793) | > loss_kl: 5.651279449462891 (5.651279449462891) | > loss_feat: 7.7055277824401855 (7.7055277824401855) | > loss_mel: 24.29380989074707 (24.29380989074707) | > loss_duration: 3.1464765071868896 (3.1464765071868896) | > loss_1: 43.037315368652344 (43.037315368652344)  --> STEP: 1 | > loss_disc: 2.523833990097046 (2.523833990097046) | > loss_disc_real_0: 0.0439145490527153 (0.0439145490527153) | > loss_disc_real_1: 0.07087836414575577 (0.07087836414575577) | > loss_disc_real_2: 0.07159074395895004 (0.07159074395895004) | > loss_disc_real_3: 0.07228045165538788 (0.07228045165538788) | > loss_disc_real_4: 0.053830649703741074 (0.053830649703741074) | > loss_disc_real_5: 0.04571026191115379 (0.04571026191115379) | > loss_0: 2.523833990097046 (2.523833990097046) | > loss_gen: 1.280309796333313 (1.280309796333313) | > loss_kl: 5.921215534210205 (5.921215534210205) | > loss_feat: 11.296453475952148 (11.296453475952148) | > loss_mel: 24.47809600830078 (24.47809600830078) | > loss_duration: 3.519670248031616 (3.519670248031616) | > loss_1: 46.49574279785156 (46.49574279785156)  --> STEP: 2 | > loss_disc: 2.2897653579711914 (2.4067996740341187) | > loss_disc_real_0: 0.13367752730846405 (0.08879603818058968) | > loss_disc_real_1: 0.2448911964893341 (0.15788478031754494) | > loss_disc_real_2: 0.1762394905090332 (0.12391511723399162) | > loss_disc_real_3: 0.30472761392593384 (0.18850403279066086) | > loss_disc_real_4: 0.179690420627594 (0.11676053516566753) | > loss_disc_real_5: 0.1625383496284485 (0.10412430576980114) | > loss_0: 2.2897653579711914 (2.4067996740341187) | > loss_gen: 3.0671088695526123 (2.1737093329429626) | > loss_kl: 7.056272029876709 (6.488743782043457) | > loss_feat: 10.789690971374512 (11.04307222366333) | > loss_mel: 24.9480037689209 (24.71304988861084) | > loss_duration: 3.420689344406128 (3.470179796218872) | > loss_1: 49.28176498413086 (47.88875389099121)  --> STEP: 3 | > loss_disc: 3.0669498443603516 (2.6268497308095298) | > loss_disc_real_0: 0.09419669210910797 (0.09059625615676244) | > loss_disc_real_1: 0.23851889371871948 (0.18476281811793646) | > loss_disc_real_2: 0.24891161918640137 (0.16558061788479486) | > loss_disc_real_3: 0.24083364009857178 (0.20594723522663116) | > loss_disc_real_4: 0.25484973192214966 (0.16279026741782823) | > loss_disc_real_5: 0.2386855185031891 (0.14897804334759712) | > loss_0: 3.0669498443603516 (2.6268497308095298) | > loss_gen: 1.3200794458389282 (1.889166037241618) | > loss_kl: 3.0403759479522705 (5.339287837346395) | > loss_feat: 0.029192620888352394 (7.3717790227383375) | > loss_mel: 1.7878118753433228 (17.071303884188335) | > loss_duration: 3.1313421726226807 (3.357233921686808) | > loss_1: 9.308801651000977 (35.02876981099447) --> EVAL PERFORMANCE | > avg_loader_time: 0.01526188850402832 (-0.0036652882893880197) | > avg_loss_disc: 2.6268497308095298 (-0.12704873085021973) | > avg_loss_disc_real_0: 0.09059625615676244 (-0.24560165653626126) | > avg_loss_disc_real_1: 0.18476281811793646 (-0.05859609693288803) | > avg_loss_disc_real_2: 0.16558061788479486 (-0.09639453639586767) | > avg_loss_disc_real_3: 0.20594723522663116 (-0.057571361462275206) | > avg_loss_disc_real_4: 0.16279026741782823 (-0.08617217962940535) | > avg_loss_disc_real_5: 0.14897804334759712 (-0.1618424567083518) | > avg_loss_0: 2.6268497308095298 (-0.12704873085021973) | > avg_loss_gen: 1.889166037241618 (-0.4563820362091062) | > avg_loss_kl: 5.339287837346395 (-0.05669697125752826) | > avg_loss_feat: 7.3717790227383375 (+1.1178172212094069) | > avg_loss_mel: 17.071303884188335 (-4.046966989835102) | > avg_loss_duration: 3.357233921686808 (+0.012297709782917998) | > avg_loss_1: 35.02876981099447 (-3.4299329121907505)  > EPOCH: 1371/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:46:47)   --> TIME: 2023-10-20 17:47:01 -- STEP: 9/50 -- GLOBAL_STEP: 121560 | > loss_disc: 2.728316307067871 (2.4023162258995905) | > loss_disc_real_0: 0.15185457468032837 (0.13179857946104473) | > loss_disc_real_1: 0.25618693232536316 (0.2254628948867321) | > loss_disc_real_2: 0.20565956830978394 (0.21962002623412344) | > loss_disc_real_3: 0.24444793164730072 (0.23286516798867118) | > loss_disc_real_4: 0.2563900351524353 (0.21547589554554886) | > loss_disc_real_5: 0.2610126733779907 (0.20641974959936407) | > loss_0: 2.728316307067871 (2.4023162258995905) | > grad_norm_0: tensor(823.2066, device='cuda:0') (tensor(525.6908, device='cuda:0')) | > loss_gen: 1.7331961393356323 (2.258357114262051) | > loss_kl: 0.6411446332931519 (0.6925796601507399) | > loss_feat: 0.8955551981925964 (5.527906958427694) | > loss_mel: 6.773853778839111 (17.03187506728702) | > loss_duration: 1.2490460872650146 (1.3210072914759319) | > loss_1: 11.29279613494873 (26.831725703345406) | > grad_norm_1: tensor(20311.7090, device='cuda:0') (tensor(25824.2480, device='cuda:0')) | > current_lr_0: 5.076624533926233e-05 | > current_lr_1: 5.081704015251704e-05 | > step_time: 0.4473 (0.6038211716545953) | > loader_time: 0.0092 (0.022182305653889973)  --> TIME: 2023-10-20 17:47:18 -- STEP: 39/50 -- GLOBAL_STEP: 121590 | > loss_disc: 3.0161023139953613 (2.4501288945858297) | > loss_disc_real_0: 0.19106422364711761 (0.13778737903787538) | > loss_disc_real_1: 0.2775591015815735 (0.22225231906542411) | > loss_disc_real_2: 0.3035718500614166 (0.2158566529934223) | > loss_disc_real_3: 0.23337185382843018 (0.24404943724855402) | > loss_disc_real_4: 0.24393264949321747 (0.2118840548568047) | > loss_disc_real_5: 0.26608362793922424 (0.22297697318479037) | > loss_0: 3.0161023139953613 (2.4501288945858297) | > grad_norm_0: tensor(639.4156, device='cuda:0') (tensor(587.6931, device='cuda:0')) | > loss_gen: 1.562286376953125 (2.2058509221443763) | > loss_kl: 0.6560311913490295 (0.7654931598748916) | > loss_feat: 0.008980786427855492 (5.398330171091052) | > loss_mel: 0.47199633717536926 (19.440177536163574) | > loss_duration: 1.3789767026901245 (1.2924189475866465) | > loss_1: 4.078271389007568 (29.102270847711807) | > grad_norm_1: tensor(42374.6367, device='cuda:0') (tensor(14453.9648, device='cuda:0')) | > current_lr_0: 5.076624533926233e-05 | > current_lr_1: 5.081704015251704e-05 | > step_time: 0.4204 (0.5684818549033924) | > loader_time: 0.0026 (0.020890309260441706)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.1176156997680664 (3.1176156997680664) | > loss_disc_real_0: 0.039689771831035614 (0.039689771831035614) | > loss_disc_real_1: 0.22481343150138855 (0.22481343150138855) | > loss_disc_real_2: 0.29085490107536316 (0.29085490107536316) | > loss_disc_real_3: 0.2458423525094986 (0.2458423525094986) | > loss_disc_real_4: 0.2814491391181946 (0.2814491391181946) | > loss_disc_real_5: 0.2546069324016571 (0.2546069324016571) | > loss_0: 3.1176156997680664 (3.1176156997680664) | > loss_gen: 1.4649975299835205 (1.4649975299835205) | > loss_kl: 6.2418532371521 (6.2418532371521) | > loss_feat: 1.9134324789047241 (1.9134324789047241) | > loss_mel: 20.01602554321289 (20.01602554321289) | > loss_duration: 3.116788864135742 (3.116788864135742) | > loss_1: 32.75309753417969 (32.75309753417969)  --> STEP: 1 | > loss_disc: 2.6586849689483643 (2.6586849689483643) | > loss_disc_real_0: 0.13971787691116333 (0.13971787691116333) | > loss_disc_real_1: 0.17973245680332184 (0.17973245680332184) | > loss_disc_real_2: 0.21677018702030182 (0.21677018702030182) | > loss_disc_real_3: 0.2122853547334671 (0.2122853547334671) | > loss_disc_real_4: 0.15042151510715485 (0.15042151510715485) | > loss_disc_real_5: 0.08269913494586945 (0.08269913494586945) | > loss_0: 2.6586849689483643 (2.6586849689483643) | > loss_gen: 1.6838996410369873 (1.6838996410369873) | > loss_kl: 6.090417861938477 (6.090417861938477) | > loss_feat: 6.776561737060547 (6.776561737060547) | > loss_mel: 21.419837951660156 (21.419837951660156) | > loss_duration: 3.6127583980560303 (3.6127583980560303) | > loss_1: 39.58347702026367 (39.58347702026367)  --> STEP: 2 | > loss_disc: 1.7518035173416138 (2.205244243144989) | > loss_disc_real_0: 0.1242443397641182 (0.13198110833764076) | > loss_disc_real_1: 0.22806720435619354 (0.2038998305797577) | > loss_disc_real_2: 0.12115028500556946 (0.16896023601293564) | > loss_disc_real_3: 0.09492266178131104 (0.15360400825738907) | > loss_disc_real_4: 0.11536017060279846 (0.13289084285497665) | > loss_disc_real_5: 0.20303694903850555 (0.1428680419921875) | > loss_0: 1.7518035173416138 (2.205244243144989) | > loss_gen: 3.041170597076416 (2.3625351190567017) | > loss_kl: 6.749025821685791 (6.419721841812134) | > loss_feat: 11.325491905212402 (9.051026821136475) | > loss_mel: 22.37282943725586 (21.896333694458008) | > loss_duration: 3.4381556510925293 (3.52545702457428) | > loss_1: 46.92667770385742 (43.25507736206055)  --> STEP: 3 | > loss_disc: 2.4103450775146484 (2.2736111879348755) | > loss_disc_real_0: 0.21775205433368683 (0.16057142366965613) | > loss_disc_real_1: 0.289397656917572 (0.2323991060256958) | > loss_disc_real_2: 0.25767895579338074 (0.19853314260641733) | > loss_disc_real_3: 0.2915235757827759 (0.199577197432518) | > loss_disc_real_4: 0.22163328528404236 (0.16247165699799856) | > loss_disc_real_5: 0.21918746829032898 (0.16830785075823465) | > loss_0: 2.4103450775146484 (2.2736111879348755) | > loss_gen: 2.420778512954712 (2.3819495836893716) | > loss_kl: 2.930875062942505 (5.256772915522258) | > loss_feat: 4.247957229614258 (7.450003623962402) | > loss_mel: 20.57456398010254 (21.45574378967285) | > loss_duration: 3.0667941570281982 (3.3725694020589194) | > loss_1: 33.240966796875 (39.917040506998696) --> EVAL PERFORMANCE | > avg_loader_time: 0.019383668899536133 (+0.0041217803955078125) | > avg_loss_disc: 2.2736111879348755 (-0.3532385428746543) | > avg_loss_disc_real_0: 0.16057142366965613 (+0.06997516751289369) | > avg_loss_disc_real_1: 0.2323991060256958 (+0.04763628790775934) | > avg_loss_disc_real_2: 0.19853314260641733 (+0.03295252472162247) | > avg_loss_disc_real_3: 0.199577197432518 (-0.006370037794113159) | > avg_loss_disc_real_4: 0.16247165699799856 (-0.000318610419829668) | > avg_loss_disc_real_5: 0.16830785075823465 (+0.01932980741063753) | > avg_loss_0: 2.2736111879348755 (-0.3532385428746543) | > avg_loss_gen: 2.3819495836893716 (+0.4927835464477537) | > avg_loss_kl: 5.256772915522258 (-0.08251492182413678) | > avg_loss_feat: 7.450003623962402 (+0.07822460122406483) | > avg_loss_mel: 21.45574378967285 (+4.384439905484516) | > avg_loss_duration: 3.3725694020589194 (+0.015335480372111299) | > avg_loss_1: 39.917040506998696 (+4.888270696004227)  > EPOCH: 1372/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:47:43)   --> TIME: 2023-10-20 17:47:59 -- STEP: 19/50 -- GLOBAL_STEP: 121620 | > loss_disc: 2.7779693603515625 (2.4187635371559546) | > loss_disc_real_0: 0.09848710149526596 (0.1385377402368345) | > loss_disc_real_1: 0.2405186891555786 (0.22585051742039228) | > loss_disc_real_2: 0.21110303699970245 (0.21138851854361987) | > loss_disc_real_3: 0.25199946761131287 (0.23018720902894674) | > loss_disc_real_4: 0.3364918828010559 (0.23582111279431142) | > loss_disc_real_5: 0.23867370188236237 (0.22104425728321075) | > loss_0: 2.7779693603515625 (2.4187635371559546) | > grad_norm_0: tensor(480.4223, device='cuda:0') (tensor(571.0957, device='cuda:0')) | > loss_gen: 2.367434501647949 (2.272197202632302) | > loss_kl: 1.0341713428497314 (0.8998726041693437) | > loss_feat: 9.245087623596191 (6.099181779121098) | > loss_mel: 22.769046783447266 (21.861030929966976) | > loss_duration: 1.3820585012435913 (1.3231096204958461) | > loss_1: 36.79779815673828 (32.455392034430254) | > grad_norm_1: tensor(11653.7061, device='cuda:0') (tensor(15805.5283, device='cuda:0')) | > current_lr_0: 5.07155012986037e-05 | > current_lr_1: 5.076624533926233e-05 | > step_time: 0.3428 (0.5411527282313296) | > loader_time: 0.0095 (0.017064822347540604)  --> TIME: 2023-10-20 17:48:13 -- STEP: 49/50 -- GLOBAL_STEP: 121650 | > loss_disc: 2.5192008018493652 (2.3962082595241316) | > loss_disc_real_0: 0.03929877281188965 (0.1268003252619992) | > loss_disc_real_1: 0.43221187591552734 (0.22912032514506456) | > loss_disc_real_2: 0.2891882061958313 (0.20030676048933244) | > loss_disc_real_3: 0.1698879450559616 (0.21441037952899933) | > loss_disc_real_4: 0.2769424319267273 (0.22537523774164064) | > loss_disc_real_5: 0.330142617225647 (0.21991715390159158) | > loss_0: 2.5192008018493652 (2.3962082595241316) | > grad_norm_0: tensor(634.7150, device='cuda:0') (tensor(543.4813, device='cuda:0')) | > loss_gen: 2.3964593410491943 (2.295712354231854) | > loss_kl: 0.4200194776058197 (0.8303942102558759) | > loss_feat: 4.935083389282227 (6.1047719909372375) | > loss_mel: 28.762643814086914 (20.846573761531285) | > loss_duration: 1.4405571222305298 (1.2938236509050642) | > loss_1: 37.95476150512695 (31.371276213198282) | > grad_norm_1: tensor(17393.1113, device='cuda:0') (tensor(17321.4922, device='cuda:0')) | > current_lr_0: 5.07155012986037e-05 | > current_lr_1: 5.076624533926233e-05 | > step_time: 1.039 (0.4859977838944416) | > loader_time: 0.423 (0.02017316526296187)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.167022943496704 (2.167022943496704) | > loss_disc_real_0: 0.12821471691131592 (0.12821471691131592) | > loss_disc_real_1: 0.14330443739891052 (0.14330443739891052) | > loss_disc_real_2: 0.1524282842874527 (0.1524282842874527) | > loss_disc_real_3: 0.21942123770713806 (0.21942123770713806) | > loss_disc_real_4: 0.1402762532234192 (0.1402762532234192) | > loss_disc_real_5: 0.14290280640125275 (0.14290280640125275) | > loss_0: 2.167022943496704 (2.167022943496704) | > loss_gen: 2.2881221771240234 (2.2881221771240234) | > loss_kl: 6.4107441902160645 (6.4107441902160645) | > loss_feat: 11.220786094665527 (11.220786094665527) | > loss_mel: 24.11249351501465 (24.11249351501465) | > loss_duration: 3.142343044281006 (3.142343044281006) | > loss_1: 47.17449188232422 (47.17449188232422)  --> STEP: 1 | > loss_disc: 3.22995662689209 (3.22995662689209) | > loss_disc_real_0: 0.30939629673957825 (0.30939629673957825) | > loss_disc_real_1: 0.28154879808425903 (0.28154879808425903) | > loss_disc_real_2: 0.3402787148952484 (0.3402787148952484) | > loss_disc_real_3: 0.2957327663898468 (0.2957327663898468) | > loss_disc_real_4: 0.3351333737373352 (0.3351333737373352) | > loss_disc_real_5: 0.37831220030784607 (0.37831220030784607) | > loss_0: 3.22995662689209 (3.22995662689209) | > loss_gen: 2.326824188232422 (2.326824188232422) | > loss_kl: 6.22011137008667 (6.22011137008667) | > loss_feat: 6.4280314445495605 (6.4280314445495605) | > loss_mel: 19.363798141479492 (19.363798141479492) | > loss_duration: 3.4568448066711426 (3.4568448066711426) | > loss_1: 37.79560852050781 (37.79560852050781)  --> STEP: 2 | > loss_disc: 1.5175726413726807 (2.3737646341323853) | > loss_disc_real_0: 0.028317086398601532 (0.1688566915690899) | > loss_disc_real_1: 0.19615085422992706 (0.23884982615709305) | > loss_disc_real_2: 0.11522603780031204 (0.22775237634778023) | > loss_disc_real_3: 0.09295009821653366 (0.19434143230319023) | > loss_disc_real_4: 0.1572442501783371 (0.24618881195783615) | > loss_disc_real_5: 0.08753833174705505 (0.23292526602745056) | > loss_0: 1.5175726413726807 (2.3737646341323853) | > loss_gen: 2.7931699752807617 (2.559997081756592) | > loss_kl: 6.619105815887451 (6.4196085929870605) | > loss_feat: 13.128705978393555 (9.778368711471558) | > loss_mel: 22.471744537353516 (20.917771339416504) | > loss_duration: 3.379556655883789 (3.418200731277466) | > loss_1: 48.39228820800781 (43.09394836425781)  --> STEP: 3 | > loss_disc: 3.0220911502838135 (2.589873472849528) | > loss_disc_real_0: 0.7179181575775146 (0.3518771802385648) | > loss_disc_real_1: 0.29172763228416443 (0.2564757615327835) | > loss_disc_real_2: 0.29202380776405334 (0.24917618681987128) | > loss_disc_real_3: 0.4416561722755432 (0.2767796789606412) | > loss_disc_real_4: 0.18661238253116608 (0.22633000214894614) | > loss_disc_real_5: 0.2579394280910492 (0.24126332004865012) | > loss_0: 3.0220911502838135 (2.589873472849528) | > loss_gen: 2.5897417068481445 (2.5699119567871094) | > loss_kl: 2.971848249435425 (5.270355145136516) | > loss_feat: 5.524188995361328 (8.36030880610148) | > loss_mel: 18.477575302124023 (20.10437266031901) | > loss_duration: 3.245587110519409 (3.360662857691447) | > loss_1: 32.80894088745117 (39.6656125386556) --> EVAL PERFORMANCE | > avg_loader_time: 0.02295653025309245 (+0.0035728613535563163) | > avg_loss_disc: 2.589873472849528 (+0.31626228491465236) | > avg_loss_disc_real_0: 0.3518771802385648 (+0.19130575656890866) | > avg_loss_disc_real_1: 0.2564757615327835 (+0.024076655507087708) | > avg_loss_disc_real_2: 0.24917618681987128 (+0.05064304421345395) | > avg_loss_disc_real_3: 0.2767796789606412 (+0.0772024815281232) | > avg_loss_disc_real_4: 0.22633000214894614 (+0.06385834515094757) | > avg_loss_disc_real_5: 0.24126332004865012 (+0.07295546929041546) | > avg_loss_0: 2.589873472849528 (+0.31626228491465236) | > avg_loss_gen: 2.5699119567871094 (+0.18796237309773778) | > avg_loss_kl: 5.270355145136516 (+0.013582229614257812) | > avg_loss_feat: 8.36030880610148 (+0.9103051821390782) | > avg_loss_mel: 20.10437266031901 (-1.35137112935384) | > avg_loss_duration: 3.360662857691447 (-0.011906544367472627) | > avg_loss_1: 39.6656125386556 (-0.2514279683430942)  > EPOCH: 1373/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:48:36)   --> TIME: 2023-10-20 17:48:56 -- STEP: 29/50 -- GLOBAL_STEP: 121680 | > loss_disc: 2.974273920059204 (2.5145732945409325) | > loss_disc_real_0: 0.2408866584300995 (0.14028737016407575) | > loss_disc_real_1: 0.2499929964542389 (0.22026008829988283) | > loss_disc_real_2: 0.25101056694984436 (0.242680835569727) | > loss_disc_real_3: 0.23654095828533173 (0.2680461504336062) | > loss_disc_real_4: 0.25977376103401184 (0.2362844649830769) | > loss_disc_real_5: 0.23967468738555908 (0.2237587840906505) | > loss_0: 2.974273920059204 (2.5145732945409325) | > grad_norm_0: tensor(274.1405, device='cuda:0') (tensor(495.1331, device='cuda:0')) | > loss_gen: 1.5562145709991455 (2.177362783201809) | > loss_kl: 0.6808029413223267 (0.7982416399594011) | > loss_feat: 0.07901640236377716 (4.824453895718887) | > loss_mel: 6.517303943634033 (19.450943839961084) | > loss_duration: 1.261537790298462 (1.2921683130593136) | > loss_1: 10.09487533569336 (28.543170221920672) | > grad_norm_1: tensor(47353.0508, device='cuda:0') (tensor(16114.0029, device='cuda:0')) | > current_lr_0: 5.066480797979076e-05 | > current_lr_1: 5.07155012986037e-05 | > step_time: 0.3183 (0.49487281667775107) | > loader_time: 0.015 (0.01555299758911133)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.8615565299987793 (2.8615565299987793) | > loss_disc_real_0: 0.17088881134986877 (0.17088881134986877) | > loss_disc_real_1: 0.3030039668083191 (0.3030039668083191) | > loss_disc_real_2: 0.2871541976928711 (0.2871541976928711) | > loss_disc_real_3: 0.27995771169662476 (0.27995771169662476) | > loss_disc_real_4: 0.2740894556045532 (0.2740894556045532) | > loss_disc_real_5: 0.2883358597755432 (0.2883358597755432) | > loss_0: 2.8615565299987793 (2.8615565299987793) | > loss_gen: 1.9024131298065186 (1.9024131298065186) | > loss_kl: 6.101010799407959 (6.101010799407959) | > loss_feat: 4.494903087615967 (4.494903087615967) | > loss_mel: 22.55727767944336 (22.55727767944336) | > loss_duration: 3.232278823852539 (3.232278823852539) | > loss_1: 38.287879943847656 (38.287879943847656)  --> STEP: 1 | > loss_disc: 2.861119270324707 (2.861119270324707) | > loss_disc_real_0: 0.2614288926124573 (0.2614288926124573) | > loss_disc_real_1: 0.24717923998832703 (0.24717923998832703) | > loss_disc_real_2: 0.3299109637737274 (0.3299109637737274) | > loss_disc_real_3: 0.2486136555671692 (0.2486136555671692) | > loss_disc_real_4: 0.3152785301208496 (0.3152785301208496) | > loss_disc_real_5: 0.154830202460289 (0.154830202460289) | > loss_0: 2.861119270324707 (2.861119270324707) | > loss_gen: 1.954520344734192 (1.954520344734192) | > loss_kl: 5.93164587020874 (5.93164587020874) | > loss_feat: 7.038980484008789 (7.038980484008789) | > loss_mel: 22.66048812866211 (22.66048812866211) | > loss_duration: 3.571136236190796 (3.571136236190796) | > loss_1: 41.15677261352539 (41.15677261352539)  --> STEP: 2 | > loss_disc: 1.9882397651672363 (2.4246795177459717) | > loss_disc_real_0: 0.18168607354164124 (0.22155748307704926) | > loss_disc_real_1: 0.1689261645078659 (0.20805270224809647) | > loss_disc_real_2: 0.1876201331615448 (0.2587655484676361) | > loss_disc_real_3: 0.07892510294914246 (0.16376937925815582) | > loss_disc_real_4: 0.07989072054624557 (0.1975846253335476) | > loss_disc_real_5: 0.04171750321984291 (0.09827385284006596) | > loss_0: 1.9882397651672363 (2.4246795177459717) | > loss_gen: 2.371903419494629 (2.1632118821144104) | > loss_kl: 6.829537868499756 (6.380591869354248) | > loss_feat: 13.795244216918945 (10.417112350463867) | > loss_mel: 22.299270629882812 (22.47987937927246) | > loss_duration: 3.483140230178833 (3.5271382331848145) | > loss_1: 48.77909469604492 (44.967933654785156)  --> STEP: 3 | > loss_disc: 2.5475924015045166 (2.46565047899882) | > loss_disc_real_0: 0.26027339696884155 (0.2344627877076467) | > loss_disc_real_1: 0.44603604078292847 (0.28738048175970715) | > loss_disc_real_2: 0.24162504076957703 (0.2530520459016164) | > loss_disc_real_3: 0.318315714597702 (0.2152848243713379) | > loss_disc_real_4: 0.22166407108306885 (0.2056111072500547) | > loss_disc_real_5: 0.20759184658527374 (0.13471318408846855) | > loss_0: 2.5475924015045166 (2.46565047899882) | > loss_gen: 2.812845468521118 (2.3797564109166465) | > loss_kl: 2.9317891597747803 (5.230990966161092) | > loss_feat: 6.249454975128174 (9.027893225351969) | > loss_mel: 20.21674919128418 (21.725502649943035) | > loss_duration: 3.2030375003814697 (3.4191046555836997) | > loss_1: 35.413875579833984 (41.78324762980143) --> EVAL PERFORMANCE | > avg_loader_time: 0.02217864990234375 (-0.0007778803507486991) | > avg_loss_disc: 2.46565047899882 (-0.12422299385070801) | > avg_loss_disc_real_0: 0.2344627877076467 (-0.1174143925309181) | > avg_loss_disc_real_1: 0.28738048175970715 (+0.030904720226923643) | > avg_loss_disc_real_2: 0.2530520459016164 (+0.00387585908174512) | > avg_loss_disc_real_3: 0.2152848243713379 (-0.061494854589303316) | > avg_loss_disc_real_4: 0.2056111072500547 (-0.02071889489889145) | > avg_loss_disc_real_5: 0.13471318408846855 (-0.10655013596018156) | > avg_loss_0: 2.46565047899882 (-0.12422299385070801) | > avg_loss_gen: 2.3797564109166465 (-0.1901555458704629) | > avg_loss_kl: 5.230990966161092 (-0.03936417897542377) | > avg_loss_feat: 9.027893225351969 (+0.6675844192504883) | > avg_loss_mel: 21.725502649943035 (+1.6211299896240234) | > avg_loss_duration: 3.4191046555836997 (+0.0584417978922529) | > avg_loss_1: 41.78324762980143 (+2.1176350911458286)  > EPOCH: 1374/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:49:30)   --> TIME: 2023-10-20 17:49:40 -- STEP: 9/50 -- GLOBAL_STEP: 121710 | > loss_disc: 2.9086074829101562 (2.4331264893213906) | > loss_disc_real_0: 0.21218407154083252 (0.11109200368324916) | > loss_disc_real_1: 0.24945493042469025 (0.19141307555966908) | > loss_disc_real_2: 0.2704034149646759 (0.23297328253587088) | > loss_disc_real_3: 0.2788469195365906 (0.2464930597278807) | > loss_disc_real_4: 0.26046034693717957 (0.19925226850642097) | > loss_disc_real_5: 0.25729626417160034 (0.17515759873721334) | > loss_0: 2.9086074829101562 (2.4331264893213906) | > grad_norm_0: tensor(1049.2427, device='cuda:0') (tensor(487.7061, device='cuda:0')) | > loss_gen: 1.7101480960845947 (2.2863042089674206) | > loss_kl: 0.7726449370384216 (0.8525560994942983) | > loss_feat: 1.0054467916488647 (6.8383668131298485) | > loss_mel: 16.83209228515625 (20.33788850572374) | > loss_duration: 1.2654733657836914 (1.2930864757961698) | > loss_1: 21.585803985595703 (31.608201768663193) | > grad_norm_1: tensor(4431.8271, device='cuda:0') (tensor(14490.3682, device='cuda:0')) | > current_lr_0: 5.0614165332123846e-05 | > current_lr_1: 5.066480797979076e-05 | > step_time: 0.4995 (0.47004519568549263) | > loader_time: 0.037 (0.016335169474283855)  --> TIME: 2023-10-20 17:49:53 -- STEP: 39/50 -- GLOBAL_STEP: 121740 | > loss_disc: 2.336839199066162 (2.5556914256169248) | > loss_disc_real_0: 0.08184045553207397 (0.15462606605619958) | > loss_disc_real_1: 0.2926679849624634 (0.22444067971828657) | > loss_disc_real_2: 0.3996507227420807 (0.23360340469158614) | > loss_disc_real_3: 0.22945211827754974 (0.24892536259423464) | > loss_disc_real_4: 0.26937541365623474 (0.242357148287388) | > loss_disc_real_5: 0.28718188405036926 (0.23405916329759818) | > loss_0: 2.336839199066162 (2.5556914256169248) | > grad_norm_0: tensor(1043.3080, device='cuda:0') (tensor(577.6252, device='cuda:0')) | > loss_gen: 2.74752140045166 (2.2259186108907065) | > loss_kl: 0.22027017176151276 (0.7809561349642582) | > loss_feat: 5.024384498596191 (5.32749343310029) | > loss_mel: 20.612070083618164 (18.285000229493168) | > loss_duration: 1.3362188339233398 (1.280401544693189) | > loss_1: 29.94046401977539 (27.899769966418926) | > grad_norm_1: tensor(30547.1445, device='cuda:0') (tensor(16611.9199, device='cuda:0')) | > current_lr_0: 5.0614165332123846e-05 | > current_lr_1: 5.066480797979076e-05 | > step_time: 1.4085 (0.44210538497337926) | > loader_time: 0.0033 (0.008979516151623845)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.7493226528167725 (2.7493226528167725) | > loss_disc_real_0: 0.18310599029064178 (0.18310599029064178) | > loss_disc_real_1: 0.19629913568496704 (0.19629913568496704) | > loss_disc_real_2: 0.1036141961812973 (0.1036141961812973) | > loss_disc_real_3: 0.10556264221668243 (0.10556264221668243) | > loss_disc_real_4: 0.08188024908304214 (0.08188024908304214) | > loss_disc_real_5: 0.11528345942497253 (0.11528345942497253) | > loss_0: 2.7493226528167725 (2.7493226528167725) | > loss_gen: 1.6771783828735352 (1.6771783828735352) | > loss_kl: 6.390053749084473 (6.390053749084473) | > loss_feat: 9.21871566772461 (9.21871566772461) | > loss_mel: 25.72119140625 (25.72119140625) | > loss_duration: 3.1987311840057373 (3.1987311840057373) | > loss_1: 46.205867767333984 (46.205867767333984)  --> STEP: 1 | > loss_disc: 2.9914515018463135 (2.9914515018463135) | > loss_disc_real_0: 0.356484055519104 (0.356484055519104) | > loss_disc_real_1: 0.2627982497215271 (0.2627982497215271) | > loss_disc_real_2: 0.2555982172489166 (0.2555982172489166) | > loss_disc_real_3: 0.2289106249809265 (0.2289106249809265) | > loss_disc_real_4: 0.2512533664703369 (0.2512533664703369) | > loss_disc_real_5: 0.2648250162601471 (0.2648250162601471) | > loss_0: 2.9914515018463135 (2.9914515018463135) | > loss_gen: 1.6551510095596313 (1.6551510095596313) | > loss_kl: 5.721053123474121 (5.721053123474121) | > loss_feat: 0.08668161183595657 (0.08668161183595657) | > loss_mel: 4.216687202453613 (4.216687202453613) | > loss_duration: 3.5034539699554443 (3.5034539699554443) | > loss_1: 15.183027267456055 (15.183027267456055)  --> STEP: 2 | > loss_disc: 2.811366558074951 (2.9014090299606323) | > loss_disc_real_0: 0.6170455813407898 (0.4867648184299469) | > loss_disc_real_1: 0.1958598643541336 (0.22932905703783035) | > loss_disc_real_2: 0.19223128259181976 (0.2239147499203682) | > loss_disc_real_3: 0.37640970945358276 (0.30266016721725464) | > loss_disc_real_4: 0.173774853348732 (0.21251410990953445) | > loss_disc_real_5: 0.27018341422080994 (0.2675042152404785) | > loss_0: 2.811366558074951 (2.9014090299606323) | > loss_gen: 2.9223897457122803 (2.288770377635956) | > loss_kl: 6.850741863250732 (6.285897493362427) | > loss_feat: 8.786995887756348 (4.436838749796152) | > loss_mel: 22.740169525146484 (13.478428363800049) | > loss_duration: 3.535736322402954 (3.519595146179199) | > loss_1: 44.83603286743164 (30.009530067443848)  --> STEP: 3 | > loss_disc: 2.6332271099090576 (2.8120150566101074) | > loss_disc_real_0: 0.30689090490341187 (0.42680684725443524) | > loss_disc_real_1: 0.2010210156440735 (0.2198930432399114) | > loss_disc_real_2: 0.2615104615688324 (0.2364466538031896) | > loss_disc_real_3: 0.25041770935058594 (0.28524601459503174) | > loss_disc_real_4: 0.2705201506614685 (0.2318494568268458) | > loss_disc_real_5: 0.37178072333335876 (0.3022630512714386) | > loss_0: 2.6332271099090576 (2.8120150566101074) | > loss_gen: 2.3138554096221924 (2.297132054964701) | > loss_kl: 2.931800127029419 (5.167865037918091) | > loss_feat: 3.2549889087677 (4.042888802786668) | > loss_mel: 23.016483306884766 (16.657780011494953) | > loss_duration: 3.1388394832611084 (3.392676591873169) | > loss_1: 34.655967712402344 (31.558342615763348) --> EVAL PERFORMANCE | > avg_loader_time: 0.014571348826090494 (-0.007607301076253256) | > avg_loss_disc: 2.8120150566101074 (+0.3463645776112876) | > avg_loss_disc_real_0: 0.42680684725443524 (+0.19234405954678854) | > avg_loss_disc_real_1: 0.2198930432399114 (-0.06748743851979574) | > avg_loss_disc_real_2: 0.2364466538031896 (-0.01660539209842679) | > avg_loss_disc_real_3: 0.28524601459503174 (+0.06996119022369385) | > avg_loss_disc_real_4: 0.2318494568268458 (+0.02623834957679111) | > avg_loss_disc_real_5: 0.3022630512714386 (+0.16754986718297005) | > avg_loss_0: 2.8120150566101074 (+0.3463645776112876) | > avg_loss_gen: 2.297132054964701 (-0.08262435595194528) | > avg_loss_kl: 5.167865037918091 (-0.063125928243001) | > avg_loss_feat: 4.042888802786668 (-4.985004422565301) | > avg_loss_mel: 16.657780011494953 (-5.067722638448082) | > avg_loss_duration: 3.392676591873169 (-0.026428063710530747) | > avg_loss_1: 31.558342615763348 (-10.224905014038082)  > EPOCH: 1375/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:50:20)   --> TIME: 2023-10-20 17:50:52 -- STEP: 19/50 -- GLOBAL_STEP: 121770 | > loss_disc: 2.521094799041748 (2.5731353697023893) | > loss_disc_real_0: 0.13358095288276672 (0.1790876455703064) | > loss_disc_real_1: 0.1747296005487442 (0.21912326350023872) | > loss_disc_real_2: 0.2265508621931076 (0.23899381588164129) | > loss_disc_real_3: 0.2438175231218338 (0.22642172539704725) | > loss_disc_real_4: 0.23721376061439514 (0.21572072529479078) | > loss_disc_real_5: 0.3299710154533386 (0.21871139040510906) | > loss_0: 2.521094799041748 (2.5731353697023893) | > grad_norm_0: tensor(788.8547, device='cuda:0') (tensor(705.6164, device='cuda:0')) | > loss_gen: 1.9619393348693848 (2.0691121502926477) | > loss_kl: 0.9742591977119446 (0.8798368322221857) | > loss_feat: 3.488682508468628 (4.699748763324399) | > loss_mel: 19.251161575317383 (18.807472787405317) | > loss_duration: 1.3410422801971436 (1.314263996325041) | > loss_1: 27.0170841217041 (27.770434856414795) | > grad_norm_1: tensor(3922.2124, device='cuda:0') (tensor(23218.5723, device='cuda:0')) | > current_lr_0: 5.056357330495399e-05 | > current_lr_1: 5.0614165332123846e-05 | > step_time: 0.7051 (0.8380732536315918) | > loader_time: 0.0276 (0.02787866090473376)  --> TIME: 2023-10-20 17:51:09 -- STEP: 49/50 -- GLOBAL_STEP: 121800 | > loss_disc: 2.000836133956909 (2.5155730077198575) | > loss_disc_real_0: 0.04347693920135498 (0.1618125342897007) | > loss_disc_real_1: 0.19723641872406006 (0.22285723716628794) | > loss_disc_real_2: 0.16059836745262146 (0.21770546459877976) | > loss_disc_real_3: 0.17666985094547272 (0.22617487487744312) | > loss_disc_real_4: 0.13031870126724243 (0.23319845133442052) | > loss_disc_real_5: 0.27350538969039917 (0.24127210326948945) | > loss_0: 2.000836133956909 (2.5155730077198575) | > grad_norm_0: tensor(567.9366, device='cuda:0') (tensor(673.8498, device='cuda:0')) | > loss_gen: 2.411764144897461 (2.1741523864317904) | > loss_kl: 0.7077566385269165 (0.7901987897384227) | > loss_feat: 5.067411422729492 (5.354242802958709) | > loss_mel: 21.889907836914062 (19.173844427478553) | > loss_duration: 1.3452509641647339 (1.2909190131693469) | > loss_1: 31.422090530395508 (28.783357474268698) | > grad_norm_1: tensor(13174.7051, device='cuda:0') (tensor(18843.5469, device='cuda:0')) | > current_lr_0: 5.056357330495399e-05 | > current_lr_1: 5.0614165332123846e-05 | > step_time: 0.4226 (0.646067273860075) | > loader_time: 0.6664 (0.03437035424368723)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.2476470470428467 (2.2476470470428467) | > loss_disc_real_0: 0.17233744263648987 (0.17233744263648987) | > loss_disc_real_1: 0.15232884883880615 (0.15232884883880615) | > loss_disc_real_2: 0.19184117019176483 (0.19184117019176483) | > loss_disc_real_3: 0.306266725063324 (0.306266725063324) | > loss_disc_real_4: 0.13648173213005066 (0.13648173213005066) | > loss_disc_real_5: 0.16331306099891663 (0.16331306099891663) | > loss_0: 2.2476470470428467 (2.2476470470428467) | > loss_gen: 2.485825538635254 (2.485825538635254) | > loss_kl: 5.73193359375 (5.73193359375) | > loss_feat: 8.861767768859863 (8.861767768859863) | > loss_mel: 23.410232543945312 (23.410232543945312) | > loss_duration: 3.15114688873291 (3.15114688873291) | > loss_1: 43.64090347290039 (43.64090347290039)  --> STEP: 1 | > loss_disc: 3.3106088638305664 (3.3106088638305664) | > loss_disc_real_0: 0.22158363461494446 (0.22158363461494446) | > loss_disc_real_1: 0.21789944171905518 (0.21789944171905518) | > loss_disc_real_2: 0.265663206577301 (0.265663206577301) | > loss_disc_real_3: 0.3232603371143341 (0.3232603371143341) | > loss_disc_real_4: 0.23399652540683746 (0.23399652540683746) | > loss_disc_real_5: 0.30691149830818176 (0.30691149830818176) | > loss_0: 3.3106088638305664 (3.3106088638305664) | > loss_gen: 1.4812260866165161 (1.4812260866165161) | > loss_kl: 6.055269718170166 (6.055269718170166) | > loss_feat: 2.9787256717681885 (2.9787256717681885) | > loss_mel: 17.793682098388672 (17.793682098388672) | > loss_duration: 3.5721278190612793 (3.5721278190612793) | > loss_1: 31.881032943725586 (31.881032943725586)  --> STEP: 2 | > loss_disc: 3.098052501678467 (3.2043306827545166) | > loss_disc_real_0: 0.5411968231201172 (0.3813902288675308) | > loss_disc_real_1: 0.2779856026172638 (0.24794252216815948) | > loss_disc_real_2: 0.4230702221393585 (0.3443667143583298) | > loss_disc_real_3: 0.32727691531181335 (0.32526862621307373) | > loss_disc_real_4: 0.3190858066082001 (0.27654116600751877) | > loss_disc_real_5: 0.38214215636253357 (0.34452682733535767) | > loss_0: 3.098052501678467 (3.2043306827545166) | > loss_gen: 2.835869073867798 (2.158547580242157) | > loss_kl: 7.044577121734619 (6.549923419952393) | > loss_feat: 4.137491226196289 (3.5581084489822388) | > loss_mel: 26.084209442138672 (21.938945770263672) | > loss_duration: 3.349365234375 (3.4607465267181396) | > loss_1: 43.45151138305664 (37.66627216339111)  --> STEP: 3 | > loss_disc: 3.0548930168151855 (3.1545181274414062) | > loss_disc_real_0: 0.33818817138671875 (0.36698954304059345) | > loss_disc_real_1: 0.3220883905887604 (0.2726578116416931) | > loss_disc_real_2: 0.2847469747066498 (0.3244934678077698) | > loss_disc_real_3: 0.2735210657119751 (0.3080194393793742) | > loss_disc_real_4: 0.27368319034576416 (0.2755885074536006) | > loss_disc_real_5: 0.4071199893951416 (0.36539121468861896) | > loss_0: 3.0548930168151855 (3.1545181274414062) | > loss_gen: 2.2282657623291016 (2.1817869742711387) | > loss_kl: 2.8017001152038574 (5.300515651702881) | > loss_feat: 4.444685459136963 (3.8536341190338135) | > loss_mel: 21.95913314819336 (21.945674896240234) | > loss_duration: 3.145986318588257 (3.355826457341512) | > loss_1: 34.579769134521484 (36.63743782043457) --> EVAL PERFORMANCE | > avg_loader_time: 0.012287060419718424 (-0.0022842884063720703) | > avg_loss_disc: 3.1545181274414062 (+0.34250307083129883) | > avg_loss_disc_real_0: 0.36698954304059345 (-0.05981730421384179) | > avg_loss_disc_real_1: 0.2726578116416931 (+0.05276476840178171) | > avg_loss_disc_real_2: 0.3244934678077698 (+0.08804681400458017) | > avg_loss_disc_real_3: 0.3080194393793742 (+0.022773424784342466) | > avg_loss_disc_real_4: 0.2755885074536006 (+0.04373905062675479) | > avg_loss_disc_real_5: 0.36539121468861896 (+0.06312816341718036) | > avg_loss_0: 3.1545181274414062 (+0.34250307083129883) | > avg_loss_gen: 2.1817869742711387 (-0.11534508069356253) | > avg_loss_kl: 5.300515651702881 (+0.13265061378479004) | > avg_loss_feat: 3.8536341190338135 (-0.18925468375285437) | > avg_loss_mel: 21.945674896240234 (+5.287894884745281) | > avg_loss_duration: 3.355826457341512 (-0.03685013453165675) | > avg_loss_1: 36.63743782043457 (+5.079095204671223)  > EPOCH: 1376/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:51:29)   --> TIME: 2023-10-20 17:51:55 -- STEP: 29/50 -- GLOBAL_STEP: 121830 | > loss_disc: 1.9809592962265015 (2.417439000359897) | > loss_disc_real_0: 0.10668821632862091 (0.1416527540583549) | > loss_disc_real_1: 0.1529412567615509 (0.2150021587209455) | > loss_disc_real_2: 0.10135351866483688 (0.23704644176980538) | > loss_disc_real_3: 0.14035463333129883 (0.23628080286214068) | > loss_disc_real_4: 0.10222179442644119 (0.21283542140033737) | > loss_disc_real_5: 0.05483365058898926 (0.1941321437600358) | > loss_0: 1.9809592962265015 (2.417439000359897) | > grad_norm_0: tensor(330.3307, device='cuda:0') (tensor(502.8539, device='cuda:0')) | > loss_gen: 2.2894885540008545 (2.3201858545171805) | > loss_kl: 0.8602093458175659 (0.7940624017139961) | > loss_feat: 10.253878593444824 (6.630375331781549) | > loss_mel: 20.147701263427734 (20.64701947672614) | > loss_duration: 1.2888250350952148 (1.2906184073152214) | > loss_1: 34.84010314941406 (31.682261894489155) | > grad_norm_1: tensor(4261.0151, device='cuda:0') (tensor(21199.8047, device='cuda:0')) | > current_lr_0: 5.051303184768282e-05 | > current_lr_1: 5.056357330495399e-05 | > step_time: 0.5255 (0.675588426918819) | > loader_time: 0.0018 (0.02918703802700701)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.838352680206299 (2.838352680206299) | > loss_disc_real_0: 0.17792077362537384 (0.17792077362537384) | > loss_disc_real_1: 0.2553386092185974 (0.2553386092185974) | > loss_disc_real_2: 0.26295390725135803 (0.26295390725135803) | > loss_disc_real_3: 0.2698194980621338 (0.2698194980621338) | > loss_disc_real_4: 0.2713393270969391 (0.2713393270969391) | > loss_disc_real_5: 0.24402621388435364 (0.24402621388435364) | > loss_0: 2.838352680206299 (2.838352680206299) | > loss_gen: 1.6753448247909546 (1.6753448247909546) | > loss_kl: 6.787863254547119 (6.787863254547119) | > loss_feat: 0.8385273814201355 (0.8385273814201355) | > loss_mel: 18.238771438598633 (18.238771438598633) | > loss_duration: 3.2206218242645264 (3.2206218242645264) | > loss_1: 30.761127471923828 (30.761127471923828)  --> STEP: 1 | > loss_disc: 2.853705406188965 (2.853705406188965) | > loss_disc_real_0: 0.2361014038324356 (0.2361014038324356) | > loss_disc_real_1: 0.28414154052734375 (0.28414154052734375) | > loss_disc_real_2: 0.2535022795200348 (0.2535022795200348) | > loss_disc_real_3: 0.28153958916664124 (0.28153958916664124) | > loss_disc_real_4: 0.26420915126800537 (0.26420915126800537) | > loss_disc_real_5: 0.23773053288459778 (0.23773053288459778) | > loss_0: 2.853705406188965 (2.853705406188965) | > loss_gen: 1.7660722732543945 (1.7660722732543945) | > loss_kl: 5.882192134857178 (5.882192134857178) | > loss_feat: 1.1963008642196655 (1.1963008642196655) | > loss_mel: 16.926645278930664 (16.926645278930664) | > loss_duration: 3.6377336978912354 (3.6377336978912354) | > loss_1: 29.40894317626953 (29.40894317626953)  --> STEP: 2 | > loss_disc: 1.128556251525879 (1.9911308288574219) | > loss_disc_real_0: 0.09466433525085449 (0.16538286954164505) | > loss_disc_real_1: 0.11975981295108795 (0.20195067673921585) | > loss_disc_real_2: 0.11628119647502899 (0.1848917379975319) | > loss_disc_real_3: 0.06915983557701111 (0.17534971237182617) | > loss_disc_real_4: 0.008276295848190784 (0.13624272355809808) | > loss_disc_real_5: 0.038556113839149475 (0.13814332336187363) | > loss_0: 1.128556251525879 (1.9911308288574219) | > loss_gen: 3.2958319187164307 (2.5309520959854126) | > loss_kl: 6.955156326293945 (6.4186742305755615) | > loss_feat: 15.930869102478027 (8.563584983348846) | > loss_mel: 26.559070587158203 (21.742857933044434) | > loss_duration: 3.364715814590454 (3.5012247562408447) | > loss_1: 56.10564422607422 (42.757293701171875)  --> STEP: 3 | > loss_disc: 2.9272286891937256 (2.303163448969523) | > loss_disc_real_0: 0.5481644868850708 (0.2929767419894536) | > loss_disc_real_1: 0.26461291313171387 (0.22283808887004852) | > loss_disc_real_2: 0.27539294958114624 (0.21505880852540335) | > loss_disc_real_3: 0.1905091106891632 (0.18040284514427185) | > loss_disc_real_4: 0.31243830919265747 (0.19497458543628454) | > loss_disc_real_5: 0.27112311124801636 (0.1824699193239212) | > loss_0: 2.9272286891937256 (2.303163448969523) | > loss_gen: 2.6091175079345703 (2.5570072333017984) | > loss_kl: 2.9223310947418213 (5.2532265186309814) | > loss_feat: 5.393095016479492 (7.506754994392395) | > loss_mel: 22.882150650024414 (22.12262217203776) | > loss_duration: 3.0387494564056396 (3.347066322962443) | > loss_1: 36.84544372558594 (40.78667704264323) --> EVAL PERFORMANCE | > avg_loader_time: 0.019639968872070312 (+0.007352908452351889) | > avg_loss_disc: 2.303163448969523 (-0.8513546784718833) | > avg_loss_disc_real_0: 0.2929767419894536 (-0.07401280105113983) | > avg_loss_disc_real_1: 0.22283808887004852 (-0.04981972277164459) | > avg_loss_disc_real_2: 0.21505880852540335 (-0.10943465928236643) | > avg_loss_disc_real_3: 0.18040284514427185 (-0.12761659423510235) | > avg_loss_disc_real_4: 0.19497458543628454 (-0.08061392201731604) | > avg_loss_disc_real_5: 0.1824699193239212 (-0.18292129536469776) | > avg_loss_0: 2.303163448969523 (-0.8513546784718833) | > avg_loss_gen: 2.5570072333017984 (+0.3752202590306597) | > avg_loss_kl: 5.2532265186309814 (-0.047289133071899414) | > avg_loss_feat: 7.506754994392395 (+3.6531208753585815) | > avg_loss_mel: 22.12262217203776 (+0.17694727579752723) | > avg_loss_duration: 3.347066322962443 (-0.008760134379069306) | > avg_loss_1: 40.78667704264323 (+4.1492392222086565)  > EPOCH: 1377/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:52:22)   --> TIME: 2023-10-20 17:52:37 -- STEP: 9/50 -- GLOBAL_STEP: 121860 | > loss_disc: 2.86283016204834 (2.4763762421078153) | > loss_disc_real_0: 0.1488880068063736 (0.12853693962097168) | > loss_disc_real_1: 0.21756035089492798 (0.22914165423976052) | > loss_disc_real_2: 0.26623448729515076 (0.22635072304142845) | > loss_disc_real_3: 0.24020591378211975 (0.2196305100288656) | > loss_disc_real_4: 0.25889280438423157 (0.20129929958946174) | > loss_disc_real_5: 0.280681848526001 (0.21172832366493013) | > loss_0: 2.86283016204834 (2.4763762421078153) | > grad_norm_0: tensor(738.6900, device='cuda:0') (tensor(741.9603, device='cuda:0')) | > loss_gen: 1.7072358131408691 (2.2292796770731607) | > loss_kl: 0.4566999077796936 (0.8590923315948911) | > loss_feat: 1.496954083442688 (5.648922615581089) | > loss_mel: 16.41980743408203 (20.676446808709038) | > loss_duration: 1.2554104328155518 (1.263354692194197) | > loss_1: 21.33610725402832 (30.677096048990887) | > grad_norm_1: tensor(3440.2681, device='cuda:0') (tensor(25556.6289, device='cuda:0')) | > current_lr_0: 5.046254090976255e-05 | > current_lr_1: 5.051303184768282e-05 | > step_time: 0.3919 (0.9055443869696723) | > loader_time: 0.0594 (0.039815266927083336)  --> TIME: 2023-10-20 17:52:52 -- STEP: 39/50 -- GLOBAL_STEP: 121890 | > loss_disc: 3.006625175476074 (2.4895814259847007) | > loss_disc_real_0: 0.23158320784568787 (0.1385203513961572) | > loss_disc_real_1: 0.2442484349012375 (0.2249292859282249) | > loss_disc_real_2: 0.2489822655916214 (0.2286518298280545) | > loss_disc_real_3: 0.2426680475473404 (0.234047849686482) | > loss_disc_real_4: 0.24252647161483765 (0.23988673067054686) | > loss_disc_real_5: 0.24036625027656555 (0.24229380177954832) | > loss_0: 3.006625175476074 (2.4895814259847007) | > grad_norm_0: tensor(343.0836, device='cuda:0') (tensor(602.2805, device='cuda:0')) | > loss_gen: 1.4633762836456299 (2.237244722170708) | > loss_kl: 0.460811585187912 (0.7430930657264514) | > loss_feat: 0.021900616586208344 (5.364414805594163) | > loss_mel: 0.8703052401542664 (19.772365635786297) | > loss_duration: 1.4091616868972778 (1.274612694214552) | > loss_1: 4.225555419921875 (29.39173080982306) | > grad_norm_1: tensor(69331.0625, device='cuda:0') (tensor(17790.8750, device='cuda:0')) | > current_lr_0: 5.046254090976255e-05 | > current_lr_1: 5.051303184768282e-05 | > step_time: 0.2602 (0.5595007615211682) | > loader_time: 0.009 (0.01623645195594201)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.550194263458252 (2.550194263458252) | > loss_disc_real_0: 0.04268604516983032 (0.04268604516983032) | > loss_disc_real_1: 0.15342088043689728 (0.15342088043689728) | > loss_disc_real_2: 0.3987279534339905 (0.3987279534339905) | > loss_disc_real_3: 0.3206775188446045 (0.3206775188446045) | > loss_disc_real_4: 0.17460371553897858 (0.17460371553897858) | > loss_disc_real_5: 0.1740599423646927 (0.1740599423646927) | > loss_0: 2.550194263458252 (2.550194263458252) | > loss_gen: 2.35600209236145 (2.35600209236145) | > loss_kl: 6.329399585723877 (6.329399585723877) | > loss_feat: 9.76290225982666 (9.76290225982666) | > loss_mel: 21.97876739501953 (21.97876739501953) | > loss_duration: 3.2625012397766113 (3.2625012397766113) | > loss_1: 43.689571380615234 (43.689571380615234)  --> STEP: 1 | > loss_disc: 2.433290958404541 (2.433290958404541) | > loss_disc_real_0: 0.2504608631134033 (0.2504608631134033) | > loss_disc_real_1: 0.18685835599899292 (0.18685835599899292) | > loss_disc_real_2: 0.2897736430168152 (0.2897736430168152) | > loss_disc_real_3: 0.2072424590587616 (0.2072424590587616) | > loss_disc_real_4: 0.35756152868270874 (0.35756152868270874) | > loss_disc_real_5: 0.2873018980026245 (0.2873018980026245) | > loss_0: 2.433290958404541 (2.433290958404541) | > loss_gen: 2.755831718444824 (2.755831718444824) | > loss_kl: 5.896425724029541 (5.896425724029541) | > loss_feat: 6.517816066741943 (6.517816066741943) | > loss_mel: 23.587514877319336 (23.587514877319336) | > loss_duration: 3.5765702724456787 (3.5765702724456787) | > loss_1: 42.33415603637695 (42.33415603637695)  --> STEP: 2 | > loss_disc: 3.102966547012329 (2.768128752708435) | > loss_disc_real_0: 0.5323024988174438 (0.3913816809654236) | > loss_disc_real_1: 0.27382272481918335 (0.23034054040908813) | > loss_disc_real_2: 0.318688303232193 (0.3042309731245041) | > loss_disc_real_3: 0.1994348019361496 (0.2033386304974556) | > loss_disc_real_4: 0.3921528458595276 (0.37485718727111816) | > loss_disc_real_5: 0.4067573547363281 (0.3470296263694763) | > loss_0: 3.102966547012329 (2.768128752708435) | > loss_gen: 2.4644036293029785 (2.6101176738739014) | > loss_kl: 7.571154594421387 (6.733790159225464) | > loss_feat: 6.735743522644043 (6.626779794692993) | > loss_mel: 24.40494728088379 (23.996231079101562) | > loss_duration: 3.48472261428833 (3.5306464433670044) | > loss_1: 44.660972595214844 (43.4975643157959)  --> STEP: 3 | > loss_disc: 3.1604647636413574 (2.898907423019409) | > loss_disc_real_0: 0.5695549845695496 (0.4507727821667989) | > loss_disc_real_1: 0.2833935022354126 (0.24802486101786295) | > loss_disc_real_2: 0.3328019678592682 (0.3137546380360921) | > loss_disc_real_3: 0.2663246989250183 (0.2243339866399765) | > loss_disc_real_4: 0.25747233629226685 (0.33572890361150104) | > loss_disc_real_5: 0.24612939357757568 (0.3133962154388428) | > loss_0: 3.1604647636413574 (2.898907423019409) | > loss_gen: 2.036609649658203 (2.4189483324686685) | > loss_kl: 2.7437949180603027 (5.403791745503743) | > loss_feat: 0.6836097836494446 (4.645723124345143) | > loss_mel: 15.855581283569336 (21.282681147257488) | > loss_duration: 3.153291702270508 (3.4048615296681723) | > loss_1: 24.47288703918457 (37.156005223592125) --> EVAL PERFORMANCE | > avg_loader_time: 0.00848849614461263 (-0.011151472727457682) | > avg_loss_disc: 2.898907423019409 (+0.5957439740498862) | > avg_loss_disc_real_0: 0.4507727821667989 (+0.15779604017734528) | > avg_loss_disc_real_1: 0.24802486101786295 (+0.025186772147814424) | > avg_loss_disc_real_2: 0.3137546380360921 (+0.09869582951068875) | > avg_loss_disc_real_3: 0.2243339866399765 (+0.04393114149570465) | > avg_loss_disc_real_4: 0.33572890361150104 (+0.1407543181752165) | > avg_loss_disc_real_5: 0.3133962154388428 (+0.13092629611492157) | > avg_loss_0: 2.898907423019409 (+0.5957439740498862) | > avg_loss_gen: 2.4189483324686685 (-0.13805890083312988) | > avg_loss_kl: 5.403791745503743 (+0.15056522687276175) | > avg_loss_feat: 4.645723124345143 (-2.8610318700472517) | > avg_loss_mel: 21.282681147257488 (-0.8399410247802734) | > avg_loss_duration: 3.4048615296681723 (+0.05779520670572946) | > avg_loss_1: 37.156005223592125 (-3.630671819051102)  > EPOCH: 1378/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:53:07)   --> TIME: 2023-10-20 17:53:26 -- STEP: 19/50 -- GLOBAL_STEP: 121920 | > loss_disc: 2.0707406997680664 (2.296970430173372) | > loss_disc_real_0: 0.031247852370142937 (0.10298184677958488) | > loss_disc_real_1: 0.18584473431110382 (0.21640194677992872) | > loss_disc_real_2: 0.23918767273426056 (0.2308824060386733) | > loss_disc_real_3: 0.2671046257019043 (0.2321916379426655) | > loss_disc_real_4: 0.1419631391763687 (0.20430074313557461) | > loss_disc_real_5: 0.27844029664993286 (0.21363004846008202) | > loss_0: 2.0707406997680664 (2.296970430173372) | > grad_norm_0: tensor(276.1124, device='cuda:0') (tensor(513.9225, device='cuda:0')) | > loss_gen: 2.7789008617401123 (2.485452746090136) | > loss_kl: 1.2831250429153442 (0.808041966275165) | > loss_feat: 6.385804176330566 (7.471733733227379) | > loss_mel: 22.347137451171875 (23.581142274956953) | > loss_duration: 1.4155840873718262 (1.3236791836588007) | > loss_1: 34.21055221557617 (35.670049667358406) | > grad_norm_1: tensor(3538.5959, device='cuda:0') (tensor(23337.3809, device='cuda:0')) | > current_lr_0: 5.041210044069594e-05 | > current_lr_1: 5.046254090976255e-05 | > step_time: 0.4917 (0.6636371110614977) | > loader_time: 0.0251 (0.027535789891293173)  --> TIME: 2023-10-20 17:53:47 -- STEP: 49/50 -- GLOBAL_STEP: 121950 | > loss_disc: 2.7087910175323486 (2.385278261437708) | > loss_disc_real_0: 0.05960666760802269 (0.12666563412212595) | > loss_disc_real_1: 0.2522774934768677 (0.22230703626968423) | > loss_disc_real_2: 0.14336277544498444 (0.2230187690987879) | > loss_disc_real_3: 0.30719804763793945 (0.22699513065875793) | > loss_disc_real_4: 0.27856239676475525 (0.22473108082325483) | > loss_disc_real_5: 0.25091224908828735 (0.2236276629323862) | > loss_0: 2.7087910175323486 (2.385278261437708) | > grad_norm_0: tensor(690.5997, device='cuda:0') (tensor(537.1163, device='cuda:0')) | > loss_gen: 1.7395931482315063 (2.3087370882228937) | > loss_kl: 0.6006031036376953 (0.7800248605864387) | > loss_feat: 1.7394200563430786 (6.004217586803193) | > loss_mel: 20.593700408935547 (20.664480155828052) | > loss_duration: 1.3942975997924805 (1.2861459303875358) | > loss_1: 26.067615509033203 (31.043605278949357) | > grad_norm_1: tensor(2437.0293, device='cuda:0') (tensor(16322.3125, device='cuda:0')) | > current_lr_0: 5.041210044069594e-05 | > current_lr_1: 5.046254090976255e-05 | > step_time: 0.8672 (0.6707148795225181) | > loader_time: 0.4195 (0.03232319014413016)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0916812419891357 (3.0916812419891357) | > loss_disc_real_0: 0.590829074382782 (0.590829074382782) | > loss_disc_real_1: 0.24104732275009155 (0.24104732275009155) | > loss_disc_real_2: 0.30278852581977844 (0.30278852581977844) | > loss_disc_real_3: 0.3284233510494232 (0.3284233510494232) | > loss_disc_real_4: 0.37660306692123413 (0.37660306692123413) | > loss_disc_real_5: 0.2460634857416153 (0.2460634857416153) | > loss_0: 3.0916812419891357 (3.0916812419891357) | > loss_gen: 2.3211138248443604 (2.3211138248443604) | > loss_kl: 7.303217887878418 (7.303217887878418) | > loss_feat: 5.055123805999756 (5.055123805999756) | > loss_mel: 19.662086486816406 (19.662086486816406) | > loss_duration: 3.202730655670166 (3.202730655670166) | > loss_1: 37.544273376464844 (37.544273376464844)  --> STEP: 1 | > loss_disc: 2.4471659660339355 (2.4471659660339355) | > loss_disc_real_0: 0.26751458644866943 (0.26751458644866943) | > loss_disc_real_1: 0.24314282834529877 (0.24314282834529877) | > loss_disc_real_2: 0.22444450855255127 (0.22444450855255127) | > loss_disc_real_3: 0.24857069551944733 (0.24857069551944733) | > loss_disc_real_4: 0.3442997634410858 (0.3442997634410858) | > loss_disc_real_5: 0.2261161208152771 (0.2261161208152771) | > loss_0: 2.4471659660339355 (2.4471659660339355) | > loss_gen: 2.681945323944092 (2.681945323944092) | > loss_kl: 6.5466532707214355 (6.5466532707214355) | > loss_feat: 7.302380561828613 (7.302380561828613) | > loss_mel: 22.73029136657715 (22.73029136657715) | > loss_duration: 3.7087044715881348 (3.7087044715881348) | > loss_1: 42.969974517822266 (42.969974517822266)  --> STEP: 2 | > loss_disc: 3.000676393508911 (2.7239211797714233) | > loss_disc_real_0: 0.23942360281944275 (0.2534690946340561) | > loss_disc_real_1: 0.2592729330062866 (0.2512078806757927) | > loss_disc_real_2: 0.27658286690711975 (0.2505136877298355) | > loss_disc_real_3: 0.29775139689445496 (0.27316104620695114) | > loss_disc_real_4: 0.26347973942756653 (0.30388975143432617) | > loss_disc_real_5: 0.2500056028366089 (0.238060861825943) | > loss_0: 3.000676393508911 (2.7239211797714233) | > loss_gen: 1.592698574066162 (2.137321949005127) | > loss_kl: 7.162337779998779 (6.854495525360107) | > loss_feat: 0.01654728129506111 (3.659463921561837) | > loss_mel: 0.6645048260688782 (11.697398096323013) | > loss_duration: 3.4260153770446777 (3.5673599243164062) | > loss_1: 12.862104415893555 (27.91603946685791)  --> STEP: 3 | > loss_disc: 2.2450690269470215 (2.5643037954966226) | > loss_disc_real_0: 0.30691978335380554 (0.2712859908739726) | > loss_disc_real_1: 0.24430416524410248 (0.24890664219856262) | > loss_disc_real_2: 0.18443870544433594 (0.22848869363466898) | > loss_disc_real_3: 0.2983631193637848 (0.281561737259229) | > loss_disc_real_4: 0.2018604874610901 (0.2698799967765808) | > loss_disc_real_5: 0.09905534982681274 (0.19172569115956625) | > loss_0: 2.2450690269470215 (2.5643037954966226) | > loss_gen: 3.101778984069824 (2.458807627360026) | > loss_kl: 3.5570740699768066 (5.755355040232341) | > loss_feat: 6.914079666137695 (4.744335836420457) | > loss_mel: 21.301755905151367 (14.898850699265799) | > loss_duration: 3.2478089332580566 (3.4608429272969565) | > loss_1: 38.12249755859375 (31.31819216410319) --> EVAL PERFORMANCE | > avg_loader_time: 0.006063063939412435 (-0.002425432205200196) | > avg_loss_disc: 2.5643037954966226 (-0.3346036275227866) | > avg_loss_disc_real_0: 0.2712859908739726 (-0.1794867912928263) | > avg_loss_disc_real_1: 0.24890664219856262 (+0.0008817811806996756) | > avg_loss_disc_real_2: 0.22848869363466898 (-0.08526594440142313) | > avg_loss_disc_real_3: 0.281561737259229 (+0.057227750619252504) | > avg_loss_disc_real_4: 0.2698799967765808 (-0.06584890683492023) | > avg_loss_disc_real_5: 0.19172569115956625 (-0.12167052427927652) | > avg_loss_0: 2.5643037954966226 (-0.3346036275227866) | > avg_loss_gen: 2.458807627360026 (+0.03985929489135742) | > avg_loss_kl: 5.755355040232341 (+0.3515632947285976) | > avg_loss_feat: 4.744335836420457 (+0.09861271207531352) | > avg_loss_mel: 14.898850699265799 (-6.38383044799169) | > avg_loss_duration: 3.4608429272969565 (+0.05598139762878418) | > avg_loss_1: 31.31819216410319 (-5.8378130594889335)  > EPOCH: 1379/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:54:02)   --> TIME: 2023-10-20 17:54:28 -- STEP: 29/50 -- GLOBAL_STEP: 121980 | > loss_disc: 2.9105818271636963 (2.519162239699529) | > loss_disc_real_0: 0.17045989632606506 (0.14283623196313094) | > loss_disc_real_1: 0.3288685381412506 (0.21548255247160278) | > loss_disc_real_2: 0.3306387960910797 (0.25456506373553445) | > loss_disc_real_3: 0.33458349108695984 (0.24965446596515592) | > loss_disc_real_4: 0.32831865549087524 (0.23869118454127475) | > loss_disc_real_5: 0.351268470287323 (0.23305310141937485) | > loss_0: 2.9105818271636963 (2.519162239699529) | > grad_norm_0: tensor(315.1952, device='cuda:0') (tensor(680.1589, device='cuda:0')) | > loss_gen: 2.2379305362701416 (2.262744369177982) | > loss_kl: 1.2267131805419922 (0.8429851747792343) | > loss_feat: 3.5817031860351562 (5.261633857763533) | > loss_mel: 21.43994903564453 (19.76421268438471) | > loss_duration: 1.318517804145813 (1.2901364277149072) | > loss_1: 29.804813385009766 (29.421712398529053) | > grad_norm_1: tensor(3297.4788, device='cuda:0') (tensor(18823.6406, device='cuda:0')) | > current_lr_0: 5.03617103900362e-05 | > current_lr_1: 5.041210044069594e-05 | > step_time: 0.4402 (0.6743227531170023) | > loader_time: 0.013 (0.019978835664946452)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.451505184173584 (2.451505184173584) | > loss_disc_real_0: 0.16605012118816376 (0.16605012118816376) | > loss_disc_real_1: 0.26758119463920593 (0.26758119463920593) | > loss_disc_real_2: 0.36671286821365356 (0.36671286821365356) | > loss_disc_real_3: 0.247451052069664 (0.247451052069664) | > loss_disc_real_4: 0.15083147585391998 (0.15083147585391998) | > loss_disc_real_5: 0.21144334971904755 (0.21144334971904755) | > loss_0: 2.451505184173584 (2.451505184173584) | > loss_gen: 2.4515774250030518 (2.4515774250030518) | > loss_kl: 6.266480445861816 (6.266480445861816) | > loss_feat: 8.85525131225586 (8.85525131225586) | > loss_mel: 22.64090919494629 (22.64090919494629) | > loss_duration: 3.073472261428833 (3.073472261428833) | > loss_1: 43.287689208984375 (43.287689208984375)  --> STEP: 1 | > loss_disc: 2.299811363220215 (2.299811363220215) | > loss_disc_real_0: 0.05409843102097511 (0.05409843102097511) | > loss_disc_real_1: 0.2273407131433487 (0.2273407131433487) | > loss_disc_real_2: 0.2397778481245041 (0.2397778481245041) | > loss_disc_real_3: 0.16684836149215698 (0.16684836149215698) | > loss_disc_real_4: 0.2076563537120819 (0.2076563537120819) | > loss_disc_real_5: 0.148018941283226 (0.148018941283226) | > loss_0: 2.299811363220215 (2.299811363220215) | > loss_gen: 1.9534130096435547 (1.9534130096435547) | > loss_kl: 6.354910373687744 (6.354910373687744) | > loss_feat: 8.024999618530273 (8.024999618530273) | > loss_mel: 22.410316467285156 (22.410316467285156) | > loss_duration: 3.585235595703125 (3.585235595703125) | > loss_1: 42.32887268066406 (42.32887268066406)  --> STEP: 2 | > loss_disc: 2.9697978496551514 (2.634804606437683) | > loss_disc_real_0: 0.2529798150062561 (0.1535391230136156) | > loss_disc_real_1: 0.2579632103443146 (0.24265196174383163) | > loss_disc_real_2: 0.2771452069282532 (0.25846152752637863) | > loss_disc_real_3: 0.23428232967853546 (0.20056534558534622) | > loss_disc_real_4: 0.2560429871082306 (0.23184967041015625) | > loss_disc_real_5: 0.22778527438640594 (0.18790210783481598) | > loss_0: 2.9697978496551514 (2.634804606437683) | > loss_gen: 1.544151782989502 (1.7487823963165283) | > loss_kl: 6.780595302581787 (6.567752838134766) | > loss_feat: 0.08650463074445724 (4.055752124637365) | > loss_mel: 3.9591329097747803 (13.184724688529968) | > loss_duration: 3.2703230381011963 (3.4277793169021606) | > loss_1: 15.640707015991211 (28.984789848327637)  --> STEP: 3 | > loss_disc: 2.224459409713745 (2.4980228741963706) | > loss_disc_real_0: 0.1821281909942627 (0.16306881234049797) | > loss_disc_real_1: 0.16190314292907715 (0.21573568880558014) | > loss_disc_real_2: 0.14218977093696594 (0.21970427532990774) | > loss_disc_real_3: 0.20098719000816345 (0.20070596039295197) | > loss_disc_real_4: 0.2612247169017792 (0.24164135257403055) | > loss_disc_real_5: 0.13450904190540314 (0.17010441919167837) | > loss_0: 2.224459409713745 (2.4980228741963706) | > loss_gen: 2.366736650466919 (1.954767147699992) | > loss_kl: 3.0796847343444824 (5.405063470204671) | > loss_feat: 6.665425777435303 (4.925643342236678) | > loss_mel: 21.507457733154297 (15.958969036738077) | > loss_duration: 3.0913844108581543 (3.3156476815541587) | > loss_1: 36.710689544677734 (31.560089747111004) > CHECKPOINT : runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000/checkpoint_122000.pth  > EVALUATION   --> STEP: 0 | > loss_disc: 2.936263084411621 (2.607582926750183) | > loss_disc_real_0: 0.28320828080177307 (0.19310367945581675) | > loss_disc_real_1: 0.36554428935050964 (0.2531878389418125) | > loss_disc_real_2: 0.3868129849433899 (0.2614814527332783) | > loss_disc_real_3: 0.2614075243473053 (0.2158813513815403) | > loss_disc_real_4: 0.3208828866481781 (0.26145173609256744) | > loss_disc_real_5: 0.2602061927318573 (0.1926298625767231) | > loss_0: 2.936263084411621 (2.607582926750183) | > loss_gen: 2.39937162399292 (2.065918266773224) | > loss_kl: 6.6634931564331055 (5.71967089176178) | > loss_feat: 7.731506824493408 (5.62710921280086) | > loss_mel: 22.373106002807617 (17.562503278255463) | > loss_duration: 3.10127329826355 (3.2620540857315063) | > loss_1: 42.26874923706055 (34.23725461959839)  --> STEP: 1 | > loss_disc: 2.803635835647583 (2.646793508529663) | > loss_disc_real_0: 0.1982073187828064 (0.19412440732121466) | > loss_disc_real_1: 0.2466258406639099 (0.251875439286232) | > loss_disc_real_2: 0.23716799914836884 (0.2566187620162964) | > loss_disc_real_3: 0.2112421989440918 (0.2149535208940506) | > loss_disc_real_4: 0.26662617921829224 (0.2624866247177124) | > loss_disc_real_5: 0.16199053823947906 (0.18650199770927428) | > loss_0: 2.803635835647583 (2.646793508529663) | > loss_gen: 1.726118803024292 (1.9979583740234375) | > loss_kl: 6.0190110206604 (5.779538917541504) | > loss_feat: 3.5056159496307373 (5.202810560166836) | > loss_mel: 19.36033821105957 (17.922070264816284) | > loss_duration: 3.5569217205047607 (3.3210276126861573) | > loss_1: 34.16800308227539 (34.22340431213379)  --> STEP: 2 | > loss_disc: 2.854403495788574 (2.681395173072815) | > loss_disc_real_0: 0.16159260272979736 (0.1887024398893118) | > loss_disc_real_1: 0.23176859319210052 (0.24852429827054343) | > loss_disc_real_2: 0.284673810005188 (0.2612946033477783) | > loss_disc_real_3: 0.254438579082489 (0.221534363925457) | > loss_disc_real_4: 0.2556340992450714 (0.2613445371389389) | > loss_disc_real_5: 0.22994714975357056 (0.19374285638332367) | > loss_0: 2.854403495788574 (2.681395173072815) | > loss_gen: 1.5876121520996094 (1.9295673370361328) | > loss_kl: 6.6010260581970215 (5.91645344098409) | > loss_feat: 0.519991397857666 (4.422340699781974) | > loss_mel: 20.1088809967041 (18.28653872013092) | > loss_duration: 3.3555538654327393 (3.326781988143921) | > loss_1: 32.173065185546875 (33.8816811243693)  --> STEP: 3 | > loss_disc: 3.0043962001800537 (2.7275381769452776) | > loss_disc_real_0: 0.23861773312091827 (0.19583319606525557) | > loss_disc_real_1: 0.2560238242149353 (0.24959565911974227) | > loss_disc_real_2: 0.272417813539505 (0.26288363337516785) | > loss_disc_real_3: 0.2397155910730362 (0.22413168208939688) | > loss_disc_real_4: 0.2549743056297302 (0.2604345040661948) | > loss_disc_real_5: 0.22881650924682617 (0.1987533782209669) | > loss_0: 3.0043962001800537 (2.7275381769452776) | > loss_gen: 1.4893832206726074 (1.8666838918413435) | > loss_kl: 2.9469594955444336 (5.492240020206997) | > loss_feat: 0.020510787144303322 (3.79350785511945) | > loss_mel: 1.4716885089874268 (15.884417261396136) | > loss_duration: 3.0998711585998535 (3.2943661553519115) | > loss_1: 9.028412818908691 (30.331214223589217) --> EVAL PERFORMANCE | > avg_loader_time: 0.42661963190351215 (+0.42055656796409974) | > avg_loss_disc: 2.7275381769452776 (+0.16323438144865499) | > avg_loss_disc_real_0: 0.19583319606525557 (-0.07545279480871703) | > avg_loss_disc_real_1: 0.24959565911974227 (+0.0006890169211796471) | > avg_loss_disc_real_2: 0.26288363337516785 (+0.03439493974049887) | > avg_loss_disc_real_3: 0.22413168208939688 (-0.05743005516983213) | > avg_loss_disc_real_4: 0.2604345040661948 (-0.009445492710386028) | > avg_loss_disc_real_5: 0.1987533782209669 (+0.007027687061400639) | > avg_loss_0: 2.7275381769452776 (+0.16323438144865499) | > avg_loss_gen: 1.8666838918413435 (-0.5921237355186824) | > avg_loss_kl: 5.492240020206997 (-0.26311502002534404) | > avg_loss_feat: 3.79350785511945 (-0.950827981301007) | > avg_loss_mel: 15.884417261396136 (+0.9855665621303373) | > avg_loss_duration: 3.2943661553519115 (-0.16647677194504507) | > avg_loss_1: 30.331214223589217 (-0.9869779405139738)  > EPOCH: 1380/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:55:01)   --> TIME: 2023-10-20 17:55:10 -- STEP: 9/50 -- GLOBAL_STEP: 122010 | > loss_disc: 2.8302507400512695 (2.309179425239563) | > loss_disc_real_0: 0.17668235301971436 (0.10892237795309888) | > loss_disc_real_1: 0.2645888924598694 (0.19572052814894253) | > loss_disc_real_2: 0.2974308729171753 (0.22216886033614477) | > loss_disc_real_3: 0.25027257204055786 (0.18782153642839855) | > loss_disc_real_4: 0.25093427300453186 (0.20098822232749727) | > loss_disc_real_5: 0.23432418704032898 (0.1973032516737779) | > loss_0: 2.8302507400512695 (2.309179425239563) | > grad_norm_0: tensor(957.2764, device='cuda:0') (tensor(605.3860, device='cuda:0')) | > loss_gen: 1.7203770875930786 (2.3302554289499917) | > loss_kl: 0.5008503198623657 (0.8536159793535868) | > loss_feat: 0.5938704609870911 (7.532956024010976) | > loss_mel: 15.280499458312988 (19.270483917660183) | > loss_duration: 1.3020132780075073 (1.2961188157399495) | > loss_1: 19.397611618041992 (31.283429357740616) | > grad_norm_1: tensor(9391.3311, device='cuda:0') (tensor(17334.0137, device='cuda:0')) | > current_lr_0: 5.0311370707386974e-05 | > current_lr_1: 5.03617103900362e-05 | > step_time: 0.3524 (0.4908405409918891) | > loader_time: 0.008 (0.011358208126491971)  --> TIME: 2023-10-20 17:55:24 -- STEP: 39/50 -- GLOBAL_STEP: 122040 | > loss_disc: 1.7644317150115967 (2.381007683582795) | > loss_disc_real_0: 0.04521317780017853 (0.13098711766398108) | > loss_disc_real_1: 0.29353803396224976 (0.22188821654671279) | > loss_disc_real_2: 0.19697479903697968 (0.2140866770194127) | > loss_disc_real_3: 0.21248680353164673 (0.2247730778195919) | > loss_disc_real_4: 0.21225932240486145 (0.21112758145691493) | > loss_disc_real_5: 0.12581978738307953 (0.2128933585033967) | > loss_0: 1.7644317150115967 (2.381007683582795) | > grad_norm_0: tensor(571.7855, device='cuda:0') (tensor(630.6606, device='cuda:0')) | > loss_gen: 3.143928289413452 (2.2729504903157554) | > loss_kl: 0.2645694613456726 (0.8052129317552615) | > loss_feat: 7.9994707107543945 (5.943443989715514) | > loss_mel: 23.654903411865234 (19.93584212737206) | > loss_duration: 1.3849339485168457 (1.2895122277430997) | > loss_1: 36.44780349731445 (30.246961520268368) | > grad_norm_1: tensor(17984.9082, device='cuda:0') (tensor(18965.0430, device='cuda:0')) | > current_lr_0: 5.0311370707386974e-05 | > current_lr_1: 5.03617103900362e-05 | > step_time: 0.3686 (0.44617969561845827) | > loader_time: 0.0068 (0.010573032574775891)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.9028358459472656 (2.9028358459472656) | > loss_disc_real_0: 0.45672285556793213 (0.45672285556793213) | > loss_disc_real_1: 0.2733345031738281 (0.2733345031738281) | > loss_disc_real_2: 0.3655342161655426 (0.3655342161655426) | > loss_disc_real_3: 0.2993573844432831 (0.2993573844432831) | > loss_disc_real_4: 0.14093996584415436 (0.14093996584415436) | > loss_disc_real_5: 0.26428765058517456 (0.26428765058517456) | > loss_0: 2.9028358459472656 (2.9028358459472656) | > loss_gen: 2.262662887573242 (2.262662887573242) | > loss_kl: 6.4786858558654785 (6.4786858558654785) | > loss_feat: 7.7924628257751465 (7.7924628257751465) | > loss_mel: 22.811342239379883 (22.811342239379883) | > loss_duration: 3.18872332572937 (3.18872332572937) | > loss_1: 42.533878326416016 (42.533878326416016)  --> STEP: 1 | > loss_disc: 2.352952003479004 (2.352952003479004) | > loss_disc_real_0: 0.13455867767333984 (0.13455867767333984) | > loss_disc_real_1: 0.18522927165031433 (0.18522927165031433) | > loss_disc_real_2: 0.21336905658245087 (0.21336905658245087) | > loss_disc_real_3: 0.1890202909708023 (0.1890202909708023) | > loss_disc_real_4: 0.10998997092247009 (0.10998997092247009) | > loss_disc_real_5: 0.06411927938461304 (0.06411927938461304) | > loss_0: 2.352952003479004 (2.352952003479004) | > loss_gen: 2.0383222103118896 (2.0383222103118896) | > loss_kl: 6.437880516052246 (6.437880516052246) | > loss_feat: 8.220980644226074 (8.220980644226074) | > loss_mel: 27.567243576049805 (27.567243576049805) | > loss_duration: 3.7399208545684814 (3.7399208545684814) | > loss_1: 48.00434875488281 (48.00434875488281)  --> STEP: 2 | > loss_disc: 2.2968435287475586 (2.3248977661132812) | > loss_disc_real_0: 0.4047006368637085 (0.26962965726852417) | > loss_disc_real_1: 0.1340351700782776 (0.15963222086429596) | > loss_disc_real_2: 0.22587230801582336 (0.21962068229913712) | > loss_disc_real_3: 0.2952224016189575 (0.2421213462948799) | > loss_disc_real_4: 0.07912574708461761 (0.09455785900354385) | > loss_disc_real_5: 0.24034211039543152 (0.15223069489002228) | > loss_0: 2.2968435287475586 (2.3248977661132812) | > loss_gen: 3.83134126663208 (2.934831738471985) | > loss_kl: 6.666046142578125 (6.5519633293151855) | > loss_feat: 10.20473861694336 (9.212859630584717) | > loss_mel: 22.408193588256836 (24.98771858215332) | > loss_duration: 3.3343799114227295 (3.5371503829956055) | > loss_1: 46.444698333740234 (47.22452354431152)  --> STEP: 3 | > loss_disc: 2.8202757835388184 (2.4900237719217935) | > loss_disc_real_0: 0.3322525918483734 (0.29050396879514057) | > loss_disc_real_1: 0.3291976749897003 (0.2161540389060974) | > loss_disc_real_2: 0.3697676360607147 (0.26966966688632965) | > loss_disc_real_3: 0.42743247747421265 (0.3038917233546575) | > loss_disc_real_4: 0.29661568999290466 (0.16191046933333078) | > loss_disc_real_5: 0.22611263394355774 (0.17685800790786743) | > loss_0: 2.8202757835388184 (2.4900237719217935) | > loss_gen: 2.879626750946045 (2.9164300759633384) | > loss_kl: 3.069344997406006 (5.391090552012126) | > loss_feat: 4.858494281768799 (7.761404514312744) | > loss_mel: 22.864534378051758 (24.279990514119465) | > loss_duration: 3.2398574352264404 (3.4380527337392173) | > loss_1: 36.91185760498047 (43.78696823120117) --> EVAL PERFORMANCE | > avg_loader_time: 0.001842180887858073 (-0.42477745101565406) | > avg_loss_disc: 2.4900237719217935 (-0.2375144050234841) | > avg_loss_disc_real_0: 0.29050396879514057 (+0.094670772729885) | > avg_loss_disc_real_1: 0.2161540389060974 (-0.03344162021364486) | > avg_loss_disc_real_2: 0.26966966688632965 (+0.006786033511161804) | > avg_loss_disc_real_3: 0.3038917233546575 (+0.0797600412652606) | > avg_loss_disc_real_4: 0.16191046933333078 (-0.098524034732864) | > avg_loss_disc_real_5: 0.17685800790786743 (-0.02189537031309946) | > avg_loss_0: 2.4900237719217935 (-0.2375144050234841) | > avg_loss_gen: 2.9164300759633384 (+1.0497461841219948) | > avg_loss_kl: 5.391090552012126 (-0.1011494681948708) | > avg_loss_feat: 7.761404514312744 (+3.9678966591932943) | > avg_loss_mel: 24.279990514119465 (+8.395573252723329) | > avg_loss_duration: 3.4380527337392173 (+0.1436865783873058) | > avg_loss_1: 43.78696823120117 (+13.455754007611954)  > EPOCH: 1381/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:55:46)   --> TIME: 2023-10-20 17:56:10 -- STEP: 19/50 -- GLOBAL_STEP: 122070 | > loss_disc: 3.008836030960083 (2.496004732031571) | > loss_disc_real_0: 0.2706906199455261 (0.15617315118250094) | > loss_disc_real_1: 0.25453779101371765 (0.2112201189524249) | > loss_disc_real_2: 0.2624553442001343 (0.21562890237883517) | > loss_disc_real_3: 0.25159239768981934 (0.24389597499056867) | > loss_disc_real_4: 0.27781111001968384 (0.21128430261619782) | > loss_disc_real_5: 0.2666277289390564 (0.21901536203528704) | > loss_0: 3.008836030960083 (2.496004732031571) | > grad_norm_0: tensor(280.0549, device='cuda:0') (tensor(535.7346, device='cuda:0')) | > loss_gen: 1.5822447538375854 (2.1791891424279464) | > loss_kl: 0.5720443725585938 (0.8074535005971005) | > loss_feat: 0.013088861480355263 (5.2145826448931505) | > loss_mel: 0.6587411165237427 (17.901869949541595) | > loss_duration: 1.4341181516647339 (1.3212895016921193) | > loss_1: 4.260237216949463 (27.42438446848016) | > grad_norm_1: tensor(97699.2266, device='cuda:0') (tensor(27494.0117, device='cuda:0')) | > current_lr_0: 5.026108134240231e-05 | > current_lr_1: 5.0311370707386974e-05 | > step_time: 0.9044 (0.953585285889475) | > loader_time: 0.024 (0.03855086627759432)  --> TIME: 2023-10-20 17:56:34 -- STEP: 49/50 -- GLOBAL_STEP: 122100 | > loss_disc: 2.784275531768799 (2.488859259352392) | > loss_disc_real_0: 0.17793519794940948 (0.1426243087732974) | > loss_disc_real_1: 0.2026379257440567 (0.21461423539689609) | > loss_disc_real_2: 0.203419491648674 (0.2274157244864167) | > loss_disc_real_3: 0.36911600828170776 (0.23500100891961126) | > loss_disc_real_4: 0.24593865871429443 (0.24154684363807344) | > loss_disc_real_5: 0.4094116687774658 (0.22961205042594549) | > loss_0: 2.784275531768799 (2.488859259352392) | > grad_norm_0: tensor(573.7372, device='cuda:0') (tensor(570.1375, device='cuda:0')) | > loss_gen: 2.263160228729248 (2.238046181445219) | > loss_kl: 0.5021670460700989 (0.7512525368709954) | > loss_feat: 4.613692283630371 (5.285735168760376) | > loss_mel: 19.550132751464844 (18.032122562126233) | > loss_duration: 1.398422122001648 (1.2914576311500707) | > loss_1: 28.32757568359375 (27.598613982297937) | > grad_norm_1: tensor(17937.6484, device='cuda:0') (tensor(22185.5410, device='cuda:0')) | > current_lr_0: 5.026108134240231e-05 | > current_lr_1: 5.0311370707386974e-05 | > step_time: 0.4632 (0.822604378875421) | > loader_time: 0.4562 (0.04226304560291524)  > EVALUATION   --> STEP: 0 | > loss_disc: 1.904779076576233 (1.904779076576233) | > loss_disc_real_0: 0.1796131432056427 (0.1796131432056427) | > loss_disc_real_1: 0.2572653293609619 (0.2572653293609619) | > loss_disc_real_2: 0.15816840529441833 (0.15816840529441833) | > loss_disc_real_3: 0.1285848319530487 (0.1285848319530487) | > loss_disc_real_4: 0.2068822681903839 (0.2068822681903839) | > loss_disc_real_5: 0.1294853687286377 (0.1294853687286377) | > loss_0: 1.904779076576233 (1.904779076576233) | > loss_gen: 3.0368261337280273 (3.0368261337280273) | > loss_kl: 6.069615840911865 (6.069615840911865) | > loss_feat: 12.603611946105957 (12.603611946105957) | > loss_mel: 25.877670288085938 (25.877670288085938) | > loss_duration: 3.228428363800049 (3.228428363800049) | > loss_1: 50.8161506652832 (50.8161506652832)  --> STEP: 1 | > loss_disc: 2.3646342754364014 (2.3646342754364014) | > loss_disc_real_0: 0.16430377960205078 (0.16430377960205078) | > loss_disc_real_1: 0.22457124292850494 (0.22457124292850494) | > loss_disc_real_2: 0.22219063341617584 (0.22219063341617584) | > loss_disc_real_3: 0.2479727864265442 (0.2479727864265442) | > loss_disc_real_4: 0.25505346059799194 (0.25505346059799194) | > loss_disc_real_5: 0.21656836569309235 (0.21656836569309235) | > loss_0: 2.3646342754364014 (2.3646342754364014) | > loss_gen: 2.3582873344421387 (2.3582873344421387) | > loss_kl: 6.503458499908447 (6.503458499908447) | > loss_feat: 3.6651861667633057 (3.6651861667633057) | > loss_mel: 19.86850929260254 (19.86850929260254) | > loss_duration: 3.569446563720703 (3.569446563720703) | > loss_1: 35.96488952636719 (35.96488952636719)  --> STEP: 2 | > loss_disc: 2.8096325397491455 (2.5871334075927734) | > loss_disc_real_0: 0.09133477509021759 (0.12781927734613419) | > loss_disc_real_1: 0.20938612520694733 (0.21697868406772614) | > loss_disc_real_2: 0.3058444559574127 (0.2640175446867943) | > loss_disc_real_3: 0.2694084942340851 (0.25869064033031464) | > loss_disc_real_4: 0.2643080949783325 (0.25968077778816223) | > loss_disc_real_5: 0.24521425366401672 (0.23089130967855453) | > loss_0: 2.8096325397491455 (2.5871334075927734) | > loss_gen: 1.6687616109848022 (2.0135244727134705) | > loss_kl: 6.811373710632324 (6.657416105270386) | > loss_feat: 1.364911437034607 (2.5150488018989563) | > loss_mel: 21.618757247924805 (20.743633270263672) | > loss_duration: 3.3819985389709473 (3.475722551345825) | > loss_1: 34.845802307128906 (35.40534591674805)  --> STEP: 3 | > loss_disc: 1.871856689453125 (2.348707834879557) | > loss_disc_real_0: 0.12151825428009033 (0.12571893632411957) | > loss_disc_real_1: 0.1845112293958664 (0.20615619917710623) | > loss_disc_real_2: 0.17663459479808807 (0.2348898947238922) | > loss_disc_real_3: 0.2460370808839798 (0.2544727871815364) | > loss_disc_real_4: 0.08289678394794464 (0.20075277984142303) | > loss_disc_real_5: 0.12580621242523193 (0.195862943927447) | > loss_0: 1.871856689453125 (2.348707834879557) | > loss_gen: 2.5345497131347656 (2.1871995528539023) | > loss_kl: 2.5958328247070312 (5.303555011749268) | > loss_feat: 6.375738620758057 (3.8019454081853232) | > loss_mel: 21.802175521850586 (21.09648068745931) | > loss_duration: 3.1103224754333496 (3.3539225260416665) | > loss_1: 36.418617248535156 (35.74310302734375) --> EVAL PERFORMANCE | > avg_loader_time: 0.003495375315348307 (+0.0016531944274902342) | > avg_loss_disc: 2.348707834879557 (-0.14131593704223633) | > avg_loss_disc_real_0: 0.12571893632411957 (-0.164785032471021) | > avg_loss_disc_real_1: 0.20615619917710623 (-0.009997839728991181) | > avg_loss_disc_real_2: 0.2348898947238922 (-0.03477977216243744) | > avg_loss_disc_real_3: 0.2544727871815364 (-0.0494189361731211) | > avg_loss_disc_real_4: 0.20075277984142303 (+0.038842310508092254) | > avg_loss_disc_real_5: 0.195862943927447 (+0.01900493601957956) | > avg_loss_0: 2.348707834879557 (-0.14131593704223633) | > avg_loss_gen: 2.1871995528539023 (-0.729230523109436) | > avg_loss_kl: 5.303555011749268 (-0.08753554026285837) | > avg_loss_feat: 3.8019454081853232 (-3.959459106127421) | > avg_loss_mel: 21.09648068745931 (-3.1835098266601562) | > avg_loss_duration: 3.3539225260416665 (-0.08413020769755075) | > avg_loss_1: 35.74310302734375 (-8.043865203857422)  > EPOCH: 1382/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:56:46)   --> TIME: 2023-10-20 17:57:19 -- STEP: 29/50 -- GLOBAL_STEP: 122130 | > loss_disc: 3.417597770690918 (2.425088027427936) | > loss_disc_real_0: 0.16723576188087463 (0.13172098396924037) | > loss_disc_real_1: 0.2740964889526367 (0.22188055643747592) | > loss_disc_real_2: 0.20286227762699127 (0.2373432933256544) | > loss_disc_real_3: 0.30980196595191956 (0.24606367919979424) | > loss_disc_real_4: 0.31299781799316406 (0.21974278703845782) | > loss_disc_real_5: 0.3238169550895691 (0.21937267206095415) | > loss_0: 3.417597770690918 (2.425088027427936) | > grad_norm_0: tensor(407.4444, device='cuda:0') (tensor(502.0631, device='cuda:0')) | > loss_gen: 1.469919204711914 (2.29244628856922) | > loss_kl: 0.970404863357544 (0.9046429375122333) | > loss_feat: 3.6155264377593994 (6.167035832487303) | > loss_mel: 14.794249534606934 (20.453344047069557) | > loss_duration: 1.2752162218093872 (1.290240193235463) | > loss_1: 22.125316619873047 (31.107709095395844) | > grad_norm_1: tensor(10153.7803, device='cuda:0') (tensor(16194.7939, device='cuda:0')) | > current_lr_0: 5.0210842244786523e-05 | > current_lr_1: 5.026108134240231e-05 | > step_time: 1.1835 (0.529844070303029) | > loader_time: 0.0787 (0.014992738592213598)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1862826347351074 (2.1862826347351074) | > loss_disc_real_0: 0.12692537903785706 (0.12692537903785706) | > loss_disc_real_1: 0.18711574375629425 (0.18711574375629425) | > loss_disc_real_2: 0.1550009846687317 (0.1550009846687317) | > loss_disc_real_3: 0.22899217903614044 (0.22899217903614044) | > loss_disc_real_4: 0.102417953312397 (0.102417953312397) | > loss_disc_real_5: 0.24701696634292603 (0.24701696634292603) | > loss_0: 2.1862826347351074 (2.1862826347351074) | > loss_gen: 2.4536709785461426 (2.4536709785461426) | > loss_kl: 5.820084571838379 (5.820084571838379) | > loss_feat: 10.369032859802246 (10.369032859802246) | > loss_mel: 24.98520278930664 (24.98520278930664) | > loss_duration: 3.152268886566162 (3.152268886566162) | > loss_1: 46.78025817871094 (46.78025817871094)  --> STEP: 1 | > loss_disc: 3.5602166652679443 (3.5602166652679443) | > loss_disc_real_0: 0.37179991602897644 (0.37179991602897644) | > loss_disc_real_1: 0.3802988529205322 (0.3802988529205322) | > loss_disc_real_2: 0.3882426917552948 (0.3882426917552948) | > loss_disc_real_3: 0.3294602930545807 (0.3294602930545807) | > loss_disc_real_4: 0.37324026226997375 (0.37324026226997375) | > loss_disc_real_5: 0.349626362323761 (0.349626362323761) | > loss_0: 3.5602166652679443 (3.5602166652679443) | > loss_gen: 2.3595035076141357 (2.3595035076141357) | > loss_kl: 6.100122451782227 (6.100122451782227) | > loss_feat: 7.800718784332275 (7.800718784332275) | > loss_mel: 21.891571044921875 (21.891571044921875) | > loss_duration: 3.60337495803833 (3.60337495803833) | > loss_1: 41.75529098510742 (41.75529098510742)  --> STEP: 2 | > loss_disc: 1.900460124015808 (2.730338394641876) | > loss_disc_real_0: 0.13432444632053375 (0.2530621811747551) | > loss_disc_real_1: 0.09355569630861282 (0.23692727461457253) | > loss_disc_real_2: 0.05362742766737938 (0.2209350597113371) | > loss_disc_real_3: 0.10712385922670364 (0.21829207614064217) | > loss_disc_real_4: 0.03236269950866699 (0.20280148088932037) | > loss_disc_real_5: 0.0852324441075325 (0.21742940321564674) | > loss_0: 1.900460124015808 (2.730338394641876) | > loss_gen: 1.9257872104644775 (2.1426453590393066) | > loss_kl: 6.814802169799805 (6.457462310791016) | > loss_feat: 10.719705581665039 (9.260212182998657) | > loss_mel: 25.857513427734375 (23.874542236328125) | > loss_duration: 3.3987560272216797 (3.501065492630005) | > loss_1: 48.71656799316406 (45.23592948913574)  --> STEP: 3 | > loss_disc: 2.718657970428467 (2.7264449199040732) | > loss_disc_real_0: 0.08910910040140152 (0.1984111542503039) | > loss_disc_real_1: 0.37138256430625916 (0.2817457045118014) | > loss_disc_real_2: 0.3179420530796051 (0.2532707241674264) | > loss_disc_real_3: 0.3061559200286865 (0.2475800241033236) | > loss_disc_real_4: 0.34537893533706665 (0.25032729903856915) | > loss_disc_real_5: 0.30460405349731445 (0.24648761997620264) | > loss_0: 2.718657970428467 (2.7264449199040732) | > loss_gen: 2.394552707672119 (2.226614475250244) | > loss_kl: 2.84846568107605 (5.25446343421936) | > loss_feat: 3.569495916366577 (7.363306760787964) | > loss_mel: 17.562894821166992 (21.770659764607746) | > loss_duration: 3.056015968322754 (3.3527156511942544) | > loss_1: 29.43142318725586 (39.967760721842446) --> EVAL PERFORMANCE | > avg_loader_time: 0.002740780512491862 (-0.0007545948028564453) | > avg_loss_disc: 2.7264449199040732 (+0.3777370850245161) | > avg_loss_disc_real_0: 0.1984111542503039 (+0.07269221792618433) | > avg_loss_disc_real_1: 0.2817457045118014 (+0.07558950533469519) | > avg_loss_disc_real_2: 0.2532707241674264 (+0.018380829443534197) | > avg_loss_disc_real_3: 0.2475800241033236 (-0.006892763078212766) | > avg_loss_disc_real_4: 0.25032729903856915 (+0.049574519197146116) | > avg_loss_disc_real_5: 0.24648761997620264 (+0.050624676048755646) | > avg_loss_0: 2.7264449199040732 (+0.3777370850245161) | > avg_loss_gen: 2.226614475250244 (+0.03941492239634181) | > avg_loss_kl: 5.25446343421936 (-0.04909157752990723) | > avg_loss_feat: 7.363306760787964 (+3.5613613526026406) | > avg_loss_mel: 21.770659764607746 (+0.6741790771484375) | > avg_loss_duration: 3.3527156511942544 (-0.0012068748474121094) | > avg_loss_1: 39.967760721842446 (+4.2246576944986955)  > EPOCH: 1383/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:57:55)   --> TIME: 2023-10-20 17:58:02 -- STEP: 9/50 -- GLOBAL_STEP: 122160 | > loss_disc: 2.8582773208618164 (2.72789290216234) | > loss_disc_real_0: 0.2994535565376282 (0.15238305284745163) | > loss_disc_real_1: 0.2831462025642395 (0.2382676994634999) | > loss_disc_real_2: 0.2258344292640686 (0.2742855486770471) | > loss_disc_real_3: 0.27896374464035034 (0.24534099880192015) | > loss_disc_real_4: 0.25815171003341675 (0.22932546254661348) | > loss_disc_real_5: 0.23531289398670197 (0.23148414740959802) | > loss_0: 2.8582773208618164 (2.72789290216234) | > grad_norm_0: tensor(641.1710, device='cuda:0') (tensor(429.4801, device='cuda:0')) | > loss_gen: 1.7217671871185303 (2.1107682519488864) | > loss_kl: 0.9881936311721802 (0.6629096733199226) | > loss_feat: 1.02035653591156 (5.34903183248308) | > loss_mel: 16.726451873779297 (19.119198905097115) | > loss_duration: 1.270595908164978 (1.287472168604533) | > loss_1: 21.727365493774414 (28.52938101026747) | > grad_norm_1: tensor(3103.1570, device='cuda:0') (tensor(12743.3916, device='cuda:0')) | > current_lr_0: 5.0160653364294255e-05 | > current_lr_1: 5.0210842244786523e-05 | > step_time: 0.3619 (0.36336533228556317) | > loader_time: 0.0022 (0.0037838617960611978)  --> TIME: 2023-10-20 17:58:13 -- STEP: 39/50 -- GLOBAL_STEP: 122190 | > loss_disc: 1.9394633769989014 (2.482694332416241) | > loss_disc_real_0: 0.05651463568210602 (0.13133192580575356) | > loss_disc_real_1: 0.19667312502861023 (0.2196991989054741) | > loss_disc_real_2: 0.20976988971233368 (0.23723123929439446) | > loss_disc_real_3: 0.18659108877182007 (0.23325409315144405) | > loss_disc_real_4: 0.12639477849006653 (0.2272654355217058) | > loss_disc_real_5: 0.06667323410511017 (0.20980250692138305) | > loss_0: 1.9394633769989014 (2.482694332416241) | > grad_norm_0: tensor(471.8535, device='cuda:0') (tensor(464.3088, device='cuda:0')) | > loss_gen: 2.5272984504699707 (2.2392823787835927) | > loss_kl: 0.4112894833087921 (0.738622594338197) | > loss_feat: 5.696244716644287 (6.041601117986899) | > loss_mel: 17.998245239257812 (20.190782082386505) | > loss_duration: 1.3720654249191284 (1.2879866483883982) | > loss_1: 28.005142211914062 (30.498274778708435) | > grad_norm_1: tensor(6135.6948, device='cuda:0') (tensor(14213.4180, device='cuda:0')) | > current_lr_0: 5.0160653364294255e-05 | > current_lr_1: 5.0210842244786523e-05 | > step_time: 0.3284 (0.34374702282440966) | > loader_time: 0.0135 (0.01105869733370267)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.1344847679138184 (2.1344847679138184) | > loss_disc_real_0: 0.10081364214420319 (0.10081364214420319) | > loss_disc_real_1: 0.3637707531452179 (0.3637707531452179) | > loss_disc_real_2: 0.23458316922187805 (0.23458316922187805) | > loss_disc_real_3: 0.2635338008403778 (0.2635338008403778) | > loss_disc_real_4: 0.15086111426353455 (0.15086111426353455) | > loss_disc_real_5: 0.16282597184181213 (0.16282597184181213) | > loss_0: 2.1344847679138184 (2.1344847679138184) | > loss_gen: 2.671025276184082 (2.671025276184082) | > loss_kl: 6.9191765785217285 (6.9191765785217285) | > loss_feat: 7.964388370513916 (7.964388370513916) | > loss_mel: 22.129371643066406 (22.129371643066406) | > loss_duration: 3.163422107696533 (3.163422107696533) | > loss_1: 42.847381591796875 (42.847381591796875)  --> STEP: 1 | > loss_disc: 2.9772582054138184 (2.9772582054138184) | > loss_disc_real_0: 0.19179204106330872 (0.19179204106330872) | > loss_disc_real_1: 0.27226266264915466 (0.27226266264915466) | > loss_disc_real_2: 0.19500286877155304 (0.19500286877155304) | > loss_disc_real_3: 0.2525283098220825 (0.2525283098220825) | > loss_disc_real_4: 0.30674582719802856 (0.30674582719802856) | > loss_disc_real_5: 0.381373792886734 (0.381373792886734) | > loss_0: 2.9772582054138184 (2.9772582054138184) | > loss_gen: 1.7849860191345215 (1.7849860191345215) | > loss_kl: 6.453866481781006 (6.453866481781006) | > loss_feat: 6.239503383636475 (6.239503383636475) | > loss_mel: 21.965137481689453 (21.965137481689453) | > loss_duration: 3.5746653079986572 (3.5746653079986572) | > loss_1: 40.018157958984375 (40.018157958984375)  --> STEP: 2 | > loss_disc: 2.0982065200805664 (2.5377323627471924) | > loss_disc_real_0: 0.21583794057369232 (0.20381499081850052) | > loss_disc_real_1: 0.16108635067939758 (0.21667450666427612) | > loss_disc_real_2: 0.220387265086174 (0.20769506692886353) | > loss_disc_real_3: 0.11302980780601501 (0.18277905881404877) | > loss_disc_real_4: 0.18521982431411743 (0.245982825756073) | > loss_disc_real_5: 0.3587445616722107 (0.37005917727947235) | > loss_0: 2.0982065200805664 (2.5377323627471924) | > loss_gen: 3.089033603668213 (2.437009811401367) | > loss_kl: 6.763184070587158 (6.608525276184082) | > loss_feat: 10.693099021911621 (8.466301202774048) | > loss_mel: 22.290332794189453 (22.127735137939453) | > loss_duration: 3.4451708793640137 (3.5099180936813354) | > loss_1: 46.28082275390625 (43.14949035644531)  --> STEP: 3 | > loss_disc: 2.965080738067627 (2.6801818211873374) | > loss_disc_real_0: 0.3262764811515808 (0.24463548759619394) | > loss_disc_real_1: 0.25543317198753357 (0.2295940617720286) | > loss_disc_real_2: 0.2377413511276245 (0.2177104949951172) | > loss_disc_real_3: 0.2454349845647812 (0.20366436739762625) | > loss_disc_real_4: 0.28423845767974854 (0.25873470306396484) | > loss_disc_real_5: 0.26804912090301514 (0.33605582515398663) | > loss_0: 2.965080738067627 (2.6801818211873374) | > loss_gen: 1.7174021005630493 (2.1971405744552612) | > loss_kl: 3.2661821842193604 (5.494410912195842) | > loss_feat: 0.5679481029510498 (5.833516836166382) | > loss_mel: 5.354339122772217 (16.53660313288371) | > loss_duration: 3.139720916748047 (3.3865190347035727) | > loss_1: 14.045592308044434 (33.448191006978355) --> EVAL PERFORMANCE | > avg_loader_time: 0.002447843551635742 (-0.00029293696085611965) | > avg_loss_disc: 2.6801818211873374 (-0.04626309871673584) | > avg_loss_disc_real_0: 0.24463548759619394 (+0.046224333345890045) | > avg_loss_disc_real_1: 0.2295940617720286 (-0.052151642739772824) | > avg_loss_disc_real_2: 0.2177104949951172 (-0.03556022917230922) | > avg_loss_disc_real_3: 0.20366436739762625 (-0.04391565670569736) | > avg_loss_disc_real_4: 0.25873470306396484 (+0.008407404025395693) | > avg_loss_disc_real_5: 0.33605582515398663 (+0.089568205177784) | > avg_loss_0: 2.6801818211873374 (-0.04626309871673584) | > avg_loss_gen: 2.1971405744552612 (-0.02947390079498291) | > avg_loss_kl: 5.494410912195842 (+0.23994747797648142) | > avg_loss_feat: 5.833516836166382 (-1.529789924621582) | > avg_loss_mel: 16.53660313288371 (-5.234056631724037) | > avg_loss_duration: 3.3865190347035727 (+0.03380338350931833) | > avg_loss_1: 33.448191006978355 (-6.51956971486409)  > EPOCH: 1384/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:58:34)   --> TIME: 2023-10-20 17:58:45 -- STEP: 19/50 -- GLOBAL_STEP: 122220 | > loss_disc: 3.0252625942230225 (2.4306392105002153) | > loss_disc_real_0: 0.14924155175685883 (0.13805672232257693) | > loss_disc_real_1: 0.2324523627758026 (0.21504710457826914) | > loss_disc_real_2: 0.24643965065479279 (0.23433247894832962) | > loss_disc_real_3: 0.2442687302827835 (0.21500264970879807) | > loss_disc_real_4: 0.26722341775894165 (0.21734694822838432) | > loss_disc_real_5: 0.27640002965927124 (0.2139299402111455) | > loss_0: 3.0252625942230225 (2.4306392105002153) | > grad_norm_0: tensor(848.7969, device='cuda:0') (tensor(577.6147, device='cuda:0')) | > loss_gen: 1.4702750444412231 (2.2282824516296387) | > loss_kl: 0.97190260887146 (0.8033268843826494) | > loss_feat: 0.061493370682001114 (6.01597846475871) | > loss_mel: 1.4173177480697632 (19.319276389322784) | > loss_duration: 1.3959977626800537 (1.2943795417484485) | > loss_1: 5.316986083984375 (29.661243840267783) | > grad_norm_1: tensor(32491.2734, device='cuda:0') (tensor(19408.6445, device='cuda:0')) | > current_lr_0: 5.011051465073032e-05 | > current_lr_1: 5.0160653364294255e-05 | > step_time: 0.3329 (0.33086921039380524) | > loader_time: 0.0099 (0.011580341740658409)  --> TIME: 2023-10-20 17:58:57 -- STEP: 49/50 -- GLOBAL_STEP: 122250 | > loss_disc: 2.239004135131836 (2.4794310136717193) | > loss_disc_real_0: 0.10764048993587494 (0.14826010331055342) | > loss_disc_real_1: 0.3289130926132202 (0.2215319725931907) | > loss_disc_real_2: 0.2999017536640167 (0.23244285347814464) | > loss_disc_real_3: 0.21091124415397644 (0.23890306739782802) | > loss_disc_real_4: 0.22315074503421783 (0.23181751811382723) | > loss_disc_real_5: 0.1534857600927353 (0.22485836063112533) | > loss_0: 2.239004135131836 (2.4794310136717193) | > grad_norm_0: tensor(460.3530, device='cuda:0') (tensor(582.9113, device='cuda:0')) | > loss_gen: 2.550455093383789 (2.233837782120218) | > loss_kl: 0.029697539284825325 (0.7493231062758334) | > loss_feat: 5.244951248168945 (5.525841575343997) | > loss_mel: 23.574321746826172 (19.744057414483056) | > loss_duration: 1.407310962677002 (1.2769785924833648) | > loss_1: 32.80673599243164 (29.530038473557454) | > grad_norm_1: tensor(5091.7974, device='cuda:0') (tensor(15786.3828, device='cuda:0')) | > current_lr_0: 5.011051465073032e-05 | > current_lr_1: 5.0160653364294255e-05 | > step_time: 0.3483 (0.3571792086776422) | > loader_time: 0.6895 (0.022710104377902284)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.4659461975097656 (3.4659461975097656) | > loss_disc_real_0: 0.5007192492485046 (0.5007192492485046) | > loss_disc_real_1: 0.3958526849746704 (0.3958526849746704) | > loss_disc_real_2: 0.34608161449432373 (0.34608161449432373) | > loss_disc_real_3: 0.44868507981300354 (0.44868507981300354) | > loss_disc_real_4: 0.3334503173828125 (0.3334503173828125) | > loss_disc_real_5: 0.3585868775844574 (0.3585868775844574) | > loss_0: 3.4659461975097656 (3.4659461975097656) | > loss_gen: 2.2806472778320312 (2.2806472778320312) | > loss_kl: 6.53168249130249 (6.53168249130249) | > loss_feat: 6.097215175628662 (6.097215175628662) | > loss_mel: 23.405189514160156 (23.405189514160156) | > loss_duration: 3.2687344551086426 (3.2687344551086426) | > loss_1: 41.58346939086914 (41.58346939086914)  --> STEP: 1 | > loss_disc: 1.0403133630752563 (1.0403133630752563) | > loss_disc_real_0: 0.014957057312130928 (0.014957057312130928) | > loss_disc_real_1: 0.050164468586444855 (0.050164468586444855) | > loss_disc_real_2: 0.04976150393486023 (0.04976150393486023) | > loss_disc_real_3: 0.03747215121984482 (0.03747215121984482) | > loss_disc_real_4: 0.04391822591423988 (0.04391822591423988) | > loss_disc_real_5: 0.022475766018033028 (0.022475766018033028) | > loss_0: 1.0403133630752563 (1.0403133630752563) | > loss_gen: 2.9354350566864014 (2.9354350566864014) | > loss_kl: 5.777812957763672 (5.777812957763672) | > loss_feat: 17.578092575073242 (17.578092575073242) | > loss_mel: 28.4288387298584 (28.4288387298584) | > loss_duration: 3.6295244693756104 (3.6295244693756104) | > loss_1: 58.34970474243164 (58.34970474243164)  --> STEP: 2 | > loss_disc: 2.841095447540283 (1.9407044053077698) | > loss_disc_real_0: 0.09734250605106354 (0.05614978168159723) | > loss_disc_real_1: 0.2503580152988434 (0.15026124194264412) | > loss_disc_real_2: 0.3196536898612976 (0.18470759689807892) | > loss_disc_real_3: 0.26574811339378357 (0.1516101323068142) | > loss_disc_real_4: 0.25570544600486755 (0.14981183595955372) | > loss_disc_real_5: 0.24271482229232788 (0.13259529415518045) | > loss_0: 2.841095447540283 (1.9407044053077698) | > loss_gen: 1.7040549516677856 (2.3197450041770935) | > loss_kl: 6.8134918212890625 (6.295652389526367) | > loss_feat: 0.9199324250221252 (9.249012500047684) | > loss_mel: 15.05626392364502 (21.74255132675171) | > loss_duration: 3.3675479888916016 (3.498536229133606) | > loss_1: 27.861291885375977 (43.10549831390381)  --> STEP: 3 | > loss_disc: 2.5050649642944336 (2.1288245916366577) | > loss_disc_real_0: 0.2288030982017517 (0.11370088718831539) | > loss_disc_real_1: 0.34502965211868286 (0.21518404533465704) | > loss_disc_real_2: 0.19049929082393646 (0.18663816154003143) | > loss_disc_real_3: 0.25172409415245056 (0.1849814529220263) | > loss_disc_real_4: 0.27417853474617004 (0.19126740222175917) | > loss_disc_real_5: 0.2749705910682678 (0.1800537264595429) | > loss_0: 2.5050649642944336 (2.1288245916366577) | > loss_gen: 2.407613515853882 (2.3490345080693564) | > loss_kl: 2.662327766418457 (5.0845441818237305) | > loss_feat: 4.571571350097656 (7.6898654500643415) | > loss_mel: 22.996023178100586 (22.160375277201336) | > loss_duration: 3.1562142372131348 (3.3844288984934487) | > loss_1: 35.79375076293945 (40.66824913024902) --> EVAL PERFORMANCE | > avg_loader_time: 0.00238037109375 (-6.747245788574219e-05) | > avg_loss_disc: 2.1288245916366577 (-0.5513572295506797) | > avg_loss_disc_real_0: 0.11370088718831539 (-0.13093460040787855) | > avg_loss_disc_real_1: 0.21518404533465704 (-0.014410016437371553) | > avg_loss_disc_real_2: 0.18663816154003143 (-0.031072333455085754) | > avg_loss_disc_real_3: 0.1849814529220263 (-0.018682914475599943) | > avg_loss_disc_real_4: 0.19126740222175917 (-0.06746730084220567) | > avg_loss_disc_real_5: 0.1800537264595429 (-0.15600209869444373) | > avg_loss_0: 2.1288245916366577 (-0.5513572295506797) | > avg_loss_gen: 2.3490345080693564 (+0.1518939336140952) | > avg_loss_kl: 5.0845441818237305 (-0.4098667303721113) | > avg_loss_feat: 7.6898654500643415 (+1.8563486138979597) | > avg_loss_mel: 22.160375277201336 (+5.623772144317627) | > avg_loss_duration: 3.3844288984934487 (-0.002090136210123994) | > avg_loss_1: 40.66824913024902 (+7.220058123270668)  > EPOCH: 1385/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:59:09)   --> TIME: 2023-10-20 17:59:28 -- STEP: 29/50 -- GLOBAL_STEP: 122280 | > loss_disc: 2.0977954864501953 (2.315992811630513) | > loss_disc_real_0: 0.028631102293729782 (0.12050634417040594) | > loss_disc_real_1: 0.18788322806358337 (0.21486456409610552) | > loss_disc_real_2: 0.1162029579281807 (0.22332675780715613) | > loss_disc_real_3: 0.13556942343711853 (0.21118503089608817) | > loss_disc_real_4: 0.1958572119474411 (0.204880491798294) | > loss_disc_real_5: 0.30313563346862793 (0.21405022398665033) | > loss_0: 2.0977954864501953 (2.315992811630513) | > grad_norm_0: tensor(559.5411, device='cuda:0') (tensor(547.1271, device='cuda:0')) | > loss_gen: 2.453202724456787 (2.3686136623908736) | > loss_kl: 0.935214638710022 (0.8277939054472693) | > loss_feat: 6.87150239944458 (6.1478091575976075) | > loss_mel: 17.471923828125 (20.182078003883362) | > loss_duration: 1.3193086385726929 (1.291052719642376) | > loss_1: 29.0511531829834 (30.817347608763598) | > grad_norm_1: tensor(44507.2852, device='cuda:0') (tensor(22984.2832, device='cuda:0')) | > current_lr_0: 5.0060426053949755e-05 | > current_lr_1: 5.011051465073032e-05 | > step_time: 0.3158 (0.3272849526898614) | > loader_time: 0.0112 (0.008329860095320078)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.760991096496582 (2.760991096496582) | > loss_disc_real_0: 0.5074218511581421 (0.5074218511581421) | > loss_disc_real_1: 0.21424230933189392 (0.21424230933189392) | > loss_disc_real_2: 0.2518727779388428 (0.2518727779388428) | > loss_disc_real_3: 0.3068959712982178 (0.3068959712982178) | > loss_disc_real_4: 0.25023213028907776 (0.25023213028907776) | > loss_disc_real_5: 0.28646954894065857 (0.28646954894065857) | > loss_0: 2.760991096496582 (2.760991096496582) | > loss_gen: 2.501192808151245 (2.501192808151245) | > loss_kl: 5.8521409034729 (5.8521409034729) | > loss_feat: 4.458529949188232 (4.458529949188232) | > loss_mel: 21.57780647277832 (21.57780647277832) | > loss_duration: 3.327265739440918 (3.327265739440918) | > loss_1: 37.71693801879883 (37.71693801879883)  --> STEP: 1 | > loss_disc: 2.6798043251037598 (2.6798043251037598) | > loss_disc_real_0: 0.40528422594070435 (0.40528422594070435) | > loss_disc_real_1: 0.14146016538143158 (0.14146016538143158) | > loss_disc_real_2: 0.14941681921482086 (0.14941681921482086) | > loss_disc_real_3: 0.1282902956008911 (0.1282902956008911) | > loss_disc_real_4: 0.3053317368030548 (0.3053317368030548) | > loss_disc_real_5: 0.2277524769306183 (0.2277524769306183) | > loss_0: 2.6798043251037598 (2.6798043251037598) | > loss_gen: 1.9574662446975708 (1.9574662446975708) | > loss_kl: 6.113514423370361 (6.113514423370361) | > loss_feat: 5.3984904289245605 (5.3984904289245605) | > loss_mel: 24.286514282226562 (24.286514282226562) | > loss_duration: 3.645385980606079 (3.645385980606079) | > loss_1: 41.401371002197266 (41.401371002197266)  --> STEP: 2 | > loss_disc: 2.4737730026245117 (2.5767886638641357) | > loss_disc_real_0: 0.6052741408348083 (0.5052791833877563) | > loss_disc_real_1: 0.25959888100624084 (0.2005295231938362) | > loss_disc_real_2: 0.21048733592033386 (0.17995207756757736) | > loss_disc_real_3: 0.23454074561595917 (0.18141552060842514) | > loss_disc_real_4: 0.07897195965051651 (0.19215184822678566) | > loss_disc_real_5: 0.0712890699505806 (0.14952077344059944) | > loss_0: 2.4737730026245117 (2.5767886638641357) | > loss_gen: 2.544041395187378 (2.2507538199424744) | > loss_kl: 6.600313186645508 (6.356913805007935) | > loss_feat: 10.611662864685059 (8.00507664680481) | > loss_mel: 25.094594955444336 (24.69055461883545) | > loss_duration: 3.3651645183563232 (3.505275249481201) | > loss_1: 48.21577835083008 (44.80857467651367)  --> STEP: 3 | > loss_disc: 3.5030407905578613 (2.8855393727620444) | > loss_disc_real_0: 0.40629976987838745 (0.47228604555130005) | > loss_disc_real_1: 0.2763373851776123 (0.22579881052176157) | > loss_disc_real_2: 0.3276626765727997 (0.22918894390265146) | > loss_disc_real_3: 0.30031609535217285 (0.22104904552300772) | > loss_disc_real_4: 0.31514424085617065 (0.23314931243658066) | > loss_disc_real_5: 0.3639764189720154 (0.2210059886177381) | > loss_0: 3.5030407905578613 (2.8855393727620444) | > loss_gen: 1.7460289001464844 (2.0825121800104776) | > loss_kl: 2.9740376472473145 (5.229288419087728) | > loss_feat: 2.394850492477417 (6.135001262029012) | > loss_mel: 19.060935974121094 (22.814015070597332) | > loss_duration: 3.101762294769287 (3.3707709312438965) | > loss_1: 29.277616500854492 (39.63158861796061) --> EVAL PERFORMANCE | > avg_loader_time: 0.0067323048909505205 (+0.0043519337972005205) | > avg_loss_disc: 2.8855393727620444 (+0.7567147811253867) | > avg_loss_disc_real_0: 0.47228604555130005 (+0.35858515836298466) | > avg_loss_disc_real_1: 0.22579881052176157 (+0.010614765187104525) | > avg_loss_disc_real_2: 0.22918894390265146 (+0.04255078236262003) | > avg_loss_disc_real_3: 0.22104904552300772 (+0.03606759260098141) | > avg_loss_disc_real_4: 0.23314931243658066 (+0.04188191021482149) | > avg_loss_disc_real_5: 0.2210059886177381 (+0.040952262158195196) | > avg_loss_0: 2.8855393727620444 (+0.7567147811253867) | > avg_loss_gen: 2.0825121800104776 (-0.2665223280588789) | > avg_loss_kl: 5.229288419087728 (+0.1447442372639971) | > avg_loss_feat: 6.135001262029012 (-1.5548641880353298) | > avg_loss_mel: 22.814015070597332 (+0.6536397933959961) | > avg_loss_duration: 3.3707709312438965 (-0.01365796724955226) | > avg_loss_1: 39.63158861796061 (-1.0366605122884138)  > EPOCH: 1386/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 17:59:46)   --> TIME: 2023-10-20 18:00:00 -- STEP: 9/50 -- GLOBAL_STEP: 122310 | > loss_disc: 2.1053848266601562 (2.0459894869062634) | > loss_disc_real_0: 0.14762191474437714 (0.09861991533802615) | > loss_disc_real_1: 0.2877897620201111 (0.18410850564638773) | > loss_disc_real_2: 0.25226905941963196 (0.18562188651412725) | > loss_disc_real_3: 0.18607039749622345 (0.19381883864601454) | > loss_disc_real_4: 0.207990363240242 (0.15795940036574999) | > loss_disc_real_5: 0.06784945726394653 (0.14321032989149293) | > loss_0: 2.1053848266601562 (2.0459894869062634) | > grad_norm_0: tensor(329.9482, device='cuda:0') (tensor(407.5440, device='cuda:0')) | > loss_gen: 2.587900400161743 (2.5187798606024847) | > loss_kl: 1.0000261068344116 (0.6698383258448707) | > loss_feat: 6.368304252624512 (8.313216216034359) | > loss_mel: 22.094091415405273 (21.71700202094184) | > loss_duration: 1.3106787204742432 (1.3056702084011502) | > loss_1: 33.36100387573242 (34.524506674872505) | > grad_norm_1: tensor(5618.1304, device='cuda:0') (tensor(19258.5586, device='cuda:0')) | > current_lr_0: 5.0010387523857686e-05 | > current_lr_1: 5.0060426053949755e-05 | > step_time: 0.3234 (0.3298473093244765) | > loader_time: 0.0126 (0.012040270699395074)  --> TIME: 2023-10-20 18:00:10 -- STEP: 39/50 -- GLOBAL_STEP: 122340 | > loss_disc: 2.0125646591186523 (2.340264818607232) | > loss_disc_real_0: 0.026531247422099113 (0.11818267326228894) | > loss_disc_real_1: 0.19019284844398499 (0.20536937001041877) | > loss_disc_real_2: 0.26504436135292053 (0.22443177968932268) | > loss_disc_real_3: 0.09900015592575073 (0.21740758495453077) | > loss_disc_real_4: 0.27666687965393066 (0.21546190657103673) | > loss_disc_real_5: 0.4125604033470154 (0.23042416552272746) | > loss_0: 2.0125646591186523 (2.340264818607232) | > grad_norm_0: tensor(388.7456, device='cuda:0') (tensor(506.7259, device='cuda:0')) | > loss_gen: 3.1287026405334473 (2.3788113380089793) | > loss_kl: 0.9810919761657715 (0.8223755585077481) | > loss_feat: 8.407490730285645 (6.494852574685446) | > loss_mel: 22.303857803344727 (20.325394052725567) | > loss_duration: 1.3381258249282837 (1.282501492744837) | > loss_1: 36.159271240234375 (31.30393509987073) | > grad_norm_1: tensor(6315.7095, device='cuda:0') (tensor(16560.5547, device='cuda:0')) | > current_lr_0: 5.0010387523857686e-05 | > current_lr_1: 5.0060426053949755e-05 | > step_time: 0.3221 (0.328413107456305) | > loader_time: 0.0134 (0.009833837166810647)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.663541793823242 (2.663541793823242) | > loss_disc_real_0: 0.26134800910949707 (0.26134800910949707) | > loss_disc_real_1: 0.18589916825294495 (0.18589916825294495) | > loss_disc_real_2: 0.1734868437051773 (0.1734868437051773) | > loss_disc_real_3: 0.19549524784088135 (0.19549524784088135) | > loss_disc_real_4: 0.21040929853916168 (0.21040929853916168) | > loss_disc_real_5: 0.2738848030567169 (0.2738848030567169) | > loss_0: 2.663541793823242 (2.663541793823242) | > loss_gen: 1.928614616394043 (1.928614616394043) | > loss_kl: 6.537901878356934 (6.537901878356934) | > loss_feat: 9.900006294250488 (9.900006294250488) | > loss_mel: 20.61441421508789 (20.61441421508789) | > loss_duration: 3.266401529312134 (3.266401529312134) | > loss_1: 42.24734115600586 (42.24734115600586)  --> STEP: 1 | > loss_disc: 3.088407516479492 (3.088407516479492) | > loss_disc_real_0: 0.36016467213630676 (0.36016467213630676) | > loss_disc_real_1: 0.2725389003753662 (0.2725389003753662) | > loss_disc_real_2: 0.2685641348361969 (0.2685641348361969) | > loss_disc_real_3: 0.21251800656318665 (0.21251800656318665) | > loss_disc_real_4: 0.2709774374961853 (0.2709774374961853) | > loss_disc_real_5: 0.23167629539966583 (0.23167629539966583) | > loss_0: 3.088407516479492 (3.088407516479492) | > loss_gen: 1.7349332571029663 (1.7349332571029663) | > loss_kl: 6.3208842277526855 (6.3208842277526855) | > loss_feat: 3.690519094467163 (3.690519094467163) | > loss_mel: 21.637096405029297 (21.637096405029297) | > loss_duration: 3.5653421878814697 (3.5653421878814697) | > loss_1: 36.94877243041992 (36.94877243041992)  --> STEP: 2 | > loss_disc: 2.788778781890869 (2.9385931491851807) | > loss_disc_real_0: 0.1484445035457611 (0.25430458784103394) | > loss_disc_real_1: 0.28330186009407043 (0.2779203802347183) | > loss_disc_real_2: 0.29051294922828674 (0.2795385420322418) | > loss_disc_real_3: 0.3123377561569214 (0.262427881360054) | > loss_disc_real_4: 0.2890529930591583 (0.2800152152776718) | > loss_disc_real_5: 0.311568021774292 (0.2716221585869789) | > loss_0: 2.788778781890869 (2.9385931491851807) | > loss_gen: 2.152740478515625 (1.9438368678092957) | > loss_kl: 7.133639812469482 (6.727262020111084) | > loss_feat: 3.0183916091918945 (3.354455351829529) | > loss_mel: 23.269384384155273 (22.453240394592285) | > loss_duration: 3.3774325847625732 (3.4713873863220215) | > loss_1: 38.95159149169922 (37.95018196105957)  --> STEP: 3 | > loss_disc: 3.031613349914551 (2.969599882761637) | > loss_disc_real_0: 0.6088334321975708 (0.3724808692932129) | > loss_disc_real_1: 0.2914462387561798 (0.28242899974187213) | > loss_disc_real_2: 0.23461227118968964 (0.26456311841805774) | > loss_disc_real_3: 0.25119444727897644 (0.25868340333302814) | > loss_disc_real_4: 0.21614092588424683 (0.25872378547986347) | > loss_disc_real_5: 0.29644158482551575 (0.2798953006664912) | > loss_0: 3.031613349914551 (2.969599882761637) | > loss_gen: 2.1037514209747314 (1.997141718864441) | > loss_kl: 3.0294930934906006 (5.494672377904256) | > loss_feat: 1.3010995388031006 (2.6700034141540527) | > loss_mel: 15.270669937133789 (20.05905024210612) | > loss_duration: 3.148317337036133 (3.363697369893392) | > loss_1: 24.85333251953125 (33.58456548055013) --> EVAL PERFORMANCE | > avg_loader_time: 0.009588082631429037 (+0.0028557777404785165) | > avg_loss_disc: 2.969599882761637 (+0.0840605099995928) | > avg_loss_disc_real_0: 0.3724808692932129 (-0.09980517625808716) | > avg_loss_disc_real_1: 0.28242899974187213 (+0.056630189220110566) | > avg_loss_disc_real_2: 0.26456311841805774 (+0.03537417451540628) | > avg_loss_disc_real_3: 0.25868340333302814 (+0.03763435781002042) | > avg_loss_disc_real_4: 0.25872378547986347 (+0.025574473043282808) | > avg_loss_disc_real_5: 0.2798953006664912 (+0.05888931204875311) | > avg_loss_0: 2.969599882761637 (+0.0840605099995928) | > avg_loss_gen: 1.997141718864441 (-0.08537046114603664) | > avg_loss_kl: 5.494672377904256 (+0.2653839588165283) | > avg_loss_feat: 2.6700034141540527 (-3.464997847874959) | > avg_loss_mel: 20.05905024210612 (-2.754964828491211) | > avg_loss_duration: 3.363697369893392 (-0.007073561350504409) | > avg_loss_1: 33.58456548055013 (-6.047023137410477)  > EPOCH: 1387/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 18:00:25)   --> TIME: 2023-10-20 18:00:43 -- STEP: 19/50 -- GLOBAL_STEP: 122370 | > loss_disc: 2.9255526065826416 (2.396455827512239) | > loss_disc_real_0: 0.2165139615535736 (0.14748264751151988) | > loss_disc_real_1: 0.3249050974845886 (0.21394951023945682) | > loss_disc_real_2: 0.23465321958065033 (0.21786533649030485) | > loss_disc_real_3: 0.34930312633514404 (0.21919039293731513) | > loss_disc_real_4: 0.4013964533805847 (0.20561674021576581) | > loss_disc_real_5: 0.3858504891395569 (0.20788136997113102) | > loss_0: 2.9255526065826416 (2.396455827512239) | > grad_norm_0: tensor(528.6450, device='cuda:0') (tensor(593.9572, device='cuda:0')) | > loss_gen: 2.2136805057525635 (2.292175575306541) | > loss_kl: 0.9592264890670776 (0.719129102010476) | > loss_feat: 2.8654212951660156 (6.744584419225392) | > loss_mel: 21.158878326416016 (21.311250059228193) | > loss_duration: 1.38023042678833 (1.3298593320344623) | > loss_1: 28.577436447143555 (32.396998957583776) | > grad_norm_1: tensor(2706.3955, device='cuda:0') (tensor(22208.2227, device='cuda:0')) | > current_lr_0: 4.9960399010409324e-05 | > current_lr_1: 5.0010387523857686e-05 | > step_time: 0.3274 (0.34065034514979314) | > loader_time: 0.009 (0.009376300008673417)  --> TIME: 2023-10-20 18:00:54 -- STEP: 49/50 -- GLOBAL_STEP: 122400 | > loss_disc: 2.955639362335205 (2.4162201638124423) | > loss_disc_real_0: 0.3208874464035034 (0.15160227051879074) | > loss_disc_real_1: 0.26988065242767334 (0.21916374355098422) | > loss_disc_real_2: 0.2512403726577759 (0.22280314002110033) | > loss_disc_real_3: 0.23015017807483673 (0.23711852786340276) | > loss_disc_real_4: 0.25552889704704285 (0.2203821111090329) | > loss_disc_real_5: 0.2650730609893799 (0.2120019987757717) | > loss_0: 2.955639362335205 (2.4162201638124423) | > grad_norm_0: tensor(1203.3781, device='cuda:0') (tensor(802.4697, device='cuda:0')) | > loss_gen: 1.6190065145492554 (2.2897713354655687) | > loss_kl: 0.5981838703155518 (0.7037346624598211) | > loss_feat: 0.19871607422828674 (6.0394475776512095) | > loss_mel: 5.157136917114258 (20.2437056230039) | > loss_duration: 1.3889737129211426 (1.2893946523569069) | > loss_1: 8.962017059326172 (30.56605381868323) | > grad_norm_1: tensor(9382.0029, device='cuda:0') (tensor(22278.4531, device='cuda:0')) | > current_lr_0: 4.9960399010409324e-05 | > current_lr_1: 5.0010387523857686e-05 | > step_time: 0.9262 (0.3459500974538375) | > loader_time: 0.537 (0.01922393818290866)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.0119948387145996 (3.0119948387145996) | > loss_disc_real_0: 0.27828580141067505 (0.27828580141067505) | > loss_disc_real_1: 0.2493741512298584 (0.2493741512298584) | > loss_disc_real_2: 0.24704305827617645 (0.24704305827617645) | > loss_disc_real_3: 0.2241038978099823 (0.2241038978099823) | > loss_disc_real_4: 0.2463361620903015 (0.2463361620903015) | > loss_disc_real_5: 0.22391951084136963 (0.22391951084136963) | > loss_0: 3.0119948387145996 (3.0119948387145996) | > loss_gen: 1.4960579872131348 (1.4960579872131348) | > loss_kl: 6.60556697845459 (6.60556697845459) | > loss_feat: 0.536892831325531 (0.536892831325531) | > loss_mel: 7.381156921386719 (7.381156921386719) | > loss_duration: 3.1782472133636475 (3.1782472133636475) | > loss_1: 19.197921752929688 (19.197921752929688)  --> STEP: 1 | > loss_disc: 2.8580381870269775 (2.8580381870269775) | > loss_disc_real_0: 0.23802265524864197 (0.23802265524864197) | > loss_disc_real_1: 0.26852694153785706 (0.26852694153785706) | > loss_disc_real_2: 0.26018017530441284 (0.26018017530441284) | > loss_disc_real_3: 0.2320430725812912 (0.2320430725812912) | > loss_disc_real_4: 0.25593581795692444 (0.25593581795692444) | > loss_disc_real_5: 0.26603448390960693 (0.26603448390960693) | > loss_0: 2.8580381870269775 (2.8580381870269775) | > loss_gen: 1.7049176692962646 (1.7049176692962646) | > loss_kl: 6.017825603485107 (6.017825603485107) | > loss_feat: 0.3609028458595276 (0.3609028458595276) | > loss_mel: 12.705613136291504 (12.705613136291504) | > loss_duration: 3.60687518119812 (3.60687518119812) | > loss_1: 24.396133422851562 (24.396133422851562)  --> STEP: 2 | > loss_disc: 2.9717960357666016 (2.9149171113967896) | > loss_disc_real_0: 0.28804582357406616 (0.26303423941135406) | > loss_disc_real_1: 0.26882869005203247 (0.26867781579494476) | > loss_disc_real_2: 0.25901004672050476 (0.2595951110124588) | > loss_disc_real_3: 0.23082922399044037 (0.23143614828586578) | > loss_disc_real_4: 0.25582775473594666 (0.25588178634643555) | > loss_disc_real_5: 0.26586997509002686 (0.2659522294998169) | > loss_0: 2.9717960357666016 (2.9149171113967896) | > loss_gen: 1.6062592267990112 (1.655588448047638) | > loss_kl: 6.626989841461182 (6.3224077224731445) | > loss_feat: 0.09117357432842255 (0.22603821009397507) | > loss_mel: 1.6119543313980103 (7.158783733844757) | > loss_duration: 3.407191276550293 (3.5070332288742065) | > loss_1: 13.343568801879883 (18.869851112365723)  --> STEP: 3 | > loss_disc: 2.5662953853607178 (2.7987098693847656) | > loss_disc_real_0: 0.21755924820899963 (0.24787590901056925) | > loss_disc_real_1: 0.25416725873947144 (0.2638409634431203) | > loss_disc_real_2: 0.3526158034801483 (0.29060200850168866) | > loss_disc_real_3: 0.27125200629234314 (0.24470810095469156) | > loss_disc_real_4: 0.28007224202156067 (0.26394527157147724) | > loss_disc_real_5: 0.2978385388851166 (0.2765809992949168) | > loss_0: 2.5662953853607178 (2.7987098693847656) | > loss_gen: 2.7744388580322266 (2.0285385847091675) | > loss_kl: 2.932063102722168 (5.192292849222819) | > loss_feat: 4.86464262008667 (1.77223968009154) | > loss_mel: 19.80729103088379 (11.374952832857767) | > loss_duration: 3.1262757778167725 (3.3801140785217285) | > loss_1: 33.50471115112305 (23.748137791951496) --> EVAL PERFORMANCE | > avg_loader_time: 0.005040725072224935 (-0.004547357559204102) | > avg_loss_disc: 2.7987098693847656 (-0.1708900133768716) | > avg_loss_disc_real_0: 0.24787590901056925 (-0.12460496028264365) | > avg_loss_disc_real_1: 0.2638409634431203 (-0.01858803629875183) | > avg_loss_disc_real_2: 0.29060200850168866 (+0.026038890083630917) | > avg_loss_disc_real_3: 0.24470810095469156 (-0.01397530237833658) | > avg_loss_disc_real_4: 0.26394527157147724 (+0.0052214860916137695) | > avg_loss_disc_real_5: 0.2765809992949168 (-0.003314301371574402) | > avg_loss_0: 2.7987098693847656 (-0.1708900133768716) | > avg_loss_gen: 2.0285385847091675 (+0.03139686584472656) | > avg_loss_kl: 5.192292849222819 (-0.3023795286814366) | > avg_loss_feat: 1.77223968009154 (-0.8977637340625126) | > avg_loss_mel: 11.374952832857767 (-8.684097409248354) | > avg_loss_duration: 3.3801140785217285 (+0.01641670862833644) | > avg_loss_1: 23.748137791951496 (-9.836427688598636)  > EPOCH: 1388/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 18:01:04)   --> TIME: 2023-10-20 18:01:24 -- STEP: 29/50 -- GLOBAL_STEP: 122430 | > loss_disc: 2.0426948070526123 (2.494565560899932) | > loss_disc_real_0: 0.037216171622276306 (0.12640525259334465) | > loss_disc_real_1: 0.1784285008907318 (0.21288135288090543) | > loss_disc_real_2: 0.14546772837638855 (0.240929144723662) | > loss_disc_real_3: 0.22542263567447662 (0.24506332076572138) | > loss_disc_real_4: 0.122898630797863 (0.23549770101391035) | > loss_disc_real_5: 0.20238171517848969 (0.2459339994680266) | > loss_0: 2.0426948070526123 (2.494565560899932) | > grad_norm_0: tensor(533.8553, device='cuda:0') (tensor(551.1029, device='cuda:0')) | > loss_gen: 2.4227511882781982 (2.1961824770631457) | > loss_kl: 1.0532559156417847 (0.9058666342291338) | > loss_feat: 5.133174896240234 (5.055198437181012) | > loss_mel: 20.717811584472656 (18.82456268113235) | > loss_duration: 1.2925069332122803 (1.284921387146259) | > loss_1: 30.6195011138916 (28.26673150884694) | > grad_norm_1: tensor(11251.1318, device='cuda:0') (tensor(16567.6250, device='cuda:0')) | > current_lr_0: 4.99104604636099e-05 | > current_lr_1: 4.9960399010409324e-05 | > step_time: 0.3254 (0.32595666523637445) | > loader_time: 0.0147 (0.011485782162896517)  > EVALUATION   --> STEP: 0 | > loss_disc: 2.710296630859375 (2.710296630859375) | > loss_disc_real_0: 0.33940595388412476 (0.33940595388412476) | > loss_disc_real_1: 0.2603665590286255 (0.2603665590286255) | > loss_disc_real_2: 0.18763884902000427 (0.18763884902000427) | > loss_disc_real_3: 0.2136177271604538 (0.2136177271604538) | > loss_disc_real_4: 0.14366987347602844 (0.14366987347602844) | > loss_disc_real_5: 0.2558133900165558 (0.2558133900165558) | > loss_0: 2.710296630859375 (2.710296630859375) | > loss_gen: 1.9622374773025513 (1.9622374773025513) | > loss_kl: 6.603827953338623 (6.603827953338623) | > loss_feat: 6.052294731140137 (6.052294731140137) | > loss_mel: 24.546146392822266 (24.546146392822266) | > loss_duration: 3.234895944595337 (3.234895944595337) | > loss_1: 42.39940643310547 (42.39940643310547)  --> STEP: 1 | > loss_disc: 2.882615089416504 (2.882615089416504) | > loss_disc_real_0: 0.15819412469863892 (0.15819412469863892) | > loss_disc_real_1: 0.20185932517051697 (0.20185932517051697) | > loss_disc_real_2: 0.3229210078716278 (0.3229210078716278) | > loss_disc_real_3: 0.2677752375602722 (0.2677752375602722) | > loss_disc_real_4: 0.4347531497478485 (0.4347531497478485) | > loss_disc_real_5: 0.351494163274765 (0.351494163274765) | > loss_0: 2.882615089416504 (2.882615089416504) | > loss_gen: 2.114729881286621 (2.114729881286621) | > loss_kl: 6.354005813598633 (6.354005813598633) | > loss_feat: 6.713897228240967 (6.713897228240967) | > loss_mel: 24.197458267211914 (24.197458267211914) | > loss_duration: 3.558647394180298 (3.558647394180298) | > loss_1: 42.93873977661133 (42.93873977661133)  --> STEP: 2 | > loss_disc: 3.3022408485412598 (3.092427968978882) | > loss_disc_real_0: 0.04677046090364456 (0.10248229280114174) | > loss_disc_real_1: 0.23048420250415802 (0.2161717638373375) | > loss_disc_real_2: 0.18407893180847168 (0.25349996984004974) | > loss_disc_real_3: 0.23931871354579926 (0.25354697555303574) | > loss_disc_real_4: 0.2565292418003082 (0.34564119577407837) | > loss_disc_real_5: 0.3185745179653168 (0.3350343406200409) | > loss_0: 3.3022408485412598 (3.092427968978882) | > loss_gen: 1.2830451726913452 (1.6988875269889832) | > loss_kl: 7.120041847229004 (6.737023830413818) | > loss_feat: 11.072823524475098 (8.893360376358032) | > loss_mel: 25.146867752075195 (24.672163009643555) | > loss_duration: 3.463200330734253 (3.5109238624572754) | > loss_1: 48.08597946166992 (45.512359619140625)  --> STEP: 3 | > loss_disc: 2.8650448322296143 (3.0166335900624595) | > loss_disc_real_0: 0.2158682942390442 (0.14027762661377588) | > loss_disc_real_1: 0.3528956472873688 (0.2617463916540146) | > loss_disc_real_2: 0.3130379319190979 (0.2733459571997325) | > loss_disc_real_3: 0.3744887411594391 (0.29386089742183685) | > loss_disc_real_4: 0.2919332683086395 (0.32773855328559875) | > loss_disc_real_5: 0.2127118855714798 (0.2942601889371872) | > loss_0: 2.8650448322296143 (3.0166335900624595) | > loss_gen: 2.1952178478240967 (1.8643309672673543) | > loss_kl: 3.0456137657165527 (5.5065538088480634) | > loss_feat: 3.337003707885742 (7.041241486867269) | > loss_mel: 20.241138458251953 (23.195154825846355) | > loss_duration: 3.1579506397247314 (3.3932661215464273) | > loss_1: 31.976924896240234 (41.00054804484049) --> EVAL PERFORMANCE | > avg_loader_time: 0.005487203598022461 (+0.00044647852579752633) | > avg_loss_disc: 3.0166335900624595 (+0.21792372067769383) | > avg_loss_disc_real_0: 0.14027762661377588 (-0.10759828239679337) | > avg_loss_disc_real_1: 0.2617463916540146 (-0.0020945717891057147) | > avg_loss_disc_real_2: 0.2733459571997325 (-0.017256051301956177) | > avg_loss_disc_real_3: 0.29386089742183685 (+0.04915279646714529) | > avg_loss_disc_real_4: 0.32773855328559875 (+0.06379328171412152) | > avg_loss_disc_real_5: 0.2942601889371872 (+0.017679189642270388) | > avg_loss_0: 3.0166335900624595 (+0.21792372067769383) | > avg_loss_gen: 1.8643309672673543 (-0.16420761744181323) | > avg_loss_kl: 5.5065538088480634 (+0.31426095962524414) | > avg_loss_feat: 7.041241486867269 (+5.269001806775728) | > avg_loss_mel: 23.195154825846355 (+11.820201992988588) | > avg_loss_duration: 3.3932661215464273 (+0.013152043024698745) | > avg_loss_1: 41.00054804484049 (+17.252410252888996)  > EPOCH: 1389/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 18:01:43)   --> TIME: 2023-10-20 18:01:57 -- STEP: 9/50 -- GLOBAL_STEP: 122460 | > loss_disc: 1.9672448635101318 (2.2306407160229154) | > loss_disc_real_0: 0.18168264627456665 (0.10501148303349812) | > loss_disc_real_1: 0.268627405166626 (0.17822753224107954) | > loss_disc_real_2: 0.29063913226127625 (0.22439758562379414) | > loss_disc_real_3: 0.23987635970115662 (0.19902339577674866) | > loss_disc_real_4: 0.11547654122114182 (0.20394572181006274) | > loss_disc_real_5: 0.13428953289985657 (0.18637721778617966) | > loss_0: 1.9672448635101318 (2.2306407160229154) | > grad_norm_0: tensor(664.1508, device='cuda:0') (tensor(487.4695, device='cuda:0')) | > loss_gen: 3.210723876953125 (2.4233634736802845) | > loss_kl: 0.5590148568153381 (0.7079009347491794) | > loss_feat: 7.438332557678223 (6.855996996992165) | > loss_mel: 23.6958065032959 (19.6918629805247) | > loss_duration: 1.2511042356491089 (1.2844317621654935) | > loss_1: 36.15497970581055 (30.963555547926163) | > grad_norm_1: tensor(17967.0801, device='cuda:0') (tensor(19905.7324, device='cuda:0')) | > current_lr_0: 4.9860571833514615e-05 | > current_lr_1: 4.99104604636099e-05 | > step_time: 0.3398 (0.3292324013180203) | > loader_time: 0.0146 (0.011104610231187608)  --> TIME: 2023-10-20 18:02:07 -- STEP: 39/50 -- GLOBAL_STEP: 122490 | > loss_disc: 1.757526159286499 (2.3685772388409343) | > loss_disc_real_0: 0.030537622049450874 (0.13877872654642812) | > loss_disc_real_1: 0.13127383589744568 (0.21110866581782317) | > loss_disc_real_2: 0.07702812552452087 (0.2041778253057064) | > loss_disc_real_3: 0.08053605258464813 (0.22768071847848403) | > loss_disc_real_4: 0.13640163838863373 (0.21798837485794836) | > loss_disc_real_5: 0.12434367835521698 (0.20723064339313751) | > loss_0: 1.757526159286499 (2.3685772388409343) | > grad_norm_0: tensor(816.7641, device='cuda:0') (tensor(552.0768, device='cuda:0')) | > loss_gen: 2.3212051391601562 (2.2496492801568455) | > loss_kl: 0.49404627084732056 (0.7360418110321731) | > loss_feat: 7.86184024810791 (5.5478047637794266) | > loss_mel: 21.011545181274414 (19.681470669232883) | > loss_duration: 1.3037909269332886 (1.2744449071395092) | > loss_1: 32.992427825927734 (29.489411366291534) | > grad_norm_1: tensor(15842.7891, device='cuda:0') (tensor(19114.2773, device='cuda:0')) | > current_lr_0: 4.9860571833514615e-05 | > current_lr_1: 4.99104604636099e-05 | > step_time: 0.2476 (0.32573570960607284) | > loader_time: 0.0024 (0.00802451524979029)  > EVALUATION   --> STEP: 0 | > loss_disc: 3.126354694366455 (3.126354694366455) | > loss_disc_real_0: 0.4585871398448944 (0.4585871398448944) | > loss_disc_real_1: 0.2543623149394989 (0.2543623149394989) | > loss_disc_real_2: 0.271098792552948 (0.271098792552948) | > loss_disc_real_3: 0.291004478931427 (0.291004478931427) | > loss_disc_real_4: 0.24768109619617462 (0.24768109619617462) | > loss_disc_real_5: 0.2861190438270569 (0.2861190438270569) | > loss_0: 3.126354694366455 (3.126354694366455) | > loss_gen: 2.2357442378997803 (2.2357442378997803) | > loss_kl: 6.528903961181641 (6.528903961181641) | > loss_feat: 8.851153373718262 (8.851153373718262) | > loss_mel: 20.530607223510742 (20.530607223510742) | > loss_duration: 3.209707736968994 (3.209707736968994) | > loss_1: 41.356117248535156 (41.356117248535156)  --> STEP: 1 | > loss_disc: 1.8872768878936768 (1.8872768878936768) | > loss_disc_real_0: 0.2095390260219574 (0.2095390260219574) | > loss_disc_real_1: 0.21558481454849243 (0.21558481454849243) | > loss_disc_real_2: 0.2165428102016449 (0.2165428102016449) | > loss_disc_real_3: 0.16099420189857483 (0.16099420189857483) | > loss_disc_real_4: 0.1295040249824524 (0.1295040249824524) | > loss_disc_real_5: 0.19452054798603058 (0.19452054798603058) | > loss_0: 1.8872768878936768 (1.8872768878936768) | > loss_gen: 2.7763569355010986 (2.7763569355010986) | > loss_kl: 5.90897798538208 (5.90897798538208) | > loss_feat: 8.149456977844238 (8.149456977844238) | > loss_mel: 22.912975311279297 (22.912975311279297) | > loss_duration: 3.6359832286834717 (3.6359832286834717) | > loss_1: 43.383750915527344 (43.383750915527344)  --> STEP: 2 | > loss_disc: 2.639608383178711 (2.263442635536194) | > loss_disc_real_0: 0.34716230630874634 (0.27835066616535187) | > loss_disc_real_1: 0.17569595575332642 (0.19564038515090942) | > loss_disc_real_2: 0.17415164411067963 (0.19534722715616226) | > loss_disc_real_3: 0.1890210211277008 (0.17500761151313782) | > loss_disc_real_4: 0.3189074695110321 (0.22420574724674225) | > loss_disc_real_5: 0.38743576407432556 (0.29097815603017807) | > loss_0: 2.639608383178711 (2.263442635536194) | > loss_gen: 2.5979790687561035 (2.687168002128601) | > loss_kl: 6.892714023590088 (6.400846004486084) | > loss_feat: 6.388965606689453 (7.269211292266846) | > loss_mel: 21.271841049194336 (22.092408180236816) | > loss_duration: 3.405294418334961 (3.5206388235092163) | > loss_1: 40.556793212890625 (41.970272064208984)  --> STEP: 3 | > loss_disc: 2.8882484436035156 (2.4717112382253013) | > loss_disc_real_0: 0.22047965228557587 (0.2590603282054265) | > loss_disc_real_1: 0.24730193614959717 (0.21286090215047201) | > loss_disc_real_2: 0.2402566522359848 (0.21031703551610312) | > loss_disc_real_3: 0.2958836853504181 (0.21529963612556458) | > loss_disc_real_4: 0.25972920656204224 (0.23604690035184225) | > loss_disc_real_5: 0.3637259602546692 (0.3152274241050084) | > loss_0: 2.8882484436035156 (2.4717112382253013) | > loss_gen: 1.87126886844635 (2.4152016242345176) | > loss_kl: 2.9705216884613037 (5.257404565811157) | > loss_feat: 2.4570586681365967 (5.665160417556763) | > loss_mel: 18.456520080566406 (20.88044548034668) | > loss_duration: 3.1457679271698 (3.395681858062744) | > loss_1: 28.90113639831543 (37.61389350891113) --> EVAL PERFORMANCE | > avg_loader_time: 0.003157933553059896 (-0.002329270044962565) | > avg_loss_disc: 2.4717112382253013 (-0.5449223518371582) | > avg_loss_disc_real_0: 0.2590603282054265 (+0.11878270159165064) | > avg_loss_disc_real_1: 0.21286090215047201 (-0.04888548950354257) | > avg_loss_disc_real_2: 0.21031703551610312 (-0.06302892168362936) | > avg_loss_disc_real_3: 0.21529963612556458 (-0.07856126129627228) | > avg_loss_disc_real_4: 0.23604690035184225 (-0.0916916529337565) | > avg_loss_disc_real_5: 0.3152274241050084 (+0.02096723516782123) | > avg_loss_0: 2.4717112382253013 (-0.5449223518371582) | > avg_loss_gen: 2.4152016242345176 (+0.5508706569671633) | > avg_loss_kl: 5.257404565811157 (-0.24914924303690622) | > avg_loss_feat: 5.665160417556763 (-1.3760810693105059) | > avg_loss_mel: 20.88044548034668 (-2.3147093454996757) | > avg_loss_duration: 3.395681858062744 (+0.00241573651631688) | > avg_loss_1: 37.61389350891113 (-3.3866545359293596)  > EPOCH: 1390/2000 --> runs/persian-tts-vits-grapheme-arman24-FINETUNED-October-19-2023_11+40PM-0000000  > TRAINING (2023-10-20 18:02:20)